2023-10-09T06:23:44.323 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-09T06:23:44.323 DEBUG:teuthology.run:Teuthology command: teuthology --name vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} --archive /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418378 --verbose --owner scheduled_vshankar@teuthology -- /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418378/orig.config.yaml 2023-10-09T06:23:44.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T06:23:44.456 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418378 branch: wip-yuri-testing-2023-10-06-0949-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} email: vshankar@redhat.com first_in_suite: false job_id: '7418378' kernel: client: branch: testing flavor: default kdb: true sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-10-06-0949-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20231009.053123 sha1: 62a27f0d8453e2104f759ed08ba781e24c5ed056 owner: scheduled_vshankar@teuthology priority: 30 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8174 sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-vshankar-testing-20231009.053123 suite_path: /home/teuthworker/src/github.com_vshankar_ceph_62a27f0d8453e2104f759ed08ba781e24c5ed056/qa suite_relpath: qa suite_repo: https://github.com/vshankar/ceph.git suite_sha1: 62a27f0d8453e2104f759ed08ba781e24c5ed056 targets: smithi071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIRJ4qdiIKOm6ZBaxD08Dwdvukm3DT3qdA2DfHnyFLPGYl92IveRjBn6erkhNm843iVuL8hVdADiSgBNrFomEVg= smithi179.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEnRlHUHakBP4LvTw/XdcGQUfDtTX9A81YyPazj2kbMbDrSdwTKfcH6UUpEyvmwY6Xe0P/7RwCnyNSPbv/m769k= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-09_05:36:44 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-09T06:23:44.456 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_vshankar_ceph_62a27f0d8453e2104f759ed08ba781e24c5ed056/qa; will attempt to use it 2023-10-09T06:23:44.457 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_vshankar_ceph_62a27f0d8453e2104f759ed08ba781e24c5ed056/qa/tasks 2023-10-09T06:23:44.457 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-09T06:23:44.459 INFO:teuthology.task.internal:Checking packages... 2023-10-09T06:23:44.481 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '08cac0187919fc3a247efdf445f652e2fb30a647' 2023-10-09T06:23:44.482 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-09T06:23:44.482 INFO:teuthology.packaging:ref: None 2023-10-09T06:23:44.482 INFO:teuthology.packaging:tag: None 2023-10-09T06:23:44.482 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-06-0949-quincy 2023-10-09T06:23:44.482 INFO:teuthology.packaging:sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T06:23:44.482 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-06-0949-quincy 2023-10-09T06:23:44.710 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1320.g08cac018 2023-10-09T06:23:44.710 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-09T06:23:44.716 INFO:teuthology.task.internal:no buildpackages task found 2023-10-09T06:23:44.717 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-09T06:23:44.724 INFO:teuthology.task.internal:Saving configuration 2023-10-09T06:23:44.741 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-09T06:23:44.746 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T06:23:44.771 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418378', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 06:18:38.723216', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIRJ4qdiIKOm6ZBaxD08Dwdvukm3DT3qdA2DfHnyFLPGYl92IveRjBn6erkhNm843iVuL8hVdADiSgBNrFomEVg='} 2023-10-09T06:23:44.794 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418378', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 06:18:38.725099', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEnRlHUHakBP4LvTw/XdcGQUfDtTX9A81YyPazj2kbMbDrSdwTKfcH6UUpEyvmwY6Xe0P/7RwCnyNSPbv/m769k='} 2023-10-09T06:23:44.794 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-09T06:23:44.800 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-09T06:23:44.800 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-09T06:23:44.800 INFO:teuthology.run_tasks:Running task console_log... 2023-10-09T06:23:44.870 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f407cdf1b80>, signals=[15]) 2023-10-09T06:23:44.870 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-09T06:23:44.876 INFO:teuthology.task.internal:Opening connections... 2023-10-09T06:23:44.876 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T06:23:44.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:23:44.943 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi179.front.sepia.ceph.com 2023-10-09T06:23:44.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:23:45.013 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-09T06:23:45.019 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2023-10-09T06:23:45.036 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2023-10-09T06:23:45.037 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2023-10-09T06:23:45.089 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="Red Hat Enterprise Linux" 2023-10-09T06:23:45.090 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8.4 (Ootpa)" 2023-10-09T06:23:45.090 INFO:teuthology.orchestra.run.smithi071.stdout:ID="rhel" 2023-10-09T06:23:45.090 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="fedora" 2023-10-09T06:23:45.090 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8.4" 2023-10-09T06:23:45.090 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2023-10-09T06:23:45.090 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-09T06:23:45.090 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2023-10-09T06:23:45.090 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-09T06:23:45.090 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://www.redhat.com/" 2023-10-09T06:23:45.090 INFO:teuthology.orchestra.run.smithi071.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-09T06:23:45.091 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-09T06:23:45.091 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:23:45.091 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-09T06:23:45.091 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-09T06:23:45.091 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-09T06:23:45.091 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-09T06:23:45.092 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2023-10-09T06:23:45.113 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2023-10-09T06:23:45.130 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2023-10-09T06:23:45.131 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-10-09T06:23:45.186 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux" 2023-10-09T06:23:45.187 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.4 (Ootpa)" 2023-10-09T06:23:45.187 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel" 2023-10-09T06:23:45.187 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora" 2023-10-09T06:23:45.187 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.4" 2023-10-09T06:23:45.187 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-10-09T06:23:45.187 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-09T06:23:45.187 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-10-09T06:23:45.187 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-09T06:23:45.187 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/" 2023-10-09T06:23:45.187 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-09T06:23:45.187 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-09T06:23:45.188 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:23:45.188 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-09T06:23:45.188 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-09T06:23:45.188 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-09T06:23:45.188 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-09T06:23:45.188 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-10-09T06:23:45.213 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-09T06:23:45.223 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-09T06:23:45.256 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-09T06:23:45.257 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2023-10-09T06:23:45.259 DEBUG:teuthology.orchestra.run.smithi179:> test '!' -e /home/ubuntu/cephtest 2023-10-09T06:23:45.275 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-09T06:23:45.281 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-09T06:23:45.281 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2023-10-09T06:23:45.316 DEBUG:teuthology.orchestra.run.smithi179:> test -z $(ls -A /var/lib/ceph) 2023-10-09T06:23:45.330 INFO:teuthology.orchestra.run.smithi071.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-09T06:23:45.333 INFO:teuthology.orchestra.run.smithi179.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-09T06:23:45.334 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-09T06:23:45.391 INFO:teuthology.run_tasks:Running task kernel... 2023-10-09T06:23:45.408 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'} 2023-10-09T06:23:45.408 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-10-09T06:23:45.408 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-10-09T06:23:45.409 DEBUG:teuthology.orchestra.run.smithi071:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-09T06:23:45.409 DEBUG:teuthology.orchestra.run.smithi179:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-09T06:23:45.424 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:23:45.425 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-10-09T06:23:45.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:23:45.429 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-10-09T06:23:45.596 DEBUG:teuthology.task.kernel:sha1 for client.0 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-09T06:23:45.596 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-09T06:23:45.596 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2023-10-09T06:23:45.612 INFO:teuthology.orchestra.run.smithi071.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-09T06:23:45.613 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.25.1.el8_4.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-09T06:23:45.613 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-09T06:23:45.613 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum upgrade -y linux-firmware 2023-10-09T06:23:45.672 DEBUG:teuthology.task.kernel:sha1 for client.1 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-09T06:23:45.672 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-09T06:23:45.673 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2023-10-09T06:23:45.689 INFO:teuthology.orchestra.run.smithi179.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-09T06:23:45.690 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.25.1.el8_4.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-09T06:23:45.690 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-09T06:23:45.690 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum upgrade -y linux-firmware 2023-10-09T06:23:47.139 INFO:teuthology.orchestra.run.smithi071.stdout:Updating Subscription Management repositories. 2023-10-09T06:23:47.140 INFO:teuthology.orchestra.run.smithi071.stdout:Unable to read consumer identity 2023-10-09T06:23:47.147 INFO:teuthology.orchestra.run.smithi179.stdout:Updating Subscription Management repositories. 2023-10-09T06:23:47.147 INFO:teuthology.orchestra.run.smithi179.stdout:Unable to read consumer identity 2023-10-09T06:23:48.505 INFO:teuthology.orchestra.run.smithi071.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-10-09T06:23:48.551 INFO:teuthology.orchestra.run.smithi179.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-10-09T06:23:49.136 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 29 MB/s | 16 MB 00:00 2023-10-09T06:23:49.145 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 27 MB/s | 16 MB 00:00 2023-10-09T06:23:52.430 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 1.6 MB/s | 24 kB 00:00 2023-10-09T06:23:52.517 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 4.8 MB/s | 24 kB 00:00 2023-10-09T06:23:53.318 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-09T06:23:53.319 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2023-10-09T06:23:53.319 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-09T06:23:53.409 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2023-10-09T06:23:53.410 INFO:teuthology.orchestra.run.smithi179.stdout:Nothing to do. 2023-10-09T06:23:53.411 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2023-10-09T06:23:53.422 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-10-09T06:23:53.422 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-09T06:23:53.514 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-10-09T06:23:53.514 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-09T06:23:53.571 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-09T06:23:53.571 DEBUG:teuthology.orchestra.run.smithi071:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-09T06:23:53.574 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi071.front.sepia.ceph.com to complete... 2023-10-09T06:23:53.652 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-09T06:23:53.652 DEBUG:teuthology.orchestra.run.smithi179:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-09T06:23:53.655 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi179.front.sepia.ceph.com to complete... 2023-10-09T06:24:16.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09 06:24:16 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-09T06:24:16.161 INFO:teuthology.orchestra.run.smithi071.stderr:FINISHED --2023-10-09 06:24:16-- 2023-10-09T06:24:16.161 INFO:teuthology.orchestra.run.smithi071.stderr:Total wall clock time: 23s 2023-10-09T06:24:16.161 INFO:teuthology.orchestra.run.smithi071.stderr:Downloaded: 1 files, 363M in 22s (16.3 MB/s) 2023-10-09T06:24:16.162 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-10-09T06:24:16.162 DEBUG:teuthology.orchestra.run.smithi071:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-09T06:24:17.900 INFO:teuthology.orchestra.run.smithi071.stdout:Verifying... ######################################## 2023-10-09T06:24:18.285 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing... ######################################## 2023-10-09T06:24:18.410 INFO:teuthology.orchestra.run.smithi071.stdout:Updating / installing... 2023-10-09T06:24:18.899 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09 06:24:18 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-09T06:24:18.900 INFO:teuthology.orchestra.run.smithi179.stderr:FINISHED --2023-10-09 06:24:18-- 2023-10-09T06:24:18.900 INFO:teuthology.orchestra.run.smithi179.stderr:Total wall clock time: 25s 2023-10-09T06:24:18.900 INFO:teuthology.orchestra.run.smithi179.stderr:Downloaded: 1 files, 363M in 25s (14.6 MB/s) 2023-10-09T06:24:18.958 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-10-09T06:24:18.958 DEBUG:teuthology.orchestra.run.smithi179:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-09T06:24:20.747 INFO:teuthology.orchestra.run.smithi179.stdout:Verifying... ######################################## 2023-10-09T06:24:21.168 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing... ######################################## 2023-10-09T06:24:21.292 INFO:teuthology.orchestra.run.smithi179.stdout:Updating / installing... 2023-10-09T06:24:56.297 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-09T06:24:59.160 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-09T06:25:21.303 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi071.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-09T06:25:21.304 DEBUG:teuthology.orchestra.run.smithi071:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-09T06:25:21.367 INFO:teuthology.orchestra.run.smithi071.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-09T06:25:21.367 INFO:teuthology.orchestra.run.smithi071.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-09T06:25:21.368 INFO:teuthology.orchestra.run.smithi071.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-09T06:25:21.368 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-09T06:25:21.368 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-09T06:25:21.368 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-09T06:25:21.368 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-09T06:25:21.368 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-09T06:25:21.368 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-09T06:25:21.368 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-09T06:25:21.368 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-09T06:25:21.368 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-09T06:25:21.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-09T06:25:21.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-09T06:25:21.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-09T06:25:21.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-09T06:25:21.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-09T06:25:21.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-09T06:25:21.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-09T06:25:21.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-09T06:25:21.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-09T06:25:21.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-09T06:25:21.369 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-09T06:25:21.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-09T06:25:21.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-09T06:25:21.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-09T06:25:21.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-09T06:25:21.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-09T06:25:21.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-09T06:25:21.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-09T06:25:21.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-09T06:25:21.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-09T06:25:21.370 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-09T06:25:21.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-09T06:25:21.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-09T06:25:21.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-09T06:25:21.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-09T06:25:21.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-09T06:25:21.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-09T06:25:21.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-09T06:25:21.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-09T06:25:21.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-09T06:25:21.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-09T06:25:21.371 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-09T06:25:21.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-09T06:25:21.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-09T06:25:21.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-09T06:25:21.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-09T06:25:21.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-09T06:25:21.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-09T06:25:21.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-09T06:25:21.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-09T06:25:21.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-09T06:25:21.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-09T06:25:21.372 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-09T06:25:21.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-09T06:25:21.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-09T06:25:21.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-09T06:25:21.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-09T06:25:21.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-09T06:25:21.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-09T06:25:21.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-09T06:25:21.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-09T06:25:21.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-09T06:25:21.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-09T06:25:21.373 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-09T06:25:21.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-09T06:25:21.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-09T06:25:21.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-09T06:25:21.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-09T06:25:21.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-09T06:25:21.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-09T06:25:21.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-09T06:25:21.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-09T06:25:21.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-09T06:25:21.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-09T06:25:21.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-09T06:25:21.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-09T06:25:21.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-09T06:25:21.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-09T06:25:21.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-09T06:25:21.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-09T06:25:21.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-09T06:25:21.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-09T06:25:21.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-09T06:25:21.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-09T06:25:21.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-09T06:25:21.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-09T06:25:21.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-09T06:25:21.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-09T06:25:21.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-09T06:25:21.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-09T06:25:21.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-09T06:25:21.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-09T06:25:21.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-09T06:25:21.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-09T06:25:21.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-09T06:25:21.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-09T06:25:21.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-09T06:25:21.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-09T06:25:21.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-09T06:25:21.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-09T06:25:21.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-09T06:25:21.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-09T06:25:21.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-09T06:25:21.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-09T06:25:21.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-09T06:25:21.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-09T06:25:21.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-09T06:25:21.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-09T06:25:21.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-09T06:25:21.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-09T06:25:21.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-09T06:25:21.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-09T06:25:21.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-09T06:25:21.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-09T06:25:21.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-09T06:25:21.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-09T06:25:21.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-09T06:25:21.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-09T06:25:21.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-09T06:25:21.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-09T06:25:21.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-09T06:25:21.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-09T06:25:21.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-09T06:25:21.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-09T06:25:21.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-09T06:25:21.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-09T06:25:21.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-09T06:25:21.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-09T06:25:21.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-09T06:25:21.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-09T06:25:21.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-09T06:25:21.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-09T06:25:21.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-09T06:25:21.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-09T06:25:21.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-09T06:25:21.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-09T06:25:21.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-09T06:25:21.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-09T06:25:21.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-09T06:25:21.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-09T06:25:21.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-09T06:25:21.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-09T06:25:21.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-09T06:25:21.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-09T06:25:21.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-09T06:25:21.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-09T06:25:21.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-09T06:25:21.408 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-09T06:25:21.408 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-09T06:25:21.408 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-09T06:25:21.408 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-09T06:25:21.408 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-09T06:25:21.408 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-09T06:25:21.408 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-09T06:25:21.408 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-09T06:25:21.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-09T06:25:21.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-09T06:25:21.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-09T06:25:21.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-09T06:25:21.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-09T06:25:21.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-09T06:25:21.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-09T06:25:21.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-09T06:25:21.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-09T06:25:21.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-09T06:25:21.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-09T06:25:21.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-09T06:25:21.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-09T06:25:21.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-09T06:25:21.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-09T06:25:21.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-09T06:25:21.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-09T06:25:21.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-09T06:25:21.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-09T06:25:21.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-09T06:25:21.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-09T06:25:21.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-09T06:25:21.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-09T06:25:21.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-09T06:25:21.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-09T06:25:21.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-09T06:25:21.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-09T06:25:21.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-09T06:25:21.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-09T06:25:21.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-09T06:25:21.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-09T06:25:21.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-09T06:25:21.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-09T06:25:21.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-09T06:25:21.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-09T06:25:21.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-09T06:25:21.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-09T06:25:21.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-09T06:25:21.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-09T06:25:21.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-09T06:25:21.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-09T06:25:21.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-09T06:25:21.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-09T06:25:21.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-09T06:25:21.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-09T06:25:21.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-09T06:25:21.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-09T06:25:21.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-09T06:25:21.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-09T06:25:21.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-09T06:25:21.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-09T06:25:21.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-09T06:25:21.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-09T06:25:21.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-09T06:25:21.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-09T06:25:21.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-09T06:25:21.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-09T06:25:21.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-09T06:25:21.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-09T06:25:21.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-09T06:25:21.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-09T06:25:21.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-09T06:25:21.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-09T06:25:21.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-09T06:25:21.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-09T06:25:21.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-09T06:25:21.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-09T06:25:21.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-09T06:25:21.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-09T06:25:21.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-09T06:25:21.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-09T06:25:21.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-09T06:25:21.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-09T06:25:21.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-09T06:25:21.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-09T06:25:21.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-09T06:25:21.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-09T06:25:21.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-09T06:25:21.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-09T06:25:21.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-09T06:25:21.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-09T06:25:21.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-09T06:25:21.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-09T06:25:21.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-09T06:25:21.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-09T06:25:21.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-09T06:25:21.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-09T06:25:21.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-09T06:25:21.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-09T06:25:21.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-09T06:25:21.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-09T06:25:21.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-09T06:25:21.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-09T06:25:21.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-09T06:25:21.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-09T06:25:21.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-09T06:25:21.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-09T06:25:21.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-09T06:25:21.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-09T06:25:21.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-09T06:25:21.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-09T06:25:21.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-09T06:25:21.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-09T06:25:21.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-09T06:25:21.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-09T06:25:21.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-09T06:25:21.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-09T06:25:21.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-09T06:25:21.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-09T06:25:21.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-09T06:25:21.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-09T06:25:21.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-09T06:25:21.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-09T06:25:21.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-09T06:25:21.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-09T06:25:21.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-09T06:25:21.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-09T06:25:21.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-09T06:25:21.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-09T06:25:21.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-09T06:25:21.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-09T06:25:21.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-09T06:25:21.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-09T06:25:21.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-09T06:25:21.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-09T06:25:21.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-09T06:25:21.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-09T06:25:21.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-09T06:25:21.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-09T06:25:21.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-09T06:25:21.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-09T06:25:21.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-09T06:25:21.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-09T06:25:21.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-09T06:25:21.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-09T06:25:21.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-09T06:25:21.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-09T06:25:21.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-09T06:25:21.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-09T06:25:21.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-09T06:25:21.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-09T06:25:21.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-09T06:25:21.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-09T06:25:21.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-09T06:25:21.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-09T06:25:21.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-09T06:25:21.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-09T06:25:21.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-09T06:25:21.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-09T06:25:21.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-09T06:25:21.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-09T06:25:21.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-09T06:25:21.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-09T06:25:21.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-09T06:25:21.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-09T06:25:21.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-09T06:25:21.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-09T06:25:21.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-09T06:25:21.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-09T06:25:21.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-09T06:25:21.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-09T06:25:21.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-09T06:25:21.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-09T06:25:21.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-09T06:25:21.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-09T06:25:21.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-09T06:25:21.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-09T06:25:21.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-09T06:25:21.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-09T06:25:21.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-09T06:25:21.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-09T06:25:21.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-09T06:25:21.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-09T06:25:21.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-09T06:25:21.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-09T06:25:21.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-09T06:25:21.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-09T06:25:21.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-09T06:25:21.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-09T06:25:21.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-09T06:25:21.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-09T06:25:21.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-09T06:25:21.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-09T06:25:21.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-09T06:25:21.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-09T06:25:21.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-09T06:25:21.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-09T06:25:21.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-09T06:25:21.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-09T06:25:21.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-09T06:25:21.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-09T06:25:21.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-09T06:25:21.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-09T06:25:21.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-09T06:25:21.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-09T06:25:21.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-09T06:25:21.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-09T06:25:21.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-09T06:25:21.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-09T06:25:21.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-09T06:25:21.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-09T06:25:21.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-09T06:25:21.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-09T06:25:21.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-09T06:25:21.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-09T06:25:21.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-09T06:25:21.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-09T06:25:21.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-09T06:25:21.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-09T06:25:21.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-09T06:25:21.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-09T06:25:21.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-09T06:25:21.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-09T06:25:21.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-09T06:25:21.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-09T06:25:21.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-09T06:25:21.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-09T06:25:21.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-09T06:25:21.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-09T06:25:21.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-09T06:25:21.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-09T06:25:21.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-09T06:25:21.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-09T06:25:21.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-09T06:25:21.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-09T06:25:21.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-09T06:25:21.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-09T06:25:21.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-09T06:25:21.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-09T06:25:21.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-09T06:25:21.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-09T06:25:21.430 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-09T06:25:21.430 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-09T06:25:21.430 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-09T06:25:21.430 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-09T06:25:21.430 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-09T06:25:21.430 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-09T06:25:21.430 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-09T06:25:21.430 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-09T06:25:21.430 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-09T06:25:21.430 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-09T06:25:21.430 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-09T06:25:21.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-09T06:25:21.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-09T06:25:21.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-09T06:25:21.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-09T06:25:21.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-09T06:25:21.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-09T06:25:21.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-09T06:25:21.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-09T06:25:21.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-09T06:25:21.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-09T06:25:21.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-09T06:25:21.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-09T06:25:21.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-09T06:25:21.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-09T06:25:21.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-09T06:25:21.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-09T06:25:21.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-09T06:25:21.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-09T06:25:21.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-09T06:25:21.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-09T06:25:21.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-09T06:25:21.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-09T06:25:21.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-09T06:25:21.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-09T06:25:21.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-09T06:25:21.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-09T06:25:21.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-09T06:25:21.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-09T06:25:21.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-09T06:25:21.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-09T06:25:21.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-09T06:25:21.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-09T06:25:21.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-09T06:25:21.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-09T06:25:21.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-09T06:25:21.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-09T06:25:21.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-09T06:25:21.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-09T06:25:21.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-09T06:25:21.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-09T06:25:21.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-09T06:25:21.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-09T06:25:21.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-09T06:25:21.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-09T06:25:21.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-09T06:25:21.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-09T06:25:21.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-09T06:25:21.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-09T06:25:21.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-09T06:25:21.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-09T06:25:21.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-09T06:25:21.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-09T06:25:21.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-09T06:25:21.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-09T06:25:21.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-09T06:25:21.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-09T06:25:21.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-09T06:25:21.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-09T06:25:21.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-09T06:25:21.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-09T06:25:21.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-09T06:25:21.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-09T06:25:21.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-09T06:25:21.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-09T06:25:21.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-09T06:25:21.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-09T06:25:21.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-09T06:25:21.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-09T06:25:21.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-09T06:25:21.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-09T06:25:21.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-09T06:25:21.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-09T06:25:21.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-09T06:25:21.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-09T06:25:21.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-09T06:25:21.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-09T06:25:21.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-09T06:25:21.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-09T06:25:21.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-09T06:25:21.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-09T06:25:21.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-09T06:25:21.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-09T06:25:21.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-09T06:25:21.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-09T06:25:21.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-09T06:25:21.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-09T06:25:21.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-09T06:25:21.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-09T06:25:21.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-09T06:25:21.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-09T06:25:21.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-09T06:25:21.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-09T06:25:21.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-09T06:25:21.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-09T06:25:21.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-09T06:25:21.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-09T06:25:21.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-09T06:25:21.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-09T06:25:21.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-09T06:25:21.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-09T06:25:21.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-09T06:25:21.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-09T06:25:21.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-09T06:25:21.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-09T06:25:21.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-09T06:25:21.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-09T06:25:21.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-09T06:25:21.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-09T06:25:21.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-09T06:25:21.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-09T06:25:21.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-09T06:25:21.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-09T06:25:21.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-09T06:25:21.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-09T06:25:21.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-09T06:25:21.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-09T06:25:21.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-09T06:25:21.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-09T06:25:21.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-09T06:25:21.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-09T06:25:21.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-09T06:25:21.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-09T06:25:21.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-09T06:25:21.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-09T06:25:21.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-09T06:25:21.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-09T06:25:21.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-09T06:25:21.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-09T06:25:21.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-09T06:25:21.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-09T06:25:21.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-09T06:25:21.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-09T06:25:21.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-09T06:25:21.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-09T06:25:21.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-09T06:25:21.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-09T06:25:21.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-09T06:25:21.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-09T06:25:21.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-09T06:25:21.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-09T06:25:21.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-09T06:25:21.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-09T06:25:21.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-09T06:25:21.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-09T06:25:21.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-09T06:25:21.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-09T06:25:21.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-09T06:25:21.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-09T06:25:21.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-09T06:25:21.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-09T06:25:21.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-09T06:25:21.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-09T06:25:21.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-09T06:25:21.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-09T06:25:21.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-09T06:25:21.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-09T06:25:21.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-09T06:25:21.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-09T06:25:21.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-09T06:25:21.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-09T06:25:21.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-09T06:25:21.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-09T06:25:21.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-09T06:25:21.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-09T06:25:21.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-09T06:25:21.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-09T06:25:21.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-09T06:25:21.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-09T06:25:21.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-09T06:25:21.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-09T06:25:21.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-09T06:25:21.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-09T06:25:21.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-09T06:25:21.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-09T06:25:21.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-09T06:25:21.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-09T06:25:21.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-09T06:25:21.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-09T06:25:21.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-09T06:25:21.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-09T06:25:21.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-09T06:25:21.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-09T06:25:21.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-09T06:25:21.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-09T06:25:21.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-09T06:25:21.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-09T06:25:21.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-09T06:25:21.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-09T06:25:21.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-09T06:25:21.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-09T06:25:21.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-09T06:25:21.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-09T06:25:21.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-09T06:25:21.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-09T06:25:21.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-09T06:25:21.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-09T06:25:21.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-09T06:25:21.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-09T06:25:21.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-09T06:25:21.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-09T06:25:21.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-09T06:25:21.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-09T06:25:21.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-09T06:25:21.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-09T06:25:21.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-09T06:25:21.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-09T06:25:21.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-09T06:25:21.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-09T06:25:21.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-09T06:25:21.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-09T06:25:21.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-09T06:25:21.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-09T06:25:21.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-09T06:25:21.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-09T06:25:21.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-09T06:25:21.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-09T06:25:21.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-09T06:25:21.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-09T06:25:21.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-09T06:25:21.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-09T06:25:21.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-09T06:25:21.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-09T06:25:21.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-09T06:25:21.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-09T06:25:21.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-09T06:25:21.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-09T06:25:21.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-09T06:25:21.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-09T06:25:21.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-09T06:25:21.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-09T06:25:21.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-09T06:25:21.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-09T06:25:21.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-09T06:25:21.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-09T06:25:21.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-09T06:25:21.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-09T06:25:21.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-09T06:25:21.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-09T06:25:21.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-09T06:25:21.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-09T06:25:21.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-09T06:25:21.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-09T06:25:21.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-09T06:25:21.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-09T06:25:21.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-09T06:25:21.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-09T06:25:21.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-09T06:25:21.452 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-09T06:25:21.452 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-09T06:25:21.452 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-09T06:25:21.452 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-09T06:25:21.452 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-09T06:25:21.452 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-09T06:25:21.452 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-09T06:25:21.452 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-09T06:25:21.452 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-09T06:25:21.452 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-09T06:25:21.452 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-09T06:25:21.452 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-09T06:25:21.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-09T06:25:21.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-09T06:25:21.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-09T06:25:21.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-09T06:25:21.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-09T06:25:21.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-09T06:25:21.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-09T06:25:21.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-09T06:25:21.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-09T06:25:21.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-09T06:25:21.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-09T06:25:21.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-09T06:25:21.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-09T06:25:21.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-09T06:25:21.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-09T06:25:21.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-09T06:25:21.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-09T06:25:21.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-09T06:25:21.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-09T06:25:21.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-09T06:25:21.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-09T06:25:21.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-09T06:25:21.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-09T06:25:21.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-09T06:25:21.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-09T06:25:21.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-09T06:25:21.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-09T06:25:21.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-09T06:25:21.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-09T06:25:21.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-09T06:25:21.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-09T06:25:21.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-09T06:25:21.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-09T06:25:21.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-09T06:25:21.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-09T06:25:21.456 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-09T06:25:21.456 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-09T06:25:21.456 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-09T06:25:21.456 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-09T06:25:21.456 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-09T06:25:21.456 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-09T06:25:21.456 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-09T06:25:21.456 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-09T06:25:21.456 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-09T06:25:21.456 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-09T06:25:21.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-09T06:25:21.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-09T06:25:21.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-09T06:25:21.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-09T06:25:21.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-09T06:25:21.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-09T06:25:21.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-09T06:25:21.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-09T06:25:21.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-09T06:25:21.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-09T06:25:21.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-09T06:25:21.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-09T06:25:21.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-09T06:25:21.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-09T06:25:21.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-09T06:25:21.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-09T06:25:21.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-09T06:25:21.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-09T06:25:21.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-09T06:25:21.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-09T06:25:21.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-09T06:25:21.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-09T06:25:21.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-09T06:25:21.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-09T06:25:21.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-09T06:25:21.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-09T06:25:21.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-09T06:25:21.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-09T06:25:21.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-09T06:25:21.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-09T06:25:21.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-09T06:25:21.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-09T06:25:21.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-09T06:25:21.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-09T06:25:21.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-09T06:25:21.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-09T06:25:21.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-09T06:25:21.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-09T06:25:21.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-09T06:25:21.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-09T06:25:21.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-09T06:25:21.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-09T06:25:21.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-09T06:25:21.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-09T06:25:21.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-09T06:25:21.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-09T06:25:21.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-09T06:25:21.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-09T06:25:21.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-09T06:25:21.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-09T06:25:21.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-09T06:25:21.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-09T06:25:21.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-09T06:25:21.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-09T06:25:21.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-09T06:25:21.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-09T06:25:21.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-09T06:25:21.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-09T06:25:21.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-09T06:25:21.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-09T06:25:21.462 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-09T06:25:21.462 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-09T06:25:21.462 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-09T06:25:21.462 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-09T06:25:21.462 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-09T06:25:21.462 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-09T06:25:21.462 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-09T06:25:21.462 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-09T06:25:21.462 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-09T06:25:21.462 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-09T06:25:21.462 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-09T06:25:21.463 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-09T06:25:21.463 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-09T06:25:21.463 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-09T06:25:21.463 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-09T06:25:21.463 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-09T06:25:21.463 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-09T06:25:21.463 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-09T06:25:21.463 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-09T06:25:21.463 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-09T06:25:21.463 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-09T06:25:21.463 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-09T06:25:21.463 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-09T06:25:21.464 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-09T06:25:21.464 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-09T06:25:21.464 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-09T06:25:21.464 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-09T06:25:21.464 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-09T06:25:21.464 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-09T06:25:21.464 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-09T06:25:21.464 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-09T06:25:21.464 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-09T06:25:21.464 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-09T06:25:21.465 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-09T06:25:21.465 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-09T06:25:21.465 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-09T06:25:21.465 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-09T06:25:21.465 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-09T06:25:21.465 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-09T06:25:21.465 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-09T06:25:21.465 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-09T06:25:21.465 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-09T06:25:21.465 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-09T06:25:21.465 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-09T06:25:21.465 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-09T06:25:21.466 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-09T06:25:21.466 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-09T06:25:21.466 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-09T06:25:21.466 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-09T06:25:21.466 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-09T06:25:21.466 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-09T06:25:21.466 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-09T06:25:21.466 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-09T06:25:21.466 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-09T06:25:21.466 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-09T06:25:21.466 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-09T06:25:21.466 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-09T06:25:21.467 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-09T06:25:21.467 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-09T06:25:21.467 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-09T06:25:21.467 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-09T06:25:21.467 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-09T06:25:21.467 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-09T06:25:21.467 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-09T06:25:21.467 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-09T06:25:21.467 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-09T06:25:21.467 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-09T06:25:21.467 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-09T06:25:21.468 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-09T06:25:21.468 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-09T06:25:21.468 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-09T06:25:21.468 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-09T06:25:21.468 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-09T06:25:21.468 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-09T06:25:21.468 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-09T06:25:21.468 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-09T06:25:21.468 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-09T06:25:21.468 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-09T06:25:21.469 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-09T06:25:21.469 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-09T06:25:21.469 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-09T06:25:21.469 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-09T06:25:21.469 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-09T06:25:21.469 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-09T06:25:21.469 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-09T06:25:21.469 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-09T06:25:21.469 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-09T06:25:21.469 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-09T06:25:21.469 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-09T06:25:21.469 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-09T06:25:21.470 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-09T06:25:21.470 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-09T06:25:21.470 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-09T06:25:21.470 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-09T06:25:21.470 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-09T06:25:21.470 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-09T06:25:21.470 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-09T06:25:21.470 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-09T06:25:21.470 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-09T06:25:21.470 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-09T06:25:21.470 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-09T06:25:21.471 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-09T06:25:21.471 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-09T06:25:21.471 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-09T06:25:21.471 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-09T06:25:21.471 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-09T06:25:21.471 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-09T06:25:21.471 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-09T06:25:21.471 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-09T06:25:21.471 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-09T06:25:21.471 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-09T06:25:21.471 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-09T06:25:21.471 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-09T06:25:21.472 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-09T06:25:21.472 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-09T06:25:21.472 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-09T06:25:21.472 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-09T06:25:21.472 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-09T06:25:21.472 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-09T06:25:21.472 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-09T06:25:21.472 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-09T06:25:21.472 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-09T06:25:21.472 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-09T06:25:21.472 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-09T06:25:21.473 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-09T06:25:21.473 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-09T06:25:21.473 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-09T06:25:21.473 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-09T06:25:21.473 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-09T06:25:21.473 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-09T06:25:21.473 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-09T06:25:21.473 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-09T06:25:21.473 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-09T06:25:21.473 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-09T06:25:21.473 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-09T06:25:21.473 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-09T06:25:21.474 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-09T06:25:21.474 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-09T06:25:21.474 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-09T06:25:21.474 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-09T06:25:21.474 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-09T06:25:21.474 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-09T06:25:21.474 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-09T06:25:21.474 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-09T06:25:21.474 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-09T06:25:21.474 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-09T06:25:21.474 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-09T06:25:21.475 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-09T06:25:21.475 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-09T06:25:21.475 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-09T06:25:21.475 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-09T06:25:21.475 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-09T06:25:21.475 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-09T06:25:21.475 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-09T06:25:21.475 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-09T06:25:21.475 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-09T06:25:21.475 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-09T06:25:21.475 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-09T06:25:21.475 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-09T06:25:21.476 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-09T06:25:21.476 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-09T06:25:21.476 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-09T06:25:21.476 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-09T06:25:21.476 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-09T06:25:21.476 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-09T06:25:21.476 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-09T06:25:21.476 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-09T06:25:21.476 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-09T06:25:21.476 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-09T06:25:21.476 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-09T06:25:21.476 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-09T06:25:21.476 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-09T06:25:21.477 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-09T06:25:21.477 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-09T06:25:21.477 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-09T06:25:21.477 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-09T06:25:21.477 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-09T06:25:21.477 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-09T06:25:21.477 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-09T06:25:21.477 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-09T06:25:21.477 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-09T06:25:21.477 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-09T06:25:21.477 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-09T06:25:21.477 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-09T06:25:21.478 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-09T06:25:21.478 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-09T06:25:21.478 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-09T06:25:21.478 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-09T06:25:21.478 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-09T06:25:21.478 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-09T06:25:21.478 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-09T06:25:21.478 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-09T06:25:21.478 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-09T06:25:21.478 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-09T06:25:21.478 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-09T06:25:21.478 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-09T06:25:21.479 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-09T06:25:21.479 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-09T06:25:21.479 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-09T06:25:21.479 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-09T06:25:21.479 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-09T06:25:21.479 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-09T06:25:21.479 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-09T06:25:21.479 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-09T06:25:21.479 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-09T06:25:21.479 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-09T06:25:21.479 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-09T06:25:21.479 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-09T06:25:21.480 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-09T06:25:21.480 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-09T06:25:21.480 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-09T06:25:21.480 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-09T06:25:21.480 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-09T06:25:21.480 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-09T06:25:21.480 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-09T06:25:21.480 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-09T06:25:21.480 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-09T06:25:21.480 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-09T06:25:21.480 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-09T06:25:21.480 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-09T06:25:21.481 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-09T06:25:21.481 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-09T06:25:21.481 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-09T06:25:21.481 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-09T06:25:21.481 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-09T06:25:21.481 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-09T06:25:21.481 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-09T06:25:21.481 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-09T06:25:21.481 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-09T06:25:21.481 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-09T06:25:21.481 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-09T06:25:21.482 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-09T06:25:21.482 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-09T06:25:21.482 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-09T06:25:21.482 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-09T06:25:21.482 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-09T06:25:21.482 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-09T06:25:21.482 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-09T06:25:21.482 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-09T06:25:21.482 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-09T06:25:21.482 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-09T06:25:21.482 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-09T06:25:21.482 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-09T06:25:21.483 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-09T06:25:21.483 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-09T06:25:21.483 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-09T06:25:21.483 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-09T06:25:21.483 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-09T06:25:21.483 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-09T06:25:21.483 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-09T06:25:21.483 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-09T06:25:21.483 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-09T06:25:21.483 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-09T06:25:21.483 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-09T06:25:21.483 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-09T06:25:21.484 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-09T06:25:21.484 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-09T06:25:21.484 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-09T06:25:21.484 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-09T06:25:21.484 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-09T06:25:21.484 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-09T06:25:21.484 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-09T06:25:21.484 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-09T06:25:21.484 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-09T06:25:21.484 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-09T06:25:21.484 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-09T06:25:21.485 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-09T06:25:21.485 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-09T06:25:21.485 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-09T06:25:21.485 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-09T06:25:21.485 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-09T06:25:21.485 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-09T06:25:21.485 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-09T06:25:21.485 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-09T06:25:21.485 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-09T06:25:21.485 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-09T06:25:21.485 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-09T06:25:21.485 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-09T06:25:21.486 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-09T06:25:21.486 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-09T06:25:21.486 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-09T06:25:21.486 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-09T06:25:21.486 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-09T06:25:21.486 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-09T06:25:21.486 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-09T06:25:21.486 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-09T06:25:21.486 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-09T06:25:21.486 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-09T06:25:21.486 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-09T06:25:21.486 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-09T06:25:21.487 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-09T06:25:21.487 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-09T06:25:21.487 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-09T06:25:21.487 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-09T06:25:21.487 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-09T06:25:21.487 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-09T06:25:21.487 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-09T06:25:21.487 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-09T06:25:21.487 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-09T06:25:21.487 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-09T06:25:21.487 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-09T06:25:21.488 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-09T06:25:21.488 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-09T06:25:21.488 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-09T06:25:21.488 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-09T06:25:21.488 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-09T06:25:21.488 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-09T06:25:21.488 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-09T06:25:21.488 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-09T06:25:21.488 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-09T06:25:21.488 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-09T06:25:21.488 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-09T06:25:21.489 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-09T06:25:21.489 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-09T06:25:21.489 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-09T06:25:21.489 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-09T06:25:21.489 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-09T06:25:21.489 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-09T06:25:21.489 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-09T06:25:21.489 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-09T06:25:21.489 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-09T06:25:21.489 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-09T06:25:21.489 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-09T06:25:21.489 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-09T06:25:21.489 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-09T06:25:21.490 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-09T06:25:21.490 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-09T06:25:21.490 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-09T06:25:21.490 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-09T06:25:21.490 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-09T06:25:21.490 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-09T06:25:21.490 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-09T06:25:21.490 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-09T06:25:21.490 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-09T06:25:21.490 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-09T06:25:21.491 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-09T06:25:21.491 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-09T06:25:21.491 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-09T06:25:21.491 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-09T06:25:21.491 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-09T06:25:21.491 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-09T06:25:21.491 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-09T06:25:21.491 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-09T06:25:21.491 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-09T06:25:21.491 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-09T06:25:21.491 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-09T06:25:21.491 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-09T06:25:21.492 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-09T06:25:21.492 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-09T06:25:21.492 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-09T06:25:21.492 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-09T06:25:21.492 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-09T06:25:21.492 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-09T06:25:21.492 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-09T06:25:21.492 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-09T06:25:21.492 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-09T06:25:21.492 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-09T06:25:21.492 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-09T06:25:21.492 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-09T06:25:21.493 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-09T06:25:21.493 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-09T06:25:21.493 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-09T06:25:21.493 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-09T06:25:21.493 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-09T06:25:21.493 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-09T06:25:21.493 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-09T06:25:21.493 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-09T06:25:21.493 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-09T06:25:21.493 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-09T06:25:21.493 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-09T06:25:21.494 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-09T06:25:21.494 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-09T06:25:21.494 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-09T06:25:21.494 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-09T06:25:21.494 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-09T06:25:21.494 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-09T06:25:21.494 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-09T06:25:21.494 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-09T06:25:21.494 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-09T06:25:21.494 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-09T06:25:21.494 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-09T06:25:21.494 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-09T06:25:21.495 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-09T06:25:21.495 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-09T06:25:21.495 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-09T06:25:21.495 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-09T06:25:21.495 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-09T06:25:21.495 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-09T06:25:21.495 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-09T06:25:21.495 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-09T06:25:21.495 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-09T06:25:21.495 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-09T06:25:21.495 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-09T06:25:21.496 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-09T06:25:21.496 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-09T06:25:21.496 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-09T06:25:21.496 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-09T06:25:21.496 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-09T06:25:21.496 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-09T06:25:21.496 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-09T06:25:21.496 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-09T06:25:21.496 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-09T06:25:21.496 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-09T06:25:21.496 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-09T06:25:21.496 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-09T06:25:21.497 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-09T06:25:21.497 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-09T06:25:21.497 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-09T06:25:21.497 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-09T06:25:21.497 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-09T06:25:21.497 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-09T06:25:21.497 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-09T06:25:21.497 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-09T06:25:21.497 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-09T06:25:21.497 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-09T06:25:21.497 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-09T06:25:21.498 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-09T06:25:21.498 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-09T06:25:21.498 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-09T06:25:21.498 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-09T06:25:21.498 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-09T06:25:21.498 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-09T06:25:21.498 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-09T06:25:21.498 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-09T06:25:21.498 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-09T06:25:21.498 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-09T06:25:21.498 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-09T06:25:21.499 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-09T06:25:21.499 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-09T06:25:21.499 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-09T06:25:21.499 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-09T06:25:21.499 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-09T06:25:21.499 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-09T06:25:21.499 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-09T06:25:21.499 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-09T06:25:21.499 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-09T06:25:21.499 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-09T06:25:21.499 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-09T06:25:21.499 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-09T06:25:21.500 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-09T06:25:21.500 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-09T06:25:21.500 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-09T06:25:21.500 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-09T06:25:21.500 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-09T06:25:21.500 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-09T06:25:21.500 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-09T06:25:21.500 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-09T06:25:21.500 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-09T06:25:21.500 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-09T06:25:21.500 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-09T06:25:21.500 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-09T06:25:21.501 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-09T06:25:21.501 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-09T06:25:21.501 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-09T06:25:21.501 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-09T06:25:21.501 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-09T06:25:21.501 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-09T06:25:21.501 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-09T06:25:21.501 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-09T06:25:21.501 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-09T06:25:21.501 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-09T06:25:21.501 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-09T06:25:21.501 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-09T06:25:21.502 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-09T06:25:21.502 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-09T06:25:21.502 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-09T06:25:21.502 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-09T06:25:21.502 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-09T06:25:21.502 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-09T06:25:21.502 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-09T06:25:21.502 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-09T06:25:21.502 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-09T06:25:21.502 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-09T06:25:21.503 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-09T06:25:21.503 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-09T06:25:21.503 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-09T06:25:21.503 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-09T06:25:21.503 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-09T06:25:21.503 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-09T06:25:21.503 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-09T06:25:21.503 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-09T06:25:21.503 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-09T06:25:21.503 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-09T06:25:21.503 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-09T06:25:21.504 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-09T06:25:21.504 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-09T06:25:21.504 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-09T06:25:21.504 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-09T06:25:21.504 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-09T06:25:21.504 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-09T06:25:21.504 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-09T06:25:21.504 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-09T06:25:21.504 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-09T06:25:21.504 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-09T06:25:21.504 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-09T06:25:21.504 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-09T06:25:21.505 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-09T06:25:21.505 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-09T06:25:21.505 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-09T06:25:21.505 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-09T06:25:21.505 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-09T06:25:21.505 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-09T06:25:21.505 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-09T06:25:21.505 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-09T06:25:21.505 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-09T06:25:21.505 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-09T06:25:21.505 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-09T06:25:21.506 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-09T06:25:21.506 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-09T06:25:21.506 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-09T06:25:21.506 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-09T06:25:21.506 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-09T06:25:21.506 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-09T06:25:21.506 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-09T06:25:21.506 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-09T06:25:21.506 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-09T06:25:21.506 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-09T06:25:21.506 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-09T06:25:21.506 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-09T06:25:21.507 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-09T06:25:21.507 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-09T06:25:21.507 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-09T06:25:21.507 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-09T06:25:21.507 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-09T06:25:21.507 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-09T06:25:21.507 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-09T06:25:21.507 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-09T06:25:21.507 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-09T06:25:21.507 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-09T06:25:21.507 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-09T06:25:21.507 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-09T06:25:21.508 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-09T06:25:21.508 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-09T06:25:21.508 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-09T06:25:21.508 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-09T06:25:21.508 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-09T06:25:21.508 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-09T06:25:21.508 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-09T06:25:21.508 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-09T06:25:21.508 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-09T06:25:21.508 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-09T06:25:21.508 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-09T06:25:21.508 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-09T06:25:21.509 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-09T06:25:21.509 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-09T06:25:21.509 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-09T06:25:21.509 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-09T06:25:21.509 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-09T06:25:21.509 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-09T06:25:21.509 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-09T06:25:21.509 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-09T06:25:21.509 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-09T06:25:21.509 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-09T06:25:21.509 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-09T06:25:21.509 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-09T06:25:21.510 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-09T06:25:21.510 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-09T06:25:21.510 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-09T06:25:21.510 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-09T06:25:21.510 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-09T06:25:21.510 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-09T06:25:21.510 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-09T06:25:21.510 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-09T06:25:21.510 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-09T06:25:21.510 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-09T06:25:21.510 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-09T06:25:21.511 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-09T06:25:21.511 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-09T06:25:21.511 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-09T06:25:21.511 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-09T06:25:21.511 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-09T06:25:21.511 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-09T06:25:21.511 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-09T06:25:21.511 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-09T06:25:21.511 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-09T06:25:21.511 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-09T06:25:21.511 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-09T06:25:21.511 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-09T06:25:21.512 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-09T06:25:21.512 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-09T06:25:21.512 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-09T06:25:21.512 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-09T06:25:21.512 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-09T06:25:21.512 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-09T06:25:21.512 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-09T06:25:21.512 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-09T06:25:21.512 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-09T06:25:21.512 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-09T06:25:21.512 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-09T06:25:21.512 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-09T06:25:21.513 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-09T06:25:21.513 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-09T06:25:21.513 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-09T06:25:21.513 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-09T06:25:21.513 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-09T06:25:21.513 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-09T06:25:21.513 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-09T06:25:21.513 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-09T06:25:21.513 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-09T06:25:21.513 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-09T06:25:21.513 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-09T06:25:21.641 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-09T06:25:21.641 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-09T06:25:21.641 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-09T06:25:21.641 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-09T06:25:21.641 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-09T06:25:21.642 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-09T06:25:21.642 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-09T06:25:21.642 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-09T06:25:21.642 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-09T06:25:21.642 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-09T06:25:21.642 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-09T06:25:21.642 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-09T06:25:21.642 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-09T06:25:21.642 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-09T06:25:21.642 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-09T06:25:21.643 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-09T06:25:21.643 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-09T06:25:21.643 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-09T06:25:21.643 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-09T06:25:21.643 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-09T06:25:21.643 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-09T06:25:21.643 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-09T06:25:21.643 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-09T06:25:21.643 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-09T06:25:21.643 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-09T06:25:21.644 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-09T06:25:21.644 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-09T06:25:21.644 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-09T06:25:21.644 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-09T06:25:21.644 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-09T06:25:21.644 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-09T06:25:21.644 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-09T06:25:21.644 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-09T06:25:21.644 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-09T06:25:21.644 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-09T06:25:21.644 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-09T06:25:21.644 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-09T06:25:21.645 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-09T06:25:21.645 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-09T06:25:21.645 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-09T06:25:21.645 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-09T06:25:21.645 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-09T06:25:21.645 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-09T06:25:21.645 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-09T06:25:21.645 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-09T06:25:21.645 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-09T06:25:21.645 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-09T06:25:21.645 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-09T06:25:21.646 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-09T06:25:21.646 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-09T06:25:21.646 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-09T06:25:21.646 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-09T06:25:21.646 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-09T06:25:21.646 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-09T06:25:21.646 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-09T06:25:21.646 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-09T06:25:21.646 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-09T06:25:21.646 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-09T06:25:21.646 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-09T06:25:21.646 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-09T06:25:21.647 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-09T06:25:21.647 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-09T06:25:21.647 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-09T06:25:21.647 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-09T06:25:21.647 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-09T06:25:21.647 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-09T06:25:21.647 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-09T06:25:21.647 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-09T06:25:21.647 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-09T06:25:21.647 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-09T06:25:21.647 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-09T06:25:21.647 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-09T06:25:21.648 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-09T06:25:21.648 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-09T06:25:21.648 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-09T06:25:21.648 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-09T06:25:21.648 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-09T06:25:21.648 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-09T06:25:21.648 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-09T06:25:21.648 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-09T06:25:21.648 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-09T06:25:21.648 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-09T06:25:21.648 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-09T06:25:21.648 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-09T06:25:21.649 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-09T06:25:21.649 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-09T06:25:21.649 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-09T06:25:21.649 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-09T06:25:21.649 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-09T06:25:21.649 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-09T06:25:21.649 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-09T06:25:21.649 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-09T06:25:21.649 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-09T06:25:21.649 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-09T06:25:21.649 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-09T06:25:21.649 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-09T06:25:21.650 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-09T06:25:21.650 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-09T06:25:21.650 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-09T06:25:21.650 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-09T06:25:21.650 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-09T06:25:21.650 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-09T06:25:21.650 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-09T06:25:21.650 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-09T06:25:21.650 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-09T06:25:21.650 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-09T06:25:21.650 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-09T06:25:21.650 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-09T06:25:21.651 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-09T06:25:21.651 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-09T06:25:21.651 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-09T06:25:21.651 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-09T06:25:21.651 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-09T06:25:21.651 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-09T06:25:21.651 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-09T06:25:21.651 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-09T06:25:21.651 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-09T06:25:21.651 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-09T06:25:21.651 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-09T06:25:21.651 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-09T06:25:21.652 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-09T06:25:21.652 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-09T06:25:21.652 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-09T06:25:21.652 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-09T06:25:21.652 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-09T06:25:21.652 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-09T06:25:21.652 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-09T06:25:21.652 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-09T06:25:21.652 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-09T06:25:21.652 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-09T06:25:21.652 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-09T06:25:21.652 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-09T06:25:21.653 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-09T06:25:21.653 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-09T06:25:21.653 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-09T06:25:21.653 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-09T06:25:21.653 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-09T06:25:21.653 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-09T06:25:21.653 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-09T06:25:21.653 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-09T06:25:21.653 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-09T06:25:21.653 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-09T06:25:21.653 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-09T06:25:21.654 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-09T06:25:21.654 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-09T06:25:21.654 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-09T06:25:21.654 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-09T06:25:21.654 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-09T06:25:21.654 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-09T06:25:21.654 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-09T06:25:21.654 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-09T06:25:21.654 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-09T06:25:21.654 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-09T06:25:21.654 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-09T06:25:21.654 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-09T06:25:21.655 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-09T06:25:21.655 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-09T06:25:21.655 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-09T06:25:21.655 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-09T06:25:21.655 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-09T06:25:21.655 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-09T06:25:21.655 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-09T06:25:21.655 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-09T06:25:21.655 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-09T06:25:21.655 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-09T06:25:21.663 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-09T06:25:21.663 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-09T06:25:21.663 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-09T06:25:21.663 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-09T06:25:21.664 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-09T06:25:21.664 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-09T06:25:21.664 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-09T06:25:21.664 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-09T06:25:21.664 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-09T06:25:21.665 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-09T06:25:21.665 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-09T06:25:21.665 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-09T06:25:21.665 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-09T06:25:21.665 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-09T06:25:21.666 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-09T06:25:21.666 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-09T06:25:21.666 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-09T06:25:21.666 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-09T06:25:21.666 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-09T06:25:21.667 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-09T06:25:21.667 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-09T06:25:21.667 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-09T06:25:21.667 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-09T06:25:21.667 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-09T06:25:21.668 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-09T06:25:21.668 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-09T06:25:21.668 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-09T06:25:21.668 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-09T06:25:21.668 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-09T06:25:21.669 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-09T06:25:21.669 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-09T06:25:21.669 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-09T06:25:21.669 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-09T06:25:21.669 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-09T06:25:21.670 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-09T06:25:21.670 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-09T06:25:21.670 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-09T06:25:21.670 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-09T06:25:21.671 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-09T06:25:21.671 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-09T06:25:21.671 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-09T06:25:21.671 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-09T06:25:21.672 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-09T06:25:21.672 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-09T06:25:21.672 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-09T06:25:21.672 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-09T06:25:21.672 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-09T06:25:21.673 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-09T06:25:21.673 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-09T06:25:21.673 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-09T06:25:21.673 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-09T06:25:21.673 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-09T06:25:21.673 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-09T06:25:21.674 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-09T06:25:21.674 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-09T06:25:21.674 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-09T06:25:21.674 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-09T06:25:21.674 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-09T06:25:21.675 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-09T06:25:21.675 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-09T06:25:21.675 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-09T06:25:21.675 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-09T06:25:21.675 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-09T06:25:21.676 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-09T06:25:21.676 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-09T06:25:21.676 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-09T06:25:21.676 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-09T06:25:21.677 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-09T06:25:21.677 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-09T06:25:21.677 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-09T06:25:21.677 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-09T06:25:21.678 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-09T06:25:21.678 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-09T06:25:21.678 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-09T06:25:21.679 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-09T06:25:21.679 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-09T06:25:21.679 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-09T06:25:21.679 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-09T06:25:21.680 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-09T06:25:21.680 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-09T06:25:21.680 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-09T06:25:21.680 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-09T06:25:21.681 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-09T06:25:21.681 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-09T06:25:21.681 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-09T06:25:21.681 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-09T06:25:21.682 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-09T06:25:21.682 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-09T06:25:21.682 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-09T06:25:21.683 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-09T06:25:21.683 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-09T06:25:21.683 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-09T06:25:21.683 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-09T06:25:21.684 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-09T06:25:21.684 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-09T06:25:21.684 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-09T06:25:21.684 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-09T06:25:21.685 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-09T06:25:21.685 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-09T06:25:21.685 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-09T06:25:21.686 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-09T06:25:21.686 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-09T06:25:21.686 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-09T06:25:21.686 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-09T06:25:21.687 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-09T06:25:21.687 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-09T06:25:21.687 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-09T06:25:21.687 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-09T06:25:21.688 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-09T06:25:21.688 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-09T06:25:21.688 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-09T06:25:21.688 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-09T06:25:21.689 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-09T06:25:21.689 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-09T06:25:21.689 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-09T06:25:21.689 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-09T06:25:21.690 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-09T06:25:21.690 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-09T06:25:21.690 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-09T06:25:21.690 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-09T06:25:21.691 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-09T06:25:21.691 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-09T06:25:21.691 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-09T06:25:21.691 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-09T06:25:21.692 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-09T06:25:21.692 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-09T06:25:21.692 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-09T06:25:21.692 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-09T06:25:21.693 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-09T06:25:21.693 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-09T06:25:21.693 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-09T06:25:21.693 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-09T06:25:21.694 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-09T06:25:21.694 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-09T06:25:21.694 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-09T06:25:21.694 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-09T06:25:21.695 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-09T06:25:21.695 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-09T06:25:21.695 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-09T06:25:21.695 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-09T06:25:21.696 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-09T06:25:21.696 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-09T06:25:21.696 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-09T06:25:21.696 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-09T06:25:21.696 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-09T06:25:21.696 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-09T06:25:21.697 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-09T06:25:21.697 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-09T06:25:21.697 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-09T06:25:21.697 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-09T06:25:21.697 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-09T06:25:21.698 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-09T06:25:21.698 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-09T06:25:21.698 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-09T06:25:21.698 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-09T06:25:21.698 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-09T06:25:21.699 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-09T06:25:21.699 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-09T06:25:21.699 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-09T06:25:21.699 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-09T06:25:21.699 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-09T06:25:21.700 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-09T06:25:21.700 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-09T06:25:21.700 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-09T06:25:21.700 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-09T06:25:21.700 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-09T06:25:21.701 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-09T06:25:21.701 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-09T06:25:21.701 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-09T06:25:21.701 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-09T06:25:21.701 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-09T06:25:21.702 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-09T06:25:21.702 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-09T06:25:21.702 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-09T06:25:21.702 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-09T06:25:21.702 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-09T06:25:21.703 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-09T06:25:21.703 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-09T06:25:21.703 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-09T06:25:21.703 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-09T06:25:21.703 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-09T06:25:21.704 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-09T06:25:21.704 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-09T06:25:21.704 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-09T06:25:21.704 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-09T06:25:21.704 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-09T06:25:21.705 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-09T06:25:21.705 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-09T06:25:21.705 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-09T06:25:21.705 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-09T06:25:21.705 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-09T06:25:21.705 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-09T06:25:21.706 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-09T06:25:21.706 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-09T06:25:21.706 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-09T06:25:21.706 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-09T06:25:21.706 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-09T06:25:21.707 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-09T06:25:21.707 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-09T06:25:21.707 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-09T06:25:21.707 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-09T06:25:21.707 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-09T06:25:21.708 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-09T06:25:21.708 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-09T06:25:21.708 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-09T06:25:21.708 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-09T06:25:21.708 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-09T06:25:21.709 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-09T06:25:21.709 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-09T06:25:21.709 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-09T06:25:21.709 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-09T06:25:21.709 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-09T06:25:21.710 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-09T06:25:21.710 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-09T06:25:21.710 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-09T06:25:21.710 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-09T06:25:21.711 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-09T06:25:21.711 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-09T06:25:21.711 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-09T06:25:21.711 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-09T06:25:21.711 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-09T06:25:21.712 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-09T06:25:21.712 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-09T06:25:21.712 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-09T06:25:21.712 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-09T06:25:21.712 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-09T06:25:21.712 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-09T06:25:21.713 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-09T06:25:21.713 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-09T06:25:21.713 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-09T06:25:21.713 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-09T06:25:21.713 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-09T06:25:21.714 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-09T06:25:21.714 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-09T06:25:21.714 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-09T06:25:21.714 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-09T06:25:21.714 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-09T06:25:21.715 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-09T06:25:21.715 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-09T06:25:21.715 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-09T06:25:21.715 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-09T06:25:21.715 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-09T06:25:21.716 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-09T06:25:21.716 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-09T06:25:21.716 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-09T06:25:21.716 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-09T06:25:21.716 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-09T06:25:21.717 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-09T06:25:21.717 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-09T06:25:21.717 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-09T06:25:21.717 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-09T06:25:21.717 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-09T06:25:21.718 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-09T06:25:21.718 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-09T06:25:21.718 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-09T06:25:21.718 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-09T06:25:21.718 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-09T06:25:21.719 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-09T06:25:21.719 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-09T06:25:21.719 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-09T06:25:21.719 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-09T06:25:21.719 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-09T06:25:21.720 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-09T06:25:21.720 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-09T06:25:21.720 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-09T06:25:21.720 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-09T06:25:21.721 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-09T06:25:21.721 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-09T06:25:21.721 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-09T06:25:21.721 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-09T06:25:21.721 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-09T06:25:21.722 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-09T06:25:21.722 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-09T06:25:21.722 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-09T06:25:21.722 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-09T06:25:21.722 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-09T06:25:21.723 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-09T06:25:21.723 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-09T06:25:21.723 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-09T06:25:21.723 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-09T06:25:21.724 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-09T06:25:21.724 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-09T06:25:21.724 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-09T06:25:21.724 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-09T06:25:21.724 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-09T06:25:21.725 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-09T06:25:21.725 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-09T06:25:21.725 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-09T06:25:21.725 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-09T06:25:21.725 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-09T06:25:21.726 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-09T06:25:21.726 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-09T06:25:21.726 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-09T06:25:21.726 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-09T06:25:21.726 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-09T06:25:21.727 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-09T06:25:21.727 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-09T06:25:21.727 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-09T06:25:21.727 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-09T06:25:21.727 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-09T06:25:21.728 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-09T06:25:21.728 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-09T06:25:21.728 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-09T06:25:21.728 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-09T06:25:21.728 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-09T06:25:21.728 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-09T06:25:21.729 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-09T06:25:21.729 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-09T06:25:21.729 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-09T06:25:21.729 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-09T06:25:21.729 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-09T06:25:21.730 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-09T06:25:21.730 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-09T06:25:21.730 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-09T06:25:21.730 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-09T06:25:21.731 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-09T06:25:21.731 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-09T06:25:21.731 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-09T06:25:21.731 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-09T06:25:21.731 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-09T06:25:21.732 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-09T06:25:21.732 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-09T06:25:21.732 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-09T06:25:21.732 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-09T06:25:21.732 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-09T06:25:21.732 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-09T06:25:21.732 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-09T06:25:21.732 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-09T06:25:21.732 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-09T06:25:21.732 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-09T06:25:21.732 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-09T06:25:21.733 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-09T06:25:21.733 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-09T06:25:21.733 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-09T06:25:21.733 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-09T06:25:21.733 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-09T06:25:21.733 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-09T06:25:21.733 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-09T06:25:21.733 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-09T06:25:21.733 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-09T06:25:21.733 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-09T06:25:21.733 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-09T06:25:21.733 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-09T06:25:21.734 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-09T06:25:21.734 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-09T06:25:21.734 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-09T06:25:21.734 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-09T06:25:21.734 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-09T06:25:21.734 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-09T06:25:21.734 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-09T06:25:21.734 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-09T06:25:21.734 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-09T06:25:21.734 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-09T06:25:21.734 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-09T06:25:21.735 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-09T06:25:21.735 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-09T06:25:21.735 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-09T06:25:21.735 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-09T06:25:21.735 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-09T06:25:21.735 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-09T06:25:21.735 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-09T06:25:21.735 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-09T06:25:21.735 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-09T06:25:21.735 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-09T06:25:21.735 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-09T06:25:21.736 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-09T06:25:21.736 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-09T06:25:21.736 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-09T06:25:21.736 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-09T06:25:21.736 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-09T06:25:21.736 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-09T06:25:21.736 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-09T06:25:21.736 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-09T06:25:21.736 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-09T06:25:21.736 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-09T06:25:21.736 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-09T06:25:21.736 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-09T06:25:21.737 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-09T06:25:21.737 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-09T06:25:21.737 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-09T06:25:21.737 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-09T06:25:21.737 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-09T06:25:21.737 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-09T06:25:21.737 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-09T06:25:21.737 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-09T06:25:21.737 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-09T06:25:21.737 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-09T06:25:21.737 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-09T06:25:21.737 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-09T06:25:21.738 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-09T06:25:21.738 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-09T06:25:21.738 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-09T06:25:21.738 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-09T06:25:21.738 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-09T06:25:21.738 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-09T06:25:21.738 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-09T06:25:21.738 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-09T06:25:21.738 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-09T06:25:21.738 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-09T06:25:21.738 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-09T06:25:21.738 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-09T06:25:21.739 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-09T06:25:21.739 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-09T06:25:21.739 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-09T06:25:21.739 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-09T06:25:21.739 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-09T06:25:21.739 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-09T06:25:21.739 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-09T06:25:21.739 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-09T06:25:21.739 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-09T06:25:21.739 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-09T06:25:21.739 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-09T06:25:21.739 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-09T06:25:21.740 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-09T06:25:21.740 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-09T06:25:21.740 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-09T06:25:21.740 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-09T06:25:21.740 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-09T06:25:21.740 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-09T06:25:21.740 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-09T06:25:21.740 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-09T06:25:21.740 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-09T06:25:21.740 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-09T06:25:21.741 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-09T06:25:21.741 DEBUG:teuthology.orchestra.run.smithi071:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-09T06:25:21.765 INFO:teuthology.orchestra.run.smithi071.stdout:postinstall scriptlet (using /bin/sh): 2023-10-09T06:25:21.765 INFO:teuthology.orchestra.run.smithi071.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-09T06:25:21.765 INFO:teuthology.orchestra.run.smithi071.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-09T06:25:21.765 INFO:teuthology.orchestra.run.smithi071.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-09T06:25:21.765 INFO:teuthology.orchestra.run.smithi071.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-09T06:25:21.765 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-09T06:25:21.765 INFO:teuthology.orchestra.run.smithi071.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-09T06:25:21.765 INFO:teuthology.orchestra.run.smithi071.stdout:fi 2023-10-09T06:25:21.765 INFO:teuthology.orchestra.run.smithi071.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-09T06:25:21.765 INFO:teuthology.orchestra.run.smithi071.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-09T06:25:21.766 INFO:teuthology.orchestra.run.smithi071.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-09T06:25:21.766 INFO:teuthology.orchestra.run.smithi071.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-09T06:25:21.766 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-09T06:25:21.766 INFO:teuthology.orchestra.run.smithi071.stdout:fi 2023-10-09T06:25:21.766 INFO:teuthology.orchestra.run.smithi071.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-09T06:25:21.766 INFO:teuthology.orchestra.run.smithi071.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-09T06:25:21.766 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-09T06:25:21.766 INFO:teuthology.orchestra.run.smithi071.stdout:fi 2023-10-09T06:25:21.767 DEBUG:teuthology.orchestra.run.smithi071:> sudo rpm -qi grub2-tools 2023-10-09T06:25:21.842 INFO:teuthology.orchestra.run.smithi071.stdout:Name : grub2-tools 2023-10-09T06:25:21.842 INFO:teuthology.orchestra.run.smithi071.stdout:Epoch : 1 2023-10-09T06:25:21.842 INFO:teuthology.orchestra.run.smithi071.stdout:Version : 2.02 2023-10-09T06:25:21.842 INFO:teuthology.orchestra.run.smithi071.stdout:Release : 99.el8_4.1 2023-10-09T06:25:21.842 INFO:teuthology.orchestra.run.smithi071.stdout:Architecture: x86_64 2023-10-09T06:25:21.842 INFO:teuthology.orchestra.run.smithi071.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-09T06:25:21.842 INFO:teuthology.orchestra.run.smithi071.stdout:Group : System Environment/Base 2023-10-09T06:25:21.843 INFO:teuthology.orchestra.run.smithi071.stdout:Size : 9264631 2023-10-09T06:25:21.843 INFO:teuthology.orchestra.run.smithi071.stdout:License : GPLv3+ 2023-10-09T06:25:21.843 INFO:teuthology.orchestra.run.smithi071.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-09T06:25:21.843 INFO:teuthology.orchestra.run.smithi071.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-09T06:25:21.843 INFO:teuthology.orchestra.run.smithi071.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-09T06:25:21.843 INFO:teuthology.orchestra.run.smithi071.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-09T06:25:21.843 INFO:teuthology.orchestra.run.smithi071.stdout:Relocations : (not relocatable) 2023-10-09T06:25:21.843 INFO:teuthology.orchestra.run.smithi071.stdout:Packager : Red Hat, Inc. 2023-10-09T06:25:21.843 INFO:teuthology.orchestra.run.smithi071.stdout:Vendor : Red Hat, Inc. 2023-10-09T06:25:21.843 INFO:teuthology.orchestra.run.smithi071.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-09T06:25:21.843 INFO:teuthology.orchestra.run.smithi071.stdout:Summary : Support tools for GRUB. 2023-10-09T06:25:21.843 INFO:teuthology.orchestra.run.smithi071.stdout:Description : 2023-10-09T06:25:21.843 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:25:21.844 INFO:teuthology.orchestra.run.smithi071.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-09T06:25:21.844 INFO:teuthology.orchestra.run.smithi071.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-09T06:25:21.844 INFO:teuthology.orchestra.run.smithi071.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-09T06:25:21.844 INFO:teuthology.orchestra.run.smithi071.stdout:hardware devices. 2023-10-09T06:25:21.844 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:25:21.844 INFO:teuthology.orchestra.run.smithi071.stdout:This subpackage provides tools for support of all platforms. 2023-10-09T06:25:21.845 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-09T06:25:21.845 INFO:teuthology.task.kernel:Updating grub on smithi071 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-09T06:25:21.845 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-09T06:25:22.048 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi179.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-09T06:25:22.048 DEBUG:teuthology.orchestra.run.smithi179:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-09T06:25:22.103 INFO:teuthology.orchestra.run.smithi179.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-09T06:25:22.103 INFO:teuthology.orchestra.run.smithi179.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-09T06:25:22.103 INFO:teuthology.orchestra.run.smithi179.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-09T06:25:22.103 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-09T06:25:22.103 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-09T06:25:22.103 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-09T06:25:22.103 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-09T06:25:22.104 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-09T06:25:22.104 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-09T06:25:22.104 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-09T06:25:22.104 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-09T06:25:22.104 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-09T06:25:22.104 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-09T06:25:22.104 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-09T06:25:22.104 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-09T06:25:22.104 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-09T06:25:22.104 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-09T06:25:22.104 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-09T06:25:22.104 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-09T06:25:22.105 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-09T06:25:22.105 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-09T06:25:22.105 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-09T06:25:22.105 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-09T06:25:22.105 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-09T06:25:22.105 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-09T06:25:22.105 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-09T06:25:22.105 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-09T06:25:22.105 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-09T06:25:22.105 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-09T06:25:22.105 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-09T06:25:22.105 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-09T06:25:22.106 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-09T06:25:22.106 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-09T06:25:22.106 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-09T06:25:22.106 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-09T06:25:22.106 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-09T06:25:22.106 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-09T06:25:22.106 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-09T06:25:22.106 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-09T06:25:22.106 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-09T06:25:22.106 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-09T06:25:22.106 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-09T06:25:22.106 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-09T06:25:22.107 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-09T06:25:22.107 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-09T06:25:22.107 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-09T06:25:22.107 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-09T06:25:22.107 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-09T06:25:22.107 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-09T06:25:22.107 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-09T06:25:22.107 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-09T06:25:22.107 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-09T06:25:22.107 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-09T06:25:22.107 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-09T06:25:22.107 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-09T06:25:22.108 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-09T06:25:22.108 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-09T06:25:22.108 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-09T06:25:22.108 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-09T06:25:22.108 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-09T06:25:22.108 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-09T06:25:22.108 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-09T06:25:22.108 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-09T06:25:22.108 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-09T06:25:22.108 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-09T06:25:22.108 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-09T06:25:22.109 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-09T06:25:22.109 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-09T06:25:22.109 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-09T06:25:22.109 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-09T06:25:22.109 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-09T06:25:22.109 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-09T06:25:22.109 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-09T06:25:22.109 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-09T06:25:22.109 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-09T06:25:22.109 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-09T06:25:22.109 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-09T06:25:22.109 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-09T06:25:22.110 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-09T06:25:22.110 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-09T06:25:22.110 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-09T06:25:22.110 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-09T06:25:22.110 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-09T06:25:22.110 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-09T06:25:22.110 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-09T06:25:22.110 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-09T06:25:22.110 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-09T06:25:22.110 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-09T06:25:22.110 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-09T06:25:22.110 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-09T06:25:22.111 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-09T06:25:22.111 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-09T06:25:22.111 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-09T06:25:22.111 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-09T06:25:22.111 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-09T06:25:22.111 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-09T06:25:22.111 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-09T06:25:22.111 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-09T06:25:22.111 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-09T06:25:22.111 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-09T06:25:22.111 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-09T06:25:22.111 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-09T06:25:22.112 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-09T06:25:22.112 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-09T06:25:22.112 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-09T06:25:22.112 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-09T06:25:22.112 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-09T06:25:22.112 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-09T06:25:22.112 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-09T06:25:22.112 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-09T06:25:22.112 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-09T06:25:22.112 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-09T06:25:22.112 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-09T06:25:22.112 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-09T06:25:22.113 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-09T06:25:22.113 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-09T06:25:22.113 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-09T06:25:22.113 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-09T06:25:22.113 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-09T06:25:22.113 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-09T06:25:22.113 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-09T06:25:22.113 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-09T06:25:22.113 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-09T06:25:22.113 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-09T06:25:22.113 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-09T06:25:22.114 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-09T06:25:22.114 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-09T06:25:22.114 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-09T06:25:22.114 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-09T06:25:22.114 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-09T06:25:22.114 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-09T06:25:22.114 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-09T06:25:22.114 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-09T06:25:22.114 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-09T06:25:22.114 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-09T06:25:22.114 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-09T06:25:22.115 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-09T06:25:22.115 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-09T06:25:22.115 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-09T06:25:22.115 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-09T06:25:22.115 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-09T06:25:22.115 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-09T06:25:22.115 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-09T06:25:22.115 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-09T06:25:22.115 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-09T06:25:22.115 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-09T06:25:22.115 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-09T06:25:22.115 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-09T06:25:22.116 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-09T06:25:22.116 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-09T06:25:22.116 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-09T06:25:22.116 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-09T06:25:22.116 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-09T06:25:22.116 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-09T06:25:22.116 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-09T06:25:22.116 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-09T06:25:22.116 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-09T06:25:22.116 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-09T06:25:22.116 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-09T06:25:22.117 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-09T06:25:22.117 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-09T06:25:22.117 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-09T06:25:22.117 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-09T06:25:22.117 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-09T06:25:22.117 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-09T06:25:22.117 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-09T06:25:22.117 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-09T06:25:22.117 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-09T06:25:22.117 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-09T06:25:22.117 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-09T06:25:22.117 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-09T06:25:22.118 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-09T06:25:22.118 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-09T06:25:22.118 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-09T06:25:22.118 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-09T06:25:22.118 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-09T06:25:22.118 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-09T06:25:22.118 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-09T06:25:22.118 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-09T06:25:22.118 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-09T06:25:22.118 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-09T06:25:22.118 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-09T06:25:22.118 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-09T06:25:22.119 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-09T06:25:22.119 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-09T06:25:22.119 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-09T06:25:22.119 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-09T06:25:22.119 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-09T06:25:22.119 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-09T06:25:22.119 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-09T06:25:22.119 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-09T06:25:22.119 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-09T06:25:22.119 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-09T06:25:22.119 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-09T06:25:22.120 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-09T06:25:22.120 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-09T06:25:22.120 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-09T06:25:22.120 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-09T06:25:22.120 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-09T06:25:22.120 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-09T06:25:22.120 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-09T06:25:22.120 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-09T06:25:22.120 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-09T06:25:22.120 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-09T06:25:22.120 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-09T06:25:22.120 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-09T06:25:22.121 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-09T06:25:22.121 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-09T06:25:22.121 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-09T06:25:22.121 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-09T06:25:22.121 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-09T06:25:22.121 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-09T06:25:22.121 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-09T06:25:22.121 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-09T06:25:22.121 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-09T06:25:22.121 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-09T06:25:22.121 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-09T06:25:22.122 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-09T06:25:22.122 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-09T06:25:22.122 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-09T06:25:22.122 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-09T06:25:22.122 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-09T06:25:22.122 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-09T06:25:22.122 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-09T06:25:22.122 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-09T06:25:22.122 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-09T06:25:22.122 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-09T06:25:22.122 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-09T06:25:22.122 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-09T06:25:22.123 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-09T06:25:22.123 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-09T06:25:22.123 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-09T06:25:22.123 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-09T06:25:22.123 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-09T06:25:22.123 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-09T06:25:22.123 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-09T06:25:22.123 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-09T06:25:22.123 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-09T06:25:22.123 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-09T06:25:22.123 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-09T06:25:22.123 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-09T06:25:22.124 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-09T06:25:22.124 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-09T06:25:22.124 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-09T06:25:22.124 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-09T06:25:22.124 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-09T06:25:22.124 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-09T06:25:22.124 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-09T06:25:22.124 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-09T06:25:22.124 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-09T06:25:22.124 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-09T06:25:22.124 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-09T06:25:22.124 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-09T06:25:22.125 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-09T06:25:22.125 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-09T06:25:22.125 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-09T06:25:22.125 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-09T06:25:22.125 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-09T06:25:22.125 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-09T06:25:22.125 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-09T06:25:22.125 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-09T06:25:22.125 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-09T06:25:22.125 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-09T06:25:22.125 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-09T06:25:22.126 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-09T06:25:22.126 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-09T06:25:22.126 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-09T06:25:22.126 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-09T06:25:22.126 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-09T06:25:22.126 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-09T06:25:22.126 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-09T06:25:22.126 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-09T06:25:22.126 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-09T06:25:22.126 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-09T06:25:22.126 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-09T06:25:22.126 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-09T06:25:22.127 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-09T06:25:22.127 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-09T06:25:22.127 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-09T06:25:22.127 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-09T06:25:22.127 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-09T06:25:22.127 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-09T06:25:22.127 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-09T06:25:22.127 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-09T06:25:22.127 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-09T06:25:22.127 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-09T06:25:22.127 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-09T06:25:22.127 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-09T06:25:22.128 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-09T06:25:22.128 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-09T06:25:22.128 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-09T06:25:22.128 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-09T06:25:22.128 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-09T06:25:22.128 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-09T06:25:22.128 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-09T06:25:22.128 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-09T06:25:22.128 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-09T06:25:22.128 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-09T06:25:22.128 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-09T06:25:22.129 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-09T06:25:22.129 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-09T06:25:22.129 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-09T06:25:22.129 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-09T06:25:22.129 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-09T06:25:22.129 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-09T06:25:22.129 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-09T06:25:22.129 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-09T06:25:22.129 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-09T06:25:22.129 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-09T06:25:22.129 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-09T06:25:22.129 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-09T06:25:22.129 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-09T06:25:22.130 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-09T06:25:22.130 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-09T06:25:22.130 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-09T06:25:22.130 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-09T06:25:22.130 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-09T06:25:22.130 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-09T06:25:22.130 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-09T06:25:22.130 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-09T06:25:22.130 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-09T06:25:22.130 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-09T06:25:22.130 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-09T06:25:22.131 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-09T06:25:22.131 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-09T06:25:22.131 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-09T06:25:22.131 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-09T06:25:22.131 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-09T06:25:22.131 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-09T06:25:22.131 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-09T06:25:22.131 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-09T06:25:22.131 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-09T06:25:22.131 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-09T06:25:22.131 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-09T06:25:22.131 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-09T06:25:22.131 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-09T06:25:22.132 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-09T06:25:22.132 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-09T06:25:22.132 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-09T06:25:22.132 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-09T06:25:22.132 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-09T06:25:22.132 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-09T06:25:22.132 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-09T06:25:22.132 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-09T06:25:22.132 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-09T06:25:22.132 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-09T06:25:22.132 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-09T06:25:22.132 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-09T06:25:22.133 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-09T06:25:22.133 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-09T06:25:22.133 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-09T06:25:22.133 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-09T06:25:22.133 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-09T06:25:22.133 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-09T06:25:22.133 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-09T06:25:22.133 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-09T06:25:22.133 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-09T06:25:22.133 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-09T06:25:22.133 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-09T06:25:22.134 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-09T06:25:22.134 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-09T06:25:22.134 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-09T06:25:22.134 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-09T06:25:22.134 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-09T06:25:22.134 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-09T06:25:22.134 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-09T06:25:22.134 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-09T06:25:22.134 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-09T06:25:22.134 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-09T06:25:22.134 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-09T06:25:22.134 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-09T06:25:22.135 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-09T06:25:22.135 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-09T06:25:22.135 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-09T06:25:22.135 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-09T06:25:22.135 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-09T06:25:22.135 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-09T06:25:22.135 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-09T06:25:22.135 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-09T06:25:22.135 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-09T06:25:22.135 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-09T06:25:22.135 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-09T06:25:22.135 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-09T06:25:22.136 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-09T06:25:22.136 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-09T06:25:22.136 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-09T06:25:22.136 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-09T06:25:22.136 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-09T06:25:22.136 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-09T06:25:22.136 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-09T06:25:22.136 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-09T06:25:22.136 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-09T06:25:22.136 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-09T06:25:22.136 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-09T06:25:22.136 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-09T06:25:22.137 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-09T06:25:22.137 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-09T06:25:22.137 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-09T06:25:22.137 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-09T06:25:22.137 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-09T06:25:22.137 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-09T06:25:22.137 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-09T06:25:22.137 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-09T06:25:22.137 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-09T06:25:22.137 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-09T06:25:22.137 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-09T06:25:22.137 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-09T06:25:22.137 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-09T06:25:22.138 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-09T06:25:22.138 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-09T06:25:22.138 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-09T06:25:22.138 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-09T06:25:22.138 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-09T06:25:22.138 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-09T06:25:22.138 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-09T06:25:22.138 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-09T06:25:22.138 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-09T06:25:22.138 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-09T06:25:22.138 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-09T06:25:22.139 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-09T06:25:22.139 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-09T06:25:22.139 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-09T06:25:22.139 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-09T06:25:22.139 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-09T06:25:22.139 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-09T06:25:22.139 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-09T06:25:22.139 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-09T06:25:22.139 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-09T06:25:22.139 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-09T06:25:22.139 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-09T06:25:22.139 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-09T06:25:22.140 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-09T06:25:22.140 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-09T06:25:22.140 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-09T06:25:22.140 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-09T06:25:22.140 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-09T06:25:22.140 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-09T06:25:22.140 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-09T06:25:22.140 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-09T06:25:22.140 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-09T06:25:22.140 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-09T06:25:22.140 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-09T06:25:22.140 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-09T06:25:22.141 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-09T06:25:22.141 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-09T06:25:22.141 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-09T06:25:22.141 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-09T06:25:22.141 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-09T06:25:22.141 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-09T06:25:22.141 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-09T06:25:22.141 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-09T06:25:22.141 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-09T06:25:22.141 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-09T06:25:22.141 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-09T06:25:22.141 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-09T06:25:22.142 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-09T06:25:22.142 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-09T06:25:22.142 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-09T06:25:22.142 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-09T06:25:22.142 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-09T06:25:22.142 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-09T06:25:22.142 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-09T06:25:22.142 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-09T06:25:22.142 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-09T06:25:22.142 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-09T06:25:22.142 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-09T06:25:22.142 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-09T06:25:22.143 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-09T06:25:22.143 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-09T06:25:22.143 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-09T06:25:22.143 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-09T06:25:22.143 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-09T06:25:22.143 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-09T06:25:22.143 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-09T06:25:22.143 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-09T06:25:22.143 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-09T06:25:22.143 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-09T06:25:22.143 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-09T06:25:22.144 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-09T06:25:22.144 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-09T06:25:22.144 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-09T06:25:22.144 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-09T06:25:22.144 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-09T06:25:22.144 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-09T06:25:22.144 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-09T06:25:22.144 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-09T06:25:22.144 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-09T06:25:22.144 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-09T06:25:22.144 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-09T06:25:22.144 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-09T06:25:22.145 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-09T06:25:22.145 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-09T06:25:22.145 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-09T06:25:22.145 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-09T06:25:22.145 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-09T06:25:22.145 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-09T06:25:22.145 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-09T06:25:22.145 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-09T06:25:22.145 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-09T06:25:22.145 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-09T06:25:22.145 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-09T06:25:22.145 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-09T06:25:22.146 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-09T06:25:22.146 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-09T06:25:22.146 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-09T06:25:22.146 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-09T06:25:22.146 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-09T06:25:22.146 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-09T06:25:22.146 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-09T06:25:22.146 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-09T06:25:22.146 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-09T06:25:22.146 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-09T06:25:22.146 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-09T06:25:22.146 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-09T06:25:22.147 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-09T06:25:22.147 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-09T06:25:22.147 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-09T06:25:22.147 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-09T06:25:22.147 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-09T06:25:22.147 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-09T06:25:22.147 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-09T06:25:22.147 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-09T06:25:22.147 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-09T06:25:22.147 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-09T06:25:22.147 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-09T06:25:22.148 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-09T06:25:22.148 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-09T06:25:22.148 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-09T06:25:22.148 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-09T06:25:22.148 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-09T06:25:22.148 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-09T06:25:22.148 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-09T06:25:22.148 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-09T06:25:22.148 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-09T06:25:22.148 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-09T06:25:22.148 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-09T06:25:22.148 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-09T06:25:22.149 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-09T06:25:22.149 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-09T06:25:22.149 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-09T06:25:22.149 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-09T06:25:22.149 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-09T06:25:22.149 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-09T06:25:22.149 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-09T06:25:22.149 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-09T06:25:22.149 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-09T06:25:22.149 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-09T06:25:22.149 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-09T06:25:22.149 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-09T06:25:22.150 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-09T06:25:22.150 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-09T06:25:22.150 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-09T06:25:22.150 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-09T06:25:22.150 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-09T06:25:22.150 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-09T06:25:22.150 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-09T06:25:22.150 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-09T06:25:22.150 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-09T06:25:22.150 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-09T06:25:22.150 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-09T06:25:22.151 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-09T06:25:22.151 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-09T06:25:22.151 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-09T06:25:22.151 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-09T06:25:22.151 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-09T06:25:22.151 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-09T06:25:22.151 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-09T06:25:22.151 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-09T06:25:22.151 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-09T06:25:22.151 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-09T06:25:22.151 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-09T06:25:22.151 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-09T06:25:22.152 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-09T06:25:22.152 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-09T06:25:22.152 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-09T06:25:22.152 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-09T06:25:22.152 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-09T06:25:22.152 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-09T06:25:22.152 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-09T06:25:22.152 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-09T06:25:22.152 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-09T06:25:22.152 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-09T06:25:22.152 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-09T06:25:22.152 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-09T06:25:22.153 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-09T06:25:22.153 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-09T06:25:22.153 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-09T06:25:22.153 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-09T06:25:22.153 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-09T06:25:22.153 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-09T06:25:22.153 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-09T06:25:22.153 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-09T06:25:22.153 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-09T06:25:22.153 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-09T06:25:22.153 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-09T06:25:22.154 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-09T06:25:22.154 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-09T06:25:22.154 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-09T06:25:22.154 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-09T06:25:22.154 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-09T06:25:22.154 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-09T06:25:22.154 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-09T06:25:22.154 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-09T06:25:22.154 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-09T06:25:22.154 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-09T06:25:22.154 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-09T06:25:22.154 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-09T06:25:22.155 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-09T06:25:22.155 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-09T06:25:22.155 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-09T06:25:22.155 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-09T06:25:22.155 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-09T06:25:22.155 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-09T06:25:22.155 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-09T06:25:22.155 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-09T06:25:22.155 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-09T06:25:22.155 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-09T06:25:22.155 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-09T06:25:22.156 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-09T06:25:22.156 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-09T06:25:22.156 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-09T06:25:22.156 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-09T06:25:22.156 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-09T06:25:22.156 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-09T06:25:22.156 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-09T06:25:22.156 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-09T06:25:22.156 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-09T06:25:22.156 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-09T06:25:22.156 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-09T06:25:22.156 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-09T06:25:22.157 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-09T06:25:22.157 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-09T06:25:22.157 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-09T06:25:22.157 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-09T06:25:22.157 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-09T06:25:22.157 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-09T06:25:22.157 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-09T06:25:22.157 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-09T06:25:22.157 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-09T06:25:22.157 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-09T06:25:22.157 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-09T06:25:22.157 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-09T06:25:22.158 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-09T06:25:22.158 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-09T06:25:22.158 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-09T06:25:22.158 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-09T06:25:22.158 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-09T06:25:22.158 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-09T06:25:22.158 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-09T06:25:22.158 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-09T06:25:22.158 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-09T06:25:22.158 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-09T06:25:22.158 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-09T06:25:22.159 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-09T06:25:22.159 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-09T06:25:22.159 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-09T06:25:22.159 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-09T06:25:22.159 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-09T06:25:22.159 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-09T06:25:22.159 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-09T06:25:22.159 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-09T06:25:22.159 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-09T06:25:22.159 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-09T06:25:22.159 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-09T06:25:22.159 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-09T06:25:22.160 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-09T06:25:22.160 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-09T06:25:22.160 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-09T06:25:22.160 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-09T06:25:22.160 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-09T06:25:22.160 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-09T06:25:22.160 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-09T06:25:22.160 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-09T06:25:22.160 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-09T06:25:22.160 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-09T06:25:22.160 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-09T06:25:22.160 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-09T06:25:22.161 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-09T06:25:22.161 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-09T06:25:22.161 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-09T06:25:22.161 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-09T06:25:22.161 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-09T06:25:22.161 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-09T06:25:22.161 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-09T06:25:22.161 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-09T06:25:22.161 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-09T06:25:22.161 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-09T06:25:22.161 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-09T06:25:22.161 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-09T06:25:22.162 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-09T06:25:22.162 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-09T06:25:22.162 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-09T06:25:22.162 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-09T06:25:22.162 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-09T06:25:22.162 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-09T06:25:22.162 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-09T06:25:22.162 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-09T06:25:22.162 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-09T06:25:22.162 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-09T06:25:22.162 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-09T06:25:22.163 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-09T06:25:22.163 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-09T06:25:22.163 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-09T06:25:22.163 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-09T06:25:22.163 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-09T06:25:22.163 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-09T06:25:22.163 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-09T06:25:22.163 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-09T06:25:22.163 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-09T06:25:22.163 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-09T06:25:22.163 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-09T06:25:22.163 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-09T06:25:22.164 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-09T06:25:22.164 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-09T06:25:22.164 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-09T06:25:22.164 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-09T06:25:22.164 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-09T06:25:22.164 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-09T06:25:22.164 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-09T06:25:22.164 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-09T06:25:22.164 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-09T06:25:22.164 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-09T06:25:22.164 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-09T06:25:22.164 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-09T06:25:22.165 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-09T06:25:22.165 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-09T06:25:22.165 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-09T06:25:22.165 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-09T06:25:22.165 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-09T06:25:22.165 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-09T06:25:22.165 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-09T06:25:22.165 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-09T06:25:22.165 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-09T06:25:22.165 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-09T06:25:22.165 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-09T06:25:22.165 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-09T06:25:22.165 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-09T06:25:22.166 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-09T06:25:22.166 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-09T06:25:22.166 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-09T06:25:22.166 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-09T06:25:22.166 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-09T06:25:22.166 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-09T06:25:22.166 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-09T06:25:22.166 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-09T06:25:22.166 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-09T06:25:22.166 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-09T06:25:22.166 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-09T06:25:22.166 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-09T06:25:22.167 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-09T06:25:22.167 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-09T06:25:22.167 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-09T06:25:22.167 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-09T06:25:22.167 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-09T06:25:22.167 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-09T06:25:22.167 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-09T06:25:22.167 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-09T06:25:22.167 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-09T06:25:22.167 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-09T06:25:22.167 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-09T06:25:22.167 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-09T06:25:22.168 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-09T06:25:22.168 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-09T06:25:22.168 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-09T06:25:22.168 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-09T06:25:22.168 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-09T06:25:22.168 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-09T06:25:22.168 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-09T06:25:22.168 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-09T06:25:22.168 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-09T06:25:22.168 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-09T06:25:22.168 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-09T06:25:22.168 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-09T06:25:22.169 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-09T06:25:22.169 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-09T06:25:22.169 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-09T06:25:22.169 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-09T06:25:22.169 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-09T06:25:22.169 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-09T06:25:22.169 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-09T06:25:22.169 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-09T06:25:22.169 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-09T06:25:22.169 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-09T06:25:22.169 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-09T06:25:22.169 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-09T06:25:22.170 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-09T06:25:22.170 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-09T06:25:22.170 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-09T06:25:22.170 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-09T06:25:22.170 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-09T06:25:22.170 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-09T06:25:22.170 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-09T06:25:22.170 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-09T06:25:22.170 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-09T06:25:22.170 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-09T06:25:22.170 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-09T06:25:22.170 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-09T06:25:22.171 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-09T06:25:22.171 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-09T06:25:22.171 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-09T06:25:22.171 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-09T06:25:22.171 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-09T06:25:22.171 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-09T06:25:22.171 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-09T06:25:22.171 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-09T06:25:22.171 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-09T06:25:22.171 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-09T06:25:22.171 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-09T06:25:22.171 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-09T06:25:22.172 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-09T06:25:22.172 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-09T06:25:22.172 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-09T06:25:22.172 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-09T06:25:22.172 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-09T06:25:22.172 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-09T06:25:22.172 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-09T06:25:22.172 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-09T06:25:22.172 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-09T06:25:22.172 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-09T06:25:22.172 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-09T06:25:22.172 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-09T06:25:22.173 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-09T06:25:22.173 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-09T06:25:22.173 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-09T06:25:22.173 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-09T06:25:22.173 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-09T06:25:22.173 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-09T06:25:22.173 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-09T06:25:22.173 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-09T06:25:22.173 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-09T06:25:22.173 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-09T06:25:22.173 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-09T06:25:22.173 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-09T06:25:22.174 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-09T06:25:22.174 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-09T06:25:22.174 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-09T06:25:22.174 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-09T06:25:22.174 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-09T06:25:22.174 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-09T06:25:22.174 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-09T06:25:22.174 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-09T06:25:22.174 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-09T06:25:22.174 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-09T06:25:22.174 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-09T06:25:22.174 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-09T06:25:22.175 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-09T06:25:22.175 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-09T06:25:22.175 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-09T06:25:22.175 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-09T06:25:22.175 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-09T06:25:22.175 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-09T06:25:22.175 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-09T06:25:22.175 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-09T06:25:22.175 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-09T06:25:22.175 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-09T06:25:22.175 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-09T06:25:22.175 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-09T06:25:22.176 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-09T06:25:22.176 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-09T06:25:22.176 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-09T06:25:22.176 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-09T06:25:22.176 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-09T06:25:22.176 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-09T06:25:22.176 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-09T06:25:22.176 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-09T06:25:22.176 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-09T06:25:22.176 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-09T06:25:22.176 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-09T06:25:22.177 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-09T06:25:22.177 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-09T06:25:22.177 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-09T06:25:22.177 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-09T06:25:22.177 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-09T06:25:22.177 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-09T06:25:22.177 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-09T06:25:22.177 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-09T06:25:22.177 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-09T06:25:22.177 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-09T06:25:22.177 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-09T06:25:22.177 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-09T06:25:22.177 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-09T06:25:22.178 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-09T06:25:22.178 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-09T06:25:22.178 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-09T06:25:22.178 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-09T06:25:22.178 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-09T06:25:22.178 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-09T06:25:22.178 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-09T06:25:22.178 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-09T06:25:22.178 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-09T06:25:22.178 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-09T06:25:22.178 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-09T06:25:22.179 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-09T06:25:22.179 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-09T06:25:22.179 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-09T06:25:22.179 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-09T06:25:22.179 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-09T06:25:22.179 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-09T06:25:22.179 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-09T06:25:22.179 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-09T06:25:22.179 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-09T06:25:22.179 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-09T06:25:22.179 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-09T06:25:22.179 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-09T06:25:22.180 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-09T06:25:22.180 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-09T06:25:22.180 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-09T06:25:22.180 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-09T06:25:22.180 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-09T06:25:22.180 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-09T06:25:22.180 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-09T06:25:22.180 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-09T06:25:22.180 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-09T06:25:22.180 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-09T06:25:22.180 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-09T06:25:22.180 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-09T06:25:22.181 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-09T06:25:22.181 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-09T06:25:22.181 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-09T06:25:22.181 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-09T06:25:22.181 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-09T06:25:22.181 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-09T06:25:22.181 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-09T06:25:22.181 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-09T06:25:22.181 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-09T06:25:22.181 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-09T06:25:22.181 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-09T06:25:22.181 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-09T06:25:22.182 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-09T06:25:22.182 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-09T06:25:22.182 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-09T06:25:22.182 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-09T06:25:22.182 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-09T06:25:22.182 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-09T06:25:22.182 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-09T06:25:22.182 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-09T06:25:22.182 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-09T06:25:22.182 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-09T06:25:22.182 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-09T06:25:22.183 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-09T06:25:22.183 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-09T06:25:22.183 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-09T06:25:22.183 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-09T06:25:22.183 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-09T06:25:22.183 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-09T06:25:22.183 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-09T06:25:22.183 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-09T06:25:22.183 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-09T06:25:22.183 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-09T06:25:22.183 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-09T06:25:22.183 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-09T06:25:22.184 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-09T06:25:22.184 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-09T06:25:22.184 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-09T06:25:22.184 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-09T06:25:22.184 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-09T06:25:22.184 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-09T06:25:22.184 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-09T06:25:22.184 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-09T06:25:22.184 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-09T06:25:22.184 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-09T06:25:22.184 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-09T06:25:22.184 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-09T06:25:22.185 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-09T06:25:22.185 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-09T06:25:22.185 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-09T06:25:22.185 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-09T06:25:22.185 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-09T06:25:22.185 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-09T06:25:22.185 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-09T06:25:22.185 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-09T06:25:22.185 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-09T06:25:22.185 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-09T06:25:22.185 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-09T06:25:22.185 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-09T06:25:22.186 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-09T06:25:22.186 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-09T06:25:22.186 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-09T06:25:22.186 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-09T06:25:22.186 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-09T06:25:22.186 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-09T06:25:22.186 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-09T06:25:22.186 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-09T06:25:22.186 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-09T06:25:22.186 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-09T06:25:22.187 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-09T06:25:22.187 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-09T06:25:22.187 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-09T06:25:22.187 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-09T06:25:22.187 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-09T06:25:22.187 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-09T06:25:22.187 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-09T06:25:22.187 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-09T06:25:22.187 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-09T06:25:22.187 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-09T06:25:22.187 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-09T06:25:22.187 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-09T06:25:22.188 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-09T06:25:22.188 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-09T06:25:22.188 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-09T06:25:22.188 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-09T06:25:22.188 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-09T06:25:22.188 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-09T06:25:22.188 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-09T06:25:22.188 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-09T06:25:22.188 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-09T06:25:22.188 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-09T06:25:22.188 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-09T06:25:22.188 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-09T06:25:22.189 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-09T06:25:22.189 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-09T06:25:22.189 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-09T06:25:22.189 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-09T06:25:22.189 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-09T06:25:22.189 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-09T06:25:22.189 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-09T06:25:22.189 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-09T06:25:22.189 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-09T06:25:22.189 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-09T06:25:22.189 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-09T06:25:22.189 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-09T06:25:22.190 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-09T06:25:22.190 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-09T06:25:22.190 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-09T06:25:22.190 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-09T06:25:22.190 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-09T06:25:22.190 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-09T06:25:22.190 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-09T06:25:22.190 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-09T06:25:22.190 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-09T06:25:22.190 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-09T06:25:22.190 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-09T06:25:22.191 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-09T06:25:22.191 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-09T06:25:22.191 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-09T06:25:22.191 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-09T06:25:22.191 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-09T06:25:22.191 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-09T06:25:22.191 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-09T06:25:22.191 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-09T06:25:22.191 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-09T06:25:22.191 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-09T06:25:22.191 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-09T06:25:22.191 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-09T06:25:22.192 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-09T06:25:22.192 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-09T06:25:22.192 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-09T06:25:22.192 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-09T06:25:22.192 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-09T06:25:22.192 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-09T06:25:22.192 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-09T06:25:22.192 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-09T06:25:22.192 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-09T06:25:22.192 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-09T06:25:22.192 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-09T06:25:22.193 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-09T06:25:22.193 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-09T06:25:22.193 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-09T06:25:22.193 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-09T06:25:22.193 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-09T06:25:22.193 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-09T06:25:22.193 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-09T06:25:22.193 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-09T06:25:22.193 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-09T06:25:22.193 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-09T06:25:22.193 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-09T06:25:22.193 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-09T06:25:22.194 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-09T06:25:22.194 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-09T06:25:22.194 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-09T06:25:22.194 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-09T06:25:22.194 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-09T06:25:22.194 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-09T06:25:22.194 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-09T06:25:22.194 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-09T06:25:22.194 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-09T06:25:22.194 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-09T06:25:22.194 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-09T06:25:22.194 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-09T06:25:22.195 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-09T06:25:22.195 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-09T06:25:22.195 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-09T06:25:22.195 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-09T06:25:22.195 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-09T06:25:22.195 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-09T06:25:22.195 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-09T06:25:22.195 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-09T06:25:22.195 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-09T06:25:22.195 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-09T06:25:22.195 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-09T06:25:22.195 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-09T06:25:22.196 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-09T06:25:22.196 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-09T06:25:22.196 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-09T06:25:22.196 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-09T06:25:22.196 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-09T06:25:22.196 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-09T06:25:22.196 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-09T06:25:22.196 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-09T06:25:22.196 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-09T06:25:22.196 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-09T06:25:22.196 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-09T06:25:22.197 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-09T06:25:22.197 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-09T06:25:22.197 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-09T06:25:22.197 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-09T06:25:22.197 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-09T06:25:22.197 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-09T06:25:22.197 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-09T06:25:22.197 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-09T06:25:22.197 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-09T06:25:22.197 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-09T06:25:22.197 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-09T06:25:22.197 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-09T06:25:22.198 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-09T06:25:22.198 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-09T06:25:22.198 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-09T06:25:22.198 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-09T06:25:22.198 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-09T06:25:22.198 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-09T06:25:22.198 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-09T06:25:22.198 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-09T06:25:22.198 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-09T06:25:22.198 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-09T06:25:22.198 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-09T06:25:22.198 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-09T06:25:22.199 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-09T06:25:22.199 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-09T06:25:22.199 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-09T06:25:22.199 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-09T06:25:22.199 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-09T06:25:22.199 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-09T06:25:22.199 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-09T06:25:22.199 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-09T06:25:22.199 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-09T06:25:22.199 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-09T06:25:22.199 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-09T06:25:22.199 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-09T06:25:22.200 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-09T06:25:22.200 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-09T06:25:22.200 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-09T06:25:22.200 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-09T06:25:22.200 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-09T06:25:22.200 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-09T06:25:22.200 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-09T06:25:22.200 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-09T06:25:22.200 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-09T06:25:22.200 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-09T06:25:22.200 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-09T06:25:22.201 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-09T06:25:22.201 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-09T06:25:22.201 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-09T06:25:22.201 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-09T06:25:22.201 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-09T06:25:22.201 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-09T06:25:22.201 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-09T06:25:22.201 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-09T06:25:22.201 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-09T06:25:22.201 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-09T06:25:22.201 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-09T06:25:22.201 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-09T06:25:22.201 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-09T06:25:22.202 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-09T06:25:22.202 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-09T06:25:22.202 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-09T06:25:22.202 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-09T06:25:22.202 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-09T06:25:22.202 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-09T06:25:22.202 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-09T06:25:22.202 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-09T06:25:22.202 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-09T06:25:22.202 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-09T06:25:22.202 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-09T06:25:22.203 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-09T06:25:22.203 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-09T06:25:22.203 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-09T06:25:22.203 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-09T06:25:22.203 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-09T06:25:22.203 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-09T06:25:22.203 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-09T06:25:22.203 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-09T06:25:22.203 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-09T06:25:22.203 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-09T06:25:22.203 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-09T06:25:22.203 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-09T06:25:22.204 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-09T06:25:22.204 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-09T06:25:22.204 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-09T06:25:22.204 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-09T06:25:22.204 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-09T06:25:22.204 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-09T06:25:22.204 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-09T06:25:22.204 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-09T06:25:22.204 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-09T06:25:22.204 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-09T06:25:22.204 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-09T06:25:22.204 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-09T06:25:22.205 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-09T06:25:22.205 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-09T06:25:22.205 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-09T06:25:22.205 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-09T06:25:22.205 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-09T06:25:22.205 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-09T06:25:22.205 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-09T06:25:22.205 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-09T06:25:22.205 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-09T06:25:22.205 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-09T06:25:22.205 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-09T06:25:22.205 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-09T06:25:22.206 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-09T06:25:22.206 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-09T06:25:22.206 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-09T06:25:22.206 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-09T06:25:22.206 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-09T06:25:22.206 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-09T06:25:22.206 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-09T06:25:22.206 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-09T06:25:22.206 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-09T06:25:22.206 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-09T06:25:22.206 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-09T06:25:22.206 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-09T06:25:22.207 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-09T06:25:22.207 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-09T06:25:22.207 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-09T06:25:22.207 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-09T06:25:22.207 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-09T06:25:22.207 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-09T06:25:22.207 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-09T06:25:22.207 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-09T06:25:22.207 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-09T06:25:22.207 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-09T06:25:22.207 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-09T06:25:22.208 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-09T06:25:22.208 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-09T06:25:22.208 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-09T06:25:22.208 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-09T06:25:22.208 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-09T06:25:22.208 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-09T06:25:22.208 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-09T06:25:22.208 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-09T06:25:22.208 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-09T06:25:22.208 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-09T06:25:22.208 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-09T06:25:22.208 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-09T06:25:22.208 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-09T06:25:22.209 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-09T06:25:22.209 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-09T06:25:22.209 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-09T06:25:22.209 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-09T06:25:22.209 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-09T06:25:22.209 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-09T06:25:22.209 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-09T06:25:22.209 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-09T06:25:22.209 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-09T06:25:22.209 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-09T06:25:22.209 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-09T06:25:22.210 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-09T06:25:22.210 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-09T06:25:22.210 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-09T06:25:22.210 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-09T06:25:22.210 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-09T06:25:22.210 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-09T06:25:22.210 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-09T06:25:22.210 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-09T06:25:22.210 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-09T06:25:22.210 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-09T06:25:22.210 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-09T06:25:22.210 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-09T06:25:22.211 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-09T06:25:22.211 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-09T06:25:22.211 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-09T06:25:22.211 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-09T06:25:22.211 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-09T06:25:22.211 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-09T06:25:22.211 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-09T06:25:22.211 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-09T06:25:22.211 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-09T06:25:22.211 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-09T06:25:22.211 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-09T06:25:22.211 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-09T06:25:22.212 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-09T06:25:22.212 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-09T06:25:22.212 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-09T06:25:22.212 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-09T06:25:22.212 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-09T06:25:22.212 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-09T06:25:22.212 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-09T06:25:22.212 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-09T06:25:22.212 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-09T06:25:22.212 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-09T06:25:22.212 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-09T06:25:22.212 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-09T06:25:22.213 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-09T06:25:22.213 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-09T06:25:22.213 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-09T06:25:22.213 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-09T06:25:22.213 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-09T06:25:22.213 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-09T06:25:22.213 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-09T06:25:22.213 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-09T06:25:22.213 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-09T06:25:22.213 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-09T06:25:22.213 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-09T06:25:22.214 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-09T06:25:22.214 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-09T06:25:22.214 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-09T06:25:22.214 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-09T06:25:22.214 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-09T06:25:22.214 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-09T06:25:22.214 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-09T06:25:22.214 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-09T06:25:22.214 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-09T06:25:22.214 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-09T06:25:22.214 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-09T06:25:22.214 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-09T06:25:22.215 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-09T06:25:22.215 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-09T06:25:22.215 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-09T06:25:22.215 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-09T06:25:22.215 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-09T06:25:22.215 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-09T06:25:22.215 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-09T06:25:22.215 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-09T06:25:22.215 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-09T06:25:22.215 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-09T06:25:22.215 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-09T06:25:22.215 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-09T06:25:22.216 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-09T06:25:22.216 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-09T06:25:22.216 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-09T06:25:22.216 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-09T06:25:22.216 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-09T06:25:22.216 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-09T06:25:22.216 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-09T06:25:22.216 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-09T06:25:22.216 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-09T06:25:22.216 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-09T06:25:22.216 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-09T06:25:22.216 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-09T06:25:22.217 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-09T06:25:22.217 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-09T06:25:22.217 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-09T06:25:22.217 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-09T06:25:22.217 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-09T06:25:22.217 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-09T06:25:22.217 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-09T06:25:22.217 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-09T06:25:22.217 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-09T06:25:22.217 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-09T06:25:22.217 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-09T06:25:22.218 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-09T06:25:22.218 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-09T06:25:22.218 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-09T06:25:22.218 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-09T06:25:22.218 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-09T06:25:22.218 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-09T06:25:22.218 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-09T06:25:22.218 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-09T06:25:22.218 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-09T06:25:22.218 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-09T06:25:22.218 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-09T06:25:22.218 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-09T06:25:22.219 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-09T06:25:22.219 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-09T06:25:22.219 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-09T06:25:22.219 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-09T06:25:22.219 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-09T06:25:22.219 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-09T06:25:22.219 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-09T06:25:22.219 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-09T06:25:22.219 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-09T06:25:22.219 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-09T06:25:22.219 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-09T06:25:22.219 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-09T06:25:22.220 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-09T06:25:22.220 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-09T06:25:22.220 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-09T06:25:22.220 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-09T06:25:22.220 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-09T06:25:22.220 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-09T06:25:22.220 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-09T06:25:22.220 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-09T06:25:22.220 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-09T06:25:22.220 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-09T06:25:22.220 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-09T06:25:22.220 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-09T06:25:22.221 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-09T06:25:22.221 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-09T06:25:22.221 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-09T06:25:22.221 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-09T06:25:22.221 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-09T06:25:22.221 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-09T06:25:22.221 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-09T06:25:22.221 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-09T06:25:22.221 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-09T06:25:22.221 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-09T06:25:22.221 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-09T06:25:22.221 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-09T06:25:22.222 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-09T06:25:22.222 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-09T06:25:22.222 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-09T06:25:22.222 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-09T06:25:22.222 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-09T06:25:22.222 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-09T06:25:22.222 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-09T06:25:22.222 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-09T06:25:22.222 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-09T06:25:22.222 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-09T06:25:22.222 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-09T06:25:22.223 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-09T06:25:22.223 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-09T06:25:22.223 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-09T06:25:22.223 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-09T06:25:22.223 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-09T06:25:22.223 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-09T06:25:22.223 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-09T06:25:22.223 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-09T06:25:22.223 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-09T06:25:22.223 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-09T06:25:22.223 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-09T06:25:22.223 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-09T06:25:22.223 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-09T06:25:22.224 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-09T06:25:22.224 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-09T06:25:22.224 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-09T06:25:22.224 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-09T06:25:22.224 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-09T06:25:22.224 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-09T06:25:22.224 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-09T06:25:22.224 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-09T06:25:22.224 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-09T06:25:22.224 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-09T06:25:22.224 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-09T06:25:22.224 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-09T06:25:22.225 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-09T06:25:22.225 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-09T06:25:22.225 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-09T06:25:22.225 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-09T06:25:22.225 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-09T06:25:22.225 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-09T06:25:22.225 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-09T06:25:22.225 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-09T06:25:22.225 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-09T06:25:22.225 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-09T06:25:22.225 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-09T06:25:22.225 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-09T06:25:22.226 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-09T06:25:22.226 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-09T06:25:22.226 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-09T06:25:22.226 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-09T06:25:22.226 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-09T06:25:22.226 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-09T06:25:22.226 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-09T06:25:22.226 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-09T06:25:22.226 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-09T06:25:22.226 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-09T06:25:22.226 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-09T06:25:22.227 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-09T06:25:22.227 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-09T06:25:22.227 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-09T06:25:22.227 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-09T06:25:22.227 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-09T06:25:22.227 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-09T06:25:22.227 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-09T06:25:22.227 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-09T06:25:22.227 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-09T06:25:22.227 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-09T06:25:22.227 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-09T06:25:22.227 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-09T06:25:22.228 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-09T06:25:22.228 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-09T06:25:22.228 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-09T06:25:22.228 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-09T06:25:22.228 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-09T06:25:22.228 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-09T06:25:22.228 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-09T06:25:22.228 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-09T06:25:22.228 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-09T06:25:22.228 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-09T06:25:22.228 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-09T06:25:22.228 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-09T06:25:22.229 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-09T06:25:22.229 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-09T06:25:22.229 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-09T06:25:22.229 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-09T06:25:22.229 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-09T06:25:22.229 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-09T06:25:22.229 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-09T06:25:22.229 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-09T06:25:22.229 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-09T06:25:22.229 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-09T06:25:22.229 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-09T06:25:22.229 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-09T06:25:22.230 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-09T06:25:22.230 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-09T06:25:22.230 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-09T06:25:22.230 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-09T06:25:22.230 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-09T06:25:22.230 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-09T06:25:22.230 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-09T06:25:22.230 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-09T06:25:22.230 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-09T06:25:22.230 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-09T06:25:22.230 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-09T06:25:22.231 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-09T06:25:22.231 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-09T06:25:22.231 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-09T06:25:22.231 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-09T06:25:22.231 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-09T06:25:22.231 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-09T06:25:22.231 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-09T06:25:22.231 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-09T06:25:22.231 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-09T06:25:22.231 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-09T06:25:22.231 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-09T06:25:22.231 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-09T06:25:22.232 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-09T06:25:22.232 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-09T06:25:22.232 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-09T06:25:22.232 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-09T06:25:22.232 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-09T06:25:22.232 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-09T06:25:22.232 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-09T06:25:22.232 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-09T06:25:22.232 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-09T06:25:22.232 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-09T06:25:22.232 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-09T06:25:22.232 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-09T06:25:22.233 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-09T06:25:22.233 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-09T06:25:22.233 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-09T06:25:22.233 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-09T06:25:22.233 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-09T06:25:22.233 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-09T06:25:22.233 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-09T06:25:22.233 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-09T06:25:22.233 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-09T06:25:22.233 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-09T06:25:22.233 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-09T06:25:22.233 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-09T06:25:22.234 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-09T06:25:22.234 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-09T06:25:22.234 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-09T06:25:22.234 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-09T06:25:22.234 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-09T06:25:22.234 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-09T06:25:22.234 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-09T06:25:22.234 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-09T06:25:22.234 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-09T06:25:22.234 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-09T06:25:22.234 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-09T06:25:22.234 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-09T06:25:22.235 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-09T06:25:22.235 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-09T06:25:22.235 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-09T06:25:22.235 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-09T06:25:22.235 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-09T06:25:22.235 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-09T06:25:22.235 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-09T06:25:22.235 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-09T06:25:22.235 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-09T06:25:22.235 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-09T06:25:22.235 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-09T06:25:22.236 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-09T06:25:22.236 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-09T06:25:22.236 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-09T06:25:22.236 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-09T06:25:22.236 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-09T06:25:22.236 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-09T06:25:22.236 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-09T06:25:22.236 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-09T06:25:22.236 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-09T06:25:22.236 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-09T06:25:22.236 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-09T06:25:22.236 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-09T06:25:22.237 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-09T06:25:22.237 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-09T06:25:22.237 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-09T06:25:22.237 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-09T06:25:22.237 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-09T06:25:22.237 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-09T06:25:22.237 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-09T06:25:22.237 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-09T06:25:22.237 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-09T06:25:22.237 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-09T06:25:22.237 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-09T06:25:22.237 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-09T06:25:22.238 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-09T06:25:22.238 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-09T06:25:22.238 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-09T06:25:22.238 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-09T06:25:22.238 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-09T06:25:22.238 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-09T06:25:22.238 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-09T06:25:22.238 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-09T06:25:22.238 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-09T06:25:22.238 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-09T06:25:22.238 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-09T06:25:22.239 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-09T06:25:22.239 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-09T06:25:22.239 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-09T06:25:22.239 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-09T06:25:22.239 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-09T06:25:22.239 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-09T06:25:22.239 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-09T06:25:22.239 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-09T06:25:22.239 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-09T06:25:22.239 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-09T06:25:22.239 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-09T06:25:22.239 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-09T06:25:22.240 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-09T06:25:22.240 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-09T06:25:22.240 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-09T06:25:22.240 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-09T06:25:22.240 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-09T06:25:22.240 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-09T06:25:22.240 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-09T06:25:22.240 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-09T06:25:22.240 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-09T06:25:22.240 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-09T06:25:22.240 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-09T06:25:22.240 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-09T06:25:22.241 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-09T06:25:22.241 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-09T06:25:22.241 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-09T06:25:22.241 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-09T06:25:22.241 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-09T06:25:22.241 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-09T06:25:22.241 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-09T06:25:22.241 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-09T06:25:22.241 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-09T06:25:22.241 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-09T06:25:22.241 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-09T06:25:22.241 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-09T06:25:22.242 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-09T06:25:22.242 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-09T06:25:22.242 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-09T06:25:22.242 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-09T06:25:22.242 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-09T06:25:22.242 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-09T06:25:22.242 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-09T06:25:22.242 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-09T06:25:22.242 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-09T06:25:22.242 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-09T06:25:22.242 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-09T06:25:22.243 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-09T06:25:22.243 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-09T06:25:22.243 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-09T06:25:22.243 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-09T06:25:22.243 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-09T06:25:22.243 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-09T06:25:22.243 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-09T06:25:22.243 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-09T06:25:22.243 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-09T06:25:22.243 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-09T06:25:22.243 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-09T06:25:22.243 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-09T06:25:22.244 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-09T06:25:22.244 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-09T06:25:22.244 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-09T06:25:22.244 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-09T06:25:22.244 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-09T06:25:22.244 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-09T06:25:22.244 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-09T06:25:22.244 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-09T06:25:22.244 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-09T06:25:22.244 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-09T06:25:22.244 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-09T06:25:22.244 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-09T06:25:22.245 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-09T06:25:22.245 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-09T06:25:22.245 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-09T06:25:22.245 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-09T06:25:22.245 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-09T06:25:22.245 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-09T06:25:22.245 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-09T06:25:22.245 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-09T06:25:22.245 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-09T06:25:22.245 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-09T06:25:22.245 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-09T06:25:22.245 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-09T06:25:22.246 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-09T06:25:22.246 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-09T06:25:22.246 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-09T06:25:22.246 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-09T06:25:22.246 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-09T06:25:22.246 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-09T06:25:22.246 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-09T06:25:22.246 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-09T06:25:22.246 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-09T06:25:22.246 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-09T06:25:22.246 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-09T06:25:22.246 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-09T06:25:22.247 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-09T06:25:22.247 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-09T06:25:22.247 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-09T06:25:22.247 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-09T06:25:22.247 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-09T06:25:22.247 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-09T06:25:22.247 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-09T06:25:22.247 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-09T06:25:22.247 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-09T06:25:22.247 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-09T06:25:22.247 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-09T06:25:22.248 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-09T06:25:22.248 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-09T06:25:22.248 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-09T06:25:22.248 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-09T06:25:22.248 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-09T06:25:22.248 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-09T06:25:22.248 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-09T06:25:22.248 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-09T06:25:22.248 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-09T06:25:22.248 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-09T06:25:22.248 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-09T06:25:22.248 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-09T06:25:22.248 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-09T06:25:22.249 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-09T06:25:22.249 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-09T06:25:22.249 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-09T06:25:22.249 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-09T06:25:22.249 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-09T06:25:22.249 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-09T06:25:22.249 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-09T06:25:22.249 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-09T06:25:22.249 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-09T06:25:22.249 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-09T06:25:22.249 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-09T06:25:22.249 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-09T06:25:22.250 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-09T06:25:22.250 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-09T06:25:22.250 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-09T06:25:22.250 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-09T06:25:22.250 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-09T06:25:22.250 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-09T06:25:22.250 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-09T06:25:22.250 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-09T06:25:22.250 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-09T06:25:22.250 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-09T06:25:22.250 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-09T06:25:22.251 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-09T06:25:22.251 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-09T06:25:22.251 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-09T06:25:22.251 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-09T06:25:22.251 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-09T06:25:22.251 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-09T06:25:22.251 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-09T06:25:22.251 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-09T06:25:22.251 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-09T06:25:22.251 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-09T06:25:22.251 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-09T06:25:22.251 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-09T06:25:22.252 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-09T06:25:22.252 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-09T06:25:22.252 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-09T06:25:22.252 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-09T06:25:22.252 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-09T06:25:22.252 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-09T06:25:22.252 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-09T06:25:22.252 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-09T06:25:22.252 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-09T06:25:22.252 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-09T06:25:22.252 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-09T06:25:22.252 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-09T06:25:22.253 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-09T06:25:22.253 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-09T06:25:22.253 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-09T06:25:22.253 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-09T06:25:22.253 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-09T06:25:22.253 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-09T06:25:22.253 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-09T06:25:22.253 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-09T06:25:22.253 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-09T06:25:22.253 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-09T06:25:22.253 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-09T06:25:22.253 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-09T06:25:22.254 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-09T06:25:22.254 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-09T06:25:22.254 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-09T06:25:22.254 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-09T06:25:22.254 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-09T06:25:22.254 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-09T06:25:22.254 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-09T06:25:22.254 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-09T06:25:22.254 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-09T06:25:22.254 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-09T06:25:22.254 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-09T06:25:22.255 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-09T06:25:22.255 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-09T06:25:22.255 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-09T06:25:22.255 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-09T06:25:22.255 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-09T06:25:22.255 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-09T06:25:22.255 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-09T06:25:22.255 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-09T06:25:22.255 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-09T06:25:22.255 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-09T06:25:22.255 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-09T06:25:22.255 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-09T06:25:22.256 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-09T06:25:22.256 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-09T06:25:22.256 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-09T06:25:22.256 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-09T06:25:22.256 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-09T06:25:22.256 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-09T06:25:22.256 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-09T06:25:22.256 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-09T06:25:22.256 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-09T06:25:22.256 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-09T06:25:22.256 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-09T06:25:22.256 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-09T06:25:22.257 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-09T06:25:22.257 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-09T06:25:22.257 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-09T06:25:22.257 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-09T06:25:22.257 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-09T06:25:22.257 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-09T06:25:22.257 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-09T06:25:22.257 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-09T06:25:22.257 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-09T06:25:22.257 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-09T06:25:22.257 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-09T06:25:22.257 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-09T06:25:22.258 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-09T06:25:22.258 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-09T06:25:22.258 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-09T06:25:22.258 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-09T06:25:22.258 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-09T06:25:22.258 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-09T06:25:22.258 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-09T06:25:22.258 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-09T06:25:22.258 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-09T06:25:22.258 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-09T06:25:22.258 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-09T06:25:22.258 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-09T06:25:22.259 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-09T06:25:22.259 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-09T06:25:22.259 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-09T06:25:22.259 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-09T06:25:22.259 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-09T06:25:22.259 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-09T06:25:22.259 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-09T06:25:22.259 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-09T06:25:22.259 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-09T06:25:22.259 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-09T06:25:22.259 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-09T06:25:22.259 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-09T06:25:22.260 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-09T06:25:22.260 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-09T06:25:22.260 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-09T06:25:22.260 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-09T06:25:22.260 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-09T06:25:22.260 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-09T06:25:22.260 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-09T06:25:22.260 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-09T06:25:22.260 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-09T06:25:22.260 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-09T06:25:22.260 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-09T06:25:22.260 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-09T06:25:22.261 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-09T06:25:22.261 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-09T06:25:22.261 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-09T06:25:22.261 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-09T06:25:22.261 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-09T06:25:22.261 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-09T06:25:22.261 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-09T06:25:22.261 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-09T06:25:22.261 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-09T06:25:22.261 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-09T06:25:22.261 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-09T06:25:22.261 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-09T06:25:22.262 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-09T06:25:22.262 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-09T06:25:22.262 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-09T06:25:22.262 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-09T06:25:22.262 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-09T06:25:22.262 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-09T06:25:22.262 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-09T06:25:22.262 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-09T06:25:22.262 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-09T06:25:22.262 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-09T06:25:22.262 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-09T06:25:22.262 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-09T06:25:22.263 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-09T06:25:22.263 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-09T06:25:22.263 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-09T06:25:22.263 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-09T06:25:22.263 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-09T06:25:22.263 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-09T06:25:22.263 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-09T06:25:22.263 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-09T06:25:22.263 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-09T06:25:22.263 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-09T06:25:22.263 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-09T06:25:22.264 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-09T06:25:22.264 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-09T06:25:22.264 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-09T06:25:22.264 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-09T06:25:22.264 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-09T06:25:22.264 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-09T06:25:22.264 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-09T06:25:22.264 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-09T06:25:22.264 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-09T06:25:22.264 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-09T06:25:22.264 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-09T06:25:22.264 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-09T06:25:22.264 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-09T06:25:22.265 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-09T06:25:22.265 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-09T06:25:22.265 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-09T06:25:22.265 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-09T06:25:22.265 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-09T06:25:22.265 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-09T06:25:22.265 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-09T06:25:22.265 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-09T06:25:22.265 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-09T06:25:22.265 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-09T06:25:22.265 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-09T06:25:22.265 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-09T06:25:22.266 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-09T06:25:22.266 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-09T06:25:22.266 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-09T06:25:22.266 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-09T06:25:22.266 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-09T06:25:22.266 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-09T06:25:22.266 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-09T06:25:22.266 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-09T06:25:22.266 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-09T06:25:22.266 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-09T06:25:22.266 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-09T06:25:22.266 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-09T06:25:22.267 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-09T06:25:22.267 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-09T06:25:22.267 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-09T06:25:22.267 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-09T06:25:22.267 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-09T06:25:22.267 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-09T06:25:22.267 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-09T06:25:22.267 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-09T06:25:22.267 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-09T06:25:22.267 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-09T06:25:22.267 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-09T06:25:22.267 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-09T06:25:22.268 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-09T06:25:22.268 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-09T06:25:22.268 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-09T06:25:22.268 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-09T06:25:22.268 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-09T06:25:22.268 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-09T06:25:22.268 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-09T06:25:22.268 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-09T06:25:22.268 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-09T06:25:22.269 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-09T06:25:22.269 DEBUG:teuthology.orchestra.run.smithi179:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-09T06:25:22.290 INFO:teuthology.orchestra.run.smithi179.stdout:postinstall scriptlet (using /bin/sh): 2023-10-09T06:25:22.290 INFO:teuthology.orchestra.run.smithi179.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-09T06:25:22.290 INFO:teuthology.orchestra.run.smithi179.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-09T06:25:22.290 INFO:teuthology.orchestra.run.smithi179.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-09T06:25:22.290 INFO:teuthology.orchestra.run.smithi179.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-09T06:25:22.290 INFO:teuthology.orchestra.run.smithi179.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-09T06:25:22.290 INFO:teuthology.orchestra.run.smithi179.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-09T06:25:22.291 INFO:teuthology.orchestra.run.smithi179.stdout:fi 2023-10-09T06:25:22.291 INFO:teuthology.orchestra.run.smithi179.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-09T06:25:22.291 INFO:teuthology.orchestra.run.smithi179.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-09T06:25:22.291 INFO:teuthology.orchestra.run.smithi179.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-09T06:25:22.291 INFO:teuthology.orchestra.run.smithi179.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-09T06:25:22.291 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-09T06:25:22.291 INFO:teuthology.orchestra.run.smithi179.stdout:fi 2023-10-09T06:25:22.291 INFO:teuthology.orchestra.run.smithi179.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-09T06:25:22.291 INFO:teuthology.orchestra.run.smithi179.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-09T06:25:22.291 INFO:teuthology.orchestra.run.smithi179.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-09T06:25:22.291 INFO:teuthology.orchestra.run.smithi179.stdout:fi 2023-10-09T06:25:22.292 DEBUG:teuthology.orchestra.run.smithi179:> sudo rpm -qi grub2-tools 2023-10-09T06:25:22.363 INFO:teuthology.orchestra.run.smithi179.stdout:Name : grub2-tools 2023-10-09T06:25:22.364 INFO:teuthology.orchestra.run.smithi179.stdout:Epoch : 1 2023-10-09T06:25:22.364 INFO:teuthology.orchestra.run.smithi179.stdout:Version : 2.02 2023-10-09T06:25:22.364 INFO:teuthology.orchestra.run.smithi179.stdout:Release : 99.el8_4.1 2023-10-09T06:25:22.364 INFO:teuthology.orchestra.run.smithi179.stdout:Architecture: x86_64 2023-10-09T06:25:22.364 INFO:teuthology.orchestra.run.smithi179.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-09T06:25:22.364 INFO:teuthology.orchestra.run.smithi179.stdout:Group : System Environment/Base 2023-10-09T06:25:22.364 INFO:teuthology.orchestra.run.smithi179.stdout:Size : 9264631 2023-10-09T06:25:22.364 INFO:teuthology.orchestra.run.smithi179.stdout:License : GPLv3+ 2023-10-09T06:25:22.364 INFO:teuthology.orchestra.run.smithi179.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-09T06:25:22.364 INFO:teuthology.orchestra.run.smithi179.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-09T06:25:22.364 INFO:teuthology.orchestra.run.smithi179.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-09T06:25:22.365 INFO:teuthology.orchestra.run.smithi179.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-09T06:25:22.365 INFO:teuthology.orchestra.run.smithi179.stdout:Relocations : (not relocatable) 2023-10-09T06:25:22.365 INFO:teuthology.orchestra.run.smithi179.stdout:Packager : Red Hat, Inc. 2023-10-09T06:25:22.365 INFO:teuthology.orchestra.run.smithi179.stdout:Vendor : Red Hat, Inc. 2023-10-09T06:25:22.365 INFO:teuthology.orchestra.run.smithi179.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-09T06:25:22.365 INFO:teuthology.orchestra.run.smithi179.stdout:Summary : Support tools for GRUB. 2023-10-09T06:25:22.365 INFO:teuthology.orchestra.run.smithi179.stdout:Description : 2023-10-09T06:25:22.365 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:25:22.365 INFO:teuthology.orchestra.run.smithi179.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-09T06:25:22.365 INFO:teuthology.orchestra.run.smithi179.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-09T06:25:22.365 INFO:teuthology.orchestra.run.smithi179.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-09T06:25:22.365 INFO:teuthology.orchestra.run.smithi179.stdout:hardware devices. 2023-10-09T06:25:22.366 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:25:22.366 INFO:teuthology.orchestra.run.smithi179.stdout:This subpackage provides tools for support of all platforms. 2023-10-09T06:25:22.366 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-09T06:25:22.367 INFO:teuthology.task.kernel:Updating grub on smithi179 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-09T06:25:22.367 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-09T06:25:24.953 INFO:teuthology.orchestra.run.smithi071.stderr:Generating grub configuration file ... 2023-10-09T06:25:26.778 INFO:teuthology.orchestra.run.smithi071.stderr:done 2023-10-09T06:25:26.779 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2023-10-09T06:25:26.793 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.cSl7fbaztN 2023-10-09T06:25:26.793 DEBUG:teuthology.orchestra.run.smithi071:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.cSl7fbaztN 2023-10-09T06:25:26.851 INFO:teuthology.orchestra.run.smithi179.stderr:Generating grub configuration file ... 2023-10-09T06:25:26.863 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.cSl7fbaztN 2023-10-09T06:25:27.028 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.cSl7fbaztN is 6KB 2023-10-09T06:25:27.051 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.cSl7fbaztN 2023-10-09T06:25:27.066 DEBUG:teuthology.orchestra.run.smithi071:> sudo /bin/ls /boot/loader/entries || true 2023-10-09T06:25:27.128 INFO:teuthology.orchestra.run.smithi071.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-09T06:25:27.129 INFO:teuthology.orchestra.run.smithi071.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-09T06:25:27.129 INFO:teuthology.orchestra.run.smithi071.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-09T06:25:27.129 INFO:teuthology.orchestra.run.smithi071.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-09T06:25:27.129 INFO:teuthology.orchestra.run.smithi071.stdout:298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b.conf 2023-10-09T06:25:27.130 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b 2023-10-09T06:25:27.284 DEBUG:teuthology.orchestra.run.smithi071:> sudo shutdown -r now 2023-10-09T06:25:28.747 INFO:teuthology.orchestra.run.smithi179.stderr:done 2023-10-09T06:25:28.748 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2023-10-09T06:25:28.765 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.PgViVB1n2F 2023-10-09T06:25:28.765 DEBUG:teuthology.orchestra.run.smithi179:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.PgViVB1n2F 2023-10-09T06:25:28.836 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.PgViVB1n2F 2023-10-09T06:25:29.006 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.PgViVB1n2F is 6KB 2023-10-09T06:25:29.033 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.PgViVB1n2F 2023-10-09T06:25:29.047 DEBUG:teuthology.orchestra.run.smithi179:> sudo /bin/ls /boot/loader/entries || true 2023-10-09T06:25:29.111 INFO:teuthology.orchestra.run.smithi179.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-09T06:25:29.111 INFO:teuthology.orchestra.run.smithi179.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-09T06:25:29.111 INFO:teuthology.orchestra.run.smithi179.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-09T06:25:29.111 INFO:teuthology.orchestra.run.smithi179.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-09T06:25:29.112 INFO:teuthology.orchestra.run.smithi179.stdout:298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b.conf 2023-10-09T06:25:29.112 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b 2023-10-09T06:25:29.293 DEBUG:teuthology.orchestra.run.smithi179:> sudo shutdown -r now 2023-10-09T06:25:57.315 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-09T06:25:57.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-10-09T06:25:57.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:25:59.297 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-09T06:25:59.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-09T06:25:59.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:26:15.802 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-10-09T06:26:17.854 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-09T06:26:24.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-10-09T06:26:24.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:26:26.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-09T06:26:26.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:26:27.866 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-10-09T06:26:29.914 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-10-09T06:26:39.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-10-09T06:26:39.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:26:41.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-09T06:26:41.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:26:58.298 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-10-09T06:27:13.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-10-09T06:27:13.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:27:15.950 DEBUG:teuthology.orchestra.run.smithi071:> true 2023-10-09T06:27:16.344 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-10-09T06:27:16.344 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-09T06:27:16.345 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2023-10-09T06:27:16.380 INFO:teuthology.orchestra.run.smithi071.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-09T06:27:16.380 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-09T06:27:16.380 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-09T06:27:16.381 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-09T06:27:17.382 DEBUG:teuthology.parallel:result is None 2023-10-09T06:27:41.920 DEBUG:teuthology.orchestra.remote:timed out 2023-10-09T06:27:56.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-09T06:27:56.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:27:57.231 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-10-09T06:27:57.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-09T06:27:57.656 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-09T06:27:57.656 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2023-10-09T06:27:57.691 INFO:teuthology.orchestra.run.smithi179.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-09T06:27:57.691 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-09T06:27:57.691 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-09T06:27:57.692 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-09T06:27:58.692 DEBUG:teuthology.parallel:result is None 2023-10-09T06:27:58.693 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-09T06:27:58.701 INFO:teuthology.task.internal:Creating test directory... 2023-10-09T06:27:58.702 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-09T06:27:58.708 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-09T06:27:58.747 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-09T06:27:58.753 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-09T06:27:58.817 INFO:teuthology.task.internal:Creating archive directory... 2023-10-09T06:27:58.818 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-09T06:27:58.822 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-09T06:27:58.890 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-09T06:27:58.898 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-09T06:27:58.899 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-09T06:27:58.906 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-09T06:27:59.028 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T06:27:59.063 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T06:27:59.064 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T06:27:59.105 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T06:27:59.109 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-09T06:27:59.116 INFO:teuthology.task.internal:Configuring sudo... 2023-10-09T06:27:59.116 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-09T06:27:59.121 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-09T06:27:59.182 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-09T06:27:59.192 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-09T06:27:59.193 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-09T06:27:59.197 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-09T06:27:59.232 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T06:27:59.333 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T06:27:59.433 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T06:27:59.496 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T06:27:59.572 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:27:59.572 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-09T06:27:59.656 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T06:27:59.720 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T06:27:59.814 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T06:27:59.877 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T06:27:59.953 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-09T06:27:59.953 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-09T06:28:00.012 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2023-10-09T06:28:00.016 DEBUG:teuthology.orchestra.run.smithi179:> sudo service rsyslog restart 2023-10-09T06:28:00.124 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T06:28:00.157 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T06:28:00.569 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-09T06:28:00.578 INFO:teuthology.task.internal:Starting timer... 2023-10-09T06:28:00.578 INFO:teuthology.run_tasks:Running task pcp... 2023-10-09T06:28:00.596 INFO:teuthology.run_tasks:Running task selinux... 2023-10-09T06:28:00.612 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-09T06:28:00.612 DEBUG:teuthology.orchestra.run.smithi071:> sudo service auditd rotate 2023-10-09T06:28:00.727 INFO:teuthology.orchestra.run.smithi071.stdout:Rotating logs: [ OK ] 2023-10-09T06:28:00.731 DEBUG:teuthology.orchestra.run.smithi179:> sudo service auditd rotate 2023-10-09T06:28:00.853 INFO:teuthology.orchestra.run.smithi179.stdout:Rotating logs: [ OK ] 2023-10-09T06:28:00.856 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-09T06:28:00.857 DEBUG:teuthology.orchestra.run.smithi071:> /usr/sbin/getenforce 2023-10-09T06:28:00.909 INFO:teuthology.orchestra.run.smithi071.stdout:Permissive 2023-10-09T06:28:00.909 DEBUG:teuthology.orchestra.run.smithi179:> /usr/sbin/getenforce 2023-10-09T06:28:00.956 INFO:teuthology.orchestra.run.smithi179.stdout:Permissive 2023-10-09T06:28:00.956 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi071.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi179.front.sepia.ceph.com': 'permissive'} 2023-10-09T06:28:00.956 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T06:28:01.025 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:28:01.026 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T06:28:01.088 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:28:01.089 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-09T06:28:01.089 DEBUG:teuthology.orchestra.run.smithi071:> sudo /usr/sbin/setenforce permissive 2023-10-09T06:28:01.152 DEBUG:teuthology.orchestra.run.smithi179:> sudo /usr/sbin/setenforce permissive 2023-10-09T06:28:01.215 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-09T06:28:01.280 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-09T06:28:01.286 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-09T06:28:01.452 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-09T06:28:01.525 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-09T06:28:01.526 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi071.front.sepia.ceph.com,smithi179.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-09T06:39:11.143 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi071.front.sepia.ceph.com'), Remote(name='ubuntu@smithi179.front.sepia.ceph.com')] 2023-10-09T06:39:11.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-10-09T06:39:11.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:39:11.265 DEBUG:teuthology.orchestra.run.smithi071:> true 2023-10-09T06:39:11.375 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-10-09T06:39:11.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-09T06:39:11.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:39:11.463 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-10-09T06:39:11.572 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-10-09T06:39:11.572 INFO:teuthology.run_tasks:Running task clock... 2023-10-09T06:39:11.583 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-09T06:39:11.584 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-09T06:39:11.584 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T06:39:11.588 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-09T06:39:11.589 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T06:39:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-09T06:39:11.681 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-09T06:39:11.684 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-09T06:39:11.715 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-09T06:39:11.743 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: ntpd: command not found 2023-10-09T06:39:11.770 INFO:teuthology.orchestra.run.smithi071.stdout:506 Cannot talk to daemon 2023-10-09T06:39:11.774 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: ntpd: command not found 2023-10-09T06:39:11.801 INFO:teuthology.orchestra.run.smithi179.stdout:506 Cannot talk to daemon 2023-10-09T06:39:11.803 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-09T06:39:11.833 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-09T06:39:11.837 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-09T06:39:11.866 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-09T06:39:11.919 INFO:teuthology.orchestra.run.smithi071.stderr:bash: ntpq: command not found 2023-10-09T06:39:11.924 INFO:teuthology.orchestra.run.smithi071.stdout:210 Number of sources = 4 2023-10-09T06:39:11.924 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T06:39:11.924 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2023-10-09T06:39:11.924 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T06:39:11.924 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T06:39:11.924 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T06:39:11.924 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T06:39:11.961 INFO:teuthology.orchestra.run.smithi179.stderr:bash: ntpq: command not found 2023-10-09T06:39:11.966 INFO:teuthology.orchestra.run.smithi179.stdout:210 Number of sources = 4 2023-10-09T06:39:11.966 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T06:39:11.966 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2023-10-09T06:39:11.966 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T06:39:11.966 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T06:39:11.966 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T06:39:11.966 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T06:39:11.967 INFO:teuthology.run_tasks:Running task install... 2023-10-09T06:39:11.976 DEBUG:teuthology.task.install:project ceph 2023-10-09T06:39:11.977 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}} 2023-10-09T06:39:11.977 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'} 2023-10-09T06:39:11.977 INFO:teuthology.task.install:Using flavor: default 2023-10-09T06:39:11.984 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-09T06:39:11.984 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-09T06:39:11.984 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-09T06:39:11.985 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T06:39:11.990 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-09T06:39:11.990 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T06:39:12.261 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-09T06:39:12.261 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-09T06:39:12.270 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-09T06:39:12.270 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-09T06:39:12.381 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-09T06:39:12.382 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-09T06:39:12.382 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-09T06:39:12.442 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-09T06:39:12.443 DEBUG:teuthology.orchestra.run.smithi179:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-09T06:39:12.445 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-09T06:39:12.445 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:39:12.445 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-09T06:39:12.507 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-09T06:39:12.507 DEBUG:teuthology.orchestra.run.smithi071:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-09T06:39:12.547 DEBUG:teuthology.orchestra.run.smithi179:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-09T06:39:12.616 DEBUG:teuthology.orchestra.run.smithi071:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-09T06:39:12.642 DEBUG:teuthology.orchestra.run.smithi179:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-09T06:39:12.703 INFO:teuthology.orchestra.run.smithi179.stdout:check_obsoletes = 1 2023-10-09T06:39:12.712 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum clean all 2023-10-09T06:39:12.714 DEBUG:teuthology.orchestra.run.smithi071:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-09T06:39:12.774 INFO:teuthology.orchestra.run.smithi071.stdout:check_obsoletes = 1 2023-10-09T06:39:12.777 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum clean all 2023-10-09T06:39:13.173 INFO:teuthology.orchestra.run.smithi179.stdout:Updating Subscription Management repositories. 2023-10-09T06:39:13.236 INFO:teuthology.orchestra.run.smithi071.stdout:Updating Subscription Management repositories. 2023-10-09T06:39:13.536 INFO:teuthology.orchestra.run.smithi179.stdout:44 files removed 2023-10-09T06:39:13.596 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-09T06:39:13.618 INFO:teuthology.orchestra.run.smithi071.stdout:44 files removed 2023-10-09T06:39:13.675 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-09T06:39:14.054 INFO:teuthology.orchestra.run.smithi179.stdout:Updating Subscription Management repositories. 2023-10-09T06:39:14.138 INFO:teuthology.orchestra.run.smithi071.stdout:Updating Subscription Management repositories. 2023-10-09T06:39:14.875 INFO:teuthology.orchestra.run.smithi179.stdout:ceph packages for x86_64 240 kB/s | 78 kB 00:00 2023-10-09T06:39:15.135 INFO:teuthology.orchestra.run.smithi071.stdout:ceph packages for x86_64 162 kB/s | 78 kB 00:00 2023-10-09T06:39:15.238 INFO:teuthology.orchestra.run.smithi179.stdout:ceph noarch packages 29 kB/s | 9.2 kB 00:00 2023-10-09T06:39:15.456 INFO:teuthology.orchestra.run.smithi071.stdout:ceph noarch packages 33 kB/s | 9.2 kB 00:00 2023-10-09T06:39:15.559 INFO:teuthology.orchestra.run.smithi179.stdout:ceph source packages 5.0 kB/s | 1.5 kB 00:00 2023-10-09T06:39:15.746 INFO:teuthology.orchestra.run.smithi179.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-10-09T06:39:15.788 INFO:teuthology.orchestra.run.smithi071.stdout:ceph source packages 4.9 kB/s | 1.5 kB 00:00 2023-10-09T06:39:16.002 INFO:teuthology.orchestra.run.smithi071.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2023-10-09T06:39:16.170 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 40 MB/s | 16 MB 00:00 2023-10-09T06:39:17.256 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-10-09T06:39:19.677 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 3.8 MB/s | 24 kB 00:00 2023-10-09T06:39:20.187 INFO:teuthology.orchestra.run.smithi179.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 89 MB/s | 38 MB 00:00 2023-10-09T06:39:20.756 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 4.0 MB/s | 24 kB 00:00 2023-10-09T06:39:21.279 INFO:teuthology.orchestra.run.smithi071.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 87 MB/s | 38 MB 00:00 2023-10-09T06:39:25.980 INFO:teuthology.orchestra.run.smithi179.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 85 MB/s | 33 MB 00:00 2023-10-09T06:39:27.166 INFO:teuthology.orchestra.run.smithi071.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 86 MB/s | 33 MB 00:00 2023-10-09T06:39:34.203 INFO:teuthology.orchestra.run.smithi179.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T06:39:34.204 INFO:teuthology.orchestra.run.smithi179.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T06:39:34.215 INFO:teuthology.orchestra.run.smithi179.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-09T06:39:34.215 INFO:teuthology.orchestra.run.smithi179.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-09T06:39:34.216 INFO:teuthology.orchestra.run.smithi179.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-09T06:39:34.217 INFO:teuthology.orchestra.run.smithi179.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-09T06:39:34.219 INFO:teuthology.orchestra.run.smithi179.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-09T06:39:34.221 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-09T06:39:34.222 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-09T06:39:34.720 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2023-10-09T06:39:34.732 INFO:teuthology.orchestra.run.smithi179.stdout:====================================================================================================================== 2023-10-09T06:39:34.732 INFO:teuthology.orchestra.run.smithi179.stdout: Package Arch Version Repository Size 2023-10-09T06:39:34.732 INFO:teuthology.orchestra.run.smithi179.stdout:====================================================================================================================== 2023-10-09T06:39:34.732 INFO:teuthology.orchestra.run.smithi179.stdout:Installing: 2023-10-09T06:39:34.732 INFO:teuthology.orchestra.run.smithi179.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-09T06:39:34.732 INFO:teuthology.orchestra.run.smithi179.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-09T06:39:34.733 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-09T06:39:34.733 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-09T06:39:34.733 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-09T06:39:34.733 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-09T06:39:34.733 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-09T06:39:34.733 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-09T06:39:34.733 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-09T06:39:34.733 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-09T06:39:34.733 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T06:39:34.733 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-09T06:39:34.734 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-09T06:39:34.734 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-09T06:39:34.734 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-09T06:39:34.734 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-09T06:39:34.734 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-09T06:39:34.734 INFO:teuthology.orchestra.run.smithi179.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-09T06:39:34.734 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-09T06:39:34.734 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-09T06:39:34.734 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-09T06:39:34.734 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-09T06:39:34.735 INFO:teuthology.orchestra.run.smithi179.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-09T06:39:34.735 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-09T06:39:34.735 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-09T06:39:34.735 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-09T06:39:34.735 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-09T06:39:34.735 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-09T06:39:34.735 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-09T06:39:34.735 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-09T06:39:34.735 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T06:39:34.735 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-09T06:39:34.736 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-09T06:39:34.736 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrading: 2023-10-09T06:39:34.736 INFO:teuthology.orchestra.run.smithi179.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T06:39:34.736 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-09T06:39:34.736 INFO:teuthology.orchestra.run.smithi179.stdout:Installing dependencies: 2023-10-09T06:39:34.736 INFO:teuthology.orchestra.run.smithi179.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-09T06:39:34.736 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-09T06:39:34.736 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-09T06:39:34.736 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-09T06:39:34.736 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-09T06:39:34.736 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-09T06:39:34.737 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T06:39:34.737 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-09T06:39:34.737 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-09T06:39:34.737 INFO:teuthology.orchestra.run.smithi179.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-09T06:39:34.737 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-09T06:39:34.737 INFO:teuthology.orchestra.run.smithi179.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-09T06:39:34.737 INFO:teuthology.orchestra.run.smithi179.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-09T06:39:34.737 INFO:teuthology.orchestra.run.smithi179.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-09T06:39:34.738 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-09T06:39:34.738 INFO:teuthology.orchestra.run.smithi179.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-09T06:39:34.738 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-09T06:39:34.738 INFO:teuthology.orchestra.run.smithi179.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-09T06:39:34.738 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-09T06:39:34.738 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-09T06:39:34.738 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-09T06:39:34.738 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-09T06:39:34.738 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-09T06:39:34.739 INFO:teuthology.orchestra.run.smithi179.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-09T06:39:34.739 INFO:teuthology.orchestra.run.smithi179.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-09T06:39:34.739 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-09T06:39:34.739 INFO:teuthology.orchestra.run.smithi179.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-09T06:39:34.739 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-09T06:39:34.739 INFO:teuthology.orchestra.run.smithi179.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-09T06:39:34.739 INFO:teuthology.orchestra.run.smithi179.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-09T06:39:34.739 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-09T06:39:34.739 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-09T06:39:34.740 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-09T06:39:34.740 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-09T06:39:34.740 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-09T06:39:34.740 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-09T06:39:34.740 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-09T06:39:34.740 INFO:teuthology.orchestra.run.smithi179.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-09T06:39:34.740 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-09T06:39:34.740 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-09T06:39:34.740 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-09T06:39:34.741 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-09T06:39:34.741 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-09T06:39:34.741 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-09T06:39:34.741 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-09T06:39:34.741 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-09T06:39:34.741 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-09T06:39:34.741 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-09T06:39:34.741 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-09T06:39:34.741 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-09T06:39:34.741 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T06:39:34.741 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-09T06:39:34.742 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-09T06:39:34.742 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-09T06:39:34.742 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-09T06:39:34.742 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-09T06:39:34.742 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-09T06:39:34.742 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-09T06:39:34.742 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-09T06:39:34.742 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-09T06:39:34.742 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-09T06:39:34.742 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-09T06:39:34.742 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-09T06:39:34.743 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-09T06:39:34.743 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-09T06:39:34.743 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-09T06:39:34.743 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-09T06:39:34.743 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T06:39:34.743 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-09T06:39:34.743 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-09T06:39:34.743 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-09T06:39:34.743 INFO:teuthology.orchestra.run.smithi179.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-09T06:39:34.743 INFO:teuthology.orchestra.run.smithi179.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-09T06:39:34.743 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-09T06:39:34.743 INFO:teuthology.orchestra.run.smithi179.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-09T06:39:34.744 INFO:teuthology.orchestra.run.smithi179.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-09T06:39:34.744 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-09T06:39:34.744 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-09T06:39:34.744 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-09T06:39:34.744 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-09T06:39:34.744 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-09T06:39:34.744 INFO:teuthology.orchestra.run.smithi179.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-09T06:39:34.744 INFO:teuthology.orchestra.run.smithi179.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-09T06:39:34.744 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-09T06:39:34.744 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-09T06:39:34.744 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:39:34.744 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2023-10-09T06:39:34.745 INFO:teuthology.orchestra.run.smithi179.stdout:====================================================================================================================== 2023-10-09T06:39:34.745 INFO:teuthology.orchestra.run.smithi179.stdout:Install 118 Packages 2023-10-09T06:39:34.745 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrade 2 Packages 2023-10-09T06:39:34.745 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:39:34.745 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 202 M 2023-10-09T06:39:34.746 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2023-10-09T06:39:35.186 INFO:teuthology.orchestra.run.smithi179.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 68 kB/s | 6.4 kB 00:00 2023-10-09T06:39:35.343 INFO:teuthology.orchestra.run.smithi179.stdout:(2/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 5.5 MB/s | 876 kB 00:00 2023-10-09T06:39:35.375 INFO:teuthology.orchestra.run.smithi179.stdout:(3/120): ceph-immutable-object-cache-17.2.6-132 5.1 MB/s | 162 kB 00:00 2023-10-09T06:39:35.406 INFO:teuthology.orchestra.run.smithi071.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T06:39:35.406 INFO:teuthology.orchestra.run.smithi071.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T06:39:35.417 INFO:teuthology.orchestra.run.smithi071.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-09T06:39:35.418 INFO:teuthology.orchestra.run.smithi071.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-09T06:39:35.419 INFO:teuthology.orchestra.run.smithi071.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-09T06:39:35.420 INFO:teuthology.orchestra.run.smithi071.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-09T06:39:35.422 INFO:teuthology.orchestra.run.smithi071.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-09T06:39:35.424 INFO:teuthology.orchestra.run.smithi071.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-09T06:39:35.425 INFO:teuthology.orchestra.run.smithi071.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-09T06:39:35.583 INFO:teuthology.orchestra.run.smithi179.stdout:(4/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 11 MB/s | 2.3 MB 00:00 2023-10-09T06:39:35.713 INFO:teuthology.orchestra.run.smithi179.stdout:(5/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 12 MB/s | 1.6 MB 00:00 2023-10-09T06:39:35.921 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-09T06:39:35.933 INFO:teuthology.orchestra.run.smithi071.stdout:====================================================================================================================== 2023-10-09T06:39:35.933 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2023-10-09T06:39:35.933 INFO:teuthology.orchestra.run.smithi071.stdout:====================================================================================================================== 2023-10-09T06:39:35.933 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2023-10-09T06:39:35.933 INFO:teuthology.orchestra.run.smithi071.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-09T06:39:35.933 INFO:teuthology.orchestra.run.smithi071.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-09T06:39:35.934 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-09T06:39:35.934 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-09T06:39:35.934 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-09T06:39:35.934 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-09T06:39:35.934 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-09T06:39:35.934 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-09T06:39:35.934 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-09T06:39:35.934 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-09T06:39:35.934 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T06:39:35.934 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-09T06:39:35.934 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-09T06:39:35.935 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-09T06:39:35.935 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-09T06:39:35.935 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-09T06:39:35.935 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-09T06:39:35.935 INFO:teuthology.orchestra.run.smithi071.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-09T06:39:35.935 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-09T06:39:35.935 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-09T06:39:35.935 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-09T06:39:35.935 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-09T06:39:35.935 INFO:teuthology.orchestra.run.smithi071.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-09T06:39:35.935 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-09T06:39:35.935 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-09T06:39:35.936 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-09T06:39:35.936 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-09T06:39:35.936 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-09T06:39:35.936 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-09T06:39:35.936 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-09T06:39:35.936 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T06:39:35.936 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-09T06:39:35.936 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-09T06:39:35.936 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrading: 2023-10-09T06:39:35.936 INFO:teuthology.orchestra.run.smithi071.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T06:39:35.936 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-09T06:39:35.937 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2023-10-09T06:39:35.937 INFO:teuthology.orchestra.run.smithi071.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-09T06:39:35.937 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-09T06:39:35.937 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-09T06:39:35.937 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-09T06:39:35.937 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-09T06:39:35.937 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-09T06:39:35.937 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T06:39:35.937 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-09T06:39:35.937 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-09T06:39:35.937 INFO:teuthology.orchestra.run.smithi071.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-09T06:39:35.937 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-09T06:39:35.938 INFO:teuthology.orchestra.run.smithi071.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-09T06:39:35.938 INFO:teuthology.orchestra.run.smithi071.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-09T06:39:35.938 INFO:teuthology.orchestra.run.smithi071.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-09T06:39:35.938 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-09T06:39:35.938 INFO:teuthology.orchestra.run.smithi071.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-09T06:39:35.938 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-09T06:39:35.938 INFO:teuthology.orchestra.run.smithi071.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-09T06:39:35.938 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-09T06:39:35.938 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-09T06:39:35.938 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-09T06:39:35.938 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-09T06:39:35.939 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-09T06:39:35.939 INFO:teuthology.orchestra.run.smithi071.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-09T06:39:35.939 INFO:teuthology.orchestra.run.smithi071.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-09T06:39:35.939 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-09T06:39:35.939 INFO:teuthology.orchestra.run.smithi071.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-09T06:39:35.939 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-09T06:39:35.939 INFO:teuthology.orchestra.run.smithi071.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-09T06:39:35.939 INFO:teuthology.orchestra.run.smithi071.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-09T06:39:35.939 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-09T06:39:35.939 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-09T06:39:35.939 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-09T06:39:35.939 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-09T06:39:35.940 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-09T06:39:35.940 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-09T06:39:35.940 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-09T06:39:35.940 INFO:teuthology.orchestra.run.smithi071.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-09T06:39:35.940 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-09T06:39:35.940 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-09T06:39:35.940 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-09T06:39:35.940 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-09T06:39:35.940 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-09T06:39:35.940 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-09T06:39:35.940 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-09T06:39:35.941 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-09T06:39:35.941 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-09T06:39:35.941 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-09T06:39:35.941 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-09T06:39:35.941 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-09T06:39:35.941 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T06:39:35.941 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-09T06:39:35.941 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-09T06:39:35.941 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-09T06:39:35.941 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-09T06:39:35.941 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-09T06:39:35.942 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-09T06:39:35.942 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-09T06:39:35.942 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-09T06:39:35.942 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-09T06:39:35.942 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-09T06:39:35.942 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-09T06:39:35.942 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-09T06:39:35.942 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-09T06:39:35.942 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-09T06:39:35.942 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-09T06:39:35.942 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-09T06:39:35.942 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T06:39:35.943 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-09T06:39:35.943 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-09T06:39:35.943 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-09T06:39:35.943 INFO:teuthology.orchestra.run.smithi071.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-09T06:39:35.943 INFO:teuthology.orchestra.run.smithi071.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-09T06:39:35.943 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-09T06:39:35.943 INFO:teuthology.orchestra.run.smithi071.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-09T06:39:35.943 INFO:teuthology.orchestra.run.smithi071.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-09T06:39:35.943 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-09T06:39:35.943 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-09T06:39:35.943 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-09T06:39:35.944 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-09T06:39:35.944 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-09T06:39:35.944 INFO:teuthology.orchestra.run.smithi071.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-09T06:39:35.944 INFO:teuthology.orchestra.run.smithi071.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-09T06:39:35.944 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-09T06:39:35.944 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-09T06:39:35.944 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:39:35.944 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2023-10-09T06:39:35.944 INFO:teuthology.orchestra.run.smithi071.stdout:====================================================================================================================== 2023-10-09T06:39:35.944 INFO:teuthology.orchestra.run.smithi071.stdout:Install 118 Packages 2023-10-09T06:39:35.944 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrade 2 Packages 2023-10-09T06:39:35.945 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:39:35.945 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 202 M 2023-10-09T06:39:35.945 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2023-10-09T06:39:36.116 INFO:teuthology.orchestra.run.smithi179.stdout:(6/120): ceph-mon-17.2.6-1320.g08cac018.el8.x86 9.8 MB/s | 3.9 MB 00:00 2023-10-09T06:39:36.391 INFO:teuthology.orchestra.run.smithi071.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 23 kB/s | 6.4 kB 00:00 2023-10-09T06:39:36.780 INFO:teuthology.orchestra.run.smithi179.stdout:(7/120): ceph-common-17.2.6-1320.g08cac018.el8. 14 MB/s | 23 MB 00:01 2023-10-09T06:39:36.899 INFO:teuthology.orchestra.run.smithi071.stdout:(2/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 1.7 MB/s | 876 kB 00:00 2023-10-09T06:39:36.977 INFO:teuthology.orchestra.run.smithi071.stdout:(3/120): ceph-immutable-object-cache-17.2.6-132 2.0 MB/s | 162 kB 00:00 2023-10-09T06:39:37.311 INFO:teuthology.orchestra.run.smithi071.stdout:(4/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 6.9 MB/s | 2.3 MB 00:00 2023-10-09T06:39:37.535 INFO:teuthology.orchestra.run.smithi071.stdout:(5/120): ceph-base-17.2.6-1320.g08cac018.el8.x8 3.6 MB/s | 5.2 MB 00:01 2023-10-09T06:39:37.554 INFO:teuthology.orchestra.run.smithi071.stdout:(6/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 6.5 MB/s | 1.6 MB 00:00 2023-10-09T06:39:37.987 INFO:teuthology.orchestra.run.smithi179.stdout:(8/120): ceph-base-17.2.6-1320.g08cac018.el8.x8 1.8 MB/s | 5.2 MB 00:02 2023-10-09T06:39:38.071 INFO:teuthology.orchestra.run.smithi179.stdout:(9/120): ceph-selinux-17.2.6-1320.g08cac018.el8 291 kB/s | 24 kB 00:00 2023-10-09T06:39:38.156 INFO:teuthology.orchestra.run.smithi179.stdout:(10/120): ceph-osd-17.2.6-1320.g08cac018.el8.x8 8.2 MB/s | 17 MB 00:02 2023-10-09T06:39:38.216 INFO:teuthology.orchestra.run.smithi179.stdout:(11/120): cephfs-mirror-17.2.6-1320.g08cac018.e 4.2 MB/s | 255 kB 00:00 2023-10-09T06:39:38.274 INFO:teuthology.orchestra.run.smithi179.stdout:(12/120): libcephfs-devel-17.2.6-1320.g08cac018 432 kB/s | 25 kB 00:00 2023-10-09T06:39:38.362 INFO:teuthology.orchestra.run.smithi071.stdout:(7/120): ceph-mon-17.2.6-1320.g08cac018.el8.x86 4.8 MB/s | 3.9 MB 00:00 2023-10-09T06:39:38.409 INFO:teuthology.orchestra.run.smithi179.stdout:(13/120): libcephfs2-17.2.6-1320.g08cac018.el8. 5.8 MB/s | 797 kB 00:00 2023-10-09T06:39:38.476 INFO:teuthology.orchestra.run.smithi179.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 2.5 MB/s | 174 kB 00:00 2023-10-09T06:39:38.542 INFO:teuthology.orchestra.run.smithi179.stdout:(15/120): librados-devel-17.2.6-1320.g08cac018. 1.9 MB/s | 130 kB 00:00 2023-10-09T06:39:38.675 INFO:teuthology.orchestra.run.smithi179.stdout:(16/120): libradosstriper1-17.2.6-1320.g08cac01 3.7 MB/s | 507 kB 00:00 2023-10-09T06:39:39.052 INFO:teuthology.orchestra.run.smithi179.stdout:(17/120): ceph-radosgw-17.2.6-1320.g08cac018.el 7.4 MB/s | 17 MB 00:02 2023-10-09T06:39:39.103 INFO:teuthology.orchestra.run.smithi179.stdout:(18/120): python3-ceph-argparse-17.2.6-1320.g08 884 kB/s | 45 kB 00:00 2023-10-09T06:39:39.159 INFO:teuthology.orchestra.run.smithi179.stdout:(19/120): python3-ceph-common-17.2.6-1320.g08ca 2.0 MB/s | 115 kB 00:00 2023-10-09T06:39:39.221 INFO:teuthology.orchestra.run.smithi179.stdout:(20/120): python3-cephfs-17.2.6-1320.g08cac018. 3.0 MB/s | 190 kB 00:00 2023-10-09T06:39:39.291 INFO:teuthology.orchestra.run.smithi179.stdout:(21/120): python3-rados-17.2.6-1320.g08cac018.e 5.2 MB/s | 371 kB 00:00 2023-10-09T06:39:39.369 INFO:teuthology.orchestra.run.smithi179.stdout:(22/120): python3-rbd-17.2.6-1320.g08cac018.el8 4.6 MB/s | 358 kB 00:00 2023-10-09T06:39:39.436 INFO:teuthology.orchestra.run.smithi179.stdout:(23/120): python3-rgw-17.2.6-1320.g08cac018.el8 1.5 MB/s | 107 kB 00:00 2023-10-09T06:39:39.500 INFO:teuthology.orchestra.run.smithi179.stdout:(24/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 1.4 MB/s | 90 kB 00:00 2023-10-09T06:39:39.596 INFO:teuthology.orchestra.run.smithi179.stdout:(25/120): librgw2-17.2.6-1320.g08cac018.el8.x86 6.0 MB/s | 5.6 MB 00:00 2023-10-09T06:39:39.656 INFO:teuthology.orchestra.run.smithi179.stdout:(26/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 2.8 MB/s | 173 kB 00:00 2023-10-09T06:39:39.708 INFO:teuthology.orchestra.run.smithi179.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1320.g 444 kB/s | 23 kB 00:00 2023-10-09T06:39:39.754 INFO:teuthology.orchestra.run.smithi179.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 2.6 MB/s | 121 kB 00:00 2023-10-09T06:39:39.775 INFO:teuthology.orchestra.run.smithi071.stdout:(8/120): ceph-osd-17.2.6-1320.g08cac018.el8.x86 7.5 MB/s | 17 MB 00:02 2023-10-09T06:39:39.853 INFO:teuthology.orchestra.run.smithi071.stdout:(9/120): ceph-selinux-17.2.6-1320.g08cac018.el8 316 kB/s | 24 kB 00:00 2023-10-09T06:39:39.882 INFO:teuthology.orchestra.run.smithi179.stdout:(29/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 9.0 MB/s | 3.5 MB 00:00 2023-10-09T06:39:40.009 INFO:teuthology.orchestra.run.smithi179.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 6.7 MB/s | 1.7 MB 00:00 2023-10-09T06:39:40.075 INFO:teuthology.orchestra.run.smithi179.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1320.g08 3.5 MB/s | 238 kB 00:00 2023-10-09T06:39:40.130 INFO:teuthology.orchestra.run.smithi179.stdout:(32/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 865 kB/s | 47 kB 00:00 2023-10-09T06:39:40.178 INFO:teuthology.orchestra.run.smithi179.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1320.g0 300 kB/s | 14 kB 00:00 2023-10-09T06:39:40.237 INFO:teuthology.orchestra.run.smithi179.stdout:(34/120): ceph-volume-17.2.6-1320.g08cac018.el8 4.4 MB/s | 267 kB 00:00 2023-10-09T06:39:40.296 INFO:teuthology.orchestra.run.smithi179.stdout:(35/120): cephadm-17.2.6-1320.g08cac018.el8.noa 1.3 MB/s | 80 kB 00:00 2023-10-09T06:39:40.346 INFO:teuthology.orchestra.run.smithi179.stdout:(36/120): cephfs-top-17.2.6-1320.g08cac018.el8. 361 kB/s | 18 kB 00:00 2023-10-09T06:39:40.908 INFO:teuthology.orchestra.run.smithi179.stdout:(37/120): ceph-mgr-diskprediction-local-17.2.6- 7.2 MB/s | 7.4 MB 00:01 2023-10-09T06:39:41.077 INFO:teuthology.orchestra.run.smithi179.stdout:(38/120): gperftools-libs-2.7-9.el8.x86_64.rpm 419 kB/s | 306 kB 00:00 2023-10-09T06:39:41.192 INFO:teuthology.orchestra.run.smithi179.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 653 kB/s | 75 kB 00:00 2023-10-09T06:39:41.402 INFO:teuthology.orchestra.run.smithi179.stdout:(40/120): liboath-2.6.2-3.el8.x86_64.rpm 119 kB/s | 59 kB 00:00 2023-10-09T06:39:41.405 INFO:teuthology.orchestra.run.smithi179.stdout:(41/120): python3-asyncssh-2.7.0-2.el8.noarch.r 2.2 MB/s | 476 kB 00:00 2023-10-09T06:39:41.504 INFO:teuthology.orchestra.run.smithi071.stdout:(10/120): ceph-radosgw-17.2.6-1320.g08cac018.el 5.3 MB/s | 17 MB 00:03 2023-10-09T06:39:41.520 INFO:teuthology.orchestra.run.smithi179.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 1.6 MB/s | 185 kB 00:00 2023-10-09T06:39:41.535 INFO:teuthology.orchestra.run.smithi179.stdout:(43/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 328 kB/s | 44 kB 00:00 2023-10-09T06:39:41.569 INFO:teuthology.orchestra.run.smithi071.stdout:(11/120): cephfs-mirror-17.2.6-1320.g08cac018.e 3.9 MB/s | 255 kB 00:00 2023-10-09T06:39:41.612 INFO:teuthology.orchestra.run.smithi071.stdout:(12/120): libcephfs-devel-17.2.6-1320.g08cac018 581 kB/s | 25 kB 00:00 2023-10-09T06:39:41.620 INFO:teuthology.orchestra.run.smithi179.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 328 kB/s | 33 kB 00:00 2023-10-09T06:39:41.646 INFO:teuthology.orchestra.run.smithi179.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 149 kB/s | 16 kB 00:00 2023-10-09T06:39:41.733 INFO:teuthology.orchestra.run.smithi179.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.5 MB/s | 173 kB 00:00 2023-10-09T06:39:41.747 INFO:teuthology.orchestra.run.smithi071.stdout:(13/120): libcephfs2-17.2.6-1320.g08cac018.el8. 5.8 MB/s | 797 kB 00:00 2023-10-09T06:39:41.794 INFO:teuthology.orchestra.run.smithi071.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 3.7 MB/s | 174 kB 00:00 2023-10-09T06:39:41.838 INFO:teuthology.orchestra.run.smithi071.stdout:(15/120): librados-devel-17.2.6-1320.g08cac018. 2.9 MB/s | 130 kB 00:00 2023-10-09T06:39:41.839 INFO:teuthology.orchestra.run.smithi179.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 774 kB/s | 81 kB 00:00 2023-10-09T06:39:41.937 INFO:teuthology.orchestra.run.smithi179.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 112 kB/s | 11 kB 00:00 2023-10-09T06:39:41.939 INFO:teuthology.orchestra.run.smithi071.stdout:(16/120): libradosstriper1-17.2.6-1320.g08cac01 4.9 MB/s | 507 kB 00:00 2023-10-09T06:39:41.983 INFO:teuthology.orchestra.run.smithi179.stdout:(49/120): python3-cherrypy-18.4.0-1.el8.noarch. 1.1 MB/s | 384 kB 00:00 2023-10-09T06:39:42.037 INFO:teuthology.orchestra.run.smithi179.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 177 kB/s | 18 kB 00:00 2023-10-09T06:39:42.139 INFO:teuthology.orchestra.run.smithi179.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 477 kB/s | 49 kB 00:00 2023-10-09T06:39:42.241 INFO:teuthology.orchestra.run.smithi179.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 575 kB/s | 59 kB 00:00 2023-10-09T06:39:42.283 INFO:teuthology.orchestra.run.smithi179.stdout:(53/120): python3-kubernetes-11.0.0-6.el8.noarc 3.9 MB/s | 1.2 MB 00:00 2023-10-09T06:39:42.345 INFO:teuthology.orchestra.run.smithi179.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 583 kB/s | 60 kB 00:00 2023-10-09T06:39:42.394 INFO:teuthology.orchestra.run.smithi179.stdout:(55/120): python3-pecan-1.3.2-9.el8.noarch.rpm 2.5 MB/s | 283 kB 00:00 2023-10-09T06:39:42.444 INFO:teuthology.orchestra.run.smithi179.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 158 kB/s | 16 kB 00:00 2023-10-09T06:39:42.492 INFO:teuthology.orchestra.run.smithi179.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 345 kB/s | 34 kB 00:00 2023-10-09T06:39:42.559 INFO:teuthology.orchestra.run.smithi179.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 1.7 MB/s | 196 kB 00:00 2023-10-09T06:39:42.590 INFO:teuthology.orchestra.run.smithi179.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 651 kB/s | 64 kB 00:00 2023-10-09T06:39:42.658 INFO:teuthology.orchestra.run.smithi179.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 188 kB/s | 19 kB 00:00 2023-10-09T06:39:42.687 INFO:teuthology.orchestra.run.smithi179.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 248 kB/s | 24 kB 00:00 2023-10-09T06:39:42.759 INFO:teuthology.orchestra.run.smithi179.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 292 kB/s | 29 kB 00:00 2023-10-09T06:39:42.784 INFO:teuthology.orchestra.run.smithi179.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 285 kB/s | 27 kB 00:00 2023-10-09T06:39:42.790 INFO:teuthology.orchestra.run.smithi071.stdout:(17/120): librgw2-17.2.6-1320.g08cac018.el8.x86 6.5 MB/s | 5.6 MB 00:00 2023-10-09T06:39:42.838 INFO:teuthology.orchestra.run.smithi071.stdout:(18/120): python3-ceph-argparse-17.2.6-1320.g08 950 kB/s | 45 kB 00:00 2023-10-09T06:39:42.879 INFO:teuthology.orchestra.run.smithi179.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 2.1 MB/s | 255 kB 00:00 2023-10-09T06:39:42.882 INFO:teuthology.orchestra.run.smithi071.stdout:(19/120): python3-ceph-common-17.2.6-1320.g08ca 2.5 MB/s | 115 kB 00:00 2023-10-09T06:39:42.893 INFO:teuthology.orchestra.run.smithi179.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 2.2 MB/s | 251 kB 00:00 2023-10-09T06:39:42.930 INFO:teuthology.orchestra.run.smithi071.stdout:(20/120): python3-cephfs-17.2.6-1320.g08cac018. 4.0 MB/s | 190 kB 00:00 2023-10-09T06:39:42.983 INFO:teuthology.orchestra.run.smithi179.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 594 kB/s | 61 kB 00:00 2023-10-09T06:39:42.996 INFO:teuthology.orchestra.run.smithi179.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 834 kB/s | 85 kB 00:00 2023-10-09T06:39:43.024 INFO:teuthology.orchestra.run.smithi071.stdout:(21/120): python3-rados-17.2.6-1320.g08cac018.e 3.9 MB/s | 371 kB 00:00 2023-10-09T06:39:43.078 INFO:teuthology.orchestra.run.smithi071.stdout:(22/120): python3-rbd-17.2.6-1320.g08cac018.el8 6.4 MB/s | 358 kB 00:00 2023-10-09T06:39:43.081 INFO:teuthology.orchestra.run.smithi179.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 231 kB/s | 23 kB 00:00 2023-10-09T06:39:43.085 INFO:teuthology.orchestra.run.smithi179.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 19 MB/s | 70 kB 00:00 2023-10-09T06:39:43.124 INFO:teuthology.orchestra.run.smithi071.stdout:(23/120): python3-rgw-17.2.6-1320.g08cac018.el8 2.3 MB/s | 107 kB 00:00 2023-10-09T06:39:43.130 INFO:teuthology.orchestra.run.smithi179.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 419 kB/s | 19 kB 00:00 2023-10-09T06:39:43.157 INFO:teuthology.orchestra.run.smithi179.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.6 MB/s | 43 kB 00:00 2023-10-09T06:39:43.168 INFO:teuthology.orchestra.run.smithi071.stdout:(24/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 2.0 MB/s | 90 kB 00:00 2023-10-09T06:39:43.184 INFO:teuthology.orchestra.run.smithi179.stdout:(72/120): thrift-0.13.0-2.el8.x86_64.rpm 9.2 MB/s | 1.7 MB 00:00 2023-10-09T06:39:43.188 INFO:teuthology.orchestra.run.smithi179.stdout:(73/120): python3-oauthlib-2.1.0-1.el8.noarch.r 5.1 MB/s | 155 kB 00:00 2023-10-09T06:39:43.220 INFO:teuthology.orchestra.run.smithi179.stdout:(74/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 1.4 MB/s | 48 kB 00:00 2023-10-09T06:39:43.230 INFO:teuthology.orchestra.run.smithi179.stdout:(75/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.8 MB/s | 220 kB 00:00 2023-10-09T06:39:43.255 INFO:teuthology.orchestra.run.smithi179.stdout:(76/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 6.5 MB/s | 229 kB 00:00 2023-10-09T06:39:43.258 INFO:teuthology.orchestra.run.smithi179.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 1.5 MB/s | 43 kB 00:00 2023-10-09T06:39:43.292 INFO:teuthology.orchestra.run.smithi179.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 538 kB/s | 18 kB 00:00 2023-10-09T06:39:43.321 INFO:teuthology.orchestra.run.smithi179.stdout:(79/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 35 MB/s | 2.3 MB 00:00 2023-10-09T06:39:43.333 INFO:teuthology.orchestra.run.smithi179.stdout:(80/120): pcre2-devel-10.32-2.el8.x86_64.rpm 15 MB/s | 605 kB 00:00 2023-10-09T06:39:43.349 INFO:teuthology.orchestra.run.smithi179.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 2.9 MB/s | 83 kB 00:00 2023-10-09T06:39:43.366 INFO:teuthology.orchestra.run.smithi179.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 1.7 MB/s | 59 kB 00:00 2023-10-09T06:39:43.377 INFO:teuthology.orchestra.run.smithi179.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 5.9 MB/s | 169 kB 00:00 2023-10-09T06:39:43.398 INFO:teuthology.orchestra.run.smithi179.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 1.2 MB/s | 38 kB 00:00 2023-10-09T06:39:43.409 INFO:teuthology.orchestra.run.smithi179.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 2.6 MB/s | 86 kB 00:00 2023-10-09T06:39:43.426 INFO:teuthology.orchestra.run.smithi179.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 2.0 MB/s | 58 kB 00:00 2023-10-09T06:39:43.440 INFO:teuthology.orchestra.run.smithi179.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.5 MB/s | 47 kB 00:00 2023-10-09T06:39:43.462 INFO:teuthology.orchestra.run.smithi179.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 15 MB/s | 559 kB 00:00 2023-10-09T06:39:43.475 INFO:teuthology.orchestra.run.smithi179.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 18 MB/s | 639 kB 00:00 2023-10-09T06:39:43.498 INFO:teuthology.orchestra.run.smithi179.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 1.9 MB/s | 70 kB 00:00 2023-10-09T06:39:43.509 INFO:teuthology.orchestra.run.smithi179.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 5.7 MB/s | 200 kB 00:00 2023-10-09T06:39:43.531 INFO:teuthology.orchestra.run.smithi179.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 2.9 MB/s | 97 kB 00:00 2023-10-09T06:39:43.563 INFO:teuthology.orchestra.run.smithi179.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 1.4 MB/s | 44 kB 00:00 2023-10-09T06:39:43.594 INFO:teuthology.orchestra.run.smithi179.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 883 kB/s | 27 kB 00:00 2023-10-09T06:39:43.626 INFO:teuthology.orchestra.run.smithi179.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 4.8 MB/s | 161 kB 00:00 2023-10-09T06:39:43.657 INFO:teuthology.orchestra.run.smithi179.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 10 MB/s | 320 kB 00:00 2023-10-09T06:39:43.691 INFO:teuthology.orchestra.run.smithi179.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 14 MB/s | 457 kB 00:00 2023-10-09T06:39:43.702 INFO:teuthology.orchestra.run.smithi071.stdout:(25/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 6.5 MB/s | 3.5 MB 00:00 2023-10-09T06:39:43.779 INFO:teuthology.orchestra.run.smithi179.stdout:(98/120): python3-scipy-1.0.0-20.module+el8.1.0 54 MB/s | 15 MB 00:00 2023-10-09T06:39:43.803 INFO:teuthology.orchestra.run.smithi179.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 1.5 MB/s | 39 kB 00:00 2023-10-09T06:39:43.845 INFO:teuthology.orchestra.run.smithi179.stdout:(100/120): python3-babel-2.5.1-5.el8.noarch.rpm 31 MB/s | 4.8 MB 00:00 2023-10-09T06:39:43.859 INFO:teuthology.orchestra.run.smithi179.stdout:(101/120): bison-3.0.4-10.el8.x86_64.rpm 13 MB/s | 688 kB 00:00 2023-10-09T06:39:43.871 INFO:teuthology.orchestra.run.smithi071.stdout:(26/120): ceph-test-17.2.6-1320.g08cac018.el8.x 13 MB/s | 52 MB 00:04 2023-10-09T06:39:43.873 INFO:teuthology.orchestra.run.smithi071.stdout:(27/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 1.0 MB/s | 173 kB 00:00 2023-10-09T06:39:43.873 INFO:teuthology.orchestra.run.smithi179.stdout:(102/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 9.0 MB/s | 259 kB 00:00 2023-10-09T06:39:43.890 INFO:teuthology.orchestra.run.smithi179.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 6.2 MB/s | 225 kB 00:00 2023-10-09T06:39:43.909 INFO:teuthology.orchestra.run.smithi071.stdout:(28/120): ceph-grafana-dashboards-17.2.6-1320.g 628 kB/s | 23 kB 00:00 2023-10-09T06:39:43.911 INFO:teuthology.orchestra.run.smithi071.stdout:(29/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 3.1 MB/s | 121 kB 00:00 2023-10-09T06:39:43.983 INFO:teuthology.orchestra.run.smithi179.stdout:(104/120): python3-numpy-1.14.3-9.el8.x86_64.rp 40 MB/s | 3.7 MB 00:00 2023-10-09T06:39:43.985 INFO:teuthology.orchestra.run.smithi179.stdout:(105/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.1 MB/s | 126 kB 00:00 2023-10-09T06:39:44.008 INFO:teuthology.orchestra.run.smithi179.stdout:(106/120): oniguruma-6.8.2-2.el8.x86_64.rpm 7.3 MB/s | 187 kB 00:00 2023-10-09T06:39:44.026 INFO:teuthology.orchestra.run.smithi179.stdout:(107/120): python3-jinja2-2.10.1-2.el8_0.noarch 13 MB/s | 538 kB 00:00 2023-10-09T06:39:44.040 INFO:teuthology.orchestra.run.smithi179.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 10 MB/s | 302 kB 00:00 2023-10-09T06:39:44.053 INFO:teuthology.orchestra.run.smithi071.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 12 MB/s | 1.7 MB 00:00 2023-10-09T06:39:44.076 INFO:teuthology.orchestra.run.smithi179.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 3.1 MB/s | 157 kB 00:00 2023-10-09T06:39:44.090 INFO:teuthology.orchestra.run.smithi179.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 2.1 MB/s | 110 kB 00:00 2023-10-09T06:39:44.093 INFO:teuthology.orchestra.run.smithi071.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1320.g08 5.7 MB/s | 238 kB 00:00 2023-10-09T06:39:44.116 INFO:teuthology.orchestra.run.smithi179.stdout:(111/120): librdkafka-0.11.4-1.el8.x86_64.rpm 8.7 MB/s | 353 kB 00:00 2023-10-09T06:39:44.121 INFO:teuthology.orchestra.run.smithi179.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 645 kB/s | 20 kB 00:00 2023-10-09T06:39:44.130 INFO:teuthology.orchestra.run.smithi071.stdout:(32/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 1.3 MB/s | 47 kB 00:00 2023-10-09T06:39:44.154 INFO:teuthology.orchestra.run.smithi179.stdout:(113/120): libtool-2.4.6-25.el8.x86_64.rpm 18 MB/s | 709 kB 00:00 2023-10-09T06:39:44.155 INFO:teuthology.orchestra.run.smithi179.stdout:(114/120): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-10-09T06:39:44.167 INFO:teuthology.orchestra.run.smithi071.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1320.g0 398 kB/s | 14 kB 00:00 2023-10-09T06:39:44.207 INFO:teuthology.orchestra.run.smithi071.stdout:(34/120): ceph-volume-17.2.6-1320.g08cac018.el8 6.6 MB/s | 267 kB 00:00 2023-10-09T06:39:44.245 INFO:teuthology.orchestra.run.smithi071.stdout:(35/120): cephadm-17.2.6-1320.g08cac018.el8.noa 2.1 MB/s | 80 kB 00:00 2023-10-09T06:39:44.279 INFO:teuthology.orchestra.run.smithi179.stdout:(115/120): openblas-threads-0.3.12-1.el8.x86_64 38 MB/s | 4.7 MB 00:00 2023-10-09T06:39:44.281 INFO:teuthology.orchestra.run.smithi071.stdout:(36/120): cephfs-top-17.2.6-1320.g08cac018.el8. 495 kB/s | 18 kB 00:00 2023-10-09T06:39:44.297 INFO:teuthology.orchestra.run.smithi179.stdout:(116/120): openblas-0.3.12-1.el8.x86_64.rpm 33 MB/s | 4.6 MB 00:00 2023-10-09T06:39:44.321 INFO:teuthology.orchestra.run.smithi179.stdout:(117/120): automake-1.16.1-7.el8.noarch.rpm 17 MB/s | 713 kB 00:00 2023-10-09T06:39:44.774 INFO:teuthology.orchestra.run.smithi179.stdout:(118/120): librados2-17.2.6-1320.g08cac018.el8. 7.3 MB/s | 3.5 MB 00:00 2023-10-09T06:39:44.832 INFO:teuthology.orchestra.run.smithi179.stdout:(119/120): librbd1-17.2.6-1320.g08cac018.el8.x8 7.0 MB/s | 3.6 MB 00:00 2023-10-09T06:39:44.894 INFO:teuthology.orchestra.run.smithi071.stdout:(37/120): ceph-mgr-diskprediction-local-17.2.6- 7.5 MB/s | 7.4 MB 00:00 2023-10-09T06:39:45.008 INFO:teuthology.orchestra.run.smithi071.stdout:(38/120): gperftools-libs-2.7-9.el8.x86_64.rpm 422 kB/s | 306 kB 00:00 2023-10-09T06:39:45.158 INFO:teuthology.orchestra.run.smithi071.stdout:(39/120): ceph-common-17.2.6-1320.g08cac018.el8 2.6 MB/s | 23 MB 00:09 2023-10-09T06:39:45.160 INFO:teuthology.orchestra.run.smithi071.stdout:(40/120): libunwind-1.3.1-3.el8.x86_64.rpm 496 kB/s | 75 kB 00:00 2023-10-09T06:39:45.266 INFO:teuthology.orchestra.run.smithi071.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 408 kB/s | 44 kB 00:00 2023-10-09T06:39:45.416 INFO:teuthology.orchestra.run.smithi071.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 1.2 MB/s | 185 kB 00:00 2023-10-09T06:39:45.455 INFO:teuthology.orchestra.run.smithi071.stdout:(43/120): liboath-2.6.2-3.el8.x86_64.rpm 105 kB/s | 59 kB 00:00 2023-10-09T06:39:45.520 INFO:teuthology.orchestra.run.smithi071.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 317 kB/s | 33 kB 00:00 2023-10-09T06:39:45.565 INFO:teuthology.orchestra.run.smithi071.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 148 kB/s | 16 kB 00:00 2023-10-09T06:39:45.659 INFO:teuthology.orchestra.run.smithi071.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.2 MB/s | 173 kB 00:00 2023-10-09T06:39:45.788 INFO:teuthology.orchestra.run.smithi071.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 627 kB/s | 81 kB 00:00 2023-10-09T06:39:45.887 INFO:teuthology.orchestra.run.smithi071.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 112 kB/s | 11 kB 00:00 2023-10-09T06:39:45.915 INFO:teuthology.orchestra.run.smithi071.stdout:(49/120): python3-cherrypy-18.4.0-1.el8.noarch. 1.1 MB/s | 384 kB 00:00 2023-10-09T06:39:45.949 INFO:teuthology.orchestra.run.smithi071.stdout:(50/120): python3-asyncssh-2.7.0-2.el8.noarch.r 602 kB/s | 476 kB 00:00 2023-10-09T06:39:45.988 INFO:teuthology.orchestra.run.smithi071.stdout:(51/120): python3-jaraco-functools-2.0-4.el8.no 176 kB/s | 18 kB 00:00 2023-10-09T06:39:46.054 INFO:teuthology.orchestra.run.smithi071.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 465 kB/s | 49 kB 00:00 2023-10-09T06:39:46.098 INFO:teuthology.orchestra.run.smithi071.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 532 kB/s | 59 kB 00:00 2023-10-09T06:39:46.161 INFO:teuthology.orchestra.run.smithi071.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 566 kB/s | 60 kB 00:00 2023-10-09T06:39:46.215 INFO:teuthology.orchestra.run.smithi071.stdout:(55/120): python3-kubernetes-11.0.0-6.el8.noarc 3.9 MB/s | 1.2 MB 00:00 2023-10-09T06:39:46.260 INFO:teuthology.orchestra.run.smithi071.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 157 kB/s | 16 kB 00:00 2023-10-09T06:39:46.263 INFO:teuthology.orchestra.run.smithi071.stdout:(57/120): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-10-09T06:39:46.315 INFO:teuthology.orchestra.run.smithi071.stdout:(58/120): python3-repoze-lru-0.7-6.el8.noarch.r 341 kB/s | 34 kB 00:00 2023-10-09T06:39:46.373 INFO:teuthology.orchestra.run.smithi071.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 592 kB/s | 64 kB 00:00 2023-10-09T06:39:46.388 INFO:teuthology.orchestra.run.smithi071.stdout:(60/120): python3-routes-2.4.1-12.el8.noarch.rp 1.5 MB/s | 196 kB 00:00 2023-10-09T06:39:46.412 INFO:teuthology.orchestra.run.smithi071.stdout:(61/120): python3-simplegeneric-0.8.1-17.el8.no 192 kB/s | 19 kB 00:00 2023-10-09T06:39:46.473 INFO:teuthology.orchestra.run.smithi071.stdout:(62/120): python3-singledispatch-3.4.0.3-18.el8 239 kB/s | 24 kB 00:00 2023-10-09T06:39:46.490 INFO:teuthology.orchestra.run.smithi071.stdout:(63/120): python3-tempora-1.14.1-5.el8.noarch.r 287 kB/s | 29 kB 00:00 2023-10-09T06:39:46.510 INFO:teuthology.orchestra.run.smithi071.stdout:(64/120): python3-trustme-0.6.0-4.el8.noarch.rp 282 kB/s | 27 kB 00:00 2023-10-09T06:39:46.609 INFO:teuthology.orchestra.run.smithi071.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 616 kB/s | 61 kB 00:00 2023-10-09T06:39:46.621 INFO:teuthology.orchestra.run.smithi071.stdout:(66/120): python3-waitress-1.4.3-1.el8.noarch.r 1.7 MB/s | 255 kB 00:00 2023-10-09T06:39:46.624 INFO:teuthology.orchestra.run.smithi071.stdout:(67/120): python3-webob-1.8.5-1.el8.1.noarch.rp 1.8 MB/s | 251 kB 00:00 2023-10-09T06:39:46.711 INFO:teuthology.orchestra.run.smithi071.stdout:(68/120): python3-webtest-2.0.33-1.el8.noarch.r 847 kB/s | 85 kB 00:00 2023-10-09T06:39:46.716 INFO:teuthology.orchestra.run.smithi071.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 13 MB/s | 70 kB 00:00 2023-10-09T06:39:46.721 INFO:teuthology.orchestra.run.smithi071.stdout:(70/120): python3-zc-lockfile-2.0-2.el8.noarch. 228 kB/s | 23 kB 00:00 2023-10-09T06:39:46.746 INFO:teuthology.orchestra.run.smithi071.stdout:(71/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 637 kB/s | 19 kB 00:00 2023-10-09T06:39:46.751 INFO:teuthology.orchestra.run.smithi071.stdout:(72/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.4 MB/s | 43 kB 00:00 2023-10-09T06:39:46.763 INFO:teuthology.orchestra.run.smithi071.stdout:(73/120): python3-oauthlib-2.1.0-1.el8.noarch.r 9.0 MB/s | 155 kB 00:00 2023-10-09T06:39:46.769 INFO:teuthology.orchestra.run.smithi071.stdout:(74/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 12 MB/s | 220 kB 00:00 2023-10-09T06:39:46.779 INFO:teuthology.orchestra.run.smithi071.stdout:(75/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.0 MB/s | 48 kB 00:00 2023-10-09T06:39:46.788 INFO:teuthology.orchestra.run.smithi071.stdout:(76/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 13 MB/s | 229 kB 00:00 2023-10-09T06:39:46.793 INFO:teuthology.orchestra.run.smithi071.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 3.0 MB/s | 43 kB 00:00 2023-10-09T06:39:46.806 INFO:teuthology.orchestra.run.smithi071.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.4 MB/s | 18 kB 00:00 2023-10-09T06:39:46.833 INFO:teuthology.orchestra.run.smithi071.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 23 MB/s | 605 kB 00:00 2023-10-09T06:39:46.850 INFO:teuthology.orchestra.run.smithi071.stdout:(80/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 37 MB/s | 2.3 MB 00:00 2023-10-09T06:39:46.852 INFO:teuthology.orchestra.run.smithi071.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 4.2 MB/s | 83 kB 00:00 2023-10-09T06:39:46.864 INFO:teuthology.orchestra.run.smithi071.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 4.1 MB/s | 59 kB 00:00 2023-10-09T06:39:46.868 INFO:teuthology.orchestra.run.smithi071.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 11 MB/s | 169 kB 00:00 2023-10-09T06:39:46.877 INFO:teuthology.orchestra.run.smithi071.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 3.0 MB/s | 38 kB 00:00 2023-10-09T06:39:46.882 INFO:teuthology.orchestra.run.smithi071.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 6.0 MB/s | 86 kB 00:00 2023-10-09T06:39:46.893 INFO:teuthology.orchestra.run.smithi071.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.6 MB/s | 58 kB 00:00 2023-10-09T06:39:46.902 INFO:teuthology.orchestra.run.smithi071.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 2.4 MB/s | 47 kB 00:00 2023-10-09T06:39:46.916 INFO:teuthology.orchestra.run.smithi071.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 24 MB/s | 559 kB 00:00 2023-10-09T06:39:46.927 INFO:teuthology.orchestra.run.smithi071.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 24 MB/s | 639 kB 00:00 2023-10-09T06:39:46.929 INFO:teuthology.orchestra.run.smithi071.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 5.2 MB/s | 70 kB 00:00 2023-10-09T06:39:46.947 INFO:teuthology.orchestra.run.smithi071.stdout:(91/120): thrift-0.13.0-2.el8.x86_64.rpm 5.4 MB/s | 1.7 MB 00:00 2023-10-09T06:39:46.950 INFO:teuthology.orchestra.run.smithi071.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 4.7 MB/s | 97 kB 00:00 2023-10-09T06:39:46.951 INFO:teuthology.orchestra.run.smithi071.stdout:(93/120): libselinux-devel-2.9-5.el8.x86_64.rpm 8.3 MB/s | 200 kB 00:00 2023-10-09T06:39:46.963 INFO:teuthology.orchestra.run.smithi071.stdout:(94/120): python3-prettytable-0.7.2-14.el8.noar 3.3 MB/s | 44 kB 00:00 2023-10-09T06:39:46.965 INFO:teuthology.orchestra.run.smithi071.stdout:(95/120): python3-jsonpatch-1.21-2.el8.noarch.r 2.0 MB/s | 27 kB 00:00 2023-10-09T06:39:46.984 INFO:teuthology.orchestra.run.smithi071.stdout:(96/120): jq-1.5-12.el8.x86_64.rpm 7.8 MB/s | 161 kB 00:00 2023-10-09T06:39:46.988 INFO:teuthology.orchestra.run.smithi071.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 13 MB/s | 320 kB 00:00 2023-10-09T06:39:47.008 INFO:teuthology.orchestra.run.smithi071.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 19 MB/s | 457 kB 00:00 2023-10-09T06:39:47.022 INFO:teuthology.orchestra.run.smithi071.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.9 MB/s | 39 kB 00:00 2023-10-09T06:39:47.051 INFO:teuthology.orchestra.run.smithi071.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 23 MB/s | 688 kB 00:00 2023-10-09T06:39:47.071 INFO:teuthology.orchestra.run.smithi071.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 13 MB/s | 259 kB 00:00 2023-10-09T06:39:47.089 INFO:teuthology.orchestra.run.smithi071.stdout:(102/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 13 MB/s | 225 kB 00:00 2023-10-09T06:39:47.104 INFO:teuthology.orchestra.run.smithi071.stdout:(103/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 8.1 MB/s | 126 kB 00:00 2023-10-09T06:39:47.121 INFO:teuthology.orchestra.run.smithi071.stdout:(104/120): python3-babel-2.5.1-5.el8.noarch.rpm 36 MB/s | 4.8 MB 00:00 2023-10-09T06:39:47.138 INFO:teuthology.orchestra.run.smithi071.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 11 MB/s | 187 kB 00:00 2023-10-09T06:39:47.164 INFO:teuthology.orchestra.run.smithi071.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 20 MB/s | 538 kB 00:00 2023-10-09T06:39:47.184 INFO:teuthology.orchestra.run.smithi071.stdout:(107/120): socat-1.7.3.3-2.el8.x86_64.rpm 15 MB/s | 302 kB 00:00 2023-10-09T06:39:47.210 INFO:teuthology.orchestra.run.smithi071.stdout:(108/120): python3-numpy-1.14.3-9.el8.x86_64.rp 35 MB/s | 3.7 MB 00:00 2023-10-09T06:39:47.212 INFO:teuthology.orchestra.run.smithi071.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 5.6 MB/s | 157 kB 00:00 2023-10-09T06:39:47.226 INFO:teuthology.orchestra.run.smithi071.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 7.2 MB/s | 110 kB 00:00 2023-10-09T06:39:47.233 INFO:teuthology.orchestra.run.smithi071.stdout:(111/120): librdkafka-0.11.4-1.el8.x86_64.rpm 17 MB/s | 353 kB 00:00 2023-10-09T06:39:47.238 INFO:teuthology.orchestra.run.smithi071.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 1.5 MB/s | 20 kB 00:00 2023-10-09T06:39:47.252 INFO:teuthology.orchestra.run.smithi071.stdout:(113/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.0 MB/s | 54 kB 00:00 2023-10-09T06:39:47.262 INFO:teuthology.orchestra.run.smithi071.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 25 MB/s | 709 kB 00:00 2023-10-09T06:39:47.338 INFO:teuthology.orchestra.run.smithi071.stdout:(115/120): python3-scipy-1.0.0-20.module+el8.1. 37 MB/s | 15 MB 00:00 2023-10-09T06:39:47.370 INFO:teuthology.orchestra.run.smithi071.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 22 MB/s | 713 kB 00:00 2023-10-09T06:39:47.421 INFO:teuthology.orchestra.run.smithi071.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 28 MB/s | 4.7 MB 00:00 2023-10-09T06:39:47.443 INFO:teuthology.orchestra.run.smithi071.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 25 MB/s | 4.6 MB 00:00 2023-10-09T06:39:47.805 INFO:teuthology.orchestra.run.smithi071.stdout:(119/120): librados2-17.2.6-1320.g08cac018.el8. 8.0 MB/s | 3.5 MB 00:00 2023-10-09T06:39:48.006 INFO:teuthology.orchestra.run.smithi071.stdout:(120/120): librbd1-17.2.6-1320.g08cac018.el8.x8 6.1 MB/s | 3.6 MB 00:00 2023-10-09T06:39:48.011 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2023-10-09T06:39:48.012 INFO:teuthology.orchestra.run.smithi071.stdout:Total 17 MB/s | 202 MB 00:12 2023-10-09T06:39:48.079 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2023-10-09T06:39:48.132 INFO:teuthology.orchestra.run.smithi179.stdout:(120/120): ceph-test-17.2.6-1320.g08cac018.el8. 5.1 MB/s | 52 MB 00:10 2023-10-09T06:39:48.137 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2023-10-09T06:39:48.138 INFO:teuthology.orchestra.run.smithi179.stdout:Total 15 MB/s | 202 MB 00:13 2023-10-09T06:39:48.203 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2023-10-09T06:39:48.204 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2023-10-09T06:39:48.206 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2023-10-09T06:39:48.332 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2023-10-09T06:39:48.333 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2023-10-09T06:39:49.974 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2023-10-09T06:39:49.979 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2023-10-09T06:39:50.133 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2023-10-09T06:39:50.137 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2023-10-09T06:39:54.521 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2023-10-09T06:39:54.732 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-09T06:39:54.902 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2023-10-09T06:39:54.955 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-09T06:39:55.108 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-09T06:39:55.122 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-09T06:39:55.296 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-09T06:39:55.353 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-09T06:39:55.551 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-09T06:39:55.745 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-09T06:39:55.827 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-09T06:39:56.208 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-09T06:39:56.388 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T06:39:56.420 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T06:39:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T06:39:56.883 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T06:39:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T06:39:57.077 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T06:39:57.226 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T06:39:57.227 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T06:39:57.402 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T06:39:57.437 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T06:39:57.528 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T06:39:57.574 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T06:39:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T06:39:57.784 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T06:39:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-09T06:39:58.198 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-09T06:39:58.843 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-09T06:39:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T06:39:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T06:39:59.486 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-09T06:39:59.536 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-09T06:39:59.666 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-09T06:39:59.736 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T06:39:59.837 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T06:39:59.879 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T06:39:59.972 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T06:40:00.160 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-09T06:40:00.204 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T06:40:00.309 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T06:40:00.389 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-09T06:40:00.494 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-09T06:40:00.577 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T06:40:00.738 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T06:40:00.769 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-09T06:40:00.911 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T06:40:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-09T06:40:01.049 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T06:40:01.167 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-09T06:40:01.227 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-09T06:40:01.540 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-09T06:40:01.804 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-09T06:40:01.928 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-09T06:40:01.970 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-09T06:40:02.109 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-09T06:40:02.161 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-09T06:40:02.270 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-09T06:40:02.326 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-09T06:40:02.510 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-09T06:40:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-09T06:40:03.078 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-09T06:40:03.129 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-09T06:40:03.535 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-09T06:40:03.681 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-09T06:40:03.861 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-09T06:40:04.127 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-09T06:40:04.335 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-09T06:40:04.714 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-09T06:40:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-09T06:40:05.215 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-09T06:40:05.266 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-09T06:40:05.516 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-09T06:40:05.527 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-09T06:40:05.743 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-09T06:40:05.816 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-09T06:40:05.873 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-09T06:40:06.099 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-09T06:40:06.142 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-09T06:40:06.284 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-09T06:40:06.415 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-09T06:40:06.465 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-09T06:40:06.717 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-09T06:40:06.758 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-09T06:40:06.998 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-09T06:40:07.035 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-09T06:40:07.318 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-09T06:40:07.568 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-09T06:40:09.492 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-09T06:40:09.874 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-09T06:40:09.999 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-09T06:40:10.406 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-09T06:40:11.011 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-09T06:40:11.375 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-09T06:40:11.568 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-09T06:40:11.662 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-09T06:40:11.907 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-09T06:40:11.940 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-09T06:40:12.131 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-09T06:40:12.228 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-09T06:40:12.340 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-09T06:40:12.508 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-09T06:40:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-09T06:40:12.723 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-09T06:40:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-09T06:40:12.956 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-09T06:40:13.059 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-09T06:40:13.136 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-09T06:40:13.244 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-09T06:40:13.453 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-09T06:40:13.479 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-09T06:40:13.650 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-09T06:40:13.699 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-09T06:40:13.800 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-09T06:40:13.904 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-09T06:40:13.918 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-09T06:40:14.089 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-09T06:40:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-09T06:40:14.292 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-09T06:40:14.324 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-09T06:40:14.467 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-09T06:40:14.472 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-09T06:40:14.571 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-09T06:40:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-09T06:40:14.744 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-09T06:40:14.904 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-09T06:40:14.909 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-09T06:40:15.095 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-09T06:40:15.131 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-09T06:40:15.248 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-09T06:40:15.331 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-09T06:40:15.464 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-09T06:40:15.512 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-09T06:40:15.664 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-09T06:40:15.728 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-09T06:40:15.898 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-09T06:40:15.982 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-09T06:40:16.098 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-09T06:40:16.273 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-09T06:40:16.300 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-09T06:40:16.561 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-09T06:40:16.623 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-09T06:40:16.925 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-09T06:40:16.949 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-09T06:40:17.086 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-09T06:40:17.244 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-09T06:40:17.269 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-09T06:40:17.532 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-09T06:40:17.590 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-09T06:40:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-09T06:40:17.769 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-09T06:40:17.951 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-09T06:40:17.985 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-09T06:40:18.081 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-09T06:40:18.231 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-09T06:40:18.246 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-09T06:40:18.451 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-09T06:40:18.494 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-09T06:40:18.701 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-09T06:40:18.750 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-09T06:40:18.934 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-09T06:40:18.956 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-09T06:40:19.122 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-09T06:40:19.145 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-09T06:40:19.361 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-09T06:40:19.375 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-09T06:40:19.569 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-09T06:40:19.633 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-09T06:40:19.801 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-09T06:40:19.882 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-09T06:40:20.029 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-09T06:40:20.116 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-09T06:40:20.217 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-09T06:40:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-09T06:40:20.477 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-09T06:40:20.709 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-09T06:40:20.768 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-09T06:40:20.930 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-09T06:40:20.967 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-09T06:40:21.200 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-09T06:40:21.295 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-09T06:40:21.560 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-09T06:40:21.762 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-09T06:40:22.040 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-09T06:40:22.668 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-09T06:40:22.980 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-09T06:40:23.198 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-09T06:40:23.472 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-09T06:40:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-09T06:40:23.784 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-09T06:40:23.813 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-09T06:40:24.083 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-09T06:40:24.193 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-09T06:40:24.417 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-09T06:40:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-09T06:40:24.654 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-09T06:40:24.693 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-09T06:40:24.874 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-09T06:40:25.062 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-09T06:40:25.298 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-09T06:40:25.524 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-09T06:40:25.716 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-09T06:40:32.320 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T06:40:32.459 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T06:40:32.573 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T06:40:32.724 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T06:40:33.239 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T06:40:33.395 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T06:40:33.732 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T06:40:33.755 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T06:40:33.857 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T06:40:33.924 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T06:40:34.030 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T06:40:35.032 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T06:40:53.416 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T06:40:53.416 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /sys 2023-10-09T06:40:53.416 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /proc 2023-10-09T06:40:53.417 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /dev 2023-10-09T06:40:53.417 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /run 2023-10-09T06:40:53.417 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /mnt 2023-10-09T06:40:53.417 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /var/tmp 2023-10-09T06:40:53.417 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /home 2023-10-09T06:40:53.417 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /tmp 2023-10-09T06:40:53.417 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /dev 2023-10-09T06:40:53.417 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:40:53.859 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T06:40:54.549 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T06:40:54.549 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /sys 2023-10-09T06:40:54.549 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /proc 2023-10-09T06:40:54.549 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /dev 2023-10-09T06:40:54.549 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /run 2023-10-09T06:40:54.549 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /mnt 2023-10-09T06:40:54.549 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /var/tmp 2023-10-09T06:40:54.549 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /home 2023-10-09T06:40:54.550 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /tmp 2023-10-09T06:40:54.550 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /dev 2023-10-09T06:40:54.550 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:40:55.011 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T06:40:55.482 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T06:40:55.650 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T06:40:55.921 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T06:40:56.103 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T06:40:56.555 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T06:40:56.635 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T06:40:56.700 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T06:40:56.741 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T06:40:56.837 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T06:40:57.111 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T06:40:57.299 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T06:40:57.751 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T06:40:57.919 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T06:40:57.960 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T06:41:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T06:41:01.235 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T06:41:01.466 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-09T06:41:01.668 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-09T06:41:01.882 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T06:41:02.148 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T06:41:02.238 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T06:41:02.331 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T06:41:02.440 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T06:41:02.635 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-09T06:41:02.848 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-09T06:41:03.042 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T06:41:03.307 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T06:41:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T06:41:03.535 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T06:41:03.623 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T06:41:03.762 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T06:41:04.150 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-09T06:41:04.331 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T06:41:04.400 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T06:41:04.550 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T06:41:04.575 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T06:41:04.645 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T06:41:04.802 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T06:41:04.940 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T06:41:05.346 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-09T06:41:05.553 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T06:41:05.622 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T06:41:05.759 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T06:41:05.787 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T06:41:06.327 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-09T06:41:06.614 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T06:41:06.729 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T06:41:06.890 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T06:41:06.962 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T06:41:07.123 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T06:41:07.507 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-09T06:41:07.531 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T06:41:07.714 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T06:41:07.761 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T06:41:07.884 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T06:41:08.077 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T06:41:08.149 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T06:41:08.321 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T06:41:08.726 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T06:41:08.943 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T06:41:13.075 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T06:41:14.298 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T06:41:14.355 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-09T06:41:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-09T06:41:14.938 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 110/122 2023-10-09T06:41:15.193 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-09T06:41:15.379 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-09T06:41:15.407 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-09T06:41:15.618 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-09T06:41:15.702 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-09T06:41:15.777 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-09T06:41:15.946 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-09T06:41:16.080 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-09T06:41:16.138 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-09T06:41:16.318 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 110/122 2023-10-09T06:41:16.421 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-09T06:41:16.550 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-09T06:41:16.603 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-09T06:41:16.683 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-09T06:41:16.759 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-09T06:41:16.787 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-09T06:41:16.871 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-09T06:41:16.895 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-09T06:41:16.940 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-09T06:41:17.025 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-09T06:41:17.026 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T06:41:17.123 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-09T06:41:17.260 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T06:41:17.260 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T06:41:17.267 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-09T06:41:17.494 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-09T06:41:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T06:41:17.658 INFO:teuthology.orchestra.run.smithi071.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-09T06:41:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:17.772 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-09T06:41:17.949 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-09T06:41:18.038 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-09T06:41:18.241 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-09T06:41:18.265 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-09T06:41:18.436 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-09T06:41:18.437 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T06:41:18.495 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-09T06:41:18.495 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-09T06:41:18.495 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-09T06:41:18.495 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T06:41:18.495 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-09T06:41:18.495 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T06:41:18.496 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T06:41:18.496 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-09T06:41:18.496 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-09T06:41:18.496 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T06:41:18.496 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-09T06:41:18.496 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-09T06:41:18.496 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T06:41:18.496 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-09T06:41:18.496 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-09T06:41:18.496 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-09T06:41:18.496 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-09T06:41:18.497 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-09T06:41:18.497 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-09T06:41:18.497 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-09T06:41:18.497 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-09T06:41:18.497 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-09T06:41:18.497 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-09T06:41:18.497 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-09T06:41:18.497 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-09T06:41:18.505 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-09T06:41:18.506 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-09T06:41:18.506 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-09T06:41:18.506 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-09T06:41:18.506 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-09T06:41:18.506 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-09T06:41:18.506 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-09T06:41:18.506 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-09T06:41:18.506 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-09T06:41:18.506 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-09T06:41:18.506 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-09T06:41:18.506 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-09T06:41:18.507 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-09T06:41:18.507 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-09T06:41:18.507 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-09T06:41:18.507 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-09T06:41:18.507 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-09T06:41:18.507 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-09T06:41:18.507 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-09T06:41:18.507 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-09T06:41:18.507 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-09T06:41:18.507 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-09T06:41:18.507 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-09T06:41:18.507 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-09T06:41:18.508 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-09T06:41:18.508 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-09T06:41:18.508 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-09T06:41:18.508 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-09T06:41:18.508 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-09T06:41:18.508 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-09T06:41:18.508 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-09T06:41:18.508 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-09T06:41:18.508 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-09T06:41:18.508 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-09T06:41:18.508 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-09T06:41:18.509 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-09T06:41:18.509 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-09T06:41:18.509 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-09T06:41:18.509 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-09T06:41:18.509 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-09T06:41:18.509 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-09T06:41:18.509 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-09T06:41:18.509 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-09T06:41:18.509 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-09T06:41:18.509 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-09T06:41:18.509 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-09T06:41:18.509 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-09T06:41:18.510 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-09T06:41:18.510 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-09T06:41:18.510 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-09T06:41:18.510 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-09T06:41:18.510 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-09T06:41:18.510 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-09T06:41:18.510 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-09T06:41:18.510 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-09T06:41:18.510 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-09T06:41:18.510 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-09T06:41:18.510 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-09T06:41:18.511 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-09T06:41:18.511 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-09T06:41:18.511 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-09T06:41:18.511 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-09T06:41:18.511 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-09T06:41:18.511 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-09T06:41:18.511 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-09T06:41:18.511 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-09T06:41:18.511 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-09T06:41:18.511 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-09T06:41:18.511 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-09T06:41:18.511 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-09T06:41:18.512 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-09T06:41:18.512 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-09T06:41:18.512 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-09T06:41:18.512 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-09T06:41:18.512 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-09T06:41:18.512 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-09T06:41:18.512 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-09T06:41:18.512 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-09T06:41:18.512 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-09T06:41:18.512 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-09T06:41:18.512 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-09T06:41:18.513 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-09T06:41:18.513 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-09T06:41:18.513 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-09T06:41:18.513 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-09T06:41:18.513 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-09T06:41:18.513 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-09T06:41:18.513 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-09T06:41:18.513 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-09T06:41:18.513 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-09T06:41:18.513 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-09T06:41:18.513 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-09T06:41:18.513 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-09T06:41:18.514 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-09T06:41:18.514 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-09T06:41:18.514 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-09T06:41:18.672 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T06:41:18.672 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T06:41:19.073 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T06:41:19.073 INFO:teuthology.orchestra.run.smithi179.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-09T06:41:19.074 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:19.944 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-09T06:41:19.944 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-09T06:41:19.944 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-09T06:41:19.944 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T06:41:19.944 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-09T06:41:19.944 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T06:41:19.945 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T06:41:19.945 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-09T06:41:19.945 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-09T06:41:19.945 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T06:41:19.945 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-09T06:41:19.945 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-09T06:41:19.945 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T06:41:19.945 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-09T06:41:19.945 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-09T06:41:19.945 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-09T06:41:19.945 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-09T06:41:19.946 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-09T06:41:19.946 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-09T06:41:19.946 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-09T06:41:19.946 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-09T06:41:19.946 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-09T06:41:19.946 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-09T06:41:19.946 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-09T06:41:19.946 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-09T06:41:19.946 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-09T06:41:19.946 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-09T06:41:19.955 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-09T06:41:19.955 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-09T06:41:19.955 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-09T06:41:19.956 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-09T06:41:19.956 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-09T06:41:19.956 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-09T06:41:19.956 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-09T06:41:19.956 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-09T06:41:19.956 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-09T06:41:19.956 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-09T06:41:19.956 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-09T06:41:19.956 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-09T06:41:19.956 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-09T06:41:19.957 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-09T06:41:19.957 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-09T06:41:19.957 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-09T06:41:19.957 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-09T06:41:19.957 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-09T06:41:19.957 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-09T06:41:19.957 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-09T06:41:19.958 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-09T06:41:19.958 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-09T06:41:19.958 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-09T06:41:19.958 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-09T06:41:19.958 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-09T06:41:19.958 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-09T06:41:19.958 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-09T06:41:19.958 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-09T06:41:19.958 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-09T06:41:19.958 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-09T06:41:19.958 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-09T06:41:19.959 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-09T06:41:19.959 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-09T06:41:19.959 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-09T06:41:19.959 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-09T06:41:19.959 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-09T06:41:19.959 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-09T06:41:19.959 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-09T06:41:19.959 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-09T06:41:19.959 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-09T06:41:19.959 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-09T06:41:19.959 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-09T06:41:19.960 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-09T06:41:19.960 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-09T06:41:19.960 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-09T06:41:19.960 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-09T06:41:19.960 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-09T06:41:19.960 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-09T06:41:19.960 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-09T06:41:19.960 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-09T06:41:19.960 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-09T06:41:19.960 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-09T06:41:19.960 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-09T06:41:19.960 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-09T06:41:19.961 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-09T06:41:19.961 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-09T06:41:19.961 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-09T06:41:19.961 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-09T06:41:19.961 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-09T06:41:19.961 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-09T06:41:19.961 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-09T06:41:19.961 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-09T06:41:19.961 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-09T06:41:19.961 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-09T06:41:19.961 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-09T06:41:19.962 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-09T06:41:19.962 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-09T06:41:19.962 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-09T06:41:19.962 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-09T06:41:19.962 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-09T06:41:19.962 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-09T06:41:19.962 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-09T06:41:19.962 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-09T06:41:19.962 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-09T06:41:19.962 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-09T06:41:19.963 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-09T06:41:19.963 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-09T06:41:19.963 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-09T06:41:19.963 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-09T06:41:19.963 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-09T06:41:19.963 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-09T06:41:19.963 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-09T06:41:19.963 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-09T06:41:19.963 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-09T06:41:19.963 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-09T06:41:19.963 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-09T06:41:19.963 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-09T06:41:19.964 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-09T06:41:19.964 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-09T06:41:19.964 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-09T06:41:19.964 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-09T06:41:19.964 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-09T06:41:19.964 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-09T06:41:19.964 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-09T06:41:20.825 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T06:41:20.826 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:54 ago on Mon 09 Oct 2023 06:39:26 AM UTC. 2023-10-09T06:41:22.290 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T06:41:22.291 INFO:teuthology.orchestra.run.smithi179.stdout:Last metadata expiration check: 0:01:57 ago on Mon 09 Oct 2023 06:39:25 AM UTC. 2023-10-09T06:41:23.020 INFO:teuthology.orchestra.run.smithi071.stdout:Installed products updated. 2023-10-09T06:41:23.151 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:23.151 INFO:teuthology.orchestra.run.smithi071.stdout:Upgraded: 2023-10-09T06:41:23.152 INFO:teuthology.orchestra.run.smithi071.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.152 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.152 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2023-10-09T06:41:23.152 INFO:teuthology.orchestra.run.smithi071.stdout: automake-1.16.1-7.el8.noarch 2023-10-09T06:41:23.152 INFO:teuthology.orchestra.run.smithi071.stdout: bison-3.0.4-10.el8.x86_64 2023-10-09T06:41:23.152 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.152 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.152 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.152 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.153 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:41:23.153 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.153 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.153 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.153 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:41:23.153 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:41:23.153 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:41:23.153 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:41:23.154 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:41:23.154 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.154 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.154 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:41:23.154 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.154 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.154 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.154 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:41:23.154 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:41:23.154 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:41:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-09T06:41:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: flex-2.6.1-9.el8.x86_64 2023-10-09T06:41:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-09T06:41:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-09T06:41:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: jq-1.5-12.el8.x86_64 2023-10-09T06:41:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-09T06:41:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-09T06:41:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-09T06:41:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-09T06:41:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-09T06:41:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-09T06:41:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-09T06:41:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-09T06:41:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-09T06:41:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-09T06:41:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-09T06:41:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-09T06:41:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-09T06:41:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-09T06:41:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-09T06:41:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-09T06:41:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-09T06:41:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-09T06:41:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-09T06:41:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-09T06:41:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-09T06:41:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-09T06:41:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-09T06:41:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-09T06:41:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-09T06:41:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-09T06:41:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-09T06:41:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-09T06:41:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-09T06:41:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-09T06:41:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-09T06:41:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-09T06:41:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-09T06:41:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-09T06:41:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-09T06:41:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-09T06:41:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-09T06:41:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-09T06:41:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-09T06:41:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-09T06:41:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-09T06:41:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-09T06:41:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-09T06:41:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-09T06:41:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-09T06:41:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-09T06:41:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-09T06:41:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-09T06:41:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend-2.6-1.el8.noarch 2023-10-09T06:41:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-09T06:41:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-09T06:41:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-09T06:41:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-09T06:41:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-09T06:41:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-09T06:41:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-09T06:41:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-09T06:41:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-09T06:41:23.162 INFO:teuthology.orchestra.run.smithi071.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-09T06:41:23.162 INFO:teuthology.orchestra.run.smithi071.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-09T06:41:23.162 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-09T06:41:23.162 INFO:teuthology.orchestra.run.smithi071.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-09T06:41:23.162 INFO:teuthology.orchestra.run.smithi071.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-09T06:41:23.162 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-09T06:41:23.162 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-09T06:41:23.162 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-09T06:41:23.162 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-09T06:41:23.163 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-09T06:41:23.163 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.163 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.163 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:23.163 INFO:teuthology.orchestra.run.smithi071.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-09T06:41:23.163 INFO:teuthology.orchestra.run.smithi071.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-09T06:41:23.163 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-09T06:41:23.163 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-09T06:41:23.164 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-09T06:41:23.164 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:23.164 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-09T06:41:23.490 DEBUG:teuthology.parallel:result is None 2023-10-09T06:41:24.445 INFO:teuthology.orchestra.run.smithi179.stdout:Installed products updated. 2023-10-09T06:41:24.576 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:24.576 INFO:teuthology.orchestra.run.smithi179.stdout:Upgraded: 2023-10-09T06:41:24.576 INFO:teuthology.orchestra.run.smithi179.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.576 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.576 INFO:teuthology.orchestra.run.smithi179.stdout:Installed: 2023-10-09T06:41:24.576 INFO:teuthology.orchestra.run.smithi179.stdout: automake-1.16.1-7.el8.noarch 2023-10-09T06:41:24.577 INFO:teuthology.orchestra.run.smithi179.stdout: bison-3.0.4-10.el8.x86_64 2023-10-09T06:41:24.577 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.577 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.577 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.577 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.577 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:41:24.577 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.577 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.577 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.577 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:41:24.577 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:41:24.578 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:41:24.578 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:41:24.578 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:41:24.578 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.578 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.578 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:41:24.578 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.578 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.578 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.578 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:41:24.578 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:41:24.579 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.579 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T06:41:24.579 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-09T06:41:24.579 INFO:teuthology.orchestra.run.smithi179.stdout: flex-2.6.1-9.el8.x86_64 2023-10-09T06:41:24.579 INFO:teuthology.orchestra.run.smithi179.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-09T06:41:24.579 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-09T06:41:24.579 INFO:teuthology.orchestra.run.smithi179.stdout: jq-1.5-12.el8.x86_64 2023-10-09T06:41:24.579 INFO:teuthology.orchestra.run.smithi179.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-09T06:41:24.579 INFO:teuthology.orchestra.run.smithi179.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-09T06:41:24.579 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-09T06:41:24.579 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.579 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.580 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.580 INFO:teuthology.orchestra.run.smithi179.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-09T06:41:24.580 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-09T06:41:24.580 INFO:teuthology.orchestra.run.smithi179.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-09T06:41:24.580 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-09T06:41:24.580 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-09T06:41:24.580 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.580 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.580 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-09T06:41:24.580 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.580 INFO:teuthology.orchestra.run.smithi179.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-09T06:41:24.580 INFO:teuthology.orchestra.run.smithi179.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-09T06:41:24.581 INFO:teuthology.orchestra.run.smithi179.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-09T06:41:24.581 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-09T06:41:24.581 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-09T06:41:24.581 INFO:teuthology.orchestra.run.smithi179.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-09T06:41:24.581 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-09T06:41:24.581 INFO:teuthology.orchestra.run.smithi179.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-09T06:41:24.581 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-09T06:41:24.581 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-09T06:41:24.581 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-09T06:41:24.581 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-09T06:41:24.581 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-09T06:41:24.582 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-09T06:41:24.582 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-09T06:41:24.582 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-09T06:41:24.582 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-09T06:41:24.582 INFO:teuthology.orchestra.run.smithi179.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-09T06:41:24.582 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-09T06:41:24.582 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.582 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.582 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.582 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-09T06:41:24.582 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-09T06:41:24.583 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-09T06:41:24.583 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-09T06:41:24.583 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-09T06:41:24.583 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-09T06:41:24.583 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-09T06:41:24.583 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-09T06:41:24.583 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-09T06:41:24.583 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-09T06:41:24.583 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-09T06:41:24.583 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-09T06:41:24.583 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-09T06:41:24.583 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-09T06:41:24.584 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-09T06:41:24.584 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-09T06:41:24.584 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-09T06:41:24.584 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-09T06:41:24.584 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-09T06:41:24.584 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-09T06:41:24.584 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend-2.6-1.el8.noarch 2023-10-09T06:41:24.584 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-09T06:41:24.584 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-09T06:41:24.584 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-09T06:41:24.584 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-09T06:41:24.584 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.585 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.585 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-09T06:41:24.585 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-09T06:41:24.585 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.585 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-09T06:41:24.585 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-09T06:41:24.585 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-09T06:41:24.585 INFO:teuthology.orchestra.run.smithi179.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-09T06:41:24.585 INFO:teuthology.orchestra.run.smithi179.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-09T06:41:24.585 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-09T06:41:24.585 INFO:teuthology.orchestra.run.smithi179.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-09T06:41:24.586 INFO:teuthology.orchestra.run.smithi179.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-09T06:41:24.586 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-09T06:41:24.586 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-09T06:41:24.586 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-09T06:41:24.586 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-09T06:41:24.586 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-09T06:41:24.586 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.586 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.586 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T06:41:24.586 INFO:teuthology.orchestra.run.smithi179.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-09T06:41:24.586 INFO:teuthology.orchestra.run.smithi179.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-09T06:41:24.587 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-09T06:41:24.587 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-09T06:41:24.587 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-09T06:41:24.587 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:24.587 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2023-10-09T06:41:24.890 DEBUG:teuthology.parallel:result is None 2023-10-09T06:41:24.891 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T06:41:25.112 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-09T06:41:25.158 INFO:teuthology.orchestra.run.smithi071.stdout:17.2.6-1320.g08cac018.el8 2023-10-09T06:41:25.159 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-09T06:41:25.159 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-09T06:41:25.159 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T06:41:25.302 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-09T06:41:25.350 INFO:teuthology.orchestra.run.smithi179.stdout:17.2.6-1320.g08cac018.el8 2023-10-09T06:41:25.351 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-09T06:41:25.351 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-09T06:41:25.351 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-09T06:41:25.351 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:41:25.351 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-09T06:41:25.432 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-09T06:41:25.433 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-09T06:41:25.513 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-09T06:41:25.514 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:41:25.514 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/daemon-helper 2023-10-09T06:41:25.573 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-09T06:41:25.675 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-09T06:41:25.675 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/daemon-helper 2023-10-09T06:41:25.738 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-09T06:41:25.840 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-09T06:41:25.840 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:41:25.840 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-09T06:41:25.901 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-09T06:41:26.001 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-09T06:41:26.002 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-09T06:41:26.065 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-09T06:41:26.168 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-09T06:41:26.169 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:41:26.169 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/stdin-killer 2023-10-09T06:41:26.230 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-09T06:41:26.329 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-09T06:41:26.330 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/stdin-killer 2023-10-09T06:41:26.393 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-09T06:41:26.494 INFO:teuthology.run_tasks:Running task ceph... 2023-10-09T06:41:26.561 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-09T06:41:26.561 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /var/log/ceph 2023-10-09T06:41:26.565 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 777 /var/log/ceph 2023-10-09T06:41:26.625 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-09T06:41:26.625 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-09T06:41:26.629 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-09T06:41:26.689 INFO:tasks.ceph:Creating extra log directories... 2023-10-09T06:41:26.689 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-09T06:41:26.694 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-09T06:41:26.760 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-09T06:41:26.761 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-09T06:41:26.761 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-09T06:41:26.761 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:41:26.761 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-09T06:41:26.796 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-09T06:41:27.537 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-09T06:41:27.605 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-09T06:41:27.605 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-09T06:41:27.642 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-09T06:41:28.581 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-09T06:41:28.653 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-09T06:41:28.653 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-09T06:41:28.654 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418378', 'branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7418378', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-06-0949-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20231009.053123', 'sha1': '62a27f0d8453e2104f759ed08ba781e24c5ed056'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 30, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8174, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20231009.053123', 'suite_path': '/home/teuthworker/src/github.com_vshankar_ceph_62a27f0d8453e2104f759ed08ba781e24c5ed056/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/vshankar/ceph.git', 'suite_sha1': '62a27f0d8453e2104f759ed08ba781e24c5ed056', 'targets': {'smithi071.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIRJ4qdiIKOm6ZBaxD08Dwdvukm3DT3qdA2DfHnyFLPGYl92IveRjBn6erkhNm843iVuL8hVdADiSgBNrFomEVg=', 'smithi179.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEnRlHUHakBP4LvTw/XdcGQUfDtTX9A81YyPazj2kbMbDrSdwTKfcH6UUpEyvmwY6Xe0P/7RwCnyNSPbv/m769k='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-09_05:36:44', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-09T06:41:28.654 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-09T06:41:28.659 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-09T06:41:28.697 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/run/ceph 2023-10-09T06:41:28.740 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/run/ceph 2023-10-09T06:41:28.802 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:41:28.802 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/scratch_devs of=/dev/stdout 2023-10-09T06:41:28.839 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-09T06:41:28.839 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 2023-10-09T06:41:28.915 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-09T06:41:28.916 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T06:41:28.916 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-10-09T06:41:28.916 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T06:41:28.916 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T06:41:28.916 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2023-10-09 06:41:17.967212711 +0000 2023-10-09T06:41:28.916 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2023-10-09 06:38:28.239092063 +0000 2023-10-09T06:41:28.916 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2023-10-09 06:38:28.239092063 +0000 2023-10-09T06:41:28.916 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2023-10-09T06:41:28.916 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-09T06:41:29.013 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2023-10-09T06:41:29.013 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2023-10-09T06:41:29.013 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000374525 s, 1.4 MB/s 2023-10-09T06:41:29.015 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-09T06:41:29.054 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 2023-10-09T06:41:29.130 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-09T06:41:29.130 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T06:41:29.130 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-10-09T06:41:29.130 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T06:41:29.130 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T06:41:29.130 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2023-10-09 06:41:17.967212711 +0000 2023-10-09T06:41:29.130 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2023-10-09 06:38:29.010078152 +0000 2023-10-09T06:41:29.130 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2023-10-09 06:38:29.010078152 +0000 2023-10-09T06:41:29.130 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2023-10-09T06:41:29.131 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-09T06:41:29.226 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2023-10-09T06:41:29.227 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2023-10-09T06:41:29.227 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000312745 s, 1.6 MB/s 2023-10-09T06:41:29.229 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-09T06:41:29.266 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 2023-10-09T06:41:29.343 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-09T06:41:29.343 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T06:41:29.343 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-10-09T06:41:29.343 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T06:41:29.343 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T06:41:29.343 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2023-10-09 06:41:17.967212711 +0000 2023-10-09T06:41:29.343 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2023-10-09 06:38:29.778064295 +0000 2023-10-09T06:41:29.343 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2023-10-09 06:38:29.778064295 +0000 2023-10-09T06:41:29.344 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2023-10-09T06:41:29.344 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-09T06:41:29.440 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2023-10-09T06:41:29.440 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2023-10-09T06:41:29.440 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000339413 s, 1.5 MB/s 2023-10-09T06:41:29.443 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-09T06:41:29.480 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 2023-10-09T06:41:29.557 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-09T06:41:29.558 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T06:41:29.558 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-10-09T06:41:29.558 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T06:41:29.558 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T06:41:29.558 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2023-10-09 06:41:17.968212694 +0000 2023-10-09T06:41:29.558 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2023-10-09 06:38:30.733047064 +0000 2023-10-09T06:41:29.558 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2023-10-09 06:38:30.733047064 +0000 2023-10-09T06:41:29.558 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2023-10-09T06:41:29.559 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-09T06:41:29.654 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2023-10-09T06:41:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2023-10-09T06:41:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000307637 s, 1.7 MB/s 2023-10-09T06:41:29.657 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-09T06:41:29.695 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T06:41:29.697 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-09T06:41:29.697 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/scratch_devs of=/dev/stdout 2023-10-09T06:41:29.735 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-09T06:41:29.735 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_1 2023-10-09T06:41:29.813 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-09T06:41:29.813 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T06:41:29.814 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-10-09T06:41:29.814 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T06:41:29.814 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T06:41:29.814 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-10-09 06:41:19.395336062 +0000 2023-10-09T06:41:29.814 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-10-09 06:38:31.245756707 +0000 2023-10-09T06:41:29.814 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-10-09 06:38:31.245756707 +0000 2023-10-09T06:41:29.814 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2023-10-09T06:41:29.814 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-09T06:41:29.912 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-10-09T06:41:29.913 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-10-09T06:41:29.913 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000342166 s, 1.5 MB/s 2023-10-09T06:41:29.915 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-09T06:41:29.953 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_2 2023-10-09T06:41:30.030 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-09T06:41:30.030 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T06:41:30.031 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-10-09T06:41:30.031 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T06:41:30.031 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T06:41:30.031 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-10-09 06:41:19.396336041 +0000 2023-10-09T06:41:30.031 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-10-09 06:38:32.027740584 +0000 2023-10-09T06:41:30.031 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-10-09 06:38:32.027740584 +0000 2023-10-09T06:41:30.031 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2023-10-09T06:41:30.032 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-09T06:41:30.127 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-10-09T06:41:30.127 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-10-09T06:41:30.127 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000322632 s, 1.6 MB/s 2023-10-09T06:41:30.129 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-09T06:41:30.167 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_3 2023-10-09T06:41:30.244 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-09T06:41:30.244 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T06:41:30.244 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-10-09T06:41:30.244 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T06:41:30.244 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T06:41:30.244 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-10-09 06:41:19.396336041 +0000 2023-10-09T06:41:30.244 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-10-09 06:38:32.792724810 +0000 2023-10-09T06:41:30.244 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-10-09 06:38:32.792724810 +0000 2023-10-09T06:41:30.245 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2023-10-09T06:41:30.245 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-09T06:41:30.341 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-10-09T06:41:30.341 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-10-09T06:41:30.341 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000320366 s, 1.6 MB/s 2023-10-09T06:41:30.343 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-09T06:41:30.381 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_4 2023-10-09T06:41:30.458 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-09T06:41:30.459 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T06:41:30.459 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-10-09T06:41:30.459 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T06:41:30.459 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T06:41:30.459 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-10-09 06:41:19.396336041 +0000 2023-10-09T06:41:30.459 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-10-09 06:38:33.612707903 +0000 2023-10-09T06:41:30.459 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-10-09 06:38:33.612707903 +0000 2023-10-09T06:41:30.459 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2023-10-09T06:41:30.460 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-09T06:41:30.556 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-10-09T06:41:30.556 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-10-09T06:41:30.556 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000321935 s, 1.6 MB/s 2023-10-09T06:41:30.559 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-09T06:41:30.596 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T06:41:30.596 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-09T06:41:30.596 INFO:tasks.ceph:Generating config... 2023-10-09T06:41:30.598 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-09T06:41:30.598 INFO:tasks.ceph:[client] debug client = 20 2023-10-09T06:41:30.598 INFO:tasks.ceph:[client] debug ms = 1 2023-10-09T06:41:30.598 INFO:tasks.ceph:[client] pid file = 2023-10-09T06:41:30.598 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-09T06:41:30.598 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-09T06:41:30.598 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-09T06:41:30.598 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-09T06:41:30.598 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-09T06:41:30.598 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-09T06:41:30.598 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-09T06:41:30.599 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-09T06:41:30.599 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-09T06:41:30.599 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-09T06:41:30.599 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-09T06:41:30.599 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-09T06:41:30.599 INFO:tasks.ceph:[mgr] debug client = 20 2023-10-09T06:41:30.599 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-10-09T06:41:30.599 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-09T06:41:30.599 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-09T06:41:30.599 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-09T06:41:30.599 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-09T06:41:30.599 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-09T06:41:30.600 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-09T06:41:30.600 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-09T06:41:30.600 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-09T06:41:30.600 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-09T06:41:30.600 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-09T06:41:30.600 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-09T06:41:30.600 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-09T06:41:30.600 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-09T06:41:30.600 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-09T06:41:30.600 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-09T06:41:30.600 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-09T06:41:30.601 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-09T06:41:30.601 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-09T06:41:30.601 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-09T06:41:30.601 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-09T06:41:30.601 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-09T06:41:30.601 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-09T06:41:30.601 INFO:tasks.ceph:Setting up mon.a... 2023-10-09T06:41:30.601 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-09T06:41:30.698 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.keyring 2023-10-09T06:41:30.703 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-09T06:41:30.789 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-09T06:41:30.849 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.71'), ('mon.b', '172.21.15.179'), ('mon.c', '[v2:172.21.15.179:3301,v1:172.21.15.179:6790]')] 2023-10-09T06:41:30.849 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.71,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-09T06:41:30.850 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:41:30.850 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-09T06:41:30.885 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.71 --add b 172.21.15.179 --addv c '[v2:172.21.15.179:3301,v1:172.21.15.179:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:41:30.998 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:41:30.999 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: generated fsid 604c5619-653a-4ab6-912c-ab2e5464fe4a 2023-10-09T06:41:30.999 INFO:teuthology.orchestra.run.smithi071.stdout:setting min_mon_release = octopus 2023-10-09T06:41:30.999 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 0 2023-10-09T06:41:30.999 INFO:teuthology.orchestra.run.smithi071.stdout:fsid 604c5619-653a-4ab6-912c-ab2e5464fe4a 2023-10-09T06:41:30.999 INFO:teuthology.orchestra.run.smithi071.stdout:last_changed 2023-10-09T06:41:30.999087+0000 2023-10-09T06:41:30.999 INFO:teuthology.orchestra.run.smithi071.stdout:created 2023-10-09T06:41:30.999087+0000 2023-10-09T06:41:30.999 INFO:teuthology.orchestra.run.smithi071.stdout:min_mon_release 15 (octopus) 2023-10-09T06:41:30.999 INFO:teuthology.orchestra.run.smithi071.stdout:election_strategy: 1 2023-10-09T06:41:30.999 INFO:teuthology.orchestra.run.smithi071.stdout:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2023-10-09T06:41:30.999 INFO:teuthology.orchestra.run.smithi071.stdout:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2023-10-09T06:41:30.999 INFO:teuthology.orchestra.run.smithi071.stdout:2: [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] mon.c 2023-10-09T06:41:31.000 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-09T06:41:31.001 DEBUG:teuthology.orchestra.run.smithi071:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-09T06:41:31.036 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 604c5619-653a-4ab6-912c-ab2e5464fe4a... 2023-10-09T06:41:31.037 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-09T06:41:31.080 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-09T06:41:31.185 INFO:teuthology.orchestra.run.smithi071.stdout:[global] 2023-10-09T06:41:31.185 INFO:teuthology.orchestra.run.smithi071.stdout: chdir = "" 2023-10-09T06:41:31.185 INFO:teuthology.orchestra.run.smithi071.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-09T06:41:31.185 INFO:teuthology.orchestra.run.smithi071.stdout: auth supported = cephx 2023-10-09T06:41:31.185 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.185 INFO:teuthology.orchestra.run.smithi071.stdout: filestore xattr use omap = true 2023-10-09T06:41:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: mon clock drift allowed = 1.000 2023-10-09T06:41:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: osd crush chooseleaf type = 0 2023-10-09T06:41:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: auth debug = true 2023-10-09T06:41:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on old message = true 2023-10-09T06:41:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on bug = true 2023-10-09T06:41:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-09T06:41:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: mon pg warn max object skew = 0 2023-10-09T06:41:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: # disable pg_autoscaler by default for new pools 2023-10-09T06:41:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-09T06:41:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default size = 2 2023-10-09T06:41:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow primary affinity = true 2023-10-09T06:41:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow pg remap = true 2023-10-09T06:41:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on legacy crush tunables = false 2023-10-09T06:41:31.188 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on crush straw calc version zero = false 2023-10-09T06:41:31.188 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on no sortbitwise = false 2023-10-09T06:41:31.188 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on osd down out interval zero = false 2023-10-09T06:41:31.188 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on too few osds = false 2023-10-09T06:41:31.188 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-09T06:41:31.188 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-09T06:41:31.188 INFO:teuthology.orchestra.run.smithi071.stdout: mon_allow_pool_size_one = true 2023-10-09T06:41:31.188 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.188 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-09T06:41:31.188 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.188 INFO:teuthology.orchestra.run.smithi071.stdout: osd default data pool replay window = 5 2023-10-09T06:41:31.189 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.189 INFO:teuthology.orchestra.run.smithi071.stdout: mon allow pool delete = true 2023-10-09T06:41:31.189 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.189 INFO:teuthology.orchestra.run.smithi071.stdout: mon cluster log file level = debug 2023-10-09T06:41:31.189 INFO:teuthology.orchestra.run.smithi071.stdout: debug asserts on shutdown = true 2023-10-09T06:41:31.189 INFO:teuthology.orchestra.run.smithi071.stdout: mon health detail to clog = false 2023-10-09T06:41:31.189 INFO:teuthology.orchestra.run.smithi071.stdout: mon host = "172.21.15.71,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2023-10-09T06:41:31.189 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on skipped message = False 2023-10-09T06:41:31.189 INFO:teuthology.orchestra.run.smithi071.stdout: fsid = 604c5619-653a-4ab6-912c-ab2e5464fe4a 2023-10-09T06:41:31.189 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.189 INFO:teuthology.orchestra.run.smithi071.stdout:[osd] 2023-10-09T06:41:31.190 INFO:teuthology.orchestra.run.smithi071.stdout: osd journal size = 100 2023-10-09T06:41:31.190 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.190 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub load threshold = 5.0 2023-10-09T06:41:31.190 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub max interval = 600 2023-10-09T06:41:31.190 INFO:teuthology.orchestra.run.smithi071.stdout: osd mclock profile = high_recovery_ops 2023-10-09T06:41:31.190 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.190 INFO:teuthology.orchestra.run.smithi071.stdout: osd recover clone overlap = true 2023-10-09T06:41:31.190 INFO:teuthology.orchestra.run.smithi071.stdout: osd recovery max chunk = 1048576 2023-10-09T06:41:31.190 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.190 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug shutdown = true 2023-10-09T06:41:31.190 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug op order = true 2023-10-09T06:41:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug verify stray on activate = true 2023-10-09T06:41:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: osd open classes on start = true 2023-10-09T06:41:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug pg log writeout = true 2023-10-09T06:41:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: osd deep scrub update digest min age = 30 2023-10-09T06:41:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: osd map max advance = 10 2023-10-09T06:41:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: journal zero on create = true 2023-10-09T06:41:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: filestore ondisk finisher threads = 3 2023-10-09T06:41:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: filestore apply finisher threads = 3 2023-10-09T06:41:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: bdev debug aio = true 2023-10-09T06:41:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug misdirected ops = true 2023-10-09T06:41:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: bdev async discard = True 2023-10-09T06:41:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: bdev enable discard = True 2023-10-09T06:41:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore allocator = bitmap 2023-10-09T06:41:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore block size = 96636764160 2023-10-09T06:41:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore fsck on mount = True 2023-10-09T06:41:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluefs = 1/20 2023-10-09T06:41:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluestore = 1/20 2023-10-09T06:41:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2023-10-09T06:41:31.193 INFO:teuthology.orchestra.run.smithi071.stdout: debug osd = 20 2023-10-09T06:41:31.193 INFO:teuthology.orchestra.run.smithi071.stdout: debug rocksdb = 4/10 2023-10-09T06:41:31.193 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd backfillfull_ratio = 0.85 2023-10-09T06:41:31.193 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd full ratio = 0.9 2023-10-09T06:41:31.193 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd nearfull ratio = 0.8 2023-10-09T06:41:31.193 INFO:teuthology.orchestra.run.smithi071.stdout: osd failsafe full ratio = 0.95 2023-10-09T06:41:31.193 INFO:teuthology.orchestra.run.smithi071.stdout: osd objectstore = bluestore 2023-10-09T06:41:31.193 INFO:teuthology.orchestra.run.smithi071.stdout: osd op complaint time = 180 2023-10-09T06:41:31.193 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.193 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr] 2023-10-09T06:41:31.193 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2023-10-09T06:41:31.193 INFO:teuthology.orchestra.run.smithi071.stdout: debug mgr = 20 2023-10-09T06:41:31.194 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2023-10-09T06:41:31.194 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2023-10-09T06:41:31.194 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2023-10-09T06:41:31.194 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2023-10-09T06:41:31.194 INFO:teuthology.orchestra.run.smithi071.stdout: mgr/telemetry/nag = false 2023-10-09T06:41:31.194 INFO:teuthology.orchestra.run.smithi071.stdout: debug client = 20 2023-10-09T06:41:31.194 INFO:teuthology.orchestra.run.smithi071.stdout: debug finisher = 20 2023-10-09T06:41:31.194 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.194 INFO:teuthology.orchestra.run.smithi071.stdout:[mon] 2023-10-09T06:41:31.194 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2023-10-09T06:41:31.194 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2023-10-09T06:41:31.195 INFO:teuthology.orchestra.run.smithi071.stdout: debug paxos = 20 2023-10-09T06:41:31.195 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2023-10-09T06:41:31.195 INFO:teuthology.orchestra.run.smithi071.stdout: mon data avail warn = 5 2023-10-09T06:41:31.195 INFO:teuthology.orchestra.run.smithi071.stdout: mon mgr mkfs grace = 240 2023-10-09T06:41:31.195 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2023-10-09T06:41:31.195 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd reporter subtree level = osd 2023-10-09T06:41:31.195 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd prime pg temp = true 2023-10-09T06:41:31.195 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2023-10-09T06:41:31.195 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.195 INFO:teuthology.orchestra.run.smithi071.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-09T06:41:31.195 INFO:teuthology.orchestra.run.smithi071.stdout: auth mon ticket ttl = 660 # 11m 2023-10-09T06:41:31.195 INFO:teuthology.orchestra.run.smithi071.stdout: auth service ticket ttl = 240 # 4m 2023-10-09T06:41:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: # don't complain about insecure global_id in the test suite 2023-10-09T06:41:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-09T06:41:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-09T06:41:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: # 1m isn't quite enough 2023-10-09T06:41:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: mon_down_mkfs_grace = 2m 2023-10-09T06:41:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_filestore_osds = false 2023-10-09T06:41:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: mon op complaint time = 120 2023-10-09T06:41:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:41:31.196 INFO:teuthology.orchestra.run.smithi071.stdout:[client] 2023-10-09T06:41:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: rgw cache enabled = true 2023-10-09T06:41:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable ops log = true 2023-10-09T06:41:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable usage log = true 2023-10-09T06:41:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-09T06:41:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-09T06:41:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: client mount timeout = 600 2023-10-09T06:41:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: debug client = 20 2023-10-09T06:41:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2023-10-09T06:41:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: pid file = "" 2023-10-09T06:41:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: rados mon op timeout = 900 2023-10-09T06:41:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: rados osd op timeout = 900 2023-10-09T06:41:31.197 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.a] 2023-10-09T06:41:31.198 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.b] 2023-10-09T06:41:31.198 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.c] 2023-10-09T06:41:31.198 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.a] 2023-10-09T06:41:31.198 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.c] 2023-10-09T06:41:31.198 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.b] 2023-10-09T06:41:31.198 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.d] 2023-10-09T06:41:31.198 INFO:teuthology.orchestra.run.smithi071.stdout:[mds] 2023-10-09T06:41:31.198 INFO:teuthology.orchestra.run.smithi071.stdout: debug mds = 20 2023-10-09T06:41:31.198 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2023-10-09T06:41:31.198 INFO:teuthology.orchestra.run.smithi071.stdout: mds debug frag = True 2023-10-09T06:41:31.198 INFO:teuthology.orchestra.run.smithi071.stdout: mds debug scatterstat = True 2023-10-09T06:41:31.199 INFO:teuthology.orchestra.run.smithi071.stdout: mds op complaint time = 180 2023-10-09T06:41:31.199 INFO:teuthology.orchestra.run.smithi071.stdout: mds verify scatter = True 2023-10-09T06:41:31.199 INFO:teuthology.orchestra.run.smithi071.stdout: osd op complaint time = 180 2023-10-09T06:41:31.199 INFO:teuthology.orchestra.run.smithi071.stdout: rados mon op timeout = 900 2023-10-09T06:41:31.199 INFO:teuthology.orchestra.run.smithi071.stdout: rados osd op timeout = 900 2023-10-09T06:41:31.199 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2023-10-09T06:41:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2023-10-09T06:41:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-09T06:41:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2023-10-09T06:41:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2023-10-09T06:41:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2023-10-09T06:41:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2023-10-09T06:41:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2023-10-09T06:41:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2023-10-09T06:41:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2023-10-09T06:41:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-09T06:41:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2023-10-09T06:41:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2023-10-09T06:41:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-09T06:41:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2023-10-09T06:41:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2023-10-09T06:41:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2023-10-09T06:41:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2023-10-09T06:41:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2023-10-09T06:41:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2023-10-09T06:41:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2023-10-09T06:41:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2023-10-09T06:41:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-09T06:41:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-09T06:41:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2023-10-09T06:41:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-09T06:41:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2023-10-09T06:41:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2023-10-09T06:41:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2023-10-09T06:41:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2023-10-09T06:41:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2023-10-09T06:41:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.71,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2023-10-09T06:41:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on skipped message = False 2023-10-09T06:41:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = 604c5619-653a-4ab6-912c-ab2e5464fe4a 2023-10-09T06:41:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.203 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2023-10-09T06:41:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2023-10-09T06:41:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2023-10-09T06:41:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2023-10-09T06:41:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2023-10-09T06:41:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2023-10-09T06:41:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2023-10-09T06:41:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2023-10-09T06:41:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2023-10-09T06:41:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2023-10-09T06:41:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2023-10-09T06:41:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2023-10-09T06:41:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2023-10-09T06:41:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2023-10-09T06:41:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2023-10-09T06:41:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2023-10-09T06:41:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2023-10-09T06:41:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2023-10-09T06:41:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2023-10-09T06:41:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: bdev async discard = True 2023-10-09T06:41:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: bdev enable discard = True 2023-10-09T06:41:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore allocator = bitmap 2023-10-09T06:41:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2023-10-09T06:41:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2023-10-09T06:41:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 1/20 2023-10-09T06:41:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 1/20 2023-10-09T06:41:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-10-09T06:41:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2023-10-09T06:41:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 4/10 2023-10-09T06:41:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2023-10-09T06:41:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2023-10-09T06:41:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2023-10-09T06:41:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2023-10-09T06:41:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2023-10-09T06:41:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2023-10-09T06:41:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.207 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2023-10-09T06:41:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-10-09T06:41:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2023-10-09T06:41:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2023-10-09T06:41:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2023-10-09T06:41:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2023-10-09T06:41:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2023-10-09T06:41:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2023-10-09T06:41:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2023-10-09T06:41:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: debug finisher = 20 2023-10-09T06:41:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.208 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2023-10-09T06:41:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-10-09T06:41:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2023-10-09T06:41:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2023-10-09T06:41:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2023-10-09T06:41:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2023-10-09T06:41:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2023-10-09T06:41:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2023-10-09T06:41:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2023-10-09T06:41:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2023-10-09T06:41:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2023-10-09T06:41:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-09T06:41:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2023-10-09T06:41:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2023-10-09T06:41:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2023-10-09T06:41:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-09T06:41:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-09T06:41:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2023-10-09T06:41:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2023-10-09T06:41:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2023-10-09T06:41:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: mon op complaint time = 120 2023-10-09T06:41:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-10-09T06:41:31.210 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2023-10-09T06:41:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2023-10-09T06:41:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2023-10-09T06:41:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2023-10-09T06:41:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-09T06:41:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-09T06:41:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: client mount timeout = 600 2023-10-09T06:41:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2023-10-09T06:41:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-10-09T06:41:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = "" 2023-10-09T06:41:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2023-10-09T06:41:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2023-10-09T06:41:31.212 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2023-10-09T06:41:31.212 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2023-10-09T06:41:31.212 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2023-10-09T06:41:31.212 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2023-10-09T06:41:31.212 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2023-10-09T06:41:31.212 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2023-10-09T06:41:31.212 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2023-10-09T06:41:31.212 INFO:teuthology.orchestra.run.smithi179.stdout:[mds] 2023-10-09T06:41:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds = 20 2023-10-09T06:41:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-10-09T06:41:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug frag = True 2023-10-09T06:41:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug scatterstat = True 2023-10-09T06:41:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: mds op complaint time = 180 2023-10-09T06:41:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: mds verify scatter = True 2023-10-09T06:41:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2023-10-09T06:41:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2023-10-09T06:41:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2023-10-09T06:41:31.221 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-09T06:41:31.221 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-09T06:41:31.318 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-09T06:41:31.318 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:41:31.318 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-09T06:41:31.353 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:41:31.353 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-09T06:41:31.428 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T06:41:31.429 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:41:31.429 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-09T06:41:31.429 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-09T06:41:31.553 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:41:31.554 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:41:31.630 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi179.front.sepia.ceph.com 2023-10-09T06:41:31.630 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-09T06:41:31.630 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-09T06:41:31.630 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-09T06:41:31.717 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-09T06:41:31.718 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:41:31.793 INFO:tasks.ceph:Setting up mon nodes... 2023-10-09T06:41:31.793 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-09T06:41:31.794 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-09T06:41:31.902 INFO:teuthology.orchestra.run.smithi071.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-09T06:41:31.908 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-09T06:41:32.041 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-09T06:41:32.047 INFO:tasks.ceph:Setting up mds nodes... 2023-10-09T06:41:32.047 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-09T06:41:32.155 INFO:teuthology.orchestra.run.smithi071.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-09T06:41:32.160 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-09T06:41:32.220 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-09T06:41:32.328 INFO:teuthology.orchestra.run.smithi071.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-09T06:41:32.333 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-09T06:41:32.393 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-09T06:41:32.504 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-09T06:41:32.511 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-09T06:41:32.571 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-09T06:41:32.680 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-09T06:41:32.684 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-09T06:41:32.744 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-09T06:41:32.744 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-09T06:41:32.831 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-09T06:41:32.862 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-09T06:41:32.943 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-09T06:41:32.974 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-09T06:41:33.057 INFO:teuthology.orchestra.run.smithi179.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-09T06:41:33.088 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-09T06:41:33.170 INFO:teuthology.orchestra.run.smithi179.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-09T06:41:33.201 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-09T06:41:33.201 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-09T06:41:33.201 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-09T06:41:33.262 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T06:41:33.262 INFO:tasks.ceph:role: osd.0 2023-10-09T06:41:33.263 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T06:41:33.263 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-09T06:41:33.330 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T06:41:33.331 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T06:41:33.331 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T06:41:33.331 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 2023-10-09T06:41:33.331 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T06:41:33.331 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2023-10-09T06:41:33.331 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T06:41:33.331 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T06:41:33.331 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T06:41:33.331 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T06:41:33.762 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2023-10-09T06:41:33.765 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2023-10-09T06:41:33.765 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-09T06:41:33.947 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-09T06:41:34.019 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-09T06:41:34.079 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T06:41:34.080 INFO:tasks.ceph:role: osd.1 2023-10-09T06:41:34.080 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T06:41:34.080 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-09T06:41:34.147 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T06:41:34.147 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T06:41:34.147 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T06:41:34.147 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 2023-10-09T06:41:34.147 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T06:41:34.147 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2023-10-09T06:41:34.148 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T06:41:34.148 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T06:41:34.148 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T06:41:34.148 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T06:41:34.561 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2023-10-09T06:41:34.565 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2023-10-09T06:41:34.565 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-09T06:41:34.696 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-09T06:41:34.762 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-09T06:41:34.822 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T06:41:34.822 INFO:tasks.ceph:role: osd.2 2023-10-09T06:41:34.822 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T06:41:34.822 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-09T06:41:34.890 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T06:41:34.890 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T06:41:34.890 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T06:41:34.890 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 2023-10-09T06:41:34.890 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T06:41:34.891 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2023-10-09T06:41:34.891 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T06:41:34.891 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T06:41:34.891 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T06:41:34.891 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T06:41:35.361 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2023-10-09T06:41:35.365 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2023-10-09T06:41:35.365 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-09T06:41:35.569 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-09T06:41:35.636 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-09T06:41:35.697 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T06:41:35.697 INFO:tasks.ceph:role: osd.3 2023-10-09T06:41:35.697 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T06:41:35.698 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-09T06:41:35.766 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T06:41:35.766 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T06:41:35.766 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T06:41:35.766 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 2023-10-09T06:41:35.766 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T06:41:35.766 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2023-10-09T06:41:35.766 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T06:41:35.766 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T06:41:35.766 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T06:41:35.767 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T06:41:36.202 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2023-10-09T06:41:36.205 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2023-10-09T06:41:36.205 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-09T06:41:36.361 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-09T06:41:36.427 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:41:36.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:36.539+0000 7f02a875e540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-09T06:41:36.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:36.541+0000 7f02a875e540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-09T06:41:36.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:36.541+0000 7f02a875e540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-09T06:41:36.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:36.541+0000 7f02a875e540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-09T06:41:36.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:36.541+0000 7f02a875e540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-09T06:41:36.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:36.543+0000 7f02a875e540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-09T06:41:37.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:37.083+0000 7f02a875e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:41:37.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:37.851+0000 7f02a875e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:41:38.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:38.617+0000 7f02a875e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:41:39.433 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-09T06:41:39.499 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:41:39.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:39.591+0000 7efc72e79540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-09T06:41:39.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:39.591+0000 7efc72e79540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-09T06:41:39.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:39.591+0000 7efc72e79540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-09T06:41:39.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:39.591+0000 7efc72e79540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-09T06:41:39.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:39.591+0000 7efc72e79540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-09T06:41:39.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:39.592+0000 7efc72e79540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-09T06:41:40.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:40.133+0000 7efc72e79540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:41:40.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:40.900+0000 7efc72e79540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:41:41.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:41.669+0000 7efc72e79540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:41:42.481 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-09T06:41:42.545 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:41:42.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:42.637+0000 7f66c3ade540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-09T06:41:42.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:42.637+0000 7f66c3ade540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-09T06:41:42.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:42.637+0000 7f66c3ade540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-09T06:41:42.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:42.637+0000 7f66c3ade540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-09T06:41:42.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:42.637+0000 7f66c3ade540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-09T06:41:42.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:42.639+0000 7f66c3ade540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-09T06:41:43.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:43.177+0000 7f66c3ade540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:41:43.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:43.941+0000 7f66c3ade540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:41:44.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:44.705+0000 7f66c3ade540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:41:45.535 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-09T06:41:45.601 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:41:45.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:45.692+0000 7f3192215540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-09T06:41:45.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:45.692+0000 7f3192215540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-09T06:41:45.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:45.692+0000 7f3192215540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-09T06:41:45.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:45.692+0000 7f3192215540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-09T06:41:45.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:45.692+0000 7f3192215540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-09T06:41:45.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:45.694+0000 7f3192215540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-09T06:41:46.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:46.231+0000 7f3192215540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:41:46.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:46.996+0000 7f3192215540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:41:47.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:41:47.759+0000 7f3192215540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:41:48.578 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-09T06:41:48.641 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-09T06:41:48.709 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T06:41:48.710 INFO:tasks.ceph:role: osd.4 2023-10-09T06:41:48.710 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-09T06:41:48.710 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-09T06:41:48.780 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T06:41:48.780 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T06:41:48.780 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T06:41:48.780 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 2023-10-09T06:41:48.781 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T06:41:48.781 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-10-09T06:41:48.781 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T06:41:48.781 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T06:41:48.781 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T06:41:48.781 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T06:41:49.211 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-10-09T06:41:49.215 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-10-09T06:41:49.215 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-09T06:41:49.391 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-09T06:41:49.463 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-09T06:41:49.524 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T06:41:49.524 INFO:tasks.ceph:role: osd.5 2023-10-09T06:41:49.524 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-09T06:41:49.524 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-09T06:41:49.592 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T06:41:49.592 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T06:41:49.592 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T06:41:49.593 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 2023-10-09T06:41:49.593 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T06:41:49.593 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-10-09T06:41:49.593 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T06:41:49.593 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T06:41:49.593 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T06:41:49.593 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T06:41:49.997 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-10-09T06:41:50.001 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-10-09T06:41:50.002 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-09T06:41:50.127 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-09T06:41:50.194 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-09T06:41:50.254 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T06:41:50.254 INFO:tasks.ceph:role: osd.6 2023-10-09T06:41:50.255 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-09T06:41:50.255 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-09T06:41:50.322 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T06:41:50.322 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T06:41:50.322 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T06:41:50.322 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 2023-10-09T06:41:50.322 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T06:41:50.322 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-10-09T06:41:50.323 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T06:41:50.323 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T06:41:50.323 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T06:41:50.323 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T06:41:50.767 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-10-09T06:41:50.771 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-10-09T06:41:50.771 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-09T06:41:50.955 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-09T06:41:51.022 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-09T06:41:51.142 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T06:41:51.142 INFO:tasks.ceph:role: osd.7 2023-10-09T06:41:51.143 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-09T06:41:51.143 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-09T06:41:51.212 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T06:41:51.213 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T06:41:51.213 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T06:41:51.213 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 2023-10-09T06:41:51.213 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T06:41:51.213 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-10-09T06:41:51.213 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T06:41:51.213 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T06:41:51.213 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T06:41:51.213 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T06:41:51.647 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-10-09T06:41:51.651 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-10-09T06:41:51.651 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-09T06:41:51.775 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-09T06:41:51.843 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:41:51.959 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:51.959+0000 7f9221310540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-09T06:41:51.960 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:51.959+0000 7f9221310540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-09T06:41:51.960 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:51.959+0000 7f9221310540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-09T06:41:51.960 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:51.959+0000 7f9221310540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-09T06:41:51.960 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:51.960+0000 7f9221310540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-09T06:41:51.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:51.962+0000 7f9221310540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-09T06:41:52.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:52.497+0000 7f9221310540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:41:53.259 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:53.259+0000 7f9221310540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:41:54.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:54.025+0000 7f9221310540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:41:54.836 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-09T06:41:54.900 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:41:54.990 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:54.990+0000 7f7f5a3a0540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-09T06:41:54.991 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:54.990+0000 7f7f5a3a0540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-09T06:41:54.991 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:54.990+0000 7f7f5a3a0540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-09T06:41:54.991 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:54.990+0000 7f7f5a3a0540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-09T06:41:54.991 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:54.990+0000 7f7f5a3a0540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-09T06:41:54.992 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:54.992+0000 7f7f5a3a0540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-09T06:41:55.528 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:55.528+0000 7f7f5a3a0540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:41:56.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:56.289+0000 7f7f5a3a0540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:41:57.055 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:57.054+0000 7f7f5a3a0540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:41:57.871 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-09T06:41:57.936 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:41:58.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:58.027+0000 7f266fd55540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-09T06:41:58.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:58.027+0000 7f266fd55540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-09T06:41:58.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:58.027+0000 7f266fd55540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-09T06:41:58.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:58.027+0000 7f266fd55540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-09T06:41:58.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:58.027+0000 7f266fd55540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-09T06:41:58.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:58.029+0000 7f266fd55540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-09T06:41:58.568 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:58.567+0000 7f266fd55540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:41:58.656 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:41:58.661 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:41:59.331 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:41:59.331+0000 7f266fd55540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:42:00.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:00.094+0000 7f266fd55540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:42:00.909 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-09T06:42:00.973 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:42:01.063 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:01.063+0000 7ff692c3a540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-09T06:42:01.063 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:01.063+0000 7ff692c3a540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-09T06:42:01.064 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:01.063+0000 7ff692c3a540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-09T06:42:01.064 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:01.063+0000 7ff692c3a540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-09T06:42:01.064 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:01.063+0000 7ff692c3a540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-09T06:42:01.065 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:01.065+0000 7ff692c3a540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-09T06:42:01.600 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:01.600+0000 7ff692c3a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:42:02.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:02.362+0000 7ff692c3a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:42:03.130 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:03.129+0000 7ff692c3a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T06:42:03.941 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-09T06:42:04.005 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-09T06:42:04.006 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:42:04.006 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-09T06:42:04.074 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:42:04.074 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-09T06:42:04.176 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:42:04.176 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-09T06:42:04.275 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:42:04.276 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-09T06:42:04.376 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:42:04.376 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-09T06:42:04.476 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:42:04.477 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-09T06:42:04.578 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:42:04.578 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-09T06:42:04.678 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-09T06:42:04.678 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-09T06:42:04.743 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-09T06:42:04.743 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-09T06:42:04.844 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-09T06:42:04.844 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-09T06:42:04.944 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-09T06:42:04.944 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-09T06:42:05.044 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-09T06:42:05.044 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-09T06:42:05.143 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-09T06:42:05.143 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-09T06:42:05.242 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-09T06:42:05.243 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-09T06:42:05.343 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:42:05.343 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-09T06:42:05.380 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:42:05.380 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-09T06:42:05.455 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-09T06:42:05.455 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-09T06:42:05.491 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-09T06:42:05.491 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-09T06:42:05.566 INFO:tasks.ceph:Adding keys to all mons... 2023-10-09T06:42:05.566 DEBUG:teuthology.orchestra.run.smithi071:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-09T06:42:05.573 DEBUG:teuthology.orchestra.run.smithi179:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-09T06:42:05.626 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr.y] 2023-10-09T06:42:05.626 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCboCNly/XVNRAAlKr9arCbsDbzZ9bpIU5dng== 2023-10-09T06:42:05.627 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.a] 2023-10-09T06:42:05.627 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCcoCNlpI5JCRAAGBgrs6g+6KZFXv1eq0fkwQ== 2023-10-09T06:42:05.627 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.c] 2023-10-09T06:42:05.627 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCcoCNlLKKfExAA65+KIyYd16iQ2L5topDPkg== 2023-10-09T06:42:05.627 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.0] 2023-10-09T06:42:05.627 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCgoCNll7hBIBAAtZ8mBx+MPAwEou48boP4Hw== 2023-10-09T06:42:05.627 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.1] 2023-10-09T06:42:05.627 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCjoCNl7uRMIxAAztQi4ZsulyN2FHcMRzZ82Q== 2023-10-09T06:42:05.627 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.2] 2023-10-09T06:42:05.628 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCmoCNlW/cNJhAAfFdnRC95YJwpCngJS956cA== 2023-10-09T06:42:05.628 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.3] 2023-10-09T06:42:05.628 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCpoCNlAIlYKRAAD5IGHWZ14ckpQAU4wBifbg== 2023-10-09T06:42:05.628 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr.x] 2023-10-09T06:42:05.628 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCcoCNlwwJ/AhAAjHMhAX1/yWgh9no7yQqP6Q== 2023-10-09T06:42:05.628 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.b] 2023-10-09T06:42:05.628 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCcoCNlDZQYHhAA2LGKHPLrBVKlGMK0TKup7A== 2023-10-09T06:42:05.628 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.d] 2023-10-09T06:42:05.628 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCcoCNlpQKTKBAAP59h/znElthIdqbK9tKJww== 2023-10-09T06:42:05.628 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.4] 2023-10-09T06:42:05.629 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCvoCNltrA4ORAAtifmL9hr1xKd+jsMf5Nf+Q== 2023-10-09T06:42:05.629 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.5] 2023-10-09T06:42:05.629 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCyoCNlA/IOOxAAQWRPQ+00o9xrpScAvY/87w== 2023-10-09T06:42:05.629 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.6] 2023-10-09T06:42:05.629 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQC2oCNlvRusARAAcRaGyCROIRVTHeKhrncN8g== 2023-10-09T06:42:05.629 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.7] 2023-10-09T06:42:05.629 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQC5oCNli/3NAxAAIMYuED41ZSx1xF384N6y1A== 2023-10-09T06:42:05.629 INFO:teuthology.orchestra.run.smithi071.stdout:[client.0] 2023-10-09T06:42:05.629 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCcoCNlHrKWMRAAyIfmryGSgqIFwWEJyixprw== 2023-10-09T06:42:05.630 INFO:teuthology.orchestra.run.smithi071.stdout:[client.2] 2023-10-09T06:42:05.630 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCcoCNlM3JHOBAA8fszREXH+WnYb+3vIaakcA== 2023-10-09T06:42:05.630 INFO:teuthology.orchestra.run.smithi071.stdout:[client.1] 2023-10-09T06:42:05.630 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCdoCNldq1xAxAAxCpmelS0qDEY187u19JkcQ== 2023-10-09T06:42:05.630 INFO:teuthology.orchestra.run.smithi071.stdout:[client.3] 2023-10-09T06:42:05.630 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCdoCNlgkEqChAAwntdv9UOo30x40pVa70yag== 2023-10-09T06:42:05.663 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.y] 2023-10-09T06:42:05.663 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCboCNly/XVNRAAlKr9arCbsDbzZ9bpIU5dng== 2023-10-09T06:42:05.663 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2023-10-09T06:42:05.663 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCcoCNlpI5JCRAAGBgrs6g+6KZFXv1eq0fkwQ== 2023-10-09T06:42:05.663 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2023-10-09T06:42:05.663 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCcoCNlLKKfExAA65+KIyYd16iQ2L5topDPkg== 2023-10-09T06:42:05.663 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.0] 2023-10-09T06:42:05.664 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCgoCNll7hBIBAAtZ8mBx+MPAwEou48boP4Hw== 2023-10-09T06:42:05.664 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.1] 2023-10-09T06:42:05.664 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCjoCNl7uRMIxAAztQi4ZsulyN2FHcMRzZ82Q== 2023-10-09T06:42:05.664 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.2] 2023-10-09T06:42:05.664 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCmoCNlW/cNJhAAfFdnRC95YJwpCngJS956cA== 2023-10-09T06:42:05.664 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.3] 2023-10-09T06:42:05.664 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCpoCNlAIlYKRAAD5IGHWZ14ckpQAU4wBifbg== 2023-10-09T06:42:05.664 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.x] 2023-10-09T06:42:05.664 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCcoCNlwwJ/AhAAjHMhAX1/yWgh9no7yQqP6Q== 2023-10-09T06:42:05.664 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2023-10-09T06:42:05.664 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCcoCNlDZQYHhAA2LGKHPLrBVKlGMK0TKup7A== 2023-10-09T06:42:05.665 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2023-10-09T06:42:05.665 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCcoCNlpQKTKBAAP59h/znElthIdqbK9tKJww== 2023-10-09T06:42:05.665 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.4] 2023-10-09T06:42:05.665 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCvoCNltrA4ORAAtifmL9hr1xKd+jsMf5Nf+Q== 2023-10-09T06:42:05.665 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.5] 2023-10-09T06:42:05.665 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCyoCNlA/IOOxAAQWRPQ+00o9xrpScAvY/87w== 2023-10-09T06:42:05.665 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.6] 2023-10-09T06:42:05.665 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQC2oCNlvRusARAAcRaGyCROIRVTHeKhrncN8g== 2023-10-09T06:42:05.665 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.7] 2023-10-09T06:42:05.665 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQC5oCNli/3NAxAAIMYuED41ZSx1xF384N6y1A== 2023-10-09T06:42:05.665 INFO:teuthology.orchestra.run.smithi179.stdout:[client.0] 2023-10-09T06:42:05.665 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCcoCNlHrKWMRAAyIfmryGSgqIFwWEJyixprw== 2023-10-09T06:42:05.666 INFO:teuthology.orchestra.run.smithi179.stdout:[client.2] 2023-10-09T06:42:05.666 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCcoCNlM3JHOBAA8fszREXH+WnYb+3vIaakcA== 2023-10-09T06:42:05.666 INFO:teuthology.orchestra.run.smithi179.stdout:[client.1] 2023-10-09T06:42:05.666 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCdoCNldq1xAxAAxCpmelS0qDEY187u19JkcQ== 2023-10-09T06:42:05.666 INFO:teuthology.orchestra.run.smithi179.stdout:[client.3] 2023-10-09T06:42:05.666 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCdoCNlgkEqChAAwntdv9UOo30x40pVa70yag== 2023-10-09T06:42:05.667 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T06:42:05.676 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T06:42:05.800 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T06:42:05.808 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T06:42:05.904 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T06:42:05.909 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T06:42:06.006 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:42:06.014 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:42:06.108 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:42:06.112 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:42:06.206 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:42:06.211 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:42:06.304 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:42:06.309 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:42:06.402 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T06:42:06.407 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T06:42:06.502 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T06:42:06.506 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T06:42:06.603 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T06:42:06.608 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T06:42:06.706 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:42:06.711 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:42:06.806 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:42:06.811 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:42:06.905 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:42:06.909 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:42:07.003 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:42:07.008 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T06:42:07.102 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T06:42:07.107 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T06:42:07.203 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T06:42:07.208 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T06:42:07.305 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T06:42:07.309 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T06:42:07.406 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T06:42:07.410 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T06:42:07.507 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-09T06:42:07.507 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-09T06:42:07.567 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-09T06:42:07.675 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-09T06:42:07.735 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-09T06:42:07.797 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-09T06:42:07.906 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-09T06:42:07.967 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-09T06:42:08.027 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-09T06:42:08.133 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-09T06:42:08.194 DEBUG:teuthology.orchestra.run.smithi071:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:42:08.199 DEBUG:teuthology.orchestra.run.smithi179:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-09T06:42:08.234 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-09T06:42:08.235 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-09T06:42:08.235 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-09T06:42:08.278 INFO:tasks.ceph.mon.a:Started 2023-10-09T06:42:08.279 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-09T06:42:08.279 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-09T06:42:08.284 INFO:tasks.ceph.mon.b:Started 2023-10-09T06:42:08.284 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-09T06:42:08.284 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-09T06:42:08.288 INFO:tasks.ceph.mon.c:Started 2023-10-09T06:42:08.288 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-09T06:42:08.288 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-09T06:42:08.289 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-09T06:42:08.293 INFO:tasks.ceph.mgr.y:Started 2023-10-09T06:42:08.293 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-09T06:42:08.293 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-09T06:42:08.298 INFO:tasks.ceph.mgr.x:Started 2023-10-09T06:42:08.299 INFO:tasks.ceph:Setting crush tunables to default 2023-10-09T06:42:08.299 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd crush tunables default 2023-10-09T06:42:08.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.479+0000 7f8afcd9d700 1 Processor -- start 2023-10-09T06:42:08.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.479+0000 7f8afcd9d700 1 -- start start 2023-10-09T06:42:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.480+0000 7f8afcd9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b16d0 0x7f8af80b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.480+0000 7f8afcd9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 0x7f8af80b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.480+0000 7f8afcd9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af80b2080 con 0x7f8af80b4e70 2023-10-09T06:42:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.480+0000 7f8afcd9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af80cfb00 con 0x7f8af80b33b0 2023-10-09T06:42:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.480+0000 7f8afcd9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af80b5c40 con 0x7f8af80b16d0 2023-10-09T06:42:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.480+0000 7f8af7fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 0x7f8af80b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.480+0000 7f8af7fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 0x7f8af80b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49998/0 (socket says 172.21.15.71:49998) 2023-10-09T06:42:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.480+0000 7f8af7fff700 1 -- 172.21.15.71:0/1895215993 learned_addr learned my addr 172.21.15.71:0/1895215993 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.480+0000 7f8af6ffd700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b16d0 0x7f8af80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.480+0000 7f8af7fff700 1 -- 172.21.15.71:0/1895215993 >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 msgr2=0x7f8af80b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-09T06:42:08.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.480+0000 7f8af7fff700 1 -- 172.21.15.71:0/1895215993 >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 msgr2=0x7f8af80b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-09T06:42:08.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.480+0000 7f8af7fff700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 0x7f8af80b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-09T06:42:08.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.481+0000 7f8af7fff700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 0x7f8af80b3830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:42:08.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.481+0000 7f8af6ffd700 1 -- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b16d0 msgr2=0x7f8af80b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-09T06:42:08.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.481+0000 7f8af6ffd700 1 -- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b16d0 msgr2=0x7f8af80b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-09T06:42:08.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.481+0000 7f8af6ffd700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b16d0 0x7f8af80b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-09T06:42:08.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.481+0000 7f8af6ffd700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b16d0 0x7f8af80b1b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:42:08.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.682+0000 7f8af7fff700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 0x7f8af80b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:08.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.682+0000 7f8af7fff700 1 -- 172.21.15.71:0/1895215993 >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 msgr2=0x7f8af80b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-09T06:42:08.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.682+0000 7f8af7fff700 1 -- 172.21.15.71:0/1895215993 >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 msgr2=0x7f8af80b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-09T06:42:08.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.682+0000 7f8af7fff700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 0x7f8af80b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-09T06:42:08.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.682+0000 7f8af7fff700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 0x7f8af80b3830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:42:08.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.682+0000 7f8af6ffd700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b16d0 0x7f8af80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:08.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.682+0000 7f8af6ffd700 1 -- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b16d0 msgr2=0x7f8af80b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-09T06:42:08.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.682+0000 7f8af6ffd700 1 -- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b16d0 msgr2=0x7f8af80b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-09T06:42:08.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.682+0000 7f8af6ffd700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b16d0 0x7f8af80b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-09T06:42:08.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:08.682+0000 7f8af6ffd700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b16d0 0x7f8af80b1b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:42:09.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:09.083+0000 7f8af7fff700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 0x7f8af80b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:09.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:09.083+0000 7f8af7fff700 1 -- 172.21.15.71:0/1895215993 >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 msgr2=0x7f8af80b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-09T06:42:09.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:09.083+0000 7f8af7fff700 1 -- 172.21.15.71:0/1895215993 >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 msgr2=0x7f8af80b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-09T06:42:09.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:09.083+0000 7f8af7fff700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 0x7f8af80b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-09T06:42:09.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:09.083+0000 7f8af7fff700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 0x7f8af80b3830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T06:42:09.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:09.083+0000 7f8af6ffd700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b16d0 0x7f8af80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:09.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:09.083+0000 7f8af6ffd700 1 -- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b16d0 msgr2=0x7f8af80b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-09T06:42:09.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:09.083+0000 7f8af6ffd700 1 -- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b16d0 msgr2=0x7f8af80b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-09T06:42:09.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:09.084+0000 7f8af6ffd700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b16d0 0x7f8af80b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-09T06:42:09.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:09.084+0000 7f8af6ffd700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b16d0 0x7f8af80b1b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T06:42:09.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:09.885+0000 7f8af7fff700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 0x7f8af80b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:09.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:09.885+0000 7f8af7fff700 1 -- 172.21.15.71:0/1895215993 >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 msgr2=0x7f8af80b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-09T06:42:09.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:09.885+0000 7f8af7fff700 1 -- 172.21.15.71:0/1895215993 >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 msgr2=0x7f8af80b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-09T06:42:09.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:09.885+0000 7f8af7fff700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 0x7f8af80b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-09T06:42:09.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:09.885+0000 7f8af7fff700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 0x7f8af80b3830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T06:42:09.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:09.885+0000 7f8af6ffd700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b16d0 0x7f8af80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:09.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:09.885+0000 7f8af6ffd700 1 -- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b16d0 msgr2=0x7f8af80b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-09T06:42:09.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:09.885+0000 7f8af6ffd700 1 -- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b16d0 msgr2=0x7f8af80b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-09T06:42:09.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:09.885+0000 7f8af6ffd700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b16d0 0x7f8af80b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-09T06:42:09.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:09.885+0000 7f8af6ffd700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b16d0 0x7f8af80b1b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T06:42:11.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:11.481+0000 7f8af57fa700 1 -- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b16d0 msgr2=0x7f8af80b1b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T06:42:11.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:11.481+0000 7f8af57fa700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b16d0 0x7f8af80b1b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:11.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:11.481+0000 7f8af57fa700 1 -- 172.21.15.71:0/1895215993 >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 msgr2=0x7f8af80b3830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T06:42:11.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:11.481+0000 7f8af57fa700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.71:3300/0 conn(0x7f8af80b33b0 0x7f8af80b3830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:11.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:11.481+0000 7f8af57fa700 1 -- 172.21.15.71:0/1895215993 >> v1:172.21.15.179:6789/0 conn(0x7f8af80b4e70 legacy=0x7f8af80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:11.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:11.481+0000 7f8af57fa700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.179:3300/0 conn(0x7f8ae4003730 0x7f8ae4005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:11.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:11.481+0000 7f8af57fa700 1 -- 172.21.15.71:0/1895215993 --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af80b5f20 con 0x7f8ae4006250 2023-10-09T06:42:11.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:11.481+0000 7f8af57fa700 1 -- 172.21.15.71:0/1895215993 --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af80cfb00 con 0x7f8ae4003730 2023-10-09T06:42:11.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:11.481+0000 7f8af77fe700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.179:3300/0 conn(0x7f8ae4003730 0x7f8ae4005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:11.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:11.481+0000 7f8af77fe700 1 -- 172.21.15.71:0/1895215993 >> v2:172.21.15.179:3300/0 conn(0x7f8ae4003730 msgr2=0x7f8ae4005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-09T06:42:11.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:11.481+0000 7f8af77fe700 1 -- 172.21.15.71:0/1895215993 >> v2:172.21.15.179:3300/0 conn(0x7f8ae4003730 msgr2=0x7f8ae4005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-09T06:42:11.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:11.481+0000 7f8af77fe700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.179:3300/0 conn(0x7f8ae4003730 0x7f8ae4005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-09T06:42:11.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:11.481+0000 7f8af77fe700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.179:3300/0 conn(0x7f8ae4003730 0x7f8ae4005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:42:11.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:11.682+0000 7f8af77fe700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.179:3300/0 conn(0x7f8ae4003730 0x7f8ae4005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:11.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:11.682+0000 7f8af77fe700 1 -- 172.21.15.71:0/1895215993 >> v2:172.21.15.179:3300/0 conn(0x7f8ae4003730 msgr2=0x7f8ae4005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-09T06:42:11.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:11.682+0000 7f8af77fe700 1 -- 172.21.15.71:0/1895215993 >> v2:172.21.15.179:3300/0 conn(0x7f8ae4003730 msgr2=0x7f8ae4005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-09T06:42:11.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:11.682+0000 7f8af77fe700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.179:3300/0 conn(0x7f8ae4003730 0x7f8ae4005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-09T06:42:11.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:11.682+0000 7f8af77fe700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.179:3300/0 conn(0x7f8ae4003730 0x7f8ae4005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:42:12.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:12.084+0000 7f8af77fe700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.179:3300/0 conn(0x7f8ae4003730 0x7f8ae4005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:12.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:12.084+0000 7f8af77fe700 1 -- 172.21.15.71:0/1895215993 >> v2:172.21.15.179:3300/0 conn(0x7f8ae4003730 msgr2=0x7f8ae4005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-09T06:42:12.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:12.084+0000 7f8af77fe700 1 -- 172.21.15.71:0/1895215993 >> v2:172.21.15.179:3300/0 conn(0x7f8ae4003730 msgr2=0x7f8ae4005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-09T06:42:12.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:12.084+0000 7f8af77fe700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.179:3300/0 conn(0x7f8ae4003730 0x7f8ae4005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-09T06:42:12.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:12.084+0000 7f8af77fe700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.179:3300/0 conn(0x7f8ae4003730 0x7f8ae4005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T06:42:12.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:12.886+0000 7f8af77fe700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.179:3300/0 conn(0x7f8ae4003730 0x7f8ae4005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:12.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:12.886+0000 7f8af77fe700 1 -- 172.21.15.71:0/1895215993 >> v2:172.21.15.179:3300/0 conn(0x7f8ae4003730 msgr2=0x7f8ae4005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-09T06:42:12.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:12.886+0000 7f8af77fe700 1 -- 172.21.15.71:0/1895215993 >> v2:172.21.15.179:3300/0 conn(0x7f8ae4003730 msgr2=0x7f8ae4005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-09T06:42:12.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:12.886+0000 7f8af77fe700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.179:3300/0 conn(0x7f8ae4003730 0x7f8ae4005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-09T06:42:12.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:12.886+0000 7f8af77fe700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.179:3300/0 conn(0x7f8ae4003730 0x7f8ae4005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T06:42:13.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.678+0000 7f8af67fc700 1 -- 172.21.15.71:0/1895215993 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900461157 0 0) 0x7f8af80b5f20 con 0x7f8ae4006250 2023-10-09T06:42:13.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.678+0000 7f8af67fc700 1 -- 172.21.15.71:0/1895215993 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ae0003570 con 0x7f8ae4006250 2023-10-09T06:42:13.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.679+0000 7f8af67fc700 1 -- 172.21.15.71:0/1895215993 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 354086647 0 0) 0x7f8ae0003570 con 0x7f8ae4006250 2023-10-09T06:42:13.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.679+0000 7f8af67fc700 1 -- 172.21.15.71:0/1895215993 >> v2:172.21.15.179:3300/0 conn(0x7f8ae4003730 msgr2=0x7f8ae4005b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T06:42:13.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.679+0000 7f8af67fc700 1 --2- 172.21.15.71:0/1895215993 >> v2:172.21.15.179:3300/0 conn(0x7f8ae4003730 0x7f8ae4005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:13.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.679+0000 7f8af67fc700 1 -- 172.21.15.71:0/1895215993 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae400aff0 con 0x7f8ae4006250 2023-10-09T06:42:13.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.679+0000 7f8af67fc700 1 -- 172.21.15.71:0/1895215993 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f8aec00d300 con 0x7f8ae4006250 2023-10-09T06:42:13.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.679+0000 7f8af67fc700 1 -- 172.21.15.71:0/1895215993 >> v1:172.21.15.71:6789/0 conn(0x7f8ae4006250 legacy=0x7f8ae4008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:13.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.679+0000 7f8af7fff700 1 -- 172.21.15.71:0/1895215993 reap_dead start 2023-10-09T06:42:13.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.679+0000 7f8af67fc700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ae0003a60 0x7f8ae0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.679+0000 7f8af67fc700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ae0004810 0x7f8ae0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.679+0000 7f8af67fc700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ae00052e0 0x7f8ae000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.679+0000 7f8af67fc700 1 -- 172.21.15.71:0/1895215993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af80cfb00 con 0x7f8ae0004810 2023-10-09T06:42:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.679+0000 7f8af67fc700 1 -- 172.21.15.71:0/1895215993 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae000c2a0 con 0x7f8ae0003a60 2023-10-09T06:42:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.679+0000 7f8af67fc700 1 -- 172.21.15.71:0/1895215993 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae000c460 con 0x7f8ae00052e0 2023-10-09T06:42:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.679+0000 7f8af6ffd700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ae0004810 0x7f8ae0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.679+0000 7f8af77fe700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ae0003a60 0x7f8ae0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.679+0000 7f8af7fff700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ae00052e0 0x7f8ae000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.680+0000 7f8af77fe700 1 -- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ae00052e0 msgr2=0x7f8ae000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.680+0000 7f8af77fe700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ae00052e0 0x7f8ae000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.680+0000 7f8af77fe700 1 -- 172.21.15.71:0/1895215993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ae0004810 msgr2=0x7f8ae0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:13.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.680+0000 7f8af77fe700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ae0004810 0x7f8ae0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:13.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.680+0000 7f8af77fe700 1 -- 172.21.15.71:0/1895215993 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae0003570 con 0x7f8ae0003a60 2023-10-09T06:42:13.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.680+0000 7f8af6ffd700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ae0004810 0x7f8ae0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:42:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.680+0000 7f8af77fe700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ae0003a60 0x7f8ae0003e50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80039f0 tx=0x7f8ae8009040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29de2c1c4acbc256 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.681+0000 7f8af67fc700 1 -- 172.21.15.71:0/1895215993 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8006820 con 0x7f8ae0003a60 2023-10-09T06:42:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.681+0000 7f8af67fc700 1 -- 172.21.15.71:0/1895215993 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae80069a0 con 0x7f8ae0003a60 2023-10-09T06:42:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.681+0000 7f8af67fc700 1 -- 172.21.15.71:0/1895215993 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8006b50 con 0x7f8ae0003a60 2023-10-09T06:42:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.681+0000 7f8afcd9d700 1 -- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ae0003a60 msgr2=0x7f8ae0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.681+0000 7f8afcd9d700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ae0003a60 0x7f8ae0003e50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80039f0 tx=0x7f8ae8009040 comp rx=0 tx=0).stop 2023-10-09T06:42:13.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.682+0000 7f8afcd9d700 1 -- 172.21.15.71:0/1895215993 shutdown_connections 2023-10-09T06:42:13.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.682+0000 7f8afcd9d700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ae00052e0 0x7f8ae000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:13.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.682+0000 7f8afcd9d700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ae0004810 0x7f8ae0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:13.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.682+0000 7f8afcd9d700 1 --2- 172.21.15.71:0/1895215993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ae0003a60 0x7f8ae0003e50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:13.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.682+0000 7f8afcd9d700 1 -- 172.21.15.71:0/1895215993 >> 172.21.15.71:0/1895215993 conn(0x7f8af80d10c0 msgr2=0x7f8af80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:13.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.682+0000 7f8afcd9d700 1 -- 172.21.15.71:0/1895215993 shutdown_connections 2023-10-09T06:42:13.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.682+0000 7f8afcd9d700 1 -- 172.21.15.71:0/1895215993 wait complete. 2023-10-09T06:42:13.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.683+0000 7f8afcd9d700 1 Processor -- start 2023-10-09T06:42:13.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.683+0000 7f8afcd9d700 1 -- start start 2023-10-09T06:42:13.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.684+0000 7f8afcd9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ae0003a60 0x7f8af8155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:13.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.684+0000 7f8afcd9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ae0004810 0x7f8af80cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:13.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.684+0000 7f8afcd9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ae00052e0 0x7f8af815b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:13.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.684+0000 7f8afcd9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af80c71b0 con 0x7f8ae0003a60 2023-10-09T06:42:13.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.684+0000 7f8afcd9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af8155dd0 con 0x7f8ae0004810 2023-10-09T06:42:13.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.684+0000 7f8afcd9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af80c6080 con 0x7f8ae00052e0 2023-10-09T06:42:13.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.685+0000 7f8af7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ae00052e0 0x7f8af815b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:13.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.685+0000 7f8af7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ae00052e0 0x7f8af815b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:46764/0 (socket says 172.21.15.71:46764) 2023-10-09T06:42:13.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.685+0000 7f8af7fff700 1 -- 172.21.15.71:0/3257196785 learned_addr learned my addr 172.21.15.71:0/3257196785 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:13.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.685+0000 7f8af77fe700 1 --2- 172.21.15.71:0/3257196785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ae0003a60 0x7f8af8155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.685+0000 7f8af6ffd700 1 --2- 172.21.15.71:0/3257196785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ae0004810 0x7f8af80cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.685+0000 7f8af7fff700 1 -- 172.21.15.71:0/3257196785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ae0004810 msgr2=0x7f8af80cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.685+0000 7f8af7fff700 1 --2- 172.21.15.71:0/3257196785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ae0004810 0x7f8af80cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.685+0000 7f8af7fff700 1 -- 172.21.15.71:0/3257196785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ae0003a60 msgr2=0x7f8af8155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.685+0000 7f8af7fff700 1 --2- 172.21.15.71:0/3257196785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ae0003a60 0x7f8af8155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.685+0000 7f8af7fff700 1 -- 172.21.15.71:0/3257196785 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af80c6360 con 0x7f8ae00052e0 2023-10-09T06:42:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.685+0000 7f8af77fe700 1 --2- 172.21.15.71:0/3257196785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ae0003a60 0x7f8af8155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.686+0000 7f8af7fff700 1 --2- 172.21.15.71:0/3257196785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ae00052e0 0x7f8af815b3b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40061c0 tx=0x7f8af000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.686+0000 7f8adf7fe700 1 -- 172.21.15.71:0/3257196785 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af0013980 con 0x7f8ae00052e0 2023-10-09T06:42:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.686+0000 7f8adf7fe700 1 -- 172.21.15.71:0/3257196785 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af000f040 con 0x7f8ae00052e0 2023-10-09T06:42:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.686+0000 7f8adf7fe700 1 -- 172.21.15.71:0/3257196785 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af0013d50 con 0x7f8ae00052e0 2023-10-09T06:42:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.686+0000 7f8afcd9d700 1 -- 172.21.15.71:0/3257196785 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af80c6b60 con 0x7f8ae00052e0 2023-10-09T06:42:13.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.686+0000 7f8afcd9d700 1 -- 172.21.15.71:0/3257196785 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af80cb5c0 con 0x7f8ae00052e0 2023-10-09T06:42:13.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.687+0000 7f8afcd9d700 1 -- 172.21.15.71:0/3257196785 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af80cb7e0 con 0x7f8ae00052e0 2023-10-09T06:42:13.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.688+0000 7f8adf7fe700 1 -- 172.21.15.71:0/3257196785 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8af0018660 con 0x7f8ae00052e0 2023-10-09T06:42:13.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.688+0000 7f8adf7fe700 1 -- 172.21.15.71:0/3257196785 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8af002d7a0 con 0x7f8ae00052e0 2023-10-09T06:42:13.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.690+0000 7f8adf7fe700 1 -- 172.21.15.71:0/3257196785 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8af0018910 con 0x7f8ae00052e0 2023-10-09T06:42:13.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.767+0000 7f8afcd9d700 1 -- 172.21.15.71:0/3257196785 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f8af80b2a80 con 0x7f8ae00052e0 2023-10-09T06:42:13.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.774+0000 7f8adf7fe700 1 -- 172.21.15.71:0/3257196785 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8af0018ba0 con 0x7f8ae00052e0 2023-10-09T06:42:13.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.775+0000 7f8afcd9d700 1 -- 172.21.15.71:0/3257196785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ae00052e0 msgr2=0x7f8af815b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:13.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.775+0000 7f8afcd9d700 1 --2- 172.21.15.71:0/3257196785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ae00052e0 0x7f8af815b3b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40061c0 tx=0x7f8af000b040 comp rx=0 tx=0).stop 2023-10-09T06:42:13.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.775+0000 7f8afcd9d700 1 -- 172.21.15.71:0/3257196785 shutdown_connections 2023-10-09T06:42:13.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.775+0000 7f8afcd9d700 1 --2- 172.21.15.71:0/3257196785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ae00052e0 0x7f8af815b3b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:13.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.775+0000 7f8afcd9d700 1 --2- 172.21.15.71:0/3257196785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ae0003a60 0x7f8af8155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:13.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.775+0000 7f8afcd9d700 1 --2- 172.21.15.71:0/3257196785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ae0004810 0x7f8af80cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:13.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.775+0000 7f8afcd9d700 1 -- 172.21.15.71:0/3257196785 >> 172.21.15.71:0/3257196785 conn(0x7f8af80d10c0 msgr2=0x7f8af8159f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:13.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.776+0000 7f8afcd9d700 1 -- 172.21.15.71:0/3257196785 shutdown_connections 2023-10-09T06:42:13.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:13.776+0000 7f8afcd9d700 1 -- 172.21.15.71:0/3257196785 wait complete. 2023-10-09T06:42:13.777 INFO:teuthology.orchestra.run.smithi071.stderr:adjusted tunables profile to default 2023-10-09T06:42:13.794 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-09T06:42:13.794 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:42:13.794 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-09T06:42:13.855 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:42:13.856 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-09T06:42:13.955 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:42:13.955 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-09T06:42:14.054 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-09T06:42:14.054 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-09T06:42:14.154 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-09T06:42:14.154 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-09T06:42:14.216 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-09T06:42:14.216 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-09T06:42:14.319 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-09T06:42:14.319 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-09T06:42:14.420 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-10-09T06:42:14.420 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-09T06:42:14.527 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 19d03ca4-e6df-41aa-96f2-124f6caf3544 0 2023-10-09T06:42:14.748 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.747+0000 7fda9359d700 1 Processor -- start 2023-10-09T06:42:14.748 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.747+0000 7fda9359d700 1 -- start start 2023-10-09T06:42:14.750 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.749+0000 7fda9359d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fda8c0b4e70 0x7fda8c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:14.750 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.749+0000 7fda9359d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda8c0b16d0 0x7fda8c0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:14.750 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.749+0000 7fda9359d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda8c0b2080 con 0x7fda8c15d240 2023-10-09T06:42:14.750 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.749+0000 7fda9359d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda8c0cfb00 con 0x7fda8c0b4e70 2023-10-09T06:42:14.750 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.749+0000 7fda9359d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c0b5c40 con 0x7fda8c0b16d0 2023-10-09T06:42:14.750 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.749+0000 7fda91d9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda8c0b16d0 0x7fda8c0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:14.750 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.749+0000 7fda92d9c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fda8c15d240 0x7fda8c15d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:54864/0 (socket says 172.21.15.179:54864) 2023-10-09T06:42:14.750 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.749+0000 7fda92d9c700 1 -- 172.21.15.179:0/3210304007 learned_addr learned my addr 172.21.15.179:0/3210304007 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-10-09T06:42:14.750 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.749+0000 7fda9259b700 1 --2- 172.21.15.179:0/3210304007 >> v2:172.21.15.71:3300/0 conn(0x7fda8c0b4e70 0x7fda8c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:14.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.749+0000 7fda91d9a700 1 -- 172.21.15.179:0/3210304007 >> v2:172.21.15.71:3300/0 conn(0x7fda8c0b4e70 msgr2=0x7fda8c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:14.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.749+0000 7fda91d9a700 1 --2- 172.21.15.179:0/3210304007 >> v2:172.21.15.71:3300/0 conn(0x7fda8c0b4e70 0x7fda8c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:14.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.749+0000 7fda91d9a700 1 -- 172.21.15.179:0/3210304007 >> v1:172.21.15.179:6789/0 conn(0x7fda8c15d240 legacy=0x7fda8c15d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:14.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.749+0000 7fda91d9a700 1 -- 172.21.15.179:0/3210304007 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c0b5f20 con 0x7fda8c0b16d0 2023-10-09T06:42:14.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.749+0000 7fda91599700 1 -- 172.21.15.179:0/3210304007 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723206526 0 0) 0x7fda8c0b2080 con 0x7fda8c15d240 2023-10-09T06:42:14.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.750+0000 7fda91d9a700 1 --2- 172.21.15.179:0/3210304007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda8c0b16d0 0x7fda8c0b1b40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0098e0 tx=0x7fda7c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d53cb9ddb6b1568 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:14.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.750+0000 7fda91599700 1 -- 172.21.15.179:0/3210304007 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c00b640 con 0x7fda8c0b16d0 2023-10-09T06:42:14.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.750+0000 7fda91599700 1 -- 172.21.15.179:0/3210304007 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7c00b7a0 con 0x7fda8c0b16d0 2023-10-09T06:42:14.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.750+0000 7fda91599700 1 -- 172.21.15.179:0/3210304007 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c00bb40 con 0x7fda8c0b16d0 2023-10-09T06:42:14.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.750+0000 7fda9359d700 1 -- 172.21.15.179:0/3210304007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda8c0b16d0 msgr2=0x7fda8c0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:14.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.750+0000 7fda9359d700 1 --2- 172.21.15.179:0/3210304007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda8c0b16d0 0x7fda8c0b1b40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0098e0 tx=0x7fda7c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:14.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.751+0000 7fda9359d700 1 -- 172.21.15.179:0/3210304007 shutdown_connections 2023-10-09T06:42:14.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.751+0000 7fda9359d700 1 --2- 172.21.15.179:0/3210304007 >> v2:172.21.15.71:3300/0 conn(0x7fda8c0b4e70 0x7fda8c0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:14.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.751+0000 7fda9359d700 1 --2- 172.21.15.179:0/3210304007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda8c0b16d0 0x7fda8c0b1b40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:14.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.751+0000 7fda9359d700 1 -- 172.21.15.179:0/3210304007 >> 172.21.15.179:0/3210304007 conn(0x7fda8c0d10c0 msgr2=0x7fda8c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:14.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.751+0000 7fda9359d700 1 -- 172.21.15.179:0/3210304007 shutdown_connections 2023-10-09T06:42:14.754 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.751+0000 7fda9359d700 1 -- 172.21.15.179:0/3210304007 wait complete. 2023-10-09T06:42:14.754 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.752+0000 7fda9359d700 1 Processor -- start 2023-10-09T06:42:14.754 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.752+0000 7fda9359d700 1 -- start start 2023-10-09T06:42:14.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.753+0000 7fda9359d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda8c0b16d0 0x7fda8c158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:14.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.753+0000 7fda9359d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda8c0b4e70 0x7fda8c0cb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:14.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.753+0000 7fda9359d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda8c15d240 0x7fda8c0cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:14.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.753+0000 7fda9359d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c16d850 con 0x7fda8c0b4e70 2023-10-09T06:42:14.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.753+0000 7fda9359d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c1585b0 con 0x7fda8c15d240 2023-10-09T06:42:14.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.753+0000 7fda9359d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c16cf20 con 0x7fda8c0b16d0 2023-10-09T06:42:14.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.753+0000 7fda9259b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda8c0b16d0 0x7fda8c158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:14.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.753+0000 7fda92d9c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda8c15d240 0x7fda8c0cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:14.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.753+0000 7fda9259b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda8c0b16d0 0x7fda8c158070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:43150/0 (socket says 172.21.15.179:43150) 2023-10-09T06:42:14.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.753+0000 7fda9259b700 1 -- 172.21.15.179:0/90259942 learned_addr learned my addr 172.21.15.179:0/90259942 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-09T06:42:14.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.753+0000 7fda91d9a700 1 --2- 172.21.15.179:0/90259942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda8c0b4e70 0x7fda8c0cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:14.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.754+0000 7fda92d9c700 1 -- 172.21.15.179:0/90259942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda8c0b16d0 msgr2=0x7fda8c158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:14.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.754+0000 7fda92d9c700 1 --2- 172.21.15.179:0/90259942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda8c0b16d0 0x7fda8c158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:14.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.754+0000 7fda92d9c700 1 -- 172.21.15.179:0/90259942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda8c0b4e70 msgr2=0x7fda8c0cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:14.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.754+0000 7fda92d9c700 1 --2- 172.21.15.179:0/90259942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda8c0b4e70 0x7fda8c0cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:14.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.754+0000 7fda92d9c700 1 -- 172.21.15.179:0/90259942 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c009420 con 0x7fda8c15d240 2023-10-09T06:42:14.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.754+0000 7fda9259b700 1 --2- 172.21.15.179:0/90259942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda8c0b16d0 0x7fda8c158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:42:14.759 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.754+0000 7fda91d9a700 1 --2- 172.21.15.179:0/90259942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda8c0b4e70 0x7fda8c0cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:42:14.759 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.754+0000 7fda92d9c700 1 --2- 172.21.15.179:0/90259942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda8c15d240 0x7fda8c0cbcc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fda8400cb90 tx=0x7fda840018f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:14.759 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.754+0000 7fda827fc700 1 -- 172.21.15.179:0/90259942 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8400a780 con 0x7fda8c15d240 2023-10-09T06:42:14.759 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.754+0000 7fda827fc700 1 -- 172.21.15.179:0/90259942 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8400a8e0 con 0x7fda8c15d240 2023-10-09T06:42:14.759 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.754+0000 7fda827fc700 1 -- 172.21.15.179:0/90259942 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8400aca0 con 0x7fda8c15d240 2023-10-09T06:42:14.759 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.754+0000 7fda9359d700 1 -- 172.21.15.179:0/90259942 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda8c16d200 con 0x7fda8c15d240 2023-10-09T06:42:14.759 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.754+0000 7fda9359d700 1 -- 172.21.15.179:0/90259942 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8c0cc340 con 0x7fda8c15d240 2023-10-09T06:42:14.759 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.755+0000 7fda827fc700 1 -- 172.21.15.179:0/90259942 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fda84007300 con 0x7fda8c15d240 2023-10-09T06:42:14.759 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.755+0000 7fda827fc700 1 -- 172.21.15.179:0/90259942 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fda8401b750 con 0x7fda8c15d240 2023-10-09T06:42:14.759 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.755+0000 7fda9359d700 1 -- 172.21.15.179:0/90259942 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda8c16d9c0 con 0x7fda8c15d240 2023-10-09T06:42:14.760 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.758+0000 7fda827fc700 1 -- 172.21.15.179:0/90259942 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fda8400ae50 con 0x7fda8c15d240 2023-10-09T06:42:14.845 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.843+0000 7fda9359d700 1 -- 172.21.15.179:0/90259942 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "19d03ca4-e6df-41aa-96f2-124f6caf3544", "id": 0} v 0) v1 -- 0x7fda8c04bb80 con 0x7fda8c15d240 2023-10-09T06:42:14.851 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.851+0000 7fda827fc700 1 -- 172.21.15.179:0/90259942 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "19d03ca4-e6df-41aa-96f2-124f6caf3544", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fda840077b0 con 0x7fda8c15d240 2023-10-09T06:42:14.851 INFO:teuthology.orchestra.run.smithi179.stdout:0 2023-10-09T06:42:14.852 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.852+0000 7fda9359d700 1 -- 172.21.15.179:0/90259942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda8c15d240 msgr2=0x7fda8c0cbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:14.853 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.852+0000 7fda9359d700 1 --2- 172.21.15.179:0/90259942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda8c15d240 0x7fda8c0cbcc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fda8400cb90 tx=0x7fda840018f0 comp rx=0 tx=0).stop 2023-10-09T06:42:14.853 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.852+0000 7fda9359d700 1 -- 172.21.15.179:0/90259942 shutdown_connections 2023-10-09T06:42:14.853 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.852+0000 7fda9359d700 1 --2- 172.21.15.179:0/90259942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda8c15d240 0x7fda8c0cbcc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:14.853 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.852+0000 7fda9359d700 1 --2- 172.21.15.179:0/90259942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda8c0b16d0 0x7fda8c158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:14.853 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.852+0000 7fda9359d700 1 --2- 172.21.15.179:0/90259942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda8c0b4e70 0x7fda8c0cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:14.853 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.852+0000 7fda9359d700 1 -- 172.21.15.179:0/90259942 >> 172.21.15.179:0/90259942 conn(0x7fda8c0d10c0 msgr2=0x7fda8c158f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:14.853 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.852+0000 7fda9359d700 1 -- 172.21.15.179:0/90259942 shutdown_connections 2023-10-09T06:42:14.853 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:14.852+0000 7fda9359d700 1 -- 172.21.15.179:0/90259942 wait complete. 2023-10-09T06:42:14.869 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new e85eb90c-750f-4d88-a1e6-a6e2d1bf9673 1 2023-10-09T06:42:15.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.047+0000 7f78639ff700 1 Processor -- start 2023-10-09T06:42:15.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.047+0000 7f78639ff700 1 -- start start 2023-10-09T06:42:15.049 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.048+0000 7f78639ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f785c06b160 0x7f785c06b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:15.049 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.048+0000 7f78639ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f785c0637d0 0x7f785c068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:15.049 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.048+0000 7f78639ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785c0ac450 con 0x7f785c06a2b0 2023-10-09T06:42:15.049 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.048+0000 7f78639ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f785c06adc0 con 0x7f785c06b160 2023-10-09T06:42:15.049 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.048+0000 7f78639ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f785c069d00 con 0x7f785c0637d0 2023-10-09T06:42:15.049 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.049+0000 7f7860f9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f785c0637d0 0x7f785c068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:15.049 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.049+0000 7f7860f9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f785c0637d0 0x7f785c068cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:37534/0 (socket says 172.21.15.179:37534) 2023-10-09T06:42:15.049 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.049+0000 7f7860f9a700 1 -- 172.21.15.179:0/3558402524 learned_addr learned my addr 172.21.15.179:0/3558402524 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-09T06:42:15.050 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.049+0000 7f786179b700 1 --2- 172.21.15.179:0/3558402524 >> v2:172.21.15.71:3300/0 conn(0x7f785c06b160 0x7f785c06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:15.054 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.049+0000 7f7860f9a700 1 -- 172.21.15.179:0/3558402524 >> v2:172.21.15.71:3300/0 conn(0x7f785c06b160 msgr2=0x7f785c06b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:15.054 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.049+0000 7f7860f9a700 1 --2- 172.21.15.179:0/3558402524 >> v2:172.21.15.71:3300/0 conn(0x7f785c06b160 0x7f785c06b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.054 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.049+0000 7f7860f9a700 1 -- 172.21.15.179:0/3558402524 >> v1:172.21.15.71:6789/0 conn(0x7f785c06a2b0 legacy=0x7f785c06a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:15.054 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.049+0000 7f7860f9a700 1 -- 172.21.15.179:0/3558402524 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785c068830 con 0x7f785c0637d0 2023-10-09T06:42:15.054 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.049+0000 7f786179b700 1 --2- 172.21.15.179:0/3558402524 >> v2:172.21.15.71:3300/0 conn(0x7f785c06b160 0x7f785c06b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:42:15.054 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.049+0000 7f7860f9a700 1 --2- 172.21.15.179:0/3558402524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f785c0637d0 0x7f785c068cc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f785c0af860 tx=0x7f784c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=997aef1e45eb372 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:15.054 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.050+0000 7f7853fff700 1 -- 172.21.15.179:0/3558402524 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c009e70 con 0x7f785c0637d0 2023-10-09T06:42:15.055 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.050+0000 7f7853fff700 1 -- 172.21.15.179:0/3558402524 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784c00b860 con 0x7f785c0637d0 2023-10-09T06:42:15.055 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.050+0000 7f7853fff700 1 -- 172.21.15.179:0/3558402524 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c00bc20 con 0x7f785c0637d0 2023-10-09T06:42:15.055 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.050+0000 7f78639ff700 1 -- 172.21.15.179:0/3558402524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f785c0637d0 msgr2=0x7f785c068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:15.055 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.050+0000 7f78639ff700 1 --2- 172.21.15.179:0/3558402524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f785c0637d0 0x7f785c068cc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f785c0af860 tx=0x7f784c009250 comp rx=0 tx=0).stop 2023-10-09T06:42:15.055 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.050+0000 7f78639ff700 1 -- 172.21.15.179:0/3558402524 shutdown_connections 2023-10-09T06:42:15.055 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.050+0000 7f78639ff700 1 --2- 172.21.15.179:0/3558402524 >> v2:172.21.15.71:3300/0 conn(0x7f785c06b160 0x7f785c06b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.055 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.050+0000 7f78639ff700 1 --2- 172.21.15.179:0/3558402524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f785c0637d0 0x7f785c068cc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.056 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.050+0000 7f78639ff700 1 -- 172.21.15.179:0/3558402524 >> 172.21.15.179:0/3558402524 conn(0x7f785c06ded0 msgr2=0x7f785c06e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:15.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.051+0000 7f78639ff700 1 -- 172.21.15.179:0/3558402524 shutdown_connections 2023-10-09T06:42:15.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.051+0000 7f78639ff700 1 -- 172.21.15.179:0/3558402524 wait complete. 2023-10-09T06:42:15.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.052+0000 7f78639ff700 1 Processor -- start 2023-10-09T06:42:15.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.052+0000 7f78639ff700 1 -- start start 2023-10-09T06:42:15.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.053+0000 7f78639ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f785c0637d0 0x7f785c16a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:15.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.053+0000 7f78639ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f785c06a2b0 0x7f785c141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:15.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.053+0000 7f78639ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f785c06b160 0x7f785c0b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:15.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.053+0000 7f78639ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785c0c1fe0 con 0x7f785c06b160 2023-10-09T06:42:15.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.053+0000 7f78639ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785c16b840 con 0x7f785c0637d0 2023-10-09T06:42:15.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.053+0000 7f78639ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785c16abc0 con 0x7f785c06a2b0 2023-10-09T06:42:15.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.053+0000 7f7860f9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f785c06a2b0 0x7f785c141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:15.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.053+0000 7f786179b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f785c0637d0 0x7f785c16a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:15.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.053+0000 7f7860f9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f785c06a2b0 0x7f785c141fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:43160/0 (socket says 172.21.15.179:43160) 2023-10-09T06:42:15.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.053+0000 7f7860f9a700 1 -- 172.21.15.179:0/3487981967 learned_addr learned my addr 172.21.15.179:0/3487981967 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-09T06:42:15.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.054+0000 7f7861f9c700 1 --2- 172.21.15.179:0/3487981967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f785c06b160 0x7f785c0b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:15.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.054+0000 7f7860f9a700 1 -- 172.21.15.179:0/3487981967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f785c0637d0 msgr2=0x7f785c16a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:15.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.054+0000 7f7860f9a700 1 --2- 172.21.15.179:0/3487981967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f785c0637d0 0x7f785c16a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.054+0000 7f7860f9a700 1 -- 172.21.15.179:0/3487981967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f785c06b160 msgr2=0x7f785c0b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:15.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.054+0000 7f7860f9a700 1 --2- 172.21.15.179:0/3487981967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f785c06b160 0x7f785c0b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.062 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.054+0000 7f7860f9a700 1 -- 172.21.15.179:0/3487981967 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7858009420 con 0x7f785c06a2b0 2023-10-09T06:42:15.062 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.054+0000 7f786179b700 1 --2- 172.21.15.179:0/3487981967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f785c0637d0 0x7f785c16a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:42:15.062 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.054+0000 7f7860f9a700 1 --2- 172.21.15.179:0/3487981967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f785c06a2b0 0x7f785c141fe0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f785c15d4f0 tx=0x7f784c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:15.062 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.054+0000 7f78517fa700 1 -- 172.21.15.179:0/3487981967 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c01f070 con 0x7f785c06a2b0 2023-10-09T06:42:15.062 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.054+0000 7f78517fa700 1 -- 172.21.15.179:0/3487981967 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784c002f30 con 0x7f785c06a2b0 2023-10-09T06:42:15.062 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.054+0000 7f78517fa700 1 -- 172.21.15.179:0/3487981967 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c000bc0 con 0x7f785c06a2b0 2023-10-09T06:42:15.062 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.054+0000 7f78639ff700 1 -- 172.21.15.179:0/3487981967 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f784c0094f0 con 0x7f785c06a2b0 2023-10-09T06:42:15.062 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.055+0000 7f78639ff700 1 -- 172.21.15.179:0/3487981967 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f785c16b1f0 con 0x7f785c06a2b0 2023-10-09T06:42:15.062 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.055+0000 7f78517fa700 1 -- 172.21.15.179:0/3487981967 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f784c023070 con 0x7f785c06a2b0 2023-10-09T06:42:15.062 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.055+0000 7f78517fa700 1 -- 172.21.15.179:0/3487981967 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f784c0257e0 con 0x7f785c06a2b0 2023-10-09T06:42:15.063 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.056+0000 7f78639ff700 1 -- 172.21.15.179:0/3487981967 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f785c16b9f0 con 0x7f785c06a2b0 2023-10-09T06:42:15.063 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.058+0000 7f78517fa700 1 -- 172.21.15.179:0/3487981967 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f785c16b9f0 con 0x7f785c06a2b0 2023-10-09T06:42:15.094 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:15.094+0000 7f427e4aa180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T06:42:15.143 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.142+0000 7f78639ff700 1 -- 172.21.15.179:0/3487981967 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e85eb90c-750f-4d88-a1e6-a6e2d1bf9673", "id": 1} v 0) v1 -- 0x7f785c04c3c0 con 0x7f785c06a2b0 2023-10-09T06:42:15.148 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.148+0000 7f78517fa700 1 -- 172.21.15.179:0/3487981967 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e85eb90c-750f-4d88-a1e6-a6e2d1bf9673", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f784c02a070 con 0x7f785c06a2b0 2023-10-09T06:42:15.148 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-10-09T06:42:15.149 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.149+0000 7f78639ff700 1 -- 172.21.15.179:0/3487981967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f785c06a2b0 msgr2=0x7f785c141fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:15.149 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.149+0000 7f78639ff700 1 --2- 172.21.15.179:0/3487981967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f785c06a2b0 0x7f785c141fe0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f785c15d4f0 tx=0x7f784c017000 comp rx=0 tx=0).stop 2023-10-09T06:42:15.150 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.149+0000 7f78639ff700 1 -- 172.21.15.179:0/3487981967 shutdown_connections 2023-10-09T06:42:15.150 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.149+0000 7f78639ff700 1 --2- 172.21.15.179:0/3487981967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f785c06b160 0x7f785c0b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.150 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.149+0000 7f78639ff700 1 --2- 172.21.15.179:0/3487981967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f785c0637d0 0x7f785c16a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.150 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.149+0000 7f78639ff700 1 --2- 172.21.15.179:0/3487981967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f785c06a2b0 0x7f785c141fe0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.150 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.149+0000 7f78639ff700 1 -- 172.21.15.179:0/3487981967 >> 172.21.15.179:0/3487981967 conn(0x7f785c06ded0 msgr2=0x7f785c153880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:15.150 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.149+0000 7f78639ff700 1 -- 172.21.15.179:0/3487981967 shutdown_connections 2023-10-09T06:42:15.150 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.149+0000 7f78639ff700 1 -- 172.21.15.179:0/3487981967 wait complete. 2023-10-09T06:42:15.166 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new deab9835-7328-4761-a3fd-13db8c80d559 2 2023-10-09T06:42:15.272 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:15.271+0000 7f427e4aa180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T06:42:15.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.348+0000 7f9bbd59d700 1 Processor -- start 2023-10-09T06:42:15.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.348+0000 7f9bbd59d700 1 -- start start 2023-10-09T06:42:15.351 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.349+0000 7f9bbd59d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9bb80b16d0 0x7f9bb80b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:15.351 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.349+0000 7f9bbd59d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9bb80b33b0 0x7f9bb80b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:15.351 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.349+0000 7f9bbd59d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb80b2080 con 0x7f9bb80b4e70 2023-10-09T06:42:15.351 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.349+0000 7f9bbd59d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb80cfb00 con 0x7f9bb80b16d0 2023-10-09T06:42:15.351 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.349+0000 7f9bbd59d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb80b5c40 con 0x7f9bb80b33b0 2023-10-09T06:42:15.351 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.349+0000 7f9bbcd9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9bb80b33b0 0x7f9bb80b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:15.351 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.350+0000 7f9bbcd9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9bb80b33b0 0x7f9bb80b37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:37550/0 (socket says 172.21.15.179:37550) 2023-10-09T06:42:15.351 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.350+0000 7f9bb7fff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f9bb80b4e70 0x7f9bb80ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:54868/0 (socket says 172.21.15.179:54868) 2023-10-09T06:42:15.351 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.350+0000 7f9bbcd9c700 1 -- 172.21.15.179:0/2231416737 learned_addr learned my addr 172.21.15.179:0/2231416737 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-09T06:42:15.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.350+0000 7f9bb77fe700 1 --2- 172.21.15.179:0/2231416737 >> v2:172.21.15.71:3300/0 conn(0x7f9bb80b16d0 0x7f9bb80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:15.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.350+0000 7f9bbcd9c700 1 -- 172.21.15.179:0/2231416737 >> v2:172.21.15.71:3300/0 conn(0x7f9bb80b16d0 msgr2=0x7f9bb80b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:15.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.350+0000 7f9bbcd9c700 1 --2- 172.21.15.179:0/2231416737 >> v2:172.21.15.71:3300/0 conn(0x7f9bb80b16d0 0x7f9bb80b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.350+0000 7f9bbcd9c700 1 -- 172.21.15.179:0/2231416737 >> v1:172.21.15.179:6789/0 conn(0x7f9bb80b4e70 legacy=0x7f9bb80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:15.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.350+0000 7f9bbcd9c700 1 -- 172.21.15.179:0/2231416737 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb80b5f20 con 0x7f9bb80b33b0 2023-10-09T06:42:15.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.350+0000 7f9bb6ffd700 1 -- 172.21.15.179:0/2231416737 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407014310 0 0) 0x7f9bb80b2080 con 0x7f9bb80b4e70 2023-10-09T06:42:15.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.350+0000 7f9bbcd9c700 1 --2- 172.21.15.179:0/2231416737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb80b33b0 0x7f9bb80b37d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8071380 tx=0x7f9bb0009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da08b06e78cefb94 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:15.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.351+0000 7f9bb6ffd700 1 -- 172.21.15.179:0/2231416737 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb000e070 con 0x7f9bb80b33b0 2023-10-09T06:42:15.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.351+0000 7f9bb6ffd700 1 -- 172.21.15.179:0/2231416737 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb000ba20 con 0x7f9bb80b33b0 2023-10-09T06:42:15.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.351+0000 7f9bb6ffd700 1 -- 172.21.15.179:0/2231416737 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb00092e0 con 0x7f9bb80b33b0 2023-10-09T06:42:15.353 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.351+0000 7f9bbd59d700 1 -- 172.21.15.179:0/2231416737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb80b33b0 msgr2=0x7f9bb80b37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:15.353 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.351+0000 7f9bbd59d700 1 --2- 172.21.15.179:0/2231416737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb80b33b0 0x7f9bb80b37d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8071380 tx=0x7f9bb0009840 comp rx=0 tx=0).stop 2023-10-09T06:42:15.353 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.351+0000 7f9bbd59d700 1 -- 172.21.15.179:0/2231416737 shutdown_connections 2023-10-09T06:42:15.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.351+0000 7f9bbd59d700 1 --2- 172.21.15.179:0/2231416737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb80b33b0 0x7f9bb80b37d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.351+0000 7f9bbd59d700 1 --2- 172.21.15.179:0/2231416737 >> v2:172.21.15.71:3300/0 conn(0x7f9bb80b16d0 0x7f9bb80b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.351+0000 7f9bbd59d700 1 -- 172.21.15.179:0/2231416737 >> 172.21.15.179:0/2231416737 conn(0x7f9bb80d10c0 msgr2=0x7f9bb80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:15.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.351+0000 7f9bbd59d700 1 -- 172.21.15.179:0/2231416737 shutdown_connections 2023-10-09T06:42:15.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.351+0000 7f9bbd59d700 1 -- 172.21.15.179:0/2231416737 wait complete. 2023-10-09T06:42:15.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.353+0000 7f9bbd59d700 1 Processor -- start 2023-10-09T06:42:15.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.353+0000 7f9bbd59d700 1 -- start start 2023-10-09T06:42:15.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.354+0000 7f9bbd59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb80b16d0 0x7f9bb8149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:15.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.354+0000 7f9bbd59d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bb80b33b0 0x7f9bb80c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:15.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.354+0000 7f9bbd59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb80b4e70 0x7f9bb8158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:15.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.354+0000 7f9bbd59d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb816f0d0 con 0x7f9bb80b33b0 2023-10-09T06:42:15.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.354+0000 7f9bbd59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb816ff30 con 0x7f9bb80b4e70 2023-10-09T06:42:15.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.354+0000 7f9bbd59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb816f320 con 0x7f9bb80b16d0 2023-10-09T06:42:15.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.354+0000 7f9bbcd9c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb80b4e70 0x7f9bb8158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:15.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.354+0000 7f9bb7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb80b16d0 0x7f9bb8149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:15.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.354+0000 7f9bbcd9c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb80b4e70 0x7f9bb8158cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:37556/0 (socket says 172.21.15.179:37556) 2023-10-09T06:42:15.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.354+0000 7f9bbcd9c700 1 -- 172.21.15.179:0/2626452968 learned_addr learned my addr 172.21.15.179:0/2626452968 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-09T06:42:15.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.354+0000 7f9bb77fe700 1 --2- 172.21.15.179:0/2626452968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bb80b33b0 0x7f9bb80c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:15.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.354+0000 7f9bbcd9c700 1 -- 172.21.15.179:0/2626452968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb80b16d0 msgr2=0x7f9bb8149c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:15.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.354+0000 7f9bbcd9c700 1 --2- 172.21.15.179:0/2626452968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb80b16d0 0x7f9bb8149c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.354+0000 7f9bbcd9c700 1 -- 172.21.15.179:0/2626452968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bb80b33b0 msgr2=0x7f9bb80c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:15.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.354+0000 7f9bbcd9c700 1 --2- 172.21.15.179:0/2626452968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bb80b33b0 0x7f9bb80c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.354+0000 7f9bbcd9c700 1 -- 172.21.15.179:0/2626452968 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb0009ae0 con 0x7f9bb80b4e70 2023-10-09T06:42:15.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.355+0000 7f9bbcd9c700 1 --2- 172.21.15.179:0/2626452968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb80b4e70 0x7f9bb8158cb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000b6c0 tx=0x7f9bb0018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:15.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.355+0000 7f9b9ffff700 1 -- 172.21.15.179:0/2626452968 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb00078a0 con 0x7f9bb80b4e70 2023-10-09T06:42:15.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.355+0000 7f9b9ffff700 1 -- 172.21.15.179:0/2626452968 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb0007a00 con 0x7f9bb80b4e70 2023-10-09T06:42:15.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.355+0000 7f9b9ffff700 1 -- 172.21.15.179:0/2626452968 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0007dc0 con 0x7f9bb80b4e70 2023-10-09T06:42:15.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.355+0000 7f9bbd59d700 1 -- 172.21.15.179:0/2626452968 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb816f600 con 0x7f9bb80b4e70 2023-10-09T06:42:15.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.355+0000 7f9bbd59d700 1 -- 172.21.15.179:0/2626452968 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb816fbc0 con 0x7f9bb80b4e70 2023-10-09T06:42:15.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.355+0000 7f9b9ffff700 1 -- 172.21.15.179:0/2626452968 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9bb0026670 con 0x7f9bb80b4e70 2023-10-09T06:42:15.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.355+0000 7f9b9ffff700 1 -- 172.21.15.179:0/2626452968 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f9bb0026d50 con 0x7f9bb80b4e70 2023-10-09T06:42:15.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.356+0000 7f9bbd59d700 1 -- 172.21.15.179:0/2626452968 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb8088990 con 0x7f9bb80b4e70 2023-10-09T06:42:15.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.359+0000 7f9b9ffff700 1 -- 172.21.15.179:0/2626452968 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9bb00466d0 con 0x7f9bb80b4e70 2023-10-09T06:42:15.378 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:15.378+0000 7f427e4aa180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T06:42:15.462 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.461+0000 7f9bbd59d700 1 -- 172.21.15.179:0/2626452968 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "deab9835-7328-4761-a3fd-13db8c80d559", "id": 2} v 0) v1 -- 0x7f9bb804bb80 con 0x7f9bb80b4e70 2023-10-09T06:42:15.465 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.464+0000 7f9b9ffff700 1 -- 172.21.15.179:0/2626452968 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "deab9835-7328-4761-a3fd-13db8c80d559", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9bb0035030 con 0x7f9bb80b4e70 2023-10-09T06:42:15.465 INFO:teuthology.orchestra.run.smithi179.stdout:2 2023-10-09T06:42:15.466 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.465+0000 7f9bbd59d700 1 -- 172.21.15.179:0/2626452968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb80b4e70 msgr2=0x7f9bb8158cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:15.466 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.465+0000 7f9bbd59d700 1 --2- 172.21.15.179:0/2626452968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb80b4e70 0x7f9bb8158cb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000b6c0 tx=0x7f9bb0018000 comp rx=0 tx=0).stop 2023-10-09T06:42:15.467 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.466+0000 7f9bbd59d700 1 -- 172.21.15.179:0/2626452968 shutdown_connections 2023-10-09T06:42:15.467 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.466+0000 7f9bbd59d700 1 --2- 172.21.15.179:0/2626452968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb80b4e70 0x7f9bb8158cb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.467 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.466+0000 7f9bbd59d700 1 --2- 172.21.15.179:0/2626452968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb80b16d0 0x7f9bb8149c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.467 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.466+0000 7f9bbd59d700 1 --2- 172.21.15.179:0/2626452968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9bb80b33b0 0x7f9bb80c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.467 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.466+0000 7f9bbd59d700 1 -- 172.21.15.179:0/2626452968 >> 172.21.15.179:0/2626452968 conn(0x7f9bb80d10c0 msgr2=0x7f9bb815c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:15.467 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.466+0000 7f9bbd59d700 1 -- 172.21.15.179:0/2626452968 shutdown_connections 2023-10-09T06:42:15.467 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.466+0000 7f9bbd59d700 1 -- 172.21.15.179:0/2626452968 wait complete. 2023-10-09T06:42:15.482 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 7bb54ddc-5fa5-409f-b399-b3f91f31c295 3 2023-10-09T06:42:15.615 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:15.615+0000 7f427e4aa180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:42:15.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.659+0000 7f4e61b9d700 1 Processor -- start 2023-10-09T06:42:15.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.660+0000 7f4e61b9d700 1 -- start start 2023-10-09T06:42:15.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.661+0000 7f4e61b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4e5c0b4e70 0x7f4e5c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:15.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.661+0000 7f4e61b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c0b16d0 0x7f4e5c0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:15.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.661+0000 7f4e61b9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4e5c15d240 0x7f4e5c15d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:15.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.661+0000 7f4e61b9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e5c0b2080 con 0x7f4e5c15d240 2023-10-09T06:42:15.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.661+0000 7f4e61b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e5c0cfb00 con 0x7f4e5c0b4e70 2023-10-09T06:42:15.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.661+0000 7f4e61b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c0b5c40 con 0x7f4e5c0b16d0 2023-10-09T06:42:15.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.661+0000 7f4e5bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c0b16d0 0x7f4e5c0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:15.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.661+0000 7f4e60b9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4e5c0b4e70 0x7f4e5c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:15.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.661+0000 7f4e60b9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4e5c0b4e70 0x7f4e5c0ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:37566/0 (socket says 172.21.15.179:37566) 2023-10-09T06:42:15.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.661+0000 7f4e5bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c0b16d0 0x7f4e5c0b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:43186/0 (socket says 172.21.15.179:43186) 2023-10-09T06:42:15.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.661+0000 7f4e60b9b700 1 -- 172.21.15.179:0/1609141841 learned_addr learned my addr 172.21.15.179:0/1609141841 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-09T06:42:15.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.661+0000 7f4e6139c700 1 --2- 172.21.15.179:0/1609141841 >> v2:172.21.15.71:3300/0 conn(0x7f4e5c15d240 0x7f4e5c15d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:15.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.662+0000 7f4e60b9b700 1 -- 172.21.15.179:0/1609141841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c0b16d0 msgr2=0x7f4e5c0b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:15.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.662+0000 7f4e60b9b700 1 --2- 172.21.15.179:0/1609141841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c0b16d0 0x7f4e5c0b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.662+0000 7f4e60b9b700 1 -- 172.21.15.179:0/1609141841 >> v2:172.21.15.71:3300/0 conn(0x7f4e5c15d240 msgr2=0x7f4e5c15d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:15.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.662+0000 7f4e60b9b700 1 --2- 172.21.15.179:0/1609141841 >> v2:172.21.15.71:3300/0 conn(0x7f4e5c15d240 0x7f4e5c15d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.662+0000 7f4e60b9b700 1 -- 172.21.15.179:0/1609141841 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5c0b5f20 con 0x7f4e5c0b4e70 2023-10-09T06:42:15.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.662+0000 7f4e5bfff700 1 --2- 172.21.15.179:0/1609141841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c0b16d0 0x7f4e5c0b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:42:15.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.662+0000 7f4e60b9b700 1 --2- 172.21.15.179:0/1609141841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e5c0b4e70 0x7f4e5c0ccff0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c064910 tx=0x7f4e50009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f5cfe48270202e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:15.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.662+0000 7f4e5b7fe700 1 -- 172.21.15.179:0/1609141841 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5000b640 con 0x7f4e5c0b4e70 2023-10-09T06:42:15.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.662+0000 7f4e5b7fe700 1 -- 172.21.15.179:0/1609141841 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5000b7a0 con 0x7f4e5c0b4e70 2023-10-09T06:42:15.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.662+0000 7f4e5b7fe700 1 -- 172.21.15.179:0/1609141841 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5000bb60 con 0x7f4e5c0b4e70 2023-10-09T06:42:15.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.663+0000 7f4e61b9d700 1 -- 172.21.15.179:0/1609141841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e5c0b4e70 msgr2=0x7f4e5c0ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:15.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.663+0000 7f4e61b9d700 1 --2- 172.21.15.179:0/1609141841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e5c0b4e70 0x7f4e5c0ccff0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c064910 tx=0x7f4e50009250 comp rx=0 tx=0).stop 2023-10-09T06:42:15.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.663+0000 7f4e61b9d700 1 -- 172.21.15.179:0/1609141841 shutdown_connections 2023-10-09T06:42:15.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.663+0000 7f4e61b9d700 1 --2- 172.21.15.179:0/1609141841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e5c0b4e70 0x7f4e5c0ccff0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.663+0000 7f4e61b9d700 1 --2- 172.21.15.179:0/1609141841 >> v2:172.21.15.71:3300/0 conn(0x7f4e5c15d240 0x7f4e5c15d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.663+0000 7f4e61b9d700 1 --2- 172.21.15.179:0/1609141841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c0b16d0 0x7f4e5c0b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.663+0000 7f4e61b9d700 1 -- 172.21.15.179:0/1609141841 >> 172.21.15.179:0/1609141841 conn(0x7f4e5c0d10c0 msgr2=0x7f4e5c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:15.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.663+0000 7f4e61b9d700 1 -- 172.21.15.179:0/1609141841 shutdown_connections 2023-10-09T06:42:15.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.663+0000 7f4e61b9d700 1 -- 172.21.15.179:0/1609141841 wait complete. 2023-10-09T06:42:15.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.664+0000 7f4e61b9d700 1 Processor -- start 2023-10-09T06:42:15.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.664+0000 7f4e61b9d700 1 -- start start 2023-10-09T06:42:15.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.665+0000 7f4e61b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c0b16d0 0x7f4e5c145790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:15.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.665+0000 7f4e61b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e5c0b4e70 0x7f4e5c0cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:15.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.665+0000 7f4e61b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e5c15d240 0x7f4e5c15c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:15.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.665+0000 7f4e61b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c0ca6b0 con 0x7f4e5c0b4e70 2023-10-09T06:42:15.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.665+0000 7f4e61b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c146df0 con 0x7f4e5c15d240 2023-10-09T06:42:15.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.665+0000 7f4e61b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c146220 con 0x7f4e5c0b16d0 2023-10-09T06:42:15.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.666+0000 7f4e60b9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c0b16d0 0x7f4e5c145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:15.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.666+0000 7f4e60b9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c0b16d0 0x7f4e5c145790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:43194/0 (socket says 172.21.15.179:43194) 2023-10-09T06:42:15.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.666+0000 7f4e6139c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e5c15d240 0x7f4e5c15c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:15.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.666+0000 7f4e60b9b700 1 -- 172.21.15.179:0/4159840494 learned_addr learned my addr 172.21.15.179:0/4159840494 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-09T06:42:15.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.666+0000 7f4e5bfff700 1 --2- 172.21.15.179:0/4159840494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e5c0b4e70 0x7f4e5c0cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:15.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.666+0000 7f4e60b9b700 1 -- 172.21.15.179:0/4159840494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e5c15d240 msgr2=0x7f4e5c15c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:15.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.666+0000 7f4e60b9b700 1 --2- 172.21.15.179:0/4159840494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e5c15d240 0x7f4e5c15c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.666+0000 7f4e60b9b700 1 -- 172.21.15.179:0/4159840494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e5c0b4e70 msgr2=0x7f4e5c0cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:15.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.666+0000 7f4e60b9b700 1 --2- 172.21.15.179:0/4159840494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e5c0b4e70 0x7f4e5c0cba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.666+0000 7f4e60b9b700 1 -- 172.21.15.179:0/4159840494 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e48009420 con 0x7f4e5c0b16d0 2023-10-09T06:42:15.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.666+0000 7f4e60b9b700 1 --2- 172.21.15.179:0/4159840494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c0b16d0 0x7f4e5c145790 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4e50006fd0 tx=0x7f4e50017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:15.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.667+0000 7f4e58ff9700 1 -- 172.21.15.179:0/4159840494 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5000b910 con 0x7f4e5c0b16d0 2023-10-09T06:42:15.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.667+0000 7f4e58ff9700 1 -- 172.21.15.179:0/4159840494 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5000ba70 con 0x7f4e5c0b16d0 2023-10-09T06:42:15.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.667+0000 7f4e58ff9700 1 -- 172.21.15.179:0/4159840494 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e50011630 con 0x7f4e5c0b16d0 2023-10-09T06:42:15.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.667+0000 7f4e61b9d700 1 -- 172.21.15.179:0/4159840494 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e500094f0 con 0x7f4e5c0b16d0 2023-10-09T06:42:15.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.667+0000 7f4e61b9d700 1 -- 172.21.15.179:0/4159840494 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5c146a80 con 0x7f4e5c0b16d0 2023-10-09T06:42:15.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.667+0000 7f4e58ff9700 1 -- 172.21.15.179:0/4159840494 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4e500119a0 con 0x7f4e5c0b16d0 2023-10-09T06:42:15.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.667+0000 7f4e58ff9700 1 -- 172.21.15.179:0/4159840494 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f4e5002d9d0 con 0x7f4e5c0b16d0 2023-10-09T06:42:15.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.668+0000 7f4e61b9d700 1 -- 172.21.15.179:0/4159840494 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5c088990 con 0x7f4e5c0b16d0 2023-10-09T06:42:15.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.670+0000 7f4e58ff9700 1 -- 172.21.15.179:0/4159840494 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4e50032060 con 0x7f4e5c0b16d0 2023-10-09T06:42:15.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.770+0000 7f4e61b9d700 1 -- 172.21.15.179:0/4159840494 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7bb54ddc-5fa5-409f-b399-b3f91f31c295", "id": 3} v 0) v1 -- 0x7f4e5c04bb80 con 0x7f4e5c0b16d0 2023-10-09T06:42:15.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.774+0000 7f4e58ff9700 1 -- 172.21.15.179:0/4159840494 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7bb54ddc-5fa5-409f-b399-b3f91f31c295", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4e50028070 con 0x7f4e5c0b16d0 2023-10-09T06:42:15.775 INFO:teuthology.orchestra.run.smithi179.stdout:3 2023-10-09T06:42:15.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.775+0000 7f4e61b9d700 1 -- 172.21.15.179:0/4159840494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c0b16d0 msgr2=0x7f4e5c145790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:15.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.775+0000 7f4e61b9d700 1 --2- 172.21.15.179:0/4159840494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c0b16d0 0x7f4e5c145790 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4e50006fd0 tx=0x7f4e50017000 comp rx=0 tx=0).stop 2023-10-09T06:42:15.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.775+0000 7f4e61b9d700 1 -- 172.21.15.179:0/4159840494 shutdown_connections 2023-10-09T06:42:15.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.775+0000 7f4e61b9d700 1 --2- 172.21.15.179:0/4159840494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e5c15d240 0x7f4e5c15c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.775+0000 7f4e61b9d700 1 --2- 172.21.15.179:0/4159840494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c0b16d0 0x7f4e5c145790 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.775+0000 7f4e61b9d700 1 --2- 172.21.15.179:0/4159840494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e5c0b4e70 0x7f4e5c0cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.775+0000 7f4e61b9d700 1 -- 172.21.15.179:0/4159840494 >> 172.21.15.179:0/4159840494 conn(0x7f4e5c0d10c0 msgr2=0x7f4e5c069590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:15.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.775+0000 7f4e61b9d700 1 -- 172.21.15.179:0/4159840494 shutdown_connections 2023-10-09T06:42:15.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.775+0000 7f4e61b9d700 1 -- 172.21.15.179:0/4159840494 wait complete. 2023-10-09T06:42:15.792 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 665ff040-e3f7-4797-aabb-4da836fec1b4 4 2023-10-09T06:42:15.804 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:15.804+0000 7feaa363f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T06:42:15.850 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:15.850+0000 7f427e4aa180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T06:42:15.948 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:15.948+0000 7f427e4aa180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T06:42:15.967 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:15.967+0000 7feaa363f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T06:42:15.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.969+0000 7f254d59d700 1 Processor -- start 2023-10-09T06:42:15.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.969+0000 7f254d59d700 1 -- start start 2023-10-09T06:42:15.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.970+0000 7f254d59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25480b4e70 0x7f25480ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:15.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.970+0000 7f254d59d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f25480b16d0 0x7f25480b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:15.972 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.970+0000 7f254d59d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25480b2080 con 0x7f254815d240 2023-10-09T06:42:15.972 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.970+0000 7f254d59d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25480cfb00 con 0x7f25480b16d0 2023-10-09T06:42:15.972 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.970+0000 7f254d59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25480b5c40 con 0x7f25480b4e70 2023-10-09T06:42:15.972 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.970+0000 7f25477fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f25480b16d0 0x7f25480b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:15.972 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.970+0000 7f2547fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25480b4e70 0x7f25480ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:15.972 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.970+0000 7f2547fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25480b4e70 0x7f25480ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:43200/0 (socket says 172.21.15.179:43200) 2023-10-09T06:42:15.972 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.970+0000 7f25477fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f25480b16d0 0x7f25480b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:37584/0 (socket says 172.21.15.179:37584) 2023-10-09T06:42:15.972 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.970+0000 7f2547fff700 1 -- 172.21.15.179:0/1027014872 learned_addr learned my addr 172.21.15.179:0/1027014872 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-09T06:42:15.972 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.971+0000 7f25477fe700 1 -- 172.21.15.179:0/1027014872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25480b4e70 msgr2=0x7f25480ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:15.972 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.971+0000 7f25477fe700 1 --2- 172.21.15.179:0/1027014872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25480b4e70 0x7f25480ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.972 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.971+0000 7f25477fe700 1 -- 172.21.15.179:0/1027014872 >> v1:172.21.15.179:6789/0 conn(0x7f254815d240 legacy=0x7f254815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:15.973 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.971+0000 7f25477fe700 1 -- 172.21.15.179:0/1027014872 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25480b5f20 con 0x7f25480b16d0 2023-10-09T06:42:15.973 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.971+0000 7f2547fff700 1 --2- 172.21.15.179:0/1027014872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25480b4e70 0x7f25480ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:42:15.973 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.971+0000 7f25477fe700 1 --2- 172.21.15.179:0/1027014872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25480b16d0 0x7f25480b1b40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f253c0098e0 tx=0x7f253c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bed9422dd7ad7c40 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:15.973 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.971+0000 7f2546ffd700 1 -- 172.21.15.179:0/1027014872 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c00b640 con 0x7f25480b16d0 2023-10-09T06:42:15.973 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.971+0000 7f2546ffd700 1 -- 172.21.15.179:0/1027014872 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253c00b7a0 con 0x7f25480b16d0 2023-10-09T06:42:15.973 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.971+0000 7f2546ffd700 1 -- 172.21.15.179:0/1027014872 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c00bb40 con 0x7f25480b16d0 2023-10-09T06:42:15.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.972+0000 7f254d59d700 1 -- 172.21.15.179:0/1027014872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25480b16d0 msgr2=0x7f25480b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:15.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.972+0000 7f254d59d700 1 --2- 172.21.15.179:0/1027014872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25480b16d0 0x7f25480b1b40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f253c0098e0 tx=0x7f253c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.972+0000 7f254d59d700 1 -- 172.21.15.179:0/1027014872 shutdown_connections 2023-10-09T06:42:15.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.972+0000 7f254d59d700 1 --2- 172.21.15.179:0/1027014872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25480b4e70 0x7f25480ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.972+0000 7f254d59d700 1 --2- 172.21.15.179:0/1027014872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25480b16d0 0x7f25480b1b40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.972+0000 7f254d59d700 1 -- 172.21.15.179:0/1027014872 >> 172.21.15.179:0/1027014872 conn(0x7f25480d10c0 msgr2=0x7f25480affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:15.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.972+0000 7f254d59d700 1 -- 172.21.15.179:0/1027014872 shutdown_connections 2023-10-09T06:42:15.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.972+0000 7f254d59d700 1 -- 172.21.15.179:0/1027014872 wait complete. 2023-10-09T06:42:15.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.974+0000 7f254d59d700 1 Processor -- start 2023-10-09T06:42:15.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.974+0000 7f254d59d700 1 -- start start 2023-10-09T06:42:15.978 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.975+0000 7f254d59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25480b16d0 0x7f2548153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:15.979 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.975+0000 7f254d59d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25480b4e70 0x7f2548169f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:15.979 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.975+0000 7f254d59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f254815d240 0x7f25481553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:15.979 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.975+0000 7f254d59d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254816d370 con 0x7f25480b4e70 2023-10-09T06:42:15.979 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.975+0000 7f254d59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2548154f40 con 0x7f254815d240 2023-10-09T06:42:15.979 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.975+0000 7f254d59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2548154610 con 0x7f25480b16d0 2023-10-09T06:42:15.979 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.975+0000 7f2547fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25480b16d0 0x7f2548153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:15.979 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.975+0000 7f2547fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25480b16d0 0x7f2548153570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:43208/0 (socket says 172.21.15.179:43208) 2023-10-09T06:42:15.979 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.975+0000 7f2547fff700 1 -- 172.21.15.179:0/1600820565 learned_addr learned my addr 172.21.15.179:0/1600820565 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-09T06:42:15.979 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.975+0000 7f254cd9c700 1 --2- 172.21.15.179:0/1600820565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f254815d240 0x7f25481553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:15.979 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.975+0000 7f25477fe700 1 --2- 172.21.15.179:0/1600820565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25480b4e70 0x7f2548169f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:15.979 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.975+0000 7f2547fff700 1 -- 172.21.15.179:0/1600820565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f254815d240 msgr2=0x7f25481553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:15.980 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.975+0000 7f2547fff700 1 --2- 172.21.15.179:0/1600820565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f254815d240 0x7f25481553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.980 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.975+0000 7f2547fff700 1 -- 172.21.15.179:0/1600820565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25480b4e70 msgr2=0x7f2548169f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:15.980 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.975+0000 7f2547fff700 1 --2- 172.21.15.179:0/1600820565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25480b4e70 0x7f2548169f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:15.980 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.975+0000 7f2547fff700 1 -- 172.21.15.179:0/1600820565 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25380094f0 con 0x7f25480b16d0 2023-10-09T06:42:15.980 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.976+0000 7f2547fff700 1 --2- 172.21.15.179:0/1600820565 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25480b16d0 0x7f2548153570 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f253800ec50 tx=0x7f2538009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:15.980 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.976+0000 7f252ffff700 1 -- 172.21.15.179:0/1600820565 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25380097d0 con 0x7f25480b16d0 2023-10-09T06:42:15.980 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.976+0000 7f252ffff700 1 -- 172.21.15.179:0/1600820565 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253800c850 con 0x7f25480b16d0 2023-10-09T06:42:15.980 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.976+0000 7f252ffff700 1 -- 172.21.15.179:0/1600820565 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253800cbf0 con 0x7f25480b16d0 2023-10-09T06:42:15.980 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.976+0000 7f254d59d700 1 -- 172.21.15.179:0/1600820565 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253c009420 con 0x7f25480b16d0 2023-10-09T06:42:15.980 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.976+0000 7f254d59d700 1 -- 172.21.15.179:0/1600820565 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2548154bd0 con 0x7f25480b16d0 2023-10-09T06:42:15.980 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.976+0000 7f252ffff700 1 -- 172.21.15.179:0/1600820565 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f2538005c80 con 0x7f25480b16d0 2023-10-09T06:42:15.981 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.976+0000 7f252ffff700 1 -- 172.21.15.179:0/1600820565 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f25380067a0 con 0x7f25480b16d0 2023-10-09T06:42:15.981 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.977+0000 7f254d59d700 1 -- 172.21.15.179:0/1600820565 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2548088990 con 0x7f25480b16d0 2023-10-09T06:42:15.981 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:15.980+0000 7f252ffff700 1 -- 172.21.15.179:0/1600820565 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f2538021060 con 0x7f25480b16d0 2023-10-09T06:42:16.061 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:16.061+0000 7feaa363f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T06:42:16.064 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.063+0000 7f254d59d700 1 -- 172.21.15.179:0/1600820565 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "665ff040-e3f7-4797-aabb-4da836fec1b4", "id": 4} v 0) v1 -- 0x7f254804bb80 con 0x7f25480b16d0 2023-10-09T06:42:16.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.068+0000 7f252ffff700 1 -- 172.21.15.179:0/1600820565 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "665ff040-e3f7-4797-aabb-4da836fec1b4", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2538017070 con 0x7f25480b16d0 2023-10-09T06:42:16.068 INFO:teuthology.orchestra.run.smithi179.stdout:4 2023-10-09T06:42:16.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.069+0000 7f254d59d700 1 -- 172.21.15.179:0/1600820565 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25480b16d0 msgr2=0x7f2548153570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:16.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.069+0000 7f254d59d700 1 --2- 172.21.15.179:0/1600820565 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25480b16d0 0x7f2548153570 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f253800ec50 tx=0x7f2538009250 comp rx=0 tx=0).stop 2023-10-09T06:42:16.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.069+0000 7f254d59d700 1 -- 172.21.15.179:0/1600820565 shutdown_connections 2023-10-09T06:42:16.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.069+0000 7f254d59d700 1 --2- 172.21.15.179:0/1600820565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f254815d240 0x7f25481553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.069+0000 7f254d59d700 1 --2- 172.21.15.179:0/1600820565 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25480b16d0 0x7f2548153570 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.069+0000 7f254d59d700 1 --2- 172.21.15.179:0/1600820565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25480b4e70 0x7f2548169f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.069+0000 7f254d59d700 1 -- 172.21.15.179:0/1600820565 >> 172.21.15.179:0/1600820565 conn(0x7f25480d10c0 msgr2=0x7f254815c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:16.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.069+0000 7f254d59d700 1 -- 172.21.15.179:0/1600820565 shutdown_connections 2023-10-09T06:42:16.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.069+0000 7f254d59d700 1 -- 172.21.15.179:0/1600820565 wait complete. 2023-10-09T06:42:16.086 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 2cc5c3c9-78f0-4a52-8f99-5c9917f54e72 5 2023-10-09T06:42:16.120 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:16.120+0000 7f427e4aa180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T06:42:16.244 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:16.243+0000 7f427e4aa180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T06:42:16.266 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.266+0000 7f1d1ed9d700 1 Processor -- start 2023-10-09T06:42:16.267 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.266+0000 7f1d1ed9d700 1 -- start start 2023-10-09T06:42:16.269 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.267+0000 7f1d1ed9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d180b4e70 0x7f1d180ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:16.269 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.268+0000 7f1d1ed9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1d180b1b40 0x7f1d1815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:16.269 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.268+0000 7f1d1ed9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d180cfb00 con 0x7f1d180b16d0 2023-10-09T06:42:16.269 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.268+0000 7f1d1ed9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d180b5c40 con 0x7f1d180b1b40 2023-10-09T06:42:16.269 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.268+0000 7f1d1ed9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d180b5f20 con 0x7f1d180b4e70 2023-10-09T06:42:16.269 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.268+0000 7f1d1dd9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d180b4e70 0x7f1d180ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:16.269 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.268+0000 7f1d1dd9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d180b4e70 0x7f1d180ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:43222/0 (socket says 172.21.15.179:43222) 2023-10-09T06:42:16.269 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.268+0000 7f1d1d59a700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f1d180b16d0 0x7f1d1815d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:54882/0 (socket says 172.21.15.179:54882) 2023-10-09T06:42:16.269 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.268+0000 7f1d1dd9b700 1 -- 172.21.15.179:0/329018116 learned_addr learned my addr 172.21.15.179:0/329018116 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-09T06:42:16.270 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.268+0000 7f1d1e59c700 1 --2- 172.21.15.179:0/329018116 >> v2:172.21.15.71:3300/0 conn(0x7f1d180b1b40 0x7f1d1815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:16.270 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.268+0000 7f1d1dd9b700 1 -- 172.21.15.179:0/329018116 >> v2:172.21.15.71:3300/0 conn(0x7f1d180b1b40 msgr2=0x7f1d1815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:16.270 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.268+0000 7f1d1dd9b700 1 --2- 172.21.15.179:0/329018116 >> v2:172.21.15.71:3300/0 conn(0x7f1d180b1b40 0x7f1d1815d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.270 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.268+0000 7f1d1dd9b700 1 -- 172.21.15.179:0/329018116 >> v1:172.21.15.179:6789/0 conn(0x7f1d180b16d0 legacy=0x7f1d1815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:16.270 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.268+0000 7f1d1dd9b700 1 -- 172.21.15.179:0/329018116 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d180b6200 con 0x7f1d180b4e70 2023-10-09T06:42:16.270 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.268+0000 7f1d1cd99700 1 -- 172.21.15.179:0/329018116 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438852584 0 0) 0x7f1d180cfb00 con 0x7f1d180b16d0 2023-10-09T06:42:16.270 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.269+0000 7f1d1dd9b700 1 --2- 172.21.15.179:0/329018116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d180b4e70 0x7f1d180ccff0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1d140099b0 tx=0x7f1d14009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65f3a37a25166016 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:16.271 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.269+0000 7f1d1cd99700 1 -- 172.21.15.179:0/329018116 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d14009ea0 con 0x7f1d180b4e70 2023-10-09T06:42:16.271 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.269+0000 7f1d1cd99700 1 -- 172.21.15.179:0/329018116 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1400b860 con 0x7f1d180b4e70 2023-10-09T06:42:16.272 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.269+0000 7f1d1cd99700 1 -- 172.21.15.179:0/329018116 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1400bc00 con 0x7f1d180b4e70 2023-10-09T06:42:16.272 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.269+0000 7f1d1ed9d700 1 -- 172.21.15.179:0/329018116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d180b4e70 msgr2=0x7f1d180ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:16.272 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.269+0000 7f1d1ed9d700 1 --2- 172.21.15.179:0/329018116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d180b4e70 0x7f1d180ccff0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1d140099b0 tx=0x7f1d14009250 comp rx=0 tx=0).stop 2023-10-09T06:42:16.272 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.270+0000 7f1d1ed9d700 1 -- 172.21.15.179:0/329018116 shutdown_connections 2023-10-09T06:42:16.272 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.270+0000 7f1d1ed9d700 1 --2- 172.21.15.179:0/329018116 >> v2:172.21.15.71:3300/0 conn(0x7f1d180b1b40 0x7f1d1815d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.272 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.270+0000 7f1d1ed9d700 1 --2- 172.21.15.179:0/329018116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d180b4e70 0x7f1d180ccff0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.272 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.270+0000 7f1d1ed9d700 1 -- 172.21.15.179:0/329018116 >> 172.21.15.179:0/329018116 conn(0x7f1d180d10c0 msgr2=0x7f1d180affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:16.272 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.270+0000 7f1d1ed9d700 1 -- 172.21.15.179:0/329018116 shutdown_connections 2023-10-09T06:42:16.272 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.270+0000 7f1d1ed9d700 1 -- 172.21.15.179:0/329018116 wait complete. 2023-10-09T06:42:16.272 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.271+0000 7f1d1ed9d700 1 Processor -- start 2023-10-09T06:42:16.272 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.271+0000 7f1d1ed9d700 1 -- start start 2023-10-09T06:42:16.274 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.272+0000 7f1d1ed9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d180b16d0 0x7f1d180cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:16.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.272+0000 7f1d1ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d180b1b40 0x7f1d1815e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:16.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.272+0000 7f1d1ed9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d180b4e70 0x7f1d1815e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:16.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.272+0000 7f1d1ed9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d180c5fa0 con 0x7f1d180b1b40 2023-10-09T06:42:16.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.272+0000 7f1d1ed9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d180c5390 con 0x7f1d180b16d0 2023-10-09T06:42:16.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.272+0000 7f1d1ed9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d180c5670 con 0x7f1d180b4e70 2023-10-09T06:42:16.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.272+0000 7f1d1dd9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d180b16d0 0x7f1d180cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:16.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.272+0000 7f1d1dd9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d180b16d0 0x7f1d180cbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:37602/0 (socket says 172.21.15.179:37602) 2023-10-09T06:42:16.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.272+0000 7f1d1dd9b700 1 -- 172.21.15.179:0/1530222933 learned_addr learned my addr 172.21.15.179:0/1530222933 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-09T06:42:16.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.272+0000 7f1d1e59c700 1 --2- 172.21.15.179:0/1530222933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d180b4e70 0x7f1d1815e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:16.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.272+0000 7f1d1d59a700 1 --2- 172.21.15.179:0/1530222933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d180b1b40 0x7f1d1815e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:16.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.273+0000 7f1d1dd9b700 1 -- 172.21.15.179:0/1530222933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d180b4e70 msgr2=0x7f1d1815e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:16.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.273+0000 7f1d1dd9b700 1 --2- 172.21.15.179:0/1530222933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d180b4e70 0x7f1d1815e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.273+0000 7f1d1dd9b700 1 -- 172.21.15.179:0/1530222933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d180b1b40 msgr2=0x7f1d1815e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:16.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.273+0000 7f1d1dd9b700 1 --2- 172.21.15.179:0/1530222933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d180b1b40 0x7f1d1815e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.273+0000 7f1d1dd9b700 1 -- 172.21.15.179:0/1530222933 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d140094f0 con 0x7f1d180b16d0 2023-10-09T06:42:16.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.273+0000 7f1d1dd9b700 1 --2- 172.21.15.179:0/1530222933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d180b16d0 0x7f1d180cbfa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009290 tx=0x7f1d14017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:16.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.273+0000 7f1d0dffb700 1 -- 172.21.15.179:0/1530222933 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1400bbe0 con 0x7f1d180b16d0 2023-10-09T06:42:16.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.273+0000 7f1d0dffb700 1 -- 172.21.15.179:0/1530222933 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d14011420 con 0x7f1d180b16d0 2023-10-09T06:42:16.277 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.273+0000 7f1d0dffb700 1 -- 172.21.15.179:0/1530222933 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d140117c0 con 0x7f1d180b16d0 2023-10-09T06:42:16.277 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.273+0000 7f1d1ed9d700 1 -- 172.21.15.179:0/1530222933 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d180c5950 con 0x7f1d180b16d0 2023-10-09T06:42:16.277 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.274+0000 7f1d1ed9d700 1 -- 172.21.15.179:0/1530222933 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d180c9870 con 0x7f1d180b16d0 2023-10-09T06:42:16.277 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.274+0000 7f1d0dffb700 1 -- 172.21.15.179:0/1530222933 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1d1402e3f0 con 0x7f1d180b16d0 2023-10-09T06:42:16.277 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.274+0000 7f1d0dffb700 1 -- 172.21.15.179:0/1530222933 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f1d14011db0 con 0x7f1d180b16d0 2023-10-09T06:42:16.277 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.275+0000 7f1d1ed9d700 1 -- 172.21.15.179:0/1530222933 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d18088990 con 0x7f1d180b16d0 2023-10-09T06:42:16.277 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.277+0000 7f1d0dffb700 1 -- 172.21.15.179:0/1530222933 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f1d14033060 con 0x7f1d180b16d0 2023-10-09T06:42:16.282 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:16.283+0000 7feaa363f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:42:16.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.362+0000 7f1d1ed9d700 1 -- 172.21.15.179:0/1530222933 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2cc5c3c9-78f0-4a52-8f99-5c9917f54e72", "id": 5} v 0) v1 -- 0x7f1d1804bb80 con 0x7f1d180b16d0 2023-10-09T06:42:16.371 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.370+0000 7f1d0dffb700 1 -- 172.21.15.179:0/1530222933 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2cc5c3c9-78f0-4a52-8f99-5c9917f54e72", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1d14015020 con 0x7f1d180b16d0 2023-10-09T06:42:16.371 INFO:teuthology.orchestra.run.smithi179.stdout:5 2023-10-09T06:42:16.372 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.371+0000 7f1d1ed9d700 1 -- 172.21.15.179:0/1530222933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d180b16d0 msgr2=0x7f1d180cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:16.372 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.371+0000 7f1d1ed9d700 1 --2- 172.21.15.179:0/1530222933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d180b16d0 0x7f1d180cbfa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009290 tx=0x7f1d14017000 comp rx=0 tx=0).stop 2023-10-09T06:42:16.372 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.371+0000 7f1d1ed9d700 1 -- 172.21.15.179:0/1530222933 shutdown_connections 2023-10-09T06:42:16.372 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.371+0000 7f1d1ed9d700 1 --2- 172.21.15.179:0/1530222933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d180b4e70 0x7f1d1815e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.372 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.371+0000 7f1d1ed9d700 1 --2- 172.21.15.179:0/1530222933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d180b16d0 0x7f1d180cbfa0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.373 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.371+0000 7f1d1ed9d700 1 --2- 172.21.15.179:0/1530222933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d180b1b40 0x7f1d1815e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.373 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.372+0000 7f1d1ed9d700 1 -- 172.21.15.179:0/1530222933 >> 172.21.15.179:0/1530222933 conn(0x7f1d180d10c0 msgr2=0x7f1d180b53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:16.373 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.372+0000 7f1d1ed9d700 1 -- 172.21.15.179:0/1530222933 shutdown_connections 2023-10-09T06:42:16.373 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.372+0000 7f1d1ed9d700 1 -- 172.21.15.179:0/1530222933 wait complete. 2023-10-09T06:42:16.389 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 42ca831e-7ec1-41af-b57d-5347b8474863 6 2023-10-09T06:42:16.494 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:16.494+0000 7feaa363f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T06:42:16.587 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:16.587+0000 7feaa363f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T06:42:16.606 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.606+0000 7f2f07fff700 1 Processor -- start 2023-10-09T06:42:16.606 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.606+0000 7f2f07fff700 1 -- start start 2023-10-09T06:42:16.608 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.607+0000 7f2f07fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2f08159d90 0x7f2f0806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:16.608 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.607+0000 7f2f07fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2f08153f30 0x7f2f0815a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:16.608 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.607+0000 7f2f07fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0806c370 con 0x7f2f0806bf20 2023-10-09T06:42:16.608 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.607+0000 7f2f07fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0815d700 con 0x7f2f08153f30 2023-10-09T06:42:16.608 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.607+0000 7f2f07fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0815d9e0 con 0x7f2f08159d90 2023-10-09T06:42:16.608 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.607+0000 7f2f06ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2f08159d90 0x7f2f0806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:16.608 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.608+0000 7f2f06ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2f08159d90 0x7f2f0806b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:37614/0 (socket says 172.21.15.179:37614) 2023-10-09T06:42:16.609 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.608+0000 7f2f06ffd700 1 -- 172.21.15.179:0/2585221082 learned_addr learned my addr 172.21.15.179:0/2585221082 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-09T06:42:16.609 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.608+0000 7f2f067fc700 1 --1- 172.21.15.179:0/2585221082 >> v1:172.21.15.179:6789/0 conn(0x7f2f0806bf20 0x7f2f08153820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:54886/0 (socket says 172.21.15.179:54886) 2023-10-09T06:42:16.609 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.608+0000 7f2f077fe700 1 --2- 172.21.15.179:0/2585221082 >> v2:172.21.15.71:3300/0 conn(0x7f2f08153f30 0x7f2f0815a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:16.610 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.608+0000 7f2f06ffd700 1 -- 172.21.15.179:0/2585221082 >> v2:172.21.15.71:3300/0 conn(0x7f2f08153f30 msgr2=0x7f2f0815a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:16.610 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.608+0000 7f2f06ffd700 1 --2- 172.21.15.179:0/2585221082 >> v2:172.21.15.71:3300/0 conn(0x7f2f08153f30 0x7f2f0815a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.610 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.608+0000 7f2f06ffd700 1 -- 172.21.15.179:0/2585221082 >> v1:172.21.15.179:6789/0 conn(0x7f2f0806bf20 legacy=0x7f2f08153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:16.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.608+0000 7f2f05ffb700 1 -- 172.21.15.179:0/2585221082 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3219998818 0 0) 0x7f2f0806c370 con 0x7f2f0806bf20 2023-10-09T06:42:16.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.608+0000 7f2f06ffd700 1 -- 172.21.15.179:0/2585221082 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0815dcc0 con 0x7f2f08159d90 2023-10-09T06:42:16.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.608+0000 7f2f06ffd700 1 --2- 172.21.15.179:0/2585221082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f08159d90 0x7f2f0806b9e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2f0806fd50 tx=0x7f2ef8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6c790d774d0ed78 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:16.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.608+0000 7f2f05ffb700 1 -- 172.21.15.179:0/2585221082 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8009e70 con 0x7f2f08159d90 2023-10-09T06:42:16.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.609+0000 7f2f05ffb700 1 -- 172.21.15.179:0/2585221082 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef800b860 con 0x7f2f08159d90 2023-10-09T06:42:16.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.609+0000 7f2f05ffb700 1 -- 172.21.15.179:0/2585221082 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef800bc20 con 0x7f2f08159d90 2023-10-09T06:42:16.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.609+0000 7f2f07fff700 1 -- 172.21.15.179:0/2585221082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f08159d90 msgr2=0x7f2f0806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:16.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.609+0000 7f2f07fff700 1 --2- 172.21.15.179:0/2585221082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f08159d90 0x7f2f0806b9e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2f0806fd50 tx=0x7f2ef8009250 comp rx=0 tx=0).stop 2023-10-09T06:42:16.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.609+0000 7f2f07fff700 1 -- 172.21.15.179:0/2585221082 shutdown_connections 2023-10-09T06:42:16.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.609+0000 7f2f07fff700 1 --2- 172.21.15.179:0/2585221082 >> v2:172.21.15.71:3300/0 conn(0x7f2f08153f30 0x7f2f0815a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.609+0000 7f2f07fff700 1 --2- 172.21.15.179:0/2585221082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f08159d90 0x7f2f0806b9e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.609+0000 7f2f07fff700 1 -- 172.21.15.179:0/2585221082 >> 172.21.15.179:0/2585221082 conn(0x7f2f080ce470 msgr2=0x7f2f080ce870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:16.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.609+0000 7f2f07fff700 1 -- 172.21.15.179:0/2585221082 shutdown_connections 2023-10-09T06:42:16.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.609+0000 7f2f07fff700 1 -- 172.21.15.179:0/2585221082 wait complete. 2023-10-09T06:42:16.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.611+0000 7f2f07fff700 1 Processor -- start 2023-10-09T06:42:16.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.611+0000 7f2f07fff700 1 -- start start 2023-10-09T06:42:16.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.612+0000 7f2f07fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f0806bf20 0x7f2f080ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:16.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.612+0000 7f2f07fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f08153f30 0x7f2f081554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:16.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.612+0000 7f2f07fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f08159d90 0x7f2f080b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:16.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.612+0000 7f2f07fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f08169f30 con 0x7f2f08153f30 2023-10-09T06:42:16.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.612+0000 7f2f07fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f08154450 con 0x7f2f08159d90 2023-10-09T06:42:16.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.612+0000 7f2f07fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f08154730 con 0x7f2f0806bf20 2023-10-09T06:42:16.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.612+0000 7f2f077fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f08159d90 0x7f2f080b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:16.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.612+0000 7f2f06ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f0806bf20 0x7f2f080ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:16.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.612+0000 7f2f077fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f08159d90 0x7f2f080b1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:37616/0 (socket says 172.21.15.179:37616) 2023-10-09T06:42:16.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.612+0000 7f2f06ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f0806bf20 0x7f2f080ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:43246/0 (socket says 172.21.15.179:43246) 2023-10-09T06:42:16.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.612+0000 7f2f077fe700 1 -- 172.21.15.179:0/2788172241 learned_addr learned my addr 172.21.15.179:0/2788172241 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-09T06:42:16.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.612+0000 7f2f067fc700 1 --2- 172.21.15.179:0/2788172241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f08153f30 0x7f2f081554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:16.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.613+0000 7f2f077fe700 1 -- 172.21.15.179:0/2788172241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f0806bf20 msgr2=0x7f2f080ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:16.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.613+0000 7f2f077fe700 1 --2- 172.21.15.179:0/2788172241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f0806bf20 0x7f2f080ca260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.613+0000 7f2f077fe700 1 -- 172.21.15.179:0/2788172241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f08153f30 msgr2=0x7f2f081554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:16.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.613+0000 7f2f077fe700 1 --2- 172.21.15.179:0/2788172241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f08153f30 0x7f2f081554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.613+0000 7f2f077fe700 1 -- 172.21.15.179:0/2788172241 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef80094f0 con 0x7f2f08159d90 2023-10-09T06:42:16.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.613+0000 7f2f077fe700 1 --2- 172.21.15.179:0/2788172241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f08159d90 0x7f2f080b1210 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2f00009e90 tx=0x7f2f0000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:16.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.613+0000 7f2eeeffd700 1 -- 172.21.15.179:0/2788172241 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000caa0 con 0x7f2f08159d90 2023-10-09T06:42:16.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.613+0000 7f2eeeffd700 1 -- 172.21.15.179:0/2788172241 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0000f040 con 0x7f2f08159d90 2023-10-09T06:42:16.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.613+0000 7f2eeeffd700 1 -- 172.21.15.179:0/2788172241 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000ce50 con 0x7f2f08159d90 2023-10-09T06:42:16.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.613+0000 7f2f07fff700 1 -- 172.21.15.179:0/2788172241 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f08154a10 con 0x7f2f08159d90 2023-10-09T06:42:16.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.613+0000 7f2f07fff700 1 -- 172.21.15.179:0/2788172241 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f08154fd0 con 0x7f2f08159d90 2023-10-09T06:42:16.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.614+0000 7f2eeeffd700 1 -- 172.21.15.179:0/2788172241 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f2f00014690 con 0x7f2f08159d90 2023-10-09T06:42:16.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.614+0000 7f2eeeffd700 1 -- 172.21.15.179:0/2788172241 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f2f00014940 con 0x7f2f08159d90 2023-10-09T06:42:16.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.615+0000 7f2f07fff700 1 -- 172.21.15.179:0/2788172241 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f081551f0 con 0x7f2f08159d90 2023-10-09T06:42:16.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.617+0000 7f2eeeffd700 1 -- 172.21.15.179:0/2788172241 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f2f00018020 con 0x7f2f08159d90 2023-10-09T06:42:16.718 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.718+0000 7f2f07fff700 1 -- 172.21.15.179:0/2788172241 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "42ca831e-7ec1-41af-b57d-5347b8474863", "id": 6} v 0) v1 -- 0x7f2f08143220 con 0x7f2f08159d90 2023-10-09T06:42:16.723 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.723+0000 7f2eeeffd700 1 -- 172.21.15.179:0/2788172241 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "42ca831e-7ec1-41af-b57d-5347b8474863", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2f00014bf0 con 0x7f2f08159d90 2023-10-09T06:42:16.723 INFO:teuthology.orchestra.run.smithi179.stdout:6 2023-10-09T06:42:16.725 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.724+0000 7f2f07fff700 1 -- 172.21.15.179:0/2788172241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f08159d90 msgr2=0x7f2f080b1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:16.725 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.724+0000 7f2f07fff700 1 --2- 172.21.15.179:0/2788172241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f08159d90 0x7f2f080b1210 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2f00009e90 tx=0x7f2f0000b040 comp rx=0 tx=0).stop 2023-10-09T06:42:16.725 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.724+0000 7f2f07fff700 1 -- 172.21.15.179:0/2788172241 shutdown_connections 2023-10-09T06:42:16.725 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.724+0000 7f2f07fff700 1 --2- 172.21.15.179:0/2788172241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f08159d90 0x7f2f080b1210 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.726 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.724+0000 7f2f07fff700 1 --2- 172.21.15.179:0/2788172241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f0806bf20 0x7f2f080ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.726 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.724+0000 7f2f07fff700 1 --2- 172.21.15.179:0/2788172241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f08153f30 0x7f2f081554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.726 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.724+0000 7f2f07fff700 1 -- 172.21.15.179:0/2788172241 >> 172.21.15.179:0/2788172241 conn(0x7f2f080ce470 msgr2=0x7f2f0813bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:16.726 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.724+0000 7f2f07fff700 1 -- 172.21.15.179:0/2788172241 shutdown_connections 2023-10-09T06:42:16.726 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.724+0000 7f2f07fff700 1 -- 172.21.15.179:0/2788172241 wait complete. 2023-10-09T06:42:16.741 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 05e957b3-1e58-4ffb-9e9d-de3b2eaae636 7 2023-10-09T06:42:16.747 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:16.747+0000 7feaa363f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T06:42:16.866 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:16.864+0000 7feaa363f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T06:42:16.914 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:16.912+0000 7f427e4aa180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T06:42:16.917 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.916+0000 7f7fe279d700 1 Processor -- start 2023-10-09T06:42:16.917 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.916+0000 7f7fe279d700 1 -- start start 2023-10-09T06:42:16.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.918+0000 7f7fe279d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fdc0b4e70 0x7f7fdc0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:16.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.918+0000 7f7fe279d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7fdc0b16d0 0x7f7fdc0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:16.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.918+0000 7f7fe279d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fdc0b2080 con 0x7f7fdc15d240 2023-10-09T06:42:16.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.918+0000 7f7fe279d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fdc0cfb00 con 0x7f7fdc0b16d0 2023-10-09T06:42:16.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.918+0000 7f7fe279d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc0b5c40 con 0x7f7fdc0b4e70 2023-10-09T06:42:16.921 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.918+0000 7f7fe179b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fdc0b4e70 0x7f7fdc0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:16.921 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.918+0000 7f7fe179b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fdc0b4e70 0x7f7fdc0ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:43254/0 (socket says 172.21.15.179:43254) 2023-10-09T06:42:16.921 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.918+0000 7f7fe179b700 1 -- 172.21.15.179:0/3332806967 learned_addr learned my addr 172.21.15.179:0/3332806967 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-09T06:42:16.921 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.918+0000 7f7fe0f9a700 1 --2- 172.21.15.179:0/3332806967 >> v2:172.21.15.71:3300/0 conn(0x7f7fdc0b16d0 0x7f7fdc0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:16.921 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.918+0000 7f7fe179b700 1 -- 172.21.15.179:0/3332806967 >> v2:172.21.15.71:3300/0 conn(0x7f7fdc0b16d0 msgr2=0x7f7fdc0b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:16.921 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.918+0000 7f7fe179b700 1 --2- 172.21.15.179:0/3332806967 >> v2:172.21.15.71:3300/0 conn(0x7f7fdc0b16d0 0x7f7fdc0b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.921 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.918+0000 7f7fe179b700 1 -- 172.21.15.179:0/3332806967 >> v1:172.21.15.71:6789/0 conn(0x7f7fdc15d240 legacy=0x7f7fdc15d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:16.921 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.918+0000 7f7fe179b700 1 -- 172.21.15.179:0/3332806967 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fdc0b5f20 con 0x7f7fdc0b4e70 2023-10-09T06:42:16.921 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.918+0000 7f7fe0f9a700 1 --2- 172.21.15.179:0/3332806967 >> v2:172.21.15.71:3300/0 conn(0x7f7fdc0b16d0 0x7f7fdc0b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:16.921 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.919+0000 7f7fe179b700 1 --2- 172.21.15.179:0/3332806967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fdc0b4e70 0x7f7fdc0ccff0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80099b0 tx=0x7f7fd8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1ed8f195ee8e21b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:16.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.919+0000 7f7fd3fff700 1 -- 172.21.15.179:0/3332806967 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd800b860 con 0x7f7fdc0b4e70 2023-10-09T06:42:16.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.919+0000 7f7fd3fff700 1 -- 172.21.15.179:0/3332806967 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd800b9c0 con 0x7f7fdc0b4e70 2023-10-09T06:42:16.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.919+0000 7f7fd3fff700 1 -- 172.21.15.179:0/3332806967 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd800bd60 con 0x7f7fdc0b4e70 2023-10-09T06:42:16.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.919+0000 7f7fe279d700 1 -- 172.21.15.179:0/3332806967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fdc0b4e70 msgr2=0x7f7fdc0ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:16.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.919+0000 7f7fe279d700 1 --2- 172.21.15.179:0/3332806967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fdc0b4e70 0x7f7fdc0ccff0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80099b0 tx=0x7f7fd8009250 comp rx=0 tx=0).stop 2023-10-09T06:42:16.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.919+0000 7f7fe279d700 1 -- 172.21.15.179:0/3332806967 shutdown_connections 2023-10-09T06:42:16.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.919+0000 7f7fe279d700 1 --2- 172.21.15.179:0/3332806967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fdc0b4e70 0x7f7fdc0ccff0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.920+0000 7f7fe279d700 1 --2- 172.21.15.179:0/3332806967 >> v2:172.21.15.71:3300/0 conn(0x7f7fdc0b16d0 0x7f7fdc0b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.920+0000 7f7fe279d700 1 -- 172.21.15.179:0/3332806967 >> 172.21.15.179:0/3332806967 conn(0x7f7fdc0d10c0 msgr2=0x7f7fdc0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:16.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.920+0000 7f7fe279d700 1 -- 172.21.15.179:0/3332806967 shutdown_connections 2023-10-09T06:42:16.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.920+0000 7f7fe279d700 1 -- 172.21.15.179:0/3332806967 wait complete. 2023-10-09T06:42:16.926 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.921+0000 7f7fe279d700 1 Processor -- start 2023-10-09T06:42:16.926 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.921+0000 7f7fe279d700 1 -- start start 2023-10-09T06:42:16.926 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.922+0000 7f7fe279d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fdc0b16d0 0x7f7fdc0c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:16.926 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.922+0000 7f7fe279d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fdc0b4e70 0x7f7fdc0cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:16.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.922+0000 7f7fe279d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fdc15d240 0x7f7fdc145790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:16.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.922+0000 7f7fe279d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc149150 con 0x7f7fdc0b4e70 2023-10-09T06:42:16.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.922+0000 7f7fe279d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc0cc360 con 0x7f7fdc0b16d0 2023-10-09T06:42:16.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.922+0000 7f7fe279d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc0c8220 con 0x7f7fdc15d240 2023-10-09T06:42:16.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.922+0000 7f7fe179b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fdc0b16d0 0x7f7fdc0c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:16.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.922+0000 7f7fe179b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fdc0b16d0 0x7f7fdc0c6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:37630/0 (socket says 172.21.15.179:37630) 2023-10-09T06:42:16.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.922+0000 7f7fe179b700 1 -- 172.21.15.179:0/3393570788 learned_addr learned my addr 172.21.15.179:0/3393570788 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-10-09T06:42:16.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.922+0000 7f7fe1f9c700 1 --2- 172.21.15.179:0/3393570788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fdc15d240 0x7f7fdc145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:16.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.922+0000 7f7fe0f9a700 1 --2- 172.21.15.179:0/3393570788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fdc0b4e70 0x7f7fdc0cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:16.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.923+0000 7f7fe179b700 1 -- 172.21.15.179:0/3393570788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fdc15d240 msgr2=0x7f7fdc145790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:16.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.923+0000 7f7fe179b700 1 --2- 172.21.15.179:0/3393570788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fdc15d240 0x7f7fdc145790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.923+0000 7f7fe179b700 1 -- 172.21.15.179:0/3393570788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fdc0b4e70 msgr2=0x7f7fdc0cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:16.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.923+0000 7f7fe179b700 1 --2- 172.21.15.179:0/3393570788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fdc0b4e70 0x7f7fdc0cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:16.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.923+0000 7f7fe179b700 1 -- 172.21.15.179:0/3393570788 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd80094f0 con 0x7f7fdc0b16d0 2023-10-09T06:42:16.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.923+0000 7f7fe179b700 1 --2- 172.21.15.179:0/3393570788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fdc0b16d0 0x7f7fdc0c6fc0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80090b0 tx=0x7f7fd8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:16.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.923+0000 7f7fd17fa700 1 -- 172.21.15.179:0/3393570788 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8011e00 con 0x7f7fdc0b16d0 2023-10-09T06:42:16.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.923+0000 7f7fd17fa700 1 -- 172.21.15.179:0/3393570788 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd801f070 con 0x7f7fdc0b16d0 2023-10-09T06:42:16.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.923+0000 7f7fe279d700 1 -- 172.21.15.179:0/3393570788 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fdc146140 con 0x7f7fdc0b16d0 2023-10-09T06:42:16.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.924+0000 7f7fd17fa700 1 -- 172.21.15.179:0/3393570788 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd80266d0 con 0x7f7fdc0b16d0 2023-10-09T06:42:16.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.924+0000 7f7fe279d700 1 -- 172.21.15.179:0/3393570788 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fdc0c78f0 con 0x7f7fdc0b16d0 2023-10-09T06:42:16.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.924+0000 7f7fd17fa700 1 -- 172.21.15.179:0/3393570788 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7fd8026a80 con 0x7f7fdc0b16d0 2023-10-09T06:42:16.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.924+0000 7f7fd17fa700 1 -- 172.21.15.179:0/3393570788 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f7fd8021070 con 0x7f7fdc0b16d0 2023-10-09T06:42:16.929 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.925+0000 7f7fe279d700 1 -- 172.21.15.179:0/3393570788 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fdc088990 con 0x7f7fdc0b16d0 2023-10-09T06:42:16.929 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:16.927+0000 7f7fd17fa700 1 -- 172.21.15.179:0/3393570788 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f7fd802b020 con 0x7f7fdc0b16d0 2023-10-09T06:42:17.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:17.011+0000 7f7fe279d700 1 -- 172.21.15.179:0/3393570788 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "05e957b3-1e58-4ffb-9e9d-de3b2eaae636", "id": 7} v 0) v1 -- 0x7f7fdc04bb80 con 0x7f7fdc0b16d0 2023-10-09T06:42:17.012 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:17.012+0000 7f427e4aa180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T06:42:17.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:17.015+0000 7f7fd17fa700 1 -- 172.21.15.179:0/3393570788 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "05e957b3-1e58-4ffb-9e9d-de3b2eaae636", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7fd8015020 con 0x7f7fdc0b16d0 2023-10-09T06:42:17.016 INFO:teuthology.orchestra.run.smithi179.stdout:7 2023-10-09T06:42:17.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:17.016+0000 7f7fe279d700 1 -- 172.21.15.179:0/3393570788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fdc0b16d0 msgr2=0x7f7fdc0c6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:17.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:17.016+0000 7f7fe279d700 1 --2- 172.21.15.179:0/3393570788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fdc0b16d0 0x7f7fdc0c6fc0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80090b0 tx=0x7f7fd8017000 comp rx=0 tx=0).stop 2023-10-09T06:42:17.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:17.016+0000 7f7fe279d700 1 -- 172.21.15.179:0/3393570788 shutdown_connections 2023-10-09T06:42:17.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:17.016+0000 7f7fe279d700 1 --2- 172.21.15.179:0/3393570788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fdc15d240 0x7f7fdc145790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:17.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:17.016+0000 7f7fe279d700 1 --2- 172.21.15.179:0/3393570788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fdc0b16d0 0x7f7fdc0c6fc0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:17.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:17.016+0000 7f7fe279d700 1 --2- 172.21.15.179:0/3393570788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fdc0b4e70 0x7f7fdc0cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:17.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:17.016+0000 7f7fe279d700 1 -- 172.21.15.179:0/3393570788 >> 172.21.15.179:0/3393570788 conn(0x7f7fdc0d10c0 msgr2=0x7f7fdc15c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:17.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:17.017+0000 7f7fe279d700 1 -- 172.21.15.179:0/3393570788 shutdown_connections 2023-10-09T06:42:17.018 INFO:teuthology.orchestra.run.smithi179.stderr:2023-10-09T06:42:17.017+0000 7f7fe279d700 1 -- 172.21.15.179:0/3393570788 wait complete. 2023-10-09T06:42:17.033 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-09T06:42:17.034 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-09T06:42:17.038 INFO:tasks.ceph.osd.0:Started 2023-10-09T06:42:17.038 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-09T06:42:17.038 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-09T06:42:17.042 INFO:tasks.ceph.osd.1:Started 2023-10-09T06:42:17.043 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-09T06:42:17.043 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-09T06:42:17.047 INFO:tasks.ceph.osd.2:Started 2023-10-09T06:42:17.047 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-09T06:42:17.047 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-09T06:42:17.051 INFO:tasks.ceph.osd.3:Started 2023-10-09T06:42:17.052 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-09T06:42:17.052 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-09T06:42:17.056 INFO:tasks.ceph.osd.4:Started 2023-10-09T06:42:17.056 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-09T06:42:17.056 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-09T06:42:17.060 INFO:tasks.ceph.osd.5:Started 2023-10-09T06:42:17.060 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-09T06:42:17.060 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-09T06:42:17.066 INFO:tasks.ceph.osd.6:Started 2023-10-09T06:42:17.066 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-09T06:42:17.066 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-09T06:42:17.072 INFO:tasks.ceph.osd.7:Started 2023-10-09T06:42:17.072 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:42:17.124 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:17.123+0000 7f427e4aa180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T06:42:17.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.292+0000 7f832559d700 1 Processor -- start 2023-10-09T06:42:17.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.292+0000 7f832559d700 1 -- start start 2023-10-09T06:42:17.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.293+0000 7f832559d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f83201597f0 0x7f83200b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:17.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.293+0000 7f832559d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83200b11d0 con 0x7f8320159420 2023-10-09T06:42:17.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.293+0000 7f832559d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83200b14b0 con 0x7f832015d230 2023-10-09T06:42:17.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.293+0000 7f832559d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83200b1790 con 0x7f83201597f0 2023-10-09T06:42:17.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.293+0000 7f831ffff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8320159420 0x7f83200b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48522/0 (socket says 172.21.15.71:48522) 2023-10-09T06:42:17.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.293+0000 7f831ffff700 1 -- 172.21.15.71:0/929949339 learned_addr learned my addr 172.21.15.71:0/929949339 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:17.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.293+0000 7f831f7fe700 1 --2- 172.21.15.71:0/929949339 >> v2:172.21.15.179:3300/0 conn(0x7f83201597f0 0x7f83200b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:17.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.294+0000 7f831effd700 1 -- 172.21.15.71:0/929949339 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866919873 0 0) 0x7f83200b11d0 con 0x7f8320159420 2023-10-09T06:42:17.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.294+0000 7f831effd700 1 -- 172.21.15.71:0/929949339 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8308003570 con 0x7f8320159420 2023-10-09T06:42:17.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.294+0000 7f831effd700 1 -- 172.21.15.71:0/929949339 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679907144 0 0) 0x7f83200b14b0 con 0x7f832015d230 2023-10-09T06:42:17.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.294+0000 7f831effd700 1 -- 172.21.15.71:0/929949339 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83200b11d0 con 0x7f832015d230 2023-10-09T06:42:17.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.294+0000 7f831f7fe700 1 -- 172.21.15.71:0/929949339 >> v1:172.21.15.179:6789/0 conn(0x7f832015d230 legacy=0x7f832015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:17.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.294+0000 7f831f7fe700 1 -- 172.21.15.71:0/929949339 >> v1:172.21.15.71:6789/0 conn(0x7f8320159420 legacy=0x7f83200b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:17.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.294+0000 7f831f7fe700 1 -- 172.21.15.71:0/929949339 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83200b1a70 con 0x7f83201597f0 2023-10-09T06:42:17.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.294+0000 7f831f7fe700 1 --2- 172.21.15.71:0/929949339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83201597f0 0x7f83200b2270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f83140098e0 tx=0x7f83140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=845820b85a39f07b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:17.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.295+0000 7f831effd700 1 -- 172.21.15.71:0/929949339 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314011630 con 0x7f83201597f0 2023-10-09T06:42:17.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.295+0000 7f831effd700 1 -- 172.21.15.71:0/929949339 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8314011790 con 0x7f83201597f0 2023-10-09T06:42:17.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.295+0000 7f831effd700 1 -- 172.21.15.71:0/929949339 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314011b30 con 0x7f83201597f0 2023-10-09T06:42:17.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.295+0000 7f832559d700 1 -- 172.21.15.71:0/929949339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83201597f0 msgr2=0x7f83200b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:17.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.295+0000 7f832559d700 1 --2- 172.21.15.71:0/929949339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83201597f0 0x7f83200b2270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f83140098e0 tx=0x7f83140091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:17.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.295+0000 7f832559d700 1 -- 172.21.15.71:0/929949339 shutdown_connections 2023-10-09T06:42:17.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.295+0000 7f832559d700 1 --2- 172.21.15.71:0/929949339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83201597f0 0x7f83200b2270 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:17.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.295+0000 7f832559d700 1 -- 172.21.15.71:0/929949339 >> 172.21.15.71:0/929949339 conn(0x7f83200d0660 msgr2=0x7f83200d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:17.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.295+0000 7f832559d700 1 -- 172.21.15.71:0/929949339 shutdown_connections 2023-10-09T06:42:17.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.295+0000 7f832559d700 1 -- 172.21.15.71:0/929949339 wait complete. 2023-10-09T06:42:17.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.297+0000 7f832559d700 1 Processor -- start 2023-10-09T06:42:17.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.297+0000 7f832559d700 1 -- start start 2023-10-09T06:42:17.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.298+0000 7f832559d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8320159420 0x7f832015c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:17.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.298+0000 7f832559d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83201597f0 0x7f83200c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:17.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.298+0000 7f832559d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f832015d230 0x7f83201542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:17.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.298+0000 7f832559d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83201697a0 con 0x7f83201597f0 2023-10-09T06:42:17.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.298+0000 7f832559d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83200c5b00 con 0x7f832015d230 2023-10-09T06:42:17.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.298+0000 7f832559d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83200c5de0 con 0x7f8320159420 2023-10-09T06:42:17.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.298+0000 7f831f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83201597f0 0x7f83200c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:17.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.298+0000 7f831ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8320159420 0x7f832015c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:17.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.298+0000 7f831f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83201597f0 0x7f83200c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39348/0 (socket says 172.21.15.71:39348) 2023-10-09T06:42:17.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.298+0000 7f8324d9c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f832015d230 0x7f83201542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:17.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.298+0000 7f831f7fe700 1 -- 172.21.15.71:0/3313421627 learned_addr learned my addr 172.21.15.71:0/3313421627 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:17.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.299+0000 7f831f7fe700 1 -- 172.21.15.71:0/3313421627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8320159420 msgr2=0x7f832015c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:17.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.299+0000 7f831f7fe700 1 --2- 172.21.15.71:0/3313421627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8320159420 0x7f832015c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:17.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.299+0000 7f831f7fe700 1 -- 172.21.15.71:0/3313421627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f832015d230 msgr2=0x7f83201542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:17.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.299+0000 7f831f7fe700 1 --2- 172.21.15.71:0/3313421627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f832015d230 0x7f83201542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:17.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.299+0000 7f831f7fe700 1 -- 172.21.15.71:0/3313421627 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8314009420 con 0x7f83201597f0 2023-10-09T06:42:17.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.299+0000 7f8324d9c700 1 --2- 172.21.15.71:0/3313421627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f832015d230 0x7f83201542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:42:17.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.299+0000 7f831f7fe700 1 --2- 172.21.15.71:0/3313421627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83201597f0 0x7f83200c5400 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8314013000 tx=0x7f8314017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:17.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.299+0000 7f8307fff700 1 -- 172.21.15.71:0/3313421627 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831401f070 con 0x7f83201597f0 2023-10-09T06:42:17.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.299+0000 7f8307fff700 1 -- 172.21.15.71:0/3313421627 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8314000bc0 con 0x7f83201597f0 2023-10-09T06:42:17.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.299+0000 7f832559d700 1 -- 172.21.15.71:0/3313421627 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83200c60c0 con 0x7f83201597f0 2023-10-09T06:42:17.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.299+0000 7f8307fff700 1 -- 172.21.15.71:0/3313421627 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314025420 con 0x7f83201597f0 2023-10-09T06:42:17.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.300+0000 7f832559d700 1 -- 172.21.15.71:0/3313421627 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8320154800 con 0x7f83201597f0 2023-10-09T06:42:17.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.300+0000 7f8307fff700 1 -- 172.21.15.71:0/3313421627 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8314023070 con 0x7f83201597f0 2023-10-09T06:42:17.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.300+0000 7f8307fff700 1 -- 172.21.15.71:0/3313421627 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f831402ea90 con 0x7f83201597f0 2023-10-09T06:42:17.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.301+0000 7f832559d700 1 -- 172.21.15.71:0/3313421627 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8320169910 con 0x7f83201597f0 2023-10-09T06:42:17.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.304+0000 7f8307fff700 1 -- 172.21.15.71:0/3313421627 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f831402a070 con 0x7f83201597f0 2023-10-09T06:42:17.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.373+0000 7f832559d700 1 -- 172.21.15.71:0/3313421627 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f832004c3c0 con 0x7f83201597f0 2023-10-09T06:42:17.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.374+0000 7f8307fff700 1 -- 172.21.15.71:0/3313421627 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f8314015020 con 0x7f83201597f0 2023-10-09T06:42:17.374 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:42:17.374 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":10,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:42:17.012751+0000","last_up_change":"0.000000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:42:17.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.375+0000 7f832559d700 1 -- 172.21.15.71:0/3313421627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83201597f0 msgr2=0x7f83200c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:17.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.375+0000 7f832559d700 1 --2- 172.21.15.71:0/3313421627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83201597f0 0x7f83200c5400 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8314013000 tx=0x7f8314017000 comp rx=0 tx=0).stop 2023-10-09T06:42:17.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.375+0000 7f832559d700 1 -- 172.21.15.71:0/3313421627 shutdown_connections 2023-10-09T06:42:17.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.375+0000 7f832559d700 1 --2- 172.21.15.71:0/3313421627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f832015d230 0x7f83201542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:17.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.375+0000 7f832559d700 1 --2- 172.21.15.71:0/3313421627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8320159420 0x7f832015c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:17.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.375+0000 7f832559d700 1 --2- 172.21.15.71:0/3313421627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83201597f0 0x7f83200c5400 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:17.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.375+0000 7f832559d700 1 -- 172.21.15.71:0/3313421627 >> 172.21.15.71:0/3313421627 conn(0x7f83200d0660 msgr2=0x7f83200b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:17.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.375+0000 7f832559d700 1 -- 172.21.15.71:0/3313421627 shutdown_connections 2023-10-09T06:42:17.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:17.375+0000 7f832559d700 1 -- 172.21.15.71:0/3313421627 wait complete. 2023-10-09T06:42:17.392 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-09T06:42:17.392 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-09T06:42:17.538 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:17.539+0000 7feaa363f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T06:42:17.634 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:17.635+0000 7feaa363f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T06:42:17.701 INFO:tasks.ceph.osd.0.smithi071.stderr:2023-10-09T06:42:17.701+0000 7f45c3389540 -1 Falling back to public interface 2023-10-09T06:42:17.720 INFO:tasks.ceph.osd.2.smithi071.stderr:2023-10-09T06:42:17.720+0000 7f25116a8540 -1 Falling back to public interface 2023-10-09T06:42:17.735 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:17.735+0000 7feaa363f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T06:42:17.739 INFO:tasks.ceph.osd.6.smithi179.stderr:2023-10-09T06:42:17.739+0000 7fd4de23f540 -1 Falling back to public interface 2023-10-09T06:42:17.746 INFO:tasks.ceph.osd.1.smithi071.stderr:2023-10-09T06:42:17.746+0000 7fe88231c540 -1 Falling back to public interface 2023-10-09T06:42:17.748 INFO:tasks.ceph.osd.7.smithi179.stderr:2023-10-09T06:42:17.748+0000 7f19fd33f540 -1 Falling back to public interface 2023-10-09T06:42:17.750 INFO:tasks.ceph.osd.3.smithi071.stderr:2023-10-09T06:42:17.751+0000 7f6dacada540 -1 Falling back to public interface 2023-10-09T06:42:17.770 INFO:tasks.ceph.osd.5.smithi179.stderr:2023-10-09T06:42:17.770+0000 7f4bd6ff2540 -1 Falling back to public interface 2023-10-09T06:42:17.775 INFO:tasks.ceph.osd.4.smithi179.stderr:2023-10-09T06:42:17.775+0000 7f7c18ae4540 -1 Falling back to public interface 2023-10-09T06:42:17.873 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:17.872+0000 7f427e4aa180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T06:42:18.043 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:18.043+0000 7f427e4aa180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:42:18.158 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:18.158+0000 7f427e4aa180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T06:42:18.199 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-09T06:42:18.387 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.386+0000 7fd4df39d700 1 Processor -- start 2023-10-09T06:42:18.387 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.387+0000 7fd4df39d700 1 -- start start 2023-10-09T06:42:18.396 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.388+0000 7fd4df39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4d815ce50 0x7fd4d815d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:18.396 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.388+0000 7fd4df39d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d8159ef0 con 0x7fd4d80b4730 2023-10-09T06:42:18.396 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.388+0000 7fd4df39d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d80b6090 con 0x7fd4d815daf0 2023-10-09T06:42:18.396 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.388+0000 7fd4df39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d80b52a0 con 0x7fd4d815ce50 2023-10-09T06:42:18.396 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.388+0000 7fd4deb9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd4d80b4730 0x7fd4d80b4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48526/0 (socket says 172.21.15.71:48526) 2023-10-09T06:42:18.397 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.388+0000 7fd4deb9c700 1 -- 172.21.15.71:0/287318028 learned_addr learned my addr 172.21.15.71:0/287318028 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:18.397 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.388+0000 7fd4de39b700 1 --2- 172.21.15.71:0/287318028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4d815ce50 0x7fd4d815d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:18.397 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.389+0000 7fd4dd399700 1 -- 172.21.15.71:0/287318028 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2400587467 0 0) 0x7fd4d80b6090 con 0x7fd4d815daf0 2023-10-09T06:42:18.398 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.389+0000 7fd4dd399700 1 -- 172.21.15.71:0/287318028 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4c4003570 con 0x7fd4d815daf0 2023-10-09T06:42:18.398 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.389+0000 7fd4dd399700 1 -- 172.21.15.71:0/287318028 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3613028367 0 0) 0x7fd4d8159ef0 con 0x7fd4d80b4730 2023-10-09T06:42:18.398 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.389+0000 7fd4dd399700 1 -- 172.21.15.71:0/287318028 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4d80b6090 con 0x7fd4d80b4730 2023-10-09T06:42:18.399 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.389+0000 7fd4de39b700 1 -- 172.21.15.71:0/287318028 >> v1:172.21.15.179:6789/0 conn(0x7fd4d815daf0 legacy=0x7fd4d815a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:18.399 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.389+0000 7fd4de39b700 1 -- 172.21.15.71:0/287318028 >> v1:172.21.15.71:6789/0 conn(0x7fd4d80b4730 legacy=0x7fd4d80b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:18.399 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.389+0000 7fd4de39b700 1 -- 172.21.15.71:0/287318028 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d815df40 con 0x7fd4d815ce50 2023-10-09T06:42:18.400 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.389+0000 7fd4de39b700 1 --2- 172.21.15.71:0/287318028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4d815ce50 0x7fd4d815d5b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009ee0 tx=0x7fd4d4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b46188330ce63df5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:18.400 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.389+0000 7fd4dd399700 1 -- 172.21.15.71:0/287318028 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d400e070 con 0x7fd4d815ce50 2023-10-09T06:42:18.400 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.390+0000 7fd4dd399700 1 -- 172.21.15.71:0/287318028 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d400bc10 con 0x7fd4d815ce50 2023-10-09T06:42:18.400 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.390+0000 7fd4dd399700 1 -- 172.21.15.71:0/287318028 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4012430 con 0x7fd4d815ce50 2023-10-09T06:42:18.401 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.390+0000 7fd4df39d700 1 -- 172.21.15.71:0/287318028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4d815ce50 msgr2=0x7fd4d815d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:18.401 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.390+0000 7fd4df39d700 1 --2- 172.21.15.71:0/287318028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4d815ce50 0x7fd4d815d5b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009ee0 tx=0x7fd4d4009780 comp rx=0 tx=0).stop 2023-10-09T06:42:18.401 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.390+0000 7fd4df39d700 1 -- 172.21.15.71:0/287318028 shutdown_connections 2023-10-09T06:42:18.401 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.390+0000 7fd4df39d700 1 --2- 172.21.15.71:0/287318028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4d815ce50 0x7fd4d815d5b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:18.402 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.390+0000 7fd4df39d700 1 -- 172.21.15.71:0/287318028 >> 172.21.15.71:0/287318028 conn(0x7fd4d8087ff0 msgr2=0x7fd4d806d060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:18.402 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.390+0000 7fd4df39d700 1 -- 172.21.15.71:0/287318028 shutdown_connections 2023-10-09T06:42:18.402 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.390+0000 7fd4df39d700 1 -- 172.21.15.71:0/287318028 wait complete. 2023-10-09T06:42:18.403 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.392+0000 7fd4df39d700 1 Processor -- start 2023-10-09T06:42:18.403 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.392+0000 7fd4df39d700 1 -- start start 2023-10-09T06:42:18.403 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.392+0000 7fd4df39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4d80b4730 0x7fd4d80ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:18.403 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.392+0000 7fd4df39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4d815ce50 0x7fd4d8160350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:18.404 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.392+0000 7fd4df39d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4d815daf0 0x7fd4d80cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:18.404 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.392+0000 7fd4df39d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d80cf6b0 con 0x7fd4d815daf0 2023-10-09T06:42:18.409 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.392+0000 7fd4df39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d80ceaa0 con 0x7fd4d80b4730 2023-10-09T06:42:18.410 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.392+0000 7fd4df39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d80ced80 con 0x7fd4d815ce50 2023-10-09T06:42:18.410 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.393+0000 7fd4deb9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4d815daf0 0x7fd4d80cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:18.410 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.393+0000 7fd4de39b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4d80b4730 0x7fd4d80ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:18.410 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.393+0000 7fd4ddb9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4d815ce50 0x7fd4d8160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:18.410 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.393+0000 7fd4de39b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4d80b4730 0x7fd4d80ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:48502/0 (socket says 172.21.15.71:48502) 2023-10-09T06:42:18.410 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.393+0000 7fd4de39b700 1 -- 172.21.15.71:0/2928687215 learned_addr learned my addr 172.21.15.71:0/2928687215 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:18.411 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.393+0000 7fd4de39b700 1 -- 172.21.15.71:0/2928687215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4d815ce50 msgr2=0x7fd4d8160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:18.411 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.393+0000 7fd4de39b700 1 --2- 172.21.15.71:0/2928687215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4d815ce50 0x7fd4d8160350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:18.411 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.393+0000 7fd4de39b700 1 -- 172.21.15.71:0/2928687215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4d815daf0 msgr2=0x7fd4d80cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:18.411 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.393+0000 7fd4de39b700 1 --2- 172.21.15.71:0/2928687215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4d815daf0 0x7fd4d80cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:18.411 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.393+0000 7fd4de39b700 1 -- 172.21.15.71:0/2928687215 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d4009a20 con 0x7fd4d80b4730 2023-10-09T06:42:18.412 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.393+0000 7fd4deb9c700 1 --2- 172.21.15.71:0/2928687215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4d815daf0 0x7fd4d80cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:42:18.412 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.393+0000 7fd4de39b700 1 --2- 172.21.15.71:0/2928687215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4d80b4730 0x7fd4d80ce4a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40097c0 tx=0x7fd4d4019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:18.412 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.394+0000 7fd4ce7fc700 1 -- 172.21.15.71:0/2928687215 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4012d50 con 0x7fd4d80b4730 2023-10-09T06:42:18.412 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.394+0000 7fd4ce7fc700 1 -- 172.21.15.71:0/2928687215 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d401b420 con 0x7fd4d80b4730 2023-10-09T06:42:18.412 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.394+0000 7fd4df39d700 1 -- 172.21.15.71:0/2928687215 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d80cf060 con 0x7fd4d80b4730 2023-10-09T06:42:18.412 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.394+0000 7fd4ce7fc700 1 -- 172.21.15.71:0/2928687215 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d401b7e0 con 0x7fd4d80b4730 2023-10-09T06:42:18.413 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.394+0000 7fd4df39d700 1 -- 172.21.15.71:0/2928687215 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d80b01d0 con 0x7fd4d80b4730 2023-10-09T06:42:18.413 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.394+0000 7fd4ce7fc700 1 -- 172.21.15.71:0/2928687215 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd4d401bb90 con 0x7fd4d80b4730 2023-10-09T06:42:18.413 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.394+0000 7fd4ce7fc700 1 -- 172.21.15.71:0/2928687215 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fd4d401be40 con 0x7fd4d80b4730 2023-10-09T06:42:18.413 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.395+0000 7fd4df39d700 1 -- 172.21.15.71:0/2928687215 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d80cf990 con 0x7fd4d80b4730 2023-10-09T06:42:18.414 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.397+0000 7fd4ce7fc700 1 -- 172.21.15.71:0/2928687215 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd4d4033060 con 0x7fd4d80b4730 2023-10-09T06:42:18.462 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:18.461+0000 7f427e4aa180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T06:42:18.470 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.470+0000 7fd4df39d700 1 -- 172.21.15.71:0/2928687215 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4d80b03f0 con 0x7fd4d80b4730 2023-10-09T06:42:18.470 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:18.470+0000 7feaa363f180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T06:42:18.471 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.471+0000 7fd4ce7fc700 1 -- 172.21.15.71:0/2928687215 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fd4d402a070 con 0x7fd4d80b4730 2023-10-09T06:42:18.471 INFO:teuthology.misc.health.smithi071.stdout: 2023-10-09T06:42:18.471 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":10,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:42:17.012751+0000","last_up_change":"0.000000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:42:18.472 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.472+0000 7fd4df39d700 1 -- 172.21.15.71:0/2928687215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4d80b4730 msgr2=0x7fd4d80ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:18.472 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.472+0000 7fd4df39d700 1 --2- 172.21.15.71:0/2928687215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4d80b4730 0x7fd4d80ce4a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40097c0 tx=0x7fd4d4019000 comp rx=0 tx=0).stop 2023-10-09T06:42:18.472 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.472+0000 7fd4df39d700 1 -- 172.21.15.71:0/2928687215 shutdown_connections 2023-10-09T06:42:18.472 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.472+0000 7fd4df39d700 1 --2- 172.21.15.71:0/2928687215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4d815daf0 0x7fd4d80cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:18.472 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.472+0000 7fd4df39d700 1 --2- 172.21.15.71:0/2928687215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4d80b4730 0x7fd4d80ce4a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:18.472 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.472+0000 7fd4df39d700 1 --2- 172.21.15.71:0/2928687215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4d815ce50 0x7fd4d8160350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:18.473 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.472+0000 7fd4df39d700 1 -- 172.21.15.71:0/2928687215 >> 172.21.15.71:0/2928687215 conn(0x7fd4d8087ff0 msgr2=0x7fd4d80d05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:18.473 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.472+0000 7fd4df39d700 1 -- 172.21.15.71:0/2928687215 shutdown_connections 2023-10-09T06:42:18.473 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:18.472+0000 7fd4df39d700 1 -- 172.21.15.71:0/2928687215 wait complete. 2023-10-09T06:42:18.487 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-09T06:42:18.558 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:18.557+0000 7f427e4aa180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T06:42:18.646 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:18.645+0000 7feaa363f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:42:18.758 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:18.757+0000 7feaa363f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T06:42:19.054 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:19.054+0000 7feaa363f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T06:42:19.151 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:19.151+0000 7feaa363f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T06:42:19.563 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:19.563+0000 7f427e4aa180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T06:42:19.654 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:19.654+0000 7f427e4aa180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T06:42:19.749 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:19.749+0000 7f427e4aa180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T06:42:19.914 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:19.913+0000 7f427e4aa180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T06:42:20.022 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:20.022+0000 7f427e4aa180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T06:42:20.147 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:20.147+0000 7feaa363f180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T06:42:20.213 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:20.212+0000 7f427e4aa180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T06:42:20.243 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:20.243+0000 7feaa363f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T06:42:20.327 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:20.327+0000 7f427e4aa180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T06:42:20.342 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:20.342+0000 7feaa363f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T06:42:20.422 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:20.421+0000 7f427e4aa180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T06:42:20.508 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:20.508+0000 7feaa363f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T06:42:20.520 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:20.520+0000 7f427e4aa180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T06:42:20.698 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:20.698+0000 7feaa363f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T06:42:20.907 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:20.907+0000 7feaa363f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T06:42:21.007 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:21.007+0000 7feaa363f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T06:42:21.105 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:21.105+0000 7feaa363f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T06:42:21.199 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:42:21.199+0000 7feaa363f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T06:42:21.263 INFO:tasks.ceph.osd.0.smithi071.stderr:2023-10-09T06:42:21.263+0000 7f45c3389540 -1 osd.0 0 log_to_monitors true 2023-10-09T06:42:21.326 INFO:tasks.ceph.osd.2.smithi071.stderr:2023-10-09T06:42:21.326+0000 7f25116a8540 -1 osd.2 0 log_to_monitors true 2023-10-09T06:42:21.326 INFO:tasks.ceph.osd.7.smithi179.stderr:2023-10-09T06:42:21.326+0000 7f19fd33f540 -1 osd.7 0 log_to_monitors true 2023-10-09T06:42:21.326 INFO:tasks.ceph.osd.4.smithi179.stderr:2023-10-09T06:42:21.326+0000 7f7c18ae4540 -1 osd.4 0 log_to_monitors true 2023-10-09T06:42:21.338 INFO:tasks.ceph.osd.1.smithi071.stderr:2023-10-09T06:42:21.338+0000 7fe88231c540 -1 osd.1 0 log_to_monitors true 2023-10-09T06:42:21.519 INFO:tasks.ceph.osd.6.smithi179.stderr:2023-10-09T06:42:21.519+0000 7fd4de23f540 -1 osd.6 0 log_to_monitors true 2023-10-09T06:42:21.544 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:21.544+0000 7f42365fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-09T06:42:21.544 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:42:21.544+0000 7f42365fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-09T06:42:21.585 INFO:tasks.ceph.osd.5.smithi179.stderr:2023-10-09T06:42:21.584+0000 7f4bd6ff2540 -1 osd.5 0 log_to_monitors true 2023-10-09T06:42:21.586 INFO:tasks.ceph.osd.3.smithi071.stderr:2023-10-09T06:42:21.587+0000 7f6dacada540 -1 osd.3 0 log_to_monitors true 2023-10-09T06:42:24.855 INFO:tasks.ceph.osd.1.smithi071.stderr:2023-10-09T06:42:24.855+0000 7fe875df6700 -1 osd.1 0 waiting for initial osdmap 2023-10-09T06:42:24.862 INFO:tasks.ceph.osd.1.smithi071.stderr:2023-10-09T06:42:24.862+0000 7fe86ede8700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T06:42:24.899 INFO:tasks.ceph.osd.2.smithi071.stderr:2023-10-09T06:42:24.899+0000 7f25051f6700 -1 osd.2 0 waiting for initial osdmap 2023-10-09T06:42:24.905 INFO:tasks.ceph.osd.2.smithi071.stderr:2023-10-09T06:42:24.906+0000 7f24fe1e8700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T06:42:24.924 INFO:tasks.ceph.osd.7.smithi179.stderr:2023-10-09T06:42:24.922+0000 7f19f0df6700 -1 osd.7 0 waiting for initial osdmap 2023-10-09T06:42:24.931 INFO:tasks.ceph.osd.7.smithi179.stderr:2023-10-09T06:42:24.930+0000 7f19e9de8700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T06:42:24.933 INFO:tasks.ceph.osd.0.smithi071.stderr:2023-10-09T06:42:24.933+0000 7f45b85f9700 -1 osd.0 0 waiting for initial osdmap 2023-10-09T06:42:24.938 INFO:tasks.ceph.osd.6.smithi179.stderr:2023-10-09T06:42:24.936+0000 7fd4d1df6700 -1 osd.6 0 waiting for initial osdmap 2023-10-09T06:42:24.939 INFO:tasks.ceph.osd.0.smithi071.stderr:2023-10-09T06:42:24.940+0000 7f45afde8700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T06:42:24.944 INFO:tasks.ceph.osd.6.smithi179.stderr:2023-10-09T06:42:24.943+0000 7fd4cade8700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T06:42:24.956 INFO:tasks.ceph.osd.4.smithi179.stderr:2023-10-09T06:42:24.955+0000 7f7c0ddf9700 -1 osd.4 0 waiting for initial osdmap 2023-10-09T06:42:24.961 INFO:tasks.ceph.osd.4.smithi179.stderr:2023-10-09T06:42:24.960+0000 7f7c055e8700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T06:42:24.965 INFO:tasks.ceph.osd.5.smithi179.stderr:2023-10-09T06:42:24.964+0000 7f4bca9f6700 -1 osd.5 0 waiting for initial osdmap 2023-10-09T06:42:24.967 INFO:tasks.ceph.osd.3.smithi071.stderr:2023-10-09T06:42:24.968+0000 7f6da1df9700 -1 osd.3 0 waiting for initial osdmap 2023-10-09T06:42:24.970 INFO:tasks.ceph.osd.5.smithi179.stderr:2023-10-09T06:42:24.969+0000 7f4bc39e8700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T06:42:24.974 INFO:tasks.ceph.osd.3.smithi071.stderr:2023-10-09T06:42:24.974+0000 7f6d995e8700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T06:42:25.294 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-09T06:42:25.450 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.449+0000 7f82105ff700 1 Processor -- start 2023-10-09T06:42:25.450 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.449+0000 7f82105ff700 1 -- start start 2023-10-09T06:42:25.454 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.450+0000 7f82105ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82081562f0 0x7f82080c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:25.454 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.451+0000 7f82105ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f820806b5b0 0x7f82080c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:25.454 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.451+0000 7f82105ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82080c8150 con 0x7f82081566c0 2023-10-09T06:42:25.454 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.451+0000 7f82105ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8208156e70 con 0x7f820806b5b0 2023-10-09T06:42:25.455 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.451+0000 7f82105ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82080c7540 con 0x7f82081562f0 2023-10-09T06:42:25.455 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.451+0000 7f820db9a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f82081566c0 0x7f820806aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53160/0 (socket says 172.21.15.71:53160) 2023-10-09T06:42:25.455 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.451+0000 7f820db9a700 1 -- 172.21.15.71:0/925547596 learned_addr learned my addr 172.21.15.71:0/925547596 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:25.455 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.451+0000 7f820eb9c700 1 --2- 172.21.15.71:0/925547596 >> v2:172.21.15.179:3300/0 conn(0x7f820806b5b0 0x7f82080c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:25.455 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.451+0000 7f820e39b700 1 --2- 172.21.15.71:0/925547596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82081562f0 0x7f82080c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:25.455 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.451+0000 7f820d399700 1 -- 172.21.15.71:0/925547596 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966694061 0 0) 0x7f82080c8150 con 0x7f82081566c0 2023-10-09T06:42:25.455 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.451+0000 7f820d399700 1 -- 172.21.15.71:0/925547596 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81f4003570 con 0x7f82081566c0 2023-10-09T06:42:25.455 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820d399700 1 -- 172.21.15.71:0/925547596 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3363597418 0 0) 0x7f81f4003570 con 0x7f82081566c0 2023-10-09T06:42:25.455 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820d399700 1 -- 172.21.15.71:0/925547596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82081562f0 msgr2=0x7f82080c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:25.455 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820d399700 1 --2- 172.21.15.71:0/925547596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82081562f0 0x7f82080c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:25.455 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820d399700 1 -- 172.21.15.71:0/925547596 >> v2:172.21.15.179:3300/0 conn(0x7f820806b5b0 msgr2=0x7f82080c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:25.456 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820d399700 1 --2- 172.21.15.71:0/925547596 >> v2:172.21.15.179:3300/0 conn(0x7f820806b5b0 0x7f82080c6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:25.456 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820d399700 1 -- 172.21.15.71:0/925547596 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82080c7820 con 0x7f82081566c0 2023-10-09T06:42:25.456 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820d399700 1 -- 172.21.15.71:0/925547596 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f81f8001470 con 0x7f82081566c0 2023-10-09T06:42:25.456 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820eb9c700 1 --2- 172.21.15.71:0/925547596 >> v2:172.21.15.179:3300/0 conn(0x7f820806b5b0 0x7f82080c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:42:25.456 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820d399700 1 -- 172.21.15.71:0/925547596 >> v1:172.21.15.71:6789/0 conn(0x7f82081566c0 legacy=0x7f820806aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:25.456 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820d399700 1 --2- 172.21.15.71:0/925547596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81f4003a60 0x7f81f4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:25.456 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820d399700 1 --2- 172.21.15.71:0/925547596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81f4004810 0x7f81f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:25.456 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820d399700 1 --2- 172.21.15.71:0/925547596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81f40051c0 0x7f81f400dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:25.456 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820d399700 1 -- 172.21.15.71:0/925547596 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8208156e70 con 0x7f81f40051c0 2023-10-09T06:42:25.456 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820d399700 1 -- 172.21.15.71:0/925547596 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82080c7540 con 0x7f81f4003a60 2023-10-09T06:42:25.456 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820d399700 1 -- 172.21.15.71:0/925547596 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f400e1b0 con 0x7f81f4004810 2023-10-09T06:42:25.457 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820e39b700 1 --2- 172.21.15.71:0/925547596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82081562f0 0x7f82080c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:42:25.457 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820eb9c700 1 --2- 172.21.15.71:0/925547596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81f40051c0 0x7f81f400dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:25.457 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820db9a700 1 --2- 172.21.15.71:0/925547596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81f4004810 0x7f81f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:25.457 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820e39b700 1 --2- 172.21.15.71:0/925547596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81f4003a60 0x7f81f4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:25.457 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820eb9c700 1 -- 172.21.15.71:0/925547596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81f4004810 msgr2=0x7f81f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:25.457 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820eb9c700 1 --2- 172.21.15.71:0/925547596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81f4004810 0x7f81f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:25.457 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820eb9c700 1 -- 172.21.15.71:0/925547596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81f4003a60 msgr2=0x7f81f4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:25.457 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820eb9c700 1 --2- 172.21.15.71:0/925547596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81f4003a60 0x7f81f4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:25.457 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.452+0000 7f820eb9c700 1 -- 172.21.15.71:0/925547596 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f4003570 con 0x7f81f40051c0 2023-10-09T06:42:25.457 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.453+0000 7f820eb9c700 1 --2- 172.21.15.71:0/925547596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81f40051c0 0x7f81f400dc70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f820806b9b0 tx=0x7f820000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811f679665180359 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:25.457 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.453+0000 7f820d399700 1 -- 172.21.15.71:0/925547596 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820000ec40 con 0x7f81f40051c0 2023-10-09T06:42:25.457 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.453+0000 7f820d399700 1 -- 172.21.15.71:0/925547596 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820000f040 con 0x7f81f40051c0 2023-10-09T06:42:25.458 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.453+0000 7f820d399700 1 -- 172.21.15.71:0/925547596 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8200014480 con 0x7f81f40051c0 2023-10-09T06:42:25.458 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.453+0000 7f82105ff700 1 -- 172.21.15.71:0/925547596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81f40051c0 msgr2=0x7f81f400dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:25.458 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.453+0000 7f82105ff700 1 --2- 172.21.15.71:0/925547596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81f40051c0 0x7f81f400dc70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f820806b9b0 tx=0x7f820000b040 comp rx=0 tx=0).stop 2023-10-09T06:42:25.458 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.453+0000 7f820eb9c700 1 -- 172.21.15.71:0/925547596 reap_dead start 2023-10-09T06:42:25.458 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.453+0000 7f82105ff700 1 -- 172.21.15.71:0/925547596 shutdown_connections 2023-10-09T06:42:25.458 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.453+0000 7f82105ff700 1 -- 172.21.15.71:0/925547596 >> 172.21.15.71:0/925547596 conn(0x7f820806d350 msgr2=0x7f82080cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:25.458 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.453+0000 7f82105ff700 1 -- 172.21.15.71:0/925547596 shutdown_connections 2023-10-09T06:42:25.458 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.454+0000 7f82105ff700 1 -- 172.21.15.71:0/925547596 wait complete. 2023-10-09T06:42:25.461 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.455+0000 7f82105ff700 1 Processor -- start 2023-10-09T06:42:25.461 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.455+0000 7f82105ff700 1 -- start start 2023-10-09T06:42:25.461 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.456+0000 7f82105ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81f40051c0 0x7f82080cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:25.461 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.456+0000 7f82105ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82080a60b0 0x7f82080caa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:25.461 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.456+0000 7f82105ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f820816cfb0 0x7f820816d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:25.461 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.456+0000 7f82105ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820816d960 con 0x7f82080a60b0 2023-10-09T06:42:25.461 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.456+0000 7f82105ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82080cbe50 con 0x7f820816cfb0 2023-10-09T06:42:25.461 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.456+0000 7f82105ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82080cc820 con 0x7f81f40051c0 2023-10-09T06:42:25.462 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.456+0000 7f820db9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82080a60b0 0x7f82080caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:25.462 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.456+0000 7f820db9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82080a60b0 0x7f82080caa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50858/0 (socket says 172.21.15.71:50858) 2023-10-09T06:42:25.462 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.456+0000 7f820db9a700 1 -- 172.21.15.71:0/1416371257 learned_addr learned my addr 172.21.15.71:0/1416371257 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:25.462 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.456+0000 7f820e39b700 1 --2- 172.21.15.71:0/1416371257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81f40051c0 0x7f82080cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:25.462 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.456+0000 7f820eb9c700 1 --2- 172.21.15.71:0/1416371257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f820816cfb0 0x7f820816d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:25.462 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.456+0000 7f820db9a700 1 -- 172.21.15.71:0/1416371257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81f40051c0 msgr2=0x7f82080cc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:25.462 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.456+0000 7f820db9a700 1 --2- 172.21.15.71:0/1416371257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81f40051c0 0x7f82080cc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:25.462 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.456+0000 7f820db9a700 1 -- 172.21.15.71:0/1416371257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f820816cfb0 msgr2=0x7f820816d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:25.462 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.456+0000 7f820db9a700 1 --2- 172.21.15.71:0/1416371257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f820816cfb0 0x7f820816d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:25.462 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.456+0000 7f820db9a700 1 -- 172.21.15.71:0/1416371257 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82080cb240 con 0x7f82080a60b0 2023-10-09T06:42:25.462 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.456+0000 7f820eb9c700 1 --2- 172.21.15.71:0/1416371257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f820816cfb0 0x7f820816d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:25.463 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.456+0000 7f820e39b700 1 --2- 172.21.15.71:0/1416371257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81f40051c0 0x7f82080cc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:25.463 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.457+0000 7f820db9a700 1 --2- 172.21.15.71:0/1416371257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82080a60b0 0x7f82080caa10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f81f800e8f0 tx=0x7f81f8000da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:25.463 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.457+0000 7f81fe7fc700 1 -- 172.21.15.71:0/1416371257 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f800ee90 con 0x7f82080a60b0 2023-10-09T06:42:25.463 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.457+0000 7f81fe7fc700 1 -- 172.21.15.71:0/1416371257 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f8010040 con 0x7f82080a60b0 2023-10-09T06:42:25.463 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.457+0000 7f81fe7fc700 1 -- 172.21.15.71:0/1416371257 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f800a9b0 con 0x7f82080a60b0 2023-10-09T06:42:25.463 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.457+0000 7f82105ff700 1 -- 172.21.15.71:0/1416371257 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82080cb520 con 0x7f82080a60b0 2023-10-09T06:42:25.463 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.457+0000 7f82105ff700 1 -- 172.21.15.71:0/1416371257 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82080cbae0 con 0x7f82080a60b0 2023-10-09T06:42:25.463 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.458+0000 7f82105ff700 1 -- 172.21.15.71:0/1416371257 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82080cc000 con 0x7f82080a60b0 2023-10-09T06:42:25.463 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.459+0000 7f81fe7fc700 1 -- 172.21.15.71:0/1416371257 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f81f801d3b0 con 0x7f82080a60b0 2023-10-09T06:42:25.463 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.460+0000 7f81fe7fc700 1 --2- 172.21.15.71:0/1416371257 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f81ec066ea0 0x7f81ec069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:25.463 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.460+0000 7f81fe7fc700 1 -- 172.21.15.71:0/1416371257 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7f81f8082d20 con 0x7f82080a60b0 2023-10-09T06:42:25.463 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.460+0000 7f820e39b700 1 --2- 172.21.15.71:0/1416371257 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f81ec066ea0 0x7f81ec069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:25.464 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.461+0000 7f820e39b700 1 --2- 172.21.15.71:0/1416371257 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f81ec066ea0 0x7f81ec069350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8204009390 tx=0x7f8204008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:25.465 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.465+0000 7f81fe7fc700 1 -- 172.21.15.71:0/1416371257 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82080cc000 con 0x7f82080a60b0 2023-10-09T06:42:25.659 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.658+0000 7f82105ff700 1 -- 172.21.15.71:0/1416371257 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82080cbfc0 con 0x7f82080a60b0 2023-10-09T06:42:25.660 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.659+0000 7f81fe7fc700 1 -- 172.21.15.71:0/1416371257 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f81f8019030 con 0x7f82080a60b0 2023-10-09T06:42:25.660 INFO:teuthology.misc.health.smithi071.stdout: 2023-10-09T06:42:25.660 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":12,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:42:22.613684+0000","last_up_change":"0.000000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:42:25.662 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.661+0000 7f82105ff700 1 -- 172.21.15.71:0/1416371257 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f81ec066ea0 msgr2=0x7f81ec069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:25.662 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.661+0000 7f82105ff700 1 --2- 172.21.15.71:0/1416371257 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f81ec066ea0 0x7f81ec069350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8204009390 tx=0x7f8204008040 comp rx=0 tx=0).stop 2023-10-09T06:42:25.663 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.661+0000 7f82105ff700 1 -- 172.21.15.71:0/1416371257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82080a60b0 msgr2=0x7f82080caa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:25.663 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.661+0000 7f82105ff700 1 --2- 172.21.15.71:0/1416371257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82080a60b0 0x7f82080caa10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f81f800e8f0 tx=0x7f81f8000da0 comp rx=0 tx=0).stop 2023-10-09T06:42:25.663 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.661+0000 7f82105ff700 1 -- 172.21.15.71:0/1416371257 shutdown_connections 2023-10-09T06:42:25.663 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.661+0000 7f82105ff700 1 --2- 172.21.15.71:0/1416371257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f820816cfb0 0x7f820816d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:25.663 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.661+0000 7f82105ff700 1 --2- 172.21.15.71:0/1416371257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81f40051c0 0x7f82080cc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:25.663 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.661+0000 7f82105ff700 1 --2- 172.21.15.71:0/1416371257 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f81ec066ea0 0x7f81ec069350 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:25.663 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.661+0000 7f82105ff700 1 --2- 172.21.15.71:0/1416371257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82080a60b0 0x7f82080caa10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:25.663 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.661+0000 7f82105ff700 1 -- 172.21.15.71:0/1416371257 >> 172.21.15.71:0/1416371257 conn(0x7f820806d350 msgr2=0x7f8208152ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:25.663 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.661+0000 7f82105ff700 1 -- 172.21.15.71:0/1416371257 shutdown_connections 2023-10-09T06:42:25.663 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:25.661+0000 7f82105ff700 1 -- 172.21.15.71:0/1416371257 wait complete. 2023-10-09T06:42:25.677 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-09T06:42:28.819 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:42:28.824 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:42:32.484 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-09T06:42:32.651 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.650+0000 7f552199d700 1 Processor -- start 2023-10-09T06:42:32.651 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.650+0000 7f552199d700 1 -- start start 2023-10-09T06:42:32.653 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.651+0000 7f552199d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f551c15dcc0 0x7f551c0b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:32.653 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.651+0000 7f552199d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f551c15b140 0x7f551c0b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:32.653 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.651+0000 7f552199d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f551c159ef0 con 0x7f551c15ce50 2023-10-09T06:42:32.653 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.651+0000 7f552199d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f551c0b6090 con 0x7f551c15dcc0 2023-10-09T06:42:32.653 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.651+0000 7f552199d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551c0b51b0 con 0x7f551c15b140 2023-10-09T06:42:32.653 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.651+0000 7f551bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f551c15dcc0 0x7f551c0b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:32.653 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.652+0000 7f551bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f551c15dcc0 0x7f551c0b3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50864/0 (socket says 172.21.15.71:50864) 2023-10-09T06:42:32.653 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.652+0000 7f551bfff700 1 -- 172.21.15.71:0/1398776520 learned_addr learned my addr 172.21.15.71:0/1398776520 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:32.653 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.652+0000 7f552119c700 1 --2- 172.21.15.71:0/1398776520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f551c15b140 0x7f551c0b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:32.654 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.652+0000 7f551bfff700 1 -- 172.21.15.71:0/1398776520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f551c15b140 msgr2=0x7f551c0b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:32.654 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.652+0000 7f551bfff700 1 --2- 172.21.15.71:0/1398776520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f551c15b140 0x7f551c0b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:32.654 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.652+0000 7f551bfff700 1 -- 172.21.15.71:0/1398776520 >> v1:172.21.15.179:6789/0 conn(0x7f551c15ce50 legacy=0x7f551c15d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:32.654 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.652+0000 7f551bfff700 1 -- 172.21.15.71:0/1398776520 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551c0b5480 con 0x7f551c15dcc0 2023-10-09T06:42:32.654 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.652+0000 7f551bfff700 1 --2- 172.21.15.71:0/1398776520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f551c15dcc0 0x7f551c0b3720 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f55080099b0 tx=0x7f5508009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b210642ddc837c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:32.655 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.652+0000 7f551b7fe700 1 -- 172.21.15.71:0/1398776520 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5508009ea0 con 0x7f551c15dcc0 2023-10-09T06:42:32.655 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.653+0000 7f551b7fe700 1 -- 172.21.15.71:0/1398776520 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550800b8f0 con 0x7f551c15dcc0 2023-10-09T06:42:32.655 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.653+0000 7f551b7fe700 1 -- 172.21.15.71:0/1398776520 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550800bc90 con 0x7f551c15dcc0 2023-10-09T06:42:32.655 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.653+0000 7f552199d700 1 -- 172.21.15.71:0/1398776520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f551c15dcc0 msgr2=0x7f551c0b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:32.655 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.653+0000 7f552199d700 1 --2- 172.21.15.71:0/1398776520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f551c15dcc0 0x7f551c0b3720 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f55080099b0 tx=0x7f5508009250 comp rx=0 tx=0).stop 2023-10-09T06:42:32.655 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.653+0000 7f552199d700 1 -- 172.21.15.71:0/1398776520 shutdown_connections 2023-10-09T06:42:32.655 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.653+0000 7f552199d700 1 --2- 172.21.15.71:0/1398776520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f551c15b140 0x7f551c0b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:32.655 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.653+0000 7f552199d700 1 --2- 172.21.15.71:0/1398776520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f551c15dcc0 0x7f551c0b3720 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:32.656 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.653+0000 7f552199d700 1 -- 172.21.15.71:0/1398776520 >> 172.21.15.71:0/1398776520 conn(0x7f551c087ff0 msgr2=0x7f551c06d060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:32.656 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.653+0000 7f552199d700 1 -- 172.21.15.71:0/1398776520 shutdown_connections 2023-10-09T06:42:32.656 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.653+0000 7f552199d700 1 -- 172.21.15.71:0/1398776520 wait complete. 2023-10-09T06:42:32.658 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.655+0000 7f552199d700 1 Processor -- start 2023-10-09T06:42:32.658 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.655+0000 7f552199d700 1 -- start start 2023-10-09T06:42:32.658 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.656+0000 7f552199d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f551c15b140 0x7f551c0cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:32.658 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.656+0000 7f552199d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f551c15ce50 0x7f551c16ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:32.658 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.656+0000 7f552199d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f551c15dcc0 0x7f551c16e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:32.658 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.656+0000 7f552199d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551c0cc130 con 0x7f551c15dcc0 2023-10-09T06:42:32.658 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.656+0000 7f552199d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551c0cebe0 con 0x7f551c15ce50 2023-10-09T06:42:32.658 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.656+0000 7f552199d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551c16dce0 con 0x7f551c15b140 2023-10-09T06:42:32.659 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.656+0000 7f552119c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f551c15dcc0 0x7f551c16e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:32.659 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.656+0000 7f552119c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f551c15dcc0 0x7f551c16e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50870/0 (socket says 172.21.15.71:50870) 2023-10-09T06:42:32.659 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.656+0000 7f552119c700 1 -- 172.21.15.71:0/3269549728 learned_addr learned my addr 172.21.15.71:0/3269549728 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:32.659 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.656+0000 7f551bfff700 1 --2- 172.21.15.71:0/3269549728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f551c15ce50 0x7f551c16ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:32.659 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.656+0000 7f552099b700 1 --2- 172.21.15.71:0/3269549728 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f551c15b140 0x7f551c0cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:32.659 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.656+0000 7f552119c700 1 -- 172.21.15.71:0/3269549728 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f551c15b140 msgr2=0x7f551c0cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:32.659 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.656+0000 7f552119c700 1 --2- 172.21.15.71:0/3269549728 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f551c15b140 0x7f551c0cbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:32.659 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.656+0000 7f552119c700 1 -- 172.21.15.71:0/3269549728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f551c15ce50 msgr2=0x7f551c16ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:32.659 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.656+0000 7f552119c700 1 --2- 172.21.15.71:0/3269549728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f551c15ce50 0x7f551c16ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:32.659 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.656+0000 7f552119c700 1 -- 172.21.15.71:0/3269549728 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55080094f0 con 0x7f551c15dcc0 2023-10-09T06:42:32.659 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.656+0000 7f551bfff700 1 --2- 172.21.15.71:0/3269549728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f551c15ce50 0x7f551c16ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:32.660 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.656+0000 7f552099b700 1 --2- 172.21.15.71:0/3269549728 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f551c15b140 0x7f551c0cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:32.660 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.657+0000 7f552119c700 1 --2- 172.21.15.71:0/3269549728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f551c15dcc0 0x7f551c16e170 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5514009e20 tx=0x7f551400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:32.660 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.657+0000 7f5518ff9700 1 -- 172.21.15.71:0/3269549728 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551400cc20 con 0x7f551c15dcc0 2023-10-09T06:42:32.660 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.657+0000 7f5518ff9700 1 -- 172.21.15.71:0/3269549728 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551400f040 con 0x7f551c15dcc0 2023-10-09T06:42:32.660 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.657+0000 7f552199d700 1 -- 172.21.15.71:0/3269549728 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f551c16b140 con 0x7f551c15dcc0 2023-10-09T06:42:32.660 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.657+0000 7f5518ff9700 1 -- 172.21.15.71:0/3269549728 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5514014480 con 0x7f551c15dcc0 2023-10-09T06:42:32.660 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.657+0000 7f552199d700 1 -- 172.21.15.71:0/3269549728 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f551c09b750 con 0x7f551c15dcc0 2023-10-09T06:42:32.661 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.658+0000 7f552199d700 1 -- 172.21.15.71:0/3269549728 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551c16de70 con 0x7f551c15dcc0 2023-10-09T06:42:32.661 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.659+0000 7f5518ff9700 1 -- 172.21.15.71:0/3269549728 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5514014830 con 0x7f551c15dcc0 2023-10-09T06:42:32.661 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.660+0000 7f5518ff9700 1 --2- 172.21.15.71:0/3269549728 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5500066f30 0x7f55000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:32.661 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.660+0000 7f5518ff9700 1 -- 172.21.15.71:0/3269549728 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5514084bf0 con 0x7f551c15dcc0 2023-10-09T06:42:32.661 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.661+0000 7f552099b700 1 --2- 172.21.15.71:0/3269549728 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5500066f30 0x7f55000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:32.662 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.661+0000 7f552099b700 1 --2- 172.21.15.71:0/3269549728 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5500066f30 0x7f55000693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f55100017f0 tx=0x7f5510009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:32.666 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.665+0000 7f5518ff9700 1 -- 172.21.15.71:0/3269549728 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5514052110 con 0x7f551c15dcc0 2023-10-09T06:42:32.857 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.856+0000 7f552199d700 1 -- 172.21.15.71:0/3269549728 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f551c064b50 con 0x7f551c15dcc0 2023-10-09T06:42:32.857 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.857+0000 7f5518ff9700 1 -- 172.21.15.71:0/3269549728 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f5514055730 con 0x7f551c15dcc0 2023-10-09T06:42:32.858 INFO:teuthology.misc.health.smithi071.stdout: 2023-10-09T06:42:32.858 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":16,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:42:28.883427+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:42:32.860 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.859+0000 7f552199d700 1 -- 172.21.15.71:0/3269549728 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5500066f30 msgr2=0x7f55000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:32.860 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.859+0000 7f552199d700 1 --2- 172.21.15.71:0/3269549728 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5500066f30 0x7f55000693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f55100017f0 tx=0x7f5510009040 comp rx=0 tx=0).stop 2023-10-09T06:42:32.860 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.859+0000 7f552199d700 1 -- 172.21.15.71:0/3269549728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f551c15dcc0 msgr2=0x7f551c16e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:32.861 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.859+0000 7f552199d700 1 --2- 172.21.15.71:0/3269549728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f551c15dcc0 0x7f551c16e170 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5514009e20 tx=0x7f551400b040 comp rx=0 tx=0).stop 2023-10-09T06:42:32.861 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.859+0000 7f552199d700 1 -- 172.21.15.71:0/3269549728 shutdown_connections 2023-10-09T06:42:32.861 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.859+0000 7f552199d700 1 --2- 172.21.15.71:0/3269549728 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5500066f30 0x7f55000693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:32.861 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.859+0000 7f552199d700 1 --2- 172.21.15.71:0/3269549728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f551c15dcc0 0x7f551c16e170 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:32.861 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.859+0000 7f552199d700 1 --2- 172.21.15.71:0/3269549728 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f551c15b140 0x7f551c0cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:32.861 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.859+0000 7f552199d700 1 --2- 172.21.15.71:0/3269549728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f551c15ce50 0x7f551c16ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:32.861 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.859+0000 7f552199d700 1 -- 172.21.15.71:0/3269549728 >> 172.21.15.71:0/3269549728 conn(0x7f551c087ff0 msgr2=0x7f551c06dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:32.861 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.859+0000 7f552199d700 1 -- 172.21.15.71:0/3269549728 shutdown_connections 2023-10-09T06:42:32.861 INFO:teuthology.misc.health.smithi071.stderr:2023-10-09T06:42:32.859+0000 7f552199d700 1 -- 172.21.15.71:0/3269549728 wait complete. 2023-10-09T06:42:32.875 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-09T06:42:32.875 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-09T06:42:32.876 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T06:42:32.876 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T06:42:32.880 INFO:tasks.ceph.mds.a:Started 2023-10-09T06:42:32.880 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T06:42:32.880 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T06:42:32.884 INFO:tasks.ceph.mds.c:Started 2023-10-09T06:42:32.884 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T06:42:32.884 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T06:42:32.889 INFO:tasks.ceph.mds.b:Started 2023-10-09T06:42:32.889 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T06:42:32.889 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T06:42:32.894 INFO:tasks.ceph.mds.d:Started 2023-10-09T06:42:32.894 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-09T06:42:32.894 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:42:33.011 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2023-10-09T06:42:33.015 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-10-09T06:42:33.030 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-09T06:42:33.030 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-09T06:42:33.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.085+0000 7ff7f07ff700 1 Processor -- start 2023-10-09T06:42:33.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.085+0000 7ff7f07ff700 1 -- start start 2023-10-09T06:42:33.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.086+0000 7ff7f07ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff7e8159c60 0x7ff7e815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:33.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.087+0000 7ff7f07ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e815a160 con 0x7ff7e815db10 2023-10-09T06:42:33.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.087+0000 7ff7f07ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e80d13a0 con 0x7ff7e8159890 2023-10-09T06:42:33.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.087+0000 7ff7f07ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e815df50 con 0x7ff7e8159c60 2023-10-09T06:42:33.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.087+0000 7ff7eed9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff7e815db10 0x7ff7e8069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53180/0 (socket says 172.21.15.71:53180) 2023-10-09T06:42:33.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.087+0000 7ff7eed9c700 1 -- 172.21.15.71:0/2809908035 learned_addr learned my addr 172.21.15.71:0/2809908035 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:33.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.087+0000 7ff7edd9a700 1 --2- 172.21.15.71:0/2809908035 >> v2:172.21.15.71:3300/0 conn(0x7ff7e8159c60 0x7ff7e815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:33.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.087+0000 7ff7edd9a700 1 -- 172.21.15.71:0/2809908035 >> v1:172.21.15.179:6789/0 conn(0x7ff7e8159890 legacy=0x7ff7e815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:33.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.087+0000 7ff7ed599700 1 -- 172.21.15.71:0/2809908035 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672136486 0 0) 0x7ff7e80d13a0 con 0x7ff7e8159890 2023-10-09T06:42:33.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.087+0000 7ff7edd9a700 1 -- 172.21.15.71:0/2809908035 >> v1:172.21.15.71:6789/0 conn(0x7ff7e815db10 legacy=0x7ff7e8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:33.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.087+0000 7ff7edd9a700 1 -- 172.21.15.71:0/2809908035 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e815e140 con 0x7ff7e8159c60 2023-10-09T06:42:33.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.088+0000 7ff7edd9a700 1 --2- 172.21.15.71:0/2809908035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7e8159c60 0x7ff7e815d5d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff7d80098e0 tx=0x7ff7d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898fc2cad43e46ae server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:33.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.088+0000 7ff7ed599700 1 -- 172.21.15.71:0/2809908035 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d8009e80 con 0x7ff7e8159c60 2023-10-09T06:42:33.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.088+0000 7ff7ed599700 1 -- 172.21.15.71:0/2809908035 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d800b760 con 0x7ff7e8159c60 2023-10-09T06:42:33.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.088+0000 7ff7ed599700 1 -- 172.21.15.71:0/2809908035 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d800bae0 con 0x7ff7e8159c60 2023-10-09T06:42:33.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.088+0000 7ff7f07ff700 1 -- 172.21.15.71:0/2809908035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7e8159c60 msgr2=0x7ff7e815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:33.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.088+0000 7ff7f07ff700 1 --2- 172.21.15.71:0/2809908035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7e8159c60 0x7ff7e815d5d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff7d80098e0 tx=0x7ff7d80091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.088+0000 7ff7f07ff700 1 -- 172.21.15.71:0/2809908035 shutdown_connections 2023-10-09T06:42:33.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.088+0000 7ff7f07ff700 1 --2- 172.21.15.71:0/2809908035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7e8159c60 0x7ff7e815d5d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.088+0000 7ff7f07ff700 1 -- 172.21.15.71:0/2809908035 >> 172.21.15.71:0/2809908035 conn(0x7ff7e8068e20 msgr2=0x7ff7e80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:33.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.088+0000 7ff7f07ff700 1 -- 172.21.15.71:0/2809908035 shutdown_connections 2023-10-09T06:42:33.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.088+0000 7ff7f07ff700 1 -- 172.21.15.71:0/2809908035 wait complete. 2023-10-09T06:42:33.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.090+0000 7ff7f07ff700 1 Processor -- start 2023-10-09T06:42:33.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.090+0000 7ff7f07ff700 1 -- start start 2023-10-09T06:42:33.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.091+0000 7ff7f07ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7e8159890 0x7ff7e8169870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:33.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.091+0000 7ff7f07ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7e8159c60 0x7ff7e81473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:33.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.091+0000 7ff7f07ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7e815db10 0x7ff7e80cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:33.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.091+0000 7ff7f07ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e8169db0 con 0x7ff7e815db10 2023-10-09T06:42:33.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.091+0000 7ff7f07ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e81478e0 con 0x7ff7e8159890 2023-10-09T06:42:33.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.091+0000 7ff7f07ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e8152c90 con 0x7ff7e8159c60 2023-10-09T06:42:33.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.091+0000 7ff7eed9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7e815db10 0x7ff7e80cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:33.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.091+0000 7ff7eed9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7e815db10 0x7ff7e80cd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50922/0 (socket says 172.21.15.71:50922) 2023-10-09T06:42:33.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.091+0000 7ff7eed9c700 1 -- 172.21.15.71:0/1745752088 learned_addr learned my addr 172.21.15.71:0/1745752088 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:33.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.091+0000 7ff7ee59b700 1 --2- 172.21.15.71:0/1745752088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7e8159890 0x7ff7e8169870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:33.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.091+0000 7ff7edd9a700 1 --2- 172.21.15.71:0/1745752088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7e8159c60 0x7ff7e81473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:33.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.092+0000 7ff7eed9c700 1 -- 172.21.15.71:0/1745752088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7e8159c60 msgr2=0x7ff7e81473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:33.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.092+0000 7ff7eed9c700 1 --2- 172.21.15.71:0/1745752088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7e8159c60 0x7ff7e81473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.092+0000 7ff7eed9c700 1 -- 172.21.15.71:0/1745752088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7e8159890 msgr2=0x7ff7e8169870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:33.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.092+0000 7ff7eed9c700 1 --2- 172.21.15.71:0/1745752088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7e8159890 0x7ff7e8169870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.092+0000 7ff7eed9c700 1 -- 172.21.15.71:0/1745752088 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d8009420 con 0x7ff7e815db10 2023-10-09T06:42:33.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.092+0000 7ff7eed9c700 1 --2- 172.21.15.71:0/1745752088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7e815db10 0x7ff7e80cd100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000cdd0 tx=0x7ff7e0001bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:33.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.092+0000 7ff7de7fc700 1 -- 172.21.15.71:0/1745752088 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e000aa80 con 0x7ff7e815db10 2023-10-09T06:42:33.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.092+0000 7ff7de7fc700 1 -- 172.21.15.71:0/1745752088 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e000abe0 con 0x7ff7e815db10 2023-10-09T06:42:33.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.092+0000 7ff7de7fc700 1 -- 172.21.15.71:0/1745752088 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e00070f0 con 0x7ff7e815db10 2023-10-09T06:42:33.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.092+0000 7ff7f07ff700 1 -- 172.21.15.71:0/1745752088 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e80b5170 con 0x7ff7e815db10 2023-10-09T06:42:33.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.092+0000 7ff7f07ff700 1 -- 172.21.15.71:0/1745752088 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e80b5430 con 0x7ff7e815db10 2023-10-09T06:42:33.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.093+0000 7ff7f07ff700 1 -- 172.21.15.71:0/1745752088 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e80d15e0 con 0x7ff7e815db10 2023-10-09T06:42:33.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.094+0000 7ff7de7fc700 1 -- 172.21.15.71:0/1745752088 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff7e00074e0 con 0x7ff7e815db10 2023-10-09T06:42:33.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.095+0000 7ff7de7fc700 1 --2- 172.21.15.71:0/1745752088 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff7cc066f30 0x7ff7cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:33.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.095+0000 7ff7de7fc700 1 -- 172.21.15.71:0/1745752088 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff7e0084760 con 0x7ff7e815db10 2023-10-09T06:42:33.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.095+0000 7ff7ee59b700 1 --2- 172.21.15.71:0/1745752088 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff7cc066f30 0x7ff7cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:33.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.096+0000 7ff7ee59b700 1 --2- 172.21.15.71:0/1745752088 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff7cc066f30 0x7ff7cc0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4003a40 tx=0x7ff7e4007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:33.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.099+0000 7ff7de7fc700 1 -- 172.21.15.71:0/1745752088 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7e0051c70 con 0x7ff7e815db10 2023-10-09T06:42:33.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.290+0000 7ff7f07ff700 1 -- 172.21.15.71:0/1745752088 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7e804c3c0 con 0x7ff7e815db10 2023-10-09T06:42:33.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.291+0000 7ff7de7fc700 1 -- 172.21.15.71:0/1745752088 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12127 (secure 0 0 0) 0x7ff7e0055290 con 0x7ff7e815db10 2023-10-09T06:42:33.292 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:42:33.292 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":16,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:42:28.883427+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:42:33.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.293+0000 7ff7f07ff700 1 -- 172.21.15.71:0/1745752088 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff7cc066f30 msgr2=0x7ff7cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:33.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.293+0000 7ff7f07ff700 1 --2- 172.21.15.71:0/1745752088 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff7cc066f30 0x7ff7cc0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4003a40 tx=0x7ff7e4007ec0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.293+0000 7ff7f07ff700 1 -- 172.21.15.71:0/1745752088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7e815db10 msgr2=0x7ff7e80cd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:33.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.293+0000 7ff7f07ff700 1 --2- 172.21.15.71:0/1745752088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7e815db10 0x7ff7e80cd100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000cdd0 tx=0x7ff7e0001bc0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.293+0000 7ff7f07ff700 1 -- 172.21.15.71:0/1745752088 shutdown_connections 2023-10-09T06:42:33.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.293+0000 7ff7f07ff700 1 --2- 172.21.15.71:0/1745752088 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff7cc066f30 0x7ff7cc0693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.293+0000 7ff7f07ff700 1 --2- 172.21.15.71:0/1745752088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7e815db10 0x7ff7e80cd100 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.293+0000 7ff7f07ff700 1 --2- 172.21.15.71:0/1745752088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7e8159890 0x7ff7e8169870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.293+0000 7ff7f07ff700 1 --2- 172.21.15.71:0/1745752088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7e8159c60 0x7ff7e81473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.293+0000 7ff7f07ff700 1 -- 172.21.15.71:0/1745752088 >> 172.21.15.71:0/1745752088 conn(0x7ff7e8068e20 msgr2=0x7ff7e8153d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:33.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.293+0000 7ff7f07ff700 1 -- 172.21.15.71:0/1745752088 shutdown_connections 2023-10-09T06:42:33.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.293+0000 7ff7f07ff700 1 -- 172.21.15.71:0/1745752088 wait complete. 2023-10-09T06:42:33.311 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T06:42:33.312 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:42:33.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.494+0000 7f5ab5f9d700 1 Processor -- start 2023-10-09T06:42:33.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.494+0000 7f5ab5f9d700 1 -- start start 2023-10-09T06:42:33.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.495+0000 7f5ab5f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5ab00b16d0 0x7f5ab00b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:33.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.495+0000 7f5ab5f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ab00b33b0 0x7f5ab00b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:33.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.495+0000 7f5ab5f9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab00b2080 con 0x7f5ab00b4e70 2023-10-09T06:42:33.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.495+0000 7f5ab5f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab00cfb00 con 0x7f5ab00b16d0 2023-10-09T06:42:33.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.495+0000 7f5ab5f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab00b5c40 con 0x7f5ab00b33b0 2023-10-09T06:42:33.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.495+0000 7f5ab4f9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f5ab00b4e70 0x7f5ab00ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53188/0 (socket says 172.21.15.71:53188) 2023-10-09T06:42:33.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.495+0000 7f5ab4f9b700 1 -- 172.21.15.71:0/1472112667 learned_addr learned my addr 172.21.15.71:0/1472112667 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:33.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.496+0000 7f5aaf7fe700 1 -- 172.21.15.71:0/1472112667 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 148769510 0 0) 0x7f5ab00b2080 con 0x7f5ab00b4e70 2023-10-09T06:42:33.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.496+0000 7f5aaf7fe700 1 -- 172.21.15.71:0/1472112667 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5aa0003570 con 0x7f5ab00b4e70 2023-10-09T06:42:33.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.496+0000 7f5aaffff700 1 --2- 172.21.15.71:0/1472112667 >> v2:172.21.15.179:3300/0 conn(0x7f5ab00b16d0 0x7f5ab00b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:33.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.496+0000 7f5ab579c700 1 --2- 172.21.15.71:0/1472112667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ab00b33b0 0x7f5ab00b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:33.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.496+0000 7f5aaf7fe700 1 -- 172.21.15.71:0/1472112667 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 99418247 0 0) 0x7f5aa0003570 con 0x7f5ab00b4e70 2023-10-09T06:42:33.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.496+0000 7f5aaf7fe700 1 -- 172.21.15.71:0/1472112667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ab00b33b0 msgr2=0x7f5ab00b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:33.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.496+0000 7f5aaf7fe700 1 --2- 172.21.15.71:0/1472112667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ab00b33b0 0x7f5ab00b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.496+0000 7f5aaf7fe700 1 -- 172.21.15.71:0/1472112667 >> v2:172.21.15.179:3300/0 conn(0x7f5ab00b16d0 msgr2=0x7f5ab00b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:33.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.496+0000 7f5aaf7fe700 1 --2- 172.21.15.71:0/1472112667 >> v2:172.21.15.179:3300/0 conn(0x7f5ab00b16d0 0x7f5ab00b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.496+0000 7f5aaf7fe700 1 -- 172.21.15.71:0/1472112667 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab00b5f20 con 0x7f5ab00b4e70 2023-10-09T06:42:33.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.496+0000 7f5aaf7fe700 1 -- 172.21.15.71:0/1472112667 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f5aa4001470 con 0x7f5ab00b4e70 2023-10-09T06:42:33.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.496+0000 7f5aaf7fe700 1 -- 172.21.15.71:0/1472112667 >> v1:172.21.15.71:6789/0 conn(0x7f5ab00b4e70 legacy=0x7f5ab00ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:33.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.496+0000 7f5aaf7fe700 1 --2- 172.21.15.71:0/1472112667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5aa0003ae0 0x7f5aa0003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:33.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.496+0000 7f5aaf7fe700 1 --2- 172.21.15.71:0/1472112667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5aa0004810 0x7f5aa0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:33.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.496+0000 7f5aaf7fe700 1 --2- 172.21.15.71:0/1472112667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ab00b33b0 0x7f5aa00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:33.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.496+0000 7f5aaf7fe700 1 -- 172.21.15.71:0/1472112667 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab00cfb00 con 0x7f5aa0003ae0 2023-10-09T06:42:33.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.496+0000 7f5aaf7fe700 1 -- 172.21.15.71:0/1472112667 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab00b5c40 con 0x7f5aa0004810 2023-10-09T06:42:33.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.496+0000 7f5aaf7fe700 1 -- 172.21.15.71:0/1472112667 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa000bbc0 con 0x7f5ab00b33b0 2023-10-09T06:42:33.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.496+0000 7f5ab4f9b700 1 --2- 172.21.15.71:0/1472112667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5aa0003ae0 0x7f5aa0003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:33.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.496+0000 7f5aaffff700 1 --2- 172.21.15.71:0/1472112667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5aa0004810 0x7f5aa0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:33.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.496+0000 7f5ab579c700 1 --2- 172.21.15.71:0/1472112667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ab00b33b0 0x7f5aa00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:33.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.497+0000 7f5aaffff700 1 -- 172.21.15.71:0/1472112667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ab00b33b0 msgr2=0x7f5aa00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:33.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.497+0000 7f5aaffff700 1 --2- 172.21.15.71:0/1472112667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ab00b33b0 0x7f5aa00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.497+0000 7f5aaffff700 1 -- 172.21.15.71:0/1472112667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5aa0003ae0 msgr2=0x7f5aa0003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:33.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.497+0000 7f5aaffff700 1 --2- 172.21.15.71:0/1472112667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5aa0003ae0 0x7f5aa0003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.497+0000 7f5aaffff700 1 -- 172.21.15.71:0/1472112667 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa0003570 con 0x7f5aa0004810 2023-10-09T06:42:33.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.497+0000 7f5aaffff700 1 --2- 172.21.15.71:0/1472112667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5aa0004810 0x7f5aa0004c80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c009c00 tx=0x7f5a9c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf4fd3a6c665086a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:33.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.497+0000 7f5aaf7fe700 1 -- 172.21.15.71:0/1472112667 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c00e710 con 0x7f5aa0004810 2023-10-09T06:42:33.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.497+0000 7f5aaf7fe700 1 -- 172.21.15.71:0/1472112667 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9c00e870 con 0x7f5aa0004810 2023-10-09T06:42:33.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.497+0000 7f5aaf7fe700 1 -- 172.21.15.71:0/1472112667 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c00ec30 con 0x7f5aa0004810 2023-10-09T06:42:33.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.498+0000 7f5ab5f9d700 1 -- 172.21.15.71:0/1472112667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5aa0004810 msgr2=0x7f5aa0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:33.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.498+0000 7f5ab5f9d700 1 --2- 172.21.15.71:0/1472112667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5aa0004810 0x7f5aa0004c80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c009c00 tx=0x7f5a9c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.498+0000 7f5ab579c700 1 -- 172.21.15.71:0/1472112667 reap_dead start 2023-10-09T06:42:33.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.498+0000 7f5ab5f9d700 1 -- 172.21.15.71:0/1472112667 shutdown_connections 2023-10-09T06:42:33.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.498+0000 7f5ab5f9d700 1 -- 172.21.15.71:0/1472112667 >> 172.21.15.71:0/1472112667 conn(0x7f5ab00d10c0 msgr2=0x7f5ab00affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:33.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.498+0000 7f5ab5f9d700 1 -- 172.21.15.71:0/1472112667 shutdown_connections 2023-10-09T06:42:33.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.498+0000 7f5ab5f9d700 1 -- 172.21.15.71:0/1472112667 wait complete. 2023-10-09T06:42:33.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.499+0000 7f5ab5f9d700 1 Processor -- start 2023-10-09T06:42:33.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.499+0000 7f5ab5f9d700 1 -- start start 2023-10-09T06:42:33.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.500+0000 7f5ab5f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5aa0004810 0x7f5ab0156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:33.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.500+0000 7f5ab5f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ab00cad20 0x7f5ab0169ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:33.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.500+0000 7f5ab5f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ab016a530 0x7f5ab00c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:33.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.500+0000 7f5ab5f9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab01567b0 con 0x7f5aa0004810 2023-10-09T06:42:33.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.500+0000 7f5ab5f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab00c6360 con 0x7f5ab016a530 2023-10-09T06:42:33.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.500+0000 7f5ab5f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab00c6ee0 con 0x7f5ab00cad20 2023-10-09T06:42:33.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.500+0000 7f5ab4f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5aa0004810 0x7f5ab0156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:33.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.501+0000 7f5ab4f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5aa0004810 0x7f5ab0156270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50948/0 (socket says 172.21.15.71:50948) 2023-10-09T06:42:33.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.501+0000 7f5ab4f9b700 1 -- 172.21.15.71:0/3172800047 learned_addr learned my addr 172.21.15.71:0/3172800047 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:33.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.501+0000 7f5ab4f9b700 1 -- 172.21.15.71:0/3172800047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ab00cad20 msgr2=0x7f5ab0169ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:33.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.501+0000 7f5aaffff700 1 --2- 172.21.15.71:0/3172800047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ab00cad20 0x7f5ab0169ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:33.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.501+0000 7f5ab579c700 1 --2- 172.21.15.71:0/3172800047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ab016a530 0x7f5ab00c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:33.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.501+0000 7f5ab4f9b700 1 --2- 172.21.15.71:0/3172800047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ab00cad20 0x7f5ab0169ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.501+0000 7f5ab4f9b700 1 -- 172.21.15.71:0/3172800047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ab016a530 msgr2=0x7f5ab00c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:33.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.501+0000 7f5ab4f9b700 1 --2- 172.21.15.71:0/3172800047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ab016a530 0x7f5ab00c7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.501+0000 7f5ab4f9b700 1 -- 172.21.15.71:0/3172800047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab00c65b0 con 0x7f5aa0004810 2023-10-09T06:42:33.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.501+0000 7f5ab579c700 1 --2- 172.21.15.71:0/3172800047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ab016a530 0x7f5ab00c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:33.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.501+0000 7f5aaffff700 1 --2- 172.21.15.71:0/3172800047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ab00cad20 0x7f5ab0169ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:33.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.501+0000 7f5ab4f9b700 1 --2- 172.21.15.71:0/3172800047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5aa0004810 0x7f5ab0156270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4007fd0 tx=0x7f5aa4001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:33.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.501+0000 7f5aacff9700 1 -- 172.21.15.71:0/3172800047 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4018030 con 0x7f5aa0004810 2023-10-09T06:42:33.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.501+0000 7f5aacff9700 1 -- 172.21.15.71:0/3172800047 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa400f8d0 con 0x7f5aa0004810 2023-10-09T06:42:33.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.501+0000 7f5aacff9700 1 -- 172.21.15.71:0/3172800047 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa400fc70 con 0x7f5aa0004810 2023-10-09T06:42:33.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.501+0000 7f5ab5f9d700 1 -- 172.21.15.71:0/3172800047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab00c6890 con 0x7f5aa0004810 2023-10-09T06:42:33.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.502+0000 7f5ab5f9d700 1 -- 172.21.15.71:0/3172800047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab00cb190 con 0x7f5aa0004810 2023-10-09T06:42:33.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.502+0000 7f5ab5f9d700 1 -- 172.21.15.71:0/3172800047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab00c71c0 con 0x7f5aa0004810 2023-10-09T06:42:33.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.503+0000 7f5aacff9700 1 -- 172.21.15.71:0/3172800047 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5aa401b070 con 0x7f5aa0004810 2023-10-09T06:42:33.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.504+0000 7f5aacff9700 1 --2- 172.21.15.71:0/3172800047 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5a94066fb0 0x7f5a94069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:33.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.504+0000 7f5aacff9700 1 -- 172.21.15.71:0/3172800047 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5aa4019070 con 0x7f5aa0004810 2023-10-09T06:42:33.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.504+0000 7f5aaffff700 1 --2- 172.21.15.71:0/3172800047 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5a94066fb0 0x7f5a94069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:33.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.505+0000 7f5aaffff700 1 --2- 172.21.15.71:0/3172800047 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5a94066fb0 0x7f5a94069460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00af3c0 tx=0x7f5a9c01a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:33.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.508+0000 7f5aacff9700 1 -- 172.21.15.71:0/3172800047 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5aa4051640 con 0x7f5aa0004810 2023-10-09T06:42:33.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.705+0000 7f5ab5f9d700 1 -- 172.21.15.71:0/3172800047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ab004bb80 con 0x7f5aa0004810 2023-10-09T06:42:33.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.705+0000 7f5aacff9700 1 -- 172.21.15.71:0/3172800047 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5aa4054c60 con 0x7f5aa0004810 2023-10-09T06:42:33.707 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T06:42:33.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.707+0000 7f5ab5f9d700 1 -- 172.21.15.71:0/3172800047 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5a94066fb0 msgr2=0x7f5a94069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:33.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.707+0000 7f5ab5f9d700 1 --2- 172.21.15.71:0/3172800047 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5a94066fb0 0x7f5a94069460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00af3c0 tx=0x7f5a9c01a000 comp rx=0 tx=0).stop 2023-10-09T06:42:33.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.707+0000 7f5ab5f9d700 1 -- 172.21.15.71:0/3172800047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5aa0004810 msgr2=0x7f5ab0156270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:33.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.707+0000 7f5ab5f9d700 1 --2- 172.21.15.71:0/3172800047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5aa0004810 0x7f5ab0156270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4007fd0 tx=0x7f5aa4001dc0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.707+0000 7f5ab5f9d700 1 -- 172.21.15.71:0/3172800047 shutdown_connections 2023-10-09T06:42:33.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.707+0000 7f5ab5f9d700 1 --2- 172.21.15.71:0/3172800047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ab016a530 0x7f5ab00c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.707+0000 7f5ab5f9d700 1 --2- 172.21.15.71:0/3172800047 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5a94066fb0 0x7f5a94069460 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.708+0000 7f5ab5f9d700 1 --2- 172.21.15.71:0/3172800047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5aa0004810 0x7f5ab0156270 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.708+0000 7f5ab5f9d700 1 --2- 172.21.15.71:0/3172800047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ab00cad20 0x7f5ab0169ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.708+0000 7f5ab5f9d700 1 -- 172.21.15.71:0/3172800047 >> 172.21.15.71:0/3172800047 conn(0x7f5ab00d10c0 msgr2=0x7f5ab00ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:33.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.708+0000 7f5ab5f9d700 1 -- 172.21.15.71:0/3172800047 shutdown_connections 2023-10-09T06:42:33.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.708+0000 7f5ab5f9d700 1 -- 172.21.15.71:0/3172800047 wait complete. 2023-10-09T06:42:33.726 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:42:33.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.905+0000 7f4f339ff700 1 Processor -- start 2023-10-09T06:42:33.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.905+0000 7f4f339ff700 1 -- start start 2023-10-09T06:42:33.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.906+0000 7f4f339ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4f2c0ccf90 0x7f4f2c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:33.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.906+0000 7f4f339ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2c0cc300 con 0x7f4f2c0b1420 2023-10-09T06:42:33.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.907+0000 7f4f339ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2c0ad370 con 0x7f4f2c0cbf30 2023-10-09T06:42:33.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.907+0000 7f4f339ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f2c156bf0 con 0x7f4f2c0ccf90 2023-10-09T06:42:33.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.907+0000 7f4f31f9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4f2c0ccf90 0x7f4f2c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:33.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.907+0000 7f4f30f9a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f4f2c0b1420 0x7f4f2c0c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53200/0 (socket says 172.21.15.71:53200) 2023-10-09T06:42:33.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.907+0000 7f4f30f9a700 1 -- 172.21.15.71:0/537196220 learned_addr learned my addr 172.21.15.71:0/537196220 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:33.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.907+0000 7f4f31f9c700 1 -- 172.21.15.71:0/537196220 >> v1:172.21.15.179:6789/0 conn(0x7f4f2c0cbf30 legacy=0x7f4f2c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:33.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.907+0000 7f4f31f9c700 1 -- 172.21.15.71:0/537196220 >> v1:172.21.15.71:6789/0 conn(0x7f4f2c0b1420 legacy=0x7f4f2c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:33.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.907+0000 7f4f31f9c700 1 -- 172.21.15.71:0/537196220 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c0ad650 con 0x7f4f2c0ccf90 2023-10-09T06:42:33.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.908+0000 7f4f31f9c700 1 --2- 172.21.15.71:0/537196220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f2c0ccf90 0x7f4f2c0ae410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4f24009e60 tx=0x7f4f24009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73891d670faff387 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:33.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.908+0000 7f4f23fff700 1 -- 172.21.15.71:0/537196220 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2400e070 con 0x7f4f2c0ccf90 2023-10-09T06:42:33.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.908+0000 7f4f23fff700 1 -- 172.21.15.71:0/537196220 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2400bc30 con 0x7f4f2c0ccf90 2023-10-09T06:42:33.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.908+0000 7f4f23fff700 1 -- 172.21.15.71:0/537196220 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f24012430 con 0x7f4f2c0ccf90 2023-10-09T06:42:33.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.908+0000 7f4f339ff700 1 -- 172.21.15.71:0/537196220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f2c0ccf90 msgr2=0x7f4f2c0ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:33.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.908+0000 7f4f339ff700 1 --2- 172.21.15.71:0/537196220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f2c0ccf90 0x7f4f2c0ae410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4f24009e60 tx=0x7f4f24009780 comp rx=0 tx=0).stop 2023-10-09T06:42:33.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.908+0000 7f4f339ff700 1 -- 172.21.15.71:0/537196220 shutdown_connections 2023-10-09T06:42:33.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.908+0000 7f4f339ff700 1 --2- 172.21.15.71:0/537196220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f2c0ccf90 0x7f4f2c0ae410 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.908+0000 7f4f339ff700 1 -- 172.21.15.71:0/537196220 >> 172.21.15.71:0/537196220 conn(0x7f4f2c06a320 msgr2=0x7f4f2c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:33.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.908+0000 7f4f339ff700 1 -- 172.21.15.71:0/537196220 shutdown_connections 2023-10-09T06:42:33.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.908+0000 7f4f339ff700 1 -- 172.21.15.71:0/537196220 wait complete. 2023-10-09T06:42:33.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.910+0000 7f4f339ff700 1 Processor -- start 2023-10-09T06:42:33.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.910+0000 7f4f339ff700 1 -- start start 2023-10-09T06:42:33.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.911+0000 7f4f339ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f2c0b1420 0x7f4f2c0ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:33.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.911+0000 7f4f339ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f2c0cbf30 0x7f4f2c14a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:33.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.911+0000 7f4f339ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f2c0ccf90 0x7f4f2c0c15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:33.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.911+0000 7f4f339ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c167890 con 0x7f4f2c0ccf90 2023-10-09T06:42:33.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.911+0000 7f4f339ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c14ba20 con 0x7f4f2c0b1420 2023-10-09T06:42:33.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.911+0000 7f4f339ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c167dd0 con 0x7f4f2c0cbf30 2023-10-09T06:42:33.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.911+0000 7f4f31f9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f2c0ccf90 0x7f4f2c0c15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:33.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.911+0000 7f4f31f9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f2c0ccf90 0x7f4f2c0c15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50960/0 (socket says 172.21.15.71:50960) 2023-10-09T06:42:33.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.911+0000 7f4f31f9c700 1 -- 172.21.15.71:0/2446947310 learned_addr learned my addr 172.21.15.71:0/2446947310 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:33.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.911+0000 7f4f30f9a700 1 --2- 172.21.15.71:0/2446947310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f2c0cbf30 0x7f4f2c14a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:33.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.911+0000 7f4f3179b700 1 --2- 172.21.15.71:0/2446947310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f2c0b1420 0x7f4f2c0ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:33.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.911+0000 7f4f31f9c700 1 -- 172.21.15.71:0/2446947310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f2c0cbf30 msgr2=0x7f4f2c14a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:33.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.911+0000 7f4f31f9c700 1 --2- 172.21.15.71:0/2446947310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f2c0cbf30 0x7f4f2c14a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.912+0000 7f4f31f9c700 1 -- 172.21.15.71:0/2446947310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f2c0b1420 msgr2=0x7f4f2c0ab9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:33.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.912+0000 7f4f31f9c700 1 --2- 172.21.15.71:0/2446947310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f2c0b1420 0x7f4f2c0ab9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:33.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.912+0000 7f4f31f9c700 1 -- 172.21.15.71:0/2446947310 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f24009a20 con 0x7f4f2c0ccf90 2023-10-09T06:42:33.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.912+0000 7f4f31f9c700 1 --2- 172.21.15.71:0/2446947310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f2c0ccf90 0x7f4f2c0c15e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c064290 tx=0x7f4f24019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:33.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.912+0000 7f4f217fa700 1 -- 172.21.15.71:0/2446947310 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f24012e10 con 0x7f4f2c0ccf90 2023-10-09T06:42:33.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.912+0000 7f4f217fa700 1 -- 172.21.15.71:0/2446947310 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2401e630 con 0x7f4f2c0ccf90 2023-10-09T06:42:33.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.912+0000 7f4f217fa700 1 -- 172.21.15.71:0/2446947310 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2401e9f0 con 0x7f4f2c0ccf90 2023-10-09T06:42:33.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.912+0000 7f4f339ff700 1 -- 172.21.15.71:0/2446947310 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2c167aa0 con 0x7f4f2c0ccf90 2023-10-09T06:42:33.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.912+0000 7f4f339ff700 1 -- 172.21.15.71:0/2446947310 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2c14b740 con 0x7f4f2c0ccf90 2023-10-09T06:42:33.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.913+0000 7f4f339ff700 1 -- 172.21.15.71:0/2446947310 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2c04c3c0 con 0x7f4f2c0ccf90 2023-10-09T06:42:33.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.914+0000 7f4f217fa700 1 -- 172.21.15.71:0/2446947310 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f24024070 con 0x7f4f2c0ccf90 2023-10-09T06:42:33.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.915+0000 7f4f217fa700 1 --2- 172.21.15.71:0/2446947310 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4f10066f30 0x7f4f100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:33.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.916+0000 7f4f217fa700 1 -- 172.21.15.71:0/2446947310 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4f24086a70 con 0x7f4f2c0ccf90 2023-10-09T06:42:33.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.916+0000 7f4f3179b700 1 --2- 172.21.15.71:0/2446947310 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4f10066f30 0x7f4f100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:33.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.916+0000 7f4f3179b700 1 --2- 172.21.15.71:0/2446947310 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4f10066f30 0x7f4f100693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4f28003aa0 tx=0x7f4f28000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:33.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:33.920+0000 7f4f217fa700 1 -- 172.21.15.71:0/2446947310 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f24053f90 con 0x7f4f2c0ccf90 2023-10-09T06:42:34.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.157+0000 7f4f339ff700 1 -- 172.21.15.71:0/2446947310 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f2c0b0af0 con 0x7f4f2c0ccf90 2023-10-09T06:42:34.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.158+0000 7f4f217fa700 1 -- 172.21.15.71:0/2446947310 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f4f2402c090 con 0x7f4f2c0ccf90 2023-10-09T06:42:34.159 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:42:34.159 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3129948705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3129948705},{"type":"v1","addr":"172.21.15.71:6835","nonce":3129948705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2871867918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2871867918},{"type":"v1","addr":"172.21.15.71:6833","nonce":2871867918}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2975286987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2975286987},{"type":"v1","addr":"172.21.15.179:6836","nonce":2975286987}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3516898913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3516898913},{"type":"v1","addr":"172.21.15.179:6837","nonce":3516898913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-09T06:42:34.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.160+0000 7f4f339ff700 1 -- 172.21.15.71:0/2446947310 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4f10066f30 msgr2=0x7f4f100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:34.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.160+0000 7f4f339ff700 1 --2- 172.21.15.71:0/2446947310 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4f10066f30 0x7f4f100693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4f28003aa0 tx=0x7f4f28000bc0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.160+0000 7f4f339ff700 1 -- 172.21.15.71:0/2446947310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f2c0ccf90 msgr2=0x7f4f2c0c15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:34.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.160+0000 7f4f339ff700 1 --2- 172.21.15.71:0/2446947310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f2c0ccf90 0x7f4f2c0c15e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c064290 tx=0x7f4f24019000 comp rx=0 tx=0).stop 2023-10-09T06:42:34.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.160+0000 7f4f339ff700 1 -- 172.21.15.71:0/2446947310 shutdown_connections 2023-10-09T06:42:34.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.160+0000 7f4f339ff700 1 --2- 172.21.15.71:0/2446947310 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4f10066f30 0x7f4f100693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.160+0000 7f4f339ff700 1 --2- 172.21.15.71:0/2446947310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f2c0ccf90 0x7f4f2c0c15e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.160+0000 7f4f339ff700 1 --2- 172.21.15.71:0/2446947310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f2c0b1420 0x7f4f2c0ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.160+0000 7f4f339ff700 1 --2- 172.21.15.71:0/2446947310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f2c0cbf30 0x7f4f2c14a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.160+0000 7f4f339ff700 1 -- 172.21.15.71:0/2446947310 >> 172.21.15.71:0/2446947310 conn(0x7f4f2c06a320 msgr2=0x7f4f2c0afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:34.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.160+0000 7f4f339ff700 1 -- 172.21.15.71:0/2446947310 shutdown_connections 2023-10-09T06:42:34.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.160+0000 7f4f339ff700 1 -- 172.21.15.71:0/2446947310 wait complete. 2023-10-09T06:42:34.163 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 3 2023-10-09T06:42:34.179 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:42:34.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.358+0000 7fb16f59e700 1 Processor -- start 2023-10-09T06:42:34.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.358+0000 7fb16f59e700 1 -- start start 2023-10-09T06:42:34.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.359+0000 7fb16f59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb170159420 0x7fb1700b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:34.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.359+0000 7fb16f59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1701597f0 0x7fb1700b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:34.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.359+0000 7fb16f59e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1700b11d0 con 0x7fb17015d230 2023-10-09T06:42:34.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.359+0000 7fb16f59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1700b14b0 con 0x7fb170159420 2023-10-09T06:42:34.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.359+0000 7fb16f59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1700b1790 con 0x7fb1701597f0 2023-10-09T06:42:34.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.359+0000 7fb16ed9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb17015d230 0x7fb1700b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53210/0 (socket says 172.21.15.71:53210) 2023-10-09T06:42:34.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.359+0000 7fb16ed9d700 1 -- 172.21.15.71:0/725688335 learned_addr learned my addr 172.21.15.71:0/725688335 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:34.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.360+0000 7fb16dd9b700 1 --2- 172.21.15.71:0/725688335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1701597f0 0x7fb1700b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:34.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.360+0000 7fb16e59c700 1 --2- 172.21.15.71:0/725688335 >> v2:172.21.15.179:3300/0 conn(0x7fb170159420 0x7fb1700b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:34.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.360+0000 7fb16d59a700 1 -- 172.21.15.71:0/725688335 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777901804 0 0) 0x7fb1700b11d0 con 0x7fb17015d230 2023-10-09T06:42:34.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.360+0000 7fb16d59a700 1 -- 172.21.15.71:0/725688335 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb158003570 con 0x7fb17015d230 2023-10-09T06:42:34.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.360+0000 7fb16d59a700 1 -- 172.21.15.71:0/725688335 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 528416600 0 0) 0x7fb158003570 con 0x7fb17015d230 2023-10-09T06:42:34.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.360+0000 7fb16d59a700 1 -- 172.21.15.71:0/725688335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1701597f0 msgr2=0x7fb1700b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:34.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.360+0000 7fb16d59a700 1 --2- 172.21.15.71:0/725688335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1701597f0 0x7fb1700b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.360+0000 7fb16d59a700 1 -- 172.21.15.71:0/725688335 >> v2:172.21.15.179:3300/0 conn(0x7fb170159420 msgr2=0x7fb1700b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:34.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.360+0000 7fb16d59a700 1 --2- 172.21.15.71:0/725688335 >> v2:172.21.15.179:3300/0 conn(0x7fb170159420 0x7fb1700b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.360+0000 7fb16d59a700 1 -- 172.21.15.71:0/725688335 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1700b1a70 con 0x7fb17015d230 2023-10-09T06:42:34.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.360+0000 7fb16d59a700 1 -- 172.21.15.71:0/725688335 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fb1680017f0 con 0x7fb17015d230 2023-10-09T06:42:34.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.360+0000 7fb16d59a700 1 -- 172.21.15.71:0/725688335 >> v1:172.21.15.71:6789/0 conn(0x7fb17015d230 legacy=0x7fb1700b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:34.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.360+0000 7fb16d59a700 1 --2- 172.21.15.71:0/725688335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb158003ae0 0x7fb158003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:34.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.360+0000 7fb16d59a700 1 --2- 172.21.15.71:0/725688335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb158004810 0x7fb158004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:34.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.360+0000 7fb16d59a700 1 --2- 172.21.15.71:0/725688335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1701597f0 0x7fb1580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:34.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.360+0000 7fb16d59a700 1 -- 172.21.15.71:0/725688335 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1700b14b0 con 0x7fb158004810 2023-10-09T06:42:34.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.360+0000 7fb16d59a700 1 -- 172.21.15.71:0/725688335 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1700b1790 con 0x7fb158003ae0 2023-10-09T06:42:34.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.360+0000 7fb16d59a700 1 -- 172.21.15.71:0/725688335 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb15800bb10 con 0x7fb1701597f0 2023-10-09T06:42:34.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.361+0000 7fb16dd9b700 1 --2- 172.21.15.71:0/725688335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb158004810 0x7fb158004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:34.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.361+0000 7fb16ed9d700 1 --2- 172.21.15.71:0/725688335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1701597f0 0x7fb1580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:34.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.361+0000 7fb16e59c700 1 --2- 172.21.15.71:0/725688335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb158003ae0 0x7fb158003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:34.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.361+0000 7fb16dd9b700 1 -- 172.21.15.71:0/725688335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1701597f0 msgr2=0x7fb1580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:34.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.361+0000 7fb16dd9b700 1 --2- 172.21.15.71:0/725688335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1701597f0 0x7fb1580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.361+0000 7fb16dd9b700 1 -- 172.21.15.71:0/725688335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb158003ae0 msgr2=0x7fb158003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:34.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.361+0000 7fb16dd9b700 1 --2- 172.21.15.71:0/725688335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb158003ae0 0x7fb158003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.361+0000 7fb16dd9b700 1 -- 172.21.15.71:0/725688335 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb158003570 con 0x7fb158004810 2023-10-09T06:42:34.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.361+0000 7fb16dd9b700 1 --2- 172.21.15.71:0/725688335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb158004810 0x7fb158004c80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb164009c00 tx=0x7fb1640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ce4a8347c44490 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:34.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.361+0000 7fb16d59a700 1 -- 172.21.15.71:0/725688335 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16400e710 con 0x7fb158004810 2023-10-09T06:42:34.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.361+0000 7fb16d59a700 1 -- 172.21.15.71:0/725688335 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16400e870 con 0x7fb158004810 2023-10-09T06:42:34.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.361+0000 7fb16d59a700 1 -- 172.21.15.71:0/725688335 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16400ec30 con 0x7fb158004810 2023-10-09T06:42:34.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.362+0000 7fb16f59e700 1 -- 172.21.15.71:0/725688335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb158004810 msgr2=0x7fb158004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:34.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.362+0000 7fb16f59e700 1 --2- 172.21.15.71:0/725688335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb158004810 0x7fb158004c80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb164009c00 tx=0x7fb1640091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.362+0000 7fb16ed9d700 1 -- 172.21.15.71:0/725688335 reap_dead start 2023-10-09T06:42:34.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.362+0000 7fb16f59e700 1 -- 172.21.15.71:0/725688335 shutdown_connections 2023-10-09T06:42:34.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.362+0000 7fb16f59e700 1 -- 172.21.15.71:0/725688335 >> 172.21.15.71:0/725688335 conn(0x7fb1700d0660 msgr2=0x7fb1700d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:34.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.362+0000 7fb16f59e700 1 -- 172.21.15.71:0/725688335 shutdown_connections 2023-10-09T06:42:34.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.362+0000 7fb16f59e700 1 -- 172.21.15.71:0/725688335 wait complete. 2023-10-09T06:42:34.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.363+0000 7fb16f59e700 1 Processor -- start 2023-10-09T06:42:34.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.363+0000 7fb16f59e700 1 -- start start 2023-10-09T06:42:34.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.364+0000 7fb16f59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb158004810 0x7fb17015c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:34.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.364+0000 7fb16f59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb170150520 0x7fb1701528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:34.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.364+0000 7fb16f59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb170150ca0 0x7fb170151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:34.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.364+0000 7fb16f59e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb170151680 con 0x7fb170150ca0 2023-10-09T06:42:34.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.364+0000 7fb16f59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb170159bc0 con 0x7fb158004810 2023-10-09T06:42:34.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.364+0000 7fb16f59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17015a180 con 0x7fb170150520 2023-10-09T06:42:34.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.365+0000 7fb16ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb170150ca0 0x7fb170151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:34.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.365+0000 7fb16ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb170150ca0 0x7fb170151140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50980/0 (socket says 172.21.15.71:50980) 2023-10-09T06:42:34.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.365+0000 7fb16e59c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb158004810 0x7fb17015c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:34.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.365+0000 7fb16ed9d700 1 -- 172.21.15.71:0/3104125 learned_addr learned my addr 172.21.15.71:0/3104125 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:34.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.365+0000 7fb16dd9b700 1 --2- 172.21.15.71:0/3104125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb170150520 0x7fb1701528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:34.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.365+0000 7fb16ed9d700 1 -- 172.21.15.71:0/3104125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb170150520 msgr2=0x7fb1701528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:34.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.365+0000 7fb16ed9d700 1 --2- 172.21.15.71:0/3104125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb170150520 0x7fb1701528a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.365+0000 7fb16ed9d700 1 -- 172.21.15.71:0/3104125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb158004810 msgr2=0x7fb17015c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:34.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.365+0000 7fb16ed9d700 1 --2- 172.21.15.71:0/3104125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb158004810 0x7fb17015c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.365+0000 7fb16ed9d700 1 -- 172.21.15.71:0/3104125 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb170153120 con 0x7fb170150ca0 2023-10-09T06:42:34.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.365+0000 7fb16ed9d700 1 --2- 172.21.15.71:0/3104125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb170150ca0 0x7fb170151140 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb168007b40 tx=0x7fb168002140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:34.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.365+0000 7fb15e7fc700 1 -- 172.21.15.71:0/3104125 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16800aca0 con 0x7fb170150ca0 2023-10-09T06:42:34.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.365+0000 7fb15e7fc700 1 -- 172.21.15.71:0/3104125 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16800ae20 con 0x7fb170150ca0 2023-10-09T06:42:34.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.365+0000 7fb15e7fc700 1 -- 172.21.15.71:0/3104125 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb168013640 con 0x7fb170150ca0 2023-10-09T06:42:34.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.365+0000 7fb16f59e700 1 -- 172.21.15.71:0/3104125 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb170153400 con 0x7fb170150ca0 2023-10-09T06:42:34.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.366+0000 7fb16f59e700 1 -- 172.21.15.71:0/3104125 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb170152de0 con 0x7fb170150ca0 2023-10-09T06:42:34.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.366+0000 7fb16f59e700 1 -- 172.21.15.71:0/3104125 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17004c3c0 con 0x7fb170150ca0 2023-10-09T06:42:34.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.367+0000 7fb15e7fc700 1 -- 172.21.15.71:0/3104125 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1680139f0 con 0x7fb170150ca0 2023-10-09T06:42:34.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.368+0000 7fb15e7fc700 1 --2- 172.21.15.71:0/3104125 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb150066f30 0x7fb1500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:34.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.368+0000 7fb15e7fc700 1 -- 172.21.15.71:0/3104125 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb1680848c0 con 0x7fb170150ca0 2023-10-09T06:42:34.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.369+0000 7fb16e59c700 1 --2- 172.21.15.71:0/3104125 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb150066f30 0x7fb1500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:34.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.369+0000 7fb16e59c700 1 --2- 172.21.15.71:0/3104125 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb150066f30 0x7fb1500693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb160006f00 tx=0x7fb1600091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:34.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.373+0000 7fb15e7fc700 1 -- 172.21.15.71:0/3104125 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb168051e80 con 0x7fb170150ca0 2023-10-09T06:42:34.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.565+0000 7fb16f59e700 1 -- 172.21.15.71:0/3104125 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb17015a2c0 con 0x7fb170150ca0 2023-10-09T06:42:34.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.566+0000 7fb15e7fc700 1 -- 172.21.15.71:0/3104125 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12127 (secure 0 0 0) 0x7fb1680554a0 con 0x7fb170150ca0 2023-10-09T06:42:34.567 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:42:34.567 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":16,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:42:28.883427+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:42:34.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.568+0000 7fb16f59e700 1 -- 172.21.15.71:0/3104125 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb150066f30 msgr2=0x7fb1500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:34.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.568+0000 7fb16f59e700 1 --2- 172.21.15.71:0/3104125 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb150066f30 0x7fb1500693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb160006f00 tx=0x7fb1600091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.568+0000 7fb16f59e700 1 -- 172.21.15.71:0/3104125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb170150ca0 msgr2=0x7fb170151140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:34.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.568+0000 7fb16f59e700 1 --2- 172.21.15.71:0/3104125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb170150ca0 0x7fb170151140 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb168007b40 tx=0x7fb168002140 comp rx=0 tx=0).stop 2023-10-09T06:42:34.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.568+0000 7fb16f59e700 1 -- 172.21.15.71:0/3104125 shutdown_connections 2023-10-09T06:42:34.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.568+0000 7fb16f59e700 1 --2- 172.21.15.71:0/3104125 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb150066f30 0x7fb1500693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.568+0000 7fb16f59e700 1 --2- 172.21.15.71:0/3104125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb170150ca0 0x7fb170151140 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.568+0000 7fb16f59e700 1 --2- 172.21.15.71:0/3104125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb158004810 0x7fb17015c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.568+0000 7fb16f59e700 1 --2- 172.21.15.71:0/3104125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb170150520 0x7fb1701528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.568+0000 7fb16f59e700 1 -- 172.21.15.71:0/3104125 >> 172.21.15.71:0/3104125 conn(0x7fb1700d0660 msgr2=0x7fb1701577c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:34.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.568+0000 7fb16f59e700 1 -- 172.21.15.71:0/3104125 shutdown_connections 2023-10-09T06:42:34.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.568+0000 7fb16f59e700 1 -- 172.21.15.71:0/3104125 wait complete. 2023-10-09T06:42:34.587 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T06:42:34.587 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:42:34.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.769+0000 7f7d85dff700 1 Processor -- start 2023-10-09T06:42:34.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.769+0000 7f7d85dff700 1 -- start start 2023-10-09T06:42:34.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.770+0000 7f7d85dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d80159890 0x7f7d8015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:34.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.770+0000 7f7d85dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8015a160 con 0x7f7d80069560 2023-10-09T06:42:34.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.770+0000 7f7d85dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d800d13a0 con 0x7f7d80159c60 2023-10-09T06:42:34.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.770+0000 7f7d85dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8015e140 con 0x7f7d80159890 2023-10-09T06:42:34.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.771+0000 7f7d7ffff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f7d80069560 0x7f7d800ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53226/0 (socket says 172.21.15.71:53226) 2023-10-09T06:42:34.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.771+0000 7f7d7ffff700 1 -- 172.21.15.71:0/2954793400 learned_addr learned my addr 172.21.15.71:0/2954793400 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:34.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.771+0000 7f7d7f7fe700 1 --2- 172.21.15.71:0/2954793400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d80159890 0x7f7d8015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:34.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.771+0000 7f7d7e7fc700 1 -- 172.21.15.71:0/2954793400 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838349054 0 0) 0x7f7d8015a160 con 0x7f7d80069560 2023-10-09T06:42:34.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.771+0000 7f7d7e7fc700 1 -- 172.21.15.71:0/2954793400 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d68003570 con 0x7f7d80069560 2023-10-09T06:42:34.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.771+0000 7f7d7e7fc700 1 -- 172.21.15.71:0/2954793400 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2849992746 0 0) 0x7f7d800d13a0 con 0x7f7d80159c60 2023-10-09T06:42:34.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.771+0000 7f7d7e7fc700 1 -- 172.21.15.71:0/2954793400 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d8015a160 con 0x7f7d80159c60 2023-10-09T06:42:34.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.771+0000 7f7d7e7fc700 1 -- 172.21.15.71:0/2954793400 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1411788986 0 0) 0x7f7d68003570 con 0x7f7d80069560 2023-10-09T06:42:34.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.771+0000 7f7d7e7fc700 1 -- 172.21.15.71:0/2954793400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d80159890 msgr2=0x7f7d8015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:34.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.771+0000 7f7d7e7fc700 1 --2- 172.21.15.71:0/2954793400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d80159890 0x7f7d8015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.771+0000 7f7d7e7fc700 1 -- 172.21.15.71:0/2954793400 >> v1:172.21.15.179:6789/0 conn(0x7f7d80159c60 legacy=0x7f7d8015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:34.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.771+0000 7f7d7e7fc700 1 -- 172.21.15.71:0/2954793400 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8015a3d0 con 0x7f7d80069560 2023-10-09T06:42:34.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.771+0000 7f7d7e7fc700 1 -- 172.21.15.71:0/2954793400 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f7d780017f0 con 0x7f7d80069560 2023-10-09T06:42:34.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.771+0000 7f7d7e7fc700 1 -- 172.21.15.71:0/2954793400 >> v1:172.21.15.71:6789/0 conn(0x7f7d80069560 legacy=0x7f7d800ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:34.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.771+0000 7f7d7e7fc700 1 --2- 172.21.15.71:0/2954793400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d68003c20 0x7f7d68004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:34.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.772+0000 7f7d7e7fc700 1 --2- 172.21.15.71:0/2954793400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d68004810 0x7f7d68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:34.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.772+0000 7f7d7e7fc700 1 --2- 172.21.15.71:0/2954793400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d80159890 0x7f7d68005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:34.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.772+0000 7f7d7e7fc700 1 -- 172.21.15.71:0/2954793400 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8015e140 con 0x7f7d68003c20 2023-10-09T06:42:34.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.772+0000 7f7d7e7fc700 1 -- 172.21.15.71:0/2954793400 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6800bbf0 con 0x7f7d68004810 2023-10-09T06:42:34.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.772+0000 7f7d7e7fc700 1 -- 172.21.15.71:0/2954793400 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6800bdb0 con 0x7f7d80159890 2023-10-09T06:42:34.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.772+0000 7f7d7f7fe700 1 --2- 172.21.15.71:0/2954793400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d68003c20 0x7f7d68004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:34.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.772+0000 7f7d7ffff700 1 --2- 172.21.15.71:0/2954793400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d80159890 0x7f7d68005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:34.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.772+0000 7f7d7effd700 1 --2- 172.21.15.71:0/2954793400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d68004810 0x7f7d68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:34.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.772+0000 7f7d7f7fe700 1 -- 172.21.15.71:0/2954793400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d80159890 msgr2=0x7f7d68005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:34.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.772+0000 7f7d7f7fe700 1 --2- 172.21.15.71:0/2954793400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d80159890 0x7f7d68005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.772+0000 7f7d7f7fe700 1 -- 172.21.15.71:0/2954793400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d68004810 msgr2=0x7f7d68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:34.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.772+0000 7f7d7f7fe700 1 --2- 172.21.15.71:0/2954793400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d68004810 0x7f7d68004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.772+0000 7f7d7f7fe700 1 -- 172.21.15.71:0/2954793400 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d68003570 con 0x7f7d68003c20 2023-10-09T06:42:34.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.772+0000 7f7d7effd700 1 --2- 172.21.15.71:0/2954793400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d68004810 0x7f7d68004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:34.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.772+0000 7f7d7f7fe700 1 --2- 172.21.15.71:0/2954793400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d68003c20 0x7f7d68004010 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7d70009c00 tx=0x7f7d700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292328df6214dc9a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:34.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.773+0000 7f7d7e7fc700 1 -- 172.21.15.71:0/2954793400 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7000e710 con 0x7f7d68003c20 2023-10-09T06:42:34.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.773+0000 7f7d7e7fc700 1 -- 172.21.15.71:0/2954793400 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7000e870 con 0x7f7d68003c20 2023-10-09T06:42:34.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.773+0000 7f7d7e7fc700 1 -- 172.21.15.71:0/2954793400 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7000ec30 con 0x7f7d68003c20 2023-10-09T06:42:34.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.773+0000 7f7d85dff700 1 -- 172.21.15.71:0/2954793400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d68003c20 msgr2=0x7f7d68004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:34.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.773+0000 7f7d85dff700 1 --2- 172.21.15.71:0/2954793400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d68003c20 0x7f7d68004010 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7d70009c00 tx=0x7f7d700091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.773+0000 7f7d7ffff700 1 -- 172.21.15.71:0/2954793400 reap_dead start 2023-10-09T06:42:34.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.773+0000 7f7d85dff700 1 -- 172.21.15.71:0/2954793400 shutdown_connections 2023-10-09T06:42:34.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.773+0000 7f7d85dff700 1 -- 172.21.15.71:0/2954793400 >> 172.21.15.71:0/2954793400 conn(0x7f7d80068e20 msgr2=0x7f7d800d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:34.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.773+0000 7f7d85dff700 1 -- 172.21.15.71:0/2954793400 shutdown_connections 2023-10-09T06:42:34.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.773+0000 7f7d85dff700 1 -- 172.21.15.71:0/2954793400 wait complete. 2023-10-09T06:42:34.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.775+0000 7f7d85dff700 1 Processor -- start 2023-10-09T06:42:34.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.775+0000 7f7d85dff700 1 -- start start 2023-10-09T06:42:34.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.775+0000 7f7d85dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d68003c20 0x7f7d8014d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:34.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.776+0000 7f7d85dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d800cd100 0x7f7d800cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:34.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.776+0000 7f7d85dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d800b1c20 0x7f7d800b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:34.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.776+0000 7f7d85dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d800b25d0 con 0x7f7d800cd100 2023-10-09T06:42:34.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.776+0000 7f7d85dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d800b3aa0 con 0x7f7d68003c20 2023-10-09T06:42:34.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.776+0000 7f7d85dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8014dac0 con 0x7f7d800b1c20 2023-10-09T06:42:34.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.776+0000 7f7d7effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d800cd100 0x7f7d800cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:34.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.776+0000 7f7d7effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d800cd100 0x7f7d800cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50994/0 (socket says 172.21.15.71:50994) 2023-10-09T06:42:34.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.776+0000 7f7d7effd700 1 -- 172.21.15.71:0/2108646659 learned_addr learned my addr 172.21.15.71:0/2108646659 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:34.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.776+0000 7f7d7ffff700 1 --2- 172.21.15.71:0/2108646659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d800b1c20 0x7f7d800b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:34.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.776+0000 7f7d7f7fe700 1 --2- 172.21.15.71:0/2108646659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d68003c20 0x7f7d8014d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:34.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.776+0000 7f7d7effd700 1 -- 172.21.15.71:0/2108646659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d800b1c20 msgr2=0x7f7d800b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:34.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.776+0000 7f7d7effd700 1 --2- 172.21.15.71:0/2108646659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d800b1c20 0x7f7d800b2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.776+0000 7f7d7effd700 1 -- 172.21.15.71:0/2108646659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d68003c20 msgr2=0x7f7d8014d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:34.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.776+0000 7f7d7effd700 1 --2- 172.21.15.71:0/2108646659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d68003c20 0x7f7d8014d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.776+0000 7f7d7effd700 1 -- 172.21.15.71:0/2108646659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d800ce840 con 0x7f7d800cd100 2023-10-09T06:42:34.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.776+0000 7f7d7effd700 1 --2- 172.21.15.71:0/2108646659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d800cd100 0x7f7d800cd570 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400d7e0 tx=0x7f7d74009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:34.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.777+0000 7f7d677fe700 1 -- 172.21.15.71:0/2108646659 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d74006820 con 0x7f7d800cd100 2023-10-09T06:42:34.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.777+0000 7f7d677fe700 1 -- 172.21.15.71:0/2108646659 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d740069a0 con 0x7f7d800cd100 2023-10-09T06:42:34.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.777+0000 7f7d677fe700 1 -- 172.21.15.71:0/2108646659 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d74006d60 con 0x7f7d800cd100 2023-10-09T06:42:34.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.777+0000 7f7d85dff700 1 -- 172.21.15.71:0/2108646659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d800cdc70 con 0x7f7d800cd100 2023-10-09T06:42:34.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.777+0000 7f7d85dff700 1 -- 172.21.15.71:0/2108646659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d800b3730 con 0x7f7d800cd100 2023-10-09T06:42:34.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.778+0000 7f7d85dff700 1 -- 172.21.15.71:0/2108646659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d800b3590 con 0x7f7d800cd100 2023-10-09T06:42:34.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.779+0000 7f7d677fe700 1 -- 172.21.15.71:0/2108646659 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d74007230 con 0x7f7d800cd100 2023-10-09T06:42:34.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.779+0000 7f7d677fe700 1 --2- 172.21.15.71:0/2108646659 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7d6c066f30 0x7f7d6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:34.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.780+0000 7f7d677fe700 1 -- 172.21.15.71:0/2108646659 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7d74083e70 con 0x7f7d800cd100 2023-10-09T06:42:34.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.780+0000 7f7d7f7fe700 1 --2- 172.21.15.71:0/2108646659 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7d6c066f30 0x7f7d6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:34.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.781+0000 7f7d7f7fe700 1 --2- 172.21.15.71:0/2108646659 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7d6c066f30 0x7f7d6c0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7d700091e0 tx=0x7f7d7001a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:34.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.783+0000 7f7d677fe700 1 -- 172.21.15.71:0/2108646659 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d800b3590 con 0x7f7d800cd100 2023-10-09T06:42:34.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.972+0000 7f7d85dff700 1 -- 172.21.15.71:0/2108646659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d800b3590 con 0x7f7d800cd100 2023-10-09T06:42:34.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.973+0000 7f7d677fe700 1 -- 172.21.15.71:0/2108646659 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d800b3590 con 0x7f7d800cd100 2023-10-09T06:42:34.974 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T06:42:34.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.975+0000 7f7d85dff700 1 -- 172.21.15.71:0/2108646659 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7d6c066f30 msgr2=0x7f7d6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:34.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.975+0000 7f7d85dff700 1 --2- 172.21.15.71:0/2108646659 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7d6c066f30 0x7f7d6c0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7d700091e0 tx=0x7f7d7001a000 comp rx=0 tx=0).stop 2023-10-09T06:42:34.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.975+0000 7f7d85dff700 1 -- 172.21.15.71:0/2108646659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d800cd100 msgr2=0x7f7d800cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:34.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.975+0000 7f7d85dff700 1 --2- 172.21.15.71:0/2108646659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d800cd100 0x7f7d800cd570 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400d7e0 tx=0x7f7d74009040 comp rx=0 tx=0).stop 2023-10-09T06:42:34.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.975+0000 7f7d85dff700 1 -- 172.21.15.71:0/2108646659 shutdown_connections 2023-10-09T06:42:34.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.975+0000 7f7d85dff700 1 --2- 172.21.15.71:0/2108646659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d800b1c20 0x7f7d800b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.975+0000 7f7d85dff700 1 --2- 172.21.15.71:0/2108646659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d68003c20 0x7f7d8014d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.975+0000 7f7d85dff700 1 --2- 172.21.15.71:0/2108646659 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7d6c066f30 0x7f7d6c0693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.975+0000 7f7d85dff700 1 --2- 172.21.15.71:0/2108646659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d800cd100 0x7f7d800cd570 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:34.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.975+0000 7f7d85dff700 1 -- 172.21.15.71:0/2108646659 >> 172.21.15.71:0/2108646659 conn(0x7f7d80068e20 msgr2=0x7f7d800c5590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:34.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.975+0000 7f7d85dff700 1 -- 172.21.15.71:0/2108646659 shutdown_connections 2023-10-09T06:42:34.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:34.975+0000 7f7d85dff700 1 -- 172.21.15.71:0/2108646659 wait complete. 2023-10-09T06:42:34.994 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T06:42:35.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.173+0000 7f85ee1ff700 1 Processor -- start 2023-10-09T06:42:35.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.173+0000 7f85ee1ff700 1 -- start start 2023-10-09T06:42:35.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.174+0000 7f85ee1ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f85e80caa90 0x7f85e80c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:35.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.174+0000 7f85ee1ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e815d7e0 con 0x7f85e806c0a0 2023-10-09T06:42:35.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.174+0000 7f85ee1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e815dac0 con 0x7f85e806bcd0 2023-10-09T06:42:35.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.174+0000 7f85ee1ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e80caef0 con 0x7f85e80caa90 2023-10-09T06:42:35.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.174+0000 7f85e7fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f85e80caa90 0x7f85e80c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:35.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.174+0000 7f85e6ffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f85e806c0a0 0x7f85e815df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56562/0 (socket says 172.21.15.71:56562) 2023-10-09T06:42:35.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.174+0000 7f85e6ffd700 1 -- 172.21.15.71:0/3149188049 learned_addr learned my addr 172.21.15.71:0/3149188049 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:35.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.175+0000 7f85e67fc700 1 -- 172.21.15.71:0/3149188049 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827001618 0 0) 0x7f85e815d7e0 con 0x7f85e806c0a0 2023-10-09T06:42:35.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.175+0000 7f85e67fc700 1 -- 172.21.15.71:0/3149188049 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85d0003570 con 0x7f85e806c0a0 2023-10-09T06:42:35.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.175+0000 7f85e7fff700 1 -- 172.21.15.71:0/3149188049 >> v1:172.21.15.179:6789/0 conn(0x7f85e806bcd0 legacy=0x7f85e815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:35.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.175+0000 7f85e7fff700 1 -- 172.21.15.71:0/3149188049 >> v1:172.21.15.71:6789/0 conn(0x7f85e806c0a0 legacy=0x7f85e815df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:35.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.175+0000 7f85e7fff700 1 -- 172.21.15.71:0/3149188049 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e815aa30 con 0x7f85e80caa90 2023-10-09T06:42:35.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.175+0000 7f85e7fff700 1 --2- 172.21.15.71:0/3149188049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85e80caa90 0x7f85e80c8c40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009e60 tx=0x7f85e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93196ecc8946732 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:35.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.175+0000 7f85e67fc700 1 -- 172.21.15.71:0/3149188049 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e000e070 con 0x7f85e80caa90 2023-10-09T06:42:35.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.175+0000 7f85e67fc700 1 -- 172.21.15.71:0/3149188049 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e000bb60 con 0x7f85e80caa90 2023-10-09T06:42:35.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.175+0000 7f85e67fc700 1 -- 172.21.15.71:0/3149188049 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0012430 con 0x7f85e80caa90 2023-10-09T06:42:35.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.176+0000 7f85ee1ff700 1 -- 172.21.15.71:0/3149188049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85e80caa90 msgr2=0x7f85e80c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:35.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.176+0000 7f85ee1ff700 1 --2- 172.21.15.71:0/3149188049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85e80caa90 0x7f85e80c8c40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009e60 tx=0x7f85e0009780 comp rx=0 tx=0).stop 2023-10-09T06:42:35.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.176+0000 7f85ee1ff700 1 -- 172.21.15.71:0/3149188049 shutdown_connections 2023-10-09T06:42:35.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.176+0000 7f85ee1ff700 1 --2- 172.21.15.71:0/3149188049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85e80caa90 0x7f85e80c8c40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:35.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.176+0000 7f85ee1ff700 1 -- 172.21.15.71:0/3149188049 >> 172.21.15.71:0/3149188049 conn(0x7f85e80ce600 msgr2=0x7f85e80cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:35.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.176+0000 7f85ee1ff700 1 -- 172.21.15.71:0/3149188049 shutdown_connections 2023-10-09T06:42:35.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.176+0000 7f85ee1ff700 1 -- 172.21.15.71:0/3149188049 wait complete. 2023-10-09T06:42:35.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.177+0000 7f85ee1ff700 1 Processor -- start 2023-10-09T06:42:35.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.178+0000 7f85ee1ff700 1 -- start start 2023-10-09T06:42:35.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.178+0000 7f85ee1ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85e806bcd0 0x7f85e814a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:35.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.178+0000 7f85ee1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85e806c0a0 0x7f85e8169810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:35.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.178+0000 7f85ee1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85e80caa90 0x7f85e8169d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:35.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.178+0000 7f85ee1ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e814a8c0 con 0x7f85e806bcd0 2023-10-09T06:42:35.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.178+0000 7f85ee1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80c3940 con 0x7f85e806c0a0 2023-10-09T06:42:35.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.178+0000 7f85ee1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80c9670 con 0x7f85e80caa90 2023-10-09T06:42:35.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.179+0000 7f85e77fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85e806bcd0 0x7f85e814a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:35.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.179+0000 7f85e77fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85e806bcd0 0x7f85e814a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43972/0 (socket says 172.21.15.71:43972) 2023-10-09T06:42:35.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.179+0000 7f85e77fe700 1 -- 172.21.15.71:0/2470845564 learned_addr learned my addr 172.21.15.71:0/2470845564 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:35.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.179+0000 7f85e7fff700 1 --2- 172.21.15.71:0/2470845564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85e80caa90 0x7f85e8169d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:35.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.179+0000 7f85e6ffd700 1 --2- 172.21.15.71:0/2470845564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85e806c0a0 0x7f85e8169810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:35.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.179+0000 7f85e77fe700 1 -- 172.21.15.71:0/2470845564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85e80caa90 msgr2=0x7f85e8169d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:35.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.179+0000 7f85e77fe700 1 --2- 172.21.15.71:0/2470845564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85e80caa90 0x7f85e8169d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:35.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.179+0000 7f85e77fe700 1 -- 172.21.15.71:0/2470845564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85e806c0a0 msgr2=0x7f85e8169810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:35.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.179+0000 7f85e77fe700 1 --2- 172.21.15.71:0/2470845564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85e806c0a0 0x7f85e8169810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:35.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.179+0000 7f85e77fe700 1 -- 172.21.15.71:0/2470845564 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e0009a20 con 0x7f85e806bcd0 2023-10-09T06:42:35.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.179+0000 7f85e7fff700 1 --2- 172.21.15.71:0/2470845564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85e80caa90 0x7f85e8169d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:35.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.179+0000 7f85e6ffd700 1 --2- 172.21.15.71:0/2470845564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85e806c0a0 0x7f85e8169810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:35.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.179+0000 7f85e77fe700 1 --2- 172.21.15.71:0/2470845564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85e806bcd0 0x7f85e814a380 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f85d800c510 tx=0x7f85d800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:35.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.179+0000 7f85cf7fe700 1 -- 172.21.15.71:0/2470845564 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d8011590 con 0x7f85e806bcd0 2023-10-09T06:42:35.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.180+0000 7f85cf7fe700 1 -- 172.21.15.71:0/2470845564 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d8011710 con 0x7f85e806bcd0 2023-10-09T06:42:35.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.180+0000 7f85cf7fe700 1 -- 172.21.15.71:0/2470845564 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d8011ad0 con 0x7f85e806bcd0 2023-10-09T06:42:35.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.180+0000 7f85ee1ff700 1 -- 172.21.15.71:0/2470845564 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e80c8dd0 con 0x7f85e806bcd0 2023-10-09T06:42:35.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.180+0000 7f85ee1ff700 1 -- 172.21.15.71:0/2470845564 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e80c9390 con 0x7f85e806bcd0 2023-10-09T06:42:35.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.181+0000 7f85ee1ff700 1 -- 172.21.15.71:0/2470845564 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e80c3710 con 0x7f85e806bcd0 2023-10-09T06:42:35.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.182+0000 7f85cf7fe700 1 -- 172.21.15.71:0/2470845564 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f85d801b3b0 con 0x7f85e806bcd0 2023-10-09T06:42:35.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.183+0000 7f85cf7fe700 1 --2- 172.21.15.71:0/2470845564 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f85d4066f30 0x7f85d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:35.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.183+0000 7f85cf7fe700 1 -- 172.21.15.71:0/2470845564 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f85d80837b0 con 0x7f85e806bcd0 2023-10-09T06:42:35.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.183+0000 7f85e6ffd700 1 --2- 172.21.15.71:0/2470845564 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f85d4066f30 0x7f85d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:35.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.184+0000 7f85e6ffd700 1 --2- 172.21.15.71:0/2470845564 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f85d4066f30 0x7f85d40693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f85dc007fd0 tx=0x7f85dc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:35.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.187+0000 7f85cf7fe700 1 -- 172.21.15.71:0/2470845564 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85e80c3710 con 0x7f85e806bcd0 2023-10-09T06:42:35.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.380+0000 7f85ee1ff700 1 -- 172.21.15.71:0/2470845564 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f85e80c3710 con 0x7f85e806bcd0 2023-10-09T06:42:35.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.380+0000 7f85cf7fe700 1 -- 172.21.15.71:0/2470845564 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f85e80c3710 con 0x7f85e806bcd0 2023-10-09T06:42:35.382 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:42:35.382 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-09T06:42:35.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:42:35.382 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 1, 2023-10-09T06:42:35.382 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": ".mgr" 2023-10-09T06:42:35.382 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:42:35.382 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-09T06:42:35.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.382+0000 7f85ee1ff700 1 -- 172.21.15.71:0/2470845564 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f85d4066f30 msgr2=0x7f85d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:35.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.383+0000 7f85ee1ff700 1 --2- 172.21.15.71:0/2470845564 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f85d4066f30 0x7f85d40693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f85dc007fd0 tx=0x7f85dc009040 comp rx=0 tx=0).stop 2023-10-09T06:42:35.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.383+0000 7f85ee1ff700 1 -- 172.21.15.71:0/2470845564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85e806bcd0 msgr2=0x7f85e814a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:35.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.383+0000 7f85ee1ff700 1 --2- 172.21.15.71:0/2470845564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85e806bcd0 0x7f85e814a380 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f85d800c510 tx=0x7f85d800c8d0 comp rx=0 tx=0).stop 2023-10-09T06:42:35.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.383+0000 7f85ee1ff700 1 -- 172.21.15.71:0/2470845564 shutdown_connections 2023-10-09T06:42:35.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.383+0000 7f85ee1ff700 1 --2- 172.21.15.71:0/2470845564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85e80caa90 0x7f85e8169d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:35.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.383+0000 7f85ee1ff700 1 --2- 172.21.15.71:0/2470845564 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f85d4066f30 0x7f85d40693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:35.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.383+0000 7f85ee1ff700 1 --2- 172.21.15.71:0/2470845564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85e806bcd0 0x7f85e814a380 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:35.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.383+0000 7f85ee1ff700 1 --2- 172.21.15.71:0/2470845564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85e806c0a0 0x7f85e8169810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:35.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.383+0000 7f85ee1ff700 1 -- 172.21.15.71:0/2470845564 >> 172.21.15.71:0/2470845564 conn(0x7f85e80ce600 msgr2=0x7f85e8159de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:35.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.383+0000 7f85ee1ff700 1 -- 172.21.15.71:0/2470845564 shutdown_connections 2023-10-09T06:42:35.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.383+0000 7f85ee1ff700 1 -- 172.21.15.71:0/2470845564 wait complete. 2023-10-09T06:42:35.401 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T06:42:35.401 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T06:42:35.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.583+0000 7fa6b49ff700 1 Processor -- start 2023-10-09T06:42:35.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.583+0000 7fa6b49ff700 1 -- start start 2023-10-09T06:42:35.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.584+0000 7fa6b49ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa6b0157740 0x7fa6b00adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:35.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.584+0000 7fa6b49ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6b00b2100 0x7fa6b0068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:35.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.584+0000 7fa6b49ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa6b00688d0 0x7fa6b0069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:35.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.584+0000 7fa6b49ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b00acc00 con 0x7fa6b0157740 2023-10-09T06:42:35.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.584+0000 7fa6b49ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b006d6a0 con 0x7fa6b00688d0 2023-10-09T06:42:35.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.584+0000 7fa6b49ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b0068d50 con 0x7fa6b00b2100 2023-10-09T06:42:35.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.585+0000 7fa6ae59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa6b0157740 0x7fa6b00adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:35.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.585+0000 7fa6ae59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa6b0157740 0x7fa6b00adfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43986/0 (socket says 172.21.15.71:43986) 2023-10-09T06:42:35.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.585+0000 7fa6ae59c700 1 -- 172.21.15.71:0/55120821 learned_addr learned my addr 172.21.15.71:0/55120821 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:35.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.585+0000 7fa6a7fff700 1 --2- 172.21.15.71:0/55120821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6b00b2100 0x7fa6b0068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:35.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.585+0000 7fa6aed9d700 1 --2- 172.21.15.71:0/55120821 >> v2:172.21.15.179:3300/0 conn(0x7fa6b00688d0 0x7fa6b0069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:35.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.585+0000 7fa6ae59c700 1 -- 172.21.15.71:0/55120821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6b00b2100 msgr2=0x7fa6b0068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:35.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.585+0000 7fa6ae59c700 1 --2- 172.21.15.71:0/55120821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6b00b2100 0x7fa6b0068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:35.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.585+0000 7fa6ae59c700 1 -- 172.21.15.71:0/55120821 >> v2:172.21.15.179:3300/0 conn(0x7fa6b00688d0 msgr2=0x7fa6b0069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:35.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.585+0000 7fa6ae59c700 1 --2- 172.21.15.71:0/55120821 >> v2:172.21.15.179:3300/0 conn(0x7fa6b00688d0 0x7fa6b0069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:35.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.585+0000 7fa6ae59c700 1 -- 172.21.15.71:0/55120821 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b006dc20 con 0x7fa6b0157740 2023-10-09T06:42:35.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.585+0000 7fa6ae59c700 1 --2- 172.21.15.71:0/55120821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6b0157740 0x7fa6b00adfc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa6b00c9fd0 tx=0x7fa6a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af25c284f37ba80 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:35.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.586+0000 7fa6add9b700 1 -- 172.21.15.71:0/55120821 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a000b820 con 0x7fa6b0157740 2023-10-09T06:42:35.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.586+0000 7fa6add9b700 1 -- 172.21.15.71:0/55120821 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a000b980 con 0x7fa6b0157740 2023-10-09T06:42:35.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.586+0000 7fa6add9b700 1 -- 172.21.15.71:0/55120821 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a000bd20 con 0x7fa6b0157740 2023-10-09T06:42:35.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.586+0000 7fa6b49ff700 1 -- 172.21.15.71:0/55120821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6b0157740 msgr2=0x7fa6b00adfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:35.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.586+0000 7fa6b49ff700 1 --2- 172.21.15.71:0/55120821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6b0157740 0x7fa6b00adfc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa6b00c9fd0 tx=0x7fa6a0009250 comp rx=0 tx=0).stop 2023-10-09T06:42:35.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.586+0000 7fa6b49ff700 1 -- 172.21.15.71:0/55120821 shutdown_connections 2023-10-09T06:42:35.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.586+0000 7fa6b49ff700 1 --2- 172.21.15.71:0/55120821 >> v2:172.21.15.179:3300/0 conn(0x7fa6b00688d0 0x7fa6b0069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:35.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.586+0000 7fa6b49ff700 1 --2- 172.21.15.71:0/55120821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6b0157740 0x7fa6b00adfc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:35.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.586+0000 7fa6b49ff700 1 --2- 172.21.15.71:0/55120821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6b00b2100 0x7fa6b0068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:35.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.586+0000 7fa6b49ff700 1 -- 172.21.15.71:0/55120821 >> 172.21.15.71:0/55120821 conn(0x7fa6b00c8f90 msgr2=0x7fa6b00c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:35.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.586+0000 7fa6b49ff700 1 -- 172.21.15.71:0/55120821 shutdown_connections 2023-10-09T06:42:35.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.586+0000 7fa6b49ff700 1 -- 172.21.15.71:0/55120821 wait complete. 2023-10-09T06:42:35.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.588+0000 7fa6b49ff700 1 Processor -- start 2023-10-09T06:42:35.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.588+0000 7fa6b49ff700 1 -- start start 2023-10-09T06:42:35.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.589+0000 7fa6b49ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6b00688d0 0x7fa6b0154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:35.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.589+0000 7fa6b49ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6b00b2100 0x7fa6b00c5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:35.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.589+0000 7fa6b49ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6b0157740 0x7fa6b00cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:35.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.589+0000 7fa6b49ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b00c7c90 con 0x7fa6b0157740 2023-10-09T06:42:35.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.589+0000 7fa6b49ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b00c7080 con 0x7fa6b00688d0 2023-10-09T06:42:35.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.589+0000 7fa6b49ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b00c7360 con 0x7fa6b00b2100 2023-10-09T06:42:35.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.589+0000 7fa6aed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6b0157740 0x7fa6b00cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:35.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.589+0000 7fa6aed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6b0157740 0x7fa6b00cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43996/0 (socket says 172.21.15.71:43996) 2023-10-09T06:42:35.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.589+0000 7fa6aed9d700 1 -- 172.21.15.71:0/3174830391 learned_addr learned my addr 172.21.15.71:0/3174830391 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:35.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.589+0000 7fa6ae59c700 1 --2- 172.21.15.71:0/3174830391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6b00688d0 0x7fa6b0154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:35.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.589+0000 7fa6a7fff700 1 --2- 172.21.15.71:0/3174830391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6b00b2100 0x7fa6b00c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:35.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.589+0000 7fa6aed9d700 1 -- 172.21.15.71:0/3174830391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6b00b2100 msgr2=0x7fa6b00c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:35.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.589+0000 7fa6aed9d700 1 --2- 172.21.15.71:0/3174830391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6b00b2100 0x7fa6b00c5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:35.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.589+0000 7fa6aed9d700 1 -- 172.21.15.71:0/3174830391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6b00688d0 msgr2=0x7fa6b0154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:35.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.589+0000 7fa6aed9d700 1 --2- 172.21.15.71:0/3174830391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6b00688d0 0x7fa6b0154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:35.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.589+0000 7fa6aed9d700 1 -- 172.21.15.71:0/3174830391 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a00094f0 con 0x7fa6b0157740 2023-10-09T06:42:35.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.590+0000 7fa6a7fff700 1 --2- 172.21.15.71:0/3174830391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6b00b2100 0x7fa6b00c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:35.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.590+0000 7fa6aed9d700 1 --2- 172.21.15.71:0/3174830391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6b0157740 0x7fa6b00cc500 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8009fa0 tx=0x7fa6a8009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:35.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.590+0000 7fa6a67fc700 1 -- 172.21.15.71:0/3174830391 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a800ec70 con 0x7fa6b0157740 2023-10-09T06:42:35.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.590+0000 7fa6a67fc700 1 -- 172.21.15.71:0/3174830391 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a800edd0 con 0x7fa6b0157740 2023-10-09T06:42:35.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.590+0000 7fa6a67fc700 1 -- 172.21.15.71:0/3174830391 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8014670 con 0x7fa6b0157740 2023-10-09T06:42:35.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.590+0000 7fa6b49ff700 1 -- 172.21.15.71:0/3174830391 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b00c7640 con 0x7fa6b0157740 2023-10-09T06:42:35.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.590+0000 7fa6b49ff700 1 -- 172.21.15.71:0/3174830391 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b00c5ac0 con 0x7fa6b0157740 2023-10-09T06:42:35.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.591+0000 7fa6b49ff700 1 -- 172.21.15.71:0/3174830391 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b00c7e40 con 0x7fa6b0157740 2023-10-09T06:42:35.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.592+0000 7fa6a67fc700 1 -- 172.21.15.71:0/3174830391 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa6a80149e0 con 0x7fa6b0157740 2023-10-09T06:42:35.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.593+0000 7fa6a67fc700 1 --2- 172.21.15.71:0/3174830391 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa690066f30 0x7fa6900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:35.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.593+0000 7fa6a67fc700 1 -- 172.21.15.71:0/3174830391 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa6a8084960 con 0x7fa6b0157740 2023-10-09T06:42:35.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.593+0000 7fa6ae59c700 1 --2- 172.21.15.71:0/3174830391 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa690066f30 0x7fa6900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:35.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.594+0000 7fa6ae59c700 1 --2- 172.21.15.71:0/3174830391 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa690066f30 0x7fa6900693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa6b00c9fd0 tx=0x7fa6a0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:35.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.597+0000 7fa6a67fc700 1 -- 172.21.15.71:0/3174830391 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6a8051e80 con 0x7fa6b0157740 2023-10-09T06:42:35.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:35.789+0000 7fa6b49ff700 1 -- 172.21.15.71:0/3174830391 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa6b00718b0 con 0x7fa6b0157740 2023-10-09T06:42:36.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.608+0000 7fa6a67fc700 1 -- 172.21.15.71:0/3174830391 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa6a80554a0 con 0x7fa6b0157740 2023-10-09T06:42:36.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.612+0000 7fa6b49ff700 1 -- 172.21.15.71:0/3174830391 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa690066f30 msgr2=0x7fa6900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:36.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.612+0000 7fa6b49ff700 1 --2- 172.21.15.71:0/3174830391 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa690066f30 0x7fa6900693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa6b00c9fd0 tx=0x7fa6a0017000 comp rx=0 tx=0).stop 2023-10-09T06:42:36.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.612+0000 7fa6b49ff700 1 -- 172.21.15.71:0/3174830391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6b0157740 msgr2=0x7fa6b00cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:36.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.612+0000 7fa6b49ff700 1 --2- 172.21.15.71:0/3174830391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6b0157740 0x7fa6b00cc500 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8009fa0 tx=0x7fa6a8009900 comp rx=0 tx=0).stop 2023-10-09T06:42:36.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.613+0000 7fa6b49ff700 1 -- 172.21.15.71:0/3174830391 shutdown_connections 2023-10-09T06:42:36.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.613+0000 7fa6b49ff700 1 --2- 172.21.15.71:0/3174830391 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa690066f30 0x7fa6900693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:36.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.613+0000 7fa6b49ff700 1 --2- 172.21.15.71:0/3174830391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6b0157740 0x7fa6b00cc500 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:36.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.613+0000 7fa6b49ff700 1 --2- 172.21.15.71:0/3174830391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6b00688d0 0x7fa6b0154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:36.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.613+0000 7fa6b49ff700 1 --2- 172.21.15.71:0/3174830391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6b00b2100 0x7fa6b00c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:36.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.613+0000 7fa6b49ff700 1 -- 172.21.15.71:0/3174830391 >> 172.21.15.71:0/3174830391 conn(0x7fa6b00c8f90 msgr2=0x7fa6b00ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:36.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.614+0000 7fa6b49ff700 1 -- 172.21.15.71:0/3174830391 shutdown_connections 2023-10-09T06:42:36.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.614+0000 7fa6b49ff700 1 -- 172.21.15.71:0/3174830391 wait complete. 2023-10-09T06:42:36.620 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' created 2023-10-09T06:42:36.639 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T06:42:36.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.827+0000 7fd22e3ff700 1 Processor -- start 2023-10-09T06:42:36.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.827+0000 7fd22e3ff700 1 -- start start 2023-10-09T06:42:36.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.829+0000 7fd22e3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd228157a00 0x7fd228158a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:36.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.829+0000 7fd22e3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd228068390 0x7fd228068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:36.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.829+0000 7fd22e3ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd228158590 con 0x7fd228157630 2023-10-09T06:42:36.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.829+0000 7fd22e3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd228068d50 con 0x7fd228068390 2023-10-09T06:42:36.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.829+0000 7fd22e3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd228157f80 con 0x7fd228157a00 2023-10-09T06:42:36.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.829+0000 7fd227fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd228157630 0x7fd2280abd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56578/0 (socket says 172.21.15.71:56578) 2023-10-09T06:42:36.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.829+0000 7fd227fff700 1 -- 172.21.15.71:0/2319026491 learned_addr learned my addr 172.21.15.71:0/2319026491 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:36.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.829+0000 7fd22c99c700 1 --2- 172.21.15.71:0/2319026491 >> v2:172.21.15.179:3300/0 conn(0x7fd228068390 0x7fd228068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:36.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.829+0000 7fd21ffff700 1 --2- 172.21.15.71:0/2319026491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd228157a00 0x7fd228158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:36.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.829+0000 7fd2277fe700 1 -- 172.21.15.71:0/2319026491 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3839690154 0 0) 0x7fd228158590 con 0x7fd228157630 2023-10-09T06:42:36.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.829+0000 7fd2277fe700 1 -- 172.21.15.71:0/2319026491 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd214003570 con 0x7fd228157630 2023-10-09T06:42:36.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.830+0000 7fd2277fe700 1 -- 172.21.15.71:0/2319026491 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3917121171 0 0) 0x7fd214003570 con 0x7fd228157630 2023-10-09T06:42:36.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.830+0000 7fd22c99c700 1 -- 172.21.15.71:0/2319026491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd228157a00 msgr2=0x7fd228158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:36.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.830+0000 7fd22c99c700 1 --2- 172.21.15.71:0/2319026491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd228157a00 0x7fd228158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:36.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.830+0000 7fd22c99c700 1 -- 172.21.15.71:0/2319026491 >> v1:172.21.15.71:6789/0 conn(0x7fd228157630 legacy=0x7fd2280abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:36.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.830+0000 7fd22c99c700 1 -- 172.21.15.71:0/2319026491 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2280ac7a0 con 0x7fd228068390 2023-10-09T06:42:36.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.830+0000 7fd21ffff700 1 --2- 172.21.15.71:0/2319026491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd228157a00 0x7fd228158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:42:36.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.830+0000 7fd22c99c700 1 --2- 172.21.15.71:0/2319026491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd228068390 0x7fd228068810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd220009e60 tx=0x7fd220009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2651552cb24672c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:36.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.830+0000 7fd2277fe700 1 -- 172.21.15.71:0/2319026491 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22000e070 con 0x7fd228068390 2023-10-09T06:42:36.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.830+0000 7fd2277fe700 1 -- 172.21.15.71:0/2319026491 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22000b7a0 con 0x7fd228068390 2023-10-09T06:42:36.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.830+0000 7fd2277fe700 1 -- 172.21.15.71:0/2319026491 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd218001470 con 0x7fd228068390 2023-10-09T06:42:36.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.831+0000 7fd22e3ff700 1 -- 172.21.15.71:0/2319026491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd228068390 msgr2=0x7fd228068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:36.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.831+0000 7fd22e3ff700 1 --2- 172.21.15.71:0/2319026491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd228068390 0x7fd228068810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd220009e60 tx=0x7fd220009780 comp rx=0 tx=0).stop 2023-10-09T06:42:36.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.831+0000 7fd22e3ff700 1 -- 172.21.15.71:0/2319026491 shutdown_connections 2023-10-09T06:42:36.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.831+0000 7fd22e3ff700 1 --2- 172.21.15.71:0/2319026491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd228068390 0x7fd228068810 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:36.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.831+0000 7fd22e3ff700 1 --2- 172.21.15.71:0/2319026491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd228157a00 0x7fd228158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:36.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.831+0000 7fd22e3ff700 1 -- 172.21.15.71:0/2319026491 >> 172.21.15.71:0/2319026491 conn(0x7fd2280cc540 msgr2=0x7fd2280cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:36.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.831+0000 7fd22e3ff700 1 -- 172.21.15.71:0/2319026491 shutdown_connections 2023-10-09T06:42:36.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.831+0000 7fd22e3ff700 1 -- 172.21.15.71:0/2319026491 wait complete. 2023-10-09T06:42:36.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.832+0000 7fd22e3ff700 1 Processor -- start 2023-10-09T06:42:36.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.833+0000 7fd22e3ff700 1 -- start start 2023-10-09T06:42:36.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.833+0000 7fd22e3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd228068390 0x7fd228152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:36.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.834+0000 7fd22e3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd228157630 0x7fd2280c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:36.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.834+0000 7fd22e3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd228157a00 0x7fd2280c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:36.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.834+0000 7fd22e3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2280c38c0 con 0x7fd228068390 2023-10-09T06:42:36.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.834+0000 7fd22e3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2280c0f00 con 0x7fd228157630 2023-10-09T06:42:36.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.834+0000 7fd22e3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2280c11e0 con 0x7fd228157a00 2023-10-09T06:42:36.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.834+0000 7fd227fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd228068390 0x7fd228152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:36.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.834+0000 7fd227fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd228068390 0x7fd228152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44006/0 (socket says 172.21.15.71:44006) 2023-10-09T06:42:36.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.834+0000 7fd227fff700 1 -- 172.21.15.71:0/786700670 learned_addr learned my addr 172.21.15.71:0/786700670 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:36.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.834+0000 7fd227fff700 1 -- 172.21.15.71:0/786700670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd228157a00 msgr2=0x7fd2280c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:36.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.834+0000 7fd227fff700 1 --2- 172.21.15.71:0/786700670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd228157a00 0x7fd2280c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:36.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.834+0000 7fd227fff700 1 -- 172.21.15.71:0/786700670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd228157630 msgr2=0x7fd2280c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:36.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.834+0000 7fd227fff700 1 --2- 172.21.15.71:0/786700670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd228157630 0x7fd2280c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:36.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.834+0000 7fd227fff700 1 -- 172.21.15.71:0/786700670 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd210009420 con 0x7fd228068390 2023-10-09T06:42:36.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.834+0000 7fd227fff700 1 --2- 172.21.15.71:0/786700670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd228068390 0x7fd228152be0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd21800cb90 tx=0x7fd218001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:36.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.834+0000 7fd224ff9700 1 -- 172.21.15.71:0/786700670 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd218007360 con 0x7fd228068390 2023-10-09T06:42:36.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.835+0000 7fd224ff9700 1 -- 172.21.15.71:0/786700670 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2180074e0 con 0x7fd228068390 2023-10-09T06:42:36.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.835+0000 7fd22e3ff700 1 -- 172.21.15.71:0/786700670 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd220009a20 con 0x7fd228068390 2023-10-09T06:42:36.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.835+0000 7fd224ff9700 1 -- 172.21.15.71:0/786700670 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd218004830 con 0x7fd228068390 2023-10-09T06:42:36.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.835+0000 7fd22e3ff700 1 -- 172.21.15.71:0/786700670 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2280c3550 con 0x7fd228068390 2023-10-09T06:42:36.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.836+0000 7fd22e3ff700 1 -- 172.21.15.71:0/786700670 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2280718b0 con 0x7fd228068390 2023-10-09T06:42:36.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.837+0000 7fd224ff9700 1 -- 172.21.15.71:0/786700670 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd218004ba0 con 0x7fd228068390 2023-10-09T06:42:36.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.837+0000 7fd224ff9700 1 --2- 172.21.15.71:0/786700670 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd208066f60 0x7fd208069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:36.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.838+0000 7fd224ff9700 1 -- 172.21.15.71:0/786700670 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fd218083c40 con 0x7fd228068390 2023-10-09T06:42:36.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.838+0000 7fd21ffff700 1 --2- 172.21.15.71:0/786700670 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd208066f60 0x7fd208069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:36.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.839+0000 7fd21ffff700 1 --2- 172.21.15.71:0/786700670 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd208066f60 0x7fd208069410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd22815e5f0 tx=0x7fd2100091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:36.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:36.842+0000 7fd224ff9700 1 -- 172.21.15.71:0/786700670 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd218051110 con 0x7fd228068390 2023-10-09T06:42:37.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.034+0000 7fd22e3ff700 1 -- 172.21.15.71:0/786700670 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd228158220 con 0x7fd228068390 2023-10-09T06:42:37.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.615+0000 7fd224ff9700 1 -- 172.21.15.71:0/786700670 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd218018020 con 0x7fd228068390 2023-10-09T06:42:37.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.619+0000 7fd22e3ff700 1 -- 172.21.15.71:0/786700670 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd208066f60 msgr2=0x7fd208069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:37.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.619+0000 7fd22e3ff700 1 --2- 172.21.15.71:0/786700670 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd208066f60 0x7fd208069410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd22815e5f0 tx=0x7fd2100091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:37.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.619+0000 7fd22e3ff700 1 -- 172.21.15.71:0/786700670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd228068390 msgr2=0x7fd228152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:37.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.619+0000 7fd22e3ff700 1 --2- 172.21.15.71:0/786700670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd228068390 0x7fd228152be0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd21800cb90 tx=0x7fd218001b50 comp rx=0 tx=0).stop 2023-10-09T06:42:37.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.626+0000 7fd22e3ff700 1 -- 172.21.15.71:0/786700670 shutdown_connections 2023-10-09T06:42:37.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.626+0000 7fd22e3ff700 1 --2- 172.21.15.71:0/786700670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd228157a00 0x7fd2280c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:37.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.626+0000 7fd22e3ff700 1 --2- 172.21.15.71:0/786700670 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd208066f60 0x7fd208069410 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:37.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.626+0000 7fd22e3ff700 1 --2- 172.21.15.71:0/786700670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd228068390 0x7fd228152be0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:37.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.626+0000 7fd22e3ff700 1 --2- 172.21.15.71:0/786700670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd228157630 0x7fd2280c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:37.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.626+0000 7fd22e3ff700 1 -- 172.21.15.71:0/786700670 >> 172.21.15.71:0/786700670 conn(0x7fd2280cc540 msgr2=0x7fd2280cc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:37.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.633+0000 7fd22e3ff700 1 -- 172.21.15.71:0/786700670 shutdown_connections 2023-10-09T06:42:37.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.634+0000 7fd22e3ff700 1 -- 172.21.15.71:0/786700670 wait complete. 2023-10-09T06:42:37.640 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' created 2023-10-09T06:42:37.659 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T06:42:37.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.843+0000 7f198119d700 1 Processor -- start 2023-10-09T06:42:37.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.843+0000 7f198119d700 1 -- start start 2023-10-09T06:42:37.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.844+0000 7f198119d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f197c0ccc00 0x7f197c069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:37.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.844+0000 7f198119d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f197c06a020 0x7f197c0cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:37.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.844+0000 7f198119d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f197c0c9f30 con 0x7f197c159a60 2023-10-09T06:42:37.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.844+0000 7f198119d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f197c06dfc0 con 0x7f197c06a020 2023-10-09T06:42:37.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.844+0000 7f198119d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f197c0ca470 con 0x7f197c0ccc00 2023-10-09T06:42:37.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.844+0000 7f198099c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f197c06a020 0x7f197c0cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:37.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.844+0000 7f198099c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f197c06a020 0x7f197c0cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44018/0 (socket says 172.21.15.71:44018) 2023-10-09T06:42:37.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.844+0000 7f198099c700 1 -- 172.21.15.71:0/2163868417 learned_addr learned my addr 172.21.15.71:0/2163868417 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:37.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.845+0000 7f1973fff700 1 --2- 172.21.15.71:0/2163868417 >> v2:172.21.15.179:3300/0 conn(0x7f197c0ccc00 0x7f197c069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:37.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.845+0000 7f198099c700 1 -- 172.21.15.71:0/2163868417 >> v2:172.21.15.179:3300/0 conn(0x7f197c0ccc00 msgr2=0x7f197c069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:37.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.845+0000 7f198099c700 1 --2- 172.21.15.71:0/2163868417 >> v2:172.21.15.179:3300/0 conn(0x7f197c0ccc00 0x7f197c069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:37.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.845+0000 7f198099c700 1 -- 172.21.15.71:0/2163868417 >> v1:172.21.15.179:6789/0 conn(0x7f197c159a60 legacy=0x7f197c0c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:37.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.845+0000 7f198099c700 1 -- 172.21.15.71:0/2163868417 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c0ca750 con 0x7f197c06a020 2023-10-09T06:42:37.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.845+0000 7f198099c700 1 --2- 172.21.15.71:0/2163868417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f197c06a020 0x7f197c0cb230 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f197c0cf6a0 tx=0x7f1974009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909087dabf4eb623 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:37.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.845+0000 7f197b7fe700 1 -- 172.21.15.71:0/2163868417 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197400e070 con 0x7f197c06a020 2023-10-09T06:42:37.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.845+0000 7f197b7fe700 1 -- 172.21.15.71:0/2163868417 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197400bab0 con 0x7f197c06a020 2023-10-09T06:42:37.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.845+0000 7f197b7fe700 1 -- 172.21.15.71:0/2163868417 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19740092e0 con 0x7f197c06a020 2023-10-09T06:42:37.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.846+0000 7f198119d700 1 -- 172.21.15.71:0/2163868417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f197c06a020 msgr2=0x7f197c0cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:37.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.846+0000 7f198119d700 1 --2- 172.21.15.71:0/2163868417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f197c06a020 0x7f197c0cb230 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f197c0cf6a0 tx=0x7f1974009840 comp rx=0 tx=0).stop 2023-10-09T06:42:37.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.846+0000 7f198119d700 1 -- 172.21.15.71:0/2163868417 shutdown_connections 2023-10-09T06:42:37.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.846+0000 7f198119d700 1 --2- 172.21.15.71:0/2163868417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f197c06a020 0x7f197c0cb230 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:37.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.846+0000 7f198119d700 1 --2- 172.21.15.71:0/2163868417 >> v2:172.21.15.179:3300/0 conn(0x7f197c0ccc00 0x7f197c069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:37.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.846+0000 7f198119d700 1 -- 172.21.15.71:0/2163868417 >> 172.21.15.71:0/2163868417 conn(0x7f197c06baa0 msgr2=0x7f197c06bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:37.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.846+0000 7f198119d700 1 -- 172.21.15.71:0/2163868417 shutdown_connections 2023-10-09T06:42:37.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.846+0000 7f198119d700 1 -- 172.21.15.71:0/2163868417 wait complete. 2023-10-09T06:42:37.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.847+0000 7f198119d700 1 Processor -- start 2023-10-09T06:42:37.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.848+0000 7f198119d700 1 -- start start 2023-10-09T06:42:37.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.848+0000 7f198119d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f197c06a020 0x7f197c16a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:37.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.848+0000 7f198119d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f197c0ccc00 0x7f197c0c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:37.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.848+0000 7f198119d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f197c159a60 0x7f197c1533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:37.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.848+0000 7f198119d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c0b1430 con 0x7f197c0ccc00 2023-10-09T06:42:37.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.848+0000 7f198119d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c0c7560 con 0x7f197c159a60 2023-10-09T06:42:37.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.848+0000 7f198119d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197c0c7800 con 0x7f197c06a020 2023-10-09T06:42:37.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.849+0000 7f1973fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f197c0ccc00 0x7f197c0c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:37.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.849+0000 7f1973fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f197c0ccc00 0x7f197c0c7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44034/0 (socket says 172.21.15.71:44034) 2023-10-09T06:42:37.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.849+0000 7f1973fff700 1 -- 172.21.15.71:0/1796299217 learned_addr learned my addr 172.21.15.71:0/1796299217 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:37.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.849+0000 7f197bfff700 1 --2- 172.21.15.71:0/1796299217 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f197c06a020 0x7f197c16a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:37.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.849+0000 7f198099c700 1 --2- 172.21.15.71:0/1796299217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f197c159a60 0x7f197c1533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:37.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.849+0000 7f1973fff700 1 -- 172.21.15.71:0/1796299217 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f197c06a020 msgr2=0x7f197c16a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:37.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.849+0000 7f1973fff700 1 --2- 172.21.15.71:0/1796299217 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f197c06a020 0x7f197c16a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:37.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.849+0000 7f1973fff700 1 -- 172.21.15.71:0/1796299217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f197c159a60 msgr2=0x7f197c1533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:37.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.849+0000 7f1973fff700 1 --2- 172.21.15.71:0/1796299217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f197c159a60 0x7f197c1533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:37.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.849+0000 7f1973fff700 1 -- 172.21.15.71:0/1796299217 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1974009ae0 con 0x7f197c0ccc00 2023-10-09T06:42:37.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.849+0000 7f1973fff700 1 --2- 172.21.15.71:0/1796299217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f197c0ccc00 0x7f197c0c7020 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f196400ec80 tx=0x7f19640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:37.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.849+0000 7f1978ff9700 1 -- 172.21.15.71:0/1796299217 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196400c9d0 con 0x7f197c0ccc00 2023-10-09T06:42:37.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.849+0000 7f1978ff9700 1 -- 172.21.15.71:0/1796299217 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196400cb30 con 0x7f197c0ccc00 2023-10-09T06:42:37.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.849+0000 7f198119d700 1 -- 172.21.15.71:0/1796299217 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197c0c7ae0 con 0x7f197c0ccc00 2023-10-09T06:42:37.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.849+0000 7f1978ff9700 1 -- 172.21.15.71:0/1796299217 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964013470 con 0x7f197c0ccc00 2023-10-09T06:42:37.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.850+0000 7f198119d700 1 -- 172.21.15.71:0/1796299217 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197c0c80a0 con 0x7f197c0ccc00 2023-10-09T06:42:37.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.851+0000 7f198119d700 1 -- 172.21.15.71:0/1796299217 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197c0b15a0 con 0x7f197c0ccc00 2023-10-09T06:42:37.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.851+0000 7f1978ff9700 1 -- 172.21.15.71:0/1796299217 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1964013820 con 0x7f197c0ccc00 2023-10-09T06:42:37.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.853+0000 7f1978ff9700 1 --2- 172.21.15.71:0/1796299217 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f195c066f30 0x7f195c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:37.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.853+0000 7f1978ff9700 1 -- 172.21.15.71:0/1796299217 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f1964084900 con 0x7f197c0ccc00 2023-10-09T06:42:37.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.853+0000 7f197bfff700 1 --2- 172.21.15.71:0/1796299217 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f195c066f30 0x7f195c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:37.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.854+0000 7f197bfff700 1 --2- 172.21.15.71:0/1796299217 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f195c066f30 0x7f195c0693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f197c157190 tx=0x7f196c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:37.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:37.858+0000 7f1978ff9700 1 -- 172.21.15.71:0/1796299217 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f197c0b15a0 con 0x7f197c0ccc00 2023-10-09T06:42:38.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.091+0000 7f198119d700 1 -- 172.21.15.71:0/1796299217 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f197c0b1570 con 0x7f197c0ccc00 2023-10-09T06:42:38.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.627+0000 7f1978ff9700 1 -- 172.21.15.71:0/1796299217 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1964051b30 con 0x7f197c0ccc00 2023-10-09T06:42:38.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.629+0000 7f198119d700 1 -- 172.21.15.71:0/1796299217 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f195c066f30 msgr2=0x7f195c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:38.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.629+0000 7f198119d700 1 --2- 172.21.15.71:0/1796299217 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f195c066f30 0x7f195c0693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f197c157190 tx=0x7f196c009040 comp rx=0 tx=0).stop 2023-10-09T06:42:38.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.630+0000 7f198119d700 1 -- 172.21.15.71:0/1796299217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f197c0ccc00 msgr2=0x7f197c0c7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:38.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.630+0000 7f198119d700 1 --2- 172.21.15.71:0/1796299217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f197c0ccc00 0x7f197c0c7020 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f196400ec80 tx=0x7f19640091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:38.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.630+0000 7f198119d700 1 -- 172.21.15.71:0/1796299217 shutdown_connections 2023-10-09T06:42:38.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.630+0000 7f198119d700 1 --2- 172.21.15.71:0/1796299217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f197c159a60 0x7f197c1533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:38.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.630+0000 7f198119d700 1 --2- 172.21.15.71:0/1796299217 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f197c06a020 0x7f197c16a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:38.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.630+0000 7f198119d700 1 --2- 172.21.15.71:0/1796299217 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f195c066f30 0x7f195c0693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:38.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.630+0000 7f198119d700 1 --2- 172.21.15.71:0/1796299217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f197c0ccc00 0x7f197c0c7020 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:38.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.630+0000 7f198119d700 1 -- 172.21.15.71:0/1796299217 >> 172.21.15.71:0/1796299217 conn(0x7f197c06baa0 msgr2=0x7f197c157640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:38.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.630+0000 7f198119d700 1 -- 172.21.15.71:0/1796299217 shutdown_connections 2023-10-09T06:42:38.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.630+0000 7f198119d700 1 -- 172.21.15.71:0/1796299217 wait complete. 2023-10-09T06:42:38.632 INFO:teuthology.orchestra.run.smithi071.stderr:new fs with metadata pool 2 and data pool 3 2023-10-09T06:42:38.653 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:42:38.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.830+0000 7f77793ff700 1 Processor -- start 2023-10-09T06:42:38.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.831+0000 7f77793ff700 1 -- start start 2023-10-09T06:42:38.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.832+0000 7f77793ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f77740af4c0 0x7f7774068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:38.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.832+0000 7f77793ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77740688d0 0x7f7774157e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:38.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.832+0000 7f77793ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77740c77b0 con 0x7f7774155310 2023-10-09T06:42:38.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.832+0000 7f77793ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77740c8720 con 0x7f77740af4c0 2023-10-09T06:42:38.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.832+0000 7f77793ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777406ac60 con 0x7f77740688d0 2023-10-09T06:42:38.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.832+0000 7f7772ffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f7774155310 0x7f777406b660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56586/0 (socket says 172.21.15.71:56586) 2023-10-09T06:42:38.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.832+0000 7f7772ffd700 1 -- 172.21.15.71:0/3939374142 learned_addr learned my addr 172.21.15.71:0/3939374142 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:38.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.832+0000 7f77727fc700 1 -- 172.21.15.71:0/3939374142 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440809666 0 0) 0x7f77740c77b0 con 0x7f7774155310 2023-10-09T06:42:38.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.832+0000 7f77737fe700 1 --2- 172.21.15.71:0/3939374142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77740688d0 0x7f7774157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:38.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.832+0000 7f776bfff700 1 --2- 172.21.15.71:0/3939374142 >> v2:172.21.15.179:3300/0 conn(0x7f77740af4c0 0x7f7774068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:38.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.833+0000 7f77727fc700 1 -- 172.21.15.71:0/3939374142 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7760003570 con 0x7f7774155310 2023-10-09T06:42:38.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.833+0000 7f77727fc700 1 -- 172.21.15.71:0/3939374142 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3471276440 0 0) 0x7f7760003570 con 0x7f7774155310 2023-10-09T06:42:38.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.833+0000 7f77727fc700 1 -- 172.21.15.71:0/3939374142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77740688d0 msgr2=0x7f7774157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:38.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.833+0000 7f77727fc700 1 --2- 172.21.15.71:0/3939374142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77740688d0 0x7f7774157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:38.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.833+0000 7f77727fc700 1 -- 172.21.15.71:0/3939374142 >> v2:172.21.15.179:3300/0 conn(0x7f77740af4c0 msgr2=0x7f7774068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:38.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.833+0000 7f77727fc700 1 --2- 172.21.15.71:0/3939374142 >> v2:172.21.15.179:3300/0 conn(0x7f77740af4c0 0x7f7774068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:38.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.833+0000 7f77727fc700 1 -- 172.21.15.71:0/3939374142 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777406b1d0 con 0x7f7774155310 2023-10-09T06:42:38.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.833+0000 7f77727fc700 1 -- 172.21.15.71:0/3939374142 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f7764001470 con 0x7f7774155310 2023-10-09T06:42:38.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.833+0000 7f77727fc700 1 -- 172.21.15.71:0/3939374142 >> v1:172.21.15.71:6789/0 conn(0x7f7774155310 legacy=0x7f777406b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:38.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.833+0000 7f77727fc700 1 --2- 172.21.15.71:0/3939374142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7760003a60 0x7f7760003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:38.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.833+0000 7f77727fc700 1 --2- 172.21.15.71:0/3939374142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77740688d0 0x7f7760004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:38.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.833+0000 7f77727fc700 1 --2- 172.21.15.71:0/3939374142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7760004d50 0x7f77600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:38.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.833+0000 7f77727fc700 1 -- 172.21.15.71:0/3939374142 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777406ac60 con 0x7f7760003a60 2023-10-09T06:42:38.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.833+0000 7f77727fc700 1 -- 172.21.15.71:0/3939374142 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776000ba60 con 0x7f7760004d50 2023-10-09T06:42:38.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.833+0000 7f77727fc700 1 -- 172.21.15.71:0/3939374142 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776000bba0 con 0x7f77740688d0 2023-10-09T06:42:38.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.833+0000 7f7772ffd700 1 --2- 172.21.15.71:0/3939374142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7760003a60 0x7f7760003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:38.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.833+0000 7f776bfff700 1 --2- 172.21.15.71:0/3939374142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77740688d0 0x7f7760004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:38.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.833+0000 7f77737fe700 1 --2- 172.21.15.71:0/3939374142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7760004d50 0x7f77600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:38.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.834+0000 7f7772ffd700 1 -- 172.21.15.71:0/3939374142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77740688d0 msgr2=0x7f7760004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:38.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.834+0000 7f7772ffd700 1 --2- 172.21.15.71:0/3939374142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77740688d0 0x7f7760004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:38.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.834+0000 7f7772ffd700 1 -- 172.21.15.71:0/3939374142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7760004d50 msgr2=0x7f77600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:38.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.834+0000 7f7772ffd700 1 --2- 172.21.15.71:0/3939374142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7760004d50 0x7f77600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:38.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.834+0000 7f7772ffd700 1 -- 172.21.15.71:0/3939374142 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7760003570 con 0x7f7760003a60 2023-10-09T06:42:38.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.834+0000 7f7772ffd700 1 --2- 172.21.15.71:0/3939374142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7760003a60 0x7f7760003e70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f776400c3c0 tx=0x7f777415c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4550bc77d9c8eebd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:38.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.834+0000 7f77727fc700 1 -- 172.21.15.71:0/3939374142 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776400cc50 con 0x7f7760003a60 2023-10-09T06:42:38.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.834+0000 7f77727fc700 1 -- 172.21.15.71:0/3939374142 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776400cdd0 con 0x7f7760003a60 2023-10-09T06:42:38.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.834+0000 7f77727fc700 1 -- 172.21.15.71:0/3939374142 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764005b70 con 0x7f7760003a60 2023-10-09T06:42:38.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.835+0000 7f77793ff700 1 -- 172.21.15.71:0/3939374142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7760003a60 msgr2=0x7f7760003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:38.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.835+0000 7f77793ff700 1 --2- 172.21.15.71:0/3939374142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7760003a60 0x7f7760003e70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f776400c3c0 tx=0x7f777415c480 comp rx=0 tx=0).stop 2023-10-09T06:42:38.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.835+0000 7f77737fe700 1 -- 172.21.15.71:0/3939374142 reap_dead start 2023-10-09T06:42:38.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.835+0000 7f77793ff700 1 -- 172.21.15.71:0/3939374142 shutdown_connections 2023-10-09T06:42:38.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.835+0000 7f77793ff700 1 -- 172.21.15.71:0/3939374142 >> 172.21.15.71:0/3939374142 conn(0x7f77740c9860 msgr2=0x7f77740c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:38.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.835+0000 7f77793ff700 1 -- 172.21.15.71:0/3939374142 shutdown_connections 2023-10-09T06:42:38.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.835+0000 7f77793ff700 1 -- 172.21.15.71:0/3939374142 wait complete. 2023-10-09T06:42:38.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.836+0000 7f77793ff700 1 Processor -- start 2023-10-09T06:42:38.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.836+0000 7f77793ff700 1 -- start start 2023-10-09T06:42:38.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.837+0000 7f77793ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7760003a60 0x7f77740aabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:38.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.837+0000 7f77793ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7774154480 0x7f77741548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:38.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.837+0000 7f77793ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77740b2170 0x7f77740b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:38.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.837+0000 7f77793ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777416d410 con 0x7f7774154480 2023-10-09T06:42:38.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.837+0000 7f77793ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777416d6f0 con 0x7f7760003a60 2023-10-09T06:42:38.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.837+0000 7f77793ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777416d9d0 con 0x7f77740b2170 2023-10-09T06:42:38.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.837+0000 7f776bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7774154480 0x7f77741548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:38.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.837+0000 7f776bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7774154480 0x7f77741548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44052/0 (socket says 172.21.15.71:44052) 2023-10-09T06:42:38.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.837+0000 7f776bfff700 1 -- 172.21.15.71:0/3223446041 learned_addr learned my addr 172.21.15.71:0/3223446041 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:38.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.837+0000 7f7772ffd700 1 --2- 172.21.15.71:0/3223446041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7760003a60 0x7f77740aabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:38.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.838+0000 7f77737fe700 1 --2- 172.21.15.71:0/3223446041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77740b2170 0x7f77740b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:38.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.838+0000 7f776bfff700 1 -- 172.21.15.71:0/3223446041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77740b2170 msgr2=0x7f77740b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:38.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.838+0000 7f776bfff700 1 --2- 172.21.15.71:0/3223446041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77740b2170 0x7f77740b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:38.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.838+0000 7f776bfff700 1 -- 172.21.15.71:0/3223446041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7760003a60 msgr2=0x7f77740aabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:38.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.838+0000 7f776bfff700 1 --2- 172.21.15.71:0/3223446041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7760003a60 0x7f77740aabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:38.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.838+0000 7f776bfff700 1 -- 172.21.15.71:0/3223446041 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777416dcb0 con 0x7f7774154480 2023-10-09T06:42:38.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.838+0000 7f77737fe700 1 --2- 172.21.15.71:0/3223446041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77740b2170 0x7f77740b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:38.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.838+0000 7f776bfff700 1 --2- 172.21.15.71:0/3223446041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7774154480 0x7f77741548f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f775c011d40 tx=0x7f775c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:38.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.838+0000 7f776affd700 1 -- 172.21.15.71:0/3223446041 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c00fac0 con 0x7f7774154480 2023-10-09T06:42:38.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.838+0000 7f776affd700 1 -- 172.21.15.71:0/3223446041 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775c00fc20 con 0x7f7774154480 2023-10-09T06:42:38.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.838+0000 7f77793ff700 1 -- 172.21.15.71:0/3223446041 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777416df90 con 0x7f7774154480 2023-10-09T06:42:38.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.838+0000 7f776affd700 1 -- 172.21.15.71:0/3223446041 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c014440 con 0x7f7774154480 2023-10-09T06:42:38.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.838+0000 7f77793ff700 1 -- 172.21.15.71:0/3223446041 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77740b2b50 con 0x7f7774154480 2023-10-09T06:42:38.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.840+0000 7f77793ff700 1 -- 172.21.15.71:0/3223446041 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77740b2dd0 con 0x7f7774154480 2023-10-09T06:42:38.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.840+0000 7f776affd700 1 -- 172.21.15.71:0/3223446041 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f775c014870 con 0x7f7774154480 2023-10-09T06:42:38.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.841+0000 7f776affd700 1 --2- 172.21.15.71:0/3223446041 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7754066f30 0x7f77540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:38.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.841+0000 7f776affd700 1 -- 172.21.15.71:0/3223446041 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f775c018030 con 0x7f7774154480 2023-10-09T06:42:38.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.841+0000 7f7772ffd700 1 --2- 172.21.15.71:0/3223446041 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7754066f30 0x7f77540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:38.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.842+0000 7f7772ffd700 1 --2- 172.21.15.71:0/3223446041 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7754066f30 0x7f77540693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7764015040 tx=0x7f7764012000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:38.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:38.846+0000 7f776affd700 1 -- 172.21.15.71:0/3223446041 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f775c0520f0 con 0x7f7774154480 2023-10-09T06:42:39.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.036+0000 7f77793ff700 1 -- 172.21.15.71:0/3223446041 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f777404c3c0 con 0x7f7774154480 2023-10-09T06:42:39.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.037+0000 7f776affd700 1 -- 172.21.15.71:0/3223446041 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f775c022090 con 0x7f7774154480 2023-10-09T06:42:39.039 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:42:39.039 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":19,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:42:38.093423+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:42:35.828340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:42:37.071896+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:42:39.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.040+0000 7f77793ff700 1 -- 172.21.15.71:0/3223446041 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7754066f30 msgr2=0x7f77540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:39.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.040+0000 7f77793ff700 1 --2- 172.21.15.71:0/3223446041 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7754066f30 0x7f77540693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7764015040 tx=0x7f7764012000 comp rx=0 tx=0).stop 2023-10-09T06:42:39.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.040+0000 7f77793ff700 1 -- 172.21.15.71:0/3223446041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7774154480 msgr2=0x7f77741548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:39.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.040+0000 7f77793ff700 1 --2- 172.21.15.71:0/3223446041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7774154480 0x7f77741548f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f775c011d40 tx=0x7f775c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:39.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.040+0000 7f77793ff700 1 -- 172.21.15.71:0/3223446041 shutdown_connections 2023-10-09T06:42:39.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.040+0000 7f77793ff700 1 --2- 172.21.15.71:0/3223446041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77740b2170 0x7f77740b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:39.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.040+0000 7f77793ff700 1 --2- 172.21.15.71:0/3223446041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7760003a60 0x7f77740aabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:39.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.040+0000 7f77793ff700 1 --2- 172.21.15.71:0/3223446041 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7754066f30 0x7f77540693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:39.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.040+0000 7f77793ff700 1 --2- 172.21.15.71:0/3223446041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7774154480 0x7f77741548f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:39.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.040+0000 7f77793ff700 1 -- 172.21.15.71:0/3223446041 >> 172.21.15.71:0/3223446041 conn(0x7f77740c9860 msgr2=0x7f777406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:39.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.040+0000 7f77793ff700 1 -- 172.21.15.71:0/3223446041 shutdown_connections 2023-10-09T06:42:39.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.040+0000 7f77793ff700 1 -- 172.21.15.71:0/3223446041 wait complete. 2023-10-09T06:42:39.059 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:42:39.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.238+0000 7f06b1b9d700 1 Processor -- start 2023-10-09T06:42:39.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.238+0000 7f06b1b9d700 1 -- start start 2023-10-09T06:42:39.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.239+0000 7f06b1b9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f06ac1597f0 0x7f06ac0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:39.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.239+0000 7f06b1b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f06ac15d230 0x7f06ac15d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:39.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.239+0000 7f06b1b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ac15db70 con 0x7f06ac159420 2023-10-09T06:42:39.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.239+0000 7f06b1b9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ac0b11d0 con 0x7f06ac1597f0 2023-10-09T06:42:39.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.239+0000 7f06b1b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ac0b14b0 con 0x7f06ac15d230 2023-10-09T06:42:39.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.239+0000 7f06abfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f06ac1597f0 0x7f06ac0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:39.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.240+0000 7f06abfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f06ac1597f0 0x7f06ac0b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44066/0 (socket says 172.21.15.71:44066) 2023-10-09T06:42:39.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.240+0000 7f06abfff700 1 -- 172.21.15.71:0/2413829794 learned_addr learned my addr 172.21.15.71:0/2413829794 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:39.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.240+0000 7f06b139c700 1 --2- 172.21.15.71:0/2413829794 >> v2:172.21.15.179:3300/0 conn(0x7f06ac15d230 0x7f06ac15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:39.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.240+0000 7f06abfff700 1 -- 172.21.15.71:0/2413829794 >> v2:172.21.15.179:3300/0 conn(0x7f06ac15d230 msgr2=0x7f06ac15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:39.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.240+0000 7f06abfff700 1 --2- 172.21.15.71:0/2413829794 >> v2:172.21.15.179:3300/0 conn(0x7f06ac15d230 0x7f06ac15d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:39.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.240+0000 7f06abfff700 1 -- 172.21.15.71:0/2413829794 >> v1:172.21.15.179:6789/0 conn(0x7f06ac159420 legacy=0x7f06ac0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:39.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.240+0000 7f06abfff700 1 -- 172.21.15.71:0/2413829794 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac0b1790 con 0x7f06ac1597f0 2023-10-09T06:42:39.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.240+0000 7f06abfff700 1 --2- 172.21.15.71:0/2413829794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06ac1597f0 0x7f06ac0b2270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f06ac15d170 tx=0x7f0698009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93d7bd78227ddfe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:39.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.240+0000 7f06ab7fe700 1 -- 172.21.15.71:0/2413829794 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0698009e70 con 0x7f06ac1597f0 2023-10-09T06:42:39.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.240+0000 7f06ab7fe700 1 -- 172.21.15.71:0/2413829794 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069800b860 con 0x7f06ac1597f0 2023-10-09T06:42:39.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.240+0000 7f06ab7fe700 1 -- 172.21.15.71:0/2413829794 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069800bc00 con 0x7f06ac1597f0 2023-10-09T06:42:39.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.241+0000 7f06b1b9d700 1 -- 172.21.15.71:0/2413829794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06ac1597f0 msgr2=0x7f06ac0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:39.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.241+0000 7f06b1b9d700 1 --2- 172.21.15.71:0/2413829794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06ac1597f0 0x7f06ac0b2270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f06ac15d170 tx=0x7f0698009250 comp rx=0 tx=0).stop 2023-10-09T06:42:39.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.241+0000 7f06b1b9d700 1 -- 172.21.15.71:0/2413829794 shutdown_connections 2023-10-09T06:42:39.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.241+0000 7f06b1b9d700 1 --2- 172.21.15.71:0/2413829794 >> v2:172.21.15.179:3300/0 conn(0x7f06ac15d230 0x7f06ac15d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:39.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.241+0000 7f06b1b9d700 1 --2- 172.21.15.71:0/2413829794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06ac1597f0 0x7f06ac0b2270 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:39.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.241+0000 7f06b1b9d700 1 -- 172.21.15.71:0/2413829794 >> 172.21.15.71:0/2413829794 conn(0x7f06ac0d0660 msgr2=0x7f06ac0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:39.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.241+0000 7f06b1b9d700 1 -- 172.21.15.71:0/2413829794 shutdown_connections 2023-10-09T06:42:39.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.241+0000 7f06b1b9d700 1 -- 172.21.15.71:0/2413829794 wait complete. 2023-10-09T06:42:39.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.243+0000 7f06b1b9d700 1 Processor -- start 2023-10-09T06:42:39.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.243+0000 7f06b1b9d700 1 -- start start 2023-10-09T06:42:39.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.243+0000 7f06b1b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06ac159420 0x7f06ac154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:39.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.243+0000 7f06b1b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06ac1597f0 0x7f06ac0c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:39.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.244+0000 7f06b1b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06ac15d230 0x7f06ac0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:39.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.244+0000 7f06b1b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0c66f0 con 0x7f06ac159420 2023-10-09T06:42:39.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.244+0000 7f06b1b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0c6f00 con 0x7f06ac1597f0 2023-10-09T06:42:39.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.244+0000 7f06b1b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac154940 con 0x7f06ac15d230 2023-10-09T06:42:39.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.244+0000 7f06b0b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06ac159420 0x7f06ac154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:39.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.244+0000 7f06b0b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06ac159420 0x7f06ac154400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44068/0 (socket says 172.21.15.71:44068) 2023-10-09T06:42:39.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.244+0000 7f06b0b9b700 1 -- 172.21.15.71:0/436357650 learned_addr learned my addr 172.21.15.71:0/436357650 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:39.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.244+0000 7f06abfff700 1 --2- 172.21.15.71:0/436357650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06ac1597f0 0x7f06ac0c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:39.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.244+0000 7f06b139c700 1 --2- 172.21.15.71:0/436357650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06ac15d230 0x7f06ac0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:39.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.244+0000 7f06b0b9b700 1 -- 172.21.15.71:0/436357650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06ac15d230 msgr2=0x7f06ac0b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:39.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.244+0000 7f06b0b9b700 1 --2- 172.21.15.71:0/436357650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06ac15d230 0x7f06ac0b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:39.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.244+0000 7f06b0b9b700 1 -- 172.21.15.71:0/436357650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06ac1597f0 msgr2=0x7f06ac0c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:39.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.244+0000 7f06b0b9b700 1 --2- 172.21.15.71:0/436357650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06ac1597f0 0x7f06ac0c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:39.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.244+0000 7f06b0b9b700 1 -- 172.21.15.71:0/436357650 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06980094f0 con 0x7f06ac159420 2023-10-09T06:42:39.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.244+0000 7f06abfff700 1 --2- 172.21.15.71:0/436357650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06ac1597f0 0x7f06ac0c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:39.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.244+0000 7f06b0b9b700 1 --2- 172.21.15.71:0/436357650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06ac159420 0x7f06ac154400 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f06a000c5c0 tx=0x7f06a000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:39.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.245+0000 7f06a8ff9700 1 -- 172.21.15.71:0/436357650 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a0011590 con 0x7f06ac159420 2023-10-09T06:42:39.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.245+0000 7f06a8ff9700 1 -- 172.21.15.71:0/436357650 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a0011710 con 0x7f06ac159420 2023-10-09T06:42:39.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.245+0000 7f06b1b9d700 1 -- 172.21.15.71:0/436357650 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ac0c5e50 con 0x7f06ac159420 2023-10-09T06:42:39.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.245+0000 7f06a8ff9700 1 -- 172.21.15.71:0/436357650 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a0011ad0 con 0x7f06ac159420 2023-10-09T06:42:39.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.245+0000 7f06b1b9d700 1 -- 172.21.15.71:0/436357650 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ac0c6410 con 0x7f06ac159420 2023-10-09T06:42:39.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.246+0000 7f06b1b9d700 1 -- 172.21.15.71:0/436357650 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ac04c3c0 con 0x7f06ac159420 2023-10-09T06:42:39.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.246+0000 7f06a8ff9700 1 -- 172.21.15.71:0/436357650 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f06a001b3b0 con 0x7f06ac159420 2023-10-09T06:42:39.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.247+0000 7f06a8ff9700 1 --2- 172.21.15.71:0/436357650 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0690066f30 0x7f06900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:39.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.247+0000 7f06a8ff9700 1 -- 172.21.15.71:0/436357650 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f06a0083bb0 con 0x7f06ac159420 2023-10-09T06:42:39.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.248+0000 7f06abfff700 1 --2- 172.21.15.71:0/436357650 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0690066f30 0x7f06900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:39.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.248+0000 7f06abfff700 1 --2- 172.21.15.71:0/436357650 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0690066f30 0x7f06900693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f06ac15d170 tx=0x7f0698017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:39.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.251+0000 7f06a8ff9700 1 -- 172.21.15.71:0/436357650 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06a0050d80 con 0x7f06ac159420 2023-10-09T06:42:39.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.442+0000 7f06b1b9d700 1 -- 172.21.15.71:0/436357650 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06ac0b1a70 con 0x7f06ac159420 2023-10-09T06:42:39.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.443+0000 7f06a8ff9700 1 -- 172.21.15.71:0/436357650 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f06a0017020 con 0x7f06ac159420 2023-10-09T06:42:39.444 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:42:39.444 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":19,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:42:38.093423+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:42:35.828340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:42:37.071896+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:42:39.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.445+0000 7f06b1b9d700 1 -- 172.21.15.71:0/436357650 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0690066f30 msgr2=0x7f06900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:39.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.445+0000 7f06b1b9d700 1 --2- 172.21.15.71:0/436357650 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0690066f30 0x7f06900693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f06ac15d170 tx=0x7f0698017000 comp rx=0 tx=0).stop 2023-10-09T06:42:39.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.445+0000 7f06b1b9d700 1 -- 172.21.15.71:0/436357650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06ac159420 msgr2=0x7f06ac154400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:39.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.445+0000 7f06b1b9d700 1 --2- 172.21.15.71:0/436357650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06ac159420 0x7f06ac154400 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f06a000c5c0 tx=0x7f06a000c980 comp rx=0 tx=0).stop 2023-10-09T06:42:39.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.445+0000 7f06b1b9d700 1 -- 172.21.15.71:0/436357650 shutdown_connections 2023-10-09T06:42:39.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.445+0000 7f06b1b9d700 1 --2- 172.21.15.71:0/436357650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06ac15d230 0x7f06ac0b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:39.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.445+0000 7f06b1b9d700 1 --2- 172.21.15.71:0/436357650 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0690066f30 0x7f06900693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:39.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.445+0000 7f06b1b9d700 1 --2- 172.21.15.71:0/436357650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06ac159420 0x7f06ac154400 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:39.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.445+0000 7f06b1b9d700 1 --2- 172.21.15.71:0/436357650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06ac1597f0 0x7f06ac0c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:39.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.445+0000 7f06b1b9d700 1 -- 172.21.15.71:0/436357650 >> 172.21.15.71:0/436357650 conn(0x7f06ac0d0660 msgr2=0x7f06ac0b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:39.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.446+0000 7f06b1b9d700 1 -- 172.21.15.71:0/436357650 shutdown_connections 2023-10-09T06:42:39.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.446+0000 7f06b1b9d700 1 -- 172.21.15.71:0/436357650 wait complete. 2023-10-09T06:42:39.464 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T06:42:39.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.648+0000 7f32f719d700 1 Processor -- start 2023-10-09T06:42:39.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.648+0000 7f32f719d700 1 -- start start 2023-10-09T06:42:39.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.649+0000 7f32f719d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f32f00b4e70 0x7f32f00ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:39.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.649+0000 7f32f719d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f00b1b40 0x7f32f015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:39.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.649+0000 7f32f719d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f00cfb00 con 0x7f32f00b16d0 2023-10-09T06:42:39.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.649+0000 7f32f719d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f00b5c40 con 0x7f32f00b4e70 2023-10-09T06:42:39.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.649+0000 7f32f719d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f00b5f20 con 0x7f32f00b1b40 2023-10-09T06:42:39.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.650+0000 7f32f599a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f32f00b16d0 0x7f32f015d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56590/0 (socket says 172.21.15.71:56590) 2023-10-09T06:42:39.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.650+0000 7f32f599a700 1 -- 172.21.15.71:0/1332078878 learned_addr learned my addr 172.21.15.71:0/1332078878 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:39.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.650+0000 7f32f619b700 1 --2- 172.21.15.71:0/1332078878 >> v2:172.21.15.179:3300/0 conn(0x7f32f00b4e70 0x7f32f00ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:39.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.650+0000 7f32f699c700 1 --2- 172.21.15.71:0/1332078878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f00b1b40 0x7f32f015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:39.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.650+0000 7f32f5199700 1 -- 172.21.15.71:0/1332078878 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237587440 0 0) 0x7f32f00cfb00 con 0x7f32f00b16d0 2023-10-09T06:42:39.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.650+0000 7f32f5199700 1 -- 172.21.15.71:0/1332078878 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32dc003570 con 0x7f32f00b16d0 2023-10-09T06:42:39.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.650+0000 7f32f619b700 1 -- 172.21.15.71:0/1332078878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f00b1b40 msgr2=0x7f32f015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:39.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.650+0000 7f32f619b700 1 --2- 172.21.15.71:0/1332078878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f00b1b40 0x7f32f015d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:39.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.650+0000 7f32f619b700 1 -- 172.21.15.71:0/1332078878 >> v1:172.21.15.71:6789/0 conn(0x7f32f00b16d0 legacy=0x7f32f015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:39.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.650+0000 7f32f5199700 1 -- 172.21.15.71:0/1332078878 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1901093616 0 0) 0x7f32dc003570 con 0x7f32f00b16d0 2023-10-09T06:42:39.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.650+0000 7f32f619b700 1 -- 172.21.15.71:0/1332078878 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f00b6200 con 0x7f32f00b4e70 2023-10-09T06:42:39.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.650+0000 7f32f699c700 1 --2- 172.21.15.71:0/1332078878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f00b1b40 0x7f32f015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:42:39.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.651+0000 7f32f619b700 1 --2- 172.21.15.71:0/1332078878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32f00b4e70 0x7f32f00ccff0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0098e0 tx=0x7f32ec0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=318380281a9839a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:39.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.651+0000 7f32f5199700 1 -- 172.21.15.71:0/1332078878 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0001470 con 0x7f32f00b4e70 2023-10-09T06:42:39.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.651+0000 7f32f5199700 1 -- 172.21.15.71:0/1332078878 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ec011420 con 0x7f32f00b4e70 2023-10-09T06:42:39.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.651+0000 7f32f5199700 1 -- 172.21.15.71:0/1332078878 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec0117a0 con 0x7f32f00b4e70 2023-10-09T06:42:39.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.651+0000 7f32f719d700 1 -- 172.21.15.71:0/1332078878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32f00b4e70 msgr2=0x7f32f00ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:39.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.651+0000 7f32f719d700 1 --2- 172.21.15.71:0/1332078878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32f00b4e70 0x7f32f00ccff0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0098e0 tx=0x7f32ec0091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:39.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.652+0000 7f32f719d700 1 -- 172.21.15.71:0/1332078878 shutdown_connections 2023-10-09T06:42:39.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.652+0000 7f32f719d700 1 --2- 172.21.15.71:0/1332078878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f00b1b40 0x7f32f015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:39.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.652+0000 7f32f719d700 1 --2- 172.21.15.71:0/1332078878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32f00b4e70 0x7f32f00ccff0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:39.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.652+0000 7f32f719d700 1 -- 172.21.15.71:0/1332078878 >> 172.21.15.71:0/1332078878 conn(0x7f32f00d10c0 msgr2=0x7f32f00affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:39.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.652+0000 7f32f719d700 1 -- 172.21.15.71:0/1332078878 shutdown_connections 2023-10-09T06:42:39.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.652+0000 7f32f719d700 1 -- 172.21.15.71:0/1332078878 wait complete. 2023-10-09T06:42:39.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.653+0000 7f32f719d700 1 Processor -- start 2023-10-09T06:42:39.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.653+0000 7f32f719d700 1 -- start start 2023-10-09T06:42:39.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.654+0000 7f32f719d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32f00b16d0 0x7f32f0157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:39.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.654+0000 7f32f719d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f00b1b40 0x7f32f00c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:39.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.654+0000 7f32f719d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32f00b4e70 0x7f32f00c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:39.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.654+0000 7f32f719d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f00ca560 con 0x7f32f00b4e70 2023-10-09T06:42:39.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.654+0000 7f32f719d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f00ca840 con 0x7f32f00b16d0 2023-10-09T06:42:39.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.654+0000 7f32f719d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f00cab20 con 0x7f32f00b1b40 2023-10-09T06:42:39.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.654+0000 7f32f699c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32f00b4e70 0x7f32f00c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:39.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.654+0000 7f32f699c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32f00b4e70 0x7f32f00c96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44072/0 (socket says 172.21.15.71:44072) 2023-10-09T06:42:39.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.654+0000 7f32f699c700 1 -- 172.21.15.71:0/524705723 learned_addr learned my addr 172.21.15.71:0/524705723 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:39.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.654+0000 7f32f619b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32f00b16d0 0x7f32f0157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:39.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.654+0000 7f32f599a700 1 --2- 172.21.15.71:0/524705723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f00b1b40 0x7f32f00c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:39.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.655+0000 7f32f699c700 1 -- 172.21.15.71:0/524705723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f00b1b40 msgr2=0x7f32f00c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:39.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.655+0000 7f32f699c700 1 --2- 172.21.15.71:0/524705723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f00b1b40 0x7f32f00c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:39.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.655+0000 7f32f699c700 1 -- 172.21.15.71:0/524705723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32f00b16d0 msgr2=0x7f32f0157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:39.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.655+0000 7f32f699c700 1 --2- 172.21.15.71:0/524705723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32f00b16d0 0x7f32f0157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:39.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.655+0000 7f32f699c700 1 -- 172.21.15.71:0/524705723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e8009a20 con 0x7f32f00b4e70 2023-10-09T06:42:39.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.655+0000 7f32f699c700 1 --2- 172.21.15.71:0/524705723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32f00b4e70 0x7f32f00c96b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009fc0 tx=0x7f32e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:39.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.655+0000 7f32e67fc700 1 -- 172.21.15.71:0/524705723 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e800cbd0 con 0x7f32f00b4e70 2023-10-09T06:42:39.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.655+0000 7f32e67fc700 1 -- 172.21.15.71:0/524705723 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e800f040 con 0x7f32f00b4e70 2023-10-09T06:42:39.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.655+0000 7f32f719d700 1 -- 172.21.15.71:0/524705723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32ec009420 con 0x7f32f00b4e70 2023-10-09T06:42:39.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.655+0000 7f32e67fc700 1 -- 172.21.15.71:0/524705723 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e8014480 con 0x7f32f00b4e70 2023-10-09T06:42:39.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.655+0000 7f32f719d700 1 -- 172.21.15.71:0/524705723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f0169e70 con 0x7f32f00b4e70 2023-10-09T06:42:39.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.656+0000 7f32f719d700 1 -- 172.21.15.71:0/524705723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f0088990 con 0x7f32f00b4e70 2023-10-09T06:42:39.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.657+0000 7f32e67fc700 1 -- 172.21.15.71:0/524705723 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f32e8003020 con 0x7f32f00b4e70 2023-10-09T06:42:39.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.658+0000 7f32e67fc700 1 --2- 172.21.15.71:0/524705723 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f32d4066f30 0x7f32d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:39.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.658+0000 7f32e67fc700 1 -- 172.21.15.71:0/524705723 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f32e8084ef0 con 0x7f32f00b4e70 2023-10-09T06:42:39.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.658+0000 7f32f619b700 1 --2- 172.21.15.71:0/524705723 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f32d4066f30 0x7f32d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:39.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.659+0000 7f32f619b700 1 --2- 172.21.15.71:0/524705723 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f32d4066f30 0x7f32d40693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0091e0 tx=0x7f32ec016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:39.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.662+0000 7f32e67fc700 1 -- 172.21.15.71:0/524705723 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32e80520c0 con 0x7f32f00b4e70 2023-10-09T06:42:39.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:39.892+0000 7f32f719d700 1 -- 172.21.15.71:0/524705723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f32f004bb80 con 0x7f32f00b4e70 2023-10-09T06:42:40.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.642+0000 7f32e67fc700 1 -- 172.21.15.71:0/524705723 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f32e80556e0 con 0x7f32f00b4e70 2023-10-09T06:42:40.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.645+0000 7f32f719d700 1 -- 172.21.15.71:0/524705723 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f32d4066f30 msgr2=0x7f32d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:40.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.645+0000 7f32f719d700 1 --2- 172.21.15.71:0/524705723 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f32d4066f30 0x7f32d40693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0091e0 tx=0x7f32ec016000 comp rx=0 tx=0).stop 2023-10-09T06:42:40.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.645+0000 7f32f719d700 1 -- 172.21.15.71:0/524705723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32f00b4e70 msgr2=0x7f32f00c96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:40.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.645+0000 7f32f719d700 1 --2- 172.21.15.71:0/524705723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32f00b4e70 0x7f32f00c96b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009fc0 tx=0x7f32e800b040 comp rx=0 tx=0).stop 2023-10-09T06:42:40.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.645+0000 7f32f719d700 1 -- 172.21.15.71:0/524705723 shutdown_connections 2023-10-09T06:42:40.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.645+0000 7f32f719d700 1 --2- 172.21.15.71:0/524705723 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f32d4066f30 0x7f32d40693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:40.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.645+0000 7f32f719d700 1 --2- 172.21.15.71:0/524705723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32f00b4e70 0x7f32f00c96b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:40.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.645+0000 7f32f719d700 1 --2- 172.21.15.71:0/524705723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32f00b16d0 0x7f32f0157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:40.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.645+0000 7f32f719d700 1 --2- 172.21.15.71:0/524705723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f00b1b40 0x7f32f00c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:40.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.645+0000 7f32f719d700 1 -- 172.21.15.71:0/524705723 >> 172.21.15.71:0/524705723 conn(0x7f32f00d10c0 msgr2=0x7f32f0069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:40.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.646+0000 7f32f719d700 1 -- 172.21.15.71:0/524705723 shutdown_connections 2023-10-09T06:42:40.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.646+0000 7f32f719d700 1 -- 172.21.15.71:0/524705723 wait complete. 2023-10-09T06:42:40.666 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T06:42:40.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.851+0000 7f6cba3ff700 1 Processor -- start 2023-10-09T06:42:40.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.851+0000 7f6cba3ff700 1 -- start start 2023-10-09T06:42:40.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.852+0000 7f6cba3ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6cb40ccee0 0x7f6cb41561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:40.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.853+0000 7f6cba3ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb415b0d0 con 0x7f6cb40c83f0 2023-10-09T06:42:40.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.853+0000 7f6cba3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb415a4c0 con 0x7f6cb40c87c0 2023-10-09T06:42:40.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.853+0000 7f6cba3ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb415a7a0 con 0x7f6cb40ccee0 2023-10-09T06:42:40.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.853+0000 7f6cb3fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6cb40c83f0 0x7f6cb40c7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56596/0 (socket says 172.21.15.71:56596) 2023-10-09T06:42:40.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.853+0000 7f6cb3fff700 1 -- 172.21.15.71:0/1919315882 learned_addr learned my addr 172.21.15.71:0/1919315882 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:40.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.853+0000 7f6cb37fe700 1 --2- 172.21.15.71:0/1919315882 >> v2:172.21.15.71:3300/0 conn(0x7f6cb40ccee0 0x7f6cb41561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:40.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.853+0000 7f6cb2ffd700 1 -- 172.21.15.71:0/1919315882 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877236990 0 0) 0x7f6cb415b0d0 con 0x7f6cb40c83f0 2023-10-09T06:42:40.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.853+0000 7f6cb2ffd700 1 -- 172.21.15.71:0/1919315882 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c9c003570 con 0x7f6cb40c83f0 2023-10-09T06:42:40.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.853+0000 7f6cb37fe700 1 -- 172.21.15.71:0/1919315882 >> v1:172.21.15.179:6789/0 conn(0x7f6cb40c87c0 legacy=0x7f6cb40ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:40.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.853+0000 7f6cb37fe700 1 -- 172.21.15.71:0/1919315882 >> v1:172.21.15.71:6789/0 conn(0x7f6cb40c83f0 legacy=0x7f6cb40c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:40.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.853+0000 7f6cb37fe700 1 -- 172.21.15.71:0/1919315882 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb415aa80 con 0x7f6cb40ccee0 2023-10-09T06:42:40.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.854+0000 7f6cb37fe700 1 --2- 172.21.15.71:0/1919315882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cb40ccee0 0x7f6cb41561d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80098e0 tx=0x7f6ca80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98941673624dfff0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:40.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.854+0000 7f6cb2ffd700 1 -- 172.21.15.71:0/1919315882 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca800b640 con 0x7f6cb40ccee0 2023-10-09T06:42:40.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.854+0000 7f6cb2ffd700 1 -- 172.21.15.71:0/1919315882 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca800b7a0 con 0x7f6cb40ccee0 2023-10-09T06:42:40.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.854+0000 7f6cb2ffd700 1 -- 172.21.15.71:0/1919315882 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca800bb40 con 0x7f6cb40ccee0 2023-10-09T06:42:40.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.854+0000 7f6cba3ff700 1 -- 172.21.15.71:0/1919315882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cb40ccee0 msgr2=0x7f6cb41561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:40.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.854+0000 7f6cba3ff700 1 --2- 172.21.15.71:0/1919315882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cb40ccee0 0x7f6cb41561d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80098e0 tx=0x7f6ca80091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:40.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.854+0000 7f6cba3ff700 1 -- 172.21.15.71:0/1919315882 shutdown_connections 2023-10-09T06:42:40.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.854+0000 7f6cba3ff700 1 --2- 172.21.15.71:0/1919315882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cb40ccee0 0x7f6cb41561d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:40.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.854+0000 7f6cba3ff700 1 -- 172.21.15.71:0/1919315882 >> 172.21.15.71:0/1919315882 conn(0x7f6cb4068e10 msgr2=0x7f6cb40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:40.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.854+0000 7f6cba3ff700 1 -- 172.21.15.71:0/1919315882 shutdown_connections 2023-10-09T06:42:40.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.855+0000 7f6cba3ff700 1 -- 172.21.15.71:0/1919315882 wait complete. 2023-10-09T06:42:40.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.856+0000 7f6cba3ff700 1 Processor -- start 2023-10-09T06:42:40.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.856+0000 7f6cba3ff700 1 -- start start 2023-10-09T06:42:40.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.857+0000 7f6cba3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cb40c83f0 0x7f6cb4148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:40.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.857+0000 7f6cba3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cb40c87c0 0x7f6cb416b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:40.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.857+0000 7f6cba3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cb40ccee0 0x7f6cb416be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:40.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.857+0000 7f6cba3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb40c5820 con 0x7f6cb40c83f0 2023-10-09T06:42:40.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.857+0000 7f6cba3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb40c4f70 con 0x7f6cb40c87c0 2023-10-09T06:42:40.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.857+0000 7f6cba3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb4147c70 con 0x7f6cb40ccee0 2023-10-09T06:42:40.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.857+0000 7f6cb3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cb40c83f0 0x7f6cb4148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:40.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.857+0000 7f6cb3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cb40c83f0 0x7f6cb4148a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44082/0 (socket says 172.21.15.71:44082) 2023-10-09T06:42:40.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.857+0000 7f6cb3fff700 1 -- 172.21.15.71:0/1791387622 learned_addr learned my addr 172.21.15.71:0/1791387622 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:40.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.857+0000 7f6cb37fe700 1 --2- 172.21.15.71:0/1791387622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cb40c87c0 0x7f6cb416b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:40.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.857+0000 7f6cb899c700 1 --2- 172.21.15.71:0/1791387622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cb40ccee0 0x7f6cb416be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:40.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.858+0000 7f6cb3fff700 1 -- 172.21.15.71:0/1791387622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cb40ccee0 msgr2=0x7f6cb416be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:40.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.858+0000 7f6cb3fff700 1 --2- 172.21.15.71:0/1791387622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cb40ccee0 0x7f6cb416be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:40.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.858+0000 7f6cb3fff700 1 -- 172.21.15.71:0/1791387622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cb40c87c0 msgr2=0x7f6cb416b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:40.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.858+0000 7f6cb3fff700 1 --2- 172.21.15.71:0/1791387622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cb40c87c0 0x7f6cb416b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:40.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.858+0000 7f6cb3fff700 1 -- 172.21.15.71:0/1791387622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca8009420 con 0x7f6cb40c83f0 2023-10-09T06:42:40.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.858+0000 7f6cb3fff700 1 --2- 172.21.15.71:0/1791387622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cb40c83f0 0x7f6cb4148a60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400c590 tx=0x7f6ca4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:40.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.858+0000 7f6c9bfff700 1 -- 172.21.15.71:0/1791387622 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4005cd0 con 0x7f6cb40c83f0 2023-10-09T06:42:40.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.858+0000 7f6c9bfff700 1 -- 172.21.15.71:0/1791387622 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca4005e50 con 0x7f6cb40c83f0 2023-10-09T06:42:40.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.858+0000 7f6cba3ff700 1 -- 172.21.15.71:0/1791387622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb40c51d0 con 0x7f6cb40c83f0 2023-10-09T06:42:40.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.858+0000 7f6c9bfff700 1 -- 172.21.15.71:0/1791387622 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4007320 con 0x7f6cb40c83f0 2023-10-09T06:42:40.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.858+0000 7f6cba3ff700 1 -- 172.21.15.71:0/1791387622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb4145730 con 0x7f6cb40c83f0 2023-10-09T06:42:40.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.859+0000 7f6cba3ff700 1 -- 172.21.15.71:0/1791387622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb404c3c0 con 0x7f6cb40c83f0 2023-10-09T06:42:40.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.860+0000 7f6c9bfff700 1 -- 172.21.15.71:0/1791387622 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ca401b3b0 con 0x7f6cb40c83f0 2023-10-09T06:42:40.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.861+0000 7f6c9bfff700 1 --2- 172.21.15.71:0/1791387622 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6ca0066f30 0x7f6ca00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:40.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.861+0000 7f6c9bfff700 1 -- 172.21.15.71:0/1791387622 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6ca4083cc0 con 0x7f6cb40c83f0 2023-10-09T06:42:40.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.861+0000 7f6cb37fe700 1 --2- 172.21.15.71:0/1791387622 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6ca0066f30 0x7f6ca00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:40.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.862+0000 7f6cb37fe700 1 --2- 172.21.15.71:0/1791387622 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6ca0066f30 0x7f6ca00693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80093f0 tx=0x7f6ca8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:40.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:40.865+0000 7f6c9bfff700 1 -- 172.21.15.71:0/1791387622 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ca408a080 con 0x7f6cb40c83f0 2023-10-09T06:42:41.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.097+0000 7f6cba3ff700 1 -- 172.21.15.71:0/1791387622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6cb40cbd90 con 0x7f6cb40c83f0 2023-10-09T06:42:41.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.647+0000 7f6c9bfff700 1 -- 172.21.15.71:0/1791387622 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6ca4017070 con 0x7f6cb40c83f0 2023-10-09T06:42:41.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.650+0000 7f6cba3ff700 1 -- 172.21.15.71:0/1791387622 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6ca0066f30 msgr2=0x7f6ca00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:41.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.650+0000 7f6cba3ff700 1 --2- 172.21.15.71:0/1791387622 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6ca0066f30 0x7f6ca00693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80093f0 tx=0x7f6ca8017000 comp rx=0 tx=0).stop 2023-10-09T06:42:41.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.650+0000 7f6cba3ff700 1 -- 172.21.15.71:0/1791387622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cb40c83f0 msgr2=0x7f6cb4148a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:41.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.650+0000 7f6cba3ff700 1 --2- 172.21.15.71:0/1791387622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cb40c83f0 0x7f6cb4148a60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400c590 tx=0x7f6ca4007e00 comp rx=0 tx=0).stop 2023-10-09T06:42:41.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.650+0000 7f6cba3ff700 1 -- 172.21.15.71:0/1791387622 shutdown_connections 2023-10-09T06:42:41.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.650+0000 7f6cba3ff700 1 --2- 172.21.15.71:0/1791387622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cb40ccee0 0x7f6cb416be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:41.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.650+0000 7f6cba3ff700 1 --2- 172.21.15.71:0/1791387622 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6ca0066f30 0x7f6ca00693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:41.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.650+0000 7f6cba3ff700 1 --2- 172.21.15.71:0/1791387622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cb40c83f0 0x7f6cb4148a60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:41.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.650+0000 7f6cba3ff700 1 --2- 172.21.15.71:0/1791387622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cb40c87c0 0x7f6cb416b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:41.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.650+0000 7f6cba3ff700 1 -- 172.21.15.71:0/1791387622 >> 172.21.15.71:0/1791387622 conn(0x7f6cb4068e10 msgr2=0x7f6cb4069770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:41.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.650+0000 7f6cba3ff700 1 -- 172.21.15.71:0/1791387622 shutdown_connections 2023-10-09T06:42:41.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.650+0000 7f6cba3ff700 1 -- 172.21.15.71:0/1791387622 wait complete. 2023-10-09T06:42:41.669 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:42:41.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.848+0000 7f039f3ff700 1 Processor -- start 2023-10-09T06:42:41.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.848+0000 7f039f3ff700 1 -- start start 2023-10-09T06:42:41.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.849+0000 7f039f3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0398159890 0x7f039815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:41.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.849+0000 7f039f3ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0398159c60 0x7f039815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:41.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.849+0000 7f039f3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f039815db10 0x7f0398069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:41.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.849+0000 7f039f3ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f039815a160 con 0x7f0398159c60 2023-10-09T06:42:41.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.849+0000 7f039f3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03980d13a0 con 0x7f039815db10 2023-10-09T06:42:41.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.849+0000 7f039f3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039815e140 con 0x7f0398159890 2023-10-09T06:42:41.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.849+0000 7f039c99a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0398159c60 0x7f039815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:41.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.850+0000 7f039c99a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0398159c60 0x7f039815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44086/0 (socket says 172.21.15.71:44086) 2023-10-09T06:42:41.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.850+0000 7f039c99a700 1 -- 172.21.15.71:0/2189300473 learned_addr learned my addr 172.21.15.71:0/2189300473 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:41.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.850+0000 7f039d99c700 1 --2- 172.21.15.71:0/2189300473 >> v2:172.21.15.179:3300/0 conn(0x7f039815db10 0x7f0398069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:41.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.850+0000 7f039d19b700 1 --2- 172.21.15.71:0/2189300473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0398159890 0x7f039815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:41.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.850+0000 7f039c99a700 1 -- 172.21.15.71:0/2189300473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0398159890 msgr2=0x7f039815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:41.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.850+0000 7f039c99a700 1 --2- 172.21.15.71:0/2189300473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0398159890 0x7f039815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:41.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.850+0000 7f039c99a700 1 -- 172.21.15.71:0/2189300473 >> v2:172.21.15.179:3300/0 conn(0x7f039815db10 msgr2=0x7f0398069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:41.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.850+0000 7f039c99a700 1 --2- 172.21.15.71:0/2189300473 >> v2:172.21.15.179:3300/0 conn(0x7f039815db10 0x7f0398069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:41.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.850+0000 7f039c99a700 1 -- 172.21.15.71:0/2189300473 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039815a3d0 con 0x7f0398159c60 2023-10-09T06:42:41.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.850+0000 7f039c99a700 1 --2- 172.21.15.71:0/2189300473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0398159c60 0x7f039815d5d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0398089b50 tx=0x7f0388009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b129847ff4d08fea server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:41.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.850+0000 7f038ffff700 1 -- 172.21.15.71:0/2189300473 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038800b640 con 0x7f0398159c60 2023-10-09T06:42:41.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.850+0000 7f038ffff700 1 -- 172.21.15.71:0/2189300473 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038800b7a0 con 0x7f0398159c60 2023-10-09T06:42:41.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.850+0000 7f038ffff700 1 -- 172.21.15.71:0/2189300473 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038800bb60 con 0x7f0398159c60 2023-10-09T06:42:41.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.851+0000 7f039f3ff700 1 -- 172.21.15.71:0/2189300473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0398159c60 msgr2=0x7f039815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:41.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.851+0000 7f039f3ff700 1 --2- 172.21.15.71:0/2189300473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0398159c60 0x7f039815d5d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0398089b50 tx=0x7f0388009250 comp rx=0 tx=0).stop 2023-10-09T06:42:41.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.851+0000 7f039f3ff700 1 -- 172.21.15.71:0/2189300473 shutdown_connections 2023-10-09T06:42:41.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.851+0000 7f039f3ff700 1 --2- 172.21.15.71:0/2189300473 >> v2:172.21.15.179:3300/0 conn(0x7f039815db10 0x7f0398069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:41.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.851+0000 7f039f3ff700 1 --2- 172.21.15.71:0/2189300473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0398159890 0x7f039815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:41.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.851+0000 7f039f3ff700 1 --2- 172.21.15.71:0/2189300473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0398159c60 0x7f039815d5d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:41.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.851+0000 7f039f3ff700 1 -- 172.21.15.71:0/2189300473 >> 172.21.15.71:0/2189300473 conn(0x7f0398068e20 msgr2=0x7f03980d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:41.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.851+0000 7f039f3ff700 1 -- 172.21.15.71:0/2189300473 shutdown_connections 2023-10-09T06:42:41.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.851+0000 7f039f3ff700 1 -- 172.21.15.71:0/2189300473 wait complete. 2023-10-09T06:42:41.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.853+0000 7f039f3ff700 1 Processor -- start 2023-10-09T06:42:41.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.853+0000 7f039f3ff700 1 -- start start 2023-10-09T06:42:41.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.853+0000 7f039f3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0398159890 0x7f0398152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:41.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.854+0000 7f039f3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0398159c60 0x7f03981584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:41.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.854+0000 7f039f3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f039815db10 0x7f03980c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:41.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.854+0000 7f039f3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03980b4380 con 0x7f039815db10 2023-10-09T06:42:41.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.854+0000 7f039f3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03980b4660 con 0x7f0398159890 2023-10-09T06:42:41.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.854+0000 7f039f3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03980b4940 con 0x7f0398159c60 2023-10-09T06:42:41.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.854+0000 7f039d99c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f039815db10 0x7f03980c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:41.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.854+0000 7f039d99c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f039815db10 0x7f03980c9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44088/0 (socket says 172.21.15.71:44088) 2023-10-09T06:42:41.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.854+0000 7f039d99c700 1 -- 172.21.15.71:0/4233216620 learned_addr learned my addr 172.21.15.71:0/4233216620 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:41.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.854+0000 7f039d19b700 1 --2- 172.21.15.71:0/4233216620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0398159890 0x7f0398152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:41.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.854+0000 7f039c99a700 1 --2- 172.21.15.71:0/4233216620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0398159c60 0x7f03981584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:41.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.854+0000 7f039d99c700 1 -- 172.21.15.71:0/4233216620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0398159c60 msgr2=0x7f03981584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:41.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.854+0000 7f039d99c700 1 --2- 172.21.15.71:0/4233216620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0398159c60 0x7f03981584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:41.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.854+0000 7f039d99c700 1 -- 172.21.15.71:0/4233216620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0398159890 msgr2=0x7f0398152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:41.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.854+0000 7f039d99c700 1 --2- 172.21.15.71:0/4233216620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0398159890 0x7f0398152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:41.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.854+0000 7f039d99c700 1 -- 172.21.15.71:0/4233216620 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03880094f0 con 0x7f039815db10 2023-10-09T06:42:41.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.854+0000 7f039d19b700 1 --2- 172.21.15.71:0/4233216620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0398159890 0x7f0398152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:41.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.854+0000 7f039d99c700 1 --2- 172.21.15.71:0/4233216620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f039815db10 0x7f03980c9a20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0390009df0 tx=0x7f039000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:41.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.855+0000 7f038d7fa700 1 -- 172.21.15.71:0/4233216620 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039000cb50 con 0x7f039815db10 2023-10-09T06:42:41.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.855+0000 7f038d7fa700 1 -- 172.21.15.71:0/4233216620 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039000f040 con 0x7f039815db10 2023-10-09T06:42:41.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.855+0000 7f038d7fa700 1 -- 172.21.15.71:0/4233216620 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0390014480 con 0x7f039815db10 2023-10-09T06:42:41.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.855+0000 7f039f3ff700 1 -- 172.21.15.71:0/4233216620 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03980b4c20 con 0x7f039815db10 2023-10-09T06:42:41.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.855+0000 7f039f3ff700 1 -- 172.21.15.71:0/4233216620 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03980b3f40 con 0x7f039815db10 2023-10-09T06:42:41.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.856+0000 7f039f3ff700 1 -- 172.21.15.71:0/4233216620 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f039804c3c0 con 0x7f039815db10 2023-10-09T06:42:41.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.857+0000 7f038d7fa700 1 -- 172.21.15.71:0/4233216620 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0390014830 con 0x7f039815db10 2023-10-09T06:42:41.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.857+0000 7f038d7fa700 1 --2- 172.21.15.71:0/4233216620 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f037c066f30 0x7f037c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:41.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.857+0000 7f038d7fa700 1 -- 172.21.15.71:0/4233216620 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0390084f50 con 0x7f039815db10 2023-10-09T06:42:41.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.858+0000 7f039d19b700 1 --2- 172.21.15.71:0/4233216620 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f037c066f30 0x7f037c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:41.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.859+0000 7f039d19b700 1 --2- 172.21.15.71:0/4233216620 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f037c066f30 0x7f037c0693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0394006f00 tx=0x7f0394008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:41.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:41.861+0000 7f038d7fa700 1 -- 172.21.15.71:0/4233216620 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0390052120 con 0x7f039815db10 2023-10-09T06:42:42.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.093+0000 7f039f3ff700 1 -- 172.21.15.71:0/4233216620 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f039815a990 con 0x7f039815db10 2023-10-09T06:42:42.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.094+0000 7f038d7fa700 1 -- 172.21.15.71:0/4233216620 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f0390055740 con 0x7f039815db10 2023-10-09T06:42:42.095 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:42:42.095 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3129948705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3129948705},{"type":"v1","addr":"172.21.15.71:6835","nonce":3129948705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2871867918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2871867918},{"type":"v1","addr":"172.21.15.71:6833","nonce":2871867918}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2975286987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2975286987},{"type":"v1","addr":"172.21.15.179:6836","nonce":2975286987}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:42:38.093747+0000","modified":"2023-10-09T06:42:41.642372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/3516898913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3516898913},{"type":"v1","addr":"172.21.15.179:6837","nonce":3516898913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T06:42:42.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.096+0000 7f039f3ff700 1 -- 172.21.15.71:0/4233216620 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f037c066f30 msgr2=0x7f037c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:42.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.096+0000 7f039f3ff700 1 --2- 172.21.15.71:0/4233216620 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f037c066f30 0x7f037c0693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0394006f00 tx=0x7f0394008040 comp rx=0 tx=0).stop 2023-10-09T06:42:42.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.096+0000 7f039f3ff700 1 -- 172.21.15.71:0/4233216620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f039815db10 msgr2=0x7f03980c9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:42.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.096+0000 7f039f3ff700 1 --2- 172.21.15.71:0/4233216620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f039815db10 0x7f03980c9a20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0390009df0 tx=0x7f039000b040 comp rx=0 tx=0).stop 2023-10-09T06:42:42.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.096+0000 7f039f3ff700 1 -- 172.21.15.71:0/4233216620 shutdown_connections 2023-10-09T06:42:42.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.096+0000 7f039f3ff700 1 --2- 172.21.15.71:0/4233216620 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f037c066f30 0x7f037c0693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:42.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.096+0000 7f039f3ff700 1 --2- 172.21.15.71:0/4233216620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f039815db10 0x7f03980c9a20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:42.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.096+0000 7f039f3ff700 1 --2- 172.21.15.71:0/4233216620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0398159890 0x7f0398152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:42.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.096+0000 7f039f3ff700 1 --2- 172.21.15.71:0/4233216620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0398159c60 0x7f03981584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:42.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.096+0000 7f039f3ff700 1 -- 172.21.15.71:0/4233216620 >> 172.21.15.71:0/4233216620 conn(0x7f0398068e20 msgr2=0x7f039815d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:42.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.096+0000 7f039f3ff700 1 -- 172.21.15.71:0/4233216620 shutdown_connections 2023-10-09T06:42:42.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.096+0000 7f039f3ff700 1 -- 172.21.15.71:0/4233216620 wait complete. 2023-10-09T06:42:42.099 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2023-10-09T06:42:42.115 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:42:42.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.295+0000 7f3d1b7ff700 1 Processor -- start 2023-10-09T06:42:42.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.295+0000 7f3d1b7ff700 1 -- start start 2023-10-09T06:42:42.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.296+0000 7f3d1b7ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3d140ccc40 0x7f3d14155c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:42.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.296+0000 7f3d1b7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d140cd010 0x7f3d140b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:42.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.296+0000 7f3d1b7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d140ad930 con 0x7f3d14156150 2023-10-09T06:42:42.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.296+0000 7f3d1b7ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d140acd20 con 0x7f3d140ccc40 2023-10-09T06:42:42.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.296+0000 7f3d1b7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d140ad000 con 0x7f3d140cd010 2023-10-09T06:42:42.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.296+0000 7f3d1959b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3d140ccc40 0x7f3d14155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:42.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.297+0000 7f3d1959b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3d140ccc40 0x7f3d14155c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44094/0 (socket says 172.21.15.71:44094) 2023-10-09T06:42:42.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.297+0000 7f3d1959b700 1 -- 172.21.15.71:0/2905013339 learned_addr learned my addr 172.21.15.71:0/2905013339 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:42.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.297+0000 7f3d19d9c700 1 --2- 172.21.15.71:0/2905013339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d140cd010 0x7f3d140b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:42.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.297+0000 7f3d1959b700 1 -- 172.21.15.71:0/2905013339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d140cd010 msgr2=0x7f3d140b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:42.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.297+0000 7f3d1959b700 1 --2- 172.21.15.71:0/2905013339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d140cd010 0x7f3d140b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:42.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.297+0000 7f3d1959b700 1 -- 172.21.15.71:0/2905013339 >> v1:172.21.15.179:6789/0 conn(0x7f3d14156150 legacy=0x7f3d140ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:42.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.297+0000 7f3d1959b700 1 -- 172.21.15.71:0/2905013339 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d140ad2e0 con 0x7f3d140ccc40 2023-10-09T06:42:42.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.297+0000 7f3d19d9c700 1 --2- 172.21.15.71:0/2905013339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d140cd010 0x7f3d140b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:42.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.297+0000 7f3d1959b700 1 --2- 172.21.15.71:0/2905013339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d140ccc40 0x7f3d14155c10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3d100099b0 tx=0x7f3d10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b616641f17b795ed server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:42.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.297+0000 7f3d0bfff700 1 -- 172.21.15.71:0/2905013339 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1000b860 con 0x7f3d140ccc40 2023-10-09T06:42:42.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.298+0000 7f3d0bfff700 1 -- 172.21.15.71:0/2905013339 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1000b9c0 con 0x7f3d140ccc40 2023-10-09T06:42:42.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.298+0000 7f3d0bfff700 1 -- 172.21.15.71:0/2905013339 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1000bd60 con 0x7f3d140ccc40 2023-10-09T06:42:42.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.298+0000 7f3d1b7ff700 1 -- 172.21.15.71:0/2905013339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d140ccc40 msgr2=0x7f3d14155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:42.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.298+0000 7f3d1b7ff700 1 --2- 172.21.15.71:0/2905013339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d140ccc40 0x7f3d14155c10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3d100099b0 tx=0x7f3d10009250 comp rx=0 tx=0).stop 2023-10-09T06:42:42.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.298+0000 7f3d1b7ff700 1 -- 172.21.15.71:0/2905013339 shutdown_connections 2023-10-09T06:42:42.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.298+0000 7f3d1b7ff700 1 --2- 172.21.15.71:0/2905013339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d140cd010 0x7f3d140b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:42.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.298+0000 7f3d1b7ff700 1 --2- 172.21.15.71:0/2905013339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d140ccc40 0x7f3d14155c10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:42.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.298+0000 7f3d1b7ff700 1 -- 172.21.15.71:0/2905013339 >> 172.21.15.71:0/2905013339 conn(0x7f3d1406a320 msgr2=0x7f3d140cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:42.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.298+0000 7f3d1b7ff700 1 -- 172.21.15.71:0/2905013339 shutdown_connections 2023-10-09T06:42:42.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.298+0000 7f3d1b7ff700 1 -- 172.21.15.71:0/2905013339 wait complete. 2023-10-09T06:42:42.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.300+0000 7f3d1b7ff700 1 Processor -- start 2023-10-09T06:42:42.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.300+0000 7f3d1b7ff700 1 -- start start 2023-10-09T06:42:42.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.301+0000 7f3d1b7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d140ccc40 0x7f3d141415e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:42.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.301+0000 7f3d1b7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d140cd010 0x7f3d1416aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:42.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.301+0000 7f3d1b7ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d14156150 0x7f3d1416b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:42.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.301+0000 7f3d1b7ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d140a8eb0 con 0x7f3d14156150 2023-10-09T06:42:42.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.301+0000 7f3d1b7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d140c1470 con 0x7f3d140ccc40 2023-10-09T06:42:42.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.301+0000 7f3d1b7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d140c1750 con 0x7f3d140cd010 2023-10-09T06:42:42.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.301+0000 7f3d19d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d14156150 0x7f3d1416b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:42.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.301+0000 7f3d19d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d14156150 0x7f3d1416b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44108/0 (socket says 172.21.15.71:44108) 2023-10-09T06:42:42.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.301+0000 7f3d19d9c700 1 -- 172.21.15.71:0/3713317750 learned_addr learned my addr 172.21.15.71:0/3713317750 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:42.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.301+0000 7f3d19d9c700 1 -- 172.21.15.71:0/3713317750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d140cd010 msgr2=0x7f3d1416aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:42.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.301+0000 7f3d19d9c700 1 --2- 172.21.15.71:0/3713317750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d140cd010 0x7f3d1416aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:42.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.301+0000 7f3d19d9c700 1 -- 172.21.15.71:0/3713317750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d140ccc40 msgr2=0x7f3d141415e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:42.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.301+0000 7f3d19d9c700 1 --2- 172.21.15.71:0/3713317750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d140ccc40 0x7f3d141415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:42.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.301+0000 7f3d19d9c700 1 -- 172.21.15.71:0/3713317750 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d100094f0 con 0x7f3d14156150 2023-10-09T06:42:42.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.301+0000 7f3d19d9c700 1 --2- 172.21.15.71:0/3713317750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d14156150 0x7f3d1416b420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00d180 tx=0x7f3d0c009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:42.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.302+0000 7f3d097fa700 1 -- 172.21.15.71:0/3713317750 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c00de20 con 0x7f3d14156150 2023-10-09T06:42:42.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.302+0000 7f3d097fa700 1 -- 172.21.15.71:0/3713317750 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0c00f040 con 0x7f3d14156150 2023-10-09T06:42:42.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.302+0000 7f3d097fa700 1 -- 172.21.15.71:0/3713317750 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c015690 con 0x7f3d14156150 2023-10-09T06:42:42.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.302+0000 7f3d1b7ff700 1 -- 172.21.15.71:0/3713317750 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d140c1a30 con 0x7f3d14156150 2023-10-09T06:42:42.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.302+0000 7f3d1b7ff700 1 -- 172.21.15.71:0/3713317750 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d1413eec0 con 0x7f3d14156150 2023-10-09T06:42:42.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.303+0000 7f3d1b7ff700 1 -- 172.21.15.71:0/3713317750 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d1404c3c0 con 0x7f3d14156150 2023-10-09T06:42:42.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.303+0000 7f3d097fa700 1 -- 172.21.15.71:0/3713317750 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d0c01e3b0 con 0x7f3d14156150 2023-10-09T06:42:42.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.304+0000 7f3d097fa700 1 --2- 172.21.15.71:0/3713317750 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3cf8066f30 0x7f3cf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:42.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.304+0000 7f3d097fa700 1 -- 172.21.15.71:0/3713317750 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3d0c084c20 con 0x7f3d14156150 2023-10-09T06:42:42.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.305+0000 7f3d1959b700 1 --2- 172.21.15.71:0/3713317750 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3cf8066f30 0x7f3cf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:42.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.305+0000 7f3d1959b700 1 --2- 172.21.15.71:0/3713317750 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3cf8066f30 0x7f3cf80693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3d100099b0 tx=0x7f3d10017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:42.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.308+0000 7f3d097fa700 1 -- 172.21.15.71:0/3713317750 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d0c051df0 con 0x7f3d14156150 2023-10-09T06:42:42.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.501+0000 7f3d1b7ff700 1 -- 172.21.15.71:0/3713317750 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d140ad5c0 con 0x7f3d14156150 2023-10-09T06:42:42.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.502+0000 7f3d097fa700 1 -- 172.21.15.71:0/3713317750 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f3d0c01a090 con 0x7f3d14156150 2023-10-09T06:42:42.503 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:42:42.504 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":20,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:42:39.546192+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:42:35.828340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:42:37.071896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:42:42.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.504+0000 7f3d1b7ff700 1 -- 172.21.15.71:0/3713317750 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3cf8066f30 msgr2=0x7f3cf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:42.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.504+0000 7f3d1b7ff700 1 --2- 172.21.15.71:0/3713317750 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3cf8066f30 0x7f3cf80693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3d100099b0 tx=0x7f3d10017000 comp rx=0 tx=0).stop 2023-10-09T06:42:42.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.504+0000 7f3d1b7ff700 1 -- 172.21.15.71:0/3713317750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d14156150 msgr2=0x7f3d1416b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:42.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.504+0000 7f3d1b7ff700 1 --2- 172.21.15.71:0/3713317750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d14156150 0x7f3d1416b420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00d180 tx=0x7f3d0c009a50 comp rx=0 tx=0).stop 2023-10-09T06:42:42.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.505+0000 7f3d1b7ff700 1 -- 172.21.15.71:0/3713317750 shutdown_connections 2023-10-09T06:42:42.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.505+0000 7f3d1b7ff700 1 --2- 172.21.15.71:0/3713317750 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3cf8066f30 0x7f3cf80693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:42.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.505+0000 7f3d1b7ff700 1 --2- 172.21.15.71:0/3713317750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d14156150 0x7f3d1416b420 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:42.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.505+0000 7f3d1b7ff700 1 --2- 172.21.15.71:0/3713317750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d140ccc40 0x7f3d141415e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:42.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.505+0000 7f3d1b7ff700 1 --2- 172.21.15.71:0/3713317750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d140cd010 0x7f3d1416aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:42.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.505+0000 7f3d1b7ff700 1 -- 172.21.15.71:0/3713317750 >> 172.21.15.71:0/3713317750 conn(0x7f3d1406a320 msgr2=0x7f3d140c8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:42.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.505+0000 7f3d1b7ff700 1 -- 172.21.15.71:0/3713317750 shutdown_connections 2023-10-09T06:42:42.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.505+0000 7f3d1b7ff700 1 -- 172.21.15.71:0/3713317750 wait complete. 2023-10-09T06:42:42.523 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T06:42:42.523 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:42:42.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.704+0000 7f9a0dfff700 1 Processor -- start 2023-10-09T06:42:42.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.704+0000 7f9a0dfff700 1 -- start start 2023-10-09T06:42:42.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.706+0000 7f9a0dfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9a080b1420 0x7f9a080ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:42.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.706+0000 7f9a0dfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a080ccf90 0x7f9a080c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:42.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.706+0000 7f9a0dfff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a080cc300 con 0x7f9a080cbf30 2023-10-09T06:42:42.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.706+0000 7f9a0dfff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a08156bf0 con 0x7f9a080b1420 2023-10-09T06:42:42.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.706+0000 7f9a0dfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a080ae950 con 0x7f9a080ccf90 2023-10-09T06:42:42.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.706+0000 7f9a06ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9a080b1420 0x7f9a080ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:42.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.706+0000 7f9a077fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9a080cbf30 0x7f9a080b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56608/0 (socket says 172.21.15.71:56608) 2023-10-09T06:42:42.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.706+0000 7f9a077fe700 1 -- 172.21.15.71:0/381998329 learned_addr learned my addr 172.21.15.71:0/381998329 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:42.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.706+0000 7f9a07fff700 1 --2- 172.21.15.71:0/381998329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a080ccf90 0x7f9a080c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:42.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.706+0000 7f9a067fc700 1 -- 172.21.15.71:0/381998329 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285822601 0 0) 0x7f9a080cc300 con 0x7f9a080cbf30 2023-10-09T06:42:42.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.706+0000 7f9a06ffd700 1 -- 172.21.15.71:0/381998329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a080ccf90 msgr2=0x7f9a080c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:42.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.706+0000 7f9a06ffd700 1 --2- 172.21.15.71:0/381998329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a080ccf90 0x7f9a080c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:42.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.706+0000 7f9a06ffd700 1 -- 172.21.15.71:0/381998329 >> v1:172.21.15.71:6789/0 conn(0x7f9a080cbf30 legacy=0x7f9a080b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:42.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.706+0000 7f9a06ffd700 1 -- 172.21.15.71:0/381998329 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a080ad370 con 0x7f9a080b1420 2023-10-09T06:42:42.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.707+0000 7f9a06ffd700 1 --2- 172.21.15.71:0/381998329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a080b1420 0x7f9a080ae410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009910 tx=0x7f99fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc5ab1b41b5fc6c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:42.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.707+0000 7f9a067fc700 1 -- 172.21.15.71:0/381998329 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc00b820 con 0x7f9a080b1420 2023-10-09T06:42:42.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.707+0000 7f9a067fc700 1 -- 172.21.15.71:0/381998329 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc00b980 con 0x7f9a080b1420 2023-10-09T06:42:42.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.707+0000 7f9a067fc700 1 -- 172.21.15.71:0/381998329 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc00bd20 con 0x7f9a080b1420 2023-10-09T06:42:42.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.707+0000 7f9a0dfff700 1 -- 172.21.15.71:0/381998329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a080b1420 msgr2=0x7f9a080ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:42.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.707+0000 7f9a0dfff700 1 --2- 172.21.15.71:0/381998329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a080b1420 0x7f9a080ae410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009910 tx=0x7f99fc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:42.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.707+0000 7f9a0dfff700 1 -- 172.21.15.71:0/381998329 shutdown_connections 2023-10-09T06:42:42.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.708+0000 7f9a0dfff700 1 --2- 172.21.15.71:0/381998329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a080ccf90 0x7f9a080c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:42.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.708+0000 7f9a0dfff700 1 --2- 172.21.15.71:0/381998329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a080b1420 0x7f9a080ae410 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:42.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.708+0000 7f9a0dfff700 1 -- 172.21.15.71:0/381998329 >> 172.21.15.71:0/381998329 conn(0x7f9a0806a320 msgr2=0x7f9a080cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:42.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.708+0000 7f9a0dfff700 1 -- 172.21.15.71:0/381998329 shutdown_connections 2023-10-09T06:42:42.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.708+0000 7f9a0dfff700 1 -- 172.21.15.71:0/381998329 wait complete. 2023-10-09T06:42:42.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.709+0000 7f9a0dfff700 1 Processor -- start 2023-10-09T06:42:42.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.709+0000 7f9a0dfff700 1 -- start start 2023-10-09T06:42:42.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.710+0000 7f9a0dfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a080b1420 0x7f9a080a8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:42.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.710+0000 7f9a0dfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a080cbf30 0x7f9a08155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:42.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.710+0000 7f9a0dfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a080ccf90 0x7f9a080c1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:42.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.710+0000 7f9a0dfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a080a9fa0 con 0x7f9a080ccf90 2023-10-09T06:42:42.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.710+0000 7f9a0dfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a080a9700 con 0x7f9a080b1420 2023-10-09T06:42:42.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.710+0000 7f9a0dfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a080a99e0 con 0x7f9a080cbf30 2023-10-09T06:42:42.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.710+0000 7f9a07fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a080ccf90 0x7f9a080c1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:42.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.710+0000 7f9a07fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a080ccf90 0x7f9a080c1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44118/0 (socket says 172.21.15.71:44118) 2023-10-09T06:42:42.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.710+0000 7f9a07fff700 1 -- 172.21.15.71:0/4093009527 learned_addr learned my addr 172.21.15.71:0/4093009527 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:42.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.710+0000 7f9a06ffd700 1 --2- 172.21.15.71:0/4093009527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a080cbf30 0x7f9a08155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:42.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.710+0000 7f9a077fe700 1 --2- 172.21.15.71:0/4093009527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a080b1420 0x7f9a080a8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:42.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.711+0000 7f9a07fff700 1 -- 172.21.15.71:0/4093009527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a080cbf30 msgr2=0x7f9a08155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:42.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.711+0000 7f9a07fff700 1 --2- 172.21.15.71:0/4093009527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a080cbf30 0x7f9a08155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:42.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.711+0000 7f9a07fff700 1 -- 172.21.15.71:0/4093009527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a080b1420 msgr2=0x7f9a080a8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:42.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.711+0000 7f9a07fff700 1 --2- 172.21.15.71:0/4093009527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a080b1420 0x7f9a080a8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:42.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.711+0000 7f9a07fff700 1 -- 172.21.15.71:0/4093009527 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc009420 con 0x7f9a080ccf90 2023-10-09T06:42:42.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.711+0000 7f9a077fe700 1 --2- 172.21.15.71:0/4093009527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a080b1420 0x7f9a080a8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:42.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.711+0000 7f9a07fff700 1 --2- 172.21.15.71:0/4093009527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a080ccf90 0x7f9a080c1ce0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9a00007f20 tx=0x7f9a00009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:42.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.711+0000 7f99ef7fe700 1 -- 172.21.15.71:0/4093009527 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0000ebf0 con 0x7f9a080ccf90 2023-10-09T06:42:42.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.711+0000 7f99ef7fe700 1 -- 172.21.15.71:0/4093009527 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0000ed70 con 0x7f9a080ccf90 2023-10-09T06:42:42.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.711+0000 7f99ef7fe700 1 -- 172.21.15.71:0/4093009527 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a00014670 con 0x7f9a080ccf90 2023-10-09T06:42:42.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.711+0000 7f9a0dfff700 1 -- 172.21.15.71:0/4093009527 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a080a9cc0 con 0x7f9a080ccf90 2023-10-09T06:42:42.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.711+0000 7f9a0dfff700 1 -- 172.21.15.71:0/4093009527 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a080a93f0 con 0x7f9a080ccf90 2023-10-09T06:42:42.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.712+0000 7f9a0dfff700 1 -- 172.21.15.71:0/4093009527 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a080aa790 con 0x7f9a080ccf90 2023-10-09T06:42:42.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.713+0000 7f99ef7fe700 1 -- 172.21.15.71:0/4093009527 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a000149e0 con 0x7f9a080ccf90 2023-10-09T06:42:42.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.714+0000 7f99ef7fe700 1 --2- 172.21.15.71:0/4093009527 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f99f4066f30 0x7f99f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:42.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.714+0000 7f99ef7fe700 1 -- 172.21.15.71:0/4093009527 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9a00084bc0 con 0x7f9a080ccf90 2023-10-09T06:42:42.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.715+0000 7f9a077fe700 1 --2- 172.21.15.71:0/4093009527 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f99f4066f30 0x7f99f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:42.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.715+0000 7f9a077fe700 1 --2- 172.21.15.71:0/4093009527 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f99f4066f30 0x7f99f40693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9a0816b4d0 tx=0x7f99f8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:42.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.718+0000 7f99ef7fe700 1 -- 172.21.15.71:0/4093009527 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a00051e30 con 0x7f9a080ccf90 2023-10-09T06:42:42.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.905+0000 7f9a0dfff700 1 -- 172.21.15.71:0/4093009527 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9a0804c3c0 con 0x7f99f4066f30 2023-10-09T06:42:42.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.915+0000 7f99ef7fe700 1 -- 172.21.15.71:0/4093009527 <== mgr.4102 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264589 (secure 0 0 0) 0x7f9a0804c3c0 con 0x7f99f4066f30 2023-10-09T06:42:42.919 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:42:42.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.919+0000 7f9a0dfff700 1 -- 172.21.15.71:0/4093009527 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f99f4066f30 msgr2=0x7f99f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:42.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.919+0000 7f9a0dfff700 1 --2- 172.21.15.71:0/4093009527 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f99f4066f30 0x7f99f40693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9a0816b4d0 tx=0x7f99f8009040 comp rx=0 tx=0).stop 2023-10-09T06:42:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.919+0000 7f9a0dfff700 1 -- 172.21.15.71:0/4093009527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a080ccf90 msgr2=0x7f9a080c1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.919+0000 7f9a0dfff700 1 --2- 172.21.15.71:0/4093009527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a080ccf90 0x7f9a080c1ce0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9a00007f20 tx=0x7f9a00009860 comp rx=0 tx=0).stop 2023-10-09T06:42:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.919+0000 7f9a0dfff700 1 -- 172.21.15.71:0/4093009527 shutdown_connections 2023-10-09T06:42:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.919+0000 7f9a0dfff700 1 --2- 172.21.15.71:0/4093009527 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f99f4066f30 0x7f99f40693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.919+0000 7f9a0dfff700 1 --2- 172.21.15.71:0/4093009527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a080ccf90 0x7f9a080c1ce0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.919+0000 7f9a0dfff700 1 --2- 172.21.15.71:0/4093009527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a080b1420 0x7f9a080a8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.919+0000 7f9a0dfff700 1 --2- 172.21.15.71:0/4093009527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a080cbf30 0x7f9a08155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.919+0000 7f9a0dfff700 1 -- 172.21.15.71:0/4093009527 >> 172.21.15.71:0/4093009527 conn(0x7f9a0806a320 msgr2=0x7f9a080ca450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.919+0000 7f9a0dfff700 1 -- 172.21.15.71:0/4093009527 shutdown_connections 2023-10-09T06:42:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:42.919+0000 7f9a0dfff700 1 -- 172.21.15.71:0/4093009527 wait complete. 2023-10-09T06:42:42.924 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:42:42.937 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-09T06:42:42.545468+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":144,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381116,"kb_used_data":2812,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593604,"statfs":{"total":773094113280,"available":770655850496,"internally_reserved":0,"allocated":2879488,"data_stored":1744292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.936784"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.577185+0000","last_change":"2023-10-09T06:42:38.575641+0000","last_active":"2023-10-09T06:42:38.577185+0000","last_peered":"2023-10-09T06:42:38.577185+0000","last_clean":"2023-10-09T06:42:38.577185+0000","last_became_active":"2023-10-09T06:42:38.575375+0000","last_became_peered":"2023-10-09T06:42:38.575375+0000","last_unstale":"2023-10-09T06:42:38.577185+0000","last_undegraded":"2023-10-09T06:42:38.577185+0000","last_fullsized":"2023-10-09T06:42:38.577185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:07.557629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.563008+0000","last_change":"2023-10-09T06:42:38.559528+0000","last_active":"2023-10-09T06:42:38.563008+0000","last_peered":"2023-10-09T06:42:38.563008+0000","last_clean":"2023-10-09T06:42:38.563008+0000","last_became_active":"2023-10-09T06:42:38.559281+0000","last_became_peered":"2023-10-09T06:42:38.559281+0000","last_unstale":"2023-10-09T06:42:38.563008+0000","last_undegraded":"2023-10-09T06:42:38.563008+0000","last_fullsized":"2023-10-09T06:42:38.563008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:33.081210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.564926+0000","last_change":"2023-10-09T06:42:38.560485+0000","last_active":"2023-10-09T06:42:38.564926+0000","last_peered":"2023-10-09T06:42:38.564926+0000","last_clean":"2023-10-09T06:42:38.564926+0000","last_became_active":"2023-10-09T06:42:38.560196+0000","last_became_peered":"2023-10-09T06:42:38.560196+0000","last_unstale":"2023-10-09T06:42:38.564926+0000","last_undegraded":"2023-10-09T06:42:38.564926+0000","last_fullsized":"2023-10-09T06:42:38.564926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:35:09.230725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.577325+0000","last_change":"2023-10-09T06:42:38.563950+0000","last_active":"2023-10-09T06:42:38.577325+0000","last_peered":"2023-10-09T06:42:38.577325+0000","last_clean":"2023-10-09T06:42:38.577325+0000","last_became_active":"2023-10-09T06:42:38.563426+0000","last_became_peered":"2023-10-09T06:42:38.563426+0000","last_unstale":"2023-10-09T06:42:38.577325+0000","last_undegraded":"2023-10-09T06:42:38.577325+0000","last_fullsized":"2023-10-09T06:42:38.577325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:40.455468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.575267+0000","last_change":"2023-10-09T06:42:38.569136+0000","last_active":"2023-10-09T06:42:38.575267+0000","last_peered":"2023-10-09T06:42:38.575267+0000","last_clean":"2023-10-09T06:42:38.575267+0000","last_became_active":"2023-10-09T06:42:38.568819+0000","last_became_peered":"2023-10-09T06:42:38.568819+0000","last_unstale":"2023-10-09T06:42:38.575267+0000","last_undegraded":"2023-10-09T06:42:38.575267+0000","last_fullsized":"2023-10-09T06:42:38.575267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:45.260995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578720+0000","last_change":"2023-10-09T06:42:38.569499+0000","last_active":"2023-10-09T06:42:38.578720+0000","last_peered":"2023-10-09T06:42:38.578720+0000","last_clean":"2023-10-09T06:42:38.578720+0000","last_became_active":"2023-10-09T06:42:38.569273+0000","last_became_peered":"2023-10-09T06:42:38.569273+0000","last_unstale":"2023-10-09T06:42:38.578720+0000","last_undegraded":"2023-10-09T06:42:38.578720+0000","last_fullsized":"2023-10-09T06:42:38.578720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:30.124382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.568498+0000","last_change":"2023-10-09T06:42:38.563449+0000","last_active":"2023-10-09T06:42:38.568498+0000","last_peered":"2023-10-09T06:42:38.568498+0000","last_clean":"2023-10-09T06:42:38.568498+0000","last_became_active":"2023-10-09T06:42:38.563177+0000","last_became_peered":"2023-10-09T06:42:38.563177+0000","last_unstale":"2023-10-09T06:42:38.568498+0000","last_undegraded":"2023-10-09T06:42:38.568498+0000","last_fullsized":"2023-10-09T06:42:38.568498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:30.124382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581576+0000","last_change":"2023-10-09T06:42:38.577903+0000","last_active":"2023-10-09T06:42:38.581576+0000","last_peered":"2023-10-09T06:42:38.581576+0000","last_clean":"2023-10-09T06:42:38.581576+0000","last_became_active":"2023-10-09T06:42:38.577678+0000","last_became_peered":"2023-10-09T06:42:38.577678+0000","last_unstale":"2023-10-09T06:42:38.581576+0000","last_undegraded":"2023-10-09T06:42:38.581576+0000","last_fullsized":"2023-10-09T06:42:38.581576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:21.009791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.584331+0000","last_change":"2023-10-09T06:42:38.579587+0000","last_active":"2023-10-09T06:42:38.584331+0000","last_peered":"2023-10-09T06:42:38.584331+0000","last_clean":"2023-10-09T06:42:38.584331+0000","last_became_active":"2023-10-09T06:42:38.579323+0000","last_became_peered":"2023-10-09T06:42:38.579323+0000","last_unstale":"2023-10-09T06:42:38.584331+0000","last_undegraded":"2023-10-09T06:42:38.584331+0000","last_fullsized":"2023-10-09T06:42:38.584331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:01:38.384294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581576+0000","last_change":"2023-10-09T06:42:38.579931+0000","last_active":"2023-10-09T06:42:38.581576+0000","last_peered":"2023-10-09T06:42:38.581576+0000","last_clean":"2023-10-09T06:42:38.581576+0000","last_became_active":"2023-10-09T06:42:38.579558+0000","last_became_peered":"2023-10-09T06:42:38.579558+0000","last_unstale":"2023-10-09T06:42:38.581576+0000","last_undegraded":"2023-10-09T06:42:38.581576+0000","last_fullsized":"2023-10-09T06:42:38.581576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:12:51.397981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581524+0000","last_change":"2023-10-09T06:42:38.579020+0000","last_active":"2023-10-09T06:42:38.581524+0000","last_peered":"2023-10-09T06:42:38.581524+0000","last_clean":"2023-10-09T06:42:38.581524+0000","last_became_active":"2023-10-09T06:42:38.578750+0000","last_became_peered":"2023-10-09T06:42:38.578750+0000","last_unstale":"2023-10-09T06:42:38.581524+0000","last_undegraded":"2023-10-09T06:42:38.581524+0000","last_fullsized":"2023-10-09T06:42:38.581524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:09.752553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.569984+0000","last_change":"2023-10-09T06:42:38.569028+0000","last_active":"2023-10-09T06:42:38.569984+0000","last_peered":"2023-10-09T06:42:38.569984+0000","last_clean":"2023-10-09T06:42:38.569984+0000","last_became_active":"2023-10-09T06:42:38.568700+0000","last_became_peered":"2023-10-09T06:42:38.568700+0000","last_unstale":"2023-10-09T06:42:38.569984+0000","last_undegraded":"2023-10-09T06:42:38.569984+0000","last_fullsized":"2023-10-09T06:42:38.569984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:28.626444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.573134+0000","last_change":"2023-10-09T06:42:38.570156+0000","last_active":"2023-10-09T06:42:38.573134+0000","last_peered":"2023-10-09T06:42:38.573134+0000","last_clean":"2023-10-09T06:42:38.573134+0000","last_became_active":"2023-10-09T06:42:38.569850+0000","last_became_peered":"2023-10-09T06:42:38.569850+0000","last_unstale":"2023-10-09T06:42:38.573134+0000","last_undegraded":"2023-10-09T06:42:38.573134+0000","last_fullsized":"2023-10-09T06:42:38.573134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:12:51.397981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.572785+0000","last_change":"2023-10-09T06:42:38.567093+0000","last_active":"2023-10-09T06:42:38.572785+0000","last_peered":"2023-10-09T06:42:38.572785+0000","last_clean":"2023-10-09T06:42:38.572785+0000","last_became_active":"2023-10-09T06:42:38.566754+0000","last_became_peered":"2023-10-09T06:42:38.566754+0000","last_unstale":"2023-10-09T06:42:38.572785+0000","last_undegraded":"2023-10-09T06:42:38.572785+0000","last_fullsized":"2023-10-09T06:42:38.572785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:52.216260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570209+0000","last_change":"2023-10-09T06:42:38.569052+0000","last_active":"2023-10-09T06:42:38.570209+0000","last_peered":"2023-10-09T06:42:38.570209+0000","last_clean":"2023-10-09T06:42:38.570209+0000","last_became_active":"2023-10-09T06:42:38.568464+0000","last_became_peered":"2023-10-09T06:42:38.568464+0000","last_unstale":"2023-10-09T06:42:38.570209+0000","last_undegraded":"2023-10-09T06:42:38.570209+0000","last_fullsized":"2023-10-09T06:42:38.570209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:09.752553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578790+0000","last_change":"2023-10-09T06:42:38.572741+0000","last_active":"2023-10-09T06:42:38.578790+0000","last_peered":"2023-10-09T06:42:38.578790+0000","last_clean":"2023-10-09T06:42:38.578790+0000","last_became_active":"2023-10-09T06:42:38.572442+0000","last_became_peered":"2023-10-09T06:42:38.572442+0000","last_unstale":"2023-10-09T06:42:38.578790+0000","last_undegraded":"2023-10-09T06:42:38.578790+0000","last_fullsized":"2023-10-09T06:42:38.578790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:39.013974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581431+0000","last_change":"2023-10-09T06:42:38.577189+0000","last_active":"2023-10-09T06:42:38.581431+0000","last_peered":"2023-10-09T06:42:38.581431+0000","last_clean":"2023-10-09T06:42:38.581431+0000","last_became_active":"2023-10-09T06:42:38.576869+0000","last_became_peered":"2023-10-09T06:42:38.576869+0000","last_unstale":"2023-10-09T06:42:38.581431+0000","last_undegraded":"2023-10-09T06:42:38.581431+0000","last_fullsized":"2023-10-09T06:42:38.581431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:52:15.589759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570197+0000","last_change":"2023-10-09T06:42:38.566807+0000","last_active":"2023-10-09T06:42:38.570197+0000","last_peered":"2023-10-09T06:42:38.570197+0000","last_clean":"2023-10-09T06:42:38.570197+0000","last_became_active":"2023-10-09T06:42:38.566406+0000","last_became_peered":"2023-10-09T06:42:38.566406+0000","last_unstale":"2023-10-09T06:42:38.570197+0000","last_undegraded":"2023-10-09T06:42:38.570197+0000","last_fullsized":"2023-10-09T06:42:38.570197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:28.626444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.568562+0000","last_change":"2023-10-09T06:42:38.562250+0000","last_active":"2023-10-09T06:42:38.568562+0000","last_peered":"2023-10-09T06:42:38.568562+0000","last_clean":"2023-10-09T06:42:38.568562+0000","last_became_active":"2023-10-09T06:42:38.561988+0000","last_became_peered":"2023-10-09T06:42:38.561988+0000","last_unstale":"2023-10-09T06:42:38.568562+0000","last_undegraded":"2023-10-09T06:42:38.568562+0000","last_fullsized":"2023-10-09T06:42:38.568562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:39.013974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.646183+0000","last_change":"2023-10-09T06:42:37.642781+0000","last_active":"2023-10-09T06:42:38.646183+0000","last_peered":"2023-10-09T06:42:38.646183+0000","last_clean":"2023-10-09T06:42:38.646183+0000","last_became_active":"2023-10-09T06:42:37.642471+0000","last_became_peered":"2023-10-09T06:42:37.642471+0000","last_unstale":"2023-10-09T06:42:38.646183+0000","last_undegraded":"2023-10-09T06:42:38.646183+0000","last_fullsized":"2023-10-09T06:42:38.646183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:05:08.035245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570629+0000","last_change":"2023-10-09T06:42:38.566995+0000","last_active":"2023-10-09T06:42:38.570629+0000","last_peered":"2023-10-09T06:42:38.570629+0000","last_clean":"2023-10-09T06:42:38.570629+0000","last_became_active":"2023-10-09T06:42:38.566465+0000","last_became_peered":"2023-10-09T06:42:38.566465+0000","last_unstale":"2023-10-09T06:42:38.570629+0000","last_undegraded":"2023-10-09T06:42:38.570629+0000","last_fullsized":"2023-10-09T06:42:38.570629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:37:48.391850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.649735+0000","last_change":"2023-10-09T06:42:37.639809+0000","last_active":"2023-10-09T06:42:38.649735+0000","last_peered":"2023-10-09T06:42:38.649735+0000","last_clean":"2023-10-09T06:42:38.649735+0000","last_became_active":"2023-10-09T06:42:37.639544+0000","last_became_peered":"2023-10-09T06:42:37.639544+0000","last_unstale":"2023-10-09T06:42:38.649735+0000","last_undegraded":"2023-10-09T06:42:38.649735+0000","last_fullsized":"2023-10-09T06:42:38.649735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:20:06.272193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.582029+0000","last_change":"2023-10-09T06:42:38.579122+0000","last_active":"2023-10-09T06:42:38.582029+0000","last_peered":"2023-10-09T06:42:38.582029+0000","last_clean":"2023-10-09T06:42:38.582029+0000","last_became_active":"2023-10-09T06:42:38.578579+0000","last_became_peered":"2023-10-09T06:42:38.578579+0000","last_unstale":"2023-10-09T06:42:38.582029+0000","last_undegraded":"2023-10-09T06:42:38.582029+0000","last_fullsized":"2023-10-09T06:42:38.582029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:09.752553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.640061+0000","last_change":"2023-10-09T06:42:37.639115+0000","last_active":"2023-10-09T06:42:38.640061+0000","last_peered":"2023-10-09T06:42:38.640061+0000","last_clean":"2023-10-09T06:42:38.640061+0000","last_became_active":"2023-10-09T06:42:37.638883+0000","last_became_peered":"2023-10-09T06:42:37.638883+0000","last_unstale":"2023-10-09T06:42:38.640061+0000","last_undegraded":"2023-10-09T06:42:38.640061+0000","last_fullsized":"2023-10-09T06:42:38.640061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:00.278956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.576787+0000","last_change":"2023-10-09T06:42:38.556216+0000","last_active":"2023-10-09T06:42:38.576787+0000","last_peered":"2023-10-09T06:42:38.576787+0000","last_clean":"2023-10-09T06:42:38.576787+0000","last_became_active":"2023-10-09T06:42:38.555948+0000","last_became_peered":"2023-10-09T06:42:38.555948+0000","last_unstale":"2023-10-09T06:42:38.576787+0000","last_undegraded":"2023-10-09T06:42:38.576787+0000","last_fullsized":"2023-10-09T06:42:38.576787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:07.557629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.639343+0000","last_change":"2023-10-09T06:42:37.645201+0000","last_active":"2023-10-09T06:42:38.639343+0000","last_peered":"2023-10-09T06:42:38.639343+0000","last_clean":"2023-10-09T06:42:38.639343+0000","last_became_active":"2023-10-09T06:42:37.644809+0000","last_became_peered":"2023-10-09T06:42:37.644809+0000","last_unstale":"2023-10-09T06:42:38.639343+0000","last_undegraded":"2023-10-09T06:42:38.639343+0000","last_fullsized":"2023-10-09T06:42:38.639343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:24.163542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.577053+0000","last_change":"2023-10-09T06:42:38.562628+0000","last_active":"2023-10-09T06:42:38.577053+0000","last_peered":"2023-10-09T06:42:38.577053+0000","last_clean":"2023-10-09T06:42:38.577053+0000","last_became_active":"2023-10-09T06:42:38.559604+0000","last_became_peered":"2023-10-09T06:42:38.559604+0000","last_unstale":"2023-10-09T06:42:38.577053+0000","last_undegraded":"2023-10-09T06:42:38.577053+0000","last_fullsized":"2023-10-09T06:42:38.577053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:37:48.391850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.647992+0000","last_change":"2023-10-09T06:42:37.636915+0000","last_active":"2023-10-09T06:42:38.647992+0000","last_peered":"2023-10-09T06:42:38.647992+0000","last_clean":"2023-10-09T06:42:38.647992+0000","last_became_active":"2023-10-09T06:42:37.635860+0000","last_became_peered":"2023-10-09T06:42:37.635860+0000","last_unstale":"2023-10-09T06:42:38.647992+0000","last_undegraded":"2023-10-09T06:42:38.647992+0000","last_fullsized":"2023-10-09T06:42:38.647992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:37:09.158328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.574981+0000","last_change":"2023-10-09T06:42:38.569866+0000","last_active":"2023-10-09T06:42:38.574981+0000","last_peered":"2023-10-09T06:42:38.574981+0000","last_clean":"2023-10-09T06:42:38.574981+0000","last_became_active":"2023-10-09T06:42:38.569553+0000","last_became_peered":"2023-10-09T06:42:38.569553+0000","last_unstale":"2023-10-09T06:42:38.574981+0000","last_undegraded":"2023-10-09T06:42:38.574981+0000","last_fullsized":"2023-10-09T06:42:38.574981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:21:05.708304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.645604+0000","last_change":"2023-10-09T06:42:37.633709+0000","last_active":"2023-10-09T06:42:38.645604+0000","last_peered":"2023-10-09T06:42:38.645604+0000","last_clean":"2023-10-09T06:42:38.645604+0000","last_became_active":"2023-10-09T06:42:37.633130+0000","last_became_peered":"2023-10-09T06:42:37.633130+0000","last_unstale":"2023-10-09T06:42:38.645604+0000","last_undegraded":"2023-10-09T06:42:38.645604+0000","last_fullsized":"2023-10-09T06:42:38.645604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:37:09.158328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.565018+0000","last_change":"2023-10-09T06:42:38.559125+0000","last_active":"2023-10-09T06:42:38.565018+0000","last_peered":"2023-10-09T06:42:38.565018+0000","last_clean":"2023-10-09T06:42:38.565018+0000","last_became_active":"2023-10-09T06:42:38.558844+0000","last_became_peered":"2023-10-09T06:42:38.558844+0000","last_unstale":"2023-10-09T06:42:38.565018+0000","last_undegraded":"2023-10-09T06:42:38.565018+0000","last_fullsized":"2023-10-09T06:42:38.565018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:12:51.397981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.555859+0000","last_change":"2023-10-09T06:42:37.637810+0000","last_active":"2023-10-09T06:42:38.555859+0000","last_peered":"2023-10-09T06:42:38.555859+0000","last_clean":"2023-10-09T06:42:38.555859+0000","last_became_active":"2023-10-09T06:42:37.637502+0000","last_became_peered":"2023-10-09T06:42:37.637502+0000","last_unstale":"2023-10-09T06:42:38.555859+0000","last_undegraded":"2023-10-09T06:42:38.555859+0000","last_fullsized":"2023-10-09T06:42:38.555859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:35.971277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570842+0000","last_change":"2023-10-09T06:42:38.568118+0000","last_active":"2023-10-09T06:42:38.570842+0000","last_peered":"2023-10-09T06:42:38.570842+0000","last_clean":"2023-10-09T06:42:38.570842+0000","last_became_active":"2023-10-09T06:42:38.567829+0000","last_became_peered":"2023-10-09T06:42:38.567829+0000","last_unstale":"2023-10-09T06:42:38.570842+0000","last_undegraded":"2023-10-09T06:42:38.570842+0000","last_fullsized":"2023-10-09T06:42:38.570842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:40.455468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.550527+0000","last_change":"2023-10-09T06:42:37.630311+0000","last_active":"2023-10-09T06:42:38.550527+0000","last_peered":"2023-10-09T06:42:38.550527+0000","last_clean":"2023-10-09T06:42:38.550527+0000","last_became_active":"2023-10-09T06:42:37.629826+0000","last_became_peered":"2023-10-09T06:42:37.629826+0000","last_unstale":"2023-10-09T06:42:38.550527+0000","last_undegraded":"2023-10-09T06:42:38.550527+0000","last_fullsized":"2023-10-09T06:42:38.550527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:35.971277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570137+0000","last_change":"2023-10-09T06:42:38.564818+0000","last_active":"2023-10-09T06:42:38.570137+0000","last_peered":"2023-10-09T06:42:38.570137+0000","last_clean":"2023-10-09T06:42:38.570137+0000","last_became_active":"2023-10-09T06:42:38.564033+0000","last_became_peered":"2023-10-09T06:42:38.564033+0000","last_unstale":"2023-10-09T06:42:38.570137+0000","last_undegraded":"2023-10-09T06:42:38.570137+0000","last_fullsized":"2023-10-09T06:42:38.570137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:47.620309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.561468+0000","last_change":"2023-10-09T06:42:37.639202+0000","last_active":"2023-10-09T06:42:38.561468+0000","last_peered":"2023-10-09T06:42:38.561468+0000","last_clean":"2023-10-09T06:42:38.561468+0000","last_became_active":"2023-10-09T06:42:37.638949+0000","last_became_peered":"2023-10-09T06:42:37.638949+0000","last_unstale":"2023-10-09T06:42:38.561468+0000","last_undegraded":"2023-10-09T06:42:38.561468+0000","last_fullsized":"2023-10-09T06:42:38.561468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:04:15.833968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578657+0000","last_change":"2023-10-09T06:42:38.576519+0000","last_active":"2023-10-09T06:42:38.578657+0000","last_peered":"2023-10-09T06:42:38.578657+0000","last_clean":"2023-10-09T06:42:38.578657+0000","last_became_active":"2023-10-09T06:42:38.574470+0000","last_became_peered":"2023-10-09T06:42:38.574470+0000","last_unstale":"2023-10-09T06:42:38.578657+0000","last_undegraded":"2023-10-09T06:42:38.578657+0000","last_fullsized":"2023-10-09T06:42:38.578657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:58.690094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.551196+0000","last_change":"2023-10-09T06:42:37.638178+0000","last_active":"2023-10-09T06:42:38.551196+0000","last_peered":"2023-10-09T06:42:38.551196+0000","last_clean":"2023-10-09T06:42:38.551196+0000","last_became_active":"2023-10-09T06:42:37.636993+0000","last_became_peered":"2023-10-09T06:42:37.636993+0000","last_unstale":"2023-10-09T06:42:38.551196+0000","last_undegraded":"2023-10-09T06:42:38.551196+0000","last_fullsized":"2023-10-09T06:42:38.551196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:52.698626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581385+0000","last_change":"2023-10-09T06:42:38.578851+0000","last_active":"2023-10-09T06:42:38.581385+0000","last_peered":"2023-10-09T06:42:38.581385+0000","last_clean":"2023-10-09T06:42:38.581385+0000","last_became_active":"2023-10-09T06:42:38.578545+0000","last_became_peered":"2023-10-09T06:42:38.578545+0000","last_unstale":"2023-10-09T06:42:38.581385+0000","last_undegraded":"2023-10-09T06:42:38.581385+0000","last_fullsized":"2023-10-09T06:42:38.581385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:47.620309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.647140+0000","last_change":"2023-10-09T06:42:37.641427+0000","last_active":"2023-10-09T06:42:38.647140+0000","last_peered":"2023-10-09T06:42:38.647140+0000","last_clean":"2023-10-09T06:42:38.647140+0000","last_became_active":"2023-10-09T06:42:37.640279+0000","last_became_peered":"2023-10-09T06:42:37.640279+0000","last_unstale":"2023-10-09T06:42:38.647140+0000","last_undegraded":"2023-10-09T06:42:38.647140+0000","last_fullsized":"2023-10-09T06:42:38.647140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:24.163542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.569145+0000","last_change":"2023-10-09T06:42:38.567036+0000","last_active":"2023-10-09T06:42:38.569145+0000","last_peered":"2023-10-09T06:42:38.569145+0000","last_clean":"2023-10-09T06:42:38.569145+0000","last_became_active":"2023-10-09T06:42:38.566747+0000","last_became_peered":"2023-10-09T06:42:38.566747+0000","last_unstale":"2023-10-09T06:42:38.569145+0000","last_undegraded":"2023-10-09T06:42:38.569145+0000","last_fullsized":"2023-10-09T06:42:38.569145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:54:35.039738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.650427+0000","last_change":"2023-10-09T06:42:37.640729+0000","last_active":"2023-10-09T06:42:38.650427+0000","last_peered":"2023-10-09T06:42:38.650427+0000","last_clean":"2023-10-09T06:42:38.650427+0000","last_became_active":"2023-10-09T06:42:37.640292+0000","last_became_peered":"2023-10-09T06:42:37.640292+0000","last_unstale":"2023-10-09T06:42:38.650427+0000","last_undegraded":"2023-10-09T06:42:38.650427+0000","last_fullsized":"2023-10-09T06:42:38.650427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:35.971277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.568584+0000","last_change":"2023-10-09T06:42:38.563617+0000","last_active":"2023-10-09T06:42:38.568584+0000","last_peered":"2023-10-09T06:42:38.568584+0000","last_clean":"2023-10-09T06:42:38.568584+0000","last_became_active":"2023-10-09T06:42:38.563354+0000","last_became_peered":"2023-10-09T06:42:38.563354+0000","last_unstale":"2023-10-09T06:42:38.568584+0000","last_undegraded":"2023-10-09T06:42:38.568584+0000","last_fullsized":"2023-10-09T06:42:38.568584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:37:48.391850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.641288+0000","last_change":"2023-10-09T06:42:37.640446+0000","last_active":"2023-10-09T06:42:38.641288+0000","last_peered":"2023-10-09T06:42:38.641288+0000","last_clean":"2023-10-09T06:42:38.641288+0000","last_became_active":"2023-10-09T06:42:37.640147+0000","last_became_peered":"2023-10-09T06:42:37.640147+0000","last_unstale":"2023-10-09T06:42:38.641288+0000","last_undegraded":"2023-10-09T06:42:38.641288+0000","last_fullsized":"2023-10-09T06:42:38.641288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:39.606272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.566333+0000","last_change":"2023-10-09T06:42:38.562201+0000","last_active":"2023-10-09T06:42:38.566333+0000","last_peered":"2023-10-09T06:42:38.566333+0000","last_clean":"2023-10-09T06:42:38.566333+0000","last_became_active":"2023-10-09T06:42:38.561906+0000","last_became_peered":"2023-10-09T06:42:38.561906+0000","last_unstale":"2023-10-09T06:42:38.566333+0000","last_undegraded":"2023-10-09T06:42:38.566333+0000","last_fullsized":"2023-10-09T06:42:38.566333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:33.081210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.554492+0000","last_change":"2023-10-09T06:42:37.633895+0000","last_active":"2023-10-09T06:42:38.554492+0000","last_peered":"2023-10-09T06:42:38.554492+0000","last_clean":"2023-10-09T06:42:38.554492+0000","last_became_active":"2023-10-09T06:42:37.633582+0000","last_became_peered":"2023-10-09T06:42:37.633582+0000","last_unstale":"2023-10-09T06:42:38.554492+0000","last_undegraded":"2023-10-09T06:42:38.554492+0000","last_fullsized":"2023-10-09T06:42:38.554492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:37:09.158328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.577139+0000","last_change":"2023-10-09T06:42:38.574732+0000","last_active":"2023-10-09T06:42:38.577139+0000","last_peered":"2023-10-09T06:42:38.577139+0000","last_clean":"2023-10-09T06:42:38.577139+0000","last_became_active":"2023-10-09T06:42:38.574374+0000","last_became_peered":"2023-10-09T06:42:38.574374+0000","last_unstale":"2023-10-09T06:42:38.577139+0000","last_undegraded":"2023-10-09T06:42:38.577139+0000","last_fullsized":"2023-10-09T06:42:38.577139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:58.690094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.561313+0000","last_change":"2023-10-09T06:42:37.634258+0000","last_active":"2023-10-09T06:42:38.561313+0000","last_peered":"2023-10-09T06:42:38.561313+0000","last_clean":"2023-10-09T06:42:38.561313+0000","last_became_active":"2023-10-09T06:42:37.633958+0000","last_became_peered":"2023-10-09T06:42:37.633958+0000","last_unstale":"2023-10-09T06:42:38.561313+0000","last_undegraded":"2023-10-09T06:42:38.561313+0000","last_fullsized":"2023-10-09T06:42:38.561313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:52.698626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.566266+0000","last_change":"2023-10-09T06:42:38.564382+0000","last_active":"2023-10-09T06:42:38.566266+0000","last_peered":"2023-10-09T06:42:38.566266+0000","last_clean":"2023-10-09T06:42:38.566266+0000","last_became_active":"2023-10-09T06:42:38.563827+0000","last_became_peered":"2023-10-09T06:42:38.563827+0000","last_unstale":"2023-10-09T06:42:38.566266+0000","last_undegraded":"2023-10-09T06:42:38.566266+0000","last_fullsized":"2023-10-09T06:42:38.566266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:35:09.230725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.644393+0000","last_change":"2023-10-09T06:42:37.636395+0000","last_active":"2023-10-09T06:42:38.644393+0000","last_peered":"2023-10-09T06:42:38.644393+0000","last_clean":"2023-10-09T06:42:38.644393+0000","last_became_active":"2023-10-09T06:42:37.636040+0000","last_became_peered":"2023-10-09T06:42:37.636040+0000","last_unstale":"2023-10-09T06:42:38.644393+0000","last_undegraded":"2023-10-09T06:42:38.644393+0000","last_fullsized":"2023-10-09T06:42:38.644393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:04:15.833968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.575637+0000","last_change":"2023-10-09T06:42:38.570513+0000","last_active":"2023-10-09T06:42:38.575637+0000","last_peered":"2023-10-09T06:42:38.575637+0000","last_clean":"2023-10-09T06:42:38.575637+0000","last_became_active":"2023-10-09T06:42:38.570219+0000","last_became_peered":"2023-10-09T06:42:38.570219+0000","last_unstale":"2023-10-09T06:42:38.575637+0000","last_undegraded":"2023-10-09T06:42:38.575637+0000","last_fullsized":"2023-10-09T06:42:38.575637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:28:50.048850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.641339+0000","last_change":"2023-10-09T06:42:37.638988+0000","last_active":"2023-10-09T06:42:38.641339+0000","last_peered":"2023-10-09T06:42:38.641339+0000","last_clean":"2023-10-09T06:42:38.641339+0000","last_became_active":"2023-10-09T06:42:37.638699+0000","last_became_peered":"2023-10-09T06:42:37.638699+0000","last_unstale":"2023-10-09T06:42:38.641339+0000","last_undegraded":"2023-10-09T06:42:38.641339+0000","last_fullsized":"2023-10-09T06:42:38.641339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:20:06.272193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.575426+0000","last_change":"2023-10-09T06:42:38.569837+0000","last_active":"2023-10-09T06:42:38.575426+0000","last_peered":"2023-10-09T06:42:38.575426+0000","last_clean":"2023-10-09T06:42:38.575426+0000","last_became_active":"2023-10-09T06:42:38.569508+0000","last_became_peered":"2023-10-09T06:42:38.569508+0000","last_unstale":"2023-10-09T06:42:38.575426+0000","last_undegraded":"2023-10-09T06:42:38.575426+0000","last_fullsized":"2023-10-09T06:42:38.575426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:40.455468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.556115+0000","last_change":"2023-10-09T06:42:37.641808+0000","last_active":"2023-10-09T06:42:38.556115+0000","last_peered":"2023-10-09T06:42:38.556115+0000","last_clean":"2023-10-09T06:42:38.556115+0000","last_became_active":"2023-10-09T06:42:37.641389+0000","last_became_peered":"2023-10-09T06:42:37.641389+0000","last_unstale":"2023-10-09T06:42:38.556115+0000","last_undegraded":"2023-10-09T06:42:38.556115+0000","last_fullsized":"2023-10-09T06:42:38.556115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:52.698626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578832+0000","last_change":"2023-10-09T06:42:38.568966+0000","last_active":"2023-10-09T06:42:38.578832+0000","last_peered":"2023-10-09T06:42:38.578832+0000","last_clean":"2023-10-09T06:42:38.578832+0000","last_became_active":"2023-10-09T06:42:38.564917+0000","last_became_peered":"2023-10-09T06:42:38.564917+0000","last_unstale":"2023-10-09T06:42:38.578832+0000","last_undegraded":"2023-10-09T06:42:38.578832+0000","last_fullsized":"2023-10-09T06:42:38.578832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:13.371246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.554558+0000","last_change":"2023-10-09T06:42:37.635676+0000","last_active":"2023-10-09T06:42:38.554558+0000","last_peered":"2023-10-09T06:42:38.554558+0000","last_clean":"2023-10-09T06:42:38.554558+0000","last_became_active":"2023-10-09T06:42:37.635365+0000","last_became_peered":"2023-10-09T06:42:37.635365+0000","last_unstale":"2023-10-09T06:42:38.554558+0000","last_undegraded":"2023-10-09T06:42:38.554558+0000","last_fullsized":"2023-10-09T06:42:38.554558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:04:15.833968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.565166+0000","last_change":"2023-10-09T06:42:38.557514+0000","last_active":"2023-10-09T06:42:38.565166+0000","last_peered":"2023-10-09T06:42:38.565166+0000","last_clean":"2023-10-09T06:42:38.565166+0000","last_became_active":"2023-10-09T06:42:38.557194+0000","last_became_peered":"2023-10-09T06:42:38.557194+0000","last_unstale":"2023-10-09T06:42:38.565166+0000","last_undegraded":"2023-10-09T06:42:38.565166+0000","last_fullsized":"2023-10-09T06:42:38.565166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:52.216260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.569358+0000","last_change":"2023-10-09T06:42:38.562852+0000","last_active":"2023-10-09T06:42:38.569358+0000","last_peered":"2023-10-09T06:42:38.569358+0000","last_clean":"2023-10-09T06:42:38.569358+0000","last_became_active":"2023-10-09T06:42:38.562427+0000","last_became_peered":"2023-10-09T06:42:38.562427+0000","last_unstale":"2023-10-09T06:42:38.569358+0000","last_undegraded":"2023-10-09T06:42:38.569358+0000","last_fullsized":"2023-10-09T06:42:38.569358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:54:31.244116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.555131+0000","last_change":"2023-10-09T06:42:37.629265+0000","last_active":"2023-10-09T06:42:38.555131+0000","last_peered":"2023-10-09T06:42:38.555131+0000","last_clean":"2023-10-09T06:42:38.555131+0000","last_became_active":"2023-10-09T06:42:37.628888+0000","last_became_peered":"2023-10-09T06:42:37.628888+0000","last_unstale":"2023-10-09T06:42:38.555131+0000","last_undegraded":"2023-10-09T06:42:38.555131+0000","last_fullsized":"2023-10-09T06:42:38.555131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:37:09.158328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581871+0000","last_change":"2023-10-09T06:42:38.578592+0000","last_active":"2023-10-09T06:42:38.581871+0000","last_peered":"2023-10-09T06:42:38.581871+0000","last_clean":"2023-10-09T06:42:38.581871+0000","last_became_active":"2023-10-09T06:42:38.578331+0000","last_became_peered":"2023-10-09T06:42:38.578331+0000","last_unstale":"2023-10-09T06:42:38.581871+0000","last_undegraded":"2023-10-09T06:42:38.581871+0000","last_fullsized":"2023-10-09T06:42:38.581871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:10.767555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.549764+0000","last_change":"2023-10-09T06:42:37.631298+0000","last_active":"2023-10-09T06:42:38.549764+0000","last_peered":"2023-10-09T06:42:38.549764+0000","last_clean":"2023-10-09T06:42:38.549764+0000","last_became_active":"2023-10-09T06:42:37.631005+0000","last_became_peered":"2023-10-09T06:42:37.631005+0000","last_unstale":"2023-10-09T06:42:38.549764+0000","last_undegraded":"2023-10-09T06:42:38.549764+0000","last_fullsized":"2023-10-09T06:42:38.549764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:24.163542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.556307+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:42:38.556307+0000","last_peered":"2023-10-09T06:42:38.556307+0000","last_clean":"2023-10-09T06:42:38.556307+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:42:38.556307+0000","last_undegraded":"2023-10-09T06:42:38.556307+0000","last_fullsized":"2023-10-09T06:42:38.556307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.564781+0000","last_change":"2023-10-09T06:42:38.559755+0000","last_active":"2023-10-09T06:42:38.564781+0000","last_peered":"2023-10-09T06:42:38.564781+0000","last_clean":"2023-10-09T06:42:38.564781+0000","last_became_active":"2023-10-09T06:42:38.559505+0000","last_became_peered":"2023-10-09T06:42:38.559505+0000","last_unstale":"2023-10-09T06:42:38.564781+0000","last_undegraded":"2023-10-09T06:42:38.564781+0000","last_fullsized":"2023-10-09T06:42:38.564781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:49:10.861117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.556416+0000","last_change":"2023-10-09T06:42:37.643040+0000","last_active":"2023-10-09T06:42:38.556416+0000","last_peered":"2023-10-09T06:42:38.556416+0000","last_clean":"2023-10-09T06:42:38.556416+0000","last_became_active":"2023-10-09T06:42:37.642814+0000","last_became_peered":"2023-10-09T06:42:37.642814+0000","last_unstale":"2023-10-09T06:42:38.556416+0000","last_undegraded":"2023-10-09T06:42:38.556416+0000","last_fullsized":"2023-10-09T06:42:38.556416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:20:06.272193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.557248+0000","last_change":"2023-10-09T06:42:37.642142+0000","last_active":"2023-10-09T06:42:38.557248+0000","last_peered":"2023-10-09T06:42:38.557248+0000","last_clean":"2023-10-09T06:42:38.557248+0000","last_became_active":"2023-10-09T06:42:37.641797+0000","last_became_peered":"2023-10-09T06:42:37.641797+0000","last_unstale":"2023-10-09T06:42:38.557248+0000","last_undegraded":"2023-10-09T06:42:38.557248+0000","last_fullsized":"2023-10-09T06:42:38.557248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:54:34.033416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570074+0000","last_change":"2023-10-09T06:42:38.563528+0000","last_active":"2023-10-09T06:42:38.570074+0000","last_peered":"2023-10-09T06:42:38.570074+0000","last_clean":"2023-10-09T06:42:38.570074+0000","last_became_active":"2023-10-09T06:42:38.563121+0000","last_became_peered":"2023-10-09T06:42:38.563121+0000","last_unstale":"2023-10-09T06:42:38.570074+0000","last_undegraded":"2023-10-09T06:42:38.570074+0000","last_fullsized":"2023-10-09T06:42:38.570074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:13.371246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.556624+0000","last_change":"2023-10-09T06:42:37.641729+0000","last_active":"2023-10-09T06:42:38.556624+0000","last_peered":"2023-10-09T06:42:38.556624+0000","last_clean":"2023-10-09T06:42:38.556624+0000","last_became_active":"2023-10-09T06:42:37.641401+0000","last_became_peered":"2023-10-09T06:42:37.641401+0000","last_unstale":"2023-10-09T06:42:38.556624+0000","last_undegraded":"2023-10-09T06:42:38.556624+0000","last_fullsized":"2023-10-09T06:42:38.556624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:00.278956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.572665+0000","last_change":"2023-10-09T06:42:38.569525+0000","last_active":"2023-10-09T06:42:38.572665+0000","last_peered":"2023-10-09T06:42:38.572665+0000","last_clean":"2023-10-09T06:42:38.572665+0000","last_became_active":"2023-10-09T06:42:38.569071+0000","last_became_peered":"2023-10-09T06:42:38.569071+0000","last_unstale":"2023-10-09T06:42:38.572665+0000","last_undegraded":"2023-10-09T06:42:38.572665+0000","last_fullsized":"2023-10-09T06:42:38.572665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:13.371246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.640292+0000","last_change":"2023-10-09T06:42:37.637774+0000","last_active":"2023-10-09T06:42:38.640292+0000","last_peered":"2023-10-09T06:42:38.640292+0000","last_clean":"2023-10-09T06:42:38.640292+0000","last_became_active":"2023-10-09T06:42:37.637478+0000","last_became_peered":"2023-10-09T06:42:37.637478+0000","last_unstale":"2023-10-09T06:42:38.640292+0000","last_undegraded":"2023-10-09T06:42:38.640292+0000","last_fullsized":"2023-10-09T06:42:38.640292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:24.163542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.564966+0000","last_change":"2023-10-09T06:42:38.562018+0000","last_active":"2023-10-09T06:42:38.564966+0000","last_peered":"2023-10-09T06:42:38.564966+0000","last_clean":"2023-10-09T06:42:38.564966+0000","last_became_active":"2023-10-09T06:42:38.561717+0000","last_became_peered":"2023-10-09T06:42:38.561717+0000","last_unstale":"2023-10-09T06:42:38.564966+0000","last_undegraded":"2023-10-09T06:42:38.564966+0000","last_fullsized":"2023-10-09T06:42:38.564966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:28.626444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.556201+0000","last_change":"2023-10-09T06:42:37.642616+0000","last_active":"2023-10-09T06:42:38.556201+0000","last_peered":"2023-10-09T06:42:38.556201+0000","last_clean":"2023-10-09T06:42:38.556201+0000","last_became_active":"2023-10-09T06:42:37.641865+0000","last_became_peered":"2023-10-09T06:42:37.641865+0000","last_unstale":"2023-10-09T06:42:38.556201+0000","last_undegraded":"2023-10-09T06:42:38.556201+0000","last_fullsized":"2023-10-09T06:42:38.556201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:10.432797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.566828+0000","last_change":"2023-10-09T06:42:38.564540+0000","last_active":"2023-10-09T06:42:38.566828+0000","last_peered":"2023-10-09T06:42:38.566828+0000","last_clean":"2023-10-09T06:42:38.566828+0000","last_became_active":"2023-10-09T06:42:38.564273+0000","last_became_peered":"2023-10-09T06:42:38.564273+0000","last_unstale":"2023-10-09T06:42:38.566828+0000","last_undegraded":"2023-10-09T06:42:38.566828+0000","last_fullsized":"2023-10-09T06:42:38.566828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:01.285278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.556077+0000","last_change":"2023-10-09T06:42:37.635028+0000","last_active":"2023-10-09T06:42:38.556077+0000","last_peered":"2023-10-09T06:42:38.556077+0000","last_clean":"2023-10-09T06:42:38.556077+0000","last_became_active":"2023-10-09T06:42:37.634697+0000","last_became_peered":"2023-10-09T06:42:37.634697+0000","last_unstale":"2023-10-09T06:42:38.556077+0000","last_undegraded":"2023-10-09T06:42:38.556077+0000","last_fullsized":"2023-10-09T06:42:38.556077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:35.971277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.569616+0000","last_change":"2023-10-09T06:42:38.563391+0000","last_active":"2023-10-09T06:42:38.569616+0000","last_peered":"2023-10-09T06:42:38.569616+0000","last_clean":"2023-10-09T06:42:38.569616+0000","last_became_active":"2023-10-09T06:42:38.563055+0000","last_became_peered":"2023-10-09T06:42:38.563055+0000","last_unstale":"2023-10-09T06:42:38.569616+0000","last_undegraded":"2023-10-09T06:42:38.569616+0000","last_fullsized":"2023-10-09T06:42:38.569616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:09.752553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.561304+0000","last_change":"2023-10-09T06:42:37.635284+0000","last_active":"2023-10-09T06:42:38.561304+0000","last_peered":"2023-10-09T06:42:38.561304+0000","last_clean":"2023-10-09T06:42:38.561304+0000","last_became_active":"2023-10-09T06:42:37.633661+0000","last_became_peered":"2023-10-09T06:42:37.633661+0000","last_unstale":"2023-10-09T06:42:38.561304+0000","last_undegraded":"2023-10-09T06:42:38.561304+0000","last_fullsized":"2023-10-09T06:42:38.561304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:04:15.833968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570875+0000","last_change":"2023-10-09T06:42:38.568141+0000","last_active":"2023-10-09T06:42:38.570875+0000","last_peered":"2023-10-09T06:42:38.570875+0000","last_clean":"2023-10-09T06:42:38.570875+0000","last_became_active":"2023-10-09T06:42:38.567842+0000","last_became_peered":"2023-10-09T06:42:38.567842+0000","last_unstale":"2023-10-09T06:42:38.570875+0000","last_undegraded":"2023-10-09T06:42:38.570875+0000","last_fullsized":"2023-10-09T06:42:38.570875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:28:50.048850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.640654+0000","last_change":"2023-10-09T06:42:37.642378+0000","last_active":"2023-10-09T06:42:38.640654+0000","last_peered":"2023-10-09T06:42:38.640654+0000","last_clean":"2023-10-09T06:42:38.640654+0000","last_became_active":"2023-10-09T06:42:37.641825+0000","last_became_peered":"2023-10-09T06:42:37.641825+0000","last_unstale":"2023-10-09T06:42:38.640654+0000","last_undegraded":"2023-10-09T06:42:38.640654+0000","last_fullsized":"2023-10-09T06:42:38.640654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:04:15.833968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.571061+0000","last_change":"2023-10-09T06:42:38.569442+0000","last_active":"2023-10-09T06:42:38.571061+0000","last_peered":"2023-10-09T06:42:38.571061+0000","last_clean":"2023-10-09T06:42:38.571061+0000","last_became_active":"2023-10-09T06:42:38.569154+0000","last_became_peered":"2023-10-09T06:42:38.569154+0000","last_unstale":"2023-10-09T06:42:38.571061+0000","last_undegraded":"2023-10-09T06:42:38.571061+0000","last_fullsized":"2023-10-09T06:42:38.571061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:13.371246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.554960+0000","last_change":"2023-10-09T06:42:37.631048+0000","last_active":"2023-10-09T06:42:38.554960+0000","last_peered":"2023-10-09T06:42:38.554960+0000","last_clean":"2023-10-09T06:42:38.554960+0000","last_became_active":"2023-10-09T06:42:37.630750+0000","last_became_peered":"2023-10-09T06:42:37.630750+0000","last_unstale":"2023-10-09T06:42:38.554960+0000","last_undegraded":"2023-10-09T06:42:38.554960+0000","last_fullsized":"2023-10-09T06:42:38.554960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:35.971277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581777+0000","last_change":"2023-10-09T06:42:38.578335+0000","last_active":"2023-10-09T06:42:38.581777+0000","last_peered":"2023-10-09T06:42:38.581777+0000","last_clean":"2023-10-09T06:42:38.581777+0000","last_became_active":"2023-10-09T06:42:38.578028+0000","last_became_peered":"2023-10-09T06:42:38.578028+0000","last_unstale":"2023-10-09T06:42:38.581777+0000","last_undegraded":"2023-10-09T06:42:38.581777+0000","last_fullsized":"2023-10-09T06:42:38.581777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:21.009791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.647078+0000","last_change":"2023-10-09T06:42:37.634742+0000","last_active":"2023-10-09T06:42:38.647078+0000","last_peered":"2023-10-09T06:42:38.647078+0000","last_clean":"2023-10-09T06:42:38.647078+0000","last_became_active":"2023-10-09T06:42:37.633877+0000","last_became_peered":"2023-10-09T06:42:37.633877+0000","last_unstale":"2023-10-09T06:42:38.647078+0000","last_undegraded":"2023-10-09T06:42:38.647078+0000","last_fullsized":"2023-10-09T06:42:38.647078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:10.432797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.577301+0000","last_change":"2023-10-09T06:42:38.563710+0000","last_active":"2023-10-09T06:42:38.577301+0000","last_peered":"2023-10-09T06:42:38.577301+0000","last_clean":"2023-10-09T06:42:38.577301+0000","last_became_active":"2023-10-09T06:42:38.563052+0000","last_became_peered":"2023-10-09T06:42:38.563052+0000","last_unstale":"2023-10-09T06:42:38.577301+0000","last_undegraded":"2023-10-09T06:42:38.577301+0000","last_fullsized":"2023-10-09T06:42:38.577301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:21.009791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.642089+0000","last_change":"2023-10-09T06:42:37.629716+0000","last_active":"2023-10-09T06:42:38.642089+0000","last_peered":"2023-10-09T06:42:38.642089+0000","last_clean":"2023-10-09T06:42:38.642089+0000","last_became_active":"2023-10-09T06:42:37.629416+0000","last_became_peered":"2023-10-09T06:42:37.629416+0000","last_unstale":"2023-10-09T06:42:38.642089+0000","last_undegraded":"2023-10-09T06:42:38.642089+0000","last_fullsized":"2023-10-09T06:42:38.642089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:52.698626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.576962+0000","last_change":"2023-10-09T06:42:38.571766+0000","last_active":"2023-10-09T06:42:38.576962+0000","last_peered":"2023-10-09T06:42:38.576962+0000","last_clean":"2023-10-09T06:42:38.576962+0000","last_became_active":"2023-10-09T06:42:38.571419+0000","last_became_peered":"2023-10-09T06:42:38.571419+0000","last_unstale":"2023-10-09T06:42:38.576962+0000","last_undegraded":"2023-10-09T06:42:38.576962+0000","last_fullsized":"2023-10-09T06:42:38.576962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:44:36.008678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.566289+0000","last_change":"2023-10-09T06:42:38.564609+0000","last_active":"2023-10-09T06:42:38.566289+0000","last_peered":"2023-10-09T06:42:38.566289+0000","last_clean":"2023-10-09T06:42:38.566289+0000","last_became_active":"2023-10-09T06:42:38.564121+0000","last_became_peered":"2023-10-09T06:42:38.564121+0000","last_unstale":"2023-10-09T06:42:38.566289+0000","last_undegraded":"2023-10-09T06:42:38.566289+0000","last_fullsized":"2023-10-09T06:42:38.566289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:10.767555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581375+0000","last_change":"2023-10-09T06:42:38.577925+0000","last_active":"2023-10-09T06:42:38.581375+0000","last_peered":"2023-10-09T06:42:38.581375+0000","last_clean":"2023-10-09T06:42:38.581375+0000","last_became_active":"2023-10-09T06:42:38.577659+0000","last_became_peered":"2023-10-09T06:42:38.577659+0000","last_unstale":"2023-10-09T06:42:38.581375+0000","last_undegraded":"2023-10-09T06:42:38.581375+0000","last_fullsized":"2023-10-09T06:42:38.581375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:21:05.708304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578759+0000","last_change":"2023-10-09T06:42:38.571770+0000","last_active":"2023-10-09T06:42:38.578759+0000","last_peered":"2023-10-09T06:42:38.578759+0000","last_clean":"2023-10-09T06:42:38.578759+0000","last_became_active":"2023-10-09T06:42:38.571510+0000","last_became_peered":"2023-10-09T06:42:38.571510+0000","last_unstale":"2023-10-09T06:42:38.578759+0000","last_undegraded":"2023-10-09T06:42:38.578759+0000","last_fullsized":"2023-10-09T06:42:38.578759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:28:50.048850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.567198+0000","last_change":"2023-10-09T06:42:38.564945+0000","last_active":"2023-10-09T06:42:38.567198+0000","last_peered":"2023-10-09T06:42:38.567198+0000","last_clean":"2023-10-09T06:42:38.567198+0000","last_became_active":"2023-10-09T06:42:38.564686+0000","last_became_peered":"2023-10-09T06:42:38.564686+0000","last_unstale":"2023-10-09T06:42:38.567198+0000","last_undegraded":"2023-10-09T06:42:38.567198+0000","last_fullsized":"2023-10-09T06:42:38.567198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:10.767555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570888+0000","last_change":"2023-10-09T06:42:38.569388+0000","last_active":"2023-10-09T06:42:38.570888+0000","last_peered":"2023-10-09T06:42:38.570888+0000","last_clean":"2023-10-09T06:42:38.570888+0000","last_became_active":"2023-10-09T06:42:38.568559+0000","last_became_peered":"2023-10-09T06:42:38.568559+0000","last_unstale":"2023-10-09T06:42:38.570888+0000","last_undegraded":"2023-10-09T06:42:38.570888+0000","last_fullsized":"2023-10-09T06:42:38.570888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:07.557629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570179+0000","last_change":"2023-10-09T06:42:38.565348+0000","last_active":"2023-10-09T06:42:38.570179+0000","last_peered":"2023-10-09T06:42:38.570179+0000","last_clean":"2023-10-09T06:42:38.570179+0000","last_became_active":"2023-10-09T06:42:38.564447+0000","last_became_peered":"2023-10-09T06:42:38.564447+0000","last_unstale":"2023-10-09T06:42:38.570179+0000","last_undegraded":"2023-10-09T06:42:38.570179+0000","last_fullsized":"2023-10-09T06:42:38.570179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:12:51.397981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.575872+0000","last_change":"2023-10-09T06:42:38.573595+0000","last_active":"2023-10-09T06:42:38.575872+0000","last_peered":"2023-10-09T06:42:38.575872+0000","last_clean":"2023-10-09T06:42:38.575872+0000","last_became_active":"2023-10-09T06:42:38.573337+0000","last_became_peered":"2023-10-09T06:42:38.573337+0000","last_unstale":"2023-10-09T06:42:38.575872+0000","last_undegraded":"2023-10-09T06:42:38.575872+0000","last_fullsized":"2023-10-09T06:42:38.575872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:47.620309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570836+0000","last_change":"2023-10-09T06:42:38.569014+0000","last_active":"2023-10-09T06:42:38.570836+0000","last_peered":"2023-10-09T06:42:38.570836+0000","last_clean":"2023-10-09T06:42:38.570836+0000","last_became_active":"2023-10-09T06:42:38.568745+0000","last_became_peered":"2023-10-09T06:42:38.568745+0000","last_unstale":"2023-10-09T06:42:38.570836+0000","last_undegraded":"2023-10-09T06:42:38.570836+0000","last_fullsized":"2023-10-09T06:42:38.570836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:47.620309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578772+0000","last_change":"2023-10-09T06:42:38.569326+0000","last_active":"2023-10-09T06:42:38.578772+0000","last_peered":"2023-10-09T06:42:38.578772+0000","last_clean":"2023-10-09T06:42:38.578772+0000","last_became_active":"2023-10-09T06:42:38.569071+0000","last_became_peered":"2023-10-09T06:42:38.569071+0000","last_unstale":"2023-10-09T06:42:38.578772+0000","last_undegraded":"2023-10-09T06:42:38.578772+0000","last_fullsized":"2023-10-09T06:42:38.578772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:44:36.008678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.572639+0000","last_change":"2023-10-09T06:42:38.569598+0000","last_active":"2023-10-09T06:42:38.572639+0000","last_peered":"2023-10-09T06:42:38.572639+0000","last_clean":"2023-10-09T06:42:38.572639+0000","last_became_active":"2023-10-09T06:42:38.569008+0000","last_became_peered":"2023-10-09T06:42:38.569008+0000","last_unstale":"2023-10-09T06:42:38.572639+0000","last_undegraded":"2023-10-09T06:42:38.572639+0000","last_fullsized":"2023-10-09T06:42:38.572639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:33.081210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578740+0000","last_change":"2023-10-09T06:42:38.569703+0000","last_active":"2023-10-09T06:42:38.578740+0000","last_peered":"2023-10-09T06:42:38.578740+0000","last_clean":"2023-10-09T06:42:38.578740+0000","last_became_active":"2023-10-09T06:42:38.565385+0000","last_became_peered":"2023-10-09T06:42:38.565385+0000","last_unstale":"2023-10-09T06:42:38.578740+0000","last_undegraded":"2023-10-09T06:42:38.578740+0000","last_fullsized":"2023-10-09T06:42:38.578740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:33.081210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.575964+0000","last_change":"2023-10-09T06:42:38.572735+0000","last_active":"2023-10-09T06:42:38.575964+0000","last_peered":"2023-10-09T06:42:38.575964+0000","last_clean":"2023-10-09T06:42:38.575964+0000","last_became_active":"2023-10-09T06:42:38.572479+0000","last_became_peered":"2023-10-09T06:42:38.572479+0000","last_unstale":"2023-10-09T06:42:38.575964+0000","last_undegraded":"2023-10-09T06:42:38.575964+0000","last_fullsized":"2023-10-09T06:42:38.575964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:13.371246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.571301+0000","last_change":"2023-10-09T06:42:38.569452+0000","last_active":"2023-10-09T06:42:38.571301+0000","last_peered":"2023-10-09T06:42:38.571301+0000","last_clean":"2023-10-09T06:42:38.571301+0000","last_became_active":"2023-10-09T06:42:38.569167+0000","last_became_peered":"2023-10-09T06:42:38.569167+0000","last_unstale":"2023-10-09T06:42:38.571301+0000","last_undegraded":"2023-10-09T06:42:38.571301+0000","last_fullsized":"2023-10-09T06:42:38.571301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:33.081210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":661576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9490000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.617}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.052}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.5800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.125}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1929999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0250000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":811008,"data_stored":661632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":192512,"data_stored":64366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:42:42.947 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:42:43.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.157+0000 7f19209ff700 1 Processor -- start 2023-10-09T06:42:43.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.157+0000 7f19209ff700 1 -- start start 2023-10-09T06:42:43.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.158+0000 7f19209ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f191c0b1c20 0x7f191c1572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:43.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.158+0000 7f19209ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f191c157c60 con 0x7f191c157820 2023-10-09T06:42:43.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.158+0000 7f19209ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f191c0cb300 con 0x7f191c0b1850 2023-10-09T06:42:43.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.158+0000 7f19209ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f191c06fc30 con 0x7f191c0b1c20 2023-10-09T06:42:43.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.159+0000 7f191ad9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f191c157820 0x7f191c0abf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56616/0 (socket says 172.21.15.71:56616) 2023-10-09T06:42:43.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.159+0000 7f191ad9d700 1 -- 172.21.15.71:0/2413263391 learned_addr learned my addr 172.21.15.71:0/2413263391 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:43.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.159+0000 7f1919d9b700 1 --2- 172.21.15.71:0/2413263391 >> v2:172.21.15.179:3300/0 conn(0x7f191c0b1c20 0x7f191c1572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:43.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.159+0000 7f191959a700 1 -- 172.21.15.71:0/2413263391 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970405200 0 0) 0x7f191c157c60 con 0x7f191c157820 2023-10-09T06:42:43.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.159+0000 7f191959a700 1 -- 172.21.15.71:0/2413263391 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1904003570 con 0x7f191c157820 2023-10-09T06:42:43.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.159+0000 7f1919d9b700 1 -- 172.21.15.71:0/2413263391 >> v1:172.21.15.179:6789/0 conn(0x7f191c0b1850 legacy=0x7f191c0ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:43.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.159+0000 7f1919d9b700 1 -- 172.21.15.71:0/2413263391 >> v1:172.21.15.71:6789/0 conn(0x7f191c157820 legacy=0x7f191c0abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:43.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.159+0000 7f1919d9b700 1 -- 172.21.15.71:0/2413263391 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191c0cb5e0 con 0x7f191c0b1c20 2023-10-09T06:42:43.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.159+0000 7f1919d9b700 1 --2- 172.21.15.71:0/2413263391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f191c0b1c20 0x7f191c1572e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f19100098e0 tx=0x7f19100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cbb7f85407592cf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:43.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.160+0000 7f191959a700 1 -- 172.21.15.71:0/2413263391 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191000b640 con 0x7f191c0b1c20 2023-10-09T06:42:43.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.160+0000 7f191959a700 1 -- 172.21.15.71:0/2413263391 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191000b7a0 con 0x7f191c0b1c20 2023-10-09T06:42:43.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.160+0000 7f191959a700 1 -- 172.21.15.71:0/2413263391 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191000bb40 con 0x7f191c0b1c20 2023-10-09T06:42:43.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.160+0000 7f19209ff700 1 -- 172.21.15.71:0/2413263391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f191c0b1c20 msgr2=0x7f191c1572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:43.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.160+0000 7f19209ff700 1 --2- 172.21.15.71:0/2413263391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f191c0b1c20 0x7f191c1572e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f19100098e0 tx=0x7f19100091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:43.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.160+0000 7f19209ff700 1 -- 172.21.15.71:0/2413263391 shutdown_connections 2023-10-09T06:42:43.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.160+0000 7f19209ff700 1 --2- 172.21.15.71:0/2413263391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f191c0b1c20 0x7f191c1572e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:43.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.160+0000 7f19209ff700 1 -- 172.21.15.71:0/2413263391 >> 172.21.15.71:0/2413263391 conn(0x7f191c06a320 msgr2=0x7f191c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:43.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.160+0000 7f19209ff700 1 -- 172.21.15.71:0/2413263391 shutdown_connections 2023-10-09T06:42:43.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.160+0000 7f19209ff700 1 -- 172.21.15.71:0/2413263391 wait complete. 2023-10-09T06:42:43.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.162+0000 7f19209ff700 1 Processor -- start 2023-10-09T06:42:43.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.162+0000 7f19209ff700 1 -- start start 2023-10-09T06:42:43.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.163+0000 7f19209ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f191c0b1850 0x7f191c1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:43.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.163+0000 7f19209ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f191c0b1c20 0x7f191c0a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:43.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.163+0000 7f19209ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f191c157820 0x7f191c16a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:43.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.163+0000 7f19209ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191c0cc260 con 0x7f191c0b1c20 2023-10-09T06:42:43.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.163+0000 7f19209ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191c0a9b00 con 0x7f191c157820 2023-10-09T06:42:43.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.163+0000 7f19209ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191c16d530 con 0x7f191c0b1850 2023-10-09T06:42:43.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.163+0000 7f1919d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f191c0b1c20 0x7f191c0a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:43.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.163+0000 7f1919d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f191c0b1c20 0x7f191c0a90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44128/0 (socket says 172.21.15.71:44128) 2023-10-09T06:42:43.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.163+0000 7f1919d9b700 1 -- 172.21.15.71:0/2996684035 learned_addr learned my addr 172.21.15.71:0/2996684035 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:43.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.163+0000 7f191ad9d700 1 --2- 172.21.15.71:0/2996684035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f191c157820 0x7f191c16a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:43.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.163+0000 7f191a59c700 1 --2- 172.21.15.71:0/2996684035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f191c0b1850 0x7f191c1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:43.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.163+0000 7f1919d9b700 1 -- 172.21.15.71:0/2996684035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f191c0b1850 msgr2=0x7f191c1555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:43.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.163+0000 7f1919d9b700 1 --2- 172.21.15.71:0/2996684035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f191c0b1850 0x7f191c1555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:43.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.163+0000 7f1919d9b700 1 -- 172.21.15.71:0/2996684035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f191c157820 msgr2=0x7f191c16a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:43.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.163+0000 7f1919d9b700 1 --2- 172.21.15.71:0/2996684035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f191c157820 0x7f191c16a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:43.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.163+0000 7f1919d9b700 1 -- 172.21.15.71:0/2996684035 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1910009420 con 0x7f191c0b1c20 2023-10-09T06:42:43.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.164+0000 7f1919d9b700 1 --2- 172.21.15.71:0/2996684035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f191c0b1c20 0x7f191c0a90f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f191c064290 tx=0x7f1910017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:43.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.164+0000 7f190a7fc700 1 -- 172.21.15.71:0/2996684035 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191000bb20 con 0x7f191c0b1c20 2023-10-09T06:42:43.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.164+0000 7f190a7fc700 1 -- 172.21.15.71:0/2996684035 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1910011420 con 0x7f191c0b1c20 2023-10-09T06:42:43.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.164+0000 7f19209ff700 1 -- 172.21.15.71:0/2996684035 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f191c16d810 con 0x7f191c0b1c20 2023-10-09T06:42:43.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.164+0000 7f190a7fc700 1 -- 172.21.15.71:0/2996684035 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19100117c0 con 0x7f191c0b1c20 2023-10-09T06:42:43.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.164+0000 7f19209ff700 1 -- 172.21.15.71:0/2996684035 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191c155af0 con 0x7f191c0b1c20 2023-10-09T06:42:43.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.165+0000 7f19209ff700 1 -- 172.21.15.71:0/2996684035 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f191c16da20 con 0x7f191c0b1c20 2023-10-09T06:42:43.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.166+0000 7f190a7fc700 1 -- 172.21.15.71:0/2996684035 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1910011b70 con 0x7f191c0b1c20 2023-10-09T06:42:43.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.167+0000 7f190a7fc700 1 --2- 172.21.15.71:0/2996684035 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f18fc066f30 0x7f18fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:43.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.167+0000 7f190a7fc700 1 -- 172.21.15.71:0/2996684035 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1910085c60 con 0x7f191c0b1c20 2023-10-09T06:42:43.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.167+0000 7f191a59c700 1 --2- 172.21.15.71:0/2996684035 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f18fc066f30 0x7f18fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:43.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.168+0000 7f191a59c700 1 --2- 172.21.15.71:0/2996684035 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f18fc066f30 0x7f18fc0693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f190c003860 tx=0x7f190c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:43.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.171+0000 7f190a7fc700 1 -- 172.21.15.71:0/2996684035 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1910052e30 con 0x7f191c0b1c20 2023-10-09T06:42:43.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.357+0000 7f19209ff700 1 -- 172.21.15.71:0/2996684035 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f191c16dc00 con 0x7f18fc066f30 2023-10-09T06:42:43.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.365+0000 7f190a7fc700 1 -- 172.21.15.71:0/2996684035 <== mgr.4102 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264589 (secure 0 0 0) 0x7f191c16dc00 con 0x7f18fc066f30 2023-10-09T06:42:43.373 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:42:43.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.369+0000 7f19209ff700 1 -- 172.21.15.71:0/2996684035 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f18fc066f30 msgr2=0x7f18fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:43.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.369+0000 7f19209ff700 1 --2- 172.21.15.71:0/2996684035 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f18fc066f30 0x7f18fc0693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f190c003860 tx=0x7f190c009040 comp rx=0 tx=0).stop 2023-10-09T06:42:43.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.369+0000 7f19209ff700 1 -- 172.21.15.71:0/2996684035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f191c0b1c20 msgr2=0x7f191c0a90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:43.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.369+0000 7f19209ff700 1 --2- 172.21.15.71:0/2996684035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f191c0b1c20 0x7f191c0a90f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f191c064290 tx=0x7f1910017000 comp rx=0 tx=0).stop 2023-10-09T06:42:43.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.370+0000 7f19209ff700 1 -- 172.21.15.71:0/2996684035 shutdown_connections 2023-10-09T06:42:43.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.370+0000 7f19209ff700 1 --2- 172.21.15.71:0/2996684035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f191c157820 0x7f191c16a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:43.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.370+0000 7f19209ff700 1 --2- 172.21.15.71:0/2996684035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f191c0b1850 0x7f191c1555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:43.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.370+0000 7f19209ff700 1 --2- 172.21.15.71:0/2996684035 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f18fc066f30 0x7f18fc0693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:43.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.370+0000 7f19209ff700 1 --2- 172.21.15.71:0/2996684035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f191c0b1c20 0x7f191c0a90f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:43.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.370+0000 7f19209ff700 1 -- 172.21.15.71:0/2996684035 >> 172.21.15.71:0/2996684035 conn(0x7f191c06a320 msgr2=0x7f191c15cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:43.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.370+0000 7f19209ff700 1 -- 172.21.15.71:0/2996684035 shutdown_connections 2023-10-09T06:42:43.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.370+0000 7f19209ff700 1 -- 172.21.15.71:0/2996684035 wait complete. 2023-10-09T06:42:43.379 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:42:43.391 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-09T06:42:42.545468+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":144,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381116,"kb_used_data":2812,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593604,"statfs":{"total":773094113280,"available":770655850496,"internally_reserved":0,"allocated":2879488,"data_stored":1744292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.936784"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.577185+0000","last_change":"2023-10-09T06:42:38.575641+0000","last_active":"2023-10-09T06:42:38.577185+0000","last_peered":"2023-10-09T06:42:38.577185+0000","last_clean":"2023-10-09T06:42:38.577185+0000","last_became_active":"2023-10-09T06:42:38.575375+0000","last_became_peered":"2023-10-09T06:42:38.575375+0000","last_unstale":"2023-10-09T06:42:38.577185+0000","last_undegraded":"2023-10-09T06:42:38.577185+0000","last_fullsized":"2023-10-09T06:42:38.577185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:07.557629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.563008+0000","last_change":"2023-10-09T06:42:38.559528+0000","last_active":"2023-10-09T06:42:38.563008+0000","last_peered":"2023-10-09T06:42:38.563008+0000","last_clean":"2023-10-09T06:42:38.563008+0000","last_became_active":"2023-10-09T06:42:38.559281+0000","last_became_peered":"2023-10-09T06:42:38.559281+0000","last_unstale":"2023-10-09T06:42:38.563008+0000","last_undegraded":"2023-10-09T06:42:38.563008+0000","last_fullsized":"2023-10-09T06:42:38.563008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:33.081210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.564926+0000","last_change":"2023-10-09T06:42:38.560485+0000","last_active":"2023-10-09T06:42:38.564926+0000","last_peered":"2023-10-09T06:42:38.564926+0000","last_clean":"2023-10-09T06:42:38.564926+0000","last_became_active":"2023-10-09T06:42:38.560196+0000","last_became_peered":"2023-10-09T06:42:38.560196+0000","last_unstale":"2023-10-09T06:42:38.564926+0000","last_undegraded":"2023-10-09T06:42:38.564926+0000","last_fullsized":"2023-10-09T06:42:38.564926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:35:09.230725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.577325+0000","last_change":"2023-10-09T06:42:38.563950+0000","last_active":"2023-10-09T06:42:38.577325+0000","last_peered":"2023-10-09T06:42:38.577325+0000","last_clean":"2023-10-09T06:42:38.577325+0000","last_became_active":"2023-10-09T06:42:38.563426+0000","last_became_peered":"2023-10-09T06:42:38.563426+0000","last_unstale":"2023-10-09T06:42:38.577325+0000","last_undegraded":"2023-10-09T06:42:38.577325+0000","last_fullsized":"2023-10-09T06:42:38.577325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:40.455468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.575267+0000","last_change":"2023-10-09T06:42:38.569136+0000","last_active":"2023-10-09T06:42:38.575267+0000","last_peered":"2023-10-09T06:42:38.575267+0000","last_clean":"2023-10-09T06:42:38.575267+0000","last_became_active":"2023-10-09T06:42:38.568819+0000","last_became_peered":"2023-10-09T06:42:38.568819+0000","last_unstale":"2023-10-09T06:42:38.575267+0000","last_undegraded":"2023-10-09T06:42:38.575267+0000","last_fullsized":"2023-10-09T06:42:38.575267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:45.260995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578720+0000","last_change":"2023-10-09T06:42:38.569499+0000","last_active":"2023-10-09T06:42:38.578720+0000","last_peered":"2023-10-09T06:42:38.578720+0000","last_clean":"2023-10-09T06:42:38.578720+0000","last_became_active":"2023-10-09T06:42:38.569273+0000","last_became_peered":"2023-10-09T06:42:38.569273+0000","last_unstale":"2023-10-09T06:42:38.578720+0000","last_undegraded":"2023-10-09T06:42:38.578720+0000","last_fullsized":"2023-10-09T06:42:38.578720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:30.124382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.568498+0000","last_change":"2023-10-09T06:42:38.563449+0000","last_active":"2023-10-09T06:42:38.568498+0000","last_peered":"2023-10-09T06:42:38.568498+0000","last_clean":"2023-10-09T06:42:38.568498+0000","last_became_active":"2023-10-09T06:42:38.563177+0000","last_became_peered":"2023-10-09T06:42:38.563177+0000","last_unstale":"2023-10-09T06:42:38.568498+0000","last_undegraded":"2023-10-09T06:42:38.568498+0000","last_fullsized":"2023-10-09T06:42:38.568498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:30.124382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581576+0000","last_change":"2023-10-09T06:42:38.577903+0000","last_active":"2023-10-09T06:42:38.581576+0000","last_peered":"2023-10-09T06:42:38.581576+0000","last_clean":"2023-10-09T06:42:38.581576+0000","last_became_active":"2023-10-09T06:42:38.577678+0000","last_became_peered":"2023-10-09T06:42:38.577678+0000","last_unstale":"2023-10-09T06:42:38.581576+0000","last_undegraded":"2023-10-09T06:42:38.581576+0000","last_fullsized":"2023-10-09T06:42:38.581576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:21.009791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.584331+0000","last_change":"2023-10-09T06:42:38.579587+0000","last_active":"2023-10-09T06:42:38.584331+0000","last_peered":"2023-10-09T06:42:38.584331+0000","last_clean":"2023-10-09T06:42:38.584331+0000","last_became_active":"2023-10-09T06:42:38.579323+0000","last_became_peered":"2023-10-09T06:42:38.579323+0000","last_unstale":"2023-10-09T06:42:38.584331+0000","last_undegraded":"2023-10-09T06:42:38.584331+0000","last_fullsized":"2023-10-09T06:42:38.584331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:01:38.384294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581576+0000","last_change":"2023-10-09T06:42:38.579931+0000","last_active":"2023-10-09T06:42:38.581576+0000","last_peered":"2023-10-09T06:42:38.581576+0000","last_clean":"2023-10-09T06:42:38.581576+0000","last_became_active":"2023-10-09T06:42:38.579558+0000","last_became_peered":"2023-10-09T06:42:38.579558+0000","last_unstale":"2023-10-09T06:42:38.581576+0000","last_undegraded":"2023-10-09T06:42:38.581576+0000","last_fullsized":"2023-10-09T06:42:38.581576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:12:51.397981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581524+0000","last_change":"2023-10-09T06:42:38.579020+0000","last_active":"2023-10-09T06:42:38.581524+0000","last_peered":"2023-10-09T06:42:38.581524+0000","last_clean":"2023-10-09T06:42:38.581524+0000","last_became_active":"2023-10-09T06:42:38.578750+0000","last_became_peered":"2023-10-09T06:42:38.578750+0000","last_unstale":"2023-10-09T06:42:38.581524+0000","last_undegraded":"2023-10-09T06:42:38.581524+0000","last_fullsized":"2023-10-09T06:42:38.581524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:09.752553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.569984+0000","last_change":"2023-10-09T06:42:38.569028+0000","last_active":"2023-10-09T06:42:38.569984+0000","last_peered":"2023-10-09T06:42:38.569984+0000","last_clean":"2023-10-09T06:42:38.569984+0000","last_became_active":"2023-10-09T06:42:38.568700+0000","last_became_peered":"2023-10-09T06:42:38.568700+0000","last_unstale":"2023-10-09T06:42:38.569984+0000","last_undegraded":"2023-10-09T06:42:38.569984+0000","last_fullsized":"2023-10-09T06:42:38.569984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:28.626444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.573134+0000","last_change":"2023-10-09T06:42:38.570156+0000","last_active":"2023-10-09T06:42:38.573134+0000","last_peered":"2023-10-09T06:42:38.573134+0000","last_clean":"2023-10-09T06:42:38.573134+0000","last_became_active":"2023-10-09T06:42:38.569850+0000","last_became_peered":"2023-10-09T06:42:38.569850+0000","last_unstale":"2023-10-09T06:42:38.573134+0000","last_undegraded":"2023-10-09T06:42:38.573134+0000","last_fullsized":"2023-10-09T06:42:38.573134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:12:51.397981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.572785+0000","last_change":"2023-10-09T06:42:38.567093+0000","last_active":"2023-10-09T06:42:38.572785+0000","last_peered":"2023-10-09T06:42:38.572785+0000","last_clean":"2023-10-09T06:42:38.572785+0000","last_became_active":"2023-10-09T06:42:38.566754+0000","last_became_peered":"2023-10-09T06:42:38.566754+0000","last_unstale":"2023-10-09T06:42:38.572785+0000","last_undegraded":"2023-10-09T06:42:38.572785+0000","last_fullsized":"2023-10-09T06:42:38.572785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:52.216260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570209+0000","last_change":"2023-10-09T06:42:38.569052+0000","last_active":"2023-10-09T06:42:38.570209+0000","last_peered":"2023-10-09T06:42:38.570209+0000","last_clean":"2023-10-09T06:42:38.570209+0000","last_became_active":"2023-10-09T06:42:38.568464+0000","last_became_peered":"2023-10-09T06:42:38.568464+0000","last_unstale":"2023-10-09T06:42:38.570209+0000","last_undegraded":"2023-10-09T06:42:38.570209+0000","last_fullsized":"2023-10-09T06:42:38.570209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:09.752553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578790+0000","last_change":"2023-10-09T06:42:38.572741+0000","last_active":"2023-10-09T06:42:38.578790+0000","last_peered":"2023-10-09T06:42:38.578790+0000","last_clean":"2023-10-09T06:42:38.578790+0000","last_became_active":"2023-10-09T06:42:38.572442+0000","last_became_peered":"2023-10-09T06:42:38.572442+0000","last_unstale":"2023-10-09T06:42:38.578790+0000","last_undegraded":"2023-10-09T06:42:38.578790+0000","last_fullsized":"2023-10-09T06:42:38.578790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:39.013974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581431+0000","last_change":"2023-10-09T06:42:38.577189+0000","last_active":"2023-10-09T06:42:38.581431+0000","last_peered":"2023-10-09T06:42:38.581431+0000","last_clean":"2023-10-09T06:42:38.581431+0000","last_became_active":"2023-10-09T06:42:38.576869+0000","last_became_peered":"2023-10-09T06:42:38.576869+0000","last_unstale":"2023-10-09T06:42:38.581431+0000","last_undegraded":"2023-10-09T06:42:38.581431+0000","last_fullsized":"2023-10-09T06:42:38.581431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:52:15.589759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570197+0000","last_change":"2023-10-09T06:42:38.566807+0000","last_active":"2023-10-09T06:42:38.570197+0000","last_peered":"2023-10-09T06:42:38.570197+0000","last_clean":"2023-10-09T06:42:38.570197+0000","last_became_active":"2023-10-09T06:42:38.566406+0000","last_became_peered":"2023-10-09T06:42:38.566406+0000","last_unstale":"2023-10-09T06:42:38.570197+0000","last_undegraded":"2023-10-09T06:42:38.570197+0000","last_fullsized":"2023-10-09T06:42:38.570197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:28.626444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.568562+0000","last_change":"2023-10-09T06:42:38.562250+0000","last_active":"2023-10-09T06:42:38.568562+0000","last_peered":"2023-10-09T06:42:38.568562+0000","last_clean":"2023-10-09T06:42:38.568562+0000","last_became_active":"2023-10-09T06:42:38.561988+0000","last_became_peered":"2023-10-09T06:42:38.561988+0000","last_unstale":"2023-10-09T06:42:38.568562+0000","last_undegraded":"2023-10-09T06:42:38.568562+0000","last_fullsized":"2023-10-09T06:42:38.568562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:39.013974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.646183+0000","last_change":"2023-10-09T06:42:37.642781+0000","last_active":"2023-10-09T06:42:38.646183+0000","last_peered":"2023-10-09T06:42:38.646183+0000","last_clean":"2023-10-09T06:42:38.646183+0000","last_became_active":"2023-10-09T06:42:37.642471+0000","last_became_peered":"2023-10-09T06:42:37.642471+0000","last_unstale":"2023-10-09T06:42:38.646183+0000","last_undegraded":"2023-10-09T06:42:38.646183+0000","last_fullsized":"2023-10-09T06:42:38.646183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:05:08.035245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570629+0000","last_change":"2023-10-09T06:42:38.566995+0000","last_active":"2023-10-09T06:42:38.570629+0000","last_peered":"2023-10-09T06:42:38.570629+0000","last_clean":"2023-10-09T06:42:38.570629+0000","last_became_active":"2023-10-09T06:42:38.566465+0000","last_became_peered":"2023-10-09T06:42:38.566465+0000","last_unstale":"2023-10-09T06:42:38.570629+0000","last_undegraded":"2023-10-09T06:42:38.570629+0000","last_fullsized":"2023-10-09T06:42:38.570629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:37:48.391850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.649735+0000","last_change":"2023-10-09T06:42:37.639809+0000","last_active":"2023-10-09T06:42:38.649735+0000","last_peered":"2023-10-09T06:42:38.649735+0000","last_clean":"2023-10-09T06:42:38.649735+0000","last_became_active":"2023-10-09T06:42:37.639544+0000","last_became_peered":"2023-10-09T06:42:37.639544+0000","last_unstale":"2023-10-09T06:42:38.649735+0000","last_undegraded":"2023-10-09T06:42:38.649735+0000","last_fullsized":"2023-10-09T06:42:38.649735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:20:06.272193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.582029+0000","last_change":"2023-10-09T06:42:38.579122+0000","last_active":"2023-10-09T06:42:38.582029+0000","last_peered":"2023-10-09T06:42:38.582029+0000","last_clean":"2023-10-09T06:42:38.582029+0000","last_became_active":"2023-10-09T06:42:38.578579+0000","last_became_peered":"2023-10-09T06:42:38.578579+0000","last_unstale":"2023-10-09T06:42:38.582029+0000","last_undegraded":"2023-10-09T06:42:38.582029+0000","last_fullsized":"2023-10-09T06:42:38.582029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:09.752553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.640061+0000","last_change":"2023-10-09T06:42:37.639115+0000","last_active":"2023-10-09T06:42:38.640061+0000","last_peered":"2023-10-09T06:42:38.640061+0000","last_clean":"2023-10-09T06:42:38.640061+0000","last_became_active":"2023-10-09T06:42:37.638883+0000","last_became_peered":"2023-10-09T06:42:37.638883+0000","last_unstale":"2023-10-09T06:42:38.640061+0000","last_undegraded":"2023-10-09T06:42:38.640061+0000","last_fullsized":"2023-10-09T06:42:38.640061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:00.278956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.576787+0000","last_change":"2023-10-09T06:42:38.556216+0000","last_active":"2023-10-09T06:42:38.576787+0000","last_peered":"2023-10-09T06:42:38.576787+0000","last_clean":"2023-10-09T06:42:38.576787+0000","last_became_active":"2023-10-09T06:42:38.555948+0000","last_became_peered":"2023-10-09T06:42:38.555948+0000","last_unstale":"2023-10-09T06:42:38.576787+0000","last_undegraded":"2023-10-09T06:42:38.576787+0000","last_fullsized":"2023-10-09T06:42:38.576787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:07.557629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.639343+0000","last_change":"2023-10-09T06:42:37.645201+0000","last_active":"2023-10-09T06:42:38.639343+0000","last_peered":"2023-10-09T06:42:38.639343+0000","last_clean":"2023-10-09T06:42:38.639343+0000","last_became_active":"2023-10-09T06:42:37.644809+0000","last_became_peered":"2023-10-09T06:42:37.644809+0000","last_unstale":"2023-10-09T06:42:38.639343+0000","last_undegraded":"2023-10-09T06:42:38.639343+0000","last_fullsized":"2023-10-09T06:42:38.639343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:24.163542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.577053+0000","last_change":"2023-10-09T06:42:38.562628+0000","last_active":"2023-10-09T06:42:38.577053+0000","last_peered":"2023-10-09T06:42:38.577053+0000","last_clean":"2023-10-09T06:42:38.577053+0000","last_became_active":"2023-10-09T06:42:38.559604+0000","last_became_peered":"2023-10-09T06:42:38.559604+0000","last_unstale":"2023-10-09T06:42:38.577053+0000","last_undegraded":"2023-10-09T06:42:38.577053+0000","last_fullsized":"2023-10-09T06:42:38.577053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:37:48.391850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.647992+0000","last_change":"2023-10-09T06:42:37.636915+0000","last_active":"2023-10-09T06:42:38.647992+0000","last_peered":"2023-10-09T06:42:38.647992+0000","last_clean":"2023-10-09T06:42:38.647992+0000","last_became_active":"2023-10-09T06:42:37.635860+0000","last_became_peered":"2023-10-09T06:42:37.635860+0000","last_unstale":"2023-10-09T06:42:38.647992+0000","last_undegraded":"2023-10-09T06:42:38.647992+0000","last_fullsized":"2023-10-09T06:42:38.647992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:37:09.158328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.574981+0000","last_change":"2023-10-09T06:42:38.569866+0000","last_active":"2023-10-09T06:42:38.574981+0000","last_peered":"2023-10-09T06:42:38.574981+0000","last_clean":"2023-10-09T06:42:38.574981+0000","last_became_active":"2023-10-09T06:42:38.569553+0000","last_became_peered":"2023-10-09T06:42:38.569553+0000","last_unstale":"2023-10-09T06:42:38.574981+0000","last_undegraded":"2023-10-09T06:42:38.574981+0000","last_fullsized":"2023-10-09T06:42:38.574981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:21:05.708304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.645604+0000","last_change":"2023-10-09T06:42:37.633709+0000","last_active":"2023-10-09T06:42:38.645604+0000","last_peered":"2023-10-09T06:42:38.645604+0000","last_clean":"2023-10-09T06:42:38.645604+0000","last_became_active":"2023-10-09T06:42:37.633130+0000","last_became_peered":"2023-10-09T06:42:37.633130+0000","last_unstale":"2023-10-09T06:42:38.645604+0000","last_undegraded":"2023-10-09T06:42:38.645604+0000","last_fullsized":"2023-10-09T06:42:38.645604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:37:09.158328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.565018+0000","last_change":"2023-10-09T06:42:38.559125+0000","last_active":"2023-10-09T06:42:38.565018+0000","last_peered":"2023-10-09T06:42:38.565018+0000","last_clean":"2023-10-09T06:42:38.565018+0000","last_became_active":"2023-10-09T06:42:38.558844+0000","last_became_peered":"2023-10-09T06:42:38.558844+0000","last_unstale":"2023-10-09T06:42:38.565018+0000","last_undegraded":"2023-10-09T06:42:38.565018+0000","last_fullsized":"2023-10-09T06:42:38.565018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:12:51.397981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.555859+0000","last_change":"2023-10-09T06:42:37.637810+0000","last_active":"2023-10-09T06:42:38.555859+0000","last_peered":"2023-10-09T06:42:38.555859+0000","last_clean":"2023-10-09T06:42:38.555859+0000","last_became_active":"2023-10-09T06:42:37.637502+0000","last_became_peered":"2023-10-09T06:42:37.637502+0000","last_unstale":"2023-10-09T06:42:38.555859+0000","last_undegraded":"2023-10-09T06:42:38.555859+0000","last_fullsized":"2023-10-09T06:42:38.555859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:35.971277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570842+0000","last_change":"2023-10-09T06:42:38.568118+0000","last_active":"2023-10-09T06:42:38.570842+0000","last_peered":"2023-10-09T06:42:38.570842+0000","last_clean":"2023-10-09T06:42:38.570842+0000","last_became_active":"2023-10-09T06:42:38.567829+0000","last_became_peered":"2023-10-09T06:42:38.567829+0000","last_unstale":"2023-10-09T06:42:38.570842+0000","last_undegraded":"2023-10-09T06:42:38.570842+0000","last_fullsized":"2023-10-09T06:42:38.570842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:40.455468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.550527+0000","last_change":"2023-10-09T06:42:37.630311+0000","last_active":"2023-10-09T06:42:38.550527+0000","last_peered":"2023-10-09T06:42:38.550527+0000","last_clean":"2023-10-09T06:42:38.550527+0000","last_became_active":"2023-10-09T06:42:37.629826+0000","last_became_peered":"2023-10-09T06:42:37.629826+0000","last_unstale":"2023-10-09T06:42:38.550527+0000","last_undegraded":"2023-10-09T06:42:38.550527+0000","last_fullsized":"2023-10-09T06:42:38.550527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:35.971277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570137+0000","last_change":"2023-10-09T06:42:38.564818+0000","last_active":"2023-10-09T06:42:38.570137+0000","last_peered":"2023-10-09T06:42:38.570137+0000","last_clean":"2023-10-09T06:42:38.570137+0000","last_became_active":"2023-10-09T06:42:38.564033+0000","last_became_peered":"2023-10-09T06:42:38.564033+0000","last_unstale":"2023-10-09T06:42:38.570137+0000","last_undegraded":"2023-10-09T06:42:38.570137+0000","last_fullsized":"2023-10-09T06:42:38.570137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:47.620309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.561468+0000","last_change":"2023-10-09T06:42:37.639202+0000","last_active":"2023-10-09T06:42:38.561468+0000","last_peered":"2023-10-09T06:42:38.561468+0000","last_clean":"2023-10-09T06:42:38.561468+0000","last_became_active":"2023-10-09T06:42:37.638949+0000","last_became_peered":"2023-10-09T06:42:37.638949+0000","last_unstale":"2023-10-09T06:42:38.561468+0000","last_undegraded":"2023-10-09T06:42:38.561468+0000","last_fullsized":"2023-10-09T06:42:38.561468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:04:15.833968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578657+0000","last_change":"2023-10-09T06:42:38.576519+0000","last_active":"2023-10-09T06:42:38.578657+0000","last_peered":"2023-10-09T06:42:38.578657+0000","last_clean":"2023-10-09T06:42:38.578657+0000","last_became_active":"2023-10-09T06:42:38.574470+0000","last_became_peered":"2023-10-09T06:42:38.574470+0000","last_unstale":"2023-10-09T06:42:38.578657+0000","last_undegraded":"2023-10-09T06:42:38.578657+0000","last_fullsized":"2023-10-09T06:42:38.578657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:58.690094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.551196+0000","last_change":"2023-10-09T06:42:37.638178+0000","last_active":"2023-10-09T06:42:38.551196+0000","last_peered":"2023-10-09T06:42:38.551196+0000","last_clean":"2023-10-09T06:42:38.551196+0000","last_became_active":"2023-10-09T06:42:37.636993+0000","last_became_peered":"2023-10-09T06:42:37.636993+0000","last_unstale":"2023-10-09T06:42:38.551196+0000","last_undegraded":"2023-10-09T06:42:38.551196+0000","last_fullsized":"2023-10-09T06:42:38.551196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:52.698626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581385+0000","last_change":"2023-10-09T06:42:38.578851+0000","last_active":"2023-10-09T06:42:38.581385+0000","last_peered":"2023-10-09T06:42:38.581385+0000","last_clean":"2023-10-09T06:42:38.581385+0000","last_became_active":"2023-10-09T06:42:38.578545+0000","last_became_peered":"2023-10-09T06:42:38.578545+0000","last_unstale":"2023-10-09T06:42:38.581385+0000","last_undegraded":"2023-10-09T06:42:38.581385+0000","last_fullsized":"2023-10-09T06:42:38.581385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:47.620309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.647140+0000","last_change":"2023-10-09T06:42:37.641427+0000","last_active":"2023-10-09T06:42:38.647140+0000","last_peered":"2023-10-09T06:42:38.647140+0000","last_clean":"2023-10-09T06:42:38.647140+0000","last_became_active":"2023-10-09T06:42:37.640279+0000","last_became_peered":"2023-10-09T06:42:37.640279+0000","last_unstale":"2023-10-09T06:42:38.647140+0000","last_undegraded":"2023-10-09T06:42:38.647140+0000","last_fullsized":"2023-10-09T06:42:38.647140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:24.163542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.569145+0000","last_change":"2023-10-09T06:42:38.567036+0000","last_active":"2023-10-09T06:42:38.569145+0000","last_peered":"2023-10-09T06:42:38.569145+0000","last_clean":"2023-10-09T06:42:38.569145+0000","last_became_active":"2023-10-09T06:42:38.566747+0000","last_became_peered":"2023-10-09T06:42:38.566747+0000","last_unstale":"2023-10-09T06:42:38.569145+0000","last_undegraded":"2023-10-09T06:42:38.569145+0000","last_fullsized":"2023-10-09T06:42:38.569145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:54:35.039738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.650427+0000","last_change":"2023-10-09T06:42:37.640729+0000","last_active":"2023-10-09T06:42:38.650427+0000","last_peered":"2023-10-09T06:42:38.650427+0000","last_clean":"2023-10-09T06:42:38.650427+0000","last_became_active":"2023-10-09T06:42:37.640292+0000","last_became_peered":"2023-10-09T06:42:37.640292+0000","last_unstale":"2023-10-09T06:42:38.650427+0000","last_undegraded":"2023-10-09T06:42:38.650427+0000","last_fullsized":"2023-10-09T06:42:38.650427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:35.971277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.568584+0000","last_change":"2023-10-09T06:42:38.563617+0000","last_active":"2023-10-09T06:42:38.568584+0000","last_peered":"2023-10-09T06:42:38.568584+0000","last_clean":"2023-10-09T06:42:38.568584+0000","last_became_active":"2023-10-09T06:42:38.563354+0000","last_became_peered":"2023-10-09T06:42:38.563354+0000","last_unstale":"2023-10-09T06:42:38.568584+0000","last_undegraded":"2023-10-09T06:42:38.568584+0000","last_fullsized":"2023-10-09T06:42:38.568584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:37:48.391850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.641288+0000","last_change":"2023-10-09T06:42:37.640446+0000","last_active":"2023-10-09T06:42:38.641288+0000","last_peered":"2023-10-09T06:42:38.641288+0000","last_clean":"2023-10-09T06:42:38.641288+0000","last_became_active":"2023-10-09T06:42:37.640147+0000","last_became_peered":"2023-10-09T06:42:37.640147+0000","last_unstale":"2023-10-09T06:42:38.641288+0000","last_undegraded":"2023-10-09T06:42:38.641288+0000","last_fullsized":"2023-10-09T06:42:38.641288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:39.606272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.566333+0000","last_change":"2023-10-09T06:42:38.562201+0000","last_active":"2023-10-09T06:42:38.566333+0000","last_peered":"2023-10-09T06:42:38.566333+0000","last_clean":"2023-10-09T06:42:38.566333+0000","last_became_active":"2023-10-09T06:42:38.561906+0000","last_became_peered":"2023-10-09T06:42:38.561906+0000","last_unstale":"2023-10-09T06:42:38.566333+0000","last_undegraded":"2023-10-09T06:42:38.566333+0000","last_fullsized":"2023-10-09T06:42:38.566333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:33.081210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.554492+0000","last_change":"2023-10-09T06:42:37.633895+0000","last_active":"2023-10-09T06:42:38.554492+0000","last_peered":"2023-10-09T06:42:38.554492+0000","last_clean":"2023-10-09T06:42:38.554492+0000","last_became_active":"2023-10-09T06:42:37.633582+0000","last_became_peered":"2023-10-09T06:42:37.633582+0000","last_unstale":"2023-10-09T06:42:38.554492+0000","last_undegraded":"2023-10-09T06:42:38.554492+0000","last_fullsized":"2023-10-09T06:42:38.554492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:37:09.158328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.577139+0000","last_change":"2023-10-09T06:42:38.574732+0000","last_active":"2023-10-09T06:42:38.577139+0000","last_peered":"2023-10-09T06:42:38.577139+0000","last_clean":"2023-10-09T06:42:38.577139+0000","last_became_active":"2023-10-09T06:42:38.574374+0000","last_became_peered":"2023-10-09T06:42:38.574374+0000","last_unstale":"2023-10-09T06:42:38.577139+0000","last_undegraded":"2023-10-09T06:42:38.577139+0000","last_fullsized":"2023-10-09T06:42:38.577139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:58.690094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.561313+0000","last_change":"2023-10-09T06:42:37.634258+0000","last_active":"2023-10-09T06:42:38.561313+0000","last_peered":"2023-10-09T06:42:38.561313+0000","last_clean":"2023-10-09T06:42:38.561313+0000","last_became_active":"2023-10-09T06:42:37.633958+0000","last_became_peered":"2023-10-09T06:42:37.633958+0000","last_unstale":"2023-10-09T06:42:38.561313+0000","last_undegraded":"2023-10-09T06:42:38.561313+0000","last_fullsized":"2023-10-09T06:42:38.561313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:52.698626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.566266+0000","last_change":"2023-10-09T06:42:38.564382+0000","last_active":"2023-10-09T06:42:38.566266+0000","last_peered":"2023-10-09T06:42:38.566266+0000","last_clean":"2023-10-09T06:42:38.566266+0000","last_became_active":"2023-10-09T06:42:38.563827+0000","last_became_peered":"2023-10-09T06:42:38.563827+0000","last_unstale":"2023-10-09T06:42:38.566266+0000","last_undegraded":"2023-10-09T06:42:38.566266+0000","last_fullsized":"2023-10-09T06:42:38.566266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:35:09.230725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.644393+0000","last_change":"2023-10-09T06:42:37.636395+0000","last_active":"2023-10-09T06:42:38.644393+0000","last_peered":"2023-10-09T06:42:38.644393+0000","last_clean":"2023-10-09T06:42:38.644393+0000","last_became_active":"2023-10-09T06:42:37.636040+0000","last_became_peered":"2023-10-09T06:42:37.636040+0000","last_unstale":"2023-10-09T06:42:38.644393+0000","last_undegraded":"2023-10-09T06:42:38.644393+0000","last_fullsized":"2023-10-09T06:42:38.644393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:04:15.833968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.575637+0000","last_change":"2023-10-09T06:42:38.570513+0000","last_active":"2023-10-09T06:42:38.575637+0000","last_peered":"2023-10-09T06:42:38.575637+0000","last_clean":"2023-10-09T06:42:38.575637+0000","last_became_active":"2023-10-09T06:42:38.570219+0000","last_became_peered":"2023-10-09T06:42:38.570219+0000","last_unstale":"2023-10-09T06:42:38.575637+0000","last_undegraded":"2023-10-09T06:42:38.575637+0000","last_fullsized":"2023-10-09T06:42:38.575637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:28:50.048850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.641339+0000","last_change":"2023-10-09T06:42:37.638988+0000","last_active":"2023-10-09T06:42:38.641339+0000","last_peered":"2023-10-09T06:42:38.641339+0000","last_clean":"2023-10-09T06:42:38.641339+0000","last_became_active":"2023-10-09T06:42:37.638699+0000","last_became_peered":"2023-10-09T06:42:37.638699+0000","last_unstale":"2023-10-09T06:42:38.641339+0000","last_undegraded":"2023-10-09T06:42:38.641339+0000","last_fullsized":"2023-10-09T06:42:38.641339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:20:06.272193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.575426+0000","last_change":"2023-10-09T06:42:38.569837+0000","last_active":"2023-10-09T06:42:38.575426+0000","last_peered":"2023-10-09T06:42:38.575426+0000","last_clean":"2023-10-09T06:42:38.575426+0000","last_became_active":"2023-10-09T06:42:38.569508+0000","last_became_peered":"2023-10-09T06:42:38.569508+0000","last_unstale":"2023-10-09T06:42:38.575426+0000","last_undegraded":"2023-10-09T06:42:38.575426+0000","last_fullsized":"2023-10-09T06:42:38.575426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:40.455468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.556115+0000","last_change":"2023-10-09T06:42:37.641808+0000","last_active":"2023-10-09T06:42:38.556115+0000","last_peered":"2023-10-09T06:42:38.556115+0000","last_clean":"2023-10-09T06:42:38.556115+0000","last_became_active":"2023-10-09T06:42:37.641389+0000","last_became_peered":"2023-10-09T06:42:37.641389+0000","last_unstale":"2023-10-09T06:42:38.556115+0000","last_undegraded":"2023-10-09T06:42:38.556115+0000","last_fullsized":"2023-10-09T06:42:38.556115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:52.698626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578832+0000","last_change":"2023-10-09T06:42:38.568966+0000","last_active":"2023-10-09T06:42:38.578832+0000","last_peered":"2023-10-09T06:42:38.578832+0000","last_clean":"2023-10-09T06:42:38.578832+0000","last_became_active":"2023-10-09T06:42:38.564917+0000","last_became_peered":"2023-10-09T06:42:38.564917+0000","last_unstale":"2023-10-09T06:42:38.578832+0000","last_undegraded":"2023-10-09T06:42:38.578832+0000","last_fullsized":"2023-10-09T06:42:38.578832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:13.371246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.554558+0000","last_change":"2023-10-09T06:42:37.635676+0000","last_active":"2023-10-09T06:42:38.554558+0000","last_peered":"2023-10-09T06:42:38.554558+0000","last_clean":"2023-10-09T06:42:38.554558+0000","last_became_active":"2023-10-09T06:42:37.635365+0000","last_became_peered":"2023-10-09T06:42:37.635365+0000","last_unstale":"2023-10-09T06:42:38.554558+0000","last_undegraded":"2023-10-09T06:42:38.554558+0000","last_fullsized":"2023-10-09T06:42:38.554558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:04:15.833968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.565166+0000","last_change":"2023-10-09T06:42:38.557514+0000","last_active":"2023-10-09T06:42:38.565166+0000","last_peered":"2023-10-09T06:42:38.565166+0000","last_clean":"2023-10-09T06:42:38.565166+0000","last_became_active":"2023-10-09T06:42:38.557194+0000","last_became_peered":"2023-10-09T06:42:38.557194+0000","last_unstale":"2023-10-09T06:42:38.565166+0000","last_undegraded":"2023-10-09T06:42:38.565166+0000","last_fullsized":"2023-10-09T06:42:38.565166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:52.216260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.569358+0000","last_change":"2023-10-09T06:42:38.562852+0000","last_active":"2023-10-09T06:42:38.569358+0000","last_peered":"2023-10-09T06:42:38.569358+0000","last_clean":"2023-10-09T06:42:38.569358+0000","last_became_active":"2023-10-09T06:42:38.562427+0000","last_became_peered":"2023-10-09T06:42:38.562427+0000","last_unstale":"2023-10-09T06:42:38.569358+0000","last_undegraded":"2023-10-09T06:42:38.569358+0000","last_fullsized":"2023-10-09T06:42:38.569358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:54:31.244116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.555131+0000","last_change":"2023-10-09T06:42:37.629265+0000","last_active":"2023-10-09T06:42:38.555131+0000","last_peered":"2023-10-09T06:42:38.555131+0000","last_clean":"2023-10-09T06:42:38.555131+0000","last_became_active":"2023-10-09T06:42:37.628888+0000","last_became_peered":"2023-10-09T06:42:37.628888+0000","last_unstale":"2023-10-09T06:42:38.555131+0000","last_undegraded":"2023-10-09T06:42:38.555131+0000","last_fullsized":"2023-10-09T06:42:38.555131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:37:09.158328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581871+0000","last_change":"2023-10-09T06:42:38.578592+0000","last_active":"2023-10-09T06:42:38.581871+0000","last_peered":"2023-10-09T06:42:38.581871+0000","last_clean":"2023-10-09T06:42:38.581871+0000","last_became_active":"2023-10-09T06:42:38.578331+0000","last_became_peered":"2023-10-09T06:42:38.578331+0000","last_unstale":"2023-10-09T06:42:38.581871+0000","last_undegraded":"2023-10-09T06:42:38.581871+0000","last_fullsized":"2023-10-09T06:42:38.581871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:10.767555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.549764+0000","last_change":"2023-10-09T06:42:37.631298+0000","last_active":"2023-10-09T06:42:38.549764+0000","last_peered":"2023-10-09T06:42:38.549764+0000","last_clean":"2023-10-09T06:42:38.549764+0000","last_became_active":"2023-10-09T06:42:37.631005+0000","last_became_peered":"2023-10-09T06:42:37.631005+0000","last_unstale":"2023-10-09T06:42:38.549764+0000","last_undegraded":"2023-10-09T06:42:38.549764+0000","last_fullsized":"2023-10-09T06:42:38.549764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:24.163542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.556307+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:42:38.556307+0000","last_peered":"2023-10-09T06:42:38.556307+0000","last_clean":"2023-10-09T06:42:38.556307+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:42:38.556307+0000","last_undegraded":"2023-10-09T06:42:38.556307+0000","last_fullsized":"2023-10-09T06:42:38.556307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.564781+0000","last_change":"2023-10-09T06:42:38.559755+0000","last_active":"2023-10-09T06:42:38.564781+0000","last_peered":"2023-10-09T06:42:38.564781+0000","last_clean":"2023-10-09T06:42:38.564781+0000","last_became_active":"2023-10-09T06:42:38.559505+0000","last_became_peered":"2023-10-09T06:42:38.559505+0000","last_unstale":"2023-10-09T06:42:38.564781+0000","last_undegraded":"2023-10-09T06:42:38.564781+0000","last_fullsized":"2023-10-09T06:42:38.564781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:49:10.861117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.556416+0000","last_change":"2023-10-09T06:42:37.643040+0000","last_active":"2023-10-09T06:42:38.556416+0000","last_peered":"2023-10-09T06:42:38.556416+0000","last_clean":"2023-10-09T06:42:38.556416+0000","last_became_active":"2023-10-09T06:42:37.642814+0000","last_became_peered":"2023-10-09T06:42:37.642814+0000","last_unstale":"2023-10-09T06:42:38.556416+0000","last_undegraded":"2023-10-09T06:42:38.556416+0000","last_fullsized":"2023-10-09T06:42:38.556416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:20:06.272193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.557248+0000","last_change":"2023-10-09T06:42:37.642142+0000","last_active":"2023-10-09T06:42:38.557248+0000","last_peered":"2023-10-09T06:42:38.557248+0000","last_clean":"2023-10-09T06:42:38.557248+0000","last_became_active":"2023-10-09T06:42:37.641797+0000","last_became_peered":"2023-10-09T06:42:37.641797+0000","last_unstale":"2023-10-09T06:42:38.557248+0000","last_undegraded":"2023-10-09T06:42:38.557248+0000","last_fullsized":"2023-10-09T06:42:38.557248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:54:34.033416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570074+0000","last_change":"2023-10-09T06:42:38.563528+0000","last_active":"2023-10-09T06:42:38.570074+0000","last_peered":"2023-10-09T06:42:38.570074+0000","last_clean":"2023-10-09T06:42:38.570074+0000","last_became_active":"2023-10-09T06:42:38.563121+0000","last_became_peered":"2023-10-09T06:42:38.563121+0000","last_unstale":"2023-10-09T06:42:38.570074+0000","last_undegraded":"2023-10-09T06:42:38.570074+0000","last_fullsized":"2023-10-09T06:42:38.570074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:13.371246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.556624+0000","last_change":"2023-10-09T06:42:37.641729+0000","last_active":"2023-10-09T06:42:38.556624+0000","last_peered":"2023-10-09T06:42:38.556624+0000","last_clean":"2023-10-09T06:42:38.556624+0000","last_became_active":"2023-10-09T06:42:37.641401+0000","last_became_peered":"2023-10-09T06:42:37.641401+0000","last_unstale":"2023-10-09T06:42:38.556624+0000","last_undegraded":"2023-10-09T06:42:38.556624+0000","last_fullsized":"2023-10-09T06:42:38.556624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:00.278956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.572665+0000","last_change":"2023-10-09T06:42:38.569525+0000","last_active":"2023-10-09T06:42:38.572665+0000","last_peered":"2023-10-09T06:42:38.572665+0000","last_clean":"2023-10-09T06:42:38.572665+0000","last_became_active":"2023-10-09T06:42:38.569071+0000","last_became_peered":"2023-10-09T06:42:38.569071+0000","last_unstale":"2023-10-09T06:42:38.572665+0000","last_undegraded":"2023-10-09T06:42:38.572665+0000","last_fullsized":"2023-10-09T06:42:38.572665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:13.371246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.640292+0000","last_change":"2023-10-09T06:42:37.637774+0000","last_active":"2023-10-09T06:42:38.640292+0000","last_peered":"2023-10-09T06:42:38.640292+0000","last_clean":"2023-10-09T06:42:38.640292+0000","last_became_active":"2023-10-09T06:42:37.637478+0000","last_became_peered":"2023-10-09T06:42:37.637478+0000","last_unstale":"2023-10-09T06:42:38.640292+0000","last_undegraded":"2023-10-09T06:42:38.640292+0000","last_fullsized":"2023-10-09T06:42:38.640292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:24.163542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.564966+0000","last_change":"2023-10-09T06:42:38.562018+0000","last_active":"2023-10-09T06:42:38.564966+0000","last_peered":"2023-10-09T06:42:38.564966+0000","last_clean":"2023-10-09T06:42:38.564966+0000","last_became_active":"2023-10-09T06:42:38.561717+0000","last_became_peered":"2023-10-09T06:42:38.561717+0000","last_unstale":"2023-10-09T06:42:38.564966+0000","last_undegraded":"2023-10-09T06:42:38.564966+0000","last_fullsized":"2023-10-09T06:42:38.564966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:28.626444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.556201+0000","last_change":"2023-10-09T06:42:37.642616+0000","last_active":"2023-10-09T06:42:38.556201+0000","last_peered":"2023-10-09T06:42:38.556201+0000","last_clean":"2023-10-09T06:42:38.556201+0000","last_became_active":"2023-10-09T06:42:37.641865+0000","last_became_peered":"2023-10-09T06:42:37.641865+0000","last_unstale":"2023-10-09T06:42:38.556201+0000","last_undegraded":"2023-10-09T06:42:38.556201+0000","last_fullsized":"2023-10-09T06:42:38.556201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:10.432797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.566828+0000","last_change":"2023-10-09T06:42:38.564540+0000","last_active":"2023-10-09T06:42:38.566828+0000","last_peered":"2023-10-09T06:42:38.566828+0000","last_clean":"2023-10-09T06:42:38.566828+0000","last_became_active":"2023-10-09T06:42:38.564273+0000","last_became_peered":"2023-10-09T06:42:38.564273+0000","last_unstale":"2023-10-09T06:42:38.566828+0000","last_undegraded":"2023-10-09T06:42:38.566828+0000","last_fullsized":"2023-10-09T06:42:38.566828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:01.285278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.556077+0000","last_change":"2023-10-09T06:42:37.635028+0000","last_active":"2023-10-09T06:42:38.556077+0000","last_peered":"2023-10-09T06:42:38.556077+0000","last_clean":"2023-10-09T06:42:38.556077+0000","last_became_active":"2023-10-09T06:42:37.634697+0000","last_became_peered":"2023-10-09T06:42:37.634697+0000","last_unstale":"2023-10-09T06:42:38.556077+0000","last_undegraded":"2023-10-09T06:42:38.556077+0000","last_fullsized":"2023-10-09T06:42:38.556077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:35.971277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.569616+0000","last_change":"2023-10-09T06:42:38.563391+0000","last_active":"2023-10-09T06:42:38.569616+0000","last_peered":"2023-10-09T06:42:38.569616+0000","last_clean":"2023-10-09T06:42:38.569616+0000","last_became_active":"2023-10-09T06:42:38.563055+0000","last_became_peered":"2023-10-09T06:42:38.563055+0000","last_unstale":"2023-10-09T06:42:38.569616+0000","last_undegraded":"2023-10-09T06:42:38.569616+0000","last_fullsized":"2023-10-09T06:42:38.569616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:09.752553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.561304+0000","last_change":"2023-10-09T06:42:37.635284+0000","last_active":"2023-10-09T06:42:38.561304+0000","last_peered":"2023-10-09T06:42:38.561304+0000","last_clean":"2023-10-09T06:42:38.561304+0000","last_became_active":"2023-10-09T06:42:37.633661+0000","last_became_peered":"2023-10-09T06:42:37.633661+0000","last_unstale":"2023-10-09T06:42:38.561304+0000","last_undegraded":"2023-10-09T06:42:38.561304+0000","last_fullsized":"2023-10-09T06:42:38.561304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:04:15.833968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570875+0000","last_change":"2023-10-09T06:42:38.568141+0000","last_active":"2023-10-09T06:42:38.570875+0000","last_peered":"2023-10-09T06:42:38.570875+0000","last_clean":"2023-10-09T06:42:38.570875+0000","last_became_active":"2023-10-09T06:42:38.567842+0000","last_became_peered":"2023-10-09T06:42:38.567842+0000","last_unstale":"2023-10-09T06:42:38.570875+0000","last_undegraded":"2023-10-09T06:42:38.570875+0000","last_fullsized":"2023-10-09T06:42:38.570875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:28:50.048850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.640654+0000","last_change":"2023-10-09T06:42:37.642378+0000","last_active":"2023-10-09T06:42:38.640654+0000","last_peered":"2023-10-09T06:42:38.640654+0000","last_clean":"2023-10-09T06:42:38.640654+0000","last_became_active":"2023-10-09T06:42:37.641825+0000","last_became_peered":"2023-10-09T06:42:37.641825+0000","last_unstale":"2023-10-09T06:42:38.640654+0000","last_undegraded":"2023-10-09T06:42:38.640654+0000","last_fullsized":"2023-10-09T06:42:38.640654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:04:15.833968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.571061+0000","last_change":"2023-10-09T06:42:38.569442+0000","last_active":"2023-10-09T06:42:38.571061+0000","last_peered":"2023-10-09T06:42:38.571061+0000","last_clean":"2023-10-09T06:42:38.571061+0000","last_became_active":"2023-10-09T06:42:38.569154+0000","last_became_peered":"2023-10-09T06:42:38.569154+0000","last_unstale":"2023-10-09T06:42:38.571061+0000","last_undegraded":"2023-10-09T06:42:38.571061+0000","last_fullsized":"2023-10-09T06:42:38.571061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:13.371246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.554960+0000","last_change":"2023-10-09T06:42:37.631048+0000","last_active":"2023-10-09T06:42:38.554960+0000","last_peered":"2023-10-09T06:42:38.554960+0000","last_clean":"2023-10-09T06:42:38.554960+0000","last_became_active":"2023-10-09T06:42:37.630750+0000","last_became_peered":"2023-10-09T06:42:37.630750+0000","last_unstale":"2023-10-09T06:42:38.554960+0000","last_undegraded":"2023-10-09T06:42:38.554960+0000","last_fullsized":"2023-10-09T06:42:38.554960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:35.971277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581777+0000","last_change":"2023-10-09T06:42:38.578335+0000","last_active":"2023-10-09T06:42:38.581777+0000","last_peered":"2023-10-09T06:42:38.581777+0000","last_clean":"2023-10-09T06:42:38.581777+0000","last_became_active":"2023-10-09T06:42:38.578028+0000","last_became_peered":"2023-10-09T06:42:38.578028+0000","last_unstale":"2023-10-09T06:42:38.581777+0000","last_undegraded":"2023-10-09T06:42:38.581777+0000","last_fullsized":"2023-10-09T06:42:38.581777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:21.009791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.647078+0000","last_change":"2023-10-09T06:42:37.634742+0000","last_active":"2023-10-09T06:42:38.647078+0000","last_peered":"2023-10-09T06:42:38.647078+0000","last_clean":"2023-10-09T06:42:38.647078+0000","last_became_active":"2023-10-09T06:42:37.633877+0000","last_became_peered":"2023-10-09T06:42:37.633877+0000","last_unstale":"2023-10-09T06:42:38.647078+0000","last_undegraded":"2023-10-09T06:42:38.647078+0000","last_fullsized":"2023-10-09T06:42:38.647078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:10.432797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.577301+0000","last_change":"2023-10-09T06:42:38.563710+0000","last_active":"2023-10-09T06:42:38.577301+0000","last_peered":"2023-10-09T06:42:38.577301+0000","last_clean":"2023-10-09T06:42:38.577301+0000","last_became_active":"2023-10-09T06:42:38.563052+0000","last_became_peered":"2023-10-09T06:42:38.563052+0000","last_unstale":"2023-10-09T06:42:38.577301+0000","last_undegraded":"2023-10-09T06:42:38.577301+0000","last_fullsized":"2023-10-09T06:42:38.577301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:21.009791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.642089+0000","last_change":"2023-10-09T06:42:37.629716+0000","last_active":"2023-10-09T06:42:38.642089+0000","last_peered":"2023-10-09T06:42:38.642089+0000","last_clean":"2023-10-09T06:42:38.642089+0000","last_became_active":"2023-10-09T06:42:37.629416+0000","last_became_peered":"2023-10-09T06:42:37.629416+0000","last_unstale":"2023-10-09T06:42:38.642089+0000","last_undegraded":"2023-10-09T06:42:38.642089+0000","last_fullsized":"2023-10-09T06:42:38.642089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:52.698626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.576962+0000","last_change":"2023-10-09T06:42:38.571766+0000","last_active":"2023-10-09T06:42:38.576962+0000","last_peered":"2023-10-09T06:42:38.576962+0000","last_clean":"2023-10-09T06:42:38.576962+0000","last_became_active":"2023-10-09T06:42:38.571419+0000","last_became_peered":"2023-10-09T06:42:38.571419+0000","last_unstale":"2023-10-09T06:42:38.576962+0000","last_undegraded":"2023-10-09T06:42:38.576962+0000","last_fullsized":"2023-10-09T06:42:38.576962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:44:36.008678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.566289+0000","last_change":"2023-10-09T06:42:38.564609+0000","last_active":"2023-10-09T06:42:38.566289+0000","last_peered":"2023-10-09T06:42:38.566289+0000","last_clean":"2023-10-09T06:42:38.566289+0000","last_became_active":"2023-10-09T06:42:38.564121+0000","last_became_peered":"2023-10-09T06:42:38.564121+0000","last_unstale":"2023-10-09T06:42:38.566289+0000","last_undegraded":"2023-10-09T06:42:38.566289+0000","last_fullsized":"2023-10-09T06:42:38.566289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:10.767555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581375+0000","last_change":"2023-10-09T06:42:38.577925+0000","last_active":"2023-10-09T06:42:38.581375+0000","last_peered":"2023-10-09T06:42:38.581375+0000","last_clean":"2023-10-09T06:42:38.581375+0000","last_became_active":"2023-10-09T06:42:38.577659+0000","last_became_peered":"2023-10-09T06:42:38.577659+0000","last_unstale":"2023-10-09T06:42:38.581375+0000","last_undegraded":"2023-10-09T06:42:38.581375+0000","last_fullsized":"2023-10-09T06:42:38.581375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:21:05.708304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578759+0000","last_change":"2023-10-09T06:42:38.571770+0000","last_active":"2023-10-09T06:42:38.578759+0000","last_peered":"2023-10-09T06:42:38.578759+0000","last_clean":"2023-10-09T06:42:38.578759+0000","last_became_active":"2023-10-09T06:42:38.571510+0000","last_became_peered":"2023-10-09T06:42:38.571510+0000","last_unstale":"2023-10-09T06:42:38.578759+0000","last_undegraded":"2023-10-09T06:42:38.578759+0000","last_fullsized":"2023-10-09T06:42:38.578759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:28:50.048850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.567198+0000","last_change":"2023-10-09T06:42:38.564945+0000","last_active":"2023-10-09T06:42:38.567198+0000","last_peered":"2023-10-09T06:42:38.567198+0000","last_clean":"2023-10-09T06:42:38.567198+0000","last_became_active":"2023-10-09T06:42:38.564686+0000","last_became_peered":"2023-10-09T06:42:38.564686+0000","last_unstale":"2023-10-09T06:42:38.567198+0000","last_undegraded":"2023-10-09T06:42:38.567198+0000","last_fullsized":"2023-10-09T06:42:38.567198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:10.767555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570888+0000","last_change":"2023-10-09T06:42:38.569388+0000","last_active":"2023-10-09T06:42:38.570888+0000","last_peered":"2023-10-09T06:42:38.570888+0000","last_clean":"2023-10-09T06:42:38.570888+0000","last_became_active":"2023-10-09T06:42:38.568559+0000","last_became_peered":"2023-10-09T06:42:38.568559+0000","last_unstale":"2023-10-09T06:42:38.570888+0000","last_undegraded":"2023-10-09T06:42:38.570888+0000","last_fullsized":"2023-10-09T06:42:38.570888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:07.557629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570179+0000","last_change":"2023-10-09T06:42:38.565348+0000","last_active":"2023-10-09T06:42:38.570179+0000","last_peered":"2023-10-09T06:42:38.570179+0000","last_clean":"2023-10-09T06:42:38.570179+0000","last_became_active":"2023-10-09T06:42:38.564447+0000","last_became_peered":"2023-10-09T06:42:38.564447+0000","last_unstale":"2023-10-09T06:42:38.570179+0000","last_undegraded":"2023-10-09T06:42:38.570179+0000","last_fullsized":"2023-10-09T06:42:38.570179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:12:51.397981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.575872+0000","last_change":"2023-10-09T06:42:38.573595+0000","last_active":"2023-10-09T06:42:38.575872+0000","last_peered":"2023-10-09T06:42:38.575872+0000","last_clean":"2023-10-09T06:42:38.575872+0000","last_became_active":"2023-10-09T06:42:38.573337+0000","last_became_peered":"2023-10-09T06:42:38.573337+0000","last_unstale":"2023-10-09T06:42:38.575872+0000","last_undegraded":"2023-10-09T06:42:38.575872+0000","last_fullsized":"2023-10-09T06:42:38.575872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:47.620309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570836+0000","last_change":"2023-10-09T06:42:38.569014+0000","last_active":"2023-10-09T06:42:38.570836+0000","last_peered":"2023-10-09T06:42:38.570836+0000","last_clean":"2023-10-09T06:42:38.570836+0000","last_became_active":"2023-10-09T06:42:38.568745+0000","last_became_peered":"2023-10-09T06:42:38.568745+0000","last_unstale":"2023-10-09T06:42:38.570836+0000","last_undegraded":"2023-10-09T06:42:38.570836+0000","last_fullsized":"2023-10-09T06:42:38.570836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:47.620309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578772+0000","last_change":"2023-10-09T06:42:38.569326+0000","last_active":"2023-10-09T06:42:38.578772+0000","last_peered":"2023-10-09T06:42:38.578772+0000","last_clean":"2023-10-09T06:42:38.578772+0000","last_became_active":"2023-10-09T06:42:38.569071+0000","last_became_peered":"2023-10-09T06:42:38.569071+0000","last_unstale":"2023-10-09T06:42:38.578772+0000","last_undegraded":"2023-10-09T06:42:38.578772+0000","last_fullsized":"2023-10-09T06:42:38.578772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:44:36.008678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.572639+0000","last_change":"2023-10-09T06:42:38.569598+0000","last_active":"2023-10-09T06:42:38.572639+0000","last_peered":"2023-10-09T06:42:38.572639+0000","last_clean":"2023-10-09T06:42:38.572639+0000","last_became_active":"2023-10-09T06:42:38.569008+0000","last_became_peered":"2023-10-09T06:42:38.569008+0000","last_unstale":"2023-10-09T06:42:38.572639+0000","last_undegraded":"2023-10-09T06:42:38.572639+0000","last_fullsized":"2023-10-09T06:42:38.572639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:33.081210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578740+0000","last_change":"2023-10-09T06:42:38.569703+0000","last_active":"2023-10-09T06:42:38.578740+0000","last_peered":"2023-10-09T06:42:38.578740+0000","last_clean":"2023-10-09T06:42:38.578740+0000","last_became_active":"2023-10-09T06:42:38.565385+0000","last_became_peered":"2023-10-09T06:42:38.565385+0000","last_unstale":"2023-10-09T06:42:38.578740+0000","last_undegraded":"2023-10-09T06:42:38.578740+0000","last_fullsized":"2023-10-09T06:42:38.578740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:33.081210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.575964+0000","last_change":"2023-10-09T06:42:38.572735+0000","last_active":"2023-10-09T06:42:38.575964+0000","last_peered":"2023-10-09T06:42:38.575964+0000","last_clean":"2023-10-09T06:42:38.575964+0000","last_became_active":"2023-10-09T06:42:38.572479+0000","last_became_peered":"2023-10-09T06:42:38.572479+0000","last_unstale":"2023-10-09T06:42:38.575964+0000","last_undegraded":"2023-10-09T06:42:38.575964+0000","last_fullsized":"2023-10-09T06:42:38.575964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:13.371246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.571301+0000","last_change":"2023-10-09T06:42:38.569452+0000","last_active":"2023-10-09T06:42:38.571301+0000","last_peered":"2023-10-09T06:42:38.571301+0000","last_clean":"2023-10-09T06:42:38.571301+0000","last_became_active":"2023-10-09T06:42:38.569167+0000","last_became_peered":"2023-10-09T06:42:38.569167+0000","last_unstale":"2023-10-09T06:42:38.571301+0000","last_undegraded":"2023-10-09T06:42:38.571301+0000","last_fullsized":"2023-10-09T06:42:38.571301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:33.081210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":661576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9490000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.617}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.052}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.5800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.125}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1929999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0250000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":811008,"data_stored":661632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":192512,"data_stored":64366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:42:43.398 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T06:42:43.398 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-09T06:42:43.398 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-09T06:42:43.398 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-09T06:42:43.399 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-09T06:42:43.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.612+0000 7f73eabff700 1 Processor -- start 2023-10-09T06:42:43.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.612+0000 7f73eabff700 1 -- start start 2023-10-09T06:42:43.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.613+0000 7f73eabff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f73e40ccc40 0x7f73e4155c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:43.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.613+0000 7f73eabff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f73e40cd010 0x7f73e40b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:43.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.613+0000 7f73eabff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e40ad930 con 0x7f73e4156150 2023-10-09T06:42:43.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.613+0000 7f73eabff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e40acd20 con 0x7f73e40ccc40 2023-10-09T06:42:43.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.613+0000 7f73eabff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e40ad000 con 0x7f73e40cd010 2023-10-09T06:42:43.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.614+0000 7f73e899b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f73e40ccc40 0x7f73e4155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:43.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.614+0000 7f73e899b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f73e40ccc40 0x7f73e4155c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44134/0 (socket says 172.21.15.71:44134) 2023-10-09T06:42:43.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.614+0000 7f73e899b700 1 -- 172.21.15.71:0/2598031115 learned_addr learned my addr 172.21.15.71:0/2598031115 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:43.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.614+0000 7f73e919c700 1 --2- 172.21.15.71:0/2598031115 >> v2:172.21.15.179:3300/0 conn(0x7f73e40cd010 0x7f73e40b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:43.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.614+0000 7f73e899b700 1 -- 172.21.15.71:0/2598031115 >> v2:172.21.15.179:3300/0 conn(0x7f73e40cd010 msgr2=0x7f73e40b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:43.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.614+0000 7f73e899b700 1 --2- 172.21.15.71:0/2598031115 >> v2:172.21.15.179:3300/0 conn(0x7f73e40cd010 0x7f73e40b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:43.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.614+0000 7f73e899b700 1 -- 172.21.15.71:0/2598031115 >> v1:172.21.15.179:6789/0 conn(0x7f73e4156150 legacy=0x7f73e40ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:43.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.614+0000 7f73e899b700 1 -- 172.21.15.71:0/2598031115 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e40ad2e0 con 0x7f73e40ccc40 2023-10-09T06:42:43.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.614+0000 7f73e919c700 1 --2- 172.21.15.71:0/2598031115 >> v2:172.21.15.179:3300/0 conn(0x7f73e40cd010 0x7f73e40b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:43.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.614+0000 7f73e899b700 1 --2- 172.21.15.71:0/2598031115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73e40ccc40 0x7f73e4155c10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f73e40ae0c0 tx=0x7f73d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b6eb827f67ac7a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:43.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.615+0000 7f73e37fe700 1 -- 172.21.15.71:0/2598031115 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d800b820 con 0x7f73e40ccc40 2023-10-09T06:42:43.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.615+0000 7f73e37fe700 1 -- 172.21.15.71:0/2598031115 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d800b980 con 0x7f73e40ccc40 2023-10-09T06:42:43.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.615+0000 7f73e37fe700 1 -- 172.21.15.71:0/2598031115 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d800bd20 con 0x7f73e40ccc40 2023-10-09T06:42:43.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.615+0000 7f73eabff700 1 -- 172.21.15.71:0/2598031115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73e40ccc40 msgr2=0x7f73e4155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:43.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.615+0000 7f73eabff700 1 --2- 172.21.15.71:0/2598031115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73e40ccc40 0x7f73e4155c10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f73e40ae0c0 tx=0x7f73d8009250 comp rx=0 tx=0).stop 2023-10-09T06:42:43.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.615+0000 7f73eabff700 1 -- 172.21.15.71:0/2598031115 shutdown_connections 2023-10-09T06:42:43.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.615+0000 7f73eabff700 1 --2- 172.21.15.71:0/2598031115 >> v2:172.21.15.179:3300/0 conn(0x7f73e40cd010 0x7f73e40b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:43.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.615+0000 7f73eabff700 1 --2- 172.21.15.71:0/2598031115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73e40ccc40 0x7f73e4155c10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:43.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.615+0000 7f73eabff700 1 -- 172.21.15.71:0/2598031115 >> 172.21.15.71:0/2598031115 conn(0x7f73e406a320 msgr2=0x7f73e40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:43.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.615+0000 7f73eabff700 1 -- 172.21.15.71:0/2598031115 shutdown_connections 2023-10-09T06:42:43.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.615+0000 7f73eabff700 1 -- 172.21.15.71:0/2598031115 wait complete. 2023-10-09T06:42:43.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.617+0000 7f73eabff700 1 Processor -- start 2023-10-09T06:42:43.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.617+0000 7f73eabff700 1 -- start start 2023-10-09T06:42:43.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.618+0000 7f73eabff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73e40ccc40 0x7f73e40a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:43.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.618+0000 7f73eabff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73e40cd010 0x7f73e40aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:43.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.618+0000 7f73eabff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73e4156150 0x7f73e416acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:43.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.618+0000 7f73eabff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e40a9db0 con 0x7f73e4156150 2023-10-09T06:42:43.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.618+0000 7f73eabff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e40a8520 con 0x7f73e40cd010 2023-10-09T06:42:43.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.618+0000 7f73eabff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e40a8800 con 0x7f73e40ccc40 2023-10-09T06:42:43.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.618+0000 7f73e919c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73e4156150 0x7f73e416acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:43.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.618+0000 7f73e919c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73e4156150 0x7f73e416acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44136/0 (socket says 172.21.15.71:44136) 2023-10-09T06:42:43.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.618+0000 7f73e919c700 1 -- 172.21.15.71:0/3125620480 learned_addr learned my addr 172.21.15.71:0/3125620480 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:43.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.618+0000 7f73e899b700 1 --2- 172.21.15.71:0/3125620480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73e40ccc40 0x7f73e40a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:43.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.618+0000 7f73e3fff700 1 --2- 172.21.15.71:0/3125620480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73e40cd010 0x7f73e40aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:43.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.618+0000 7f73e919c700 1 -- 172.21.15.71:0/3125620480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73e40ccc40 msgr2=0x7f73e40a9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:43.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.618+0000 7f73e919c700 1 --2- 172.21.15.71:0/3125620480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73e40ccc40 0x7f73e40a9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:43.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.618+0000 7f73e919c700 1 -- 172.21.15.71:0/3125620480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73e40cd010 msgr2=0x7f73e40aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:43.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.618+0000 7f73e919c700 1 --2- 172.21.15.71:0/3125620480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73e40cd010 0x7f73e40aa0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:43.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.618+0000 7f73e919c700 1 -- 172.21.15.71:0/3125620480 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d80094f0 con 0x7f73e4156150 2023-10-09T06:42:43.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.619+0000 7f73e919c700 1 --2- 172.21.15.71:0/3125620480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73e4156150 0x7f73e416acf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f73dc00a380 tx=0x7f73dc007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:43.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.619+0000 7f73e0ff9700 1 -- 172.21.15.71:0/3125620480 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc015440 con 0x7f73e4156150 2023-10-09T06:42:43.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.619+0000 7f73e0ff9700 1 -- 172.21.15.71:0/3125620480 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73dc0155a0 con 0x7f73e4156150 2023-10-09T06:42:43.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.619+0000 7f73eabff700 1 -- 172.21.15.71:0/3125620480 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e40a8ae0 con 0x7f73e4156150 2023-10-09T06:42:43.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.619+0000 7f73e0ff9700 1 -- 172.21.15.71:0/3125620480 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc015960 con 0x7f73e4156150 2023-10-09T06:42:43.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.619+0000 7f73eabff700 1 -- 172.21.15.71:0/3125620480 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e40aa610 con 0x7f73e4156150 2023-10-09T06:42:43.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.620+0000 7f73eabff700 1 -- 172.21.15.71:0/3125620480 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e40c13d0 con 0x7f73e4156150 2023-10-09T06:42:43.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.621+0000 7f73e0ff9700 1 -- 172.21.15.71:0/3125620480 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73dc00d440 con 0x7f73e4156150 2023-10-09T06:42:43.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.622+0000 7f73e0ff9700 1 --2- 172.21.15.71:0/3125620480 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f73c8066f30 0x7f73c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:43.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.622+0000 7f73e0ff9700 1 -- 172.21.15.71:0/3125620480 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f73dc085030 con 0x7f73e4156150 2023-10-09T06:42:43.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.622+0000 7f73e899b700 1 --2- 172.21.15.71:0/3125620480 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f73c8066f30 0x7f73c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:43.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.623+0000 7f73e899b700 1 --2- 172.21.15.71:0/3125620480 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f73c8066f30 0x7f73c80693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f73e40ae0c0 tx=0x7f73d8016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:43.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.627+0000 7f73e0ff9700 1 -- 172.21.15.71:0/3125620480 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f73dc0522a0 con 0x7f73e4156150 2023-10-09T06:42:43.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.871+0000 7f73eabff700 1 -- 172.21.15.71:0/3125620480 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f73e40aa890 con 0x7f73e4156150 2023-10-09T06:42:43.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.875+0000 7f73e0ff9700 1 -- 172.21.15.71:0/3125620480 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163706 (secure 0 0 0) 0x7f73dc0558c0 con 0x7f73e4156150 2023-10-09T06:42:43.877 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:42:43.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.878+0000 7f73eabff700 1 -- 172.21.15.71:0/3125620480 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f73c8066f30 msgr2=0x7f73c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:43.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.878+0000 7f73eabff700 1 --2- 172.21.15.71:0/3125620480 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f73c8066f30 0x7f73c80693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f73e40ae0c0 tx=0x7f73d8016000 comp rx=0 tx=0).stop 2023-10-09T06:42:43.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.878+0000 7f73eabff700 1 -- 172.21.15.71:0/3125620480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73e4156150 msgr2=0x7f73e416acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:43.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.878+0000 7f73eabff700 1 --2- 172.21.15.71:0/3125620480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73e4156150 0x7f73e416acf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f73dc00a380 tx=0x7f73dc007900 comp rx=0 tx=0).stop 2023-10-09T06:42:43.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.878+0000 7f73eabff700 1 -- 172.21.15.71:0/3125620480 shutdown_connections 2023-10-09T06:42:43.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.878+0000 7f73eabff700 1 --2- 172.21.15.71:0/3125620480 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f73c8066f30 0x7f73c80693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:43.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.878+0000 7f73eabff700 1 --2- 172.21.15.71:0/3125620480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73e4156150 0x7f73e416acf0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:43.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.878+0000 7f73eabff700 1 --2- 172.21.15.71:0/3125620480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73e40ccc40 0x7f73e40a9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:43.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.878+0000 7f73eabff700 1 --2- 172.21.15.71:0/3125620480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73e40cd010 0x7f73e40aa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:43.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.878+0000 7f73eabff700 1 -- 172.21.15.71:0/3125620480 >> 172.21.15.71:0/3125620480 conn(0x7f73e406a320 msgr2=0x7f73e40af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:43.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.878+0000 7f73eabff700 1 -- 172.21.15.71:0/3125620480 shutdown_connections 2023-10-09T06:42:43.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:43.878+0000 7f73eabff700 1 -- 172.21.15.71:0/3125620480 wait complete. 2023-10-09T06:42:43.895 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":5,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":85452},{"type":"v1","addr":"172.21.15.179:6833","nonce":85452}]},"active_addr":"172.21.15.179:6833/85452","active_change":"2023-10-09T06:42:20.524599+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4109,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":4042901359}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":1464937439}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":3168407320}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":1455428643}]}]} 2023-10-09T06:42:43.901 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-09T06:42:43.901 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-09T06:42:43.901 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:42:44.031 INFO:tasks.ceph.mds.d.smithi179.stderr:2023-10-09T06:42:44.030+0000 7f6253ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:42:44.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.079+0000 7fd5597ff700 1 Processor -- start 2023-10-09T06:42:44.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.079+0000 7fd5597ff700 1 -- start start 2023-10-09T06:42:44.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.080+0000 7fd5597ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd5540b1420 0x7fd5540ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:44.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.081+0000 7fd5597ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5540cc300 con 0x7fd5540cbf30 2023-10-09T06:42:44.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.081+0000 7fd5597ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5540ad370 con 0x7fd5540ccf90 2023-10-09T06:42:44.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.081+0000 7fd5597ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd554156bf0 con 0x7fd5540b1420 2023-10-09T06:42:44.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.081+0000 7fd5527fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd5540b1420 0x7fd5540ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:44.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.081+0000 7fd552ffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd5540cbf30 0x7fd5540b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56626/0 (socket says 172.21.15.71:56626) 2023-10-09T06:42:44.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.081+0000 7fd552ffd700 1 -- 172.21.15.71:0/2496890037 learned_addr learned my addr 172.21.15.71:0/2496890037 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:44.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.081+0000 7fd551ffb700 1 -- 172.21.15.71:0/2496890037 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904940496 0 0) 0x7fd5540cc300 con 0x7fd5540cbf30 2023-10-09T06:42:44.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.081+0000 7fd5527fc700 1 -- 172.21.15.71:0/2496890037 >> v1:172.21.15.179:6789/0 conn(0x7fd5540ccf90 legacy=0x7fd5540c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:44.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.081+0000 7fd5527fc700 1 -- 172.21.15.71:0/2496890037 >> v1:172.21.15.71:6789/0 conn(0x7fd5540cbf30 legacy=0x7fd5540b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:44.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.081+0000 7fd5527fc700 1 -- 172.21.15.71:0/2496890037 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5540ad650 con 0x7fd5540b1420 2023-10-09T06:42:44.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.082+0000 7fd5527fc700 1 --2- 172.21.15.71:0/2496890037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5540b1420 0x7fd5540ae410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd5480098e0 tx=0x7fd5480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=924f9d3e087c8f8b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:44.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.082+0000 7fd551ffb700 1 -- 172.21.15.71:0/2496890037 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd548009e80 con 0x7fd5540b1420 2023-10-09T06:42:44.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.082+0000 7fd551ffb700 1 -- 172.21.15.71:0/2496890037 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54800b820 con 0x7fd5540b1420 2023-10-09T06:42:44.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.082+0000 7fd551ffb700 1 -- 172.21.15.71:0/2496890037 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54800bba0 con 0x7fd5540b1420 2023-10-09T06:42:44.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.082+0000 7fd5597ff700 1 -- 172.21.15.71:0/2496890037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5540b1420 msgr2=0x7fd5540ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:44.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.082+0000 7fd5597ff700 1 --2- 172.21.15.71:0/2496890037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5540b1420 0x7fd5540ae410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd5480098e0 tx=0x7fd5480091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:44.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.082+0000 7fd5597ff700 1 -- 172.21.15.71:0/2496890037 shutdown_connections 2023-10-09T06:42:44.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.082+0000 7fd5597ff700 1 --2- 172.21.15.71:0/2496890037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5540b1420 0x7fd5540ae410 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:44.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.082+0000 7fd5597ff700 1 -- 172.21.15.71:0/2496890037 >> 172.21.15.71:0/2496890037 conn(0x7fd55406a320 msgr2=0x7fd5540cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:44.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.082+0000 7fd5597ff700 1 -- 172.21.15.71:0/2496890037 shutdown_connections 2023-10-09T06:42:44.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.083+0000 7fd5597ff700 1 -- 172.21.15.71:0/2496890037 wait complete. 2023-10-09T06:42:44.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.084+0000 7fd5597ff700 1 Processor -- start 2023-10-09T06:42:44.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.084+0000 7fd5597ff700 1 -- start start 2023-10-09T06:42:44.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.085+0000 7fd5597ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5540b1420 0x7fd554147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:44.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.085+0000 7fd5597ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5540cbf30 0x7fd55415dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:44.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.085+0000 7fd5597ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5540ccf90 0x7fd55415e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:44.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.085+0000 7fd5597ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd554168730 con 0x7fd5540ccf90 2023-10-09T06:42:44.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.085+0000 7fd5597ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd554167ab0 con 0x7fd5540b1420 2023-10-09T06:42:44.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.085+0000 7fd5597ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd554167d90 con 0x7fd5540cbf30 2023-10-09T06:42:44.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.085+0000 7fd5537fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5540ccf90 0x7fd55415e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:44.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.085+0000 7fd552ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5540b1420 0x7fd554147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:44.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.085+0000 7fd5537fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5540ccf90 0x7fd55415e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44150/0 (socket says 172.21.15.71:44150) 2023-10-09T06:42:44.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.085+0000 7fd5537fe700 1 -- 172.21.15.71:0/2919120709 learned_addr learned my addr 172.21.15.71:0/2919120709 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:44.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.085+0000 7fd5527fc700 1 --2- 172.21.15.71:0/2919120709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5540cbf30 0x7fd55415dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:44.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.086+0000 7fd5537fe700 1 -- 172.21.15.71:0/2919120709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5540cbf30 msgr2=0x7fd55415dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:44.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.086+0000 7fd5537fe700 1 --2- 172.21.15.71:0/2919120709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5540cbf30 0x7fd55415dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:44.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.086+0000 7fd5537fe700 1 -- 172.21.15.71:0/2919120709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5540b1420 msgr2=0x7fd554147ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:44.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.086+0000 7fd5537fe700 1 --2- 172.21.15.71:0/2919120709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5540b1420 0x7fd554147ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:44.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.086+0000 7fd5537fe700 1 -- 172.21.15.71:0/2919120709 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd548009420 con 0x7fd5540ccf90 2023-10-09T06:42:44.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.086+0000 7fd5537fe700 1 --2- 172.21.15.71:0/2919120709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5540ccf90 0x7fd55415e2c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd54c00b4e0 tx=0x7fd54c009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:44.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.086+0000 7fd53affd700 1 -- 172.21.15.71:0/2919120709 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c00be90 con 0x7fd5540ccf90 2023-10-09T06:42:44.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.086+0000 7fd53affd700 1 -- 172.21.15.71:0/2919120709 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c00f510 con 0x7fd5540ccf90 2023-10-09T06:42:44.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.086+0000 7fd53affd700 1 -- 172.21.15.71:0/2919120709 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c00f8b0 con 0x7fd5540ccf90 2023-10-09T06:42:44.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.086+0000 7fd5597ff700 1 -- 172.21.15.71:0/2919120709 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd554168070 con 0x7fd5540ccf90 2023-10-09T06:42:44.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.086+0000 7fd5597ff700 1 -- 172.21.15.71:0/2919120709 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd554148430 con 0x7fd5540ccf90 2023-10-09T06:42:44.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.087+0000 7fd5597ff700 1 -- 172.21.15.71:0/2919120709 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd554168870 con 0x7fd5540ccf90 2023-10-09T06:42:44.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.088+0000 7fd53affd700 1 -- 172.21.15.71:0/2919120709 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd54c00fca0 con 0x7fd5540ccf90 2023-10-09T06:42:44.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.089+0000 7fd53affd700 1 --2- 172.21.15.71:0/2919120709 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd540066f30 0x7fd5400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:44.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.089+0000 7fd53affd700 1 -- 172.21.15.71:0/2919120709 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd54c083f50 con 0x7fd5540ccf90 2023-10-09T06:42:44.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.090+0000 7fd552ffd700 1 --2- 172.21.15.71:0/2919120709 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd540066f30 0x7fd5400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:44.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.090+0000 7fd552ffd700 1 --2- 172.21.15.71:0/2919120709 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd540066f30 0x7fd5400693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd544002250 tx=0x7fd544001a20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:44.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.093+0000 7fd53affd700 1 -- 172.21.15.71:0/2919120709 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd554168870 con 0x7fd5540ccf90 2023-10-09T06:42:44.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.283+0000 7fd5597ff700 1 -- 172.21.15.71:0/2919120709 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd554168870 con 0x7fd5540ccf90 2023-10-09T06:42:44.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.284+0000 7fd53affd700 1 -- 172.21.15.71:0/2919120709 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fd554168870 con 0x7fd5540ccf90 2023-10-09T06:42:44.342 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:42:44.343 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":20,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:42:39.546192+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:42:35.828340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:42:37.071896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:42:44.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.287+0000 7fd5597ff700 1 -- 172.21.15.71:0/2919120709 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd540066f30 msgr2=0x7fd5400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:44.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.287+0000 7fd5597ff700 1 --2- 172.21.15.71:0/2919120709 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd540066f30 0x7fd5400693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd544002250 tx=0x7fd544001a20 comp rx=0 tx=0).stop 2023-10-09T06:42:44.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.287+0000 7fd5597ff700 1 -- 172.21.15.71:0/2919120709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5540ccf90 msgr2=0x7fd55415e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:44.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.287+0000 7fd5597ff700 1 --2- 172.21.15.71:0/2919120709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5540ccf90 0x7fd55415e2c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd54c00b4e0 tx=0x7fd54c009060 comp rx=0 tx=0).stop 2023-10-09T06:42:44.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.287+0000 7fd5597ff700 1 -- 172.21.15.71:0/2919120709 shutdown_connections 2023-10-09T06:42:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.287+0000 7fd5597ff700 1 --2- 172.21.15.71:0/2919120709 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd540066f30 0x7fd5400693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.287+0000 7fd5597ff700 1 --2- 172.21.15.71:0/2919120709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5540ccf90 0x7fd55415e2c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.287+0000 7fd5597ff700 1 --2- 172.21.15.71:0/2919120709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5540b1420 0x7fd554147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.287+0000 7fd5597ff700 1 --2- 172.21.15.71:0/2919120709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5540cbf30 0x7fd55415dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.287+0000 7fd5597ff700 1 -- 172.21.15.71:0/2919120709 >> 172.21.15.71:0/2919120709 conn(0x7fd55406a320 msgr2=0x7fd5540afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.287+0000 7fd5597ff700 1 -- 172.21.15.71:0/2919120709 shutdown_connections 2023-10-09T06:42:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.287+0000 7fd5597ff700 1 -- 172.21.15.71:0/2919120709 wait complete. 2023-10-09T06:42:44.346 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-09T06:42:44.346 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:42:44.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.525+0000 7f37b9fff700 1 Processor -- start 2023-10-09T06:42:44.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.525+0000 7f37b9fff700 1 -- start start 2023-10-09T06:42:44.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.527+0000 7f37b9fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f37b40ccf90 0x7f37b40ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.527+0000 7f37b9fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b40cc300 con 0x7f37b40cbf30 2023-10-09T06:42:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.527+0000 7f37b9fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b40ad370 con 0x7f37b40b1420 2023-10-09T06:42:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.527+0000 7f37b9fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b4156bf0 con 0x7f37b40ccf90 2023-10-09T06:42:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.527+0000 7f37b37fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f37b40cbf30 0x7f37b40b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56632/0 (socket says 172.21.15.71:56632) 2023-10-09T06:42:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.527+0000 7f37b37fe700 1 -- 172.21.15.71:0/4145297378 learned_addr learned my addr 172.21.15.71:0/4145297378 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.527+0000 7f37b3fff700 1 --2- 172.21.15.71:0/4145297378 >> v2:172.21.15.179:3300/0 conn(0x7f37b40ccf90 0x7f37b40ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.527+0000 7f37b27fc700 1 -- 172.21.15.71:0/4145297378 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866009288 0 0) 0x7f37b40cc300 con 0x7f37b40cbf30 2023-10-09T06:42:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.527+0000 7f37b27fc700 1 -- 172.21.15.71:0/4145297378 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f379c003570 con 0x7f37b40cbf30 2023-10-09T06:42:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.528+0000 7f37b27fc700 1 -- 172.21.15.71:0/4145297378 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 841794301 0 0) 0x7f379c003570 con 0x7f37b40cbf30 2023-10-09T06:42:44.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.528+0000 7f37b27fc700 1 -- 172.21.15.71:0/4145297378 >> v2:172.21.15.179:3300/0 conn(0x7f37b40ccf90 msgr2=0x7f37b40ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:44.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.528+0000 7f37b27fc700 1 --2- 172.21.15.71:0/4145297378 >> v2:172.21.15.179:3300/0 conn(0x7f37b40ccf90 0x7f37b40ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:44.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.528+0000 7f37b27fc700 1 -- 172.21.15.71:0/4145297378 >> v1:172.21.15.179:6789/0 conn(0x7f37b40b1420 legacy=0x7f37b40c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.528+0000 7f37b27fc700 1 -- 172.21.15.71:0/4145297378 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b40ad650 con 0x7f37b40cbf30 2023-10-09T06:42:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.528+0000 7f37b27fc700 1 -- 172.21.15.71:0/4145297378 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f37a4001470 con 0x7f37b40cbf30 2023-10-09T06:42:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.528+0000 7f37b27fc700 1 -- 172.21.15.71:0/4145297378 >> v1:172.21.15.71:6789/0 conn(0x7f37b40cbf30 legacy=0x7f37b40b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.528+0000 7f37b27fc700 1 --2- 172.21.15.71:0/4145297378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f379c003a60 0x7f379c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.528+0000 7f37b27fc700 1 --2- 172.21.15.71:0/4145297378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f379c004810 0x7f379c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.528+0000 7f37b27fc700 1 --2- 172.21.15.71:0/4145297378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f379c0051c0 0x7f379c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.528+0000 7f37b27fc700 1 -- 172.21.15.71:0/4145297378 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b4156bf0 con 0x7f379c003a60 2023-10-09T06:42:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.528+0000 7f37b27fc700 1 -- 172.21.15.71:0/4145297378 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c00c050 con 0x7f379c0051c0 2023-10-09T06:42:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.528+0000 7f37b27fc700 1 -- 172.21.15.71:0/4145297378 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379c00c210 con 0x7f379c004810 2023-10-09T06:42:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.528+0000 7f37b37fe700 1 --2- 172.21.15.71:0/4145297378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f379c003a60 0x7f379c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.528+0000 7f37b2ffd700 1 --2- 172.21.15.71:0/4145297378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f379c004810 0x7f379c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:44.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.528+0000 7f37b3fff700 1 --2- 172.21.15.71:0/4145297378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f379c0051c0 0x7f379c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:44.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.528+0000 7f37b37fe700 1 -- 172.21.15.71:0/4145297378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f379c004810 msgr2=0x7f379c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:44.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.528+0000 7f37b37fe700 1 --2- 172.21.15.71:0/4145297378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f379c004810 0x7f379c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:44.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.528+0000 7f37b37fe700 1 -- 172.21.15.71:0/4145297378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f379c0051c0 msgr2=0x7f379c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:44.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.528+0000 7f37b37fe700 1 --2- 172.21.15.71:0/4145297378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f379c0051c0 0x7f379c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:44.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.528+0000 7f37b37fe700 1 -- 172.21.15.71:0/4145297378 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379c003570 con 0x7f379c003a60 2023-10-09T06:42:44.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.528+0000 7f37b3fff700 1 --2- 172.21.15.71:0/4145297378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f379c0051c0 0x7f379c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:44.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.528+0000 7f37b3fff700 1 -- 172.21.15.71:0/4145297378 reap_dead start 2023-10-09T06:42:44.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.529+0000 7f37b37fe700 1 --2- 172.21.15.71:0/4145297378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f379c003a60 0x7f379c003e30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f37a400c3c0 tx=0x7f37a4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a903eeb35e4b94f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:44.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.529+0000 7f37b27fc700 1 -- 172.21.15.71:0/4145297378 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a400cc90 con 0x7f379c003a60 2023-10-09T06:42:44.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.529+0000 7f37b27fc700 1 -- 172.21.15.71:0/4145297378 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a400ce10 con 0x7f379c003a60 2023-10-09T06:42:44.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.529+0000 7f37b27fc700 1 -- 172.21.15.71:0/4145297378 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a4005b70 con 0x7f379c003a60 2023-10-09T06:42:44.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.529+0000 7f37b9fff700 1 -- 172.21.15.71:0/4145297378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f379c003a60 msgr2=0x7f379c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:44.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.529+0000 7f37b9fff700 1 --2- 172.21.15.71:0/4145297378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f379c003a60 0x7f379c003e30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f37a400c3c0 tx=0x7f37a4001e70 comp rx=0 tx=0).stop 2023-10-09T06:42:44.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.529+0000 7f37b9fff700 1 -- 172.21.15.71:0/4145297378 shutdown_connections 2023-10-09T06:42:44.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.529+0000 7f37b9fff700 1 --2- 172.21.15.71:0/4145297378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f379c003a60 0x7f379c003e30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:44.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.529+0000 7f37b9fff700 1 -- 172.21.15.71:0/4145297378 >> 172.21.15.71:0/4145297378 conn(0x7f37b406a320 msgr2=0x7f37b40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:44.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.529+0000 7f37b9fff700 1 -- 172.21.15.71:0/4145297378 shutdown_connections 2023-10-09T06:42:44.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.529+0000 7f37b9fff700 1 -- 172.21.15.71:0/4145297378 wait complete. 2023-10-09T06:42:44.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.531+0000 7f37b9fff700 1 Processor -- start 2023-10-09T06:42:44.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.531+0000 7f37b9fff700 1 -- start start 2023-10-09T06:42:44.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.532+0000 7f37b9fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f379c003a60 0x7f37b4156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:44.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.532+0000 7f37b9fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37b41583a0 0x7f37b40ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:44.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.532+0000 7f37b9fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37b40abe20 0x7f37b40c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:44.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.532+0000 7f37b9fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b40ac290 con 0x7f37b40abe20 2023-10-09T06:42:44.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.532+0000 7f37b9fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b40c12d0 con 0x7f379c003a60 2023-10-09T06:42:44.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.532+0000 7f37b9fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b4157580 con 0x7f37b41583a0 2023-10-09T06:42:44.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.532+0000 7f37b3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37b40abe20 0x7f37b40c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:44.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.532+0000 7f37b3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37b40abe20 0x7f37b40c1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44158/0 (socket says 172.21.15.71:44158) 2023-10-09T06:42:44.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.532+0000 7f37b3fff700 1 -- 172.21.15.71:0/3406462906 learned_addr learned my addr 172.21.15.71:0/3406462906 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:44.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.532+0000 7f37b37fe700 1 --2- 172.21.15.71:0/3406462906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f379c003a60 0x7f37b4156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:44.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.532+0000 7f37b2ffd700 1 --2- 172.21.15.71:0/3406462906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37b41583a0 0x7f37b40ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:44.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.533+0000 7f37b3fff700 1 -- 172.21.15.71:0/3406462906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37b41583a0 msgr2=0x7f37b40ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:44.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.533+0000 7f37b3fff700 1 --2- 172.21.15.71:0/3406462906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37b41583a0 0x7f37b40ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:44.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.533+0000 7f37b3fff700 1 -- 172.21.15.71:0/3406462906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f379c003a60 msgr2=0x7f37b4156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:44.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.533+0000 7f37b3fff700 1 --2- 172.21.15.71:0/3406462906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f379c003a60 0x7f37b4156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:44.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.533+0000 7f37b3fff700 1 -- 172.21.15.71:0/3406462906 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b4157860 con 0x7f37b40abe20 2023-10-09T06:42:44.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.533+0000 7f37b3fff700 1 --2- 172.21.15.71:0/3406462906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37b40abe20 0x7f37b40c1a40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f37b40b03d0 tx=0x7f37ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:44.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.533+0000 7f379b7fe700 1 -- 172.21.15.71:0/3406462906 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac01b070 con 0x7f37b40abe20 2023-10-09T06:42:44.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.533+0000 7f379b7fe700 1 -- 172.21.15.71:0/3406462906 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ac00f040 con 0x7f37b40abe20 2023-10-09T06:42:44.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.533+0000 7f37b9fff700 1 -- 172.21.15.71:0/3406462906 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b4157b40 con 0x7f37b40abe20 2023-10-09T06:42:44.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.533+0000 7f379b7fe700 1 -- 172.21.15.71:0/3406462906 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac00e050 con 0x7f37b40abe20 2023-10-09T06:42:44.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.533+0000 7f37b9fff700 1 -- 172.21.15.71:0/3406462906 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b4157270 con 0x7f37b40abe20 2023-10-09T06:42:44.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.534+0000 7f37b9fff700 1 -- 172.21.15.71:0/3406462906 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b40c1760 con 0x7f37b40abe20 2023-10-09T06:42:44.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.535+0000 7f379b7fe700 1 -- 172.21.15.71:0/3406462906 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f37ac003020 con 0x7f37b40abe20 2023-10-09T06:42:44.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.536+0000 7f379b7fe700 1 --2- 172.21.15.71:0/3406462906 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f37a0066f30 0x7f37a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:44.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.536+0000 7f379b7fe700 1 -- 172.21.15.71:0/3406462906 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f37ac084940 con 0x7f37b40abe20 2023-10-09T06:42:44.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.536+0000 7f37b37fe700 1 --2- 172.21.15.71:0/3406462906 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f37a0066f30 0x7f37a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:44.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.537+0000 7f37b37fe700 1 --2- 172.21.15.71:0/3406462906 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f37a0066f30 0x7f37a00693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f37a4001ed0 tx=0x7f37a4015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:44.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.540+0000 7f379b7fe700 1 -- 172.21.15.71:0/3406462906 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37b40c1760 con 0x7f37b40abe20 2023-10-09T06:42:44.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.735+0000 7f37b9fff700 1 -- 172.21.15.71:0/3406462906 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37b404c3c0 con 0x7f37b40abe20 2023-10-09T06:42:44.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.736+0000 7f379b7fe700 1 -- 172.21.15.71:0/3406462906 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f37ac051b10 con 0x7f37b40abe20 2023-10-09T06:42:44.737 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:42:44.738 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":20,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:42:39.546192+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:42:35.828340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:42:37.071896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:42:44.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.739+0000 7f37b9fff700 1 -- 172.21.15.71:0/3406462906 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f37a0066f30 msgr2=0x7f37a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:44.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.739+0000 7f37b9fff700 1 --2- 172.21.15.71:0/3406462906 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f37a0066f30 0x7f37a00693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f37a4001ed0 tx=0x7f37a4015000 comp rx=0 tx=0).stop 2023-10-09T06:42:44.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.739+0000 7f37b9fff700 1 -- 172.21.15.71:0/3406462906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37b40abe20 msgr2=0x7f37b40c1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:44.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.739+0000 7f37b9fff700 1 --2- 172.21.15.71:0/3406462906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37b40abe20 0x7f37b40c1a40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f37b40b03d0 tx=0x7f37ac00b040 comp rx=0 tx=0).stop 2023-10-09T06:42:44.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.739+0000 7f37b9fff700 1 -- 172.21.15.71:0/3406462906 shutdown_connections 2023-10-09T06:42:44.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.739+0000 7f37b9fff700 1 --2- 172.21.15.71:0/3406462906 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f37a0066f30 0x7f37a00693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:44.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.739+0000 7f37b9fff700 1 --2- 172.21.15.71:0/3406462906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37b40abe20 0x7f37b40c1a40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:44.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.739+0000 7f37b9fff700 1 --2- 172.21.15.71:0/3406462906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f379c003a60 0x7f37b4156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:44.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.739+0000 7f37b9fff700 1 --2- 172.21.15.71:0/3406462906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37b41583a0 0x7f37b40ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:44.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.739+0000 7f37b9fff700 1 -- 172.21.15.71:0/3406462906 >> 172.21.15.71:0/3406462906 conn(0x7f37b406a320 msgr2=0x7f37b406eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:44.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.739+0000 7f37b9fff700 1 -- 172.21.15.71:0/3406462906 shutdown_connections 2023-10-09T06:42:44.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:44.739+0000 7f37b9fff700 1 -- 172.21.15.71:0/3406462906 wait complete. 2023-10-09T06:42:44.757 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-09T06:42:44.758 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-09T06:42:44.758 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-09T06:42:44.759 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-09T06:42:44.759 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-09T06:42:44.759 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-09T06:42:44.760 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-09T06:42:44.760 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-09T06:42:45.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.082+0000 7fe40359e700 1 Processor -- start 2023-10-09T06:42:45.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.082+0000 7f1378f9d700 1 Processor -- start 2023-10-09T06:42:45.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.082+0000 7fe40359e700 1 -- start start 2023-10-09T06:42:45.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.082+0000 7f1378f9d700 1 -- start start 2023-10-09T06:42:45.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.084+0000 7f1378f9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f136c0e3f80 0x7f136c0e4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.084+0000 7f1378f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f136c0ea2b0 0x7f136c0ea6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.084+0000 7f1378f9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136c0eac30 con 0x7f136c006a40 2023-10-09T06:42:45.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.084+0000 7f1378f9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136c006fb0 con 0x7f136c0e3f80 2023-10-09T06:42:45.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.084+0000 7f1378f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136c007290 con 0x7f136c0ea2b0 2023-10-09T06:42:45.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.084+0000 7fe40359e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe3fc006a40 0x7fe3fc0e4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.084+0000 7fe40359e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3fc006fb0 con 0x7fe3fc0ea2b0 2023-10-09T06:42:45.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.084+0000 7fe40359e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3fc007290 con 0x7fe3fc0e3f80 2023-10-09T06:42:45.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.084+0000 7fe40359e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3fc007570 con 0x7fe3fc006a40 2023-10-09T06:42:45.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.085+0000 7fe402d9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe3fc0ea2b0 0x7fe3fc053630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58198/0 (socket says 172.21.15.71:58198) 2023-10-09T06:42:45.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.085+0000 7fe402d9d700 1 -- 172.21.15.71:0/896121176 learned_addr learned my addr 172.21.15.71:0/896121176 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:45.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.085+0000 7fe40159a700 1 -- 172.21.15.71:0/896121176 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248008626 0 0) 0x7fe3fc006fb0 con 0x7fe3fc0ea2b0 2023-10-09T06:42:45.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.085+0000 7fe40159a700 1 -- 172.21.15.71:0/896121176 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3ec003570 con 0x7fe3fc0ea2b0 2023-10-09T06:42:45.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.086+0000 7f1373fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f136c0ea2b0 0x7f136c0ea6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.086+0000 7f1373fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f136c0ea2b0 0x7f136c0ea6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:49144/0 (socket says 172.21.15.71:49144) 2023-10-09T06:42:45.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.086+0000 7f1373fff700 1 -- 172.21.15.71:0/193227463 learned_addr learned my addr 172.21.15.71:0/193227463 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.086+0000 7fe401d9b700 1 --2- 172.21.15.71:0/896121176 >> v2:172.21.15.71:3300/0 conn(0x7fe3fc006a40 0x7fe3fc0e4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.086+0000 7fe40159a700 1 -- 172.21.15.71:0/896121176 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1385704588 0 0) 0x7fe3ec003570 con 0x7fe3fc0ea2b0 2023-10-09T06:42:45.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.086+0000 7fe401d9b700 1 -- 172.21.15.71:0/896121176 >> v1:172.21.15.179:6789/0 conn(0x7fe3fc0e3f80 legacy=0x7fe3fc04ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.086+0000 7fe401d9b700 1 -- 172.21.15.71:0/896121176 >> v1:172.21.15.71:6789/0 conn(0x7fe3fc0ea2b0 legacy=0x7fe3fc053630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.087+0000 7fe401d9b700 1 -- 172.21.15.71:0/896121176 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc007850 con 0x7fe3fc006a40 2023-10-09T06:42:45.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.087+0000 7f1373fff700 1 -- 172.21.15.71:0/193227463 >> v2:172.21.15.71:3300/0 conn(0x7f136c0e3f80 msgr2=0x7f136c0e4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.087+0000 7fe401d9b700 1 --2- 172.21.15.71:0/896121176 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc006a40 0x7fe3fc0e4350 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80098e0 tx=0x7fe3f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925532f5e5b6fec1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.087+0000 7f1373fff700 1 --2- 172.21.15.71:0/193227463 >> v2:172.21.15.71:3300/0 conn(0x7f136c0e3f80 0x7f136c0e4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.087+0000 7f1373fff700 1 -- 172.21.15.71:0/193227463 >> v1:172.21.15.71:6789/0 conn(0x7f136c006a40 legacy=0x7f136c04ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.087+0000 7f1373fff700 1 -- 172.21.15.71:0/193227463 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c007570 con 0x7f136c0ea2b0 2023-10-09T06:42:45.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.087+0000 7f35015ff700 1 Processor -- start 2023-10-09T06:42:45.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.088+0000 7f35015ff700 1 -- start start 2023-10-09T06:42:45.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.088+0000 7fe40159a700 1 -- 172.21.15.71:0/896121176 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40404c9a0 con 0x7fe3fc006a40 2023-10-09T06:42:45.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.088+0000 7fe40159a700 1 -- 172.21.15.71:0/896121176 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f8011420 con 0x7fe3fc006a40 2023-10-09T06:42:45.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.088+0000 7fe40159a700 1 -- 172.21.15.71:0/896121176 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f80117c0 con 0x7fe3fc006a40 2023-10-09T06:42:45.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.089+0000 7f1373fff700 1 --2- 172.21.15.71:0/193227463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f136c0ea2b0 0x7f136c0ea6f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f136c04faf0 tx=0x7f1360009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=322a91be48e35353 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.089+0000 7fe2be9ff700 1 Processor -- start 2023-10-09T06:42:45.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.089+0000 7fe40359e700 1 -- 172.21.15.71:0/896121176 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc006a40 msgr2=0x7fe3fc0e4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.089+0000 7fe40359e700 1 --2- 172.21.15.71:0/896121176 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc006a40 0x7fe3fc0e4350 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80098e0 tx=0x7fe3f80091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.090+0000 7f35015ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f34f4039360 0x7f34f4054350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.089+0000 7fe2be9ff700 1 -- start start 2023-10-09T06:42:45.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.090+0000 7f35015ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f4039ae0 con 0x7f34f40e1ef0 2023-10-09T06:42:45.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.090+0000 7f35015ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f4054890 con 0x7f34f4053f00 2023-10-09T06:42:45.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.090+0000 7fe40359e700 1 -- 172.21.15.71:0/896121176 shutdown_connections 2023-10-09T06:42:45.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.090+0000 7f35015ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f40556d0 con 0x7f34f4039360 2023-10-09T06:42:45.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.090+0000 7f34fa7fc700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f34f4053f00 0x7f34f4038c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:47186/0 (socket says 172.21.15.71:47186) 2023-10-09T06:42:45.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.090+0000 7f34fa7fc700 1 -- 172.21.15.71:0/2793443527 learned_addr learned my addr 172.21.15.71:0/2793443527 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:45.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.090+0000 7f13727fc700 1 -- 172.21.15.71:0/193227463 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136000b820 con 0x7f136c0ea2b0 2023-10-09T06:42:45.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.090+0000 7f13727fc700 1 -- 172.21.15.71:0/193227463 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136000b980 con 0x7f136c0ea2b0 2023-10-09T06:42:45.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.090+0000 7f13727fc700 1 -- 172.21.15.71:0/193227463 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136000bd20 con 0x7f136c0ea2b0 2023-10-09T06:42:45.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.090+0000 7fe40359e700 1 --2- 172.21.15.71:0/896121176 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc006a40 0x7fe3fc0e4350 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.090+0000 7fe40359e700 1 -- 172.21.15.71:0/896121176 >> 172.21.15.71:0/896121176 conn(0x7fe3fc054da0 msgr2=0x7fe3fc0551a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.091+0000 7f34fb7fe700 1 --2- 172.21.15.71:0/2793443527 >> v2:172.21.15.71:3300/0 conn(0x7f34f4039360 0x7f34f4054350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.091+0000 7f34f9ffb700 1 -- 172.21.15.71:0/2793443527 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2362615357 0 0) 0x7f34f4054890 con 0x7f34f4053f00 2023-10-09T06:42:45.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.091+0000 7f34f9ffb700 1 -- 172.21.15.71:0/2793443527 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34e4003570 con 0x7f34f4053f00 2023-10-09T06:42:45.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.091+0000 7f34f9ffb700 1 -- 172.21.15.71:0/2793443527 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260061732 0 0) 0x7f34f4039ae0 con 0x7f34f40e1ef0 2023-10-09T06:42:45.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.091+0000 7f34f9ffb700 1 -- 172.21.15.71:0/2793443527 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34f4054890 con 0x7f34f40e1ef0 2023-10-09T06:42:45.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.091+0000 7f34f9ffb700 1 -- 172.21.15.71:0/2793443527 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1133754691 0 0) 0x7f34e4003570 con 0x7f34f4053f00 2023-10-09T06:42:45.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.091+0000 7f34f9ffb700 1 -- 172.21.15.71:0/2793443527 >> v2:172.21.15.71:3300/0 conn(0x7f34f4039360 msgr2=0x7f34f4054350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.091+0000 7f34f9ffb700 1 --2- 172.21.15.71:0/2793443527 >> v2:172.21.15.71:3300/0 conn(0x7f34f4039360 0x7f34f4054350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.091+0000 7f34f9ffb700 1 -- 172.21.15.71:0/2793443527 >> v1:172.21.15.71:6789/0 conn(0x7f34f40e1ef0 legacy=0x7f34f40e22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.092+0000 7f34f9ffb700 1 -- 172.21.15.71:0/2793443527 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f4054ac0 con 0x7f34f4053f00 2023-10-09T06:42:45.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.091+0000 7fe2be9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2b815db40 0x7fe2b8068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.091+0000 7fe2be9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe2b80c2f90 0x7fe2b80c8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.092+0000 7fe2be9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b8069580 con 0x7fe2b80ce1f0 2023-10-09T06:42:45.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.092+0000 7fe2be9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b8068970 con 0x7fe2b80c2f90 2023-10-09T06:42:45.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.092+0000 7fe2be9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b8068c50 con 0x7fe2b815db40 2023-10-09T06:42:45.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.092+0000 7f34f9ffb700 1 -- 172.21.15.71:0/2793443527 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f34fc04c0e0 con 0x7f34f4053f00 2023-10-09T06:42:45.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.092+0000 7f34f9ffb700 1 -- 172.21.15.71:0/2793443527 >> v1:172.21.15.179:6789/0 conn(0x7f34f4053f00 legacy=0x7f34f4038c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.092+0000 7f34f9ffb700 1 --2- 172.21.15.71:0/2793443527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34e4003bf0 0x7f34e4003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.092+0000 7f34f9ffb700 1 --2- 172.21.15.71:0/2793443527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34e4004810 0x7f34e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.093+0000 7f34f9ffb700 1 --2- 172.21.15.71:0/2793443527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34e40051c0 0x7f34e400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.092+0000 7fe2b7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2b815db40 0x7fe2b8068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.092+0000 7fe2b7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2b815db40 0x7fe2b8068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:49058/0 (socket says 172.21.15.71:49058) 2023-10-09T06:42:45.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.092+0000 7fe2b7fff700 1 -- 172.21.15.71:0/1703138109 learned_addr learned my addr 172.21.15.71:0/1703138109 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.092+0000 7fe2b7fff700 1 -- 172.21.15.71:0/1703138109 >> v2:172.21.15.179:3300/0 conn(0x7fe2b80c2f90 msgr2=0x7fe2b80c8200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-09T06:42:45.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.092+0000 7fe2b7fff700 1 --2- 172.21.15.71:0/1703138109 >> v2:172.21.15.179:3300/0 conn(0x7fe2b80c2f90 0x7fe2b80c8200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.092+0000 7fe2b7fff700 1 -- 172.21.15.71:0/1703138109 >> v1:172.21.15.179:6789/0 conn(0x7fe2b80ce1f0 legacy=0x7fe2b80c2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.093+0000 7f34f9ffb700 1 -- 172.21.15.71:0/2793443527 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f0001230 con 0x7f34e4004810 2023-10-09T06:42:45.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.093+0000 7fe2b7fff700 1 -- 172.21.15.71:0/1703138109 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b8068f30 con 0x7fe2b815db40 2023-10-09T06:42:45.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.093+0000 7f34f9ffb700 1 -- 172.21.15.71:0/2793443527 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f40556d0 con 0x7f34e4003bf0 2023-10-09T06:42:45.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.093+0000 7f34f9ffb700 1 -- 172.21.15.71:0/2793443527 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e400c020 con 0x7f34e40051c0 2023-10-09T06:42:45.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.093+0000 7fe2b7fff700 1 --2- 172.21.15.71:0/1703138109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2b815db40 0x7fe2b8068390 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe2b00099b0 tx=0x7fe2b0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4ae28a5d9277882 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.093+0000 7f1378f9d700 1 -- 172.21.15.71:0/193227463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f136c0ea2b0 msgr2=0x7f136c0ea6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.093+0000 7f1378f9d700 1 --2- 172.21.15.71:0/193227463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f136c0ea2b0 0x7f136c0ea6f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f136c04faf0 tx=0x7f1360009250 comp rx=0 tx=0).stop 2023-10-09T06:42:45.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.093+0000 7f1378f9d700 1 -- 172.21.15.71:0/193227463 shutdown_connections 2023-10-09T06:42:45.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.093+0000 7f1378f9d700 1 --2- 172.21.15.71:0/193227463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f136c0ea2b0 0x7f136c0ea6f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.093+0000 7f1378f9d700 1 --2- 172.21.15.71:0/193227463 >> v2:172.21.15.71:3300/0 conn(0x7f136c0e3f80 0x7f136c0e4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.093+0000 7fe40359e700 1 -- 172.21.15.71:0/896121176 shutdown_connections 2023-10-09T06:42:45.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.093+0000 7f34fb7fe700 1 --2- 172.21.15.71:0/2793443527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34e40051c0 0x7f34e400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.093+0000 7f1378f9d700 1 -- 172.21.15.71:0/193227463 >> 172.21.15.71:0/193227463 conn(0x7f136c054da0 msgr2=0x7f136c0551a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.093+0000 7f1378f9d700 1 -- 172.21.15.71:0/193227463 shutdown_connections 2023-10-09T06:42:45.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.093+0000 7f34faffd700 1 --2- 172.21.15.71:0/2793443527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34e4003bf0 0x7f34e4003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.093+0000 7fe40359e700 1 -- 172.21.15.71:0/896121176 wait complete. 2023-10-09T06:42:45.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.094+0000 7f34faffd700 1 -- 172.21.15.71:0/2793443527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34e40051c0 msgr2=0x7f34e400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.094+0000 7f34faffd700 1 --2- 172.21.15.71:0/2793443527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34e40051c0 0x7f34e400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.094+0000 7f34faffd700 1 -- 172.21.15.71:0/2793443527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34e4004810 msgr2=0x7f34e4004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T06:42:45.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.094+0000 7f34faffd700 1 --2- 172.21.15.71:0/2793443527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34e4004810 0x7f34e4004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.094+0000 7f34faffd700 1 -- 172.21.15.71:0/2793443527 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e4003570 con 0x7f34e4003bf0 2023-10-09T06:42:45.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.094+0000 7f34fb7fe700 1 -- 172.21.15.71:0/2793443527 reap_dead start 2023-10-09T06:42:45.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.093+0000 7f1378f9d700 1 -- 172.21.15.71:0/193227463 wait complete. 2023-10-09T06:42:45.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.095+0000 7fe40359e700 1 Processor -- start 2023-10-09T06:42:45.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.095+0000 7fe40359e700 1 -- start start 2023-10-09T06:42:45.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.095+0000 7f34faffd700 1 --2- 172.21.15.71:0/2793443527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34e4003bf0 0x7f34e4003fc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f34f0001050 tx=0x7f34f0001dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c0f0b01af3c23 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.096+0000 7fe2b6ffd700 1 -- 172.21.15.71:0/1703138109 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b000b820 con 0x7fe2b815db40 2023-10-09T06:42:45.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.096+0000 7fe2b6ffd700 1 -- 172.21.15.71:0/1703138109 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b000b980 con 0x7fe2b815db40 2023-10-09T06:42:45.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.096+0000 7fe2b6ffd700 1 -- 172.21.15.71:0/1703138109 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b000bd20 con 0x7fe2b815db40 2023-10-09T06:42:45.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.096+0000 7f1378f9d700 1 Processor -- start 2023-10-09T06:42:45.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.096+0000 7fe40359e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc006a40 0x7fe3fc04d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.096+0000 7fe40359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3fc0e3f80 0x7fe3fc0e6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.096+0000 7fe40359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3fc0ea2b0 0x7fe3fc0ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.097+0000 7fe40359e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0e7170 con 0x7fe3fc006a40 2023-10-09T06:42:45.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.097+0000 7fe40359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc04be50 con 0x7fe3fc0ea2b0 2023-10-09T06:42:45.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.097+0000 7fe2be9ff700 1 -- 172.21.15.71:0/1703138109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2b815db40 msgr2=0x7fe2b8068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.097+0000 7fe2be9ff700 1 --2- 172.21.15.71:0/1703138109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2b815db40 0x7fe2b8068390 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe2b00099b0 tx=0x7fe2b0009250 comp rx=0 tx=0).stop 2023-10-09T06:42:45.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.097+0000 7fe401d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3fc0e3f80 0x7fe3fc0e6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.097+0000 7fe40359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0cf530 con 0x7fe3fc0e3f80 2023-10-09T06:42:45.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.097+0000 7f34f9ffb700 1 -- 172.21.15.71:0/2793443527 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f000ca80 con 0x7f34e4003bf0 2023-10-09T06:42:45.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.097+0000 7fe402d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3fc0ea2b0 0x7fe3fc0ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.097+0000 7f34f9ffb700 1 -- 172.21.15.71:0/2793443527 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f000cc00 con 0x7f34e4003bf0 2023-10-09T06:42:45.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.097+0000 7f34f9ffb700 1 -- 172.21.15.71:0/2793443527 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f0012400 con 0x7f34e4003bf0 2023-10-09T06:42:45.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.098+0000 7fe2be9ff700 1 -- 172.21.15.71:0/1703138109 shutdown_connections 2023-10-09T06:42:45.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.098+0000 7fe2be9ff700 1 --2- 172.21.15.71:0/1703138109 >> v2:172.21.15.179:3300/0 conn(0x7fe2b80c2f90 0x7fe2b80c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.098+0000 7fe2be9ff700 1 --2- 172.21.15.71:0/1703138109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2b815db40 0x7fe2b8068390 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.098+0000 7fe2be9ff700 1 -- 172.21.15.71:0/1703138109 >> 172.21.15.71:0/1703138109 conn(0x7fe2b806a5c0 msgr2=0x7fe2b80cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.097+0000 7fe402d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3fc0ea2b0 0x7fe3fc0ceff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:49162/0 (socket says 172.21.15.71:49162) 2023-10-09T06:42:45.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.097+0000 7fe402d9d700 1 -- 172.21.15.71:0/2398361664 learned_addr learned my addr 172.21.15.71:0/2398361664 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.097+0000 7fe40259c700 1 --2- 172.21.15.71:0/2398361664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc006a40 0x7fe3fc04d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.098+0000 7fe402d9d700 1 -- 172.21.15.71:0/2398361664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3fc0e3f80 msgr2=0x7fe3fc0e6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.098+0000 7fe402d9d700 1 --2- 172.21.15.71:0/2398361664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3fc0e3f80 0x7fe3fc0e6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.098+0000 7fe402d9d700 1 -- 172.21.15.71:0/2398361664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc006a40 msgr2=0x7fe3fc04d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.098+0000 7fe402d9d700 1 --2- 172.21.15.71:0/2398361664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc006a40 0x7fe3fc04d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.098+0000 7f35015ff700 1 -- 172.21.15.71:0/2793443527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34e4003bf0 msgr2=0x7f34e4003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.098+0000 7f35015ff700 1 --2- 172.21.15.71:0/2793443527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34e4003bf0 0x7f34e4003fc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f34f0001050 tx=0x7f34f0001dc0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.098+0000 7fe402d9d700 1 -- 172.21.15.71:0/2398361664 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f8009420 con 0x7fe3fc0ea2b0 2023-10-09T06:42:45.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.099+0000 7fe402d9d700 1 --2- 172.21.15.71:0/2398361664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3fc0ea2b0 0x7fe3fc0ceff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe4040701a0 tx=0x7fe404067410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.099+0000 7fe2be9ff700 1 -- 172.21.15.71:0/1703138109 shutdown_connections 2023-10-09T06:42:45.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.099+0000 7fe2be9ff700 1 -- 172.21.15.71:0/1703138109 wait complete. 2023-10-09T06:42:45.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.096+0000 7f1378f9d700 1 -- start start 2023-10-09T06:42:45.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.098+0000 7f1378f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f136c006a40 0x7f136c0e0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.098+0000 7f1378f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f136c0e3f80 0x7f136c036030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.098+0000 7f1378f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f136c0ea2b0 0x7f136c036570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.098+0000 7f1378f9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c0e0aa0 con 0x7f136c0e3f80 2023-10-09T06:42:45.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.098+0000 7f1378f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c0e6190 con 0x7f136c0ea2b0 2023-10-09T06:42:45.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.098+0000 7f1378f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c0e50f0 con 0x7f136c006a40 2023-10-09T06:42:45.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.099+0000 7f1372ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f136c0e3f80 0x7f136c036030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.099+0000 7f1372ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f136c0e3f80 0x7f136c036030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51936/0 (socket says 172.21.15.71:51936) 2023-10-09T06:42:45.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.099+0000 7f1372ffd700 1 -- 172.21.15.71:0/4039396646 learned_addr learned my addr 172.21.15.71:0/4039396646 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.099+0000 7f1372ffd700 1 -- 172.21.15.71:0/4039396646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f136c006a40 msgr2=0x7f136c0e0560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:42:45.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.099+0000 7f1372ffd700 1 --2- 172.21.15.71:0/4039396646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f136c006a40 0x7f136c0e0560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.099+0000 7f1372ffd700 1 -- 172.21.15.71:0/4039396646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f136c0ea2b0 msgr2=0x7f136c036570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:42:45.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.099+0000 7f1372ffd700 1 --2- 172.21.15.71:0/4039396646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f136c0ea2b0 0x7f136c036570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.099+0000 7f1372ffd700 1 -- 172.21.15.71:0/4039396646 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13600094f0 con 0x7f136c0e3f80 2023-10-09T06:42:45.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.099+0000 7fe3f27fc700 1 -- 172.21.15.71:0/2398361664 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40404c440 con 0x7fe3fc0ea2b0 2023-10-09T06:42:45.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.099+0000 7fe3f27fc700 1 -- 172.21.15.71:0/2398361664 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40406a410 con 0x7fe3fc0ea2b0 2023-10-09T06:42:45.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.099+0000 7fe3f27fc700 1 -- 172.21.15.71:0/2398361664 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40406a810 con 0x7fe3fc0ea2b0 2023-10-09T06:42:45.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.100+0000 7fe40359e700 1 -- 172.21.15.71:0/2398361664 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3fc0fa990 con 0x7fe3fc0ea2b0 2023-10-09T06:42:45.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.100+0000 7fe40359e700 1 -- 172.21.15.71:0/2398361664 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3fc0faef0 con 0x7fe3fc0ea2b0 2023-10-09T06:42:45.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.101+0000 7f35015ff700 1 -- 172.21.15.71:0/2793443527 shutdown_connections 2023-10-09T06:42:45.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.101+0000 7f35015ff700 1 --2- 172.21.15.71:0/2793443527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34e4003bf0 0x7f34e4003fc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.101+0000 7f35015ff700 1 -- 172.21.15.71:0/2793443527 >> 172.21.15.71:0/2793443527 conn(0x7f34f400f0b0 msgr2=0x7f34f4059070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.101+0000 7fe2be9ff700 1 Processor -- start 2023-10-09T06:42:45.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.101+0000 7f35015ff700 1 -- 172.21.15.71:0/2793443527 shutdown_connections 2023-10-09T06:42:45.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.101+0000 7f35015ff700 1 -- 172.21.15.71:0/2793443527 wait complete. 2023-10-09T06:42:45.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.100+0000 7f1372ffd700 1 --2- 172.21.15.71:0/4039396646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f136c0e3f80 0x7f136c036030 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1374076970 tx=0x7f1374067410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.100+0000 7f135f7fe700 1 -- 172.21.15.71:0/4039396646 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374068010 con 0x7f136c0e3f80 2023-10-09T06:42:45.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.100+0000 7f135f7fe700 1 -- 172.21.15.71:0/4039396646 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13740648e0 con 0x7f136c0e3f80 2023-10-09T06:42:45.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.100+0000 7f135f7fe700 1 -- 172.21.15.71:0/4039396646 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137406a680 con 0x7f136c0e3f80 2023-10-09T06:42:45.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.102+0000 7f95d8fff700 1 Processor -- start 2023-10-09T06:42:45.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.100+0000 7f1378f9d700 1 -- 172.21.15.71:0/4039396646 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136c0e53d0 con 0x7f136c0e3f80 2023-10-09T06:42:45.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.101+0000 7f1378f9d700 1 -- 172.21.15.71:0/4039396646 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136c0e5990 con 0x7f136c0e3f80 2023-10-09T06:42:45.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.101+0000 7f1378f9d700 1 -- 172.21.15.71:0/4039396646 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f136c0054e0 con 0x7f136c0e3f80 2023-10-09T06:42:45.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.102+0000 7f1a9cdff700 1 Processor -- start 2023-10-09T06:42:45.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.102+0000 7f1a9cdff700 1 -- start start 2023-10-09T06:42:45.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.102+0000 7f95d8fff700 1 -- start start 2023-10-09T06:42:45.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.102+0000 7fe3e3fff700 1 -- 172.21.15.71:0/2398361664 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe3fc0054e0 con 0x7fe3fc0ea2b0 2023-10-09T06:42:45.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.103+0000 7fe3f27fc700 1 -- 172.21.15.71:0/2398361664 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe404090430 con 0x7fe3fc0ea2b0 2023-10-09T06:42:45.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.103+0000 7f35015ff700 1 Processor -- start 2023-10-09T06:42:45.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.103+0000 7fd309bff700 1 Processor -- start 2023-10-09T06:42:45.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.102+0000 7fe2be9ff700 1 -- start start 2023-10-09T06:42:45.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.103+0000 7fe2be9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2b80c2f90 0x7fe2b815e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.104+0000 7f95d8fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f95d4159a10 0x7f95d40c7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.104+0000 7fe2be9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2b80ce1f0 0x7fe2b815b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.104+0000 7f95d8fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95d406f500 0x7f95d406dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.104+0000 7fe2be9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2b815db40 0x7fe2b812ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.104+0000 7f95d8fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d406f070 con 0x7f95d40cadc0 2023-10-09T06:42:45.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.104+0000 7f95d8fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d40c7e40 con 0x7f95d4159a10 2023-10-09T06:42:45.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.104+0000 7f95d8fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d406e460 con 0x7f95d406f500 2023-10-09T06:42:45.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.104+0000 7f95d259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f95d4159a10 0x7f95d40c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.104+0000 7f1a9cdff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1a98159890 0x7f1a9815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.104+0000 7f1a9cdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a98159c60 0x7f1a9815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.104+0000 7f1a9cdff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a9815a160 con 0x7f1a9815db10 2023-10-09T06:42:45.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.104+0000 7f1a9cdff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a980d13a0 con 0x7f1a98159890 2023-10-09T06:42:45.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.104+0000 7f1a9cdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9815e140 con 0x7f1a98159c60 2023-10-09T06:42:45.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.104+0000 7f35015ff700 1 -- start start 2023-10-09T06:42:45.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.104+0000 7f95d259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f95d4159a10 0x7f95d40c7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51940/0 (socket says 172.21.15.71:51940) 2023-10-09T06:42:45.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.104+0000 7f95d259c700 1 -- 172.21.15.71:0/501580096 learned_addr learned my addr 172.21.15.71:0/501580096 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.104+0000 7fe2b7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2b80c2f90 0x7fe2b815e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.104+0000 7fe2b7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2b80c2f90 0x7fe2b815e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:49172/0 (socket says 172.21.15.71:49172) 2023-10-09T06:42:45.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.104+0000 7f1a95d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a98159c60 0x7f1a9815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.105+0000 7f1a95d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a98159c60 0x7f1a9815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:49096/0 (socket says 172.21.15.71:49096) 2023-10-09T06:42:45.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.105+0000 7f1a95d9b700 1 -- 172.21.15.71:0/547622626 learned_addr learned my addr 172.21.15.71:0/547622626 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.105+0000 7fe2b77fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2b80ce1f0 0x7fe2b815b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.105+0000 7fe2b77fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2b80ce1f0 0x7fe2b815b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:49078/0 (socket says 172.21.15.71:49078) 2023-10-09T06:42:45.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.105+0000 7f1a95d9b700 1 -- 172.21.15.71:0/547622626 >> v2:172.21.15.71:3300/0 conn(0x7f1a98159890 msgr2=0x7f1a9815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.105+0000 7f1a95d9b700 1 --2- 172.21.15.71:0/547622626 >> v2:172.21.15.71:3300/0 conn(0x7f1a98159890 0x7f1a9815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.105+0000 7f1a95d9b700 1 -- 172.21.15.71:0/547622626 >> v1:172.21.15.179:6789/0 conn(0x7f1a9815db10 legacy=0x7f1a98069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.105+0000 7f1a95d9b700 1 -- 172.21.15.71:0/547622626 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9815a3d0 con 0x7f1a98159c60 2023-10-09T06:42:45.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.105+0000 7f95d259c700 1 -- 172.21.15.71:0/501580096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95d406f500 msgr2=0x7f95d406dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.105+0000 7f95d259c700 1 --2- 172.21.15.71:0/501580096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95d406f500 0x7f95d406dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.105+0000 7f95d259c700 1 -- 172.21.15.71:0/501580096 >> v1:172.21.15.179:6789/0 conn(0x7f95d40cadc0 legacy=0x7f95d4069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.105+0000 7f95d259c700 1 -- 172.21.15.71:0/501580096 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d406e740 con 0x7f95d4159a10 2023-10-09T06:42:45.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.105+0000 7f1a95d9b700 1 --2- 172.21.15.71:0/547622626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a98159c60 0x7f1a9815d5d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009f20 tx=0x7f1a90009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4c6192a00267a59 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.106+0000 7f35015ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34e4003bf0 0x7f34f40e3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.104+0000 7fe3f27fc700 1 --2- 172.21.15.71:0/2398361664 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe3e4067000 0x7fe3e40694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.104+0000 7fe3f27fc700 1 -- 172.21.15.71:0/2398361664 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe4040fbc40 con 0x7fe3fc0ea2b0 2023-10-09T06:42:45.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.104+0000 7fe40259c700 1 --2- 172.21.15.71:0/2398361664 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe3e4067000 0x7fe3e40694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.105+0000 7fe3f27fc700 1 --2- 172.21.15.71:0/2398361664 >> [v2:172.21.15.71:6816/85792,v1:172.21.15.71:6817/85792] conn(0x7fe3e406f210 0x7fe3e4071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.105+0000 7fe3f27fc700 1 -- 172.21.15.71:0/2398361664 --> [v2:172.21.15.71:6816/85792,v1:172.21.15.71:6817/85792] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe3e4071cd0 con 0x7fe3e406f210 2023-10-09T06:42:45.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.105+0000 7fe3f27fc700 1 -- 172.21.15.71:0/2398361664 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4041001c0 con 0x7fe3fc0ea2b0 2023-10-09T06:42:45.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.105+0000 7fe401d9b700 1 --2- 172.21.15.71:0/2398361664 >> [v2:172.21.15.71:6816/85792,v1:172.21.15.71:6817/85792] conn(0x7fe3e406f210 0x7fe3e4071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.105+0000 7fe40259c700 1 --2- 172.21.15.71:0/2398361664 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe3e4067000 0x7fe3e40694b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4003b80 tx=0x7fe3f4007e40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.106+0000 7fe401d9b700 1 --2- 172.21.15.71:0/2398361664 >> [v2:172.21.15.71:6816/85792,v1:172.21.15.71:6817/85792] conn(0x7fe3e406f210 0x7fe3e4071620 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.106+0000 7f35015ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34f40e1440 0x7f34f40e49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.106+0000 7f35015ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34f40e4f30 0x7f34f40e7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.106+0000 7f34faffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34e4003bf0 0x7f34f40e3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.106+0000 7f34faffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34e4003bf0 0x7f34f40e3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51968/0 (socket says 172.21.15.71:51968) 2023-10-09T06:42:45.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.106+0000 7f34faffd700 1 -- 172.21.15.71:0/37206612 learned_addr learned my addr 172.21.15.71:0/37206612 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.106+0000 7f35015ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f40e5c70 con 0x7f34e4003bf0 2023-10-09T06:42:45.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.107+0000 7f34fb7fe700 1 --2- 172.21.15.71:0/37206612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34f40e4f30 0x7f34f40e7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.107+0000 7f34fa7fc700 1 --2- 172.21.15.71:0/37206612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34f40e1440 0x7f34f40e49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.107+0000 7f35015ff700 1 -- 172.21.15.71:0/37206612 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f40ce4c0 con 0x7f34f40e4f30 2023-10-09T06:42:45.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.107+0000 7f35015ff700 1 -- 172.21.15.71:0/37206612 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f40e35a0 con 0x7f34f40e1440 2023-10-09T06:42:45.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.104+0000 7fd309bff700 1 -- start start 2023-10-09T06:42:45.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.106+0000 7fd309bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2fc0e6380 0x7fd2fc0e6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.106+0000 7fd309bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd2fc0ea9e0 0x7fd2fc034ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.106+0000 7fd309bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2fc053c10 con 0x7fd2fc034b80 2023-10-09T06:42:45.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.106+0000 7fd309bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2fc0eb150 con 0x7fd2fc0ea9e0 2023-10-09T06:42:45.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.106+0000 7fd309bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc053000 con 0x7fd2fc0e6380 2023-10-09T06:42:45.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.106+0000 7f1a9559a700 1 -- 172.21.15.71:0/547622626 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9000e070 con 0x7f1a98159c60 2023-10-09T06:42:45.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.106+0000 7f1a9559a700 1 -- 172.21.15.71:0/547622626 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9000ba40 con 0x7f1a98159c60 2023-10-09T06:42:45.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.106+0000 7f1a9559a700 1 -- 172.21.15.71:0/547622626 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a900092e0 con 0x7f1a98159c60 2023-10-09T06:42:45.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.107+0000 7f1a9cdff700 1 -- 172.21.15.71:0/547622626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a98159c60 msgr2=0x7f1a9815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.107+0000 7f1a9cdff700 1 --2- 172.21.15.71:0/547622626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a98159c60 0x7f1a9815d5d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009f20 tx=0x7f1a90009840 comp rx=0 tx=0).stop 2023-10-09T06:42:45.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.106+0000 7fe2bd79d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2b815db40 0x7fe2b812ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.106+0000 7fe2b7fff700 1 -- 172.21.15.71:0/3850731790 learned_addr learned my addr 172.21.15.71:0/3850731790 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.107+0000 7f1a9cdff700 1 -- 172.21.15.71:0/547622626 shutdown_connections 2023-10-09T06:42:45.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.107+0000 7f1a9cdff700 1 --2- 172.21.15.71:0/547622626 >> v2:172.21.15.71:3300/0 conn(0x7f1a98159890 0x7f1a9815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.107+0000 7f1a9cdff700 1 --2- 172.21.15.71:0/547622626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a98159c60 0x7f1a9815d5d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.107+0000 7f1a9cdff700 1 -- 172.21.15.71:0/547622626 >> 172.21.15.71:0/547622626 conn(0x7f1a98068e20 msgr2=0x7f1a980d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.108+0000 7fe2be9ff700 1 -- 172.21.15.71:0/3850731790 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b812f160 con 0x7fe2b815db40 2023-10-09T06:42:45.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.108+0000 7fe2be9ff700 1 -- 172.21.15.71:0/3850731790 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b8176230 con 0x7fe2b80c2f90 2023-10-09T06:42:45.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.108+0000 7fe2be9ff700 1 -- 172.21.15.71:0/3850731790 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b80b19b0 con 0x7fe2b80ce1f0 2023-10-09T06:42:45.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.107+0000 7f135f7fe700 1 -- 172.21.15.71:0/4039396646 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f137406aab0 con 0x7f136c0e3f80 2023-10-09T06:42:45.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.108+0000 7f135f7fe700 1 --2- 172.21.15.71:0/4039396646 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1358067080 0x7f1358069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.108+0000 7f135f7fe700 1 -- 172.21.15.71:0/4039396646 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f13740fbd10 con 0x7f136c0e3f80 2023-10-09T06:42:45.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.109+0000 7f135f7fe700 1 --2- 172.21.15.71:0/4039396646 >> [v2:172.21.15.71:6800/85788,v1:172.21.15.71:6801/85788] conn(0x7f135806f290 0x7f13580716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.109+0000 7f135f7fe700 1 -- 172.21.15.71:0/4039396646 --> [v2:172.21.15.71:6800/85788,v1:172.21.15.71:6801/85788] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1358071d50 con 0x7f135806f290 2023-10-09T06:42:45.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.109+0000 7f135f7fe700 1 -- 172.21.15.71:0/4039396646 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13740fc040 con 0x7f136c0e3f80 2023-10-09T06:42:45.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.107+0000 7f95d259c700 1 --2- 172.21.15.71:0/501580096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d4159a10 0x7f95d40c7900 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f95cc009f20 tx=0x7f95cc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9d7804c3f0b77b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.109+0000 7fe2b7fff700 1 -- 172.21.15.71:0/3850731790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2b80ce1f0 msgr2=0x7fe2b815b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.109+0000 7fe2b7fff700 1 --2- 172.21.15.71:0/3850731790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2b80ce1f0 0x7fe2b815b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.109+0000 7fe2b7fff700 1 -- 172.21.15.71:0/3850731790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2b815db40 msgr2=0x7fe2b812ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.109+0000 7fe2b7fff700 1 --2- 172.21.15.71:0/3850731790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2b815db40 0x7fe2b812ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.109+0000 7fe2b7fff700 1 -- 172.21.15.71:0/3850731790 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b00094f0 con 0x7fe2b80c2f90 2023-10-09T06:42:45.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.109+0000 7fe2bd79d700 1 --2- 172.21.15.71:0/3850731790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2b815db40 0x7fe2b812ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:42:45.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.110+0000 7f95d159a700 1 -- 172.21.15.71:0/501580096 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc00e070 con 0x7f95d4159a10 2023-10-09T06:42:45.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.110+0000 7f12ce5ff700 1 Processor -- start 2023-10-09T06:42:45.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.110+0000 7f95d159a700 1 -- 172.21.15.71:0/501580096 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95cc00ba40 con 0x7f95d4159a10 2023-10-09T06:42:45.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.110+0000 7f95d159a700 1 -- 172.21.15.71:0/501580096 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc0092e0 con 0x7f95d4159a10 2023-10-09T06:42:45.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.107+0000 7fd3037fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2fc0e6380 0x7fd2fc0e6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.107+0000 7fd3037fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2fc0e6380 0x7fd2fc0e6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:49104/0 (socket says 172.21.15.71:49104) 2023-10-09T06:42:45.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.107+0000 7fd3037fe700 1 -- 172.21.15.71:0/1362700262 learned_addr learned my addr 172.21.15.71:0/1362700262 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.107+0000 7fd303fff700 1 --2- 172.21.15.71:0/1362700262 >> v2:172.21.15.71:3300/0 conn(0x7fd2fc0ea9e0 0x7fd2fc034ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.107+0000 7fd3037fe700 1 -- 172.21.15.71:0/1362700262 >> v2:172.21.15.71:3300/0 conn(0x7fd2fc0ea9e0 msgr2=0x7fd2fc034ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.107+0000 7fd3037fe700 1 --2- 172.21.15.71:0/1362700262 >> v2:172.21.15.71:3300/0 conn(0x7fd2fc0ea9e0 0x7fd2fc034ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.107+0000 7fd3037fe700 1 -- 172.21.15.71:0/1362700262 >> v1:172.21.15.179:6789/0 conn(0x7fd2fc034b80 legacy=0x7fd2fc0ea2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.107+0000 7fd3037fe700 1 -- 172.21.15.71:0/1362700262 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc0532e0 con 0x7fd2fc0e6380 2023-10-09T06:42:45.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.110+0000 7f12ce5ff700 1 -- start start 2023-10-09T06:42:45.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.107+0000 7fd3027fc700 1 -- 172.21.15.71:0/1362700262 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848478374 0 0) 0x7fd2fc053c10 con 0x7fd2fc034b80 2023-10-09T06:42:45.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.108+0000 7fd303fff700 1 --2- 172.21.15.71:0/1362700262 >> v2:172.21.15.71:3300/0 conn(0x7fd2fc0ea9e0 0x7fd2fc034ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:45.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.108+0000 7fd3037fe700 1 --2- 172.21.15.71:0/1362700262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2fc0e6380 0x7fd2fc0e6750 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00099b0 tx=0x7fd2f0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efb7ca7cd7c24729 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.108+0000 7fd3027fc700 1 -- 172.21.15.71:0/1362700262 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f000b860 con 0x7fd2fc0e6380 2023-10-09T06:42:45.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.108+0000 7fd3027fc700 1 -- 172.21.15.71:0/1362700262 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f000b9c0 con 0x7fd2fc0e6380 2023-10-09T06:42:45.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.108+0000 7fd3027fc700 1 -- 172.21.15.71:0/1362700262 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f000b860 con 0x7fd2fc0e6380 2023-10-09T06:42:45.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.110+0000 7fd309bff700 1 -- 172.21.15.71:0/1362700262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2fc0e6380 msgr2=0x7fd2fc0e6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.110+0000 7fd309bff700 1 --2- 172.21.15.71:0/1362700262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2fc0e6380 0x7fd2fc0e6750 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00099b0 tx=0x7fd2f0009250 comp rx=0 tx=0).stop 2023-10-09T06:42:45.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.109+0000 7f13737fe700 1 --2- 172.21.15.71:0/4039396646 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1358067080 0x7f1358069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.109+0000 7f1373fff700 1 --2- 172.21.15.71:0/4039396646 >> [v2:172.21.15.71:6800/85788,v1:172.21.15.71:6801/85788] conn(0x7f135806f290 0x7f13580716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.110+0000 7f1373fff700 1 --2- 172.21.15.71:0/4039396646 >> [v2:172.21.15.71:6800/85788,v1:172.21.15.71:6801/85788] conn(0x7f135806f290 0x7f13580716a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.110+0000 7f34fa7fc700 1 -- 172.21.15.71:0/37206612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34f40e4f30 msgr2=0x7f34f40e7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.110+0000 7f34fa7fc700 1 --2- 172.21.15.71:0/37206612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34f40e4f30 0x7f34f40e7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.110+0000 7f34fa7fc700 1 -- 172.21.15.71:0/37206612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34e4003bf0 msgr2=0x7f34f40e3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.110+0000 7f34fa7fc700 1 --2- 172.21.15.71:0/37206612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34e4003bf0 0x7f34f40e3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.110+0000 7f34fa7fc700 1 -- 172.21.15.71:0/37206612 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f40e53d0 con 0x7f34f40e1440 2023-10-09T06:42:45.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.110+0000 7f34fa7fc700 1 --2- 172.21.15.71:0/37206612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34f40e1440 0x7f34f40e49f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f34fc04d1b0 tx=0x7f34f4055810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.111+0000 7fd309bff700 1 -- 172.21.15.71:0/1362700262 shutdown_connections 2023-10-09T06:42:45.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.111+0000 7fd309bff700 1 --2- 172.21.15.71:0/1362700262 >> v2:172.21.15.71:3300/0 conn(0x7fd2fc0ea9e0 0x7fd2fc034ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.111+0000 7fd309bff700 1 --2- 172.21.15.71:0/1362700262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2fc0e6380 0x7fd2fc0e6750 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.111+0000 7fd309bff700 1 -- 172.21.15.71:0/1362700262 >> 172.21.15.71:0/1362700262 conn(0x7fd2fc054e30 msgr2=0x7fd2fc055230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.111+0000 7f34e2ffd700 1 -- 172.21.15.71:0/37206612 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc06a620 con 0x7f34f40e1440 2023-10-09T06:42:45.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.111+0000 7f95d8fff700 1 -- 172.21.15.71:0/501580096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d4159a10 msgr2=0x7f95d40c7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.111+0000 7f95d8fff700 1 --2- 172.21.15.71:0/501580096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d4159a10 0x7f95d40c7900 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f95cc009f20 tx=0x7f95cc009840 comp rx=0 tx=0).stop 2023-10-09T06:42:45.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.111+0000 7f34e2ffd700 1 -- 172.21.15.71:0/37206612 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34fc06a780 con 0x7f34f40e1440 2023-10-09T06:42:45.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.111+0000 7f34e2ffd700 1 -- 172.21.15.71:0/37206612 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc06ab40 con 0x7f34f40e1440 2023-10-09T06:42:45.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.111+0000 7f35015ff700 1 -- 172.21.15.71:0/37206612 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f40e56b0 con 0x7f34f40e1440 2023-10-09T06:42:45.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.111+0000 7f95d8fff700 1 -- 172.21.15.71:0/501580096 shutdown_connections 2023-10-09T06:42:45.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.111+0000 7f95d8fff700 1 --2- 172.21.15.71:0/501580096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d4159a10 0x7f95d40c7900 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.112+0000 7f95d8fff700 1 --2- 172.21.15.71:0/501580096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95d406f500 0x7f95d406dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.112+0000 7f95d8fff700 1 -- 172.21.15.71:0/501580096 >> 172.21.15.71:0/501580096 conn(0x7f95d40cccb0 msgr2=0x7f95d40c8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.111+0000 7f35015ff700 1 -- 172.21.15.71:0/37206612 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f40e8500 con 0x7f34f40e1440 2023-10-09T06:42:45.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.112+0000 7f95d8fff700 1 -- 172.21.15.71:0/501580096 shutdown_connections 2023-10-09T06:42:45.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.112+0000 7f95d8fff700 1 -- 172.21.15.71:0/501580096 wait complete. 2023-10-09T06:42:45.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.112+0000 7f135f7fe700 1 -- 172.21.15.71:0/4039396646 <== osd.0 v2:172.21.15.71:6800/85788 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1358071d50 con 0x7f135806f290 2023-10-09T06:42:45.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.112+0000 7f34e0ff9700 1 -- 172.21.15.71:0/37206612 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f34f40ce290 con 0x7f34f40e1440 2023-10-09T06:42:45.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.112+0000 7f12ce5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12c8159890 0x7f12c815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.112+0000 7f12ce5ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f12c8159c60 0x7f12c815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.112+0000 7f12ce5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f12c815db10 0x7f12c8069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.113+0000 7f12ce5ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c815a160 con 0x7f12c8159c60 2023-10-09T06:42:45.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.113+0000 7f12ce5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c80d13a0 con 0x7f12c815db10 2023-10-09T06:42:45.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.113+0000 7f12ce5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c815e140 con 0x7f12c8159890 2023-10-09T06:42:45.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.113+0000 7f12c77fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f12c8159c60 0x7f12c815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.113+0000 7f12c77fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f12c8159c60 0x7f12c815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51998/0 (socket says 172.21.15.71:51998) 2023-10-09T06:42:45.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.113+0000 7f12c77fe700 1 -- 172.21.15.71:0/118231391 learned_addr learned my addr 172.21.15.71:0/118231391 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.114+0000 7f12c7fff700 1 --2- 172.21.15.71:0/118231391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12c8159890 0x7f12c815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.108+0000 7f1a9cdff700 1 -- 172.21.15.71:0/547622626 shutdown_connections 2023-10-09T06:42:45.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.108+0000 7f1a9cdff700 1 -- 172.21.15.71:0/547622626 wait complete. 2023-10-09T06:42:45.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.110+0000 7f1a9cdff700 1 Processor -- start 2023-10-09T06:42:45.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.110+0000 7f1a9cdff700 1 -- start start 2023-10-09T06:42:45.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.112+0000 7f1a9cdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a98159c60 0x7f1a9817ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.112+0000 7f1a9cdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a9815db10 0x7f1a9815e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.112+0000 7f1a9cdff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a9815ec30 0x7f1a980ce090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.112+0000 7f1a9cdff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9817b190 con 0x7f1a9815ec30 2023-10-09T06:42:45.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.112+0000 7f1a9cdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a98087e70 con 0x7f1a98159c60 2023-10-09T06:42:45.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.112+0000 7f1a9cdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9815f0a0 con 0x7f1a9815db10 2023-10-09T06:42:45.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.114+0000 7f1a95d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a9815db10 0x7f1a9815e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.114+0000 7f12c77fe700 1 -- 172.21.15.71:0/118231391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12c8159890 msgr2=0x7f12c815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.114+0000 7f95d8fff700 1 Processor -- start 2023-10-09T06:42:45.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.114+0000 7f12c77fe700 1 --2- 172.21.15.71:0/118231391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12c8159890 0x7f12c815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.114+0000 7f12c77fe700 1 -- 172.21.15.71:0/118231391 >> v2:172.21.15.179:3300/0 conn(0x7f12c815db10 msgr2=0x7f12c8069560 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-09T06:42:45.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.114+0000 7f1a95d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a9815db10 0x7f1a9815e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:49108/0 (socket says 172.21.15.71:49108) 2023-10-09T06:42:45.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.114+0000 7f1a95d9b700 1 -- 172.21.15.71:0/438015717 learned_addr learned my addr 172.21.15.71:0/438015717 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.107+0000 7fe3f27fc700 1 -- 172.21.15.71:0/2398361664 <== osd.1 v2:172.21.15.71:6816/85792 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe3e4071cd0 con 0x7fe3e406f210 2023-10-09T06:42:45.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.114+0000 7f12c77fe700 1 --2- 172.21.15.71:0/118231391 >> v2:172.21.15.179:3300/0 conn(0x7f12c815db10 0x7f12c8069560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.115+0000 7f95d8fff700 1 -- start start 2023-10-09T06:42:45.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.114+0000 7f12c77fe700 1 -- 172.21.15.71:0/118231391 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c815a3d0 con 0x7f12c8159c60 2023-10-09T06:42:45.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.114+0000 7f12c7fff700 1 --2- 172.21.15.71:0/118231391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12c8159890 0x7f12c815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:42:45.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.115+0000 7f12c77fe700 1 --2- 172.21.15.71:0/118231391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12c8159c60 0x7f12c815d5d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f12c8089b50 tx=0x7f12b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6372c5fcfa7f6063 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.114+0000 7f34e2ffd700 1 -- 172.21.15.71:0/37206612 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34fc090430 con 0x7f34f40e1440 2023-10-09T06:42:45.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.115+0000 7f34e2ffd700 1 --2- 172.21.15.71:0/37206612 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f34e8067080 0x7f34e8069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.115+0000 7f34e2ffd700 1 -- 172.21.15.71:0/37206612 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f34fc0fbe40 con 0x7f34f40e1440 2023-10-09T06:42:45.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.116+0000 7f34e2ffd700 1 --2- 172.21.15.71:0/37206612 >> [v2:172.21.15.71:6808/85789,v1:172.21.15.71:6809/85789] conn(0x7f34e806f290 0x7f34e80716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.116+0000 7f34faffd700 1 --2- 172.21.15.71:0/37206612 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f34e8067080 0x7f34e8069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.116+0000 7f34e2ffd700 1 -- 172.21.15.71:0/37206612 --> [v2:172.21.15.71:6808/85789,v1:172.21.15.71:6809/85789] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f34e8071d50 con 0x7f34e806f290 2023-10-09T06:42:45.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.116+0000 7f12c6ffd700 1 -- 172.21.15.71:0/118231391 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b4009e70 con 0x7f12c8159c60 2023-10-09T06:42:45.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.116+0000 7f34e2ffd700 1 -- 172.21.15.71:0/37206612 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34fc0fe3e0 con 0x7f34f40e1440 2023-10-09T06:42:45.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.111+0000 7fd309bff700 1 -- 172.21.15.71:0/1362700262 shutdown_connections 2023-10-09T06:42:45.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.111+0000 7fd309bff700 1 -- 172.21.15.71:0/1362700262 wait complete. 2023-10-09T06:42:45.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.116+0000 7f12c6ffd700 1 -- 172.21.15.71:0/118231391 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b400b860 con 0x7f12c8159c60 2023-10-09T06:42:45.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.113+0000 7fd309bff700 1 Processor -- start 2023-10-09T06:42:45.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.113+0000 7fd309bff700 1 -- start start 2023-10-09T06:42:45.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.116+0000 7f12c6ffd700 1 -- 172.21.15.71:0/118231391 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b400bc00 con 0x7f12c8159c60 2023-10-09T06:42:45.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.116+0000 7f95d8fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95d406f500 0x7f95d40aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.116+0000 7f1a9659c700 1 --2- 172.21.15.71:0/438015717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a98159c60 0x7f1a9817ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.116+0000 7f1a96d9d700 1 --2- 172.21.15.71:0/438015717 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a9815ec30 0x7f1a980ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.116+0000 7f95d8fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d40cadc0 0x7f95d41534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.115+0000 7fd309bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2fc034b80 0x7fd2fc04bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.115+0000 7fd309bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2fc0e6380 0x7fd2fc0e0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.115+0000 7fd309bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2fc0ea9e0 0x7fd2fc0bb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.115+0000 7fd309bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc04c420 con 0x7fd2fc0ea9e0 2023-10-09T06:42:45.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.115+0000 7fd309bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc0e0e90 con 0x7fd2fc0e6380 2023-10-09T06:42:45.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.115+0000 7fd309bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc035900 con 0x7fd2fc034b80 2023-10-09T06:42:45.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.116+0000 7fd3037fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2fc034b80 0x7fd2fc04bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.116+0000 7fd3037fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2fc034b80 0x7fd2fc04bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:49118/0 (socket says 172.21.15.71:49118) 2023-10-09T06:42:45.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.116+0000 7fd3037fe700 1 -- 172.21.15.71:0/3700797870 learned_addr learned my addr 172.21.15.71:0/3700797870 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.116+0000 7fd302ffd700 1 --2- 172.21.15.71:0/3700797870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2fc0e6380 0x7fd2fc0e0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.116+0000 7fd3037fe700 1 -- 172.21.15.71:0/3700797870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2fc0e6380 msgr2=0x7fd2fc0e0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.116+0000 7fd3037fe700 1 --2- 172.21.15.71:0/3700797870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2fc0e6380 0x7fd2fc0e0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.116+0000 7fd3037fe700 1 -- 172.21.15.71:0/3700797870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2fc0ea9e0 msgr2=0x7fd2fc0bb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.116+0000 7fd303fff700 1 --2- 172.21.15.71:0/3700797870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2fc0ea9e0 0x7fd2fc0bb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.116+0000 7fd3037fe700 1 --2- 172.21.15.71:0/3700797870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2fc0ea9e0 0x7fd2fc0bb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.116+0000 7fd3037fe700 1 -- 172.21.15.71:0/3700797870 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f00094f0 con 0x7fd2fc034b80 2023-10-09T06:42:45.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.116+0000 7fd303fff700 1 --2- 172.21.15.71:0/3700797870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2fc0ea9e0 0x7fd2fc0bb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:45.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.117+0000 7fd3037fe700 1 --2- 172.21.15.71:0/3700797870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2fc034b80 0x7fd2fc04bee0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009290 tx=0x7fd2f0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.117+0000 7f12ce5ff700 1 -- 172.21.15.71:0/118231391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12c8159c60 msgr2=0x7f12c815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.117+0000 7f12ce5ff700 1 --2- 172.21.15.71:0/118231391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12c8159c60 0x7f12c815d5d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f12c8089b50 tx=0x7f12b4009250 comp rx=0 tx=0).stop 2023-10-09T06:42:45.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.117+0000 7f34faffd700 1 --2- 172.21.15.71:0/37206612 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f34e8067080 0x7f34e8069530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f34f0007e50 tx=0x7f34f0010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.117+0000 7f34fb7fe700 1 --2- 172.21.15.71:0/37206612 >> [v2:172.21.15.71:6808/85789,v1:172.21.15.71:6809/85789] conn(0x7f34e806f290 0x7f34e80716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.117+0000 7f12ce5ff700 1 -- 172.21.15.71:0/118231391 shutdown_connections 2023-10-09T06:42:45.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.117+0000 7f12ce5ff700 1 --2- 172.21.15.71:0/118231391 >> v2:172.21.15.179:3300/0 conn(0x7f12c815db10 0x7f12c8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.117+0000 7f12ce5ff700 1 --2- 172.21.15.71:0/118231391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12c8159890 0x7f12c815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.117+0000 7f12ce5ff700 1 --2- 172.21.15.71:0/118231391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12c8159c60 0x7f12c815d5d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.117+0000 7f12ce5ff700 1 -- 172.21.15.71:0/118231391 >> 172.21.15.71:0/118231391 conn(0x7f12c8068e20 msgr2=0x7f12c80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.117+0000 7f1a95d9b700 1 -- 172.21.15.71:0/438015717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a98159c60 msgr2=0x7f1a9817ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.117+0000 7fd2ef7fe700 1 -- 172.21.15.71:0/3700797870 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f000b860 con 0x7fd2fc034b80 2023-10-09T06:42:45.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.117+0000 7f95d259c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95d406f500 0x7f95d40aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.117+0000 7f95d259c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95d406f500 0x7f95d40aba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:49214/0 (socket says 172.21.15.71:49214) 2023-10-09T06:42:45.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.117+0000 7f95d259c700 1 -- 172.21.15.71:0/476368805 learned_addr learned my addr 172.21.15.71:0/476368805 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.117+0000 7f95d8fff700 1 --2- 172.21.15.71:0/476368805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95d4159a10 0x7f95d4156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.117+0000 7f95d8fff700 1 -- 172.21.15.71:0/476368805 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d40abfc0 con 0x7f95d40cadc0 2023-10-09T06:42:45.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.117+0000 7f95d8fff700 1 -- 172.21.15.71:0/476368805 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d4151cd0 con 0x7f95d406f500 2023-10-09T06:42:45.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.117+0000 7f95d8fff700 1 -- 172.21.15.71:0/476368805 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d40c39b0 con 0x7f95d4159a10 2023-10-09T06:42:45.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.118+0000 7f34fb7fe700 1 --2- 172.21.15.71:0/37206612 >> [v2:172.21.15.71:6808/85789,v1:172.21.15.71:6809/85789] conn(0x7f34e806f290 0x7f34e80716a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.117+0000 7f1a95d9b700 1 --2- 172.21.15.71:0/438015717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a98159c60 0x7f1a9817ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.117+0000 7f1a95d9b700 1 -- 172.21.15.71:0/438015717 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a9815ec30 msgr2=0x7f1a980ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.118+0000 7f95d1d9b700 1 --2- 172.21.15.71:0/476368805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d40cadc0 0x7f95d41534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.118+0000 7f12ce5ff700 1 -- 172.21.15.71:0/118231391 shutdown_connections 2023-10-09T06:42:45.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.118+0000 7f1a95d9b700 1 --2- 172.21.15.71:0/438015717 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a9815ec30 0x7f1a980ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.118+0000 7f12ce5ff700 1 -- 172.21.15.71:0/118231391 wait complete. 2023-10-09T06:42:45.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.118+0000 7f1a95d9b700 1 -- 172.21.15.71:0/438015717 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a90009ae0 con 0x7f1a9815db10 2023-10-09T06:42:45.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.118+0000 7f1a9659c700 1 --2- 172.21.15.71:0/438015717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a98159c60 0x7f1a9817ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:42:45.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.118+0000 7f1a96d9d700 1 --2- 172.21.15.71:0/438015717 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a9815ec30 0x7f1a980ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:45.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.118+0000 7f1a95d9b700 1 --2- 172.21.15.71:0/438015717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a9815db10 0x7f1a9815e6f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1a90003000 tx=0x7f1a90017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.118+0000 7fd309bff700 1 -- 172.21.15.71:0/3700797870 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2fc035be0 con 0x7fd2fc034b80 2023-10-09T06:42:45.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.119+0000 7f34e2ffd700 1 -- 172.21.15.71:0/37206612 <== osd.2 v2:172.21.15.71:6808/85789 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f34e8071d50 con 0x7f34e806f290 2023-10-09T06:42:45.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.119+0000 7fe2b7fff700 1 --2- 172.21.15.71:0/3850731790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2b80c2f90 0x7fe2b815e870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0009290 tx=0x7fe2b0016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.118+0000 7fd309bff700 1 -- 172.21.15.71:0/3700797870 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2fc0361a0 con 0x7fd2fc034b80 2023-10-09T06:42:45.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.119+0000 7f95d1d9b700 1 -- 172.21.15.71:0/476368805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95d4159a10 msgr2=0x7f95d4156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.119+0000 7f95d1d9b700 1 --2- 172.21.15.71:0/476368805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95d4159a10 0x7f95d4156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.119+0000 7f95d1d9b700 1 -- 172.21.15.71:0/476368805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95d406f500 msgr2=0x7f95d40aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.119+0000 7f95d1d9b700 1 --2- 172.21.15.71:0/476368805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95d406f500 0x7f95d40aba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.119+0000 7f95d1d9b700 1 -- 172.21.15.71:0/476368805 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc009ae0 con 0x7f95d40cadc0 2023-10-09T06:42:45.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.120+0000 7f95d1d9b700 1 --2- 172.21.15.71:0/476368805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d40cadc0 0x7f95d41534a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f95c400b600 tx=0x7f95c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.120+0000 7f12ce5ff700 1 Processor -- start 2023-10-09T06:42:45.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.120+0000 7f95c27fc700 1 -- 172.21.15.71:0/476368805 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c400f510 con 0x7f95d40cadc0 2023-10-09T06:42:45.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.120+0000 7f95c27fc700 1 -- 172.21.15.71:0/476368805 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c400f690 con 0x7f95d40cadc0 2023-10-09T06:42:45.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.120+0000 7f95c27fc700 1 -- 172.21.15.71:0/476368805 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c400fa50 con 0x7f95d40cadc0 2023-10-09T06:42:45.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.120+0000 7f95d8fff700 1 -- 172.21.15.71:0/476368805 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d40c3c90 con 0x7f95d40cadc0 2023-10-09T06:42:45.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.119+0000 7fd2ef7fe700 1 -- 172.21.15.71:0/3700797870 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f001a660 con 0x7fd2fc034b80 2023-10-09T06:42:45.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.120+0000 7fd2ef7fe700 1 -- 172.21.15.71:0/3700797870 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f001a9e0 con 0x7fd2fc034b80 2023-10-09T06:42:45.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.120+0000 7f12ce5ff700 1 -- start start 2023-10-09T06:42:45.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.119+0000 7f1a867fc700 1 -- 172.21.15.71:0/438015717 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a90012a10 con 0x7f1a9815db10 2023-10-09T06:42:45.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.119+0000 7f1a867fc700 1 -- 172.21.15.71:0/438015717 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a90012bb0 con 0x7f1a9815db10 2023-10-09T06:42:45.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.119+0000 7f1a867fc700 1 -- 172.21.15.71:0/438015717 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9001e430 con 0x7f1a9815db10 2023-10-09T06:42:45.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.121+0000 7f12ce5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12c8159890 0x7f12c81494b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.121+0000 7f12ce5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12c815db10 0x7f12c815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.121+0000 7f12ce5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12c80cdc90 0x7f12c81526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.121+0000 7f12ce5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c80ce650 con 0x7f12c80cdc90 2023-10-09T06:42:45.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.121+0000 7f12ce5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c815cf10 con 0x7f12c8159890 2023-10-09T06:42:45.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.121+0000 7f12ce5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c81499f0 con 0x7f12c815db10 2023-10-09T06:42:45.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.121+0000 7f1a9cdff700 1 -- 172.21.15.71:0/438015717 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a981513c0 con 0x7f1a9815db10 2023-10-09T06:42:45.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.121+0000 7f1a9cdff700 1 -- 172.21.15.71:0/438015717 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a980ced00 con 0x7f1a9815db10 2023-10-09T06:42:45.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.122+0000 7f95d8fff700 1 -- 172.21.15.71:0/476368805 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d40c3ff0 con 0x7f95d40cadc0 2023-10-09T06:42:45.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.122+0000 7f12ccb9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12c80cdc90 0x7f12c81526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.122+0000 7f12ccb9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12c80cdc90 0x7f12c81526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52016/0 (socket says 172.21.15.71:52016) 2023-10-09T06:42:45.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.122+0000 7f12ccb9c700 1 -- 172.21.15.71:0/3820182953 learned_addr learned my addr 172.21.15.71:0/3820182953 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.122+0000 7f12c7fff700 1 --2- 172.21.15.71:0/3820182953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12c8159890 0x7f12c81494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.122+0000 7f12c77fe700 1 --2- 172.21.15.71:0/3820182953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12c815db10 0x7f12c815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.122+0000 7f12ccb9c700 1 -- 172.21.15.71:0/3820182953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12c815db10 msgr2=0x7f12c815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.122+0000 7f12ccb9c700 1 --2- 172.21.15.71:0/3820182953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12c815db10 0x7f12c815d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.122+0000 7f12ccb9c700 1 -- 172.21.15.71:0/3820182953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12c8159890 msgr2=0x7f12c81494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.122+0000 7f12ccb9c700 1 --2- 172.21.15.71:0/3820182953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12c8159890 0x7f12c81494b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.122+0000 7f12ccb9c700 1 -- 172.21.15.71:0/3820182953 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc009420 con 0x7f12c80cdc90 2023-10-09T06:42:45.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.123+0000 7f12ccb9c700 1 --2- 172.21.15.71:0/3820182953 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12c80cdc90 0x7f12c81526a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f12c000bbb0 tx=0x7f12c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.123+0000 7fd2ed7fa700 1 -- 172.21.15.71:0/3700797870 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd2e4000fd0 con 0x7fd2fc034b80 2023-10-09T06:42:45.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.123+0000 7f12b3fff700 1 -- 172.21.15.71:0/3820182953 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c00092e0 con 0x7f12c80cdc90 2023-10-09T06:42:45.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.123+0000 7fe2affff700 1 -- 172.21.15.71:0/3850731790 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0011e00 con 0x7fe2b80c2f90 2023-10-09T06:42:45.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.123+0000 7fe2affff700 1 -- 172.21.15.71:0/3850731790 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b001b470 con 0x7fe2b80c2f90 2023-10-09T06:42:45.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.123+0000 7fe2affff700 1 -- 172.21.15.71:0/3850731790 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b001b830 con 0x7fe2b80c2f90 2023-10-09T06:42:45.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.123+0000 7f12b3fff700 1 -- 172.21.15.71:0/3820182953 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c000c7a0 con 0x7f12c80cdc90 2023-10-09T06:42:45.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.124+0000 7f12ce5ff700 1 -- 172.21.15.71:0/3820182953 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b40094f0 con 0x7f12c80cdc90 2023-10-09T06:42:45.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.124+0000 7f1a9cdff700 1 -- 172.21.15.71:0/438015717 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1a9804c3c0 con 0x7f1a9815db10 2023-10-09T06:42:45.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.124+0000 7f12ce5ff700 1 -- 172.21.15.71:0/3820182953 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c815c5e0 con 0x7f12c80cdc90 2023-10-09T06:42:45.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.124+0000 7f12b3fff700 1 -- 172.21.15.71:0/3820182953 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c000cb40 con 0x7f12c80cdc90 2023-10-09T06:42:45.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.125+0000 7fe2be9ff700 1 -- 172.21.15.71:0/3850731790 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b80b1f70 con 0x7fe2b80c2f90 2023-10-09T06:42:45.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.125+0000 7f1a867fc700 1 -- 172.21.15.71:0/438015717 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a9001e860 con 0x7f1a9815db10 2023-10-09T06:42:45.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.125+0000 7f95b3fff700 1 -- 172.21.15.71:0/476368805 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95d404c3c0 con 0x7f95d40cadc0 2023-10-09T06:42:45.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.125+0000 7fe2be9ff700 1 -- 172.21.15.71:0/3850731790 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b815f230 con 0x7fe2b80c2f90 2023-10-09T06:42:45.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.113+0000 7f13737fe700 1 --2- 172.21.15.71:0/4039396646 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1358067080 0x7f1358069530 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1368006fd0 tx=0x7f1368006d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.126+0000 7f95c27fc700 1 -- 172.21.15.71:0/476368805 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f95c401a400 con 0x7f95d40cadc0 2023-10-09T06:42:45.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.124+0000 7fd2ef7fe700 1 -- 172.21.15.71:0/3700797870 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd2f001ad50 con 0x7fd2fc034b80 2023-10-09T06:42:45.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.126+0000 7f12ce5ff700 1 -- 172.21.15.71:0/3820182953 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f12c804c3c0 con 0x7f12c80cdc90 2023-10-09T06:42:45.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.126+0000 7f1a867fc700 1 --2- 172.21.15.71:0/438015717 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1a78067080 0x7f1a78069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.126+0000 7f1a867fc700 1 -- 172.21.15.71:0/438015717 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1a90085f60 con 0x7f1a9815db10 2023-10-09T06:42:45.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.126+0000 7f1a867fc700 1 --2- 172.21.15.71:0/438015717 >> [v2:172.21.15.179:6822/86045,v1:172.21.15.179:6824/86045] conn(0x7f1a7806f290 0x7f1a780716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.126+0000 7f1a867fc700 1 -- 172.21.15.71:0/438015717 --> [v2:172.21.15.179:6822/86045,v1:172.21.15.179:6824/86045] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a78071d50 con 0x7f1a7806f290 2023-10-09T06:42:45.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.126+0000 7f1a867fc700 1 -- 172.21.15.71:0/438015717 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a90088500 con 0x7f1a9815db10 2023-10-09T06:42:45.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.127+0000 7f1a9659c700 1 --2- 172.21.15.71:0/438015717 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1a78067080 0x7f1a78069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.126+0000 7fd2ef7fe700 1 --2- 172.21.15.71:0/3700797870 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd2e8067000 0x7fd2e80694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.126+0000 7fd2ef7fe700 1 -- 172.21.15.71:0/3700797870 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd2f0085890 con 0x7fd2fc034b80 2023-10-09T06:42:45.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.126+0000 7fd302ffd700 1 --2- 172.21.15.71:0/3700797870 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd2e8067000 0x7fd2e80694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.127+0000 7fd2ef7fe700 1 --2- 172.21.15.71:0/3700797870 >> [v2:172.21.15.179:6816/86054,v1:172.21.15.179:6817/86054] conn(0x7fd2e806f0a0 0x7fd2e80714b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.127+0000 7fd2ef7fe700 1 -- 172.21.15.71:0/3700797870 --> [v2:172.21.15.179:6816/86054,v1:172.21.15.179:6817/86054] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2e8071b60 con 0x7fd2e806f0a0 2023-10-09T06:42:45.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.127+0000 7fd2ef7fe700 1 -- 172.21.15.71:0/3700797870 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2f008a220 con 0x7fd2fc034b80 2023-10-09T06:42:45.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.127+0000 7fd303fff700 1 --2- 172.21.15.71:0/3700797870 >> [v2:172.21.15.179:6816/86054,v1:172.21.15.179:6817/86054] conn(0x7fd2e806f0a0 0x7fd2e80714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.127+0000 7f1a96d9d700 1 --2- 172.21.15.71:0/438015717 >> [v2:172.21.15.179:6822/86045,v1:172.21.15.179:6824/86045] conn(0x7f1a7806f290 0x7f1a780716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.128+0000 7f95c27fc700 1 --2- 172.21.15.71:0/476368805 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f95b4067000 0x7f95b40694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.128+0000 7f95c27fc700 1 -- 172.21.15.71:0/476368805 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f95c408aaf0 con 0x7f95d40cadc0 2023-10-09T06:42:45.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.127+0000 7fd302ffd700 1 --2- 172.21.15.71:0/3700797870 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd2e8067000 0x7fd2e80694b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd30404d2d0 tx=0x7fd304067410 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.128+0000 7fd303fff700 1 --2- 172.21.15.71:0/3700797870 >> [v2:172.21.15.179:6816/86054,v1:172.21.15.179:6817/86054] conn(0x7fd2e806f0a0 0x7fd2e80714b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.128+0000 7f95d259c700 1 --2- 172.21.15.71:0/476368805 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f95b4067000 0x7f95b40694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.128+0000 7f1a9659c700 1 --2- 172.21.15.71:0/438015717 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1a78067080 0x7f1a78069530 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1a9815d870 tx=0x7f1a88009120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.128+0000 7f1a96d9d700 1 --2- 172.21.15.71:0/438015717 >> [v2:172.21.15.179:6822/86045,v1:172.21.15.179:6824/86045] conn(0x7f1a7806f290 0x7f1a780716a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.128+0000 7f95c27fc700 1 --2- 172.21.15.71:0/476368805 >> [v2:172.21.15.179:6800/86042,v1:172.21.15.179:6801/86042] conn(0x7f95b406f210 0x7f95b4071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.128+0000 7f95c27fc700 1 -- 172.21.15.71:0/476368805 --> [v2:172.21.15.179:6800/86042,v1:172.21.15.179:6801/86042] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95b4071cd0 con 0x7f95b406f210 2023-10-09T06:42:45.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.128+0000 7f95c27fc700 1 -- 172.21.15.71:0/476368805 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95c408adf0 con 0x7f95d40cadc0 2023-10-09T06:42:45.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.129+0000 7f95d2d9d700 1 --2- 172.21.15.71:0/476368805 >> [v2:172.21.15.179:6800/86042,v1:172.21.15.179:6801/86042] conn(0x7f95b406f210 0x7f95b4071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.129+0000 7f95d259c700 1 --2- 172.21.15.71:0/476368805 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f95b4067000 0x7f95b40694b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f95cc009ab0 tx=0x7f95cc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.128+0000 7fe2be9ff700 1 -- 172.21.15.71:0/3850731790 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe2b80718b0 con 0x7fe2b80c2f90 2023-10-09T06:42:45.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.128+0000 7f12b3fff700 1 -- 172.21.15.71:0/3820182953 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f12c0012070 con 0x7f12c80cdc90 2023-10-09T06:42:45.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.129+0000 7f12b3fff700 1 --2- 172.21.15.71:0/3820182953 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f12ac066f30 0x7f12ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.129+0000 7f12b3fff700 1 -- 172.21.15.71:0/3820182953 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f12c00835d0 con 0x7f12c80cdc90 2023-10-09T06:42:45.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.129+0000 7f12b3fff700 1 --2- 172.21.15.71:0/3820182953 >> [v2:172.21.15.179:6808/86043,v1:172.21.15.179:6809/86043] conn(0x7f12ac06ef50 0x7f12ac071360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.129+0000 7f12b3fff700 1 -- 172.21.15.71:0/3820182953 --> [v2:172.21.15.179:6808/86043,v1:172.21.15.179:6809/86043] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f12ac071a10 con 0x7f12ac06ef50 2023-10-09T06:42:45.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.129+0000 7f12b3fff700 1 -- 172.21.15.71:0/3820182953 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12c0083810 con 0x7f12c80cdc90 2023-10-09T06:42:45.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.129+0000 7f1a867fc700 1 -- 172.21.15.71:0/438015717 <== osd.4 v2:172.21.15.179:6822/86045 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1a78071d50 con 0x7f1a7806f290 2023-10-09T06:42:45.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.129+0000 7fd2ef7fe700 1 -- 172.21.15.71:0/3700797870 <== osd.5 v2:172.21.15.179:6816/86054 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd2e8071b60 con 0x7fd2e806f0a0 2023-10-09T06:42:45.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.130+0000 7f12c7fff700 1 --2- 172.21.15.71:0/3820182953 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f12ac066f30 0x7f12ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.130+0000 7f95d2d9d700 1 --2- 172.21.15.71:0/476368805 >> [v2:172.21.15.179:6800/86042,v1:172.21.15.179:6801/86042] conn(0x7f95b406f210 0x7f95b4071620 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.130+0000 7f12c77fe700 1 --2- 172.21.15.71:0/3820182953 >> [v2:172.21.15.179:6808/86043,v1:172.21.15.179:6809/86043] conn(0x7f12ac06ef50 0x7f12ac071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.130+0000 7fe2affff700 1 -- 172.21.15.71:0/3850731790 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2b001bbe0 con 0x7fe2b80c2f90 2023-10-09T06:42:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.130+0000 7f12c7fff700 1 --2- 172.21.15.71:0/3820182953 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f12ac066f30 0x7f12ac0693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0093f0 tx=0x7f12bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.130+0000 7f12c77fe700 1 --2- 172.21.15.71:0/3820182953 >> [v2:172.21.15.179:6808/86043,v1:172.21.15.179:6809/86043] conn(0x7f12ac06ef50 0x7f12ac071360 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.131+0000 7f95c27fc700 1 -- 172.21.15.71:0/476368805 <== osd.6 v2:172.21.15.179:6800/86042 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f95b4071cd0 con 0x7f95b406f210 2023-10-09T06:42:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.131+0000 7f12b3fff700 1 -- 172.21.15.71:0/3820182953 <== osd.7 v2:172.21.15.179:6808/86043 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f12ac071a10 con 0x7f12ac06ef50 2023-10-09T06:42:45.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.135+0000 7fe2affff700 1 --2- 172.21.15.71:0/3850731790 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe298067080 0x7fe298069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.135+0000 7fe2affff700 1 -- 172.21.15.71:0/3850731790 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe2b0086360 con 0x7fe2b80c2f90 2023-10-09T06:42:45.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.135+0000 7fe2affff700 1 --2- 172.21.15.71:0/3850731790 >> [v2:172.21.15.71:6823/85810,v1:172.21.15.71:6825/85810] conn(0x7fe29806f290 0x7fe2980716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.135+0000 7fe2affff700 1 -- 172.21.15.71:0/3850731790 --> [v2:172.21.15.71:6823/85810,v1:172.21.15.71:6825/85810] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe298071d50 con 0x7fe29806f290 2023-10-09T06:42:45.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.135+0000 7fe2affff700 1 -- 172.21.15.71:0/3850731790 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2b0086690 con 0x7fe2b80c2f90 2023-10-09T06:42:45.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.136+0000 7fe2b77fe700 1 --2- 172.21.15.71:0/3850731790 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe298067080 0x7fe298069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.136+0000 7fe2bd79d700 1 --2- 172.21.15.71:0/3850731790 >> [v2:172.21.15.71:6823/85810,v1:172.21.15.71:6825/85810] conn(0x7fe29806f290 0x7fe2980716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.137+0000 7fe2b77fe700 1 --2- 172.21.15.71:0/3850731790 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe298067080 0x7fe298069530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe2b806ea50 tx=0x7fe2a8009780 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.137+0000 7fe2bd79d700 1 --2- 172.21.15.71:0/3850731790 >> [v2:172.21.15.71:6823/85810,v1:172.21.15.71:6825/85810] conn(0x7fe29806f290 0x7fe2980716a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.140+0000 7fe2affff700 1 -- 172.21.15.71:0/3850731790 <== osd.3 v2:172.21.15.71:6823/85810 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe298071d50 con 0x7fe29806f290 2023-10-09T06:42:45.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.141+0000 7f1378f9d700 1 -- 172.21.15.71:0/4039396646 --> [v2:172.21.15.71:6800/85788,v1:172.21.15.71:6801/85788] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f136c007850 con 0x7f135806f290 2023-10-09T06:42:45.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.142+0000 7f135f7fe700 1 -- 172.21.15.71:0/4039396646 <== osd.0 v2:172.21.15.71:6800/85788 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f136c007850 con 0x7f135806f290 2023-10-09T06:42:45.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.144+0000 7f1378f9d700 1 -- 172.21.15.71:0/4039396646 >> [v2:172.21.15.71:6800/85788,v1:172.21.15.71:6801/85788] conn(0x7f135806f290 msgr2=0x7f13580716a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.144+0000 7f1378f9d700 1 --2- 172.21.15.71:0/4039396646 >> [v2:172.21.15.71:6800/85788,v1:172.21.15.71:6801/85788] conn(0x7f135806f290 0x7f13580716a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.145+0000 7f1378f9d700 1 -- 172.21.15.71:0/4039396646 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1358067080 msgr2=0x7f1358069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.145+0000 7f1378f9d700 1 --2- 172.21.15.71:0/4039396646 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1358067080 0x7f1358069530 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1368006fd0 tx=0x7f1368006d30 comp rx=0 tx=0).stop 2023-10-09T06:42:45.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.145+0000 7f1378f9d700 1 -- 172.21.15.71:0/4039396646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f136c0e3f80 msgr2=0x7f136c036030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.145+0000 7f1378f9d700 1 --2- 172.21.15.71:0/4039396646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f136c0e3f80 0x7f136c036030 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1374076970 tx=0x7f1374067410 comp rx=0 tx=0).stop 2023-10-09T06:42:45.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.146+0000 7f1373fff700 1 -- 172.21.15.71:0/4039396646 reap_dead start 2023-10-09T06:42:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.147+0000 7f1378f9d700 1 -- 172.21.15.71:0/4039396646 shutdown_connections 2023-10-09T06:42:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.147+0000 7f1378f9d700 1 -- 172.21.15.71:0/4039396646 >> 172.21.15.71:0/4039396646 conn(0x7f136c054da0 msgr2=0x7f136c0e0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.147+0000 7f1378f9d700 1 -- 172.21.15.71:0/4039396646 shutdown_connections 2023-10-09T06:42:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.147+0000 7f1378f9d700 1 -- 172.21.15.71:0/4039396646 wait complete. 2023-10-09T06:42:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.146+0000 7fe3e3fff700 1 -- 172.21.15.71:0/2398361664 --> [v2:172.21.15.71:6816/85792,v1:172.21.15.71:6817/85792] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe3fc0df9c0 con 0x7fe3e406f210 2023-10-09T06:42:45.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.147+0000 7fe3f27fc700 1 -- 172.21.15.71:0/2398361664 <== osd.1 v2:172.21.15.71:6816/85792 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe3fc0df9c0 con 0x7fe3e406f210 2023-10-09T06:42:45.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.148+0000 7fe3e3fff700 1 -- 172.21.15.71:0/2398361664 >> [v2:172.21.15.71:6816/85792,v1:172.21.15.71:6817/85792] conn(0x7fe3e406f210 msgr2=0x7fe3e4071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.148+0000 7fe3e3fff700 1 --2- 172.21.15.71:0/2398361664 >> [v2:172.21.15.71:6816/85792,v1:172.21.15.71:6817/85792] conn(0x7fe3e406f210 0x7fe3e4071620 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.149+0000 7fe3e3fff700 1 -- 172.21.15.71:0/2398361664 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe3e4067000 msgr2=0x7fe3e40694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.149+0000 7f34e0ff9700 1 -- 172.21.15.71:0/37206612 --> [v2:172.21.15.71:6808/85789,v1:172.21.15.71:6809/85789] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f34f4058e10 con 0x7f34e806f290 2023-10-09T06:42:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.149+0000 7fe3e3fff700 1 --2- 172.21.15.71:0/2398361664 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe3e4067000 0x7fe3e40694b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4003b80 tx=0x7fe3f4007e40 comp rx=0 tx=0).stop 2023-10-09T06:42:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.149+0000 7fe3e3fff700 1 -- 172.21.15.71:0/2398361664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3fc0ea2b0 msgr2=0x7fe3fc0ceff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.149+0000 7fe3e3fff700 1 --2- 172.21.15.71:0/2398361664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3fc0ea2b0 0x7fe3fc0ceff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe4040701a0 tx=0x7fe404067410 comp rx=0 tx=0).stop 2023-10-09T06:42:45.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.149+0000 7f34e2ffd700 1 -- 172.21.15.71:0/37206612 <== osd.2 v2:172.21.15.71:6808/85789 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f34f4058e10 con 0x7f34e806f290 2023-10-09T06:42:45.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.150+0000 7fe402d9d700 1 -- 172.21.15.71:0/2398361664 reap_dead start 2023-10-09T06:42:45.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.150+0000 7fe3e3fff700 1 -- 172.21.15.71:0/2398361664 shutdown_connections 2023-10-09T06:42:45.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.150+0000 7fe3e3fff700 1 -- 172.21.15.71:0/2398361664 >> 172.21.15.71:0/2398361664 conn(0x7fe3fc054da0 msgr2=0x7fe3fc0e7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.150+0000 7f35015ff700 1 -- 172.21.15.71:0/37206612 >> [v2:172.21.15.71:6808/85789,v1:172.21.15.71:6809/85789] conn(0x7f34e806f290 msgr2=0x7f34e80716a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.150+0000 7f35015ff700 1 --2- 172.21.15.71:0/37206612 >> [v2:172.21.15.71:6808/85789,v1:172.21.15.71:6809/85789] conn(0x7f34e806f290 0x7f34e80716a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.151+0000 7fe3e3fff700 1 -- 172.21.15.71:0/2398361664 shutdown_connections 2023-10-09T06:42:45.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.151+0000 7fe3e3fff700 1 -- 172.21.15.71:0/2398361664 wait complete. 2023-10-09T06:42:45.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.151+0000 7f35015ff700 1 -- 172.21.15.71:0/37206612 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f34e8067080 msgr2=0x7f34e8069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.151+0000 7f35015ff700 1 --2- 172.21.15.71:0/37206612 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f34e8067080 0x7f34e8069530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f34f0007e50 tx=0x7f34f0010000 comp rx=0 tx=0).stop 2023-10-09T06:42:45.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.151+0000 7f35015ff700 1 -- 172.21.15.71:0/37206612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34f40e1440 msgr2=0x7f34f40e49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.151+0000 7f35015ff700 1 --2- 172.21.15.71:0/37206612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34f40e1440 0x7f34f40e49f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f34fc04d1b0 tx=0x7f34f4055810 comp rx=0 tx=0).stop 2023-10-09T06:42:45.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.151+0000 7f34fb7fe700 1 -- 172.21.15.71:0/37206612 reap_dead start 2023-10-09T06:42:45.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.151+0000 7f35015ff700 1 -- 172.21.15.71:0/37206612 shutdown_connections 2023-10-09T06:42:45.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.151+0000 7f35015ff700 1 -- 172.21.15.71:0/37206612 >> 172.21.15.71:0/37206612 conn(0x7f34f400f0b0 msgr2=0x7f34f404eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.152+0000 7f35015ff700 1 -- 172.21.15.71:0/37206612 shutdown_connections 2023-10-09T06:42:45.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.152+0000 7f35015ff700 1 -- 172.21.15.71:0/37206612 wait complete. 2023-10-09T06:42:45.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.160+0000 7f12ce5ff700 1 -- 172.21.15.71:0/3820182953 --> [v2:172.21.15.179:6808/86043,v1:172.21.15.179:6809/86043] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f12c806a5b0 con 0x7f12ac06ef50 2023-10-09T06:42:45.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.160+0000 7f1a9cdff700 1 -- 172.21.15.71:0/438015717 --> [v2:172.21.15.179:6822/86045,v1:172.21.15.179:6824/86045] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1a98069dc0 con 0x7f1a7806f290 2023-10-09T06:42:45.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.160+0000 7f12b3fff700 1 -- 172.21.15.71:0/3820182953 <== osd.7 v2:172.21.15.179:6808/86043 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f12c806a5b0 con 0x7f12ac06ef50 2023-10-09T06:42:45.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.161+0000 7f1a867fc700 1 -- 172.21.15.71:0/438015717 <== osd.4 v2:172.21.15.179:6822/86045 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1a98069dc0 con 0x7f1a7806f290 2023-10-09T06:42:45.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.162+0000 7f1a77fff700 1 -- 172.21.15.71:0/438015717 >> [v2:172.21.15.179:6822/86045,v1:172.21.15.179:6824/86045] conn(0x7f1a7806f290 msgr2=0x7f1a780716a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.162+0000 7f1a77fff700 1 --2- 172.21.15.71:0/438015717 >> [v2:172.21.15.179:6822/86045,v1:172.21.15.179:6824/86045] conn(0x7f1a7806f290 0x7f1a780716a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.162+0000 7f1a77fff700 1 -- 172.21.15.71:0/438015717 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1a78067080 msgr2=0x7f1a78069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.162+0000 7f1a77fff700 1 --2- 172.21.15.71:0/438015717 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1a78067080 0x7f1a78069530 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1a9815d870 tx=0x7f1a88009120 comp rx=0 tx=0).stop 2023-10-09T06:42:45.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.162+0000 7f1a77fff700 1 -- 172.21.15.71:0/438015717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a9815db10 msgr2=0x7f1a9815e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.162+0000 7f1a77fff700 1 --2- 172.21.15.71:0/438015717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a9815db10 0x7f1a9815e6f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1a90003000 tx=0x7f1a90017000 comp rx=0 tx=0).stop 2023-10-09T06:42:45.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.162+0000 7f1a96d9d700 1 -- 172.21.15.71:0/438015717 reap_dead start 2023-10-09T06:42:45.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.163+0000 7f1a77fff700 1 -- 172.21.15.71:0/438015717 shutdown_connections 2023-10-09T06:42:45.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.163+0000 7f1a77fff700 1 -- 172.21.15.71:0/438015717 >> 172.21.15.71:0/438015717 conn(0x7f1a98068e20 msgr2=0x7f1a98158530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.163+0000 7f12b1ffb700 1 -- 172.21.15.71:0/3820182953 >> [v2:172.21.15.179:6808/86043,v1:172.21.15.179:6809/86043] conn(0x7f12ac06ef50 msgr2=0x7f12ac071360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.163+0000 7f12b1ffb700 1 --2- 172.21.15.71:0/3820182953 >> [v2:172.21.15.179:6808/86043,v1:172.21.15.179:6809/86043] conn(0x7f12ac06ef50 0x7f12ac071360 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.163+0000 7f12b1ffb700 1 -- 172.21.15.71:0/3820182953 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f12ac066f30 msgr2=0x7f12ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.163+0000 7f12b1ffb700 1 --2- 172.21.15.71:0/3820182953 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f12ac066f30 0x7f12ac0693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0093f0 tx=0x7f12bc008040 comp rx=0 tx=0).stop 2023-10-09T06:42:45.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.164+0000 7f95b3fff700 1 -- 172.21.15.71:0/476368805 --> [v2:172.21.15.179:6800/86042,v1:172.21.15.179:6801/86042] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f95d406ea20 con 0x7f95b406f210 2023-10-09T06:42:45.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.163+0000 7f12b1ffb700 1 -- 172.21.15.71:0/3820182953 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12c80cdc90 msgr2=0x7f12c81526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.163+0000 7f12b1ffb700 1 --2- 172.21.15.71:0/3820182953 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12c80cdc90 0x7f12c81526a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f12c000bbb0 tx=0x7f12c0009840 comp rx=0 tx=0).stop 2023-10-09T06:42:45.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.164+0000 7f1a77fff700 1 -- 172.21.15.71:0/438015717 shutdown_connections 2023-10-09T06:42:45.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.163+0000 7f12ccb9c700 1 -- 172.21.15.71:0/3820182953 reap_dead start 2023-10-09T06:42:45.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.163+0000 7f12b1ffb700 1 -- 172.21.15.71:0/3820182953 shutdown_connections 2023-10-09T06:42:45.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.163+0000 7f12b1ffb700 1 -- 172.21.15.71:0/3820182953 >> 172.21.15.71:0/3820182953 conn(0x7f12c8068e20 msgr2=0x7f12c81542a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.164+0000 7f12b1ffb700 1 -- 172.21.15.71:0/3820182953 shutdown_connections 2023-10-09T06:42:45.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.164+0000 7f12b1ffb700 1 -- 172.21.15.71:0/3820182953 wait complete. 2023-10-09T06:42:45.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.164+0000 7f1a77fff700 1 -- 172.21.15.71:0/438015717 wait complete. 2023-10-09T06:42:45.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.164+0000 7f95c27fc700 1 -- 172.21.15.71:0/476368805 <== osd.6 v2:172.21.15.179:6800/86042 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f95d406ea20 con 0x7f95b406f210 2023-10-09T06:42:45.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.165+0000 7f95d8fff700 1 -- 172.21.15.71:0/476368805 >> [v2:172.21.15.179:6800/86042,v1:172.21.15.179:6801/86042] conn(0x7f95b406f210 msgr2=0x7f95b4071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.165+0000 7f95d8fff700 1 --2- 172.21.15.71:0/476368805 >> [v2:172.21.15.179:6800/86042,v1:172.21.15.179:6801/86042] conn(0x7f95b406f210 0x7f95b4071620 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.166+0000 7f95d8fff700 1 -- 172.21.15.71:0/476368805 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f95b4067000 msgr2=0x7f95b40694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.166+0000 7fd2ed7fa700 1 -- 172.21.15.71:0/3700797870 --> [v2:172.21.15.179:6816/86054,v1:172.21.15.179:6817/86054] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd2e4002d30 con 0x7fd2e806f0a0 2023-10-09T06:42:45.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.166+0000 7f95d8fff700 1 --2- 172.21.15.71:0/476368805 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f95b4067000 0x7f95b40694b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f95cc009ab0 tx=0x7f95cc017000 comp rx=0 tx=0).stop 2023-10-09T06:42:45.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.166+0000 7f95d8fff700 1 -- 172.21.15.71:0/476368805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d40cadc0 msgr2=0x7f95d41534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.166+0000 7f95d8fff700 1 --2- 172.21.15.71:0/476368805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95d40cadc0 0x7f95d41534a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f95c400b600 tx=0x7f95c40091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.166+0000 7f95d2d9d700 1 -- 172.21.15.71:0/476368805 reap_dead start 2023-10-09T06:42:45.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.166+0000 7f95d8fff700 1 -- 172.21.15.71:0/476368805 shutdown_connections 2023-10-09T06:42:45.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.166+0000 7f95d8fff700 1 -- 172.21.15.71:0/476368805 >> 172.21.15.71:0/476368805 conn(0x7f95d40cccb0 msgr2=0x7f95d4158860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.167+0000 7fd2ef7fe700 1 -- 172.21.15.71:0/3700797870 <== osd.5 v2:172.21.15.179:6816/86054 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd2e4002d30 con 0x7fd2e806f0a0 2023-10-09T06:42:45.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.169+0000 7fd309bff700 1 -- 172.21.15.71:0/3700797870 >> [v2:172.21.15.179:6816/86054,v1:172.21.15.179:6817/86054] conn(0x7fd2e806f0a0 msgr2=0x7fd2e80714b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.169+0000 7fd309bff700 1 --2- 172.21.15.71:0/3700797870 >> [v2:172.21.15.179:6816/86054,v1:172.21.15.179:6817/86054] conn(0x7fd2e806f0a0 0x7fd2e80714b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.169+0000 7f95d8fff700 1 -- 172.21.15.71:0/476368805 shutdown_connections 2023-10-09T06:42:45.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.169+0000 7fd309bff700 1 -- 172.21.15.71:0/3700797870 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd2e8067000 msgr2=0x7fd2e80694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.169+0000 7fd309bff700 1 --2- 172.21.15.71:0/3700797870 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd2e8067000 0x7fd2e80694b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd30404d2d0 tx=0x7fd304067410 comp rx=0 tx=0).stop 2023-10-09T06:42:45.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.169+0000 7f95d8fff700 1 -- 172.21.15.71:0/476368805 wait complete. 2023-10-09T06:42:45.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.169+0000 7fd309bff700 1 -- 172.21.15.71:0/3700797870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2fc034b80 msgr2=0x7fd2fc04bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.169+0000 7fd309bff700 1 --2- 172.21.15.71:0/3700797870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2fc034b80 0x7fd2fc04bee0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009290 tx=0x7fd2f0017000 comp rx=0 tx=0).stop 2023-10-09T06:42:45.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.169+0000 7fd303fff700 1 -- 172.21.15.71:0/3700797870 reap_dead start 2023-10-09T06:42:45.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.169+0000 7fd309bff700 1 -- 172.21.15.71:0/3700797870 shutdown_connections 2023-10-09T06:42:45.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.170+0000 7fd309bff700 1 -- 172.21.15.71:0/3700797870 >> 172.21.15.71:0/3700797870 conn(0x7fd2fc054e30 msgr2=0x7fd2fc006a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.170+0000 7fd309bff700 1 -- 172.21.15.71:0/3700797870 shutdown_connections 2023-10-09T06:42:45.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.170+0000 7fd309bff700 1 -- 172.21.15.71:0/3700797870 wait complete. 2023-10-09T06:42:45.217 INFO:teuthology.orchestra.run.smithi071.stdout:55834574854 2023-10-09T06:42:45.218 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-09T06:42:45.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.179+0000 7fe2be9ff700 1 -- 172.21.15.71:0/3850731790 --> [v2:172.21.15.71:6823/85810,v1:172.21.15.71:6825/85810] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe2b80b1d30 con 0x7fe29806f290 2023-10-09T06:42:45.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.179+0000 7fe2affff700 1 -- 172.21.15.71:0/3850731790 <== osd.3 v2:172.21.15.71:6823/85810 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe2b80b1d30 con 0x7fe29806f290 2023-10-09T06:42:45.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.180+0000 7fe2be9ff700 1 -- 172.21.15.71:0/3850731790 >> [v2:172.21.15.71:6823/85810,v1:172.21.15.71:6825/85810] conn(0x7fe29806f290 msgr2=0x7fe2980716a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.180+0000 7fe2be9ff700 1 --2- 172.21.15.71:0/3850731790 >> [v2:172.21.15.71:6823/85810,v1:172.21.15.71:6825/85810] conn(0x7fe29806f290 0x7fe2980716a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.181+0000 7fe2be9ff700 1 -- 172.21.15.71:0/3850731790 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe298067080 msgr2=0x7fe298069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.181+0000 7fe2be9ff700 1 --2- 172.21.15.71:0/3850731790 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe298067080 0x7fe298069530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe2b806ea50 tx=0x7fe2a8009780 comp rx=0 tx=0).stop 2023-10-09T06:42:45.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.181+0000 7fe2be9ff700 1 -- 172.21.15.71:0/3850731790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2b80c2f90 msgr2=0x7fe2b815e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.181+0000 7fe2be9ff700 1 --2- 172.21.15.71:0/3850731790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2b80c2f90 0x7fe2b815e870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0009290 tx=0x7fe2b0016000 comp rx=0 tx=0).stop 2023-10-09T06:42:45.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.181+0000 7fe2bd79d700 1 -- 172.21.15.71:0/3850731790 reap_dead start 2023-10-09T06:42:45.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.181+0000 7fe2be9ff700 1 -- 172.21.15.71:0/3850731790 shutdown_connections 2023-10-09T06:42:45.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.181+0000 7fe2be9ff700 1 -- 172.21.15.71:0/3850731790 >> 172.21.15.71:0/3850731790 conn(0x7fe2b806a5c0 msgr2=0x7fe2b815cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.221 INFO:teuthology.orchestra.run.smithi071.stdout:55834574855 2023-10-09T06:42:45.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.182+0000 7fe2be9ff700 1 -- 172.21.15.71:0/3850731790 shutdown_connections 2023-10-09T06:42:45.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.182+0000 7fe2be9ff700 1 -- 172.21.15.71:0/3850731790 wait complete. 2023-10-09T06:42:45.222 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-09T06:42:45.223 INFO:teuthology.orchestra.run.smithi071.stdout:55834574854 2023-10-09T06:42:45.223 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-09T06:42:45.224 INFO:teuthology.orchestra.run.smithi071.stdout:55834574855 2023-10-09T06:42:45.224 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-09T06:42:45.225 INFO:teuthology.orchestra.run.smithi071.stdout:55834574854 2023-10-09T06:42:45.225 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-09T06:42:45.226 INFO:teuthology.orchestra.run.smithi071.stdout:55834574854 2023-10-09T06:42:45.226 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-09T06:42:45.227 INFO:teuthology.orchestra.run.smithi071.stdout:55834574855 2023-10-09T06:42:45.227 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-09T06:42:45.228 INFO:teuthology.orchestra.run.smithi071.stdout:55834574855 2023-10-09T06:42:45.228 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-09T06:42:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.578+0000 7f74b199d700 1 Processor -- start 2023-10-09T06:42:45.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.579+0000 7f74b199d700 1 -- start start 2023-10-09T06:42:45.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.577+0000 7f75ba59d700 1 Processor -- start 2023-10-09T06:42:45.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.577+0000 7f75ba59d700 1 -- start start 2023-10-09T06:42:45.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.579+0000 7f75ba59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75ac0e7c00 0x7f75ac0ea3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.579+0000 7f75ba59d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f75ac00cac0 0x7f75ac0ea920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.579+0000 7f75ba59d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ac0e7770 con 0x7f75ac0522c0 2023-10-09T06:42:45.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.579+0000 7f75ba59d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ac0eae60 con 0x7f75ac00cac0 2023-10-09T06:42:45.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.579+0000 7f75ba59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0eb110 con 0x7f75ac0e7c00 2023-10-09T06:42:45.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.581+0000 7f74b199d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74a40de960 0x7f74a4050300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.580+0000 7f75b9d9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f75ac00cac0 0x7f75ac0ea920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.580+0000 7f75b9d9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f75ac00cac0 0x7f75ac0ea920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:49234/0 (socket says 172.21.15.71:49234) 2023-10-09T06:42:45.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.580+0000 7f75b9d9c700 1 -- 172.21.15.71:0/2671701857 learned_addr learned my addr 172.21.15.71:0/2671701857 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.581+0000 7f75abfff700 1 -- 172.21.15.71:0/2671701857 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1621499643 0 0) 0x7f75ac0e7770 con 0x7f75ac0522c0 2023-10-09T06:42:45.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.581+0000 7f75abfff700 1 -- 172.21.15.71:0/2671701857 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75a0003570 con 0x7f75ac0522c0 2023-10-09T06:42:45.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.581+0000 7f74b199d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f74a4050840 0x7f74a4052970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.581+0000 7f75abfff700 1 -- 172.21.15.71:0/2671701857 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4208568096 0 0) 0x7f75a0003570 con 0x7f75ac0522c0 2023-10-09T06:42:45.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.581+0000 7f75abfff700 1 -- 172.21.15.71:0/2671701857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75ac0e7c00 msgr2=0x7f75ac0ea3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.581+0000 7f74abfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74a40de960 0x7f74a4050300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.581+0000 7f74abfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74a40de960 0x7f74a4050300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:49142/0 (socket says 172.21.15.71:49142) 2023-10-09T06:42:45.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.582+0000 7f74abfff700 1 -- 172.21.15.71:0/3522842806 learned_addr learned my addr 172.21.15.71:0/3522842806 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.582+0000 7f74b199d700 1 -- 172.21.15.71:0/3522842806 --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a4050ca0 con 0x7f74a40de590 2023-10-09T06:42:45.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.581+0000 7f75b8d9a700 1 --2- 172.21.15.71:0/2671701857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75ac0e7c00 0x7f75ac0ea3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.581+0000 7f75abfff700 1 --2- 172.21.15.71:0/2671701857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75ac0e7c00 0x7f75ac0ea3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.581+0000 7f75abfff700 1 -- 172.21.15.71:0/2671701857 >> v2:172.21.15.179:3300/0 conn(0x7f75ac00cac0 msgr2=0x7f75ac0ea920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.581+0000 7f75abfff700 1 --2- 172.21.15.71:0/2671701857 >> v2:172.21.15.179:3300/0 conn(0x7f75ac00cac0 0x7f75ac0ea920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.581+0000 7f75abfff700 1 -- 172.21.15.71:0/2671701857 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac0e7120 con 0x7f75ac0522c0 2023-10-09T06:42:45.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.581+0000 7f75abfff700 1 -- 172.21.15.71:0/2671701857 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f75b0001470 con 0x7f75ac0522c0 2023-10-09T06:42:45.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.582+0000 7f74b199d700 1 -- 172.21.15.71:0/3522842806 --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a40078d0 con 0x7f74a4050840 2023-10-09T06:42:45.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.582+0000 7f74b199d700 1 -- 172.21.15.71:0/3522842806 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a4035c10 con 0x7f74a40de960 2023-10-09T06:42:45.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.581+0000 7f75abfff700 1 -- 172.21.15.71:0/2671701857 >> v1:172.21.15.179:6789/0 conn(0x7f75ac0522c0 legacy=0x7f75ac00c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.582+0000 7f75abfff700 1 --2- 172.21.15.71:0/2671701857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75a0003ae0 0x7f75a0003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.582+0000 7f75abfff700 1 --2- 172.21.15.71:0/2671701857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75a0004810 0x7f75a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.582+0000 7f75abfff700 1 --2- 172.21.15.71:0/2671701857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75a00052e0 0x7f75a000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.582+0000 7f75abfff700 1 -- 172.21.15.71:0/2671701857 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0eae60 con 0x7f75a00052e0 2023-10-09T06:42:45.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.582+0000 7f75abfff700 1 -- 172.21.15.71:0/2671701857 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0eb110 con 0x7f75a0003ae0 2023-10-09T06:42:45.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.582+0000 7f75abfff700 1 -- 172.21.15.71:0/2671701857 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a000c2d0 con 0x7f75a0004810 2023-10-09T06:42:45.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.582+0000 7f75b959b700 1 --2- 172.21.15.71:0/2671701857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75a0003ae0 0x7f75a0003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.582+0000 7f75b8d9a700 1 --2- 172.21.15.71:0/2671701857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75ac0e7c00 0x7f75ac0ea3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:45.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.582+0000 7f75b959b700 1 -- 172.21.15.71:0/2671701857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75a0004810 msgr2=0x7f75a0004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T06:42:45.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.582+0000 7f75b959b700 1 --2- 172.21.15.71:0/2671701857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75a0004810 0x7f75a0004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.583+0000 7f75b959b700 1 -- 172.21.15.71:0/2671701857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75a00052e0 msgr2=0x7f75a000ba60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T06:42:45.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.583+0000 7f74abfff700 1 -- 172.21.15.71:0/3522842806 >> v2:172.21.15.71:3300/0 conn(0x7f74a4050840 msgr2=0x7f74a4052970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.583+0000 7f74abfff700 1 --2- 172.21.15.71:0/3522842806 >> v2:172.21.15.71:3300/0 conn(0x7f74a4050840 0x7f74a4052970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.583+0000 7f75b959b700 1 --2- 172.21.15.71:0/2671701857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75a00052e0 0x7f75a000ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.583+0000 7f75b959b700 1 -- 172.21.15.71:0/2671701857 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a0003570 con 0x7f75a0003ae0 2023-10-09T06:42:45.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.583+0000 7f75b959b700 1 --2- 172.21.15.71:0/2671701857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75a0003ae0 0x7f75a0003ef0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f75b000c1e0 tx=0x7f75b0002e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=121f5aa9487545bd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.584+0000 7f75abfff700 1 -- 172.21.15.71:0/2671701857 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b000cb10 con 0x7f75a0003ae0 2023-10-09T06:42:45.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.584+0000 7f75abfff700 1 -- 172.21.15.71:0/2671701857 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b000cc70 con 0x7f75a0003ae0 2023-10-09T06:42:45.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.584+0000 7f75abfff700 1 -- 172.21.15.71:0/2671701857 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0006820 con 0x7f75a0003ae0 2023-10-09T06:42:45.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.583+0000 7f74abfff700 1 -- 172.21.15.71:0/3522842806 >> v1:172.21.15.179:6789/0 conn(0x7f74a40de590 legacy=0x7f74a40360a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.583+0000 7f74abfff700 1 -- 172.21.15.71:0/3522842806 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a40367b0 con 0x7f74a40de960 2023-10-09T06:42:45.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.584+0000 7f74abfff700 1 --2- 172.21.15.71:0/3522842806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74a40de960 0x7f74a4050300 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f74ac05f200 tx=0x7f74ac066260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d17e4ffe318fa8f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.584+0000 7f0ed1f9d700 1 Processor -- start 2023-10-09T06:42:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.584+0000 7f74ab7fe700 1 -- 172.21.15.71:0/3522842806 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac0676e0 con 0x7f74a40de960 2023-10-09T06:42:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.585+0000 7f74ab7fe700 1 -- 172.21.15.71:0/3522842806 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac067860 con 0x7f74a40de960 2023-10-09T06:42:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.585+0000 7f74ab7fe700 1 -- 172.21.15.71:0/3522842806 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac0647a0 con 0x7f74a40de960 2023-10-09T06:42:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.585+0000 7f75ba59d700 1 -- 172.21.15.71:0/2671701857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75a0003ae0 msgr2=0x7f75a0003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.585+0000 7f75ba59d700 1 --2- 172.21.15.71:0/2671701857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75a0003ae0 0x7f75a0003ef0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f75b000c1e0 tx=0x7f75b0002e70 comp rx=0 tx=0).stop 2023-10-09T06:42:45.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.585+0000 7f0ed1f9d700 1 -- start start 2023-10-09T06:42:45.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.586+0000 7f74b199d700 1 -- 172.21.15.71:0/3522842806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74a40de960 msgr2=0x7f74a4050300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.586+0000 7f74b199d700 1 --2- 172.21.15.71:0/3522842806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74a40de960 0x7f74a4050300 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f74ac05f200 tx=0x7f74ac066260 comp rx=0 tx=0).stop 2023-10-09T06:42:45.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.586+0000 7f75b9d9c700 1 -- 172.21.15.71:0/2671701857 reap_dead start 2023-10-09T06:42:45.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.586+0000 7f75ba59d700 1 -- 172.21.15.71:0/2671701857 shutdown_connections 2023-10-09T06:42:45.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.586+0000 7f75ba59d700 1 -- 172.21.15.71:0/2671701857 >> 172.21.15.71:0/2671701857 conn(0x7f75ac056f90 msgr2=0x7f75ac057390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.586+0000 7f75ba59d700 1 -- 172.21.15.71:0/2671701857 shutdown_connections 2023-10-09T06:42:45.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.586+0000 7f75ba59d700 1 -- 172.21.15.71:0/2671701857 wait complete. 2023-10-09T06:42:45.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.587+0000 7f0ed1f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0ec404f450 0x7f0ec4033b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.588+0000 7f0ed1f9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec4006030 con 0x7f0ec40de0e0 2023-10-09T06:42:45.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.588+0000 7f74b199d700 1 -- 172.21.15.71:0/3522842806 shutdown_connections 2023-10-09T06:42:45.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.588+0000 7f74b199d700 1 --2- 172.21.15.71:0/3522842806 >> v2:172.21.15.71:3300/0 conn(0x7f74a4050840 0x7f74a4052970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.588+0000 7f74b199d700 1 --2- 172.21.15.71:0/3522842806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74a40de960 0x7f74a4050300 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.588+0000 7f74b199d700 1 -- 172.21.15.71:0/3522842806 >> 172.21.15.71:0/3522842806 conn(0x7f74a4054da0 msgr2=0x7f74a40551a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.588+0000 7f0ed179c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f0ec40de4b0 0x7f0ec40064c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:47246/0 (socket says 172.21.15.71:47246) 2023-10-09T06:42:45.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.588+0000 7f0ed179c700 1 -- 172.21.15.71:0/736925584 learned_addr learned my addr 172.21.15.71:0/736925584 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:45.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.588+0000 7f0ed1f9d700 1 -- 172.21.15.71:0/736925584 --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec4053cc0 con 0x7f0ec40de4b0 2023-10-09T06:42:45.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.588+0000 7f0ed1f9d700 1 -- 172.21.15.71:0/736925584 --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec4053fa0 con 0x7f0ec404f450 2023-10-09T06:42:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.589+0000 7f0ecbfff700 1 --2- 172.21.15.71:0/736925584 >> v2:172.21.15.179:3300/0 conn(0x7f0ec404f450 0x7f0ec4033b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.589+0000 7f0ecb7fe700 1 -- 172.21.15.71:0/736925584 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 20671728 0 0) 0x7f0ec4053cc0 con 0x7f0ec40de4b0 2023-10-09T06:42:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.589+0000 7f0ecb7fe700 1 -- 172.21.15.71:0/736925584 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ebc003570 con 0x7f0ec40de4b0 2023-10-09T06:42:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.589+0000 7f75ba59d700 1 Processor -- start 2023-10-09T06:42:45.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.589+0000 7f0ecb7fe700 1 -- 172.21.15.71:0/736925584 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807172095 0 0) 0x7f0ec4006030 con 0x7f0ec40de0e0 2023-10-09T06:42:45.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.589+0000 7f0ecb7fe700 1 -- 172.21.15.71:0/736925584 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ec4053cc0 con 0x7f0ec40de0e0 2023-10-09T06:42:45.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.589+0000 7f0ecb7fe700 1 -- 172.21.15.71:0/736925584 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1145622675 0 0) 0x7f0ebc003570 con 0x7f0ec40de4b0 2023-10-09T06:42:45.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.589+0000 7f0ecb7fe700 1 -- 172.21.15.71:0/736925584 >> v2:172.21.15.179:3300/0 conn(0x7f0ec404f450 msgr2=0x7f0ec4033b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.589+0000 7f0ecb7fe700 1 --2- 172.21.15.71:0/736925584 >> v2:172.21.15.179:3300/0 conn(0x7f0ec404f450 0x7f0ec4033b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.589+0000 7f0ecb7fe700 1 -- 172.21.15.71:0/736925584 >> v1:172.21.15.71:6789/0 conn(0x7f0ec40de0e0 legacy=0x7f0ec4053450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.589+0000 7f0ecb7fe700 1 -- 172.21.15.71:0/736925584 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec4054280 con 0x7f0ec40de4b0 2023-10-09T06:42:45.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.589+0000 7f0ecb7fe700 1 -- 172.21.15.71:0/736925584 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f0ec0004b20 con 0x7f0ec40de4b0 2023-10-09T06:42:45.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.590+0000 7f0ecb7fe700 1 -- 172.21.15.71:0/736925584 >> v1:172.21.15.179:6789/0 conn(0x7f0ec40de4b0 legacy=0x7f0ec40064c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.590+0000 7f0ecb7fe700 1 --2- 172.21.15.71:0/736925584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ebc003bf0 0x7f0ebc003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.590+0000 7f0ecb7fe700 1 --2- 172.21.15.71:0/736925584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ebc004810 0x7f0ebc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.589+0000 7f75ba59d700 1 -- start start 2023-10-09T06:42:45.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.590+0000 7f75ba59d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75ac04c8d0 0x7f75ac04cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.590+0000 7f75ba59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75ac0d8050 0x7f75ac0d6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.591+0000 7f75ba59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75ac0d67a0 0x7f75ac0d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.591+0000 7f75ba59d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac04b3f0 con 0x7f75ac04c8d0 2023-10-09T06:42:45.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.591+0000 7f75ba59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0d7bc0 con 0x7f75ac0d67a0 2023-10-09T06:42:45.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.591+0000 7f75ba59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac04d1e0 con 0x7f75ac0d8050 2023-10-09T06:42:45.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.591+0000 7f75b9d9c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75ac0d67a0 0x7f75ac0d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.591+0000 7f75b9d9c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75ac0d67a0 0x7f75ac0d3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:49272/0 (socket says 172.21.15.71:49272) 2023-10-09T06:42:45.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.591+0000 7f75b9d9c700 1 -- 172.21.15.71:0/2028407121 learned_addr learned my addr 172.21.15.71:0/2028407121 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.590+0000 7f0ecb7fe700 1 --2- 172.21.15.71:0/736925584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ebc005210 0x7f0ebc007a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.590+0000 7f0ecb7fe700 1 -- 172.21.15.71:0/736925584 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb8001130 con 0x7f0ebc005210 2023-10-09T06:42:45.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.590+0000 7f0ecb7fe700 1 -- 172.21.15.71:0/736925584 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec4053fa0 con 0x7f0ebc003bf0 2023-10-09T06:42:45.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.590+0000 7f0ecb7fe700 1 -- 172.21.15.71:0/736925584 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc008210 con 0x7f0ebc004810 2023-10-09T06:42:45.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.590+0000 7f0ed0f9b700 1 --2- 172.21.15.71:0/736925584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ebc003bf0 0x7f0ebc003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.591+0000 7f0ed179c700 1 --2- 172.21.15.71:0/736925584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ebc005210 0x7f0ebc007a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.591+0000 7f0ecbfff700 1 --2- 172.21.15.71:0/736925584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ebc004810 0x7f0ebc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.591+0000 7f75b959b700 1 --2- 172.21.15.71:0/2028407121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75ac04c8d0 0x7f75ac04cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.592+0000 7f75b9d9c700 1 -- 172.21.15.71:0/2028407121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75ac0d8050 msgr2=0x7f75ac0d6260 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T06:42:45.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.592+0000 7f75b9d9c700 1 --2- 172.21.15.71:0/2028407121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75ac0d8050 0x7f75ac0d6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.592+0000 7f75b9d9c700 1 -- 172.21.15.71:0/2028407121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75ac04c8d0 msgr2=0x7f75ac04cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.592+0000 7f75b9d9c700 1 --2- 172.21.15.71:0/2028407121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75ac04c8d0 0x7f75ac04cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.592+0000 7f75b9d9c700 1 -- 172.21.15.71:0/2028407121 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac0d6fb0 con 0x7f75ac0d67a0 2023-10-09T06:42:45.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.592+0000 7f75b959b700 1 --2- 172.21.15.71:0/2028407121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75ac04c8d0 0x7f75ac04cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:45.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.591+0000 7f0ed179c700 1 -- 172.21.15.71:0/736925584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ebc004810 msgr2=0x7f0ebc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.591+0000 7f0ed179c700 1 --2- 172.21.15.71:0/736925584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ebc004810 0x7f0ebc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.591+0000 7f0ed179c700 1 -- 172.21.15.71:0/736925584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ebc003bf0 msgr2=0x7f0ebc003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.591+0000 7f0ed179c700 1 --2- 172.21.15.71:0/736925584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ebc003bf0 0x7f0ebc003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.591+0000 7f0ed179c700 1 -- 172.21.15.71:0/736925584 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec4054280 con 0x7f0ebc005210 2023-10-09T06:42:45.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.592+0000 7f0ed179c700 1 -- 172.21.15.71:0/736925584 reap_dead start 2023-10-09T06:42:45.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.592+0000 7f75b9d9c700 1 --2- 172.21.15.71:0/2028407121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75ac0d67a0 0x7f75ac0d3b20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f75b40614f0 tx=0x7f75b406e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.592+0000 7f75a97fa700 1 -- 172.21.15.71:0/2028407121 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b4067b30 con 0x7f75ac0d67a0 2023-10-09T06:42:45.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.592+0000 7f75a97fa700 1 -- 172.21.15.71:0/2028407121 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b408c070 con 0x7f75ac0d67a0 2023-10-09T06:42:45.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.592+0000 7f75ba59d700 1 -- 172.21.15.71:0/2028407121 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ac0d7290 con 0x7f75ac0d67a0 2023-10-09T06:42:45.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.592+0000 7f0ed179c700 1 --2- 172.21.15.71:0/736925584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ebc005210 0x7f0ebc007a40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000d4f0 tx=0x7f0ec0001700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69dc03a62f9f6dc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.593+0000 7f75ba59d700 1 -- 172.21.15.71:0/2028407121 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ac0d7850 con 0x7f75ac0d67a0 2023-10-09T06:42:45.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.593+0000 7f0ecb7fe700 1 -- 172.21.15.71:0/736925584 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0001a30 con 0x7f0ebc005210 2023-10-09T06:42:45.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.593+0000 7f0ecb7fe700 1 -- 172.21.15.71:0/736925584 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec000dda0 con 0x7f0ebc005210 2023-10-09T06:42:45.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.593+0000 7f0ecb7fe700 1 -- 172.21.15.71:0/736925584 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec00106d0 con 0x7f0ebc005210 2023-10-09T06:42:45.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.593+0000 7f75a97fa700 1 -- 172.21.15.71:0/2028407121 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b4067ee0 con 0x7f75ac0d67a0 2023-10-09T06:42:45.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.594+0000 7f0ed1f9d700 1 -- 172.21.15.71:0/736925584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ebc005210 msgr2=0x7f0ebc007a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.594+0000 7f0ed1f9d700 1 --2- 172.21.15.71:0/736925584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ebc005210 0x7f0ebc007a40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000d4f0 tx=0x7f0ec0001700 comp rx=0 tx=0).stop 2023-10-09T06:42:45.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.594+0000 7f74b199d700 1 -- 172.21.15.71:0/3522842806 shutdown_connections 2023-10-09T06:42:45.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.595+0000 7f0ed1f9d700 1 -- 172.21.15.71:0/736925584 shutdown_connections 2023-10-09T06:42:45.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.595+0000 7f0ed1f9d700 1 --2- 172.21.15.71:0/736925584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ebc005210 0x7f0ebc007a40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.595+0000 7f0ed1f9d700 1 -- 172.21.15.71:0/736925584 >> 172.21.15.71:0/736925584 conn(0x7f0ec4051810 msgr2=0x7f0ec4051c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.595+0000 7f74b199d700 1 -- 172.21.15.71:0/3522842806 wait complete. 2023-10-09T06:42:45.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.595+0000 7f93defff700 1 Processor -- start 2023-10-09T06:42:45.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.595+0000 7f75ba59d700 1 -- 172.21.15.71:0/2028407121 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75940052b0 con 0x7f75ac0d67a0 2023-10-09T06:42:45.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.595+0000 7f0ed1f9d700 1 -- 172.21.15.71:0/736925584 shutdown_connections 2023-10-09T06:42:45.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.596+0000 7f0ed1f9d700 1 -- 172.21.15.71:0/736925584 wait complete. 2023-10-09T06:42:45.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.596+0000 7f75a97fa700 1 -- 172.21.15.71:0/2028407121 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f75b408e070 con 0x7f75ac0d67a0 2023-10-09T06:42:45.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.597+0000 7f75a97fa700 1 --2- 172.21.15.71:0/2028407121 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7598067080 0x7f7598069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.597+0000 7f75a97fa700 1 -- 172.21.15.71:0/2028407121 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f75b40fb3e0 con 0x7f75ac0d67a0 2023-10-09T06:42:45.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.598+0000 7f75b959b700 1 --2- 172.21.15.71:0/2028407121 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7598067080 0x7f7598069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.596+0000 7f93defff700 1 -- start start 2023-10-09T06:42:45.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.598+0000 7f93defff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d80b0010 0x7f93d815d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.598+0000 7f93defff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d80b0750 con 0x7f93d815dd90 2023-10-09T06:42:45.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.598+0000 7f93defff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d80aca70 con 0x7f93d80afc40 2023-10-09T06:42:45.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.598+0000 7f93defff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d80acd50 con 0x7f93d80b0010 2023-10-09T06:42:45.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.598+0000 7f93dd59c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f93d815dd90 0x7f93d80adb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58222/0 (socket says 172.21.15.71:58222) 2023-10-09T06:42:45.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.598+0000 7f93dd59c700 1 -- 172.21.15.71:0/635496386 learned_addr learned my addr 172.21.15.71:0/635496386 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:45.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.598+0000 7f93d7fff700 1 --2- 172.21.15.71:0/635496386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d80b0010 0x7f93d815d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.599+0000 7f74b199d700 1 Processor -- start 2023-10-09T06:42:45.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.599+0000 7f74b199d700 1 -- start start 2023-10-09T06:42:45.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.599+0000 7f0ed1f9d700 1 Processor -- start 2023-10-09T06:42:45.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.599+0000 7f93d7fff700 1 -- 172.21.15.71:0/635496386 >> v1:172.21.15.179:6789/0 conn(0x7f93d80afc40 legacy=0x7f93d80b1c00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-09T06:42:45.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.599+0000 7f93d7fff700 1 -- 172.21.15.71:0/635496386 >> v1:172.21.15.71:6789/0 conn(0x7f93d815dd90 legacy=0x7f93d80adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.599+0000 7f93d7fff700 1 -- 172.21.15.71:0/635496386 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d80ad030 con 0x7f93d80b0010 2023-10-09T06:42:45.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.599+0000 7f75b959b700 1 --2- 172.21.15.71:0/2028407121 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7598067080 0x7f7598069530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f75b000c1e0 tx=0x7f75b0016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.600+0000 7f0ed1f9d700 1 -- start start 2023-10-09T06:42:45.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.600+0000 7f93d7fff700 1 --2- 172.21.15.71:0/635496386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d80b0010 0x7f93d815d850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f93c0009e90 tx=0x7f93c0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecb228cc9664358a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.600+0000 7f93d77fe700 1 -- 172.21.15.71:0/635496386 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c000e070 con 0x7f93d80b0010 2023-10-09T06:42:45.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.600+0000 7f93d77fe700 1 -- 172.21.15.71:0/635496386 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c000bbf0 con 0x7f93d80b0010 2023-10-09T06:42:45.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.600+0000 7f93d77fe700 1 -- 172.21.15.71:0/635496386 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c0012430 con 0x7f93d80b0010 2023-10-09T06:42:45.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.600+0000 7f74b199d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74a4050840 0x7f74a40edcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.601+0000 7f53d759d700 1 Processor -- start 2023-10-09T06:42:45.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.601+0000 7f53d759d700 1 -- start start 2023-10-09T06:42:45.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.601+0000 7f93defff700 1 -- 172.21.15.71:0/635496386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d80b0010 msgr2=0x7f93d815d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.601+0000 7f74b099b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74a4050840 0x7f74a40edcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.601+0000 7f93defff700 1 --2- 172.21.15.71:0/635496386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d80b0010 0x7f93d815d850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f93c0009e90 tx=0x7f93c0009780 comp rx=0 tx=0).stop 2023-10-09T06:42:45.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.601+0000 7f74b199d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74a40de590 0x7f74a4052ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.601+0000 7f74b099b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74a4050840 0x7f74a40edcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52058/0 (socket says 172.21.15.71:52058) 2023-10-09T06:42:45.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.601+0000 7f74b199d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74a40de960 0x7f74a40533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.601+0000 7f93defff700 1 -- 172.21.15.71:0/635496386 shutdown_connections 2023-10-09T06:42:45.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.601+0000 7f93defff700 1 --2- 172.21.15.71:0/635496386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d80b0010 0x7f93d815d850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.601+0000 7f93defff700 1 -- 172.21.15.71:0/635496386 >> 172.21.15.71:0/635496386 conn(0x7f93d806a320 msgr2=0x7f93d80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.602+0000 7f0ed1f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ebc005210 0x7f0ec40c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.602+0000 7f0ed1f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ec4038170 0x7f0ec404c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.602+0000 7f75a97fa700 1 -- 172.21.15.71:0/2028407121 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f75b40c86e0 con 0x7f75ac0d67a0 2023-10-09T06:42:45.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.602+0000 7f0ed0f9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ebc005210 0x7f0ec40c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.602+0000 7f0ed0f9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ebc005210 0x7f0ec40c99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:49182/0 (socket says 172.21.15.71:49182) 2023-10-09T06:42:45.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.602+0000 7f0ed0f9b700 1 -- 172.21.15.71:0/1618361966 learned_addr learned my addr 172.21.15.71:0/1618361966 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.602+0000 7f0ed1f9d700 1 --2- 172.21.15.71:0/1618361966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ec40364e0 0x7f0ec4036980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.603+0000 7f0ed1f9d700 1 -- 172.21.15.71:0/1618361966 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec4036ec0 con 0x7f0ec4038170 2023-10-09T06:42:45.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.603+0000 7f0ecbfff700 1 --2- 172.21.15.71:0/1618361966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ec4038170 0x7f0ec404c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.603+0000 7f0ed1f9d700 1 -- 172.21.15.71:0/1618361966 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40decf0 con 0x7f0ec40364e0 2023-10-09T06:42:45.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.603+0000 7f0ed179c700 1 --2- 172.21.15.71:0/1618361966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ec40364e0 0x7f0ec4036980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.603+0000 7f0ed1f9d700 1 -- 172.21.15.71:0/1618361966 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40defd0 con 0x7f0ebc005210 2023-10-09T06:42:45.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.603+0000 7f93defff700 1 -- 172.21.15.71:0/635496386 shutdown_connections 2023-10-09T06:42:45.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.603+0000 7f53d759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53c8038fb0 0x7f53c80e1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.603+0000 7f53d759d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f53c8039380 0x7f53c80e2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.603+0000 7f53d759d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c80e2850 con 0x7f53c8006370 2023-10-09T06:42:45.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.603+0000 7f53d759d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c8006f00 con 0x7f53c8039380 2023-10-09T06:42:45.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.603+0000 7f53d759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c8007c60 con 0x7f53c8038fb0 2023-10-09T06:42:45.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.603+0000 7f53d659b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53c8038fb0 0x7f53c80e1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.604+0000 7f53d659b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53c8038fb0 0x7f53c80e1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:49198/0 (socket says 172.21.15.71:49198) 2023-10-09T06:42:45.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.604+0000 7f53d659b700 1 -- 172.21.15.71:0/1047909575 learned_addr learned my addr 172.21.15.71:0/1047909575 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.604+0000 7f53d5d9a700 1 --2- 172.21.15.71:0/1047909575 >> v2:172.21.15.71:3300/0 conn(0x7f53c8039380 0x7f53c80e2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.604+0000 7f53d5d9a700 1 -- 172.21.15.71:0/1047909575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53c8038fb0 msgr2=0x7f53c80e1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.604+0000 7f53d5d9a700 1 --2- 172.21.15.71:0/1047909575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53c8038fb0 0x7f53c80e1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.604+0000 7f53d5d9a700 1 -- 172.21.15.71:0/1047909575 >> v1:172.21.15.71:6789/0 conn(0x7f53c8006370 legacy=0x7f53c80067f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.604+0000 7f53d5d9a700 1 -- 172.21.15.71:0/1047909575 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c80070e0 con 0x7f53c8039380 2023-10-09T06:42:45.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.604+0000 7f53d659b700 1 --2- 172.21.15.71:0/1047909575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53c8038fb0 0x7f53c80e1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:42:45.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.604+0000 7f0ed0f9b700 1 -- 172.21.15.71:0/1618361966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ec40364e0 msgr2=0x7f0ec4036980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.604+0000 7f0ed0f9b700 1 --2- 172.21.15.71:0/1618361966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ec40364e0 0x7f0ec4036980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.604+0000 7f0ed0f9b700 1 -- 172.21.15.71:0/1618361966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ec4038170 msgr2=0x7f0ec404c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.604+0000 7f0ed0f9b700 1 --2- 172.21.15.71:0/1618361966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ec4038170 0x7f0ec404c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.604+0000 7f0ed0f9b700 1 -- 172.21.15.71:0/1618361966 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec40df2b0 con 0x7f0ebc005210 2023-10-09T06:42:45.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.605+0000 7eff5df9d700 1 Processor -- start 2023-10-09T06:42:45.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.605+0000 7f53d5d9a700 1 --2- 172.21.15.71:0/1047909575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53c8039380 0x7f53c80e2310 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f53c8011f80 tx=0x7f53c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b338bd7d5760c3ce server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.604+0000 7f0ed0f9b700 1 --2- 172.21.15.71:0/1618361966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ebc005210 0x7f0ec40c99b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0eb800fc30 tx=0x7f0eb8009040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.605+0000 7eff5df9d700 1 -- start start 2023-10-09T06:42:45.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.604+0000 7f0ec8ff9700 1 -- 172.21.15.71:0/1618361966 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb800d850 con 0x7f0ebc005210 2023-10-09T06:42:45.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.604+0000 7f0ec8ff9700 1 -- 172.21.15.71:0/1618361966 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb800d9d0 con 0x7f0ebc005210 2023-10-09T06:42:45.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.604+0000 7f0ec8ff9700 1 -- 172.21.15.71:0/1618361966 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb800dd90 con 0x7f0ebc005210 2023-10-09T06:42:45.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.605+0000 7f0ed1f9d700 1 -- 172.21.15.71:0/1618361966 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec40df590 con 0x7f0ebc005210 2023-10-09T06:42:45.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.601+0000 7f74b199d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a403a970 con 0x7f74a4050840 2023-10-09T06:42:45.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.601+0000 7f74b199d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a403a690 con 0x7f74a40de590 2023-10-09T06:42:45.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.601+0000 7f74b199d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40da210 con 0x7f74a40de960 2023-10-09T06:42:45.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.602+0000 7f74b099b700 1 -- 172.21.15.71:0/422512148 learned_addr learned my addr 172.21.15.71:0/422512148 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.602+0000 7f74abfff700 1 --2- 172.21.15.71:0/422512148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74a40de590 0x7f74a4052ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.602+0000 7f74b119c700 1 --2- 172.21.15.71:0/422512148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74a40de960 0x7f74a40533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.602+0000 7f74b099b700 1 -- 172.21.15.71:0/422512148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74a40de960 msgr2=0x7f74a40533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.602+0000 7f74b099b700 1 --2- 172.21.15.71:0/422512148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74a40de960 0x7f74a40533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.602+0000 7f74b099b700 1 -- 172.21.15.71:0/422512148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74a40de590 msgr2=0x7f74a4052ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.602+0000 7f74b099b700 1 --2- 172.21.15.71:0/422512148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74a40de590 0x7f74a4052ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.602+0000 7f74b099b700 1 -- 172.21.15.71:0/422512148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac04c0e0 con 0x7f74a4050840 2023-10-09T06:42:45.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.603+0000 7f74b099b700 1 --2- 172.21.15.71:0/422512148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74a4050840 0x7f74a40edcb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f74a000c590 tx=0x7f74a000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.606+0000 7f74a8ff9700 1 -- 172.21.15.71:0/422512148 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0011590 con 0x7f74a4050840 2023-10-09T06:42:45.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.606+0000 7f74a8ff9700 1 -- 172.21.15.71:0/422512148 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a00116f0 con 0x7f74a4050840 2023-10-09T06:42:45.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.606+0000 7f0ed1f9d700 1 -- 172.21.15.71:0/1618361966 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec40385e0 con 0x7f0ebc005210 2023-10-09T06:42:45.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.606+0000 7eff5df9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7eff50039370 0x7eff50053f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.607+0000 7eff5df9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff500e2490 0x7eff50054490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.607+0000 7eff5df9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff500549d0 con 0x7eff500e20c0 2023-10-09T06:42:45.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.606+0000 7f74a8ff9700 1 -- 172.21.15.71:0/422512148 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0011a90 con 0x7f74a4050840 2023-10-09T06:42:45.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.607+0000 7f74b199d700 1 -- 172.21.15.71:0/422512148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a40da4f0 con 0x7f74a4050840 2023-10-09T06:42:45.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.607+0000 7f74b199d700 1 -- 172.21.15.71:0/422512148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a40ee1f0 con 0x7f74a4050840 2023-10-09T06:42:45.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.607+0000 7eff57fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7eff50039370 0x7eff50053f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.607+0000 7eff57fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7eff50039370 0x7eff50053f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:49282/0 (socket says 172.21.15.71:49282) 2023-10-09T06:42:45.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.607+0000 7eff57fff700 1 -- 172.21.15.71:0/2374106021 learned_addr learned my addr 172.21.15.71:0/2374106021 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.607+0000 7eff5d79c700 1 --2- 172.21.15.71:0/2374106021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff500e2490 0x7eff50054490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.608+0000 7eff5df9d700 1 -- 172.21.15.71:0/2374106021 --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff50055840 con 0x7eff50039370 2023-10-09T06:42:45.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.608+0000 7eff5df9d700 1 -- 172.21.15.71:0/2374106021 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff50054c30 con 0x7eff500e2490 2023-10-09T06:42:45.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.605+0000 7f93defff700 1 -- 172.21.15.71:0/635496386 wait complete. 2023-10-09T06:42:45.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.607+0000 7f93defff700 1 Processor -- start 2023-10-09T06:42:45.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.608+0000 7f0ed1f9d700 1 -- 172.21.15.71:0/1618361966 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec40054e0 con 0x7f0ebc005210 2023-10-09T06:42:45.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.608+0000 7f53d5599700 1 -- 172.21.15.71:0/1047909575 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0011630 con 0x7f53c8039380 2023-10-09T06:42:45.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.608+0000 7f53d5599700 1 -- 172.21.15.71:0/1047909575 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c0011790 con 0x7f53c8039380 2023-10-09T06:42:45.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.608+0000 7f53d5599700 1 -- 172.21.15.71:0/1047909575 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0011b30 con 0x7f53c8039380 2023-10-09T06:42:45.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.609+0000 7f93defff700 1 -- start start 2023-10-09T06:42:45.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.609+0000 7f53d759d700 1 -- 172.21.15.71:0/1047909575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53c8039380 msgr2=0x7f53c80e2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.609+0000 7f53d759d700 1 --2- 172.21.15.71:0/1047909575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53c8039380 0x7f53c80e2310 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f53c8011f80 tx=0x7f53c00091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.609+0000 7f81d199d700 1 Processor -- start 2023-10-09T06:42:45.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.609+0000 7f53d759d700 1 -- 172.21.15.71:0/1047909575 shutdown_connections 2023-10-09T06:42:45.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.609+0000 7f53d759d700 1 --2- 172.21.15.71:0/1047909575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53c8038fb0 0x7f53c80e1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.610+0000 7f81d199d700 1 -- start start 2023-10-09T06:42:45.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.609+0000 7f53d759d700 1 --2- 172.21.15.71:0/1047909575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53c8039380 0x7f53c80e2310 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f53c8011f80 tx=0x7f53c00091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.609+0000 7f53d759d700 1 -- 172.21.15.71:0/1047909575 >> 172.21.15.71:0/1047909575 conn(0x7f53c800f1c0 msgr2=0x7f53c8059180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.608+0000 7eff577fe700 1 -- 172.21.15.71:0/2374106021 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831336130 0 0) 0x7eff500549d0 con 0x7eff500e20c0 2023-10-09T06:42:45.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.608+0000 7eff577fe700 1 -- 172.21.15.71:0/2374106021 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff48003570 con 0x7eff500e20c0 2023-10-09T06:42:45.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.609+0000 7eff577fe700 1 -- 172.21.15.71:0/2374106021 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2875009569 0 0) 0x7eff48003570 con 0x7eff500e20c0 2023-10-09T06:42:45.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.609+0000 7eff577fe700 1 -- 172.21.15.71:0/2374106021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff500e2490 msgr2=0x7eff50054490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.609+0000 7eff577fe700 1 --2- 172.21.15.71:0/2374106021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff500e2490 0x7eff50054490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.609+0000 7eff577fe700 1 -- 172.21.15.71:0/2374106021 >> v2:172.21.15.179:3300/0 conn(0x7eff50039370 msgr2=0x7eff50053f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.609+0000 7eff577fe700 1 --2- 172.21.15.71:0/2374106021 >> v2:172.21.15.179:3300/0 conn(0x7eff50039370 0x7eff50053f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.609+0000 7eff577fe700 1 -- 172.21.15.71:0/2374106021 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff50054f10 con 0x7eff500e20c0 2023-10-09T06:42:45.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.609+0000 7eff577fe700 1 -- 172.21.15.71:0/2374106021 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7eff44001470 con 0x7eff500e20c0 2023-10-09T06:42:45.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.609+0000 7eff577fe700 1 -- 172.21.15.71:0/2374106021 >> v1:172.21.15.179:6789/0 conn(0x7eff500e20c0 legacy=0x7eff50038c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.609+0000 7eff577fe700 1 --2- 172.21.15.71:0/2374106021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff48003a80 0x7eff48003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.609+0000 7eff577fe700 1 --2- 172.21.15.71:0/2374106021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff48004810 0x7eff48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.609+0000 7eff577fe700 1 --2- 172.21.15.71:0/2374106021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff480052e0 0x7eff48014270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.609+0000 7eff577fe700 1 -- 172.21.15.71:0/2374106021 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff50055840 con 0x7eff48003a80 2023-10-09T06:42:45.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.609+0000 7eff577fe700 1 -- 172.21.15.71:0/2374106021 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff50054c30 con 0x7eff48004810 2023-10-09T06:42:45.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.609+0000 7eff577fe700 1 -- 172.21.15.71:0/2374106021 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff48005ab0 con 0x7eff480052e0 2023-10-09T06:42:45.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.610+0000 7eff5cf9b700 1 --2- 172.21.15.71:0/2374106021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff48003a80 0x7eff48003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.610+0000 7f93defff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93d80afc40 0x7f93d8152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.610+0000 7f93defff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d80b0010 0x7f93d81556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.610+0000 7eff57fff700 1 --2- 172.21.15.71:0/2374106021 >> v2:172.21.15.179:3300/0 conn(0x7eff50039370 0x7eff50053f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:45.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.611+0000 7f185b59e700 1 Processor -- start 2023-10-09T06:42:45.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.611+0000 7eff5d79c700 1 --2- 172.21.15.71:0/2374106021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff500e2490 0x7eff50054490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:45.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.611+0000 7eff57fff700 1 --2- 172.21.15.71:0/2374106021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff48004810 0x7eff48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.611+0000 7eff5d79c700 1 --2- 172.21.15.71:0/2374106021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff480052e0 0x7eff48014270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.610+0000 7f93defff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93d815dd90 0x7f93d8155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.611+0000 7eff5cf9b700 1 -- 172.21.15.71:0/2374106021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff480052e0 msgr2=0x7eff48014270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.611+0000 7eff5cf9b700 1 --2- 172.21.15.71:0/2374106021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff480052e0 0x7eff48014270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.611+0000 7eff5cf9b700 1 -- 172.21.15.71:0/2374106021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff48004810 msgr2=0x7eff48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.611+0000 7eff5cf9b700 1 --2- 172.21.15.71:0/2374106021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff48004810 0x7eff48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.612+0000 7eff5cf9b700 1 -- 172.21.15.71:0/2374106021 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff50054f10 con 0x7eff48003a80 2023-10-09T06:42:45.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.612+0000 7f53d759d700 1 -- 172.21.15.71:0/1047909575 shutdown_connections 2023-10-09T06:42:45.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.609+0000 7f74b199d700 1 -- 172.21.15.71:0/422512148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a40da350 con 0x7f74a4050840 2023-10-09T06:42:45.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.610+0000 7f93defff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d8155230 con 0x7f93d815dd90 2023-10-09T06:42:45.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.610+0000 7f93defff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d8154620 con 0x7f93d80afc40 2023-10-09T06:42:45.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.610+0000 7f93defff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d8154900 con 0x7f93d80b0010 2023-10-09T06:42:45.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.611+0000 7f93d7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d80b0010 0x7f93d81556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.611+0000 7f93dcd9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93d80afc40 0x7f93d8152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.611+0000 7f93d7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d80b0010 0x7f93d81556c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:49222/0 (socket says 172.21.15.71:49222) 2023-10-09T06:42:45.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.611+0000 7f93d7fff700 1 -- 172.21.15.71:0/3692131267 learned_addr learned my addr 172.21.15.71:0/3692131267 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.611+0000 7f93dd59c700 1 --2- 172.21.15.71:0/3692131267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93d815dd90 0x7f93d8155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.611+0000 7f93d7fff700 1 -- 172.21.15.71:0/3692131267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93d80afc40 msgr2=0x7f93d8152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.611+0000 7f93d7fff700 1 --2- 172.21.15.71:0/3692131267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93d80afc40 0x7f93d8152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.611+0000 7f93d7fff700 1 -- 172.21.15.71:0/3692131267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93d815dd90 msgr2=0x7f93d8155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.611+0000 7f93d7fff700 1 --2- 172.21.15.71:0/3692131267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93d815dd90 0x7f93d8155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.611+0000 7f93d7fff700 1 -- 172.21.15.71:0/3692131267 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c0009a20 con 0x7f93d80b0010 2023-10-09T06:42:45.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.611+0000 7f93d7fff700 1 --2- 172.21.15.71:0/3692131267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d80b0010 0x7f93d81556c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f93d8064290 tx=0x7f93c0018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.612+0000 7eff5d79c700 1 --2- 172.21.15.71:0/2374106021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff480052e0 0x7eff48014270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:45.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.612+0000 7f81d199d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4006d70 0x7f81c4007140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.612+0000 7f81d199d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f81c400d4c0 0x7f81c40e1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.612+0000 7f185b59e700 1 -- start start 2023-10-09T06:42:45.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.612+0000 7f81d099b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4006d70 0x7f81c4007140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.613+0000 7f81d199d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c4035190 con 0x7f81c400d930 2023-10-09T06:42:45.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.613+0000 7f81d099b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4006d70 0x7f81c4007140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:49240/0 (socket says 172.21.15.71:49240) 2023-10-09T06:42:45.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.613+0000 7f81d099b700 1 -- 172.21.15.71:0/2596866781 learned_addr learned my addr 172.21.15.71:0/2596866781 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.613+0000 7f81d199d700 1 -- 172.21.15.71:0/2596866781 --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c4055b60 con 0x7f81c400d4c0 2023-10-09T06:42:45.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.613+0000 7f81d199d700 1 -- 172.21.15.71:0/2596866781 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c4055350 con 0x7f81c4006d70 2023-10-09T06:42:45.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.613+0000 7f81cbfff700 1 --2- 172.21.15.71:0/2596866781 >> v2:172.21.15.179:3300/0 conn(0x7f81c400d4c0 0x7f81c40e1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.612+0000 7f93d4ff9700 1 -- 172.21.15.71:0/3692131267 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c0012e10 con 0x7f93d80b0010 2023-10-09T06:42:45.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.612+0000 7f93d4ff9700 1 -- 172.21.15.71:0/3692131267 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c001e640 con 0x7f93d80b0010 2023-10-09T06:42:45.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.613+0000 7f93d4ff9700 1 -- 172.21.15.71:0/3692131267 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c001ea40 con 0x7f93d80b0010 2023-10-09T06:42:45.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.613+0000 7f93defff700 1 -- 172.21.15.71:0/3692131267 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d8154be0 con 0x7f93d80b0010 2023-10-09T06:42:45.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.613+0000 7f81d099b700 1 -- 172.21.15.71:0/2596866781 >> v2:172.21.15.179:3300/0 conn(0x7f81c400d4c0 msgr2=0x7f81c40e1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.613+0000 7f93defff700 1 -- 172.21.15.71:0/3692131267 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d8152580 con 0x7f93d80b0010 2023-10-09T06:42:45.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.613+0000 7f81d099b700 1 --2- 172.21.15.71:0/2596866781 >> v2:172.21.15.179:3300/0 conn(0x7f81c400d4c0 0x7f81c40e1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.613+0000 7f81d099b700 1 -- 172.21.15.71:0/2596866781 >> v1:172.21.15.179:6789/0 conn(0x7f81c400d930 legacy=0x7f81c4053960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.613+0000 7f81d099b700 1 -- 172.21.15.71:0/2596866781 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c40555a0 con 0x7f81c4006d70 2023-10-09T06:42:45.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.614+0000 7f81d099b700 1 --2- 172.21.15.71:0/2596866781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4006d70 0x7f81c4007140 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f81c00099b0 tx=0x7f81c0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41126c72bcd339f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.614+0000 7f185b59e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1854039370 0x7f18540e22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.614+0000 7f185b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18540062c0 0x7f1854006740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.614+0000 7f81cb7fe700 1 -- 172.21.15.71:0/2596866781 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0009ea0 con 0x7f81c4006d70 2023-10-09T06:42:45.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.614+0000 7f81cb7fe700 1 -- 172.21.15.71:0/2596866781 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c000b820 con 0x7f81c4006d70 2023-10-09T06:42:45.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.614+0000 7f81cb7fe700 1 -- 172.21.15.71:0/2596866781 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c000bbc0 con 0x7f81c4006d70 2023-10-09T06:42:45.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.615+0000 7f185a59c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f18540e1f00 0x7f1854038c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:47280/0 (socket says 172.21.15.71:47280) 2023-10-09T06:42:45.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.612+0000 7f74a8ff9700 1 -- 172.21.15.71:0/422512148 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f74a0012420 con 0x7f74a4050840 2023-10-09T06:42:45.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.615+0000 7f185b59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1854006c80 con 0x7f18540e1f00 2023-10-09T06:42:45.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.615+0000 7f185b59e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1854039b50 con 0x7f1854039370 2023-10-09T06:42:45.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.615+0000 7f185b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18540e2810 con 0x7f18540062c0 2023-10-09T06:42:45.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.614+0000 7f74a8ff9700 1 --2- 172.21.15.71:0/422512148 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7490067080 0x7f7490069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.615+0000 7f185a59c700 1 -- 172.21.15.71:0/1484621272 learned_addr learned my addr 172.21.15.71:0/1484621272 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:45.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.615+0000 7eff5cf9b700 1 --2- 172.21.15.71:0/2374106021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff48003a80 0x7eff48003eb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7eff4400c410 tx=0x7eff44007970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279f1499db872ccf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.614+0000 7f74a8ff9700 1 -- 172.21.15.71:0/422512148 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f74a0083830 con 0x7f74a4050840 2023-10-09T06:42:45.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.615+0000 7f1859d9b700 1 --2- 172.21.15.71:0/1484621272 >> v2:172.21.15.71:3300/0 conn(0x7f1854039370 0x7f18540e22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.615+0000 7f185ad9d700 1 --2- 172.21.15.71:0/1484621272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18540062c0 0x7f1854006740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.614+0000 7f74abfff700 1 --2- 172.21.15.71:0/422512148 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7490067080 0x7f7490069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.615+0000 7f185959a700 1 -- 172.21.15.71:0/1484621272 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2241663464 0 0) 0x7f1854006c80 con 0x7f18540e1f00 2023-10-09T06:42:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.615+0000 7f185959a700 1 -- 172.21.15.71:0/1484621272 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1844003570 con 0x7f18540e1f00 2023-10-09T06:42:45.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.616+0000 7f81d199d700 1 -- 172.21.15.71:0/2596866781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4006d70 msgr2=0x7f81c4007140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.616+0000 7f81d199d700 1 --2- 172.21.15.71:0/2596866781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4006d70 0x7f81c4007140 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f81c00099b0 tx=0x7f81c0009250 comp rx=0 tx=0).stop 2023-10-09T06:42:45.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.616+0000 7f185959a700 1 -- 172.21.15.71:0/1484621272 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3868579381 0 0) 0x7f1844003570 con 0x7f18540e1f00 2023-10-09T06:42:45.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.616+0000 7f185959a700 1 -- 172.21.15.71:0/1484621272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18540062c0 msgr2=0x7f1854006740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.616+0000 7f185959a700 1 --2- 172.21.15.71:0/1484621272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18540062c0 0x7f1854006740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.616+0000 7f185959a700 1 -- 172.21.15.71:0/1484621272 >> v2:172.21.15.71:3300/0 conn(0x7f1854039370 msgr2=0x7f18540e22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.616+0000 7f185959a700 1 --2- 172.21.15.71:0/1484621272 >> v2:172.21.15.71:3300/0 conn(0x7f1854039370 0x7f18540e22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.616+0000 7f185959a700 1 -- 172.21.15.71:0/1484621272 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1854006ed0 con 0x7f18540e1f00 2023-10-09T06:42:45.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.616+0000 7f185959a700 1 -- 172.21.15.71:0/1484621272 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f184c001470 con 0x7f18540e1f00 2023-10-09T06:42:45.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.616+0000 7f81d199d700 1 -- 172.21.15.71:0/2596866781 shutdown_connections 2023-10-09T06:42:45.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.616+0000 7f81d199d700 1 --2- 172.21.15.71:0/2596866781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4006d70 0x7f81c4007140 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.616+0000 7f81d199d700 1 --2- 172.21.15.71:0/2596866781 >> v2:172.21.15.179:3300/0 conn(0x7f81c400d4c0 0x7f81c40e1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.616+0000 7f81d199d700 1 -- 172.21.15.71:0/2596866781 >> 172.21.15.71:0/2596866781 conn(0x7f81c400b1d0 msgr2=0x7f81c400b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.616+0000 7f185959a700 1 -- 172.21.15.71:0/1484621272 >> v1:172.21.15.179:6789/0 conn(0x7f18540e1f00 legacy=0x7f1854038c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.616+0000 7f185959a700 1 --2- 172.21.15.71:0/1484621272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1844003a60 0x7f1844003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.616+0000 7f185959a700 1 --2- 172.21.15.71:0/1484621272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1844004810 0x7f1844004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.616+0000 7f185959a700 1 --2- 172.21.15.71:0/1484621272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18440051c0 0x7f184400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.616+0000 7f185959a700 1 -- 172.21.15.71:0/1484621272 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1854039b50 con 0x7f1844003a60 2023-10-09T06:42:45.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.616+0000 7f185959a700 1 -- 172.21.15.71:0/1484621272 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18540e2810 con 0x7f18440051c0 2023-10-09T06:42:45.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.616+0000 7f185959a700 1 -- 172.21.15.71:0/1484621272 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184400bfa0 con 0x7f1844004810 2023-10-09T06:42:45.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.616+0000 7f93ce7fc700 1 -- 172.21.15.71:0/3692131267 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d81553a0 con 0x7f93d80b0010 2023-10-09T06:42:45.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.616+0000 7f81d199d700 1 -- 172.21.15.71:0/2596866781 shutdown_connections 2023-10-09T06:42:45.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.616+0000 7f81d199d700 1 -- 172.21.15.71:0/2596866781 wait complete. 2023-10-09T06:42:45.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.614+0000 7f53d759d700 1 -- 172.21.15.71:0/1047909575 wait complete. 2023-10-09T06:42:45.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.617+0000 7f53d759d700 1 Processor -- start 2023-10-09T06:42:45.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.617+0000 7f185a59c700 1 --2- 172.21.15.71:0/1484621272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1844003a60 0x7f1844003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.617+0000 7f1859d9b700 1 --2- 172.21.15.71:0/1484621272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1844004810 0x7f1844004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.617+0000 7f1859d9b700 1 -- 172.21.15.71:0/1484621272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18440051c0 msgr2=0x7f184400ba60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-09T06:42:45.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.617+0000 7f1859d9b700 1 --2- 172.21.15.71:0/1484621272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18440051c0 0x7f184400ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.617+0000 7f1859d9b700 1 -- 172.21.15.71:0/1484621272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1844003a60 msgr2=0x7f1844003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:45.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.617+0000 7f1859d9b700 1 --2- 172.21.15.71:0/1484621272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1844003a60 0x7f1844003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.617+0000 7f1859d9b700 1 -- 172.21.15.71:0/1484621272 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1854006ed0 con 0x7f1844004810 2023-10-09T06:42:45.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.617+0000 7f185a59c700 1 --2- 172.21.15.71:0/1484621272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1844003a60 0x7f1844003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:42:45.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.618+0000 7f1859d9b700 1 --2- 172.21.15.71:0/1484621272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1844004810 0x7f1844004c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1854039770 tx=0x7f18500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a197a8a9513ae8d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.618+0000 7f0ec8ff9700 1 -- 172.21.15.71:0/1618361966 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0eb8013600 con 0x7f0ebc005210 2023-10-09T06:42:45.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.617+0000 7f53d759d700 1 -- start start 2023-10-09T06:42:45.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.619+0000 7f53d759d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53c8006370 0x7f53c80e16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.619+0000 7f0ec8ff9700 1 --2- 172.21.15.71:0/1618361966 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0eb0067080 0x7f0eb0069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.619+0000 7f81d199d700 1 Processor -- start 2023-10-09T06:42:45.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.619+0000 7f0ec8ff9700 1 -- 172.21.15.71:0/1618361966 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0eb8084960 con 0x7f0ebc005210 2023-10-09T06:42:45.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.619+0000 7f81d199d700 1 -- start start 2023-10-09T06:42:45.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.620+0000 7f74abfff700 1 --2- 172.21.15.71:0/422512148 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7490067080 0x7f7490069530 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f74a4035d50 tx=0x7f74ac090000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.619+0000 7f53d659b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53c8006370 0x7f53c80e16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.620+0000 7f53d759d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53c8038fb0 0x7f53c804f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.620+0000 7f53d759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53c804f9e0 0x7f53c80f53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.620+0000 7f53d659b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53c8006370 0x7f53c80e16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52134/0 (socket says 172.21.15.71:52134) 2023-10-09T06:42:45.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.620+0000 7f53d759d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80f4510 con 0x7f53c8006370 2023-10-09T06:42:45.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.620+0000 7f53d759d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80f3940 con 0x7f53c8038fb0 2023-10-09T06:42:45.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.620+0000 7f53d759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80f3be0 con 0x7f53c804f9e0 2023-10-09T06:42:45.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.620+0000 7f0ecbfff700 1 --2- 172.21.15.71:0/1618361966 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0eb0067080 0x7f0eb0069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.620+0000 7f93d4ff9700 1 -- 172.21.15.71:0/3692131267 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f93c0024070 con 0x7f93d80b0010 2023-10-09T06:42:45.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.620+0000 7f53d659b700 1 -- 172.21.15.71:0/2777834558 learned_addr learned my addr 172.21.15.71:0/2777834558 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.620+0000 7f53d6d9c700 1 --2- 172.21.15.71:0/2777834558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53c804f9e0 0x7f53c80f53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.620+0000 7f53d5d9a700 1 --2- 172.21.15.71:0/2777834558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53c8038fb0 0x7f53c804f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.621+0000 7f0ecbfff700 1 --2- 172.21.15.71:0/1618361966 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0eb0067080 0x7f0eb0069530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc000eb0 tx=0x7f0ecc092040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.621+0000 7f185959a700 1 -- 172.21.15.71:0/1484621272 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185000e710 con 0x7f1844004810 2023-10-09T06:42:45.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.621+0000 7eff577fe700 1 -- 172.21.15.71:0/2374106021 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44007c60 con 0x7eff48003a80 2023-10-09T06:42:45.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.621+0000 7eff577fe700 1 -- 172.21.15.71:0/2374106021 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4400ccc0 con 0x7eff48003a80 2023-10-09T06:42:45.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.621+0000 7eff577fe700 1 -- 172.21.15.71:0/2374106021 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44012670 con 0x7eff48003a80 2023-10-09T06:42:45.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.621+0000 7f0ec8ff9700 1 -- 172.21.15.71:0/1618361966 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0eb8051bb0 con 0x7f0ebc005210 2023-10-09T06:42:45.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.621+0000 7f81d199d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4006d70 0x7f81c40ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.621+0000 7f53d6d9c700 1 -- 172.21.15.71:0/2777834558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53c8038fb0 msgr2=0x7f53c804f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.621+0000 7f53d6d9c700 1 --2- 172.21.15.71:0/2777834558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53c8038fb0 0x7f53c804f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.621+0000 7f53d6d9c700 1 -- 172.21.15.71:0/2777834558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53c8006370 msgr2=0x7f53c80e16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.621+0000 7f53d6d9c700 1 --2- 172.21.15.71:0/2777834558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53c8006370 0x7f53c80e16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.621+0000 7f53d6d9c700 1 -- 172.21.15.71:0/2777834558 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc0094f0 con 0x7f53c804f9e0 2023-10-09T06:42:45.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.621+0000 7f53d5d9a700 1 --2- 172.21.15.71:0/2777834558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53c8038fb0 0x7f53c804f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:45.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.621+0000 7f81d199d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81c400d4c0 0x7f81c404bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.621+0000 7f53d6d9c700 1 --2- 172.21.15.71:0/2777834558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53c804f9e0 0x7f53c80f53a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f53d004cc40 tx=0x7f53d0067410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.622+0000 7f74a8ff9700 1 -- 172.21.15.71:0/422512148 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74a004b5a0 con 0x7f74a4050840 2023-10-09T06:42:45.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.622+0000 7f53d659b700 1 --2- 172.21.15.71:0/2777834558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53c8006370 0x7f53c80e16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:42:45.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.622+0000 7f81d099b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4006d70 0x7f81c40ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.622+0000 7f81d099b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4006d70 0x7f81c40ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:49270/0 (socket says 172.21.15.71:49270) 2023-10-09T06:42:45.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.622+0000 7eff5df9d700 1 -- 172.21.15.71:0/2374106021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff48003a80 msgr2=0x7eff48003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.622+0000 7eff5df9d700 1 --2- 172.21.15.71:0/2374106021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff48003a80 0x7eff48003eb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7eff4400c410 tx=0x7eff44007970 comp rx=0 tx=0).stop 2023-10-09T06:42:45.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.622+0000 7eff5d79c700 1 -- 172.21.15.71:0/2374106021 reap_dead start 2023-10-09T06:42:45.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.622+0000 7f81d099b700 1 -- 172.21.15.71:0/3051582766 learned_addr learned my addr 172.21.15.71:0/3051582766 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.622+0000 7f81d199d700 1 --2- 172.21.15.71:0/3051582766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81c400d930 0x7f81c404c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.622+0000 7eff5df9d700 1 -- 172.21.15.71:0/2374106021 shutdown_connections 2023-10-09T06:42:45.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.622+0000 7eff5df9d700 1 -- 172.21.15.71:0/2374106021 >> 172.21.15.71:0/2374106021 conn(0x7eff50059b50 msgr2=0x7eff50055af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.622+0000 7eff5df9d700 1 -- 172.21.15.71:0/2374106021 shutdown_connections 2023-10-09T06:42:45.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.622+0000 7eff5df9d700 1 -- 172.21.15.71:0/2374106021 wait complete. 2023-10-09T06:42:45.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.622+0000 7f81cbfff700 1 --2- 172.21.15.71:0/3051582766 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81c400d4c0 0x7f81c404bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.622+0000 7f93d4ff9700 1 --2- 172.21.15.71:0/3692131267 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f93b8067080 0x7f93b8069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.622+0000 7f93d4ff9700 1 -- 172.21.15.71:0/3692131267 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f93c0086f30 con 0x7f93d80b0010 2023-10-09T06:42:45.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.623+0000 7f93dcd9b700 1 --2- 172.21.15.71:0/3692131267 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f93b8067080 0x7f93b8069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.623+0000 7f81d119c700 1 --2- 172.21.15.71:0/3051582766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81c400d930 0x7f81c404c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.623+0000 7f81d199d700 1 -- 172.21.15.71:0/3051582766 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c40f3840 con 0x7f81c400d930 2023-10-09T06:42:45.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.623+0000 7f81d199d700 1 -- 172.21.15.71:0/3051582766 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c404e680 con 0x7f81c400d4c0 2023-10-09T06:42:45.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.623+0000 7f81d199d700 1 -- 172.21.15.71:0/3051582766 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c40ced80 con 0x7f81c4006d70 2023-10-09T06:42:45.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.623+0000 7f93dcd9b700 1 --2- 172.21.15.71:0/3692131267 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f93b8067080 0x7f93b8069530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f93d0006fd0 tx=0x7f93d00090f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.623+0000 7f81d099b700 1 -- 172.21.15.71:0/3051582766 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81c400d4c0 msgr2=0x7f81c404bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.623+0000 7f81d099b700 1 --2- 172.21.15.71:0/3051582766 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81c400d4c0 0x7f81c404bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.623+0000 7f81d099b700 1 -- 172.21.15.71:0/3051582766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81c400d930 msgr2=0x7f81c404c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.623+0000 7f81d099b700 1 --2- 172.21.15.71:0/3051582766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81c400d930 0x7f81c404c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.623+0000 7f81d099b700 1 -- 172.21.15.71:0/3051582766 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c00094f0 con 0x7f81c4006d70 2023-10-09T06:42:45.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.624+0000 7f81d099b700 1 --2- 172.21.15.71:0/3051582766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4006d70 0x7f81c40ce840 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f81c4055490 tx=0x7f81c0016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.625+0000 7eff5df9d700 1 Processor -- start 2023-10-09T06:42:45.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.625+0000 7eff5df9d700 1 -- start start 2023-10-09T06:42:45.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.626+0000 7eff5df9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff500d5550 0x7eff50051750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.626+0000 7eff5df9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5000a000 0x7eff50050090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.626+0000 7eff5df9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff5003c9c0 0x7eff5003ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.626+0000 7f185959a700 1 -- 172.21.15.71:0/1484621272 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185000e870 con 0x7f1844004810 2023-10-09T06:42:45.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.626+0000 7f185959a700 1 -- 172.21.15.71:0/1484621272 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185000e710 con 0x7f1844004810 2023-10-09T06:42:45.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.626+0000 7f81c8ff9700 1 -- 172.21.15.71:0/3051582766 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0011ea0 con 0x7f81c4006d70 2023-10-09T06:42:45.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.626+0000 7eff5df9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff500e09c0 con 0x7eff5000a000 2023-10-09T06:42:45.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.626+0000 7eff5df9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5003d370 con 0x7eff5003c9c0 2023-10-09T06:42:45.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.626+0000 7f81d199d700 1 -- 172.21.15.71:0/3051582766 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c40f3a40 con 0x7f81c4006d70 2023-10-09T06:42:45.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.626+0000 7eff5df9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff50050790 con 0x7eff500d5550 2023-10-09T06:42:45.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.626+0000 7eff5d79c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff5003c9c0 0x7eff5003ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.627+0000 7eff5d79c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff5003c9c0 0x7eff5003ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:49348/0 (socket says 172.21.15.71:49348) 2023-10-09T06:42:45.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.627+0000 7eff5d79c700 1 -- 172.21.15.71:0/1408872455 learned_addr learned my addr 172.21.15.71:0/1408872455 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.626+0000 7f53c67fc700 1 -- 172.21.15.71:0/2777834558 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0067e10 con 0x7f53c804f9e0 2023-10-09T06:42:45.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.626+0000 7f53c67fc700 1 -- 172.21.15.71:0/2777834558 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d0067fb0 con 0x7f53c804f9e0 2023-10-09T06:42:45.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.626+0000 7f53c67fc700 1 -- 172.21.15.71:0/2777834558 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d006a660 con 0x7f53c804f9e0 2023-10-09T06:42:45.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.627+0000 7f53d759d700 1 -- 172.21.15.71:0/2777834558 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c0009420 con 0x7f53c804f9e0 2023-10-09T06:42:45.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.626+0000 7f81d199d700 1 -- 172.21.15.71:0/3051582766 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c404e030 con 0x7f81c4006d70 2023-10-09T06:42:45.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.627+0000 7eff57fff700 1 --2- 172.21.15.71:0/1408872455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5000a000 0x7eff50050090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.627+0000 7eff5d79c700 1 -- 172.21.15.71:0/1408872455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff500d5550 msgr2=0x7eff50051750 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T06:42:45.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.627+0000 7eff5d79c700 1 --2- 172.21.15.71:0/1408872455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff500d5550 0x7eff50051750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.627+0000 7eff5d79c700 1 -- 172.21.15.71:0/1408872455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5000a000 msgr2=0x7eff50050090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.627+0000 7f185b59e700 1 -- 172.21.15.71:0/1484621272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1844004810 msgr2=0x7f1844004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.627+0000 7f185b59e700 1 --2- 172.21.15.71:0/1484621272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1844004810 0x7f1844004c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1854039770 tx=0x7f18500091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.627+0000 7f185ad9d700 1 -- 172.21.15.71:0/1484621272 reap_dead start 2023-10-09T06:42:45.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.627+0000 7eff5d79c700 1 --2- 172.21.15.71:0/1408872455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5000a000 0x7eff50050090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.627+0000 7f81c8ff9700 1 -- 172.21.15.71:0/3051582766 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c001b470 con 0x7f81c4006d70 2023-10-09T06:42:45.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.627+0000 7f81c8ff9700 1 -- 172.21.15.71:0/3051582766 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c001b830 con 0x7f81c4006d70 2023-10-09T06:42:45.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.627+0000 7f185b59e700 1 -- 172.21.15.71:0/1484621272 shutdown_connections 2023-10-09T06:42:45.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.627+0000 7f185b59e700 1 -- 172.21.15.71:0/1484621272 >> 172.21.15.71:0/1484621272 conn(0x7f1854059b50 msgr2=0x7f1854055af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:45.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.627+0000 7eff5d79c700 1 -- 172.21.15.71:0/1408872455 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff50050a70 con 0x7eff5003c9c0 2023-10-09T06:42:45.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.627+0000 7eff57fff700 1 --2- 172.21.15.71:0/1408872455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5000a000 0x7eff50050090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:45.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.628+0000 7f185b59e700 1 -- 172.21.15.71:0/1484621272 shutdown_connections 2023-10-09T06:42:45.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.628+0000 7f53d759d700 1 -- 172.21.15.71:0/2777834558 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c80f41a0 con 0x7f53c804f9e0 2023-10-09T06:42:45.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.628+0000 7f185b59e700 1 -- 172.21.15.71:0/1484621272 wait complete. 2023-10-09T06:42:45.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.629+0000 7eff5d79c700 1 --2- 172.21.15.71:0/1408872455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff5003c9c0 0x7eff5003ce30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7eff58062fd0 tx=0x7eff58066260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.629+0000 7f53d759d700 1 -- 172.21.15.71:0/2777834558 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c80f4680 con 0x7f53c804f9e0 2023-10-09T06:42:45.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.630+0000 7f93d4ff9700 1 -- 172.21.15.71:0/3692131267 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93c0054180 con 0x7f93d80b0010 2023-10-09T06:42:45.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.630+0000 7eff54ff9700 1 -- 172.21.15.71:0/1408872455 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58067b30 con 0x7eff5003c9c0 2023-10-09T06:42:45.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.630+0000 7eff54ff9700 1 -- 172.21.15.71:0/1408872455 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5808c070 con 0x7eff5003c9c0 2023-10-09T06:42:45.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.630+0000 7eff5df9d700 1 -- 172.21.15.71:0/1408872455 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff50050d50 con 0x7eff5003c9c0 2023-10-09T06:42:45.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.630+0000 7eff54ff9700 1 -- 172.21.15.71:0/1408872455 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58067f00 con 0x7eff5003c9c0 2023-10-09T06:42:45.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.630+0000 7eff5df9d700 1 -- 172.21.15.71:0/1408872455 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5000ce80 con 0x7eff5003c9c0 2023-10-09T06:42:45.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.630+0000 7f185b59e700 1 Processor -- start 2023-10-09T06:42:45.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.631+0000 7f185b59e700 1 -- start start 2023-10-09T06:42:45.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.631+0000 7f53c67fc700 1 -- 172.21.15.71:0/2777834558 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f53d006aa50 con 0x7f53c804f9e0 2023-10-09T06:42:45.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.630+0000 7f81d199d700 1 -- 172.21.15.71:0/3051582766 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81ac0052b0 con 0x7f81c4006d70 2023-10-09T06:42:45.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.632+0000 7eff5df9d700 1 -- 172.21.15.71:0/1408872455 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff380052b0 con 0x7eff5003c9c0 2023-10-09T06:42:45.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.632+0000 7f81c8ff9700 1 -- 172.21.15.71:0/3051582766 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f81c001bc20 con 0x7f81c4006d70 2023-10-09T06:42:45.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.633+0000 7f185b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1844004810 0x7f18540e0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.633+0000 7f53c67fc700 1 --2- 172.21.15.71:0/2777834558 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f53b4067080 0x7f53b4069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.633+0000 7f185b59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18540e13c0 0x7f185404c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.633+0000 7f185b59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f185404ce00 0x7f185404ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.633+0000 7f53c67fc700 1 -- 172.21.15.71:0/2777834558 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f53d00faf60 con 0x7f53c804f9e0 2023-10-09T06:42:45.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.634+0000 7f81c8ff9700 1 --2- 172.21.15.71:0/3051582766 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f81b0066fb0 0x7f81b0069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.633+0000 7f185a59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1844004810 0x7f18540e0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.633+0000 7f185a59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1844004810 0x7f18540e0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:49284/0 (socket says 172.21.15.71:49284) 2023-10-09T06:42:45.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.634+0000 7f1859d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18540e13c0 0x7f185404c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.634+0000 7f1859d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18540e13c0 0x7f185404c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:49362/0 (socket says 172.21.15.71:49362) 2023-10-09T06:42:45.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.634+0000 7f185ad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f185404ce00 0x7f185404ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.634+0000 7f185ad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f185404ce00 0x7f185404ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52168/0 (socket says 172.21.15.71:52168) 2023-10-09T06:42:45.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.634+0000 7f81c8ff9700 1 -- 172.21.15.71:0/3051582766 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f81c00861d0 con 0x7f81c4006d70 2023-10-09T06:42:45.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.634+0000 7f185a59c700 1 -- 172.21.15.71:0/2792467694 learned_addr learned my addr 172.21.15.71:0/2792467694 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:45.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.634+0000 7f185b59e700 1 -- 172.21.15.71:0/2792467694 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18540e70b0 con 0x7f185404ce00 2023-10-09T06:42:45.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.634+0000 7f185b59e700 1 -- 172.21.15.71:0/2792467694 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18540e7910 con 0x7f18540e13c0 2023-10-09T06:42:45.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.634+0000 7f185b59e700 1 -- 172.21.15.71:0/2792467694 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18540f60d0 con 0x7f1844004810 2023-10-09T06:42:45.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.635+0000 7f53d659b700 1 --2- 172.21.15.71:0/2777834558 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f53b4067080 0x7f53b4069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.635+0000 7f81cbfff700 1 --2- 172.21.15.71:0/3051582766 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f81b0066fb0 0x7f81b0069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.636+0000 7eff54ff9700 1 -- 172.21.15.71:0/1408872455 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff5808e070 con 0x7eff5003c9c0 2023-10-09T06:42:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.635+0000 7f185ad9d700 1 -- 172.21.15.71:0/2792467694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1844004810 msgr2=0x7f18540e0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.635+0000 7f185ad9d700 1 --2- 172.21.15.71:0/2792467694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1844004810 0x7f18540e0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.635+0000 7f185ad9d700 1 -- 172.21.15.71:0/2792467694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18540e13c0 msgr2=0x7f185404c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.635+0000 7f185ad9d700 1 --2- 172.21.15.71:0/2792467694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18540e13c0 0x7f185404c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.635+0000 7f185ad9d700 1 -- 172.21.15.71:0/2792467694 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18540e72c0 con 0x7f185404ce00 2023-10-09T06:42:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.636+0000 7f185ad9d700 1 --2- 172.21.15.71:0/2792467694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f185404ce00 0x7f185404ef30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f185c04c860 tx=0x7f185c066260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.636+0000 7f184a7fc700 1 -- 172.21.15.71:0/2792467694 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c067ff0 con 0x7f185404ce00 2023-10-09T06:42:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.636+0000 7f1859d9b700 1 --2- 172.21.15.71:0/2792467694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18540e13c0 0x7f185404c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:45.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.637+0000 7f184a7fc700 1 -- 172.21.15.71:0/2792467694 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185c067840 con 0x7f185404ce00 2023-10-09T06:42:45.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.637+0000 7f185b59e700 1 -- 172.21.15.71:0/2792467694 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18540e75a0 con 0x7f185404ce00 2023-10-09T06:42:45.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.637+0000 7f81cbfff700 1 --2- 172.21.15.71:0/3051582766 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f81b0066fb0 0x7f81b0069460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f81c403b380 tx=0x7f81b80091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.637+0000 7f53d659b700 1 --2- 172.21.15.71:0/2777834558 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f53b4067080 0x7f53b4069530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f53c8058d90 tx=0x7f53cc009250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.638+0000 7f81c8ff9700 1 -- 172.21.15.71:0/3051582766 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f81c00533a0 con 0x7f81c4006d70 2023-10-09T06:42:45.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.640+0000 7f185b59e700 1 -- 172.21.15.71:0/2792467694 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185404f6b0 con 0x7f185404ce00 2023-10-09T06:42:45.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.640+0000 7f184a7fc700 1 -- 172.21.15.71:0/2792467694 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c091aa0 con 0x7f185404ce00 2023-10-09T06:42:45.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.641+0000 7f184a7fc700 1 -- 172.21.15.71:0/2792467694 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f185c097070 con 0x7f185404ce00 2023-10-09T06:42:45.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.642+0000 7f184a7fc700 1 --2- 172.21.15.71:0/2792467694 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f183c067100 0x7f183c0695b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.642+0000 7f184a7fc700 1 -- 172.21.15.71:0/2792467694 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f185c1032a0 con 0x7f185404ce00 2023-10-09T06:42:45.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.644+0000 7eff54ff9700 1 --2- 172.21.15.71:0/1408872455 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7eff3c067080 0x7eff3c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:45.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.644+0000 7eff54ff9700 1 -- 172.21.15.71:0/1408872455 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7eff580fbf60 con 0x7eff5003c9c0 2023-10-09T06:42:45.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.645+0000 7f53c67fc700 1 -- 172.21.15.71:0/2777834558 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53d00cbc40 con 0x7f53c804f9e0 2023-10-09T06:42:45.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.645+0000 7f185b59e700 1 -- 172.21.15.71:0/2792467694 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18540e7aa0 con 0x7f185404ce00 2023-10-09T06:42:45.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.645+0000 7f185a59c700 1 --2- 172.21.15.71:0/2792467694 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f183c067100 0x7f183c0695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.645+0000 7eff5cf9b700 1 --2- 172.21.15.71:0/1408872455 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7eff3c067080 0x7eff3c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:45.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.645+0000 7eff54ff9700 1 -- 172.21.15.71:0/1408872455 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff580ccd70 con 0x7eff5003c9c0 2023-10-09T06:42:45.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.646+0000 7eff5cf9b700 1 --2- 172.21.15.71:0/1408872455 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7eff3c067080 0x7eff3c069530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff50007af0 tx=0x7eff44017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:45.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.655+0000 7f184a7fc700 1 -- 172.21.15.71:0/2792467694 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f185c0d0540 con 0x7f185404ce00 2023-10-09T06:42:45.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:45.656+0000 7f185a59c700 1 --2- 172.21.15.71:0/2792467694 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f183c067100 0x7f183c0695b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f184c000e50 tx=0x7f184c0079d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:46.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.030+0000 7f75ba59d700 1 -- 172.21.15.71:0/2028407121 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7594005560 con 0x7f75ac0d67a0 2023-10-09T06:42:46.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.031+0000 7f75a97fa700 1 -- 172.21.15.71:0/2028407121 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f75b4068040 con 0x7f75ac0d67a0 2023-10-09T06:42:46.032 INFO:teuthology.orchestra.run.smithi071.stdout:55834574854 2023-10-09T06:42:46.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.035+0000 7f759effd700 1 -- 172.21.15.71:0/2028407121 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7598067080 msgr2=0x7f7598069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:46.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.035+0000 7f759effd700 1 --2- 172.21.15.71:0/2028407121 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7598067080 0x7f7598069530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f75b000c1e0 tx=0x7f75b0016000 comp rx=0 tx=0).stop 2023-10-09T06:42:46.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.036+0000 7f759effd700 1 -- 172.21.15.71:0/2028407121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75ac0d67a0 msgr2=0x7f75ac0d3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:46.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.036+0000 7f759effd700 1 --2- 172.21.15.71:0/2028407121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75ac0d67a0 0x7f75ac0d3b20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f75b40614f0 tx=0x7f75b406e040 comp rx=0 tx=0).stop 2023-10-09T06:42:46.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.036+0000 7f759effd700 1 -- 172.21.15.71:0/2028407121 shutdown_connections 2023-10-09T06:42:46.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.036+0000 7f759effd700 1 --2- 172.21.15.71:0/2028407121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75ac0d67a0 0x7f75ac0d3b20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.036+0000 7f759effd700 1 --2- 172.21.15.71:0/2028407121 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7598067080 0x7f7598069530 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.037+0000 7f759effd700 1 --2- 172.21.15.71:0/2028407121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75ac04c8d0 0x7f75ac04cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.037+0000 7f759effd700 1 --2- 172.21.15.71:0/2028407121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75ac0d8050 0x7f75ac0d6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.037+0000 7f759effd700 1 -- 172.21.15.71:0/2028407121 >> 172.21.15.71:0/2028407121 conn(0x7f75ac056f90 msgr2=0x7f75ac0565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:46.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.038+0000 7f759effd700 1 -- 172.21.15.71:0/2028407121 shutdown_connections 2023-10-09T06:42:46.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.038+0000 7f759effd700 1 -- 172.21.15.71:0/2028407121 wait complete. 2023-10-09T06:42:46.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2023-10-09T06:42:46.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.069+0000 7f0ed1f9d700 1 -- 172.21.15.71:0/1618361966 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0ec40df110 con 0x7f0ebc005210 2023-10-09T06:42:46.071 INFO:teuthology.orchestra.run.smithi071.stdout:55834574853 2023-10-09T06:42:46.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.070+0000 7f0ec8ff9700 1 -- 172.21.15.71:0/1618361966 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0ec40df110 con 0x7f0ebc005210 2023-10-09T06:42:46.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.071+0000 7f93ce7fc700 1 -- 172.21.15.71:0/3692131267 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f93d804c3c0 con 0x7f93d80b0010 2023-10-09T06:42:46.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.071+0000 7f81d199d700 1 -- 172.21.15.71:0/3051582766 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f81ac005560 con 0x7f81c4006d70 2023-10-09T06:42:46.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.071+0000 7f93d4ff9700 1 -- 172.21.15.71:0/3692131267 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f93c00577a0 con 0x7f93d80b0010 2023-10-09T06:42:46.073 INFO:teuthology.orchestra.run.smithi071.stdout:55834574854 2023-10-09T06:42:46.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.072+0000 7f81c8ff9700 1 -- 172.21.15.71:0/3051582766 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f81c002a090 con 0x7f81c4006d70 2023-10-09T06:42:46.073 INFO:teuthology.orchestra.run.smithi071.stdout:55834574854 2023-10-09T06:42:46.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.073+0000 7f0ed1f9d700 1 -- 172.21.15.71:0/1618361966 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0eb0067080 msgr2=0x7f0eb0069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:46.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.073+0000 7f0ed1f9d700 1 --2- 172.21.15.71:0/1618361966 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0eb0067080 0x7f0eb0069530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc000eb0 tx=0x7f0ecc092040 comp rx=0 tx=0).stop 2023-10-09T06:42:46.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.074+0000 7f0ed1f9d700 1 -- 172.21.15.71:0/1618361966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ebc005210 msgr2=0x7f0ec40c99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:46.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.074+0000 7f0ed1f9d700 1 --2- 172.21.15.71:0/1618361966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ebc005210 0x7f0ec40c99b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0eb800fc30 tx=0x7f0eb8009040 comp rx=0 tx=0).stop 2023-10-09T06:42:46.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.074+0000 7f74b199d700 1 -- 172.21.15.71:0/422512148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f74a40daa10 con 0x7f74a4050840 2023-10-09T06:42:46.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.074+0000 7f0ed1f9d700 1 -- 172.21.15.71:0/1618361966 shutdown_connections 2023-10-09T06:42:46.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.074+0000 7f0ed1f9d700 1 --2- 172.21.15.71:0/1618361966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ec40364e0 0x7f0ec4036980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.074+0000 7f0ed1f9d700 1 --2- 172.21.15.71:0/1618361966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ebc005210 0x7f0ec40c99b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.074+0000 7f0ed1f9d700 1 --2- 172.21.15.71:0/1618361966 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0eb0067080 0x7f0eb0069530 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.074+0000 7f0ed1f9d700 1 --2- 172.21.15.71:0/1618361966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ec4038170 0x7f0ec404c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.074+0000 7f0ed1f9d700 1 -- 172.21.15.71:0/1618361966 >> 172.21.15.71:0/1618361966 conn(0x7f0ec4051810 msgr2=0x7f0ec4051be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:46.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.075+0000 7f74a8ff9700 1 -- 172.21.15.71:0/422512148 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f74a40daa10 con 0x7f74a4050840 2023-10-09T06:42:46.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.075+0000 7f93ce7fc700 1 -- 172.21.15.71:0/3692131267 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f93b8067080 msgr2=0x7f93b8069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:46.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.075+0000 7f93ce7fc700 1 --2- 172.21.15.71:0/3692131267 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f93b8067080 0x7f93b8069530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f93d0006fd0 tx=0x7f93d00090f0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.075+0000 7f93ce7fc700 1 -- 172.21.15.71:0/3692131267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d80b0010 msgr2=0x7f93d81556c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:46.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.075+0000 7f93ce7fc700 1 --2- 172.21.15.71:0/3692131267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d80b0010 0x7f93d81556c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f93d8064290 tx=0x7f93c0018000 comp rx=0 tx=0).stop 2023-10-09T06:42:46.077 INFO:teuthology.orchestra.run.smithi071.stdout:55834574853 2023-10-09T06:42:46.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.075+0000 7f0ed1f9d700 1 -- 172.21.15.71:0/1618361966 shutdown_connections 2023-10-09T06:42:46.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.075+0000 7f0ed1f9d700 1 -- 172.21.15.71:0/1618361966 wait complete. 2023-10-09T06:42:46.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.075+0000 7f93ce7fc700 1 -- 172.21.15.71:0/3692131267 shutdown_connections 2023-10-09T06:42:46.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.075+0000 7f93ce7fc700 1 --2- 172.21.15.71:0/3692131267 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f93b8067080 0x7f93b8069530 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.075+0000 7f93ce7fc700 1 --2- 172.21.15.71:0/3692131267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93d815dd90 0x7f93d8155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.075+0000 7f93ce7fc700 1 --2- 172.21.15.71:0/3692131267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93d80afc40 0x7f93d8152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.075+0000 7f93ce7fc700 1 --2- 172.21.15.71:0/3692131267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d80b0010 0x7f93d81556c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.075+0000 7f93ce7fc700 1 -- 172.21.15.71:0/3692131267 >> 172.21.15.71:0/3692131267 conn(0x7f93d806a320 msgr2=0x7f93d815bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:46.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.075+0000 7f81d199d700 1 -- 172.21.15.71:0/3051582766 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f81b0066fb0 msgr2=0x7f81b0069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:46.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.075+0000 7f81d199d700 1 --2- 172.21.15.71:0/3051582766 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f81b0066fb0 0x7f81b0069460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f81c403b380 tx=0x7f81b80091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.075+0000 7f81d199d700 1 -- 172.21.15.71:0/3051582766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4006d70 msgr2=0x7f81c40ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:46.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.075+0000 7f81d199d700 1 --2- 172.21.15.71:0/3051582766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4006d70 0x7f81c40ce840 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f81c4055490 tx=0x7f81c0016000 comp rx=0 tx=0).stop 2023-10-09T06:42:46.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.075+0000 7f93ce7fc700 1 -- 172.21.15.71:0/3692131267 shutdown_connections 2023-10-09T06:42:46.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.075+0000 7f93ce7fc700 1 -- 172.21.15.71:0/3692131267 wait complete. 2023-10-09T06:42:46.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.075+0000 7f81d199d700 1 -- 172.21.15.71:0/3051582766 shutdown_connections 2023-10-09T06:42:46.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.076+0000 7f81d199d700 1 --2- 172.21.15.71:0/3051582766 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f81b0066fb0 0x7f81b0069460 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.076+0000 7f81d199d700 1 --2- 172.21.15.71:0/3051582766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81c400d930 0x7f81c404c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.076+0000 7f81d199d700 1 --2- 172.21.15.71:0/3051582766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c4006d70 0x7f81c40ce840 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.076+0000 7f81d199d700 1 --2- 172.21.15.71:0/3051582766 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81c400d4c0 0x7f81c404bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.076+0000 7f81d199d700 1 -- 172.21.15.71:0/3051582766 >> 172.21.15.71:0/3051582766 conn(0x7f81c400b1d0 msgr2=0x7f81c40dd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:46.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.076+0000 7f81d199d700 1 -- 172.21.15.71:0/3051582766 shutdown_connections 2023-10-09T06:42:46.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.076+0000 7f81d199d700 1 -- 172.21.15.71:0/3051582766 wait complete. 2023-10-09T06:42:46.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.078+0000 7f74b199d700 1 -- 172.21.15.71:0/422512148 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7490067080 msgr2=0x7f7490069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:46.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.079+0000 7f74b199d700 1 --2- 172.21.15.71:0/422512148 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7490067080 0x7f7490069530 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f74a4035d50 tx=0x7f74ac090000 comp rx=0 tx=0).stop 2023-10-09T06:42:46.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.079+0000 7f74b199d700 1 -- 172.21.15.71:0/422512148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74a4050840 msgr2=0x7f74a40edcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:46.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.079+0000 7f74b199d700 1 --2- 172.21.15.71:0/422512148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74a4050840 0x7f74a40edcb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f74a000c590 tx=0x7f74a000c950 comp rx=0 tx=0).stop 2023-10-09T06:42:46.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.079+0000 7f74b199d700 1 -- 172.21.15.71:0/422512148 shutdown_connections 2023-10-09T06:42:46.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.079+0000 7f74b199d700 1 --2- 172.21.15.71:0/422512148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74a40de960 0x7f74a40533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.079+0000 7f74b199d700 1 --2- 172.21.15.71:0/422512148 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7490067080 0x7f7490069530 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f74a4035d50 tx=0x7f74ac090000 comp rx=0 tx=0).stop 2023-10-09T06:42:46.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.079+0000 7f74b199d700 1 --2- 172.21.15.71:0/422512148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74a4050840 0x7f74a40edcb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.079+0000 7f74b199d700 1 --2- 172.21.15.71:0/422512148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74a40de590 0x7f74a4052ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.079+0000 7f74b199d700 1 -- 172.21.15.71:0/422512148 >> 172.21.15.71:0/422512148 conn(0x7f74a4054da0 msgr2=0x7f74a40ce220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:46.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.081+0000 7f53d759d700 1 -- 172.21.15.71:0/2777834558 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f53c8005930 con 0x7f53c804f9e0 2023-10-09T06:42:46.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.082+0000 7f74b199d700 1 -- 172.21.15.71:0/422512148 shutdown_connections 2023-10-09T06:42:46.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.082+0000 7f74b199d700 1 -- 172.21.15.71:0/422512148 wait complete. 2023-10-09T06:42:46.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.082+0000 7f53c67fc700 1 -- 172.21.15.71:0/2777834558 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f53d00cb7d0 con 0x7f53c804f9e0 2023-10-09T06:42:46.083 INFO:teuthology.orchestra.run.smithi071.stdout:55834574853 2023-10-09T06:42:46.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.086+0000 7f53d759d700 1 -- 172.21.15.71:0/2777834558 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f53b4067080 msgr2=0x7f53b4069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:46.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.086+0000 7f53d759d700 1 --2- 172.21.15.71:0/2777834558 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f53b4067080 0x7f53b4069530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f53c8058d90 tx=0x7f53cc009250 comp rx=0 tx=0).stop 2023-10-09T06:42:46.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.086+0000 7f53d759d700 1 -- 172.21.15.71:0/2777834558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53c804f9e0 msgr2=0x7f53c80f53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:46.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.086+0000 7f53d759d700 1 --2- 172.21.15.71:0/2777834558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53c804f9e0 0x7f53c80f53a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f53d004cc40 tx=0x7f53d0067410 comp rx=0 tx=0).stop 2023-10-09T06:42:46.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.087+0000 7f53d759d700 1 -- 172.21.15.71:0/2777834558 shutdown_connections 2023-10-09T06:42:46.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.087+0000 7f53d759d700 1 --2- 172.21.15.71:0/2777834558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53c804f9e0 0x7f53c80f53a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.087+0000 7f53d759d700 1 --2- 172.21.15.71:0/2777834558 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f53b4067080 0x7f53b4069530 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.087+0000 7f53d759d700 1 --2- 172.21.15.71:0/2777834558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53c8006370 0x7f53c80e16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.087+0000 7f53d759d700 1 --2- 172.21.15.71:0/2777834558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53c8038fb0 0x7f53c804f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.087+0000 7f53d759d700 1 -- 172.21.15.71:0/2777834558 >> 172.21.15.71:0/2777834558 conn(0x7f53c800f1c0 msgr2=0x7f53c8055ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:46.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.087+0000 7f53d759d700 1 -- 172.21.15.71:0/2777834558 shutdown_connections 2023-10-09T06:42:46.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.087+0000 7eff5df9d700 1 -- 172.21.15.71:0/1408872455 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7eff38005830 con 0x7eff5003c9c0 2023-10-09T06:42:46.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.087+0000 7f53d759d700 1 -- 172.21.15.71:0/2777834558 wait complete. 2023-10-09T06:42:46.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.088+0000 7eff54ff9700 1 -- 172.21.15.71:0/1408872455 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7eff5809f020 con 0x7eff5003c9c0 2023-10-09T06:42:46.090 INFO:teuthology.orchestra.run.smithi071.stdout:55834574853 2023-10-09T06:42:46.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.092+0000 7eff5df9d700 1 -- 172.21.15.71:0/1408872455 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7eff3c067080 msgr2=0x7eff3c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:46.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.092+0000 7eff5df9d700 1 --2- 172.21.15.71:0/1408872455 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7eff3c067080 0x7eff3c069530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff50007af0 tx=0x7eff44017000 comp rx=0 tx=0).stop 2023-10-09T06:42:46.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.092+0000 7eff5df9d700 1 -- 172.21.15.71:0/1408872455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff5003c9c0 msgr2=0x7eff5003ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:46.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.092+0000 7eff5df9d700 1 --2- 172.21.15.71:0/1408872455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff5003c9c0 0x7eff5003ce30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7eff58062fd0 tx=0x7eff58066260 comp rx=0 tx=0).stop 2023-10-09T06:42:46.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.092+0000 7eff5df9d700 1 -- 172.21.15.71:0/1408872455 shutdown_connections 2023-10-09T06:42:46.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.092+0000 7eff5df9d700 1 --2- 172.21.15.71:0/1408872455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff5003c9c0 0x7eff5003ce30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.092+0000 7eff5df9d700 1 --2- 172.21.15.71:0/1408872455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff500d5550 0x7eff50051750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.092+0000 7eff5df9d700 1 --2- 172.21.15.71:0/1408872455 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7eff3c067080 0x7eff3c069530 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.092+0000 7eff5df9d700 1 --2- 172.21.15.71:0/1408872455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5000a000 0x7eff50050090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.092+0000 7eff5df9d700 1 -- 172.21.15.71:0/1408872455 >> 172.21.15.71:0/1408872455 conn(0x7eff50059b50 msgr2=0x7eff500e1590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:46.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.092+0000 7eff5df9d700 1 -- 172.21.15.71:0/1408872455 shutdown_connections 2023-10-09T06:42:46.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.092+0000 7eff5df9d700 1 -- 172.21.15.71:0/1408872455 wait complete. 2023-10-09T06:42:46.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.095+0000 7f185b59e700 1 -- 172.21.15.71:0/2792467694 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f18540057d0 con 0x7f185404ce00 2023-10-09T06:42:46.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.096+0000 7f184a7fc700 1 -- 172.21.15.71:0/2792467694 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f185c0d3b60 con 0x7f185404ce00 2023-10-09T06:42:46.097 INFO:teuthology.orchestra.run.smithi071.stdout:55834574854 2023-10-09T06:42:46.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.100+0000 7f185b59e700 1 -- 172.21.15.71:0/2792467694 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f183c067100 msgr2=0x7f183c0695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:46.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.100+0000 7f185b59e700 1 --2- 172.21.15.71:0/2792467694 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f183c067100 0x7f183c0695b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f184c000e50 tx=0x7f184c0079d0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.100+0000 7f185b59e700 1 -- 172.21.15.71:0/2792467694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f185404ce00 msgr2=0x7f185404ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:46.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.100+0000 7f185b59e700 1 --2- 172.21.15.71:0/2792467694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f185404ce00 0x7f185404ef30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f185c04c860 tx=0x7f185c066260 comp rx=0 tx=0).stop 2023-10-09T06:42:46.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.101+0000 7f185b59e700 1 -- 172.21.15.71:0/2792467694 shutdown_connections 2023-10-09T06:42:46.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.101+0000 7f185b59e700 1 --2- 172.21.15.71:0/2792467694 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f183c067100 0x7f183c0695b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.101+0000 7f185b59e700 1 --2- 172.21.15.71:0/2792467694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f185404ce00 0x7f185404ef30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.101+0000 7f185b59e700 1 --2- 172.21.15.71:0/2792467694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1844004810 0x7f18540e0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.101+0000 7f185b59e700 1 --2- 172.21.15.71:0/2792467694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18540e13c0 0x7f185404c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:46.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.101+0000 7f185b59e700 1 -- 172.21.15.71:0/2792467694 >> 172.21.15.71:0/2792467694 conn(0x7f1854059b50 msgr2=0x7f185403be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:46.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.102+0000 7f185b59e700 1 -- 172.21.15.71:0/2792467694 shutdown_connections 2023-10-09T06:42:46.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:46.102+0000 7f185b59e700 1 -- 172.21.15.71:0/2792467694 wait complete. 2023-10-09T06:42:46.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2023-10-09T06:42:46.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-10-09T06:42:46.116 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-10-09T06:42:46.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-10-09T06:42:46.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-09T06:42:46.122 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-09T06:42:46.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-10-09T06:42:47.070 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-09T06:42:47.114 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-09T06:42:47.116 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-09T06:42:47.116 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-09T06:42:47.118 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-09T06:42:47.121 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-09T06:42:47.123 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-09T06:42:47.128 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-09T06:42:47.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.330+0000 7f70365ff700 1 Processor -- start 2023-10-09T06:42:47.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.330+0000 7f70365ff700 1 -- start start 2023-10-09T06:42:47.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.332+0000 7f70365ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f703015b970 0x7f703006ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.333+0000 7f70365ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f70300cccb0 0x7f703006bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.333+0000 7f70365ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7030162960 con 0x7f703015bd40 2023-10-09T06:42:47.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.333+0000 7f70365ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70300cd110 con 0x7f70300cccb0 2023-10-09T06:42:47.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.333+0000 7f70365ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70300c8c40 con 0x7f703015b970 2023-10-09T06:42:47.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.334+0000 7f702ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f703015b970 0x7f703006ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.334+0000 7f702ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f703015b970 0x7f703006ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:49288/0 (socket says 172.21.15.71:49288) 2023-10-09T06:42:47.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.334+0000 7f702ffff700 1 -- 172.21.15.71:0/865841232 learned_addr learned my addr 172.21.15.71:0/865841232 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:47.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.334+0000 7f7034b9c700 1 --2- 172.21.15.71:0/865841232 >> v2:172.21.15.71:3300/0 conn(0x7f70300cccb0 0x7f703006bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.334+0000 7f702ffff700 1 -- 172.21.15.71:0/865841232 >> v2:172.21.15.71:3300/0 conn(0x7f70300cccb0 msgr2=0x7f703006bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:47.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.334+0000 7f702ffff700 1 --2- 172.21.15.71:0/865841232 >> v2:172.21.15.71:3300/0 conn(0x7f70300cccb0 0x7f703006bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.334+0000 7f702ffff700 1 -- 172.21.15.71:0/865841232 >> v1:172.21.15.71:6789/0 conn(0x7f703015bd40 legacy=0x7f70300cc5a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T06:42:47.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.334+0000 7f702ffff700 1 -- 172.21.15.71:0/865841232 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7030161d90 con 0x7f703015b970 2023-10-09T06:42:47.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.335+0000 7f702ffff700 1 --2- 172.21.15.71:0/865841232 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f703015b970 0x7f703006ba80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f70200099b0 tx=0x7f7020009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4fd1077d096f187 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.335+0000 7f702effd700 1 -- 172.21.15.71:0/865841232 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702000b820 con 0x7f703015b970 2023-10-09T06:42:47.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.336+0000 7f702effd700 1 -- 172.21.15.71:0/865841232 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702000b980 con 0x7f703015b970 2023-10-09T06:42:47.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.337+0000 7f70365ff700 1 -- 172.21.15.71:0/865841232 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f703015b970 msgr2=0x7f703006ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.337+0000 7f70365ff700 1 --2- 172.21.15.71:0/865841232 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f703015b970 0x7f703006ba80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f70200099b0 tx=0x7f7020009250 comp rx=0 tx=0).stop 2023-10-09T06:42:47.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.337+0000 7f70365ff700 1 -- 172.21.15.71:0/865841232 shutdown_connections 2023-10-09T06:42:47.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.337+0000 7f70365ff700 1 --2- 172.21.15.71:0/865841232 >> v2:172.21.15.71:3300/0 conn(0x7f70300cccb0 0x7f703006bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.337+0000 7f70365ff700 1 --2- 172.21.15.71:0/865841232 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f703015b970 0x7f703006ba80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.337+0000 7f70365ff700 1 -- 172.21.15.71:0/865841232 >> 172.21.15.71:0/865841232 conn(0x7f70300ce600 msgr2=0x7f70300cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:47.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.338+0000 7f70365ff700 1 -- 172.21.15.71:0/865841232 shutdown_connections 2023-10-09T06:42:47.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.338+0000 7f70365ff700 1 -- 172.21.15.71:0/865841232 wait complete. 2023-10-09T06:42:47.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.340+0000 7f70365ff700 1 Processor -- start 2023-10-09T06:42:47.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.341+0000 7f70365ff700 1 -- start start 2023-10-09T06:42:47.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.342+0000 7f70365ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70300cccb0 0x7f703014aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.342+0000 7f70365ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f703015b970 0x7f7030132940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.342+0000 7f70365ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f703015bd40 0x7f70300b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.342+0000 7f70365ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7030149a70 con 0x7f703015bd40 2023-10-09T06:42:47.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.342+0000 7f70365ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7030149d10 con 0x7f70300cccb0 2023-10-09T06:42:47.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.342+0000 7f70365ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7030149ff0 con 0x7f703015b970 2023-10-09T06:42:47.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.343+0000 7f7034b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f703015bd40 0x7f70300b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.343+0000 7f702ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70300cccb0 0x7f703014aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.343+0000 7f702ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70300cccb0 0x7f703014aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:49372/0 (socket says 172.21.15.71:49372) 2023-10-09T06:42:47.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.343+0000 7f702ffff700 1 -- 172.21.15.71:0/3180033366 learned_addr learned my addr 172.21.15.71:0/3180033366 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:47.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.343+0000 7f702f7fe700 1 --2- 172.21.15.71:0/3180033366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f703015b970 0x7f7030132940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.343+0000 7f702ffff700 1 -- 172.21.15.71:0/3180033366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f703015b970 msgr2=0x7f7030132940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.343+0000 7f702ffff700 1 --2- 172.21.15.71:0/3180033366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f703015b970 0x7f7030132940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.343+0000 7f702ffff700 1 -- 172.21.15.71:0/3180033366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f703015bd40 msgr2=0x7f70300b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.343+0000 7f702ffff700 1 --2- 172.21.15.71:0/3180033366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f703015bd40 0x7f70300b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.343+0000 7f702ffff700 1 -- 172.21.15.71:0/3180033366 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70200094f0 con 0x7f70300cccb0 2023-10-09T06:42:47.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.344+0000 7f702ffff700 1 --2- 172.21.15.71:0/3180033366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70300cccb0 0x7f703014aad0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f70200094c0 tx=0x7f7020016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.345+0000 7f7017fff700 1 -- 172.21.15.71:0/3180033366 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702001a430 con 0x7f70300cccb0 2023-10-09T06:42:47.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.345+0000 7f70365ff700 1 -- 172.21.15.71:0/3180033366 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703014a2d0 con 0x7f70300cccb0 2023-10-09T06:42:47.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.345+0000 7f70365ff700 1 -- 172.21.15.71:0/3180033366 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70300b4000 con 0x7f70300cccb0 2023-10-09T06:42:47.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.347+0000 7f7017fff700 1 -- 172.21.15.71:0/3180033366 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702000bcb0 con 0x7f70300cccb0 2023-10-09T06:42:47.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.347+0000 7f7017fff700 1 -- 172.21.15.71:0/3180033366 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702001a430 con 0x7f70300cccb0 2023-10-09T06:42:47.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.350+0000 7f7015ffb700 1 -- 172.21.15.71:0/3180033366 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701c0052e0 con 0x7f70300cccb0 2023-10-09T06:42:47.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.352+0000 7f7017fff700 1 -- 172.21.15.71:0/3180033366 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7020044bd0 con 0x7f70300cccb0 2023-10-09T06:42:47.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.354+0000 7f7017fff700 1 --2- 172.21.15.71:0/3180033366 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7018067160 0x7f7018069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.354+0000 7f7017fff700 1 -- 172.21.15.71:0/3180033366 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7020085d40 con 0x7f70300cccb0 2023-10-09T06:42:47.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.355+0000 7f702f7fe700 1 --2- 172.21.15.71:0/3180033366 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7018067160 0x7f7018069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.356+0000 7f7017fff700 1 -- 172.21.15.71:0/3180033366 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7020052f10 con 0x7f70300cccb0 2023-10-09T06:42:47.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.365+0000 7f702f7fe700 1 --2- 172.21.15.71:0/3180033366 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7018067160 0x7f7018069610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f70280012b0 tx=0x7f7028009670 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.403+0000 7ffbc9d9d700 1 Processor -- start 2023-10-09T06:42:47.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.403+0000 7ffbc9d9d700 1 -- start start 2023-10-09T06:42:47.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.405+0000 7ffbc9d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc4155720 0x7ffbc406f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.405+0000 7ffbc9d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffbc40c77e0 0x7ffbc40ca630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.405+0000 7ffbc9d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc406dd20 con 0x7ffbc4156af0 2023-10-09T06:42:47.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.405+0000 7ffbc9d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc406e000 con 0x7ffbc40c77e0 2023-10-09T06:42:47.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.405+0000 7ffbc9d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc406e2e0 con 0x7ffbc4155720 2023-10-09T06:42:47.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.406+0000 7ffbc8d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc4155720 0x7ffbc406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.407+0000 7ffbc8d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc4155720 0x7ffbc406f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:49304/0 (socket says 172.21.15.71:49304) 2023-10-09T06:42:47.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.407+0000 7ffbc8d9b700 1 -- 172.21.15.71:0/1774095920 learned_addr learned my addr 172.21.15.71:0/1774095920 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:47.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.407+0000 7ffbc959c700 1 --2- 172.21.15.71:0/1774095920 >> v2:172.21.15.179:3300/0 conn(0x7ffbc40c77e0 0x7ffbc40ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.408+0000 7ffbc37fe700 1 -- 172.21.15.71:0/1774095920 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537356243 0 0) 0x7ffbc406dd20 con 0x7ffbc4156af0 2023-10-09T06:42:47.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.408+0000 7ffbc959c700 1 -- 172.21.15.71:0/1774095920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc4155720 msgr2=0x7ffbc406f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:47.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.408+0000 7ffbc959c700 1 --2- 172.21.15.71:0/1774095920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc4155720 0x7ffbc406f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.408+0000 7ffbc959c700 1 -- 172.21.15.71:0/1774095920 >> v1:172.21.15.179:6789/0 conn(0x7ffbc4156af0 legacy=0x7ffbc40c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.408+0000 7ffbc959c700 1 -- 172.21.15.71:0/1774095920 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc406e5c0 con 0x7ffbc40c77e0 2023-10-09T06:42:47.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.410+0000 7ffbc959c700 1 --2- 172.21.15.71:0/1774095920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc40c77e0 0x7ffbc40ca630 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40098e0 tx=0x7ffbb40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6c8b12a08af836a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.410+0000 7ffbc37fe700 1 -- 172.21.15.71:0/1774095920 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb400b640 con 0x7ffbc40c77e0 2023-10-09T06:42:47.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.411+0000 7ffbc37fe700 1 -- 172.21.15.71:0/1774095920 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb400b7a0 con 0x7ffbc40c77e0 2023-10-09T06:42:47.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.412+0000 7ffbc37fe700 1 -- 172.21.15.71:0/1774095920 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb400bb40 con 0x7ffbc40c77e0 2023-10-09T06:42:47.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.412+0000 7ffbc9d9d700 1 -- 172.21.15.71:0/1774095920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc40c77e0 msgr2=0x7ffbc40ca630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.412+0000 7ffbc9d9d700 1 --2- 172.21.15.71:0/1774095920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc40c77e0 0x7ffbc40ca630 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40098e0 tx=0x7ffbb40091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.412+0000 7ffbc9d9d700 1 -- 172.21.15.71:0/1774095920 shutdown_connections 2023-10-09T06:42:47.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.412+0000 7ffbc9d9d700 1 --2- 172.21.15.71:0/1774095920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc40c77e0 0x7ffbc40ca630 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.412+0000 7ffbc9d9d700 1 --2- 172.21.15.71:0/1774095920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc4155720 0x7ffbc406f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.412+0000 7ffbc9d9d700 1 -- 172.21.15.71:0/1774095920 >> 172.21.15.71:0/1774095920 conn(0x7ffbc40cc1f0 msgr2=0x7ffbc40cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:47.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.412+0000 7ffbc9d9d700 1 -- 172.21.15.71:0/1774095920 shutdown_connections 2023-10-09T06:42:47.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.414+0000 7ffbc9d9d700 1 -- 172.21.15.71:0/1774095920 wait complete. 2023-10-09T06:42:47.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.416+0000 7fd3d759d700 1 Processor -- start 2023-10-09T06:42:47.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.416+0000 7ffbc9d9d700 1 Processor -- start 2023-10-09T06:42:47.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.417+0000 7fd3d759d700 1 -- start start 2023-10-09T06:42:47.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.418+0000 7fe9df59e700 1 Processor -- start 2023-10-09T06:42:47.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.417+0000 7ffbc9d9d700 1 -- start start 2023-10-09T06:42:47.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.419+0000 7ffbc9d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc40c77e0 0x7ffbc414a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.419+0000 7ffbc9d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc4155720 0x7ffbc40c3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.419+0000 7fd3d759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3d0156d70 0x7fd3d0153800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.419+0000 7fd3d759d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd3d006f500 0x7fd3d0152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.419+0000 7fd3d759d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d0157df0 con 0x7fd3d00b1970 2023-10-09T06:42:47.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.419+0000 7fd3d759d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d01571e0 con 0x7fd3d006f500 2023-10-09T06:42:47.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.419+0000 7fd3d759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d01574c0 con 0x7fd3d0156d70 2023-10-09T06:42:47.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.420+0000 7ffbc9d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc4156af0 0x7ffbc40c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.420+0000 7ffbc9d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc40c5360 con 0x7ffbc4155720 2023-10-09T06:42:47.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.420+0000 7ffbc3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc4155720 0x7ffbc40c3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.420+0000 7ffbc9d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc414ad30 con 0x7ffbc40c77e0 2023-10-09T06:42:47.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.420+0000 7ffbc3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc4155720 0x7ffbc40c3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52186/0 (socket says 172.21.15.71:52186) 2023-10-09T06:42:47.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.420+0000 7ffbc3fff700 1 -- 172.21.15.71:0/3445206005 learned_addr learned my addr 172.21.15.71:0/3445206005 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:47.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.420+0000 7ffbc959c700 1 --2- 172.21.15.71:0/3445206005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc4156af0 0x7ffbc40c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.420+0000 7ffbc9d9d700 1 -- 172.21.15.71:0/3445206005 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc40c44a0 con 0x7ffbc4156af0 2023-10-09T06:42:47.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.420+0000 7fd3d5d9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd3d006f500 0x7fd3d0152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.420+0000 7fd3d5d9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd3d006f500 0x7fd3d0152ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:49384/0 (socket says 172.21.15.71:49384) 2023-10-09T06:42:47.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.420+0000 7fd3d5d9a700 1 -- 172.21.15.71:0/987292239 learned_addr learned my addr 172.21.15.71:0/987292239 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:47.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.419+0000 7fe9df59e700 1 -- start start 2023-10-09T06:42:47.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.420+0000 7fe9df59e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe9d80552a0 0x7fe9d8006a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.421+0000 7fe9df59e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d8007c60 con 0x7fe9d8039380 2023-10-09T06:42:47.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.421+0000 7fd3d659b700 1 --2- 172.21.15.71:0/987292239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3d0156d70 0x7fd3d0153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.421+0000 7fe9df59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d80070e0 con 0x7fe9d8038fb0 2023-10-09T06:42:47.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.421+0000 7fd3d5d9a700 1 -- 172.21.15.71:0/987292239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3d0156d70 msgr2=0x7fd3d0153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:47.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.421+0000 7fd3d5d9a700 1 --2- 172.21.15.71:0/987292239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3d0156d70 0x7fd3d0153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.421+0000 7fd3d5d9a700 1 -- 172.21.15.71:0/987292239 >> v1:172.21.15.179:6789/0 conn(0x7fd3d00b1970 legacy=0x7fd3d0159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:47.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.421+0000 7fd3d5d9a700 1 -- 172.21.15.71:0/987292239 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d01577a0 con 0x7fd3d006f500 2023-10-09T06:42:47.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.421+0000 7fe9df59e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d80073c0 con 0x7fe9d80552a0 2023-10-09T06:42:47.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.421+0000 7fd3d5d9a700 1 --2- 172.21.15.71:0/987292239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3d006f500 0x7fd3d0152ee0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0009f20 tx=0x7fd3c0009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53650296cb8760ca server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.422+0000 7fd3d5599700 1 -- 172.21.15.71:0/987292239 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c000e070 con 0x7fd3d006f500 2023-10-09T06:42:47.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.422+0000 7fd3d5599700 1 -- 172.21.15.71:0/987292239 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c000bad0 con 0x7fd3d006f500 2023-10-09T06:42:47.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.421+0000 7fe9de59c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fe9d8038fb0 0x7fe9d80e1dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:47322/0 (socket says 172.21.15.71:47322) 2023-10-09T06:42:47.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.421+0000 7fe9de59c700 1 -- 172.21.15.71:0/1967170408 learned_addr learned my addr 172.21.15.71:0/1967170408 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.423+0000 7fd3d759d700 1 -- 172.21.15.71:0/987292239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3d006f500 msgr2=0x7fd3d0152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.423+0000 7fd3d759d700 1 --2- 172.21.15.71:0/987292239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3d006f500 0x7fd3d0152ee0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0009f20 tx=0x7fd3c0009840 comp rx=0 tx=0).stop 2023-10-09T06:42:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.423+0000 7fd3d759d700 1 -- 172.21.15.71:0/987292239 shutdown_connections 2023-10-09T06:42:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.423+0000 7fd3d759d700 1 --2- 172.21.15.71:0/987292239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3d0156d70 0x7fd3d0153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.423+0000 7fd3d759d700 1 --2- 172.21.15.71:0/987292239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3d006f500 0x7fd3d0152ee0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.423+0000 7fd3d759d700 1 -- 172.21.15.71:0/987292239 >> 172.21.15.71:0/987292239 conn(0x7fd3d00ccc80 msgr2=0x7fd3d0068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.423+0000 7ffbc8d9b700 1 --2- 172.21.15.71:0/3445206005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc40c77e0 0x7ffbc414a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.422+0000 7fe9ded9d700 1 --2- 172.21.15.71:0/1967170408 >> v2:172.21.15.71:3300/0 conn(0x7fe9d80552a0 0x7fe9d8006a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.424+0000 7ffbc3fff700 1 -- 172.21.15.71:0/3445206005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc4156af0 msgr2=0x7ffbc40c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.424+0000 7ffbc3fff700 1 --2- 172.21.15.71:0/3445206005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc4156af0 0x7ffbc40c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.424+0000 7ffbc3fff700 1 -- 172.21.15.71:0/3445206005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc40c77e0 msgr2=0x7ffbc414a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.424+0000 7ffbc3fff700 1 --2- 172.21.15.71:0/3445206005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc40c77e0 0x7ffbc414a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.424+0000 7ffbc3fff700 1 -- 172.21.15.71:0/3445206005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb4009420 con 0x7ffbc4155720 2023-10-09T06:42:47.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.422+0000 7fe9ded9d700 1 -- 172.21.15.71:0/1967170408 >> v1:172.21.15.179:6789/0 conn(0x7fe9d8038fb0 legacy=0x7fe9d80e1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.422+0000 7fe9ded9d700 1 -- 172.21.15.71:0/1967170408 >> v1:172.21.15.71:6789/0 conn(0x7fe9d8039380 legacy=0x7fe9d8006370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.423+0000 7fe9ded9d700 1 -- 172.21.15.71:0/1967170408 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d80076a0 con 0x7fe9d80552a0 2023-10-09T06:42:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.424+0000 7ffbc3fff700 1 --2- 172.21.15.71:0/3445206005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc4155720 0x7ffbc40c3a20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800c5b0 tx=0x7ffbb8007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.423+0000 7fe9ded9d700 1 --2- 172.21.15.71:0/1967170408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9d80552a0 0x7fe9d8006a80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0071b60 tx=0x7fe9e0066260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93dfb0b8364e326 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.424+0000 7fe9dd59a700 1 -- 172.21.15.71:0/1967170408 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0067610 con 0x7fe9d80552a0 2023-10-09T06:42:47.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.424+0000 7fe9dd59a700 1 -- 172.21.15.71:0/1967170408 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e0067770 con 0x7fe9d80552a0 2023-10-09T06:42:47.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.424+0000 7fe9dd59a700 1 -- 172.21.15.71:0/1967170408 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e00647a0 con 0x7fe9d80552a0 2023-10-09T06:42:47.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.425+0000 7fd3d759d700 1 -- 172.21.15.71:0/987292239 shutdown_connections 2023-10-09T06:42:47.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.426+0000 7fe9df59e700 1 -- 172.21.15.71:0/1967170408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9d80552a0 msgr2=0x7fe9d8006a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.425+0000 7fd3d759d700 1 -- 172.21.15.71:0/987292239 wait complete. 2023-10-09T06:42:47.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.426+0000 7ffbc0ff9700 1 -- 172.21.15.71:0/3445206005 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8011590 con 0x7ffbc4155720 2023-10-09T06:42:47.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.426+0000 7ffbc9d9d700 1 -- 172.21.15.71:0/3445206005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc40c4750 con 0x7ffbc4155720 2023-10-09T06:42:47.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.426+0000 7fe9df59e700 1 --2- 172.21.15.71:0/1967170408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9d80552a0 0x7fe9d8006a80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0071b60 tx=0x7fe9e0066260 comp rx=0 tx=0).stop 2023-10-09T06:42:47.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.426+0000 7ffbc9d9d700 1 -- 172.21.15.71:0/3445206005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc40c4d10 con 0x7ffbc4155720 2023-10-09T06:42:47.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.426+0000 7fe9df59e700 1 -- 172.21.15.71:0/1967170408 shutdown_connections 2023-10-09T06:42:47.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.426+0000 7fe9df59e700 1 --2- 172.21.15.71:0/1967170408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9d80552a0 0x7fe9d8006a80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.426+0000 7fe9df59e700 1 -- 172.21.15.71:0/1967170408 >> 172.21.15.71:0/1967170408 conn(0x7fe9d800f1c0 msgr2=0x7fe9d8059180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.428+0000 7ffbc0ff9700 1 -- 172.21.15.71:0/3445206005 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb80116f0 con 0x7ffbc4155720 2023-10-09T06:42:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.428+0000 7fd3d759d700 1 Processor -- start 2023-10-09T06:42:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.429+0000 7ffbc0ff9700 1 -- 172.21.15.71:0/3445206005 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8011a90 con 0x7ffbc4155720 2023-10-09T06:42:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.429+0000 7fd3d759d700 1 -- start start 2023-10-09T06:42:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.430+0000 7fe9df59e700 1 -- 172.21.15.71:0/1967170408 shutdown_connections 2023-10-09T06:42:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.430+0000 7fd3d759d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3d006f500 0x7fd3d014cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.430+0000 7fd3d759d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3d00b1970 0x7fd3d0177430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.430+0000 7fd3d759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3d0156d70 0x7fd3d0155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.430+0000 7fd3d759d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d017a3a0 con 0x7fd3d006f500 2023-10-09T06:42:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.430+0000 7fd3d759d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d014da60 con 0x7fd3d00b1970 2023-10-09T06:42:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.430+0000 7fd3d759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d017a5f0 con 0x7fd3d0156d70 2023-10-09T06:42:47.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.431+0000 7ffbc0ff9700 1 -- 172.21.15.71:0/3445206005 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffbb8012420 con 0x7ffbc4155720 2023-10-09T06:42:47.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.431+0000 7ffbaa7fc700 1 -- 172.21.15.71:0/3445206005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba40052b0 con 0x7ffbc4155720 2023-10-09T06:42:47.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.432+0000 7fd3d6d9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3d0156d70 0x7fd3d0155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.432+0000 7fd3d6d9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3d0156d70 0x7fd3d0155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:49342/0 (socket says 172.21.15.71:49342) 2023-10-09T06:42:47.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.432+0000 7fd3d6d9c700 1 -- 172.21.15.71:0/3280026927 learned_addr learned my addr 172.21.15.71:0/3280026927 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:47.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.432+0000 7fd3d5d9a700 1 --2- 172.21.15.71:0/3280026927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3d00b1970 0x7fd3d0177430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.430+0000 7fe9df59e700 1 -- 172.21.15.71:0/1967170408 wait complete. 2023-10-09T06:42:47.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.433+0000 7ffbc0ff9700 1 --2- 172.21.15.71:0/3445206005 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffbb0067000 0x7ffbb00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.433+0000 7ffbc0ff9700 1 -- 172.21.15.71:0/3445206005 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffbb8083720 con 0x7ffbc4155720 2023-10-09T06:42:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.434+0000 7fd3d5d9a700 1 -- 172.21.15.71:0/3280026927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3d0156d70 msgr2=0x7fd3d0155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.434+0000 7fd3d5d9a700 1 --2- 172.21.15.71:0/3280026927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3d0156d70 0x7fd3d0155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.434+0000 7fd3d5d9a700 1 -- 172.21.15.71:0/3280026927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3d006f500 msgr2=0x7fd3d014cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.434+0000 7fd3d5d9a700 1 --2- 172.21.15.71:0/3280026927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3d006f500 0x7fd3d014cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.434+0000 7fd3d5d9a700 1 -- 172.21.15.71:0/3280026927 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c0009ae0 con 0x7fd3d00b1970 2023-10-09T06:42:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.435+0000 7fd3d5d9a700 1 --2- 172.21.15.71:0/3280026927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3d00b1970 0x7fd3d0177430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0014000 tx=0x7fd3c0017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.432+0000 7fe9df59e700 1 Processor -- start 2023-10-09T06:42:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.436+0000 7fd3ce7fc700 1 -- 172.21.15.71:0/3280026927 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0012a80 con 0x7fd3d00b1970 2023-10-09T06:42:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.436+0000 7fd3d759d700 1 -- 172.21.15.71:0/3280026927 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d017a8d0 con 0x7fd3d00b1970 2023-10-09T06:42:47.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.436+0000 7fd3d759d700 1 -- 172.21.15.71:0/3280026927 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d014d4e0 con 0x7fd3d00b1970 2023-10-09T06:42:47.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.437+0000 7fd3ce7fc700 1 -- 172.21.15.71:0/3280026927 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c0012c40 con 0x7fd3d00b1970 2023-10-09T06:42:47.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.438+0000 7fd3ce7fc700 1 -- 172.21.15.71:0/3280026927 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c001d420 con 0x7fd3d00b1970 2023-10-09T06:42:47.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.441+0000 7fd3ce7fc700 1 -- 172.21.15.71:0/3280026927 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd3c001d850 con 0x7fd3d00b1970 2023-10-09T06:42:47.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.442+0000 7ffbc0ff9700 1 -- 172.21.15.71:0/3445206005 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffbb804b5a0 con 0x7ffbc4155720 2023-10-09T06:42:47.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.442+0000 7fd3d759d700 1 -- 172.21.15.71:0/3280026927 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b00052b0 con 0x7fd3d00b1970 2023-10-09T06:42:47.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.432+0000 7fe9df59e700 1 -- start start 2023-10-09T06:42:47.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.437+0000 7fe9df59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9d8038fb0 0x7fe9d80dd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.437+0000 7fe9df59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9d8039380 0x7fe9d80e6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.438+0000 7fe9de59c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9d8038fb0 0x7fe9d80dd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.438+0000 7fe9de59c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9d8038fb0 0x7fe9d80dd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:49416/0 (socket says 172.21.15.71:49416) 2023-10-09T06:42:47.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.438+0000 7fe9ddd9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9d8039380 0x7fe9d80e6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.438+0000 7fe9ddd9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9d8039380 0x7fe9d80e6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52226/0 (socket says 172.21.15.71:52226) 2023-10-09T06:42:47.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.438+0000 7fe9de59c700 1 -- 172.21.15.71:0/1321336257 learned_addr learned my addr 172.21.15.71:0/1321336257 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.438+0000 7fe9df59e700 1 --2- 172.21.15.71:0/1321336257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9d80552a0 0x7fe9d80e68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.439+0000 7fe9df59e700 1 -- 172.21.15.71:0/1321336257 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d80f74c0 con 0x7fe9d8039380 2023-10-09T06:42:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.439+0000 7fe9df59e700 1 -- 172.21.15.71:0/1321336257 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d804eda0 con 0x7fe9d8038fb0 2023-10-09T06:42:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.439+0000 7fe9df59e700 1 -- 172.21.15.71:0/1321336257 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d804f080 con 0x7fe9d80552a0 2023-10-09T06:42:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.442+0000 7ffbc8d9b700 1 --2- 172.21.15.71:0/3445206005 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffbb0067000 0x7ffbb00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.443+0000 7fd3ce7fc700 1 --2- 172.21.15.71:0/3280026927 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd3bc066f80 0x7fd3bc069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.443+0000 7fe9ddd9b700 1 -- 172.21.15.71:0/1321336257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9d80552a0 msgr2=0x7fe9d80e68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.443+0000 7fe9ddd9b700 1 --2- 172.21.15.71:0/1321336257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9d80552a0 0x7fe9d80e68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.443+0000 7fe9ddd9b700 1 -- 172.21.15.71:0/1321336257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9d8038fb0 msgr2=0x7fe9d80dd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.443+0000 7fe9ddd9b700 1 --2- 172.21.15.71:0/1321336257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9d8038fb0 0x7fe9d80dd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.444+0000 7fd3d659b700 1 --2- 172.21.15.71:0/3280026927 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd3bc066f80 0x7fd3bc069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.444+0000 7fe9ddd9b700 1 -- 172.21.15.71:0/1321336257 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e004c0e0 con 0x7fe9d8039380 2023-10-09T06:42:47.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.444+0000 7fe9ddd9b700 1 --2- 172.21.15.71:0/1321336257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9d8039380 0x7fe9d80e6360 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4001050 tx=0x7fe9d4007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.444+0000 7ffbc8d9b700 1 --2- 172.21.15.71:0/3445206005 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffbb0067000 0x7ffbb00694b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc007260 tx=0x7ffbbc007690 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.445+0000 7fd3d659b700 1 --2- 172.21.15.71:0/3280026927 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd3bc066f80 0x7fd3bc069430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4009a40 tx=0x7fd3c4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.445+0000 7fd3ce7fc700 1 -- 172.21.15.71:0/3280026927 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd3c0085ec0 con 0x7fd3d00b1970 2023-10-09T06:42:47.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.445+0000 7fe9ce7fc700 1 -- 172.21.15.71:0/1321336257 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4011590 con 0x7fe9d8039380 2023-10-09T06:42:47.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.445+0000 7fe9ce7fc700 1 -- 172.21.15.71:0/1321336257 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d4011710 con 0x7fe9d8039380 2023-10-09T06:42:47.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.445+0000 7fe9ce7fc700 1 -- 172.21.15.71:0/1321336257 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4011ad0 con 0x7fe9d8039380 2023-10-09T06:42:47.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.445+0000 7fe9df59e700 1 -- 172.21.15.71:0/1321336257 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d804f360 con 0x7fe9d8039380 2023-10-09T06:42:47.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.446+0000 7fe9df59e700 1 -- 172.21.15.71:0/1321336257 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d804ea90 con 0x7fe9d8039380 2023-10-09T06:42:47.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.448+0000 7fe9df59e700 1 -- 172.21.15.71:0/1321336257 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d804f880 con 0x7fe9d8039380 2023-10-09T06:42:47.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.449+0000 7fe9ce7fc700 1 -- 172.21.15.71:0/1321336257 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe9d401b3b0 con 0x7fe9d8039380 2023-10-09T06:42:47.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.451+0000 7fe9ce7fc700 1 --2- 172.21.15.71:0/1321336257 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe9c0067030 0x7fe9c00694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.452+0000 7fd3ce7fc700 1 -- 172.21.15.71:0/3280026927 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3c0053110 con 0x7fd3d00b1970 2023-10-09T06:42:47.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.458+0000 7fe9de59c700 1 --2- 172.21.15.71:0/1321336257 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe9c0067030 0x7fe9c00694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.459+0000 7fe9ce7fc700 1 -- 172.21.15.71:0/1321336257 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe9d4054de0 con 0x7fe9d8039380 2023-10-09T06:42:47.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.459+0000 7fe9de59c700 1 --2- 172.21.15.71:0/1321336257 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe9c0067030 0x7fe9c00694e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0007fd0 tx=0x7fe9d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.459+0000 7fe9ce7fc700 1 -- 172.21.15.71:0/1321336257 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9d804f880 con 0x7fe9d8039380 2023-10-09T06:42:47.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.490+0000 7f09c279d700 1 Processor -- start 2023-10-09T06:42:47.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.490+0000 7f09c279d700 1 -- start start 2023-10-09T06:42:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.492+0000 7f09c279d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f09bc0ca290 0x7f09bc0c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.492+0000 7f09c279d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09bc0c73e0 con 0x7f09bc147550 2023-10-09T06:42:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.492+0000 7f09c279d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09bc069f10 con 0x7f09bc0c6f80 2023-10-09T06:42:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.492+0000 7f09c279d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09bc06a1f0 con 0x7f09bc0ca290 2023-10-09T06:42:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.493+0000 7f09c179b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f09bc147550 0x7f09bc0696c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58258/0 (socket says 172.21.15.71:58258) 2023-10-09T06:42:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.493+0000 7f09c179b700 1 -- 172.21.15.71:0/2621418605 learned_addr learned my addr 172.21.15.71:0/2621418605 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.493+0000 7f09c0f9a700 1 --2- 172.21.15.71:0/2621418605 >> v2:172.21.15.179:3300/0 conn(0x7f09bc0ca290 0x7f09bc0c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.494+0000 7f09b3fff700 1 -- 172.21.15.71:0/2621418605 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432738837 0 0) 0x7f09b4001490 con 0x7f09bc147550 2023-10-09T06:42:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.494+0000 7f09b3fff700 1 -- 172.21.15.71:0/2621418605 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09a8003570 con 0x7f09bc147550 2023-10-09T06:42:47.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.494+0000 7f09c0f9a700 1 -- 172.21.15.71:0/2621418605 >> v1:172.21.15.179:6789/0 conn(0x7f09bc0c6f80 legacy=0x7f09bc167800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-09T06:42:47.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.494+0000 7f09c0f9a700 1 -- 172.21.15.71:0/2621418605 >> v1:172.21.15.71:6789/0 conn(0x7f09bc147550 legacy=0x7f09bc0696c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.494+0000 7f09c0f9a700 1 -- 172.21.15.71:0/2621418605 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09bc06a4d0 con 0x7f09bc0ca290 2023-10-09T06:42:47.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.495+0000 7f09c0f9a700 1 --2- 172.21.15.71:0/2621418605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09bc0ca290 0x7f09bc0c6a40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f09b80098e0 tx=0x7f09b80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3d239c16e552a04 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.496+0000 7f09b3fff700 1 -- 172.21.15.71:0/2621418605 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b8011630 con 0x7f09bc0ca290 2023-10-09T06:42:47.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.496+0000 7f09b3fff700 1 -- 172.21.15.71:0/2621418605 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b8011790 con 0x7f09bc0ca290 2023-10-09T06:42:47.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.497+0000 7f09c279d700 1 -- 172.21.15.71:0/2621418605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09bc0ca290 msgr2=0x7f09bc0c6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.497+0000 7f09c279d700 1 --2- 172.21.15.71:0/2621418605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09bc0ca290 0x7f09bc0c6a40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f09b80098e0 tx=0x7f09b80091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.497+0000 7f09c279d700 1 -- 172.21.15.71:0/2621418605 shutdown_connections 2023-10-09T06:42:47.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.497+0000 7f09c279d700 1 --2- 172.21.15.71:0/2621418605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09bc0ca290 0x7f09bc0c6a40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.497+0000 7f09c279d700 1 -- 172.21.15.71:0/2621418605 >> 172.21.15.71:0/2621418605 conn(0x7f09bc0cc1f0 msgr2=0x7f09bc0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:47.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.498+0000 7f09c279d700 1 -- 172.21.15.71:0/2621418605 shutdown_connections 2023-10-09T06:42:47.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.500+0000 7f09c279d700 1 -- 172.21.15.71:0/2621418605 wait complete. 2023-10-09T06:42:47.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.502+0000 7f09c279d700 1 Processor -- start 2023-10-09T06:42:47.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.502+0000 7f09c279d700 1 -- start start 2023-10-09T06:42:47.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.503+0000 7f09c279d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09bc0c6f80 0x7f09bc144160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.503+0000 7f09c279d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09bc0ca290 0x7f09bc1603d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.503+0000 7f09c279d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09bc147550 0x7f09bc06d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.504+0000 7f09c0f9a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09bc0ca290 0x7f09bc1603d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.504+0000 7f09c0f9a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09bc0ca290 0x7f09bc1603d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:49436/0 (socket says 172.21.15.71:49436) 2023-10-09T06:42:47.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.504+0000 7f09c0f9a700 1 -- 172.21.15.71:0/2946913598 learned_addr learned my addr 172.21.15.71:0/2946913598 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:47.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.504+0000 7f09c179b700 1 --2- 172.21.15.71:0/2946913598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09bc0c6f80 0x7f09bc144160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.504+0000 7f09c279d700 1 -- 172.21.15.71:0/2946913598 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc1446a0 con 0x7f09bc147550 2023-10-09T06:42:47.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.504+0000 7f09c279d700 1 -- 172.21.15.71:0/2946913598 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc1623e0 con 0x7f09bc0ca290 2023-10-09T06:42:47.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.504+0000 7f09c279d700 1 -- 172.21.15.71:0/2946913598 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc160ee0 con 0x7f09bc0c6f80 2023-10-09T06:42:47.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.504+0000 7f09c0f9a700 1 -- 172.21.15.71:0/2946913598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09bc0c6f80 msgr2=0x7f09bc144160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.504+0000 7f09c0f9a700 1 --2- 172.21.15.71:0/2946913598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09bc0c6f80 0x7f09bc144160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.504+0000 7f09c0f9a700 1 -- 172.21.15.71:0/2946913598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09bc147550 msgr2=0x7f09bc06d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.504+0000 7f09c0f9a700 1 --2- 172.21.15.71:0/2946913598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09bc147550 0x7f09bc06d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.504+0000 7f09c0f9a700 1 -- 172.21.15.71:0/2946913598 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b8009420 con 0x7f09bc0ca290 2023-10-09T06:42:47.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.504+0000 7f283659d700 1 Processor -- start 2023-10-09T06:42:47.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.504+0000 7f283659d700 1 -- start start 2023-10-09T06:42:47.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.505+0000 7f09c0f9a700 1 --2- 172.21.15.71:0/2946913598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09bc0ca290 0x7f09bc1603d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f09b80093f0 tx=0x7f09b8016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.506+0000 7f09b17fa700 1 -- 172.21.15.71:0/2946913598 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b8011630 con 0x7f09bc0ca290 2023-10-09T06:42:47.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.506+0000 7fd25679d700 1 Processor -- start 2023-10-09T06:42:47.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.506+0000 7fd25679d700 1 -- start start 2023-10-09T06:42:47.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.506+0000 7f09b17fa700 1 -- 172.21.15.71:0/2946913598 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b8020070 con 0x7f09bc0ca290 2023-10-09T06:42:47.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.507+0000 7f283659d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2830161d40 0x7f28300ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.507+0000 7f283659d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2830162410 con 0x7f28300d01e0 2023-10-09T06:42:47.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.507+0000 7f283659d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28300cf140 con 0x7f28301471f0 2023-10-09T06:42:47.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.507+0000 7f283659d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28300cf420 con 0x7f2830161d40 2023-10-09T06:42:47.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.506+0000 7f09b17fa700 1 -- 172.21.15.71:0/2946913598 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b801c8b0 con 0x7f09bc0ca290 2023-10-09T06:42:47.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.507+0000 7f2834d9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2830161d40 0x7f28300ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.507+0000 7f2834d9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2830161d40 0x7f28300ce4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:49440/0 (socket says 172.21.15.71:49440) 2023-10-09T06:42:47.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.507+0000 7f2834d9a700 1 -- 172.21.15.71:0/3446266880 learned_addr learned my addr 172.21.15.71:0/3446266880 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:47.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.508+0000 7f2834d9a700 1 -- 172.21.15.71:0/3446266880 >> v1:172.21.15.179:6789/0 conn(0x7f28301471f0 legacy=0x7f2830161630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.508+0000 7f09c279d700 1 -- 172.21.15.71:0/2946913598 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09bc162c40 con 0x7f09bc0ca290 2023-10-09T06:42:47.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.508+0000 7f09c279d700 1 -- 172.21.15.71:0/2946913598 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09bc1625f0 con 0x7f09bc0ca290 2023-10-09T06:42:47.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.508+0000 7f2834d9a700 1 -- 172.21.15.71:0/3446266880 >> v1:172.21.15.71:6789/0 conn(0x7f28300d01e0 legacy=0x7f28300b3960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T06:42:47.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.508+0000 7f2834d9a700 1 -- 172.21.15.71:0/3446266880 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28300cf700 con 0x7f2830161d40 2023-10-09T06:42:47.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.509+0000 7f2834d9a700 1 --2- 172.21.15.71:0/3446266880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2830161d40 0x7f28300ce4f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f282c0099b0 tx=0x7f282c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adda9f3220ab59f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.509+0000 7f2827fff700 1 -- 172.21.15.71:0/3446266880 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c00b820 con 0x7f2830161d40 2023-10-09T06:42:47.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.509+0000 7fd25679d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd2501471f0 0x7fd250161630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.509+0000 7fd25679d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd2500d01e0 0x7fd250161b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.509+0000 7fd25679d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd250162410 con 0x7fd2500ce4f0 2023-10-09T06:42:47.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.509+0000 7fd25679d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2500cf140 con 0x7fd2500d01e0 2023-10-09T06:42:47.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.509+0000 7fd25679d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2500cf420 con 0x7fd2501471f0 2023-10-09T06:42:47.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.509+0000 7f2827fff700 1 -- 172.21.15.71:0/3446266880 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282c00b980 con 0x7f2830161d40 2023-10-09T06:42:47.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.510+0000 7f283659d700 1 -- 172.21.15.71:0/3446266880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2830161d40 msgr2=0x7f28300ce4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.510+0000 7f283659d700 1 --2- 172.21.15.71:0/3446266880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2830161d40 0x7f28300ce4f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f282c0099b0 tx=0x7f282c009250 comp rx=0 tx=0).stop 2023-10-09T06:42:47.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.511+0000 7fd25579b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd2501471f0 0x7fd250161630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.511+0000 7f283659d700 1 -- 172.21.15.71:0/3446266880 shutdown_connections 2023-10-09T06:42:47.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.511+0000 7f283659d700 1 --2- 172.21.15.71:0/3446266880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2830161d40 0x7f28300ce4f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.511+0000 7f283659d700 1 -- 172.21.15.71:0/3446266880 >> 172.21.15.71:0/3446266880 conn(0x7f28300d0660 msgr2=0x7f28300d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:47.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.511+0000 7fd25579b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd2501471f0 0x7fd250161630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:49456/0 (socket says 172.21.15.71:49456) 2023-10-09T06:42:47.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.511+0000 7fd25579b700 1 -- 172.21.15.71:0/3538923716 learned_addr learned my addr 172.21.15.71:0/3538923716 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:47.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.511+0000 7fd254f9a700 1 --2- 172.21.15.71:0/3538923716 >> v2:172.21.15.71:3300/0 conn(0x7fd2500d01e0 0x7fd250161b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.512+0000 7fd25579b700 1 -- 172.21.15.71:0/3538923716 >> v2:172.21.15.71:3300/0 conn(0x7fd2500d01e0 msgr2=0x7fd250161b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:47.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.512+0000 7fd25579b700 1 --2- 172.21.15.71:0/3538923716 >> v2:172.21.15.71:3300/0 conn(0x7fd2500d01e0 0x7fd250161b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.512+0000 7fd25579b700 1 -- 172.21.15.71:0/3538923716 >> v1:172.21.15.179:6789/0 conn(0x7fd2500ce4f0 legacy=0x7fd2500ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.512+0000 7fd25579b700 1 -- 172.21.15.71:0/3538923716 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2500cf700 con 0x7fd2501471f0 2023-10-09T06:42:47.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.512+0000 7fd254f9a700 1 --2- 172.21.15.71:0/3538923716 >> v2:172.21.15.71:3300/0 conn(0x7fd2500d01e0 0x7fd250161b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:47.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.512+0000 7f283659d700 1 -- 172.21.15.71:0/3446266880 shutdown_connections 2023-10-09T06:42:47.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.512+0000 7f09b17fa700 1 -- 172.21.15.71:0/2946913598 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f09b801cc20 con 0x7f09bc0ca290 2023-10-09T06:42:47.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.512+0000 7f09b17fa700 1 --2- 172.21.15.71:0/2946913598 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f09a0067080 0x7f09a0069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.512+0000 7f09b17fa700 1 -- 172.21.15.71:0/2946913598 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f09b8022070 con 0x7f09bc0ca290 2023-10-09T06:42:47.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.513+0000 7fd25579b700 1 --2- 172.21.15.71:0/3538923716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2501471f0 0x7fd250161630 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd2500b66b0 tx=0x7fd248009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dae690184265a19c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.513+0000 7f09c179b700 1 --2- 172.21.15.71:0/2946913598 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f09a0067080 0x7f09a0069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.513+0000 7f283659d700 1 -- 172.21.15.71:0/3446266880 wait complete. 2023-10-09T06:42:47.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.514+0000 7f09c279d700 1 -- 172.21.15.71:0/2946913598 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09bc162dd0 con 0x7f09bc0ca290 2023-10-09T06:42:47.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.514+0000 7fd247fff700 1 -- 172.21.15.71:0/3538923716 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24800e070 con 0x7fd2501471f0 2023-10-09T06:42:47.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.514+0000 7fd247fff700 1 -- 172.21.15.71:0/3538923716 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24800b920 con 0x7fd2501471f0 2023-10-09T06:42:47.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.515+0000 7f09c179b700 1 --2- 172.21.15.71:0/2946913598 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f09a0067080 0x7f09a0069530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f09bc0c6760 tx=0x7f09b4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.515+0000 7f283659d700 1 Processor -- start 2023-10-09T06:42:47.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.515+0000 7f283659d700 1 -- start start 2023-10-09T06:42:47.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.515+0000 7fd247fff700 1 -- 172.21.15.71:0/3538923716 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2480092e0 con 0x7fd2501471f0 2023-10-09T06:42:47.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.516+0000 7fd25679d700 1 -- 172.21.15.71:0/3538923716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2501471f0 msgr2=0x7fd250161630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.516+0000 7fd25679d700 1 --2- 172.21.15.71:0/3538923716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2501471f0 0x7fd250161630 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd2500b66b0 tx=0x7fd248009840 comp rx=0 tx=0).stop 2023-10-09T06:42:47.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.516+0000 7fd25679d700 1 -- 172.21.15.71:0/3538923716 shutdown_connections 2023-10-09T06:42:47.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.516+0000 7fd25679d700 1 --2- 172.21.15.71:0/3538923716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2501471f0 0x7fd250161630 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.516+0000 7fd25679d700 1 --2- 172.21.15.71:0/3538923716 >> v2:172.21.15.71:3300/0 conn(0x7fd2500d01e0 0x7fd250161b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.516+0000 7fd25679d700 1 -- 172.21.15.71:0/3538923716 >> 172.21.15.71:0/3538923716 conn(0x7fd2500d0660 msgr2=0x7fd2500d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:47.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.516+0000 7f283659d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28300d01e0 0x7f283015cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.516+0000 7f283659d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28301471f0 0x7f283006c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.516+0000 7f283659d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2830161d40 0x7f283006c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.516+0000 7f283659d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283006d9f0 con 0x7f28300d01e0 2023-10-09T06:42:47.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.516+0000 7f283659d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283006dfb0 con 0x7f28301471f0 2023-10-09T06:42:47.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.516+0000 7f283659d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28301458c0 con 0x7f2830161d40 2023-10-09T06:42:47.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.516+0000 7fd25679d700 1 -- 172.21.15.71:0/3538923716 shutdown_connections 2023-10-09T06:42:47.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.517+0000 7fd25679d700 1 -- 172.21.15.71:0/3538923716 wait complete. 2023-10-09T06:42:47.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.517+0000 7f283559b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28300d01e0 0x7f283015cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.517+0000 7f283559b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28300d01e0 0x7f283015cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52268/0 (socket says 172.21.15.71:52268) 2023-10-09T06:42:47.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.517+0000 7f283559b700 1 -- 172.21.15.71:0/1929282299 learned_addr learned my addr 172.21.15.71:0/1929282299 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:47.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.517+0000 7f2835d9c700 1 --2- 172.21.15.71:0/1929282299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2830161d40 0x7f283006c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.517+0000 7f2834d9a700 1 --2- 172.21.15.71:0/1929282299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28301471f0 0x7f283006c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.517+0000 7f2835d9c700 1 -- 172.21.15.71:0/1929282299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28301471f0 msgr2=0x7f283006c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.517+0000 7f2835d9c700 1 --2- 172.21.15.71:0/1929282299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28301471f0 0x7f283006c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.517+0000 7f2835d9c700 1 -- 172.21.15.71:0/1929282299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28300d01e0 msgr2=0x7f283015cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.517+0000 7f2835d9c700 1 --2- 172.21.15.71:0/1929282299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28300d01e0 0x7f283015cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.517+0000 7f2835d9c700 1 -- 172.21.15.71:0/1929282299 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282c0094f0 con 0x7f2830161d40 2023-10-09T06:42:47.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.518+0000 7f2835d9c700 1 --2- 172.21.15.71:0/1929282299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2830161d40 0x7f283006c5b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f282000b4f0 tx=0x7f2820009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.518+0000 7f28257fa700 1 -- 172.21.15.71:0/1929282299 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282000f510 con 0x7f2830161d40 2023-10-09T06:42:47.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.518+0000 7f28257fa700 1 -- 172.21.15.71:0/1929282299 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282000f690 con 0x7f2830161d40 2023-10-09T06:42:47.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.518+0000 7f28257fa700 1 -- 172.21.15.71:0/1929282299 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282000fa50 con 0x7f2830161d40 2023-10-09T06:42:47.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.518+0000 7f283659d700 1 -- 172.21.15.71:0/1929282299 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f283006cc30 con 0x7f2830161d40 2023-10-09T06:42:47.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.519+0000 7f283659d700 1 -- 172.21.15.71:0/1929282299 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f283006dc40 con 0x7f2830161d40 2023-10-09T06:42:47.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.519+0000 7f09b17fa700 1 -- 172.21.15.71:0/2946913598 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09b8053930 con 0x7f09bc0ca290 2023-10-09T06:42:47.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.520+0000 7fd25679d700 1 Processor -- start 2023-10-09T06:42:47.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.520+0000 7fd25679d700 1 -- start start 2023-10-09T06:42:47.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.522+0000 7f283559b700 1 --2- 172.21.15.71:0/1929282299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28300d01e0 0x7f283015cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:47.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.523+0000 7fd25679d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2500ce4f0 0x7fd2500b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.523+0000 7f283659d700 1 -- 172.21.15.71:0/1929282299 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2830067ea0 con 0x7f2830161d40 2023-10-09T06:42:47.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.525+0000 7fd25679d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2500d01e0 0x7fd2501432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.525+0000 7fd25679d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2501471f0 0x7fd25015cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.525+0000 7fd25679d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25006bb80 con 0x7fd2500d01e0 2023-10-09T06:42:47.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.525+0000 7fd25679d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2500b4a00 con 0x7fd2500ce4f0 2023-10-09T06:42:47.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.525+0000 7fd25679d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25006b830 con 0x7fd2501471f0 2023-10-09T06:42:47.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.525+0000 7fd255f9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2501471f0 0x7fd25015cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.525+0000 7fd25579b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2500ce4f0 0x7fd2500b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.526+0000 7fd254f9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2500d01e0 0x7fd2501432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.526+0000 7fd254f9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2500d01e0 0x7fd2501432c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52280/0 (socket says 172.21.15.71:52280) 2023-10-09T06:42:47.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.526+0000 7fd254f9a700 1 -- 172.21.15.71:0/1303483249 learned_addr learned my addr 172.21.15.71:0/1303483249 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:47.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.526+0000 7fd254f9a700 1 -- 172.21.15.71:0/1303483249 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2501471f0 msgr2=0x7fd25015cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.526+0000 7fd254f9a700 1 --2- 172.21.15.71:0/1303483249 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2501471f0 0x7fd25015cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.527+0000 7fd254f9a700 1 -- 172.21.15.71:0/1303483249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2500ce4f0 msgr2=0x7fd2500b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.527+0000 7fd254f9a700 1 --2- 172.21.15.71:0/1303483249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2500ce4f0 0x7fd2500b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.527+0000 7fd254f9a700 1 -- 172.21.15.71:0/1303483249 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd248009ae0 con 0x7fd2500d01e0 2023-10-09T06:42:47.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.527+0000 7fd254f9a700 1 --2- 172.21.15.71:0/1303483249 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2500d01e0 0x7fd2501432c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd24000ea20 tx=0x7fd240008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.525+0000 7f28257fa700 1 -- 172.21.15.71:0/1929282299 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f282001a400 con 0x7f2830161d40 2023-10-09T06:42:47.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.528+0000 7f28257fa700 1 --2- 172.21.15.71:0/1929282299 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2814066fb0 0x7f2814069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.528+0000 7f28257fa700 1 -- 172.21.15.71:0/1929282299 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2820083ee0 con 0x7f2830161d40 2023-10-09T06:42:47.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.528+0000 7fd2457fa700 1 -- 172.21.15.71:0/1303483249 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24000c5e0 con 0x7fd2500d01e0 2023-10-09T06:42:47.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.528+0000 7fd25579b700 1 --2- 172.21.15.71:0/1303483249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2500ce4f0 0x7fd2500b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:47.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.528+0000 7fd25679d700 1 -- 172.21.15.71:0/1303483249 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd25006f150 con 0x7fd2500d01e0 2023-10-09T06:42:47.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.528+0000 7fd25679d700 1 -- 172.21.15.71:0/1303483249 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd250143800 con 0x7fd2500d01e0 2023-10-09T06:42:47.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.530+0000 7f283559b700 1 --2- 172.21.15.71:0/1929282299 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2814066fb0 0x7f2814069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.530+0000 7fd2457fa700 1 -- 172.21.15.71:0/1303483249 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24000c740 con 0x7fd2500d01e0 2023-10-09T06:42:47.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.531+0000 7f28257fa700 1 -- 172.21.15.71:0/1929282299 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2820051130 con 0x7f2830161d40 2023-10-09T06:42:47.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.532+0000 7fd2457fa700 1 -- 172.21.15.71:0/1303483249 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24000c5e0 con 0x7fd2500d01e0 2023-10-09T06:42:47.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.532+0000 7f283559b700 1 --2- 172.21.15.71:0/1929282299 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2814066fb0 0x7f2814069460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2828007fd0 tx=0x7f2828009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.534+0000 7fd25679d700 1 -- 172.21.15.71:0/1303483249 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd25006bd30 con 0x7fd2500d01e0 2023-10-09T06:42:47.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.536+0000 7fd2457fa700 1 -- 172.21.15.71:0/1303483249 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd24000cb80 con 0x7fd2500d01e0 2023-10-09T06:42:47.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.537+0000 7fd2457fa700 1 --2- 172.21.15.71:0/1303483249 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd234066f90 0x7fd234069440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.537+0000 7fd2457fa700 1 -- 172.21.15.71:0/1303483249 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd24000ce30 con 0x7fd2500d01e0 2023-10-09T06:42:47.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.539+0000 7fd25579b700 1 --2- 172.21.15.71:0/1303483249 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd234066f90 0x7fd234069440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.547+0000 7fd2457fa700 1 -- 172.21.15.71:0/1303483249 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd240051b90 con 0x7fd2500d01e0 2023-10-09T06:42:47.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.550+0000 7fd25579b700 1 --2- 172.21.15.71:0/1303483249 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd234066f90 0x7fd234069440 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd248009ab0 tx=0x7fd248017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.559+0000 7f77e93ff700 1 Processor -- start 2023-10-09T06:42:47.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.559+0000 7f77e93ff700 1 -- start start 2023-10-09T06:42:47.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.561+0000 7f77e93ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f77e415dc70 0x7f77e40b2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.561+0000 7f77e93ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e40cebb0 con 0x7f77e40cb540 2023-10-09T06:42:47.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.561+0000 7f77e93ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e40b2f10 con 0x7f77e4069f90 2023-10-09T06:42:47.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.561+0000 7f77e93ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e40b31f0 con 0x7f77e415dc70 2023-10-09T06:42:47.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.562+0000 7f77e37fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f77e40cb540 0x7f77e40cf040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58276/0 (socket says 172.21.15.71:58276) 2023-10-09T06:42:47.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.562+0000 7f77e37fe700 1 -- 172.21.15.71:0/3881657205 learned_addr learned my addr 172.21.15.71:0/3881657205 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:47.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.564+0000 7f77e1ffb700 1 -- 172.21.15.71:0/3881657205 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 66769290 0 0) 0x7f77e40cebb0 con 0x7f77e40cb540 2023-10-09T06:42:47.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.564+0000 7f77e1ffb700 1 -- 172.21.15.71:0/3881657205 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77cc003570 con 0x7f77e40cb540 2023-10-09T06:42:47.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.564+0000 7f77e2ffd700 1 --2- 172.21.15.71:0/3881657205 >> v2:172.21.15.179:3300/0 conn(0x7f77e415dc70 0x7f77e40b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.564+0000 7f77e1ffb700 1 -- 172.21.15.71:0/3881657205 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4149439836 0 0) 0x7f77cc003570 con 0x7f77e40cb540 2023-10-09T06:42:47.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.564+0000 7f77e1ffb700 1 -- 172.21.15.71:0/3881657205 >> v2:172.21.15.179:3300/0 conn(0x7f77e415dc70 msgr2=0x7f77e40b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:47.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.564+0000 7f77e1ffb700 1 --2- 172.21.15.71:0/3881657205 >> v2:172.21.15.179:3300/0 conn(0x7f77e415dc70 0x7f77e40b2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.564+0000 7f77e1ffb700 1 -- 172.21.15.71:0/3881657205 >> v1:172.21.15.179:6789/0 conn(0x7f77e4069f90 legacy=0x7f77e40cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.564+0000 7f77e1ffb700 1 -- 172.21.15.71:0/3881657205 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e40ce560 con 0x7f77e40cb540 2023-10-09T06:42:47.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.565+0000 7f77e1ffb700 1 -- 172.21.15.71:0/3881657205 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f77dc0017f0 con 0x7f77e40cb540 2023-10-09T06:42:47.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.565+0000 7f77e1ffb700 1 -- 172.21.15.71:0/3881657205 >> v1:172.21.15.71:6789/0 conn(0x7f77e40cb540 legacy=0x7f77e40cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.565+0000 7f77e1ffb700 1 --2- 172.21.15.71:0/3881657205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77cc003ab0 0x7f77cc003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.565+0000 7f77e1ffb700 1 --2- 172.21.15.71:0/3881657205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77cc004810 0x7f77cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.565+0000 7f77e1ffb700 1 --2- 172.21.15.71:0/3881657205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77cc0053c0 0x7f77cc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.565+0000 7f77e1ffb700 1 -- 172.21.15.71:0/3881657205 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e40b31f0 con 0x7f77cc0053c0 2023-10-09T06:42:47.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.565+0000 7f77e1ffb700 1 -- 172.21.15.71:0/3881657205 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc00c2a0 con 0x7f77cc004810 2023-10-09T06:42:47.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.565+0000 7f77e1ffb700 1 -- 172.21.15.71:0/3881657205 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc00c460 con 0x7f77cc003ab0 2023-10-09T06:42:47.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.566+0000 7f77e37fe700 1 --2- 172.21.15.71:0/3881657205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77cc0053c0 0x7f77cc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.567+0000 7f77e37fe700 1 -- 172.21.15.71:0/3881657205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77cc003ab0 msgr2=0x7f77cc003ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T06:42:47.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.567+0000 7f77e37fe700 1 --2- 172.21.15.71:0/3881657205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77cc003ab0 0x7f77cc003ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.567+0000 7f77e37fe700 1 -- 172.21.15.71:0/3881657205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77cc004810 msgr2=0x7f77cc004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T06:42:47.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.567+0000 7f77e37fe700 1 --2- 172.21.15.71:0/3881657205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77cc004810 0x7f77cc004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.567+0000 7f77e37fe700 1 -- 172.21.15.71:0/3881657205 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77cc003570 con 0x7f77cc0053c0 2023-10-09T06:42:47.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.567+0000 7f77e37fe700 1 -- 172.21.15.71:0/3881657205 reap_dead start 2023-10-09T06:42:47.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.568+0000 7f77e2ffd700 1 --2- 172.21.15.71:0/3881657205 >> v2:172.21.15.179:3300/0 conn(0x7f77e415dc70 0x7f77e40b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:47.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.568+0000 7f77e37fe700 1 --2- 172.21.15.71:0/3881657205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77cc0053c0 0x7f77cc00ba60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f77e40cb940 tx=0x7f77dc002140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dfac70e7e5b5cb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.569+0000 7f77e1ffb700 1 -- 172.21.15.71:0/3881657205 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc0070f0 con 0x7f77cc0053c0 2023-10-09T06:42:47.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.569+0000 7f77e1ffb700 1 -- 172.21.15.71:0/3881657205 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77dc007250 con 0x7f77cc0053c0 2023-10-09T06:42:47.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.569+0000 7f77e1ffb700 1 -- 172.21.15.71:0/3881657205 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc007610 con 0x7f77cc0053c0 2023-10-09T06:42:47.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.570+0000 7f77e93ff700 1 -- 172.21.15.71:0/3881657205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77cc0053c0 msgr2=0x7f77cc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.570+0000 7f77e93ff700 1 --2- 172.21.15.71:0/3881657205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77cc0053c0 0x7f77cc00ba60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f77e40cb940 tx=0x7f77dc002140 comp rx=0 tx=0).stop 2023-10-09T06:42:47.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.571+0000 7f77e93ff700 1 -- 172.21.15.71:0/3881657205 shutdown_connections 2023-10-09T06:42:47.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.571+0000 7f77e93ff700 1 --2- 172.21.15.71:0/3881657205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77cc0053c0 0x7f77cc00ba60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.571+0000 7f77e93ff700 1 -- 172.21.15.71:0/3881657205 >> 172.21.15.71:0/3881657205 conn(0x7f77e4068e20 msgr2=0x7f77e40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:47.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.572+0000 7f77e93ff700 1 -- 172.21.15.71:0/3881657205 shutdown_connections 2023-10-09T06:42:47.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.572+0000 7f77e93ff700 1 -- 172.21.15.71:0/3881657205 wait complete. 2023-10-09T06:42:47.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.574+0000 7f77e93ff700 1 Processor -- start 2023-10-09T06:42:47.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.575+0000 7f77e93ff700 1 -- start start 2023-10-09T06:42:47.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.576+0000 7f77e93ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77cc0053c0 0x7f77e415fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.576+0000 7f77e93ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77e415e040 0x7f77e415e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.577+0000 7f77e93ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77e4135cd0 0x7f77e4136170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.577+0000 7f77e2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77cc0053c0 0x7f77e415fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.577+0000 7f77e2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77cc0053c0 0x7f77e415fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52298/0 (socket says 172.21.15.71:52298) 2023-10-09T06:42:47.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.577+0000 7f77e93ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e41366b0 con 0x7f77cc0053c0 2023-10-09T06:42:47.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.577+0000 7f77e93ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e415f7c0 con 0x7f77e4135cd0 2023-10-09T06:42:47.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.577+0000 7f77e93ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e415ebb0 con 0x7f77e415e040 2023-10-09T06:42:47.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.577+0000 7f77e27fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77e415e040 0x7f77e415e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.577+0000 7f77e27fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77e415e040 0x7f77e415e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:49370/0 (socket says 172.21.15.71:49370) 2023-10-09T06:42:47.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.577+0000 7f77e27fc700 1 -- 172.21.15.71:0/1552713567 learned_addr learned my addr 172.21.15.71:0/1552713567 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:47.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.577+0000 7f77e37fe700 1 --2- 172.21.15.71:0/1552713567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77e4135cd0 0x7f77e4136170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.578+0000 7f77e27fc700 1 -- 172.21.15.71:0/1552713567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77e4135cd0 msgr2=0x7f77e4136170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.578+0000 7f77e27fc700 1 --2- 172.21.15.71:0/1552713567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77e4135cd0 0x7f77e4136170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.578+0000 7f77e27fc700 1 -- 172.21.15.71:0/1552713567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77cc0053c0 msgr2=0x7f77e415fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.578+0000 7f77e27fc700 1 --2- 172.21.15.71:0/1552713567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77cc0053c0 0x7f77e415fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.578+0000 7f77e27fc700 1 -- 172.21.15.71:0/1552713567 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e415ee90 con 0x7f77e415e040 2023-10-09T06:42:47.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.578+0000 7f77e27fc700 1 --2- 172.21.15.71:0/1552713567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77e415e040 0x7f77e415e4b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f77d400c5f0 tx=0x7f77d4007ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.579+0000 7f77caffd700 1 -- 172.21.15.71:0/1552713567 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d4011590 con 0x7f77e415e040 2023-10-09T06:42:47.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.579+0000 7f77e93ff700 1 -- 172.21.15.71:0/1552713567 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e415f170 con 0x7f77e415e040 2023-10-09T06:42:47.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.579+0000 7f77e93ff700 1 -- 172.21.15.71:0/1552713567 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e40c9db0 con 0x7f77e415e040 2023-10-09T06:42:47.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.581+0000 7f77e2ffd700 1 --2- 172.21.15.71:0/1552713567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77cc0053c0 0x7f77e415fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-10-09T06:42:47.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.581+0000 7f77caffd700 1 -- 172.21.15.71:0/1552713567 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d4011710 con 0x7f77e415e040 2023-10-09T06:42:47.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.582+0000 7f77caffd700 1 -- 172.21.15.71:0/1552713567 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d4011ad0 con 0x7f77e415e040 2023-10-09T06:42:47.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.583+0000 7f77e93ff700 1 -- 172.21.15.71:0/1552713567 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c40052b0 con 0x7f77e415e040 2023-10-09T06:42:47.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.587+0000 7f77caffd700 1 -- 172.21.15.71:0/1552713567 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77d401b3b0 con 0x7f77e415e040 2023-10-09T06:42:47.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.589+0000 7f77caffd700 1 --2- 172.21.15.71:0/1552713567 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f77d0067000 0x7f77d00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:47.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.589+0000 7f77caffd700 1 -- 172.21.15.71:0/1552713567 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f77d4083c90 con 0x7f77e415e040 2023-10-09T06:42:47.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.590+0000 7f77caffd700 1 -- 172.21.15.71:0/1552713567 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77d4050f60 con 0x7f77e415e040 2023-10-09T06:42:47.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.594+0000 7f77e2ffd700 1 --2- 172.21.15.71:0/1552713567 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f77d0067000 0x7f77d00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:47.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.607+0000 7f77e2ffd700 1 --2- 172.21.15.71:0/1552713567 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f77d0067000 0x7f77d00694b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f77e4066e40 tx=0x7f77d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:47.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.771+0000 7f7015ffb700 1 -- 172.21.15.71:0/3180033366 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f701c005860 con 0x7f70300cccb0 2023-10-09T06:42:47.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.771+0000 7f7017fff700 1 -- 172.21.15.71:0/3180033366 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7020056530 con 0x7f70300cccb0 2023-10-09T06:42:47.906 INFO:teuthology.orchestra.run.smithi071.stdout:55834574855 2023-10-09T06:42:47.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.775+0000 7f70365ff700 1 -- 172.21.15.71:0/3180033366 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7018067160 msgr2=0x7f7018069610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.776+0000 7f70365ff700 1 --2- 172.21.15.71:0/3180033366 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7018067160 0x7f7018069610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f70280012b0 tx=0x7f7028009670 comp rx=0 tx=0).stop 2023-10-09T06:42:47.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.776+0000 7f70365ff700 1 -- 172.21.15.71:0/3180033366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70300cccb0 msgr2=0x7f703014aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.776+0000 7f70365ff700 1 --2- 172.21.15.71:0/3180033366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70300cccb0 0x7f703014aad0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f70200094c0 tx=0x7f7020016000 comp rx=0 tx=0).stop 2023-10-09T06:42:47.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.776+0000 7f70365ff700 1 -- 172.21.15.71:0/3180033366 shutdown_connections 2023-10-09T06:42:47.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.776+0000 7f70365ff700 1 --2- 172.21.15.71:0/3180033366 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7018067160 0x7f7018069610 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.776+0000 7f70365ff700 1 --2- 172.21.15.71:0/3180033366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f703015bd40 0x7f70300b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.776+0000 7f70365ff700 1 --2- 172.21.15.71:0/3180033366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70300cccb0 0x7f703014aad0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.776+0000 7f70365ff700 1 --2- 172.21.15.71:0/3180033366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f703015b970 0x7f7030132940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.776+0000 7f70365ff700 1 -- 172.21.15.71:0/3180033366 >> 172.21.15.71:0/3180033366 conn(0x7f70300ce600 msgr2=0x7f70300c38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:47.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.777+0000 7f70365ff700 1 -- 172.21.15.71:0/3180033366 shutdown_connections 2023-10-09T06:42:47.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.777+0000 7f70365ff700 1 -- 172.21.15.71:0/3180033366 wait complete. 2023-10-09T06:42:47.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-10-09T06:42:47.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.882+0000 7ffbaa7fc700 1 -- 172.21.15.71:0/3445206005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffba4005560 con 0x7ffbc4155720 2023-10-09T06:42:47.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.883+0000 7ffbc0ff9700 1 -- 172.21.15.71:0/3445206005 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffbb8017090 con 0x7ffbc4155720 2023-10-09T06:42:47.911 DEBUG:teuthology.parallel:result is None 2023-10-09T06:42:47.911 INFO:teuthology.orchestra.run.smithi071.stdout:55834574855 2023-10-09T06:42:47.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.886+0000 7fd25679d700 1 -- 172.21.15.71:0/1303483249 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd25006f670 con 0x7fd2500d01e0 2023-10-09T06:42:47.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.886+0000 7fd2457fa700 1 -- 172.21.15.71:0/1303483249 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd240051b90 con 0x7fd2500d01e0 2023-10-09T06:42:47.912 INFO:teuthology.orchestra.run.smithi071.stdout:55834574854 2023-10-09T06:42:47.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.887+0000 7ffbaa7fc700 1 -- 172.21.15.71:0/3445206005 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffbb0067000 msgr2=0x7ffbb00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.887+0000 7ffbaa7fc700 1 --2- 172.21.15.71:0/3445206005 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffbb0067000 0x7ffbb00694b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc007260 tx=0x7ffbbc007690 comp rx=0 tx=0).stop 2023-10-09T06:42:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.887+0000 7ffbaa7fc700 1 -- 172.21.15.71:0/3445206005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc4155720 msgr2=0x7ffbc40c3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.887+0000 7ffbaa7fc700 1 --2- 172.21.15.71:0/3445206005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc4155720 0x7ffbc40c3a20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800c5b0 tx=0x7ffbb8007f60 comp rx=0 tx=0).stop 2023-10-09T06:42:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.887+0000 7ffbaa7fc700 1 -- 172.21.15.71:0/3445206005 shutdown_connections 2023-10-09T06:42:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.887+0000 7ffbaa7fc700 1 --2- 172.21.15.71:0/3445206005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc4156af0 0x7ffbc40c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.887+0000 7ffbaa7fc700 1 --2- 172.21.15.71:0/3445206005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc40c77e0 0x7ffbc414a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.887+0000 7ffbaa7fc700 1 --2- 172.21.15.71:0/3445206005 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffbb0067000 0x7ffbb00694b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.887+0000 7ffbaa7fc700 1 --2- 172.21.15.71:0/3445206005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc4155720 0x7ffbc40c3a20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.887+0000 7ffbaa7fc700 1 -- 172.21.15.71:0/3445206005 >> 172.21.15.71:0/3445206005 conn(0x7ffbc40cc1f0 msgr2=0x7ffbc4154cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.888+0000 7ffbaa7fc700 1 -- 172.21.15.71:0/3445206005 shutdown_connections 2023-10-09T06:42:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.888+0000 7ffbaa7fc700 1 -- 172.21.15.71:0/3445206005 wait complete. 2023-10-09T06:42:47.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.890+0000 7fd25679d700 1 -- 172.21.15.71:0/1303483249 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd234066f90 msgr2=0x7fd234069440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.890+0000 7fd25679d700 1 --2- 172.21.15.71:0/1303483249 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd234066f90 0x7fd234069440 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd248009ab0 tx=0x7fd248017000 comp rx=0 tx=0).stop 2023-10-09T06:42:47.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.890+0000 7fd25679d700 1 -- 172.21.15.71:0/1303483249 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2500d01e0 msgr2=0x7fd2501432c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.890+0000 7fd25679d700 1 --2- 172.21.15.71:0/1303483249 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2500d01e0 0x7fd2501432c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd24000ea20 tx=0x7fd240008040 comp rx=0 tx=0).stop 2023-10-09T06:42:47.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.891+0000 7fd25679d700 1 -- 172.21.15.71:0/1303483249 shutdown_connections 2023-10-09T06:42:47.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.891+0000 7fd25679d700 1 --2- 172.21.15.71:0/1303483249 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2501471f0 0x7fd25015cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.891+0000 7fd25679d700 1 --2- 172.21.15.71:0/1303483249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2500ce4f0 0x7fd2500b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.891+0000 7fd25679d700 1 --2- 172.21.15.71:0/1303483249 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd234066f90 0x7fd234069440 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.891+0000 7fd25679d700 1 --2- 172.21.15.71:0/1303483249 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2500d01e0 0x7fd2501432c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.891+0000 7fd25679d700 1 -- 172.21.15.71:0/1303483249 >> 172.21.15.71:0/1303483249 conn(0x7fd2500d0660 msgr2=0x7fd250161340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:47.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.891+0000 7fd25679d700 1 -- 172.21.15.71:0/1303483249 shutdown_connections 2023-10-09T06:42:47.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.891+0000 7fd25679d700 1 -- 172.21.15.71:0/1303483249 wait complete. 2023-10-09T06:42:47.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.903+0000 7fe9df59e700 1 -- 172.21.15.71:0/1321336257 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe9d804f880 con 0x7fe9d8039380 2023-10-09T06:42:47.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.904+0000 7fe9ce7fc700 1 -- 172.21.15.71:0/1321336257 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9d804f880 con 0x7fe9d8039380 2023-10-09T06:42:47.917 INFO:teuthology.orchestra.run.smithi071.stdout:55834574854 2023-10-09T06:42:47.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.905+0000 7fd3d759d700 1 -- 172.21.15.71:0/3280026927 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd3b0005560 con 0x7fd3d00b1970 2023-10-09T06:42:47.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.905+0000 7fd3ce7fc700 1 -- 172.21.15.71:0/3280026927 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd3c002a070 con 0x7fd3d00b1970 2023-10-09T06:42:47.917 INFO:teuthology.orchestra.run.smithi071.stdout:55834574854 2023-10-09T06:42:47.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.908+0000 7fe9df59e700 1 -- 172.21.15.71:0/1321336257 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe9c0067030 msgr2=0x7fe9c00694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.908+0000 7fe9df59e700 1 --2- 172.21.15.71:0/1321336257 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe9c0067030 0x7fe9c00694e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0007fd0 tx=0x7fe9d0009040 comp rx=0 tx=0).stop 2023-10-09T06:42:47.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.908+0000 7fe9df59e700 1 -- 172.21.15.71:0/1321336257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9d8039380 msgr2=0x7fe9d80e6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.908+0000 7fe9df59e700 1 --2- 172.21.15.71:0/1321336257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9d8039380 0x7fe9d80e6360 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4001050 tx=0x7fe9d4007ec0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.909+0000 7fd3d759d700 1 -- 172.21.15.71:0/3280026927 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd3bc066f80 msgr2=0x7fd3bc069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.909+0000 7fd3d759d700 1 --2- 172.21.15.71:0/3280026927 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd3bc066f80 0x7fd3bc069430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4009a40 tx=0x7fd3c4008040 comp rx=0 tx=0).stop 2023-10-09T06:42:47.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.909+0000 7fd3d759d700 1 -- 172.21.15.71:0/3280026927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3d00b1970 msgr2=0x7fd3d0177430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.909+0000 7fd3d759d700 1 --2- 172.21.15.71:0/3280026927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3d00b1970 0x7fd3d0177430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0014000 tx=0x7fd3c0017000 comp rx=0 tx=0).stop 2023-10-09T06:42:47.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.909+0000 7fd3d759d700 1 -- 172.21.15.71:0/3280026927 shutdown_connections 2023-10-09T06:42:47.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.909+0000 7fd3d759d700 1 --2- 172.21.15.71:0/3280026927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3d0156d70 0x7fd3d0155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.909+0000 7fd3d759d700 1 --2- 172.21.15.71:0/3280026927 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd3bc066f80 0x7fd3bc069430 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.909+0000 7fd3d759d700 1 --2- 172.21.15.71:0/3280026927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3d006f500 0x7fd3d014cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.909+0000 7fd3d759d700 1 --2- 172.21.15.71:0/3280026927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3d00b1970 0x7fd3d0177430 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.909+0000 7fd3d759d700 1 -- 172.21.15.71:0/3280026927 >> 172.21.15.71:0/3280026927 conn(0x7fd3d00ccc80 msgr2=0x7fd3d0147320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:47.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.909+0000 7fe9df59e700 1 -- 172.21.15.71:0/1321336257 shutdown_connections 2023-10-09T06:42:47.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.909+0000 7fe9df59e700 1 --2- 172.21.15.71:0/1321336257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9d80552a0 0x7fe9d80e68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.909+0000 7fe9df59e700 1 --2- 172.21.15.71:0/1321336257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9d8038fb0 0x7fe9d80dd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.909+0000 7fe9df59e700 1 --2- 172.21.15.71:0/1321336257 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe9c0067030 0x7fe9c00694e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.909+0000 7fe9df59e700 1 --2- 172.21.15.71:0/1321336257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9d8039380 0x7fe9d80e6360 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.909+0000 7fe9df59e700 1 -- 172.21.15.71:0/1321336257 >> 172.21.15.71:0/1321336257 conn(0x7fe9d800f1c0 msgr2=0x7fe9d803b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:47.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.910+0000 7fe9df59e700 1 -- 172.21.15.71:0/1321336257 shutdown_connections 2023-10-09T06:42:47.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.910+0000 7fe9df59e700 1 -- 172.21.15.71:0/1321336257 wait complete. 2023-10-09T06:42:47.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.911+0000 7fd3d759d700 1 -- 172.21.15.71:0/3280026927 shutdown_connections 2023-10-09T06:42:47.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.911+0000 7fd3d759d700 1 -- 172.21.15.71:0/3280026927 wait complete. 2023-10-09T06:42:47.922 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-10-09T06:42:47.923 DEBUG:teuthology.parallel:result is None 2023-10-09T06:42:47.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-10-09T06:42:47.925 DEBUG:teuthology.parallel:result is None 2023-10-09T06:42:47.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.932+0000 7f09c279d700 1 -- 172.21.15.71:0/2946913598 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f09bc162dd0 con 0x7f09bc0ca290 2023-10-09T06:42:47.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.933+0000 7f09b17fa700 1 -- 172.21.15.71:0/2946913598 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f09b8056f50 con 0x7f09bc0ca290 2023-10-09T06:42:47.934 INFO:teuthology.orchestra.run.smithi071.stdout:55834574855 2023-10-09T06:42:47.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.937+0000 7f09c279d700 1 -- 172.21.15.71:0/2946913598 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f09a0067080 msgr2=0x7f09a0069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.937+0000 7f09c279d700 1 --2- 172.21.15.71:0/2946913598 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f09a0067080 0x7f09a0069530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f09bc0c6760 tx=0x7f09b4009040 comp rx=0 tx=0).stop 2023-10-09T06:42:47.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.937+0000 7f09c279d700 1 -- 172.21.15.71:0/2946913598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09bc0ca290 msgr2=0x7f09bc1603d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.937+0000 7f09c279d700 1 --2- 172.21.15.71:0/2946913598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09bc0ca290 0x7f09bc1603d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f09b80093f0 tx=0x7f09b8016000 comp rx=0 tx=0).stop 2023-10-09T06:42:47.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.937+0000 7f09c279d700 1 -- 172.21.15.71:0/2946913598 shutdown_connections 2023-10-09T06:42:47.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.937+0000 7f09c279d700 1 --2- 172.21.15.71:0/2946913598 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f09a0067080 0x7f09a0069530 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.937+0000 7f09c279d700 1 --2- 172.21.15.71:0/2946913598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09bc147550 0x7f09bc06d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.937+0000 7f09c279d700 1 --2- 172.21.15.71:0/2946913598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09bc0c6f80 0x7f09bc144160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.937+0000 7f09c279d700 1 --2- 172.21.15.71:0/2946913598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09bc0ca290 0x7f09bc1603d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.937+0000 7f09c279d700 1 -- 172.21.15.71:0/2946913598 >> 172.21.15.71:0/2946913598 conn(0x7f09bc0cc1f0 msgr2=0x7f09bc0696c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:47.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.937+0000 7f09c279d700 1 -- 172.21.15.71:0/2946913598 shutdown_connections 2023-10-09T06:42:47.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.937+0000 7f09c279d700 1 -- 172.21.15.71:0/2946913598 wait complete. 2023-10-09T06:42:47.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-10-09T06:42:47.943 DEBUG:teuthology.parallel:result is None 2023-10-09T06:42:47.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-10-09T06:42:47.943 DEBUG:teuthology.parallel:result is None 2023-10-09T06:42:47.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-10-09T06:42:47.956 DEBUG:teuthology.parallel:result is None 2023-10-09T06:42:47.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.969+0000 7f283659d700 1 -- 172.21.15.71:0/1929282299 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f283004c3c0 con 0x7f2830161d40 2023-10-09T06:42:47.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.970+0000 7f28257fa700 1 -- 172.21.15.71:0/1929282299 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2820054750 con 0x7f2830161d40 2023-10-09T06:42:47.971 INFO:teuthology.orchestra.run.smithi071.stdout:55834574854 2023-10-09T06:42:47.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.972+0000 7f283659d700 1 -- 172.21.15.71:0/1929282299 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2814066fb0 msgr2=0x7f2814069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.972+0000 7f283659d700 1 --2- 172.21.15.71:0/1929282299 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2814066fb0 0x7f2814069460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2828007fd0 tx=0x7f2828009040 comp rx=0 tx=0).stop 2023-10-09T06:42:47.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.972+0000 7f283659d700 1 -- 172.21.15.71:0/1929282299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2830161d40 msgr2=0x7f283006c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.972+0000 7f283659d700 1 --2- 172.21.15.71:0/1929282299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2830161d40 0x7f283006c5b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f282000b4f0 tx=0x7f2820009060 comp rx=0 tx=0).stop 2023-10-09T06:42:47.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.972+0000 7f283659d700 1 -- 172.21.15.71:0/1929282299 shutdown_connections 2023-10-09T06:42:47.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.972+0000 7f283659d700 1 --2- 172.21.15.71:0/1929282299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2830161d40 0x7f283006c5b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.972+0000 7f283659d700 1 --2- 172.21.15.71:0/1929282299 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2814066fb0 0x7f2814069460 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.972+0000 7f283659d700 1 --2- 172.21.15.71:0/1929282299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28300d01e0 0x7f283015cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.972+0000 7f283659d700 1 --2- 172.21.15.71:0/1929282299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28301471f0 0x7f283006c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:47.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.972+0000 7f283659d700 1 -- 172.21.15.71:0/1929282299 >> 172.21.15.71:0/1929282299 conn(0x7f28300d0660 msgr2=0x7f2830146240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:47.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.972+0000 7f283659d700 1 -- 172.21.15.71:0/1929282299 shutdown_connections 2023-10-09T06:42:47.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.972+0000 7f283659d700 1 -- 172.21.15.71:0/1929282299 wait complete. 2023-10-09T06:42:47.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-10-09T06:42:47.991 DEBUG:teuthology.parallel:result is None 2023-10-09T06:42:47.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.995+0000 7f77e93ff700 1 -- 172.21.15.71:0/1552713567 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f77c4005830 con 0x7f77e415e040 2023-10-09T06:42:47.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.996+0000 7f77caffd700 1 -- 172.21.15.71:0/1552713567 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f77d4054580 con 0x7f77e415e040 2023-10-09T06:42:47.996 INFO:teuthology.orchestra.run.smithi071.stdout:55834574855 2023-10-09T06:42:47.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.998+0000 7f77e93ff700 1 -- 172.21.15.71:0/1552713567 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f77d0067000 msgr2=0x7f77d00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:47.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.998+0000 7f77e93ff700 1 --2- 172.21.15.71:0/1552713567 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f77d0067000 0x7f77d00694b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f77e4066e40 tx=0x7f77d8008040 comp rx=0 tx=0).stop 2023-10-09T06:42:47.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.998+0000 7f77e93ff700 1 -- 172.21.15.71:0/1552713567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77e415e040 msgr2=0x7f77e415e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:48.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.998+0000 7f77e93ff700 1 --2- 172.21.15.71:0/1552713567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77e415e040 0x7f77e415e4b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f77d400c5f0 tx=0x7f77d4007ec0 comp rx=0 tx=0).stop 2023-10-09T06:42:48.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.998+0000 7f77e93ff700 1 -- 172.21.15.71:0/1552713567 shutdown_connections 2023-10-09T06:42:48.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.998+0000 7f77e93ff700 1 --2- 172.21.15.71:0/1552713567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77e4135cd0 0x7f77e4136170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:48.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.998+0000 7f77e93ff700 1 --2- 172.21.15.71:0/1552713567 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f77d0067000 0x7f77d00694b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:48.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.998+0000 7f77e93ff700 1 --2- 172.21.15.71:0/1552713567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77cc0053c0 0x7f77e415fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:48.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.998+0000 7f77e93ff700 1 --2- 172.21.15.71:0/1552713567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77e415e040 0x7f77e415e4b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:48.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.998+0000 7f77e93ff700 1 -- 172.21.15.71:0/1552713567 >> 172.21.15.71:0/1552713567 conn(0x7f77e4068e20 msgr2=0x7f77e40c69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:48.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.998+0000 7f77e93ff700 1 -- 172.21.15.71:0/1552713567 shutdown_connections 2023-10-09T06:42:48.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:47.998+0000 7f77e93ff700 1 -- 172.21.15.71:0/1552713567 wait complete. 2023-10-09T06:42:48.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-10-09T06:42:48.016 DEBUG:teuthology.parallel:result is None 2023-10-09T06:42:48.016 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-09T06:42:48.016 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:42:48.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.235+0000 7fba4359e700 1 Processor -- start 2023-10-09T06:42:48.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.236+0000 7fba4359e700 1 -- start start 2023-10-09T06:42:48.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.237+0000 7fba4359e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fba4406a660 0x7fba44157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:48.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.237+0000 7fba4359e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4406e2a0 con 0x7fba44150550 2023-10-09T06:42:48.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.237+0000 7fba4359e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4406b2e0 con 0x7fba44150180 2023-10-09T06:42:48.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.237+0000 7fba4359e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba440c78e0 con 0x7fba4406a660 2023-10-09T06:42:48.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.237+0000 7fba41d9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fba44150550 0x7fba44069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58280/0 (socket says 172.21.15.71:58280) 2023-10-09T06:42:48.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.237+0000 7fba42d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fba4406a660 0x7fba44157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:48.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.237+0000 7fba41d9b700 1 -- 172.21.15.71:0/2847697048 learned_addr learned my addr 172.21.15.71:0/2847697048 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:48.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.238+0000 7fba4159a700 1 -- 172.21.15.71:0/2847697048 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456651687 0 0) 0x7fba4406e2a0 con 0x7fba44150550 2023-10-09T06:42:48.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.238+0000 7fba4159a700 1 -- 172.21.15.71:0/2847697048 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba2c003570 con 0x7fba44150550 2023-10-09T06:42:48.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.238+0000 7fba42d9d700 1 -- 172.21.15.71:0/2847697048 >> v1:172.21.15.179:6789/0 conn(0x7fba44150180 legacy=0x7fba440c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:48.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.238+0000 7fba42d9d700 1 -- 172.21.15.71:0/2847697048 >> v1:172.21.15.71:6789/0 conn(0x7fba44150550 legacy=0x7fba44069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:48.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.238+0000 7fba42d9d700 1 -- 172.21.15.71:0/2847697048 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba440c7bc0 con 0x7fba4406a660 2023-10-09T06:42:48.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.238+0000 7fba42d9d700 1 --2- 172.21.15.71:0/2847697048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba4406a660 0x7fba44157770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fba3c009e90 tx=0x7fba3c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22415348d480d2e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:48.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.238+0000 7fba4159a700 1 -- 172.21.15.71:0/2847697048 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c00e070 con 0x7fba4406a660 2023-10-09T06:42:48.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.238+0000 7fba4159a700 1 -- 172.21.15.71:0/2847697048 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3c00bc40 con 0x7fba4406a660 2023-10-09T06:42:48.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.238+0000 7fba4159a700 1 -- 172.21.15.71:0/2847697048 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c012430 con 0x7fba4406a660 2023-10-09T06:42:48.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.239+0000 7fba4359e700 1 -- 172.21.15.71:0/2847697048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba4406a660 msgr2=0x7fba44157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:48.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.239+0000 7fba4359e700 1 --2- 172.21.15.71:0/2847697048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba4406a660 0x7fba44157770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fba3c009e90 tx=0x7fba3c009780 comp rx=0 tx=0).stop 2023-10-09T06:42:48.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.239+0000 7fba4359e700 1 -- 172.21.15.71:0/2847697048 shutdown_connections 2023-10-09T06:42:48.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.239+0000 7fba4359e700 1 --2- 172.21.15.71:0/2847697048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba4406a660 0x7fba44157770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:48.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.239+0000 7fba4359e700 1 -- 172.21.15.71:0/2847697048 >> 172.21.15.71:0/2847697048 conn(0x7fba440cc1f0 msgr2=0x7fba440cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:48.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.239+0000 7fba4359e700 1 -- 172.21.15.71:0/2847697048 shutdown_connections 2023-10-09T06:42:48.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.239+0000 7fba4359e700 1 -- 172.21.15.71:0/2847697048 wait complete. 2023-10-09T06:42:48.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.240+0000 7fba4359e700 1 Processor -- start 2023-10-09T06:42:48.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.240+0000 7fba4359e700 1 -- start start 2023-10-09T06:42:48.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.241+0000 7fba4359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba4406a660 0x7fba440c2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:48.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.241+0000 7fba4359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba44150180 0x7fba440c2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:48.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.241+0000 7fba4359e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba44150550 0x7fba440c5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:48.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.241+0000 7fba4359e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba440c2110 con 0x7fba44150550 2023-10-09T06:42:48.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.241+0000 7fba4359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba440aaa90 con 0x7fba44150180 2023-10-09T06:42:48.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.241+0000 7fba4359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba440c1490 con 0x7fba4406a660 2023-10-09T06:42:48.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.242+0000 7fba42d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba44150550 0x7fba440c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:48.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.242+0000 7fba42d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba44150550 0x7fba440c5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52318/0 (socket says 172.21.15.71:52318) 2023-10-09T06:42:48.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.242+0000 7fba42d9d700 1 -- 172.21.15.71:0/4201926188 learned_addr learned my addr 172.21.15.71:0/4201926188 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:48.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.242+0000 7fba41d9b700 1 --2- 172.21.15.71:0/4201926188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba44150180 0x7fba440c2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:48.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.242+0000 7fba42d9d700 1 -- 172.21.15.71:0/4201926188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba4406a660 msgr2=0x7fba440c2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:48.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.242+0000 7fba4259c700 1 --2- 172.21.15.71:0/4201926188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba4406a660 0x7fba440c2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:48.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.242+0000 7fba42d9d700 1 --2- 172.21.15.71:0/4201926188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba4406a660 0x7fba440c2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:48.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.242+0000 7fba42d9d700 1 -- 172.21.15.71:0/4201926188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba44150180 msgr2=0x7fba440c2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:48.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.242+0000 7fba42d9d700 1 --2- 172.21.15.71:0/4201926188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba44150180 0x7fba440c2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:48.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.242+0000 7fba42d9d700 1 -- 172.21.15.71:0/4201926188 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3c009a20 con 0x7fba44150550 2023-10-09T06:42:48.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.242+0000 7fba41d9b700 1 --2- 172.21.15.71:0/4201926188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba44150180 0x7fba440c2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:48.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.242+0000 7fba4259c700 1 --2- 172.21.15.71:0/4201926188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba4406a660 0x7fba440c2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:48.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.242+0000 7fba42d9d700 1 --2- 172.21.15.71:0/4201926188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba44150550 0x7fba440c5280 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fba3c013000 tx=0x7fba3c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:48.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.242+0000 7fba327fc700 1 -- 172.21.15.71:0/4201926188 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c012e40 con 0x7fba44150550 2023-10-09T06:42:48.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.242+0000 7fba327fc700 1 -- 172.21.15.71:0/4201926188 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3c01b630 con 0x7fba44150550 2023-10-09T06:42:48.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.243+0000 7fba327fc700 1 -- 172.21.15.71:0/4201926188 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c01b9f0 con 0x7fba44150550 2023-10-09T06:42:48.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.243+0000 7fba4359e700 1 -- 172.21.15.71:0/4201926188 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba440c1770 con 0x7fba44150550 2023-10-09T06:42:48.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.243+0000 7fba4359e700 1 -- 172.21.15.71:0/4201926188 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba440c1d30 con 0x7fba44150550 2023-10-09T06:42:48.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.244+0000 7fba4359e700 1 -- 172.21.15.71:0/4201926188 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba4404bbe0 con 0x7fba44150550 2023-10-09T06:42:48.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.244+0000 7fba327fc700 1 -- 172.21.15.71:0/4201926188 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba3c01c400 con 0x7fba44150550 2023-10-09T06:42:48.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.245+0000 7fba327fc700 1 --2- 172.21.15.71:0/4201926188 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fba24066f30 0x7fba240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:48.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.246+0000 7fba327fc700 1 -- 172.21.15.71:0/4201926188 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fba3c0860f0 con 0x7fba44150550 2023-10-09T06:42:48.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.246+0000 7fba4259c700 1 --2- 172.21.15.71:0/4201926188 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fba24066f30 0x7fba240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:48.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.247+0000 7fba4259c700 1 --2- 172.21.15.71:0/4201926188 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fba24066f30 0x7fba240693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fba34001840 tx=0x7fba34009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:48.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.249+0000 7fba327fc700 1 -- 172.21.15.71:0/4201926188 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba3c056df0 con 0x7fba44150550 2023-10-09T06:42:48.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.438+0000 7fba4359e700 1 -- 172.21.15.71:0/4201926188 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fba440c2250 con 0x7fba24066f30 2023-10-09T06:42:48.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.447+0000 7fba327fc700 1 -- 172.21.15.71:0/4201926188 <== mgr.4102 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264525 (secure 0 0 0) 0x7fba440c2250 con 0x7fba24066f30 2023-10-09T06:42:48.451 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:42:48.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.451+0000 7fba4359e700 1 -- 172.21.15.71:0/4201926188 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fba24066f30 msgr2=0x7fba240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:48.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.451+0000 7fba4359e700 1 --2- 172.21.15.71:0/4201926188 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fba24066f30 0x7fba240693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fba34001840 tx=0x7fba34009040 comp rx=0 tx=0).stop 2023-10-09T06:42:48.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.451+0000 7fba4359e700 1 -- 172.21.15.71:0/4201926188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba44150550 msgr2=0x7fba440c5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:48.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.451+0000 7fba4359e700 1 --2- 172.21.15.71:0/4201926188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba44150550 0x7fba440c5280 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fba3c013000 tx=0x7fba3c019000 comp rx=0 tx=0).stop 2023-10-09T06:42:48.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.451+0000 7fba4359e700 1 -- 172.21.15.71:0/4201926188 shutdown_connections 2023-10-09T06:42:48.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.451+0000 7fba4359e700 1 --2- 172.21.15.71:0/4201926188 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fba24066f30 0x7fba240693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:48.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.451+0000 7fba4359e700 1 --2- 172.21.15.71:0/4201926188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba44150550 0x7fba440c5280 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:48.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.451+0000 7fba4359e700 1 --2- 172.21.15.71:0/4201926188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba4406a660 0x7fba440c2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:48.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.451+0000 7fba4359e700 1 --2- 172.21.15.71:0/4201926188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba44150180 0x7fba440c2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:48.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.451+0000 7fba4359e700 1 -- 172.21.15.71:0/4201926188 >> 172.21.15.71:0/4201926188 conn(0x7fba440cc1f0 msgr2=0x7fba440ca5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:48.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.451+0000 7fba4359e700 1 -- 172.21.15.71:0/4201926188 shutdown_connections 2023-10-09T06:42:48.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.451+0000 7fba4359e700 1 -- 172.21.15.71:0/4201926188 wait complete. 2023-10-09T06:42:48.454 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:42:48.469 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-09T06:42:46.546716+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381128,"kb_used_data":2824,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593592,"statfs":{"total":773094113280,"available":770655838208,"internally_reserved":0,"allocated":2891776,"data_stored":1750580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002239"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.577185+0000","last_change":"2023-10-09T06:42:38.575641+0000","last_active":"2023-10-09T06:42:38.577185+0000","last_peered":"2023-10-09T06:42:38.577185+0000","last_clean":"2023-10-09T06:42:38.577185+0000","last_became_active":"2023-10-09T06:42:38.575375+0000","last_became_peered":"2023-10-09T06:42:38.575375+0000","last_unstale":"2023-10-09T06:42:38.577185+0000","last_undegraded":"2023-10-09T06:42:38.577185+0000","last_fullsized":"2023-10-09T06:42:38.577185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:07.557629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.563008+0000","last_change":"2023-10-09T06:42:38.559528+0000","last_active":"2023-10-09T06:42:38.563008+0000","last_peered":"2023-10-09T06:42:38.563008+0000","last_clean":"2023-10-09T06:42:38.563008+0000","last_became_active":"2023-10-09T06:42:38.559281+0000","last_became_peered":"2023-10-09T06:42:38.559281+0000","last_unstale":"2023-10-09T06:42:38.563008+0000","last_undegraded":"2023-10-09T06:42:38.563008+0000","last_fullsized":"2023-10-09T06:42:38.563008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:33.081210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.564926+0000","last_change":"2023-10-09T06:42:38.560485+0000","last_active":"2023-10-09T06:42:38.564926+0000","last_peered":"2023-10-09T06:42:38.564926+0000","last_clean":"2023-10-09T06:42:38.564926+0000","last_became_active":"2023-10-09T06:42:38.560196+0000","last_became_peered":"2023-10-09T06:42:38.560196+0000","last_unstale":"2023-10-09T06:42:38.564926+0000","last_undegraded":"2023-10-09T06:42:38.564926+0000","last_fullsized":"2023-10-09T06:42:38.564926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:35:09.230725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.577325+0000","last_change":"2023-10-09T06:42:38.563950+0000","last_active":"2023-10-09T06:42:38.577325+0000","last_peered":"2023-10-09T06:42:38.577325+0000","last_clean":"2023-10-09T06:42:38.577325+0000","last_became_active":"2023-10-09T06:42:38.563426+0000","last_became_peered":"2023-10-09T06:42:38.563426+0000","last_unstale":"2023-10-09T06:42:38.577325+0000","last_undegraded":"2023-10-09T06:42:38.577325+0000","last_fullsized":"2023-10-09T06:42:38.577325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:40.455468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.575267+0000","last_change":"2023-10-09T06:42:38.569136+0000","last_active":"2023-10-09T06:42:38.575267+0000","last_peered":"2023-10-09T06:42:38.575267+0000","last_clean":"2023-10-09T06:42:38.575267+0000","last_became_active":"2023-10-09T06:42:38.568819+0000","last_became_peered":"2023-10-09T06:42:38.568819+0000","last_unstale":"2023-10-09T06:42:38.575267+0000","last_undegraded":"2023-10-09T06:42:38.575267+0000","last_fullsized":"2023-10-09T06:42:38.575267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:45.260995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578720+0000","last_change":"2023-10-09T06:42:38.569499+0000","last_active":"2023-10-09T06:42:38.578720+0000","last_peered":"2023-10-09T06:42:38.578720+0000","last_clean":"2023-10-09T06:42:38.578720+0000","last_became_active":"2023-10-09T06:42:38.569273+0000","last_became_peered":"2023-10-09T06:42:38.569273+0000","last_unstale":"2023-10-09T06:42:38.578720+0000","last_undegraded":"2023-10-09T06:42:38.578720+0000","last_fullsized":"2023-10-09T06:42:38.578720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:30.124382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.568498+0000","last_change":"2023-10-09T06:42:38.563449+0000","last_active":"2023-10-09T06:42:38.568498+0000","last_peered":"2023-10-09T06:42:38.568498+0000","last_clean":"2023-10-09T06:42:38.568498+0000","last_became_active":"2023-10-09T06:42:38.563177+0000","last_became_peered":"2023-10-09T06:42:38.563177+0000","last_unstale":"2023-10-09T06:42:38.568498+0000","last_undegraded":"2023-10-09T06:42:38.568498+0000","last_fullsized":"2023-10-09T06:42:38.568498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:30.124382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581576+0000","last_change":"2023-10-09T06:42:38.577903+0000","last_active":"2023-10-09T06:42:38.581576+0000","last_peered":"2023-10-09T06:42:38.581576+0000","last_clean":"2023-10-09T06:42:38.581576+0000","last_became_active":"2023-10-09T06:42:38.577678+0000","last_became_peered":"2023-10-09T06:42:38.577678+0000","last_unstale":"2023-10-09T06:42:38.581576+0000","last_undegraded":"2023-10-09T06:42:38.581576+0000","last_fullsized":"2023-10-09T06:42:38.581576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:21.009791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.584331+0000","last_change":"2023-10-09T06:42:38.579587+0000","last_active":"2023-10-09T06:42:38.584331+0000","last_peered":"2023-10-09T06:42:38.584331+0000","last_clean":"2023-10-09T06:42:38.584331+0000","last_became_active":"2023-10-09T06:42:38.579323+0000","last_became_peered":"2023-10-09T06:42:38.579323+0000","last_unstale":"2023-10-09T06:42:38.584331+0000","last_undegraded":"2023-10-09T06:42:38.584331+0000","last_fullsized":"2023-10-09T06:42:38.584331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:01:38.384294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581576+0000","last_change":"2023-10-09T06:42:38.579931+0000","last_active":"2023-10-09T06:42:38.581576+0000","last_peered":"2023-10-09T06:42:38.581576+0000","last_clean":"2023-10-09T06:42:38.581576+0000","last_became_active":"2023-10-09T06:42:38.579558+0000","last_became_peered":"2023-10-09T06:42:38.579558+0000","last_unstale":"2023-10-09T06:42:38.581576+0000","last_undegraded":"2023-10-09T06:42:38.581576+0000","last_fullsized":"2023-10-09T06:42:38.581576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:12:51.397981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581524+0000","last_change":"2023-10-09T06:42:38.579020+0000","last_active":"2023-10-09T06:42:38.581524+0000","last_peered":"2023-10-09T06:42:38.581524+0000","last_clean":"2023-10-09T06:42:38.581524+0000","last_became_active":"2023-10-09T06:42:38.578750+0000","last_became_peered":"2023-10-09T06:42:38.578750+0000","last_unstale":"2023-10-09T06:42:38.581524+0000","last_undegraded":"2023-10-09T06:42:38.581524+0000","last_fullsized":"2023-10-09T06:42:38.581524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:09.752553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.569984+0000","last_change":"2023-10-09T06:42:38.569028+0000","last_active":"2023-10-09T06:42:38.569984+0000","last_peered":"2023-10-09T06:42:38.569984+0000","last_clean":"2023-10-09T06:42:38.569984+0000","last_became_active":"2023-10-09T06:42:38.568700+0000","last_became_peered":"2023-10-09T06:42:38.568700+0000","last_unstale":"2023-10-09T06:42:38.569984+0000","last_undegraded":"2023-10-09T06:42:38.569984+0000","last_fullsized":"2023-10-09T06:42:38.569984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:28.626444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.573134+0000","last_change":"2023-10-09T06:42:38.570156+0000","last_active":"2023-10-09T06:42:38.573134+0000","last_peered":"2023-10-09T06:42:38.573134+0000","last_clean":"2023-10-09T06:42:38.573134+0000","last_became_active":"2023-10-09T06:42:38.569850+0000","last_became_peered":"2023-10-09T06:42:38.569850+0000","last_unstale":"2023-10-09T06:42:38.573134+0000","last_undegraded":"2023-10-09T06:42:38.573134+0000","last_fullsized":"2023-10-09T06:42:38.573134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:12:51.397981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.572785+0000","last_change":"2023-10-09T06:42:38.567093+0000","last_active":"2023-10-09T06:42:38.572785+0000","last_peered":"2023-10-09T06:42:38.572785+0000","last_clean":"2023-10-09T06:42:38.572785+0000","last_became_active":"2023-10-09T06:42:38.566754+0000","last_became_peered":"2023-10-09T06:42:38.566754+0000","last_unstale":"2023-10-09T06:42:38.572785+0000","last_undegraded":"2023-10-09T06:42:38.572785+0000","last_fullsized":"2023-10-09T06:42:38.572785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:52.216260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570209+0000","last_change":"2023-10-09T06:42:38.569052+0000","last_active":"2023-10-09T06:42:38.570209+0000","last_peered":"2023-10-09T06:42:38.570209+0000","last_clean":"2023-10-09T06:42:38.570209+0000","last_became_active":"2023-10-09T06:42:38.568464+0000","last_became_peered":"2023-10-09T06:42:38.568464+0000","last_unstale":"2023-10-09T06:42:38.570209+0000","last_undegraded":"2023-10-09T06:42:38.570209+0000","last_fullsized":"2023-10-09T06:42:38.570209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:09.752553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578790+0000","last_change":"2023-10-09T06:42:38.572741+0000","last_active":"2023-10-09T06:42:38.578790+0000","last_peered":"2023-10-09T06:42:38.578790+0000","last_clean":"2023-10-09T06:42:38.578790+0000","last_became_active":"2023-10-09T06:42:38.572442+0000","last_became_peered":"2023-10-09T06:42:38.572442+0000","last_unstale":"2023-10-09T06:42:38.578790+0000","last_undegraded":"2023-10-09T06:42:38.578790+0000","last_fullsized":"2023-10-09T06:42:38.578790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:39.013974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581431+0000","last_change":"2023-10-09T06:42:38.577189+0000","last_active":"2023-10-09T06:42:38.581431+0000","last_peered":"2023-10-09T06:42:38.581431+0000","last_clean":"2023-10-09T06:42:38.581431+0000","last_became_active":"2023-10-09T06:42:38.576869+0000","last_became_peered":"2023-10-09T06:42:38.576869+0000","last_unstale":"2023-10-09T06:42:38.581431+0000","last_undegraded":"2023-10-09T06:42:38.581431+0000","last_fullsized":"2023-10-09T06:42:38.581431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:52:15.589759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570197+0000","last_change":"2023-10-09T06:42:38.566807+0000","last_active":"2023-10-09T06:42:38.570197+0000","last_peered":"2023-10-09T06:42:38.570197+0000","last_clean":"2023-10-09T06:42:38.570197+0000","last_became_active":"2023-10-09T06:42:38.566406+0000","last_became_peered":"2023-10-09T06:42:38.566406+0000","last_unstale":"2023-10-09T06:42:38.570197+0000","last_undegraded":"2023-10-09T06:42:38.570197+0000","last_fullsized":"2023-10-09T06:42:38.570197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:28.626444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.568562+0000","last_change":"2023-10-09T06:42:38.562250+0000","last_active":"2023-10-09T06:42:38.568562+0000","last_peered":"2023-10-09T06:42:38.568562+0000","last_clean":"2023-10-09T06:42:38.568562+0000","last_became_active":"2023-10-09T06:42:38.561988+0000","last_became_peered":"2023-10-09T06:42:38.561988+0000","last_unstale":"2023-10-09T06:42:38.568562+0000","last_undegraded":"2023-10-09T06:42:38.568562+0000","last_fullsized":"2023-10-09T06:42:38.568562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:39.013974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.646183+0000","last_change":"2023-10-09T06:42:37.642781+0000","last_active":"2023-10-09T06:42:38.646183+0000","last_peered":"2023-10-09T06:42:38.646183+0000","last_clean":"2023-10-09T06:42:38.646183+0000","last_became_active":"2023-10-09T06:42:37.642471+0000","last_became_peered":"2023-10-09T06:42:37.642471+0000","last_unstale":"2023-10-09T06:42:38.646183+0000","last_undegraded":"2023-10-09T06:42:38.646183+0000","last_fullsized":"2023-10-09T06:42:38.646183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:05:08.035245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570629+0000","last_change":"2023-10-09T06:42:38.566995+0000","last_active":"2023-10-09T06:42:38.570629+0000","last_peered":"2023-10-09T06:42:38.570629+0000","last_clean":"2023-10-09T06:42:38.570629+0000","last_became_active":"2023-10-09T06:42:38.566465+0000","last_became_peered":"2023-10-09T06:42:38.566465+0000","last_unstale":"2023-10-09T06:42:38.570629+0000","last_undegraded":"2023-10-09T06:42:38.570629+0000","last_fullsized":"2023-10-09T06:42:38.570629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:37:48.391850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.649735+0000","last_change":"2023-10-09T06:42:37.639809+0000","last_active":"2023-10-09T06:42:38.649735+0000","last_peered":"2023-10-09T06:42:38.649735+0000","last_clean":"2023-10-09T06:42:38.649735+0000","last_became_active":"2023-10-09T06:42:37.639544+0000","last_became_peered":"2023-10-09T06:42:37.639544+0000","last_unstale":"2023-10-09T06:42:38.649735+0000","last_undegraded":"2023-10-09T06:42:38.649735+0000","last_fullsized":"2023-10-09T06:42:38.649735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:20:06.272193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.582029+0000","last_change":"2023-10-09T06:42:38.579122+0000","last_active":"2023-10-09T06:42:38.582029+0000","last_peered":"2023-10-09T06:42:38.582029+0000","last_clean":"2023-10-09T06:42:38.582029+0000","last_became_active":"2023-10-09T06:42:38.578579+0000","last_became_peered":"2023-10-09T06:42:38.578579+0000","last_unstale":"2023-10-09T06:42:38.582029+0000","last_undegraded":"2023-10-09T06:42:38.582029+0000","last_fullsized":"2023-10-09T06:42:38.582029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:09.752553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.640061+0000","last_change":"2023-10-09T06:42:37.639115+0000","last_active":"2023-10-09T06:42:38.640061+0000","last_peered":"2023-10-09T06:42:38.640061+0000","last_clean":"2023-10-09T06:42:38.640061+0000","last_became_active":"2023-10-09T06:42:37.638883+0000","last_became_peered":"2023-10-09T06:42:37.638883+0000","last_unstale":"2023-10-09T06:42:38.640061+0000","last_undegraded":"2023-10-09T06:42:38.640061+0000","last_fullsized":"2023-10-09T06:42:38.640061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:00.278956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.576787+0000","last_change":"2023-10-09T06:42:38.556216+0000","last_active":"2023-10-09T06:42:38.576787+0000","last_peered":"2023-10-09T06:42:38.576787+0000","last_clean":"2023-10-09T06:42:38.576787+0000","last_became_active":"2023-10-09T06:42:38.555948+0000","last_became_peered":"2023-10-09T06:42:38.555948+0000","last_unstale":"2023-10-09T06:42:38.576787+0000","last_undegraded":"2023-10-09T06:42:38.576787+0000","last_fullsized":"2023-10-09T06:42:38.576787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:07.557629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.639343+0000","last_change":"2023-10-09T06:42:37.645201+0000","last_active":"2023-10-09T06:42:38.639343+0000","last_peered":"2023-10-09T06:42:38.639343+0000","last_clean":"2023-10-09T06:42:38.639343+0000","last_became_active":"2023-10-09T06:42:37.644809+0000","last_became_peered":"2023-10-09T06:42:37.644809+0000","last_unstale":"2023-10-09T06:42:38.639343+0000","last_undegraded":"2023-10-09T06:42:38.639343+0000","last_fullsized":"2023-10-09T06:42:38.639343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:24.163542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.577053+0000","last_change":"2023-10-09T06:42:38.562628+0000","last_active":"2023-10-09T06:42:38.577053+0000","last_peered":"2023-10-09T06:42:38.577053+0000","last_clean":"2023-10-09T06:42:38.577053+0000","last_became_active":"2023-10-09T06:42:38.559604+0000","last_became_peered":"2023-10-09T06:42:38.559604+0000","last_unstale":"2023-10-09T06:42:38.577053+0000","last_undegraded":"2023-10-09T06:42:38.577053+0000","last_fullsized":"2023-10-09T06:42:38.577053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:37:48.391850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.647992+0000","last_change":"2023-10-09T06:42:37.636915+0000","last_active":"2023-10-09T06:42:38.647992+0000","last_peered":"2023-10-09T06:42:38.647992+0000","last_clean":"2023-10-09T06:42:38.647992+0000","last_became_active":"2023-10-09T06:42:37.635860+0000","last_became_peered":"2023-10-09T06:42:37.635860+0000","last_unstale":"2023-10-09T06:42:38.647992+0000","last_undegraded":"2023-10-09T06:42:38.647992+0000","last_fullsized":"2023-10-09T06:42:38.647992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:37:09.158328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.574981+0000","last_change":"2023-10-09T06:42:38.569866+0000","last_active":"2023-10-09T06:42:38.574981+0000","last_peered":"2023-10-09T06:42:38.574981+0000","last_clean":"2023-10-09T06:42:38.574981+0000","last_became_active":"2023-10-09T06:42:38.569553+0000","last_became_peered":"2023-10-09T06:42:38.569553+0000","last_unstale":"2023-10-09T06:42:38.574981+0000","last_undegraded":"2023-10-09T06:42:38.574981+0000","last_fullsized":"2023-10-09T06:42:38.574981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:21:05.708304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.645604+0000","last_change":"2023-10-09T06:42:37.633709+0000","last_active":"2023-10-09T06:42:38.645604+0000","last_peered":"2023-10-09T06:42:38.645604+0000","last_clean":"2023-10-09T06:42:38.645604+0000","last_became_active":"2023-10-09T06:42:37.633130+0000","last_became_peered":"2023-10-09T06:42:37.633130+0000","last_unstale":"2023-10-09T06:42:38.645604+0000","last_undegraded":"2023-10-09T06:42:38.645604+0000","last_fullsized":"2023-10-09T06:42:38.645604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:37:09.158328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.565018+0000","last_change":"2023-10-09T06:42:38.559125+0000","last_active":"2023-10-09T06:42:38.565018+0000","last_peered":"2023-10-09T06:42:38.565018+0000","last_clean":"2023-10-09T06:42:38.565018+0000","last_became_active":"2023-10-09T06:42:38.558844+0000","last_became_peered":"2023-10-09T06:42:38.558844+0000","last_unstale":"2023-10-09T06:42:38.565018+0000","last_undegraded":"2023-10-09T06:42:38.565018+0000","last_fullsized":"2023-10-09T06:42:38.565018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:12:51.397981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.555859+0000","last_change":"2023-10-09T06:42:37.637810+0000","last_active":"2023-10-09T06:42:38.555859+0000","last_peered":"2023-10-09T06:42:38.555859+0000","last_clean":"2023-10-09T06:42:38.555859+0000","last_became_active":"2023-10-09T06:42:37.637502+0000","last_became_peered":"2023-10-09T06:42:37.637502+0000","last_unstale":"2023-10-09T06:42:38.555859+0000","last_undegraded":"2023-10-09T06:42:38.555859+0000","last_fullsized":"2023-10-09T06:42:38.555859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:35.971277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570842+0000","last_change":"2023-10-09T06:42:38.568118+0000","last_active":"2023-10-09T06:42:38.570842+0000","last_peered":"2023-10-09T06:42:38.570842+0000","last_clean":"2023-10-09T06:42:38.570842+0000","last_became_active":"2023-10-09T06:42:38.567829+0000","last_became_peered":"2023-10-09T06:42:38.567829+0000","last_unstale":"2023-10-09T06:42:38.570842+0000","last_undegraded":"2023-10-09T06:42:38.570842+0000","last_fullsized":"2023-10-09T06:42:38.570842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:40.455468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.550527+0000","last_change":"2023-10-09T06:42:37.630311+0000","last_active":"2023-10-09T06:42:38.550527+0000","last_peered":"2023-10-09T06:42:38.550527+0000","last_clean":"2023-10-09T06:42:38.550527+0000","last_became_active":"2023-10-09T06:42:37.629826+0000","last_became_peered":"2023-10-09T06:42:37.629826+0000","last_unstale":"2023-10-09T06:42:38.550527+0000","last_undegraded":"2023-10-09T06:42:38.550527+0000","last_fullsized":"2023-10-09T06:42:38.550527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:35.971277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570137+0000","last_change":"2023-10-09T06:42:38.564818+0000","last_active":"2023-10-09T06:42:38.570137+0000","last_peered":"2023-10-09T06:42:38.570137+0000","last_clean":"2023-10-09T06:42:38.570137+0000","last_became_active":"2023-10-09T06:42:38.564033+0000","last_became_peered":"2023-10-09T06:42:38.564033+0000","last_unstale":"2023-10-09T06:42:38.570137+0000","last_undegraded":"2023-10-09T06:42:38.570137+0000","last_fullsized":"2023-10-09T06:42:38.570137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:47.620309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.561468+0000","last_change":"2023-10-09T06:42:37.639202+0000","last_active":"2023-10-09T06:42:38.561468+0000","last_peered":"2023-10-09T06:42:38.561468+0000","last_clean":"2023-10-09T06:42:38.561468+0000","last_became_active":"2023-10-09T06:42:37.638949+0000","last_became_peered":"2023-10-09T06:42:37.638949+0000","last_unstale":"2023-10-09T06:42:38.561468+0000","last_undegraded":"2023-10-09T06:42:38.561468+0000","last_fullsized":"2023-10-09T06:42:38.561468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:04:15.833968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578657+0000","last_change":"2023-10-09T06:42:38.576519+0000","last_active":"2023-10-09T06:42:38.578657+0000","last_peered":"2023-10-09T06:42:38.578657+0000","last_clean":"2023-10-09T06:42:38.578657+0000","last_became_active":"2023-10-09T06:42:38.574470+0000","last_became_peered":"2023-10-09T06:42:38.574470+0000","last_unstale":"2023-10-09T06:42:38.578657+0000","last_undegraded":"2023-10-09T06:42:38.578657+0000","last_fullsized":"2023-10-09T06:42:38.578657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:58.690094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.551196+0000","last_change":"2023-10-09T06:42:37.638178+0000","last_active":"2023-10-09T06:42:38.551196+0000","last_peered":"2023-10-09T06:42:38.551196+0000","last_clean":"2023-10-09T06:42:38.551196+0000","last_became_active":"2023-10-09T06:42:37.636993+0000","last_became_peered":"2023-10-09T06:42:37.636993+0000","last_unstale":"2023-10-09T06:42:38.551196+0000","last_undegraded":"2023-10-09T06:42:38.551196+0000","last_fullsized":"2023-10-09T06:42:38.551196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:52.698626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581385+0000","last_change":"2023-10-09T06:42:38.578851+0000","last_active":"2023-10-09T06:42:38.581385+0000","last_peered":"2023-10-09T06:42:38.581385+0000","last_clean":"2023-10-09T06:42:38.581385+0000","last_became_active":"2023-10-09T06:42:38.578545+0000","last_became_peered":"2023-10-09T06:42:38.578545+0000","last_unstale":"2023-10-09T06:42:38.581385+0000","last_undegraded":"2023-10-09T06:42:38.581385+0000","last_fullsized":"2023-10-09T06:42:38.581385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:47.620309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.647140+0000","last_change":"2023-10-09T06:42:37.641427+0000","last_active":"2023-10-09T06:42:38.647140+0000","last_peered":"2023-10-09T06:42:38.647140+0000","last_clean":"2023-10-09T06:42:38.647140+0000","last_became_active":"2023-10-09T06:42:37.640279+0000","last_became_peered":"2023-10-09T06:42:37.640279+0000","last_unstale":"2023-10-09T06:42:38.647140+0000","last_undegraded":"2023-10-09T06:42:38.647140+0000","last_fullsized":"2023-10-09T06:42:38.647140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:24.163542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.569145+0000","last_change":"2023-10-09T06:42:38.567036+0000","last_active":"2023-10-09T06:42:38.569145+0000","last_peered":"2023-10-09T06:42:38.569145+0000","last_clean":"2023-10-09T06:42:38.569145+0000","last_became_active":"2023-10-09T06:42:38.566747+0000","last_became_peered":"2023-10-09T06:42:38.566747+0000","last_unstale":"2023-10-09T06:42:38.569145+0000","last_undegraded":"2023-10-09T06:42:38.569145+0000","last_fullsized":"2023-10-09T06:42:38.569145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:54:35.039738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.650427+0000","last_change":"2023-10-09T06:42:37.640729+0000","last_active":"2023-10-09T06:42:38.650427+0000","last_peered":"2023-10-09T06:42:38.650427+0000","last_clean":"2023-10-09T06:42:38.650427+0000","last_became_active":"2023-10-09T06:42:37.640292+0000","last_became_peered":"2023-10-09T06:42:37.640292+0000","last_unstale":"2023-10-09T06:42:38.650427+0000","last_undegraded":"2023-10-09T06:42:38.650427+0000","last_fullsized":"2023-10-09T06:42:38.650427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:35.971277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.568584+0000","last_change":"2023-10-09T06:42:38.563617+0000","last_active":"2023-10-09T06:42:38.568584+0000","last_peered":"2023-10-09T06:42:38.568584+0000","last_clean":"2023-10-09T06:42:38.568584+0000","last_became_active":"2023-10-09T06:42:38.563354+0000","last_became_peered":"2023-10-09T06:42:38.563354+0000","last_unstale":"2023-10-09T06:42:38.568584+0000","last_undegraded":"2023-10-09T06:42:38.568584+0000","last_fullsized":"2023-10-09T06:42:38.568584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:37:48.391850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.641288+0000","last_change":"2023-10-09T06:42:37.640446+0000","last_active":"2023-10-09T06:42:38.641288+0000","last_peered":"2023-10-09T06:42:38.641288+0000","last_clean":"2023-10-09T06:42:38.641288+0000","last_became_active":"2023-10-09T06:42:37.640147+0000","last_became_peered":"2023-10-09T06:42:37.640147+0000","last_unstale":"2023-10-09T06:42:38.641288+0000","last_undegraded":"2023-10-09T06:42:38.641288+0000","last_fullsized":"2023-10-09T06:42:38.641288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:39.606272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.566333+0000","last_change":"2023-10-09T06:42:38.562201+0000","last_active":"2023-10-09T06:42:38.566333+0000","last_peered":"2023-10-09T06:42:38.566333+0000","last_clean":"2023-10-09T06:42:38.566333+0000","last_became_active":"2023-10-09T06:42:38.561906+0000","last_became_peered":"2023-10-09T06:42:38.561906+0000","last_unstale":"2023-10-09T06:42:38.566333+0000","last_undegraded":"2023-10-09T06:42:38.566333+0000","last_fullsized":"2023-10-09T06:42:38.566333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:33.081210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.554492+0000","last_change":"2023-10-09T06:42:37.633895+0000","last_active":"2023-10-09T06:42:38.554492+0000","last_peered":"2023-10-09T06:42:38.554492+0000","last_clean":"2023-10-09T06:42:38.554492+0000","last_became_active":"2023-10-09T06:42:37.633582+0000","last_became_peered":"2023-10-09T06:42:37.633582+0000","last_unstale":"2023-10-09T06:42:38.554492+0000","last_undegraded":"2023-10-09T06:42:38.554492+0000","last_fullsized":"2023-10-09T06:42:38.554492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:37:09.158328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.577139+0000","last_change":"2023-10-09T06:42:38.574732+0000","last_active":"2023-10-09T06:42:38.577139+0000","last_peered":"2023-10-09T06:42:38.577139+0000","last_clean":"2023-10-09T06:42:38.577139+0000","last_became_active":"2023-10-09T06:42:38.574374+0000","last_became_peered":"2023-10-09T06:42:38.574374+0000","last_unstale":"2023-10-09T06:42:38.577139+0000","last_undegraded":"2023-10-09T06:42:38.577139+0000","last_fullsized":"2023-10-09T06:42:38.577139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:58.690094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.561313+0000","last_change":"2023-10-09T06:42:37.634258+0000","last_active":"2023-10-09T06:42:38.561313+0000","last_peered":"2023-10-09T06:42:38.561313+0000","last_clean":"2023-10-09T06:42:38.561313+0000","last_became_active":"2023-10-09T06:42:37.633958+0000","last_became_peered":"2023-10-09T06:42:37.633958+0000","last_unstale":"2023-10-09T06:42:38.561313+0000","last_undegraded":"2023-10-09T06:42:38.561313+0000","last_fullsized":"2023-10-09T06:42:38.561313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:52.698626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.566266+0000","last_change":"2023-10-09T06:42:38.564382+0000","last_active":"2023-10-09T06:42:38.566266+0000","last_peered":"2023-10-09T06:42:38.566266+0000","last_clean":"2023-10-09T06:42:38.566266+0000","last_became_active":"2023-10-09T06:42:38.563827+0000","last_became_peered":"2023-10-09T06:42:38.563827+0000","last_unstale":"2023-10-09T06:42:38.566266+0000","last_undegraded":"2023-10-09T06:42:38.566266+0000","last_fullsized":"2023-10-09T06:42:38.566266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:35:09.230725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.644393+0000","last_change":"2023-10-09T06:42:37.636395+0000","last_active":"2023-10-09T06:42:38.644393+0000","last_peered":"2023-10-09T06:42:38.644393+0000","last_clean":"2023-10-09T06:42:38.644393+0000","last_became_active":"2023-10-09T06:42:37.636040+0000","last_became_peered":"2023-10-09T06:42:37.636040+0000","last_unstale":"2023-10-09T06:42:38.644393+0000","last_undegraded":"2023-10-09T06:42:38.644393+0000","last_fullsized":"2023-10-09T06:42:38.644393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:04:15.833968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.575637+0000","last_change":"2023-10-09T06:42:38.570513+0000","last_active":"2023-10-09T06:42:38.575637+0000","last_peered":"2023-10-09T06:42:38.575637+0000","last_clean":"2023-10-09T06:42:38.575637+0000","last_became_active":"2023-10-09T06:42:38.570219+0000","last_became_peered":"2023-10-09T06:42:38.570219+0000","last_unstale":"2023-10-09T06:42:38.575637+0000","last_undegraded":"2023-10-09T06:42:38.575637+0000","last_fullsized":"2023-10-09T06:42:38.575637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:28:50.048850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.641339+0000","last_change":"2023-10-09T06:42:37.638988+0000","last_active":"2023-10-09T06:42:38.641339+0000","last_peered":"2023-10-09T06:42:38.641339+0000","last_clean":"2023-10-09T06:42:38.641339+0000","last_became_active":"2023-10-09T06:42:37.638699+0000","last_became_peered":"2023-10-09T06:42:37.638699+0000","last_unstale":"2023-10-09T06:42:38.641339+0000","last_undegraded":"2023-10-09T06:42:38.641339+0000","last_fullsized":"2023-10-09T06:42:38.641339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:20:06.272193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.575426+0000","last_change":"2023-10-09T06:42:38.569837+0000","last_active":"2023-10-09T06:42:38.575426+0000","last_peered":"2023-10-09T06:42:38.575426+0000","last_clean":"2023-10-09T06:42:38.575426+0000","last_became_active":"2023-10-09T06:42:38.569508+0000","last_became_peered":"2023-10-09T06:42:38.569508+0000","last_unstale":"2023-10-09T06:42:38.575426+0000","last_undegraded":"2023-10-09T06:42:38.575426+0000","last_fullsized":"2023-10-09T06:42:38.575426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:40.455468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.556115+0000","last_change":"2023-10-09T06:42:37.641808+0000","last_active":"2023-10-09T06:42:38.556115+0000","last_peered":"2023-10-09T06:42:38.556115+0000","last_clean":"2023-10-09T06:42:38.556115+0000","last_became_active":"2023-10-09T06:42:37.641389+0000","last_became_peered":"2023-10-09T06:42:37.641389+0000","last_unstale":"2023-10-09T06:42:38.556115+0000","last_undegraded":"2023-10-09T06:42:38.556115+0000","last_fullsized":"2023-10-09T06:42:38.556115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:52.698626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578832+0000","last_change":"2023-10-09T06:42:38.568966+0000","last_active":"2023-10-09T06:42:38.578832+0000","last_peered":"2023-10-09T06:42:38.578832+0000","last_clean":"2023-10-09T06:42:38.578832+0000","last_became_active":"2023-10-09T06:42:38.564917+0000","last_became_peered":"2023-10-09T06:42:38.564917+0000","last_unstale":"2023-10-09T06:42:38.578832+0000","last_undegraded":"2023-10-09T06:42:38.578832+0000","last_fullsized":"2023-10-09T06:42:38.578832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:13.371246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.554558+0000","last_change":"2023-10-09T06:42:37.635676+0000","last_active":"2023-10-09T06:42:38.554558+0000","last_peered":"2023-10-09T06:42:38.554558+0000","last_clean":"2023-10-09T06:42:38.554558+0000","last_became_active":"2023-10-09T06:42:37.635365+0000","last_became_peered":"2023-10-09T06:42:37.635365+0000","last_unstale":"2023-10-09T06:42:38.554558+0000","last_undegraded":"2023-10-09T06:42:38.554558+0000","last_fullsized":"2023-10-09T06:42:38.554558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:04:15.833968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.565166+0000","last_change":"2023-10-09T06:42:38.557514+0000","last_active":"2023-10-09T06:42:38.565166+0000","last_peered":"2023-10-09T06:42:38.565166+0000","last_clean":"2023-10-09T06:42:38.565166+0000","last_became_active":"2023-10-09T06:42:38.557194+0000","last_became_peered":"2023-10-09T06:42:38.557194+0000","last_unstale":"2023-10-09T06:42:38.565166+0000","last_undegraded":"2023-10-09T06:42:38.565166+0000","last_fullsized":"2023-10-09T06:42:38.565166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:52.216260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.569358+0000","last_change":"2023-10-09T06:42:38.562852+0000","last_active":"2023-10-09T06:42:38.569358+0000","last_peered":"2023-10-09T06:42:38.569358+0000","last_clean":"2023-10-09T06:42:38.569358+0000","last_became_active":"2023-10-09T06:42:38.562427+0000","last_became_peered":"2023-10-09T06:42:38.562427+0000","last_unstale":"2023-10-09T06:42:38.569358+0000","last_undegraded":"2023-10-09T06:42:38.569358+0000","last_fullsized":"2023-10-09T06:42:38.569358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:54:31.244116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.555131+0000","last_change":"2023-10-09T06:42:37.629265+0000","last_active":"2023-10-09T06:42:38.555131+0000","last_peered":"2023-10-09T06:42:38.555131+0000","last_clean":"2023-10-09T06:42:38.555131+0000","last_became_active":"2023-10-09T06:42:37.628888+0000","last_became_peered":"2023-10-09T06:42:37.628888+0000","last_unstale":"2023-10-09T06:42:38.555131+0000","last_undegraded":"2023-10-09T06:42:38.555131+0000","last_fullsized":"2023-10-09T06:42:38.555131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:37:09.158328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581871+0000","last_change":"2023-10-09T06:42:38.578592+0000","last_active":"2023-10-09T06:42:38.581871+0000","last_peered":"2023-10-09T06:42:38.581871+0000","last_clean":"2023-10-09T06:42:38.581871+0000","last_became_active":"2023-10-09T06:42:38.578331+0000","last_became_peered":"2023-10-09T06:42:38.578331+0000","last_unstale":"2023-10-09T06:42:38.581871+0000","last_undegraded":"2023-10-09T06:42:38.581871+0000","last_fullsized":"2023-10-09T06:42:38.581871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:10.767555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.549764+0000","last_change":"2023-10-09T06:42:37.631298+0000","last_active":"2023-10-09T06:42:38.549764+0000","last_peered":"2023-10-09T06:42:38.549764+0000","last_clean":"2023-10-09T06:42:38.549764+0000","last_became_active":"2023-10-09T06:42:37.631005+0000","last_became_peered":"2023-10-09T06:42:37.631005+0000","last_unstale":"2023-10-09T06:42:38.549764+0000","last_undegraded":"2023-10-09T06:42:38.549764+0000","last_fullsized":"2023-10-09T06:42:38.549764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:24.163542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.556307+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:42:38.556307+0000","last_peered":"2023-10-09T06:42:38.556307+0000","last_clean":"2023-10-09T06:42:38.556307+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:42:38.556307+0000","last_undegraded":"2023-10-09T06:42:38.556307+0000","last_fullsized":"2023-10-09T06:42:38.556307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.564781+0000","last_change":"2023-10-09T06:42:38.559755+0000","last_active":"2023-10-09T06:42:38.564781+0000","last_peered":"2023-10-09T06:42:38.564781+0000","last_clean":"2023-10-09T06:42:38.564781+0000","last_became_active":"2023-10-09T06:42:38.559505+0000","last_became_peered":"2023-10-09T06:42:38.559505+0000","last_unstale":"2023-10-09T06:42:38.564781+0000","last_undegraded":"2023-10-09T06:42:38.564781+0000","last_fullsized":"2023-10-09T06:42:38.564781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:49:10.861117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.556416+0000","last_change":"2023-10-09T06:42:37.643040+0000","last_active":"2023-10-09T06:42:38.556416+0000","last_peered":"2023-10-09T06:42:38.556416+0000","last_clean":"2023-10-09T06:42:38.556416+0000","last_became_active":"2023-10-09T06:42:37.642814+0000","last_became_peered":"2023-10-09T06:42:37.642814+0000","last_unstale":"2023-10-09T06:42:38.556416+0000","last_undegraded":"2023-10-09T06:42:38.556416+0000","last_fullsized":"2023-10-09T06:42:38.556416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:20:06.272193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.557248+0000","last_change":"2023-10-09T06:42:37.642142+0000","last_active":"2023-10-09T06:42:38.557248+0000","last_peered":"2023-10-09T06:42:38.557248+0000","last_clean":"2023-10-09T06:42:38.557248+0000","last_became_active":"2023-10-09T06:42:37.641797+0000","last_became_peered":"2023-10-09T06:42:37.641797+0000","last_unstale":"2023-10-09T06:42:38.557248+0000","last_undegraded":"2023-10-09T06:42:38.557248+0000","last_fullsized":"2023-10-09T06:42:38.557248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:54:34.033416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570074+0000","last_change":"2023-10-09T06:42:38.563528+0000","last_active":"2023-10-09T06:42:38.570074+0000","last_peered":"2023-10-09T06:42:38.570074+0000","last_clean":"2023-10-09T06:42:38.570074+0000","last_became_active":"2023-10-09T06:42:38.563121+0000","last_became_peered":"2023-10-09T06:42:38.563121+0000","last_unstale":"2023-10-09T06:42:38.570074+0000","last_undegraded":"2023-10-09T06:42:38.570074+0000","last_fullsized":"2023-10-09T06:42:38.570074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:13.371246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T06:42:39.554941+0000","last_change":"2023-10-09T06:42:37.641729+0000","last_active":"2023-10-09T06:42:39.554941+0000","last_peered":"2023-10-09T06:42:39.554941+0000","last_clean":"2023-10-09T06:42:39.554941+0000","last_became_active":"2023-10-09T06:42:37.641401+0000","last_became_peered":"2023-10-09T06:42:37.641401+0000","last_unstale":"2023-10-09T06:42:39.554941+0000","last_undegraded":"2023-10-09T06:42:39.554941+0000","last_fullsized":"2023-10-09T06:42:39.554941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:00.278956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.572665+0000","last_change":"2023-10-09T06:42:38.569525+0000","last_active":"2023-10-09T06:42:38.572665+0000","last_peered":"2023-10-09T06:42:38.572665+0000","last_clean":"2023-10-09T06:42:38.572665+0000","last_became_active":"2023-10-09T06:42:38.569071+0000","last_became_peered":"2023-10-09T06:42:38.569071+0000","last_unstale":"2023-10-09T06:42:38.572665+0000","last_undegraded":"2023-10-09T06:42:38.572665+0000","last_fullsized":"2023-10-09T06:42:38.572665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:13.371246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.640292+0000","last_change":"2023-10-09T06:42:37.637774+0000","last_active":"2023-10-09T06:42:38.640292+0000","last_peered":"2023-10-09T06:42:38.640292+0000","last_clean":"2023-10-09T06:42:38.640292+0000","last_became_active":"2023-10-09T06:42:37.637478+0000","last_became_peered":"2023-10-09T06:42:37.637478+0000","last_unstale":"2023-10-09T06:42:38.640292+0000","last_undegraded":"2023-10-09T06:42:38.640292+0000","last_fullsized":"2023-10-09T06:42:38.640292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:24.163542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.564966+0000","last_change":"2023-10-09T06:42:38.562018+0000","last_active":"2023-10-09T06:42:38.564966+0000","last_peered":"2023-10-09T06:42:38.564966+0000","last_clean":"2023-10-09T06:42:38.564966+0000","last_became_active":"2023-10-09T06:42:38.561717+0000","last_became_peered":"2023-10-09T06:42:38.561717+0000","last_unstale":"2023-10-09T06:42:38.564966+0000","last_undegraded":"2023-10-09T06:42:38.564966+0000","last_fullsized":"2023-10-09T06:42:38.564966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:28.626444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.556201+0000","last_change":"2023-10-09T06:42:37.642616+0000","last_active":"2023-10-09T06:42:38.556201+0000","last_peered":"2023-10-09T06:42:38.556201+0000","last_clean":"2023-10-09T06:42:38.556201+0000","last_became_active":"2023-10-09T06:42:37.641865+0000","last_became_peered":"2023-10-09T06:42:37.641865+0000","last_unstale":"2023-10-09T06:42:38.556201+0000","last_undegraded":"2023-10-09T06:42:38.556201+0000","last_fullsized":"2023-10-09T06:42:38.556201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:10.432797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.566828+0000","last_change":"2023-10-09T06:42:38.564540+0000","last_active":"2023-10-09T06:42:38.566828+0000","last_peered":"2023-10-09T06:42:38.566828+0000","last_clean":"2023-10-09T06:42:38.566828+0000","last_became_active":"2023-10-09T06:42:38.564273+0000","last_became_peered":"2023-10-09T06:42:38.564273+0000","last_unstale":"2023-10-09T06:42:38.566828+0000","last_undegraded":"2023-10-09T06:42:38.566828+0000","last_fullsized":"2023-10-09T06:42:38.566828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:01.285278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.556077+0000","last_change":"2023-10-09T06:42:37.635028+0000","last_active":"2023-10-09T06:42:38.556077+0000","last_peered":"2023-10-09T06:42:38.556077+0000","last_clean":"2023-10-09T06:42:38.556077+0000","last_became_active":"2023-10-09T06:42:37.634697+0000","last_became_peered":"2023-10-09T06:42:37.634697+0000","last_unstale":"2023-10-09T06:42:38.556077+0000","last_undegraded":"2023-10-09T06:42:38.556077+0000","last_fullsized":"2023-10-09T06:42:38.556077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:35.971277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.569616+0000","last_change":"2023-10-09T06:42:38.563391+0000","last_active":"2023-10-09T06:42:38.569616+0000","last_peered":"2023-10-09T06:42:38.569616+0000","last_clean":"2023-10-09T06:42:38.569616+0000","last_became_active":"2023-10-09T06:42:38.563055+0000","last_became_peered":"2023-10-09T06:42:38.563055+0000","last_unstale":"2023-10-09T06:42:38.569616+0000","last_undegraded":"2023-10-09T06:42:38.569616+0000","last_fullsized":"2023-10-09T06:42:38.569616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:09.752553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.561304+0000","last_change":"2023-10-09T06:42:37.635284+0000","last_active":"2023-10-09T06:42:38.561304+0000","last_peered":"2023-10-09T06:42:38.561304+0000","last_clean":"2023-10-09T06:42:38.561304+0000","last_became_active":"2023-10-09T06:42:37.633661+0000","last_became_peered":"2023-10-09T06:42:37.633661+0000","last_unstale":"2023-10-09T06:42:38.561304+0000","last_undegraded":"2023-10-09T06:42:38.561304+0000","last_fullsized":"2023-10-09T06:42:38.561304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:04:15.833968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570875+0000","last_change":"2023-10-09T06:42:38.568141+0000","last_active":"2023-10-09T06:42:38.570875+0000","last_peered":"2023-10-09T06:42:38.570875+0000","last_clean":"2023-10-09T06:42:38.570875+0000","last_became_active":"2023-10-09T06:42:38.567842+0000","last_became_peered":"2023-10-09T06:42:38.567842+0000","last_unstale":"2023-10-09T06:42:38.570875+0000","last_undegraded":"2023-10-09T06:42:38.570875+0000","last_fullsized":"2023-10-09T06:42:38.570875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:28:50.048850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.640654+0000","last_change":"2023-10-09T06:42:37.642378+0000","last_active":"2023-10-09T06:42:38.640654+0000","last_peered":"2023-10-09T06:42:38.640654+0000","last_clean":"2023-10-09T06:42:38.640654+0000","last_became_active":"2023-10-09T06:42:37.641825+0000","last_became_peered":"2023-10-09T06:42:37.641825+0000","last_unstale":"2023-10-09T06:42:38.640654+0000","last_undegraded":"2023-10-09T06:42:38.640654+0000","last_fullsized":"2023-10-09T06:42:38.640654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:04:15.833968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.571061+0000","last_change":"2023-10-09T06:42:38.569442+0000","last_active":"2023-10-09T06:42:38.571061+0000","last_peered":"2023-10-09T06:42:38.571061+0000","last_clean":"2023-10-09T06:42:38.571061+0000","last_became_active":"2023-10-09T06:42:38.569154+0000","last_became_peered":"2023-10-09T06:42:38.569154+0000","last_unstale":"2023-10-09T06:42:38.571061+0000","last_undegraded":"2023-10-09T06:42:38.571061+0000","last_fullsized":"2023-10-09T06:42:38.571061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:13.371246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.554960+0000","last_change":"2023-10-09T06:42:37.631048+0000","last_active":"2023-10-09T06:42:38.554960+0000","last_peered":"2023-10-09T06:42:38.554960+0000","last_clean":"2023-10-09T06:42:38.554960+0000","last_became_active":"2023-10-09T06:42:37.630750+0000","last_became_peered":"2023-10-09T06:42:37.630750+0000","last_unstale":"2023-10-09T06:42:38.554960+0000","last_undegraded":"2023-10-09T06:42:38.554960+0000","last_fullsized":"2023-10-09T06:42:38.554960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:35.971277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581777+0000","last_change":"2023-10-09T06:42:38.578335+0000","last_active":"2023-10-09T06:42:38.581777+0000","last_peered":"2023-10-09T06:42:38.581777+0000","last_clean":"2023-10-09T06:42:38.581777+0000","last_became_active":"2023-10-09T06:42:38.578028+0000","last_became_peered":"2023-10-09T06:42:38.578028+0000","last_unstale":"2023-10-09T06:42:38.581777+0000","last_undegraded":"2023-10-09T06:42:38.581777+0000","last_fullsized":"2023-10-09T06:42:38.581777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:21.009791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.647078+0000","last_change":"2023-10-09T06:42:37.634742+0000","last_active":"2023-10-09T06:42:38.647078+0000","last_peered":"2023-10-09T06:42:38.647078+0000","last_clean":"2023-10-09T06:42:38.647078+0000","last_became_active":"2023-10-09T06:42:37.633877+0000","last_became_peered":"2023-10-09T06:42:37.633877+0000","last_unstale":"2023-10-09T06:42:38.647078+0000","last_undegraded":"2023-10-09T06:42:38.647078+0000","last_fullsized":"2023-10-09T06:42:38.647078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:10.432797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.577301+0000","last_change":"2023-10-09T06:42:38.563710+0000","last_active":"2023-10-09T06:42:38.577301+0000","last_peered":"2023-10-09T06:42:38.577301+0000","last_clean":"2023-10-09T06:42:38.577301+0000","last_became_active":"2023-10-09T06:42:38.563052+0000","last_became_peered":"2023-10-09T06:42:38.563052+0000","last_unstale":"2023-10-09T06:42:38.577301+0000","last_undegraded":"2023-10-09T06:42:38.577301+0000","last_fullsized":"2023-10-09T06:42:38.577301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:21.009791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.642089+0000","last_change":"2023-10-09T06:42:37.629716+0000","last_active":"2023-10-09T06:42:38.642089+0000","last_peered":"2023-10-09T06:42:38.642089+0000","last_clean":"2023-10-09T06:42:38.642089+0000","last_became_active":"2023-10-09T06:42:37.629416+0000","last_became_peered":"2023-10-09T06:42:37.629416+0000","last_unstale":"2023-10-09T06:42:38.642089+0000","last_undegraded":"2023-10-09T06:42:38.642089+0000","last_fullsized":"2023-10-09T06:42:38.642089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:52.698626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.576962+0000","last_change":"2023-10-09T06:42:38.571766+0000","last_active":"2023-10-09T06:42:38.576962+0000","last_peered":"2023-10-09T06:42:38.576962+0000","last_clean":"2023-10-09T06:42:38.576962+0000","last_became_active":"2023-10-09T06:42:38.571419+0000","last_became_peered":"2023-10-09T06:42:38.571419+0000","last_unstale":"2023-10-09T06:42:38.576962+0000","last_undegraded":"2023-10-09T06:42:38.576962+0000","last_fullsized":"2023-10-09T06:42:38.576962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:44:36.008678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.566289+0000","last_change":"2023-10-09T06:42:38.564609+0000","last_active":"2023-10-09T06:42:38.566289+0000","last_peered":"2023-10-09T06:42:38.566289+0000","last_clean":"2023-10-09T06:42:38.566289+0000","last_became_active":"2023-10-09T06:42:38.564121+0000","last_became_peered":"2023-10-09T06:42:38.564121+0000","last_unstale":"2023-10-09T06:42:38.566289+0000","last_undegraded":"2023-10-09T06:42:38.566289+0000","last_fullsized":"2023-10-09T06:42:38.566289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:10.767555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581375+0000","last_change":"2023-10-09T06:42:38.577925+0000","last_active":"2023-10-09T06:42:38.581375+0000","last_peered":"2023-10-09T06:42:38.581375+0000","last_clean":"2023-10-09T06:42:38.581375+0000","last_became_active":"2023-10-09T06:42:38.577659+0000","last_became_peered":"2023-10-09T06:42:38.577659+0000","last_unstale":"2023-10-09T06:42:38.581375+0000","last_undegraded":"2023-10-09T06:42:38.581375+0000","last_fullsized":"2023-10-09T06:42:38.581375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:21:05.708304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578759+0000","last_change":"2023-10-09T06:42:38.571770+0000","last_active":"2023-10-09T06:42:38.578759+0000","last_peered":"2023-10-09T06:42:38.578759+0000","last_clean":"2023-10-09T06:42:38.578759+0000","last_became_active":"2023-10-09T06:42:38.571510+0000","last_became_peered":"2023-10-09T06:42:38.571510+0000","last_unstale":"2023-10-09T06:42:38.578759+0000","last_undegraded":"2023-10-09T06:42:38.578759+0000","last_fullsized":"2023-10-09T06:42:38.578759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:28:50.048850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.567198+0000","last_change":"2023-10-09T06:42:38.564945+0000","last_active":"2023-10-09T06:42:38.567198+0000","last_peered":"2023-10-09T06:42:38.567198+0000","last_clean":"2023-10-09T06:42:38.567198+0000","last_became_active":"2023-10-09T06:42:38.564686+0000","last_became_peered":"2023-10-09T06:42:38.564686+0000","last_unstale":"2023-10-09T06:42:38.567198+0000","last_undegraded":"2023-10-09T06:42:38.567198+0000","last_fullsized":"2023-10-09T06:42:38.567198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:10.767555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570888+0000","last_change":"2023-10-09T06:42:38.569388+0000","last_active":"2023-10-09T06:42:38.570888+0000","last_peered":"2023-10-09T06:42:38.570888+0000","last_clean":"2023-10-09T06:42:38.570888+0000","last_became_active":"2023-10-09T06:42:38.568559+0000","last_became_peered":"2023-10-09T06:42:38.568559+0000","last_unstale":"2023-10-09T06:42:38.570888+0000","last_undegraded":"2023-10-09T06:42:38.570888+0000","last_fullsized":"2023-10-09T06:42:38.570888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:07.557629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570179+0000","last_change":"2023-10-09T06:42:38.565348+0000","last_active":"2023-10-09T06:42:38.570179+0000","last_peered":"2023-10-09T06:42:38.570179+0000","last_clean":"2023-10-09T06:42:38.570179+0000","last_became_active":"2023-10-09T06:42:38.564447+0000","last_became_peered":"2023-10-09T06:42:38.564447+0000","last_unstale":"2023-10-09T06:42:38.570179+0000","last_undegraded":"2023-10-09T06:42:38.570179+0000","last_fullsized":"2023-10-09T06:42:38.570179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:12:51.397981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.575872+0000","last_change":"2023-10-09T06:42:38.573595+0000","last_active":"2023-10-09T06:42:38.575872+0000","last_peered":"2023-10-09T06:42:38.575872+0000","last_clean":"2023-10-09T06:42:38.575872+0000","last_became_active":"2023-10-09T06:42:38.573337+0000","last_became_peered":"2023-10-09T06:42:38.573337+0000","last_unstale":"2023-10-09T06:42:38.575872+0000","last_undegraded":"2023-10-09T06:42:38.575872+0000","last_fullsized":"2023-10-09T06:42:38.575872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:47.620309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570836+0000","last_change":"2023-10-09T06:42:38.569014+0000","last_active":"2023-10-09T06:42:38.570836+0000","last_peered":"2023-10-09T06:42:38.570836+0000","last_clean":"2023-10-09T06:42:38.570836+0000","last_became_active":"2023-10-09T06:42:38.568745+0000","last_became_peered":"2023-10-09T06:42:38.568745+0000","last_unstale":"2023-10-09T06:42:38.570836+0000","last_undegraded":"2023-10-09T06:42:38.570836+0000","last_fullsized":"2023-10-09T06:42:38.570836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:47.620309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578772+0000","last_change":"2023-10-09T06:42:38.569326+0000","last_active":"2023-10-09T06:42:38.578772+0000","last_peered":"2023-10-09T06:42:38.578772+0000","last_clean":"2023-10-09T06:42:38.578772+0000","last_became_active":"2023-10-09T06:42:38.569071+0000","last_became_peered":"2023-10-09T06:42:38.569071+0000","last_unstale":"2023-10-09T06:42:38.578772+0000","last_undegraded":"2023-10-09T06:42:38.578772+0000","last_fullsized":"2023-10-09T06:42:38.578772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:44:36.008678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.572639+0000","last_change":"2023-10-09T06:42:38.569598+0000","last_active":"2023-10-09T06:42:38.572639+0000","last_peered":"2023-10-09T06:42:38.572639+0000","last_clean":"2023-10-09T06:42:38.572639+0000","last_became_active":"2023-10-09T06:42:38.569008+0000","last_became_peered":"2023-10-09T06:42:38.569008+0000","last_unstale":"2023-10-09T06:42:38.572639+0000","last_undegraded":"2023-10-09T06:42:38.572639+0000","last_fullsized":"2023-10-09T06:42:38.572639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:33.081210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578740+0000","last_change":"2023-10-09T06:42:38.569703+0000","last_active":"2023-10-09T06:42:38.578740+0000","last_peered":"2023-10-09T06:42:38.578740+0000","last_clean":"2023-10-09T06:42:38.578740+0000","last_became_active":"2023-10-09T06:42:38.565385+0000","last_became_peered":"2023-10-09T06:42:38.565385+0000","last_unstale":"2023-10-09T06:42:38.578740+0000","last_undegraded":"2023-10-09T06:42:38.578740+0000","last_fullsized":"2023-10-09T06:42:38.578740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:33.081210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.575964+0000","last_change":"2023-10-09T06:42:38.572735+0000","last_active":"2023-10-09T06:42:38.575964+0000","last_peered":"2023-10-09T06:42:38.575964+0000","last_clean":"2023-10-09T06:42:38.575964+0000","last_became_active":"2023-10-09T06:42:38.572479+0000","last_became_peered":"2023-10-09T06:42:38.572479+0000","last_unstale":"2023-10-09T06:42:38.575964+0000","last_undegraded":"2023-10-09T06:42:38.575964+0000","last_fullsized":"2023-10-09T06:42:38.575964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:13.371246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.571301+0000","last_change":"2023-10-09T06:42:38.569452+0000","last_active":"2023-10-09T06:42:38.571301+0000","last_peered":"2023-10-09T06:42:38.571301+0000","last_clean":"2023-10-09T06:42:38.571301+0000","last_became_active":"2023-10-09T06:42:38.569167+0000","last_became_peered":"2023-10-09T06:42:38.569167+0000","last_unstale":"2023-10-09T06:42:38.571301+0000","last_undegraded":"2023-10-09T06:42:38.571301+0000","last_fullsized":"2023-10-09T06:42:38.571301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:33.081210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":661576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":811008,"data_stored":661632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:42:48.475 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:42:48.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.689+0000 7f7afcfff700 1 Processor -- start 2023-10-09T06:42:48.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.689+0000 7f7afcfff700 1 -- start start 2023-10-09T06:42:48.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.690+0000 7f7afcfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7af81578b0 0x7f7af8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:48.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.690+0000 7f7afcfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7af80af2f0 0x7f7af80af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:48.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.690+0000 7f7afcfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7af80ad930 con 0x7f7af8155c10 2023-10-09T06:42:48.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.690+0000 7f7afcfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7af80b0c80 con 0x7f7af81578b0 2023-10-09T06:42:48.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.690+0000 7f7afcfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af80acd20 con 0x7f7af80af2f0 2023-10-09T06:42:48.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.691+0000 7f7af5d9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7af81578b0 0x7f7af8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:48.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.691+0000 7f7af6d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7af80af2f0 0x7f7af80af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:48.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.691+0000 7f7af5d9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7af81578b0 0x7f7af8155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:49510/0 (socket says 172.21.15.71:49510) 2023-10-09T06:42:48.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.691+0000 7f7af5d9b700 1 -- 172.21.15.71:0/1456897533 learned_addr learned my addr 172.21.15.71:0/1456897533 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:48.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.691+0000 7f7af559a700 1 -- 172.21.15.71:0/1456897533 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1225769265 0 0) 0x7f7af80ad930 con 0x7f7af8155c10 2023-10-09T06:42:48.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.691+0000 7f7af559a700 1 -- 172.21.15.71:0/1456897533 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ae0003570 con 0x7f7af8155c10 2023-10-09T06:42:48.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.691+0000 7f7af6d9d700 1 -- 172.21.15.71:0/1456897533 >> v2:172.21.15.179:3300/0 conn(0x7f7af81578b0 msgr2=0x7f7af8155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:48.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.691+0000 7f7af6d9d700 1 --2- 172.21.15.71:0/1456897533 >> v2:172.21.15.179:3300/0 conn(0x7f7af81578b0 0x7f7af8155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:48.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.691+0000 7f7af6d9d700 1 -- 172.21.15.71:0/1456897533 >> v1:172.21.15.179:6789/0 conn(0x7f7af8155c10 legacy=0x7f7af80ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:48.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.691+0000 7f7af6d9d700 1 -- 172.21.15.71:0/1456897533 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af80ad000 con 0x7f7af80af2f0 2023-10-09T06:42:48.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.691+0000 7f7af5d9b700 1 --2- 172.21.15.71:0/1456897533 >> v2:172.21.15.179:3300/0 conn(0x7f7af81578b0 0x7f7af8155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:42:48.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.692+0000 7f7af6d9d700 1 --2- 172.21.15.71:0/1456897533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7af80af2f0 0x7f7af80af730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7af0009e60 tx=0x7f7af0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d50830f5c56f741e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:48.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.692+0000 7f7af559a700 1 -- 172.21.15.71:0/1456897533 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af000e070 con 0x7f7af80af2f0 2023-10-09T06:42:48.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.692+0000 7f7af559a700 1 -- 172.21.15.71:0/1456897533 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af000bab0 con 0x7f7af80af2f0 2023-10-09T06:42:48.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.692+0000 7f7af559a700 1 -- 172.21.15.71:0/1456897533 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af000be70 con 0x7f7af80af2f0 2023-10-09T06:42:48.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.692+0000 7f7afcfff700 1 -- 172.21.15.71:0/1456897533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7af80af2f0 msgr2=0x7f7af80af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:48.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.692+0000 7f7afcfff700 1 --2- 172.21.15.71:0/1456897533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7af80af2f0 0x7f7af80af730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7af0009e60 tx=0x7f7af0009780 comp rx=0 tx=0).stop 2023-10-09T06:42:48.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.692+0000 7f7afcfff700 1 -- 172.21.15.71:0/1456897533 shutdown_connections 2023-10-09T06:42:48.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.692+0000 7f7afcfff700 1 --2- 172.21.15.71:0/1456897533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7af80af2f0 0x7f7af80af730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:48.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.692+0000 7f7afcfff700 1 --2- 172.21.15.71:0/1456897533 >> v2:172.21.15.179:3300/0 conn(0x7f7af81578b0 0x7f7af8155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:48.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.692+0000 7f7afcfff700 1 -- 172.21.15.71:0/1456897533 >> 172.21.15.71:0/1456897533 conn(0x7f7af806a320 msgr2=0x7f7af80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:48.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.693+0000 7f7afcfff700 1 -- 172.21.15.71:0/1456897533 shutdown_connections 2023-10-09T06:42:48.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.693+0000 7f7afcfff700 1 -- 172.21.15.71:0/1456897533 wait complete. 2023-10-09T06:42:48.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.694+0000 7f7afcfff700 1 Processor -- start 2023-10-09T06:42:48.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.694+0000 7f7afcfff700 1 -- start start 2023-10-09T06:42:48.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.695+0000 7f7afcfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7af80af2f0 0x7f7af814e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:48.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.695+0000 7f7afcfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7af8155c10 0x7f7af80a6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:48.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.695+0000 7f7afcfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7af81578b0 0x7f7af80a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:48.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.695+0000 7f7afcfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af80a6ab0 con 0x7f7af8155c10 2023-10-09T06:42:48.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.695+0000 7f7afcfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af80a5ea0 con 0x7f7af80af2f0 2023-10-09T06:42:48.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.695+0000 7f7afcfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af80a6180 con 0x7f7af81578b0 2023-10-09T06:42:48.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.695+0000 7f7af5d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7af8155c10 0x7f7af80a6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:48.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.695+0000 7f7af5d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7af8155c10 0x7f7af80a6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52330/0 (socket says 172.21.15.71:52330) 2023-10-09T06:42:48.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.695+0000 7f7af5d9b700 1 -- 172.21.15.71:0/1401042434 learned_addr learned my addr 172.21.15.71:0/1401042434 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:48.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.695+0000 7f7af659c700 1 --2- 172.21.15.71:0/1401042434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7af80af2f0 0x7f7af814e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:48.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.695+0000 7f7af6d9d700 1 --2- 172.21.15.71:0/1401042434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7af81578b0 0x7f7af80a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:48.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.696+0000 7f7af5d9b700 1 -- 172.21.15.71:0/1401042434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7af81578b0 msgr2=0x7f7af80a54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:48.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.696+0000 7f7af5d9b700 1 --2- 172.21.15.71:0/1401042434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7af81578b0 0x7f7af80a54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:48.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.696+0000 7f7af5d9b700 1 -- 172.21.15.71:0/1401042434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7af80af2f0 msgr2=0x7f7af814e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:48.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.696+0000 7f7af5d9b700 1 --2- 172.21.15.71:0/1401042434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7af80af2f0 0x7f7af814e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:48.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.696+0000 7f7af5d9b700 1 -- 172.21.15.71:0/1401042434 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aec00b780 con 0x7f7af8155c10 2023-10-09T06:42:48.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.696+0000 7f7af6d9d700 1 --2- 172.21.15.71:0/1401042434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7af81578b0 0x7f7af80a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:48.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.696+0000 7f7af5d9b700 1 --2- 172.21.15.71:0/1401042434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7af8155c10 0x7f7af80a6f40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7aec00de50 tx=0x7f7aec00f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:48.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.696+0000 7f7ae67fc700 1 -- 172.21.15.71:0/1401042434 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aec009bb0 con 0x7f7af8155c10 2023-10-09T06:42:48.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.696+0000 7f7ae67fc700 1 -- 172.21.15.71:0/1401042434 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aec009d10 con 0x7f7af8155c10 2023-10-09T06:42:48.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.696+0000 7f7ae67fc700 1 -- 172.21.15.71:0/1401042434 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aec017620 con 0x7f7af8155c10 2023-10-09T06:42:48.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.696+0000 7f7afcfff700 1 -- 172.21.15.71:0/1401042434 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af0009a20 con 0x7f7af8155c10 2023-10-09T06:42:48.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.696+0000 7f7afcfff700 1 -- 172.21.15.71:0/1401042434 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af80a6740 con 0x7f7af8155c10 2023-10-09T06:42:48.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.697+0000 7f7afcfff700 1 -- 172.21.15.71:0/1401042434 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af804c3c0 con 0x7f7af8155c10 2023-10-09T06:42:48.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.698+0000 7f7ae67fc700 1 -- 172.21.15.71:0/1401042434 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7aec0179d0 con 0x7f7af8155c10 2023-10-09T06:42:48.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.699+0000 7f7ae67fc700 1 --2- 172.21.15.71:0/1401042434 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ad8066f30 0x7f7ad80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:48.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.700+0000 7f7ae67fc700 1 -- 172.21.15.71:0/1401042434 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7aec084920 con 0x7f7af8155c10 2023-10-09T06:42:48.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.700+0000 7f7af659c700 1 --2- 172.21.15.71:0/1401042434 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ad8066f30 0x7f7ad80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:48.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.701+0000 7f7af659c700 1 --2- 172.21.15.71:0/1401042434 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ad8066f30 0x7f7ad80693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8007fd0 tx=0x7f7ae8007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:48.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.704+0000 7f7ae67fc700 1 -- 172.21.15.71:0/1401042434 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7aec051b90 con 0x7f7af8155c10 2023-10-09T06:42:48.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.888+0000 7f7afcfff700 1 -- 172.21.15.71:0/1401042434 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7af80a6bf0 con 0x7f7ad8066f30 2023-10-09T06:42:48.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.897+0000 7f7ae67fc700 1 -- 172.21.15.71:0/1401042434 <== mgr.4102 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264512 (secure 0 0 0) 0x7f7af80a6bf0 con 0x7f7ad8066f30 2023-10-09T06:42:48.901 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:42:48.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.901+0000 7f7afcfff700 1 -- 172.21.15.71:0/1401042434 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ad8066f30 msgr2=0x7f7ad80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:48.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.901+0000 7f7afcfff700 1 --2- 172.21.15.71:0/1401042434 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ad8066f30 0x7f7ad80693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8007fd0 tx=0x7f7ae8007d50 comp rx=0 tx=0).stop 2023-10-09T06:42:48.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.901+0000 7f7afcfff700 1 -- 172.21.15.71:0/1401042434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7af8155c10 msgr2=0x7f7af80a6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:48.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.901+0000 7f7afcfff700 1 --2- 172.21.15.71:0/1401042434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7af8155c10 0x7f7af80a6f40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7aec00de50 tx=0x7f7aec00f040 comp rx=0 tx=0).stop 2023-10-09T06:42:48.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.901+0000 7f7afcfff700 1 -- 172.21.15.71:0/1401042434 shutdown_connections 2023-10-09T06:42:48.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.901+0000 7f7afcfff700 1 --2- 172.21.15.71:0/1401042434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7af81578b0 0x7f7af80a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:48.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.901+0000 7f7afcfff700 1 --2- 172.21.15.71:0/1401042434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7af80af2f0 0x7f7af814e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:48.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.901+0000 7f7afcfff700 1 --2- 172.21.15.71:0/1401042434 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ad8066f30 0x7f7ad80693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:48.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.901+0000 7f7afcfff700 1 --2- 172.21.15.71:0/1401042434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7af8155c10 0x7f7af80a6f40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:48.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.901+0000 7f7afcfff700 1 -- 172.21.15.71:0/1401042434 >> 172.21.15.71:0/1401042434 conn(0x7f7af806a320 msgr2=0x7f7af8154ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:48.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.901+0000 7f7afcfff700 1 -- 172.21.15.71:0/1401042434 shutdown_connections 2023-10-09T06:42:48.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:48.901+0000 7f7afcfff700 1 -- 172.21.15.71:0/1401042434 wait complete. 2023-10-09T06:42:48.904 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:42:48.919 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-09T06:42:48.547289+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381128,"kb_used_data":2824,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593592,"statfs":{"total":773094113280,"available":770655838208,"internally_reserved":0,"allocated":2891776,"data_stored":1750580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.000057"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.577185+0000","last_change":"2023-10-09T06:42:38.575641+0000","last_active":"2023-10-09T06:42:38.577185+0000","last_peered":"2023-10-09T06:42:38.577185+0000","last_clean":"2023-10-09T06:42:38.577185+0000","last_became_active":"2023-10-09T06:42:38.575375+0000","last_became_peered":"2023-10-09T06:42:38.575375+0000","last_unstale":"2023-10-09T06:42:38.577185+0000","last_undegraded":"2023-10-09T06:42:38.577185+0000","last_fullsized":"2023-10-09T06:42:38.577185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:07.557629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.563008+0000","last_change":"2023-10-09T06:42:38.559528+0000","last_active":"2023-10-09T06:42:38.563008+0000","last_peered":"2023-10-09T06:42:38.563008+0000","last_clean":"2023-10-09T06:42:38.563008+0000","last_became_active":"2023-10-09T06:42:38.559281+0000","last_became_peered":"2023-10-09T06:42:38.559281+0000","last_unstale":"2023-10-09T06:42:38.563008+0000","last_undegraded":"2023-10-09T06:42:38.563008+0000","last_fullsized":"2023-10-09T06:42:38.563008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:33.081210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.564926+0000","last_change":"2023-10-09T06:42:38.560485+0000","last_active":"2023-10-09T06:42:38.564926+0000","last_peered":"2023-10-09T06:42:38.564926+0000","last_clean":"2023-10-09T06:42:38.564926+0000","last_became_active":"2023-10-09T06:42:38.560196+0000","last_became_peered":"2023-10-09T06:42:38.560196+0000","last_unstale":"2023-10-09T06:42:38.564926+0000","last_undegraded":"2023-10-09T06:42:38.564926+0000","last_fullsized":"2023-10-09T06:42:38.564926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:35:09.230725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.577325+0000","last_change":"2023-10-09T06:42:38.563950+0000","last_active":"2023-10-09T06:42:38.577325+0000","last_peered":"2023-10-09T06:42:38.577325+0000","last_clean":"2023-10-09T06:42:38.577325+0000","last_became_active":"2023-10-09T06:42:38.563426+0000","last_became_peered":"2023-10-09T06:42:38.563426+0000","last_unstale":"2023-10-09T06:42:38.577325+0000","last_undegraded":"2023-10-09T06:42:38.577325+0000","last_fullsized":"2023-10-09T06:42:38.577325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:40.455468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.575267+0000","last_change":"2023-10-09T06:42:38.569136+0000","last_active":"2023-10-09T06:42:38.575267+0000","last_peered":"2023-10-09T06:42:38.575267+0000","last_clean":"2023-10-09T06:42:38.575267+0000","last_became_active":"2023-10-09T06:42:38.568819+0000","last_became_peered":"2023-10-09T06:42:38.568819+0000","last_unstale":"2023-10-09T06:42:38.575267+0000","last_undegraded":"2023-10-09T06:42:38.575267+0000","last_fullsized":"2023-10-09T06:42:38.575267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:45.260995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578720+0000","last_change":"2023-10-09T06:42:38.569499+0000","last_active":"2023-10-09T06:42:38.578720+0000","last_peered":"2023-10-09T06:42:38.578720+0000","last_clean":"2023-10-09T06:42:38.578720+0000","last_became_active":"2023-10-09T06:42:38.569273+0000","last_became_peered":"2023-10-09T06:42:38.569273+0000","last_unstale":"2023-10-09T06:42:38.578720+0000","last_undegraded":"2023-10-09T06:42:38.578720+0000","last_fullsized":"2023-10-09T06:42:38.578720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:30.124382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.568498+0000","last_change":"2023-10-09T06:42:38.563449+0000","last_active":"2023-10-09T06:42:38.568498+0000","last_peered":"2023-10-09T06:42:38.568498+0000","last_clean":"2023-10-09T06:42:38.568498+0000","last_became_active":"2023-10-09T06:42:38.563177+0000","last_became_peered":"2023-10-09T06:42:38.563177+0000","last_unstale":"2023-10-09T06:42:38.568498+0000","last_undegraded":"2023-10-09T06:42:38.568498+0000","last_fullsized":"2023-10-09T06:42:38.568498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:30.124382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581576+0000","last_change":"2023-10-09T06:42:38.577903+0000","last_active":"2023-10-09T06:42:38.581576+0000","last_peered":"2023-10-09T06:42:38.581576+0000","last_clean":"2023-10-09T06:42:38.581576+0000","last_became_active":"2023-10-09T06:42:38.577678+0000","last_became_peered":"2023-10-09T06:42:38.577678+0000","last_unstale":"2023-10-09T06:42:38.581576+0000","last_undegraded":"2023-10-09T06:42:38.581576+0000","last_fullsized":"2023-10-09T06:42:38.581576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:21.009791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.584331+0000","last_change":"2023-10-09T06:42:38.579587+0000","last_active":"2023-10-09T06:42:38.584331+0000","last_peered":"2023-10-09T06:42:38.584331+0000","last_clean":"2023-10-09T06:42:38.584331+0000","last_became_active":"2023-10-09T06:42:38.579323+0000","last_became_peered":"2023-10-09T06:42:38.579323+0000","last_unstale":"2023-10-09T06:42:38.584331+0000","last_undegraded":"2023-10-09T06:42:38.584331+0000","last_fullsized":"2023-10-09T06:42:38.584331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:01:38.384294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581576+0000","last_change":"2023-10-09T06:42:38.579931+0000","last_active":"2023-10-09T06:42:38.581576+0000","last_peered":"2023-10-09T06:42:38.581576+0000","last_clean":"2023-10-09T06:42:38.581576+0000","last_became_active":"2023-10-09T06:42:38.579558+0000","last_became_peered":"2023-10-09T06:42:38.579558+0000","last_unstale":"2023-10-09T06:42:38.581576+0000","last_undegraded":"2023-10-09T06:42:38.581576+0000","last_fullsized":"2023-10-09T06:42:38.581576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:12:51.397981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581524+0000","last_change":"2023-10-09T06:42:38.579020+0000","last_active":"2023-10-09T06:42:38.581524+0000","last_peered":"2023-10-09T06:42:38.581524+0000","last_clean":"2023-10-09T06:42:38.581524+0000","last_became_active":"2023-10-09T06:42:38.578750+0000","last_became_peered":"2023-10-09T06:42:38.578750+0000","last_unstale":"2023-10-09T06:42:38.581524+0000","last_undegraded":"2023-10-09T06:42:38.581524+0000","last_fullsized":"2023-10-09T06:42:38.581524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:09.752553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.569984+0000","last_change":"2023-10-09T06:42:38.569028+0000","last_active":"2023-10-09T06:42:38.569984+0000","last_peered":"2023-10-09T06:42:38.569984+0000","last_clean":"2023-10-09T06:42:38.569984+0000","last_became_active":"2023-10-09T06:42:38.568700+0000","last_became_peered":"2023-10-09T06:42:38.568700+0000","last_unstale":"2023-10-09T06:42:38.569984+0000","last_undegraded":"2023-10-09T06:42:38.569984+0000","last_fullsized":"2023-10-09T06:42:38.569984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:28.626444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.573134+0000","last_change":"2023-10-09T06:42:38.570156+0000","last_active":"2023-10-09T06:42:38.573134+0000","last_peered":"2023-10-09T06:42:38.573134+0000","last_clean":"2023-10-09T06:42:38.573134+0000","last_became_active":"2023-10-09T06:42:38.569850+0000","last_became_peered":"2023-10-09T06:42:38.569850+0000","last_unstale":"2023-10-09T06:42:38.573134+0000","last_undegraded":"2023-10-09T06:42:38.573134+0000","last_fullsized":"2023-10-09T06:42:38.573134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:12:51.397981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.572785+0000","last_change":"2023-10-09T06:42:38.567093+0000","last_active":"2023-10-09T06:42:38.572785+0000","last_peered":"2023-10-09T06:42:38.572785+0000","last_clean":"2023-10-09T06:42:38.572785+0000","last_became_active":"2023-10-09T06:42:38.566754+0000","last_became_peered":"2023-10-09T06:42:38.566754+0000","last_unstale":"2023-10-09T06:42:38.572785+0000","last_undegraded":"2023-10-09T06:42:38.572785+0000","last_fullsized":"2023-10-09T06:42:38.572785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:52.216260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570209+0000","last_change":"2023-10-09T06:42:38.569052+0000","last_active":"2023-10-09T06:42:38.570209+0000","last_peered":"2023-10-09T06:42:38.570209+0000","last_clean":"2023-10-09T06:42:38.570209+0000","last_became_active":"2023-10-09T06:42:38.568464+0000","last_became_peered":"2023-10-09T06:42:38.568464+0000","last_unstale":"2023-10-09T06:42:38.570209+0000","last_undegraded":"2023-10-09T06:42:38.570209+0000","last_fullsized":"2023-10-09T06:42:38.570209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:09.752553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578790+0000","last_change":"2023-10-09T06:42:38.572741+0000","last_active":"2023-10-09T06:42:38.578790+0000","last_peered":"2023-10-09T06:42:38.578790+0000","last_clean":"2023-10-09T06:42:38.578790+0000","last_became_active":"2023-10-09T06:42:38.572442+0000","last_became_peered":"2023-10-09T06:42:38.572442+0000","last_unstale":"2023-10-09T06:42:38.578790+0000","last_undegraded":"2023-10-09T06:42:38.578790+0000","last_fullsized":"2023-10-09T06:42:38.578790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:39.013974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581431+0000","last_change":"2023-10-09T06:42:38.577189+0000","last_active":"2023-10-09T06:42:38.581431+0000","last_peered":"2023-10-09T06:42:38.581431+0000","last_clean":"2023-10-09T06:42:38.581431+0000","last_became_active":"2023-10-09T06:42:38.576869+0000","last_became_peered":"2023-10-09T06:42:38.576869+0000","last_unstale":"2023-10-09T06:42:38.581431+0000","last_undegraded":"2023-10-09T06:42:38.581431+0000","last_fullsized":"2023-10-09T06:42:38.581431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:52:15.589759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570197+0000","last_change":"2023-10-09T06:42:38.566807+0000","last_active":"2023-10-09T06:42:38.570197+0000","last_peered":"2023-10-09T06:42:38.570197+0000","last_clean":"2023-10-09T06:42:38.570197+0000","last_became_active":"2023-10-09T06:42:38.566406+0000","last_became_peered":"2023-10-09T06:42:38.566406+0000","last_unstale":"2023-10-09T06:42:38.570197+0000","last_undegraded":"2023-10-09T06:42:38.570197+0000","last_fullsized":"2023-10-09T06:42:38.570197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:28.626444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.568562+0000","last_change":"2023-10-09T06:42:38.562250+0000","last_active":"2023-10-09T06:42:38.568562+0000","last_peered":"2023-10-09T06:42:38.568562+0000","last_clean":"2023-10-09T06:42:38.568562+0000","last_became_active":"2023-10-09T06:42:38.561988+0000","last_became_peered":"2023-10-09T06:42:38.561988+0000","last_unstale":"2023-10-09T06:42:38.568562+0000","last_undegraded":"2023-10-09T06:42:38.568562+0000","last_fullsized":"2023-10-09T06:42:38.568562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:39.013974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.646183+0000","last_change":"2023-10-09T06:42:37.642781+0000","last_active":"2023-10-09T06:42:38.646183+0000","last_peered":"2023-10-09T06:42:38.646183+0000","last_clean":"2023-10-09T06:42:38.646183+0000","last_became_active":"2023-10-09T06:42:37.642471+0000","last_became_peered":"2023-10-09T06:42:37.642471+0000","last_unstale":"2023-10-09T06:42:38.646183+0000","last_undegraded":"2023-10-09T06:42:38.646183+0000","last_fullsized":"2023-10-09T06:42:38.646183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:05:08.035245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570629+0000","last_change":"2023-10-09T06:42:38.566995+0000","last_active":"2023-10-09T06:42:38.570629+0000","last_peered":"2023-10-09T06:42:38.570629+0000","last_clean":"2023-10-09T06:42:38.570629+0000","last_became_active":"2023-10-09T06:42:38.566465+0000","last_became_peered":"2023-10-09T06:42:38.566465+0000","last_unstale":"2023-10-09T06:42:38.570629+0000","last_undegraded":"2023-10-09T06:42:38.570629+0000","last_fullsized":"2023-10-09T06:42:38.570629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:37:48.391850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.649735+0000","last_change":"2023-10-09T06:42:37.639809+0000","last_active":"2023-10-09T06:42:38.649735+0000","last_peered":"2023-10-09T06:42:38.649735+0000","last_clean":"2023-10-09T06:42:38.649735+0000","last_became_active":"2023-10-09T06:42:37.639544+0000","last_became_peered":"2023-10-09T06:42:37.639544+0000","last_unstale":"2023-10-09T06:42:38.649735+0000","last_undegraded":"2023-10-09T06:42:38.649735+0000","last_fullsized":"2023-10-09T06:42:38.649735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:20:06.272193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.582029+0000","last_change":"2023-10-09T06:42:38.579122+0000","last_active":"2023-10-09T06:42:38.582029+0000","last_peered":"2023-10-09T06:42:38.582029+0000","last_clean":"2023-10-09T06:42:38.582029+0000","last_became_active":"2023-10-09T06:42:38.578579+0000","last_became_peered":"2023-10-09T06:42:38.578579+0000","last_unstale":"2023-10-09T06:42:38.582029+0000","last_undegraded":"2023-10-09T06:42:38.582029+0000","last_fullsized":"2023-10-09T06:42:38.582029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:09.752553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.640061+0000","last_change":"2023-10-09T06:42:37.639115+0000","last_active":"2023-10-09T06:42:38.640061+0000","last_peered":"2023-10-09T06:42:38.640061+0000","last_clean":"2023-10-09T06:42:38.640061+0000","last_became_active":"2023-10-09T06:42:37.638883+0000","last_became_peered":"2023-10-09T06:42:37.638883+0000","last_unstale":"2023-10-09T06:42:38.640061+0000","last_undegraded":"2023-10-09T06:42:38.640061+0000","last_fullsized":"2023-10-09T06:42:38.640061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:00.278956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.576787+0000","last_change":"2023-10-09T06:42:38.556216+0000","last_active":"2023-10-09T06:42:38.576787+0000","last_peered":"2023-10-09T06:42:38.576787+0000","last_clean":"2023-10-09T06:42:38.576787+0000","last_became_active":"2023-10-09T06:42:38.555948+0000","last_became_peered":"2023-10-09T06:42:38.555948+0000","last_unstale":"2023-10-09T06:42:38.576787+0000","last_undegraded":"2023-10-09T06:42:38.576787+0000","last_fullsized":"2023-10-09T06:42:38.576787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:07.557629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.639343+0000","last_change":"2023-10-09T06:42:37.645201+0000","last_active":"2023-10-09T06:42:38.639343+0000","last_peered":"2023-10-09T06:42:38.639343+0000","last_clean":"2023-10-09T06:42:38.639343+0000","last_became_active":"2023-10-09T06:42:37.644809+0000","last_became_peered":"2023-10-09T06:42:37.644809+0000","last_unstale":"2023-10-09T06:42:38.639343+0000","last_undegraded":"2023-10-09T06:42:38.639343+0000","last_fullsized":"2023-10-09T06:42:38.639343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:24.163542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.577053+0000","last_change":"2023-10-09T06:42:38.562628+0000","last_active":"2023-10-09T06:42:38.577053+0000","last_peered":"2023-10-09T06:42:38.577053+0000","last_clean":"2023-10-09T06:42:38.577053+0000","last_became_active":"2023-10-09T06:42:38.559604+0000","last_became_peered":"2023-10-09T06:42:38.559604+0000","last_unstale":"2023-10-09T06:42:38.577053+0000","last_undegraded":"2023-10-09T06:42:38.577053+0000","last_fullsized":"2023-10-09T06:42:38.577053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:37:48.391850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.647992+0000","last_change":"2023-10-09T06:42:37.636915+0000","last_active":"2023-10-09T06:42:38.647992+0000","last_peered":"2023-10-09T06:42:38.647992+0000","last_clean":"2023-10-09T06:42:38.647992+0000","last_became_active":"2023-10-09T06:42:37.635860+0000","last_became_peered":"2023-10-09T06:42:37.635860+0000","last_unstale":"2023-10-09T06:42:38.647992+0000","last_undegraded":"2023-10-09T06:42:38.647992+0000","last_fullsized":"2023-10-09T06:42:38.647992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:37:09.158328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.574981+0000","last_change":"2023-10-09T06:42:38.569866+0000","last_active":"2023-10-09T06:42:38.574981+0000","last_peered":"2023-10-09T06:42:38.574981+0000","last_clean":"2023-10-09T06:42:38.574981+0000","last_became_active":"2023-10-09T06:42:38.569553+0000","last_became_peered":"2023-10-09T06:42:38.569553+0000","last_unstale":"2023-10-09T06:42:38.574981+0000","last_undegraded":"2023-10-09T06:42:38.574981+0000","last_fullsized":"2023-10-09T06:42:38.574981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:21:05.708304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.645604+0000","last_change":"2023-10-09T06:42:37.633709+0000","last_active":"2023-10-09T06:42:38.645604+0000","last_peered":"2023-10-09T06:42:38.645604+0000","last_clean":"2023-10-09T06:42:38.645604+0000","last_became_active":"2023-10-09T06:42:37.633130+0000","last_became_peered":"2023-10-09T06:42:37.633130+0000","last_unstale":"2023-10-09T06:42:38.645604+0000","last_undegraded":"2023-10-09T06:42:38.645604+0000","last_fullsized":"2023-10-09T06:42:38.645604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:37:09.158328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.565018+0000","last_change":"2023-10-09T06:42:38.559125+0000","last_active":"2023-10-09T06:42:38.565018+0000","last_peered":"2023-10-09T06:42:38.565018+0000","last_clean":"2023-10-09T06:42:38.565018+0000","last_became_active":"2023-10-09T06:42:38.558844+0000","last_became_peered":"2023-10-09T06:42:38.558844+0000","last_unstale":"2023-10-09T06:42:38.565018+0000","last_undegraded":"2023-10-09T06:42:38.565018+0000","last_fullsized":"2023-10-09T06:42:38.565018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:12:51.397981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.555859+0000","last_change":"2023-10-09T06:42:37.637810+0000","last_active":"2023-10-09T06:42:38.555859+0000","last_peered":"2023-10-09T06:42:38.555859+0000","last_clean":"2023-10-09T06:42:38.555859+0000","last_became_active":"2023-10-09T06:42:37.637502+0000","last_became_peered":"2023-10-09T06:42:37.637502+0000","last_unstale":"2023-10-09T06:42:38.555859+0000","last_undegraded":"2023-10-09T06:42:38.555859+0000","last_fullsized":"2023-10-09T06:42:38.555859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:35.971277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570842+0000","last_change":"2023-10-09T06:42:38.568118+0000","last_active":"2023-10-09T06:42:38.570842+0000","last_peered":"2023-10-09T06:42:38.570842+0000","last_clean":"2023-10-09T06:42:38.570842+0000","last_became_active":"2023-10-09T06:42:38.567829+0000","last_became_peered":"2023-10-09T06:42:38.567829+0000","last_unstale":"2023-10-09T06:42:38.570842+0000","last_undegraded":"2023-10-09T06:42:38.570842+0000","last_fullsized":"2023-10-09T06:42:38.570842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:40.455468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.550527+0000","last_change":"2023-10-09T06:42:37.630311+0000","last_active":"2023-10-09T06:42:38.550527+0000","last_peered":"2023-10-09T06:42:38.550527+0000","last_clean":"2023-10-09T06:42:38.550527+0000","last_became_active":"2023-10-09T06:42:37.629826+0000","last_became_peered":"2023-10-09T06:42:37.629826+0000","last_unstale":"2023-10-09T06:42:38.550527+0000","last_undegraded":"2023-10-09T06:42:38.550527+0000","last_fullsized":"2023-10-09T06:42:38.550527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:35.971277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570137+0000","last_change":"2023-10-09T06:42:38.564818+0000","last_active":"2023-10-09T06:42:38.570137+0000","last_peered":"2023-10-09T06:42:38.570137+0000","last_clean":"2023-10-09T06:42:38.570137+0000","last_became_active":"2023-10-09T06:42:38.564033+0000","last_became_peered":"2023-10-09T06:42:38.564033+0000","last_unstale":"2023-10-09T06:42:38.570137+0000","last_undegraded":"2023-10-09T06:42:38.570137+0000","last_fullsized":"2023-10-09T06:42:38.570137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:47.620309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.561468+0000","last_change":"2023-10-09T06:42:37.639202+0000","last_active":"2023-10-09T06:42:38.561468+0000","last_peered":"2023-10-09T06:42:38.561468+0000","last_clean":"2023-10-09T06:42:38.561468+0000","last_became_active":"2023-10-09T06:42:37.638949+0000","last_became_peered":"2023-10-09T06:42:37.638949+0000","last_unstale":"2023-10-09T06:42:38.561468+0000","last_undegraded":"2023-10-09T06:42:38.561468+0000","last_fullsized":"2023-10-09T06:42:38.561468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:04:15.833968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578657+0000","last_change":"2023-10-09T06:42:38.576519+0000","last_active":"2023-10-09T06:42:38.578657+0000","last_peered":"2023-10-09T06:42:38.578657+0000","last_clean":"2023-10-09T06:42:38.578657+0000","last_became_active":"2023-10-09T06:42:38.574470+0000","last_became_peered":"2023-10-09T06:42:38.574470+0000","last_unstale":"2023-10-09T06:42:38.578657+0000","last_undegraded":"2023-10-09T06:42:38.578657+0000","last_fullsized":"2023-10-09T06:42:38.578657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:58.690094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.551196+0000","last_change":"2023-10-09T06:42:37.638178+0000","last_active":"2023-10-09T06:42:38.551196+0000","last_peered":"2023-10-09T06:42:38.551196+0000","last_clean":"2023-10-09T06:42:38.551196+0000","last_became_active":"2023-10-09T06:42:37.636993+0000","last_became_peered":"2023-10-09T06:42:37.636993+0000","last_unstale":"2023-10-09T06:42:38.551196+0000","last_undegraded":"2023-10-09T06:42:38.551196+0000","last_fullsized":"2023-10-09T06:42:38.551196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:52.698626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581385+0000","last_change":"2023-10-09T06:42:38.578851+0000","last_active":"2023-10-09T06:42:38.581385+0000","last_peered":"2023-10-09T06:42:38.581385+0000","last_clean":"2023-10-09T06:42:38.581385+0000","last_became_active":"2023-10-09T06:42:38.578545+0000","last_became_peered":"2023-10-09T06:42:38.578545+0000","last_unstale":"2023-10-09T06:42:38.581385+0000","last_undegraded":"2023-10-09T06:42:38.581385+0000","last_fullsized":"2023-10-09T06:42:38.581385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:47.620309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.647140+0000","last_change":"2023-10-09T06:42:37.641427+0000","last_active":"2023-10-09T06:42:38.647140+0000","last_peered":"2023-10-09T06:42:38.647140+0000","last_clean":"2023-10-09T06:42:38.647140+0000","last_became_active":"2023-10-09T06:42:37.640279+0000","last_became_peered":"2023-10-09T06:42:37.640279+0000","last_unstale":"2023-10-09T06:42:38.647140+0000","last_undegraded":"2023-10-09T06:42:38.647140+0000","last_fullsized":"2023-10-09T06:42:38.647140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:24.163542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.569145+0000","last_change":"2023-10-09T06:42:38.567036+0000","last_active":"2023-10-09T06:42:38.569145+0000","last_peered":"2023-10-09T06:42:38.569145+0000","last_clean":"2023-10-09T06:42:38.569145+0000","last_became_active":"2023-10-09T06:42:38.566747+0000","last_became_peered":"2023-10-09T06:42:38.566747+0000","last_unstale":"2023-10-09T06:42:38.569145+0000","last_undegraded":"2023-10-09T06:42:38.569145+0000","last_fullsized":"2023-10-09T06:42:38.569145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:54:35.039738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.650427+0000","last_change":"2023-10-09T06:42:37.640729+0000","last_active":"2023-10-09T06:42:38.650427+0000","last_peered":"2023-10-09T06:42:38.650427+0000","last_clean":"2023-10-09T06:42:38.650427+0000","last_became_active":"2023-10-09T06:42:37.640292+0000","last_became_peered":"2023-10-09T06:42:37.640292+0000","last_unstale":"2023-10-09T06:42:38.650427+0000","last_undegraded":"2023-10-09T06:42:38.650427+0000","last_fullsized":"2023-10-09T06:42:38.650427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:35.971277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.568584+0000","last_change":"2023-10-09T06:42:38.563617+0000","last_active":"2023-10-09T06:42:38.568584+0000","last_peered":"2023-10-09T06:42:38.568584+0000","last_clean":"2023-10-09T06:42:38.568584+0000","last_became_active":"2023-10-09T06:42:38.563354+0000","last_became_peered":"2023-10-09T06:42:38.563354+0000","last_unstale":"2023-10-09T06:42:38.568584+0000","last_undegraded":"2023-10-09T06:42:38.568584+0000","last_fullsized":"2023-10-09T06:42:38.568584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:37:48.391850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.641288+0000","last_change":"2023-10-09T06:42:37.640446+0000","last_active":"2023-10-09T06:42:38.641288+0000","last_peered":"2023-10-09T06:42:38.641288+0000","last_clean":"2023-10-09T06:42:38.641288+0000","last_became_active":"2023-10-09T06:42:37.640147+0000","last_became_peered":"2023-10-09T06:42:37.640147+0000","last_unstale":"2023-10-09T06:42:38.641288+0000","last_undegraded":"2023-10-09T06:42:38.641288+0000","last_fullsized":"2023-10-09T06:42:38.641288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:39.606272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.566333+0000","last_change":"2023-10-09T06:42:38.562201+0000","last_active":"2023-10-09T06:42:38.566333+0000","last_peered":"2023-10-09T06:42:38.566333+0000","last_clean":"2023-10-09T06:42:38.566333+0000","last_became_active":"2023-10-09T06:42:38.561906+0000","last_became_peered":"2023-10-09T06:42:38.561906+0000","last_unstale":"2023-10-09T06:42:38.566333+0000","last_undegraded":"2023-10-09T06:42:38.566333+0000","last_fullsized":"2023-10-09T06:42:38.566333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:33.081210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.554492+0000","last_change":"2023-10-09T06:42:37.633895+0000","last_active":"2023-10-09T06:42:38.554492+0000","last_peered":"2023-10-09T06:42:38.554492+0000","last_clean":"2023-10-09T06:42:38.554492+0000","last_became_active":"2023-10-09T06:42:37.633582+0000","last_became_peered":"2023-10-09T06:42:37.633582+0000","last_unstale":"2023-10-09T06:42:38.554492+0000","last_undegraded":"2023-10-09T06:42:38.554492+0000","last_fullsized":"2023-10-09T06:42:38.554492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:37:09.158328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.577139+0000","last_change":"2023-10-09T06:42:38.574732+0000","last_active":"2023-10-09T06:42:38.577139+0000","last_peered":"2023-10-09T06:42:38.577139+0000","last_clean":"2023-10-09T06:42:38.577139+0000","last_became_active":"2023-10-09T06:42:38.574374+0000","last_became_peered":"2023-10-09T06:42:38.574374+0000","last_unstale":"2023-10-09T06:42:38.577139+0000","last_undegraded":"2023-10-09T06:42:38.577139+0000","last_fullsized":"2023-10-09T06:42:38.577139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:58.690094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.561313+0000","last_change":"2023-10-09T06:42:37.634258+0000","last_active":"2023-10-09T06:42:38.561313+0000","last_peered":"2023-10-09T06:42:38.561313+0000","last_clean":"2023-10-09T06:42:38.561313+0000","last_became_active":"2023-10-09T06:42:37.633958+0000","last_became_peered":"2023-10-09T06:42:37.633958+0000","last_unstale":"2023-10-09T06:42:38.561313+0000","last_undegraded":"2023-10-09T06:42:38.561313+0000","last_fullsized":"2023-10-09T06:42:38.561313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:52.698626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.566266+0000","last_change":"2023-10-09T06:42:38.564382+0000","last_active":"2023-10-09T06:42:38.566266+0000","last_peered":"2023-10-09T06:42:38.566266+0000","last_clean":"2023-10-09T06:42:38.566266+0000","last_became_active":"2023-10-09T06:42:38.563827+0000","last_became_peered":"2023-10-09T06:42:38.563827+0000","last_unstale":"2023-10-09T06:42:38.566266+0000","last_undegraded":"2023-10-09T06:42:38.566266+0000","last_fullsized":"2023-10-09T06:42:38.566266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:35:09.230725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.644393+0000","last_change":"2023-10-09T06:42:37.636395+0000","last_active":"2023-10-09T06:42:38.644393+0000","last_peered":"2023-10-09T06:42:38.644393+0000","last_clean":"2023-10-09T06:42:38.644393+0000","last_became_active":"2023-10-09T06:42:37.636040+0000","last_became_peered":"2023-10-09T06:42:37.636040+0000","last_unstale":"2023-10-09T06:42:38.644393+0000","last_undegraded":"2023-10-09T06:42:38.644393+0000","last_fullsized":"2023-10-09T06:42:38.644393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:04:15.833968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.575637+0000","last_change":"2023-10-09T06:42:38.570513+0000","last_active":"2023-10-09T06:42:38.575637+0000","last_peered":"2023-10-09T06:42:38.575637+0000","last_clean":"2023-10-09T06:42:38.575637+0000","last_became_active":"2023-10-09T06:42:38.570219+0000","last_became_peered":"2023-10-09T06:42:38.570219+0000","last_unstale":"2023-10-09T06:42:38.575637+0000","last_undegraded":"2023-10-09T06:42:38.575637+0000","last_fullsized":"2023-10-09T06:42:38.575637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:28:50.048850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.641339+0000","last_change":"2023-10-09T06:42:37.638988+0000","last_active":"2023-10-09T06:42:38.641339+0000","last_peered":"2023-10-09T06:42:38.641339+0000","last_clean":"2023-10-09T06:42:38.641339+0000","last_became_active":"2023-10-09T06:42:37.638699+0000","last_became_peered":"2023-10-09T06:42:37.638699+0000","last_unstale":"2023-10-09T06:42:38.641339+0000","last_undegraded":"2023-10-09T06:42:38.641339+0000","last_fullsized":"2023-10-09T06:42:38.641339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:20:06.272193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.575426+0000","last_change":"2023-10-09T06:42:38.569837+0000","last_active":"2023-10-09T06:42:38.575426+0000","last_peered":"2023-10-09T06:42:38.575426+0000","last_clean":"2023-10-09T06:42:38.575426+0000","last_became_active":"2023-10-09T06:42:38.569508+0000","last_became_peered":"2023-10-09T06:42:38.569508+0000","last_unstale":"2023-10-09T06:42:38.575426+0000","last_undegraded":"2023-10-09T06:42:38.575426+0000","last_fullsized":"2023-10-09T06:42:38.575426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:40.455468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.556115+0000","last_change":"2023-10-09T06:42:37.641808+0000","last_active":"2023-10-09T06:42:38.556115+0000","last_peered":"2023-10-09T06:42:38.556115+0000","last_clean":"2023-10-09T06:42:38.556115+0000","last_became_active":"2023-10-09T06:42:37.641389+0000","last_became_peered":"2023-10-09T06:42:37.641389+0000","last_unstale":"2023-10-09T06:42:38.556115+0000","last_undegraded":"2023-10-09T06:42:38.556115+0000","last_fullsized":"2023-10-09T06:42:38.556115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:52.698626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578832+0000","last_change":"2023-10-09T06:42:38.568966+0000","last_active":"2023-10-09T06:42:38.578832+0000","last_peered":"2023-10-09T06:42:38.578832+0000","last_clean":"2023-10-09T06:42:38.578832+0000","last_became_active":"2023-10-09T06:42:38.564917+0000","last_became_peered":"2023-10-09T06:42:38.564917+0000","last_unstale":"2023-10-09T06:42:38.578832+0000","last_undegraded":"2023-10-09T06:42:38.578832+0000","last_fullsized":"2023-10-09T06:42:38.578832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:13.371246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.554558+0000","last_change":"2023-10-09T06:42:37.635676+0000","last_active":"2023-10-09T06:42:38.554558+0000","last_peered":"2023-10-09T06:42:38.554558+0000","last_clean":"2023-10-09T06:42:38.554558+0000","last_became_active":"2023-10-09T06:42:37.635365+0000","last_became_peered":"2023-10-09T06:42:37.635365+0000","last_unstale":"2023-10-09T06:42:38.554558+0000","last_undegraded":"2023-10-09T06:42:38.554558+0000","last_fullsized":"2023-10-09T06:42:38.554558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:04:15.833968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.565166+0000","last_change":"2023-10-09T06:42:38.557514+0000","last_active":"2023-10-09T06:42:38.565166+0000","last_peered":"2023-10-09T06:42:38.565166+0000","last_clean":"2023-10-09T06:42:38.565166+0000","last_became_active":"2023-10-09T06:42:38.557194+0000","last_became_peered":"2023-10-09T06:42:38.557194+0000","last_unstale":"2023-10-09T06:42:38.565166+0000","last_undegraded":"2023-10-09T06:42:38.565166+0000","last_fullsized":"2023-10-09T06:42:38.565166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:52.216260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.569358+0000","last_change":"2023-10-09T06:42:38.562852+0000","last_active":"2023-10-09T06:42:38.569358+0000","last_peered":"2023-10-09T06:42:38.569358+0000","last_clean":"2023-10-09T06:42:38.569358+0000","last_became_active":"2023-10-09T06:42:38.562427+0000","last_became_peered":"2023-10-09T06:42:38.562427+0000","last_unstale":"2023-10-09T06:42:38.569358+0000","last_undegraded":"2023-10-09T06:42:38.569358+0000","last_fullsized":"2023-10-09T06:42:38.569358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:54:31.244116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.555131+0000","last_change":"2023-10-09T06:42:37.629265+0000","last_active":"2023-10-09T06:42:38.555131+0000","last_peered":"2023-10-09T06:42:38.555131+0000","last_clean":"2023-10-09T06:42:38.555131+0000","last_became_active":"2023-10-09T06:42:37.628888+0000","last_became_peered":"2023-10-09T06:42:37.628888+0000","last_unstale":"2023-10-09T06:42:38.555131+0000","last_undegraded":"2023-10-09T06:42:38.555131+0000","last_fullsized":"2023-10-09T06:42:38.555131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:37:09.158328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581871+0000","last_change":"2023-10-09T06:42:38.578592+0000","last_active":"2023-10-09T06:42:38.581871+0000","last_peered":"2023-10-09T06:42:38.581871+0000","last_clean":"2023-10-09T06:42:38.581871+0000","last_became_active":"2023-10-09T06:42:38.578331+0000","last_became_peered":"2023-10-09T06:42:38.578331+0000","last_unstale":"2023-10-09T06:42:38.581871+0000","last_undegraded":"2023-10-09T06:42:38.581871+0000","last_fullsized":"2023-10-09T06:42:38.581871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:10.767555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.549764+0000","last_change":"2023-10-09T06:42:37.631298+0000","last_active":"2023-10-09T06:42:38.549764+0000","last_peered":"2023-10-09T06:42:38.549764+0000","last_clean":"2023-10-09T06:42:38.549764+0000","last_became_active":"2023-10-09T06:42:37.631005+0000","last_became_peered":"2023-10-09T06:42:37.631005+0000","last_unstale":"2023-10-09T06:42:38.549764+0000","last_undegraded":"2023-10-09T06:42:38.549764+0000","last_fullsized":"2023-10-09T06:42:38.549764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:24.163542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.556307+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:42:38.556307+0000","last_peered":"2023-10-09T06:42:38.556307+0000","last_clean":"2023-10-09T06:42:38.556307+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:42:38.556307+0000","last_undegraded":"2023-10-09T06:42:38.556307+0000","last_fullsized":"2023-10-09T06:42:38.556307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.564781+0000","last_change":"2023-10-09T06:42:38.559755+0000","last_active":"2023-10-09T06:42:38.564781+0000","last_peered":"2023-10-09T06:42:38.564781+0000","last_clean":"2023-10-09T06:42:38.564781+0000","last_became_active":"2023-10-09T06:42:38.559505+0000","last_became_peered":"2023-10-09T06:42:38.559505+0000","last_unstale":"2023-10-09T06:42:38.564781+0000","last_undegraded":"2023-10-09T06:42:38.564781+0000","last_fullsized":"2023-10-09T06:42:38.564781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:49:10.861117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.556416+0000","last_change":"2023-10-09T06:42:37.643040+0000","last_active":"2023-10-09T06:42:38.556416+0000","last_peered":"2023-10-09T06:42:38.556416+0000","last_clean":"2023-10-09T06:42:38.556416+0000","last_became_active":"2023-10-09T06:42:37.642814+0000","last_became_peered":"2023-10-09T06:42:37.642814+0000","last_unstale":"2023-10-09T06:42:38.556416+0000","last_undegraded":"2023-10-09T06:42:38.556416+0000","last_fullsized":"2023-10-09T06:42:38.556416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:20:06.272193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.557248+0000","last_change":"2023-10-09T06:42:37.642142+0000","last_active":"2023-10-09T06:42:38.557248+0000","last_peered":"2023-10-09T06:42:38.557248+0000","last_clean":"2023-10-09T06:42:38.557248+0000","last_became_active":"2023-10-09T06:42:37.641797+0000","last_became_peered":"2023-10-09T06:42:37.641797+0000","last_unstale":"2023-10-09T06:42:38.557248+0000","last_undegraded":"2023-10-09T06:42:38.557248+0000","last_fullsized":"2023-10-09T06:42:38.557248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:54:34.033416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570074+0000","last_change":"2023-10-09T06:42:38.563528+0000","last_active":"2023-10-09T06:42:38.570074+0000","last_peered":"2023-10-09T06:42:38.570074+0000","last_clean":"2023-10-09T06:42:38.570074+0000","last_became_active":"2023-10-09T06:42:38.563121+0000","last_became_peered":"2023-10-09T06:42:38.563121+0000","last_unstale":"2023-10-09T06:42:38.570074+0000","last_undegraded":"2023-10-09T06:42:38.570074+0000","last_fullsized":"2023-10-09T06:42:38.570074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:13.371246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T06:42:39.554941+0000","last_change":"2023-10-09T06:42:37.641729+0000","last_active":"2023-10-09T06:42:39.554941+0000","last_peered":"2023-10-09T06:42:39.554941+0000","last_clean":"2023-10-09T06:42:39.554941+0000","last_became_active":"2023-10-09T06:42:37.641401+0000","last_became_peered":"2023-10-09T06:42:37.641401+0000","last_unstale":"2023-10-09T06:42:39.554941+0000","last_undegraded":"2023-10-09T06:42:39.554941+0000","last_fullsized":"2023-10-09T06:42:39.554941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:00.278956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.572665+0000","last_change":"2023-10-09T06:42:38.569525+0000","last_active":"2023-10-09T06:42:38.572665+0000","last_peered":"2023-10-09T06:42:38.572665+0000","last_clean":"2023-10-09T06:42:38.572665+0000","last_became_active":"2023-10-09T06:42:38.569071+0000","last_became_peered":"2023-10-09T06:42:38.569071+0000","last_unstale":"2023-10-09T06:42:38.572665+0000","last_undegraded":"2023-10-09T06:42:38.572665+0000","last_fullsized":"2023-10-09T06:42:38.572665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:13.371246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.640292+0000","last_change":"2023-10-09T06:42:37.637774+0000","last_active":"2023-10-09T06:42:38.640292+0000","last_peered":"2023-10-09T06:42:38.640292+0000","last_clean":"2023-10-09T06:42:38.640292+0000","last_became_active":"2023-10-09T06:42:37.637478+0000","last_became_peered":"2023-10-09T06:42:37.637478+0000","last_unstale":"2023-10-09T06:42:38.640292+0000","last_undegraded":"2023-10-09T06:42:38.640292+0000","last_fullsized":"2023-10-09T06:42:38.640292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:24.163542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.564966+0000","last_change":"2023-10-09T06:42:38.562018+0000","last_active":"2023-10-09T06:42:38.564966+0000","last_peered":"2023-10-09T06:42:38.564966+0000","last_clean":"2023-10-09T06:42:38.564966+0000","last_became_active":"2023-10-09T06:42:38.561717+0000","last_became_peered":"2023-10-09T06:42:38.561717+0000","last_unstale":"2023-10-09T06:42:38.564966+0000","last_undegraded":"2023-10-09T06:42:38.564966+0000","last_fullsized":"2023-10-09T06:42:38.564966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:28.626444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.556201+0000","last_change":"2023-10-09T06:42:37.642616+0000","last_active":"2023-10-09T06:42:38.556201+0000","last_peered":"2023-10-09T06:42:38.556201+0000","last_clean":"2023-10-09T06:42:38.556201+0000","last_became_active":"2023-10-09T06:42:37.641865+0000","last_became_peered":"2023-10-09T06:42:37.641865+0000","last_unstale":"2023-10-09T06:42:38.556201+0000","last_undegraded":"2023-10-09T06:42:38.556201+0000","last_fullsized":"2023-10-09T06:42:38.556201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:10.432797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.566828+0000","last_change":"2023-10-09T06:42:38.564540+0000","last_active":"2023-10-09T06:42:38.566828+0000","last_peered":"2023-10-09T06:42:38.566828+0000","last_clean":"2023-10-09T06:42:38.566828+0000","last_became_active":"2023-10-09T06:42:38.564273+0000","last_became_peered":"2023-10-09T06:42:38.564273+0000","last_unstale":"2023-10-09T06:42:38.566828+0000","last_undegraded":"2023-10-09T06:42:38.566828+0000","last_fullsized":"2023-10-09T06:42:38.566828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:01.285278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.556077+0000","last_change":"2023-10-09T06:42:37.635028+0000","last_active":"2023-10-09T06:42:38.556077+0000","last_peered":"2023-10-09T06:42:38.556077+0000","last_clean":"2023-10-09T06:42:38.556077+0000","last_became_active":"2023-10-09T06:42:37.634697+0000","last_became_peered":"2023-10-09T06:42:37.634697+0000","last_unstale":"2023-10-09T06:42:38.556077+0000","last_undegraded":"2023-10-09T06:42:38.556077+0000","last_fullsized":"2023-10-09T06:42:38.556077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:35.971277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.569616+0000","last_change":"2023-10-09T06:42:38.563391+0000","last_active":"2023-10-09T06:42:38.569616+0000","last_peered":"2023-10-09T06:42:38.569616+0000","last_clean":"2023-10-09T06:42:38.569616+0000","last_became_active":"2023-10-09T06:42:38.563055+0000","last_became_peered":"2023-10-09T06:42:38.563055+0000","last_unstale":"2023-10-09T06:42:38.569616+0000","last_undegraded":"2023-10-09T06:42:38.569616+0000","last_fullsized":"2023-10-09T06:42:38.569616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:09.752553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.561304+0000","last_change":"2023-10-09T06:42:37.635284+0000","last_active":"2023-10-09T06:42:38.561304+0000","last_peered":"2023-10-09T06:42:38.561304+0000","last_clean":"2023-10-09T06:42:38.561304+0000","last_became_active":"2023-10-09T06:42:37.633661+0000","last_became_peered":"2023-10-09T06:42:37.633661+0000","last_unstale":"2023-10-09T06:42:38.561304+0000","last_undegraded":"2023-10-09T06:42:38.561304+0000","last_fullsized":"2023-10-09T06:42:38.561304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:04:15.833968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570875+0000","last_change":"2023-10-09T06:42:38.568141+0000","last_active":"2023-10-09T06:42:38.570875+0000","last_peered":"2023-10-09T06:42:38.570875+0000","last_clean":"2023-10-09T06:42:38.570875+0000","last_became_active":"2023-10-09T06:42:38.567842+0000","last_became_peered":"2023-10-09T06:42:38.567842+0000","last_unstale":"2023-10-09T06:42:38.570875+0000","last_undegraded":"2023-10-09T06:42:38.570875+0000","last_fullsized":"2023-10-09T06:42:38.570875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:28:50.048850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.640654+0000","last_change":"2023-10-09T06:42:37.642378+0000","last_active":"2023-10-09T06:42:38.640654+0000","last_peered":"2023-10-09T06:42:38.640654+0000","last_clean":"2023-10-09T06:42:38.640654+0000","last_became_active":"2023-10-09T06:42:37.641825+0000","last_became_peered":"2023-10-09T06:42:37.641825+0000","last_unstale":"2023-10-09T06:42:38.640654+0000","last_undegraded":"2023-10-09T06:42:38.640654+0000","last_fullsized":"2023-10-09T06:42:38.640654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:04:15.833968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.571061+0000","last_change":"2023-10-09T06:42:38.569442+0000","last_active":"2023-10-09T06:42:38.571061+0000","last_peered":"2023-10-09T06:42:38.571061+0000","last_clean":"2023-10-09T06:42:38.571061+0000","last_became_active":"2023-10-09T06:42:38.569154+0000","last_became_peered":"2023-10-09T06:42:38.569154+0000","last_unstale":"2023-10-09T06:42:38.571061+0000","last_undegraded":"2023-10-09T06:42:38.571061+0000","last_fullsized":"2023-10-09T06:42:38.571061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:13.371246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.554960+0000","last_change":"2023-10-09T06:42:37.631048+0000","last_active":"2023-10-09T06:42:38.554960+0000","last_peered":"2023-10-09T06:42:38.554960+0000","last_clean":"2023-10-09T06:42:38.554960+0000","last_became_active":"2023-10-09T06:42:37.630750+0000","last_became_peered":"2023-10-09T06:42:37.630750+0000","last_unstale":"2023-10-09T06:42:38.554960+0000","last_undegraded":"2023-10-09T06:42:38.554960+0000","last_fullsized":"2023-10-09T06:42:38.554960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:35.971277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581777+0000","last_change":"2023-10-09T06:42:38.578335+0000","last_active":"2023-10-09T06:42:38.581777+0000","last_peered":"2023-10-09T06:42:38.581777+0000","last_clean":"2023-10-09T06:42:38.581777+0000","last_became_active":"2023-10-09T06:42:38.578028+0000","last_became_peered":"2023-10-09T06:42:38.578028+0000","last_unstale":"2023-10-09T06:42:38.581777+0000","last_undegraded":"2023-10-09T06:42:38.581777+0000","last_fullsized":"2023-10-09T06:42:38.581777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:21.009791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.647078+0000","last_change":"2023-10-09T06:42:37.634742+0000","last_active":"2023-10-09T06:42:38.647078+0000","last_peered":"2023-10-09T06:42:38.647078+0000","last_clean":"2023-10-09T06:42:38.647078+0000","last_became_active":"2023-10-09T06:42:37.633877+0000","last_became_peered":"2023-10-09T06:42:37.633877+0000","last_unstale":"2023-10-09T06:42:38.647078+0000","last_undegraded":"2023-10-09T06:42:38.647078+0000","last_fullsized":"2023-10-09T06:42:38.647078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:10.432797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.577301+0000","last_change":"2023-10-09T06:42:38.563710+0000","last_active":"2023-10-09T06:42:38.577301+0000","last_peered":"2023-10-09T06:42:38.577301+0000","last_clean":"2023-10-09T06:42:38.577301+0000","last_became_active":"2023-10-09T06:42:38.563052+0000","last_became_peered":"2023-10-09T06:42:38.563052+0000","last_unstale":"2023-10-09T06:42:38.577301+0000","last_undegraded":"2023-10-09T06:42:38.577301+0000","last_fullsized":"2023-10-09T06:42:38.577301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:21.009791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.642089+0000","last_change":"2023-10-09T06:42:37.629716+0000","last_active":"2023-10-09T06:42:38.642089+0000","last_peered":"2023-10-09T06:42:38.642089+0000","last_clean":"2023-10-09T06:42:38.642089+0000","last_became_active":"2023-10-09T06:42:37.629416+0000","last_became_peered":"2023-10-09T06:42:37.629416+0000","last_unstale":"2023-10-09T06:42:38.642089+0000","last_undegraded":"2023-10-09T06:42:38.642089+0000","last_fullsized":"2023-10-09T06:42:38.642089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:36.600957+0000","last_clean_scrub_stamp":"2023-10-09T06:42:36.600957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:52.698626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.576962+0000","last_change":"2023-10-09T06:42:38.571766+0000","last_active":"2023-10-09T06:42:38.576962+0000","last_peered":"2023-10-09T06:42:38.576962+0000","last_clean":"2023-10-09T06:42:38.576962+0000","last_became_active":"2023-10-09T06:42:38.571419+0000","last_became_peered":"2023-10-09T06:42:38.571419+0000","last_unstale":"2023-10-09T06:42:38.576962+0000","last_undegraded":"2023-10-09T06:42:38.576962+0000","last_fullsized":"2023-10-09T06:42:38.576962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:44:36.008678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.566289+0000","last_change":"2023-10-09T06:42:38.564609+0000","last_active":"2023-10-09T06:42:38.566289+0000","last_peered":"2023-10-09T06:42:38.566289+0000","last_clean":"2023-10-09T06:42:38.566289+0000","last_became_active":"2023-10-09T06:42:38.564121+0000","last_became_peered":"2023-10-09T06:42:38.564121+0000","last_unstale":"2023-10-09T06:42:38.566289+0000","last_undegraded":"2023-10-09T06:42:38.566289+0000","last_fullsized":"2023-10-09T06:42:38.566289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:10.767555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.581375+0000","last_change":"2023-10-09T06:42:38.577925+0000","last_active":"2023-10-09T06:42:38.581375+0000","last_peered":"2023-10-09T06:42:38.581375+0000","last_clean":"2023-10-09T06:42:38.581375+0000","last_became_active":"2023-10-09T06:42:38.577659+0000","last_became_peered":"2023-10-09T06:42:38.577659+0000","last_unstale":"2023-10-09T06:42:38.581375+0000","last_undegraded":"2023-10-09T06:42:38.581375+0000","last_fullsized":"2023-10-09T06:42:38.581375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:21:05.708304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578759+0000","last_change":"2023-10-09T06:42:38.571770+0000","last_active":"2023-10-09T06:42:38.578759+0000","last_peered":"2023-10-09T06:42:38.578759+0000","last_clean":"2023-10-09T06:42:38.578759+0000","last_became_active":"2023-10-09T06:42:38.571510+0000","last_became_peered":"2023-10-09T06:42:38.571510+0000","last_unstale":"2023-10-09T06:42:38.578759+0000","last_undegraded":"2023-10-09T06:42:38.578759+0000","last_fullsized":"2023-10-09T06:42:38.578759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:28:50.048850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.567198+0000","last_change":"2023-10-09T06:42:38.564945+0000","last_active":"2023-10-09T06:42:38.567198+0000","last_peered":"2023-10-09T06:42:38.567198+0000","last_clean":"2023-10-09T06:42:38.567198+0000","last_became_active":"2023-10-09T06:42:38.564686+0000","last_became_peered":"2023-10-09T06:42:38.564686+0000","last_unstale":"2023-10-09T06:42:38.567198+0000","last_undegraded":"2023-10-09T06:42:38.567198+0000","last_fullsized":"2023-10-09T06:42:38.567198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:10.767555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570888+0000","last_change":"2023-10-09T06:42:38.569388+0000","last_active":"2023-10-09T06:42:38.570888+0000","last_peered":"2023-10-09T06:42:38.570888+0000","last_clean":"2023-10-09T06:42:38.570888+0000","last_became_active":"2023-10-09T06:42:38.568559+0000","last_became_peered":"2023-10-09T06:42:38.568559+0000","last_unstale":"2023-10-09T06:42:38.570888+0000","last_undegraded":"2023-10-09T06:42:38.570888+0000","last_fullsized":"2023-10-09T06:42:38.570888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:45:07.557629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570179+0000","last_change":"2023-10-09T06:42:38.565348+0000","last_active":"2023-10-09T06:42:38.570179+0000","last_peered":"2023-10-09T06:42:38.570179+0000","last_clean":"2023-10-09T06:42:38.570179+0000","last_became_active":"2023-10-09T06:42:38.564447+0000","last_became_peered":"2023-10-09T06:42:38.564447+0000","last_unstale":"2023-10-09T06:42:38.570179+0000","last_undegraded":"2023-10-09T06:42:38.570179+0000","last_fullsized":"2023-10-09T06:42:38.570179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:12:51.397981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.575872+0000","last_change":"2023-10-09T06:42:38.573595+0000","last_active":"2023-10-09T06:42:38.575872+0000","last_peered":"2023-10-09T06:42:38.575872+0000","last_clean":"2023-10-09T06:42:38.575872+0000","last_became_active":"2023-10-09T06:42:38.573337+0000","last_became_peered":"2023-10-09T06:42:38.573337+0000","last_unstale":"2023-10-09T06:42:38.575872+0000","last_undegraded":"2023-10-09T06:42:38.575872+0000","last_fullsized":"2023-10-09T06:42:38.575872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:47.620309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.570836+0000","last_change":"2023-10-09T06:42:38.569014+0000","last_active":"2023-10-09T06:42:38.570836+0000","last_peered":"2023-10-09T06:42:38.570836+0000","last_clean":"2023-10-09T06:42:38.570836+0000","last_became_active":"2023-10-09T06:42:38.568745+0000","last_became_peered":"2023-10-09T06:42:38.568745+0000","last_unstale":"2023-10-09T06:42:38.570836+0000","last_undegraded":"2023-10-09T06:42:38.570836+0000","last_fullsized":"2023-10-09T06:42:38.570836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:47.620309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578772+0000","last_change":"2023-10-09T06:42:38.569326+0000","last_active":"2023-10-09T06:42:38.578772+0000","last_peered":"2023-10-09T06:42:38.578772+0000","last_clean":"2023-10-09T06:42:38.578772+0000","last_became_active":"2023-10-09T06:42:38.569071+0000","last_became_peered":"2023-10-09T06:42:38.569071+0000","last_unstale":"2023-10-09T06:42:38.578772+0000","last_undegraded":"2023-10-09T06:42:38.578772+0000","last_fullsized":"2023-10-09T06:42:38.578772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:44:36.008678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.572639+0000","last_change":"2023-10-09T06:42:38.569598+0000","last_active":"2023-10-09T06:42:38.572639+0000","last_peered":"2023-10-09T06:42:38.572639+0000","last_clean":"2023-10-09T06:42:38.572639+0000","last_became_active":"2023-10-09T06:42:38.569008+0000","last_became_peered":"2023-10-09T06:42:38.569008+0000","last_unstale":"2023-10-09T06:42:38.572639+0000","last_undegraded":"2023-10-09T06:42:38.572639+0000","last_fullsized":"2023-10-09T06:42:38.572639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:33.081210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.578740+0000","last_change":"2023-10-09T06:42:38.569703+0000","last_active":"2023-10-09T06:42:38.578740+0000","last_peered":"2023-10-09T06:42:38.578740+0000","last_clean":"2023-10-09T06:42:38.578740+0000","last_became_active":"2023-10-09T06:42:38.565385+0000","last_became_peered":"2023-10-09T06:42:38.565385+0000","last_unstale":"2023-10-09T06:42:38.578740+0000","last_undegraded":"2023-10-09T06:42:38.578740+0000","last_fullsized":"2023-10-09T06:42:38.578740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:33.081210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.575964+0000","last_change":"2023-10-09T06:42:38.572735+0000","last_active":"2023-10-09T06:42:38.575964+0000","last_peered":"2023-10-09T06:42:38.575964+0000","last_clean":"2023-10-09T06:42:38.575964+0000","last_became_active":"2023-10-09T06:42:38.572479+0000","last_became_peered":"2023-10-09T06:42:38.572479+0000","last_unstale":"2023-10-09T06:42:38.575964+0000","last_undegraded":"2023-10-09T06:42:38.575964+0000","last_fullsized":"2023-10-09T06:42:38.575964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:13.371246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T06:42:38.571301+0000","last_change":"2023-10-09T06:42:38.569452+0000","last_active":"2023-10-09T06:42:38.571301+0000","last_peered":"2023-10-09T06:42:38.571301+0000","last_clean":"2023-10-09T06:42:38.571301+0000","last_became_active":"2023-10-09T06:42:38.569167+0000","last_became_peered":"2023-10-09T06:42:38.569167+0000","last_unstale":"2023-10-09T06:42:38.571301+0000","last_undegraded":"2023-10-09T06:42:38.571301+0000","last_fullsized":"2023-10-09T06:42:38.571301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:37.607278+0000","last_clean_scrub_stamp":"2023-10-09T06:42:37.607278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:33.081210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":661576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":811008,"data_stored":661632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:42:48.925 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-09T06:42:48.925 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-09T06:42:48.925 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-09T06:42:48.926 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-09T06:42:49.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.137+0000 7f635c5ff700 1 Processor -- start 2023-10-09T06:42:49.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.137+0000 7f635c5ff700 1 -- start start 2023-10-09T06:42:49.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.139+0000 7f635c5ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f63540b12e0 0x7f63540af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:49.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.139+0000 7f635c5ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63540c9810 con 0x7f6354156770 2023-10-09T06:42:49.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.139+0000 7f635c5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63540adf80 con 0x7f63540cacb0 2023-10-09T06:42:49.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.139+0000 7f635c5ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63540c9680 con 0x7f63540b12e0 2023-10-09T06:42:49.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.139+0000 7f6359b9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f63540b12e0 0x7f63540af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:49.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.139+0000 7f635a39b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6354156770 0x7f63540b0bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58284/0 (socket says 172.21.15.71:58284) 2023-10-09T06:42:49.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.139+0000 7f635a39b700 1 -- 172.21.15.71:0/2452069150 learned_addr learned my addr 172.21.15.71:0/2452069150 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:49.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.139+0000 7f6359399700 1 -- 172.21.15.71:0/2452069150 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770703814 0 0) 0x7f63540c9810 con 0x7f6354156770 2023-10-09T06:42:49.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.139+0000 7f6359b9a700 1 -- 172.21.15.71:0/2452069150 >> v1:172.21.15.179:6789/0 conn(0x7f63540cacb0 legacy=0x7f63540af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:49.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.139+0000 7f6359b9a700 1 -- 172.21.15.71:0/2452069150 >> v1:172.21.15.71:6789/0 conn(0x7f6354156770 legacy=0x7f63540b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:49.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.139+0000 7f6359b9a700 1 -- 172.21.15.71:0/2452069150 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63540ae260 con 0x7f63540b12e0 2023-10-09T06:42:49.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.140+0000 7f6359b9a700 1 --2- 172.21.15.71:0/2452069150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63540b12e0 0x7f63540af2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f63440098e0 tx=0x7f63440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511df107c5001e1e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:49.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.140+0000 7f6359399700 1 -- 172.21.15.71:0/2452069150 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6344009e80 con 0x7f63540b12e0 2023-10-09T06:42:49.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.140+0000 7f6359399700 1 -- 172.21.15.71:0/2452069150 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634400b860 con 0x7f63540b12e0 2023-10-09T06:42:49.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.140+0000 7f6359399700 1 -- 172.21.15.71:0/2452069150 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634400bbe0 con 0x7f63540b12e0 2023-10-09T06:42:49.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.140+0000 7f635c5ff700 1 -- 172.21.15.71:0/2452069150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63540b12e0 msgr2=0x7f63540af2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:49.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.140+0000 7f635c5ff700 1 --2- 172.21.15.71:0/2452069150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63540b12e0 0x7f63540af2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f63440098e0 tx=0x7f63440091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:49.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.141+0000 7f635c5ff700 1 -- 172.21.15.71:0/2452069150 shutdown_connections 2023-10-09T06:42:49.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.141+0000 7f635c5ff700 1 --2- 172.21.15.71:0/2452069150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63540b12e0 0x7f63540af2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:49.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.141+0000 7f635c5ff700 1 -- 172.21.15.71:0/2452069150 >> 172.21.15.71:0/2452069150 conn(0x7f635406a310 msgr2=0x7f63540cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:49.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.141+0000 7f635c5ff700 1 -- 172.21.15.71:0/2452069150 shutdown_connections 2023-10-09T06:42:49.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.141+0000 7f635c5ff700 1 -- 172.21.15.71:0/2452069150 wait complete. 2023-10-09T06:42:49.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.142+0000 7f635c5ff700 1 Processor -- start 2023-10-09T06:42:49.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.142+0000 7f635c5ff700 1 -- start start 2023-10-09T06:42:49.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.143+0000 7f635c5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63540b12e0 0x7f63540c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:49.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.143+0000 7f635c5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63540cacb0 0x7f63540c2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:49.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.143+0000 7f635c5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6354156770 0x7f635416a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:49.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.143+0000 7f635c5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63540a9960 con 0x7f63540cacb0 2023-10-09T06:42:49.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.143+0000 7f635c5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6354152030 con 0x7f63540b12e0 2023-10-09T06:42:49.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.143+0000 7f635c5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63540c29f0 con 0x7f6354156770 2023-10-09T06:42:49.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.143+0000 7f6359b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63540cacb0 0x7f63540c2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:49.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.143+0000 7f6359b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63540cacb0 0x7f63540c2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52358/0 (socket says 172.21.15.71:52358) 2023-10-09T06:42:49.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.143+0000 7f6359b9a700 1 -- 172.21.15.71:0/3905398125 learned_addr learned my addr 172.21.15.71:0/3905398125 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:49.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.144+0000 7f635a39b700 1 --2- 172.21.15.71:0/3905398125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63540b12e0 0x7f63540c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:49.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.144+0000 7f635ab9c700 1 --2- 172.21.15.71:0/3905398125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6354156770 0x7f635416a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:49.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.144+0000 7f6359b9a700 1 -- 172.21.15.71:0/3905398125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6354156770 msgr2=0x7f635416a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:49.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.144+0000 7f6359b9a700 1 --2- 172.21.15.71:0/3905398125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6354156770 0x7f635416a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:49.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.144+0000 7f6359b9a700 1 -- 172.21.15.71:0/3905398125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63540b12e0 msgr2=0x7f63540c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:49.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.144+0000 7f6359b9a700 1 --2- 172.21.15.71:0/3905398125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63540b12e0 0x7f63540c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:49.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.144+0000 7f6359b9a700 1 -- 172.21.15.71:0/3905398125 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6344009420 con 0x7f63540cacb0 2023-10-09T06:42:49.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.144+0000 7f6359b9a700 1 --2- 172.21.15.71:0/3905398125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63540cacb0 0x7f63540c2190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f635406d540 tx=0x7f6344017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:49.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.144+0000 7f634a7fc700 1 -- 172.21.15.71:0/3905398125 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634401f070 con 0x7f63540cacb0 2023-10-09T06:42:49.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.144+0000 7f634a7fc700 1 -- 172.21.15.71:0/3905398125 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634400b9d0 con 0x7f63540cacb0 2023-10-09T06:42:49.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.144+0000 7f635c5ff700 1 -- 172.21.15.71:0/3905398125 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63540c2cd0 con 0x7f63540cacb0 2023-10-09T06:42:49.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.144+0000 7f634a7fc700 1 -- 172.21.15.71:0/3905398125 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6344025670 con 0x7f63540cacb0 2023-10-09T06:42:49.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.144+0000 7f635c5ff700 1 -- 172.21.15.71:0/3905398125 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63540c3290 con 0x7f63540cacb0 2023-10-09T06:42:49.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.145+0000 7f635c5ff700 1 -- 172.21.15.71:0/3905398125 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63540a9b10 con 0x7f63540cacb0 2023-10-09T06:42:49.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.146+0000 7f634a7fc700 1 -- 172.21.15.71:0/3905398125 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6344023070 con 0x7f63540cacb0 2023-10-09T06:42:49.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.147+0000 7f634a7fc700 1 --2- 172.21.15.71:0/3905398125 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6338066f30 0x7f63380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:49.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.148+0000 7f634a7fc700 1 -- 172.21.15.71:0/3905398125 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6344085b70 con 0x7f63540cacb0 2023-10-09T06:42:49.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.148+0000 7f635a39b700 1 --2- 172.21.15.71:0/3905398125 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6338066f30 0x7f63380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:49.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.148+0000 7f635a39b700 1 --2- 172.21.15.71:0/3905398125 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6338066f30 0x7f63380693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6350000c00 tx=0x7f6350009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:49.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.152+0000 7f634a7fc700 1 -- 172.21.15.71:0/3905398125 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63540a9b10 con 0x7f63540cacb0 2023-10-09T06:42:49.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.384+0000 7f635c5ff700 1 -- 172.21.15.71:0/3905398125 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f63540a9b10 con 0x7f63540cacb0 2023-10-09T06:42:49.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.384+0000 7f634a7fc700 1 -- 172.21.15.71:0/3905398125 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f634402a040 con 0x7f63540cacb0 2023-10-09T06:42:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:42:49.386 INFO:teuthology.orchestra.run.smithi071.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-09T06:42:49.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.386+0000 7f635c5ff700 1 -- 172.21.15.71:0/3905398125 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6338066f30 msgr2=0x7f63380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:49.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.386+0000 7f635c5ff700 1 --2- 172.21.15.71:0/3905398125 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6338066f30 0x7f63380693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6350000c00 tx=0x7f6350009040 comp rx=0 tx=0).stop 2023-10-09T06:42:49.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.386+0000 7f635c5ff700 1 -- 172.21.15.71:0/3905398125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63540cacb0 msgr2=0x7f63540c2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:49.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.386+0000 7f635c5ff700 1 --2- 172.21.15.71:0/3905398125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63540cacb0 0x7f63540c2190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f635406d540 tx=0x7f6344017000 comp rx=0 tx=0).stop 2023-10-09T06:42:49.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.386+0000 7f635c5ff700 1 -- 172.21.15.71:0/3905398125 shutdown_connections 2023-10-09T06:42:49.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.386+0000 7f635c5ff700 1 --2- 172.21.15.71:0/3905398125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6354156770 0x7f635416a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:49.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.386+0000 7f635c5ff700 1 --2- 172.21.15.71:0/3905398125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63540b12e0 0x7f63540c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:49.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.386+0000 7f635c5ff700 1 --2- 172.21.15.71:0/3905398125 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6338066f30 0x7f63380693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:49.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.386+0000 7f635c5ff700 1 --2- 172.21.15.71:0/3905398125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63540cacb0 0x7f63540c2190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:49.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.386+0000 7f635c5ff700 1 -- 172.21.15.71:0/3905398125 >> 172.21.15.71:0/3905398125 conn(0x7f635406a310 msgr2=0x7f63541554c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:49.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.386+0000 7f635c5ff700 1 -- 172.21.15.71:0/3905398125 shutdown_connections 2023-10-09T06:42:49.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.386+0000 7f635c5ff700 1 -- 172.21.15.71:0/3905398125 wait complete. 2023-10-09T06:42:49.405 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-09T06:42:49.405 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:42:49.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.589+0000 7fca8659d700 1 Processor -- start 2023-10-09T06:42:49.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.590+0000 7fca8659d700 1 -- start start 2023-10-09T06:42:49.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.591+0000 7fca8659d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca80156310 0x7fca800c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:49.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.591+0000 7fca8659d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fca801566e0 0x7fca800ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:49.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.591+0000 7fca8659d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fca800ca300 0x7fca800ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:49.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.591+0000 7fca8659d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca800ca860 con 0x7fca800ca300 2023-10-09T06:42:49.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.591+0000 7fca8659d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca800cab40 con 0x7fca801566e0 2023-10-09T06:42:49.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.591+0000 7fca8659d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca800cae20 con 0x7fca80156310 2023-10-09T06:42:49.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.591+0000 7fca85d9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fca800ca300 0x7fca800ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:49.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.591+0000 7fca85d9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fca800ca300 0x7fca800ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52368/0 (socket says 172.21.15.71:52368) 2023-10-09T06:42:49.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.591+0000 7fca85d9c700 1 -- 172.21.15.71:0/989373826 learned_addr learned my addr 172.21.15.71:0/989373826 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:49.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.592+0000 7fca84d9a700 1 --2- 172.21.15.71:0/989373826 >> v2:172.21.15.179:3300/0 conn(0x7fca801566e0 0x7fca800ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:49.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.592+0000 7fca8559b700 1 --2- 172.21.15.71:0/989373826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca80156310 0x7fca800c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:49.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.592+0000 7fca85d9c700 1 -- 172.21.15.71:0/989373826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca80156310 msgr2=0x7fca800c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:49.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.592+0000 7fca85d9c700 1 --2- 172.21.15.71:0/989373826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca80156310 0x7fca800c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:49.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.592+0000 7fca85d9c700 1 -- 172.21.15.71:0/989373826 >> v2:172.21.15.179:3300/0 conn(0x7fca801566e0 msgr2=0x7fca800ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:49.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.592+0000 7fca85d9c700 1 --2- 172.21.15.71:0/989373826 >> v2:172.21.15.179:3300/0 conn(0x7fca801566e0 0x7fca800ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:49.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.592+0000 7fca85d9c700 1 -- 172.21.15.71:0/989373826 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca800cb100 con 0x7fca800ca300 2023-10-09T06:42:49.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.592+0000 7fca84d9a700 1 --2- 172.21.15.71:0/989373826 >> v2:172.21.15.179:3300/0 conn(0x7fca801566e0 0x7fca800ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:49.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.592+0000 7fca8559b700 1 --2- 172.21.15.71:0/989373826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca80156310 0x7fca800c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:49.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.592+0000 7fca85d9c700 1 --2- 172.21.15.71:0/989373826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca800ca300 0x7fca800ae540 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fca8006d1e0 tx=0x7fca78009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51558aacc8b1f709 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:49.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.592+0000 7fca77fff700 1 -- 172.21.15.71:0/989373826 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7800e070 con 0x7fca800ca300 2023-10-09T06:42:49.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.592+0000 7fca77fff700 1 -- 172.21.15.71:0/989373826 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7800ba50 con 0x7fca800ca300 2023-10-09T06:42:49.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.592+0000 7fca77fff700 1 -- 172.21.15.71:0/989373826 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca780092e0 con 0x7fca800ca300 2023-10-09T06:42:49.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.593+0000 7fca8659d700 1 -- 172.21.15.71:0/989373826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca800ca300 msgr2=0x7fca800ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:49.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.593+0000 7fca8659d700 1 --2- 172.21.15.71:0/989373826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca800ca300 0x7fca800ae540 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fca8006d1e0 tx=0x7fca78009840 comp rx=0 tx=0).stop 2023-10-09T06:42:49.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.593+0000 7fca8659d700 1 -- 172.21.15.71:0/989373826 shutdown_connections 2023-10-09T06:42:49.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.593+0000 7fca8659d700 1 --2- 172.21.15.71:0/989373826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca800ca300 0x7fca800ae540 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:49.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.593+0000 7fca8659d700 1 --2- 172.21.15.71:0/989373826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca80156310 0x7fca800c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:49.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.593+0000 7fca8659d700 1 --2- 172.21.15.71:0/989373826 >> v2:172.21.15.179:3300/0 conn(0x7fca801566e0 0x7fca800ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:49.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.593+0000 7fca8659d700 1 -- 172.21.15.71:0/989373826 >> 172.21.15.71:0/989373826 conn(0x7fca800cc1f0 msgr2=0x7fca800cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:49.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.593+0000 7fca8659d700 1 -- 172.21.15.71:0/989373826 shutdown_connections 2023-10-09T06:42:49.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.593+0000 7fca8659d700 1 -- 172.21.15.71:0/989373826 wait complete. 2023-10-09T06:42:49.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.594+0000 7fca8659d700 1 Processor -- start 2023-10-09T06:42:49.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.594+0000 7fca8659d700 1 -- start start 2023-10-09T06:42:49.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.595+0000 7fca8659d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca800ca300 0x7fca80144680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:49.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.595+0000 7fca8659d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca80156310 0x7fca8014ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:49.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.595+0000 7fca8659d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca801566e0 0x7fca801482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:49.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.595+0000 7fca8659d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca800b1ac0 con 0x7fca801566e0 2023-10-09T06:42:49.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.595+0000 7fca8659d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca80144bc0 con 0x7fca800ca300 2023-10-09T06:42:49.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.595+0000 7fca8659d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8014fe90 con 0x7fca80156310 2023-10-09T06:42:49.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.595+0000 7fca85d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca801566e0 0x7fca801482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:49.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.595+0000 7fca85d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca801566e0 0x7fca801482b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52378/0 (socket says 172.21.15.71:52378) 2023-10-09T06:42:49.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.595+0000 7fca85d9c700 1 -- 172.21.15.71:0/2265277645 learned_addr learned my addr 172.21.15.71:0/2265277645 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:49.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.596+0000 7fca84d9a700 1 --2- 172.21.15.71:0/2265277645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca80156310 0x7fca8014ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:49.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.596+0000 7fca8559b700 1 --2- 172.21.15.71:0/2265277645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca800ca300 0x7fca80144680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:49.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.596+0000 7fca85d9c700 1 -- 172.21.15.71:0/2265277645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca80156310 msgr2=0x7fca8014ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:49.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.596+0000 7fca85d9c700 1 --2- 172.21.15.71:0/2265277645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca80156310 0x7fca8014ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:49.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.596+0000 7fca85d9c700 1 -- 172.21.15.71:0/2265277645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca800ca300 msgr2=0x7fca80144680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:49.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.596+0000 7fca85d9c700 1 --2- 172.21.15.71:0/2265277645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca800ca300 0x7fca80144680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:49.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.596+0000 7fca85d9c700 1 -- 172.21.15.71:0/2265277645 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca78009ae0 con 0x7fca801566e0 2023-10-09T06:42:49.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.596+0000 7fca84d9a700 1 --2- 172.21.15.71:0/2265277645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca80156310 0x7fca8014ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:49.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.596+0000 7fca8559b700 1 --2- 172.21.15.71:0/2265277645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca800ca300 0x7fca80144680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:49.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.596+0000 7fca85d9c700 1 --2- 172.21.15.71:0/2265277645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca801566e0 0x7fca801482b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fca8006fe40 tx=0x7fca78018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:49.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.596+0000 7fca757fa700 1 -- 172.21.15.71:0/2265277645 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78008e80 con 0x7fca801566e0 2023-10-09T06:42:49.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.596+0000 7fca757fa700 1 -- 172.21.15.71:0/2265277645 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7801c410 con 0x7fca801566e0 2023-10-09T06:42:49.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.596+0000 7fca757fa700 1 -- 172.21.15.71:0/2265277645 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7801c7d0 con 0x7fca801566e0 2023-10-09T06:42:49.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.596+0000 7fca8659d700 1 -- 172.21.15.71:0/2265277645 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca800b1500 con 0x7fca801566e0 2023-10-09T06:42:49.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.597+0000 7fca8659d700 1 -- 172.21.15.71:0/2265277645 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca80150130 con 0x7fca801566e0 2023-10-09T06:42:49.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.597+0000 7fca8659d700 1 -- 172.21.15.71:0/2265277645 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca8004c3c0 con 0x7fca801566e0 2023-10-09T06:42:49.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.598+0000 7fca757fa700 1 -- 172.21.15.71:0/2265277645 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca78003040 con 0x7fca801566e0 2023-10-09T06:42:49.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.599+0000 7fca757fa700 1 --2- 172.21.15.71:0/2265277645 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fca64066f30 0x7fca640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:49.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.599+0000 7fca757fa700 1 -- 172.21.15.71:0/2265277645 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fca78085fd0 con 0x7fca801566e0 2023-10-09T06:42:49.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.600+0000 7fca8559b700 1 --2- 172.21.15.71:0/2265277645 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fca64066f30 0x7fca640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:49.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.600+0000 7fca8559b700 1 --2- 172.21.15.71:0/2265277645 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fca64066f30 0x7fca640693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fca80130b10 tx=0x7fca7c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:49.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.603+0000 7fca757fa700 1 -- 172.21.15.71:0/2265277645 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca780531a0 con 0x7fca801566e0 2023-10-09T06:42:49.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.796+0000 7fca8659d700 1 -- 172.21.15.71:0/2265277645 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca800cd0b0 con 0x7fca801566e0 2023-10-09T06:42:49.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.797+0000 7fca757fa700 1 -- 172.21.15.71:0/2265277645 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fca780567c0 con 0x7fca801566e0 2023-10-09T06:42:49.798 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:42:49.798 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":20,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:42:39.546192+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:42:35.828340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:42:37.071896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:42:49.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.799+0000 7fca8659d700 1 -- 172.21.15.71:0/2265277645 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fca64066f30 msgr2=0x7fca640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:49.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.799+0000 7fca8659d700 1 --2- 172.21.15.71:0/2265277645 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fca64066f30 0x7fca640693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fca80130b10 tx=0x7fca7c008040 comp rx=0 tx=0).stop 2023-10-09T06:42:49.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.799+0000 7fca8659d700 1 -- 172.21.15.71:0/2265277645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca801566e0 msgr2=0x7fca801482b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:49.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.799+0000 7fca8659d700 1 --2- 172.21.15.71:0/2265277645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca801566e0 0x7fca801482b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fca8006fe40 tx=0x7fca78018000 comp rx=0 tx=0).stop 2023-10-09T06:42:49.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.799+0000 7fca8659d700 1 -- 172.21.15.71:0/2265277645 shutdown_connections 2023-10-09T06:42:49.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.799+0000 7fca8659d700 1 --2- 172.21.15.71:0/2265277645 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fca64066f30 0x7fca640693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:49.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.799+0000 7fca8659d700 1 --2- 172.21.15.71:0/2265277645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca801566e0 0x7fca801482b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:49.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.799+0000 7fca8659d700 1 --2- 172.21.15.71:0/2265277645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca800ca300 0x7fca80144680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:49.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.799+0000 7fca8659d700 1 --2- 172.21.15.71:0/2265277645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca80156310 0x7fca8014ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:49.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.799+0000 7fca8659d700 1 -- 172.21.15.71:0/2265277645 >> 172.21.15.71:0/2265277645 conn(0x7fca800cc1f0 msgr2=0x7fca800c2690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:49.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.799+0000 7fca8659d700 1 -- 172.21.15.71:0/2265277645 shutdown_connections 2023-10-09T06:42:49.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.799+0000 7fca8659d700 1 -- 172.21.15.71:0/2265277645 wait complete. 2023-10-09T06:42:49.818 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:42:35.828340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:42:37.071896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:42:49.818 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:42:50.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.999+0000 7f7d4939d700 1 Processor -- start 2023-10-09T06:42:50.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:49.999+0000 7f7d4939d700 1 -- start start 2023-10-09T06:42:50.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.000+0000 7f7d4939d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7d440b16d0 0x7f7d440b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:50.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.000+0000 7f7d4939d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d440b33b0 0x7f7d440b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:50.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.000+0000 7f7d4939d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d440b2080 con 0x7f7d440b4e70 2023-10-09T06:42:50.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.000+0000 7f7d4939d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d440cfb00 con 0x7f7d440b16d0 2023-10-09T06:42:50.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.000+0000 7f7d4939d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d440b5c40 con 0x7f7d440b33b0 2023-10-09T06:42:50.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.001+0000 7f7d437fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7d440b16d0 0x7f7d440b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:50.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.001+0000 7f7d437fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7d440b16d0 0x7f7d440b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52388/0 (socket says 172.21.15.71:52388) 2023-10-09T06:42:50.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.001+0000 7f7d437fe700 1 -- 172.21.15.71:0/2133792940 learned_addr learned my addr 172.21.15.71:0/2133792940 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:50.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.001+0000 7f7d48b9c700 1 --2- 172.21.15.71:0/2133792940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d440b33b0 0x7f7d440b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:50.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.001+0000 7f7d437fe700 1 -- 172.21.15.71:0/2133792940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d440b33b0 msgr2=0x7f7d440b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:50.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.001+0000 7f7d437fe700 1 --2- 172.21.15.71:0/2133792940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d440b33b0 0x7f7d440b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.001+0000 7f7d437fe700 1 -- 172.21.15.71:0/2133792940 >> v1:172.21.15.179:6789/0 conn(0x7f7d440b4e70 legacy=0x7f7d440ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:50.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.001+0000 7f7d437fe700 1 -- 172.21.15.71:0/2133792940 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d440b5f20 con 0x7f7d440b16d0 2023-10-09T06:42:50.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.001+0000 7f7d437fe700 1 --2- 172.21.15.71:0/2133792940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d440b16d0 0x7f7d440b1b40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7d380099b0 tx=0x7f7d38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3c6c4d94e49dd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:50.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.002+0000 7f7d42ffd700 1 -- 172.21.15.71:0/2133792940 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3800b820 con 0x7f7d440b16d0 2023-10-09T06:42:50.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.002+0000 7f7d42ffd700 1 -- 172.21.15.71:0/2133792940 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3800b980 con 0x7f7d440b16d0 2023-10-09T06:42:50.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.002+0000 7f7d42ffd700 1 -- 172.21.15.71:0/2133792940 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3800bd40 con 0x7f7d440b16d0 2023-10-09T06:42:50.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.002+0000 7f7d4939d700 1 -- 172.21.15.71:0/2133792940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d440b16d0 msgr2=0x7f7d440b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:50.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.002+0000 7f7d4939d700 1 --2- 172.21.15.71:0/2133792940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d440b16d0 0x7f7d440b1b40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7d380099b0 tx=0x7f7d38009250 comp rx=0 tx=0).stop 2023-10-09T06:42:50.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.002+0000 7f7d4939d700 1 -- 172.21.15.71:0/2133792940 shutdown_connections 2023-10-09T06:42:50.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.002+0000 7f7d4939d700 1 --2- 172.21.15.71:0/2133792940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d440b33b0 0x7f7d440b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.002+0000 7f7d4939d700 1 --2- 172.21.15.71:0/2133792940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d440b16d0 0x7f7d440b1b40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.002+0000 7f7d4939d700 1 -- 172.21.15.71:0/2133792940 >> 172.21.15.71:0/2133792940 conn(0x7f7d440d10c0 msgr2=0x7f7d440affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:50.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.002+0000 7f7d4939d700 1 -- 172.21.15.71:0/2133792940 shutdown_connections 2023-10-09T06:42:50.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.002+0000 7f7d4939d700 1 -- 172.21.15.71:0/2133792940 wait complete. 2023-10-09T06:42:50.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.004+0000 7f7d4939d700 1 Processor -- start 2023-10-09T06:42:50.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.004+0000 7f7d4939d700 1 -- start start 2023-10-09T06:42:50.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.005+0000 7f7d4939d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d440b16d0 0x7f7d440cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:50.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.005+0000 7f7d4939d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d440b33b0 0x7f7d440cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:50.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.005+0000 7f7d4939d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d440b4e70 0x7f7d4416d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:50.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.005+0000 7f7d4939d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d440c9650 con 0x7f7d440b4e70 2023-10-09T06:42:50.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.005+0000 7f7d4939d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d44146ad0 con 0x7f7d440b33b0 2023-10-09T06:42:50.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.005+0000 7f7d4939d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d440c8a40 con 0x7f7d440b16d0 2023-10-09T06:42:50.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.005+0000 7f7d48b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d440b4e70 0x7f7d4416d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:50.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.005+0000 7f7d48b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d440b4e70 0x7f7d4416d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52398/0 (socket says 172.21.15.71:52398) 2023-10-09T06:42:50.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.005+0000 7f7d48b9c700 1 -- 172.21.15.71:0/746707331 learned_addr learned my addr 172.21.15.71:0/746707331 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:50.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.005+0000 7f7d48b9c700 1 -- 172.21.15.71:0/746707331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d440b16d0 msgr2=0x7f7d440cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:50.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.005+0000 7f7d437fe700 1 --2- 172.21.15.71:0/746707331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d440b33b0 0x7f7d440cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:50.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.005+0000 7f7d43fff700 1 --2- 172.21.15.71:0/746707331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d440b16d0 0x7f7d440cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:50.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.005+0000 7f7d48b9c700 1 --2- 172.21.15.71:0/746707331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d440b16d0 0x7f7d440cade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.006+0000 7f7d48b9c700 1 -- 172.21.15.71:0/746707331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d440b33b0 msgr2=0x7f7d440cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:50.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.006+0000 7f7d48b9c700 1 --2- 172.21.15.71:0/746707331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d440b33b0 0x7f7d440cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.006+0000 7f7d48b9c700 1 -- 172.21.15.71:0/746707331 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d380094f0 con 0x7f7d440b4e70 2023-10-09T06:42:50.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.006+0000 7f7d437fe700 1 --2- 172.21.15.71:0/746707331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d440b33b0 0x7f7d440cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:50.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.006+0000 7f7d43fff700 1 --2- 172.21.15.71:0/746707331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d440b16d0 0x7f7d440cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:50.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.006+0000 7f7d48b9c700 1 --2- 172.21.15.71:0/746707331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d440b4e70 0x7f7d4416d7b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c009fa0 tx=0x7f7d3c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:50.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.006+0000 7f7d2bfff700 1 -- 172.21.15.71:0/746707331 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c00ed20 con 0x7f7d440b4e70 2023-10-09T06:42:50.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.006+0000 7f7d2bfff700 1 -- 172.21.15.71:0/746707331 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3c00ee80 con 0x7f7d440b4e70 2023-10-09T06:42:50.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.006+0000 7f7d2bfff700 1 -- 172.21.15.71:0/746707331 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c014670 con 0x7f7d440b4e70 2023-10-09T06:42:50.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.006+0000 7f7d4939d700 1 -- 172.21.15.71:0/746707331 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d440c8d20 con 0x7f7d440b4e70 2023-10-09T06:42:50.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.006+0000 7f7d4939d700 1 -- 172.21.15.71:0/746707331 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d440c92e0 con 0x7f7d440b4e70 2023-10-09T06:42:50.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.007+0000 7f7d4939d700 1 -- 172.21.15.71:0/746707331 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d440c97c0 con 0x7f7d440b4e70 2023-10-09T06:42:50.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.008+0000 7f7d2bfff700 1 -- 172.21.15.71:0/746707331 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d3c0149e0 con 0x7f7d440b4e70 2023-10-09T06:42:50.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.009+0000 7f7d2bfff700 1 --2- 172.21.15.71:0/746707331 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7d30066f30 0x7f7d300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:50.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.009+0000 7f7d2bfff700 1 -- 172.21.15.71:0/746707331 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7d3c084cb0 con 0x7f7d440b4e70 2023-10-09T06:42:50.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.009+0000 7f7d43fff700 1 --2- 172.21.15.71:0/746707331 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7d30066f30 0x7f7d300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:50.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.010+0000 7f7d43fff700 1 --2- 172.21.15.71:0/746707331 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7d30066f30 0x7f7d300693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7d34002880 tx=0x7f7d34009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:50.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.013+0000 7f7d2bfff700 1 -- 172.21.15.71:0/746707331 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d3c051f20 con 0x7f7d440b4e70 2023-10-09T06:42:50.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.198+0000 7f7d4939d700 1 -- 172.21.15.71:0/746707331 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d44069bc0 con 0x7f7d440b4e70 2023-10-09T06:42:50.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.199+0000 7f7d2bfff700 1 -- 172.21.15.71:0/746707331 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d3c055540 con 0x7f7d440b4e70 2023-10-09T06:42:50.200 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T06:42:50.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.201+0000 7f7d4939d700 1 -- 172.21.15.71:0/746707331 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7d30066f30 msgr2=0x7f7d300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:50.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.201+0000 7f7d4939d700 1 --2- 172.21.15.71:0/746707331 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7d30066f30 0x7f7d300693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7d34002880 tx=0x7f7d34009040 comp rx=0 tx=0).stop 2023-10-09T06:42:50.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.201+0000 7f7d4939d700 1 -- 172.21.15.71:0/746707331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d440b4e70 msgr2=0x7f7d4416d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:50.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.201+0000 7f7d4939d700 1 --2- 172.21.15.71:0/746707331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d440b4e70 0x7f7d4416d7b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c009fa0 tx=0x7f7d3c009900 comp rx=0 tx=0).stop 2023-10-09T06:42:50.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.201+0000 7f7d4939d700 1 -- 172.21.15.71:0/746707331 shutdown_connections 2023-10-09T06:42:50.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.201+0000 7f7d4939d700 1 --2- 172.21.15.71:0/746707331 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7d30066f30 0x7f7d300693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.201+0000 7f7d4939d700 1 --2- 172.21.15.71:0/746707331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d440b4e70 0x7f7d4416d7b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.201+0000 7f7d4939d700 1 --2- 172.21.15.71:0/746707331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d440b16d0 0x7f7d440cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.201+0000 7f7d4939d700 1 --2- 172.21.15.71:0/746707331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d440b33b0 0x7f7d440cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.201+0000 7f7d4939d700 1 -- 172.21.15.71:0/746707331 >> 172.21.15.71:0/746707331 conn(0x7f7d440d10c0 msgr2=0x7f7d44159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:50.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.201+0000 7f7d4939d700 1 -- 172.21.15.71:0/746707331 shutdown_connections 2023-10-09T06:42:50.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.201+0000 7f7d4939d700 1 -- 172.21.15.71:0/746707331 wait complete. 2023-10-09T06:42:50.219 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:42:50.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.401+0000 7f68f7bff700 1 Processor -- start 2023-10-09T06:42:50.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.401+0000 7f68f7bff700 1 -- start start 2023-10-09T06:42:50.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.402+0000 7f68f7bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f68f0069e80 0x7f68f00c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:50.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.402+0000 7f68f7bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68f00b0a70 0x7f68f00c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:50.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.402+0000 7f68f7bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f00af2f0 con 0x7f68f015ac80 2023-10-09T06:42:50.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.402+0000 7f68f7bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f00af5d0 con 0x7f68f0069e80 2023-10-09T06:42:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.402+0000 7f68f7bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00c8660 con 0x7f68f00b0a70 2023-10-09T06:42:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.403+0000 7f68f599b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f68f015ac80 0x7f68f0069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58290/0 (socket says 172.21.15.71:58290) 2023-10-09T06:42:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.403+0000 7f68f519a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f68f0069e80 0x7f68f00c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.403+0000 7f68f599b700 1 -- 172.21.15.71:0/145021015 learned_addr learned my addr 172.21.15.71:0/145021015 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:50.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.403+0000 7f68f619c700 1 --2- 172.21.15.71:0/145021015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68f00b0a70 0x7f68f00c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:50.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.403+0000 7f68f4999700 1 -- 172.21.15.71:0/145021015 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991577449 0 0) 0x7f68f00af2f0 con 0x7f68f015ac80 2023-10-09T06:42:50.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.403+0000 7f68f519a700 1 -- 172.21.15.71:0/145021015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68f00b0a70 msgr2=0x7f68f00c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:50.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.403+0000 7f68f519a700 1 --2- 172.21.15.71:0/145021015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68f00b0a70 0x7f68f00c70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.403+0000 7f68f519a700 1 -- 172.21.15.71:0/145021015 >> v1:172.21.15.71:6789/0 conn(0x7f68f015ac80 legacy=0x7f68f0069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:50.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.403+0000 7f68f519a700 1 -- 172.21.15.71:0/145021015 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f00c8940 con 0x7f68f0069e80 2023-10-09T06:42:50.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.403+0000 7f68f519a700 1 --2- 172.21.15.71:0/145021015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68f0069e80 0x7f68f00c6b70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f68e00098e0 tx=0x7f68e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f57b55671281d7e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:50.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.403+0000 7f68f4999700 1 -- 172.21.15.71:0/145021015 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0009e80 con 0x7f68f0069e80 2023-10-09T06:42:50.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.404+0000 7f68f4999700 1 -- 172.21.15.71:0/145021015 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e000b860 con 0x7f68f0069e80 2023-10-09T06:42:50.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.404+0000 7f68f4999700 1 -- 172.21.15.71:0/145021015 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e000bbe0 con 0x7f68f0069e80 2023-10-09T06:42:50.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.404+0000 7f68f7bff700 1 -- 172.21.15.71:0/145021015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68f0069e80 msgr2=0x7f68f00c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:50.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.404+0000 7f68f7bff700 1 --2- 172.21.15.71:0/145021015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68f0069e80 0x7f68f00c6b70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f68e00098e0 tx=0x7f68e00091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.404+0000 7f68f7bff700 1 -- 172.21.15.71:0/145021015 shutdown_connections 2023-10-09T06:42:50.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.404+0000 7f68f7bff700 1 --2- 172.21.15.71:0/145021015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68f00b0a70 0x7f68f00c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.404+0000 7f68f7bff700 1 --2- 172.21.15.71:0/145021015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68f0069e80 0x7f68f00c6b70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.404+0000 7f68f7bff700 1 -- 172.21.15.71:0/145021015 >> 172.21.15.71:0/145021015 conn(0x7f68f0068e10 msgr2=0x7f68f00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:50.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.404+0000 7f68f7bff700 1 -- 172.21.15.71:0/145021015 shutdown_connections 2023-10-09T06:42:50.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.404+0000 7f68f7bff700 1 -- 172.21.15.71:0/145021015 wait complete. 2023-10-09T06:42:50.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.406+0000 7f68f7bff700 1 Processor -- start 2023-10-09T06:42:50.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.406+0000 7f68f7bff700 1 -- start start 2023-10-09T06:42:50.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.407+0000 7f68f7bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68f0069e80 0x7f68f01575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:50.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.407+0000 7f68f7bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68f00b0a70 0x7f68f0169ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:50.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.407+0000 7f68f7bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68f015ac80 0x7f68f0144f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:50.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.407+0000 7f68f7bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00caac0 con 0x7f68f00b0a70 2023-10-09T06:42:50.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.407+0000 7f68f7bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f01595e0 con 0x7f68f015ac80 2023-10-09T06:42:50.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.407+0000 7f68f7bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f016a160 con 0x7f68f0069e80 2023-10-09T06:42:50.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.407+0000 7f68f519a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68f00b0a70 0x7f68f0169ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:50.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.407+0000 7f68f519a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68f00b0a70 0x7f68f0169ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52414/0 (socket says 172.21.15.71:52414) 2023-10-09T06:42:50.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.407+0000 7f68f519a700 1 -- 172.21.15.71:0/446832358 learned_addr learned my addr 172.21.15.71:0/446832358 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:50.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.407+0000 7f68f619c700 1 --2- 172.21.15.71:0/446832358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68f015ac80 0x7f68f0144f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:50.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.407+0000 7f68f599b700 1 --2- 172.21.15.71:0/446832358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68f0069e80 0x7f68f01575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:50.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.407+0000 7f68f519a700 1 -- 172.21.15.71:0/446832358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68f0069e80 msgr2=0x7f68f01575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:50.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.407+0000 7f68f519a700 1 --2- 172.21.15.71:0/446832358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68f0069e80 0x7f68f01575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.407+0000 7f68f519a700 1 -- 172.21.15.71:0/446832358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68f015ac80 msgr2=0x7f68f0144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:50.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.407+0000 7f68f519a700 1 --2- 172.21.15.71:0/446832358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68f015ac80 0x7f68f0144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.407+0000 7f68f519a700 1 -- 172.21.15.71:0/446832358 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e0009420 con 0x7f68f00b0a70 2023-10-09T06:42:50.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.407+0000 7f68f619c700 1 --2- 172.21.15.71:0/446832358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68f015ac80 0x7f68f0144f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:50.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.407+0000 7f68f599b700 1 --2- 172.21.15.71:0/446832358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68f0069e80 0x7f68f01575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:50.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.407+0000 7f68f519a700 1 --2- 172.21.15.71:0/446832358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68f00b0a70 0x7f68f0169ad0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f68e0013000 tx=0x7f68e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:50.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.408+0000 7f68e5ffb700 1 -- 172.21.15.71:0/446832358 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e000bbe0 con 0x7f68f00b0a70 2023-10-09T06:42:50.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.408+0000 7f68e5ffb700 1 -- 172.21.15.71:0/446832358 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e0011420 con 0x7f68f00b0a70 2023-10-09T06:42:50.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.408+0000 7f68f7bff700 1 -- 172.21.15.71:0/446832358 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f016a440 con 0x7f68f00b0a70 2023-10-09T06:42:50.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.408+0000 7f68e5ffb700 1 -- 172.21.15.71:0/446832358 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e00117e0 con 0x7f68f00b0a70 2023-10-09T06:42:50.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.408+0000 7f68f7bff700 1 -- 172.21.15.71:0/446832358 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f016aa00 con 0x7f68f00b0a70 2023-10-09T06:42:50.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.409+0000 7f68f7bff700 1 -- 172.21.15.71:0/446832358 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f004c3c0 con 0x7f68f00b0a70 2023-10-09T06:42:50.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.410+0000 7f68e5ffb700 1 -- 172.21.15.71:0/446832358 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f68e0011bd0 con 0x7f68f00b0a70 2023-10-09T06:42:50.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.410+0000 7f68e5ffb700 1 --2- 172.21.15.71:0/446832358 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f68d4066f30 0x7f68d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:50.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.411+0000 7f68e5ffb700 1 -- 172.21.15.71:0/446832358 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f68e0085fe0 con 0x7f68f00b0a70 2023-10-09T06:42:50.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.411+0000 7f68f599b700 1 --2- 172.21.15.71:0/446832358 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f68d4066f30 0x7f68d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:50.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.412+0000 7f68f599b700 1 --2- 172.21.15.71:0/446832358 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f68d4066f30 0x7f68d40693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f68ec007fd0 tx=0x7f68ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:50.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.415+0000 7f68e5ffb700 1 -- 172.21.15.71:0/446832358 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68e00531d0 con 0x7f68f00b0a70 2023-10-09T06:42:50.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.603+0000 7f68f7bff700 1 -- 172.21.15.71:0/446832358 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f68f00cac00 con 0x7f68f00b0a70 2023-10-09T06:42:50.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.604+0000 7f68e5ffb700 1 -- 172.21.15.71:0/446832358 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f68e00567f0 con 0x7f68f00b0a70 2023-10-09T06:42:50.605 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-09T06:42:50.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.606+0000 7f68f7bff700 1 -- 172.21.15.71:0/446832358 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f68d4066f30 msgr2=0x7f68d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:50.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.606+0000 7f68f7bff700 1 --2- 172.21.15.71:0/446832358 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f68d4066f30 0x7f68d40693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f68ec007fd0 tx=0x7f68ec009040 comp rx=0 tx=0).stop 2023-10-09T06:42:50.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.606+0000 7f68f7bff700 1 -- 172.21.15.71:0/446832358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68f00b0a70 msgr2=0x7f68f0169ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:50.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.606+0000 7f68f7bff700 1 --2- 172.21.15.71:0/446832358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68f00b0a70 0x7f68f0169ad0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f68e0013000 tx=0x7f68e0017000 comp rx=0 tx=0).stop 2023-10-09T06:42:50.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.606+0000 7f68f7bff700 1 -- 172.21.15.71:0/446832358 shutdown_connections 2023-10-09T06:42:50.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.606+0000 7f68f7bff700 1 --2- 172.21.15.71:0/446832358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68f015ac80 0x7f68f0144f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.606+0000 7f68f7bff700 1 --2- 172.21.15.71:0/446832358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68f0069e80 0x7f68f01575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.606+0000 7f68f7bff700 1 --2- 172.21.15.71:0/446832358 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f68d4066f30 0x7f68d40693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.606+0000 7f68f7bff700 1 --2- 172.21.15.71:0/446832358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68f00b0a70 0x7f68f0169ad0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.606+0000 7f68f7bff700 1 -- 172.21.15.71:0/446832358 >> 172.21.15.71:0/446832358 conn(0x7f68f0068e10 msgr2=0x7f68f01562d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:50.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.606+0000 7f68f7bff700 1 -- 172.21.15.71:0/446832358 shutdown_connections 2023-10-09T06:42:50.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.606+0000 7f68f7bff700 1 -- 172.21.15.71:0/446832358 wait complete. 2023-10-09T06:42:50.624 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:42:50.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.807+0000 7ff20919d700 1 Processor -- start 2023-10-09T06:42:50.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.807+0000 7ff20919d700 1 -- start start 2023-10-09T06:42:50.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.808+0000 7ff20919d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2040b16d0 0x7ff2040b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:50.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.808+0000 7ff20919d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff2040b33b0 0x7ff2040b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:50.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.808+0000 7ff20919d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2040b2080 con 0x7ff2040b4e70 2023-10-09T06:42:50.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.808+0000 7ff20919d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2040cfb00 con 0x7ff2040b33b0 2023-10-09T06:42:50.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.808+0000 7ff20919d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2040b5c40 con 0x7ff2040b16d0 2023-10-09T06:42:50.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.808+0000 7ff20899c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff2040b33b0 0x7ff2040b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:50.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.808+0000 7ff20899c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff2040b33b0 0x7ff2040b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52430/0 (socket says 172.21.15.71:52430) 2023-10-09T06:42:50.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.808+0000 7ff20899c700 1 -- 172.21.15.71:0/3598095325 learned_addr learned my addr 172.21.15.71:0/3598095325 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:50.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.809+0000 7ff2037fe700 1 --2- 172.21.15.71:0/3598095325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2040b16d0 0x7ff2040b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:50.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.809+0000 7ff20899c700 1 -- 172.21.15.71:0/3598095325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2040b16d0 msgr2=0x7ff2040b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:50.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.809+0000 7ff20899c700 1 --2- 172.21.15.71:0/3598095325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2040b16d0 0x7ff2040b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.809+0000 7ff20899c700 1 -- 172.21.15.71:0/3598095325 >> v1:172.21.15.179:6789/0 conn(0x7ff2040b4e70 legacy=0x7ff2040ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:50.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.809+0000 7ff20899c700 1 -- 172.21.15.71:0/3598095325 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2040b5f20 con 0x7ff2040b33b0 2023-10-09T06:42:50.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.809+0000 7ff20899c700 1 --2- 172.21.15.71:0/3598095325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2040b33b0 0x7ff2040b3830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009f20 tx=0x7ff1fc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ba08e17a545acf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:50.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.809+0000 7ff202ffd700 1 -- 172.21.15.71:0/3598095325 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc00e070 con 0x7ff2040b33b0 2023-10-09T06:42:50.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.809+0000 7ff202ffd700 1 -- 172.21.15.71:0/3598095325 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc00ba80 con 0x7ff2040b33b0 2023-10-09T06:42:50.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.809+0000 7ff202ffd700 1 -- 172.21.15.71:0/3598095325 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc0092e0 con 0x7ff2040b33b0 2023-10-09T06:42:50.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.810+0000 7ff20919d700 1 -- 172.21.15.71:0/3598095325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2040b33b0 msgr2=0x7ff2040b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:50.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.810+0000 7ff20919d700 1 --2- 172.21.15.71:0/3598095325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2040b33b0 0x7ff2040b3830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009f20 tx=0x7ff1fc009840 comp rx=0 tx=0).stop 2023-10-09T06:42:50.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.810+0000 7ff20919d700 1 -- 172.21.15.71:0/3598095325 shutdown_connections 2023-10-09T06:42:50.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.810+0000 7ff20919d700 1 --2- 172.21.15.71:0/3598095325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2040b33b0 0x7ff2040b3830 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.810+0000 7ff20919d700 1 --2- 172.21.15.71:0/3598095325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2040b16d0 0x7ff2040b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.810+0000 7ff20919d700 1 -- 172.21.15.71:0/3598095325 >> 172.21.15.71:0/3598095325 conn(0x7ff2040d10c0 msgr2=0x7ff2040affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:50.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.810+0000 7ff20919d700 1 -- 172.21.15.71:0/3598095325 shutdown_connections 2023-10-09T06:42:50.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.810+0000 7ff20919d700 1 -- 172.21.15.71:0/3598095325 wait complete. 2023-10-09T06:42:50.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.811+0000 7ff20919d700 1 Processor -- start 2023-10-09T06:42:50.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.812+0000 7ff20919d700 1 -- start start 2023-10-09T06:42:50.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.812+0000 7ff20919d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2040b16d0 0x7ff204068390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:50.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.812+0000 7ff20919d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2040b33b0 0x7ff2040cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:50.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.812+0000 7ff20919d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2040b4e70 0x7ff2040c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:50.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.812+0000 7ff20919d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff204068a20 con 0x7ff2040b33b0 2023-10-09T06:42:50.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.812+0000 7ff20919d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff204068d00 con 0x7ff2040b16d0 2023-10-09T06:42:50.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.812+0000 7ff20919d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff204068fe0 con 0x7ff2040b4e70 2023-10-09T06:42:50.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.813+0000 7ff2037fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2040b33b0 0x7ff2040cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:50.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.813+0000 7ff2037fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2040b33b0 0x7ff2040cbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52442/0 (socket says 172.21.15.71:52442) 2023-10-09T06:42:50.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.813+0000 7ff2037fe700 1 -- 172.21.15.71:0/50270980 learned_addr learned my addr 172.21.15.71:0/50270980 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:50.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.813+0000 7ff203fff700 1 --2- 172.21.15.71:0/50270980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2040b16d0 0x7ff204068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:50.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.813+0000 7ff20899c700 1 --2- 172.21.15.71:0/50270980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2040b4e70 0x7ff2040c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:50.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.813+0000 7ff2037fe700 1 -- 172.21.15.71:0/50270980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2040b4e70 msgr2=0x7ff2040c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:50.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.813+0000 7ff2037fe700 1 --2- 172.21.15.71:0/50270980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2040b4e70 0x7ff2040c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.813+0000 7ff2037fe700 1 -- 172.21.15.71:0/50270980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2040b16d0 msgr2=0x7ff204068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:50.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.813+0000 7ff2037fe700 1 --2- 172.21.15.71:0/50270980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2040b16d0 0x7ff204068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:50.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.813+0000 7ff2037fe700 1 -- 172.21.15.71:0/50270980 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc009ae0 con 0x7ff2040b33b0 2023-10-09T06:42:50.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.813+0000 7ff2037fe700 1 --2- 172.21.15.71:0/50270980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2040b33b0 0x7ff2040cbec0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800d890 tx=0x7ff1f8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:50.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.813+0000 7ff1ebfff700 1 -- 172.21.15.71:0/50270980 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f80125f0 con 0x7ff2040b33b0 2023-10-09T06:42:50.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.814+0000 7ff1ebfff700 1 -- 172.21.15.71:0/50270980 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f8012770 con 0x7ff2040b33b0 2023-10-09T06:42:50.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.814+0000 7ff20919d700 1 -- 172.21.15.71:0/50270980 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2040692c0 con 0x7ff2040b33b0 2023-10-09T06:42:50.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.814+0000 7ff1ebfff700 1 -- 172.21.15.71:0/50270980 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8012b30 con 0x7ff2040b33b0 2023-10-09T06:42:50.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.814+0000 7ff20919d700 1 -- 172.21.15.71:0/50270980 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2040c97b0 con 0x7ff2040b33b0 2023-10-09T06:42:50.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.815+0000 7ff20919d700 1 -- 172.21.15.71:0/50270980 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2040c99d0 con 0x7ff2040b33b0 2023-10-09T06:42:50.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.815+0000 7ff1ebfff700 1 -- 172.21.15.71:0/50270980 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1f801e460 con 0x7ff2040b33b0 2023-10-09T06:42:50.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.816+0000 7ff1ebfff700 1 --2- 172.21.15.71:0/50270980 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff1f0066f30 0x7ff1f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:50.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.816+0000 7ff1ebfff700 1 -- 172.21.15.71:0/50270980 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff1f8084d10 con 0x7ff2040b33b0 2023-10-09T06:42:50.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.817+0000 7ff203fff700 1 --2- 172.21.15.71:0/50270980 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff1f0066f30 0x7ff1f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:50.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.817+0000 7ff203fff700 1 --2- 172.21.15.71:0/50270980 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff1f0066f30 0x7ff1f00693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff20415bf90 tx=0x7ff1f4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:50.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:50.820+0000 7ff1ebfff700 1 -- 172.21.15.71:0/50270980 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1f808a020 con 0x7ff2040b33b0 2023-10-09T06:42:51.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.011+0000 7ff20919d700 1 -- 172.21.15.71:0/50270980 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff20404bb80 con 0x7ff2040b33b0 2023-10-09T06:42:51.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.012+0000 7ff1ebfff700 1 -- 172.21.15.71:0/50270980 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff1f8051ee0 con 0x7ff2040b33b0 2023-10-09T06:42:51.013 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-09T06:42:51.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.014+0000 7ff20919d700 1 -- 172.21.15.71:0/50270980 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff1f0066f30 msgr2=0x7ff1f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:51.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.014+0000 7ff20919d700 1 --2- 172.21.15.71:0/50270980 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff1f0066f30 0x7ff1f00693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff20415bf90 tx=0x7ff1f4009040 comp rx=0 tx=0).stop 2023-10-09T06:42:51.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.014+0000 7ff20919d700 1 -- 172.21.15.71:0/50270980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2040b33b0 msgr2=0x7ff2040cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:51.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.014+0000 7ff20919d700 1 --2- 172.21.15.71:0/50270980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2040b33b0 0x7ff2040cbec0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800d890 tx=0x7ff1f8008040 comp rx=0 tx=0).stop 2023-10-09T06:42:51.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.014+0000 7ff20919d700 1 -- 172.21.15.71:0/50270980 shutdown_connections 2023-10-09T06:42:51.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.014+0000 7ff20919d700 1 --2- 172.21.15.71:0/50270980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2040b4e70 0x7ff2040c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.014+0000 7ff20919d700 1 --2- 172.21.15.71:0/50270980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2040b16d0 0x7ff204068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.014+0000 7ff20919d700 1 --2- 172.21.15.71:0/50270980 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff1f0066f30 0x7ff1f00693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.014+0000 7ff20919d700 1 --2- 172.21.15.71:0/50270980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2040b33b0 0x7ff2040cbec0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.014+0000 7ff20919d700 1 -- 172.21.15.71:0/50270980 >> 172.21.15.71:0/50270980 conn(0x7ff2040d10c0 msgr2=0x7ff2040b4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:51.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.014+0000 7ff20919d700 1 -- 172.21.15.71:0/50270980 shutdown_connections 2023-10-09T06:42:51.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.014+0000 7ff20919d700 1 -- 172.21.15.71:0/50270980 wait complete. 2023-10-09T06:42:51.032 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:42:51.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.211+0000 7f01f2dff700 1 Processor -- start 2023-10-09T06:42:51.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.211+0000 7f01f2dff700 1 -- start start 2023-10-09T06:42:51.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.213+0000 7f01f2dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ec0b1420 0x7f01ec0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:51.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.213+0000 7f01f2dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f01ec0ccf90 0x7f01ec0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:51.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.213+0000 7f01f2dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ec0cc300 con 0x7f01ec0cbf30 2023-10-09T06:42:51.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.213+0000 7f01f2dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ec156bf0 con 0x7f01ec0ccf90 2023-10-09T06:42:51.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.213+0000 7f01f2dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec0ae950 con 0x7f01ec0b1420 2023-10-09T06:42:51.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.213+0000 7f01f139c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f01ec0ccf90 0x7f01ec0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:51.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.213+0000 7f01f139c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f01ec0ccf90 0x7f01ec0c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52456/0 (socket says 172.21.15.71:52456) 2023-10-09T06:42:51.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.213+0000 7f01f139c700 1 -- 172.21.15.71:0/2499518880 learned_addr learned my addr 172.21.15.71:0/2499518880 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:51.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.213+0000 7f01f139c700 1 -- 172.21.15.71:0/2499518880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ec0b1420 msgr2=0x7f01ec0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:51.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.213+0000 7f01f139c700 1 --2- 172.21.15.71:0/2499518880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ec0b1420 0x7f01ec0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.213+0000 7f01f139c700 1 -- 172.21.15.71:0/2499518880 >> v1:172.21.15.179:6789/0 conn(0x7f01ec0cbf30 legacy=0x7f01ec0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:51.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.213+0000 7f01f139c700 1 -- 172.21.15.71:0/2499518880 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec0ad370 con 0x7f01ec0ccf90 2023-10-09T06:42:51.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.213+0000 7f01f139c700 1 --2- 172.21.15.71:0/2499518880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01ec0ccf90 0x7f01ec0c9740 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009f50 tx=0x7f01e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8603972e1368924e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:51.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.214+0000 7f01eb7fe700 1 -- 172.21.15.71:0/2499518880 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e400e070 con 0x7f01ec0ccf90 2023-10-09T06:42:51.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.214+0000 7f01eb7fe700 1 -- 172.21.15.71:0/2499518880 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e400ba30 con 0x7f01ec0ccf90 2023-10-09T06:42:51.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.214+0000 7f01eb7fe700 1 -- 172.21.15.71:0/2499518880 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e40092e0 con 0x7f01ec0ccf90 2023-10-09T06:42:51.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.214+0000 7f01f2dff700 1 -- 172.21.15.71:0/2499518880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01ec0ccf90 msgr2=0x7f01ec0c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:51.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.214+0000 7f01f2dff700 1 --2- 172.21.15.71:0/2499518880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01ec0ccf90 0x7f01ec0c9740 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009f50 tx=0x7f01e4009840 comp rx=0 tx=0).stop 2023-10-09T06:42:51.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.214+0000 7f01f2dff700 1 -- 172.21.15.71:0/2499518880 shutdown_connections 2023-10-09T06:42:51.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.214+0000 7f01f2dff700 1 --2- 172.21.15.71:0/2499518880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01ec0ccf90 0x7f01ec0c9740 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.214+0000 7f01f2dff700 1 --2- 172.21.15.71:0/2499518880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ec0b1420 0x7f01ec0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.214+0000 7f01f2dff700 1 -- 172.21.15.71:0/2499518880 >> 172.21.15.71:0/2499518880 conn(0x7f01ec06a320 msgr2=0x7f01ec0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:51.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.214+0000 7f01f2dff700 1 -- 172.21.15.71:0/2499518880 shutdown_connections 2023-10-09T06:42:51.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.214+0000 7f01f2dff700 1 -- 172.21.15.71:0/2499518880 wait complete. 2023-10-09T06:42:51.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.216+0000 7f01f2dff700 1 Processor -- start 2023-10-09T06:42:51.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.216+0000 7f01f2dff700 1 -- start start 2023-10-09T06:42:51.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.217+0000 7f01f2dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01ec0b1420 0x7f01ec0ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:51.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.217+0000 7f01f2dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01ec0cbf30 0x7f01ec0a9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:51.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.217+0000 7f01f2dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ec0ccf90 0x7f01ec0c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:51.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.217+0000 7f01f2dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec144800 con 0x7f01ec0b1420 2023-10-09T06:42:51.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.217+0000 7f01f2dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec0abe70 con 0x7f01ec0cbf30 2023-10-09T06:42:51.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.217+0000 7f01f2dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec0ac150 con 0x7f01ec0ccf90 2023-10-09T06:42:51.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.217+0000 7f01f0b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01ec0b1420 0x7f01ec0ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:51.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.217+0000 7f01f0b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01ec0b1420 0x7f01ec0ab7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52460/0 (socket says 172.21.15.71:52460) 2023-10-09T06:42:51.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.217+0000 7f01f0b9b700 1 -- 172.21.15.71:0/1960591203 learned_addr learned my addr 172.21.15.71:0/1960591203 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:51.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.217+0000 7f01ebfff700 1 --2- 172.21.15.71:0/1960591203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01ec0cbf30 0x7f01ec0a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:51.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.217+0000 7f01f139c700 1 --2- 172.21.15.71:0/1960591203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ec0ccf90 0x7f01ec0c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:51.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.217+0000 7f01f0b9b700 1 -- 172.21.15.71:0/1960591203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ec0ccf90 msgr2=0x7f01ec0c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:51.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.217+0000 7f01f0b9b700 1 --2- 172.21.15.71:0/1960591203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ec0ccf90 0x7f01ec0c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.217+0000 7f01f0b9b700 1 -- 172.21.15.71:0/1960591203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01ec0cbf30 msgr2=0x7f01ec0a9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:51.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.217+0000 7f01f0b9b700 1 --2- 172.21.15.71:0/1960591203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01ec0cbf30 0x7f01ec0a9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.217+0000 7f01f0b9b700 1 -- 172.21.15.71:0/1960591203 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e4009ae0 con 0x7f01ec0b1420 2023-10-09T06:42:51.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.217+0000 7f01f139c700 1 --2- 172.21.15.71:0/1960591203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ec0ccf90 0x7f01ec0c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:51.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.218+0000 7f01f0b9b700 1 --2- 172.21.15.71:0/1960591203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01ec0b1420 0x7f01ec0ab7b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f01e000b600 tx=0x7f01e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:51.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.218+0000 7f01e8ff9700 1 -- 172.21.15.71:0/1960591203 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e000f510 con 0x7f01ec0b1420 2023-10-09T06:42:51.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.218+0000 7f01e8ff9700 1 -- 172.21.15.71:0/1960591203 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e000f670 con 0x7f01ec0b1420 2023-10-09T06:42:51.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.218+0000 7f01f2dff700 1 -- 172.21.15.71:0/1960591203 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ec0ac430 con 0x7f01ec0b1420 2023-10-09T06:42:51.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.218+0000 7f01e8ff9700 1 -- 172.21.15.71:0/1960591203 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e000fa30 con 0x7f01ec0b1420 2023-10-09T06:42:51.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.218+0000 7f01f2dff700 1 -- 172.21.15.71:0/1960591203 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ec0a97c0 con 0x7f01ec0b1420 2023-10-09T06:42:51.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.219+0000 7f01f2dff700 1 -- 172.21.15.71:0/1960591203 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ec04c3c0 con 0x7f01ec0b1420 2023-10-09T06:42:51.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.220+0000 7f01e8ff9700 1 -- 172.21.15.71:0/1960591203 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f01e001a400 con 0x7f01ec0b1420 2023-10-09T06:42:51.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.221+0000 7f01e8ff9700 1 --2- 172.21.15.71:0/1960591203 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f01d0066f30 0x7f01d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:51.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.221+0000 7f01e8ff9700 1 -- 172.21.15.71:0/1960591203 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f01e0083ff0 con 0x7f01ec0b1420 2023-10-09T06:42:51.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.221+0000 7f01ebfff700 1 --2- 172.21.15.71:0/1960591203 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f01d0066f30 0x7f01d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:51.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.222+0000 7f01ebfff700 1 --2- 172.21.15.71:0/1960591203 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f01d0066f30 0x7f01d00693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f01d8006fd0 tx=0x7f01d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:51.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.225+0000 7f01e8ff9700 1 -- 172.21.15.71:0/1960591203 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01e00512e0 con 0x7f01ec0b1420 2023-10-09T06:42:51.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.457+0000 7f01f2dff700 1 -- 172.21.15.71:0/1960591203 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01ec0ad650 con 0x7f01ec0b1420 2023-10-09T06:42:51.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.457+0000 7f01e8ff9700 1 -- 172.21.15.71:0/1960591203 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f01e0054900 con 0x7f01ec0b1420 2023-10-09T06:42:51.458 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:42:51.458 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3129948705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3129948705},{"type":"v1","addr":"172.21.15.71:6835","nonce":3129948705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2871867918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2871867918},{"type":"v1","addr":"172.21.15.71:6833","nonce":2871867918}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2975286987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2975286987},{"type":"v1","addr":"172.21.15.179:6836","nonce":2975286987}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:42:38.093747+0000","modified":"2023-10-09T06:42:41.642372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/3516898913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3516898913},{"type":"v1","addr":"172.21.15.179:6837","nonce":3516898913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T06:42:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.460+0000 7f01f2dff700 1 -- 172.21.15.71:0/1960591203 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f01d0066f30 msgr2=0x7f01d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.460+0000 7f01f2dff700 1 --2- 172.21.15.71:0/1960591203 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f01d0066f30 0x7f01d00693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f01d8006fd0 tx=0x7f01d8008040 comp rx=0 tx=0).stop 2023-10-09T06:42:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.460+0000 7f01f2dff700 1 -- 172.21.15.71:0/1960591203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01ec0b1420 msgr2=0x7f01ec0ab7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.460+0000 7f01f2dff700 1 --2- 172.21.15.71:0/1960591203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01ec0b1420 0x7f01ec0ab7b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f01e000b600 tx=0x7f01e00091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.460+0000 7f01f2dff700 1 -- 172.21.15.71:0/1960591203 shutdown_connections 2023-10-09T06:42:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.460+0000 7f01f2dff700 1 --2- 172.21.15.71:0/1960591203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ec0ccf90 0x7f01ec0c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.460+0000 7f01f2dff700 1 --2- 172.21.15.71:0/1960591203 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f01d0066f30 0x7f01d00693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.460+0000 7f01f2dff700 1 --2- 172.21.15.71:0/1960591203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01ec0b1420 0x7f01ec0ab7b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.460+0000 7f01f2dff700 1 --2- 172.21.15.71:0/1960591203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01ec0cbf30 0x7f01ec0a9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.460+0000 7f01f2dff700 1 -- 172.21.15.71:0/1960591203 >> 172.21.15.71:0/1960591203 conn(0x7f01ec06a320 msgr2=0x7f01ec155fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:51.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.460+0000 7f01f2dff700 1 -- 172.21.15.71:0/1960591203 shutdown_connections 2023-10-09T06:42:51.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.460+0000 7f01f2dff700 1 -- 172.21.15.71:0/1960591203 wait complete. 2023-10-09T06:42:51.462 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2023-10-09T06:42:51.478 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:42:51.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.656+0000 7f2561fff700 1 Processor -- start 2023-10-09T06:42:51.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.656+0000 7f2561fff700 1 -- start start 2023-10-09T06:42:51.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.657+0000 7f2561fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f255c155c10 0x7f255c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:51.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.657+0000 7f2561fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f255c0ac230 0x7f255c0ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:51.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.657+0000 7f2561fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255c0ad930 con 0x7f255c0ccc40 2023-10-09T06:42:51.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.657+0000 7f2561fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f255c0acd20 con 0x7f255c155c10 2023-10-09T06:42:51.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.657+0000 7f2561fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f255c0ad000 con 0x7f255c0ac230 2023-10-09T06:42:51.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.658+0000 7f255b7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f255c155c10 0x7f255c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:51.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.658+0000 7f255bfff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f255c0ccc40 0x7f255c0af2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58296/0 (socket says 172.21.15.71:58296) 2023-10-09T06:42:51.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.658+0000 7f255bfff700 1 -- 172.21.15.71:0/1952307246 learned_addr learned my addr 172.21.15.71:0/1952307246 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:51.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.658+0000 7f255affd700 1 --2- 172.21.15.71:0/1952307246 >> v2:172.21.15.179:3300/0 conn(0x7f255c0ac230 0x7f255c0ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:51.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.658+0000 7f255a7fc700 1 -- 172.21.15.71:0/1952307246 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693079809 0 0) 0x7f255c0ad930 con 0x7f255c0ccc40 2023-10-09T06:42:51.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.658+0000 7f255a7fc700 1 -- 172.21.15.71:0/1952307246 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2544003570 con 0x7f255c0ccc40 2023-10-09T06:42:51.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.658+0000 7f255b7fe700 1 -- 172.21.15.71:0/1952307246 >> v2:172.21.15.179:3300/0 conn(0x7f255c0ac230 msgr2=0x7f255c0ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:51.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.658+0000 7f255b7fe700 1 --2- 172.21.15.71:0/1952307246 >> v2:172.21.15.179:3300/0 conn(0x7f255c0ac230 0x7f255c0ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.658+0000 7f255b7fe700 1 -- 172.21.15.71:0/1952307246 >> v1:172.21.15.71:6789/0 conn(0x7f255c0ccc40 legacy=0x7f255c0af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:51.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.658+0000 7f255b7fe700 1 -- 172.21.15.71:0/1952307246 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c0ad2e0 con 0x7f255c155c10 2023-10-09T06:42:51.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.658+0000 7f255b7fe700 1 --2- 172.21.15.71:0/1952307246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f255c155c10 0x7f255c155fe0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f255c065bb0 tx=0x7f254c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c48abec7d24ed1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:51.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.659+0000 7f255a7fc700 1 -- 172.21.15.71:0/1952307246 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c00f6b0 con 0x7f255c155c10 2023-10-09T06:42:51.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.659+0000 7f255a7fc700 1 -- 172.21.15.71:0/1952307246 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c00f830 con 0x7f255c155c10 2023-10-09T06:42:51.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.659+0000 7f255a7fc700 1 -- 172.21.15.71:0/1952307246 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c00fbf0 con 0x7f255c155c10 2023-10-09T06:42:51.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.659+0000 7f2561fff700 1 -- 172.21.15.71:0/1952307246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f255c155c10 msgr2=0x7f255c155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:51.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.659+0000 7f2561fff700 1 --2- 172.21.15.71:0/1952307246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f255c155c10 0x7f255c155fe0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f255c065bb0 tx=0x7f254c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.659+0000 7f2561fff700 1 -- 172.21.15.71:0/1952307246 shutdown_connections 2023-10-09T06:42:51.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.659+0000 7f2561fff700 1 --2- 172.21.15.71:0/1952307246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f255c155c10 0x7f255c155fe0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.659+0000 7f2561fff700 1 --2- 172.21.15.71:0/1952307246 >> v2:172.21.15.179:3300/0 conn(0x7f255c0ac230 0x7f255c0ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.659+0000 7f2561fff700 1 -- 172.21.15.71:0/1952307246 >> 172.21.15.71:0/1952307246 conn(0x7f255c06a320 msgr2=0x7f255c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:51.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.659+0000 7f2561fff700 1 -- 172.21.15.71:0/1952307246 shutdown_connections 2023-10-09T06:42:51.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.659+0000 7f2561fff700 1 -- 172.21.15.71:0/1952307246 wait complete. 2023-10-09T06:42:51.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.661+0000 7f2561fff700 1 Processor -- start 2023-10-09T06:42:51.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.661+0000 7f2561fff700 1 -- start start 2023-10-09T06:42:51.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.662+0000 7f2561fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f255c0ac230 0x7f255c0c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:51.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.662+0000 7f2561fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f255c0ccc40 0x7f255c152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:51.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.662+0000 7f2561fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f255c155c10 0x7f255c16a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:51.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.662+0000 7f2561fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c16ac80 con 0x7f255c155c10 2023-10-09T06:42:51.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.662+0000 7f2561fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c0c4200 con 0x7f255c0ac230 2023-10-09T06:42:51.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.662+0000 7f2561fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c0c44e0 con 0x7f255c0ccc40 2023-10-09T06:42:51.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.662+0000 7f255bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f255c155c10 0x7f255c16a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:51.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.662+0000 7f255bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f255c155c10 0x7f255c16a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52468/0 (socket says 172.21.15.71:52468) 2023-10-09T06:42:51.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.662+0000 7f255bfff700 1 -- 172.21.15.71:0/747948668 learned_addr learned my addr 172.21.15.71:0/747948668 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:51.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.662+0000 7f255b7fe700 1 --2- 172.21.15.71:0/747948668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f255c0ac230 0x7f255c0c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:51.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.662+0000 7f255affd700 1 --2- 172.21.15.71:0/747948668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f255c0ccc40 0x7f255c152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:51.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.662+0000 7f255bfff700 1 -- 172.21.15.71:0/747948668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f255c0ccc40 msgr2=0x7f255c152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:51.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.662+0000 7f255bfff700 1 --2- 172.21.15.71:0/747948668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f255c0ccc40 0x7f255c152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.662+0000 7f255bfff700 1 -- 172.21.15.71:0/747948668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f255c0ac230 msgr2=0x7f255c0c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:51.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.662+0000 7f255bfff700 1 --2- 172.21.15.71:0/747948668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f255c0ac230 0x7f255c0c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.662+0000 7f255bfff700 1 -- 172.21.15.71:0/747948668 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c009420 con 0x7f255c155c10 2023-10-09T06:42:51.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.663+0000 7f255bfff700 1 --2- 172.21.15.71:0/747948668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f255c155c10 0x7f255c16a110 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2554001460 tx=0x7f2554001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:51.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.663+0000 7f25437fe700 1 -- 172.21.15.71:0/747948668 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255400ce80 con 0x7f255c155c10 2023-10-09T06:42:51.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.663+0000 7f25437fe700 1 -- 172.21.15.71:0/747948668 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255400ab70 con 0x7f255c155c10 2023-10-09T06:42:51.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.663+0000 7f2561fff700 1 -- 172.21.15.71:0/747948668 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f255c0c47c0 con 0x7f255c155c10 2023-10-09T06:42:51.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.663+0000 7f25437fe700 1 -- 172.21.15.71:0/747948668 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25540070f0 con 0x7f255c155c10 2023-10-09T06:42:51.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.663+0000 7f2561fff700 1 -- 172.21.15.71:0/747948668 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255c16a650 con 0x7f255c155c10 2023-10-09T06:42:51.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.664+0000 7f2561fff700 1 -- 172.21.15.71:0/747948668 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255c0c4ce0 con 0x7f255c155c10 2023-10-09T06:42:51.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.665+0000 7f25437fe700 1 -- 172.21.15.71:0/747948668 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2554007520 con 0x7f255c155c10 2023-10-09T06:42:51.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.666+0000 7f25437fe700 1 --2- 172.21.15.71:0/747948668 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2548066f30 0x7f25480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:51.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.666+0000 7f25437fe700 1 -- 172.21.15.71:0/747948668 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2554084ab0 con 0x7f255c155c10 2023-10-09T06:42:51.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.666+0000 7f255b7fe700 1 --2- 172.21.15.71:0/747948668 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2548066f30 0x7f25480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:51.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.667+0000 7f255b7fe700 1 --2- 172.21.15.71:0/747948668 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2548066f30 0x7f25480693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f255c065bb0 tx=0x7f254c019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:51.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.670+0000 7f25437fe700 1 -- 172.21.15.71:0/747948668 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f255c0c4ce0 con 0x7f255c155c10 2023-10-09T06:42:51.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.861+0000 7f2561fff700 1 -- 172.21.15.71:0/747948668 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f255c0c4ce0 con 0x7f255c155c10 2023-10-09T06:42:51.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.862+0000 7f25437fe700 1 -- 172.21.15.71:0/747948668 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f255c0c4ce0 con 0x7f255c155c10 2023-10-09T06:42:51.863 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:42:51.864 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":20,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:42:39.546192+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:42:35.828340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:42:37.071896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:42:51.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.865+0000 7f2561fff700 1 -- 172.21.15.71:0/747948668 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2548066f30 msgr2=0x7f25480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:51.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.865+0000 7f2561fff700 1 --2- 172.21.15.71:0/747948668 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2548066f30 0x7f25480693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f255c065bb0 tx=0x7f254c019000 comp rx=0 tx=0).stop 2023-10-09T06:42:51.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.865+0000 7f2561fff700 1 -- 172.21.15.71:0/747948668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f255c155c10 msgr2=0x7f255c16a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:51.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.865+0000 7f2561fff700 1 --2- 172.21.15.71:0/747948668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f255c155c10 0x7f255c16a110 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2554001460 tx=0x7f2554001ae0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.865+0000 7f2561fff700 1 -- 172.21.15.71:0/747948668 shutdown_connections 2023-10-09T06:42:51.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.865+0000 7f2561fff700 1 --2- 172.21.15.71:0/747948668 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2548066f30 0x7f25480693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.865+0000 7f2561fff700 1 --2- 172.21.15.71:0/747948668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f255c155c10 0x7f255c16a110 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.865+0000 7f2561fff700 1 --2- 172.21.15.71:0/747948668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f255c0ac230 0x7f255c0c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.865+0000 7f2561fff700 1 --2- 172.21.15.71:0/747948668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f255c0ccc40 0x7f255c152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:51.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.865+0000 7f2561fff700 1 -- 172.21.15.71:0/747948668 >> 172.21.15.71:0/747948668 conn(0x7f255c06a320 msgr2=0x7f255c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:51.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.865+0000 7f2561fff700 1 -- 172.21.15.71:0/747948668 shutdown_connections 2023-10-09T06:42:51.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:51.865+0000 7f2561fff700 1 -- 172.21.15.71:0/747948668 wait complete. 2023-10-09T06:42:51.883 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:42:35.828340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:42:37.071896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:42:51.884 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:42:52.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.066+0000 7fe1b7bff700 1 Processor -- start 2023-10-09T06:42:52.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.066+0000 7fe1b7bff700 1 -- start start 2023-10-09T06:42:52.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.068+0000 7fe1b7bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe1b0069e80 0x7fe1b00c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:52.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.068+0000 7fe1b7bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b00af2f0 con 0x7fe1b00b0a70 2023-10-09T06:42:52.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.068+0000 7fe1b7bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b00af5d0 con 0x7fe1b015ac80 2023-10-09T06:42:52.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.068+0000 7fe1b7bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b00c8660 con 0x7fe1b0069e80 2023-10-09T06:42:52.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.068+0000 7fe1b619c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe1b00b0a70 0x7fe1b00c70b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58302/0 (socket says 172.21.15.71:58302) 2023-10-09T06:42:52.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.068+0000 7fe1b619c700 1 -- 172.21.15.71:0/3144313077 learned_addr learned my addr 172.21.15.71:0/3144313077 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:52.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.068+0000 7fe1b519a700 1 --2- 172.21.15.71:0/3144313077 >> v2:172.21.15.179:3300/0 conn(0x7fe1b0069e80 0x7fe1b00c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:52.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.068+0000 7fe1b4999700 1 -- 172.21.15.71:0/3144313077 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497255248 0 0) 0x7fe1b00af2f0 con 0x7fe1b00b0a70 2023-10-09T06:42:52.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.068+0000 7fe1b4999700 1 -- 172.21.15.71:0/3144313077 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe19c003570 con 0x7fe1b00b0a70 2023-10-09T06:42:52.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.069+0000 7fe1b519a700 1 -- 172.21.15.71:0/3144313077 >> v1:172.21.15.179:6789/0 conn(0x7fe1b015ac80 legacy=0x7fe1b0069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:52.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.069+0000 7fe1b519a700 1 -- 172.21.15.71:0/3144313077 >> v1:172.21.15.71:6789/0 conn(0x7fe1b00b0a70 legacy=0x7fe1b00c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:52.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.069+0000 7fe1b519a700 1 -- 172.21.15.71:0/3144313077 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b00c8940 con 0x7fe1b0069e80 2023-10-09T06:42:52.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.069+0000 7fe1b519a700 1 --2- 172.21.15.71:0/3144313077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1b0069e80 0x7fe1b00c6b70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00098e0 tx=0x7fe1a00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14715fb1ecbe1613 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:52.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.069+0000 7fe1b4999700 1 -- 172.21.15.71:0/3144313077 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a000b640 con 0x7fe1b0069e80 2023-10-09T06:42:52.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.069+0000 7fe1b4999700 1 -- 172.21.15.71:0/3144313077 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a000b7a0 con 0x7fe1b0069e80 2023-10-09T06:42:52.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.069+0000 7fe1b4999700 1 -- 172.21.15.71:0/3144313077 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a000bb40 con 0x7fe1b0069e80 2023-10-09T06:42:52.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.070+0000 7fe1b7bff700 1 -- 172.21.15.71:0/3144313077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1b0069e80 msgr2=0x7fe1b00c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:52.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.070+0000 7fe1b7bff700 1 --2- 172.21.15.71:0/3144313077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1b0069e80 0x7fe1b00c6b70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00098e0 tx=0x7fe1a00091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.070+0000 7fe1b7bff700 1 -- 172.21.15.71:0/3144313077 shutdown_connections 2023-10-09T06:42:52.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.070+0000 7fe1b7bff700 1 --2- 172.21.15.71:0/3144313077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1b0069e80 0x7fe1b00c6b70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.070+0000 7fe1b7bff700 1 -- 172.21.15.71:0/3144313077 >> 172.21.15.71:0/3144313077 conn(0x7fe1b0068e10 msgr2=0x7fe1b00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:52.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.070+0000 7fe1b7bff700 1 -- 172.21.15.71:0/3144313077 shutdown_connections 2023-10-09T06:42:52.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.070+0000 7fe1b7bff700 1 -- 172.21.15.71:0/3144313077 wait complete. 2023-10-09T06:42:52.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.071+0000 7fe1b7bff700 1 Processor -- start 2023-10-09T06:42:52.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.071+0000 7fe1b7bff700 1 -- start start 2023-10-09T06:42:52.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.072+0000 7fe1b7bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1b0069e80 0x7fe1b00ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.072+0000 7fe1b7bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1b00b0a70 0x7fe1b0169ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.072+0000 7fe1b7bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1b015ac80 0x7fe1b016a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.072+0000 7fe1b7bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b00cbb10 con 0x7fe1b0069e80 2023-10-09T06:42:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.072+0000 7fe1b7bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b00cb680 con 0x7fe1b015ac80 2023-10-09T06:42:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.072+0000 7fe1b7bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b00caa70 con 0x7fe1b00b0a70 2023-10-09T06:42:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.072+0000 7fe1b599b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1b0069e80 0x7fe1b00ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.073+0000 7fe1b599b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1b0069e80 0x7fe1b00ca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52478/0 (socket says 172.21.15.71:52478) 2023-10-09T06:42:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.073+0000 7fe1b599b700 1 -- 172.21.15.71:0/1301847611 learned_addr learned my addr 172.21.15.71:0/1301847611 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.073+0000 7fe1b619c700 1 --2- 172.21.15.71:0/1301847611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1b015ac80 0x7fe1b016a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.073+0000 7fe1b519a700 1 --2- 172.21.15.71:0/1301847611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1b00b0a70 0x7fe1b0169ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.073+0000 7fe1b599b700 1 -- 172.21.15.71:0/1301847611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1b00b0a70 msgr2=0x7fe1b0169ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.073+0000 7fe1b599b700 1 --2- 172.21.15.71:0/1301847611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1b00b0a70 0x7fe1b0169ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.073+0000 7fe1b599b700 1 -- 172.21.15.71:0/1301847611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1b015ac80 msgr2=0x7fe1b016a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.073+0000 7fe1b599b700 1 --2- 172.21.15.71:0/1301847611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1b015ac80 0x7fe1b016a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.073+0000 7fe1b599b700 1 -- 172.21.15.71:0/1301847611 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a0009420 con 0x7fe1b0069e80 2023-10-09T06:42:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.073+0000 7fe1b519a700 1 --2- 172.21.15.71:0/1301847611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1b00b0a70 0x7fe1b0169ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.073+0000 7fe1b599b700 1 --2- 172.21.15.71:0/1301847611 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1b0069e80 0x7fe1b00ca100 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00c4e0 tx=0x7fe1ac00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.073+0000 7fe1a5ffb700 1 -- 172.21.15.71:0/1301847611 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac011590 con 0x7fe1b0069e80 2023-10-09T06:42:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.073+0000 7fe1a5ffb700 1 -- 172.21.15.71:0/1301847611 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ac011710 con 0x7fe1b0069e80 2023-10-09T06:42:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.073+0000 7fe1a5ffb700 1 -- 172.21.15.71:0/1301847611 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac011ad0 con 0x7fe1b0069e80 2023-10-09T06:42:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.073+0000 7fe1b7bff700 1 -- 172.21.15.71:0/1301847611 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b00cad50 con 0x7fe1b0069e80 2023-10-09T06:42:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.074+0000 7fe1b7bff700 1 -- 172.21.15.71:0/1301847611 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b00cb310 con 0x7fe1b0069e80 2023-10-09T06:42:52.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.074+0000 7fe1b7bff700 1 -- 172.21.15.71:0/1301847611 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b004c3c0 con 0x7fe1b0069e80 2023-10-09T06:42:52.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.075+0000 7fe1a5ffb700 1 -- 172.21.15.71:0/1301847611 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe1ac01b3b0 con 0x7fe1b0069e80 2023-10-09T06:42:52.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.076+0000 7fe1a5ffb700 1 --2- 172.21.15.71:0/1301847611 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe194066fb0 0x7fe194069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:52.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.076+0000 7fe1a5ffb700 1 -- 172.21.15.71:0/1301847611 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe1ac083a50 con 0x7fe1b0069e80 2023-10-09T06:42:52.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.076+0000 7fe1b519a700 1 --2- 172.21.15.71:0/1301847611 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe194066fb0 0x7fe194069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:52.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.077+0000 7fe1b519a700 1 --2- 172.21.15.71:0/1301847611 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe194066fb0 0x7fe194069460 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00098e0 tx=0x7fe1a0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:52.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.080+0000 7fe1a5ffb700 1 -- 172.21.15.71:0/1301847611 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1ac050c20 con 0x7fe1b0069e80 2023-10-09T06:42:52.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.272+0000 7fe1b7bff700 1 -- 172.21.15.71:0/1301847611 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1b00cb4a0 con 0x7fe1b0069e80 2023-10-09T06:42:52.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.272+0000 7fe1a5ffb700 1 -- 172.21.15.71:0/1301847611 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1ac017070 con 0x7fe1b0069e80 2023-10-09T06:42:52.274 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T06:42:52.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.275+0000 7fe1b7bff700 1 -- 172.21.15.71:0/1301847611 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe194066fb0 msgr2=0x7fe194069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:52.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.275+0000 7fe1b7bff700 1 --2- 172.21.15.71:0/1301847611 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe194066fb0 0x7fe194069460 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00098e0 tx=0x7fe1a0017000 comp rx=0 tx=0).stop 2023-10-09T06:42:52.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.275+0000 7fe1b7bff700 1 -- 172.21.15.71:0/1301847611 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1b0069e80 msgr2=0x7fe1b00ca100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:52.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.275+0000 7fe1b7bff700 1 --2- 172.21.15.71:0/1301847611 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1b0069e80 0x7fe1b00ca100 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00c4e0 tx=0x7fe1ac00c8a0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.275+0000 7fe1b7bff700 1 -- 172.21.15.71:0/1301847611 shutdown_connections 2023-10-09T06:42:52.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.275+0000 7fe1b7bff700 1 --2- 172.21.15.71:0/1301847611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1b015ac80 0x7fe1b016a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.275+0000 7fe1b7bff700 1 --2- 172.21.15.71:0/1301847611 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe194066fb0 0x7fe194069460 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.275+0000 7fe1b7bff700 1 --2- 172.21.15.71:0/1301847611 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1b0069e80 0x7fe1b00ca100 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.275+0000 7fe1b7bff700 1 --2- 172.21.15.71:0/1301847611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1b00b0a70 0x7fe1b0169ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.275+0000 7fe1b7bff700 1 -- 172.21.15.71:0/1301847611 >> 172.21.15.71:0/1301847611 conn(0x7fe1b0068e10 msgr2=0x7fe1b0156400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:52.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.275+0000 7fe1b7bff700 1 -- 172.21.15.71:0/1301847611 shutdown_connections 2023-10-09T06:42:52.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.275+0000 7fe1b7bff700 1 -- 172.21.15.71:0/1301847611 wait complete. 2023-10-09T06:42:52.293 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:42:52.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.475+0000 7f7c8099d700 1 Processor -- start 2023-10-09T06:42:52.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.475+0000 7f7c8099d700 1 -- start start 2023-10-09T06:42:52.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.476+0000 7f7c8099d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c7c0b4e70 0x7f7c7c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:52.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.476+0000 7f7c8099d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7c7c0b16d0 0x7f7c7c0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:52.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.476+0000 7f7c8099d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7c0b2080 con 0x7f7c7c15d240 2023-10-09T06:42:52.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.476+0000 7f7c8099d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7c0cfb00 con 0x7f7c7c0b16d0 2023-10-09T06:42:52.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.476+0000 7f7c8099d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c0b5c40 con 0x7f7c7c0b4e70 2023-10-09T06:42:52.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.477+0000 7f7c7affd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7c7c0b16d0 0x7f7c7c0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:52.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.477+0000 7f7c7b7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c7c0b4e70 0x7f7c7c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:52.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.477+0000 7f7c7affd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7c7c0b16d0 0x7f7c7c0b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:49618/0 (socket says 172.21.15.71:49618) 2023-10-09T06:42:52.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.477+0000 7f7c7b7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c7c0b4e70 0x7f7c7c0ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:49516/0 (socket says 172.21.15.71:49516) 2023-10-09T06:42:52.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.477+0000 7f7c7b7fe700 1 -- 172.21.15.71:0/2312572915 learned_addr learned my addr 172.21.15.71:0/2312572915 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:52.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.477+0000 7f7c7bfff700 1 --1- 172.21.15.71:0/2312572915 >> v1:172.21.15.179:6789/0 conn(0x7f7c7c15d240 0x7f7c7c15d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:47430/0 (socket says 172.21.15.71:47430) 2023-10-09T06:42:52.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.477+0000 7f7c7b7fe700 1 -- 172.21.15.71:0/2312572915 >> v2:172.21.15.179:3300/0 conn(0x7f7c7c0b16d0 msgr2=0x7f7c7c0b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:52.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.477+0000 7f7c7b7fe700 1 --2- 172.21.15.71:0/2312572915 >> v2:172.21.15.179:3300/0 conn(0x7f7c7c0b16d0 0x7f7c7c0b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.477+0000 7f7c7b7fe700 1 -- 172.21.15.71:0/2312572915 >> v1:172.21.15.179:6789/0 conn(0x7f7c7c15d240 legacy=0x7f7c7c15d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:52.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.477+0000 7f7c7b7fe700 1 -- 172.21.15.71:0/2312572915 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c0b5f20 con 0x7f7c7c0b4e70 2023-10-09T06:42:52.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.477+0000 7f7c7b7fe700 1 --2- 172.21.15.71:0/2312572915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c7c0b4e70 0x7f7c7c0ccff0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c0099b0 tx=0x7f7c6c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f554fd6f684dd69 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:52.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.478+0000 7f7c7a7fc700 1 -- 172.21.15.71:0/2312572915 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c009ea0 con 0x7f7c7c0b4e70 2023-10-09T06:42:52.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.478+0000 7f7c7a7fc700 1 -- 172.21.15.71:0/2312572915 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6c00b860 con 0x7f7c7c0b4e70 2023-10-09T06:42:52.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.478+0000 7f7c7a7fc700 1 -- 172.21.15.71:0/2312572915 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c00bc00 con 0x7f7c7c0b4e70 2023-10-09T06:42:52.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.478+0000 7f7c8099d700 1 -- 172.21.15.71:0/2312572915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c7c0b4e70 msgr2=0x7f7c7c0ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:52.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.478+0000 7f7c8099d700 1 --2- 172.21.15.71:0/2312572915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c7c0b4e70 0x7f7c7c0ccff0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c0099b0 tx=0x7f7c6c009250 comp rx=0 tx=0).stop 2023-10-09T06:42:52.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.478+0000 7f7c8099d700 1 -- 172.21.15.71:0/2312572915 shutdown_connections 2023-10-09T06:42:52.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.478+0000 7f7c8099d700 1 --2- 172.21.15.71:0/2312572915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c7c0b4e70 0x7f7c7c0ccff0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.478+0000 7f7c8099d700 1 --2- 172.21.15.71:0/2312572915 >> v2:172.21.15.179:3300/0 conn(0x7f7c7c0b16d0 0x7f7c7c0b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.478+0000 7f7c8099d700 1 -- 172.21.15.71:0/2312572915 >> 172.21.15.71:0/2312572915 conn(0x7f7c7c0d10c0 msgr2=0x7f7c7c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:52.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.478+0000 7f7c8099d700 1 -- 172.21.15.71:0/2312572915 shutdown_connections 2023-10-09T06:42:52.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.478+0000 7f7c8099d700 1 -- 172.21.15.71:0/2312572915 wait complete. 2023-10-09T06:42:52.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.480+0000 7f7c8099d700 1 Processor -- start 2023-10-09T06:42:52.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.480+0000 7f7c8099d700 1 -- start start 2023-10-09T06:42:52.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.481+0000 7f7c8099d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c7c0b16d0 0x7f7c7c153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:52.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.481+0000 7f7c8099d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c7c0b4e70 0x7f7c7c1536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:52.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.481+0000 7f7c8099d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c7c15d240 0x7f7c7c16d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:52.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.481+0000 7f7c8099d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c155fb0 con 0x7f7c7c15d240 2023-10-09T06:42:52.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.481+0000 7f7c8099d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c1512d0 con 0x7f7c7c0b4e70 2023-10-09T06:42:52.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.481+0000 7f7c8099d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c155cd0 con 0x7f7c7c0b16d0 2023-10-09T06:42:52.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.481+0000 7f7c7bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c7c15d240 0x7f7c7c16d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:52.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.481+0000 7f7c7bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c7c15d240 0x7f7c7c16d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52488/0 (socket says 172.21.15.71:52488) 2023-10-09T06:42:52.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.481+0000 7f7c7bfff700 1 -- 172.21.15.71:0/962925298 learned_addr learned my addr 172.21.15.71:0/962925298 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:52.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.481+0000 7f7c7affd700 1 --2- 172.21.15.71:0/962925298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c7c0b4e70 0x7f7c7c1536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:52.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.481+0000 7f7c7b7fe700 1 --2- 172.21.15.71:0/962925298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c7c0b16d0 0x7f7c7c153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:52.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.481+0000 7f7c7bfff700 1 -- 172.21.15.71:0/962925298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c7c0b16d0 msgr2=0x7f7c7c153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:52.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.481+0000 7f7c7bfff700 1 --2- 172.21.15.71:0/962925298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c7c0b16d0 0x7f7c7c153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.481+0000 7f7c7bfff700 1 -- 172.21.15.71:0/962925298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c7c0b4e70 msgr2=0x7f7c7c1536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:52.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.481+0000 7f7c7bfff700 1 --2- 172.21.15.71:0/962925298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c7c0b4e70 0x7f7c7c1536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.482+0000 7f7c7bfff700 1 -- 172.21.15.71:0/962925298 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c0094f0 con 0x7f7c7c15d240 2023-10-09T06:42:52.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.482+0000 7f7c7bfff700 1 --2- 172.21.15.71:0/962925298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c7c15d240 0x7f7c7c16d560 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400cc70 tx=0x7f7c74001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:52.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.482+0000 7f7c637fe700 1 -- 172.21.15.71:0/962925298 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74005df0 con 0x7f7c7c15d240 2023-10-09T06:42:52.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.482+0000 7f7c637fe700 1 -- 172.21.15.71:0/962925298 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7400a5b0 con 0x7f7c7c15d240 2023-10-09T06:42:52.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.482+0000 7f7c8099d700 1 -- 172.21.15.71:0/962925298 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7c150c80 con 0x7f7c7c15d240 2023-10-09T06:42:52.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.482+0000 7f7c637fe700 1 -- 172.21.15.71:0/962925298 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7400a930 con 0x7f7c7c15d240 2023-10-09T06:42:52.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.482+0000 7f7c8099d700 1 -- 172.21.15.71:0/962925298 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7c16daa0 con 0x7f7c7c15d240 2023-10-09T06:42:52.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.483+0000 7f7c8099d700 1 -- 172.21.15.71:0/962925298 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7c150ae0 con 0x7f7c7c15d240 2023-10-09T06:42:52.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.484+0000 7f7c637fe700 1 -- 172.21.15.71:0/962925298 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c7400ace0 con 0x7f7c7c15d240 2023-10-09T06:42:52.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.485+0000 7f7c637fe700 1 --2- 172.21.15.71:0/962925298 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7c68066f30 0x7f7c680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:52.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.485+0000 7f7c637fe700 1 -- 172.21.15.71:0/962925298 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7c74084560 con 0x7f7c7c15d240 2023-10-09T06:42:52.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.485+0000 7f7c7b7fe700 1 --2- 172.21.15.71:0/962925298 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7c68066f30 0x7f7c680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:52.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.486+0000 7f7c7b7fe700 1 --2- 172.21.15.71:0/962925298 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7c68066f30 0x7f7c680693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c0099b0 tx=0x7f7c6c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:52.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.489+0000 7f7c637fe700 1 -- 172.21.15.71:0/962925298 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c7c150ae0 con 0x7f7c7c15d240 2023-10-09T06:42:52.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.680+0000 7f7c8099d700 1 -- 172.21.15.71:0/962925298 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c7c150ae0 con 0x7f7c7c15d240 2023-10-09T06:42:52.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.680+0000 7f7c637fe700 1 -- 172.21.15.71:0/962925298 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c7c150ae0 con 0x7f7c7c15d240 2023-10-09T06:42:52.682 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-09T06:42:52.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.683+0000 7f7c8099d700 1 -- 172.21.15.71:0/962925298 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7c68066f30 msgr2=0x7f7c680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:52.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.683+0000 7f7c8099d700 1 --2- 172.21.15.71:0/962925298 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7c68066f30 0x7f7c680693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c0099b0 tx=0x7f7c6c017000 comp rx=0 tx=0).stop 2023-10-09T06:42:52.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.683+0000 7f7c8099d700 1 -- 172.21.15.71:0/962925298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c7c15d240 msgr2=0x7f7c7c16d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:52.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.683+0000 7f7c8099d700 1 --2- 172.21.15.71:0/962925298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c7c15d240 0x7f7c7c16d560 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400cc70 tx=0x7f7c74001a70 comp rx=0 tx=0).stop 2023-10-09T06:42:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.683+0000 7f7c8099d700 1 -- 172.21.15.71:0/962925298 shutdown_connections 2023-10-09T06:42:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.683+0000 7f7c8099d700 1 --2- 172.21.15.71:0/962925298 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7c68066f30 0x7f7c680693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.683+0000 7f7c8099d700 1 --2- 172.21.15.71:0/962925298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c7c15d240 0x7f7c7c16d560 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.683+0000 7f7c8099d700 1 --2- 172.21.15.71:0/962925298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c7c0b16d0 0x7f7c7c153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.683+0000 7f7c8099d700 1 --2- 172.21.15.71:0/962925298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c7c0b4e70 0x7f7c7c1536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.683+0000 7f7c8099d700 1 -- 172.21.15.71:0/962925298 >> 172.21.15.71:0/962925298 conn(0x7f7c7c0d10c0 msgr2=0x7f7c7c069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.683+0000 7f7c8099d700 1 -- 172.21.15.71:0/962925298 shutdown_connections 2023-10-09T06:42:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.683+0000 7f7c8099d700 1 -- 172.21.15.71:0/962925298 wait complete. 2023-10-09T06:42:52.703 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:42:52.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.883+0000 7faf6df9d700 1 Processor -- start 2023-10-09T06:42:52.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.883+0000 7faf6df9d700 1 -- start start 2023-10-09T06:42:52.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.884+0000 7faf6df9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faf680b4e70 0x7faf680ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:52.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.884+0000 7faf6df9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7faf680b16d0 0x7faf680b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:52.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.884+0000 7faf6df9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf6815d240 0x7faf6815d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:52.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.884+0000 7faf6df9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf680b2080 con 0x7faf680b4e70 2023-10-09T06:42:52.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.884+0000 7faf6df9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf680cfb00 con 0x7faf680b16d0 2023-10-09T06:42:52.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.884+0000 7faf6df9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf680b5c40 con 0x7faf6815d240 2023-10-09T06:42:52.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.884+0000 7faf6cf9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faf680b4e70 0x7faf680ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:52.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.884+0000 7faf6cf9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faf680b4e70 0x7faf680ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52494/0 (socket says 172.21.15.71:52494) 2023-10-09T06:42:52.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.884+0000 7faf6cf9b700 1 -- 172.21.15.71:0/2950238555 learned_addr learned my addr 172.21.15.71:0/2950238555 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:52.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.885+0000 7faf67fff700 1 --2- 172.21.15.71:0/2950238555 >> v2:172.21.15.179:3300/0 conn(0x7faf680b16d0 0x7faf680b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:52.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.885+0000 7faf6d79c700 1 --2- 172.21.15.71:0/2950238555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf6815d240 0x7faf6815d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:52.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.885+0000 7faf6cf9b700 1 -- 172.21.15.71:0/2950238555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf6815d240 msgr2=0x7faf6815d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:52.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.885+0000 7faf6cf9b700 1 --2- 172.21.15.71:0/2950238555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf6815d240 0x7faf6815d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.885+0000 7faf6cf9b700 1 -- 172.21.15.71:0/2950238555 >> v2:172.21.15.179:3300/0 conn(0x7faf680b16d0 msgr2=0x7faf680b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:52.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.885+0000 7faf6cf9b700 1 --2- 172.21.15.71:0/2950238555 >> v2:172.21.15.179:3300/0 conn(0x7faf680b16d0 0x7faf680b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.885+0000 7faf6cf9b700 1 -- 172.21.15.71:0/2950238555 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf680b5f20 con 0x7faf680b4e70 2023-10-09T06:42:52.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.885+0000 7faf6cf9b700 1 --2- 172.21.15.71:0/2950238555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf680b4e70 0x7faf680ccff0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faf68089830 tx=0x7faf5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625bd10b6a84bb50 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:52.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.885+0000 7faf677fe700 1 -- 172.21.15.71:0/2950238555 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c00b860 con 0x7faf680b4e70 2023-10-09T06:42:52.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.885+0000 7faf677fe700 1 -- 172.21.15.71:0/2950238555 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c00b9c0 con 0x7faf680b4e70 2023-10-09T06:42:52.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.885+0000 7faf677fe700 1 -- 172.21.15.71:0/2950238555 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c00bd60 con 0x7faf680b4e70 2023-10-09T06:42:52.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.886+0000 7faf6df9d700 1 -- 172.21.15.71:0/2950238555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf680b4e70 msgr2=0x7faf680ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:52.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.886+0000 7faf6df9d700 1 --2- 172.21.15.71:0/2950238555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf680b4e70 0x7faf680ccff0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faf68089830 tx=0x7faf5c009250 comp rx=0 tx=0).stop 2023-10-09T06:42:52.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.886+0000 7faf6df9d700 1 -- 172.21.15.71:0/2950238555 shutdown_connections 2023-10-09T06:42:52.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.886+0000 7faf6df9d700 1 --2- 172.21.15.71:0/2950238555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf6815d240 0x7faf6815d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.886+0000 7faf6df9d700 1 --2- 172.21.15.71:0/2950238555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf680b4e70 0x7faf680ccff0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.886+0000 7faf6df9d700 1 --2- 172.21.15.71:0/2950238555 >> v2:172.21.15.179:3300/0 conn(0x7faf680b16d0 0x7faf680b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.886+0000 7faf6df9d700 1 -- 172.21.15.71:0/2950238555 >> 172.21.15.71:0/2950238555 conn(0x7faf680d10c0 msgr2=0x7faf680affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:52.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.886+0000 7faf6df9d700 1 -- 172.21.15.71:0/2950238555 shutdown_connections 2023-10-09T06:42:52.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.886+0000 7faf6df9d700 1 -- 172.21.15.71:0/2950238555 wait complete. 2023-10-09T06:42:52.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.887+0000 7faf6df9d700 1 Processor -- start 2023-10-09T06:42:52.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.888+0000 7faf6df9d700 1 -- start start 2023-10-09T06:42:52.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.888+0000 7faf6df9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf680b16d0 0x7faf68145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:52.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.889+0000 7faf6df9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf680b4e70 0x7faf6816a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:52.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.889+0000 7faf6df9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf6815d240 0x7faf680c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:52.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.889+0000 7faf6df9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf680c6740 con 0x7faf680b16d0 2023-10-09T06:42:52.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.889+0000 7faf6df9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf68146280 con 0x7faf6815d240 2023-10-09T06:42:52.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.889+0000 7faf6df9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6816a9b0 con 0x7faf680b4e70 2023-10-09T06:42:52.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.889+0000 7faf6cf9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf680b16d0 0x7faf68145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:52.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.889+0000 7faf6cf9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf680b16d0 0x7faf68145d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52504/0 (socket says 172.21.15.71:52504) 2023-10-09T06:42:52.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.889+0000 7faf6cf9b700 1 -- 172.21.15.71:0/1318011662 learned_addr learned my addr 172.21.15.71:0/1318011662 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:52.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.889+0000 7faf6cf9b700 1 -- 172.21.15.71:0/1318011662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf680b4e70 msgr2=0x7faf6816a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:52.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.889+0000 7faf6cf9b700 1 --2- 172.21.15.71:0/1318011662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf680b4e70 0x7faf6816a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.889+0000 7faf6cf9b700 1 -- 172.21.15.71:0/1318011662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf6815d240 msgr2=0x7faf680c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:52.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.889+0000 7faf6cf9b700 1 --2- 172.21.15.71:0/1318011662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf6815d240 0x7faf680c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:52.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.889+0000 7faf6cf9b700 1 -- 172.21.15.71:0/1318011662 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c0094f0 con 0x7faf680b16d0 2023-10-09T06:42:52.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.889+0000 7faf6cf9b700 1 --2- 172.21.15.71:0/1318011662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf680b16d0 0x7faf68145d40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faf68070dd0 tx=0x7faf5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:52.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.889+0000 7faf64ff9700 1 -- 172.21.15.71:0/1318011662 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c024440 con 0x7faf680b16d0 2023-10-09T06:42:52.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.890+0000 7faf64ff9700 1 -- 172.21.15.71:0/1318011662 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c0245a0 con 0x7faf680b16d0 2023-10-09T06:42:52.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.890+0000 7faf6df9d700 1 -- 172.21.15.71:0/1318011662 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6816ac90 con 0x7faf680b16d0 2023-10-09T06:42:52.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.890+0000 7faf64ff9700 1 -- 172.21.15.71:0/1318011662 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c024960 con 0x7faf680b16d0 2023-10-09T06:42:52.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.890+0000 7faf6df9d700 1 -- 172.21.15.71:0/1318011662 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf680c6360 con 0x7faf680b16d0 2023-10-09T06:42:52.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.891+0000 7faf6df9d700 1 -- 172.21.15.71:0/1318011662 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf68088990 con 0x7faf680b16d0 2023-10-09T06:42:52.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.891+0000 7faf64ff9700 1 -- 172.21.15.71:0/1318011662 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf5c01a420 con 0x7faf680b16d0 2023-10-09T06:42:52.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.893+0000 7faf64ff9700 1 --2- 172.21.15.71:0/1318011662 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faf4c066f30 0x7faf4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:52.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.893+0000 7faf64ff9700 1 -- 172.21.15.71:0/1318011662 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faf5c086550 con 0x7faf680b16d0 2023-10-09T06:42:52.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.893+0000 7faf67fff700 1 --2- 172.21.15.71:0/1318011662 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faf4c066f30 0x7faf4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:52.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.894+0000 7faf67fff700 1 --2- 172.21.15.71:0/1318011662 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faf4c066f30 0x7faf4c0693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faf54009a40 tx=0x7faf54008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:52.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:52.898+0000 7faf64ff9700 1 -- 172.21.15.71:0/1318011662 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf5c053720 con 0x7faf680b16d0 2023-10-09T06:42:53.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.089+0000 7faf6df9d700 1 -- 172.21.15.71:0/1318011662 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf6804bb80 con 0x7faf680b16d0 2023-10-09T06:42:53.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.089+0000 7faf64ff9700 1 -- 172.21.15.71:0/1318011662 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf5c056d40 con 0x7faf680b16d0 2023-10-09T06:42:53.090 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-09T06:42:53.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.091+0000 7faf6df9d700 1 -- 172.21.15.71:0/1318011662 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faf4c066f30 msgr2=0x7faf4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:53.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.091+0000 7faf6df9d700 1 --2- 172.21.15.71:0/1318011662 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faf4c066f30 0x7faf4c0693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faf54009a40 tx=0x7faf54008040 comp rx=0 tx=0).stop 2023-10-09T06:42:53.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.091+0000 7faf6df9d700 1 -- 172.21.15.71:0/1318011662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf680b16d0 msgr2=0x7faf68145d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:53.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.091+0000 7faf6df9d700 1 --2- 172.21.15.71:0/1318011662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf680b16d0 0x7faf68145d40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faf68070dd0 tx=0x7faf5c017000 comp rx=0 tx=0).stop 2023-10-09T06:42:53.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.092+0000 7faf6df9d700 1 -- 172.21.15.71:0/1318011662 shutdown_connections 2023-10-09T06:42:53.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.092+0000 7faf6df9d700 1 --2- 172.21.15.71:0/1318011662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf6815d240 0x7faf680c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:53.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.092+0000 7faf6df9d700 1 --2- 172.21.15.71:0/1318011662 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faf4c066f30 0x7faf4c0693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:53.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.092+0000 7faf6df9d700 1 --2- 172.21.15.71:0/1318011662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf680b16d0 0x7faf68145d40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:53.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.092+0000 7faf6df9d700 1 --2- 172.21.15.71:0/1318011662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf680b4e70 0x7faf6816a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:53.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.092+0000 7faf6df9d700 1 -- 172.21.15.71:0/1318011662 >> 172.21.15.71:0/1318011662 conn(0x7faf680d10c0 msgr2=0x7faf6815c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:53.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.092+0000 7faf6df9d700 1 -- 172.21.15.71:0/1318011662 shutdown_connections 2023-10-09T06:42:53.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.092+0000 7faf6df9d700 1 -- 172.21.15.71:0/1318011662 wait complete. 2023-10-09T06:42:53.110 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:42:53.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.289+0000 7f04f01ff700 1 Processor -- start 2023-10-09T06:42:53.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.289+0000 7f04f01ff700 1 -- start start 2023-10-09T06:42:53.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.290+0000 7f04f01ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f04e81578b0 0x7f04e8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:53.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.290+0000 7f04f01ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e80af2f0 0x7f04e80af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:53.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.290+0000 7f04f01ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e80ad930 con 0x7f04e8155c10 2023-10-09T06:42:53.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.290+0000 7f04f01ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e80b0c80 con 0x7f04e81578b0 2023-10-09T06:42:53.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.290+0000 7f04f01ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e80acd20 con 0x7f04e80af2f0 2023-10-09T06:42:53.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.291+0000 7f04ed79a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f04e81578b0 0x7f04e8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:53.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.291+0000 7f04ed79a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f04e81578b0 0x7f04e8155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52510/0 (socket says 172.21.15.71:52510) 2023-10-09T06:42:53.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.291+0000 7f04ed79a700 1 -- 172.21.15.71:0/937445392 learned_addr learned my addr 172.21.15.71:0/937445392 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:53.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.291+0000 7f04ee79c700 1 --2- 172.21.15.71:0/937445392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e80af2f0 0x7f04e80af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:53.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.291+0000 7f04ed79a700 1 -- 172.21.15.71:0/937445392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e80af2f0 msgr2=0x7f04e80af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:53.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.291+0000 7f04ed79a700 1 --2- 172.21.15.71:0/937445392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e80af2f0 0x7f04e80af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:53.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.291+0000 7f04ed79a700 1 -- 172.21.15.71:0/937445392 >> v1:172.21.15.179:6789/0 conn(0x7f04e8155c10 legacy=0x7f04e80ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:53.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.291+0000 7f04ed79a700 1 -- 172.21.15.71:0/937445392 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e80ad000 con 0x7f04e81578b0 2023-10-09T06:42:53.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.291+0000 7f04ee79c700 1 --2- 172.21.15.71:0/937445392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e80af2f0 0x7f04e80af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:53.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.291+0000 7f04ed79a700 1 --2- 172.21.15.71:0/937445392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04e81578b0 0x7f04e8155fe0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f04d80099b0 tx=0x7f04d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2162ce69b6304c8a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:53.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.292+0000 7f04ecf99700 1 -- 172.21.15.71:0/937445392 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d800b860 con 0x7f04e81578b0 2023-10-09T06:42:53.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.292+0000 7f04ecf99700 1 -- 172.21.15.71:0/937445392 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d800b9c0 con 0x7f04e81578b0 2023-10-09T06:42:53.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.292+0000 7f04ecf99700 1 -- 172.21.15.71:0/937445392 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d800bd60 con 0x7f04e81578b0 2023-10-09T06:42:53.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.292+0000 7f04f01ff700 1 -- 172.21.15.71:0/937445392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04e81578b0 msgr2=0x7f04e8155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:53.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.292+0000 7f04f01ff700 1 --2- 172.21.15.71:0/937445392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04e81578b0 0x7f04e8155fe0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f04d80099b0 tx=0x7f04d8009250 comp rx=0 tx=0).stop 2023-10-09T06:42:53.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.292+0000 7f04f01ff700 1 -- 172.21.15.71:0/937445392 shutdown_connections 2023-10-09T06:42:53.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.292+0000 7f04f01ff700 1 --2- 172.21.15.71:0/937445392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e80af2f0 0x7f04e80af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:53.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.292+0000 7f04f01ff700 1 --2- 172.21.15.71:0/937445392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04e81578b0 0x7f04e8155fe0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:53.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.292+0000 7f04f01ff700 1 -- 172.21.15.71:0/937445392 >> 172.21.15.71:0/937445392 conn(0x7f04e806a320 msgr2=0x7f04e80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:53.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.292+0000 7f04f01ff700 1 -- 172.21.15.71:0/937445392 shutdown_connections 2023-10-09T06:42:53.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.292+0000 7f04f01ff700 1 -- 172.21.15.71:0/937445392 wait complete. 2023-10-09T06:42:53.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.294+0000 7f04f01ff700 1 Processor -- start 2023-10-09T06:42:53.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.294+0000 7f04f01ff700 1 -- start start 2023-10-09T06:42:53.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.295+0000 7f04f01ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04e80af2f0 0x7f04e814e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:53.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.295+0000 7f04f01ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e8155c10 0x7f04e806e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:53.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.295+0000 7f04f01ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04e81578b0 0x7f04e806eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:53.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.295+0000 7f04f01ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e815b3e0 con 0x7f04e80af2f0 2023-10-09T06:42:53.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.295+0000 7f04f01ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e815b6c0 con 0x7f04e81578b0 2023-10-09T06:42:53.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.295+0000 7f04f01ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e815b9a0 con 0x7f04e8155c10 2023-10-09T06:42:53.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.295+0000 7f04edf9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04e80af2f0 0x7f04e814e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:53.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.295+0000 7f04edf9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04e80af2f0 0x7f04e814e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52518/0 (socket says 172.21.15.71:52518) 2023-10-09T06:42:53.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.295+0000 7f04edf9b700 1 -- 172.21.15.71:0/2042683402 learned_addr learned my addr 172.21.15.71:0/2042683402 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:53.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.295+0000 7f04ee79c700 1 --2- 172.21.15.71:0/2042683402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04e81578b0 0x7f04e806eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:53.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.295+0000 7f04ed79a700 1 --2- 172.21.15.71:0/2042683402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e8155c10 0x7f04e806e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:53.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.295+0000 7f04edf9b700 1 -- 172.21.15.71:0/2042683402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e8155c10 msgr2=0x7f04e806e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:53.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.295+0000 7f04edf9b700 1 --2- 172.21.15.71:0/2042683402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e8155c10 0x7f04e806e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:53.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.295+0000 7f04edf9b700 1 -- 172.21.15.71:0/2042683402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04e81578b0 msgr2=0x7f04e806eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:53.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.295+0000 7f04edf9b700 1 --2- 172.21.15.71:0/2042683402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04e81578b0 0x7f04e806eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:53.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.295+0000 7f04edf9b700 1 -- 172.21.15.71:0/2042683402 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d80094f0 con 0x7f04e80af2f0 2023-10-09T06:42:53.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.295+0000 7f04ed79a700 1 --2- 172.21.15.71:0/2042683402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e8155c10 0x7f04e806e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:53.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.295+0000 7f04ee79c700 1 --2- 172.21.15.71:0/2042683402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04e81578b0 0x7f04e806eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:53.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.296+0000 7f04edf9b700 1 --2- 172.21.15.71:0/2042683402 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04e80af2f0 0x7f04e814e440 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f04e400c590 tx=0x7f04e400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:53.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.296+0000 7f04ddffb700 1 -- 172.21.15.71:0/2042683402 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4011590 con 0x7f04e80af2f0 2023-10-09T06:42:53.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.296+0000 7f04ddffb700 1 -- 172.21.15.71:0/2042683402 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e40116f0 con 0x7f04e80af2f0 2023-10-09T06:42:53.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.296+0000 7f04ddffb700 1 -- 172.21.15.71:0/2042683402 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4011ab0 con 0x7f04e80af2f0 2023-10-09T06:42:53.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.296+0000 7f04f01ff700 1 -- 172.21.15.71:0/2042683402 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e815bc80 con 0x7f04e80af2f0 2023-10-09T06:42:53.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.296+0000 7f04f01ff700 1 -- 172.21.15.71:0/2042683402 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e815a620 con 0x7f04e80af2f0 2023-10-09T06:42:53.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.297+0000 7f04f01ff700 1 -- 172.21.15.71:0/2042683402 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e80690e0 con 0x7f04e80af2f0 2023-10-09T06:42:53.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.298+0000 7f04ddffb700 1 -- 172.21.15.71:0/2042683402 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04e401b3b0 con 0x7f04e80af2f0 2023-10-09T06:42:53.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.299+0000 7f04ddffb700 1 --2- 172.21.15.71:0/2042683402 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f04cc066f30 0x7f04cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:53.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.299+0000 7f04ddffb700 1 -- 172.21.15.71:0/2042683402 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f04e4083b80 con 0x7f04e80af2f0 2023-10-09T06:42:53.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.299+0000 7f04ed79a700 1 --2- 172.21.15.71:0/2042683402 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f04cc066f30 0x7f04cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:53.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.300+0000 7f04ed79a700 1 --2- 172.21.15.71:0/2042683402 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f04cc066f30 0x7f04cc0693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f04d80099b0 tx=0x7f04d8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:53.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.303+0000 7f04ddffb700 1 -- 172.21.15.71:0/2042683402 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04e4050d50 con 0x7f04e80af2f0 2023-10-09T06:42:53.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.534+0000 7f04f01ff700 1 -- 172.21.15.71:0/2042683402 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04e804c3c0 con 0x7f04e80af2f0 2023-10-09T06:42:53.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.535+0000 7f04ddffb700 1 -- 172.21.15.71:0/2042683402 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f04e4017020 con 0x7f04e80af2f0 2023-10-09T06:42:53.536 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:42:53.536 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3129948705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3129948705},{"type":"v1","addr":"172.21.15.71:6835","nonce":3129948705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2871867918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2871867918},{"type":"v1","addr":"172.21.15.71:6833","nonce":2871867918}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2975286987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2975286987},{"type":"v1","addr":"172.21.15.179:6836","nonce":2975286987}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:42:38.093747+0000","modified":"2023-10-09T06:42:41.642372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/3516898913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3516898913},{"type":"v1","addr":"172.21.15.179:6837","nonce":3516898913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T06:42:53.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.537+0000 7f04f01ff700 1 -- 172.21.15.71:0/2042683402 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f04cc066f30 msgr2=0x7f04cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:53.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.537+0000 7f04f01ff700 1 --2- 172.21.15.71:0/2042683402 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f04cc066f30 0x7f04cc0693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f04d80099b0 tx=0x7f04d8017000 comp rx=0 tx=0).stop 2023-10-09T06:42:53.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.537+0000 7f04f01ff700 1 -- 172.21.15.71:0/2042683402 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04e80af2f0 msgr2=0x7f04e814e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:53.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.537+0000 7f04f01ff700 1 --2- 172.21.15.71:0/2042683402 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04e80af2f0 0x7f04e814e440 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f04e400c590 tx=0x7f04e400c950 comp rx=0 tx=0).stop 2023-10-09T06:42:53.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.537+0000 7f04f01ff700 1 -- 172.21.15.71:0/2042683402 shutdown_connections 2023-10-09T06:42:53.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.537+0000 7f04f01ff700 1 --2- 172.21.15.71:0/2042683402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04e81578b0 0x7f04e806eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:53.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.537+0000 7f04f01ff700 1 --2- 172.21.15.71:0/2042683402 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f04cc066f30 0x7f04cc0693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:53.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.537+0000 7f04f01ff700 1 --2- 172.21.15.71:0/2042683402 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04e80af2f0 0x7f04e814e440 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:53.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.537+0000 7f04f01ff700 1 --2- 172.21.15.71:0/2042683402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e8155c10 0x7f04e806e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:53.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.537+0000 7f04f01ff700 1 -- 172.21.15.71:0/2042683402 >> 172.21.15.71:0/2042683402 conn(0x7f04e806a320 msgr2=0x7f04e80b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:53.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.537+0000 7f04f01ff700 1 -- 172.21.15.71:0/2042683402 shutdown_connections 2023-10-09T06:42:53.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.537+0000 7f04f01ff700 1 -- 172.21.15.71:0/2042683402 wait complete. 2023-10-09T06:42:53.539 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2023-10-09T06:42:53.557 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:42:53.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.738+0000 7f857619d700 1 Processor -- start 2023-10-09T06:42:53.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.738+0000 7f857619d700 1 -- start start 2023-10-09T06:42:53.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.739+0000 7f857619d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8570159420 0x7f85700b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:53.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.739+0000 7f857619d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f85701597f0 0x7f85700b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:53.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.740+0000 7f857619d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85700b11d0 con 0x7f857015d230 2023-10-09T06:42:53.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.740+0000 7f857619d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85700b14b0 con 0x7f85701597f0 2023-10-09T06:42:53.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.740+0000 7f857619d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85700b1790 con 0x7f8570159420 2023-10-09T06:42:53.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.740+0000 7f857499a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f85701597f0 0x7f85700b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:53.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.740+0000 7f857499a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f85701597f0 0x7f85700b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52534/0 (socket says 172.21.15.71:52534) 2023-10-09T06:42:53.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.740+0000 7f857519b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8570159420 0x7f85700b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:53.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.740+0000 7f857499a700 1 -- 172.21.15.71:0/2678921657 learned_addr learned my addr 172.21.15.71:0/2678921657 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:53.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.740+0000 7f857599c700 1 --1- 172.21.15.71:0/2678921657 >> v1:172.21.15.179:6789/0 conn(0x7f857015d230 0x7f857015d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:47460/0 (socket says 172.21.15.71:47460) 2023-10-09T06:42:53.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.740+0000 7f857499a700 1 -- 172.21.15.71:0/2678921657 >> v2:172.21.15.179:3300/0 conn(0x7f8570159420 msgr2=0x7f85700b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:53.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.740+0000 7f857499a700 1 --2- 172.21.15.71:0/2678921657 >> v2:172.21.15.179:3300/0 conn(0x7f8570159420 0x7f85700b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:53.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.740+0000 7f857499a700 1 -- 172.21.15.71:0/2678921657 >> v1:172.21.15.179:6789/0 conn(0x7f857015d230 legacy=0x7f857015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:53.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.740+0000 7f857499a700 1 -- 172.21.15.71:0/2678921657 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85700b1a70 con 0x7f85701597f0 2023-10-09T06:42:53.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.740+0000 7f857499a700 1 --2- 172.21.15.71:0/2678921657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85701597f0 0x7f85700b2270 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f85700b2f20 tx=0x7f8560009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4324537b029eb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:53.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.741+0000 7f8567fff700 1 -- 172.21.15.71:0/2678921657 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8560009e70 con 0x7f85701597f0 2023-10-09T06:42:53.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.741+0000 7f8567fff700 1 -- 172.21.15.71:0/2678921657 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856000b860 con 0x7f85701597f0 2023-10-09T06:42:53.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.741+0000 7f8567fff700 1 -- 172.21.15.71:0/2678921657 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856000bc00 con 0x7f85701597f0 2023-10-09T06:42:53.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.741+0000 7f857619d700 1 -- 172.21.15.71:0/2678921657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85701597f0 msgr2=0x7f85700b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:53.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.741+0000 7f857619d700 1 --2- 172.21.15.71:0/2678921657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85701597f0 0x7f85700b2270 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f85700b2f20 tx=0x7f8560009250 comp rx=0 tx=0).stop 2023-10-09T06:42:53.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.741+0000 7f857619d700 1 -- 172.21.15.71:0/2678921657 shutdown_connections 2023-10-09T06:42:53.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.741+0000 7f857619d700 1 --2- 172.21.15.71:0/2678921657 >> v2:172.21.15.179:3300/0 conn(0x7f8570159420 0x7f85700b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:53.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.741+0000 7f857619d700 1 --2- 172.21.15.71:0/2678921657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85701597f0 0x7f85700b2270 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:53.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.741+0000 7f857619d700 1 -- 172.21.15.71:0/2678921657 >> 172.21.15.71:0/2678921657 conn(0x7f85700d0660 msgr2=0x7f85700d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:53.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.741+0000 7f857619d700 1 -- 172.21.15.71:0/2678921657 shutdown_connections 2023-10-09T06:42:53.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.741+0000 7f857619d700 1 -- 172.21.15.71:0/2678921657 wait complete. 2023-10-09T06:42:53.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.743+0000 7f857619d700 1 Processor -- start 2023-10-09T06:42:53.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.743+0000 7f857619d700 1 -- start start 2023-10-09T06:42:53.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.744+0000 7f857619d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8570159420 0x7f85701543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:53.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.744+0000 7f857619d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85701597f0 0x7f85700c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:53.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.744+0000 7f857619d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f857015d230 0x7f85700b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:53.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.744+0000 7f857619d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85700c5d70 con 0x7f85701597f0 2023-10-09T06:42:53.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.744+0000 7f857619d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85700c6050 con 0x7f857015d230 2023-10-09T06:42:53.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.744+0000 7f857619d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85700c6330 con 0x7f8570159420 2023-10-09T06:42:53.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.744+0000 7f857499a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85701597f0 0x7f85700c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:53.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.744+0000 7f857499a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85701597f0 0x7f85700c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52538/0 (socket says 172.21.15.71:52538) 2023-10-09T06:42:53.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.744+0000 7f857499a700 1 -- 172.21.15.71:0/3962577746 learned_addr learned my addr 172.21.15.71:0/3962577746 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:53.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.744+0000 7f857519b700 1 --2- 172.21.15.71:0/3962577746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8570159420 0x7f85701543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:53.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.744+0000 7f857599c700 1 --2- 172.21.15.71:0/3962577746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f857015d230 0x7f85700b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:53.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.744+0000 7f857499a700 1 -- 172.21.15.71:0/3962577746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8570159420 msgr2=0x7f85701543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:53.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.744+0000 7f857499a700 1 --2- 172.21.15.71:0/3962577746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8570159420 0x7f85701543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:53.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.744+0000 7f857499a700 1 -- 172.21.15.71:0/3962577746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f857015d230 msgr2=0x7f85700b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:53.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.744+0000 7f857499a700 1 --2- 172.21.15.71:0/3962577746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f857015d230 0x7f85700b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:53.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.744+0000 7f857499a700 1 -- 172.21.15.71:0/3962577746 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85600094f0 con 0x7f85701597f0 2023-10-09T06:42:53.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.745+0000 7f857499a700 1 --2- 172.21.15.71:0/3962577746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85701597f0 0x7f85700c5400 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8570089340 tx=0x7f8560017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:53.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.745+0000 7f85657fa700 1 -- 172.21.15.71:0/3962577746 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8560011420 con 0x7f85701597f0 2023-10-09T06:42:53.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.745+0000 7f85657fa700 1 -- 172.21.15.71:0/3962577746 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85600115a0 con 0x7f85701597f0 2023-10-09T06:42:53.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.745+0000 7f85657fa700 1 -- 172.21.15.71:0/3962577746 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8560011960 con 0x7f85701597f0 2023-10-09T06:42:53.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.745+0000 7f857619d700 1 -- 172.21.15.71:0/3962577746 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85700c6610 con 0x7f85701597f0 2023-10-09T06:42:53.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.745+0000 7f857619d700 1 -- 172.21.15.71:0/3962577746 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8570154910 con 0x7f85701597f0 2023-10-09T06:42:53.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.746+0000 7f857619d700 1 -- 172.21.15.71:0/3962577746 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85700c7160 con 0x7f85701597f0 2023-10-09T06:42:53.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.747+0000 7f85657fa700 1 -- 172.21.15.71:0/3962577746 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f85600253f0 con 0x7f85701597f0 2023-10-09T06:42:53.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.747+0000 7f85657fa700 1 --2- 172.21.15.71:0/3962577746 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8554066f30 0x7f85540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:53.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.748+0000 7f85657fa700 1 -- 172.21.15.71:0/3962577746 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8560085f80 con 0x7f85701597f0 2023-10-09T06:42:53.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.748+0000 7f857519b700 1 --2- 172.21.15.71:0/3962577746 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8554066f30 0x7f85540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:53.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.749+0000 7f857519b700 1 --2- 172.21.15.71:0/3962577746 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8554066f30 0x7f85540693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8570068d70 tx=0x7f856c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:53.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.752+0000 7f85657fa700 1 -- 172.21.15.71:0/3962577746 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85700c7160 con 0x7f85701597f0 2023-10-09T06:42:53.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.943+0000 7f857619d700 1 -- 172.21.15.71:0/3962577746 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85700c7160 con 0x7f85701597f0 2023-10-09T06:42:53.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.944+0000 7f85657fa700 1 -- 172.21.15.71:0/3962577746 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f85700c7160 con 0x7f85701597f0 2023-10-09T06:42:53.945 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:42:53.945 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":20,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:42:39.546192+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:42:35.828340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:42:37.071896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:42:53.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.946+0000 7f857619d700 1 -- 172.21.15.71:0/3962577746 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8554066f30 msgr2=0x7f85540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:53.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.946+0000 7f857619d700 1 --2- 172.21.15.71:0/3962577746 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8554066f30 0x7f85540693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8570068d70 tx=0x7f856c00b040 comp rx=0 tx=0).stop 2023-10-09T06:42:53.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.946+0000 7f857619d700 1 -- 172.21.15.71:0/3962577746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85701597f0 msgr2=0x7f85700c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:53.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.946+0000 7f857619d700 1 --2- 172.21.15.71:0/3962577746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85701597f0 0x7f85700c5400 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8570089340 tx=0x7f8560017000 comp rx=0 tx=0).stop 2023-10-09T06:42:53.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.947+0000 7f857619d700 1 -- 172.21.15.71:0/3962577746 shutdown_connections 2023-10-09T06:42:53.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.947+0000 7f857619d700 1 --2- 172.21.15.71:0/3962577746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f857015d230 0x7f85700b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:53.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.947+0000 7f857619d700 1 --2- 172.21.15.71:0/3962577746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8570159420 0x7f85701543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:53.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.947+0000 7f857619d700 1 --2- 172.21.15.71:0/3962577746 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8554066f30 0x7f85540693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:53.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.947+0000 7f857619d700 1 --2- 172.21.15.71:0/3962577746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85701597f0 0x7f85700c5400 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:53.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.947+0000 7f857619d700 1 -- 172.21.15.71:0/3962577746 >> 172.21.15.71:0/3962577746 conn(0x7f85700d0660 msgr2=0x7f85701553d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:53.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.947+0000 7f857619d700 1 -- 172.21.15.71:0/3962577746 shutdown_connections 2023-10-09T06:42:53.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:53.947+0000 7f857619d700 1 -- 172.21.15.71:0/3962577746 wait complete. 2023-10-09T06:42:53.965 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:42:54.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.145+0000 7fa82e5ff700 1 Processor -- start 2023-10-09T06:42:54.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.145+0000 7fa82e5ff700 1 -- start start 2023-10-09T06:42:54.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.146+0000 7fa82e5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa8280b1850 0x7fa8280b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:54.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.147+0000 7fa82e5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8281579f0 0x7fa8280abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:54.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.147+0000 7fa82e5ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8280cb300 con 0x7fa8280ae680 2023-10-09T06:42:54.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.147+0000 7fa82e5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa82806fc30 con 0x7fa8280b1850 2023-10-09T06:42:54.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.147+0000 7fa82e5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8280cc260 con 0x7fa8281579f0 2023-10-09T06:42:54.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.147+0000 7fa8277fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa8280ae680 0x7fa8281572e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58310/0 (socket says 172.21.15.71:58310) 2023-10-09T06:42:54.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.147+0000 7fa8277fe700 1 -- 172.21.15.71:0/2458884793 learned_addr learned my addr 172.21.15.71:0/2458884793 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:54.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.147+0000 7fa826ffd700 1 -- 172.21.15.71:0/2458884793 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077710234 0 0) 0x7fa8280cb300 con 0x7fa8280ae680 2023-10-09T06:42:54.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.147+0000 7fa827fff700 1 --2- 172.21.15.71:0/2458884793 >> v2:172.21.15.179:3300/0 conn(0x7fa8280b1850 0x7fa8280b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:54.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.147+0000 7fa82cb9c700 1 --2- 172.21.15.71:0/2458884793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8281579f0 0x7fa8280abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:54.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.147+0000 7fa826ffd700 1 -- 172.21.15.71:0/2458884793 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa810003570 con 0x7fa8280ae680 2023-10-09T06:42:54.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.147+0000 7fa826ffd700 1 -- 172.21.15.71:0/2458884793 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2592552137 0 0) 0x7fa810003570 con 0x7fa8280ae680 2023-10-09T06:42:54.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.147+0000 7fa826ffd700 1 -- 172.21.15.71:0/2458884793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8281579f0 msgr2=0x7fa8280abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:54.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.147+0000 7fa826ffd700 1 --2- 172.21.15.71:0/2458884793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8281579f0 0x7fa8280abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:54.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.147+0000 7fa826ffd700 1 -- 172.21.15.71:0/2458884793 >> v2:172.21.15.179:3300/0 conn(0x7fa8280b1850 msgr2=0x7fa8280b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:54.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.147+0000 7fa826ffd700 1 --2- 172.21.15.71:0/2458884793 >> v2:172.21.15.179:3300/0 conn(0x7fa8280b1850 0x7fa8280b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:54.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.147+0000 7fa826ffd700 1 -- 172.21.15.71:0/2458884793 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8280cb5e0 con 0x7fa8280ae680 2023-10-09T06:42:54.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.148+0000 7fa826ffd700 1 -- 172.21.15.71:0/2458884793 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fa81c001470 con 0x7fa8280ae680 2023-10-09T06:42:54.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.148+0000 7fa826ffd700 1 -- 172.21.15.71:0/2458884793 >> v1:172.21.15.71:6789/0 conn(0x7fa8280ae680 legacy=0x7fa8281572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:54.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.148+0000 7fa826ffd700 1 --2- 172.21.15.71:0/2458884793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8281579f0 0x7fa810003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:54.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.148+0000 7fa826ffd700 1 --2- 172.21.15.71:0/2458884793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa810004010 0x7fa810004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:54.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.148+0000 7fa826ffd700 1 --2- 172.21.15.71:0/2458884793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa810004d50 0x7fa8100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:54.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.148+0000 7fa826ffd700 1 -- 172.21.15.71:0/2458884793 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82806fc30 con 0x7fa810004d50 2023-10-09T06:42:54.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.148+0000 7fa826ffd700 1 -- 172.21.15.71:0/2458884793 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8280cc260 con 0x7fa810004010 2023-10-09T06:42:54.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.148+0000 7fa826ffd700 1 -- 172.21.15.71:0/2458884793 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81000bab0 con 0x7fa8281579f0 2023-10-09T06:42:54.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.148+0000 7fa82cb9c700 1 --2- 172.21.15.71:0/2458884793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa810004d50 0x7fa8100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:54.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.148+0000 7fa827fff700 1 --2- 172.21.15.71:0/2458884793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8281579f0 0x7fa810003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:54.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.148+0000 7fa8277fe700 1 --2- 172.21.15.71:0/2458884793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa810004010 0x7fa810004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:54.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.148+0000 7fa82cb9c700 1 -- 172.21.15.71:0/2458884793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8281579f0 msgr2=0x7fa810003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:54.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.148+0000 7fa82cb9c700 1 --2- 172.21.15.71:0/2458884793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8281579f0 0x7fa810003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:54.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.148+0000 7fa82cb9c700 1 -- 172.21.15.71:0/2458884793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa810004010 msgr2=0x7fa810004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:54.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.148+0000 7fa82cb9c700 1 --2- 172.21.15.71:0/2458884793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa810004010 0x7fa810004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:54.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.148+0000 7fa82cb9c700 1 -- 172.21.15.71:0/2458884793 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa810003570 con 0x7fa810004d50 2023-10-09T06:42:54.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.148+0000 7fa82cb9c700 1 --2- 172.21.15.71:0/2458884793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa810004d50 0x7fa8100051c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa82000e210 tx=0x7fa82000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28e512f70b2912b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:54.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.149+0000 7fa826ffd700 1 -- 172.21.15.71:0/2458884793 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82000eac0 con 0x7fa810004d50 2023-10-09T06:42:54.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.149+0000 7fa826ffd700 1 -- 172.21.15.71:0/2458884793 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82000f040 con 0x7fa810004d50 2023-10-09T06:42:54.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.149+0000 7fa826ffd700 1 -- 172.21.15.71:0/2458884793 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82000ee70 con 0x7fa810004d50 2023-10-09T06:42:54.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.149+0000 7fa82e5ff700 1 -- 172.21.15.71:0/2458884793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa810004d50 msgr2=0x7fa8100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:54.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.149+0000 7fa82e5ff700 1 --2- 172.21.15.71:0/2458884793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa810004d50 0x7fa8100051c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa82000e210 tx=0x7fa82000b040 comp rx=0 tx=0).stop 2023-10-09T06:42:54.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.149+0000 7fa82cb9c700 1 -- 172.21.15.71:0/2458884793 reap_dead start 2023-10-09T06:42:54.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.149+0000 7fa82e5ff700 1 -- 172.21.15.71:0/2458884793 shutdown_connections 2023-10-09T06:42:54.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.149+0000 7fa82e5ff700 1 -- 172.21.15.71:0/2458884793 >> 172.21.15.71:0/2458884793 conn(0x7fa82806a320 msgr2=0x7fa8280cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:54.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.149+0000 7fa82e5ff700 1 -- 172.21.15.71:0/2458884793 shutdown_connections 2023-10-09T06:42:54.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.149+0000 7fa82e5ff700 1 -- 172.21.15.71:0/2458884793 wait complete. 2023-10-09T06:42:54.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.151+0000 7fa82e5ff700 1 Processor -- start 2023-10-09T06:42:54.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.151+0000 7fa82e5ff700 1 -- start start 2023-10-09T06:42:54.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.152+0000 7fa82e5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa810004d50 0x7fa82814afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:54.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.152+0000 7fa82e5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa82814ca70 0x7fa82814e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:54.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.152+0000 7fa82e5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa82814e9e0 0x7fa8281553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:54.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.152+0000 7fa82e5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82814baa0 con 0x7fa82814e9e0 2023-10-09T06:42:54.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.152+0000 7fa82e5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82814c5e0 con 0x7fa82814ca70 2023-10-09T06:42:54.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.152+0000 7fa82e5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82814b510 con 0x7fa810004d50 2023-10-09T06:42:54.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.152+0000 7fa82cb9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa82814e9e0 0x7fa8281553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:54.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.152+0000 7fa82cb9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa82814e9e0 0x7fa8281553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52562/0 (socket says 172.21.15.71:52562) 2023-10-09T06:42:54.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.152+0000 7fa82cb9c700 1 -- 172.21.15.71:0/2026309820 learned_addr learned my addr 172.21.15.71:0/2026309820 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:54.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.152+0000 7fa8277fe700 1 --2- 172.21.15.71:0/2026309820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa82814ca70 0x7fa82814e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:54.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.152+0000 7fa827fff700 1 --2- 172.21.15.71:0/2026309820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa810004d50 0x7fa82814afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:54.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.152+0000 7fa82cb9c700 1 -- 172.21.15.71:0/2026309820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa810004d50 msgr2=0x7fa82814afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:54.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.152+0000 7fa82cb9c700 1 --2- 172.21.15.71:0/2026309820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa810004d50 0x7fa82814afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:54.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.152+0000 7fa82cb9c700 1 -- 172.21.15.71:0/2026309820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa82814ca70 msgr2=0x7fa82814e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:54.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.152+0000 7fa82cb9c700 1 --2- 172.21.15.71:0/2026309820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa82814ca70 0x7fa82814e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:54.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.152+0000 7fa82cb9c700 1 -- 172.21.15.71:0/2026309820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa828158bf0 con 0x7fa82814e9e0 2023-10-09T06:42:54.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.152+0000 7fa82cb9c700 1 --2- 172.21.15.71:0/2026309820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa82814e9e0 0x7fa8281553c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa810004760 tx=0x7fa82001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:54.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.153+0000 7fa80ffff700 1 -- 172.21.15.71:0/2026309820 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa820027430 con 0x7fa82814e9e0 2023-10-09T06:42:54.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.153+0000 7fa80ffff700 1 -- 172.21.15.71:0/2026309820 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa820022070 con 0x7fa82814e9e0 2023-10-09T06:42:54.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.153+0000 7fa82e5ff700 1 -- 172.21.15.71:0/2026309820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa82814bcb0 con 0x7fa82814e9e0 2023-10-09T06:42:54.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.153+0000 7fa80ffff700 1 -- 172.21.15.71:0/2026309820 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa820027820 con 0x7fa82814e9e0 2023-10-09T06:42:54.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.153+0000 7fa82e5ff700 1 -- 172.21.15.71:0/2026309820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82814c270 con 0x7fa82814e9e0 2023-10-09T06:42:54.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.154+0000 7fa82e5ff700 1 -- 172.21.15.71:0/2026309820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa82814c790 con 0x7fa82814e9e0 2023-10-09T06:42:54.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.155+0000 7fa80ffff700 1 -- 172.21.15.71:0/2026309820 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa820024030 con 0x7fa82814e9e0 2023-10-09T06:42:54.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.155+0000 7fa80ffff700 1 --2- 172.21.15.71:0/2026309820 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa814066f30 0x7fa8140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:54.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.156+0000 7fa80ffff700 1 -- 172.21.15.71:0/2026309820 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa820085be0 con 0x7fa82814e9e0 2023-10-09T06:42:54.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.156+0000 7fa827fff700 1 --2- 172.21.15.71:0/2026309820 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa814066f30 0x7fa8140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:54.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.157+0000 7fa827fff700 1 --2- 172.21.15.71:0/2026309820 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa814066f30 0x7fa8140693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa8280abb80 tx=0x7fa818008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:54.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.159+0000 7fa80ffff700 1 -- 172.21.15.71:0/2026309820 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa82814c790 con 0x7fa82814e9e0 2023-10-09T06:42:54.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.389+0000 7fa82e5ff700 1 -- 172.21.15.71:0/2026309820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa82814c790 con 0x7fa82814e9e0 2023-10-09T06:42:54.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.390+0000 7fa80ffff700 1 -- 172.21.15.71:0/2026309820 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7fa82814c790 con 0x7fa82814e9e0 2023-10-09T06:42:54.391 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:42:54.391 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3129948705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3129948705},{"type":"v1","addr":"172.21.15.71:6835","nonce":3129948705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2871867918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2871867918},{"type":"v1","addr":"172.21.15.71:6833","nonce":2871867918}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2975286987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2975286987},{"type":"v1","addr":"172.21.15.179:6836","nonce":2975286987}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:42:38.093747+0000","modified":"2023-10-09T06:42:41.642372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/3516898913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3516898913},{"type":"v1","addr":"172.21.15.179:6837","nonce":3516898913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T06:42:54.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.392+0000 7fa82e5ff700 1 -- 172.21.15.71:0/2026309820 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa814066f30 msgr2=0x7fa8140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:54.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.392+0000 7fa82e5ff700 1 --2- 172.21.15.71:0/2026309820 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa814066f30 0x7fa8140693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa8280abb80 tx=0x7fa818008040 comp rx=0 tx=0).stop 2023-10-09T06:42:54.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.392+0000 7fa82e5ff700 1 -- 172.21.15.71:0/2026309820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa82814e9e0 msgr2=0x7fa8281553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:54.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.392+0000 7fa82e5ff700 1 --2- 172.21.15.71:0/2026309820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa82814e9e0 0x7fa8281553c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa810004760 tx=0x7fa82001a000 comp rx=0 tx=0).stop 2023-10-09T06:42:54.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.392+0000 7fa82e5ff700 1 -- 172.21.15.71:0/2026309820 shutdown_connections 2023-10-09T06:42:54.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.392+0000 7fa82e5ff700 1 --2- 172.21.15.71:0/2026309820 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa814066f30 0x7fa8140693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:54.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.392+0000 7fa82e5ff700 1 --2- 172.21.15.71:0/2026309820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa82814e9e0 0x7fa8281553c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:54.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.392+0000 7fa82e5ff700 1 --2- 172.21.15.71:0/2026309820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa810004d50 0x7fa82814afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:54.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.392+0000 7fa82e5ff700 1 --2- 172.21.15.71:0/2026309820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa82814ca70 0x7fa82814e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:54.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.392+0000 7fa82e5ff700 1 -- 172.21.15.71:0/2026309820 >> 172.21.15.71:0/2026309820 conn(0x7fa82806a320 msgr2=0x7fa828152b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:54.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.392+0000 7fa82e5ff700 1 -- 172.21.15.71:0/2026309820 shutdown_connections 2023-10-09T06:42:54.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.392+0000 7fa82e5ff700 1 -- 172.21.15.71:0/2026309820 wait complete. 2023-10-09T06:42:54.394 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2023-10-09T06:42:54.813 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T06:42:38.093747+0000', 'modified': '2023-10-09T06:42:41.642372+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6837/3516898913', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6835', 'nonce': 3516898913}, {'type': 'v1', 'addr': '172.21.15.179:6837', 'nonce': 3516898913}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T06:42:54.813 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T06:42:54.813 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-09T06:42:54.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.993+0000 7fa846bff700 1 Processor -- start 2023-10-09T06:42:54.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.993+0000 7fa846bff700 1 -- start start 2023-10-09T06:42:54.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.995+0000 7fa846bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa840159720 0x7fa840159af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:54.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.995+0000 7fa846bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa8400ab4e0 0x7fa8400a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:54.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.995+0000 7fa846bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8400a9e10 0x7fa8400ad250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:54.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.995+0000 7fa846bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8400ab980 con 0x7fa8400ab4e0 2023-10-09T06:42:54.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.995+0000 7fa846bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8400ac020 con 0x7fa840159720 2023-10-09T06:42:54.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.995+0000 7fa846bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8400aa440 con 0x7fa8400a9e10 2023-10-09T06:42:54.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.995+0000 7fa83ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa8400ab4e0 0x7fa8400a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:54.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.995+0000 7fa83ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa8400ab4e0 0x7fa8400a98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36898/0 (socket says 172.21.15.71:36898) 2023-10-09T06:42:54.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.995+0000 7fa83ffff700 1 -- 172.21.15.71:0/2667792285 learned_addr learned my addr 172.21.15.71:0/2667792285 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:54.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.995+0000 7fa84499b700 1 --2- 172.21.15.71:0/2667792285 >> v2:172.21.15.179:3300/0 conn(0x7fa840159720 0x7fa840159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:54.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.995+0000 7fa84519c700 1 --2- 172.21.15.71:0/2667792285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8400a9e10 0x7fa8400ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:54.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.995+0000 7fa83ffff700 1 -- 172.21.15.71:0/2667792285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8400a9e10 msgr2=0x7fa8400ad250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:54.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.995+0000 7fa83ffff700 1 --2- 172.21.15.71:0/2667792285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8400a9e10 0x7fa8400ad250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:54.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.995+0000 7fa83ffff700 1 -- 172.21.15.71:0/2667792285 >> v2:172.21.15.179:3300/0 conn(0x7fa840159720 msgr2=0x7fa840159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:54.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.995+0000 7fa83ffff700 1 --2- 172.21.15.71:0/2667792285 >> v2:172.21.15.179:3300/0 conn(0x7fa840159720 0x7fa840159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:54.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.995+0000 7fa83ffff700 1 -- 172.21.15.71:0/2667792285 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8400aa720 con 0x7fa8400ab4e0 2023-10-09T06:42:54.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.996+0000 7fa83ffff700 1 --2- 172.21.15.71:0/2667792285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8400ab4e0 0x7fa8400a98d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa840063d40 tx=0x7fa82c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8327848b2241c341 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:54.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.996+0000 7fa83f7fe700 1 -- 172.21.15.71:0/2667792285 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c00b860 con 0x7fa8400ab4e0 2023-10-09T06:42:54.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.996+0000 7fa83f7fe700 1 -- 172.21.15.71:0/2667792285 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c00b9c0 con 0x7fa8400ab4e0 2023-10-09T06:42:54.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.996+0000 7fa83f7fe700 1 -- 172.21.15.71:0/2667792285 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c00bd60 con 0x7fa8400ab4e0 2023-10-09T06:42:55.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.996+0000 7fa846bff700 1 -- 172.21.15.71:0/2667792285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8400ab4e0 msgr2=0x7fa8400a98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:55.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.996+0000 7fa846bff700 1 --2- 172.21.15.71:0/2667792285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8400ab4e0 0x7fa8400a98d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa840063d40 tx=0x7fa82c009250 comp rx=0 tx=0).stop 2023-10-09T06:42:55.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.997+0000 7fa846bff700 1 -- 172.21.15.71:0/2667792285 shutdown_connections 2023-10-09T06:42:55.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.997+0000 7fa846bff700 1 --2- 172.21.15.71:0/2667792285 >> v2:172.21.15.179:3300/0 conn(0x7fa840159720 0x7fa840159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.997+0000 7fa846bff700 1 --2- 172.21.15.71:0/2667792285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8400a9e10 0x7fa8400ad250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.997+0000 7fa846bff700 1 --2- 172.21.15.71:0/2667792285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8400ab4e0 0x7fa8400a98d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.997+0000 7fa846bff700 1 -- 172.21.15.71:0/2667792285 >> 172.21.15.71:0/2667792285 conn(0x7fa84006a320 msgr2=0x7fa8400cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:55.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.997+0000 7fa846bff700 1 -- 172.21.15.71:0/2667792285 shutdown_connections 2023-10-09T06:42:55.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.997+0000 7fa846bff700 1 -- 172.21.15.71:0/2667792285 wait complete. 2023-10-09T06:42:55.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.998+0000 7fa846bff700 1 Processor -- start 2023-10-09T06:42:55.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.998+0000 7fa846bff700 1 -- start start 2023-10-09T06:42:55.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.999+0000 7fa846bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8400a9e10 0x7fa84014c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.999+0000 7fa846bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8400ab4e0 0x7fa840158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.999+0000 7fa846bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa840159720 0x7fa840158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.999+0000 7fa846bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84016b430 con 0x7fa840159720 2023-10-09T06:42:55.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.999+0000 7fa846bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84014ca60 con 0x7fa8400ab4e0 2023-10-09T06:42:55.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.999+0000 7fa846bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84016ab00 con 0x7fa8400a9e10 2023-10-09T06:42:55.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.999+0000 7fa84519c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa840159720 0x7fa840158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.999+0000 7fa84519c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa840159720 0x7fa840158990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36910/0 (socket says 172.21.15.71:36910) 2023-10-09T06:42:55.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.999+0000 7fa84519c700 1 -- 172.21.15.71:0/2598899938 learned_addr learned my addr 172.21.15.71:0/2598899938 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:55.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.999+0000 7fa84499b700 1 --2- 172.21.15.71:0/2598899938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8400a9e10 0x7fa84014c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:54.999+0000 7fa83ffff700 1 --2- 172.21.15.71:0/2598899938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8400ab4e0 0x7fa840158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.000+0000 7fa84519c700 1 -- 172.21.15.71:0/2598899938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8400a9e10 msgr2=0x7fa84014c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:55.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.000+0000 7fa84519c700 1 --2- 172.21.15.71:0/2598899938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8400a9e10 0x7fa84014c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.000+0000 7fa84519c700 1 -- 172.21.15.71:0/2598899938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8400ab4e0 msgr2=0x7fa840158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:55.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.000+0000 7fa84519c700 1 --2- 172.21.15.71:0/2598899938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8400ab4e0 0x7fa840158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.000+0000 7fa84519c700 1 -- 172.21.15.71:0/2598899938 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82c0094f0 con 0x7fa840159720 2023-10-09T06:42:55.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.000+0000 7fa84499b700 1 --2- 172.21.15.71:0/2598899938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8400a9e10 0x7fa84014c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:55.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.000+0000 7fa84519c700 1 --2- 172.21.15.71:0/2598899938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa840159720 0x7fa840158990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa838007f20 tx=0x7fa838009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:55.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.000+0000 7fa83cff9700 1 -- 172.21.15.71:0/2598899938 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83800ebf0 con 0x7fa840159720 2023-10-09T06:42:55.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.000+0000 7fa83cff9700 1 -- 172.21.15.71:0/2598899938 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83800ed70 con 0x7fa840159720 2023-10-09T06:42:55.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.000+0000 7fa83cff9700 1 -- 172.21.15.71:0/2598899938 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838014670 con 0x7fa840159720 2023-10-09T06:42:55.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.000+0000 7fa846bff700 1 -- 172.21.15.71:0/2598899938 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa84016ade0 con 0x7fa840159720 2023-10-09T06:42:55.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.000+0000 7fa846bff700 1 -- 172.21.15.71:0/2598899938 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84016a7a0 con 0x7fa840159720 2023-10-09T06:42:55.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.002+0000 7fa83cff9700 1 -- 172.21.15.71:0/2598899938 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa8380149e0 con 0x7fa840159720 2023-10-09T06:42:55.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.003+0000 7fa83cff9700 1 --2- 172.21.15.71:0/2598899938 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa824066f30 0x7fa8240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.003+0000 7fa83cff9700 1 -- 172.21.15.71:0/2598899938 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa838084c10 con 0x7fa840159720 2023-10-09T06:42:55.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.004+0000 7fa84499b700 1 --2- 172.21.15.71:0/2598899938 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa824066f30 0x7fa8240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.004+0000 7fa84499b700 1 --2- 172.21.15.71:0/2598899938 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa824066f30 0x7fa8240693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa834006fd0 tx=0x7fa834008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:55.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.005+0000 7fa855291b80 1 Processor -- start 2023-10-09T06:42:55.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.005+0000 7fa855291b80 1 -- start start 2023-10-09T06:42:55.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.006+0000 7fa855291b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e0c512ea50 0x55e0c512ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.006+0000 7fa855291b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c5178d00 0x55e0c5157a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.006+0000 7fa855291b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e0c5157f60 0x55e0c512acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.006+0000 7fa855291b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5085a70 con 0x55e0c5178d00 2023-10-09T06:42:55.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.006+0000 7fa855291b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5083270 con 0x55e0c5157f60 2023-10-09T06:42:55.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.006+0000 7fa855291b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0c507f060 con 0x55e0c512ea50 2023-10-09T06:42:55.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.006+0000 7fa83ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c5178d00 0x55e0c5157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.006+0000 7fa83ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c5178d00 0x55e0c5157a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36916/0 (socket says 172.21.15.71:36916) 2023-10-09T06:42:55.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.006+0000 7fa84499b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e0c512ea50 0x55e0c512ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.006+0000 7fa83ffff700 1 -- 172.21.15.71:0/1769315746 learned_addr learned my addr 172.21.15.71:0/1769315746 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:55.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.006+0000 7fa84519c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e0c5157f60 0x55e0c512acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.007+0000 7fa83ffff700 1 -- 172.21.15.71:0/1769315746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e0c512ea50 msgr2=0x55e0c512ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:55.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.007+0000 7fa83ffff700 1 --2- 172.21.15.71:0/1769315746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e0c512ea50 0x55e0c512ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.007+0000 7fa83ffff700 1 -- 172.21.15.71:0/1769315746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e0c5157f60 msgr2=0x55e0c512acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:55.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.007+0000 7fa83ffff700 1 --2- 172.21.15.71:0/1769315746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e0c5157f60 0x55e0c512acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.007+0000 7fa83ffff700 1 -- 172.21.15.71:0/1769315746 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0c4f19270 con 0x55e0c5178d00 2023-10-09T06:42:55.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.007+0000 7fa83ffff700 1 --2- 172.21.15.71:0/1769315746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c5178d00 0x55e0c5157a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00b3c0 tx=0x7fa82c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16af1a6b2922fe7f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:55.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.007+0000 7fa829ffb700 1 -- 172.21.15.71:0/1769315746 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c021070 con 0x55e0c5178d00 2023-10-09T06:42:55.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.007+0000 7fa829ffb700 1 -- 172.21.15.71:0/1769315746 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c000bc0 con 0x55e0c5178d00 2023-10-09T06:42:55.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.007+0000 7fa829ffb700 1 -- 172.21.15.71:0/1769315746 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c00bd80 con 0x55e0c5178d00 2023-10-09T06:42:55.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.008+0000 7fa855291b80 1 -- 172.21.15.71:0/1769315746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c5178d00 msgr2=0x55e0c5157a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:55.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.008+0000 7fa855291b80 1 --2- 172.21.15.71:0/1769315746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c5178d00 0x55e0c5157a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00b3c0 tx=0x7fa82c017000 comp rx=0 tx=0).stop 2023-10-09T06:42:55.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.008+0000 7fa855291b80 1 -- 172.21.15.71:0/1769315746 shutdown_connections 2023-10-09T06:42:55.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.008+0000 7fa855291b80 1 --2- 172.21.15.71:0/1769315746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e0c5157f60 0x55e0c512acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.008+0000 7fa855291b80 1 --2- 172.21.15.71:0/1769315746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e0c512ea50 0x55e0c512ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.008+0000 7fa855291b80 1 --2- 172.21.15.71:0/1769315746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c5178d00 0x55e0c5157a20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.008+0000 7fa855291b80 1 -- 172.21.15.71:0/1769315746 >> 172.21.15.71:0/1769315746 conn(0x55e0c5130370 msgr2=0x55e0c5130740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:55.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.008+0000 7fa855291b80 1 -- 172.21.15.71:0/1769315746 shutdown_connections 2023-10-09T06:42:55.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.008+0000 7fa855291b80 1 -- 172.21.15.71:0/1769315746 wait complete. 2023-10-09T06:42:55.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.009+0000 7fa855291b80 1 -- start start 2023-10-09T06:42:55.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.009+0000 7fa855291b80 1 Processor -- start 2023-10-09T06:42:55.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.010+0000 7fa855291b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e0c512ea50 0x55e0c51783d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.010+0000 7fa855291b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c5157f60 0x55e0c51563c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.010+0000 7fa855291b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e0c5178d00 0x55e0c5156900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.010+0000 7fa855291b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c502a890 con 0x55e0c5157f60 2023-10-09T06:42:55.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.010+0000 7fa855291b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5045ea0 con 0x55e0c5178d00 2023-10-09T06:42:55.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.010+0000 7fa855291b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0c4f01e30 con 0x55e0c512ea50 2023-10-09T06:42:55.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.010+0000 7fa855291b80 10 client.0 _ll_register_callbacks cb 0x55e0c50f2110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:42:55.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.010+0000 7fa83ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c5157f60 0x55e0c51563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.010+0000 7fa83ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c5157f60 0x55e0c51563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36930/0 (socket says 172.21.15.71:36930) 2023-10-09T06:42:55.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.010+0000 7fa83ffff700 1 -- 172.21.15.71:0/1642873001 learned_addr learned my addr 172.21.15.71:0/1642873001 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:55.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.010+0000 7fa84499b700 1 --2- 172.21.15.71:0/1642873001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e0c512ea50 0x55e0c51783d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.010+0000 7fa84519c700 1 --2- 172.21.15.71:0/1642873001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e0c5178d00 0x55e0c5156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.010+0000 7fa83ffff700 1 -- 172.21.15.71:0/1642873001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e0c512ea50 msgr2=0x55e0c51783d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:55.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.010+0000 7fa83ffff700 1 --2- 172.21.15.71:0/1642873001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e0c512ea50 0x55e0c51783d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.010+0000 7fa83ffff700 1 -- 172.21.15.71:0/1642873001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e0c5178d00 msgr2=0x55e0c5156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:55.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.010+0000 7fa83ffff700 1 --2- 172.21.15.71:0/1642873001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e0c5178d00 0x55e0c5156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.010+0000 7fa83ffff700 1 -- 172.21.15.71:0/1642873001 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8400aa720 con 0x55e0c5157f60 2023-10-09T06:42:55.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.010+0000 7fa84519c700 1 --2- 172.21.15.71:0/1642873001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e0c5178d00 0x55e0c5156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:42:55.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.011+0000 7fa83ffff700 1 --2- 172.21.15.71:0/1642873001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c5157f60 0x55e0c51563c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa82c003080 tx=0x7fa82c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ac3feff483f9dc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:55.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.011+0000 7fa81effd700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T06:42:55.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.011+0000 7fa81effd700 1 -- 172.21.15.71:0/1642873001 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c011840 con 0x55e0c5157f60 2023-10-09T06:42:55.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.011+0000 7fa81effd700 1 -- 172.21.15.71:0/1642873001 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa82c034020 con 0x55e0c5157f60 2023-10-09T06:42:55.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.011+0000 7fa855291b80 1 -- 172.21.15.71:0/1642873001 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0c5123b70 con 0x55e0c5157f60 2023-10-09T06:42:55.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.011+0000 7fa81effd700 1 -- 172.21.15.71:0/1642873001 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa82c0119a0 con 0x55e0c5157f60 2023-10-09T06:42:55.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.011+0000 7fa855291b80 10 client.4638 fetch_fsmap learned FSMap version 8 2023-10-09T06:42:55.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.011+0000 7fa855291b80 1 -- 172.21.15.71:0/1642873001 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55e0c4ebbfe0 con 0x55e0c5157f60 2023-10-09T06:42:55.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.011+0000 7fa81effd700 1 -- 172.21.15.71:0/1642873001 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e0c5123b70 con 0x55e0c5157f60 2023-10-09T06:42:55.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.011+0000 7fa81effd700 1 -- 172.21.15.71:0/1642873001 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa82c011b00 con 0x55e0c5157f60 2023-10-09T06:42:55.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.011+0000 7fa855291b80 10 client.4638 fetch_fsmap finished waiting for FSMap version 8 2023-10-09T06:42:55.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.012+0000 7fa855291b80 10 client.4638 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T06:42:55.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.012+0000 7fa855291b80 20 client.4638 populate_metadata read hostname 'smithi071' 2023-10-09T06:42:55.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.012+0000 7fa855291b80 1 --2- 172.21.15.71:0/1642873001 >> [v2:172.21.15.179:6835/3516898913,v1:172.21.15.179:6837/3516898913] conn(0x55e0c5154270 0x55e0c51719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.012+0000 7fa855291b80 4 client.4638 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T06:42:55.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.012+0000 7fa855291b80 1 -- 172.21.15.71:0/1642873001 --> [v2:172.21.15.179:6835/3516898913,v1:172.21.15.179:6837/3516898913] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0c5100aa0 con 0x55e0c5154270 2023-10-09T06:42:55.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.012+0000 7fa84499b700 1 --2- 172.21.15.71:0/1642873001 >> [v2:172.21.15.179:6835/3516898913,v1:172.21.15.179:6837/3516898913] conn(0x55e0c5154270 0x55e0c51719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.012+0000 7fa81effd700 10 client.4638 ms_handle_connect on v2:172.21.15.179:6835/3516898913 2023-10-09T06:42:55.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.012+0000 7fa84499b700 1 --2- 172.21.15.71:0/1642873001 >> [v2:172.21.15.179:6835/3516898913,v1:172.21.15.179:6837/3516898913] conn(0x55e0c5154270 0x55e0c51719e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac6500e184a863b5 server_cookie=d0e4eafe866f8fd4 in_seq=0 out_seq=0 2023-10-09T06:42:55.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.013+0000 7fa81effd700 1 -- 172.21.15.71:0/1642873001 <== mds.0 v2:172.21.15.179:6835/3516898913 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55e0c5100aa0 con 0x55e0c5154270 2023-10-09T06:42:55.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.013+0000 7fa81effd700 10 client.4638 handle_command_reply: tid=0 2023-10-09T06:42:55.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.013+0000 7fa855291b80 1 client.4638 shutdown 2023-10-09T06:42:55.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.014+0000 7fa855291b80 1 -- 172.21.15.71:0/1642873001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c5157f60 msgr2=0x55e0c51563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:55.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.014+0000 7fa855291b80 1 --2- 172.21.15.71:0/1642873001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c5157f60 0x55e0c51563c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa82c003080 tx=0x7fa82c021000 comp rx=0 tx=0).stop 2023-10-09T06:42:55.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.014+0000 7fa855291b80 1 -- 172.21.15.71:0/1642873001 shutdown_connections 2023-10-09T06:42:55.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.014+0000 7fa855291b80 1 --2- 172.21.15.71:0/1642873001 >> [v2:172.21.15.179:6835/3516898913,v1:172.21.15.179:6837/3516898913] conn(0x55e0c5154270 0x55e0c51719e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.014+0000 7fa855291b80 1 --2- 172.21.15.71:0/1642873001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e0c5178d00 0x55e0c5156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.014+0000 7fa855291b80 1 --2- 172.21.15.71:0/1642873001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e0c512ea50 0x55e0c51783d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.014+0000 7fa855291b80 1 --2- 172.21.15.71:0/1642873001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c5157f60 0x55e0c51563c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.014+0000 7fa81effd700 0 client.4638 ms_handle_reset on v2:172.21.15.179:6835/3516898913 2023-10-09T06:42:55.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.014+0000 7fa855291b80 1 -- 172.21.15.71:0/1642873001 >> 172.21.15.71:0/1642873001 conn(0x55e0c5130370 msgr2=0x55e0c5174550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:55.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.014+0000 7fa855291b80 1 -- 172.21.15.71:0/1642873001 shutdown_connections 2023-10-09T06:42:55.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.014+0000 7fa855291b80 1 -- 172.21.15.71:0/1642873001 wait complete. 2023-10-09T06:42:55.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.014+0000 7fa855291b80 20 client.4638 trim_cache size 0 max 16384 2023-10-09T06:42:55.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.031+0000 7fa855291b80 1 Processor -- start 2023-10-09T06:42:55.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.031+0000 7fa855291b80 1 -- start start 2023-10-09T06:42:55.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.032+0000 7fa855291b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c512ea50 0x55e0c5156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.032+0000 7fa855291b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e0c5157f60 0x55e0c5131b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.032+0000 7fa855291b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e0c5178d00 0x55e0c516fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.032+0000 7fa855291b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c51295a0 con 0x55e0c512ea50 2023-10-09T06:42:55.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.032+0000 7fa855291b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c512afb0 con 0x55e0c5157f60 2023-10-09T06:42:55.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.032+0000 7fa855291b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0c502a810 con 0x55e0c5178d00 2023-10-09T06:42:55.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.032+0000 7fa84499b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c512ea50 0x55e0c5156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.032+0000 7fa84499b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c512ea50 0x55e0c5156fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36944/0 (socket says 172.21.15.71:36944) 2023-10-09T06:42:55.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.032+0000 7fa84499b700 1 -- 172.21.15.71:0/4106088195 learned_addr learned my addr 172.21.15.71:0/4106088195 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:55.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.032+0000 7fa83ffff700 1 --2- 172.21.15.71:0/4106088195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e0c5157f60 0x55e0c5131b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.032+0000 7fa84519c700 1 --2- 172.21.15.71:0/4106088195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e0c5178d00 0x55e0c516fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.032+0000 7fa84499b700 1 -- 172.21.15.71:0/4106088195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e0c5178d00 msgr2=0x55e0c516fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:55.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.032+0000 7fa84499b700 1 --2- 172.21.15.71:0/4106088195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e0c5178d00 0x55e0c516fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.032+0000 7fa84499b700 1 -- 172.21.15.71:0/4106088195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e0c5157f60 msgr2=0x55e0c5131b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:55.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.032+0000 7fa84499b700 1 --2- 172.21.15.71:0/4106088195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e0c5157f60 0x55e0c5131b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.032+0000 7fa84499b700 1 -- 172.21.15.71:0/4106088195 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84014daf0 con 0x55e0c512ea50 2023-10-09T06:42:55.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.033+0000 7fa84499b700 1 --2- 172.21.15.71:0/4106088195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c512ea50 0x55e0c5156fb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55e0c5045f90 tx=0x7fa834029250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f492cbf150cf5551 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:55.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.033+0000 7fa82a7fc700 1 -- 172.21.15.71:0/4106088195 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa834028070 con 0x55e0c512ea50 2023-10-09T06:42:55.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.033+0000 7fa82a7fc700 1 -- 172.21.15.71:0/4106088195 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa834014ad0 con 0x55e0c512ea50 2023-10-09T06:42:55.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.033+0000 7fa82a7fc700 1 -- 172.21.15.71:0/4106088195 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa834014c60 con 0x55e0c512ea50 2023-10-09T06:42:55.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.033+0000 7fa855291b80 1 -- 172.21.15.71:0/4106088195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c512ea50 msgr2=0x55e0c5156fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:55.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.033+0000 7fa855291b80 1 --2- 172.21.15.71:0/4106088195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c512ea50 0x55e0c5156fb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55e0c5045f90 tx=0x7fa834029250 comp rx=0 tx=0).stop 2023-10-09T06:42:55.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.033+0000 7fa855291b80 1 -- 172.21.15.71:0/4106088195 shutdown_connections 2023-10-09T06:42:55.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.033+0000 7fa855291b80 1 --2- 172.21.15.71:0/4106088195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e0c5178d00 0x55e0c516fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.033+0000 7fa855291b80 1 --2- 172.21.15.71:0/4106088195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c512ea50 0x55e0c5156fb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.033+0000 7fa855291b80 1 --2- 172.21.15.71:0/4106088195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e0c5157f60 0x55e0c5131b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.033+0000 7fa855291b80 1 -- 172.21.15.71:0/4106088195 >> 172.21.15.71:0/4106088195 conn(0x55e0c5130370 msgr2=0x55e0c5175e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:55.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.034+0000 7fa855291b80 1 -- 172.21.15.71:0/4106088195 shutdown_connections 2023-10-09T06:42:55.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.034+0000 7fa855291b80 1 -- 172.21.15.71:0/4106088195 wait complete. 2023-10-09T06:42:55.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.034+0000 7fa855291b80 1 -- start start 2023-10-09T06:42:55.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.034+0000 7fa855291b80 1 Processor -- start 2023-10-09T06:42:55.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.035+0000 7fa855291b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e0c512ea50 0x55e0c512a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.035+0000 7fa855291b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e0c5157f60 0x55e0c512ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.035+0000 7fa855291b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c5178d00 0x55e0c512f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.035+0000 7fa855291b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5173310 con 0x55e0c5178d00 2023-10-09T06:42:55.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.035+0000 7fa855291b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c51e38f0 con 0x55e0c5157f60 2023-10-09T06:42:55.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.035+0000 7fa855291b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5172820 con 0x55e0c512ea50 2023-10-09T06:42:55.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.035+0000 7fa855291b80 10 client.0 _ll_register_callbacks cb 0x55e0c50f2110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:42:55.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.036+0000 7fa84519c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c5178d00 0x55e0c512f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.036+0000 7fa84519c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c5178d00 0x55e0c512f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36960/0 (socket says 172.21.15.71:36960) 2023-10-09T06:42:55.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.036+0000 7fa84519c700 1 -- 172.21.15.71:0/547522794 learned_addr learned my addr 172.21.15.71:0/547522794 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:55.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.036+0000 7fa83ffff700 1 --2- 172.21.15.71:0/547522794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e0c5157f60 0x55e0c512ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.036+0000 7fa84499b700 1 --2- 172.21.15.71:0/547522794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e0c512ea50 0x55e0c512a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.036+0000 7fa84519c700 1 -- 172.21.15.71:0/547522794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e0c512ea50 msgr2=0x55e0c512a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:55.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.036+0000 7fa84519c700 1 --2- 172.21.15.71:0/547522794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e0c512ea50 0x55e0c512a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.036+0000 7fa84519c700 1 -- 172.21.15.71:0/547522794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e0c5157f60 msgr2=0x55e0c512ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:55.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.036+0000 7fa84519c700 1 --2- 172.21.15.71:0/547522794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e0c5157f60 0x55e0c512ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.036+0000 7fa84519c700 1 -- 172.21.15.71:0/547522794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83400e040 con 0x55e0c5178d00 2023-10-09T06:42:55.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.036+0000 7fa84499b700 1 --2- 172.21.15.71:0/547522794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e0c512ea50 0x55e0c512a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:55.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.036+0000 7fa84519c700 1 --2- 172.21.15.71:0/547522794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c5178d00 0x55e0c512f360 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa83800c040 tx=0x7fa838020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e92ca4313f07a08 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:55.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.036+0000 7fa81effd700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T06:42:55.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.036+0000 7fa81effd700 1 -- 172.21.15.71:0/547522794 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83805ca40 con 0x55e0c5178d00 2023-10-09T06:42:55.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.036+0000 7fa81effd700 1 -- 172.21.15.71:0/547522794 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa838012dc0 con 0x55e0c5178d00 2023-10-09T06:42:55.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.036+0000 7fa855291b80 1 -- 172.21.15.71:0/547522794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa82c000bc0 con 0x55e0c5178d00 2023-10-09T06:42:55.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.036+0000 7fa81effd700 1 -- 172.21.15.71:0/547522794 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8380551a0 con 0x55e0c5178d00 2023-10-09T06:42:55.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.037+0000 7fa855291b80 10 client.4644 fetch_fsmap learned FSMap version 8 2023-10-09T06:42:55.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.037+0000 7fa855291b80 1 -- 172.21.15.71:0/547522794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55e0c504d780 con 0x55e0c5178d00 2023-10-09T06:42:55.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.037+0000 7fa81effd700 1 -- 172.21.15.71:0/547522794 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa838064080 con 0x55e0c5178d00 2023-10-09T06:42:55.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.037+0000 7fa81effd700 1 -- 172.21.15.71:0/547522794 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa83805c5b0 con 0x55e0c5178d00 2023-10-09T06:42:55.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.037+0000 7fa855291b80 10 client.4644 fetch_fsmap finished waiting for FSMap version 8 2023-10-09T06:42:55.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.037+0000 7fa855291b80 10 client.4644 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T06:42:55.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.037+0000 7fa855291b80 20 client.4644 populate_metadata read hostname 'smithi071' 2023-10-09T06:42:55.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.037+0000 7fa855291b80 1 --2- 172.21.15.71:0/547522794 >> [v2:172.21.15.179:6835/3516898913,v1:172.21.15.179:6837/3516898913] conn(0x55e0c5170120 0x55e0c51704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.037+0000 7fa855291b80 4 client.4644 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2023-10-09T06:42:55.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.037+0000 7fa855291b80 1 -- 172.21.15.71:0/547522794 --> [v2:172.21.15.179:6835/3516898913,v1:172.21.15.179:6837/3516898913] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e0c5021e00 con 0x55e0c5170120 2023-10-09T06:42:55.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.037+0000 7fa84499b700 1 --2- 172.21.15.71:0/547522794 >> [v2:172.21.15.179:6835/3516898913,v1:172.21.15.179:6837/3516898913] conn(0x55e0c5170120 0x55e0c51704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.038+0000 7fa84499b700 1 --2- 172.21.15.71:0/547522794 >> [v2:172.21.15.179:6835/3516898913,v1:172.21.15.179:6837/3516898913] conn(0x55e0c5170120 0x55e0c51704f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57d6e57a5b8d659c server_cookie=4d4981967490cee1 in_seq=0 out_seq=0 2023-10-09T06:42:55.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.038+0000 7fa81effd700 10 client.4644 ms_handle_connect on v2:172.21.15.179:6835/3516898913 2023-10-09T06:42:55.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.038+0000 7fa81effd700 1 -- 172.21.15.71:0/547522794 <== mds.0 v2:172.21.15.179:6835/3516898913 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55e0c5021e00 con 0x55e0c5170120 2023-10-09T06:42:55.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.038+0000 7fa81effd700 10 client.4644 handle_command_reply: tid=0 2023-10-09T06:42:55.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.038+0000 7fa855291b80 1 client.4644 shutdown 2023-10-09T06:42:55.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.038+0000 7fa855291b80 1 -- 172.21.15.71:0/547522794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c5178d00 msgr2=0x55e0c512f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:55.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.038+0000 7fa855291b80 1 --2- 172.21.15.71:0/547522794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c5178d00 0x55e0c512f360 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa83800c040 tx=0x7fa838020040 comp rx=0 tx=0).stop 2023-10-09T06:42:55.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.038+0000 7fa855291b80 1 -- 172.21.15.71:0/547522794 shutdown_connections 2023-10-09T06:42:55.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.038+0000 7fa855291b80 1 --2- 172.21.15.71:0/547522794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0c5178d00 0x55e0c512f360 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.038+0000 7fa855291b80 1 --2- 172.21.15.71:0/547522794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e0c512ea50 0x55e0c512a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.038+0000 7fa855291b80 1 --2- 172.21.15.71:0/547522794 >> [v2:172.21.15.179:6835/3516898913,v1:172.21.15.179:6837/3516898913] conn(0x55e0c5170120 0x55e0c51704f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.038+0000 7fa855291b80 1 --2- 172.21.15.71:0/547522794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e0c5157f60 0x55e0c512ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.038+0000 7fa855291b80 1 -- 172.21.15.71:0/547522794 >> 172.21.15.71:0/547522794 conn(0x55e0c5130370 msgr2=0x55e0c5131b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:55.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.038+0000 7fa81effd700 0 client.4644 ms_handle_reset on v2:172.21.15.179:6835/3516898913 2023-10-09T06:42:55.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.038+0000 7fa855291b80 1 -- 172.21.15.71:0/547522794 shutdown_connections 2023-10-09T06:42:55.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.038+0000 7fa855291b80 1 -- 172.21.15.71:0/547522794 wait complete. 2023-10-09T06:42:55.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.038+0000 7fa855291b80 20 client.4644 trim_cache size 0 max 16384 2023-10-09T06:42:55.046 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T06:42:55.046 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "604c5619-653a-4ab6-912c-ab2e5464fe4a", 2023-10-09T06:42:55.047 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2023-10-09T06:42:55.047 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 4291, 2023-10-09T06:42:55.047 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2023-10-09T06:42:55.047 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2023-10-09T06:42:55.047 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2023-10-09T06:42:55.047 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 16.411707231000001, 2023-10-09T06:42:55.047 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 8, 2023-10-09T06:42:55.047 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 20, 2023-10-09T06:42:55.047 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 20, 2023-10-09T06:42:55.047 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 22.004282661000001 2023-10-09T06:42:55.047 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T06:42:55.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.039+0000 7fa846bff700 1 -- 172.21.15.71:0/2598899938 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa824066f30 msgr2=0x7fa8240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:55.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.039+0000 7fa846bff700 1 --2- 172.21.15.71:0/2598899938 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa824066f30 0x7fa8240693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa834006fd0 tx=0x7fa834008040 comp rx=0 tx=0).stop 2023-10-09T06:42:55.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.039+0000 7fa846bff700 1 -- 172.21.15.71:0/2598899938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa840159720 msgr2=0x7fa840158990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:55.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.039+0000 7fa846bff700 1 --2- 172.21.15.71:0/2598899938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa840159720 0x7fa840158990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa838007f20 tx=0x7fa838009860 comp rx=0 tx=0).stop 2023-10-09T06:42:55.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.039+0000 7fa846bff700 1 -- 172.21.15.71:0/2598899938 shutdown_connections 2023-10-09T06:42:55.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.039+0000 7fa846bff700 1 --2- 172.21.15.71:0/2598899938 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa824066f30 0x7fa8240693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.039+0000 7fa846bff700 1 --2- 172.21.15.71:0/2598899938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa840159720 0x7fa840158990 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.039+0000 7fa846bff700 1 --2- 172.21.15.71:0/2598899938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8400a9e10 0x7fa84014c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.039+0000 7fa846bff700 1 --2- 172.21.15.71:0/2598899938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8400ab4e0 0x7fa840158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.039+0000 7fa846bff700 1 -- 172.21.15.71:0/2598899938 >> 172.21.15.71:0/2598899938 conn(0x7fa84006a320 msgr2=0x7fa840157540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:55.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.039+0000 7fa846bff700 1 -- 172.21.15.71:0/2598899938 shutdown_connections 2023-10-09T06:42:55.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.039+0000 7fa846bff700 1 -- 172.21.15.71:0/2598899938 wait complete. 2023-10-09T06:42:55.056 INFO:teuthology.run_tasks:Running task kclient... 2023-10-09T06:42:55.081 INFO:tasks.kclient:Mounting kernel clients... 2023-10-09T06:42:55.082 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-09T06:42:55.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:55.082 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-09T06:42:55.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:55.119 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link delete ceph-brx 2023-10-09T06:42:55.222 INFO:teuthology.orchestra.run.smithi071.stderr:Cannot find device "ceph-brx" 2023-10-09T06:42:55.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:42:55.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:55.226 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-09T06:42:55.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:55.262 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link delete ceph-brx 2023-10-09T06:42:55.364 INFO:teuthology.orchestra.run.smithi071.stderr:Cannot find device "ceph-brx" 2023-10-09T06:42:55.367 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:42:55.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:55.368 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-10-09T06:42:55.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:55.409 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2023-10-09T06:42:55.516 INFO:teuthology.orchestra.run.smithi179.stderr:Cannot find device "ceph-brx" 2023-10-09T06:42:55.520 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:42:55.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:55.521 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-10-09T06:42:55.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:55.558 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2023-10-09T06:42:55.660 INFO:teuthology.orchestra.run.smithi179.stderr:Cannot find device "ceph-brx" 2023-10-09T06:42:55.663 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T06:42:55.663 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-09T06:42:55.663 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:42:55.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.844+0000 7f3ef35ff700 1 Processor -- start 2023-10-09T06:42:55.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.844+0000 7f3ef35ff700 1 -- start start 2023-10-09T06:42:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.845+0000 7f3ef35ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3eec159db0 0x7f3eec069ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.845+0000 7f3ef35ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3eec06a2b0 0x7f3eec06a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.845+0000 7f3ef35ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eec0c96a0 con 0x7f3eec1599e0 2023-10-09T06:42:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.845+0000 7f3ef35ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eec0cb9e0 con 0x7f3eec06a2b0 2023-10-09T06:42:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.845+0000 7f3ef35ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0cab60 con 0x7f3eec159db0 2023-10-09T06:42:55.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.846+0000 7f3ef0b9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3eec159db0 0x7f3eec069ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.846+0000 7f3ef1b9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3eec06a2b0 0x7f3eec06a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.846+0000 7f3ef139b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f3eec1599e0 0x7f3eec069080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:59756/0 (socket says 172.21.15.71:59756) 2023-10-09T06:42:55.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.846+0000 7f3ef139b700 1 -- 172.21.15.71:0/1261154561 learned_addr learned my addr 172.21.15.71:0/1261154561 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:55.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.846+0000 7f3ee3fff700 1 -- 172.21.15.71:0/1261154561 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945231337 0 0) 0x7f3eec0c96a0 con 0x7f3eec1599e0 2023-10-09T06:42:55.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.846+0000 7f3ee3fff700 1 -- 172.21.15.71:0/1261154561 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ed8003570 con 0x7f3eec1599e0 2023-10-09T06:42:55.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.846+0000 7f3ef0b9a700 1 -- 172.21.15.71:0/1261154561 >> v2:172.21.15.179:3300/0 conn(0x7f3eec06a2b0 msgr2=0x7f3eec06a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:55.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.846+0000 7f3ef0b9a700 1 --2- 172.21.15.71:0/1261154561 >> v2:172.21.15.179:3300/0 conn(0x7f3eec06a2b0 0x7f3eec06a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.846+0000 7f3ef0b9a700 1 -- 172.21.15.71:0/1261154561 >> v1:172.21.15.179:6789/0 conn(0x7f3eec1599e0 legacy=0x7f3eec069080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:55.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.846+0000 7f3ef0b9a700 1 -- 172.21.15.71:0/1261154561 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec0cb420 con 0x7f3eec159db0 2023-10-09T06:42:55.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.846+0000 7f3ef1b9c700 1 --2- 172.21.15.71:0/1261154561 >> v2:172.21.15.179:3300/0 conn(0x7f3eec06a2b0 0x7f3eec06a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:42:55.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.847+0000 7f3ef0b9a700 1 --2- 172.21.15.71:0/1261154561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3eec159db0 0x7f3eec069ac0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0098e0 tx=0x7f3edc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82b8b70d4f12e263 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:55.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.847+0000 7f3ee3fff700 1 -- 172.21.15.71:0/1261154561 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc011630 con 0x7f3eec159db0 2023-10-09T06:42:55.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.847+0000 7f3ee3fff700 1 -- 172.21.15.71:0/1261154561 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc011790 con 0x7f3eec159db0 2023-10-09T06:42:55.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.847+0000 7f3ee3fff700 1 -- 172.21.15.71:0/1261154561 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc011b30 con 0x7f3eec159db0 2023-10-09T06:42:55.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.847+0000 7f3ef35ff700 1 -- 172.21.15.71:0/1261154561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3eec159db0 msgr2=0x7f3eec069ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:55.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.847+0000 7f3ef35ff700 1 --2- 172.21.15.71:0/1261154561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3eec159db0 0x7f3eec069ac0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0098e0 tx=0x7f3edc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.847+0000 7f3ef35ff700 1 -- 172.21.15.71:0/1261154561 shutdown_connections 2023-10-09T06:42:55.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.847+0000 7f3ef35ff700 1 --2- 172.21.15.71:0/1261154561 >> v2:172.21.15.179:3300/0 conn(0x7f3eec06a2b0 0x7f3eec06a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.847+0000 7f3ef35ff700 1 --2- 172.21.15.71:0/1261154561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3eec159db0 0x7f3eec069ac0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.847+0000 7f3ef35ff700 1 -- 172.21.15.71:0/1261154561 >> 172.21.15.71:0/1261154561 conn(0x7f3eec0c9860 msgr2=0x7f3eec0c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:55.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.847+0000 7f3ef35ff700 1 -- 172.21.15.71:0/1261154561 shutdown_connections 2023-10-09T06:42:55.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.848+0000 7f3ef35ff700 1 -- 172.21.15.71:0/1261154561 wait complete. 2023-10-09T06:42:55.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.849+0000 7f3ef35ff700 1 Processor -- start 2023-10-09T06:42:55.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.849+0000 7f3ef35ff700 1 -- start start 2023-10-09T06:42:55.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.850+0000 7f3ef35ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3eec06a2b0 0x7f3eec15a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.850+0000 7f3ef35ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3eec1599e0 0x7f3eec150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.850+0000 7f3ef35ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3eec159db0 0x7f3eec0c6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.850+0000 7f3ef35ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0b2b80 con 0x7f3eec1599e0 2023-10-09T06:42:55.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.850+0000 7f3ef35ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0c4d10 con 0x7f3eec159db0 2023-10-09T06:42:55.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.850+0000 7f3ef35ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0b22e0 con 0x7f3eec06a2b0 2023-10-09T06:42:55.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.850+0000 7f3ef0b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3eec1599e0 0x7f3eec150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.850+0000 7f3ef0b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3eec1599e0 0x7f3eec150af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36966/0 (socket says 172.21.15.71:36966) 2023-10-09T06:42:55.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.850+0000 7f3ef0b9a700 1 -- 172.21.15.71:0/2438091276 learned_addr learned my addr 172.21.15.71:0/2438091276 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:55.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.850+0000 7f3ef139b700 1 --2- 172.21.15.71:0/2438091276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3eec06a2b0 0x7f3eec15a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.850+0000 7f3ef1b9c700 1 --2- 172.21.15.71:0/2438091276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3eec159db0 0x7f3eec0c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.851+0000 7f3ef0b9a700 1 -- 172.21.15.71:0/2438091276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3eec06a2b0 msgr2=0x7f3eec15a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:55.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.851+0000 7f3ef0b9a700 1 --2- 172.21.15.71:0/2438091276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3eec06a2b0 0x7f3eec15a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.851+0000 7f3ef0b9a700 1 -- 172.21.15.71:0/2438091276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3eec159db0 msgr2=0x7f3eec0c6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:55.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.851+0000 7f3ef0b9a700 1 --2- 172.21.15.71:0/2438091276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3eec159db0 0x7f3eec0c6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:55.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.851+0000 7f3ef0b9a700 1 -- 172.21.15.71:0/2438091276 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee4009a20 con 0x7f3eec1599e0 2023-10-09T06:42:55.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.851+0000 7f3ef139b700 1 --2- 172.21.15.71:0/2438091276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3eec06a2b0 0x7f3eec15a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:42:55.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.851+0000 7f3ef0b9a700 1 --2- 172.21.15.71:0/2438091276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3eec1599e0 0x7f3eec150af0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009ed0 tx=0x7f3edc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:55.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.851+0000 7f3ee17fa700 1 -- 172.21.15.71:0/2438091276 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc000cc0 con 0x7f3eec1599e0 2023-10-09T06:42:55.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.851+0000 7f3ee17fa700 1 -- 172.21.15.71:0/2438091276 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc011900 con 0x7f3eec1599e0 2023-10-09T06:42:55.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.851+0000 7f3ee17fa700 1 -- 172.21.15.71:0/2438091276 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc025420 con 0x7f3eec1599e0 2023-10-09T06:42:55.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.851+0000 7f3ef35ff700 1 -- 172.21.15.71:0/2438091276 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3edc009420 con 0x7f3eec1599e0 2023-10-09T06:42:55.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.851+0000 7f3ef35ff700 1 -- 172.21.15.71:0/2438091276 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eec0b28a0 con 0x7f3eec1599e0 2023-10-09T06:42:55.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.852+0000 7f3ef35ff700 1 -- 172.21.15.71:0/2438091276 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eec04c3c0 con 0x7f3eec1599e0 2023-10-09T06:42:55.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.853+0000 7f3ee17fa700 1 -- 172.21.15.71:0/2438091276 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3edc023070 con 0x7f3eec1599e0 2023-10-09T06:42:55.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.854+0000 7f3ee17fa700 1 --2- 172.21.15.71:0/2438091276 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3ed0066f30 0x7f3ed00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:55.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.854+0000 7f3ee17fa700 1 -- 172.21.15.71:0/2438091276 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3edc085960 con 0x7f3eec1599e0 2023-10-09T06:42:55.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.854+0000 7f3ef139b700 1 --2- 172.21.15.71:0/2438091276 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3ed0066f30 0x7f3ed00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:55.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.855+0000 7f3ef139b700 1 --2- 172.21.15.71:0/2438091276 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3ed0066f30 0x7f3ed00693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8007fd0 tx=0x7f3ee8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:55.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:55.858+0000 7f3ee17fa700 1 -- 172.21.15.71:0/2438091276 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3edc052bf0 con 0x7f3eec1599e0 2023-10-09T06:42:56.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:56.095+0000 7f3ef35ff700 1 -- 172.21.15.71:0/2438091276 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3eec0c4e50 con 0x7f3eec1599e0 2023-10-09T06:42:56.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:56.095+0000 7f3ee17fa700 1 -- 172.21.15.71:0/2438091276 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3edc02a070 con 0x7f3eec1599e0 2023-10-09T06:42:56.096 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:42:56.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:56.097+0000 7f3ef35ff700 1 -- 172.21.15.71:0/2438091276 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3ed0066f30 msgr2=0x7f3ed00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:56.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:56.097+0000 7f3ef35ff700 1 --2- 172.21.15.71:0/2438091276 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3ed0066f30 0x7f3ed00693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8007fd0 tx=0x7f3ee8009040 comp rx=0 tx=0).stop 2023-10-09T06:42:56.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:56.097+0000 7f3ef35ff700 1 -- 172.21.15.71:0/2438091276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3eec1599e0 msgr2=0x7f3eec150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:56.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:56.097+0000 7f3ef35ff700 1 --2- 172.21.15.71:0/2438091276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3eec1599e0 0x7f3eec150af0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009ed0 tx=0x7f3edc017000 comp rx=0 tx=0).stop 2023-10-09T06:42:56.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:56.098+0000 7f3ef35ff700 1 -- 172.21.15.71:0/2438091276 shutdown_connections 2023-10-09T06:42:56.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:56.098+0000 7f3ef35ff700 1 --2- 172.21.15.71:0/2438091276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3eec159db0 0x7f3eec0c6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:56.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:56.098+0000 7f3ef35ff700 1 --2- 172.21.15.71:0/2438091276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3eec06a2b0 0x7f3eec15a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:56.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:56.098+0000 7f3ef35ff700 1 --2- 172.21.15.71:0/2438091276 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3ed0066f30 0x7f3ed00693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:56.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:56.098+0000 7f3ef35ff700 1 --2- 172.21.15.71:0/2438091276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3eec1599e0 0x7f3eec150af0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:56.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:56.098+0000 7f3ef35ff700 1 -- 172.21.15.71:0/2438091276 >> 172.21.15.71:0/2438091276 conn(0x7f3eec0c9860 msgr2=0x7f3eec06a710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:56.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:56.098+0000 7f3ef35ff700 1 -- 172.21.15.71:0/2438091276 shutdown_connections 2023-10-09T06:42:56.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:56.098+0000 7f3ef35ff700 1 -- 172.21.15.71:0/2438091276 wait complete. 2023-10-09T06:42:56.116 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T06:42:56.116 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:42:56.116 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2023-10-09T06:42:56.116 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T06:42:56.116 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T06:42:56.116 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T06:42:56.116 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T06:42:56.116 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:42:56.116 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:42:56.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:56.117 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2023-10-09T06:42:56.153 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:42:56.154 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:42:56.154 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:42:56.154 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:42:56.154 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-10-09T06:42:56.154 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:42:56.154 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:42:56.154 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2023-10-09T06:42:56.154 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2023-10-09T06:42:56.154 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:42:56.154 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2023-10-09T06:42:56.155 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2023-10-09T06:42:56.155 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:42:56.155 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:42:56.155 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:42:56.155 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:42:56.155 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T06:42:56.155 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42260sec preferred_lft 42260sec 2023-10-09T06:42:56.155 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2023-10-09T06:42:56.155 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:42:56.156 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-09T06:42:56.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:56.157 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-09T06:42:56.157 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-09T06:42:56.157 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add name ceph-brx type bridge 2023-10-09T06:42:56.157 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip addr flush dev ceph-brx 2023-10-09T06:42:56.158 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set ceph-brx up 2023-10-09T06:42:56.158 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-09T06:42:56.158 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-09T06:42:56.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:56.599 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:42:56.662 INFO:teuthology.orchestra.run.smithi071.stdout:1 2023-10-09T06:42:56.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:56.665 DEBUG:teuthology.orchestra.run.smithi071:> route 2023-10-09T06:42:56.715 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2023-10-09T06:42:56.716 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:42:56.716 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T06:42:56.716 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T06:42:56.716 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:42:56.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:56.717 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-09T06:42:56.717 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-09T06:42:56.718 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T06:42:56.718 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T06:42:56.718 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T06:42:56.718 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-09T06:42:57.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:57.419 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-09T06:42:57.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:57.456 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list-id 2023-10-09T06:42:57.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:57.532 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-09T06:42:57.532 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-09T06:42:57.532 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T06:42:57.532 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-09T06:42:57.532 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-09T06:42:57.697 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-09T06:42:57.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:57.697 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-09T06:42:57.697 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-09T06:42:57.697 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-09T06:42:57.697 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-09T06:42:57.697 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-09T06:42:57.698 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-09T06:42:57.698 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-09T06:42:57.698 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-09T06:42:57.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:57.950 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-09T06:42:57.950 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-09T06:42:57.950 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2023-10-09T06:42:57.950 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set dev brx.0 master ceph-brx 2023-10-09T06:42:57.950 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-09T06:42:58.106 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:42:58.106 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T06:42:58.143 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:42:58.143 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:42:58.143 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:42:58.219 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T06:42:58.219 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:42:58.219 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:42:58.366 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:42:58.366 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:42:58.825 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:42:58.825 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:42:58.825 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.71:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-09T06:42:58.825 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with new device syntax: 0@604c5619-653a-4ab6-912c-ab2e5464fe4a.cephfs=/ 2023-10-09T06:42:58.825 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.71:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-10-09T06:42:58.831 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:42:58.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:58.831 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:42:58.894 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-09T06:42:58.894 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:42:58.923 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:42:58.945 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:42:59.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.078+0000 7eff5efff700 1 Processor -- start 2023-10-09T06:42:59.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.078+0000 7eff5efff700 1 -- start start 2023-10-09T06:42:59.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.079+0000 7eff5efff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7eff5806c0a0 0x7eff580caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:59.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.079+0000 7eff5efff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5815d7e0 con 0x7eff5806bcd0 2023-10-09T06:42:59.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.079+0000 7eff5efff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5815dac0 con 0x7eff5815df50 2023-10-09T06:42:59.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.079+0000 7eff5efff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff5815aa30 con 0x7eff5806c0a0 2023-10-09T06:42:59.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.080+0000 7eff57fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7eff5806c0a0 0x7eff580caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:59.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.080+0000 7eff5cd9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7eff5806bcd0 0x7eff5815a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:42110/0 (socket says 172.21.15.71:42110) 2023-10-09T06:42:59.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.080+0000 7eff5cd9b700 1 -- 172.21.15.71:0/1808140291 learned_addr learned my addr 172.21.15.71:0/1808140291 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:42:59.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.080+0000 7eff577fe700 1 -- 172.21.15.71:0/1808140291 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3031950173 0 0) 0x7eff5815d7e0 con 0x7eff5806bcd0 2023-10-09T06:42:59.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.080+0000 7eff57fff700 1 -- 172.21.15.71:0/1808140291 >> v1:172.21.15.179:6789/0 conn(0x7eff5815df50 legacy=0x7eff580c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:42:59.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.080+0000 7eff57fff700 1 -- 172.21.15.71:0/1808140291 >> v1:172.21.15.71:6789/0 conn(0x7eff5806bcd0 legacy=0x7eff5815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:59.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.080+0000 7eff57fff700 1 -- 172.21.15.71:0/1808140291 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5815ad10 con 0x7eff5806c0a0 2023-10-09T06:42:59.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.080+0000 7eff57fff700 1 --2- 172.21.15.71:0/1808140291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5806c0a0 0x7eff580caa90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff440098e0 tx=0x7eff440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a36e09f50ce9f4a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:59.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.080+0000 7eff577fe700 1 -- 172.21.15.71:0/1808140291 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44009e80 con 0x7eff5806c0a0 2023-10-09T06:42:59.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.081+0000 7eff577fe700 1 -- 172.21.15.71:0/1808140291 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4400b820 con 0x7eff5806c0a0 2023-10-09T06:42:59.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.081+0000 7eff577fe700 1 -- 172.21.15.71:0/1808140291 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4400bba0 con 0x7eff5806c0a0 2023-10-09T06:42:59.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.081+0000 7eff5efff700 1 -- 172.21.15.71:0/1808140291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5806c0a0 msgr2=0x7eff580caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:59.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.081+0000 7eff5efff700 1 --2- 172.21.15.71:0/1808140291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5806c0a0 0x7eff580caa90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff440098e0 tx=0x7eff440091a0 comp rx=0 tx=0).stop 2023-10-09T06:42:59.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.081+0000 7eff5efff700 1 -- 172.21.15.71:0/1808140291 shutdown_connections 2023-10-09T06:42:59.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.081+0000 7eff5efff700 1 --2- 172.21.15.71:0/1808140291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5806c0a0 0x7eff580caa90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:59.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.081+0000 7eff5efff700 1 -- 172.21.15.71:0/1808140291 >> 172.21.15.71:0/1808140291 conn(0x7eff580ce600 msgr2=0x7eff580cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:59.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.081+0000 7eff5efff700 1 -- 172.21.15.71:0/1808140291 shutdown_connections 2023-10-09T06:42:59.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.081+0000 7eff5efff700 1 -- 172.21.15.71:0/1808140291 wait complete. 2023-10-09T06:42:59.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.083+0000 7eff5efff700 1 Processor -- start 2023-10-09T06:42:59.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.083+0000 7eff5efff700 1 -- start start 2023-10-09T06:42:59.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.084+0000 7eff5efff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff5806bcd0 0x7eff580c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:59.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.084+0000 7eff5efff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5806c0a0 0x7eff58154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:59.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.084+0000 7eff5efff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff5815df50 0x7eff58159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:59.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.084+0000 7eff5efff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff580c8f80 con 0x7eff5806c0a0 2023-10-09T06:42:59.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.084+0000 7eff5efff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff580c8370 con 0x7eff5815df50 2023-10-09T06:42:59.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.084+0000 7eff5efff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff580c8650 con 0x7eff5806bcd0 2023-10-09T06:42:59.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.084+0000 7eff57fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5806c0a0 0x7eff58154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:59.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.084+0000 7eff57fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5806c0a0 0x7eff58154c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36992/0 (socket says 172.21.15.71:36992) 2023-10-09T06:42:59.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.084+0000 7eff57fff700 1 -- 172.21.15.71:0/3433446082 learned_addr learned my addr 172.21.15.71:0/3433446082 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:42:59.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.084+0000 7eff5cd9b700 1 --2- 172.21.15.71:0/3433446082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff5806bcd0 0x7eff580c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:59.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.084+0000 7eff5d59c700 1 --2- 172.21.15.71:0/3433446082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff5815df50 0x7eff58159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:59.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.084+0000 7eff57fff700 1 -- 172.21.15.71:0/3433446082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff5806bcd0 msgr2=0x7eff580c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:59.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.084+0000 7eff57fff700 1 --2- 172.21.15.71:0/3433446082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff5806bcd0 0x7eff580c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:59.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.084+0000 7eff57fff700 1 -- 172.21.15.71:0/3433446082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff5815df50 msgr2=0x7eff58159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:59.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.084+0000 7eff57fff700 1 --2- 172.21.15.71:0/3433446082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff5815df50 0x7eff58159e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:59.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.084+0000 7eff57fff700 1 -- 172.21.15.71:0/3433446082 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff44009420 con 0x7eff5806c0a0 2023-10-09T06:42:59.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.084+0000 7eff5cd9b700 1 --2- 172.21.15.71:0/3433446082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff5806bcd0 0x7eff580c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:59.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.084+0000 7eff5d59c700 1 --2- 172.21.15.71:0/3433446082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff5815df50 0x7eff58159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:42:59.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.084+0000 7eff57fff700 1 --2- 172.21.15.71:0/3433446082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5806c0a0 0x7eff58154c90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7eff440030c0 tx=0x7eff44016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:59.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.085+0000 7eff54ff9700 1 -- 172.21.15.71:0/3433446082 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44006af0 con 0x7eff5806c0a0 2023-10-09T06:42:59.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.085+0000 7eff54ff9700 1 -- 172.21.15.71:0/3433446082 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff44020070 con 0x7eff5806c0a0 2023-10-09T06:42:59.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.085+0000 7eff54ff9700 1 -- 172.21.15.71:0/3433446082 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4401b450 con 0x7eff5806c0a0 2023-10-09T06:42:59.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.085+0000 7eff5efff700 1 -- 172.21.15.71:0/3433446082 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff580c8930 con 0x7eff5806c0a0 2023-10-09T06:42:59.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.085+0000 7eff5efff700 1 -- 172.21.15.71:0/3433446082 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff580c9950 con 0x7eff5806c0a0 2023-10-09T06:42:59.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.086+0000 7eff5efff700 1 -- 172.21.15.71:0/3433446082 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff580c90f0 con 0x7eff5806c0a0 2023-10-09T06:42:59.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.087+0000 7eff54ff9700 1 -- 172.21.15.71:0/3433446082 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff44022030 con 0x7eff5806c0a0 2023-10-09T06:42:59.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.087+0000 7eff54ff9700 1 --2- 172.21.15.71:0/3433446082 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7eff3c066f30 0x7eff3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:42:59.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.088+0000 7eff54ff9700 1 -- 172.21.15.71:0/3433446082 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7eff440865a0 con 0x7eff5806c0a0 2023-10-09T06:42:59.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.088+0000 7eff5cd9b700 1 --2- 172.21.15.71:0/3433446082 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7eff3c066f30 0x7eff3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:42:59.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.088+0000 7eff5cd9b700 1 --2- 172.21.15.71:0/3433446082 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7eff3c066f30 0x7eff3c0693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7eff4c001810 tx=0x7eff4c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:42:59.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.092+0000 7eff54ff9700 1 -- 172.21.15.71:0/3433446082 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff44053770 con 0x7eff5806c0a0 2023-10-09T06:42:59.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.323+0000 7eff5efff700 1 -- 172.21.15.71:0/3433446082 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7eff5804c3c0 con 0x7eff5806c0a0 2023-10-09T06:42:59.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.323+0000 7eff54ff9700 1 -- 172.21.15.71:0/3433446082 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7eff44056d90 con 0x7eff5806c0a0 2023-10-09T06:42:59.325 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:42:59.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.326+0000 7eff5efff700 1 -- 172.21.15.71:0/3433446082 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7eff3c066f30 msgr2=0x7eff3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:59.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.326+0000 7eff5efff700 1 --2- 172.21.15.71:0/3433446082 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7eff3c066f30 0x7eff3c0693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7eff4c001810 tx=0x7eff4c009040 comp rx=0 tx=0).stop 2023-10-09T06:42:59.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.326+0000 7eff5efff700 1 -- 172.21.15.71:0/3433446082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5806c0a0 msgr2=0x7eff58154c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:42:59.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.326+0000 7eff5efff700 1 --2- 172.21.15.71:0/3433446082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5806c0a0 0x7eff58154c90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7eff440030c0 tx=0x7eff44016000 comp rx=0 tx=0).stop 2023-10-09T06:42:59.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.326+0000 7eff5efff700 1 -- 172.21.15.71:0/3433446082 shutdown_connections 2023-10-09T06:42:59.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.326+0000 7eff5efff700 1 --2- 172.21.15.71:0/3433446082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff5815df50 0x7eff58159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:59.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.326+0000 7eff5efff700 1 --2- 172.21.15.71:0/3433446082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff5806bcd0 0x7eff580c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:59.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.326+0000 7eff5efff700 1 --2- 172.21.15.71:0/3433446082 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7eff3c066f30 0x7eff3c0693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:59.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.326+0000 7eff5efff700 1 --2- 172.21.15.71:0/3433446082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff5806c0a0 0x7eff58154c90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:42:59.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.326+0000 7eff5efff700 1 -- 172.21.15.71:0/3433446082 >> 172.21.15.71:0/3433446082 conn(0x7eff580ce600 msgr2=0x7eff580cc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:42:59.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.326+0000 7eff5efff700 1 -- 172.21.15.71:0/3433446082 shutdown_connections 2023-10-09T06:42:59.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:42:59.326+0000 7eff5efff700 1 -- 172.21.15.71:0/3433446082 wait complete. 2023-10-09T06:42:59.344 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T06:42:59.344 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:42:59.344 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2023-10-09T06:42:59.345 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-09T06:42:59.345 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-09T06:42:59.345 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T06:42:59.345 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T06:42:59.345 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:42:59.345 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-09T06:42:59.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:59.345 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2023-10-09T06:42:59.422 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:42:59.422 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:42:59.422 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:42:59.422 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:42:59.422 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-10-09T06:42:59.422 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:42:59.422 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:42:59.423 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2023-10-09T06:42:59.423 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2023-10-09T06:42:59.423 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:42:59.423 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2023-10-09T06:42:59.423 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2023-10-09T06:42:59.423 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:42:59.423 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:42:59.423 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:42:59.423 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:42:59.423 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T06:42:59.423 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42256sec preferred_lft 42256sec 2023-10-09T06:42:59.424 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2023-10-09T06:42:59.424 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:42:59.424 INFO:teuthology.orchestra.run.smithi071.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:42:59.424 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether ae:1f:c9:59:0c:1b brd ff:ff:ff:ff:ff:ff 2023-10-09T06:42:59.424 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:42:59.424 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:42:59.424 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::8052:a9ff:fe85:8756/64 scope link 2023-10-09T06:42:59.424 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:42:59.424 INFO:teuthology.orchestra.run.smithi071.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:42:59.424 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether ae:1f:c9:59:0c:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T06:42:59.424 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ac1f:c9ff:fe59:c1b/64 scope link tentative 2023-10-09T06:42:59.424 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:42:59.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:59.425 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:42:59.521 INFO:teuthology.orchestra.run.smithi071.stdout:1 2023-10-09T06:42:59.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:59.524 DEBUG:teuthology.orchestra.run.smithi071:> route 2023-10-09T06:42:59.562 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2023-10-09T06:42:59.563 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:42:59.563 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T06:42:59.563 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T06:42:59.563 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:42:59.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:59.564 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-09T06:42:59.564 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-09T06:42:59.564 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T06:42:59.564 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T06:42:59.565 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T06:42:59.565 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-09T06:42:59.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:59.764 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-09T06:42:59.800 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T06:42:59.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:59.802 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list-id 2023-10-09T06:42:59.888 INFO:teuthology.orchestra.run.smithi071.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-09T06:42:59.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:42:59.889 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-09T06:42:59.889 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-09T06:42:59.891 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T06:42:59.891 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-09T06:42:59.891 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-09T06:43:00.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:00.060 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-09T06:43:00.126 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:43:00.127 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:43:00.127 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:43:00.127 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:00.127 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-10-09T06:43:00.127 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:00.127 INFO:teuthology.orchestra.run.smithi071.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:43:00.127 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0a:34:a4:3d:de:2a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T06:43:00.127 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T06:43:00.127 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:00.127 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::834:a4ff:fe3d:de2a/64 scope link 2023-10-09T06:43:00.128 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:00.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:00.129 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-09T06:43:00.192 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:43:00.193 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:43:00.193 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:43:00.193 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:00.193 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-10-09T06:43:00.193 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:00.193 INFO:teuthology.orchestra.run.smithi071.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:43:00.193 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0a:34:a4:3d:de:2a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T06:43:00.193 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T06:43:00.193 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:00.193 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::834:a4ff:fe3d:de2a/64 scope link 2023-10-09T06:43:00.193 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:00.196 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-09T06:43:00.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:00.197 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-09T06:43:00.197 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-09T06:43:00.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-09T06:43:00.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-09T06:43:00.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-09T06:43:00.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-09T06:43:00.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-09T06:43:00.197 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-09T06:43:00.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:00.429 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-09T06:43:00.429 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-09T06:43:00.429 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.1 up 2023-10-09T06:43:00.429 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set dev brx.1 master ceph-brx 2023-10-09T06:43:00.429 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-09T06:43:00.586 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:43:00.586 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-09T06:43:00.623 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-09T06:43:00.623 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:43:00.624 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-09T06:43:00.699 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-09T06:43:00.699 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:43:00.699 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:43:00.828 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:43:00.828 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:43:00.858 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:43:00.858 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:43:00.858 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.71:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-09T06:43:00.858 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with new device syntax: 2@604c5619-653a-4ab6-912c-ab2e5464fe4a.cephfs=/ 2023-10-09T06:43:00.859 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.71:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-10-09T06:43:00.861 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:43:00.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:00.862 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-09T06:43:00.922 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-09T06:43:00.922 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:43:01.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.103+0000 7f26227ff700 1 Processor -- start 2023-10-09T06:43:01.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.103+0000 7f26227ff700 1 -- start start 2023-10-09T06:43:01.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.105+0000 7f26227ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f261c1578b0 0x7f261c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:01.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.105+0000 7f26227ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f261c0af2f0 0x7f261c0af710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:01.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.105+0000 7f26227ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c0ad930 con 0x7f261c155c10 2023-10-09T06:43:01.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.105+0000 7f26227ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c0b0c60 con 0x7f261c0af2f0 2023-10-09T06:43:01.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.105+0000 7f26227ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0acd20 con 0x7f261c1578b0 2023-10-09T06:43:01.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.105+0000 7f261bfff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f261c155c10 0x7f261c0ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:42112/0 (socket says 172.21.15.71:42112) 2023-10-09T06:43:01.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.105+0000 7f261bfff700 1 -- 172.21.15.71:0/2525428164 learned_addr learned my addr 172.21.15.71:0/2525428164 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:01.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.105+0000 7f2613fff700 1 --2- 172.21.15.71:0/2525428164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f261c1578b0 0x7f261c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:01.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.105+0000 7f2620d9c700 1 --2- 172.21.15.71:0/2525428164 >> v2:172.21.15.179:3300/0 conn(0x7f261c0af2f0 0x7f261c0af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:01.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.105+0000 7f261b7fe700 1 -- 172.21.15.71:0/2525428164 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2151677137 0 0) 0x7f261c0ad930 con 0x7f261c155c10 2023-10-09T06:43:01.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.106+0000 7f261b7fe700 1 -- 172.21.15.71:0/2525428164 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2608003570 con 0x7f261c155c10 2023-10-09T06:43:01.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.106+0000 7f261b7fe700 1 -- 172.21.15.71:0/2525428164 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1171430439 0 0) 0x7f2608003570 con 0x7f261c155c10 2023-10-09T06:43:01.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.106+0000 7f261b7fe700 1 -- 172.21.15.71:0/2525428164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f261c1578b0 msgr2=0x7f261c155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:01.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.106+0000 7f261b7fe700 1 --2- 172.21.15.71:0/2525428164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f261c1578b0 0x7f261c155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:01.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.106+0000 7f261b7fe700 1 -- 172.21.15.71:0/2525428164 >> v2:172.21.15.179:3300/0 conn(0x7f261c0af2f0 msgr2=0x7f261c0af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:01.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.106+0000 7f261b7fe700 1 --2- 172.21.15.71:0/2525428164 >> v2:172.21.15.179:3300/0 conn(0x7f261c0af2f0 0x7f261c0af710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:01.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.106+0000 7f261b7fe700 1 -- 172.21.15.71:0/2525428164 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c0ad000 con 0x7f261c155c10 2023-10-09T06:43:01.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.106+0000 7f261b7fe700 1 -- 172.21.15.71:0/2525428164 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f260c001470 con 0x7f261c155c10 2023-10-09T06:43:01.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.106+0000 7f261b7fe700 1 -- 172.21.15.71:0/2525428164 >> v1:172.21.15.71:6789/0 conn(0x7f261c155c10 legacy=0x7f261c0ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:01.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.106+0000 7f261b7fe700 1 --2- 172.21.15.71:0/2525428164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2608003a90 0x7f2608003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:01.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.106+0000 7f261b7fe700 1 --2- 172.21.15.71:0/2525428164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f261c1578b0 0x7f2608004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:01.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.106+0000 7f261b7fe700 1 --2- 172.21.15.71:0/2525428164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2608004d50 0x7f26080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:01.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.106+0000 7f261b7fe700 1 -- 172.21.15.71:0/2525428164 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0b0c60 con 0x7f2608004d50 2023-10-09T06:43:01.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.106+0000 7f261b7fe700 1 -- 172.21.15.71:0/2525428164 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0acd20 con 0x7f2608003a90 2023-10-09T06:43:01.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.106+0000 7f261b7fe700 1 -- 172.21.15.71:0/2525428164 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260800dca0 con 0x7f261c1578b0 2023-10-09T06:43:01.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.106+0000 7f2620d9c700 1 --2- 172.21.15.71:0/2525428164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2608004d50 0x7f26080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:01.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.106+0000 7f261bfff700 1 --2- 172.21.15.71:0/2525428164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2608003a90 0x7f2608003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:01.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.106+0000 7f2613fff700 1 --2- 172.21.15.71:0/2525428164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f261c1578b0 0x7f2608004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:01.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.107+0000 7f2620d9c700 1 -- 172.21.15.71:0/2525428164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f261c1578b0 msgr2=0x7f2608004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:01.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.107+0000 7f2620d9c700 1 --2- 172.21.15.71:0/2525428164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f261c1578b0 0x7f2608004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:01.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.107+0000 7f2620d9c700 1 -- 172.21.15.71:0/2525428164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2608003a90 msgr2=0x7f2608003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:01.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.107+0000 7f2620d9c700 1 --2- 172.21.15.71:0/2525428164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2608003a90 0x7f2608003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:01.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.107+0000 7f2620d9c700 1 -- 172.21.15.71:0/2525428164 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2608003570 con 0x7f2608004d50 2023-10-09T06:43:01.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.107+0000 7f2620d9c700 1 --2- 172.21.15.71:0/2525428164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2608004d50 0x7f26080051c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f261400e210 tx=0x7f261400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280b4383d6ce7ae2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:01.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.107+0000 7f261b7fe700 1 -- 172.21.15.71:0/2525428164 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261400ea60 con 0x7f2608004d50 2023-10-09T06:43:01.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.107+0000 7f261b7fe700 1 -- 172.21.15.71:0/2525428164 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261400f040 con 0x7f2608004d50 2023-10-09T06:43:01.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.107+0000 7f261b7fe700 1 -- 172.21.15.71:0/2525428164 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261400ee10 con 0x7f2608004d50 2023-10-09T06:43:01.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.107+0000 7f26227ff700 1 -- 172.21.15.71:0/2525428164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2608004d50 msgr2=0x7f26080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:01.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.107+0000 7f26227ff700 1 --2- 172.21.15.71:0/2525428164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2608004d50 0x7f26080051c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f261400e210 tx=0x7f261400b040 comp rx=0 tx=0).stop 2023-10-09T06:43:01.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.108+0000 7f2620d9c700 1 -- 172.21.15.71:0/2525428164 reap_dead start 2023-10-09T06:43:01.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.108+0000 7f26227ff700 1 -- 172.21.15.71:0/2525428164 shutdown_connections 2023-10-09T06:43:01.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.108+0000 7f26227ff700 1 -- 172.21.15.71:0/2525428164 >> 172.21.15.71:0/2525428164 conn(0x7f261c06a320 msgr2=0x7f261c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:01.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.108+0000 7f26227ff700 1 -- 172.21.15.71:0/2525428164 shutdown_connections 2023-10-09T06:43:01.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.108+0000 7f26227ff700 1 -- 172.21.15.71:0/2525428164 wait complete. 2023-10-09T06:43:01.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.109+0000 7f26227ff700 1 Processor -- start 2023-10-09T06:43:01.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.109+0000 7f26227ff700 1 -- start start 2023-10-09T06:43:01.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.110+0000 7f26227ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2608004d50 0x7f261c15aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:01.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.110+0000 7f26227ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f261c158ef0 0x7f261c16a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:01.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.110+0000 7f26227ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f261c1505f0 0x7f261c0c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:01.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.110+0000 7f26227ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c16ac80 con 0x7f2608004d50 2023-10-09T06:43:01.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.110+0000 7f26227ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c159960 con 0x7f261c1505f0 2023-10-09T06:43:01.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.110+0000 7f26227ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c159c40 con 0x7f261c158ef0 2023-10-09T06:43:01.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.110+0000 7f261bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2608004d50 0x7f261c15aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:01.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.110+0000 7f261bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2608004d50 0x7f261c15aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37004/0 (socket says 172.21.15.71:37004) 2023-10-09T06:43:01.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.110+0000 7f261bfff700 1 -- 172.21.15.71:0/2913549093 learned_addr learned my addr 172.21.15.71:0/2913549093 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:01.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.110+0000 7f2620d9c700 1 --2- 172.21.15.71:0/2913549093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f261c1505f0 0x7f261c0c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:01.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.110+0000 7f2613fff700 1 --2- 172.21.15.71:0/2913549093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f261c158ef0 0x7f261c16a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:01.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.111+0000 7f261bfff700 1 -- 172.21.15.71:0/2913549093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f261c158ef0 msgr2=0x7f261c16a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:01.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.111+0000 7f261bfff700 1 --2- 172.21.15.71:0/2913549093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f261c158ef0 0x7f261c16a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:01.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.111+0000 7f261bfff700 1 -- 172.21.15.71:0/2913549093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f261c1505f0 msgr2=0x7f261c0c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:01.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.111+0000 7f261bfff700 1 --2- 172.21.15.71:0/2913549093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f261c1505f0 0x7f261c0c9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:01.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.111+0000 7f261bfff700 1 -- 172.21.15.71:0/2913549093 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c159f20 con 0x7f2608004d50 2023-10-09T06:43:01.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.111+0000 7f2620d9c700 1 --2- 172.21.15.71:0/2913549093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f261c1505f0 0x7f261c0c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:01.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.111+0000 7f261bfff700 1 --2- 172.21.15.71:0/2913549093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2608004d50 0x7f261c15aa00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f260c007370 tx=0x7f260c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:01.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.111+0000 7f2618ff9700 1 -- 172.21.15.71:0/2913549093 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c00f8d0 con 0x7f2608004d50 2023-10-09T06:43:01.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.111+0000 7f2618ff9700 1 -- 172.21.15.71:0/2913549093 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c00fa70 con 0x7f2608004d50 2023-10-09T06:43:01.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.111+0000 7f26227ff700 1 -- 172.21.15.71:0/2913549093 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261c15a200 con 0x7f2608004d50 2023-10-09T06:43:01.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.111+0000 7f2618ff9700 1 -- 172.21.15.71:0/2913549093 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c00fe30 con 0x7f2608004d50 2023-10-09T06:43:01.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.111+0000 7f26227ff700 1 -- 172.21.15.71:0/2913549093 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261c150a60 con 0x7f2608004d50 2023-10-09T06:43:01.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.112+0000 7f26227ff700 1 -- 172.21.15.71:0/2913549093 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261c04c3c0 con 0x7f2608004d50 2023-10-09T06:43:01.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.113+0000 7f2618ff9700 1 -- 172.21.15.71:0/2913549093 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f260c013600 con 0x7f2608004d50 2023-10-09T06:43:01.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.114+0000 7f2618ff9700 1 --2- 172.21.15.71:0/2913549093 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f25fc066f30 0x7f25fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:01.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.114+0000 7f2618ff9700 1 -- 172.21.15.71:0/2913549093 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f260c0847a0 con 0x7f2608004d50 2023-10-09T06:43:01.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.115+0000 7f2613fff700 1 --2- 172.21.15.71:0/2913549093 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f25fc066f30 0x7f25fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:01.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.115+0000 7f2613fff700 1 --2- 172.21.15.71:0/2913549093 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f25fc066f30 0x7f25fc0693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f261c0b2600 tx=0x7f26040091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:01.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.118+0000 7f2618ff9700 1 -- 172.21.15.71:0/2913549093 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f260c051970 con 0x7f2608004d50 2023-10-09T06:43:01.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.352+0000 7f26227ff700 1 -- 172.21.15.71:0/2913549093 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f261c0ad2e0 con 0x7f2608004d50 2023-10-09T06:43:01.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.352+0000 7f2618ff9700 1 -- 172.21.15.71:0/2913549093 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f260c054f90 con 0x7f2608004d50 2023-10-09T06:43:01.353 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:43:01.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.354+0000 7f26227ff700 1 -- 172.21.15.71:0/2913549093 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f25fc066f30 msgr2=0x7f25fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:01.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.354+0000 7f26227ff700 1 --2- 172.21.15.71:0/2913549093 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f25fc066f30 0x7f25fc0693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f261c0b2600 tx=0x7f26040091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:01.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.354+0000 7f26227ff700 1 -- 172.21.15.71:0/2913549093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2608004d50 msgr2=0x7f261c15aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:01.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.354+0000 7f26227ff700 1 --2- 172.21.15.71:0/2913549093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2608004d50 0x7f261c15aa00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f260c007370 tx=0x7f260c001e50 comp rx=0 tx=0).stop 2023-10-09T06:43:01.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.354+0000 7f26227ff700 1 -- 172.21.15.71:0/2913549093 shutdown_connections 2023-10-09T06:43:01.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.354+0000 7f26227ff700 1 --2- 172.21.15.71:0/2913549093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f261c1505f0 0x7f261c0c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:01.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.354+0000 7f26227ff700 1 --2- 172.21.15.71:0/2913549093 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f25fc066f30 0x7f25fc0693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:01.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.354+0000 7f26227ff700 1 --2- 172.21.15.71:0/2913549093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2608004d50 0x7f261c15aa00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:01.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.354+0000 7f26227ff700 1 --2- 172.21.15.71:0/2913549093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f261c158ef0 0x7f261c16a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:01.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.354+0000 7f26227ff700 1 -- 172.21.15.71:0/2913549093 >> 172.21.15.71:0/2913549093 conn(0x7f261c06a320 msgr2=0x7f261c153460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:01.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.355+0000 7f26227ff700 1 -- 172.21.15.71:0/2913549093 shutdown_connections 2023-10-09T06:43:01.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:01.355+0000 7f26227ff700 1 -- 172.21.15.71:0/2913549093 wait complete. 2023-10-09T06:43:01.373 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T06:43:01.373 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:43:01.373 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-10-09T06:43:01.373 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T06:43:01.373 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T06:43:01.373 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T06:43:01.373 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T06:43:01.373 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:43:01.373 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:43:01.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:01.374 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-10-09T06:43:01.414 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:43:01.414 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:43:01.414 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:43:01.414 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:01.415 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-10-09T06:43:01.415 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:01.415 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:43:01.415 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:43:01.415 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2023-10-09T06:43:01.415 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:43:01.415 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:43:01.415 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2023-10-09T06:43:01.415 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:43:01.415 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-10-09T06:43:01.415 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:43:01.416 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-10-09T06:43:01.416 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T06:43:01.416 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42253sec preferred_lft 42253sec 2023-10-09T06:43:01.416 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2023-10-09T06:43:01.416 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:01.416 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-09T06:43:01.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:01.416 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-09T06:43:01.417 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-09T06:43:01.417 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add name ceph-brx type bridge 2023-10-09T06:43:01.417 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip addr flush dev ceph-brx 2023-10-09T06:43:01.417 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set ceph-brx up 2023-10-09T06:43:01.417 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-09T06:43:01.417 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-09T06:43:01.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:01.872 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:43:01.934 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-10-09T06:43:01.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:01.938 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-10-09T06:43:01.988 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-10-09T06:43:01.988 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:43:01.988 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T06:43:01.988 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T06:43:01.988 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:43:01.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:01.989 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-09T06:43:01.989 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-09T06:43:01.990 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T06:43:01.990 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T06:43:01.990 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T06:43:01.990 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-09T06:43:02.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:02.710 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-10-09T06:43:02.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:02.747 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list-id 2023-10-09T06:43:02.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:02.822 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-09T06:43:02.823 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-09T06:43:02.823 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T06:43:02.823 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-09T06:43:02.823 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-09T06:43:02.988 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-09T06:43:02.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:02.989 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-09T06:43:02.989 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-09T06:43:02.989 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-09T06:43:02.989 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-09T06:43:02.989 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-09T06:43:02.989 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-09T06:43:02.989 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-09T06:43:02.989 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-09T06:43:03.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:03.244 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-09T06:43:03.244 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-09T06:43:03.244 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2023-10-09T06:43:03.244 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set dev brx.0 master ceph-brx 2023-10-09T06:43:03.244 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-09T06:43:03.398 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:43:03.398 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T06:43:03.434 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T06:43:03.434 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:43:03.434 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:43:03.509 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T06:43:03.510 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:43:03.510 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:43:03.647 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:43:03.648 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:43:04.097 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:43:04.097 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:43:04.097 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.71:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-09T06:43:04.097 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: 1@604c5619-653a-4ab6-912c-ab2e5464fe4a.cephfs=/ 2023-10-09T06:43:04.098 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.71:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-10-09T06:43:04.102 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:43:04.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:04.103 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T06:43:04.164 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-09T06:43:04.164 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:43:04.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.353+0000 7f848c7ff700 1 Processor -- start 2023-10-09T06:43:04.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.353+0000 7f848c7ff700 1 -- start start 2023-10-09T06:43:04.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.354+0000 7f848c7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8484159890 0x7f848415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:04.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.354+0000 7f848c7ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848415a160 con 0x7f8484069560 2023-10-09T06:43:04.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.354+0000 7f848c7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84840d13a0 con 0x7f8484159c60 2023-10-09T06:43:04.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.354+0000 7f848c7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848415e140 con 0x7f8484159890 2023-10-09T06:43:04.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.355+0000 7f848ad9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8484069560 0x7f84840ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:42116/0 (socket says 172.21.15.71:42116) 2023-10-09T06:43:04.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.355+0000 7f848ad9c700 1 -- 172.21.15.71:0/2315743493 learned_addr learned my addr 172.21.15.71:0/2315743493 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:04.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.355+0000 7f848a59b700 1 --2- 172.21.15.71:0/2315743493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8484159890 0x7f848415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:04.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.355+0000 7f8489599700 1 -- 172.21.15.71:0/2315743493 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1876186400 0 0) 0x7f848415a160 con 0x7f8484069560 2023-10-09T06:43:04.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.355+0000 7f8489599700 1 -- 172.21.15.71:0/2315743493 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8470003570 con 0x7f8484069560 2023-10-09T06:43:04.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.355+0000 7f848a59b700 1 -- 172.21.15.71:0/2315743493 >> v1:172.21.15.179:6789/0 conn(0x7f8484159c60 legacy=0x7f848415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:04.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.355+0000 7f8489599700 1 -- 172.21.15.71:0/2315743493 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443413523 0 0) 0x7f84840d13a0 con 0x7f8484159c60 2023-10-09T06:43:04.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.355+0000 7f848a59b700 1 -- 172.21.15.71:0/2315743493 >> v1:172.21.15.71:6789/0 conn(0x7f8484069560 legacy=0x7f84840ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:04.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.355+0000 7f848a59b700 1 -- 172.21.15.71:0/2315743493 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848415a3d0 con 0x7f8484159890 2023-10-09T06:43:04.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.355+0000 7f848a59b700 1 --2- 172.21.15.71:0/2315743493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8484159890 0x7f848415abd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8480009910 tx=0x7f84800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8027f0377ba4b73 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:04.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.356+0000 7f8489599700 1 -- 172.21.15.71:0/2315743493 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848000b680 con 0x7f8484159890 2023-10-09T06:43:04.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.356+0000 7f8489599700 1 -- 172.21.15.71:0/2315743493 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848000b7e0 con 0x7f8484159890 2023-10-09T06:43:04.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.356+0000 7f8489599700 1 -- 172.21.15.71:0/2315743493 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848000bba0 con 0x7f8484159890 2023-10-09T06:43:04.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.356+0000 7f848c7ff700 1 -- 172.21.15.71:0/2315743493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8484159890 msgr2=0x7f848415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:04.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.356+0000 7f848c7ff700 1 --2- 172.21.15.71:0/2315743493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8484159890 0x7f848415abd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8480009910 tx=0x7f84800091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:04.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.356+0000 7f848c7ff700 1 -- 172.21.15.71:0/2315743493 shutdown_connections 2023-10-09T06:43:04.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.356+0000 7f848c7ff700 1 --2- 172.21.15.71:0/2315743493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8484159890 0x7f848415abd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:04.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.356+0000 7f848c7ff700 1 -- 172.21.15.71:0/2315743493 >> 172.21.15.71:0/2315743493 conn(0x7f8484068e20 msgr2=0x7f84840d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:04.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.356+0000 7f848c7ff700 1 -- 172.21.15.71:0/2315743493 shutdown_connections 2023-10-09T06:43:04.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.356+0000 7f848c7ff700 1 -- 172.21.15.71:0/2315743493 wait complete. 2023-10-09T06:43:04.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.358+0000 7f848c7ff700 1 Processor -- start 2023-10-09T06:43:04.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.358+0000 7f848c7ff700 1 -- start start 2023-10-09T06:43:04.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.359+0000 7f848c7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8484069560 0x7f84840cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:04.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.359+0000 7f848c7ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8484159890 0x7f84841440a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:04.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.359+0000 7f848c7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8484159c60 0x7f8484154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:04.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.359+0000 7f848c7ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84840cdf80 con 0x7f8484159890 2023-10-09T06:43:04.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.359+0000 7f848c7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84840cd9c0 con 0x7f8484159c60 2023-10-09T06:43:04.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.359+0000 7f848c7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84840cdca0 con 0x7f8484069560 2023-10-09T06:43:04.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.359+0000 7f8489d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8484159890 0x7f84841440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:04.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.359+0000 7f8489d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8484159890 0x7f84841440a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37020/0 (socket says 172.21.15.71:37020) 2023-10-09T06:43:04.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.359+0000 7f8489d9a700 1 -- 172.21.15.71:0/3946340792 learned_addr learned my addr 172.21.15.71:0/3946340792 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:04.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.359+0000 7f848a59b700 1 --2- 172.21.15.71:0/3946340792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8484069560 0x7f84840cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:04.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.359+0000 7f848ad9c700 1 --2- 172.21.15.71:0/3946340792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8484159c60 0x7f8484154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:04.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.359+0000 7f8489d9a700 1 -- 172.21.15.71:0/3946340792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8484069560 msgr2=0x7f84840cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:04.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.359+0000 7f8489d9a700 1 --2- 172.21.15.71:0/3946340792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8484069560 0x7f84840cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:04.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.359+0000 7f8489d9a700 1 -- 172.21.15.71:0/3946340792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8484159c60 msgr2=0x7f8484154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:04.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.359+0000 7f8489d9a700 1 --2- 172.21.15.71:0/3946340792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8484159c60 0x7f8484154350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:04.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.360+0000 7f8489d9a700 1 -- 172.21.15.71:0/3946340792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8480009420 con 0x7f8484159890 2023-10-09T06:43:04.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.360+0000 7f8489d9a700 1 --2- 172.21.15.71:0/3946340792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8484159890 0x7f84841440a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f847400c560 tx=0x7f8474007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:04.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.360+0000 7f847a7fc700 1 -- 172.21.15.71:0/3946340792 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8474011590 con 0x7f8484159890 2023-10-09T06:43:04.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.360+0000 7f847a7fc700 1 -- 172.21.15.71:0/3946340792 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8474011710 con 0x7f8484159890 2023-10-09T06:43:04.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.360+0000 7f848c7ff700 1 -- 172.21.15.71:0/3946340792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84840ce290 con 0x7f8484159890 2023-10-09T06:43:04.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.360+0000 7f847a7fc700 1 -- 172.21.15.71:0/3946340792 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8474011ad0 con 0x7f8484159890 2023-10-09T06:43:04.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.360+0000 7f848c7ff700 1 -- 172.21.15.71:0/3946340792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84840cd600 con 0x7f8484159890 2023-10-09T06:43:04.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.361+0000 7f848c7ff700 1 -- 172.21.15.71:0/3946340792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f848404c3c0 con 0x7f8484159890 2023-10-09T06:43:04.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.362+0000 7f847a7fc700 1 -- 172.21.15.71:0/3946340792 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f847401b3b0 con 0x7f8484159890 2023-10-09T06:43:04.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.363+0000 7f847a7fc700 1 --2- 172.21.15.71:0/3946340792 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8468066f30 0x7f84680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:04.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.363+0000 7f847a7fc700 1 -- 172.21.15.71:0/3946340792 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f84740839e0 con 0x7f8484159890 2023-10-09T06:43:04.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.363+0000 7f848a59b700 1 --2- 172.21.15.71:0/3946340792 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8468066f30 0x7f84680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:04.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.364+0000 7f848a59b700 1 --2- 172.21.15.71:0/3946340792 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8468066f30 0x7f84680693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f84800093f0 tx=0x7f8480017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:04.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.367+0000 7f847a7fc700 1 -- 172.21.15.71:0/3946340792 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8474050bb0 con 0x7f8484159890 2023-10-09T06:43:04.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.601+0000 7f848c7ff700 1 -- 172.21.15.71:0/3946340792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f848406a5b0 con 0x7f8484159890 2023-10-09T06:43:04.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.601+0000 7f847a7fc700 1 -- 172.21.15.71:0/3946340792 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8474017070 con 0x7f8484159890 2023-10-09T06:43:04.602 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:43:04.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.604+0000 7f848c7ff700 1 -- 172.21.15.71:0/3946340792 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8468066f30 msgr2=0x7f84680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:04.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.604+0000 7f848c7ff700 1 --2- 172.21.15.71:0/3946340792 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8468066f30 0x7f84680693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f84800093f0 tx=0x7f8480017000 comp rx=0 tx=0).stop 2023-10-09T06:43:04.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.604+0000 7f848c7ff700 1 -- 172.21.15.71:0/3946340792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8484159890 msgr2=0x7f84841440a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:04.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.604+0000 7f848c7ff700 1 --2- 172.21.15.71:0/3946340792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8484159890 0x7f84841440a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f847400c560 tx=0x7f8474007f50 comp rx=0 tx=0).stop 2023-10-09T06:43:04.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.604+0000 7f848c7ff700 1 -- 172.21.15.71:0/3946340792 shutdown_connections 2023-10-09T06:43:04.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.604+0000 7f848c7ff700 1 --2- 172.21.15.71:0/3946340792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8484159c60 0x7f8484154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:04.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.604+0000 7f848c7ff700 1 --2- 172.21.15.71:0/3946340792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8484069560 0x7f84840cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:04.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.604+0000 7f848c7ff700 1 --2- 172.21.15.71:0/3946340792 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8468066f30 0x7f84680693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:04.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.604+0000 7f848c7ff700 1 --2- 172.21.15.71:0/3946340792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8484159890 0x7f84841440a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:04.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.604+0000 7f848c7ff700 1 -- 172.21.15.71:0/3946340792 >> 172.21.15.71:0/3946340792 conn(0x7f8484068e20 msgr2=0x7f848415b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:04.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.604+0000 7f848c7ff700 1 -- 172.21.15.71:0/3946340792 shutdown_connections 2023-10-09T06:43:04.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:04.604+0000 7f848c7ff700 1 -- 172.21.15.71:0/3946340792 wait complete. 2023-10-09T06:43:04.622 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T06:43:04.622 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:43:04.622 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-10-09T06:43:04.622 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-09T06:43:04.623 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-09T06:43:04.623 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T06:43:04.623 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T06:43:04.623 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:43:04.623 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-09T06:43:04.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:04.623 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-10-09T06:43:04.661 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:43:04.661 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:43:04.661 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:43:04.661 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:04.662 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-10-09T06:43:04.662 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:04.662 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:43:04.662 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:43:04.662 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2023-10-09T06:43:04.662 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:43:04.662 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:43:04.662 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2023-10-09T06:43:04.662 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:43:04.662 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-10-09T06:43:04.662 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:43:04.662 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-10-09T06:43:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T06:43:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42250sec preferred_lft 42250sec 2023-10-09T06:43:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2023-10-09T06:43:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:04.663 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:43:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether d6:70:30:51:35:42 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:43:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:43:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::c02e:8cff:fe9c:1588/64 scope link 2023-10-09T06:43:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:04.663 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:43:04.664 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether d6:70:30:51:35:42 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T06:43:04.664 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::d470:30ff:fe51:3542/64 scope link 2023-10-09T06:43:04.664 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:04.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:04.665 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:43:04.760 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-10-09T06:43:04.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:04.763 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-10-09T06:43:04.802 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-10-09T06:43:04.802 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:43:04.802 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T06:43:04.802 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T06:43:04.802 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:43:04.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:04.803 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-09T06:43:04.803 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-09T06:43:04.803 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T06:43:04.803 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T06:43:04.803 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T06:43:04.803 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-09T06:43:04.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:04.996 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-10-09T06:43:05.033 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T06:43:05.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:05.033 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list-id 2023-10-09T06:43:05.109 INFO:teuthology.orchestra.run.smithi179.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-09T06:43:05.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:05.109 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-09T06:43:05.109 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-09T06:43:05.109 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T06:43:05.109 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-09T06:43:05.109 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-09T06:43:05.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:05.274 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-09T06:43:05.334 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:43:05.334 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:43:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:43:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-10-09T06:43:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:05.335 INFO:teuthology.orchestra.run.smithi179.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:43:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether ae:fb:44:68:47:6e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T06:43:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T06:43:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::acfb:44ff:fe68:476e/64 scope link 2023-10-09T06:43:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:05.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:05.337 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-09T06:43:05.397 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:43:05.397 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:43:05.398 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:43:05.398 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:05.398 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-10-09T06:43:05.398 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:05.398 INFO:teuthology.orchestra.run.smithi179.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:43:05.398 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether ae:fb:44:68:47:6e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T06:43:05.398 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T06:43:05.398 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:05.398 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::acfb:44ff:fe68:476e/64 scope link 2023-10-09T06:43:05.398 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:05.401 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-09T06:43:05.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:05.401 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-09T06:43:05.401 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-09T06:43:05.401 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-09T06:43:05.401 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-09T06:43:05.401 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-09T06:43:05.402 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-09T06:43:05.402 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-09T06:43:05.402 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-09T06:43:05.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:05.624 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-10-09T06:43:05.624 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-10-09T06:43:05.624 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.1 up 2023-10-09T06:43:05.625 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set dev brx.1 master ceph-brx 2023-10-09T06:43:05.625 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-10-09T06:43:05.780 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:43:05.780 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-09T06:43:05.817 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-09T06:43:05.817 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:43:05.817 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-09T06:43:05.893 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-09T06:43:05.894 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:43:05.894 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:43:06.023 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:43:06.023 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:43:06.051 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:43:06.051 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:43:06.051 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.71:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-09T06:43:06.052 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: 3@604c5619-653a-4ab6-912c-ab2e5464fe4a.cephfs=/ 2023-10-09T06:43:06.052 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.71:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-10-09T06:43:06.055 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:43:06.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:06.056 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-09T06:43:06.116 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-09T06:43:06.165 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:43:06.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.356+0000 7fcc989ff700 1 Processor -- start 2023-10-09T06:43:06.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.356+0000 7fcc989ff700 1 -- start start 2023-10-09T06:43:06.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.358+0000 7fcc989ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcc94155c10 0x7fcc94155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:06.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.358+0000 7fcc989ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcc940ac230 0x7fcc940ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:06.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.358+0000 7fcc989ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc941568a0 0x7fcc94156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:06.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.358+0000 7fcc989ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc940ad930 con 0x7fcc940ac230 2023-10-09T06:43:06.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.358+0000 7fcc989ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc940acd20 con 0x7fcc94155c10 2023-10-09T06:43:06.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.358+0000 7fcc989ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc940ad000 con 0x7fcc941568a0 2023-10-09T06:43:06.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.358+0000 7fcc91d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcc940ac230 0x7fcc940ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:06.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.358+0000 7fcc91d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcc940ac230 0x7fcc940ac6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40334/0 (socket says 172.21.15.71:40334) 2023-10-09T06:43:06.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.358+0000 7fcc91d9b700 1 -- 172.21.15.71:0/3721727480 learned_addr learned my addr 172.21.15.71:0/3721727480 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:06.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.358+0000 7fcc9259c700 1 --2- 172.21.15.71:0/3721727480 >> v2:172.21.15.179:3300/0 conn(0x7fcc94155c10 0x7fcc94155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:06.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.358+0000 7fcc92d9d700 1 --2- 172.21.15.71:0/3721727480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc941568a0 0x7fcc94156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:06.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.358+0000 7fcc91d9b700 1 -- 172.21.15.71:0/3721727480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc941568a0 msgr2=0x7fcc94156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:06.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.358+0000 7fcc91d9b700 1 --2- 172.21.15.71:0/3721727480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc941568a0 0x7fcc94156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:06.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.358+0000 7fcc91d9b700 1 -- 172.21.15.71:0/3721727480 >> v2:172.21.15.179:3300/0 conn(0x7fcc94155c10 msgr2=0x7fcc94155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:06.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.358+0000 7fcc91d9b700 1 --2- 172.21.15.71:0/3721727480 >> v2:172.21.15.179:3300/0 conn(0x7fcc94155c10 0x7fcc94155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:06.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.358+0000 7fcc91d9b700 1 -- 172.21.15.71:0/3721727480 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc940ad2e0 con 0x7fcc940ac230 2023-10-09T06:43:06.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.359+0000 7fcc91d9b700 1 --2- 172.21.15.71:0/3721727480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc940ac230 0x7fcc940ac6d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcc94063d40 tx=0x7fcc88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7352761289ee92 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:06.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.359+0000 7fcc9159a700 1 -- 172.21.15.71:0/3721727480 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8800b640 con 0x7fcc940ac230 2023-10-09T06:43:06.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.359+0000 7fcc9159a700 1 -- 172.21.15.71:0/3721727480 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8800b7a0 con 0x7fcc940ac230 2023-10-09T06:43:06.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.359+0000 7fcc9159a700 1 -- 172.21.15.71:0/3721727480 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8800bb60 con 0x7fcc940ac230 2023-10-09T06:43:06.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.359+0000 7fcc989ff700 1 -- 172.21.15.71:0/3721727480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc940ac230 msgr2=0x7fcc940ac6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:06.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.359+0000 7fcc989ff700 1 --2- 172.21.15.71:0/3721727480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc940ac230 0x7fcc940ac6d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcc94063d40 tx=0x7fcc88009250 comp rx=0 tx=0).stop 2023-10-09T06:43:06.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.359+0000 7fcc989ff700 1 -- 172.21.15.71:0/3721727480 shutdown_connections 2023-10-09T06:43:06.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.359+0000 7fcc989ff700 1 --2- 172.21.15.71:0/3721727480 >> v2:172.21.15.179:3300/0 conn(0x7fcc94155c10 0x7fcc94155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:06.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.359+0000 7fcc989ff700 1 --2- 172.21.15.71:0/3721727480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc941568a0 0x7fcc94156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:06.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.359+0000 7fcc989ff700 1 --2- 172.21.15.71:0/3721727480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc940ac230 0x7fcc940ac6d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:06.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.359+0000 7fcc989ff700 1 -- 172.21.15.71:0/3721727480 >> 172.21.15.71:0/3721727480 conn(0x7fcc9406a320 msgr2=0x7fcc940cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:06.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.360+0000 7fcc989ff700 1 -- 172.21.15.71:0/3721727480 shutdown_connections 2023-10-09T06:43:06.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.360+0000 7fcc989ff700 1 -- 172.21.15.71:0/3721727480 wait complete. 2023-10-09T06:43:06.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.361+0000 7fcc989ff700 1 Processor -- start 2023-10-09T06:43:06.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.361+0000 7fcc989ff700 1 -- start start 2023-10-09T06:43:06.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.362+0000 7fcc989ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc940ac230 0x7fcc94167c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:06.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.362+0000 7fcc989ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc94155c10 0x7fcc941528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:06.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.362+0000 7fcc989ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc941568a0 0x7fcc94168e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:06.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.362+0000 7fcc989ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc94152e10 con 0x7fcc941568a0 2023-10-09T06:43:06.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.362+0000 7fcc989ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9415c3a0 con 0x7fcc94155c10 2023-10-09T06:43:06.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.362+0000 7fcc989ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc940a6160 con 0x7fcc940ac230 2023-10-09T06:43:06.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.362+0000 7fcc92d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc941568a0 0x7fcc94168e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:06.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.362+0000 7fcc92d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc941568a0 0x7fcc94168e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40346/0 (socket says 172.21.15.71:40346) 2023-10-09T06:43:06.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.362+0000 7fcc92d9d700 1 -- 172.21.15.71:0/3393550773 learned_addr learned my addr 172.21.15.71:0/3393550773 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:06.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.362+0000 7fcc9259c700 1 --2- 172.21.15.71:0/3393550773 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc940ac230 0x7fcc94167c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:06.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.362+0000 7fcc91d9b700 1 --2- 172.21.15.71:0/3393550773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc94155c10 0x7fcc941528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:06.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.363+0000 7fcc92d9d700 1 -- 172.21.15.71:0/3393550773 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc940ac230 msgr2=0x7fcc94167c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:06.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.363+0000 7fcc92d9d700 1 --2- 172.21.15.71:0/3393550773 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc940ac230 0x7fcc94167c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:06.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.363+0000 7fcc92d9d700 1 -- 172.21.15.71:0/3393550773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc94155c10 msgr2=0x7fcc941528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:06.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.363+0000 7fcc92d9d700 1 --2- 172.21.15.71:0/3393550773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc94155c10 0x7fcc941528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:06.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.363+0000 7fcc92d9d700 1 -- 172.21.15.71:0/3393550773 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc880094f0 con 0x7fcc941568a0 2023-10-09T06:43:06.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.363+0000 7fcc9259c700 1 --2- 172.21.15.71:0/3393550773 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc940ac230 0x7fcc94167c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:06.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.363+0000 7fcc92d9d700 1 --2- 172.21.15.71:0/3393550773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc941568a0 0x7fcc94168e00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c009e20 tx=0x7fcc8c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:06.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.363+0000 7fcc827fc700 1 -- 172.21.15.71:0/3393550773 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c00cc20 con 0x7fcc941568a0 2023-10-09T06:43:06.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.363+0000 7fcc827fc700 1 -- 172.21.15.71:0/3393550773 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8c00f040 con 0x7fcc941568a0 2023-10-09T06:43:06.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.363+0000 7fcc989ff700 1 -- 172.21.15.71:0/3393550773 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc94168bd0 con 0x7fcc941568a0 2023-10-09T06:43:06.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.363+0000 7fcc827fc700 1 -- 172.21.15.71:0/3393550773 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c014480 con 0x7fcc941568a0 2023-10-09T06:43:06.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.363+0000 7fcc989ff700 1 -- 172.21.15.71:0/3393550773 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc94168610 con 0x7fcc941568a0 2023-10-09T06:43:06.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.364+0000 7fcc989ff700 1 -- 172.21.15.71:0/3393550773 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9404c3c0 con 0x7fcc941568a0 2023-10-09T06:43:06.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.365+0000 7fcc827fc700 1 -- 172.21.15.71:0/3393550773 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc8c014830 con 0x7fcc941568a0 2023-10-09T06:43:06.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.366+0000 7fcc827fc700 1 --2- 172.21.15.71:0/3393550773 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcc74066f30 0x7fcc740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:06.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.366+0000 7fcc827fc700 1 -- 172.21.15.71:0/3393550773 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcc8c084f80 con 0x7fcc941568a0 2023-10-09T06:43:06.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.366+0000 7fcc9259c700 1 --2- 172.21.15.71:0/3393550773 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcc74066f30 0x7fcc740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:06.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.367+0000 7fcc9259c700 1 --2- 172.21.15.71:0/3393550773 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcc74066f30 0x7fcc740693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcc940b0a00 tx=0x7fcc84008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:06.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.370+0000 7fcc827fc700 1 -- 172.21.15.71:0/3393550773 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc8c052150 con 0x7fcc941568a0 2023-10-09T06:43:06.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.562+0000 7fcc989ff700 1 -- 172.21.15.71:0/3393550773 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc9415c4e0 con 0x7fcc941568a0 2023-10-09T06:43:06.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.563+0000 7fcc827fc700 1 -- 172.21.15.71:0/3393550773 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fcc8c055770 con 0x7fcc941568a0 2023-10-09T06:43:06.564 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:06.565 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":20,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:42:39.546192+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:42:35.828340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:42:37.071896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:43:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.566+0000 7fcc989ff700 1 -- 172.21.15.71:0/3393550773 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcc74066f30 msgr2=0x7fcc740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.566+0000 7fcc989ff700 1 --2- 172.21.15.71:0/3393550773 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcc74066f30 0x7fcc740693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcc940b0a00 tx=0x7fcc84008040 comp rx=0 tx=0).stop 2023-10-09T06:43:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.566+0000 7fcc989ff700 1 -- 172.21.15.71:0/3393550773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc941568a0 msgr2=0x7fcc94168e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.566+0000 7fcc989ff700 1 --2- 172.21.15.71:0/3393550773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc941568a0 0x7fcc94168e00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c009e20 tx=0x7fcc8c00b040 comp rx=0 tx=0).stop 2023-10-09T06:43:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.566+0000 7fcc989ff700 1 -- 172.21.15.71:0/3393550773 shutdown_connections 2023-10-09T06:43:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.566+0000 7fcc989ff700 1 --2- 172.21.15.71:0/3393550773 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcc74066f30 0x7fcc740693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.566+0000 7fcc989ff700 1 --2- 172.21.15.71:0/3393550773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc941568a0 0x7fcc94168e00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.566+0000 7fcc989ff700 1 --2- 172.21.15.71:0/3393550773 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc940ac230 0x7fcc94167c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:06.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.566+0000 7fcc989ff700 1 --2- 172.21.15.71:0/3393550773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc94155c10 0x7fcc941528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:06.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.566+0000 7fcc989ff700 1 -- 172.21.15.71:0/3393550773 >> 172.21.15.71:0/3393550773 conn(0x7fcc9406a320 msgr2=0x7fcc940cab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:06.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.566+0000 7fcc989ff700 1 -- 172.21.15.71:0/3393550773 shutdown_connections 2023-10-09T06:43:06.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.566+0000 7fcc989ff700 1 -- 172.21.15.71:0/3393550773 wait complete. 2023-10-09T06:43:06.584 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:42:35.828340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:42:37.071896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:43:06.585 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:43:06.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.769+0000 7f47ef1ff700 1 Processor -- start 2023-10-09T06:43:06.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.769+0000 7f47ef1ff700 1 -- start start 2023-10-09T06:43:06.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.771+0000 7f47ef1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f47e81568e0 0x7f47e81616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:06.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.771+0000 7f47ef1ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e815b0d0 con 0x7f47e80ccee0 2023-10-09T06:43:06.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.771+0000 7f47ef1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e815a4c0 con 0x7f47e80c83f0 2023-10-09T06:43:06.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.771+0000 7f47ef1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e815a7a0 con 0x7f47e81568e0 2023-10-09T06:43:06.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.771+0000 7f47e7fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f47e80ccee0 0x7f47e81561d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47342/0 (socket says 172.21.15.71:47342) 2023-10-09T06:43:06.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.771+0000 7f47e7fff700 1 -- 172.21.15.71:0/2201249991 learned_addr learned my addr 172.21.15.71:0/2201249991 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:06.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.771+0000 7f47ed79c700 1 --2- 172.21.15.71:0/2201249991 >> v2:172.21.15.179:3300/0 conn(0x7f47e81568e0 0x7f47e81616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:06.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.771+0000 7f47e77fe700 1 -- 172.21.15.71:0/2201249991 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128976752 0 0) 0x7f47e815b0d0 con 0x7f47e80ccee0 2023-10-09T06:43:06.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.771+0000 7f47e77fe700 1 -- 172.21.15.71:0/2201249991 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47d8003570 con 0x7f47e80ccee0 2023-10-09T06:43:06.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.771+0000 7f47ed79c700 1 -- 172.21.15.71:0/2201249991 >> v1:172.21.15.179:6789/0 conn(0x7f47e80c83f0 legacy=0x7f47e80c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:06.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.771+0000 7f47ed79c700 1 -- 172.21.15.71:0/2201249991 >> v1:172.21.15.71:6789/0 conn(0x7f47e80ccee0 legacy=0x7f47e81561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:06.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.772+0000 7f47ed79c700 1 -- 172.21.15.71:0/2201249991 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e815aa80 con 0x7f47e81568e0 2023-10-09T06:43:06.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.772+0000 7f47ed79c700 1 --2- 172.21.15.71:0/2201249991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47e81568e0 0x7f47e81616c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009e60 tx=0x7f47e0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4388ab90754dd524 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:06.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.772+0000 7f47e77fe700 1 -- 172.21.15.71:0/2201249991 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e000e070 con 0x7f47e81568e0 2023-10-09T06:43:06.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.772+0000 7f47e77fe700 1 -- 172.21.15.71:0/2201249991 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e000bb60 con 0x7f47e81568e0 2023-10-09T06:43:06.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.772+0000 7f47e77fe700 1 -- 172.21.15.71:0/2201249991 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e0012430 con 0x7f47e81568e0 2023-10-09T06:43:06.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.772+0000 7f47ef1ff700 1 -- 172.21.15.71:0/2201249991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47e81568e0 msgr2=0x7f47e81616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:06.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.773+0000 7f47ef1ff700 1 --2- 172.21.15.71:0/2201249991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47e81568e0 0x7f47e81616c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009e60 tx=0x7f47e0009780 comp rx=0 tx=0).stop 2023-10-09T06:43:06.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.773+0000 7f47ef1ff700 1 -- 172.21.15.71:0/2201249991 shutdown_connections 2023-10-09T06:43:06.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.773+0000 7f47ef1ff700 1 --2- 172.21.15.71:0/2201249991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47e81568e0 0x7f47e81616c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:06.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.773+0000 7f47ef1ff700 1 -- 172.21.15.71:0/2201249991 >> 172.21.15.71:0/2201249991 conn(0x7f47e8068e10 msgr2=0x7f47e80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:06.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.773+0000 7f47ef1ff700 1 -- 172.21.15.71:0/2201249991 shutdown_connections 2023-10-09T06:43:06.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.773+0000 7f47ef1ff700 1 -- 172.21.15.71:0/2201249991 wait complete. 2023-10-09T06:43:06.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.774+0000 7f47ef1ff700 1 Processor -- start 2023-10-09T06:43:06.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.774+0000 7f47ef1ff700 1 -- start start 2023-10-09T06:43:06.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.775+0000 7f47ef1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47e80c83f0 0x7f47e814f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:06.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.775+0000 7f47ef1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47e80ccee0 0x7f47e81575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:06.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.775+0000 7f47ef1ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47e81568e0 0x7f47e8154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:06.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.775+0000 7f47ef1ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e814f6e0 con 0x7f47e81568e0 2023-10-09T06:43:06.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.775+0000 7f47ef1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e8157060 con 0x7f47e80c83f0 2023-10-09T06:43:06.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.775+0000 7f47ef1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e80c5230 con 0x7f47e80ccee0 2023-10-09T06:43:06.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.775+0000 7f47ed79c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47e81568e0 0x7f47e8154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:06.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.775+0000 7f47ed79c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47e81568e0 0x7f47e8154500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40350/0 (socket says 172.21.15.71:40350) 2023-10-09T06:43:06.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.775+0000 7f47ed79c700 1 -- 172.21.15.71:0/365412281 learned_addr learned my addr 172.21.15.71:0/365412281 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:06.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.775+0000 7f47ecf9b700 1 --2- 172.21.15.71:0/365412281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47e80c83f0 0x7f47e814f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:06.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.775+0000 7f47e7fff700 1 --2- 172.21.15.71:0/365412281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47e80ccee0 0x7f47e81575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:06.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.776+0000 7f47ed79c700 1 -- 172.21.15.71:0/365412281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47e80ccee0 msgr2=0x7f47e81575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:06.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.776+0000 7f47ed79c700 1 --2- 172.21.15.71:0/365412281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47e80ccee0 0x7f47e81575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:06.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.776+0000 7f47ed79c700 1 -- 172.21.15.71:0/365412281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47e80c83f0 msgr2=0x7f47e814f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:06.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.776+0000 7f47ed79c700 1 --2- 172.21.15.71:0/365412281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47e80c83f0 0x7f47e814f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:06.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.776+0000 7f47ed79c700 1 -- 172.21.15.71:0/365412281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e0009a20 con 0x7f47e81568e0 2023-10-09T06:43:06.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.776+0000 7f47ed79c700 1 --2- 172.21.15.71:0/365412281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47e81568e0 0x7f47e8154500 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f47e8063d40 tx=0x7f47e0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:06.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.776+0000 7f47e4ff9700 1 -- 172.21.15.71:0/365412281 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e0012e00 con 0x7f47e81568e0 2023-10-09T06:43:06.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.776+0000 7f47e4ff9700 1 -- 172.21.15.71:0/365412281 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e001d630 con 0x7f47e81568e0 2023-10-09T06:43:06.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.776+0000 7f47ef1ff700 1 -- 172.21.15.71:0/365412281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e80c4900 con 0x7f47e81568e0 2023-10-09T06:43:06.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.776+0000 7f47e4ff9700 1 -- 172.21.15.71:0/365412281 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e001d9f0 con 0x7f47e81568e0 2023-10-09T06:43:06.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.776+0000 7f47ef1ff700 1 -- 172.21.15.71:0/365412281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e80c4ec0 con 0x7f47e81568e0 2023-10-09T06:43:06.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.777+0000 7f47ef1ff700 1 -- 172.21.15.71:0/365412281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e80c53e0 con 0x7f47e81568e0 2023-10-09T06:43:06.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.778+0000 7f47e4ff9700 1 -- 172.21.15.71:0/365412281 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47e0024070 con 0x7f47e81568e0 2023-10-09T06:43:06.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.779+0000 7f47e4ff9700 1 --2- 172.21.15.71:0/365412281 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f47cc066f30 0x7f47cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:06.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.779+0000 7f47e4ff9700 1 -- 172.21.15.71:0/365412281 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f47e0086dd0 con 0x7f47e81568e0 2023-10-09T06:43:06.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.779+0000 7f47ecf9b700 1 --2- 172.21.15.71:0/365412281 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f47cc066f30 0x7f47cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:06.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.780+0000 7f47ecf9b700 1 --2- 172.21.15.71:0/365412281 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f47cc066f30 0x7f47cc0693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0038a0 tx=0x7f47dc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:06.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.783+0000 7f47e4ff9700 1 -- 172.21.15.71:0/365412281 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47e80c53e0 con 0x7f47e81568e0 2023-10-09T06:43:06.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.975+0000 7f47ef1ff700 1 -- 172.21.15.71:0/365412281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f47e80c53a0 con 0x7f47e81568e0 2023-10-09T06:43:06.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.975+0000 7f47e4ff9700 1 -- 172.21.15.71:0/365412281 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f47e002c020 con 0x7f47e81568e0 2023-10-09T06:43:06.976 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T06:43:06.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.977+0000 7f47ef1ff700 1 -- 172.21.15.71:0/365412281 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f47cc066f30 msgr2=0x7f47cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:06.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.977+0000 7f47ef1ff700 1 --2- 172.21.15.71:0/365412281 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f47cc066f30 0x7f47cc0693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0038a0 tx=0x7f47dc009040 comp rx=0 tx=0).stop 2023-10-09T06:43:06.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.977+0000 7f47ef1ff700 1 -- 172.21.15.71:0/365412281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47e81568e0 msgr2=0x7f47e8154500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:06.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.977+0000 7f47ef1ff700 1 --2- 172.21.15.71:0/365412281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47e81568e0 0x7f47e8154500 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f47e8063d40 tx=0x7f47e0019000 comp rx=0 tx=0).stop 2023-10-09T06:43:06.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.978+0000 7f47ef1ff700 1 -- 172.21.15.71:0/365412281 shutdown_connections 2023-10-09T06:43:06.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.978+0000 7f47ef1ff700 1 --2- 172.21.15.71:0/365412281 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f47cc066f30 0x7f47cc0693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:06.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.978+0000 7f47ef1ff700 1 --2- 172.21.15.71:0/365412281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47e81568e0 0x7f47e8154500 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:06.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.978+0000 7f47ef1ff700 1 --2- 172.21.15.71:0/365412281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47e80c83f0 0x7f47e814f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:06.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.978+0000 7f47ef1ff700 1 --2- 172.21.15.71:0/365412281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47e80ccee0 0x7f47e81575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:06.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.978+0000 7f47ef1ff700 1 -- 172.21.15.71:0/365412281 >> 172.21.15.71:0/365412281 conn(0x7f47e8068e10 msgr2=0x7f47e80b12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:06.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.978+0000 7f47ef1ff700 1 -- 172.21.15.71:0/365412281 shutdown_connections 2023-10-09T06:43:06.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:06.978+0000 7f47ef1ff700 1 -- 172.21.15.71:0/365412281 wait complete. 2023-10-09T06:43:06.996 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:43:07.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.182+0000 7fb069d9d700 1 Processor -- start 2023-10-09T06:43:07.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.182+0000 7fb069d9d700 1 -- start start 2023-10-09T06:43:07.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.183+0000 7fb069d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb0640b4e70 0x7fb0640ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:07.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.183+0000 7fb069d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb0640b1b40 0x7fb06415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:07.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.183+0000 7fb069d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0640cfb00 con 0x7fb0640b16d0 2023-10-09T06:43:07.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.183+0000 7fb069d9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0640b5c40 con 0x7fb0640b1b40 2023-10-09T06:43:07.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.183+0000 7fb069d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0640b5f20 con 0x7fb0640b4e70 2023-10-09T06:43:07.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.183+0000 7fb068d9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb0640b4e70 0x7fb0640ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:07.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.184+0000 7fb06959c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb0640b1b40 0x7fb06415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:07.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.184+0000 7fb063fff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb0640b16d0 0x7fb06415d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:39550/0 (socket says 172.21.15.71:39550) 2023-10-09T06:43:07.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.184+0000 7fb063fff700 1 -- 172.21.15.71:0/4088984909 learned_addr learned my addr 172.21.15.71:0/4088984909 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:07.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.184+0000 7fb0637fe700 1 -- 172.21.15.71:0/4088984909 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111648097 0 0) 0x7fb0640cfb00 con 0x7fb0640b16d0 2023-10-09T06:43:07.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.184+0000 7fb0637fe700 1 -- 172.21.15.71:0/4088984909 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb054003570 con 0x7fb0640b16d0 2023-10-09T06:43:07.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.184+0000 7fb06959c700 1 -- 172.21.15.71:0/4088984909 >> v2:172.21.15.179:3300/0 conn(0x7fb0640b4e70 msgr2=0x7fb0640ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:07.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.184+0000 7fb06959c700 1 --2- 172.21.15.71:0/4088984909 >> v2:172.21.15.179:3300/0 conn(0x7fb0640b4e70 0x7fb0640ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:07.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.184+0000 7fb06959c700 1 -- 172.21.15.71:0/4088984909 >> v1:172.21.15.179:6789/0 conn(0x7fb0640b16d0 legacy=0x7fb06415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:07.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.184+0000 7fb06959c700 1 -- 172.21.15.71:0/4088984909 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0640b6200 con 0x7fb0640b1b40 2023-10-09T06:43:07.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.184+0000 7fb06959c700 1 --2- 172.21.15.71:0/4088984909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0640b1b40 0x7fb06415d950 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb064064910 tx=0x7fb05c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248fd603ac185050 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:07.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.184+0000 7fb0637fe700 1 -- 172.21.15.71:0/4088984909 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c011630 con 0x7fb0640b1b40 2023-10-09T06:43:07.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.184+0000 7fb0637fe700 1 -- 172.21.15.71:0/4088984909 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05c0117b0 con 0x7fb0640b1b40 2023-10-09T06:43:07.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.184+0000 7fb0637fe700 1 -- 172.21.15.71:0/4088984909 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c011b70 con 0x7fb0640b1b40 2023-10-09T06:43:07.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.185+0000 7fb069d9d700 1 -- 172.21.15.71:0/4088984909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0640b1b40 msgr2=0x7fb06415d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:07.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.185+0000 7fb069d9d700 1 --2- 172.21.15.71:0/4088984909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0640b1b40 0x7fb06415d950 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb064064910 tx=0x7fb05c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:07.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.185+0000 7fb069d9d700 1 -- 172.21.15.71:0/4088984909 shutdown_connections 2023-10-09T06:43:07.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.185+0000 7fb069d9d700 1 --2- 172.21.15.71:0/4088984909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0640b1b40 0x7fb06415d950 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:07.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.185+0000 7fb069d9d700 1 --2- 172.21.15.71:0/4088984909 >> v2:172.21.15.179:3300/0 conn(0x7fb0640b4e70 0x7fb0640ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:07.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.185+0000 7fb069d9d700 1 -- 172.21.15.71:0/4088984909 >> 172.21.15.71:0/4088984909 conn(0x7fb0640d10c0 msgr2=0x7fb0640affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:07.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.185+0000 7fb069d9d700 1 -- 172.21.15.71:0/4088984909 shutdown_connections 2023-10-09T06:43:07.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.185+0000 7fb069d9d700 1 -- 172.21.15.71:0/4088984909 wait complete. 2023-10-09T06:43:07.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.187+0000 7fb069d9d700 1 Processor -- start 2023-10-09T06:43:07.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.187+0000 7fb069d9d700 1 -- start start 2023-10-09T06:43:07.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.188+0000 7fb069d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0640b16d0 0x7fb064145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:07.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.188+0000 7fb069d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0640b1b40 0x7fb0640c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:07.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.188+0000 7fb069d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0640b4e70 0x7fb0640c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:07.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.188+0000 7fb069d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0640c9c70 con 0x7fb0640b1b40 2023-10-09T06:43:07.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.188+0000 7fb069d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0640c6660 con 0x7fb0640b16d0 2023-10-09T06:43:07.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.188+0000 7fb069d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0640c9060 con 0x7fb0640b4e70 2023-10-09T06:43:07.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.188+0000 7fb063fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0640b1b40 0x7fb0640c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:07.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.188+0000 7fb063fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0640b1b40 0x7fb0640c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40376/0 (socket says 172.21.15.71:40376) 2023-10-09T06:43:07.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.188+0000 7fb063fff700 1 -- 172.21.15.71:0/2751986964 learned_addr learned my addr 172.21.15.71:0/2751986964 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:07.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.188+0000 7fb068d9b700 1 --2- 172.21.15.71:0/2751986964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0640b16d0 0x7fb064145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:07.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.188+0000 7fb06959c700 1 --2- 172.21.15.71:0/2751986964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0640b4e70 0x7fb0640c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:07.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.188+0000 7fb063fff700 1 -- 172.21.15.71:0/2751986964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0640b4e70 msgr2=0x7fb0640c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:07.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.188+0000 7fb063fff700 1 --2- 172.21.15.71:0/2751986964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0640b4e70 0x7fb0640c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:07.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.188+0000 7fb063fff700 1 -- 172.21.15.71:0/2751986964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0640b16d0 msgr2=0x7fb064145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:07.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.188+0000 7fb063fff700 1 --2- 172.21.15.71:0/2751986964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0640b16d0 0x7fb064145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:07.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.188+0000 7fb063fff700 1 -- 172.21.15.71:0/2751986964 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05c009420 con 0x7fb0640b1b40 2023-10-09T06:43:07.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.189+0000 7fb063fff700 1 --2- 172.21.15.71:0/2751986964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0640b1b40 0x7fb0640c84f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb05000c7f0 tx=0x7fb050007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:07.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.189+0000 7fb060ff9700 1 -- 172.21.15.71:0/2751986964 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb050005b30 con 0x7fb0640b1b40 2023-10-09T06:43:07.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.189+0000 7fb060ff9700 1 -- 172.21.15.71:0/2751986964 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb050005cb0 con 0x7fb0640b1b40 2023-10-09T06:43:07.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.189+0000 7fb069d9d700 1 -- 172.21.15.71:0/2751986964 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0640c9340 con 0x7fb0640b1b40 2023-10-09T06:43:07.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.189+0000 7fb060ff9700 1 -- 172.21.15.71:0/2751986964 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb050007320 con 0x7fb0640b1b40 2023-10-09T06:43:07.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.189+0000 7fb069d9d700 1 -- 172.21.15.71:0/2751986964 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0640c9900 con 0x7fb0640b1b40 2023-10-09T06:43:07.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.190+0000 7fb069d9d700 1 -- 172.21.15.71:0/2751986964 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0640c9ac0 con 0x7fb0640b1b40 2023-10-09T06:43:07.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.191+0000 7fb060ff9700 1 -- 172.21.15.71:0/2751986964 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb05001b3b0 con 0x7fb0640b1b40 2023-10-09T06:43:07.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.191+0000 7fb060ff9700 1 --2- 172.21.15.71:0/2751986964 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb048066f30 0x7fb0480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:07.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.192+0000 7fb060ff9700 1 -- 172.21.15.71:0/2751986964 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb050083b40 con 0x7fb0640b1b40 2023-10-09T06:43:07.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.192+0000 7fb068d9b700 1 --2- 172.21.15.71:0/2751986964 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb048066f30 0x7fb0480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:07.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.192+0000 7fb068d9b700 1 --2- 172.21.15.71:0/2751986964 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb048066f30 0x7fb0480693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb058009fd0 tx=0x7fb05800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:07.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.195+0000 7fb060ff9700 1 -- 172.21.15.71:0/2751986964 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb050050d10 con 0x7fb0640b1b40 2023-10-09T06:43:07.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.386+0000 7fb069d9d700 1 -- 172.21.15.71:0/2751986964 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb0640c9e20 con 0x7fb0640b1b40 2023-10-09T06:43:07.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.387+0000 7fb060ff9700 1 -- 172.21.15.71:0/2751986964 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb0640c9e20 con 0x7fb0640b1b40 2023-10-09T06:43:07.388 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-09T06:43:07.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.389+0000 7fb069d9d700 1 -- 172.21.15.71:0/2751986964 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb048066f30 msgr2=0x7fb0480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:07.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.389+0000 7fb069d9d700 1 --2- 172.21.15.71:0/2751986964 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb048066f30 0x7fb0480693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb058009fd0 tx=0x7fb05800b040 comp rx=0 tx=0).stop 2023-10-09T06:43:07.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.389+0000 7fb069d9d700 1 -- 172.21.15.71:0/2751986964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0640b1b40 msgr2=0x7fb0640c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:07.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.389+0000 7fb069d9d700 1 --2- 172.21.15.71:0/2751986964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0640b1b40 0x7fb0640c84f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb05000c7f0 tx=0x7fb050007e00 comp rx=0 tx=0).stop 2023-10-09T06:43:07.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.389+0000 7fb069d9d700 1 -- 172.21.15.71:0/2751986964 shutdown_connections 2023-10-09T06:43:07.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.389+0000 7fb069d9d700 1 --2- 172.21.15.71:0/2751986964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0640b4e70 0x7fb0640c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:07.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.389+0000 7fb069d9d700 1 --2- 172.21.15.71:0/2751986964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0640b16d0 0x7fb064145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:07.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.389+0000 7fb069d9d700 1 --2- 172.21.15.71:0/2751986964 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb048066f30 0x7fb0480693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:07.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.389+0000 7fb069d9d700 1 --2- 172.21.15.71:0/2751986964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0640b1b40 0x7fb0640c84f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:07.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.389+0000 7fb069d9d700 1 -- 172.21.15.71:0/2751986964 >> 172.21.15.71:0/2751986964 conn(0x7fb0640d10c0 msgr2=0x7fb0640b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:07.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.389+0000 7fb069d9d700 1 -- 172.21.15.71:0/2751986964 shutdown_connections 2023-10-09T06:43:07.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.389+0000 7fb069d9d700 1 -- 172.21.15.71:0/2751986964 wait complete. 2023-10-09T06:43:07.408 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:43:07.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.591+0000 7fdbb179d700 1 Processor -- start 2023-10-09T06:43:07.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.591+0000 7fdbb179d700 1 -- start start 2023-10-09T06:43:07.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.592+0000 7fdbb179d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdbac153900 0x7fdbac0c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:07.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.592+0000 7fdbb179d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbac06e150 con 0x7fdbac0c9db0 2023-10-09T06:43:07.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.592+0000 7fdbb179d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbac0c7800 con 0x7fdbac06a710 2023-10-09T06:43:07.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.592+0000 7fdbb179d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbac0c7ae0 con 0x7fdbac153900 2023-10-09T06:43:07.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.592+0000 7fdbabfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdbac153900 0x7fdbac0c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:07.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.592+0000 7fdbab7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fdbac0c9db0 0x7fdbac06a000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47350/0 (socket says 172.21.15.71:47350) 2023-10-09T06:43:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.592+0000 7fdbabfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdbac153900 0x7fdbac0c6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40388/0 (socket says 172.21.15.71:40388) 2023-10-09T06:43:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.592+0000 7fdbab7fe700 1 -- 172.21.15.71:0/625718151 learned_addr learned my addr 172.21.15.71:0/625718151 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.593+0000 7fdbabfff700 1 -- 172.21.15.71:0/625718151 >> v1:172.21.15.179:6789/0 conn(0x7fdbac06a710 legacy=0x7fdbac06e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.593+0000 7fdbabfff700 1 -- 172.21.15.71:0/625718151 >> v1:172.21.15.71:6789/0 conn(0x7fdbac0c9db0 legacy=0x7fdbac06a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.593+0000 7fdbabfff700 1 -- 172.21.15.71:0/625718151 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac0c7dc0 con 0x7fdbac153900 2023-10-09T06:43:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.593+0000 7fdbaaffd700 1 -- 172.21.15.71:0/625718151 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039311985 0 0) 0x7fdbac06e150 con 0x7fdbac0c9db0 2023-10-09T06:43:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.593+0000 7fdbabfff700 1 --2- 172.21.15.71:0/625718151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbac153900 0x7fdbac0c6f00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0098e0 tx=0x7fdb9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10775209d17bf9a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:07.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.593+0000 7fdbaaffd700 1 -- 172.21.15.71:0/625718151 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c009e80 con 0x7fdbac153900 2023-10-09T06:43:07.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.593+0000 7fdbaaffd700 1 -- 172.21.15.71:0/625718151 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c00b860 con 0x7fdbac153900 2023-10-09T06:43:07.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.593+0000 7fdbaaffd700 1 -- 172.21.15.71:0/625718151 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c00bbe0 con 0x7fdbac153900 2023-10-09T06:43:07.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.594+0000 7fdbb179d700 1 -- 172.21.15.71:0/625718151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbac153900 msgr2=0x7fdbac0c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:07.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.594+0000 7fdbb179d700 1 --2- 172.21.15.71:0/625718151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbac153900 0x7fdbac0c6f00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0098e0 tx=0x7fdb9c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:07.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.594+0000 7fdbb179d700 1 -- 172.21.15.71:0/625718151 shutdown_connections 2023-10-09T06:43:07.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.594+0000 7fdbb179d700 1 --2- 172.21.15.71:0/625718151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbac153900 0x7fdbac0c6f00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:07.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.594+0000 7fdbb179d700 1 -- 172.21.15.71:0/625718151 >> 172.21.15.71:0/625718151 conn(0x7fdbac0cc1e0 msgr2=0x7fdbac0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:07.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.594+0000 7fdbb179d700 1 -- 172.21.15.71:0/625718151 shutdown_connections 2023-10-09T06:43:07.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.594+0000 7fdbb179d700 1 -- 172.21.15.71:0/625718151 wait complete. 2023-10-09T06:43:07.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.595+0000 7fdbb179d700 1 Processor -- start 2023-10-09T06:43:07.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.595+0000 7fdbb179d700 1 -- start start 2023-10-09T06:43:07.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.596+0000 7fdbb179d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbac06a710 0x7fdbac0b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:07.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.596+0000 7fdbb179d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbac0c9db0 0x7fdbac1518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:07.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.596+0000 7fdbb179d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbac153900 0x7fdbac151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:07.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.596+0000 7fdbb179d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac0c6050 con 0x7fdbac0c9db0 2023-10-09T06:43:07.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.596+0000 7fdbb179d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac0c57b0 con 0x7fdbac06a710 2023-10-09T06:43:07.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.596+0000 7fdbb179d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac0c5a90 con 0x7fdbac153900 2023-10-09T06:43:07.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.597+0000 7fdbab7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbac0c9db0 0x7fdbac1518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:07.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.597+0000 7fdbab7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbac0c9db0 0x7fdbac1518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40392/0 (socket says 172.21.15.71:40392) 2023-10-09T06:43:07.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.597+0000 7fdbab7fe700 1 -- 172.21.15.71:0/3970335055 learned_addr learned my addr 172.21.15.71:0/3970335055 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:07.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.597+0000 7fdbb0f9c700 1 --2- 172.21.15.71:0/3970335055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbac153900 0x7fdbac151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:07.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.597+0000 7fdbabfff700 1 --2- 172.21.15.71:0/3970335055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbac06a710 0x7fdbac0b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:07.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.597+0000 7fdbab7fe700 1 -- 172.21.15.71:0/3970335055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbac153900 msgr2=0x7fdbac151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:07.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.597+0000 7fdbab7fe700 1 --2- 172.21.15.71:0/3970335055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbac153900 0x7fdbac151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:07.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.597+0000 7fdbab7fe700 1 -- 172.21.15.71:0/3970335055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbac06a710 msgr2=0x7fdbac0b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:07.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.597+0000 7fdbab7fe700 1 --2- 172.21.15.71:0/3970335055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbac06a710 0x7fdbac0b17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:07.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.597+0000 7fdbab7fe700 1 -- 172.21.15.71:0/3970335055 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c009420 con 0x7fdbac0c9db0 2023-10-09T06:43:07.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.597+0000 7fdbabfff700 1 --2- 172.21.15.71:0/3970335055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbac06a710 0x7fdbac0b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:07.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.597+0000 7fdbab7fe700 1 --2- 172.21.15.71:0/3970335055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbac0c9db0 0x7fdbac1518c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdba000c7e0 tx=0x7fdba0007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:07.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.597+0000 7fdb93fff700 1 -- 172.21.15.71:0/3970335055 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba00063b0 con 0x7fdbac0c9db0 2023-10-09T06:43:07.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.598+0000 7fdb93fff700 1 -- 172.21.15.71:0/3970335055 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba0006510 con 0x7fdbac0c9db0 2023-10-09T06:43:07.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.598+0000 7fdbb179d700 1 -- 172.21.15.71:0/3970335055 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbac0c5d70 con 0x7fdbac0c9db0 2023-10-09T06:43:07.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.598+0000 7fdb93fff700 1 -- 172.21.15.71:0/3970335055 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba0004a80 con 0x7fdbac0c9db0 2023-10-09T06:43:07.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.598+0000 7fdbb179d700 1 -- 172.21.15.71:0/3970335055 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbac0c5410 con 0x7fdbac0c9db0 2023-10-09T06:43:07.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.599+0000 7fdbb179d700 1 -- 172.21.15.71:0/3970335055 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbac0aef80 con 0x7fdbac0c9db0 2023-10-09T06:43:07.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.599+0000 7fdb93fff700 1 -- 172.21.15.71:0/3970335055 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdba001b3b0 con 0x7fdbac0c9db0 2023-10-09T06:43:07.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.600+0000 7fdb93fff700 1 --2- 172.21.15.71:0/3970335055 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb98066f30 0x7fdb980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:07.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.600+0000 7fdb93fff700 1 -- 172.21.15.71:0/3970335055 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdba0083ba0 con 0x7fdbac0c9db0 2023-10-09T06:43:07.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.601+0000 7fdbabfff700 1 --2- 172.21.15.71:0/3970335055 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb98066f30 0x7fdb980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:07.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.601+0000 7fdbabfff700 1 --2- 172.21.15.71:0/3970335055 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb98066f30 0x7fdb980693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0098e0 tx=0x7fdb9c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:07.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.604+0000 7fdb93fff700 1 -- 172.21.15.71:0/3970335055 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdbac0aef80 con 0x7fdbac0c9db0 2023-10-09T06:43:07.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.795+0000 7fdbb179d700 1 -- 172.21.15.71:0/3970335055 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdbac0aef80 con 0x7fdbac0c9db0 2023-10-09T06:43:07.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.795+0000 7fdb93fff700 1 -- 172.21.15.71:0/3970335055 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdbac0aef80 con 0x7fdbac0c9db0 2023-10-09T06:43:07.796 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-09T06:43:07.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.797+0000 7fdbb179d700 1 -- 172.21.15.71:0/3970335055 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb98066f30 msgr2=0x7fdb980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:07.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.797+0000 7fdbb179d700 1 --2- 172.21.15.71:0/3970335055 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb98066f30 0x7fdb980693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0098e0 tx=0x7fdb9c017000 comp rx=0 tx=0).stop 2023-10-09T06:43:07.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.797+0000 7fdbb179d700 1 -- 172.21.15.71:0/3970335055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbac0c9db0 msgr2=0x7fdbac1518c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:07.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.797+0000 7fdbb179d700 1 --2- 172.21.15.71:0/3970335055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbac0c9db0 0x7fdbac1518c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdba000c7e0 tx=0x7fdba0007d70 comp rx=0 tx=0).stop 2023-10-09T06:43:07.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.797+0000 7fdbb179d700 1 -- 172.21.15.71:0/3970335055 shutdown_connections 2023-10-09T06:43:07.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.797+0000 7fdbb179d700 1 --2- 172.21.15.71:0/3970335055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbac153900 0x7fdbac151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:07.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.797+0000 7fdbb179d700 1 --2- 172.21.15.71:0/3970335055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbac06a710 0x7fdbac0b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:07.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.797+0000 7fdbb179d700 1 --2- 172.21.15.71:0/3970335055 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb98066f30 0x7fdb980693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:07.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.797+0000 7fdbb179d700 1 --2- 172.21.15.71:0/3970335055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbac0c9db0 0x7fdbac1518c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:07.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.797+0000 7fdbb179d700 1 -- 172.21.15.71:0/3970335055 >> 172.21.15.71:0/3970335055 conn(0x7fdbac0cc1e0 msgr2=0x7fdbac0cb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:07.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.798+0000 7fdbb179d700 1 -- 172.21.15.71:0/3970335055 shutdown_connections 2023-10-09T06:43:07.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.798+0000 7fdbb179d700 1 -- 172.21.15.71:0/3970335055 wait complete. 2023-10-09T06:43:07.816 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:43:07.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.998+0000 7fc934d9d700 1 Processor -- start 2023-10-09T06:43:08.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:07.999+0000 7fc934d9d700 1 -- start start 2023-10-09T06:43:08.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.000+0000 7fc934d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc9301597f0 0x7fc9300b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:08.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.000+0000 7fc934d9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9300b11d0 con 0x7fc930159420 2023-10-09T06:43:08.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.000+0000 7fc934d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9300b14b0 con 0x7fc93015d230 2023-10-09T06:43:08.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.000+0000 7fc934d9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9300b1790 con 0x7fc9301597f0 2023-10-09T06:43:08.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.000+0000 7fc92effd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc9301597f0 0x7fc9300b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:08.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.000+0000 7fc92effd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc9301597f0 0x7fc9300b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40400/0 (socket says 172.21.15.71:40400) 2023-10-09T06:43:08.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.000+0000 7fc92effd700 1 -- 172.21.15.71:0/1220133404 learned_addr learned my addr 172.21.15.71:0/1220133404 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:08.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.000+0000 7fc92f7fe700 1 --1- 172.21.15.71:0/1220133404 >> v1:172.21.15.71:6789/0 conn(0x7fc930159420 0x7fc9300b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47366/0 (socket says 172.21.15.71:47366) 2023-10-09T06:43:08.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.001+0000 7fc92effd700 1 -- 172.21.15.71:0/1220133404 >> v1:172.21.15.179:6789/0 conn(0x7fc93015d230 legacy=0x7fc93015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:08.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.001+0000 7fc92effd700 1 -- 172.21.15.71:0/1220133404 >> v1:172.21.15.71:6789/0 conn(0x7fc930159420 legacy=0x7fc9300b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:08.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.001+0000 7fc92effd700 1 -- 172.21.15.71:0/1220133404 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9300b1a70 con 0x7fc9301597f0 2023-10-09T06:43:08.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.001+0000 7fc92e7fc700 1 -- 172.21.15.71:0/1220133404 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562499398 0 0) 0x7fc9300b11d0 con 0x7fc930159420 2023-10-09T06:43:08.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.001+0000 7fc92effd700 1 --2- 172.21.15.71:0/1220133404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9301597f0 0x7fc9300b2270 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc9240099b0 tx=0x7fc924009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e99046bc57efcab server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:08.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.001+0000 7fc92e7fc700 1 -- 172.21.15.71:0/1220133404 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92400b860 con 0x7fc9301597f0 2023-10-09T06:43:08.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.001+0000 7fc92e7fc700 1 -- 172.21.15.71:0/1220133404 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92400b9c0 con 0x7fc9301597f0 2023-10-09T06:43:08.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.001+0000 7fc92e7fc700 1 -- 172.21.15.71:0/1220133404 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92400bd60 con 0x7fc9301597f0 2023-10-09T06:43:08.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.002+0000 7fc934d9d700 1 -- 172.21.15.71:0/1220133404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9301597f0 msgr2=0x7fc9300b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:08.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.002+0000 7fc934d9d700 1 --2- 172.21.15.71:0/1220133404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9301597f0 0x7fc9300b2270 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc9240099b0 tx=0x7fc924009250 comp rx=0 tx=0).stop 2023-10-09T06:43:08.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.002+0000 7fc934d9d700 1 -- 172.21.15.71:0/1220133404 shutdown_connections 2023-10-09T06:43:08.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.002+0000 7fc934d9d700 1 --2- 172.21.15.71:0/1220133404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9301597f0 0x7fc9300b2270 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:08.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.002+0000 7fc934d9d700 1 -- 172.21.15.71:0/1220133404 >> 172.21.15.71:0/1220133404 conn(0x7fc9300d0660 msgr2=0x7fc9300d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:08.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.002+0000 7fc934d9d700 1 -- 172.21.15.71:0/1220133404 shutdown_connections 2023-10-09T06:43:08.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.002+0000 7fc934d9d700 1 -- 172.21.15.71:0/1220133404 wait complete. 2023-10-09T06:43:08.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.004+0000 7fc934d9d700 1 Processor -- start 2023-10-09T06:43:08.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.004+0000 7fc934d9d700 1 -- start start 2023-10-09T06:43:08.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.005+0000 7fc934d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc930159420 0x7fc930145fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:08.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.005+0000 7fc934d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9301597f0 0x7fc930157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:08.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.005+0000 7fc934d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc93015d230 0x7fc930157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:08.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.005+0000 7fc934d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93016cf90 con 0x7fc930159420 2023-10-09T06:43:08.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.005+0000 7fc934d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93016db10 con 0x7fc93015d230 2023-10-09T06:43:08.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.005+0000 7fc934d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93016d1e0 con 0x7fc9301597f0 2023-10-09T06:43:08.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.005+0000 7fc92f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc930159420 0x7fc930145fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:08.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.005+0000 7fc92f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc930159420 0x7fc930145fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40414/0 (socket says 172.21.15.71:40414) 2023-10-09T06:43:08.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.005+0000 7fc92f7fe700 1 -- 172.21.15.71:0/2875764080 learned_addr learned my addr 172.21.15.71:0/2875764080 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:08.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.005+0000 7fc92f7fe700 1 -- 172.21.15.71:0/2875764080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9301597f0 msgr2=0x7fc930157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:08.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.005+0000 7fc92f7fe700 1 --2- 172.21.15.71:0/2875764080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9301597f0 0x7fc930157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:08.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.005+0000 7fc92f7fe700 1 -- 172.21.15.71:0/2875764080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc93015d230 msgr2=0x7fc930157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:08.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.005+0000 7fc92f7fe700 1 --2- 172.21.15.71:0/2875764080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc93015d230 0x7fc930157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:08.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.005+0000 7fc92f7fe700 1 -- 172.21.15.71:0/2875764080 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9240094f0 con 0x7fc930159420 2023-10-09T06:43:08.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.005+0000 7fc92f7fe700 1 --2- 172.21.15.71:0/2875764080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc930159420 0x7fc930145fb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc92000c840 tx=0x7fc920007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.006+0000 7fc9177fe700 1 -- 172.21.15.71:0/2875764080 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920005b40 con 0x7fc930159420 2023-10-09T06:43:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.006+0000 7fc9177fe700 1 -- 172.21.15.71:0/2875764080 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc920005cc0 con 0x7fc930159420 2023-10-09T06:43:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.006+0000 7fc9177fe700 1 -- 172.21.15.71:0/2875764080 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920007320 con 0x7fc930159420 2023-10-09T06:43:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.006+0000 7fc934d9d700 1 -- 172.21.15.71:0/2875764080 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93016d4c0 con 0x7fc930159420 2023-10-09T06:43:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.006+0000 7fc934d9d700 1 -- 172.21.15.71:0/2875764080 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9301464f0 con 0x7fc930159420 2023-10-09T06:43:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.007+0000 7fc934d9d700 1 -- 172.21.15.71:0/2875764080 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc93016dea0 con 0x7fc930159420 2023-10-09T06:43:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.008+0000 7fc9177fe700 1 -- 172.21.15.71:0/2875764080 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc92001b3b0 con 0x7fc930159420 2023-10-09T06:43:08.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.008+0000 7fc9177fe700 1 --2- 172.21.15.71:0/2875764080 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc91c066f30 0x7fc91c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:08.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.009+0000 7fc9177fe700 1 -- 172.21.15.71:0/2875764080 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc920083b00 con 0x7fc930159420 2023-10-09T06:43:08.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.009+0000 7fc92effd700 1 --2- 172.21.15.71:0/2875764080 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc91c066f30 0x7fc91c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:08.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.010+0000 7fc92effd700 1 --2- 172.21.15.71:0/2875764080 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc91c066f30 0x7fc91c0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc9240099b0 tx=0x7fc924017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:08.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.012+0000 7fc9177fe700 1 -- 172.21.15.71:0/2875764080 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc920050d70 con 0x7fc930159420 2023-10-09T06:43:08.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.212+0000 7fc934d9d700 1 -- 172.21.15.71:0/2875764080 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc93004c3c0 con 0x7fc930159420 2023-10-09T06:43:08.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.213+0000 7fc9177fe700 1 -- 172.21.15.71:0/2875764080 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fc920017020 con 0x7fc930159420 2023-10-09T06:43:08.214 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:08.214 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":20,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:42:39.546192+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:42:35.828340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:42:37.071896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:43:08.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.215+0000 7fc934d9d700 1 -- 172.21.15.71:0/2875764080 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc91c066f30 msgr2=0x7fc91c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:08.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.215+0000 7fc934d9d700 1 --2- 172.21.15.71:0/2875764080 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc91c066f30 0x7fc91c0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc9240099b0 tx=0x7fc924017000 comp rx=0 tx=0).stop 2023-10-09T06:43:08.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.215+0000 7fc934d9d700 1 -- 172.21.15.71:0/2875764080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc930159420 msgr2=0x7fc930145fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:08.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.215+0000 7fc934d9d700 1 --2- 172.21.15.71:0/2875764080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc930159420 0x7fc930145fb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc92000c840 tx=0x7fc920007d90 comp rx=0 tx=0).stop 2023-10-09T06:43:08.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.215+0000 7fc934d9d700 1 -- 172.21.15.71:0/2875764080 shutdown_connections 2023-10-09T06:43:08.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.215+0000 7fc934d9d700 1 --2- 172.21.15.71:0/2875764080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc93015d230 0x7fc930157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:08.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.215+0000 7fc934d9d700 1 --2- 172.21.15.71:0/2875764080 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc91c066f30 0x7fc91c0693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:08.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.215+0000 7fc934d9d700 1 --2- 172.21.15.71:0/2875764080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc930159420 0x7fc930145fb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:08.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.215+0000 7fc934d9d700 1 --2- 172.21.15.71:0/2875764080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9301597f0 0x7fc930157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:08.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.215+0000 7fc934d9d700 1 -- 172.21.15.71:0/2875764080 >> 172.21.15.71:0/2875764080 conn(0x7fc9300d0660 msgr2=0x7fc930069be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:08.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.216+0000 7fc934d9d700 1 -- 172.21.15.71:0/2875764080 shutdown_connections 2023-10-09T06:43:08.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.216+0000 7fc934d9d700 1 -- 172.21.15.71:0/2875764080 wait complete. 2023-10-09T06:43:08.234 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:42:35.828340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:42:37.071896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:43:08.235 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:43:08.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.420+0000 7fb7235ff700 1 Processor -- start 2023-10-09T06:43:08.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.420+0000 7fb7235ff700 1 -- start start 2023-10-09T06:43:08.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.421+0000 7fb7235ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb71c0699c0 0x7fb71c06f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:08.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.421+0000 7fb7235ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb71c06f750 0x7fb71c1596d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:08.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.422+0000 7fb7235ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71c06de10 con 0x7fb71c069d90 2023-10-09T06:43:08.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.422+0000 7fb7235ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb71c06e0f0 con 0x7fb71c0699c0 2023-10-09T06:43:08.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.422+0000 7fb7235ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c06e3d0 con 0x7fb71c06f750 2023-10-09T06:43:08.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.422+0000 7fb720b9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb71c06f750 0x7fb71c1596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:08.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.422+0000 7fb72139b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb71c0699c0 0x7fb71c06f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:08.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.422+0000 7fb721b9c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb71c069d90 0x7fb71c15d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:39582/0 (socket says 172.21.15.71:39582) 2023-10-09T06:43:08.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.422+0000 7fb721b9c700 1 -- 172.21.15.71:0/618415501 learned_addr learned my addr 172.21.15.71:0/618415501 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:08.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.422+0000 7fb713fff700 1 -- 172.21.15.71:0/618415501 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137301377 0 0) 0x7fb71c06de10 con 0x7fb71c069d90 2023-10-09T06:43:08.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.423+0000 7fb713fff700 1 -- 172.21.15.71:0/618415501 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb708003570 con 0x7fb71c069d90 2023-10-09T06:43:08.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.423+0000 7fb720b9a700 1 -- 172.21.15.71:0/618415501 >> v2:172.21.15.179:3300/0 conn(0x7fb71c0699c0 msgr2=0x7fb71c06f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:08.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.423+0000 7fb720b9a700 1 --2- 172.21.15.71:0/618415501 >> v2:172.21.15.179:3300/0 conn(0x7fb71c0699c0 0x7fb71c06f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:08.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.423+0000 7fb720b9a700 1 -- 172.21.15.71:0/618415501 >> v1:172.21.15.179:6789/0 conn(0x7fb71c069d90 legacy=0x7fb71c15d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:08.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.423+0000 7fb720b9a700 1 -- 172.21.15.71:0/618415501 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71c06e6b0 con 0x7fb71c06f750 2023-10-09T06:43:08.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.423+0000 7fb72139b700 1 --2- 172.21.15.71:0/618415501 >> v2:172.21.15.179:3300/0 conn(0x7fb71c0699c0 0x7fb71c06f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:43:08.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.423+0000 7fb720b9a700 1 --2- 172.21.15.71:0/618415501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb71c06f750 0x7fb71c1596d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb70c0098e0 tx=0x7fb70c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdeff5bbb22012f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:08.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.423+0000 7fb713fff700 1 -- 172.21.15.71:0/618415501 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c011630 con 0x7fb71c06f750 2023-10-09T06:43:08.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.423+0000 7fb713fff700 1 -- 172.21.15.71:0/618415501 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70c011790 con 0x7fb71c06f750 2023-10-09T06:43:08.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.423+0000 7fb713fff700 1 -- 172.21.15.71:0/618415501 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c011b30 con 0x7fb71c06f750 2023-10-09T06:43:08.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.424+0000 7fb7235ff700 1 -- 172.21.15.71:0/618415501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb71c06f750 msgr2=0x7fb71c1596d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:08.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.424+0000 7fb7235ff700 1 --2- 172.21.15.71:0/618415501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb71c06f750 0x7fb71c1596d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb70c0098e0 tx=0x7fb70c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:08.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.424+0000 7fb7235ff700 1 -- 172.21.15.71:0/618415501 shutdown_connections 2023-10-09T06:43:08.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.424+0000 7fb7235ff700 1 --2- 172.21.15.71:0/618415501 >> v2:172.21.15.179:3300/0 conn(0x7fb71c0699c0 0x7fb71c06f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:08.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.424+0000 7fb7235ff700 1 --2- 172.21.15.71:0/618415501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb71c06f750 0x7fb71c1596d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:08.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.424+0000 7fb7235ff700 1 -- 172.21.15.71:0/618415501 >> 172.21.15.71:0/618415501 conn(0x7fb71c068e10 msgr2=0x7fb71c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:08.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.424+0000 7fb7235ff700 1 -- 172.21.15.71:0/618415501 shutdown_connections 2023-10-09T06:43:08.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.424+0000 7fb7235ff700 1 -- 172.21.15.71:0/618415501 wait complete. 2023-10-09T06:43:08.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.425+0000 7fb7235ff700 1 Processor -- start 2023-10-09T06:43:08.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.425+0000 7fb7235ff700 1 -- start start 2023-10-09T06:43:08.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.426+0000 7fb7235ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb71c0699c0 0x7fb71c153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:08.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.426+0000 7fb7235ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb71c069d90 0x7fb71c0c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:08.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.426+0000 7fb7235ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb71c06f750 0x7fb71c14cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:08.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.426+0000 7fb7235ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c0c5d60 con 0x7fb71c069d90 2023-10-09T06:43:08.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.426+0000 7fb7235ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c0c3910 con 0x7fb71c0699c0 2023-10-09T06:43:08.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.426+0000 7fb7235ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c152530 con 0x7fb71c06f750 2023-10-09T06:43:08.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.427+0000 7fb720b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb71c069d90 0x7fb71c0c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:08.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.427+0000 7fb720b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb71c069d90 0x7fb71c0c43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40430/0 (socket says 172.21.15.71:40430) 2023-10-09T06:43:08.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.427+0000 7fb720b9a700 1 -- 172.21.15.71:0/2393710877 learned_addr learned my addr 172.21.15.71:0/2393710877 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:08.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.427+0000 7fb72139b700 1 --2- 172.21.15.71:0/2393710877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb71c0699c0 0x7fb71c153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:08.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.427+0000 7fb721b9c700 1 --2- 172.21.15.71:0/2393710877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb71c06f750 0x7fb71c14cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:08.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.427+0000 7fb720b9a700 1 -- 172.21.15.71:0/2393710877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb71c06f750 msgr2=0x7fb71c14cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:08.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.427+0000 7fb720b9a700 1 --2- 172.21.15.71:0/2393710877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb71c06f750 0x7fb71c14cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:08.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.427+0000 7fb720b9a700 1 -- 172.21.15.71:0/2393710877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb71c0699c0 msgr2=0x7fb71c153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:08.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.427+0000 7fb720b9a700 1 --2- 172.21.15.71:0/2393710877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb71c0699c0 0x7fb71c153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:08.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.427+0000 7fb720b9a700 1 -- 172.21.15.71:0/2393710877 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb718009420 con 0x7fb71c069d90 2023-10-09T06:43:08.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.427+0000 7fb720b9a700 1 --2- 172.21.15.71:0/2393710877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb71c069d90 0x7fb71c0c43e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb70c013000 tx=0x7fb70c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:08.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.428+0000 7fb7117fa700 1 -- 172.21.15.71:0/2393710877 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c011900 con 0x7fb71c069d90 2023-10-09T06:43:08.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.428+0000 7fb7117fa700 1 -- 172.21.15.71:0/2393710877 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70c011a60 con 0x7fb71c069d90 2023-10-09T06:43:08.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.428+0000 7fb7117fa700 1 -- 172.21.15.71:0/2393710877 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c025640 con 0x7fb71c069d90 2023-10-09T06:43:08.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.428+0000 7fb7235ff700 1 -- 172.21.15.71:0/2393710877 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb70c009420 con 0x7fb71c069d90 2023-10-09T06:43:08.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.428+0000 7fb7235ff700 1 -- 172.21.15.71:0/2393710877 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71c1527d0 con 0x7fb71c069d90 2023-10-09T06:43:08.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.429+0000 7fb7235ff700 1 -- 172.21.15.71:0/2393710877 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71c04c3c0 con 0x7fb71c069d90 2023-10-09T06:43:08.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.430+0000 7fb7117fa700 1 -- 172.21.15.71:0/2393710877 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb70c025a30 con 0x7fb71c069d90 2023-10-09T06:43:08.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.430+0000 7fb7117fa700 1 --2- 172.21.15.71:0/2393710877 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb700066f30 0x7fb7000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:08.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.430+0000 7fb7117fa700 1 -- 172.21.15.71:0/2393710877 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb70c085c10 con 0x7fb71c069d90 2023-10-09T06:43:08.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.431+0000 7fb72139b700 1 --2- 172.21.15.71:0/2393710877 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb700066f30 0x7fb7000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:08.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.432+0000 7fb72139b700 1 --2- 172.21.15.71:0/2393710877 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb700066f30 0x7fb7000693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb718009f40 tx=0x7fb7180091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:08.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.435+0000 7fb7117fa700 1 -- 172.21.15.71:0/2393710877 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb70c052de0 con 0x7fb71c069d90 2023-10-09T06:43:08.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.628+0000 7fb7235ff700 1 -- 172.21.15.71:0/2393710877 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb71c0c7b00 con 0x7fb71c069d90 2023-10-09T06:43:08.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.628+0000 7fb7117fa700 1 -- 172.21.15.71:0/2393710877 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb70c015020 con 0x7fb71c069d90 2023-10-09T06:43:08.630 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T06:43:08.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.630+0000 7fb7235ff700 1 -- 172.21.15.71:0/2393710877 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb700066f30 msgr2=0x7fb7000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:08.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.630+0000 7fb7235ff700 1 --2- 172.21.15.71:0/2393710877 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb700066f30 0x7fb7000693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb718009f40 tx=0x7fb7180091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:08.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.630+0000 7fb7235ff700 1 -- 172.21.15.71:0/2393710877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb71c069d90 msgr2=0x7fb71c0c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:08.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.630+0000 7fb7235ff700 1 --2- 172.21.15.71:0/2393710877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb71c069d90 0x7fb71c0c43e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb70c013000 tx=0x7fb70c017000 comp rx=0 tx=0).stop 2023-10-09T06:43:08.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.630+0000 7fb7235ff700 1 -- 172.21.15.71:0/2393710877 shutdown_connections 2023-10-09T06:43:08.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.630+0000 7fb7235ff700 1 --2- 172.21.15.71:0/2393710877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb71c06f750 0x7fb71c14cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:08.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.630+0000 7fb7235ff700 1 --2- 172.21.15.71:0/2393710877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb71c0699c0 0x7fb71c153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:08.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.630+0000 7fb7235ff700 1 --2- 172.21.15.71:0/2393710877 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb700066f30 0x7fb7000693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:08.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.630+0000 7fb7235ff700 1 --2- 172.21.15.71:0/2393710877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb71c069d90 0x7fb71c0c43e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:08.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.630+0000 7fb7235ff700 1 -- 172.21.15.71:0/2393710877 >> 172.21.15.71:0/2393710877 conn(0x7fb71c068e10 msgr2=0x7fb71c0c1360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:08.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.630+0000 7fb7235ff700 1 -- 172.21.15.71:0/2393710877 shutdown_connections 2023-10-09T06:43:08.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.631+0000 7fb7235ff700 1 -- 172.21.15.71:0/2393710877 wait complete. 2023-10-09T06:43:08.649 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:43:08.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.832+0000 7f2fc919d700 1 Processor -- start 2023-10-09T06:43:08.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.832+0000 7f2fc919d700 1 -- start start 2023-10-09T06:43:08.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.833+0000 7f2fc919d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2fc4159450 0x7f2fc40c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:08.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.833+0000 7f2fc919d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2fc4159820 0x7f2fc406d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:08.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.833+0000 7f2fc919d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc40c8730 con 0x7f2fc40c96e0 2023-10-09T06:43:08.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.833+0000 7f2fc919d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc40c7b00 con 0x7f2fc4159820 2023-10-09T06:43:08.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.833+0000 7f2fc919d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc40c89a0 con 0x7f2fc4159450 2023-10-09T06:43:08.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.834+0000 7f2fbbfff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f2fc40c96e0 0x7f2fc40a98e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47382/0 (socket says 172.21.15.71:47382) 2023-10-09T06:43:08.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.834+0000 7f2fbbfff700 1 -- 172.21.15.71:0/1796538722 learned_addr learned my addr 172.21.15.71:0/1796538722 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:08.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.834+0000 7f2fc899c700 1 --2- 172.21.15.71:0/1796538722 >> v2:172.21.15.71:3300/0 conn(0x7f2fc4159820 0x7f2fc406d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:08.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.834+0000 7f2fc3fff700 1 --2- 172.21.15.71:0/1796538722 >> v2:172.21.15.179:3300/0 conn(0x7f2fc4159450 0x7f2fc40c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:08.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.834+0000 7f2fc37fe700 1 -- 172.21.15.71:0/1796538722 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741167343 0 0) 0x7f2fc40c8730 con 0x7f2fc40c96e0 2023-10-09T06:43:08.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.834+0000 7f2fc899c700 1 -- 172.21.15.71:0/1796538722 >> v2:172.21.15.179:3300/0 conn(0x7f2fc4159450 msgr2=0x7f2fc40c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:08.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.834+0000 7f2fc899c700 1 --2- 172.21.15.71:0/1796538722 >> v2:172.21.15.179:3300/0 conn(0x7f2fc4159450 0x7f2fc40c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:08.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.834+0000 7f2fc899c700 1 -- 172.21.15.71:0/1796538722 >> v1:172.21.15.71:6789/0 conn(0x7f2fc40c96e0 legacy=0x7f2fc40a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:08.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.834+0000 7f2fc899c700 1 -- 172.21.15.71:0/1796538722 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc40c8c80 con 0x7f2fc4159820 2023-10-09T06:43:08.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.834+0000 7f2fc3fff700 1 --2- 172.21.15.71:0/1796538722 >> v2:172.21.15.179:3300/0 conn(0x7f2fc4159450 0x7f2fc40c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:08.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.834+0000 7f2fc899c700 1 --2- 172.21.15.71:0/1796538722 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fc4159820 0x7f2fc406d750 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2fc406d3f0 tx=0x7f2fbc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce5aa8180a545e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:08.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.835+0000 7f2fc37fe700 1 -- 172.21.15.71:0/1796538722 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc00e070 con 0x7f2fc4159820 2023-10-09T06:43:08.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.835+0000 7f2fc37fe700 1 -- 172.21.15.71:0/1796538722 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc00bc30 con 0x7f2fc4159820 2023-10-09T06:43:08.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.835+0000 7f2fc37fe700 1 -- 172.21.15.71:0/1796538722 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc012430 con 0x7f2fc4159820 2023-10-09T06:43:08.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.835+0000 7f2fc919d700 1 -- 172.21.15.71:0/1796538722 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fc4159820 msgr2=0x7f2fc406d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:08.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.835+0000 7f2fc919d700 1 --2- 172.21.15.71:0/1796538722 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fc4159820 0x7f2fc406d750 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2fc406d3f0 tx=0x7f2fbc009780 comp rx=0 tx=0).stop 2023-10-09T06:43:08.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.835+0000 7f2fc919d700 1 -- 172.21.15.71:0/1796538722 shutdown_connections 2023-10-09T06:43:08.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.835+0000 7f2fc919d700 1 --2- 172.21.15.71:0/1796538722 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fc4159820 0x7f2fc406d750 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:08.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.835+0000 7f2fc919d700 1 --2- 172.21.15.71:0/1796538722 >> v2:172.21.15.179:3300/0 conn(0x7f2fc4159450 0x7f2fc40c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:08.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.835+0000 7f2fc919d700 1 -- 172.21.15.71:0/1796538722 >> 172.21.15.71:0/1796538722 conn(0x7f2fc40698e0 msgr2=0x7f2fc4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:08.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.835+0000 7f2fc919d700 1 -- 172.21.15.71:0/1796538722 shutdown_connections 2023-10-09T06:43:08.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.835+0000 7f2fc919d700 1 -- 172.21.15.71:0/1796538722 wait complete. 2023-10-09T06:43:08.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.837+0000 7f2fc919d700 1 Processor -- start 2023-10-09T06:43:08.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.837+0000 7f2fc919d700 1 -- start start 2023-10-09T06:43:08.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.838+0000 7f2fc919d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fc40c96e0 0x7f2fc4151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:08.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.838+0000 7f2fc919d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fc4159450 0x7f2fc415ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:08.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.838+0000 7f2fc919d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fc4159820 0x7f2fc4154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:08.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.838+0000 7f2fc919d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc4152100 con 0x7f2fc4159820 2023-10-09T06:43:08.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.838+0000 7f2fc919d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc40b0070 con 0x7f2fc40c96e0 2023-10-09T06:43:08.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.838+0000 7f2fc919d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc40b0350 con 0x7f2fc4159450 2023-10-09T06:43:08.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.838+0000 7f2fc899c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fc4159820 0x7f2fc4154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:08.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.838+0000 7f2fc899c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fc4159820 0x7f2fc4154aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40438/0 (socket says 172.21.15.71:40438) 2023-10-09T06:43:08.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.838+0000 7f2fc899c700 1 -- 172.21.15.71:0/776213528 learned_addr learned my addr 172.21.15.71:0/776213528 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:08.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.838+0000 7f2fc3fff700 1 --2- 172.21.15.71:0/776213528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fc40c96e0 0x7f2fc4151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:08.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.838+0000 7f2fbbfff700 1 --2- 172.21.15.71:0/776213528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fc4159450 0x7f2fc415ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:08.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.839+0000 7f2fc899c700 1 -- 172.21.15.71:0/776213528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fc4159450 msgr2=0x7f2fc415ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:08.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.839+0000 7f2fc899c700 1 --2- 172.21.15.71:0/776213528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fc4159450 0x7f2fc415ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:08.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.839+0000 7f2fc899c700 1 -- 172.21.15.71:0/776213528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fc40c96e0 msgr2=0x7f2fc4151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:08.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.839+0000 7f2fc899c700 1 --2- 172.21.15.71:0/776213528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fc40c96e0 0x7f2fc4151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:08.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.839+0000 7f2fc899c700 1 -- 172.21.15.71:0/776213528 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc009a20 con 0x7f2fc4159820 2023-10-09T06:43:08.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.839+0000 7f2fc899c700 1 --2- 172.21.15.71:0/776213528 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fc4159820 0x7f2fc4154aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc013000 tx=0x7f2fbc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:08.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.839+0000 7f2fc0ff9700 1 -- 172.21.15.71:0/776213528 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc027470 con 0x7f2fc4159820 2023-10-09T06:43:08.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.839+0000 7f2fc0ff9700 1 -- 172.21.15.71:0/776213528 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc027630 con 0x7f2fc4159820 2023-10-09T06:43:08.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.839+0000 7f2fc0ff9700 1 -- 172.21.15.71:0/776213528 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc0279f0 con 0x7f2fc4159820 2023-10-09T06:43:08.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.839+0000 7f2fc919d700 1 -- 172.21.15.71:0/776213528 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc40b0630 con 0x7f2fc4159820 2023-10-09T06:43:08.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.839+0000 7f2fc919d700 1 -- 172.21.15.71:0/776213528 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc40b0bf0 con 0x7f2fc4159820 2023-10-09T06:43:08.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.840+0000 7f2fc919d700 1 -- 172.21.15.71:0/776213528 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc40b0de0 con 0x7f2fc4159820 2023-10-09T06:43:08.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.841+0000 7f2fc0ff9700 1 -- 172.21.15.71:0/776213528 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2fbc024070 con 0x7f2fc4159820 2023-10-09T06:43:08.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.842+0000 7f2fc0ff9700 1 --2- 172.21.15.71:0/776213528 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2fa4066f30 0x7f2fa40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:08.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.842+0000 7f2fc0ff9700 1 -- 172.21.15.71:0/776213528 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2fbc086cc0 con 0x7f2fc4159820 2023-10-09T06:43:08.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.842+0000 7f2fc3fff700 1 --2- 172.21.15.71:0/776213528 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2fa4066f30 0x7f2fa40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:08.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.843+0000 7f2fc3fff700 1 --2- 172.21.15.71:0/776213528 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2fa4066f30 0x7f2fa40693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4006f00 tx=0x7f2fb4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:08.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:08.847+0000 7f2fc0ff9700 1 -- 172.21.15.71:0/776213528 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fbc08d080 con 0x7f2fc4159820 2023-10-09T06:43:09.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.036+0000 7f2fc919d700 1 -- 172.21.15.71:0/776213528 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2fc40c7de0 con 0x7f2fc4159820 2023-10-09T06:43:09.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.036+0000 7f2fc0ff9700 1 -- 172.21.15.71:0/776213528 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2fbc02c020 con 0x7f2fc4159820 2023-10-09T06:43:09.037 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-09T06:43:09.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.038+0000 7f2fc919d700 1 -- 172.21.15.71:0/776213528 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2fa4066f30 msgr2=0x7f2fa40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:09.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.038+0000 7f2fc919d700 1 --2- 172.21.15.71:0/776213528 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2fa4066f30 0x7f2fa40693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4006f00 tx=0x7f2fb4008040 comp rx=0 tx=0).stop 2023-10-09T06:43:09.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.038+0000 7f2fc919d700 1 -- 172.21.15.71:0/776213528 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fc4159820 msgr2=0x7f2fc4154aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:09.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.038+0000 7f2fc919d700 1 --2- 172.21.15.71:0/776213528 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fc4159820 0x7f2fc4154aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc013000 tx=0x7f2fbc019000 comp rx=0 tx=0).stop 2023-10-09T06:43:09.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.039+0000 7f2fc919d700 1 -- 172.21.15.71:0/776213528 shutdown_connections 2023-10-09T06:43:09.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.039+0000 7f2fc919d700 1 --2- 172.21.15.71:0/776213528 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2fa4066f30 0x7f2fa40693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.039+0000 7f2fc919d700 1 --2- 172.21.15.71:0/776213528 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fc4159820 0x7f2fc4154aa0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.039+0000 7f2fc919d700 1 --2- 172.21.15.71:0/776213528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fc40c96e0 0x7f2fc4151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.039+0000 7f2fc919d700 1 --2- 172.21.15.71:0/776213528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fc4159450 0x7f2fc415ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.039+0000 7f2fc919d700 1 -- 172.21.15.71:0/776213528 >> 172.21.15.71:0/776213528 conn(0x7f2fc40698e0 msgr2=0x7f2fc4069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:09.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.039+0000 7f2fc919d700 1 -- 172.21.15.71:0/776213528 shutdown_connections 2023-10-09T06:43:09.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.039+0000 7f2fc919d700 1 -- 172.21.15.71:0/776213528 wait complete. 2023-10-09T06:43:09.057 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:43:09.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.240+0000 7fe01a5ff700 1 Processor -- start 2023-10-09T06:43:09.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.240+0000 7fe01a5ff700 1 -- start start 2023-10-09T06:43:09.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.241+0000 7fe01a5ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe014159c10 0x7fe01415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:09.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.241+0000 7fe01a5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe0140b5ea0 0x7fe014068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:09.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.241+0000 7fe01a5ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01415c480 con 0x7fe014068bb0 2023-10-09T06:43:09.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.241+0000 7fe01a5ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0140b2a40 con 0x7fe014159c10 2023-10-09T06:43:09.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.241+0000 7fe01a5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01415b5d0 con 0x7fe0140b5ea0 2023-10-09T06:43:09.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.242+0000 7fe013fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe014159c10 0x7fe01415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:09.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.242+0000 7fe018b9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe014068bb0 0x7fe01415c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47396/0 (socket says 172.21.15.71:47396) 2023-10-09T06:43:09.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.242+0000 7fe018b9c700 1 -- 172.21.15.71:0/2777144987 learned_addr learned my addr 172.21.15.71:0/2777144987 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:09.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.242+0000 7fe013fff700 1 -- 172.21.15.71:0/2777144987 >> v2:172.21.15.179:3300/0 conn(0x7fe0140b5ea0 msgr2=0x7fe014068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:09.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.242+0000 7fe0137fe700 1 --2- 172.21.15.71:0/2777144987 >> v2:172.21.15.179:3300/0 conn(0x7fe0140b5ea0 0x7fe014068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:09.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.242+0000 7fe013fff700 1 --2- 172.21.15.71:0/2777144987 >> v2:172.21.15.179:3300/0 conn(0x7fe0140b5ea0 0x7fe014068670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.242+0000 7fe012ffd700 1 -- 172.21.15.71:0/2777144987 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1047144277 0 0) 0x7fe01415c480 con 0x7fe014068bb0 2023-10-09T06:43:09.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.242+0000 7fe013fff700 1 -- 172.21.15.71:0/2777144987 >> v1:172.21.15.71:6789/0 conn(0x7fe014068bb0 legacy=0x7fe01415c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:09.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.242+0000 7fe013fff700 1 -- 172.21.15.71:0/2777144987 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01415b870 con 0x7fe014159c10 2023-10-09T06:43:09.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.242+0000 7fe0137fe700 1 --2- 172.21.15.71:0/2777144987 >> v2:172.21.15.179:3300/0 conn(0x7fe0140b5ea0 0x7fe014068670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:09.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.242+0000 7fe013fff700 1 --2- 172.21.15.71:0/2777144987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe014159c10 0x7fe01415b090 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe01409a150 tx=0x7fe0040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20027f2087c70507 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:09.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.243+0000 7fe012ffd700 1 -- 172.21.15.71:0/2777144987 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00400b6b0 con 0x7fe014159c10 2023-10-09T06:43:09.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.243+0000 7fe012ffd700 1 -- 172.21.15.71:0/2777144987 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00400b810 con 0x7fe014159c10 2023-10-09T06:43:09.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.243+0000 7fe012ffd700 1 -- 172.21.15.71:0/2777144987 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00400bbb0 con 0x7fe014159c10 2023-10-09T06:43:09.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.243+0000 7fe01a5ff700 1 -- 172.21.15.71:0/2777144987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe014159c10 msgr2=0x7fe01415b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:09.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.243+0000 7fe01a5ff700 1 --2- 172.21.15.71:0/2777144987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe014159c10 0x7fe01415b090 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe01409a150 tx=0x7fe0040091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.243+0000 7fe01a5ff700 1 -- 172.21.15.71:0/2777144987 shutdown_connections 2023-10-09T06:43:09.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.243+0000 7fe01a5ff700 1 --2- 172.21.15.71:0/2777144987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe014159c10 0x7fe01415b090 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.243+0000 7fe01a5ff700 1 --2- 172.21.15.71:0/2777144987 >> v2:172.21.15.179:3300/0 conn(0x7fe0140b5ea0 0x7fe014068670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.243+0000 7fe01a5ff700 1 -- 172.21.15.71:0/2777144987 >> 172.21.15.71:0/2777144987 conn(0x7fe014099a20 msgr2=0x7fe0140af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:09.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.243+0000 7fe01a5ff700 1 -- 172.21.15.71:0/2777144987 shutdown_connections 2023-10-09T06:43:09.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.243+0000 7fe01a5ff700 1 -- 172.21.15.71:0/2777144987 wait complete. 2023-10-09T06:43:09.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.245+0000 7fe01a5ff700 1 Processor -- start 2023-10-09T06:43:09.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.245+0000 7fe01a5ff700 1 -- start start 2023-10-09T06:43:09.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.246+0000 7fe01a5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe014068bb0 0x7fe01416ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:09.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.246+0000 7fe01a5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0140b5ea0 0x7fe014169ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:09.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.246+0000 7fe01a5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe014159c10 0x7fe0140af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:09.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.246+0000 7fe01a5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0140b1410 con 0x7fe014068bb0 2023-10-09T06:43:09.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.246+0000 7fe01a5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01416d040 con 0x7fe0140b5ea0 2023-10-09T06:43:09.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.246+0000 7fe01a5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01416d320 con 0x7fe014159c10 2023-10-09T06:43:09.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.246+0000 7fe013fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe014068bb0 0x7fe01416ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:09.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.246+0000 7fe013fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe014068bb0 0x7fe01416ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40450/0 (socket says 172.21.15.71:40450) 2023-10-09T06:43:09.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.246+0000 7fe013fff700 1 -- 172.21.15.71:0/3044359580 learned_addr learned my addr 172.21.15.71:0/3044359580 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:09.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.246+0000 7fe013fff700 1 -- 172.21.15.71:0/3044359580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe014159c10 msgr2=0x7fe0140af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:09.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.246+0000 7fe013fff700 1 --2- 172.21.15.71:0/3044359580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe014159c10 0x7fe0140af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.246+0000 7fe013fff700 1 -- 172.21.15.71:0/3044359580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0140b5ea0 msgr2=0x7fe014169ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:09.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.246+0000 7fe013fff700 1 --2- 172.21.15.71:0/3044359580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0140b5ea0 0x7fe014169ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.246+0000 7fe013fff700 1 -- 172.21.15.71:0/3044359580 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe004009420 con 0x7fe014068bb0 2023-10-09T06:43:09.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.247+0000 7fe013fff700 1 --2- 172.21.15.71:0/3044359580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe014068bb0 0x7fe01416ca60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe014063db0 tx=0x7fe004017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:09.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.247+0000 7fdffbfff700 1 -- 172.21.15.71:0/3044359580 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe004011420 con 0x7fe014068bb0 2023-10-09T06:43:09.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.247+0000 7fdffbfff700 1 -- 172.21.15.71:0/3044359580 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe004011580 con 0x7fe014068bb0 2023-10-09T06:43:09.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.247+0000 7fe01a5ff700 1 -- 172.21.15.71:0/3044359580 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01416d600 con 0x7fe014068bb0 2023-10-09T06:43:09.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.247+0000 7fdffbfff700 1 -- 172.21.15.71:0/3044359580 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe004011920 con 0x7fe014068bb0 2023-10-09T06:43:09.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.247+0000 7fe01a5ff700 1 -- 172.21.15.71:0/3044359580 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0140af8e0 con 0x7fe014068bb0 2023-10-09T06:43:09.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.248+0000 7fe01a5ff700 1 -- 172.21.15.71:0/3044359580 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0140c7090 con 0x7fe014068bb0 2023-10-09T06:43:09.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.249+0000 7fdffbfff700 1 -- 172.21.15.71:0/3044359580 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe004011cd0 con 0x7fe014068bb0 2023-10-09T06:43:09.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.250+0000 7fdffbfff700 1 --2- 172.21.15.71:0/3044359580 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe000066f60 0x7fe000069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:09.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.250+0000 7fdffbfff700 1 -- 172.21.15.71:0/3044359580 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe004085f90 con 0x7fe014068bb0 2023-10-09T06:43:09.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.250+0000 7fe0137fe700 1 --2- 172.21.15.71:0/3044359580 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe000066f60 0x7fe000069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:09.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.251+0000 7fe0137fe700 1 --2- 172.21.15.71:0/3044359580 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe000066f60 0x7fe000069410 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe01406abf0 tx=0x7fe008008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:09.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.254+0000 7fdffbfff700 1 -- 172.21.15.71:0/3044359580 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0040531e0 con 0x7fe014068bb0 2023-10-09T06:43:09.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.442+0000 7fe01a5ff700 1 -- 172.21.15.71:0/3044359580 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe01404c3c0 con 0x7fe014068bb0 2023-10-09T06:43:09.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.442+0000 7fdffbfff700 1 -- 172.21.15.71:0/3044359580 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe004056800 con 0x7fe014068bb0 2023-10-09T06:43:09.444 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-09T06:43:09.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.445+0000 7fe01a5ff700 1 -- 172.21.15.71:0/3044359580 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe000066f60 msgr2=0x7fe000069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:09.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.445+0000 7fe01a5ff700 1 --2- 172.21.15.71:0/3044359580 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe000066f60 0x7fe000069410 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe01406abf0 tx=0x7fe008008040 comp rx=0 tx=0).stop 2023-10-09T06:43:09.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.445+0000 7fe01a5ff700 1 -- 172.21.15.71:0/3044359580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe014068bb0 msgr2=0x7fe01416ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:09.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.445+0000 7fe01a5ff700 1 --2- 172.21.15.71:0/3044359580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe014068bb0 0x7fe01416ca60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe014063db0 tx=0x7fe004017000 comp rx=0 tx=0).stop 2023-10-09T06:43:09.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.445+0000 7fe01a5ff700 1 -- 172.21.15.71:0/3044359580 shutdown_connections 2023-10-09T06:43:09.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.445+0000 7fe01a5ff700 1 --2- 172.21.15.71:0/3044359580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe014159c10 0x7fe0140af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.445+0000 7fe01a5ff700 1 --2- 172.21.15.71:0/3044359580 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe000066f60 0x7fe000069410 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.445+0000 7fe01a5ff700 1 --2- 172.21.15.71:0/3044359580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe014068bb0 0x7fe01416ca60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.445+0000 7fe01a5ff700 1 --2- 172.21.15.71:0/3044359580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0140b5ea0 0x7fe014169ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.445+0000 7fe01a5ff700 1 -- 172.21.15.71:0/3044359580 >> 172.21.15.71:0/3044359580 conn(0x7fe014099a20 msgr2=0x7fe01409b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:09.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.445+0000 7fe01a5ff700 1 -- 172.21.15.71:0/3044359580 shutdown_connections 2023-10-09T06:43:09.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.445+0000 7fe01a5ff700 1 -- 172.21.15.71:0/3044359580 wait complete. 2023-10-09T06:43:09.464 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:43:09.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.646+0000 7f4a57fff700 1 Processor -- start 2023-10-09T06:43:09.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.646+0000 7f4a57fff700 1 -- start start 2023-10-09T06:43:09.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.648+0000 7f4a57fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4a58150180 0x7f4a58157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:09.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.648+0000 7f4a57fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4a58150550 0x7f4a580c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:09.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.648+0000 7f4a57fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a580c7240 0x7f4a5806e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:09.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.648+0000 7f4a57fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a580c76a0 con 0x7f4a58150550 2023-10-09T06:43:09.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.648+0000 7f4a57fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a5806e2a0 con 0x7f4a58150180 2023-10-09T06:43:09.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.648+0000 7f4a57fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5806b2e0 con 0x7f4a580c7240 2023-10-09T06:43:09.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.648+0000 7f4a567fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4a58150550 0x7f4a580c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:09.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.648+0000 7f4a567fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4a58150550 0x7f4a580c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40462/0 (socket says 172.21.15.71:40462) 2023-10-09T06:43:09.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.648+0000 7f4a567fc700 1 -- 172.21.15.71:0/936378970 learned_addr learned my addr 172.21.15.71:0/936378970 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:09.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.648+0000 7f4a577fe700 1 --2- 172.21.15.71:0/936378970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a580c7240 0x7f4a5806e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:09.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.648+0000 7f4a567fc700 1 -- 172.21.15.71:0/936378970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a580c7240 msgr2=0x7f4a5806e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:09.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.648+0000 7f4a56ffd700 1 --2- 172.21.15.71:0/936378970 >> v2:172.21.15.179:3300/0 conn(0x7f4a58150180 0x7f4a58157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:09.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.648+0000 7f4a567fc700 1 --2- 172.21.15.71:0/936378970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a580c7240 0x7f4a5806e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.648+0000 7f4a567fc700 1 -- 172.21.15.71:0/936378970 >> v2:172.21.15.179:3300/0 conn(0x7f4a58150180 msgr2=0x7f4a58157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:09.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.648+0000 7f4a567fc700 1 --2- 172.21.15.71:0/936378970 >> v2:172.21.15.179:3300/0 conn(0x7f4a58150180 0x7f4a58157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.648+0000 7f4a567fc700 1 -- 172.21.15.71:0/936378970 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a580c78e0 con 0x7f4a58150550 2023-10-09T06:43:09.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.648+0000 7f4a577fe700 1 --2- 172.21.15.71:0/936378970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a580c7240 0x7f4a5806e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:09.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.648+0000 7f4a56ffd700 1 --2- 172.21.15.71:0/936378970 >> v2:172.21.15.179:3300/0 conn(0x7f4a58150180 0x7f4a58157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:09.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.649+0000 7f4a567fc700 1 --2- 172.21.15.71:0/936378970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a58150550 0x7f4a580c6d00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4a5806fd20 tx=0x7f4a4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acec5babef3e4249 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:09.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.649+0000 7f4a55ffb700 1 -- 172.21.15.71:0/936378970 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c00b820 con 0x7f4a58150550 2023-10-09T06:43:09.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.649+0000 7f4a55ffb700 1 -- 172.21.15.71:0/936378970 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4c00b980 con 0x7f4a58150550 2023-10-09T06:43:09.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.649+0000 7f4a55ffb700 1 -- 172.21.15.71:0/936378970 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c00bd20 con 0x7f4a58150550 2023-10-09T06:43:09.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.649+0000 7f4a57fff700 1 -- 172.21.15.71:0/936378970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a58150550 msgr2=0x7f4a580c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:09.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.649+0000 7f4a57fff700 1 --2- 172.21.15.71:0/936378970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a58150550 0x7f4a580c6d00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4a5806fd20 tx=0x7f4a4c009250 comp rx=0 tx=0).stop 2023-10-09T06:43:09.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.650+0000 7f4a57fff700 1 -- 172.21.15.71:0/936378970 shutdown_connections 2023-10-09T06:43:09.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.650+0000 7f4a57fff700 1 --2- 172.21.15.71:0/936378970 >> v2:172.21.15.179:3300/0 conn(0x7f4a58150180 0x7f4a58157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.650+0000 7f4a57fff700 1 --2- 172.21.15.71:0/936378970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a580c7240 0x7f4a5806e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.650+0000 7f4a57fff700 1 --2- 172.21.15.71:0/936378970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a58150550 0x7f4a580c6d00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.650+0000 7f4a57fff700 1 -- 172.21.15.71:0/936378970 >> 172.21.15.71:0/936378970 conn(0x7f4a580cc1f0 msgr2=0x7f4a580cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:09.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.650+0000 7f4a57fff700 1 -- 172.21.15.71:0/936378970 shutdown_connections 2023-10-09T06:43:09.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.650+0000 7f4a57fff700 1 -- 172.21.15.71:0/936378970 wait complete. 2023-10-09T06:43:09.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.651+0000 7f4a57fff700 1 Processor -- start 2023-10-09T06:43:09.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.651+0000 7f4a57fff700 1 -- start start 2023-10-09T06:43:09.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.652+0000 7f4a57fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a580c7240 0x7f4a580aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:09.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.652+0000 7f4a57fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a58150180 0x7f4a580ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:09.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.652+0000 7f4a57fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a58150550 0x7f4a580abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:09.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.652+0000 7f4a57fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a580ae780 con 0x7f4a58150180 2023-10-09T06:43:09.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.652+0000 7f4a57fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a580c4110 con 0x7f4a58150550 2023-10-09T06:43:09.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.652+0000 7f4a57fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a580c4f70 con 0x7f4a580c7240 2023-10-09T06:43:09.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.652+0000 7f4a567fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a58150180 0x7f4a580ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:09.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.652+0000 7f4a567fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a58150180 0x7f4a580ac6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40468/0 (socket says 172.21.15.71:40468) 2023-10-09T06:43:09.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.652+0000 7f4a567fc700 1 -- 172.21.15.71:0/3891868965 learned_addr learned my addr 172.21.15.71:0/3891868965 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:09.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.652+0000 7f4a577fe700 1 --2- 172.21.15.71:0/3891868965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a58150550 0x7f4a580abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:09.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.652+0000 7f4a56ffd700 1 --2- 172.21.15.71:0/3891868965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a580c7240 0x7f4a580aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:09.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.653+0000 7f4a567fc700 1 -- 172.21.15.71:0/3891868965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a580c7240 msgr2=0x7f4a580aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:09.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.653+0000 7f4a567fc700 1 --2- 172.21.15.71:0/3891868965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a580c7240 0x7f4a580aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.653+0000 7f4a567fc700 1 -- 172.21.15.71:0/3891868965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a58150550 msgr2=0x7f4a580abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:09.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.653+0000 7f4a567fc700 1 --2- 172.21.15.71:0/3891868965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a58150550 0x7f4a580abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.653+0000 7f4a567fc700 1 -- 172.21.15.71:0/3891868965 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c0094f0 con 0x7f4a58150180 2023-10-09T06:43:09.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.653+0000 7f4a577fe700 1 --2- 172.21.15.71:0/3891868965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a58150550 0x7f4a580abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:09.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.653+0000 7f4a567fc700 1 --2- 172.21.15.71:0/3891868965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a58150180 0x7f4a580ac6b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c0094c0 tx=0x7f4a4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:09.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.653+0000 7f4a3effd700 1 -- 172.21.15.71:0/3891868965 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c01a420 con 0x7f4a58150180 2023-10-09T06:43:09.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.653+0000 7f4a3effd700 1 -- 172.21.15.71:0/3891868965 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4c01a580 con 0x7f4a58150180 2023-10-09T06:43:09.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.653+0000 7f4a57fff700 1 -- 172.21.15.71:0/3891868965 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a580c4360 con 0x7f4a58150180 2023-10-09T06:43:09.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.653+0000 7f4a3effd700 1 -- 172.21.15.71:0/3891868965 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c01a940 con 0x7f4a58150180 2023-10-09T06:43:09.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.653+0000 7f4a57fff700 1 -- 172.21.15.71:0/3891868965 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a580c4920 con 0x7f4a58150180 2023-10-09T06:43:09.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.654+0000 7f4a57fff700 1 -- 172.21.15.71:0/3891868965 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a580c50e0 con 0x7f4a58150180 2023-10-09T06:43:09.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.655+0000 7f4a3effd700 1 -- 172.21.15.71:0/3891868965 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a4c02e450 con 0x7f4a58150180 2023-10-09T06:43:09.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.656+0000 7f4a3effd700 1 --2- 172.21.15.71:0/3891868965 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4a44066f30 0x7f4a440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:09.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.656+0000 7f4a3effd700 1 -- 172.21.15.71:0/3891868965 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4a4c0860a0 con 0x7f4a58150180 2023-10-09T06:43:09.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.656+0000 7f4a56ffd700 1 --2- 172.21.15.71:0/3891868965 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4a44066f30 0x7f4a440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:09.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.657+0000 7f4a56ffd700 1 --2- 172.21.15.71:0/3891868965 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4a44066f30 0x7f4a440693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800ac00 tx=0x7f4a48006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:09.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.660+0000 7f4a3effd700 1 -- 172.21.15.71:0/3891868965 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a4c053270 con 0x7f4a58150180 2023-10-09T06:43:09.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.851+0000 7f4a57fff700 1 -- 172.21.15.71:0/3891868965 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a5804c3c0 con 0x7f4a58150180 2023-10-09T06:43:09.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.852+0000 7f4a3effd700 1 -- 172.21.15.71:0/3891868965 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f4a4c056890 con 0x7f4a58150180 2023-10-09T06:43:09.854 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:09.854 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":20,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:42:39.546192+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:42:35.828340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:42:37.071896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:43:09.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.855+0000 7f4a57fff700 1 -- 172.21.15.71:0/3891868965 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4a44066f30 msgr2=0x7f4a440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:09.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.855+0000 7f4a57fff700 1 --2- 172.21.15.71:0/3891868965 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4a44066f30 0x7f4a440693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800ac00 tx=0x7f4a48006f90 comp rx=0 tx=0).stop 2023-10-09T06:43:09.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.855+0000 7f4a57fff700 1 -- 172.21.15.71:0/3891868965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a58150180 msgr2=0x7f4a580ac6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:09.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.855+0000 7f4a57fff700 1 --2- 172.21.15.71:0/3891868965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a58150180 0x7f4a580ac6b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c0094c0 tx=0x7f4a4c017000 comp rx=0 tx=0).stop 2023-10-09T06:43:09.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.855+0000 7f4a57fff700 1 -- 172.21.15.71:0/3891868965 shutdown_connections 2023-10-09T06:43:09.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.855+0000 7f4a57fff700 1 --2- 172.21.15.71:0/3891868965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a58150550 0x7f4a580abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.855+0000 7f4a57fff700 1 --2- 172.21.15.71:0/3891868965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a580c7240 0x7f4a580aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.855+0000 7f4a57fff700 1 --2- 172.21.15.71:0/3891868965 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4a44066f30 0x7f4a440693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.855+0000 7f4a57fff700 1 --2- 172.21.15.71:0/3891868965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a58150180 0x7f4a580ac6b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:09.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.855+0000 7f4a57fff700 1 -- 172.21.15.71:0/3891868965 >> 172.21.15.71:0/3891868965 conn(0x7f4a580cc1f0 msgr2=0x7f4a58158720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:09.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.855+0000 7f4a57fff700 1 -- 172.21.15.71:0/3891868965 shutdown_connections 2023-10-09T06:43:09.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:09.855+0000 7f4a57fff700 1 -- 172.21.15.71:0/3891868965 wait complete. 2023-10-09T06:43:09.874 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:42:35.828340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:42:37.071896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:43:09.874 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:43:10.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.056+0000 7fac851ff700 1 Processor -- start 2023-10-09T06:43:10.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.056+0000 7fac851ff700 1 -- start start 2023-10-09T06:43:10.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.058+0000 7fac851ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fac80159c60 0x7fac8015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:10.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.058+0000 7fac851ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac8015a160 con 0x7fac8015db10 2023-10-09T06:43:10.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.058+0000 7fac851ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac800d13a0 con 0x7fac80159890 2023-10-09T06:43:10.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.058+0000 7fac851ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8015df50 con 0x7fac80159c60 2023-10-09T06:43:10.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.058+0000 7fac7f59e700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fac8015db10 0x7fac80069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47402/0 (socket says 172.21.15.71:47402) 2023-10-09T06:43:10.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.058+0000 7fac7f59e700 1 -- 172.21.15.71:0/1883500495 learned_addr learned my addr 172.21.15.71:0/1883500495 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:10.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.058+0000 7fac7e59c700 1 --2- 172.21.15.71:0/1883500495 >> v2:172.21.15.179:3300/0 conn(0x7fac80159c60 0x7fac8015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:10.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.058+0000 7fac7dd9b700 1 -- 172.21.15.71:0/1883500495 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672979041 0 0) 0x7fac8015a160 con 0x7fac8015db10 2023-10-09T06:43:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.058+0000 7fac7dd9b700 1 -- 172.21.15.71:0/1883500495 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac68003570 con 0x7fac8015db10 2023-10-09T06:43:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.058+0000 7fac7dd9b700 1 -- 172.21.15.71:0/1883500495 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1856741202 0 0) 0x7fac800d13a0 con 0x7fac80159890 2023-10-09T06:43:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.058+0000 7fac7dd9b700 1 -- 172.21.15.71:0/1883500495 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac8015a160 con 0x7fac80159890 2023-10-09T06:43:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.058+0000 7fac7e59c700 1 -- 172.21.15.71:0/1883500495 >> v1:172.21.15.179:6789/0 conn(0x7fac80159890 legacy=0x7fac8015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.058+0000 7fac7dd9b700 1 -- 172.21.15.71:0/1883500495 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3343375914 0 0) 0x7fac68003570 con 0x7fac8015db10 2023-10-09T06:43:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.058+0000 7fac7e59c700 1 -- 172.21.15.71:0/1883500495 >> v1:172.21.15.71:6789/0 conn(0x7fac8015db10 legacy=0x7fac80069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.058+0000 7fac7e59c700 1 -- 172.21.15.71:0/1883500495 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8015e140 con 0x7fac80159c60 2023-10-09T06:43:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.059+0000 7fac7e59c700 1 --2- 172.21.15.71:0/1883500495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac80159c60 0x7fac8015d5d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fac740098e0 tx=0x7fac740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4581edb59433e4dc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.059+0000 7fac7dd9b700 1 -- 172.21.15.71:0/1883500495 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac780017f0 con 0x7fac80159c60 2023-10-09T06:43:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.059+0000 7fac7dd9b700 1 -- 172.21.15.71:0/1883500495 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac74011420 con 0x7fac80159c60 2023-10-09T06:43:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.059+0000 7fac7dd9b700 1 -- 172.21.15.71:0/1883500495 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac740117c0 con 0x7fac80159c60 2023-10-09T06:43:10.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.059+0000 7fac851ff700 1 -- 172.21.15.71:0/1883500495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac80159c60 msgr2=0x7fac8015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:10.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.059+0000 7fac851ff700 1 --2- 172.21.15.71:0/1883500495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac80159c60 0x7fac8015d5d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fac740098e0 tx=0x7fac740091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:10.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.060+0000 7fac851ff700 1 -- 172.21.15.71:0/1883500495 shutdown_connections 2023-10-09T06:43:10.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.060+0000 7fac851ff700 1 --2- 172.21.15.71:0/1883500495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac80159c60 0x7fac8015d5d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:10.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.060+0000 7fac851ff700 1 -- 172.21.15.71:0/1883500495 >> 172.21.15.71:0/1883500495 conn(0x7fac80068e20 msgr2=0x7fac800d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:10.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.060+0000 7fac851ff700 1 -- 172.21.15.71:0/1883500495 shutdown_connections 2023-10-09T06:43:10.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.060+0000 7fac851ff700 1 -- 172.21.15.71:0/1883500495 wait complete. 2023-10-09T06:43:10.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.061+0000 7fac851ff700 1 Processor -- start 2023-10-09T06:43:10.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.061+0000 7fac851ff700 1 -- start start 2023-10-09T06:43:10.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.062+0000 7fac851ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac80159890 0x7fac800b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:10.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.062+0000 7fac851ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac80159c60 0x7fac800cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:10.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.062+0000 7fac851ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac8015db10 0x7fac80144250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:10.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.062+0000 7fac851ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac800b3bf0 con 0x7fac80159c60 2023-10-09T06:43:10.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.062+0000 7fac851ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8016de70 con 0x7fac80159890 2023-10-09T06:43:10.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.062+0000 7fac851ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac80144790 con 0x7fac8015db10 2023-10-09T06:43:10.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.062+0000 7fac7e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac80159c60 0x7fac800cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:10.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.062+0000 7fac7e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac80159c60 0x7fac800cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40472/0 (socket says 172.21.15.71:40472) 2023-10-09T06:43:10.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.062+0000 7fac7e59c700 1 -- 172.21.15.71:0/3962853876 learned_addr learned my addr 172.21.15.71:0/3962853876 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:10.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.063+0000 7fac7ed9d700 1 --2- 172.21.15.71:0/3962853876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac80159890 0x7fac800b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:10.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.063+0000 7fac7f59e700 1 --2- 172.21.15.71:0/3962853876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac8015db10 0x7fac80144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:10.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.063+0000 7fac7e59c700 1 -- 172.21.15.71:0/3962853876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac8015db10 msgr2=0x7fac80144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:10.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.063+0000 7fac7e59c700 1 --2- 172.21.15.71:0/3962853876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac8015db10 0x7fac80144250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:10.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.063+0000 7fac7e59c700 1 -- 172.21.15.71:0/3962853876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac80159890 msgr2=0x7fac800b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:10.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.063+0000 7fac7e59c700 1 --2- 172.21.15.71:0/3962853876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac80159890 0x7fac800b2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:10.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.063+0000 7fac7e59c700 1 -- 172.21.15.71:0/3962853876 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac74009420 con 0x7fac80159c60 2023-10-09T06:43:10.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.063+0000 7fac7e59c700 1 --2- 172.21.15.71:0/3962853876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac80159c60 0x7fac800cefc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fac80070e20 tx=0x7fac74016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:10.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.063+0000 7fac66ffd700 1 -- 172.21.15.71:0/3962853876 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7401cc90 con 0x7fac80159c60 2023-10-09T06:43:10.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.063+0000 7fac66ffd700 1 -- 172.21.15.71:0/3962853876 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7401cdf0 con 0x7fac80159c60 2023-10-09T06:43:10.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.063+0000 7fac851ff700 1 -- 172.21.15.71:0/3962853876 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac800b5010 con 0x7fac80159c60 2023-10-09T06:43:10.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.063+0000 7fac66ffd700 1 -- 172.21.15.71:0/3962853876 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7401a6a0 con 0x7fac80159c60 2023-10-09T06:43:10.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.063+0000 7fac851ff700 1 -- 172.21.15.71:0/3962853876 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac800b3630 con 0x7fac80159c60 2023-10-09T06:43:10.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.064+0000 7fac851ff700 1 -- 172.21.15.71:0/3962853876 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac800b51f0 con 0x7fac80159c60 2023-10-09T06:43:10.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.066+0000 7fac66ffd700 1 -- 172.21.15.71:0/3962853876 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac7401aa50 con 0x7fac80159c60 2023-10-09T06:43:10.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.066+0000 7fac66ffd700 1 --2- 172.21.15.71:0/3962853876 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fac6c066f30 0x7fac6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:10.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.066+0000 7fac66ffd700 1 -- 172.21.15.71:0/3962853876 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fac74085f80 con 0x7fac80159c60 2023-10-09T06:43:10.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.067+0000 7fac7ed9d700 1 --2- 172.21.15.71:0/3962853876 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fac6c066f30 0x7fac6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:10.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.067+0000 7fac7ed9d700 1 --2- 172.21.15.71:0/3962853876 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fac6c066f30 0x7fac6c0693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fac70003870 tx=0x7fac70009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:10.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.070+0000 7fac66ffd700 1 -- 172.21.15.71:0/3962853876 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac740b75a0 con 0x7fac80159c60 2023-10-09T06:43:10.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.259+0000 7fac851ff700 1 -- 172.21.15.71:0/3962853876 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac8004c3c0 con 0x7fac80159c60 2023-10-09T06:43:10.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.260+0000 7fac66ffd700 1 -- 172.21.15.71:0/3962853876 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac740531f0 con 0x7fac80159c60 2023-10-09T06:43:10.261 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T06:43:10.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.262+0000 7fac851ff700 1 -- 172.21.15.71:0/3962853876 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fac6c066f30 msgr2=0x7fac6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:10.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.262+0000 7fac851ff700 1 --2- 172.21.15.71:0/3962853876 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fac6c066f30 0x7fac6c0693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fac70003870 tx=0x7fac70009040 comp rx=0 tx=0).stop 2023-10-09T06:43:10.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.262+0000 7fac851ff700 1 -- 172.21.15.71:0/3962853876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac80159c60 msgr2=0x7fac800cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:10.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.262+0000 7fac851ff700 1 --2- 172.21.15.71:0/3962853876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac80159c60 0x7fac800cefc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fac80070e20 tx=0x7fac74016000 comp rx=0 tx=0).stop 2023-10-09T06:43:10.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.262+0000 7fac851ff700 1 -- 172.21.15.71:0/3962853876 shutdown_connections 2023-10-09T06:43:10.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.262+0000 7fac851ff700 1 --2- 172.21.15.71:0/3962853876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac8015db10 0x7fac80144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:10.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.262+0000 7fac851ff700 1 --2- 172.21.15.71:0/3962853876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac80159890 0x7fac800b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:10.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.262+0000 7fac851ff700 1 --2- 172.21.15.71:0/3962853876 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fac6c066f30 0x7fac6c0693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:10.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.262+0000 7fac851ff700 1 --2- 172.21.15.71:0/3962853876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac80159c60 0x7fac800cefc0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:10.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.262+0000 7fac851ff700 1 -- 172.21.15.71:0/3962853876 >> 172.21.15.71:0/3962853876 conn(0x7fac80068e20 msgr2=0x7fac80153490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:10.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.262+0000 7fac851ff700 1 -- 172.21.15.71:0/3962853876 shutdown_connections 2023-10-09T06:43:10.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.262+0000 7fac851ff700 1 -- 172.21.15.71:0/3962853876 wait complete. 2023-10-09T06:43:10.280 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:43:10.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.462+0000 7f0a9adff700 1 Processor -- start 2023-10-09T06:43:10.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.462+0000 7f0a9adff700 1 -- start start 2023-10-09T06:43:10.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.463+0000 7f0a9adff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0a940ccee0 0x7f0a941561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:10.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.463+0000 7f0a9adff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9415b0d0 con 0x7f0a940c87c0 2023-10-09T06:43:10.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.463+0000 7f0a9adff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9415a4c0 con 0x7f0a940c83f0 2023-10-09T06:43:10.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.463+0000 7f0a9adff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9415a7a0 con 0x7f0a940ccee0 2023-10-09T06:43:10.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.464+0000 7f0a9939c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f0a940c87c0 0x7f0a940ca1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47412/0 (socket says 172.21.15.71:47412) 2023-10-09T06:43:10.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.464+0000 7f0a9939c700 1 -- 172.21.15.71:0/2144425978 learned_addr learned my addr 172.21.15.71:0/2144425978 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:10.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.464+0000 7f0a93fff700 1 --2- 172.21.15.71:0/2144425978 >> v2:172.21.15.179:3300/0 conn(0x7f0a940ccee0 0x7f0a941561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:10.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.464+0000 7f0a937fe700 1 -- 172.21.15.71:0/2144425978 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240872963 0 0) 0x7f0a9415b0d0 con 0x7f0a940c87c0 2023-10-09T06:43:10.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.464+0000 7f0a937fe700 1 -- 172.21.15.71:0/2144425978 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a84003570 con 0x7f0a940c87c0 2023-10-09T06:43:10.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.464+0000 7f0a937fe700 1 -- 172.21.15.71:0/2144425978 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2915258946 0 0) 0x7f0a9415a4c0 con 0x7f0a940c83f0 2023-10-09T06:43:10.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.464+0000 7f0a937fe700 1 -- 172.21.15.71:0/2144425978 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a9415b0d0 con 0x7f0a940c83f0 2023-10-09T06:43:10.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.464+0000 7f0a937fe700 1 -- 172.21.15.71:0/2144425978 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1506530705 0 0) 0x7f0a84003570 con 0x7f0a940c87c0 2023-10-09T06:43:10.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.464+0000 7f0a93fff700 1 -- 172.21.15.71:0/2144425978 >> v1:172.21.15.179:6789/0 conn(0x7f0a940c83f0 legacy=0x7f0a940c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:10.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.464+0000 7f0a93fff700 1 -- 172.21.15.71:0/2144425978 >> v1:172.21.15.71:6789/0 conn(0x7f0a940c87c0 legacy=0x7f0a940ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:10.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.464+0000 7f0a93fff700 1 -- 172.21.15.71:0/2144425978 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9415aa80 con 0x7f0a940ccee0 2023-10-09T06:43:10.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.465+0000 7f0a93fff700 1 --2- 172.21.15.71:0/2144425978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a940ccee0 0x7f0a941561d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0a800098e0 tx=0x7f0a800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fad745a0aae6438 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:10.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.465+0000 7f0a937fe700 1 -- 172.21.15.71:0/2144425978 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c0017f0 con 0x7f0a940ccee0 2023-10-09T06:43:10.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.465+0000 7f0a937fe700 1 -- 172.21.15.71:0/2144425978 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a80011420 con 0x7f0a940ccee0 2023-10-09T06:43:10.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.465+0000 7f0a937fe700 1 -- 172.21.15.71:0/2144425978 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a800117c0 con 0x7f0a940ccee0 2023-10-09T06:43:10.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.466+0000 7f0a9adff700 1 -- 172.21.15.71:0/2144425978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a940ccee0 msgr2=0x7f0a941561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:10.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.466+0000 7f0a9adff700 1 --2- 172.21.15.71:0/2144425978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a940ccee0 0x7f0a941561d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0a800098e0 tx=0x7f0a800091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:10.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.466+0000 7f0a9adff700 1 -- 172.21.15.71:0/2144425978 shutdown_connections 2023-10-09T06:43:10.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.466+0000 7f0a9adff700 1 --2- 172.21.15.71:0/2144425978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a940ccee0 0x7f0a941561d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:10.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.466+0000 7f0a9adff700 1 -- 172.21.15.71:0/2144425978 >> 172.21.15.71:0/2144425978 conn(0x7f0a94068e10 msgr2=0x7f0a940cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:10.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.466+0000 7f0a9adff700 1 -- 172.21.15.71:0/2144425978 shutdown_connections 2023-10-09T06:43:10.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.466+0000 7f0a9adff700 1 -- 172.21.15.71:0/2144425978 wait complete. 2023-10-09T06:43:10.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.467+0000 7f0a9adff700 1 Processor -- start 2023-10-09T06:43:10.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.467+0000 7f0a9adff700 1 -- start start 2023-10-09T06:43:10.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.468+0000 7f0a9adff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a940c83f0 0x7f0a9416a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:10.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.468+0000 7f0a9adff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a940c87c0 0x7f0a940c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:10.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.468+0000 7f0a9adff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a940ccee0 0x7f0a94152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:10.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.468+0000 7f0a9adff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a94155270 con 0x7f0a940ccee0 2023-10-09T06:43:10.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.468+0000 7f0a9adff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9416ae90 con 0x7f0a940c87c0 2023-10-09T06:43:10.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.468+0000 7f0a9adff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a94154380 con 0x7f0a940c83f0 2023-10-09T06:43:10.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.469+0000 7f0a9939c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a940ccee0 0x7f0a94152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:10.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.469+0000 7f0a9939c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a940ccee0 0x7f0a94152e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40488/0 (socket says 172.21.15.71:40488) 2023-10-09T06:43:10.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.469+0000 7f0a9939c700 1 -- 172.21.15.71:0/3165468247 learned_addr learned my addr 172.21.15.71:0/3165468247 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:10.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.469+0000 7f0a98b9b700 1 --2- 172.21.15.71:0/3165468247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a940c83f0 0x7f0a9416a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:10.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.469+0000 7f0a93fff700 1 --2- 172.21.15.71:0/3165468247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a940c87c0 0x7f0a940c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:10.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.469+0000 7f0a9939c700 1 -- 172.21.15.71:0/3165468247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a940c83f0 msgr2=0x7f0a9416a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:10.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.469+0000 7f0a9939c700 1 --2- 172.21.15.71:0/3165468247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a940c83f0 0x7f0a9416a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:10.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.469+0000 7f0a9939c700 1 -- 172.21.15.71:0/3165468247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a940c87c0 msgr2=0x7f0a940c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:10.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.469+0000 7f0a9939c700 1 --2- 172.21.15.71:0/3165468247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a940c87c0 0x7f0a940c4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:10.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.469+0000 7f0a9939c700 1 -- 172.21.15.71:0/3165468247 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a80009420 con 0x7f0a940ccee0 2023-10-09T06:43:10.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.469+0000 7f0a9939c700 1 --2- 172.21.15.71:0/3165468247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a940ccee0 0x7f0a94152e80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00cc80 tx=0x7f0a8c007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:10.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.469+0000 7f0a90ff9700 1 -- 172.21.15.71:0/3165468247 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c00ce30 con 0x7f0a940ccee0 2023-10-09T06:43:10.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.470+0000 7f0a90ff9700 1 -- 172.21.15.71:0/3165468247 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8c004dc0 con 0x7f0a940ccee0 2023-10-09T06:43:10.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.470+0000 7f0a9adff700 1 -- 172.21.15.71:0/3165468247 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a94154660 con 0x7f0a940ccee0 2023-10-09T06:43:10.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.470+0000 7f0a90ff9700 1 -- 172.21.15.71:0/3165468247 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c00ab70 con 0x7f0a940ccee0 2023-10-09T06:43:10.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.470+0000 7f0a9adff700 1 -- 172.21.15.71:0/3165468247 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a94154c20 con 0x7f0a940ccee0 2023-10-09T06:43:10.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.471+0000 7f0a9adff700 1 -- 172.21.15.71:0/3165468247 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a941553e0 con 0x7f0a940ccee0 2023-10-09T06:43:10.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.471+0000 7f0a90ff9700 1 -- 172.21.15.71:0/3165468247 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a8c007150 con 0x7f0a940ccee0 2023-10-09T06:43:10.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.472+0000 7f0a90ff9700 1 --2- 172.21.15.71:0/3165468247 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0a78066f30 0x7f0a780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:10.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.472+0000 7f0a90ff9700 1 -- 172.21.15.71:0/3165468247 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a8c084130 con 0x7f0a940ccee0 2023-10-09T06:43:10.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.473+0000 7f0a98b9b700 1 --2- 172.21.15.71:0/3165468247 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0a78066f30 0x7f0a780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:10.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.473+0000 7f0a98b9b700 1 --2- 172.21.15.71:0/3165468247 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0a78066f30 0x7f0a780693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0a880037e0 tx=0x7f0a88009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:10.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.477+0000 7f0a90ff9700 1 -- 172.21.15.71:0/3165468247 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a8c051380 con 0x7f0a940ccee0 2023-10-09T06:43:10.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.674+0000 7f0a9adff700 1 -- 172.21.15.71:0/3165468247 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a9404c3c0 con 0x7f0a940ccee0 2023-10-09T06:43:10.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.674+0000 7f0a90ff9700 1 -- 172.21.15.71:0/3165468247 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0a8c0549a0 con 0x7f0a940ccee0 2023-10-09T06:43:10.675 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-09T06:43:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.677+0000 7f0a9adff700 1 -- 172.21.15.71:0/3165468247 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0a78066f30 msgr2=0x7f0a780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.677+0000 7f0a9adff700 1 --2- 172.21.15.71:0/3165468247 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0a78066f30 0x7f0a780693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0a880037e0 tx=0x7f0a88009040 comp rx=0 tx=0).stop 2023-10-09T06:43:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.677+0000 7f0a9adff700 1 -- 172.21.15.71:0/3165468247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a940ccee0 msgr2=0x7f0a94152e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.677+0000 7f0a9adff700 1 --2- 172.21.15.71:0/3165468247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a940ccee0 0x7f0a94152e80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00cc80 tx=0x7f0a8c007d20 comp rx=0 tx=0).stop 2023-10-09T06:43:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.677+0000 7f0a9adff700 1 -- 172.21.15.71:0/3165468247 shutdown_connections 2023-10-09T06:43:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.677+0000 7f0a9adff700 1 --2- 172.21.15.71:0/3165468247 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0a78066f30 0x7f0a780693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.677+0000 7f0a9adff700 1 --2- 172.21.15.71:0/3165468247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a940ccee0 0x7f0a94152e80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:10.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.677+0000 7f0a9adff700 1 --2- 172.21.15.71:0/3165468247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a940c83f0 0x7f0a9416a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:10.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.677+0000 7f0a9adff700 1 --2- 172.21.15.71:0/3165468247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a940c87c0 0x7f0a940c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:10.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.677+0000 7f0a9adff700 1 -- 172.21.15.71:0/3165468247 >> 172.21.15.71:0/3165468247 conn(0x7f0a94068e10 msgr2=0x7f0a940c2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:10.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.677+0000 7f0a9adff700 1 -- 172.21.15.71:0/3165468247 shutdown_connections 2023-10-09T06:43:10.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.677+0000 7f0a9adff700 1 -- 172.21.15.71:0/3165468247 wait complete. 2023-10-09T06:43:10.695 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:43:10.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.879+0000 7f7929bff700 1 Processor -- start 2023-10-09T06:43:10.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.879+0000 7f7929bff700 1 -- start start 2023-10-09T06:43:10.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.879+0000 7f7929bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7924159890 0x7f792415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:10.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.879+0000 7f7929bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7924159c60 0x7f792415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:10.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.879+0000 7f7929bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f792415a160 con 0x7f792415db10 2023-10-09T06:43:10.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.879+0000 7f7929bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792415df50 con 0x7f7924159890 2023-10-09T06:43:10.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.879+0000 7f7929bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79240d13a0 con 0x7f7924159c60 2023-10-09T06:43:10.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.879+0000 7f79237fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7924159890 0x7f792415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:10.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.880+0000 7f7923fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f792415db10 0x7f7924069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47428/0 (socket says 172.21.15.71:47428) 2023-10-09T06:43:10.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.880+0000 7f7923fff700 1 -- 172.21.15.71:0/2341795221 learned_addr learned my addr 172.21.15.71:0/2341795221 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:10.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.880+0000 7f7922ffd700 1 --2- 172.21.15.71:0/2341795221 >> v2:172.21.15.179:3300/0 conn(0x7f7924159c60 0x7f792415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:10.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.880+0000 7f79237fe700 1 -- 172.21.15.71:0/2341795221 >> v2:172.21.15.179:3300/0 conn(0x7f7924159c60 msgr2=0x7f792415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:10.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.880+0000 7f79237fe700 1 --2- 172.21.15.71:0/2341795221 >> v2:172.21.15.179:3300/0 conn(0x7f7924159c60 0x7f792415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:10.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.880+0000 7f79237fe700 1 -- 172.21.15.71:0/2341795221 >> v1:172.21.15.71:6789/0 conn(0x7f792415db10 legacy=0x7f7924069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:10.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.880+0000 7f79227fc700 1 -- 172.21.15.71:0/2341795221 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272722153 0 0) 0x7f792415a160 con 0x7f792415db10 2023-10-09T06:43:10.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.880+0000 7f79237fe700 1 -- 172.21.15.71:0/2341795221 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792415e140 con 0x7f7924159890 2023-10-09T06:43:10.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.880+0000 7f79237fe700 1 --2- 172.21.15.71:0/2341795221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7924159890 0x7f792415abd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f79240b67f0 tx=0x7f79140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455b87c062edcb3d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:10.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.880+0000 7f79227fc700 1 -- 172.21.15.71:0/2341795221 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791400b6b0 con 0x7f7924159890 2023-10-09T06:43:10.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.881+0000 7f79227fc700 1 -- 172.21.15.71:0/2341795221 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791400b810 con 0x7f7924159890 2023-10-09T06:43:10.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.881+0000 7f79227fc700 1 -- 172.21.15.71:0/2341795221 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791400bbb0 con 0x7f7924159890 2023-10-09T06:43:10.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.881+0000 7f7929bff700 1 -- 172.21.15.71:0/2341795221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7924159890 msgr2=0x7f792415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:10.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.881+0000 7f7929bff700 1 --2- 172.21.15.71:0/2341795221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7924159890 0x7f792415abd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f79240b67f0 tx=0x7f79140091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:10.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.881+0000 7f7929bff700 1 -- 172.21.15.71:0/2341795221 shutdown_connections 2023-10-09T06:43:10.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.881+0000 7f7929bff700 1 --2- 172.21.15.71:0/2341795221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7924159890 0x7f792415abd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:10.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.881+0000 7f7929bff700 1 --2- 172.21.15.71:0/2341795221 >> v2:172.21.15.179:3300/0 conn(0x7f7924159c60 0x7f792415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:10.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.881+0000 7f7929bff700 1 -- 172.21.15.71:0/2341795221 >> 172.21.15.71:0/2341795221 conn(0x7f7924068e20 msgr2=0x7f79240d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:10.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.881+0000 7f7929bff700 1 -- 172.21.15.71:0/2341795221 shutdown_connections 2023-10-09T06:43:10.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.881+0000 7f7929bff700 1 -- 172.21.15.71:0/2341795221 wait complete. 2023-10-09T06:43:10.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.883+0000 7f7929bff700 1 Processor -- start 2023-10-09T06:43:10.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.883+0000 7f7929bff700 1 -- start start 2023-10-09T06:43:10.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.884+0000 7f7929bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7924159890 0x7f79241491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:10.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.884+0000 7f7929bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7924159c60 0x7f79240b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:10.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.884+0000 7f7929bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f792415db10 0x7f79240b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:10.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.884+0000 7f7929bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79240cf810 con 0x7f7924159890 2023-10-09T06:43:10.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.884+0000 7f7929bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79240b4580 con 0x7f7924159c60 2023-10-09T06:43:10.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.884+0000 7f7929bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79240b5780 con 0x7f792415db10 2023-10-09T06:43:10.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.884+0000 7f79237fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7924159890 0x7f79241491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:10.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.884+0000 7f79237fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7924159890 0x7f79241491a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40496/0 (socket says 172.21.15.71:40496) 2023-10-09T06:43:10.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.884+0000 7f79237fe700 1 -- 172.21.15.71:0/2553909511 learned_addr learned my addr 172.21.15.71:0/2553909511 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:10.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.884+0000 7f7922ffd700 1 --2- 172.21.15.71:0/2553909511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7924159c60 0x7f79240b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:10.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.884+0000 7f7923fff700 1 --2- 172.21.15.71:0/2553909511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f792415db10 0x7f79240b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:10.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.884+0000 7f79237fe700 1 -- 172.21.15.71:0/2553909511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f792415db10 msgr2=0x7f79240b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:10.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.884+0000 7f79237fe700 1 --2- 172.21.15.71:0/2553909511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f792415db10 0x7f79240b5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:10.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.884+0000 7f79237fe700 1 -- 172.21.15.71:0/2553909511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7924159c60 msgr2=0x7f79240b4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:10.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.884+0000 7f79237fe700 1 --2- 172.21.15.71:0/2553909511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7924159c60 0x7f79240b4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:10.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.884+0000 7f79237fe700 1 -- 172.21.15.71:0/2553909511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7914009420 con 0x7f7924159890 2023-10-09T06:43:10.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.884+0000 7f7922ffd700 1 --2- 172.21.15.71:0/2553909511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7924159c60 0x7f79240b4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:10.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.884+0000 7f7923fff700 1 --2- 172.21.15.71:0/2553909511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f792415db10 0x7f79240b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:10.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.885+0000 7f79237fe700 1 --2- 172.21.15.71:0/2553909511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7924159890 0x7f79241491a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7924070e20 tx=0x7f7914017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:10.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.885+0000 7f790b7fe700 1 -- 172.21.15.71:0/2553909511 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791400b980 con 0x7f7924159890 2023-10-09T06:43:10.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.885+0000 7f790b7fe700 1 -- 172.21.15.71:0/2553909511 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791400bb00 con 0x7f7924159890 2023-10-09T06:43:10.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.885+0000 7f7929bff700 1 -- 172.21.15.71:0/2553909511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79240ceee0 con 0x7f7924159890 2023-10-09T06:43:10.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.885+0000 7f790b7fe700 1 -- 172.21.15.71:0/2553909511 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7914025670 con 0x7f7924159890 2023-10-09T06:43:10.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.885+0000 7f7929bff700 1 -- 172.21.15.71:0/2553909511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79240cf4a0 con 0x7f7924159890 2023-10-09T06:43:10.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.886+0000 7f7929bff700 1 -- 172.21.15.71:0/2553909511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f792404c3c0 con 0x7f7924159890 2023-10-09T06:43:10.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.887+0000 7f790b7fe700 1 -- 172.21.15.71:0/2553909511 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7914023070 con 0x7f7924159890 2023-10-09T06:43:10.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.888+0000 7f790b7fe700 1 --2- 172.21.15.71:0/2553909511 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7910066f30 0x7f79100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:10.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.888+0000 7f790b7fe700 1 -- 172.21.15.71:0/2553909511 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7914085c80 con 0x7f7924159890 2023-10-09T06:43:10.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.888+0000 7f7922ffd700 1 --2- 172.21.15.71:0/2553909511 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7910066f30 0x7f79100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:10.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.889+0000 7f7922ffd700 1 --2- 172.21.15.71:0/2553909511 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7910066f30 0x7f79100693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f79240c6b90 tx=0x7f7918008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:10.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:10.892+0000 7f790b7fe700 1 -- 172.21.15.71:0/2553909511 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7914052e50 con 0x7f7924159890 2023-10-09T06:43:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.080+0000 7f7929bff700 1 -- 172.21.15.71:0/2553909511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f792406a5b0 con 0x7f7924159890 2023-10-09T06:43:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.081+0000 7f790b7fe700 1 -- 172.21.15.71:0/2553909511 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7914056470 con 0x7f7924159890 2023-10-09T06:43:11.082 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-09T06:43:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.083+0000 7f7929bff700 1 -- 172.21.15.71:0/2553909511 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7910066f30 msgr2=0x7f79100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.083+0000 7f7929bff700 1 --2- 172.21.15.71:0/2553909511 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7910066f30 0x7f79100693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f79240c6b90 tx=0x7f7918008040 comp rx=0 tx=0).stop 2023-10-09T06:43:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.083+0000 7f7929bff700 1 -- 172.21.15.71:0/2553909511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7924159890 msgr2=0x7f79241491a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.083+0000 7f7929bff700 1 --2- 172.21.15.71:0/2553909511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7924159890 0x7f79241491a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7924070e20 tx=0x7f7914017000 comp rx=0 tx=0).stop 2023-10-09T06:43:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.083+0000 7f7929bff700 1 -- 172.21.15.71:0/2553909511 shutdown_connections 2023-10-09T06:43:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.083+0000 7f7929bff700 1 --2- 172.21.15.71:0/2553909511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f792415db10 0x7f79240b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.083+0000 7f7929bff700 1 --2- 172.21.15.71:0/2553909511 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7910066f30 0x7f79100693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.083+0000 7f7929bff700 1 --2- 172.21.15.71:0/2553909511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7924159890 0x7f79241491a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.083+0000 7f7929bff700 1 --2- 172.21.15.71:0/2553909511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7924159c60 0x7f79240b4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.083+0000 7f7929bff700 1 -- 172.21.15.71:0/2553909511 >> 172.21.15.71:0/2553909511 conn(0x7f7924068e20 msgr2=0x7f7924153070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.083+0000 7f7929bff700 1 -- 172.21.15.71:0/2553909511 shutdown_connections 2023-10-09T06:43:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.083+0000 7f7929bff700 1 -- 172.21.15.71:0/2553909511 wait complete. 2023-10-09T06:43:11.102 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:43:11.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.282+0000 7fbc05bff700 1 Processor -- start 2023-10-09T06:43:11.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.282+0000 7fbc05bff700 1 -- start start 2023-10-09T06:43:11.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.284+0000 7fbc05bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbc001578b0 0x7fbc00155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:11.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.284+0000 7fbc05bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbc000af2f0 0x7fbc000af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:11.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.284+0000 7fbc05bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc000ad930 con 0x7fbc00155c10 2023-10-09T06:43:11.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.284+0000 7fbc05bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc000b0c80 con 0x7fbc001578b0 2023-10-09T06:43:11.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.284+0000 7fbc05bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc000acd20 con 0x7fbc000af2f0 2023-10-09T06:43:11.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.284+0000 7fbbfeffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbc001578b0 0x7fbc00155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:11.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.284+0000 7fbbfeffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbc001578b0 0x7fbc00155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40506/0 (socket says 172.21.15.71:40506) 2023-10-09T06:43:11.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.284+0000 7fbbfeffd700 1 -- 172.21.15.71:0/824976652 learned_addr learned my addr 172.21.15.71:0/824976652 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:11.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.284+0000 7fbbfffff700 1 --2- 172.21.15.71:0/824976652 >> v2:172.21.15.179:3300/0 conn(0x7fbc000af2f0 0x7fbc000af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:11.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.285+0000 7fbbfeffd700 1 -- 172.21.15.71:0/824976652 >> v2:172.21.15.179:3300/0 conn(0x7fbc000af2f0 msgr2=0x7fbc000af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:11.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.285+0000 7fbbfeffd700 1 --2- 172.21.15.71:0/824976652 >> v2:172.21.15.179:3300/0 conn(0x7fbc000af2f0 0x7fbc000af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:11.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.285+0000 7fbbfeffd700 1 -- 172.21.15.71:0/824976652 >> v1:172.21.15.179:6789/0 conn(0x7fbc00155c10 legacy=0x7fbc000ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:11.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.285+0000 7fbbfeffd700 1 -- 172.21.15.71:0/824976652 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc000ad000 con 0x7fbc001578b0 2023-10-09T06:43:11.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.285+0000 7fbbfeffd700 1 --2- 172.21.15.71:0/824976652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc001578b0 0x7fbc00155fe0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbc00065be0 tx=0x7fbbf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d028dcfc94e87c7f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:11.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.285+0000 7fbbfe7fc700 1 -- 172.21.15.71:0/824976652 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4009e70 con 0x7fbc001578b0 2023-10-09T06:43:11.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.285+0000 7fbbfe7fc700 1 -- 172.21.15.71:0/824976652 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf400b860 con 0x7fbc001578b0 2023-10-09T06:43:11.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.285+0000 7fbbfe7fc700 1 -- 172.21.15.71:0/824976652 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf400bc00 con 0x7fbc001578b0 2023-10-09T06:43:11.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.286+0000 7fbc05bff700 1 -- 172.21.15.71:0/824976652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc001578b0 msgr2=0x7fbc00155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:11.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.286+0000 7fbc05bff700 1 --2- 172.21.15.71:0/824976652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc001578b0 0x7fbc00155fe0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbc00065be0 tx=0x7fbbf4009250 comp rx=0 tx=0).stop 2023-10-09T06:43:11.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.286+0000 7fbc05bff700 1 -- 172.21.15.71:0/824976652 shutdown_connections 2023-10-09T06:43:11.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.286+0000 7fbc05bff700 1 --2- 172.21.15.71:0/824976652 >> v2:172.21.15.179:3300/0 conn(0x7fbc000af2f0 0x7fbc000af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:11.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.286+0000 7fbc05bff700 1 --2- 172.21.15.71:0/824976652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc001578b0 0x7fbc00155fe0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:11.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.286+0000 7fbc05bff700 1 -- 172.21.15.71:0/824976652 >> 172.21.15.71:0/824976652 conn(0x7fbc0006a320 msgr2=0x7fbc000cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:11.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.286+0000 7fbc05bff700 1 -- 172.21.15.71:0/824976652 shutdown_connections 2023-10-09T06:43:11.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.286+0000 7fbc05bff700 1 -- 172.21.15.71:0/824976652 wait complete. 2023-10-09T06:43:11.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.287+0000 7fbc05bff700 1 Processor -- start 2023-10-09T06:43:11.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.287+0000 7fbc05bff700 1 -- start start 2023-10-09T06:43:11.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.288+0000 7fbc05bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc000af2f0 0x7fbc00145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:11.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.288+0000 7fbc05bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc00155c10 0x7fbc00142c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:11.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.288+0000 7fbc05bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc001578b0 0x7fbc000cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:11.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.288+0000 7fbc05bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc00145760 con 0x7fbc00155c10 2023-10-09T06:43:11.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.288+0000 7fbc05bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc000cd390 con 0x7fbc001578b0 2023-10-09T06:43:11.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.288+0000 7fbc05bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc00144b50 con 0x7fbc000af2f0 2023-10-09T06:43:11.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.288+0000 7fbbfeffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc00155c10 0x7fbc00142c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:11.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.288+0000 7fbbfeffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc00155c10 0x7fbc00142c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40522/0 (socket says 172.21.15.71:40522) 2023-10-09T06:43:11.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.288+0000 7fbbfeffd700 1 -- 172.21.15.71:0/3588496366 learned_addr learned my addr 172.21.15.71:0/3588496366 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:11.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.289+0000 7fbbfeffd700 1 -- 172.21.15.71:0/3588496366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc000af2f0 msgr2=0x7fbc00145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:11.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.289+0000 7fbbfeffd700 1 --2- 172.21.15.71:0/3588496366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc000af2f0 0x7fbc00145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:11.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.289+0000 7fbbfeffd700 1 -- 172.21.15.71:0/3588496366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc001578b0 msgr2=0x7fbc000cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:11.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.289+0000 7fbbfeffd700 1 --2- 172.21.15.71:0/3588496366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc001578b0 0x7fbc000cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:11.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.289+0000 7fbbfeffd700 1 -- 172.21.15.71:0/3588496366 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf40094f0 con 0x7fbc00155c10 2023-10-09T06:43:11.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.289+0000 7fbbfeffd700 1 --2- 172.21.15.71:0/3588496366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc00155c10 0x7fbc00142c40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbc00064290 tx=0x7fbbf4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:11.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.289+0000 7fbbe77fe700 1 -- 172.21.15.71:0/3588496366 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4011420 con 0x7fbc00155c10 2023-10-09T06:43:11.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.289+0000 7fbbe77fe700 1 -- 172.21.15.71:0/3588496366 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf40115a0 con 0x7fbc00155c10 2023-10-09T06:43:11.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.289+0000 7fbbe77fe700 1 -- 172.21.15.71:0/3588496366 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4011960 con 0x7fbc00155c10 2023-10-09T06:43:11.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.289+0000 7fbc05bff700 1 -- 172.21.15.71:0/3588496366 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc00144e30 con 0x7fbc00155c10 2023-10-09T06:43:11.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.289+0000 7fbc05bff700 1 -- 172.21.15.71:0/3588496366 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc001453f0 con 0x7fbc00155c10 2023-10-09T06:43:11.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.290+0000 7fbc05bff700 1 -- 172.21.15.71:0/3588496366 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc0004c3c0 con 0x7fbc00155c10 2023-10-09T06:43:11.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.291+0000 7fbbe77fe700 1 -- 172.21.15.71:0/3588496366 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbbf40253f0 con 0x7fbc00155c10 2023-10-09T06:43:11.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.292+0000 7fbbe77fe700 1 --2- 172.21.15.71:0/3588496366 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbbec066f30 0x7fbbec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:11.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.292+0000 7fbbe77fe700 1 -- 172.21.15.71:0/3588496366 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbbf4085f10 con 0x7fbc00155c10 2023-10-09T06:43:11.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.292+0000 7fbbff7fe700 1 --2- 172.21.15.71:0/3588496366 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbbec066f30 0x7fbbec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:11.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.293+0000 7fbbff7fe700 1 --2- 172.21.15.71:0/3588496366 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbbec066f30 0x7fbbec0693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0001730 tx=0x7fbbf0007b40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:11.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.296+0000 7fbbe77fe700 1 -- 172.21.15.71:0/3588496366 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbbf40530e0 con 0x7fbc00155c10 2023-10-09T06:43:11.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.486+0000 7fbc05bff700 1 -- 172.21.15.71:0/3588496366 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc000ad2e0 con 0x7fbc00155c10 2023-10-09T06:43:11.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.487+0000 7fbbe77fe700 1 -- 172.21.15.71:0/3588496366 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fbbf4056700 con 0x7fbc00155c10 2023-10-09T06:43:11.487 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:11.487 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":20,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:42:39.546192+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:42:35.828340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:42:37.071896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:43:11.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.490+0000 7fbc05bff700 1 -- 172.21.15.71:0/3588496366 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbbec066f30 msgr2=0x7fbbec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:11.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.490+0000 7fbc05bff700 1 --2- 172.21.15.71:0/3588496366 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbbec066f30 0x7fbbec0693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0001730 tx=0x7fbbf0007b40 comp rx=0 tx=0).stop 2023-10-09T06:43:11.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.490+0000 7fbc05bff700 1 -- 172.21.15.71:0/3588496366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc00155c10 msgr2=0x7fbc00142c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:11.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.490+0000 7fbc05bff700 1 --2- 172.21.15.71:0/3588496366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc00155c10 0x7fbc00142c40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbc00064290 tx=0x7fbbf4017000 comp rx=0 tx=0).stop 2023-10-09T06:43:11.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.490+0000 7fbc05bff700 1 -- 172.21.15.71:0/3588496366 shutdown_connections 2023-10-09T06:43:11.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.490+0000 7fbc05bff700 1 --2- 172.21.15.71:0/3588496366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc001578b0 0x7fbc000cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:11.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.490+0000 7fbc05bff700 1 --2- 172.21.15.71:0/3588496366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc000af2f0 0x7fbc00145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:11.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.490+0000 7fbc05bff700 1 --2- 172.21.15.71:0/3588496366 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbbec066f30 0x7fbbec0693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:11.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.490+0000 7fbc05bff700 1 --2- 172.21.15.71:0/3588496366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc00155c10 0x7fbc00142c40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:11.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.490+0000 7fbc05bff700 1 -- 172.21.15.71:0/3588496366 >> 172.21.15.71:0/3588496366 conn(0x7fbc0006a320 msgr2=0x7fbc000ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:11.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.490+0000 7fbc05bff700 1 -- 172.21.15.71:0/3588496366 shutdown_connections 2023-10-09T06:43:11.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.490+0000 7fbc05bff700 1 -- 172.21.15.71:0/3588496366 wait complete. 2023-10-09T06:43:11.507 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:42:35.828340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:42:37.071896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:43:11.508 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:43:11.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.694+0000 7efff7dff700 1 Processor -- start 2023-10-09T06:43:11.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.694+0000 7efff7dff700 1 -- start start 2023-10-09T06:43:11.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.695+0000 7efff7dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7efff00c70b0 0x7efff0155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:11.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.695+0000 7efff7dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efff00ccc40 0x7efff006e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:11.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.695+0000 7efff7dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff006eb90 con 0x7efff00cd0b0 2023-10-09T06:43:11.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.695+0000 7efff7dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff01563f0 con 0x7efff00c70b0 2023-10-09T06:43:11.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.695+0000 7efff7dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff006ee70 con 0x7efff00ccc40 2023-10-09T06:43:11.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.696+0000 7efff5b9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7efff00c70b0 0x7efff0155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:11.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.696+0000 7efff639c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7efff00cd0b0 0x7efff0069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47430/0 (socket says 172.21.15.71:47430) 2023-10-09T06:43:11.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.696+0000 7efff639c700 1 -- 172.21.15.71:0/3651348201 learned_addr learned my addr 172.21.15.71:0/3651348201 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:11.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.696+0000 7efff5b9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7efff00c70b0 0x7efff0155eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40526/0 (socket says 172.21.15.71:40526) 2023-10-09T06:43:11.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.696+0000 7efff539a700 1 --2- 172.21.15.71:0/3651348201 >> v2:172.21.15.179:3300/0 conn(0x7efff00ccc40 0x7efff006e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:11.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.696+0000 7efff5b9b700 1 -- 172.21.15.71:0/3651348201 >> v2:172.21.15.179:3300/0 conn(0x7efff00ccc40 msgr2=0x7efff006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:11.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.696+0000 7efff5b9b700 1 --2- 172.21.15.71:0/3651348201 >> v2:172.21.15.179:3300/0 conn(0x7efff00ccc40 0x7efff006e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:11.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.696+0000 7efff5b9b700 1 -- 172.21.15.71:0/3651348201 >> v1:172.21.15.71:6789/0 conn(0x7efff00cd0b0 legacy=0x7efff0069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:11.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.696+0000 7efff4b99700 1 -- 172.21.15.71:0/3651348201 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728399353 0 0) 0x7efff006eb90 con 0x7efff00cd0b0 2023-10-09T06:43:11.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.696+0000 7efff5b9b700 1 -- 172.21.15.71:0/3651348201 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff006f150 con 0x7efff00c70b0 2023-10-09T06:43:11.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.696+0000 7efff5b9b700 1 --2- 172.21.15.71:0/3651348201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efff00c70b0 0x7efff0155eb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efff0065130 tx=0x7effec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda37d935a888d08 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:11.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.697+0000 7efff4b99700 1 -- 172.21.15.71:0/3651348201 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec00b6b0 con 0x7efff00c70b0 2023-10-09T06:43:11.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.697+0000 7efff4b99700 1 -- 172.21.15.71:0/3651348201 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec00b810 con 0x7efff00c70b0 2023-10-09T06:43:11.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.697+0000 7efff4b99700 1 -- 172.21.15.71:0/3651348201 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec00bbb0 con 0x7efff00c70b0 2023-10-09T06:43:11.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.697+0000 7efff7dff700 1 -- 172.21.15.71:0/3651348201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efff00c70b0 msgr2=0x7efff0155eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:11.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.697+0000 7efff7dff700 1 --2- 172.21.15.71:0/3651348201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efff00c70b0 0x7efff0155eb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efff0065130 tx=0x7effec0091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:11.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.697+0000 7efff7dff700 1 -- 172.21.15.71:0/3651348201 shutdown_connections 2023-10-09T06:43:11.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.697+0000 7efff7dff700 1 --2- 172.21.15.71:0/3651348201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efff00c70b0 0x7efff0155eb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:11.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.697+0000 7efff7dff700 1 --2- 172.21.15.71:0/3651348201 >> v2:172.21.15.179:3300/0 conn(0x7efff00ccc40 0x7efff006e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:11.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.697+0000 7efff7dff700 1 -- 172.21.15.71:0/3651348201 >> 172.21.15.71:0/3651348201 conn(0x7efff0068e10 msgr2=0x7efff00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:11.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.697+0000 7efff7dff700 1 -- 172.21.15.71:0/3651348201 shutdown_connections 2023-10-09T06:43:11.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.697+0000 7efff7dff700 1 -- 172.21.15.71:0/3651348201 wait complete. 2023-10-09T06:43:11.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.699+0000 7efff7dff700 1 Processor -- start 2023-10-09T06:43:11.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.699+0000 7efff7dff700 1 -- start start 2023-10-09T06:43:11.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.700+0000 7efff7dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efff00c70b0 0x7efff00b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:11.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.700+0000 7efff7dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efff00ccc40 0x7efff014d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:11.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.700+0000 7efff7dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efff00cd0b0 0x7efff016d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:11.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.700+0000 7efff7dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff00af2d0 con 0x7efff00c70b0 2023-10-09T06:43:11.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.700+0000 7efff7dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff00af890 con 0x7efff00cd0b0 2023-10-09T06:43:11.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.700+0000 7efff7dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff00adda0 con 0x7efff00ccc40 2023-10-09T06:43:11.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.700+0000 7efff5b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efff00c70b0 0x7efff00b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:11.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.700+0000 7efff5b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efff00c70b0 0x7efff00b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40534/0 (socket says 172.21.15.71:40534) 2023-10-09T06:43:11.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.700+0000 7efff5b9b700 1 -- 172.21.15.71:0/2904231506 learned_addr learned my addr 172.21.15.71:0/2904231506 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:11.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.700+0000 7efff539a700 1 --2- 172.21.15.71:0/2904231506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efff00ccc40 0x7efff014d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:11.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.700+0000 7efff639c700 1 --2- 172.21.15.71:0/2904231506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efff00cd0b0 0x7efff016d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:11.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.700+0000 7efff5b9b700 1 -- 172.21.15.71:0/2904231506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efff00ccc40 msgr2=0x7efff014d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:11.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.700+0000 7efff5b9b700 1 --2- 172.21.15.71:0/2904231506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efff00ccc40 0x7efff014d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:11.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.700+0000 7efff5b9b700 1 -- 172.21.15.71:0/2904231506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efff00cd0b0 msgr2=0x7efff016d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:11.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.700+0000 7efff5b9b700 1 --2- 172.21.15.71:0/2904231506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efff00cd0b0 0x7efff016d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:11.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.700+0000 7efff5b9b700 1 -- 172.21.15.71:0/2904231506 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec009420 con 0x7efff00c70b0 2023-10-09T06:43:11.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.701+0000 7efff5b9b700 1 --2- 172.21.15.71:0/2904231506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efff00c70b0 0x7efff00b1750 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efff006fe40 tx=0x7effec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:11.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.701+0000 7effe5ffb700 1 -- 172.21.15.71:0/2904231506 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec011420 con 0x7efff00c70b0 2023-10-09T06:43:11.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.701+0000 7effe5ffb700 1 -- 172.21.15.71:0/2904231506 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec011580 con 0x7efff00c70b0 2023-10-09T06:43:11.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.701+0000 7efff7dff700 1 -- 172.21.15.71:0/2904231506 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff00ae080 con 0x7efff00c70b0 2023-10-09T06:43:11.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.701+0000 7effe5ffb700 1 -- 172.21.15.71:0/2904231506 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec011940 con 0x7efff00c70b0 2023-10-09T06:43:11.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.701+0000 7efff7dff700 1 -- 172.21.15.71:0/2904231506 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff00b1c90 con 0x7efff00c70b0 2023-10-09T06:43:11.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.702+0000 7efff7dff700 1 -- 172.21.15.71:0/2904231506 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff004c3c0 con 0x7efff00c70b0 2023-10-09T06:43:11.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.703+0000 7effe5ffb700 1 -- 172.21.15.71:0/2904231506 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7effec011d30 con 0x7efff00c70b0 2023-10-09T06:43:11.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.703+0000 7effe5ffb700 1 --2- 172.21.15.71:0/2904231506 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7effd4066f30 0x7effd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:11.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.704+0000 7effe5ffb700 1 -- 172.21.15.71:0/2904231506 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7effec085f40 con 0x7efff00c70b0 2023-10-09T06:43:11.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.704+0000 7efff539a700 1 --2- 172.21.15.71:0/2904231506 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7effd4066f30 0x7effd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:11.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.705+0000 7efff539a700 1 --2- 172.21.15.71:0/2904231506 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7effd4066f30 0x7effd40693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7effe0006fd0 tx=0x7effe0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:11.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.708+0000 7effe5ffb700 1 -- 172.21.15.71:0/2904231506 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7effec053110 con 0x7efff00c70b0 2023-10-09T06:43:11.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.895+0000 7efff7dff700 1 -- 172.21.15.71:0/2904231506 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efff00c8230 con 0x7efff00c70b0 2023-10-09T06:43:11.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.896+0000 7effe5ffb700 1 -- 172.21.15.71:0/2904231506 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7effec0150a0 con 0x7efff00c70b0 2023-10-09T06:43:11.896 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T06:43:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.898+0000 7efff7dff700 1 -- 172.21.15.71:0/2904231506 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7effd4066f30 msgr2=0x7effd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.898+0000 7efff7dff700 1 --2- 172.21.15.71:0/2904231506 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7effd4066f30 0x7effd40693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7effe0006fd0 tx=0x7effe0008040 comp rx=0 tx=0).stop 2023-10-09T06:43:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.898+0000 7efff7dff700 1 -- 172.21.15.71:0/2904231506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efff00c70b0 msgr2=0x7efff00b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.898+0000 7efff7dff700 1 --2- 172.21.15.71:0/2904231506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efff00c70b0 0x7efff00b1750 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efff006fe40 tx=0x7effec017000 comp rx=0 tx=0).stop 2023-10-09T06:43:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.898+0000 7efff7dff700 1 -- 172.21.15.71:0/2904231506 shutdown_connections 2023-10-09T06:43:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.898+0000 7efff7dff700 1 --2- 172.21.15.71:0/2904231506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efff00cd0b0 0x7efff016d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.898+0000 7efff7dff700 1 --2- 172.21.15.71:0/2904231506 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7effd4066f30 0x7effd40693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.898+0000 7efff7dff700 1 --2- 172.21.15.71:0/2904231506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efff00c70b0 0x7efff00b1750 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.898+0000 7efff7dff700 1 --2- 172.21.15.71:0/2904231506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efff00ccc40 0x7efff014d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.898+0000 7efff7dff700 1 -- 172.21.15.71:0/2904231506 >> 172.21.15.71:0/2904231506 conn(0x7efff0068e10 msgr2=0x7efff00c1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.898+0000 7efff7dff700 1 -- 172.21.15.71:0/2904231506 shutdown_connections 2023-10-09T06:43:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:11.898+0000 7efff7dff700 1 -- 172.21.15.71:0/2904231506 wait complete. 2023-10-09T06:43:11.916 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:43:12.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.100+0000 7f54e9b9d700 1 Processor -- start 2023-10-09T06:43:12.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.100+0000 7f54e9b9d700 1 -- start start 2023-10-09T06:43:12.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.101+0000 7f54e9b9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f54e40b16d0 0x7f54e40b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:12.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.101+0000 7f54e9b9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e40b2080 con 0x7f54e40b4e70 2023-10-09T06:43:12.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.101+0000 7f54e9b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e40cfb00 con 0x7f54e40b33b0 2023-10-09T06:43:12.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.101+0000 7f54e9b9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e40b5c40 con 0x7f54e40b16d0 2023-10-09T06:43:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.101+0000 7f54e8b9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f54e40b4e70 0x7f54e40ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47440/0 (socket says 172.21.15.71:47440) 2023-10-09T06:43:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.101+0000 7f54e8b9b700 1 -- 172.21.15.71:0/3825914187 learned_addr learned my addr 172.21.15.71:0/3825914187 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.101+0000 7f54e3fff700 1 --2- 172.21.15.71:0/3825914187 >> v2:172.21.15.71:3300/0 conn(0x7f54e40b16d0 0x7f54e40b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.102+0000 7f54e37fe700 1 -- 172.21.15.71:0/3825914187 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129341125 0 0) 0x7f54e40b2080 con 0x7f54e40b4e70 2023-10-09T06:43:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.102+0000 7f54e37fe700 1 -- 172.21.15.71:0/3825914187 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54d4003570 con 0x7f54e40b4e70 2023-10-09T06:43:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.102+0000 7f54e3fff700 1 -- 172.21.15.71:0/3825914187 >> v1:172.21.15.179:6789/0 conn(0x7f54e40b33b0 legacy=0x7f54e40b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.102+0000 7f54e3fff700 1 -- 172.21.15.71:0/3825914187 >> v1:172.21.15.71:6789/0 conn(0x7f54e40b4e70 legacy=0x7f54e40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.102+0000 7f54e3fff700 1 -- 172.21.15.71:0/3825914187 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e40b5f20 con 0x7f54e40b16d0 2023-10-09T06:43:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.102+0000 7f54e3fff700 1 --2- 172.21.15.71:0/3825914187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e40b16d0 0x7f54e40b1b40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f54d00098e0 tx=0x7f54d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33570f40e3f963c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.102+0000 7f54e37fe700 1 -- 172.21.15.71:0/3825914187 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d000b640 con 0x7f54e40b16d0 2023-10-09T06:43:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.102+0000 7f54e37fe700 1 -- 172.21.15.71:0/3825914187 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d000b7a0 con 0x7f54e40b16d0 2023-10-09T06:43:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.102+0000 7f54e37fe700 1 -- 172.21.15.71:0/3825914187 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d000bb40 con 0x7f54e40b16d0 2023-10-09T06:43:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.103+0000 7f54e9b9d700 1 -- 172.21.15.71:0/3825914187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e40b16d0 msgr2=0x7f54e40b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.103+0000 7f54e9b9d700 1 --2- 172.21.15.71:0/3825914187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e40b16d0 0x7f54e40b1b40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f54d00098e0 tx=0x7f54d00091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.103+0000 7f54e9b9d700 1 -- 172.21.15.71:0/3825914187 shutdown_connections 2023-10-09T06:43:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.103+0000 7f54e9b9d700 1 --2- 172.21.15.71:0/3825914187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e40b16d0 0x7f54e40b1b40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.103+0000 7f54e9b9d700 1 -- 172.21.15.71:0/3825914187 >> 172.21.15.71:0/3825914187 conn(0x7f54e40d10c0 msgr2=0x7f54e40affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:12.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.103+0000 7f54e9b9d700 1 -- 172.21.15.71:0/3825914187 shutdown_connections 2023-10-09T06:43:12.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.103+0000 7f54e9b9d700 1 -- 172.21.15.71:0/3825914187 wait complete. 2023-10-09T06:43:12.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.105+0000 7f54e9b9d700 1 Processor -- start 2023-10-09T06:43:12.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.105+0000 7f54e9b9d700 1 -- start start 2023-10-09T06:43:12.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.106+0000 7f54e9b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e40b16d0 0x7f54e40c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:12.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.106+0000 7f54e9b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54e40b33b0 0x7f54e40c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:12.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.106+0000 7f54e9b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54e40b4e70 0x7f54e416d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:12.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.106+0000 7f54e9b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e414b230 con 0x7f54e40b16d0 2023-10-09T06:43:12.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.106+0000 7f54e9b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e414c090 con 0x7f54e40b4e70 2023-10-09T06:43:12.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.106+0000 7f54e9b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e40ca050 con 0x7f54e40b33b0 2023-10-09T06:43:12.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.106+0000 7f54e8b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e40b16d0 0x7f54e40c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:12.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.106+0000 7f54e8b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e40b16d0 0x7f54e40c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40552/0 (socket says 172.21.15.71:40552) 2023-10-09T06:43:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.106+0000 7f54e8b9b700 1 -- 172.21.15.71:0/1389475752 learned_addr learned my addr 172.21.15.71:0/1389475752 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.106+0000 7f54e8b9b700 1 -- 172.21.15.71:0/1389475752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54e40b33b0 msgr2=0x7f54e40c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.106+0000 7f54e8b9b700 1 --2- 172.21.15.71:0/1389475752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54e40b33b0 0x7f54e40c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.106+0000 7f54e8b9b700 1 -- 172.21.15.71:0/1389475752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54e40b4e70 msgr2=0x7f54e416d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.106+0000 7f54e8b9b700 1 --2- 172.21.15.71:0/1389475752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54e40b4e70 0x7f54e416d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.106+0000 7f54e8b9b700 1 -- 172.21.15.71:0/1389475752 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d0009420 con 0x7f54e40b16d0 2023-10-09T06:43:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.106+0000 7f54e8b9b700 1 --2- 172.21.15.71:0/1389475752 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e40b16d0 0x7f54e40c85d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f54d800c590 tx=0x7f54d8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.107+0000 7f54e0ff9700 1 -- 172.21.15.71:0/1389475752 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d8005b30 con 0x7f54e40b16d0 2023-10-09T06:43:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.107+0000 7f54e0ff9700 1 -- 172.21.15.71:0/1389475752 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d8005cb0 con 0x7f54e40b16d0 2023-10-09T06:43:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.107+0000 7f54e0ff9700 1 -- 172.21.15.71:0/1389475752 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d8007320 con 0x7f54e40b16d0 2023-10-09T06:43:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.107+0000 7f54e9b9d700 1 -- 172.21.15.71:0/1389475752 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e414b480 con 0x7f54e40b16d0 2023-10-09T06:43:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.107+0000 7f54e9b9d700 1 -- 172.21.15.71:0/1389475752 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e414ba40 con 0x7f54e40b16d0 2023-10-09T06:43:12.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.108+0000 7f54e9b9d700 1 -- 172.21.15.71:0/1389475752 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e415a290 con 0x7f54e40b16d0 2023-10-09T06:43:12.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.109+0000 7f54e0ff9700 1 -- 172.21.15.71:0/1389475752 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f54d801b3b0 con 0x7f54e40b16d0 2023-10-09T06:43:12.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.109+0000 7f54e0ff9700 1 --2- 172.21.15.71:0/1389475752 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f54c8066f30 0x7f54c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:12.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.109+0000 7f54e0ff9700 1 -- 172.21.15.71:0/1389475752 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f54d8083b90 con 0x7f54e40b16d0 2023-10-09T06:43:12.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.110+0000 7f54e3fff700 1 --2- 172.21.15.71:0/1389475752 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f54c8066f30 0x7f54c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:12.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.111+0000 7f54e3fff700 1 --2- 172.21.15.71:0/1389475752 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f54c8066f30 0x7f54c80693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f54e40b0f40 tx=0x7f54d0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:12.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.113+0000 7f54e0ff9700 1 -- 172.21.15.71:0/1389475752 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54d8050d60 con 0x7f54e40b16d0 2023-10-09T06:43:12.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.302+0000 7f54e9b9d700 1 -- 172.21.15.71:0/1389475752 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f54e404bb80 con 0x7f54e40b16d0 2023-10-09T06:43:12.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.302+0000 7f54e0ff9700 1 -- 172.21.15.71:0/1389475752 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f54d80170a0 con 0x7f54e40b16d0 2023-10-09T06:43:12.303 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-09T06:43:12.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.305+0000 7f54e9b9d700 1 -- 172.21.15.71:0/1389475752 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f54c8066f30 msgr2=0x7f54c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:12.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.305+0000 7f54e9b9d700 1 --2- 172.21.15.71:0/1389475752 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f54c8066f30 0x7f54c80693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f54e40b0f40 tx=0x7f54d0017000 comp rx=0 tx=0).stop 2023-10-09T06:43:12.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.305+0000 7f54e9b9d700 1 -- 172.21.15.71:0/1389475752 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e40b16d0 msgr2=0x7f54e40c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:12.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.305+0000 7f54e9b9d700 1 --2- 172.21.15.71:0/1389475752 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e40b16d0 0x7f54e40c85d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f54d800c590 tx=0x7f54d8007e00 comp rx=0 tx=0).stop 2023-10-09T06:43:12.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.305+0000 7f54e9b9d700 1 -- 172.21.15.71:0/1389475752 shutdown_connections 2023-10-09T06:43:12.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.305+0000 7f54e9b9d700 1 --2- 172.21.15.71:0/1389475752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54e40b4e70 0x7f54e416d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.305+0000 7f54e9b9d700 1 --2- 172.21.15.71:0/1389475752 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f54c8066f30 0x7f54c80693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.305+0000 7f54e9b9d700 1 --2- 172.21.15.71:0/1389475752 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e40b16d0 0x7f54e40c85d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.305+0000 7f54e9b9d700 1 --2- 172.21.15.71:0/1389475752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54e40b33b0 0x7f54e40c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.305+0000 7f54e9b9d700 1 -- 172.21.15.71:0/1389475752 >> 172.21.15.71:0/1389475752 conn(0x7f54e40d10c0 msgr2=0x7f54e40ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:12.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.305+0000 7f54e9b9d700 1 -- 172.21.15.71:0/1389475752 shutdown_connections 2023-10-09T06:43:12.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.305+0000 7f54e9b9d700 1 -- 172.21.15.71:0/1389475752 wait complete. 2023-10-09T06:43:12.322 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:43:12.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.504+0000 7f656d5ff700 1 Processor -- start 2023-10-09T06:43:12.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.504+0000 7f656d5ff700 1 -- start start 2023-10-09T06:43:12.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.506+0000 7f656d5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65680c83f0 0x7f65680c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:12.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.506+0000 7f656d5ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f65681568e0 0x7f65680ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.506+0000 7f656d5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f656815b0d0 con 0x7f65680ccee0 2023-10-09T06:43:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.506+0000 7f656d5ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65680c7a60 con 0x7f65681568e0 2023-10-09T06:43:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.506+0000 7f656d5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656815a4c0 con 0x7f65680c83f0 2023-10-09T06:43:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.506+0000 7f65677fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f65681568e0 0x7f65680ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.506+0000 7f65677fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f65681568e0 0x7f65680ca1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40568/0 (socket says 172.21.15.71:40568) 2023-10-09T06:43:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.506+0000 7f65677fe700 1 -- 172.21.15.71:0/4159824332 learned_addr learned my addr 172.21.15.71:0/4159824332 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.506+0000 7f6566ffd700 1 --2- 172.21.15.71:0/4159824332 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65680c83f0 0x7f65680c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.506+0000 7f65677fe700 1 -- 172.21.15.71:0/4159824332 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65680c83f0 msgr2=0x7f65680c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.506+0000 7f65677fe700 1 --2- 172.21.15.71:0/4159824332 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65680c83f0 0x7f65680c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.506+0000 7f65677fe700 1 -- 172.21.15.71:0/4159824332 >> v1:172.21.15.179:6789/0 conn(0x7f65680ccee0 legacy=0x7f65681561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.506+0000 7f65677fe700 1 -- 172.21.15.71:0/4159824332 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656815a7a0 con 0x7f65681568e0 2023-10-09T06:43:12.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.507+0000 7f65677fe700 1 --2- 172.21.15.71:0/4159824332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65681568e0 0x7f65680ca1e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6560009f20 tx=0x7f6560009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829db0faf327a96e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:12.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.507+0000 7f6565ffb700 1 -- 172.21.15.71:0/4159824332 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656000e070 con 0x7f65681568e0 2023-10-09T06:43:12.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.507+0000 7f6565ffb700 1 -- 172.21.15.71:0/4159824332 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656000ba80 con 0x7f65681568e0 2023-10-09T06:43:12.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.507+0000 7f6565ffb700 1 -- 172.21.15.71:0/4159824332 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65600092e0 con 0x7f65681568e0 2023-10-09T06:43:12.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.507+0000 7f656d5ff700 1 -- 172.21.15.71:0/4159824332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65681568e0 msgr2=0x7f65680ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:12.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.507+0000 7f656d5ff700 1 --2- 172.21.15.71:0/4159824332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65681568e0 0x7f65680ca1e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6560009f20 tx=0x7f6560009840 comp rx=0 tx=0).stop 2023-10-09T06:43:12.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.508+0000 7f656d5ff700 1 -- 172.21.15.71:0/4159824332 shutdown_connections 2023-10-09T06:43:12.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.508+0000 7f656d5ff700 1 --2- 172.21.15.71:0/4159824332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65681568e0 0x7f65680ca1e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.508+0000 7f656d5ff700 1 --2- 172.21.15.71:0/4159824332 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65680c83f0 0x7f65680c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.508+0000 7f656d5ff700 1 -- 172.21.15.71:0/4159824332 >> 172.21.15.71:0/4159824332 conn(0x7f6568068e10 msgr2=0x7f65680cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:12.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.508+0000 7f656d5ff700 1 -- 172.21.15.71:0/4159824332 shutdown_connections 2023-10-09T06:43:12.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.508+0000 7f656d5ff700 1 -- 172.21.15.71:0/4159824332 wait complete. 2023-10-09T06:43:12.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.509+0000 7f656d5ff700 1 Processor -- start 2023-10-09T06:43:12.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.509+0000 7f656d5ff700 1 -- start start 2023-10-09T06:43:12.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.510+0000 7f656d5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65680c83f0 0x7f6568152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.510+0000 7f656d5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65680ccee0 0x7f65681544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.510+0000 7f656d5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65681568e0 0x7f6568154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.510+0000 7f656d5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656815a180 con 0x7f65681568e0 2023-10-09T06:43:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.510+0000 7f656d5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65680c2c60 con 0x7f65680ccee0 2023-10-09T06:43:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.510+0000 7f656d5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65680c2050 con 0x7f65680c83f0 2023-10-09T06:43:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.510+0000 7f65677fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65681568e0 0x7f6568154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.510+0000 7f65677fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65681568e0 0x7f6568154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40570/0 (socket says 172.21.15.71:40570) 2023-10-09T06:43:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.510+0000 7f65677fe700 1 -- 172.21.15.71:0/3410923457 learned_addr learned my addr 172.21.15.71:0/3410923457 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.510+0000 7f65667fc700 1 --2- 172.21.15.71:0/3410923457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65680ccee0 0x7f65681544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.510+0000 7f6566ffd700 1 --2- 172.21.15.71:0/3410923457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65680c83f0 0x7f6568152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.511+0000 7f65677fe700 1 -- 172.21.15.71:0/3410923457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65680c83f0 msgr2=0x7f6568152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.511+0000 7f65677fe700 1 --2- 172.21.15.71:0/3410923457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65680c83f0 0x7f6568152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.511+0000 7f65677fe700 1 -- 172.21.15.71:0/3410923457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65680ccee0 msgr2=0x7f65681544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.511+0000 7f65677fe700 1 --2- 172.21.15.71:0/3410923457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65680ccee0 0x7f65681544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.511+0000 7f65677fe700 1 -- 172.21.15.71:0/3410923457 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6560009ae0 con 0x7f65681568e0 2023-10-09T06:43:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.511+0000 7f6566ffd700 1 --2- 172.21.15.71:0/3410923457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65680c83f0 0x7f6568152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.511+0000 7f65677fe700 1 --2- 172.21.15.71:0/3410923457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65681568e0 0x7f6568154a20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6568063d40 tx=0x7f6560018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.511+0000 7f654effd700 1 -- 172.21.15.71:0/3410923457 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65600032f0 con 0x7f65681568e0 2023-10-09T06:43:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.511+0000 7f654effd700 1 -- 172.21.15.71:0/3410923457 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6560008e80 con 0x7f65681568e0 2023-10-09T06:43:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.511+0000 7f654effd700 1 -- 172.21.15.71:0/3410923457 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6560025690 con 0x7f65681568e0 2023-10-09T06:43:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.511+0000 7f656d5ff700 1 -- 172.21.15.71:0/3410923457 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65680c2330 con 0x7f65681568e0 2023-10-09T06:43:12.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.511+0000 7f656d5ff700 1 -- 172.21.15.71:0/3410923457 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65680c28f0 con 0x7f65681568e0 2023-10-09T06:43:12.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.512+0000 7f656d5ff700 1 -- 172.21.15.71:0/3410923457 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65680c2da0 con 0x7f65681568e0 2023-10-09T06:43:12.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.513+0000 7f654effd700 1 -- 172.21.15.71:0/3410923457 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6560003040 con 0x7f65681568e0 2023-10-09T06:43:12.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.514+0000 7f654effd700 1 --2- 172.21.15.71:0/3410923457 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6554066f30 0x7f65540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:12.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.514+0000 7f654effd700 1 -- 172.21.15.71:0/3410923457 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6560085fe0 con 0x7f65681568e0 2023-10-09T06:43:12.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.514+0000 7f6566ffd700 1 --2- 172.21.15.71:0/3410923457 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6554066f30 0x7f65540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:12.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.515+0000 7f6566ffd700 1 --2- 172.21.15.71:0/3410923457 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6554066f30 0x7f65540693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6558006fd0 tx=0x7f6558008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:12.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.518+0000 7f654effd700 1 -- 172.21.15.71:0/3410923457 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65680c2da0 con 0x7f65681568e0 2023-10-09T06:43:12.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.709+0000 7f656d5ff700 1 -- 172.21.15.71:0/3410923457 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f65680c2da0 con 0x7f65681568e0 2023-10-09T06:43:12.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.709+0000 7f654effd700 1 -- 172.21.15.71:0/3410923457 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f65680c2da0 con 0x7f65681568e0 2023-10-09T06:43:12.709 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-09T06:43:12.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.712+0000 7f656d5ff700 1 -- 172.21.15.71:0/3410923457 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6554066f30 msgr2=0x7f65540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:12.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.712+0000 7f656d5ff700 1 --2- 172.21.15.71:0/3410923457 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6554066f30 0x7f65540693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6558006fd0 tx=0x7f6558008040 comp rx=0 tx=0).stop 2023-10-09T06:43:12.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.712+0000 7f656d5ff700 1 -- 172.21.15.71:0/3410923457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65681568e0 msgr2=0x7f6568154a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:12.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.712+0000 7f656d5ff700 1 --2- 172.21.15.71:0/3410923457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65681568e0 0x7f6568154a20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6568063d40 tx=0x7f6560018000 comp rx=0 tx=0).stop 2023-10-09T06:43:12.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.712+0000 7f656d5ff700 1 -- 172.21.15.71:0/3410923457 shutdown_connections 2023-10-09T06:43:12.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.712+0000 7f656d5ff700 1 --2- 172.21.15.71:0/3410923457 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6554066f30 0x7f65540693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.712+0000 7f656d5ff700 1 --2- 172.21.15.71:0/3410923457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65681568e0 0x7f6568154a20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.712+0000 7f656d5ff700 1 --2- 172.21.15.71:0/3410923457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65680c83f0 0x7f6568152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.712+0000 7f656d5ff700 1 --2- 172.21.15.71:0/3410923457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65680ccee0 0x7f65681544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.712+0000 7f656d5ff700 1 -- 172.21.15.71:0/3410923457 >> 172.21.15.71:0/3410923457 conn(0x7f6568068e10 msgr2=0x7f65680c8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:12.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.712+0000 7f656d5ff700 1 -- 172.21.15.71:0/3410923457 shutdown_connections 2023-10-09T06:43:12.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.712+0000 7f656d5ff700 1 -- 172.21.15.71:0/3410923457 wait complete. 2023-10-09T06:43:12.790 INFO:tasks.cephfs_test_runner:Starting test: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test concurrent snap creates in same file-system without db issues 2023-10-09T06:43:12.791 INFO:tasks.cephfs_test_runner:test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-09T06:43:12.791 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-10-09T06:43:12.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.971+0000 7f50fe19d700 1 Processor -- start 2023-10-09T06:43:12.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.971+0000 7f50fe19d700 1 -- start start 2023-10-09T06:43:12.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.972+0000 7f50fe19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f81595a0 0x7f50f80b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:12.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.972+0000 7f50fe19d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f50f80c6c60 0x7f50f80c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:12.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.973+0000 7f50fe19d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f80b1410 con 0x7f50f80b1de0 2023-10-09T06:43:12.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.973+0000 7f50fe19d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f80b2b90 con 0x7f50f80c6c60 2023-10-09T06:43:12.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.973+0000 7f50fe19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f8063230 con 0x7f50f81595a0 2023-10-09T06:43:12.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.973+0000 7f50fd99c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f50f80b1de0 0x7f50f815d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47446/0 (socket says 172.21.15.71:47446) 2023-10-09T06:43:12.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.973+0000 7f50fd99c700 1 -- 172.21.15.71:0/1834158384 learned_addr learned my addr 172.21.15.71:0/1834158384 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:12.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.973+0000 7f50fd19b700 1 --2- 172.21.15.71:0/1834158384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f81595a0 0x7f50f80b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:12.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.973+0000 7f50fc99a700 1 --2- 172.21.15.71:0/1834158384 >> v2:172.21.15.179:3300/0 conn(0x7f50f80c6c60 0x7f50f80c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:12.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.973+0000 7f50effff700 1 -- 172.21.15.71:0/1834158384 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149085030 0 0) 0x7f50f80b1410 con 0x7f50f80b1de0 2023-10-09T06:43:12.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.973+0000 7f50effff700 1 -- 172.21.15.71:0/1834158384 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50e4003570 con 0x7f50f80b1de0 2023-10-09T06:43:12.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.974+0000 7f50effff700 1 -- 172.21.15.71:0/1834158384 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1656360403 0 0) 0x7f50e4003570 con 0x7f50f80b1de0 2023-10-09T06:43:12.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.974+0000 7f50effff700 1 -- 172.21.15.71:0/1834158384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f81595a0 msgr2=0x7f50f80b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:12.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.974+0000 7f50effff700 1 --2- 172.21.15.71:0/1834158384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f81595a0 0x7f50f80b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.974+0000 7f50effff700 1 -- 172.21.15.71:0/1834158384 >> v2:172.21.15.179:3300/0 conn(0x7f50f80c6c60 msgr2=0x7f50f80c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:12.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.974+0000 7f50effff700 1 --2- 172.21.15.71:0/1834158384 >> v2:172.21.15.179:3300/0 conn(0x7f50f80c6c60 0x7f50f80c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.974+0000 7f50effff700 1 -- 172.21.15.71:0/1834158384 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f80634f0 con 0x7f50f80b1de0 2023-10-09T06:43:12.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.974+0000 7f50effff700 1 -- 172.21.15.71:0/1834158384 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f50f00017f0 con 0x7f50f80b1de0 2023-10-09T06:43:12.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.974+0000 7f50effff700 1 -- 172.21.15.71:0/1834158384 >> v1:172.21.15.71:6789/0 conn(0x7f50f80b1de0 legacy=0x7f50f815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:12.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.974+0000 7f50effff700 1 --2- 172.21.15.71:0/1834158384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f81595a0 0x7f50e4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:12.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.974+0000 7f50effff700 1 --2- 172.21.15.71:0/1834158384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50e4003fe0 0x7f50e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:12.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.974+0000 7f50effff700 1 --2- 172.21.15.71:0/1834158384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50e4004d50 0x7f50e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:12.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.974+0000 7f50effff700 1 -- 172.21.15.71:0/1834158384 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f80b2b90 con 0x7f50e4003fe0 2023-10-09T06:43:12.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.974+0000 7f50effff700 1 -- 172.21.15.71:0/1834158384 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f8063230 con 0x7f50e4004d50 2023-10-09T06:43:12.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.974+0000 7f50effff700 1 -- 172.21.15.71:0/1834158384 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e400ba90 con 0x7f50f81595a0 2023-10-09T06:43:12.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.974+0000 7f50fc99a700 1 --2- 172.21.15.71:0/1834158384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50e4003fe0 0x7f50e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:12.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.974+0000 7f50fd19b700 1 --2- 172.21.15.71:0/1834158384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f81595a0 0x7f50e4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:12.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.974+0000 7f50fd99c700 1 --2- 172.21.15.71:0/1834158384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50e4004d50 0x7f50e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:12.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.974+0000 7f50fc99a700 1 -- 172.21.15.71:0/1834158384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f81595a0 msgr2=0x7f50e4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:12.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.974+0000 7f50fc99a700 1 --2- 172.21.15.71:0/1834158384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f81595a0 0x7f50e4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.974+0000 7f50fc99a700 1 -- 172.21.15.71:0/1834158384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50e4004d50 msgr2=0x7f50e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:12.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.974+0000 7f50fc99a700 1 --2- 172.21.15.71:0/1834158384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50e4004d50 0x7f50e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.974+0000 7f50fc99a700 1 -- 172.21.15.71:0/1834158384 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e4003570 con 0x7f50e4003fe0 2023-10-09T06:43:12.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.974+0000 7f50fd19b700 1 --2- 172.21.15.71:0/1834158384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f81595a0 0x7f50e4003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:43:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.975+0000 7f50fc99a700 1 --2- 172.21.15.71:0/1834158384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50e4003fe0 0x7f50e4004810 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009c00 tx=0x7f50e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e1a977eef5c6e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.975+0000 7f50effff700 1 -- 172.21.15.71:0/1834158384 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e800e6b0 con 0x7f50e4003fe0 2023-10-09T06:43:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.975+0000 7f50effff700 1 -- 172.21.15.71:0/1834158384 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e800e810 con 0x7f50e4003fe0 2023-10-09T06:43:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.975+0000 7f50effff700 1 -- 172.21.15.71:0/1834158384 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e800ebd0 con 0x7f50e4003fe0 2023-10-09T06:43:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.975+0000 7f50fe19d700 1 -- 172.21.15.71:0/1834158384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50e4003fe0 msgr2=0x7f50e4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.975+0000 7f50fe19d700 1 --2- 172.21.15.71:0/1834158384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50e4003fe0 0x7f50e4004810 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009c00 tx=0x7f50e80091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.975+0000 7f50fd99c700 1 -- 172.21.15.71:0/1834158384 reap_dead start 2023-10-09T06:43:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.975+0000 7f50fe19d700 1 -- 172.21.15.71:0/1834158384 shutdown_connections 2023-10-09T06:43:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.975+0000 7f50fe19d700 1 -- 172.21.15.71:0/1834158384 >> 172.21.15.71:0/1834158384 conn(0x7f50f806ddb0 msgr2=0x7f50f806e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.976+0000 7f50fe19d700 1 -- 172.21.15.71:0/1834158384 shutdown_connections 2023-10-09T06:43:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.976+0000 7f50fe19d700 1 -- 172.21.15.71:0/1834158384 wait complete. 2023-10-09T06:43:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.977+0000 7f50fe19d700 1 Processor -- start 2023-10-09T06:43:12.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.977+0000 7f50fe19d700 1 -- start start 2023-10-09T06:43:12.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.978+0000 7f50fe19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50e4003fe0 0x7f50f80aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:12.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.978+0000 7f50fe19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f816a070 0x7f50f80c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:12.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.978+0000 7f50fe19d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50f816a4e0 0x7f50f80c3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:12.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.978+0000 7f50fe19d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f815d3f0 con 0x7f50f816a4e0 2023-10-09T06:43:12.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.978+0000 7f50fe19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f813d1b0 con 0x7f50e4003fe0 2023-10-09T06:43:12.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.978+0000 7f50fe19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f80c2330 con 0x7f50f816a070 2023-10-09T06:43:12.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.978+0000 7f50fd99c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50f816a4e0 0x7f50f80c3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:12.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.978+0000 7f50fd99c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50f816a4e0 0x7f50f80c3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40580/0 (socket says 172.21.15.71:40580) 2023-10-09T06:43:12.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.978+0000 7f50fd99c700 1 -- 172.21.15.71:0/403363642 learned_addr learned my addr 172.21.15.71:0/403363642 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:12.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.978+0000 7f50fc99a700 1 --2- 172.21.15.71:0/403363642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f816a070 0x7f50f80c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:12.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.978+0000 7f50fd19b700 1 --2- 172.21.15.71:0/403363642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50e4003fe0 0x7f50f80aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:12.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.979+0000 7f50fd99c700 1 -- 172.21.15.71:0/403363642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f816a070 msgr2=0x7f50f80c31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:12.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.979+0000 7f50fd99c700 1 --2- 172.21.15.71:0/403363642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f816a070 0x7f50f80c31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.979+0000 7f50fd99c700 1 -- 172.21.15.71:0/403363642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50e4003fe0 msgr2=0x7f50f80aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:12.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.979+0000 7f50fd99c700 1 --2- 172.21.15.71:0/403363642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50e4003fe0 0x7f50f80aecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:12.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.979+0000 7f50fd99c700 1 -- 172.21.15.71:0/403363642 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f815d640 con 0x7f50f816a4e0 2023-10-09T06:43:12.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.979+0000 7f50fd19b700 1 --2- 172.21.15.71:0/403363642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50e4003fe0 0x7f50f80aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:12.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.979+0000 7f50fd99c700 1 --2- 172.21.15.71:0/403363642 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50f816a4e0 0x7f50f80c3720 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f50f8063370 tx=0x7f50f0002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:12.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.979+0000 7f50ed7fa700 1 -- 172.21.15.71:0/403363642 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f000ae50 con 0x7f50f816a4e0 2023-10-09T06:43:12.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.979+0000 7f50ed7fa700 1 -- 172.21.15.71:0/403363642 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f00133f0 con 0x7f50f816a4e0 2023-10-09T06:43:12.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.979+0000 7f50ed7fa700 1 -- 172.21.15.71:0/403363642 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00137b0 con 0x7f50f816a4e0 2023-10-09T06:43:12.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.979+0000 7f50fe19d700 1 -- 172.21.15.71:0/403363642 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f815d920 con 0x7f50f816a4e0 2023-10-09T06:43:12.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.979+0000 7f50fe19d700 1 -- 172.21.15.71:0/403363642 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f815dee0 con 0x7f50f816a4e0 2023-10-09T06:43:12.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.980+0000 7f50fe19d700 1 -- 172.21.15.71:0/403363642 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f815e0d0 con 0x7f50f816a4e0 2023-10-09T06:43:12.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.981+0000 7f50ed7fa700 1 -- 172.21.15.71:0/403363642 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f50f0013b60 con 0x7f50f816a4e0 2023-10-09T06:43:12.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.982+0000 7f50ed7fa700 1 --2- 172.21.15.71:0/403363642 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f50dc066f60 0x7f50dc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:12.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.982+0000 7f50ed7fa700 1 -- 172.21.15.71:0/403363642 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f50f0084ef0 con 0x7f50f816a4e0 2023-10-09T06:43:12.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.982+0000 7f50fd19b700 1 --2- 172.21.15.71:0/403363642 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f50dc066f60 0x7f50dc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:12.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.983+0000 7f50fd19b700 1 --2- 172.21.15.71:0/403363642 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f50dc066f60 0x7f50dc069410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f50f4006dc0 tx=0x7f50f4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:12.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:12.986+0000 7f50ed7fa700 1 -- 172.21.15.71:0/403363642 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50f00520c0 con 0x7f50f816a4e0 2023-10-09T06:43:13.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.255+0000 7f50fe19d700 1 -- 172.21.15.71:0/403363642 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7f50f804c3c0 con 0x7f50f816a4e0 2023-10-09T06:43:13.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.650+0000 7f50ed7fa700 1 -- 172.21.15.71:0/403363642 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v54) v1 ==== 161+0+0 (secure 0 0 0) 0x7f50f00556e0 con 0x7f50f816a4e0 2023-10-09T06:43:13.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.653+0000 7f50fe19d700 1 -- 172.21.15.71:0/403363642 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f50dc066f60 msgr2=0x7f50dc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:13.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.653+0000 7f50fe19d700 1 --2- 172.21.15.71:0/403363642 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f50dc066f60 0x7f50dc069410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f50f4006dc0 tx=0x7f50f4008040 comp rx=0 tx=0).stop 2023-10-09T06:43:13.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.653+0000 7f50fe19d700 1 -- 172.21.15.71:0/403363642 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50f816a4e0 msgr2=0x7f50f80c3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:13.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.653+0000 7f50fe19d700 1 --2- 172.21.15.71:0/403363642 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50f816a4e0 0x7f50f80c3720 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f50f8063370 tx=0x7f50f0002210 comp rx=0 tx=0).stop 2023-10-09T06:43:13.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.653+0000 7f50fe19d700 1 -- 172.21.15.71:0/403363642 shutdown_connections 2023-10-09T06:43:13.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.653+0000 7f50fe19d700 1 --2- 172.21.15.71:0/403363642 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f50dc066f60 0x7f50dc069410 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:13.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.653+0000 7f50fe19d700 1 --2- 172.21.15.71:0/403363642 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50f816a4e0 0x7f50f80c3720 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:13.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.653+0000 7f50fe19d700 1 --2- 172.21.15.71:0/403363642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50e4003fe0 0x7f50f80aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:13.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.653+0000 7f50fe19d700 1 --2- 172.21.15.71:0/403363642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f816a070 0x7f50f80c31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:13.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.653+0000 7f50fe19d700 1 -- 172.21.15.71:0/403363642 >> 172.21.15.71:0/403363642 conn(0x7f50f806ddb0 msgr2=0x7f50f813d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:13.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.653+0000 7f50fe19d700 1 -- 172.21.15.71:0/403363642 shutdown_connections 2023-10-09T06:43:13.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.653+0000 7f50fe19d700 1 -- 172.21.15.71:0/403363642 wait complete. 2023-10-09T06:43:13.671 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T06:43:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.854+0000 7f8491d9d700 1 Processor -- start 2023-10-09T06:43:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.854+0000 7f8491d9d700 1 -- start start 2023-10-09T06:43:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.855+0000 7f8491d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f848c0cb1a0 0x7f848c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.855+0000 7f8491d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f848c15a8a0 0x7f848c06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.855+0000 7f8491d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f848c06f5a0 0x7f848c0ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.855+0000 7f8491d9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848c15b2e0 con 0x7f848c06f5a0 2023-10-09T06:43:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.855+0000 7f8491d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848c06ebd0 con 0x7f848c15a8a0 2023-10-09T06:43:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.855+0000 7f8491d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848c15ad20 con 0x7f848c0cb1a0 2023-10-09T06:43:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.855+0000 7f849159c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f848c06f5a0 0x7f848c0ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.855+0000 7f849159c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f848c06f5a0 0x7f848c0ae0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40582/0 (socket says 172.21.15.71:40582) 2023-10-09T06:43:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.855+0000 7f849159c700 1 -- 172.21.15.71:0/2317606935 learned_addr learned my addr 172.21.15.71:0/2317606935 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.856+0000 7f8490d9b700 1 --2- 172.21.15.71:0/2317606935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f848c0cb1a0 0x7f848c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.856+0000 7f848bfff700 1 --2- 172.21.15.71:0/2317606935 >> v2:172.21.15.179:3300/0 conn(0x7f848c15a8a0 0x7f848c06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.856+0000 7f849159c700 1 -- 172.21.15.71:0/2317606935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f848c0cb1a0 msgr2=0x7f848c15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.856+0000 7f849159c700 1 --2- 172.21.15.71:0/2317606935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f848c0cb1a0 0x7f848c15a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.856+0000 7f849159c700 1 -- 172.21.15.71:0/2317606935 >> v2:172.21.15.179:3300/0 conn(0x7f848c15a8a0 msgr2=0x7f848c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.856+0000 7f849159c700 1 --2- 172.21.15.71:0/2317606935 >> v2:172.21.15.179:3300/0 conn(0x7f848c15a8a0 0x7f848c06f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.856+0000 7f849159c700 1 -- 172.21.15.71:0/2317606935 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c15b000 con 0x7f848c06f5a0 2023-10-09T06:43:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.856+0000 7f8490d9b700 1 --2- 172.21.15.71:0/2317606935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f848c0cb1a0 0x7f848c15a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:13.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.856+0000 7f848bfff700 1 --2- 172.21.15.71:0/2317606935 >> v2:172.21.15.179:3300/0 conn(0x7f848c15a8a0 0x7f848c06f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:13.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.856+0000 7f849159c700 1 --2- 172.21.15.71:0/2317606935 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f848c06f5a0 0x7f848c0ae0d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f848c06d1e0 tx=0x7f8484009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ab9d29fd0ab7c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:13.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.856+0000 7f848b7fe700 1 -- 172.21.15.71:0/2317606935 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848400e070 con 0x7f848c06f5a0 2023-10-09T06:43:13.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.856+0000 7f848b7fe700 1 -- 172.21.15.71:0/2317606935 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848400bae0 con 0x7f848c06f5a0 2023-10-09T06:43:13.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.856+0000 7f848b7fe700 1 -- 172.21.15.71:0/2317606935 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84840092e0 con 0x7f848c06f5a0 2023-10-09T06:43:13.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.857+0000 7f8491d9d700 1 -- 172.21.15.71:0/2317606935 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f848c06f5a0 msgr2=0x7f848c0ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.857+0000 7f8491d9d700 1 --2- 172.21.15.71:0/2317606935 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f848c06f5a0 0x7f848c0ae0d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f848c06d1e0 tx=0x7f8484009840 comp rx=0 tx=0).stop 2023-10-09T06:43:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.857+0000 7f8491d9d700 1 -- 172.21.15.71:0/2317606935 shutdown_connections 2023-10-09T06:43:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.857+0000 7f8491d9d700 1 --2- 172.21.15.71:0/2317606935 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f848c06f5a0 0x7f848c0ae0d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.857+0000 7f8491d9d700 1 --2- 172.21.15.71:0/2317606935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f848c0cb1a0 0x7f848c15a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.857+0000 7f8491d9d700 1 --2- 172.21.15.71:0/2317606935 >> v2:172.21.15.179:3300/0 conn(0x7f848c15a8a0 0x7f848c06f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.857+0000 7f8491d9d700 1 -- 172.21.15.71:0/2317606935 >> 172.21.15.71:0/2317606935 conn(0x7f848c0cc1e0 msgr2=0x7f848c0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.857+0000 7f8491d9d700 1 -- 172.21.15.71:0/2317606935 shutdown_connections 2023-10-09T06:43:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.857+0000 7f8491d9d700 1 -- 172.21.15.71:0/2317606935 wait complete. 2023-10-09T06:43:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.858+0000 7f8491d9d700 1 Processor -- start 2023-10-09T06:43:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.859+0000 7f8491d9d700 1 -- start start 2023-10-09T06:43:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.859+0000 7f8491d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f848c06f5a0 0x7f848c155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.859+0000 7f8491d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f848c0cb1a0 0x7f848c157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.859+0000 7f8491d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f848c157970 0x7f848c0c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.859+0000 7f8491d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c158b00 con 0x7f848c157970 2023-10-09T06:43:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.859+0000 7f8491d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c157ef0 con 0x7f848c06f5a0 2023-10-09T06:43:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.859+0000 7f8491d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848c1581d0 con 0x7f848c0cb1a0 2023-10-09T06:43:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.860+0000 7f849159c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f848c157970 0x7f848c0c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.860+0000 7f849159c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f848c157970 0x7f848c0c76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40596/0 (socket says 172.21.15.71:40596) 2023-10-09T06:43:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.860+0000 7f849159c700 1 -- 172.21.15.71:0/1521478244 learned_addr learned my addr 172.21.15.71:0/1521478244 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.860+0000 7f8490d9b700 1 --2- 172.21.15.71:0/1521478244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f848c06f5a0 0x7f848c155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.860+0000 7f848bfff700 1 --2- 172.21.15.71:0/1521478244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f848c0cb1a0 0x7f848c157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.860+0000 7f849159c700 1 -- 172.21.15.71:0/1521478244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f848c0cb1a0 msgr2=0x7f848c157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.860+0000 7f849159c700 1 --2- 172.21.15.71:0/1521478244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f848c0cb1a0 0x7f848c157430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.860+0000 7f849159c700 1 -- 172.21.15.71:0/1521478244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f848c06f5a0 msgr2=0x7f848c155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.860+0000 7f849159c700 1 --2- 172.21.15.71:0/1521478244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f848c06f5a0 0x7f848c155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.860+0000 7f849159c700 1 -- 172.21.15.71:0/1521478244 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8484009ae0 con 0x7f848c157970 2023-10-09T06:43:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.860+0000 7f848bfff700 1 --2- 172.21.15.71:0/1521478244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f848c0cb1a0 0x7f848c157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.860+0000 7f849159c700 1 --2- 172.21.15.71:0/1521478244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f848c157970 0x7f848c0c76a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8484012000 tx=0x7f8484018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.860+0000 7f8488ff9700 1 -- 172.21.15.71:0/1521478244 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8484008dd0 con 0x7f848c157970 2023-10-09T06:43:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.861+0000 7f8488ff9700 1 -- 172.21.15.71:0/1521478244 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848401d420 con 0x7f848c157970 2023-10-09T06:43:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.861+0000 7f8488ff9700 1 -- 172.21.15.71:0/1521478244 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848401d7e0 con 0x7f848c157970 2023-10-09T06:43:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.861+0000 7f8491d9d700 1 -- 172.21.15.71:0/1521478244 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848c1584b0 con 0x7f848c157970 2023-10-09T06:43:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.861+0000 7f8491d9d700 1 -- 172.21.15.71:0/1521478244 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f848c1564e0 con 0x7f848c157970 2023-10-09T06:43:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.862+0000 7f8491d9d700 1 -- 172.21.15.71:0/1521478244 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f848c06c450 con 0x7f848c157970 2023-10-09T06:43:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.862+0000 7f8488ff9700 1 -- 172.21.15.71:0/1521478244 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8484003040 con 0x7f848c157970 2023-10-09T06:43:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.863+0000 7f8488ff9700 1 --2- 172.21.15.71:0/1521478244 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8470066f30 0x7f84700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.863+0000 7f8488ff9700 1 -- 172.21.15.71:0/1521478244 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8484086280 con 0x7f848c157970 2023-10-09T06:43:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.864+0000 7f8490d9b700 1 --2- 172.21.15.71:0/1521478244 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8470066f30 0x7f84700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.865+0000 7f8490d9b700 1 --2- 172.21.15.71:0/1521478244 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8470066f30 0x7f84700693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f848000acc0 tx=0x7f8480008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:13.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:13.868+0000 7f8488ff9700 1 -- 172.21.15.71:0/1521478244 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8484053450 con 0x7f848c157970 2023-10-09T06:43:14.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.060+0000 7f8491d9d700 1 -- 172.21.15.71:0/1521478244 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f848c158c40 con 0x7f848c157970 2023-10-09T06:43:14.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.065+0000 7f8488ff9700 1 -- 172.21.15.71:0/1521478244 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8484008f30 con 0x7f848c157970 2023-10-09T06:43:14.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.068+0000 7f8491d9d700 1 -- 172.21.15.71:0/1521478244 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8470066f30 msgr2=0x7f84700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:14.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.068+0000 7f8491d9d700 1 --2- 172.21.15.71:0/1521478244 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8470066f30 0x7f84700693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f848000acc0 tx=0x7f8480008040 comp rx=0 tx=0).stop 2023-10-09T06:43:14.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.068+0000 7f8491d9d700 1 -- 172.21.15.71:0/1521478244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f848c157970 msgr2=0x7f848c0c76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:14.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.068+0000 7f8491d9d700 1 --2- 172.21.15.71:0/1521478244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f848c157970 0x7f848c0c76a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8484012000 tx=0x7f8484018000 comp rx=0 tx=0).stop 2023-10-09T06:43:14.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.068+0000 7f8491d9d700 1 -- 172.21.15.71:0/1521478244 shutdown_connections 2023-10-09T06:43:14.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.068+0000 7f8491d9d700 1 --2- 172.21.15.71:0/1521478244 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8470066f30 0x7f84700693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:14.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.068+0000 7f8491d9d700 1 --2- 172.21.15.71:0/1521478244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f848c157970 0x7f848c0c76a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:14.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.068+0000 7f8491d9d700 1 --2- 172.21.15.71:0/1521478244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f848c06f5a0 0x7f848c155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:14.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.068+0000 7f8491d9d700 1 --2- 172.21.15.71:0/1521478244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f848c0cb1a0 0x7f848c157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:14.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.068+0000 7f8491d9d700 1 -- 172.21.15.71:0/1521478244 >> 172.21.15.71:0/1521478244 conn(0x7f848c0cc1e0 msgr2=0x7f848c0c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:14.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.068+0000 7f8491d9d700 1 -- 172.21.15.71:0/1521478244 shutdown_connections 2023-10-09T06:43:14.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.068+0000 7f8491d9d700 1 -- 172.21.15.71:0/1521478244 wait complete. 2023-10-09T06:43:14.086 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:43:14.086 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:43:14.176 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:43:14.269 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:43:14.269 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T06:43:14.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:43:14.270 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-09T06:43:14.362 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T06:43:14.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:14.363 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T06:43:14.407 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T06:43:14.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:43:14.407 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-09T06:43:14.505 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-10-09T06:43:14.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:14.506 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T06:43:14.551 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-09T06:43:14.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:43:14.551 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-09T06:43:14.632 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T06:43:14.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:14.633 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-09T06:43:14.670 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-09T06:43:14.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:43:14.670 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-09T06:43:14.753 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-10-09T06:43:14.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:14.753 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-09T06:43:14.790 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T06:43:14.790 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:43:14.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.971+0000 7f03b21ff700 1 Processor -- start 2023-10-09T06:43:14.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.971+0000 7f03b21ff700 1 -- start start 2023-10-09T06:43:14.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.972+0000 7f03b21ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f03ac13f710 0x7f03ac069220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:14.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.972+0000 7f03b21ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03ac13fae0 0x7f03ac0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:14.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.972+0000 7f03b21ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03ac0c8c20 con 0x7f03ac069760 2023-10-09T06:43:14.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.972+0000 7f03b21ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03ac06b2c0 con 0x7f03ac13f710 2023-10-09T06:43:14.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.972+0000 7f03b21ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0c8010 con 0x7f03ac13fae0 2023-10-09T06:43:14.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.972+0000 7f03abfff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f03ac069760 0x7f03ac159b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47460/0 (socket says 172.21.15.71:47460) 2023-10-09T06:43:14.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.972+0000 7f03abfff700 1 -- 172.21.15.71:0/1280715475 learned_addr learned my addr 172.21.15.71:0/1280715475 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:14.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.973+0000 7f03a3fff700 1 --2- 172.21.15.71:0/1280715475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03ac13fae0 0x7f03ac0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:14.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.973+0000 7f03ab7fe700 1 --2- 172.21.15.71:0/1280715475 >> v2:172.21.15.179:3300/0 conn(0x7f03ac13f710 0x7f03ac069220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:14.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.973+0000 7f03aaffd700 1 -- 172.21.15.71:0/1280715475 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512912829 0 0) 0x7f03ac0c8c20 con 0x7f03ac069760 2023-10-09T06:43:14.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.973+0000 7f03aaffd700 1 -- 172.21.15.71:0/1280715475 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0398003570 con 0x7f03ac069760 2023-10-09T06:43:14.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.973+0000 7f03a3fff700 1 -- 172.21.15.71:0/1280715475 >> v2:172.21.15.179:3300/0 conn(0x7f03ac13f710 msgr2=0x7f03ac069220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:14.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.973+0000 7f03a3fff700 1 --2- 172.21.15.71:0/1280715475 >> v2:172.21.15.179:3300/0 conn(0x7f03ac13f710 0x7f03ac069220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:14.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.973+0000 7f03a3fff700 1 -- 172.21.15.71:0/1280715475 >> v1:172.21.15.71:6789/0 conn(0x7f03ac069760 legacy=0x7f03ac159b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:14.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.973+0000 7f03a3fff700 1 -- 172.21.15.71:0/1280715475 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac0c82f0 con 0x7f03ac13fae0 2023-10-09T06:43:14.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.973+0000 7f03a3fff700 1 --2- 172.21.15.71:0/1280715475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03ac13fae0 0x7f03ac0cb6f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f03940098e0 tx=0x7f03940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6892e9df68622b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:14.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.974+0000 7f03aaffd700 1 -- 172.21.15.71:0/1280715475 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0394011630 con 0x7f03ac13fae0 2023-10-09T06:43:14.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.974+0000 7f03aaffd700 1 -- 172.21.15.71:0/1280715475 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0394011790 con 0x7f03ac13fae0 2023-10-09T06:43:14.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.974+0000 7f03aaffd700 1 -- 172.21.15.71:0/1280715475 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0394011b30 con 0x7f03ac13fae0 2023-10-09T06:43:14.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.974+0000 7f03b21ff700 1 -- 172.21.15.71:0/1280715475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03ac13fae0 msgr2=0x7f03ac0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:14.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.974+0000 7f03b21ff700 1 --2- 172.21.15.71:0/1280715475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03ac13fae0 0x7f03ac0cb6f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f03940098e0 tx=0x7f03940091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:14.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.974+0000 7f03b21ff700 1 -- 172.21.15.71:0/1280715475 shutdown_connections 2023-10-09T06:43:14.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.974+0000 7f03b21ff700 1 --2- 172.21.15.71:0/1280715475 >> v2:172.21.15.179:3300/0 conn(0x7f03ac13f710 0x7f03ac069220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:14.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.974+0000 7f03b21ff700 1 --2- 172.21.15.71:0/1280715475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03ac13fae0 0x7f03ac0cb6f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:14.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.974+0000 7f03b21ff700 1 -- 172.21.15.71:0/1280715475 >> 172.21.15.71:0/1280715475 conn(0x7f03ac0c9860 msgr2=0x7f03ac0c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:14.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.974+0000 7f03b21ff700 1 -- 172.21.15.71:0/1280715475 shutdown_connections 2023-10-09T06:43:14.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.974+0000 7f03b21ff700 1 -- 172.21.15.71:0/1280715475 wait complete. 2023-10-09T06:43:14.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.976+0000 7f03b21ff700 1 Processor -- start 2023-10-09T06:43:14.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.976+0000 7f03b21ff700 1 -- start start 2023-10-09T06:43:14.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.977+0000 7f03b21ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03ac069760 0x7f03ac0b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:14.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.977+0000 7f03b21ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03ac13f710 0x7f03ac155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:14.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.977+0000 7f03b21ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03ac13fae0 0x7f03ac0ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:14.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.977+0000 7f03b21ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0b0e80 con 0x7f03ac13fae0 2023-10-09T06:43:14.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.977+0000 7f03b21ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0c6330 con 0x7f03ac13f710 2023-10-09T06:43:14.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.977+0000 7f03b21ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0a9970 con 0x7f03ac069760 2023-10-09T06:43:14.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.977+0000 7f03abfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03ac13fae0 0x7f03ac0ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:14.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.977+0000 7f03abfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03ac13fae0 0x7f03ac0ab8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40598/0 (socket says 172.21.15.71:40598) 2023-10-09T06:43:14.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.977+0000 7f03abfff700 1 -- 172.21.15.71:0/702424987 learned_addr learned my addr 172.21.15.71:0/702424987 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:14.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.977+0000 7f03a3fff700 1 --2- 172.21.15.71:0/702424987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03ac13f710 0x7f03ac155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:14.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.977+0000 7f03ab7fe700 1 --2- 172.21.15.71:0/702424987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03ac069760 0x7f03ac0b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:14.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.978+0000 7f03abfff700 1 -- 172.21.15.71:0/702424987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03ac069760 msgr2=0x7f03ac0b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:14.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.978+0000 7f03abfff700 1 --2- 172.21.15.71:0/702424987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03ac069760 0x7f03ac0b0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:14.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.978+0000 7f03abfff700 1 -- 172.21.15.71:0/702424987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03ac13f710 msgr2=0x7f03ac155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:14.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.978+0000 7f03abfff700 1 --2- 172.21.15.71:0/702424987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03ac13f710 0x7f03ac155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:14.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.978+0000 7f03abfff700 1 -- 172.21.15.71:0/702424987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0394009420 con 0x7f03ac13fae0 2023-10-09T06:43:14.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.978+0000 7f03abfff700 1 --2- 172.21.15.71:0/702424987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03ac13fae0 0x7f03ac0ab8a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f03a4001460 tx=0x7f03a4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:14.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.978+0000 7f03a37fe700 1 -- 172.21.15.71:0/702424987 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a400a890 con 0x7f03ac13fae0 2023-10-09T06:43:14.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.978+0000 7f03a37fe700 1 -- 172.21.15.71:0/702424987 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a400a9f0 con 0x7f03ac13fae0 2023-10-09T06:43:14.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.978+0000 7f03a37fe700 1 -- 172.21.15.71:0/702424987 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a400ad70 con 0x7f03ac13fae0 2023-10-09T06:43:14.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.978+0000 7f03b21ff700 1 -- 172.21.15.71:0/702424987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ac0a9c50 con 0x7f03ac13fae0 2023-10-09T06:43:14.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.978+0000 7f03b21ff700 1 -- 172.21.15.71:0/702424987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ac155e50 con 0x7f03ac13fae0 2023-10-09T06:43:14.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.979+0000 7f03b21ff700 1 -- 172.21.15.71:0/702424987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ac0aa170 con 0x7f03ac13fae0 2023-10-09T06:43:14.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.980+0000 7f03a37fe700 1 -- 172.21.15.71:0/702424987 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03a4007300 con 0x7f03ac13fae0 2023-10-09T06:43:14.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.981+0000 7f03a37fe700 1 --2- 172.21.15.71:0/702424987 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f038c066f30 0x7f038c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:14.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.981+0000 7f03a37fe700 1 -- 172.21.15.71:0/702424987 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f03a40849a0 con 0x7f03ac13fae0 2023-10-09T06:43:14.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.981+0000 7f03ab7fe700 1 --2- 172.21.15.71:0/702424987 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f038c066f30 0x7f038c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:14.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.982+0000 7f03ab7fe700 1 --2- 172.21.15.71:0/702424987 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f038c066f30 0x7f038c0693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f039c009db0 tx=0x7f039c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:14.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:14.985+0000 7f03a37fe700 1 -- 172.21.15.71:0/702424987 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03ac0aa170 con 0x7f03ac13fae0 2023-10-09T06:43:15.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.221+0000 7f03b21ff700 1 -- 172.21.15.71:0/702424987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03ac0aa170 con 0x7f03ac13fae0 2023-10-09T06:43:15.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.221+0000 7f03a37fe700 1 -- 172.21.15.71:0/702424987 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f03ac0aa170 con 0x7f03ac13fae0 2023-10-09T06:43:15.246 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:15.246 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3129948705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3129948705},{"type":"v1","addr":"172.21.15.71:6835","nonce":3129948705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2871867918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2871867918},{"type":"v1","addr":"172.21.15.71:6833","nonce":2871867918}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2975286987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2975286987},{"type":"v1","addr":"172.21.15.179:6836","nonce":2975286987}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:42:38.093747+0000","modified":"2023-10-09T06:42:41.642372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/3516898913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3516898913},{"type":"v1","addr":"172.21.15.179:6837","nonce":3516898913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T06:43:15.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.224+0000 7f03b21ff700 1 -- 172.21.15.71:0/702424987 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f038c066f30 msgr2=0x7f038c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:15.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.224+0000 7f03b21ff700 1 --2- 172.21.15.71:0/702424987 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f038c066f30 0x7f038c0693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f039c009db0 tx=0x7f039c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:15.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.224+0000 7f03b21ff700 1 -- 172.21.15.71:0/702424987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03ac13fae0 msgr2=0x7f03ac0ab8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:15.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.224+0000 7f03b21ff700 1 --2- 172.21.15.71:0/702424987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03ac13fae0 0x7f03ac0ab8a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f03a4001460 tx=0x7f03a4001ae0 comp rx=0 tx=0).stop 2023-10-09T06:43:15.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.224+0000 7f03b21ff700 1 -- 172.21.15.71:0/702424987 shutdown_connections 2023-10-09T06:43:15.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.224+0000 7f03b21ff700 1 --2- 172.21.15.71:0/702424987 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f038c066f30 0x7f038c0693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:15.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.224+0000 7f03b21ff700 1 --2- 172.21.15.71:0/702424987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03ac13fae0 0x7f03ac0ab8a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:15.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.224+0000 7f03b21ff700 1 --2- 172.21.15.71:0/702424987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03ac069760 0x7f03ac0b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:15.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.224+0000 7f03b21ff700 1 --2- 172.21.15.71:0/702424987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03ac13f710 0x7f03ac155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:15.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.224+0000 7f03b21ff700 1 -- 172.21.15.71:0/702424987 >> 172.21.15.71:0/702424987 conn(0x7f03ac0c9860 msgr2=0x7f03ac06dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:15.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.224+0000 7f03b21ff700 1 -- 172.21.15.71:0/702424987 shutdown_connections 2023-10-09T06:43:15.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.224+0000 7f03b21ff700 1 -- 172.21.15.71:0/702424987 wait complete. 2023-10-09T06:43:15.249 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2023-10-09T06:43:15.249 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:43:15.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.428+0000 7ff2b619d700 1 Processor -- start 2023-10-09T06:43:15.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.428+0000 7ff2b619d700 1 -- start start 2023-10-09T06:43:15.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.429+0000 7ff2b619d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2b0156310 0x7ff2b00c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:15.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.430+0000 7ff2b619d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b00ca860 con 0x7ff2b01566e0 2023-10-09T06:43:15.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.430+0000 7ff2b619d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b00cab40 con 0x7ff2b00ae710 2023-10-09T06:43:15.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.430+0000 7ff2b619d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b00cae20 con 0x7ff2b0156310 2023-10-09T06:43:15.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.430+0000 7ff2b499a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff2b01566e0 0x7ff2b00ae000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37770/0 (socket says 172.21.15.71:37770) 2023-10-09T06:43:15.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.430+0000 7ff2b499a700 1 -- 172.21.15.71:0/2083903652 learned_addr learned my addr 172.21.15.71:0/2083903652 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:15.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.430+0000 7ff2b519b700 1 --2- 172.21.15.71:0/2083903652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2b0156310 0x7ff2b00c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:15.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.430+0000 7ff2a7fff700 1 -- 172.21.15.71:0/2083903652 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2431773522 0 0) 0x7ff2b00ca860 con 0x7ff2b01566e0 2023-10-09T06:43:15.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.430+0000 7ff2a7fff700 1 -- 172.21.15.71:0/2083903652 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff29c003570 con 0x7ff2b01566e0 2023-10-09T06:43:15.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.430+0000 7ff2a7fff700 1 -- 172.21.15.71:0/2083903652 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828677406 0 0) 0x7ff2b00cab40 con 0x7ff2b00ae710 2023-10-09T06:43:15.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.431+0000 7ff2a7fff700 1 -- 172.21.15.71:0/2083903652 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2b00ca860 con 0x7ff2b00ae710 2023-10-09T06:43:15.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.431+0000 7ff2a7fff700 1 -- 172.21.15.71:0/2083903652 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 787389353 0 0) 0x7ff29c003570 con 0x7ff2b01566e0 2023-10-09T06:43:15.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.431+0000 7ff2a7fff700 1 -- 172.21.15.71:0/2083903652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2b0156310 msgr2=0x7ff2b00c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:15.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.431+0000 7ff2a7fff700 1 --2- 172.21.15.71:0/2083903652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2b0156310 0x7ff2b00c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:15.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.431+0000 7ff2a7fff700 1 -- 172.21.15.71:0/2083903652 >> v1:172.21.15.179:6789/0 conn(0x7ff2b00ae710 legacy=0x7ff2b00c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:15.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.431+0000 7ff2a7fff700 1 -- 172.21.15.71:0/2083903652 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b00cb100 con 0x7ff2b01566e0 2023-10-09T06:43:15.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.431+0000 7ff2a7fff700 1 -- 172.21.15.71:0/2083903652 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7ff2a0001470 con 0x7ff2b01566e0 2023-10-09T06:43:15.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.431+0000 7ff2a7fff700 1 -- 172.21.15.71:0/2083903652 >> v1:172.21.15.71:6789/0 conn(0x7ff2b01566e0 legacy=0x7ff2b00ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:15.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.431+0000 7ff2a7fff700 1 --2- 172.21.15.71:0/2083903652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff29c003c20 0x7ff29c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:15.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.431+0000 7ff2a7fff700 1 --2- 172.21.15.71:0/2083903652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2b0156310 0x7ff29c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:15.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.431+0000 7ff2a7fff700 1 --2- 172.21.15.71:0/2083903652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff29c004d50 0x7ff29c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:15.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.431+0000 7ff2a7fff700 1 -- 172.21.15.71:0/2083903652 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b00cae20 con 0x7ff29c004d50 2023-10-09T06:43:15.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.431+0000 7ff2a7fff700 1 -- 172.21.15.71:0/2083903652 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c00bbf0 con 0x7ff29c003c20 2023-10-09T06:43:15.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.431+0000 7ff2a7fff700 1 -- 172.21.15.71:0/2083903652 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c00bd60 con 0x7ff2b0156310 2023-10-09T06:43:15.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.431+0000 7ff2b519b700 1 --2- 172.21.15.71:0/2083903652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff29c003c20 0x7ff29c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:15.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.431+0000 7ff2b599c700 1 --2- 172.21.15.71:0/2083903652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff29c004d50 0x7ff29c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:15.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.431+0000 7ff2b499a700 1 --2- 172.21.15.71:0/2083903652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2b0156310 0x7ff29c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:15.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.431+0000 7ff2b519b700 1 -- 172.21.15.71:0/2083903652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2b0156310 msgr2=0x7ff29c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:15.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.431+0000 7ff2b519b700 1 --2- 172.21.15.71:0/2083903652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2b0156310 0x7ff29c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:15.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.431+0000 7ff2b519b700 1 -- 172.21.15.71:0/2083903652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff29c004d50 msgr2=0x7ff29c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:15.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.431+0000 7ff2b519b700 1 --2- 172.21.15.71:0/2083903652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff29c004d50 0x7ff29c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:15.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.431+0000 7ff2b519b700 1 -- 172.21.15.71:0/2083903652 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c003570 con 0x7ff29c003c20 2023-10-09T06:43:15.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.431+0000 7ff2b599c700 1 --2- 172.21.15.71:0/2083903652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff29c004d50 0x7ff29c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:43:15.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.432+0000 7ff2b519b700 1 --2- 172.21.15.71:0/2083903652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff29c003c20 0x7ff29c004010 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac006f00 tx=0x7ff2ac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4b209bb36753dc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:15.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.432+0000 7ff2a7fff700 1 -- 172.21.15.71:0/2083903652 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac00e710 con 0x7ff29c003c20 2023-10-09T06:43:15.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.432+0000 7ff2a7fff700 1 -- 172.21.15.71:0/2083903652 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ac00e870 con 0x7ff29c003c20 2023-10-09T06:43:15.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.432+0000 7ff2a7fff700 1 -- 172.21.15.71:0/2083903652 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac00ec30 con 0x7ff29c003c20 2023-10-09T06:43:15.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.432+0000 7ff2b619d700 1 -- 172.21.15.71:0/2083903652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff29c003c20 msgr2=0x7ff29c004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:15.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.432+0000 7ff2b619d700 1 --2- 172.21.15.71:0/2083903652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff29c003c20 0x7ff29c004010 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac006f00 tx=0x7ff2ac0091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:15.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.432+0000 7ff2b599c700 1 -- 172.21.15.71:0/2083903652 reap_dead start 2023-10-09T06:43:15.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.433+0000 7ff2b619d700 1 -- 172.21.15.71:0/2083903652 shutdown_connections 2023-10-09T06:43:15.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.433+0000 7ff2b619d700 1 -- 172.21.15.71:0/2083903652 >> 172.21.15.71:0/2083903652 conn(0x7ff2b00cc1f0 msgr2=0x7ff2b00cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:15.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.433+0000 7ff2b619d700 1 -- 172.21.15.71:0/2083903652 shutdown_connections 2023-10-09T06:43:15.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.433+0000 7ff2b619d700 1 -- 172.21.15.71:0/2083903652 wait complete. 2023-10-09T06:43:15.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.434+0000 7ff2b619d700 1 Processor -- start 2023-10-09T06:43:15.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.434+0000 7ff2b619d700 1 -- start start 2023-10-09T06:43:15.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.435+0000 7ff2b619d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff29c003c20 0x7ff2b01574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:15.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.435+0000 7ff2b619d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2b0167a10 0x7ff2b014b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:15.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.435+0000 7ff2b619d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2b0151b70 0x7ff2b00c1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:15.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.435+0000 7ff2b619d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b014be20 con 0x7ff29c003c20 2023-10-09T06:43:15.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.435+0000 7ff2b619d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b0152500 con 0x7ff2b0167a10 2023-10-09T06:43:15.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.435+0000 7ff2b619d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b0167fb0 con 0x7ff2b0151b70 2023-10-09T06:43:15.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.435+0000 7ff2b519b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff29c003c20 0x7ff2b01574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:15.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.435+0000 7ff2b519b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff29c003c20 0x7ff2b01574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52580/0 (socket says 172.21.15.71:52580) 2023-10-09T06:43:15.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.435+0000 7ff2b519b700 1 -- 172.21.15.71:0/222541904 learned_addr learned my addr 172.21.15.71:0/222541904 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:15.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.435+0000 7ff2b499a700 1 --2- 172.21.15.71:0/222541904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2b0167a10 0x7ff2b014b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:15.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.435+0000 7ff2b599c700 1 --2- 172.21.15.71:0/222541904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2b0151b70 0x7ff2b00c1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:15.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.436+0000 7ff2b519b700 1 -- 172.21.15.71:0/222541904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2b0151b70 msgr2=0x7ff2b00c1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:15.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.436+0000 7ff2b519b700 1 --2- 172.21.15.71:0/222541904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2b0151b70 0x7ff2b00c1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:15.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.436+0000 7ff2b519b700 1 -- 172.21.15.71:0/222541904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2b0167a10 msgr2=0x7ff2b014b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:15.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.436+0000 7ff2b519b700 1 --2- 172.21.15.71:0/222541904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2b0167a10 0x7ff2b014b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:15.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.436+0000 7ff2b519b700 1 -- 172.21.15.71:0/222541904 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b0168290 con 0x7ff29c003c20 2023-10-09T06:43:15.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.436+0000 7ff2b519b700 1 --2- 172.21.15.71:0/222541904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff29c003c20 0x7ff2b01574d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00e4b0 tx=0x7ff2ac01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:15.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.436+0000 7ff2a57fa700 1 -- 172.21.15.71:0/222541904 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac022070 con 0x7ff29c003c20 2023-10-09T06:43:15.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.436+0000 7ff2a57fa700 1 -- 172.21.15.71:0/222541904 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ac00e9e0 con 0x7ff29c003c20 2023-10-09T06:43:15.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.436+0000 7ff2b619d700 1 -- 172.21.15.71:0/222541904 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b0168570 con 0x7ff29c003c20 2023-10-09T06:43:15.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.436+0000 7ff2a57fa700 1 -- 172.21.15.71:0/222541904 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac00e710 con 0x7ff29c003c20 2023-10-09T06:43:15.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.436+0000 7ff2b619d700 1 -- 172.21.15.71:0/222541904 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b0152010 con 0x7ff29c003c20 2023-10-09T06:43:15.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.437+0000 7ff2b619d700 1 -- 172.21.15.71:0/222541904 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b004c3c0 con 0x7ff29c003c20 2023-10-09T06:43:15.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.438+0000 7ff2a57fa700 1 -- 172.21.15.71:0/222541904 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff2ac027680 con 0x7ff29c003c20 2023-10-09T06:43:15.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.439+0000 7ff2a57fa700 1 --2- 172.21.15.71:0/222541904 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff294066f30 0x7ff2940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:15.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.440+0000 7ff2a57fa700 1 -- 172.21.15.71:0/222541904 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff2ac085ec0 con 0x7ff29c003c20 2023-10-09T06:43:15.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.440+0000 7ff2b499a700 1 --2- 172.21.15.71:0/222541904 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff294066f30 0x7ff2940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:15.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.440+0000 7ff2b499a700 1 --2- 172.21.15.71:0/222541904 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff294066f30 0x7ff2940693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff2b00c1890 tx=0x7ff2a0001d20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:15.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.444+0000 7ff2a57fa700 1 -- 172.21.15.71:0/222541904 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2ac053140 con 0x7ff29c003c20 2023-10-09T06:43:15.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.636+0000 7ff2b619d700 1 -- 172.21.15.71:0/222541904 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2b0152850 con 0x7ff29c003c20 2023-10-09T06:43:15.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.637+0000 7ff2a57fa700 1 -- 172.21.15.71:0/222541904 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7ff2ac056760 con 0x7ff29c003c20 2023-10-09T06:43:15.637 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:15.637 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":20,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:42:39.546192+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:42:35.828340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:42:37.071896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:43:15.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.639+0000 7ff2b619d700 1 -- 172.21.15.71:0/222541904 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff294066f30 msgr2=0x7ff2940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:15.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.639+0000 7ff2b619d700 1 --2- 172.21.15.71:0/222541904 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff294066f30 0x7ff2940693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff2b00c1890 tx=0x7ff2a0001d20 comp rx=0 tx=0).stop 2023-10-09T06:43:15.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.639+0000 7ff2b619d700 1 -- 172.21.15.71:0/222541904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff29c003c20 msgr2=0x7ff2b01574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:15.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.639+0000 7ff2b619d700 1 --2- 172.21.15.71:0/222541904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff29c003c20 0x7ff2b01574d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00e4b0 tx=0x7ff2ac01a000 comp rx=0 tx=0).stop 2023-10-09T06:43:15.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.639+0000 7ff2b619d700 1 -- 172.21.15.71:0/222541904 shutdown_connections 2023-10-09T06:43:15.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.639+0000 7ff2b619d700 1 --2- 172.21.15.71:0/222541904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2b0151b70 0x7ff2b00c1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:15.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.639+0000 7ff2b619d700 1 --2- 172.21.15.71:0/222541904 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff294066f30 0x7ff2940693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:15.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.639+0000 7ff2b619d700 1 --2- 172.21.15.71:0/222541904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff29c003c20 0x7ff2b01574d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:15.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.639+0000 7ff2b619d700 1 --2- 172.21.15.71:0/222541904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2b0167a10 0x7ff2b014b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:15.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.639+0000 7ff2b619d700 1 -- 172.21.15.71:0/222541904 >> 172.21.15.71:0/222541904 conn(0x7ff2b00cc1f0 msgr2=0x7ff2b0069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:15.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.639+0000 7ff2b619d700 1 -- 172.21.15.71:0/222541904 shutdown_connections 2023-10-09T06:43:15.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.639+0000 7ff2b619d700 1 -- 172.21.15.71:0/222541904 wait complete. 2023-10-09T06:43:15.657 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:42:35.828340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:42:37.071896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:43:15.658 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:43:15.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.841+0000 7f05457ff700 1 Processor -- start 2023-10-09T06:43:15.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.841+0000 7f05457ff700 1 -- start start 2023-10-09T06:43:15.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.842+0000 7f05457ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f05400ccee0 0x7f05401561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:15.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.842+0000 7f05457ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f05400c87c0 0x7f0540156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:15.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.842+0000 7f05457ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054015b0d0 con 0x7f05400c83f0 2023-10-09T06:43:15.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.842+0000 7f05457ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0540156c50 con 0x7f05400ccee0 2023-10-09T06:43:15.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.842+0000 7f05457ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f054015a4c0 con 0x7f05400c87c0 2023-10-09T06:43:15.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.843+0000 7f053effd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f05400c83f0 0x7f05400c7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37774/0 (socket says 172.21.15.71:37774) 2023-10-09T06:43:15.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.843+0000 7f053effd700 1 -- 172.21.15.71:0/2725553038 learned_addr learned my addr 172.21.15.71:0/2725553038 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:15.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.843+0000 7f053e7fc700 1 --2- 172.21.15.71:0/2725553038 >> v2:172.21.15.71:3300/0 conn(0x7f05400ccee0 0x7f05401561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:15.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.843+0000 7f053f7fe700 1 --2- 172.21.15.71:0/2725553038 >> v2:172.21.15.179:3300/0 conn(0x7f05400c87c0 0x7f0540156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:15.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.843+0000 7f053dffb700 1 -- 172.21.15.71:0/2725553038 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241155165 0 0) 0x7f054015b0d0 con 0x7f05400c83f0 2023-10-09T06:43:15.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.843+0000 7f053dffb700 1 -- 172.21.15.71:0/2725553038 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0528003570 con 0x7f05400c83f0 2023-10-09T06:43:15.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.843+0000 7f053e7fc700 1 -- 172.21.15.71:0/2725553038 >> v2:172.21.15.179:3300/0 conn(0x7f05400c87c0 msgr2=0x7f0540156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:15.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.843+0000 7f053e7fc700 1 --2- 172.21.15.71:0/2725553038 >> v2:172.21.15.179:3300/0 conn(0x7f05400c87c0 0x7f0540156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:15.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.843+0000 7f053e7fc700 1 -- 172.21.15.71:0/2725553038 >> v1:172.21.15.71:6789/0 conn(0x7f05400c83f0 legacy=0x7f05400c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:15.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.843+0000 7f053e7fc700 1 -- 172.21.15.71:0/2725553038 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054015a7a0 con 0x7f05400ccee0 2023-10-09T06:43:15.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.843+0000 7f053e7fc700 1 --2- 172.21.15.71:0/2725553038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05400ccee0 0x7f05401561d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f054006d240 tx=0x7f05340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ebee8adb467b88 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:15.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.844+0000 7f053dffb700 1 -- 172.21.15.71:0/2725553038 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0534011630 con 0x7f05400ccee0 2023-10-09T06:43:15.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.844+0000 7f053dffb700 1 -- 172.21.15.71:0/2725553038 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0534011790 con 0x7f05400ccee0 2023-10-09T06:43:15.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.844+0000 7f053dffb700 1 -- 172.21.15.71:0/2725553038 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0534011b30 con 0x7f05400ccee0 2023-10-09T06:43:15.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.844+0000 7f05457ff700 1 -- 172.21.15.71:0/2725553038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05400ccee0 msgr2=0x7f05401561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:15.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.844+0000 7f05457ff700 1 --2- 172.21.15.71:0/2725553038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05400ccee0 0x7f05401561d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f054006d240 tx=0x7f05340091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:15.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.844+0000 7f05457ff700 1 -- 172.21.15.71:0/2725553038 shutdown_connections 2023-10-09T06:43:15.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.844+0000 7f05457ff700 1 --2- 172.21.15.71:0/2725553038 >> v2:172.21.15.179:3300/0 conn(0x7f05400c87c0 0x7f0540156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:15.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.844+0000 7f05457ff700 1 --2- 172.21.15.71:0/2725553038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05400ccee0 0x7f05401561d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:15.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.844+0000 7f05457ff700 1 -- 172.21.15.71:0/2725553038 >> 172.21.15.71:0/2725553038 conn(0x7f0540068e10 msgr2=0x7f05400cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:15.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.844+0000 7f05457ff700 1 -- 172.21.15.71:0/2725553038 shutdown_connections 2023-10-09T06:43:15.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.844+0000 7f05457ff700 1 -- 172.21.15.71:0/2725553038 wait complete. 2023-10-09T06:43:15.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.846+0000 7f05457ff700 1 Processor -- start 2023-10-09T06:43:15.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.846+0000 7f05457ff700 1 -- start start 2023-10-09T06:43:15.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.847+0000 7f05457ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05400c83f0 0x7f0540141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:15.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.847+0000 7f05457ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05400c87c0 0x7f054013eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:15.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.847+0000 7f05457ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05400ccee0 0x7f054013f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:15.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.847+0000 7f05457ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0540147d00 con 0x7f05400ccee0 2023-10-09T06:43:15.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.847+0000 7f05457ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0540147fe0 con 0x7f05400c87c0 2023-10-09T06:43:15.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.847+0000 7f05457ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05401482c0 con 0x7f05400c83f0 2023-10-09T06:43:15.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.847+0000 7f053f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05400ccee0 0x7f054013f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:15.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.847+0000 7f053f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05400ccee0 0x7f054013f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52604/0 (socket says 172.21.15.71:52604) 2023-10-09T06:43:15.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.847+0000 7f053f7fe700 1 -- 172.21.15.71:0/366845357 learned_addr learned my addr 172.21.15.71:0/366845357 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:15.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.847+0000 7f053e7fc700 1 --2- 172.21.15.71:0/366845357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05400c87c0 0x7f054013eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:15.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.847+0000 7f053effd700 1 --2- 172.21.15.71:0/366845357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05400c83f0 0x7f0540141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:15.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.847+0000 7f053f7fe700 1 -- 172.21.15.71:0/366845357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05400c83f0 msgr2=0x7f0540141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:15.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.847+0000 7f053f7fe700 1 --2- 172.21.15.71:0/366845357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05400c83f0 0x7f0540141fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:15.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.847+0000 7f053f7fe700 1 -- 172.21.15.71:0/366845357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05400c87c0 msgr2=0x7f054013eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:15.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.847+0000 7f053f7fe700 1 --2- 172.21.15.71:0/366845357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05400c87c0 0x7f054013eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:15.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.848+0000 7f053f7fe700 1 -- 172.21.15.71:0/366845357 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0534009420 con 0x7f05400ccee0 2023-10-09T06:43:15.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.848+0000 7f053effd700 1 --2- 172.21.15.71:0/366845357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05400c83f0 0x7f0540141fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:15.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.848+0000 7f053f7fe700 1 --2- 172.21.15.71:0/366845357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05400ccee0 0x7f054013f040 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0538009fa0 tx=0x7f0538009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:15.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.848+0000 7f0526ffd700 1 -- 172.21.15.71:0/366845357 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053800ed20 con 0x7f05400ccee0 2023-10-09T06:43:15.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.848+0000 7f0526ffd700 1 -- 172.21.15.71:0/366845357 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053800ee80 con 0x7f05400ccee0 2023-10-09T06:43:15.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.848+0000 7f05457ff700 1 -- 172.21.15.71:0/366845357 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05401485a0 con 0x7f05400ccee0 2023-10-09T06:43:15.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.848+0000 7f0526ffd700 1 -- 172.21.15.71:0/366845357 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538014670 con 0x7f05400ccee0 2023-10-09T06:43:15.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.848+0000 7f05457ff700 1 -- 172.21.15.71:0/366845357 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0540142520 con 0x7f05400ccee0 2023-10-09T06:43:15.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.849+0000 7f05457ff700 1 -- 172.21.15.71:0/366845357 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f054004c3c0 con 0x7f05400ccee0 2023-10-09T06:43:15.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.850+0000 7f0526ffd700 1 -- 172.21.15.71:0/366845357 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f05380149e0 con 0x7f05400ccee0 2023-10-09T06:43:15.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.851+0000 7f0526ffd700 1 --2- 172.21.15.71:0/366845357 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f052c066f30 0x7f052c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:15.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.851+0000 7f0526ffd700 1 -- 172.21.15.71:0/366845357 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0538084dc0 con 0x7f05400ccee0 2023-10-09T06:43:15.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.851+0000 7f053effd700 1 --2- 172.21.15.71:0/366845357 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f052c066f30 0x7f052c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:15.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.852+0000 7f053effd700 1 --2- 172.21.15.71:0/366845357 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f052c066f30 0x7f052c0693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0530007fd0 tx=0x7f0530009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:15.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:15.855+0000 7f0526ffd700 1 -- 172.21.15.71:0/366845357 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0538051f90 con 0x7f05400ccee0 2023-10-09T06:43:16.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.043+0000 7f05457ff700 1 -- 172.21.15.71:0/366845357 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f05400afa90 con 0x7f05400ccee0 2023-10-09T06:43:16.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.043+0000 7f0526ffd700 1 -- 172.21.15.71:0/366845357 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05380555b0 con 0x7f05400ccee0 2023-10-09T06:43:16.043 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T06:43:16.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.045+0000 7f05457ff700 1 -- 172.21.15.71:0/366845357 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f052c066f30 msgr2=0x7f052c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:16.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.045+0000 7f05457ff700 1 --2- 172.21.15.71:0/366845357 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f052c066f30 0x7f052c0693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0530007fd0 tx=0x7f0530009040 comp rx=0 tx=0).stop 2023-10-09T06:43:16.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.045+0000 7f05457ff700 1 -- 172.21.15.71:0/366845357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05400ccee0 msgr2=0x7f054013f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:16.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.045+0000 7f05457ff700 1 --2- 172.21.15.71:0/366845357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05400ccee0 0x7f054013f040 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0538009fa0 tx=0x7f0538009900 comp rx=0 tx=0).stop 2023-10-09T06:43:16.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.046+0000 7f05457ff700 1 -- 172.21.15.71:0/366845357 shutdown_connections 2023-10-09T06:43:16.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.046+0000 7f05457ff700 1 --2- 172.21.15.71:0/366845357 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f052c066f30 0x7f052c0693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.046+0000 7f05457ff700 1 --2- 172.21.15.71:0/366845357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05400ccee0 0x7f054013f040 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.046+0000 7f05457ff700 1 --2- 172.21.15.71:0/366845357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05400c83f0 0x7f0540141fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.046+0000 7f05457ff700 1 --2- 172.21.15.71:0/366845357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05400c87c0 0x7f054013eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.046+0000 7f05457ff700 1 -- 172.21.15.71:0/366845357 >> 172.21.15.71:0/366845357 conn(0x7f0540068e10 msgr2=0x7f0540155fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:16.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.046+0000 7f05457ff700 1 -- 172.21.15.71:0/366845357 shutdown_connections 2023-10-09T06:43:16.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.046+0000 7f05457ff700 1 -- 172.21.15.71:0/366845357 wait complete. 2023-10-09T06:43:16.063 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:43:16.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.247+0000 7fbc6dbff700 1 Processor -- start 2023-10-09T06:43:16.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.247+0000 7fbc6dbff700 1 -- start start 2023-10-09T06:43:16.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.248+0000 7fbc6dbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc68155eb0 0x7fbc6806e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:16.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.248+0000 7fbc6dbff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbc68069770 0x7fbc68069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:16.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.248+0000 7fbc6dbff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc68156320 con 0x7fbc680c70b0 2023-10-09T06:43:16.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.249+0000 7fbc6dbff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc680cd350 con 0x7fbc68069770 2023-10-09T06:43:16.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.249+0000 7fbc6dbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6806a130 con 0x7fbc68155eb0 2023-10-09T06:43:16.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.249+0000 7fbc677fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fbc680c70b0 0x7fbc680ccc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37790/0 (socket says 172.21.15.71:37790) 2023-10-09T06:43:16.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.249+0000 7fbc677fe700 1 -- 172.21.15.71:0/3853259743 learned_addr learned my addr 172.21.15.71:0/3853259743 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:16.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.249+0000 7fbc667fc700 1 -- 172.21.15.71:0/3853259743 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2324527566 0 0) 0x7fbc68156320 con 0x7fbc680c70b0 2023-10-09T06:43:16.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.249+0000 7fbc667fc700 1 -- 172.21.15.71:0/3853259743 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc50003570 con 0x7fbc680c70b0 2023-10-09T06:43:16.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.249+0000 7fbc67fff700 1 --2- 172.21.15.71:0/3853259743 >> v2:172.21.15.179:3300/0 conn(0x7fbc68069770 0x7fbc68069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:16.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.249+0000 7fbc66ffd700 1 --2- 172.21.15.71:0/3853259743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc68155eb0 0x7fbc6806e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:16.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.249+0000 7fbc667fc700 1 -- 172.21.15.71:0/3853259743 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4126295142 0 0) 0x7fbc50003570 con 0x7fbc680c70b0 2023-10-09T06:43:16.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.249+0000 7fbc667fc700 1 -- 172.21.15.71:0/3853259743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc68155eb0 msgr2=0x7fbc6806e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:16.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.249+0000 7fbc667fc700 1 --2- 172.21.15.71:0/3853259743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc68155eb0 0x7fbc6806e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.249+0000 7fbc667fc700 1 -- 172.21.15.71:0/3853259743 >> v2:172.21.15.179:3300/0 conn(0x7fbc68069770 msgr2=0x7fbc68069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:16.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.249+0000 7fbc667fc700 1 --2- 172.21.15.71:0/3853259743 >> v2:172.21.15.179:3300/0 conn(0x7fbc68069770 0x7fbc68069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.249+0000 7fbc667fc700 1 -- 172.21.15.71:0/3853259743 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6806eb90 con 0x7fbc680c70b0 2023-10-09T06:43:16.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.249+0000 7fbc667fc700 1 -- 172.21.15.71:0/3853259743 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fbc58001470 con 0x7fbc680c70b0 2023-10-09T06:43:16.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.250+0000 7fbc667fc700 1 -- 172.21.15.71:0/3853259743 >> v1:172.21.15.71:6789/0 conn(0x7fbc680c70b0 legacy=0x7fbc680ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:16.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.250+0000 7fbc667fc700 1 --2- 172.21.15.71:0/3853259743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc50003b10 0x7fbc50003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:16.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.250+0000 7fbc667fc700 1 --2- 172.21.15.71:0/3853259743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc68155eb0 0x7fbc50004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:16.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.250+0000 7fbc667fc700 1 --2- 172.21.15.71:0/3853259743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc50004d50 0x7fbc500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:16.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.250+0000 7fbc667fc700 1 -- 172.21.15.71:0/3853259743 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc680cd350 con 0x7fbc50003b10 2023-10-09T06:43:16.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.250+0000 7fbc667fc700 1 -- 172.21.15.71:0/3853259743 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6806a130 con 0x7fbc50004d50 2023-10-09T06:43:16.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.250+0000 7fbc667fc700 1 -- 172.21.15.71:0/3853259743 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5000dd50 con 0x7fbc68155eb0 2023-10-09T06:43:16.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.250+0000 7fbc677fe700 1 --2- 172.21.15.71:0/3853259743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc50003b10 0x7fbc50003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:16.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.250+0000 7fbc66ffd700 1 --2- 172.21.15.71:0/3853259743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc68155eb0 0x7fbc50004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:16.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.250+0000 7fbc67fff700 1 --2- 172.21.15.71:0/3853259743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc50004d50 0x7fbc500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:16.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.250+0000 7fbc677fe700 1 -- 172.21.15.71:0/3853259743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc68155eb0 msgr2=0x7fbc50004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:16.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.250+0000 7fbc677fe700 1 --2- 172.21.15.71:0/3853259743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc68155eb0 0x7fbc50004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.250+0000 7fbc677fe700 1 -- 172.21.15.71:0/3853259743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc50004d50 msgr2=0x7fbc500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:16.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.250+0000 7fbc677fe700 1 --2- 172.21.15.71:0/3853259743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc50004d50 0x7fbc500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.250+0000 7fbc677fe700 1 -- 172.21.15.71:0/3853259743 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc50003570 con 0x7fbc50003b10 2023-10-09T06:43:16.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.250+0000 7fbc67fff700 1 --2- 172.21.15.71:0/3853259743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc50004d50 0x7fbc500051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:16.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.251+0000 7fbc677fe700 1 --2- 172.21.15.71:0/3853259743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc50003b10 0x7fbc50003f20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800c2d0 tx=0x7fbc58001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d301018c8218c10a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:16.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.251+0000 7fbc667fc700 1 -- 172.21.15.71:0/3853259743 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5800cb40 con 0x7fbc50003b10 2023-10-09T06:43:16.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.251+0000 7fbc667fc700 1 -- 172.21.15.71:0/3853259743 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5800ccc0 con 0x7fbc50003b10 2023-10-09T06:43:16.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.251+0000 7fbc667fc700 1 -- 172.21.15.71:0/3853259743 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc58005b70 con 0x7fbc50003b10 2023-10-09T06:43:16.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.251+0000 7fbc6dbff700 1 -- 172.21.15.71:0/3853259743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc50003b10 msgr2=0x7fbc50003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:16.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.251+0000 7fbc6dbff700 1 --2- 172.21.15.71:0/3853259743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc50003b10 0x7fbc50003f20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800c2d0 tx=0x7fbc58001d80 comp rx=0 tx=0).stop 2023-10-09T06:43:16.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.251+0000 7fbc67fff700 1 -- 172.21.15.71:0/3853259743 reap_dead start 2023-10-09T06:43:16.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.251+0000 7fbc6dbff700 1 -- 172.21.15.71:0/3853259743 shutdown_connections 2023-10-09T06:43:16.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.251+0000 7fbc6dbff700 1 -- 172.21.15.71:0/3853259743 >> 172.21.15.71:0/3853259743 conn(0x7fbc68068e10 msgr2=0x7fbc680cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:16.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.251+0000 7fbc6dbff700 1 -- 172.21.15.71:0/3853259743 shutdown_connections 2023-10-09T06:43:16.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.251+0000 7fbc6dbff700 1 -- 172.21.15.71:0/3853259743 wait complete. 2023-10-09T06:43:16.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.253+0000 7fbc6dbff700 1 Processor -- start 2023-10-09T06:43:16.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.253+0000 7fbc6dbff700 1 -- start start 2023-10-09T06:43:16.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.254+0000 7fbc6dbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc50003b10 0x7fbc68153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:16.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.254+0000 7fbc6dbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc68166080 0x7fbc680b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:16.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.254+0000 7fbc6dbff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc68159b70 0x7fbc68159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:16.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.254+0000 7fbc6dbff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6815a530 con 0x7fbc68159b70 2023-10-09T06:43:16.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.254+0000 7fbc6dbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc680b0f60 con 0x7fbc50003b10 2023-10-09T06:43:16.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.254+0000 7fbc6dbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc68154520 con 0x7fbc68166080 2023-10-09T06:43:16.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.254+0000 7fbc67fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc68159b70 0x7fbc68159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:16.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.254+0000 7fbc67fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc68159b70 0x7fbc68159ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52622/0 (socket says 172.21.15.71:52622) 2023-10-09T06:43:16.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.254+0000 7fbc67fff700 1 -- 172.21.15.71:0/1118797697 learned_addr learned my addr 172.21.15.71:0/1118797697 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:16.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.254+0000 7fbc67fff700 1 -- 172.21.15.71:0/1118797697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc68166080 msgr2=0x7fbc680b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:16.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.254+0000 7fbc67fff700 1 --2- 172.21.15.71:0/1118797697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc68166080 0x7fbc680b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.254+0000 7fbc67fff700 1 -- 172.21.15.71:0/1118797697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc50003b10 msgr2=0x7fbc68153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:16.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.254+0000 7fbc67fff700 1 --2- 172.21.15.71:0/1118797697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc50003b10 0x7fbc68153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.254+0000 7fbc67fff700 1 -- 172.21.15.71:0/1118797697 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc68166500 con 0x7fbc68159b70 2023-10-09T06:43:16.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.255+0000 7fbc67fff700 1 --2- 172.21.15.71:0/1118797697 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc68159b70 0x7fbc68159ff0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbc680c8f70 tx=0x7fbc6000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:16.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.255+0000 7fbc4f7fe700 1 -- 172.21.15.71:0/1118797697 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6001b070 con 0x7fbc68159b70 2023-10-09T06:43:16.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.255+0000 7fbc4f7fe700 1 -- 172.21.15.71:0/1118797697 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6000f040 con 0x7fbc68159b70 2023-10-09T06:43:16.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.255+0000 7fbc4f7fe700 1 -- 172.21.15.71:0/1118797697 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6000e050 con 0x7fbc68159b70 2023-10-09T06:43:16.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.255+0000 7fbc6dbff700 1 -- 172.21.15.71:0/1118797697 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc681667e0 con 0x7fbc68159b70 2023-10-09T06:43:16.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.255+0000 7fbc6dbff700 1 -- 172.21.15.71:0/1118797697 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc68166da0 con 0x7fbc68159b70 2023-10-09T06:43:16.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.256+0000 7fbc6dbff700 1 -- 172.21.15.71:0/1118797697 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc6806d2a0 con 0x7fbc68159b70 2023-10-09T06:43:16.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.257+0000 7fbc4f7fe700 1 -- 172.21.15.71:0/1118797697 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc60003020 con 0x7fbc68159b70 2023-10-09T06:43:16.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.258+0000 7fbc4f7fe700 1 --2- 172.21.15.71:0/1118797697 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbc54066f30 0x7fbc540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:16.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.258+0000 7fbc4f7fe700 1 -- 172.21.15.71:0/1118797697 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbc60084a50 con 0x7fbc68159b70 2023-10-09T06:43:16.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.258+0000 7fbc677fe700 1 --2- 172.21.15.71:0/1118797697 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbc54066f30 0x7fbc540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:16.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.259+0000 7fbc677fe700 1 --2- 172.21.15.71:0/1118797697 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbc54066f30 0x7fbc540693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbc58000ff0 tx=0x7fbc58015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:16.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.262+0000 7fbc4f7fe700 1 -- 172.21.15.71:0/1118797697 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc60051c20 con 0x7fbc68159b70 2023-10-09T06:43:16.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.452+0000 7fbc6dbff700 1 -- 172.21.15.71:0/1118797697 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbc6804c3c0 con 0x7fbc68159b70 2023-10-09T06:43:16.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.453+0000 7fbc4f7fe700 1 -- 172.21.15.71:0/1118797697 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbc60055240 con 0x7fbc68159b70 2023-10-09T06:43:16.453 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-09T06:43:16.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.455+0000 7fbc6dbff700 1 -- 172.21.15.71:0/1118797697 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbc54066f30 msgr2=0x7fbc540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:16.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.455+0000 7fbc6dbff700 1 --2- 172.21.15.71:0/1118797697 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbc54066f30 0x7fbc540693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbc58000ff0 tx=0x7fbc58015000 comp rx=0 tx=0).stop 2023-10-09T06:43:16.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.455+0000 7fbc6dbff700 1 -- 172.21.15.71:0/1118797697 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc68159b70 msgr2=0x7fbc68159ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:16.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.455+0000 7fbc6dbff700 1 --2- 172.21.15.71:0/1118797697 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc68159b70 0x7fbc68159ff0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbc680c8f70 tx=0x7fbc6000b040 comp rx=0 tx=0).stop 2023-10-09T06:43:16.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.455+0000 7fbc6dbff700 1 -- 172.21.15.71:0/1118797697 shutdown_connections 2023-10-09T06:43:16.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.455+0000 7fbc6dbff700 1 --2- 172.21.15.71:0/1118797697 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbc54066f30 0x7fbc540693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.455+0000 7fbc6dbff700 1 --2- 172.21.15.71:0/1118797697 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc68159b70 0x7fbc68159ff0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.455+0000 7fbc6dbff700 1 --2- 172.21.15.71:0/1118797697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc50003b10 0x7fbc68153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.455+0000 7fbc6dbff700 1 --2- 172.21.15.71:0/1118797697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc68166080 0x7fbc680b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.455+0000 7fbc6dbff700 1 -- 172.21.15.71:0/1118797697 >> 172.21.15.71:0/1118797697 conn(0x7fbc68068e10 msgr2=0x7fbc680c20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:16.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.455+0000 7fbc6dbff700 1 -- 172.21.15.71:0/1118797697 shutdown_connections 2023-10-09T06:43:16.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.455+0000 7fbc6dbff700 1 -- 172.21.15.71:0/1118797697 wait complete. 2023-10-09T06:43:16.472 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:43:16.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.657+0000 7f466eb9d700 1 Processor -- start 2023-10-09T06:43:16.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.657+0000 7f466eb9d700 1 -- start start 2023-10-09T06:43:16.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.658+0000 7f466eb9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f46680b4e70 0x7f46680ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:16.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.658+0000 7f466eb9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46680cfb00 con 0x7f46680b16d0 2023-10-09T06:43:16.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.658+0000 7f466eb9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466815e060 con 0x7f46680b1b40 2023-10-09T06:43:16.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.658+0000 7f466eb9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46680b5c40 con 0x7f46680b4e70 2023-10-09T06:43:16.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.659+0000 7f466d39a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f46680b16d0 0x7f466815d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37804/0 (socket says 172.21.15.71:37804) 2023-10-09T06:43:16.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.659+0000 7f466d39a700 1 -- 172.21.15.71:0/1442239690 learned_addr learned my addr 172.21.15.71:0/1442239690 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:16.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.659+0000 7f466db9b700 1 --2- 172.21.15.71:0/1442239690 >> v2:172.21.15.179:3300/0 conn(0x7f46680b4e70 0x7f46680ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:16.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.659+0000 7f466cb99700 1 -- 172.21.15.71:0/1442239690 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369511760 0 0) 0x7f46680cfb00 con 0x7f46680b16d0 2023-10-09T06:43:16.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.659+0000 7f466cb99700 1 -- 172.21.15.71:0/1442239690 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4654003570 con 0x7f46680b16d0 2023-10-09T06:43:16.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.659+0000 7f466cb99700 1 -- 172.21.15.71:0/1442239690 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788464183 0 0) 0x7f466815e060 con 0x7f46680b1b40 2023-10-09T06:43:16.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.659+0000 7f466cb99700 1 -- 172.21.15.71:0/1442239690 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46680cfb00 con 0x7f46680b1b40 2023-10-09T06:43:16.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.659+0000 7f466cb99700 1 -- 172.21.15.71:0/1442239690 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1262068752 0 0) 0x7f4654003570 con 0x7f46680b16d0 2023-10-09T06:43:16.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.659+0000 7f466cb99700 1 -- 172.21.15.71:0/1442239690 >> v2:172.21.15.179:3300/0 conn(0x7f46680b4e70 msgr2=0x7f46680ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:16.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.659+0000 7f466cb99700 1 --2- 172.21.15.71:0/1442239690 >> v2:172.21.15.179:3300/0 conn(0x7f46680b4e70 0x7f46680ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.659+0000 7f466cb99700 1 -- 172.21.15.71:0/1442239690 >> v1:172.21.15.179:6789/0 conn(0x7f46680b1b40 legacy=0x7f466815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:16.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.659+0000 7f466cb99700 1 -- 172.21.15.71:0/1442239690 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46680b5f20 con 0x7f46680b16d0 2023-10-09T06:43:16.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.659+0000 7f466cb99700 1 -- 172.21.15.71:0/1442239690 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f4658001470 con 0x7f46680b16d0 2023-10-09T06:43:16.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.659+0000 7f466cb99700 1 -- 172.21.15.71:0/1442239690 >> v1:172.21.15.71:6789/0 conn(0x7f46680b16d0 legacy=0x7f466815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:16.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.659+0000 7f466cb99700 1 --2- 172.21.15.71:0/1442239690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4654003bf0 0x7f4654003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:16.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.659+0000 7f466cb99700 1 --2- 172.21.15.71:0/1442239690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4654004810 0x7f4654004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:16.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.659+0000 7f466cb99700 1 --2- 172.21.15.71:0/1442239690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46540051c0 0x7f465400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:16.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.659+0000 7f466cb99700 1 -- 172.21.15.71:0/1442239690 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46680b5c40 con 0x7f4654003bf0 2023-10-09T06:43:16.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.659+0000 7f466cb99700 1 -- 172.21.15.71:0/1442239690 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465400c160 con 0x7f46540051c0 2023-10-09T06:43:16.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.660+0000 7f466cb99700 1 -- 172.21.15.71:0/1442239690 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465400c320 con 0x7f4654004810 2023-10-09T06:43:16.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.660+0000 7f466db9b700 1 --2- 172.21.15.71:0/1442239690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4654003bf0 0x7f4654003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:16.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.660+0000 7f466e39c700 1 --2- 172.21.15.71:0/1442239690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46540051c0 0x7f465400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:16.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.660+0000 7f466d39a700 1 --2- 172.21.15.71:0/1442239690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4654004810 0x7f4654004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:16.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.660+0000 7f466db9b700 1 -- 172.21.15.71:0/1442239690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4654004810 msgr2=0x7f4654004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:16.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.660+0000 7f466db9b700 1 --2- 172.21.15.71:0/1442239690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4654004810 0x7f4654004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.660+0000 7f466db9b700 1 -- 172.21.15.71:0/1442239690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46540051c0 msgr2=0x7f465400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:16.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.660+0000 7f466db9b700 1 --2- 172.21.15.71:0/1442239690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46540051c0 0x7f465400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.660+0000 7f466db9b700 1 -- 172.21.15.71:0/1442239690 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4654003570 con 0x7f4654003bf0 2023-10-09T06:43:16.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.660+0000 7f466e39c700 1 --2- 172.21.15.71:0/1442239690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46540051c0 0x7f465400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:16.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.660+0000 7f466e39c700 1 -- 172.21.15.71:0/1442239690 reap_dead start 2023-10-09T06:43:16.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.660+0000 7f466db9b700 1 --2- 172.21.15.71:0/1442239690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4654003bf0 0x7f4654003fe0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4664006f00 tx=0x7f46640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c79a5235aac3bce server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:16.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.660+0000 7f466cb99700 1 -- 172.21.15.71:0/1442239690 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466400e710 con 0x7f4654003bf0 2023-10-09T06:43:16.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.661+0000 7f466cb99700 1 -- 172.21.15.71:0/1442239690 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466400e870 con 0x7f4654003bf0 2023-10-09T06:43:16.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.661+0000 7f466cb99700 1 -- 172.21.15.71:0/1442239690 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466400ec30 con 0x7f4654003bf0 2023-10-09T06:43:16.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.661+0000 7f466eb9d700 1 -- 172.21.15.71:0/1442239690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4654003bf0 msgr2=0x7f4654003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:16.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.661+0000 7f466eb9d700 1 --2- 172.21.15.71:0/1442239690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4654003bf0 0x7f4654003fe0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4664006f00 tx=0x7f46640091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.661+0000 7f466eb9d700 1 -- 172.21.15.71:0/1442239690 shutdown_connections 2023-10-09T06:43:16.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.661+0000 7f466eb9d700 1 --2- 172.21.15.71:0/1442239690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4654003bf0 0x7f4654003fe0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.661+0000 7f466eb9d700 1 -- 172.21.15.71:0/1442239690 >> 172.21.15.71:0/1442239690 conn(0x7f46680d10c0 msgr2=0x7f46680affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:16.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.661+0000 7f466eb9d700 1 -- 172.21.15.71:0/1442239690 shutdown_connections 2023-10-09T06:43:16.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.661+0000 7f466eb9d700 1 -- 172.21.15.71:0/1442239690 wait complete. 2023-10-09T06:43:16.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.663+0000 7f466eb9d700 1 Processor -- start 2023-10-09T06:43:16.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.663+0000 7f466eb9d700 1 -- start start 2023-10-09T06:43:16.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.664+0000 7f466eb9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4654003bf0 0x7f46681490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:16.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.664+0000 7f466eb9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4668149b00 0x7f46680c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:16.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.664+0000 7f466eb9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46680c7d30 0x7f46680ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:16.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.664+0000 7f466eb9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46681495e0 con 0x7f4668149b00 2023-10-09T06:43:16.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.664+0000 7f466eb9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46680c82d0 con 0x7f4654003bf0 2023-10-09T06:43:16.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.664+0000 7f466eb9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46680c85b0 con 0x7f46680c7d30 2023-10-09T06:43:16.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.664+0000 7f466d39a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4668149b00 0x7f46680c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:16.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.664+0000 7f466d39a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4668149b00 0x7f46680c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52646/0 (socket says 172.21.15.71:52646) 2023-10-09T06:43:16.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.664+0000 7f466d39a700 1 -- 172.21.15.71:0/238978231 learned_addr learned my addr 172.21.15.71:0/238978231 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:16.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.664+0000 7f466db9b700 1 --2- 172.21.15.71:0/238978231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4654003bf0 0x7f46681490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:16.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.664+0000 7f466e39c700 1 --2- 172.21.15.71:0/238978231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46680c7d30 0x7f46680ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:16.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.664+0000 7f466d39a700 1 -- 172.21.15.71:0/238978231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46680c7d30 msgr2=0x7f46680ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:16.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.664+0000 7f466d39a700 1 --2- 172.21.15.71:0/238978231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46680c7d30 0x7f46680ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.664+0000 7f466d39a700 1 -- 172.21.15.71:0/238978231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4654003bf0 msgr2=0x7f46681490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:16.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.664+0000 7f466d39a700 1 --2- 172.21.15.71:0/238978231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4654003bf0 0x7f46681490a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.665+0000 7f466d39a700 1 -- 172.21.15.71:0/238978231 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46680c8890 con 0x7f4668149b00 2023-10-09T06:43:16.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.665+0000 7f466d39a700 1 --2- 172.21.15.71:0/238978231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4668149b00 0x7f46680c6700 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f465800e810 tx=0x7f4658000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:16.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.665+0000 7f465dffb700 1 -- 172.21.15.71:0/238978231 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4658012590 con 0x7f4668149b00 2023-10-09T06:43:16.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.665+0000 7f465dffb700 1 -- 172.21.15.71:0/238978231 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46580126f0 con 0x7f4668149b00 2023-10-09T06:43:16.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.665+0000 7f465dffb700 1 -- 172.21.15.71:0/238978231 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4658012ab0 con 0x7f4668149b00 2023-10-09T06:43:16.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.665+0000 7f466eb9d700 1 -- 172.21.15.71:0/238978231 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46680c8b70 con 0x7f4668149b00 2023-10-09T06:43:16.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.665+0000 7f466eb9d700 1 -- 172.21.15.71:0/238978231 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46680c6c40 con 0x7f4668149b00 2023-10-09T06:43:16.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.666+0000 7f466eb9d700 1 -- 172.21.15.71:0/238978231 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4668088990 con 0x7f4668149b00 2023-10-09T06:43:16.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.667+0000 7f465dffb700 1 -- 172.21.15.71:0/238978231 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f465801d460 con 0x7f4668149b00 2023-10-09T06:43:16.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.668+0000 7f465dffb700 1 --2- 172.21.15.71:0/238978231 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f464c066f30 0x7f464c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:16.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.668+0000 7f465dffb700 1 -- 172.21.15.71:0/238978231 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4658084320 con 0x7f4668149b00 2023-10-09T06:43:16.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.668+0000 7f466db9b700 1 --2- 172.21.15.71:0/238978231 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f464c066f30 0x7f464c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:16.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.669+0000 7f466db9b700 1 --2- 172.21.15.71:0/238978231 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f464c066f30 0x7f464c0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f46640091e0 tx=0x7f466401a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:16.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.672+0000 7f465dffb700 1 -- 172.21.15.71:0/238978231 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46580515b0 con 0x7f4668149b00 2023-10-09T06:43:16.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.863+0000 7f466eb9d700 1 -- 172.21.15.71:0/238978231 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f46680ccb80 con 0x7f4668149b00 2023-10-09T06:43:16.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.863+0000 7f465dffb700 1 -- 172.21.15.71:0/238978231 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4658054bd0 con 0x7f4668149b00 2023-10-09T06:43:16.863 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-09T06:43:16.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.866+0000 7f466eb9d700 1 -- 172.21.15.71:0/238978231 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f464c066f30 msgr2=0x7f464c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:16.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.866+0000 7f466eb9d700 1 --2- 172.21.15.71:0/238978231 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f464c066f30 0x7f464c0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f46640091e0 tx=0x7f466401a000 comp rx=0 tx=0).stop 2023-10-09T06:43:16.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.866+0000 7f466eb9d700 1 -- 172.21.15.71:0/238978231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4668149b00 msgr2=0x7f46680c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:16.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.866+0000 7f466eb9d700 1 --2- 172.21.15.71:0/238978231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4668149b00 0x7f46680c6700 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f465800e810 tx=0x7f4658000bc0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.866+0000 7f466eb9d700 1 -- 172.21.15.71:0/238978231 shutdown_connections 2023-10-09T06:43:16.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.866+0000 7f466eb9d700 1 --2- 172.21.15.71:0/238978231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46680c7d30 0x7f46680ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.866+0000 7f466eb9d700 1 --2- 172.21.15.71:0/238978231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4654003bf0 0x7f46681490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.866+0000 7f466eb9d700 1 --2- 172.21.15.71:0/238978231 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f464c066f30 0x7f464c0693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.866+0000 7f466eb9d700 1 --2- 172.21.15.71:0/238978231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4668149b00 0x7f46680c6700 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:16.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.866+0000 7f466eb9d700 1 -- 172.21.15.71:0/238978231 >> 172.21.15.71:0/238978231 conn(0x7f46680d10c0 msgr2=0x7f4668069250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:16.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.866+0000 7f466eb9d700 1 -- 172.21.15.71:0/238978231 shutdown_connections 2023-10-09T06:43:16.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:16.866+0000 7f466eb9d700 1 -- 172.21.15.71:0/238978231 wait complete. 2023-10-09T06:43:16.883 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:43:17.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.064+0000 7f9778f9d700 1 Processor -- start 2023-10-09T06:43:17.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.064+0000 7f9778f9d700 1 -- start start 2023-10-09T06:43:17.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.066+0000 7f9778f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9774156310 0x7f97740c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:17.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.066+0000 7f9778f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f97740ae710 0x7f97740c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:17.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.066+0000 7f9778f9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97740ca860 con 0x7f97741566e0 2023-10-09T06:43:17.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.066+0000 7f9778f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97740cab40 con 0x7f97740ae710 2023-10-09T06:43:17.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.066+0000 7f9778f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97740cae20 con 0x7f9774156310 2023-10-09T06:43:17.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.066+0000 7f9772ffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f97741566e0 0x7f97740ae000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37816/0 (socket says 172.21.15.71:37816) 2023-10-09T06:43:17.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.066+0000 7f9772ffd700 1 -- 172.21.15.71:0/3767103305 learned_addr learned my addr 172.21.15.71:0/3767103305 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:17.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.066+0000 7f97737fe700 1 --2- 172.21.15.71:0/3767103305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9774156310 0x7f97740c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:17.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.066+0000 7f9773fff700 1 --2- 172.21.15.71:0/3767103305 >> v2:172.21.15.179:3300/0 conn(0x7f97740ae710 0x7f97740c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:17.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.066+0000 7f97727fc700 1 -- 172.21.15.71:0/3767103305 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254858193 0 0) 0x7f97740ca860 con 0x7f97741566e0 2023-10-09T06:43:17.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.066+0000 7f97727fc700 1 -- 172.21.15.71:0/3767103305 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f975c003570 con 0x7f97741566e0 2023-10-09T06:43:17.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.067+0000 7f97727fc700 1 -- 172.21.15.71:0/3767103305 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2274198510 0 0) 0x7f975c003570 con 0x7f97741566e0 2023-10-09T06:43:17.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.067+0000 7f9773fff700 1 -- 172.21.15.71:0/3767103305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9774156310 msgr2=0x7f97740c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:17.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.067+0000 7f9773fff700 1 --2- 172.21.15.71:0/3767103305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9774156310 0x7f97740c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.067+0000 7f9773fff700 1 -- 172.21.15.71:0/3767103305 >> v1:172.21.15.71:6789/0 conn(0x7f97741566e0 legacy=0x7f97740ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:17.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.067+0000 7f9773fff700 1 -- 172.21.15.71:0/3767103305 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97740cb100 con 0x7f97740ae710 2023-10-09T06:43:17.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.067+0000 7f9773fff700 1 --2- 172.21.15.71:0/3767103305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97740ae710 0x7f97740c6830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f976c009e60 tx=0x7f976c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb31480bd420cb44 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:17.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.067+0000 7f97727fc700 1 -- 172.21.15.71:0/3767103305 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c00e070 con 0x7f97740ae710 2023-10-09T06:43:17.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.067+0000 7f97727fc700 1 -- 172.21.15.71:0/3767103305 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c00b7a0 con 0x7f97740ae710 2023-10-09T06:43:17.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.067+0000 7f97727fc700 1 -- 172.21.15.71:0/3767103305 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768001470 con 0x7f97740ae710 2023-10-09T06:43:17.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.068+0000 7f9778f9d700 1 -- 172.21.15.71:0/3767103305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97740ae710 msgr2=0x7f97740c6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:17.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.068+0000 7f9778f9d700 1 --2- 172.21.15.71:0/3767103305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97740ae710 0x7f97740c6830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f976c009e60 tx=0x7f976c009780 comp rx=0 tx=0).stop 2023-10-09T06:43:17.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.068+0000 7f9778f9d700 1 -- 172.21.15.71:0/3767103305 shutdown_connections 2023-10-09T06:43:17.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.068+0000 7f9778f9d700 1 --2- 172.21.15.71:0/3767103305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97740ae710 0x7f97740c6830 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.068+0000 7f9778f9d700 1 --2- 172.21.15.71:0/3767103305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9774156310 0x7f97740c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.068+0000 7f9778f9d700 1 -- 172.21.15.71:0/3767103305 >> 172.21.15.71:0/3767103305 conn(0x7f97740cc1f0 msgr2=0x7f97740cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:17.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.068+0000 7f9778f9d700 1 -- 172.21.15.71:0/3767103305 shutdown_connections 2023-10-09T06:43:17.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.068+0000 7f9778f9d700 1 -- 172.21.15.71:0/3767103305 wait complete. 2023-10-09T06:43:17.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.069+0000 7f9778f9d700 1 Processor -- start 2023-10-09T06:43:17.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.069+0000 7f9778f9d700 1 -- start start 2023-10-09T06:43:17.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.070+0000 7f9778f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97740ae710 0x7f977413d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:17.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.070+0000 7f9778f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9774156310 0x7f97740c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:17.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.070+0000 7f9778f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97741566e0 0x7f97740c26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:17.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.070+0000 7f9778f9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9774140460 con 0x7f9774156310 2023-10-09T06:43:17.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.070+0000 7f9778f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977413f850 con 0x7f97741566e0 2023-10-09T06:43:17.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.070+0000 7f9778f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977413fb30 con 0x7f97740ae710 2023-10-09T06:43:17.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.070+0000 7f9772ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9774156310 0x7f97740c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:17.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.070+0000 7f9772ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9774156310 0x7f97740c21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52648/0 (socket says 172.21.15.71:52648) 2023-10-09T06:43:17.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.070+0000 7f9772ffd700 1 -- 172.21.15.71:0/1012180801 learned_addr learned my addr 172.21.15.71:0/1012180801 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:17.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.071+0000 7f9773fff700 1 --2- 172.21.15.71:0/1012180801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97741566e0 0x7f97740c26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:17.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.071+0000 7f97737fe700 1 --2- 172.21.15.71:0/1012180801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97740ae710 0x7f977413d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:17.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.071+0000 7f9772ffd700 1 -- 172.21.15.71:0/1012180801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97740ae710 msgr2=0x7f977413d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:17.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.071+0000 7f9772ffd700 1 --2- 172.21.15.71:0/1012180801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97740ae710 0x7f977413d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.071+0000 7f9772ffd700 1 -- 172.21.15.71:0/1012180801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97741566e0 msgr2=0x7f97740c26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:17.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.071+0000 7f9772ffd700 1 --2- 172.21.15.71:0/1012180801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97741566e0 0x7f97740c26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.071+0000 7f9772ffd700 1 -- 172.21.15.71:0/1012180801 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c009a20 con 0x7f9774156310 2023-10-09T06:43:17.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.071+0000 7f97737fe700 1 --2- 172.21.15.71:0/1012180801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97740ae710 0x7f977413d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:17.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.071+0000 7f9773fff700 1 --2- 172.21.15.71:0/1012180801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97741566e0 0x7f97740c26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:17.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.071+0000 7f9772ffd700 1 --2- 172.21.15.71:0/1012180801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9774156310 0x7f97740c21b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f97680011e0 tx=0x7f9768001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:17.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.071+0000 7f975b7fe700 1 -- 172.21.15.71:0/1012180801 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768005b30 con 0x7f9774156310 2023-10-09T06:43:17.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.071+0000 7f975b7fe700 1 -- 172.21.15.71:0/1012180801 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9768005cb0 con 0x7f9774156310 2023-10-09T06:43:17.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.071+0000 7f975b7fe700 1 -- 172.21.15.71:0/1012180801 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768007340 con 0x7f9774156310 2023-10-09T06:43:17.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.071+0000 7f9778f9d700 1 -- 172.21.15.71:0/1012180801 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977413fe10 con 0x7f9774156310 2023-10-09T06:43:17.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.071+0000 7f9778f9d700 1 -- 172.21.15.71:0/1012180801 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97741408f0 con 0x7f9774156310 2023-10-09T06:43:17.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.072+0000 7f9778f9d700 1 -- 172.21.15.71:0/1012180801 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97741405d0 con 0x7f9774156310 2023-10-09T06:43:17.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.073+0000 7f975b7fe700 1 -- 172.21.15.71:0/1012180801 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f976800a420 con 0x7f9774156310 2023-10-09T06:43:17.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.074+0000 7f975b7fe700 1 --2- 172.21.15.71:0/1012180801 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9760066f30 0x7f97600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:17.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.074+0000 7f975b7fe700 1 -- 172.21.15.71:0/1012180801 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f97680842c0 con 0x7f9774156310 2023-10-09T06:43:17.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.074+0000 7f97737fe700 1 --2- 172.21.15.71:0/1012180801 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9760066f30 0x7f97600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:17.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.075+0000 7f97737fe700 1 --2- 172.21.15.71:0/1012180801 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9760066f30 0x7f97600693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9764006f00 tx=0x7f9764008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:17.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.078+0000 7f975b7fe700 1 -- 172.21.15.71:0/1012180801 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97680515b0 con 0x7f9774156310 2023-10-09T06:43:17.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.311+0000 7f9778f9d700 1 -- 172.21.15.71:0/1012180801 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f977404c3c0 con 0x7f9774156310 2023-10-09T06:43:17.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.312+0000 7f975b7fe700 1 -- 172.21.15.71:0/1012180801 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f9768054bd0 con 0x7f9774156310 2023-10-09T06:43:17.312 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:17.312 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3129948705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3129948705},{"type":"v1","addr":"172.21.15.71:6835","nonce":3129948705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2871867918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2871867918},{"type":"v1","addr":"172.21.15.71:6833","nonce":2871867918}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2975286987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2975286987},{"type":"v1","addr":"172.21.15.179:6836","nonce":2975286987}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:42:38.093747+0000","modified":"2023-10-09T06:42:41.642372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/3516898913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3516898913},{"type":"v1","addr":"172.21.15.179:6837","nonce":3516898913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T06:43:17.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.314+0000 7f9778f9d700 1 -- 172.21.15.71:0/1012180801 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9760066f30 msgr2=0x7f97600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:17.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.314+0000 7f9778f9d700 1 --2- 172.21.15.71:0/1012180801 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9760066f30 0x7f97600693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9764006f00 tx=0x7f9764008040 comp rx=0 tx=0).stop 2023-10-09T06:43:17.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.314+0000 7f9778f9d700 1 -- 172.21.15.71:0/1012180801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9774156310 msgr2=0x7f97740c21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:17.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.314+0000 7f9778f9d700 1 --2- 172.21.15.71:0/1012180801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9774156310 0x7f97740c21b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f97680011e0 tx=0x7f9768001a10 comp rx=0 tx=0).stop 2023-10-09T06:43:17.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.315+0000 7f9778f9d700 1 -- 172.21.15.71:0/1012180801 shutdown_connections 2023-10-09T06:43:17.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.315+0000 7f9778f9d700 1 --2- 172.21.15.71:0/1012180801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97741566e0 0x7f97740c26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.315+0000 7f9778f9d700 1 --2- 172.21.15.71:0/1012180801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97740ae710 0x7f977413d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.315+0000 7f9778f9d700 1 --2- 172.21.15.71:0/1012180801 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9760066f30 0x7f97600693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.315+0000 7f9778f9d700 1 --2- 172.21.15.71:0/1012180801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9774156310 0x7f97740c21b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.315+0000 7f9778f9d700 1 -- 172.21.15.71:0/1012180801 >> 172.21.15.71:0/1012180801 conn(0x7f97740cc1f0 msgr2=0x7f97740c0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.315+0000 7f9778f9d700 1 -- 172.21.15.71:0/1012180801 shutdown_connections 2023-10-09T06:43:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.315+0000 7f9778f9d700 1 -- 172.21.15.71:0/1012180801 wait complete. 2023-10-09T06:43:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2023-10-09T06:43:17.332 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:43:17.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.514+0000 7fb940dff700 1 Processor -- start 2023-10-09T06:43:17.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.514+0000 7fb940dff700 1 -- start start 2023-10-09T06:43:17.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.515+0000 7fb940dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb93c155c10 0x7fb93c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:17.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.515+0000 7fb940dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c0ac230 0x7fb93c0ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:17.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.516+0000 7fb940dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93c0ad930 con 0x7fb93c1568a0 2023-10-09T06:43:17.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.516+0000 7fb940dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb93c0acd20 con 0x7fb93c155c10 2023-10-09T06:43:17.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.516+0000 7fb940dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c0ad000 con 0x7fb93c0ac230 2023-10-09T06:43:17.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.516+0000 7fb93a59c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb93c155c10 0x7fb93c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:17.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.516+0000 7fb939d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c0ac230 0x7fb93c0ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:17.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.516+0000 7fb93ad9d700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb93c1568a0 0x7fb93c156cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:55024/0 (socket says 172.21.15.71:55024) 2023-10-09T06:43:17.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.516+0000 7fb93ad9d700 1 -- 172.21.15.71:0/3800129470 learned_addr learned my addr 172.21.15.71:0/3800129470 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:17.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.516+0000 7fb93a59c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb93c155c10 0x7fb93c155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:43534/0 (socket says 172.21.15.71:43534) 2023-10-09T06:43:17.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.516+0000 7fb93959a700 1 -- 172.21.15.71:0/3800129470 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347859777 0 0) 0x7fb93c0ad930 con 0x7fb93c1568a0 2023-10-09T06:43:17.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.516+0000 7fb93959a700 1 -- 172.21.15.71:0/3800129470 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb924003570 con 0x7fb93c1568a0 2023-10-09T06:43:17.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.517+0000 7fb939d9b700 1 -- 172.21.15.71:0/3800129470 >> v2:172.21.15.179:3300/0 conn(0x7fb93c155c10 msgr2=0x7fb93c155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:17.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.517+0000 7fb939d9b700 1 --2- 172.21.15.71:0/3800129470 >> v2:172.21.15.179:3300/0 conn(0x7fb93c155c10 0x7fb93c155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.517+0000 7fb939d9b700 1 -- 172.21.15.71:0/3800129470 >> v1:172.21.15.179:6789/0 conn(0x7fb93c1568a0 legacy=0x7fb93c156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:17.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.517+0000 7fb939d9b700 1 -- 172.21.15.71:0/3800129470 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93c0ad2e0 con 0x7fb93c0ac230 2023-10-09T06:43:17.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.517+0000 7fb93a59c700 1 --2- 172.21.15.71:0/3800129470 >> v2:172.21.15.179:3300/0 conn(0x7fb93c155c10 0x7fb93c155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:43:17.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.517+0000 7fb939d9b700 1 --2- 172.21.15.71:0/3800129470 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c0ac230 0x7fb93c0ac6a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb9300098e0 tx=0x7fb9300091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60294e0deee32348 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:17.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.517+0000 7fb93959a700 1 -- 172.21.15.71:0/3800129470 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb930011630 con 0x7fb93c0ac230 2023-10-09T06:43:17.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.517+0000 7fb93959a700 1 -- 172.21.15.71:0/3800129470 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb930011790 con 0x7fb93c0ac230 2023-10-09T06:43:17.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.517+0000 7fb93959a700 1 -- 172.21.15.71:0/3800129470 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb930011b30 con 0x7fb93c0ac230 2023-10-09T06:43:17.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.518+0000 7fb940dff700 1 -- 172.21.15.71:0/3800129470 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c0ac230 msgr2=0x7fb93c0ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:17.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.518+0000 7fb940dff700 1 --2- 172.21.15.71:0/3800129470 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c0ac230 0x7fb93c0ac6a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb9300098e0 tx=0x7fb9300091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.518+0000 7fb940dff700 1 -- 172.21.15.71:0/3800129470 shutdown_connections 2023-10-09T06:43:17.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.518+0000 7fb940dff700 1 --2- 172.21.15.71:0/3800129470 >> v2:172.21.15.179:3300/0 conn(0x7fb93c155c10 0x7fb93c155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.518+0000 7fb940dff700 1 --2- 172.21.15.71:0/3800129470 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c0ac230 0x7fb93c0ac6a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.518+0000 7fb940dff700 1 -- 172.21.15.71:0/3800129470 >> 172.21.15.71:0/3800129470 conn(0x7fb93c06a320 msgr2=0x7fb93c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:17.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.518+0000 7fb940dff700 1 -- 172.21.15.71:0/3800129470 shutdown_connections 2023-10-09T06:43:17.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.518+0000 7fb940dff700 1 -- 172.21.15.71:0/3800129470 wait complete. 2023-10-09T06:43:17.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.520+0000 7fb940dff700 1 Processor -- start 2023-10-09T06:43:17.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.520+0000 7fb940dff700 1 -- start start 2023-10-09T06:43:17.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.521+0000 7fb940dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c0ac230 0x7fb93c1409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:17.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.521+0000 7fb940dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb93c155c10 0x7fb93c156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:17.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.521+0000 7fb940dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb93c1568a0 0x7fb93c0aac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:17.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.521+0000 7fb940dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c150cc0 con 0x7fb93c155c10 2023-10-09T06:43:17.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.521+0000 7fb940dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c157360 con 0x7fb93c1568a0 2023-10-09T06:43:17.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.521+0000 7fb940dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c150f60 con 0x7fb93c0ac230 2023-10-09T06:43:17.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.521+0000 7fb939d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb93c155c10 0x7fb93c156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:17.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.521+0000 7fb939d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb93c155c10 0x7fb93c156e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52652/0 (socket says 172.21.15.71:52652) 2023-10-09T06:43:17.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.521+0000 7fb939d9b700 1 -- 172.21.15.71:0/3258480626 learned_addr learned my addr 172.21.15.71:0/3258480626 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:17.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.521+0000 7fb93a59c700 1 --2- 172.21.15.71:0/3258480626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c0ac230 0x7fb93c1409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:17.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.521+0000 7fb93ad9d700 1 --2- 172.21.15.71:0/3258480626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb93c1568a0 0x7fb93c0aac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:17.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.521+0000 7fb939d9b700 1 -- 172.21.15.71:0/3258480626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c0ac230 msgr2=0x7fb93c1409f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:17.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.521+0000 7fb939d9b700 1 --2- 172.21.15.71:0/3258480626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c0ac230 0x7fb93c1409f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.521+0000 7fb939d9b700 1 -- 172.21.15.71:0/3258480626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb93c1568a0 msgr2=0x7fb93c0aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:17.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.521+0000 7fb939d9b700 1 --2- 172.21.15.71:0/3258480626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb93c1568a0 0x7fb93c0aac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.521+0000 7fb939d9b700 1 -- 172.21.15.71:0/3258480626 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb92c00b6d0 con 0x7fb93c155c10 2023-10-09T06:43:17.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.521+0000 7fb93a59c700 1 --2- 172.21.15.71:0/3258480626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c0ac230 0x7fb93c1409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:17.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.522+0000 7fb939d9b700 1 --2- 172.21.15.71:0/3258480626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb93c155c10 0x7fb93c156e20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb930009ed0 tx=0x7fb930017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:17.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.522+0000 7fb92a7fc700 1 -- 172.21.15.71:0/3258480626 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb930011b10 con 0x7fb93c155c10 2023-10-09T06:43:17.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.522+0000 7fb92a7fc700 1 -- 172.21.15.71:0/3258480626 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9300253f0 con 0x7fb93c155c10 2023-10-09T06:43:17.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.522+0000 7fb92a7fc700 1 -- 172.21.15.71:0/3258480626 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb930025790 con 0x7fb93c155c10 2023-10-09T06:43:17.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.522+0000 7fb940dff700 1 -- 172.21.15.71:0/3258480626 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb930009420 con 0x7fb93c155c10 2023-10-09T06:43:17.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.522+0000 7fb940dff700 1 -- 172.21.15.71:0/3258480626 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93c151520 con 0x7fb93c155c10 2023-10-09T06:43:17.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.523+0000 7fb940dff700 1 -- 172.21.15.71:0/3258480626 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb93c04c3c0 con 0x7fb93c155c10 2023-10-09T06:43:17.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.524+0000 7fb92a7fc700 1 -- 172.21.15.71:0/3258480626 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb930025b80 con 0x7fb93c155c10 2023-10-09T06:43:17.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.525+0000 7fb92a7fc700 1 --2- 172.21.15.71:0/3258480626 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb91c066f30 0x7fb91c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:17.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.525+0000 7fb92a7fc700 1 -- 172.21.15.71:0/3258480626 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb930085f50 con 0x7fb93c155c10 2023-10-09T06:43:17.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.525+0000 7fb93a59c700 1 --2- 172.21.15.71:0/3258480626 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb91c066f30 0x7fb91c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:17.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.526+0000 7fb93a59c700 1 --2- 172.21.15.71:0/3258480626 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb91c066f30 0x7fb91c0693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00bf80 tx=0x7fb92c00b430 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:17.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.528+0000 7fb92a7fc700 1 -- 172.21.15.71:0/3258480626 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb930053120 con 0x7fb93c155c10 2023-10-09T06:43:17.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.725+0000 7fb940dff700 1 -- 172.21.15.71:0/3258480626 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb93c0ad5c0 con 0x7fb93c155c10 2023-10-09T06:43:17.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.726+0000 7fb92a7fc700 1 -- 172.21.15.71:0/3258480626 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fb930056740 con 0x7fb93c155c10 2023-10-09T06:43:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:17.726 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":20,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:42:39.546192+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:42:35.828340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:42:37.071896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:43:17.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.728+0000 7fb940dff700 1 -- 172.21.15.71:0/3258480626 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb91c066f30 msgr2=0x7fb91c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:17.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.728+0000 7fb940dff700 1 --2- 172.21.15.71:0/3258480626 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb91c066f30 0x7fb91c0693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00bf80 tx=0x7fb92c00b430 comp rx=0 tx=0).stop 2023-10-09T06:43:17.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.728+0000 7fb940dff700 1 -- 172.21.15.71:0/3258480626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb93c155c10 msgr2=0x7fb93c156e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:17.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.728+0000 7fb940dff700 1 --2- 172.21.15.71:0/3258480626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb93c155c10 0x7fb93c156e20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb930009ed0 tx=0x7fb930017000 comp rx=0 tx=0).stop 2023-10-09T06:43:17.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.729+0000 7fb940dff700 1 -- 172.21.15.71:0/3258480626 shutdown_connections 2023-10-09T06:43:17.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.729+0000 7fb940dff700 1 --2- 172.21.15.71:0/3258480626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb93c1568a0 0x7fb93c0aac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.729+0000 7fb940dff700 1 --2- 172.21.15.71:0/3258480626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c0ac230 0x7fb93c1409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.729+0000 7fb940dff700 1 --2- 172.21.15.71:0/3258480626 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb91c066f30 0x7fb91c0693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.729+0000 7fb940dff700 1 --2- 172.21.15.71:0/3258480626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb93c155c10 0x7fb93c156e20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.729+0000 7fb940dff700 1 -- 172.21.15.71:0/3258480626 >> 172.21.15.71:0/3258480626 conn(0x7fb93c06a320 msgr2=0x7fb93c06e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:17.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.729+0000 7fb940dff700 1 -- 172.21.15.71:0/3258480626 shutdown_connections 2023-10-09T06:43:17.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.729+0000 7fb940dff700 1 -- 172.21.15.71:0/3258480626 wait complete. 2023-10-09T06:43:17.746 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T06:43:17.746 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:43:17.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.927+0000 7f01ebfff700 1 Processor -- start 2023-10-09T06:43:17.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.927+0000 7f01ebfff700 1 -- start start 2023-10-09T06:43:17.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.928+0000 7f01ebfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f01ec150550 0x7f01ec157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:17.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.928+0000 7f01ebfff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ec06e2a0 con 0x7f01ec150180 2023-10-09T06:43:17.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.928+0000 7f01ebfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ec06b2e0 con 0x7f01ec0c7410 2023-10-09T06:43:17.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.928+0000 7f01ebfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ec0c78e0 con 0x7f01ec150550 2023-10-09T06:43:17.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.928+0000 7f01eaffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f01ec150180 0x7f01ec0c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37818/0 (socket says 172.21.15.71:37818) 2023-10-09T06:43:17.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.928+0000 7f01eaffd700 1 -- 172.21.15.71:0/514940457 learned_addr learned my addr 172.21.15.71:0/514940457 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:17.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.929+0000 7f01ea7fc700 1 --2- 172.21.15.71:0/514940457 >> v2:172.21.15.179:3300/0 conn(0x7f01ec150550 0x7f01ec157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:17.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.929+0000 7f01e9ffb700 1 -- 172.21.15.71:0/514940457 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230384002 0 0) 0x7f01ec06e2a0 con 0x7f01ec150180 2023-10-09T06:43:17.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.929+0000 7f01e9ffb700 1 -- 172.21.15.71:0/514940457 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01d4003570 con 0x7f01ec150180 2023-10-09T06:43:17.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.929+0000 7f01e9ffb700 1 -- 172.21.15.71:0/514940457 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 351975780 0 0) 0x7f01d4003570 con 0x7f01ec150180 2023-10-09T06:43:17.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.929+0000 7f01e9ffb700 1 -- 172.21.15.71:0/514940457 >> v2:172.21.15.179:3300/0 conn(0x7f01ec150550 msgr2=0x7f01ec157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:17.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.929+0000 7f01e9ffb700 1 --2- 172.21.15.71:0/514940457 >> v2:172.21.15.179:3300/0 conn(0x7f01ec150550 0x7f01ec157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.929+0000 7f01e9ffb700 1 -- 172.21.15.71:0/514940457 >> v1:172.21.15.179:6789/0 conn(0x7f01ec0c7410 legacy=0x7f01ec069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:17.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.929+0000 7f01e9ffb700 1 -- 172.21.15.71:0/514940457 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec0c7bc0 con 0x7f01ec150180 2023-10-09T06:43:17.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.929+0000 7f01e9ffb700 1 -- 172.21.15.71:0/514940457 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f01dc001470 con 0x7f01ec150180 2023-10-09T06:43:17.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.929+0000 7f01e9ffb700 1 -- 172.21.15.71:0/514940457 >> v1:172.21.15.71:6789/0 conn(0x7f01ec150180 legacy=0x7f01ec0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:17.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.929+0000 7f01e9ffb700 1 --2- 172.21.15.71:0/514940457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01d4003ab0 0x7f01d4003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:17.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.929+0000 7f01e9ffb700 1 --2- 172.21.15.71:0/514940457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01d4004810 0x7f01d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:17.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.929+0000 7f01e9ffb700 1 --2- 172.21.15.71:0/514940457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01d4005210 0x7f01d400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:17.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.929+0000 7f01e9ffb700 1 -- 172.21.15.71:0/514940457 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec0c78e0 con 0x7f01d4003ab0 2023-10-09T06:43:17.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.929+0000 7f01e9ffb700 1 -- 172.21.15.71:0/514940457 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d400c130 con 0x7f01d4005210 2023-10-09T06:43:17.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.929+0000 7f01e9ffb700 1 -- 172.21.15.71:0/514940457 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d400c2f0 con 0x7f01d4004810 2023-10-09T06:43:17.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.930+0000 7f01eaffd700 1 --2- 172.21.15.71:0/514940457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01d4003ab0 0x7f01d4003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:17.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.930+0000 7f01ea7fc700 1 --2- 172.21.15.71:0/514940457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01d4004810 0x7f01d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:17.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.930+0000 7f01eb7fe700 1 --2- 172.21.15.71:0/514940457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01d4005210 0x7f01d400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:17.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.930+0000 7f01eaffd700 1 -- 172.21.15.71:0/514940457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01d4004810 msgr2=0x7f01d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:17.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.930+0000 7f01eaffd700 1 --2- 172.21.15.71:0/514940457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01d4004810 0x7f01d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.930+0000 7f01eaffd700 1 -- 172.21.15.71:0/514940457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01d4005210 msgr2=0x7f01d400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:17.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.930+0000 7f01eaffd700 1 --2- 172.21.15.71:0/514940457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01d4005210 0x7f01d400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.930+0000 7f01eaffd700 1 -- 172.21.15.71:0/514940457 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d4003570 con 0x7f01d4003ab0 2023-10-09T06:43:17.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.930+0000 7f01eb7fe700 1 -- 172.21.15.71:0/514940457 reap_dead start 2023-10-09T06:43:17.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.930+0000 7f01eaffd700 1 --2- 172.21.15.71:0/514940457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01d4003ab0 0x7f01d4003ec0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00c2d0 tx=0x7f01dc001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa80f03e64634f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:17.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.930+0000 7f01e9ffb700 1 -- 172.21.15.71:0/514940457 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc00cba0 con 0x7f01d4003ab0 2023-10-09T06:43:17.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.930+0000 7f01e9ffb700 1 -- 172.21.15.71:0/514940457 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01dc00cd20 con 0x7f01d4003ab0 2023-10-09T06:43:17.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.930+0000 7f01e9ffb700 1 -- 172.21.15.71:0/514940457 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc005b70 con 0x7f01d4003ab0 2023-10-09T06:43:17.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.931+0000 7f01ebfff700 1 -- 172.21.15.71:0/514940457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01d4003ab0 msgr2=0x7f01d4003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:17.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.931+0000 7f01ebfff700 1 --2- 172.21.15.71:0/514940457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01d4003ab0 0x7f01d4003ec0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00c2d0 tx=0x7f01dc001d80 comp rx=0 tx=0).stop 2023-10-09T06:43:17.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.931+0000 7f01ebfff700 1 -- 172.21.15.71:0/514940457 shutdown_connections 2023-10-09T06:43:17.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.931+0000 7f01ebfff700 1 --2- 172.21.15.71:0/514940457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01d4003ab0 0x7f01d4003ec0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.931+0000 7f01ebfff700 1 -- 172.21.15.71:0/514940457 >> 172.21.15.71:0/514940457 conn(0x7f01ec0cc1f0 msgr2=0x7f01ec0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:17.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.931+0000 7f01ebfff700 1 -- 172.21.15.71:0/514940457 shutdown_connections 2023-10-09T06:43:17.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.931+0000 7f01ebfff700 1 -- 172.21.15.71:0/514940457 wait complete. 2023-10-09T06:43:17.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.933+0000 7f01ebfff700 1 Processor -- start 2023-10-09T06:43:17.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.933+0000 7f01ebfff700 1 -- start start 2023-10-09T06:43:17.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.933+0000 7f01ebfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01d4003ab0 0x7f01ec14ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:17.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.933+0000 7f01ebfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ec159ef0 0x7f01ec15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:17.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.934+0000 7f01ebfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01ec157c10 0x7f01ec1580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:17.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.934+0000 7f01ebfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec1585f0 con 0x7f01d4003ab0 2023-10-09T06:43:17.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.934+0000 7f01ebfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec168af0 con 0x7f01ec157c10 2023-10-09T06:43:17.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.934+0000 7f01ebfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec168dd0 con 0x7f01ec159ef0 2023-10-09T06:43:17.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.934+0000 7f01eaffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01d4003ab0 0x7f01ec14ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:17.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.934+0000 7f01eaffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01d4003ab0 0x7f01ec14ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52662/0 (socket says 172.21.15.71:52662) 2023-10-09T06:43:17.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.934+0000 7f01eaffd700 1 -- 172.21.15.71:0/835608922 learned_addr learned my addr 172.21.15.71:0/835608922 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:17.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.934+0000 7f01eaffd700 1 -- 172.21.15.71:0/835608922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ec159ef0 msgr2=0x7f01ec15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:17.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.934+0000 7f01eaffd700 1 --2- 172.21.15.71:0/835608922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ec159ef0 0x7f01ec15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.934+0000 7f01eaffd700 1 -- 172.21.15.71:0/835608922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01ec157c10 msgr2=0x7f01ec1580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:17.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.934+0000 7f01eaffd700 1 --2- 172.21.15.71:0/835608922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01ec157c10 0x7f01ec1580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:17.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.934+0000 7f01eaffd700 1 -- 172.21.15.71:0/835608922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec1690b0 con 0x7f01d4003ab0 2023-10-09T06:43:17.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.934+0000 7f01eaffd700 1 --2- 172.21.15.71:0/835608922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01d4003ab0 0x7f01ec14ae70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00c8c0 tx=0x7f01dc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:17.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.935+0000 7f01d2ffd700 1 -- 172.21.15.71:0/835608922 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc004e70 con 0x7f01d4003ab0 2023-10-09T06:43:17.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.935+0000 7f01d2ffd700 1 -- 172.21.15.71:0/835608922 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01dc00ce90 con 0x7f01d4003ab0 2023-10-09T06:43:17.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.935+0000 7f01d2ffd700 1 -- 172.21.15.71:0/835608922 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc007530 con 0x7f01d4003ab0 2023-10-09T06:43:17.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.935+0000 7f01ebfff700 1 -- 172.21.15.71:0/835608922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ec169390 con 0x7f01d4003ab0 2023-10-09T06:43:17.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.935+0000 7f01ebfff700 1 -- 172.21.15.71:0/835608922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ec169950 con 0x7f01d4003ab0 2023-10-09T06:43:17.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.936+0000 7f01ebfff700 1 -- 172.21.15.71:0/835608922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ec04c3c0 con 0x7f01d4003ab0 2023-10-09T06:43:17.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.936+0000 7f01d2ffd700 1 -- 172.21.15.71:0/835608922 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f01dc012400 con 0x7f01d4003ab0 2023-10-09T06:43:17.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.937+0000 7f01d2ffd700 1 --2- 172.21.15.71:0/835608922 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f01d8066f20 0x7f01d80693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:17.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.938+0000 7f01d2ffd700 1 -- 172.21.15.71:0/835608922 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f01dc084d90 con 0x7f01d4003ab0 2023-10-09T06:43:17.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.938+0000 7f01ea7fc700 1 --2- 172.21.15.71:0/835608922 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f01d8066f20 0x7f01d80693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:17.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.939+0000 7f01ea7fc700 1 --2- 172.21.15.71:0/835608922 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f01d8066f20 0x7f01d80693d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0c13a0 tx=0x7f01e00091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:17.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:17.941+0000 7f01d2ffd700 1 -- 172.21.15.71:0/835608922 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01dc052010 con 0x7f01d4003ab0 2023-10-09T06:43:18.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.178+0000 7f01ebfff700 1 -- 172.21.15.71:0/835608922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01ec06ada0 con 0x7f01d4003ab0 2023-10-09T06:43:18.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.178+0000 7f01d2ffd700 1 -- 172.21.15.71:0/835608922 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f01dc055630 con 0x7f01d4003ab0 2023-10-09T06:43:18.178 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:18.178 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3129948705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3129948705},{"type":"v1","addr":"172.21.15.71:6835","nonce":3129948705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2871867918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2871867918},{"type":"v1","addr":"172.21.15.71:6833","nonce":2871867918}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2975286987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2975286987},{"type":"v1","addr":"172.21.15.179:6836","nonce":2975286987}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:42:38.093747+0000","modified":"2023-10-09T06:42:41.642372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/3516898913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3516898913},{"type":"v1","addr":"172.21.15.179:6837","nonce":3516898913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T06:43:18.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.180+0000 7f01ebfff700 1 -- 172.21.15.71:0/835608922 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f01d8066f20 msgr2=0x7f01d80693d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:18.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.180+0000 7f01ebfff700 1 --2- 172.21.15.71:0/835608922 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f01d8066f20 0x7f01d80693d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0c13a0 tx=0x7f01e00091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.180+0000 7f01ebfff700 1 -- 172.21.15.71:0/835608922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01d4003ab0 msgr2=0x7f01ec14ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:18.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.180+0000 7f01ebfff700 1 --2- 172.21.15.71:0/835608922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01d4003ab0 0x7f01ec14ae70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00c8c0 tx=0x7f01dc015000 comp rx=0 tx=0).stop 2023-10-09T06:43:18.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.180+0000 7f01ebfff700 1 -- 172.21.15.71:0/835608922 shutdown_connections 2023-10-09T06:43:18.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.180+0000 7f01ebfff700 1 --2- 172.21.15.71:0/835608922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01ec157c10 0x7f01ec1580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.180+0000 7f01ebfff700 1 --2- 172.21.15.71:0/835608922 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f01d8066f20 0x7f01d80693d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.180+0000 7f01ebfff700 1 --2- 172.21.15.71:0/835608922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01d4003ab0 0x7f01ec14ae70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.180+0000 7f01ebfff700 1 --2- 172.21.15.71:0/835608922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ec159ef0 0x7f01ec15a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.180+0000 7f01ebfff700 1 -- 172.21.15.71:0/835608922 >> 172.21.15.71:0/835608922 conn(0x7f01ec0cc1f0 msgr2=0x7f01ec0c8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:18.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.181+0000 7f01ebfff700 1 -- 172.21.15.71:0/835608922 shutdown_connections 2023-10-09T06:43:18.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.181+0000 7f01ebfff700 1 -- 172.21.15.71:0/835608922 wait complete. 2023-10-09T06:43:18.182 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2023-10-09T06:43:18.198 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:43:18.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.378+0000 7faa68b9d700 1 Processor -- start 2023-10-09T06:43:18.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.378+0000 7faa68b9d700 1 -- start start 2023-10-09T06:43:18.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.379+0000 7faa68b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7faa641593b0 0x7faa64159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:18.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.379+0000 7faa68b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa640ceaa0 0x7faa640b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:18.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.379+0000 7faa68b9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faa640b1740 0x7faa640b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:18.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.379+0000 7faa68b9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa640b2100 con 0x7faa640b1740 2023-10-09T06:43:18.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.379+0000 7faa68b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa640b6570 con 0x7faa641593b0 2023-10-09T06:43:18.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.379+0000 7faa68b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa640cfe20 con 0x7faa640ceaa0 2023-10-09T06:43:18.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.379+0000 7faa63fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faa640b1740 0x7faa640b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:18.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.379+0000 7faa63fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faa640b1740 0x7faa640b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52674/0 (socket says 172.21.15.71:52674) 2023-10-09T06:43:18.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.379+0000 7faa63fff700 1 -- 172.21.15.71:0/230884211 learned_addr learned my addr 172.21.15.71:0/230884211 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:18.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.379+0000 7faa637fe700 1 --2- 172.21.15.71:0/230884211 >> v2:172.21.15.179:3300/0 conn(0x7faa641593b0 0x7faa64159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:18.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.379+0000 7faa62ffd700 1 --2- 172.21.15.71:0/230884211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa640ceaa0 0x7faa640b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:18.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.380+0000 7faa63fff700 1 -- 172.21.15.71:0/230884211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa640ceaa0 msgr2=0x7faa640b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:18.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.380+0000 7faa63fff700 1 --2- 172.21.15.71:0/230884211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa640ceaa0 0x7faa640b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.380+0000 7faa63fff700 1 -- 172.21.15.71:0/230884211 >> v2:172.21.15.179:3300/0 conn(0x7faa641593b0 msgr2=0x7faa64159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:18.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.380+0000 7faa63fff700 1 --2- 172.21.15.71:0/230884211 >> v2:172.21.15.179:3300/0 conn(0x7faa641593b0 0x7faa64159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.380+0000 7faa63fff700 1 -- 172.21.15.71:0/230884211 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa640cf210 con 0x7faa640b1740 2023-10-09T06:43:18.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.380+0000 7faa63fff700 1 --2- 172.21.15.71:0/230884211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa640b1740 0x7faa640b1bc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faa64070d60 tx=0x7faa5c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeafaa1ce2d7ca5a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:18.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.380+0000 7faa627fc700 1 -- 172.21.15.71:0/230884211 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c00e070 con 0x7faa640b1740 2023-10-09T06:43:18.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.380+0000 7faa627fc700 1 -- 172.21.15.71:0/230884211 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5c00b970 con 0x7faa640b1740 2023-10-09T06:43:18.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.380+0000 7faa627fc700 1 -- 172.21.15.71:0/230884211 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c0092e0 con 0x7faa640b1740 2023-10-09T06:43:18.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.381+0000 7faa68b9d700 1 -- 172.21.15.71:0/230884211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa640b1740 msgr2=0x7faa640b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:18.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.381+0000 7faa68b9d700 1 --2- 172.21.15.71:0/230884211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa640b1740 0x7faa640b1bc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faa64070d60 tx=0x7faa5c009840 comp rx=0 tx=0).stop 2023-10-09T06:43:18.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.381+0000 7faa68b9d700 1 -- 172.21.15.71:0/230884211 shutdown_connections 2023-10-09T06:43:18.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.381+0000 7faa68b9d700 1 --2- 172.21.15.71:0/230884211 >> v2:172.21.15.179:3300/0 conn(0x7faa641593b0 0x7faa64159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.381+0000 7faa68b9d700 1 --2- 172.21.15.71:0/230884211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa640b1740 0x7faa640b1bc0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.381+0000 7faa68b9d700 1 --2- 172.21.15.71:0/230884211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa640ceaa0 0x7faa640b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.381+0000 7faa68b9d700 1 -- 172.21.15.71:0/230884211 >> 172.21.15.71:0/230884211 conn(0x7faa640d1130 msgr2=0x7faa640b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:18.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.381+0000 7faa68b9d700 1 -- 172.21.15.71:0/230884211 shutdown_connections 2023-10-09T06:43:18.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.381+0000 7faa68b9d700 1 -- 172.21.15.71:0/230884211 wait complete. 2023-10-09T06:43:18.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.382+0000 7faa68b9d700 1 Processor -- start 2023-10-09T06:43:18.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.383+0000 7faa68b9d700 1 -- start start 2023-10-09T06:43:18.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.383+0000 7faa68b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa640b1740 0x7faa64069720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:18.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.383+0000 7faa68b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa640ceaa0 0x7faa641560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:18.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.383+0000 7faa68b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa641593b0 0x7faa6415e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:18.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.383+0000 7faa68b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa64068390 con 0x7faa640ceaa0 2023-10-09T06:43:18.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.383+0000 7faa68b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa64068630 con 0x7faa641593b0 2023-10-09T06:43:18.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.383+0000 7faa68b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa64068910 con 0x7faa640b1740 2023-10-09T06:43:18.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.384+0000 7faa62ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa640ceaa0 0x7faa641560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:18.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.384+0000 7faa62ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa640ceaa0 0x7faa641560b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52678/0 (socket says 172.21.15.71:52678) 2023-10-09T06:43:18.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.384+0000 7faa62ffd700 1 -- 172.21.15.71:0/1994767501 learned_addr learned my addr 172.21.15.71:0/1994767501 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:18.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.384+0000 7faa63fff700 1 --2- 172.21.15.71:0/1994767501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa641593b0 0x7faa6415e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:18.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.384+0000 7faa637fe700 1 --2- 172.21.15.71:0/1994767501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa640b1740 0x7faa64069720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:18.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.384+0000 7faa62ffd700 1 -- 172.21.15.71:0/1994767501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa640b1740 msgr2=0x7faa64069720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:18.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.384+0000 7faa62ffd700 1 --2- 172.21.15.71:0/1994767501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa640b1740 0x7faa64069720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.384+0000 7faa62ffd700 1 -- 172.21.15.71:0/1994767501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa641593b0 msgr2=0x7faa6415e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:18.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.384+0000 7faa62ffd700 1 --2- 172.21.15.71:0/1994767501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa641593b0 0x7faa6415e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.384+0000 7faa62ffd700 1 -- 172.21.15.71:0/1994767501 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5c009ae0 con 0x7faa640ceaa0 2023-10-09T06:43:18.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.384+0000 7faa62ffd700 1 --2- 172.21.15.71:0/1994767501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa640ceaa0 0x7faa641560b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faa5800ec80 tx=0x7faa580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:18.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.385+0000 7faa4b7fe700 1 -- 172.21.15.71:0/1994767501 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5800c850 con 0x7faa640ceaa0 2023-10-09T06:43:18.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.385+0000 7faa4b7fe700 1 -- 172.21.15.71:0/1994767501 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5800c9d0 con 0x7faa640ceaa0 2023-10-09T06:43:18.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.385+0000 7faa68b9d700 1 -- 172.21.15.71:0/1994767501 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa64068bf0 con 0x7faa640ceaa0 2023-10-09T06:43:18.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.385+0000 7faa4b7fe700 1 -- 172.21.15.71:0/1994767501 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5800cd90 con 0x7faa640ceaa0 2023-10-09T06:43:18.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.385+0000 7faa68b9d700 1 -- 172.21.15.71:0/1994767501 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa64069c60 con 0x7faa640ceaa0 2023-10-09T06:43:18.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.386+0000 7faa68b9d700 1 -- 172.21.15.71:0/1994767501 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa64069110 con 0x7faa640ceaa0 2023-10-09T06:43:18.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.387+0000 7faa4b7fe700 1 -- 172.21.15.71:0/1994767501 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa58013680 con 0x7faa640ceaa0 2023-10-09T06:43:18.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.387+0000 7faa4b7fe700 1 --2- 172.21.15.71:0/1994767501 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faa50066f30 0x7faa500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:18.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.388+0000 7faa4b7fe700 1 -- 172.21.15.71:0/1994767501 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faa58084800 con 0x7faa640ceaa0 2023-10-09T06:43:18.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.388+0000 7faa637fe700 1 --2- 172.21.15.71:0/1994767501 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faa50066f30 0x7faa500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:18.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.389+0000 7faa637fe700 1 --2- 172.21.15.71:0/1994767501 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faa50066f30 0x7faa500693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faa54009d10 tx=0x7faa540091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:18.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.392+0000 7faa4b7fe700 1 -- 172.21.15.71:0/1994767501 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa64069110 con 0x7faa640ceaa0 2023-10-09T06:43:18.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.630+0000 7faa68b9d700 1 -- 172.21.15.71:0/1994767501 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa64069110 con 0x7faa640ceaa0 2023-10-09T06:43:18.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.631+0000 7faa4b7fe700 1 -- 172.21.15.71:0/1994767501 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7faa64069110 con 0x7faa640ceaa0 2023-10-09T06:43:18.631 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:18.631 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3129948705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3129948705},{"type":"v1","addr":"172.21.15.71:6835","nonce":3129948705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2871867918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2871867918},{"type":"v1","addr":"172.21.15.71:6833","nonce":2871867918}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2975286987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2975286987},{"type":"v1","addr":"172.21.15.179:6836","nonce":2975286987}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:42:38.093747+0000","modified":"2023-10-09T06:42:41.642372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/3516898913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3516898913},{"type":"v1","addr":"172.21.15.179:6837","nonce":3516898913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T06:43:18.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.633+0000 7faa68b9d700 1 -- 172.21.15.71:0/1994767501 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faa50066f30 msgr2=0x7faa500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:18.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.633+0000 7faa68b9d700 1 --2- 172.21.15.71:0/1994767501 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faa50066f30 0x7faa500693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faa54009d10 tx=0x7faa540091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.633+0000 7faa68b9d700 1 -- 172.21.15.71:0/1994767501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa640ceaa0 msgr2=0x7faa641560b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:18.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.633+0000 7faa68b9d700 1 --2- 172.21.15.71:0/1994767501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa640ceaa0 0x7faa641560b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faa5800ec80 tx=0x7faa580091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.633+0000 7faa68b9d700 1 -- 172.21.15.71:0/1994767501 shutdown_connections 2023-10-09T06:43:18.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.633+0000 7faa68b9d700 1 --2- 172.21.15.71:0/1994767501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa641593b0 0x7faa6415e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.633+0000 7faa68b9d700 1 --2- 172.21.15.71:0/1994767501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa640b1740 0x7faa64069720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.633+0000 7faa68b9d700 1 --2- 172.21.15.71:0/1994767501 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faa50066f30 0x7faa500693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.633+0000 7faa68b9d700 1 --2- 172.21.15.71:0/1994767501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa640ceaa0 0x7faa641560b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.633+0000 7faa68b9d700 1 -- 172.21.15.71:0/1994767501 >> 172.21.15.71:0/1994767501 conn(0x7faa640d1130 msgr2=0x7faa640b0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:18.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.633+0000 7faa68b9d700 1 -- 172.21.15.71:0/1994767501 shutdown_connections 2023-10-09T06:43:18.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.633+0000 7faa68b9d700 1 -- 172.21.15.71:0/1994767501 wait complete. 2023-10-09T06:43:18.636 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2023-10-09T06:43:18.650 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:43:18.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.830+0000 7f705b59e700 1 Processor -- start 2023-10-09T06:43:18.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.830+0000 7f705b59e700 1 -- start start 2023-10-09T06:43:18.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.831+0000 7f705b59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f705c159420 0x7f705c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:18.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.831+0000 7f705b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f705c1597f0 0x7f705c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:18.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.831+0000 7f705b59e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f705c15d230 0x7f705c15d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:18.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.831+0000 7f705b59e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f705c15dbd0 con 0x7f705c15d230 2023-10-09T06:43:18.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.831+0000 7f705b59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f705c0b11d0 con 0x7f705c159420 2023-10-09T06:43:18.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.831+0000 7f705b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0b14b0 con 0x7f705c1597f0 2023-10-09T06:43:18.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.831+0000 7f705ad9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f705c15d230 0x7f705c15d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:18.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.832+0000 7f705ad9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f705c15d230 0x7f705c15d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52692/0 (socket says 172.21.15.71:52692) 2023-10-09T06:43:18.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.832+0000 7f705ad9d700 1 -- 172.21.15.71:0/3823057433 learned_addr learned my addr 172.21.15.71:0/3823057433 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:18.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.832+0000 7f705a59c700 1 --2- 172.21.15.71:0/3823057433 >> v2:172.21.15.179:3300/0 conn(0x7f705c159420 0x7f705c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:18.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.832+0000 7f7059d9b700 1 --2- 172.21.15.71:0/3823057433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f705c1597f0 0x7f705c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:18.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.832+0000 7f705ad9d700 1 -- 172.21.15.71:0/3823057433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f705c1597f0 msgr2=0x7f705c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:18.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.832+0000 7f705ad9d700 1 --2- 172.21.15.71:0/3823057433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f705c1597f0 0x7f705c0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.832+0000 7f705ad9d700 1 -- 172.21.15.71:0/3823057433 >> v2:172.21.15.179:3300/0 conn(0x7f705c159420 msgr2=0x7f705c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:18.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.832+0000 7f705ad9d700 1 --2- 172.21.15.71:0/3823057433 >> v2:172.21.15.179:3300/0 conn(0x7f705c159420 0x7f705c0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.832+0000 7f705ad9d700 1 -- 172.21.15.71:0/3823057433 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c0b1790 con 0x7f705c15d230 2023-10-09T06:43:18.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.832+0000 7f705a59c700 1 --2- 172.21.15.71:0/3823057433 >> v2:172.21.15.179:3300/0 conn(0x7f705c159420 0x7f705c0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:18.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.832+0000 7f705ad9d700 1 --2- 172.21.15.71:0/3823057433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f705c15d230 0x7f705c15d690 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f705c0b2f20 tx=0x7f7054009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5e23c3dd84568b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:18.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.832+0000 7f705959a700 1 -- 172.21.15.71:0/3823057433 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705400e070 con 0x7f705c15d230 2023-10-09T06:43:18.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.833+0000 7f705959a700 1 -- 172.21.15.71:0/3823057433 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705400ba50 con 0x7f705c15d230 2023-10-09T06:43:18.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.833+0000 7f705959a700 1 -- 172.21.15.71:0/3823057433 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70540092e0 con 0x7f705c15d230 2023-10-09T06:43:18.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.833+0000 7f705b59e700 1 -- 172.21.15.71:0/3823057433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f705c15d230 msgr2=0x7f705c15d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:18.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.833+0000 7f705b59e700 1 --2- 172.21.15.71:0/3823057433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f705c15d230 0x7f705c15d690 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f705c0b2f20 tx=0x7f7054009840 comp rx=0 tx=0).stop 2023-10-09T06:43:18.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.833+0000 7f705b59e700 1 -- 172.21.15.71:0/3823057433 shutdown_connections 2023-10-09T06:43:18.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.833+0000 7f705b59e700 1 --2- 172.21.15.71:0/3823057433 >> v2:172.21.15.179:3300/0 conn(0x7f705c159420 0x7f705c0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.833+0000 7f705b59e700 1 --2- 172.21.15.71:0/3823057433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f705c15d230 0x7f705c15d690 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.833+0000 7f705b59e700 1 --2- 172.21.15.71:0/3823057433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f705c1597f0 0x7f705c0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.833+0000 7f705b59e700 1 -- 172.21.15.71:0/3823057433 >> 172.21.15.71:0/3823057433 conn(0x7f705c0d0660 msgr2=0x7f705c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:18.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.833+0000 7f705b59e700 1 -- 172.21.15.71:0/3823057433 shutdown_connections 2023-10-09T06:43:18.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.833+0000 7f705b59e700 1 -- 172.21.15.71:0/3823057433 wait complete. 2023-10-09T06:43:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.835+0000 7f705b59e700 1 Processor -- start 2023-10-09T06:43:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.835+0000 7f705b59e700 1 -- start start 2023-10-09T06:43:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.836+0000 7f705b59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f705c159420 0x7f705c154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.836+0000 7f705b59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f705c1597f0 0x7f705c1538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.836+0000 7f705b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f705c15d230 0x7f705c16a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.836+0000 7f705b59e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c16a590 con 0x7f705c159420 2023-10-09T06:43:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.836+0000 7f705b59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c154ca0 con 0x7f705c1597f0 2023-10-09T06:43:18.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.836+0000 7f705b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705c154f80 con 0x7f705c15d230 2023-10-09T06:43:18.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.836+0000 7f705a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f705c159420 0x7f705c154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:18.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.836+0000 7f705a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f705c159420 0x7f705c154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52700/0 (socket says 172.21.15.71:52700) 2023-10-09T06:43:18.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.836+0000 7f705a59c700 1 -- 172.21.15.71:0/306756025 learned_addr learned my addr 172.21.15.71:0/306756025 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:18.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.836+0000 7f7059d9b700 1 --2- 172.21.15.71:0/306756025 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f705c1597f0 0x7f705c1538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:18.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.836+0000 7f705ad9d700 1 --2- 172.21.15.71:0/306756025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f705c15d230 0x7f705c16a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:18.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.836+0000 7f705a59c700 1 -- 172.21.15.71:0/306756025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f705c15d230 msgr2=0x7f705c16a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:18.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.836+0000 7f705a59c700 1 --2- 172.21.15.71:0/306756025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f705c15d230 0x7f705c16a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.836+0000 7f705a59c700 1 -- 172.21.15.71:0/306756025 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f705c1597f0 msgr2=0x7f705c1538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:18.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.836+0000 7f705a59c700 1 --2- 172.21.15.71:0/306756025 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f705c1597f0 0x7f705c1538b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:18.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.836+0000 7f705a59c700 1 -- 172.21.15.71:0/306756025 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7054009ae0 con 0x7f705c159420 2023-10-09T06:43:18.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.836+0000 7f705ad9d700 1 --2- 172.21.15.71:0/306756025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f705c15d230 0x7f705c16a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:18.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.837+0000 7f705a59c700 1 --2- 172.21.15.71:0/306756025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f705c159420 0x7f705c154630 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f704c00e8d0 tx=0x7f704c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:18.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.837+0000 7f704a7fc700 1 -- 172.21.15.71:0/306756025 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c00ee70 con 0x7f705c159420 2023-10-09T06:43:18.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.837+0000 7f704a7fc700 1 -- 172.21.15.71:0/306756025 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704c00c5e0 con 0x7f705c159420 2023-10-09T06:43:18.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.837+0000 7f705b59e700 1 -- 172.21.15.71:0/306756025 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f705c155260 con 0x7f705c159420 2023-10-09T06:43:18.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.837+0000 7f704a7fc700 1 -- 172.21.15.71:0/306756025 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c00c980 con 0x7f705c159420 2023-10-09T06:43:18.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.837+0000 7f705b59e700 1 -- 172.21.15.71:0/306756025 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f705c0c5400 con 0x7f705c159420 2023-10-09T06:43:18.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.838+0000 7f705b59e700 1 -- 172.21.15.71:0/306756025 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f705c155700 con 0x7f705c159420 2023-10-09T06:43:18.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.839+0000 7f704a7fc700 1 -- 172.21.15.71:0/306756025 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f704c013410 con 0x7f705c159420 2023-10-09T06:43:18.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.840+0000 7f704a7fc700 1 --2- 172.21.15.71:0/306756025 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f703c066f30 0x7f703c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:18.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.840+0000 7f704a7fc700 1 -- 172.21.15.71:0/306756025 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f704c084340 con 0x7f705c159420 2023-10-09T06:43:18.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.840+0000 7f7059d9b700 1 --2- 172.21.15.71:0/306756025 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f703c066f30 0x7f703c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:18.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.841+0000 7f7059d9b700 1 --2- 172.21.15.71:0/306756025 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f703c066f30 0x7f703c0693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f705c0cc560 tx=0x7f7050008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:18.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:18.844+0000 7f704a7fc700 1 -- 172.21.15.71:0/306756025 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f704c0515b0 con 0x7f705c159420 2023-10-09T06:43:19.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.034+0000 7f705b59e700 1 -- 172.21.15.71:0/306756025 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f705c04c3c0 con 0x7f705c159420 2023-10-09T06:43:19.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.035+0000 7f704a7fc700 1 -- 172.21.15.71:0/306756025 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f704c054bd0 con 0x7f705c159420 2023-10-09T06:43:19.035 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:19.035 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":20,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:42:39.546192+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:42:35.828340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T06:42:37.071896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:43:19.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.037+0000 7f705b59e700 1 -- 172.21.15.71:0/306756025 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f703c066f30 msgr2=0x7f703c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:19.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.037+0000 7f705b59e700 1 --2- 172.21.15.71:0/306756025 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f703c066f30 0x7f703c0693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f705c0cc560 tx=0x7f7050008040 comp rx=0 tx=0).stop 2023-10-09T06:43:19.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.037+0000 7f705b59e700 1 -- 172.21.15.71:0/306756025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f705c159420 msgr2=0x7f705c154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:19.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.037+0000 7f705b59e700 1 --2- 172.21.15.71:0/306756025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f705c159420 0x7f705c154630 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f704c00e8d0 tx=0x7f704c008040 comp rx=0 tx=0).stop 2023-10-09T06:43:19.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.037+0000 7f705b59e700 1 -- 172.21.15.71:0/306756025 shutdown_connections 2023-10-09T06:43:19.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.037+0000 7f705b59e700 1 --2- 172.21.15.71:0/306756025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f705c15d230 0x7f705c16a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:19.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.037+0000 7f705b59e700 1 --2- 172.21.15.71:0/306756025 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f703c066f30 0x7f703c0693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:19.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.037+0000 7f705b59e700 1 --2- 172.21.15.71:0/306756025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f705c159420 0x7f705c154630 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:19.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.037+0000 7f705b59e700 1 --2- 172.21.15.71:0/306756025 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f705c1597f0 0x7f705c1538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:19.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.037+0000 7f705b59e700 1 -- 172.21.15.71:0/306756025 >> 172.21.15.71:0/306756025 conn(0x7f705c0d0660 msgr2=0x7f705c069590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:19.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.037+0000 7f705b59e700 1 -- 172.21.15.71:0/306756025 shutdown_connections 2023-10-09T06:43:19.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.037+0000 7f705b59e700 1 -- 172.21.15.71:0/306756025 wait complete. 2023-10-09T06:43:19.055 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T06:43:19.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.235+0000 7f1f3ddff700 1 Processor -- start 2023-10-09T06:43:19.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.235+0000 7f1f3ddff700 1 -- start start 2023-10-09T06:43:19.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.236+0000 7f1f3ddff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f38069560 0x7f1f380699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:19.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.236+0000 7f1f3ddff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f38069ee0 con 0x7f1f38159890 2023-10-09T06:43:19.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.236+0000 7f1f3ddff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3815a160 con 0x7f1f38159c60 2023-10-09T06:43:19.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.236+0000 7f1f3ddff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f380d13a0 con 0x7f1f38069560 2023-10-09T06:43:19.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.237+0000 7f1f377fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f1f38159890 0x7f1f3815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37834/0 (socket says 172.21.15.71:37834) 2023-10-09T06:43:19.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.237+0000 7f1f377fe700 1 -- 172.21.15.71:0/1632479767 learned_addr learned my addr 172.21.15.71:0/1632479767 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:19.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.237+0000 7f1f367fc700 1 -- 172.21.15.71:0/1632479767 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1252380627 0 0) 0x7f1f38069ee0 con 0x7f1f38159890 2023-10-09T06:43:19.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.237+0000 7f1f367fc700 1 -- 172.21.15.71:0/1632479767 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f20003570 con 0x7f1f38159890 2023-10-09T06:43:19.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.237+0000 7f1f37fff700 1 --2- 172.21.15.71:0/1632479767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f38069560 0x7f1f380699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:19.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.237+0000 7f1f367fc700 1 -- 172.21.15.71:0/1632479767 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2927210483 0 0) 0x7f1f20003570 con 0x7f1f38159890 2023-10-09T06:43:19.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.237+0000 7f1f367fc700 1 -- 172.21.15.71:0/1632479767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f38069560 msgr2=0x7f1f380699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:19.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.237+0000 7f1f367fc700 1 --2- 172.21.15.71:0/1632479767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f38069560 0x7f1f380699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:19.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.237+0000 7f1f367fc700 1 -- 172.21.15.71:0/1632479767 >> v1:172.21.15.179:6789/0 conn(0x7f1f38159c60 legacy=0x7f1f3815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:19.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.237+0000 7f1f367fc700 1 -- 172.21.15.71:0/1632479767 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3815e140 con 0x7f1f38159890 2023-10-09T06:43:19.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.237+0000 7f1f367fc700 1 -- 172.21.15.71:0/1632479767 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f1f28001470 con 0x7f1f38159890 2023-10-09T06:43:19.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.237+0000 7f1f367fc700 1 -- 172.21.15.71:0/1632479767 >> v1:172.21.15.71:6789/0 conn(0x7f1f38159890 legacy=0x7f1f3815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:19.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.238+0000 7f1f367fc700 1 --2- 172.21.15.71:0/1632479767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f20003a90 0x7f1f20003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:19.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.238+0000 7f1f367fc700 1 --2- 172.21.15.71:0/1632479767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f20004810 0x7f1f20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:19.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.238+0000 7f1f367fc700 1 --2- 172.21.15.71:0/1632479767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f38069560 0x7f1f200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:19.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.238+0000 7f1f367fc700 1 -- 172.21.15.71:0/1632479767 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f380d13a0 con 0x7f1f20004810 2023-10-09T06:43:19.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.238+0000 7f1f367fc700 1 -- 172.21.15.71:0/1632479767 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2000bb40 con 0x7f1f20003a90 2023-10-09T06:43:19.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.238+0000 7f1f367fc700 1 -- 172.21.15.71:0/1632479767 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2000bd00 con 0x7f1f38069560 2023-10-09T06:43:19.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.238+0000 7f1f36ffd700 1 --2- 172.21.15.71:0/1632479767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f20004810 0x7f1f20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:19.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.238+0000 7f1f377fe700 1 --2- 172.21.15.71:0/1632479767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f20003a90 0x7f1f20003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:19.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.238+0000 7f1f37fff700 1 --2- 172.21.15.71:0/1632479767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f38069560 0x7f1f200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:19.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.238+0000 7f1f36ffd700 1 -- 172.21.15.71:0/1632479767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f38069560 msgr2=0x7f1f200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:19.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.238+0000 7f1f36ffd700 1 --2- 172.21.15.71:0/1632479767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f38069560 0x7f1f200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:19.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.238+0000 7f1f36ffd700 1 -- 172.21.15.71:0/1632479767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f20003a90 msgr2=0x7f1f20003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:19.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.238+0000 7f1f36ffd700 1 --2- 172.21.15.71:0/1632479767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f20003a90 0x7f1f20003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:19.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.238+0000 7f1f36ffd700 1 -- 172.21.15.71:0/1632479767 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f20003570 con 0x7f1f20004810 2023-10-09T06:43:19.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.239+0000 7f1f36ffd700 1 --2- 172.21.15.71:0/1632479767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f20004810 0x7f1f20004c80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c001970 tx=0x7f1f2c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636ca278d48c4e8f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:19.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.239+0000 7f1f367fc700 1 -- 172.21.15.71:0/1632479767 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c00c5d0 con 0x7f1f20004810 2023-10-09T06:43:19.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.239+0000 7f1f367fc700 1 -- 172.21.15.71:0/1632479767 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2c00c730 con 0x7f1f20004810 2023-10-09T06:43:19.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.239+0000 7f1f367fc700 1 -- 172.21.15.71:0/1632479767 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c00cad0 con 0x7f1f20004810 2023-10-09T06:43:19.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.239+0000 7f1f3ddff700 1 -- 172.21.15.71:0/1632479767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f20004810 msgr2=0x7f1f20004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:19.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.239+0000 7f1f3ddff700 1 --2- 172.21.15.71:0/1632479767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f20004810 0x7f1f20004c80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c001970 tx=0x7f1f2c007d30 comp rx=0 tx=0).stop 2023-10-09T06:43:19.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.239+0000 7f1f37fff700 1 -- 172.21.15.71:0/1632479767 reap_dead start 2023-10-09T06:43:19.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.239+0000 7f1f3ddff700 1 -- 172.21.15.71:0/1632479767 shutdown_connections 2023-10-09T06:43:19.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.239+0000 7f1f3ddff700 1 -- 172.21.15.71:0/1632479767 >> 172.21.15.71:0/1632479767 conn(0x7f1f38068e20 msgr2=0x7f1f380d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:19.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.239+0000 7f1f3ddff700 1 -- 172.21.15.71:0/1632479767 shutdown_connections 2023-10-09T06:43:19.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.239+0000 7f1f3ddff700 1 -- 172.21.15.71:0/1632479767 wait complete. 2023-10-09T06:43:19.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.241+0000 7f1f3ddff700 1 Processor -- start 2023-10-09T06:43:19.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.241+0000 7f1f3ddff700 1 -- start start 2023-10-09T06:43:19.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.242+0000 7f1f3ddff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f20004810 0x7f1f38150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:19.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.242+0000 7f1f3ddff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f380cfa10 0x7f1f3816c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:19.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.242+0000 7f1f3ddff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f380b14d0 0x7f1f380b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:19.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.242+0000 7f1f3ddff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f380b1e80 con 0x7f1f380cfa10 2023-10-09T06:43:19.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.242+0000 7f1f3ddff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f380cfe80 con 0x7f1f20004810 2023-10-09T06:43:19.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.242+0000 7f1f3ddff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f38169c40 con 0x7f1f380b14d0 2023-10-09T06:43:19.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.242+0000 7f1f36ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f380cfa10 0x7f1f3816c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:19.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.242+0000 7f1f36ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f380cfa10 0x7f1f3816c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52716/0 (socket says 172.21.15.71:52716) 2023-10-09T06:43:19.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.242+0000 7f1f36ffd700 1 -- 172.21.15.71:0/19862573 learned_addr learned my addr 172.21.15.71:0/19862573 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:19.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.242+0000 7f1f377fe700 1 --2- 172.21.15.71:0/19862573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f20004810 0x7f1f38150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:19.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.242+0000 7f1f37fff700 1 --2- 172.21.15.71:0/19862573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f380b14d0 0x7f1f380b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:19.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.242+0000 7f1f36ffd700 1 -- 172.21.15.71:0/19862573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f380b14d0 msgr2=0x7f1f380b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:19.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.242+0000 7f1f36ffd700 1 --2- 172.21.15.71:0/19862573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f380b14d0 0x7f1f380b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:19.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.242+0000 7f1f36ffd700 1 -- 172.21.15.71:0/19862573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f20004810 msgr2=0x7f1f38150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:19.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.242+0000 7f1f36ffd700 1 --2- 172.21.15.71:0/19862573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f20004810 0x7f1f38150030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:19.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.242+0000 7f1f36ffd700 1 -- 172.21.15.71:0/19862573 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f38169f20 con 0x7f1f380cfa10 2023-10-09T06:43:19.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.243+0000 7f1f36ffd700 1 --2- 172.21.15.71:0/19862573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f380cfa10 0x7f1f3816c610 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00c3c0 tx=0x7f1f2c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:19.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.243+0000 7f1f1f7fe700 1 -- 172.21.15.71:0/19862573 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c00c5d0 con 0x7f1f380cfa10 2023-10-09T06:43:19.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.243+0000 7f1f1f7fe700 1 -- 172.21.15.71:0/19862573 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2c00ce40 con 0x7f1f380cfa10 2023-10-09T06:43:19.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.243+0000 7f1f3ddff700 1 -- 172.21.15.71:0/19862573 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3816a200 con 0x7f1f380cfa10 2023-10-09T06:43:19.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.243+0000 7f1f1f7fe700 1 -- 172.21.15.71:0/19862573 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c006820 con 0x7f1f380cfa10 2023-10-09T06:43:19.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.243+0000 7f1f3ddff700 1 -- 172.21.15.71:0/19862573 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f381507b0 con 0x7f1f380cfa10 2023-10-09T06:43:19.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.244+0000 7f1f3ddff700 1 -- 172.21.15.71:0/19862573 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3804c3c0 con 0x7f1f380cfa10 2023-10-09T06:43:19.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.245+0000 7f1f1f7fe700 1 -- 172.21.15.71:0/19862573 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f2c019070 con 0x7f1f380cfa10 2023-10-09T06:43:19.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.246+0000 7f1f1f7fe700 1 --2- 172.21.15.71:0/19862573 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1f24066f30 0x7f1f240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:19.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.246+0000 7f1f1f7fe700 1 -- 172.21.15.71:0/19862573 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f2c085bd0 con 0x7f1f380cfa10 2023-10-09T06:43:19.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.246+0000 7f1f377fe700 1 --2- 172.21.15.71:0/19862573 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1f24066f30 0x7f1f240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:19.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.247+0000 7f1f377fe700 1 --2- 172.21.15.71:0/19862573 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1f24066f30 0x7f1f240693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1f28001200 tx=0x7f1f28001e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:19.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.250+0000 7f1f1f7fe700 1 -- 172.21.15.71:0/19862573 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f2c052f00 con 0x7f1f380cfa10 2023-10-09T06:43:19.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.482+0000 7f1f3ddff700 1 -- 172.21.15.71:0/19862573 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1f3806a5b0 con 0x7f1f380cfa10 2023-10-09T06:43:19.483 INFO:tasks.ceph.mon.a.smithi071.stderr:2023-10-09T06:43:19.483+0000 7fdb445f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T06:43:19.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.487+0000 7f1f1f7fe700 1 -- 172.21.15.71:0/19862573 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1f2c022020 con 0x7f1f380cfa10 2023-10-09T06:43:19.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.490+0000 7f1f3ddff700 1 -- 172.21.15.71:0/19862573 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1f24066f30 msgr2=0x7f1f240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:19.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.490+0000 7f1f3ddff700 1 --2- 172.21.15.71:0/19862573 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1f24066f30 0x7f1f240693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1f28001200 tx=0x7f1f28001e70 comp rx=0 tx=0).stop 2023-10-09T06:43:19.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.490+0000 7f1f3ddff700 1 -- 172.21.15.71:0/19862573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f380cfa10 msgr2=0x7f1f3816c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:19.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.490+0000 7f1f3ddff700 1 --2- 172.21.15.71:0/19862573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f380cfa10 0x7f1f3816c610 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00c3c0 tx=0x7f1f2c015000 comp rx=0 tx=0).stop 2023-10-09T06:43:19.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.490+0000 7f1f3ddff700 1 -- 172.21.15.71:0/19862573 shutdown_connections 2023-10-09T06:43:19.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.490+0000 7f1f3ddff700 1 --2- 172.21.15.71:0/19862573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f380b14d0 0x7f1f380b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:19.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.490+0000 7f1f3ddff700 1 --2- 172.21.15.71:0/19862573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f20004810 0x7f1f38150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:19.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.490+0000 7f1f3ddff700 1 --2- 172.21.15.71:0/19862573 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1f24066f30 0x7f1f240693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:19.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.490+0000 7f1f3ddff700 1 --2- 172.21.15.71:0/19862573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f380cfa10 0x7f1f3816c610 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:19.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.490+0000 7f1f3ddff700 1 -- 172.21.15.71:0/19862573 >> 172.21.15.71:0/19862573 conn(0x7f1f38068e20 msgr2=0x7f1f38153550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:19.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.490+0000 7f1f3ddff700 1 -- 172.21.15.71:0/19862573 shutdown_connections 2023-10-09T06:43:19.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.490+0000 7f1f3ddff700 1 -- 172.21.15.71:0/19862573 wait complete. 2023-10-09T06:43:19.491 INFO:teuthology.orchestra.run.smithi071.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T06:43:19.495 INFO:tasks.ceph.mds.d.smithi179.stderr: -1917> 2023-10-09T06:42:44.030+0000 7f6253ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:43:19.507 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T06:43:19.537 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-09T06:43:19.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.691+0000 7f2e145ff700 1 Processor -- start 2023-10-09T06:43:19.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.691+0000 7f2e145ff700 1 -- start start 2023-10-09T06:43:19.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.693+0000 7f2e145ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2e0c0c83f0 0x7f2e0c0c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:19.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.693+0000 7f2e145ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2e0c1568e0 0x7f2e0c0ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:19.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.693+0000 7f2e145ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e0c15b0d0 con 0x7f2e0c0ccee0 2023-10-09T06:43:19.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.693+0000 7f2e145ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0c0c7a60 con 0x7f2e0c1568e0 2023-10-09T06:43:19.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.693+0000 7f2e145ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0c15a4c0 con 0x7f2e0c0c83f0 2023-10-09T06:43:19.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.693+0000 7f2e12b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2e0c1568e0 0x7f2e0c0ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:19.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.693+0000 7f2e12b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2e0c1568e0 0x7f2e0c0ca1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52730/0 (socket says 172.21.15.71:52730) 2023-10-09T06:43:19.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.693+0000 7f2e12b9c700 1 -- 172.21.15.71:0/2700648802 learned_addr learned my addr 172.21.15.71:0/2700648802 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:19.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.693+0000 7f2e1239b700 1 --2- 172.21.15.71:0/2700648802 >> v2:172.21.15.179:3300/0 conn(0x7f2e0c0c83f0 0x7f2e0c0c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:19.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.693+0000 7f2e12b9c700 1 -- 172.21.15.71:0/2700648802 >> v2:172.21.15.179:3300/0 conn(0x7f2e0c0c83f0 msgr2=0x7f2e0c0c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:19.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.693+0000 7f2e12b9c700 1 --2- 172.21.15.71:0/2700648802 >> v2:172.21.15.179:3300/0 conn(0x7f2e0c0c83f0 0x7f2e0c0c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:19.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.693+0000 7f2e12b9c700 1 -- 172.21.15.71:0/2700648802 >> v1:172.21.15.179:6789/0 conn(0x7f2e0c0ccee0 legacy=0x7f2e0c1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:19.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.693+0000 7f2e12b9c700 1 -- 172.21.15.71:0/2700648802 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0c15a7a0 con 0x7f2e0c1568e0 2023-10-09T06:43:19.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.694+0000 7f2e12b9c700 1 --2- 172.21.15.71:0/2700648802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e0c1568e0 0x7f2e0c0ca1e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0c9fd0 tx=0x7f2e04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35eb8140993818c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:19.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.694+0000 7f2e11399700 1 -- 172.21.15.71:0/2700648802 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0400e070 con 0x7f2e0c1568e0 2023-10-09T06:43:19.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.694+0000 7f2e11399700 1 -- 172.21.15.71:0/2700648802 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0400ba50 con 0x7f2e0c1568e0 2023-10-09T06:43:19.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.694+0000 7f2e11399700 1 -- 172.21.15.71:0/2700648802 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e040092e0 con 0x7f2e0c1568e0 2023-10-09T06:43:19.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.694+0000 7f2e145ff700 1 -- 172.21.15.71:0/2700648802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e0c1568e0 msgr2=0x7f2e0c0ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:19.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.694+0000 7f2e145ff700 1 --2- 172.21.15.71:0/2700648802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e0c1568e0 0x7f2e0c0ca1e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0c9fd0 tx=0x7f2e04009840 comp rx=0 tx=0).stop 2023-10-09T06:43:19.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.695+0000 7f2e145ff700 1 -- 172.21.15.71:0/2700648802 shutdown_connections 2023-10-09T06:43:19.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.695+0000 7f2e145ff700 1 --2- 172.21.15.71:0/2700648802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e0c1568e0 0x7f2e0c0ca1e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:19.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.695+0000 7f2e145ff700 1 --2- 172.21.15.71:0/2700648802 >> v2:172.21.15.179:3300/0 conn(0x7f2e0c0c83f0 0x7f2e0c0c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:19.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.695+0000 7f2e145ff700 1 -- 172.21.15.71:0/2700648802 >> 172.21.15.71:0/2700648802 conn(0x7f2e0c068e10 msgr2=0x7f2e0c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:19.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.695+0000 7f2e145ff700 1 -- 172.21.15.71:0/2700648802 shutdown_connections 2023-10-09T06:43:19.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.695+0000 7f2e145ff700 1 -- 172.21.15.71:0/2700648802 wait complete. 2023-10-09T06:43:19.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.696+0000 7f2e145ff700 1 Processor -- start 2023-10-09T06:43:19.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.696+0000 7f2e145ff700 1 -- start start 2023-10-09T06:43:19.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.697+0000 7f2e145ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e0c0c83f0 0x7f2e0c1580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:19.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.697+0000 7f2e145ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e0c0ccee0 0x7f2e0c0b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:19.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.697+0000 7f2e145ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e0c1568e0 0x7f2e0c153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:19.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.697+0000 7f2e145ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c0af2d0 con 0x7f2e0c1568e0 2023-10-09T06:43:19.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.697+0000 7f2e145ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c0afe50 con 0x7f2e0c0c83f0 2023-10-09T06:43:19.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.697+0000 7f2e145ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c0b1830 con 0x7f2e0c0ccee0 2023-10-09T06:43:19.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.697+0000 7f2e12b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e0c1568e0 0x7f2e0c153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:19.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.697+0000 7f2e1239b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e0c0c83f0 0x7f2e0c1580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:19.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.697+0000 7f2e12b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e0c1568e0 0x7f2e0c153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52740/0 (socket says 172.21.15.71:52740) 2023-10-09T06:43:19.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.697+0000 7f2e12b9c700 1 -- 172.21.15.71:0/1893228550 learned_addr learned my addr 172.21.15.71:0/1893228550 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:19.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.697+0000 7f2e11b9a700 1 --2- 172.21.15.71:0/1893228550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e0c0ccee0 0x7f2e0c0b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:19.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.698+0000 7f2e12b9c700 1 -- 172.21.15.71:0/1893228550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e0c0ccee0 msgr2=0x7f2e0c0b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:19.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.698+0000 7f2e12b9c700 1 --2- 172.21.15.71:0/1893228550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e0c0ccee0 0x7f2e0c0b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:19.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.698+0000 7f2e12b9c700 1 -- 172.21.15.71:0/1893228550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e0c0c83f0 msgr2=0x7f2e0c1580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:19.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.698+0000 7f2e12b9c700 1 --2- 172.21.15.71:0/1893228550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e0c0c83f0 0x7f2e0c1580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:19.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.698+0000 7f2e12b9c700 1 -- 172.21.15.71:0/1893228550 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e04009ae0 con 0x7f2e0c1568e0 2023-10-09T06:43:19.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.698+0000 7f2e12b9c700 1 --2- 172.21.15.71:0/1893228550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e0c1568e0 0x7f2e0c153590 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2e04009fd0 tx=0x7f2e04018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:19.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.698+0000 7f2e027fc700 1 -- 172.21.15.71:0/1893228550 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e04008d90 con 0x7f2e0c1568e0 2023-10-09T06:43:19.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.698+0000 7f2e027fc700 1 -- 172.21.15.71:0/1893228550 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0401c410 con 0x7f2e0c1568e0 2023-10-09T06:43:19.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.698+0000 7f2e027fc700 1 -- 172.21.15.71:0/1893228550 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0401c7d0 con 0x7f2e0c1568e0 2023-10-09T06:43:19.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.698+0000 7f2e145ff700 1 -- 172.21.15.71:0/1893228550 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e0c0af520 con 0x7f2e0c1568e0 2023-10-09T06:43:19.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.698+0000 7f2e145ff700 1 -- 172.21.15.71:0/1893228550 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e0c0afae0 con 0x7f2e0c1568e0 2023-10-09T06:43:19.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.699+0000 7f2e145ff700 1 -- 172.21.15.71:0/1893228550 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e0c04c3c0 con 0x7f2e0c1568e0 2023-10-09T06:43:19.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.700+0000 7f2e027fc700 1 -- 172.21.15.71:0/1893228550 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e04003040 con 0x7f2e0c1568e0 2023-10-09T06:43:19.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.701+0000 7f2e027fc700 1 --2- 172.21.15.71:0/1893228550 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2df0066f30 0x7f2df00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:19.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.701+0000 7f2e027fc700 1 -- 172.21.15.71:0/1893228550 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f2e04085ed0 con 0x7f2e0c1568e0 2023-10-09T06:43:19.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.701+0000 7f2e1239b700 1 --2- 172.21.15.71:0/1893228550 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2df0066f30 0x7f2df00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:19.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.702+0000 7f2e1239b700 1 --2- 172.21.15.71:0/1893228550 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2df0066f30 0x7f2df00693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2e08006fd0 tx=0x7f2e08008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:19.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.705+0000 7f2e027fc700 1 -- 172.21.15.71:0/1893228550 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e04053050 con 0x7f2e0c1568e0 2023-10-09T06:43:19.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:19.936+0000 7f2e145ff700 1 -- 172.21.15.71:0/1893228550 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2e0c15aa80 con 0x7f2e0c1568e0 2023-10-09T06:43:20.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.488+0000 7f2e027fc700 1 -- 172.21.15.71:0/1893228550 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2e04056670 con 0x7f2e0c1568e0 2023-10-09T06:43:20.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.491+0000 7f2e145ff700 1 -- 172.21.15.71:0/1893228550 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2df0066f30 msgr2=0x7f2df00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:20.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.491+0000 7f2e145ff700 1 --2- 172.21.15.71:0/1893228550 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2df0066f30 0x7f2df00693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2e08006fd0 tx=0x7f2e08008040 comp rx=0 tx=0).stop 2023-10-09T06:43:20.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.491+0000 7f2e145ff700 1 -- 172.21.15.71:0/1893228550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e0c1568e0 msgr2=0x7f2e0c153590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:20.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.491+0000 7f2e145ff700 1 --2- 172.21.15.71:0/1893228550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e0c1568e0 0x7f2e0c153590 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2e04009fd0 tx=0x7f2e04018000 comp rx=0 tx=0).stop 2023-10-09T06:43:20.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.491+0000 7f2e145ff700 1 -- 172.21.15.71:0/1893228550 shutdown_connections 2023-10-09T06:43:20.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.491+0000 7f2e145ff700 1 --2- 172.21.15.71:0/1893228550 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2df0066f30 0x7f2df00693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:20.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.491+0000 7f2e145ff700 1 --2- 172.21.15.71:0/1893228550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e0c1568e0 0x7f2e0c153590 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:20.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.491+0000 7f2e145ff700 1 --2- 172.21.15.71:0/1893228550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e0c0c83f0 0x7f2e0c1580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:20.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.491+0000 7f2e145ff700 1 --2- 172.21.15.71:0/1893228550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e0c0ccee0 0x7f2e0c0b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:20.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.491+0000 7f2e145ff700 1 -- 172.21.15.71:0/1893228550 >> 172.21.15.71:0/1893228550 conn(0x7f2e0c068e10 msgr2=0x7f2e0c155480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:20.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.491+0000 7f2e145ff700 1 -- 172.21.15.71:0/1893228550 shutdown_connections 2023-10-09T06:43:20.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.491+0000 7f2e145ff700 1 -- 172.21.15.71:0/1893228550 wait complete. 2023-10-09T06:43:20.513 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T06:43:20.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.698+0000 7f8e2e19d700 1 Processor -- start 2023-10-09T06:43:20.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.698+0000 7f8e2e19d700 1 -- start start 2023-10-09T06:43:20.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.699+0000 7f8e2e19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e28153480 0x7f8e280ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:20.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.700+0000 7f8e2e19d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8e28153850 0x7f8e281596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:20.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.700+0000 7f8e2e19d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2815a050 con 0x7f8e28159bf0 2023-10-09T06:43:20.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.700+0000 7f8e2e19d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e280aec90 con 0x7f8e28153850 2023-10-09T06:43:20.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.700+0000 7f8e2e19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2815a480 con 0x7f8e28153480 2023-10-09T06:43:20.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.700+0000 7f8e2d99c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8e28159bf0 0x7f8e281560b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37844/0 (socket says 172.21.15.71:37844) 2023-10-09T06:43:20.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.700+0000 7f8e2d99c700 1 -- 172.21.15.71:0/1492816965 learned_addr learned my addr 172.21.15.71:0/1492816965 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:20.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.700+0000 7f8e2c99a700 1 --2- 172.21.15.71:0/1492816965 >> v2:172.21.15.179:3300/0 conn(0x7f8e28153850 0x7f8e281596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:20.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.700+0000 7f8e2d19b700 1 --2- 172.21.15.71:0/1492816965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e28153480 0x7f8e280ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:20.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.700+0000 7f8e1ffff700 1 -- 172.21.15.71:0/1492816965 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464867618 0 0) 0x7f8e20001490 con 0x7f8e28159bf0 2023-10-09T06:43:20.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.700+0000 7f8e1ffff700 1 -- 172.21.15.71:0/1492816965 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e14003570 con 0x7f8e28159bf0 2023-10-09T06:43:20.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.701+0000 7f8e1ffff700 1 -- 172.21.15.71:0/1492816965 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 929204851 0 0) 0x7f8e14003570 con 0x7f8e28159bf0 2023-10-09T06:43:20.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.701+0000 7f8e1ffff700 1 -- 172.21.15.71:0/1492816965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e28153480 msgr2=0x7f8e280ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:20.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.701+0000 7f8e1ffff700 1 --2- 172.21.15.71:0/1492816965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e28153480 0x7f8e280ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:20.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.701+0000 7f8e1ffff700 1 -- 172.21.15.71:0/1492816965 >> v2:172.21.15.179:3300/0 conn(0x7f8e28153850 msgr2=0x7f8e281596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:20.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.701+0000 7f8e1ffff700 1 --2- 172.21.15.71:0/1492816965 >> v2:172.21.15.179:3300/0 conn(0x7f8e28153850 0x7f8e281596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:20.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.701+0000 7f8e1ffff700 1 -- 172.21.15.71:0/1492816965 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e280afb40 con 0x7f8e28159bf0 2023-10-09T06:43:20.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.701+0000 7f8e1ffff700 1 -- 172.21.15.71:0/1492816965 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f8e20001980 con 0x7f8e28159bf0 2023-10-09T06:43:20.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.701+0000 7f8e1ffff700 1 -- 172.21.15.71:0/1492816965 >> v1:172.21.15.71:6789/0 conn(0x7f8e28159bf0 legacy=0x7f8e281560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:20.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.701+0000 7f8e1ffff700 1 --2- 172.21.15.71:0/1492816965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e28153480 0x7f8e14003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:20.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.701+0000 7f8e1ffff700 1 --2- 172.21.15.71:0/1492816965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e140040b0 0x7f8e14004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:20.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.701+0000 7f8e1ffff700 1 --2- 172.21.15.71:0/1492816965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e14004d50 0x7f8e140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:20.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.701+0000 7f8e1ffff700 1 -- 172.21.15.71:0/1492816965 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e280aec90 con 0x7f8e14004d50 2023-10-09T06:43:20.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.701+0000 7f8e1ffff700 1 -- 172.21.15.71:0/1492816965 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2815a480 con 0x7f8e140040b0 2023-10-09T06:43:20.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.701+0000 7f8e1ffff700 1 -- 172.21.15.71:0/1492816965 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1400bc20 con 0x7f8e28153480 2023-10-09T06:43:20.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.701+0000 7f8e2d99c700 1 --2- 172.21.15.71:0/1492816965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e14004d50 0x7f8e140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:20.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.701+0000 7f8e2c99a700 1 --2- 172.21.15.71:0/1492816965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e140040b0 0x7f8e14004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:20.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.701+0000 7f8e2d19b700 1 --2- 172.21.15.71:0/1492816965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e28153480 0x7f8e14003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:20.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.701+0000 7f8e2d99c700 1 -- 172.21.15.71:0/1492816965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e28153480 msgr2=0x7f8e14003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:20.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.701+0000 7f8e2d99c700 1 --2- 172.21.15.71:0/1492816965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e28153480 0x7f8e14003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:20.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.701+0000 7f8e2d99c700 1 -- 172.21.15.71:0/1492816965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e140040b0 msgr2=0x7f8e14004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:20.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.701+0000 7f8e2d99c700 1 --2- 172.21.15.71:0/1492816965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e140040b0 0x7f8e14004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:20.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.701+0000 7f8e2d99c700 1 -- 172.21.15.71:0/1492816965 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e14003570 con 0x7f8e14004d50 2023-10-09T06:43:20.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.702+0000 7f8e2d99c700 1 --2- 172.21.15.71:0/1492816965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e14004d50 0x7f8e140051c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000aa30 tx=0x7f8e2000a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a791ce248ca4fd20 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:20.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.702+0000 7f8e1ffff700 1 -- 172.21.15.71:0/1492816965 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2000ae70 con 0x7f8e14004d50 2023-10-09T06:43:20.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.702+0000 7f8e1ffff700 1 -- 172.21.15.71:0/1492816965 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2000c5d0 con 0x7f8e14004d50 2023-10-09T06:43:20.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.702+0000 7f8e1ffff700 1 -- 172.21.15.71:0/1492816965 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2000c9b0 con 0x7f8e14004d50 2023-10-09T06:43:20.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.702+0000 7f8e2e19d700 1 -- 172.21.15.71:0/1492816965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e14004d50 msgr2=0x7f8e140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:20.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.702+0000 7f8e2e19d700 1 --2- 172.21.15.71:0/1492816965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e14004d50 0x7f8e140051c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000aa30 tx=0x7f8e2000a0f0 comp rx=0 tx=0).stop 2023-10-09T06:43:20.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.702+0000 7f8e2d99c700 1 -- 172.21.15.71:0/1492816965 reap_dead start 2023-10-09T06:43:20.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.702+0000 7f8e2e19d700 1 -- 172.21.15.71:0/1492816965 shutdown_connections 2023-10-09T06:43:20.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.702+0000 7f8e2e19d700 1 -- 172.21.15.71:0/1492816965 >> 172.21.15.71:0/1492816965 conn(0x7f8e28068e20 msgr2=0x7f8e280cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:20.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.702+0000 7f8e2e19d700 1 -- 172.21.15.71:0/1492816965 shutdown_connections 2023-10-09T06:43:20.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.703+0000 7f8e2e19d700 1 -- 172.21.15.71:0/1492816965 wait complete. 2023-10-09T06:43:20.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.704+0000 7f8e2e19d700 1 Processor -- start 2023-10-09T06:43:20.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.704+0000 7f8e2e19d700 1 -- start start 2023-10-09T06:43:20.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.705+0000 7f8e2e19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e14004d50 0x7f8e281663f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:20.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.705+0000 7f8e2e19d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e2814e3b0 0x7f8e2814db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:20.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.705+0000 7f8e2e19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e280c1070 0x7f8e280c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:20.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.705+0000 7f8e2e19d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e28166930 con 0x7f8e2814e3b0 2023-10-09T06:43:20.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.705+0000 7f8e2e19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2814ec60 con 0x7f8e280c1070 2023-10-09T06:43:20.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.705+0000 7f8e2e19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e280c1a00 con 0x7f8e14004d50 2023-10-09T06:43:20.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.705+0000 7f8e2c99a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e2814e3b0 0x7f8e2814db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:20.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.705+0000 7f8e2c99a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e2814e3b0 0x7f8e2814db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52766/0 (socket says 172.21.15.71:52766) 2023-10-09T06:43:20.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.705+0000 7f8e2c99a700 1 -- 172.21.15.71:0/3707529182 learned_addr learned my addr 172.21.15.71:0/3707529182 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:20.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.706+0000 7f8e2d19b700 1 --2- 172.21.15.71:0/3707529182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e14004d50 0x7f8e281663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:20.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.706+0000 7f8e2d99c700 1 --2- 172.21.15.71:0/3707529182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e280c1070 0x7f8e280c14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:20.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.706+0000 7f8e2c99a700 1 -- 172.21.15.71:0/3707529182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e14004d50 msgr2=0x7f8e281663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:20.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.706+0000 7f8e2c99a700 1 --2- 172.21.15.71:0/3707529182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e14004d50 0x7f8e281663f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:20.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.706+0000 7f8e2c99a700 1 -- 172.21.15.71:0/3707529182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e280c1070 msgr2=0x7f8e280c14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:20.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.706+0000 7f8e2c99a700 1 --2- 172.21.15.71:0/3707529182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e280c1070 0x7f8e280c14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:20.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.706+0000 7f8e2c99a700 1 -- 172.21.15.71:0/3707529182 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e280c8550 con 0x7f8e2814e3b0 2023-10-09T06:43:20.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.706+0000 7f8e2c99a700 1 --2- 172.21.15.71:0/3707529182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e2814e3b0 0x7f8e2814db40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800dea0 tx=0x7f8e1800f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:20.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.706+0000 7f8e1d7fa700 1 -- 172.21.15.71:0/3707529182 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18012040 con 0x7f8e2814e3b0 2023-10-09T06:43:20.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.706+0000 7f8e1d7fa700 1 -- 172.21.15.71:0/3707529182 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e18013d10 con 0x7f8e2814e3b0 2023-10-09T06:43:20.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.706+0000 7f8e1d7fa700 1 -- 172.21.15.71:0/3707529182 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1801a6d0 con 0x7f8e2814e3b0 2023-10-09T06:43:20.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.706+0000 7f8e2e19d700 1 -- 172.21.15.71:0/3707529182 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e280c7f90 con 0x7f8e2814e3b0 2023-10-09T06:43:20.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.706+0000 7f8e2e19d700 1 -- 172.21.15.71:0/3707529182 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e28154b80 con 0x7f8e2814e3b0 2023-10-09T06:43:20.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.707+0000 7f8e2e19d700 1 -- 172.21.15.71:0/3707529182 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2806b690 con 0x7f8e2814e3b0 2023-10-09T06:43:20.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.708+0000 7f8e1d7fa700 1 -- 172.21.15.71:0/3707529182 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e1801aac0 con 0x7f8e2814e3b0 2023-10-09T06:43:20.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.709+0000 7f8e1d7fa700 1 --2- 172.21.15.71:0/3707529182 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8e0c066f60 0x7f8e0c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:20.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.709+0000 7f8e1d7fa700 1 -- 172.21.15.71:0/3707529182 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f8e18087190 con 0x7f8e2814e3b0 2023-10-09T06:43:20.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.709+0000 7f8e2d19b700 1 --2- 172.21.15.71:0/3707529182 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8e0c066f60 0x7f8e0c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:20.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.710+0000 7f8e2d19b700 1 --2- 172.21.15.71:0/3707529182 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8e0c066f60 0x7f8e0c069410 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8e24006f00 tx=0x7f8e240091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:20.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.713+0000 7f8e1d7fa700 1 -- 172.21.15.71:0/3707529182 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e18054310 con 0x7f8e2814e3b0 2023-10-09T06:43:20.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:20.905+0000 7f8e2e19d700 1 -- 172.21.15.71:0/3707529182 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8e28155280 con 0x7f8e2814e3b0 2023-10-09T06:43:21.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.493+0000 7f8e1d7fa700 1 -- 172.21.15.71:0/3707529182 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8e18057930 con 0x7f8e2814e3b0 2023-10-09T06:43:21.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.496+0000 7f8e2e19d700 1 -- 172.21.15.71:0/3707529182 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8e0c066f60 msgr2=0x7f8e0c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:21.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.496+0000 7f8e2e19d700 1 --2- 172.21.15.71:0/3707529182 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8e0c066f60 0x7f8e0c069410 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8e24006f00 tx=0x7f8e240091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:21.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.496+0000 7f8e2e19d700 1 -- 172.21.15.71:0/3707529182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e2814e3b0 msgr2=0x7f8e2814db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:21.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.496+0000 7f8e2e19d700 1 --2- 172.21.15.71:0/3707529182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e2814e3b0 0x7f8e2814db40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800dea0 tx=0x7f8e1800f040 comp rx=0 tx=0).stop 2023-10-09T06:43:21.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.496+0000 7f8e2e19d700 1 -- 172.21.15.71:0/3707529182 shutdown_connections 2023-10-09T06:43:21.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.496+0000 7f8e2e19d700 1 --2- 172.21.15.71:0/3707529182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e280c1070 0x7f8e280c14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:21.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.496+0000 7f8e2e19d700 1 --2- 172.21.15.71:0/3707529182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e14004d50 0x7f8e281663f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:21.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.496+0000 7f8e2e19d700 1 --2- 172.21.15.71:0/3707529182 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8e0c066f60 0x7f8e0c069410 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:21.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.496+0000 7f8e2e19d700 1 --2- 172.21.15.71:0/3707529182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e2814e3b0 0x7f8e2814db40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:21.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.496+0000 7f8e2e19d700 1 -- 172.21.15.71:0/3707529182 >> 172.21.15.71:0/3707529182 conn(0x7f8e28068e20 msgr2=0x7f8e280ae4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:21.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.496+0000 7f8e2e19d700 1 -- 172.21.15.71:0/3707529182 shutdown_connections 2023-10-09T06:43:21.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.496+0000 7f8e2e19d700 1 -- 172.21.15.71:0/3707529182 wait complete. 2023-10-09T06:43:21.499 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' removed 2023-10-09T06:43:21.524 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T06:43:21.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.711+0000 7ff6a5fff700 1 Processor -- start 2023-10-09T06:43:21.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.711+0000 7ff6a5fff700 1 -- start start 2023-10-09T06:43:21.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.712+0000 7ff6a5fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff6a00c8490 0x7ff6a00c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:21.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.712+0000 7ff6a5fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a00ac030 con 0x7ff6a0069a50 2023-10-09T06:43:21.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.712+0000 7ff6a5fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a00ab820 con 0x7ff6a0069e20 2023-10-09T06:43:21.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.712+0000 7ff6a5fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a006dbb0 con 0x7ff6a00c8490 2023-10-09T06:43:21.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.713+0000 7ff69f7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff6a0069a50 0x7ff6a015a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37860/0 (socket says 172.21.15.71:37860) 2023-10-09T06:43:21.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.713+0000 7ff69f7fe700 1 -- 172.21.15.71:0/1156872209 learned_addr learned my addr 172.21.15.71:0/1156872209 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:21.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.713+0000 7ff69e7fc700 1 -- 172.21.15.71:0/1156872209 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351480668 0 0) 0x7ff690001110 con 0x7ff6a0069a50 2023-10-09T06:43:21.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.713+0000 7ff69e7fc700 1 -- 172.21.15.71:0/1156872209 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff688003570 con 0x7ff6a0069a50 2023-10-09T06:43:21.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.713+0000 7ff69effd700 1 --2- 172.21.15.71:0/1156872209 >> v2:172.21.15.179:3300/0 conn(0x7ff6a00c8490 0x7ff6a00c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:21.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.713+0000 7ff69e7fc700 1 -- 172.21.15.71:0/1156872209 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 552832096 0 0) 0x7ff688003570 con 0x7ff6a0069a50 2023-10-09T06:43:21.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.713+0000 7ff69e7fc700 1 -- 172.21.15.71:0/1156872209 >> v2:172.21.15.179:3300/0 conn(0x7ff6a00c8490 msgr2=0x7ff6a00c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:21.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.713+0000 7ff69e7fc700 1 --2- 172.21.15.71:0/1156872209 >> v2:172.21.15.179:3300/0 conn(0x7ff6a00c8490 0x7ff6a00c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:21.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.713+0000 7ff69e7fc700 1 -- 172.21.15.71:0/1156872209 >> v1:172.21.15.179:6789/0 conn(0x7ff6a0069e20 legacy=0x7ff6a01569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:21.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.713+0000 7ff69e7fc700 1 -- 172.21.15.71:0/1156872209 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a00aba70 con 0x7ff6a0069a50 2023-10-09T06:43:21.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.713+0000 7ff69e7fc700 1 -- 172.21.15.71:0/1156872209 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7ff690001600 con 0x7ff6a0069a50 2023-10-09T06:43:21.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.713+0000 7ff69e7fc700 1 -- 172.21.15.71:0/1156872209 >> v1:172.21.15.71:6789/0 conn(0x7ff6a0069a50 legacy=0x7ff6a015a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:21.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.713+0000 7ff69e7fc700 1 --2- 172.21.15.71:0/1156872209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff688003ab0 0x7ff688003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:21.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.714+0000 7ff69e7fc700 1 --2- 172.21.15.71:0/1156872209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff688004810 0x7ff688004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:21.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.714+0000 7ff69e7fc700 1 --2- 172.21.15.71:0/1156872209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6880052e0 0x7ff68800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:21.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.714+0000 7ff69e7fc700 1 -- 172.21.15.71:0/1156872209 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a006dbb0 con 0x7ff688004810 2023-10-09T06:43:21.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.714+0000 7ff69e7fc700 1 -- 172.21.15.71:0/1156872209 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68800c260 con 0x7ff688003ab0 2023-10-09T06:43:21.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.714+0000 7ff69e7fc700 1 -- 172.21.15.71:0/1156872209 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68800c420 con 0x7ff6880052e0 2023-10-09T06:43:21.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.714+0000 7ff69effd700 1 --2- 172.21.15.71:0/1156872209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff688004810 0x7ff688004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:21.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.714+0000 7ff69f7fe700 1 --2- 172.21.15.71:0/1156872209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff688003ab0 0x7ff688003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:21.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.714+0000 7ff69ffff700 1 --2- 172.21.15.71:0/1156872209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6880052e0 0x7ff68800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:21.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.714+0000 7ff69effd700 1 -- 172.21.15.71:0/1156872209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6880052e0 msgr2=0x7ff68800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:21.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.714+0000 7ff69effd700 1 --2- 172.21.15.71:0/1156872209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6880052e0 0x7ff68800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:21.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.714+0000 7ff69effd700 1 -- 172.21.15.71:0/1156872209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff688003ab0 msgr2=0x7ff688003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:21.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.714+0000 7ff69effd700 1 --2- 172.21.15.71:0/1156872209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff688003ab0 0x7ff688003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:21.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.714+0000 7ff69effd700 1 -- 172.21.15.71:0/1156872209 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff688003570 con 0x7ff688004810 2023-10-09T06:43:21.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.714+0000 7ff69ffff700 1 --2- 172.21.15.71:0/1156872209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6880052e0 0x7ff68800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:21.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.714+0000 7ff69ffff700 1 -- 172.21.15.71:0/1156872209 reap_dead start 2023-10-09T06:43:21.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.714+0000 7ff69effd700 1 --2- 172.21.15.71:0/1156872209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff688004810 0x7ff688004c80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff69400ac00 tx=0x7ff694008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2745df5d1b7fd377 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:21.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.715+0000 7ff69e7fc700 1 -- 172.21.15.71:0/1156872209 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69400d7a0 con 0x7ff688004810 2023-10-09T06:43:21.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.715+0000 7ff69e7fc700 1 -- 172.21.15.71:0/1156872209 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69400d900 con 0x7ff688004810 2023-10-09T06:43:21.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.715+0000 7ff69e7fc700 1 -- 172.21.15.71:0/1156872209 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69400dab0 con 0x7ff688004810 2023-10-09T06:43:21.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.715+0000 7ff6a5fff700 1 -- 172.21.15.71:0/1156872209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff688004810 msgr2=0x7ff688004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:21.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.715+0000 7ff6a5fff700 1 --2- 172.21.15.71:0/1156872209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff688004810 0x7ff688004c80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff69400ac00 tx=0x7ff694008040 comp rx=0 tx=0).stop 2023-10-09T06:43:21.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.715+0000 7ff6a5fff700 1 -- 172.21.15.71:0/1156872209 shutdown_connections 2023-10-09T06:43:21.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.715+0000 7ff6a5fff700 1 --2- 172.21.15.71:0/1156872209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff688004810 0x7ff688004c80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:21.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.715+0000 7ff6a5fff700 1 -- 172.21.15.71:0/1156872209 >> 172.21.15.71:0/1156872209 conn(0x7ff6a00c8f90 msgr2=0x7ff6a00c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:21.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.715+0000 7ff6a5fff700 1 -- 172.21.15.71:0/1156872209 shutdown_connections 2023-10-09T06:43:21.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.715+0000 7ff6a5fff700 1 -- 172.21.15.71:0/1156872209 wait complete. 2023-10-09T06:43:21.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.717+0000 7ff6a5fff700 1 Processor -- start 2023-10-09T06:43:21.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.717+0000 7ff6a5fff700 1 -- start start 2023-10-09T06:43:21.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.718+0000 7ff6a5fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff688004810 0x7ff6a01684b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:21.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.718+0000 7ff6a5fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6a00bfad0 0x7ff6a00af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:21.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.718+0000 7ff6a5fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6a00afc70 0x7ff6a0158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:21.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.718+0000 7ff6a5fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a0153b10 con 0x7ff6a00afc70 2023-10-09T06:43:21.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.718+0000 7ff6a5fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a0157610 con 0x7ff688004810 2023-10-09T06:43:21.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.718+0000 7ff6a5fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a0157860 con 0x7ff6a00bfad0 2023-10-09T06:43:21.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.718+0000 7ff69ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6a00afc70 0x7ff6a0158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:21.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.718+0000 7ff69ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6a00afc70 0x7ff6a0158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52782/0 (socket says 172.21.15.71:52782) 2023-10-09T06:43:21.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.718+0000 7ff69ffff700 1 -- 172.21.15.71:0/3524987707 learned_addr learned my addr 172.21.15.71:0/3524987707 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:21.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.718+0000 7ff69effd700 1 --2- 172.21.15.71:0/3524987707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6a00bfad0 0x7ff6a00af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:21.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.718+0000 7ff69f7fe700 1 --2- 172.21.15.71:0/3524987707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff688004810 0x7ff6a01684b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:21.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.718+0000 7ff69ffff700 1 -- 172.21.15.71:0/3524987707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6a00bfad0 msgr2=0x7ff6a00af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:21.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.718+0000 7ff69ffff700 1 --2- 172.21.15.71:0/3524987707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6a00bfad0 0x7ff6a00af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:21.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.718+0000 7ff69ffff700 1 -- 172.21.15.71:0/3524987707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff688004810 msgr2=0x7ff6a01684b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:21.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.718+0000 7ff69ffff700 1 --2- 172.21.15.71:0/3524987707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff688004810 0x7ff6a01684b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:21.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.718+0000 7ff69ffff700 1 -- 172.21.15.71:0/3524987707 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a0157b40 con 0x7ff6a00afc70 2023-10-09T06:43:21.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.718+0000 7ff69f7fe700 1 --2- 172.21.15.71:0/3524987707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff688004810 0x7ff6a01684b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:21.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.719+0000 7ff69ffff700 1 --2- 172.21.15.71:0/3524987707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6a00afc70 0x7ff6a0158900 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff6a00c9fd0 tx=0x7ff698009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:21.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.719+0000 7ff6877fe700 1 -- 172.21.15.71:0/3524987707 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff698018070 con 0x7ff6a00afc70 2023-10-09T06:43:21.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.719+0000 7ff6877fe700 1 -- 172.21.15.71:0/3524987707 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff698006ba0 con 0x7ff6a00afc70 2023-10-09T06:43:21.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.719+0000 7ff6877fe700 1 -- 172.21.15.71:0/3524987707 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff698013630 con 0x7ff6a00afc70 2023-10-09T06:43:21.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.719+0000 7ff6a5fff700 1 -- 172.21.15.71:0/3524987707 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a0157e20 con 0x7ff6a00afc70 2023-10-09T06:43:21.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.719+0000 7ff6a5fff700 1 -- 172.21.15.71:0/3524987707 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a01583e0 con 0x7ff6a00afc70 2023-10-09T06:43:21.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.720+0000 7ff6a5fff700 1 -- 172.21.15.71:0/3524987707 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a0158600 con 0x7ff6a00afc70 2023-10-09T06:43:21.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.721+0000 7ff6877fe700 1 -- 172.21.15.71:0/3524987707 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff698003030 con 0x7ff6a00afc70 2023-10-09T06:43:21.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.722+0000 7ff6877fe700 1 --2- 172.21.15.71:0/3524987707 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff68c066f30 0x7ff68c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:21.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.722+0000 7ff6877fe700 1 -- 172.21.15.71:0/3524987707 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5469+0+0 (secure 0 0 0) 0x7ff698083e60 con 0x7ff6a00afc70 2023-10-09T06:43:21.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.722+0000 7ff69f7fe700 1 --2- 172.21.15.71:0/3524987707 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff68c066f30 0x7ff68c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:21.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.723+0000 7ff69f7fe700 1 --2- 172.21.15.71:0/3524987707 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff68c066f30 0x7ff68c0693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff690001ed0 tx=0x7ff690009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:21.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.726+0000 7ff6877fe700 1 -- 172.21.15.71:0/3524987707 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6980511c0 con 0x7ff6a00afc70 2023-10-09T06:43:21.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:21.916+0000 7ff6a5fff700 1 -- 172.21.15.71:0/3524987707 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff6a00718b0 con 0x7ff6a00afc70 2023-10-09T06:43:22.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.496+0000 7ff6877fe700 1 -- 172.21.15.71:0/3524987707 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff6980547e0 con 0x7ff6a00afc70 2023-10-09T06:43:22.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.503+0000 7ff6a5fff700 1 -- 172.21.15.71:0/3524987707 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff68c066f30 msgr2=0x7ff68c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:22.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.503+0000 7ff6a5fff700 1 --2- 172.21.15.71:0/3524987707 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff68c066f30 0x7ff68c0693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff690001ed0 tx=0x7ff690009040 comp rx=0 tx=0).stop 2023-10-09T06:43:22.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.503+0000 7ff6a5fff700 1 -- 172.21.15.71:0/3524987707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6a00afc70 msgr2=0x7ff6a0158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:22.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.503+0000 7ff6a5fff700 1 --2- 172.21.15.71:0/3524987707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6a00afc70 0x7ff6a0158900 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff6a00c9fd0 tx=0x7ff698009040 comp rx=0 tx=0).stop 2023-10-09T06:43:22.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.503+0000 7ff6a5fff700 1 -- 172.21.15.71:0/3524987707 shutdown_connections 2023-10-09T06:43:22.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.503+0000 7ff6a5fff700 1 --2- 172.21.15.71:0/3524987707 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff68c066f30 0x7ff68c0693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:22.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.503+0000 7ff6a5fff700 1 --2- 172.21.15.71:0/3524987707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6a00afc70 0x7ff6a0158900 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:22.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.503+0000 7ff6a5fff700 1 --2- 172.21.15.71:0/3524987707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff688004810 0x7ff6a01684b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:22.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.503+0000 7ff6a5fff700 1 --2- 172.21.15.71:0/3524987707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6a00bfad0 0x7ff6a00af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:22.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.503+0000 7ff6a5fff700 1 -- 172.21.15.71:0/3524987707 >> 172.21.15.71:0/3524987707 conn(0x7ff6a00c8f90 msgr2=0x7ff6a00ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:22.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.505+0000 7ff6a5fff700 1 -- 172.21.15.71:0/3524987707 shutdown_connections 2023-10-09T06:43:22.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.505+0000 7ff6a5fff700 1 -- 172.21.15.71:0/3524987707 wait complete. 2023-10-09T06:43:22.509 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' removed 2023-10-09T06:43:22.527 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T06:43:22.528 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T06:43:22.528 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T06:43:22.528 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:43:22.528 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T06:43:22.528 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T06:43:22.528 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T06:43:22.529 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:43:22.529 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T06:43:22.529 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T06:43:22.529 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T06:43:22.529 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:43:22.529 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T06:43:22.529 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T06:43:22.530 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T06:43:22.530 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:43:22.542 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T06:43:22.543 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T06:43:22.543 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T06:43:22.544 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T06:43:22.545 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T06:43:22.546 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T06:43:22.547 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T06:43:22.547 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T06:43:22.587 INFO:tasks.ceph.mds.c:Started 2023-10-09T06:43:22.587 DEBUG:teuthology.parallel:result is None 2023-10-09T06:43:22.589 INFO:tasks.ceph.mds.b:Started 2023-10-09T06:43:22.590 DEBUG:teuthology.parallel:result is None 2023-10-09T06:43:22.590 INFO:tasks.ceph.mds.a:Started 2023-10-09T06:43:22.590 DEBUG:teuthology.parallel:result is None 2023-10-09T06:43:22.592 INFO:tasks.ceph.mds.d:Started 2023-10-09T06:43:22.592 DEBUG:teuthology.parallel:result is None 2023-10-09T06:43:22.593 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T06:43:22.725 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2023-10-09T06:43:22.725 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-10-09T06:43:22.726 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-09T06:43:22.726 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-09T06:43:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.784+0000 7fd12a7ff700 1 Processor -- start 2023-10-09T06:43:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.784+0000 7fd12a7ff700 1 -- start start 2023-10-09T06:43:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.785+0000 7fd12a7ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd1240b1420 0x7fd1240ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.785+0000 7fd12a7ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1240cc300 con 0x7fd1240cbf30 2023-10-09T06:43:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.785+0000 7fd12a7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1240ad370 con 0x7fd1240ccf90 2023-10-09T06:43:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.786+0000 7fd12a7ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd124156bf0 con 0x7fd1240b1420 2023-10-09T06:43:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.786+0000 7fd1237fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd1240b1420 0x7fd1240ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.786+0000 7fd1237fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd1240b1420 0x7fd1240ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52840/0 (socket says 172.21.15.71:52840) 2023-10-09T06:43:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.786+0000 7fd123fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd1240cbf30 0x7fd1240b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37874/0 (socket says 172.21.15.71:37874) 2023-10-09T06:43:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.786+0000 7fd1237fe700 1 -- 172.21.15.71:0/760810339 learned_addr learned my addr 172.21.15.71:0/760810339 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.786+0000 7fd122ffd700 1 -- 172.21.15.71:0/760810339 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1360246832 0 0) 0x7fd1240cc300 con 0x7fd1240cbf30 2023-10-09T06:43:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.786+0000 7fd1237fe700 1 -- 172.21.15.71:0/760810339 >> v1:172.21.15.179:6789/0 conn(0x7fd1240ccf90 legacy=0x7fd1240c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.786+0000 7fd1237fe700 1 -- 172.21.15.71:0/760810339 >> v1:172.21.15.71:6789/0 conn(0x7fd1240cbf30 legacy=0x7fd1240b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.786+0000 7fd1237fe700 1 -- 172.21.15.71:0/760810339 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1240ad650 con 0x7fd1240b1420 2023-10-09T06:43:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.786+0000 7fd1237fe700 1 --2- 172.21.15.71:0/760810339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1240b1420 0x7fd1240ae410 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd1180099b0 tx=0x7fd118009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab3912edb36d7e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.787+0000 7fd122ffd700 1 -- 172.21.15.71:0/760810339 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11800b860 con 0x7fd1240b1420 2023-10-09T06:43:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.787+0000 7fd122ffd700 1 -- 172.21.15.71:0/760810339 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11800b9c0 con 0x7fd1240b1420 2023-10-09T06:43:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.787+0000 7fd122ffd700 1 -- 172.21.15.71:0/760810339 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11800bd60 con 0x7fd1240b1420 2023-10-09T06:43:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.787+0000 7fd12a7ff700 1 -- 172.21.15.71:0/760810339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1240b1420 msgr2=0x7fd1240ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.787+0000 7fd12a7ff700 1 --2- 172.21.15.71:0/760810339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1240b1420 0x7fd1240ae410 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd1180099b0 tx=0x7fd118009250 comp rx=0 tx=0).stop 2023-10-09T06:43:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.787+0000 7fd12a7ff700 1 -- 172.21.15.71:0/760810339 shutdown_connections 2023-10-09T06:43:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.787+0000 7fd12a7ff700 1 --2- 172.21.15.71:0/760810339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1240b1420 0x7fd1240ae410 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.787+0000 7fd12a7ff700 1 -- 172.21.15.71:0/760810339 >> 172.21.15.71:0/760810339 conn(0x7fd12406a320 msgr2=0x7fd1240cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.787+0000 7fd12a7ff700 1 -- 172.21.15.71:0/760810339 shutdown_connections 2023-10-09T06:43:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.787+0000 7fd12a7ff700 1 -- 172.21.15.71:0/760810339 wait complete. 2023-10-09T06:43:22.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.789+0000 7fd12a7ff700 1 Processor -- start 2023-10-09T06:43:22.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.789+0000 7fd12a7ff700 1 -- start start 2023-10-09T06:43:22.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.790+0000 7fd12a7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1240b1420 0x7fd12416b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:22.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.790+0000 7fd12a7ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1240cbf30 0x7fd12416bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:22.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.790+0000 7fd12a7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1240ccf90 0x7fd12416c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:22.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.790+0000 7fd12a7ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1241503c0 con 0x7fd1240cbf30 2023-10-09T06:43:22.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.790+0000 7fd12a7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd124158f60 con 0x7fd1240ccf90 2023-10-09T06:43:22.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.790+0000 7fd12a7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd124159240 con 0x7fd1240b1420 2023-10-09T06:43:22.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.790+0000 7fd1237fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1240cbf30 0x7fd12416bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:22.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.790+0000 7fd1237fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1240cbf30 0x7fd12416bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52844/0 (socket says 172.21.15.71:52844) 2023-10-09T06:43:22.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.790+0000 7fd1237fe700 1 -- 172.21.15.71:0/1135931998 learned_addr learned my addr 172.21.15.71:0/1135931998 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:22.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.790+0000 7fd128d9c700 1 --2- 172.21.15.71:0/1135931998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1240ccf90 0x7fd12416c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:22.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.790+0000 7fd123fff700 1 --2- 172.21.15.71:0/1135931998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1240b1420 0x7fd12416b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:22.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.790+0000 7fd1237fe700 1 -- 172.21.15.71:0/1135931998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1240b1420 msgr2=0x7fd12416b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:22.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.790+0000 7fd1237fe700 1 --2- 172.21.15.71:0/1135931998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1240b1420 0x7fd12416b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:22.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.790+0000 7fd1237fe700 1 -- 172.21.15.71:0/1135931998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1240ccf90 msgr2=0x7fd12416c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:22.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.790+0000 7fd1237fe700 1 --2- 172.21.15.71:0/1135931998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1240ccf90 0x7fd12416c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:22.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.790+0000 7fd1237fe700 1 -- 172.21.15.71:0/1135931998 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1180094f0 con 0x7fd1240cbf30 2023-10-09T06:43:22.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.791+0000 7fd1237fe700 1 --2- 172.21.15.71:0/1135931998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1240cbf30 0x7fd12416bf10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd118006f50 tx=0x7fd118017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:22.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.791+0000 7fd10bfff700 1 -- 172.21.15.71:0/1135931998 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11801f070 con 0x7fd1240cbf30 2023-10-09T06:43:22.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.791+0000 7fd10bfff700 1 -- 172.21.15.71:0/1135931998 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11801a420 con 0x7fd1240cbf30 2023-10-09T06:43:22.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.791+0000 7fd10bfff700 1 -- 172.21.15.71:0/1135931998 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11801a800 con 0x7fd1240cbf30 2023-10-09T06:43:22.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.791+0000 7fd12a7ff700 1 -- 172.21.15.71:0/1135931998 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd124159520 con 0x7fd1240cbf30 2023-10-09T06:43:22.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.791+0000 7fd12a7ff700 1 -- 172.21.15.71:0/1135931998 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd12415a320 con 0x7fd1240cbf30 2023-10-09T06:43:22.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.792+0000 7fd12a7ff700 1 -- 172.21.15.71:0/1135931998 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd124150530 con 0x7fd1240cbf30 2023-10-09T06:43:22.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.793+0000 7fd10bfff700 1 -- 172.21.15.71:0/1135931998 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd11801ab70 con 0x7fd1240cbf30 2023-10-09T06:43:22.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.794+0000 7fd10bfff700 1 --2- 172.21.15.71:0/1135931998 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd110066f30 0x7fd1100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:22.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.794+0000 7fd10bfff700 1 -- 172.21.15.71:0/1135931998 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd1180854c0 con 0x7fd1240cbf30 2023-10-09T06:43:22.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.794+0000 7fd123fff700 1 --2- 172.21.15.71:0/1135931998 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd110066f30 0x7fd1100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:22.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.795+0000 7fd123fff700 1 --2- 172.21.15.71:0/1135931998 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd110066f30 0x7fd1100693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd1140011e0 tx=0x7fd114007bd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:22.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:22.798+0000 7fd10bfff700 1 -- 172.21.15.71:0/1135931998 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd118052990 con 0x7fd1240cbf30 2023-10-09T06:43:23.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:23.005+0000 7fd12a7ff700 1 -- 172.21.15.71:0/1135931998 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd12404c3c0 con 0x7fd1240cbf30 2023-10-09T06:43:24.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.512+0000 7fd10bfff700 1 -- 172.21.15.71:0/1135931998 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd118055fb0 con 0x7fd1240cbf30 2023-10-09T06:43:24.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.515+0000 7fd12a7ff700 1 -- 172.21.15.71:0/1135931998 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd110066f30 msgr2=0x7fd1100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:24.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.515+0000 7fd12a7ff700 1 --2- 172.21.15.71:0/1135931998 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd110066f30 0x7fd1100693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd1140011e0 tx=0x7fd114007bd0 comp rx=0 tx=0).stop 2023-10-09T06:43:24.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.515+0000 7fd12a7ff700 1 -- 172.21.15.71:0/1135931998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1240cbf30 msgr2=0x7fd12416bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:24.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.515+0000 7fd12a7ff700 1 --2- 172.21.15.71:0/1135931998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1240cbf30 0x7fd12416bf10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd118006f50 tx=0x7fd118017000 comp rx=0 tx=0).stop 2023-10-09T06:43:24.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.515+0000 7fd12a7ff700 1 -- 172.21.15.71:0/1135931998 shutdown_connections 2023-10-09T06:43:24.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.515+0000 7fd12a7ff700 1 --2- 172.21.15.71:0/1135931998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1240ccf90 0x7fd12416c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:24.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.515+0000 7fd12a7ff700 1 --2- 172.21.15.71:0/1135931998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1240b1420 0x7fd12416b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:24.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.515+0000 7fd12a7ff700 1 --2- 172.21.15.71:0/1135931998 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd110066f30 0x7fd1100693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:24.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.515+0000 7fd12a7ff700 1 --2- 172.21.15.71:0/1135931998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1240cbf30 0x7fd12416bf10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:24.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.515+0000 7fd12a7ff700 1 -- 172.21.15.71:0/1135931998 >> 172.21.15.71:0/1135931998 conn(0x7fd12406a320 msgr2=0x7fd1240ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:24.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.515+0000 7fd12a7ff700 1 -- 172.21.15.71:0/1135931998 shutdown_connections 2023-10-09T06:43:24.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.515+0000 7fd12a7ff700 1 -- 172.21.15.71:0/1135931998 wait complete. 2023-10-09T06:43:24.518 INFO:teuthology.orchestra.run.smithi071.stderr: removed all blocklist entries 2023-10-09T06:43:24.537 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T06:43:24.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.722+0000 7fe66619d700 1 Processor -- start 2023-10-09T06:43:24.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.722+0000 7fe66619d700 1 -- start start 2023-10-09T06:43:24.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.723+0000 7fe66619d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe66006a660 0x7fe660157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:24.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.723+0000 7fe66619d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe66006e2a0 con 0x7fe660150180 2023-10-09T06:43:24.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.723+0000 7fe66619d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe66006b2e0 con 0x7fe660150550 2023-10-09T06:43:24.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.723+0000 7fe66619d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6600c78e0 con 0x7fe66006a660 2023-10-09T06:43:24.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.723+0000 7fe66519b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe660150180 0x7fe6600c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37886/0 (socket says 172.21.15.71:37886) 2023-10-09T06:43:24.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.723+0000 7fe66519b700 1 -- 172.21.15.71:0/1615515473 learned_addr learned my addr 172.21.15.71:0/1615515473 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:24.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.724+0000 7fe66599c700 1 --2- 172.21.15.71:0/1615515473 >> v2:172.21.15.179:3300/0 conn(0x7fe66006a660 0x7fe660157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:24.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.724+0000 7fe657fff700 1 -- 172.21.15.71:0/1615515473 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057829304 0 0) 0x7fe66006e2a0 con 0x7fe660150180 2023-10-09T06:43:24.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.724+0000 7fe657fff700 1 -- 172.21.15.71:0/1615515473 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe64c003570 con 0x7fe660150180 2023-10-09T06:43:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.724+0000 7fe657fff700 1 -- 172.21.15.71:0/1615515473 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3256160824 0 0) 0x7fe64c003570 con 0x7fe660150180 2023-10-09T06:43:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.724+0000 7fe657fff700 1 -- 172.21.15.71:0/1615515473 >> v2:172.21.15.179:3300/0 conn(0x7fe66006a660 msgr2=0x7fe660157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.724+0000 7fe657fff700 1 --2- 172.21.15.71:0/1615515473 >> v2:172.21.15.179:3300/0 conn(0x7fe66006a660 0x7fe660157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.724+0000 7fe657fff700 1 -- 172.21.15.71:0/1615515473 >> v1:172.21.15.179:6789/0 conn(0x7fe660150550 legacy=0x7fe660069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.724+0000 7fe657fff700 1 -- 172.21.15.71:0/1615515473 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6600c7bc0 con 0x7fe660150180 2023-10-09T06:43:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.724+0000 7fe657fff700 1 -- 172.21.15.71:0/1615515473 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fe65c001470 con 0x7fe660150180 2023-10-09T06:43:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.724+0000 7fe657fff700 1 -- 172.21.15.71:0/1615515473 >> v1:172.21.15.71:6789/0 conn(0x7fe660150180 legacy=0x7fe6600c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.724+0000 7fe657fff700 1 --2- 172.21.15.71:0/1615515473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe64c003ae0 0x7fe64c003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.724+0000 7fe657fff700 1 --2- 172.21.15.71:0/1615515473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe64c004810 0x7fe64c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.724+0000 7fe657fff700 1 --2- 172.21.15.71:0/1615515473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe64c005230 0x7fe64c00dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.724+0000 7fe657fff700 1 -- 172.21.15.71:0/1615515473 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6600c78e0 con 0x7fe64c004810 2023-10-09T06:43:24.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.724+0000 7fe657fff700 1 -- 172.21.15.71:0/1615515473 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c00e370 con 0x7fe64c005230 2023-10-09T06:43:24.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.724+0000 7fe657fff700 1 -- 172.21.15.71:0/1615515473 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c00e530 con 0x7fe64c003ae0 2023-10-09T06:43:24.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.724+0000 7fe66499a700 1 --2- 172.21.15.71:0/1615515473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe64c004810 0x7fe64c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:24.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.724+0000 7fe66519b700 1 --2- 172.21.15.71:0/1615515473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe64c003ae0 0x7fe64c003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:24.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.725+0000 7fe66599c700 1 --2- 172.21.15.71:0/1615515473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe64c005230 0x7fe64c00dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:24.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.725+0000 7fe66499a700 1 -- 172.21.15.71:0/1615515473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe64c003ae0 msgr2=0x7fe64c003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:24.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.725+0000 7fe66499a700 1 --2- 172.21.15.71:0/1615515473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe64c003ae0 0x7fe64c003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:24.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.725+0000 7fe66499a700 1 -- 172.21.15.71:0/1615515473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe64c005230 msgr2=0x7fe64c00dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:24.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.725+0000 7fe66499a700 1 --2- 172.21.15.71:0/1615515473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe64c005230 0x7fe64c00dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:24.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.725+0000 7fe66499a700 1 -- 172.21.15.71:0/1615515473 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c003570 con 0x7fe64c004810 2023-10-09T06:43:24.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.725+0000 7fe66599c700 1 --2- 172.21.15.71:0/1615515473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe64c005230 0x7fe64c00dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.725+0000 7fe66599c700 1 -- 172.21.15.71:0/1615515473 reap_dead start 2023-10-09T06:43:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.725+0000 7fe66499a700 1 --2- 172.21.15.71:0/1615515473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe64c004810 0x7fe64c004c80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe6500018b0 tx=0x7fe650007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81b05026b6273d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.725+0000 7fe657fff700 1 -- 172.21.15.71:0/1615515473 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650012420 con 0x7fe64c004810 2023-10-09T06:43:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.725+0000 7fe657fff700 1 -- 172.21.15.71:0/1615515473 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6500125a0 con 0x7fe64c004810 2023-10-09T06:43:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.725+0000 7fe657fff700 1 -- 172.21.15.71:0/1615515473 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650012960 con 0x7fe64c004810 2023-10-09T06:43:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.726+0000 7fe66619d700 1 -- 172.21.15.71:0/1615515473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe64c004810 msgr2=0x7fe64c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.726+0000 7fe66619d700 1 --2- 172.21.15.71:0/1615515473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe64c004810 0x7fe64c004c80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe6500018b0 tx=0x7fe650007d30 comp rx=0 tx=0).stop 2023-10-09T06:43:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.726+0000 7fe66619d700 1 -- 172.21.15.71:0/1615515473 shutdown_connections 2023-10-09T06:43:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.726+0000 7fe66619d700 1 --2- 172.21.15.71:0/1615515473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe64c004810 0x7fe64c004c80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.726+0000 7fe66619d700 1 -- 172.21.15.71:0/1615515473 >> 172.21.15.71:0/1615515473 conn(0x7fe6600cc1f0 msgr2=0x7fe6600cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.726+0000 7fe66619d700 1 -- 172.21.15.71:0/1615515473 shutdown_connections 2023-10-09T06:43:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.726+0000 7fe66619d700 1 -- 172.21.15.71:0/1615515473 wait complete. 2023-10-09T06:43:24.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.727+0000 7fe66619d700 1 Processor -- start 2023-10-09T06:43:24.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.727+0000 7fe66619d700 1 -- start start 2023-10-09T06:43:24.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.728+0000 7fe66619d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe64c004810 0x7fe66015a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:24.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.728+0000 7fe66619d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe66016a280 0x7fe660157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:24.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.728+0000 7fe66619d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe660158210 0x7fe6600c1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:24.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.728+0000 7fe66619d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe660146840 con 0x7fe66016a280 2023-10-09T06:43:24.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.728+0000 7fe66619d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe660169df0 con 0x7fe660158210 2023-10-09T06:43:24.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.728+0000 7fe66619d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66016a6f0 con 0x7fe64c004810 2023-10-09T06:43:24.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.728+0000 7fe66499a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe66016a280 0x7fe660157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:24.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.728+0000 7fe66499a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe66016a280 0x7fe660157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52858/0 (socket says 172.21.15.71:52858) 2023-10-09T06:43:24.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.729+0000 7fe66499a700 1 -- 172.21.15.71:0/1755467366 learned_addr learned my addr 172.21.15.71:0/1755467366 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:24.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.729+0000 7fe66599c700 1 --2- 172.21.15.71:0/1755467366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe660158210 0x7fe6600c1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:24.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.729+0000 7fe66519b700 1 --2- 172.21.15.71:0/1755467366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe64c004810 0x7fe66015a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:24.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.729+0000 7fe66499a700 1 -- 172.21.15.71:0/1755467366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe64c004810 msgr2=0x7fe66015a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:24.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.729+0000 7fe66499a700 1 --2- 172.21.15.71:0/1755467366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe64c004810 0x7fe66015a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:24.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.729+0000 7fe66499a700 1 -- 172.21.15.71:0/1755467366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe660158210 msgr2=0x7fe6600c1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:24.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.729+0000 7fe66499a700 1 --2- 172.21.15.71:0/1755467366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe660158210 0x7fe6600c1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:24.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.729+0000 7fe66499a700 1 -- 172.21.15.71:0/1755467366 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6601586e0 con 0x7fe66016a280 2023-10-09T06:43:24.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.729+0000 7fe66599c700 1 --2- 172.21.15.71:0/1755467366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe660158210 0x7fe6600c1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:24.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.729+0000 7fe66499a700 1 --2- 172.21.15.71:0/1755467366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe66016a280 0x7fe660157cd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00e340 tx=0x7fe650015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:24.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.729+0000 7fe6557fa700 1 -- 172.21.15.71:0/1755467366 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65000c800 con 0x7fe66016a280 2023-10-09T06:43:24.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.729+0000 7fe6557fa700 1 -- 172.21.15.71:0/1755467366 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65000c960 con 0x7fe66016a280 2023-10-09T06:43:24.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.729+0000 7fe6557fa700 1 -- 172.21.15.71:0/1755467366 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65000cd20 con 0x7fe66016a280 2023-10-09T06:43:24.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.729+0000 7fe66619d700 1 -- 172.21.15.71:0/1755467366 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6601589c0 con 0x7fe66016a280 2023-10-09T06:43:24.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.730+0000 7fe66619d700 1 -- 172.21.15.71:0/1755467366 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6601696f0 con 0x7fe66016a280 2023-10-09T06:43:24.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.730+0000 7fe66619d700 1 -- 172.21.15.71:0/1755467366 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6600648d0 con 0x7fe66016a280 2023-10-09T06:43:24.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.731+0000 7fe6557fa700 1 -- 172.21.15.71:0/1755467366 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe65001f620 con 0x7fe66016a280 2023-10-09T06:43:24.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.732+0000 7fe6557fa700 1 --2- 172.21.15.71:0/1755467366 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe644066f30 0x7fe6440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:24.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.732+0000 7fe6557fa700 1 -- 172.21.15.71:0/1755467366 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe650085bc0 con 0x7fe66016a280 2023-10-09T06:43:24.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.732+0000 7fe66519b700 1 --2- 172.21.15.71:0/1755467366 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe644066f30 0x7fe6440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:24.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.733+0000 7fe66519b700 1 --2- 172.21.15.71:0/1755467366 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe644066f30 0x7fe6440693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0015a0 tx=0x7fe65c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:24.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:24.736+0000 7fe6557fa700 1 -- 172.21.15.71:0/1755467366 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6500530e0 con 0x7fe66016a280 2023-10-09T06:43:25.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.003+0000 7fe66619d700 1 -- 172.21.15.71:0/1755467366 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe66004c3c0 con 0x7fe66016a280 2023-10-09T06:43:25.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.003+0000 7fe6557fa700 1 -- 172.21.15.71:0/1755467366 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fe650023090 con 0x7fe66016a280 2023-10-09T06:43:25.004 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:25.004 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T06:43:25.005 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_dump": [ 2023-10-09T06:43:25.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.005 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.a", 2023-10-09T06:43:25.005 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlpI5JCRAAGBgrs6g+6KZFXv1eq0fkwQ==", 2023-10-09T06:43:25.005 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.005 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:43:25.005 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:43:25.005 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:43:25.005 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:43:25.005 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.006 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.b", 2023-10-09T06:43:25.006 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlDZQYHhAA2LGKHPLrBVKlGMK0TKup7A==", 2023-10-09T06:43:25.006 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.006 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:43:25.006 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:43:25.006 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:43:25.006 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:43:25.006 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.007 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.c", 2023-10-09T06:43:25.007 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlLKKfExAA65+KIyYd16iQ2L5topDPkg==", 2023-10-09T06:43:25.007 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.007 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:43:25.007 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:43:25.007 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:43:25.007 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:43:25.007 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.007 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.d", 2023-10-09T06:43:25.008 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlpQKTKBAAP59h/znElthIdqbK9tKJww==", 2023-10-09T06:43:25.008 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.008 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:43:25.008 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:43:25.008 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:43:25.008 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:43:25.008 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.008 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.0", 2023-10-09T06:43:25.008 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCgoCNll7hBIBAAtZ8mBx+MPAwEou48boP4Hw==", 2023-10-09T06:43:25.009 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.009 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:43:25.009 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:43:25.009 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:43:25.009 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.009 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.1", 2023-10-09T06:43:25.009 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCjoCNl7uRMIxAAztQi4ZsulyN2FHcMRzZ82Q==", 2023-10-09T06:43:25.009 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.009 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:43:25.010 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:43:25.010 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:43:25.010 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.010 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.2", 2023-10-09T06:43:25.010 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCmoCNlW/cNJhAAfFdnRC95YJwpCngJS956cA==", 2023-10-09T06:43:25.010 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.010 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:43:25.010 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:43:25.010 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:43:25.011 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.011 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.3", 2023-10-09T06:43:25.011 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCpoCNlAIlYKRAAD5IGHWZ14ckpQAU4wBifbg==", 2023-10-09T06:43:25.011 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.011 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:43:25.011 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:43:25.011 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:43:25.011 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.012 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.4", 2023-10-09T06:43:25.012 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCvoCNltrA4ORAAtifmL9hr1xKd+jsMf5Nf+Q==", 2023-10-09T06:43:25.012 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.012 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:43:25.012 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:43:25.012 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:43:25.012 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.012 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.5", 2023-10-09T06:43:25.013 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCyoCNlA/IOOxAAQWRPQ+00o9xrpScAvY/87w==", 2023-10-09T06:43:25.013 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.013 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:43:25.013 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:43:25.013 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:43:25.013 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.013 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.6", 2023-10-09T06:43:25.013 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQC2oCNlvRusARAAcRaGyCROIRVTHeKhrncN8g==", 2023-10-09T06:43:25.013 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.014 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:43:25.014 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:43:25.014 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:43:25.014 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.014 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.7", 2023-10-09T06:43:25.014 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQC5oCNli/3NAxAAIMYuED41ZSx1xF384N6y1A==", 2023-10-09T06:43:25.014 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.014 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:43:25.014 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:43:25.015 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:43:25.015 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.015 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.0", 2023-10-09T06:43:25.015 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlHrKWMRAAyIfmryGSgqIFwWEJyixprw==", 2023-10-09T06:43:25.015 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.015 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:43:25.015 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T06:43:25.015 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T06:43:25.015 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T06:43:25.015 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.016 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.1", 2023-10-09T06:43:25.016 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCdoCNldq1xAxAAxCpmelS0qDEY187u19JkcQ==", 2023-10-09T06:43:25.016 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.016 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:43:25.016 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T06:43:25.016 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T06:43:25.016 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T06:43:25.016 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.017 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.2", 2023-10-09T06:43:25.017 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlM3JHOBAA8fszREXH+WnYb+3vIaakcA==", 2023-10-09T06:43:25.017 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.017 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:43:25.017 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T06:43:25.017 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T06:43:25.017 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T06:43:25.017 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.017 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.3", 2023-10-09T06:43:25.018 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCdoCNlgkEqChAAwntdv9UOo30x40pVa70yag==", 2023-10-09T06:43:25.018 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.018 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:43:25.018 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T06:43:25.018 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T06:43:25.018 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T06:43:25.018 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.018 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.admin", 2023-10-09T06:43:25.018 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCboCNlj2W4EhAAUnfX6NBeDyMj2nY/G2ciEg==", 2023-10-09T06:43:25.019 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.019 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T06:43:25.019 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:43:25.019 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:43:25.019 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:43:25.019 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.019 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-mds", 2023-10-09T06:43:25.019 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQDFoCNlPhzmJhAAcR+32bovNQjjA3rXt19PhA==", 2023-10-09T06:43:25.019 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.020 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-mds" 2023-10-09T06:43:25.020 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.020 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-mgr", 2023-10-09T06:43:25.020 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQDFoCNlUibmJhAAljBMlDBQ2adzuM1BmZU0cg==", 2023-10-09T06:43:25.020 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.020 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-09T06:43:25.020 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.020 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-osd", 2023-10-09T06:43:25.021 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQDFoCNlLzDmJhAA1lfJ5PCd4baxPr+VRHyrQQ==", 2023-10-09T06:43:25.021 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.021 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-osd" 2023-10-09T06:43:25.021 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.021 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-rbd", 2023-10-09T06:43:25.021 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQDFoCNlxTjmJhAA7LnstJJY23Tb2U1Hk2/21Q==", 2023-10-09T06:43:25.021 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.021 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-09T06:43:25.021 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.022 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-09T06:43:25.022 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQDFoCNlkUHmJhAAAqt/nsStrV9r33/hZSOziQ==", 2023-10-09T06:43:25.022 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.022 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-09T06:43:25.022 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.022 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-rgw", 2023-10-09T06:43:25.022 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQDFoCNlQlHmJhAAlZPtkF3uBMVo09B0wCiegw==", 2023-10-09T06:43:25.023 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.023 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-09T06:43:25.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.023 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.x", 2023-10-09T06:43:25.023 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlwwJ/AhAAjHMhAX1/yWgh9no7yQqP6Q==", 2023-10-09T06:43:25.023 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.023 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T06:43:25.023 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-09T06:43:25.023 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:43:25.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:43:25.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:25.024 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.y", 2023-10-09T06:43:25.024 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCboCNly/XVNRAAlKr9arCbsDbzZ9bpIU5dng==", 2023-10-09T06:43:25.024 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:43:25.024 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T06:43:25.024 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-09T06:43:25.024 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:43:25.024 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.024 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:25.024 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2023-10-09T06:43:25.024 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T06:43:25.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.006+0000 7fe66619d700 1 -- 172.21.15.71:0/1755467366 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe644066f30 msgr2=0x7fe6440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:25.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.006+0000 7fe66619d700 1 --2- 172.21.15.71:0/1755467366 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe644066f30 0x7fe6440693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0015a0 tx=0x7fe65c009040 comp rx=0 tx=0).stop 2023-10-09T06:43:25.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.006+0000 7fe66619d700 1 -- 172.21.15.71:0/1755467366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe66016a280 msgr2=0x7fe660157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:25.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.006+0000 7fe66619d700 1 --2- 172.21.15.71:0/1755467366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe66016a280 0x7fe660157cd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00e340 tx=0x7fe650015000 comp rx=0 tx=0).stop 2023-10-09T06:43:25.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.006+0000 7fe66619d700 1 -- 172.21.15.71:0/1755467366 shutdown_connections 2023-10-09T06:43:25.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.006+0000 7fe66619d700 1 --2- 172.21.15.71:0/1755467366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe660158210 0x7fe6600c1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.006+0000 7fe66619d700 1 --2- 172.21.15.71:0/1755467366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe64c004810 0x7fe66015a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.006+0000 7fe66619d700 1 --2- 172.21.15.71:0/1755467366 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe644066f30 0x7fe6440693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.006+0000 7fe66619d700 1 --2- 172.21.15.71:0/1755467366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe66016a280 0x7fe660157cd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.006+0000 7fe66619d700 1 -- 172.21.15.71:0/1755467366 >> 172.21.15.71:0/1755467366 conn(0x7fe6600cc1f0 msgr2=0x7fe66015b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.006+0000 7fe66619d700 1 -- 172.21.15.71:0/1755467366 shutdown_connections 2023-10-09T06:43:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.006+0000 7fe66619d700 1 -- 172.21.15.71:0/1755467366 wait complete. 2023-10-09T06:43:25.027 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-09T06:43:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.207+0000 7f80f09ff700 1 Processor -- start 2023-10-09T06:43:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.207+0000 7f80f09ff700 1 -- start start 2023-10-09T06:43:25.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.209+0000 7f80f09ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ec0b1c20 0x7f80ec1572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:25.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.209+0000 7f80f09ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f80ec157820 0x7f80ec0abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:25.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.209+0000 7f80f09ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ec157c80 con 0x7f80ec0b1850 2023-10-09T06:43:25.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.209+0000 7f80f09ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80ec06fc30 con 0x7f80ec157820 2023-10-09T06:43:25.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.209+0000 7f80f09ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec0cc260 con 0x7f80ec0b1c20 2023-10-09T06:43:25.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.209+0000 7f80ea59c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f80ec0b1850 0x7f80ec0ae680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51744/0 (socket says 172.21.15.71:51744) 2023-10-09T06:43:25.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.209+0000 7f80ea59c700 1 -- 172.21.15.71:0/3336156758 learned_addr learned my addr 172.21.15.71:0/3336156758 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.209+0000 7f80ead9d700 1 --2- 172.21.15.71:0/3336156758 >> v2:172.21.15.179:3300/0 conn(0x7f80ec157820 0x7f80ec0abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.209+0000 7f80e9d9b700 1 --2- 172.21.15.71:0/3336156758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ec0b1c20 0x7f80ec1572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.209+0000 7f80e959a700 1 -- 172.21.15.71:0/3336156758 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593171423 0 0) 0x7f80ec157c80 con 0x7f80ec0b1850 2023-10-09T06:43:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.209+0000 7f80e959a700 1 -- 172.21.15.71:0/3336156758 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80d4003570 con 0x7f80ec0b1850 2023-10-09T06:43:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.210+0000 7f80e959a700 1 -- 172.21.15.71:0/3336156758 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3456468679 0 0) 0x7f80d4003570 con 0x7f80ec0b1850 2023-10-09T06:43:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.210+0000 7f80e959a700 1 -- 172.21.15.71:0/3336156758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ec0b1c20 msgr2=0x7f80ec1572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.210+0000 7f80e959a700 1 --2- 172.21.15.71:0/3336156758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ec0b1c20 0x7f80ec1572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.210+0000 7f80e959a700 1 -- 172.21.15.71:0/3336156758 >> v2:172.21.15.179:3300/0 conn(0x7f80ec157820 msgr2=0x7f80ec0abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:25.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.210+0000 7f80e959a700 1 --2- 172.21.15.71:0/3336156758 >> v2:172.21.15.179:3300/0 conn(0x7f80ec157820 0x7f80ec0abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.210+0000 7f80e959a700 1 -- 172.21.15.71:0/3336156758 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec0cb300 con 0x7f80ec0b1850 2023-10-09T06:43:25.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.210+0000 7f80e959a700 1 -- 172.21.15.71:0/3336156758 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f80dc001470 con 0x7f80ec0b1850 2023-10-09T06:43:25.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.210+0000 7f80e959a700 1 -- 172.21.15.71:0/3336156758 >> v1:172.21.15.71:6789/0 conn(0x7f80ec0b1850 legacy=0x7f80ec0ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:25.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.210+0000 7f80e959a700 1 --2- 172.21.15.71:0/3336156758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ec0b1c20 0x7f80d4003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:25.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.210+0000 7f80e959a700 1 --2- 172.21.15.71:0/3336156758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80d40040b0 0x7f80d4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:25.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.210+0000 7f80e959a700 1 --2- 172.21.15.71:0/3336156758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80d4004d50 0x7f80d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:25.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.210+0000 7f80e959a700 1 -- 172.21.15.71:0/3336156758 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec06fc30 con 0x7f80d4004d50 2023-10-09T06:43:25.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.210+0000 7f80e959a700 1 -- 172.21.15.71:0/3336156758 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec0cc260 con 0x7f80d40040b0 2023-10-09T06:43:25.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.210+0000 7f80e959a700 1 -- 172.21.15.71:0/3336156758 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d400bb60 con 0x7f80ec0b1c20 2023-10-09T06:43:25.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.210+0000 7f80ead9d700 1 --2- 172.21.15.71:0/3336156758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80d4004d50 0x7f80d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:25.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.210+0000 7f80e9d9b700 1 --2- 172.21.15.71:0/3336156758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80d40040b0 0x7f80d4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:25.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.210+0000 7f80ea59c700 1 --2- 172.21.15.71:0/3336156758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ec0b1c20 0x7f80d4003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:25.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.210+0000 7f80ead9d700 1 -- 172.21.15.71:0/3336156758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ec0b1c20 msgr2=0x7f80d4003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:25.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.210+0000 7f80ead9d700 1 --2- 172.21.15.71:0/3336156758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ec0b1c20 0x7f80d4003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.210+0000 7f80ead9d700 1 -- 172.21.15.71:0/3336156758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80d40040b0 msgr2=0x7f80d4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:25.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.210+0000 7f80ead9d700 1 --2- 172.21.15.71:0/3336156758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80d40040b0 0x7f80d4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.210+0000 7f80ead9d700 1 -- 172.21.15.71:0/3336156758 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d4003570 con 0x7f80d4004d50 2023-10-09T06:43:25.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.210+0000 7f80ea59c700 1 --2- 172.21.15.71:0/3336156758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ec0b1c20 0x7f80d4003ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:25.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.211+0000 7f80ead9d700 1 --2- 172.21.15.71:0/3336156758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80d4004d50 0x7f80d40051c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f80e40094d0 tx=0x7f80e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c7b48e891fc4b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:25.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.211+0000 7f80e959a700 1 -- 172.21.15.71:0/3336156758 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e400ea90 con 0x7f80d4004d50 2023-10-09T06:43:25.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.211+0000 7f80e959a700 1 -- 172.21.15.71:0/3336156758 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e400f040 con 0x7f80d4004d50 2023-10-09T06:43:25.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.211+0000 7f80e959a700 1 -- 172.21.15.71:0/3336156758 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e400ee20 con 0x7f80d4004d50 2023-10-09T06:43:25.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.211+0000 7f80f09ff700 1 -- 172.21.15.71:0/3336156758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80d4004d50 msgr2=0x7f80d40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:25.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.211+0000 7f80f09ff700 1 --2- 172.21.15.71:0/3336156758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80d4004d50 0x7f80d40051c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f80e40094d0 tx=0x7f80e400b040 comp rx=0 tx=0).stop 2023-10-09T06:43:25.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.211+0000 7f80ead9d700 1 -- 172.21.15.71:0/3336156758 reap_dead start 2023-10-09T06:43:25.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.211+0000 7f80f09ff700 1 -- 172.21.15.71:0/3336156758 shutdown_connections 2023-10-09T06:43:25.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.211+0000 7f80f09ff700 1 -- 172.21.15.71:0/3336156758 >> 172.21.15.71:0/3336156758 conn(0x7f80ec06a320 msgr2=0x7f80ec0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:25.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.211+0000 7f80f09ff700 1 -- 172.21.15.71:0/3336156758 shutdown_connections 2023-10-09T06:43:25.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.212+0000 7f80f09ff700 1 -- 172.21.15.71:0/3336156758 wait complete. 2023-10-09T06:43:25.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.213+0000 7f80f09ff700 1 Processor -- start 2023-10-09T06:43:25.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.213+0000 7f80f09ff700 1 -- start start 2023-10-09T06:43:25.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.214+0000 7f80f09ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80d4004d50 0x7f80ec15c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:25.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.214+0000 7f80f09ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ec168510 0x7f80ec15b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:25.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.214+0000 7f80f09ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80ec0a6120 0x7f80ec144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:25.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.214+0000 7f80f09ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec15ceb0 con 0x7f80ec0a6120 2023-10-09T06:43:25.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.214+0000 7f80f09ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec15bbb0 con 0x7f80d4004d50 2023-10-09T06:43:25.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.214+0000 7f80f09ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec15be90 con 0x7f80ec168510 2023-10-09T06:43:25.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.214+0000 7f80ead9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80ec0a6120 0x7f80ec144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:25.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.214+0000 7f80ead9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80ec0a6120 0x7f80ec144b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59150/0 (socket says 172.21.15.71:59150) 2023-10-09T06:43:25.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.214+0000 7f80ead9d700 1 -- 172.21.15.71:0/4197178697 learned_addr learned my addr 172.21.15.71:0/4197178697 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:25.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.215+0000 7f80ea59c700 1 --2- 172.21.15.71:0/4197178697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80d4004d50 0x7f80ec15c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:25.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.215+0000 7f80ead9d700 1 -- 172.21.15.71:0/4197178697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ec168510 msgr2=0x7f80ec15b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:25.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.215+0000 7f80e9d9b700 1 --2- 172.21.15.71:0/4197178697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ec168510 0x7f80ec15b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:25.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.215+0000 7f80ead9d700 1 --2- 172.21.15.71:0/4197178697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ec168510 0x7f80ec15b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.215+0000 7f80ead9d700 1 -- 172.21.15.71:0/4197178697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80d4004d50 msgr2=0x7f80ec15c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:25.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.215+0000 7f80ead9d700 1 --2- 172.21.15.71:0/4197178697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80d4004d50 0x7f80ec15c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.215+0000 7f80ead9d700 1 -- 172.21.15.71:0/4197178697 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec15c170 con 0x7f80ec0a6120 2023-10-09T06:43:25.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.215+0000 7f80ea59c700 1 --2- 172.21.15.71:0/4197178697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80d4004d50 0x7f80ec15c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:25.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.215+0000 7f80e9d9b700 1 --2- 172.21.15.71:0/4197178697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ec168510 0x7f80ec15b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:25.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.215+0000 7f80ead9d700 1 --2- 172.21.15.71:0/4197178697 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80ec0a6120 0x7f80ec144b60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f80d4004760 tx=0x7f80e401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:25.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.215+0000 7f80da7fc700 1 -- 172.21.15.71:0/4197178697 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e400ee90 con 0x7f80ec0a6120 2023-10-09T06:43:25.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.215+0000 7f80da7fc700 1 -- 172.21.15.71:0/4197178697 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e401d630 con 0x7f80ec0a6120 2023-10-09T06:43:25.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.215+0000 7f80f09ff700 1 -- 172.21.15.71:0/4197178697 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ec15c450 con 0x7f80ec0a6120 2023-10-09T06:43:25.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.215+0000 7f80da7fc700 1 -- 172.21.15.71:0/4197178697 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e401d9f0 con 0x7f80ec0a6120 2023-10-09T06:43:25.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.215+0000 7f80f09ff700 1 -- 172.21.15.71:0/4197178697 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ec0a65c0 con 0x7f80ec0a6120 2023-10-09T06:43:25.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.216+0000 7f80f09ff700 1 -- 172.21.15.71:0/4197178697 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80ec15c670 con 0x7f80ec0a6120 2023-10-09T06:43:25.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.217+0000 7f80da7fc700 1 -- 172.21.15.71:0/4197178697 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80e4003040 con 0x7f80ec0a6120 2023-10-09T06:43:25.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.218+0000 7f80da7fc700 1 --2- 172.21.15.71:0/4197178697 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f80cc066f30 0x7f80cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:25.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.218+0000 7f80da7fc700 1 -- 172.21.15.71:0/4197178697 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f80e40852d0 con 0x7f80ec0a6120 2023-10-09T06:43:25.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.218+0000 7f80ea59c700 1 --2- 172.21.15.71:0/4197178697 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f80cc066f30 0x7f80cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:25.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.220+0000 7f80ea59c700 1 --2- 172.21.15.71:0/4197178697 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f80cc066f30 0x7f80cc0693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f80dc001c50 tx=0x7f80dc0014c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:25.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.222+0000 7f80da7fc700 1 -- 172.21.15.71:0/4197178697 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80e4052870 con 0x7f80ec0a6120 2023-10-09T06:43:25.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.487+0000 7f80f09ff700 1 -- 172.21.15.71:0/4197178697 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f80ec04c3c0 con 0x7f80ec0a6120 2023-10-09T06:43:25.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.491+0000 7f80da7fc700 1 -- 172.21.15.71:0/4197178697 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f80e4055e90 con 0x7f80ec0a6120 2023-10-09T06:43:25.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.493+0000 7f80f09ff700 1 -- 172.21.15.71:0/4197178697 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f80cc066f30 msgr2=0x7f80cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:25.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.493+0000 7f80f09ff700 1 --2- 172.21.15.71:0/4197178697 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f80cc066f30 0x7f80cc0693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f80dc001c50 tx=0x7f80dc0014c0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.493+0000 7f80f09ff700 1 -- 172.21.15.71:0/4197178697 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80ec0a6120 msgr2=0x7f80ec144b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:25.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.493+0000 7f80f09ff700 1 --2- 172.21.15.71:0/4197178697 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80ec0a6120 0x7f80ec144b60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f80d4004760 tx=0x7f80e401a000 comp rx=0 tx=0).stop 2023-10-09T06:43:25.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.493+0000 7f80f09ff700 1 -- 172.21.15.71:0/4197178697 shutdown_connections 2023-10-09T06:43:25.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.493+0000 7f80f09ff700 1 --2- 172.21.15.71:0/4197178697 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f80cc066f30 0x7f80cc0693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.493+0000 7f80f09ff700 1 --2- 172.21.15.71:0/4197178697 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80ec0a6120 0x7f80ec144b60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.493+0000 7f80f09ff700 1 --2- 172.21.15.71:0/4197178697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80d4004d50 0x7f80ec15c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.493+0000 7f80f09ff700 1 --2- 172.21.15.71:0/4197178697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80ec168510 0x7f80ec15b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.494+0000 7f80f09ff700 1 -- 172.21.15.71:0/4197178697 >> 172.21.15.71:0/4197178697 conn(0x7f80ec06a320 msgr2=0x7f80ec152cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:25.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.494+0000 7f80f09ff700 1 -- 172.21.15.71:0/4197178697 shutdown_connections 2023-10-09T06:43:25.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.494+0000 7f80f09ff700 1 -- 172.21.15.71:0/4197178697 wait complete. 2023-10-09T06:43:25.512 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-09T06:43:25.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.693+0000 7f7f083ff700 1 Processor -- start 2023-10-09T06:43:25.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.693+0000 7f7f083ff700 1 -- start start 2023-10-09T06:43:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.695+0000 7f7f083ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7f001578b0 0x7f7f00155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.695+0000 7f7f083ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f000ad930 con 0x7f7f000af2f0 2023-10-09T06:43:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.695+0000 7f7f083ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f000acd20 con 0x7f7f00155c10 2023-10-09T06:43:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.695+0000 7f7f083ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f000ad000 con 0x7f7f001578b0 2023-10-09T06:43:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.695+0000 7f7f0699c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f7f000af2f0 0x7f7f000af730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51746/0 (socket says 172.21.15.71:51746) 2023-10-09T06:43:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.695+0000 7f7f0699c700 1 -- 172.21.15.71:0/604542518 learned_addr learned my addr 172.21.15.71:0/604542518 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.695+0000 7f7f0599a700 1 --2- 172.21.15.71:0/604542518 >> v2:172.21.15.179:3300/0 conn(0x7f7f001578b0 0x7f7f00155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.695+0000 7f7f05199700 1 -- 172.21.15.71:0/604542518 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2526245572 0 0) 0x7f7f000ad930 con 0x7f7f000af2f0 2023-10-09T06:43:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.695+0000 7f7f05199700 1 -- 172.21.15.71:0/604542518 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eec003570 con 0x7f7f000af2f0 2023-10-09T06:43:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.696+0000 7f7f0599a700 1 -- 172.21.15.71:0/604542518 >> v1:172.21.15.179:6789/0 conn(0x7f7f00155c10 legacy=0x7f7f000ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.696+0000 7f7f05199700 1 -- 172.21.15.71:0/604542518 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1895425137 0 0) 0x7f7f000acd20 con 0x7f7f00155c10 2023-10-09T06:43:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.696+0000 7f7f0599a700 1 -- 172.21.15.71:0/604542518 >> v1:172.21.15.71:6789/0 conn(0x7f7f000af2f0 legacy=0x7f7f000af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.696+0000 7f7f0599a700 1 -- 172.21.15.71:0/604542518 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f000ad2e0 con 0x7f7f001578b0 2023-10-09T06:43:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.696+0000 7f7f0599a700 1 --2- 172.21.15.71:0/604542518 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f001578b0 0x7f7f00155fe0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00098e0 tx=0x7f7ef00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=301cc48da0e5ee0d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.696+0000 7f7f05199700 1 -- 172.21.15.71:0/604542518 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef80017f0 con 0x7f7f001578b0 2023-10-09T06:43:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.696+0000 7f7f05199700 1 -- 172.21.15.71:0/604542518 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef0011420 con 0x7f7f001578b0 2023-10-09T06:43:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.696+0000 7f7f05199700 1 -- 172.21.15.71:0/604542518 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef00117c0 con 0x7f7f001578b0 2023-10-09T06:43:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.697+0000 7f7f083ff700 1 -- 172.21.15.71:0/604542518 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f001578b0 msgr2=0x7f7f00155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.697+0000 7f7f083ff700 1 --2- 172.21.15.71:0/604542518 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f001578b0 0x7f7f00155fe0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00098e0 tx=0x7f7ef00091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.697+0000 7f7f083ff700 1 -- 172.21.15.71:0/604542518 shutdown_connections 2023-10-09T06:43:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.697+0000 7f7f083ff700 1 --2- 172.21.15.71:0/604542518 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f001578b0 0x7f7f00155fe0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.697+0000 7f7f083ff700 1 -- 172.21.15.71:0/604542518 >> 172.21.15.71:0/604542518 conn(0x7f7f0006a320 msgr2=0x7f7f000cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.697+0000 7f7f083ff700 1 -- 172.21.15.71:0/604542518 shutdown_connections 2023-10-09T06:43:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.697+0000 7f7f083ff700 1 -- 172.21.15.71:0/604542518 wait complete. 2023-10-09T06:43:25.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.698+0000 7f7f083ff700 1 Processor -- start 2023-10-09T06:43:25.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.699+0000 7f7f083ff700 1 -- start start 2023-10-09T06:43:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.699+0000 7f7f083ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f000af2f0 0x7f7f000c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.699+0000 7f7f083ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f00155c10 0x7f7f00144f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.699+0000 7f7f083ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f001578b0 0x7f7f00159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.699+0000 7f7f083ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0006de50 con 0x7f7f000af2f0 2023-10-09T06:43:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.699+0000 7f7f083ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f000ca6e0 con 0x7f7f00155c10 2023-10-09T06:43:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.699+0000 7f7f083ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f000cc800 con 0x7f7f001578b0 2023-10-09T06:43:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.700+0000 7f7f0619b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f000af2f0 0x7f7f000c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.700+0000 7f7f0619b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f000af2f0 0x7f7f000c9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59158/0 (socket says 172.21.15.71:59158) 2023-10-09T06:43:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.700+0000 7f7f0619b700 1 -- 172.21.15.71:0/3767363350 learned_addr learned my addr 172.21.15.71:0/3767363350 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.700+0000 7f7f0599a700 1 --2- 172.21.15.71:0/3767363350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f00155c10 0x7f7f00144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.700+0000 7f7f0699c700 1 --2- 172.21.15.71:0/3767363350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f001578b0 0x7f7f00159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.700+0000 7f7f0619b700 1 -- 172.21.15.71:0/3767363350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f001578b0 msgr2=0x7f7f00159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.700+0000 7f7f0619b700 1 --2- 172.21.15.71:0/3767363350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f001578b0 0x7f7f00159060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.700+0000 7f7f0619b700 1 -- 172.21.15.71:0/3767363350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f00155c10 msgr2=0x7f7f00144f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.700+0000 7f7f0619b700 1 --2- 172.21.15.71:0/3767363350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f00155c10 0x7f7f00144f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.700+0000 7f7f0619b700 1 -- 172.21.15.71:0/3767363350 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef0009420 con 0x7f7f000af2f0 2023-10-09T06:43:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.700+0000 7f7f0599a700 1 --2- 172.21.15.71:0/3767363350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f00155c10 0x7f7f00144f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.700+0000 7f7f0619b700 1 --2- 172.21.15.71:0/3767363350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f000af2f0 0x7f7f000c9890 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00c7e0 tx=0x7f7efc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.700+0000 7f7ef67fc700 1 -- 172.21.15.71:0/3767363350 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc012700 con 0x7f7f000af2f0 2023-10-09T06:43:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.700+0000 7f7ef67fc700 1 -- 172.21.15.71:0/3767363350 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc012880 con 0x7f7f000af2f0 2023-10-09T06:43:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.701+0000 7f7f083ff700 1 -- 172.21.15.71:0/3767363350 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f000ccae0 con 0x7f7f000af2f0 2023-10-09T06:43:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.701+0000 7f7ef67fc700 1 -- 172.21.15.71:0/3767363350 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc012c40 con 0x7f7f000af2f0 2023-10-09T06:43:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.701+0000 7f7f083ff700 1 -- 172.21.15.71:0/3767363350 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f001454b0 con 0x7f7f000af2f0 2023-10-09T06:43:25.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.702+0000 7f7f083ff700 1 -- 172.21.15.71:0/3767363350 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0004c3c0 con 0x7f7f000af2f0 2023-10-09T06:43:25.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.703+0000 7f7ef67fc700 1 -- 172.21.15.71:0/3767363350 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7efc01b400 con 0x7f7f000af2f0 2023-10-09T06:43:25.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.703+0000 7f7ef67fc700 1 --2- 172.21.15.71:0/3767363350 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ee4066f30 0x7f7ee40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:25.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.703+0000 7f7ef67fc700 1 -- 172.21.15.71:0/3767363350 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7efc083d90 con 0x7f7f000af2f0 2023-10-09T06:43:25.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.704+0000 7f7f0599a700 1 --2- 172.21.15.71:0/3767363350 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ee4066f30 0x7f7ee40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:25.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.705+0000 7f7f0599a700 1 --2- 172.21.15.71:0/3767363350 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ee4066f30 0x7f7ee40693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00030c0 tx=0x7f7ef0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.707+0000 7f7ef67fc700 1 -- 172.21.15.71:0/3767363350 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7efc051350 con 0x7f7f000af2f0 2023-10-09T06:43:25.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.970+0000 7f7f083ff700 1 -- 172.21.15.71:0/3767363350 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f7f000ad5c0 con 0x7f7f000af2f0 2023-10-09T06:43:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.975+0000 7f7ef67fc700 1 -- 172.21.15.71:0/3767363350 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7efc054970 con 0x7f7f000af2f0 2023-10-09T06:43:25.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.977+0000 7f7f083ff700 1 -- 172.21.15.71:0/3767363350 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ee4066f30 msgr2=0x7f7ee40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:25.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.977+0000 7f7f083ff700 1 --2- 172.21.15.71:0/3767363350 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ee4066f30 0x7f7ee40693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00030c0 tx=0x7f7ef0017000 comp rx=0 tx=0).stop 2023-10-09T06:43:25.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.977+0000 7f7f083ff700 1 -- 172.21.15.71:0/3767363350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f000af2f0 msgr2=0x7f7f000c9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:25.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.977+0000 7f7f083ff700 1 --2- 172.21.15.71:0/3767363350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f000af2f0 0x7f7f000c9890 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00c7e0 tx=0x7f7efc007df0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.977+0000 7f7f083ff700 1 -- 172.21.15.71:0/3767363350 shutdown_connections 2023-10-09T06:43:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.977+0000 7f7f083ff700 1 --2- 172.21.15.71:0/3767363350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f001578b0 0x7f7f00159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.977+0000 7f7f083ff700 1 --2- 172.21.15.71:0/3767363350 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ee4066f30 0x7f7ee40693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.977+0000 7f7f083ff700 1 --2- 172.21.15.71:0/3767363350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f000af2f0 0x7f7f000c9890 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.977+0000 7f7f083ff700 1 --2- 172.21.15.71:0/3767363350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f00155c10 0x7f7f00144f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.977+0000 7f7f083ff700 1 -- 172.21.15.71:0/3767363350 >> 172.21.15.71:0/3767363350 conn(0x7f7f0006a320 msgr2=0x7f7f00157cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.977+0000 7f7f083ff700 1 -- 172.21.15.71:0/3767363350 shutdown_connections 2023-10-09T06:43:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:25.977+0000 7f7f083ff700 1 -- 172.21.15.71:0/3767363350 wait complete. 2023-10-09T06:43:25.995 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-09T06:43:26.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.174+0000 7fc5e6fff700 1 Processor -- start 2023-10-09T06:43:26.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.174+0000 7fc5e6fff700 1 -- start start 2023-10-09T06:43:26.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.175+0000 7fc5e6fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc5e00b1c20 0x7fc5e01572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:26.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.175+0000 7fc5e6fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e0157c60 con 0x7fc5e0157820 2023-10-09T06:43:26.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.176+0000 7fc5e6fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e00cb300 con 0x7fc5e00b1850 2023-10-09T06:43:26.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.176+0000 7fc5e6fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e006fc30 con 0x7fc5e00b1c20 2023-10-09T06:43:26.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.176+0000 7fc5e559c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc5e0157820 0x7fc5e00abf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51756/0 (socket says 172.21.15.71:51756) 2023-10-09T06:43:26.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.176+0000 7fc5e559c700 1 -- 172.21.15.71:0/2749848070 learned_addr learned my addr 172.21.15.71:0/2749848070 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:26.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.176+0000 7fc5dffff700 1 --2- 172.21.15.71:0/2749848070 >> v2:172.21.15.179:3300/0 conn(0x7fc5e00b1c20 0x7fc5e01572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:26.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.176+0000 7fc5df7fe700 1 -- 172.21.15.71:0/2749848070 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823395303 0 0) 0x7fc5e0157c60 con 0x7fc5e0157820 2023-10-09T06:43:26.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.176+0000 7fc5df7fe700 1 -- 172.21.15.71:0/2749848070 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5d0003570 con 0x7fc5e0157820 2023-10-09T06:43:26.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.176+0000 7fc5dffff700 1 -- 172.21.15.71:0/2749848070 >> v1:172.21.15.179:6789/0 conn(0x7fc5e00b1850 legacy=0x7fc5e00ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.176+0000 7fc5dffff700 1 -- 172.21.15.71:0/2749848070 >> v1:172.21.15.71:6789/0 conn(0x7fc5e0157820 legacy=0x7fc5e00abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.176+0000 7fc5df7fe700 1 -- 172.21.15.71:0/2749848070 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1331708212 0 0) 0x7fc5d0003570 con 0x7fc5e0157820 2023-10-09T06:43:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.177+0000 7fc5dffff700 1 -- 172.21.15.71:0/2749848070 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e00cb5e0 con 0x7fc5e00b1c20 2023-10-09T06:43:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.177+0000 7fc5dffff700 1 --2- 172.21.15.71:0/2749848070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5e00b1c20 0x7fc5e01572e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc0098e0 tx=0x7fc5cc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93892a6bd65dea19 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:26.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.177+0000 7fc5df7fe700 1 -- 172.21.15.71:0/2749848070 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d80017f0 con 0x7fc5e00b1c20 2023-10-09T06:43:26.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.177+0000 7fc5df7fe700 1 -- 172.21.15.71:0/2749848070 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5cc011420 con 0x7fc5e00b1c20 2023-10-09T06:43:26.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.177+0000 7fc5df7fe700 1 -- 172.21.15.71:0/2749848070 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc0117c0 con 0x7fc5e00b1c20 2023-10-09T06:43:26.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.178+0000 7fc5e6fff700 1 -- 172.21.15.71:0/2749848070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5e00b1c20 msgr2=0x7fc5e01572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:26.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.178+0000 7fc5e6fff700 1 --2- 172.21.15.71:0/2749848070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5e00b1c20 0x7fc5e01572e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc0098e0 tx=0x7fc5cc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:26.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.178+0000 7fc5e6fff700 1 -- 172.21.15.71:0/2749848070 shutdown_connections 2023-10-09T06:43:26.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.178+0000 7fc5e6fff700 1 --2- 172.21.15.71:0/2749848070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5e00b1c20 0x7fc5e01572e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:26.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.178+0000 7fc5e6fff700 1 -- 172.21.15.71:0/2749848070 >> 172.21.15.71:0/2749848070 conn(0x7fc5e006a320 msgr2=0x7fc5e00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:26.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.178+0000 7fc5e6fff700 1 -- 172.21.15.71:0/2749848070 shutdown_connections 2023-10-09T06:43:26.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.178+0000 7fc5e6fff700 1 -- 172.21.15.71:0/2749848070 wait complete. 2023-10-09T06:43:26.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.179+0000 7fc5e6fff700 1 Processor -- start 2023-10-09T06:43:26.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.179+0000 7fc5e6fff700 1 -- start start 2023-10-09T06:43:26.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.180+0000 7fc5e6fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5e00b1850 0x7fc5e0155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:26.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.180+0000 7fc5e6fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5e00b1c20 0x7fc5e0169a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:26.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.180+0000 7fc5e6fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5e0157820 0x7fc5e0158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:26.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.180+0000 7fc5e6fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e00cc260 con 0x7fc5e0157820 2023-10-09T06:43:26.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.180+0000 7fc5e6fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e00b0f80 con 0x7fc5e00b1850 2023-10-09T06:43:26.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.180+0000 7fc5e6fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e00b1410 con 0x7fc5e00b1c20 2023-10-09T06:43:26.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.181+0000 7fc5e559c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5e0157820 0x7fc5e0158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:26.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.181+0000 7fc5e559c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5e0157820 0x7fc5e0158460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59166/0 (socket says 172.21.15.71:59166) 2023-10-09T06:43:26.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.181+0000 7fc5e559c700 1 -- 172.21.15.71:0/3549627943 learned_addr learned my addr 172.21.15.71:0/3549627943 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:26.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.181+0000 7fc5e4d9b700 1 --2- 172.21.15.71:0/3549627943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5e00b1850 0x7fc5e0155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:26.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.181+0000 7fc5dffff700 1 --2- 172.21.15.71:0/3549627943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5e00b1c20 0x7fc5e0169a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:26.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.181+0000 7fc5e559c700 1 -- 172.21.15.71:0/3549627943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5e00b1c20 msgr2=0x7fc5e0169a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:26.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.181+0000 7fc5e559c700 1 --2- 172.21.15.71:0/3549627943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5e00b1c20 0x7fc5e0169a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:26.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.181+0000 7fc5e559c700 1 -- 172.21.15.71:0/3549627943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5e00b1850 msgr2=0x7fc5e0155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:26.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.181+0000 7fc5e559c700 1 --2- 172.21.15.71:0/3549627943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5e00b1850 0x7fc5e0155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:26.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.181+0000 7fc5e559c700 1 -- 172.21.15.71:0/3549627943 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc009420 con 0x7fc5e0157820 2023-10-09T06:43:26.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.181+0000 7fc5e4d9b700 1 --2- 172.21.15.71:0/3549627943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5e00b1850 0x7fc5e0155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:26.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.181+0000 7fc5e559c700 1 --2- 172.21.15.71:0/3549627943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5e0157820 0x7fc5e0158460 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc5d800cbe0 tx=0x7fc5d8001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:26.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.181+0000 7fc5dcff9700 1 -- 172.21.15.71:0/3549627943 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8004dc0 con 0x7fc5e0157820 2023-10-09T06:43:26.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.181+0000 7fc5dcff9700 1 -- 172.21.15.71:0/3549627943 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d800a6b0 con 0x7fc5e0157820 2023-10-09T06:43:26.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.181+0000 7fc5dcff9700 1 -- 172.21.15.71:0/3549627943 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d800aa70 con 0x7fc5e0157820 2023-10-09T06:43:26.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.181+0000 7fc5e6fff700 1 -- 172.21.15.71:0/3549627943 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e00b0370 con 0x7fc5e0157820 2023-10-09T06:43:26.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.182+0000 7fc5e6fff700 1 -- 172.21.15.71:0/3549627943 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e00b0930 con 0x7fc5e0157820 2023-10-09T06:43:26.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.182+0000 7fc5e6fff700 1 -- 172.21.15.71:0/3549627943 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e004c3c0 con 0x7fc5e0157820 2023-10-09T06:43:26.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.183+0000 7fc5dcff9700 1 -- 172.21.15.71:0/3549627943 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc5d8007150 con 0x7fc5e0157820 2023-10-09T06:43:26.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.184+0000 7fc5dcff9700 1 --2- 172.21.15.71:0/3549627943 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc5c4066f60 0x7fc5c4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:26.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.184+0000 7fc5dcff9700 1 -- 172.21.15.71:0/3549627943 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc5d8083990 con 0x7fc5e0157820 2023-10-09T06:43:26.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.185+0000 7fc5e4d9b700 1 --2- 172.21.15.71:0/3549627943 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc5c4066f60 0x7fc5c4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:26.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.185+0000 7fc5e4d9b700 1 --2- 172.21.15.71:0/3549627943 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc5c4066f60 0x7fc5c4069410 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4007fd0 tx=0x7fc5d4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:26.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.188+0000 7fc5dcff9700 1 -- 172.21.15.71:0/3549627943 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5d8050f30 con 0x7fc5e0157820 2023-10-09T06:43:26.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.454+0000 7fc5e6fff700 1 -- 172.21.15.71:0/3549627943 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fc5e00cb8c0 con 0x7fc5e0157820 2023-10-09T06:43:26.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.458+0000 7fc5dcff9700 1 -- 172.21.15.71:0/3549627943 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc5d80180a0 con 0x7fc5e0157820 2023-10-09T06:43:26.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.460+0000 7fc5e6fff700 1 -- 172.21.15.71:0/3549627943 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc5c4066f60 msgr2=0x7fc5c4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:26.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.460+0000 7fc5e6fff700 1 --2- 172.21.15.71:0/3549627943 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc5c4066f60 0x7fc5c4069410 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4007fd0 tx=0x7fc5d4009040 comp rx=0 tx=0).stop 2023-10-09T06:43:26.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.460+0000 7fc5e6fff700 1 -- 172.21.15.71:0/3549627943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5e0157820 msgr2=0x7fc5e0158460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:26.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.460+0000 7fc5e6fff700 1 --2- 172.21.15.71:0/3549627943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5e0157820 0x7fc5e0158460 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc5d800cbe0 tx=0x7fc5d8001640 comp rx=0 tx=0).stop 2023-10-09T06:43:26.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.460+0000 7fc5e6fff700 1 -- 172.21.15.71:0/3549627943 shutdown_connections 2023-10-09T06:43:26.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.460+0000 7fc5e6fff700 1 --2- 172.21.15.71:0/3549627943 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc5c4066f60 0x7fc5c4069410 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:26.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.460+0000 7fc5e6fff700 1 --2- 172.21.15.71:0/3549627943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5e0157820 0x7fc5e0158460 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:26.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.460+0000 7fc5e6fff700 1 --2- 172.21.15.71:0/3549627943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5e00b1850 0x7fc5e0155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:26.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.460+0000 7fc5e6fff700 1 --2- 172.21.15.71:0/3549627943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5e00b1c20 0x7fc5e0169a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:26.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.460+0000 7fc5e6fff700 1 -- 172.21.15.71:0/3549627943 >> 172.21.15.71:0/3549627943 conn(0x7fc5e006a320 msgr2=0x7fc5e00ae7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:26.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.461+0000 7fc5e6fff700 1 -- 172.21.15.71:0/3549627943 shutdown_connections 2023-10-09T06:43:26.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.461+0000 7fc5e6fff700 1 -- 172.21.15.71:0/3549627943 wait complete. 2023-10-09T06:43:26.479 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-09T06:43:26.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.661+0000 7f357d7ff700 1 Processor -- start 2023-10-09T06:43:26.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.661+0000 7f357d7ff700 1 -- start start 2023-10-09T06:43:26.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.662+0000 7f357d7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f357806bcd0 0x7f35780caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:26.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.662+0000 7f357d7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f357815df50 0x7f357815e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:26.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.662+0000 7f357d7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357815d7e0 con 0x7f357806c0a0 2023-10-09T06:43:26.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.662+0000 7f357d7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357815dac0 con 0x7f357815df50 2023-10-09T06:43:26.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.662+0000 7f357d7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357815aa30 con 0x7f357806bcd0 2023-10-09T06:43:26.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.663+0000 7f35777fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f357815df50 0x7f357815e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:26.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.663+0000 7f3576ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f357806bcd0 0x7f35780caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:26.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.663+0000 7f35777fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f357815df50 0x7f357815e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:56922/0 (socket says 172.21.15.71:56922) 2023-10-09T06:43:26.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.663+0000 7f35777fe700 1 -- 172.21.15.71:0/3661249648 learned_addr learned my addr 172.21.15.71:0/3661249648 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:26.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.663+0000 7f35767fc700 1 --1- 172.21.15.71:0/3661249648 >> v1:172.21.15.179:6789/0 conn(0x7f357806c0a0 0x7f357815a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:58014/0 (socket says 172.21.15.71:58014) 2023-10-09T06:43:26.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.663+0000 7f35777fe700 1 -- 172.21.15.71:0/3661249648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f357806bcd0 msgr2=0x7f35780caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:26.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.663+0000 7f35777fe700 1 --2- 172.21.15.71:0/3661249648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f357806bcd0 0x7f35780caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:26.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.663+0000 7f35777fe700 1 -- 172.21.15.71:0/3661249648 >> v1:172.21.15.179:6789/0 conn(0x7f357806c0a0 legacy=0x7f357815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:26.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.663+0000 7f35777fe700 1 -- 172.21.15.71:0/3661249648 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357815ad10 con 0x7f357815df50 2023-10-09T06:43:26.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.663+0000 7f3576ffd700 1 --2- 172.21.15.71:0/3661249648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f357806bcd0 0x7f35780caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:43:26.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.664+0000 7f35777fe700 1 --2- 172.21.15.71:0/3661249648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f357815df50 0x7f357815e3b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3570009f20 tx=0x7f3570009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7c66370243f2050 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:26.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.664+0000 7f3575ffb700 1 -- 172.21.15.71:0/3661249648 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357000e070 con 0x7f357815df50 2023-10-09T06:43:26.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.664+0000 7f3575ffb700 1 -- 172.21.15.71:0/3661249648 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357000b9d0 con 0x7f357815df50 2023-10-09T06:43:26.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.664+0000 7f3575ffb700 1 -- 172.21.15.71:0/3661249648 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35700092e0 con 0x7f357815df50 2023-10-09T06:43:26.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.664+0000 7f357d7ff700 1 -- 172.21.15.71:0/3661249648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f357815df50 msgr2=0x7f357815e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:26.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.664+0000 7f357d7ff700 1 --2- 172.21.15.71:0/3661249648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f357815df50 0x7f357815e3b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3570009f20 tx=0x7f3570009840 comp rx=0 tx=0).stop 2023-10-09T06:43:26.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.665+0000 7f357d7ff700 1 -- 172.21.15.71:0/3661249648 shutdown_connections 2023-10-09T06:43:26.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.665+0000 7f357d7ff700 1 --2- 172.21.15.71:0/3661249648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f357815df50 0x7f357815e3b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:26.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.665+0000 7f357d7ff700 1 --2- 172.21.15.71:0/3661249648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f357806bcd0 0x7f35780caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:26.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.665+0000 7f357d7ff700 1 -- 172.21.15.71:0/3661249648 >> 172.21.15.71:0/3661249648 conn(0x7f35780ce600 msgr2=0x7f35780cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:26.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.665+0000 7f357d7ff700 1 -- 172.21.15.71:0/3661249648 shutdown_connections 2023-10-09T06:43:26.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.665+0000 7f357d7ff700 1 -- 172.21.15.71:0/3661249648 wait complete. 2023-10-09T06:43:26.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.666+0000 7f357d7ff700 1 Processor -- start 2023-10-09T06:43:26.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.666+0000 7f357d7ff700 1 -- start start 2023-10-09T06:43:26.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.667+0000 7f357d7ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f357806bcd0 0x7f3578157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:26.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.667+0000 7f357d7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f357806c0a0 0x7f3578069a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:26.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.667+0000 7f357d7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f357815df50 0x7f3578155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:26.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.667+0000 7f357d7ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35781573b0 con 0x7f357806bcd0 2023-10-09T06:43:26.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.667+0000 7f357d7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35780b3ff0 con 0x7f357806c0a0 2023-10-09T06:43:26.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.667+0000 7f357d7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35781567a0 con 0x7f357815df50 2023-10-09T06:43:26.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.667+0000 7f3576ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f357806bcd0 0x7f3578157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:26.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.667+0000 7f3576ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f357806bcd0 0x7f3578157840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59182/0 (socket says 172.21.15.71:59182) 2023-10-09T06:43:26.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.667+0000 7f3576ffd700 1 -- 172.21.15.71:0/3488060496 learned_addr learned my addr 172.21.15.71:0/3488060496 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:26.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.668+0000 7f35767fc700 1 --2- 172.21.15.71:0/3488060496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f357806c0a0 0x7f3578069a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:26.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.668+0000 7f35777fe700 1 --2- 172.21.15.71:0/3488060496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f357815df50 0x7f3578155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:26.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.668+0000 7f3576ffd700 1 -- 172.21.15.71:0/3488060496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f357815df50 msgr2=0x7f3578155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:26.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.668+0000 7f3576ffd700 1 --2- 172.21.15.71:0/3488060496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f357815df50 0x7f3578155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:26.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.668+0000 7f3576ffd700 1 -- 172.21.15.71:0/3488060496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f357806c0a0 msgr2=0x7f3578069a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:26.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.668+0000 7f3576ffd700 1 --2- 172.21.15.71:0/3488060496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f357806c0a0 0x7f3578069a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:26.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.668+0000 7f3576ffd700 1 -- 172.21.15.71:0/3488060496 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3568009420 con 0x7f357806bcd0 2023-10-09T06:43:26.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.668+0000 7f3576ffd700 1 --2- 172.21.15.71:0/3488060496 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f357806bcd0 0x7f3578157840 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f356800ec80 tx=0x7f35680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:26.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.668+0000 7f355effd700 1 -- 172.21.15.71:0/3488060496 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356800c850 con 0x7f357806bcd0 2023-10-09T06:43:26.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.669+0000 7f355effd700 1 -- 172.21.15.71:0/3488060496 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356800c9b0 con 0x7f357806bcd0 2023-10-09T06:43:26.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.669+0000 7f357d7ff700 1 -- 172.21.15.71:0/3488060496 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3570009ae0 con 0x7f357806bcd0 2023-10-09T06:43:26.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.669+0000 7f355effd700 1 -- 172.21.15.71:0/3488060496 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356800cd30 con 0x7f357806bcd0 2023-10-09T06:43:26.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.669+0000 7f357d7ff700 1 -- 172.21.15.71:0/3488060496 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3578156d60 con 0x7f357806bcd0 2023-10-09T06:43:26.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.670+0000 7f357d7ff700 1 -- 172.21.15.71:0/3488060496 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357804c3c0 con 0x7f357806bcd0 2023-10-09T06:43:26.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.670+0000 7f355effd700 1 -- 172.21.15.71:0/3488060496 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3568013680 con 0x7f357806bcd0 2023-10-09T06:43:26.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.671+0000 7f355effd700 1 --2- 172.21.15.71:0/3488060496 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3564066f30 0x7f35640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:26.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.671+0000 7f355effd700 1 -- 172.21.15.71:0/3488060496 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f35680847f0 con 0x7f357806bcd0 2023-10-09T06:43:26.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.672+0000 7f35767fc700 1 --2- 172.21.15.71:0/3488060496 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3564066f30 0x7f35640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:26.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.672+0000 7f35767fc700 1 --2- 172.21.15.71:0/3488060496 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3564066f30 0x7f35640693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3578070ad0 tx=0x7f356c007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:26.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.675+0000 7f355effd700 1 -- 172.21.15.71:0/3488060496 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35680557a0 con 0x7f357806bcd0 2023-10-09T06:43:26.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.942+0000 7f357d7ff700 1 -- 172.21.15.71:0/3488060496 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f357815aff0 con 0x7f357806bcd0 2023-10-09T06:43:26.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.946+0000 7f355effd700 1 -- 172.21.15.71:0/3488060496 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3568055330 con 0x7f357806bcd0 2023-10-09T06:43:26.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.948+0000 7f357d7ff700 1 -- 172.21.15.71:0/3488060496 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3564066f30 msgr2=0x7f35640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:26.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.948+0000 7f357d7ff700 1 --2- 172.21.15.71:0/3488060496 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3564066f30 0x7f35640693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3578070ad0 tx=0x7f356c007eb0 comp rx=0 tx=0).stop 2023-10-09T06:43:26.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.948+0000 7f357d7ff700 1 -- 172.21.15.71:0/3488060496 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f357806bcd0 msgr2=0x7f3578157840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:26.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.948+0000 7f357d7ff700 1 --2- 172.21.15.71:0/3488060496 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f357806bcd0 0x7f3578157840 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f356800ec80 tx=0x7f35680091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:26.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.949+0000 7f357d7ff700 1 -- 172.21.15.71:0/3488060496 shutdown_connections 2023-10-09T06:43:26.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.949+0000 7f357d7ff700 1 --2- 172.21.15.71:0/3488060496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f357815df50 0x7f3578155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:26.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.949+0000 7f357d7ff700 1 --2- 172.21.15.71:0/3488060496 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3564066f30 0x7f35640693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:26.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.949+0000 7f357d7ff700 1 --2- 172.21.15.71:0/3488060496 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f357806bcd0 0x7f3578157840 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:26.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.949+0000 7f357d7ff700 1 --2- 172.21.15.71:0/3488060496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f357806c0a0 0x7f3578069a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:26.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.949+0000 7f357d7ff700 1 -- 172.21.15.71:0/3488060496 >> 172.21.15.71:0/3488060496 conn(0x7f35780ce600 msgr2=0x7f35780c3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:26.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.949+0000 7f357d7ff700 1 -- 172.21.15.71:0/3488060496 shutdown_connections 2023-10-09T06:43:26.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:26.949+0000 7f357d7ff700 1 -- 172.21.15.71:0/3488060496 wait complete. 2023-10-09T06:43:26.967 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-09T06:43:27.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.147+0000 7f34229ff700 1 Processor -- start 2023-10-09T06:43:27.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.147+0000 7f34229ff700 1 -- start start 2023-10-09T06:43:27.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.148+0000 7f34229ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f341c155c10 0x7f341c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:27.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.148+0000 7f34229ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f341c0ac230 0x7f341c0ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:27.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.148+0000 7f34229ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f341c0ad930 con 0x7f341c1568a0 2023-10-09T06:43:27.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.148+0000 7f34229ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f341c0acd20 con 0x7f341c155c10 2023-10-09T06:43:27.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.148+0000 7f34229ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341c0ad000 con 0x7f341c0ac230 2023-10-09T06:43:27.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.149+0000 7f341bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f341c155c10 0x7f341c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:27.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.149+0000 7f341bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f341c155c10 0x7f341c155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59198/0 (socket says 172.21.15.71:59198) 2023-10-09T06:43:27.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.149+0000 7f341bfff700 1 -- 172.21.15.71:0/73241067 learned_addr learned my addr 172.21.15.71:0/73241067 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:27.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.149+0000 7f341b7fe700 1 --2- 172.21.15.71:0/73241067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f341c0ac230 0x7f341c0ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:27.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.149+0000 7f341bfff700 1 -- 172.21.15.71:0/73241067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f341c0ac230 msgr2=0x7f341c0ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:27.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.149+0000 7f341bfff700 1 --2- 172.21.15.71:0/73241067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f341c0ac230 0x7f341c0ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:27.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.149+0000 7f341bfff700 1 -- 172.21.15.71:0/73241067 >> v1:172.21.15.179:6789/0 conn(0x7f341c1568a0 legacy=0x7f341c156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:27.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.149+0000 7f341bfff700 1 -- 172.21.15.71:0/73241067 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c0ad2e0 con 0x7f341c155c10 2023-10-09T06:43:27.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.149+0000 7f341b7fe700 1 --2- 172.21.15.71:0/73241067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f341c0ac230 0x7f341c0ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:27.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.149+0000 7f341bfff700 1 --2- 172.21.15.71:0/73241067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c155c10 0x7f341c155fe0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f340c0099b0 tx=0x7f340c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfcfc2224268976a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:27.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.150+0000 7f341affd700 1 -- 172.21.15.71:0/73241067 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c00b860 con 0x7f341c155c10 2023-10-09T06:43:27.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.150+0000 7f341affd700 1 -- 172.21.15.71:0/73241067 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340c00b9c0 con 0x7f341c155c10 2023-10-09T06:43:27.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.150+0000 7f341affd700 1 -- 172.21.15.71:0/73241067 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c00bd60 con 0x7f341c155c10 2023-10-09T06:43:27.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.150+0000 7f34229ff700 1 -- 172.21.15.71:0/73241067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c155c10 msgr2=0x7f341c155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:27.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.150+0000 7f34229ff700 1 --2- 172.21.15.71:0/73241067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c155c10 0x7f341c155fe0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f340c0099b0 tx=0x7f340c009250 comp rx=0 tx=0).stop 2023-10-09T06:43:27.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.150+0000 7f34229ff700 1 -- 172.21.15.71:0/73241067 shutdown_connections 2023-10-09T06:43:27.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.150+0000 7f34229ff700 1 --2- 172.21.15.71:0/73241067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c155c10 0x7f341c155fe0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:27.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.150+0000 7f34229ff700 1 --2- 172.21.15.71:0/73241067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f341c0ac230 0x7f341c0ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:27.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.150+0000 7f34229ff700 1 -- 172.21.15.71:0/73241067 >> 172.21.15.71:0/73241067 conn(0x7f341c06a320 msgr2=0x7f341c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:27.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.150+0000 7f34229ff700 1 -- 172.21.15.71:0/73241067 shutdown_connections 2023-10-09T06:43:27.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.150+0000 7f34229ff700 1 -- 172.21.15.71:0/73241067 wait complete. 2023-10-09T06:43:27.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.152+0000 7f34229ff700 1 Processor -- start 2023-10-09T06:43:27.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.152+0000 7f34229ff700 1 -- start start 2023-10-09T06:43:27.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.153+0000 7f34229ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f341c0ac230 0x7f341c15b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:27.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.153+0000 7f34229ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f341c155c10 0x7f341c0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:27.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.153+0000 7f34229ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c1568a0 0x7f341c16e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:27.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.153+0000 7f34229ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341c0cd250 con 0x7f341c1568a0 2023-10-09T06:43:27.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.153+0000 7f34229ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341c16e670 con 0x7f341c0ac230 2023-10-09T06:43:27.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.153+0000 7f34229ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341c158740 con 0x7f341c155c10 2023-10-09T06:43:27.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.153+0000 7f3420f9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c1568a0 0x7f341c16e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:27.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.153+0000 7f3420f9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c1568a0 0x7f341c16e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59212/0 (socket says 172.21.15.71:59212) 2023-10-09T06:43:27.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.153+0000 7f3420f9c700 1 -- 172.21.15.71:0/537765141 learned_addr learned my addr 172.21.15.71:0/537765141 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:27.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.153+0000 7f341bfff700 1 --2- 172.21.15.71:0/537765141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f341c0ac230 0x7f341c15b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:27.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.153+0000 7f341b7fe700 1 --2- 172.21.15.71:0/537765141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f341c155c10 0x7f341c0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:27.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.153+0000 7f3420f9c700 1 -- 172.21.15.71:0/537765141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f341c155c10 msgr2=0x7f341c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:27.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.153+0000 7f3420f9c700 1 --2- 172.21.15.71:0/537765141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f341c155c10 0x7f341c0ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:27.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.153+0000 7f3420f9c700 1 -- 172.21.15.71:0/537765141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f341c0ac230 msgr2=0x7f341c15b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:27.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.153+0000 7f3420f9c700 1 --2- 172.21.15.71:0/537765141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f341c0ac230 0x7f341c15b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:27.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.153+0000 7f3420f9c700 1 -- 172.21.15.71:0/537765141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340c0094f0 con 0x7f341c1568a0 2023-10-09T06:43:27.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.153+0000 7f341bfff700 1 --2- 172.21.15.71:0/537765141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f341c0ac230 0x7f341c15b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:27.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.154+0000 7f3420f9c700 1 --2- 172.21.15.71:0/537765141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c1568a0 0x7f341c16e130 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f341400c840 tx=0x7f3414001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:27.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.154+0000 7f3403fff700 1 -- 172.21.15.71:0/537765141 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3414012630 con 0x7f341c1568a0 2023-10-09T06:43:27.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.154+0000 7f3403fff700 1 -- 172.21.15.71:0/537765141 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34140127b0 con 0x7f341c1568a0 2023-10-09T06:43:27.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.154+0000 7f34229ff700 1 -- 172.21.15.71:0/537765141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f341c157e10 con 0x7f341c1568a0 2023-10-09T06:43:27.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.154+0000 7f3403fff700 1 -- 172.21.15.71:0/537765141 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3414012b70 con 0x7f341c1568a0 2023-10-09T06:43:27.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.154+0000 7f34229ff700 1 -- 172.21.15.71:0/537765141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f341c1583d0 con 0x7f341c1568a0 2023-10-09T06:43:27.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.155+0000 7f34229ff700 1 -- 172.21.15.71:0/537765141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f341c04c3c0 con 0x7f341c1568a0 2023-10-09T06:43:27.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.156+0000 7f3403fff700 1 -- 172.21.15.71:0/537765141 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3414003030 con 0x7f341c1568a0 2023-10-09T06:43:27.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.157+0000 7f3403fff700 1 --2- 172.21.15.71:0/537765141 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3408066f30 0x7f34080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:27.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.157+0000 7f3403fff700 1 -- 172.21.15.71:0/537765141 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f34140841a0 con 0x7f341c1568a0 2023-10-09T06:43:27.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.157+0000 7f341bfff700 1 --2- 172.21.15.71:0/537765141 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3408066f30 0x7f34080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:27.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.158+0000 7f341bfff700 1 --2- 172.21.15.71:0/537765141 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3408066f30 0x7f34080693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f340c0099b0 tx=0x7f340c018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:27.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.161+0000 7f3403fff700 1 -- 172.21.15.71:0/537765141 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3414051760 con 0x7f341c1568a0 2023-10-09T06:43:27.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.425+0000 7f34229ff700 1 -- 172.21.15.71:0/537765141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f341c0ad5c0 con 0x7f341c1568a0 2023-10-09T06:43:27.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.429+0000 7f3403fff700 1 -- 172.21.15.71:0/537765141 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3414054d80 con 0x7f341c1568a0 2023-10-09T06:43:27.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.432+0000 7f34229ff700 1 -- 172.21.15.71:0/537765141 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3408066f30 msgr2=0x7f34080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:27.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.432+0000 7f34229ff700 1 --2- 172.21.15.71:0/537765141 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3408066f30 0x7f34080693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f340c0099b0 tx=0x7f340c018000 comp rx=0 tx=0).stop 2023-10-09T06:43:27.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.432+0000 7f34229ff700 1 -- 172.21.15.71:0/537765141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c1568a0 msgr2=0x7f341c16e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:27.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.432+0000 7f34229ff700 1 --2- 172.21.15.71:0/537765141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c1568a0 0x7f341c16e130 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f341400c840 tx=0x7f3414001670 comp rx=0 tx=0).stop 2023-10-09T06:43:27.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.432+0000 7f34229ff700 1 -- 172.21.15.71:0/537765141 shutdown_connections 2023-10-09T06:43:27.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.432+0000 7f34229ff700 1 --2- 172.21.15.71:0/537765141 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3408066f30 0x7f34080693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:27.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.432+0000 7f34229ff700 1 --2- 172.21.15.71:0/537765141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c1568a0 0x7f341c16e130 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:27.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.432+0000 7f34229ff700 1 --2- 172.21.15.71:0/537765141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f341c0ac230 0x7f341c15b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:27.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.432+0000 7f34229ff700 1 --2- 172.21.15.71:0/537765141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f341c155c10 0x7f341c0ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:27.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.432+0000 7f34229ff700 1 -- 172.21.15.71:0/537765141 >> 172.21.15.71:0/537765141 conn(0x7f341c06a320 msgr2=0x7f341c154ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:27.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.432+0000 7f34229ff700 1 -- 172.21.15.71:0/537765141 shutdown_connections 2023-10-09T06:43:27.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.432+0000 7f34229ff700 1 -- 172.21.15.71:0/537765141 wait complete. 2023-10-09T06:43:27.450 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-09T06:43:27.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.630+0000 7f78829ff700 1 Processor -- start 2023-10-09T06:43:27.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.631+0000 7f78829ff700 1 -- start start 2023-10-09T06:43:27.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.632+0000 7f78829ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f787c155c10 0x7f787c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:27.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.632+0000 7f78829ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f787c0ac230 0x7f787c0ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:27.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.632+0000 7f78829ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787c0ad930 con 0x7f787c1568a0 2023-10-09T06:43:27.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.632+0000 7f78829ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787c0acd20 con 0x7f787c155c10 2023-10-09T06:43:27.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.632+0000 7f78829ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787c0ad000 con 0x7f787c0ac230 2023-10-09T06:43:27.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.632+0000 7f787bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f787c155c10 0x7f787c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:27.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.632+0000 7f787bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f787c155c10 0x7f787c155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59222/0 (socket says 172.21.15.71:59222) 2023-10-09T06:43:27.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.632+0000 7f787bfff700 1 -- 172.21.15.71:0/1515741634 learned_addr learned my addr 172.21.15.71:0/1515741634 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:27.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.632+0000 7f787b7fe700 1 --2- 172.21.15.71:0/1515741634 >> v2:172.21.15.179:3300/0 conn(0x7f787c0ac230 0x7f787c0ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:27.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.633+0000 7f787bfff700 1 -- 172.21.15.71:0/1515741634 >> v2:172.21.15.179:3300/0 conn(0x7f787c0ac230 msgr2=0x7f787c0ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:27.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.633+0000 7f787bfff700 1 --2- 172.21.15.71:0/1515741634 >> v2:172.21.15.179:3300/0 conn(0x7f787c0ac230 0x7f787c0ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:27.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.633+0000 7f787bfff700 1 -- 172.21.15.71:0/1515741634 >> v1:172.21.15.179:6789/0 conn(0x7f787c1568a0 legacy=0x7f787c156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:27.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.633+0000 7f787bfff700 1 -- 172.21.15.71:0/1515741634 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c0ad2e0 con 0x7f787c155c10 2023-10-09T06:43:27.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.633+0000 7f787bfff700 1 --2- 172.21.15.71:0/1515741634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f787c155c10 0x7f787c155fe0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f787c065bb0 tx=0x7f786c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c4642278061084 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.633+0000 7f787affd700 1 -- 172.21.15.71:0/1515741634 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c00b860 con 0x7f787c155c10 2023-10-09T06:43:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.633+0000 7f787affd700 1 -- 172.21.15.71:0/1515741634 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c00b9c0 con 0x7f787c155c10 2023-10-09T06:43:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.633+0000 7f787affd700 1 -- 172.21.15.71:0/1515741634 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c00bd60 con 0x7f787c155c10 2023-10-09T06:43:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.634+0000 7f78829ff700 1 -- 172.21.15.71:0/1515741634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f787c155c10 msgr2=0x7f787c155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.634+0000 7f78829ff700 1 --2- 172.21.15.71:0/1515741634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f787c155c10 0x7f787c155fe0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f787c065bb0 tx=0x7f786c009250 comp rx=0 tx=0).stop 2023-10-09T06:43:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.634+0000 7f78829ff700 1 -- 172.21.15.71:0/1515741634 shutdown_connections 2023-10-09T06:43:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.634+0000 7f78829ff700 1 --2- 172.21.15.71:0/1515741634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f787c155c10 0x7f787c155fe0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.634+0000 7f78829ff700 1 --2- 172.21.15.71:0/1515741634 >> v2:172.21.15.179:3300/0 conn(0x7f787c0ac230 0x7f787c0ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.634+0000 7f78829ff700 1 -- 172.21.15.71:0/1515741634 >> 172.21.15.71:0/1515741634 conn(0x7f787c06a320 msgr2=0x7f787c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.634+0000 7f78829ff700 1 -- 172.21.15.71:0/1515741634 shutdown_connections 2023-10-09T06:43:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.634+0000 7f78829ff700 1 -- 172.21.15.71:0/1515741634 wait complete. 2023-10-09T06:43:27.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.635+0000 7f78829ff700 1 Processor -- start 2023-10-09T06:43:27.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.635+0000 7f78829ff700 1 -- start start 2023-10-09T06:43:27.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.636+0000 7f78829ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f787c0ac230 0x7f787c13bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:27.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.636+0000 7f78829ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f787c155c10 0x7f787c159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:27.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.636+0000 7f78829ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f787c1568a0 0x7f787c167d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:27.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.636+0000 7f78829ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c0cae00 con 0x7f787c0ac230 2023-10-09T06:43:27.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.636+0000 7f78829ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c13c1d0 con 0x7f787c1568a0 2023-10-09T06:43:27.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.636+0000 7f78829ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787c1595e0 con 0x7f787c155c10 2023-10-09T06:43:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.636+0000 7f787bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f787c0ac230 0x7f787c13bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.637+0000 7f787bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f787c0ac230 0x7f787c13bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59234/0 (socket says 172.21.15.71:59234) 2023-10-09T06:43:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.637+0000 7f787bfff700 1 -- 172.21.15.71:0/4128640901 learned_addr learned my addr 172.21.15.71:0/4128640901 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.637+0000 7f787b7fe700 1 --2- 172.21.15.71:0/4128640901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f787c155c10 0x7f787c159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.637+0000 7f7880f9c700 1 --2- 172.21.15.71:0/4128640901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f787c1568a0 0x7f787c167d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.637+0000 7f787bfff700 1 -- 172.21.15.71:0/4128640901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f787c155c10 msgr2=0x7f787c159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.637+0000 7f787bfff700 1 --2- 172.21.15.71:0/4128640901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f787c155c10 0x7f787c159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.637+0000 7f787bfff700 1 -- 172.21.15.71:0/4128640901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f787c1568a0 msgr2=0x7f787c167d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.637+0000 7f787bfff700 1 --2- 172.21.15.71:0/4128640901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f787c1568a0 0x7f787c167d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.637+0000 7f787bfff700 1 -- 172.21.15.71:0/4128640901 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786c0094f0 con 0x7f787c0ac230 2023-10-09T06:43:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.637+0000 7f787bfff700 1 --2- 172.21.15.71:0/4128640901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f787c0ac230 0x7f787c13bc90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f786c006fd0 tx=0x7f786c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:27.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.637+0000 7f7863fff700 1 -- 172.21.15.71:0/4128640901 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c011e20 con 0x7f787c0ac230 2023-10-09T06:43:27.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.637+0000 7f7863fff700 1 -- 172.21.15.71:0/4128640901 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c01a630 con 0x7f787c0ac230 2023-10-09T06:43:27.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.637+0000 7f7863fff700 1 -- 172.21.15.71:0/4128640901 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c01a9f0 con 0x7f787c0ac230 2023-10-09T06:43:27.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.637+0000 7f78829ff700 1 -- 172.21.15.71:0/4128640901 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787c1598c0 con 0x7f787c0ac230 2023-10-09T06:43:27.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.638+0000 7f78829ff700 1 -- 172.21.15.71:0/4128640901 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f787c15a500 con 0x7f787c0ac230 2023-10-09T06:43:27.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.639+0000 7f78829ff700 1 -- 172.21.15.71:0/4128640901 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f787c04c3c0 con 0x7f787c0ac230 2023-10-09T06:43:27.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.639+0000 7f7863fff700 1 -- 172.21.15.71:0/4128640901 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f786c02d440 con 0x7f787c0ac230 2023-10-09T06:43:27.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.640+0000 7f7863fff700 1 --2- 172.21.15.71:0/4128640901 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7868066f30 0x7f78680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:27.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.640+0000 7f7863fff700 1 -- 172.21.15.71:0/4128640901 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f786c085eb0 con 0x7f787c0ac230 2023-10-09T06:43:27.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.641+0000 7f787b7fe700 1 --2- 172.21.15.71:0/4128640901 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7868066f30 0x7f78680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:27.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.641+0000 7f787b7fe700 1 --2- 172.21.15.71:0/4128640901 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7868066f30 0x7f78680693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f787c0ae990 tx=0x7f7870008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:27.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.644+0000 7f7863fff700 1 -- 172.21.15.71:0/4128640901 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f786c0533d0 con 0x7f787c0ac230 2023-10-09T06:43:27.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.910+0000 7f78829ff700 1 -- 172.21.15.71:0/4128640901 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f787c0ad5c0 con 0x7f787c0ac230 2023-10-09T06:43:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.913+0000 7f7863fff700 1 -- 172.21.15.71:0/4128640901 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f786c0569f0 con 0x7f787c0ac230 2023-10-09T06:43:27.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.916+0000 7f78829ff700 1 -- 172.21.15.71:0/4128640901 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7868066f30 msgr2=0x7f78680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:27.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.916+0000 7f78829ff700 1 --2- 172.21.15.71:0/4128640901 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7868066f30 0x7f78680693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f787c0ae990 tx=0x7f7870008040 comp rx=0 tx=0).stop 2023-10-09T06:43:27.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.916+0000 7f78829ff700 1 -- 172.21.15.71:0/4128640901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f787c0ac230 msgr2=0x7f787c13bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:27.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.916+0000 7f78829ff700 1 --2- 172.21.15.71:0/4128640901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f787c0ac230 0x7f787c13bc90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f786c006fd0 tx=0x7f786c017000 comp rx=0 tx=0).stop 2023-10-09T06:43:27.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.916+0000 7f78829ff700 1 -- 172.21.15.71:0/4128640901 shutdown_connections 2023-10-09T06:43:27.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.916+0000 7f78829ff700 1 --2- 172.21.15.71:0/4128640901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f787c1568a0 0x7f787c167d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:27.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.916+0000 7f78829ff700 1 --2- 172.21.15.71:0/4128640901 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7868066f30 0x7f78680693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:27.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.916+0000 7f78829ff700 1 --2- 172.21.15.71:0/4128640901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f787c0ac230 0x7f787c13bc90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:27.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.916+0000 7f78829ff700 1 --2- 172.21.15.71:0/4128640901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f787c155c10 0x7f787c159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:27.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.916+0000 7f78829ff700 1 -- 172.21.15.71:0/4128640901 >> 172.21.15.71:0/4128640901 conn(0x7f787c06a320 msgr2=0x7f787c152330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:27.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.916+0000 7f78829ff700 1 -- 172.21.15.71:0/4128640901 shutdown_connections 2023-10-09T06:43:27.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:27.916+0000 7f78829ff700 1 -- 172.21.15.71:0/4128640901 wait complete. 2023-10-09T06:43:27.934 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:43:28.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.114+0000 7fe400dff700 1 Processor -- start 2023-10-09T06:43:28.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.114+0000 7fe400dff700 1 -- start start 2023-10-09T06:43:28.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.115+0000 7fe400dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe3fc155c10 0x7fe3fc155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:28.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.115+0000 7fe400dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3fc0ac6d0 0x7fe3fc0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:28.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.115+0000 7fe400dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3fc0acac0 con 0x7fe3fc0ac230 2023-10-09T06:43:28.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.115+0000 7fe400dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3fc0ad930 con 0x7fe3fc155c10 2023-10-09T06:43:28.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.115+0000 7fe400dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0acd20 con 0x7fe3fc0ac6d0 2023-10-09T06:43:28.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.116+0000 7fe3fa59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe3fc155c10 0x7fe3fc155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:28.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.116+0000 7fe3fa59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe3fc155c10 0x7fe3fc155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59242/0 (socket says 172.21.15.71:59242) 2023-10-09T06:43:28.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.116+0000 7fe3fa59c700 1 -- 172.21.15.71:0/2084613854 learned_addr learned my addr 172.21.15.71:0/2084613854 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:28.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.116+0000 7fe3fad9d700 1 --2- 172.21.15.71:0/2084613854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3fc0ac6d0 0x7fe3fc0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:28.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.116+0000 7fe3fa59c700 1 -- 172.21.15.71:0/2084613854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3fc0ac6d0 msgr2=0x7fe3fc0b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:28.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.116+0000 7fe3fa59c700 1 --2- 172.21.15.71:0/2084613854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3fc0ac6d0 0x7fe3fc0b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:28.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.116+0000 7fe3fa59c700 1 -- 172.21.15.71:0/2084613854 >> v1:172.21.15.179:6789/0 conn(0x7fe3fc0ac230 legacy=0x7fe3fc1568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:28.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.116+0000 7fe3fa59c700 1 -- 172.21.15.71:0/2084613854 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc0ad000 con 0x7fe3fc155c10 2023-10-09T06:43:28.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.116+0000 7fe3fa59c700 1 --2- 172.21.15.71:0/2084613854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc155c10 0x7fe3fc155fe0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0acc50 tx=0x7fe3ec00a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8b7a8d200a4186 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:28.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.117+0000 7fe3f959a700 1 -- 172.21.15.71:0/2084613854 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec00ca40 con 0x7fe3fc155c10 2023-10-09T06:43:28.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.117+0000 7fe3f959a700 1 -- 172.21.15.71:0/2084613854 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec00cba0 con 0x7fe3fc155c10 2023-10-09T06:43:28.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.117+0000 7fe3f959a700 1 -- 172.21.15.71:0/2084613854 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec0183f0 con 0x7fe3fc155c10 2023-10-09T06:43:28.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.117+0000 7fe400dff700 1 -- 172.21.15.71:0/2084613854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc155c10 msgr2=0x7fe3fc155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:28.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.117+0000 7fe400dff700 1 --2- 172.21.15.71:0/2084613854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc155c10 0x7fe3fc155fe0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0acc50 tx=0x7fe3ec00a3f0 comp rx=0 tx=0).stop 2023-10-09T06:43:28.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.117+0000 7fe400dff700 1 -- 172.21.15.71:0/2084613854 shutdown_connections 2023-10-09T06:43:28.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.117+0000 7fe400dff700 1 --2- 172.21.15.71:0/2084613854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3fc0ac6d0 0x7fe3fc0b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:28.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.117+0000 7fe400dff700 1 --2- 172.21.15.71:0/2084613854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc155c10 0x7fe3fc155fe0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:28.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.117+0000 7fe400dff700 1 -- 172.21.15.71:0/2084613854 >> 172.21.15.71:0/2084613854 conn(0x7fe3fc06a320 msgr2=0x7fe3fc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:28.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.117+0000 7fe400dff700 1 -- 172.21.15.71:0/2084613854 shutdown_connections 2023-10-09T06:43:28.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.117+0000 7fe400dff700 1 -- 172.21.15.71:0/2084613854 wait complete. 2023-10-09T06:43:28.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.119+0000 7fe400dff700 1 Processor -- start 2023-10-09T06:43:28.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.119+0000 7fe400dff700 1 -- start start 2023-10-09T06:43:28.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.120+0000 7fe400dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc0ac230 0x7fe3fc0c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:28.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.120+0000 7fe400dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3fc0ac6d0 0x7fe3fc0a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:28.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.120+0000 7fe400dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3fc155c10 0x7fe3fc13e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:28.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.120+0000 7fe400dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0c2390 con 0x7fe3fc0ac230 2023-10-09T06:43:28.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.120+0000 7fe400dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0c2bf0 con 0x7fe3fc155c10 2023-10-09T06:43:28.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.120+0000 7fe400dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0c8100 con 0x7fe3fc0ac6d0 2023-10-09T06:43:28.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.120+0000 7fe3fa59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc0ac230 0x7fe3fc0c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:28.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.120+0000 7fe3fa59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc0ac230 0x7fe3fc0c7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59250/0 (socket says 172.21.15.71:59250) 2023-10-09T06:43:28.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.120+0000 7fe3fa59c700 1 -- 172.21.15.71:0/2727879816 learned_addr learned my addr 172.21.15.71:0/2727879816 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:28.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.120+0000 7fe3f9d9b700 1 --2- 172.21.15.71:0/2727879816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3fc0ac6d0 0x7fe3fc0a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:28.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.120+0000 7fe3fad9d700 1 --2- 172.21.15.71:0/2727879816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3fc155c10 0x7fe3fc13e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:28.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.120+0000 7fe3fa59c700 1 -- 172.21.15.71:0/2727879816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3fc0ac6d0 msgr2=0x7fe3fc0a9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:28.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.120+0000 7fe3fa59c700 1 --2- 172.21.15.71:0/2727879816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3fc0ac6d0 0x7fe3fc0a9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:28.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.120+0000 7fe3fa59c700 1 -- 172.21.15.71:0/2727879816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3fc155c10 msgr2=0x7fe3fc13e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:28.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.120+0000 7fe3fa59c700 1 --2- 172.21.15.71:0/2727879816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3fc155c10 0x7fe3fc13e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:28.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.120+0000 7fe3fa59c700 1 -- 172.21.15.71:0/2727879816 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ec00a690 con 0x7fe3fc0ac230 2023-10-09T06:43:28.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.121+0000 7fe3fa59c700 1 --2- 172.21.15.71:0/2727879816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc0ac230 0x7fe3fc0c7860 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec0030c0 tx=0x7fe3ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:28.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.121+0000 7fe3ea7fc700 1 -- 172.21.15.71:0/2727879816 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec01d070 con 0x7fe3fc0ac230 2023-10-09T06:43:28.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.121+0000 7fe3ea7fc700 1 -- 172.21.15.71:0/2727879816 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec010600 con 0x7fe3fc0ac230 2023-10-09T06:43:28.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.121+0000 7fe3ea7fc700 1 -- 172.21.15.71:0/2727879816 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec0109a0 con 0x7fe3fc0ac230 2023-10-09T06:43:28.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.121+0000 7fe400dff700 1 -- 172.21.15.71:0/2727879816 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3fc0c25a0 con 0x7fe3fc0ac230 2023-10-09T06:43:28.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.121+0000 7fe400dff700 1 -- 172.21.15.71:0/2727879816 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3fc0c7da0 con 0x7fe3fc0ac230 2023-10-09T06:43:28.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.122+0000 7fe400dff700 1 -- 172.21.15.71:0/2727879816 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3fc04c3c0 con 0x7fe3fc0ac230 2023-10-09T06:43:28.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.123+0000 7fe3ea7fc700 1 -- 172.21.15.71:0/2727879816 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe3ec021400 con 0x7fe3fc0ac230 2023-10-09T06:43:28.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.125+0000 7fe3ea7fc700 1 --2- 172.21.15.71:0/2727879816 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe3dc066f30 0x7fe3dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:28.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.125+0000 7fe3ea7fc700 1 -- 172.21.15.71:0/2727879816 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe3ec085620 con 0x7fe3fc0ac230 2023-10-09T06:43:28.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.125+0000 7fe3f9d9b700 1 --2- 172.21.15.71:0/2727879816 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe3dc066f30 0x7fe3dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:28.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.126+0000 7fe3f9d9b700 1 --2- 172.21.15.71:0/2727879816 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe3dc066f30 0x7fe3dc0693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe3f00037c0 tx=0x7fe3f0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:28.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.129+0000 7fe3ea7fc700 1 -- 172.21.15.71:0/2727879816 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3ec052b40 con 0x7fe3fc0ac230 2023-10-09T06:43:28.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.320+0000 7fe400dff700 1 -- 172.21.15.71:0/2727879816 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3fc0ad2e0 con 0x7fe3fc0ac230 2023-10-09T06:43:28.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.321+0000 7fe3ea7fc700 1 -- 172.21.15.71:0/2727879816 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12134 (secure 0 0 0) 0x7fe3ec056160 con 0x7fe3fc0ac230 2023-10-09T06:43:28.322 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:28.322 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":28,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:43:24.509280+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:43:28.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.323+0000 7fe400dff700 1 -- 172.21.15.71:0/2727879816 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe3dc066f30 msgr2=0x7fe3dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:28.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.323+0000 7fe400dff700 1 --2- 172.21.15.71:0/2727879816 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe3dc066f30 0x7fe3dc0693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe3f00037c0 tx=0x7fe3f0009040 comp rx=0 tx=0).stop 2023-10-09T06:43:28.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.323+0000 7fe400dff700 1 -- 172.21.15.71:0/2727879816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc0ac230 msgr2=0x7fe3fc0c7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:28.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.323+0000 7fe400dff700 1 --2- 172.21.15.71:0/2727879816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc0ac230 0x7fe3fc0c7860 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec0030c0 tx=0x7fe3ec017000 comp rx=0 tx=0).stop 2023-10-09T06:43:28.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.324+0000 7fe400dff700 1 -- 172.21.15.71:0/2727879816 shutdown_connections 2023-10-09T06:43:28.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.324+0000 7fe400dff700 1 --2- 172.21.15.71:0/2727879816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3fc155c10 0x7fe3fc13e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:28.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.324+0000 7fe400dff700 1 --2- 172.21.15.71:0/2727879816 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe3dc066f30 0x7fe3dc0693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:28.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.324+0000 7fe400dff700 1 --2- 172.21.15.71:0/2727879816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3fc0ac230 0x7fe3fc0c7860 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:28.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.324+0000 7fe400dff700 1 --2- 172.21.15.71:0/2727879816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3fc0ac6d0 0x7fe3fc0a9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:28.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.324+0000 7fe400dff700 1 -- 172.21.15.71:0/2727879816 >> 172.21.15.71:0/2727879816 conn(0x7fe3fc06a320 msgr2=0x7fe3fc06e850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:28.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.324+0000 7fe400dff700 1 -- 172.21.15.71:0/2727879816 shutdown_connections 2023-10-09T06:43:28.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.324+0000 7fe400dff700 1 -- 172.21.15.71:0/2727879816 wait complete. 2023-10-09T06:43:28.342 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T06:43:28.342 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:43:28.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.524+0000 7f041959d700 1 Processor -- start 2023-10-09T06:43:28.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.524+0000 7f041959d700 1 -- start start 2023-10-09T06:43:28.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.526+0000 7f041959d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f041406f060 0x7f04140ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:28.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.526+0000 7f041959d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f041406f4b0 0x7f04140ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:28.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.526+0000 7f041959d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041406ebd0 con 0x7f04140cb1a0 2023-10-09T06:43:28.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.526+0000 7f041959d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041415b2e0 con 0x7f041406f4b0 2023-10-09T06:43:28.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.526+0000 7f041959d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041415aa70 con 0x7f041406f060 2023-10-09T06:43:28.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.526+0000 7f0418d9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f041406f4b0 0x7f04140ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:28.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.526+0000 7f0418d9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f041406f4b0 0x7f04140ae610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59262/0 (socket says 172.21.15.71:59262) 2023-10-09T06:43:28.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.526+0000 7f0418d9c700 1 -- 172.21.15.71:0/530481958 learned_addr learned my addr 172.21.15.71:0/530481958 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:28.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.527+0000 7f040bfff700 1 --2- 172.21.15.71:0/530481958 >> v2:172.21.15.179:3300/0 conn(0x7f041406f060 0x7f04140ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:28.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.527+0000 7f0418d9c700 1 -- 172.21.15.71:0/530481958 >> v2:172.21.15.179:3300/0 conn(0x7f041406f060 msgr2=0x7f04140ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:28.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.527+0000 7f0418d9c700 1 --2- 172.21.15.71:0/530481958 >> v2:172.21.15.179:3300/0 conn(0x7f041406f060 0x7f04140ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:28.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.527+0000 7f0418d9c700 1 -- 172.21.15.71:0/530481958 >> v1:172.21.15.179:6789/0 conn(0x7f04140cb1a0 legacy=0x7f041415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:28.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.527+0000 7f0418d9c700 1 -- 172.21.15.71:0/530481958 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041415ad20 con 0x7f041406f4b0 2023-10-09T06:43:28.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.527+0000 7f040bfff700 1 --2- 172.21.15.71:0/530481958 >> v2:172.21.15.179:3300/0 conn(0x7f041406f060 0x7f04140ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:28.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.527+0000 7f0418d9c700 1 --2- 172.21.15.71:0/530481958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f041406f4b0 0x7f04140ae610 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0414070d30 tx=0x7f040c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c129c84037a1ec9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:28.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.527+0000 7f04137fe700 1 -- 172.21.15.71:0/530481958 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c00e070 con 0x7f041406f4b0 2023-10-09T06:43:28.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.527+0000 7f04137fe700 1 -- 172.21.15.71:0/530481958 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c00bae0 con 0x7f041406f4b0 2023-10-09T06:43:28.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.527+0000 7f04137fe700 1 -- 172.21.15.71:0/530481958 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c0092e0 con 0x7f041406f4b0 2023-10-09T06:43:28.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.528+0000 7f041959d700 1 -- 172.21.15.71:0/530481958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f041406f4b0 msgr2=0x7f04140ae610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:28.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.528+0000 7f041959d700 1 --2- 172.21.15.71:0/530481958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f041406f4b0 0x7f04140ae610 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0414070d30 tx=0x7f040c009840 comp rx=0 tx=0).stop 2023-10-09T06:43:28.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.528+0000 7f041959d700 1 -- 172.21.15.71:0/530481958 shutdown_connections 2023-10-09T06:43:28.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.528+0000 7f041959d700 1 --2- 172.21.15.71:0/530481958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f041406f4b0 0x7f04140ae610 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:28.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.528+0000 7f041959d700 1 --2- 172.21.15.71:0/530481958 >> v2:172.21.15.179:3300/0 conn(0x7f041406f060 0x7f04140ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:28.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.528+0000 7f041959d700 1 -- 172.21.15.71:0/530481958 >> 172.21.15.71:0/530481958 conn(0x7f04140cc1e0 msgr2=0x7f04140cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:28.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.528+0000 7f041959d700 1 -- 172.21.15.71:0/530481958 shutdown_connections 2023-10-09T06:43:28.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.528+0000 7f041959d700 1 -- 172.21.15.71:0/530481958 wait complete. 2023-10-09T06:43:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.529+0000 7f041959d700 1 Processor -- start 2023-10-09T06:43:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.530+0000 7f041959d700 1 -- start start 2023-10-09T06:43:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.530+0000 7f041959d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f041406f060 0x7f041415a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.530+0000 7f041959d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f041406f4b0 0x7f04140c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.530+0000 7f041959d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04140cb1a0 0x7f0414169860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.531+0000 7f041959d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04140c2150 con 0x7f041406f4b0 2023-10-09T06:43:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.531+0000 7f041959d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04140c1540 con 0x7f04140cb1a0 2023-10-09T06:43:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.531+0000 7f041959d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04140c1820 con 0x7f041406f060 2023-10-09T06:43:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.531+0000 7f040bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f041406f4b0 0x7f04140c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.531+0000 7f040bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f041406f4b0 0x7f04140c78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59278/0 (socket says 172.21.15.71:59278) 2023-10-09T06:43:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.531+0000 7f040bfff700 1 -- 172.21.15.71:0/3245361341 learned_addr learned my addr 172.21.15.71:0/3245361341 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.531+0000 7f0418d9c700 1 --2- 172.21.15.71:0/3245361341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04140cb1a0 0x7f0414169860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.531+0000 7f0413fff700 1 --2- 172.21.15.71:0/3245361341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f041406f060 0x7f041415a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.531+0000 7f040bfff700 1 -- 172.21.15.71:0/3245361341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f041406f060 msgr2=0x7f041415a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.531+0000 7f040bfff700 1 --2- 172.21.15.71:0/3245361341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f041406f060 0x7f041415a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.531+0000 7f040bfff700 1 -- 172.21.15.71:0/3245361341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04140cb1a0 msgr2=0x7f0414169860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.531+0000 7f040bfff700 1 --2- 172.21.15.71:0/3245361341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04140cb1a0 0x7f0414169860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.531+0000 7f040bfff700 1 -- 172.21.15.71:0/3245361341 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040c009ae0 con 0x7f041406f4b0 2023-10-09T06:43:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.531+0000 7f0418d9c700 1 --2- 172.21.15.71:0/3245361341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04140cb1a0 0x7f0414169860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:28.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.531+0000 7f0413fff700 1 --2- 172.21.15.71:0/3245361341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f041406f060 0x7f041415a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:28.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.531+0000 7f040bfff700 1 --2- 172.21.15.71:0/3245361341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f041406f4b0 0x7f04140c78f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00e8d0 tx=0x7f03fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:28.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.532+0000 7f0410ff9700 1 -- 172.21.15.71:0/3245361341 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc00ee70 con 0x7f041406f4b0 2023-10-09T06:43:28.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.532+0000 7f0410ff9700 1 -- 172.21.15.71:0/3245361341 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03fc00c5e0 con 0x7f041406f4b0 2023-10-09T06:43:28.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.532+0000 7f041959d700 1 -- 172.21.15.71:0/3245361341 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04140c1b00 con 0x7f041406f4b0 2023-10-09T06:43:28.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.532+0000 7f0410ff9700 1 -- 172.21.15.71:0/3245361341 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc00c980 con 0x7f041406f4b0 2023-10-09T06:43:28.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.532+0000 7f041959d700 1 -- 172.21.15.71:0/3245361341 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0414159c50 con 0x7f041406f4b0 2023-10-09T06:43:28.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.533+0000 7f041959d700 1 -- 172.21.15.71:0/3245361341 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041406c450 con 0x7f041406f4b0 2023-10-09T06:43:28.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.534+0000 7f0410ff9700 1 -- 172.21.15.71:0/3245361341 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03fc013410 con 0x7f041406f4b0 2023-10-09T06:43:28.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.535+0000 7f0410ff9700 1 --2- 172.21.15.71:0/3245361341 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f03f4066f30 0x7f03f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:28.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.535+0000 7f0410ff9700 1 -- 172.21.15.71:0/3245361341 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f03fc0840e0 con 0x7f041406f4b0 2023-10-09T06:43:28.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.535+0000 7f0413fff700 1 --2- 172.21.15.71:0/3245361341 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f03f4066f30 0x7f03f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:28.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.536+0000 7f0413fff700 1 --2- 172.21.15.71:0/3245361341 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f03f4066f30 0x7f03f40693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f04040017a0 tx=0x7f0404009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:28.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.539+0000 7f0410ff9700 1 -- 172.21.15.71:0/3245361341 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03fc051600 con 0x7f041406f4b0 2023-10-09T06:43:28.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.735+0000 7f041959d700 1 -- 172.21.15.71:0/3245361341 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f04140c2290 con 0x7f041406f4b0 2023-10-09T06:43:28.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.735+0000 7f0410ff9700 1 -- 172.21.15.71:0/3245361341 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f03fc054c20 con 0x7f041406f4b0 2023-10-09T06:43:28.736 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T06:43:28.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.738+0000 7f041959d700 1 -- 172.21.15.71:0/3245361341 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f03f4066f30 msgr2=0x7f03f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:28.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.738+0000 7f041959d700 1 --2- 172.21.15.71:0/3245361341 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f03f4066f30 0x7f03f40693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f04040017a0 tx=0x7f0404009040 comp rx=0 tx=0).stop 2023-10-09T06:43:28.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.738+0000 7f041959d700 1 -- 172.21.15.71:0/3245361341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f041406f4b0 msgr2=0x7f04140c78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:28.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.738+0000 7f041959d700 1 --2- 172.21.15.71:0/3245361341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f041406f4b0 0x7f04140c78f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00e8d0 tx=0x7f03fc008040 comp rx=0 tx=0).stop 2023-10-09T06:43:28.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.738+0000 7f041959d700 1 -- 172.21.15.71:0/3245361341 shutdown_connections 2023-10-09T06:43:28.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.738+0000 7f041959d700 1 --2- 172.21.15.71:0/3245361341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04140cb1a0 0x7f0414169860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:28.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.738+0000 7f041959d700 1 --2- 172.21.15.71:0/3245361341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f041406f060 0x7f041415a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:28.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.738+0000 7f041959d700 1 --2- 172.21.15.71:0/3245361341 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f03f4066f30 0x7f03f40693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:28.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.738+0000 7f041959d700 1 --2- 172.21.15.71:0/3245361341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f041406f4b0 0x7f04140c78f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:28.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.738+0000 7f041959d700 1 -- 172.21.15.71:0/3245361341 >> 172.21.15.71:0/3245361341 conn(0x7f04140cc1e0 msgr2=0x7f04140afea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:28.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.738+0000 7f041959d700 1 -- 172.21.15.71:0/3245361341 shutdown_connections 2023-10-09T06:43:28.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.738+0000 7f041959d700 1 -- 172.21.15.71:0/3245361341 wait complete. 2023-10-09T06:43:28.756 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T06:43:28.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.934+0000 7f0b9319d700 1 Processor -- start 2023-10-09T06:43:28.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.935+0000 7f0b9319d700 1 -- start start 2023-10-09T06:43:28.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.936+0000 7f0b9319d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0b8c150180 0x7f0b8c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:28.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.936+0000 7f0b9319d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b8c06e2a0 con 0x7f0b8c0c7410 2023-10-09T06:43:28.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.936+0000 7f0b9319d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b8c06b2e0 con 0x7f0b8c150550 2023-10-09T06:43:28.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.936+0000 7f0b9319d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b8c0c78e0 con 0x7f0b8c150180 2023-10-09T06:43:28.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.936+0000 7f0b9219b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0b8c150180 0x7f0b8c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:28.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.936+0000 7f0b9299c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f0b8c0c7410 0x7f0b8c069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51772/0 (socket says 172.21.15.71:51772) 2023-10-09T06:43:28.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.936+0000 7f0b9299c700 1 -- 172.21.15.71:0/174408380 learned_addr learned my addr 172.21.15.71:0/174408380 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:28.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.937+0000 7f0b9219b700 1 -- 172.21.15.71:0/174408380 >> v1:172.21.15.179:6789/0 conn(0x7f0b8c150550 legacy=0x7f0b8c0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:28.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.937+0000 7f0b9219b700 1 -- 172.21.15.71:0/174408380 >> v1:172.21.15.71:6789/0 conn(0x7f0b8c0c7410 legacy=0x7f0b8c069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:28.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.937+0000 7f0b9219b700 1 -- 172.21.15.71:0/174408380 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c0c7bc0 con 0x7f0b8c150180 2023-10-09T06:43:28.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.937+0000 7f0b91199700 1 -- 172.21.15.71:0/174408380 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287512114 0 0) 0x7f0b8c06e2a0 con 0x7f0b8c0c7410 2023-10-09T06:43:28.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.937+0000 7f0b9219b700 1 --2- 172.21.15.71:0/174408380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b8c150180 0x7f0b8c157770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0b880098e0 tx=0x7f0b880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1034f55dcab5f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:28.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.937+0000 7f0b91199700 1 -- 172.21.15.71:0/174408380 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88009e80 con 0x7f0b8c150180 2023-10-09T06:43:28.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.937+0000 7f0b91199700 1 -- 172.21.15.71:0/174408380 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8800b860 con 0x7f0b8c150180 2023-10-09T06:43:28.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.937+0000 7f0b91199700 1 -- 172.21.15.71:0/174408380 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8800bbe0 con 0x7f0b8c150180 2023-10-09T06:43:28.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.938+0000 7f0b9319d700 1 -- 172.21.15.71:0/174408380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b8c150180 msgr2=0x7f0b8c157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:28.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.938+0000 7f0b9319d700 1 --2- 172.21.15.71:0/174408380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b8c150180 0x7f0b8c157770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0b880098e0 tx=0x7f0b880091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:28.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.938+0000 7f0b9319d700 1 -- 172.21.15.71:0/174408380 shutdown_connections 2023-10-09T06:43:28.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.938+0000 7f0b9319d700 1 --2- 172.21.15.71:0/174408380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b8c150180 0x7f0b8c157770 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:28.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.938+0000 7f0b9319d700 1 -- 172.21.15.71:0/174408380 >> 172.21.15.71:0/174408380 conn(0x7f0b8c0cc1f0 msgr2=0x7f0b8c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:28.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.938+0000 7f0b9319d700 1 -- 172.21.15.71:0/174408380 shutdown_connections 2023-10-09T06:43:28.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.938+0000 7f0b9319d700 1 -- 172.21.15.71:0/174408380 wait complete. 2023-10-09T06:43:28.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.939+0000 7f0b9319d700 1 Processor -- start 2023-10-09T06:43:28.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.940+0000 7f0b9319d700 1 -- start start 2023-10-09T06:43:28.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.940+0000 7f0b9319d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b8c0c7410 0x7f0b8c0b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:28.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.940+0000 7f0b9319d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b8c150180 0x7f0b8c14ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:28.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.940+0000 7f0b9319d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b8c150550 0x7f0b8c0cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:28.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.940+0000 7f0b9319d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c0ae650 con 0x7f0b8c0c7410 2023-10-09T06:43:28.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.940+0000 7f0b9319d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c0ada40 con 0x7f0b8c150550 2023-10-09T06:43:28.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.940+0000 7f0b9319d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c0add20 con 0x7f0b8c150180 2023-10-09T06:43:28.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.941+0000 7f0b9219b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b8c0c7410 0x7f0b8c0b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:28.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.941+0000 7f0b9219b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b8c0c7410 0x7f0b8c0b0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59294/0 (socket says 172.21.15.71:59294) 2023-10-09T06:43:28.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.941+0000 7f0b9219b700 1 -- 172.21.15.71:0/3499929899 learned_addr learned my addr 172.21.15.71:0/3499929899 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:28.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.941+0000 7f0b9299c700 1 --2- 172.21.15.71:0/3499929899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b8c150550 0x7f0b8c0cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:28.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.941+0000 7f0b9199a700 1 --2- 172.21.15.71:0/3499929899 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b8c150180 0x7f0b8c14ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:28.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.941+0000 7f0b9219b700 1 -- 172.21.15.71:0/3499929899 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b8c150180 msgr2=0x7f0b8c14ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:28.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.941+0000 7f0b9219b700 1 --2- 172.21.15.71:0/3499929899 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b8c150180 0x7f0b8c14ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:28.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.941+0000 7f0b9219b700 1 -- 172.21.15.71:0/3499929899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b8c150550 msgr2=0x7f0b8c0cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:28.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.941+0000 7f0b9219b700 1 --2- 172.21.15.71:0/3499929899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b8c150550 0x7f0b8c0cad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:28.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.941+0000 7f0b9219b700 1 -- 172.21.15.71:0/3499929899 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b88009420 con 0x7f0b8c0c7410 2023-10-09T06:43:28.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.941+0000 7f0b9199a700 1 --2- 172.21.15.71:0/3499929899 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b8c150180 0x7f0b8c14ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:28.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.941+0000 7f0b9299c700 1 --2- 172.21.15.71:0/3499929899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b8c150550 0x7f0b8c0cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:28.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.941+0000 7f0b9219b700 1 --2- 172.21.15.71:0/3499929899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b8c0c7410 0x7f0b8c0b0230 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c06b470 tx=0x7f0b88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:28.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.942+0000 7f0b827fc700 1 -- 172.21.15.71:0/3499929899 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8801f070 con 0x7f0b8c0c7410 2023-10-09T06:43:28.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.942+0000 7f0b827fc700 1 -- 172.21.15.71:0/3499929899 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8800b9d0 con 0x7f0b8c0c7410 2023-10-09T06:43:28.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.942+0000 7f0b9319d700 1 -- 172.21.15.71:0/3499929899 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b8c0ae000 con 0x7f0b8c0c7410 2023-10-09T06:43:28.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.942+0000 7f0b827fc700 1 -- 172.21.15.71:0/3499929899 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88025670 con 0x7f0b8c0c7410 2023-10-09T06:43:28.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.942+0000 7f0b9319d700 1 -- 172.21.15.71:0/3499929899 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8c0b0770 con 0x7f0b8c0c7410 2023-10-09T06:43:28.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.943+0000 7f0b9319d700 1 -- 172.21.15.71:0/3499929899 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b8c04c3c0 con 0x7f0b8c0c7410 2023-10-09T06:43:28.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.943+0000 7f0b827fc700 1 -- 172.21.15.71:0/3499929899 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0b88023070 con 0x7f0b8c0c7410 2023-10-09T06:43:28.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.944+0000 7f0b827fc700 1 --2- 172.21.15.71:0/3499929899 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0b70066f30 0x7f0b700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:28.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.944+0000 7f0b827fc700 1 -- 172.21.15.71:0/3499929899 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0b880858f0 con 0x7f0b8c0c7410 2023-10-09T06:43:28.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.945+0000 7f0b9199a700 1 --2- 172.21.15.71:0/3499929899 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0b70066f30 0x7f0b700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:28.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.945+0000 7f0b9199a700 1 --2- 172.21.15.71:0/3499929899 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0b70066f30 0x7f0b700693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c0aeab0 tx=0x7f0b7c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:28.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:28.949+0000 7f0b827fc700 1 -- 172.21.15.71:0/3499929899 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0b88052e10 con 0x7f0b8c0c7410 2023-10-09T06:43:29.044 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:43:29.049 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:43:29.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.146+0000 7f0b9319d700 1 -- 172.21.15.71:0/3499929899 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0b8c0c2fb0 con 0x7f0b8c0c7410 2023-10-09T06:43:29.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.147+0000 7f0b827fc700 1 -- 172.21.15.71:0/3499929899 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0b88015090 con 0x7f0b8c0c7410 2023-10-09T06:43:29.148 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:29.148 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-09T06:43:29.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:29.148 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 1, 2023-10-09T06:43:29.148 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": ".mgr" 2023-10-09T06:43:29.148 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:29.148 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-09T06:43:29.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.149+0000 7f0b9319d700 1 -- 172.21.15.71:0/3499929899 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0b70066f30 msgr2=0x7f0b700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:29.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.149+0000 7f0b9319d700 1 --2- 172.21.15.71:0/3499929899 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0b70066f30 0x7f0b700693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c0aeab0 tx=0x7f0b7c009040 comp rx=0 tx=0).stop 2023-10-09T06:43:29.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.149+0000 7f0b9319d700 1 -- 172.21.15.71:0/3499929899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b8c0c7410 msgr2=0x7f0b8c0b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:29.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.149+0000 7f0b9319d700 1 --2- 172.21.15.71:0/3499929899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b8c0c7410 0x7f0b8c0b0230 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c06b470 tx=0x7f0b88017000 comp rx=0 tx=0).stop 2023-10-09T06:43:29.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.149+0000 7f0b9319d700 1 -- 172.21.15.71:0/3499929899 shutdown_connections 2023-10-09T06:43:29.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.149+0000 7f0b9319d700 1 --2- 172.21.15.71:0/3499929899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b8c150550 0x7f0b8c0cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:29.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.149+0000 7f0b9319d700 1 --2- 172.21.15.71:0/3499929899 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0b70066f30 0x7f0b700693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:29.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.149+0000 7f0b9319d700 1 --2- 172.21.15.71:0/3499929899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b8c0c7410 0x7f0b8c0b0230 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:29.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.149+0000 7f0b9319d700 1 --2- 172.21.15.71:0/3499929899 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b8c150180 0x7f0b8c14ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:29.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.149+0000 7f0b9319d700 1 -- 172.21.15.71:0/3499929899 >> 172.21.15.71:0/3499929899 conn(0x7f0b8c0cc1f0 msgr2=0x7f0b8c159800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:29.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.149+0000 7f0b9319d700 1 -- 172.21.15.71:0/3499929899 shutdown_connections 2023-10-09T06:43:29.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.149+0000 7f0b9319d700 1 -- 172.21.15.71:0/3499929899 wait complete. 2023-10-09T06:43:29.167 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T06:43:29.168 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T06:43:29.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.391+0000 7f33e35ff700 1 Processor -- start 2023-10-09T06:43:29.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.391+0000 7f33e35ff700 1 -- start start 2023-10-09T06:43:29.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.392+0000 7f33e35ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f33dc1563b0 0x7f33dc156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:29.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.392+0000 7f33e35ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f33dc15a440 0x7f33dc0acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:29.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.392+0000 7f33e35ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33dc15a9b0 con 0x7f33dc068890 2023-10-09T06:43:29.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.392+0000 7f33e35ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33dc15ac90 con 0x7f33dc1563b0 2023-10-09T06:43:29.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.392+0000 7f33e35ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33dc15af70 con 0x7f33dc15a440 2023-10-09T06:43:29.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.393+0000 7f33e139b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f33dc1563b0 0x7f33dc156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:29.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.393+0000 7f33e139b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f33dc1563b0 0x7f33dc156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59302/0 (socket says 172.21.15.71:59302) 2023-10-09T06:43:29.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.393+0000 7f33e139b700 1 -- 172.21.15.71:0/3851908077 learned_addr learned my addr 172.21.15.71:0/3851908077 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:29.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.393+0000 7f33e0b9a700 1 --2- 172.21.15.71:0/3851908077 >> v2:172.21.15.179:3300/0 conn(0x7f33dc15a440 0x7f33dc0acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:29.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.393+0000 7f33e139b700 1 -- 172.21.15.71:0/3851908077 >> v2:172.21.15.179:3300/0 conn(0x7f33dc15a440 msgr2=0x7f33dc0acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:29.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.393+0000 7f33e139b700 1 --2- 172.21.15.71:0/3851908077 >> v2:172.21.15.179:3300/0 conn(0x7f33dc15a440 0x7f33dc0acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:29.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.393+0000 7f33e139b700 1 -- 172.21.15.71:0/3851908077 >> v1:172.21.15.179:6789/0 conn(0x7f33dc068890 legacy=0x7f33dc0c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:29.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.393+0000 7f33e139b700 1 -- 172.21.15.71:0/3851908077 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc15b250 con 0x7f33dc1563b0 2023-10-09T06:43:29.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.393+0000 7f33e0b9a700 1 --2- 172.21.15.71:0/3851908077 >> v2:172.21.15.179:3300/0 conn(0x7f33dc15a440 0x7f33dc0acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:29.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.393+0000 7f33e139b700 1 --2- 172.21.15.71:0/3851908077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33dc1563b0 0x7f33dc156780 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f33dc06fb10 tx=0x7f33d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e7d84890b35b8a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:29.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.394+0000 7f33d3fff700 1 -- 172.21.15.71:0/3851908077 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d800b860 con 0x7f33dc1563b0 2023-10-09T06:43:29.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.394+0000 7f33d3fff700 1 -- 172.21.15.71:0/3851908077 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d800b9c0 con 0x7f33dc1563b0 2023-10-09T06:43:29.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.394+0000 7f33d3fff700 1 -- 172.21.15.71:0/3851908077 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d800bd60 con 0x7f33dc1563b0 2023-10-09T06:43:29.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.394+0000 7f33e35ff700 1 -- 172.21.15.71:0/3851908077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33dc1563b0 msgr2=0x7f33dc156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:29.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.394+0000 7f33e35ff700 1 --2- 172.21.15.71:0/3851908077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33dc1563b0 0x7f33dc156780 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f33dc06fb10 tx=0x7f33d8009250 comp rx=0 tx=0).stop 2023-10-09T06:43:29.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.394+0000 7f33e35ff700 1 -- 172.21.15.71:0/3851908077 shutdown_connections 2023-10-09T06:43:29.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.394+0000 7f33e35ff700 1 --2- 172.21.15.71:0/3851908077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33dc1563b0 0x7f33dc156780 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:29.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.394+0000 7f33e35ff700 1 --2- 172.21.15.71:0/3851908077 >> v2:172.21.15.179:3300/0 conn(0x7f33dc15a440 0x7f33dc0acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:29.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.394+0000 7f33e35ff700 1 -- 172.21.15.71:0/3851908077 >> 172.21.15.71:0/3851908077 conn(0x7f33dc0c8f90 msgr2=0x7f33dc0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:29.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.394+0000 7f33e35ff700 1 -- 172.21.15.71:0/3851908077 shutdown_connections 2023-10-09T06:43:29.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.394+0000 7f33e35ff700 1 -- 172.21.15.71:0/3851908077 wait complete. 2023-10-09T06:43:29.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.396+0000 7f33e35ff700 1 Processor -- start 2023-10-09T06:43:29.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.396+0000 7f33e35ff700 1 -- start start 2023-10-09T06:43:29.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.397+0000 7f33e35ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33dc068890 0x7f33dc0adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:29.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.397+0000 7f33e35ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33dc1563b0 0x7f33dc1680a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:29.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.397+0000 7f33e35ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33dc15a440 0x7f33dc0c10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:29.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.397+0000 7f33e35ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc167c10 con 0x7f33dc15a440 2023-10-09T06:43:29.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.397+0000 7f33e35ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc1678c0 con 0x7f33dc068890 2023-10-09T06:43:29.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.397+0000 7f33e35ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc0c0510 con 0x7f33dc1563b0 2023-10-09T06:43:29.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.397+0000 7f33e1b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33dc15a440 0x7f33dc0c10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:29.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.397+0000 7f33e1b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33dc15a440 0x7f33dc0c10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59312/0 (socket says 172.21.15.71:59312) 2023-10-09T06:43:29.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.397+0000 7f33e1b9c700 1 -- 172.21.15.71:0/543648424 learned_addr learned my addr 172.21.15.71:0/543648424 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:29.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.397+0000 7f33e139b700 1 --2- 172.21.15.71:0/543648424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33dc068890 0x7f33dc0adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:29.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.397+0000 7f33e0b9a700 1 --2- 172.21.15.71:0/543648424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33dc1563b0 0x7f33dc1680a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:29.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.398+0000 7f33e1b9c700 1 -- 172.21.15.71:0/543648424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33dc1563b0 msgr2=0x7f33dc1680a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:29.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.398+0000 7f33e1b9c700 1 --2- 172.21.15.71:0/543648424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33dc1563b0 0x7f33dc1680a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:29.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.398+0000 7f33e1b9c700 1 -- 172.21.15.71:0/543648424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33dc068890 msgr2=0x7f33dc0adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:29.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.398+0000 7f33e1b9c700 1 --2- 172.21.15.71:0/543648424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33dc068890 0x7f33dc0adef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:29.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.398+0000 7f33e1b9c700 1 -- 172.21.15.71:0/543648424 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d80094f0 con 0x7f33dc15a440 2023-10-09T06:43:29.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.398+0000 7f33e1b9c700 1 --2- 172.21.15.71:0/543648424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33dc15a440 0x7f33dc0c10f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f33d400c8e0 tx=0x7f33d4001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:29.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.398+0000 7f33d17fa700 1 -- 172.21.15.71:0/543648424 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d4012630 con 0x7f33dc15a440 2023-10-09T06:43:29.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.398+0000 7f33d17fa700 1 -- 172.21.15.71:0/543648424 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d4012790 con 0x7f33dc15a440 2023-10-09T06:43:29.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.398+0000 7f33d17fa700 1 -- 172.21.15.71:0/543648424 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d4012b50 con 0x7f33dc15a440 2023-10-09T06:43:29.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.398+0000 7f33e35ff700 1 -- 172.21.15.71:0/543648424 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33dc0c07f0 con 0x7f33dc15a440 2023-10-09T06:43:29.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.398+0000 7f33e35ff700 1 -- 172.21.15.71:0/543648424 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33dc1558e0 con 0x7f33dc15a440 2023-10-09T06:43:29.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.399+0000 7f33e35ff700 1 -- 172.21.15.71:0/543648424 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33dc167dc0 con 0x7f33dc15a440 2023-10-09T06:43:29.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.400+0000 7f33d17fa700 1 -- 172.21.15.71:0/543648424 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f33d401a3a0 con 0x7f33dc15a440 2023-10-09T06:43:29.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.401+0000 7f33d17fa700 1 --2- 172.21.15.71:0/543648424 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f33c0066f30 0x7f33c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:29.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.401+0000 7f33d17fa700 1 -- 172.21.15.71:0/543648424 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f33d40843c0 con 0x7f33dc15a440 2023-10-09T06:43:29.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.401+0000 7f33e139b700 1 --2- 172.21.15.71:0/543648424 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f33c0066f30 0x7f33c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:29.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.402+0000 7f33e139b700 1 --2- 172.21.15.71:0/543648424 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f33c0066f30 0x7f33c00693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f33dc06fb10 tx=0x7f33d8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:29.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.405+0000 7f33d17fa700 1 -- 172.21.15.71:0/543648424 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f33dc167dc0 con 0x7f33dc15a440 2023-10-09T06:43:29.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:29.596+0000 7f33e35ff700 1 -- 172.21.15.71:0/543648424 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f33dc0ab630 con 0x7f33dc15a440 2023-10-09T06:43:30.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.560+0000 7f33d17fa700 1 -- 172.21.15.71:0/543648424 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f33d4055370 con 0x7f33dc15a440 2023-10-09T06:43:30.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.564+0000 7f33e35ff700 1 -- 172.21.15.71:0/543648424 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f33c0066f30 msgr2=0x7f33c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:30.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.565+0000 7f33e35ff700 1 --2- 172.21.15.71:0/543648424 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f33c0066f30 0x7f33c00693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f33dc06fb10 tx=0x7f33d8017000 comp rx=0 tx=0).stop 2023-10-09T06:43:30.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.565+0000 7f33e35ff700 1 -- 172.21.15.71:0/543648424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33dc15a440 msgr2=0x7f33dc0c10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:30.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.565+0000 7f33e35ff700 1 --2- 172.21.15.71:0/543648424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33dc15a440 0x7f33dc0c10f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f33d400c8e0 tx=0x7f33d4001710 comp rx=0 tx=0).stop 2023-10-09T06:43:30.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.565+0000 7f33e35ff700 1 -- 172.21.15.71:0/543648424 shutdown_connections 2023-10-09T06:43:30.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.565+0000 7f33e35ff700 1 --2- 172.21.15.71:0/543648424 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f33c0066f30 0x7f33c00693e0 secure :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f33dc06fb10 tx=0x7f33d8017000 comp rx=0 tx=0).stop 2023-10-09T06:43:30.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.565+0000 7f33e35ff700 1 --2- 172.21.15.71:0/543648424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33dc15a440 0x7f33dc0c10f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:30.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.565+0000 7f33e35ff700 1 --2- 172.21.15.71:0/543648424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33dc068890 0x7f33dc0adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:30.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.565+0000 7f33e35ff700 1 --2- 172.21.15.71:0/543648424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33dc1563b0 0x7f33dc1680a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:30.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.565+0000 7f33e35ff700 1 -- 172.21.15.71:0/543648424 >> 172.21.15.71:0/543648424 conn(0x7f33dc0c8f90 msgr2=0x7f33dc154650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:30.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.566+0000 7f33e35ff700 1 -- 172.21.15.71:0/543648424 shutdown_connections 2023-10-09T06:43:30.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.566+0000 7f33e35ff700 1 -- 172.21.15.71:0/543648424 wait complete. 2023-10-09T06:43:30.570 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' created 2023-10-09T06:43:30.589 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T06:43:30.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.779+0000 7f9da359e700 1 Processor -- start 2023-10-09T06:43:30.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.780+0000 7f9da359e700 1 -- start start 2023-10-09T06:43:30.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.781+0000 7f9da359e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9da41563b0 0x7f9da40ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:30.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.781+0000 7f9da359e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da40cbe50 con 0x7f9da40ae9c0 2023-10-09T06:43:30.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.781+0000 7f9da359e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da40cb370 con 0x7f9da4156780 2023-10-09T06:43:30.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.781+0000 7f9da359e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da40cb650 con 0x7f9da41563b0 2023-10-09T06:43:30.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.781+0000 7f9da259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9da41563b0 0x7f9da40ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:30.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.781+0000 7f9da259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9da41563b0 0x7f9da40ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59314/0 (socket says 172.21.15.71:59314) 2023-10-09T06:43:30.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.781+0000 7f9da259c700 1 -- 172.21.15.71:0/3051202364 learned_addr learned my addr 172.21.15.71:0/3051202364 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:30.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.781+0000 7f9da2d9d700 1 --1- 172.21.15.71:0/3051202364 >> v1:172.21.15.71:6789/0 conn(0x7f9da40ae9c0 0x7f9da40c7340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51786/0 (socket says 172.21.15.71:51786) 2023-10-09T06:43:30.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.782+0000 7f9da259c700 1 -- 172.21.15.71:0/3051202364 >> v1:172.21.15.179:6789/0 conn(0x7f9da4156780 legacy=0x7f9da40ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:30.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.782+0000 7f9da259c700 1 -- 172.21.15.71:0/3051202364 >> v1:172.21.15.71:6789/0 conn(0x7f9da40ae9c0 legacy=0x7f9da40c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:30.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.782+0000 7f9da259c700 1 -- 172.21.15.71:0/3051202364 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da40c6860 con 0x7f9da41563b0 2023-10-09T06:43:30.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.782+0000 7f9da159a700 1 -- 172.21.15.71:0/3051202364 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681462353 0 0) 0x7f9da40cbe50 con 0x7f9da40ae9c0 2023-10-09T06:43:30.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.782+0000 7f9da259c700 1 --2- 172.21.15.71:0/3051202364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9da41563b0 0x7f9da40ca7d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9d940099b0 tx=0x7f9d94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5daa8ed3da652bf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:30.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.782+0000 7f9da159a700 1 -- 172.21.15.71:0/3051202364 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9400b820 con 0x7f9da41563b0 2023-10-09T06:43:30.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.782+0000 7f9da159a700 1 -- 172.21.15.71:0/3051202364 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9400b980 con 0x7f9da41563b0 2023-10-09T06:43:30.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.782+0000 7f9da159a700 1 -- 172.21.15.71:0/3051202364 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9400bd20 con 0x7f9da41563b0 2023-10-09T06:43:30.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.783+0000 7f9da359e700 1 -- 172.21.15.71:0/3051202364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9da41563b0 msgr2=0x7f9da40ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:30.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.783+0000 7f9da359e700 1 --2- 172.21.15.71:0/3051202364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9da41563b0 0x7f9da40ca7d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9d940099b0 tx=0x7f9d94009250 comp rx=0 tx=0).stop 2023-10-09T06:43:30.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.783+0000 7f9da359e700 1 -- 172.21.15.71:0/3051202364 shutdown_connections 2023-10-09T06:43:30.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.783+0000 7f9da359e700 1 --2- 172.21.15.71:0/3051202364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9da41563b0 0x7f9da40ca7d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:30.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.783+0000 7f9da359e700 1 -- 172.21.15.71:0/3051202364 >> 172.21.15.71:0/3051202364 conn(0x7f9da4068e20 msgr2=0x7f9da40cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:30.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.783+0000 7f9da359e700 1 -- 172.21.15.71:0/3051202364 shutdown_connections 2023-10-09T06:43:30.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.783+0000 7f9da359e700 1 -- 172.21.15.71:0/3051202364 wait complete. 2023-10-09T06:43:30.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.784+0000 7f9da359e700 1 Processor -- start 2023-10-09T06:43:30.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.784+0000 7f9da359e700 1 -- start start 2023-10-09T06:43:30.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.785+0000 7f9da359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da40ae9c0 0x7f9da40b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:30.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.785+0000 7f9da359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da41563b0 0x7f9da40c1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:30.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.785+0000 7f9da359e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9da4156780 0x7f9da40c2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:30.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.785+0000 7f9da359e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da4150880 con 0x7f9da4156780 2023-10-09T06:43:30.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.785+0000 7f9da359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da416a970 con 0x7f9da40ae9c0 2023-10-09T06:43:30.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.785+0000 7f9da359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da4169d60 con 0x7f9da41563b0 2023-10-09T06:43:30.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.786+0000 7f9da2d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9da4156780 0x7f9da40c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:30.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.786+0000 7f9da2d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9da4156780 0x7f9da40c2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59326/0 (socket says 172.21.15.71:59326) 2023-10-09T06:43:30.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.786+0000 7f9da2d9d700 1 -- 172.21.15.71:0/2240318930 learned_addr learned my addr 172.21.15.71:0/2240318930 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:30.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.786+0000 7f9da1d9b700 1 --2- 172.21.15.71:0/2240318930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da41563b0 0x7f9da40c1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:30.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.786+0000 7f9da259c700 1 --2- 172.21.15.71:0/2240318930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da40ae9c0 0x7f9da40b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:30.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.786+0000 7f9da2d9d700 1 -- 172.21.15.71:0/2240318930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da41563b0 msgr2=0x7f9da40c1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:30.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.786+0000 7f9da2d9d700 1 --2- 172.21.15.71:0/2240318930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da41563b0 0x7f9da40c1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:30.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.786+0000 7f9da2d9d700 1 -- 172.21.15.71:0/2240318930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da40ae9c0 msgr2=0x7f9da40b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:30.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.786+0000 7f9da2d9d700 1 --2- 172.21.15.71:0/2240318930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da40ae9c0 0x7f9da40b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:30.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.786+0000 7f9da2d9d700 1 -- 172.21.15.71:0/2240318930 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d940094f0 con 0x7f9da4156780 2023-10-09T06:43:30.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.786+0000 7f9da2d9d700 1 --2- 172.21.15.71:0/2240318930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9da4156780 0x7f9da40c2440 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c00cd80 tx=0x7f9d9c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:30.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.786+0000 7f9d927fc700 1 -- 172.21.15.71:0/2240318930 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c005df0 con 0x7f9da4156780 2023-10-09T06:43:30.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.786+0000 7f9d927fc700 1 -- 172.21.15.71:0/2240318930 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9c00a900 con 0x7f9da4156780 2023-10-09T06:43:30.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.787+0000 7f9da359e700 1 -- 172.21.15.71:0/2240318930 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da416a040 con 0x7f9da4156780 2023-10-09T06:43:30.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.787+0000 7f9d927fc700 1 -- 172.21.15.71:0/2240318930 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c00acc0 con 0x7f9da4156780 2023-10-09T06:43:30.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.787+0000 7f9da359e700 1 -- 172.21.15.71:0/2240318930 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da416a600 con 0x7f9da4156780 2023-10-09T06:43:30.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.788+0000 7f9da359e700 1 -- 172.21.15.71:0/2240318930 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da40af0f0 con 0x7f9da4156780 2023-10-09T06:43:30.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.789+0000 7f9d927fc700 1 -- 172.21.15.71:0/2240318930 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d9c007300 con 0x7f9da4156780 2023-10-09T06:43:30.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.790+0000 7f9d927fc700 1 --2- 172.21.15.71:0/2240318930 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9d84066f30 0x7f9d840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:30.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.790+0000 7f9d927fc700 1 -- 172.21.15.71:0/2240318930 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f9d9c084570 con 0x7f9da4156780 2023-10-09T06:43:30.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.790+0000 7f9da259c700 1 --2- 172.21.15.71:0/2240318930 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9d84066f30 0x7f9d840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:30.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.791+0000 7f9da259c700 1 --2- 172.21.15.71:0/2240318930 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9d84066f30 0x7f9d840693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9d940099b0 tx=0x7f9d94016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:30.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.794+0000 7f9d927fc700 1 -- 172.21.15.71:0/2240318930 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9da40af0f0 con 0x7f9da4156780 2023-10-09T06:43:30.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:30.985+0000 7f9da359e700 1 -- 172.21.15.71:0/2240318930 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9da40af0f0 con 0x7f9da4156780 2023-10-09T06:43:31.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.564+0000 7f9d927fc700 1 -- 172.21.15.71:0/2240318930 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9da40af0f0 con 0x7f9da4156780 2023-10-09T06:43:31.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.572+0000 7f9da359e700 1 -- 172.21.15.71:0/2240318930 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9d84066f30 msgr2=0x7f9d840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:31.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.572+0000 7f9da359e700 1 --2- 172.21.15.71:0/2240318930 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9d84066f30 0x7f9d840693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9d940099b0 tx=0x7f9d94016000 comp rx=0 tx=0).stop 2023-10-09T06:43:31.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.572+0000 7f9da359e700 1 -- 172.21.15.71:0/2240318930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9da4156780 msgr2=0x7f9da40c2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:31.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.572+0000 7f9da359e700 1 --2- 172.21.15.71:0/2240318930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9da4156780 0x7f9da40c2440 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c00cd80 tx=0x7f9d9c001ae0 comp rx=0 tx=0).stop 2023-10-09T06:43:31.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.573+0000 7f9da359e700 1 -- 172.21.15.71:0/2240318930 shutdown_connections 2023-10-09T06:43:31.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.573+0000 7f9da359e700 1 --2- 172.21.15.71:0/2240318930 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9d84066f30 0x7f9d840693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:31.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.573+0000 7f9da359e700 1 --2- 172.21.15.71:0/2240318930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9da4156780 0x7f9da40c2440 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:31.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.573+0000 7f9da359e700 1 --2- 172.21.15.71:0/2240318930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da40ae9c0 0x7f9da40b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:31.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.573+0000 7f9da359e700 1 --2- 172.21.15.71:0/2240318930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da41563b0 0x7f9da40c1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:31.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.573+0000 7f9da359e700 1 -- 172.21.15.71:0/2240318930 >> 172.21.15.71:0/2240318930 conn(0x7f9da4068e20 msgr2=0x7f9da40c7340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:31.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.573+0000 7f9da359e700 1 -- 172.21.15.71:0/2240318930 shutdown_connections 2023-10-09T06:43:31.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.574+0000 7f9da359e700 1 -- 172.21.15.71:0/2240318930 wait complete. 2023-10-09T06:43:31.581 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' created 2023-10-09T06:43:31.604 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T06:43:31.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.787+0000 7f45a53ff700 1 Processor -- start 2023-10-09T06:43:31.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.787+0000 7f45a53ff700 1 -- start start 2023-10-09T06:43:31.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.788+0000 7f45a53ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45a00ccee0 0x7f45a01561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:31.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.788+0000 7f45a53ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f45a00c87c0 0x7f45a0156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:31.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.788+0000 7f45a53ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a015b0d0 con 0x7f45a00c83f0 2023-10-09T06:43:31.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.788+0000 7f45a53ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a0156c50 con 0x7f45a00c87c0 2023-10-09T06:43:31.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.788+0000 7f45a53ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a015a4c0 con 0x7f45a00ccee0 2023-10-09T06:43:31.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.789+0000 7f459effd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f45a00c83f0 0x7f45a00c7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51790/0 (socket says 172.21.15.71:51790) 2023-10-09T06:43:31.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.789+0000 7f459effd700 1 -- 172.21.15.71:0/2136595051 learned_addr learned my addr 172.21.15.71:0/2136595051 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:31.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.789+0000 7f459f7fe700 1 --2- 172.21.15.71:0/2136595051 >> v2:172.21.15.179:3300/0 conn(0x7f45a00c87c0 0x7f45a0156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:31.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.789+0000 7f4597fff700 1 --2- 172.21.15.71:0/2136595051 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45a00ccee0 0x7f45a01561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:31.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.789+0000 7f459e7fc700 1 -- 172.21.15.71:0/2136595051 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723331100 0 0) 0x7f45a015b0d0 con 0x7f45a00c83f0 2023-10-09T06:43:31.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.789+0000 7f459e7fc700 1 -- 172.21.15.71:0/2136595051 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f458c003570 con 0x7f45a00c83f0 2023-10-09T06:43:31.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.789+0000 7f459f7fe700 1 -- 172.21.15.71:0/2136595051 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45a00ccee0 msgr2=0x7f45a01561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:31.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.789+0000 7f459f7fe700 1 --2- 172.21.15.71:0/2136595051 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45a00ccee0 0x7f45a01561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:31.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.789+0000 7f459f7fe700 1 -- 172.21.15.71:0/2136595051 >> v1:172.21.15.71:6789/0 conn(0x7f45a00c83f0 legacy=0x7f45a00c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:31.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.789+0000 7f459f7fe700 1 -- 172.21.15.71:0/2136595051 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a015a7a0 con 0x7f45a00c87c0 2023-10-09T06:43:31.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.789+0000 7f4597fff700 1 --2- 172.21.15.71:0/2136595051 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45a00ccee0 0x7f45a01561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:43:31.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.790+0000 7f459f7fe700 1 --2- 172.21.15.71:0/2136595051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45a00c87c0 0x7f45a0156710 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4598009e60 tx=0x7f4598009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4f70ce81b08300f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:31.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.790+0000 7f459e7fc700 1 -- 172.21.15.71:0/2136595051 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459800e070 con 0x7f45a00c87c0 2023-10-09T06:43:31.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.790+0000 7f459e7fc700 1 -- 172.21.15.71:0/2136595051 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459800bab0 con 0x7f45a00c87c0 2023-10-09T06:43:31.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.790+0000 7f459e7fc700 1 -- 172.21.15.71:0/2136595051 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459800be70 con 0x7f45a00c87c0 2023-10-09T06:43:31.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.790+0000 7f45a53ff700 1 -- 172.21.15.71:0/2136595051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45a00c87c0 msgr2=0x7f45a0156710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:31.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.791+0000 7f45a53ff700 1 --2- 172.21.15.71:0/2136595051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45a00c87c0 0x7f45a0156710 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4598009e60 tx=0x7f4598009780 comp rx=0 tx=0).stop 2023-10-09T06:43:31.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.791+0000 7f45a53ff700 1 -- 172.21.15.71:0/2136595051 shutdown_connections 2023-10-09T06:43:31.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.791+0000 7f45a53ff700 1 --2- 172.21.15.71:0/2136595051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45a00c87c0 0x7f45a0156710 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:31.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.791+0000 7f45a53ff700 1 --2- 172.21.15.71:0/2136595051 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45a00ccee0 0x7f45a01561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:31.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.791+0000 7f45a53ff700 1 -- 172.21.15.71:0/2136595051 >> 172.21.15.71:0/2136595051 conn(0x7f45a0068e10 msgr2=0x7f45a00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:31.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.791+0000 7f45a53ff700 1 -- 172.21.15.71:0/2136595051 shutdown_connections 2023-10-09T06:43:31.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.791+0000 7f45a53ff700 1 -- 172.21.15.71:0/2136595051 wait complete. 2023-10-09T06:43:31.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.792+0000 7f45a53ff700 1 Processor -- start 2023-10-09T06:43:31.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.792+0000 7f45a53ff700 1 -- start start 2023-10-09T06:43:31.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.793+0000 7f45a53ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45a00c83f0 0x7f45a01556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:31.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.793+0000 7f45a53ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45a00c87c0 0x7f45a014d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:31.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.793+0000 7f45a53ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45a00ccee0 0x7f45a014d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:31.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.793+0000 7f45a53ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a014dca0 con 0x7f45a00c83f0 2023-10-09T06:43:31.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.793+0000 7f45a53ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a014ace0 con 0x7f45a00ccee0 2023-10-09T06:43:31.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.793+0000 7f45a53ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a014afc0 con 0x7f45a00c87c0 2023-10-09T06:43:31.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.793+0000 7f459effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45a00c83f0 0x7f45a01556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:31.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.793+0000 7f459effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45a00c83f0 0x7f45a01556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59338/0 (socket says 172.21.15.71:59338) 2023-10-09T06:43:31.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.793+0000 7f459effd700 1 -- 172.21.15.71:0/3531220082 learned_addr learned my addr 172.21.15.71:0/3531220082 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:31.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.794+0000 7f4597fff700 1 --2- 172.21.15.71:0/3531220082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45a00c87c0 0x7f45a014d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:31.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.794+0000 7f459f7fe700 1 --2- 172.21.15.71:0/3531220082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45a00ccee0 0x7f45a014d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:31.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.794+0000 7f459effd700 1 -- 172.21.15.71:0/3531220082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45a00c87c0 msgr2=0x7f45a014d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:31.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.794+0000 7f459effd700 1 --2- 172.21.15.71:0/3531220082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45a00c87c0 0x7f45a014d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:31.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.794+0000 7f459effd700 1 -- 172.21.15.71:0/3531220082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45a00ccee0 msgr2=0x7f45a014d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:31.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.794+0000 7f459effd700 1 --2- 172.21.15.71:0/3531220082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45a00ccee0 0x7f45a014d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:31.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.794+0000 7f459effd700 1 -- 172.21.15.71:0/3531220082 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4588009420 con 0x7f45a00c83f0 2023-10-09T06:43:31.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.794+0000 7f4597fff700 1 --2- 172.21.15.71:0/3531220082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45a00c87c0 0x7f45a014d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:31.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.794+0000 7f459effd700 1 --2- 172.21.15.71:0/3531220082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45a00c83f0 0x7f45a01556f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f459000c7c0 tx=0x7f4590007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:31.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.794+0000 7f4596ffd700 1 -- 172.21.15.71:0/3531220082 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4590005b30 con 0x7f45a00c83f0 2023-10-09T06:43:31.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.794+0000 7f4596ffd700 1 -- 172.21.15.71:0/3531220082 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4590005c90 con 0x7f45a00c83f0 2023-10-09T06:43:31.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.794+0000 7f4596ffd700 1 -- 172.21.15.71:0/3531220082 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4590007340 con 0x7f45a00c83f0 2023-10-09T06:43:31.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.794+0000 7f45a53ff700 1 -- 172.21.15.71:0/3531220082 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4598009a20 con 0x7f45a00c83f0 2023-10-09T06:43:31.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.794+0000 7f45a53ff700 1 -- 172.21.15.71:0/3531220082 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a016ad90 con 0x7f45a00c83f0 2023-10-09T06:43:31.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.795+0000 7f45a53ff700 1 -- 172.21.15.71:0/3531220082 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a004c3c0 con 0x7f45a00c83f0 2023-10-09T06:43:31.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.797+0000 7f4596ffd700 1 -- 172.21.15.71:0/3531220082 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f459001b400 con 0x7f45a00c83f0 2023-10-09T06:43:31.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.798+0000 7f4596ffd700 1 --2- 172.21.15.71:0/3531220082 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4580066f30 0x7f45800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:31.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.798+0000 7f4596ffd700 1 -- 172.21.15.71:0/3531220082 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f45900840c0 con 0x7f45a00c83f0 2023-10-09T06:43:31.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.798+0000 7f4597fff700 1 --2- 172.21.15.71:0/3531220082 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4580066f30 0x7f45800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:31.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.799+0000 7f4597fff700 1 --2- 172.21.15.71:0/3531220082 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4580066f30 0x7f45800693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f45880093f0 tx=0x7f4588008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:31.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:31.803+0000 7f4596ffd700 1 -- 172.21.15.71:0/3531220082 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4590051370 con 0x7f45a00c83f0 2023-10-09T06:43:32.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.037+0000 7f45a53ff700 1 -- 172.21.15.71:0/3531220082 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f45a014b180 con 0x7f45a00c83f0 2023-10-09T06:43:32.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.587+0000 7f4596ffd700 1 -- 172.21.15.71:0/3531220082 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4590054990 con 0x7f45a00c83f0 2023-10-09T06:43:32.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.598+0000 7f45a53ff700 1 -- 172.21.15.71:0/3531220082 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4580066f30 msgr2=0x7f45800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:32.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.598+0000 7f45a53ff700 1 --2- 172.21.15.71:0/3531220082 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4580066f30 0x7f45800693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f45880093f0 tx=0x7f4588008040 comp rx=0 tx=0).stop 2023-10-09T06:43:32.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.598+0000 7f45a53ff700 1 -- 172.21.15.71:0/3531220082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45a00c83f0 msgr2=0x7f45a01556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:32.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.598+0000 7f45a53ff700 1 --2- 172.21.15.71:0/3531220082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45a00c83f0 0x7f45a01556f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f459000c7c0 tx=0x7f4590007e00 comp rx=0 tx=0).stop 2023-10-09T06:43:32.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.599+0000 7f45a53ff700 1 -- 172.21.15.71:0/3531220082 shutdown_connections 2023-10-09T06:43:32.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.599+0000 7f45a53ff700 1 --2- 172.21.15.71:0/3531220082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45a00ccee0 0x7f45a014d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:32.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.599+0000 7f45a53ff700 1 --2- 172.21.15.71:0/3531220082 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4580066f30 0x7f45800693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:32.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.599+0000 7f45a53ff700 1 --2- 172.21.15.71:0/3531220082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45a00c83f0 0x7f45a01556f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:32.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.599+0000 7f45a53ff700 1 --2- 172.21.15.71:0/3531220082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45a00c87c0 0x7f45a014d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:32.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.599+0000 7f45a53ff700 1 -- 172.21.15.71:0/3531220082 >> 172.21.15.71:0/3531220082 conn(0x7f45a0068e10 msgr2=0x7f45a00cbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:32.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.600+0000 7f45a53ff700 1 -- 172.21.15.71:0/3531220082 shutdown_connections 2023-10-09T06:43:32.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.600+0000 7f45a53ff700 1 -- 172.21.15.71:0/3531220082 wait complete. 2023-10-09T06:43:32.611 INFO:teuthology.orchestra.run.smithi071.stderr:new fs with metadata pool 4 and data pool 5 2023-10-09T06:43:32.630 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:43:32.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.811+0000 7fee81b9d700 1 Processor -- start 2023-10-09T06:43:32.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.811+0000 7fee81b9d700 1 -- start start 2023-10-09T06:43:32.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.812+0000 7fee81b9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fee7c1597f0 0x7fee7c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:32.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.812+0000 7fee81b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fee7c15d230 0x7fee7c15d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:32.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.812+0000 7fee81b9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7c15db70 con 0x7fee7c159420 2023-10-09T06:43:32.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.812+0000 7fee81b9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7c0b11d0 con 0x7fee7c1597f0 2023-10-09T06:43:32.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.812+0000 7fee81b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7c0b14b0 con 0x7fee7c15d230 2023-10-09T06:43:32.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.812+0000 7fee7bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fee7c1597f0 0x7fee7c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:32.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.812+0000 7fee7bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fee7c1597f0 0x7fee7c0b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59350/0 (socket says 172.21.15.71:59350) 2023-10-09T06:43:32.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.812+0000 7fee80b9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fee7c159420 0x7fee7c0b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51792/0 (socket says 172.21.15.71:51792) 2023-10-09T06:43:32.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.812+0000 7fee7bfff700 1 -- 172.21.15.71:0/3039354709 learned_addr learned my addr 172.21.15.71:0/3039354709 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:32.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.813+0000 7fee8139c700 1 --2- 172.21.15.71:0/3039354709 >> v2:172.21.15.179:3300/0 conn(0x7fee7c15d230 0x7fee7c15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:32.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.813+0000 7fee7bfff700 1 -- 172.21.15.71:0/3039354709 >> v2:172.21.15.179:3300/0 conn(0x7fee7c15d230 msgr2=0x7fee7c15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:32.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.813+0000 7fee7bfff700 1 --2- 172.21.15.71:0/3039354709 >> v2:172.21.15.179:3300/0 conn(0x7fee7c15d230 0x7fee7c15d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:32.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.813+0000 7fee7bfff700 1 -- 172.21.15.71:0/3039354709 >> v1:172.21.15.71:6789/0 conn(0x7fee7c159420 legacy=0x7fee7c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:32.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.813+0000 7fee7bfff700 1 -- 172.21.15.71:0/3039354709 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c0b1790 con 0x7fee7c1597f0 2023-10-09T06:43:32.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.813+0000 7fee7b7fe700 1 -- 172.21.15.71:0/3039354709 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168175296 0 0) 0x7fee7c15db70 con 0x7fee7c159420 2023-10-09T06:43:32.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.813+0000 7fee7bfff700 1 --2- 172.21.15.71:0/3039354709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee7c1597f0 0x7fee7c0b2270 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fee7c15d170 tx=0x7fee68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f30742b8f741bfe6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:32.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.813+0000 7fee7b7fe700 1 -- 172.21.15.71:0/3039354709 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6800b860 con 0x7fee7c1597f0 2023-10-09T06:43:32.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.813+0000 7fee7b7fe700 1 -- 172.21.15.71:0/3039354709 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6800b9c0 con 0x7fee7c1597f0 2023-10-09T06:43:32.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.814+0000 7fee7b7fe700 1 -- 172.21.15.71:0/3039354709 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6800bd60 con 0x7fee7c1597f0 2023-10-09T06:43:32.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.814+0000 7fee81b9d700 1 -- 172.21.15.71:0/3039354709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee7c1597f0 msgr2=0x7fee7c0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:32.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.814+0000 7fee81b9d700 1 --2- 172.21.15.71:0/3039354709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee7c1597f0 0x7fee7c0b2270 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fee7c15d170 tx=0x7fee68009250 comp rx=0 tx=0).stop 2023-10-09T06:43:32.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.814+0000 7fee81b9d700 1 -- 172.21.15.71:0/3039354709 shutdown_connections 2023-10-09T06:43:32.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.814+0000 7fee81b9d700 1 --2- 172.21.15.71:0/3039354709 >> v2:172.21.15.179:3300/0 conn(0x7fee7c15d230 0x7fee7c15d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:32.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.814+0000 7fee81b9d700 1 --2- 172.21.15.71:0/3039354709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee7c1597f0 0x7fee7c0b2270 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:32.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.814+0000 7fee81b9d700 1 -- 172.21.15.71:0/3039354709 >> 172.21.15.71:0/3039354709 conn(0x7fee7c0d0660 msgr2=0x7fee7c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:32.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.814+0000 7fee81b9d700 1 -- 172.21.15.71:0/3039354709 shutdown_connections 2023-10-09T06:43:32.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.814+0000 7fee81b9d700 1 -- 172.21.15.71:0/3039354709 wait complete. 2023-10-09T06:43:32.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.816+0000 7fee81b9d700 1 Processor -- start 2023-10-09T06:43:32.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.816+0000 7fee81b9d700 1 -- start start 2023-10-09T06:43:32.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.817+0000 7fee81b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee7c159420 0x7fee7c147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:32.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.817+0000 7fee81b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee7c1597f0 0x7fee7c0c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:32.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.817+0000 7fee81b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee7c15d230 0x7fee7c169cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:32.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.817+0000 7fee81b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c15bf90 con 0x7fee7c1597f0 2023-10-09T06:43:32.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.817+0000 7fee81b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c1476a0 con 0x7fee7c15d230 2023-10-09T06:43:32.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.817+0000 7fee81b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c0c5940 con 0x7fee7c159420 2023-10-09T06:43:32.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.817+0000 7fee7bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee7c1597f0 0x7fee7c0c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:32.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.817+0000 7fee7bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee7c1597f0 0x7fee7c0c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59360/0 (socket says 172.21.15.71:59360) 2023-10-09T06:43:32.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.817+0000 7fee7bfff700 1 -- 172.21.15.71:0/1867664824 learned_addr learned my addr 172.21.15.71:0/1867664824 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.817+0000 7fee80b9b700 1 --2- 172.21.15.71:0/1867664824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee7c159420 0x7fee7c147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.817+0000 7fee8139c700 1 --2- 172.21.15.71:0/1867664824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee7c15d230 0x7fee7c169cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.817+0000 7fee7bfff700 1 -- 172.21.15.71:0/1867664824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee7c159420 msgr2=0x7fee7c147160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.817+0000 7fee7bfff700 1 --2- 172.21.15.71:0/1867664824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee7c159420 0x7fee7c147160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.817+0000 7fee7bfff700 1 -- 172.21.15.71:0/1867664824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee7c15d230 msgr2=0x7fee7c169cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.817+0000 7fee7bfff700 1 --2- 172.21.15.71:0/1867664824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee7c15d230 0x7fee7c169cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.817+0000 7fee7bfff700 1 -- 172.21.15.71:0/1867664824 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee680094f0 con 0x7fee7c1597f0 2023-10-09T06:43:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.818+0000 7fee7bfff700 1 --2- 172.21.15.71:0/1867664824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee7c1597f0 0x7fee7c0c5400 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fee7c089340 tx=0x7fee68017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.818+0000 7fee78ff9700 1 -- 172.21.15.71:0/1867664824 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68011e00 con 0x7fee7c1597f0 2023-10-09T06:43:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.818+0000 7fee78ff9700 1 -- 172.21.15.71:0/1867664824 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee68024440 con 0x7fee7c1597f0 2023-10-09T06:43:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.818+0000 7fee78ff9700 1 -- 172.21.15.71:0/1867664824 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68024800 con 0x7fee7c1597f0 2023-10-09T06:43:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.818+0000 7fee81b9d700 1 -- 172.21.15.71:0/1867664824 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7c15bb00 con 0x7fee7c1597f0 2023-10-09T06:43:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.818+0000 7fee81b9d700 1 -- 172.21.15.71:0/1867664824 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7c15b1d0 con 0x7fee7c1597f0 2023-10-09T06:43:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.819+0000 7fee81b9d700 1 -- 172.21.15.71:0/1867664824 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7c04c3c0 con 0x7fee7c1597f0 2023-10-09T06:43:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.820+0000 7fee78ff9700 1 -- 172.21.15.71:0/1867664824 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee6802d440 con 0x7fee7c1597f0 2023-10-09T06:43:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.821+0000 7fee78ff9700 1 --2- 172.21.15.71:0/1867664824 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fee60066f30 0x7fee600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.821+0000 7fee78ff9700 1 -- 172.21.15.71:0/1867664824 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee68085fe0 con 0x7fee7c1597f0 2023-10-09T06:43:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.822+0000 7fee80b9b700 1 --2- 172.21.15.71:0/1867664824 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fee60066f30 0x7fee600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.822+0000 7fee80b9b700 1 --2- 172.21.15.71:0/1867664824 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fee60066f30 0x7fee600693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fee70007fd0 tx=0x7fee70007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:32.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:32.826+0000 7fee78ff9700 1 -- 172.21.15.71:0/1867664824 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee68053210 con 0x7fee7c1597f0 2023-10-09T06:43:33.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.013+0000 7fee81b9d700 1 -- 172.21.15.71:0/1867664824 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee7c06a160 con 0x7fee7c1597f0 2023-10-09T06:43:33.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.014+0000 7fee78ff9700 1 -- 172.21.15.71:0/1867664824 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15363 (secure 0 0 0) 0x7fee6805ae60 con 0x7fee7c1597f0 2023-10-09T06:43:33.015 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:33.015 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":31,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:43:32.039302+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:43:29.634330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T06:43:31.023113+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:43:33.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.016+0000 7fee81b9d700 1 -- 172.21.15.71:0/1867664824 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fee60066f30 msgr2=0x7fee600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:33.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.016+0000 7fee81b9d700 1 --2- 172.21.15.71:0/1867664824 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fee60066f30 0x7fee600693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fee70007fd0 tx=0x7fee70007d50 comp rx=0 tx=0).stop 2023-10-09T06:43:33.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.016+0000 7fee81b9d700 1 -- 172.21.15.71:0/1867664824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee7c1597f0 msgr2=0x7fee7c0c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:33.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.016+0000 7fee81b9d700 1 --2- 172.21.15.71:0/1867664824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee7c1597f0 0x7fee7c0c5400 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fee7c089340 tx=0x7fee68017000 comp rx=0 tx=0).stop 2023-10-09T06:43:33.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.016+0000 7fee81b9d700 1 -- 172.21.15.71:0/1867664824 shutdown_connections 2023-10-09T06:43:33.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.016+0000 7fee81b9d700 1 --2- 172.21.15.71:0/1867664824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee7c15d230 0x7fee7c169cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:33.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.016+0000 7fee81b9d700 1 --2- 172.21.15.71:0/1867664824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee7c159420 0x7fee7c147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:33.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.016+0000 7fee81b9d700 1 --2- 172.21.15.71:0/1867664824 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fee60066f30 0x7fee600693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:33.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.016+0000 7fee81b9d700 1 --2- 172.21.15.71:0/1867664824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee7c1597f0 0x7fee7c0c5400 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:33.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.016+0000 7fee81b9d700 1 -- 172.21.15.71:0/1867664824 >> 172.21.15.71:0/1867664824 conn(0x7fee7c0d0660 msgr2=0x7fee7c157ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:33.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.017+0000 7fee81b9d700 1 -- 172.21.15.71:0/1867664824 shutdown_connections 2023-10-09T06:43:33.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.017+0000 7fee81b9d700 1 -- 172.21.15.71:0/1867664824 wait complete. 2023-10-09T06:43:33.035 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:43:33.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.216+0000 7ff37c9fe700 1 Processor -- start 2023-10-09T06:43:33.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.216+0000 7ff37c9fe700 1 -- start start 2023-10-09T06:43:33.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.217+0000 7ff37c9fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff3780b1e50 0x7ff378159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:33.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.217+0000 7ff37c9fe700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3780cfe20 con 0x7ff3781593b0 2023-10-09T06:43:33.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.217+0000 7ff37c9fe700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3780cf210 con 0x7ff3780ceaa0 2023-10-09T06:43:33.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.217+0000 7ff37c9fe700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3780cf4f0 con 0x7ff3780b1e50 2023-10-09T06:43:33.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.217+0000 7ff37659c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff3780b1e50 0x7ff378159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:33.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.217+0000 7ff37659c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff3780b1e50 0x7ff378159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59376/0 (socket says 172.21.15.71:59376) 2023-10-09T06:43:33.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.217+0000 7ff37659c700 1 -- 172.21.15.71:0/2870791956 learned_addr learned my addr 172.21.15.71:0/2870791956 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:33.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.217+0000 7ff376d9d700 1 --1- 172.21.15.71:0/2870791956 >> v1:172.21.15.71:6789/0 conn(0x7ff3781593b0 0x7ff3780b1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51800/0 (socket says 172.21.15.71:51800) 2023-10-09T06:43:33.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.218+0000 7ff37659c700 1 -- 172.21.15.71:0/2870791956 >> v1:172.21.15.179:6789/0 conn(0x7ff3780ceaa0 legacy=0x7ff3780b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:33.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.218+0000 7ff37659c700 1 -- 172.21.15.71:0/2870791956 >> v1:172.21.15.71:6789/0 conn(0x7ff3781593b0 legacy=0x7ff3780b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:33.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.218+0000 7ff37659c700 1 -- 172.21.15.71:0/2870791956 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3780cf7d0 con 0x7ff3780b1e50 2023-10-09T06:43:33.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.218+0000 7ff375d9b700 1 -- 172.21.15.71:0/2870791956 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663409786 0 0) 0x7ff3780cfe20 con 0x7ff3781593b0 2023-10-09T06:43:33.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.218+0000 7ff37659c700 1 --2- 172.21.15.71:0/2870791956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3780b1e50 0x7ff378159780 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0099b0 tx=0x7ff36c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8af96c0bcea2804 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:33.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.218+0000 7ff375d9b700 1 -- 172.21.15.71:0/2870791956 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c00b820 con 0x7ff3780b1e50 2023-10-09T06:43:33.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.218+0000 7ff375d9b700 1 -- 172.21.15.71:0/2870791956 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c00b980 con 0x7ff3780b1e50 2023-10-09T06:43:33.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.218+0000 7ff375d9b700 1 -- 172.21.15.71:0/2870791956 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c00bd20 con 0x7ff3780b1e50 2023-10-09T06:43:33.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.219+0000 7ff37c9fe700 1 -- 172.21.15.71:0/2870791956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3780b1e50 msgr2=0x7ff378159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:33.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.219+0000 7ff37c9fe700 1 --2- 172.21.15.71:0/2870791956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3780b1e50 0x7ff378159780 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0099b0 tx=0x7ff36c009250 comp rx=0 tx=0).stop 2023-10-09T06:43:33.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.219+0000 7ff37c9fe700 1 -- 172.21.15.71:0/2870791956 shutdown_connections 2023-10-09T06:43:33.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.219+0000 7ff37c9fe700 1 --2- 172.21.15.71:0/2870791956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3780b1e50 0x7ff378159780 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:33.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.219+0000 7ff37c9fe700 1 -- 172.21.15.71:0/2870791956 >> 172.21.15.71:0/2870791956 conn(0x7ff3780d1130 msgr2=0x7ff3780b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:33.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.219+0000 7ff37c9fe700 1 -- 172.21.15.71:0/2870791956 shutdown_connections 2023-10-09T06:43:33.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.219+0000 7ff37c9fe700 1 -- 172.21.15.71:0/2870791956 wait complete. 2023-10-09T06:43:33.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.220+0000 7ff37c9fe700 1 Processor -- start 2023-10-09T06:43:33.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.221+0000 7ff37c9fe700 1 -- start start 2023-10-09T06:43:33.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.221+0000 7ff37c9fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3780b1e50 0x7ff378154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:33.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.221+0000 7ff37c9fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3780ceaa0 0x7ff37814e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:33.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.221+0000 7ff37c9fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3781593b0 0x7ff37815f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:33.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.221+0000 7ff37c9fe700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37815f330 con 0x7ff3781593b0 2023-10-09T06:43:33.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.221+0000 7ff37c9fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37815e720 con 0x7ff3780b1e50 2023-10-09T06:43:33.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.221+0000 7ff37c9fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37815ea00 con 0x7ff3780ceaa0 2023-10-09T06:43:33.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.222+0000 7ff37759e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3781593b0 0x7ff37815f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:33.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.222+0000 7ff37759e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3781593b0 0x7ff37815f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59384/0 (socket says 172.21.15.71:59384) 2023-10-09T06:43:33.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.222+0000 7ff37759e700 1 -- 172.21.15.71:0/766821342 learned_addr learned my addr 172.21.15.71:0/766821342 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:33.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.222+0000 7ff37659c700 1 --2- 172.21.15.71:0/766821342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3780ceaa0 0x7ff37814e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:33.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.222+0000 7ff376d9d700 1 --2- 172.21.15.71:0/766821342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3780b1e50 0x7ff378154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:33.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.222+0000 7ff37759e700 1 -- 172.21.15.71:0/766821342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3780ceaa0 msgr2=0x7ff37814e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:33.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.222+0000 7ff37759e700 1 --2- 172.21.15.71:0/766821342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3780ceaa0 0x7ff37814e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:33.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.222+0000 7ff37759e700 1 -- 172.21.15.71:0/766821342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3780b1e50 msgr2=0x7ff378154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:33.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.222+0000 7ff37759e700 1 --2- 172.21.15.71:0/766821342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3780b1e50 0x7ff378154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:33.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.222+0000 7ff37759e700 1 -- 172.21.15.71:0/766821342 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c0094f0 con 0x7ff3781593b0 2023-10-09T06:43:33.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.222+0000 7ff37759e700 1 --2- 172.21.15.71:0/766821342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3781593b0 0x7ff37815f7c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff37000c930 tx=0x7ff3700026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:33.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.223+0000 7ff35effd700 1 -- 172.21.15.71:0/766821342 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff370012630 con 0x7ff3781593b0 2023-10-09T06:43:33.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.223+0000 7ff35effd700 1 -- 172.21.15.71:0/766821342 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3700127d0 con 0x7ff3781593b0 2023-10-09T06:43:33.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.223+0000 7ff35effd700 1 -- 172.21.15.71:0/766821342 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff370012b90 con 0x7ff3781593b0 2023-10-09T06:43:33.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.223+0000 7ff37c9fe700 1 -- 172.21.15.71:0/766821342 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff37815ece0 con 0x7ff3781593b0 2023-10-09T06:43:33.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.223+0000 7ff37c9fe700 1 -- 172.21.15.71:0/766821342 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3781550a0 con 0x7ff3781593b0 2023-10-09T06:43:33.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.224+0000 7ff37c9fe700 1 -- 172.21.15.71:0/766821342 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff37804c3c0 con 0x7ff3781593b0 2023-10-09T06:43:33.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.225+0000 7ff35effd700 1 -- 172.21.15.71:0/766821342 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff37000a3b0 con 0x7ff3781593b0 2023-10-09T06:43:33.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.226+0000 7ff35effd700 1 --2- 172.21.15.71:0/766821342 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff364066f30 0x7ff3640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:33.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.226+0000 7ff35effd700 1 -- 172.21.15.71:0/766821342 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff370084280 con 0x7ff3781593b0 2023-10-09T06:43:33.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.226+0000 7ff376d9d700 1 --2- 172.21.15.71:0/766821342 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff364066f30 0x7ff3640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:33.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.227+0000 7ff376d9d700 1 --2- 172.21.15.71:0/766821342 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff364066f30 0x7ff3640693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff368007fd0 tx=0x7ff368007e10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:33.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.230+0000 7ff35effd700 1 -- 172.21.15.71:0/766821342 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3700514f0 con 0x7ff3781593b0 2023-10-09T06:43:33.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.423+0000 7ff37c9fe700 1 -- 172.21.15.71:0/766821342 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3780cfab0 con 0x7ff3781593b0 2023-10-09T06:43:33.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.424+0000 7ff35effd700 1 -- 172.21.15.71:0/766821342 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15363 (secure 0 0 0) 0x7ff370054b10 con 0x7ff3781593b0 2023-10-09T06:43:33.425 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:33.425 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":31,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:43:32.039302+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:43:29.634330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T06:43:31.023113+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:43:33.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.426+0000 7ff37c9fe700 1 -- 172.21.15.71:0/766821342 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff364066f30 msgr2=0x7ff3640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:33.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.426+0000 7ff37c9fe700 1 --2- 172.21.15.71:0/766821342 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff364066f30 0x7ff3640693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff368007fd0 tx=0x7ff368007e10 comp rx=0 tx=0).stop 2023-10-09T06:43:33.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.426+0000 7ff37c9fe700 1 -- 172.21.15.71:0/766821342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3781593b0 msgr2=0x7ff37815f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:33.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.426+0000 7ff37c9fe700 1 --2- 172.21.15.71:0/766821342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3781593b0 0x7ff37815f7c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff37000c930 tx=0x7ff3700026e0 comp rx=0 tx=0).stop 2023-10-09T06:43:33.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.426+0000 7ff37c9fe700 1 -- 172.21.15.71:0/766821342 shutdown_connections 2023-10-09T06:43:33.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.426+0000 7ff37c9fe700 1 --2- 172.21.15.71:0/766821342 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff364066f30 0x7ff3640693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:33.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.426+0000 7ff37c9fe700 1 --2- 172.21.15.71:0/766821342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3781593b0 0x7ff37815f7c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:33.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.426+0000 7ff37c9fe700 1 --2- 172.21.15.71:0/766821342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3780b1e50 0x7ff378154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:33.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.426+0000 7ff37c9fe700 1 --2- 172.21.15.71:0/766821342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3780ceaa0 0x7ff37814e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:33.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.426+0000 7ff37c9fe700 1 -- 172.21.15.71:0/766821342 >> 172.21.15.71:0/766821342 conn(0x7ff3780d1130 msgr2=0x7ff3780b4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:33.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.426+0000 7ff37c9fe700 1 -- 172.21.15.71:0/766821342 shutdown_connections 2023-10-09T06:43:33.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.426+0000 7ff37c9fe700 1 -- 172.21.15.71:0/766821342 wait complete. 2023-10-09T06:43:33.444 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T06:43:33.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.632+0000 7fdd903ff700 1 Processor -- start 2023-10-09T06:43:33.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.632+0000 7fdd903ff700 1 -- start start 2023-10-09T06:43:33.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.633+0000 7fdd903ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdd88159c60 0x7fdd8815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:33.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.633+0000 7fdd903ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8815a160 con 0x7fdd88159890 2023-10-09T06:43:33.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.633+0000 7fdd903ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd880d13a0 con 0x7fdd8815db10 2023-10-09T06:43:33.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.633+0000 7fdd903ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8815df50 con 0x7fdd88159c60 2023-10-09T06:43:33.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.634+0000 7fdd8d99a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdd88159c60 0x7fdd8815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:33.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.634+0000 7fdd8e19b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fdd88159890 0x7fdd8815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51802/0 (socket says 172.21.15.71:51802) 2023-10-09T06:43:33.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.634+0000 7fdd8e19b700 1 -- 172.21.15.71:0/3020713692 learned_addr learned my addr 172.21.15.71:0/3020713692 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:33.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.634+0000 7fdd8d99a700 1 -- 172.21.15.71:0/3020713692 >> v1:172.21.15.179:6789/0 conn(0x7fdd8815db10 legacy=0x7fdd88069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:33.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.634+0000 7fdd8d99a700 1 -- 172.21.15.71:0/3020713692 >> v1:172.21.15.71:6789/0 conn(0x7fdd88159890 legacy=0x7fdd8815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:33.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.634+0000 7fdd8d99a700 1 -- 172.21.15.71:0/3020713692 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8815e140 con 0x7fdd88159c60 2023-10-09T06:43:33.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.634+0000 7fdd8d199700 1 -- 172.21.15.71:0/3020713692 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1370559181 0 0) 0x7fdd8815a160 con 0x7fdd88159890 2023-10-09T06:43:33.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.634+0000 7fdd8d99a700 1 --2- 172.21.15.71:0/3020713692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd88159c60 0x7fdd8815d5d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdd780098e0 tx=0x7fdd780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb5d8dcf08c21bc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:33.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.635+0000 7fdd8d199700 1 -- 172.21.15.71:0/3020713692 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78009e80 con 0x7fdd88159c60 2023-10-09T06:43:33.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.635+0000 7fdd8d199700 1 -- 172.21.15.71:0/3020713692 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7800b860 con 0x7fdd88159c60 2023-10-09T06:43:33.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.635+0000 7fdd8d199700 1 -- 172.21.15.71:0/3020713692 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7800bbe0 con 0x7fdd88159c60 2023-10-09T06:43:33.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.635+0000 7fdd903ff700 1 -- 172.21.15.71:0/3020713692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd88159c60 msgr2=0x7fdd8815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:33.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.635+0000 7fdd903ff700 1 --2- 172.21.15.71:0/3020713692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd88159c60 0x7fdd8815d5d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdd780098e0 tx=0x7fdd780091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:33.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.635+0000 7fdd903ff700 1 -- 172.21.15.71:0/3020713692 shutdown_connections 2023-10-09T06:43:33.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.635+0000 7fdd903ff700 1 --2- 172.21.15.71:0/3020713692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd88159c60 0x7fdd8815d5d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:33.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.635+0000 7fdd903ff700 1 -- 172.21.15.71:0/3020713692 >> 172.21.15.71:0/3020713692 conn(0x7fdd88068e20 msgr2=0x7fdd880d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:33.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.635+0000 7fdd903ff700 1 -- 172.21.15.71:0/3020713692 shutdown_connections 2023-10-09T06:43:33.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.635+0000 7fdd903ff700 1 -- 172.21.15.71:0/3020713692 wait complete. 2023-10-09T06:43:33.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.637+0000 7fdd903ff700 1 Processor -- start 2023-10-09T06:43:33.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.637+0000 7fdd903ff700 1 -- start start 2023-10-09T06:43:33.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.638+0000 7fdd903ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd88159890 0x7fdd880b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:33.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.638+0000 7fdd903ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd88159c60 0x7fdd880b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:33.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.638+0000 7fdd903ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd8815db10 0x7fdd880b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:33.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.638+0000 7fdd903ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd880b2090 con 0x7fdd88159890 2023-10-09T06:43:33.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.638+0000 7fdd903ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd880b64b0 con 0x7fdd8815db10 2023-10-09T06:43:33.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.638+0000 7fdd903ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd880b1480 con 0x7fdd88159c60 2023-10-09T06:43:33.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.638+0000 7fdd8e19b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd88159890 0x7fdd880b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:33.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.638+0000 7fdd8e19b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd88159890 0x7fdd880b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59400/0 (socket says 172.21.15.71:59400) 2023-10-09T06:43:33.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.638+0000 7fdd8e19b700 1 -- 172.21.15.71:0/410061616 learned_addr learned my addr 172.21.15.71:0/410061616 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:33.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.638+0000 7fdd8e19b700 1 -- 172.21.15.71:0/410061616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd88159c60 msgr2=0x7fdd880b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:33.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.638+0000 7fdd8e19b700 1 --2- 172.21.15.71:0/410061616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd88159c60 0x7fdd880b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:33.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.638+0000 7fdd8e19b700 1 -- 172.21.15.71:0/410061616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd8815db10 msgr2=0x7fdd880b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:33.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.638+0000 7fdd8e19b700 1 --2- 172.21.15.71:0/410061616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd8815db10 0x7fdd880b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:33.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.638+0000 7fdd8e19b700 1 -- 172.21.15.71:0/410061616 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd78009420 con 0x7fdd88159890 2023-10-09T06:43:33.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.639+0000 7fdd8e19b700 1 --2- 172.21.15.71:0/410061616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd88159890 0x7fdd880b5f70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400c810 tx=0x7fdd84007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:33.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.639+0000 7fdd7e7fc700 1 -- 172.21.15.71:0/410061616 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84005c00 con 0x7fdd88159890 2023-10-09T06:43:33.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.639+0000 7fdd7e7fc700 1 -- 172.21.15.71:0/410061616 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd84005d60 con 0x7fdd88159890 2023-10-09T06:43:33.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.639+0000 7fdd903ff700 1 -- 172.21.15.71:0/410061616 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd880b1760 con 0x7fdd88159890 2023-10-09T06:43:33.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.639+0000 7fdd7e7fc700 1 -- 172.21.15.71:0/410061616 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84007340 con 0x7fdd88159890 2023-10-09T06:43:33.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.639+0000 7fdd903ff700 1 -- 172.21.15.71:0/410061616 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd880b1d20 con 0x7fdd88159890 2023-10-09T06:43:33.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.640+0000 7fdd903ff700 1 -- 172.21.15.71:0/410061616 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8804c3c0 con 0x7fdd88159890 2023-10-09T06:43:33.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.641+0000 7fdd7e7fc700 1 -- 172.21.15.71:0/410061616 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd8401b400 con 0x7fdd88159890 2023-10-09T06:43:33.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.642+0000 7fdd7e7fc700 1 --2- 172.21.15.71:0/410061616 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdd6c066f30 0x7fdd6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:33.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.642+0000 7fdd7e7fc700 1 -- 172.21.15.71:0/410061616 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdd84084080 con 0x7fdd88159890 2023-10-09T06:43:33.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.642+0000 7fdd8d99a700 1 --2- 172.21.15.71:0/410061616 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdd6c066f30 0x7fdd6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:33.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.643+0000 7fdd8d99a700 1 --2- 172.21.15.71:0/410061616 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdd6c066f30 0x7fdd6c0693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdd88157310 tx=0x7fdd78017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:33.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.646+0000 7fdd7e7fc700 1 -- 172.21.15.71:0/410061616 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd840512d0 con 0x7fdd88159890 2023-10-09T06:43:33.678 INFO:tasks.ceph.mds.c.smithi071.stderr:2023-10-09T06:43:33.677+0000 7fcafc3f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:43:33.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:33.877+0000 7fdd903ff700 1 -- 172.21.15.71:0/410061616 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdd880caba0 con 0x7fdd88159890 2023-10-09T06:43:34.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.598+0000 7fdd7e7fc700 1 -- 172.21.15.71:0/410061616 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdd840548f0 con 0x7fdd88159890 2023-10-09T06:43:34.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.600+0000 7fdd903ff700 1 -- 172.21.15.71:0/410061616 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdd6c066f30 msgr2=0x7fdd6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:34.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.600+0000 7fdd903ff700 1 --2- 172.21.15.71:0/410061616 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdd6c066f30 0x7fdd6c0693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdd88157310 tx=0x7fdd78017000 comp rx=0 tx=0).stop 2023-10-09T06:43:34.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.600+0000 7fdd903ff700 1 -- 172.21.15.71:0/410061616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd88159890 msgr2=0x7fdd880b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:34.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.600+0000 7fdd903ff700 1 --2- 172.21.15.71:0/410061616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd88159890 0x7fdd880b5f70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400c810 tx=0x7fdd84007d90 comp rx=0 tx=0).stop 2023-10-09T06:43:34.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.600+0000 7fdd903ff700 1 -- 172.21.15.71:0/410061616 shutdown_connections 2023-10-09T06:43:34.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.600+0000 7fdd903ff700 1 --2- 172.21.15.71:0/410061616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd8815db10 0x7fdd880b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:34.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.600+0000 7fdd903ff700 1 --2- 172.21.15.71:0/410061616 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdd6c066f30 0x7fdd6c0693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.600+0000 7fdd903ff700 1 --2- 172.21.15.71:0/410061616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd88159890 0x7fdd880b5f70 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.600+0000 7fdd903ff700 1 --2- 172.21.15.71:0/410061616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd88159c60 0x7fdd880b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.600+0000 7fdd903ff700 1 -- 172.21.15.71:0/410061616 >> 172.21.15.71:0/410061616 conn(0x7fdd88068e20 msgr2=0x7fdd88153fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.601+0000 7fdd903ff700 1 -- 172.21.15.71:0/410061616 shutdown_connections 2023-10-09T06:43:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.601+0000 7fdd903ff700 1 -- 172.21.15.71:0/410061616 wait complete. 2023-10-09T06:43:34.621 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T06:43:34.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.806+0000 7f63c7fff700 1 Processor -- start 2023-10-09T06:43:34.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.806+0000 7f63c7fff700 1 -- start start 2023-10-09T06:43:34.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.807+0000 7f63c7fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f63c8068550 0x7f63c8068920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:34.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.807+0000 7f63c7fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f63c80b0b60 0x7f63c80b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:34.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.807+0000 7f63c7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63c8159260 0x7f63c81596e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:34.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.807+0000 7f63c7fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c806cff0 con 0x7f63c80b0b60 2023-10-09T06:43:34.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.807+0000 7f63c7fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c806bf50 con 0x7f63c8068550 2023-10-09T06:43:34.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.807+0000 7f63c7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c806c230 con 0x7f63c8159260 2023-10-09T06:43:34.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.807+0000 7f63c67fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f63c80b0b60 0x7f63c80b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:34.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.807+0000 7f63c67fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f63c80b0b60 0x7f63c80b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59416/0 (socket says 172.21.15.71:59416) 2023-10-09T06:43:34.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.807+0000 7f63c67fc700 1 -- 172.21.15.71:0/4032030006 learned_addr learned my addr 172.21.15.71:0/4032030006 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:34.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.808+0000 7f63c6ffd700 1 --2- 172.21.15.71:0/4032030006 >> v2:172.21.15.179:3300/0 conn(0x7f63c8068550 0x7f63c8068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:34.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.808+0000 7f63c77fe700 1 --2- 172.21.15.71:0/4032030006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63c8159260 0x7f63c81596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:34.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.808+0000 7f63c67fc700 1 -- 172.21.15.71:0/4032030006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63c8159260 msgr2=0x7f63c81596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:34.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.808+0000 7f63c67fc700 1 --2- 172.21.15.71:0/4032030006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63c8159260 0x7f63c81596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:34.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.808+0000 7f63c67fc700 1 -- 172.21.15.71:0/4032030006 >> v2:172.21.15.179:3300/0 conn(0x7f63c8068550 msgr2=0x7f63c8068920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:34.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.808+0000 7f63c67fc700 1 --2- 172.21.15.71:0/4032030006 >> v2:172.21.15.179:3300/0 conn(0x7f63c8068550 0x7f63c8068920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:34.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.808+0000 7f63c67fc700 1 -- 172.21.15.71:0/4032030006 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c806c510 con 0x7f63c80b0b60 2023-10-09T06:43:34.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.808+0000 7f63c6ffd700 1 --2- 172.21.15.71:0/4032030006 >> v2:172.21.15.179:3300/0 conn(0x7f63c8068550 0x7f63c8068920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:34.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.808+0000 7f63c77fe700 1 --2- 172.21.15.71:0/4032030006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63c8159260 0x7f63c81596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:34.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.808+0000 7f63c67fc700 1 --2- 172.21.15.71:0/4032030006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63c80b0b60 0x7f63c80b0fd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f63c806b600 tx=0x7f63bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb5e6999795d498 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:34.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.808+0000 7f63c5ffb700 1 -- 172.21.15.71:0/4032030006 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc00b860 con 0x7f63c80b0b60 2023-10-09T06:43:34.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.808+0000 7f63c5ffb700 1 -- 172.21.15.71:0/4032030006 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63bc00b9c0 con 0x7f63c80b0b60 2023-10-09T06:43:34.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.808+0000 7f63c5ffb700 1 -- 172.21.15.71:0/4032030006 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc00bd60 con 0x7f63c80b0b60 2023-10-09T06:43:34.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.809+0000 7f63c7fff700 1 -- 172.21.15.71:0/4032030006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63c80b0b60 msgr2=0x7f63c80b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:34.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.809+0000 7f63c7fff700 1 --2- 172.21.15.71:0/4032030006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63c80b0b60 0x7f63c80b0fd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f63c806b600 tx=0x7f63bc009250 comp rx=0 tx=0).stop 2023-10-09T06:43:34.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.809+0000 7f63c7fff700 1 -- 172.21.15.71:0/4032030006 shutdown_connections 2023-10-09T06:43:34.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.809+0000 7f63c7fff700 1 --2- 172.21.15.71:0/4032030006 >> v2:172.21.15.179:3300/0 conn(0x7f63c8068550 0x7f63c8068920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:34.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.809+0000 7f63c7fff700 1 --2- 172.21.15.71:0/4032030006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63c8159260 0x7f63c81596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:34.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.809+0000 7f63c7fff700 1 --2- 172.21.15.71:0/4032030006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63c80b0b60 0x7f63c80b0fd0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:34.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.809+0000 7f63c7fff700 1 -- 172.21.15.71:0/4032030006 >> 172.21.15.71:0/4032030006 conn(0x7f63c806a940 msgr2=0x7f63c806ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:34.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.809+0000 7f63c7fff700 1 -- 172.21.15.71:0/4032030006 shutdown_connections 2023-10-09T06:43:34.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.809+0000 7f63c7fff700 1 -- 172.21.15.71:0/4032030006 wait complete. 2023-10-09T06:43:34.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.811+0000 7f63c7fff700 1 Processor -- start 2023-10-09T06:43:34.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.811+0000 7f63c7fff700 1 -- start start 2023-10-09T06:43:34.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.812+0000 7f63c7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63c8068550 0x7f63c81517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:34.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.812+0000 7f63c7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63c80b0b60 0x7f63c8169c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:34.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.812+0000 7f63c7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63c8159260 0x7f63c815b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:34.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.812+0000 7f63c7fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c80ce1b0 con 0x7f63c8159260 2023-10-09T06:43:34.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.812+0000 7f63c7fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c815acf0 con 0x7f63c8068550 2023-10-09T06:43:34.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.812+0000 7f63c7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c80ae0e0 con 0x7f63c80b0b60 2023-10-09T06:43:34.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.812+0000 7f63c77fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63c8159260 0x7f63c815b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:34.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.812+0000 7f63c77fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63c8159260 0x7f63c815b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59422/0 (socket says 172.21.15.71:59422) 2023-10-09T06:43:34.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.812+0000 7f63c77fe700 1 -- 172.21.15.71:0/424029654 learned_addr learned my addr 172.21.15.71:0/424029654 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:34.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.812+0000 7f63c6ffd700 1 --2- 172.21.15.71:0/424029654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63c8068550 0x7f63c81517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:34.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.812+0000 7f63c67fc700 1 --2- 172.21.15.71:0/424029654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63c80b0b60 0x7f63c8169c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:34.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.812+0000 7f63c77fe700 1 -- 172.21.15.71:0/424029654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63c80b0b60 msgr2=0x7f63c8169c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:34.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.812+0000 7f63c77fe700 1 --2- 172.21.15.71:0/424029654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63c80b0b60 0x7f63c8169c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:34.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.812+0000 7f63c77fe700 1 -- 172.21.15.71:0/424029654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63c8068550 msgr2=0x7f63c81517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:34.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.812+0000 7f63c77fe700 1 --2- 172.21.15.71:0/424029654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63c8068550 0x7f63c81517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:34.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.812+0000 7f63c77fe700 1 -- 172.21.15.71:0/424029654 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63bc0094f0 con 0x7f63c8159260 2023-10-09T06:43:34.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.813+0000 7f63c77fe700 1 --2- 172.21.15.71:0/424029654 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63c8159260 0x7f63c815b180 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f63c000cf20 tx=0x7f63c0007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:34.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.813+0000 7f63aeffd700 1 -- 172.21.15.71:0/424029654 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c000adf0 con 0x7f63c8159260 2023-10-09T06:43:34.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.813+0000 7f63aeffd700 1 -- 172.21.15.71:0/424029654 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c0016420 con 0x7f63c8159260 2023-10-09T06:43:34.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.813+0000 7f63c7fff700 1 -- 172.21.15.71:0/424029654 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c815a0e0 con 0x7f63c8159260 2023-10-09T06:43:34.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.813+0000 7f63aeffd700 1 -- 172.21.15.71:0/424029654 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c00167e0 con 0x7f63c8159260 2023-10-09T06:43:34.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.813+0000 7f63c7fff700 1 -- 172.21.15.71:0/424029654 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c815a6a0 con 0x7f63c8159260 2023-10-09T06:43:34.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.814+0000 7f63c7fff700 1 -- 172.21.15.71:0/424029654 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c815ae80 con 0x7f63c8159260 2023-10-09T06:43:34.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.815+0000 7f63aeffd700 1 -- 172.21.15.71:0/424029654 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f63c0016bd0 con 0x7f63c8159260 2023-10-09T06:43:34.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.816+0000 7f63aeffd700 1 --2- 172.21.15.71:0/424029654 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f63b4066f30 0x7f63b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:34.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.816+0000 7f63aeffd700 1 -- 172.21.15.71:0/424029654 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f63c0012070 con 0x7f63c8159260 2023-10-09T06:43:34.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.816+0000 7f63c6ffd700 1 --2- 172.21.15.71:0/424029654 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f63b4066f30 0x7f63b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:34.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.817+0000 7f63c6ffd700 1 --2- 172.21.15.71:0/424029654 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f63b4066f30 0x7f63b40693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f63b800ab30 tx=0x7f63b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:34.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:34.820+0000 7f63aeffd700 1 -- 172.21.15.71:0/424029654 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63c004e5a0 con 0x7f63c8159260 2023-10-09T06:43:35.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.051+0000 7f63c7fff700 1 -- 172.21.15.71:0/424029654 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f63c806c7f0 con 0x7f63c8159260 2023-10-09T06:43:35.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.603+0000 7f63aeffd700 1 -- 172.21.15.71:0/424029654 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f63c0089070 con 0x7f63c8159260 2023-10-09T06:43:35.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.606+0000 7f63c7fff700 1 -- 172.21.15.71:0/424029654 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f63b4066f30 msgr2=0x7f63b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:35.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.606+0000 7f63c7fff700 1 --2- 172.21.15.71:0/424029654 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f63b4066f30 0x7f63b40693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f63b800ab30 tx=0x7f63b8008040 comp rx=0 tx=0).stop 2023-10-09T06:43:35.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.606+0000 7f63c7fff700 1 -- 172.21.15.71:0/424029654 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63c8159260 msgr2=0x7f63c815b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:35.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.606+0000 7f63c7fff700 1 --2- 172.21.15.71:0/424029654 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63c8159260 0x7f63c815b180 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f63c000cf20 tx=0x7f63c0007860 comp rx=0 tx=0).stop 2023-10-09T06:43:35.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.606+0000 7f63c7fff700 1 -- 172.21.15.71:0/424029654 shutdown_connections 2023-10-09T06:43:35.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.606+0000 7f63c7fff700 1 --2- 172.21.15.71:0/424029654 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f63b4066f30 0x7f63b40693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:35.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.606+0000 7f63c7fff700 1 --2- 172.21.15.71:0/424029654 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63c8159260 0x7f63c815b180 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:35.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.606+0000 7f63c7fff700 1 --2- 172.21.15.71:0/424029654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63c8068550 0x7f63c81517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:35.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.606+0000 7f63c7fff700 1 --2- 172.21.15.71:0/424029654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63c80b0b60 0x7f63c8169c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:35.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.606+0000 7f63c7fff700 1 -- 172.21.15.71:0/424029654 >> 172.21.15.71:0/424029654 conn(0x7f63c806a940 msgr2=0x7f63c8155120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:35.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.606+0000 7f63c7fff700 1 -- 172.21.15.71:0/424029654 shutdown_connections 2023-10-09T06:43:35.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.606+0000 7f63c7fff700 1 -- 172.21.15.71:0/424029654 wait complete. 2023-10-09T06:43:35.626 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:43:35.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.807+0000 7ff0223ff700 1 Processor -- start 2023-10-09T06:43:35.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.807+0000 7ff0223ff700 1 -- start start 2023-10-09T06:43:35.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.808+0000 7ff0223ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff01c06c0a0 0x7ff01c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:35.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.808+0000 7ff0223ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01c15d7e0 con 0x7ff01c06bcd0 2023-10-09T06:43:35.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.808+0000 7ff0223ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01c15dac0 con 0x7ff01c15df50 2023-10-09T06:43:35.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.808+0000 7ff0223ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c15aa30 con 0x7ff01c06c0a0 2023-10-09T06:43:35.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.808+0000 7ff01bfff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff01c06bcd0 0x7ff01c15a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58226/0 (socket says 172.21.15.71:58226) 2023-10-09T06:43:35.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.808+0000 7ff01bfff700 1 -- 172.21.15.71:0/1834678118 learned_addr learned my addr 172.21.15.71:0/1834678118 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:35.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.809+0000 7ff01b7fe700 1 --2- 172.21.15.71:0/1834678118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff01c06c0a0 0x7ff01c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:35.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.809+0000 7ff01affd700 1 -- 172.21.15.71:0/1834678118 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134890291 0 0) 0x7ff01c15d7e0 con 0x7ff01c06bcd0 2023-10-09T06:43:35.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.809+0000 7ff01affd700 1 -- 172.21.15.71:0/1834678118 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff004003570 con 0x7ff01c06bcd0 2023-10-09T06:43:35.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.809+0000 7ff01affd700 1 -- 172.21.15.71:0/1834678118 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1910422013 0 0) 0x7ff01c15dac0 con 0x7ff01c15df50 2023-10-09T06:43:35.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.809+0000 7ff01affd700 1 -- 172.21.15.71:0/1834678118 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff01c15d7e0 con 0x7ff01c15df50 2023-10-09T06:43:35.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.809+0000 7ff01affd700 1 -- 172.21.15.71:0/1834678118 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1118943475 0 0) 0x7ff004003570 con 0x7ff01c06bcd0 2023-10-09T06:43:35.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.809+0000 7ff01affd700 1 -- 172.21.15.71:0/1834678118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff01c06c0a0 msgr2=0x7ff01c0caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:35.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.809+0000 7ff01affd700 1 --2- 172.21.15.71:0/1834678118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff01c06c0a0 0x7ff01c0caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:35.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.809+0000 7ff01affd700 1 -- 172.21.15.71:0/1834678118 >> v1:172.21.15.179:6789/0 conn(0x7ff01c15df50 legacy=0x7ff01c0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:35.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.809+0000 7ff01affd700 1 -- 172.21.15.71:0/1834678118 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c15ad10 con 0x7ff01c06bcd0 2023-10-09T06:43:35.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.809+0000 7ff01affd700 1 -- 172.21.15.71:0/1834678118 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7ff00c001470 con 0x7ff01c06bcd0 2023-10-09T06:43:35.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.809+0000 7ff01affd700 1 -- 172.21.15.71:0/1834678118 >> v1:172.21.15.71:6789/0 conn(0x7ff01c06bcd0 legacy=0x7ff01c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:35.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.809+0000 7ff01affd700 1 --2- 172.21.15.71:0/1834678118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff004003c20 0x7ff004004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:35.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.809+0000 7ff01affd700 1 --2- 172.21.15.71:0/1834678118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff004004810 0x7ff004004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:35.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.809+0000 7ff01affd700 1 --2- 172.21.15.71:0/1834678118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff01c06c0a0 0x7ff0040052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.809+0000 7ff01affd700 1 -- 172.21.15.71:0/1834678118 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c15aa30 con 0x7ff004003c20 2023-10-09T06:43:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.809+0000 7ff01affd700 1 -- 172.21.15.71:0/1834678118 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00400bc40 con 0x7ff004004810 2023-10-09T06:43:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.809+0000 7ff01affd700 1 -- 172.21.15.71:0/1834678118 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00400be00 con 0x7ff01c06c0a0 2023-10-09T06:43:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.810+0000 7ff01bfff700 1 --2- 172.21.15.71:0/1834678118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff004003c20 0x7ff004004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.810+0000 7ff01b7fe700 1 --2- 172.21.15.71:0/1834678118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff004004810 0x7ff004004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.810+0000 7ff02099c700 1 --2- 172.21.15.71:0/1834678118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff01c06c0a0 0x7ff0040052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.810+0000 7ff01bfff700 1 -- 172.21.15.71:0/1834678118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff01c06c0a0 msgr2=0x7ff0040052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.810+0000 7ff01bfff700 1 --2- 172.21.15.71:0/1834678118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff01c06c0a0 0x7ff0040052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.810+0000 7ff01bfff700 1 -- 172.21.15.71:0/1834678118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff004004810 msgr2=0x7ff004004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.810+0000 7ff01bfff700 1 --2- 172.21.15.71:0/1834678118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff004004810 0x7ff004004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.810+0000 7ff01bfff700 1 -- 172.21.15.71:0/1834678118 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff004003570 con 0x7ff004003c20 2023-10-09T06:43:35.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.810+0000 7ff02099c700 1 --2- 172.21.15.71:0/1834678118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff01c06c0a0 0x7ff0040052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:35.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.810+0000 7ff01bfff700 1 --2- 172.21.15.71:0/1834678118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff004003c20 0x7ff004004010 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00c1e0 tx=0x7ff01c0ce4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b44d781dc2f9844 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:35.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.810+0000 7ff01affd700 1 -- 172.21.15.71:0/1834678118 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c00cb10 con 0x7ff004003c20 2023-10-09T06:43:35.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.810+0000 7ff01affd700 1 -- 172.21.15.71:0/1834678118 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00c00cc90 con 0x7ff004003c20 2023-10-09T06:43:35.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.810+0000 7ff01affd700 1 -- 172.21.15.71:0/1834678118 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c005b70 con 0x7ff004003c20 2023-10-09T06:43:35.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.811+0000 7ff0223ff700 1 -- 172.21.15.71:0/1834678118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff004003c20 msgr2=0x7ff004004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:35.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.811+0000 7ff0223ff700 1 --2- 172.21.15.71:0/1834678118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff004003c20 0x7ff004004010 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00c1e0 tx=0x7ff01c0ce4d0 comp rx=0 tx=0).stop 2023-10-09T06:43:35.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.811+0000 7ff02099c700 1 -- 172.21.15.71:0/1834678118 reap_dead start 2023-10-09T06:43:35.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.811+0000 7ff0223ff700 1 -- 172.21.15.71:0/1834678118 shutdown_connections 2023-10-09T06:43:35.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.811+0000 7ff0223ff700 1 -- 172.21.15.71:0/1834678118 >> 172.21.15.71:0/1834678118 conn(0x7ff01c0ce600 msgr2=0x7ff01c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:35.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.811+0000 7ff0223ff700 1 -- 172.21.15.71:0/1834678118 shutdown_connections 2023-10-09T06:43:35.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.811+0000 7ff0223ff700 1 -- 172.21.15.71:0/1834678118 wait complete. 2023-10-09T06:43:35.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.812+0000 7ff0223ff700 1 Processor -- start 2023-10-09T06:43:35.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.813+0000 7ff0223ff700 1 -- start start 2023-10-09T06:43:35.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.813+0000 7ff0223ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff004003c20 0x7ff01c16b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:35.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.813+0000 7ff0223ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff01c1439b0 0x7ff01c06a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:35.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.813+0000 7ff0223ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff01c06ab40 0x7ff01c158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:35.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.813+0000 7ff0223ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c06af70 con 0x7ff01c1439b0 2023-10-09T06:43:35.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.813+0000 7ff0223ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c159aa0 con 0x7ff004003c20 2023-10-09T06:43:35.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.813+0000 7ff0223ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c159d80 con 0x7ff01c06ab40 2023-10-09T06:43:35.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.814+0000 7ff01b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff01c1439b0 0x7ff01c06a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:35.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.814+0000 7ff01b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff01c1439b0 0x7ff01c06a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37340/0 (socket says 172.21.15.71:37340) 2023-10-09T06:43:35.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.814+0000 7ff01b7fe700 1 -- 172.21.15.71:0/2547624141 learned_addr learned my addr 172.21.15.71:0/2547624141 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:35.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.814+0000 7ff02099c700 1 --2- 172.21.15.71:0/2547624141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff01c06ab40 0x7ff01c158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:35.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.814+0000 7ff01bfff700 1 --2- 172.21.15.71:0/2547624141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff004003c20 0x7ff01c16b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:35.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.814+0000 7ff01b7fe700 1 -- 172.21.15.71:0/2547624141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff01c06ab40 msgr2=0x7ff01c158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:35.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.814+0000 7ff01b7fe700 1 --2- 172.21.15.71:0/2547624141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff01c06ab40 0x7ff01c158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:35.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.814+0000 7ff01b7fe700 1 -- 172.21.15.71:0/2547624141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff004003c20 msgr2=0x7ff01c16b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:35.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.814+0000 7ff01b7fe700 1 --2- 172.21.15.71:0/2547624141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff004003c20 0x7ff01c16b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:35.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.814+0000 7ff01b7fe700 1 -- 172.21.15.71:0/2547624141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c0c7360 con 0x7ff01c1439b0 2023-10-09T06:43:35.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.814+0000 7ff01b7fe700 1 --2- 172.21.15.71:0/2547624141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff01c1439b0 0x7ff01c06a600 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff010011d40 tx=0x7ff0100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:35.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.814+0000 7ff003fff700 1 -- 172.21.15.71:0/2547624141 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01000fac0 con 0x7ff01c1439b0 2023-10-09T06:43:35.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.815+0000 7ff003fff700 1 -- 172.21.15.71:0/2547624141 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01000fc20 con 0x7ff01c1439b0 2023-10-09T06:43:35.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.815+0000 7ff0223ff700 1 -- 172.21.15.71:0/2547624141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01c0c7640 con 0x7ff01c1439b0 2023-10-09T06:43:35.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.815+0000 7ff003fff700 1 -- 172.21.15.71:0/2547624141 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff010014440 con 0x7ff01c1439b0 2023-10-09T06:43:35.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.815+0000 7ff0223ff700 1 -- 172.21.15.71:0/2547624141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01c143e20 con 0x7ff01c1439b0 2023-10-09T06:43:35.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.816+0000 7ff0223ff700 1 -- 172.21.15.71:0/2547624141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01c0c79b0 con 0x7ff01c1439b0 2023-10-09T06:43:35.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.817+0000 7ff003fff700 1 -- 172.21.15.71:0/2547624141 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff010014a80 con 0x7ff01c1439b0 2023-10-09T06:43:35.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.817+0000 7ff003fff700 1 --2- 172.21.15.71:0/2547624141 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff008066f30 0x7ff0080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:35.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.817+0000 7ff003fff700 1 -- 172.21.15.71:0/2547624141 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff010018030 con 0x7ff01c1439b0 2023-10-09T06:43:35.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.818+0000 7ff01bfff700 1 --2- 172.21.15.71:0/2547624141 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff008066f30 0x7ff0080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:35.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.818+0000 7ff01bfff700 1 --2- 172.21.15.71:0/2547624141 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff008066f30 0x7ff0080693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00c1e0 tx=0x7ff00c015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:35.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:35.821+0000 7ff003fff700 1 -- 172.21.15.71:0/2547624141 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff010052500 con 0x7ff01c1439b0 2023-10-09T06:43:36.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.054+0000 7ff0223ff700 1 -- 172.21.15.71:0/2547624141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff01c159f40 con 0x7ff01c1439b0 2023-10-09T06:43:36.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.054+0000 7ff003fff700 1 -- 172.21.15.71:0/2547624141 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4603 (secure 0 0 0) 0x7ff010055b20 con 0x7ff01c1439b0 2023-10-09T06:43:36.055 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:36.055 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2315236875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":2315236875},{"type":"v1","addr":"172.21.15.71:6835","nonce":2315236875}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4628,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2455384244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2455384244},{"type":"v1","addr":"172.21.15.179:6836","nonce":2455384244}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3668669622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3668669622},{"type":"v1","addr":"172.21.15.179:6837","nonce":3668669622}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:43:32.039618+0000","modified":"2023-10-09T06:43:35.597837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4905":{"gid":4905,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6834/4010179291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":4010179291},{"type":"v1","addr":"172.21.15.71:6834","nonce":4010179291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T06:43:36.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.056+0000 7ff0223ff700 1 -- 172.21.15.71:0/2547624141 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff008066f30 msgr2=0x7ff0080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:36.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.056+0000 7ff0223ff700 1 --2- 172.21.15.71:0/2547624141 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff008066f30 0x7ff0080693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00c1e0 tx=0x7ff00c015000 comp rx=0 tx=0).stop 2023-10-09T06:43:36.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.056+0000 7ff0223ff700 1 -- 172.21.15.71:0/2547624141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff01c1439b0 msgr2=0x7ff01c06a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:36.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.056+0000 7ff0223ff700 1 --2- 172.21.15.71:0/2547624141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff01c1439b0 0x7ff01c06a600 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff010011d40 tx=0x7ff0100091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.057+0000 7ff0223ff700 1 -- 172.21.15.71:0/2547624141 shutdown_connections 2023-10-09T06:43:36.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.057+0000 7ff0223ff700 1 --2- 172.21.15.71:0/2547624141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff01c06ab40 0x7ff01c158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.057+0000 7ff0223ff700 1 --2- 172.21.15.71:0/2547624141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff004003c20 0x7ff01c16b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.057+0000 7ff0223ff700 1 --2- 172.21.15.71:0/2547624141 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff008066f30 0x7ff0080693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.057+0000 7ff0223ff700 1 --2- 172.21.15.71:0/2547624141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff01c1439b0 0x7ff01c06a600 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.057+0000 7ff0223ff700 1 -- 172.21.15.71:0/2547624141 >> 172.21.15.71:0/2547624141 conn(0x7ff01c0ce600 msgr2=0x7ff01c0ca840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:36.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.057+0000 7ff0223ff700 1 -- 172.21.15.71:0/2547624141 shutdown_connections 2023-10-09T06:43:36.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.057+0000 7ff0223ff700 1 -- 172.21.15.71:0/2547624141 wait complete. 2023-10-09T06:43:36.059 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 15 2023-10-09T06:43:36.075 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:43:36.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.255+0000 7f7040bff700 1 Processor -- start 2023-10-09T06:43:36.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.255+0000 7f7040bff700 1 -- start start 2023-10-09T06:43:36.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.256+0000 7f7040bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f703c155c10 0x7f703c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:36.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.256+0000 7f7040bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f703c0ac230 0x7f703c0ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:36.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.256+0000 7f7040bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703c0ad930 con 0x7f703c1568a0 2023-10-09T06:43:36.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.256+0000 7f7040bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f703c0acd20 con 0x7f703c0ac230 2023-10-09T06:43:36.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.257+0000 7f7040bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703c0ad000 con 0x7f703c155c10 2023-10-09T06:43:36.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.257+0000 7f7039d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f703c0ac230 0x7f703c0ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:36.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.257+0000 7f7039d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f703c0ac230 0x7f703c0ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37356/0 (socket says 172.21.15.71:37356) 2023-10-09T06:43:36.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.257+0000 7f7039d9b700 1 -- 172.21.15.71:0/2712850898 learned_addr learned my addr 172.21.15.71:0/2712850898 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:36.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.257+0000 7f703a59c700 1 --2- 172.21.15.71:0/2712850898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f703c155c10 0x7f703c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:36.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.257+0000 7f7039d9b700 1 -- 172.21.15.71:0/2712850898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f703c155c10 msgr2=0x7f703c155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:36.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.257+0000 7f7039d9b700 1 --2- 172.21.15.71:0/2712850898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f703c155c10 0x7f703c155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.257+0000 7f7039d9b700 1 -- 172.21.15.71:0/2712850898 >> v1:172.21.15.179:6789/0 conn(0x7f703c1568a0 legacy=0x7f703c156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:36.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.257+0000 7f7039d9b700 1 -- 172.21.15.71:0/2712850898 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c0ad2e0 con 0x7f703c0ac230 2023-10-09T06:43:36.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.258+0000 7f7039d9b700 1 --2- 172.21.15.71:0/2712850898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f703c0ac230 0x7f703c0ac6a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f70300099b0 tx=0x7f7030009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa3fae77ccc5094 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:36.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.258+0000 7f703959a700 1 -- 172.21.15.71:0/2712850898 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7030009ea0 con 0x7f703c0ac230 2023-10-09T06:43:36.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.258+0000 7f703959a700 1 -- 172.21.15.71:0/2712850898 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703000b860 con 0x7f703c0ac230 2023-10-09T06:43:36.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.258+0000 7f703959a700 1 -- 172.21.15.71:0/2712850898 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703000bc00 con 0x7f703c0ac230 2023-10-09T06:43:36.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.258+0000 7f7040bff700 1 -- 172.21.15.71:0/2712850898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f703c0ac230 msgr2=0x7f703c0ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:36.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.258+0000 7f7040bff700 1 --2- 172.21.15.71:0/2712850898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f703c0ac230 0x7f703c0ac6a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f70300099b0 tx=0x7f7030009250 comp rx=0 tx=0).stop 2023-10-09T06:43:36.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.258+0000 7f7040bff700 1 -- 172.21.15.71:0/2712850898 shutdown_connections 2023-10-09T06:43:36.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.258+0000 7f7040bff700 1 --2- 172.21.15.71:0/2712850898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f703c155c10 0x7f703c155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.258+0000 7f7040bff700 1 --2- 172.21.15.71:0/2712850898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f703c0ac230 0x7f703c0ac6a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.258+0000 7f7040bff700 1 -- 172.21.15.71:0/2712850898 >> 172.21.15.71:0/2712850898 conn(0x7f703c06a320 msgr2=0x7f703c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:36.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.259+0000 7f7040bff700 1 -- 172.21.15.71:0/2712850898 shutdown_connections 2023-10-09T06:43:36.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.259+0000 7f7040bff700 1 -- 172.21.15.71:0/2712850898 wait complete. 2023-10-09T06:43:36.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.260+0000 7f7040bff700 1 Processor -- start 2023-10-09T06:43:36.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.260+0000 7f7040bff700 1 -- start start 2023-10-09T06:43:36.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.261+0000 7f7040bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f703c0ac230 0x7f703c168590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:36.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.261+0000 7f7040bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f703c155c10 0x7f703c0a8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:36.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.261+0000 7f7040bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f703c1568a0 0x7f703c1522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:36.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.261+0000 7f7040bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c0a9260 con 0x7f703c0ac230 2023-10-09T06:43:36.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.261+0000 7f7040bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c158e10 con 0x7f703c155c10 2023-10-09T06:43:36.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.261+0000 7f7040bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703c0a8790 con 0x7f703c1568a0 2023-10-09T06:43:36.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.261+0000 7f703a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f703c0ac230 0x7f703c168590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:36.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.261+0000 7f703a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f703c0ac230 0x7f703c168590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37372/0 (socket says 172.21.15.71:37372) 2023-10-09T06:43:36.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.261+0000 7f703a59c700 1 -- 172.21.15.71:0/3304368910 learned_addr learned my addr 172.21.15.71:0/3304368910 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:36.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.261+0000 7f7039d9b700 1 --2- 172.21.15.71:0/3304368910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f703c155c10 0x7f703c0a8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:36.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.261+0000 7f703ad9d700 1 --2- 172.21.15.71:0/3304368910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f703c1568a0 0x7f703c1522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:36.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.261+0000 7f703a59c700 1 -- 172.21.15.71:0/3304368910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f703c1568a0 msgr2=0x7f703c1522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:36.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.261+0000 7f703a59c700 1 --2- 172.21.15.71:0/3304368910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f703c1568a0 0x7f703c1522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.261+0000 7f703a59c700 1 -- 172.21.15.71:0/3304368910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f703c155c10 msgr2=0x7f703c0a8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:36.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.261+0000 7f703a59c700 1 --2- 172.21.15.71:0/3304368910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f703c155c10 0x7f703c0a8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.261+0000 7f703a59c700 1 -- 172.21.15.71:0/3304368910 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70300094f0 con 0x7f703c0ac230 2023-10-09T06:43:36.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.261+0000 7f703ad9d700 1 --2- 172.21.15.71:0/3304368910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f703c1568a0 0x7f703c1522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:36.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.262+0000 7f703a59c700 1 --2- 172.21.15.71:0/3304368910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f703c0ac230 0x7f703c168590 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f702c00ec80 tx=0x7f702c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:36.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.262+0000 7f702a7fc700 1 -- 172.21.15.71:0/3304368910 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c00c9d0 con 0x7f703c0ac230 2023-10-09T06:43:36.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.262+0000 7f702a7fc700 1 -- 172.21.15.71:0/3304368910 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c00cb50 con 0x7f703c0ac230 2023-10-09T06:43:36.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.262+0000 7f7040bff700 1 -- 172.21.15.71:0/3304368910 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703c1590b0 con 0x7f703c0ac230 2023-10-09T06:43:36.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.262+0000 7f702a7fc700 1 -- 172.21.15.71:0/3304368910 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c013470 con 0x7f703c0ac230 2023-10-09T06:43:36.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.262+0000 7f7040bff700 1 -- 172.21.15.71:0/3304368910 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703c0a8ca0 con 0x7f703c0ac230 2023-10-09T06:43:36.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.263+0000 7f7040bff700 1 -- 172.21.15.71:0/3304368910 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703c04c3c0 con 0x7f703c0ac230 2023-10-09T06:43:36.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.264+0000 7f702a7fc700 1 -- 172.21.15.71:0/3304368910 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f702c013860 con 0x7f703c0ac230 2023-10-09T06:43:36.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.265+0000 7f702a7fc700 1 --2- 172.21.15.71:0/3304368910 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f701c066f30 0x7f701c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:36.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.265+0000 7f702a7fc700 1 -- 172.21.15.71:0/3304368910 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f702c084d60 con 0x7f703c0ac230 2023-10-09T06:43:36.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.266+0000 7f7039d9b700 1 --2- 172.21.15.71:0/3304368910 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f701c066f30 0x7f701c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:36.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.266+0000 7f7039d9b700 1 --2- 172.21.15.71:0/3304368910 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f701c066f30 0x7f701c0693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f70300099b0 tx=0x7f7030017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:36.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.269+0000 7f702a7fc700 1 -- 172.21.15.71:0/3304368910 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f702c051f30 con 0x7f703c0ac230 2023-10-09T06:43:36.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.459+0000 7f7040bff700 1 -- 172.21.15.71:0/3304368910 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f703c0ad5c0 con 0x7f703c0ac230 2023-10-09T06:43:36.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.460+0000 7f702a7fc700 1 -- 172.21.15.71:0/3304368910 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f702c055550 con 0x7f703c0ac230 2023-10-09T06:43:36.461 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:36.462 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":32,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:43:33.582434+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:43:29.634330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T06:43:31.023113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:43:36.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.462+0000 7f7040bff700 1 -- 172.21.15.71:0/3304368910 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f701c066f30 msgr2=0x7f701c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:36.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.462+0000 7f7040bff700 1 --2- 172.21.15.71:0/3304368910 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f701c066f30 0x7f701c0693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f70300099b0 tx=0x7f7030017000 comp rx=0 tx=0).stop 2023-10-09T06:43:36.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.462+0000 7f7040bff700 1 -- 172.21.15.71:0/3304368910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f703c0ac230 msgr2=0x7f703c168590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:36.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.462+0000 7f7040bff700 1 --2- 172.21.15.71:0/3304368910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f703c0ac230 0x7f703c168590 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f702c00ec80 tx=0x7f702c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.462+0000 7f7040bff700 1 -- 172.21.15.71:0/3304368910 shutdown_connections 2023-10-09T06:43:36.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.462+0000 7f7040bff700 1 --2- 172.21.15.71:0/3304368910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f703c1568a0 0x7f703c1522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.462+0000 7f7040bff700 1 --2- 172.21.15.71:0/3304368910 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f701c066f30 0x7f701c0693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.462+0000 7f7040bff700 1 --2- 172.21.15.71:0/3304368910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f703c0ac230 0x7f703c168590 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.462+0000 7f7040bff700 1 --2- 172.21.15.71:0/3304368910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f703c155c10 0x7f703c0a8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.462+0000 7f7040bff700 1 -- 172.21.15.71:0/3304368910 >> 172.21.15.71:0/3304368910 conn(0x7f703c06a320 msgr2=0x7f703c153800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:36.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.462+0000 7f7040bff700 1 -- 172.21.15.71:0/3304368910 shutdown_connections 2023-10-09T06:43:36.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.463+0000 7f7040bff700 1 -- 172.21.15.71:0/3304368910 wait complete. 2023-10-09T06:43:36.482 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T06:43:36.482 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:43:36.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.665+0000 7f21141ff700 1 Processor -- start 2023-10-09T06:43:36.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.665+0000 7f21141ff700 1 -- start start 2023-10-09T06:43:36.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.666+0000 7f21141ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f210c0b1420 0x7f210c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:36.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.666+0000 7f21141ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f210c0ccf90 0x7f210c0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:36.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.666+0000 7f21141ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f210c0cc300 con 0x7f210c0cbf30 2023-10-09T06:43:36.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.666+0000 7f21141ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f210c156bf0 con 0x7f210c0ccf90 2023-10-09T06:43:36.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.666+0000 7f21141ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f210c0ae950 con 0x7f210c0b1420 2023-10-09T06:43:36.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.667+0000 7f211279c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f210c0ccf90 0x7f210c0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:36.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.667+0000 7f211279c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f210c0ccf90 0x7f210c0c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37378/0 (socket says 172.21.15.71:37378) 2023-10-09T06:43:36.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.667+0000 7f211279c700 1 -- 172.21.15.71:0/828336381 learned_addr learned my addr 172.21.15.71:0/828336381 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:36.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.667+0000 7f211179a700 1 --2- 172.21.15.71:0/828336381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f210c0b1420 0x7f210c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:36.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.667+0000 7f211279c700 1 -- 172.21.15.71:0/828336381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f210c0b1420 msgr2=0x7f210c0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:36.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.667+0000 7f211279c700 1 --2- 172.21.15.71:0/828336381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f210c0b1420 0x7f210c0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.667+0000 7f211279c700 1 -- 172.21.15.71:0/828336381 >> v1:172.21.15.71:6789/0 conn(0x7f210c0cbf30 legacy=0x7f210c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:36.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.667+0000 7f211279c700 1 -- 172.21.15.71:0/828336381 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210c0ad370 con 0x7f210c0ccf90 2023-10-09T06:43:36.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.667+0000 7f211279c700 1 --2- 172.21.15.71:0/828336381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f210c0ccf90 0x7f210c0c9740 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f210400d1d0 tx=0x7f210400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0755b59cfaedc55 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:36.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.668+0000 7f2110f99700 1 -- 172.21.15.71:0/828336381 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2104010070 con 0x7f210c0ccf90 2023-10-09T06:43:36.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.668+0000 7f2110f99700 1 -- 172.21.15.71:0/828336381 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210400b0d0 con 0x7f210c0ccf90 2023-10-09T06:43:36.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.668+0000 7f2110f99700 1 -- 172.21.15.71:0/828336381 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210400b490 con 0x7f210c0ccf90 2023-10-09T06:43:36.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.668+0000 7f21141ff700 1 -- 172.21.15.71:0/828336381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f210c0ccf90 msgr2=0x7f210c0c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:36.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.668+0000 7f21141ff700 1 --2- 172.21.15.71:0/828336381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f210c0ccf90 0x7f210c0c9740 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f210400d1d0 tx=0x7f210400ba50 comp rx=0 tx=0).stop 2023-10-09T06:43:36.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.668+0000 7f21141ff700 1 -- 172.21.15.71:0/828336381 shutdown_connections 2023-10-09T06:43:36.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.668+0000 7f21141ff700 1 --2- 172.21.15.71:0/828336381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f210c0ccf90 0x7f210c0c9740 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.668+0000 7f21141ff700 1 --2- 172.21.15.71:0/828336381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f210c0b1420 0x7f210c0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.668+0000 7f21141ff700 1 -- 172.21.15.71:0/828336381 >> 172.21.15.71:0/828336381 conn(0x7f210c06a320 msgr2=0x7f210c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:36.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.668+0000 7f21141ff700 1 -- 172.21.15.71:0/828336381 shutdown_connections 2023-10-09T06:43:36.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.668+0000 7f21141ff700 1 -- 172.21.15.71:0/828336381 wait complete. 2023-10-09T06:43:36.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.670+0000 7f21141ff700 1 Processor -- start 2023-10-09T06:43:36.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.670+0000 7f21141ff700 1 -- start start 2023-10-09T06:43:36.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.671+0000 7f21141ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f210c0b1420 0x7f210c06eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:36.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.671+0000 7f21141ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f210c0cbf30 0x7f210c16dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:36.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.671+0000 7f21141ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f210c0ccf90 0x7f210c149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:36.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.671+0000 7f21141ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210c1687d0 con 0x7f210c0ccf90 2023-10-09T06:43:36.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.671+0000 7f21141ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210c167c30 con 0x7f210c0cbf30 2023-10-09T06:43:36.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.671+0000 7f21141ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f210c16b040 con 0x7f210c0b1420 2023-10-09T06:43:36.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.671+0000 7f211279c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f210c0ccf90 0x7f210c149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:36.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.671+0000 7f211279c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f210c0ccf90 0x7f210c149ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37380/0 (socket says 172.21.15.71:37380) 2023-10-09T06:43:36.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.671+0000 7f211279c700 1 -- 172.21.15.71:0/1035123047 learned_addr learned my addr 172.21.15.71:0/1035123047 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:36.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.671+0000 7f2111f9b700 1 --2- 172.21.15.71:0/1035123047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f210c0b1420 0x7f210c06eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:36.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.671+0000 7f211179a700 1 --2- 172.21.15.71:0/1035123047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f210c0cbf30 0x7f210c16dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:36.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.671+0000 7f211279c700 1 -- 172.21.15.71:0/1035123047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f210c0b1420 msgr2=0x7f210c06eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:36.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.671+0000 7f211279c700 1 --2- 172.21.15.71:0/1035123047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f210c0b1420 0x7f210c06eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.672+0000 7f211279c700 1 -- 172.21.15.71:0/1035123047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f210c0cbf30 msgr2=0x7f210c16dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:36.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.672+0000 7f211279c700 1 --2- 172.21.15.71:0/1035123047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f210c0cbf30 0x7f210c16dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.672+0000 7f211279c700 1 -- 172.21.15.71:0/1035123047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210400bcf0 con 0x7f210c0ccf90 2023-10-09T06:43:36.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.672+0000 7f211279c700 1 --2- 172.21.15.71:0/1035123047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f210c0ccf90 0x7f210c149ee0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f210c064290 tx=0x7f210401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:36.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.672+0000 7f2101ffb700 1 -- 172.21.15.71:0/1035123047 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210400ad20 con 0x7f210c0ccf90 2023-10-09T06:43:36.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.672+0000 7f2101ffb700 1 -- 172.21.15.71:0/1035123047 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210400ae80 con 0x7f210c0ccf90 2023-10-09T06:43:36.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.672+0000 7f21141ff700 1 -- 172.21.15.71:0/1035123047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f210c167ea0 con 0x7f210c0ccf90 2023-10-09T06:43:36.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.672+0000 7f2101ffb700 1 -- 172.21.15.71:0/1035123047 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210401d680 con 0x7f210c0ccf90 2023-10-09T06:43:36.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.672+0000 7f21141ff700 1 -- 172.21.15.71:0/1035123047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f210c168460 con 0x7f210c0ccf90 2023-10-09T06:43:36.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.673+0000 7f21141ff700 1 -- 172.21.15.71:0/1035123047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f210c04c3c0 con 0x7f210c0ccf90 2023-10-09T06:43:36.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.674+0000 7f2101ffb700 1 -- 172.21.15.71:0/1035123047 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2104003040 con 0x7f210c0ccf90 2023-10-09T06:43:36.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.675+0000 7f2101ffb700 1 --2- 172.21.15.71:0/1035123047 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f20f0066f30 0x7f20f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:36.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.675+0000 7f2101ffb700 1 -- 172.21.15.71:0/1035123047 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2104086110 con 0x7f210c0ccf90 2023-10-09T06:43:36.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.676+0000 7f2111f9b700 1 --2- 172.21.15.71:0/1035123047 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f20f0066f30 0x7f20f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:36.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.676+0000 7f2111f9b700 1 --2- 172.21.15.71:0/1035123047 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f20f0066f30 0x7f20f00693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2108003860 tx=0x7f2108009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:36.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.679+0000 7f2101ffb700 1 -- 172.21.15.71:0/1035123047 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2104053380 con 0x7f210c0ccf90 2023-10-09T06:43:36.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.865+0000 7f21141ff700 1 -- 172.21.15.71:0/1035123047 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f210c0ad650 con 0x7f20f0066f30 2023-10-09T06:43:36.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.876+0000 7f2101ffb700 1 -- 172.21.15.71:0/1035123047 <== mgr.4102 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285858 (secure 0 0 0) 0x7f210c0ad650 con 0x7f20f0066f30 2023-10-09T06:43:36.881 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:36.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.880+0000 7f21141ff700 1 -- 172.21.15.71:0/1035123047 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f20f0066f30 msgr2=0x7f20f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:36.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.880+0000 7f21141ff700 1 --2- 172.21.15.71:0/1035123047 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f20f0066f30 0x7f20f00693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2108003860 tx=0x7f2108009040 comp rx=0 tx=0).stop 2023-10-09T06:43:36.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.880+0000 7f21141ff700 1 -- 172.21.15.71:0/1035123047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f210c0ccf90 msgr2=0x7f210c149ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:36.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.880+0000 7f21141ff700 1 --2- 172.21.15.71:0/1035123047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f210c0ccf90 0x7f210c149ee0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f210c064290 tx=0x7f210401a000 comp rx=0 tx=0).stop 2023-10-09T06:43:36.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.880+0000 7f21141ff700 1 -- 172.21.15.71:0/1035123047 shutdown_connections 2023-10-09T06:43:36.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.880+0000 7f21141ff700 1 --2- 172.21.15.71:0/1035123047 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f20f0066f30 0x7f20f00693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.880+0000 7f21141ff700 1 --2- 172.21.15.71:0/1035123047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f210c0ccf90 0x7f210c149ee0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.880+0000 7f21141ff700 1 --2- 172.21.15.71:0/1035123047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f210c0b1420 0x7f210c06eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.880+0000 7f21141ff700 1 --2- 172.21.15.71:0/1035123047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f210c0cbf30 0x7f210c16dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:36.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.880+0000 7f21141ff700 1 -- 172.21.15.71:0/1035123047 >> 172.21.15.71:0/1035123047 conn(0x7f210c06a320 msgr2=0x7f210c0cb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:36.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.880+0000 7f21141ff700 1 -- 172.21.15.71:0/1035123047 shutdown_connections 2023-10-09T06:43:36.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:36.880+0000 7f21141ff700 1 -- 172.21.15.71:0/1035123047 wait complete. 2023-10-09T06:43:36.885 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:43:36.898 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2023-10-09T06:43:36.559134+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382004,"kb_used_data":3700,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592716,"statfs":{"total":773094113280,"available":770654941184,"internally_reserved":0,"allocated":3788800,"data_stored":2147335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.998717"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.574839+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:53.860293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.586116+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:00:35.415369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569760+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:43:56.155101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573386+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:48.954261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.571448+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:43:23.488401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.581886+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:26:14.972288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.574438+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:27.903807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.579425+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:16.764212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.570982+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:37.420872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.571826+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:15:24.986946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.577387+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:11.622961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569197+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:00.654956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.570478+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:29.373317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.578539+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:37:21.561094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568960+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:48.954261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.577716+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:28.200993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573604+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:55.485080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.577528+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:23.043125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573293+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:00.654956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.572351+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:46.342897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.579223+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:49.546526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568525+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:18.302001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.570762+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:37.420872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.566809+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:49.546526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.572775+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:41.827957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.572776+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:48.954261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573628+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:00.654956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568620+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:15:24.986946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.570846+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:53.860293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.574237+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:18.302001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573065+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:59.295306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.575099+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:53.860293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569345+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:53.860293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.588823+0000","last_change":"2023-10-09T06:43:31.588823+0000","last_active":"2023-10-09T06:43:31.588823+0000","last_peered":"2023-10-09T06:43:31.588823+0000","last_clean":"2023-10-09T06:43:31.588823+0000","last_became_active":"2023-10-09T06:43:31.588554+0000","last_became_peered":"2023-10-09T06:43:31.588554+0000","last_unstale":"2023-10-09T06:43:31.588823+0000","last_undegraded":"2023-10-09T06:43:31.588823+0000","last_fullsized":"2023-10-09T06:43:31.588823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:56.343954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.574278+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:27.903807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.580770+0000","last_change":"2023-10-09T06:43:31.580770+0000","last_active":"2023-10-09T06:43:31.580770+0000","last_peered":"2023-10-09T06:43:31.580770+0000","last_clean":"2023-10-09T06:43:31.580770+0000","last_became_active":"2023-10-09T06:43:31.580483+0000","last_became_peered":"2023-10-09T06:43:31.580483+0000","last_unstale":"2023-10-09T06:43:31.580770+0000","last_undegraded":"2023-10-09T06:43:31.580770+0000","last_fullsized":"2023-10-09T06:43:31.580770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:56.343954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569483+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:59.295306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.591561+0000","last_change":"2023-10-09T06:43:31.591561+0000","last_active":"2023-10-09T06:43:31.591561+0000","last_peered":"2023-10-09T06:43:31.591561+0000","last_clean":"2023-10-09T06:43:31.591561+0000","last_became_active":"2023-10-09T06:43:31.591261+0000","last_became_peered":"2023-10-09T06:43:31.591261+0000","last_unstale":"2023-10-09T06:43:31.591561+0000","last_undegraded":"2023-10-09T06:43:31.591561+0000","last_fullsized":"2023-10-09T06:43:31.591561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:27.198306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573177+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:16.764212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.581224+0000","last_change":"2023-10-09T06:43:31.581224+0000","last_active":"2023-10-09T06:43:31.581224+0000","last_peered":"2023-10-09T06:43:31.581224+0000","last_clean":"2023-10-09T06:43:31.581224+0000","last_became_active":"2023-10-09T06:43:31.580851+0000","last_became_peered":"2023-10-09T06:43:31.580851+0000","last_unstale":"2023-10-09T06:43:31.581224+0000","last_undegraded":"2023-10-09T06:43:31.581224+0000","last_fullsized":"2023-10-09T06:43:31.581224+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:07.887852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573693+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:19:56.940720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.585382+0000","last_change":"2023-10-09T06:43:31.585382+0000","last_active":"2023-10-09T06:43:31.585382+0000","last_peered":"2023-10-09T06:43:31.585382+0000","last_clean":"2023-10-09T06:43:31.585382+0000","last_became_active":"2023-10-09T06:43:31.585083+0000","last_became_peered":"2023-10-09T06:43:31.585083+0000","last_unstale":"2023-10-09T06:43:31.585382+0000","last_undegraded":"2023-10-09T06:43:31.585382+0000","last_fullsized":"2023-10-09T06:43:31.585382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:56.343954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.570015+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:58.469035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.585289+0000","last_change":"2023-10-09T06:43:31.585289+0000","last_active":"2023-10-09T06:43:31.585289+0000","last_peered":"2023-10-09T06:43:31.585289+0000","last_clean":"2023-10-09T06:43:31.585289+0000","last_became_active":"2023-10-09T06:43:31.584990+0000","last_became_peered":"2023-10-09T06:43:31.584990+0000","last_unstale":"2023-10-09T06:43:31.585289+0000","last_undegraded":"2023-10-09T06:43:31.585289+0000","last_fullsized":"2023-10-09T06:43:31.585289+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:19:58.338127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.566811+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:55.485080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.587212+0000","last_change":"2023-10-09T06:43:31.587212+0000","last_active":"2023-10-09T06:43:31.587212+0000","last_peered":"2023-10-09T06:43:31.587212+0000","last_clean":"2023-10-09T06:43:31.587212+0000","last_became_active":"2023-10-09T06:43:31.586951+0000","last_became_peered":"2023-10-09T06:43:31.586951+0000","last_unstale":"2023-10-09T06:43:31.587212+0000","last_undegraded":"2023-10-09T06:43:31.587212+0000","last_fullsized":"2023-10-09T06:43:31.587212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:15:23.984259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.572294+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:11.622961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.582874+0000","last_change":"2023-10-09T06:43:31.582874+0000","last_active":"2023-10-09T06:43:31.582874+0000","last_peered":"2023-10-09T06:43:31.582874+0000","last_clean":"2023-10-09T06:43:31.582874+0000","last_became_active":"2023-10-09T06:43:31.582615+0000","last_became_peered":"2023-10-09T06:43:31.582615+0000","last_unstale":"2023-10-09T06:43:31.582874+0000","last_undegraded":"2023-10-09T06:43:31.582874+0000","last_fullsized":"2023-10-09T06:43:31.582874+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:15:09.963486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568407+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:16.764212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.584657+0000","last_change":"2023-10-09T06:43:31.584657+0000","last_active":"2023-10-09T06:43:31.584657+0000","last_peered":"2023-10-09T06:43:31.584657+0000","last_clean":"2023-10-09T06:43:31.584657+0000","last_became_active":"2023-10-09T06:43:31.584392+0000","last_became_peered":"2023-10-09T06:43:31.584392+0000","last_unstale":"2023-10-09T06:43:31.584657+0000","last_undegraded":"2023-10-09T06:43:31.584657+0000","last_fullsized":"2023-10-09T06:43:31.584657+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:17.299314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.575980+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:43:56.155101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.582543+0000","last_change":"2023-10-09T06:43:31.582543+0000","last_active":"2023-10-09T06:43:31.582543+0000","last_peered":"2023-10-09T06:43:31.582543+0000","last_clean":"2023-10-09T06:43:31.582543+0000","last_became_active":"2023-10-09T06:43:31.582274+0000","last_became_peered":"2023-10-09T06:43:31.582274+0000","last_unstale":"2023-10-09T06:43:31.582543+0000","last_undegraded":"2023-10-09T06:43:31.582543+0000","last_fullsized":"2023-10-09T06:43:31.582543+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:54.482393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.571650+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:16.764212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.581601+0000","last_change":"2023-10-09T06:43:31.581601+0000","last_active":"2023-10-09T06:43:31.581601+0000","last_peered":"2023-10-09T06:43:31.581601+0000","last_clean":"2023-10-09T06:43:31.581601+0000","last_became_active":"2023-10-09T06:43:31.581330+0000","last_became_peered":"2023-10-09T06:43:31.581330+0000","last_unstale":"2023-10-09T06:43:31.581601+0000","last_undegraded":"2023-10-09T06:43:31.581601+0000","last_fullsized":"2023-10-09T06:43:31.581601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:26.901120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568125+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:41.827957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.591755+0000","last_change":"2023-10-09T06:43:31.591755+0000","last_active":"2023-10-09T06:43:31.591755+0000","last_peered":"2023-10-09T06:43:31.591755+0000","last_clean":"2023-10-09T06:43:31.591755+0000","last_became_active":"2023-10-09T06:43:31.591271+0000","last_became_peered":"2023-10-09T06:43:31.591271+0000","last_unstale":"2023-10-09T06:43:31.591755+0000","last_undegraded":"2023-10-09T06:43:31.591755+0000","last_fullsized":"2023-10-09T06:43:31.591755+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:26.901120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.571745+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:49.546526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.581530+0000","last_change":"2023-10-09T06:43:31.581530+0000","last_active":"2023-10-09T06:43:31.581530+0000","last_peered":"2023-10-09T06:43:31.581530+0000","last_clean":"2023-10-09T06:43:31.581530+0000","last_became_active":"2023-10-09T06:43:31.580810+0000","last_became_peered":"2023-10-09T06:43:31.580810+0000","last_unstale":"2023-10-09T06:43:31.581530+0000","last_undegraded":"2023-10-09T06:43:31.581530+0000","last_fullsized":"2023-10-09T06:43:31.581530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:44:08.275015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569062+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:41.827957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.583715+0000","last_change":"2023-10-09T06:43:31.583715+0000","last_active":"2023-10-09T06:43:31.583715+0000","last_peered":"2023-10-09T06:43:31.583715+0000","last_clean":"2023-10-09T06:43:31.583715+0000","last_became_active":"2023-10-09T06:43:31.583119+0000","last_became_peered":"2023-10-09T06:43:31.583119+0000","last_unstale":"2023-10-09T06:43:31.583715+0000","last_undegraded":"2023-10-09T06:43:31.583715+0000","last_fullsized":"2023-10-09T06:43:31.583715+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:58.292619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.575587+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:37.420872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.585275+0000","last_change":"2023-10-09T06:43:31.585275+0000","last_active":"2023-10-09T06:43:31.585275+0000","last_peered":"2023-10-09T06:43:31.585275+0000","last_clean":"2023-10-09T06:43:31.585275+0000","last_became_active":"2023-10-09T06:43:31.584989+0000","last_became_peered":"2023-10-09T06:43:31.584989+0000","last_unstale":"2023-10-09T06:43:31.585275+0000","last_undegraded":"2023-10-09T06:43:31.585275+0000","last_fullsized":"2023-10-09T06:43:31.585275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:36.418185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573626+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:18.302001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.591837+0000","last_change":"2023-10-09T06:43:31.591837+0000","last_active":"2023-10-09T06:43:31.591837+0000","last_peered":"2023-10-09T06:43:31.591837+0000","last_clean":"2023-10-09T06:43:31.591837+0000","last_became_active":"2023-10-09T06:43:31.591583+0000","last_became_peered":"2023-10-09T06:43:31.591583+0000","last_unstale":"2023-10-09T06:43:31.591837+0000","last_undegraded":"2023-10-09T06:43:31.591837+0000","last_fullsized":"2023-10-09T06:43:31.591837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:48.543839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568791+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:27.903807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.591708+0000","last_change":"2023-10-09T06:43:31.591708+0000","last_active":"2023-10-09T06:43:31.591708+0000","last_peered":"2023-10-09T06:43:31.591708+0000","last_clean":"2023-10-09T06:43:31.591708+0000","last_became_active":"2023-10-09T06:43:31.591444+0000","last_became_peered":"2023-10-09T06:43:31.591444+0000","last_unstale":"2023-10-09T06:43:31.591708+0000","last_undegraded":"2023-10-09T06:43:31.591708+0000","last_fullsized":"2023-10-09T06:43:31.591708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:52.857606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.567757+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:11.622961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.582200+0000","last_change":"2023-10-09T06:43:31.582200+0000","last_active":"2023-10-09T06:43:31.582200+0000","last_peered":"2023-10-09T06:43:31.582200+0000","last_clean":"2023-10-09T06:43:31.582200+0000","last_became_active":"2023-10-09T06:43:31.581947+0000","last_became_peered":"2023-10-09T06:43:31.581947+0000","last_unstale":"2023-10-09T06:43:31.582200+0000","last_undegraded":"2023-10-09T06:43:31.582200+0000","last_fullsized":"2023-10-09T06:43:31.582200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:31.583076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569282+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:28.200993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.581221+0000","last_change":"2023-10-09T06:43:31.581221+0000","last_active":"2023-10-09T06:43:31.581221+0000","last_peered":"2023-10-09T06:43:31.581221+0000","last_clean":"2023-10-09T06:43:31.581221+0000","last_became_active":"2023-10-09T06:43:31.580923+0000","last_became_peered":"2023-10-09T06:43:31.580923+0000","last_unstale":"2023-10-09T06:43:31.581221+0000","last_undegraded":"2023-10-09T06:43:31.581221+0000","last_fullsized":"2023-10-09T06:43:31.581221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:43.384282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.572973+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:44.386969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.585326+0000","last_change":"2023-10-09T06:43:31.585326+0000","last_active":"2023-10-09T06:43:31.585326+0000","last_peered":"2023-10-09T06:43:31.585326+0000","last_clean":"2023-10-09T06:43:31.585326+0000","last_became_active":"2023-10-09T06:43:31.585015+0000","last_became_peered":"2023-10-09T06:43:31.585015+0000","last_unstale":"2023-10-09T06:43:31.585326+0000","last_undegraded":"2023-10-09T06:43:31.585326+0000","last_fullsized":"2023-10-09T06:43:31.585326+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:12:59.791856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569881+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:05.648062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.579815+0000","last_change":"2023-10-09T06:43:31.579815+0000","last_active":"2023-10-09T06:43:31.579815+0000","last_peered":"2023-10-09T06:43:31.579815+0000","last_clean":"2023-10-09T06:43:31.579815+0000","last_became_active":"2023-10-09T06:43:31.579569+0000","last_became_peered":"2023-10-09T06:43:31.579569+0000","last_unstale":"2023-10-09T06:43:31.579815+0000","last_undegraded":"2023-10-09T06:43:31.579815+0000","last_fullsized":"2023-10-09T06:43:31.579815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:31.688662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.571007+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:36:56.965210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.582436+0000","last_change":"2023-10-09T06:43:31.582436+0000","last_active":"2023-10-09T06:43:31.582436+0000","last_peered":"2023-10-09T06:43:31.582436+0000","last_clean":"2023-10-09T06:43:31.582436+0000","last_became_active":"2023-10-09T06:43:31.582133+0000","last_became_peered":"2023-10-09T06:43:31.582133+0000","last_unstale":"2023-10-09T06:43:31.582436+0000","last_undegraded":"2023-10-09T06:43:31.582436+0000","last_fullsized":"2023-10-09T06:43:31.582436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:48:44.295975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568823+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:30:10.950127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.572408+0000","last_change":"2023-10-09T06:43:31.572408+0000","last_active":"2023-10-09T06:43:31.572408+0000","last_peered":"2023-10-09T06:43:31.572408+0000","last_clean":"2023-10-09T06:43:31.572408+0000","last_became_active":"2023-10-09T06:43:31.572144+0000","last_became_peered":"2023-10-09T06:43:31.572144+0000","last_unstale":"2023-10-09T06:43:31.572408+0000","last_undegraded":"2023-10-09T06:43:31.572408+0000","last_fullsized":"2023-10-09T06:43:31.572408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:49:32.843137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573875+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:59.295306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.582351+0000","last_change":"2023-10-09T06:43:31.582351+0000","last_active":"2023-10-09T06:43:31.582351+0000","last_peered":"2023-10-09T06:43:31.582351+0000","last_clean":"2023-10-09T06:43:31.582351+0000","last_became_active":"2023-10-09T06:43:31.582079+0000","last_became_peered":"2023-10-09T06:43:31.582079+0000","last_unstale":"2023-10-09T06:43:31.582351+0000","last_undegraded":"2023-10-09T06:43:31.582351+0000","last_fullsized":"2023-10-09T06:43:31.582351+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:52.857606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573496+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:49:33.845823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.585000+0000","last_change":"2023-10-09T06:43:31.585000+0000","last_active":"2023-10-09T06:43:31.585000+0000","last_peered":"2023-10-09T06:43:31.585000+0000","last_clean":"2023-10-09T06:43:31.585000+0000","last_became_active":"2023-10-09T06:43:31.584704+0000","last_became_peered":"2023-10-09T06:43:31.584704+0000","last_unstale":"2023-10-09T06:43:31.585000+0000","last_undegraded":"2023-10-09T06:43:31.585000+0000","last_fullsized":"2023-10-09T06:43:31.585000+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:17.299314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569914+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:23.043125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.574479+0000","last_change":"2023-10-09T06:43:31.574479+0000","last_active":"2023-10-09T06:43:31.574479+0000","last_peered":"2023-10-09T06:43:31.574479+0000","last_clean":"2023-10-09T06:43:31.574479+0000","last_became_active":"2023-10-09T06:43:31.571653+0000","last_became_peered":"2023-10-09T06:43:31.571653+0000","last_unstale":"2023-10-09T06:43:31.574479+0000","last_undegraded":"2023-10-09T06:43:31.574479+0000","last_fullsized":"2023-10-09T06:43:31.574479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:48:44.295975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568788+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:27.903807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.578306+0000","last_change":"2023-10-09T06:43:31.578306+0000","last_active":"2023-10-09T06:43:31.578306+0000","last_peered":"2023-10-09T06:43:31.578306+0000","last_clean":"2023-10-09T06:43:31.578306+0000","last_became_active":"2023-10-09T06:43:31.578049+0000","last_became_peered":"2023-10-09T06:43:31.578049+0000","last_unstale":"2023-10-09T06:43:31.578306+0000","last_undegraded":"2023-10-09T06:43:31.578306+0000","last_fullsized":"2023-10-09T06:43:31.578306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:19:55.938033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.575366+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:37.420872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.582574+0000","last_change":"2023-10-09T06:43:31.582574+0000","last_active":"2023-10-09T06:43:31.582574+0000","last_peered":"2023-10-09T06:43:31.582574+0000","last_clean":"2023-10-09T06:43:31.582574+0000","last_became_active":"2023-10-09T06:43:31.582321+0000","last_became_peered":"2023-10-09T06:43:31.582321+0000","last_unstale":"2023-10-09T06:43:31.582574+0000","last_undegraded":"2023-10-09T06:43:31.582574+0000","last_fullsized":"2023-10-09T06:43:31.582574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:19:55.938033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568162+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:18.302001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.584968+0000","last_change":"2023-10-09T06:43:31.584968+0000","last_active":"2023-10-09T06:43:31.584968+0000","last_peered":"2023-10-09T06:43:31.584968+0000","last_clean":"2023-10-09T06:43:31.584968+0000","last_became_active":"2023-10-09T06:43:31.584655+0000","last_became_peered":"2023-10-09T06:43:31.584655+0000","last_unstale":"2023-10-09T06:43:31.584968+0000","last_undegraded":"2023-10-09T06:43:31.584968+0000","last_fullsized":"2023-10-09T06:43:31.584968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:26.901120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.577942+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:58.469035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.582691+0000","last_change":"2023-10-09T06:43:31.582691+0000","last_active":"2023-10-09T06:43:31.582691+0000","last_peered":"2023-10-09T06:43:31.582691+0000","last_clean":"2023-10-09T06:43:31.582691+0000","last_became_active":"2023-10-09T06:43:31.582414+0000","last_became_peered":"2023-10-09T06:43:31.582414+0000","last_unstale":"2023-10-09T06:43:31.582691+0000","last_undegraded":"2023-10-09T06:43:31.582691+0000","last_fullsized":"2023-10-09T06:43:31.582691+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:45.340210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.566972+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:19:56.940720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.585912+0000","last_change":"2023-10-09T06:43:31.585912+0000","last_active":"2023-10-09T06:43:31.585912+0000","last_peered":"2023-10-09T06:43:31.585912+0000","last_clean":"2023-10-09T06:43:31.585912+0000","last_became_active":"2023-10-09T06:43:31.585592+0000","last_became_peered":"2023-10-09T06:43:31.585592+0000","last_unstale":"2023-10-09T06:43:31.585912+0000","last_undegraded":"2023-10-09T06:43:31.585912+0000","last_fullsized":"2023-10-09T06:43:31.585912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:52.857606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573200+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:32.691349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.588384+0000","last_change":"2023-10-09T06:43:31.588384+0000","last_active":"2023-10-09T06:43:31.588384+0000","last_peered":"2023-10-09T06:43:31.588384+0000","last_clean":"2023-10-09T06:43:31.588384+0000","last_became_active":"2023-10-09T06:43:31.588110+0000","last_became_peered":"2023-10-09T06:43:31.588110+0000","last_unstale":"2023-10-09T06:43:31.588384+0000","last_undegraded":"2023-10-09T06:43:31.588384+0000","last_fullsized":"2023-10-09T06:43:31.588384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:31.688662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":171,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T06:43:30.567324+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:43:30.567324+0000","last_peered":"2023-10-09T06:43:30.567324+0000","last_clean":"2023-10-09T06:43:30.567324+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:43:30.567324+0000","last_undegraded":"2023-10-09T06:43:30.567324+0000","last_fullsized":"2023-10-09T06:43:30.567324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":710411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.448,"5min":3.448,"15min":3.448},"last":0.55500000000000005}]},{"osd":1,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":5.617,"5min":5.617,"15min":5.617},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":0.58799999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.004}]},{"osd":3,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":5.5800000000000001,"5min":5.5800000000000001,"15min":5.5800000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":6.9299999999999997,"5min":6.9299999999999997,"15min":6.9299999999999997},"last":0.97499999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":3.125,"5min":3.125,"15min":3.125},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":4.8380000000000001,"5min":4.8380000000000001,"15min":4.8380000000000001},"last":1.028}]},{"osd":5,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":4.1929999999999996,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":3.6749999999999998,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":1.0800000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":4.0250000000000004,"5min":4.0250000000000004,"15min":4.0250000000000004},"last":1.137},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":7.0259999999999998,"5min":7.0259999999999998,"15min":7.0259999999999998},"last":1.0740000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":120043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.56999999999999995}]},{"osd":1,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54500000000000004}]},{"osd":2,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.67000000000000004}]},{"osd":3,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.78400000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.878},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.81000000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.89700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":120043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.38600000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.54000000000000004}]},{"osd":3,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.48399999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.83399999999999996}]},{"osd":5,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.89500000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.90300000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.84699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":710411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.53100000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.47499999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.437}]},{"osd":4,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.65400000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.73299999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.58699999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.69399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":120043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.35199999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":0.48999999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.46800000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.73899999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.61799999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.60199999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.57099999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":120043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.45000000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.46400000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.54700000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.78200000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.80300000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.73699999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":120043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.59099999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.63},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.79800000000000004}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.86299999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.748}]},{"osd":5,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.65900000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.76800000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.90100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297616,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074224,"statfs":{"total":96636764160,"available":96332005376,"internally_reserved":0,"allocated":335872,"data_stored":126298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.79100000000000004}]},{"osd":1,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.73799999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.80300000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":0.75600000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.46999999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.5739999999999998,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.51800000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.9609999999999999,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":0.502}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:43:36.906 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:43:37.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.116+0000 7fdd93fff700 1 Processor -- start 2023-10-09T06:43:37.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.116+0000 7fdd93fff700 1 -- start start 2023-10-09T06:43:37.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.118+0000 7fdd93fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdd8c06c0a0 0x7fdd8c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:37.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.118+0000 7fdd93fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdd8c15df50 0x7fdd8c15e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:37.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.118+0000 7fdd93fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8c15d7e0 con 0x7fdd8c06bcd0 2023-10-09T06:43:37.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.118+0000 7fdd93fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8c15dac0 con 0x7fdd8c06c0a0 2023-10-09T06:43:37.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.118+0000 7fdd93fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8c15aa30 con 0x7fdd8c15df50 2023-10-09T06:43:37.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.118+0000 7fdd9159a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdd8c06c0a0 0x7fdd8c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:37.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.118+0000 7fdd9159a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdd8c06c0a0 0x7fdd8c0caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37388/0 (socket says 172.21.15.71:37388) 2023-10-09T06:43:37.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.118+0000 7fdd9159a700 1 -- 172.21.15.71:0/3615897030 learned_addr learned my addr 172.21.15.71:0/3615897030 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:37.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.118+0000 7fdd9259c700 1 --2- 172.21.15.71:0/3615897030 >> v2:172.21.15.179:3300/0 conn(0x7fdd8c15df50 0x7fdd8c15e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:37.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.119+0000 7fdd9159a700 1 -- 172.21.15.71:0/3615897030 >> v2:172.21.15.179:3300/0 conn(0x7fdd8c15df50 msgr2=0x7fdd8c15e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:37.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.119+0000 7fdd9159a700 1 --2- 172.21.15.71:0/3615897030 >> v2:172.21.15.179:3300/0 conn(0x7fdd8c15df50 0x7fdd8c15e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:37.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.119+0000 7fdd9159a700 1 -- 172.21.15.71:0/3615897030 >> v1:172.21.15.179:6789/0 conn(0x7fdd8c06bcd0 legacy=0x7fdd8c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:37.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.119+0000 7fdd9159a700 1 -- 172.21.15.71:0/3615897030 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c15ad10 con 0x7fdd8c06c0a0 2023-10-09T06:43:37.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.119+0000 7fdd9159a700 1 --2- 172.21.15.71:0/3615897030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd8c06c0a0 0x7fdd8c0caa90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c15d720 tx=0x7fdd7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48fb55a9b5b783e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:37.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.119+0000 7fdd90d99700 1 -- 172.21.15.71:0/3615897030 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c009e70 con 0x7fdd8c06c0a0 2023-10-09T06:43:37.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.119+0000 7fdd90d99700 1 -- 172.21.15.71:0/3615897030 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7c00b860 con 0x7fdd8c06c0a0 2023-10-09T06:43:37.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.119+0000 7fdd90d99700 1 -- 172.21.15.71:0/3615897030 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c00bc20 con 0x7fdd8c06c0a0 2023-10-09T06:43:37.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.120+0000 7fdd93fff700 1 -- 172.21.15.71:0/3615897030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd8c06c0a0 msgr2=0x7fdd8c0caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:37.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.120+0000 7fdd93fff700 1 --2- 172.21.15.71:0/3615897030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd8c06c0a0 0x7fdd8c0caa90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c15d720 tx=0x7fdd7c009250 comp rx=0 tx=0).stop 2023-10-09T06:43:37.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.120+0000 7fdd93fff700 1 -- 172.21.15.71:0/3615897030 shutdown_connections 2023-10-09T06:43:37.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.120+0000 7fdd93fff700 1 --2- 172.21.15.71:0/3615897030 >> v2:172.21.15.179:3300/0 conn(0x7fdd8c15df50 0x7fdd8c15e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:37.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.120+0000 7fdd93fff700 1 --2- 172.21.15.71:0/3615897030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd8c06c0a0 0x7fdd8c0caa90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:37.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.120+0000 7fdd93fff700 1 -- 172.21.15.71:0/3615897030 >> 172.21.15.71:0/3615897030 conn(0x7fdd8c0ce600 msgr2=0x7fdd8c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:37.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.120+0000 7fdd93fff700 1 -- 172.21.15.71:0/3615897030 shutdown_connections 2023-10-09T06:43:37.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.120+0000 7fdd93fff700 1 -- 172.21.15.71:0/3615897030 wait complete. 2023-10-09T06:43:37.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.121+0000 7fdd93fff700 1 Processor -- start 2023-10-09T06:43:37.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.121+0000 7fdd93fff700 1 -- start start 2023-10-09T06:43:37.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.122+0000 7fdd93fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd8c06bcd0 0x7fdd8c0b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:37.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.122+0000 7fdd93fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd8c06c0a0 0x7fdd8c169d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:37.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.122+0000 7fdd93fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd8c15df50 0x7fdd8c0c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:37.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.122+0000 7fdd93fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c0b0580 con 0x7fdd8c15df50 2023-10-09T06:43:37.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.122+0000 7fdd93fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c0b24d0 con 0x7fdd8c06bcd0 2023-10-09T06:43:37.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.122+0000 7fdd93fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c0b3330 con 0x7fdd8c06c0a0 2023-10-09T06:43:37.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.122+0000 7fdd9259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd8c15df50 0x7fdd8c0c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:37.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.122+0000 7fdd9259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd8c15df50 0x7fdd8c0c4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37404/0 (socket says 172.21.15.71:37404) 2023-10-09T06:43:37.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.122+0000 7fdd9259c700 1 -- 172.21.15.71:0/2909394620 learned_addr learned my addr 172.21.15.71:0/2909394620 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:37.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.123+0000 7fdd91d9b700 1 --2- 172.21.15.71:0/2909394620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd8c06bcd0 0x7fdd8c0b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:37.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.123+0000 7fdd9159a700 1 --2- 172.21.15.71:0/2909394620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd8c06c0a0 0x7fdd8c169d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:37.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.123+0000 7fdd9259c700 1 -- 172.21.15.71:0/2909394620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd8c06c0a0 msgr2=0x7fdd8c169d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:37.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.123+0000 7fdd9259c700 1 --2- 172.21.15.71:0/2909394620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd8c06c0a0 0x7fdd8c169d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:37.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.123+0000 7fdd9259c700 1 -- 172.21.15.71:0/2909394620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd8c06bcd0 msgr2=0x7fdd8c0b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:37.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.123+0000 7fdd9259c700 1 --2- 172.21.15.71:0/2909394620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd8c06bcd0 0x7fdd8c0b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:37.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.123+0000 7fdd9259c700 1 -- 172.21.15.71:0/2909394620 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7c0094f0 con 0x7fdd8c15df50 2023-10-09T06:43:37.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.123+0000 7fdd91d9b700 1 --2- 172.21.15.71:0/2909394620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd8c06bcd0 0x7fdd8c0b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:37.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.123+0000 7fdd9259c700 1 --2- 172.21.15.71:0/2909394620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd8c15df50 0x7fdd8c0c4720 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009e20 tx=0x7fdd8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:37.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.123+0000 7fdd81ffb700 1 -- 172.21.15.71:0/2909394620 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8400cc20 con 0x7fdd8c15df50 2023-10-09T06:43:37.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.123+0000 7fdd81ffb700 1 -- 172.21.15.71:0/2909394620 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8400f040 con 0x7fdd8c15df50 2023-10-09T06:43:37.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.123+0000 7fdd93fff700 1 -- 172.21.15.71:0/2909394620 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c0b2720 con 0x7fdd8c15df50 2023-10-09T06:43:37.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.123+0000 7fdd81ffb700 1 -- 172.21.15.71:0/2909394620 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84014480 con 0x7fdd8c15df50 2023-10-09T06:43:37.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.123+0000 7fdd93fff700 1 -- 172.21.15.71:0/2909394620 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8c0b2ce0 con 0x7fdd8c15df50 2023-10-09T06:43:37.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.124+0000 7fdd93fff700 1 -- 172.21.15.71:0/2909394620 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8c0b34c0 con 0x7fdd8c15df50 2023-10-09T06:43:37.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.125+0000 7fdd81ffb700 1 -- 172.21.15.71:0/2909394620 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd84014830 con 0x7fdd8c15df50 2023-10-09T06:43:37.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.127+0000 7fdd81ffb700 1 --2- 172.21.15.71:0/2909394620 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdd70066f30 0x7fdd700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:37.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.127+0000 7fdd81ffb700 1 -- 172.21.15.71:0/2909394620 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdd84084fd0 con 0x7fdd8c15df50 2023-10-09T06:43:37.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.127+0000 7fdd91d9b700 1 --2- 172.21.15.71:0/2909394620 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdd70066f30 0x7fdd700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:37.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.128+0000 7fdd91d9b700 1 --2- 172.21.15.71:0/2909394620 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdd70066f30 0x7fdd700693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdd88007fd0 tx=0x7fdd88009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:37.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.131+0000 7fdd81ffb700 1 -- 172.21.15.71:0/2909394620 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd840521a0 con 0x7fdd8c15df50 2023-10-09T06:43:37.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.317+0000 7fdd93fff700 1 -- 172.21.15.71:0/2909394620 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdd8c15aff0 con 0x7fdd70066f30 2023-10-09T06:43:37.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.327+0000 7fdd81ffb700 1 -- 172.21.15.71:0/2909394620 <== mgr.4102 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285858 (secure 0 0 0) 0x7fdd8c15aff0 con 0x7fdd70066f30 2023-10-09T06:43:37.331 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:37.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.330+0000 7fdd93fff700 1 -- 172.21.15.71:0/2909394620 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdd70066f30 msgr2=0x7fdd700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:37.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.330+0000 7fdd93fff700 1 --2- 172.21.15.71:0/2909394620 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdd70066f30 0x7fdd700693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdd88007fd0 tx=0x7fdd88009040 comp rx=0 tx=0).stop 2023-10-09T06:43:37.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.330+0000 7fdd93fff700 1 -- 172.21.15.71:0/2909394620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd8c15df50 msgr2=0x7fdd8c0c4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:37.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.330+0000 7fdd93fff700 1 --2- 172.21.15.71:0/2909394620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd8c15df50 0x7fdd8c0c4720 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009e20 tx=0x7fdd8400b040 comp rx=0 tx=0).stop 2023-10-09T06:43:37.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.330+0000 7fdd93fff700 1 -- 172.21.15.71:0/2909394620 shutdown_connections 2023-10-09T06:43:37.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.330+0000 7fdd93fff700 1 --2- 172.21.15.71:0/2909394620 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdd70066f30 0x7fdd700693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:37.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.330+0000 7fdd93fff700 1 --2- 172.21.15.71:0/2909394620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd8c15df50 0x7fdd8c0c4720 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:37.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.330+0000 7fdd93fff700 1 --2- 172.21.15.71:0/2909394620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd8c06bcd0 0x7fdd8c0b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:37.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.330+0000 7fdd93fff700 1 --2- 172.21.15.71:0/2909394620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd8c06c0a0 0x7fdd8c169d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:37.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.330+0000 7fdd93fff700 1 -- 172.21.15.71:0/2909394620 >> 172.21.15.71:0/2909394620 conn(0x7fdd8c0ce600 msgr2=0x7fdd8c0c33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:37.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.331+0000 7fdd93fff700 1 -- 172.21.15.71:0/2909394620 shutdown_connections 2023-10-09T06:43:37.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.331+0000 7fdd93fff700 1 -- 172.21.15.71:0/2909394620 wait complete. 2023-10-09T06:43:37.336 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:43:37.349 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2023-10-09T06:43:36.559134+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382004,"kb_used_data":3700,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592716,"statfs":{"total":773094113280,"available":770654941184,"internally_reserved":0,"allocated":3788800,"data_stored":2147335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.998717"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.574839+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:53.860293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.586116+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:00:35.415369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569760+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:43:56.155101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573386+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:48.954261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.571448+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:43:23.488401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.581886+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:26:14.972288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.574438+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:27.903807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.579425+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:16.764212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.570982+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:37.420872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.571826+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:15:24.986946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.577387+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:11.622961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569197+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:00.654956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.570478+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:29.373317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.578539+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:37:21.561094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568960+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:48.954261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.577716+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:28.200993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573604+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:55.485080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.577528+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:23.043125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573293+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:00.654956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.572351+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:46.342897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.579223+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:49.546526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568525+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:18.302001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.570762+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:37.420872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.566809+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:49.546526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.572775+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:41.827957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.572776+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:48.954261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573628+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:00.654956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568620+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:15:24.986946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.570846+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:53.860293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.574237+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:18.302001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573065+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:59.295306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.575099+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:53.860293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569345+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:53.860293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.588823+0000","last_change":"2023-10-09T06:43:31.588823+0000","last_active":"2023-10-09T06:43:31.588823+0000","last_peered":"2023-10-09T06:43:31.588823+0000","last_clean":"2023-10-09T06:43:31.588823+0000","last_became_active":"2023-10-09T06:43:31.588554+0000","last_became_peered":"2023-10-09T06:43:31.588554+0000","last_unstale":"2023-10-09T06:43:31.588823+0000","last_undegraded":"2023-10-09T06:43:31.588823+0000","last_fullsized":"2023-10-09T06:43:31.588823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:56.343954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.574278+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:27.903807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.580770+0000","last_change":"2023-10-09T06:43:31.580770+0000","last_active":"2023-10-09T06:43:31.580770+0000","last_peered":"2023-10-09T06:43:31.580770+0000","last_clean":"2023-10-09T06:43:31.580770+0000","last_became_active":"2023-10-09T06:43:31.580483+0000","last_became_peered":"2023-10-09T06:43:31.580483+0000","last_unstale":"2023-10-09T06:43:31.580770+0000","last_undegraded":"2023-10-09T06:43:31.580770+0000","last_fullsized":"2023-10-09T06:43:31.580770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:56.343954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569483+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:59.295306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.591561+0000","last_change":"2023-10-09T06:43:31.591561+0000","last_active":"2023-10-09T06:43:31.591561+0000","last_peered":"2023-10-09T06:43:31.591561+0000","last_clean":"2023-10-09T06:43:31.591561+0000","last_became_active":"2023-10-09T06:43:31.591261+0000","last_became_peered":"2023-10-09T06:43:31.591261+0000","last_unstale":"2023-10-09T06:43:31.591561+0000","last_undegraded":"2023-10-09T06:43:31.591561+0000","last_fullsized":"2023-10-09T06:43:31.591561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:27.198306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573177+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:16.764212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.581224+0000","last_change":"2023-10-09T06:43:31.581224+0000","last_active":"2023-10-09T06:43:31.581224+0000","last_peered":"2023-10-09T06:43:31.581224+0000","last_clean":"2023-10-09T06:43:31.581224+0000","last_became_active":"2023-10-09T06:43:31.580851+0000","last_became_peered":"2023-10-09T06:43:31.580851+0000","last_unstale":"2023-10-09T06:43:31.581224+0000","last_undegraded":"2023-10-09T06:43:31.581224+0000","last_fullsized":"2023-10-09T06:43:31.581224+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:07.887852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573693+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:19:56.940720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.585382+0000","last_change":"2023-10-09T06:43:31.585382+0000","last_active":"2023-10-09T06:43:31.585382+0000","last_peered":"2023-10-09T06:43:31.585382+0000","last_clean":"2023-10-09T06:43:31.585382+0000","last_became_active":"2023-10-09T06:43:31.585083+0000","last_became_peered":"2023-10-09T06:43:31.585083+0000","last_unstale":"2023-10-09T06:43:31.585382+0000","last_undegraded":"2023-10-09T06:43:31.585382+0000","last_fullsized":"2023-10-09T06:43:31.585382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:56.343954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.570015+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:58.469035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.585289+0000","last_change":"2023-10-09T06:43:31.585289+0000","last_active":"2023-10-09T06:43:31.585289+0000","last_peered":"2023-10-09T06:43:31.585289+0000","last_clean":"2023-10-09T06:43:31.585289+0000","last_became_active":"2023-10-09T06:43:31.584990+0000","last_became_peered":"2023-10-09T06:43:31.584990+0000","last_unstale":"2023-10-09T06:43:31.585289+0000","last_undegraded":"2023-10-09T06:43:31.585289+0000","last_fullsized":"2023-10-09T06:43:31.585289+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:19:58.338127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.566811+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:55.485080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.587212+0000","last_change":"2023-10-09T06:43:31.587212+0000","last_active":"2023-10-09T06:43:31.587212+0000","last_peered":"2023-10-09T06:43:31.587212+0000","last_clean":"2023-10-09T06:43:31.587212+0000","last_became_active":"2023-10-09T06:43:31.586951+0000","last_became_peered":"2023-10-09T06:43:31.586951+0000","last_unstale":"2023-10-09T06:43:31.587212+0000","last_undegraded":"2023-10-09T06:43:31.587212+0000","last_fullsized":"2023-10-09T06:43:31.587212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:15:23.984259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.572294+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:11.622961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.582874+0000","last_change":"2023-10-09T06:43:31.582874+0000","last_active":"2023-10-09T06:43:31.582874+0000","last_peered":"2023-10-09T06:43:31.582874+0000","last_clean":"2023-10-09T06:43:31.582874+0000","last_became_active":"2023-10-09T06:43:31.582615+0000","last_became_peered":"2023-10-09T06:43:31.582615+0000","last_unstale":"2023-10-09T06:43:31.582874+0000","last_undegraded":"2023-10-09T06:43:31.582874+0000","last_fullsized":"2023-10-09T06:43:31.582874+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:15:09.963486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568407+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:16.764212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.584657+0000","last_change":"2023-10-09T06:43:31.584657+0000","last_active":"2023-10-09T06:43:31.584657+0000","last_peered":"2023-10-09T06:43:31.584657+0000","last_clean":"2023-10-09T06:43:31.584657+0000","last_became_active":"2023-10-09T06:43:31.584392+0000","last_became_peered":"2023-10-09T06:43:31.584392+0000","last_unstale":"2023-10-09T06:43:31.584657+0000","last_undegraded":"2023-10-09T06:43:31.584657+0000","last_fullsized":"2023-10-09T06:43:31.584657+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:17.299314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.575980+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:43:56.155101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.582543+0000","last_change":"2023-10-09T06:43:31.582543+0000","last_active":"2023-10-09T06:43:31.582543+0000","last_peered":"2023-10-09T06:43:31.582543+0000","last_clean":"2023-10-09T06:43:31.582543+0000","last_became_active":"2023-10-09T06:43:31.582274+0000","last_became_peered":"2023-10-09T06:43:31.582274+0000","last_unstale":"2023-10-09T06:43:31.582543+0000","last_undegraded":"2023-10-09T06:43:31.582543+0000","last_fullsized":"2023-10-09T06:43:31.582543+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:54.482393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.571650+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:16.764212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.581601+0000","last_change":"2023-10-09T06:43:31.581601+0000","last_active":"2023-10-09T06:43:31.581601+0000","last_peered":"2023-10-09T06:43:31.581601+0000","last_clean":"2023-10-09T06:43:31.581601+0000","last_became_active":"2023-10-09T06:43:31.581330+0000","last_became_peered":"2023-10-09T06:43:31.581330+0000","last_unstale":"2023-10-09T06:43:31.581601+0000","last_undegraded":"2023-10-09T06:43:31.581601+0000","last_fullsized":"2023-10-09T06:43:31.581601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:26.901120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568125+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:41.827957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.591755+0000","last_change":"2023-10-09T06:43:31.591755+0000","last_active":"2023-10-09T06:43:31.591755+0000","last_peered":"2023-10-09T06:43:31.591755+0000","last_clean":"2023-10-09T06:43:31.591755+0000","last_became_active":"2023-10-09T06:43:31.591271+0000","last_became_peered":"2023-10-09T06:43:31.591271+0000","last_unstale":"2023-10-09T06:43:31.591755+0000","last_undegraded":"2023-10-09T06:43:31.591755+0000","last_fullsized":"2023-10-09T06:43:31.591755+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:26.901120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.571745+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:49.546526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.581530+0000","last_change":"2023-10-09T06:43:31.581530+0000","last_active":"2023-10-09T06:43:31.581530+0000","last_peered":"2023-10-09T06:43:31.581530+0000","last_clean":"2023-10-09T06:43:31.581530+0000","last_became_active":"2023-10-09T06:43:31.580810+0000","last_became_peered":"2023-10-09T06:43:31.580810+0000","last_unstale":"2023-10-09T06:43:31.581530+0000","last_undegraded":"2023-10-09T06:43:31.581530+0000","last_fullsized":"2023-10-09T06:43:31.581530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:44:08.275015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569062+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:41.827957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.583715+0000","last_change":"2023-10-09T06:43:31.583715+0000","last_active":"2023-10-09T06:43:31.583715+0000","last_peered":"2023-10-09T06:43:31.583715+0000","last_clean":"2023-10-09T06:43:31.583715+0000","last_became_active":"2023-10-09T06:43:31.583119+0000","last_became_peered":"2023-10-09T06:43:31.583119+0000","last_unstale":"2023-10-09T06:43:31.583715+0000","last_undegraded":"2023-10-09T06:43:31.583715+0000","last_fullsized":"2023-10-09T06:43:31.583715+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:58.292619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.575587+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:37.420872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.585275+0000","last_change":"2023-10-09T06:43:31.585275+0000","last_active":"2023-10-09T06:43:31.585275+0000","last_peered":"2023-10-09T06:43:31.585275+0000","last_clean":"2023-10-09T06:43:31.585275+0000","last_became_active":"2023-10-09T06:43:31.584989+0000","last_became_peered":"2023-10-09T06:43:31.584989+0000","last_unstale":"2023-10-09T06:43:31.585275+0000","last_undegraded":"2023-10-09T06:43:31.585275+0000","last_fullsized":"2023-10-09T06:43:31.585275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:36.418185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573626+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:18.302001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.591837+0000","last_change":"2023-10-09T06:43:31.591837+0000","last_active":"2023-10-09T06:43:31.591837+0000","last_peered":"2023-10-09T06:43:31.591837+0000","last_clean":"2023-10-09T06:43:31.591837+0000","last_became_active":"2023-10-09T06:43:31.591583+0000","last_became_peered":"2023-10-09T06:43:31.591583+0000","last_unstale":"2023-10-09T06:43:31.591837+0000","last_undegraded":"2023-10-09T06:43:31.591837+0000","last_fullsized":"2023-10-09T06:43:31.591837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:48.543839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568791+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:27.903807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.591708+0000","last_change":"2023-10-09T06:43:31.591708+0000","last_active":"2023-10-09T06:43:31.591708+0000","last_peered":"2023-10-09T06:43:31.591708+0000","last_clean":"2023-10-09T06:43:31.591708+0000","last_became_active":"2023-10-09T06:43:31.591444+0000","last_became_peered":"2023-10-09T06:43:31.591444+0000","last_unstale":"2023-10-09T06:43:31.591708+0000","last_undegraded":"2023-10-09T06:43:31.591708+0000","last_fullsized":"2023-10-09T06:43:31.591708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:52.857606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.567757+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:11.622961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.582200+0000","last_change":"2023-10-09T06:43:31.582200+0000","last_active":"2023-10-09T06:43:31.582200+0000","last_peered":"2023-10-09T06:43:31.582200+0000","last_clean":"2023-10-09T06:43:31.582200+0000","last_became_active":"2023-10-09T06:43:31.581947+0000","last_became_peered":"2023-10-09T06:43:31.581947+0000","last_unstale":"2023-10-09T06:43:31.582200+0000","last_undegraded":"2023-10-09T06:43:31.582200+0000","last_fullsized":"2023-10-09T06:43:31.582200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:31.583076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569282+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:28.200993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.581221+0000","last_change":"2023-10-09T06:43:31.581221+0000","last_active":"2023-10-09T06:43:31.581221+0000","last_peered":"2023-10-09T06:43:31.581221+0000","last_clean":"2023-10-09T06:43:31.581221+0000","last_became_active":"2023-10-09T06:43:31.580923+0000","last_became_peered":"2023-10-09T06:43:31.580923+0000","last_unstale":"2023-10-09T06:43:31.581221+0000","last_undegraded":"2023-10-09T06:43:31.581221+0000","last_fullsized":"2023-10-09T06:43:31.581221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:43.384282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.572973+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:44.386969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.585326+0000","last_change":"2023-10-09T06:43:31.585326+0000","last_active":"2023-10-09T06:43:31.585326+0000","last_peered":"2023-10-09T06:43:31.585326+0000","last_clean":"2023-10-09T06:43:31.585326+0000","last_became_active":"2023-10-09T06:43:31.585015+0000","last_became_peered":"2023-10-09T06:43:31.585015+0000","last_unstale":"2023-10-09T06:43:31.585326+0000","last_undegraded":"2023-10-09T06:43:31.585326+0000","last_fullsized":"2023-10-09T06:43:31.585326+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:12:59.791856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569881+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:05.648062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.579815+0000","last_change":"2023-10-09T06:43:31.579815+0000","last_active":"2023-10-09T06:43:31.579815+0000","last_peered":"2023-10-09T06:43:31.579815+0000","last_clean":"2023-10-09T06:43:31.579815+0000","last_became_active":"2023-10-09T06:43:31.579569+0000","last_became_peered":"2023-10-09T06:43:31.579569+0000","last_unstale":"2023-10-09T06:43:31.579815+0000","last_undegraded":"2023-10-09T06:43:31.579815+0000","last_fullsized":"2023-10-09T06:43:31.579815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:31.688662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.571007+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:36:56.965210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.582436+0000","last_change":"2023-10-09T06:43:31.582436+0000","last_active":"2023-10-09T06:43:31.582436+0000","last_peered":"2023-10-09T06:43:31.582436+0000","last_clean":"2023-10-09T06:43:31.582436+0000","last_became_active":"2023-10-09T06:43:31.582133+0000","last_became_peered":"2023-10-09T06:43:31.582133+0000","last_unstale":"2023-10-09T06:43:31.582436+0000","last_undegraded":"2023-10-09T06:43:31.582436+0000","last_fullsized":"2023-10-09T06:43:31.582436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:48:44.295975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568823+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:30:10.950127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.572408+0000","last_change":"2023-10-09T06:43:31.572408+0000","last_active":"2023-10-09T06:43:31.572408+0000","last_peered":"2023-10-09T06:43:31.572408+0000","last_clean":"2023-10-09T06:43:31.572408+0000","last_became_active":"2023-10-09T06:43:31.572144+0000","last_became_peered":"2023-10-09T06:43:31.572144+0000","last_unstale":"2023-10-09T06:43:31.572408+0000","last_undegraded":"2023-10-09T06:43:31.572408+0000","last_fullsized":"2023-10-09T06:43:31.572408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:49:32.843137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573875+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:59.295306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.582351+0000","last_change":"2023-10-09T06:43:31.582351+0000","last_active":"2023-10-09T06:43:31.582351+0000","last_peered":"2023-10-09T06:43:31.582351+0000","last_clean":"2023-10-09T06:43:31.582351+0000","last_became_active":"2023-10-09T06:43:31.582079+0000","last_became_peered":"2023-10-09T06:43:31.582079+0000","last_unstale":"2023-10-09T06:43:31.582351+0000","last_undegraded":"2023-10-09T06:43:31.582351+0000","last_fullsized":"2023-10-09T06:43:31.582351+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:52.857606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573496+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:49:33.845823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.585000+0000","last_change":"2023-10-09T06:43:31.585000+0000","last_active":"2023-10-09T06:43:31.585000+0000","last_peered":"2023-10-09T06:43:31.585000+0000","last_clean":"2023-10-09T06:43:31.585000+0000","last_became_active":"2023-10-09T06:43:31.584704+0000","last_became_peered":"2023-10-09T06:43:31.584704+0000","last_unstale":"2023-10-09T06:43:31.585000+0000","last_undegraded":"2023-10-09T06:43:31.585000+0000","last_fullsized":"2023-10-09T06:43:31.585000+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:17.299314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569914+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:23.043125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.574479+0000","last_change":"2023-10-09T06:43:31.574479+0000","last_active":"2023-10-09T06:43:31.574479+0000","last_peered":"2023-10-09T06:43:31.574479+0000","last_clean":"2023-10-09T06:43:31.574479+0000","last_became_active":"2023-10-09T06:43:31.571653+0000","last_became_peered":"2023-10-09T06:43:31.571653+0000","last_unstale":"2023-10-09T06:43:31.574479+0000","last_undegraded":"2023-10-09T06:43:31.574479+0000","last_fullsized":"2023-10-09T06:43:31.574479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:48:44.295975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568788+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:27.903807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.578306+0000","last_change":"2023-10-09T06:43:31.578306+0000","last_active":"2023-10-09T06:43:31.578306+0000","last_peered":"2023-10-09T06:43:31.578306+0000","last_clean":"2023-10-09T06:43:31.578306+0000","last_became_active":"2023-10-09T06:43:31.578049+0000","last_became_peered":"2023-10-09T06:43:31.578049+0000","last_unstale":"2023-10-09T06:43:31.578306+0000","last_undegraded":"2023-10-09T06:43:31.578306+0000","last_fullsized":"2023-10-09T06:43:31.578306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:19:55.938033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.575366+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:37.420872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.582574+0000","last_change":"2023-10-09T06:43:31.582574+0000","last_active":"2023-10-09T06:43:31.582574+0000","last_peered":"2023-10-09T06:43:31.582574+0000","last_clean":"2023-10-09T06:43:31.582574+0000","last_became_active":"2023-10-09T06:43:31.582321+0000","last_became_peered":"2023-10-09T06:43:31.582321+0000","last_unstale":"2023-10-09T06:43:31.582574+0000","last_undegraded":"2023-10-09T06:43:31.582574+0000","last_fullsized":"2023-10-09T06:43:31.582574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:19:55.938033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568162+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:18.302001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.584968+0000","last_change":"2023-10-09T06:43:31.584968+0000","last_active":"2023-10-09T06:43:31.584968+0000","last_peered":"2023-10-09T06:43:31.584968+0000","last_clean":"2023-10-09T06:43:31.584968+0000","last_became_active":"2023-10-09T06:43:31.584655+0000","last_became_peered":"2023-10-09T06:43:31.584655+0000","last_unstale":"2023-10-09T06:43:31.584968+0000","last_undegraded":"2023-10-09T06:43:31.584968+0000","last_fullsized":"2023-10-09T06:43:31.584968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:26.901120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.577942+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:58.469035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.582691+0000","last_change":"2023-10-09T06:43:31.582691+0000","last_active":"2023-10-09T06:43:31.582691+0000","last_peered":"2023-10-09T06:43:31.582691+0000","last_clean":"2023-10-09T06:43:31.582691+0000","last_became_active":"2023-10-09T06:43:31.582414+0000","last_became_peered":"2023-10-09T06:43:31.582414+0000","last_unstale":"2023-10-09T06:43:31.582691+0000","last_undegraded":"2023-10-09T06:43:31.582691+0000","last_fullsized":"2023-10-09T06:43:31.582691+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:45.340210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.566972+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:19:56.940720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.585912+0000","last_change":"2023-10-09T06:43:31.585912+0000","last_active":"2023-10-09T06:43:31.585912+0000","last_peered":"2023-10-09T06:43:31.585912+0000","last_clean":"2023-10-09T06:43:31.585912+0000","last_became_active":"2023-10-09T06:43:31.585592+0000","last_became_peered":"2023-10-09T06:43:31.585592+0000","last_unstale":"2023-10-09T06:43:31.585912+0000","last_undegraded":"2023-10-09T06:43:31.585912+0000","last_fullsized":"2023-10-09T06:43:31.585912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:52.857606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573200+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:32.691349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.588384+0000","last_change":"2023-10-09T06:43:31.588384+0000","last_active":"2023-10-09T06:43:31.588384+0000","last_peered":"2023-10-09T06:43:31.588384+0000","last_clean":"2023-10-09T06:43:31.588384+0000","last_became_active":"2023-10-09T06:43:31.588110+0000","last_became_peered":"2023-10-09T06:43:31.588110+0000","last_unstale":"2023-10-09T06:43:31.588384+0000","last_undegraded":"2023-10-09T06:43:31.588384+0000","last_fullsized":"2023-10-09T06:43:31.588384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:31.688662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":171,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T06:43:30.567324+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:43:30.567324+0000","last_peered":"2023-10-09T06:43:30.567324+0000","last_clean":"2023-10-09T06:43:30.567324+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:43:30.567324+0000","last_undegraded":"2023-10-09T06:43:30.567324+0000","last_fullsized":"2023-10-09T06:43:30.567324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":710411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.448,"5min":3.448,"15min":3.448},"last":0.55500000000000005}]},{"osd":1,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":5.617,"5min":5.617,"15min":5.617},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":0.58799999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.004}]},{"osd":3,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":5.5800000000000001,"5min":5.5800000000000001,"15min":5.5800000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":6.9299999999999997,"5min":6.9299999999999997,"15min":6.9299999999999997},"last":0.97499999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":3.125,"5min":3.125,"15min":3.125},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":4.8380000000000001,"5min":4.8380000000000001,"15min":4.8380000000000001},"last":1.028}]},{"osd":5,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":4.1929999999999996,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":3.6749999999999998,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":1.0800000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":4.0250000000000004,"5min":4.0250000000000004,"15min":4.0250000000000004},"last":1.137},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":7.0259999999999998,"5min":7.0259999999999998,"15min":7.0259999999999998},"last":1.0740000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":120043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.56999999999999995}]},{"osd":1,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54500000000000004}]},{"osd":2,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.67000000000000004}]},{"osd":3,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.78400000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.878},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.81000000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.89700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":120043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.38600000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.54000000000000004}]},{"osd":3,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.48399999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.83399999999999996}]},{"osd":5,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.89500000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.90300000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.84699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":710411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.53100000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.47499999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.437}]},{"osd":4,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.65400000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.73299999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.58699999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.69399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":120043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.35199999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":0.48999999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.46800000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.73899999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.61799999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.60199999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.57099999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":120043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.45000000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.46400000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.54700000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.78200000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.80300000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.73699999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":120043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.59099999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.63},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.79800000000000004}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.86299999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.748}]},{"osd":5,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.65900000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.76800000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.90100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297616,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074224,"statfs":{"total":96636764160,"available":96332005376,"internally_reserved":0,"allocated":335872,"data_stored":126298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.79100000000000004}]},{"osd":1,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.73799999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.80300000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":0.75600000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.46999999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.5739999999999998,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.51800000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.9609999999999999,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":0.502}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:43:37.359 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:43:37.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.568+0000 7fd688b9d700 1 Processor -- start 2023-10-09T06:43:37.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.569+0000 7fd688b9d700 1 -- start start 2023-10-09T06:43:37.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.570+0000 7fd688b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd68406d950 0x7fd6840c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:37.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.570+0000 7fd688b9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd68406ae70 con 0x7fd68406dd20 2023-10-09T06:43:37.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.570+0000 7fd688b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6840c7a30 con 0x7fd68406a0a0 2023-10-09T06:43:37.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.570+0000 7fd688b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68406a540 con 0x7fd68406d950 2023-10-09T06:43:37.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.570+0000 7fd683fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd68406dd20 0x7fd6840c7320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58250/0 (socket says 172.21.15.71:58250) 2023-10-09T06:43:37.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.570+0000 7fd683fff700 1 -- 172.21.15.71:0/1172809702 learned_addr learned my addr 172.21.15.71:0/1172809702 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:37.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.571+0000 7fd6827fc700 1 -- 172.21.15.71:0/1172809702 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2250848126 0 0) 0x7fd68406ae70 con 0x7fd68406dd20 2023-10-09T06:43:37.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.571+0000 7fd6827fc700 1 -- 172.21.15.71:0/1172809702 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd66c003570 con 0x7fd68406dd20 2023-10-09T06:43:37.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.571+0000 7fd6837fe700 1 --2- 172.21.15.71:0/1172809702 >> v2:172.21.15.179:3300/0 conn(0x7fd68406d950 0x7fd6840c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:37.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.571+0000 7fd6827fc700 1 -- 172.21.15.71:0/1172809702 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1624072438 0 0) 0x7fd66c003570 con 0x7fd68406dd20 2023-10-09T06:43:37.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.571+0000 7fd6827fc700 1 -- 172.21.15.71:0/1172809702 >> v2:172.21.15.179:3300/0 conn(0x7fd68406d950 msgr2=0x7fd6840c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:37.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.571+0000 7fd6827fc700 1 --2- 172.21.15.71:0/1172809702 >> v2:172.21.15.179:3300/0 conn(0x7fd68406d950 0x7fd6840c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:37.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.571+0000 7fd6827fc700 1 -- 172.21.15.71:0/1172809702 >> v1:172.21.15.179:6789/0 conn(0x7fd68406a0a0 legacy=0x7fd6840c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:37.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.571+0000 7fd6827fc700 1 -- 172.21.15.71:0/1172809702 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68406a820 con 0x7fd68406dd20 2023-10-09T06:43:37.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.571+0000 7fd6827fc700 1 -- 172.21.15.71:0/1172809702 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fd67c0017f0 con 0x7fd68406dd20 2023-10-09T06:43:37.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.571+0000 7fd6827fc700 1 -- 172.21.15.71:0/1172809702 >> v1:172.21.15.71:6789/0 conn(0x7fd68406dd20 legacy=0x7fd6840c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:37.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.571+0000 7fd6827fc700 1 --2- 172.21.15.71:0/1172809702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd66c003a60 0x7fd66c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:37.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.571+0000 7fd6827fc700 1 --2- 172.21.15.71:0/1172809702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd66c004810 0x7fd66c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:37.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.571+0000 7fd6827fc700 1 --2- 172.21.15.71:0/1172809702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd66c0051c0 0x7fd66c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:37.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.571+0000 7fd6827fc700 1 -- 172.21.15.71:0/1172809702 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68406a540 con 0x7fd66c0051c0 2023-10-09T06:43:37.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.571+0000 7fd6827fc700 1 -- 172.21.15.71:0/1172809702 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c00c0d0 con 0x7fd66c004810 2023-10-09T06:43:37.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.571+0000 7fd6827fc700 1 -- 172.21.15.71:0/1172809702 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c00c290 con 0x7fd66c003a60 2023-10-09T06:43:37.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.572+0000 7fd682ffd700 1 --2- 172.21.15.71:0/1172809702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd66c004810 0x7fd66c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:37.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.572+0000 7fd6837fe700 1 --2- 172.21.15.71:0/1172809702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd66c003a60 0x7fd66c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:37.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.572+0000 7fd683fff700 1 --2- 172.21.15.71:0/1172809702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd66c0051c0 0x7fd66c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:37.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.572+0000 7fd683fff700 1 -- 172.21.15.71:0/1172809702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd66c003a60 msgr2=0x7fd66c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:37.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.572+0000 7fd683fff700 1 --2- 172.21.15.71:0/1172809702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd66c003a60 0x7fd66c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:37.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.572+0000 7fd683fff700 1 -- 172.21.15.71:0/1172809702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd66c004810 msgr2=0x7fd66c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:37.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.572+0000 7fd683fff700 1 --2- 172.21.15.71:0/1172809702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd66c004810 0x7fd66c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:37.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.572+0000 7fd683fff700 1 -- 172.21.15.71:0/1172809702 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66c003570 con 0x7fd66c0051c0 2023-10-09T06:43:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.572+0000 7fd682ffd700 1 --2- 172.21.15.71:0/1172809702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd66c004810 0x7fd66c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:43:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.572+0000 7fd683fff700 1 -- 172.21.15.71:0/1172809702 reap_dead start 2023-10-09T06:43:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.572+0000 7fd683fff700 1 --2- 172.21.15.71:0/1172809702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd66c0051c0 0x7fd66c00ba60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00a930 tx=0x7fd67c0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52f3c556b89e7d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.572+0000 7fd6827fc700 1 -- 172.21.15.71:0/1172809702 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c0070d0 con 0x7fd66c0051c0 2023-10-09T06:43:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.572+0000 7fd6827fc700 1 -- 172.21.15.71:0/1172809702 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67c007230 con 0x7fd66c0051c0 2023-10-09T06:43:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.572+0000 7fd6827fc700 1 -- 172.21.15.71:0/1172809702 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c0075d0 con 0x7fd66c0051c0 2023-10-09T06:43:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.573+0000 7fd688b9d700 1 -- 172.21.15.71:0/1172809702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd66c0051c0 msgr2=0x7fd66c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.573+0000 7fd688b9d700 1 --2- 172.21.15.71:0/1172809702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd66c0051c0 0x7fd66c00ba60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00a930 tx=0x7fd67c0021d0 comp rx=0 tx=0).stop 2023-10-09T06:43:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.573+0000 7fd688b9d700 1 -- 172.21.15.71:0/1172809702 shutdown_connections 2023-10-09T06:43:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.573+0000 7fd688b9d700 1 --2- 172.21.15.71:0/1172809702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd66c0051c0 0x7fd66c00ba60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:37.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.573+0000 7fd688b9d700 1 -- 172.21.15.71:0/1172809702 >> 172.21.15.71:0/1172809702 conn(0x7fd6840cc1f0 msgr2=0x7fd6840cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:37.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.573+0000 7fd688b9d700 1 -- 172.21.15.71:0/1172809702 shutdown_connections 2023-10-09T06:43:37.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.573+0000 7fd688b9d700 1 -- 172.21.15.71:0/1172809702 wait complete. 2023-10-09T06:43:37.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.575+0000 7fd688b9d700 1 Processor -- start 2023-10-09T06:43:37.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.575+0000 7fd688b9d700 1 -- start start 2023-10-09T06:43:37.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.575+0000 7fd688b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd66c0051c0 0x7fd6840c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:37.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.576+0000 7fd688b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd68414f380 0x7fd684156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:37.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.576+0000 7fd688b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd684157e20 0x7fd6841572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:37.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.576+0000 7fd688b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6840c4980 con 0x7fd684157e20 2023-10-09T06:43:37.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.576+0000 7fd688b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd684152400 con 0x7fd66c0051c0 2023-10-09T06:43:37.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.576+0000 7fd688b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6841526e0 con 0x7fd68414f380 2023-10-09T06:43:37.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.576+0000 7fd683fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd684157e20 0x7fd6841572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:37.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.576+0000 7fd683fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd684157e20 0x7fd6841572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37410/0 (socket says 172.21.15.71:37410) 2023-10-09T06:43:37.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.576+0000 7fd683fff700 1 -- 172.21.15.71:0/899991231 learned_addr learned my addr 172.21.15.71:0/899991231 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:37.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.576+0000 7fd683fff700 1 -- 172.21.15.71:0/899991231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd68414f380 msgr2=0x7fd684156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:37.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.576+0000 7fd682ffd700 1 --2- 172.21.15.71:0/899991231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd68414f380 0x7fd684156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:37.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.576+0000 7fd6837fe700 1 --2- 172.21.15.71:0/899991231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd66c0051c0 0x7fd6840c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:37.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.576+0000 7fd683fff700 1 --2- 172.21.15.71:0/899991231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd68414f380 0x7fd684156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:37.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.576+0000 7fd683fff700 1 -- 172.21.15.71:0/899991231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd66c0051c0 msgr2=0x7fd6840c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:37.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.576+0000 7fd683fff700 1 --2- 172.21.15.71:0/899991231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd66c0051c0 0x7fd6840c3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:37.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.576+0000 7fd683fff700 1 -- 172.21.15.71:0/899991231 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6841529c0 con 0x7fd684157e20 2023-10-09T06:43:37.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.576+0000 7fd682ffd700 1 --2- 172.21.15.71:0/899991231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd68414f380 0x7fd684156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:37.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.576+0000 7fd683fff700 1 --2- 172.21.15.71:0/899991231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd684157e20 0x7fd6841572e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd67c000f80 tx=0x7fd67c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:37.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.577+0000 7fd66b7fe700 1 -- 172.21.15.71:0/899991231 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c01d420 con 0x7fd684157e20 2023-10-09T06:43:37.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.577+0000 7fd66b7fe700 1 -- 172.21.15.71:0/899991231 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67c01d5c0 con 0x7fd684157e20 2023-10-09T06:43:37.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.577+0000 7fd688b9d700 1 -- 172.21.15.71:0/899991231 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6840c4300 con 0x7fd684157e20 2023-10-09T06:43:37.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.577+0000 7fd66b7fe700 1 -- 172.21.15.71:0/899991231 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c01d980 con 0x7fd684157e20 2023-10-09T06:43:37.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.577+0000 7fd688b9d700 1 -- 172.21.15.71:0/899991231 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6840c2120 con 0x7fd684157e20 2023-10-09T06:43:37.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.578+0000 7fd688b9d700 1 -- 172.21.15.71:0/899991231 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6840c4af0 con 0x7fd684157e20 2023-10-09T06:43:37.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.579+0000 7fd66b7fe700 1 -- 172.21.15.71:0/899991231 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd67c027450 con 0x7fd684157e20 2023-10-09T06:43:37.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.579+0000 7fd66b7fe700 1 --2- 172.21.15.71:0/899991231 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd670066f30 0x7fd6700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:37.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.580+0000 7fd66b7fe700 1 -- 172.21.15.71:0/899991231 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd67c086ce0 con 0x7fd684157e20 2023-10-09T06:43:37.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.580+0000 7fd6837fe700 1 --2- 172.21.15.71:0/899991231 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd670066f30 0x7fd6700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:37.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.581+0000 7fd6837fe700 1 --2- 172.21.15.71:0/899991231 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd670066f30 0x7fd6700693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd674006f00 tx=0x7fd674008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:37.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.584+0000 7fd66b7fe700 1 -- 172.21.15.71:0/899991231 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd67c053eb0 con 0x7fd684157e20 2023-10-09T06:43:37.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.772+0000 7fd688b9d700 1 -- 172.21.15.71:0/899991231 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd684152850 con 0x7fd670066f30 2023-10-09T06:43:37.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.780+0000 7fd66b7fe700 1 -- 172.21.15.71:0/899991231 <== mgr.4102 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285858 (secure 0 0 0) 0x7fd684152850 con 0x7fd670066f30 2023-10-09T06:43:37.785 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:37.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.785+0000 7fd688b9d700 1 -- 172.21.15.71:0/899991231 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd670066f30 msgr2=0x7fd6700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:37.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.785+0000 7fd688b9d700 1 --2- 172.21.15.71:0/899991231 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd670066f30 0x7fd6700693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd674006f00 tx=0x7fd674008040 comp rx=0 tx=0).stop 2023-10-09T06:43:37.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.785+0000 7fd688b9d700 1 -- 172.21.15.71:0/899991231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd684157e20 msgr2=0x7fd6841572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:37.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.785+0000 7fd688b9d700 1 --2- 172.21.15.71:0/899991231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd684157e20 0x7fd6841572e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd67c000f80 tx=0x7fd67c016000 comp rx=0 tx=0).stop 2023-10-09T06:43:37.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.785+0000 7fd688b9d700 1 -- 172.21.15.71:0/899991231 shutdown_connections 2023-10-09T06:43:37.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.785+0000 7fd688b9d700 1 --2- 172.21.15.71:0/899991231 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd670066f30 0x7fd6700693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:37.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.785+0000 7fd688b9d700 1 --2- 172.21.15.71:0/899991231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd684157e20 0x7fd6841572e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:37.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.785+0000 7fd688b9d700 1 --2- 172.21.15.71:0/899991231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd66c0051c0 0x7fd6840c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:37.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.785+0000 7fd688b9d700 1 --2- 172.21.15.71:0/899991231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd68414f380 0x7fd684156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:37.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.785+0000 7fd688b9d700 1 -- 172.21.15.71:0/899991231 >> 172.21.15.71:0/899991231 conn(0x7fd6840cc1f0 msgr2=0x7fd6840c9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:37.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.785+0000 7fd688b9d700 1 -- 172.21.15.71:0/899991231 shutdown_connections 2023-10-09T06:43:37.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:37.785+0000 7fd688b9d700 1 -- 172.21.15.71:0/899991231 wait complete. 2023-10-09T06:43:37.789 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:43:37.803 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2023-10-09T06:43:36.559134+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382004,"kb_used_data":3700,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592716,"statfs":{"total":773094113280,"available":770654941184,"internally_reserved":0,"allocated":3788800,"data_stored":2147335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.998717"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.574839+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:53.860293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.586116+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:00:35.415369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569760+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:43:56.155101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573386+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:48.954261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.571448+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:43:23.488401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.581886+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:26:14.972288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.574438+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:27.903807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.579425+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:16.764212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.570982+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:37.420872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.571826+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:15:24.986946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.577387+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:11.622961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569197+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:00.654956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.570478+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:29.373317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.578539+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:37:21.561094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568960+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:48.954261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.577716+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:28.200993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573604+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:55.485080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.577528+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:23.043125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573293+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:00.654956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.572351+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:46.342897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.579223+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:49.546526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568525+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:18.302001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.570762+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:37.420872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.566809+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:49.546526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.572775+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:41.827957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.572776+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:48.954261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573628+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:00.654956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568620+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:15:24.986946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.570846+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:53.860293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.574237+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:18.302001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573065+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:59.295306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.575099+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:53.860293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569345+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:53.860293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.588823+0000","last_change":"2023-10-09T06:43:31.588823+0000","last_active":"2023-10-09T06:43:31.588823+0000","last_peered":"2023-10-09T06:43:31.588823+0000","last_clean":"2023-10-09T06:43:31.588823+0000","last_became_active":"2023-10-09T06:43:31.588554+0000","last_became_peered":"2023-10-09T06:43:31.588554+0000","last_unstale":"2023-10-09T06:43:31.588823+0000","last_undegraded":"2023-10-09T06:43:31.588823+0000","last_fullsized":"2023-10-09T06:43:31.588823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:56.343954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.574278+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:27.903807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.580770+0000","last_change":"2023-10-09T06:43:31.580770+0000","last_active":"2023-10-09T06:43:31.580770+0000","last_peered":"2023-10-09T06:43:31.580770+0000","last_clean":"2023-10-09T06:43:31.580770+0000","last_became_active":"2023-10-09T06:43:31.580483+0000","last_became_peered":"2023-10-09T06:43:31.580483+0000","last_unstale":"2023-10-09T06:43:31.580770+0000","last_undegraded":"2023-10-09T06:43:31.580770+0000","last_fullsized":"2023-10-09T06:43:31.580770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:56.343954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569483+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:59.295306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.591561+0000","last_change":"2023-10-09T06:43:31.591561+0000","last_active":"2023-10-09T06:43:31.591561+0000","last_peered":"2023-10-09T06:43:31.591561+0000","last_clean":"2023-10-09T06:43:31.591561+0000","last_became_active":"2023-10-09T06:43:31.591261+0000","last_became_peered":"2023-10-09T06:43:31.591261+0000","last_unstale":"2023-10-09T06:43:31.591561+0000","last_undegraded":"2023-10-09T06:43:31.591561+0000","last_fullsized":"2023-10-09T06:43:31.591561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:27.198306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573177+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:16.764212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.581224+0000","last_change":"2023-10-09T06:43:31.581224+0000","last_active":"2023-10-09T06:43:31.581224+0000","last_peered":"2023-10-09T06:43:31.581224+0000","last_clean":"2023-10-09T06:43:31.581224+0000","last_became_active":"2023-10-09T06:43:31.580851+0000","last_became_peered":"2023-10-09T06:43:31.580851+0000","last_unstale":"2023-10-09T06:43:31.581224+0000","last_undegraded":"2023-10-09T06:43:31.581224+0000","last_fullsized":"2023-10-09T06:43:31.581224+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:07.887852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573693+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:19:56.940720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.585382+0000","last_change":"2023-10-09T06:43:31.585382+0000","last_active":"2023-10-09T06:43:31.585382+0000","last_peered":"2023-10-09T06:43:31.585382+0000","last_clean":"2023-10-09T06:43:31.585382+0000","last_became_active":"2023-10-09T06:43:31.585083+0000","last_became_peered":"2023-10-09T06:43:31.585083+0000","last_unstale":"2023-10-09T06:43:31.585382+0000","last_undegraded":"2023-10-09T06:43:31.585382+0000","last_fullsized":"2023-10-09T06:43:31.585382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:56.343954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.570015+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:58.469035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.585289+0000","last_change":"2023-10-09T06:43:31.585289+0000","last_active":"2023-10-09T06:43:31.585289+0000","last_peered":"2023-10-09T06:43:31.585289+0000","last_clean":"2023-10-09T06:43:31.585289+0000","last_became_active":"2023-10-09T06:43:31.584990+0000","last_became_peered":"2023-10-09T06:43:31.584990+0000","last_unstale":"2023-10-09T06:43:31.585289+0000","last_undegraded":"2023-10-09T06:43:31.585289+0000","last_fullsized":"2023-10-09T06:43:31.585289+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:19:58.338127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.566811+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:55.485080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.587212+0000","last_change":"2023-10-09T06:43:31.587212+0000","last_active":"2023-10-09T06:43:31.587212+0000","last_peered":"2023-10-09T06:43:31.587212+0000","last_clean":"2023-10-09T06:43:31.587212+0000","last_became_active":"2023-10-09T06:43:31.586951+0000","last_became_peered":"2023-10-09T06:43:31.586951+0000","last_unstale":"2023-10-09T06:43:31.587212+0000","last_undegraded":"2023-10-09T06:43:31.587212+0000","last_fullsized":"2023-10-09T06:43:31.587212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:15:23.984259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.572294+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:11.622961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.582874+0000","last_change":"2023-10-09T06:43:31.582874+0000","last_active":"2023-10-09T06:43:31.582874+0000","last_peered":"2023-10-09T06:43:31.582874+0000","last_clean":"2023-10-09T06:43:31.582874+0000","last_became_active":"2023-10-09T06:43:31.582615+0000","last_became_peered":"2023-10-09T06:43:31.582615+0000","last_unstale":"2023-10-09T06:43:31.582874+0000","last_undegraded":"2023-10-09T06:43:31.582874+0000","last_fullsized":"2023-10-09T06:43:31.582874+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:15:09.963486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568407+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:16.764212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.584657+0000","last_change":"2023-10-09T06:43:31.584657+0000","last_active":"2023-10-09T06:43:31.584657+0000","last_peered":"2023-10-09T06:43:31.584657+0000","last_clean":"2023-10-09T06:43:31.584657+0000","last_became_active":"2023-10-09T06:43:31.584392+0000","last_became_peered":"2023-10-09T06:43:31.584392+0000","last_unstale":"2023-10-09T06:43:31.584657+0000","last_undegraded":"2023-10-09T06:43:31.584657+0000","last_fullsized":"2023-10-09T06:43:31.584657+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:17.299314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.575980+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:43:56.155101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.582543+0000","last_change":"2023-10-09T06:43:31.582543+0000","last_active":"2023-10-09T06:43:31.582543+0000","last_peered":"2023-10-09T06:43:31.582543+0000","last_clean":"2023-10-09T06:43:31.582543+0000","last_became_active":"2023-10-09T06:43:31.582274+0000","last_became_peered":"2023-10-09T06:43:31.582274+0000","last_unstale":"2023-10-09T06:43:31.582543+0000","last_undegraded":"2023-10-09T06:43:31.582543+0000","last_fullsized":"2023-10-09T06:43:31.582543+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:54.482393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.571650+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:16.764212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.581601+0000","last_change":"2023-10-09T06:43:31.581601+0000","last_active":"2023-10-09T06:43:31.581601+0000","last_peered":"2023-10-09T06:43:31.581601+0000","last_clean":"2023-10-09T06:43:31.581601+0000","last_became_active":"2023-10-09T06:43:31.581330+0000","last_became_peered":"2023-10-09T06:43:31.581330+0000","last_unstale":"2023-10-09T06:43:31.581601+0000","last_undegraded":"2023-10-09T06:43:31.581601+0000","last_fullsized":"2023-10-09T06:43:31.581601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:26.901120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568125+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:41.827957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.591755+0000","last_change":"2023-10-09T06:43:31.591755+0000","last_active":"2023-10-09T06:43:31.591755+0000","last_peered":"2023-10-09T06:43:31.591755+0000","last_clean":"2023-10-09T06:43:31.591755+0000","last_became_active":"2023-10-09T06:43:31.591271+0000","last_became_peered":"2023-10-09T06:43:31.591271+0000","last_unstale":"2023-10-09T06:43:31.591755+0000","last_undegraded":"2023-10-09T06:43:31.591755+0000","last_fullsized":"2023-10-09T06:43:31.591755+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:26.901120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.571745+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:49.546526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.581530+0000","last_change":"2023-10-09T06:43:31.581530+0000","last_active":"2023-10-09T06:43:31.581530+0000","last_peered":"2023-10-09T06:43:31.581530+0000","last_clean":"2023-10-09T06:43:31.581530+0000","last_became_active":"2023-10-09T06:43:31.580810+0000","last_became_peered":"2023-10-09T06:43:31.580810+0000","last_unstale":"2023-10-09T06:43:31.581530+0000","last_undegraded":"2023-10-09T06:43:31.581530+0000","last_fullsized":"2023-10-09T06:43:31.581530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:44:08.275015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569062+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:41.827957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.583715+0000","last_change":"2023-10-09T06:43:31.583715+0000","last_active":"2023-10-09T06:43:31.583715+0000","last_peered":"2023-10-09T06:43:31.583715+0000","last_clean":"2023-10-09T06:43:31.583715+0000","last_became_active":"2023-10-09T06:43:31.583119+0000","last_became_peered":"2023-10-09T06:43:31.583119+0000","last_unstale":"2023-10-09T06:43:31.583715+0000","last_undegraded":"2023-10-09T06:43:31.583715+0000","last_fullsized":"2023-10-09T06:43:31.583715+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:58.292619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.575587+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:37.420872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.585275+0000","last_change":"2023-10-09T06:43:31.585275+0000","last_active":"2023-10-09T06:43:31.585275+0000","last_peered":"2023-10-09T06:43:31.585275+0000","last_clean":"2023-10-09T06:43:31.585275+0000","last_became_active":"2023-10-09T06:43:31.584989+0000","last_became_peered":"2023-10-09T06:43:31.584989+0000","last_unstale":"2023-10-09T06:43:31.585275+0000","last_undegraded":"2023-10-09T06:43:31.585275+0000","last_fullsized":"2023-10-09T06:43:31.585275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:36.418185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573626+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:18.302001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.591837+0000","last_change":"2023-10-09T06:43:31.591837+0000","last_active":"2023-10-09T06:43:31.591837+0000","last_peered":"2023-10-09T06:43:31.591837+0000","last_clean":"2023-10-09T06:43:31.591837+0000","last_became_active":"2023-10-09T06:43:31.591583+0000","last_became_peered":"2023-10-09T06:43:31.591583+0000","last_unstale":"2023-10-09T06:43:31.591837+0000","last_undegraded":"2023-10-09T06:43:31.591837+0000","last_fullsized":"2023-10-09T06:43:31.591837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:48.543839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568791+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:27.903807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.591708+0000","last_change":"2023-10-09T06:43:31.591708+0000","last_active":"2023-10-09T06:43:31.591708+0000","last_peered":"2023-10-09T06:43:31.591708+0000","last_clean":"2023-10-09T06:43:31.591708+0000","last_became_active":"2023-10-09T06:43:31.591444+0000","last_became_peered":"2023-10-09T06:43:31.591444+0000","last_unstale":"2023-10-09T06:43:31.591708+0000","last_undegraded":"2023-10-09T06:43:31.591708+0000","last_fullsized":"2023-10-09T06:43:31.591708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:52.857606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.567757+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:11.622961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.582200+0000","last_change":"2023-10-09T06:43:31.582200+0000","last_active":"2023-10-09T06:43:31.582200+0000","last_peered":"2023-10-09T06:43:31.582200+0000","last_clean":"2023-10-09T06:43:31.582200+0000","last_became_active":"2023-10-09T06:43:31.581947+0000","last_became_peered":"2023-10-09T06:43:31.581947+0000","last_unstale":"2023-10-09T06:43:31.582200+0000","last_undegraded":"2023-10-09T06:43:31.582200+0000","last_fullsized":"2023-10-09T06:43:31.582200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:31.583076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569282+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:28.200993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.581221+0000","last_change":"2023-10-09T06:43:31.581221+0000","last_active":"2023-10-09T06:43:31.581221+0000","last_peered":"2023-10-09T06:43:31.581221+0000","last_clean":"2023-10-09T06:43:31.581221+0000","last_became_active":"2023-10-09T06:43:31.580923+0000","last_became_peered":"2023-10-09T06:43:31.580923+0000","last_unstale":"2023-10-09T06:43:31.581221+0000","last_undegraded":"2023-10-09T06:43:31.581221+0000","last_fullsized":"2023-10-09T06:43:31.581221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:43.384282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.572973+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:44.386969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.585326+0000","last_change":"2023-10-09T06:43:31.585326+0000","last_active":"2023-10-09T06:43:31.585326+0000","last_peered":"2023-10-09T06:43:31.585326+0000","last_clean":"2023-10-09T06:43:31.585326+0000","last_became_active":"2023-10-09T06:43:31.585015+0000","last_became_peered":"2023-10-09T06:43:31.585015+0000","last_unstale":"2023-10-09T06:43:31.585326+0000","last_undegraded":"2023-10-09T06:43:31.585326+0000","last_fullsized":"2023-10-09T06:43:31.585326+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:12:59.791856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569881+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:05.648062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.579815+0000","last_change":"2023-10-09T06:43:31.579815+0000","last_active":"2023-10-09T06:43:31.579815+0000","last_peered":"2023-10-09T06:43:31.579815+0000","last_clean":"2023-10-09T06:43:31.579815+0000","last_became_active":"2023-10-09T06:43:31.579569+0000","last_became_peered":"2023-10-09T06:43:31.579569+0000","last_unstale":"2023-10-09T06:43:31.579815+0000","last_undegraded":"2023-10-09T06:43:31.579815+0000","last_fullsized":"2023-10-09T06:43:31.579815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:31.688662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.571007+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:36:56.965210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.582436+0000","last_change":"2023-10-09T06:43:31.582436+0000","last_active":"2023-10-09T06:43:31.582436+0000","last_peered":"2023-10-09T06:43:31.582436+0000","last_clean":"2023-10-09T06:43:31.582436+0000","last_became_active":"2023-10-09T06:43:31.582133+0000","last_became_peered":"2023-10-09T06:43:31.582133+0000","last_unstale":"2023-10-09T06:43:31.582436+0000","last_undegraded":"2023-10-09T06:43:31.582436+0000","last_fullsized":"2023-10-09T06:43:31.582436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:48:44.295975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568823+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:30:10.950127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.572408+0000","last_change":"2023-10-09T06:43:31.572408+0000","last_active":"2023-10-09T06:43:31.572408+0000","last_peered":"2023-10-09T06:43:31.572408+0000","last_clean":"2023-10-09T06:43:31.572408+0000","last_became_active":"2023-10-09T06:43:31.572144+0000","last_became_peered":"2023-10-09T06:43:31.572144+0000","last_unstale":"2023-10-09T06:43:31.572408+0000","last_undegraded":"2023-10-09T06:43:31.572408+0000","last_fullsized":"2023-10-09T06:43:31.572408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:49:32.843137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573875+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:59.295306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.582351+0000","last_change":"2023-10-09T06:43:31.582351+0000","last_active":"2023-10-09T06:43:31.582351+0000","last_peered":"2023-10-09T06:43:31.582351+0000","last_clean":"2023-10-09T06:43:31.582351+0000","last_became_active":"2023-10-09T06:43:31.582079+0000","last_became_peered":"2023-10-09T06:43:31.582079+0000","last_unstale":"2023-10-09T06:43:31.582351+0000","last_undegraded":"2023-10-09T06:43:31.582351+0000","last_fullsized":"2023-10-09T06:43:31.582351+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:52.857606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573496+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:49:33.845823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.585000+0000","last_change":"2023-10-09T06:43:31.585000+0000","last_active":"2023-10-09T06:43:31.585000+0000","last_peered":"2023-10-09T06:43:31.585000+0000","last_clean":"2023-10-09T06:43:31.585000+0000","last_became_active":"2023-10-09T06:43:31.584704+0000","last_became_peered":"2023-10-09T06:43:31.584704+0000","last_unstale":"2023-10-09T06:43:31.585000+0000","last_undegraded":"2023-10-09T06:43:31.585000+0000","last_fullsized":"2023-10-09T06:43:31.585000+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:17.299314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.569914+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:23.043125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.574479+0000","last_change":"2023-10-09T06:43:31.574479+0000","last_active":"2023-10-09T06:43:31.574479+0000","last_peered":"2023-10-09T06:43:31.574479+0000","last_clean":"2023-10-09T06:43:31.574479+0000","last_became_active":"2023-10-09T06:43:31.571653+0000","last_became_peered":"2023-10-09T06:43:31.571653+0000","last_unstale":"2023-10-09T06:43:31.574479+0000","last_undegraded":"2023-10-09T06:43:31.574479+0000","last_fullsized":"2023-10-09T06:43:31.574479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:48:44.295975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568788+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:27.903807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.578306+0000","last_change":"2023-10-09T06:43:31.578306+0000","last_active":"2023-10-09T06:43:31.578306+0000","last_peered":"2023-10-09T06:43:31.578306+0000","last_clean":"2023-10-09T06:43:31.578306+0000","last_became_active":"2023-10-09T06:43:31.578049+0000","last_became_peered":"2023-10-09T06:43:31.578049+0000","last_unstale":"2023-10-09T06:43:31.578306+0000","last_undegraded":"2023-10-09T06:43:31.578306+0000","last_fullsized":"2023-10-09T06:43:31.578306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:19:55.938033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.575366+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:37.420872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.582574+0000","last_change":"2023-10-09T06:43:31.582574+0000","last_active":"2023-10-09T06:43:31.582574+0000","last_peered":"2023-10-09T06:43:31.582574+0000","last_clean":"2023-10-09T06:43:31.582574+0000","last_became_active":"2023-10-09T06:43:31.582321+0000","last_became_peered":"2023-10-09T06:43:31.582321+0000","last_unstale":"2023-10-09T06:43:31.582574+0000","last_undegraded":"2023-10-09T06:43:31.582574+0000","last_fullsized":"2023-10-09T06:43:31.582574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:19:55.938033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.568162+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:18.302001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.584968+0000","last_change":"2023-10-09T06:43:31.584968+0000","last_active":"2023-10-09T06:43:31.584968+0000","last_peered":"2023-10-09T06:43:31.584968+0000","last_clean":"2023-10-09T06:43:31.584968+0000","last_became_active":"2023-10-09T06:43:31.584655+0000","last_became_peered":"2023-10-09T06:43:31.584655+0000","last_unstale":"2023-10-09T06:43:31.584968+0000","last_undegraded":"2023-10-09T06:43:31.584968+0000","last_fullsized":"2023-10-09T06:43:31.584968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:26.901120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.577942+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:58.469035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.582691+0000","last_change":"2023-10-09T06:43:31.582691+0000","last_active":"2023-10-09T06:43:31.582691+0000","last_peered":"2023-10-09T06:43:31.582691+0000","last_clean":"2023-10-09T06:43:31.582691+0000","last_became_active":"2023-10-09T06:43:31.582414+0000","last_became_peered":"2023-10-09T06:43:31.582414+0000","last_unstale":"2023-10-09T06:43:31.582691+0000","last_undegraded":"2023-10-09T06:43:31.582691+0000","last_fullsized":"2023-10-09T06:43:31.582691+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:45.340210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.566972+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:19:56.940720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.585912+0000","last_change":"2023-10-09T06:43:31.585912+0000","last_active":"2023-10-09T06:43:31.585912+0000","last_peered":"2023-10-09T06:43:31.585912+0000","last_clean":"2023-10-09T06:43:31.585912+0000","last_became_active":"2023-10-09T06:43:31.585592+0000","last_became_peered":"2023-10-09T06:43:31.585592+0000","last_unstale":"2023-10-09T06:43:31.585912+0000","last_undegraded":"2023-10-09T06:43:31.585912+0000","last_fullsized":"2023-10-09T06:43:31.585912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:52.857606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:43:31.559218+0000","last_change":"2023-10-09T06:43:31.573200+0000","last_active":"2023-10-09T06:43:31.559218+0000","last_peered":"2023-10-09T06:43:31.559218+0000","last_clean":"2023-10-09T06:43:31.559218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:43:31.559218+0000","last_undegraded":"2023-10-09T06:43:31.559218+0000","last_fullsized":"2023-10-09T06:43:31.559218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:32.691349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T06:43:31.588384+0000","last_change":"2023-10-09T06:43:31.588384+0000","last_active":"2023-10-09T06:43:31.588384+0000","last_peered":"2023-10-09T06:43:31.588384+0000","last_clean":"2023-10-09T06:43:31.588384+0000","last_became_active":"2023-10-09T06:43:31.588110+0000","last_became_peered":"2023-10-09T06:43:31.588110+0000","last_unstale":"2023-10-09T06:43:31.588384+0000","last_undegraded":"2023-10-09T06:43:31.588384+0000","last_fullsized":"2023-10-09T06:43:31.588384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:31.688662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":171,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T06:43:30.567324+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:43:30.567324+0000","last_peered":"2023-10-09T06:43:30.567324+0000","last_clean":"2023-10-09T06:43:30.567324+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:43:30.567324+0000","last_undegraded":"2023-10-09T06:43:30.567324+0000","last_fullsized":"2023-10-09T06:43:30.567324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":710411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.448,"5min":3.448,"15min":3.448},"last":0.55500000000000005}]},{"osd":1,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":5.617,"5min":5.617,"15min":5.617},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":0.58799999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.004}]},{"osd":3,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":5.5800000000000001,"5min":5.5800000000000001,"15min":5.5800000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":6.9299999999999997,"5min":6.9299999999999997,"15min":6.9299999999999997},"last":0.97499999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":3.125,"5min":3.125,"15min":3.125},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":4.8380000000000001,"5min":4.8380000000000001,"15min":4.8380000000000001},"last":1.028}]},{"osd":5,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":4.1929999999999996,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":3.6749999999999998,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":1.0800000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":4.0250000000000004,"5min":4.0250000000000004,"15min":4.0250000000000004},"last":1.137},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":7.0259999999999998,"5min":7.0259999999999998,"15min":7.0259999999999998},"last":1.0740000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":120043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.56999999999999995}]},{"osd":1,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54500000000000004}]},{"osd":2,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.67000000000000004}]},{"osd":3,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.78400000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.878},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.81000000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.89700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":120043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.38600000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.54000000000000004}]},{"osd":3,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.48399999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.83399999999999996}]},{"osd":5,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.89500000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.90300000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.84699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":710411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.53100000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.47499999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.437}]},{"osd":4,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.65400000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.73299999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.58699999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.69399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":120043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.35199999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":0.48999999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.46800000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.73899999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.61799999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.60199999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.57099999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":120043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.45000000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.46400000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.54700000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.78200000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.80300000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.73699999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":120043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.59099999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.63},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.79800000000000004}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.86299999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.748}]},{"osd":5,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.65900000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.76800000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.90100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297616,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074224,"statfs":{"total":96636764160,"available":96332005376,"internally_reserved":0,"allocated":335872,"data_stored":126298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.79100000000000004}]},{"osd":1,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.73799999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.80300000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":0.75600000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.46999999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.5739999999999998,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.51800000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.9609999999999999,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":0.502}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:43:37.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-10-09T06:43:37.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.574839+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:32:53.860293+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:43:37.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-10-09T06:43:37.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.586116+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:00:35.415369+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T06:43:37.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-10-09T06:43:37.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.569760+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T06:43:56.155101+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:43:37.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-10-09T06:43:37.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.573386+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T07:38:48.954261+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:43:37.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-10-09T06:43:37.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.571448+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:43:23.488401+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T06:43:37.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-10-09T06:43:37.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.581886+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T09:26:14.972288+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T06:43:37.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-10-09T06:43:37.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.574438+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T08:05:27.903807+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:43:37.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-10-09T06:43:37.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.579425+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:57:16.764212+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:43:37.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-10-09T06:43:37.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.570982+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:37:37.420872+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:43:37.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-10-09T06:43:37.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.571826+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T10:15:24.986946+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:43:37.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-10-09T06:43:37.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.577387+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:32:11.622961+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:43:37.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-10-09T06:43:37.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.569197+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:02:00.654956+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:43:37.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-10-09T06:43:37.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.570478+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:57:29.373317+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T06:43:37.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-10-09T06:43:37.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.578539+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:37:21.561094+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T06:43:37.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-10-09T06:43:37.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.568960+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T07:38:48.954261+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:43:37.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-10-09T06:43:37.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.577716+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:19:28.200993+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:43:37.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-10-09T06:43:37.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.573604+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:21:55.485080+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:43:37.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-10-09T06:43:37.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.577528+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:26:23.043125+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T06:43:37.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-10-09T06:43:37.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.573293+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:02:00.654956+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T06:43:37.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-10-09T06:43:37.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.572351+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:42:46.342897+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T06:43:37.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-10-09T06:43:37.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.579223+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:34:49.546526+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:43:37.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-10-09T06:43:37.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.568525+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T07:33:18.302001+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:43:37.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-10-09T06:43:37.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.570762+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:37:37.420872+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T06:43:37.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-10-09T06:43:37.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.566809+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:34:49.546526+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:43:37.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-10-09T06:43:37.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.572775+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T09:23:41.827957+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:43:37.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-10-09T06:43:37.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.572776+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T07:38:48.954261+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T06:43:37.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-10-09T06:43:37.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.573628+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:02:00.654956+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:43:37.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-10-09T06:43:37.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.568620+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T10:15:24.986946+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:43:37.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-10-09T06:43:37.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.570846+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:32:53.860293+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:43:37.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-10-09T06:43:37.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.574237+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T07:33:18.302001+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:43:37.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-10-09T06:43:37.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.573065+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T07:43:59.295306+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:43:37.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-10-09T06:43:37.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.575099+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:32:53.860293+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:43:37.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-10-09T06:43:37.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.569345+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:32:53.860293+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T06:43:37.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-10-09T06:43:37.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.574278+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T08:05:27.903807+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:43:37.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-10-09T06:43:37.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.569483+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T07:43:59.295306+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:43:37.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-10-09T06:43:37.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.573177+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:57:16.764212+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:43:37.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-10-09T06:43:37.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.573693+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:19:56.940720+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:43:37.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-10-09T06:43:37.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.570015+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:15:58.469035+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:43:37.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-10-09T06:43:37.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.566811+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:21:55.485080+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:43:37.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-10-09T06:43:37.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.572294+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:32:11.622961+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:43:37.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-10-09T06:43:37.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.568407+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:57:16.764212+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:43:37.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-10-09T06:43:37.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.575980+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T06:43:56.155101+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T06:43:37.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-10-09T06:43:37.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.571650+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:57:16.764212+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T06:43:37.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-10-09T06:43:37.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.568125+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T09:23:41.827957+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:43:37.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-10-09T06:43:37.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.571745+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:34:49.546526+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:43:37.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-10-09T06:43:37.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.569062+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T09:23:41.827957+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T06:43:37.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-10-09T06:43:37.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.575587+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:37:37.420872+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:43:37.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-10-09T06:43:37.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.573626+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T07:33:18.302001+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:43:37.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-10-09T06:43:37.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.568791+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T08:05:27.903807+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:43:37.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-10-09T06:43:37.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.567757+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:32:11.622961+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:43:37.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-10-09T06:43:37.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.569282+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:19:28.200993+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T06:43:37.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-10-09T06:43:37.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.572973+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T09:22:44.386969+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T06:43:37.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-10-09T06:43:37.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.569881+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:31:05.648062+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T06:43:37.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-10-09T06:43:37.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.571007+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:36:56.965210+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T06:43:37.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-10-09T06:43:37.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.568823+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T09:30:10.950127+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T06:43:37.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-10-09T06:43:37.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.573875+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T07:43:59.295306+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:43:37.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-10-09T06:43:37.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.573496+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T08:49:33.845823+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T06:43:37.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-10-09T06:43:37.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.569914+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:26:23.043125+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:43:37.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-10-09T06:43:37.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.568788+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T08:05:27.903807+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T06:43:37.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-10-09T06:43:37.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.575366+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:37:37.420872+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:43:37.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-10-09T06:43:37.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.568162+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T07:33:18.302001+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T06:43:37.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-10-09T06:43:37.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.577942+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:15:58.469035+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T06:43:37.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-10-09T06:43:37.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.566972+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:19:56.940720+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:43:37.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-10-09T06:43:37.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:43:31.559218+0000', 'last_change': '2023-10-09T06:43:31.573200+0000', 'last_active': '2023-10-09T06:43:31.559218+0000', 'last_peered': '2023-10-09T06:43:31.559218+0000', 'last_clean': '2023-10-09T06:43:31.559218+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:43:31.559218+0000', 'last_undegraded': '2023-10-09T06:43:31.559218+0000', 'last_fullsized': '2023-10-09T06:43:31.559218+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'last_clean_scrub_stamp': '2023-10-09T06:43:31.559218+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T08:39:32.691349+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:43:37.825 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T06:43:38.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.022+0000 7f4be9d9d700 1 Processor -- start 2023-10-09T06:43:38.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.022+0000 7f4be9d9d700 1 -- start start 2023-10-09T06:43:38.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.023+0000 7f4be9d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4be41559a0 0x7f4be4069870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:38.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.023+0000 7f4be9d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4be4155d70 0x7f4be406e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:38.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.023+0000 7f4be9d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be40c6810 con 0x7f4be40ac210 2023-10-09T06:43:38.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.023+0000 7f4be9d9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be40c7390 con 0x7f4be41559a0 2023-10-09T06:43:38.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.023+0000 7f4be9d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be40c6a60 con 0x7f4be4155d70 2023-10-09T06:43:38.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.023+0000 7f4be8d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4be41559a0 0x7f4be4069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:38.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.023+0000 7f4be8d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4be41559a0 0x7f4be4069870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37416/0 (socket says 172.21.15.71:37416) 2023-10-09T06:43:38.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.023+0000 7f4be8d9b700 1 -- 172.21.15.71:0/2377358259 learned_addr learned my addr 172.21.15.71:0/2377358259 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:38.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.024+0000 7f4be959c700 1 --2- 172.21.15.71:0/2377358259 >> v2:172.21.15.179:3300/0 conn(0x7f4be4155d70 0x7f4be406e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:38.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.024+0000 7f4be8d9b700 1 -- 172.21.15.71:0/2377358259 >> v2:172.21.15.179:3300/0 conn(0x7f4be4155d70 msgr2=0x7f4be406e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:38.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.024+0000 7f4be8d9b700 1 --2- 172.21.15.71:0/2377358259 >> v2:172.21.15.179:3300/0 conn(0x7f4be4155d70 0x7f4be406e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:38.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.024+0000 7f4be8d9b700 1 -- 172.21.15.71:0/2377358259 >> v1:172.21.15.179:6789/0 conn(0x7f4be40ac210 legacy=0x7f4be406deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:38.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.024+0000 7f4be8d9b700 1 -- 172.21.15.71:0/2377358259 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be40c6d40 con 0x7f4be41559a0 2023-10-09T06:43:38.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.024+0000 7f4be8d9b700 1 --2- 172.21.15.71:0/2377358259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4be41559a0 0x7f4be4069870 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4be40c6780 tx=0x7f4bd800a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f12b574ae50973 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:38.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.024+0000 7f4be37fe700 1 -- 172.21.15.71:0/2377358259 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd800ca00 con 0x7f4be41559a0 2023-10-09T06:43:38.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.024+0000 7f4be37fe700 1 -- 172.21.15.71:0/2377358259 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd800cb60 con 0x7f4be41559a0 2023-10-09T06:43:38.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.024+0000 7f4be37fe700 1 -- 172.21.15.71:0/2377358259 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd80183f0 con 0x7f4be41559a0 2023-10-09T06:43:38.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.025+0000 7f4be9d9d700 1 -- 172.21.15.71:0/2377358259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4be41559a0 msgr2=0x7f4be4069870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:38.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.025+0000 7f4be9d9d700 1 --2- 172.21.15.71:0/2377358259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4be41559a0 0x7f4be4069870 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4be40c6780 tx=0x7f4bd800a3f0 comp rx=0 tx=0).stop 2023-10-09T06:43:38.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.025+0000 7f4be9d9d700 1 -- 172.21.15.71:0/2377358259 shutdown_connections 2023-10-09T06:43:38.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.025+0000 7f4be9d9d700 1 --2- 172.21.15.71:0/2377358259 >> v2:172.21.15.179:3300/0 conn(0x7f4be4155d70 0x7f4be406e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:38.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.025+0000 7f4be9d9d700 1 --2- 172.21.15.71:0/2377358259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4be41559a0 0x7f4be4069870 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:38.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.025+0000 7f4be9d9d700 1 -- 172.21.15.71:0/2377358259 >> 172.21.15.71:0/2377358259 conn(0x7f4be40ccca0 msgr2=0x7f4be40c8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:38.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.025+0000 7f4be9d9d700 1 -- 172.21.15.71:0/2377358259 shutdown_connections 2023-10-09T06:43:38.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.025+0000 7f4be9d9d700 1 -- 172.21.15.71:0/2377358259 wait complete. 2023-10-09T06:43:38.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.026+0000 7f4be9d9d700 1 Processor -- start 2023-10-09T06:43:38.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.026+0000 7f4be9d9d700 1 -- start start 2023-10-09T06:43:38.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.027+0000 7f4be9d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4be40ac210 0x7f4be40b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:38.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.027+0000 7f4be9d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4be41559a0 0x7f4be415c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:38.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.027+0000 7f4be9d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4be4155d70 0x7f4be40c3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:38.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.027+0000 7f4be9d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be4168ce0 con 0x7f4be4155d70 2023-10-09T06:43:38.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.027+0000 7f4be9d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be40c41e0 con 0x7f4be40ac210 2023-10-09T06:43:38.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.027+0000 7f4be9d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be415be70 con 0x7f4be41559a0 2023-10-09T06:43:38.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.028+0000 7f4be959c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4be4155d70 0x7f4be40c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:38.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.028+0000 7f4be959c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4be4155d70 0x7f4be40c3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37426/0 (socket says 172.21.15.71:37426) 2023-10-09T06:43:38.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.028+0000 7f4be959c700 1 -- 172.21.15.71:0/3717479563 learned_addr learned my addr 172.21.15.71:0/3717479563 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:38.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.028+0000 7f4be8d9b700 1 --2- 172.21.15.71:0/3717479563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4be40ac210 0x7f4be40b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:38.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.028+0000 7f4be3fff700 1 --2- 172.21.15.71:0/3717479563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4be41559a0 0x7f4be415c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:38.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.028+0000 7f4be959c700 1 -- 172.21.15.71:0/3717479563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4be41559a0 msgr2=0x7f4be415c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:38.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.028+0000 7f4be959c700 1 --2- 172.21.15.71:0/3717479563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4be41559a0 0x7f4be415c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:38.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.028+0000 7f4be959c700 1 -- 172.21.15.71:0/3717479563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4be40ac210 msgr2=0x7f4be40b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:38.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.028+0000 7f4be959c700 1 --2- 172.21.15.71:0/3717479563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4be40ac210 0x7f4be40b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:38.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.028+0000 7f4be959c700 1 -- 172.21.15.71:0/3717479563 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd800a690 con 0x7f4be4155d70 2023-10-09T06:43:38.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.028+0000 7f4be3fff700 1 --2- 172.21.15.71:0/3717479563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4be41559a0 0x7f4be415c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:38.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.028+0000 7f4be959c700 1 --2- 172.21.15.71:0/3717479563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4be4155d70 0x7f4be40c3280 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009fa0 tx=0x7f4bdc009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:38.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.028+0000 7f4be0ff9700 1 -- 172.21.15.71:0/3717479563 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc00ed20 con 0x7f4be4155d70 2023-10-09T06:43:38.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.028+0000 7f4be0ff9700 1 -- 172.21.15.71:0/3717479563 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc00ee80 con 0x7f4be4155d70 2023-10-09T06:43:38.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.028+0000 7f4be0ff9700 1 -- 172.21.15.71:0/3717479563 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc014670 con 0x7f4be4155d70 2023-10-09T06:43:38.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.028+0000 7f4be9d9d700 1 -- 172.21.15.71:0/3717479563 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be4168a00 con 0x7f4be4155d70 2023-10-09T06:43:38.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.029+0000 7f4be9d9d700 1 -- 172.21.15.71:0/3717479563 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be415bb00 con 0x7f4be4155d70 2023-10-09T06:43:38.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.029+0000 7f4be9d9d700 1 -- 172.21.15.71:0/3717479563 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be415c000 con 0x7f4be4155d70 2023-10-09T06:43:38.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.030+0000 7f4be0ff9700 1 -- 172.21.15.71:0/3717479563 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4bdc0149e0 con 0x7f4be4155d70 2023-10-09T06:43:38.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.031+0000 7f4be0ff9700 1 --2- 172.21.15.71:0/3717479563 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4bc8066f30 0x7f4bc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:38.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.031+0000 7f4be0ff9700 1 -- 172.21.15.71:0/3717479563 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4bdc084d00 con 0x7f4be4155d70 2023-10-09T06:43:38.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.032+0000 7f4be8d9b700 1 --2- 172.21.15.71:0/3717479563 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4bc8066f30 0x7f4bc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:38.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.032+0000 7f4be8d9b700 1 --2- 172.21.15.71:0/3717479563 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4bc8066f30 0x7f4bc80693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4be40c6780 tx=0x7f4bd8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:38.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.035+0000 7f4be0ff9700 1 -- 172.21.15.71:0/3717479563 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4bdc051ed0 con 0x7f4be4155d70 2023-10-09T06:43:38.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.302+0000 7f4be9d9d700 1 -- 172.21.15.71:0/3717479563 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f4be404c3c0 con 0x7f4be4155d70 2023-10-09T06:43:38.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.303+0000 7f4be0ff9700 1 -- 172.21.15.71:0/3717479563 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1583 (secure 0 0 0) 0x7f4bdc0554f0 con 0x7f4be4155d70 2023-10-09T06:43:38.304 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:38.304 INFO:teuthology.orchestra.run.smithi071.stdout:{"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":84,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":32,"num_osds":8,"num_up_osds":8,"osd_up_since":1696833745,"num_in_osds":8,"osd_in_since":1696833737,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2439172096,"bytes_avail":770654941184,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4905}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-10-09T06:43:28.557133+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-09T06:43:38.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.305+0000 7f4be9d9d700 1 -- 172.21.15.71:0/3717479563 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4bc8066f30 msgr2=0x7f4bc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:38.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.305+0000 7f4be9d9d700 1 --2- 172.21.15.71:0/3717479563 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4bc8066f30 0x7f4bc80693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4be40c6780 tx=0x7f4bd8017000 comp rx=0 tx=0).stop 2023-10-09T06:43:38.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.305+0000 7f4be9d9d700 1 -- 172.21.15.71:0/3717479563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4be4155d70 msgr2=0x7f4be40c3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:38.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.305+0000 7f4be9d9d700 1 --2- 172.21.15.71:0/3717479563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4be4155d70 0x7f4be40c3280 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009fa0 tx=0x7f4bdc009900 comp rx=0 tx=0).stop 2023-10-09T06:43:38.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.305+0000 7f4be9d9d700 1 -- 172.21.15.71:0/3717479563 shutdown_connections 2023-10-09T06:43:38.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.305+0000 7f4be9d9d700 1 --2- 172.21.15.71:0/3717479563 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4bc8066f30 0x7f4bc80693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:38.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.305+0000 7f4be9d9d700 1 --2- 172.21.15.71:0/3717479563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4be4155d70 0x7f4be40c3280 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:38.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.305+0000 7f4be9d9d700 1 --2- 172.21.15.71:0/3717479563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4be40ac210 0x7f4be40b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:38.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.305+0000 7f4be9d9d700 1 --2- 172.21.15.71:0/3717479563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4be41559a0 0x7f4be415c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:38.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.305+0000 7f4be9d9d700 1 -- 172.21.15.71:0/3717479563 >> 172.21.15.71:0/3717479563 conn(0x7f4be40ccca0 msgr2=0x7f4be40cb600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:38.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.305+0000 7f4be9d9d700 1 -- 172.21.15.71:0/3717479563 shutdown_connections 2023-10-09T06:43:38.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.305+0000 7f4be9d9d700 1 -- 172.21.15.71:0/3717479563 wait complete. 2023-10-09T06:43:38.323 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T06:43:38.324 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:43:38.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.502+0000 7f14a1f9d700 1 Processor -- start 2023-10-09T06:43:38.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.503+0000 7f14a1f9d700 1 -- start start 2023-10-09T06:43:38.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.504+0000 7f14a1f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f149c157270 0x7f149c068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:38.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.504+0000 7f14a1f9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f149c0688d0 0x7f149c0b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:38.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.504+0000 7f14a1f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f149c0b0a00 0x7f149c06a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:38.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.504+0000 7f14a1f9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149c068d40 con 0x7f149c0688d0 2023-10-09T06:43:38.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.504+0000 7f14a1f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149c15a980 con 0x7f149c0b0a00 2023-10-09T06:43:38.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.504+0000 7f14a1f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149c15a050 con 0x7f149c157270 2023-10-09T06:43:38.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.504+0000 7f149bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f149c0688d0 0x7f149c0b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:38.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.504+0000 7f149bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f149c0688d0 0x7f149c0b04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37428/0 (socket says 172.21.15.71:37428) 2023-10-09T06:43:38.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.504+0000 7f149bfff700 1 -- 172.21.15.71:0/2981073144 learned_addr learned my addr 172.21.15.71:0/2981073144 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:38.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.505+0000 7f14a0f9b700 1 --2- 172.21.15.71:0/2981073144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f149c157270 0x7f149c068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:38.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.505+0000 7f14a179c700 1 --2- 172.21.15.71:0/2981073144 >> v2:172.21.15.179:3300/0 conn(0x7f149c0b0a00 0x7f149c06a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:38.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.505+0000 7f149bfff700 1 -- 172.21.15.71:0/2981073144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f149c157270 msgr2=0x7f149c068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:38.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.505+0000 7f149bfff700 1 --2- 172.21.15.71:0/2981073144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f149c157270 0x7f149c068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:38.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.505+0000 7f149bfff700 1 -- 172.21.15.71:0/2981073144 >> v2:172.21.15.179:3300/0 conn(0x7f149c0b0a00 msgr2=0x7f149c06a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:38.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.505+0000 7f149bfff700 1 --2- 172.21.15.71:0/2981073144 >> v2:172.21.15.179:3300/0 conn(0x7f149c0b0a00 0x7f149c06a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:38.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.505+0000 7f149bfff700 1 -- 172.21.15.71:0/2981073144 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c15a330 con 0x7f149c0688d0 2023-10-09T06:43:38.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.505+0000 7f14a0f9b700 1 --2- 172.21.15.71:0/2981073144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f149c157270 0x7f149c068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:38.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.505+0000 7f149bfff700 1 --2- 172.21.15.71:0/2981073144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f149c0688d0 0x7f149c0b04c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f149c06ed10 tx=0x7f1488009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a128a4c8622829a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:38.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.505+0000 7f149b7fe700 1 -- 172.21.15.71:0/2981073144 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148800b860 con 0x7f149c0688d0 2023-10-09T06:43:38.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.505+0000 7f149b7fe700 1 -- 172.21.15.71:0/2981073144 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148800b9c0 con 0x7f149c0688d0 2023-10-09T06:43:38.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.505+0000 7f149b7fe700 1 -- 172.21.15.71:0/2981073144 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148800bd60 con 0x7f149c0688d0 2023-10-09T06:43:38.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.506+0000 7f14a1f9d700 1 -- 172.21.15.71:0/2981073144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f149c0688d0 msgr2=0x7f149c0b04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:38.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.506+0000 7f14a1f9d700 1 --2- 172.21.15.71:0/2981073144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f149c0688d0 0x7f149c0b04c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f149c06ed10 tx=0x7f1488009250 comp rx=0 tx=0).stop 2023-10-09T06:43:38.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.506+0000 7f14a1f9d700 1 -- 172.21.15.71:0/2981073144 shutdown_connections 2023-10-09T06:43:38.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.506+0000 7f14a1f9d700 1 --2- 172.21.15.71:0/2981073144 >> v2:172.21.15.179:3300/0 conn(0x7f149c0b0a00 0x7f149c06a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:38.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.506+0000 7f14a1f9d700 1 --2- 172.21.15.71:0/2981073144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f149c157270 0x7f149c068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:38.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.506+0000 7f14a1f9d700 1 --2- 172.21.15.71:0/2981073144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f149c0688d0 0x7f149c0b04c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:38.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.506+0000 7f14a1f9d700 1 -- 172.21.15.71:0/2981073144 >> 172.21.15.71:0/2981073144 conn(0x7f149c0cd310 msgr2=0x7f149c0cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:38.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.506+0000 7f14a1f9d700 1 -- 172.21.15.71:0/2981073144 shutdown_connections 2023-10-09T06:43:38.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.506+0000 7f14a1f9d700 1 -- 172.21.15.71:0/2981073144 wait complete. 2023-10-09T06:43:38.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.507+0000 7f14a1f9d700 1 Processor -- start 2023-10-09T06:43:38.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.508+0000 7f14a1f9d700 1 -- start start 2023-10-09T06:43:38.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.508+0000 7f14a1f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f149c0688d0 0x7f149c0ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:38.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.508+0000 7f14a1f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f149c0b0a00 0x7f149c16d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:38.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.508+0000 7f14a1f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f149c157270 0x7f149c0acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:38.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.508+0000 7f14a1f9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c16d900 con 0x7f149c157270 2023-10-09T06:43:38.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.508+0000 7f14a1f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c15ce90 con 0x7f149c0688d0 2023-10-09T06:43:38.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.508+0000 7f14a1f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149c15d170 con 0x7f149c0b0a00 2023-10-09T06:43:38.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.509+0000 7f14a179c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f149c157270 0x7f149c0acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:38.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.509+0000 7f14a179c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f149c157270 0x7f149c0acbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37442/0 (socket says 172.21.15.71:37442) 2023-10-09T06:43:38.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.509+0000 7f14a179c700 1 -- 172.21.15.71:0/841420214 learned_addr learned my addr 172.21.15.71:0/841420214 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:38.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.509+0000 7f149bfff700 1 --2- 172.21.15.71:0/841420214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f149c0b0a00 0x7f149c16d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:38.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.509+0000 7f14a0f9b700 1 --2- 172.21.15.71:0/841420214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f149c0688d0 0x7f149c0ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:38.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.509+0000 7f14a179c700 1 -- 172.21.15.71:0/841420214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f149c0b0a00 msgr2=0x7f149c16d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:38.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.509+0000 7f14a179c700 1 --2- 172.21.15.71:0/841420214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f149c0b0a00 0x7f149c16d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:38.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.509+0000 7f14a179c700 1 -- 172.21.15.71:0/841420214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f149c0688d0 msgr2=0x7f149c0ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:38.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.509+0000 7f14a179c700 1 --2- 172.21.15.71:0/841420214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f149c0688d0 0x7f149c0ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:38.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.509+0000 7f14a179c700 1 -- 172.21.15.71:0/841420214 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14880094f0 con 0x7f149c157270 2023-10-09T06:43:38.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.509+0000 7f14a0f9b700 1 --2- 172.21.15.71:0/841420214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f149c0688d0 0x7f149c0ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:38.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.509+0000 7f14a179c700 1 --2- 172.21.15.71:0/841420214 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f149c157270 0x7f149c0acbd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1494009fa0 tx=0x7f1494009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:38.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.509+0000 7f1498ff9700 1 -- 172.21.15.71:0/841420214 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149400ed20 con 0x7f149c157270 2023-10-09T06:43:38.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.509+0000 7f1498ff9700 1 -- 172.21.15.71:0/841420214 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149400ee80 con 0x7f149c157270 2023-10-09T06:43:38.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.510+0000 7f1498ff9700 1 -- 172.21.15.71:0/841420214 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1494014670 con 0x7f149c157270 2023-10-09T06:43:38.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.510+0000 7f14a1f9d700 1 -- 172.21.15.71:0/841420214 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149c15d450 con 0x7f149c157270 2023-10-09T06:43:38.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.510+0000 7f14a1f9d700 1 -- 172.21.15.71:0/841420214 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149c15da10 con 0x7f149c157270 2023-10-09T06:43:38.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.511+0000 7f14a1f9d700 1 -- 172.21.15.71:0/841420214 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f149c04bbe0 con 0x7f149c157270 2023-10-09T06:43:38.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.511+0000 7f1498ff9700 1 -- 172.21.15.71:0/841420214 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14940149e0 con 0x7f149c157270 2023-10-09T06:43:38.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.512+0000 7f1498ff9700 1 --2- 172.21.15.71:0/841420214 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1480066f30 0x7f14800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:38.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.512+0000 7f1498ff9700 1 -- 172.21.15.71:0/841420214 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1494084dc0 con 0x7f149c157270 2023-10-09T06:43:38.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.513+0000 7f14a0f9b700 1 --2- 172.21.15.71:0/841420214 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1480066f30 0x7f14800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:38.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.513+0000 7f14a0f9b700 1 --2- 172.21.15.71:0/841420214 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1480066f30 0x7f14800693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1490006f00 tx=0x7f1490008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:38.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.516+0000 7f1498ff9700 1 -- 172.21.15.71:0/841420214 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1494051f90 con 0x7f149c157270 2023-10-09T06:43:38.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.704+0000 7f14a1f9d700 1 -- 172.21.15.71:0/841420214 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f149c04c3c0 con 0x7f1480066f30 2023-10-09T06:43:38.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.713+0000 7f1498ff9700 1 -- 172.21.15.71:0/841420214 <== mgr.4102 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288692 (secure 0 0 0) 0x7f149c04c3c0 con 0x7f1480066f30 2023-10-09T06:43:38.719 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:38.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.717+0000 7f14a1f9d700 1 -- 172.21.15.71:0/841420214 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1480066f30 msgr2=0x7f14800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:38.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.717+0000 7f14a1f9d700 1 --2- 172.21.15.71:0/841420214 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1480066f30 0x7f14800693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1490006f00 tx=0x7f1490008040 comp rx=0 tx=0).stop 2023-10-09T06:43:38.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.717+0000 7f14a1f9d700 1 -- 172.21.15.71:0/841420214 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f149c157270 msgr2=0x7f149c0acbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:38.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.717+0000 7f14a1f9d700 1 --2- 172.21.15.71:0/841420214 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f149c157270 0x7f149c0acbd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1494009fa0 tx=0x7f1494009900 comp rx=0 tx=0).stop 2023-10-09T06:43:38.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.717+0000 7f14a1f9d700 1 -- 172.21.15.71:0/841420214 shutdown_connections 2023-10-09T06:43:38.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.717+0000 7f14a1f9d700 1 --2- 172.21.15.71:0/841420214 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1480066f30 0x7f14800693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:38.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.717+0000 7f14a1f9d700 1 --2- 172.21.15.71:0/841420214 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f149c157270 0x7f149c0acbd0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:38.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.717+0000 7f14a1f9d700 1 --2- 172.21.15.71:0/841420214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f149c0688d0 0x7f149c0ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:38.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.717+0000 7f14a1f9d700 1 --2- 172.21.15.71:0/841420214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f149c0b0a00 0x7f149c16d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:38.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.717+0000 7f14a1f9d700 1 -- 172.21.15.71:0/841420214 >> 172.21.15.71:0/841420214 conn(0x7f149c0cd310 msgr2=0x7f149c1563e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:38.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.717+0000 7f14a1f9d700 1 -- 172.21.15.71:0/841420214 shutdown_connections 2023-10-09T06:43:38.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:38.717+0000 7f14a1f9d700 1 -- 172.21.15.71:0/841420214 wait complete. 2023-10-09T06:43:38.723 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:43:38.735 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2023-10-09T06:43:38.559608+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382344,"kb_used_data":4040,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592376,"statfs":{"total":773094113280,"available":770654593024,"internally_reserved":0,"allocated":4136960,"data_stored":2300140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.996146"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.611545+0000","last_change":"2023-10-09T06:43:32.608684+0000","last_active":"2023-10-09T06:43:32.611545+0000","last_peered":"2023-10-09T06:43:32.611545+0000","last_clean":"2023-10-09T06:43:32.611545+0000","last_became_active":"2023-10-09T06:43:32.608415+0000","last_became_peered":"2023-10-09T06:43:32.608415+0000","last_unstale":"2023-10-09T06:43:32.611545+0000","last_undegraded":"2023-10-09T06:43:32.611545+0000","last_fullsized":"2023-10-09T06:43:32.611545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:41.827957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.600778+0000","last_change":"2023-10-09T06:43:32.596455+0000","last_active":"2023-10-09T06:43:32.600778+0000","last_peered":"2023-10-09T06:43:32.600778+0000","last_clean":"2023-10-09T06:43:32.600778+0000","last_became_active":"2023-10-09T06:43:32.596191+0000","last_became_peered":"2023-10-09T06:43:32.596191+0000","last_unstale":"2023-10-09T06:43:32.600778+0000","last_undegraded":"2023-10-09T06:43:32.600778+0000","last_fullsized":"2023-10-09T06:43:32.600778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:05.782825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.615591+0000","last_change":"2023-10-09T06:43:32.613779+0000","last_active":"2023-10-09T06:43:32.615591+0000","last_peered":"2023-10-09T06:43:32.615591+0000","last_clean":"2023-10-09T06:43:32.615591+0000","last_became_active":"2023-10-09T06:43:32.613479+0000","last_became_peered":"2023-10-09T06:43:32.613479+0000","last_unstale":"2023-10-09T06:43:32.615591+0000","last_undegraded":"2023-10-09T06:43:32.615591+0000","last_fullsized":"2023-10-09T06:43:32.615591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:00:35.415369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.616648+0000","last_change":"2023-10-09T06:43:32.608672+0000","last_active":"2023-10-09T06:43:32.616648+0000","last_peered":"2023-10-09T06:43:32.616648+0000","last_clean":"2023-10-09T06:43:32.616648+0000","last_became_active":"2023-10-09T06:43:32.608426+0000","last_became_peered":"2023-10-09T06:43:32.608426+0000","last_unstale":"2023-10-09T06:43:32.616648+0000","last_undegraded":"2023-10-09T06:43:32.616648+0000","last_fullsized":"2023-10-09T06:43:32.616648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:34.388845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.605791+0000","last_change":"2023-10-09T06:43:32.599088+0000","last_active":"2023-10-09T06:43:32.605791+0000","last_peered":"2023-10-09T06:43:32.605791+0000","last_clean":"2023-10-09T06:43:32.605791+0000","last_became_active":"2023-10-09T06:43:32.598827+0000","last_became_peered":"2023-10-09T06:43:32.598827+0000","last_unstale":"2023-10-09T06:43:32.605791+0000","last_undegraded":"2023-10-09T06:43:32.605791+0000","last_fullsized":"2023-10-09T06:43:32.605791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:13:00.794543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.606851+0000","last_change":"2023-10-09T06:43:32.600491+0000","last_active":"2023-10-09T06:43:32.606851+0000","last_peered":"2023-10-09T06:43:32.606851+0000","last_clean":"2023-10-09T06:43:32.606851+0000","last_became_active":"2023-10-09T06:43:32.600303+0000","last_became_peered":"2023-10-09T06:43:32.600303+0000","last_unstale":"2023-10-09T06:43:32.606851+0000","last_undegraded":"2023-10-09T06:43:32.606851+0000","last_fullsized":"2023-10-09T06:43:32.606851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:17.258894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.606938+0000","last_change":"2023-10-09T06:43:32.600310+0000","last_active":"2023-10-09T06:43:32.606938+0000","last_peered":"2023-10-09T06:43:32.606938+0000","last_clean":"2023-10-09T06:43:32.606938+0000","last_became_active":"2023-10-09T06:43:32.600056+0000","last_became_peered":"2023-10-09T06:43:32.600056+0000","last_unstale":"2023-10-09T06:43:32.606938+0000","last_undegraded":"2023-10-09T06:43:32.606938+0000","last_fullsized":"2023-10-09T06:43:32.606938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:41.827957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.606006+0000","last_change":"2023-10-09T06:43:32.602153+0000","last_active":"2023-10-09T06:43:32.606006+0000","last_peered":"2023-10-09T06:43:32.606006+0000","last_clean":"2023-10-09T06:43:32.606006+0000","last_became_active":"2023-10-09T06:43:32.601897+0000","last_became_peered":"2023-10-09T06:43:32.601897+0000","last_unstale":"2023-10-09T06:43:32.606006+0000","last_undegraded":"2023-10-09T06:43:32.606006+0000","last_fullsized":"2023-10-09T06:43:32.606006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:26:14.972288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.615231+0000","last_change":"2023-10-09T06:43:32.609879+0000","last_active":"2023-10-09T06:43:32.615231+0000","last_peered":"2023-10-09T06:43:32.615231+0000","last_clean":"2023-10-09T06:43:32.615231+0000","last_became_active":"2023-10-09T06:43:32.609550+0000","last_became_peered":"2023-10-09T06:43:32.609550+0000","last_unstale":"2023-10-09T06:43:32.615231+0000","last_undegraded":"2023-10-09T06:43:32.615231+0000","last_fullsized":"2023-10-09T06:43:32.615231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:15:24.986946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.616729+0000","last_change":"2023-10-09T06:43:32.603669+0000","last_active":"2023-10-09T06:43:32.616729+0000","last_peered":"2023-10-09T06:43:32.616729+0000","last_clean":"2023-10-09T06:43:32.616729+0000","last_became_active":"2023-10-09T06:43:32.603356+0000","last_became_peered":"2023-10-09T06:43:32.603356+0000","last_unstale":"2023-10-09T06:43:32.616729+0000","last_undegraded":"2023-10-09T06:43:32.616729+0000","last_fullsized":"2023-10-09T06:43:32.616729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:17.258894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.615385+0000","last_change":"2023-10-09T06:43:32.614024+0000","last_active":"2023-10-09T06:43:32.615385+0000","last_peered":"2023-10-09T06:43:32.615385+0000","last_clean":"2023-10-09T06:43:32.615385+0000","last_became_active":"2023-10-09T06:43:32.613706+0000","last_became_peered":"2023-10-09T06:43:32.613706+0000","last_unstale":"2023-10-09T06:43:32.615385+0000","last_undegraded":"2023-10-09T06:43:32.615385+0000","last_fullsized":"2023-10-09T06:43:32.615385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:00.654956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.609286+0000","last_change":"2023-10-09T06:43:32.602539+0000","last_active":"2023-10-09T06:43:32.609286+0000","last_peered":"2023-10-09T06:43:32.609286+0000","last_clean":"2023-10-09T06:43:32.609286+0000","last_became_active":"2023-10-09T06:43:32.602190+0000","last_became_peered":"2023-10-09T06:43:32.602190+0000","last_unstale":"2023-10-09T06:43:32.609286+0000","last_undegraded":"2023-10-09T06:43:32.609286+0000","last_fullsized":"2023-10-09T06:43:32.609286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:30:04.650694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.616458+0000","last_change":"2023-10-09T06:43:32.614724+0000","last_active":"2023-10-09T06:43:32.616458+0000","last_peered":"2023-10-09T06:43:32.616458+0000","last_clean":"2023-10-09T06:43:32.616458+0000","last_became_active":"2023-10-09T06:43:32.614479+0000","last_became_peered":"2023-10-09T06:43:32.614479+0000","last_unstale":"2023-10-09T06:43:32.616458+0000","last_undegraded":"2023-10-09T06:43:32.616458+0000","last_fullsized":"2023-10-09T06:43:32.616458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:19:59.340814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.600960+0000","last_change":"2023-10-09T06:43:32.593796+0000","last_active":"2023-10-09T06:43:32.600960+0000","last_peered":"2023-10-09T06:43:32.600960+0000","last_clean":"2023-10-09T06:43:32.600960+0000","last_became_active":"2023-10-09T06:43:32.593502+0000","last_became_peered":"2023-10-09T06:43:32.593502+0000","last_unstale":"2023-10-09T06:43:32.600960+0000","last_undegraded":"2023-10-09T06:43:32.600960+0000","last_fullsized":"2023-10-09T06:43:32.600960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:28:34.180710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.608341+0000","last_change":"2023-10-09T06:43:32.597658+0000","last_active":"2023-10-09T06:43:32.608341+0000","last_peered":"2023-10-09T06:43:32.608341+0000","last_clean":"2023-10-09T06:43:32.608341+0000","last_became_active":"2023-10-09T06:43:32.597364+0000","last_became_peered":"2023-10-09T06:43:32.597364+0000","last_unstale":"2023-10-09T06:43:32.608341+0000","last_undegraded":"2023-10-09T06:43:32.608341+0000","last_fullsized":"2023-10-09T06:43:32.608341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:34.388845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.606025+0000","last_change":"2023-10-09T06:43:32.602327+0000","last_active":"2023-10-09T06:43:32.606025+0000","last_peered":"2023-10-09T06:43:32.606025+0000","last_clean":"2023-10-09T06:43:32.606025+0000","last_became_active":"2023-10-09T06:43:32.602050+0000","last_became_peered":"2023-10-09T06:43:32.602050+0000","last_unstale":"2023-10-09T06:43:32.606025+0000","last_undegraded":"2023-10-09T06:43:32.606025+0000","last_fullsized":"2023-10-09T06:43:32.606025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:15:13.252714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.599386+0000","last_change":"2023-10-09T06:43:32.597778+0000","last_active":"2023-10-09T06:43:32.599386+0000","last_peered":"2023-10-09T06:43:32.599386+0000","last_clean":"2023-10-09T06:43:32.599386+0000","last_became_active":"2023-10-09T06:43:32.597515+0000","last_became_peered":"2023-10-09T06:43:32.597515+0000","last_unstale":"2023-10-09T06:43:32.599386+0000","last_undegraded":"2023-10-09T06:43:32.599386+0000","last_fullsized":"2023-10-09T06:43:32.599386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:49.546526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.607104+0000","last_change":"2023-10-09T06:43:32.604582+0000","last_active":"2023-10-09T06:43:32.607104+0000","last_peered":"2023-10-09T06:43:32.607104+0000","last_clean":"2023-10-09T06:43:32.607104+0000","last_became_active":"2023-10-09T06:43:32.604303+0000","last_became_peered":"2023-10-09T06:43:32.604303+0000","last_unstale":"2023-10-09T06:43:32.607104+0000","last_undegraded":"2023-10-09T06:43:32.607104+0000","last_fullsized":"2023-10-09T06:43:32.607104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:20.764820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.617960+0000","last_change":"2023-10-09T06:43:32.612073+0000","last_active":"2023-10-09T06:43:32.617960+0000","last_peered":"2023-10-09T06:43:32.617960+0000","last_clean":"2023-10-09T06:43:32.617960+0000","last_became_active":"2023-10-09T06:43:32.611800+0000","last_became_peered":"2023-10-09T06:43:32.611800+0000","last_unstale":"2023-10-09T06:43:32.617960+0000","last_undegraded":"2023-10-09T06:43:32.617960+0000","last_fullsized":"2023-10-09T06:43:32.617960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:23:20.441286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.617158+0000","last_change":"2023-10-09T06:43:32.611760+0000","last_active":"2023-10-09T06:43:32.617158+0000","last_peered":"2023-10-09T06:43:32.617158+0000","last_clean":"2023-10-09T06:43:32.617158+0000","last_became_active":"2023-10-09T06:43:32.611479+0000","last_became_peered":"2023-10-09T06:43:32.611479+0000","last_unstale":"2023-10-09T06:43:32.617158+0000","last_undegraded":"2023-10-09T06:43:32.617158+0000","last_fullsized":"2023-10-09T06:43:32.617158+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:44:09.277702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.592779+0000","last_change":"2023-10-09T06:43:32.588123+0000","last_active":"2023-10-09T06:43:32.592779+0000","last_peered":"2023-10-09T06:43:32.592779+0000","last_clean":"2023-10-09T06:43:32.592779+0000","last_became_active":"2023-10-09T06:43:32.587825+0000","last_became_peered":"2023-10-09T06:43:32.587825+0000","last_unstale":"2023-10-09T06:43:32.592779+0000","last_undegraded":"2023-10-09T06:43:32.592779+0000","last_fullsized":"2023-10-09T06:43:32.592779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:43:56.155101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.596549+0000","last_change":"2023-10-09T06:43:32.592067+0000","last_active":"2023-10-09T06:43:32.596549+0000","last_peered":"2023-10-09T06:43:32.596549+0000","last_clean":"2023-10-09T06:43:32.596549+0000","last_became_active":"2023-10-09T06:43:32.590636+0000","last_became_peered":"2023-10-09T06:43:32.590636+0000","last_unstale":"2023-10-09T06:43:32.596549+0000","last_undegraded":"2023-10-09T06:43:32.596549+0000","last_fullsized":"2023-10-09T06:43:32.596549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:41.827957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.599400+0000","last_change":"2023-10-09T06:43:32.593988+0000","last_active":"2023-10-09T06:43:32.599400+0000","last_peered":"2023-10-09T06:43:32.599400+0000","last_clean":"2023-10-09T06:43:32.599400+0000","last_became_active":"2023-10-09T06:43:32.593693+0000","last_became_peered":"2023-10-09T06:43:32.593693+0000","last_unstale":"2023-10-09T06:43:32.599400+0000","last_undegraded":"2023-10-09T06:43:32.599400+0000","last_fullsized":"2023-10-09T06:43:32.599400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:11.622961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.607906+0000","last_change":"2023-10-09T06:43:32.595286+0000","last_active":"2023-10-09T06:43:32.607906+0000","last_peered":"2023-10-09T06:43:32.607906+0000","last_clean":"2023-10-09T06:43:32.607906+0000","last_became_active":"2023-10-09T06:43:32.595045+0000","last_became_peered":"2023-10-09T06:43:32.595045+0000","last_unstale":"2023-10-09T06:43:32.607906+0000","last_undegraded":"2023-10-09T06:43:32.607906+0000","last_fullsized":"2023-10-09T06:43:32.607906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:17.258894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.616914+0000","last_change":"2023-10-09T06:43:32.607636+0000","last_active":"2023-10-09T06:43:32.616914+0000","last_peered":"2023-10-09T06:43:32.616914+0000","last_clean":"2023-10-09T06:43:32.616914+0000","last_became_active":"2023-10-09T06:43:32.607276+0000","last_became_peered":"2023-10-09T06:43:32.607276+0000","last_unstale":"2023-10-09T06:43:32.616914+0000","last_undegraded":"2023-10-09T06:43:32.616914+0000","last_fullsized":"2023-10-09T06:43:32.616914+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:23.043125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.607086+0000","last_change":"2023-10-09T06:43:32.600330+0000","last_active":"2023-10-09T06:43:32.607086+0000","last_peered":"2023-10-09T06:43:32.607086+0000","last_clean":"2023-10-09T06:43:32.607086+0000","last_became_active":"2023-10-09T06:43:32.600050+0000","last_became_peered":"2023-10-09T06:43:32.600050+0000","last_unstale":"2023-10-09T06:43:32.607086+0000","last_undegraded":"2023-10-09T06:43:32.607086+0000","last_fullsized":"2023-10-09T06:43:32.607086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:46:52.659669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.616955+0000","last_change":"2023-10-09T06:43:32.608311+0000","last_active":"2023-10-09T06:43:32.616955+0000","last_peered":"2023-10-09T06:43:32.616955+0000","last_clean":"2023-10-09T06:43:32.616955+0000","last_became_active":"2023-10-09T06:43:32.608046+0000","last_became_peered":"2023-10-09T06:43:32.608046+0000","last_unstale":"2023-10-09T06:43:32.616955+0000","last_undegraded":"2023-10-09T06:43:32.616955+0000","last_fullsized":"2023-10-09T06:43:32.616955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:37:21.561094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.595224+0000","last_change":"2023-10-09T06:43:32.585763+0000","last_active":"2023-10-09T06:43:32.595224+0000","last_peered":"2023-10-09T06:43:32.595224+0000","last_clean":"2023-10-09T06:43:32.595224+0000","last_became_active":"2023-10-09T06:43:32.585466+0000","last_became_peered":"2023-10-09T06:43:32.585466+0000","last_unstale":"2023-10-09T06:43:32.595224+0000","last_undegraded":"2023-10-09T06:43:32.595224+0000","last_fullsized":"2023-10-09T06:43:32.595224+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:37:21.561094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.603837+0000","last_change":"2023-10-09T06:43:32.596860+0000","last_active":"2023-10-09T06:43:32.603837+0000","last_peered":"2023-10-09T06:43:32.603837+0000","last_clean":"2023-10-09T06:43:32.603837+0000","last_became_active":"2023-10-09T06:43:32.596531+0000","last_became_peered":"2023-10-09T06:43:32.596531+0000","last_unstale":"2023-10-09T06:43:32.603837+0000","last_undegraded":"2023-10-09T06:43:32.603837+0000","last_fullsized":"2023-10-09T06:43:32.603837+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:48.954261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.606906+0000","last_change":"2023-10-09T06:43:32.599866+0000","last_active":"2023-10-09T06:43:32.606906+0000","last_peered":"2023-10-09T06:43:32.606906+0000","last_clean":"2023-10-09T06:43:32.606906+0000","last_became_active":"2023-10-09T06:43:32.599329+0000","last_became_peered":"2023-10-09T06:43:32.599329+0000","last_unstale":"2023-10-09T06:43:32.606906+0000","last_undegraded":"2023-10-09T06:43:32.606906+0000","last_fullsized":"2023-10-09T06:43:32.606906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:48.954261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.606448+0000","last_change":"2023-10-09T06:43:32.600806+0000","last_active":"2023-10-09T06:43:32.606448+0000","last_peered":"2023-10-09T06:43:32.606448+0000","last_clean":"2023-10-09T06:43:32.606448+0000","last_became_active":"2023-10-09T06:43:32.600509+0000","last_became_peered":"2023-10-09T06:43:32.600509+0000","last_unstale":"2023-10-09T06:43:32.606448+0000","last_undegraded":"2023-10-09T06:43:32.606448+0000","last_fullsized":"2023-10-09T06:43:32.606448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:49.546526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.610353+0000","last_change":"2023-10-09T06:43:32.605070+0000","last_active":"2023-10-09T06:43:32.610353+0000","last_peered":"2023-10-09T06:43:32.610353+0000","last_clean":"2023-10-09T06:43:32.610353+0000","last_became_active":"2023-10-09T06:43:32.604801+0000","last_became_peered":"2023-10-09T06:43:32.604801+0000","last_unstale":"2023-10-09T06:43:32.610353+0000","last_undegraded":"2023-10-09T06:43:32.610353+0000","last_fullsized":"2023-10-09T06:43:32.610353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:43:56.155101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.600721+0000","last_change":"2023-10-09T06:43:32.597473+0000","last_active":"2023-10-09T06:43:32.600721+0000","last_peered":"2023-10-09T06:43:32.600721+0000","last_clean":"2023-10-09T06:43:32.600721+0000","last_became_active":"2023-10-09T06:43:32.597215+0000","last_became_peered":"2023-10-09T06:43:32.597215+0000","last_unstale":"2023-10-09T06:43:32.600721+0000","last_undegraded":"2023-10-09T06:43:32.600721+0000","last_fullsized":"2023-10-09T06:43:32.600721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:15:24.986946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.611094+0000","last_change":"2023-10-09T06:43:31.588823+0000","last_active":"2023-10-09T06:43:32.611094+0000","last_peered":"2023-10-09T06:43:32.611094+0000","last_clean":"2023-10-09T06:43:32.611094+0000","last_became_active":"2023-10-09T06:43:31.588554+0000","last_became_peered":"2023-10-09T06:43:31.588554+0000","last_unstale":"2023-10-09T06:43:32.611094+0000","last_undegraded":"2023-10-09T06:43:32.611094+0000","last_fullsized":"2023-10-09T06:43:32.611094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:56.343954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.610397+0000","last_change":"2023-10-09T06:43:32.605854+0000","last_active":"2023-10-09T06:43:32.610397+0000","last_peered":"2023-10-09T06:43:32.610397+0000","last_clean":"2023-10-09T06:43:32.610397+0000","last_became_active":"2023-10-09T06:43:32.605561+0000","last_became_peered":"2023-10-09T06:43:32.605561+0000","last_unstale":"2023-10-09T06:43:32.610397+0000","last_undegraded":"2023-10-09T06:43:32.610397+0000","last_fullsized":"2023-10-09T06:43:32.610397+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:15:24.986946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.610952+0000","last_change":"2023-10-09T06:43:31.580770+0000","last_active":"2023-10-09T06:43:32.610952+0000","last_peered":"2023-10-09T06:43:32.610952+0000","last_clean":"2023-10-09T06:43:32.610952+0000","last_became_active":"2023-10-09T06:43:31.580483+0000","last_became_peered":"2023-10-09T06:43:31.580483+0000","last_unstale":"2023-10-09T06:43:32.610952+0000","last_undegraded":"2023-10-09T06:43:32.610952+0000","last_fullsized":"2023-10-09T06:43:32.610952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:56.343954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.606540+0000","last_change":"2023-10-09T06:43:32.603722+0000","last_active":"2023-10-09T06:43:32.606540+0000","last_peered":"2023-10-09T06:43:32.606540+0000","last_clean":"2023-10-09T06:43:32.606540+0000","last_became_active":"2023-10-09T06:43:32.603439+0000","last_became_peered":"2023-10-09T06:43:32.603439+0000","last_unstale":"2023-10-09T06:43:32.606540+0000","last_undegraded":"2023-10-09T06:43:32.606540+0000","last_fullsized":"2023-10-09T06:43:32.606540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:16.764212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.619099+0000","last_change":"2023-10-09T06:43:31.591561+0000","last_active":"2023-10-09T06:43:32.619099+0000","last_peered":"2023-10-09T06:43:32.619099+0000","last_clean":"2023-10-09T06:43:32.619099+0000","last_became_active":"2023-10-09T06:43:31.591261+0000","last_became_peered":"2023-10-09T06:43:31.591261+0000","last_unstale":"2023-10-09T06:43:32.619099+0000","last_undegraded":"2023-10-09T06:43:32.619099+0000","last_fullsized":"2023-10-09T06:43:32.619099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:27.198306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.616975+0000","last_change":"2023-10-09T06:43:32.608335+0000","last_active":"2023-10-09T06:43:32.616975+0000","last_peered":"2023-10-09T06:43:32.616975+0000","last_clean":"2023-10-09T06:43:32.616975+0000","last_became_active":"2023-10-09T06:43:32.608089+0000","last_became_peered":"2023-10-09T06:43:32.608089+0000","last_unstale":"2023-10-09T06:43:32.616975+0000","last_undegraded":"2023-10-09T06:43:32.616975+0000","last_fullsized":"2023-10-09T06:43:32.616975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:58.469035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.617493+0000","last_change":"2023-10-09T06:43:31.581224+0000","last_active":"2023-10-09T06:43:32.617493+0000","last_peered":"2023-10-09T06:43:32.617493+0000","last_clean":"2023-10-09T06:43:32.617493+0000","last_became_active":"2023-10-09T06:43:31.580851+0000","last_became_peered":"2023-10-09T06:43:31.580851+0000","last_unstale":"2023-10-09T06:43:32.617493+0000","last_undegraded":"2023-10-09T06:43:32.617493+0000","last_fullsized":"2023-10-09T06:43:32.617493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:07.887852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.610234+0000","last_change":"2023-10-09T06:43:32.604094+0000","last_active":"2023-10-09T06:43:32.610234+0000","last_peered":"2023-10-09T06:43:32.610234+0000","last_clean":"2023-10-09T06:43:32.610234+0000","last_became_active":"2023-10-09T06:43:32.603857+0000","last_became_peered":"2023-10-09T06:43:32.603857+0000","last_unstale":"2023-10-09T06:43:32.610234+0000","last_undegraded":"2023-10-09T06:43:32.610234+0000","last_fullsized":"2023-10-09T06:43:32.610234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:58.469035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.614280+0000","last_change":"2023-10-09T06:43:31.585382+0000","last_active":"2023-10-09T06:43:32.614280+0000","last_peered":"2023-10-09T06:43:32.614280+0000","last_clean":"2023-10-09T06:43:32.614280+0000","last_became_active":"2023-10-09T06:43:31.585083+0000","last_became_peered":"2023-10-09T06:43:31.585083+0000","last_unstale":"2023-10-09T06:43:32.614280+0000","last_undegraded":"2023-10-09T06:43:32.614280+0000","last_fullsized":"2023-10-09T06:43:32.614280+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:56.343954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.595342+0000","last_change":"2023-10-09T06:43:32.586115+0000","last_active":"2023-10-09T06:43:32.595342+0000","last_peered":"2023-10-09T06:43:32.595342+0000","last_clean":"2023-10-09T06:43:32.595342+0000","last_became_active":"2023-10-09T06:43:32.585591+0000","last_became_peered":"2023-10-09T06:43:32.585591+0000","last_unstale":"2023-10-09T06:43:32.595342+0000","last_undegraded":"2023-10-09T06:43:32.595342+0000","last_fullsized":"2023-10-09T06:43:32.595342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:26:14.972288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.615113+0000","last_change":"2023-10-09T06:43:31.585289+0000","last_active":"2023-10-09T06:43:32.615113+0000","last_peered":"2023-10-09T06:43:32.615113+0000","last_clean":"2023-10-09T06:43:32.615113+0000","last_became_active":"2023-10-09T06:43:31.584990+0000","last_became_peered":"2023-10-09T06:43:31.584990+0000","last_unstale":"2023-10-09T06:43:32.615113+0000","last_undegraded":"2023-10-09T06:43:32.615113+0000","last_fullsized":"2023-10-09T06:43:32.615113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:19:58.338127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.603610+0000","last_change":"2023-10-09T06:43:32.597781+0000","last_active":"2023-10-09T06:43:32.603610+0000","last_peered":"2023-10-09T06:43:32.603610+0000","last_clean":"2023-10-09T06:43:32.603610+0000","last_became_active":"2023-10-09T06:43:32.597479+0000","last_became_peered":"2023-10-09T06:43:32.597479+0000","last_unstale":"2023-10-09T06:43:32.603610+0000","last_undegraded":"2023-10-09T06:43:32.603610+0000","last_fullsized":"2023-10-09T06:43:32.603610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:11.622961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.583772+0000","last_change":"2023-10-09T06:43:31.587212+0000","last_active":"2023-10-09T06:43:32.583772+0000","last_peered":"2023-10-09T06:43:32.583772+0000","last_clean":"2023-10-09T06:43:32.583772+0000","last_became_active":"2023-10-09T06:43:31.586951+0000","last_became_peered":"2023-10-09T06:43:31.586951+0000","last_unstale":"2023-10-09T06:43:32.583772+0000","last_undegraded":"2023-10-09T06:43:32.583772+0000","last_fullsized":"2023-10-09T06:43:32.583772+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:15:23.984259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.616591+0000","last_change":"2023-10-09T06:43:32.603530+0000","last_active":"2023-10-09T06:43:32.616591+0000","last_peered":"2023-10-09T06:43:32.616591+0000","last_clean":"2023-10-09T06:43:32.616591+0000","last_became_active":"2023-10-09T06:43:32.603262+0000","last_became_peered":"2023-10-09T06:43:32.603262+0000","last_unstale":"2023-10-09T06:43:32.616591+0000","last_undegraded":"2023-10-09T06:43:32.616591+0000","last_fullsized":"2023-10-09T06:43:32.616591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:15:13.252714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.579373+0000","last_change":"2023-10-09T06:43:31.582874+0000","last_active":"2023-10-09T06:43:32.579373+0000","last_peered":"2023-10-09T06:43:32.579373+0000","last_clean":"2023-10-09T06:43:32.579373+0000","last_became_active":"2023-10-09T06:43:31.582615+0000","last_became_peered":"2023-10-09T06:43:31.582615+0000","last_unstale":"2023-10-09T06:43:32.579373+0000","last_undegraded":"2023-10-09T06:43:32.579373+0000","last_fullsized":"2023-10-09T06:43:32.579373+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:15:09.963486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.608025+0000","last_change":"2023-10-09T06:43:32.597230+0000","last_active":"2023-10-09T06:43:32.608025+0000","last_peered":"2023-10-09T06:43:32.608025+0000","last_clean":"2023-10-09T06:43:32.608025+0000","last_became_active":"2023-10-09T06:43:32.596921+0000","last_became_peered":"2023-10-09T06:43:32.596921+0000","last_unstale":"2023-10-09T06:43:32.608025+0000","last_undegraded":"2023-10-09T06:43:32.608025+0000","last_fullsized":"2023-10-09T06:43:32.608025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:23:20.441286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.584805+0000","last_change":"2023-10-09T06:43:31.584657+0000","last_active":"2023-10-09T06:43:32.584805+0000","last_peered":"2023-10-09T06:43:32.584805+0000","last_clean":"2023-10-09T06:43:32.584805+0000","last_became_active":"2023-10-09T06:43:31.584392+0000","last_became_peered":"2023-10-09T06:43:31.584392+0000","last_unstale":"2023-10-09T06:43:32.584805+0000","last_undegraded":"2023-10-09T06:43:32.584805+0000","last_fullsized":"2023-10-09T06:43:32.584805+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:17.299314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.611950+0000","last_change":"2023-10-09T06:43:32.609687+0000","last_active":"2023-10-09T06:43:32.611950+0000","last_peered":"2023-10-09T06:43:32.611950+0000","last_clean":"2023-10-09T06:43:32.611950+0000","last_became_active":"2023-10-09T06:43:32.609446+0000","last_became_peered":"2023-10-09T06:43:32.609446+0000","last_unstale":"2023-10-09T06:43:32.611950+0000","last_undegraded":"2023-10-09T06:43:32.611950+0000","last_fullsized":"2023-10-09T06:43:32.611950+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:54.977377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.578960+0000","last_change":"2023-10-09T06:43:31.582543+0000","last_active":"2023-10-09T06:43:32.578960+0000","last_peered":"2023-10-09T06:43:32.578960+0000","last_clean":"2023-10-09T06:43:32.578960+0000","last_became_active":"2023-10-09T06:43:31.582274+0000","last_became_peered":"2023-10-09T06:43:31.582274+0000","last_unstale":"2023-10-09T06:43:32.578960+0000","last_undegraded":"2023-10-09T06:43:32.578960+0000","last_fullsized":"2023-10-09T06:43:32.578960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:54.482393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.600935+0000","last_change":"2023-10-09T06:43:32.594622+0000","last_active":"2023-10-09T06:43:32.600935+0000","last_peered":"2023-10-09T06:43:32.600935+0000","last_clean":"2023-10-09T06:43:32.600935+0000","last_became_active":"2023-10-09T06:43:32.594271+0000","last_became_peered":"2023-10-09T06:43:32.594271+0000","last_unstale":"2023-10-09T06:43:32.600935+0000","last_undegraded":"2023-10-09T06:43:32.600935+0000","last_fullsized":"2023-10-09T06:43:32.600935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:34.388845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.610601+0000","last_change":"2023-10-09T06:43:31.581601+0000","last_active":"2023-10-09T06:43:32.610601+0000","last_peered":"2023-10-09T06:43:32.610601+0000","last_clean":"2023-10-09T06:43:32.610601+0000","last_became_active":"2023-10-09T06:43:31.581330+0000","last_became_peered":"2023-10-09T06:43:31.581330+0000","last_unstale":"2023-10-09T06:43:32.610601+0000","last_undegraded":"2023-10-09T06:43:32.610601+0000","last_fullsized":"2023-10-09T06:43:32.610601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:26.901120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.615580+0000","last_change":"2023-10-09T06:43:32.614024+0000","last_active":"2023-10-09T06:43:32.615580+0000","last_peered":"2023-10-09T06:43:32.615580+0000","last_clean":"2023-10-09T06:43:32.615580+0000","last_became_active":"2023-10-09T06:43:32.613543+0000","last_became_peered":"2023-10-09T06:43:32.613543+0000","last_unstale":"2023-10-09T06:43:32.615580+0000","last_undegraded":"2023-10-09T06:43:32.615580+0000","last_fullsized":"2023-10-09T06:43:32.615580+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:46:52.659669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.625297+0000","last_change":"2023-10-09T06:43:31.591755+0000","last_active":"2023-10-09T06:43:32.625297+0000","last_peered":"2023-10-09T06:43:32.625297+0000","last_clean":"2023-10-09T06:43:32.625297+0000","last_became_active":"2023-10-09T06:43:31.591271+0000","last_became_peered":"2023-10-09T06:43:31.591271+0000","last_unstale":"2023-10-09T06:43:32.625297+0000","last_undegraded":"2023-10-09T06:43:32.625297+0000","last_fullsized":"2023-10-09T06:43:32.625297+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:26.901120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.618409+0000","last_change":"2023-10-09T06:43:32.613044+0000","last_active":"2023-10-09T06:43:32.618409+0000","last_peered":"2023-10-09T06:43:32.618409+0000","last_clean":"2023-10-09T06:43:32.618409+0000","last_became_active":"2023-10-09T06:43:32.612768+0000","last_became_peered":"2023-10-09T06:43:32.612768+0000","last_unstale":"2023-10-09T06:43:32.618409+0000","last_undegraded":"2023-10-09T06:43:32.618409+0000","last_fullsized":"2023-10-09T06:43:32.618409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:26:14.972288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.614866+0000","last_change":"2023-10-09T06:43:31.581530+0000","last_active":"2023-10-09T06:43:32.614866+0000","last_peered":"2023-10-09T06:43:32.614866+0000","last_clean":"2023-10-09T06:43:32.614866+0000","last_became_active":"2023-10-09T06:43:31.580810+0000","last_became_peered":"2023-10-09T06:43:31.580810+0000","last_unstale":"2023-10-09T06:43:32.614866+0000","last_undegraded":"2023-10-09T06:43:32.614866+0000","last_fullsized":"2023-10-09T06:43:32.614866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:44:08.275015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.600900+0000","last_change":"2023-10-09T06:43:32.598595+0000","last_active":"2023-10-09T06:43:32.600900+0000","last_peered":"2023-10-09T06:43:32.600900+0000","last_clean":"2023-10-09T06:43:32.600900+0000","last_became_active":"2023-10-09T06:43:32.598302+0000","last_became_peered":"2023-10-09T06:43:32.598302+0000","last_unstale":"2023-10-09T06:43:32.600900+0000","last_undegraded":"2023-10-09T06:43:32.600900+0000","last_fullsized":"2023-10-09T06:43:32.600900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:15:13.252714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.595665+0000","last_change":"2023-10-09T06:43:31.583715+0000","last_active":"2023-10-09T06:43:32.595665+0000","last_peered":"2023-10-09T06:43:32.595665+0000","last_clean":"2023-10-09T06:43:32.595665+0000","last_became_active":"2023-10-09T06:43:31.583119+0000","last_became_peered":"2023-10-09T06:43:31.583119+0000","last_unstale":"2023-10-09T06:43:32.595665+0000","last_undegraded":"2023-10-09T06:43:32.595665+0000","last_fullsized":"2023-10-09T06:43:32.595665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:58.292619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.610335+0000","last_change":"2023-10-09T06:43:32.605032+0000","last_active":"2023-10-09T06:43:32.610335+0000","last_peered":"2023-10-09T06:43:32.610335+0000","last_clean":"2023-10-09T06:43:32.610335+0000","last_became_active":"2023-10-09T06:43:32.604751+0000","last_became_peered":"2023-10-09T06:43:32.604751+0000","last_unstale":"2023-10-09T06:43:32.610335+0000","last_undegraded":"2023-10-09T06:43:32.610335+0000","last_fullsized":"2023-10-09T06:43:32.610335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:23.043125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.583879+0000","last_change":"2023-10-09T06:43:31.585275+0000","last_active":"2023-10-09T06:43:32.583879+0000","last_peered":"2023-10-09T06:43:32.583879+0000","last_clean":"2023-10-09T06:43:32.583879+0000","last_became_active":"2023-10-09T06:43:31.584989+0000","last_became_peered":"2023-10-09T06:43:31.584989+0000","last_unstale":"2023-10-09T06:43:32.583879+0000","last_undegraded":"2023-10-09T06:43:32.583879+0000","last_fullsized":"2023-10-09T06:43:32.583879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:36.418185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.605787+0000","last_change":"2023-10-09T06:43:32.597772+0000","last_active":"2023-10-09T06:43:32.605787+0000","last_peered":"2023-10-09T06:43:32.605787+0000","last_clean":"2023-10-09T06:43:32.605787+0000","last_became_active":"2023-10-09T06:43:32.597493+0000","last_became_peered":"2023-10-09T06:43:32.597493+0000","last_unstale":"2023-10-09T06:43:32.605787+0000","last_undegraded":"2023-10-09T06:43:32.605787+0000","last_fullsized":"2023-10-09T06:43:32.605787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:11.622961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.623565+0000","last_change":"2023-10-09T06:43:31.591837+0000","last_active":"2023-10-09T06:43:32.623565+0000","last_peered":"2023-10-09T06:43:32.623565+0000","last_clean":"2023-10-09T06:43:32.623565+0000","last_became_active":"2023-10-09T06:43:31.591583+0000","last_became_peered":"2023-10-09T06:43:31.591583+0000","last_unstale":"2023-10-09T06:43:32.623565+0000","last_undegraded":"2023-10-09T06:43:32.623565+0000","last_fullsized":"2023-10-09T06:43:32.623565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:48.543839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.591708+0000","last_change":"2023-10-09T06:43:32.585788+0000","last_active":"2023-10-09T06:43:32.591708+0000","last_peered":"2023-10-09T06:43:32.591708+0000","last_clean":"2023-10-09T06:43:32.591708+0000","last_became_active":"2023-10-09T06:43:32.585508+0000","last_became_peered":"2023-10-09T06:43:32.585508+0000","last_unstale":"2023-10-09T06:43:32.591708+0000","last_undegraded":"2023-10-09T06:43:32.591708+0000","last_fullsized":"2023-10-09T06:43:32.591708+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:28.200993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.618362+0000","last_change":"2023-10-09T06:43:31.591708+0000","last_active":"2023-10-09T06:43:32.618362+0000","last_peered":"2023-10-09T06:43:32.618362+0000","last_clean":"2023-10-09T06:43:32.618362+0000","last_became_active":"2023-10-09T06:43:31.591444+0000","last_became_peered":"2023-10-09T06:43:31.591444+0000","last_unstale":"2023-10-09T06:43:32.618362+0000","last_undegraded":"2023-10-09T06:43:32.618362+0000","last_fullsized":"2023-10-09T06:43:32.618362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:52.857606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.598256+0000","last_change":"2023-10-09T06:43:32.587025+0000","last_active":"2023-10-09T06:43:32.598256+0000","last_peered":"2023-10-09T06:43:32.598256+0000","last_clean":"2023-10-09T06:43:32.598256+0000","last_became_active":"2023-10-09T06:43:32.586749+0000","last_became_peered":"2023-10-09T06:43:32.586749+0000","last_unstale":"2023-10-09T06:43:32.598256+0000","last_undegraded":"2023-10-09T06:43:32.598256+0000","last_fullsized":"2023-10-09T06:43:32.598256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:15:13.252714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.614123+0000","last_change":"2023-10-09T06:43:31.582200+0000","last_active":"2023-10-09T06:43:32.614123+0000","last_peered":"2023-10-09T06:43:32.614123+0000","last_clean":"2023-10-09T06:43:32.614123+0000","last_became_active":"2023-10-09T06:43:31.581947+0000","last_became_peered":"2023-10-09T06:43:31.581947+0000","last_unstale":"2023-10-09T06:43:32.614123+0000","last_undegraded":"2023-10-09T06:43:32.614123+0000","last_fullsized":"2023-10-09T06:43:32.614123+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:31.583076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.615916+0000","last_change":"2023-10-09T06:43:32.603210+0000","last_active":"2023-10-09T06:43:32.615916+0000","last_peered":"2023-10-09T06:43:32.615916+0000","last_clean":"2023-10-09T06:43:32.615916+0000","last_became_active":"2023-10-09T06:43:32.602881+0000","last_became_peered":"2023-10-09T06:43:32.602881+0000","last_unstale":"2023-10-09T06:43:32.615916+0000","last_undegraded":"2023-10-09T06:43:32.615916+0000","last_fullsized":"2023-10-09T06:43:32.615916+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:43:56.155101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.617479+0000","last_change":"2023-10-09T06:43:31.581221+0000","last_active":"2023-10-09T06:43:32.617479+0000","last_peered":"2023-10-09T06:43:32.617479+0000","last_clean":"2023-10-09T06:43:32.617479+0000","last_became_active":"2023-10-09T06:43:31.580923+0000","last_became_peered":"2023-10-09T06:43:31.580923+0000","last_unstale":"2023-10-09T06:43:32.617479+0000","last_undegraded":"2023-10-09T06:43:32.617479+0000","last_fullsized":"2023-10-09T06:43:32.617479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:43.384282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.605202+0000","last_change":"2023-10-09T06:43:32.598532+0000","last_active":"2023-10-09T06:43:32.605202+0000","last_peered":"2023-10-09T06:43:32.605202+0000","last_clean":"2023-10-09T06:43:32.605202+0000","last_became_active":"2023-10-09T06:43:32.598214+0000","last_became_peered":"2023-10-09T06:43:32.598214+0000","last_unstale":"2023-10-09T06:43:32.605202+0000","last_undegraded":"2023-10-09T06:43:32.605202+0000","last_fullsized":"2023-10-09T06:43:32.605202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:32.691349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.579951+0000","last_change":"2023-10-09T06:43:31.585326+0000","last_active":"2023-10-09T06:43:32.579951+0000","last_peered":"2023-10-09T06:43:32.579951+0000","last_clean":"2023-10-09T06:43:32.579951+0000","last_became_active":"2023-10-09T06:43:31.585015+0000","last_became_peered":"2023-10-09T06:43:31.585015+0000","last_unstale":"2023-10-09T06:43:32.579951+0000","last_undegraded":"2023-10-09T06:43:32.579951+0000","last_fullsized":"2023-10-09T06:43:32.579951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:12:59.791856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.613330+0000","last_change":"2023-10-09T06:43:32.605686+0000","last_active":"2023-10-09T06:43:32.613330+0000","last_peered":"2023-10-09T06:43:32.613330+0000","last_clean":"2023-10-09T06:43:32.613330+0000","last_became_active":"2023-10-09T06:43:32.605337+0000","last_became_peered":"2023-10-09T06:43:32.605337+0000","last_unstale":"2023-10-09T06:43:32.613330+0000","last_undegraded":"2023-10-09T06:43:32.613330+0000","last_fullsized":"2023-10-09T06:43:32.613330+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:48:45.298662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.617102+0000","last_change":"2023-10-09T06:43:31.579815+0000","last_active":"2023-10-09T06:43:32.617102+0000","last_peered":"2023-10-09T06:43:32.617102+0000","last_clean":"2023-10-09T06:43:32.617102+0000","last_became_active":"2023-10-09T06:43:31.579569+0000","last_became_peered":"2023-10-09T06:43:31.579569+0000","last_unstale":"2023-10-09T06:43:32.617102+0000","last_undegraded":"2023-10-09T06:43:32.617102+0000","last_fullsized":"2023-10-09T06:43:32.617102+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:31.688662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.601252+0000","last_change":"2023-10-09T06:43:32.596945+0000","last_active":"2023-10-09T06:43:32.601252+0000","last_peered":"2023-10-09T06:43:32.601252+0000","last_clean":"2023-10-09T06:43:32.601252+0000","last_became_active":"2023-10-09T06:43:32.596679+0000","last_became_peered":"2023-10-09T06:43:32.596679+0000","last_unstale":"2023-10-09T06:43:32.601252+0000","last_undegraded":"2023-10-09T06:43:32.601252+0000","last_fullsized":"2023-10-09T06:43:32.601252+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:32.585763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.594773+0000","last_change":"2023-10-09T06:43:31.582436+0000","last_active":"2023-10-09T06:43:32.594773+0000","last_peered":"2023-10-09T06:43:32.594773+0000","last_clean":"2023-10-09T06:43:32.594773+0000","last_became_active":"2023-10-09T06:43:31.582133+0000","last_became_peered":"2023-10-09T06:43:31.582133+0000","last_unstale":"2023-10-09T06:43:32.594773+0000","last_undegraded":"2023-10-09T06:43:32.594773+0000","last_fullsized":"2023-10-09T06:43:32.594773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:48:44.295975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.601214+0000","last_change":"2023-10-09T06:43:32.598307+0000","last_active":"2023-10-09T06:43:32.601214+0000","last_peered":"2023-10-09T06:43:32.601214+0000","last_clean":"2023-10-09T06:43:32.601214+0000","last_became_active":"2023-10-09T06:43:32.597975+0000","last_became_peered":"2023-10-09T06:43:32.597975+0000","last_unstale":"2023-10-09T06:43:32.601214+0000","last_undegraded":"2023-10-09T06:43:32.601214+0000","last_fullsized":"2023-10-09T06:43:32.601214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:15:10.966173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.580314+0000","last_change":"2023-10-09T06:43:31.572408+0000","last_active":"2023-10-09T06:43:32.580314+0000","last_peered":"2023-10-09T06:43:32.580314+0000","last_clean":"2023-10-09T06:43:32.580314+0000","last_became_active":"2023-10-09T06:43:31.572144+0000","last_became_peered":"2023-10-09T06:43:31.572144+0000","last_unstale":"2023-10-09T06:43:32.580314+0000","last_undegraded":"2023-10-09T06:43:32.580314+0000","last_fullsized":"2023-10-09T06:43:32.580314+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:49:32.843137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.606957+0000","last_change":"2023-10-09T06:43:32.600929+0000","last_active":"2023-10-09T06:43:32.606957+0000","last_peered":"2023-10-09T06:43:32.606957+0000","last_clean":"2023-10-09T06:43:32.606957+0000","last_became_active":"2023-10-09T06:43:32.600617+0000","last_became_peered":"2023-10-09T06:43:32.600617+0000","last_unstale":"2023-10-09T06:43:32.606957+0000","last_undegraded":"2023-10-09T06:43:32.606957+0000","last_fullsized":"2023-10-09T06:43:32.606957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:15:24.986946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.578977+0000","last_change":"2023-10-09T06:43:31.582351+0000","last_active":"2023-10-09T06:43:32.578977+0000","last_peered":"2023-10-09T06:43:32.578977+0000","last_clean":"2023-10-09T06:43:32.578977+0000","last_became_active":"2023-10-09T06:43:31.582079+0000","last_became_peered":"2023-10-09T06:43:31.582079+0000","last_unstale":"2023-10-09T06:43:32.578977+0000","last_undegraded":"2023-10-09T06:43:32.578977+0000","last_fullsized":"2023-10-09T06:43:32.578977+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:52.857606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.614973+0000","last_change":"2023-10-09T06:43:32.612523+0000","last_active":"2023-10-09T06:43:32.614973+0000","last_peered":"2023-10-09T06:43:32.614973+0000","last_clean":"2023-10-09T06:43:32.614973+0000","last_became_active":"2023-10-09T06:43:32.612126+0000","last_became_peered":"2023-10-09T06:43:32.612126+0000","last_unstale":"2023-10-09T06:43:32.614973+0000","last_undegraded":"2023-10-09T06:43:32.614973+0000","last_fullsized":"2023-10-09T06:43:32.614973+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:57.346641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.616864+0000","last_change":"2023-10-09T06:43:31.585000+0000","last_active":"2023-10-09T06:43:32.616864+0000","last_peered":"2023-10-09T06:43:32.616864+0000","last_clean":"2023-10-09T06:43:32.616864+0000","last_became_active":"2023-10-09T06:43:31.584704+0000","last_became_peered":"2023-10-09T06:43:31.584704+0000","last_unstale":"2023-10-09T06:43:32.616864+0000","last_undegraded":"2023-10-09T06:43:32.616864+0000","last_fullsized":"2023-10-09T06:43:32.616864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:17.299314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.615611+0000","last_change":"2023-10-09T06:43:32.614443+0000","last_active":"2023-10-09T06:43:32.615611+0000","last_peered":"2023-10-09T06:43:32.615611+0000","last_clean":"2023-10-09T06:43:32.615611+0000","last_became_active":"2023-10-09T06:43:32.613595+0000","last_became_peered":"2023-10-09T06:43:32.613595+0000","last_unstale":"2023-10-09T06:43:32.615611+0000","last_undegraded":"2023-10-09T06:43:32.615611+0000","last_fullsized":"2023-10-09T06:43:32.615611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:54.977377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.579069+0000","last_change":"2023-10-09T06:43:31.574479+0000","last_active":"2023-10-09T06:43:32.579069+0000","last_peered":"2023-10-09T06:43:32.579069+0000","last_clean":"2023-10-09T06:43:32.579069+0000","last_became_active":"2023-10-09T06:43:31.571653+0000","last_became_peered":"2023-10-09T06:43:31.571653+0000","last_unstale":"2023-10-09T06:43:32.579069+0000","last_undegraded":"2023-10-09T06:43:32.579069+0000","last_fullsized":"2023-10-09T06:43:32.579069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:48:44.295975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.613097+0000","last_change":"2023-10-09T06:43:32.609720+0000","last_active":"2023-10-09T06:43:32.613097+0000","last_peered":"2023-10-09T06:43:32.613097+0000","last_clean":"2023-10-09T06:43:32.613097+0000","last_became_active":"2023-10-09T06:43:32.609439+0000","last_became_peered":"2023-10-09T06:43:32.609439+0000","last_unstale":"2023-10-09T06:43:32.613097+0000","last_undegraded":"2023-10-09T06:43:32.613097+0000","last_fullsized":"2023-10-09T06:43:32.613097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:28.200993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.596050+0000","last_change":"2023-10-09T06:43:31.578306+0000","last_active":"2023-10-09T06:43:32.596050+0000","last_peered":"2023-10-09T06:43:32.596050+0000","last_clean":"2023-10-09T06:43:32.596050+0000","last_became_active":"2023-10-09T06:43:31.578049+0000","last_became_peered":"2023-10-09T06:43:31.578049+0000","last_unstale":"2023-10-09T06:43:32.596050+0000","last_undegraded":"2023-10-09T06:43:32.596050+0000","last_fullsized":"2023-10-09T06:43:32.596050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:19:55.938033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.610216+0000","last_change":"2023-10-09T06:43:32.606494+0000","last_active":"2023-10-09T06:43:32.610216+0000","last_peered":"2023-10-09T06:43:32.610216+0000","last_clean":"2023-10-09T06:43:32.610216+0000","last_became_active":"2023-10-09T06:43:32.606184+0000","last_became_peered":"2023-10-09T06:43:32.606184+0000","last_unstale":"2023-10-09T06:43:32.610216+0000","last_undegraded":"2023-10-09T06:43:32.610216+0000","last_fullsized":"2023-10-09T06:43:32.610216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:28.200993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.579778+0000","last_change":"2023-10-09T06:43:31.582574+0000","last_active":"2023-10-09T06:43:32.579778+0000","last_peered":"2023-10-09T06:43:32.579778+0000","last_clean":"2023-10-09T06:43:32.579778+0000","last_became_active":"2023-10-09T06:43:31.582321+0000","last_became_peered":"2023-10-09T06:43:31.582321+0000","last_unstale":"2023-10-09T06:43:32.579778+0000","last_undegraded":"2023-10-09T06:43:32.579778+0000","last_fullsized":"2023-10-09T06:43:32.579778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:19:55.938033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.607163+0000","last_change":"2023-10-09T06:43:32.604300+0000","last_active":"2023-10-09T06:43:32.607163+0000","last_peered":"2023-10-09T06:43:32.607163+0000","last_clean":"2023-10-09T06:43:32.607163+0000","last_became_active":"2023-10-09T06:43:32.602848+0000","last_became_peered":"2023-10-09T06:43:32.602848+0000","last_unstale":"2023-10-09T06:43:32.607163+0000","last_undegraded":"2023-10-09T06:43:32.607163+0000","last_fullsized":"2023-10-09T06:43:32.607163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:49.546526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.595577+0000","last_change":"2023-10-09T06:43:31.584968+0000","last_active":"2023-10-09T06:43:32.595577+0000","last_peered":"2023-10-09T06:43:32.595577+0000","last_clean":"2023-10-09T06:43:32.595577+0000","last_became_active":"2023-10-09T06:43:31.584655+0000","last_became_peered":"2023-10-09T06:43:31.584655+0000","last_unstale":"2023-10-09T06:43:32.595577+0000","last_undegraded":"2023-10-09T06:43:32.595577+0000","last_fullsized":"2023-10-09T06:43:32.595577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:26.901120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.615036+0000","last_change":"2023-10-09T06:43:32.605878+0000","last_active":"2023-10-09T06:43:32.615036+0000","last_peered":"2023-10-09T06:43:32.615036+0000","last_clean":"2023-10-09T06:43:32.615036+0000","last_became_active":"2023-10-09T06:43:32.605618+0000","last_became_peered":"2023-10-09T06:43:32.605618+0000","last_unstale":"2023-10-09T06:43:32.615036+0000","last_undegraded":"2023-10-09T06:43:32.615036+0000","last_fullsized":"2023-10-09T06:43:32.615036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:30:04.650694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.580414+0000","last_change":"2023-10-09T06:43:31.582691+0000","last_active":"2023-10-09T06:43:32.580414+0000","last_peered":"2023-10-09T06:43:32.580414+0000","last_clean":"2023-10-09T06:43:32.580414+0000","last_became_active":"2023-10-09T06:43:31.582414+0000","last_became_peered":"2023-10-09T06:43:31.582414+0000","last_unstale":"2023-10-09T06:43:32.580414+0000","last_undegraded":"2023-10-09T06:43:32.580414+0000","last_fullsized":"2023-10-09T06:43:32.580414+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:45.340210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.596599+0000","last_change":"2023-10-09T06:43:32.592082+0000","last_active":"2023-10-09T06:43:32.596599+0000","last_peered":"2023-10-09T06:43:32.596599+0000","last_clean":"2023-10-09T06:43:32.596599+0000","last_became_active":"2023-10-09T06:43:32.591194+0000","last_became_peered":"2023-10-09T06:43:32.591194+0000","last_unstale":"2023-10-09T06:43:32.596599+0000","last_undegraded":"2023-10-09T06:43:32.596599+0000","last_fullsized":"2023-10-09T06:43:32.596599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:00.654956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.583693+0000","last_change":"2023-10-09T06:43:31.585912+0000","last_active":"2023-10-09T06:43:32.583693+0000","last_peered":"2023-10-09T06:43:32.583693+0000","last_clean":"2023-10-09T06:43:32.583693+0000","last_became_active":"2023-10-09T06:43:31.585592+0000","last_became_peered":"2023-10-09T06:43:31.585592+0000","last_unstale":"2023-10-09T06:43:32.583693+0000","last_undegraded":"2023-10-09T06:43:32.583693+0000","last_fullsized":"2023-10-09T06:43:32.583693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:52.857606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.605874+0000","last_change":"2023-10-09T06:43:32.601538+0000","last_active":"2023-10-09T06:43:32.605874+0000","last_peered":"2023-10-09T06:43:32.605874+0000","last_clean":"2023-10-09T06:43:32.605874+0000","last_became_active":"2023-10-09T06:43:32.601293+0000","last_became_peered":"2023-10-09T06:43:32.601293+0000","last_unstale":"2023-10-09T06:43:32.605874+0000","last_undegraded":"2023-10-09T06:43:32.605874+0000","last_fullsized":"2023-10-09T06:43:32.605874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:37:21.561094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.595641+0000","last_change":"2023-10-09T06:43:31.588384+0000","last_active":"2023-10-09T06:43:32.595641+0000","last_peered":"2023-10-09T06:43:32.595641+0000","last_clean":"2023-10-09T06:43:32.595641+0000","last_became_active":"2023-10-09T06:43:31.588110+0000","last_became_peered":"2023-10-09T06:43:31.588110+0000","last_unstale":"2023-10-09T06:43:32.595641+0000","last_undegraded":"2023-10-09T06:43:32.595641+0000","last_fullsized":"2023-10-09T06:43:32.595641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:31.688662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.588994+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:43:32.588994+0000","last_peered":"2023-10-09T06:43:32.588994+0000","last_clean":"2023-10-09T06:43:32.588994+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:43:32.588994+0000","last_undegraded":"2023-10-09T06:43:32.588994+0000","last_fullsized":"2023-10-09T06:43:32.588994+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073616,"statfs":{"total":96636764160,"available":96331382784,"internally_reserved":0,"allocated":958464,"data_stored":729807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.448,"5min":3.448,"15min":3.448},"last":0.48199999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":5.617,"5min":5.617,"15min":5.617},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":0.54900000000000004}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":0.60499999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":5.5800000000000001,"5min":5.5800000000000001,"15min":5.5800000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":6.9299999999999997,"5min":6.9299999999999997,"15min":6.9299999999999997},"last":0.71899999999999997}]},{"osd":4,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":3.125,"5min":3.125,"15min":3.125},"last":0.432},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":4.8380000000000001,"5min":4.8380000000000001,"15min":4.8380000000000001},"last":0.70399999999999996}]},{"osd":5,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":4.1929999999999996,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":3.6749999999999998,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.64800000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":4.0250000000000004,"5min":4.0250000000000004,"15min":4.0250000000000004},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":7.0259999999999998,"5min":7.0259999999999998,"15min":7.0259999999999998},"last":0.66000000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":368640,"data_stored":139937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.64100000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59899999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.48699999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.67100000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.73399999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.626},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.747}]},{"osd":7,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.71999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":140907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.42699999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.48299999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.58599999999999997}]},{"osd":4,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.93899999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.92100000000000004}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.77000000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.95899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298220,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073620,"statfs":{"total":96636764160,"available":96331386880,"internally_reserved":0,"allocated":954368,"data_stored":729717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.42999999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.36299999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.376},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.54700000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.59799999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.52100000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.53600000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.58499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":364544,"data_stored":139419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.57799999999999996}]},{"osd":1,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":0.438}]},{"osd":3,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.48399999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.67800000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.63200000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.59599999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.66900000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":140907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.438},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.33800000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.38400000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.499}]},{"osd":4,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.65600000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.68999999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.61299999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.57699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":368640,"data_stored":139453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.73799999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.753}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.82699999999999996}]},{"osd":3,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.71899999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.625}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.80800000000000005}]},{"osd":7,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.872}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":368640,"data_stored":139993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.68400000000000005}]},{"osd":1,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.59399999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":0.752},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.61299999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":0.70899999999999996}]},{"osd":4,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.621}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.5739999999999998,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.9609999999999999,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":0.73999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:43:41.744 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:43:41.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.932+0000 7fcf8d1ff700 1 Processor -- start 2023-10-09T06:43:41.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.932+0000 7fcf8d1ff700 1 -- start start 2023-10-09T06:43:41.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.933+0000 7fcf8d1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcf88155c10 0x7fcf88155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:41.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.934+0000 7fcf8d1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf880ac6d0 0x7fcf880b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:41.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.934+0000 7fcf8d1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf880acac0 con 0x7fcf880ac230 2023-10-09T06:43:41.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.934+0000 7fcf8d1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf880ad930 con 0x7fcf88155c10 2023-10-09T06:43:41.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.934+0000 7fcf8d1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf880acd20 con 0x7fcf880ac6d0 2023-10-09T06:43:41.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.934+0000 7fcf86d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcf88155c10 0x7fcf88155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:41.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.934+0000 7fcf8759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf880ac6d0 0x7fcf880b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:41.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.934+0000 7fcf86d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcf88155c10 0x7fcf88155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:37844/0 (socket says 172.21.15.71:37844) 2023-10-09T06:43:41.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.934+0000 7fcf86d9d700 1 -- 172.21.15.71:0/996066377 learned_addr learned my addr 172.21.15.71:0/996066377 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:41.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.935+0000 7fcf8659c700 1 -- 172.21.15.71:0/996066377 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261824987 0 0) 0x7fcf880acac0 con 0x7fcf880ac230 2023-10-09T06:43:41.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.935+0000 7fcf8659c700 1 -- 172.21.15.71:0/996066377 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf74003570 con 0x7fcf880ac230 2023-10-09T06:43:41.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.935+0000 7fcf8759e700 1 -- 172.21.15.71:0/996066377 >> v2:172.21.15.179:3300/0 conn(0x7fcf88155c10 msgr2=0x7fcf88155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:41.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.935+0000 7fcf8759e700 1 --2- 172.21.15.71:0/996066377 >> v2:172.21.15.179:3300/0 conn(0x7fcf88155c10 0x7fcf88155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:41.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.935+0000 7fcf8759e700 1 -- 172.21.15.71:0/996066377 >> v1:172.21.15.179:6789/0 conn(0x7fcf880ac230 legacy=0x7fcf881568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:41.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.935+0000 7fcf8759e700 1 -- 172.21.15.71:0/996066377 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf880ad000 con 0x7fcf880ac6d0 2023-10-09T06:43:41.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.935+0000 7fcf8759e700 1 --2- 172.21.15.71:0/996066377 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf880ac6d0 0x7fcf880b0300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcf880acc50 tx=0x7fcf8000a890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7915eef739a17e7e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:41.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.935+0000 7fcf8659c700 1 -- 172.21.15.71:0/996066377 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8000f070 con 0x7fcf880ac6d0 2023-10-09T06:43:41.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.936+0000 7fcf8659c700 1 -- 172.21.15.71:0/996066377 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8000a2e0 con 0x7fcf880ac6d0 2023-10-09T06:43:41.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.936+0000 7fcf8659c700 1 -- 172.21.15.71:0/996066377 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8000cb80 con 0x7fcf880ac6d0 2023-10-09T06:43:41.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.936+0000 7fcf8d1ff700 1 -- 172.21.15.71:0/996066377 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf880ac6d0 msgr2=0x7fcf880b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:41.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.936+0000 7fcf8d1ff700 1 --2- 172.21.15.71:0/996066377 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf880ac6d0 0x7fcf880b0300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcf880acc50 tx=0x7fcf8000a890 comp rx=0 tx=0).stop 2023-10-09T06:43:41.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.936+0000 7fcf8d1ff700 1 -- 172.21.15.71:0/996066377 shutdown_connections 2023-10-09T06:43:41.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.936+0000 7fcf8d1ff700 1 --2- 172.21.15.71:0/996066377 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf880ac6d0 0x7fcf880b0300 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:41.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.936+0000 7fcf8d1ff700 1 --2- 172.21.15.71:0/996066377 >> v2:172.21.15.179:3300/0 conn(0x7fcf88155c10 0x7fcf88155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:41.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.936+0000 7fcf8d1ff700 1 -- 172.21.15.71:0/996066377 >> 172.21.15.71:0/996066377 conn(0x7fcf8806a320 msgr2=0x7fcf880cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:41.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.936+0000 7fcf8d1ff700 1 -- 172.21.15.71:0/996066377 shutdown_connections 2023-10-09T06:43:41.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.936+0000 7fcf8d1ff700 1 -- 172.21.15.71:0/996066377 wait complete. 2023-10-09T06:43:41.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.938+0000 7fcf8d1ff700 1 Processor -- start 2023-10-09T06:43:41.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.938+0000 7fcf8d1ff700 1 -- start start 2023-10-09T06:43:41.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.939+0000 7fcf8d1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf880ac230 0x7fcf880a6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:41.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.939+0000 7fcf8d1ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf880ac6d0 0x7fcf880a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:41.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.939+0000 7fcf8d1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf88155c10 0x7fcf880a8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:41.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.939+0000 7fcf8d1ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf880a7470 con 0x7fcf880ac6d0 2023-10-09T06:43:41.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.939+0000 7fcf8d1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf880a9af0 con 0x7fcf880ac230 2023-10-09T06:43:41.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.939+0000 7fcf8d1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf880a7670 con 0x7fcf88155c10 2023-10-09T06:43:41.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.939+0000 7fcf7ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf880ac6d0 0x7fcf880a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:41.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.939+0000 7fcf7ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf880ac6d0 0x7fcf880a95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37444/0 (socket says 172.21.15.71:37444) 2023-10-09T06:43:41.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.939+0000 7fcf7ffff700 1 -- 172.21.15.71:0/2769399358 learned_addr learned my addr 172.21.15.71:0/2769399358 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:41.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.939+0000 7fcf8759e700 1 --2- 172.21.15.71:0/2769399358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf88155c10 0x7fcf880a8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:41.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.939+0000 7fcf86d9d700 1 --2- 172.21.15.71:0/2769399358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf880ac230 0x7fcf880a6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:41.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.939+0000 7fcf7ffff700 1 -- 172.21.15.71:0/2769399358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf88155c10 msgr2=0x7fcf880a8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:41.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.939+0000 7fcf7ffff700 1 --2- 172.21.15.71:0/2769399358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf88155c10 0x7fcf880a8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:41.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.939+0000 7fcf7ffff700 1 -- 172.21.15.71:0/2769399358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf880ac230 msgr2=0x7fcf880a6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:41.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.939+0000 7fcf7ffff700 1 --2- 172.21.15.71:0/2769399358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf880ac230 0x7fcf880a6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:41.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.939+0000 7fcf7ffff700 1 -- 172.21.15.71:0/2769399358 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8000ab30 con 0x7fcf880ac6d0 2023-10-09T06:43:41.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.940+0000 7fcf7ffff700 1 --2- 172.21.15.71:0/2769399358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf880ac6d0 0x7fcf880a95b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcf7000c790 tx=0x7fcf70007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:41.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.940+0000 7fcf7effd700 1 -- 172.21.15.71:0/2769399358 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf70010510 con 0x7fcf880ac6d0 2023-10-09T06:43:41.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.940+0000 7fcf7effd700 1 -- 172.21.15.71:0/2769399358 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf70010670 con 0x7fcf880ac6d0 2023-10-09T06:43:41.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.940+0000 7fcf7effd700 1 -- 172.21.15.71:0/2769399358 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf70010a10 con 0x7fcf880ac6d0 2023-10-09T06:43:41.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.940+0000 7fcf8d1ff700 1 -- 172.21.15.71:0/2769399358 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf880a7950 con 0x7fcf880ac6d0 2023-10-09T06:43:41.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.940+0000 7fcf8d1ff700 1 -- 172.21.15.71:0/2769399358 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf880a7f90 con 0x7fcf880ac6d0 2023-10-09T06:43:41.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.941+0000 7fcf8d1ff700 1 -- 172.21.15.71:0/2769399358 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf8804c3c0 con 0x7fcf880ac6d0 2023-10-09T06:43:41.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.942+0000 7fcf7effd700 1 -- 172.21.15.71:0/2769399358 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf7001b3b0 con 0x7fcf880ac6d0 2023-10-09T06:43:41.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.943+0000 7fcf7effd700 1 --2- 172.21.15.71:0/2769399358 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcf68066f30 0x7fcf680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:41.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.943+0000 7fcf7effd700 1 -- 172.21.15.71:0/2769399358 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcf70083e70 con 0x7fcf880ac6d0 2023-10-09T06:43:41.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.943+0000 7fcf86d9d700 1 --2- 172.21.15.71:0/2769399358 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcf68066f30 0x7fcf680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:41.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.944+0000 7fcf86d9d700 1 --2- 172.21.15.71:0/2769399358 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcf68066f30 0x7fcf680693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcf78006fd0 tx=0x7fcf78009250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:41.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:41.947+0000 7fcf7effd700 1 -- 172.21.15.71:0/2769399358 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf70051040 con 0x7fcf880ac6d0 2023-10-09T06:43:42.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.130+0000 7fcf8d1ff700 1 -- 172.21.15.71:0/2769399358 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf880ad2e0 con 0x7fcf68066f30 2023-10-09T06:43:42.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.139+0000 7fcf7effd700 1 -- 172.21.15.71:0/2769399358 <== mgr.4102 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288692 (secure 0 0 0) 0x7fcf880ad2e0 con 0x7fcf68066f30 2023-10-09T06:43:42.144 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:42.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.143+0000 7fcf8d1ff700 1 -- 172.21.15.71:0/2769399358 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcf68066f30 msgr2=0x7fcf680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:42.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.143+0000 7fcf8d1ff700 1 --2- 172.21.15.71:0/2769399358 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcf68066f30 0x7fcf680693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcf78006fd0 tx=0x7fcf78009250 comp rx=0 tx=0).stop 2023-10-09T06:43:42.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.143+0000 7fcf8d1ff700 1 -- 172.21.15.71:0/2769399358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf880ac6d0 msgr2=0x7fcf880a95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:42.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.143+0000 7fcf8d1ff700 1 --2- 172.21.15.71:0/2769399358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf880ac6d0 0x7fcf880a95b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcf7000c790 tx=0x7fcf70007e10 comp rx=0 tx=0).stop 2023-10-09T06:43:42.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.144+0000 7fcf8d1ff700 1 -- 172.21.15.71:0/2769399358 shutdown_connections 2023-10-09T06:43:42.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.144+0000 7fcf8d1ff700 1 --2- 172.21.15.71:0/2769399358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf88155c10 0x7fcf880a8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:42.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.144+0000 7fcf8d1ff700 1 --2- 172.21.15.71:0/2769399358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf880ac230 0x7fcf880a6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:42.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.144+0000 7fcf8d1ff700 1 --2- 172.21.15.71:0/2769399358 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcf68066f30 0x7fcf680693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:42.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.144+0000 7fcf8d1ff700 1 --2- 172.21.15.71:0/2769399358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf880ac6d0 0x7fcf880a95b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:42.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.144+0000 7fcf8d1ff700 1 -- 172.21.15.71:0/2769399358 >> 172.21.15.71:0/2769399358 conn(0x7fcf8806a320 msgr2=0x7fcf88148290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:42.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.144+0000 7fcf8d1ff700 1 -- 172.21.15.71:0/2769399358 shutdown_connections 2023-10-09T06:43:42.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.144+0000 7fcf8d1ff700 1 -- 172.21.15.71:0/2769399358 wait complete. 2023-10-09T06:43:42.147 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:43:42.162 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-10-09T06:43:40.560331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382344,"kb_used_data":4040,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592376,"statfs":{"total":773094113280,"available":770654593024,"internally_reserved":0,"allocated":4136960,"data_stored":2300140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002263"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.611545+0000","last_change":"2023-10-09T06:43:32.608684+0000","last_active":"2023-10-09T06:43:32.611545+0000","last_peered":"2023-10-09T06:43:32.611545+0000","last_clean":"2023-10-09T06:43:32.611545+0000","last_became_active":"2023-10-09T06:43:32.608415+0000","last_became_peered":"2023-10-09T06:43:32.608415+0000","last_unstale":"2023-10-09T06:43:32.611545+0000","last_undegraded":"2023-10-09T06:43:32.611545+0000","last_fullsized":"2023-10-09T06:43:32.611545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:41.827957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.600778+0000","last_change":"2023-10-09T06:43:32.596455+0000","last_active":"2023-10-09T06:43:32.600778+0000","last_peered":"2023-10-09T06:43:32.600778+0000","last_clean":"2023-10-09T06:43:32.600778+0000","last_became_active":"2023-10-09T06:43:32.596191+0000","last_became_peered":"2023-10-09T06:43:32.596191+0000","last_unstale":"2023-10-09T06:43:32.600778+0000","last_undegraded":"2023-10-09T06:43:32.600778+0000","last_fullsized":"2023-10-09T06:43:32.600778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:05.782825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.615591+0000","last_change":"2023-10-09T06:43:32.613779+0000","last_active":"2023-10-09T06:43:32.615591+0000","last_peered":"2023-10-09T06:43:32.615591+0000","last_clean":"2023-10-09T06:43:32.615591+0000","last_became_active":"2023-10-09T06:43:32.613479+0000","last_became_peered":"2023-10-09T06:43:32.613479+0000","last_unstale":"2023-10-09T06:43:32.615591+0000","last_undegraded":"2023-10-09T06:43:32.615591+0000","last_fullsized":"2023-10-09T06:43:32.615591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:00:35.415369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.616648+0000","last_change":"2023-10-09T06:43:32.608672+0000","last_active":"2023-10-09T06:43:32.616648+0000","last_peered":"2023-10-09T06:43:32.616648+0000","last_clean":"2023-10-09T06:43:32.616648+0000","last_became_active":"2023-10-09T06:43:32.608426+0000","last_became_peered":"2023-10-09T06:43:32.608426+0000","last_unstale":"2023-10-09T06:43:32.616648+0000","last_undegraded":"2023-10-09T06:43:32.616648+0000","last_fullsized":"2023-10-09T06:43:32.616648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:34.388845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.605791+0000","last_change":"2023-10-09T06:43:32.599088+0000","last_active":"2023-10-09T06:43:32.605791+0000","last_peered":"2023-10-09T06:43:32.605791+0000","last_clean":"2023-10-09T06:43:32.605791+0000","last_became_active":"2023-10-09T06:43:32.598827+0000","last_became_peered":"2023-10-09T06:43:32.598827+0000","last_unstale":"2023-10-09T06:43:32.605791+0000","last_undegraded":"2023-10-09T06:43:32.605791+0000","last_fullsized":"2023-10-09T06:43:32.605791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:13:00.794543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.606851+0000","last_change":"2023-10-09T06:43:32.600491+0000","last_active":"2023-10-09T06:43:32.606851+0000","last_peered":"2023-10-09T06:43:32.606851+0000","last_clean":"2023-10-09T06:43:32.606851+0000","last_became_active":"2023-10-09T06:43:32.600303+0000","last_became_peered":"2023-10-09T06:43:32.600303+0000","last_unstale":"2023-10-09T06:43:32.606851+0000","last_undegraded":"2023-10-09T06:43:32.606851+0000","last_fullsized":"2023-10-09T06:43:32.606851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:17.258894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.606938+0000","last_change":"2023-10-09T06:43:32.600310+0000","last_active":"2023-10-09T06:43:32.606938+0000","last_peered":"2023-10-09T06:43:32.606938+0000","last_clean":"2023-10-09T06:43:32.606938+0000","last_became_active":"2023-10-09T06:43:32.600056+0000","last_became_peered":"2023-10-09T06:43:32.600056+0000","last_unstale":"2023-10-09T06:43:32.606938+0000","last_undegraded":"2023-10-09T06:43:32.606938+0000","last_fullsized":"2023-10-09T06:43:32.606938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:41.827957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.606006+0000","last_change":"2023-10-09T06:43:32.602153+0000","last_active":"2023-10-09T06:43:32.606006+0000","last_peered":"2023-10-09T06:43:32.606006+0000","last_clean":"2023-10-09T06:43:32.606006+0000","last_became_active":"2023-10-09T06:43:32.601897+0000","last_became_peered":"2023-10-09T06:43:32.601897+0000","last_unstale":"2023-10-09T06:43:32.606006+0000","last_undegraded":"2023-10-09T06:43:32.606006+0000","last_fullsized":"2023-10-09T06:43:32.606006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:26:14.972288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.615231+0000","last_change":"2023-10-09T06:43:32.609879+0000","last_active":"2023-10-09T06:43:32.615231+0000","last_peered":"2023-10-09T06:43:32.615231+0000","last_clean":"2023-10-09T06:43:32.615231+0000","last_became_active":"2023-10-09T06:43:32.609550+0000","last_became_peered":"2023-10-09T06:43:32.609550+0000","last_unstale":"2023-10-09T06:43:32.615231+0000","last_undegraded":"2023-10-09T06:43:32.615231+0000","last_fullsized":"2023-10-09T06:43:32.615231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:15:24.986946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.616729+0000","last_change":"2023-10-09T06:43:32.603669+0000","last_active":"2023-10-09T06:43:32.616729+0000","last_peered":"2023-10-09T06:43:32.616729+0000","last_clean":"2023-10-09T06:43:32.616729+0000","last_became_active":"2023-10-09T06:43:32.603356+0000","last_became_peered":"2023-10-09T06:43:32.603356+0000","last_unstale":"2023-10-09T06:43:32.616729+0000","last_undegraded":"2023-10-09T06:43:32.616729+0000","last_fullsized":"2023-10-09T06:43:32.616729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:17.258894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.615385+0000","last_change":"2023-10-09T06:43:32.614024+0000","last_active":"2023-10-09T06:43:32.615385+0000","last_peered":"2023-10-09T06:43:32.615385+0000","last_clean":"2023-10-09T06:43:32.615385+0000","last_became_active":"2023-10-09T06:43:32.613706+0000","last_became_peered":"2023-10-09T06:43:32.613706+0000","last_unstale":"2023-10-09T06:43:32.615385+0000","last_undegraded":"2023-10-09T06:43:32.615385+0000","last_fullsized":"2023-10-09T06:43:32.615385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:00.654956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.609286+0000","last_change":"2023-10-09T06:43:32.602539+0000","last_active":"2023-10-09T06:43:32.609286+0000","last_peered":"2023-10-09T06:43:32.609286+0000","last_clean":"2023-10-09T06:43:32.609286+0000","last_became_active":"2023-10-09T06:43:32.602190+0000","last_became_peered":"2023-10-09T06:43:32.602190+0000","last_unstale":"2023-10-09T06:43:32.609286+0000","last_undegraded":"2023-10-09T06:43:32.609286+0000","last_fullsized":"2023-10-09T06:43:32.609286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:30:04.650694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.616458+0000","last_change":"2023-10-09T06:43:32.614724+0000","last_active":"2023-10-09T06:43:32.616458+0000","last_peered":"2023-10-09T06:43:32.616458+0000","last_clean":"2023-10-09T06:43:32.616458+0000","last_became_active":"2023-10-09T06:43:32.614479+0000","last_became_peered":"2023-10-09T06:43:32.614479+0000","last_unstale":"2023-10-09T06:43:32.616458+0000","last_undegraded":"2023-10-09T06:43:32.616458+0000","last_fullsized":"2023-10-09T06:43:32.616458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:19:59.340814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.600960+0000","last_change":"2023-10-09T06:43:32.593796+0000","last_active":"2023-10-09T06:43:32.600960+0000","last_peered":"2023-10-09T06:43:32.600960+0000","last_clean":"2023-10-09T06:43:32.600960+0000","last_became_active":"2023-10-09T06:43:32.593502+0000","last_became_peered":"2023-10-09T06:43:32.593502+0000","last_unstale":"2023-10-09T06:43:32.600960+0000","last_undegraded":"2023-10-09T06:43:32.600960+0000","last_fullsized":"2023-10-09T06:43:32.600960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:28:34.180710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.608341+0000","last_change":"2023-10-09T06:43:32.597658+0000","last_active":"2023-10-09T06:43:32.608341+0000","last_peered":"2023-10-09T06:43:32.608341+0000","last_clean":"2023-10-09T06:43:32.608341+0000","last_became_active":"2023-10-09T06:43:32.597364+0000","last_became_peered":"2023-10-09T06:43:32.597364+0000","last_unstale":"2023-10-09T06:43:32.608341+0000","last_undegraded":"2023-10-09T06:43:32.608341+0000","last_fullsized":"2023-10-09T06:43:32.608341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:34.388845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.606025+0000","last_change":"2023-10-09T06:43:32.602327+0000","last_active":"2023-10-09T06:43:32.606025+0000","last_peered":"2023-10-09T06:43:32.606025+0000","last_clean":"2023-10-09T06:43:32.606025+0000","last_became_active":"2023-10-09T06:43:32.602050+0000","last_became_peered":"2023-10-09T06:43:32.602050+0000","last_unstale":"2023-10-09T06:43:32.606025+0000","last_undegraded":"2023-10-09T06:43:32.606025+0000","last_fullsized":"2023-10-09T06:43:32.606025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:15:13.252714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.599386+0000","last_change":"2023-10-09T06:43:32.597778+0000","last_active":"2023-10-09T06:43:32.599386+0000","last_peered":"2023-10-09T06:43:32.599386+0000","last_clean":"2023-10-09T06:43:32.599386+0000","last_became_active":"2023-10-09T06:43:32.597515+0000","last_became_peered":"2023-10-09T06:43:32.597515+0000","last_unstale":"2023-10-09T06:43:32.599386+0000","last_undegraded":"2023-10-09T06:43:32.599386+0000","last_fullsized":"2023-10-09T06:43:32.599386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:49.546526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.607104+0000","last_change":"2023-10-09T06:43:32.604582+0000","last_active":"2023-10-09T06:43:32.607104+0000","last_peered":"2023-10-09T06:43:32.607104+0000","last_clean":"2023-10-09T06:43:32.607104+0000","last_became_active":"2023-10-09T06:43:32.604303+0000","last_became_peered":"2023-10-09T06:43:32.604303+0000","last_unstale":"2023-10-09T06:43:32.607104+0000","last_undegraded":"2023-10-09T06:43:32.607104+0000","last_fullsized":"2023-10-09T06:43:32.607104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:20.764820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.617960+0000","last_change":"2023-10-09T06:43:32.612073+0000","last_active":"2023-10-09T06:43:32.617960+0000","last_peered":"2023-10-09T06:43:32.617960+0000","last_clean":"2023-10-09T06:43:32.617960+0000","last_became_active":"2023-10-09T06:43:32.611800+0000","last_became_peered":"2023-10-09T06:43:32.611800+0000","last_unstale":"2023-10-09T06:43:32.617960+0000","last_undegraded":"2023-10-09T06:43:32.617960+0000","last_fullsized":"2023-10-09T06:43:32.617960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:23:20.441286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.617158+0000","last_change":"2023-10-09T06:43:32.611760+0000","last_active":"2023-10-09T06:43:32.617158+0000","last_peered":"2023-10-09T06:43:32.617158+0000","last_clean":"2023-10-09T06:43:32.617158+0000","last_became_active":"2023-10-09T06:43:32.611479+0000","last_became_peered":"2023-10-09T06:43:32.611479+0000","last_unstale":"2023-10-09T06:43:32.617158+0000","last_undegraded":"2023-10-09T06:43:32.617158+0000","last_fullsized":"2023-10-09T06:43:32.617158+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:44:09.277702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.592779+0000","last_change":"2023-10-09T06:43:32.588123+0000","last_active":"2023-10-09T06:43:32.592779+0000","last_peered":"2023-10-09T06:43:32.592779+0000","last_clean":"2023-10-09T06:43:32.592779+0000","last_became_active":"2023-10-09T06:43:32.587825+0000","last_became_peered":"2023-10-09T06:43:32.587825+0000","last_unstale":"2023-10-09T06:43:32.592779+0000","last_undegraded":"2023-10-09T06:43:32.592779+0000","last_fullsized":"2023-10-09T06:43:32.592779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:43:56.155101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.596549+0000","last_change":"2023-10-09T06:43:32.592067+0000","last_active":"2023-10-09T06:43:32.596549+0000","last_peered":"2023-10-09T06:43:32.596549+0000","last_clean":"2023-10-09T06:43:32.596549+0000","last_became_active":"2023-10-09T06:43:32.590636+0000","last_became_peered":"2023-10-09T06:43:32.590636+0000","last_unstale":"2023-10-09T06:43:32.596549+0000","last_undegraded":"2023-10-09T06:43:32.596549+0000","last_fullsized":"2023-10-09T06:43:32.596549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:41.827957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.599400+0000","last_change":"2023-10-09T06:43:32.593988+0000","last_active":"2023-10-09T06:43:32.599400+0000","last_peered":"2023-10-09T06:43:32.599400+0000","last_clean":"2023-10-09T06:43:32.599400+0000","last_became_active":"2023-10-09T06:43:32.593693+0000","last_became_peered":"2023-10-09T06:43:32.593693+0000","last_unstale":"2023-10-09T06:43:32.599400+0000","last_undegraded":"2023-10-09T06:43:32.599400+0000","last_fullsized":"2023-10-09T06:43:32.599400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:11.622961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.607906+0000","last_change":"2023-10-09T06:43:32.595286+0000","last_active":"2023-10-09T06:43:32.607906+0000","last_peered":"2023-10-09T06:43:32.607906+0000","last_clean":"2023-10-09T06:43:32.607906+0000","last_became_active":"2023-10-09T06:43:32.595045+0000","last_became_peered":"2023-10-09T06:43:32.595045+0000","last_unstale":"2023-10-09T06:43:32.607906+0000","last_undegraded":"2023-10-09T06:43:32.607906+0000","last_fullsized":"2023-10-09T06:43:32.607906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:17.258894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.616914+0000","last_change":"2023-10-09T06:43:32.607636+0000","last_active":"2023-10-09T06:43:32.616914+0000","last_peered":"2023-10-09T06:43:32.616914+0000","last_clean":"2023-10-09T06:43:32.616914+0000","last_became_active":"2023-10-09T06:43:32.607276+0000","last_became_peered":"2023-10-09T06:43:32.607276+0000","last_unstale":"2023-10-09T06:43:32.616914+0000","last_undegraded":"2023-10-09T06:43:32.616914+0000","last_fullsized":"2023-10-09T06:43:32.616914+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:23.043125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.607086+0000","last_change":"2023-10-09T06:43:32.600330+0000","last_active":"2023-10-09T06:43:32.607086+0000","last_peered":"2023-10-09T06:43:32.607086+0000","last_clean":"2023-10-09T06:43:32.607086+0000","last_became_active":"2023-10-09T06:43:32.600050+0000","last_became_peered":"2023-10-09T06:43:32.600050+0000","last_unstale":"2023-10-09T06:43:32.607086+0000","last_undegraded":"2023-10-09T06:43:32.607086+0000","last_fullsized":"2023-10-09T06:43:32.607086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:46:52.659669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.616955+0000","last_change":"2023-10-09T06:43:32.608311+0000","last_active":"2023-10-09T06:43:32.616955+0000","last_peered":"2023-10-09T06:43:32.616955+0000","last_clean":"2023-10-09T06:43:32.616955+0000","last_became_active":"2023-10-09T06:43:32.608046+0000","last_became_peered":"2023-10-09T06:43:32.608046+0000","last_unstale":"2023-10-09T06:43:32.616955+0000","last_undegraded":"2023-10-09T06:43:32.616955+0000","last_fullsized":"2023-10-09T06:43:32.616955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:37:21.561094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.595224+0000","last_change":"2023-10-09T06:43:32.585763+0000","last_active":"2023-10-09T06:43:32.595224+0000","last_peered":"2023-10-09T06:43:32.595224+0000","last_clean":"2023-10-09T06:43:32.595224+0000","last_became_active":"2023-10-09T06:43:32.585466+0000","last_became_peered":"2023-10-09T06:43:32.585466+0000","last_unstale":"2023-10-09T06:43:32.595224+0000","last_undegraded":"2023-10-09T06:43:32.595224+0000","last_fullsized":"2023-10-09T06:43:32.595224+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:37:21.561094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.603837+0000","last_change":"2023-10-09T06:43:32.596860+0000","last_active":"2023-10-09T06:43:32.603837+0000","last_peered":"2023-10-09T06:43:32.603837+0000","last_clean":"2023-10-09T06:43:32.603837+0000","last_became_active":"2023-10-09T06:43:32.596531+0000","last_became_peered":"2023-10-09T06:43:32.596531+0000","last_unstale":"2023-10-09T06:43:32.603837+0000","last_undegraded":"2023-10-09T06:43:32.603837+0000","last_fullsized":"2023-10-09T06:43:32.603837+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:48.954261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.606906+0000","last_change":"2023-10-09T06:43:32.599866+0000","last_active":"2023-10-09T06:43:32.606906+0000","last_peered":"2023-10-09T06:43:32.606906+0000","last_clean":"2023-10-09T06:43:32.606906+0000","last_became_active":"2023-10-09T06:43:32.599329+0000","last_became_peered":"2023-10-09T06:43:32.599329+0000","last_unstale":"2023-10-09T06:43:32.606906+0000","last_undegraded":"2023-10-09T06:43:32.606906+0000","last_fullsized":"2023-10-09T06:43:32.606906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:48.954261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.606448+0000","last_change":"2023-10-09T06:43:32.600806+0000","last_active":"2023-10-09T06:43:32.606448+0000","last_peered":"2023-10-09T06:43:32.606448+0000","last_clean":"2023-10-09T06:43:32.606448+0000","last_became_active":"2023-10-09T06:43:32.600509+0000","last_became_peered":"2023-10-09T06:43:32.600509+0000","last_unstale":"2023-10-09T06:43:32.606448+0000","last_undegraded":"2023-10-09T06:43:32.606448+0000","last_fullsized":"2023-10-09T06:43:32.606448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:49.546526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.610353+0000","last_change":"2023-10-09T06:43:32.605070+0000","last_active":"2023-10-09T06:43:32.610353+0000","last_peered":"2023-10-09T06:43:32.610353+0000","last_clean":"2023-10-09T06:43:32.610353+0000","last_became_active":"2023-10-09T06:43:32.604801+0000","last_became_peered":"2023-10-09T06:43:32.604801+0000","last_unstale":"2023-10-09T06:43:32.610353+0000","last_undegraded":"2023-10-09T06:43:32.610353+0000","last_fullsized":"2023-10-09T06:43:32.610353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:43:56.155101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.600721+0000","last_change":"2023-10-09T06:43:32.597473+0000","last_active":"2023-10-09T06:43:32.600721+0000","last_peered":"2023-10-09T06:43:32.600721+0000","last_clean":"2023-10-09T06:43:32.600721+0000","last_became_active":"2023-10-09T06:43:32.597215+0000","last_became_peered":"2023-10-09T06:43:32.597215+0000","last_unstale":"2023-10-09T06:43:32.600721+0000","last_undegraded":"2023-10-09T06:43:32.600721+0000","last_fullsized":"2023-10-09T06:43:32.600721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:15:24.986946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.611094+0000","last_change":"2023-10-09T06:43:31.588823+0000","last_active":"2023-10-09T06:43:32.611094+0000","last_peered":"2023-10-09T06:43:32.611094+0000","last_clean":"2023-10-09T06:43:32.611094+0000","last_became_active":"2023-10-09T06:43:31.588554+0000","last_became_peered":"2023-10-09T06:43:31.588554+0000","last_unstale":"2023-10-09T06:43:32.611094+0000","last_undegraded":"2023-10-09T06:43:32.611094+0000","last_fullsized":"2023-10-09T06:43:32.611094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:56.343954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.610397+0000","last_change":"2023-10-09T06:43:32.605854+0000","last_active":"2023-10-09T06:43:32.610397+0000","last_peered":"2023-10-09T06:43:32.610397+0000","last_clean":"2023-10-09T06:43:32.610397+0000","last_became_active":"2023-10-09T06:43:32.605561+0000","last_became_peered":"2023-10-09T06:43:32.605561+0000","last_unstale":"2023-10-09T06:43:32.610397+0000","last_undegraded":"2023-10-09T06:43:32.610397+0000","last_fullsized":"2023-10-09T06:43:32.610397+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:15:24.986946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.610952+0000","last_change":"2023-10-09T06:43:31.580770+0000","last_active":"2023-10-09T06:43:32.610952+0000","last_peered":"2023-10-09T06:43:32.610952+0000","last_clean":"2023-10-09T06:43:32.610952+0000","last_became_active":"2023-10-09T06:43:31.580483+0000","last_became_peered":"2023-10-09T06:43:31.580483+0000","last_unstale":"2023-10-09T06:43:32.610952+0000","last_undegraded":"2023-10-09T06:43:32.610952+0000","last_fullsized":"2023-10-09T06:43:32.610952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:56.343954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.606540+0000","last_change":"2023-10-09T06:43:32.603722+0000","last_active":"2023-10-09T06:43:32.606540+0000","last_peered":"2023-10-09T06:43:32.606540+0000","last_clean":"2023-10-09T06:43:32.606540+0000","last_became_active":"2023-10-09T06:43:32.603439+0000","last_became_peered":"2023-10-09T06:43:32.603439+0000","last_unstale":"2023-10-09T06:43:32.606540+0000","last_undegraded":"2023-10-09T06:43:32.606540+0000","last_fullsized":"2023-10-09T06:43:32.606540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:16.764212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.619099+0000","last_change":"2023-10-09T06:43:31.591561+0000","last_active":"2023-10-09T06:43:32.619099+0000","last_peered":"2023-10-09T06:43:32.619099+0000","last_clean":"2023-10-09T06:43:32.619099+0000","last_became_active":"2023-10-09T06:43:31.591261+0000","last_became_peered":"2023-10-09T06:43:31.591261+0000","last_unstale":"2023-10-09T06:43:32.619099+0000","last_undegraded":"2023-10-09T06:43:32.619099+0000","last_fullsized":"2023-10-09T06:43:32.619099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:27.198306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.616975+0000","last_change":"2023-10-09T06:43:32.608335+0000","last_active":"2023-10-09T06:43:32.616975+0000","last_peered":"2023-10-09T06:43:32.616975+0000","last_clean":"2023-10-09T06:43:32.616975+0000","last_became_active":"2023-10-09T06:43:32.608089+0000","last_became_peered":"2023-10-09T06:43:32.608089+0000","last_unstale":"2023-10-09T06:43:32.616975+0000","last_undegraded":"2023-10-09T06:43:32.616975+0000","last_fullsized":"2023-10-09T06:43:32.616975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:58.469035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.617493+0000","last_change":"2023-10-09T06:43:31.581224+0000","last_active":"2023-10-09T06:43:32.617493+0000","last_peered":"2023-10-09T06:43:32.617493+0000","last_clean":"2023-10-09T06:43:32.617493+0000","last_became_active":"2023-10-09T06:43:31.580851+0000","last_became_peered":"2023-10-09T06:43:31.580851+0000","last_unstale":"2023-10-09T06:43:32.617493+0000","last_undegraded":"2023-10-09T06:43:32.617493+0000","last_fullsized":"2023-10-09T06:43:32.617493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:07.887852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.610234+0000","last_change":"2023-10-09T06:43:32.604094+0000","last_active":"2023-10-09T06:43:32.610234+0000","last_peered":"2023-10-09T06:43:32.610234+0000","last_clean":"2023-10-09T06:43:32.610234+0000","last_became_active":"2023-10-09T06:43:32.603857+0000","last_became_peered":"2023-10-09T06:43:32.603857+0000","last_unstale":"2023-10-09T06:43:32.610234+0000","last_undegraded":"2023-10-09T06:43:32.610234+0000","last_fullsized":"2023-10-09T06:43:32.610234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:58.469035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.614280+0000","last_change":"2023-10-09T06:43:31.585382+0000","last_active":"2023-10-09T06:43:32.614280+0000","last_peered":"2023-10-09T06:43:32.614280+0000","last_clean":"2023-10-09T06:43:32.614280+0000","last_became_active":"2023-10-09T06:43:31.585083+0000","last_became_peered":"2023-10-09T06:43:31.585083+0000","last_unstale":"2023-10-09T06:43:32.614280+0000","last_undegraded":"2023-10-09T06:43:32.614280+0000","last_fullsized":"2023-10-09T06:43:32.614280+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:56.343954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.595342+0000","last_change":"2023-10-09T06:43:32.586115+0000","last_active":"2023-10-09T06:43:32.595342+0000","last_peered":"2023-10-09T06:43:32.595342+0000","last_clean":"2023-10-09T06:43:32.595342+0000","last_became_active":"2023-10-09T06:43:32.585591+0000","last_became_peered":"2023-10-09T06:43:32.585591+0000","last_unstale":"2023-10-09T06:43:32.595342+0000","last_undegraded":"2023-10-09T06:43:32.595342+0000","last_fullsized":"2023-10-09T06:43:32.595342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:26:14.972288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.615113+0000","last_change":"2023-10-09T06:43:31.585289+0000","last_active":"2023-10-09T06:43:32.615113+0000","last_peered":"2023-10-09T06:43:32.615113+0000","last_clean":"2023-10-09T06:43:32.615113+0000","last_became_active":"2023-10-09T06:43:31.584990+0000","last_became_peered":"2023-10-09T06:43:31.584990+0000","last_unstale":"2023-10-09T06:43:32.615113+0000","last_undegraded":"2023-10-09T06:43:32.615113+0000","last_fullsized":"2023-10-09T06:43:32.615113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:19:58.338127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.603610+0000","last_change":"2023-10-09T06:43:32.597781+0000","last_active":"2023-10-09T06:43:32.603610+0000","last_peered":"2023-10-09T06:43:32.603610+0000","last_clean":"2023-10-09T06:43:32.603610+0000","last_became_active":"2023-10-09T06:43:32.597479+0000","last_became_peered":"2023-10-09T06:43:32.597479+0000","last_unstale":"2023-10-09T06:43:32.603610+0000","last_undegraded":"2023-10-09T06:43:32.603610+0000","last_fullsized":"2023-10-09T06:43:32.603610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:11.622961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.583772+0000","last_change":"2023-10-09T06:43:31.587212+0000","last_active":"2023-10-09T06:43:32.583772+0000","last_peered":"2023-10-09T06:43:32.583772+0000","last_clean":"2023-10-09T06:43:32.583772+0000","last_became_active":"2023-10-09T06:43:31.586951+0000","last_became_peered":"2023-10-09T06:43:31.586951+0000","last_unstale":"2023-10-09T06:43:32.583772+0000","last_undegraded":"2023-10-09T06:43:32.583772+0000","last_fullsized":"2023-10-09T06:43:32.583772+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:15:23.984259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.616591+0000","last_change":"2023-10-09T06:43:32.603530+0000","last_active":"2023-10-09T06:43:32.616591+0000","last_peered":"2023-10-09T06:43:32.616591+0000","last_clean":"2023-10-09T06:43:32.616591+0000","last_became_active":"2023-10-09T06:43:32.603262+0000","last_became_peered":"2023-10-09T06:43:32.603262+0000","last_unstale":"2023-10-09T06:43:32.616591+0000","last_undegraded":"2023-10-09T06:43:32.616591+0000","last_fullsized":"2023-10-09T06:43:32.616591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:15:13.252714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.579373+0000","last_change":"2023-10-09T06:43:31.582874+0000","last_active":"2023-10-09T06:43:32.579373+0000","last_peered":"2023-10-09T06:43:32.579373+0000","last_clean":"2023-10-09T06:43:32.579373+0000","last_became_active":"2023-10-09T06:43:31.582615+0000","last_became_peered":"2023-10-09T06:43:31.582615+0000","last_unstale":"2023-10-09T06:43:32.579373+0000","last_undegraded":"2023-10-09T06:43:32.579373+0000","last_fullsized":"2023-10-09T06:43:32.579373+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:15:09.963486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.608025+0000","last_change":"2023-10-09T06:43:32.597230+0000","last_active":"2023-10-09T06:43:32.608025+0000","last_peered":"2023-10-09T06:43:32.608025+0000","last_clean":"2023-10-09T06:43:32.608025+0000","last_became_active":"2023-10-09T06:43:32.596921+0000","last_became_peered":"2023-10-09T06:43:32.596921+0000","last_unstale":"2023-10-09T06:43:32.608025+0000","last_undegraded":"2023-10-09T06:43:32.608025+0000","last_fullsized":"2023-10-09T06:43:32.608025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:23:20.441286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.584805+0000","last_change":"2023-10-09T06:43:31.584657+0000","last_active":"2023-10-09T06:43:32.584805+0000","last_peered":"2023-10-09T06:43:32.584805+0000","last_clean":"2023-10-09T06:43:32.584805+0000","last_became_active":"2023-10-09T06:43:31.584392+0000","last_became_peered":"2023-10-09T06:43:31.584392+0000","last_unstale":"2023-10-09T06:43:32.584805+0000","last_undegraded":"2023-10-09T06:43:32.584805+0000","last_fullsized":"2023-10-09T06:43:32.584805+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:17.299314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.611950+0000","last_change":"2023-10-09T06:43:32.609687+0000","last_active":"2023-10-09T06:43:32.611950+0000","last_peered":"2023-10-09T06:43:32.611950+0000","last_clean":"2023-10-09T06:43:32.611950+0000","last_became_active":"2023-10-09T06:43:32.609446+0000","last_became_peered":"2023-10-09T06:43:32.609446+0000","last_unstale":"2023-10-09T06:43:32.611950+0000","last_undegraded":"2023-10-09T06:43:32.611950+0000","last_fullsized":"2023-10-09T06:43:32.611950+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:54.977377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.578960+0000","last_change":"2023-10-09T06:43:31.582543+0000","last_active":"2023-10-09T06:43:32.578960+0000","last_peered":"2023-10-09T06:43:32.578960+0000","last_clean":"2023-10-09T06:43:32.578960+0000","last_became_active":"2023-10-09T06:43:31.582274+0000","last_became_peered":"2023-10-09T06:43:31.582274+0000","last_unstale":"2023-10-09T06:43:32.578960+0000","last_undegraded":"2023-10-09T06:43:32.578960+0000","last_fullsized":"2023-10-09T06:43:32.578960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:54.482393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.600935+0000","last_change":"2023-10-09T06:43:32.594622+0000","last_active":"2023-10-09T06:43:32.600935+0000","last_peered":"2023-10-09T06:43:32.600935+0000","last_clean":"2023-10-09T06:43:32.600935+0000","last_became_active":"2023-10-09T06:43:32.594271+0000","last_became_peered":"2023-10-09T06:43:32.594271+0000","last_unstale":"2023-10-09T06:43:32.600935+0000","last_undegraded":"2023-10-09T06:43:32.600935+0000","last_fullsized":"2023-10-09T06:43:32.600935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:34.388845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.610601+0000","last_change":"2023-10-09T06:43:31.581601+0000","last_active":"2023-10-09T06:43:32.610601+0000","last_peered":"2023-10-09T06:43:32.610601+0000","last_clean":"2023-10-09T06:43:32.610601+0000","last_became_active":"2023-10-09T06:43:31.581330+0000","last_became_peered":"2023-10-09T06:43:31.581330+0000","last_unstale":"2023-10-09T06:43:32.610601+0000","last_undegraded":"2023-10-09T06:43:32.610601+0000","last_fullsized":"2023-10-09T06:43:32.610601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:26.901120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.615580+0000","last_change":"2023-10-09T06:43:32.614024+0000","last_active":"2023-10-09T06:43:32.615580+0000","last_peered":"2023-10-09T06:43:32.615580+0000","last_clean":"2023-10-09T06:43:32.615580+0000","last_became_active":"2023-10-09T06:43:32.613543+0000","last_became_peered":"2023-10-09T06:43:32.613543+0000","last_unstale":"2023-10-09T06:43:32.615580+0000","last_undegraded":"2023-10-09T06:43:32.615580+0000","last_fullsized":"2023-10-09T06:43:32.615580+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:46:52.659669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.625297+0000","last_change":"2023-10-09T06:43:31.591755+0000","last_active":"2023-10-09T06:43:32.625297+0000","last_peered":"2023-10-09T06:43:32.625297+0000","last_clean":"2023-10-09T06:43:32.625297+0000","last_became_active":"2023-10-09T06:43:31.591271+0000","last_became_peered":"2023-10-09T06:43:31.591271+0000","last_unstale":"2023-10-09T06:43:32.625297+0000","last_undegraded":"2023-10-09T06:43:32.625297+0000","last_fullsized":"2023-10-09T06:43:32.625297+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:26.901120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.618409+0000","last_change":"2023-10-09T06:43:32.613044+0000","last_active":"2023-10-09T06:43:32.618409+0000","last_peered":"2023-10-09T06:43:32.618409+0000","last_clean":"2023-10-09T06:43:32.618409+0000","last_became_active":"2023-10-09T06:43:32.612768+0000","last_became_peered":"2023-10-09T06:43:32.612768+0000","last_unstale":"2023-10-09T06:43:32.618409+0000","last_undegraded":"2023-10-09T06:43:32.618409+0000","last_fullsized":"2023-10-09T06:43:32.618409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:26:14.972288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.614866+0000","last_change":"2023-10-09T06:43:31.581530+0000","last_active":"2023-10-09T06:43:32.614866+0000","last_peered":"2023-10-09T06:43:32.614866+0000","last_clean":"2023-10-09T06:43:32.614866+0000","last_became_active":"2023-10-09T06:43:31.580810+0000","last_became_peered":"2023-10-09T06:43:31.580810+0000","last_unstale":"2023-10-09T06:43:32.614866+0000","last_undegraded":"2023-10-09T06:43:32.614866+0000","last_fullsized":"2023-10-09T06:43:32.614866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:44:08.275015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.600900+0000","last_change":"2023-10-09T06:43:32.598595+0000","last_active":"2023-10-09T06:43:32.600900+0000","last_peered":"2023-10-09T06:43:32.600900+0000","last_clean":"2023-10-09T06:43:32.600900+0000","last_became_active":"2023-10-09T06:43:32.598302+0000","last_became_peered":"2023-10-09T06:43:32.598302+0000","last_unstale":"2023-10-09T06:43:32.600900+0000","last_undegraded":"2023-10-09T06:43:32.600900+0000","last_fullsized":"2023-10-09T06:43:32.600900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:15:13.252714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.595665+0000","last_change":"2023-10-09T06:43:31.583715+0000","last_active":"2023-10-09T06:43:32.595665+0000","last_peered":"2023-10-09T06:43:32.595665+0000","last_clean":"2023-10-09T06:43:32.595665+0000","last_became_active":"2023-10-09T06:43:31.583119+0000","last_became_peered":"2023-10-09T06:43:31.583119+0000","last_unstale":"2023-10-09T06:43:32.595665+0000","last_undegraded":"2023-10-09T06:43:32.595665+0000","last_fullsized":"2023-10-09T06:43:32.595665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:58.292619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.610335+0000","last_change":"2023-10-09T06:43:32.605032+0000","last_active":"2023-10-09T06:43:32.610335+0000","last_peered":"2023-10-09T06:43:32.610335+0000","last_clean":"2023-10-09T06:43:32.610335+0000","last_became_active":"2023-10-09T06:43:32.604751+0000","last_became_peered":"2023-10-09T06:43:32.604751+0000","last_unstale":"2023-10-09T06:43:32.610335+0000","last_undegraded":"2023-10-09T06:43:32.610335+0000","last_fullsized":"2023-10-09T06:43:32.610335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:23.043125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.583879+0000","last_change":"2023-10-09T06:43:31.585275+0000","last_active":"2023-10-09T06:43:32.583879+0000","last_peered":"2023-10-09T06:43:32.583879+0000","last_clean":"2023-10-09T06:43:32.583879+0000","last_became_active":"2023-10-09T06:43:31.584989+0000","last_became_peered":"2023-10-09T06:43:31.584989+0000","last_unstale":"2023-10-09T06:43:32.583879+0000","last_undegraded":"2023-10-09T06:43:32.583879+0000","last_fullsized":"2023-10-09T06:43:32.583879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:36.418185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.605787+0000","last_change":"2023-10-09T06:43:32.597772+0000","last_active":"2023-10-09T06:43:32.605787+0000","last_peered":"2023-10-09T06:43:32.605787+0000","last_clean":"2023-10-09T06:43:32.605787+0000","last_became_active":"2023-10-09T06:43:32.597493+0000","last_became_peered":"2023-10-09T06:43:32.597493+0000","last_unstale":"2023-10-09T06:43:32.605787+0000","last_undegraded":"2023-10-09T06:43:32.605787+0000","last_fullsized":"2023-10-09T06:43:32.605787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:11.622961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.623565+0000","last_change":"2023-10-09T06:43:31.591837+0000","last_active":"2023-10-09T06:43:32.623565+0000","last_peered":"2023-10-09T06:43:32.623565+0000","last_clean":"2023-10-09T06:43:32.623565+0000","last_became_active":"2023-10-09T06:43:31.591583+0000","last_became_peered":"2023-10-09T06:43:31.591583+0000","last_unstale":"2023-10-09T06:43:32.623565+0000","last_undegraded":"2023-10-09T06:43:32.623565+0000","last_fullsized":"2023-10-09T06:43:32.623565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:48.543839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.591708+0000","last_change":"2023-10-09T06:43:32.585788+0000","last_active":"2023-10-09T06:43:32.591708+0000","last_peered":"2023-10-09T06:43:32.591708+0000","last_clean":"2023-10-09T06:43:32.591708+0000","last_became_active":"2023-10-09T06:43:32.585508+0000","last_became_peered":"2023-10-09T06:43:32.585508+0000","last_unstale":"2023-10-09T06:43:32.591708+0000","last_undegraded":"2023-10-09T06:43:32.591708+0000","last_fullsized":"2023-10-09T06:43:32.591708+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:28.200993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.618362+0000","last_change":"2023-10-09T06:43:31.591708+0000","last_active":"2023-10-09T06:43:32.618362+0000","last_peered":"2023-10-09T06:43:32.618362+0000","last_clean":"2023-10-09T06:43:32.618362+0000","last_became_active":"2023-10-09T06:43:31.591444+0000","last_became_peered":"2023-10-09T06:43:31.591444+0000","last_unstale":"2023-10-09T06:43:32.618362+0000","last_undegraded":"2023-10-09T06:43:32.618362+0000","last_fullsized":"2023-10-09T06:43:32.618362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:52.857606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.598256+0000","last_change":"2023-10-09T06:43:32.587025+0000","last_active":"2023-10-09T06:43:32.598256+0000","last_peered":"2023-10-09T06:43:32.598256+0000","last_clean":"2023-10-09T06:43:32.598256+0000","last_became_active":"2023-10-09T06:43:32.586749+0000","last_became_peered":"2023-10-09T06:43:32.586749+0000","last_unstale":"2023-10-09T06:43:32.598256+0000","last_undegraded":"2023-10-09T06:43:32.598256+0000","last_fullsized":"2023-10-09T06:43:32.598256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:15:13.252714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.614123+0000","last_change":"2023-10-09T06:43:31.582200+0000","last_active":"2023-10-09T06:43:32.614123+0000","last_peered":"2023-10-09T06:43:32.614123+0000","last_clean":"2023-10-09T06:43:32.614123+0000","last_became_active":"2023-10-09T06:43:31.581947+0000","last_became_peered":"2023-10-09T06:43:31.581947+0000","last_unstale":"2023-10-09T06:43:32.614123+0000","last_undegraded":"2023-10-09T06:43:32.614123+0000","last_fullsized":"2023-10-09T06:43:32.614123+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:31.583076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.615916+0000","last_change":"2023-10-09T06:43:32.603210+0000","last_active":"2023-10-09T06:43:32.615916+0000","last_peered":"2023-10-09T06:43:32.615916+0000","last_clean":"2023-10-09T06:43:32.615916+0000","last_became_active":"2023-10-09T06:43:32.602881+0000","last_became_peered":"2023-10-09T06:43:32.602881+0000","last_unstale":"2023-10-09T06:43:32.615916+0000","last_undegraded":"2023-10-09T06:43:32.615916+0000","last_fullsized":"2023-10-09T06:43:32.615916+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T06:43:56.155101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.617479+0000","last_change":"2023-10-09T06:43:31.581221+0000","last_active":"2023-10-09T06:43:32.617479+0000","last_peered":"2023-10-09T06:43:32.617479+0000","last_clean":"2023-10-09T06:43:32.617479+0000","last_became_active":"2023-10-09T06:43:31.580923+0000","last_became_peered":"2023-10-09T06:43:31.580923+0000","last_unstale":"2023-10-09T06:43:32.617479+0000","last_undegraded":"2023-10-09T06:43:32.617479+0000","last_fullsized":"2023-10-09T06:43:32.617479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:43.384282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.605202+0000","last_change":"2023-10-09T06:43:32.598532+0000","last_active":"2023-10-09T06:43:32.605202+0000","last_peered":"2023-10-09T06:43:32.605202+0000","last_clean":"2023-10-09T06:43:32.605202+0000","last_became_active":"2023-10-09T06:43:32.598214+0000","last_became_peered":"2023-10-09T06:43:32.598214+0000","last_unstale":"2023-10-09T06:43:32.605202+0000","last_undegraded":"2023-10-09T06:43:32.605202+0000","last_fullsized":"2023-10-09T06:43:32.605202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:32.691349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.579951+0000","last_change":"2023-10-09T06:43:31.585326+0000","last_active":"2023-10-09T06:43:32.579951+0000","last_peered":"2023-10-09T06:43:32.579951+0000","last_clean":"2023-10-09T06:43:32.579951+0000","last_became_active":"2023-10-09T06:43:31.585015+0000","last_became_peered":"2023-10-09T06:43:31.585015+0000","last_unstale":"2023-10-09T06:43:32.579951+0000","last_undegraded":"2023-10-09T06:43:32.579951+0000","last_fullsized":"2023-10-09T06:43:32.579951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:12:59.791856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.613330+0000","last_change":"2023-10-09T06:43:32.605686+0000","last_active":"2023-10-09T06:43:32.613330+0000","last_peered":"2023-10-09T06:43:32.613330+0000","last_clean":"2023-10-09T06:43:32.613330+0000","last_became_active":"2023-10-09T06:43:32.605337+0000","last_became_peered":"2023-10-09T06:43:32.605337+0000","last_unstale":"2023-10-09T06:43:32.613330+0000","last_undegraded":"2023-10-09T06:43:32.613330+0000","last_fullsized":"2023-10-09T06:43:32.613330+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:48:45.298662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.617102+0000","last_change":"2023-10-09T06:43:31.579815+0000","last_active":"2023-10-09T06:43:32.617102+0000","last_peered":"2023-10-09T06:43:32.617102+0000","last_clean":"2023-10-09T06:43:32.617102+0000","last_became_active":"2023-10-09T06:43:31.579569+0000","last_became_peered":"2023-10-09T06:43:31.579569+0000","last_unstale":"2023-10-09T06:43:32.617102+0000","last_undegraded":"2023-10-09T06:43:32.617102+0000","last_fullsized":"2023-10-09T06:43:32.617102+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:31.688662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.601252+0000","last_change":"2023-10-09T06:43:32.596945+0000","last_active":"2023-10-09T06:43:32.601252+0000","last_peered":"2023-10-09T06:43:32.601252+0000","last_clean":"2023-10-09T06:43:32.601252+0000","last_became_active":"2023-10-09T06:43:32.596679+0000","last_became_peered":"2023-10-09T06:43:32.596679+0000","last_unstale":"2023-10-09T06:43:32.601252+0000","last_undegraded":"2023-10-09T06:43:32.601252+0000","last_fullsized":"2023-10-09T06:43:32.601252+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:32.585763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.594773+0000","last_change":"2023-10-09T06:43:31.582436+0000","last_active":"2023-10-09T06:43:32.594773+0000","last_peered":"2023-10-09T06:43:32.594773+0000","last_clean":"2023-10-09T06:43:32.594773+0000","last_became_active":"2023-10-09T06:43:31.582133+0000","last_became_peered":"2023-10-09T06:43:31.582133+0000","last_unstale":"2023-10-09T06:43:32.594773+0000","last_undegraded":"2023-10-09T06:43:32.594773+0000","last_fullsized":"2023-10-09T06:43:32.594773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:48:44.295975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.601214+0000","last_change":"2023-10-09T06:43:32.598307+0000","last_active":"2023-10-09T06:43:32.601214+0000","last_peered":"2023-10-09T06:43:32.601214+0000","last_clean":"2023-10-09T06:43:32.601214+0000","last_became_active":"2023-10-09T06:43:32.597975+0000","last_became_peered":"2023-10-09T06:43:32.597975+0000","last_unstale":"2023-10-09T06:43:32.601214+0000","last_undegraded":"2023-10-09T06:43:32.601214+0000","last_fullsized":"2023-10-09T06:43:32.601214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:15:10.966173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.580314+0000","last_change":"2023-10-09T06:43:31.572408+0000","last_active":"2023-10-09T06:43:32.580314+0000","last_peered":"2023-10-09T06:43:32.580314+0000","last_clean":"2023-10-09T06:43:32.580314+0000","last_became_active":"2023-10-09T06:43:31.572144+0000","last_became_peered":"2023-10-09T06:43:31.572144+0000","last_unstale":"2023-10-09T06:43:32.580314+0000","last_undegraded":"2023-10-09T06:43:32.580314+0000","last_fullsized":"2023-10-09T06:43:32.580314+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:49:32.843137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.606957+0000","last_change":"2023-10-09T06:43:32.600929+0000","last_active":"2023-10-09T06:43:32.606957+0000","last_peered":"2023-10-09T06:43:32.606957+0000","last_clean":"2023-10-09T06:43:32.606957+0000","last_became_active":"2023-10-09T06:43:32.600617+0000","last_became_peered":"2023-10-09T06:43:32.600617+0000","last_unstale":"2023-10-09T06:43:32.606957+0000","last_undegraded":"2023-10-09T06:43:32.606957+0000","last_fullsized":"2023-10-09T06:43:32.606957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:15:24.986946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.578977+0000","last_change":"2023-10-09T06:43:31.582351+0000","last_active":"2023-10-09T06:43:32.578977+0000","last_peered":"2023-10-09T06:43:32.578977+0000","last_clean":"2023-10-09T06:43:32.578977+0000","last_became_active":"2023-10-09T06:43:31.582079+0000","last_became_peered":"2023-10-09T06:43:31.582079+0000","last_unstale":"2023-10-09T06:43:32.578977+0000","last_undegraded":"2023-10-09T06:43:32.578977+0000","last_fullsized":"2023-10-09T06:43:32.578977+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:52.857606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.614973+0000","last_change":"2023-10-09T06:43:32.612523+0000","last_active":"2023-10-09T06:43:32.614973+0000","last_peered":"2023-10-09T06:43:32.614973+0000","last_clean":"2023-10-09T06:43:32.614973+0000","last_became_active":"2023-10-09T06:43:32.612126+0000","last_became_peered":"2023-10-09T06:43:32.612126+0000","last_unstale":"2023-10-09T06:43:32.614973+0000","last_undegraded":"2023-10-09T06:43:32.614973+0000","last_fullsized":"2023-10-09T06:43:32.614973+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:57.346641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.616864+0000","last_change":"2023-10-09T06:43:31.585000+0000","last_active":"2023-10-09T06:43:32.616864+0000","last_peered":"2023-10-09T06:43:32.616864+0000","last_clean":"2023-10-09T06:43:32.616864+0000","last_became_active":"2023-10-09T06:43:31.584704+0000","last_became_peered":"2023-10-09T06:43:31.584704+0000","last_unstale":"2023-10-09T06:43:32.616864+0000","last_undegraded":"2023-10-09T06:43:32.616864+0000","last_fullsized":"2023-10-09T06:43:32.616864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:33:17.299314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.615611+0000","last_change":"2023-10-09T06:43:32.614443+0000","last_active":"2023-10-09T06:43:32.615611+0000","last_peered":"2023-10-09T06:43:32.615611+0000","last_clean":"2023-10-09T06:43:32.615611+0000","last_became_active":"2023-10-09T06:43:32.613595+0000","last_became_peered":"2023-10-09T06:43:32.613595+0000","last_unstale":"2023-10-09T06:43:32.615611+0000","last_undegraded":"2023-10-09T06:43:32.615611+0000","last_fullsized":"2023-10-09T06:43:32.615611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:54.977377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.579069+0000","last_change":"2023-10-09T06:43:31.574479+0000","last_active":"2023-10-09T06:43:32.579069+0000","last_peered":"2023-10-09T06:43:32.579069+0000","last_clean":"2023-10-09T06:43:32.579069+0000","last_became_active":"2023-10-09T06:43:31.571653+0000","last_became_peered":"2023-10-09T06:43:31.571653+0000","last_unstale":"2023-10-09T06:43:32.579069+0000","last_undegraded":"2023-10-09T06:43:32.579069+0000","last_fullsized":"2023-10-09T06:43:32.579069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:48:44.295975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.613097+0000","last_change":"2023-10-09T06:43:32.609720+0000","last_active":"2023-10-09T06:43:32.613097+0000","last_peered":"2023-10-09T06:43:32.613097+0000","last_clean":"2023-10-09T06:43:32.613097+0000","last_became_active":"2023-10-09T06:43:32.609439+0000","last_became_peered":"2023-10-09T06:43:32.609439+0000","last_unstale":"2023-10-09T06:43:32.613097+0000","last_undegraded":"2023-10-09T06:43:32.613097+0000","last_fullsized":"2023-10-09T06:43:32.613097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:28.200993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.596050+0000","last_change":"2023-10-09T06:43:31.578306+0000","last_active":"2023-10-09T06:43:32.596050+0000","last_peered":"2023-10-09T06:43:32.596050+0000","last_clean":"2023-10-09T06:43:32.596050+0000","last_became_active":"2023-10-09T06:43:31.578049+0000","last_became_peered":"2023-10-09T06:43:31.578049+0000","last_unstale":"2023-10-09T06:43:32.596050+0000","last_undegraded":"2023-10-09T06:43:32.596050+0000","last_fullsized":"2023-10-09T06:43:32.596050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:19:55.938033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.610216+0000","last_change":"2023-10-09T06:43:32.606494+0000","last_active":"2023-10-09T06:43:32.610216+0000","last_peered":"2023-10-09T06:43:32.610216+0000","last_clean":"2023-10-09T06:43:32.610216+0000","last_became_active":"2023-10-09T06:43:32.606184+0000","last_became_peered":"2023-10-09T06:43:32.606184+0000","last_unstale":"2023-10-09T06:43:32.610216+0000","last_undegraded":"2023-10-09T06:43:32.610216+0000","last_fullsized":"2023-10-09T06:43:32.610216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:28.200993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.579778+0000","last_change":"2023-10-09T06:43:31.582574+0000","last_active":"2023-10-09T06:43:32.579778+0000","last_peered":"2023-10-09T06:43:32.579778+0000","last_clean":"2023-10-09T06:43:32.579778+0000","last_became_active":"2023-10-09T06:43:31.582321+0000","last_became_peered":"2023-10-09T06:43:31.582321+0000","last_unstale":"2023-10-09T06:43:32.579778+0000","last_undegraded":"2023-10-09T06:43:32.579778+0000","last_fullsized":"2023-10-09T06:43:32.579778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:19:55.938033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.607163+0000","last_change":"2023-10-09T06:43:32.604300+0000","last_active":"2023-10-09T06:43:32.607163+0000","last_peered":"2023-10-09T06:43:32.607163+0000","last_clean":"2023-10-09T06:43:32.607163+0000","last_became_active":"2023-10-09T06:43:32.602848+0000","last_became_peered":"2023-10-09T06:43:32.602848+0000","last_unstale":"2023-10-09T06:43:32.607163+0000","last_undegraded":"2023-10-09T06:43:32.607163+0000","last_fullsized":"2023-10-09T06:43:32.607163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:49.546526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.595577+0000","last_change":"2023-10-09T06:43:31.584968+0000","last_active":"2023-10-09T06:43:32.595577+0000","last_peered":"2023-10-09T06:43:32.595577+0000","last_clean":"2023-10-09T06:43:32.595577+0000","last_became_active":"2023-10-09T06:43:31.584655+0000","last_became_peered":"2023-10-09T06:43:31.584655+0000","last_unstale":"2023-10-09T06:43:32.595577+0000","last_undegraded":"2023-10-09T06:43:32.595577+0000","last_fullsized":"2023-10-09T06:43:32.595577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:26.901120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.615036+0000","last_change":"2023-10-09T06:43:32.605878+0000","last_active":"2023-10-09T06:43:32.615036+0000","last_peered":"2023-10-09T06:43:32.615036+0000","last_clean":"2023-10-09T06:43:32.615036+0000","last_became_active":"2023-10-09T06:43:32.605618+0000","last_became_peered":"2023-10-09T06:43:32.605618+0000","last_unstale":"2023-10-09T06:43:32.615036+0000","last_undegraded":"2023-10-09T06:43:32.615036+0000","last_fullsized":"2023-10-09T06:43:32.615036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:30:04.650694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.580414+0000","last_change":"2023-10-09T06:43:31.582691+0000","last_active":"2023-10-09T06:43:32.580414+0000","last_peered":"2023-10-09T06:43:32.580414+0000","last_clean":"2023-10-09T06:43:32.580414+0000","last_became_active":"2023-10-09T06:43:31.582414+0000","last_became_peered":"2023-10-09T06:43:31.582414+0000","last_unstale":"2023-10-09T06:43:32.580414+0000","last_undegraded":"2023-10-09T06:43:32.580414+0000","last_fullsized":"2023-10-09T06:43:32.580414+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:45.340210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.596599+0000","last_change":"2023-10-09T06:43:32.592082+0000","last_active":"2023-10-09T06:43:32.596599+0000","last_peered":"2023-10-09T06:43:32.596599+0000","last_clean":"2023-10-09T06:43:32.596599+0000","last_became_active":"2023-10-09T06:43:32.591194+0000","last_became_peered":"2023-10-09T06:43:32.591194+0000","last_unstale":"2023-10-09T06:43:32.596599+0000","last_undegraded":"2023-10-09T06:43:32.596599+0000","last_fullsized":"2023-10-09T06:43:32.596599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:00.654956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.583693+0000","last_change":"2023-10-09T06:43:31.585912+0000","last_active":"2023-10-09T06:43:32.583693+0000","last_peered":"2023-10-09T06:43:32.583693+0000","last_clean":"2023-10-09T06:43:32.583693+0000","last_became_active":"2023-10-09T06:43:31.585592+0000","last_became_peered":"2023-10-09T06:43:31.585592+0000","last_unstale":"2023-10-09T06:43:32.583693+0000","last_undegraded":"2023-10-09T06:43:32.583693+0000","last_fullsized":"2023-10-09T06:43:32.583693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:52.857606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.605874+0000","last_change":"2023-10-09T06:43:32.601538+0000","last_active":"2023-10-09T06:43:32.605874+0000","last_peered":"2023-10-09T06:43:32.605874+0000","last_clean":"2023-10-09T06:43:32.605874+0000","last_became_active":"2023-10-09T06:43:32.601293+0000","last_became_peered":"2023-10-09T06:43:32.601293+0000","last_unstale":"2023-10-09T06:43:32.605874+0000","last_undegraded":"2023-10-09T06:43:32.605874+0000","last_fullsized":"2023-10-09T06:43:32.605874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:31.559218+0000","last_clean_scrub_stamp":"2023-10-09T06:43:31.559218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:37:21.561094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.595641+0000","last_change":"2023-10-09T06:43:31.588384+0000","last_active":"2023-10-09T06:43:32.595641+0000","last_peered":"2023-10-09T06:43:32.595641+0000","last_clean":"2023-10-09T06:43:32.595641+0000","last_became_active":"2023-10-09T06:43:31.588110+0000","last_became_peered":"2023-10-09T06:43:31.588110+0000","last_unstale":"2023-10-09T06:43:32.595641+0000","last_undegraded":"2023-10-09T06:43:32.595641+0000","last_fullsized":"2023-10-09T06:43:32.595641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:43:30.556531+0000","last_clean_scrub_stamp":"2023-10-09T06:43:30.556531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:31.688662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T06:43:32.588994+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:43:32.588994+0000","last_peered":"2023-10-09T06:43:32.588994+0000","last_clean":"2023-10-09T06:43:32.588994+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:43:32.588994+0000","last_undegraded":"2023-10-09T06:43:32.588994+0000","last_fullsized":"2023-10-09T06:43:32.588994+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073616,"statfs":{"total":96636764160,"available":96331382784,"internally_reserved":0,"allocated":958464,"data_stored":729807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.448,"5min":3.448,"15min":3.448},"last":0.48199999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":5.617,"5min":5.617,"15min":5.617},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":0.54900000000000004}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":0.60499999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":5.5800000000000001,"5min":5.5800000000000001,"15min":5.5800000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":6.9299999999999997,"5min":6.9299999999999997,"15min":6.9299999999999997},"last":0.71899999999999997}]},{"osd":4,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":3.125,"5min":3.125,"15min":3.125},"last":0.432},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":4.8380000000000001,"5min":4.8380000000000001,"15min":4.8380000000000001},"last":0.70399999999999996}]},{"osd":5,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":4.1929999999999996,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":3.6749999999999998,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.64800000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":4.0250000000000004,"5min":4.0250000000000004,"15min":4.0250000000000004},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":7.0259999999999998,"5min":7.0259999999999998,"15min":7.0259999999999998},"last":0.66000000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":368640,"data_stored":139937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.64100000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59899999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.48699999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.67100000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.73399999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.626},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.747}]},{"osd":7,"last update":"Mon Oct 9 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.71999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":140907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.42699999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.48299999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.58599999999999997}]},{"osd":4,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.93899999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.92100000000000004}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.77000000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.95899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298220,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073620,"statfs":{"total":96636764160,"available":96331386880,"internally_reserved":0,"allocated":954368,"data_stored":729717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.42999999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.36299999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.376},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.54700000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.59799999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.52100000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.53600000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.58499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":364544,"data_stored":139419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.57799999999999996}]},{"osd":1,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":0.438}]},{"osd":3,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.48399999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.67800000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.63200000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.59599999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.66900000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":140907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.438},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.33800000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.38400000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.499}]},{"osd":4,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.65600000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.68999999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.61299999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.57699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":368640,"data_stored":139453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.73799999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.753}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.82699999999999996}]},{"osd":3,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.71899999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.625}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.80800000000000005}]},{"osd":7,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.872}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":368640,"data_stored":139993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.68400000000000005}]},{"osd":1,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.59399999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":0.752},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.61299999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":0.70899999999999996}]},{"osd":4,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.621}]},{"osd":6,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.5739999999999998,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.9609999999999999,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":0.73999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:43:42.169 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T06:43:42.169 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T06:43:42.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.389+0000 7f80aefff700 1 Processor -- start 2023-10-09T06:43:42.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.389+0000 7f80aefff700 1 -- start start 2023-10-09T06:43:42.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.390+0000 7f80aefff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f80a8159950 0x7f80a80cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:42.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.390+0000 7f80aefff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f80a8069c70 0x7f80a80cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:42.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.390+0000 7f80aefff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a80ce380 con 0x7f80a80af320 2023-10-09T06:43:42.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.390+0000 7f80aefff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a80cec20 con 0x7f80a8159950 2023-10-09T06:43:42.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.390+0000 7f80aefff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a80afa90 con 0x7f80a8069c70 2023-10-09T06:43:42.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.391+0000 7f80acd9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f80a8159950 0x7f80a80cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:42.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.391+0000 7f80acd9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f80a8159950 0x7f80a80cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37446/0 (socket says 172.21.15.71:37446) 2023-10-09T06:43:42.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.391+0000 7f80acd9b700 1 -- 172.21.15.71:0/1300484308 learned_addr learned my addr 172.21.15.71:0/1300484308 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:42.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.391+0000 7f80ad59c700 1 --2- 172.21.15.71:0/1300484308 >> v2:172.21.15.179:3300/0 conn(0x7f80a8069c70 0x7f80a80cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:42.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.391+0000 7f80acd9b700 1 -- 172.21.15.71:0/1300484308 >> v2:172.21.15.179:3300/0 conn(0x7f80a8069c70 msgr2=0x7f80a80cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:42.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.391+0000 7f80acd9b700 1 --2- 172.21.15.71:0/1300484308 >> v2:172.21.15.179:3300/0 conn(0x7f80a8069c70 0x7f80a80cf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:42.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.391+0000 7f80acd9b700 1 -- 172.21.15.71:0/1300484308 >> v1:172.21.15.179:6789/0 conn(0x7f80a80af320 legacy=0x7f80a8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:42.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.391+0000 7f80acd9b700 1 -- 172.21.15.71:0/1300484308 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a80ce5d0 con 0x7f80a8159950 2023-10-09T06:43:42.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.391+0000 7f80acd9b700 1 --2- 172.21.15.71:0/1300484308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a8159950 0x7f80a80cbb90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f80a8063d90 tx=0x7f809c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2426a995bbf52e18 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:42.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.392+0000 7f80a77fe700 1 -- 172.21.15.71:0/1300484308 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c00b860 con 0x7f80a8159950 2023-10-09T06:43:42.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.392+0000 7f80a77fe700 1 -- 172.21.15.71:0/1300484308 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c00b9c0 con 0x7f80a8159950 2023-10-09T06:43:42.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.392+0000 7f80a77fe700 1 -- 172.21.15.71:0/1300484308 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c00bd60 con 0x7f80a8159950 2023-10-09T06:43:42.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.392+0000 7f80aefff700 1 -- 172.21.15.71:0/1300484308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a8159950 msgr2=0x7f80a80cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:42.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.392+0000 7f80aefff700 1 --2- 172.21.15.71:0/1300484308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a8159950 0x7f80a80cbb90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f80a8063d90 tx=0x7f809c009250 comp rx=0 tx=0).stop 2023-10-09T06:43:42.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.392+0000 7f80aefff700 1 -- 172.21.15.71:0/1300484308 shutdown_connections 2023-10-09T06:43:42.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.392+0000 7f80aefff700 1 --2- 172.21.15.71:0/1300484308 >> v2:172.21.15.179:3300/0 conn(0x7f80a8069c70 0x7f80a80cf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:42.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.392+0000 7f80aefff700 1 --2- 172.21.15.71:0/1300484308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a8159950 0x7f80a80cbb90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:42.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.392+0000 7f80aefff700 1 -- 172.21.15.71:0/1300484308 >> 172.21.15.71:0/1300484308 conn(0x7f80a8068e00 msgr2=0x7f80a80d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:42.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.392+0000 7f80aefff700 1 -- 172.21.15.71:0/1300484308 shutdown_connections 2023-10-09T06:43:42.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.392+0000 7f80aefff700 1 -- 172.21.15.71:0/1300484308 wait complete. 2023-10-09T06:43:42.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.394+0000 7f80aefff700 1 Processor -- start 2023-10-09T06:43:42.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.394+0000 7f80aefff700 1 -- start start 2023-10-09T06:43:42.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.395+0000 7f80aefff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a8069c70 0x7f80a8152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:42.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.395+0000 7f80aefff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80a80af320 0x7f80a815cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:42.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.395+0000 7f80aefff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80a8159950 0x7f80a815d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:42.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.395+0000 7f80aefff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a81529b0 con 0x7f80a8069c70 2023-10-09T06:43:42.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.395+0000 7f80aefff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a8159060 con 0x7f80a8159950 2023-10-09T06:43:42.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.395+0000 7f80aefff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a815d0f0 con 0x7f80a80af320 2023-10-09T06:43:42.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.395+0000 7f80acd9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a8069c70 0x7f80a8152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:42.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.395+0000 7f80acd9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a8069c70 0x7f80a8152470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37456/0 (socket says 172.21.15.71:37456) 2023-10-09T06:43:42.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.395+0000 7f80acd9b700 1 -- 172.21.15.71:0/572707213 learned_addr learned my addr 172.21.15.71:0/572707213 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:42.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.395+0000 7f80ad59c700 1 --2- 172.21.15.71:0/572707213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80a8159950 0x7f80a815d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:42.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.395+0000 7f80acd9b700 1 -- 172.21.15.71:0/572707213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80a80af320 msgr2=0x7f80a815cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:42.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.395+0000 7f80a7fff700 1 --2- 172.21.15.71:0/572707213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80a80af320 0x7f80a815cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:42.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.395+0000 7f80acd9b700 1 --2- 172.21.15.71:0/572707213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80a80af320 0x7f80a815cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:42.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.395+0000 7f80acd9b700 1 -- 172.21.15.71:0/572707213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80a8159950 msgr2=0x7f80a815d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:42.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.395+0000 7f80acd9b700 1 --2- 172.21.15.71:0/572707213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80a8159950 0x7f80a815d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:42.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.395+0000 7f80acd9b700 1 -- 172.21.15.71:0/572707213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c0094f0 con 0x7f80a8069c70 2023-10-09T06:43:42.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.395+0000 7f80ad59c700 1 --2- 172.21.15.71:0/572707213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80a8159950 0x7f80a815d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:42.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.395+0000 7f80a7fff700 1 --2- 172.21.15.71:0/572707213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80a80af320 0x7f80a815cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:42.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.396+0000 7f80acd9b700 1 --2- 172.21.15.71:0/572707213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a8069c70 0x7f80a8152470 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f80a8070e20 tx=0x7f809c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:42.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.396+0000 7f80a4ff9700 1 -- 172.21.15.71:0/572707213 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c01a420 con 0x7f80a8069c70 2023-10-09T06:43:42.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.396+0000 7f80a4ff9700 1 -- 172.21.15.71:0/572707213 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c01a580 con 0x7f80a8069c70 2023-10-09T06:43:42.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.396+0000 7f80aefff700 1 -- 172.21.15.71:0/572707213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a8158d80 con 0x7f80a8069c70 2023-10-09T06:43:42.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.396+0000 7f80a4ff9700 1 -- 172.21.15.71:0/572707213 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c01a920 con 0x7f80a8069c70 2023-10-09T06:43:42.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.396+0000 7f80aefff700 1 -- 172.21.15.71:0/572707213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a80c8da0 con 0x7f80a8069c70 2023-10-09T06:43:42.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.397+0000 7f80aefff700 1 -- 172.21.15.71:0/572707213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a80c8920 con 0x7f80a8069c70 2023-10-09T06:43:42.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.398+0000 7f80a4ff9700 1 -- 172.21.15.71:0/572707213 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f809c01ad10 con 0x7f80a8069c70 2023-10-09T06:43:42.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.399+0000 7f80a4ff9700 1 --2- 172.21.15.71:0/572707213 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f808c066f30 0x7f808c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:42.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.399+0000 7f80a4ff9700 1 -- 172.21.15.71:0/572707213 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f809c086090 con 0x7f80a8069c70 2023-10-09T06:43:42.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.399+0000 7f80a7fff700 1 --2- 172.21.15.71:0/572707213 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f808c066f30 0x7f808c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:42.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.400+0000 7f80a7fff700 1 --2- 172.21.15.71:0/572707213 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f808c066f30 0x7f808c0693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8094001840 tx=0x7f8094009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:42.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.403+0000 7f80a4ff9700 1 -- 172.21.15.71:0/572707213 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80a80c8920 con 0x7f80a8069c70 2023-10-09T06:43:42.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.669+0000 7f80aefff700 1 -- 172.21.15.71:0/572707213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f80a80c8920 con 0x7f80a8069c70 2023-10-09T06:43:42.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.674+0000 7f80a4ff9700 1 -- 172.21.15.71:0/572707213 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7f80a80c8920 con 0x7f80a8069c70 2023-10-09T06:43:42.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.677+0000 7f80aefff700 1 -- 172.21.15.71:0/572707213 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f808c066f30 msgr2=0x7f808c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:42.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.677+0000 7f80aefff700 1 --2- 172.21.15.71:0/572707213 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f808c066f30 0x7f808c0693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8094001840 tx=0x7f8094009040 comp rx=0 tx=0).stop 2023-10-09T06:43:42.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.677+0000 7f80aefff700 1 -- 172.21.15.71:0/572707213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a8069c70 msgr2=0x7f80a8152470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:42.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.677+0000 7f80aefff700 1 --2- 172.21.15.71:0/572707213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a8069c70 0x7f80a8152470 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f80a8070e20 tx=0x7f809c017000 comp rx=0 tx=0).stop 2023-10-09T06:43:42.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.677+0000 7f80aefff700 1 -- 172.21.15.71:0/572707213 shutdown_connections 2023-10-09T06:43:42.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.677+0000 7f80aefff700 1 --2- 172.21.15.71:0/572707213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80a8159950 0x7f80a815d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:42.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.677+0000 7f80aefff700 1 --2- 172.21.15.71:0/572707213 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f808c066f30 0x7f808c0693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:42.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.677+0000 7f80aefff700 1 --2- 172.21.15.71:0/572707213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a8069c70 0x7f80a8152470 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:42.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.677+0000 7f80aefff700 1 --2- 172.21.15.71:0/572707213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80a80af320 0x7f80a815cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:42.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.677+0000 7f80aefff700 1 -- 172.21.15.71:0/572707213 >> 172.21.15.71:0/572707213 conn(0x7f80a8068e00 msgr2=0x7f80a8153090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:42.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.677+0000 7f80aefff700 1 -- 172.21.15.71:0/572707213 shutdown_connections 2023-10-09T06:43:42.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.677+0000 7f80aefff700 1 -- 172.21.15.71:0/572707213 wait complete. 2023-10-09T06:43:42.681 INFO:teuthology.orchestra.run.smithi071.stderr:updated caps for client.0 2023-10-09T06:43:42.696 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:43:42.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.874+0000 7f73193ff700 1 Processor -- start 2023-10-09T06:43:42.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.874+0000 7f73193ff700 1 -- start start 2023-10-09T06:43:42.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.875+0000 7f73193ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7314159c60 0x7f731415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:42.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.875+0000 7f73193ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f731415db10 0x7f7314069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:42.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.875+0000 7f73193ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f731415a160 con 0x7f7314159890 2023-10-09T06:43:42.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.875+0000 7f73193ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73140d13a0 con 0x7f731415db10 2023-10-09T06:43:42.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.875+0000 7f73193ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731415e140 con 0x7f7314159c60 2023-10-09T06:43:42.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.876+0000 7f73127fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7314159c60 0x7f731415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:42.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.876+0000 7f73137fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f731415db10 0x7f7314069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:42.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.876+0000 7f73127fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7314159c60 0x7f731415d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:37834/0 (socket says 172.21.15.71:37834) 2023-10-09T06:43:42.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.876+0000 7f73127fc700 1 -- 172.21.15.71:0/3805467224 learned_addr learned my addr 172.21.15.71:0/3805467224 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:42.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.876+0000 7f7312ffd700 1 --1- 172.21.15.71:0/3805467224 >> v1:172.21.15.179:6789/0 conn(0x7f7314159890 0x7f731415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:46490/0 (socket says 172.21.15.71:46490) 2023-10-09T06:43:42.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.876+0000 7f73127fc700 1 -- 172.21.15.71:0/3805467224 >> v2:172.21.15.179:3300/0 conn(0x7f731415db10 msgr2=0x7f7314069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:42.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.876+0000 7f73127fc700 1 --2- 172.21.15.71:0/3805467224 >> v2:172.21.15.179:3300/0 conn(0x7f731415db10 0x7f7314069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:42.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.876+0000 7f73127fc700 1 -- 172.21.15.71:0/3805467224 >> v1:172.21.15.179:6789/0 conn(0x7f7314159890 legacy=0x7f731415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:42.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.876+0000 7f73127fc700 1 -- 172.21.15.71:0/3805467224 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731415a3d0 con 0x7f7314159c60 2023-10-09T06:43:42.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.876+0000 7f7311ffb700 1 -- 172.21.15.71:0/3805467224 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362419255 0 0) 0x7f731415a160 con 0x7f7314159890 2023-10-09T06:43:42.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.876+0000 7f73137fe700 1 --2- 172.21.15.71:0/3805467224 >> v2:172.21.15.179:3300/0 conn(0x7f731415db10 0x7f7314069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:43:42.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.877+0000 7f73127fc700 1 --2- 172.21.15.71:0/3805467224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7314159c60 0x7f731415d5d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f73080099b0 tx=0x7f7308009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e988287dae17ae75 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:42.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.877+0000 7f7311ffb700 1 -- 172.21.15.71:0/3805467224 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7308009ea0 con 0x7f7314159c60 2023-10-09T06:43:42.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.877+0000 7f7311ffb700 1 -- 172.21.15.71:0/3805467224 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730800b860 con 0x7f7314159c60 2023-10-09T06:43:42.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.877+0000 7f7311ffb700 1 -- 172.21.15.71:0/3805467224 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730800bc00 con 0x7f7314159c60 2023-10-09T06:43:42.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.877+0000 7f73193ff700 1 -- 172.21.15.71:0/3805467224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7314159c60 msgr2=0x7f731415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:42.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.877+0000 7f73193ff700 1 --2- 172.21.15.71:0/3805467224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7314159c60 0x7f731415d5d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f73080099b0 tx=0x7f7308009250 comp rx=0 tx=0).stop 2023-10-09T06:43:42.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.878+0000 7f73193ff700 1 -- 172.21.15.71:0/3805467224 shutdown_connections 2023-10-09T06:43:42.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.878+0000 7f73193ff700 1 --2- 172.21.15.71:0/3805467224 >> v2:172.21.15.179:3300/0 conn(0x7f731415db10 0x7f7314069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:42.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.878+0000 7f73193ff700 1 --2- 172.21.15.71:0/3805467224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7314159c60 0x7f731415d5d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:42.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.878+0000 7f73193ff700 1 -- 172.21.15.71:0/3805467224 >> 172.21.15.71:0/3805467224 conn(0x7f7314068e20 msgr2=0x7f73140d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:42.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.878+0000 7f73193ff700 1 -- 172.21.15.71:0/3805467224 shutdown_connections 2023-10-09T06:43:42.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.878+0000 7f73193ff700 1 -- 172.21.15.71:0/3805467224 wait complete. 2023-10-09T06:43:42.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.879+0000 7f73193ff700 1 Processor -- start 2023-10-09T06:43:42.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.879+0000 7f73193ff700 1 -- start start 2023-10-09T06:43:42.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.880+0000 7f73193ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7314159890 0x7f731416acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:42.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.880+0000 7f73193ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7314159c60 0x7f73140b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:42.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.880+0000 7f73193ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f731415db10 0x7f73140b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:42.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.880+0000 7f73193ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73140b0f90 con 0x7f7314159890 2023-10-09T06:43:42.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.880+0000 7f73193ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73140b6190 con 0x7f7314159c60 2023-10-09T06:43:42.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.880+0000 7f73193ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73140b6440 con 0x7f731415db10 2023-10-09T06:43:42.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.880+0000 7f7312ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7314159890 0x7f731416acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:42.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.880+0000 7f7312ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7314159890 0x7f731416acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37466/0 (socket says 172.21.15.71:37466) 2023-10-09T06:43:42.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.880+0000 7f7312ffd700 1 -- 172.21.15.71:0/1296911390 learned_addr learned my addr 172.21.15.71:0/1296911390 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:42.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.881+0000 7f73127fc700 1 --2- 172.21.15.71:0/1296911390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7314159c60 0x7f73140b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:42.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.881+0000 7f73137fe700 1 --2- 172.21.15.71:0/1296911390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f731415db10 0x7f73140b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:42.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.881+0000 7f7312ffd700 1 -- 172.21.15.71:0/1296911390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f731415db10 msgr2=0x7f73140b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:42.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.881+0000 7f7312ffd700 1 --2- 172.21.15.71:0/1296911390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f731415db10 0x7f73140b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:42.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.881+0000 7f7312ffd700 1 -- 172.21.15.71:0/1296911390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7314159c60 msgr2=0x7f73140b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:42.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.881+0000 7f7312ffd700 1 --2- 172.21.15.71:0/1296911390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7314159c60 0x7f73140b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:42.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.881+0000 7f7312ffd700 1 -- 172.21.15.71:0/1296911390 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730c009a20 con 0x7f7314159890 2023-10-09T06:43:42.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.881+0000 7f73137fe700 1 --2- 172.21.15.71:0/1296911390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f731415db10 0x7f73140b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:42.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.881+0000 7f7312ffd700 1 --2- 172.21.15.71:0/1296911390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7314159890 0x7f731416acb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f73040011e0 tx=0x7f7304007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:42.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.881+0000 7f72faffd700 1 -- 172.21.15.71:0/1296911390 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7304005a70 con 0x7f7314159890 2023-10-09T06:43:42.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.881+0000 7f72faffd700 1 -- 172.21.15.71:0/1296911390 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7304005bd0 con 0x7f7314159890 2023-10-09T06:43:42.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.881+0000 7f73193ff700 1 -- 172.21.15.71:0/1296911390 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73080094f0 con 0x7f7314159890 2023-10-09T06:43:42.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.881+0000 7f72faffd700 1 -- 172.21.15.71:0/1296911390 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73040070d0 con 0x7f7314159890 2023-10-09T06:43:42.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.881+0000 7f73193ff700 1 -- 172.21.15.71:0/1296911390 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73140b0940 con 0x7f7314159890 2023-10-09T06:43:42.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.882+0000 7f73193ff700 1 -- 172.21.15.71:0/1296911390 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731404c3c0 con 0x7f7314159890 2023-10-09T06:43:42.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.883+0000 7f72faffd700 1 -- 172.21.15.71:0/1296911390 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73040074c0 con 0x7f7314159890 2023-10-09T06:43:42.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.885+0000 7f72faffd700 1 --2- 172.21.15.71:0/1296911390 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7300066f30 0x7f73000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:42.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.885+0000 7f72faffd700 1 -- 172.21.15.71:0/1296911390 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7304083970 con 0x7f7314159890 2023-10-09T06:43:42.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.885+0000 7f73127fc700 1 --2- 172.21.15.71:0/1296911390 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7300066f30 0x7f73000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:42.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.886+0000 7f73127fc700 1 --2- 172.21.15.71:0/1296911390 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7300066f30 0x7f73000693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f73080099b0 tx=0x7f7308017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:42.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:42.889+0000 7f72faffd700 1 -- 172.21.15.71:0/1296911390 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f730404b5a0 con 0x7f7314159890 2023-10-09T06:43:43.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.119+0000 7f73193ff700 1 -- 172.21.15.71:0/1296911390 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f731406a5b0 con 0x7f7314159890 2023-10-09T06:43:43.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.120+0000 7f72faffd700 1 -- 172.21.15.71:0/1296911390 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f7304017020 con 0x7f7314159890 2023-10-09T06:43:43.121 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:43:43.121 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2315236875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":2315236875},{"type":"v1","addr":"172.21.15.71:6835","nonce":2315236875}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4628,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2455384244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2455384244},{"type":"v1","addr":"172.21.15.179:6836","nonce":2455384244}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3668669622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3668669622},{"type":"v1","addr":"172.21.15.179:6837","nonce":3668669622}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:43:32.039618+0000","modified":"2023-10-09T06:43:35.597837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4905":{"gid":4905,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6834/4010179291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":4010179291},{"type":"v1","addr":"172.21.15.71:6834","nonce":4010179291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T06:43:43.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.122+0000 7f73193ff700 1 -- 172.21.15.71:0/1296911390 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7300066f30 msgr2=0x7f73000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:43.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.122+0000 7f73193ff700 1 --2- 172.21.15.71:0/1296911390 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7300066f30 0x7f73000693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f73080099b0 tx=0x7f7308017000 comp rx=0 tx=0).stop 2023-10-09T06:43:43.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.122+0000 7f73193ff700 1 -- 172.21.15.71:0/1296911390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7314159890 msgr2=0x7f731416acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:43.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.122+0000 7f73193ff700 1 --2- 172.21.15.71:0/1296911390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7314159890 0x7f731416acb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f73040011e0 tx=0x7f7304007e10 comp rx=0 tx=0).stop 2023-10-09T06:43:43.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.122+0000 7f73193ff700 1 -- 172.21.15.71:0/1296911390 shutdown_connections 2023-10-09T06:43:43.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.122+0000 7f73193ff700 1 --2- 172.21.15.71:0/1296911390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f731415db10 0x7f73140b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.122+0000 7f73193ff700 1 --2- 172.21.15.71:0/1296911390 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7300066f30 0x7f73000693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.122+0000 7f73193ff700 1 --2- 172.21.15.71:0/1296911390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7314159890 0x7f731416acb0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.122+0000 7f73193ff700 1 --2- 172.21.15.71:0/1296911390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7314159c60 0x7f73140b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.122+0000 7f73193ff700 1 -- 172.21.15.71:0/1296911390 >> 172.21.15.71:0/1296911390 conn(0x7f7314068e20 msgr2=0x7f7314153170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:43.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.122+0000 7f73193ff700 1 -- 172.21.15.71:0/1296911390 shutdown_connections 2023-10-09T06:43:43.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.122+0000 7f73193ff700 1 -- 172.21.15.71:0/1296911390 wait complete. 2023-10-09T06:43:43.125 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 15 2023-10-09T06:43:43.543 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T06:43:32.039618+0000', 'modified': '2023-10-09T06:43:35.597837+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4905}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4905': {'gid': 4905, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.71:6834/4010179291', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6832', 'nonce': 4010179291}, {'type': 'v1', 'addr': '172.21.15.71:6834', 'nonce': 4010179291}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T06:43:43.544 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T06:43:43.544 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-09T06:43:43.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.727+0000 7f858739d700 1 Processor -- start 2023-10-09T06:43:43.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.727+0000 7f858739d700 1 -- start start 2023-10-09T06:43:43.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.728+0000 7f858739d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85801597f0 0x7f85800b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.728+0000 7f858739d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f858015d230 0x7f858015d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.728+0000 7f858739d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858015dbd0 con 0x7f8580159420 2023-10-09T06:43:43.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.728+0000 7f858739d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85800b11d0 con 0x7f858015d230 2023-10-09T06:43:43.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.728+0000 7f858739d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85800b14b0 con 0x7f85801597f0 2023-10-09T06:43:43.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.729+0000 7f8586b9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f858015d230 0x7f858015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.729+0000 7f858639b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f8580159420 0x7f85800b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:46494/0 (socket says 172.21.15.71:46494) 2023-10-09T06:43:43.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.729+0000 7f8586b9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f858015d230 0x7f858015d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:37908/0 (socket says 172.21.15.71:37908) 2023-10-09T06:43:43.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.729+0000 7f858639b700 1 -- 172.21.15.71:0/205718488 learned_addr learned my addr 172.21.15.71:0/205718488 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:43.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.729+0000 7f8585b9a700 1 --2- 172.21.15.71:0/205718488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85801597f0 0x7f85800b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.729+0000 7f8585b9a700 1 -- 172.21.15.71:0/205718488 >> v2:172.21.15.179:3300/0 conn(0x7f858015d230 msgr2=0x7f858015d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:43.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.729+0000 7f8585b9a700 1 --2- 172.21.15.71:0/205718488 >> v2:172.21.15.179:3300/0 conn(0x7f858015d230 0x7f858015d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.729+0000 7f8585b9a700 1 -- 172.21.15.71:0/205718488 >> v1:172.21.15.179:6789/0 conn(0x7f8580159420 legacy=0x7f85800b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:43.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.729+0000 7f8585b9a700 1 -- 172.21.15.71:0/205718488 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85800b1790 con 0x7f85801597f0 2023-10-09T06:43:43.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.729+0000 7f8586b9c700 1 --2- 172.21.15.71:0/205718488 >> v2:172.21.15.179:3300/0 conn(0x7f858015d230 0x7f858015d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:43:43.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.730+0000 7f8585b9a700 1 --2- 172.21.15.71:0/205718488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85801597f0 0x7f85800b2270 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f85700098e0 tx=0x7f85700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37d6268e39a2cd44 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:43.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.730+0000 7f8585399700 1 -- 172.21.15.71:0/205718488 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857000b640 con 0x7f85801597f0 2023-10-09T06:43:43.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.730+0000 7f8585399700 1 -- 172.21.15.71:0/205718488 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857000b7a0 con 0x7f85801597f0 2023-10-09T06:43:43.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.730+0000 7f8585399700 1 -- 172.21.15.71:0/205718488 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857000bb40 con 0x7f85801597f0 2023-10-09T06:43:43.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.730+0000 7f858739d700 1 -- 172.21.15.71:0/205718488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85801597f0 msgr2=0x7f85800b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:43.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.730+0000 7f858739d700 1 --2- 172.21.15.71:0/205718488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85801597f0 0x7f85800b2270 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f85700098e0 tx=0x7f85700091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.731+0000 7f858739d700 1 -- 172.21.15.71:0/205718488 shutdown_connections 2023-10-09T06:43:43.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.731+0000 7f858739d700 1 --2- 172.21.15.71:0/205718488 >> v2:172.21.15.179:3300/0 conn(0x7f858015d230 0x7f858015d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.731+0000 7f858739d700 1 --2- 172.21.15.71:0/205718488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85801597f0 0x7f85800b2270 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.731+0000 7f858739d700 1 -- 172.21.15.71:0/205718488 >> 172.21.15.71:0/205718488 conn(0x7f85800d0660 msgr2=0x7f85800d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:43.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.731+0000 7f858739d700 1 -- 172.21.15.71:0/205718488 shutdown_connections 2023-10-09T06:43:43.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.731+0000 7f858739d700 1 -- 172.21.15.71:0/205718488 wait complete. 2023-10-09T06:43:43.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.732+0000 7f858739d700 1 Processor -- start 2023-10-09T06:43:43.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.732+0000 7f858739d700 1 -- start start 2023-10-09T06:43:43.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.733+0000 7f858739d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8580159420 0x7f85800cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.733+0000 7f858739d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85801597f0 0x7f858016e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.733+0000 7f858739d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f858015d230 0x7f85801444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.733+0000 7f858739d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858016e9c0 con 0x7f8580159420 2023-10-09T06:43:43.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.733+0000 7f858739d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85800cc3b0 con 0x7f85801597f0 2023-10-09T06:43:43.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.733+0000 7f858739d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85800cb7a0 con 0x7f858015d230 2023-10-09T06:43:43.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.733+0000 7f858639b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8580159420 0x7f85800cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.733+0000 7f858639b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8580159420 0x7f85800cb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37480/0 (socket says 172.21.15.71:37480) 2023-10-09T06:43:43.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.733+0000 7f858639b700 1 -- 172.21.15.71:0/2447914701 learned_addr learned my addr 172.21.15.71:0/2447914701 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:43.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.733+0000 7f8585b9a700 1 --2- 172.21.15.71:0/2447914701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85801597f0 0x7f858016e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.733+0000 7f8586b9c700 1 --2- 172.21.15.71:0/2447914701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f858015d230 0x7f85801444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.734+0000 7f858639b700 1 -- 172.21.15.71:0/2447914701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f858015d230 msgr2=0x7f85801444f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:43.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.734+0000 7f858639b700 1 --2- 172.21.15.71:0/2447914701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f858015d230 0x7f85801444f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.734+0000 7f858639b700 1 -- 172.21.15.71:0/2447914701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85801597f0 msgr2=0x7f858016e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:43.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.734+0000 7f858639b700 1 --2- 172.21.15.71:0/2447914701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85801597f0 0x7f858016e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.734+0000 7f858639b700 1 -- 172.21.15.71:0/2447914701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8578009a20 con 0x7f8580159420 2023-10-09T06:43:43.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.734+0000 7f858639b700 1 --2- 172.21.15.71:0/2447914701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8580159420 0x7f85800cb0c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f857c00c7c0 tx=0x7f857c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:43.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.734+0000 7f85767fc700 1 -- 172.21.15.71:0/2447914701 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c005b30 con 0x7f8580159420 2023-10-09T06:43:43.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.734+0000 7f85767fc700 1 -- 172.21.15.71:0/2447914701 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857c005c90 con 0x7f8580159420 2023-10-09T06:43:43.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.734+0000 7f858739d700 1 -- 172.21.15.71:0/2447914701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8570009420 con 0x7f8580159420 2023-10-09T06:43:43.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.734+0000 7f85767fc700 1 -- 172.21.15.71:0/2447914701 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c004a80 con 0x7f8580159420 2023-10-09T06:43:43.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.734+0000 7f858739d700 1 -- 172.21.15.71:0/2447914701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85800cbd60 con 0x7f8580159420 2023-10-09T06:43:43.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.736+0000 7f85767fc700 1 -- 172.21.15.71:0/2447914701 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f857c0070d0 con 0x7f8580159420 2023-10-09T06:43:43.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.737+0000 7f85767fc700 1 --2- 172.21.15.71:0/2447914701 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8564067000 0x7f85640694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.737+0000 7f85767fc700 1 -- 172.21.15.71:0/2447914701 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f857c083650 con 0x7f8580159420 2023-10-09T06:43:43.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.738+0000 7f8585b9a700 1 --2- 172.21.15.71:0/2447914701 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8564067000 0x7f85640694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.739+0000 7f8585b9a700 1 --2- 172.21.15.71:0/2447914701 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8564067000 0x7f85640694b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f85700093f0 tx=0x7f8570017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:43.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.739+0000 7f8596dafb80 1 Processor -- start 2023-10-09T06:43:43.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.739+0000 7f8596dafb80 1 -- start start 2023-10-09T06:43:43.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.740+0000 7f8596dafb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea85680480 0x55ea8565f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.740+0000 7f8596dafb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea856335f0 0x55ea85680850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.740+0000 7f8596dafb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea85635b80 0x55ea85635ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.740+0000 7f8596dafb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea8558ca70 con 0x55ea85680480 2023-10-09T06:43:43.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.740+0000 7f8596dafb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea8558a270 con 0x55ea85635b80 2023-10-09T06:43:43.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.740+0000 7f8596dafb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea85586060 con 0x55ea856335f0 2023-10-09T06:43:43.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.740+0000 7f858639b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea85680480 0x55ea8565f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.740+0000 7f858639b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea85680480 0x55ea8565f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37482/0 (socket says 172.21.15.71:37482) 2023-10-09T06:43:43.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.740+0000 7f858639b700 1 -- 172.21.15.71:0/642316342 learned_addr learned my addr 172.21.15.71:0/642316342 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:43.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.740+0000 7f8585b9a700 1 --2- 172.21.15.71:0/642316342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea856335f0 0x55ea85680850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.740+0000 7f8586b9c700 1 --2- 172.21.15.71:0/642316342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea85635b80 0x55ea85635ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.741+0000 7f858639b700 1 -- 172.21.15.71:0/642316342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea856335f0 msgr2=0x55ea85680850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:43.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.741+0000 7f858639b700 1 --2- 172.21.15.71:0/642316342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea856335f0 0x55ea85680850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.741+0000 7f858639b700 1 -- 172.21.15.71:0/642316342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea85635b80 msgr2=0x55ea85635ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:43.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.741+0000 7f858639b700 1 --2- 172.21.15.71:0/642316342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea85635b80 0x55ea85635ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.741+0000 7f858639b700 1 -- 172.21.15.71:0/642316342 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea85420270 con 0x55ea85680480 2023-10-09T06:43:43.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.741+0000 7f858639b700 1 --2- 172.21.15.71:0/642316342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea85680480 0x55ea8565f7d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f857c00a040 tx=0x7f857c081a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a8f1616e5ac91bb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:43.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.741+0000 7f85637fe700 1 -- 172.21.15.71:0/642316342 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c0543f0 con 0x55ea85680480 2023-10-09T06:43:43.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.741+0000 7f85637fe700 1 -- 172.21.15.71:0/642316342 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857c054d20 con 0x55ea85680480 2023-10-09T06:43:43.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.741+0000 7f85637fe700 1 -- 172.21.15.71:0/642316342 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c054620 con 0x55ea85680480 2023-10-09T06:43:43.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.742+0000 7f8596dafb80 1 -- 172.21.15.71:0/642316342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea85680480 msgr2=0x55ea8565f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:43.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.742+0000 7f8596dafb80 1 --2- 172.21.15.71:0/642316342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea85680480 0x55ea8565f7d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f857c00a040 tx=0x7f857c081a30 comp rx=0 tx=0).stop 2023-10-09T06:43:43.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.742+0000 7f8596dafb80 1 -- 172.21.15.71:0/642316342 shutdown_connections 2023-10-09T06:43:43.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.742+0000 7f8596dafb80 1 --2- 172.21.15.71:0/642316342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea85635b80 0x55ea85635ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.742+0000 7f8596dafb80 1 --2- 172.21.15.71:0/642316342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea85680480 0x55ea8565f7d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.742+0000 7f8596dafb80 1 --2- 172.21.15.71:0/642316342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea856335f0 0x55ea85680850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.742+0000 7f8596dafb80 1 -- 172.21.15.71:0/642316342 >> 172.21.15.71:0/642316342 conn(0x55ea856370c0 msgr2=0x55ea856378f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:43.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.742+0000 7f8596dafb80 1 -- 172.21.15.71:0/642316342 shutdown_connections 2023-10-09T06:43:43.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.742+0000 7f8596dafb80 1 -- 172.21.15.71:0/642316342 wait complete. 2023-10-09T06:43:43.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.743+0000 7f8596dafb80 1 -- start start 2023-10-09T06:43:43.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.743+0000 7f8596dafb80 1 Processor -- start 2023-10-09T06:43:43.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.744+0000 7f8596dafb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea856335f0 0x55ea8567d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.744+0000 7f8596dafb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea85635b80 0x55ea85661a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.744+0000 7f8596dafb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea85680480 0x55ea8568c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.744+0000 7f8596dafb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea85531890 con 0x55ea85635b80 2023-10-09T06:43:43.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.744+0000 7f8596dafb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea8554cea0 con 0x55ea85680480 2023-10-09T06:43:43.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.744+0000 7f8596dafb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea85408e30 con 0x55ea856335f0 2023-10-09T06:43:43.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.744+0000 7f8596dafb80 10 client.0 _ll_register_callbacks cb 0x55ea855f92c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:43:43.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.744+0000 7f8585b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea85635b80 0x55ea85661a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.744+0000 7f8585b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea85635b80 0x55ea85661a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37492/0 (socket says 172.21.15.71:37492) 2023-10-09T06:43:43.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.744+0000 7f8585b9a700 1 -- 172.21.15.71:0/1701751580 learned_addr learned my addr 172.21.15.71:0/1701751580 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:43.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.744+0000 7f858639b700 1 --2- 172.21.15.71:0/1701751580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea856335f0 0x55ea8567d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.744+0000 7f8586b9c700 1 --2- 172.21.15.71:0/1701751580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea85680480 0x55ea8568c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.745+0000 7f8585b9a700 1 -- 172.21.15.71:0/1701751580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea856335f0 msgr2=0x55ea8567d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:43.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.745+0000 7f8585b9a700 1 --2- 172.21.15.71:0/1701751580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea856335f0 0x55ea8567d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.745+0000 7f8585b9a700 1 -- 172.21.15.71:0/1701751580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea85680480 msgr2=0x55ea8568c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:43.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.745+0000 7f8585b9a700 1 --2- 172.21.15.71:0/1701751580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea85680480 0x55ea8568c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.745+0000 7f8585b9a700 1 -- 172.21.15.71:0/1701751580 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85800cbd60 con 0x55ea85635b80 2023-10-09T06:43:43.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.745+0000 7f8585b9a700 1 --2- 172.21.15.71:0/1701751580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea85635b80 0x55ea85661a90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f85800b15f0 tx=0x7f8570021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a70d4854190904 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:43.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.745+0000 7f8560ff9700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T06:43:43.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.745+0000 7f8560ff9700 1 -- 172.21.15.71:0/1701751580 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570030070 con 0x55ea85635b80 2023-10-09T06:43:43.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.745+0000 7f8560ff9700 1 -- 172.21.15.71:0/1701751580 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f857001ae30 con 0x55ea85635b80 2023-10-09T06:43:43.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.745+0000 7f8596dafb80 1 -- 172.21.15.71:0/1701751580 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ea8562acd0 con 0x55ea85635b80 2023-10-09T06:43:43.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.745+0000 7f8560ff9700 1 -- 172.21.15.71:0/1701751580 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8570021070 con 0x55ea85635b80 2023-10-09T06:43:43.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.745+0000 7f8596dafb80 10 client.5103 fetch_fsmap learned FSMap version 15 2023-10-09T06:43:43.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.745+0000 7f8596dafb80 1 -- 172.21.15.71:0/1701751580 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55ea853c2fe0 con 0x55ea85635b80 2023-10-09T06:43:43.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.746+0000 7f8560ff9700 1 -- 172.21.15.71:0/1701751580 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ea8562acd0 con 0x55ea85635b80 2023-10-09T06:43:43.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.746+0000 7f8560ff9700 1 -- 172.21.15.71:0/1701751580 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8570029630 con 0x55ea85635b80 2023-10-09T06:43:43.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.746+0000 7f8596dafb80 10 client.5103 fetch_fsmap finished waiting for FSMap version 15 2023-10-09T06:43:43.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.746+0000 7f8596dafb80 10 client.5103 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T06:43:43.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.746+0000 7f8596dafb80 20 client.5103 populate_metadata read hostname 'smithi071' 2023-10-09T06:43:43.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.746+0000 7f8596dafb80 1 --2- 172.21.15.71:0/1701751580 >> [v2:172.21.15.71:6832/4010179291,v1:172.21.15.71:6834/4010179291] conn(0x55ea8565e440 0x55ea8565f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.746+0000 7f8596dafb80 4 client.5103 mds_command: new command op to 4905 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T06:43:43.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.746+0000 7f8596dafb80 1 -- 172.21.15.71:0/1701751580 --> [v2:172.21.15.71:6832/4010179291,v1:172.21.15.71:6834/4010179291] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea85607aa0 con 0x55ea8565e440 2023-10-09T06:43:43.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.746+0000 7f858639b700 1 --2- 172.21.15.71:0/1701751580 >> [v2:172.21.15.71:6832/4010179291,v1:172.21.15.71:6834/4010179291] conn(0x55ea8565e440 0x55ea8565f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.746+0000 7f858639b700 1 --2- 172.21.15.71:0/1701751580 >> [v2:172.21.15.71:6832/4010179291,v1:172.21.15.71:6834/4010179291] conn(0x55ea8565e440 0x55ea8565f680 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a51269672344e349 server_cookie=f741e774328154f0 in_seq=0 out_seq=0 2023-10-09T06:43:43.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.746+0000 7f8560ff9700 10 client.5103 ms_handle_connect on v2:172.21.15.71:6832/4010179291 2023-10-09T06:43:43.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.747+0000 7f8560ff9700 1 -- 172.21.15.71:0/1701751580 <== mds.0 v2:172.21.15.71:6832/4010179291 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55ea85607aa0 con 0x55ea8565e440 2023-10-09T06:43:43.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.747+0000 7f8560ff9700 10 client.5103 handle_command_reply: tid=0 2023-10-09T06:43:43.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.747+0000 7f8596dafb80 1 client.5103 shutdown 2023-10-09T06:43:43.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.748+0000 7f8596dafb80 1 -- 172.21.15.71:0/1701751580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea85635b80 msgr2=0x55ea85661a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:43.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.748+0000 7f8596dafb80 1 --2- 172.21.15.71:0/1701751580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea85635b80 0x55ea85661a90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f85800b15f0 tx=0x7f8570021000 comp rx=0 tx=0).stop 2023-10-09T06:43:43.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.748+0000 7f8596dafb80 1 -- 172.21.15.71:0/1701751580 shutdown_connections 2023-10-09T06:43:43.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.748+0000 7f8596dafb80 1 --2- 172.21.15.71:0/1701751580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea85680480 0x55ea8568c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.748+0000 7f8596dafb80 1 --2- 172.21.15.71:0/1701751580 >> [v2:172.21.15.71:6832/4010179291,v1:172.21.15.71:6834/4010179291] conn(0x55ea8565e440 0x55ea8565f680 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.748+0000 7f8596dafb80 1 --2- 172.21.15.71:0/1701751580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea856335f0 0x55ea8567d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.748+0000 7f8596dafb80 1 --2- 172.21.15.71:0/1701751580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea85635b80 0x55ea85661a90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.748+0000 7f8560ff9700 0 client.5103 ms_handle_reset on v2:172.21.15.71:6832/4010179291 2023-10-09T06:43:43.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.748+0000 7f8596dafb80 1 -- 172.21.15.71:0/1701751580 >> 172.21.15.71:0/1701751580 conn(0x55ea856370c0 msgr2=0x55ea85639530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:43.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.748+0000 7f8596dafb80 1 -- 172.21.15.71:0/1701751580 shutdown_connections 2023-10-09T06:43:43.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.748+0000 7f8596dafb80 1 -- 172.21.15.71:0/1701751580 wait complete. 2023-10-09T06:43:43.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.748+0000 7f8596dafb80 20 client.5103 trim_cache size 0 max 16384 2023-10-09T06:43:43.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.765+0000 7f8596dafb80 1 Processor -- start 2023-10-09T06:43:43.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.765+0000 7f8596dafb80 1 -- start start 2023-10-09T06:43:43.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.766+0000 7f8596dafb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea856335f0 0x55ea8568eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.766+0000 7f8596dafb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea85635b80 0x55ea85632c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.766+0000 7f8596dafb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea85680480 0x55ea85659020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.766+0000 7f8596dafb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea856364c0 con 0x55ea856335f0 2023-10-09T06:43:43.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.766+0000 7f8596dafb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea8568f0a0 con 0x55ea85635b80 2023-10-09T06:43:43.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.766+0000 7f8596dafb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea8567f320 con 0x55ea85680480 2023-10-09T06:43:43.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.766+0000 7f858639b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea856335f0 0x55ea8568eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.766+0000 7f858639b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea856335f0 0x55ea8568eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37504/0 (socket says 172.21.15.71:37504) 2023-10-09T06:43:43.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.766+0000 7f858639b700 1 -- 172.21.15.71:0/4236683760 learned_addr learned my addr 172.21.15.71:0/4236683760 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:43.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.766+0000 7f8586b9c700 1 --2- 172.21.15.71:0/4236683760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea85680480 0x55ea85659020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.766+0000 7f8585b9a700 1 --2- 172.21.15.71:0/4236683760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea85635b80 0x55ea85632c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.767+0000 7f858639b700 1 -- 172.21.15.71:0/4236683760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea85680480 msgr2=0x55ea85659020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:43.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.767+0000 7f858639b700 1 --2- 172.21.15.71:0/4236683760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea85680480 0x55ea85659020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.767+0000 7f858639b700 1 -- 172.21.15.71:0/4236683760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea85635b80 msgr2=0x55ea85632c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:43.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.767+0000 7f858639b700 1 --2- 172.21.15.71:0/4236683760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea85635b80 0x55ea85632c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.767+0000 7f858639b700 1 -- 172.21.15.71:0/4236683760 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea85554780 con 0x55ea856335f0 2023-10-09T06:43:43.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.767+0000 7f858639b700 1 --2- 172.21.15.71:0/4236683760 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea856335f0 0x55ea8568eb60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f857c050b20 tx=0x7f857c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc019cf1cbe0a38 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:43.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.767+0000 7f8563fff700 1 -- 172.21.15.71:0/4236683760 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c062040 con 0x55ea856335f0 2023-10-09T06:43:43.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.767+0000 7f8563fff700 1 -- 172.21.15.71:0/4236683760 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857c05b640 con 0x55ea856335f0 2023-10-09T06:43:43.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.767+0000 7f8563fff700 1 -- 172.21.15.71:0/4236683760 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c054620 con 0x55ea856335f0 2023-10-09T06:43:43.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.768+0000 7f8596dafb80 1 -- 172.21.15.71:0/4236683760 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea856335f0 msgr2=0x55ea8568eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:43.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.768+0000 7f8596dafb80 1 --2- 172.21.15.71:0/4236683760 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea856335f0 0x55ea8568eb60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f857c050b20 tx=0x7f857c012000 comp rx=0 tx=0).stop 2023-10-09T06:43:43.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.768+0000 7f8596dafb80 1 -- 172.21.15.71:0/4236683760 shutdown_connections 2023-10-09T06:43:43.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.768+0000 7f8596dafb80 1 --2- 172.21.15.71:0/4236683760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea85680480 0x55ea85659020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.768+0000 7f8596dafb80 1 --2- 172.21.15.71:0/4236683760 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea856335f0 0x55ea8568eb60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.768+0000 7f8596dafb80 1 --2- 172.21.15.71:0/4236683760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea85635b80 0x55ea85632c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.768+0000 7f8596dafb80 1 -- 172.21.15.71:0/4236683760 >> 172.21.15.71:0/4236683760 conn(0x55ea856370c0 msgr2=0x55ea85639120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:43.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.768+0000 7f8596dafb80 1 -- 172.21.15.71:0/4236683760 shutdown_connections 2023-10-09T06:43:43.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.768+0000 7f8596dafb80 1 -- 172.21.15.71:0/4236683760 wait complete. 2023-10-09T06:43:43.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.768+0000 7f8596dafb80 1 -- start start 2023-10-09T06:43:43.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.768+0000 7f8596dafb80 1 Processor -- start 2023-10-09T06:43:43.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.769+0000 7f8596dafb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea856335f0 0x55ea856db730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.769+0000 7f8596dafb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea85635b80 0x55ea856dbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.769+0000 7f8596dafb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea85680480 0x55ea85637cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.769+0000 7f8596dafb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea856cf360 con 0x55ea856335f0 2023-10-09T06:43:43.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.769+0000 7f8596dafb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea85639220 con 0x55ea85635b80 2023-10-09T06:43:43.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.769+0000 7f8596dafb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea856e2bd0 con 0x55ea85680480 2023-10-09T06:43:43.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.769+0000 7f8596dafb80 10 client.0 _ll_register_callbacks cb 0x55ea855f92c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:43:43.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.770+0000 7f858639b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea856335f0 0x55ea856db730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.770+0000 7f858639b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea856335f0 0x55ea856db730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37520/0 (socket says 172.21.15.71:37520) 2023-10-09T06:43:43.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.770+0000 7f858639b700 1 -- 172.21.15.71:0/3463232293 learned_addr learned my addr 172.21.15.71:0/3463232293 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:43.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.770+0000 7f8585b9a700 1 --2- 172.21.15.71:0/3463232293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea85635b80 0x55ea856dbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.770+0000 7f8586b9c700 1 --2- 172.21.15.71:0/3463232293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea85680480 0x55ea85637cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.770+0000 7f858639b700 1 -- 172.21.15.71:0/3463232293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea85680480 msgr2=0x55ea85637cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:43.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.770+0000 7f858639b700 1 --2- 172.21.15.71:0/3463232293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea85680480 0x55ea85637cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.770+0000 7f858639b700 1 -- 172.21.15.71:0/3463232293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea85635b80 msgr2=0x55ea856dbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:43.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.770+0000 7f858639b700 1 --2- 172.21.15.71:0/3463232293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea85635b80 0x55ea856dbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.770+0000 7f858639b700 1 -- 172.21.15.71:0/3463232293 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea85420270 con 0x55ea856335f0 2023-10-09T06:43:43.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.770+0000 7f858639b700 1 --2- 172.21.15.71:0/3463232293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea856335f0 0x55ea856db730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f857c00ce60 tx=0x7f857c068000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9967b3c869356ba server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:43.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.770+0000 7f8560ff9700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T06:43:43.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.770+0000 7f8560ff9700 1 -- 172.21.15.71:0/3463232293 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c054620 con 0x55ea856335f0 2023-10-09T06:43:43.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.771+0000 7f8596dafb80 1 -- 172.21.15.71:0/3463232293 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ea8565e090 con 0x55ea856335f0 2023-10-09T06:43:43.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.771+0000 7f8560ff9700 1 -- 172.21.15.71:0/3463232293 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f857c062040 con 0x55ea856335f0 2023-10-09T06:43:43.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.771+0000 7f8560ff9700 1 -- 172.21.15.71:0/3463232293 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f857c005e00 con 0x55ea856335f0 2023-10-09T06:43:43.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.771+0000 7f8596dafb80 10 client.5109 fetch_fsmap learned FSMap version 15 2023-10-09T06:43:43.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.771+0000 7f8596dafb80 1 -- 172.21.15.71:0/3463232293 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55ea8553b470 con 0x55ea856335f0 2023-10-09T06:43:43.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.771+0000 7f8560ff9700 1 -- 172.21.15.71:0/3463232293 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ea8565e090 con 0x55ea856335f0 2023-10-09T06:43:43.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.771+0000 7f8560ff9700 1 -- 172.21.15.71:0/3463232293 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f857c05b130 con 0x55ea856335f0 2023-10-09T06:43:43.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.771+0000 7f8596dafb80 10 client.5109 fetch_fsmap finished waiting for FSMap version 15 2023-10-09T06:43:43.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.771+0000 7f8596dafb80 10 client.5109 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T06:43:43.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.771+0000 7f8596dafb80 20 client.5109 populate_metadata read hostname 'smithi071' 2023-10-09T06:43:43.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.771+0000 7f8596dafb80 1 --2- 172.21.15.71:0/3463232293 >> [v2:172.21.15.71:6832/4010179291,v1:172.21.15.71:6834/4010179291] conn(0x55ea85660260 0x55ea856381f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.771+0000 7f8596dafb80 4 client.5109 mds_command: new command op to 4905 tid=0[{"prefix": "status"}] 2023-10-09T06:43:43.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.771+0000 7f8596dafb80 1 -- 172.21.15.71:0/3463232293 --> [v2:172.21.15.71:6832/4010179291,v1:172.21.15.71:6834/4010179291] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f857c054d20 con 0x55ea85660260 2023-10-09T06:43:43.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.771+0000 7f8585b9a700 1 --2- 172.21.15.71:0/3463232293 >> [v2:172.21.15.71:6832/4010179291,v1:172.21.15.71:6834/4010179291] conn(0x55ea85660260 0x55ea856381f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.772+0000 7f8560ff9700 10 client.5109 ms_handle_connect on v2:172.21.15.71:6832/4010179291 2023-10-09T06:43:43.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.772+0000 7f8585b9a700 1 --2- 172.21.15.71:0/3463232293 >> [v2:172.21.15.71:6832/4010179291,v1:172.21.15.71:6834/4010179291] conn(0x55ea85660260 0x55ea856381f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cab308ff355e771e server_cookie=a604ce9e73218ccd in_seq=0 out_seq=0 2023-10-09T06:43:43.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.772+0000 7f8560ff9700 1 -- 172.21.15.71:0/3463232293 <== mds.0 v2:172.21.15.71:6832/4010179291 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7f857c054d20 con 0x55ea85660260 2023-10-09T06:43:43.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.772+0000 7f8560ff9700 10 client.5109 handle_command_reply: tid=0 2023-10-09T06:43:43.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.772+0000 7f8596dafb80 1 client.5109 shutdown 2023-10-09T06:43:43.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.772+0000 7f8596dafb80 1 -- 172.21.15.71:0/3463232293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea856335f0 msgr2=0x55ea856db730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:43.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.772+0000 7f8596dafb80 1 --2- 172.21.15.71:0/3463232293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea856335f0 0x55ea856db730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f857c00ce60 tx=0x7f857c068000 comp rx=0 tx=0).stop 2023-10-09T06:43:43.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.772+0000 7f8596dafb80 1 -- 172.21.15.71:0/3463232293 shutdown_connections 2023-10-09T06:43:43.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.772+0000 7f8596dafb80 1 --2- 172.21.15.71:0/3463232293 >> [v2:172.21.15.71:6832/4010179291,v1:172.21.15.71:6834/4010179291] conn(0x55ea85660260 0x55ea856381f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.772+0000 7f8596dafb80 1 --2- 172.21.15.71:0/3463232293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea85680480 0x55ea85637cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.772+0000 7f8596dafb80 1 --2- 172.21.15.71:0/3463232293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea856335f0 0x55ea856db730 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.772+0000 7f8560ff9700 0 client.5109 ms_handle_reset on v2:172.21.15.71:6832/4010179291 2023-10-09T06:43:43.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.772+0000 7f8596dafb80 1 --2- 172.21.15.71:0/3463232293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea85635b80 0x55ea856dbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.772+0000 7f8596dafb80 1 -- 172.21.15.71:0/3463232293 >> 172.21.15.71:0/3463232293 conn(0x55ea856370c0 msgr2=0x55ea8562cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:43.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.772+0000 7f8596dafb80 1 -- 172.21.15.71:0/3463232293 shutdown_connections 2023-10-09T06:43:43.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.772+0000 7f8596dafb80 1 -- 172.21.15.71:0/3463232293 wait complete. 2023-10-09T06:43:43.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.773+0000 7f8596dafb80 20 client.5109 trim_cache size 0 max 16384 2023-10-09T06:43:43.780 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T06:43:43.780 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "604c5619-653a-4ab6-912c-ab2e5464fe4a", 2023-10-09T06:43:43.780 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2023-10-09T06:43:43.780 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 4905, 2023-10-09T06:43:43.781 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2023-10-09T06:43:43.781 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2023-10-09T06:43:43.781 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2023-10-09T06:43:43.781 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 11.190007152, 2023-10-09T06:43:43.781 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 15, 2023-10-09T06:43:43.781 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 32, 2023-10-09T06:43:43.781 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 32, 2023-10-09T06:43:43.781 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 21.044712273999998 2023-10-09T06:43:43.781 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T06:43:43.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.773+0000 7f858739d700 1 -- 172.21.15.71:0/2447914701 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8564067000 msgr2=0x7f85640694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:43.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.773+0000 7f858739d700 1 --2- 172.21.15.71:0/2447914701 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8564067000 0x7f85640694b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f85700093f0 tx=0x7f8570017000 comp rx=0 tx=0).stop 2023-10-09T06:43:43.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.773+0000 7f858739d700 1 -- 172.21.15.71:0/2447914701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8580159420 msgr2=0x7f85800cb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:43.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.773+0000 7f858739d700 1 --2- 172.21.15.71:0/2447914701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8580159420 0x7f85800cb0c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f857c00c7c0 tx=0x7f857c007f70 comp rx=0 tx=0).stop 2023-10-09T06:43:43.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.773+0000 7f858739d700 1 -- 172.21.15.71:0/2447914701 shutdown_connections 2023-10-09T06:43:43.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.773+0000 7f858739d700 1 --2- 172.21.15.71:0/2447914701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f858015d230 0x7f85801444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.773+0000 7f858739d700 1 --2- 172.21.15.71:0/2447914701 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8564067000 0x7f85640694b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.773+0000 7f858739d700 1 --2- 172.21.15.71:0/2447914701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8580159420 0x7f85800cb0c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.773+0000 7f858739d700 1 --2- 172.21.15.71:0/2447914701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85801597f0 0x7f858016e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.773+0000 7f858739d700 1 -- 172.21.15.71:0/2447914701 >> 172.21.15.71:0/2447914701 conn(0x7f85800d0660 msgr2=0x7f8580156330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:43.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.773+0000 7f858739d700 1 -- 172.21.15.71:0/2447914701 shutdown_connections 2023-10-09T06:43:43.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.773+0000 7f858739d700 1 -- 172.21.15.71:0/2447914701 wait complete. 2023-10-09T06:43:43.791 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:43:43.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.968+0000 7fee9f9ff700 1 Processor -- start 2023-10-09T06:43:43.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.969+0000 7fee9f9ff700 1 -- start start 2023-10-09T06:43:43.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.970+0000 7fee9f9ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fee98155c10 0x7fee98155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.970+0000 7fee9f9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fee980ac230 0x7fee980ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.970+0000 7fee9f9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee980ad930 con 0x7fee981568a0 2023-10-09T06:43:43.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.970+0000 7fee9f9ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee980acd20 con 0x7fee98155c10 2023-10-09T06:43:43.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.970+0000 7fee9f9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee980ad000 con 0x7fee980ac230 2023-10-09T06:43:43.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.970+0000 7fee9d79b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fee98155c10 0x7fee98155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.970+0000 7fee9d79b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fee98155c10 0x7fee98155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37526/0 (socket says 172.21.15.71:37526) 2023-10-09T06:43:43.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.970+0000 7fee9d79b700 1 -- 172.21.15.71:0/1724871875 learned_addr learned my addr 172.21.15.71:0/1724871875 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:43.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.970+0000 7fee9cf9a700 1 --2- 172.21.15.71:0/1724871875 >> v2:172.21.15.179:3300/0 conn(0x7fee980ac230 0x7fee980ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.971+0000 7fee9d79b700 1 -- 172.21.15.71:0/1724871875 >> v2:172.21.15.179:3300/0 conn(0x7fee980ac230 msgr2=0x7fee980ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:43.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.971+0000 7fee9d79b700 1 --2- 172.21.15.71:0/1724871875 >> v2:172.21.15.179:3300/0 conn(0x7fee980ac230 0x7fee980ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.971+0000 7fee9d79b700 1 -- 172.21.15.71:0/1724871875 >> v1:172.21.15.179:6789/0 conn(0x7fee981568a0 legacy=0x7fee98156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:43.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.971+0000 7fee9d79b700 1 -- 172.21.15.71:0/1724871875 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee980ad2e0 con 0x7fee98155c10 2023-10-09T06:43:43.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.971+0000 7fee9cf9a700 1 --2- 172.21.15.71:0/1724871875 >> v2:172.21.15.179:3300/0 conn(0x7fee980ac230 0x7fee980ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:43.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.971+0000 7fee9d79b700 1 --2- 172.21.15.71:0/1724871875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee98155c10 0x7fee98155fe0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fee98065bb0 tx=0x7fee94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37cef69b8a0597fe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:43.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.971+0000 7fee8ffff700 1 -- 172.21.15.71:0/1724871875 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9400b860 con 0x7fee98155c10 2023-10-09T06:43:43.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.971+0000 7fee8ffff700 1 -- 172.21.15.71:0/1724871875 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9400b9c0 con 0x7fee98155c10 2023-10-09T06:43:43.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.971+0000 7fee8ffff700 1 -- 172.21.15.71:0/1724871875 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9400bd60 con 0x7fee98155c10 2023-10-09T06:43:43.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.972+0000 7fee9f9ff700 1 -- 172.21.15.71:0/1724871875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee98155c10 msgr2=0x7fee98155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:43.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.972+0000 7fee9f9ff700 1 --2- 172.21.15.71:0/1724871875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee98155c10 0x7fee98155fe0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fee98065bb0 tx=0x7fee94009250 comp rx=0 tx=0).stop 2023-10-09T06:43:43.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.972+0000 7fee9f9ff700 1 -- 172.21.15.71:0/1724871875 shutdown_connections 2023-10-09T06:43:43.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.972+0000 7fee9f9ff700 1 --2- 172.21.15.71:0/1724871875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee98155c10 0x7fee98155fe0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.972+0000 7fee9f9ff700 1 --2- 172.21.15.71:0/1724871875 >> v2:172.21.15.179:3300/0 conn(0x7fee980ac230 0x7fee980ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.972+0000 7fee9f9ff700 1 -- 172.21.15.71:0/1724871875 >> 172.21.15.71:0/1724871875 conn(0x7fee9806a320 msgr2=0x7fee980cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:43.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.972+0000 7fee9f9ff700 1 -- 172.21.15.71:0/1724871875 shutdown_connections 2023-10-09T06:43:43.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.972+0000 7fee9f9ff700 1 -- 172.21.15.71:0/1724871875 wait complete. 2023-10-09T06:43:43.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.973+0000 7fee9f9ff700 1 Processor -- start 2023-10-09T06:43:43.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.973+0000 7fee9f9ff700 1 -- start start 2023-10-09T06:43:43.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.974+0000 7fee9f9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee980ac230 0x7fee981419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.974+0000 7fee9f9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee98155c10 0x7fee98143920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.974+0000 7fee9f9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee981568a0 0x7fee98143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.974+0000 7fee9f9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee98147970 con 0x7fee980ac230 2023-10-09T06:43:43.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.974+0000 7fee9f9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee98147c50 con 0x7fee98155c10 2023-10-09T06:43:43.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.974+0000 7fee9f9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee98147f30 con 0x7fee981568a0 2023-10-09T06:43:43.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.974+0000 7fee9d79b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee980ac230 0x7fee981419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.974+0000 7fee9d79b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee980ac230 0x7fee981419d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37538/0 (socket says 172.21.15.71:37538) 2023-10-09T06:43:43.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.974+0000 7fee9d79b700 1 -- 172.21.15.71:0/592816236 learned_addr learned my addr 172.21.15.71:0/592816236 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:43.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.975+0000 7fee9cf9a700 1 --2- 172.21.15.71:0/592816236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee98155c10 0x7fee98143920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.975+0000 7fee9df9c700 1 --2- 172.21.15.71:0/592816236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee981568a0 0x7fee98143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.975+0000 7fee9d79b700 1 -- 172.21.15.71:0/592816236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee981568a0 msgr2=0x7fee98143e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:43.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.975+0000 7fee9d79b700 1 --2- 172.21.15.71:0/592816236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee981568a0 0x7fee98143e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.975+0000 7fee9d79b700 1 -- 172.21.15.71:0/592816236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee98155c10 msgr2=0x7fee98143920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:43.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.975+0000 7fee9d79b700 1 --2- 172.21.15.71:0/592816236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee98155c10 0x7fee98143920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:43.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.975+0000 7fee9d79b700 1 -- 172.21.15.71:0/592816236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee940094f0 con 0x7fee980ac230 2023-10-09T06:43:43.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.975+0000 7fee9cf9a700 1 --2- 172.21.15.71:0/592816236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee98155c10 0x7fee98143920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:43.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.975+0000 7fee9df9c700 1 --2- 172.21.15.71:0/592816236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee981568a0 0x7fee98143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:43.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.975+0000 7fee9d79b700 1 --2- 172.21.15.71:0/592816236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee980ac230 0x7fee981419d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fee94009290 tx=0x7fee94017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:43.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.975+0000 7fee8d7fa700 1 -- 172.21.15.71:0/592816236 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee94011e60 con 0x7fee980ac230 2023-10-09T06:43:43.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.975+0000 7fee8d7fa700 1 -- 172.21.15.71:0/592816236 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9401f070 con 0x7fee980ac230 2023-10-09T06:43:43.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.975+0000 7fee9f9ff700 1 -- 172.21.15.71:0/592816236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee98148210 con 0x7fee980ac230 2023-10-09T06:43:43.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.975+0000 7fee8d7fa700 1 -- 172.21.15.71:0/592816236 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9401a870 con 0x7fee980ac230 2023-10-09T06:43:43.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.976+0000 7fee9f9ff700 1 -- 172.21.15.71:0/592816236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee98148a10 con 0x7fee980ac230 2023-10-09T06:43:43.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.977+0000 7fee9f9ff700 1 -- 172.21.15.71:0/592816236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9804c3c0 con 0x7fee980ac230 2023-10-09T06:43:43.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.977+0000 7fee8d7fa700 1 -- 172.21.15.71:0/592816236 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee9401abe0 con 0x7fee980ac230 2023-10-09T06:43:43.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.978+0000 7fee8d7fa700 1 --2- 172.21.15.71:0/592816236 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fee7c066f30 0x7fee7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:43.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.979+0000 7fee8d7fa700 1 -- 172.21.15.71:0/592816236 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee94021070 con 0x7fee980ac230 2023-10-09T06:43:43.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.979+0000 7fee9cf9a700 1 --2- 172.21.15.71:0/592816236 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fee7c066f30 0x7fee7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:43.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.980+0000 7fee9cf9a700 1 --2- 172.21.15.71:0/592816236 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fee7c066f30 0x7fee7c0693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fee88006f00 tx=0x7fee88008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:43.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:43.983+0000 7fee8d7fa700 1 -- 172.21.15.71:0/592816236 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee94053800 con 0x7fee980ac230 2023-10-09T06:43:44.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:44.218+0000 7fee9f9ff700 1 -- 172.21.15.71:0/592816236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fee980ad5c0 con 0x7fee980ac230 2023-10-09T06:43:44.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:44.219+0000 7fee8d7fa700 1 -- 172.21.15.71:0/592816236 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7fee94056e20 con 0x7fee980ac230 2023-10-09T06:43:44.220 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:43:44.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:44.221+0000 7fee9f9ff700 1 -- 172.21.15.71:0/592816236 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fee7c066f30 msgr2=0x7fee7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:44.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:44.221+0000 7fee9f9ff700 1 --2- 172.21.15.71:0/592816236 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fee7c066f30 0x7fee7c0693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fee88006f00 tx=0x7fee88008040 comp rx=0 tx=0).stop 2023-10-09T06:43:44.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:44.221+0000 7fee9f9ff700 1 -- 172.21.15.71:0/592816236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee980ac230 msgr2=0x7fee981419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:44.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:44.221+0000 7fee9f9ff700 1 --2- 172.21.15.71:0/592816236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee980ac230 0x7fee981419d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fee94009290 tx=0x7fee94017000 comp rx=0 tx=0).stop 2023-10-09T06:43:44.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:44.221+0000 7fee9f9ff700 1 -- 172.21.15.71:0/592816236 shutdown_connections 2023-10-09T06:43:44.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:44.221+0000 7fee9f9ff700 1 --2- 172.21.15.71:0/592816236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee981568a0 0x7fee98143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:44.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:44.221+0000 7fee9f9ff700 1 --2- 172.21.15.71:0/592816236 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fee7c066f30 0x7fee7c0693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:44.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:44.221+0000 7fee9f9ff700 1 --2- 172.21.15.71:0/592816236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee980ac230 0x7fee981419d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:44.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:44.221+0000 7fee9f9ff700 1 --2- 172.21.15.71:0/592816236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee98155c10 0x7fee98143920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:44.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:44.221+0000 7fee9f9ff700 1 -- 172.21.15.71:0/592816236 >> 172.21.15.71:0/592816236 conn(0x7fee9806a320 msgr2=0x7fee980ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:44.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:44.222+0000 7fee9f9ff700 1 -- 172.21.15.71:0/592816236 shutdown_connections 2023-10-09T06:43:44.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:44.222+0000 7fee9f9ff700 1 -- 172.21.15.71:0/592816236 wait complete. 2023-10-09T06:43:44.240 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:43:44.240 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:43:44.240 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2023-10-09T06:43:44.240 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T06:43:44.240 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T06:43:44.240 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:43:44.241 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:43:44.241 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:43:44.241 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:43:44.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:44.241 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2023-10-09T06:43:44.277 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:43:44.278 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:43:44.278 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:43:44.278 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:44.278 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-10-09T06:43:44.278 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:44.278 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:43:44.278 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2023-10-09T06:43:44.278 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2023-10-09T06:43:44.279 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:43:44.279 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2023-10-09T06:43:44.279 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2023-10-09T06:43:44.279 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:43:44.279 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:43:44.279 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:43:44.279 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:43:44.279 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T06:43:44.279 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42212sec preferred_lft 42212sec 2023-10-09T06:43:44.279 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2023-10-09T06:43:44.279 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:44.280 INFO:teuthology.orchestra.run.smithi071.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:43:44.280 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5a:a1:ec:c7:41:8f brd ff:ff:ff:ff:ff:ff 2023-10-09T06:43:44.280 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:43:44.280 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:44.280 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::8052:a9ff:fe85:8756/64 scope link 2023-10-09T06:43:44.280 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:44.280 INFO:teuthology.orchestra.run.smithi071.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:43:44.280 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether ae:1f:c9:59:0c:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T06:43:44.281 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ac1f:c9ff:fe59:c1b/64 scope link 2023-10-09T06:43:44.281 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:44.281 INFO:teuthology.orchestra.run.smithi071.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:43:44.281 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5a:a1:ec:c7:41:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T06:43:44.281 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::58a1:ecff:fec7:418f/64 scope link 2023-10-09T06:43:44.281 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:43:44.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:44.281 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:43:44.376 INFO:teuthology.orchestra.run.smithi071.stdout:1 2023-10-09T06:43:44.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:44.379 DEBUG:teuthology.orchestra.run.smithi071:> route 2023-10-09T06:43:44.417 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2023-10-09T06:43:44.418 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:43:44.418 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T06:43:44.418 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T06:43:44.418 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:43:44.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:44.418 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-09T06:43:44.418 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-09T06:43:44.419 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T06:43:44.419 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T06:43:44.419 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T06:43:44.419 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-09T06:43:44.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:44.613 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-09T06:43:44.649 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T06:43:44.650 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T06:43:44.650 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:43:44.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:44.650 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2023-10-09T06:43:44.751 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:43:44.751 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T06:43:44.787 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:43:44.788 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:43:44.788 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:43:44.863 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T06:43:44.863 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:43:44.863 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:43:44.992 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:43:44.993 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:43:45.021 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:43:45.021 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:43:45.021 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.71:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-09T06:43:45.021 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with new device syntax: 0@604c5619-653a-4ab6-912c-ab2e5464fe4a.cephfs=/ 2023-10-09T06:43:45.021 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.71:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-10-09T06:43:45.025 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:43:45.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:43:45.025 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:43:45.087 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T06:43:45.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.268+0000 7ff48139d700 1 Processor -- start 2023-10-09T06:43:45.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.268+0000 7ff48139d700 1 -- start start 2023-10-09T06:43:45.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.269+0000 7ff48139d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff47c06a660 0x7ff47c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:45.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.269+0000 7ff48139d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47c06e2a0 con 0x7ff47c150180 2023-10-09T06:43:45.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.269+0000 7ff48139d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47c06b2e0 con 0x7ff47c150550 2023-10-09T06:43:45.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.269+0000 7ff48139d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47c0c78e0 con 0x7ff47c06a660 2023-10-09T06:43:45.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.269+0000 7ff47bfff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff47c150180 0x7ff47c0c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37554/0 (socket says 172.21.15.71:37554) 2023-10-09T06:43:45.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.269+0000 7ff47bfff700 1 -- 172.21.15.71:0/3958816877 learned_addr learned my addr 172.21.15.71:0/3958816877 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:45.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.270+0000 7ff480b9c700 1 --2- 172.21.15.71:0/3958816877 >> v2:172.21.15.179:3300/0 conn(0x7ff47c06a660 0x7ff47c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:45.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.270+0000 7ff47affd700 1 -- 172.21.15.71:0/3958816877 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966898096 0 0) 0x7ff47c06e2a0 con 0x7ff47c150180 2023-10-09T06:43:45.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.270+0000 7ff47affd700 1 -- 172.21.15.71:0/3958816877 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff464003570 con 0x7ff47c150180 2023-10-09T06:43:45.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.270+0000 7ff47affd700 1 -- 172.21.15.71:0/3958816877 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3692947550 0 0) 0x7ff464003570 con 0x7ff47c150180 2023-10-09T06:43:45.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.270+0000 7ff47affd700 1 -- 172.21.15.71:0/3958816877 >> v2:172.21.15.179:3300/0 conn(0x7ff47c06a660 msgr2=0x7ff47c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:45.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.270+0000 7ff47affd700 1 --2- 172.21.15.71:0/3958816877 >> v2:172.21.15.179:3300/0 conn(0x7ff47c06a660 0x7ff47c157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:45.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.270+0000 7ff47affd700 1 -- 172.21.15.71:0/3958816877 >> v1:172.21.15.179:6789/0 conn(0x7ff47c150550 legacy=0x7ff47c069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:45.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.270+0000 7ff47affd700 1 -- 172.21.15.71:0/3958816877 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c0c7bc0 con 0x7ff47c150180 2023-10-09T06:43:45.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.270+0000 7ff47affd700 1 -- 172.21.15.71:0/3958816877 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7ff46c001470 con 0x7ff47c150180 2023-10-09T06:43:45.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.270+0000 7ff47affd700 1 -- 172.21.15.71:0/3958816877 >> v1:172.21.15.71:6789/0 conn(0x7ff47c150180 legacy=0x7ff47c0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:45.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.270+0000 7ff47affd700 1 --2- 172.21.15.71:0/3958816877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff464003a90 0x7ff464003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:45.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.270+0000 7ff47affd700 1 --2- 172.21.15.71:0/3958816877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff464004810 0x7ff464004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:45.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.270+0000 7ff47affd700 1 --2- 172.21.15.71:0/3958816877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4640051c0 0x7ff46400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:45.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.270+0000 7ff47affd700 1 -- 172.21.15.71:0/3958816877 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c0c78e0 con 0x7ff464003a90 2023-10-09T06:43:45.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.270+0000 7ff47affd700 1 -- 172.21.15.71:0/3958816877 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46400c0b0 con 0x7ff4640051c0 2023-10-09T06:43:45.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.270+0000 7ff47affd700 1 -- 172.21.15.71:0/3958816877 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46400c270 con 0x7ff464004810 2023-10-09T06:43:45.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.270+0000 7ff47bfff700 1 --2- 172.21.15.71:0/3958816877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff464003a90 0x7ff464003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:45.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.271+0000 7ff47b7fe700 1 --2- 172.21.15.71:0/3958816877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff464004810 0x7ff464004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:45.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.271+0000 7ff480b9c700 1 --2- 172.21.15.71:0/3958816877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4640051c0 0x7ff46400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:45.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.271+0000 7ff47bfff700 1 -- 172.21.15.71:0/3958816877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff464004810 msgr2=0x7ff464004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:45.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.271+0000 7ff47bfff700 1 --2- 172.21.15.71:0/3958816877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff464004810 0x7ff464004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:45.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.271+0000 7ff47bfff700 1 -- 172.21.15.71:0/3958816877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4640051c0 msgr2=0x7ff46400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:45.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.271+0000 7ff47bfff700 1 --2- 172.21.15.71:0/3958816877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4640051c0 0x7ff46400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:45.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.271+0000 7ff47bfff700 1 -- 172.21.15.71:0/3958816877 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff464003570 con 0x7ff464003a90 2023-10-09T06:43:45.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.271+0000 7ff480b9c700 1 -- 172.21.15.71:0/3958816877 reap_dead start 2023-10-09T06:43:45.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.271+0000 7ff47bfff700 1 --2- 172.21.15.71:0/3958816877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff464003a90 0x7ff464003e60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff46c00c2d0 tx=0x7ff46c001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f2a16622ba2e92 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:45.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.271+0000 7ff47affd700 1 -- 172.21.15.71:0/3958816877 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c00cb60 con 0x7ff464003a90 2023-10-09T06:43:45.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.271+0000 7ff47affd700 1 -- 172.21.15.71:0/3958816877 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46c00cce0 con 0x7ff464003a90 2023-10-09T06:43:45.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.271+0000 7ff47affd700 1 -- 172.21.15.71:0/3958816877 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c005b70 con 0x7ff464003a90 2023-10-09T06:43:45.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.272+0000 7ff48139d700 1 -- 172.21.15.71:0/3958816877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff464003a90 msgr2=0x7ff464003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:45.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.272+0000 7ff48139d700 1 --2- 172.21.15.71:0/3958816877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff464003a90 0x7ff464003e60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff46c00c2d0 tx=0x7ff46c001da0 comp rx=0 tx=0).stop 2023-10-09T06:43:45.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.272+0000 7ff48139d700 1 -- 172.21.15.71:0/3958816877 shutdown_connections 2023-10-09T06:43:45.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.272+0000 7ff48139d700 1 --2- 172.21.15.71:0/3958816877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff464003a90 0x7ff464003e60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:45.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.272+0000 7ff48139d700 1 -- 172.21.15.71:0/3958816877 >> 172.21.15.71:0/3958816877 conn(0x7ff47c0cc1f0 msgr2=0x7ff47c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:45.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.272+0000 7ff48139d700 1 -- 172.21.15.71:0/3958816877 shutdown_connections 2023-10-09T06:43:45.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.272+0000 7ff48139d700 1 -- 172.21.15.71:0/3958816877 wait complete. 2023-10-09T06:43:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.273+0000 7ff48139d700 1 Processor -- start 2023-10-09T06:43:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.273+0000 7ff48139d700 1 -- start start 2023-10-09T06:43:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.274+0000 7ff48139d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff464003a90 0x7ff47c0abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.274+0000 7ff48139d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff47c0ae340 0x7ff47c169030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.274+0000 7ff48139d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff47c0caca0 0x7ff47c0cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.274+0000 7ff48139d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c14b890 con 0x7ff464003a90 2023-10-09T06:43:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.274+0000 7ff48139d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c0cb630 con 0x7ff47c0ae340 2023-10-09T06:43:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.274+0000 7ff48139d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c0ac090 con 0x7ff47c0caca0 2023-10-09T06:43:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.274+0000 7ff47bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff464003a90 0x7ff47c0abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.275+0000 7ff47bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff464003a90 0x7ff47c0abab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52234/0 (socket says 172.21.15.71:52234) 2023-10-09T06:43:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.275+0000 7ff47bfff700 1 -- 172.21.15.71:0/1119311424 learned_addr learned my addr 172.21.15.71:0/1119311424 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.275+0000 7ff47b7fe700 1 --2- 172.21.15.71:0/1119311424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff47c0ae340 0x7ff47c169030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.275+0000 7ff480b9c700 1 --2- 172.21.15.71:0/1119311424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff47c0caca0 0x7ff47c0cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.275+0000 7ff47bfff700 1 -- 172.21.15.71:0/1119311424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff47c0caca0 msgr2=0x7ff47c0cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.275+0000 7ff47bfff700 1 --2- 172.21.15.71:0/1119311424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff47c0caca0 0x7ff47c0cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.275+0000 7ff47bfff700 1 -- 172.21.15.71:0/1119311424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff47c0ae340 msgr2=0x7ff47c169030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.275+0000 7ff47bfff700 1 --2- 172.21.15.71:0/1119311424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff47c0ae340 0x7ff47c169030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.275+0000 7ff47bfff700 1 -- 172.21.15.71:0/1119311424 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c0ac370 con 0x7ff464003a90 2023-10-09T06:43:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.275+0000 7ff480b9c700 1 --2- 172.21.15.71:0/1119311424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff47c0caca0 0x7ff47c0cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.275+0000 7ff47bfff700 1 --2- 172.21.15.71:0/1119311424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff464003a90 0x7ff47c0abab0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff46c00c8c0 tx=0x7ff46c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.275+0000 7ff463fff700 1 -- 172.21.15.71:0/1119311424 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c022070 con 0x7ff464003a90 2023-10-09T06:43:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.275+0000 7ff463fff700 1 -- 172.21.15.71:0/1119311424 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46c00cb60 con 0x7ff464003a90 2023-10-09T06:43:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.275+0000 7ff463fff700 1 -- 172.21.15.71:0/1119311424 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c001da0 con 0x7ff464003a90 2023-10-09T06:43:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.275+0000 7ff48139d700 1 -- 172.21.15.71:0/1119311424 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47c0ac650 con 0x7ff464003a90 2023-10-09T06:43:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.276+0000 7ff48139d700 1 -- 172.21.15.71:0/1119311424 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47c169570 con 0x7ff464003a90 2023-10-09T06:43:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.276+0000 7ff48139d700 1 -- 172.21.15.71:0/1119311424 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47c0c3460 con 0x7ff464003a90 2023-10-09T06:43:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.277+0000 7ff463fff700 1 -- 172.21.15.71:0/1119311424 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff46c0075d0 con 0x7ff464003a90 2023-10-09T06:43:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.278+0000 7ff463fff700 1 --2- 172.21.15.71:0/1119311424 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff468066f30 0x7ff4680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.278+0000 7ff463fff700 1 -- 172.21.15.71:0/1119311424 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff46c085100 con 0x7ff464003a90 2023-10-09T06:43:45.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.279+0000 7ff47b7fe700 1 --2- 172.21.15.71:0/1119311424 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff468066f30 0x7ff4680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:45.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.279+0000 7ff47b7fe700 1 --2- 172.21.15.71:0/1119311424 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff468066f30 0x7ff4680693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff470007fd0 tx=0x7ff470009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.282+0000 7ff463fff700 1 -- 172.21.15.71:0/1119311424 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff46c0522d0 con 0x7ff464003a90 2023-10-09T06:43:45.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.497+0000 7ff48139d700 1 -- 172.21.15.71:0/1119311424 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff47c04c3c0 con 0x7ff468066f30 2023-10-09T06:43:45.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.499+0000 7ff463fff700 1 -- 172.21.15.71:0/1119311424 <== mgr.4102 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff47c04c3c0 con 0x7ff468066f30 2023-10-09T06:43:45.500 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-09T06:43:45.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:43:45.500 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cephfs" 2023-10-09T06:43:45.500 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:43:45.500 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-09T06:43:45.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.501+0000 7ff48139d700 1 -- 172.21.15.71:0/1119311424 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff468066f30 msgr2=0x7ff4680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:45.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.501+0000 7ff48139d700 1 --2- 172.21.15.71:0/1119311424 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff468066f30 0x7ff4680693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff470007fd0 tx=0x7ff470009040 comp rx=0 tx=0).stop 2023-10-09T06:43:45.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.501+0000 7ff48139d700 1 -- 172.21.15.71:0/1119311424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff464003a90 msgr2=0x7ff47c0abab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:45.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.501+0000 7ff48139d700 1 --2- 172.21.15.71:0/1119311424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff464003a90 0x7ff47c0abab0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff46c00c8c0 tx=0x7ff46c015000 comp rx=0 tx=0).stop 2023-10-09T06:43:45.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.501+0000 7ff48139d700 1 -- 172.21.15.71:0/1119311424 shutdown_connections 2023-10-09T06:43:45.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.501+0000 7ff48139d700 1 --2- 172.21.15.71:0/1119311424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff47c0caca0 0x7ff47c0cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:45.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.501+0000 7ff48139d700 1 --2- 172.21.15.71:0/1119311424 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff468066f30 0x7ff4680693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:45.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.501+0000 7ff48139d700 1 --2- 172.21.15.71:0/1119311424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff464003a90 0x7ff47c0abab0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:45.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.501+0000 7ff48139d700 1 --2- 172.21.15.71:0/1119311424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff47c0ae340 0x7ff47c169030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:45.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.501+0000 7ff48139d700 1 -- 172.21.15.71:0/1119311424 >> 172.21.15.71:0/1119311424 conn(0x7ff47c0cc1f0 msgr2=0x7ff47c15a090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:45.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.501+0000 7ff48139d700 1 -- 172.21.15.71:0/1119311424 shutdown_connections 2023-10-09T06:43:45.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.501+0000 7ff48139d700 1 -- 172.21.15.71:0/1119311424 wait complete. 2023-10-09T06:43:45.520 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-09T06:43:45.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.702+0000 7fbdbc7ff700 1 Processor -- start 2023-10-09T06:43:45.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.702+0000 7fbdbc7ff700 1 -- start start 2023-10-09T06:43:45.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.703+0000 7fbdbc7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdb4159890 0x7fbdb415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:45.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.703+0000 7fbdbc7ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbdb4159c60 0x7fbdb415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:45.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.703+0000 7fbdbc7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb415a160 con 0x7fbdb415db10 2023-10-09T06:43:45.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.703+0000 7fbdbc7ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb40d13a0 con 0x7fbdb4159c60 2023-10-09T06:43:45.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.703+0000 7fbdbc7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb415e140 con 0x7fbdb4159890 2023-10-09T06:43:45.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.704+0000 7fbdb9d9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbdb4159c60 0x7fbdb415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:45.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.704+0000 7fbdb9d9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbdb4159c60 0x7fbdb415d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52236/0 (socket says 172.21.15.71:52236) 2023-10-09T06:43:45.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.704+0000 7fbdb9d9a700 1 -- 172.21.15.71:0/3577187338 learned_addr learned my addr 172.21.15.71:0/3577187338 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:45.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.704+0000 7fbdb9d9a700 1 -- 172.21.15.71:0/3577187338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdb4159890 msgr2=0x7fbdb415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:45.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.704+0000 7fbdba59b700 1 --2- 172.21.15.71:0/3577187338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdb4159890 0x7fbdb415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:45.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.704+0000 7fbdb9d9a700 1 --2- 172.21.15.71:0/3577187338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdb4159890 0x7fbdb415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:45.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.704+0000 7fbdb9d9a700 1 -- 172.21.15.71:0/3577187338 >> v1:172.21.15.179:6789/0 conn(0x7fbdb415db10 legacy=0x7fbdb4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:45.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.704+0000 7fbdb9d9a700 1 -- 172.21.15.71:0/3577187338 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb415a3d0 con 0x7fbdb4159c60 2023-10-09T06:43:45.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.704+0000 7fbdba59b700 1 --2- 172.21.15.71:0/3577187338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdb4159890 0x7fbdb415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:45.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.704+0000 7fbdb9d9a700 1 --2- 172.21.15.71:0/3577187338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdb4159c60 0x7fbdb415d5d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbda40099b0 tx=0x7fbda4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f55fab5ee530e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:45.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.705+0000 7fbdb9599700 1 -- 172.21.15.71:0/3577187338 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda400b820 con 0x7fbdb4159c60 2023-10-09T06:43:45.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.705+0000 7fbdb9599700 1 -- 172.21.15.71:0/3577187338 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda400b980 con 0x7fbdb4159c60 2023-10-09T06:43:45.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.705+0000 7fbdb9599700 1 -- 172.21.15.71:0/3577187338 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda400bd20 con 0x7fbdb4159c60 2023-10-09T06:43:45.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.705+0000 7fbdbc7ff700 1 -- 172.21.15.71:0/3577187338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdb4159c60 msgr2=0x7fbdb415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:45.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.705+0000 7fbdbc7ff700 1 --2- 172.21.15.71:0/3577187338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdb4159c60 0x7fbdb415d5d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbda40099b0 tx=0x7fbda4009250 comp rx=0 tx=0).stop 2023-10-09T06:43:45.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.705+0000 7fbdbc7ff700 1 -- 172.21.15.71:0/3577187338 shutdown_connections 2023-10-09T06:43:45.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.705+0000 7fbdbc7ff700 1 --2- 172.21.15.71:0/3577187338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdb4159890 0x7fbdb415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:45.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.705+0000 7fbdbc7ff700 1 --2- 172.21.15.71:0/3577187338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdb4159c60 0x7fbdb415d5d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:45.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.705+0000 7fbdbc7ff700 1 -- 172.21.15.71:0/3577187338 >> 172.21.15.71:0/3577187338 conn(0x7fbdb4068e20 msgr2=0x7fbdb40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:45.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.705+0000 7fbdbc7ff700 1 -- 172.21.15.71:0/3577187338 shutdown_connections 2023-10-09T06:43:45.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.705+0000 7fbdbc7ff700 1 -- 172.21.15.71:0/3577187338 wait complete. 2023-10-09T06:43:45.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.707+0000 7fbdbc7ff700 1 Processor -- start 2023-10-09T06:43:45.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.707+0000 7fbdbc7ff700 1 -- start start 2023-10-09T06:43:45.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.708+0000 7fbdbc7ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdb4159890 0x7fbdb41523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:45.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.708+0000 7fbdbc7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdb4159c60 0x7fbdb40cf770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:45.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.708+0000 7fbdbc7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdb415db10 0x7fbdb40b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:45.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.708+0000 7fbdbc7ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb40cffa0 con 0x7fbdb4159890 2023-10-09T06:43:45.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.708+0000 7fbdbc7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb416e5a0 con 0x7fbdb4159c60 2023-10-09T06:43:45.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.708+0000 7fbdbc7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb416e110 con 0x7fbdb415db10 2023-10-09T06:43:45.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.708+0000 7fbdba59b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdb4159890 0x7fbdb41523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:45.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.708+0000 7fbdba59b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdb4159890 0x7fbdb41523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52248/0 (socket says 172.21.15.71:52248) 2023-10-09T06:43:45.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.708+0000 7fbdba59b700 1 -- 172.21.15.71:0/1128352357 learned_addr learned my addr 172.21.15.71:0/1128352357 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:45.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.708+0000 7fbdba59b700 1 -- 172.21.15.71:0/1128352357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdb415db10 msgr2=0x7fbdb40b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:45.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.708+0000 7fbdba59b700 1 --2- 172.21.15.71:0/1128352357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdb415db10 0x7fbdb40b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:45.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.708+0000 7fbdba59b700 1 -- 172.21.15.71:0/1128352357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdb4159c60 msgr2=0x7fbdb40cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:45.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.708+0000 7fbdba59b700 1 --2- 172.21.15.71:0/1128352357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdb4159c60 0x7fbdb40cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:45.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.708+0000 7fbdba59b700 1 -- 172.21.15.71:0/1128352357 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda40094f0 con 0x7fbdb4159890 2023-10-09T06:43:45.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.708+0000 7fbdba59b700 1 --2- 172.21.15.71:0/1128352357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdb4159890 0x7fbdb41523c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000c860 tx=0x7fbdb0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:45.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.709+0000 7fbdaa7fc700 1 -- 172.21.15.71:0/1128352357 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0011600 con 0x7fbdb4159890 2023-10-09T06:43:45.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.709+0000 7fbdaa7fc700 1 -- 172.21.15.71:0/1128352357 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb0011760 con 0x7fbdb4159890 2023-10-09T06:43:45.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.709+0000 7fbdbc7ff700 1 -- 172.21.15.71:0/1128352357 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb416d7e0 con 0x7fbdb4159890 2023-10-09T06:43:45.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.709+0000 7fbdaa7fc700 1 -- 172.21.15.71:0/1128352357 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0011b00 con 0x7fbdb4159890 2023-10-09T06:43:45.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.709+0000 7fbdbc7ff700 1 -- 172.21.15.71:0/1128352357 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb416dda0 con 0x7fbdb4159890 2023-10-09T06:43:45.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.710+0000 7fbdbc7ff700 1 -- 172.21.15.71:0/1128352357 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb404c3c0 con 0x7fbdb4159890 2023-10-09T06:43:45.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.711+0000 7fbdaa7fc700 1 -- 172.21.15.71:0/1128352357 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbdb000a3e0 con 0x7fbdb4159890 2023-10-09T06:43:45.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.711+0000 7fbdaa7fc700 1 --2- 172.21.15.71:0/1128352357 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbd98066f30 0x7fbd980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:45.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.712+0000 7fbdaa7fc700 1 -- 172.21.15.71:0/1128352357 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbdb0084520 con 0x7fbdb4159890 2023-10-09T06:43:45.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.712+0000 7fbdb9d9a700 1 --2- 172.21.15.71:0/1128352357 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbd98066f30 0x7fbd980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:45.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.713+0000 7fbdb9d9a700 1 --2- 172.21.15.71:0/1128352357 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbd98066f30 0x7fbd980693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbda40099b0 tx=0x7fbda4016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:45.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.715+0000 7fbdaa7fc700 1 -- 172.21.15.71:0/1128352357 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbdb0051790 con 0x7fbdb4159890 2023-10-09T06:43:45.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:45.958+0000 7fbdbc7ff700 1 -- 172.21.15.71:0/1128352357 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fbdb40b2de0 con 0x7fbdb4159890 2023-10-09T06:43:46.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.645+0000 7fbdaa7fc700 1 -- 172.21.15.71:0/1128352357 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 6) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fbdb0051b60 con 0x7fbdb4159890 2023-10-09T06:43:46.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.646+0000 7fbdaa7fc700 1 -- 172.21.15.71:0/1128352357 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v6) v1 ==== 92+0+0 (secure 0 0 0) 0x7fbdb0055220 con 0x7fbdb4159890 2023-10-09T06:43:46.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.650+0000 7fbdbc7ff700 1 -- 172.21.15.71:0/1128352357 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbd98066f30 msgr2=0x7fbd980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:46.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.650+0000 7fbdbc7ff700 1 --2- 172.21.15.71:0/1128352357 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbd98066f30 0x7fbd980693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbda40099b0 tx=0x7fbda4016000 comp rx=0 tx=0).stop 2023-10-09T06:43:46.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.650+0000 7fbdbc7ff700 1 -- 172.21.15.71:0/1128352357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdb4159890 msgr2=0x7fbdb41523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:46.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.650+0000 7fbdbc7ff700 1 --2- 172.21.15.71:0/1128352357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdb4159890 0x7fbdb41523c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000c860 tx=0x7fbdb0008040 comp rx=0 tx=0).stop 2023-10-09T06:43:46.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.650+0000 7fbdbc7ff700 1 -- 172.21.15.71:0/1128352357 shutdown_connections 2023-10-09T06:43:46.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.650+0000 7fbdbc7ff700 1 --2- 172.21.15.71:0/1128352357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdb415db10 0x7fbdb40b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:46.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.650+0000 7fbdbc7ff700 1 --2- 172.21.15.71:0/1128352357 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbd98066f30 0x7fbd980693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:46.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.650+0000 7fbdbc7ff700 1 --2- 172.21.15.71:0/1128352357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdb4159890 0x7fbdb41523c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:46.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.650+0000 7fbdbc7ff700 1 --2- 172.21.15.71:0/1128352357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdb4159c60 0x7fbdb40cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:46.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.650+0000 7fbdbc7ff700 1 -- 172.21.15.71:0/1128352357 >> 172.21.15.71:0/1128352357 conn(0x7fbdb4068e20 msgr2=0x7fbdb41571f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:46.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.650+0000 7fbdbc7ff700 1 -- 172.21.15.71:0/1128352357 shutdown_connections 2023-10-09T06:43:46.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.650+0000 7fbdbc7ff700 1 -- 172.21.15.71:0/1128352357 wait complete. 2023-10-09T06:43:46.671 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-09T06:43:46.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.865+0000 7f338359e700 1 Processor -- start 2023-10-09T06:43:46.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.866+0000 7f338359e700 1 -- start start 2023-10-09T06:43:46.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.867+0000 7f338359e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f33840b16d0 0x7f33840b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:46.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.867+0000 7f338359e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f33840b33b0 0x7f33840b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:46.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.867+0000 7f338359e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33840b2080 con 0x7f33840b4e70 2023-10-09T06:43:46.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.867+0000 7f338359e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33840cfb00 con 0x7f33840b16d0 2023-10-09T06:43:46.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.867+0000 7f338359e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33840b5c40 con 0x7f33840b33b0 2023-10-09T06:43:46.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.867+0000 7f3381d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f33840b16d0 0x7f33840b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:46.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.867+0000 7f3381d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f33840b16d0 0x7f33840b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52284/0 (socket says 172.21.15.71:52284) 2023-10-09T06:43:46.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.867+0000 7f3381d9b700 1 -- 172.21.15.71:0/1286127279 learned_addr learned my addr 172.21.15.71:0/1286127279 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:46.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.867+0000 7f3382d9d700 1 --2- 172.21.15.71:0/1286127279 >> v2:172.21.15.179:3300/0 conn(0x7f33840b33b0 0x7f33840b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:46.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.868+0000 7f3381d9b700 1 -- 172.21.15.71:0/1286127279 >> v2:172.21.15.179:3300/0 conn(0x7f33840b33b0 msgr2=0x7f33840b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:46.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.868+0000 7f3381d9b700 1 --2- 172.21.15.71:0/1286127279 >> v2:172.21.15.179:3300/0 conn(0x7f33840b33b0 0x7f33840b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:46.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.868+0000 7f3381d9b700 1 -- 172.21.15.71:0/1286127279 >> v1:172.21.15.179:6789/0 conn(0x7f33840b4e70 legacy=0x7f33840ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:46.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.868+0000 7f3381d9b700 1 -- 172.21.15.71:0/1286127279 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33840b5f20 con 0x7f33840b16d0 2023-10-09T06:43:46.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.868+0000 7f3381d9b700 1 --2- 172.21.15.71:0/1286127279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33840b16d0 0x7f33840b1b40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3384071380 tx=0x7f3378009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1ba358ae9432a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:46.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.868+0000 7f338159a700 1 -- 172.21.15.71:0/1286127279 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378009e70 con 0x7f33840b16d0 2023-10-09T06:43:46.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.868+0000 7f338159a700 1 -- 172.21.15.71:0/1286127279 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337800b860 con 0x7f33840b16d0 2023-10-09T06:43:46.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.868+0000 7f338159a700 1 -- 172.21.15.71:0/1286127279 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337800bc20 con 0x7f33840b16d0 2023-10-09T06:43:46.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.869+0000 7f338359e700 1 -- 172.21.15.71:0/1286127279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33840b16d0 msgr2=0x7f33840b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:46.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.869+0000 7f338359e700 1 --2- 172.21.15.71:0/1286127279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33840b16d0 0x7f33840b1b40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3384071380 tx=0x7f3378009250 comp rx=0 tx=0).stop 2023-10-09T06:43:46.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.869+0000 7f338359e700 1 -- 172.21.15.71:0/1286127279 shutdown_connections 2023-10-09T06:43:46.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.869+0000 7f338359e700 1 --2- 172.21.15.71:0/1286127279 >> v2:172.21.15.179:3300/0 conn(0x7f33840b33b0 0x7f33840b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:46.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.869+0000 7f338359e700 1 --2- 172.21.15.71:0/1286127279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33840b16d0 0x7f33840b1b40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:46.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.869+0000 7f338359e700 1 -- 172.21.15.71:0/1286127279 >> 172.21.15.71:0/1286127279 conn(0x7f33840d10c0 msgr2=0x7f33840affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:46.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.869+0000 7f338359e700 1 -- 172.21.15.71:0/1286127279 shutdown_connections 2023-10-09T06:43:46.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.869+0000 7f338359e700 1 -- 172.21.15.71:0/1286127279 wait complete. 2023-10-09T06:43:46.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.870+0000 7f338359e700 1 Processor -- start 2023-10-09T06:43:46.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.870+0000 7f338359e700 1 -- start start 2023-10-09T06:43:46.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.871+0000 7f338359e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33840b16d0 0x7f33840cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:46.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.871+0000 7f338359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33840b33b0 0x7f3384158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:46.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.871+0000 7f338359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33840b4e70 0x7f338415d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:46.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.871+0000 7f338359e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33840cc680 con 0x7f33840b16d0 2023-10-09T06:43:46.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.871+0000 7f338359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3384169d70 con 0x7f33840b4e70 2023-10-09T06:43:46.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.871+0000 7f338359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3384169fc0 con 0x7f33840b33b0 2023-10-09T06:43:46.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.872+0000 7f338259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33840b16d0 0x7f33840cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:46.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.872+0000 7f338259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33840b16d0 0x7f33840cb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52288/0 (socket says 172.21.15.71:52288) 2023-10-09T06:43:46.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.872+0000 7f338259c700 1 -- 172.21.15.71:0/1119710318 learned_addr learned my addr 172.21.15.71:0/1119710318 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:46.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.872+0000 7f3381d9b700 1 --2- 172.21.15.71:0/1119710318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33840b33b0 0x7f3384158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:46.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.872+0000 7f3382d9d700 1 --2- 172.21.15.71:0/1119710318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33840b4e70 0x7f338415d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:46.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.872+0000 7f338259c700 1 -- 172.21.15.71:0/1119710318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33840b33b0 msgr2=0x7f3384158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:46.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.872+0000 7f338259c700 1 --2- 172.21.15.71:0/1119710318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33840b33b0 0x7f3384158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:46.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.872+0000 7f338259c700 1 -- 172.21.15.71:0/1119710318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33840b4e70 msgr2=0x7f338415d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:46.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.872+0000 7f338259c700 1 --2- 172.21.15.71:0/1119710318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33840b4e70 0x7f338415d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:46.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.872+0000 7f338259c700 1 -- 172.21.15.71:0/1119710318 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33780094f0 con 0x7f33840b16d0 2023-10-09T06:43:46.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.872+0000 7f338259c700 1 --2- 172.21.15.71:0/1119710318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33840b16d0 0x7f33840cb5d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f337400c590 tx=0x7f337400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:46.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.873+0000 7f33727fc700 1 -- 172.21.15.71:0/1119710318 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3374011590 con 0x7f33840b16d0 2023-10-09T06:43:46.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.873+0000 7f33727fc700 1 -- 172.21.15.71:0/1119710318 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3374011710 con 0x7f33840b16d0 2023-10-09T06:43:46.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.873+0000 7f338359e700 1 -- 172.21.15.71:0/1119710318 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33840cbb10 con 0x7f33840b16d0 2023-10-09T06:43:46.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.873+0000 7f33727fc700 1 -- 172.21.15.71:0/1119710318 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3374011ad0 con 0x7f33840b16d0 2023-10-09T06:43:46.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.873+0000 7f338359e700 1 -- 172.21.15.71:0/1119710318 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33840cc3a0 con 0x7f33840b16d0 2023-10-09T06:43:46.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.874+0000 7f338359e700 1 -- 172.21.15.71:0/1119710318 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3384088990 con 0x7f33840b16d0 2023-10-09T06:43:46.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.875+0000 7f33727fc700 1 -- 172.21.15.71:0/1119710318 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 6) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f337401b3b0 con 0x7f33840b16d0 2023-10-09T06:43:46.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.876+0000 7f33727fc700 1 --2- 172.21.15.71:0/1119710318 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3364066f80 0x7f3364069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:46.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.876+0000 7f33727fc700 1 -- 172.21.15.71:0/1119710318 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3374083a40 con 0x7f33840b16d0 2023-10-09T06:43:46.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.876+0000 7f3381d9b700 1 -- 172.21.15.71:0/1119710318 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3364066f80 msgr2=0x7f3364069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:43:46.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.876+0000 7f3381d9b700 1 --2- 172.21.15.71:0/1119710318 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3364066f80 0x7f3364069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:43:46.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:46.880+0000 7f33727fc700 1 -- 172.21.15.71:0/1119710318 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3374050c10 con 0x7f33840b16d0 2023-10-09T06:43:47.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.077+0000 7f3381d9b700 1 -- 172.21.15.71:0/1119710318 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3364066f80 msgr2=0x7f3364069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:43:47.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.077+0000 7f3381d9b700 1 --2- 172.21.15.71:0/1119710318 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3364066f80 0x7f3364069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:43:47.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.080+0000 7f338359e700 1 -- 172.21.15.71:0/1119710318 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f338404bb80 con 0x7f33840b16d0 2023-10-09T06:43:47.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.084+0000 7f33727fc700 1 -- 172.21.15.71:0/1119710318 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3374017070 con 0x7f33840b16d0 2023-10-09T06:43:47.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.087+0000 7f338359e700 1 -- 172.21.15.71:0/1119710318 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3364066f80 msgr2=0x7f3364069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:43:47.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.087+0000 7f338359e700 1 --2- 172.21.15.71:0/1119710318 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3364066f80 0x7f3364069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:47.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.087+0000 7f338359e700 1 -- 172.21.15.71:0/1119710318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33840b16d0 msgr2=0x7f33840cb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:47.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.087+0000 7f338359e700 1 --2- 172.21.15.71:0/1119710318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33840b16d0 0x7f33840cb5d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f337400c590 tx=0x7f337400c8a0 comp rx=0 tx=0).stop 2023-10-09T06:43:47.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.087+0000 7f338359e700 1 -- 172.21.15.71:0/1119710318 shutdown_connections 2023-10-09T06:43:47.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.087+0000 7f338359e700 1 --2- 172.21.15.71:0/1119710318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33840b4e70 0x7f338415d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:47.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.087+0000 7f338359e700 1 --2- 172.21.15.71:0/1119710318 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3364066f80 0x7f3364069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:47.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.087+0000 7f338359e700 1 --2- 172.21.15.71:0/1119710318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33840b16d0 0x7f33840cb5d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:47.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.087+0000 7f338359e700 1 --2- 172.21.15.71:0/1119710318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33840b33b0 0x7f3384158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:47.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.087+0000 7f338359e700 1 -- 172.21.15.71:0/1119710318 >> 172.21.15.71:0/1119710318 conn(0x7f33840d10c0 msgr2=0x7f33840c5420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:47.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.087+0000 7f338359e700 1 -- 172.21.15.71:0/1119710318 shutdown_connections 2023-10-09T06:43:47.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.087+0000 7f338359e700 1 -- 172.21.15.71:0/1119710318 wait complete. 2023-10-09T06:43:47.105 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-09T06:43:47.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.292+0000 7fc30339d700 1 Processor -- start 2023-10-09T06:43:47.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.293+0000 7fc30339d700 1 -- start start 2023-10-09T06:43:47.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.294+0000 7fc30339d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc2fc0b16d0 0x7fc2fc0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:47.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.294+0000 7fc30339d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2fc0b2080 con 0x7fc2fc0b4e70 2023-10-09T06:43:47.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.294+0000 7fc30339d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2fc0cfb00 con 0x7fc2fc0b33b0 2023-10-09T06:43:47.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.294+0000 7fc30339d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2fc0b5c40 con 0x7fc2fc0b16d0 2023-10-09T06:43:47.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.294+0000 7fc30239b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc2fc0b4e70 0x7fc2fc0ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37558/0 (socket says 172.21.15.71:37558) 2023-10-09T06:43:47.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.294+0000 7fc30239b700 1 -- 172.21.15.71:0/2686482193 learned_addr learned my addr 172.21.15.71:0/2686482193 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:47.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.294+0000 7fc301b9a700 1 --2- 172.21.15.71:0/2686482193 >> v2:172.21.15.179:3300/0 conn(0x7fc2fc0b16d0 0x7fc2fc0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:47.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.295+0000 7fc301399700 1 -- 172.21.15.71:0/2686482193 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2941619527 0 0) 0x7fc2fc0b2080 con 0x7fc2fc0b4e70 2023-10-09T06:43:47.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.295+0000 7fc301399700 1 -- 172.21.15.71:0/2686482193 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2e8003570 con 0x7fc2fc0b4e70 2023-10-09T06:43:47.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.295+0000 7fc301b9a700 1 -- 172.21.15.71:0/2686482193 >> v1:172.21.15.179:6789/0 conn(0x7fc2fc0b33b0 legacy=0x7fc2fc0b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:47.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.295+0000 7fc301399700 1 -- 172.21.15.71:0/2686482193 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4071527195 0 0) 0x7fc2e8003570 con 0x7fc2fc0b4e70 2023-10-09T06:43:47.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.295+0000 7fc301b9a700 1 -- 172.21.15.71:0/2686482193 >> v1:172.21.15.71:6789/0 conn(0x7fc2fc0b4e70 legacy=0x7fc2fc0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.295+0000 7fc301b9a700 1 -- 172.21.15.71:0/2686482193 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2fc0b5f20 con 0x7fc2fc0b16d0 2023-10-09T06:43:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.295+0000 7fc301b9a700 1 --2- 172.21.15.71:0/2686482193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2fc0b16d0 0x7fc2fc0b1b40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0098e0 tx=0x7fc2ec0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4f404a02ceb454b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.295+0000 7fc301399700 1 -- 172.21.15.71:0/2686482193 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8001470 con 0x7fc2fc0b16d0 2023-10-09T06:43:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.295+0000 7fc301399700 1 -- 172.21.15.71:0/2686482193 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ec011420 con 0x7fc2fc0b16d0 2023-10-09T06:43:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.295+0000 7fc301399700 1 -- 172.21.15.71:0/2686482193 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec0117c0 con 0x7fc2fc0b16d0 2023-10-09T06:43:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.296+0000 7fc30339d700 1 -- 172.21.15.71:0/2686482193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2fc0b16d0 msgr2=0x7fc2fc0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.296+0000 7fc30339d700 1 --2- 172.21.15.71:0/2686482193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2fc0b16d0 0x7fc2fc0b1b40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0098e0 tx=0x7fc2ec0091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.296+0000 7fc30339d700 1 -- 172.21.15.71:0/2686482193 shutdown_connections 2023-10-09T06:43:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.296+0000 7fc30339d700 1 --2- 172.21.15.71:0/2686482193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2fc0b16d0 0x7fc2fc0b1b40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.296+0000 7fc30339d700 1 -- 172.21.15.71:0/2686482193 >> 172.21.15.71:0/2686482193 conn(0x7fc2fc0d10c0 msgr2=0x7fc2fc0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.296+0000 7fc30339d700 1 -- 172.21.15.71:0/2686482193 shutdown_connections 2023-10-09T06:43:47.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.296+0000 7fc30339d700 1 -- 172.21.15.71:0/2686482193 wait complete. 2023-10-09T06:43:47.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.298+0000 7fc30339d700 1 Processor -- start 2023-10-09T06:43:47.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.298+0000 7fc30339d700 1 -- start start 2023-10-09T06:43:47.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.299+0000 7fc30339d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2fc0b16d0 0x7fc2fc155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:47.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.299+0000 7fc30339d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2fc0b33b0 0x7fc2fc155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:47.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.299+0000 7fc30339d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2fc0b4e70 0x7fc2fc1561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:47.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.299+0000 7fc30339d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc0cc830 con 0x7fc2fc0b16d0 2023-10-09T06:43:47.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.299+0000 7fc30339d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc155ad0 con 0x7fc2fc0b33b0 2023-10-09T06:43:47.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.299+0000 7fc30339d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc16de70 con 0x7fc2fc0b4e70 2023-10-09T06:43:47.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.299+0000 7fc30239b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2fc0b16d0 0x7fc2fc155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:47.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.299+0000 7fc30239b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2fc0b16d0 0x7fc2fc155590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52304/0 (socket says 172.21.15.71:52304) 2023-10-09T06:43:47.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.299+0000 7fc30239b700 1 -- 172.21.15.71:0/3701718890 learned_addr learned my addr 172.21.15.71:0/3701718890 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:47.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.299+0000 7fc301b9a700 1 --2- 172.21.15.71:0/3701718890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2fc0b33b0 0x7fc2fc155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:47.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.299+0000 7fc302b9c700 1 --2- 172.21.15.71:0/3701718890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2fc0b4e70 0x7fc2fc1561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:47.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.299+0000 7fc30239b700 1 -- 172.21.15.71:0/3701718890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2fc0b4e70 msgr2=0x7fc2fc1561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:47.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.299+0000 7fc30239b700 1 --2- 172.21.15.71:0/3701718890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2fc0b4e70 0x7fc2fc1561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:47.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.299+0000 7fc30239b700 1 -- 172.21.15.71:0/3701718890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2fc0b33b0 msgr2=0x7fc2fc155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:47.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.299+0000 7fc30239b700 1 --2- 172.21.15.71:0/3701718890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2fc0b33b0 0x7fc2fc155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:47.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.299+0000 7fc30239b700 1 -- 172.21.15.71:0/3701718890 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ec009420 con 0x7fc2fc0b16d0 2023-10-09T06:43:47.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.299+0000 7fc302b9c700 1 --2- 172.21.15.71:0/3701718890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2fc0b4e70 0x7fc2fc1561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:47.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.300+0000 7fc30239b700 1 --2- 172.21.15.71:0/3701718890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2fc0b16d0 0x7fc2fc155590 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800c7f0 tx=0x7fc2f80019e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:47.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.300+0000 7fc2f27fc700 1 -- 172.21.15.71:0/3701718890 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8007360 con 0x7fc2fc0b16d0 2023-10-09T06:43:47.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.300+0000 7fc2f27fc700 1 -- 172.21.15.71:0/3701718890 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f80074e0 con 0x7fc2fc0b16d0 2023-10-09T06:43:47.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.300+0000 7fc2f27fc700 1 -- 172.21.15.71:0/3701718890 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8004830 con 0x7fc2fc0b16d0 2023-10-09T06:43:47.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.300+0000 7fc30339d700 1 -- 172.21.15.71:0/3701718890 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2fc0cc150 con 0x7fc2fc0b16d0 2023-10-09T06:43:47.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.300+0000 7fc30339d700 1 -- 172.21.15.71:0/3701718890 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2fc0cbe70 con 0x7fc2fc0b16d0 2023-10-09T06:43:47.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.301+0000 7fc30339d700 1 -- 172.21.15.71:0/3701718890 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2fc088990 con 0x7fc2fc0b16d0 2023-10-09T06:43:47.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.302+0000 7fc2f27fc700 1 -- 172.21.15.71:0/3701718890 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 6) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fc2f8004be0 con 0x7fc2fc0b16d0 2023-10-09T06:43:47.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.303+0000 7fc2f27fc700 1 --2- 172.21.15.71:0/3701718890 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc2e0066f80 0x7fc2e0069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:47.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.303+0000 7fc2f27fc700 1 -- 172.21.15.71:0/3701718890 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc2f8083c20 con 0x7fc2fc0b16d0 2023-10-09T06:43:47.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.303+0000 7fc301b9a700 1 -- 172.21.15.71:0/3701718890 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc2e0066f80 msgr2=0x7fc2e0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:43:47.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.303+0000 7fc301b9a700 1 --2- 172.21.15.71:0/3701718890 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc2e0066f80 0x7fc2e0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:43:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.307+0000 7fc2f27fc700 1 -- 172.21.15.71:0/3701718890 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2f8050f10 con 0x7fc2fc0b16d0 2023-10-09T06:43:47.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.504+0000 7fc301b9a700 1 -- 172.21.15.71:0/3701718890 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc2e0066f80 msgr2=0x7fc2e0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:43:47.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.504+0000 7fc301b9a700 1 --2- 172.21.15.71:0/3701718890 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc2e0066f80 0x7fc2e0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:43:47.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.507+0000 7fc30339d700 1 -- 172.21.15.71:0/3701718890 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fc2fc04bb80 con 0x7fc2fc0b16d0 2023-10-09T06:43:47.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.513+0000 7fc2f27fc700 1 -- 172.21.15.71:0/3701718890 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v12)=0 v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7fc2f8018020 con 0x7fc2fc0b16d0 2023-10-09T06:43:47.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.515+0000 7fc30339d700 1 -- 172.21.15.71:0/3701718890 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc2e0066f80 msgr2=0x7fc2e0069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:43:47.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.515+0000 7fc30339d700 1 --2- 172.21.15.71:0/3701718890 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc2e0066f80 0x7fc2e0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:47.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.515+0000 7fc30339d700 1 -- 172.21.15.71:0/3701718890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2fc0b16d0 msgr2=0x7fc2fc155590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:47.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.515+0000 7fc30339d700 1 --2- 172.21.15.71:0/3701718890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2fc0b16d0 0x7fc2fc155590 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800c7f0 tx=0x7fc2f80019e0 comp rx=0 tx=0).stop 2023-10-09T06:43:47.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.515+0000 7fc30339d700 1 -- 172.21.15.71:0/3701718890 shutdown_connections 2023-10-09T06:43:47.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.515+0000 7fc30339d700 1 --2- 172.21.15.71:0/3701718890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2fc0b4e70 0x7fc2fc1561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:47.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.515+0000 7fc30339d700 1 --2- 172.21.15.71:0/3701718890 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc2e0066f80 0x7fc2e0069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:47.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.515+0000 7fc30339d700 1 --2- 172.21.15.71:0/3701718890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2fc0b16d0 0x7fc2fc155590 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:47.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.515+0000 7fc30339d700 1 --2- 172.21.15.71:0/3701718890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2fc0b33b0 0x7fc2fc155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:47.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.515+0000 7fc30339d700 1 -- 172.21.15.71:0/3701718890 >> 172.21.15.71:0/3701718890 conn(0x7fc2fc0d10c0 msgr2=0x7fc2fc069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:47.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.515+0000 7fc30339d700 1 -- 172.21.15.71:0/3701718890 shutdown_connections 2023-10-09T06:43:47.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.516+0000 7fc30339d700 1 -- 172.21.15.71:0/3701718890 wait complete. 2023-10-09T06:43:47.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:43:47.535 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-09T06:43:47.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:43:47.579 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir0) 2023-10-09T06:43:47.659 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir0 1M 2023-10-09T06:43:47.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.891+0000 7f2e0759d700 1 Processor -- start 2023-10-09T06:43:47.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.891+0000 7f2e0759d700 1 -- start start 2023-10-09T06:43:47.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.892+0000 7f2e0759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e000b0790 0x7f2e000cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:47.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.892+0000 7f2e0759d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2e001591e0 0x7f2e00159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:47.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.892+0000 7f2e0759d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e000cfa00 con 0x7f2e000b03c0 2023-10-09T06:43:47.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.892+0000 7f2e0759d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e000cb580 con 0x7f2e001591e0 2023-10-09T06:43:47.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.892+0000 7f2e0759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e000cf160 con 0x7f2e000b0790 2023-10-09T06:43:47.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.893+0000 7f2e06d9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2e001591e0 0x7f2e00159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:47.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.893+0000 7f2e05d9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e000b0790 0x7f2e000cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:47.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.893+0000 7f2e06d9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2e001591e0 0x7f2e00159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52320/0 (socket says 172.21.15.71:52320) 2023-10-09T06:43:47.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.893+0000 7f2e0659b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f2e000b03c0 0x7f2e000b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:35084/0 (socket says 172.21.15.71:35084) 2023-10-09T06:43:47.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.893+0000 7f2e06d9c700 1 -- 172.21.15.71:0/3669942188 learned_addr learned my addr 172.21.15.71:0/3669942188 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:47.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.893+0000 7f2e05599700 1 -- 172.21.15.71:0/3669942188 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3253466596 0 0) 0x7f2e000cfa00 con 0x7f2e000b03c0 2023-10-09T06:43:47.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.893+0000 7f2e06d9c700 1 -- 172.21.15.71:0/3669942188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e000b0790 msgr2=0x7f2e000cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:47.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.893+0000 7f2e06d9c700 1 --2- 172.21.15.71:0/3669942188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e000b0790 0x7f2e000cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:47.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.893+0000 7f2e06d9c700 1 -- 172.21.15.71:0/3669942188 >> v1:172.21.15.179:6789/0 conn(0x7f2e000b03c0 legacy=0x7f2e000b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:47.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.893+0000 7f2e06d9c700 1 -- 172.21.15.71:0/3669942188 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e000cf440 con 0x7f2e001591e0 2023-10-09T06:43:47.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.893+0000 7f2e05d9a700 1 --2- 172.21.15.71:0/3669942188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e000b0790 0x7f2e000cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:43:47.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.894+0000 7f2e06d9c700 1 --2- 172.21.15.71:0/3669942188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e001591e0 0x7f2e00159620 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2df8009f20 tx=0x7f2df8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b181c9ecb9e10d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:47.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.894+0000 7f2e05599700 1 -- 172.21.15.71:0/3669942188 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df800e070 con 0x7f2e001591e0 2023-10-09T06:43:47.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.894+0000 7f2e05599700 1 -- 172.21.15.71:0/3669942188 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df800b9d0 con 0x7f2e001591e0 2023-10-09T06:43:47.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.894+0000 7f2e05599700 1 -- 172.21.15.71:0/3669942188 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df80092e0 con 0x7f2e001591e0 2023-10-09T06:43:47.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.894+0000 7f2e0759d700 1 -- 172.21.15.71:0/3669942188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e001591e0 msgr2=0x7f2e00159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:47.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.894+0000 7f2e0759d700 1 --2- 172.21.15.71:0/3669942188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e001591e0 0x7f2e00159620 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2df8009f20 tx=0x7f2df8009840 comp rx=0 tx=0).stop 2023-10-09T06:43:47.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.895+0000 7f2e0759d700 1 -- 172.21.15.71:0/3669942188 shutdown_connections 2023-10-09T06:43:47.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.895+0000 7f2e0759d700 1 --2- 172.21.15.71:0/3669942188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e001591e0 0x7f2e00159620 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:47.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.895+0000 7f2e0759d700 1 --2- 172.21.15.71:0/3669942188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e000b0790 0x7f2e000cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:47.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.895+0000 7f2e0759d700 1 -- 172.21.15.71:0/3669942188 >> 172.21.15.71:0/3669942188 conn(0x7f2e00063230 msgr2=0x7f2e00063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:47.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.895+0000 7f2e0759d700 1 -- 172.21.15.71:0/3669942188 shutdown_connections 2023-10-09T06:43:47.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.895+0000 7f2e0759d700 1 -- 172.21.15.71:0/3669942188 wait complete. 2023-10-09T06:43:47.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.896+0000 7f2e0759d700 1 Processor -- start 2023-10-09T06:43:47.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.896+0000 7f2e0759d700 1 -- start start 2023-10-09T06:43:47.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.897+0000 7f2e0759d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e000b03c0 0x7f2e0015cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:47.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.897+0000 7f2e0759d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e000b0790 0x7f2e0016cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:47.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.897+0000 7f2e0759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e001591e0 0x7f2e0016cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:47.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.897+0000 7f2e0759d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e000c5990 con 0x7f2e000b03c0 2023-10-09T06:43:47.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.897+0000 7f2e0759d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0016ae00 con 0x7f2e000b0790 2023-10-09T06:43:47.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.897+0000 7f2e0759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e000c56b0 con 0x7f2e001591e0 2023-10-09T06:43:47.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.897+0000 7f2e0659b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e000b03c0 0x7f2e0015cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:47.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.897+0000 7f2e0659b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e000b03c0 0x7f2e0015cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52324/0 (socket says 172.21.15.71:52324) 2023-10-09T06:43:47.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.897+0000 7f2e0659b700 1 -- 172.21.15.71:0/1927575513 learned_addr learned my addr 172.21.15.71:0/1927575513 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:47.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.897+0000 7f2e05d9a700 1 --2- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e000b0790 0x7f2e0016cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:47.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.897+0000 7f2e06d9c700 1 --2- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e001591e0 0x7f2e0016cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:47.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.898+0000 7f2e0659b700 1 -- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e001591e0 msgr2=0x7f2e0016cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:47.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.898+0000 7f2e0659b700 1 --2- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e001591e0 0x7f2e0016cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:47.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.898+0000 7f2e0659b700 1 -- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e000b0790 msgr2=0x7f2e0016cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:47.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.898+0000 7f2e0659b700 1 --2- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e000b0790 0x7f2e0016cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:47.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.898+0000 7f2e0659b700 1 -- 172.21.15.71:0/1927575513 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df0009420 con 0x7f2e000b03c0 2023-10-09T06:43:47.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.898+0000 7f2e06d9c700 1 --2- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e001591e0 0x7f2e0016cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:47.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.898+0000 7f2e0659b700 1 --2- 172.21.15.71:0/1927575513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e000b03c0 0x7f2e0015cc60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc00c5e0 tx=0x7f2dfc001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:47.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.898+0000 7f2df67fc700 1 -- 172.21.15.71:0/1927575513 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc005a70 con 0x7f2e000b03c0 2023-10-09T06:43:47.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.898+0000 7f2df67fc700 1 -- 172.21.15.71:0/1927575513 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dfc005bd0 con 0x7f2e000b03c0 2023-10-09T06:43:47.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.898+0000 7f2df67fc700 1 -- 172.21.15.71:0/1927575513 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc0070d0 con 0x7f2e000b03c0 2023-10-09T06:43:47.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.898+0000 7f2e0759d700 1 -- 172.21.15.71:0/1927575513 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df8009ae0 con 0x7f2e000b03c0 2023-10-09T06:43:47.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.898+0000 7f2e0759d700 1 -- 172.21.15.71:0/1927575513 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e0016aa90 con 0x7f2e000b03c0 2023-10-09T06:43:47.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.900+0000 7f2e0759d700 1 -- 172.21.15.71:0/1927575513 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e0004c3c0 con 0x7f2e000b03c0 2023-10-09T06:43:47.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.900+0000 7f2df67fc700 1 -- 172.21.15.71:0/1927575513 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 6) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f2dfc0074c0 con 0x7f2e000b03c0 2023-10-09T06:43:47.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.901+0000 7f2df67fc700 1 --2- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2de4066f80 0x7f2de4069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:47.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.901+0000 7f2df67fc700 1 -- 172.21.15.71:0/1927575513 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2dfc083a80 con 0x7f2e000b03c0 2023-10-09T06:43:47.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.901+0000 7f2e05d9a700 1 -- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2de4066f80 msgr2=0x7f2de4069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:43:47.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.901+0000 7f2e05d9a700 1 --2- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2de4066f80 0x7f2de4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:43:47.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:47.905+0000 7f2df67fc700 1 -- 172.21.15.71:0/1927575513 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2dfc050c50 con 0x7f2e000b03c0 2023-10-09T06:43:47.932 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:47.932+0000 7f8b6ef2e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T06:43:47.992 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:47.991+0000 7efc90790180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T06:43:48.096 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:48.096+0000 7f8b6ef2e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T06:43:48.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:48.102+0000 7f2e05d9a700 1 -- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2de4066f80 msgr2=0x7f2de4069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:43:48.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:48.102+0000 7f2e05d9a700 1 --2- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2de4066f80 0x7f2de4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:43:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:48.142+0000 7f2e0759d700 1 -- 172.21.15.71:0/1927575513 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e0016af40 con 0x7f2de4066f80 2023-10-09T06:43:48.160 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:48.159+0000 7efc90790180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T06:43:48.183 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:48.183+0000 7f8b6ef2e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T06:43:48.245 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:48.244+0000 7efc90790180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T06:43:48.406 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:48.405+0000 7f8b6ef2e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:43:48.467 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:48.466+0000 7efc90790180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:43:48.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:48.503+0000 7f2e05d9a700 1 -- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2de4066f80 msgr2=0x7f2de4069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:43:48.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:48.503+0000 7f2e05d9a700 1 --2- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2de4066f80 0x7f2de4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T06:43:48.584 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:48.584+0000 7f8b6ef2e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T06:43:48.647 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:48.646+0000 7efc90790180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T06:43:48.679 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:48.679+0000 7f8b6ef2e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T06:43:48.737 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:48.737+0000 7efc90790180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T06:43:48.840 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:48.839+0000 7f8b6ef2e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T06:43:48.898 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:48.897+0000 7efc90790180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T06:43:48.939 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:48.938+0000 7f8b6ef2e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T06:43:48.997 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:48.996+0000 7efc90790180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T06:43:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:49.304+0000 7f2e05d9a700 1 -- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2de4066f80 msgr2=0x7f2de4069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:43:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:49.304+0000 7f2e05d9a700 1 --2- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2de4066f80 0x7f2de4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T06:43:49.418 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:49.416+0000 7f8b6ef2e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T06:43:49.477 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:49.476+0000 7efc90790180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T06:43:49.511 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:49.511+0000 7f8b6ef2e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T06:43:49.571 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:49.570+0000 7efc90790180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T06:43:49.601 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:49.601+0000 7f8b6ef2e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T06:43:49.660 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:49.659+0000 7efc90790180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T06:43:50.221 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:50.221+0000 7f8b6ef2e180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T06:43:50.278 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:50.277+0000 7efc90790180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T06:43:50.393 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:50.392+0000 7f8b6ef2e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:43:50.449 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:50.448+0000 7efc90790180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:43:50.488 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:50.488+0000 7f8b6ef2e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T06:43:50.544 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:50.543+0000 7efc90790180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T06:43:50.783 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:50.782+0000 7f8b6ef2e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T06:43:50.837 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:50.836+0000 7efc90790180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T06:43:50.878 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:50.878+0000 7f8b6ef2e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T06:43:50.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:50.906+0000 7f2e05d9a700 1 -- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2de4066f80 msgr2=0x7f2de4069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:43:50.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:50.906+0000 7f2e05d9a700 1 --2- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2de4066f80 0x7f2de4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-09T06:43:50.932 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:50.931+0000 7efc90790180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T06:43:51.576 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:51.575+0000 7f8b6ef2e180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T06:43:51.628 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:51.627+0000 7efc90790180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T06:43:51.866 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:51.860+0000 7f8b6ef2e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T06:43:51.908 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:51.907+0000 7efc90790180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T06:43:51.952 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:51.952+0000 7f8b6ef2e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T06:43:52.002 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:52.000+0000 7efc90790180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T06:43:52.104 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:52.103+0000 7f8b6ef2e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T06:43:52.155 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:52.154+0000 7efc90790180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T06:43:52.207 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:52.206+0000 7f8b6ef2e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T06:43:52.258 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:52.257+0000 7efc90790180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T06:43:52.393 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:52.393+0000 7f8b6ef2e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T06:43:52.442 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:52.441+0000 7efc90790180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T06:43:52.486 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:52.485+0000 7f8b6ef2e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T06:43:52.533 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:52.532+0000 7efc90790180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T06:43:52.574 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:52.573+0000 7f8b6ef2e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T06:43:52.623 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:52.622+0000 7efc90790180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T06:43:52.666 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:52.666+0000 7f8b6ef2e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T06:43:52.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:52.678+0000 7f2df67fc700 1 -- 172.21.15.71:0/1927575513 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 7) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f2dfc051020 con 0x7f2e000b03c0 2023-10-09T06:43:52.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:52.678+0000 7f2df67fc700 1 -- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2de4066f80 msgr2=0x7f2de4069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:43:52.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:52.678+0000 7f2df67fc700 1 --2- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2de4066f80 0x7f2de4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:52.723 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:43:52.722+0000 7efc90790180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T06:43:52.807 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:52.807+0000 7f8ae4277700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:43:52.807 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:52.807+0000 7f8ae4277700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:43:52.807 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:52.807+0000 7f8ae4277700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:43:52.807 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:52.807+0000 7f8ae4277700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:43:52.808 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:52.807+0000 7f8ae4277700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:43:52.808 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:52.807+0000 7f8ae026f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:43:52.808 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:52.807+0000 7f8ae026f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:43:52.808 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:52.807+0000 7f8ae026f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:43:52.808 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:52.807+0000 7f8ae026f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:43:52.809 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:43:52.807+0000 7f8ae026f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:43:53.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:53.682+0000 7f2df67fc700 1 -- 172.21.15.71:0/1927575513 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mgrmap(e 8) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f2dfc0526c0 con 0x7f2e000b03c0 2023-10-09T06:43:53.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:53.683+0000 7f2df67fc700 1 --2- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2de4066f80 0x7f2de40693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:53.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:53.683+0000 7f2df67fc700 1 -- 172.21.15.71:0/1927575513 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2de406ee20 con 0x7f2de4066f80 2023-10-09T06:43:53.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:53.686+0000 7f2e05d9a700 1 --2- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2de4066f80 0x7f2de40693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:53.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:53.687+0000 7f2e05d9a700 1 --2- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2de4066f80 0x7f2de40693b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2e0016dbc0 tx=0x7f2df00091a0 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:53.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:53.781+0000 7f2df67fc700 1 -- 172.21.15.71:0/1927575513 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f2de406ee20 con 0x7f2de4066f80 2023-10-09T06:43:53.782 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule set for path /snap_test_dir1/dir0 2023-10-09T06:43:53.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:53.784+0000 7f2e0759d700 1 -- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2de4066f80 msgr2=0x7f2de40693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:53.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:53.784+0000 7f2e0759d700 1 --2- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2de4066f80 0x7f2de40693b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2e0016dbc0 tx=0x7f2df00091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:53.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:53.784+0000 7f2e0759d700 1 -- 172.21.15.71:0/1927575513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e000b03c0 msgr2=0x7f2e0015cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:53.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:53.784+0000 7f2e0759d700 1 --2- 172.21.15.71:0/1927575513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e000b03c0 0x7f2e0015cc60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc00c5e0 tx=0x7f2dfc001040 comp rx=0 tx=0).stop 2023-10-09T06:43:53.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:53.784+0000 7f2e0759d700 1 -- 172.21.15.71:0/1927575513 shutdown_connections 2023-10-09T06:43:53.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:53.784+0000 7f2e0759d700 1 --2- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e001591e0 0x7f2e0016cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:53.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:53.784+0000 7f2e0759d700 1 --2- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2de4066f80 0x7f2de40693b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:53.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:53.784+0000 7f2e0759d700 1 --2- 172.21.15.71:0/1927575513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e000b03c0 0x7f2e0015cc60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:53.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:53.784+0000 7f2e0759d700 1 --2- 172.21.15.71:0/1927575513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e000b0790 0x7f2e0016cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:53.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:53.784+0000 7f2e0759d700 1 -- 172.21.15.71:0/1927575513 >> 172.21.15.71:0/1927575513 conn(0x7f2e00063230 msgr2=0x7f2e000b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:53.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:53.784+0000 7f2e0759d700 1 -- 172.21.15.71:0/1927575513 shutdown_connections 2023-10-09T06:43:53.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:53.784+0000 7f2e0759d700 1 -- 172.21.15.71:0/1927575513 wait complete. 2023-10-09T06:43:53.803 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir0 2023-10-09T06:43:53.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:43:53.804 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir1) 2023-10-09T06:43:53.842 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir1 1M 2023-10-09T06:43:54.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.067+0000 7f8ae579d700 1 Processor -- start 2023-10-09T06:43:54.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.067+0000 7f8ae579d700 1 -- start start 2023-10-09T06:43:54.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.068+0000 7f8ae579d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8ae0153850 0x7f8ae01596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:54.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.068+0000 7f8ae579d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8ae0159bf0 0x7f8ae0157280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:54.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.068+0000 7f8ae579d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae015a030 con 0x7f8ae0153480 2023-10-09T06:43:54.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.068+0000 7f8ae579d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae015a480 con 0x7f8ae0159bf0 2023-10-09T06:43:54.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.068+0000 7f8ae579d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae00afb40 con 0x7f8ae0153850 2023-10-09T06:43:54.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.068+0000 7f8ae4f9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8ae0159bf0 0x7f8ae0157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:54.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.068+0000 7f8ae4f9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8ae0159bf0 0x7f8ae0157280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52330/0 (socket says 172.21.15.71:52330) 2023-10-09T06:43:54.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.068+0000 7f8ae4f9c700 1 -- 172.21.15.71:0/1567357805 learned_addr learned my addr 172.21.15.71:0/1567357805 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:54.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.069+0000 7f8adf7fe700 1 --2- 172.21.15.71:0/1567357805 >> v2:172.21.15.179:3300/0 conn(0x7f8ae0153850 0x7f8ae01596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:54.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.069+0000 7f8ae4f9c700 1 -- 172.21.15.71:0/1567357805 >> v2:172.21.15.179:3300/0 conn(0x7f8ae0153850 msgr2=0x7f8ae01596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:54.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.069+0000 7f8ae4f9c700 1 --2- 172.21.15.71:0/1567357805 >> v2:172.21.15.179:3300/0 conn(0x7f8ae0153850 0x7f8ae01596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:54.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.069+0000 7f8ae4f9c700 1 -- 172.21.15.71:0/1567357805 >> v1:172.21.15.179:6789/0 conn(0x7f8ae0153480 legacy=0x7f8ae00ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:54.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.069+0000 7f8ae4f9c700 1 -- 172.21.15.71:0/1567357805 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae00afe20 con 0x7f8ae0159bf0 2023-10-09T06:43:54.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.069+0000 7f8adf7fe700 1 --2- 172.21.15.71:0/1567357805 >> v2:172.21.15.179:3300/0 conn(0x7f8ae0153850 0x7f8ae01596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:54.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.069+0000 7f8ae4f9c700 1 --2- 172.21.15.71:0/1567357805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ae0159bf0 0x7f8ae0157280 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0064f60 tx=0x7f8ad8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb292e54ac9fb0be server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:54.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.069+0000 7f8adeffd700 1 -- 172.21.15.71:0/1567357805 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad800e070 con 0x7f8ae0159bf0 2023-10-09T06:43:54.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.069+0000 7f8adeffd700 1 -- 172.21.15.71:0/1567357805 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad800ba50 con 0x7f8ae0159bf0 2023-10-09T06:43:54.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.069+0000 7f8adeffd700 1 -- 172.21.15.71:0/1567357805 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad80092e0 con 0x7f8ae0159bf0 2023-10-09T06:43:54.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.070+0000 7f8ae579d700 1 -- 172.21.15.71:0/1567357805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ae0159bf0 msgr2=0x7f8ae0157280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:54.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.070+0000 7f8ae579d700 1 --2- 172.21.15.71:0/1567357805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ae0159bf0 0x7f8ae0157280 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0064f60 tx=0x7f8ad8009840 comp rx=0 tx=0).stop 2023-10-09T06:43:54.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.070+0000 7f8ae579d700 1 -- 172.21.15.71:0/1567357805 shutdown_connections 2023-10-09T06:43:54.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.070+0000 7f8ae579d700 1 --2- 172.21.15.71:0/1567357805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ae0159bf0 0x7f8ae0157280 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:54.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.070+0000 7f8ae579d700 1 --2- 172.21.15.71:0/1567357805 >> v2:172.21.15.179:3300/0 conn(0x7f8ae0153850 0x7f8ae01596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:54.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.070+0000 7f8ae579d700 1 -- 172.21.15.71:0/1567357805 >> 172.21.15.71:0/1567357805 conn(0x7f8ae0068e20 msgr2=0x7f8ae00cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:54.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.070+0000 7f8ae579d700 1 -- 172.21.15.71:0/1567357805 shutdown_connections 2023-10-09T06:43:54.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.070+0000 7f8ae579d700 1 -- 172.21.15.71:0/1567357805 wait complete. 2023-10-09T06:43:54.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.071+0000 7f8ae579d700 1 Processor -- start 2023-10-09T06:43:54.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.072+0000 7f8ae579d700 1 -- start start 2023-10-09T06:43:54.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.072+0000 7f8ae579d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ae0153480 0x7f8ae013f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:54.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.072+0000 7f8ae579d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ae0153850 0x7f8ae00c4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:54.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.072+0000 7f8ae579d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ae0159bf0 0x7f8ae00c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:54.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.072+0000 7f8ae579d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae00c1ff0 con 0x7f8ae0153850 2023-10-09T06:43:54.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.072+0000 7f8ae579d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae00c2890 con 0x7f8ae0159bf0 2023-10-09T06:43:54.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.072+0000 7f8ae579d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae013f880 con 0x7f8ae0153480 2023-10-09T06:43:54.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.073+0000 7f8adf7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ae0153850 0x7f8ae00c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:54.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.073+0000 7f8adf7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ae0153850 0x7f8ae00c4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52332/0 (socket says 172.21.15.71:52332) 2023-10-09T06:43:54.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.073+0000 7f8adf7fe700 1 -- 172.21.15.71:0/996214340 learned_addr learned my addr 172.21.15.71:0/996214340 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:54.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.073+0000 7f8ae4f9c700 1 --2- 172.21.15.71:0/996214340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ae0159bf0 0x7f8ae00c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:54.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.073+0000 7f8adffff700 1 --2- 172.21.15.71:0/996214340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ae0153480 0x7f8ae013f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:54.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.073+0000 7f8adf7fe700 1 -- 172.21.15.71:0/996214340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ae0153480 msgr2=0x7f8ae013f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:54.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.073+0000 7f8adf7fe700 1 --2- 172.21.15.71:0/996214340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ae0153480 0x7f8ae013f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:54.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.073+0000 7f8adf7fe700 1 -- 172.21.15.71:0/996214340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ae0159bf0 msgr2=0x7f8ae00c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:54.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.073+0000 7f8adf7fe700 1 --2- 172.21.15.71:0/996214340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ae0159bf0 0x7f8ae00c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:54.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.073+0000 7f8adf7fe700 1 -- 172.21.15.71:0/996214340 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad8009ae0 con 0x7f8ae0153850 2023-10-09T06:43:54.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.073+0000 7f8ae4f9c700 1 --2- 172.21.15.71:0/996214340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ae0159bf0 0x7f8ae00c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:54.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.073+0000 7f8adf7fe700 1 --2- 172.21.15.71:0/996214340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ae0153850 0x7f8ae00c4050 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400ddd0 tx=0x7f8ad4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:54.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.074+0000 7f8ac7fff700 1 -- 172.21.15.71:0/996214340 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad400be60 con 0x7f8ae0153850 2023-10-09T06:43:54.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.074+0000 7f8ac7fff700 1 -- 172.21.15.71:0/996214340 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad400ab60 con 0x7f8ae0153850 2023-10-09T06:43:54.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.074+0000 7f8ac7fff700 1 -- 172.21.15.71:0/996214340 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4019480 con 0x7f8ae0153850 2023-10-09T06:43:54.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.074+0000 7f8ae579d700 1 -- 172.21.15.71:0/996214340 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae0157570 con 0x7f8ae0153850 2023-10-09T06:43:54.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.074+0000 7f8ae579d700 1 -- 172.21.15.71:0/996214340 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae00c2520 con 0x7f8ae0153850 2023-10-09T06:43:54.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.075+0000 7f8ae579d700 1 -- 172.21.15.71:0/996214340 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae00c2a00 con 0x7f8ae0153850 2023-10-09T06:43:54.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.076+0000 7f8ac7fff700 1 -- 172.21.15.71:0/996214340 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f8ad40197f0 con 0x7f8ae0153850 2023-10-09T06:43:54.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.077+0000 7f8ac7fff700 1 --2- 172.21.15.71:0/996214340 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8acc066dd0 0x7f8acc069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:54.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.077+0000 7f8ac7fff700 1 -- 172.21.15.71:0/996214340 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f8ad4014070 con 0x7f8ae0153850 2023-10-09T06:43:54.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.077+0000 7f8adffff700 1 --2- 172.21.15.71:0/996214340 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8acc066dd0 0x7f8acc069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:54.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.078+0000 7f8adffff700 1 --2- 172.21.15.71:0/996214340 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8acc066dd0 0x7f8acc069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8ae006a150 tx=0x7f8ad0009040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:54.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.081+0000 7f8ac7fff700 1 -- 172.21.15.71:0/996214340 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ad4051ff0 con 0x7f8ae0153850 2023-10-09T06:43:54.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.296+0000 7f8ae579d700 1 -- 172.21.15.71:0/996214340 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ae004c3c0 con 0x7f8acc066dd0 2023-10-09T06:43:54.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.366+0000 7f8ac7fff700 1 -- 172.21.15.71:0/996214340 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f8ae004c3c0 con 0x7f8acc066dd0 2023-10-09T06:43:54.367 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule set for path /snap_test_dir1/dir1 2023-10-09T06:43:54.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.369+0000 7f8ae579d700 1 -- 172.21.15.71:0/996214340 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8acc066dd0 msgr2=0x7f8acc069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:54.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.369+0000 7f8ae579d700 1 --2- 172.21.15.71:0/996214340 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8acc066dd0 0x7f8acc069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8ae006a150 tx=0x7f8ad0009040 comp rx=0 tx=0).stop 2023-10-09T06:43:54.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.369+0000 7f8ae579d700 1 -- 172.21.15.71:0/996214340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ae0153850 msgr2=0x7f8ae00c4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:54.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.369+0000 7f8ae579d700 1 --2- 172.21.15.71:0/996214340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ae0153850 0x7f8ae00c4050 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400ddd0 tx=0x7f8ad4008040 comp rx=0 tx=0).stop 2023-10-09T06:43:54.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.369+0000 7f8ae579d700 1 -- 172.21.15.71:0/996214340 shutdown_connections 2023-10-09T06:43:54.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.369+0000 7f8ae579d700 1 --2- 172.21.15.71:0/996214340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ae0159bf0 0x7f8ae00c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:54.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.369+0000 7f8ae579d700 1 --2- 172.21.15.71:0/996214340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ae0153480 0x7f8ae013f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:54.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.369+0000 7f8ae579d700 1 --2- 172.21.15.71:0/996214340 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8acc066dd0 0x7f8acc069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:54.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.369+0000 7f8ae579d700 1 --2- 172.21.15.71:0/996214340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ae0153850 0x7f8ae00c4050 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:54.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.369+0000 7f8ae579d700 1 -- 172.21.15.71:0/996214340 >> 172.21.15.71:0/996214340 conn(0x7f8ae0068e20 msgr2=0x7f8ae00c8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:54.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.369+0000 7f8ae579d700 1 -- 172.21.15.71:0/996214340 shutdown_connections 2023-10-09T06:43:54.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.369+0000 7f8ae579d700 1 -- 172.21.15.71:0/996214340 wait complete. 2023-10-09T06:43:54.387 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir1 2023-10-09T06:43:54.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:43:54.388 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir2) 2023-10-09T06:43:54.426 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir2 1M 2023-10-09T06:43:54.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.652+0000 7f25b159d700 1 Processor -- start 2023-10-09T06:43:54.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.652+0000 7f25b159d700 1 -- start start 2023-10-09T06:43:54.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.653+0000 7f25b159d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f25ac0cc8d0 0x7f25ac15b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:54.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.653+0000 7f25b159d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25ac15b960 0x7f25ac0ada30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:54.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.653+0000 7f25b159d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25ac157a50 con 0x7f25ac15b050 2023-10-09T06:43:54.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.653+0000 7f25b159d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25ac158f10 con 0x7f25ac0cc8d0 2023-10-09T06:43:54.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.653+0000 7f25b159d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac1591b0 con 0x7f25ac15b960 2023-10-09T06:43:54.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.654+0000 7f25abfff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f25ac15b050 0x7f25ac0ca100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37564/0 (socket says 172.21.15.71:37564) 2023-10-09T06:43:54.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.654+0000 7f25abfff700 1 -- 172.21.15.71:0/1336728927 learned_addr learned my addr 172.21.15.71:0/1336728927 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:54.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.654+0000 7f25a3fff700 1 --2- 172.21.15.71:0/1336728927 >> v2:172.21.15.179:3300/0 conn(0x7f25ac0cc8d0 0x7f25ac15b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:54.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.654+0000 7f25b0d9c700 1 --2- 172.21.15.71:0/1336728927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25ac15b960 0x7f25ac0ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:54.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.654+0000 7f25ab7fe700 1 -- 172.21.15.71:0/1336728927 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165017582 0 0) 0x7f25ac157a50 con 0x7f25ac15b050 2023-10-09T06:43:54.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.654+0000 7f25ab7fe700 1 -- 172.21.15.71:0/1336728927 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2598003570 con 0x7f25ac15b050 2023-10-09T06:43:54.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.654+0000 7f25ab7fe700 1 -- 172.21.15.71:0/1336728927 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3918806639 0 0) 0x7f2598003570 con 0x7f25ac15b050 2023-10-09T06:43:54.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.654+0000 7f25ab7fe700 1 -- 172.21.15.71:0/1336728927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25ac15b960 msgr2=0x7f25ac0ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:54.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.654+0000 7f25ab7fe700 1 --2- 172.21.15.71:0/1336728927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25ac15b960 0x7f25ac0ada30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:54.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.654+0000 7f25ab7fe700 1 -- 172.21.15.71:0/1336728927 >> v2:172.21.15.179:3300/0 conn(0x7f25ac0cc8d0 msgr2=0x7f25ac15b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:54.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.654+0000 7f25ab7fe700 1 --2- 172.21.15.71:0/1336728927 >> v2:172.21.15.179:3300/0 conn(0x7f25ac0cc8d0 0x7f25ac15b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:54.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.654+0000 7f25ab7fe700 1 -- 172.21.15.71:0/1336728927 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ac0ca9e0 con 0x7f25ac15b050 2023-10-09T06:43:54.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.654+0000 7f25ab7fe700 1 -- 172.21.15.71:0/1336728927 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f259c001470 con 0x7f25ac15b050 2023-10-09T06:43:54.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.654+0000 7f25a3fff700 1 --2- 172.21.15.71:0/1336728927 >> v2:172.21.15.179:3300/0 conn(0x7f25ac0cc8d0 0x7f25ac15b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:43:54.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.654+0000 7f25ab7fe700 1 -- 172.21.15.71:0/1336728927 >> v1:172.21.15.71:6789/0 conn(0x7f25ac15b050 legacy=0x7f25ac0ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:54.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.654+0000 7f25ab7fe700 1 --2- 172.21.15.71:0/1336728927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2598003a60 0x7f2598003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:54.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.655+0000 7f25ab7fe700 1 --2- 172.21.15.71:0/1336728927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2598004810 0x7f2598004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:54.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.655+0000 7f25ab7fe700 1 --2- 172.21.15.71:0/1336728927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25ac15b960 0x7f25980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:54.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.655+0000 7f25ab7fe700 1 -- 172.21.15.71:0/1336728927 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac158f10 con 0x7f2598003a60 2023-10-09T06:43:54.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.655+0000 7f25ab7fe700 1 -- 172.21.15.71:0/1336728927 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac1591b0 con 0x7f2598004810 2023-10-09T06:43:54.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.655+0000 7f25ab7fe700 1 -- 172.21.15.71:0/1336728927 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259800ba60 con 0x7f25ac15b960 2023-10-09T06:43:54.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.655+0000 7f25abfff700 1 --2- 172.21.15.71:0/1336728927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2598003a60 0x7f2598003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:54.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.655+0000 7f25a3fff700 1 --2- 172.21.15.71:0/1336728927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2598004810 0x7f2598004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:54.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.655+0000 7f25b0d9c700 1 --2- 172.21.15.71:0/1336728927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25ac15b960 0x7f25980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:54.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.655+0000 7f25abfff700 1 -- 172.21.15.71:0/1336728927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25ac15b960 msgr2=0x7f25980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:54.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.655+0000 7f25abfff700 1 --2- 172.21.15.71:0/1336728927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25ac15b960 0x7f25980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:54.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.655+0000 7f25abfff700 1 -- 172.21.15.71:0/1336728927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2598004810 msgr2=0x7f2598004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:54.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.655+0000 7f25abfff700 1 --2- 172.21.15.71:0/1336728927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2598004810 0x7f2598004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:54.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.655+0000 7f25abfff700 1 -- 172.21.15.71:0/1336728927 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2598003570 con 0x7f2598003a60 2023-10-09T06:43:54.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.655+0000 7f25b0d9c700 1 --2- 172.21.15.71:0/1336728927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25ac15b960 0x7f25980051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:54.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.655+0000 7f25a3fff700 1 --2- 172.21.15.71:0/1336728927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2598004810 0x7f2598004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:54.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.655+0000 7f25abfff700 1 --2- 172.21.15.71:0/1336728927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2598003a60 0x7f2598003e70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f259c00c3f0 tx=0x7f25ac0cc0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f4991d2310d0cd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:54.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.656+0000 7f25ab7fe700 1 -- 172.21.15.71:0/1336728927 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c00cc80 con 0x7f2598003a60 2023-10-09T06:43:54.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.656+0000 7f25ab7fe700 1 -- 172.21.15.71:0/1336728927 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259c00ce20 con 0x7f2598003a60 2023-10-09T06:43:54.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.656+0000 7f25ab7fe700 1 -- 172.21.15.71:0/1336728927 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c005b70 con 0x7f2598003a60 2023-10-09T06:43:54.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.656+0000 7f25b159d700 1 -- 172.21.15.71:0/1336728927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2598003a60 msgr2=0x7f2598003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:54.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.656+0000 7f25b159d700 1 --2- 172.21.15.71:0/1336728927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2598003a60 0x7f2598003e70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f259c00c3f0 tx=0x7f25ac0cc0d0 comp rx=0 tx=0).stop 2023-10-09T06:43:54.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.656+0000 7f25b0d9c700 1 -- 172.21.15.71:0/1336728927 reap_dead start 2023-10-09T06:43:54.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.656+0000 7f25b159d700 1 -- 172.21.15.71:0/1336728927 shutdown_connections 2023-10-09T06:43:54.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.656+0000 7f25b159d700 1 -- 172.21.15.71:0/1336728927 >> 172.21.15.71:0/1336728927 conn(0x7f25ac068e20 msgr2=0x7f25ac0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:54.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.656+0000 7f25b159d700 1 -- 172.21.15.71:0/1336728927 shutdown_connections 2023-10-09T06:43:54.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.656+0000 7f25b159d700 1 -- 172.21.15.71:0/1336728927 wait complete. 2023-10-09T06:43:54.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.658+0000 7f25b159d700 1 Processor -- start 2023-10-09T06:43:54.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.658+0000 7f25b159d700 1 -- start start 2023-10-09T06:43:54.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.659+0000 7f25b159d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2598003a60 0x7f25ac169700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:54.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.659+0000 7f25b159d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25ac0c5850 0x7f25ac16d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:54.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.659+0000 7f25b159d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25ac0c5cc0 0x7f25ac16d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:54.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.659+0000 7f25b159d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac14e220 con 0x7f25ac0c5cc0 2023-10-09T06:43:54.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.659+0000 7f25b159d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac14d390 con 0x7f2598003a60 2023-10-09T06:43:54.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.659+0000 7f25b159d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac14d610 con 0x7f25ac0c5850 2023-10-09T06:43:54.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.659+0000 7f25b0d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25ac0c5cc0 0x7f25ac16d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:54.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.659+0000 7f25b0d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25ac0c5cc0 0x7f25ac16d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52352/0 (socket says 172.21.15.71:52352) 2023-10-09T06:43:54.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.659+0000 7f25b0d9c700 1 -- 172.21.15.71:0/2136277099 learned_addr learned my addr 172.21.15.71:0/2136277099 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:54.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.659+0000 7f25b0d9c700 1 -- 172.21.15.71:0/2136277099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25ac0c5850 msgr2=0x7f25ac16d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:54.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.659+0000 7f25b0d9c700 1 --2- 172.21.15.71:0/2136277099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25ac0c5850 0x7f25ac16d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:54.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.659+0000 7f25b0d9c700 1 -- 172.21.15.71:0/2136277099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2598003a60 msgr2=0x7f25ac169700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:54.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.659+0000 7f25b0d9c700 1 --2- 172.21.15.71:0/2136277099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2598003a60 0x7f25ac169700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:54.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.659+0000 7f25b0d9c700 1 -- 172.21.15.71:0/2136277099 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ac14d8f0 con 0x7f25ac0c5cc0 2023-10-09T06:43:54.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.659+0000 7f25b0d9c700 1 --2- 172.21.15.71:0/2136277099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25ac0c5cc0 0x7f25ac16d970 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f25ac063fc0 tx=0x7f25a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:54.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.660+0000 7f25a8ff9700 1 -- 172.21.15.71:0/2136277099 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a400e050 con 0x7f25ac0c5cc0 2023-10-09T06:43:54.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.660+0000 7f25a8ff9700 1 -- 172.21.15.71:0/2136277099 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a400f040 con 0x7f25ac0c5cc0 2023-10-09T06:43:54.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.660+0000 7f25a8ff9700 1 -- 172.21.15.71:0/2136277099 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a4010ec0 con 0x7f25ac0c5cc0 2023-10-09T06:43:54.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.660+0000 7f25b159d700 1 -- 172.21.15.71:0/2136277099 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ac14dbd0 con 0x7f25ac0c5cc0 2023-10-09T06:43:54.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.660+0000 7f25b159d700 1 -- 172.21.15.71:0/2136277099 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25ac169c40 con 0x7f25ac0c5cc0 2023-10-09T06:43:54.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.661+0000 7f25b159d700 1 -- 172.21.15.71:0/2136277099 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25ac14e070 con 0x7f25ac0c5cc0 2023-10-09T06:43:54.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.661+0000 7f25a8ff9700 1 -- 172.21.15.71:0/2136277099 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f25a4003020 con 0x7f25ac0c5cc0 2023-10-09T06:43:54.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.663+0000 7f25a8ff9700 1 --2- 172.21.15.71:0/2136277099 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f258c066dd0 0x7f258c069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:54.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.663+0000 7f25a8ff9700 1 -- 172.21.15.71:0/2136277099 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f25a4084bc0 con 0x7f25ac0c5cc0 2023-10-09T06:43:54.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.663+0000 7f25abfff700 1 --2- 172.21.15.71:0/2136277099 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f258c066dd0 0x7f258c069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:54.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.664+0000 7f25abfff700 1 --2- 172.21.15.71:0/2136277099 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f258c066dd0 0x7f258c069280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f259c00c3f0 tx=0x7f259c015000 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:54.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.667+0000 7f25a8ff9700 1 -- 172.21.15.71:0/2136277099 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25a4051f10 con 0x7f25ac0c5cc0 2023-10-09T06:43:54.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.735+0000 7f25a8ff9700 1 -- 172.21.15.71:0/2136277099 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 9) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f25a40522e0 con 0x7f25ac0c5cc0 2023-10-09T06:43:54.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.886+0000 7f25b159d700 1 -- 172.21.15.71:0/2136277099 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f25ac14e360 con 0x7f258c066dd0 2023-10-09T06:43:54.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.961+0000 7f25a8ff9700 1 -- 172.21.15.71:0/2136277099 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f25ac14e360 con 0x7f258c066dd0 2023-10-09T06:43:54.962 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule set for path /snap_test_dir1/dir2 2023-10-09T06:43:54.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.963+0000 7f25b159d700 1 -- 172.21.15.71:0/2136277099 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f258c066dd0 msgr2=0x7f258c069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:54.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.963+0000 7f25b159d700 1 --2- 172.21.15.71:0/2136277099 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f258c066dd0 0x7f258c069280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f259c00c3f0 tx=0x7f259c015000 comp rx=0 tx=0).stop 2023-10-09T06:43:54.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.963+0000 7f25b159d700 1 -- 172.21.15.71:0/2136277099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25ac0c5cc0 msgr2=0x7f25ac16d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:54.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.963+0000 7f25b159d700 1 --2- 172.21.15.71:0/2136277099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25ac0c5cc0 0x7f25ac16d970 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f25ac063fc0 tx=0x7f25a400b040 comp rx=0 tx=0).stop 2023-10-09T06:43:54.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.963+0000 7f25b159d700 1 -- 172.21.15.71:0/2136277099 shutdown_connections 2023-10-09T06:43:54.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.963+0000 7f25b159d700 1 --2- 172.21.15.71:0/2136277099 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f258c066dd0 0x7f258c069280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:54.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.963+0000 7f25b159d700 1 --2- 172.21.15.71:0/2136277099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25ac0c5cc0 0x7f25ac16d970 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:54.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.963+0000 7f25b159d700 1 --2- 172.21.15.71:0/2136277099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2598003a60 0x7f25ac169700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:54.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.963+0000 7f25b159d700 1 --2- 172.21.15.71:0/2136277099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25ac0c5850 0x7f25ac16d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:54.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.963+0000 7f25b159d700 1 -- 172.21.15.71:0/2136277099 >> 172.21.15.71:0/2136277099 conn(0x7f25ac068e20 msgr2=0x7f25ac14b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:54.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.963+0000 7f25b159d700 1 -- 172.21.15.71:0/2136277099 shutdown_connections 2023-10-09T06:43:54.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:54.963+0000 7f25b159d700 1 -- 172.21.15.71:0/2136277099 wait complete. 2023-10-09T06:43:54.982 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir2 2023-10-09T06:43:54.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:43:54.982 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir3) 2023-10-09T06:43:55.022 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir3 1M 2023-10-09T06:43:55.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.248+0000 7fee8f59e700 1 Processor -- start 2023-10-09T06:43:55.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.248+0000 7fee8f59e700 1 -- start start 2023-10-09T06:43:55.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.249+0000 7fee8f59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee90159820 0x7fee900ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:55.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.249+0000 7fee8f59e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee900cfa80 con 0x7fee90159450 2023-10-09T06:43:55.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.249+0000 7fee8f59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee900cee70 con 0x7fee9015d950 2023-10-09T06:43:55.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.249+0000 7fee8f59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee900b3670 con 0x7fee90159820 2023-10-09T06:43:55.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.249+0000 7fee8e59c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fee90159450 0x7fee9015d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:40722/0 (socket says 172.21.15.71:40722) 2023-10-09T06:43:55.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.249+0000 7fee8e59c700 1 -- 172.21.15.71:0/126015673 learned_addr learned my addr 172.21.15.71:0/126015673 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:55.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.250+0000 7fee8ed9d700 1 --2- 172.21.15.71:0/126015673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee90159820 0x7fee900ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:55.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.250+0000 7fee8d59a700 1 -- 172.21.15.71:0/126015673 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177906458 0 0) 0x7fee900cfa80 con 0x7fee90159450 2023-10-09T06:43:55.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.250+0000 7fee8d59a700 1 -- 172.21.15.71:0/126015673 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee78003570 con 0x7fee90159450 2023-10-09T06:43:55.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.250+0000 7fee8d59a700 1 -- 172.21.15.71:0/126015673 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1664953984 0 0) 0x7fee78003570 con 0x7fee90159450 2023-10-09T06:43:55.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.250+0000 7fee8d59a700 1 -- 172.21.15.71:0/126015673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee90159820 msgr2=0x7fee900ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:55.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.250+0000 7fee8d59a700 1 --2- 172.21.15.71:0/126015673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee90159820 0x7fee900ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:55.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.250+0000 7fee8d59a700 1 -- 172.21.15.71:0/126015673 >> v1:172.21.15.179:6789/0 conn(0x7fee9015d950 legacy=0x7fee900ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:55.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.250+0000 7fee8d59a700 1 -- 172.21.15.71:0/126015673 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee900cf150 con 0x7fee90159450 2023-10-09T06:43:55.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.250+0000 7fee8d59a700 1 -- 172.21.15.71:0/126015673 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fee80001470 con 0x7fee90159450 2023-10-09T06:43:55.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.250+0000 7fee8d59a700 1 -- 172.21.15.71:0/126015673 >> v1:172.21.15.71:6789/0 conn(0x7fee90159450 legacy=0x7fee9015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:55.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.250+0000 7fee8d59a700 1 --2- 172.21.15.71:0/126015673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee78003a90 0x7fee78003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:55.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.250+0000 7fee8d59a700 1 --2- 172.21.15.71:0/126015673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee90159820 0x7fee78004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:55.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.250+0000 7fee8d59a700 1 --2- 172.21.15.71:0/126015673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee78004d50 0x7fee780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:55.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.250+0000 7fee8d59a700 1 -- 172.21.15.71:0/126015673 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7800bb40 con 0x7fee78003a90 2023-10-09T06:43:55.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.250+0000 7fee8d59a700 1 -- 172.21.15.71:0/126015673 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7800bcb0 con 0x7fee78004d50 2023-10-09T06:43:55.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.250+0000 7fee8d59a700 1 -- 172.21.15.71:0/126015673 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7800be70 con 0x7fee90159820 2023-10-09T06:43:55.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.251+0000 7fee8e59c700 1 --2- 172.21.15.71:0/126015673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee78003a90 0x7fee78003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:55.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.251+0000 7fee8dd9b700 1 --2- 172.21.15.71:0/126015673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee90159820 0x7fee78004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:55.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.251+0000 7fee8ed9d700 1 --2- 172.21.15.71:0/126015673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee78004d50 0x7fee780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:55.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.251+0000 7fee8e59c700 1 -- 172.21.15.71:0/126015673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee90159820 msgr2=0x7fee78004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:55.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.251+0000 7fee8e59c700 1 --2- 172.21.15.71:0/126015673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee90159820 0x7fee78004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:55.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.251+0000 7fee8e59c700 1 -- 172.21.15.71:0/126015673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee78004d50 msgr2=0x7fee780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:55.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.251+0000 7fee8e59c700 1 --2- 172.21.15.71:0/126015673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee78004d50 0x7fee780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:55.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.251+0000 7fee8e59c700 1 -- 172.21.15.71:0/126015673 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee78003570 con 0x7fee78003a90 2023-10-09T06:43:55.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.251+0000 7fee8ed9d700 1 --2- 172.21.15.71:0/126015673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee78004d50 0x7fee780051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:55.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.251+0000 7fee8e59c700 1 --2- 172.21.15.71:0/126015673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee78003a90 0x7fee78003ea0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fee8000c3c0 tx=0x7fee80001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320953c9bc934d04 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:55.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.251+0000 7fee8d59a700 1 -- 172.21.15.71:0/126015673 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8000cc90 con 0x7fee78003a90 2023-10-09T06:43:55.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.251+0000 7fee8d59a700 1 -- 172.21.15.71:0/126015673 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8000cdf0 con 0x7fee78003a90 2023-10-09T06:43:55.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.251+0000 7fee8d59a700 1 -- 172.21.15.71:0/126015673 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee80005b50 con 0x7fee78003a90 2023-10-09T06:43:55.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.252+0000 7fee8f59e700 1 -- 172.21.15.71:0/126015673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee78003a90 msgr2=0x7fee78003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:55.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.252+0000 7fee8f59e700 1 --2- 172.21.15.71:0/126015673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee78003a90 0x7fee78003ea0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fee8000c3c0 tx=0x7fee80001e50 comp rx=0 tx=0).stop 2023-10-09T06:43:55.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.252+0000 7fee8ed9d700 1 -- 172.21.15.71:0/126015673 reap_dead start 2023-10-09T06:43:55.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.252+0000 7fee8f59e700 1 -- 172.21.15.71:0/126015673 shutdown_connections 2023-10-09T06:43:55.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.252+0000 7fee8f59e700 1 -- 172.21.15.71:0/126015673 >> 172.21.15.71:0/126015673 conn(0x7fee900d0570 msgr2=0x7fee900d0970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:55.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.252+0000 7fee8f59e700 1 -- 172.21.15.71:0/126015673 shutdown_connections 2023-10-09T06:43:55.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.252+0000 7fee8f59e700 1 -- 172.21.15.71:0/126015673 wait complete. 2023-10-09T06:43:55.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.253+0000 7fee8f59e700 1 Processor -- start 2023-10-09T06:43:55.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.254+0000 7fee8f59e700 1 -- start start 2023-10-09T06:43:55.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.254+0000 7fee8f59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee78003a90 0x7fee9014f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:55.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.254+0000 7fee8f59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee90158620 0x7fee9016a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:55.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.254+0000 7fee8f59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee9015b880 0x7fee90142c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:55.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.254+0000 7fee8f59e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9014ff00 con 0x7fee9015b880 2023-10-09T06:43:55.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.254+0000 7fee8f59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee901501e0 con 0x7fee78003a90 2023-10-09T06:43:55.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.254+0000 7fee8f59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee901504c0 con 0x7fee90158620 2023-10-09T06:43:55.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.255+0000 7fee8ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee9015b880 0x7fee90142c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:55.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.255+0000 7fee8ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee9015b880 0x7fee90142c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49406/0 (socket says 172.21.15.71:49406) 2023-10-09T06:43:55.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.255+0000 7fee8ed9d700 1 -- 172.21.15.71:0/3624046819 learned_addr learned my addr 172.21.15.71:0/3624046819 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:55.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.255+0000 7fee8e59c700 1 --2- 172.21.15.71:0/3624046819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee78003a90 0x7fee9014f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:55.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.255+0000 7fee8dd9b700 1 --2- 172.21.15.71:0/3624046819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee90158620 0x7fee9016a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:55.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.255+0000 7fee8ed9d700 1 -- 172.21.15.71:0/3624046819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee90158620 msgr2=0x7fee9016a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:55.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.255+0000 7fee8ed9d700 1 --2- 172.21.15.71:0/3624046819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee90158620 0x7fee9016a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:55.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.255+0000 7fee8ed9d700 1 -- 172.21.15.71:0/3624046819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee78003a90 msgr2=0x7fee9014f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:55.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.255+0000 7fee8ed9d700 1 --2- 172.21.15.71:0/3624046819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee78003a90 0x7fee9014f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:55.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.255+0000 7fee8ed9d700 1 -- 172.21.15.71:0/3624046819 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9014db40 con 0x7fee9015b880 2023-10-09T06:43:55.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.255+0000 7fee8ed9d700 1 --2- 172.21.15.71:0/3624046819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee9015b880 0x7fee90142c40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fee900b3090 tx=0x7fee8800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:55.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.255+0000 7fee7e7fc700 1 -- 172.21.15.71:0/3624046819 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8801b070 con 0x7fee9015b880 2023-10-09T06:43:55.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.256+0000 7fee7e7fc700 1 -- 172.21.15.71:0/3624046819 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8800f040 con 0x7fee9015b880 2023-10-09T06:43:55.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.256+0000 7fee7e7fc700 1 -- 172.21.15.71:0/3624046819 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8800e050 con 0x7fee9015b880 2023-10-09T06:43:55.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.256+0000 7fee8f59e700 1 -- 172.21.15.71:0/3624046819 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9014fc10 con 0x7fee9015b880 2023-10-09T06:43:55.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.256+0000 7fee8f59e700 1 -- 172.21.15.71:0/3624046819 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee9016abf0 con 0x7fee9015b880 2023-10-09T06:43:55.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.257+0000 7fee8f59e700 1 -- 172.21.15.71:0/3624046819 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee900888b0 con 0x7fee9015b880 2023-10-09T06:43:55.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.257+0000 7fee7e7fc700 1 -- 172.21.15.71:0/3624046819 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 9) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fee88003020 con 0x7fee9015b880 2023-10-09T06:43:55.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.258+0000 7fee7e7fc700 1 --2- 172.21.15.71:0/3624046819 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fee70067130 0x7fee700695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:55.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.258+0000 7fee7e7fc700 1 -- 172.21.15.71:0/3624046819 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fee88084fe0 con 0x7fee9015b880 2023-10-09T06:43:55.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.259+0000 7fee8e59c700 1 --2- 172.21.15.71:0/3624046819 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fee70067130 0x7fee700695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:55.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.259+0000 7fee8e59c700 1 --2- 172.21.15.71:0/3624046819 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fee70067130 0x7fee700695e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fee80001ed0 tx=0x7fee80015000 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:55.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.262+0000 7fee7e7fc700 1 -- 172.21.15.71:0/3624046819 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee88051d80 con 0x7fee9015b880 2023-10-09T06:43:55.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.478+0000 7fee8f59e700 1 -- 172.21.15.71:0/3624046819 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fee90150350 con 0x7fee70067130 2023-10-09T06:43:55.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.551+0000 7fee7e7fc700 1 -- 172.21.15.71:0/3624046819 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fee90150350 con 0x7fee70067130 2023-10-09T06:43:55.552 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule set for path /snap_test_dir1/dir3 2023-10-09T06:43:55.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.553+0000 7fee8f59e700 1 -- 172.21.15.71:0/3624046819 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fee70067130 msgr2=0x7fee700695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:55.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.553+0000 7fee8f59e700 1 --2- 172.21.15.71:0/3624046819 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fee70067130 0x7fee700695e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fee80001ed0 tx=0x7fee80015000 comp rx=0 tx=0).stop 2023-10-09T06:43:55.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.553+0000 7fee8f59e700 1 -- 172.21.15.71:0/3624046819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee9015b880 msgr2=0x7fee90142c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:55.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.553+0000 7fee8f59e700 1 --2- 172.21.15.71:0/3624046819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee9015b880 0x7fee90142c40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fee900b3090 tx=0x7fee8800b040 comp rx=0 tx=0).stop 2023-10-09T06:43:55.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.553+0000 7fee8f59e700 1 -- 172.21.15.71:0/3624046819 shutdown_connections 2023-10-09T06:43:55.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.553+0000 7fee8f59e700 1 --2- 172.21.15.71:0/3624046819 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fee70067130 0x7fee700695e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:55.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.553+0000 7fee8f59e700 1 --2- 172.21.15.71:0/3624046819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee9015b880 0x7fee90142c40 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:55.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.553+0000 7fee8f59e700 1 --2- 172.21.15.71:0/3624046819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee78003a90 0x7fee9014f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:55.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.553+0000 7fee8f59e700 1 --2- 172.21.15.71:0/3624046819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee90158620 0x7fee9016a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:55.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.553+0000 7fee8f59e700 1 -- 172.21.15.71:0/3624046819 >> 172.21.15.71:0/3624046819 conn(0x7fee900d0570 msgr2=0x7fee900ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:55.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.553+0000 7fee8f59e700 1 -- 172.21.15.71:0/3624046819 shutdown_connections 2023-10-09T06:43:55.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.553+0000 7fee8f59e700 1 -- 172.21.15.71:0/3624046819 wait complete. 2023-10-09T06:43:55.571 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir3 2023-10-09T06:43:55.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:43:55.572 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir4) 2023-10-09T06:43:55.610 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir4 1M 2023-10-09T06:43:55.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.837+0000 7fc0db5ff700 1 Processor -- start 2023-10-09T06:43:55.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.838+0000 7fc0db5ff700 1 -- start start 2023-10-09T06:43:55.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.839+0000 7fc0db5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d41563b0 0x7fc0d4156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:55.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.839+0000 7fc0db5ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc0d415a440 0x7fc0d40acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:55.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.839+0000 7fc0db5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d415a9b0 con 0x7fc0d4068890 2023-10-09T06:43:55.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.839+0000 7fc0db5ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d415ac90 con 0x7fc0d415a440 2023-10-09T06:43:55.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.839+0000 7fc0db5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d415af70 con 0x7fc0d41563b0 2023-10-09T06:43:55.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.839+0000 7fc0d8b9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc0d415a440 0x7fc0d40acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:55.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.839+0000 7fc0d8b9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc0d415a440 0x7fc0d40acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49412/0 (socket says 172.21.15.71:49412) 2023-10-09T06:43:55.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.839+0000 7fc0d8b9a700 1 -- 172.21.15.71:0/1726527699 learned_addr learned my addr 172.21.15.71:0/1726527699 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:55.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.839+0000 7fc0d939b700 1 --2- 172.21.15.71:0/1726527699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d41563b0 0x7fc0d4156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:55.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.839+0000 7fc0d8b9a700 1 -- 172.21.15.71:0/1726527699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d41563b0 msgr2=0x7fc0d4156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:55.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.839+0000 7fc0d8b9a700 1 --2- 172.21.15.71:0/1726527699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d41563b0 0x7fc0d4156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:55.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.840+0000 7fc0d8b9a700 1 -- 172.21.15.71:0/1726527699 >> v1:172.21.15.179:6789/0 conn(0x7fc0d4068890 legacy=0x7fc0d40c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:55.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.840+0000 7fc0d8b9a700 1 -- 172.21.15.71:0/1726527699 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d415b250 con 0x7fc0d415a440 2023-10-09T06:43:55.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.840+0000 7fc0d8b9a700 1 --2- 172.21.15.71:0/1726527699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d415a440 0x7fc0d40acf30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc0c40099b0 tx=0x7fc0c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e69d2f00188054b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:55.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.840+0000 7fc0cbfff700 1 -- 172.21.15.71:0/1726527699 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4009ea0 con 0x7fc0d415a440 2023-10-09T06:43:55.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.840+0000 7fc0cbfff700 1 -- 172.21.15.71:0/1726527699 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c400b860 con 0x7fc0d415a440 2023-10-09T06:43:55.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.840+0000 7fc0cbfff700 1 -- 172.21.15.71:0/1726527699 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c400bc00 con 0x7fc0d415a440 2023-10-09T06:43:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.841+0000 7fc0db5ff700 1 -- 172.21.15.71:0/1726527699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d415a440 msgr2=0x7fc0d40acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.841+0000 7fc0db5ff700 1 --2- 172.21.15.71:0/1726527699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d415a440 0x7fc0d40acf30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc0c40099b0 tx=0x7fc0c4009250 comp rx=0 tx=0).stop 2023-10-09T06:43:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.841+0000 7fc0db5ff700 1 -- 172.21.15.71:0/1726527699 shutdown_connections 2023-10-09T06:43:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.841+0000 7fc0db5ff700 1 --2- 172.21.15.71:0/1726527699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d41563b0 0x7fc0d4156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.841+0000 7fc0db5ff700 1 --2- 172.21.15.71:0/1726527699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d415a440 0x7fc0d40acf30 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.841+0000 7fc0db5ff700 1 -- 172.21.15.71:0/1726527699 >> 172.21.15.71:0/1726527699 conn(0x7fc0d40c8f90 msgr2=0x7fc0d40c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.841+0000 7fc0db5ff700 1 -- 172.21.15.71:0/1726527699 shutdown_connections 2023-10-09T06:43:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.841+0000 7fc0db5ff700 1 -- 172.21.15.71:0/1726527699 wait complete. 2023-10-09T06:43:55.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.842+0000 7fc0db5ff700 1 Processor -- start 2023-10-09T06:43:55.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.842+0000 7fc0db5ff700 1 -- start start 2023-10-09T06:43:55.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.843+0000 7fc0db5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d4068890 0x7fc0d414b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:55.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.843+0000 7fc0db5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d41563b0 0x7fc0d40ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:55.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.843+0000 7fc0db5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0d415a440 0x7fc0d40ae620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:55.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.843+0000 7fc0db5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d40b00b0 con 0x7fc0d4068890 2023-10-09T06:43:55.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.843+0000 7fc0db5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d4151620 con 0x7fc0d415a440 2023-10-09T06:43:55.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.843+0000 7fc0db5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d414bb30 con 0x7fc0d41563b0 2023-10-09T06:43:55.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.843+0000 7fc0d939b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d4068890 0x7fc0d414b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:55.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.843+0000 7fc0d939b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d4068890 0x7fc0d414b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49428/0 (socket says 172.21.15.71:49428) 2023-10-09T06:43:55.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.843+0000 7fc0d939b700 1 -- 172.21.15.71:0/113983960 learned_addr learned my addr 172.21.15.71:0/113983960 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:55.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.844+0000 7fc0d8b9a700 1 --2- 172.21.15.71:0/113983960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d41563b0 0x7fc0d40ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:55.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.844+0000 7fc0d9b9c700 1 --2- 172.21.15.71:0/113983960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0d415a440 0x7fc0d40ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:55.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.844+0000 7fc0d939b700 1 -- 172.21.15.71:0/113983960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d41563b0 msgr2=0x7fc0d40ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:55.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.844+0000 7fc0d939b700 1 --2- 172.21.15.71:0/113983960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d41563b0 0x7fc0d40ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:55.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.844+0000 7fc0d939b700 1 -- 172.21.15.71:0/113983960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0d415a440 msgr2=0x7fc0d40ae620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:55.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.844+0000 7fc0d939b700 1 --2- 172.21.15.71:0/113983960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0d415a440 0x7fc0d40ae620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:55.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.844+0000 7fc0d939b700 1 -- 172.21.15.71:0/113983960 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c40094f0 con 0x7fc0d4068890 2023-10-09T06:43:55.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.844+0000 7fc0d9b9c700 1 --2- 172.21.15.71:0/113983960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0d415a440 0x7fc0d40ae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:55.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.844+0000 7fc0d939b700 1 --2- 172.21.15.71:0/113983960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d4068890 0x7fc0d414b5f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc0d000ecb0 tx=0x7fc0d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:55.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.844+0000 7fc0c97fa700 1 -- 172.21.15.71:0/113983960 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d000c920 con 0x7fc0d4068890 2023-10-09T06:43:55.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.844+0000 7fc0c97fa700 1 -- 172.21.15.71:0/113983960 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d000ca80 con 0x7fc0d4068890 2023-10-09T06:43:55.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.844+0000 7fc0c97fa700 1 -- 172.21.15.71:0/113983960 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d000ce20 con 0x7fc0d4068890 2023-10-09T06:43:55.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.844+0000 7fc0db5ff700 1 -- 172.21.15.71:0/113983960 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d40af710 con 0x7fc0d4068890 2023-10-09T06:43:55.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.844+0000 7fc0db5ff700 1 -- 172.21.15.71:0/113983960 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d40afcd0 con 0x7fc0d4068890 2023-10-09T06:43:55.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.845+0000 7fc0db5ff700 1 -- 172.21.15.71:0/113983960 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d40b0320 con 0x7fc0d4068890 2023-10-09T06:43:55.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.846+0000 7fc0c97fa700 1 -- 172.21.15.71:0/113983960 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 9) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fc0d0013680 con 0x7fc0d4068890 2023-10-09T06:43:55.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.847+0000 7fc0c97fa700 1 --2- 172.21.15.71:0/113983960 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc0b8067130 0x7fc0b80695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:55.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.847+0000 7fc0c97fa700 1 -- 172.21.15.71:0/113983960 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fc0d0084d50 con 0x7fc0d4068890 2023-10-09T06:43:55.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.847+0000 7fc0d8b9a700 1 --2- 172.21.15.71:0/113983960 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc0b8067130 0x7fc0b80695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:55.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.848+0000 7fc0d8b9a700 1 --2- 172.21.15.71:0/113983960 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc0b8067130 0x7fc0b80695e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc0c40099b0 tx=0x7fc0c4017000 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:55.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:55.851+0000 7fc0c97fa700 1 -- 172.21.15.71:0/113983960 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0d0051ba0 con 0x7fc0d4068890 2023-10-09T06:43:56.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.067+0000 7fc0db5ff700 1 -- 172.21.15.71:0/113983960 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0d40718b0 con 0x7fc0b8067130 2023-10-09T06:43:56.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.140+0000 7fc0c97fa700 1 -- 172.21.15.71:0/113983960 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fc0d40718b0 con 0x7fc0b8067130 2023-10-09T06:43:56.142 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule set for path /snap_test_dir1/dir4 2023-10-09T06:43:56.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.143+0000 7fc0db5ff700 1 -- 172.21.15.71:0/113983960 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc0b8067130 msgr2=0x7fc0b80695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:56.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.143+0000 7fc0db5ff700 1 --2- 172.21.15.71:0/113983960 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc0b8067130 0x7fc0b80695e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc0c40099b0 tx=0x7fc0c4017000 comp rx=0 tx=0).stop 2023-10-09T06:43:56.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.143+0000 7fc0db5ff700 1 -- 172.21.15.71:0/113983960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d4068890 msgr2=0x7fc0d414b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:56.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.143+0000 7fc0db5ff700 1 --2- 172.21.15.71:0/113983960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d4068890 0x7fc0d414b5f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc0d000ecb0 tx=0x7fc0d00091a0 comp rx=0 tx=0).stop 2023-10-09T06:43:56.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.143+0000 7fc0db5ff700 1 -- 172.21.15.71:0/113983960 shutdown_connections 2023-10-09T06:43:56.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.143+0000 7fc0db5ff700 1 --2- 172.21.15.71:0/113983960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0d415a440 0x7fc0d40ae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:56.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.143+0000 7fc0db5ff700 1 --2- 172.21.15.71:0/113983960 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc0b8067130 0x7fc0b80695e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:56.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.143+0000 7fc0db5ff700 1 --2- 172.21.15.71:0/113983960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d4068890 0x7fc0d414b5f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:56.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.143+0000 7fc0db5ff700 1 --2- 172.21.15.71:0/113983960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d41563b0 0x7fc0d40ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:56.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.143+0000 7fc0db5ff700 1 -- 172.21.15.71:0/113983960 >> 172.21.15.71:0/113983960 conn(0x7fc0d40c8f90 msgr2=0x7fc0d414d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:56.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.143+0000 7fc0db5ff700 1 -- 172.21.15.71:0/113983960 shutdown_connections 2023-10-09T06:43:56.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.143+0000 7fc0db5ff700 1 -- 172.21.15.71:0/113983960 wait complete. 2023-10-09T06:43:56.161 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir4 2023-10-09T06:43:56.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:43:56.162 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir5) 2023-10-09T06:43:56.200 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir5 1M 2023-10-09T06:43:56.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.425+0000 7f8cf7fff700 1 Processor -- start 2023-10-09T06:43:56.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.425+0000 7f8cf7fff700 1 -- start start 2023-10-09T06:43:56.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.426+0000 7f8cf7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cf80b03c0 0x7f8cf80cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:56.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.426+0000 7f8cf7fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8cf81591e0 0x7f8cf8159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:56.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.426+0000 7f8cf7fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf80cfa00 con 0x7f8cf80b0790 2023-10-09T06:43:56.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.426+0000 7f8cf7fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf80cb580 con 0x7f8cf81591e0 2023-10-09T06:43:56.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.426+0000 7f8cf7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf80cf160 con 0x7f8cf80b03c0 2023-10-09T06:43:56.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.426+0000 7f8cf77fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8cf81591e0 0x7f8cf8159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:56.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.426+0000 7f8cf77fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8cf81591e0 0x7f8cf8159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49438/0 (socket says 172.21.15.71:49438) 2023-10-09T06:43:56.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.426+0000 7f8cf77fe700 1 -- 172.21.15.71:0/466347340 learned_addr learned my addr 172.21.15.71:0/466347340 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:56.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.427+0000 7f8cf6ffd700 1 --2- 172.21.15.71:0/466347340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cf80b03c0 0x7f8cf80cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:56.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.427+0000 7f8cf77fe700 1 -- 172.21.15.71:0/466347340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cf80b03c0 msgr2=0x7f8cf80cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:56.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.427+0000 7f8cf77fe700 1 --2- 172.21.15.71:0/466347340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cf80b03c0 0x7f8cf80cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:56.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.427+0000 7f8cf77fe700 1 -- 172.21.15.71:0/466347340 >> v1:172.21.15.179:6789/0 conn(0x7f8cf80b0790 legacy=0x7f8cf80b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:56.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.427+0000 7f8cf77fe700 1 -- 172.21.15.71:0/466347340 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf80cf440 con 0x7f8cf81591e0 2023-10-09T06:43:56.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.427+0000 7f8cf77fe700 1 --2- 172.21.15.71:0/466347340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cf81591e0 0x7f8cf8159620 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009f20 tx=0x7f8cf0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483f7c1a5edc7e38 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:56.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.427+0000 7f8cf5ffb700 1 -- 172.21.15.71:0/466347340 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf000e070 con 0x7f8cf81591e0 2023-10-09T06:43:56.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.427+0000 7f8cf5ffb700 1 -- 172.21.15.71:0/466347340 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf000ba80 con 0x7f8cf81591e0 2023-10-09T06:43:56.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.427+0000 7f8cf5ffb700 1 -- 172.21.15.71:0/466347340 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf00092e0 con 0x7f8cf81591e0 2023-10-09T06:43:56.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.428+0000 7f8cf7fff700 1 -- 172.21.15.71:0/466347340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cf81591e0 msgr2=0x7f8cf8159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:56.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.428+0000 7f8cf7fff700 1 --2- 172.21.15.71:0/466347340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cf81591e0 0x7f8cf8159620 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009f20 tx=0x7f8cf0009840 comp rx=0 tx=0).stop 2023-10-09T06:43:56.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.428+0000 7f8cf7fff700 1 -- 172.21.15.71:0/466347340 shutdown_connections 2023-10-09T06:43:56.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.428+0000 7f8cf7fff700 1 --2- 172.21.15.71:0/466347340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cf81591e0 0x7f8cf8159620 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:56.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.428+0000 7f8cf7fff700 1 --2- 172.21.15.71:0/466347340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cf80b03c0 0x7f8cf80cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:56.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.428+0000 7f8cf7fff700 1 -- 172.21.15.71:0/466347340 >> 172.21.15.71:0/466347340 conn(0x7f8cf8063230 msgr2=0x7f8cf8063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:56.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.428+0000 7f8cf7fff700 1 -- 172.21.15.71:0/466347340 shutdown_connections 2023-10-09T06:43:56.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.428+0000 7f8cf7fff700 1 -- 172.21.15.71:0/466347340 wait complete. 2023-10-09T06:43:56.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.429+0000 7f8cf7fff700 1 Processor -- start 2023-10-09T06:43:56.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.430+0000 7f8cf7fff700 1 -- start start 2023-10-09T06:43:56.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.430+0000 7f8cf7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cf80b03c0 0x7f8cf814b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:56.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.430+0000 7f8cf7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cf80b0790 0x7f8cf815d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:56.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.430+0000 7f8cf7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cf81591e0 0x7f8cf80c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:56.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.430+0000 7f8cf7fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf8159960 con 0x7f8cf80b03c0 2023-10-09T06:43:56.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.430+0000 7f8cf7fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf815cc00 con 0x7f8cf81591e0 2023-10-09T06:43:56.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.430+0000 7f8cf7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf816ad10 con 0x7f8cf80b0790 2023-10-09T06:43:56.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.431+0000 7f8cf6ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cf80b03c0 0x7f8cf814b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:56.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.431+0000 7f8cf6ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cf80b03c0 0x7f8cf814b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49442/0 (socket says 172.21.15.71:49442) 2023-10-09T06:43:56.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.431+0000 7f8cf6ffd700 1 -- 172.21.15.71:0/3257780370 learned_addr learned my addr 172.21.15.71:0/3257780370 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:56.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.431+0000 7f8cf67fc700 1 --2- 172.21.15.71:0/3257780370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cf80b0790 0x7f8cf815d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:56.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.431+0000 7f8cf77fe700 1 --2- 172.21.15.71:0/3257780370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cf81591e0 0x7f8cf80c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:56.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.431+0000 7f8cf6ffd700 1 -- 172.21.15.71:0/3257780370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cf80b0790 msgr2=0x7f8cf815d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:56.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.431+0000 7f8cf6ffd700 1 --2- 172.21.15.71:0/3257780370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cf80b0790 0x7f8cf815d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:56.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.431+0000 7f8cf6ffd700 1 -- 172.21.15.71:0/3257780370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cf81591e0 msgr2=0x7f8cf80c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:56.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.431+0000 7f8cf6ffd700 1 --2- 172.21.15.71:0/3257780370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cf81591e0 0x7f8cf80c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:56.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.431+0000 7f8cf6ffd700 1 -- 172.21.15.71:0/3257780370 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf0009ae0 con 0x7f8cf80b03c0 2023-10-09T06:43:56.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.431+0000 7f8cf67fc700 1 --2- 172.21.15.71:0/3257780370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cf80b0790 0x7f8cf815d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:56.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.431+0000 7f8cf77fe700 1 --2- 172.21.15.71:0/3257780370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cf81591e0 0x7f8cf80c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:56.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.431+0000 7f8cf6ffd700 1 --2- 172.21.15.71:0/3257780370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cf80b03c0 0x7f8cf814b970 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800d860 tx=0x7f8ce8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:56.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.432+0000 7f8cdeffd700 1 -- 172.21.15.71:0/3257780370 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8009610 con 0x7f8cf80b03c0 2023-10-09T06:43:56.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.432+0000 7f8cdeffd700 1 -- 172.21.15.71:0/3257780370 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce8009770 con 0x7f8cf80b03c0 2023-10-09T06:43:56.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.432+0000 7f8cf7fff700 1 -- 172.21.15.71:0/3257780370 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf816aa30 con 0x7f8cf80b03c0 2023-10-09T06:43:56.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.432+0000 7f8cdeffd700 1 -- 172.21.15.71:0/3257780370 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8009b30 con 0x7f8cf80b03c0 2023-10-09T06:43:56.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.432+0000 7f8cf7fff700 1 -- 172.21.15.71:0/3257780370 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf815c890 con 0x7f8cf80b03c0 2023-10-09T06:43:56.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.433+0000 7f8cf7fff700 1 -- 172.21.15.71:0/3257780370 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf815c410 con 0x7f8cf80b03c0 2023-10-09T06:43:56.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.434+0000 7f8cdeffd700 1 -- 172.21.15.71:0/3257780370 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 9) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f8ce801e460 con 0x7f8cf80b03c0 2023-10-09T06:43:56.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.434+0000 7f8cdeffd700 1 --2- 172.21.15.71:0/3257780370 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8ce4067130 0x7f8ce40695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:56.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.434+0000 7f8cdeffd700 1 -- 172.21.15.71:0/3257780370 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f8ce80850b0 con 0x7f8cf80b03c0 2023-10-09T06:43:56.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.435+0000 7f8cf67fc700 1 --2- 172.21.15.71:0/3257780370 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8ce4067130 0x7f8ce40695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:56.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.436+0000 7f8cf67fc700 1 --2- 172.21.15.71:0/3257780370 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8ce4067130 0x7f8ce40695e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8cec007fd0 tx=0x7f8cec009040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:56.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.438+0000 7f8cdeffd700 1 -- 172.21.15.71:0/3257780370 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8cf815c410 con 0x7f8cf80b03c0 2023-10-09T06:43:56.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.658+0000 7f8cf7fff700 1 -- 172.21.15.71:0/3257780370 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cf815c410 con 0x7f8ce4067130 2023-10-09T06:43:56.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.730+0000 7f8cdeffd700 1 -- 172.21.15.71:0/3257780370 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f8cf815c410 con 0x7f8ce4067130 2023-10-09T06:43:56.732 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule set for path /snap_test_dir1/dir5 2023-10-09T06:43:56.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.733+0000 7f8cf7fff700 1 -- 172.21.15.71:0/3257780370 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8ce4067130 msgr2=0x7f8ce40695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:56.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.733+0000 7f8cf7fff700 1 --2- 172.21.15.71:0/3257780370 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8ce4067130 0x7f8ce40695e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8cec007fd0 tx=0x7f8cec009040 comp rx=0 tx=0).stop 2023-10-09T06:43:56.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.733+0000 7f8cf7fff700 1 -- 172.21.15.71:0/3257780370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cf80b03c0 msgr2=0x7f8cf814b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:56.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.733+0000 7f8cf7fff700 1 --2- 172.21.15.71:0/3257780370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cf80b03c0 0x7f8cf814b970 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800d860 tx=0x7f8ce8008040 comp rx=0 tx=0).stop 2023-10-09T06:43:56.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.733+0000 7f8cf7fff700 1 -- 172.21.15.71:0/3257780370 shutdown_connections 2023-10-09T06:43:56.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.733+0000 7f8cf7fff700 1 --2- 172.21.15.71:0/3257780370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cf81591e0 0x7f8cf80c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:56.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.733+0000 7f8cf7fff700 1 --2- 172.21.15.71:0/3257780370 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8ce4067130 0x7f8ce40695e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:56.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.733+0000 7f8cf7fff700 1 --2- 172.21.15.71:0/3257780370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cf80b03c0 0x7f8cf814b970 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:56.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.733+0000 7f8cf7fff700 1 --2- 172.21.15.71:0/3257780370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cf80b0790 0x7f8cf815d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:56.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.733+0000 7f8cf7fff700 1 -- 172.21.15.71:0/3257780370 >> 172.21.15.71:0/3257780370 conn(0x7f8cf8063230 msgr2=0x7f8cf80cff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:56.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.733+0000 7f8cf7fff700 1 -- 172.21.15.71:0/3257780370 shutdown_connections 2023-10-09T06:43:56.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:56.733+0000 7f8cf7fff700 1 -- 172.21.15.71:0/3257780370 wait complete. 2023-10-09T06:43:56.753 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir5 2023-10-09T06:43:56.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:43:56.753 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir6) 2023-10-09T06:43:56.791 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir6 1M 2023-10-09T06:43:57.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.014+0000 7f907f1ff700 1 Processor -- start 2023-10-09T06:43:57.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.014+0000 7f907f1ff700 1 -- start start 2023-10-09T06:43:57.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.015+0000 7f907f1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90781563b0 0x7f9078156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:57.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.015+0000 7f907f1ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9078068890 0x7f90780c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:57.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.015+0000 7f907f1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f907815a9b0 con 0x7f907815a440 2023-10-09T06:43:57.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.015+0000 7f907f1ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f907815ac90 con 0x7f9078068890 2023-10-09T06:43:57.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.015+0000 7f907f1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907815af70 con 0x7f90781563b0 2023-10-09T06:43:57.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.016+0000 7f907d79c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9078068890 0x7f90780c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:57.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.016+0000 7f907d79c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9078068890 0x7f90780c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49454/0 (socket says 172.21.15.71:49454) 2023-10-09T06:43:57.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.016+0000 7f907d79c700 1 -- 172.21.15.71:0/935795808 learned_addr learned my addr 172.21.15.71:0/935795808 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:57.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.016+0000 7f907cf9b700 1 --2- 172.21.15.71:0/935795808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90781563b0 0x7f9078156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:57.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.016+0000 7f907d79c700 1 -- 172.21.15.71:0/935795808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90781563b0 msgr2=0x7f9078156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:57.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.016+0000 7f907d79c700 1 --2- 172.21.15.71:0/935795808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90781563b0 0x7f9078156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:57.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.016+0000 7f907d79c700 1 -- 172.21.15.71:0/935795808 >> v1:172.21.15.179:6789/0 conn(0x7f907815a440 legacy=0x7f90780acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:57.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.016+0000 7f907d79c700 1 -- 172.21.15.71:0/935795808 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907815b250 con 0x7f9078068890 2023-10-09T06:43:57.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.016+0000 7f907cf9b700 1 --2- 172.21.15.71:0/935795808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90781563b0 0x7f9078156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:57.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.016+0000 7f907d79c700 1 --2- 172.21.15.71:0/935795808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9078068890 0x7f90780c8230 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9070009f20 tx=0x7f9070009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5aa51004ab1c53e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:57.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.017+0000 7f90777fe700 1 -- 172.21.15.71:0/935795808 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907000e070 con 0x7f9078068890 2023-10-09T06:43:57.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.017+0000 7f90777fe700 1 -- 172.21.15.71:0/935795808 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907000ba80 con 0x7f9078068890 2023-10-09T06:43:57.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.017+0000 7f90777fe700 1 -- 172.21.15.71:0/935795808 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90700092e0 con 0x7f9078068890 2023-10-09T06:43:57.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.017+0000 7f907f1ff700 1 -- 172.21.15.71:0/935795808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9078068890 msgr2=0x7f90780c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:57.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.017+0000 7f907f1ff700 1 --2- 172.21.15.71:0/935795808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9078068890 0x7f90780c8230 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9070009f20 tx=0x7f9070009840 comp rx=0 tx=0).stop 2023-10-09T06:43:57.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.017+0000 7f907f1ff700 1 -- 172.21.15.71:0/935795808 shutdown_connections 2023-10-09T06:43:57.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.017+0000 7f907f1ff700 1 --2- 172.21.15.71:0/935795808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9078068890 0x7f90780c8230 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:57.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.017+0000 7f907f1ff700 1 --2- 172.21.15.71:0/935795808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90781563b0 0x7f9078156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:57.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.017+0000 7f907f1ff700 1 -- 172.21.15.71:0/935795808 >> 172.21.15.71:0/935795808 conn(0x7f90780c8f90 msgr2=0x7f90780c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:57.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.017+0000 7f907f1ff700 1 -- 172.21.15.71:0/935795808 shutdown_connections 2023-10-09T06:43:57.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.017+0000 7f907f1ff700 1 -- 172.21.15.71:0/935795808 wait complete. 2023-10-09T06:43:57.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.019+0000 7f907f1ff700 1 Processor -- start 2023-10-09T06:43:57.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.019+0000 7f907f1ff700 1 -- start start 2023-10-09T06:43:57.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.020+0000 7f907f1ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9078068890 0x7f90781547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:57.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.020+0000 7f907f1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90781563b0 0x7f90780af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:57.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.020+0000 7f907f1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f907815a440 0x7f907816b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:57.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.020+0000 7f907f1ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90780af810 con 0x7f9078068890 2023-10-09T06:43:57.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.020+0000 7f907f1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90780afae0 con 0x7f907815a440 2023-10-09T06:43:57.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.020+0000 7f907f1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90780afdc0 con 0x7f90781563b0 2023-10-09T06:43:57.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.020+0000 7f907cf9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9078068890 0x7f90781547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:57.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.020+0000 7f907cf9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9078068890 0x7f90781547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49458/0 (socket says 172.21.15.71:49458) 2023-10-09T06:43:57.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.020+0000 7f907cf9b700 1 -- 172.21.15.71:0/407446947 learned_addr learned my addr 172.21.15.71:0/407446947 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:57.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.020+0000 7f907d79c700 1 --2- 172.21.15.71:0/407446947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f907815a440 0x7f907816b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:57.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.020+0000 7f9077fff700 1 --2- 172.21.15.71:0/407446947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90781563b0 0x7f90780af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:57.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.020+0000 7f907cf9b700 1 -- 172.21.15.71:0/407446947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90781563b0 msgr2=0x7f90780af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:57.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.020+0000 7f907cf9b700 1 --2- 172.21.15.71:0/407446947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90781563b0 0x7f90780af2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:57.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.020+0000 7f907cf9b700 1 -- 172.21.15.71:0/407446947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f907815a440 msgr2=0x7f907816b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:57.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.020+0000 7f907cf9b700 1 --2- 172.21.15.71:0/407446947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f907815a440 0x7f907816b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:57.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.020+0000 7f907cf9b700 1 -- 172.21.15.71:0/407446947 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9070009ae0 con 0x7f9078068890 2023-10-09T06:43:57.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.020+0000 7f9077fff700 1 --2- 172.21.15.71:0/407446947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90781563b0 0x7f90780af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:57.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.021+0000 7f907cf9b700 1 --2- 172.21.15.71:0/407446947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9078068890 0x7f90781547b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f906c00e8d0 tx=0x7f906c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:57.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.021+0000 7f9074ff9700 1 -- 172.21.15.71:0/407446947 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c00ee70 con 0x7f9078068890 2023-10-09T06:43:57.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.021+0000 7f9074ff9700 1 -- 172.21.15.71:0/407446947 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906c00c5e0 con 0x7f9078068890 2023-10-09T06:43:57.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.021+0000 7f9074ff9700 1 -- 172.21.15.71:0/407446947 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c00c980 con 0x7f9078068890 2023-10-09T06:43:57.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.021+0000 7f907f1ff700 1 -- 172.21.15.71:0/407446947 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907816af90 con 0x7f9078068890 2023-10-09T06:43:57.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.021+0000 7f907f1ff700 1 -- 172.21.15.71:0/407446947 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f907816bcd0 con 0x7f9078068890 2023-10-09T06:43:57.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.022+0000 7f907f1ff700 1 -- 172.21.15.71:0/407446947 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f907816b490 con 0x7f9078068890 2023-10-09T06:43:57.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.023+0000 7f9074ff9700 1 -- 172.21.15.71:0/407446947 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 9) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f906c013410 con 0x7f9078068890 2023-10-09T06:43:57.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.024+0000 7f9074ff9700 1 --2- 172.21.15.71:0/407446947 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f905c067130 0x7f905c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:57.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.024+0000 7f9074ff9700 1 -- 172.21.15.71:0/407446947 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f906c084950 con 0x7f9078068890 2023-10-09T06:43:57.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.024+0000 7f9077fff700 1 --2- 172.21.15.71:0/407446947 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f905c067130 0x7f905c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:57.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.025+0000 7f9077fff700 1 --2- 172.21.15.71:0/407446947 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f905c067130 0x7f905c0695e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f907816ae50 tx=0x7f9064009040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:57.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.028+0000 7f9074ff9700 1 -- 172.21.15.71:0/407446947 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f906c051690 con 0x7f9078068890 2023-10-09T06:43:57.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.244+0000 7f907f1ff700 1 -- 172.21.15.71:0/407446947 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9078071920 con 0x7f905c067130 2023-10-09T06:43:57.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.320+0000 7f9074ff9700 1 -- 172.21.15.71:0/407446947 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f9078071920 con 0x7f905c067130 2023-10-09T06:43:57.321 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule set for path /snap_test_dir1/dir6 2023-10-09T06:43:57.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.323+0000 7f907f1ff700 1 -- 172.21.15.71:0/407446947 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f905c067130 msgr2=0x7f905c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:57.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.323+0000 7f907f1ff700 1 --2- 172.21.15.71:0/407446947 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f905c067130 0x7f905c0695e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f907816ae50 tx=0x7f9064009040 comp rx=0 tx=0).stop 2023-10-09T06:43:57.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.323+0000 7f907f1ff700 1 -- 172.21.15.71:0/407446947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9078068890 msgr2=0x7f90781547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:57.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.323+0000 7f907f1ff700 1 --2- 172.21.15.71:0/407446947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9078068890 0x7f90781547b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f906c00e8d0 tx=0x7f906c008040 comp rx=0 tx=0).stop 2023-10-09T06:43:57.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.323+0000 7f907f1ff700 1 -- 172.21.15.71:0/407446947 shutdown_connections 2023-10-09T06:43:57.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.323+0000 7f907f1ff700 1 --2- 172.21.15.71:0/407446947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f907815a440 0x7f907816b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:57.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.323+0000 7f907f1ff700 1 --2- 172.21.15.71:0/407446947 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f905c067130 0x7f905c0695e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:57.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.323+0000 7f907f1ff700 1 --2- 172.21.15.71:0/407446947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9078068890 0x7f90781547b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:57.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.323+0000 7f907f1ff700 1 --2- 172.21.15.71:0/407446947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90781563b0 0x7f90780af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:57.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.323+0000 7f907f1ff700 1 -- 172.21.15.71:0/407446947 >> 172.21.15.71:0/407446947 conn(0x7f90780c8f90 msgr2=0x7f9078155a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:57.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.323+0000 7f907f1ff700 1 -- 172.21.15.71:0/407446947 shutdown_connections 2023-10-09T06:43:57.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.323+0000 7f907f1ff700 1 -- 172.21.15.71:0/407446947 wait complete. 2023-10-09T06:43:57.341 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir6 2023-10-09T06:43:57.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:43:57.342 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir7) 2023-10-09T06:43:57.381 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir7 1M 2023-10-09T06:43:57.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.606+0000 7f9f12d9d700 1 Processor -- start 2023-10-09T06:43:57.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.606+0000 7f9f12d9d700 1 -- start start 2023-10-09T06:43:57.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.608+0000 7f9f12d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9f0c159dc0 0x7f9f0c160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:57.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.608+0000 7f9f12d9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f0c15a480 con 0x7f9f0c153850 2023-10-09T06:43:57.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.608+0000 7f9f12d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f0c0afb40 con 0x7f9f0c153480 2023-10-09T06:43:57.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.608+0000 7f9f12d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f0c0afe20 con 0x7f9f0c159dc0 2023-10-09T06:43:57.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.608+0000 7f9f1159a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9f0c153850 0x7f9f0c1596b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:40726/0 (socket says 172.21.15.71:40726) 2023-10-09T06:43:57.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.608+0000 7f9f1159a700 1 -- 172.21.15.71:0/206235007 learned_addr learned my addr 172.21.15.71:0/206235007 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:57.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.608+0000 7f9f1259c700 1 --2- 172.21.15.71:0/206235007 >> v2:172.21.15.179:3300/0 conn(0x7f9f0c159dc0 0x7f9f0c160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:57.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.608+0000 7f9f10d99700 1 -- 172.21.15.71:0/206235007 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218227019 0 0) 0x7f9f0c15a480 con 0x7f9f0c153850 2023-10-09T06:43:57.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.608+0000 7f9f10d99700 1 -- 172.21.15.71:0/206235007 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ef8003570 con 0x7f9f0c153850 2023-10-09T06:43:57.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.609+0000 7f9f10d99700 1 -- 172.21.15.71:0/206235007 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4225547829 0 0) 0x7f9ef8003570 con 0x7f9f0c153850 2023-10-09T06:43:57.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.609+0000 7f9f10d99700 1 -- 172.21.15.71:0/206235007 >> v2:172.21.15.179:3300/0 conn(0x7f9f0c159dc0 msgr2=0x7f9f0c160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:57.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.609+0000 7f9f10d99700 1 --2- 172.21.15.71:0/206235007 >> v2:172.21.15.179:3300/0 conn(0x7f9f0c159dc0 0x7f9f0c160a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:57.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.609+0000 7f9f10d99700 1 -- 172.21.15.71:0/206235007 >> v1:172.21.15.179:6789/0 conn(0x7f9f0c153480 legacy=0x7f9f0c0ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:57.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.609+0000 7f9f10d99700 1 -- 172.21.15.71:0/206235007 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c0b0100 con 0x7f9f0c153850 2023-10-09T06:43:57.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.609+0000 7f9f10d99700 1 -- 172.21.15.71:0/206235007 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f9efc001470 con 0x7f9f0c153850 2023-10-09T06:43:57.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.609+0000 7f9f10d99700 1 -- 172.21.15.71:0/206235007 >> v1:172.21.15.71:6789/0 conn(0x7f9f0c153850 legacy=0x7f9f0c1596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:57.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.609+0000 7f9f10d99700 1 --2- 172.21.15.71:0/206235007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ef8003ab0 0x7f9ef8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:57.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.609+0000 7f9f10d99700 1 --2- 172.21.15.71:0/206235007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ef8004810 0x7f9ef8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:57.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.609+0000 7f9f10d99700 1 --2- 172.21.15.71:0/206235007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef8005210 0x7f9ef8005a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:57.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.609+0000 7f9f10d99700 1 -- 172.21.15.71:0/206235007 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c0afe20 con 0x7f9ef8003ab0 2023-10-09T06:43:57.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.609+0000 7f9f10d99700 1 -- 172.21.15.71:0/206235007 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef8006180 con 0x7f9ef8004810 2023-10-09T06:43:57.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.609+0000 7f9f10d99700 1 -- 172.21.15.71:0/206235007 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef8006340 con 0x7f9ef8005210 2023-10-09T06:43:57.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.609+0000 7f9f11d9b700 1 --2- 172.21.15.71:0/206235007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ef8003ab0 0x7f9ef8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:57.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.609+0000 7f9f1159a700 1 --2- 172.21.15.71:0/206235007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ef8004810 0x7f9ef8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:57.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.609+0000 7f9f1259c700 1 --2- 172.21.15.71:0/206235007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef8005210 0x7f9ef8005a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:57.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.609+0000 7f9f11d9b700 1 -- 172.21.15.71:0/206235007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef8005210 msgr2=0x7f9ef8005a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:57.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.609+0000 7f9f11d9b700 1 --2- 172.21.15.71:0/206235007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef8005210 0x7f9ef8005a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:57.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.609+0000 7f9f11d9b700 1 -- 172.21.15.71:0/206235007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ef8004810 msgr2=0x7f9ef8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:57.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.609+0000 7f9f11d9b700 1 --2- 172.21.15.71:0/206235007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ef8004810 0x7f9ef8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:57.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.609+0000 7f9f11d9b700 1 -- 172.21.15.71:0/206235007 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef8003570 con 0x7f9ef8003ab0 2023-10-09T06:43:57.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.610+0000 7f9f1259c700 1 -- 172.21.15.71:0/206235007 reap_dead start 2023-10-09T06:43:57.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.610+0000 7f9f11d9b700 1 --2- 172.21.15.71:0/206235007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ef8003ab0 0x7f9ef8003ec0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9f080018b0 tx=0x7f9f08007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7553b567c00868a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:57.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.610+0000 7f9f10d99700 1 -- 172.21.15.71:0/206235007 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f08012420 con 0x7f9ef8003ab0 2023-10-09T06:43:57.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.610+0000 7f9f10d99700 1 -- 172.21.15.71:0/206235007 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f080125a0 con 0x7f9ef8003ab0 2023-10-09T06:43:57.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.610+0000 7f9f10d99700 1 -- 172.21.15.71:0/206235007 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f08012960 con 0x7f9ef8003ab0 2023-10-09T06:43:57.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.610+0000 7f9f12d9d700 1 -- 172.21.15.71:0/206235007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ef8003ab0 msgr2=0x7f9ef8003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:57.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.610+0000 7f9f12d9d700 1 --2- 172.21.15.71:0/206235007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ef8003ab0 0x7f9ef8003ec0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9f080018b0 tx=0x7f9f08007d30 comp rx=0 tx=0).stop 2023-10-09T06:43:57.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.611+0000 7f9f12d9d700 1 -- 172.21.15.71:0/206235007 shutdown_connections 2023-10-09T06:43:57.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.611+0000 7f9f12d9d700 1 --2- 172.21.15.71:0/206235007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ef8003ab0 0x7f9ef8003ec0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:57.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.611+0000 7f9f12d9d700 1 -- 172.21.15.71:0/206235007 >> 172.21.15.71:0/206235007 conn(0x7f9f0c068e20 msgr2=0x7f9f0c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:57.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.611+0000 7f9f12d9d700 1 -- 172.21.15.71:0/206235007 shutdown_connections 2023-10-09T06:43:57.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.611+0000 7f9f12d9d700 1 -- 172.21.15.71:0/206235007 wait complete. 2023-10-09T06:43:57.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.612+0000 7f9f12d9d700 1 Processor -- start 2023-10-09T06:43:57.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.612+0000 7f9f12d9d700 1 -- start start 2023-10-09T06:43:57.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.613+0000 7f9f12d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef8003ab0 0x7f9f0c151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:57.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.613+0000 7f9f12d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f0c151b30 0x7f9f0c16d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:57.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.613+0000 7f9f12d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f0c16d740 0x7f9f0c16db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:57.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.613+0000 7f9f12d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c15b1a0 con 0x7f9f0c151b30 2023-10-09T06:43:57.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.613+0000 7f9f12d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c0c9b30 con 0x7f9f0c16d740 2023-10-09T06:43:57.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.613+0000 7f9f12d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c15b3f0 con 0x7f9ef8003ab0 2023-10-09T06:43:57.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.613+0000 7f9f1159a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f0c151b30 0x7f9f0c16d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:57.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.613+0000 7f9f1159a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f0c151b30 0x7f9f0c16d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49478/0 (socket says 172.21.15.71:49478) 2023-10-09T06:43:57.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.613+0000 7f9f1159a700 1 -- 172.21.15.71:0/710613764 learned_addr learned my addr 172.21.15.71:0/710613764 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:57.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.614+0000 7f9f11d9b700 1 --2- 172.21.15.71:0/710613764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef8003ab0 0x7f9f0c151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:57.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.614+0000 7f9f1259c700 1 --2- 172.21.15.71:0/710613764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f0c16d740 0x7f9f0c16db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:57.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.614+0000 7f9f1159a700 1 -- 172.21.15.71:0/710613764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef8003ab0 msgr2=0x7f9f0c151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:57.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.614+0000 7f9f1159a700 1 --2- 172.21.15.71:0/710613764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef8003ab0 0x7f9f0c151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:57.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.614+0000 7f9f1159a700 1 -- 172.21.15.71:0/710613764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f0c16d740 msgr2=0x7f9f0c16db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:57.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.614+0000 7f9f1159a700 1 --2- 172.21.15.71:0/710613764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f0c16d740 0x7f9f0c16db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:57.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.614+0000 7f9f1159a700 1 -- 172.21.15.71:0/710613764 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c15b6d0 con 0x7f9f0c151b30 2023-10-09T06:43:57.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.614+0000 7f9f11d9b700 1 --2- 172.21.15.71:0/710613764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef8003ab0 0x7f9f0c151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:57.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.614+0000 7f9f1259c700 1 --2- 172.21.15.71:0/710613764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f0c16d740 0x7f9f0c16db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:57.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.614+0000 7f9f1159a700 1 --2- 172.21.15.71:0/710613764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f0c151b30 0x7f9f0c16d200 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9efc00e840 tx=0x7f9f0c15a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:57.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.614+0000 7f9f01ffb700 1 -- 172.21.15.71:0/710613764 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc012590 con 0x7f9f0c151b30 2023-10-09T06:43:57.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.614+0000 7f9f01ffb700 1 -- 172.21.15.71:0/710613764 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc012710 con 0x7f9f0c151b30 2023-10-09T06:43:57.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.614+0000 7f9f01ffb700 1 -- 172.21.15.71:0/710613764 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc012ad0 con 0x7f9f0c151b30 2023-10-09T06:43:57.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.614+0000 7f9f12d9d700 1 -- 172.21.15.71:0/710613764 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0c0c97c0 con 0x7f9f0c151b30 2023-10-09T06:43:57.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.614+0000 7f9f12d9d700 1 -- 172.21.15.71:0/710613764 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0c0cb840 con 0x7f9f0c151b30 2023-10-09T06:43:57.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.615+0000 7f9f12d9d700 1 -- 172.21.15.71:0/710613764 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0c15b530 con 0x7f9f0c151b30 2023-10-09T06:43:57.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.616+0000 7f9f01ffb700 1 -- 172.21.15.71:0/710613764 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 9) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f9efc01d460 con 0x7f9f0c151b30 2023-10-09T06:43:57.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.617+0000 7f9f01ffb700 1 --2- 172.21.15.71:0/710613764 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9ef0067120 0x7f9ef00695d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:57.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.617+0000 7f9f01ffb700 1 -- 172.21.15.71:0/710613764 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f9efc084810 con 0x7f9f0c151b30 2023-10-09T06:43:57.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.618+0000 7f9f11d9b700 1 --2- 172.21.15.71:0/710613764 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9ef0067120 0x7f9ef00695d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:57.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.619+0000 7f9f11d9b700 1 --2- 172.21.15.71:0/710613764 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9ef0067120 0x7f9ef00695d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9f080018b0 tx=0x7f9f08015000 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:57.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.622+0000 7f9f01ffb700 1 -- 172.21.15.71:0/710613764 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f0c15b530 con 0x7f9f0c151b30 2023-10-09T06:43:57.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.838+0000 7f9f12d9d700 1 -- 172.21.15.71:0/710613764 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f0c0cba60 con 0x7f9ef0067120 2023-10-09T06:43:57.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.909+0000 7f9f01ffb700 1 -- 172.21.15.71:0/710613764 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f9f0c0cba60 con 0x7f9ef0067120 2023-10-09T06:43:57.910 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule set for path /snap_test_dir1/dir7 2023-10-09T06:43:57.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.911+0000 7f9f12d9d700 1 -- 172.21.15.71:0/710613764 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9ef0067120 msgr2=0x7f9ef00695d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:57.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.911+0000 7f9f12d9d700 1 --2- 172.21.15.71:0/710613764 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9ef0067120 0x7f9ef00695d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9f080018b0 tx=0x7f9f08015000 comp rx=0 tx=0).stop 2023-10-09T06:43:57.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.911+0000 7f9f12d9d700 1 -- 172.21.15.71:0/710613764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f0c151b30 msgr2=0x7f9f0c16d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:57.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.911+0000 7f9f12d9d700 1 --2- 172.21.15.71:0/710613764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f0c151b30 0x7f9f0c16d200 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9efc00e840 tx=0x7f9f0c15a610 comp rx=0 tx=0).stop 2023-10-09T06:43:57.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.911+0000 7f9f12d9d700 1 -- 172.21.15.71:0/710613764 shutdown_connections 2023-10-09T06:43:57.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.911+0000 7f9f12d9d700 1 --2- 172.21.15.71:0/710613764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f0c16d740 0x7f9f0c16db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:57.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.911+0000 7f9f12d9d700 1 --2- 172.21.15.71:0/710613764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef8003ab0 0x7f9f0c151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:57.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.911+0000 7f9f12d9d700 1 --2- 172.21.15.71:0/710613764 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9ef0067120 0x7f9ef00695d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:57.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.911+0000 7f9f12d9d700 1 --2- 172.21.15.71:0/710613764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9f0c151b30 0x7f9f0c16d200 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:57.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.911+0000 7f9f12d9d700 1 -- 172.21.15.71:0/710613764 >> 172.21.15.71:0/710613764 conn(0x7f9f0c068e20 msgr2=0x7f9f0c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:57.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.911+0000 7f9f12d9d700 1 -- 172.21.15.71:0/710613764 shutdown_connections 2023-10-09T06:43:57.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:57.911+0000 7f9f12d9d700 1 -- 172.21.15.71:0/710613764 wait complete. 2023-10-09T06:43:57.929 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir7 2023-10-09T06:43:57.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:43:57.930 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir8) 2023-10-09T06:43:57.968 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir8 1M 2023-10-09T06:43:58.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.193+0000 7fe74ddff700 1 Processor -- start 2023-10-09T06:43:58.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.193+0000 7fe74ddff700 1 -- start start 2023-10-09T06:43:58.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.194+0000 7fe74ddff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7481570c0 0x7fe7480c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:58.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.194+0000 7fe74ddff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7480ac030 con 0x7fe7480c8490 2023-10-09T06:43:58.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.194+0000 7fe74ddff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7480ab820 con 0x7fe748069a50 2023-10-09T06:43:58.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.194+0000 7fe74ddff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74806dbb0 con 0x7fe7481570c0 2023-10-09T06:43:58.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.195+0000 7fe746ffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe7480c8490 0x7fe7481569b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:40736/0 (socket says 172.21.15.71:40736) 2023-10-09T06:43:58.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.195+0000 7fe746ffd700 1 -- 172.21.15.71:0/674644153 learned_addr learned my addr 172.21.15.71:0/674644153 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:58.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.195+0000 7fe747fff700 1 --2- 172.21.15.71:0/674644153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7481570c0 0x7fe7480c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:58.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.195+0000 7fe7467fc700 1 -- 172.21.15.71:0/674644153 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890118934 0 0) 0x7fe73c001110 con 0x7fe7480c8490 2023-10-09T06:43:58.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.195+0000 7fe7467fc700 1 -- 172.21.15.71:0/674644153 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe730003570 con 0x7fe7480c8490 2023-10-09T06:43:58.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.195+0000 7fe7467fc700 1 -- 172.21.15.71:0/674644153 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164740643 0 0) 0x7fe7480ab820 con 0x7fe748069a50 2023-10-09T06:43:58.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.195+0000 7fe7467fc700 1 -- 172.21.15.71:0/674644153 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe73c001110 con 0x7fe748069a50 2023-10-09T06:43:58.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.195+0000 7fe7467fc700 1 -- 172.21.15.71:0/674644153 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 708329935 0 0) 0x7fe730003570 con 0x7fe7480c8490 2023-10-09T06:43:58.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.195+0000 7fe7467fc700 1 -- 172.21.15.71:0/674644153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7481570c0 msgr2=0x7fe7480c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:58.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.195+0000 7fe7467fc700 1 --2- 172.21.15.71:0/674644153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7481570c0 0x7fe7480c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:58.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.195+0000 7fe7467fc700 1 -- 172.21.15.71:0/674644153 >> v1:172.21.15.179:6789/0 conn(0x7fe748069a50 legacy=0x7fe74815a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:58.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.195+0000 7fe7467fc700 1 -- 172.21.15.71:0/674644153 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7480aba70 con 0x7fe7480c8490 2023-10-09T06:43:58.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.195+0000 7fe7467fc700 1 -- 172.21.15.71:0/674644153 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fe73c001600 con 0x7fe7480c8490 2023-10-09T06:43:58.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.195+0000 7fe7467fc700 1 -- 172.21.15.71:0/674644153 >> v1:172.21.15.71:6789/0 conn(0x7fe7480c8490 legacy=0x7fe7481569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:58.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.195+0000 7fe7467fc700 1 --2- 172.21.15.71:0/674644153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7481570c0 0x7fe730003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:58.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.195+0000 7fe7467fc700 1 --2- 172.21.15.71:0/674644153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7300041d0 0x7fe730004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:58.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.195+0000 7fe7467fc700 1 --2- 172.21.15.71:0/674644153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe730004d50 0x7fe7300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:58.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.196+0000 7fe7467fc700 1 -- 172.21.15.71:0/674644153 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74806dbb0 con 0x7fe7300041d0 2023-10-09T06:43:58.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.196+0000 7fe7467fc700 1 -- 172.21.15.71:0/674644153 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73000cd00 con 0x7fe730004d50 2023-10-09T06:43:58.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.196+0000 7fe7467fc700 1 -- 172.21.15.71:0/674644153 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73000cec0 con 0x7fe7481570c0 2023-10-09T06:43:58.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.196+0000 7fe746ffd700 1 --2- 172.21.15.71:0/674644153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7300041d0 0x7fe730004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:58.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.196+0000 7fe7477fe700 1 --2- 172.21.15.71:0/674644153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7481570c0 0x7fe730003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:58.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.196+0000 7fe747fff700 1 --2- 172.21.15.71:0/674644153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe730004d50 0x7fe7300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:58.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.196+0000 7fe746ffd700 1 -- 172.21.15.71:0/674644153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7481570c0 msgr2=0x7fe730003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:58.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.196+0000 7fe746ffd700 1 --2- 172.21.15.71:0/674644153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7481570c0 0x7fe730003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:58.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.196+0000 7fe746ffd700 1 -- 172.21.15.71:0/674644153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe730004d50 msgr2=0x7fe7300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:58.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.196+0000 7fe746ffd700 1 --2- 172.21.15.71:0/674644153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe730004d50 0x7fe7300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:58.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.196+0000 7fe746ffd700 1 -- 172.21.15.71:0/674644153 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe730003570 con 0x7fe7300041d0 2023-10-09T06:43:58.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.196+0000 7fe747fff700 1 --2- 172.21.15.71:0/674644153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe730004d50 0x7fe7300051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:43:58.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.196+0000 7fe746ffd700 1 --2- 172.21.15.71:0/674644153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7300041d0 0x7fe730004810 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00c3c0 tx=0x7fe74806dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320f956371f3cfe9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:58.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.196+0000 7fe7467fc700 1 -- 172.21.15.71:0/674644153 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c00cc30 con 0x7fe7300041d0 2023-10-09T06:43:58.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.196+0000 7fe7467fc700 1 -- 172.21.15.71:0/674644153 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c00cdb0 con 0x7fe7300041d0 2023-10-09T06:43:58.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.196+0000 7fe7467fc700 1 -- 172.21.15.71:0/674644153 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c005b70 con 0x7fe7300041d0 2023-10-09T06:43:58.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.197+0000 7fe74ddff700 1 -- 172.21.15.71:0/674644153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7300041d0 msgr2=0x7fe730004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:58.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.197+0000 7fe74ddff700 1 --2- 172.21.15.71:0/674644153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7300041d0 0x7fe730004810 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00c3c0 tx=0x7fe74806dcf0 comp rx=0 tx=0).stop 2023-10-09T06:43:58.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.197+0000 7fe747fff700 1 -- 172.21.15.71:0/674644153 reap_dead start 2023-10-09T06:43:58.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.197+0000 7fe74ddff700 1 -- 172.21.15.71:0/674644153 shutdown_connections 2023-10-09T06:43:58.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.197+0000 7fe74ddff700 1 -- 172.21.15.71:0/674644153 >> 172.21.15.71:0/674644153 conn(0x7fe7480c8f90 msgr2=0x7fe7480c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:58.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.197+0000 7fe74ddff700 1 -- 172.21.15.71:0/674644153 shutdown_connections 2023-10-09T06:43:58.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.197+0000 7fe74ddff700 1 -- 172.21.15.71:0/674644153 wait complete. 2023-10-09T06:43:58.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.198+0000 7fe74ddff700 1 Processor -- start 2023-10-09T06:43:58.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.199+0000 7fe74ddff700 1 -- start start 2023-10-09T06:43:58.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.199+0000 7fe74ddff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7300041d0 0x7fe748154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:58.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.199+0000 7fe74ddff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7480b1320 0x7fe74815c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:58.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.199+0000 7fe74ddff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe74815cde0 0x7fe74815d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:58.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.199+0000 7fe74ddff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74815f100 con 0x7fe7480b1320 2023-10-09T06:43:58.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.199+0000 7fe74ddff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe748155010 con 0x7fe7300041d0 2023-10-09T06:43:58.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.199+0000 7fe74ddff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7480b1880 con 0x7fe74815cde0 2023-10-09T06:43:58.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.200+0000 7fe746ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7480b1320 0x7fe74815c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:58.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.200+0000 7fe746ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7480b1320 0x7fe74815c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49500/0 (socket says 172.21.15.71:49500) 2023-10-09T06:43:58.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.200+0000 7fe746ffd700 1 -- 172.21.15.71:0/1801642092 learned_addr learned my addr 172.21.15.71:0/1801642092 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:58.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.200+0000 7fe746ffd700 1 -- 172.21.15.71:0/1801642092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe74815cde0 msgr2=0x7fe74815d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:58.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.200+0000 7fe746ffd700 1 --2- 172.21.15.71:0/1801642092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe74815cde0 0x7fe74815d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:58.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.200+0000 7fe746ffd700 1 -- 172.21.15.71:0/1801642092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7300041d0 msgr2=0x7fe748154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:58.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.200+0000 7fe746ffd700 1 --2- 172.21.15.71:0/1801642092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7300041d0 0x7fe748154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:58.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.200+0000 7fe746ffd700 1 -- 172.21.15.71:0/1801642092 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7480b1b60 con 0x7fe7480b1320 2023-10-09T06:43:58.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.200+0000 7fe746ffd700 1 --2- 172.21.15.71:0/1801642092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7480b1320 0x7fe74815c8a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe7300057f0 tx=0x7fe73c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:58.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.200+0000 7fe72f7fe700 1 -- 172.21.15.71:0/1801642092 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c0070d0 con 0x7fe7480b1320 2023-10-09T06:43:58.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.201+0000 7fe72f7fe700 1 -- 172.21.15.71:0/1801642092 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c007230 con 0x7fe7480b1320 2023-10-09T06:43:58.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.201+0000 7fe72f7fe700 1 -- 172.21.15.71:0/1801642092 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c0075f0 con 0x7fe7480b1320 2023-10-09T06:43:58.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.201+0000 7fe74ddff700 1 -- 172.21.15.71:0/1801642092 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7480b1e40 con 0x7fe7480b1320 2023-10-09T06:43:58.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.201+0000 7fe74ddff700 1 -- 172.21.15.71:0/1801642092 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74815aec0 con 0x7fe7480b1320 2023-10-09T06:43:58.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.202+0000 7fe74ddff700 1 -- 172.21.15.71:0/1801642092 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe74815f3e0 con 0x7fe7480b1320 2023-10-09T06:43:58.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.202+0000 7fe72f7fe700 1 -- 172.21.15.71:0/1801642092 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 9) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fe73c01f620 con 0x7fe7480b1320 2023-10-09T06:43:58.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.203+0000 7fe72f7fe700 1 --2- 172.21.15.71:0/1801642092 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe734067130 0x7fe7340695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:58.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.203+0000 7fe72f7fe700 1 -- 172.21.15.71:0/1801642092 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fe73c086430 con 0x7fe7480b1320 2023-10-09T06:43:58.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.204+0000 7fe7477fe700 1 --2- 172.21.15.71:0/1801642092 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe734067130 0x7fe7340695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:58.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.204+0000 7fe7477fe700 1 --2- 172.21.15.71:0/1801642092 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe734067130 0x7fe7340695e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe7380010e0 tx=0x7fe738009040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:58.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.207+0000 7fe72f7fe700 1 -- 172.21.15.71:0/1801642092 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe73c053280 con 0x7fe7480b1320 2023-10-09T06:43:58.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.424+0000 7fe74ddff700 1 -- 172.21.15.71:0/1801642092 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7480ac030 con 0x7fe734067130 2023-10-09T06:43:58.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.497+0000 7fe72f7fe700 1 -- 172.21.15.71:0/1801642092 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fe7480ac030 con 0x7fe734067130 2023-10-09T06:43:58.498 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule set for path /snap_test_dir1/dir8 2023-10-09T06:43:58.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.499+0000 7fe74ddff700 1 -- 172.21.15.71:0/1801642092 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe734067130 msgr2=0x7fe7340695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:58.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.499+0000 7fe74ddff700 1 --2- 172.21.15.71:0/1801642092 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe734067130 0x7fe7340695e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe7380010e0 tx=0x7fe738009040 comp rx=0 tx=0).stop 2023-10-09T06:43:58.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.499+0000 7fe74ddff700 1 -- 172.21.15.71:0/1801642092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7480b1320 msgr2=0x7fe74815c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:58.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.499+0000 7fe74ddff700 1 --2- 172.21.15.71:0/1801642092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7480b1320 0x7fe74815c8a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe7300057f0 tx=0x7fe73c015000 comp rx=0 tx=0).stop 2023-10-09T06:43:58.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.500+0000 7fe74ddff700 1 -- 172.21.15.71:0/1801642092 shutdown_connections 2023-10-09T06:43:58.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.500+0000 7fe74ddff700 1 --2- 172.21.15.71:0/1801642092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe74815cde0 0x7fe74815d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:58.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.500+0000 7fe74ddff700 1 --2- 172.21.15.71:0/1801642092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7300041d0 0x7fe748154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:58.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.500+0000 7fe74ddff700 1 --2- 172.21.15.71:0/1801642092 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe734067130 0x7fe7340695e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:58.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.500+0000 7fe74ddff700 1 --2- 172.21.15.71:0/1801642092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7480b1320 0x7fe74815c8a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:58.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.500+0000 7fe74ddff700 1 -- 172.21.15.71:0/1801642092 >> 172.21.15.71:0/1801642092 conn(0x7fe7480c8f90 msgr2=0x7fe7480cb550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:58.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.500+0000 7fe74ddff700 1 -- 172.21.15.71:0/1801642092 shutdown_connections 2023-10-09T06:43:58.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.500+0000 7fe74ddff700 1 -- 172.21.15.71:0/1801642092 wait complete. 2023-10-09T06:43:58.518 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir8 2023-10-09T06:43:58.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:43:58.518 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir9) 2023-10-09T06:43:58.556 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir9 1M 2023-10-09T06:43:58.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.785+0000 7f6e7c99d700 1 Processor -- start 2023-10-09T06:43:58.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.785+0000 7f6e7c99d700 1 -- start start 2023-10-09T06:43:58.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.786+0000 7f6e7c99d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6e780b0c00 0x7f6e780ad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:58.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.786+0000 7f6e7c99d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e780b0570 con 0x7f6e780b0760 2023-10-09T06:43:58.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.786+0000 7f6e7c99d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e780af4d0 con 0x7f6e78156350 2023-10-09T06:43:58.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.786+0000 7f6e7c99d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e780af7b0 con 0x7f6e780b0c00 2023-10-09T06:43:58.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.786+0000 7f6e76ffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6e780b0760 0x7f6e780ace60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:40738/0 (socket says 172.21.15.71:40738) 2023-10-09T06:43:58.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.786+0000 7f6e76ffd700 1 -- 172.21.15.71:0/3252670945 learned_addr learned my addr 172.21.15.71:0/3252670945 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:43:58.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.786+0000 7f6e77fff700 1 --2- 172.21.15.71:0/3252670945 >> v2:172.21.15.179:3300/0 conn(0x7f6e780b0c00 0x7f6e780ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:58.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.787+0000 7f6e767fc700 1 -- 172.21.15.71:0/3252670945 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251976710 0 0) 0x7f6e780b0570 con 0x7f6e780b0760 2023-10-09T06:43:58.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.787+0000 7f6e767fc700 1 -- 172.21.15.71:0/3252670945 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e60003570 con 0x7f6e780b0760 2023-10-09T06:43:58.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.787+0000 7f6e767fc700 1 -- 172.21.15.71:0/3252670945 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1911282602 0 0) 0x7f6e780af4d0 con 0x7f6e78156350 2023-10-09T06:43:58.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.787+0000 7f6e767fc700 1 -- 172.21.15.71:0/3252670945 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e780b0570 con 0x7f6e78156350 2023-10-09T06:43:58.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.787+0000 7f6e77fff700 1 -- 172.21.15.71:0/3252670945 >> v1:172.21.15.179:6789/0 conn(0x7f6e78156350 legacy=0x7f6e78157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:58.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.787+0000 7f6e767fc700 1 -- 172.21.15.71:0/3252670945 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2429362913 0 0) 0x7f6e60003570 con 0x7f6e780b0760 2023-10-09T06:43:58.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.787+0000 7f6e77fff700 1 -- 172.21.15.71:0/3252670945 >> v1:172.21.15.71:6789/0 conn(0x7f6e780b0760 legacy=0x7f6e780ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:58.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.787+0000 7f6e77fff700 1 -- 172.21.15.71:0/3252670945 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e780afa90 con 0x7f6e780b0c00 2023-10-09T06:43:58.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.787+0000 7f6e77fff700 1 --2- 172.21.15.71:0/3252670945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e780b0c00 0x7f6e780ad570 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6e70009e60 tx=0x7f6e70009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eca8ef795b642a83 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:58.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.788+0000 7f6e767fc700 1 -- 172.21.15.71:0/3252670945 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7000e070 con 0x7f6e780b0c00 2023-10-09T06:43:58.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.788+0000 7f6e767fc700 1 -- 172.21.15.71:0/3252670945 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7000b7a0 con 0x7f6e780b0c00 2023-10-09T06:43:58.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.788+0000 7f6e767fc700 1 -- 172.21.15.71:0/3252670945 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c001470 con 0x7f6e780b0c00 2023-10-09T06:43:58.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.788+0000 7f6e7c99d700 1 -- 172.21.15.71:0/3252670945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e780b0c00 msgr2=0x7f6e780ad570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:58.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.788+0000 7f6e7c99d700 1 --2- 172.21.15.71:0/3252670945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e780b0c00 0x7f6e780ad570 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6e70009e60 tx=0x7f6e70009780 comp rx=0 tx=0).stop 2023-10-09T06:43:58.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.788+0000 7f6e7c99d700 1 -- 172.21.15.71:0/3252670945 shutdown_connections 2023-10-09T06:43:58.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.788+0000 7f6e7c99d700 1 --2- 172.21.15.71:0/3252670945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e780b0c00 0x7f6e780ad570 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:58.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.788+0000 7f6e7c99d700 1 -- 172.21.15.71:0/3252670945 >> 172.21.15.71:0/3252670945 conn(0x7f6e78068e20 msgr2=0x7f6e780cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:58.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.788+0000 7f6e7c99d700 1 -- 172.21.15.71:0/3252670945 shutdown_connections 2023-10-09T06:43:58.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.788+0000 7f6e7c99d700 1 -- 172.21.15.71:0/3252670945 wait complete. 2023-10-09T06:43:58.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.790+0000 7f6e7c99d700 1 Processor -- start 2023-10-09T06:43:58.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.790+0000 7f6e7c99d700 1 -- start start 2023-10-09T06:43:58.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.791+0000 7f6e7c99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e780b0760 0x7f6e781599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:58.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.791+0000 7f6e7c99d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e780b0c00 0x7f6e7815b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:58.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.791+0000 7f6e7c99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e78156350 0x7f6e7815a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:58.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.791+0000 7f6e7c99d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e78159f00 con 0x7f6e780b0c00 2023-10-09T06:43:58.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.791+0000 7f6e7c99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7816ad50 con 0x7f6e780b0760 2023-10-09T06:43:58.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.791+0000 7f6e7c99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7815bc70 con 0x7f6e78156350 2023-10-09T06:43:58.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.791+0000 7f6e76ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e780b0c00 0x7f6e7815b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:58.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.791+0000 7f6e76ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e780b0c00 0x7f6e7815b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49504/0 (socket says 172.21.15.71:49504) 2023-10-09T06:43:58.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.791+0000 7f6e76ffd700 1 -- 172.21.15.71:0/122553398 learned_addr learned my addr 172.21.15.71:0/122553398 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:58.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.791+0000 7f6e77fff700 1 --2- 172.21.15.71:0/122553398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e78156350 0x7f6e7815a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:58.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.791+0000 7f6e777fe700 1 --2- 172.21.15.71:0/122553398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e780b0760 0x7f6e781599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:58.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.791+0000 7f6e76ffd700 1 -- 172.21.15.71:0/122553398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e78156350 msgr2=0x7f6e7815a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:58.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.791+0000 7f6e76ffd700 1 --2- 172.21.15.71:0/122553398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e78156350 0x7f6e7815a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:58.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.791+0000 7f6e76ffd700 1 -- 172.21.15.71:0/122553398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e780b0760 msgr2=0x7f6e781599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:58.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.791+0000 7f6e76ffd700 1 --2- 172.21.15.71:0/122553398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e780b0760 0x7f6e781599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:58.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.791+0000 7f6e76ffd700 1 -- 172.21.15.71:0/122553398 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e70009a20 con 0x7f6e780b0c00 2023-10-09T06:43:58.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.791+0000 7f6e77fff700 1 --2- 172.21.15.71:0/122553398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e78156350 0x7f6e7815a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:58.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.791+0000 7f6e777fe700 1 --2- 172.21.15.71:0/122553398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e780b0760 0x7f6e781599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:58.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.792+0000 7f6e76ffd700 1 --2- 172.21.15.71:0/122553398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e780b0c00 0x7f6e7815b730 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c00cb90 tx=0x7f6e6c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:58.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.792+0000 7f6e5f7fe700 1 -- 172.21.15.71:0/122553398 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c001d20 con 0x7f6e780b0c00 2023-10-09T06:43:58.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.792+0000 7f6e5f7fe700 1 -- 172.21.15.71:0/122553398 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6c007360 con 0x7f6e780b0c00 2023-10-09T06:43:58.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.792+0000 7f6e7c99d700 1 -- 172.21.15.71:0/122553398 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e7815ad60 con 0x7f6e780b0c00 2023-10-09T06:43:58.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.792+0000 7f6e5f7fe700 1 -- 172.21.15.71:0/122553398 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c004830 con 0x7f6e780b0c00 2023-10-09T06:43:58.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.792+0000 7f6e7c99d700 1 -- 172.21.15.71:0/122553398 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e7816a420 con 0x7f6e780b0c00 2023-10-09T06:43:58.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.793+0000 7f6e7c99d700 1 -- 172.21.15.71:0/122553398 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e7804c3c0 con 0x7f6e780b0c00 2023-10-09T06:43:58.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.794+0000 7f6e5f7fe700 1 -- 172.21.15.71:0/122553398 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 9) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f6e6c004ba0 con 0x7f6e780b0c00 2023-10-09T06:43:58.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.794+0000 7f6e5f7fe700 1 --2- 172.21.15.71:0/122553398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6e64067130 0x7f6e640695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:58.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.795+0000 7f6e5f7fe700 1 -- 172.21.15.71:0/122553398 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f6e6c0841e0 con 0x7f6e780b0c00 2023-10-09T06:43:58.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.795+0000 7f6e777fe700 1 --2- 172.21.15.71:0/122553398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6e64067130 0x7f6e640695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:58.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.796+0000 7f6e777fe700 1 --2- 172.21.15.71:0/122553398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6e64067130 0x7f6e640695e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6e68007fd0 tx=0x7f6e68009040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:58.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:58.799+0000 7f6e5f7fe700 1 -- 172.21.15.71:0/122553398 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e6c0510b0 con 0x7f6e780b0c00 2023-10-09T06:43:59.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.013+0000 7f6e7c99d700 1 -- 172.21.15.71:0/122553398 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e780afd70 con 0x7f6e64067130 2023-10-09T06:43:59.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.089+0000 7f6e5f7fe700 1 -- 172.21.15.71:0/122553398 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f6e780afd70 con 0x7f6e64067130 2023-10-09T06:43:59.091 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule set for path /snap_test_dir1/dir9 2023-10-09T06:43:59.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.092+0000 7f6e7c99d700 1 -- 172.21.15.71:0/122553398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6e64067130 msgr2=0x7f6e640695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:59.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.092+0000 7f6e7c99d700 1 --2- 172.21.15.71:0/122553398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6e64067130 0x7f6e640695e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6e68007fd0 tx=0x7f6e68009040 comp rx=0 tx=0).stop 2023-10-09T06:43:59.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.092+0000 7f6e7c99d700 1 -- 172.21.15.71:0/122553398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e780b0c00 msgr2=0x7f6e7815b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:59.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.092+0000 7f6e7c99d700 1 --2- 172.21.15.71:0/122553398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e780b0c00 0x7f6e7815b730 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c00cb90 tx=0x7f6e6c001ab0 comp rx=0 tx=0).stop 2023-10-09T06:43:59.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.092+0000 7f6e7c99d700 1 -- 172.21.15.71:0/122553398 shutdown_connections 2023-10-09T06:43:59.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.092+0000 7f6e7c99d700 1 --2- 172.21.15.71:0/122553398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e78156350 0x7f6e7815a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:59.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.092+0000 7f6e7c99d700 1 --2- 172.21.15.71:0/122553398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e780b0760 0x7f6e781599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:59.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.092+0000 7f6e7c99d700 1 --2- 172.21.15.71:0/122553398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6e64067130 0x7f6e640695e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:59.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.092+0000 7f6e7c99d700 1 --2- 172.21.15.71:0/122553398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e780b0c00 0x7f6e7815b730 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:59.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.092+0000 7f6e7c99d700 1 -- 172.21.15.71:0/122553398 >> 172.21.15.71:0/122553398 conn(0x7f6e78068e20 msgr2=0x7f6e780704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:59.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.092+0000 7f6e7c99d700 1 -- 172.21.15.71:0/122553398 shutdown_connections 2023-10-09T06:43:59.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.092+0000 7f6e7c99d700 1 -- 172.21.15.71:0/122553398 wait complete. 2023-10-09T06:43:59.110 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir9 2023-10-09T06:43:59.110 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir0 1M 2023-10-09T06:43:59.154 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:43:59.160 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:43:59.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.299+0000 7f58209ff700 1 Processor -- start 2023-10-09T06:43:59.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.299+0000 7f58209ff700 1 -- start start 2023-10-09T06:43:59.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.300+0000 7f58209ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f581c069a50 0x7f581c0c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:59.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.300+0000 7f58209ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f581c0c8490 0x7f581c15a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:59.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.300+0000 7f58209ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f581c069e20 0x7f581c06e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:59.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.300+0000 7f58209ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f581c0ac030 con 0x7f581c069e20 2023-10-09T06:43:59.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.300+0000 7f58209ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f581c0ab820 con 0x7f581c069a50 2023-10-09T06:43:59.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.300+0000 7f58209ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f581c06dbb0 con 0x7f581c0c8490 2023-10-09T06:43:59.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.300+0000 7f581ad9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f581c069e20 0x7f581c06e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:59.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.301+0000 7f581ad9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f581c069e20 0x7f581c06e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49510/0 (socket says 172.21.15.71:49510) 2023-10-09T06:43:59.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.301+0000 7f581ad9d700 1 -- 172.21.15.71:0/4227033921 learned_addr learned my addr 172.21.15.71:0/4227033921 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:59.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.301+0000 7f581a59c700 1 --2- 172.21.15.71:0/4227033921 >> v2:172.21.15.179:3300/0 conn(0x7f581c069a50 0x7f581c0c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:59.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.301+0000 7f5819d9b700 1 --2- 172.21.15.71:0/4227033921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f581c0c8490 0x7f581c15a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:59.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.301+0000 7f581ad9d700 1 -- 172.21.15.71:0/4227033921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f581c0c8490 msgr2=0x7f581c15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:59.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.301+0000 7f581ad9d700 1 --2- 172.21.15.71:0/4227033921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f581c0c8490 0x7f581c15a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:59.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.301+0000 7f581ad9d700 1 -- 172.21.15.71:0/4227033921 >> v2:172.21.15.179:3300/0 conn(0x7f581c069a50 msgr2=0x7f581c0c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:59.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.301+0000 7f581ad9d700 1 --2- 172.21.15.71:0/4227033921 >> v2:172.21.15.179:3300/0 conn(0x7f581c069a50 0x7f581c0c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:59.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.301+0000 7f581ad9d700 1 -- 172.21.15.71:0/4227033921 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581c15a9d0 con 0x7f581c069e20 2023-10-09T06:43:59.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.301+0000 7f581a59c700 1 --2- 172.21.15.71:0/4227033921 >> v2:172.21.15.179:3300/0 conn(0x7f581c069a50 0x7f581c0c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:59.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.301+0000 7f581ad9d700 1 --2- 172.21.15.71:0/4227033921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f581c069e20 0x7f581c06e040 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5814009f20 tx=0x7f5814009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e202c302c0ee58 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:59.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.301+0000 7f581959a700 1 -- 172.21.15.71:0/4227033921 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581400e070 con 0x7f581c069e20 2023-10-09T06:43:59.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.302+0000 7f581959a700 1 -- 172.21.15.71:0/4227033921 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581400ba40 con 0x7f581c069e20 2023-10-09T06:43:59.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.302+0000 7f581959a700 1 -- 172.21.15.71:0/4227033921 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58140092e0 con 0x7f581c069e20 2023-10-09T06:43:59.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.302+0000 7f58209ff700 1 -- 172.21.15.71:0/4227033921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f581c069e20 msgr2=0x7f581c06e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:59.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.302+0000 7f58209ff700 1 --2- 172.21.15.71:0/4227033921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f581c069e20 0x7f581c06e040 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5814009f20 tx=0x7f5814009840 comp rx=0 tx=0).stop 2023-10-09T06:43:59.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.302+0000 7f58209ff700 1 -- 172.21.15.71:0/4227033921 shutdown_connections 2023-10-09T06:43:59.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.302+0000 7f58209ff700 1 --2- 172.21.15.71:0/4227033921 >> v2:172.21.15.179:3300/0 conn(0x7f581c069a50 0x7f581c0c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:59.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.302+0000 7f58209ff700 1 --2- 172.21.15.71:0/4227033921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f581c069e20 0x7f581c06e040 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:59.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.302+0000 7f58209ff700 1 --2- 172.21.15.71:0/4227033921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f581c0c8490 0x7f581c15a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:59.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.302+0000 7f58209ff700 1 -- 172.21.15.71:0/4227033921 >> 172.21.15.71:0/4227033921 conn(0x7f581c0c8f90 msgr2=0x7f581c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:59.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.302+0000 7f58209ff700 1 -- 172.21.15.71:0/4227033921 shutdown_connections 2023-10-09T06:43:59.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.302+0000 7f58209ff700 1 -- 172.21.15.71:0/4227033921 wait complete. 2023-10-09T06:43:59.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.304+0000 7f58209ff700 1 Processor -- start 2023-10-09T06:43:59.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.304+0000 7f58209ff700 1 -- start start 2023-10-09T06:43:59.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.305+0000 7f58209ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f581c069a50 0x7f581c0b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:59.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.305+0000 7f58209ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f581c069e20 0x7f581c0c3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:59.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.305+0000 7f58209ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f581c0c8490 0x7f581c169ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:59.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.305+0000 7f58209ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581c0c3a70 con 0x7f581c069a50 2023-10-09T06:43:59.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.305+0000 7f58209ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581c16a5b0 con 0x7f581c0c8490 2023-10-09T06:43:59.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.305+0000 7f58209ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f581c16d060 con 0x7f581c069e20 2023-10-09T06:43:59.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.305+0000 7f581a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f581c069a50 0x7f581c0b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:59.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.305+0000 7f581a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f581c069a50 0x7f581c0b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49518/0 (socket says 172.21.15.71:49518) 2023-10-09T06:43:59.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.305+0000 7f581a59c700 1 -- 172.21.15.71:0/3258382041 learned_addr learned my addr 172.21.15.71:0/3258382041 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:59.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.305+0000 7f581a59c700 1 -- 172.21.15.71:0/3258382041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f581c069e20 msgr2=0x7f581c0c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:59.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.305+0000 7f581a59c700 1 --2- 172.21.15.71:0/3258382041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f581c069e20 0x7f581c0c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:59.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.305+0000 7f581a59c700 1 -- 172.21.15.71:0/3258382041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f581c0c8490 msgr2=0x7f581c169ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:59.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.305+0000 7f581a59c700 1 --2- 172.21.15.71:0/3258382041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f581c0c8490 0x7f581c169ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:59.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.305+0000 7f581a59c700 1 -- 172.21.15.71:0/3258382041 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5814009ae0 con 0x7f581c069a50 2023-10-09T06:43:59.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.306+0000 7f581a59c700 1 --2- 172.21.15.71:0/3258382041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f581c069a50 0x7f581c0b1e60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f580c00c850 tx=0x7f580c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:59.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.306+0000 7f580a7fc700 1 -- 172.21.15.71:0/3258382041 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c011600 con 0x7f581c069a50 2023-10-09T06:43:59.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.306+0000 7f580a7fc700 1 -- 172.21.15.71:0/3258382041 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580c011760 con 0x7f581c069a50 2023-10-09T06:43:59.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.306+0000 7f58209ff700 1 -- 172.21.15.71:0/3258382041 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f581c16d340 con 0x7f581c069a50 2023-10-09T06:43:59.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.306+0000 7f580a7fc700 1 -- 172.21.15.71:0/3258382041 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c011b00 con 0x7f581c069a50 2023-10-09T06:43:59.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.306+0000 7f58209ff700 1 -- 172.21.15.71:0/3258382041 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f581c16a0e0 con 0x7f581c069a50 2023-10-09T06:43:59.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.307+0000 7f58209ff700 1 -- 172.21.15.71:0/3258382041 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f581c16d860 con 0x7f581c069a50 2023-10-09T06:43:59.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.308+0000 7f580a7fc700 1 -- 172.21.15.71:0/3258382041 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 9) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f580c0073b0 con 0x7f581c069a50 2023-10-09T06:43:59.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.309+0000 7f580a7fc700 1 --2- 172.21.15.71:0/3258382041 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f57fc067130 0x7f57fc0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:59.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.309+0000 7f580a7fc700 1 -- 172.21.15.71:0/3258382041 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f580c084ac0 con 0x7f581c069a50 2023-10-09T06:43:59.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.309+0000 7f5819d9b700 1 --2- 172.21.15.71:0/3258382041 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f57fc067130 0x7f57fc0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:59.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.310+0000 7f5819d9b700 1 --2- 172.21.15.71:0/3258382041 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f57fc067130 0x7f57fc0695e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f581c0c3490 tx=0x7f5810008040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:59.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.312+0000 7f580a7fc700 1 -- 172.21.15.71:0/3258382041 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f581c16d860 con 0x7f581c069a50 2023-10-09T06:43:59.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.529+0000 7f58209ff700 1 -- 172.21.15.71:0/3258382041 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f581c16cee0 con 0x7f57fc067130 2023-10-09T06:43:59.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.585+0000 7f580a7fc700 1 -- 172.21.15.71:0/3258382041 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f5810009640 con 0x7f57fc067130 2023-10-09T06:43:59.586 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule activated for path /snap_test_dir1/dir0 2023-10-09T06:43:59.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.587+0000 7f58209ff700 1 -- 172.21.15.71:0/3258382041 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f57fc067130 msgr2=0x7f57fc0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:59.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.587+0000 7f58209ff700 1 --2- 172.21.15.71:0/3258382041 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f57fc067130 0x7f57fc0695e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f581c0c3490 tx=0x7f5810008040 comp rx=0 tx=0).stop 2023-10-09T06:43:59.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.587+0000 7f58209ff700 1 -- 172.21.15.71:0/3258382041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f581c069a50 msgr2=0x7f581c0b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:59.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.587+0000 7f58209ff700 1 --2- 172.21.15.71:0/3258382041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f581c069a50 0x7f581c0b1e60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f580c00c850 tx=0x7f580c008040 comp rx=0 tx=0).stop 2023-10-09T06:43:59.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.588+0000 7f58209ff700 1 -- 172.21.15.71:0/3258382041 shutdown_connections 2023-10-09T06:43:59.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.588+0000 7f58209ff700 1 --2- 172.21.15.71:0/3258382041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f581c0c8490 0x7f581c169ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:59.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.588+0000 7f58209ff700 1 --2- 172.21.15.71:0/3258382041 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f57fc067130 0x7f57fc0695e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:59.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.588+0000 7f58209ff700 1 --2- 172.21.15.71:0/3258382041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f581c069a50 0x7f581c0b1e60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:59.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.588+0000 7f58209ff700 1 --2- 172.21.15.71:0/3258382041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f581c069e20 0x7f581c0c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:59.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.588+0000 7f58209ff700 1 -- 172.21.15.71:0/3258382041 >> 172.21.15.71:0/3258382041 conn(0x7f581c0c8f90 msgr2=0x7f581c0ca870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:59.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.588+0000 7f58209ff700 1 -- 172.21.15.71:0/3258382041 shutdown_connections 2023-10-09T06:43:59.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.588+0000 7f58209ff700 1 -- 172.21.15.71:0/3258382041 wait complete. 2023-10-09T06:43:59.606 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir0 2023-10-09T06:43:59.606 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir1 1M 2023-10-09T06:43:59.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.792+0000 7f1662dff700 1 Processor -- start 2023-10-09T06:43:59.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.792+0000 7f1662dff700 1 -- start start 2023-10-09T06:43:59.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.793+0000 7f1662dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f165c159ec0 0x7f165c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:59.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.793+0000 7f1662dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f165c0b53d0 0x7f165c0cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:59.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.793+0000 7f1662dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f165c0b5b00 con 0x7f165c0cce40 2023-10-09T06:43:59.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.793+0000 7f1662dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f165c0b5850 con 0x7f165c159ec0 2023-10-09T06:43:59.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.793+0000 7f1662dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165c0b5da0 con 0x7f165c0b53d0 2023-10-09T06:43:59.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.794+0000 7f165bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f165c0b53d0 0x7f165c0cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:59.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.794+0000 7f165bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f165c0b53d0 0x7f165c0cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:36610/0 (socket says 172.21.15.71:36610) 2023-10-09T06:43:59.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.794+0000 7f166139c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f165c0cce40 0x7f165c0cd2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:37076/0 (socket says 172.21.15.71:37076) 2023-10-09T06:43:59.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.794+0000 7f165bfff700 1 -- 172.21.15.71:0/3503910511 learned_addr learned my addr 172.21.15.71:0/3503910511 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:59.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.794+0000 7f1660b9b700 1 --2- 172.21.15.71:0/3503910511 >> v2:172.21.15.179:3300/0 conn(0x7f165c159ec0 0x7f165c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:59.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.794+0000 7f165bfff700 1 -- 172.21.15.71:0/3503910511 >> v2:172.21.15.179:3300/0 conn(0x7f165c159ec0 msgr2=0x7f165c0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:43:59.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.794+0000 7f165bfff700 1 --2- 172.21.15.71:0/3503910511 >> v2:172.21.15.179:3300/0 conn(0x7f165c159ec0 0x7f165c0b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:59.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.794+0000 7f165bfff700 1 -- 172.21.15.71:0/3503910511 >> v1:172.21.15.179:6789/0 conn(0x7f165c0cce40 legacy=0x7f165c0cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:59.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.794+0000 7f165bfff700 1 -- 172.21.15.71:0/3503910511 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165c0b6080 con 0x7f165c0b53d0 2023-10-09T06:43:59.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.794+0000 7f165b7fe700 1 -- 172.21.15.71:0/3503910511 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3900767925 0 0) 0x7f165c0b5b00 con 0x7f165c0cce40 2023-10-09T06:43:59.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.795+0000 7f165bfff700 1 --2- 172.21.15.71:0/3503910511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f165c0b53d0 0x7f165c0cc900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f16480099b0 tx=0x7f1648009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7925768fb081ba23 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:59.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.795+0000 7f165b7fe700 1 -- 172.21.15.71:0/3503910511 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1648009ea0 con 0x7f165c0b53d0 2023-10-09T06:43:59.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.795+0000 7f165b7fe700 1 -- 172.21.15.71:0/3503910511 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164800b860 con 0x7f165c0b53d0 2023-10-09T06:43:59.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.795+0000 7f165b7fe700 1 -- 172.21.15.71:0/3503910511 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164800bc00 con 0x7f165c0b53d0 2023-10-09T06:43:59.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.795+0000 7f1662dff700 1 -- 172.21.15.71:0/3503910511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f165c0b53d0 msgr2=0x7f165c0cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:59.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.795+0000 7f1662dff700 1 --2- 172.21.15.71:0/3503910511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f165c0b53d0 0x7f165c0cc900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f16480099b0 tx=0x7f1648009250 comp rx=0 tx=0).stop 2023-10-09T06:43:59.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.796+0000 7f1662dff700 1 -- 172.21.15.71:0/3503910511 shutdown_connections 2023-10-09T06:43:59.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.796+0000 7f1662dff700 1 --2- 172.21.15.71:0/3503910511 >> v2:172.21.15.179:3300/0 conn(0x7f165c159ec0 0x7f165c0b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:59.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.796+0000 7f1662dff700 1 --2- 172.21.15.71:0/3503910511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f165c0b53d0 0x7f165c0cc900 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:59.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.796+0000 7f1662dff700 1 -- 172.21.15.71:0/3503910511 >> 172.21.15.71:0/3503910511 conn(0x7f165c0999f0 msgr2=0x7f165c0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:43:59.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.796+0000 7f1662dff700 1 -- 172.21.15.71:0/3503910511 shutdown_connections 2023-10-09T06:43:59.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.796+0000 7f1662dff700 1 -- 172.21.15.71:0/3503910511 wait complete. 2023-10-09T06:43:59.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.797+0000 7f1662dff700 1 Processor -- start 2023-10-09T06:43:59.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.797+0000 7f1662dff700 1 -- start start 2023-10-09T06:43:59.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.798+0000 7f1662dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f165c0b53d0 0x7f165c154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:59.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.798+0000 7f1662dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f165c0cce40 0x7f165c151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:59.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.798+0000 7f1662dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f165c159ec0 0x7f165c0cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:59.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.798+0000 7f1662dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c1526d0 con 0x7f165c0b53d0 2023-10-09T06:43:59.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.798+0000 7f1662dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c0688a0 con 0x7f165c0cce40 2023-10-09T06:43:59.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.798+0000 7f1662dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165c152ee0 con 0x7f165c159ec0 2023-10-09T06:43:59.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.798+0000 7f1660b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f165c0b53d0 0x7f165c154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:59.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.798+0000 7f1660b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f165c0b53d0 0x7f165c154de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49532/0 (socket says 172.21.15.71:49532) 2023-10-09T06:43:59.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.798+0000 7f1660b9b700 1 -- 172.21.15.71:0/108802905 learned_addr learned my addr 172.21.15.71:0/108802905 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:43:59.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.799+0000 7f166139c700 1 --2- 172.21.15.71:0/108802905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f165c159ec0 0x7f165c0cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:59.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.799+0000 7f165bfff700 1 --2- 172.21.15.71:0/108802905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f165c0cce40 0x7f165c151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:59.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.799+0000 7f1660b9b700 1 -- 172.21.15.71:0/108802905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f165c159ec0 msgr2=0x7f165c0cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:59.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.799+0000 7f1660b9b700 1 --2- 172.21.15.71:0/108802905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f165c159ec0 0x7f165c0cecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:59.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.799+0000 7f1660b9b700 1 -- 172.21.15.71:0/108802905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f165c0cce40 msgr2=0x7f165c151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:43:59.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.799+0000 7f1660b9b700 1 --2- 172.21.15.71:0/108802905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f165c0cce40 0x7f165c151860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:43:59.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.799+0000 7f1660b9b700 1 -- 172.21.15.71:0/108802905 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16480094f0 con 0x7f165c0b53d0 2023-10-09T06:43:59.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.799+0000 7f165bfff700 1 --2- 172.21.15.71:0/108802905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f165c0cce40 0x7f165c151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:43:59.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.799+0000 7f1660b9b700 1 --2- 172.21.15.71:0/108802905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f165c0b53d0 0x7f165c154de0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1650009fa0 tx=0x7f165000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:59.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.799+0000 7f1658ff9700 1 -- 172.21.15.71:0/108802905 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165000cd00 con 0x7f165c0b53d0 2023-10-09T06:43:59.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.799+0000 7f1658ff9700 1 -- 172.21.15.71:0/108802905 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165000f040 con 0x7f165c0b53d0 2023-10-09T06:43:59.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.799+0000 7f1658ff9700 1 -- 172.21.15.71:0/108802905 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16500146b0 con 0x7f165c0b53d0 2023-10-09T06:43:59.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.799+0000 7f1662dff700 1 -- 172.21.15.71:0/108802905 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f165c152920 con 0x7f165c0b53d0 2023-10-09T06:43:59.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.799+0000 7f1662dff700 1 -- 172.21.15.71:0/108802905 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165c068530 con 0x7f165c0b53d0 2023-10-09T06:43:59.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.800+0000 7f1662dff700 1 -- 172.21.15.71:0/108802905 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f165c068b80 con 0x7f165c0b53d0 2023-10-09T06:43:59.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.801+0000 7f1658ff9700 1 -- 172.21.15.71:0/108802905 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 9) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f1650014a20 con 0x7f165c0b53d0 2023-10-09T06:43:59.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.802+0000 7f1658ff9700 1 --2- 172.21.15.71:0/108802905 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f16400671b0 0x7f1640069660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:43:59.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.803+0000 7f1658ff9700 1 -- 172.21.15.71:0/108802905 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f1650085370 con 0x7f165c0b53d0 2023-10-09T06:43:59.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.803+0000 7f165bfff700 1 --2- 172.21.15.71:0/108802905 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f16400671b0 0x7f1640069660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:43:59.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.804+0000 7f165bfff700 1 --2- 172.21.15.71:0/108802905 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f16400671b0 0x7f1640069660 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f16480099b0 tx=0x7f1648017000 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:43:59.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:43:59.807+0000 7f1658ff9700 1 -- 172.21.15.71:0/108802905 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16500520b0 con 0x7f165c0b53d0 2023-10-09T06:44:00.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.020+0000 7f1662dff700 1 -- 172.21.15.71:0/108802905 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f165c0689e0 con 0x7f16400671b0 2023-10-09T06:44:00.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.082+0000 7f1658ff9700 1 -- 172.21.15.71:0/108802905 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f164800b9d0 con 0x7f16400671b0 2023-10-09T06:44:00.083 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule activated for path /snap_test_dir1/dir1 2023-10-09T06:44:00.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.084+0000 7f1662dff700 1 -- 172.21.15.71:0/108802905 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f16400671b0 msgr2=0x7f1640069660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:00.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.084+0000 7f1662dff700 1 --2- 172.21.15.71:0/108802905 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f16400671b0 0x7f1640069660 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f16480099b0 tx=0x7f1648017000 comp rx=0 tx=0).stop 2023-10-09T06:44:00.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.084+0000 7f1662dff700 1 -- 172.21.15.71:0/108802905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f165c0b53d0 msgr2=0x7f165c154de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:00.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.084+0000 7f1662dff700 1 --2- 172.21.15.71:0/108802905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f165c0b53d0 0x7f165c154de0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1650009fa0 tx=0x7f165000b040 comp rx=0 tx=0).stop 2023-10-09T06:44:00.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.084+0000 7f1662dff700 1 -- 172.21.15.71:0/108802905 shutdown_connections 2023-10-09T06:44:00.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.084+0000 7f1662dff700 1 --2- 172.21.15.71:0/108802905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f165c159ec0 0x7f165c0cecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:00.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.084+0000 7f1662dff700 1 --2- 172.21.15.71:0/108802905 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f16400671b0 0x7f1640069660 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:00.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.084+0000 7f1662dff700 1 --2- 172.21.15.71:0/108802905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f165c0b53d0 0x7f165c154de0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:00.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.084+0000 7f1662dff700 1 --2- 172.21.15.71:0/108802905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f165c0cce40 0x7f165c151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:00.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.084+0000 7f1662dff700 1 -- 172.21.15.71:0/108802905 >> 172.21.15.71:0/108802905 conn(0x7f165c0999f0 msgr2=0x7f165c158f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:44:00.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.084+0000 7f1662dff700 1 -- 172.21.15.71:0/108802905 shutdown_connections 2023-10-09T06:44:00.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.084+0000 7f1662dff700 1 -- 172.21.15.71:0/108802905 wait complete. 2023-10-09T06:44:00.102 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:44:00.102+0000 7f8acf24d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:44:00.102 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:44:00.102+0000 7f8acf24d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:44:00.102 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:44:00.102+0000 7f8acf24d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:44:00.102 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:44:00.102+0000 7f8acf24d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:44:00.102 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:44:00.102+0000 7f8acf24d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:44:00.103 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir1 2023-10-09T06:44:00.104 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir2 1M 2023-10-09T06:44:00.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.307+0000 7fc8fd59d700 1 Processor -- start 2023-10-09T06:44:00.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.307+0000 7fc8fd59d700 1 -- start start 2023-10-09T06:44:00.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.309+0000 7fc8fd59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f8156350 0x7fc8f8157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:00.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.309+0000 7fc8fd59d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc8f80b0760 0x7fc8f80b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:00.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.309+0000 7fc8fd59d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc8f8159f20 0x7fc8f815a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:00.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.309+0000 7fc8fd59d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f80b1110 con 0x7fc8f80b0760 2023-10-09T06:44:00.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.309+0000 7fc8fd59d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f80b0570 con 0x7fc8f8159f20 2023-10-09T06:44:00.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.309+0000 7fc8fd59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f81578b0 con 0x7fc8f8156350 2023-10-09T06:44:00.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.309+0000 7fc8f77fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc8f80b0760 0x7fc8f80b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:00.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.309+0000 7fc8f77fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc8f80b0760 0x7fc8f80b0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49546/0 (socket says 172.21.15.71:49546) 2023-10-09T06:44:00.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.309+0000 7fc8f77fe700 1 -- 172.21.15.71:0/1925859949 learned_addr learned my addr 172.21.15.71:0/1925859949 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:44:00.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.309+0000 7fc8f7fff700 1 --2- 172.21.15.71:0/1925859949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f8156350 0x7fc8f8157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:00.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.309+0000 7fc8fcd9c700 1 --2- 172.21.15.71:0/1925859949 >> v2:172.21.15.179:3300/0 conn(0x7fc8f8159f20 0x7fc8f815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:00.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.309+0000 7fc8f77fe700 1 -- 172.21.15.71:0/1925859949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f8156350 msgr2=0x7fc8f8157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:44:00.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.309+0000 7fc8f77fe700 1 --2- 172.21.15.71:0/1925859949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f8156350 0x7fc8f8157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:00.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.309+0000 7fc8f77fe700 1 -- 172.21.15.71:0/1925859949 >> v2:172.21.15.179:3300/0 conn(0x7fc8f8159f20 msgr2=0x7fc8f815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:44:00.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.309+0000 7fc8f77fe700 1 --2- 172.21.15.71:0/1925859949 >> v2:172.21.15.179:3300/0 conn(0x7fc8f8159f20 0x7fc8f815a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:00.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.309+0000 7fc8f77fe700 1 -- 172.21.15.71:0/1925859949 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f80af4d0 con 0x7fc8f80b0760 2023-10-09T06:44:00.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.309+0000 7fc8f7fff700 1 --2- 172.21.15.71:0/1925859949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f8156350 0x7fc8f8157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:44:00.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.309+0000 7fc8fcd9c700 1 --2- 172.21.15.71:0/1925859949 >> v2:172.21.15.179:3300/0 conn(0x7fc8f8159f20 0x7fc8f815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:44:00.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.310+0000 7fc8f77fe700 1 --2- 172.21.15.71:0/1925859949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8f80b0760 0x7fc8f80b0bd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8067f50 tx=0x7fc8ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c9f52272d50b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:00.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.310+0000 7fc8f6ffd700 1 -- 172.21.15.71:0/1925859949 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec00b860 con 0x7fc8f80b0760 2023-10-09T06:44:00.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.310+0000 7fc8f6ffd700 1 -- 172.21.15.71:0/1925859949 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ec00b9c0 con 0x7fc8f80b0760 2023-10-09T06:44:00.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.310+0000 7fc8f6ffd700 1 -- 172.21.15.71:0/1925859949 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec00bd60 con 0x7fc8f80b0760 2023-10-09T06:44:00.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.310+0000 7fc8fd59d700 1 -- 172.21.15.71:0/1925859949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8f80b0760 msgr2=0x7fc8f80b0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:00.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.310+0000 7fc8fd59d700 1 --2- 172.21.15.71:0/1925859949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8f80b0760 0x7fc8f80b0bd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8067f50 tx=0x7fc8ec009250 comp rx=0 tx=0).stop 2023-10-09T06:44:00.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.311+0000 7fc8fd59d700 1 -- 172.21.15.71:0/1925859949 shutdown_connections 2023-10-09T06:44:00.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.311+0000 7fc8fd59d700 1 --2- 172.21.15.71:0/1925859949 >> v2:172.21.15.179:3300/0 conn(0x7fc8f8159f20 0x7fc8f815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:00.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.311+0000 7fc8fd59d700 1 --2- 172.21.15.71:0/1925859949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f8156350 0x7fc8f8157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:00.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.311+0000 7fc8fd59d700 1 --2- 172.21.15.71:0/1925859949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8f80b0760 0x7fc8f80b0bd0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:00.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.311+0000 7fc8fd59d700 1 -- 172.21.15.71:0/1925859949 >> 172.21.15.71:0/1925859949 conn(0x7fc8f8068e20 msgr2=0x7fc8f80cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:44:00.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.311+0000 7fc8fd59d700 1 -- 172.21.15.71:0/1925859949 shutdown_connections 2023-10-09T06:44:00.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.311+0000 7fc8fd59d700 1 -- 172.21.15.71:0/1925859949 wait complete. 2023-10-09T06:44:00.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.312+0000 7fc8fd59d700 1 Processor -- start 2023-10-09T06:44:00.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.312+0000 7fc8fd59d700 1 -- start start 2023-10-09T06:44:00.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.313+0000 7fc8fd59d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8f80b0760 0x7fc8f80a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:00.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.313+0000 7fc8fd59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f8156350 0x7fc8f8151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:00.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.313+0000 7fc8fd59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f8159f20 0x7fc8f816b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:00.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.313+0000 7fc8fd59d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f80ab420 con 0x7fc8f80b0760 2023-10-09T06:44:00.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.313+0000 7fc8fd59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f80ab700 con 0x7fc8f8156350 2023-10-09T06:44:00.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.313+0000 7fc8fd59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f80ab9e0 con 0x7fc8f8159f20 2023-10-09T06:44:00.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.313+0000 7fc8f7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8f80b0760 0x7fc8f80a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:00.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.313+0000 7fc8f7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8f80b0760 0x7fc8f80a5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49558/0 (socket says 172.21.15.71:49558) 2023-10-09T06:44:00.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.313+0000 7fc8f7fff700 1 -- 172.21.15.71:0/4198323479 learned_addr learned my addr 172.21.15.71:0/4198323479 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:44:00.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.314+0000 7fc8f7fff700 1 -- 172.21.15.71:0/4198323479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f8159f20 msgr2=0x7fc8f816b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:00.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.314+0000 7fc8f7fff700 1 --2- 172.21.15.71:0/4198323479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f8159f20 0x7fc8f816b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:00.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.314+0000 7fc8f7fff700 1 -- 172.21.15.71:0/4198323479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f8156350 msgr2=0x7fc8f8151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:00.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.314+0000 7fc8f7fff700 1 --2- 172.21.15.71:0/4198323479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f8156350 0x7fc8f8151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:00.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.314+0000 7fc8f7fff700 1 -- 172.21.15.71:0/4198323479 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ec0094f0 con 0x7fc8f80b0760 2023-10-09T06:44:00.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.314+0000 7fc8f7fff700 1 --2- 172.21.15.71:0/4198323479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8f80b0760 0x7fc8f80a5ea0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800d860 tx=0x7fc8e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:00.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.314+0000 7fc8dffff700 1 -- 172.21.15.71:0/4198323479 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e80125f0 con 0x7fc8f80b0760 2023-10-09T06:44:00.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.314+0000 7fc8dffff700 1 -- 172.21.15.71:0/4198323479 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e8012750 con 0x7fc8f80b0760 2023-10-09T06:44:00.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.314+0000 7fc8fd59d700 1 -- 172.21.15.71:0/4198323479 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f815af80 con 0x7fc8f80b0760 2023-10-09T06:44:00.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.314+0000 7fc8dffff700 1 -- 172.21.15.71:0/4198323479 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8012ad0 con 0x7fc8f80b0760 2023-10-09T06:44:00.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.314+0000 7fc8fd59d700 1 -- 172.21.15.71:0/4198323479 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f80a63e0 con 0x7fc8f80b0760 2023-10-09T06:44:00.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.315+0000 7fc8fd59d700 1 -- 172.21.15.71:0/4198323479 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f804c3c0 con 0x7fc8f80b0760 2023-10-09T06:44:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.316+0000 7fc8dffff700 1 -- 172.21.15.71:0/4198323479 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 9) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fc8e8014430 con 0x7fc8f80b0760 2023-10-09T06:44:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.317+0000 7fc8dffff700 1 --2- 172.21.15.71:0/4198323479 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc8e4067130 0x7fc8e40695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.317+0000 7fc8dffff700 1 -- 172.21.15.71:0/4198323479 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fc8e8084e00 con 0x7fc8f80b0760 2023-10-09T06:44:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.317+0000 7fc8f77fe700 1 --2- 172.21.15.71:0/4198323479 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc8e4067130 0x7fc8e40695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.318+0000 7fc8f77fe700 1 --2- 172.21.15.71:0/4198323479 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc8e4067130 0x7fc8e40695e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8067f50 tx=0x7fc8ec017000 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:00.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.321+0000 7fc8dffff700 1 -- 172.21.15.71:0/4198323479 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8e8055780 con 0x7fc8f80b0760 2023-10-09T06:44:00.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.567+0000 7fc8fd59d700 1 -- 172.21.15.71:0/4198323479 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8f80af7b0 con 0x7fc8e4067130 2023-10-09T06:44:00.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.705+0000 7fc8dffff700 1 -- 172.21.15.71:0/4198323479 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fc8f80af7b0 con 0x7fc8e4067130 2023-10-09T06:44:00.706 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule activated for path /snap_test_dir1/dir2 2023-10-09T06:44:00.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.708+0000 7fc8fd59d700 1 -- 172.21.15.71:0/4198323479 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc8e4067130 msgr2=0x7fc8e40695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:00.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.708+0000 7fc8fd59d700 1 --2- 172.21.15.71:0/4198323479 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc8e4067130 0x7fc8e40695e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8067f50 tx=0x7fc8ec017000 comp rx=0 tx=0).stop 2023-10-09T06:44:00.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.708+0000 7fc8fd59d700 1 -- 172.21.15.71:0/4198323479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8f80b0760 msgr2=0x7fc8f80a5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:00.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.708+0000 7fc8fd59d700 1 --2- 172.21.15.71:0/4198323479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8f80b0760 0x7fc8f80a5ea0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800d860 tx=0x7fc8e8008040 comp rx=0 tx=0).stop 2023-10-09T06:44:00.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.708+0000 7fc8fd59d700 1 -- 172.21.15.71:0/4198323479 shutdown_connections 2023-10-09T06:44:00.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.708+0000 7fc8fd59d700 1 --2- 172.21.15.71:0/4198323479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f8159f20 0x7fc8f816b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:00.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.708+0000 7fc8fd59d700 1 --2- 172.21.15.71:0/4198323479 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc8e4067130 0x7fc8e40695e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:00.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.708+0000 7fc8fd59d700 1 --2- 172.21.15.71:0/4198323479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8f80b0760 0x7fc8f80a5ea0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:00.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.708+0000 7fc8fd59d700 1 --2- 172.21.15.71:0/4198323479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f8156350 0x7fc8f8151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:00.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.708+0000 7fc8fd59d700 1 -- 172.21.15.71:0/4198323479 >> 172.21.15.71:0/4198323479 conn(0x7fc8f8068e20 msgr2=0x7fc8f8156720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:44:00.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.708+0000 7fc8fd59d700 1 -- 172.21.15.71:0/4198323479 shutdown_connections 2023-10-09T06:44:00.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.708+0000 7fc8fd59d700 1 -- 172.21.15.71:0/4198323479 wait complete. 2023-10-09T06:44:00.728 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir2 2023-10-09T06:44:00.728 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir3 1M 2023-10-09T06:44:00.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.926+0000 7f15a139d700 1 Processor -- start 2023-10-09T06:44:00.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.926+0000 7f15a139d700 1 -- start start 2023-10-09T06:44:00.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.927+0000 7f15a139d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f159c153480 0x7f159c0ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:00.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.927+0000 7f15a139d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c153850 0x7f159c1596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:00.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.927+0000 7f15a139d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159c15a050 con 0x7f159c159bf0 2023-10-09T06:44:00.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.927+0000 7f15a139d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f159c0ccfe0 con 0x7f159c153480 2023-10-09T06:44:00.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.927+0000 7f15a139d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0aec90 con 0x7f159c153850 2023-10-09T06:44:00.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.928+0000 7f159bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f159c153480 0x7f159c0ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:00.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.928+0000 7f159b7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c153850 0x7f159c1596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:00.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.928+0000 7f15a0b9c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f159c159bf0 0x7f159c0cc8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:37084/0 (socket says 172.21.15.71:37084) 2023-10-09T06:44:00.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.928+0000 7f159bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f159c153480 0x7f159c0ae750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:59482/0 (socket says 172.21.15.71:59482) 2023-10-09T06:44:00.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.928+0000 7f159b7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c153850 0x7f159c1596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:36650/0 (socket says 172.21.15.71:36650) 2023-10-09T06:44:00.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.928+0000 7f15a0b9c700 1 -- 172.21.15.71:0/4075709387 learned_addr learned my addr 172.21.15.71:0/4075709387 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:44:00.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.928+0000 7f159affd700 1 -- 172.21.15.71:0/4075709387 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2411240667 0 0) 0x7f1594001490 con 0x7f159c159bf0 2023-10-09T06:44:00.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.928+0000 7f159affd700 1 -- 172.21.15.71:0/4075709387 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1584003570 con 0x7f159c159bf0 2023-10-09T06:44:00.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.928+0000 7f159bfff700 1 -- 172.21.15.71:0/4075709387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c153850 msgr2=0x7f159c1596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:44:00.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.928+0000 7f159bfff700 1 --2- 172.21.15.71:0/4075709387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c153850 0x7f159c1596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:00.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.928+0000 7f159bfff700 1 -- 172.21.15.71:0/4075709387 >> v1:172.21.15.179:6789/0 conn(0x7f159c159bf0 legacy=0x7f159c0cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:00.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.928+0000 7f159bfff700 1 -- 172.21.15.71:0/4075709387 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c15a480 con 0x7f159c153480 2023-10-09T06:44:00.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.929+0000 7f159bfff700 1 --2- 172.21.15.71:0/4075709387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159c153480 0x7f159c0ae750 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f158c0098e0 tx=0x7f158c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a005cdcd3a16236 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:00.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.929+0000 7f159affd700 1 -- 172.21.15.71:0/4075709387 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c011630 con 0x7f159c153480 2023-10-09T06:44:00.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.929+0000 7f159affd700 1 -- 172.21.15.71:0/4075709387 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c011790 con 0x7f159c153480 2023-10-09T06:44:00.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.929+0000 7f159affd700 1 -- 172.21.15.71:0/4075709387 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c011b30 con 0x7f159c153480 2023-10-09T06:44:00.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.930+0000 7f15a139d700 1 -- 172.21.15.71:0/4075709387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159c153480 msgr2=0x7f159c0ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:00.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.930+0000 7f15a139d700 1 --2- 172.21.15.71:0/4075709387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159c153480 0x7f159c0ae750 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f158c0098e0 tx=0x7f158c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:44:00.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.930+0000 7f15a139d700 1 -- 172.21.15.71:0/4075709387 shutdown_connections 2023-10-09T06:44:00.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.930+0000 7f15a139d700 1 --2- 172.21.15.71:0/4075709387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159c153480 0x7f159c0ae750 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:00.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.930+0000 7f15a139d700 1 --2- 172.21.15.71:0/4075709387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c153850 0x7f159c1596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:00.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.930+0000 7f15a139d700 1 -- 172.21.15.71:0/4075709387 >> 172.21.15.71:0/4075709387 conn(0x7f159c068e20 msgr2=0x7f159c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:44:00.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.930+0000 7f15a139d700 1 -- 172.21.15.71:0/4075709387 shutdown_connections 2023-10-09T06:44:00.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.930+0000 7f15a139d700 1 -- 172.21.15.71:0/4075709387 wait complete. 2023-10-09T06:44:00.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.932+0000 7f15a139d700 1 Processor -- start 2023-10-09T06:44:00.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.932+0000 7f15a139d700 1 -- start start 2023-10-09T06:44:00.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.933+0000 7f15a139d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f159c153480 0x7f159c151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:00.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.933+0000 7f15a139d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159c153850 0x7f159c1698a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:00.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.933+0000 7f15a139d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c159bf0 0x7f159c06e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:00.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.933+0000 7f15a139d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0c9a60 con 0x7f159c153480 2023-10-09T06:44:00.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.933+0000 7f15a139d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0c5c70 con 0x7f159c153850 2023-10-09T06:44:00.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.933+0000 7f15a139d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0c9780 con 0x7f159c159bf0 2023-10-09T06:44:00.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.933+0000 7f159bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f159c153480 0x7f159c151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:00.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.933+0000 7f159bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f159c153480 0x7f159c151ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49566/0 (socket says 172.21.15.71:49566) 2023-10-09T06:44:00.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.933+0000 7f159b7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159c153850 0x7f159c1698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:00.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.933+0000 7f159bfff700 1 -- 172.21.15.71:0/1602873353 learned_addr learned my addr 172.21.15.71:0/1602873353 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:44:00.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.933+0000 7f15a0b9c700 1 --2- 172.21.15.71:0/1602873353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c159bf0 0x7f159c06e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:00.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.934+0000 7f159bfff700 1 -- 172.21.15.71:0/1602873353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c159bf0 msgr2=0x7f159c06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:00.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.934+0000 7f159bfff700 1 --2- 172.21.15.71:0/1602873353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c159bf0 0x7f159c06e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:00.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.934+0000 7f159bfff700 1 -- 172.21.15.71:0/1602873353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159c153850 msgr2=0x7f159c1698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:00.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.934+0000 7f159bfff700 1 --2- 172.21.15.71:0/1602873353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159c153850 0x7f159c1698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:00.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.934+0000 7f159bfff700 1 -- 172.21.15.71:0/1602873353 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c009420 con 0x7f159c153480 2023-10-09T06:44:00.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.934+0000 7f15a0b9c700 1 --2- 172.21.15.71:0/1602873353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c159bf0 0x7f159c06e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:44:00.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.934+0000 7f159b7fe700 1 --2- 172.21.15.71:0/1602873353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159c153850 0x7f159c1698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:44:00.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.934+0000 7f159bfff700 1 --2- 172.21.15.71:0/1602873353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f159c153480 0x7f159c151ee0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f159c0714a0 tx=0x7f158c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:00.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.934+0000 7f1583fff700 1 -- 172.21.15.71:0/1602873353 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c000d10 con 0x7f159c153480 2023-10-09T06:44:00.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.934+0000 7f1583fff700 1 -- 172.21.15.71:0/1602873353 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c011b10 con 0x7f159c153480 2023-10-09T06:44:00.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.934+0000 7f15a139d700 1 -- 172.21.15.71:0/1602873353 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f159c0c5620 con 0x7f159c153480 2023-10-09T06:44:00.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.934+0000 7f1583fff700 1 -- 172.21.15.71:0/1602873353 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c025660 con 0x7f159c153480 2023-10-09T06:44:00.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.935+0000 7f15a139d700 1 -- 172.21.15.71:0/1602873353 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f159c152420 con 0x7f159c153480 2023-10-09T06:44:00.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.936+0000 7f15a139d700 1 -- 172.21.15.71:0/1602873353 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159c0c5480 con 0x7f159c153480 2023-10-09T06:44:00.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.937+0000 7f1583fff700 1 -- 172.21.15.71:0/1602873353 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 10) v1 ==== 84973+0+0 (secure 0 0 0) 0x7f158c025a50 con 0x7f159c153480 2023-10-09T06:44:00.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.937+0000 7f1583fff700 1 --2- 172.21.15.71:0/1602873353 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f15880671c0 0x7f1588069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:00.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.938+0000 7f1583fff700 1 -- 172.21.15.71:0/1602873353 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f158c0861d0 con 0x7f159c153480 2023-10-09T06:44:00.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.938+0000 7f159b7fe700 1 --2- 172.21.15.71:0/1602873353 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f15880671c0 0x7f1588069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:00.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.938+0000 7f159b7fe700 1 --2- 172.21.15.71:0/1602873353 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f15880671c0 0x7f1588069670 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f159c0c80b0 tx=0x7f15900091a0 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:00.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:00.942+0000 7f1583fff700 1 -- 172.21.15.71:0/1602873353 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f159c0c5480 con 0x7f159c153480 2023-10-09T06:44:01.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.166+0000 7f15a139d700 1 -- 172.21.15.71:0/1602873353 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f159c0c5480 con 0x7f15880671c0 2023-10-09T06:44:01.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.220+0000 7f1583fff700 1 -- 172.21.15.71:0/1602873353 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f159c0c5480 con 0x7f15880671c0 2023-10-09T06:44:01.221 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule activated for path /snap_test_dir1/dir3 2023-10-09T06:44:01.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.223+0000 7f15a139d700 1 -- 172.21.15.71:0/1602873353 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f15880671c0 msgr2=0x7f1588069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:01.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.223+0000 7f15a139d700 1 --2- 172.21.15.71:0/1602873353 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f15880671c0 0x7f1588069670 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f159c0c80b0 tx=0x7f15900091a0 comp rx=0 tx=0).stop 2023-10-09T06:44:01.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.223+0000 7f15a139d700 1 -- 172.21.15.71:0/1602873353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f159c153480 msgr2=0x7f159c151ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:01.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.223+0000 7f15a139d700 1 --2- 172.21.15.71:0/1602873353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f159c153480 0x7f159c151ee0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f159c0714a0 tx=0x7f158c017000 comp rx=0 tx=0).stop 2023-10-09T06:44:01.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.223+0000 7f15a139d700 1 -- 172.21.15.71:0/1602873353 shutdown_connections 2023-10-09T06:44:01.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.223+0000 7f15a139d700 1 --2- 172.21.15.71:0/1602873353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c159bf0 0x7f159c06e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:01.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.223+0000 7f15a139d700 1 --2- 172.21.15.71:0/1602873353 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f15880671c0 0x7f1588069670 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:01.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.223+0000 7f15a139d700 1 --2- 172.21.15.71:0/1602873353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f159c153480 0x7f159c151ee0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:01.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.223+0000 7f15a139d700 1 --2- 172.21.15.71:0/1602873353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159c153850 0x7f159c1698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:01.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.223+0000 7f15a139d700 1 -- 172.21.15.71:0/1602873353 >> 172.21.15.71:0/1602873353 conn(0x7f159c068e20 msgr2=0x7f159c158220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:44:01.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.223+0000 7f15a139d700 1 -- 172.21.15.71:0/1602873353 shutdown_connections 2023-10-09T06:44:01.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.223+0000 7f15a139d700 1 -- 172.21.15.71:0/1602873353 wait complete. 2023-10-09T06:44:01.242 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir3 2023-10-09T06:44:01.242 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir4 1M 2023-10-09T06:44:01.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.426+0000 7ff6d7fff700 1 Processor -- start 2023-10-09T06:44:01.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.427+0000 7ff6d7fff700 1 -- start start 2023-10-09T06:44:01.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.428+0000 7ff6d7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6d80cca20 0x7ff6d80cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:01.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.428+0000 7ff6d7fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d80cfa00 con 0x7ff6d80b03c0 2023-10-09T06:44:01.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.428+0000 7ff6d7fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d80cb580 con 0x7ff6d80b0790 2023-10-09T06:44:01.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.428+0000 7ff6d7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d80cf160 con 0x7ff6d80cca20 2023-10-09T06:44:01.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.428+0000 7ff6d6ffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff6d80b03c0 0x7ff6d80b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:40752/0 (socket says 172.21.15.71:40752) 2023-10-09T06:44:01.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.428+0000 7ff6d6ffd700 1 -- 172.21.15.71:0/176797778 learned_addr learned my addr 172.21.15.71:0/176797778 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:44:01.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.428+0000 7ff6d77fe700 1 --2- 172.21.15.71:0/176797778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6d80cca20 0x7ff6d80cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:01.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.428+0000 7ff6d5ffb700 1 -- 172.21.15.71:0/176797778 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439234608 0 0) 0x7ff6d80cfa00 con 0x7ff6d80b03c0 2023-10-09T06:44:01.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.428+0000 7ff6d5ffb700 1 -- 172.21.15.71:0/176797778 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6c0003570 con 0x7ff6d80b03c0 2023-10-09T06:44:01.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.429+0000 7ff6d5ffb700 1 -- 172.21.15.71:0/176797778 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2900930002 0 0) 0x7ff6c0003570 con 0x7ff6d80b03c0 2023-10-09T06:44:01.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.429+0000 7ff6d5ffb700 1 -- 172.21.15.71:0/176797778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6d80cca20 msgr2=0x7ff6d80cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:44:01.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.429+0000 7ff6d5ffb700 1 --2- 172.21.15.71:0/176797778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6d80cca20 0x7ff6d80cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.429+0000 7ff6d5ffb700 1 -- 172.21.15.71:0/176797778 >> v1:172.21.15.179:6789/0 conn(0x7ff6d80b0790 legacy=0x7ff6d81591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.429+0000 7ff6d5ffb700 1 -- 172.21.15.71:0/176797778 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d80cf440 con 0x7ff6d80b03c0 2023-10-09T06:44:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.429+0000 7ff6d5ffb700 1 -- 172.21.15.71:0/176797778 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7ff6c8001470 con 0x7ff6d80b03c0 2023-10-09T06:44:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.429+0000 7ff6d5ffb700 1 -- 172.21.15.71:0/176797778 >> v1:172.21.15.71:6789/0 conn(0x7ff6d80b03c0 legacy=0x7ff6d80b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.429+0000 7ff6d5ffb700 1 --2- 172.21.15.71:0/176797778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c0003a90 0x7ff6c0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.429+0000 7ff6d5ffb700 1 --2- 172.21.15.71:0/176797778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6d80cca20 0x7ff6c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.429+0000 7ff6d5ffb700 1 --2- 172.21.15.71:0/176797778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6c0004d50 0x7ff6c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.429+0000 7ff6d5ffb700 1 -- 172.21.15.71:0/176797778 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d80cf160 con 0x7ff6c0004d50 2023-10-09T06:44:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.429+0000 7ff6d5ffb700 1 -- 172.21.15.71:0/176797778 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c000bb10 con 0x7ff6c0003a90 2023-10-09T06:44:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.429+0000 7ff6d5ffb700 1 -- 172.21.15.71:0/176797778 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c000bcd0 con 0x7ff6d80cca20 2023-10-09T06:44:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.429+0000 7ff6d77fe700 1 --2- 172.21.15.71:0/176797778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6c0004d50 0x7ff6c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.429+0000 7ff6d67fc700 1 --2- 172.21.15.71:0/176797778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6d80cca20 0x7ff6c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.429+0000 7ff6d6ffd700 1 --2- 172.21.15.71:0/176797778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c0003a90 0x7ff6c0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.430+0000 7ff6d77fe700 1 -- 172.21.15.71:0/176797778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6d80cca20 msgr2=0x7ff6c0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:44:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.430+0000 7ff6d77fe700 1 --2- 172.21.15.71:0/176797778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6d80cca20 0x7ff6c0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.430+0000 7ff6d77fe700 1 -- 172.21.15.71:0/176797778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c0003a90 msgr2=0x7ff6c0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:44:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.430+0000 7ff6d77fe700 1 --2- 172.21.15.71:0/176797778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c0003a90 0x7ff6c0003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.430+0000 7ff6d77fe700 1 -- 172.21.15.71:0/176797778 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c0003570 con 0x7ff6c0004d50 2023-10-09T06:44:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.430+0000 7ff6d67fc700 1 --2- 172.21.15.71:0/176797778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6d80cca20 0x7ff6c0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:44:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.430+0000 7ff6d77fe700 1 --2- 172.21.15.71:0/176797778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6c0004d50 0x7ff6c00051c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000e210 tx=0x7ff6d000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c187931fd17cfc9b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.430+0000 7ff6d5ffb700 1 -- 172.21.15.71:0/176797778 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d000eac0 con 0x7ff6c0004d50 2023-10-09T06:44:01.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.430+0000 7ff6d5ffb700 1 -- 172.21.15.71:0/176797778 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d000f040 con 0x7ff6c0004d50 2023-10-09T06:44:01.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.430+0000 7ff6d5ffb700 1 -- 172.21.15.71:0/176797778 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d000ee70 con 0x7ff6c0004d50 2023-10-09T06:44:01.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.431+0000 7ff6d7fff700 1 -- 172.21.15.71:0/176797778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6c0004d50 msgr2=0x7ff6c00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:01.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.431+0000 7ff6d7fff700 1 --2- 172.21.15.71:0/176797778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6c0004d50 0x7ff6c00051c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000e210 tx=0x7ff6d000b040 comp rx=0 tx=0).stop 2023-10-09T06:44:01.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.431+0000 7ff6d77fe700 1 -- 172.21.15.71:0/176797778 reap_dead start 2023-10-09T06:44:01.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.431+0000 7ff6d7fff700 1 -- 172.21.15.71:0/176797778 shutdown_connections 2023-10-09T06:44:01.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.431+0000 7ff6d7fff700 1 -- 172.21.15.71:0/176797778 >> 172.21.15.71:0/176797778 conn(0x7ff6d8063230 msgr2=0x7ff6d8063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:44:01.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.431+0000 7ff6d7fff700 1 -- 172.21.15.71:0/176797778 shutdown_connections 2023-10-09T06:44:01.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.431+0000 7ff6d7fff700 1 -- 172.21.15.71:0/176797778 wait complete. 2023-10-09T06:44:01.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.432+0000 7ff6d7fff700 1 Processor -- start 2023-10-09T06:44:01.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.432+0000 7ff6d7fff700 1 -- start start 2023-10-09T06:44:01.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.433+0000 7ff6d7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c0004d50 0x7ff6d8159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:01.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.433+0000 7ff6d7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6d80c8b30 0x7ff6d80c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:01.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.433+0000 7ff6d7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6d80c60b0 0x7ff6d80c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:01.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.433+0000 7ff6d7fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d80c6a70 con 0x7ff6d80c8b30 2023-10-09T06:44:01.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.433+0000 7ff6d7fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d80c7840 con 0x7ff6d80c60b0 2023-10-09T06:44:01.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.433+0000 7ff6d7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d80c86a0 con 0x7ff6c0004d50 2023-10-09T06:44:01.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.433+0000 7ff6d67fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6d80c8b30 0x7ff6d80c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:01.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.434+0000 7ff6d67fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6d80c8b30 0x7ff6d80c8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49580/0 (socket says 172.21.15.71:49580) 2023-10-09T06:44:01.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.434+0000 7ff6d67fc700 1 -- 172.21.15.71:0/972815976 learned_addr learned my addr 172.21.15.71:0/972815976 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:44:01.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.434+0000 7ff6d6ffd700 1 --2- 172.21.15.71:0/972815976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c0004d50 0x7ff6d8159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:01.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.434+0000 7ff6d77fe700 1 --2- 172.21.15.71:0/972815976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6d80c60b0 0x7ff6d80c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:01.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.434+0000 7ff6d67fc700 1 -- 172.21.15.71:0/972815976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c0004d50 msgr2=0x7ff6d8159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:01.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.434+0000 7ff6d67fc700 1 --2- 172.21.15.71:0/972815976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c0004d50 0x7ff6d8159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:01.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.434+0000 7ff6d67fc700 1 -- 172.21.15.71:0/972815976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6d80c60b0 msgr2=0x7ff6d80c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:01.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.434+0000 7ff6d67fc700 1 --2- 172.21.15.71:0/972815976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6d80c60b0 0x7ff6d80c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:01.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.434+0000 7ff6d67fc700 1 -- 172.21.15.71:0/972815976 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d80c7a90 con 0x7ff6d80c8b30 2023-10-09T06:44:01.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.434+0000 7ff6d6ffd700 1 --2- 172.21.15.71:0/972815976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c0004d50 0x7ff6d8159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:44:01.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.434+0000 7ff6d77fe700 1 --2- 172.21.15.71:0/972815976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6d80c60b0 0x7ff6d80c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:44:01.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.434+0000 7ff6d67fc700 1 --2- 172.21.15.71:0/972815976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6d80c8b30 0x7ff6d80c8fa0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00fa00 tx=0x7ff6cc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:01.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.434+0000 7ff6beffd700 1 -- 172.21.15.71:0/972815976 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc00d920 con 0x7ff6d80c8b30 2023-10-09T06:44:01.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.434+0000 7ff6beffd700 1 -- 172.21.15.71:0/972815976 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6cc00da80 con 0x7ff6d80c8b30 2023-10-09T06:44:01.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.434+0000 7ff6beffd700 1 -- 172.21.15.71:0/972815976 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc00de00 con 0x7ff6d80c8b30 2023-10-09T06:44:01.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.434+0000 7ff6d7fff700 1 -- 172.21.15.71:0/972815976 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d80c7d70 con 0x7ff6d80c8b30 2023-10-09T06:44:01.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.435+0000 7ff6d7fff700 1 -- 172.21.15.71:0/972815976 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d80c8330 con 0x7ff6d80c8b30 2023-10-09T06:44:01.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.436+0000 7ff6d7fff700 1 -- 172.21.15.71:0/972815976 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d804c3c0 con 0x7ff6d80c8b30 2023-10-09T06:44:01.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.437+0000 7ff6beffd700 1 -- 172.21.15.71:0/972815976 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 10) v1 ==== 84973+0+0 (secure 0 0 0) 0x7ff6cc013600 con 0x7ff6d80c8b30 2023-10-09T06:44:01.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.438+0000 7ff6beffd700 1 --2- 172.21.15.71:0/972815976 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff6c40671c0 0x7ff6c4069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:01.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.438+0000 7ff6beffd700 1 -- 172.21.15.71:0/972815976 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7ff6cc084c80 con 0x7ff6d80c8b30 2023-10-09T06:44:01.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.438+0000 7ff6d6ffd700 1 --2- 172.21.15.71:0/972815976 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff6c40671c0 0x7ff6c4069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:01.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.439+0000 7ff6d6ffd700 1 --2- 172.21.15.71:0/972815976 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff6c40671c0 0x7ff6c4069670 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8000e10 tx=0x7ff6c8009040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:01.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.441+0000 7ff6beffd700 1 -- 172.21.15.71:0/972815976 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6cc051b60 con 0x7ff6d80c8b30 2023-10-09T06:44:01.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.657+0000 7ff6d7fff700 1 -- 172.21.15.71:0/972815976 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6d80c87e0 con 0x7ff6c40671c0 2023-10-09T06:44:01.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.716+0000 7ff6beffd700 1 -- 172.21.15.71:0/972815976 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7ff6d80c87e0 con 0x7ff6c40671c0 2023-10-09T06:44:01.717 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule activated for path /snap_test_dir1/dir4 2023-10-09T06:44:01.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.718+0000 7ff6d7fff700 1 -- 172.21.15.71:0/972815976 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff6c40671c0 msgr2=0x7ff6c4069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:01.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.718+0000 7ff6d7fff700 1 --2- 172.21.15.71:0/972815976 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff6c40671c0 0x7ff6c4069670 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8000e10 tx=0x7ff6c8009040 comp rx=0 tx=0).stop 2023-10-09T06:44:01.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.718+0000 7ff6d7fff700 1 -- 172.21.15.71:0/972815976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6d80c8b30 msgr2=0x7ff6d80c8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:01.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.718+0000 7ff6d7fff700 1 --2- 172.21.15.71:0/972815976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6d80c8b30 0x7ff6d80c8fa0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00fa00 tx=0x7ff6cc009040 comp rx=0 tx=0).stop 2023-10-09T06:44:01.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.719+0000 7ff6d7fff700 1 -- 172.21.15.71:0/972815976 shutdown_connections 2023-10-09T06:44:01.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.719+0000 7ff6d7fff700 1 --2- 172.21.15.71:0/972815976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6d80c60b0 0x7ff6d80c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:01.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.719+0000 7ff6d7fff700 1 --2- 172.21.15.71:0/972815976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6c0004d50 0x7ff6d8159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:01.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.719+0000 7ff6d7fff700 1 --2- 172.21.15.71:0/972815976 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff6c40671c0 0x7ff6c4069670 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:01.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.719+0000 7ff6d7fff700 1 --2- 172.21.15.71:0/972815976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6d80c8b30 0x7ff6d80c8fa0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:01.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.719+0000 7ff6d7fff700 1 -- 172.21.15.71:0/972815976 >> 172.21.15.71:0/972815976 conn(0x7ff6d8063230 msgr2=0x7ff6d80b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:44:01.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.719+0000 7ff6d7fff700 1 -- 172.21.15.71:0/972815976 shutdown_connections 2023-10-09T06:44:01.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.719+0000 7ff6d7fff700 1 -- 172.21.15.71:0/972815976 wait complete. 2023-10-09T06:44:01.737 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir4 2023-10-09T06:44:01.737 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir5 1M 2023-10-09T06:44:01.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.922+0000 7fcf0279d700 1 Processor -- start 2023-10-09T06:44:01.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.923+0000 7fcf0279d700 1 -- start start 2023-10-09T06:44:01.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.924+0000 7fcf0279d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcefc156350 0x7fcefc157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:01.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.924+0000 7fcf0279d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcefc0b0570 con 0x7fcefc0b0c00 2023-10-09T06:44:01.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.924+0000 7fcf0279d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcefc15ad40 con 0x7fcefc0b0760 2023-10-09T06:44:01.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.924+0000 7fcf0279d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcefc1578b0 con 0x7fcefc156350 2023-10-09T06:44:01.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.924+0000 7fcf01f9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fcefc0b0c00 0x7fcefc15a630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:40754/0 (socket says 172.21.15.71:40754) 2023-10-09T06:44:01.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.924+0000 7fcf01f9c700 1 -- 172.21.15.71:0/590383973 learned_addr learned my addr 172.21.15.71:0/590383973 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:44:01.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.924+0000 7fcf0179b700 1 --2- 172.21.15.71:0/590383973 >> v2:172.21.15.179:3300/0 conn(0x7fcefc156350 0x7fcefc157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:01.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.925+0000 7fcef3fff700 1 -- 172.21.15.71:0/590383973 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797906298 0 0) 0x7fcefc0b0570 con 0x7fcefc0b0c00 2023-10-09T06:44:01.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.925+0000 7fcef3fff700 1 -- 172.21.15.71:0/590383973 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcee8003570 con 0x7fcefc0b0c00 2023-10-09T06:44:01.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.925+0000 7fcef3fff700 1 -- 172.21.15.71:0/590383973 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3315618820 0 0) 0x7fcefc15ad40 con 0x7fcefc0b0760 2023-10-09T06:44:01.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.925+0000 7fcef3fff700 1 -- 172.21.15.71:0/590383973 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcefc0b0570 con 0x7fcefc0b0760 2023-10-09T06:44:01.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.925+0000 7fcef3fff700 1 -- 172.21.15.71:0/590383973 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3976210426 0 0) 0x7fcee8003570 con 0x7fcefc0b0c00 2023-10-09T06:44:01.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.925+0000 7fcef3fff700 1 -- 172.21.15.71:0/590383973 >> v2:172.21.15.179:3300/0 conn(0x7fcefc156350 msgr2=0x7fcefc157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:44:01.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.925+0000 7fcef3fff700 1 --2- 172.21.15.71:0/590383973 >> v2:172.21.15.179:3300/0 conn(0x7fcefc156350 0x7fcefc157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:01.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.925+0000 7fcef3fff700 1 -- 172.21.15.71:0/590383973 >> v1:172.21.15.179:6789/0 conn(0x7fcefc0b0760 legacy=0x7fcefc159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:01.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.925+0000 7fcef3fff700 1 -- 172.21.15.71:0/590383973 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcefc0af4d0 con 0x7fcefc0b0c00 2023-10-09T06:44:01.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.925+0000 7fcef3fff700 1 -- 172.21.15.71:0/590383973 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fcef40017f0 con 0x7fcefc0b0c00 2023-10-09T06:44:01.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.925+0000 7fcf0179b700 1 --2- 172.21.15.71:0/590383973 >> v2:172.21.15.179:3300/0 conn(0x7fcefc156350 0x7fcefc157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:44:01.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.925+0000 7fcef3fff700 1 -- 172.21.15.71:0/590383973 >> v1:172.21.15.71:6789/0 conn(0x7fcefc0b0c00 legacy=0x7fcefc15a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:01.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.925+0000 7fcef3fff700 1 --2- 172.21.15.71:0/590383973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcee8003c40 0x7fcee8004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:01.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.925+0000 7fcef3fff700 1 --2- 172.21.15.71:0/590383973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcee8004810 0x7fcee8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:01.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.925+0000 7fcef3fff700 1 --2- 172.21.15.71:0/590383973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcee8005210 0x7fcee800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:01.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.925+0000 7fcef3fff700 1 -- 172.21.15.71:0/590383973 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc1578b0 con 0x7fcee8005210 2023-10-09T06:44:01.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.925+0000 7fcef3fff700 1 -- 172.21.15.71:0/590383973 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee800c1b0 con 0x7fcee8003c40 2023-10-09T06:44:01.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.925+0000 7fcef3fff700 1 -- 172.21.15.71:0/590383973 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee800c370 con 0x7fcee8004810 2023-10-09T06:44:01.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.926+0000 7fcf01f9c700 1 --2- 172.21.15.71:0/590383973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcee8005210 0x7fcee800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:01.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.926+0000 7fcf0179b700 1 --2- 172.21.15.71:0/590383973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcee8003c40 0x7fcee8004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:01.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.926+0000 7fcf00f9a700 1 --2- 172.21.15.71:0/590383973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcee8004810 0x7fcee8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:01.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.926+0000 7fcf01f9c700 1 -- 172.21.15.71:0/590383973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcee8004810 msgr2=0x7fcee8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:44:01.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.926+0000 7fcf01f9c700 1 --2- 172.21.15.71:0/590383973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcee8004810 0x7fcee8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:01.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.926+0000 7fcf01f9c700 1 -- 172.21.15.71:0/590383973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcee8003c40 msgr2=0x7fcee8004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:44:01.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.926+0000 7fcf01f9c700 1 --2- 172.21.15.71:0/590383973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcee8003c40 0x7fcee8004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:01.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.926+0000 7fcf01f9c700 1 -- 172.21.15.71:0/590383973 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee8003570 con 0x7fcee8005210 2023-10-09T06:44:01.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.926+0000 7fcf01f9c700 1 -- 172.21.15.71:0/590383973 reap_dead start 2023-10-09T06:44:01.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.926+0000 7fcf01f9c700 1 --2- 172.21.15.71:0/590383973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcee8005210 0x7fcee800ba60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcef400a7d0 tx=0x7fcef40020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0972a80a6757118 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:01.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.926+0000 7fcef3fff700 1 -- 172.21.15.71:0/590383973 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef40070d0 con 0x7fcee8005210 2023-10-09T06:44:01.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.926+0000 7fcef3fff700 1 -- 172.21.15.71:0/590383973 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef4007230 con 0x7fcee8005210 2023-10-09T06:44:01.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.926+0000 7fcef3fff700 1 -- 172.21.15.71:0/590383973 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef40075f0 con 0x7fcee8005210 2023-10-09T06:44:01.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.927+0000 7fcf0279d700 1 -- 172.21.15.71:0/590383973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcee8005210 msgr2=0x7fcee800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:01.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.927+0000 7fcf0279d700 1 --2- 172.21.15.71:0/590383973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcee8005210 0x7fcee800ba60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcef400a7d0 tx=0x7fcef40020c0 comp rx=0 tx=0).stop 2023-10-09T06:44:01.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.927+0000 7fcf0279d700 1 -- 172.21.15.71:0/590383973 shutdown_connections 2023-10-09T06:44:01.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.927+0000 7fcf0279d700 1 --2- 172.21.15.71:0/590383973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcee8005210 0x7fcee800ba60 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:01.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.927+0000 7fcf0279d700 1 -- 172.21.15.71:0/590383973 >> 172.21.15.71:0/590383973 conn(0x7fcefc068e20 msgr2=0x7fcefc0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:44:01.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.927+0000 7fcf0279d700 1 -- 172.21.15.71:0/590383973 shutdown_connections 2023-10-09T06:44:01.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.927+0000 7fcf0279d700 1 -- 172.21.15.71:0/590383973 wait complete. 2023-10-09T06:44:01.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.928+0000 7fcf0279d700 1 Processor -- start 2023-10-09T06:44:01.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.929+0000 7fcf0279d700 1 -- start start 2023-10-09T06:44:01.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.929+0000 7fcf0279d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcee8005210 0x7fcefc15ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:01.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.929+0000 7fcf0279d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcefc0cb300 0x7fcefc14f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:01.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.929+0000 7fcf0279d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcefc154b20 0x7fcefc154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:01.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.929+0000 7fcf0279d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc0cba00 con 0x7fcee8005210 2023-10-09T06:44:01.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.929+0000 7fcf0279d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc169a60 con 0x7fcefc154b20 2023-10-09T06:44:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.929+0000 7fcf0279d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc1554e0 con 0x7fcefc0cb300 2023-10-09T06:44:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.930+0000 7fcf0179b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcee8005210 0x7fcefc15ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.930+0000 7fcf0179b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcee8005210 0x7fcefc15ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49586/0 (socket says 172.21.15.71:49586) 2023-10-09T06:44:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.930+0000 7fcf0179b700 1 -- 172.21.15.71:0/1200388141 learned_addr learned my addr 172.21.15.71:0/1200388141 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:44:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.930+0000 7fcf00f9a700 1 --2- 172.21.15.71:0/1200388141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcefc0cb300 0x7fcefc14f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.930+0000 7fcf01f9c700 1 --2- 172.21.15.71:0/1200388141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcefc154b20 0x7fcefc154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.930+0000 7fcf0179b700 1 -- 172.21.15.71:0/1200388141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcefc0cb300 msgr2=0x7fcefc14f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.930+0000 7fcf0179b700 1 --2- 172.21.15.71:0/1200388141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcefc0cb300 0x7fcefc14f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.930+0000 7fcf0179b700 1 -- 172.21.15.71:0/1200388141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcefc154b20 msgr2=0x7fcefc154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.930+0000 7fcf0179b700 1 --2- 172.21.15.71:0/1200388141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcefc154b20 0x7fcefc154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.930+0000 7fcf0179b700 1 -- 172.21.15.71:0/1200388141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcefc16aa30 con 0x7fcee8005210 2023-10-09T06:44:01.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.930+0000 7fcf0179b700 1 --2- 172.21.15.71:0/1200388141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcee8005210 0x7fcefc15ea80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fcef8011d70 tx=0x7fcef80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:01.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.930+0000 7fcef17fa700 1 -- 172.21.15.71:0/1200388141 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef800fcd0 con 0x7fcee8005210 2023-10-09T06:44:01.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.930+0000 7fcef17fa700 1 -- 172.21.15.71:0/1200388141 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef800fe30 con 0x7fcee8005210 2023-10-09T06:44:01.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.930+0000 7fcef17fa700 1 -- 172.21.15.71:0/1200388141 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef801d6d0 con 0x7fcee8005210 2023-10-09T06:44:01.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.930+0000 7fcf0279d700 1 -- 172.21.15.71:0/1200388141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcefc0cb770 con 0x7fcee8005210 2023-10-09T06:44:01.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.931+0000 7fcf0279d700 1 -- 172.21.15.71:0/1200388141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcefc14fe90 con 0x7fcee8005210 2023-10-09T06:44:01.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.932+0000 7fcf0279d700 1 -- 172.21.15.71:0/1200388141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcefc0cbf90 con 0x7fcee8005210 2023-10-09T06:44:01.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.932+0000 7fcef17fa700 1 -- 172.21.15.71:0/1200388141 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 10) v1 ==== 84973+0+0 (secure 0 0 0) 0x7fcef801dac0 con 0x7fcee8005210 2023-10-09T06:44:01.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.933+0000 7fcef17fa700 1 --2- 172.21.15.71:0/1200388141 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcee00671c0 0x7fcee0069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:01.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.933+0000 7fcef17fa700 1 -- 172.21.15.71:0/1200388141 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fcef8018070 con 0x7fcee8005210 2023-10-09T06:44:01.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.934+0000 7fcf00f9a700 1 --2- 172.21.15.71:0/1200388141 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcee00671c0 0x7fcee0069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:01.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.934+0000 7fcf00f9a700 1 --2- 172.21.15.71:0/1200388141 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcee00671c0 0x7fcee0069670 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fceec007e40 tx=0x7fceec009040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:01.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:01.938+0000 7fcef17fa700 1 -- 172.21.15.71:0/1200388141 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcef8052850 con 0x7fcee8005210 2023-10-09T06:44:02.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.154+0000 7fcf0279d700 1 -- 172.21.15.71:0/1200388141 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fcefc04c3c0 con 0x7fcee00671c0 2023-10-09T06:44:02.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.205+0000 7fcef17fa700 1 -- 172.21.15.71:0/1200388141 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fcefc04c3c0 con 0x7fcee00671c0 2023-10-09T06:44:02.206 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule activated for path /snap_test_dir1/dir5 2023-10-09T06:44:02.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.208+0000 7fcf0279d700 1 -- 172.21.15.71:0/1200388141 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcee00671c0 msgr2=0x7fcee0069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:02.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.208+0000 7fcf0279d700 1 --2- 172.21.15.71:0/1200388141 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcee00671c0 0x7fcee0069670 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fceec007e40 tx=0x7fceec009040 comp rx=0 tx=0).stop 2023-10-09T06:44:02.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.208+0000 7fcf0279d700 1 -- 172.21.15.71:0/1200388141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcee8005210 msgr2=0x7fcefc15ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:02.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.208+0000 7fcf0279d700 1 --2- 172.21.15.71:0/1200388141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcee8005210 0x7fcefc15ea80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fcef8011d70 tx=0x7fcef80091a0 comp rx=0 tx=0).stop 2023-10-09T06:44:02.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.208+0000 7fcf0279d700 1 -- 172.21.15.71:0/1200388141 shutdown_connections 2023-10-09T06:44:02.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.208+0000 7fcf0279d700 1 --2- 172.21.15.71:0/1200388141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcefc154b20 0x7fcefc154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:02.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.208+0000 7fcf0279d700 1 --2- 172.21.15.71:0/1200388141 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcee00671c0 0x7fcee0069670 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:02.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.208+0000 7fcf0279d700 1 --2- 172.21.15.71:0/1200388141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcee8005210 0x7fcefc15ea80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:02.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.208+0000 7fcf0279d700 1 --2- 172.21.15.71:0/1200388141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcefc0cb300 0x7fcefc14f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:02.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.208+0000 7fcf0279d700 1 -- 172.21.15.71:0/1200388141 >> 172.21.15.71:0/1200388141 conn(0x7fcefc068e20 msgr2=0x7fcefc151a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:44:02.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.208+0000 7fcf0279d700 1 -- 172.21.15.71:0/1200388141 shutdown_connections 2023-10-09T06:44:02.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.208+0000 7fcf0279d700 1 -- 172.21.15.71:0/1200388141 wait complete. 2023-10-09T06:44:02.226 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir5 2023-10-09T06:44:02.226 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir6 1M 2023-10-09T06:44:02.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.411+0000 7f6b96dff700 1 Processor -- start 2023-10-09T06:44:02.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.412+0000 7f6b96dff700 1 -- start start 2023-10-09T06:44:02.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.413+0000 7f6b96dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6b90069a50 0x7f6b900c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:02.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.413+0000 7f6b96dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b90069e20 0x7f6b901569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:02.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.413+0000 7f6b96dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b900ac030 con 0x7f6b900c8490 2023-10-09T06:44:02.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.413+0000 7f6b96dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b900ab820 con 0x7f6b90069a50 2023-10-09T06:44:02.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.413+0000 7f6b96dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9006dbb0 con 0x7f6b90069e20 2023-10-09T06:44:02.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.413+0000 7f6b8ffff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6b900c8490 0x7f6b9015a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:40758/0 (socket says 172.21.15.71:40758) 2023-10-09T06:44:02.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.413+0000 7f6b94b9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6b90069a50 0x7f6b900c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:02.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.413+0000 7f6b8ffff700 1 -- 172.21.15.71:0/1662761764 learned_addr learned my addr 172.21.15.71:0/1662761764 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:44:02.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.413+0000 7f6b9539c700 1 --2- 172.21.15.71:0/1662761764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b90069e20 0x7f6b901569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:02.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.413+0000 7f6b94b9b700 1 -- 172.21.15.71:0/1662761764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b90069e20 msgr2=0x7f6b901569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:44:02.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.413+0000 7f6b94b9b700 1 --2- 172.21.15.71:0/1662761764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b90069e20 0x7f6b901569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:02.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.413+0000 7f6b94b9b700 1 -- 172.21.15.71:0/1662761764 >> v1:172.21.15.71:6789/0 conn(0x7f6b900c8490 legacy=0x7f6b9015a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:02.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.413+0000 7f6b94b9b700 1 -- 172.21.15.71:0/1662761764 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b900aba70 con 0x7f6b90069a50 2023-10-09T06:44:02.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.413+0000 7f6b8f7fe700 1 -- 172.21.15.71:0/1662761764 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185508404 0 0) 0x7f6b7c001110 con 0x7f6b900c8490 2023-10-09T06:44:02.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.414+0000 7f6b9539c700 1 --2- 172.21.15.71:0/1662761764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b90069e20 0x7f6b901569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:44:02.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.414+0000 7f6b94b9b700 1 --2- 172.21.15.71:0/1662761764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b90069a50 0x7f6b900c6ac0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6b8400aa90 tx=0x7f6b8400a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7c34ddf6f6a80e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:02.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.414+0000 7f6b8f7fe700 1 -- 172.21.15.71:0/1662761764 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8400ca40 con 0x7f6b90069a50 2023-10-09T06:44:02.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.414+0000 7f6b8f7fe700 1 -- 172.21.15.71:0/1662761764 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8400cba0 con 0x7f6b90069a50 2023-10-09T06:44:02.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.414+0000 7f6b8f7fe700 1 -- 172.21.15.71:0/1662761764 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b84018400 con 0x7f6b90069a50 2023-10-09T06:44:02.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.414+0000 7f6b96dff700 1 -- 172.21.15.71:0/1662761764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b90069a50 msgr2=0x7f6b900c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:02.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.414+0000 7f6b96dff700 1 --2- 172.21.15.71:0/1662761764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b90069a50 0x7f6b900c6ac0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6b8400aa90 tx=0x7f6b8400a330 comp rx=0 tx=0).stop 2023-10-09T06:44:02.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.415+0000 7f6b96dff700 1 -- 172.21.15.71:0/1662761764 shutdown_connections 2023-10-09T06:44:02.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.415+0000 7f6b96dff700 1 --2- 172.21.15.71:0/1662761764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b90069e20 0x7f6b901569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:02.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.415+0000 7f6b96dff700 1 --2- 172.21.15.71:0/1662761764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b90069a50 0x7f6b900c6ac0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:02.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.415+0000 7f6b96dff700 1 -- 172.21.15.71:0/1662761764 >> 172.21.15.71:0/1662761764 conn(0x7f6b900c8f90 msgr2=0x7f6b900c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:44:02.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.415+0000 7f6b96dff700 1 -- 172.21.15.71:0/1662761764 shutdown_connections 2023-10-09T06:44:02.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.415+0000 7f6b96dff700 1 -- 172.21.15.71:0/1662761764 wait complete. 2023-10-09T06:44:02.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.416+0000 7f6b96dff700 1 Processor -- start 2023-10-09T06:44:02.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.416+0000 7f6b96dff700 1 -- start start 2023-10-09T06:44:02.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.417+0000 7f6b96dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b90069a50 0x7f6b900af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:02.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.417+0000 7f6b96dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b90069e20 0x7f6b900b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:02.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.417+0000 7f6b96dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b900c8490 0x7f6b90169e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:02.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.417+0000 7f6b96dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b900b1bc0 con 0x7f6b90069a50 2023-10-09T06:44:02.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.417+0000 7f6b96dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b900b1ea0 con 0x7f6b900c8490 2023-10-09T06:44:02.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.417+0000 7f6b96dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b900b2180 con 0x7f6b90069e20 2023-10-09T06:44:02.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.417+0000 7f6b94b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b90069a50 0x7f6b900af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:02.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.417+0000 7f6b94b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b90069a50 0x7f6b900af520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49608/0 (socket says 172.21.15.71:49608) 2023-10-09T06:44:02.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.417+0000 7f6b94b9b700 1 -- 172.21.15.71:0/2333717658 learned_addr learned my addr 172.21.15.71:0/2333717658 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:44:02.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.418+0000 7f6b94b9b700 1 -- 172.21.15.71:0/2333717658 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b90069e20 msgr2=0x7f6b900b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:02.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.418+0000 7f6b94b9b700 1 --2- 172.21.15.71:0/2333717658 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b90069e20 0x7f6b900b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:02.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.418+0000 7f6b94b9b700 1 -- 172.21.15.71:0/2333717658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b900c8490 msgr2=0x7f6b90169e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:02.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.418+0000 7f6b94b9b700 1 --2- 172.21.15.71:0/2333717658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b900c8490 0x7f6b90169e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:02.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.418+0000 7f6b94b9b700 1 -- 172.21.15.71:0/2333717658 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8400a5d0 con 0x7f6b90069a50 2023-10-09T06:44:02.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.418+0000 7f6b94b9b700 1 --2- 172.21.15.71:0/2333717658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b90069a50 0x7f6b900af520 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6b900cc0b0 tx=0x7f6b8401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:02.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.418+0000 7f6b8cff9700 1 -- 172.21.15.71:0/2333717658 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8401c040 con 0x7f6b90069a50 2023-10-09T06:44:02.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.418+0000 7f6b8cff9700 1 -- 172.21.15.71:0/2333717658 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b840106d0 con 0x7f6b90069a50 2023-10-09T06:44:02.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.418+0000 7f6b96dff700 1 -- 172.21.15.71:0/2333717658 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b901576b0 con 0x7f6b90069a50 2023-10-09T06:44:02.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.418+0000 7f6b8cff9700 1 -- 172.21.15.71:0/2333717658 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b84010ab0 con 0x7f6b90069a50 2023-10-09T06:44:02.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.418+0000 7f6b96dff700 1 -- 172.21.15.71:0/2333717658 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b900afa60 con 0x7f6b90069a50 2023-10-09T06:44:02.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.419+0000 7f6b96dff700 1 -- 172.21.15.71:0/2333717658 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b90157bd0 con 0x7f6b90069a50 2023-10-09T06:44:02.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.420+0000 7f6b8cff9700 1 -- 172.21.15.71:0/2333717658 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 10) v1 ==== 84973+0+0 (secure 0 0 0) 0x7f6b8402a3b0 con 0x7f6b90069a50 2023-10-09T06:44:02.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.421+0000 7f6b8cff9700 1 --2- 172.21.15.71:0/2333717658 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6b740671c0 0x7f6b74069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:02.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.421+0000 7f6b8cff9700 1 -- 172.21.15.71:0/2333717658 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f6b840864c0 con 0x7f6b90069a50 2023-10-09T06:44:02.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.421+0000 7f6b8ffff700 1 --2- 172.21.15.71:0/2333717658 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6b740671c0 0x7f6b74069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:02.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.422+0000 7f6b8ffff700 1 --2- 172.21.15.71:0/2333717658 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6b740671c0 0x7f6b74069670 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6b90159790 tx=0x7f6b7c001260 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:02.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.425+0000 7f6b8cff9700 1 -- 172.21.15.71:0/2333717658 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b840531f0 con 0x7f6b90069a50 2023-10-09T06:44:02.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.642+0000 7f6b96dff700 1 -- 172.21.15.71:0/2333717658 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b900718b0 con 0x7f6b740671c0 2023-10-09T06:44:02.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.695+0000 7f6b8cff9700 1 -- 172.21.15.71:0/2333717658 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f6b900718b0 con 0x7f6b740671c0 2023-10-09T06:44:02.696 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule activated for path /snap_test_dir1/dir6 2023-10-09T06:44:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.697+0000 7f6b96dff700 1 -- 172.21.15.71:0/2333717658 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6b740671c0 msgr2=0x7f6b74069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.698+0000 7f6b96dff700 1 --2- 172.21.15.71:0/2333717658 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6b740671c0 0x7f6b74069670 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6b90159790 tx=0x7f6b7c001260 comp rx=0 tx=0).stop 2023-10-09T06:44:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.698+0000 7f6b96dff700 1 -- 172.21.15.71:0/2333717658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b90069a50 msgr2=0x7f6b900af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.698+0000 7f6b96dff700 1 --2- 172.21.15.71:0/2333717658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b90069a50 0x7f6b900af520 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6b900cc0b0 tx=0x7f6b8401a000 comp rx=0 tx=0).stop 2023-10-09T06:44:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.698+0000 7f6b96dff700 1 -- 172.21.15.71:0/2333717658 shutdown_connections 2023-10-09T06:44:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.698+0000 7f6b96dff700 1 --2- 172.21.15.71:0/2333717658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b900c8490 0x7f6b90169e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.698+0000 7f6b96dff700 1 --2- 172.21.15.71:0/2333717658 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6b740671c0 0x7f6b74069670 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.698+0000 7f6b96dff700 1 --2- 172.21.15.71:0/2333717658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b90069a50 0x7f6b900af520 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.698+0000 7f6b96dff700 1 --2- 172.21.15.71:0/2333717658 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b90069e20 0x7f6b900b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.698+0000 7f6b96dff700 1 -- 172.21.15.71:0/2333717658 >> 172.21.15.71:0/2333717658 conn(0x7f6b900c8f90 msgr2=0x7f6b900aa700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:44:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.698+0000 7f6b96dff700 1 -- 172.21.15.71:0/2333717658 shutdown_connections 2023-10-09T06:44:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.698+0000 7f6b96dff700 1 -- 172.21.15.71:0/2333717658 wait complete. 2023-10-09T06:44:02.716 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir6 2023-10-09T06:44:02.716 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir7 1M 2023-10-09T06:44:02.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.903+0000 7faed259d700 1 Processor -- start 2023-10-09T06:44:02.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.903+0000 7faed259d700 1 -- start start 2023-10-09T06:44:02.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.904+0000 7faed259d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faecc0b0760 0x7faecc0b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:02.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.904+0000 7faed259d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faecc0b0570 con 0x7faecc156350 2023-10-09T06:44:02.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.904+0000 7faed259d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faecc0af4d0 con 0x7faecc0ace60 2023-10-09T06:44:02.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.904+0000 7faed259d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faecc0b1140 con 0x7faecc0b0760 2023-10-09T06:44:02.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.904+0000 7faed159b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7faecc156350 0x7faecc157370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:40772/0 (socket says 172.21.15.71:40772) 2023-10-09T06:44:02.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.904+0000 7faed159b700 1 -- 172.21.15.71:0/1616589424 learned_addr learned my addr 172.21.15.71:0/1616589424 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:44:02.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.904+0000 7faed0d9a700 1 --2- 172.21.15.71:0/1616589424 >> v2:172.21.15.71:3300/0 conn(0x7faecc0b0760 0x7faecc0b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:02.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.905+0000 7faec3fff700 1 -- 172.21.15.71:0/1616589424 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601349437 0 0) 0x7faecc0b0570 con 0x7faecc156350 2023-10-09T06:44:02.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.905+0000 7faec3fff700 1 -- 172.21.15.71:0/1616589424 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeb8003570 con 0x7faecc156350 2023-10-09T06:44:02.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.905+0000 7faed0d9a700 1 -- 172.21.15.71:0/1616589424 >> v1:172.21.15.179:6789/0 conn(0x7faecc0ace60 legacy=0x7faecc0ad260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.905+0000 7faed0d9a700 1 -- 172.21.15.71:0/1616589424 >> v1:172.21.15.71:6789/0 conn(0x7faecc156350 legacy=0x7faecc157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.905+0000 7faed0d9a700 1 -- 172.21.15.71:0/1616589424 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc0af7b0 con 0x7faecc0b0760 2023-10-09T06:44:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.905+0000 7faed0d9a700 1 --2- 172.21.15.71:0/1616589424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faecc0b0760 0x7faecc0b0c00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7faebc0098e0 tx=0x7faebc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac65296b197277f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.905+0000 7faec3fff700 1 -- 172.21.15.71:0/1616589424 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc00f6b0 con 0x7faecc0b0760 2023-10-09T06:44:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.905+0000 7faec3fff700 1 -- 172.21.15.71:0/1616589424 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc00f810 con 0x7faecc0b0760 2023-10-09T06:44:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.905+0000 7faec3fff700 1 -- 172.21.15.71:0/1616589424 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc00fbb0 con 0x7faecc0b0760 2023-10-09T06:44:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.906+0000 7faed259d700 1 -- 172.21.15.71:0/1616589424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faecc0b0760 msgr2=0x7faecc0b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.906+0000 7faed259d700 1 --2- 172.21.15.71:0/1616589424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faecc0b0760 0x7faecc0b0c00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7faebc0098e0 tx=0x7faebc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:44:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.906+0000 7faed259d700 1 -- 172.21.15.71:0/1616589424 shutdown_connections 2023-10-09T06:44:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.906+0000 7faed259d700 1 --2- 172.21.15.71:0/1616589424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faecc0b0760 0x7faecc0b0c00 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:02.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.906+0000 7faed259d700 1 -- 172.21.15.71:0/1616589424 >> 172.21.15.71:0/1616589424 conn(0x7faecc068e20 msgr2=0x7faecc0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:44:02.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.906+0000 7faed259d700 1 -- 172.21.15.71:0/1616589424 shutdown_connections 2023-10-09T06:44:02.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.906+0000 7faed259d700 1 -- 172.21.15.71:0/1616589424 wait complete. 2023-10-09T06:44:02.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.907+0000 7faed259d700 1 Processor -- start 2023-10-09T06:44:02.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.908+0000 7faed259d700 1 -- start start 2023-10-09T06:44:02.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.908+0000 7faed259d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faecc0ace60 0x7faecc147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.908+0000 7faed259d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faecc0b0760 0x7faecc0aa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.909+0000 7faed259d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faecc156350 0x7faecc1549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.909+0000 7faed259d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc148710 con 0x7faecc0b0760 2023-10-09T06:44:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.909+0000 7faed259d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc0aad60 con 0x7faecc0ace60 2023-10-09T06:44:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.909+0000 7faed259d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc0ab040 con 0x7faecc156350 2023-10-09T06:44:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.909+0000 7faed0d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faecc0b0760 0x7faecc0aa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.909+0000 7faed0d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faecc0b0760 0x7faecc0aa2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49636/0 (socket says 172.21.15.71:49636) 2023-10-09T06:44:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.909+0000 7faed0d9a700 1 -- 172.21.15.71:0/553205687 learned_addr learned my addr 172.21.15.71:0/553205687 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:44:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.909+0000 7faed0d9a700 1 -- 172.21.15.71:0/553205687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faecc156350 msgr2=0x7faecc1549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.909+0000 7faed0d9a700 1 --2- 172.21.15.71:0/553205687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faecc156350 0x7faecc1549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.909+0000 7faed0d9a700 1 -- 172.21.15.71:0/553205687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faecc0ace60 msgr2=0x7faecc147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:02.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.909+0000 7faed159b700 1 --2- 172.21.15.71:0/553205687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faecc0ace60 0x7faecc147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:02.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.909+0000 7faed0d9a700 1 --2- 172.21.15.71:0/553205687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faecc0ace60 0x7faecc147c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:02.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.909+0000 7faed0d9a700 1 -- 172.21.15.71:0/553205687 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faebc009420 con 0x7faecc0b0760 2023-10-09T06:44:02.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.909+0000 7faed159b700 1 --2- 172.21.15.71:0/553205687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faecc0ace60 0x7faecc147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:44:02.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.909+0000 7faed0d9a700 1 --2- 172.21.15.71:0/553205687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faecc0b0760 0x7faecc0aa2e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7faebc0093f0 tx=0x7faebc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:02.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.910+0000 7faec17fa700 1 -- 172.21.15.71:0/553205687 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc00fb90 con 0x7faecc0b0760 2023-10-09T06:44:02.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.910+0000 7faec17fa700 1 -- 172.21.15.71:0/553205687 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc000c90 con 0x7faecc0b0760 2023-10-09T06:44:02.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.910+0000 7faed259d700 1 -- 172.21.15.71:0/553205687 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faecc0ab320 con 0x7faecc0b0760 2023-10-09T06:44:02.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.910+0000 7faec17fa700 1 -- 172.21.15.71:0/553205687 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc0106a0 con 0x7faecc0b0760 2023-10-09T06:44:02.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.910+0000 7faed259d700 1 -- 172.21.15.71:0/553205687 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faecc0ab600 con 0x7faecc0b0760 2023-10-09T06:44:02.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.911+0000 7faed259d700 1 -- 172.21.15.71:0/553205687 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faecc148880 con 0x7faecc0b0760 2023-10-09T06:44:02.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.912+0000 7faec17fa700 1 -- 172.21.15.71:0/553205687 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 10) v1 ==== 84973+0+0 (secure 0 0 0) 0x7faebc0223f0 con 0x7faecc0b0760 2023-10-09T06:44:02.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.912+0000 7faec17fa700 1 --2- 172.21.15.71:0/553205687 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faeb00671c0 0x7faeb0069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:02.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.912+0000 7faec17fa700 1 -- 172.21.15.71:0/553205687 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7faebc014070 con 0x7faecc0b0760 2023-10-09T06:44:02.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.913+0000 7faed159b700 1 --2- 172.21.15.71:0/553205687 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faeb00671c0 0x7faeb0069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:02.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.914+0000 7faed159b700 1 --2- 172.21.15.71:0/553205687 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faeb00671c0 0x7faeb0069670 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7faec8007fd0 tx=0x7faec8009040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:02.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:02.917+0000 7faec17fa700 1 -- 172.21.15.71:0/553205687 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faecc148880 con 0x7faecc0b0760 2023-10-09T06:44:03.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.134+0000 7faed259d700 1 -- 172.21.15.71:0/553205687 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7faecc0b20c0 con 0x7faeb00671c0 2023-10-09T06:44:03.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.184+0000 7faec17fa700 1 -- 172.21.15.71:0/553205687 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7faecc0b20c0 con 0x7faeb00671c0 2023-10-09T06:44:03.186 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule activated for path /snap_test_dir1/dir7 2023-10-09T06:44:03.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.187+0000 7faed259d700 1 -- 172.21.15.71:0/553205687 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faeb00671c0 msgr2=0x7faeb0069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:03.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.187+0000 7faed259d700 1 --2- 172.21.15.71:0/553205687 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faeb00671c0 0x7faeb0069670 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7faec8007fd0 tx=0x7faec8009040 comp rx=0 tx=0).stop 2023-10-09T06:44:03.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.187+0000 7faed259d700 1 -- 172.21.15.71:0/553205687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faecc0b0760 msgr2=0x7faecc0aa2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:03.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.187+0000 7faed259d700 1 --2- 172.21.15.71:0/553205687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faecc0b0760 0x7faecc0aa2e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7faebc0093f0 tx=0x7faebc019000 comp rx=0 tx=0).stop 2023-10-09T06:44:03.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.187+0000 7faed259d700 1 -- 172.21.15.71:0/553205687 shutdown_connections 2023-10-09T06:44:03.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.187+0000 7faed259d700 1 --2- 172.21.15.71:0/553205687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faecc156350 0x7faecc1549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:03.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.187+0000 7faed259d700 1 --2- 172.21.15.71:0/553205687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faecc0ace60 0x7faecc147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:03.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.187+0000 7faed259d700 1 --2- 172.21.15.71:0/553205687 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faeb00671c0 0x7faeb0069670 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:03.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.187+0000 7faed259d700 1 --2- 172.21.15.71:0/553205687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faecc0b0760 0x7faecc0aa2e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:03.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.187+0000 7faed259d700 1 -- 172.21.15.71:0/553205687 >> 172.21.15.71:0/553205687 conn(0x7faecc068e20 msgr2=0x7faecc0ad230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:44:03.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.187+0000 7faed259d700 1 -- 172.21.15.71:0/553205687 shutdown_connections 2023-10-09T06:44:03.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.187+0000 7faed259d700 1 -- 172.21.15.71:0/553205687 wait complete. 2023-10-09T06:44:03.205 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir7 2023-10-09T06:44:03.205 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir8 1M 2023-10-09T06:44:03.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.390+0000 7fbfc05ff700 1 Processor -- start 2023-10-09T06:44:03.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.390+0000 7fbfc05ff700 1 -- start start 2023-10-09T06:44:03.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.391+0000 7fbfc05ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbfb80b2100 0x7fbfb8068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:03.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.391+0000 7fbfc05ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfb80688d0 0x7fbfb806e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:03.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.391+0000 7fbfc05ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb80ae6d0 con 0x7fbfb8157740 2023-10-09T06:44:03.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.391+0000 7fbfc05ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfb80acc00 con 0x7fbfb80b2100 2023-10-09T06:44:03.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.391+0000 7fbfc05ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb806d6a0 con 0x7fbfb80688d0 2023-10-09T06:44:03.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.391+0000 7fbfbdb9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbfb80b2100 0x7fbfb8068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:03.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.392+0000 7fbfbdb9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbfb80b2100 0x7fbfb8068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49652/0 (socket says 172.21.15.71:49652) 2023-10-09T06:44:03.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.392+0000 7fbfbdb9a700 1 -- 172.21.15.71:0/867909949 learned_addr learned my addr 172.21.15.71:0/867909949 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:44:03.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.392+0000 7fbfbeb9c700 1 --2- 172.21.15.71:0/867909949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfb80688d0 0x7fbfb806e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:03.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.392+0000 7fbfbdb9a700 1 -- 172.21.15.71:0/867909949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfb80688d0 msgr2=0x7fbfb806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:44:03.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.392+0000 7fbfbdb9a700 1 --2- 172.21.15.71:0/867909949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfb80688d0 0x7fbfb806e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:03.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.392+0000 7fbfbdb9a700 1 -- 172.21.15.71:0/867909949 >> v1:172.21.15.179:6789/0 conn(0x7fbfb8157740 legacy=0x7fbfb80adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:03.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.392+0000 7fbfbdb9a700 1 -- 172.21.15.71:0/867909949 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb806dc20 con 0x7fbfb80b2100 2023-10-09T06:44:03.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.392+0000 7fbfbeb9c700 1 --2- 172.21.15.71:0/867909949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfb80688d0 0x7fbfb806e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:44:03.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.392+0000 7fbfbdb9a700 1 --2- 172.21.15.71:0/867909949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfb80b2100 0x7fbfb8068390 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbfa80099b0 tx=0x7fbfa8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4adfe856389e7e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:03.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.392+0000 7fbfbd399700 1 -- 172.21.15.71:0/867909949 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa800b860 con 0x7fbfb80b2100 2023-10-09T06:44:03.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.392+0000 7fbfbd399700 1 -- 172.21.15.71:0/867909949 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa800b9c0 con 0x7fbfb80b2100 2023-10-09T06:44:03.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.393+0000 7fbfbd399700 1 -- 172.21.15.71:0/867909949 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa800bd60 con 0x7fbfb80b2100 2023-10-09T06:44:03.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.393+0000 7fbfc05ff700 1 -- 172.21.15.71:0/867909949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfb80b2100 msgr2=0x7fbfb8068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:03.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.393+0000 7fbfc05ff700 1 --2- 172.21.15.71:0/867909949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfb80b2100 0x7fbfb8068390 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbfa80099b0 tx=0x7fbfa8009250 comp rx=0 tx=0).stop 2023-10-09T06:44:03.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.393+0000 7fbfc05ff700 1 -- 172.21.15.71:0/867909949 shutdown_connections 2023-10-09T06:44:03.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.393+0000 7fbfc05ff700 1 --2- 172.21.15.71:0/867909949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfb80688d0 0x7fbfb806e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:03.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.393+0000 7fbfc05ff700 1 --2- 172.21.15.71:0/867909949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfb80b2100 0x7fbfb8068390 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:03.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.393+0000 7fbfc05ff700 1 -- 172.21.15.71:0/867909949 >> 172.21.15.71:0/867909949 conn(0x7fbfb80c8f90 msgr2=0x7fbfb80c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:44:03.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.393+0000 7fbfc05ff700 1 -- 172.21.15.71:0/867909949 shutdown_connections 2023-10-09T06:44:03.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.393+0000 7fbfc05ff700 1 -- 172.21.15.71:0/867909949 wait complete. 2023-10-09T06:44:03.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.394+0000 7fbfc05ff700 1 Processor -- start 2023-10-09T06:44:03.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.395+0000 7fbfc05ff700 1 -- start start 2023-10-09T06:44:03.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.395+0000 7fbfc05ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfb80688d0 0x7fbfb8158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:03.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.395+0000 7fbfc05ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfb80b2100 0x7fbfb8158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:03.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.395+0000 7fbfc05ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfb8157740 0x7fbfb80c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:03.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.395+0000 7fbfc05ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb8158fa0 con 0x7fbfb80b2100 2023-10-09T06:44:03.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.395+0000 7fbfc05ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb80c5ef0 con 0x7fbfb80688d0 2023-10-09T06:44:03.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.395+0000 7fbfc05ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb80c52e0 con 0x7fbfb8157740 2023-10-09T06:44:03.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.396+0000 7fbfbdb9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfb80b2100 0x7fbfb8158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:03.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.396+0000 7fbfbdb9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfb80b2100 0x7fbfb8158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49668/0 (socket says 172.21.15.71:49668) 2023-10-09T06:44:03.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.396+0000 7fbfbdb9a700 1 -- 172.21.15.71:0/2446433159 learned_addr learned my addr 172.21.15.71:0/2446433159 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:44:03.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.396+0000 7fbfbdb9a700 1 -- 172.21.15.71:0/2446433159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfb8157740 msgr2=0x7fbfb80c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:03.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.396+0000 7fbfbdb9a700 1 --2- 172.21.15.71:0/2446433159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfb8157740 0x7fbfb80c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:03.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.396+0000 7fbfbdb9a700 1 -- 172.21.15.71:0/2446433159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfb80688d0 msgr2=0x7fbfb8158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:03.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.396+0000 7fbfbdb9a700 1 --2- 172.21.15.71:0/2446433159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfb80688d0 0x7fbfb8158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:03.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.396+0000 7fbfbdb9a700 1 -- 172.21.15.71:0/2446433159 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa80094f0 con 0x7fbfb80b2100 2023-10-09T06:44:03.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.396+0000 7fbfbdb9a700 1 --2- 172.21.15.71:0/2446433159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfb80b2100 0x7fbfb8158a60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009290 tx=0x7fbfa8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:03.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.397+0000 7fbfae7fc700 1 -- 172.21.15.71:0/2446433159 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8026480 con 0x7fbfb80b2100 2023-10-09T06:44:03.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.397+0000 7fbfae7fc700 1 -- 172.21.15.71:0/2446433159 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa801f070 con 0x7fbfb80b2100 2023-10-09T06:44:03.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.397+0000 7fbfae7fc700 1 -- 172.21.15.71:0/2446433159 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8026830 con 0x7fbfb80b2100 2023-10-09T06:44:03.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.397+0000 7fbfc05ff700 1 -- 172.21.15.71:0/2446433159 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb80c55c0 con 0x7fbfb80b2100 2023-10-09T06:44:03.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.397+0000 7fbfc05ff700 1 -- 172.21.15.71:0/2446433159 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb80c5b80 con 0x7fbfb80b2100 2023-10-09T06:44:03.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.398+0000 7fbfc05ff700 1 -- 172.21.15.71:0/2446433159 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb806f240 con 0x7fbfb80b2100 2023-10-09T06:44:03.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.399+0000 7fbfae7fc700 1 -- 172.21.15.71:0/2446433159 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 10) v1 ==== 84973+0+0 (secure 0 0 0) 0x7fbfa8026ba0 con 0x7fbfb80b2100 2023-10-09T06:44:03.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.399+0000 7fbfae7fc700 1 --2- 172.21.15.71:0/2446433159 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbf9c0671c0 0x7fbf9c069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:03.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.399+0000 7fbfae7fc700 1 -- 172.21.15.71:0/2446433159 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fbfa8021070 con 0x7fbfb80b2100 2023-10-09T06:44:03.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.400+0000 7fbfbe39b700 1 --2- 172.21.15.71:0/2446433159 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbf9c0671c0 0x7fbf9c069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:03.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.401+0000 7fbfbe39b700 1 --2- 172.21.15.71:0/2446433159 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbf9c0671c0 0x7fbf9c069670 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbfb80c9a50 tx=0x7fbfb4007b40 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:03.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.403+0000 7fbfae7fc700 1 -- 172.21.15.71:0/2446433159 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbfa8053720 con 0x7fbfb80b2100 2023-10-09T06:44:03.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.625+0000 7fbfc05ff700 1 -- 172.21.15.71:0/2446433159 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbfb80718b0 con 0x7fbf9c0671c0 2023-10-09T06:44:03.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.675+0000 7fbfae7fc700 1 -- 172.21.15.71:0/2446433159 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fbfb80718b0 con 0x7fbf9c0671c0 2023-10-09T06:44:03.676 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule activated for path /snap_test_dir1/dir8 2023-10-09T06:44:03.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.678+0000 7fbfc05ff700 1 -- 172.21.15.71:0/2446433159 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbf9c0671c0 msgr2=0x7fbf9c069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:03.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.678+0000 7fbfc05ff700 1 --2- 172.21.15.71:0/2446433159 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbf9c0671c0 0x7fbf9c069670 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbfb80c9a50 tx=0x7fbfb4007b40 comp rx=0 tx=0).stop 2023-10-09T06:44:03.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.678+0000 7fbfc05ff700 1 -- 172.21.15.71:0/2446433159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfb80b2100 msgr2=0x7fbfb8158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:03.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.678+0000 7fbfc05ff700 1 --2- 172.21.15.71:0/2446433159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfb80b2100 0x7fbfb8158a60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009290 tx=0x7fbfa8017000 comp rx=0 tx=0).stop 2023-10-09T06:44:03.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.678+0000 7fbfc05ff700 1 -- 172.21.15.71:0/2446433159 shutdown_connections 2023-10-09T06:44:03.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.678+0000 7fbfc05ff700 1 --2- 172.21.15.71:0/2446433159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfb8157740 0x7fbfb80c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:03.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.678+0000 7fbfc05ff700 1 --2- 172.21.15.71:0/2446433159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfb80688d0 0x7fbfb8158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:03.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.678+0000 7fbfc05ff700 1 --2- 172.21.15.71:0/2446433159 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbf9c0671c0 0x7fbf9c069670 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:03.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.678+0000 7fbfc05ff700 1 --2- 172.21.15.71:0/2446433159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfb80b2100 0x7fbfb8158a60 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:03.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.678+0000 7fbfc05ff700 1 -- 172.21.15.71:0/2446433159 >> 172.21.15.71:0/2446433159 conn(0x7fbfb80c8f90 msgr2=0x7fbfb80cc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:44:03.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.678+0000 7fbfc05ff700 1 -- 172.21.15.71:0/2446433159 shutdown_connections 2023-10-09T06:44:03.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.678+0000 7fbfc05ff700 1 -- 172.21.15.71:0/2446433159 wait complete. 2023-10-09T06:44:03.696 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir8 2023-10-09T06:44:03.697 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir9 1M 2023-10-09T06:44:03.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.882+0000 7f12add9d700 1 Processor -- start 2023-10-09T06:44:03.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.882+0000 7f12add9d700 1 -- start start 2023-10-09T06:44:03.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.883+0000 7f12add9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f12a81594e0 0x7f12a80a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:03.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.883+0000 7f12add9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12a815a8c0 0x7f12a80abc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:03.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.883+0000 7f12add9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a80aa4b0 con 0x7f12a80a9e10 2023-10-09T06:44:03.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.883+0000 7f12add9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a80ab130 con 0x7f12a81594e0 2023-10-09T06:44:03.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.883+0000 7f12add9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a80aa2b0 con 0x7f12a815a8c0 2023-10-09T06:44:03.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.884+0000 7f12acd9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f12a81594e0 0x7f12a80a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:03.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.884+0000 7f12ad59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12a815a8c0 0x7f12a80abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:03.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.884+0000 7f12acd9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f12a81594e0 0x7f12a80a98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:59600/0 (socket says 172.21.15.71:59600) 2023-10-09T06:44:03.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.884+0000 7f12ad59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12a815a8c0 0x7f12a80abc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:36754/0 (socket says 172.21.15.71:36754) 2023-10-09T06:44:03.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.884+0000 7f12acd9b700 1 -- 172.21.15.71:0/1154475171 learned_addr learned my addr 172.21.15.71:0/1154475171 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:44:03.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.884+0000 7f12a7fff700 1 --1- 172.21.15.71:0/1154475171 >> v1:172.21.15.179:6789/0 conn(0x7f12a80a9e10 0x7f12a815d250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:37126/0 (socket says 172.21.15.71:37126) 2023-10-09T06:44:03.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.884+0000 7f12acd9b700 1 -- 172.21.15.71:0/1154475171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12a815a8c0 msgr2=0x7f12a80abc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:44:03.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.884+0000 7f12acd9b700 1 --2- 172.21.15.71:0/1154475171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12a815a8c0 0x7f12a80abc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:03.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.884+0000 7f12acd9b700 1 -- 172.21.15.71:0/1154475171 >> v1:172.21.15.179:6789/0 conn(0x7f12a80a9e10 legacy=0x7f12a815d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:03.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.884+0000 7f12acd9b700 1 -- 172.21.15.71:0/1154475171 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a80aa790 con 0x7f12a81594e0 2023-10-09T06:44:03.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.884+0000 7f12ad59c700 1 --2- 172.21.15.71:0/1154475171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12a815a8c0 0x7f12a80abc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:44:03.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.885+0000 7f12acd9b700 1 --2- 172.21.15.71:0/1154475171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12a81594e0 0x7f12a80a98d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f129c0099b0 tx=0x7f129c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69dd2401c35ae1c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:03.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.885+0000 7f12a77fe700 1 -- 172.21.15.71:0/1154475171 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c009ea0 con 0x7f12a81594e0 2023-10-09T06:44:03.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.885+0000 7f12a77fe700 1 -- 172.21.15.71:0/1154475171 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129c00b8f0 con 0x7f12a81594e0 2023-10-09T06:44:03.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.885+0000 7f12a77fe700 1 -- 172.21.15.71:0/1154475171 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c00bc90 con 0x7f12a81594e0 2023-10-09T06:44:03.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.886+0000 7f12add9d700 1 -- 172.21.15.71:0/1154475171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12a81594e0 msgr2=0x7f12a80a98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:03.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.886+0000 7f12add9d700 1 --2- 172.21.15.71:0/1154475171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12a81594e0 0x7f12a80a98d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f129c0099b0 tx=0x7f129c009250 comp rx=0 tx=0).stop 2023-10-09T06:44:03.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.886+0000 7f12add9d700 1 -- 172.21.15.71:0/1154475171 shutdown_connections 2023-10-09T06:44:03.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.886+0000 7f12add9d700 1 --2- 172.21.15.71:0/1154475171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12a815a8c0 0x7f12a80abc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:03.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.886+0000 7f12add9d700 1 --2- 172.21.15.71:0/1154475171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12a81594e0 0x7f12a80a98d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:03.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.886+0000 7f12add9d700 1 -- 172.21.15.71:0/1154475171 >> 172.21.15.71:0/1154475171 conn(0x7f12a8068e20 msgr2=0x7f12a80cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:44:03.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.886+0000 7f12add9d700 1 -- 172.21.15.71:0/1154475171 shutdown_connections 2023-10-09T06:44:03.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.886+0000 7f12add9d700 1 -- 172.21.15.71:0/1154475171 wait complete. 2023-10-09T06:44:03.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.887+0000 7f12add9d700 1 Processor -- start 2023-10-09T06:44:03.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.887+0000 7f12add9d700 1 -- start start 2023-10-09T06:44:03.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.888+0000 7f12add9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12a80a9e10 0x7f12a80c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:03.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.888+0000 7f12add9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12a81594e0 0x7f12a8169ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:03.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.888+0000 7f12add9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12a815a8c0 0x7f12a80c1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:03.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.888+0000 7f12add9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a80c20f0 con 0x7f12a81594e0 2023-10-09T06:44:03.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.888+0000 7f12add9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a80c3ad0 con 0x7f12a815a8c0 2023-10-09T06:44:03.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.888+0000 7f12add9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a80c1b30 con 0x7f12a80a9e10 2023-10-09T06:44:03.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.888+0000 7f12a7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12a81594e0 0x7f12a8169ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:03.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.888+0000 7f12a7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12a81594e0 0x7f12a8169ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49676/0 (socket says 172.21.15.71:49676) 2023-10-09T06:44:03.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.888+0000 7f12a7fff700 1 -- 172.21.15.71:0/119980641 learned_addr learned my addr 172.21.15.71:0/119980641 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:44:03.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.889+0000 7f12acd9b700 1 --2- 172.21.15.71:0/119980641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12a80a9e10 0x7f12a80c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:03.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.889+0000 7f12ad59c700 1 --2- 172.21.15.71:0/119980641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12a815a8c0 0x7f12a80c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:03.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.889+0000 7f12a7fff700 1 -- 172.21.15.71:0/119980641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12a80a9e10 msgr2=0x7f12a80c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:03.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.889+0000 7f12a7fff700 1 --2- 172.21.15.71:0/119980641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12a80a9e10 0x7f12a80c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:03.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.889+0000 7f12a7fff700 1 -- 172.21.15.71:0/119980641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12a815a8c0 msgr2=0x7f12a80c1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:03.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.889+0000 7f12a7fff700 1 --2- 172.21.15.71:0/119980641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12a815a8c0 0x7f12a80c1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:03.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.889+0000 7f12a7fff700 1 -- 172.21.15.71:0/119980641 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a0009a20 con 0x7f12a81594e0 2023-10-09T06:44:03.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.889+0000 7f12ad59c700 1 --2- 172.21.15.71:0/119980641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12a815a8c0 0x7f12a80c1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:44:03.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.889+0000 7f12acd9b700 1 --2- 172.21.15.71:0/119980641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12a80a9e10 0x7f12a80c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:44:03.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.889+0000 7f12a7fff700 1 --2- 172.21.15.71:0/119980641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12a81594e0 0x7f12a8169ab0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f129400c590 tx=0x7f1294007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:03.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.889+0000 7f12a4ff9700 1 -- 172.21.15.71:0/119980641 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1294005a70 con 0x7f12a81594e0 2023-10-09T06:44:03.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.889+0000 7f12a4ff9700 1 -- 172.21.15.71:0/119980641 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1294005bd0 con 0x7f12a81594e0 2023-10-09T06:44:03.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.889+0000 7f12a4ff9700 1 -- 172.21.15.71:0/119980641 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12940070d0 con 0x7f12a81594e0 2023-10-09T06:44:03.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.889+0000 7f12add9d700 1 -- 172.21.15.71:0/119980641 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129c0094f0 con 0x7f12a81594e0 2023-10-09T06:44:03.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.890+0000 7f12add9d700 1 -- 172.21.15.71:0/119980641 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a80c3760 con 0x7f12a81594e0 2023-10-09T06:44:03.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.890+0000 7f12add9d700 1 -- 172.21.15.71:0/119980641 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a804c3c0 con 0x7f12a81594e0 2023-10-09T06:44:03.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.891+0000 7f12a4ff9700 1 -- 172.21.15.71:0/119980641 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 10) v1 ==== 84973+0+0 (secure 0 0 0) 0x7f12940074c0 con 0x7f12a81594e0 2023-10-09T06:44:03.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.892+0000 7f12a4ff9700 1 --2- 172.21.15.71:0/119980641 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f128c0671c0 0x7f128c069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:44:03.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.892+0000 7f12a4ff9700 1 -- 172.21.15.71:0/119980641 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f1294083dd0 con 0x7f12a81594e0 2023-10-09T06:44:03.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.893+0000 7f12acd9b700 1 --2- 172.21.15.71:0/119980641 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f128c0671c0 0x7f128c069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:44:03.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.893+0000 7f12acd9b700 1 --2- 172.21.15.71:0/119980641 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f128c0671c0 0x7f128c069670 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f129c0099b0 tx=0x7f129c017000 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:44:03.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:03.897+0000 7f12a4ff9700 1 -- 172.21.15.71:0/119980641 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1294050c90 con 0x7f12a81594e0 2023-10-09T06:44:04.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:04.113+0000 7f12add9d700 1 -- 172.21.15.71:0/119980641 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f12a80c3c10 con 0x7f128c0671c0 2023-10-09T06:44:04.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:04.166+0000 7f12a4ff9700 1 -- 172.21.15.71:0/119980641 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f12a80c3c10 con 0x7f128c0671c0 2023-10-09T06:44:04.168 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule activated for path /snap_test_dir1/dir9 2023-10-09T06:44:04.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:04.169+0000 7f12add9d700 1 -- 172.21.15.71:0/119980641 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f128c0671c0 msgr2=0x7f128c069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:04.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:04.169+0000 7f12add9d700 1 --2- 172.21.15.71:0/119980641 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f128c0671c0 0x7f128c069670 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f129c0099b0 tx=0x7f129c017000 comp rx=0 tx=0).stop 2023-10-09T06:44:04.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:04.169+0000 7f12add9d700 1 -- 172.21.15.71:0/119980641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12a81594e0 msgr2=0x7f12a8169ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:44:04.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:04.169+0000 7f12add9d700 1 --2- 172.21.15.71:0/119980641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12a81594e0 0x7f12a8169ab0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f129400c590 tx=0x7f1294007f70 comp rx=0 tx=0).stop 2023-10-09T06:44:04.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:04.169+0000 7f12add9d700 1 -- 172.21.15.71:0/119980641 shutdown_connections 2023-10-09T06:44:04.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:04.169+0000 7f12add9d700 1 --2- 172.21.15.71:0/119980641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12a815a8c0 0x7f12a80c1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:04.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:04.169+0000 7f12add9d700 1 --2- 172.21.15.71:0/119980641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12a80a9e10 0x7f12a80c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:04.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:04.169+0000 7f12add9d700 1 --2- 172.21.15.71:0/119980641 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f128c0671c0 0x7f128c069670 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:04.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:04.169+0000 7f12add9d700 1 --2- 172.21.15.71:0/119980641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12a81594e0 0x7f12a8169ab0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:44:04.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:04.169+0000 7f12add9d700 1 -- 172.21.15.71:0/119980641 >> 172.21.15.71:0/119980641 conn(0x7f12a8068e20 msgr2=0x7f12a8158bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:44:04.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:04.169+0000 7f12add9d700 1 -- 172.21.15.71:0/119980641 shutdown_connections 2023-10-09T06:44:04.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:44:04.169+0000 7f12add9d700 1 -- 172.21.15.71:0/119980641 wait complete. 2023-10-09T06:44:04.187 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir9 2023-10-09T06:44:29.261 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:44:29.267 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:44:59.375 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:44:59.381 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:45:29.480 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:45:29.486 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:45:59.589 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:45:59.595 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:46:29.721 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:46:29.727 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:46:59.839 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:46:59.844 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:47:00.249 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:47:00.249+0000 7f8adb265700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:47:00.249 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:47:00.249+0000 7f8adb265700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:47:00.249 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:47:00.249+0000 7f8adb265700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:47:00.250 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:47:00.249+0000 7f8adb265700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:47:00.250 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:47:00.249+0000 7f8adb265700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:47:29.953 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:47:29.958 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:48:00.059 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:48:00.064 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:48:30.173 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:48:30.179 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:49:00.294 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:49:00.299 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:49:30.408 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:49:30.414 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:50:00.522 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:50:00.527 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:50:30.672 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:50:30.679 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:51:00.800 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:51:00.805 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:51:30.902 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:51:30.908 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:52:01.041 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:52:01.046 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:52:31.135 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:52:31.140 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:53:01.255 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:53:01.261 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:53:31.360 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:53:31.366 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:54:01.463 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:54:01.468 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:54:20.189 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir0 1M 2023-10-09T06:54:20.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.385+0000 7fe3c71ff700 1 Processor -- start 2023-10-09T06:54:20.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.385+0000 7fe3c71ff700 1 -- start start 2023-10-09T06:54:20.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.386+0000 7fe3c71ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3c01563b0 0x7fe3c0156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:20.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.386+0000 7fe3c71ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe3c0068890 0x7fe3c00c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:20.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.387+0000 7fe3c71ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c015a9b0 con 0x7fe3c015a440 2023-10-09T06:54:20.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.387+0000 7fe3c71ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c015ac90 con 0x7fe3c0068890 2023-10-09T06:54:20.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.387+0000 7fe3c71ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c015af70 con 0x7fe3c01563b0 2023-10-09T06:54:20.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.387+0000 7fe3bffff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe3c015a440 0x7fe3c00acf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46366/0 (socket says 172.21.15.71:46366) 2023-10-09T06:54:20.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.387+0000 7fe3bffff700 1 -- 172.21.15.71:0/705732804 learned_addr learned my addr 172.21.15.71:0/705732804 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:20.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.387+0000 7fe3c579c700 1 --2- 172.21.15.71:0/705732804 >> v2:172.21.15.71:3300/0 conn(0x7fe3c0068890 0x7fe3c00c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:20.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.387+0000 7fe3c4f9b700 1 --2- 172.21.15.71:0/705732804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3c01563b0 0x7fe3c0156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:20.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.387+0000 7fe3bf7fe700 1 -- 172.21.15.71:0/705732804 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547436387 0 0) 0x7fe3c015a9b0 con 0x7fe3c015a440 2023-10-09T06:54:20.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.387+0000 7fe3bf7fe700 1 -- 172.21.15.71:0/705732804 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3b0003570 con 0x7fe3c015a440 2023-10-09T06:54:20.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.387+0000 7fe3c579c700 1 -- 172.21.15.71:0/705732804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3c01563b0 msgr2=0x7fe3c0156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:20.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.387+0000 7fe3c579c700 1 --2- 172.21.15.71:0/705732804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3c01563b0 0x7fe3c0156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:20.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.387+0000 7fe3c579c700 1 -- 172.21.15.71:0/705732804 >> v1:172.21.15.71:6789/0 conn(0x7fe3c015a440 legacy=0x7fe3c00acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:20.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.387+0000 7fe3c579c700 1 -- 172.21.15.71:0/705732804 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c015b250 con 0x7fe3c0068890 2023-10-09T06:54:20.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.388+0000 7fe3c579c700 1 --2- 172.21.15.71:0/705732804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3c0068890 0x7fe3c00c8230 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8009e60 tx=0x7fe3b8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98eccb15e0615ec4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:20.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.388+0000 7fe3bf7fe700 1 -- 172.21.15.71:0/705732804 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b800bb60 con 0x7fe3c0068890 2023-10-09T06:54:20.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.388+0000 7fe3bf7fe700 1 -- 172.21.15.71:0/705732804 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b800bcc0 con 0x7fe3c0068890 2023-10-09T06:54:20.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.388+0000 7fe3bf7fe700 1 -- 172.21.15.71:0/705732804 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8011670 con 0x7fe3c0068890 2023-10-09T06:54:20.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.388+0000 7fe3c71ff700 1 -- 172.21.15.71:0/705732804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3c0068890 msgr2=0x7fe3c00c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:20.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.388+0000 7fe3c71ff700 1 --2- 172.21.15.71:0/705732804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3c0068890 0x7fe3c00c8230 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8009e60 tx=0x7fe3b8009780 comp rx=0 tx=0).stop 2023-10-09T06:54:20.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.388+0000 7fe3c71ff700 1 -- 172.21.15.71:0/705732804 shutdown_connections 2023-10-09T06:54:20.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.388+0000 7fe3c71ff700 1 --2- 172.21.15.71:0/705732804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3c0068890 0x7fe3c00c8230 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:20.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.388+0000 7fe3c71ff700 1 --2- 172.21.15.71:0/705732804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3c01563b0 0x7fe3c0156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:20.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.388+0000 7fe3c71ff700 1 -- 172.21.15.71:0/705732804 >> 172.21.15.71:0/705732804 conn(0x7fe3c00c8f90 msgr2=0x7fe3c00c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:20.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.389+0000 7fe3c71ff700 1 -- 172.21.15.71:0/705732804 shutdown_connections 2023-10-09T06:54:20.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.389+0000 7fe3c71ff700 1 -- 172.21.15.71:0/705732804 wait complete. 2023-10-09T06:54:20.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.390+0000 7fe3c71ff700 1 Processor -- start 2023-10-09T06:54:20.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.390+0000 7fe3c71ff700 1 -- start start 2023-10-09T06:54:20.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.391+0000 7fe3c71ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3c0068890 0x7fe3c00cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:20.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.391+0000 7fe3c71ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3c01563b0 0x7fe3c00c08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:20.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.391+0000 7fe3c71ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3c015a440 0x7fe3c0164b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:20.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.391+0000 7fe3c71ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c00b03d0 con 0x7fe3c0068890 2023-10-09T06:54:20.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.391+0000 7fe3c71ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c00cb8b0 con 0x7fe3c015a440 2023-10-09T06:54:20.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.391+0000 7fe3c71ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c00cbb90 con 0x7fe3c01563b0 2023-10-09T06:54:20.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.391+0000 7fe3c4f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3c0068890 0x7fe3c00cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:20.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.391+0000 7fe3c4f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3c0068890 0x7fe3c00cb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58506/0 (socket says 172.21.15.71:58506) 2023-10-09T06:54:20.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.391+0000 7fe3c4f9b700 1 -- 172.21.15.71:0/4282982003 learned_addr learned my addr 172.21.15.71:0/4282982003 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:20.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.391+0000 7fe3bffff700 1 --2- 172.21.15.71:0/4282982003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3c01563b0 0x7fe3c00c08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:20.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.391+0000 7fe3c4f9b700 1 -- 172.21.15.71:0/4282982003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3c01563b0 msgr2=0x7fe3c00c08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:20.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.391+0000 7fe3c579c700 1 --2- 172.21.15.71:0/4282982003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3c015a440 0x7fe3c0164b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:20.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.391+0000 7fe3c4f9b700 1 --2- 172.21.15.71:0/4282982003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3c01563b0 0x7fe3c00c08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:20.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.391+0000 7fe3c4f9b700 1 -- 172.21.15.71:0/4282982003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3c015a440 msgr2=0x7fe3c0164b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:20.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.391+0000 7fe3c4f9b700 1 --2- 172.21.15.71:0/4282982003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3c015a440 0x7fe3c0164b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:20.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.391+0000 7fe3c4f9b700 1 -- 172.21.15.71:0/4282982003 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b8009a20 con 0x7fe3c0068890 2023-10-09T06:54:20.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.392+0000 7fe3bffff700 1 --2- 172.21.15.71:0/4282982003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3c01563b0 0x7fe3c00c08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:54:20.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.392+0000 7fe3c579c700 1 --2- 172.21.15.71:0/4282982003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3c015a440 0x7fe3c0164b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:54:20.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.392+0000 7fe3c4f9b700 1 --2- 172.21.15.71:0/4282982003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3c0068890 0x7fe3c00cb280 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe3b400d890 tx=0x7fe3b4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:20.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.392+0000 7fe3bcff9700 1 -- 172.21.15.71:0/4282982003 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b400b600 con 0x7fe3c0068890 2023-10-09T06:54:20.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.392+0000 7fe3bcff9700 1 -- 172.21.15.71:0/4282982003 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b400b760 con 0x7fe3c0068890 2023-10-09T06:54:20.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.392+0000 7fe3c71ff700 1 -- 172.21.15.71:0/4282982003 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c00cbe70 con 0x7fe3c0068890 2023-10-09T06:54:20.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.392+0000 7fe3bcff9700 1 -- 172.21.15.71:0/4282982003 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b400bae0 con 0x7fe3c0068890 2023-10-09T06:54:20.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.392+0000 7fe3c71ff700 1 -- 172.21.15.71:0/4282982003 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c00c0e30 con 0x7fe3c0068890 2023-10-09T06:54:20.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.393+0000 7fe3c71ff700 1 -- 172.21.15.71:0/4282982003 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c00718b0 con 0x7fe3c0068890 2023-10-09T06:54:20.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.394+0000 7fe3bcff9700 1 -- 172.21.15.71:0/4282982003 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fe3b401e460 con 0x7fe3c0068890 2023-10-09T06:54:20.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.395+0000 7fe3bcff9700 1 --2- 172.21.15.71:0/4282982003 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe3a4067130 0x7fe3a40695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:20.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.395+0000 7fe3bcff9700 1 -- 172.21.15.71:0/4282982003 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fe3b40850e0 con 0x7fe3c0068890 2023-10-09T06:54:20.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.395+0000 7fe3bffff700 1 --2- 172.21.15.71:0/4282982003 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe3a4067130 0x7fe3a40695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:20.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.396+0000 7fe3bffff700 1 --2- 172.21.15.71:0/4282982003 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe3a4067130 0x7fe3a40695e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac0058d0 tx=0x7fe3ac009040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:20.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.400+0000 7fe3bcff9700 1 -- 172.21.15.71:0/4282982003 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3b4051f30 con 0x7fe3c0068890 2023-10-09T06:54:20.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.617+0000 7fe3c71ff700 1 -- 172.21.15.71:0/4282982003 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3c00b0510 con 0x7fe3a4067130 2023-10-09T06:54:20.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.690+0000 7fe3bcff9700 1 -- 172.21.15.71:0/4282982003 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fe3ac001d80 con 0x7fe3a4067130 2023-10-09T06:54:20.691 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule deactivated for path /snap_test_dir1/dir0 2023-10-09T06:54:20.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.692+0000 7fe3c71ff700 1 -- 172.21.15.71:0/4282982003 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe3a4067130 msgr2=0x7fe3a40695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:20.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.692+0000 7fe3c71ff700 1 --2- 172.21.15.71:0/4282982003 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe3a4067130 0x7fe3a40695e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac0058d0 tx=0x7fe3ac009040 comp rx=0 tx=0).stop 2023-10-09T06:54:20.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.692+0000 7fe3c71ff700 1 -- 172.21.15.71:0/4282982003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3c0068890 msgr2=0x7fe3c00cb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:20.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.692+0000 7fe3c71ff700 1 --2- 172.21.15.71:0/4282982003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3c0068890 0x7fe3c00cb280 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe3b400d890 tx=0x7fe3b4008040 comp rx=0 tx=0).stop 2023-10-09T06:54:20.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.692+0000 7fe3c71ff700 1 -- 172.21.15.71:0/4282982003 shutdown_connections 2023-10-09T06:54:20.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.692+0000 7fe3c71ff700 1 --2- 172.21.15.71:0/4282982003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3c015a440 0x7fe3c0164b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:20.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.692+0000 7fe3c71ff700 1 --2- 172.21.15.71:0/4282982003 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe3a4067130 0x7fe3a40695e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:20.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.692+0000 7fe3c71ff700 1 --2- 172.21.15.71:0/4282982003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3c0068890 0x7fe3c00cb280 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:20.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.692+0000 7fe3c71ff700 1 --2- 172.21.15.71:0/4282982003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3c01563b0 0x7fe3c00c08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:20.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.692+0000 7fe3c71ff700 1 -- 172.21.15.71:0/4282982003 >> 172.21.15.71:0/4282982003 conn(0x7fe3c00c8f90 msgr2=0x7fe3c00ae0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:20.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.692+0000 7fe3c71ff700 1 -- 172.21.15.71:0/4282982003 shutdown_connections 2023-10-09T06:54:20.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.692+0000 7fe3c71ff700 1 -- 172.21.15.71:0/4282982003 wait complete. 2023-10-09T06:54:20.710 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir0 2023-10-09T06:54:20.710 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir1 1M 2023-10-09T06:54:20.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.895+0000 7fb01e3ff700 1 Processor -- start 2023-10-09T06:54:20.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.895+0000 7fb01e3ff700 1 -- start start 2023-10-09T06:54:20.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.897+0000 7fb01e3ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb0180b2100 0x7fb018068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:20.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.897+0000 7fb01e3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb0180688d0 0x7fb01806e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:20.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.897+0000 7fb01e3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0180ae6d0 con 0x7fb018157740 2023-10-09T06:54:20.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.897+0000 7fb01e3ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0180acc00 con 0x7fb0180b2100 2023-10-09T06:54:20.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.897+0000 7fb01e3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01806d6a0 con 0x7fb0180688d0 2023-10-09T06:54:20.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.897+0000 7fb0177fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb0180b2100 0x7fb018068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:20.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.897+0000 7fb0177fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb0180b2100 0x7fb018068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58522/0 (socket says 172.21.15.71:58522) 2023-10-09T06:54:20.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.897+0000 7fb0177fe700 1 -- 172.21.15.71:0/3375932174 learned_addr learned my addr 172.21.15.71:0/3375932174 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:20.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.897+0000 7fb01c99c700 1 --2- 172.21.15.71:0/3375932174 >> v2:172.21.15.179:3300/0 conn(0x7fb0180688d0 0x7fb01806e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:20.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.897+0000 7fb0177fe700 1 -- 172.21.15.71:0/3375932174 >> v2:172.21.15.179:3300/0 conn(0x7fb0180688d0 msgr2=0x7fb01806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:20.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.897+0000 7fb0177fe700 1 --2- 172.21.15.71:0/3375932174 >> v2:172.21.15.179:3300/0 conn(0x7fb0180688d0 0x7fb01806e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:20.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.897+0000 7fb0177fe700 1 -- 172.21.15.71:0/3375932174 >> v1:172.21.15.179:6789/0 conn(0x7fb018157740 legacy=0x7fb0180adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:20.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.897+0000 7fb0177fe700 1 -- 172.21.15.71:0/3375932174 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb018068d30 con 0x7fb0180b2100 2023-10-09T06:54:20.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.898+0000 7fb0177fe700 1 --2- 172.21.15.71:0/3375932174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0180b2100 0x7fb018068390 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb01806d7e0 tx=0x7fb00c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbfc1f66fb09a7d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:20.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.898+0000 7fb016ffd700 1 -- 172.21.15.71:0/3375932174 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c00b7f0 con 0x7fb0180b2100 2023-10-09T06:54:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.898+0000 7fb016ffd700 1 -- 172.21.15.71:0/3375932174 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c00b950 con 0x7fb0180b2100 2023-10-09T06:54:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.898+0000 7fb016ffd700 1 -- 172.21.15.71:0/3375932174 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c00bcf0 con 0x7fb0180b2100 2023-10-09T06:54:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.899+0000 7fb01e3ff700 1 -- 172.21.15.71:0/3375932174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0180b2100 msgr2=0x7fb018068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.899+0000 7fb01e3ff700 1 --2- 172.21.15.71:0/3375932174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0180b2100 0x7fb018068390 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb01806d7e0 tx=0x7fb00c009250 comp rx=0 tx=0).stop 2023-10-09T06:54:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.899+0000 7fb01e3ff700 1 -- 172.21.15.71:0/3375932174 shutdown_connections 2023-10-09T06:54:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.899+0000 7fb01e3ff700 1 --2- 172.21.15.71:0/3375932174 >> v2:172.21.15.179:3300/0 conn(0x7fb0180688d0 0x7fb01806e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.899+0000 7fb01e3ff700 1 --2- 172.21.15.71:0/3375932174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0180b2100 0x7fb018068390 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.899+0000 7fb01e3ff700 1 -- 172.21.15.71:0/3375932174 >> 172.21.15.71:0/3375932174 conn(0x7fb0180c8f90 msgr2=0x7fb0180c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.899+0000 7fb01e3ff700 1 -- 172.21.15.71:0/3375932174 shutdown_connections 2023-10-09T06:54:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.899+0000 7fb01e3ff700 1 -- 172.21.15.71:0/3375932174 wait complete. 2023-10-09T06:54:20.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.901+0000 7fb01e3ff700 1 Processor -- start 2023-10-09T06:54:20.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.901+0000 7fb01e3ff700 1 -- start start 2023-10-09T06:54:20.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.902+0000 7fb01e3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0180688d0 0x7fb01816a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:20.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.902+0000 7fb01e3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0180b2100 0x7fb0180a9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:20.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.902+0000 7fb01e3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb018157740 0x7fb0180a9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:20.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.902+0000 7fb01e3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01816ab90 con 0x7fb0180b2100 2023-10-09T06:54:20.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.902+0000 7fb01e3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180c6250 con 0x7fb018157740 2023-10-09T06:54:20.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.902+0000 7fb01e3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01816a1c0 con 0x7fb0180688d0 2023-10-09T06:54:20.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.902+0000 7fb0177fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0180b2100 0x7fb0180a9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:20.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.902+0000 7fb0177fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0180b2100 0x7fb0180a9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58528/0 (socket says 172.21.15.71:58528) 2023-10-09T06:54:20.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.902+0000 7fb0177fe700 1 -- 172.21.15.71:0/88755533 learned_addr learned my addr 172.21.15.71:0/88755533 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:20.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.902+0000 7fb0177fe700 1 -- 172.21.15.71:0/88755533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0180688d0 msgr2=0x7fb01816a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:20.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.902+0000 7fb0177fe700 1 --2- 172.21.15.71:0/88755533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0180688d0 0x7fb01816a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:20.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.902+0000 7fb0177fe700 1 -- 172.21.15.71:0/88755533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb018157740 msgr2=0x7fb0180a9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:20.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.902+0000 7fb0177fe700 1 --2- 172.21.15.71:0/88755533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb018157740 0x7fb0180a9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:20.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.902+0000 7fb0177fe700 1 -- 172.21.15.71:0/88755533 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c0094f0 con 0x7fb0180b2100 2023-10-09T06:54:20.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.903+0000 7fb0177fe700 1 --2- 172.21.15.71:0/88755533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0180b2100 0x7fb0180a9340 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb00c006fd0 tx=0x7fb00c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:20.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.903+0000 7faffffff700 1 -- 172.21.15.71:0/88755533 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c00bc60 con 0x7fb0180b2100 2023-10-09T06:54:20.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.903+0000 7faffffff700 1 -- 172.21.15.71:0/88755533 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c01a630 con 0x7fb0180b2100 2023-10-09T06:54:20.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.903+0000 7fb01e3ff700 1 -- 172.21.15.71:0/88755533 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0181695b0 con 0x7fb0180b2100 2023-10-09T06:54:20.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.903+0000 7faffffff700 1 -- 172.21.15.71:0/88755533 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c01a9f0 con 0x7fb0180b2100 2023-10-09T06:54:20.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.903+0000 7fb01e3ff700 1 -- 172.21.15.71:0/88755533 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb018169b70 con 0x7fb0180b2100 2023-10-09T06:54:20.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.904+0000 7fb01e3ff700 1 -- 172.21.15.71:0/88755533 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0180718b0 con 0x7fb0180b2100 2023-10-09T06:54:20.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.905+0000 7faffffff700 1 -- 172.21.15.71:0/88755533 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fb00c0253f0 con 0x7fb0180b2100 2023-10-09T06:54:20.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.906+0000 7faffffff700 1 --2- 172.21.15.71:0/88755533 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb004067130 0x7fb0040695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:20.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.906+0000 7faffffff700 1 -- 172.21.15.71:0/88755533 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fb00c086050 con 0x7fb0180b2100 2023-10-09T06:54:20.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.906+0000 7fb017fff700 1 --2- 172.21.15.71:0/88755533 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb004067130 0x7fb0040695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:20.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.907+0000 7fb017fff700 1 --2- 172.21.15.71:0/88755533 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb004067130 0x7fb0040695e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb008007fd0 tx=0x7fb008007a90 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:20.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:20.910+0000 7faffffff700 1 -- 172.21.15.71:0/88755533 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb00c052f40 con 0x7fb0180b2100 2023-10-09T06:54:21.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.130+0000 7fb01e3ff700 1 -- 172.21.15.71:0/88755533 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0180ab350 con 0x7fb004067130 2023-10-09T06:54:21.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.200+0000 7faffffff700 1 -- 172.21.15.71:0/88755533 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fb0180ab350 con 0x7fb004067130 2023-10-09T06:54:21.201 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule deactivated for path /snap_test_dir1/dir1 2023-10-09T06:54:21.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.203+0000 7fb01e3ff700 1 -- 172.21.15.71:0/88755533 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb004067130 msgr2=0x7fb0040695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:21.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.203+0000 7fb01e3ff700 1 --2- 172.21.15.71:0/88755533 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb004067130 0x7fb0040695e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb008007fd0 tx=0x7fb008007a90 comp rx=0 tx=0).stop 2023-10-09T06:54:21.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.203+0000 7fb01e3ff700 1 -- 172.21.15.71:0/88755533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0180b2100 msgr2=0x7fb0180a9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:21.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.203+0000 7fb01e3ff700 1 --2- 172.21.15.71:0/88755533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0180b2100 0x7fb0180a9340 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb00c006fd0 tx=0x7fb00c017000 comp rx=0 tx=0).stop 2023-10-09T06:54:21.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.203+0000 7fb01e3ff700 1 -- 172.21.15.71:0/88755533 shutdown_connections 2023-10-09T06:54:21.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.203+0000 7fb01e3ff700 1 --2- 172.21.15.71:0/88755533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb018157740 0x7fb0180a9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:21.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.203+0000 7fb01e3ff700 1 --2- 172.21.15.71:0/88755533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0180688d0 0x7fb01816a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:21.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.203+0000 7fb01e3ff700 1 --2- 172.21.15.71:0/88755533 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb004067130 0x7fb0040695e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:21.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.203+0000 7fb01e3ff700 1 --2- 172.21.15.71:0/88755533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0180b2100 0x7fb0180a9340 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:21.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.203+0000 7fb01e3ff700 1 -- 172.21.15.71:0/88755533 >> 172.21.15.71:0/88755533 conn(0x7fb0180c8f90 msgr2=0x7fb0180cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:21.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.203+0000 7fb01e3ff700 1 -- 172.21.15.71:0/88755533 shutdown_connections 2023-10-09T06:54:21.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.203+0000 7fb01e3ff700 1 -- 172.21.15.71:0/88755533 wait complete. 2023-10-09T06:54:21.221 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir1 2023-10-09T06:54:21.221 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir2 1M 2023-10-09T06:54:21.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.405+0000 7f79cc5ff700 1 Processor -- start 2023-10-09T06:54:21.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.405+0000 7f79cc5ff700 1 -- start start 2023-10-09T06:54:21.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.406+0000 7f79cc5ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f79c4159ec0 0x7f79c40b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:21.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.406+0000 7f79cc5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79c40b53d0 0x7f79c40cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:21.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.407+0000 7f79cc5ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c40b5b00 con 0x7f79c40cce40 2023-10-09T06:54:21.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.407+0000 7f79cc5ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c40b5850 con 0x7f79c4159ec0 2023-10-09T06:54:21.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.407+0000 7f79cc5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c40b5da0 con 0x7f79c40b53d0 2023-10-09T06:54:21.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.407+0000 7f79ca39b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f79c4159ec0 0x7f79c40b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:21.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.407+0000 7f79cab9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f79c40cce40 0x7f79c40cd2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46380/0 (socket says 172.21.15.71:46380) 2023-10-09T06:54:21.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.407+0000 7f79cab9c700 1 -- 172.21.15.71:0/2270386496 learned_addr learned my addr 172.21.15.71:0/2270386496 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:21.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.407+0000 7f79c9b9a700 1 --2- 172.21.15.71:0/2270386496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79c40b53d0 0x7f79c40cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:21.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.407+0000 7f79ca39b700 1 -- 172.21.15.71:0/2270386496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79c40b53d0 msgr2=0x7f79c40cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:21.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.407+0000 7f79ca39b700 1 --2- 172.21.15.71:0/2270386496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79c40b53d0 0x7f79c40cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:21.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.407+0000 7f79ca39b700 1 -- 172.21.15.71:0/2270386496 >> v1:172.21.15.71:6789/0 conn(0x7f79c40cce40 legacy=0x7f79c40cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:21.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.407+0000 7f79ca39b700 1 -- 172.21.15.71:0/2270386496 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c40b6080 con 0x7f79c4159ec0 2023-10-09T06:54:21.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.407+0000 7f79c9b9a700 1 --2- 172.21.15.71:0/2270386496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79c40b53d0 0x7f79c40cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:54:21.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.407+0000 7f79c9399700 1 -- 172.21.15.71:0/2270386496 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 716949698 0 0) 0x7f79c40b5b00 con 0x7f79c40cce40 2023-10-09T06:54:21.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.408+0000 7f79ca39b700 1 --2- 172.21.15.71:0/2270386496 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79c4159ec0 0x7f79c40b4e90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f79c00098d0 tx=0x7f79c0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c23f53f88e6ce8f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:21.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.408+0000 7f79c9399700 1 -- 172.21.15.71:0/2270386496 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c0009e70 con 0x7f79c4159ec0 2023-10-09T06:54:21.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.408+0000 7f79c9399700 1 -- 172.21.15.71:0/2270386496 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c0005c10 con 0x7f79c4159ec0 2023-10-09T06:54:21.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.408+0000 7f79c9399700 1 -- 172.21.15.71:0/2270386496 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c000b650 con 0x7f79c4159ec0 2023-10-09T06:54:21.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.408+0000 7f79cc5ff700 1 -- 172.21.15.71:0/2270386496 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79c4159ec0 msgr2=0x7f79c40b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:21.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.408+0000 7f79cc5ff700 1 --2- 172.21.15.71:0/2270386496 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79c4159ec0 0x7f79c40b4e90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f79c00098d0 tx=0x7f79c0009120 comp rx=0 tx=0).stop 2023-10-09T06:54:21.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.408+0000 7f79cc5ff700 1 -- 172.21.15.71:0/2270386496 shutdown_connections 2023-10-09T06:54:21.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.408+0000 7f79cc5ff700 1 --2- 172.21.15.71:0/2270386496 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79c4159ec0 0x7f79c40b4e90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:21.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.408+0000 7f79cc5ff700 1 --2- 172.21.15.71:0/2270386496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79c40b53d0 0x7f79c40cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:21.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.408+0000 7f79cc5ff700 1 -- 172.21.15.71:0/2270386496 >> 172.21.15.71:0/2270386496 conn(0x7f79c40999f0 msgr2=0x7f79c40b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:21.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.409+0000 7f79cc5ff700 1 -- 172.21.15.71:0/2270386496 shutdown_connections 2023-10-09T06:54:21.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.409+0000 7f79cc5ff700 1 -- 172.21.15.71:0/2270386496 wait complete. 2023-10-09T06:54:21.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.410+0000 7f79cc5ff700 1 Processor -- start 2023-10-09T06:54:21.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.410+0000 7f79cc5ff700 1 -- start start 2023-10-09T06:54:21.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.411+0000 7f79cc5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79c40b53d0 0x7f79c414e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:21.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.411+0000 7f79cc5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79c40cce40 0x7f79c406a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:21.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.411+0000 7f79cc5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79c4159ec0 0x7f79c4154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:21.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.411+0000 7f79cc5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c41524a0 con 0x7f79c4159ec0 2023-10-09T06:54:21.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.411+0000 7f79cc5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c4152780 con 0x7f79c40b53d0 2023-10-09T06:54:21.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.411+0000 7f79cc5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c4068430 con 0x7f79c40cce40 2023-10-09T06:54:21.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.411+0000 7f79cab9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79c4159ec0 0x7f79c4154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:21.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.411+0000 7f79cab9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79c4159ec0 0x7f79c4154020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58538/0 (socket says 172.21.15.71:58538) 2023-10-09T06:54:21.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.411+0000 7f79cab9c700 1 -- 172.21.15.71:0/476178932 learned_addr learned my addr 172.21.15.71:0/476178932 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:21.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.411+0000 7f79c9b9a700 1 --2- 172.21.15.71:0/476178932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79c40cce40 0x7f79c406a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:21.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.411+0000 7f79ca39b700 1 --2- 172.21.15.71:0/476178932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79c40b53d0 0x7f79c414e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:21.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.412+0000 7f79cab9c700 1 -- 172.21.15.71:0/476178932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79c40cce40 msgr2=0x7f79c406a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:21.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.412+0000 7f79cab9c700 1 --2- 172.21.15.71:0/476178932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79c40cce40 0x7f79c406a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:21.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.412+0000 7f79cab9c700 1 -- 172.21.15.71:0/476178932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79c40b53d0 msgr2=0x7f79c414e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:21.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.412+0000 7f79cab9c700 1 --2- 172.21.15.71:0/476178932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79c40b53d0 0x7f79c414e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:21.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.412+0000 7f79cab9c700 1 -- 172.21.15.71:0/476178932 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c00093c0 con 0x7f79c4159ec0 2023-10-09T06:54:21.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.412+0000 7f79ca39b700 1 --2- 172.21.15.71:0/476178932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79c40b53d0 0x7f79c414e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:54:21.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.412+0000 7f79cab9c700 1 --2- 172.21.15.71:0/476178932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79c4159ec0 0x7f79c4154020 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f79bc00cc90 tx=0x7f79bc001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:21.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.412+0000 7f79ba7fc700 1 -- 172.21.15.71:0/476178932 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc00cea0 con 0x7f79c4159ec0 2023-10-09T06:54:21.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.412+0000 7f79ba7fc700 1 -- 172.21.15.71:0/476178932 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79bc00ab70 con 0x7f79c4159ec0 2023-10-09T06:54:21.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.412+0000 7f79cc5ff700 1 -- 172.21.15.71:0/476178932 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c4068710 con 0x7f79c4159ec0 2023-10-09T06:54:21.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.412+0000 7f79ba7fc700 1 -- 172.21.15.71:0/476178932 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc0070f0 con 0x7f79c4159ec0 2023-10-09T06:54:21.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.412+0000 7f79cc5ff700 1 -- 172.21.15.71:0/476178932 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c406a850 con 0x7f79c4159ec0 2023-10-09T06:54:21.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.413+0000 7f79cc5ff700 1 -- 172.21.15.71:0/476178932 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c40cbd30 con 0x7f79c4159ec0 2023-10-09T06:54:21.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.414+0000 7f79ba7fc700 1 -- 172.21.15.71:0/476178932 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f79bc0074a0 con 0x7f79c4159ec0 2023-10-09T06:54:21.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.415+0000 7f79ba7fc700 1 --2- 172.21.15.71:0/476178932 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f79a8067130 0x7f79a80695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:21.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.415+0000 7f79ba7fc700 1 -- 172.21.15.71:0/476178932 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f79bc084ec0 con 0x7f79c4159ec0 2023-10-09T06:54:21.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.416+0000 7f79ca39b700 1 --2- 172.21.15.71:0/476178932 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f79a8067130 0x7f79a80695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:21.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.416+0000 7f79ca39b700 1 --2- 172.21.15.71:0/476178932 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f79a8067130 0x7f79a80695e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f79c0009160 tx=0x7f79c0016000 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:21.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.419+0000 7f79ba7fc700 1 -- 172.21.15.71:0/476178932 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79bc051d90 con 0x7f79c4159ec0 2023-10-09T06:54:21.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.637+0000 7f79cc5ff700 1 -- 172.21.15.71:0/476178932 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f79c4063c90 con 0x7f79a8067130 2023-10-09T06:54:21.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.716+0000 7f79ba7fc700 1 -- 172.21.15.71:0/476178932 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f79c4063c90 con 0x7f79a8067130 2023-10-09T06:54:21.717 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule deactivated for path /snap_test_dir1/dir2 2023-10-09T06:54:21.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.718+0000 7f79cc5ff700 1 -- 172.21.15.71:0/476178932 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f79a8067130 msgr2=0x7f79a80695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:21.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.718+0000 7f79cc5ff700 1 --2- 172.21.15.71:0/476178932 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f79a8067130 0x7f79a80695e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f79c0009160 tx=0x7f79c0016000 comp rx=0 tx=0).stop 2023-10-09T06:54:21.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.718+0000 7f79cc5ff700 1 -- 172.21.15.71:0/476178932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79c4159ec0 msgr2=0x7f79c4154020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:21.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.718+0000 7f79cc5ff700 1 --2- 172.21.15.71:0/476178932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79c4159ec0 0x7f79c4154020 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f79bc00cc90 tx=0x7f79bc001a80 comp rx=0 tx=0).stop 2023-10-09T06:54:21.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.719+0000 7f79cc5ff700 1 -- 172.21.15.71:0/476178932 shutdown_connections 2023-10-09T06:54:21.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.719+0000 7f79cc5ff700 1 --2- 172.21.15.71:0/476178932 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f79a8067130 0x7f79a80695e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:21.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.719+0000 7f79cc5ff700 1 --2- 172.21.15.71:0/476178932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79c4159ec0 0x7f79c4154020 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:21.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.719+0000 7f79cc5ff700 1 --2- 172.21.15.71:0/476178932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79c40b53d0 0x7f79c414e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:21.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.719+0000 7f79cc5ff700 1 --2- 172.21.15.71:0/476178932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79c40cce40 0x7f79c406a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:21.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.719+0000 7f79cc5ff700 1 -- 172.21.15.71:0/476178932 >> 172.21.15.71:0/476178932 conn(0x7f79c40999f0 msgr2=0x7f79c40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:21.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.719+0000 7f79cc5ff700 1 -- 172.21.15.71:0/476178932 shutdown_connections 2023-10-09T06:54:21.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.719+0000 7f79cc5ff700 1 -- 172.21.15.71:0/476178932 wait complete. 2023-10-09T06:54:21.736 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir2 2023-10-09T06:54:21.737 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir3 1M 2023-10-09T06:54:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.922+0000 7f55b299d700 1 Processor -- start 2023-10-09T06:54:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.922+0000 7f55b299d700 1 -- start start 2023-10-09T06:54:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.923+0000 7f55b299d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55ac0cca20 0x7f55ac0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.923+0000 7f55b299d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55ac0cfa00 con 0x7f55ac0b03c0 2023-10-09T06:54:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.923+0000 7f55b299d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55ac0cb580 con 0x7f55ac0b0790 2023-10-09T06:54:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.923+0000 7f55b299d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac0cf160 con 0x7f55ac0cca20 2023-10-09T06:54:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.924+0000 7f55b199b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f55ac0b03c0 0x7f55ac0b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46382/0 (socket says 172.21.15.71:46382) 2023-10-09T06:54:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.924+0000 7f55b199b700 1 -- 172.21.15.71:0/1382503497 learned_addr learned my addr 172.21.15.71:0/1382503497 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.924+0000 7f55b219c700 1 --2- 172.21.15.71:0/1382503497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55ac0cca20 0x7f55ac0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.924+0000 7f55b0999700 1 -- 172.21.15.71:0/1382503497 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810174296 0 0) 0x7f55ac0cfa00 con 0x7f55ac0b03c0 2023-10-09T06:54:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.924+0000 7f55b0999700 1 -- 172.21.15.71:0/1382503497 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5598003570 con 0x7f55ac0b03c0 2023-10-09T06:54:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.924+0000 7f55b0999700 1 -- 172.21.15.71:0/1382503497 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 94926915 0 0) 0x7f55ac0cb580 con 0x7f55ac0b0790 2023-10-09T06:54:21.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.924+0000 7f55b0999700 1 -- 172.21.15.71:0/1382503497 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55ac0cfa00 con 0x7f55ac0b0790 2023-10-09T06:54:21.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.924+0000 7f55b219c700 1 -- 172.21.15.71:0/1382503497 >> v1:172.21.15.179:6789/0 conn(0x7f55ac0b0790 legacy=0x7f55ac1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:21.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.924+0000 7f55b219c700 1 -- 172.21.15.71:0/1382503497 >> v1:172.21.15.71:6789/0 conn(0x7f55ac0b03c0 legacy=0x7f55ac0b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:21.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.924+0000 7f55b219c700 1 -- 172.21.15.71:0/1382503497 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac0cf440 con 0x7f55ac0cca20 2023-10-09T06:54:21.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.925+0000 7f55b219c700 1 --2- 172.21.15.71:0/1382503497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55ac0cca20 0x7f55ac0cea70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009ec0 tx=0x7f55a4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94b2c5b2f6da22d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:21.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.925+0000 7f55b0999700 1 -- 172.21.15.71:0/1382503497 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a400e070 con 0x7f55ac0cca20 2023-10-09T06:54:21.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.925+0000 7f55b0999700 1 -- 172.21.15.71:0/1382503497 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a400bb40 con 0x7f55ac0cca20 2023-10-09T06:54:21.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.925+0000 7f55b0999700 1 -- 172.21.15.71:0/1382503497 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a4012430 con 0x7f55ac0cca20 2023-10-09T06:54:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.925+0000 7f55b299d700 1 -- 172.21.15.71:0/1382503497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55ac0cca20 msgr2=0x7f55ac0cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.925+0000 7f55b299d700 1 --2- 172.21.15.71:0/1382503497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55ac0cca20 0x7f55ac0cea70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009ec0 tx=0x7f55a4009780 comp rx=0 tx=0).stop 2023-10-09T06:54:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.925+0000 7f55b299d700 1 -- 172.21.15.71:0/1382503497 shutdown_connections 2023-10-09T06:54:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.925+0000 7f55b299d700 1 --2- 172.21.15.71:0/1382503497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55ac0cca20 0x7f55ac0cea70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.925+0000 7f55b299d700 1 -- 172.21.15.71:0/1382503497 >> 172.21.15.71:0/1382503497 conn(0x7f55ac063230 msgr2=0x7f55ac063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.925+0000 7f55b299d700 1 -- 172.21.15.71:0/1382503497 shutdown_connections 2023-10-09T06:54:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.926+0000 7f55b299d700 1 -- 172.21.15.71:0/1382503497 wait complete. 2023-10-09T06:54:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.927+0000 7f55b299d700 1 Processor -- start 2023-10-09T06:54:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.927+0000 7f55b299d700 1 -- start start 2023-10-09T06:54:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.928+0000 7f55b299d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55ac0b03c0 0x7f55ac156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.928+0000 7f55b299d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55ac0b0790 0x7f55ac0cba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.928+0000 7f55b299d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55ac0cca20 0x7f55ac0cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.928+0000 7f55b299d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac16db20 con 0x7f55ac0b0790 2023-10-09T06:54:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.928+0000 7f55b299d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac16d1f0 con 0x7f55ac0cca20 2023-10-09T06:54:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.928+0000 7f55b299d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac16d4d0 con 0x7f55ac0b03c0 2023-10-09T06:54:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.928+0000 7f55b119a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55ac0b0790 0x7f55ac0cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.928+0000 7f55b119a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55ac0b0790 0x7f55ac0cba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58540/0 (socket says 172.21.15.71:58540) 2023-10-09T06:54:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.928+0000 7f55b119a700 1 -- 172.21.15.71:0/2093338315 learned_addr learned my addr 172.21.15.71:0/2093338315 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.929+0000 7f55b199b700 1 --2- 172.21.15.71:0/2093338315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55ac0b03c0 0x7f55ac156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.929+0000 7f55b219c700 1 --2- 172.21.15.71:0/2093338315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55ac0cca20 0x7f55ac0cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.929+0000 7f55b119a700 1 -- 172.21.15.71:0/2093338315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55ac0b03c0 msgr2=0x7f55ac156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.929+0000 7f55b119a700 1 --2- 172.21.15.71:0/2093338315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55ac0b03c0 0x7f55ac156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.929+0000 7f55b119a700 1 -- 172.21.15.71:0/2093338315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55ac0cca20 msgr2=0x7f55ac0cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.929+0000 7f55b119a700 1 --2- 172.21.15.71:0/2093338315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55ac0cca20 0x7f55ac0cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.929+0000 7f55b119a700 1 -- 172.21.15.71:0/2093338315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a4009a20 con 0x7f55ac0b0790 2023-10-09T06:54:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.929+0000 7f55b219c700 1 --2- 172.21.15.71:0/2093338315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55ac0cca20 0x7f55ac0cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:54:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.929+0000 7f55b119a700 1 --2- 172.21.15.71:0/2093338315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55ac0b0790 0x7f55ac0cba10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f559c00c790 tx=0x7f559c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.929+0000 7f55a1ffb700 1 -- 172.21.15.71:0/2093338315 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c010510 con 0x7f55ac0b0790 2023-10-09T06:54:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.929+0000 7f55a1ffb700 1 -- 172.21.15.71:0/2093338315 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559c010670 con 0x7f55ac0b0790 2023-10-09T06:54:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.929+0000 7f55a1ffb700 1 -- 172.21.15.71:0/2093338315 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c010a10 con 0x7f55ac0b0790 2023-10-09T06:54:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.929+0000 7f55b299d700 1 -- 172.21.15.71:0/2093338315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ac16d7b0 con 0x7f55ac0b0790 2023-10-09T06:54:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.929+0000 7f55b299d700 1 -- 172.21.15.71:0/2093338315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ac157170 con 0x7f55ac0b0790 2023-10-09T06:54:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.930+0000 7f55b299d700 1 -- 172.21.15.71:0/2093338315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ac0c3d60 con 0x7f55ac0b0790 2023-10-09T06:54:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.931+0000 7f55a1ffb700 1 -- 172.21.15.71:0/2093338315 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f559c01b400 con 0x7f55ac0b0790 2023-10-09T06:54:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.932+0000 7f55a1ffb700 1 --2- 172.21.15.71:0/2093338315 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5590067130 0x7f55900695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.932+0000 7f55a1ffb700 1 -- 172.21.15.71:0/2093338315 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f559c084820 con 0x7f55ac0b0790 2023-10-09T06:54:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.932+0000 7f55b199b700 1 --2- 172.21.15.71:0/2093338315 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5590067130 0x7f55900695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.933+0000 7f55b199b700 1 --2- 172.21.15.71:0/2093338315 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5590067130 0x7f55900695e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f55a80058d0 tx=0x7f55a8009040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:21.936+0000 7f55a1ffb700 1 -- 172.21.15.71:0/2093338315 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f559c051670 con 0x7f55ac0b0790 2023-10-09T06:54:22.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.154+0000 7f55b299d700 1 -- 172.21.15.71:0/2093338315 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f55ac16d360 con 0x7f5590067130 2023-10-09T06:54:22.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.226+0000 7f55a1ffb700 1 -- 172.21.15.71:0/2093338315 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f55ac16d360 con 0x7f5590067130 2023-10-09T06:54:22.227 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule deactivated for path /snap_test_dir1/dir3 2023-10-09T06:54:22.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.228+0000 7f55b299d700 1 -- 172.21.15.71:0/2093338315 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5590067130 msgr2=0x7f55900695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:22.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.228+0000 7f55b299d700 1 --2- 172.21.15.71:0/2093338315 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5590067130 0x7f55900695e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f55a80058d0 tx=0x7f55a8009040 comp rx=0 tx=0).stop 2023-10-09T06:54:22.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.228+0000 7f55b299d700 1 -- 172.21.15.71:0/2093338315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55ac0b0790 msgr2=0x7f55ac0cba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:22.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.228+0000 7f55b299d700 1 --2- 172.21.15.71:0/2093338315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55ac0b0790 0x7f55ac0cba10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f559c00c790 tx=0x7f559c007e10 comp rx=0 tx=0).stop 2023-10-09T06:54:22.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.228+0000 7f55b299d700 1 -- 172.21.15.71:0/2093338315 shutdown_connections 2023-10-09T06:54:22.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.228+0000 7f55b299d700 1 --2- 172.21.15.71:0/2093338315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55ac0cca20 0x7f55ac0cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:22.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.228+0000 7f55b299d700 1 --2- 172.21.15.71:0/2093338315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55ac0b03c0 0x7f55ac156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:22.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.228+0000 7f55b299d700 1 --2- 172.21.15.71:0/2093338315 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5590067130 0x7f55900695e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:22.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.228+0000 7f55b299d700 1 --2- 172.21.15.71:0/2093338315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55ac0b0790 0x7f55ac0cba10 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:22.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.228+0000 7f55b299d700 1 -- 172.21.15.71:0/2093338315 >> 172.21.15.71:0/2093338315 conn(0x7f55ac063230 msgr2=0x7f55ac068cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:22.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.228+0000 7f55b299d700 1 -- 172.21.15.71:0/2093338315 shutdown_connections 2023-10-09T06:54:22.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.229+0000 7f55b299d700 1 -- 172.21.15.71:0/2093338315 wait complete. 2023-10-09T06:54:22.247 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir3 2023-10-09T06:54:22.247 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir4 1M 2023-10-09T06:54:22.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.432+0000 7f0e3bfff700 1 Processor -- start 2023-10-09T06:54:22.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.432+0000 7f0e3bfff700 1 -- start start 2023-10-09T06:54:22.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.433+0000 7f0e3bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0e3c0b03c0 0x7f0e3c0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:22.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.433+0000 7f0e3bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e3c1591e0 0x7f0e3c159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:22.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.433+0000 7f0e3bfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3c0cfa00 con 0x7f0e3c0b0790 2023-10-09T06:54:22.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.433+0000 7f0e3bfff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3c0cb580 con 0x7f0e3c0b03c0 2023-10-09T06:54:22.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.433+0000 7f0e3bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0cf160 con 0x7f0e3c1591e0 2023-10-09T06:54:22.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.433+0000 7f0e3affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0e3c0b03c0 0x7f0e3c0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:22.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.433+0000 7f0e3affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0e3c0b03c0 0x7f0e3c0cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58554/0 (socket says 172.21.15.71:58554) 2023-10-09T06:54:22.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.433+0000 7f0e3affd700 1 -- 172.21.15.71:0/2142862180 learned_addr learned my addr 172.21.15.71:0/2142862180 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:22.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.434+0000 7f0e3b7fe700 1 --2- 172.21.15.71:0/2142862180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e3c1591e0 0x7f0e3c159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:22.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.434+0000 7f0e3affd700 1 -- 172.21.15.71:0/2142862180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e3c1591e0 msgr2=0x7f0e3c159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:22.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.434+0000 7f0e3affd700 1 --2- 172.21.15.71:0/2142862180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e3c1591e0 0x7f0e3c159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:22.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.434+0000 7f0e3affd700 1 -- 172.21.15.71:0/2142862180 >> v1:172.21.15.179:6789/0 conn(0x7f0e3c0b0790 legacy=0x7f0e3c0b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:22.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.434+0000 7f0e3affd700 1 -- 172.21.15.71:0/2142862180 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c0cf440 con 0x7f0e3c0b03c0 2023-10-09T06:54:22.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.434+0000 7f0e3affd700 1 --2- 172.21.15.71:0/2142862180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e3c0b03c0 0x7f0e3c0cea70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0099e0 tx=0x7f0e2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5a0469164a1371 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:22.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.434+0000 7f0e39ffb700 1 -- 172.21.15.71:0/2142862180 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c00b820 con 0x7f0e3c0b03c0 2023-10-09T06:54:22.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.434+0000 7f0e39ffb700 1 -- 172.21.15.71:0/2142862180 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2c00b980 con 0x7f0e3c0b03c0 2023-10-09T06:54:22.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.434+0000 7f0e39ffb700 1 -- 172.21.15.71:0/2142862180 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c00bd20 con 0x7f0e3c0b03c0 2023-10-09T06:54:22.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.435+0000 7f0e3bfff700 1 -- 172.21.15.71:0/2142862180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e3c0b03c0 msgr2=0x7f0e3c0cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:22.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.435+0000 7f0e3bfff700 1 --2- 172.21.15.71:0/2142862180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e3c0b03c0 0x7f0e3c0cea70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0099e0 tx=0x7f0e2c009250 comp rx=0 tx=0).stop 2023-10-09T06:54:22.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.435+0000 7f0e3bfff700 1 -- 172.21.15.71:0/2142862180 shutdown_connections 2023-10-09T06:54:22.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.435+0000 7f0e3bfff700 1 --2- 172.21.15.71:0/2142862180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e3c1591e0 0x7f0e3c159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:22.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.435+0000 7f0e3bfff700 1 --2- 172.21.15.71:0/2142862180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e3c0b03c0 0x7f0e3c0cea70 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:22.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.435+0000 7f0e3bfff700 1 -- 172.21.15.71:0/2142862180 >> 172.21.15.71:0/2142862180 conn(0x7f0e3c063230 msgr2=0x7f0e3c063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:22.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.435+0000 7f0e3bfff700 1 -- 172.21.15.71:0/2142862180 shutdown_connections 2023-10-09T06:54:22.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.435+0000 7f0e3bfff700 1 -- 172.21.15.71:0/2142862180 wait complete. 2023-10-09T06:54:22.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.436+0000 7f0e3bfff700 1 Processor -- start 2023-10-09T06:54:22.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.437+0000 7f0e3bfff700 1 -- start start 2023-10-09T06:54:22.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.437+0000 7f0e3bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e3c0b03c0 0x7f0e3c0af5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:22.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.437+0000 7f0e3bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e3c0b0790 0x7f0e3c069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:22.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.437+0000 7f0e3bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e3c1591e0 0x7f0e3c0698a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:22.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.437+0000 7f0e3bfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0c7030 con 0x7f0e3c1591e0 2023-10-09T06:54:22.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.437+0000 7f0e3bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0c7310 con 0x7f0e3c0b03c0 2023-10-09T06:54:22.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.437+0000 7f0e3bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c1596c0 con 0x7f0e3c0b0790 2023-10-09T06:54:22.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.438+0000 7f0e3b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e3c1591e0 0x7f0e3c0698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:22.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.438+0000 7f0e3b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e3c1591e0 0x7f0e3c0698a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58566/0 (socket says 172.21.15.71:58566) 2023-10-09T06:54:22.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.438+0000 7f0e3b7fe700 1 -- 172.21.15.71:0/3711032184 learned_addr learned my addr 172.21.15.71:0/3711032184 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:22.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.438+0000 7f0e3affd700 1 --2- 172.21.15.71:0/3711032184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e3c0b03c0 0x7f0e3c0af5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:22.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.438+0000 7f0e3a7fc700 1 --2- 172.21.15.71:0/3711032184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e3c0b0790 0x7f0e3c069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:22.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.438+0000 7f0e3b7fe700 1 -- 172.21.15.71:0/3711032184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e3c0b0790 msgr2=0x7f0e3c069360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:22.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.438+0000 7f0e3b7fe700 1 --2- 172.21.15.71:0/3711032184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e3c0b0790 0x7f0e3c069360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:22.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.438+0000 7f0e3b7fe700 1 -- 172.21.15.71:0/3711032184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e3c0b03c0 msgr2=0x7f0e3c0af5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:22.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.438+0000 7f0e3b7fe700 1 --2- 172.21.15.71:0/3711032184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e3c0b03c0 0x7f0e3c0af5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:22.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.438+0000 7f0e3b7fe700 1 -- 172.21.15.71:0/3711032184 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2c0094f0 con 0x7f0e3c1591e0 2023-10-09T06:54:22.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.438+0000 7f0e3b7fe700 1 --2- 172.21.15.71:0/3711032184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e3c1591e0 0x7f0e3c0698a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0e34007f20 tx=0x7f0e34009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:22.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.439+0000 7f0e22ffd700 1 -- 172.21.15.71:0/3711032184 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3400ebf0 con 0x7f0e3c1591e0 2023-10-09T06:54:22.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.439+0000 7f0e22ffd700 1 -- 172.21.15.71:0/3711032184 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3400ed70 con 0x7f0e3c1591e0 2023-10-09T06:54:22.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.439+0000 7f0e3bfff700 1 -- 172.21.15.71:0/3711032184 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3c1599a0 con 0x7f0e3c1591e0 2023-10-09T06:54:22.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.439+0000 7f0e22ffd700 1 -- 172.21.15.71:0/3711032184 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34014670 con 0x7f0e3c1591e0 2023-10-09T06:54:22.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.439+0000 7f0e3bfff700 1 -- 172.21.15.71:0/3711032184 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3c0c6300 con 0x7f0e3c1591e0 2023-10-09T06:54:22.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.440+0000 7f0e3bfff700 1 -- 172.21.15.71:0/3711032184 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3c159ec0 con 0x7f0e3c1591e0 2023-10-09T06:54:22.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.441+0000 7f0e22ffd700 1 -- 172.21.15.71:0/3711032184 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f0e340149e0 con 0x7f0e3c1591e0 2023-10-09T06:54:22.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.441+0000 7f0e22ffd700 1 --2- 172.21.15.71:0/3711032184 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0e28067130 0x7f0e280695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:22.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.442+0000 7f0e22ffd700 1 -- 172.21.15.71:0/3711032184 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f0e34085080 con 0x7f0e3c1591e0 2023-10-09T06:54:22.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.442+0000 7f0e3affd700 1 --2- 172.21.15.71:0/3711032184 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0e28067130 0x7f0e280695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:22.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.443+0000 7f0e3affd700 1 --2- 172.21.15.71:0/3711032184 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0e28067130 0x7f0e280695e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0099e0 tx=0x7f0e2c017000 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:22.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.446+0000 7f0e22ffd700 1 -- 172.21.15.71:0/3711032184 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e3c159ec0 con 0x7f0e3c1591e0 2023-10-09T06:54:22.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.661+0000 7f0e3bfff700 1 -- 172.21.15.71:0/3711032184 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e3c159ec0 con 0x7f0e28067130 2023-10-09T06:54:22.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.736+0000 7f0e22ffd700 1 -- 172.21.15.71:0/3711032184 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f0e3c159ec0 con 0x7f0e28067130 2023-10-09T06:54:22.738 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule deactivated for path /snap_test_dir1/dir4 2023-10-09T06:54:22.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.739+0000 7f0e3bfff700 1 -- 172.21.15.71:0/3711032184 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0e28067130 msgr2=0x7f0e280695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:22.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.739+0000 7f0e3bfff700 1 --2- 172.21.15.71:0/3711032184 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0e28067130 0x7f0e280695e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0099e0 tx=0x7f0e2c017000 comp rx=0 tx=0).stop 2023-10-09T06:54:22.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.739+0000 7f0e3bfff700 1 -- 172.21.15.71:0/3711032184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e3c1591e0 msgr2=0x7f0e3c0698a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:22.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.739+0000 7f0e3bfff700 1 --2- 172.21.15.71:0/3711032184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e3c1591e0 0x7f0e3c0698a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0e34007f20 tx=0x7f0e34009860 comp rx=0 tx=0).stop 2023-10-09T06:54:22.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.739+0000 7f0e3bfff700 1 -- 172.21.15.71:0/3711032184 shutdown_connections 2023-10-09T06:54:22.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.739+0000 7f0e3bfff700 1 --2- 172.21.15.71:0/3711032184 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0e28067130 0x7f0e280695e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:22.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.739+0000 7f0e3bfff700 1 --2- 172.21.15.71:0/3711032184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e3c1591e0 0x7f0e3c0698a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:22.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.739+0000 7f0e3bfff700 1 --2- 172.21.15.71:0/3711032184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e3c0b03c0 0x7f0e3c0af5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:22.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.739+0000 7f0e3bfff700 1 --2- 172.21.15.71:0/3711032184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e3c0b0790 0x7f0e3c069360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:22.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.739+0000 7f0e3bfff700 1 -- 172.21.15.71:0/3711032184 >> 172.21.15.71:0/3711032184 conn(0x7f0e3c063230 msgr2=0x7f0e3c0cba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:22.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.739+0000 7f0e3bfff700 1 -- 172.21.15.71:0/3711032184 shutdown_connections 2023-10-09T06:54:22.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.739+0000 7f0e3bfff700 1 -- 172.21.15.71:0/3711032184 wait complete. 2023-10-09T06:54:22.757 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir4 2023-10-09T06:54:22.757 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir5 1M 2023-10-09T06:54:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.943+0000 7f25603ff700 1 Processor -- start 2023-10-09T06:54:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.944+0000 7f25603ff700 1 -- start start 2023-10-09T06:54:22.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.945+0000 7f25603ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2558159ec0 0x7f25580b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:22.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.945+0000 7f25603ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f25580cf350 0x7f25580cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:22.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.945+0000 7f25603ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25580b5b00 con 0x7f25580b53d0 2023-10-09T06:54:22.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.945+0000 7f25603ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25580b5850 con 0x7f25580cf350 2023-10-09T06:54:22.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.945+0000 7f25603ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25580b5da0 con 0x7f2558159ec0 2023-10-09T06:54:22.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.945+0000 7f255e99c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f25580cf350 0x7f25580cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:22.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.945+0000 7f255e99c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f25580cf350 0x7f25580cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58570/0 (socket says 172.21.15.71:58570) 2023-10-09T06:54:22.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.945+0000 7f255e99c700 1 -- 172.21.15.71:0/3920307977 learned_addr learned my addr 172.21.15.71:0/3920307977 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:22.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.945+0000 7f255e19b700 1 --2- 172.21.15.71:0/3920307977 >> v2:172.21.15.179:3300/0 conn(0x7f2558159ec0 0x7f25580b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:22.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.945+0000 7f255e99c700 1 -- 172.21.15.71:0/3920307977 >> v2:172.21.15.179:3300/0 conn(0x7f2558159ec0 msgr2=0x7f25580b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:22.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.945+0000 7f255e99c700 1 --2- 172.21.15.71:0/3920307977 >> v2:172.21.15.179:3300/0 conn(0x7f2558159ec0 0x7f25580b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:22.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.946+0000 7f255e99c700 1 -- 172.21.15.71:0/3920307977 >> v1:172.21.15.179:6789/0 conn(0x7f25580b53d0 legacy=0x7f25580cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:22.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.946+0000 7f255e99c700 1 -- 172.21.15.71:0/3920307977 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25580b6080 con 0x7f25580cf350 2023-10-09T06:54:22.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.946+0000 7f255e19b700 1 --2- 172.21.15.71:0/3920307977 >> v2:172.21.15.179:3300/0 conn(0x7f2558159ec0 0x7f25580b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:54:22.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.946+0000 7f255e99c700 1 --2- 172.21.15.71:0/3920307977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25580cf350 0x7f25580cd010 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2558089120 tx=0x7f2550009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4d8820af150cef server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:22.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.946+0000 7f255d199700 1 -- 172.21.15.71:0/3920307977 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255000e070 con 0x7f25580cf350 2023-10-09T06:54:22.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.946+0000 7f255d199700 1 -- 172.21.15.71:0/3920307977 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255000ba50 con 0x7f25580cf350 2023-10-09T06:54:22.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.946+0000 7f255d199700 1 -- 172.21.15.71:0/3920307977 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25500092e0 con 0x7f25580cf350 2023-10-09T06:54:22.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.947+0000 7f25603ff700 1 -- 172.21.15.71:0/3920307977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25580cf350 msgr2=0x7f25580cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:22.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.947+0000 7f25603ff700 1 --2- 172.21.15.71:0/3920307977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25580cf350 0x7f25580cd010 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2558089120 tx=0x7f2550009840 comp rx=0 tx=0).stop 2023-10-09T06:54:22.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.947+0000 7f25603ff700 1 -- 172.21.15.71:0/3920307977 shutdown_connections 2023-10-09T06:54:22.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.947+0000 7f25603ff700 1 --2- 172.21.15.71:0/3920307977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25580cf350 0x7f25580cd010 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:22.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.947+0000 7f25603ff700 1 --2- 172.21.15.71:0/3920307977 >> v2:172.21.15.179:3300/0 conn(0x7f2558159ec0 0x7f25580b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:22.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.947+0000 7f25603ff700 1 -- 172.21.15.71:0/3920307977 >> 172.21.15.71:0/3920307977 conn(0x7f25580999f0 msgr2=0x7f25580b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:22.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.947+0000 7f25603ff700 1 -- 172.21.15.71:0/3920307977 shutdown_connections 2023-10-09T06:54:22.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.947+0000 7f25603ff700 1 -- 172.21.15.71:0/3920307977 wait complete. 2023-10-09T06:54:22.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.948+0000 7f25603ff700 1 Processor -- start 2023-10-09T06:54:22.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.948+0000 7f25603ff700 1 -- start start 2023-10-09T06:54:22.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.949+0000 7f25603ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25580b53d0 0x7f255809b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:22.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.949+0000 7f25603ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25580cf350 0x7f2558151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:22.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.949+0000 7f25603ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2558159ec0 0x7f25580c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:22.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.949+0000 7f25603ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255809d9c0 con 0x7f2558159ec0 2023-10-09T06:54:22.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.949+0000 7f25603ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255809cdb0 con 0x7f25580cf350 2023-10-09T06:54:22.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.949+0000 7f25603ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255809d090 con 0x7f25580b53d0 2023-10-09T06:54:22.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.949+0000 7f255e99c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2558159ec0 0x7f25580c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:22.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.949+0000 7f255e99c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2558159ec0 0x7f25580c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58578/0 (socket says 172.21.15.71:58578) 2023-10-09T06:54:22.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.949+0000 7f255e99c700 1 -- 172.21.15.71:0/3764936908 learned_addr learned my addr 172.21.15.71:0/3764936908 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:22.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.950+0000 7f255d99a700 1 --2- 172.21.15.71:0/3764936908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25580cf350 0x7f2558151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:22.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.950+0000 7f255e19b700 1 --2- 172.21.15.71:0/3764936908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25580b53d0 0x7f255809b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:22.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.950+0000 7f255e99c700 1 -- 172.21.15.71:0/3764936908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25580b53d0 msgr2=0x7f255809b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:22.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.950+0000 7f255e99c700 1 --2- 172.21.15.71:0/3764936908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25580b53d0 0x7f255809b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:22.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.950+0000 7f255e99c700 1 -- 172.21.15.71:0/3764936908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25580cf350 msgr2=0x7f2558151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:22.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.950+0000 7f255e99c700 1 --2- 172.21.15.71:0/3764936908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25580cf350 0x7f2558151060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:22.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.950+0000 7f255e99c700 1 -- 172.21.15.71:0/3764936908 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2550009ae0 con 0x7f2558159ec0 2023-10-09T06:54:22.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.950+0000 7f255e99c700 1 --2- 172.21.15.71:0/3764936908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2558159ec0 0x7f25580c8a30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2558089390 tx=0x7f2550018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:22.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.950+0000 7f254e7fc700 1 -- 172.21.15.71:0/3764936908 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255000be60 con 0x7f2558159ec0 2023-10-09T06:54:22.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.950+0000 7f254e7fc700 1 -- 172.21.15.71:0/3764936908 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2550008ce0 con 0x7f2558159ec0 2023-10-09T06:54:22.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.950+0000 7f25603ff700 1 -- 172.21.15.71:0/3764936908 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f255809d370 con 0x7f2558159ec0 2023-10-09T06:54:22.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.951+0000 7f254e7fc700 1 -- 172.21.15.71:0/3764936908 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25500266b0 con 0x7f2558159ec0 2023-10-09T06:54:22.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.951+0000 7f25603ff700 1 -- 172.21.15.71:0/3764936908 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25581515a0 con 0x7f2558159ec0 2023-10-09T06:54:22.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.952+0000 7f25603ff700 1 -- 172.21.15.71:0/3764936908 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255809db70 con 0x7f2558159ec0 2023-10-09T06:54:22.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.953+0000 7f254e7fc700 1 -- 172.21.15.71:0/3764936908 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f2550003040 con 0x7f2558159ec0 2023-10-09T06:54:22.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.953+0000 7f254e7fc700 1 --2- 172.21.15.71:0/3764936908 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f253c067130 0x7f253c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:22.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.953+0000 7f254e7fc700 1 -- 172.21.15.71:0/3764936908 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f2550086390 con 0x7f2558159ec0 2023-10-09T06:54:22.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.954+0000 7f255e19b700 1 --2- 172.21.15.71:0/3764936908 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f253c067130 0x7f253c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:22.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.954+0000 7f255e19b700 1 --2- 172.21.15.71:0/3764936908 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f253c067130 0x7f253c0695e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2554006ea0 tx=0x7f2554008040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:22.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:22.957+0000 7f254e7fc700 1 -- 172.21.15.71:0/3764936908 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f255809db70 con 0x7f2558159ec0 2023-10-09T06:54:23.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.174+0000 7f25603ff700 1 -- 172.21.15.71:0/3764936908 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2558063c90 con 0x7f253c067130 2023-10-09T06:54:23.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.248+0000 7f254e7fc700 1 -- 172.21.15.71:0/3764936908 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f2558063c90 con 0x7f253c067130 2023-10-09T06:54:23.249 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule deactivated for path /snap_test_dir1/dir5 2023-10-09T06:54:23.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.250+0000 7f25603ff700 1 -- 172.21.15.71:0/3764936908 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f253c067130 msgr2=0x7f253c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:23.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.250+0000 7f25603ff700 1 --2- 172.21.15.71:0/3764936908 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f253c067130 0x7f253c0695e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2554006ea0 tx=0x7f2554008040 comp rx=0 tx=0).stop 2023-10-09T06:54:23.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.250+0000 7f25603ff700 1 -- 172.21.15.71:0/3764936908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2558159ec0 msgr2=0x7f25580c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:23.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.250+0000 7f25603ff700 1 --2- 172.21.15.71:0/3764936908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2558159ec0 0x7f25580c8a30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2558089390 tx=0x7f2550018000 comp rx=0 tx=0).stop 2023-10-09T06:54:23.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.251+0000 7f25603ff700 1 -- 172.21.15.71:0/3764936908 shutdown_connections 2023-10-09T06:54:23.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.251+0000 7f25603ff700 1 --2- 172.21.15.71:0/3764936908 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f253c067130 0x7f253c0695e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:23.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.251+0000 7f25603ff700 1 --2- 172.21.15.71:0/3764936908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2558159ec0 0x7f25580c8a30 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:23.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.251+0000 7f25603ff700 1 --2- 172.21.15.71:0/3764936908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25580b53d0 0x7f255809b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:23.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.251+0000 7f25603ff700 1 --2- 172.21.15.71:0/3764936908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25580cf350 0x7f2558151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:23.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.251+0000 7f25603ff700 1 -- 172.21.15.71:0/3764936908 >> 172.21.15.71:0/3764936908 conn(0x7f25580999f0 msgr2=0x7f25580d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:23.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.251+0000 7f25603ff700 1 -- 172.21.15.71:0/3764936908 shutdown_connections 2023-10-09T06:54:23.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.251+0000 7f25603ff700 1 -- 172.21.15.71:0/3764936908 wait complete. 2023-10-09T06:54:23.268 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir5 2023-10-09T06:54:23.269 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir6 1M 2023-10-09T06:54:23.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.453+0000 7f6688dff700 1 Processor -- start 2023-10-09T06:54:23.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.453+0000 7f6688dff700 1 -- start start 2023-10-09T06:54:23.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.455+0000 7f6688dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66840685e0 0x7f6684150120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:23.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.455+0000 7f6688dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f66840689b0 0x7f6684150660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:23.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.455+0000 7f6688dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6684150ba0 0x7f6684069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:23.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.455+0000 7f6688dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668415da10 con 0x7f6684150ba0 2023-10-09T06:54:23.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.455+0000 7f6688dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668415dcb0 con 0x7f66840689b0 2023-10-09T06:54:23.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.455+0000 7f6688dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668415df90 con 0x7f66840685e0 2023-10-09T06:54:23.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.455+0000 7f6682d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6684150ba0 0x7f6684069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:23.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.455+0000 7f6682d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6684150ba0 0x7f6684069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58580/0 (socket says 172.21.15.71:58580) 2023-10-09T06:54:23.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.455+0000 7f6682d9d700 1 -- 172.21.15.71:0/3595416917 learned_addr learned my addr 172.21.15.71:0/3595416917 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:23.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.455+0000 7f6681d9b700 1 --2- 172.21.15.71:0/3595416917 >> v2:172.21.15.179:3300/0 conn(0x7f66840689b0 0x7f6684150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:23.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.455+0000 7f6682d9d700 1 -- 172.21.15.71:0/3595416917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66840685e0 msgr2=0x7f6684150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:23.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.455+0000 7f668259c700 1 --2- 172.21.15.71:0/3595416917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66840685e0 0x7f6684150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:23.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.455+0000 7f6682d9d700 1 --2- 172.21.15.71:0/3595416917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66840685e0 0x7f6684150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:23.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.455+0000 7f6682d9d700 1 -- 172.21.15.71:0/3595416917 >> v2:172.21.15.179:3300/0 conn(0x7f66840689b0 msgr2=0x7f6684150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:23.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.455+0000 7f6682d9d700 1 --2- 172.21.15.71:0/3595416917 >> v2:172.21.15.179:3300/0 conn(0x7f66840689b0 0x7f6684150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:23.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.455+0000 7f6682d9d700 1 -- 172.21.15.71:0/3595416917 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668415e270 con 0x7f6684150ba0 2023-10-09T06:54:23.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.455+0000 7f6681d9b700 1 --2- 172.21.15.71:0/3595416917 >> v2:172.21.15.179:3300/0 conn(0x7f66840689b0 0x7f6684150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:54:23.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.455+0000 7f668259c700 1 --2- 172.21.15.71:0/3595416917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66840685e0 0x7f6684150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:54:23.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.456+0000 7f6682d9d700 1 --2- 172.21.15.71:0/3595416917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6684150ba0 0x7f6684069800 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f668406a920 tx=0x7f667c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf6e9188ea79afa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:23.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.456+0000 7f668159a700 1 -- 172.21.15.71:0/3595416917 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c00e070 con 0x7f6684150ba0 2023-10-09T06:54:23.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.456+0000 7f668159a700 1 -- 172.21.15.71:0/3595416917 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c00bae0 con 0x7f6684150ba0 2023-10-09T06:54:23.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.456+0000 7f668159a700 1 -- 172.21.15.71:0/3595416917 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c0092e0 con 0x7f6684150ba0 2023-10-09T06:54:23.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.456+0000 7f6688dff700 1 -- 172.21.15.71:0/3595416917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6684150ba0 msgr2=0x7f6684069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:23.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.456+0000 7f6688dff700 1 --2- 172.21.15.71:0/3595416917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6684150ba0 0x7f6684069800 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f668406a920 tx=0x7f667c009840 comp rx=0 tx=0).stop 2023-10-09T06:54:23.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.456+0000 7f6688dff700 1 -- 172.21.15.71:0/3595416917 shutdown_connections 2023-10-09T06:54:23.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.456+0000 7f6688dff700 1 --2- 172.21.15.71:0/3595416917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6684150ba0 0x7f6684069800 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:23.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.456+0000 7f6688dff700 1 --2- 172.21.15.71:0/3595416917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66840685e0 0x7f6684150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:23.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.456+0000 7f6688dff700 1 --2- 172.21.15.71:0/3595416917 >> v2:172.21.15.179:3300/0 conn(0x7f66840689b0 0x7f6684150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:23.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.456+0000 7f6688dff700 1 -- 172.21.15.71:0/3595416917 >> 172.21.15.71:0/3595416917 conn(0x7f66840c8f90 msgr2=0x7f66840c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:23.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.457+0000 7f6688dff700 1 -- 172.21.15.71:0/3595416917 shutdown_connections 2023-10-09T06:54:23.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.457+0000 7f6688dff700 1 -- 172.21.15.71:0/3595416917 wait complete. 2023-10-09T06:54:23.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.458+0000 7f6688dff700 1 Processor -- start 2023-10-09T06:54:23.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.458+0000 7f6688dff700 1 -- start start 2023-10-09T06:54:23.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.459+0000 7f6688dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66840685e0 0x7f66840ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:23.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.459+0000 7f6688dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66840689b0 0x7f6684151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:23.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.459+0000 7f6688dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6684150ba0 0x7f6684151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:23.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.459+0000 7f6688dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66840ae1b0 con 0x7f66840689b0 2023-10-09T06:54:23.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.459+0000 7f6688dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66840adbf0 con 0x7f66840685e0 2023-10-09T06:54:23.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.459+0000 7f6688dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66840aded0 con 0x7f6684150ba0 2023-10-09T06:54:23.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.459+0000 7f6681d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66840689b0 0x7f6684151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:23.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.459+0000 7f6681d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66840689b0 0x7f6684151020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58584/0 (socket says 172.21.15.71:58584) 2023-10-09T06:54:23.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.459+0000 7f6681d9b700 1 -- 172.21.15.71:0/3711801092 learned_addr learned my addr 172.21.15.71:0/3711801092 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:23.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.460+0000 7f668259c700 1 --2- 172.21.15.71:0/3711801092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66840685e0 0x7f66840ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:23.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.460+0000 7f6682d9d700 1 --2- 172.21.15.71:0/3711801092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6684150ba0 0x7f6684151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:23.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.460+0000 7f6681d9b700 1 -- 172.21.15.71:0/3711801092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6684150ba0 msgr2=0x7f6684151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:23.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.460+0000 7f6681d9b700 1 --2- 172.21.15.71:0/3711801092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6684150ba0 0x7f6684151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:23.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.460+0000 7f6681d9b700 1 -- 172.21.15.71:0/3711801092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66840685e0 msgr2=0x7f66840ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:23.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.460+0000 7f6681d9b700 1 --2- 172.21.15.71:0/3711801092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66840685e0 0x7f66840ae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:23.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.460+0000 7f6681d9b700 1 -- 172.21.15.71:0/3711801092 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c009ae0 con 0x7f66840689b0 2023-10-09T06:54:23.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.460+0000 7f6681d9b700 1 --2- 172.21.15.71:0/3711801092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66840689b0 0x7f6684151020 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f667800c830 tx=0x7f6678008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:23.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.460+0000 7f66727fc700 1 -- 172.21.15.71:0/3711801092 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678011600 con 0x7f66840689b0 2023-10-09T06:54:23.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.460+0000 7f66727fc700 1 -- 172.21.15.71:0/3711801092 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6678011760 con 0x7f66840689b0 2023-10-09T06:54:23.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.460+0000 7f6688dff700 1 -- 172.21.15.71:0/3711801092 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66840acd70 con 0x7f66840689b0 2023-10-09T06:54:23.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.460+0000 7f66727fc700 1 -- 172.21.15.71:0/3711801092 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678011b20 con 0x7f66840689b0 2023-10-09T06:54:23.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.460+0000 7f6688dff700 1 -- 172.21.15.71:0/3711801092 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66840ad570 con 0x7f66840689b0 2023-10-09T06:54:23.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.461+0000 7f6688dff700 1 -- 172.21.15.71:0/3711801092 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66840718b0 con 0x7f66840689b0 2023-10-09T06:54:23.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.462+0000 7f66727fc700 1 -- 172.21.15.71:0/3711801092 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f667800a3e0 con 0x7f66840689b0 2023-10-09T06:54:23.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.463+0000 7f66727fc700 1 --2- 172.21.15.71:0/3711801092 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6664067130 0x7f66640695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:23.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.463+0000 7f66727fc700 1 -- 172.21.15.71:0/3711801092 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f6678084fd0 con 0x7f66840689b0 2023-10-09T06:54:23.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.463+0000 7f668259c700 1 --2- 172.21.15.71:0/3711801092 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6664067130 0x7f66640695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:23.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.464+0000 7f668259c700 1 --2- 172.21.15.71:0/3711801092 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6664067130 0x7f66640695e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f667400ab30 tx=0x7f6674008040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:23.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.467+0000 7f66727fc700 1 -- 172.21.15.71:0/3711801092 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6678051d10 con 0x7f66840689b0 2023-10-09T06:54:23.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.683+0000 7f6688dff700 1 -- 172.21.15.71:0/3711801092 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f66841578f0 con 0x7f6664067130 2023-10-09T06:54:23.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.753+0000 7f66727fc700 1 -- 172.21.15.71:0/3711801092 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f66841578f0 con 0x7f6664067130 2023-10-09T06:54:23.755 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule deactivated for path /snap_test_dir1/dir6 2023-10-09T06:54:23.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.756+0000 7f6688dff700 1 -- 172.21.15.71:0/3711801092 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6664067130 msgr2=0x7f66640695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:23.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.756+0000 7f6688dff700 1 --2- 172.21.15.71:0/3711801092 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6664067130 0x7f66640695e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f667400ab30 tx=0x7f6674008040 comp rx=0 tx=0).stop 2023-10-09T06:54:23.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.756+0000 7f6688dff700 1 -- 172.21.15.71:0/3711801092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66840689b0 msgr2=0x7f6684151020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:23.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.756+0000 7f6688dff700 1 --2- 172.21.15.71:0/3711801092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66840689b0 0x7f6684151020 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f667800c830 tx=0x7f6678008040 comp rx=0 tx=0).stop 2023-10-09T06:54:23.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.756+0000 7f6688dff700 1 -- 172.21.15.71:0/3711801092 shutdown_connections 2023-10-09T06:54:23.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.756+0000 7f6688dff700 1 --2- 172.21.15.71:0/3711801092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6684150ba0 0x7f6684151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:23.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.756+0000 7f6688dff700 1 --2- 172.21.15.71:0/3711801092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66840685e0 0x7f66840ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:23.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.756+0000 7f6688dff700 1 --2- 172.21.15.71:0/3711801092 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6664067130 0x7f66640695e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:23.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.756+0000 7f6688dff700 1 --2- 172.21.15.71:0/3711801092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66840689b0 0x7f6684151020 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:23.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.756+0000 7f6688dff700 1 -- 172.21.15.71:0/3711801092 >> 172.21.15.71:0/3711801092 conn(0x7f66840c8f90 msgr2=0x7f66840ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:23.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.756+0000 7f6688dff700 1 -- 172.21.15.71:0/3711801092 shutdown_connections 2023-10-09T06:54:23.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.756+0000 7f6688dff700 1 -- 172.21.15.71:0/3711801092 wait complete. 2023-10-09T06:54:23.774 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir6 2023-10-09T06:54:23.775 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir7 1M 2023-10-09T06:54:23.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.958+0000 7f359cfff700 1 Processor -- start 2023-10-09T06:54:23.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.958+0000 7f359cfff700 1 -- start start 2023-10-09T06:54:23.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.960+0000 7f359cfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f35980c8490 0x7f35980c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:23.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.960+0000 7f359cfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3598069e20 0x7f35981569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:23.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.960+0000 7f359cfff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35980ac030 con 0x7f3598069a50 2023-10-09T06:54:23.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.960+0000 7f359cfff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35980ab820 con 0x7f35980c8490 2023-10-09T06:54:23.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.960+0000 7f359cfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359806dbb0 con 0x7f3598069e20 2023-10-09T06:54:23.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.960+0000 7f359659c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3598069a50 0x7f359815a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46398/0 (socket says 172.21.15.71:46398) 2023-10-09T06:54:23.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.960+0000 7f3595d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f35980c8490 0x7f35980c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:23.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.960+0000 7f359659c700 1 -- 172.21.15.71:0/1078122036 learned_addr learned my addr 172.21.15.71:0/1078122036 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:23.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.960+0000 7f3596d9d700 1 --2- 172.21.15.71:0/1078122036 >> v2:172.21.15.179:3300/0 conn(0x7f3598069e20 0x7f35981569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:23.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.960+0000 7f3595d9b700 1 -- 172.21.15.71:0/1078122036 >> v2:172.21.15.179:3300/0 conn(0x7f3598069e20 msgr2=0x7f35981569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:23.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.960+0000 7f3595d9b700 1 --2- 172.21.15.71:0/1078122036 >> v2:172.21.15.179:3300/0 conn(0x7f3598069e20 0x7f35981569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:23.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.960+0000 7f3595d9b700 1 -- 172.21.15.71:0/1078122036 >> v1:172.21.15.71:6789/0 conn(0x7f3598069a50 legacy=0x7f359815a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:23.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.960+0000 7f3595d9b700 1 -- 172.21.15.71:0/1078122036 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35980aba70 con 0x7f35980c8490 2023-10-09T06:54:23.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.960+0000 7f3596d9d700 1 --2- 172.21.15.71:0/1078122036 >> v2:172.21.15.179:3300/0 conn(0x7f3598069e20 0x7f35981569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:54:23.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.960+0000 7f359559a700 1 -- 172.21.15.71:0/1078122036 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101889875 0 0) 0x7f3588001110 con 0x7f3598069a50 2023-10-09T06:54:23.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.961+0000 7f3595d9b700 1 --2- 172.21.15.71:0/1078122036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980c8490 0x7f35980c6ac0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f359806db20 tx=0x7f358c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44409c914accc185 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:23.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.961+0000 7f359559a700 1 -- 172.21.15.71:0/1078122036 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c00b6b0 con 0x7f35980c8490 2023-10-09T06:54:23.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.961+0000 7f359559a700 1 -- 172.21.15.71:0/1078122036 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c00b810 con 0x7f35980c8490 2023-10-09T06:54:23.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.961+0000 7f359559a700 1 -- 172.21.15.71:0/1078122036 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c00bbb0 con 0x7f35980c8490 2023-10-09T06:54:23.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.961+0000 7f359cfff700 1 -- 172.21.15.71:0/1078122036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980c8490 msgr2=0x7f35980c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:23.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.961+0000 7f359cfff700 1 --2- 172.21.15.71:0/1078122036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980c8490 0x7f35980c6ac0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f359806db20 tx=0x7f358c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:23.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.961+0000 7f359cfff700 1 -- 172.21.15.71:0/1078122036 shutdown_connections 2023-10-09T06:54:23.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.961+0000 7f359cfff700 1 --2- 172.21.15.71:0/1078122036 >> v2:172.21.15.179:3300/0 conn(0x7f3598069e20 0x7f35981569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:23.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.961+0000 7f359cfff700 1 --2- 172.21.15.71:0/1078122036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980c8490 0x7f35980c6ac0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:23.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.961+0000 7f359cfff700 1 -- 172.21.15.71:0/1078122036 >> 172.21.15.71:0/1078122036 conn(0x7f35980c8f90 msgr2=0x7f35980c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:23.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.962+0000 7f359cfff700 1 -- 172.21.15.71:0/1078122036 shutdown_connections 2023-10-09T06:54:23.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.962+0000 7f359cfff700 1 -- 172.21.15.71:0/1078122036 wait complete. 2023-10-09T06:54:23.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.963+0000 7f359cfff700 1 Processor -- start 2023-10-09T06:54:23.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.963+0000 7f359cfff700 1 -- start start 2023-10-09T06:54:23.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.964+0000 7f359cfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3598069a50 0x7f35980c3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:23.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.964+0000 7f359cfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3598069e20 0x7f35980c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:23.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.964+0000 7f359cfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980c8490 0x7f3598168ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:23.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.964+0000 7f359cfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35980c5dc0 con 0x7f35980c8490 2023-10-09T06:54:23.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.964+0000 7f359cfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35980c60a0 con 0x7f3598069a50 2023-10-09T06:54:23.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.964+0000 7f359cfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35980c6380 con 0x7f3598069e20 2023-10-09T06:54:23.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.964+0000 7f3596d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980c8490 0x7f3598168ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:23.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.964+0000 7f3596d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980c8490 0x7f3598168ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58608/0 (socket says 172.21.15.71:58608) 2023-10-09T06:54:23.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.964+0000 7f3596d9d700 1 -- 172.21.15.71:0/1715561776 learned_addr learned my addr 172.21.15.71:0/1715561776 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:23.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.964+0000 7f3596d9d700 1 -- 172.21.15.71:0/1715561776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3598069e20 msgr2=0x7f35980c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:23.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.964+0000 7f3596d9d700 1 --2- 172.21.15.71:0/1715561776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3598069e20 0x7f35980c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:23.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.964+0000 7f359659c700 1 --2- 172.21.15.71:0/1715561776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3598069a50 0x7f35980c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:23.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.964+0000 7f3596d9d700 1 -- 172.21.15.71:0/1715561776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3598069a50 msgr2=0x7f35980c3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:23.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.965+0000 7f3596d9d700 1 --2- 172.21.15.71:0/1715561776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3598069a50 0x7f35980c3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:23.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.965+0000 7f3596d9d700 1 -- 172.21.15.71:0/1715561776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c009420 con 0x7f35980c8490 2023-10-09T06:54:23.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.965+0000 7f359659c700 1 --2- 172.21.15.71:0/1715561776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3598069a50 0x7f35980c3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:54:23.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.965+0000 7f3596d9d700 1 --2- 172.21.15.71:0/1715561776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980c8490 0x7f3598168ff0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f359000a380 tx=0x7f3590007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:23.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.965+0000 7f35867fc700 1 -- 172.21.15.71:0/1715561776 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359000ae10 con 0x7f35980c8490 2023-10-09T06:54:23.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.965+0000 7f35867fc700 1 -- 172.21.15.71:0/1715561776 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359000d650 con 0x7f35980c8490 2023-10-09T06:54:23.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.965+0000 7f359cfff700 1 -- 172.21.15.71:0/1715561776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35980c6660 con 0x7f35980c8490 2023-10-09T06:54:23.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.965+0000 7f35867fc700 1 -- 172.21.15.71:0/1715561776 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359000da10 con 0x7f35980c8490 2023-10-09T06:54:23.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.965+0000 7f359cfff700 1 -- 172.21.15.71:0/1715561776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35980c3cc0 con 0x7f35980c8490 2023-10-09T06:54:23.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.966+0000 7f359cfff700 1 -- 172.21.15.71:0/1715561776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35980718b0 con 0x7f35980c8490 2023-10-09T06:54:23.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.967+0000 7f35867fc700 1 -- 172.21.15.71:0/1715561776 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f359001e3b0 con 0x7f35980c8490 2023-10-09T06:54:23.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.969+0000 7f35867fc700 1 --2- 172.21.15.71:0/1715561776 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3578067130 0x7f35780695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:23.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.969+0000 7f35867fc700 1 -- 172.21.15.71:0/1715561776 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f35900853a0 con 0x7f35980c8490 2023-10-09T06:54:23.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.969+0000 7f359659c700 1 --2- 172.21.15.71:0/1715561776 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3578067130 0x7f35780695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:23.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.970+0000 7f359659c700 1 --2- 172.21.15.71:0/1715561776 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3578067130 0x7f35780695e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3588001810 tx=0x7f3588009040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:23.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:23.973+0000 7f35867fc700 1 -- 172.21.15.71:0/1715561776 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3590052290 con 0x7f35980c8490 2023-10-09T06:54:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.189+0000 7f359cfff700 1 -- 172.21.15.71:0/1715561776 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f35980c6210 con 0x7f3578067130 2023-10-09T06:54:24.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.261+0000 7f35867fc700 1 -- 172.21.15.71:0/1715561776 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f35980c6210 con 0x7f3578067130 2023-10-09T06:54:24.262 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule deactivated for path /snap_test_dir1/dir7 2023-10-09T06:54:24.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.264+0000 7f359cfff700 1 -- 172.21.15.71:0/1715561776 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3578067130 msgr2=0x7f35780695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:24.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.264+0000 7f359cfff700 1 --2- 172.21.15.71:0/1715561776 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3578067130 0x7f35780695e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3588001810 tx=0x7f3588009040 comp rx=0 tx=0).stop 2023-10-09T06:54:24.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.264+0000 7f359cfff700 1 -- 172.21.15.71:0/1715561776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980c8490 msgr2=0x7f3598168ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:24.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.264+0000 7f359cfff700 1 --2- 172.21.15.71:0/1715561776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980c8490 0x7f3598168ff0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f359000a380 tx=0x7f3590007900 comp rx=0 tx=0).stop 2023-10-09T06:54:24.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.264+0000 7f359cfff700 1 -- 172.21.15.71:0/1715561776 shutdown_connections 2023-10-09T06:54:24.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.264+0000 7f359cfff700 1 --2- 172.21.15.71:0/1715561776 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3578067130 0x7f35780695e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:24.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.264+0000 7f359cfff700 1 --2- 172.21.15.71:0/1715561776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980c8490 0x7f3598168ff0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:24.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.264+0000 7f359cfff700 1 --2- 172.21.15.71:0/1715561776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3598069a50 0x7f35980c3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:24.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.264+0000 7f359cfff700 1 --2- 172.21.15.71:0/1715561776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3598069e20 0x7f35980c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:24.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.264+0000 7f359cfff700 1 -- 172.21.15.71:0/1715561776 >> 172.21.15.71:0/1715561776 conn(0x7f35980c8f90 msgr2=0x7f35981569e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:24.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.264+0000 7f359cfff700 1 -- 172.21.15.71:0/1715561776 shutdown_connections 2023-10-09T06:54:24.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.264+0000 7f359cfff700 1 -- 172.21.15.71:0/1715561776 wait complete. 2023-10-09T06:54:24.282 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir7 2023-10-09T06:54:24.282 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir8 1M 2023-10-09T06:54:24.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.467+0000 7fdb6b59d700 1 Processor -- start 2023-10-09T06:54:24.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.467+0000 7fdb6b59d700 1 -- start start 2023-10-09T06:54:24.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.468+0000 7fdb6b59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb640cca20 0x7fdb640cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:24.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.468+0000 7fdb6b59d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb640cfa00 con 0x7fdb640b0790 2023-10-09T06:54:24.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.468+0000 7fdb6b59d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb640cb580 con 0x7fdb640b03c0 2023-10-09T06:54:24.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.468+0000 7fdb6b59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640cf160 con 0x7fdb640cca20 2023-10-09T06:54:24.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.468+0000 7fdb69d9a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fdb640b0790 0x7fdb641591e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46400/0 (socket says 172.21.15.71:46400) 2023-10-09T06:54:24.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.468+0000 7fdb69d9a700 1 -- 172.21.15.71:0/1191557895 learned_addr learned my addr 172.21.15.71:0/1191557895 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:24.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.469+0000 7fdb6ad9c700 1 --2- 172.21.15.71:0/1191557895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb640cca20 0x7fdb640cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:24.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.469+0000 7fdb69599700 1 -- 172.21.15.71:0/1191557895 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623317123 0 0) 0x7fdb640cfa00 con 0x7fdb640b0790 2023-10-09T06:54:24.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.469+0000 7fdb69599700 1 -- 172.21.15.71:0/1191557895 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb50003570 con 0x7fdb640b0790 2023-10-09T06:54:24.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.469+0000 7fdb69599700 1 -- 172.21.15.71:0/1191557895 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961265429 0 0) 0x7fdb640cb580 con 0x7fdb640b03c0 2023-10-09T06:54:24.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.469+0000 7fdb69599700 1 -- 172.21.15.71:0/1191557895 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb640cfa00 con 0x7fdb640b03c0 2023-10-09T06:54:24.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.469+0000 7fdb69599700 1 -- 172.21.15.71:0/1191557895 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2852006396 0 0) 0x7fdb50003570 con 0x7fdb640b0790 2023-10-09T06:54:24.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.469+0000 7fdb69599700 1 -- 172.21.15.71:0/1191557895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb640cca20 msgr2=0x7fdb640cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:24.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.469+0000 7fdb69599700 1 --2- 172.21.15.71:0/1191557895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb640cca20 0x7fdb640cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:24.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.469+0000 7fdb69599700 1 -- 172.21.15.71:0/1191557895 >> v1:172.21.15.179:6789/0 conn(0x7fdb640b03c0 legacy=0x7fdb640b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:24.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.469+0000 7fdb69599700 1 -- 172.21.15.71:0/1191557895 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb640cf440 con 0x7fdb640b0790 2023-10-09T06:54:24.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.469+0000 7fdb69599700 1 -- 172.21.15.71:0/1191557895 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fdb54001470 con 0x7fdb640b0790 2023-10-09T06:54:24.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.469+0000 7fdb69599700 1 -- 172.21.15.71:0/1191557895 >> v1:172.21.15.71:6789/0 conn(0x7fdb640b0790 legacy=0x7fdb641591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:24.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.469+0000 7fdb69599700 1 --2- 172.21.15.71:0/1191557895 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb50003c20 0x7fdb50004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:24.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.469+0000 7fdb69599700 1 --2- 172.21.15.71:0/1191557895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb50004810 0x7fdb50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:24.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.469+0000 7fdb69599700 1 --2- 172.21.15.71:0/1191557895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb640cca20 0x7fdb50005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:24.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.469+0000 7fdb69599700 1 -- 172.21.15.71:0/1191557895 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640cf160 con 0x7fdb50004810 2023-10-09T06:54:24.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.469+0000 7fdb69599700 1 -- 172.21.15.71:0/1191557895 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5000bbf0 con 0x7fdb50003c20 2023-10-09T06:54:24.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.469+0000 7fdb69599700 1 -- 172.21.15.71:0/1191557895 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5000bdb0 con 0x7fdb640cca20 2023-10-09T06:54:24.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.470+0000 7fdb69d9a700 1 --2- 172.21.15.71:0/1191557895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb50004810 0x7fdb50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:24.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.470+0000 7fdb6ad9c700 1 --2- 172.21.15.71:0/1191557895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb640cca20 0x7fdb50005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:24.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.470+0000 7fdb6a59b700 1 --2- 172.21.15.71:0/1191557895 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb50003c20 0x7fdb50004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:24.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.470+0000 7fdb69d9a700 1 -- 172.21.15.71:0/1191557895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb640cca20 msgr2=0x7fdb50005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:24.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.470+0000 7fdb69d9a700 1 --2- 172.21.15.71:0/1191557895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb640cca20 0x7fdb50005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:24.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.470+0000 7fdb69d9a700 1 -- 172.21.15.71:0/1191557895 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb50003c20 msgr2=0x7fdb50004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:24.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.470+0000 7fdb69d9a700 1 --2- 172.21.15.71:0/1191557895 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb50003c20 0x7fdb50004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:24.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.470+0000 7fdb69d9a700 1 -- 172.21.15.71:0/1191557895 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb50003570 con 0x7fdb50004810 2023-10-09T06:54:24.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.470+0000 7fdb6a59b700 1 --2- 172.21.15.71:0/1191557895 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb50003c20 0x7fdb50004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:54:24.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.470+0000 7fdb69d9a700 1 --2- 172.21.15.71:0/1191557895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb50004810 0x7fdb50004c80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400c1e0 tx=0x7fdb54001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd4db2841ad726f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:24.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.470+0000 7fdb69599700 1 -- 172.21.15.71:0/1191557895 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5400cb10 con 0x7fdb50004810 2023-10-09T06:54:24.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.470+0000 7fdb69599700 1 -- 172.21.15.71:0/1191557895 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5400cc90 con 0x7fdb50004810 2023-10-09T06:54:24.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.470+0000 7fdb69599700 1 -- 172.21.15.71:0/1191557895 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb54005b70 con 0x7fdb50004810 2023-10-09T06:54:24.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.471+0000 7fdb6b59d700 1 -- 172.21.15.71:0/1191557895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb50004810 msgr2=0x7fdb50004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:24.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.471+0000 7fdb6b59d700 1 --2- 172.21.15.71:0/1191557895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb50004810 0x7fdb50004c80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400c1e0 tx=0x7fdb54001d40 comp rx=0 tx=0).stop 2023-10-09T06:54:24.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.471+0000 7fdb6ad9c700 1 -- 172.21.15.71:0/1191557895 reap_dead start 2023-10-09T06:54:24.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.471+0000 7fdb6b59d700 1 -- 172.21.15.71:0/1191557895 shutdown_connections 2023-10-09T06:54:24.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.471+0000 7fdb6b59d700 1 -- 172.21.15.71:0/1191557895 >> 172.21.15.71:0/1191557895 conn(0x7fdb64063230 msgr2=0x7fdb64063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:24.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.471+0000 7fdb6b59d700 1 -- 172.21.15.71:0/1191557895 shutdown_connections 2023-10-09T06:54:24.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.471+0000 7fdb6b59d700 1 -- 172.21.15.71:0/1191557895 wait complete. 2023-10-09T06:54:24.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.472+0000 7fdb6b59d700 1 Processor -- start 2023-10-09T06:54:24.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.472+0000 7fdb6b59d700 1 -- start start 2023-10-09T06:54:24.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.473+0000 7fdb6b59d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb50004810 0x7fdb64169f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:24.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.473+0000 7fdb6b59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb6416e160 0x7fdb6416cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:24.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.473+0000 7fdb6b59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb640a8940 0x7fdb640b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:24.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.473+0000 7fdb6b59d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6415c3b0 con 0x7fdb50004810 2023-10-09T06:54:24.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.473+0000 7fdb6b59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640a7000 con 0x7fdb640a8940 2023-10-09T06:54:24.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.473+0000 7fdb6b59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6416a480 con 0x7fdb6416e160 2023-10-09T06:54:24.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.474+0000 7fdb6a59b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb50004810 0x7fdb64169f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:24.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.474+0000 7fdb6a59b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb50004810 0x7fdb64169f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58636/0 (socket says 172.21.15.71:58636) 2023-10-09T06:54:24.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.474+0000 7fdb6a59b700 1 -- 172.21.15.71:0/1929931974 learned_addr learned my addr 172.21.15.71:0/1929931974 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:24.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.474+0000 7fdb69d9a700 1 --2- 172.21.15.71:0/1929931974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb6416e160 0x7fdb6416cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:24.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.474+0000 7fdb6ad9c700 1 --2- 172.21.15.71:0/1929931974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb640a8940 0x7fdb640b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:24.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.474+0000 7fdb6a59b700 1 -- 172.21.15.71:0/1929931974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb6416e160 msgr2=0x7fdb6416cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:24.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.474+0000 7fdb6a59b700 1 --2- 172.21.15.71:0/1929931974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb6416e160 0x7fdb6416cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:24.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.474+0000 7fdb6a59b700 1 -- 172.21.15.71:0/1929931974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb640a8940 msgr2=0x7fdb640b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:24.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.474+0000 7fdb6a59b700 1 --2- 172.21.15.71:0/1929931974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb640a8940 0x7fdb640b46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:24.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.474+0000 7fdb6a59b700 1 -- 172.21.15.71:0/1929931974 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6416d270 con 0x7fdb50004810 2023-10-09T06:54:24.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.474+0000 7fdb6a59b700 1 --2- 172.21.15.71:0/1929931974 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb50004810 0x7fdb64169f40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fdb600010e0 tx=0x7fdb60009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:24.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.474+0000 7fdb5a7fc700 1 -- 172.21.15.71:0/1929931974 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb60006820 con 0x7fdb50004810 2023-10-09T06:54:24.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.475+0000 7fdb5a7fc700 1 -- 172.21.15.71:0/1929931974 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb60006980 con 0x7fdb50004810 2023-10-09T06:54:24.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.475+0000 7fdb6b59d700 1 -- 172.21.15.71:0/1929931974 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb640a9200 con 0x7fdb50004810 2023-10-09T06:54:24.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.475+0000 7fdb5a7fc700 1 -- 172.21.15.71:0/1929931974 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb60006d40 con 0x7fdb50004810 2023-10-09T06:54:24.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.475+0000 7fdb6b59d700 1 -- 172.21.15.71:0/1929931974 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb640a97c0 con 0x7fdb50004810 2023-10-09T06:54:24.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.476+0000 7fdb6b59d700 1 -- 172.21.15.71:0/1929931974 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6404c3c0 con 0x7fdb50004810 2023-10-09T06:54:24.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.476+0000 7fdb5a7fc700 1 -- 172.21.15.71:0/1929931974 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fdb60007230 con 0x7fdb50004810 2023-10-09T06:54:24.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.477+0000 7fdb5a7fc700 1 --2- 172.21.15.71:0/1929931974 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb48067130 0x7fdb480695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:24.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.477+0000 7fdb5a7fc700 1 -- 172.21.15.71:0/1929931974 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fdb60084bd0 con 0x7fdb50004810 2023-10-09T06:54:24.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.478+0000 7fdb69d9a700 1 --2- 172.21.15.71:0/1929931974 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb48067130 0x7fdb480695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:24.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.478+0000 7fdb69d9a700 1 --2- 172.21.15.71:0/1929931974 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb48067130 0x7fdb480695e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdb640b36f0 tx=0x7fdb54015000 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:24.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.481+0000 7fdb5a7fc700 1 -- 172.21.15.71:0/1929931974 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb60051a20 con 0x7fdb50004810 2023-10-09T06:54:24.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.696+0000 7fdb6b59d700 1 -- 172.21.15.71:0/1929931974 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb640a7140 con 0x7fdb48067130 2023-10-09T06:54:24.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.769+0000 7fdb5a7fc700 1 -- 172.21.15.71:0/1929931974 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fdb54000c30 con 0x7fdb48067130 2023-10-09T06:54:24.771 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule deactivated for path /snap_test_dir1/dir8 2023-10-09T06:54:24.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.772+0000 7fdb6b59d700 1 -- 172.21.15.71:0/1929931974 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb48067130 msgr2=0x7fdb480695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:24.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.772+0000 7fdb6b59d700 1 --2- 172.21.15.71:0/1929931974 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb48067130 0x7fdb480695e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdb640b36f0 tx=0x7fdb54015000 comp rx=0 tx=0).stop 2023-10-09T06:54:24.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.772+0000 7fdb6b59d700 1 -- 172.21.15.71:0/1929931974 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb50004810 msgr2=0x7fdb64169f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:24.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.772+0000 7fdb6b59d700 1 --2- 172.21.15.71:0/1929931974 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb50004810 0x7fdb64169f40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fdb600010e0 tx=0x7fdb60009040 comp rx=0 tx=0).stop 2023-10-09T06:54:24.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.772+0000 7fdb6b59d700 1 -- 172.21.15.71:0/1929931974 shutdown_connections 2023-10-09T06:54:24.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.772+0000 7fdb6b59d700 1 --2- 172.21.15.71:0/1929931974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb640a8940 0x7fdb640b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:24.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.772+0000 7fdb6b59d700 1 --2- 172.21.15.71:0/1929931974 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb48067130 0x7fdb480695e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:24.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.772+0000 7fdb6b59d700 1 --2- 172.21.15.71:0/1929931974 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb50004810 0x7fdb64169f40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:24.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.772+0000 7fdb6b59d700 1 --2- 172.21.15.71:0/1929931974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb6416e160 0x7fdb6416cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:24.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.772+0000 7fdb6b59d700 1 -- 172.21.15.71:0/1929931974 >> 172.21.15.71:0/1929931974 conn(0x7fdb64063230 msgr2=0x7fdb6415cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:24.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.772+0000 7fdb6b59d700 1 -- 172.21.15.71:0/1929931974 shutdown_connections 2023-10-09T06:54:24.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.772+0000 7fdb6b59d700 1 -- 172.21.15.71:0/1929931974 wait complete. 2023-10-09T06:54:24.790 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir8 2023-10-09T06:54:24.790 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir9 1M 2023-10-09T06:54:24.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.977+0000 7f02adbff700 1 Processor -- start 2023-10-09T06:54:24.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.977+0000 7f02adbff700 1 -- start start 2023-10-09T06:54:24.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.978+0000 7f02adbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02a80cd910 0x7f02a80ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:24.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.978+0000 7f02adbff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f02a80b55a0 0x7f02a80ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:24.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.978+0000 7f02adbff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a80b5b00 con 0x7f02a8159ec0 2023-10-09T06:54:24.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.978+0000 7f02adbff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a80b5da0 con 0x7f02a80b55a0 2023-10-09T06:54:24.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.978+0000 7f02adbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a80b6080 con 0x7f02a80cd910 2023-10-09T06:54:24.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.979+0000 7f02a6ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02a80cd910 0x7f02a80ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:24.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.979+0000 7f02a7fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f02a80b55a0 0x7f02a80ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:24.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.979+0000 7f02a7fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f02a80b55a0 0x7f02a80ce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:47998/0 (socket says 172.21.15.71:47998) 2023-10-09T06:54:24.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.979+0000 7f02a7fff700 1 -- 172.21.15.71:0/4235529820 learned_addr learned my addr 172.21.15.71:0/4235529820 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:24.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.979+0000 7f02a6ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02a80cd910 0x7f02a80ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:47442/0 (socket says 172.21.15.71:47442) 2023-10-09T06:54:24.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.979+0000 7f02a77fe700 1 --1- 172.21.15.71:0/4235529820 >> v1:172.21.15.179:6789/0 conn(0x7f02a8159ec0 0x7f02a80b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:39236/0 (socket says 172.21.15.71:39236) 2023-10-09T06:54:24.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.979+0000 7f02a67fc700 1 -- 172.21.15.71:0/4235529820 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4057241845 0 0) 0x7f02a80b5b00 con 0x7f02a8159ec0 2023-10-09T06:54:24.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.979+0000 7f02a67fc700 1 -- 172.21.15.71:0/4235529820 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0290003570 con 0x7f02a8159ec0 2023-10-09T06:54:24.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.979+0000 7f02a7fff700 1 -- 172.21.15.71:0/4235529820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02a80cd910 msgr2=0x7f02a80ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:24.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.979+0000 7f02a7fff700 1 --2- 172.21.15.71:0/4235529820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02a80cd910 0x7f02a80ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:24.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.979+0000 7f02a7fff700 1 -- 172.21.15.71:0/4235529820 >> v1:172.21.15.179:6789/0 conn(0x7f02a8159ec0 legacy=0x7f02a80b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:24.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.979+0000 7f02a7fff700 1 -- 172.21.15.71:0/4235529820 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a80cc100 con 0x7f02a80b55a0 2023-10-09T06:54:24.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.979+0000 7f02a6ffd700 1 --2- 172.21.15.71:0/4235529820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02a80cd910 0x7f02a80ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:54:24.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.980+0000 7f02a7fff700 1 --2- 172.21.15.71:0/4235529820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02a80b55a0 0x7f02a80ce880 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f02a0009f20 tx=0x7f02a0009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4e051457270c4e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:24.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.980+0000 7f02a67fc700 1 -- 172.21.15.71:0/4235529820 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a000e070 con 0x7f02a80b55a0 2023-10-09T06:54:24.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.980+0000 7f02a67fc700 1 -- 172.21.15.71:0/4235529820 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a000b970 con 0x7f02a80b55a0 2023-10-09T06:54:24.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.980+0000 7f02a67fc700 1 -- 172.21.15.71:0/4235529820 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a00092e0 con 0x7f02a80b55a0 2023-10-09T06:54:24.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.981+0000 7f02adbff700 1 -- 172.21.15.71:0/4235529820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02a80b55a0 msgr2=0x7f02a80ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:24.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.981+0000 7f02adbff700 1 --2- 172.21.15.71:0/4235529820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02a80b55a0 0x7f02a80ce880 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f02a0009f20 tx=0x7f02a0009840 comp rx=0 tx=0).stop 2023-10-09T06:54:24.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.981+0000 7f02adbff700 1 -- 172.21.15.71:0/4235529820 shutdown_connections 2023-10-09T06:54:24.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.981+0000 7f02adbff700 1 --2- 172.21.15.71:0/4235529820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02a80b55a0 0x7f02a80ce880 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:24.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.981+0000 7f02adbff700 1 --2- 172.21.15.71:0/4235529820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02a80cd910 0x7f02a80ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:24.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.981+0000 7f02adbff700 1 -- 172.21.15.71:0/4235529820 >> 172.21.15.71:0/4235529820 conn(0x7f02a80999f0 msgr2=0x7f02a80b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:24.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.981+0000 7f02adbff700 1 -- 172.21.15.71:0/4235529820 shutdown_connections 2023-10-09T06:54:24.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.981+0000 7f02adbff700 1 -- 172.21.15.71:0/4235529820 wait complete. 2023-10-09T06:54:24.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.982+0000 7f02adbff700 1 Processor -- start 2023-10-09T06:54:24.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.982+0000 7f02adbff700 1 -- start start 2023-10-09T06:54:24.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.983+0000 7f02adbff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02a80b55a0 0x7f02a8156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:24.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.983+0000 7f02adbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02a8159ec0 0x7f02a80d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:24.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.983+0000 7f02adbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02a8153a20 0x7f02a80d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:24.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.983+0000 7f02adbff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a8155ca0 con 0x7f02a80b55a0 2023-10-09T06:54:24.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.983+0000 7f02adbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a8156f60 con 0x7f02a8159ec0 2023-10-09T06:54:24.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.983+0000 7f02adbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a816e150 con 0x7f02a8153a20 2023-10-09T06:54:24.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.983+0000 7f02a77fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02a80b55a0 0x7f02a8156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:24.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.984+0000 7f02a77fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02a80b55a0 0x7f02a8156880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58648/0 (socket says 172.21.15.71:58648) 2023-10-09T06:54:24.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.984+0000 7f02a77fe700 1 -- 172.21.15.71:0/612784041 learned_addr learned my addr 172.21.15.71:0/612784041 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:24.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.984+0000 7f02a6ffd700 1 --2- 172.21.15.71:0/612784041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02a8159ec0 0x7f02a80d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:24.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.984+0000 7f02a7fff700 1 --2- 172.21.15.71:0/612784041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02a8153a20 0x7f02a80d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:24.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.984+0000 7f02a77fe700 1 -- 172.21.15.71:0/612784041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02a8153a20 msgr2=0x7f02a80d0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:24.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.984+0000 7f02a77fe700 1 --2- 172.21.15.71:0/612784041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02a8153a20 0x7f02a80d0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:24.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.984+0000 7f02a77fe700 1 -- 172.21.15.71:0/612784041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02a8159ec0 msgr2=0x7f02a80d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:24.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.984+0000 7f02a77fe700 1 --2- 172.21.15.71:0/612784041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02a8159ec0 0x7f02a80d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:24.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.984+0000 7f02a77fe700 1 -- 172.21.15.71:0/612784041 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c009420 con 0x7f02a80b55a0 2023-10-09T06:54:24.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.984+0000 7f02a77fe700 1 --2- 172.21.15.71:0/612784041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02a80b55a0 0x7f02a8156880 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f029800c7c0 tx=0x7f0298007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:24.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.985+0000 7f028f7fe700 1 -- 172.21.15.71:0/612784041 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0298005b90 con 0x7f02a80b55a0 2023-10-09T06:54:24.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.985+0000 7f028f7fe700 1 -- 172.21.15.71:0/612784041 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0298005cf0 con 0x7f02a80b55a0 2023-10-09T06:54:24.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.985+0000 7f028f7fe700 1 -- 172.21.15.71:0/612784041 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0298007300 con 0x7f02a80b55a0 2023-10-09T06:54:24.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.985+0000 7f02adbff700 1 -- 172.21.15.71:0/612784041 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a0009ae0 con 0x7f02a80b55a0 2023-10-09T06:54:24.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.985+0000 7f02adbff700 1 -- 172.21.15.71:0/612784041 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a816d670 con 0x7f02a80b55a0 2023-10-09T06:54:24.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.986+0000 7f02adbff700 1 -- 172.21.15.71:0/612784041 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a8063c90 con 0x7f02a80b55a0 2023-10-09T06:54:24.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.987+0000 7f028f7fe700 1 -- 172.21.15.71:0/612784041 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f029801b3b0 con 0x7f02a80b55a0 2023-10-09T06:54:24.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.988+0000 7f028f7fe700 1 --2- 172.21.15.71:0/612784041 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0294067130 0x7f02940695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:24.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.988+0000 7f028f7fe700 1 -- 172.21.15.71:0/612784041 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f0298083e80 con 0x7f02a80b55a0 2023-10-09T06:54:24.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.988+0000 7f02a6ffd700 1 --2- 172.21.15.71:0/612784041 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0294067130 0x7f02940695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:24.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.989+0000 7f02a6ffd700 1 --2- 172.21.15.71:0/612784041 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0294067130 0x7f02940695e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f02a8152950 tx=0x7f029c0091a0 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:24.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:24.992+0000 7f028f7fe700 1 -- 172.21.15.71:0/612784041 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0298050cd0 con 0x7f02a80b55a0 2023-10-09T06:54:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.207+0000 7f02adbff700 1 -- 172.21.15.71:0/612784041 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f02a80718b0 con 0x7f0294067130 2023-10-09T06:54:25.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.280+0000 7f028f7fe700 1 -- 172.21.15.71:0/612784041 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f02a80718b0 con 0x7f0294067130 2023-10-09T06:54:25.282 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule deactivated for path /snap_test_dir1/dir9 2023-10-09T06:54:25.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.283+0000 7f02adbff700 1 -- 172.21.15.71:0/612784041 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0294067130 msgr2=0x7f02940695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:25.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.283+0000 7f02adbff700 1 --2- 172.21.15.71:0/612784041 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0294067130 0x7f02940695e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f02a8152950 tx=0x7f029c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.283+0000 7f02adbff700 1 -- 172.21.15.71:0/612784041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02a80b55a0 msgr2=0x7f02a8156880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.283+0000 7f02adbff700 1 --2- 172.21.15.71:0/612784041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02a80b55a0 0x7f02a8156880 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f029800c7c0 tx=0x7f0298007db0 comp rx=0 tx=0).stop 2023-10-09T06:54:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.283+0000 7f02adbff700 1 -- 172.21.15.71:0/612784041 shutdown_connections 2023-10-09T06:54:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.283+0000 7f02adbff700 1 --2- 172.21.15.71:0/612784041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02a8153a20 0x7f02a80d0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.283+0000 7f02adbff700 1 --2- 172.21.15.71:0/612784041 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0294067130 0x7f02940695e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.283+0000 7f02adbff700 1 --2- 172.21.15.71:0/612784041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02a80b55a0 0x7f02a8156880 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.283+0000 7f02adbff700 1 --2- 172.21.15.71:0/612784041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02a8159ec0 0x7f02a80d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.283+0000 7f02adbff700 1 -- 172.21.15.71:0/612784041 >> 172.21.15.71:0/612784041 conn(0x7f02a80999f0 msgr2=0x7f02a80c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.283+0000 7f02adbff700 1 -- 172.21.15.71:0/612784041 shutdown_connections 2023-10-09T06:54:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.283+0000 7f02adbff700 1 -- 172.21.15.71:0/612784041 wait complete. 2023-10-09T06:54:25.301 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir9 2023-10-09T06:54:25.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:25.301 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-10-09T06:54:25.340 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:25.341 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:25.341 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_46_01_UTC 2023-10-09T06:54:25.341 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:25.341 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:25.341 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:25.341 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:25.341 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:25.341 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:25.341 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:25.341 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:25.342 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-06_44_00_UTC', 'scheduled-2023-10-09-06_45_00_UTC', 'scheduled-2023-10-09-06_46_01_UTC', 'scheduled-2023-10-09-06_47_00_UTC', 'scheduled-2023-10-09-06_48_00_UTC', 'scheduled-2023-10-09-06_49_00_UTC', 'scheduled-2023-10-09-06_50_00_UTC', 'scheduled-2023-10-09-06_51_00_UTC', 'scheduled-2023-10-09-06_52_00_UTC', 'scheduled-2023-10-09-06_53_00_UTC', 'scheduled-2023-10-09-06_54_00_UTC'] 2023-10-09T06:54:25.343 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir0 2023-10-09T06:54:25.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.565+0000 7fe09a5ff700 1 Processor -- start 2023-10-09T06:54:25.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.565+0000 7fe09a5ff700 1 -- start start 2023-10-09T06:54:25.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.566+0000 7fe09a5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe0941563b0 0x7fe094156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:25.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.566+0000 7fe09a5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe09415a440 0x7fe0940acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:25.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.566+0000 7fe09a5ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe09415a9b0 con 0x7fe094068890 2023-10-09T06:54:25.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.566+0000 7fe09a5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09415ac90 con 0x7fe0941563b0 2023-10-09T06:54:25.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.566+0000 7fe09a5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09415af70 con 0x7fe09415a440 2023-10-09T06:54:25.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.566+0000 7fe098b9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe094068890 0x7fe0940c8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33636/0 (socket says 172.21.15.71:33636) 2023-10-09T06:54:25.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.566+0000 7fe098b9c700 1 -- 172.21.15.71:0/3094534707 learned_addr learned my addr 172.21.15.71:0/3094534707 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:25.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.567+0000 7fe093fff700 1 --2- 172.21.15.71:0/3094534707 >> v2:172.21.15.179:3300/0 conn(0x7fe0941563b0 0x7fe094156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:25.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.567+0000 7fe0937fe700 1 -- 172.21.15.71:0/3094534707 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589461474 0 0) 0x7fe09415a9b0 con 0x7fe094068890 2023-10-09T06:54:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.567+0000 7fe08bfff700 1 --2- 172.21.15.71:0/3094534707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe09415a440 0x7fe0940acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.567+0000 7fe0937fe700 1 -- 172.21.15.71:0/3094534707 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe080003570 con 0x7fe094068890 2023-10-09T06:54:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.567+0000 7fe0937fe700 1 -- 172.21.15.71:0/3094534707 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3954414134 0 0) 0x7fe080003570 con 0x7fe094068890 2023-10-09T06:54:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.567+0000 7fe0937fe700 1 -- 172.21.15.71:0/3094534707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe09415a440 msgr2=0x7fe0940acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.567+0000 7fe0937fe700 1 --2- 172.21.15.71:0/3094534707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe09415a440 0x7fe0940acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.567+0000 7fe0937fe700 1 -- 172.21.15.71:0/3094534707 >> v2:172.21.15.179:3300/0 conn(0x7fe0941563b0 msgr2=0x7fe094156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.567+0000 7fe0937fe700 1 --2- 172.21.15.71:0/3094534707 >> v2:172.21.15.179:3300/0 conn(0x7fe0941563b0 0x7fe094156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.567+0000 7fe0937fe700 1 -- 172.21.15.71:0/3094534707 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09415b250 con 0x7fe094068890 2023-10-09T06:54:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.567+0000 7fe0937fe700 1 -- 172.21.15.71:0/3094534707 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fe08c0017f0 con 0x7fe094068890 2023-10-09T06:54:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.567+0000 7fe0937fe700 1 -- 172.21.15.71:0/3094534707 >> v1:172.21.15.71:6789/0 conn(0x7fe094068890 legacy=0x7fe0940c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.567+0000 7fe0937fe700 1 --2- 172.21.15.71:0/3094534707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe09415a440 0x7fe080003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.567+0000 7fe0937fe700 1 --2- 172.21.15.71:0/3094534707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0800040b0 0x7fe080004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:25.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.567+0000 7fe0937fe700 1 --2- 172.21.15.71:0/3094534707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe080004d50 0x7fe0800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:25.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.567+0000 7fe0937fe700 1 -- 172.21.15.71:0/3094534707 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09415ac90 con 0x7fe080004d50 2023-10-09T06:54:25.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.567+0000 7fe0937fe700 1 -- 172.21.15.71:0/3094534707 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09415af70 con 0x7fe0800040b0 2023-10-09T06:54:25.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.567+0000 7fe0937fe700 1 -- 172.21.15.71:0/3094534707 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08000dd70 con 0x7fe09415a440 2023-10-09T06:54:25.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.568+0000 7fe098b9c700 1 --2- 172.21.15.71:0/3094534707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe080004d50 0x7fe0800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:25.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.568+0000 7fe093fff700 1 --2- 172.21.15.71:0/3094534707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe09415a440 0x7fe080003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:25.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.568+0000 7fe08bfff700 1 --2- 172.21.15.71:0/3094534707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0800040b0 0x7fe080004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:25.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.568+0000 7fe098b9c700 1 -- 172.21.15.71:0/3094534707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe09415a440 msgr2=0x7fe080003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:25.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.568+0000 7fe098b9c700 1 --2- 172.21.15.71:0/3094534707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe09415a440 0x7fe080003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:25.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.568+0000 7fe098b9c700 1 -- 172.21.15.71:0/3094534707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0800040b0 msgr2=0x7fe080004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:25.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.568+0000 7fe098b9c700 1 --2- 172.21.15.71:0/3094534707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0800040b0 0x7fe080004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:25.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.568+0000 7fe098b9c700 1 -- 172.21.15.71:0/3094534707 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe080003570 con 0x7fe080004d50 2023-10-09T06:54:25.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.568+0000 7fe098b9c700 1 --2- 172.21.15.71:0/3094534707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe080004d50 0x7fe0800051c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00a870 tx=0x7fe08c002140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4df53c71084158 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:25.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.568+0000 7fe0937fe700 1 -- 172.21.15.71:0/3094534707 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c00a230 con 0x7fe080004d50 2023-10-09T06:54:25.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.568+0000 7fe0937fe700 1 -- 172.21.15.71:0/3094534707 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c0070f0 con 0x7fe080004d50 2023-10-09T06:54:25.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.568+0000 7fe0937fe700 1 -- 172.21.15.71:0/3094534707 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c0074b0 con 0x7fe080004d50 2023-10-09T06:54:25.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.569+0000 7fe09a5ff700 1 -- 172.21.15.71:0/3094534707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe080004d50 msgr2=0x7fe0800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:25.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.569+0000 7fe09a5ff700 1 --2- 172.21.15.71:0/3094534707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe080004d50 0x7fe0800051c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00a870 tx=0x7fe08c002140 comp rx=0 tx=0).stop 2023-10-09T06:54:25.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.569+0000 7fe098b9c700 1 -- 172.21.15.71:0/3094534707 reap_dead start 2023-10-09T06:54:25.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.569+0000 7fe09a5ff700 1 -- 172.21.15.71:0/3094534707 shutdown_connections 2023-10-09T06:54:25.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.569+0000 7fe09a5ff700 1 -- 172.21.15.71:0/3094534707 >> 172.21.15.71:0/3094534707 conn(0x7fe0940c8f90 msgr2=0x7fe0940c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:25.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.569+0000 7fe09a5ff700 1 -- 172.21.15.71:0/3094534707 shutdown_connections 2023-10-09T06:54:25.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.569+0000 7fe09a5ff700 1 -- 172.21.15.71:0/3094534707 wait complete. 2023-10-09T06:54:25.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.571+0000 7fe09a5ff700 1 Processor -- start 2023-10-09T06:54:25.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.571+0000 7fe09a5ff700 1 -- start start 2023-10-09T06:54:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.571+0000 7fe09a5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe080004d50 0x7fe094166e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.571+0000 7fe09a5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe094152390 0x7fe0940c2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.572+0000 7fe09a5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0940c2b80 0x7fe094169270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.572+0000 7fe09a5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0940afe20 con 0x7fe080004d50 2023-10-09T06:54:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.572+0000 7fe09a5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0940c3150 con 0x7fe094152390 2023-10-09T06:54:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.572+0000 7fe09a5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0940b0070 con 0x7fe0940c2b80 2023-10-09T06:54:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.572+0000 7fe093fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe080004d50 0x7fe094166e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.572+0000 7fe093fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe080004d50 0x7fe094166e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38996/0 (socket says 172.21.15.71:38996) 2023-10-09T06:54:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.572+0000 7fe093fff700 1 -- 172.21.15.71:0/2704076802 learned_addr learned my addr 172.21.15.71:0/2704076802 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.572+0000 7fe08bfff700 1 --2- 172.21.15.71:0/2704076802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe094152390 0x7fe0940c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.572+0000 7fe098b9c700 1 --2- 172.21.15.71:0/2704076802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0940c2b80 0x7fe094169270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:25.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.572+0000 7fe093fff700 1 -- 172.21.15.71:0/2704076802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0940c2b80 msgr2=0x7fe094169270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:25.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.572+0000 7fe093fff700 1 --2- 172.21.15.71:0/2704076802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0940c2b80 0x7fe094169270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:25.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.572+0000 7fe093fff700 1 -- 172.21.15.71:0/2704076802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe094152390 msgr2=0x7fe0940c2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:25.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.572+0000 7fe093fff700 1 --2- 172.21.15.71:0/2704076802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe094152390 0x7fe0940c2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:25.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.572+0000 7fe093fff700 1 -- 172.21.15.71:0/2704076802 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0940b0350 con 0x7fe080004d50 2023-10-09T06:54:25.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.572+0000 7fe093fff700 1 --2- 172.21.15.71:0/2704076802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe080004d50 0x7fe094166e40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe084006ac0 tx=0x7fe0840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:25.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.572+0000 7fe090ff9700 1 -- 172.21.15.71:0/2704076802 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08400fa10 con 0x7fe080004d50 2023-10-09T06:54:25.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.573+0000 7fe090ff9700 1 -- 172.21.15.71:0/2704076802 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08400fb70 con 0x7fe080004d50 2023-10-09T06:54:25.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.573+0000 7fe09a5ff700 1 -- 172.21.15.71:0/2704076802 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0940b0630 con 0x7fe080004d50 2023-10-09T06:54:25.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.573+0000 7fe090ff9700 1 -- 172.21.15.71:0/2704076802 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084014440 con 0x7fe080004d50 2023-10-09T06:54:25.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.573+0000 7fe09a5ff700 1 -- 172.21.15.71:0/2704076802 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0941697b0 con 0x7fe080004d50 2023-10-09T06:54:25.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.574+0000 7fe09a5ff700 1 -- 172.21.15.71:0/2704076802 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0940b0870 con 0x7fe080004d50 2023-10-09T06:54:25.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.575+0000 7fe090ff9700 1 -- 172.21.15.71:0/2704076802 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fe084014830 con 0x7fe080004d50 2023-10-09T06:54:25.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.575+0000 7fe090ff9700 1 --2- 172.21.15.71:0/2704076802 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe074067130 0x7fe0740695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:25.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.575+0000 7fe090ff9700 1 -- 172.21.15.71:0/2704076802 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fe084018030 con 0x7fe080004d50 2023-10-09T06:54:25.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.576+0000 7fe08bfff700 1 --2- 172.21.15.71:0/2704076802 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe074067130 0x7fe0740695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:25.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.577+0000 7fe08bfff700 1 --2- 172.21.15.71:0/2704076802 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe074067130 0x7fe0740695e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe07c006f00 tx=0x7fe07c008040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:25.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.579+0000 7fe090ff9700 1 -- 172.21.15.71:0/2704076802 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0940b0870 con 0x7fe080004d50 2023-10-09T06:54:25.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.795+0000 7fe09a5ff700 1 -- 172.21.15.71:0/2704076802 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0940b0870 con 0x7fe074067130 2023-10-09T06:54:25.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.805+0000 7fe090ff9700 1 -- 172.21.15.71:0/2704076802 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fe0940b0870 con 0x7fe074067130 2023-10-09T06:54:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:54:25.806 INFO:teuthology.orchestra.run.smithi071.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:43:53", "first": "2023-10-09T06:44:00", "last": "2023-10-09T06:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T06:54:25.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.807+0000 7fe09a5ff700 1 -- 172.21.15.71:0/2704076802 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe074067130 msgr2=0x7fe0740695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:25.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.807+0000 7fe09a5ff700 1 --2- 172.21.15.71:0/2704076802 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe074067130 0x7fe0740695e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe07c006f00 tx=0x7fe07c008040 comp rx=0 tx=0).stop 2023-10-09T06:54:25.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.807+0000 7fe09a5ff700 1 -- 172.21.15.71:0/2704076802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe080004d50 msgr2=0x7fe094166e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:25.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.807+0000 7fe09a5ff700 1 --2- 172.21.15.71:0/2704076802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe080004d50 0x7fe094166e40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe084006ac0 tx=0x7fe0840091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:25.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.807+0000 7fe09a5ff700 1 -- 172.21.15.71:0/2704076802 shutdown_connections 2023-10-09T06:54:25.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.807+0000 7fe09a5ff700 1 --2- 172.21.15.71:0/2704076802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0940c2b80 0x7fe094169270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:25.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.807+0000 7fe09a5ff700 1 --2- 172.21.15.71:0/2704076802 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe074067130 0x7fe0740695e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:25.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.807+0000 7fe09a5ff700 1 --2- 172.21.15.71:0/2704076802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe080004d50 0x7fe094166e40 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:25.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.807+0000 7fe09a5ff700 1 --2- 172.21.15.71:0/2704076802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe094152390 0x7fe0940c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:25.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.807+0000 7fe09a5ff700 1 -- 172.21.15.71:0/2704076802 >> 172.21.15.71:0/2704076802 conn(0x7fe0940c8f90 msgr2=0x7fe0940ae280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:25.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.808+0000 7fe09a5ff700 1 -- 172.21.15.71:0/2704076802 shutdown_connections 2023-10-09T06:54:25.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:25.808+0000 7fe09a5ff700 1 -- 172.21.15.71:0/2704076802 wait complete. 2023-10-09T06:54:25.826 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:43:53", "first": "2023-10-09T06:44:00", "last": "2023-10-09T06:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T06:54:25.826 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir0', 'rel_path': '/snap_test_dir1/dir0', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T06:43:53', 'first': '2023-10-09T06:44:00', 'last': '2023-10-09T06:54:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-09T06:54:25.826 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-09T06:54:25.826 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-09T06:54:25.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:25.827 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-10-09T06:54:25.864 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:25.864 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:25.864 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:25.864 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:25.864 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:25.865 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:25.865 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:25.865 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:25.865 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:25.865 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:25.866 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-06_45_00_UTC', 'scheduled-2023-10-09-06_46_00_UTC', 'scheduled-2023-10-09-06_47_00_UTC', 'scheduled-2023-10-09-06_48_00_UTC', 'scheduled-2023-10-09-06_49_00_UTC', 'scheduled-2023-10-09-06_50_00_UTC', 'scheduled-2023-10-09-06_51_00_UTC', 'scheduled-2023-10-09-06_52_00_UTC', 'scheduled-2023-10-09-06_53_00_UTC', 'scheduled-2023-10-09-06_54_00_UTC'] 2023-10-09T06:54:25.866 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir1 2023-10-09T06:54:26.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.090+0000 7fc7909ff700 1 Processor -- start 2023-10-09T06:54:26.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.090+0000 7fc7909ff700 1 -- start start 2023-10-09T06:54:26.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.091+0000 7fc7909ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc78c0cd910 0x7fc78c0ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:26.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.091+0000 7fc7909ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc78c0b55a0 0x7fc78c0ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:26.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.091+0000 7fc7909ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78c0b5b00 con 0x7fc78c159ec0 2023-10-09T06:54:26.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.091+0000 7fc7909ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78c0b5da0 con 0x7fc78c0cd910 2023-10-09T06:54:26.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.091+0000 7fc7909ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0b6080 con 0x7fc78c0b55a0 2023-10-09T06:54:26.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.091+0000 7fc783fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc78c0cd910 0x7fc78c0ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:26.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.092+0000 7fc783fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc78c0cd910 0x7fc78c0ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38998/0 (socket says 172.21.15.71:38998) 2023-10-09T06:54:26.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.092+0000 7fc783fff700 1 -- 172.21.15.71:0/1445173366 learned_addr learned my addr 172.21.15.71:0/1445173366 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:26.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.092+0000 7fc78ad9d700 1 --2- 172.21.15.71:0/1445173366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc78c0b55a0 0x7fc78c0ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:26.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.092+0000 7fc783fff700 1 -- 172.21.15.71:0/1445173366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc78c0b55a0 msgr2=0x7fc78c0ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:26.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.092+0000 7fc783fff700 1 --2- 172.21.15.71:0/1445173366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc78c0b55a0 0x7fc78c0ce880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:26.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.092+0000 7fc783fff700 1 -- 172.21.15.71:0/1445173366 >> v1:172.21.15.71:6789/0 conn(0x7fc78c159ec0 legacy=0x7fc78c0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:26.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.092+0000 7fc783fff700 1 -- 172.21.15.71:0/1445173366 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c0cc100 con 0x7fc78c0cd910 2023-10-09T06:54:26.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.092+0000 7fc789d9b700 1 -- 172.21.15.71:0/1445173366 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329694358 0 0) 0x7fc78c0b5b00 con 0x7fc78c159ec0 2023-10-09T06:54:26.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.092+0000 7fc783fff700 1 --2- 172.21.15.71:0/1445173366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc78c0cd910 0x7fc78c0ce340 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc7740099e0 tx=0x7fc774009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e9fe6988d64dc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:26.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.092+0000 7fc789d9b700 1 -- 172.21.15.71:0/1445173366 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77400b820 con 0x7fc78c0cd910 2023-10-09T06:54:26.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.093+0000 7fc789d9b700 1 -- 172.21.15.71:0/1445173366 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77400b980 con 0x7fc78c0cd910 2023-10-09T06:54:26.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.093+0000 7fc789d9b700 1 -- 172.21.15.71:0/1445173366 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77400bd20 con 0x7fc78c0cd910 2023-10-09T06:54:26.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.093+0000 7fc7909ff700 1 -- 172.21.15.71:0/1445173366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc78c0cd910 msgr2=0x7fc78c0ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:26.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.093+0000 7fc7909ff700 1 --2- 172.21.15.71:0/1445173366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc78c0cd910 0x7fc78c0ce340 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc7740099e0 tx=0x7fc774009250 comp rx=0 tx=0).stop 2023-10-09T06:54:26.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.093+0000 7fc7909ff700 1 -- 172.21.15.71:0/1445173366 shutdown_connections 2023-10-09T06:54:26.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.093+0000 7fc7909ff700 1 --2- 172.21.15.71:0/1445173366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc78c0b55a0 0x7fc78c0ce880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:26.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.093+0000 7fc7909ff700 1 --2- 172.21.15.71:0/1445173366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc78c0cd910 0x7fc78c0ce340 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:26.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.093+0000 7fc7909ff700 1 -- 172.21.15.71:0/1445173366 >> 172.21.15.71:0/1445173366 conn(0x7fc78c0999f0 msgr2=0x7fc78c0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:26.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.093+0000 7fc7909ff700 1 -- 172.21.15.71:0/1445173366 shutdown_connections 2023-10-09T06:54:26.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.093+0000 7fc7909ff700 1 -- 172.21.15.71:0/1445173366 wait complete. 2023-10-09T06:54:26.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.095+0000 7fc7909ff700 1 Processor -- start 2023-10-09T06:54:26.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.095+0000 7fc7909ff700 1 -- start start 2023-10-09T06:54:26.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.096+0000 7fc7909ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc78c0b55a0 0x7fc78c0c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:26.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.096+0000 7fc7909ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc78c159ec0 0x7fc78c157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:26.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.096+0000 7fc7909ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc78c0c7010 0x7fc78c1582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:26.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.096+0000 7fc7909ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c1534d0 con 0x7fc78c0b55a0 2023-10-09T06:54:26.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.096+0000 7fc7909ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c158990 con 0x7fc78c0c7010 2023-10-09T06:54:26.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.096+0000 7fc7909ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c158c70 con 0x7fc78c159ec0 2023-10-09T06:54:26.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.096+0000 7fc78a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc78c0b55a0 0x7fc78c0c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:26.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.096+0000 7fc78a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc78c0b55a0 0x7fc78c0c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39010/0 (socket says 172.21.15.71:39010) 2023-10-09T06:54:26.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.096+0000 7fc78a59c700 1 -- 172.21.15.71:0/1095282912 learned_addr learned my addr 172.21.15.71:0/1095282912 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:26.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.096+0000 7fc78ad9d700 1 --2- 172.21.15.71:0/1095282912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc78c0c7010 0x7fc78c1582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:26.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.096+0000 7fc783fff700 1 --2- 172.21.15.71:0/1095282912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc78c159ec0 0x7fc78c157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:26.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.096+0000 7fc78a59c700 1 -- 172.21.15.71:0/1095282912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc78c159ec0 msgr2=0x7fc78c157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:26.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.096+0000 7fc78a59c700 1 --2- 172.21.15.71:0/1095282912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc78c159ec0 0x7fc78c157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:26.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.096+0000 7fc78a59c700 1 -- 172.21.15.71:0/1095282912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc78c0c7010 msgr2=0x7fc78c1582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:26.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.096+0000 7fc78a59c700 1 --2- 172.21.15.71:0/1095282912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc78c0c7010 0x7fc78c1582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:26.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.096+0000 7fc78a59c700 1 -- 172.21.15.71:0/1095282912 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7740094f0 con 0x7fc78c0b55a0 2023-10-09T06:54:26.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.096+0000 7fc78ad9d700 1 --2- 172.21.15.71:0/1095282912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc78c0c7010 0x7fc78c1582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:54:26.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.096+0000 7fc783fff700 1 --2- 172.21.15.71:0/1095282912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc78c159ec0 0x7fc78c157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:54:26.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.096+0000 7fc78a59c700 1 --2- 172.21.15.71:0/1095282912 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc78c0b55a0 0x7fc78c0c6ad0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00c810 tx=0x7fc77c007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:26.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.097+0000 7fc7827fc700 1 -- 172.21.15.71:0/1095282912 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c010510 con 0x7fc78c0b55a0 2023-10-09T06:54:26.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.097+0000 7fc7827fc700 1 -- 172.21.15.71:0/1095282912 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77c010690 con 0x7fc78c0b55a0 2023-10-09T06:54:26.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.097+0000 7fc7827fc700 1 -- 172.21.15.71:0/1095282912 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c010a50 con 0x7fc78c0b55a0 2023-10-09T06:54:26.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.097+0000 7fc7909ff700 1 -- 172.21.15.71:0/1095282912 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78c158f50 con 0x7fc78c0b55a0 2023-10-09T06:54:26.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.097+0000 7fc7909ff700 1 -- 172.21.15.71:0/1095282912 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78c1517e0 con 0x7fc78c0b55a0 2023-10-09T06:54:26.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.098+0000 7fc7909ff700 1 -- 172.21.15.71:0/1095282912 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc78c063c90 con 0x7fc78c0b55a0 2023-10-09T06:54:26.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.099+0000 7fc7827fc700 1 -- 172.21.15.71:0/1095282912 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fc77c01b400 con 0x7fc78c0b55a0 2023-10-09T06:54:26.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.100+0000 7fc7827fc700 1 --2- 172.21.15.71:0/1095282912 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc76c067130 0x7fc76c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:26.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.100+0000 7fc7827fc700 1 -- 172.21.15.71:0/1095282912 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fc77c0845f0 con 0x7fc78c0b55a0 2023-10-09T06:54:26.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.101+0000 7fc783fff700 1 --2- 172.21.15.71:0/1095282912 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc76c067130 0x7fc76c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:26.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.101+0000 7fc783fff700 1 --2- 172.21.15.71:0/1095282912 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc76c067130 0x7fc76c0695e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc7740099e0 tx=0x7fc774017000 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:26.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.104+0000 7fc7827fc700 1 -- 172.21.15.71:0/1095282912 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc77c051560 con 0x7fc78c0b55a0 2023-10-09T06:54:26.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.322+0000 7fc7909ff700 1 -- 172.21.15.71:0/1095282912 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc78c153610 con 0x7fc76c067130 2023-10-09T06:54:26.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.331+0000 7fc7827fc700 1 -- 172.21.15.71:0/1095282912 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fc77400bbc0 con 0x7fc76c067130 2023-10-09T06:54:26.332 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:54:26.332 INFO:teuthology.orchestra.run.smithi071.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:43:54", "first": "2023-10-09T06:45:00", "last": "2023-10-09T06:54:00", "last_pruned": null, "created_count": 10, "pruned_count": 0, "active": false}] 2023-10-09T06:54:26.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.333+0000 7fc7909ff700 1 -- 172.21.15.71:0/1095282912 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc76c067130 msgr2=0x7fc76c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:26.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.333+0000 7fc7909ff700 1 --2- 172.21.15.71:0/1095282912 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc76c067130 0x7fc76c0695e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc7740099e0 tx=0x7fc774017000 comp rx=0 tx=0).stop 2023-10-09T06:54:26.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.333+0000 7fc7909ff700 1 -- 172.21.15.71:0/1095282912 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc78c0b55a0 msgr2=0x7fc78c0c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:26.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.333+0000 7fc7909ff700 1 --2- 172.21.15.71:0/1095282912 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc78c0b55a0 0x7fc78c0c6ad0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00c810 tx=0x7fc77c007d60 comp rx=0 tx=0).stop 2023-10-09T06:54:26.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.333+0000 7fc7909ff700 1 -- 172.21.15.71:0/1095282912 shutdown_connections 2023-10-09T06:54:26.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.333+0000 7fc7909ff700 1 --2- 172.21.15.71:0/1095282912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc78c0c7010 0x7fc78c1582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:26.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.333+0000 7fc7909ff700 1 --2- 172.21.15.71:0/1095282912 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc76c067130 0x7fc76c0695e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:26.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.333+0000 7fc7909ff700 1 --2- 172.21.15.71:0/1095282912 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc78c0b55a0 0x7fc78c0c6ad0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:26.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.333+0000 7fc7909ff700 1 --2- 172.21.15.71:0/1095282912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc78c159ec0 0x7fc78c157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:26.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.333+0000 7fc7909ff700 1 -- 172.21.15.71:0/1095282912 >> 172.21.15.71:0/1095282912 conn(0x7fc78c0999f0 msgr2=0x7fc78c0c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:26.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.333+0000 7fc7909ff700 1 -- 172.21.15.71:0/1095282912 shutdown_connections 2023-10-09T06:54:26.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.333+0000 7fc7909ff700 1 -- 172.21.15.71:0/1095282912 wait complete. 2023-10-09T06:54:26.351 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:43:54", "first": "2023-10-09T06:45:00", "last": "2023-10-09T06:54:00", "last_pruned": null, "created_count": 10, "pruned_count": 0, "active": false}] 2023-10-09T06:54:26.351 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir1', 'rel_path': '/snap_test_dir1/dir1', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T06:43:54', 'first': '2023-10-09T06:45:00', 'last': '2023-10-09T06:54:00', 'last_pruned': None, 'created_count': 10, 'pruned_count': 0, 'active': False} 2023-10-09T06:54:26.352 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 10 2023-10-09T06:54:26.352 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 10 2023-10-09T06:54:26.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:26.352 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-10-09T06:54:26.389 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:26.389 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:26.390 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_47_01_UTC 2023-10-09T06:54:26.390 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:26.390 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:26.390 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:26.390 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:26.390 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:26.390 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:26.390 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:26.391 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-06_45_00_UTC', 'scheduled-2023-10-09-06_46_00_UTC', 'scheduled-2023-10-09-06_47_01_UTC', 'scheduled-2023-10-09-06_48_00_UTC', 'scheduled-2023-10-09-06_49_00_UTC', 'scheduled-2023-10-09-06_50_00_UTC', 'scheduled-2023-10-09-06_51_00_UTC', 'scheduled-2023-10-09-06_52_00_UTC', 'scheduled-2023-10-09-06_53_00_UTC', 'scheduled-2023-10-09-06_54_00_UTC'] 2023-10-09T06:54:26.391 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir2 2023-10-09T06:54:26.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.614+0000 7f6e0ffff700 1 Processor -- start 2023-10-09T06:54:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.615+0000 7f6e0ffff700 1 -- start start 2023-10-09T06:54:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.616+0000 7f6e0ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6e100b0760 0x7f6e100b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.616+0000 7f6e0ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e100ace60 0x7f6e100ad280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.616+0000 7f6e0ffff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e100b0570 con 0x7f6e10156350 2023-10-09T06:54:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.616+0000 7f6e0ffff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e100b1140 con 0x7f6e100b0760 2023-10-09T06:54:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.616+0000 7f6e0ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e100af4d0 con 0x7f6e100ace60 2023-10-09T06:54:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.616+0000 7f6e0effd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6e10156350 0x7f6e10157370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33652/0 (socket says 172.21.15.71:33652) 2023-10-09T06:54:26.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.616+0000 7f6e0effd700 1 -- 172.21.15.71:0/1493488009 learned_addr learned my addr 172.21.15.71:0/1493488009 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:26.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.616+0000 7f6e0e7fc700 1 --2- 172.21.15.71:0/1493488009 >> v2:172.21.15.179:3300/0 conn(0x7f6e100b0760 0x7f6e100b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:26.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.616+0000 7f6e0f7fe700 1 --2- 172.21.15.71:0/1493488009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e100ace60 0x7f6e100ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:26.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.617+0000 7f6e0dffb700 1 -- 172.21.15.71:0/1493488009 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491528910 0 0) 0x7f6e100b0570 con 0x7f6e10156350 2023-10-09T06:54:26.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.617+0000 7f6e0dffb700 1 -- 172.21.15.71:0/1493488009 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6df8003570 con 0x7f6e10156350 2023-10-09T06:54:26.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.617+0000 7f6e0dffb700 1 -- 172.21.15.71:0/1493488009 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2390156772 0 0) 0x7f6df8003570 con 0x7f6e10156350 2023-10-09T06:54:26.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.617+0000 7f6e0dffb700 1 -- 172.21.15.71:0/1493488009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e100ace60 msgr2=0x7f6e100ad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:26.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.617+0000 7f6e0dffb700 1 --2- 172.21.15.71:0/1493488009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e100ace60 0x7f6e100ad280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:26.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.617+0000 7f6e0dffb700 1 -- 172.21.15.71:0/1493488009 >> v2:172.21.15.179:3300/0 conn(0x7f6e100b0760 msgr2=0x7f6e100b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:26.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.617+0000 7f6e0dffb700 1 --2- 172.21.15.71:0/1493488009 >> v2:172.21.15.179:3300/0 conn(0x7f6e100b0760 0x7f6e100b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:26.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.617+0000 7f6e0dffb700 1 -- 172.21.15.71:0/1493488009 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e100af7b0 con 0x7f6e10156350 2023-10-09T06:54:26.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.617+0000 7f6e0dffb700 1 -- 172.21.15.71:0/1493488009 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f6e000017f0 con 0x7f6e10156350 2023-10-09T06:54:26.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.617+0000 7f6e0e7fc700 1 --2- 172.21.15.71:0/1493488009 >> v2:172.21.15.179:3300/0 conn(0x7f6e100b0760 0x7f6e100b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:54:26.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.617+0000 7f6e0dffb700 1 -- 172.21.15.71:0/1493488009 >> v1:172.21.15.71:6789/0 conn(0x7f6e10156350 legacy=0x7f6e10157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:26.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.617+0000 7f6e0dffb700 1 --2- 172.21.15.71:0/1493488009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6df8003ae0 0x7f6df8003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:26.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.617+0000 7f6e0dffb700 1 --2- 172.21.15.71:0/1493488009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e100ace60 0x7f6df8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:26.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.617+0000 7f6e0dffb700 1 --2- 172.21.15.71:0/1493488009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6df8004d50 0x7f6df80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:26.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.617+0000 7f6e0dffb700 1 -- 172.21.15.71:0/1493488009 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e100b1140 con 0x7f6df8004d50 2023-10-09T06:54:26.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.617+0000 7f6e0dffb700 1 -- 172.21.15.71:0/1493488009 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e100af4d0 con 0x7f6df8003ae0 2023-10-09T06:54:26.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.617+0000 7f6e0dffb700 1 -- 172.21.15.71:0/1493488009 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df800bb10 con 0x7f6e100ace60 2023-10-09T06:54:26.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.617+0000 7f6e0f7fe700 1 --2- 172.21.15.71:0/1493488009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6df8004d50 0x7f6df80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:26.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.618+0000 7f6e0f7fe700 1 -- 172.21.15.71:0/1493488009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e100ace60 msgr2=0x7f6df8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:26.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.618+0000 7f6e0f7fe700 1 --2- 172.21.15.71:0/1493488009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e100ace60 0x7f6df8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:26.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.618+0000 7f6e0f7fe700 1 -- 172.21.15.71:0/1493488009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6df8003ae0 msgr2=0x7f6df8003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:26.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.618+0000 7f6e0f7fe700 1 --2- 172.21.15.71:0/1493488009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6df8003ae0 0x7f6df8003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:26.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.618+0000 7f6e0f7fe700 1 -- 172.21.15.71:0/1493488009 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df8003570 con 0x7f6df8004d50 2023-10-09T06:54:26.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.618+0000 7f6e0f7fe700 1 --2- 172.21.15.71:0/1493488009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6df8004d50 0x7f6df80051c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6e08009c30 tx=0x7f6e080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1715004feb3b6074 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:26.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.618+0000 7f6e0dffb700 1 -- 172.21.15.71:0/1493488009 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0800e710 con 0x7f6df8004d50 2023-10-09T06:54:26.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.618+0000 7f6e0dffb700 1 -- 172.21.15.71:0/1493488009 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0800e870 con 0x7f6df8004d50 2023-10-09T06:54:26.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.618+0000 7f6e0dffb700 1 -- 172.21.15.71:0/1493488009 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0800ec30 con 0x7f6df8004d50 2023-10-09T06:54:26.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.619+0000 7f6e0ffff700 1 -- 172.21.15.71:0/1493488009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6df8004d50 msgr2=0x7f6df80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:26.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.619+0000 7f6e0ffff700 1 --2- 172.21.15.71:0/1493488009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6df8004d50 0x7f6df80051c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6e08009c30 tx=0x7f6e080091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:26.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.619+0000 7f6e0f7fe700 1 -- 172.21.15.71:0/1493488009 reap_dead start 2023-10-09T06:54:26.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.619+0000 7f6e0ffff700 1 -- 172.21.15.71:0/1493488009 shutdown_connections 2023-10-09T06:54:26.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.619+0000 7f6e0ffff700 1 -- 172.21.15.71:0/1493488009 >> 172.21.15.71:0/1493488009 conn(0x7f6e10068e20 msgr2=0x7f6e100cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:26.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.619+0000 7f6e0ffff700 1 -- 172.21.15.71:0/1493488009 shutdown_connections 2023-10-09T06:54:26.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.619+0000 7f6e0ffff700 1 -- 172.21.15.71:0/1493488009 wait complete. 2023-10-09T06:54:26.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.620+0000 7f6e0ffff700 1 Processor -- start 2023-10-09T06:54:26.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.620+0000 7f6e0ffff700 1 -- start start 2023-10-09T06:54:26.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.621+0000 7f6e0ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6df8004d50 0x7f6e100c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:26.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.621+0000 7f6e0ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e1016ac30 0x7f6e100695f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.621+0000 7f6e0ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e1016b0a0 0x7f6e10069b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.621+0000 7f6e0ffff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1016a800 con 0x7f6e1016ac30 2023-10-09T06:54:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.621+0000 7f6e0ffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e100a9a70 con 0x7f6df8004d50 2023-10-09T06:54:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.621+0000 7f6e0ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e100a9d50 con 0x7f6e1016b0a0 2023-10-09T06:54:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.621+0000 7f6e0e7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e1016ac30 0x7f6e100695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.621+0000 7f6e0e7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e1016ac30 0x7f6e100695f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39024/0 (socket says 172.21.15.71:39024) 2023-10-09T06:54:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.621+0000 7f6e0e7fc700 1 -- 172.21.15.71:0/4178200943 learned_addr learned my addr 172.21.15.71:0/4178200943 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.622+0000 7f6e0effd700 1 --2- 172.21.15.71:0/4178200943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6df8004d50 0x7f6e100c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.622+0000 7f6e0f7fe700 1 --2- 172.21.15.71:0/4178200943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e1016b0a0 0x7f6e10069b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.622+0000 7f6e0e7fc700 1 -- 172.21.15.71:0/4178200943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e1016b0a0 msgr2=0x7f6e10069b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.622+0000 7f6e0e7fc700 1 --2- 172.21.15.71:0/4178200943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e1016b0a0 0x7f6e10069b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.622+0000 7f6e0e7fc700 1 -- 172.21.15.71:0/4178200943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6df8004d50 msgr2=0x7f6e100c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.622+0000 7f6e0e7fc700 1 --2- 172.21.15.71:0/4178200943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6df8004d50 0x7f6e100c7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.622+0000 7f6e0e7fc700 1 -- 172.21.15.71:0/4178200943 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e100aa030 con 0x7f6e1016ac30 2023-10-09T06:54:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.622+0000 7f6e0effd700 1 --2- 172.21.15.71:0/4178200943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6df8004d50 0x7f6e100c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:54:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.622+0000 7f6e0e7fc700 1 --2- 172.21.15.71:0/4178200943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e1016ac30 0x7f6e100695f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400ec50 tx=0x7f6e040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.622+0000 7f6df6ffd700 1 -- 172.21.15.71:0/4178200943 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0400c950 con 0x7f6e1016ac30 2023-10-09T06:54:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.622+0000 7f6df6ffd700 1 -- 172.21.15.71:0/4178200943 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0400cab0 con 0x7f6e1016ac30 2023-10-09T06:54:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.622+0000 7f6e0ffff700 1 -- 172.21.15.71:0/4178200943 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e100aa550 con 0x7f6e1016ac30 2023-10-09T06:54:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.622+0000 7f6df6ffd700 1 -- 172.21.15.71:0/4178200943 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0400ce70 con 0x7f6e1016ac30 2023-10-09T06:54:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.622+0000 7f6e0ffff700 1 -- 172.21.15.71:0/4178200943 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e100aaa40 con 0x7f6e1016ac30 2023-10-09T06:54:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.624+0000 7f6e0ffff700 1 -- 172.21.15.71:0/4178200943 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e100a98d0 con 0x7f6e1016ac30 2023-10-09T06:54:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.624+0000 7f6df6ffd700 1 -- 172.21.15.71:0/4178200943 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f6e04013680 con 0x7f6e1016ac30 2023-10-09T06:54:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.625+0000 7f6df6ffd700 1 --2- 172.21.15.71:0/4178200943 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6dfc067130 0x7f6dfc0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:26.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.625+0000 7f6df6ffd700 1 -- 172.21.15.71:0/4178200943 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f6e04084ea0 con 0x7f6e1016ac30 2023-10-09T06:54:26.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.626+0000 7f6e0effd700 1 --2- 172.21.15.71:0/4178200943 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6dfc067130 0x7f6dfc0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:26.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.626+0000 7f6e0effd700 1 --2- 172.21.15.71:0/4178200943 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6dfc067130 0x7f6dfc0695e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6e000014a0 tx=0x7f6e00005bc0 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.629+0000 7f6df6ffd700 1 -- 172.21.15.71:0/4178200943 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e100a98d0 con 0x7f6e1016ac30 2023-10-09T06:54:26.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.844+0000 7f6e0ffff700 1 -- 172.21.15.71:0/4178200943 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e100a98d0 con 0x7f6dfc067130 2023-10-09T06:54:26.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.854+0000 7f6df6ffd700 1 -- 172.21.15.71:0/4178200943 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f6e100a98d0 con 0x7f6dfc067130 2023-10-09T06:54:26.856 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:54:26.856 INFO:teuthology.orchestra.run.smithi071.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:43:54", "first": "2023-10-09T06:45:00", "last": "2023-10-09T06:54:00", "last_pruned": null, "created_count": 10, "pruned_count": 0, "active": false}] 2023-10-09T06:54:26.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.857+0000 7f6e0ffff700 1 -- 172.21.15.71:0/4178200943 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6dfc067130 msgr2=0x7f6dfc0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:26.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.857+0000 7f6e0ffff700 1 --2- 172.21.15.71:0/4178200943 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6dfc067130 0x7f6dfc0695e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6e000014a0 tx=0x7f6e00005bc0 comp rx=0 tx=0).stop 2023-10-09T06:54:26.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.857+0000 7f6e0ffff700 1 -- 172.21.15.71:0/4178200943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e1016ac30 msgr2=0x7f6e100695f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:26.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.857+0000 7f6e0ffff700 1 --2- 172.21.15.71:0/4178200943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e1016ac30 0x7f6e100695f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400ec50 tx=0x7f6e040091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:26.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.857+0000 7f6e0ffff700 1 -- 172.21.15.71:0/4178200943 shutdown_connections 2023-10-09T06:54:26.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.857+0000 7f6e0ffff700 1 --2- 172.21.15.71:0/4178200943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e1016b0a0 0x7f6e10069b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:26.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.857+0000 7f6e0ffff700 1 --2- 172.21.15.71:0/4178200943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6df8004d50 0x7f6e100c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:26.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.857+0000 7f6e0ffff700 1 --2- 172.21.15.71:0/4178200943 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6dfc067130 0x7f6dfc0695e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:26.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.857+0000 7f6e0ffff700 1 --2- 172.21.15.71:0/4178200943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e1016ac30 0x7f6e100695f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:26.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.857+0000 7f6e0ffff700 1 -- 172.21.15.71:0/4178200943 >> 172.21.15.71:0/4178200943 conn(0x7f6e10068e20 msgr2=0x7f6e100ad960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:26.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.857+0000 7f6e0ffff700 1 -- 172.21.15.71:0/4178200943 shutdown_connections 2023-10-09T06:54:26.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:26.857+0000 7f6e0ffff700 1 -- 172.21.15.71:0/4178200943 wait complete. 2023-10-09T06:54:26.876 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:43:54", "first": "2023-10-09T06:45:00", "last": "2023-10-09T06:54:00", "last_pruned": null, "created_count": 10, "pruned_count": 0, "active": false}] 2023-10-09T06:54:26.876 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir2', 'rel_path': '/snap_test_dir1/dir2', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T06:43:54', 'first': '2023-10-09T06:45:00', 'last': '2023-10-09T06:54:00', 'last_pruned': None, 'created_count': 10, 'pruned_count': 0, 'active': False} 2023-10-09T06:54:26.876 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 10 2023-10-09T06:54:26.876 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 10 2023-10-09T06:54:26.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:26.876 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-10-09T06:54:26.914 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:26.914 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:26.914 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:26.914 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:26.915 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:26.915 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:26.915 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:26.915 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:26.915 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:26.915 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:26.915 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:26.916 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-06_44_00_UTC', 'scheduled-2023-10-09-06_45_00_UTC', 'scheduled-2023-10-09-06_46_00_UTC', 'scheduled-2023-10-09-06_47_00_UTC', 'scheduled-2023-10-09-06_48_00_UTC', 'scheduled-2023-10-09-06_49_00_UTC', 'scheduled-2023-10-09-06_50_00_UTC', 'scheduled-2023-10-09-06_51_00_UTC', 'scheduled-2023-10-09-06_52_00_UTC', 'scheduled-2023-10-09-06_53_00_UTC', 'scheduled-2023-10-09-06_54_00_UTC'] 2023-10-09T06:54:26.916 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir3 2023-10-09T06:54:27.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.141+0000 7f81677ff700 1 Processor -- start 2023-10-09T06:54:27.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.142+0000 7f81677ff700 1 -- start start 2023-10-09T06:54:27.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.143+0000 7f81677ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f81601563b0 0x7f8160156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:27.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.143+0000 7f81677ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8160068890 0x7f81600c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:27.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.143+0000 7f81677ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f816015a9b0 con 0x7f816015a440 2023-10-09T06:54:27.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.143+0000 7f81677ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f816015ac90 con 0x7f8160068890 2023-10-09T06:54:27.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.143+0000 7f81677ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f816015af70 con 0x7f81601563b0 2023-10-09T06:54:27.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.143+0000 7f8165d9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8160068890 0x7f81600c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:27.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.143+0000 7f8165d9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8160068890 0x7f81600c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39032/0 (socket says 172.21.15.71:39032) 2023-10-09T06:54:27.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.143+0000 7f8165d9c700 1 -- 172.21.15.71:0/1429928155 learned_addr learned my addr 172.21.15.71:0/1429928155 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:27.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.143+0000 7f816559b700 1 --2- 172.21.15.71:0/1429928155 >> v2:172.21.15.179:3300/0 conn(0x7f81601563b0 0x7f8160156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:27.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.144+0000 7f8165d9c700 1 -- 172.21.15.71:0/1429928155 >> v2:172.21.15.179:3300/0 conn(0x7f81601563b0 msgr2=0x7f8160156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:27.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.144+0000 7f8165d9c700 1 --2- 172.21.15.71:0/1429928155 >> v2:172.21.15.179:3300/0 conn(0x7f81601563b0 0x7f8160156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:27.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.144+0000 7f8165d9c700 1 -- 172.21.15.71:0/1429928155 >> v1:172.21.15.179:6789/0 conn(0x7f816015a440 legacy=0x7f81600acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:27.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.144+0000 7f8165d9c700 1 -- 172.21.15.71:0/1429928155 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816015b250 con 0x7f8160068890 2023-10-09T06:54:27.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.144+0000 7f816559b700 1 --2- 172.21.15.71:0/1429928155 >> v2:172.21.15.179:3300/0 conn(0x7f81601563b0 0x7f8160156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:54:27.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.144+0000 7f8165d9c700 1 --2- 172.21.15.71:0/1429928155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8160068890 0x7f81600c8230 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f816006a9f0 tx=0x7f815800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566aefdd33a90dc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:27.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.144+0000 7f8157fff700 1 -- 172.21.15.71:0/1429928155 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8158010070 con 0x7f8160068890 2023-10-09T06:54:27.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.144+0000 7f8157fff700 1 -- 172.21.15.71:0/1429928155 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815800de90 con 0x7f8160068890 2023-10-09T06:54:27.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.144+0000 7f8157fff700 1 -- 172.21.15.71:0/1429928155 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815800b320 con 0x7f8160068890 2023-10-09T06:54:27.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.145+0000 7f81677ff700 1 -- 172.21.15.71:0/1429928155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8160068890 msgr2=0x7f81600c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:27.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.145+0000 7f81677ff700 1 --2- 172.21.15.71:0/1429928155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8160068890 0x7f81600c8230 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f816006a9f0 tx=0x7f815800ba50 comp rx=0 tx=0).stop 2023-10-09T06:54:27.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.145+0000 7f81677ff700 1 -- 172.21.15.71:0/1429928155 shutdown_connections 2023-10-09T06:54:27.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.145+0000 7f81677ff700 1 --2- 172.21.15.71:0/1429928155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8160068890 0x7f81600c8230 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:27.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.145+0000 7f81677ff700 1 --2- 172.21.15.71:0/1429928155 >> v2:172.21.15.179:3300/0 conn(0x7f81601563b0 0x7f8160156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:27.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.145+0000 7f81677ff700 1 -- 172.21.15.71:0/1429928155 >> 172.21.15.71:0/1429928155 conn(0x7f81600c8f90 msgr2=0x7f81600c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:27.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.145+0000 7f81677ff700 1 -- 172.21.15.71:0/1429928155 shutdown_connections 2023-10-09T06:54:27.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.145+0000 7f81677ff700 1 -- 172.21.15.71:0/1429928155 wait complete. 2023-10-09T06:54:27.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.146+0000 7f81677ff700 1 Processor -- start 2023-10-09T06:54:27.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.146+0000 7f81677ff700 1 -- start start 2023-10-09T06:54:27.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.147+0000 7f81677ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8160068890 0x7f8160166570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:27.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.147+0000 7f81677ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81601563b0 0x7f8160165e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:27.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.147+0000 7f81677ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f816015a440 0x7f8160168070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:27.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.147+0000 7f81677ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8160166360 con 0x7f816015a440 2023-10-09T06:54:27.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.147+0000 7f81677ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81600b1a40 con 0x7f81601563b0 2023-10-09T06:54:27.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.147+0000 7f81677ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81600af370 con 0x7f8160068890 2023-10-09T06:54:27.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.147+0000 7f8165d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f816015a440 0x7f8160168070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:27.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.147+0000 7f8165d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f816015a440 0x7f8160168070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39048/0 (socket says 172.21.15.71:39048) 2023-10-09T06:54:27.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.147+0000 7f8165d9c700 1 -- 172.21.15.71:0/2067738710 learned_addr learned my addr 172.21.15.71:0/2067738710 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:27.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.148+0000 7f8164d9a700 1 --2- 172.21.15.71:0/2067738710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81601563b0 0x7f8160165e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:27.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.148+0000 7f816559b700 1 --2- 172.21.15.71:0/2067738710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8160068890 0x7f8160166570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:27.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.148+0000 7f8165d9c700 1 -- 172.21.15.71:0/2067738710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8160068890 msgr2=0x7f8160166570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:27.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.148+0000 7f8165d9c700 1 --2- 172.21.15.71:0/2067738710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8160068890 0x7f8160166570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:27.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.148+0000 7f8165d9c700 1 -- 172.21.15.71:0/2067738710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81601563b0 msgr2=0x7f8160165e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:27.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.148+0000 7f8165d9c700 1 --2- 172.21.15.71:0/2067738710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81601563b0 0x7f8160165e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:27.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.148+0000 7f8165d9c700 1 -- 172.21.15.71:0/2067738710 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815800bcf0 con 0x7f816015a440 2023-10-09T06:54:27.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.148+0000 7f8165d9c700 1 --2- 172.21.15.71:0/2067738710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f816015a440 0x7f8160168070 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f816006bbb0 tx=0x7f815801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:27.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.148+0000 7f81557fa700 1 -- 172.21.15.71:0/2067738710 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815800b4d0 con 0x7f816015a440 2023-10-09T06:54:27.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.148+0000 7f81557fa700 1 -- 172.21.15.71:0/2067738710 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8158028460 con 0x7f816015a440 2023-10-09T06:54:27.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.148+0000 7f81557fa700 1 -- 172.21.15.71:0/2067738710 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8158028820 con 0x7f816015a440 2023-10-09T06:54:27.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.148+0000 7f81677ff700 1 -- 172.21.15.71:0/2067738710 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81600af650 con 0x7f816015a440 2023-10-09T06:54:27.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.149+0000 7f81677ff700 1 -- 172.21.15.71:0/2067738710 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81600afc10 con 0x7f816015a440 2023-10-09T06:54:27.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.150+0000 7f81677ff700 1 -- 172.21.15.71:0/2067738710 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81600afdd0 con 0x7f816015a440 2023-10-09T06:54:27.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.150+0000 7f81557fa700 1 -- 172.21.15.71:0/2067738710 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f8158003040 con 0x7f816015a440 2023-10-09T06:54:27.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.152+0000 7f81557fa700 1 --2- 172.21.15.71:0/2067738710 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8144067130 0x7f81440695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:27.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.152+0000 7f81557fa700 1 -- 172.21.15.71:0/2067738710 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f8158088b70 con 0x7f816015a440 2023-10-09T06:54:27.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.152+0000 7f816559b700 1 --2- 172.21.15.71:0/2067738710 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8144067130 0x7f81440695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:27.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.153+0000 7f816559b700 1 --2- 172.21.15.71:0/2067738710 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8144067130 0x7f81440695e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f81600c2510 tx=0x7f815c008040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:27.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.156+0000 7f81557fa700 1 -- 172.21.15.71:0/2067738710 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f81580558b0 con 0x7f816015a440 2023-10-09T06:54:27.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.370+0000 7f81677ff700 1 -- 172.21.15.71:0/2067738710 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81600718b0 con 0x7f8144067130 2023-10-09T06:54:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.380+0000 7f81557fa700 1 -- 172.21.15.71:0/2067738710 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f81600718b0 con 0x7f8144067130 2023-10-09T06:54:27.381 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:54:27.381 INFO:teuthology.orchestra.run.smithi071.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:43:55", "first": "2023-10-09T06:44:00", "last": "2023-10-09T06:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T06:54:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.382+0000 7f81677ff700 1 -- 172.21.15.71:0/2067738710 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8144067130 msgr2=0x7f81440695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.382+0000 7f81677ff700 1 --2- 172.21.15.71:0/2067738710 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8144067130 0x7f81440695e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f81600c2510 tx=0x7f815c008040 comp rx=0 tx=0).stop 2023-10-09T06:54:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.382+0000 7f81677ff700 1 -- 172.21.15.71:0/2067738710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f816015a440 msgr2=0x7f8160168070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.382+0000 7f81677ff700 1 --2- 172.21.15.71:0/2067738710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f816015a440 0x7f8160168070 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f816006bbb0 tx=0x7f815801a000 comp rx=0 tx=0).stop 2023-10-09T06:54:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.382+0000 7f81677ff700 1 -- 172.21.15.71:0/2067738710 shutdown_connections 2023-10-09T06:54:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.382+0000 7f81677ff700 1 --2- 172.21.15.71:0/2067738710 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8144067130 0x7f81440695e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.382+0000 7f81677ff700 1 --2- 172.21.15.71:0/2067738710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f816015a440 0x7f8160168070 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.382+0000 7f81677ff700 1 --2- 172.21.15.71:0/2067738710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8160068890 0x7f8160166570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.382+0000 7f81677ff700 1 --2- 172.21.15.71:0/2067738710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81601563b0 0x7f8160165e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.382+0000 7f81677ff700 1 -- 172.21.15.71:0/2067738710 >> 172.21.15.71:0/2067738710 conn(0x7f81600c8f90 msgr2=0x7f81600ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.383+0000 7f81677ff700 1 -- 172.21.15.71:0/2067738710 shutdown_connections 2023-10-09T06:54:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.383+0000 7f81677ff700 1 -- 172.21.15.71:0/2067738710 wait complete. 2023-10-09T06:54:27.401 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:43:55", "first": "2023-10-09T06:44:00", "last": "2023-10-09T06:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T06:54:27.401 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir3', 'rel_path': '/snap_test_dir1/dir3', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T06:43:55', 'first': '2023-10-09T06:44:00', 'last': '2023-10-09T06:54:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-09T06:54:27.401 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-09T06:54:27.401 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-09T06:54:27.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:27.401 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-10-09T06:54:27.439 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:27.439 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:27.439 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:27.440 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:27.440 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:27.440 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:27.440 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:27.440 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:27.440 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:27.440 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:27.440 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:27.441 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-06_44_00_UTC', 'scheduled-2023-10-09-06_45_00_UTC', 'scheduled-2023-10-09-06_46_00_UTC', 'scheduled-2023-10-09-06_47_00_UTC', 'scheduled-2023-10-09-06_48_00_UTC', 'scheduled-2023-10-09-06_49_00_UTC', 'scheduled-2023-10-09-06_50_00_UTC', 'scheduled-2023-10-09-06_51_00_UTC', 'scheduled-2023-10-09-06_52_00_UTC', 'scheduled-2023-10-09-06_53_00_UTC', 'scheduled-2023-10-09-06_54_00_UTC'] 2023-10-09T06:54:27.441 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir4 2023-10-09T06:54:27.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.666+0000 7fce585ff700 1 Processor -- start 2023-10-09T06:54:27.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.666+0000 7fce585ff700 1 -- start start 2023-10-09T06:54:27.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.667+0000 7fce585ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fce500c8490 0x7fce500c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:27.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.667+0000 7fce585ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fce5015a490 0x7fce50068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:27.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.667+0000 7fce585ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce500ac030 con 0x7fce50069a50 2023-10-09T06:54:27.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.667+0000 7fce585ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce500ab820 con 0x7fce5015a490 2023-10-09T06:54:27.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.667+0000 7fce585ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce5006dbb0 con 0x7fce500c8490 2023-10-09T06:54:27.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.668+0000 7fce55b9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fce5015a490 0x7fce50068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:27.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.668+0000 7fce55b9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fce5015a490 0x7fce50068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39056/0 (socket says 172.21.15.71:39056) 2023-10-09T06:54:27.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.668+0000 7fce55b9a700 1 -- 172.21.15.71:0/2645629714 learned_addr learned my addr 172.21.15.71:0/2645629714 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:27.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.668+0000 7fce5639b700 1 --2- 172.21.15.71:0/2645629714 >> v2:172.21.15.179:3300/0 conn(0x7fce500c8490 0x7fce500c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:27.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.668+0000 7fce55b9a700 1 -- 172.21.15.71:0/2645629714 >> v2:172.21.15.179:3300/0 conn(0x7fce500c8490 msgr2=0x7fce500c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:27.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.668+0000 7fce55b9a700 1 --2- 172.21.15.71:0/2645629714 >> v2:172.21.15.179:3300/0 conn(0x7fce500c8490 0x7fce500c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:27.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.668+0000 7fce55b9a700 1 -- 172.21.15.71:0/2645629714 >> v1:172.21.15.179:6789/0 conn(0x7fce50069a50 legacy=0x7fce50156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:27.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.668+0000 7fce55b9a700 1 -- 172.21.15.71:0/2645629714 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce500aba70 con 0x7fce5015a490 2023-10-09T06:54:27.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.669+0000 7fce55b9a700 1 --2- 172.21.15.71:0/2645629714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce5015a490 0x7fce50068390 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fce5006b970 tx=0x7fce40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=528e1dbe164e2e33 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:27.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.669+0000 7fce55399700 1 -- 172.21.15.71:0/2645629714 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40009e70 con 0x7fce5015a490 2023-10-09T06:54:27.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.669+0000 7fce55399700 1 -- 172.21.15.71:0/2645629714 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4000b860 con 0x7fce5015a490 2023-10-09T06:54:27.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.669+0000 7fce55399700 1 -- 172.21.15.71:0/2645629714 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4000bc00 con 0x7fce5015a490 2023-10-09T06:54:27.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.669+0000 7fce585ff700 1 -- 172.21.15.71:0/2645629714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce5015a490 msgr2=0x7fce50068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:27.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.669+0000 7fce585ff700 1 --2- 172.21.15.71:0/2645629714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce5015a490 0x7fce50068390 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fce5006b970 tx=0x7fce40009250 comp rx=0 tx=0).stop 2023-10-09T06:54:27.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.669+0000 7fce585ff700 1 -- 172.21.15.71:0/2645629714 shutdown_connections 2023-10-09T06:54:27.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.669+0000 7fce585ff700 1 --2- 172.21.15.71:0/2645629714 >> v2:172.21.15.179:3300/0 conn(0x7fce500c8490 0x7fce500c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:27.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.669+0000 7fce585ff700 1 --2- 172.21.15.71:0/2645629714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce5015a490 0x7fce50068390 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:27.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.669+0000 7fce585ff700 1 -- 172.21.15.71:0/2645629714 >> 172.21.15.71:0/2645629714 conn(0x7fce500c8f90 msgr2=0x7fce500c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:27.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.669+0000 7fce585ff700 1 -- 172.21.15.71:0/2645629714 shutdown_connections 2023-10-09T06:54:27.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.670+0000 7fce585ff700 1 -- 172.21.15.71:0/2645629714 wait complete. 2023-10-09T06:54:27.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.671+0000 7fce585ff700 1 Processor -- start 2023-10-09T06:54:27.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.671+0000 7fce585ff700 1 -- start start 2023-10-09T06:54:27.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.672+0000 7fce585ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce50069a50 0x7fce5016a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:27.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.672+0000 7fce585ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce500c8490 0x7fce5014e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:27.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.672+0000 7fce585ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce5015a490 0x7fce50154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:27.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.672+0000 7fce585ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce500c6cf0 con 0x7fce50069a50 2023-10-09T06:54:27.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.672+0000 7fce585ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce500c4d10 con 0x7fce5015a490 2023-10-09T06:54:27.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.672+0000 7fce585ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce500b1110 con 0x7fce500c8490 2023-10-09T06:54:27.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.672+0000 7fce5639b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce50069a50 0x7fce5016a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:27.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.672+0000 7fce5639b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce50069a50 0x7fce5016a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39064/0 (socket says 172.21.15.71:39064) 2023-10-09T06:54:27.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.672+0000 7fce5639b700 1 -- 172.21.15.71:0/4127660457 learned_addr learned my addr 172.21.15.71:0/4127660457 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:27.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.672+0000 7fce56b9c700 1 --2- 172.21.15.71:0/4127660457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce5015a490 0x7fce50154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:27.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.672+0000 7fce55b9a700 1 --2- 172.21.15.71:0/4127660457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce500c8490 0x7fce5014e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:27.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.673+0000 7fce5639b700 1 -- 172.21.15.71:0/4127660457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce500c8490 msgr2=0x7fce5014e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:27.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.673+0000 7fce5639b700 1 --2- 172.21.15.71:0/4127660457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce500c8490 0x7fce5014e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:27.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.673+0000 7fce5639b700 1 -- 172.21.15.71:0/4127660457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce5015a490 msgr2=0x7fce50154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:27.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.673+0000 7fce5639b700 1 --2- 172.21.15.71:0/4127660457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce5015a490 0x7fce50154a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:27.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.673+0000 7fce5639b700 1 -- 172.21.15.71:0/4127660457 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce400094f0 con 0x7fce50069a50 2023-10-09T06:54:27.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.673+0000 7fce5639b700 1 --2- 172.21.15.71:0/4127660457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce50069a50 0x7fce5016a3c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00ecb0 tx=0x7fce4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:27.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.673+0000 7fce467fc700 1 -- 172.21.15.71:0/4127660457 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c00c9d0 con 0x7fce50069a50 2023-10-09T06:54:27.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.673+0000 7fce467fc700 1 -- 172.21.15.71:0/4127660457 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4c00cb50 con 0x7fce50069a50 2023-10-09T06:54:27.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.673+0000 7fce585ff700 1 -- 172.21.15.71:0/4127660457 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5016a900 con 0x7fce50069a50 2023-10-09T06:54:27.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.673+0000 7fce467fc700 1 -- 172.21.15.71:0/4127660457 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c013470 con 0x7fce50069a50 2023-10-09T06:54:27.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.673+0000 7fce585ff700 1 -- 172.21.15.71:0/4127660457 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce500b0da0 con 0x7fce50069a50 2023-10-09T06:54:27.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.674+0000 7fce585ff700 1 -- 172.21.15.71:0/4127660457 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce500b0900 con 0x7fce50069a50 2023-10-09T06:54:27.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.675+0000 7fce467fc700 1 -- 172.21.15.71:0/4127660457 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fce4c013820 con 0x7fce50069a50 2023-10-09T06:54:27.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.676+0000 7fce467fc700 1 --2- 172.21.15.71:0/4127660457 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fce34067130 0x7fce340695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:27.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.676+0000 7fce467fc700 1 -- 172.21.15.71:0/4127660457 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fce4c084dc0 con 0x7fce50069a50 2023-10-09T06:54:27.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.676+0000 7fce55b9a700 1 --2- 172.21.15.71:0/4127660457 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fce34067130 0x7fce340695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:27.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.677+0000 7fce55b9a700 1 --2- 172.21.15.71:0/4127660457 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fce34067130 0x7fce340695e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fce5006b970 tx=0x7fce40017000 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:27.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.680+0000 7fce467fc700 1 -- 172.21.15.71:0/4127660457 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce4c051c10 con 0x7fce50069a50 2023-10-09T06:54:27.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.894+0000 7fce585ff700 1 -- 172.21.15.71:0/4127660457 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce500b1250 con 0x7fce34067130 2023-10-09T06:54:27.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.904+0000 7fce467fc700 1 -- 172.21.15.71:0/4127660457 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fce4000b9d0 con 0x7fce34067130 2023-10-09T06:54:27.904 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:54:27.905 INFO:teuthology.orchestra.run.smithi071.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:43:56", "first": "2023-10-09T06:44:00", "last": "2023-10-09T06:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T06:54:27.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.906+0000 7fce585ff700 1 -- 172.21.15.71:0/4127660457 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fce34067130 msgr2=0x7fce340695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:27.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.906+0000 7fce585ff700 1 --2- 172.21.15.71:0/4127660457 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fce34067130 0x7fce340695e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fce5006b970 tx=0x7fce40017000 comp rx=0 tx=0).stop 2023-10-09T06:54:27.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.906+0000 7fce585ff700 1 -- 172.21.15.71:0/4127660457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce50069a50 msgr2=0x7fce5016a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:27.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.906+0000 7fce585ff700 1 --2- 172.21.15.71:0/4127660457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce50069a50 0x7fce5016a3c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00ecb0 tx=0x7fce4c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:27.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.906+0000 7fce585ff700 1 -- 172.21.15.71:0/4127660457 shutdown_connections 2023-10-09T06:54:27.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.906+0000 7fce585ff700 1 --2- 172.21.15.71:0/4127660457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce5015a490 0x7fce50154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:27.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.906+0000 7fce585ff700 1 --2- 172.21.15.71:0/4127660457 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fce34067130 0x7fce340695e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:27.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.906+0000 7fce585ff700 1 --2- 172.21.15.71:0/4127660457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce50069a50 0x7fce5016a3c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:27.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.906+0000 7fce585ff700 1 --2- 172.21.15.71:0/4127660457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce500c8490 0x7fce5014e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:27.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.906+0000 7fce585ff700 1 -- 172.21.15.71:0/4127660457 >> 172.21.15.71:0/4127660457 conn(0x7fce500c8f90 msgr2=0x7fce500cac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:27.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.906+0000 7fce585ff700 1 -- 172.21.15.71:0/4127660457 shutdown_connections 2023-10-09T06:54:27.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:27.906+0000 7fce585ff700 1 -- 172.21.15.71:0/4127660457 wait complete. 2023-10-09T06:54:27.924 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:43:56", "first": "2023-10-09T06:44:00", "last": "2023-10-09T06:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T06:54:27.924 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir4', 'rel_path': '/snap_test_dir1/dir4', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T06:43:56', 'first': '2023-10-09T06:44:00', 'last': '2023-10-09T06:54:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-09T06:54:27.924 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-09T06:54:27.924 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-09T06:54:27.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:27.924 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-10-09T06:54:27.961 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:27.961 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:27.961 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:27.962 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:27.962 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:27.962 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:27.962 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:27.962 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:27.962 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:27.962 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:27.962 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:27.963 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-06_44_00_UTC', 'scheduled-2023-10-09-06_45_00_UTC', 'scheduled-2023-10-09-06_46_00_UTC', 'scheduled-2023-10-09-06_47_00_UTC', 'scheduled-2023-10-09-06_48_00_UTC', 'scheduled-2023-10-09-06_49_00_UTC', 'scheduled-2023-10-09-06_50_00_UTC', 'scheduled-2023-10-09-06_51_00_UTC', 'scheduled-2023-10-09-06_52_00_UTC', 'scheduled-2023-10-09-06_53_00_UTC', 'scheduled-2023-10-09-06_54_00_UTC'] 2023-10-09T06:54:27.963 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir5 2023-10-09T06:54:28.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.187+0000 7f4c07dff700 1 Processor -- start 2023-10-09T06:54:28.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.187+0000 7f4c07dff700 1 -- start start 2023-10-09T06:54:28.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.188+0000 7f4c07dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4c00153f50 0x7f4c000b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:28.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.188+0000 7f4c07dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4c00154320 0x7f4c0006d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:28.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.188+0000 7f4c07dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c000b4570 con 0x7f4c0015a190 2023-10-09T06:54:28.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.188+0000 7f4c07dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0015a730 con 0x7f4c00153f50 2023-10-09T06:54:28.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.188+0000 7f4c07dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0015aa10 con 0x7f4c00154320 2023-10-09T06:54:28.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.188+0000 7f4c05b9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4c00153f50 0x7f4c000b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:28.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.189+0000 7f4c05b9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4c00153f50 0x7f4c000b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39076/0 (socket says 172.21.15.71:39076) 2023-10-09T06:54:28.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.189+0000 7f4c0639c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f4c0015a190 0x7f4c0015d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33658/0 (socket says 172.21.15.71:33658) 2023-10-09T06:54:28.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.189+0000 7f4c05b9b700 1 -- 172.21.15.71:0/1742884692 learned_addr learned my addr 172.21.15.71:0/1742884692 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:28.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.189+0000 7f4c0539a700 1 --2- 172.21.15.71:0/1742884692 >> v2:172.21.15.179:3300/0 conn(0x7f4c00154320 0x7f4c0006d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:28.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.189+0000 7f4c05b9b700 1 -- 172.21.15.71:0/1742884692 >> v2:172.21.15.179:3300/0 conn(0x7f4c00154320 msgr2=0x7f4c0006d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:28.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.189+0000 7f4c05b9b700 1 --2- 172.21.15.71:0/1742884692 >> v2:172.21.15.179:3300/0 conn(0x7f4c00154320 0x7f4c0006d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:28.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.189+0000 7f4c05b9b700 1 -- 172.21.15.71:0/1742884692 >> v1:172.21.15.71:6789/0 conn(0x7f4c0015a190 legacy=0x7f4c0015d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:28.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.189+0000 7f4c05b9b700 1 -- 172.21.15.71:0/1742884692 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0015acf0 con 0x7f4c00153f50 2023-10-09T06:54:28.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.189+0000 7f4c05b9b700 1 --2- 172.21.15.71:0/1742884692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c00153f50 0x7f4c000b2000 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4c000b36a0 tx=0x7f4bfc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170adbda37a4b5f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:28.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.189+0000 7f4c04b99700 1 -- 172.21.15.71:0/1742884692 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc00b860 con 0x7f4c00153f50 2023-10-09T06:54:28.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.190+0000 7f4c04b99700 1 -- 172.21.15.71:0/1742884692 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bfc00b9c0 con 0x7f4c00153f50 2023-10-09T06:54:28.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.190+0000 7f4c04b99700 1 -- 172.21.15.71:0/1742884692 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc00bd60 con 0x7f4c00153f50 2023-10-09T06:54:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.190+0000 7f4c07dff700 1 -- 172.21.15.71:0/1742884692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c00153f50 msgr2=0x7f4c000b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.190+0000 7f4c07dff700 1 --2- 172.21.15.71:0/1742884692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c00153f50 0x7f4c000b2000 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4c000b36a0 tx=0x7f4bfc009250 comp rx=0 tx=0).stop 2023-10-09T06:54:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.190+0000 7f4c07dff700 1 -- 172.21.15.71:0/1742884692 shutdown_connections 2023-10-09T06:54:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.190+0000 7f4c07dff700 1 --2- 172.21.15.71:0/1742884692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c00153f50 0x7f4c000b2000 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.190+0000 7f4c07dff700 1 --2- 172.21.15.71:0/1742884692 >> v2:172.21.15.179:3300/0 conn(0x7f4c00154320 0x7f4c0006d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.190+0000 7f4c07dff700 1 -- 172.21.15.71:0/1742884692 >> 172.21.15.71:0/1742884692 conn(0x7f4c0006baf0 msgr2=0x7f4c0006bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.190+0000 7f4c07dff700 1 -- 172.21.15.71:0/1742884692 shutdown_connections 2023-10-09T06:54:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.190+0000 7f4c07dff700 1 -- 172.21.15.71:0/1742884692 wait complete. 2023-10-09T06:54:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.192+0000 7f4c07dff700 1 Processor -- start 2023-10-09T06:54:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.192+0000 7f4c07dff700 1 -- start start 2023-10-09T06:54:28.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.193+0000 7f4c07dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c00153f50 0x7f4c000acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:28.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.193+0000 7f4c07dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c00154320 0x7f4c000ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:28.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.193+0000 7f4c07dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c0015a190 0x7f4c000adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.193+0000 7f4c07dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c00154ad0 con 0x7f4c00153f50 2023-10-09T06:54:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.193+0000 7f4c07dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c000ad2e0 con 0x7f4c00154320 2023-10-09T06:54:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.193+0000 7f4c07dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c000cd540 con 0x7f4c0015a190 2023-10-09T06:54:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.193+0000 7f4c05b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c00153f50 0x7f4c000acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.193+0000 7f4c05b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c00153f50 0x7f4c000acda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39078/0 (socket says 172.21.15.71:39078) 2023-10-09T06:54:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.193+0000 7f4c05b9b700 1 -- 172.21.15.71:0/1961450193 learned_addr learned my addr 172.21.15.71:0/1961450193 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.193+0000 7f4c0539a700 1 --2- 172.21.15.71:0/1961450193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c00154320 0x7f4c000ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.193+0000 7f4c05b9b700 1 -- 172.21.15.71:0/1961450193 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c0015a190 msgr2=0x7f4c000adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.193+0000 7f4c0639c700 1 --2- 172.21.15.71:0/1961450193 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c0015a190 0x7f4c000adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.193+0000 7f4c05b9b700 1 --2- 172.21.15.71:0/1961450193 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c0015a190 0x7f4c000adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.193+0000 7f4c05b9b700 1 -- 172.21.15.71:0/1961450193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c00154320 msgr2=0x7f4c000ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.193+0000 7f4c05b9b700 1 --2- 172.21.15.71:0/1961450193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c00154320 0x7f4c000ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.193+0000 7f4c05b9b700 1 -- 172.21.15.71:0/1961450193 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bfc0094f0 con 0x7f4c00153f50 2023-10-09T06:54:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.193+0000 7f4c0539a700 1 --2- 172.21.15.71:0/1961450193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c00154320 0x7f4c000ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:54:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.193+0000 7f4c0639c700 1 --2- 172.21.15.71:0/1961450193 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c0015a190 0x7f4c000adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:54:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.194+0000 7f4c05b9b700 1 --2- 172.21.15.71:0/1961450193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c00153f50 0x7f4c000acda0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc009290 tx=0x7f4bfc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.194+0000 7f4bf5ffb700 1 -- 172.21.15.71:0/1961450193 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc011e60 con 0x7f4c00153f50 2023-10-09T06:54:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.194+0000 7f4bf5ffb700 1 -- 172.21.15.71:0/1961450193 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bfc01a630 con 0x7f4c00153f50 2023-10-09T06:54:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.194+0000 7f4c07dff700 1 -- 172.21.15.71:0/1961450193 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c000cd820 con 0x7f4c00153f50 2023-10-09T06:54:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.194+0000 7f4bf5ffb700 1 -- 172.21.15.71:0/1961450193 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc01a9f0 con 0x7f4c00153f50 2023-10-09T06:54:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.194+0000 7f4c07dff700 1 -- 172.21.15.71:0/1961450193 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c00154760 con 0x7f4c00153f50 2023-10-09T06:54:28.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.195+0000 7f4c07dff700 1 -- 172.21.15.71:0/1961450193 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c000718b0 con 0x7f4c00153f50 2023-10-09T06:54:28.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.196+0000 7f4bf5ffb700 1 -- 172.21.15.71:0/1961450193 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f4bfc02d440 con 0x7f4c00153f50 2023-10-09T06:54:28.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.197+0000 7f4bf5ffb700 1 --2- 172.21.15.71:0/1961450193 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4be4067130 0x7f4be40695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:28.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.197+0000 7f4bf5ffb700 1 -- 172.21.15.71:0/1961450193 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f4bfc086510 con 0x7f4c00153f50 2023-10-09T06:54:28.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.197+0000 7f4c0539a700 1 --2- 172.21.15.71:0/1961450193 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4be4067130 0x7f4be40695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:28.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.198+0000 7f4c0539a700 1 --2- 172.21.15.71:0/1961450193 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4be4067130 0x7f4be40695e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4c001529a0 tx=0x7f4bf0008040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.201+0000 7f4bf5ffb700 1 -- 172.21.15.71:0/1961450193 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4bfc053480 con 0x7f4c00153f50 2023-10-09T06:54:28.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.414+0000 7f4c07dff700 1 -- 172.21.15.71:0/1961450193 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4c00154c10 con 0x7f4be4067130 2023-10-09T06:54:28.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.423+0000 7f4bf5ffb700 1 -- 172.21.15.71:0/1961450193 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f4bf00097d0 con 0x7f4be4067130 2023-10-09T06:54:28.424 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:54:28.424 INFO:teuthology.orchestra.run.smithi071.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:43:56", "first": "2023-10-09T06:44:00", "last": "2023-10-09T06:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T06:54:28.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.425+0000 7f4c07dff700 1 -- 172.21.15.71:0/1961450193 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4be4067130 msgr2=0x7f4be40695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:28.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.425+0000 7f4c07dff700 1 --2- 172.21.15.71:0/1961450193 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4be4067130 0x7f4be40695e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4c001529a0 tx=0x7f4bf0008040 comp rx=0 tx=0).stop 2023-10-09T06:54:28.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.425+0000 7f4c07dff700 1 -- 172.21.15.71:0/1961450193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c00153f50 msgr2=0x7f4c000acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:28.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.425+0000 7f4c07dff700 1 --2- 172.21.15.71:0/1961450193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c00153f50 0x7f4c000acda0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc009290 tx=0x7f4bfc017000 comp rx=0 tx=0).stop 2023-10-09T06:54:28.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.425+0000 7f4c07dff700 1 -- 172.21.15.71:0/1961450193 shutdown_connections 2023-10-09T06:54:28.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.425+0000 7f4c07dff700 1 --2- 172.21.15.71:0/1961450193 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c0015a190 0x7f4c000adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:28.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.425+0000 7f4c07dff700 1 --2- 172.21.15.71:0/1961450193 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4be4067130 0x7f4be40695e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:28.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.425+0000 7f4c07dff700 1 --2- 172.21.15.71:0/1961450193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c00153f50 0x7f4c000acda0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:28.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.425+0000 7f4c07dff700 1 --2- 172.21.15.71:0/1961450193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c00154320 0x7f4c000ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:28.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.425+0000 7f4c07dff700 1 -- 172.21.15.71:0/1961450193 >> 172.21.15.71:0/1961450193 conn(0x7f4c0006baf0 msgr2=0x7f4c001599c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:28.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.426+0000 7f4c07dff700 1 -- 172.21.15.71:0/1961450193 shutdown_connections 2023-10-09T06:54:28.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.426+0000 7f4c07dff700 1 -- 172.21.15.71:0/1961450193 wait complete. 2023-10-09T06:54:28.443 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:43:56", "first": "2023-10-09T06:44:00", "last": "2023-10-09T06:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T06:54:28.444 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir5', 'rel_path': '/snap_test_dir1/dir5', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T06:43:56', 'first': '2023-10-09T06:44:00', 'last': '2023-10-09T06:54:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-09T06:54:28.444 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-09T06:54:28.444 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-09T06:54:28.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:28.444 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-10-09T06:54:28.482 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:28.482 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:28.482 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:28.483 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:28.483 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_48_01_UTC 2023-10-09T06:54:28.483 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:28.483 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:28.483 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:28.483 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:28.483 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:28.483 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:28.484 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-06_44_00_UTC', 'scheduled-2023-10-09-06_45_00_UTC', 'scheduled-2023-10-09-06_46_00_UTC', 'scheduled-2023-10-09-06_47_00_UTC', 'scheduled-2023-10-09-06_48_01_UTC', 'scheduled-2023-10-09-06_49_00_UTC', 'scheduled-2023-10-09-06_50_00_UTC', 'scheduled-2023-10-09-06_51_00_UTC', 'scheduled-2023-10-09-06_52_00_UTC', 'scheduled-2023-10-09-06_53_00_UTC', 'scheduled-2023-10-09-06_54_00_UTC'] 2023-10-09T06:54:28.485 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir6 2023-10-09T06:54:28.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.712+0000 7ff7aebff700 1 Processor -- start 2023-10-09T06:54:28.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.712+0000 7ff7aebff700 1 -- start start 2023-10-09T06:54:28.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.713+0000 7ff7aebff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a8153f50 0x7ff7a80b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:28.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.713+0000 7ff7aebff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff7a806d840 0x7ff7a8069e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:28.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.713+0000 7ff7aebff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a80b4570 con 0x7ff7a8154320 2023-10-09T06:54:28.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.713+0000 7ff7aebff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a815a730 con 0x7ff7a806d840 2023-10-09T06:54:28.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.713+0000 7ff7aebff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a815aa10 con 0x7ff7a8153f50 2023-10-09T06:54:28.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.713+0000 7ff7ad19c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff7a806d840 0x7ff7a8069e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:28.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.713+0000 7ff7ad19c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff7a806d840 0x7ff7a8069e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39094/0 (socket says 172.21.15.71:39094) 2023-10-09T06:54:28.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.713+0000 7ff7ad19c700 1 -- 172.21.15.71:0/462281514 learned_addr learned my addr 172.21.15.71:0/462281514 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:28.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.714+0000 7ff7ac99b700 1 --2- 172.21.15.71:0/462281514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a8153f50 0x7ff7a80b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:28.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.714+0000 7ff7ad19c700 1 -- 172.21.15.71:0/462281514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a8153f50 msgr2=0x7ff7a80b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:28.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.714+0000 7ff7ad19c700 1 --2- 172.21.15.71:0/462281514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a8153f50 0x7ff7a80b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:28.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.714+0000 7ff7ad19c700 1 -- 172.21.15.71:0/462281514 >> v1:172.21.15.179:6789/0 conn(0x7ff7a8154320 legacy=0x7ff7a806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:28.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.714+0000 7ff7ad19c700 1 -- 172.21.15.71:0/462281514 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a815acf0 con 0x7ff7a806d840 2023-10-09T06:54:28.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.714+0000 7ff7ad19c700 1 --2- 172.21.15.71:0/462281514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a806d840 0x7ff7a8069e30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff7a00099b0 tx=0x7ff7a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17c0592c4b698bd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:28.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.714+0000 7ff7a77fe700 1 -- 172.21.15.71:0/462281514 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0009ea0 con 0x7ff7a806d840 2023-10-09T06:54:28.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.714+0000 7ff7a77fe700 1 -- 172.21.15.71:0/462281514 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a000b860 con 0x7ff7a806d840 2023-10-09T06:54:28.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.714+0000 7ff7a77fe700 1 -- 172.21.15.71:0/462281514 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a000bc00 con 0x7ff7a806d840 2023-10-09T06:54:28.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.715+0000 7ff7aebff700 1 -- 172.21.15.71:0/462281514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a806d840 msgr2=0x7ff7a8069e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:28.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.715+0000 7ff7aebff700 1 --2- 172.21.15.71:0/462281514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a806d840 0x7ff7a8069e30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff7a00099b0 tx=0x7ff7a0009250 comp rx=0 tx=0).stop 2023-10-09T06:54:28.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.715+0000 7ff7aebff700 1 -- 172.21.15.71:0/462281514 shutdown_connections 2023-10-09T06:54:28.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.715+0000 7ff7aebff700 1 --2- 172.21.15.71:0/462281514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a806d840 0x7ff7a8069e30 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:28.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.715+0000 7ff7aebff700 1 --2- 172.21.15.71:0/462281514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a8153f50 0x7ff7a80b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:28.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.715+0000 7ff7aebff700 1 -- 172.21.15.71:0/462281514 >> 172.21.15.71:0/462281514 conn(0x7ff7a806baf0 msgr2=0x7ff7a806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:28.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.715+0000 7ff7aebff700 1 -- 172.21.15.71:0/462281514 shutdown_connections 2023-10-09T06:54:28.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.715+0000 7ff7aebff700 1 -- 172.21.15.71:0/462281514 wait complete. 2023-10-09T06:54:28.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.716+0000 7ff7aebff700 1 Processor -- start 2023-10-09T06:54:28.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.717+0000 7ff7aebff700 1 -- start start 2023-10-09T06:54:28.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.717+0000 7ff7aebff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a806d840 0x7ff7a815f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:28.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.717+0000 7ff7aebff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7a8153f50 0x7ff7a81452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:28.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.717+0000 7ff7aebff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a8154320 0x7ff7a80adb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:28.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.717+0000 7ff7aebff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a80cae50 con 0x7ff7a8154320 2023-10-09T06:54:28.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.717+0000 7ff7aebff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a8169fe0 con 0x7ff7a8153f50 2023-10-09T06:54:28.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.717+0000 7ff7aebff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a8145800 con 0x7ff7a806d840 2023-10-09T06:54:28.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.718+0000 7ff7ad19c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a8154320 0x7ff7a80adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:28.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.718+0000 7ff7ad19c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a8154320 0x7ff7a80adb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39106/0 (socket says 172.21.15.71:39106) 2023-10-09T06:54:28.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.718+0000 7ff7ad19c700 1 -- 172.21.15.71:0/3763042595 learned_addr learned my addr 172.21.15.71:0/3763042595 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:28.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.718+0000 7ff7ac99b700 1 --2- 172.21.15.71:0/3763042595 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a806d840 0x7ff7a815f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:28.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.718+0000 7ff7a7fff700 1 --2- 172.21.15.71:0/3763042595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7a8153f50 0x7ff7a81452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:28.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.718+0000 7ff7ad19c700 1 -- 172.21.15.71:0/3763042595 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a806d840 msgr2=0x7ff7a815f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:28.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.718+0000 7ff7ad19c700 1 --2- 172.21.15.71:0/3763042595 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a806d840 0x7ff7a815f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:28.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.718+0000 7ff7ad19c700 1 -- 172.21.15.71:0/3763042595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7a8153f50 msgr2=0x7ff7a81452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:28.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.718+0000 7ff7ad19c700 1 --2- 172.21.15.71:0/3763042595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7a8153f50 0x7ff7a81452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:28.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.718+0000 7ff7ad19c700 1 -- 172.21.15.71:0/3763042595 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a00094f0 con 0x7ff7a8154320 2023-10-09T06:54:28.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.718+0000 7ff7a7fff700 1 --2- 172.21.15.71:0/3763042595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7a8153f50 0x7ff7a81452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:54:28.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.718+0000 7ff7ad19c700 1 --2- 172.21.15.71:0/3763042595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a8154320 0x7ff7a80adb50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff7a806f610 tx=0x7ff7a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:28.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.719+0000 7ff7a4ff9700 1 -- 172.21.15.71:0/3763042595 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0011630 con 0x7ff7a8154320 2023-10-09T06:54:28.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.719+0000 7ff7a4ff9700 1 -- 172.21.15.71:0/3763042595 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a0011790 con 0x7ff7a8154320 2023-10-09T06:54:28.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.719+0000 7ff7a4ff9700 1 -- 172.21.15.71:0/3763042595 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0011b50 con 0x7ff7a8154320 2023-10-09T06:54:28.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.719+0000 7ff7aebff700 1 -- 172.21.15.71:0/3763042595 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a816d920 con 0x7ff7a8154320 2023-10-09T06:54:28.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.719+0000 7ff7aebff700 1 -- 172.21.15.71:0/3763042595 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a816dee0 con 0x7ff7a8154320 2023-10-09T06:54:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.720+0000 7ff7aebff700 1 -- 172.21.15.71:0/3763042595 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a80718b0 con 0x7ff7a8154320 2023-10-09T06:54:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.721+0000 7ff7a4ff9700 1 -- 172.21.15.71:0/3763042595 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7ff7a00253f0 con 0x7ff7a8154320 2023-10-09T06:54:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.721+0000 7ff7a4ff9700 1 --2- 172.21.15.71:0/3763042595 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff78c067130 0x7ff78c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.721+0000 7ff7a4ff9700 1 -- 172.21.15.71:0/3763042595 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7ff7a0086520 con 0x7ff7a8154320 2023-10-09T06:54:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.722+0000 7ff7ac99b700 1 --2- 172.21.15.71:0/3763042595 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff78c067130 0x7ff78c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.723+0000 7ff7ac99b700 1 --2- 172.21.15.71:0/3763042595 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff78c067130 0x7ff78c0695e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0076a0 tx=0x7ff79c00b040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:28.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.726+0000 7ff7a4ff9700 1 -- 172.21.15.71:0/3763042595 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7a0053410 con 0x7ff7a8154320 2023-10-09T06:54:28.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.942+0000 7ff7aebff700 1 -- 172.21.15.71:0/3763042595 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff7a815afd0 con 0x7ff78c067130 2023-10-09T06:54:28.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.953+0000 7ff7a4ff9700 1 -- 172.21.15.71:0/3763042595 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7ff7a815afd0 con 0x7ff78c067130 2023-10-09T06:54:28.954 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:54:28.954 INFO:teuthology.orchestra.run.smithi071.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:43:57", "first": "2023-10-09T06:44:00", "last": "2023-10-09T06:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T06:54:28.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.955+0000 7ff7aebff700 1 -- 172.21.15.71:0/3763042595 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff78c067130 msgr2=0x7ff78c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:28.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.955+0000 7ff7aebff700 1 --2- 172.21.15.71:0/3763042595 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff78c067130 0x7ff78c0695e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0076a0 tx=0x7ff79c00b040 comp rx=0 tx=0).stop 2023-10-09T06:54:28.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.955+0000 7ff7aebff700 1 -- 172.21.15.71:0/3763042595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a8154320 msgr2=0x7ff7a80adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:28.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.955+0000 7ff7aebff700 1 --2- 172.21.15.71:0/3763042595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a8154320 0x7ff7a80adb50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff7a806f610 tx=0x7ff7a0017000 comp rx=0 tx=0).stop 2023-10-09T06:54:28.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.955+0000 7ff7aebff700 1 -- 172.21.15.71:0/3763042595 shutdown_connections 2023-10-09T06:54:28.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.955+0000 7ff7aebff700 1 --2- 172.21.15.71:0/3763042595 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff78c067130 0x7ff78c0695e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:28.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.955+0000 7ff7aebff700 1 --2- 172.21.15.71:0/3763042595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a8154320 0x7ff7a80adb50 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:28.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.955+0000 7ff7aebff700 1 --2- 172.21.15.71:0/3763042595 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a806d840 0x7ff7a815f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:28.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.955+0000 7ff7aebff700 1 --2- 172.21.15.71:0/3763042595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7a8153f50 0x7ff7a81452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:28.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.955+0000 7ff7aebff700 1 -- 172.21.15.71:0/3763042595 >> 172.21.15.71:0/3763042595 conn(0x7ff7a806baf0 msgr2=0x7ff7a80b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:28.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.955+0000 7ff7aebff700 1 -- 172.21.15.71:0/3763042595 shutdown_connections 2023-10-09T06:54:28.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:28.955+0000 7ff7aebff700 1 -- 172.21.15.71:0/3763042595 wait complete. 2023-10-09T06:54:28.973 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:43:57", "first": "2023-10-09T06:44:00", "last": "2023-10-09T06:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T06:54:28.973 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir6', 'rel_path': '/snap_test_dir1/dir6', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T06:43:57', 'first': '2023-10-09T06:44:00', 'last': '2023-10-09T06:54:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-09T06:54:28.973 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-09T06:54:28.973 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-09T06:54:28.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:28.974 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-10-09T06:54:29.012 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:29.012 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:29.012 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:29.012 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:29.012 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:29.013 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:29.013 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:29.013 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:29.013 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:29.013 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:29.013 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:29.014 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-06_44_00_UTC', 'scheduled-2023-10-09-06_45_00_UTC', 'scheduled-2023-10-09-06_46_00_UTC', 'scheduled-2023-10-09-06_47_00_UTC', 'scheduled-2023-10-09-06_48_00_UTC', 'scheduled-2023-10-09-06_49_00_UTC', 'scheduled-2023-10-09-06_50_00_UTC', 'scheduled-2023-10-09-06_51_00_UTC', 'scheduled-2023-10-09-06_52_00_UTC', 'scheduled-2023-10-09-06_53_00_UTC', 'scheduled-2023-10-09-06_54_00_UTC'] 2023-10-09T06:54:29.015 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir7 2023-10-09T06:54:29.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.238+0000 7f08e599d700 1 Processor -- start 2023-10-09T06:54:29.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.238+0000 7f08e599d700 1 -- start start 2023-10-09T06:54:29.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.239+0000 7f08e599d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f08e0156350 0x7f08e0157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:29.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.239+0000 7f08e599d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f08e00b0760 0x7f08e00b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:29.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.240+0000 7f08e599d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e00b0570 con 0x7f08e0159f20 2023-10-09T06:54:29.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.240+0000 7f08e599d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e00b1140 con 0x7f08e00b0760 2023-10-09T06:54:29.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.240+0000 7f08e599d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e01578b0 con 0x7f08e0156350 2023-10-09T06:54:29.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.240+0000 7f08dffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f08e00b0760 0x7f08e00b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:29.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.240+0000 7f08e519c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f08e0159f20 0x7f08e015a320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33664/0 (socket says 172.21.15.71:33664) 2023-10-09T06:54:29.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.240+0000 7f08e519c700 1 -- 172.21.15.71:0/3631860398 learned_addr learned my addr 172.21.15.71:0/3631860398 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:29.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.240+0000 7f08e499b700 1 --2- 172.21.15.71:0/3631860398 >> v2:172.21.15.179:3300/0 conn(0x7f08e0156350 0x7f08e0157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:29.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.240+0000 7f08dffff700 1 -- 172.21.15.71:0/3631860398 >> v2:172.21.15.179:3300/0 conn(0x7f08e0156350 msgr2=0x7f08e0157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:29.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.240+0000 7f08dffff700 1 --2- 172.21.15.71:0/3631860398 >> v2:172.21.15.179:3300/0 conn(0x7f08e0156350 0x7f08e0157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:29.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.240+0000 7f08dffff700 1 -- 172.21.15.71:0/3631860398 >> v1:172.21.15.71:6789/0 conn(0x7f08e0159f20 legacy=0x7f08e015a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:29.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.240+0000 7f08dffff700 1 -- 172.21.15.71:0/3631860398 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e00af4d0 con 0x7f08e00b0760 2023-10-09T06:54:29.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.240+0000 7f08e499b700 1 --2- 172.21.15.71:0/3631860398 >> v2:172.21.15.179:3300/0 conn(0x7f08e0156350 0x7f08e0157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:54:29.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.240+0000 7f08df7fe700 1 -- 172.21.15.71:0/3631860398 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602770417 0 0) 0x7f08e00b0570 con 0x7f08e0159f20 2023-10-09T06:54:29.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.241+0000 7f08dffff700 1 --2- 172.21.15.71:0/3631860398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08e00b0760 0x7f08e00b0c00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f08e0065950 tx=0x7f08cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48e44b3be4b628d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:29.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.241+0000 7f08df7fe700 1 -- 172.21.15.71:0/3631860398 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc00b6b0 con 0x7f08e00b0760 2023-10-09T06:54:29.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.241+0000 7f08df7fe700 1 -- 172.21.15.71:0/3631860398 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc00b810 con 0x7f08e00b0760 2023-10-09T06:54:29.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.241+0000 7f08df7fe700 1 -- 172.21.15.71:0/3631860398 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc00bbb0 con 0x7f08e00b0760 2023-10-09T06:54:29.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.241+0000 7f08e599d700 1 -- 172.21.15.71:0/3631860398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08e00b0760 msgr2=0x7f08e00b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:29.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.241+0000 7f08e599d700 1 --2- 172.21.15.71:0/3631860398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08e00b0760 0x7f08e00b0c00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f08e0065950 tx=0x7f08cc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:29.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.241+0000 7f08e599d700 1 -- 172.21.15.71:0/3631860398 shutdown_connections 2023-10-09T06:54:29.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.241+0000 7f08e599d700 1 --2- 172.21.15.71:0/3631860398 >> v2:172.21.15.179:3300/0 conn(0x7f08e0156350 0x7f08e0157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:29.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.241+0000 7f08e599d700 1 --2- 172.21.15.71:0/3631860398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08e00b0760 0x7f08e00b0c00 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:29.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.241+0000 7f08e599d700 1 -- 172.21.15.71:0/3631860398 >> 172.21.15.71:0/3631860398 conn(0x7f08e0068e20 msgr2=0x7f08e00cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:29.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.241+0000 7f08e599d700 1 -- 172.21.15.71:0/3631860398 shutdown_connections 2023-10-09T06:54:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.241+0000 7f08e599d700 1 -- 172.21.15.71:0/3631860398 wait complete. 2023-10-09T06:54:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.243+0000 7f08e599d700 1 Processor -- start 2023-10-09T06:54:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.243+0000 7f08e599d700 1 -- start start 2023-10-09T06:54:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.244+0000 7f08e599d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08e00b0760 0x7f08e015eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.244+0000 7f08e599d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08e0156350 0x7f08e00abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.244+0000 7f08e599d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08e0159f20 0x7f08e016d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.244+0000 7f08e599d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e016d120 con 0x7f08e0156350 2023-10-09T06:54:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.244+0000 7f08e599d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e00c9550 con 0x7f08e0159f20 2023-10-09T06:54:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.244+0000 7f08e599d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e00c9830 con 0x7f08e00b0760 2023-10-09T06:54:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.244+0000 7f08dffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08e0156350 0x7f08e00abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.244+0000 7f08dffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08e0156350 0x7f08e00abd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39118/0 (socket says 172.21.15.71:39118) 2023-10-09T06:54:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.244+0000 7f08dffff700 1 -- 172.21.15.71:0/3478273036 learned_addr learned my addr 172.21.15.71:0/3478273036 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.245+0000 7f08e519c700 1 --2- 172.21.15.71:0/3478273036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08e0159f20 0x7f08e016d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.245+0000 7f08e499b700 1 --2- 172.21.15.71:0/3478273036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08e00b0760 0x7f08e015eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.245+0000 7f08dffff700 1 -- 172.21.15.71:0/3478273036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08e00b0760 msgr2=0x7f08e015eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.245+0000 7f08dffff700 1 --2- 172.21.15.71:0/3478273036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08e00b0760 0x7f08e015eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.245+0000 7f08dffff700 1 -- 172.21.15.71:0/3478273036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08e0159f20 msgr2=0x7f08e016d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.245+0000 7f08dffff700 1 --2- 172.21.15.71:0/3478273036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08e0159f20 0x7f08e016d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:29.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.245+0000 7f08dffff700 1 -- 172.21.15.71:0/3478273036 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc009420 con 0x7f08e0156350 2023-10-09T06:54:29.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.245+0000 7f08e499b700 1 --2- 172.21.15.71:0/3478273036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08e00b0760 0x7f08e015eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:54:29.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.245+0000 7f08e519c700 1 --2- 172.21.15.71:0/3478273036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08e0159f20 0x7f08e016d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:54:29.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.245+0000 7f08dffff700 1 --2- 172.21.15.71:0/3478273036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08e0156350 0x7f08e00abd50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f08e00714a0 tx=0x7f08cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:29.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.245+0000 7f08dcff9700 1 -- 172.21.15.71:0/3478273036 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc00bb90 con 0x7f08e0156350 2023-10-09T06:54:29.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.245+0000 7f08dcff9700 1 -- 172.21.15.71:0/3478273036 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc011420 con 0x7f08e0156350 2023-10-09T06:54:29.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.245+0000 7f08dcff9700 1 -- 172.21.15.71:0/3478273036 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc0117a0 con 0x7f08e0156350 2023-10-09T06:54:29.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.245+0000 7f08e599d700 1 -- 172.21.15.71:0/3478273036 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e00c9b10 con 0x7f08e0156350 2023-10-09T06:54:29.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.246+0000 7f08e599d700 1 -- 172.21.15.71:0/3478273036 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e00c9df0 con 0x7f08e0156350 2023-10-09T06:54:29.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.246+0000 7f08e599d700 1 -- 172.21.15.71:0/3478273036 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e016d290 con 0x7f08e0156350 2023-10-09T06:54:29.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.247+0000 7f08dcff9700 1 -- 172.21.15.71:0/3478273036 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f08cc011b90 con 0x7f08e0156350 2023-10-09T06:54:29.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.248+0000 7f08dcff9700 1 --2- 172.21.15.71:0/3478273036 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f08c4067130 0x7f08c40695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:29.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.248+0000 7f08dcff9700 1 -- 172.21.15.71:0/3478273036 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f08cc0862b0 con 0x7f08e0156350 2023-10-09T06:54:29.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.248+0000 7f08e499b700 1 --2- 172.21.15.71:0/3478273036 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f08c4067130 0x7f08c40695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:29.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.249+0000 7f08e499b700 1 --2- 172.21.15.71:0/3478273036 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f08c4067130 0x7f08c40695e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f08d4006f00 tx=0x7f08d4008040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:29.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.252+0000 7f08dcff9700 1 -- 172.21.15.71:0/3478273036 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08cc053100 con 0x7f08e0156350 2023-10-09T06:54:29.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.464+0000 7f08e599d700 1 -- 172.21.15.71:0/3478273036 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f08e004c3c0 con 0x7f08c4067130 2023-10-09T06:54:29.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.473+0000 7f08dcff9700 1 -- 172.21.15.71:0/3478273036 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f08e004c3c0 con 0x7f08c4067130 2023-10-09T06:54:29.474 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:54:29.474 INFO:teuthology.orchestra.run.smithi071.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:43:57", "first": "2023-10-09T06:44:00", "last": "2023-10-09T06:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T06:54:29.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.475+0000 7f08e599d700 1 -- 172.21.15.71:0/3478273036 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f08c4067130 msgr2=0x7f08c40695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:29.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.475+0000 7f08e599d700 1 --2- 172.21.15.71:0/3478273036 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f08c4067130 0x7f08c40695e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f08d4006f00 tx=0x7f08d4008040 comp rx=0 tx=0).stop 2023-10-09T06:54:29.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.475+0000 7f08e599d700 1 -- 172.21.15.71:0/3478273036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08e0156350 msgr2=0x7f08e00abd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:29.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.475+0000 7f08e599d700 1 --2- 172.21.15.71:0/3478273036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08e0156350 0x7f08e00abd50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f08e00714a0 tx=0x7f08cc017000 comp rx=0 tx=0).stop 2023-10-09T06:54:29.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.475+0000 7f08e599d700 1 -- 172.21.15.71:0/3478273036 shutdown_connections 2023-10-09T06:54:29.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.475+0000 7f08e599d700 1 --2- 172.21.15.71:0/3478273036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08e0159f20 0x7f08e016d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:29.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.475+0000 7f08e599d700 1 --2- 172.21.15.71:0/3478273036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08e00b0760 0x7f08e015eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:29.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.475+0000 7f08e599d700 1 --2- 172.21.15.71:0/3478273036 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f08c4067130 0x7f08c40695e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:29.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.475+0000 7f08e599d700 1 --2- 172.21.15.71:0/3478273036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08e0156350 0x7f08e00abd50 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:29.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.475+0000 7f08e599d700 1 -- 172.21.15.71:0/3478273036 >> 172.21.15.71:0/3478273036 conn(0x7f08e0068e20 msgr2=0x7f08e0154cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:29.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.476+0000 7f08e599d700 1 -- 172.21.15.71:0/3478273036 shutdown_connections 2023-10-09T06:54:29.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.476+0000 7f08e599d700 1 -- 172.21.15.71:0/3478273036 wait complete. 2023-10-09T06:54:29.493 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:43:57", "first": "2023-10-09T06:44:00", "last": "2023-10-09T06:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T06:54:29.493 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir7', 'rel_path': '/snap_test_dir1/dir7', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T06:43:57', 'first': '2023-10-09T06:44:00', 'last': '2023-10-09T06:54:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-09T06:54:29.494 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-09T06:54:29.494 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-09T06:54:29.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:29.494 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-10-09T06:54:29.531 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:29.531 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:29.532 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:29.532 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:29.532 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:29.532 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:29.532 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:29.532 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:29.532 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:29.532 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:29.532 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:29.533 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-06_44_00_UTC', 'scheduled-2023-10-09-06_45_00_UTC', 'scheduled-2023-10-09-06_46_00_UTC', 'scheduled-2023-10-09-06_47_00_UTC', 'scheduled-2023-10-09-06_48_00_UTC', 'scheduled-2023-10-09-06_49_00_UTC', 'scheduled-2023-10-09-06_50_00_UTC', 'scheduled-2023-10-09-06_51_00_UTC', 'scheduled-2023-10-09-06_52_00_UTC', 'scheduled-2023-10-09-06_53_00_UTC', 'scheduled-2023-10-09-06_54_00_UTC'] 2023-10-09T06:54:29.533 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir8 2023-10-09T06:54:29.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.760+0000 7f21a0b9d700 1 Processor -- start 2023-10-09T06:54:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.760+0000 7f21a0b9d700 1 -- start start 2023-10-09T06:54:29.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.761+0000 7f21a0b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f219c0b0760 0x7f219c0b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:29.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.761+0000 7f21a0b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f219c0ace60 0x7f219c0ad280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:29.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.761+0000 7f21a0b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219c0b0570 con 0x7f219c156350 2023-10-09T06:54:29.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.761+0000 7f21a0b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f219c0b1140 con 0x7f219c0b0760 2023-10-09T06:54:29.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.761+0000 7f21a0b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219c0af4d0 con 0x7f219c0ace60 2023-10-09T06:54:29.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.762+0000 7f219b7fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f219c156350 0x7f219c157370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:37536/0 (socket says 172.21.15.71:37536) 2023-10-09T06:54:29.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.762+0000 7f219b7fe700 1 -- 172.21.15.71:0/2259471304 learned_addr learned my addr 172.21.15.71:0/2259471304 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:29.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.762+0000 7f219affd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f219c0b0760 0x7f219c0b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:29.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.762+0000 7f219bfff700 1 --2- 172.21.15.71:0/2259471304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f219c0ace60 0x7f219c0ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:29.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.762+0000 7f219a7fc700 1 -- 172.21.15.71:0/2259471304 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2458883711 0 0) 0x7f219c0b0570 con 0x7f219c156350 2023-10-09T06:54:29.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.762+0000 7f219a7fc700 1 -- 172.21.15.71:0/2259471304 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2184003570 con 0x7f219c156350 2023-10-09T06:54:29.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.762+0000 7f219affd700 1 -- 172.21.15.71:0/2259471304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f219c0ace60 msgr2=0x7f219c0ad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:29.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.762+0000 7f219affd700 1 --2- 172.21.15.71:0/2259471304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f219c0ace60 0x7f219c0ad280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:29.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.762+0000 7f219affd700 1 -- 172.21.15.71:0/2259471304 >> v1:172.21.15.179:6789/0 conn(0x7f219c156350 legacy=0x7f219c157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:29.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.762+0000 7f219affd700 1 -- 172.21.15.71:0/2259471304 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219c0af7b0 con 0x7f219c0b0760 2023-10-09T06:54:29.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.762+0000 7f219bfff700 1 --2- 172.21.15.71:0/2259471304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f219c0ace60 0x7f219c0ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:54:29.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.762+0000 7f219affd700 1 --2- 172.21.15.71:0/2259471304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f219c0b0760 0x7f219c0b0c00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f21900098e0 tx=0x7f21900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa7d2215d09f96c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:29.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.763+0000 7f219a7fc700 1 -- 172.21.15.71:0/2259471304 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219000f6b0 con 0x7f219c0b0760 2023-10-09T06:54:29.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.763+0000 7f219a7fc700 1 -- 172.21.15.71:0/2259471304 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219000f810 con 0x7f219c0b0760 2023-10-09T06:54:29.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.763+0000 7f219a7fc700 1 -- 172.21.15.71:0/2259471304 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219000fbb0 con 0x7f219c0b0760 2023-10-09T06:54:29.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.763+0000 7f21a0b9d700 1 -- 172.21.15.71:0/2259471304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f219c0b0760 msgr2=0x7f219c0b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:29.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.763+0000 7f21a0b9d700 1 --2- 172.21.15.71:0/2259471304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f219c0b0760 0x7f219c0b0c00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f21900098e0 tx=0x7f21900091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:29.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.763+0000 7f21a0b9d700 1 -- 172.21.15.71:0/2259471304 shutdown_connections 2023-10-09T06:54:29.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.763+0000 7f21a0b9d700 1 --2- 172.21.15.71:0/2259471304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f219c0ace60 0x7f219c0ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:29.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.763+0000 7f21a0b9d700 1 --2- 172.21.15.71:0/2259471304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f219c0b0760 0x7f219c0b0c00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:29.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.763+0000 7f21a0b9d700 1 -- 172.21.15.71:0/2259471304 >> 172.21.15.71:0/2259471304 conn(0x7f219c068e20 msgr2=0x7f219c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:29.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.763+0000 7f21a0b9d700 1 -- 172.21.15.71:0/2259471304 shutdown_connections 2023-10-09T06:54:29.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.763+0000 7f21a0b9d700 1 -- 172.21.15.71:0/2259471304 wait complete. 2023-10-09T06:54:29.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.765+0000 7f21a0b9d700 1 Processor -- start 2023-10-09T06:54:29.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.765+0000 7f21a0b9d700 1 -- start start 2023-10-09T06:54:29.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.766+0000 7f21a0b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f219c0ace60 0x7f219c166310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:29.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.766+0000 7f21a0b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f219c0b0760 0x7f219c0ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:29.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.766+0000 7f21a0b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f219c156350 0x7f219c14eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:29.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.766+0000 7f21a0b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219c0a54c0 con 0x7f219c156350 2023-10-09T06:54:29.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.766+0000 7f21a0b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219c0caf30 con 0x7f219c0ace60 2023-10-09T06:54:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.766+0000 7f21a0b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219c0cb1d0 con 0x7f219c0b0760 2023-10-09T06:54:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.766+0000 7f219bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f219c156350 0x7f219c14eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.766+0000 7f219bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f219c156350 0x7f219c14eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39122/0 (socket says 172.21.15.71:39122) 2023-10-09T06:54:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.766+0000 7f219bfff700 1 -- 172.21.15.71:0/152207979 learned_addr learned my addr 172.21.15.71:0/152207979 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.766+0000 7f219b7fe700 1 --2- 172.21.15.71:0/152207979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f219c0ace60 0x7f219c166310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.766+0000 7f219affd700 1 --2- 172.21.15.71:0/152207979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f219c0b0760 0x7f219c0ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.766+0000 7f219bfff700 1 -- 172.21.15.71:0/152207979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f219c0b0760 msgr2=0x7f219c0ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.766+0000 7f219bfff700 1 --2- 172.21.15.71:0/152207979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f219c0b0760 0x7f219c0ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.766+0000 7f219bfff700 1 -- 172.21.15.71:0/152207979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f219c0ace60 msgr2=0x7f219c166310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.766+0000 7f219bfff700 1 --2- 172.21.15.71:0/152207979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f219c0ace60 0x7f219c166310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.766+0000 7f219bfff700 1 -- 172.21.15.71:0/152207979 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2194009a20 con 0x7f219c156350 2023-10-09T06:54:29.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.766+0000 7f219b7fe700 1 --2- 172.21.15.71:0/152207979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f219c0ace60 0x7f219c166310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:54:29.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.767+0000 7f219bfff700 1 --2- 172.21.15.71:0/152207979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f219c156350 0x7f219c14eda0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2194009f20 tx=0x7f219400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:29.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.767+0000 7f21837fe700 1 -- 172.21.15.71:0/152207979 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219400cbd0 con 0x7f219c156350 2023-10-09T06:54:29.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.767+0000 7f21837fe700 1 -- 172.21.15.71:0/152207979 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219400f040 con 0x7f219c156350 2023-10-09T06:54:29.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.767+0000 7f21a0b9d700 1 -- 172.21.15.71:0/152207979 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2190009420 con 0x7f219c156350 2023-10-09T06:54:29.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.767+0000 7f21837fe700 1 -- 172.21.15.71:0/152207979 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2194014480 con 0x7f219c156350 2023-10-09T06:54:29.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.767+0000 7f21a0b9d700 1 -- 172.21.15.71:0/152207979 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219c0cb790 con 0x7f219c156350 2023-10-09T06:54:29.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.768+0000 7f21a0b9d700 1 -- 172.21.15.71:0/152207979 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f219c0a5630 con 0x7f219c156350 2023-10-09T06:54:29.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.769+0000 7f21837fe700 1 -- 172.21.15.71:0/152207979 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f2194003020 con 0x7f219c156350 2023-10-09T06:54:29.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.770+0000 7f21837fe700 1 --2- 172.21.15.71:0/152207979 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2188067130 0x7f21880695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:29.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.770+0000 7f21837fe700 1 -- 172.21.15.71:0/152207979 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f21940853d0 con 0x7f219c156350 2023-10-09T06:54:29.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.770+0000 7f219b7fe700 1 --2- 172.21.15.71:0/152207979 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2188067130 0x7f21880695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:29.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.771+0000 7f219b7fe700 1 --2- 172.21.15.71:0/152207979 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2188067130 0x7f21880695e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f219c156ab0 tx=0x7f218c009040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:29.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.773+0000 7f21837fe700 1 -- 172.21.15.71:0/152207979 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21940521b0 con 0x7f219c156350 2023-10-09T06:54:29.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.990+0000 7f21a0b9d700 1 -- 172.21.15.71:0/152207979 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f219c04c3c0 con 0x7f2188067130 2023-10-09T06:54:30.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:29.999+0000 7f21837fe700 1 -- 172.21.15.71:0/152207979 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f219c04c3c0 con 0x7f2188067130 2023-10-09T06:54:30.000 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:54:30.000 INFO:teuthology.orchestra.run.smithi071.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:43:58", "first": "2023-10-09T06:44:00", "last": "2023-10-09T06:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T06:54:30.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.002+0000 7f21a0b9d700 1 -- 172.21.15.71:0/152207979 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2188067130 msgr2=0x7f21880695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:30.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.002+0000 7f21a0b9d700 1 --2- 172.21.15.71:0/152207979 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2188067130 0x7f21880695e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f219c156ab0 tx=0x7f218c009040 comp rx=0 tx=0).stop 2023-10-09T06:54:30.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.002+0000 7f21a0b9d700 1 -- 172.21.15.71:0/152207979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f219c156350 msgr2=0x7f219c14eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:30.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.002+0000 7f21a0b9d700 1 --2- 172.21.15.71:0/152207979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f219c156350 0x7f219c14eda0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2194009f20 tx=0x7f219400b040 comp rx=0 tx=0).stop 2023-10-09T06:54:30.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.002+0000 7f21a0b9d700 1 -- 172.21.15.71:0/152207979 shutdown_connections 2023-10-09T06:54:30.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.002+0000 7f21a0b9d700 1 --2- 172.21.15.71:0/152207979 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2188067130 0x7f21880695e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:30.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.002+0000 7f21a0b9d700 1 --2- 172.21.15.71:0/152207979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f219c156350 0x7f219c14eda0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:30.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.002+0000 7f21a0b9d700 1 --2- 172.21.15.71:0/152207979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f219c0ace60 0x7f219c166310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:30.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.002+0000 7f21a0b9d700 1 --2- 172.21.15.71:0/152207979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f219c0b0760 0x7f219c0ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:30.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.002+0000 7f21a0b9d700 1 -- 172.21.15.71:0/152207979 >> 172.21.15.71:0/152207979 conn(0x7f219c068e20 msgr2=0x7f219c0c8510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:30.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.002+0000 7f21a0b9d700 1 -- 172.21.15.71:0/152207979 shutdown_connections 2023-10-09T06:54:30.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.002+0000 7f21a0b9d700 1 -- 172.21.15.71:0/152207979 wait complete. 2023-10-09T06:54:30.020 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:43:58", "first": "2023-10-09T06:44:00", "last": "2023-10-09T06:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T06:54:30.020 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir8', 'rel_path': '/snap_test_dir1/dir8', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T06:43:58', 'first': '2023-10-09T06:44:00', 'last': '2023-10-09T06:54:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-09T06:54:30.020 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-09T06:54:30.021 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-09T06:54:30.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:30.021 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-10-09T06:54:30.058 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:30.058 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:30.059 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:30.060 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-06_44_00_UTC', 'scheduled-2023-10-09-06_45_00_UTC', 'scheduled-2023-10-09-06_46_00_UTC', 'scheduled-2023-10-09-06_47_00_UTC', 'scheduled-2023-10-09-06_48_00_UTC', 'scheduled-2023-10-09-06_49_00_UTC', 'scheduled-2023-10-09-06_50_00_UTC', 'scheduled-2023-10-09-06_51_00_UTC', 'scheduled-2023-10-09-06_52_00_UTC', 'scheduled-2023-10-09-06_53_00_UTC', 'scheduled-2023-10-09-06_54_00_UTC'] 2023-10-09T06:54:30.060 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir9 2023-10-09T06:54:30.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.284+0000 7f0a171ff700 1 Processor -- start 2023-10-09T06:54:30.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.285+0000 7f0a171ff700 1 -- start start 2023-10-09T06:54:30.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.286+0000 7f0a171ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0a101563b0 0x7f0a10156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:30.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.286+0000 7f0a171ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a1015a440 0x7f0a100acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:30.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.286+0000 7f0a171ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a1015a9b0 con 0x7f0a10068890 2023-10-09T06:54:30.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.286+0000 7f0a171ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a1015ac90 con 0x7f0a101563b0 2023-10-09T06:54:30.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.286+0000 7f0a171ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1015af70 con 0x7f0a1015a440 2023-10-09T06:54:30.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.286+0000 7f0a1579c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f0a10068890 0x7f0a100c8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33674/0 (socket says 172.21.15.71:33674) 2023-10-09T06:54:30.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.286+0000 7f0a1579c700 1 -- 172.21.15.71:0/986708108 learned_addr learned my addr 172.21.15.71:0/986708108 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:30.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.286+0000 7f0a14f9b700 1 --2- 172.21.15.71:0/986708108 >> v2:172.21.15.179:3300/0 conn(0x7f0a101563b0 0x7f0a10156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:30.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.286+0000 7f0a0f7fe700 1 -- 172.21.15.71:0/986708108 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649542673 0 0) 0x7f0a1015a9b0 con 0x7f0a10068890 2023-10-09T06:54:30.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.286+0000 7f0a0ffff700 1 --2- 172.21.15.71:0/986708108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a1015a440 0x7f0a100acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.286+0000 7f0a0f7fe700 1 -- 172.21.15.71:0/986708108 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a00003570 con 0x7f0a10068890 2023-10-09T06:54:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.287+0000 7f0a0f7fe700 1 -- 172.21.15.71:0/986708108 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2145822454 0 0) 0x7f0a00003570 con 0x7f0a10068890 2023-10-09T06:54:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.287+0000 7f0a0f7fe700 1 -- 172.21.15.71:0/986708108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a1015a440 msgr2=0x7f0a100acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.287+0000 7f0a0f7fe700 1 --2- 172.21.15.71:0/986708108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a1015a440 0x7f0a100acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.287+0000 7f0a0f7fe700 1 -- 172.21.15.71:0/986708108 >> v2:172.21.15.179:3300/0 conn(0x7f0a101563b0 msgr2=0x7f0a10156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.287+0000 7f0a0f7fe700 1 --2- 172.21.15.71:0/986708108 >> v2:172.21.15.179:3300/0 conn(0x7f0a101563b0 0x7f0a10156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.287+0000 7f0a0f7fe700 1 -- 172.21.15.71:0/986708108 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1015b250 con 0x7f0a10068890 2023-10-09T06:54:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.287+0000 7f0a0f7fe700 1 -- 172.21.15.71:0/986708108 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f0a080017f0 con 0x7f0a10068890 2023-10-09T06:54:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.287+0000 7f0a0f7fe700 1 -- 172.21.15.71:0/986708108 >> v1:172.21.15.71:6789/0 conn(0x7f0a10068890 legacy=0x7f0a100c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.287+0000 7f0a0f7fe700 1 --2- 172.21.15.71:0/986708108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a00003ae0 0x7f0a00003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.287+0000 7f0a0f7fe700 1 --2- 172.21.15.71:0/986708108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a00004810 0x7f0a00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:30.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.287+0000 7f0a0f7fe700 1 --2- 172.21.15.71:0/986708108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a1015a440 0x7f0a000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:30.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.287+0000 7f0a0f7fe700 1 -- 172.21.15.71:0/986708108 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1015ac90 con 0x7f0a00004810 2023-10-09T06:54:30.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.287+0000 7f0a0f7fe700 1 -- 172.21.15.71:0/986708108 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1015af70 con 0x7f0a00003ae0 2023-10-09T06:54:30.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.287+0000 7f0a0f7fe700 1 -- 172.21.15.71:0/986708108 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0000bb10 con 0x7f0a1015a440 2023-10-09T06:54:30.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.287+0000 7f0a0ffff700 1 --2- 172.21.15.71:0/986708108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a00004810 0x7f0a00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:30.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.287+0000 7f0a1579c700 1 --2- 172.21.15.71:0/986708108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a1015a440 0x7f0a000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:30.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.288+0000 7f0a0ffff700 1 -- 172.21.15.71:0/986708108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a1015a440 msgr2=0x7f0a000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:30.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.288+0000 7f0a0ffff700 1 --2- 172.21.15.71:0/986708108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a1015a440 0x7f0a000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:30.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.288+0000 7f0a0ffff700 1 -- 172.21.15.71:0/986708108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a00003ae0 msgr2=0x7f0a00003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:30.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.288+0000 7f0a14f9b700 1 --2- 172.21.15.71:0/986708108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a00003ae0 0x7f0a00003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:30.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.288+0000 7f0a0ffff700 1 --2- 172.21.15.71:0/986708108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a00003ae0 0x7f0a00003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:30.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.288+0000 7f0a0ffff700 1 -- 172.21.15.71:0/986708108 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a00003570 con 0x7f0a00004810 2023-10-09T06:54:30.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.288+0000 7f0a14f9b700 1 --2- 172.21.15.71:0/986708108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a00003ae0 0x7f0a00003ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:54:30.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.288+0000 7f0a0ffff700 1 --2- 172.21.15.71:0/986708108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a00004810 0x7f0a00004c80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f09fc010210 tx=0x7f09fc00d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3f35ce62d09498 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:30.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.288+0000 7f0a0f7fe700 1 -- 172.21.15.71:0/986708108 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc010ac0 con 0x7f0a00004810 2023-10-09T06:54:30.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.288+0000 7f0a0f7fe700 1 -- 172.21.15.71:0/986708108 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09fc011040 con 0x7f0a00004810 2023-10-09T06:54:30.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.288+0000 7f0a0f7fe700 1 -- 172.21.15.71:0/986708108 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc010e70 con 0x7f0a00004810 2023-10-09T06:54:30.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.289+0000 7f0a171ff700 1 -- 172.21.15.71:0/986708108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a00004810 msgr2=0x7f0a00004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:30.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.289+0000 7f0a171ff700 1 --2- 172.21.15.71:0/986708108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a00004810 0x7f0a00004c80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f09fc010210 tx=0x7f09fc00d040 comp rx=0 tx=0).stop 2023-10-09T06:54:30.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.289+0000 7f0a1579c700 1 -- 172.21.15.71:0/986708108 reap_dead start 2023-10-09T06:54:30.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.289+0000 7f0a171ff700 1 -- 172.21.15.71:0/986708108 shutdown_connections 2023-10-09T06:54:30.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.289+0000 7f0a171ff700 1 -- 172.21.15.71:0/986708108 >> 172.21.15.71:0/986708108 conn(0x7f0a100c8f90 msgr2=0x7f0a100c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:30.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.289+0000 7f0a171ff700 1 -- 172.21.15.71:0/986708108 shutdown_connections 2023-10-09T06:54:30.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.289+0000 7f0a171ff700 1 -- 172.21.15.71:0/986708108 wait complete. 2023-10-09T06:54:30.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.290+0000 7f0a171ff700 1 Processor -- start 2023-10-09T06:54:30.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.290+0000 7f0a171ff700 1 -- start start 2023-10-09T06:54:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.291+0000 7f0a171ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a00004810 0x7f0a100c2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.291+0000 7f0a171ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a100c2fd0 0x7f0a10169d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.291+0000 7f0a171ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a10152660 0x7f0a1016a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.291+0000 7f0a171ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a100c0e50 con 0x7f0a00004810 2023-10-09T06:54:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.291+0000 7f0a171ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a100c1130 con 0x7f0a10152660 2023-10-09T06:54:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.291+0000 7f0a171ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a100c1410 con 0x7f0a100c2fd0 2023-10-09T06:54:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.291+0000 7f0a14f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a00004810 0x7f0a100c2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.291+0000 7f0a14f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a00004810 0x7f0a100c2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39128/0 (socket says 172.21.15.71:39128) 2023-10-09T06:54:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.291+0000 7f0a14f9b700 1 -- 172.21.15.71:0/2843611332 learned_addr learned my addr 172.21.15.71:0/2843611332 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:30.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.292+0000 7f0a0ffff700 1 --2- 172.21.15.71:0/2843611332 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a100c2fd0 0x7f0a10169d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:30.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.292+0000 7f0a1579c700 1 --2- 172.21.15.71:0/2843611332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a10152660 0x7f0a1016a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:30.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.292+0000 7f0a14f9b700 1 -- 172.21.15.71:0/2843611332 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a100c2fd0 msgr2=0x7f0a10169d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:30.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.292+0000 7f0a14f9b700 1 --2- 172.21.15.71:0/2843611332 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a100c2fd0 0x7f0a10169d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:30.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.292+0000 7f0a14f9b700 1 -- 172.21.15.71:0/2843611332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a10152660 msgr2=0x7f0a1016a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:30.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.292+0000 7f0a14f9b700 1 --2- 172.21.15.71:0/2843611332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a10152660 0x7f0a1016a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:30.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.292+0000 7f0a14f9b700 1 -- 172.21.15.71:0/2843611332 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a100c16f0 con 0x7f0a00004810 2023-10-09T06:54:30.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.292+0000 7f0a14f9b700 1 --2- 172.21.15.71:0/2843611332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a00004810 0x7f0a100c2a90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0a04010ca0 tx=0x7f0a04008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:30.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.292+0000 7f0a0cff9700 1 -- 172.21.15.71:0/2843611332 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0400e870 con 0x7f0a00004810 2023-10-09T06:54:30.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.292+0000 7f0a0cff9700 1 -- 172.21.15.71:0/2843611332 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0400e9d0 con 0x7f0a00004810 2023-10-09T06:54:30.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.292+0000 7f0a0cff9700 1 -- 172.21.15.71:0/2843611332 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0400ed70 con 0x7f0a00004810 2023-10-09T06:54:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.292+0000 7f0a171ff700 1 -- 172.21.15.71:0/2843611332 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a100c0ab0 con 0x7f0a00004810 2023-10-09T06:54:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.293+0000 7f0a171ff700 1 -- 172.21.15.71:0/2843611332 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1016a980 con 0x7f0a00004810 2023-10-09T06:54:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.294+0000 7f0a171ff700 1 -- 172.21.15.71:0/2843611332 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1016ac00 con 0x7f0a00004810 2023-10-09T06:54:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.294+0000 7f0a0cff9700 1 -- 172.21.15.71:0/2843611332 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f0a0401c610 con 0x7f0a00004810 2023-10-09T06:54:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.295+0000 7f0a0cff9700 1 --2- 172.21.15.71:0/2843611332 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f09f4067130 0x7f09f40695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.295+0000 7f0a0cff9700 1 -- 172.21.15.71:0/2843611332 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f0a04084e40 con 0x7f0a00004810 2023-10-09T06:54:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.296+0000 7f0a0ffff700 1 --2- 172.21.15.71:0/2843611332 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f09f4067130 0x7f09f40695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.297+0000 7f0a0ffff700 1 --2- 172.21.15.71:0/2843611332 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f09f4067130 0x7f09f40695e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00cfd0 tx=0x7f09fc01c000 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:30.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.300+0000 7f0a0cff9700 1 -- 172.21.15.71:0/2843611332 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a04051c90 con 0x7f0a00004810 2023-10-09T06:54:30.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.514+0000 7f0a171ff700 1 -- 172.21.15.71:0/2843611332 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a100718b0 con 0x7f09f4067130 2023-10-09T06:54:30.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.523+0000 7f0a0cff9700 1 -- 172.21.15.71:0/2843611332 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f0a100718b0 con 0x7f09f4067130 2023-10-09T06:54:30.524 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:54:30.524 INFO:teuthology.orchestra.run.smithi071.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:43:59", "first": "2023-10-09T06:44:00", "last": "2023-10-09T06:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T06:54:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.525+0000 7f0a171ff700 1 -- 172.21.15.71:0/2843611332 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f09f4067130 msgr2=0x7f09f40695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.525+0000 7f0a171ff700 1 --2- 172.21.15.71:0/2843611332 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f09f4067130 0x7f09f40695e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00cfd0 tx=0x7f09fc01c000 comp rx=0 tx=0).stop 2023-10-09T06:54:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.525+0000 7f0a171ff700 1 -- 172.21.15.71:0/2843611332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a00004810 msgr2=0x7f0a100c2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.525+0000 7f0a171ff700 1 --2- 172.21.15.71:0/2843611332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a00004810 0x7f0a100c2a90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0a04010ca0 tx=0x7f0a04008040 comp rx=0 tx=0).stop 2023-10-09T06:54:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.525+0000 7f0a171ff700 1 -- 172.21.15.71:0/2843611332 shutdown_connections 2023-10-09T06:54:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.525+0000 7f0a171ff700 1 --2- 172.21.15.71:0/2843611332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a10152660 0x7f0a1016a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.525+0000 7f0a171ff700 1 --2- 172.21.15.71:0/2843611332 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f09f4067130 0x7f09f40695e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.525+0000 7f0a171ff700 1 --2- 172.21.15.71:0/2843611332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a00004810 0x7f0a100c2a90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.525+0000 7f0a171ff700 1 --2- 172.21.15.71:0/2843611332 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a100c2fd0 0x7f0a10169d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.525+0000 7f0a171ff700 1 -- 172.21.15.71:0/2843611332 >> 172.21.15.71:0/2843611332 conn(0x7f0a100c8f90 msgr2=0x7f0a10158e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.526+0000 7f0a171ff700 1 -- 172.21.15.71:0/2843611332 shutdown_connections 2023-10-09T06:54:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.526+0000 7f0a171ff700 1 -- 172.21.15.71:0/2843611332 wait complete. 2023-10-09T06:54:30.544 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:43:59", "first": "2023-10-09T06:44:00", "last": "2023-10-09T06:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T06:54:30.544 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir9', 'rel_path': '/snap_test_dir1/dir9', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T06:43:59', 'first': '2023-10-09T06:44:00', 'last': '2023-10-09T06:54:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-09T06:54:30.544 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-09T06:54:30.544 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-09T06:54:30.545 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir0 1M 2023-10-09T06:54:30.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.729+0000 7f4aae79d700 1 Processor -- start 2023-10-09T06:54:30.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.729+0000 7f4aae79d700 1 -- start start 2023-10-09T06:54:30.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.730+0000 7f4aae79d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4aa80b0790 0x7f4aa80cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:30.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.730+0000 7f4aae79d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aa81591e0 0x7f4aa8159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:30.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.730+0000 7f4aae79d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa80cfa00 con 0x7f4aa80b03c0 2023-10-09T06:54:30.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.730+0000 7f4aae79d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa80cb580 con 0x7f4aa80b0790 2023-10-09T06:54:30.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.730+0000 7f4aae79d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa80cf160 con 0x7f4aa81591e0 2023-10-09T06:54:30.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.730+0000 7f4aad79b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f4aa80b03c0 0x7f4aa80b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33686/0 (socket says 172.21.15.71:33686) 2023-10-09T06:54:30.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.730+0000 7f4aad79b700 1 -- 172.21.15.71:0/3542873634 learned_addr learned my addr 172.21.15.71:0/3542873634 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:30.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.731+0000 7f4aadf9c700 1 --2- 172.21.15.71:0/3542873634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aa81591e0 0x7f4aa8159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:30.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.731+0000 7f4aacf9a700 1 --2- 172.21.15.71:0/3542873634 >> v2:172.21.15.179:3300/0 conn(0x7f4aa80b0790 0x7f4aa80cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:30.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.731+0000 7f4a9ffff700 1 -- 172.21.15.71:0/3542873634 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849106876 0 0) 0x7f4aa80cfa00 con 0x7f4aa80b03c0 2023-10-09T06:54:30.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.731+0000 7f4a9ffff700 1 -- 172.21.15.71:0/3542873634 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a94003570 con 0x7f4aa80b03c0 2023-10-09T06:54:30.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.731+0000 7f4a9ffff700 1 -- 172.21.15.71:0/3542873634 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 555923737 0 0) 0x7f4a94003570 con 0x7f4aa80b03c0 2023-10-09T06:54:30.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.731+0000 7f4a9ffff700 1 -- 172.21.15.71:0/3542873634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aa81591e0 msgr2=0x7f4aa8159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:30.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.731+0000 7f4a9ffff700 1 --2- 172.21.15.71:0/3542873634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aa81591e0 0x7f4aa8159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:30.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.731+0000 7f4a9ffff700 1 -- 172.21.15.71:0/3542873634 >> v2:172.21.15.179:3300/0 conn(0x7f4aa80b0790 msgr2=0x7f4aa80cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:30.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.731+0000 7f4a9ffff700 1 --2- 172.21.15.71:0/3542873634 >> v2:172.21.15.179:3300/0 conn(0x7f4aa80b0790 0x7f4aa80cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:30.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.731+0000 7f4a9ffff700 1 -- 172.21.15.71:0/3542873634 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa80cf440 con 0x7f4aa80b03c0 2023-10-09T06:54:30.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.731+0000 7f4a9ffff700 1 -- 172.21.15.71:0/3542873634 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f4aa4001470 con 0x7f4aa80b03c0 2023-10-09T06:54:30.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.731+0000 7f4a9ffff700 1 -- 172.21.15.71:0/3542873634 >> v1:172.21.15.71:6789/0 conn(0x7f4aa80b03c0 legacy=0x7f4aa80b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:30.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.731+0000 7f4a9ffff700 1 --2- 172.21.15.71:0/3542873634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a94003a60 0x7f4a94003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:30.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.731+0000 7f4a9ffff700 1 --2- 172.21.15.71:0/3542873634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a94004810 0x7f4a94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:30.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.731+0000 7f4a9ffff700 1 --2- 172.21.15.71:0/3542873634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aa81591e0 0x7f4a940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:30.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.731+0000 7f4a9ffff700 1 -- 172.21.15.71:0/3542873634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa80cb580 con 0x7f4a94004810 2023-10-09T06:54:30.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.731+0000 7f4a9ffff700 1 -- 172.21.15.71:0/3542873634 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa80cf160 con 0x7f4a94003a60 2023-10-09T06:54:30.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.731+0000 7f4a9ffff700 1 -- 172.21.15.71:0/3542873634 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9400ba60 con 0x7f4aa81591e0 2023-10-09T06:54:30.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.732+0000 7f4aacf9a700 1 --2- 172.21.15.71:0/3542873634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a94004810 0x7f4a94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:30.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.732+0000 7f4aad79b700 1 --2- 172.21.15.71:0/3542873634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a94003a60 0x7f4a94003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:30.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.732+0000 7f4aadf9c700 1 --2- 172.21.15.71:0/3542873634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aa81591e0 0x7f4a940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:30.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.732+0000 7f4aacf9a700 1 -- 172.21.15.71:0/3542873634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aa81591e0 msgr2=0x7f4a940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:30.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.732+0000 7f4aacf9a700 1 --2- 172.21.15.71:0/3542873634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aa81591e0 0x7f4a940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:30.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.732+0000 7f4aacf9a700 1 -- 172.21.15.71:0/3542873634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a94003a60 msgr2=0x7f4a94003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:30.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.732+0000 7f4aacf9a700 1 --2- 172.21.15.71:0/3542873634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a94003a60 0x7f4a94003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:30.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.732+0000 7f4aacf9a700 1 -- 172.21.15.71:0/3542873634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a94003570 con 0x7f4a94004810 2023-10-09T06:54:30.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.732+0000 7f4aacf9a700 1 --2- 172.21.15.71:0/3542873634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a94004810 0x7f4a94004c80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4a98009c30 tx=0x7f4a980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7269d613bb25db63 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:30.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.733+0000 7f4a9ffff700 1 -- 172.21.15.71:0/3542873634 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9800e710 con 0x7f4a94004810 2023-10-09T06:54:30.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.733+0000 7f4a9ffff700 1 -- 172.21.15.71:0/3542873634 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9800e870 con 0x7f4a94004810 2023-10-09T06:54:30.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.733+0000 7f4a9ffff700 1 -- 172.21.15.71:0/3542873634 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9800ec30 con 0x7f4a94004810 2023-10-09T06:54:30.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.733+0000 7f4aae79d700 1 -- 172.21.15.71:0/3542873634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a94004810 msgr2=0x7f4a94004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:30.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.733+0000 7f4aae79d700 1 --2- 172.21.15.71:0/3542873634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a94004810 0x7f4a94004c80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4a98009c30 tx=0x7f4a980091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:30.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.733+0000 7f4aadf9c700 1 -- 172.21.15.71:0/3542873634 reap_dead start 2023-10-09T06:54:30.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.733+0000 7f4aae79d700 1 -- 172.21.15.71:0/3542873634 shutdown_connections 2023-10-09T06:54:30.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.733+0000 7f4aae79d700 1 -- 172.21.15.71:0/3542873634 >> 172.21.15.71:0/3542873634 conn(0x7f4aa8063230 msgr2=0x7f4aa8063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:30.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.733+0000 7f4aae79d700 1 -- 172.21.15.71:0/3542873634 shutdown_connections 2023-10-09T06:54:30.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.733+0000 7f4aae79d700 1 -- 172.21.15.71:0/3542873634 wait complete. 2023-10-09T06:54:30.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.736+0000 7f4aae79d700 1 Processor -- start 2023-10-09T06:54:30.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.736+0000 7f4aae79d700 1 -- start start 2023-10-09T06:54:30.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.737+0000 7f4aae79d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a94004810 0x7f4aa81578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:30.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.737+0000 7f4aae79d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aa80c3ff0 0x7f4aa80af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:30.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.737+0000 7f4aae79d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4aa80afb10 0x7f4aa815b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:30.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.737+0000 7f4aae79d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa816ab80 con 0x7f4a94004810 2023-10-09T06:54:30.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.737+0000 7f4aae79d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa816a000 con 0x7f4aa80afb10 2023-10-09T06:54:30.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.737+0000 7f4aae79d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa816a2e0 con 0x7f4aa80c3ff0 2023-10-09T06:54:30.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.737+0000 7f4aad79b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a94004810 0x7f4aa81578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:30.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.737+0000 7f4aad79b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a94004810 0x7f4aa81578e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39140/0 (socket says 172.21.15.71:39140) 2023-10-09T06:54:30.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.737+0000 7f4aad79b700 1 -- 172.21.15.71:0/3634480650 learned_addr learned my addr 172.21.15.71:0/3634480650 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:30.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.737+0000 7f4aacf9a700 1 --2- 172.21.15.71:0/3634480650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aa80c3ff0 0x7f4aa80af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:30.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.737+0000 7f4aadf9c700 1 --2- 172.21.15.71:0/3634480650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4aa80afb10 0x7f4aa815b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.738+0000 7f4aad79b700 1 -- 172.21.15.71:0/3634480650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aa80c3ff0 msgr2=0x7f4aa80af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.738+0000 7f4aad79b700 1 --2- 172.21.15.71:0/3634480650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aa80c3ff0 0x7f4aa80af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.738+0000 7f4aad79b700 1 -- 172.21.15.71:0/3634480650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4aa80afb10 msgr2=0x7f4aa815b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.738+0000 7f4aad79b700 1 --2- 172.21.15.71:0/3634480650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4aa80afb10 0x7f4aa815b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.738+0000 7f4aad79b700 1 -- 172.21.15.71:0/3634480650 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa816a5c0 con 0x7f4a94004810 2023-10-09T06:54:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.738+0000 7f4aadf9c700 1 --2- 172.21.15.71:0/3634480650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4aa80afb10 0x7f4aa815b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:54:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.738+0000 7f4aad79b700 1 --2- 172.21.15.71:0/3634480650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a94004810 0x7f4aa81578e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4007390 tx=0x7f4aa80cb6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.738+0000 7f4a9d7fa700 1 -- 172.21.15.71:0/3634480650 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4018030 con 0x7f4a94004810 2023-10-09T06:54:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.738+0000 7f4a9d7fa700 1 -- 172.21.15.71:0/3634480650 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa4007750 con 0x7f4a94004810 2023-10-09T06:54:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.738+0000 7f4aae79d700 1 -- 172.21.15.71:0/3634480650 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa816a8a0 con 0x7f4a94004810 2023-10-09T06:54:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.738+0000 7f4a9d7fa700 1 -- 172.21.15.71:0/3634480650 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa400fb20 con 0x7f4a94004810 2023-10-09T06:54:30.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.738+0000 7f4aae79d700 1 -- 172.21.15.71:0/3634480650 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa8169bd0 con 0x7f4a94004810 2023-10-09T06:54:30.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.739+0000 7f4aae79d700 1 -- 172.21.15.71:0/3634480650 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa8169dc0 con 0x7f4a94004810 2023-10-09T06:54:30.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.740+0000 7f4a9d7fa700 1 -- 172.21.15.71:0/3634480650 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f4aa401b070 con 0x7f4a94004810 2023-10-09T06:54:30.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.741+0000 7f4a9d7fa700 1 --2- 172.21.15.71:0/3634480650 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4a8c067130 0x7f4a8c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:30.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.741+0000 7f4a9d7fa700 1 -- 172.21.15.71:0/3634480650 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f4aa4019070 con 0x7f4a94004810 2023-10-09T06:54:30.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.741+0000 7f4aacf9a700 1 --2- 172.21.15.71:0/3634480650 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4a8c067130 0x7f4a8c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:30.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.742+0000 7f4aacf9a700 1 --2- 172.21.15.71:0/3634480650 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4a8c067130 0x7f4a8c0695e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4a980091e0 tx=0x7f4a9801a000 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:30.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.745+0000 7f4a9d7fa700 1 -- 172.21.15.71:0/3634480650 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4aa8169dc0 con 0x7f4a94004810 2023-10-09T06:54:30.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:30.963+0000 7f4aae79d700 1 -- 172.21.15.71:0/3634480650 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4aa8169dc0 con 0x7f4a8c067130 2023-10-09T06:54:31.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:31.044+0000 7f4a9d7fa700 1 -- 172.21.15.71:0/3634480650 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f4aa8169dc0 con 0x7f4a8c067130 2023-10-09T06:54:31.045 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule removed for path /snap_test_dir1/dir0 2023-10-09T06:54:31.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:31.046+0000 7f4aae79d700 1 -- 172.21.15.71:0/3634480650 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4a8c067130 msgr2=0x7f4a8c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:31.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:31.046+0000 7f4aae79d700 1 --2- 172.21.15.71:0/3634480650 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4a8c067130 0x7f4a8c0695e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4a980091e0 tx=0x7f4a9801a000 comp rx=0 tx=0).stop 2023-10-09T06:54:31.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:31.046+0000 7f4aae79d700 1 -- 172.21.15.71:0/3634480650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a94004810 msgr2=0x7f4aa81578e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:31.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:31.046+0000 7f4aae79d700 1 --2- 172.21.15.71:0/3634480650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a94004810 0x7f4aa81578e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4007390 tx=0x7f4aa80cb6c0 comp rx=0 tx=0).stop 2023-10-09T06:54:31.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:31.046+0000 7f4aae79d700 1 -- 172.21.15.71:0/3634480650 shutdown_connections 2023-10-09T06:54:31.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:31.046+0000 7f4aae79d700 1 --2- 172.21.15.71:0/3634480650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4aa80afb10 0x7f4aa815b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:31.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:31.046+0000 7f4aae79d700 1 --2- 172.21.15.71:0/3634480650 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4a8c067130 0x7f4a8c0695e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:31.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:31.046+0000 7f4aae79d700 1 --2- 172.21.15.71:0/3634480650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a94004810 0x7f4aa81578e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:31.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:31.046+0000 7f4aae79d700 1 --2- 172.21.15.71:0/3634480650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aa80c3ff0 0x7f4aa80af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:31.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:31.046+0000 7f4aae79d700 1 -- 172.21.15.71:0/3634480650 >> 172.21.15.71:0/3634480650 conn(0x7f4aa8063230 msgr2=0x7f4aa81589d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:31.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:31.046+0000 7f4aae79d700 1 -- 172.21.15.71:0/3634480650 shutdown_connections 2023-10-09T06:54:31.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:31.046+0000 7f4aae79d700 1 -- 172.21.15.71:0/3634480650 wait complete. 2023-10-09T06:54:31.065 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir0 2023-10-09T06:54:31.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:31.065 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-10-09T06:54:31.102 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:31.102 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:31.103 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_46_01_UTC 2023-10-09T06:54:31.103 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:31.103 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:31.103 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:31.103 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:31.103 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:31.103 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:31.103 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:31.103 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:31.104 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:31.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:31.105 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-09-06_44_00_UTC) 2023-10-09T06:54:31.188 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:31.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:31.188 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-09-06_45_00_UTC) 2023-10-09T06:54:31.272 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-09-06_46_01_UTC 2023-10-09T06:54:31.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:31.272 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-09-06_46_01_UTC) 2023-10-09T06:54:31.356 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:31.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:31.356 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-09-06_47_00_UTC) 2023-10-09T06:54:31.438 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:31.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:31.439 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-09-06_48_00_UTC) 2023-10-09T06:54:31.521 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:31.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:31.521 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-09-06_49_00_UTC) 2023-10-09T06:54:31.572 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:54:31.604 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:31.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:31.605 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-09-06_50_00_UTC) 2023-10-09T06:54:31.649 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:54:31.691 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:31.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:31.692 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-09-06_51_00_UTC) 2023-10-09T06:54:31.774 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:31.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:31.774 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-09-06_52_00_UTC) 2023-10-09T06:54:31.862 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:31.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:31.863 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-09-06_53_00_UTC) 2023-10-09T06:54:31.905 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:31.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:31.905 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-09-06_54_00_UTC) 2023-10-09T06:54:31.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:31.990 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0) 2023-10-09T06:54:32.069 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir1 1M 2023-10-09T06:54:32.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.293+0000 7f9094fff700 1 Processor -- start 2023-10-09T06:54:32.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.294+0000 7f9094fff700 1 -- start start 2023-10-09T06:54:32.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.295+0000 7f9094fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9090069a50 0x7f90900c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:32.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.295+0000 7f9094fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90900c8490 0x7f909015a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:32.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.295+0000 7f9094fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90900ac030 con 0x7f9090069e20 2023-10-09T06:54:32.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.295+0000 7f9094fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90900ab820 con 0x7f9090069a50 2023-10-09T06:54:32.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.295+0000 7f9094fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909006dbb0 con 0x7f90900c8490 2023-10-09T06:54:32.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.295+0000 7f908e59c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9090069a50 0x7f90900c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:32.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.295+0000 7f9087fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90900c8490 0x7f909015a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:32.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.295+0000 7f908ed9d700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f9090069e20 0x7f909006e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:37550/0 (socket says 172.21.15.71:37550) 2023-10-09T06:54:32.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.295+0000 7f908ed9d700 1 -- 172.21.15.71:0/1760934534 learned_addr learned my addr 172.21.15.71:0/1760934534 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:32.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.296+0000 7f908dd9b700 1 -- 172.21.15.71:0/1760934534 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400709823 0 0) 0x7f9088001490 con 0x7f9090069e20 2023-10-09T06:54:32.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.296+0000 7f908dd9b700 1 -- 172.21.15.71:0/1760934534 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f907c003570 con 0x7f9090069e20 2023-10-09T06:54:32.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.296+0000 7f9087fff700 1 -- 172.21.15.71:0/1760934534 >> v2:172.21.15.179:3300/0 conn(0x7f9090069a50 msgr2=0x7f90900c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:32.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.296+0000 7f9087fff700 1 --2- 172.21.15.71:0/1760934534 >> v2:172.21.15.179:3300/0 conn(0x7f9090069a50 0x7f90900c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:32.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.296+0000 7f9087fff700 1 -- 172.21.15.71:0/1760934534 >> v1:172.21.15.179:6789/0 conn(0x7f9090069e20 legacy=0x7f909006e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:32.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.296+0000 7f9087fff700 1 -- 172.21.15.71:0/1760934534 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909015a9d0 con 0x7f90900c8490 2023-10-09T06:54:32.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.296+0000 7f908e59c700 1 --2- 172.21.15.71:0/1760934534 >> v2:172.21.15.179:3300/0 conn(0x7f9090069a50 0x7f90900c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:54:32.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.296+0000 7f9087fff700 1 --2- 172.21.15.71:0/1760934534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90900c8490 0x7f909015a490 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f907800aac0 tx=0x7f907800a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=beae5b8e57433379 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:32.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.296+0000 7f908dd9b700 1 -- 172.21.15.71:0/1760934534 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907800c930 con 0x7f90900c8490 2023-10-09T06:54:32.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.297+0000 7f908dd9b700 1 -- 172.21.15.71:0/1760934534 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907800ca90 con 0x7f90900c8490 2023-10-09T06:54:32.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.297+0000 7f908dd9b700 1 -- 172.21.15.71:0/1760934534 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907800ce30 con 0x7f90900c8490 2023-10-09T06:54:32.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.297+0000 7f9094fff700 1 -- 172.21.15.71:0/1760934534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90900c8490 msgr2=0x7f909015a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:32.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.297+0000 7f9094fff700 1 --2- 172.21.15.71:0/1760934534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90900c8490 0x7f909015a490 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f907800aac0 tx=0x7f907800a330 comp rx=0 tx=0).stop 2023-10-09T06:54:32.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.297+0000 7f9094fff700 1 -- 172.21.15.71:0/1760934534 shutdown_connections 2023-10-09T06:54:32.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.297+0000 7f9094fff700 1 --2- 172.21.15.71:0/1760934534 >> v2:172.21.15.179:3300/0 conn(0x7f9090069a50 0x7f90900c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:32.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.297+0000 7f9094fff700 1 --2- 172.21.15.71:0/1760934534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90900c8490 0x7f909015a490 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:32.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.297+0000 7f9094fff700 1 -- 172.21.15.71:0/1760934534 >> 172.21.15.71:0/1760934534 conn(0x7f90900c8f90 msgr2=0x7f90900c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:32.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.297+0000 7f9094fff700 1 -- 172.21.15.71:0/1760934534 shutdown_connections 2023-10-09T06:54:32.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.297+0000 7f9094fff700 1 -- 172.21.15.71:0/1760934534 wait complete. 2023-10-09T06:54:32.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.299+0000 7f9094fff700 1 Processor -- start 2023-10-09T06:54:32.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.299+0000 7f9094fff700 1 -- start start 2023-10-09T06:54:32.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.299+0000 7f9094fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9090069a50 0x7f90900b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:32.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.299+0000 7f9094fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9090069e20 0x7f90900af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:32.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.300+0000 7f9094fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90900c8490 0x7f90901652e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:32.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.300+0000 7f9094fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90900b06c0 con 0x7f9090069e20 2023-10-09T06:54:32.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.300+0000 7f9094fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90900af810 con 0x7f90900c8490 2023-10-09T06:54:32.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.300+0000 7f9094fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90900afab0 con 0x7f9090069a50 2023-10-09T06:54:32.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.300+0000 7f9087fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9090069e20 0x7f90900af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:32.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.300+0000 7f9087fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9090069e20 0x7f90900af2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39154/0 (socket says 172.21.15.71:39154) 2023-10-09T06:54:32.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.300+0000 7f9087fff700 1 -- 172.21.15.71:0/3469844270 learned_addr learned my addr 172.21.15.71:0/3469844270 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:32.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.300+0000 7f908e59c700 1 --2- 172.21.15.71:0/3469844270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9090069a50 0x7f90900b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:32.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.300+0000 7f908ed9d700 1 --2- 172.21.15.71:0/3469844270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90900c8490 0x7f90901652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:32.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.300+0000 7f9087fff700 1 -- 172.21.15.71:0/3469844270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9090069a50 msgr2=0x7f90900b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:32.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.300+0000 7f9087fff700 1 --2- 172.21.15.71:0/3469844270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9090069a50 0x7f90900b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:32.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.300+0000 7f9087fff700 1 -- 172.21.15.71:0/3469844270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90900c8490 msgr2=0x7f90901652e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:32.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.300+0000 7f9087fff700 1 --2- 172.21.15.71:0/3469844270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90900c8490 0x7f90901652e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:32.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.300+0000 7f9087fff700 1 -- 172.21.15.71:0/3469844270 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9080009420 con 0x7f9090069e20 2023-10-09T06:54:32.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.300+0000 7f908ed9d700 1 --2- 172.21.15.71:0/3469844270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90900c8490 0x7f90901652e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:54:32.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.300+0000 7f908e59c700 1 --2- 172.21.15.71:0/3469844270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9090069a50 0x7f90900b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:54:32.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.301+0000 7f9087fff700 1 --2- 172.21.15.71:0/3469844270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9090069e20 0x7f90900af2d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f907800a370 tx=0x7f907801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:32.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.301+0000 7f90867fc700 1 -- 172.21.15.71:0/3469844270 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9078023440 con 0x7f9090069e20 2023-10-09T06:54:32.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.301+0000 7f90867fc700 1 -- 172.21.15.71:0/3469844270 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90780235a0 con 0x7f9090069e20 2023-10-09T06:54:32.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.301+0000 7f9094fff700 1 -- 172.21.15.71:0/3469844270 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907800a5d0 con 0x7f9090069e20 2023-10-09T06:54:32.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.301+0000 7f90867fc700 1 -- 172.21.15.71:0/3469844270 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9078023960 con 0x7f9090069e20 2023-10-09T06:54:32.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.301+0000 7f9094fff700 1 -- 172.21.15.71:0/3469844270 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90900b0070 con 0x7f9090069e20 2023-10-09T06:54:32.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.302+0000 7f9094fff700 1 -- 172.21.15.71:0/3469844270 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90900718b0 con 0x7f9090069e20 2023-10-09T06:54:32.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.303+0000 7f90867fc700 1 -- 172.21.15.71:0/3469844270 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f90780103f0 con 0x7f9090069e20 2023-10-09T06:54:32.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.303+0000 7f90867fc700 1 --2- 172.21.15.71:0/3469844270 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9070067130 0x7f90700695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:32.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.304+0000 7f90867fc700 1 -- 172.21.15.71:0/3469844270 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f9078086810 con 0x7f9090069e20 2023-10-09T06:54:32.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.304+0000 7f908e59c700 1 --2- 172.21.15.71:0/3469844270 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9070067130 0x7f90700695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:32.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.305+0000 7f908e59c700 1 --2- 172.21.15.71:0/3469844270 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9070067130 0x7f90700695e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f90800093f0 tx=0x7f9080008040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:32.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.308+0000 7f90867fc700 1 -- 172.21.15.71:0/3469844270 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9078053660 con 0x7f9090069e20 2023-10-09T06:54:32.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.525+0000 7f9094fff700 1 -- 172.21.15.71:0/3469844270 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9090068e00 con 0x7f9070067130 2023-10-09T06:54:32.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.607+0000 7f90867fc700 1 -- 172.21.15.71:0/3469844270 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f9090068e00 con 0x7f9070067130 2023-10-09T06:54:32.608 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule removed for path /snap_test_dir1/dir1 2023-10-09T06:54:32.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.610+0000 7f9094fff700 1 -- 172.21.15.71:0/3469844270 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9070067130 msgr2=0x7f90700695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:32.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.610+0000 7f9094fff700 1 --2- 172.21.15.71:0/3469844270 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9070067130 0x7f90700695e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f90800093f0 tx=0x7f9080008040 comp rx=0 tx=0).stop 2023-10-09T06:54:32.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.610+0000 7f9094fff700 1 -- 172.21.15.71:0/3469844270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9090069e20 msgr2=0x7f90900af2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:32.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.610+0000 7f9094fff700 1 --2- 172.21.15.71:0/3469844270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9090069e20 0x7f90900af2d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f907800a370 tx=0x7f907801a000 comp rx=0 tx=0).stop 2023-10-09T06:54:32.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.610+0000 7f9094fff700 1 -- 172.21.15.71:0/3469844270 shutdown_connections 2023-10-09T06:54:32.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.610+0000 7f9094fff700 1 --2- 172.21.15.71:0/3469844270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90900c8490 0x7f90901652e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:32.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.610+0000 7f9094fff700 1 --2- 172.21.15.71:0/3469844270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9090069a50 0x7f90900b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:32.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.610+0000 7f9094fff700 1 --2- 172.21.15.71:0/3469844270 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9070067130 0x7f90700695e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:32.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.610+0000 7f9094fff700 1 --2- 172.21.15.71:0/3469844270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9090069e20 0x7f90900af2d0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:32.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.610+0000 7f9094fff700 1 -- 172.21.15.71:0/3469844270 >> 172.21.15.71:0/3469844270 conn(0x7f90900c8f90 msgr2=0x7f90900cac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:32.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.610+0000 7f9094fff700 1 -- 172.21.15.71:0/3469844270 shutdown_connections 2023-10-09T06:54:32.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:32.610+0000 7f9094fff700 1 -- 172.21.15.71:0/3469844270 wait complete. 2023-10-09T06:54:32.628 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir1 2023-10-09T06:54:32.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:32.629 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-10-09T06:54:32.666 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:32.666 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:32.666 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:32.666 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:32.666 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:32.666 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:32.667 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:32.667 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:32.667 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:32.667 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:32.668 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:32.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:32.668 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-09-06_45_00_UTC) 2023-10-09T06:54:32.754 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:32.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:32.755 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-09-06_46_00_UTC) 2023-10-09T06:54:32.798 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:32.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:32.799 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-09-06_47_00_UTC) 2023-10-09T06:54:32.882 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:32.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:32.882 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-09-06_48_00_UTC) 2023-10-09T06:54:32.967 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:32.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:32.967 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-09-06_49_00_UTC) 2023-10-09T06:54:33.052 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:33.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:33.053 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-09-06_50_00_UTC) 2023-10-09T06:54:33.136 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:33.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:33.136 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-09-06_51_00_UTC) 2023-10-09T06:54:33.220 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:33.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:33.220 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-09-06_52_00_UTC) 2023-10-09T06:54:33.304 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:33.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:33.305 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-09-06_53_00_UTC) 2023-10-09T06:54:33.388 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:33.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:33.389 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-09-06_54_00_UTC) 2023-10-09T06:54:33.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:33.472 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1) 2023-10-09T06:54:33.552 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir2 1M 2023-10-09T06:54:33.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.814+0000 7f85dad9d700 1 Processor -- start 2023-10-09T06:54:33.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.815+0000 7f85dad9d700 1 -- start start 2023-10-09T06:54:33.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.816+0000 7f85dad9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85d4157540 0x7f85d40c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:33.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.816+0000 7f85dad9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f85d40c92f0 0x7f85d40cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:33.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.816+0000 7f85dad9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d40c9700 con 0x7f85d4157910 2023-10-09T06:54:33.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.816+0000 7f85dad9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d40cbbe0 con 0x7f85d40c92f0 2023-10-09T06:54:33.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.816+0000 7f85dad9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d415b560 con 0x7f85d4157540 2023-10-09T06:54:33.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.817+0000 7f85da59c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f85d40c92f0 0x7f85d40cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:33.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.817+0000 7f85d9d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85d4157540 0x7f85d40c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:33.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.817+0000 7f85d9d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85d4157540 0x7f85d40c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:44324/0 (socket says 172.21.15.71:44324) 2023-10-09T06:54:33.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.817+0000 7f85da59c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f85d40c92f0 0x7f85d40cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:41172/0 (socket says 172.21.15.71:41172) 2023-10-09T06:54:33.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.817+0000 7f85d9d9b700 1 -- 172.21.15.71:0/3549460873 learned_addr learned my addr 172.21.15.71:0/3549460873 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:33.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.817+0000 7f85d959a700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f85d4157910 0x7f85d40cadd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:37562/0 (socket says 172.21.15.71:37562) 2023-10-09T06:54:33.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.817+0000 7f85d9d9b700 1 -- 172.21.15.71:0/3549460873 >> v2:172.21.15.179:3300/0 conn(0x7f85d40c92f0 msgr2=0x7f85d40cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:33.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.817+0000 7f85d9d9b700 1 --2- 172.21.15.71:0/3549460873 >> v2:172.21.15.179:3300/0 conn(0x7f85d40c92f0 0x7f85d40cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:33.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.817+0000 7f85d9d9b700 1 -- 172.21.15.71:0/3549460873 >> v1:172.21.15.179:6789/0 conn(0x7f85d4157910 legacy=0x7f85d40cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:33.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.817+0000 7f85d9d9b700 1 -- 172.21.15.71:0/3549460873 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d415b840 con 0x7f85d4157540 2023-10-09T06:54:33.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.817+0000 7f85da59c700 1 --2- 172.21.15.71:0/3549460873 >> v2:172.21.15.179:3300/0 conn(0x7f85d40c92f0 0x7f85d40cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:54:33.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.818+0000 7f85d9d9b700 1 --2- 172.21.15.71:0/3549460873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85d4157540 0x7f85d40c8db0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f85d00099b0 tx=0x7f85d0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a591214f201bed0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:33.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.818+0000 7f85d8d99700 1 -- 172.21.15.71:0/3549460873 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d0009ea0 con 0x7f85d4157540 2023-10-09T06:54:33.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.818+0000 7f85d8d99700 1 -- 172.21.15.71:0/3549460873 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d000b860 con 0x7f85d4157540 2023-10-09T06:54:33.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.818+0000 7f85d8d99700 1 -- 172.21.15.71:0/3549460873 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d000bc00 con 0x7f85d4157540 2023-10-09T06:54:33.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.819+0000 7f85dad9d700 1 -- 172.21.15.71:0/3549460873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85d4157540 msgr2=0x7f85d40c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:33.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.819+0000 7f85dad9d700 1 --2- 172.21.15.71:0/3549460873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85d4157540 0x7f85d40c8db0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f85d00099b0 tx=0x7f85d0009250 comp rx=0 tx=0).stop 2023-10-09T06:54:33.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.819+0000 7f85dad9d700 1 -- 172.21.15.71:0/3549460873 shutdown_connections 2023-10-09T06:54:33.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.819+0000 7f85dad9d700 1 --2- 172.21.15.71:0/3549460873 >> v2:172.21.15.179:3300/0 conn(0x7f85d40c92f0 0x7f85d40cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:33.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.819+0000 7f85dad9d700 1 --2- 172.21.15.71:0/3549460873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85d4157540 0x7f85d40c8db0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:33.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.819+0000 7f85dad9d700 1 -- 172.21.15.71:0/3549460873 >> 172.21.15.71:0/3549460873 conn(0x7f85d406baf0 msgr2=0x7f85d406bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:33.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.819+0000 7f85dad9d700 1 -- 172.21.15.71:0/3549460873 shutdown_connections 2023-10-09T06:54:33.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.819+0000 7f85dad9d700 1 -- 172.21.15.71:0/3549460873 wait complete. 2023-10-09T06:54:33.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.821+0000 7f85dad9d700 1 Processor -- start 2023-10-09T06:54:33.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.821+0000 7f85dad9d700 1 -- start start 2023-10-09T06:54:33.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.822+0000 7f85dad9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85d40c92f0 0x7f85d4169a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:33.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.822+0000 7f85dad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85d4157540 0x7f85d41659d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:33.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.822+0000 7f85dad9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85d4157910 0x7f85d40cec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:33.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.822+0000 7f85dad9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d4169f50 con 0x7f85d4157540 2023-10-09T06:54:33.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.822+0000 7f85dad9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d41469c0 con 0x7f85d40c92f0 2023-10-09T06:54:33.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.822+0000 7f85dad9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d40ce490 con 0x7f85d4157910 2023-10-09T06:54:33.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.822+0000 7f85d959a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85d4157540 0x7f85d41659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:33.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.822+0000 7f85d9d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85d40c92f0 0x7f85d4169a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:33.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.822+0000 7f85da59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85d4157910 0x7f85d40cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:33.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.822+0000 7f85d9d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85d40c92f0 0x7f85d4169a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:41174/0 (socket says 172.21.15.71:41174) 2023-10-09T06:54:33.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.822+0000 7f85d9d9b700 1 -- 172.21.15.71:0/2781019144 learned_addr learned my addr 172.21.15.71:0/2781019144 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:33.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.823+0000 7f85da59c700 1 -- 172.21.15.71:0/2781019144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85d40c92f0 msgr2=0x7f85d4169a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:33.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.823+0000 7f85da59c700 1 --2- 172.21.15.71:0/2781019144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85d40c92f0 0x7f85d4169a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:33.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.823+0000 7f85da59c700 1 -- 172.21.15.71:0/2781019144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85d4157540 msgr2=0x7f85d41659d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:33.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.823+0000 7f85da59c700 1 --2- 172.21.15.71:0/2781019144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85d4157540 0x7f85d41659d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:33.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.823+0000 7f85da59c700 1 -- 172.21.15.71:0/2781019144 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc009a20 con 0x7f85d4157910 2023-10-09T06:54:33.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.823+0000 7f85da59c700 1 --2- 172.21.15.71:0/2781019144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85d4157910 0x7f85d40cec50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f85cc009df0 tx=0x7f85cc00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:33.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.823+0000 7f85c9ffb700 1 -- 172.21.15.71:0/2781019144 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc00bb40 con 0x7f85d4157910 2023-10-09T06:54:33.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.823+0000 7f85c9ffb700 1 -- 172.21.15.71:0/2781019144 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85cc00f040 con 0x7f85d4157910 2023-10-09T06:54:33.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.823+0000 7f85c9ffb700 1 -- 172.21.15.71:0/2781019144 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc018400 con 0x7f85d4157910 2023-10-09T06:54:33.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.823+0000 7f85dad9d700 1 -- 172.21.15.71:0/2781019144 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d00094f0 con 0x7f85d4157910 2023-10-09T06:54:33.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.823+0000 7f85dad9d700 1 -- 172.21.15.71:0/2781019144 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d4166a10 con 0x7f85d4157910 2023-10-09T06:54:33.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.825+0000 7f85dad9d700 1 -- 172.21.15.71:0/2781019144 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d404c3c0 con 0x7f85d4157910 2023-10-09T06:54:33.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.826+0000 7f85c9ffb700 1 -- 172.21.15.71:0/2781019144 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f85cc003020 con 0x7f85d4157910 2023-10-09T06:54:33.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.826+0000 7f85c9ffb700 1 --2- 172.21.15.71:0/2781019144 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f85b8067130 0x7f85b80695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:33.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.826+0000 7f85c9ffb700 1 -- 172.21.15.71:0/2781019144 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6371+0+0 (secure 0 0 0) 0x7f85cc084f50 con 0x7f85d4157910 2023-10-09T06:54:33.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.827+0000 7f85d9d9b700 1 --2- 172.21.15.71:0/2781019144 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f85b8067130 0x7f85b80695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:33.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.827+0000 7f85d9d9b700 1 --2- 172.21.15.71:0/2781019144 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f85b8067130 0x7f85b80695e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f85d000c010 tx=0x7f85d0017000 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:33.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:33.830+0000 7f85c9ffb700 1 -- 172.21.15.71:0/2781019144 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85cc051b90 con 0x7f85d4157910 2023-10-09T06:54:34.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:34.075+0000 7f85dad9d700 1 -- 172.21.15.71:0/2781019144 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f85d4154320 con 0x7f85b8067130 2023-10-09T06:54:34.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:34.179+0000 7f85c9ffb700 1 -- 172.21.15.71:0/2781019144 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f85d4154320 con 0x7f85b8067130 2023-10-09T06:54:34.180 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule removed for path /snap_test_dir1/dir2 2023-10-09T06:54:34.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:34.181+0000 7f85dad9d700 1 -- 172.21.15.71:0/2781019144 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f85b8067130 msgr2=0x7f85b80695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:34.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:34.181+0000 7f85dad9d700 1 --2- 172.21.15.71:0/2781019144 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f85b8067130 0x7f85b80695e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f85d000c010 tx=0x7f85d0017000 comp rx=0 tx=0).stop 2023-10-09T06:54:34.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:34.181+0000 7f85dad9d700 1 -- 172.21.15.71:0/2781019144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85d4157910 msgr2=0x7f85d40cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:34.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:34.181+0000 7f85dad9d700 1 --2- 172.21.15.71:0/2781019144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85d4157910 0x7f85d40cec50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f85cc009df0 tx=0x7f85cc00b040 comp rx=0 tx=0).stop 2023-10-09T06:54:34.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:34.182+0000 7f85dad9d700 1 -- 172.21.15.71:0/2781019144 shutdown_connections 2023-10-09T06:54:34.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:34.182+0000 7f85dad9d700 1 --2- 172.21.15.71:0/2781019144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85d4157910 0x7f85d40cec50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:34.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:34.182+0000 7f85dad9d700 1 --2- 172.21.15.71:0/2781019144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85d40c92f0 0x7f85d4169a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:34.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:34.182+0000 7f85dad9d700 1 --2- 172.21.15.71:0/2781019144 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f85b8067130 0x7f85b80695e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:34.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:34.182+0000 7f85dad9d700 1 --2- 172.21.15.71:0/2781019144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85d4157540 0x7f85d41659d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:34.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:34.182+0000 7f85dad9d700 1 -- 172.21.15.71:0/2781019144 >> 172.21.15.71:0/2781019144 conn(0x7f85d406baf0 msgr2=0x7f85d4155d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:34.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:34.182+0000 7f85dad9d700 1 -- 172.21.15.71:0/2781019144 shutdown_connections 2023-10-09T06:54:34.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:34.182+0000 7f85dad9d700 1 -- 172.21.15.71:0/2781019144 wait complete. 2023-10-09T06:54:34.199 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir2 2023-10-09T06:54:34.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:34.200 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-10-09T06:54:34.237 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:34.237 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:34.237 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_47_01_UTC 2023-10-09T06:54:34.237 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:34.238 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:34.238 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:34.238 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:34.238 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:34.238 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:34.238 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:34.239 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:34.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:34.239 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-09-06_45_00_UTC) 2023-10-09T06:54:34.324 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:34.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:34.325 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-09-06_46_00_UTC) 2023-10-09T06:54:34.408 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-09-06_47_01_UTC 2023-10-09T06:54:34.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:34.408 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-09-06_47_01_UTC) 2023-10-09T06:54:34.490 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:34.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:34.491 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-09-06_48_00_UTC) 2023-10-09T06:54:34.575 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:34.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:34.575 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-09-06_49_00_UTC) 2023-10-09T06:54:34.660 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:34.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:34.660 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-09-06_50_00_UTC) 2023-10-09T06:54:34.744 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:34.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:34.744 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-09-06_51_00_UTC) 2023-10-09T06:54:34.861 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:34.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:34.862 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-09-06_52_00_UTC) 2023-10-09T06:54:34.904 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:34.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:34.904 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-09-06_53_00_UTC) 2023-10-09T06:54:34.988 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:34.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:34.988 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-09-06_54_00_UTC) 2023-10-09T06:54:35.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:35.072 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2) 2023-10-09T06:54:35.151 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir3 1M 2023-10-09T06:54:35.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.376+0000 7f05d759d700 1 Processor -- start 2023-10-09T06:54:35.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.377+0000 7f05d759d700 1 -- start start 2023-10-09T06:54:35.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.378+0000 7f05d759d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f05d00cc8d0 0x7f05d015b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:35.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.378+0000 7f05d759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05d015b960 0x7f05d00ada30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:35.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.378+0000 7f05d759d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d0157a50 con 0x7f05d015b050 2023-10-09T06:54:35.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.378+0000 7f05d759d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d0158f10 con 0x7f05d00cc8d0 2023-10-09T06:54:35.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.378+0000 7f05d759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d01591b0 con 0x7f05d015b960 2023-10-09T06:54:35.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.378+0000 7f05d659b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f05d015b050 0x7f05d00ca100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44420/0 (socket says 172.21.15.71:44420) 2023-10-09T06:54:35.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.378+0000 7f05d659b700 1 -- 172.21.15.71:0/1214520981 learned_addr learned my addr 172.21.15.71:0/1214520981 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:35.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.378+0000 7f05d5d9a700 1 --2- 172.21.15.71:0/1214520981 >> v2:172.21.15.179:3300/0 conn(0x7f05d00cc8d0 0x7f05d015b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:35.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.378+0000 7f05d6d9c700 1 --2- 172.21.15.71:0/1214520981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05d015b960 0x7f05d00ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:35.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.378+0000 7f05d5599700 1 -- 172.21.15.71:0/1214520981 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105962678 0 0) 0x7f05d0157a50 con 0x7f05d015b050 2023-10-09T06:54:35.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.379+0000 7f05d5599700 1 -- 172.21.15.71:0/1214520981 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05bc003570 con 0x7f05d015b050 2023-10-09T06:54:35.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.379+0000 7f05d5599700 1 -- 172.21.15.71:0/1214520981 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3506753373 0 0) 0x7f05bc003570 con 0x7f05d015b050 2023-10-09T06:54:35.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.379+0000 7f05d5599700 1 -- 172.21.15.71:0/1214520981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05d015b960 msgr2=0x7f05d00ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:35.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.379+0000 7f05d5599700 1 --2- 172.21.15.71:0/1214520981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05d015b960 0x7f05d00ada30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:35.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.379+0000 7f05d5599700 1 -- 172.21.15.71:0/1214520981 >> v2:172.21.15.179:3300/0 conn(0x7f05d00cc8d0 msgr2=0x7f05d015b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:35.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.379+0000 7f05d5599700 1 --2- 172.21.15.71:0/1214520981 >> v2:172.21.15.179:3300/0 conn(0x7f05d00cc8d0 0x7f05d015b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:35.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.379+0000 7f05d5599700 1 -- 172.21.15.71:0/1214520981 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d00ca9e0 con 0x7f05d015b050 2023-10-09T06:54:35.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.379+0000 7f05d5599700 1 -- 172.21.15.71:0/1214520981 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f05cc001470 con 0x7f05d015b050 2023-10-09T06:54:35.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.379+0000 7f05d5599700 1 -- 172.21.15.71:0/1214520981 >> v1:172.21.15.71:6789/0 conn(0x7f05d015b050 legacy=0x7f05d00ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:35.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.379+0000 7f05d5599700 1 --2- 172.21.15.71:0/1214520981 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05bc003ae0 0x7f05bc003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:35.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.379+0000 7f05d5599700 1 --2- 172.21.15.71:0/1214520981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05bc004810 0x7f05bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:35.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.379+0000 7f05d5599700 1 --2- 172.21.15.71:0/1214520981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05d015b960 0x7f05bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:35.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.379+0000 7f05d5599700 1 -- 172.21.15.71:0/1214520981 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d0158f10 con 0x7f05bc003ae0 2023-10-09T06:54:35.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.379+0000 7f05d5599700 1 -- 172.21.15.71:0/1214520981 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d01591b0 con 0x7f05bc004810 2023-10-09T06:54:35.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.379+0000 7f05d5599700 1 -- 172.21.15.71:0/1214520981 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc00bb10 con 0x7f05d015b960 2023-10-09T06:54:35.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.379+0000 7f05d659b700 1 --2- 172.21.15.71:0/1214520981 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05bc003ae0 0x7f05bc003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:35.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.379+0000 7f05d5d9a700 1 --2- 172.21.15.71:0/1214520981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05bc004810 0x7f05bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:35.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.379+0000 7f05d6d9c700 1 --2- 172.21.15.71:0/1214520981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05d015b960 0x7f05bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:35.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.380+0000 7f05d659b700 1 -- 172.21.15.71:0/1214520981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05d015b960 msgr2=0x7f05bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:35.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.380+0000 7f05d659b700 1 --2- 172.21.15.71:0/1214520981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05d015b960 0x7f05bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:35.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.380+0000 7f05d659b700 1 -- 172.21.15.71:0/1214520981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05bc004810 msgr2=0x7f05bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:35.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.380+0000 7f05d659b700 1 --2- 172.21.15.71:0/1214520981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05bc004810 0x7f05bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:35.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.380+0000 7f05d659b700 1 -- 172.21.15.71:0/1214520981 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc003570 con 0x7f05bc003ae0 2023-10-09T06:54:35.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.380+0000 7f05d5d9a700 1 --2- 172.21.15.71:0/1214520981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05bc004810 0x7f05bc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:54:35.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.380+0000 7f05d659b700 1 --2- 172.21.15.71:0/1214520981 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05bc003ae0 0x7f05bc003ef0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f05cc00c2a0 tx=0x7f05d00cc0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8166496ac3439 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:35.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.380+0000 7f05d5599700 1 -- 172.21.15.71:0/1214520981 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc00cbd0 con 0x7f05bc003ae0 2023-10-09T06:54:35.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.380+0000 7f05d5599700 1 -- 172.21.15.71:0/1214520981 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc00cd30 con 0x7f05bc003ae0 2023-10-09T06:54:35.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.380+0000 7f05d5599700 1 -- 172.21.15.71:0/1214520981 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc00cea0 con 0x7f05bc003ae0 2023-10-09T06:54:35.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.380+0000 7f05d759d700 1 -- 172.21.15.71:0/1214520981 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05bc003ae0 msgr2=0x7f05bc003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:35.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.380+0000 7f05d759d700 1 --2- 172.21.15.71:0/1214520981 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05bc003ae0 0x7f05bc003ef0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f05cc00c2a0 tx=0x7f05d00cc0d0 comp rx=0 tx=0).stop 2023-10-09T06:54:35.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.381+0000 7f05d6d9c700 1 -- 172.21.15.71:0/1214520981 reap_dead start 2023-10-09T06:54:35.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.381+0000 7f05d759d700 1 -- 172.21.15.71:0/1214520981 shutdown_connections 2023-10-09T06:54:35.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.381+0000 7f05d759d700 1 -- 172.21.15.71:0/1214520981 >> 172.21.15.71:0/1214520981 conn(0x7f05d0068e20 msgr2=0x7f05d00cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:35.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.381+0000 7f05d759d700 1 -- 172.21.15.71:0/1214520981 shutdown_connections 2023-10-09T06:54:35.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.381+0000 7f05d759d700 1 -- 172.21.15.71:0/1214520981 wait complete. 2023-10-09T06:54:35.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.382+0000 7f05d759d700 1 Processor -- start 2023-10-09T06:54:35.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.382+0000 7f05d759d700 1 -- start start 2023-10-09T06:54:35.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.383+0000 7f05d759d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05bc003ae0 0x7f05d0140d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:35.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.383+0000 7f05d759d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05d0168410 0x7f05d00c1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:35.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.383+0000 7f05d759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05d0154da0 0x7f05d00c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:35.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.383+0000 7f05d759d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00c15b0 con 0x7f05d0168410 2023-10-09T06:54:35.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.383+0000 7f05d759d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00c2240 con 0x7f05bc003ae0 2023-10-09T06:54:35.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.383+0000 7f05d759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00c1910 con 0x7f05d0154da0 2023-10-09T06:54:35.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.383+0000 7f05d5d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05d0168410 0x7f05d00c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:35.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.383+0000 7f05d5d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05d0168410 0x7f05d00c1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36818/0 (socket says 172.21.15.71:36818) 2023-10-09T06:54:35.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.383+0000 7f05d5d9a700 1 -- 172.21.15.71:0/1299398570 learned_addr learned my addr 172.21.15.71:0/1299398570 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:35.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.384+0000 7f05d659b700 1 --2- 172.21.15.71:0/1299398570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05bc003ae0 0x7f05d0140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:35.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.384+0000 7f05d6d9c700 1 --2- 172.21.15.71:0/1299398570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05d0154da0 0x7f05d00c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:35.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.384+0000 7f05d5d9a700 1 -- 172.21.15.71:0/1299398570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05d0154da0 msgr2=0x7f05d00c37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:35.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.384+0000 7f05d5d9a700 1 --2- 172.21.15.71:0/1299398570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05d0154da0 0x7f05d00c37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:35.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.384+0000 7f05d5d9a700 1 -- 172.21.15.71:0/1299398570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05bc003ae0 msgr2=0x7f05d0140d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:35.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.384+0000 7f05d5d9a700 1 --2- 172.21.15.71:0/1299398570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05bc003ae0 0x7f05d0140d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:35.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.384+0000 7f05d5d9a700 1 -- 172.21.15.71:0/1299398570 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d00c1bf0 con 0x7f05d0168410 2023-10-09T06:54:35.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.384+0000 7f05d5d9a700 1 --2- 172.21.15.71:0/1299398570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05d0168410 0x7f05d00c1070 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f05c00118e0 tx=0x7f05c0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:35.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.384+0000 7f05c67fc700 1 -- 172.21.15.71:0/1299398570 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0011e80 con 0x7f05d0168410 2023-10-09T06:54:35.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.384+0000 7f05c67fc700 1 -- 172.21.15.71:0/1299398570 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c000f860 con 0x7f05d0168410 2023-10-09T06:54:35.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.384+0000 7f05d759d700 1 -- 172.21.15.71:0/1299398570 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d00c1ed0 con 0x7f05d0168410 2023-10-09T06:54:35.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.384+0000 7f05c67fc700 1 -- 172.21.15.71:0/1299398570 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c000fc00 con 0x7f05d0168410 2023-10-09T06:54:35.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.384+0000 7f05d759d700 1 -- 172.21.15.71:0/1299398570 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d01688a0 con 0x7f05d0168410 2023-10-09T06:54:35.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.385+0000 7f05d759d700 1 -- 172.21.15.71:0/1299398570 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d00c23d0 con 0x7f05d0168410 2023-10-09T06:54:35.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.386+0000 7f05c67fc700 1 -- 172.21.15.71:0/1299398570 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f05c0015460 con 0x7f05d0168410 2023-10-09T06:54:35.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.387+0000 7f05c67fc700 1 --2- 172.21.15.71:0/1299398570 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f05b4067130 0x7f05b40695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:35.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.387+0000 7f05c67fc700 1 -- 172.21.15.71:0/1299398570 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f05c0085360 con 0x7f05d0168410 2023-10-09T06:54:35.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.388+0000 7f05d659b700 1 --2- 172.21.15.71:0/1299398570 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f05b4067130 0x7f05b40695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:35.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.388+0000 7f05d659b700 1 --2- 172.21.15.71:0/1299398570 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f05b4067130 0x7f05b40695e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f05d0069470 tx=0x7f05cc015000 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:35.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.391+0000 7f05c67fc700 1 -- 172.21.15.71:0/1299398570 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05c0052080 con 0x7f05d0168410 2023-10-09T06:54:35.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.606+0000 7f05d759d700 1 -- 172.21.15.71:0/1299398570 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f05d004c3c0 con 0x7f05b4067130 2023-10-09T06:54:35.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.692+0000 7f05c67fc700 1 -- 172.21.15.71:0/1299398570 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f05d004c3c0 con 0x7f05b4067130 2023-10-09T06:54:35.693 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule removed for path /snap_test_dir1/dir3 2023-10-09T06:54:35.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.694+0000 7f05d759d700 1 -- 172.21.15.71:0/1299398570 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f05b4067130 msgr2=0x7f05b40695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:35.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.694+0000 7f05d759d700 1 --2- 172.21.15.71:0/1299398570 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f05b4067130 0x7f05b40695e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f05d0069470 tx=0x7f05cc015000 comp rx=0 tx=0).stop 2023-10-09T06:54:35.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.694+0000 7f05d759d700 1 -- 172.21.15.71:0/1299398570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05d0168410 msgr2=0x7f05d00c1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:35.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.694+0000 7f05d759d700 1 --2- 172.21.15.71:0/1299398570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05d0168410 0x7f05d00c1070 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f05c00118e0 tx=0x7f05c0008040 comp rx=0 tx=0).stop 2023-10-09T06:54:35.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.694+0000 7f05d759d700 1 -- 172.21.15.71:0/1299398570 shutdown_connections 2023-10-09T06:54:35.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.694+0000 7f05d759d700 1 --2- 172.21.15.71:0/1299398570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05d0154da0 0x7f05d00c37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:35.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.694+0000 7f05d759d700 1 --2- 172.21.15.71:0/1299398570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05bc003ae0 0x7f05d0140d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:35.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.694+0000 7f05d759d700 1 --2- 172.21.15.71:0/1299398570 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f05b4067130 0x7f05b40695e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:35.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.694+0000 7f05d759d700 1 --2- 172.21.15.71:0/1299398570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05d0168410 0x7f05d00c1070 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:35.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.694+0000 7f05d759d700 1 -- 172.21.15.71:0/1299398570 >> 172.21.15.71:0/1299398570 conn(0x7f05d0068e20 msgr2=0x7f05d00704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:35.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.694+0000 7f05d759d700 1 -- 172.21.15.71:0/1299398570 shutdown_connections 2023-10-09T06:54:35.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:35.694+0000 7f05d759d700 1 -- 172.21.15.71:0/1299398570 wait complete. 2023-10-09T06:54:35.712 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir3 2023-10-09T06:54:35.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:35.713 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-10-09T06:54:35.750 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:35.751 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:35.751 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:35.751 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:35.751 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:35.751 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:35.751 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:35.751 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:35.751 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:35.751 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:35.752 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:35.753 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:35.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:35.753 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-09-06_44_00_UTC) 2023-10-09T06:54:35.846 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:35.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:35.847 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-09-06_45_00_UTC) 2023-10-09T06:54:35.901 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:35.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:35.902 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-09-06_46_00_UTC) 2023-10-09T06:54:35.945 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:35.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:35.946 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-09-06_47_00_UTC) 2023-10-09T06:54:36.029 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:36.029 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:36.029 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-09-06_48_00_UTC) 2023-10-09T06:54:36.113 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:36.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:36.114 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-09-06_49_00_UTC) 2023-10-09T06:54:36.197 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:36.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:36.197 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-09-06_50_00_UTC) 2023-10-09T06:54:36.282 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:36.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:36.282 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-09-06_51_00_UTC) 2023-10-09T06:54:36.366 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:36.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:36.366 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-09-06_52_00_UTC) 2023-10-09T06:54:36.449 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:36.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:36.449 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-09-06_53_00_UTC) 2023-10-09T06:54:36.532 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:36.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:36.533 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-09-06_54_00_UTC) 2023-10-09T06:54:36.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:36.616 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3) 2023-10-09T06:54:36.696 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir4 1M 2023-10-09T06:54:36.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.938+0000 7f9073fff700 1 Processor -- start 2023-10-09T06:54:36.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.938+0000 7f9073fff700 1 -- start start 2023-10-09T06:54:36.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.939+0000 7f9073fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f906c153f50 0x7f906c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:36.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.939+0000 7f9073fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f906c154320 0x7f906c06d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:36.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.939+0000 7f9073fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f906c0b4570 con 0x7f906c15a190 2023-10-09T06:54:36.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.939+0000 7f9073fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f906c15a730 con 0x7f906c154320 2023-10-09T06:54:36.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.939+0000 7f9073fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f906c15aa10 con 0x7f906c153f50 2023-10-09T06:54:36.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.940+0000 7f907159a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f906c154320 0x7f906c06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:36.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.940+0000 7f9071d9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f906c153f50 0x7f906c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:36.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.940+0000 7f907159a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f906c154320 0x7f906c06d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36822/0 (socket says 172.21.15.71:36822) 2023-10-09T06:54:36.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.940+0000 7f907159a700 1 -- 172.21.15.71:0/1576354738 learned_addr learned my addr 172.21.15.71:0/1576354738 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:36.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.940+0000 7f907159a700 1 -- 172.21.15.71:0/1576354738 >> v2:172.21.15.179:3300/0 conn(0x7f906c153f50 msgr2=0x7f906c0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:36.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.940+0000 7f907159a700 1 --2- 172.21.15.71:0/1576354738 >> v2:172.21.15.179:3300/0 conn(0x7f906c153f50 0x7f906c0b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:36.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.940+0000 7f907159a700 1 -- 172.21.15.71:0/1576354738 >> v1:172.21.15.179:6789/0 conn(0x7f906c15a190 legacy=0x7f906c15d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:36.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.940+0000 7f907159a700 1 -- 172.21.15.71:0/1576354738 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906c15acf0 con 0x7f906c154320 2023-10-09T06:54:36.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.940+0000 7f907159a700 1 --2- 172.21.15.71:0/1576354738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f906c154320 0x7f906c06d130 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f906c06f4c0 tx=0x7f905c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67c3b89d2639c44 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:36.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.941+0000 7f9070d99700 1 -- 172.21.15.71:0/1576354738 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c009e70 con 0x7f906c154320 2023-10-09T06:54:36.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.941+0000 7f9070d99700 1 -- 172.21.15.71:0/1576354738 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905c00b860 con 0x7f906c154320 2023-10-09T06:54:36.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.941+0000 7f9070d99700 1 -- 172.21.15.71:0/1576354738 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c00bc00 con 0x7f906c154320 2023-10-09T06:54:36.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.941+0000 7f9073fff700 1 -- 172.21.15.71:0/1576354738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f906c154320 msgr2=0x7f906c06d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:36.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.941+0000 7f9073fff700 1 --2- 172.21.15.71:0/1576354738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f906c154320 0x7f906c06d130 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f906c06f4c0 tx=0x7f905c009250 comp rx=0 tx=0).stop 2023-10-09T06:54:36.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.941+0000 7f9073fff700 1 -- 172.21.15.71:0/1576354738 shutdown_connections 2023-10-09T06:54:36.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.941+0000 7f9073fff700 1 --2- 172.21.15.71:0/1576354738 >> v2:172.21.15.179:3300/0 conn(0x7f906c153f50 0x7f906c0b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:36.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.941+0000 7f9073fff700 1 --2- 172.21.15.71:0/1576354738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f906c154320 0x7f906c06d130 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:36.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.941+0000 7f9073fff700 1 -- 172.21.15.71:0/1576354738 >> 172.21.15.71:0/1576354738 conn(0x7f906c06baf0 msgr2=0x7f906c06bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:36.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.941+0000 7f9073fff700 1 -- 172.21.15.71:0/1576354738 shutdown_connections 2023-10-09T06:54:36.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.941+0000 7f9073fff700 1 -- 172.21.15.71:0/1576354738 wait complete. 2023-10-09T06:54:36.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.943+0000 7f9073fff700 1 Processor -- start 2023-10-09T06:54:36.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.943+0000 7f9073fff700 1 -- start start 2023-10-09T06:54:36.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.944+0000 7f9073fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f906c153f50 0x7f906c147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:36.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.944+0000 7f9073fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f906c154320 0x7f906c1699e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:36.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.944+0000 7f9073fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f906c15a190 0x7f906c1575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:36.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.944+0000 7f9073fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906c156f00 con 0x7f906c154320 2023-10-09T06:54:36.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.944+0000 7f9073fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906c0cd2e0 con 0x7f906c15a190 2023-10-09T06:54:36.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.944+0000 7f9073fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906c156c20 con 0x7f906c153f50 2023-10-09T06:54:36.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.944+0000 7f907159a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f906c154320 0x7f906c1699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:36.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.944+0000 7f907159a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f906c154320 0x7f906c1699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36828/0 (socket says 172.21.15.71:36828) 2023-10-09T06:54:36.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.944+0000 7f907159a700 1 -- 172.21.15.71:0/405759626 learned_addr learned my addr 172.21.15.71:0/405759626 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:36.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.944+0000 7f907259c700 1 --2- 172.21.15.71:0/405759626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f906c15a190 0x7f906c1575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:36.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.944+0000 7f9071d9b700 1 --2- 172.21.15.71:0/405759626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f906c153f50 0x7f906c147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:36.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.944+0000 7f907159a700 1 -- 172.21.15.71:0/405759626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f906c153f50 msgr2=0x7f906c147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:36.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.944+0000 7f907159a700 1 --2- 172.21.15.71:0/405759626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f906c153f50 0x7f906c147b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:36.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.944+0000 7f907159a700 1 -- 172.21.15.71:0/405759626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f906c15a190 msgr2=0x7f906c1575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:36.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.944+0000 7f907159a700 1 --2- 172.21.15.71:0/405759626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f906c15a190 0x7f906c1575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:36.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.944+0000 7f907159a700 1 -- 172.21.15.71:0/405759626 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905c0094f0 con 0x7f906c154320 2023-10-09T06:54:36.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.945+0000 7f907159a700 1 --2- 172.21.15.71:0/405759626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f906c154320 0x7f906c1699e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f905c006fd0 tx=0x7f905c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:36.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.945+0000 7f9061ffb700 1 -- 172.21.15.71:0/405759626 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c000d10 con 0x7f906c154320 2023-10-09T06:54:36.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.945+0000 7f9061ffb700 1 -- 172.21.15.71:0/405759626 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905c00bbe0 con 0x7f906c154320 2023-10-09T06:54:36.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.945+0000 7f9061ffb700 1 -- 172.21.15.71:0/405759626 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c011670 con 0x7f906c154320 2023-10-09T06:54:36.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.945+0000 7f9073fff700 1 -- 172.21.15.71:0/405759626 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f906c0ccc90 con 0x7f906c154320 2023-10-09T06:54:36.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.945+0000 7f9073fff700 1 -- 172.21.15.71:0/405759626 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f906c169f20 con 0x7f906c154320 2023-10-09T06:54:36.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.946+0000 7f9073fff700 1 -- 172.21.15.71:0/405759626 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f906c0cd470 con 0x7f906c154320 2023-10-09T06:54:36.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.947+0000 7f9061ffb700 1 -- 172.21.15.71:0/405759626 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f905c011aa0 con 0x7f906c154320 2023-10-09T06:54:36.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.948+0000 7f9061ffb700 1 --2- 172.21.15.71:0/405759626 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9050067130 0x7f90500695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:36.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.948+0000 7f9061ffb700 1 -- 172.21.15.71:0/405759626 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6403+0+0 (secure 0 0 0) 0x7f905c086500 con 0x7f906c154320 2023-10-09T06:54:36.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.948+0000 7f9071d9b700 1 --2- 172.21.15.71:0/405759626 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9050067130 0x7f90500695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:36.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.949+0000 7f9071d9b700 1 --2- 172.21.15.71:0/405759626 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9050067130 0x7f90500695e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9068009d10 tx=0x7f90680091a0 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:36.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:36.952+0000 7f9061ffb700 1 -- 172.21.15.71:0/405759626 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f905c053190 con 0x7f906c154320 2023-10-09T06:54:37.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:37.181+0000 7f9073fff700 1 -- 172.21.15.71:0/405759626 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f906c0718b0 con 0x7f9050067130 2023-10-09T06:54:37.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:37.263+0000 7f9061ffb700 1 -- 172.21.15.71:0/405759626 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f906c0718b0 con 0x7f9050067130 2023-10-09T06:54:37.264 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule removed for path /snap_test_dir1/dir4 2023-10-09T06:54:37.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:37.265+0000 7f9073fff700 1 -- 172.21.15.71:0/405759626 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9050067130 msgr2=0x7f90500695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:37.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:37.265+0000 7f9073fff700 1 --2- 172.21.15.71:0/405759626 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9050067130 0x7f90500695e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9068009d10 tx=0x7f90680091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:37.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:37.265+0000 7f9073fff700 1 -- 172.21.15.71:0/405759626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f906c154320 msgr2=0x7f906c1699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:37.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:37.265+0000 7f9073fff700 1 --2- 172.21.15.71:0/405759626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f906c154320 0x7f906c1699e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f905c006fd0 tx=0x7f905c017000 comp rx=0 tx=0).stop 2023-10-09T06:54:37.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:37.265+0000 7f9073fff700 1 -- 172.21.15.71:0/405759626 shutdown_connections 2023-10-09T06:54:37.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:37.265+0000 7f9073fff700 1 --2- 172.21.15.71:0/405759626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f906c15a190 0x7f906c1575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:37.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:37.265+0000 7f9073fff700 1 --2- 172.21.15.71:0/405759626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f906c153f50 0x7f906c147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:37.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:37.265+0000 7f9073fff700 1 --2- 172.21.15.71:0/405759626 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9050067130 0x7f90500695e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:37.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:37.265+0000 7f9073fff700 1 --2- 172.21.15.71:0/405759626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f906c154320 0x7f906c1699e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:37.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:37.265+0000 7f9073fff700 1 -- 172.21.15.71:0/405759626 >> 172.21.15.71:0/405759626 conn(0x7f906c06baf0 msgr2=0x7f906c0c77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:37.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:37.265+0000 7f9073fff700 1 -- 172.21.15.71:0/405759626 shutdown_connections 2023-10-09T06:54:37.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:37.265+0000 7f9073fff700 1 -- 172.21.15.71:0/405759626 wait complete. 2023-10-09T06:54:37.284 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir4 2023-10-09T06:54:37.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:37.285 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-10-09T06:54:37.322 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:37.323 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:37.323 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:37.323 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:37.323 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:37.323 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:37.324 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:37.324 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:37.324 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:37.324 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:37.324 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:37.326 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:37.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:37.326 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-09-06_44_00_UTC) 2023-10-09T06:54:37.411 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:37.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:37.411 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-09-06_45_00_UTC) 2023-10-09T06:54:37.495 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:37.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:37.495 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-09-06_46_00_UTC) 2023-10-09T06:54:37.579 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:37.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:37.579 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-09-06_47_00_UTC) 2023-10-09T06:54:37.661 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:37.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:37.662 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-09-06_48_00_UTC) 2023-10-09T06:54:37.745 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:37.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:37.745 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-09-06_49_00_UTC) 2023-10-09T06:54:37.868 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:37.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:37.868 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-09-06_50_00_UTC) 2023-10-09T06:54:37.957 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:37.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:37.957 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-09-06_51_00_UTC) 2023-10-09T06:54:38.005 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:38.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:38.005 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-09-06_52_00_UTC) 2023-10-09T06:54:38.088 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:38.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:38.089 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-09-06_53_00_UTC) 2023-10-09T06:54:38.173 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:38.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:38.174 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-09-06_54_00_UTC) 2023-10-09T06:54:38.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:38.262 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4) 2023-10-09T06:54:38.341 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir5 1M 2023-10-09T06:54:38.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.567+0000 7f530739d700 1 Processor -- start 2023-10-09T06:54:38.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.567+0000 7f530739d700 1 -- start start 2023-10-09T06:54:38.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.568+0000 7f530739d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f53000cb560 0x7f53000cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:38.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.568+0000 7f530739d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f53000cc970 0x7f53000697b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:38.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.568+0000 7f530739d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5300159db0 con 0x7f5300069cf0 2023-10-09T06:54:38.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.568+0000 7f530739d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530006aa30 con 0x7f53000cb560 2023-10-09T06:54:38.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.568+0000 7f530739d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53000cce10 con 0x7f53000cc970 2023-10-09T06:54:38.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.568+0000 7f530639b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f53000cb560 0x7f53000cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:38.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.569+0000 7f530639b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f53000cb560 0x7f53000cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36838/0 (socket says 172.21.15.71:36838) 2023-10-09T06:54:38.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.569+0000 7f530639b700 1 -- 172.21.15.71:0/1699625105 learned_addr learned my addr 172.21.15.71:0/1699625105 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:38.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.569+0000 7f5305b9a700 1 --2- 172.21.15.71:0/1699625105 >> v2:172.21.15.179:3300/0 conn(0x7f53000cc970 0x7f53000697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:38.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.569+0000 7f530639b700 1 -- 172.21.15.71:0/1699625105 >> v2:172.21.15.179:3300/0 conn(0x7f53000cc970 msgr2=0x7f53000697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:38.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.569+0000 7f530639b700 1 --2- 172.21.15.71:0/1699625105 >> v2:172.21.15.179:3300/0 conn(0x7f53000cc970 0x7f53000697b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:38.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.569+0000 7f530639b700 1 -- 172.21.15.71:0/1699625105 >> v1:172.21.15.179:6789/0 conn(0x7f5300069cf0 legacy=0x7f530006d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:38.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.569+0000 7f530639b700 1 -- 172.21.15.71:0/1699625105 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530006a470 con 0x7f53000cb560 2023-10-09T06:54:38.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.569+0000 7f530639b700 1 --2- 172.21.15.71:0/1699625105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53000cb560 0x7f53000cc430 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0099b0 tx=0x7f52fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e670bb514c7456ec server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:38.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.569+0000 7f5305399700 1 -- 172.21.15.71:0/1699625105 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc009ea0 con 0x7f53000cb560 2023-10-09T06:54:38.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.569+0000 7f5305399700 1 -- 172.21.15.71:0/1699625105 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc00b820 con 0x7f53000cb560 2023-10-09T06:54:38.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.569+0000 7f5305399700 1 -- 172.21.15.71:0/1699625105 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc00bbc0 con 0x7f53000cb560 2023-10-09T06:54:38.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.570+0000 7f530739d700 1 -- 172.21.15.71:0/1699625105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53000cb560 msgr2=0x7f53000cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:38.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.570+0000 7f530739d700 1 --2- 172.21.15.71:0/1699625105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53000cb560 0x7f53000cc430 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0099b0 tx=0x7f52fc009250 comp rx=0 tx=0).stop 2023-10-09T06:54:38.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.570+0000 7f530739d700 1 -- 172.21.15.71:0/1699625105 shutdown_connections 2023-10-09T06:54:38.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.570+0000 7f530739d700 1 --2- 172.21.15.71:0/1699625105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53000cb560 0x7f53000cc430 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:38.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.570+0000 7f530739d700 1 --2- 172.21.15.71:0/1699625105 >> v2:172.21.15.179:3300/0 conn(0x7f53000cc970 0x7f53000697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:38.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.570+0000 7f530739d700 1 -- 172.21.15.71:0/1699625105 >> 172.21.15.71:0/1699625105 conn(0x7f530006baf0 msgr2=0x7f530006bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:38.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.570+0000 7f530739d700 1 -- 172.21.15.71:0/1699625105 shutdown_connections 2023-10-09T06:54:38.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.570+0000 7f530739d700 1 -- 172.21.15.71:0/1699625105 wait complete. 2023-10-09T06:54:38.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.571+0000 7f530739d700 1 Processor -- start 2023-10-09T06:54:38.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.572+0000 7f530739d700 1 -- start start 2023-10-09T06:54:38.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.572+0000 7f530739d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5300069cf0 0x7f5300150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:38.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.572+0000 7f530739d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53000cb560 0x7f5300153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:38.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.573+0000 7f530739d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53000cc970 0x7f53000c3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:38.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.573+0000 7f530739d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53000c65f0 con 0x7f53000cb560 2023-10-09T06:54:38.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.573+0000 7f530739d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53000c5700 con 0x7f5300069cf0 2023-10-09T06:54:38.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.573+0000 7f530739d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53000c59e0 con 0x7f53000cc970 2023-10-09T06:54:38.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.573+0000 7f5305b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53000cb560 0x7f5300153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:38.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.573+0000 7f5305b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53000cb560 0x7f5300153d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36840/0 (socket says 172.21.15.71:36840) 2023-10-09T06:54:38.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.573+0000 7f5305b9a700 1 -- 172.21.15.71:0/3356692047 learned_addr learned my addr 172.21.15.71:0/3356692047 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:38.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.573+0000 7f530639b700 1 --2- 172.21.15.71:0/3356692047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5300069cf0 0x7f5300150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:38.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.573+0000 7f5306b9c700 1 --2- 172.21.15.71:0/3356692047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53000cc970 0x7f53000c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:38.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.573+0000 7f5305b9a700 1 -- 172.21.15.71:0/3356692047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53000cc970 msgr2=0x7f53000c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:38.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.573+0000 7f5305b9a700 1 --2- 172.21.15.71:0/3356692047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53000cc970 0x7f53000c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:38.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.573+0000 7f5305b9a700 1 -- 172.21.15.71:0/3356692047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5300069cf0 msgr2=0x7f5300150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:38.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.573+0000 7f5305b9a700 1 --2- 172.21.15.71:0/3356692047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5300069cf0 0x7f5300150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:38.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.573+0000 7f5305b9a700 1 -- 172.21.15.71:0/3356692047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc0094f0 con 0x7f53000cb560 2023-10-09T06:54:38.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.573+0000 7f5305b9a700 1 --2- 172.21.15.71:0/3356692047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53000cb560 0x7f5300153d30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f52f000e930 tx=0x7f52f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:38.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.574+0000 7f52f67fc700 1 -- 172.21.15.71:0/3356692047 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0013680 con 0x7f53000cb560 2023-10-09T06:54:38.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.574+0000 7f52f67fc700 1 -- 172.21.15.71:0/3356692047 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f00137e0 con 0x7f53000cb560 2023-10-09T06:54:38.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.574+0000 7f530739d700 1 -- 172.21.15.71:0/3356692047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53000c5cc0 con 0x7f53000cb560 2023-10-09T06:54:38.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.574+0000 7f52f67fc700 1 -- 172.21.15.71:0/3356692047 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0013b80 con 0x7f53000cb560 2023-10-09T06:54:38.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.574+0000 7f530739d700 1 -- 172.21.15.71:0/3356692047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53000c6280 con 0x7f53000cb560 2023-10-09T06:54:38.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.575+0000 7f530739d700 1 -- 172.21.15.71:0/3356692047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53000c6760 con 0x7f53000cb560 2023-10-09T06:54:38.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.576+0000 7f52f67fc700 1 -- 172.21.15.71:0/3356692047 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f52f000c3e0 con 0x7f53000cb560 2023-10-09T06:54:38.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.577+0000 7f52f67fc700 1 --2- 172.21.15.71:0/3356692047 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f52e4067130 0x7f52e40695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:38.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.577+0000 7f52f67fc700 1 -- 172.21.15.71:0/3356692047 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6707+0+0 (secure 0 0 0) 0x7f52f0084da0 con 0x7f53000cb560 2023-10-09T06:54:38.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.578+0000 7f530639b700 1 --2- 172.21.15.71:0/3356692047 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f52e4067130 0x7f52e40695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:38.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.578+0000 7f530639b700 1 --2- 172.21.15.71:0/3356692047 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f52e4067130 0x7f52e40695e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0099b0 tx=0x7f52fc017000 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:38.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.581+0000 7f52f67fc700 1 -- 172.21.15.71:0/3356692047 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52f0051900 con 0x7f53000cb560 2023-10-09T06:54:38.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.803+0000 7f530739d700 1 -- 172.21.15.71:0/3356692047 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f530004c3c0 con 0x7f52e4067130 2023-10-09T06:54:38.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.889+0000 7f52f67fc700 1 -- 172.21.15.71:0/3356692047 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f530004c3c0 con 0x7f52e4067130 2023-10-09T06:54:38.891 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule removed for path /snap_test_dir1/dir5 2023-10-09T06:54:38.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.892+0000 7f530739d700 1 -- 172.21.15.71:0/3356692047 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f52e4067130 msgr2=0x7f52e40695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:38.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.892+0000 7f530739d700 1 --2- 172.21.15.71:0/3356692047 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f52e4067130 0x7f52e40695e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0099b0 tx=0x7f52fc017000 comp rx=0 tx=0).stop 2023-10-09T06:54:38.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.892+0000 7f530739d700 1 -- 172.21.15.71:0/3356692047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53000cb560 msgr2=0x7f5300153d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:38.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.892+0000 7f530739d700 1 --2- 172.21.15.71:0/3356692047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53000cb560 0x7f5300153d30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f52f000e930 tx=0x7f52f00091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:38.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.892+0000 7f530739d700 1 -- 172.21.15.71:0/3356692047 shutdown_connections 2023-10-09T06:54:38.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.892+0000 7f530739d700 1 --2- 172.21.15.71:0/3356692047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53000cc970 0x7f53000c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:38.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.892+0000 7f530739d700 1 --2- 172.21.15.71:0/3356692047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5300069cf0 0x7f5300150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:38.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.892+0000 7f530739d700 1 --2- 172.21.15.71:0/3356692047 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f52e4067130 0x7f52e40695e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:38.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.892+0000 7f530739d700 1 --2- 172.21.15.71:0/3356692047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53000cb560 0x7f5300153d30 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:38.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.892+0000 7f530739d700 1 -- 172.21.15.71:0/3356692047 >> 172.21.15.71:0/3356692047 conn(0x7f530006baf0 msgr2=0x7f53000ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:38.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.892+0000 7f530739d700 1 -- 172.21.15.71:0/3356692047 shutdown_connections 2023-10-09T06:54:38.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:38.892+0000 7f530739d700 1 -- 172.21.15.71:0/3356692047 wait complete. 2023-10-09T06:54:38.910 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir5 2023-10-09T06:54:38.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:38.911 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-10-09T06:54:38.948 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:38.948 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:38.948 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:38.948 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:38.948 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:38.948 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:38.948 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:38.949 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:38.949 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:38.949 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:38.949 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:38.950 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:38.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:38.950 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-09-06_44_00_UTC) 2023-10-09T06:54:39.035 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:39.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:39.035 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-09-06_45_00_UTC) 2023-10-09T06:54:39.119 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:39.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:39.119 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-09-06_46_00_UTC) 2023-10-09T06:54:39.203 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:39.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:39.203 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-09-06_47_00_UTC) 2023-10-09T06:54:39.286 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:39.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:39.287 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-09-06_48_00_UTC) 2023-10-09T06:54:39.369 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:39.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:39.370 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-09-06_49_00_UTC) 2023-10-09T06:54:39.452 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:39.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:39.453 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-09-06_50_00_UTC) 2023-10-09T06:54:39.535 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:39.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:39.535 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-09-06_51_00_UTC) 2023-10-09T06:54:39.619 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:39.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:39.619 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-09-06_52_00_UTC) 2023-10-09T06:54:39.701 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:39.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:39.701 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-09-06_53_00_UTC) 2023-10-09T06:54:39.784 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:39.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:39.785 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-09-06_54_00_UTC) 2023-10-09T06:54:39.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:39.873 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5) 2023-10-09T06:54:39.914 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir6 1M 2023-10-09T06:54:40.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.150+0000 7f28607ff700 1 Processor -- start 2023-10-09T06:54:40.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.151+0000 7f28607ff700 1 -- start start 2023-10-09T06:54:40.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.152+0000 7f28607ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f285815a440 0x7f28580acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:40.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.152+0000 7f28607ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f285815a9b0 con 0x7f2858068890 2023-10-09T06:54:40.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.152+0000 7f28607ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f285815ac90 con 0x7f28581563b0 2023-10-09T06:54:40.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.152+0000 7f28607ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285815af70 con 0x7f285815a440 2023-10-09T06:54:40.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.152+0000 7f285ed9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f2858068890 0x7f28580c8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44426/0 (socket says 172.21.15.71:44426) 2023-10-09T06:54:40.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.152+0000 7f285ed9c700 1 -- 172.21.15.71:0/892119069 learned_addr learned my addr 172.21.15.71:0/892119069 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:40.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.152+0000 7f285dd9a700 1 --2- 172.21.15.71:0/892119069 >> v2:172.21.15.179:3300/0 conn(0x7f285815a440 0x7f28580acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:40.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.152+0000 7f285d599700 1 -- 172.21.15.71:0/892119069 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619562579 0 0) 0x7f285815a9b0 con 0x7f2858068890 2023-10-09T06:54:40.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.153+0000 7f285d599700 1 -- 172.21.15.71:0/892119069 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2844003570 con 0x7f2858068890 2023-10-09T06:54:40.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.153+0000 7f285d599700 1 -- 172.21.15.71:0/892119069 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255943846 0 0) 0x7f285815ac90 con 0x7f28581563b0 2023-10-09T06:54:40.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.153+0000 7f285d599700 1 -- 172.21.15.71:0/892119069 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f285815a9b0 con 0x7f28581563b0 2023-10-09T06:54:40.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.153+0000 7f285d599700 1 -- 172.21.15.71:0/892119069 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 840679618 0 0) 0x7f2844003570 con 0x7f2858068890 2023-10-09T06:54:40.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.153+0000 7f285d599700 1 -- 172.21.15.71:0/892119069 >> v2:172.21.15.179:3300/0 conn(0x7f285815a440 msgr2=0x7f28580acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:40.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.153+0000 7f285d599700 1 --2- 172.21.15.71:0/892119069 >> v2:172.21.15.179:3300/0 conn(0x7f285815a440 0x7f28580acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:40.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.153+0000 7f285d599700 1 -- 172.21.15.71:0/892119069 >> v1:172.21.15.179:6789/0 conn(0x7f28581563b0 legacy=0x7f2858156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:40.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.153+0000 7f285d599700 1 -- 172.21.15.71:0/892119069 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285815b250 con 0x7f2858068890 2023-10-09T06:54:40.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.153+0000 7f285d599700 1 -- 172.21.15.71:0/892119069 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f28500017f0 con 0x7f2858068890 2023-10-09T06:54:40.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.153+0000 7f285d599700 1 -- 172.21.15.71:0/892119069 >> v1:172.21.15.71:6789/0 conn(0x7f2858068890 legacy=0x7f28580c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:40.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.153+0000 7f285d599700 1 --2- 172.21.15.71:0/892119069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2844003c40 0x7f2844004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:40.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.153+0000 7f285d599700 1 --2- 172.21.15.71:0/892119069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2844004810 0x7f2844004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:40.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.153+0000 7f285d599700 1 --2- 172.21.15.71:0/892119069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2844005210 0x7f284400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:40.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.153+0000 7f285d599700 1 -- 172.21.15.71:0/892119069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285815af70 con 0x7f2844005210 2023-10-09T06:54:40.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.153+0000 7f285d599700 1 -- 172.21.15.71:0/892119069 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284400c130 con 0x7f2844004810 2023-10-09T06:54:40.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.153+0000 7f285d599700 1 -- 172.21.15.71:0/892119069 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284400c2c0 con 0x7f2844003c40 2023-10-09T06:54:40.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.153+0000 7f285dd9a700 1 --2- 172.21.15.71:0/892119069 >> v2:172.21.15.179:3300/0 conn(0x7f285815a440 0x7f28580acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:54:40.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.153+0000 7f285ed9c700 1 --2- 172.21.15.71:0/892119069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2844005210 0x7f284400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:40.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.153+0000 7f285e59b700 1 --2- 172.21.15.71:0/892119069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2844003c40 0x7f2844004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:40.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.154+0000 7f285dd9a700 1 --2- 172.21.15.71:0/892119069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2844004810 0x7f2844004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:40.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.154+0000 7f285ed9c700 1 -- 172.21.15.71:0/892119069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2844003c40 msgr2=0x7f2844004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:40.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.154+0000 7f285ed9c700 1 --2- 172.21.15.71:0/892119069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2844003c40 0x7f2844004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:40.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.154+0000 7f285ed9c700 1 -- 172.21.15.71:0/892119069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2844004810 msgr2=0x7f2844004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:40.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.154+0000 7f285ed9c700 1 --2- 172.21.15.71:0/892119069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2844004810 0x7f2844004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:40.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.154+0000 7f285ed9c700 1 -- 172.21.15.71:0/892119069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2844003570 con 0x7f2844005210 2023-10-09T06:54:40.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.154+0000 7f285ed9c700 1 -- 172.21.15.71:0/892119069 reap_dead start 2023-10-09T06:54:40.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.154+0000 7f285ed9c700 1 --2- 172.21.15.71:0/892119069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2844005210 0x7f284400ba60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f285000a2b0 tx=0x7f28500020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e667102c5714ef30 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:40.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.154+0000 7f285d599700 1 -- 172.21.15.71:0/892119069 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2850010570 con 0x7f2844005210 2023-10-09T06:54:40.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.154+0000 7f285d599700 1 -- 172.21.15.71:0/892119069 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28500106d0 con 0x7f2844005210 2023-10-09T06:54:40.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.154+0000 7f285d599700 1 -- 172.21.15.71:0/892119069 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2850010a90 con 0x7f2844005210 2023-10-09T06:54:40.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.155+0000 7f28607ff700 1 -- 172.21.15.71:0/892119069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2844005210 msgr2=0x7f284400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:40.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.155+0000 7f28607ff700 1 --2- 172.21.15.71:0/892119069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2844005210 0x7f284400ba60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f285000a2b0 tx=0x7f28500020c0 comp rx=0 tx=0).stop 2023-10-09T06:54:40.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.155+0000 7f28607ff700 1 -- 172.21.15.71:0/892119069 shutdown_connections 2023-10-09T06:54:40.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.155+0000 7f28607ff700 1 --2- 172.21.15.71:0/892119069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2844005210 0x7f284400ba60 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:40.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.155+0000 7f28607ff700 1 -- 172.21.15.71:0/892119069 >> 172.21.15.71:0/892119069 conn(0x7f28580c8f90 msgr2=0x7f28580c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:40.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.155+0000 7f28607ff700 1 -- 172.21.15.71:0/892119069 shutdown_connections 2023-10-09T06:54:40.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.155+0000 7f28607ff700 1 -- 172.21.15.71:0/892119069 wait complete. 2023-10-09T06:54:40.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.156+0000 7f28607ff700 1 Processor -- start 2023-10-09T06:54:40.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.156+0000 7f28607ff700 1 -- start start 2023-10-09T06:54:40.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.157+0000 7f28607ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2844005210 0x7f2858152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:40.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.157+0000 7f28607ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2858166830 0x7f28580b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:40.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.157+0000 7f28607ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2858155610 0x7f28580b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:40.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.157+0000 7f28607ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28580b1e10 con 0x7f2858166830 2023-10-09T06:54:40.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.157+0000 7f28607ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2858154bc0 con 0x7f2858155610 2023-10-09T06:54:40.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.157+0000 7f28607ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2858154270 con 0x7f2844005210 2023-10-09T06:54:40.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.158+0000 7f285dd9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2858166830 0x7f28580b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:40.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.158+0000 7f285dd9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2858166830 0x7f28580b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36870/0 (socket says 172.21.15.71:36870) 2023-10-09T06:54:40.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.158+0000 7f285dd9a700 1 -- 172.21.15.71:0/805531964 learned_addr learned my addr 172.21.15.71:0/805531964 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:40.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.158+0000 7f285e59b700 1 --2- 172.21.15.71:0/805531964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2844005210 0x7f2858152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:40.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.158+0000 7f285ed9c700 1 --2- 172.21.15.71:0/805531964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2858155610 0x7f28580b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:40.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.158+0000 7f285dd9a700 1 -- 172.21.15.71:0/805531964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2844005210 msgr2=0x7f2858152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:40.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.158+0000 7f285dd9a700 1 --2- 172.21.15.71:0/805531964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2844005210 0x7f2858152f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:40.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.158+0000 7f285dd9a700 1 -- 172.21.15.71:0/805531964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2858155610 msgr2=0x7f28580b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:40.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.158+0000 7f285dd9a700 1 --2- 172.21.15.71:0/805531964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2858155610 0x7f28580b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:40.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.158+0000 7f285dd9a700 1 -- 172.21.15.71:0/805531964 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2858154550 con 0x7f2858166830 2023-10-09T06:54:40.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.158+0000 7f285e59b700 1 --2- 172.21.15.71:0/805531964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2844005210 0x7f2858152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:54:40.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.158+0000 7f285dd9a700 1 --2- 172.21.15.71:0/805531964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2858166830 0x7f28580b18d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2848011960 tx=0x7f2848008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:40.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.158+0000 7f284e7fc700 1 -- 172.21.15.71:0/805531964 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848011ea0 con 0x7f2858166830 2023-10-09T06:54:40.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.158+0000 7f284e7fc700 1 -- 172.21.15.71:0/805531964 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284800f8e0 con 0x7f2858166830 2023-10-09T06:54:40.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.159+0000 7f284e7fc700 1 -- 172.21.15.71:0/805531964 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284800fc60 con 0x7f2858166830 2023-10-09T06:54:40.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.159+0000 7f28607ff700 1 -- 172.21.15.71:0/805531964 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2858154e10 con 0x7f2858166830 2023-10-09T06:54:40.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.159+0000 7f28607ff700 1 -- 172.21.15.71:0/805531964 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2858153f40 con 0x7f2858166830 2023-10-09T06:54:40.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.160+0000 7f28607ff700 1 -- 172.21.15.71:0/805531964 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28580718b0 con 0x7f2858166830 2023-10-09T06:54:40.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.161+0000 7f284e7fc700 1 -- 172.21.15.71:0/805531964 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f2848015460 con 0x7f2858166830 2023-10-09T06:54:40.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.161+0000 7f284e7fc700 1 --2- 172.21.15.71:0/805531964 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f283c067130 0x7f283c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:40.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.161+0000 7f284e7fc700 1 -- 172.21.15.71:0/805531964 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6451+0+0 (secure 0 0 0) 0x7f2848085470 con 0x7f2858166830 2023-10-09T06:54:40.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.162+0000 7f285e59b700 1 --2- 172.21.15.71:0/805531964 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f283c067130 0x7f283c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:40.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.163+0000 7f285e59b700 1 --2- 172.21.15.71:0/805531964 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f283c067130 0x7f283c0695e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2854007a60 tx=0x7f2854009040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:40.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.166+0000 7f284e7fc700 1 -- 172.21.15.71:0/805531964 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2848055c00 con 0x7f2858166830 2023-10-09T06:54:40.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.381+0000 7f28607ff700 1 -- 172.21.15.71:0/805531964 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f285806d6a0 con 0x7f283c067130 2023-10-09T06:54:40.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.463+0000 7f284e7fc700 1 -- 172.21.15.71:0/805531964 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f285806d6a0 con 0x7f283c067130 2023-10-09T06:54:40.464 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule removed for path /snap_test_dir1/dir6 2023-10-09T06:54:40.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.465+0000 7f28607ff700 1 -- 172.21.15.71:0/805531964 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f283c067130 msgr2=0x7f283c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:40.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.465+0000 7f28607ff700 1 --2- 172.21.15.71:0/805531964 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f283c067130 0x7f283c0695e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2854007a60 tx=0x7f2854009040 comp rx=0 tx=0).stop 2023-10-09T06:54:40.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.466+0000 7f28607ff700 1 -- 172.21.15.71:0/805531964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2858166830 msgr2=0x7f28580b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:40.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.466+0000 7f28607ff700 1 --2- 172.21.15.71:0/805531964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2858166830 0x7f28580b18d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2848011960 tx=0x7f2848008040 comp rx=0 tx=0).stop 2023-10-09T06:54:40.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.466+0000 7f28607ff700 1 -- 172.21.15.71:0/805531964 shutdown_connections 2023-10-09T06:54:40.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.466+0000 7f28607ff700 1 --2- 172.21.15.71:0/805531964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2858155610 0x7f28580b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:40.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.466+0000 7f28607ff700 1 --2- 172.21.15.71:0/805531964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2844005210 0x7f2858152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:40.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.466+0000 7f28607ff700 1 --2- 172.21.15.71:0/805531964 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f283c067130 0x7f283c0695e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:40.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.466+0000 7f28607ff700 1 --2- 172.21.15.71:0/805531964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2858166830 0x7f28580b18d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:40.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.466+0000 7f28607ff700 1 -- 172.21.15.71:0/805531964 >> 172.21.15.71:0/805531964 conn(0x7f28580c8f90 msgr2=0x7f2858156780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:40.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.466+0000 7f28607ff700 1 -- 172.21.15.71:0/805531964 shutdown_connections 2023-10-09T06:54:40.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:40.466+0000 7f28607ff700 1 -- 172.21.15.71:0/805531964 wait complete. 2023-10-09T06:54:40.484 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir6 2023-10-09T06:54:40.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:40.484 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-10-09T06:54:40.521 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:40.522 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:40.522 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:40.522 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:40.522 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_48_01_UTC 2023-10-09T06:54:40.522 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:40.522 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:40.522 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:40.522 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:40.522 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:40.522 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:40.523 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:40.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:40.524 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-09-06_44_00_UTC) 2023-10-09T06:54:40.608 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:40.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:40.608 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-09-06_45_00_UTC) 2023-10-09T06:54:40.690 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:40.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:40.691 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-09-06_46_00_UTC) 2023-10-09T06:54:40.773 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:40.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:40.774 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-09-06_47_00_UTC) 2023-10-09T06:54:40.907 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-09-06_48_01_UTC 2023-10-09T06:54:40.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:40.907 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-09-06_48_01_UTC) 2023-10-09T06:54:40.950 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:40.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:40.950 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-09-06_49_00_UTC) 2023-10-09T06:54:41.034 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:41.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:41.034 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-09-06_50_00_UTC) 2023-10-09T06:54:41.117 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:41.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:41.118 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-09-06_51_00_UTC) 2023-10-09T06:54:41.207 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:41.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:41.207 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-09-06_52_00_UTC) 2023-10-09T06:54:41.251 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:41.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:41.252 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-09-06_53_00_UTC) 2023-10-09T06:54:41.334 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:41.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:41.335 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-09-06_54_00_UTC) 2023-10-09T06:54:41.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:41.417 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6) 2023-10-09T06:54:41.497 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir7 1M 2023-10-09T06:54:41.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.722+0000 7f13b339d700 1 Processor -- start 2023-10-09T06:54:41.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.723+0000 7f13b339d700 1 -- start start 2023-10-09T06:54:41.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.724+0000 7f13b339d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f13ac0b0c00 0x7f13ac0ad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:41.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.724+0000 7f13b339d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ac0b0570 con 0x7f13ac0b0760 2023-10-09T06:54:41.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.724+0000 7f13b339d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ac0af4d0 con 0x7f13ac156350 2023-10-09T06:54:41.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.724+0000 7f13b339d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13ac0af7b0 con 0x7f13ac0b0c00 2023-10-09T06:54:41.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.724+0000 7f13b2b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f13ac0b0c00 0x7f13ac0ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:41.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.724+0000 7f13b2b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f13ac0b0c00 0x7f13ac0ad570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36874/0 (socket says 172.21.15.71:36874) 2023-10-09T06:54:41.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.724+0000 7f13b2b9c700 1 -- 172.21.15.71:0/733152742 learned_addr learned my addr 172.21.15.71:0/733152742 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:41.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.724+0000 7f13b1b9a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f13ac0b0760 0x7f13ac0ace60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44440/0 (socket says 172.21.15.71:44440) 2023-10-09T06:54:41.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.725+0000 7f13b2b9c700 1 -- 172.21.15.71:0/733152742 >> v1:172.21.15.179:6789/0 conn(0x7f13ac156350 legacy=0x7f13ac157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:41.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.725+0000 7f13b2b9c700 1 -- 172.21.15.71:0/733152742 >> v1:172.21.15.71:6789/0 conn(0x7f13ac0b0760 legacy=0x7f13ac0ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:41.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.725+0000 7f13b2b9c700 1 -- 172.21.15.71:0/733152742 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ac0afa90 con 0x7f13ac0b0c00 2023-10-09T06:54:41.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.725+0000 7f13b2b9c700 1 --2- 172.21.15.71:0/733152742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13ac0b0c00 0x7f13ac0ad570 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009f20 tx=0x7f13a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57df401da4594368 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:41.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.725+0000 7f13b1399700 1 -- 172.21.15.71:0/733152742 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a40092e0 con 0x7f13ac0b0c00 2023-10-09T06:54:41.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.725+0000 7f13b1399700 1 -- 172.21.15.71:0/733152742 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a400ba40 con 0x7f13ac0b0c00 2023-10-09T06:54:41.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.725+0000 7f13b1399700 1 -- 172.21.15.71:0/733152742 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a400be00 con 0x7f13ac0b0c00 2023-10-09T06:54:41.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.726+0000 7f13b339d700 1 -- 172.21.15.71:0/733152742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13ac0b0c00 msgr2=0x7f13ac0ad570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:41.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.726+0000 7f13b339d700 1 --2- 172.21.15.71:0/733152742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13ac0b0c00 0x7f13ac0ad570 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009f20 tx=0x7f13a4009840 comp rx=0 tx=0).stop 2023-10-09T06:54:41.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.726+0000 7f13b339d700 1 -- 172.21.15.71:0/733152742 shutdown_connections 2023-10-09T06:54:41.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.726+0000 7f13b339d700 1 --2- 172.21.15.71:0/733152742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13ac0b0c00 0x7f13ac0ad570 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:41.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.726+0000 7f13b339d700 1 -- 172.21.15.71:0/733152742 >> 172.21.15.71:0/733152742 conn(0x7f13ac068e20 msgr2=0x7f13ac0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:41.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.726+0000 7f13b339d700 1 -- 172.21.15.71:0/733152742 shutdown_connections 2023-10-09T06:54:41.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.726+0000 7f13b339d700 1 -- 172.21.15.71:0/733152742 wait complete. 2023-10-09T06:54:41.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.727+0000 7f13b339d700 1 Processor -- start 2023-10-09T06:54:41.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.727+0000 7f13b339d700 1 -- start start 2023-10-09T06:54:41.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.728+0000 7f13b339d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13ac0b0760 0x7f13ac0c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:41.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.728+0000 7f13b339d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13ac0b0c00 0x7f13ac16ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:41.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.728+0000 7f13b339d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13ac156350 0x7f13ac154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:41.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.728+0000 7f13b339d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac153c80 con 0x7f13ac0b0c00 2023-10-09T06:54:41.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.728+0000 7f13b339d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac16ab00 con 0x7f13ac156350 2023-10-09T06:54:41.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.728+0000 7f13b339d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac153ed0 con 0x7f13ac0b0760 2023-10-09T06:54:41.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.728+0000 7f13b1b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13ac0b0c00 0x7f13ac16ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:41.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.729+0000 7f13b1b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13ac0b0c00 0x7f13ac16ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36876/0 (socket says 172.21.15.71:36876) 2023-10-09T06:54:41.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.729+0000 7f13b1b9a700 1 -- 172.21.15.71:0/1176487788 learned_addr learned my addr 172.21.15.71:0/1176487788 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:41.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.729+0000 7f13b2b9c700 1 --2- 172.21.15.71:0/1176487788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13ac156350 0x7f13ac154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:41.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.729+0000 7f13b239b700 1 --2- 172.21.15.71:0/1176487788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13ac0b0760 0x7f13ac0c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:41.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.729+0000 7f13b1b9a700 1 -- 172.21.15.71:0/1176487788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13ac0b0760 msgr2=0x7f13ac0c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:41.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.729+0000 7f13b1b9a700 1 --2- 172.21.15.71:0/1176487788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13ac0b0760 0x7f13ac0c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:41.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.729+0000 7f13b1b9a700 1 -- 172.21.15.71:0/1176487788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13ac156350 msgr2=0x7f13ac154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:41.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.729+0000 7f13b1b9a700 1 --2- 172.21.15.71:0/1176487788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13ac156350 0x7f13ac154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:41.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.729+0000 7f13b1b9a700 1 -- 172.21.15.71:0/1176487788 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a4009ae0 con 0x7f13ac0b0c00 2023-10-09T06:54:41.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.729+0000 7f13b239b700 1 --2- 172.21.15.71:0/1176487788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13ac0b0760 0x7f13ac0c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:54:41.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.729+0000 7f13b1b9a700 1 --2- 172.21.15.71:0/1176487788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13ac0b0c00 0x7f13ac16ad70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f139c00c560 tx=0x7f139c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:41.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.729+0000 7f13a27fc700 1 -- 172.21.15.71:0/1176487788 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c005a70 con 0x7f13ac0b0c00 2023-10-09T06:54:41.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.729+0000 7f13a27fc700 1 -- 172.21.15.71:0/1176487788 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139c005bd0 con 0x7f13ac0b0c00 2023-10-09T06:54:41.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.729+0000 7f13b339d700 1 -- 172.21.15.71:0/1176487788 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13ac1541b0 con 0x7f13ac0b0c00 2023-10-09T06:54:41.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.729+0000 7f13a27fc700 1 -- 172.21.15.71:0/1176487788 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c0070d0 con 0x7f13ac0b0c00 2023-10-09T06:54:41.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.730+0000 7f13b339d700 1 -- 172.21.15.71:0/1176487788 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13ac154770 con 0x7f13ac0b0c00 2023-10-09T06:54:41.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.731+0000 7f13b339d700 1 -- 172.21.15.71:0/1176487788 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13ac154960 con 0x7f13ac0b0c00 2023-10-09T06:54:41.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.731+0000 7f13a27fc700 1 -- 172.21.15.71:0/1176487788 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f139c007480 con 0x7f13ac0b0c00 2023-10-09T06:54:41.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.732+0000 7f13a27fc700 1 --2- 172.21.15.71:0/1176487788 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1390067130 0x7f13900695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:41.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.732+0000 7f13a27fc700 1 -- 172.21.15.71:0/1176487788 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6515+0+0 (secure 0 0 0) 0x7f139c084180 con 0x7f13ac0b0c00 2023-10-09T06:54:41.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.733+0000 7f13b239b700 1 --2- 172.21.15.71:0/1176487788 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1390067130 0x7f13900695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:41.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.733+0000 7f13b239b700 1 --2- 172.21.15.71:0/1176487788 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1390067130 0x7f13900695e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f13ac16d100 tx=0x7f13a8009040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:41.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.736+0000 7f13a27fc700 1 -- 172.21.15.71:0/1176487788 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f139c050da0 con 0x7f13ac0b0c00 2023-10-09T06:54:41.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:41.971+0000 7f13b339d700 1 -- 172.21.15.71:0/1176487788 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f13ac04c3c0 con 0x7f1390067130 2023-10-09T06:54:42.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:42.055+0000 7f13a27fc700 1 -- 172.21.15.71:0/1176487788 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f13ac04c3c0 con 0x7f1390067130 2023-10-09T06:54:42.056 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule removed for path /snap_test_dir1/dir7 2023-10-09T06:54:42.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:42.058+0000 7f13b339d700 1 -- 172.21.15.71:0/1176487788 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1390067130 msgr2=0x7f13900695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:42.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:42.058+0000 7f13b339d700 1 --2- 172.21.15.71:0/1176487788 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1390067130 0x7f13900695e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f13ac16d100 tx=0x7f13a8009040 comp rx=0 tx=0).stop 2023-10-09T06:54:42.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:42.058+0000 7f13b339d700 1 -- 172.21.15.71:0/1176487788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13ac0b0c00 msgr2=0x7f13ac16ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:42.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:42.058+0000 7f13b339d700 1 --2- 172.21.15.71:0/1176487788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13ac0b0c00 0x7f13ac16ad70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f139c00c560 tx=0x7f139c007f70 comp rx=0 tx=0).stop 2023-10-09T06:54:42.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:42.058+0000 7f13b339d700 1 -- 172.21.15.71:0/1176487788 shutdown_connections 2023-10-09T06:54:42.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:42.058+0000 7f13b339d700 1 --2- 172.21.15.71:0/1176487788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13ac156350 0x7f13ac154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:42.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:42.058+0000 7f13b339d700 1 --2- 172.21.15.71:0/1176487788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13ac0b0760 0x7f13ac0c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:42.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:42.058+0000 7f13b339d700 1 --2- 172.21.15.71:0/1176487788 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1390067130 0x7f13900695e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:42.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:42.058+0000 7f13b339d700 1 --2- 172.21.15.71:0/1176487788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13ac0b0c00 0x7f13ac16ad70 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:42.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:42.058+0000 7f13b339d700 1 -- 172.21.15.71:0/1176487788 >> 172.21.15.71:0/1176487788 conn(0x7f13ac068e20 msgr2=0x7f13ac151df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:42.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:42.058+0000 7f13b339d700 1 -- 172.21.15.71:0/1176487788 shutdown_connections 2023-10-09T06:54:42.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:42.058+0000 7f13b339d700 1 -- 172.21.15.71:0/1176487788 wait complete. 2023-10-09T06:54:42.076 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir7 2023-10-09T06:54:42.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:42.077 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-10-09T06:54:42.116 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:42.116 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:42.116 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:42.116 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:42.116 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:42.116 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:42.116 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:42.117 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:42.117 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:42.117 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:42.117 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:42.118 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:42.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:42.118 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-09-06_44_00_UTC) 2023-10-09T06:54:42.203 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:42.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:42.204 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-09-06_45_00_UTC) 2023-10-09T06:54:42.286 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:42.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:42.286 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-09-06_46_00_UTC) 2023-10-09T06:54:42.370 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:42.370 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:42.371 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-09-06_47_00_UTC) 2023-10-09T06:54:42.454 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:42.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:42.454 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-09-06_48_00_UTC) 2023-10-09T06:54:42.538 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:42.538 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:42.538 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-09-06_49_00_UTC) 2023-10-09T06:54:42.622 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:42.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:42.622 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-09-06_50_00_UTC) 2023-10-09T06:54:42.706 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:42.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:42.707 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-09-06_51_00_UTC) 2023-10-09T06:54:42.790 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:42.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:42.790 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-09-06_52_00_UTC) 2023-10-09T06:54:42.906 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:42.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:42.906 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-09-06_53_00_UTC) 2023-10-09T06:54:42.952 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:42.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:42.952 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-09-06_54_00_UTC) 2023-10-09T06:54:43.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:43.036 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7) 2023-10-09T06:54:43.116 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir8 1M 2023-10-09T06:54:43.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.381+0000 7f5cae7ff700 1 Processor -- start 2023-10-09T06:54:43.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.381+0000 7f5cae7ff700 1 -- start start 2023-10-09T06:54:43.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.382+0000 7f5cae7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ca8153f50 0x7f5ca80b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:43.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.382+0000 7f5cae7ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5ca8154320 0x7f5ca806d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:43.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.382+0000 7f5cae7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5ca815a190 0x7f5ca806d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:43.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.382+0000 7f5cae7ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca80b4570 con 0x7f5ca8154320 2023-10-09T06:54:43.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.382+0000 7f5cae7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca815a730 con 0x7f5ca815a190 2023-10-09T06:54:43.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.382+0000 7f5cae7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca815aa10 con 0x7f5ca8153f50 2023-10-09T06:54:43.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.382+0000 7f5ca77fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5ca8154320 0x7f5ca806d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:43.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.383+0000 7f5ca77fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5ca8154320 0x7f5ca806d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36890/0 (socket says 172.21.15.71:36890) 2023-10-09T06:54:43.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.383+0000 7f5ca77fe700 1 -- 172.21.15.71:0/1089326661 learned_addr learned my addr 172.21.15.71:0/1089326661 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:43.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.383+0000 7f5ca7fff700 1 --2- 172.21.15.71:0/1089326661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ca8153f50 0x7f5ca80b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:43.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.383+0000 7f5cacd9c700 1 --2- 172.21.15.71:0/1089326661 >> v2:172.21.15.179:3300/0 conn(0x7f5ca815a190 0x7f5ca806d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:43.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.383+0000 7f5ca77fe700 1 -- 172.21.15.71:0/1089326661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ca8153f50 msgr2=0x7f5ca80b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:43.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.383+0000 7f5ca77fe700 1 --2- 172.21.15.71:0/1089326661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ca8153f50 0x7f5ca80b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:43.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.383+0000 7f5ca77fe700 1 -- 172.21.15.71:0/1089326661 >> v2:172.21.15.179:3300/0 conn(0x7f5ca815a190 msgr2=0x7f5ca806d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:43.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.383+0000 7f5ca77fe700 1 --2- 172.21.15.71:0/1089326661 >> v2:172.21.15.179:3300/0 conn(0x7f5ca815a190 0x7f5ca806d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:43.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.383+0000 7f5ca77fe700 1 -- 172.21.15.71:0/1089326661 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca815acf0 con 0x7f5ca8154320 2023-10-09T06:54:43.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.383+0000 7f5ca77fe700 1 --2- 172.21.15.71:0/1089326661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ca8154320 0x7f5ca806d130 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80cf1c0 tx=0x7f5c9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0367a8ad0af368 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:43.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.383+0000 7f5ca6ffd700 1 -- 172.21.15.71:0/1089326661 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c00b640 con 0x7f5ca8154320 2023-10-09T06:54:43.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.383+0000 7f5ca6ffd700 1 -- 172.21.15.71:0/1089326661 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c00b7a0 con 0x7f5ca8154320 2023-10-09T06:54:43.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.383+0000 7f5ca6ffd700 1 -- 172.21.15.71:0/1089326661 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c00bb60 con 0x7f5ca8154320 2023-10-09T06:54:43.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.384+0000 7f5cae7ff700 1 -- 172.21.15.71:0/1089326661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ca8154320 msgr2=0x7f5ca806d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:43.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.384+0000 7f5cae7ff700 1 --2- 172.21.15.71:0/1089326661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ca8154320 0x7f5ca806d130 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80cf1c0 tx=0x7f5c9c009250 comp rx=0 tx=0).stop 2023-10-09T06:54:43.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.384+0000 7f5cae7ff700 1 -- 172.21.15.71:0/1089326661 shutdown_connections 2023-10-09T06:54:43.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.384+0000 7f5cae7ff700 1 --2- 172.21.15.71:0/1089326661 >> v2:172.21.15.179:3300/0 conn(0x7f5ca815a190 0x7f5ca806d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:43.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.384+0000 7f5cae7ff700 1 --2- 172.21.15.71:0/1089326661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ca8153f50 0x7f5ca80b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:43.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.384+0000 7f5cae7ff700 1 --2- 172.21.15.71:0/1089326661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ca8154320 0x7f5ca806d130 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:43.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.384+0000 7f5cae7ff700 1 -- 172.21.15.71:0/1089326661 >> 172.21.15.71:0/1089326661 conn(0x7f5ca806baf0 msgr2=0x7f5ca806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:43.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.384+0000 7f5cae7ff700 1 -- 172.21.15.71:0/1089326661 shutdown_connections 2023-10-09T06:54:43.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.384+0000 7f5cae7ff700 1 -- 172.21.15.71:0/1089326661 wait complete. 2023-10-09T06:54:43.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.386+0000 7f5cae7ff700 1 Processor -- start 2023-10-09T06:54:43.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.386+0000 7f5cae7ff700 1 -- start start 2023-10-09T06:54:43.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.387+0000 7f5cae7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ca8153f50 0x7f5ca8146240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:43.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.387+0000 7f5cae7ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ca8154320 0x7f5ca80cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:43.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.387+0000 7f5cae7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ca815a190 0x7f5ca815c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:43.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.387+0000 7f5cae7ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca8169e10 con 0x7f5ca8154320 2023-10-09T06:54:43.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.387+0000 7f5cae7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca80cc560 con 0x7f5ca815a190 2023-10-09T06:54:43.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.387+0000 7f5cae7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca80cc840 con 0x7f5ca8153f50 2023-10-09T06:54:43.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.387+0000 7f5ca77fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ca8154320 0x7f5ca80cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:43.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.387+0000 7f5ca77fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ca8154320 0x7f5ca80cbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36892/0 (socket says 172.21.15.71:36892) 2023-10-09T06:54:43.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.387+0000 7f5ca77fe700 1 -- 172.21.15.71:0/2941280187 learned_addr learned my addr 172.21.15.71:0/2941280187 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:43.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.387+0000 7f5cacd9c700 1 --2- 172.21.15.71:0/2941280187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ca815a190 0x7f5ca815c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:43.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.387+0000 7f5ca7fff700 1 --2- 172.21.15.71:0/2941280187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ca8153f50 0x7f5ca8146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:43.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.387+0000 7f5ca77fe700 1 -- 172.21.15.71:0/2941280187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ca8153f50 msgr2=0x7f5ca8146240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:43.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.387+0000 7f5ca77fe700 1 --2- 172.21.15.71:0/2941280187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ca8153f50 0x7f5ca8146240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:43.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.387+0000 7f5ca77fe700 1 -- 172.21.15.71:0/2941280187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ca815a190 msgr2=0x7f5ca815c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:43.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.387+0000 7f5ca77fe700 1 --2- 172.21.15.71:0/2941280187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ca815a190 0x7f5ca815c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:43.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.387+0000 7f5ca77fe700 1 -- 172.21.15.71:0/2941280187 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9c0094f0 con 0x7f5ca8154320 2023-10-09T06:54:43.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.387+0000 7f5ca77fe700 1 --2- 172.21.15.71:0/2941280187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ca8154320 0x7f5ca80cbb10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5ca806f610 tx=0x7f5c9c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:43.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.388+0000 7f5c8ffff700 1 -- 172.21.15.71:0/2941280187 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c00b910 con 0x7f5ca8154320 2023-10-09T06:54:43.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.388+0000 7f5c8ffff700 1 -- 172.21.15.71:0/2941280187 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c00ba70 con 0x7f5ca8154320 2023-10-09T06:54:43.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.388+0000 7f5c8ffff700 1 -- 172.21.15.71:0/2941280187 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c011630 con 0x7f5ca8154320 2023-10-09T06:54:43.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.388+0000 7f5cae7ff700 1 -- 172.21.15.71:0/2941280187 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca80ccb20 con 0x7f5ca8154320 2023-10-09T06:54:43.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.388+0000 7f5cae7ff700 1 -- 172.21.15.71:0/2941280187 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca8146780 con 0x7f5ca8154320 2023-10-09T06:54:43.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.389+0000 7f5cae7ff700 1 -- 172.21.15.71:0/2941280187 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca8169fc0 con 0x7f5ca8154320 2023-10-09T06:54:43.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.390+0000 7f5c8ffff700 1 -- 172.21.15.71:0/2941280187 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f5c9c0119a0 con 0x7f5ca8154320 2023-10-09T06:54:43.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.390+0000 7f5c8ffff700 1 --2- 172.21.15.71:0/2941280187 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5c94067130 0x7f5c940695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:43.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.390+0000 7f5c8ffff700 1 -- 172.21.15.71:0/2941280187 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6563+0+0 (secure 0 0 0) 0x7f5c9c0863d0 con 0x7f5ca8154320 2023-10-09T06:54:43.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.391+0000 7f5ca7fff700 1 --2- 172.21.15.71:0/2941280187 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5c94067130 0x7f5c940695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:43.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.392+0000 7f5ca7fff700 1 --2- 172.21.15.71:0/2941280187 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5c94067130 0x7f5c940695e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009db0 tx=0x7f5c980091a0 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:43.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.395+0000 7f5c8ffff700 1 -- 172.21.15.71:0/2941280187 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ca8169fc0 con 0x7f5ca8154320 2023-10-09T06:54:43.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.615+0000 7f5cae7ff700 1 -- 172.21.15.71:0/2941280187 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ca80718b0 con 0x7f5c94067130 2023-10-09T06:54:43.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.694+0000 7f5c8ffff700 1 -- 172.21.15.71:0/2941280187 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f5ca80718b0 con 0x7f5c94067130 2023-10-09T06:54:43.695 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule removed for path /snap_test_dir1/dir8 2023-10-09T06:54:43.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.696+0000 7f5cae7ff700 1 -- 172.21.15.71:0/2941280187 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5c94067130 msgr2=0x7f5c940695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:43.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.696+0000 7f5cae7ff700 1 --2- 172.21.15.71:0/2941280187 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5c94067130 0x7f5c940695e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009db0 tx=0x7f5c980091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:43.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.696+0000 7f5cae7ff700 1 -- 172.21.15.71:0/2941280187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ca8154320 msgr2=0x7f5ca80cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:43.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.696+0000 7f5cae7ff700 1 --2- 172.21.15.71:0/2941280187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ca8154320 0x7f5ca80cbb10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5ca806f610 tx=0x7f5c9c017000 comp rx=0 tx=0).stop 2023-10-09T06:54:43.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.697+0000 7f5cae7ff700 1 -- 172.21.15.71:0/2941280187 shutdown_connections 2023-10-09T06:54:43.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.697+0000 7f5cae7ff700 1 --2- 172.21.15.71:0/2941280187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ca815a190 0x7f5ca815c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:43.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.697+0000 7f5cae7ff700 1 --2- 172.21.15.71:0/2941280187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ca8153f50 0x7f5ca8146240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:43.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.697+0000 7f5cae7ff700 1 --2- 172.21.15.71:0/2941280187 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5c94067130 0x7f5c940695e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:43.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.697+0000 7f5cae7ff700 1 --2- 172.21.15.71:0/2941280187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ca8154320 0x7f5ca80cbb10 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:43.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.697+0000 7f5cae7ff700 1 -- 172.21.15.71:0/2941280187 >> 172.21.15.71:0/2941280187 conn(0x7f5ca806baf0 msgr2=0x7f5ca806dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:43.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.697+0000 7f5cae7ff700 1 -- 172.21.15.71:0/2941280187 shutdown_connections 2023-10-09T06:54:43.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:43.697+0000 7f5cae7ff700 1 -- 172.21.15.71:0/2941280187 wait complete. 2023-10-09T06:54:43.716 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir8 2023-10-09T06:54:43.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:43.716 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-10-09T06:54:43.756 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:43.756 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:43.756 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:43.756 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:43.756 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:43.756 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:43.756 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:43.756 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:43.757 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:43.757 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:43.757 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:43.758 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:43.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:43.758 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-09-06_44_00_UTC) 2023-10-09T06:54:43.850 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:43.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:43.850 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-09-06_45_00_UTC) 2023-10-09T06:54:43.893 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:43.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:43.893 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-09-06_46_00_UTC) 2023-10-09T06:54:43.978 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:43.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:43.979 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-09-06_47_00_UTC) 2023-10-09T06:54:44.062 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:44.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:44.063 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-09-06_48_00_UTC) 2023-10-09T06:54:44.147 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:44.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:44.147 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-09-06_49_00_UTC) 2023-10-09T06:54:44.230 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:44.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:44.230 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-09-06_50_00_UTC) 2023-10-09T06:54:44.314 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:44.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:44.315 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-09-06_51_00_UTC) 2023-10-09T06:54:44.397 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:44.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:44.397 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-09-06_52_00_UTC) 2023-10-09T06:54:44.481 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:44.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:44.481 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-09-06_53_00_UTC) 2023-10-09T06:54:44.569 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:44.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:44.570 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-09-06_54_00_UTC) 2023-10-09T06:54:44.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:44.615 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8) 2023-10-09T06:54:44.694 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir9 1M 2023-10-09T06:54:44.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.934+0000 7faac359e700 1 Processor -- start 2023-10-09T06:54:44.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.934+0000 7faac359e700 1 -- start start 2023-10-09T06:54:44.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.935+0000 7faac359e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faac40b0c00 0x7faac40ad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:44.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.935+0000 7faac359e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac40b0570 con 0x7faac4156350 2023-10-09T06:54:44.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.935+0000 7faac359e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac40af4d0 con 0x7faac40b0760 2023-10-09T06:54:44.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.935+0000 7faac359e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac40af7b0 con 0x7faac40b0c00 2023-10-09T06:54:44.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.935+0000 7faac259c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7faac4156350 0x7faac4157370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44452/0 (socket says 172.21.15.71:44452) 2023-10-09T06:54:44.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.935+0000 7faac259c700 1 -- 172.21.15.71:0/1157070313 learned_addr learned my addr 172.21.15.71:0/1157070313 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:44.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.935+0000 7faac2d9d700 1 --2- 172.21.15.71:0/1157070313 >> v2:172.21.15.71:3300/0 conn(0x7faac40b0c00 0x7faac40ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:44.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.936+0000 7faac159a700 1 -- 172.21.15.71:0/1157070313 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137494967 0 0) 0x7faac40b0570 con 0x7faac4156350 2023-10-09T06:54:44.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.936+0000 7faac159a700 1 -- 172.21.15.71:0/1157070313 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaac003570 con 0x7faac4156350 2023-10-09T06:54:44.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.936+0000 7faac2d9d700 1 -- 172.21.15.71:0/1157070313 >> v1:172.21.15.179:6789/0 conn(0x7faac40b0760 legacy=0x7faac40ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:44.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.936+0000 7faac2d9d700 1 -- 172.21.15.71:0/1157070313 >> v1:172.21.15.71:6789/0 conn(0x7faac4156350 legacy=0x7faac4157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:44.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.936+0000 7faac2d9d700 1 -- 172.21.15.71:0/1157070313 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac40afa90 con 0x7faac40b0c00 2023-10-09T06:54:44.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.936+0000 7faac2d9d700 1 --2- 172.21.15.71:0/1157070313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac40b0c00 0x7faac40ad570 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7faabc009e60 tx=0x7faabc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aafa8c06a21689f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:44.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.936+0000 7faac159a700 1 -- 172.21.15.71:0/1157070313 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc00bb60 con 0x7faac40b0c00 2023-10-09T06:54:44.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.936+0000 7faac159a700 1 -- 172.21.15.71:0/1157070313 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faabc00bcc0 con 0x7faac40b0c00 2023-10-09T06:54:44.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.936+0000 7faac159a700 1 -- 172.21.15.71:0/1157070313 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc0116b0 con 0x7faac40b0c00 2023-10-09T06:54:44.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.937+0000 7faac359e700 1 -- 172.21.15.71:0/1157070313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac40b0c00 msgr2=0x7faac40ad570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:44.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.937+0000 7faac359e700 1 --2- 172.21.15.71:0/1157070313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac40b0c00 0x7faac40ad570 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7faabc009e60 tx=0x7faabc009780 comp rx=0 tx=0).stop 2023-10-09T06:54:44.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.937+0000 7faac359e700 1 -- 172.21.15.71:0/1157070313 shutdown_connections 2023-10-09T06:54:44.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.937+0000 7faac359e700 1 --2- 172.21.15.71:0/1157070313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac40b0c00 0x7faac40ad570 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:44.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.937+0000 7faac359e700 1 -- 172.21.15.71:0/1157070313 >> 172.21.15.71:0/1157070313 conn(0x7faac4068e20 msgr2=0x7faac40cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:44.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.937+0000 7faac359e700 1 -- 172.21.15.71:0/1157070313 shutdown_connections 2023-10-09T06:54:44.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.937+0000 7faac359e700 1 -- 172.21.15.71:0/1157070313 wait complete. 2023-10-09T06:54:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.938+0000 7faac359e700 1 Processor -- start 2023-10-09T06:54:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.939+0000 7faac359e700 1 -- start start 2023-10-09T06:54:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.939+0000 7faac359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac40b0760 0x7faac4166d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.939+0000 7faac359e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac40b0c00 0x7faac40cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.939+0000 7faac359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faac4156350 0x7faac40a72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.939+0000 7faac359e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac40c90c0 con 0x7faac40b0c00 2023-10-09T06:54:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.939+0000 7faac359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac40c9960 con 0x7faac40b0760 2023-10-09T06:54:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.939+0000 7faac359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac4166640 con 0x7faac4156350 2023-10-09T06:54:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.940+0000 7faac1d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac40b0c00 0x7faac40cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.940+0000 7faac1d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac40b0c00 0x7faac40cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36908/0 (socket says 172.21.15.71:36908) 2023-10-09T06:54:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.940+0000 7faac1d9b700 1 -- 172.21.15.71:0/2936545792 learned_addr learned my addr 172.21.15.71:0/2936545792 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.940+0000 7faac2d9d700 1 --2- 172.21.15.71:0/2936545792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faac4156350 0x7faac40a72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.940+0000 7faac259c700 1 --2- 172.21.15.71:0/2936545792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac40b0760 0x7faac4166d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.940+0000 7faac1d9b700 1 -- 172.21.15.71:0/2936545792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faac4156350 msgr2=0x7faac40a72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.940+0000 7faac1d9b700 1 --2- 172.21.15.71:0/2936545792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faac4156350 0x7faac40a72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.940+0000 7faac1d9b700 1 -- 172.21.15.71:0/2936545792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac40b0760 msgr2=0x7faac4166d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.940+0000 7faac1d9b700 1 --2- 172.21.15.71:0/2936545792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac40b0760 0x7faac4166d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.940+0000 7faac1d9b700 1 -- 172.21.15.71:0/2936545792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc009a20 con 0x7faac40b0c00 2023-10-09T06:54:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.940+0000 7faac259c700 1 --2- 172.21.15.71:0/2936545792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac40b0760 0x7faac4166d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:54:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.940+0000 7faac1d9b700 1 --2- 172.21.15.71:0/2936545792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac40b0c00 0x7faac40cb650 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7faab800c4e0 tx=0x7faab800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:44.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.941+0000 7faab27fc700 1 -- 172.21.15.71:0/2936545792 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab8011590 con 0x7faac40b0c00 2023-10-09T06:54:44.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.941+0000 7faab27fc700 1 -- 172.21.15.71:0/2936545792 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab8011710 con 0x7faac40b0c00 2023-10-09T06:54:44.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.941+0000 7faab27fc700 1 -- 172.21.15.71:0/2936545792 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab8011ad0 con 0x7faac40b0c00 2023-10-09T06:54:44.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.941+0000 7faac359e700 1 -- 172.21.15.71:0/2936545792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac40c9310 con 0x7faac40b0c00 2023-10-09T06:54:44.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.941+0000 7faac359e700 1 -- 172.21.15.71:0/2936545792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac40cbb90 con 0x7faac40b0c00 2023-10-09T06:54:44.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.942+0000 7faac359e700 1 -- 172.21.15.71:0/2936545792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac40cbdb0 con 0x7faac40b0c00 2023-10-09T06:54:44.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.943+0000 7faab27fc700 1 -- 172.21.15.71:0/2936545792 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7faab8001020 con 0x7faac40b0c00 2023-10-09T06:54:44.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.944+0000 7faab27fc700 1 --2- 172.21.15.71:0/2936545792 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faaa4067130 0x7faaa40695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:44.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.944+0000 7faab27fc700 1 -- 172.21.15.71:0/2936545792 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6515+0+0 (secure 0 0 0) 0x7faab8083fc0 con 0x7faac40b0c00 2023-10-09T06:54:44.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.944+0000 7faac259c700 1 --2- 172.21.15.71:0/2936545792 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faaa4067130 0x7faaa40695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:44.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.945+0000 7faac259c700 1 --2- 172.21.15.71:0/2936545792 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faaa4067130 0x7faaa40695e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faac4156f60 tx=0x7faab4009040 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:44.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:44.948+0000 7faab27fc700 1 -- 172.21.15.71:0/2936545792 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faab8050be0 con 0x7faac40b0c00 2023-10-09T06:54:45.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:45.164+0000 7faac359e700 1 -- 172.21.15.71:0/2936545792 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7faac40c9ad0 con 0x7faaa4067130 2023-10-09T06:54:45.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:45.245+0000 7faab27fc700 1 -- 172.21.15.71:0/2936545792 <== mgr.5083 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7faac40c9ad0 con 0x7faaa4067130 2023-10-09T06:54:45.247 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule removed for path /snap_test_dir1/dir9 2023-10-09T06:54:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:45.248+0000 7faac359e700 1 -- 172.21.15.71:0/2936545792 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faaa4067130 msgr2=0x7faaa40695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:45.248+0000 7faac359e700 1 --2- 172.21.15.71:0/2936545792 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faaa4067130 0x7faaa40695e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faac4156f60 tx=0x7faab4009040 comp rx=0 tx=0).stop 2023-10-09T06:54:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:45.248+0000 7faac359e700 1 -- 172.21.15.71:0/2936545792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac40b0c00 msgr2=0x7faac40cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:45.248+0000 7faac359e700 1 --2- 172.21.15.71:0/2936545792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac40b0c00 0x7faac40cb650 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7faab800c4e0 tx=0x7faab800c7f0 comp rx=0 tx=0).stop 2023-10-09T06:54:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:45.248+0000 7faac359e700 1 -- 172.21.15.71:0/2936545792 shutdown_connections 2023-10-09T06:54:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:45.248+0000 7faac359e700 1 --2- 172.21.15.71:0/2936545792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faac4156350 0x7faac40a72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:45.248+0000 7faac359e700 1 --2- 172.21.15.71:0/2936545792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac40b0760 0x7faac4166d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:45.248+0000 7faac359e700 1 --2- 172.21.15.71:0/2936545792 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faaa4067130 0x7faaa40695e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:45.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:45.248+0000 7faac359e700 1 --2- 172.21.15.71:0/2936545792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac40b0c00 0x7faac40cb650 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:45.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:45.248+0000 7faac359e700 1 -- 172.21.15.71:0/2936545792 >> 172.21.15.71:0/2936545792 conn(0x7faac4068e20 msgr2=0x7faac40add60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:45.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:45.248+0000 7faac359e700 1 -- 172.21.15.71:0/2936545792 shutdown_connections 2023-10-09T06:54:45.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:45.248+0000 7faac359e700 1 -- 172.21.15.71:0/2936545792 wait complete. 2023-10-09T06:54:45.266 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir9 2023-10-09T06:54:45.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:45.266 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-10-09T06:54:45.303 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:45.304 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:45.304 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:45.304 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:45.304 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:45.304 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:45.304 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:45.304 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:45.304 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:45.304 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:45.304 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:45.305 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-09-06_44_00_UTC 2023-10-09T06:54:45.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:45.306 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-09-06_44_00_UTC) 2023-10-09T06:54:45.395 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-09-06_45_00_UTC 2023-10-09T06:54:45.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:45.396 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-09-06_45_00_UTC) 2023-10-09T06:54:45.440 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-09-06_46_00_UTC 2023-10-09T06:54:45.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:45.440 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-09-06_46_00_UTC) 2023-10-09T06:54:45.524 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-09-06_47_00_UTC 2023-10-09T06:54:45.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:45.525 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-09-06_47_00_UTC) 2023-10-09T06:54:45.609 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-09-06_48_00_UTC 2023-10-09T06:54:45.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:45.610 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-09-06_48_00_UTC) 2023-10-09T06:54:45.693 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-09-06_49_00_UTC 2023-10-09T06:54:45.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:45.694 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-09-06_49_00_UTC) 2023-10-09T06:54:45.815 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-09-06_50_00_UTC 2023-10-09T06:54:45.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:45.815 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-09-06_50_00_UTC) 2023-10-09T06:54:45.879 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-09-06_51_00_UTC 2023-10-09T06:54:45.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:45.879 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-09-06_51_00_UTC) 2023-10-09T06:54:45.922 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-09-06_52_00_UTC 2023-10-09T06:54:45.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:45.923 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-09-06_52_00_UTC) 2023-10-09T06:54:46.005 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-09-06_53_00_UTC 2023-10-09T06:54:46.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:46.006 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-09-06_53_00_UTC) 2023-10-09T06:54:46.088 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-09-06_54_00_UTC 2023-10-09T06:54:46.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:46.089 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-09-06_54_00_UTC) 2023-10-09T06:54:46.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:46.174 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9) 2023-10-09T06:54:46.254 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-09T06:54:46.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.474+0000 7fb02a39d700 1 Processor -- start 2023-10-09T06:54:46.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.474+0000 7fb02a39d700 1 -- start start 2023-10-09T06:54:46.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.475+0000 7fb02a39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb024153900 0x7fb0240c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:46.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.475+0000 7fb02a39d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02406e150 con 0x7fb0240c9db0 2023-10-09T06:54:46.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.475+0000 7fb02a39d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0240c7800 con 0x7fb02406a710 2023-10-09T06:54:46.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.475+0000 7fb02a39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240c7ae0 con 0x7fb024153900 2023-10-09T06:54:46.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.475+0000 7fb028b9a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb0240c9db0 0x7fb02406a000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51394/0 (socket says 172.21.15.71:51394) 2023-10-09T06:54:46.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.475+0000 7fb028b9a700 1 -- 172.21.15.71:0/2846815441 learned_addr learned my addr 172.21.15.71:0/2846815441 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:46.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.476+0000 7fb02939b700 1 --2- 172.21.15.71:0/2846815441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb024153900 0x7fb0240c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:46.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.476+0000 7fb01bfff700 1 -- 172.21.15.71:0/2846815441 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541913747 0 0) 0x7fb02406e150 con 0x7fb0240c9db0 2023-10-09T06:54:46.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.476+0000 7fb01bfff700 1 -- 172.21.15.71:0/2846815441 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb010003570 con 0x7fb0240c9db0 2023-10-09T06:54:46.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.476+0000 7fb01bfff700 1 -- 172.21.15.71:0/2846815441 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490943043 0 0) 0x7fb0240c7800 con 0x7fb02406a710 2023-10-09T06:54:46.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.476+0000 7fb01bfff700 1 -- 172.21.15.71:0/2846815441 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb02406e150 con 0x7fb02406a710 2023-10-09T06:54:46.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.476+0000 7fb01bfff700 1 -- 172.21.15.71:0/2846815441 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1366794048 0 0) 0x7fb010003570 con 0x7fb0240c9db0 2023-10-09T06:54:46.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.476+0000 7fb02939b700 1 -- 172.21.15.71:0/2846815441 >> v1:172.21.15.179:6789/0 conn(0x7fb02406a710 legacy=0x7fb02406e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:46.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.476+0000 7fb02939b700 1 -- 172.21.15.71:0/2846815441 >> v1:172.21.15.71:6789/0 conn(0x7fb0240c9db0 legacy=0x7fb02406a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:46.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.476+0000 7fb02939b700 1 -- 172.21.15.71:0/2846815441 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0240c7dc0 con 0x7fb024153900 2023-10-09T06:54:46.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.477+0000 7fb02939b700 1 --2- 172.21.15.71:0/2846815441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb024153900 0x7fb0240c6f00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb020009910 tx=0x7fb0200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9f5f1611ba07d38 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:46.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.477+0000 7fb01bfff700 1 -- 172.21.15.71:0/2846815441 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb014001470 con 0x7fb024153900 2023-10-09T06:54:46.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.477+0000 7fb01bfff700 1 -- 172.21.15.71:0/2846815441 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb020011420 con 0x7fb024153900 2023-10-09T06:54:46.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.477+0000 7fb01bfff700 1 -- 172.21.15.71:0/2846815441 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0200117c0 con 0x7fb024153900 2023-10-09T06:54:46.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.477+0000 7fb02a39d700 1 -- 172.21.15.71:0/2846815441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb024153900 msgr2=0x7fb0240c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:46.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.477+0000 7fb02a39d700 1 --2- 172.21.15.71:0/2846815441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb024153900 0x7fb0240c6f00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb020009910 tx=0x7fb0200091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:46.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.477+0000 7fb02a39d700 1 -- 172.21.15.71:0/2846815441 shutdown_connections 2023-10-09T06:54:46.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.477+0000 7fb02a39d700 1 --2- 172.21.15.71:0/2846815441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb024153900 0x7fb0240c6f00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:46.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.477+0000 7fb02a39d700 1 -- 172.21.15.71:0/2846815441 >> 172.21.15.71:0/2846815441 conn(0x7fb0240cc1e0 msgr2=0x7fb0240cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:46.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.478+0000 7fb02a39d700 1 -- 172.21.15.71:0/2846815441 shutdown_connections 2023-10-09T06:54:46.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.478+0000 7fb02a39d700 1 -- 172.21.15.71:0/2846815441 wait complete. 2023-10-09T06:54:46.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.479+0000 7fb02a39d700 1 Processor -- start 2023-10-09T06:54:46.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.479+0000 7fb02a39d700 1 -- start start 2023-10-09T06:54:46.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.480+0000 7fb02a39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02406a710 0x7fb024159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:46.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.480+0000 7fb02a39d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0240c9db0 0x7fb0240b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:46.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.480+0000 7fb02a39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb024153900 0x7fb02416d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:46.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.480+0000 7fb02a39d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240c28f0 con 0x7fb0240c9db0 2023-10-09T06:54:46.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.480+0000 7fb02a39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb024159fa0 con 0x7fb024153900 2023-10-09T06:54:46.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.480+0000 7fb02a39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240c2460 con 0x7fb02406a710 2023-10-09T06:54:46.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.480+0000 7fb028b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0240c9db0 0x7fb0240b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:46.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.480+0000 7fb028b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0240c9db0 0x7fb0240b0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56140/0 (socket says 172.21.15.71:56140) 2023-10-09T06:54:46.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.480+0000 7fb028b9a700 1 -- 172.21.15.71:0/4279867635 learned_addr learned my addr 172.21.15.71:0/4279867635 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:46.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.480+0000 7fb02939b700 1 --2- 172.21.15.71:0/4279867635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02406a710 0x7fb024159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:46.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.480+0000 7fb029b9c700 1 --2- 172.21.15.71:0/4279867635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb024153900 0x7fb02416d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:46.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.481+0000 7fb028b9a700 1 -- 172.21.15.71:0/4279867635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02406a710 msgr2=0x7fb024159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:46.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.481+0000 7fb028b9a700 1 --2- 172.21.15.71:0/4279867635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02406a710 0x7fb024159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:46.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.481+0000 7fb028b9a700 1 -- 172.21.15.71:0/4279867635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb024153900 msgr2=0x7fb02416d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:46.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.481+0000 7fb028b9a700 1 --2- 172.21.15.71:0/4279867635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb024153900 0x7fb02416d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:46.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.481+0000 7fb028b9a700 1 -- 172.21.15.71:0/4279867635 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb020009420 con 0x7fb0240c9db0 2023-10-09T06:54:46.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.481+0000 7fb028b9a700 1 --2- 172.21.15.71:0/4279867635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0240c9db0 0x7fb0240b0f30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb01400cbc0 tx=0x7fb014001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:46.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.481+0000 7fb0197fa700 1 -- 172.21.15.71:0/4279867635 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb014007e90 con 0x7fb0240c9db0 2023-10-09T06:54:46.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.481+0000 7fb0197fa700 1 -- 172.21.15.71:0/4279867635 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb014007150 con 0x7fb0240c9db0 2023-10-09T06:54:46.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.481+0000 7fb02a39d700 1 -- 172.21.15.71:0/4279867635 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02415a1d0 con 0x7fb0240c9db0 2023-10-09T06:54:46.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.481+0000 7fb0197fa700 1 -- 172.21.15.71:0/4279867635 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb014007510 con 0x7fb0240c9db0 2023-10-09T06:54:46.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.481+0000 7fb02a39d700 1 -- 172.21.15.71:0/4279867635 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0240c1e10 con 0x7fb0240c9db0 2023-10-09T06:54:46.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.482+0000 7fb02a39d700 1 -- 172.21.15.71:0/4279867635 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0240c2610 con 0x7fb0240c9db0 2023-10-09T06:54:46.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.483+0000 7fb0197fa700 1 -- 172.21.15.71:0/4279867635 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fb014004a40 con 0x7fb0240c9db0 2023-10-09T06:54:46.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.484+0000 7fb0197fa700 1 --2- 172.21.15.71:0/4279867635 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb008067130 0x7fb0080695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:46.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.484+0000 7fb0197fa700 1 -- 172.21.15.71:0/4279867635 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6627+0+0 (secure 0 0 0) 0x7fb0140841d0 con 0x7fb0240c9db0 2023-10-09T06:54:46.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.484+0000 7fb02939b700 1 --2- 172.21.15.71:0/4279867635 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb008067130 0x7fb0080695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:46.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.485+0000 7fb02939b700 1 --2- 172.21.15.71:0/4279867635 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb008067130 0x7fb0080695e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb0200030c0 tx=0x7fb020016000 comp rx=0 tx=0).ready entity=mgr.5083 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:46.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.488+0000 7fb0197fa700 1 -- 172.21.15.71:0/4279867635 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0240c2610 con 0x7fb0240c9db0 2023-10-09T06:54:46.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:46.746+0000 7fb02a39d700 1 -- 172.21.15.71:0/4279867635 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fb0240c25d0 con 0x7fb0240c9db0 2023-10-09T06:54:47.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:47.738+0000 7fb0197fa700 1 -- 172.21.15.71:0/4279867635 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 13) v1 ==== 84911+0+0 (secure 0 0 0) 0x7fb014004cf0 con 0x7fb0240c9db0 2023-10-09T06:54:47.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:47.740+0000 7fb0197fa700 1 -- 172.21.15.71:0/4279867635 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v13) v1 ==== 93+0+0 (secure 0 0 0) 0x7fb0140546a0 con 0x7fb0240c9db0 2023-10-09T06:54:47.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:47.744+0000 7fb02a39d700 1 -- 172.21.15.71:0/4279867635 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb008067130 msgr2=0x7fb0080695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:47.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:47.745+0000 7fb02a39d700 1 --2- 172.21.15.71:0/4279867635 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb008067130 0x7fb0080695e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb0200030c0 tx=0x7fb020016000 comp rx=0 tx=0).stop 2023-10-09T06:54:47.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:47.745+0000 7fb02a39d700 1 -- 172.21.15.71:0/4279867635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0240c9db0 msgr2=0x7fb0240b0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:47.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:47.745+0000 7fb02a39d700 1 --2- 172.21.15.71:0/4279867635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0240c9db0 0x7fb0240b0f30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb01400cbc0 tx=0x7fb014001b50 comp rx=0 tx=0).stop 2023-10-09T06:54:47.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:47.745+0000 7fb02a39d700 1 -- 172.21.15.71:0/4279867635 shutdown_connections 2023-10-09T06:54:47.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:47.745+0000 7fb02a39d700 1 --2- 172.21.15.71:0/4279867635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb024153900 0x7fb02416d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:47.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:47.745+0000 7fb02a39d700 1 --2- 172.21.15.71:0/4279867635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02406a710 0x7fb024159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:47.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:47.745+0000 7fb02a39d700 1 --2- 172.21.15.71:0/4279867635 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb008067130 0x7fb0080695e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:47.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:47.745+0000 7fb02a39d700 1 --2- 172.21.15.71:0/4279867635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0240c9db0 0x7fb0240b0f30 secure :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb01400cbc0 tx=0x7fb014001b50 comp rx=0 tx=0).stop 2023-10-09T06:54:47.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:47.745+0000 7fb02a39d700 1 -- 172.21.15.71:0/4279867635 >> 172.21.15.71:0/4279867635 conn(0x7fb0240cc1e0 msgr2=0x7fb0240ca200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:47.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:47.745+0000 7fb02a39d700 1 -- 172.21.15.71:0/4279867635 shutdown_connections 2023-10-09T06:54:47.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:47.745+0000 7fb02a39d700 1 -- 172.21.15.71:0/4279867635 wait complete. 2023-10-09T06:54:47.780 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:54:47.781 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:54:47.871 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:54:47.950 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:54:47.950 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T06:54:47.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:54:47.950 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T06:54:48.041 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T06:54:48.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:54:48.042 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T06:54:48.079 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:54:48.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.312+0000 7f600999d700 1 Processor -- start 2023-10-09T06:54:48.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.312+0000 7f600999d700 1 -- start start 2023-10-09T06:54:48.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.314+0000 7f600999d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f60041595a0 0x7f60040b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:48.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.314+0000 7f600999d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f60040c6c60 0x7f60040c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:48.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.314+0000 7f600999d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60040b1de0 0x7f60040c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:48.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.314+0000 7f600999d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60040b2b90 con 0x7f60040c6c60 2023-10-09T06:54:48.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.314+0000 7f600999d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60040b1410 con 0x7f60041595a0 2023-10-09T06:54:48.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.314+0000 7f600999d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6004063230 con 0x7f60040b1de0 2023-10-09T06:54:48.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.314+0000 7f6003fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f60040c6c60 0x7f60040c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:48.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.314+0000 7f6003fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f60040c6c60 0x7f60040c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56156/0 (socket says 172.21.15.71:56156) 2023-10-09T06:54:48.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.314+0000 7f6003fff700 1 -- 172.21.15.71:0/453527515 learned_addr learned my addr 172.21.15.71:0/453527515 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:48.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.314+0000 7f600899b700 1 --2- 172.21.15.71:0/453527515 >> v2:172.21.15.179:3300/0 conn(0x7f60041595a0 0x7f60040b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:48.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.314+0000 7f600919c700 1 --2- 172.21.15.71:0/453527515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60040b1de0 0x7f60040c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:48.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.314+0000 7f6003fff700 1 -- 172.21.15.71:0/453527515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60040b1de0 msgr2=0x7f60040c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:48.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.314+0000 7f6003fff700 1 --2- 172.21.15.71:0/453527515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60040b1de0 0x7f60040c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:48.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.314+0000 7f6003fff700 1 -- 172.21.15.71:0/453527515 >> v2:172.21.15.179:3300/0 conn(0x7f60041595a0 msgr2=0x7f60040b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:48.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.314+0000 7f6003fff700 1 --2- 172.21.15.71:0/453527515 >> v2:172.21.15.179:3300/0 conn(0x7f60041595a0 0x7f60040b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:48.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.314+0000 7f6003fff700 1 -- 172.21.15.71:0/453527515 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60040634f0 con 0x7f60040c6c60 2023-10-09T06:54:48.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.315+0000 7f6003fff700 1 --2- 172.21.15.71:0/453527515 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60040c6c60 0x7f60040c8120 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f60040c8d10 tx=0x7f5ff0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ebad8785ecc65e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:48.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.315+0000 7f60037fe700 1 -- 172.21.15.71:0/453527515 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff000b640 con 0x7f60040c6c60 2023-10-09T06:54:48.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.315+0000 7f60037fe700 1 -- 172.21.15.71:0/453527515 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff000b7a0 con 0x7f60040c6c60 2023-10-09T06:54:48.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.315+0000 7f60037fe700 1 -- 172.21.15.71:0/453527515 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff000bb60 con 0x7f60040c6c60 2023-10-09T06:54:48.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.316+0000 7f600999d700 1 -- 172.21.15.71:0/453527515 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60040c6c60 msgr2=0x7f60040c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:48.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.316+0000 7f600999d700 1 --2- 172.21.15.71:0/453527515 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60040c6c60 0x7f60040c8120 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f60040c8d10 tx=0x7f5ff0009250 comp rx=0 tx=0).stop 2023-10-09T06:54:48.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.316+0000 7f600999d700 1 -- 172.21.15.71:0/453527515 shutdown_connections 2023-10-09T06:54:48.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.316+0000 7f600999d700 1 --2- 172.21.15.71:0/453527515 >> v2:172.21.15.179:3300/0 conn(0x7f60041595a0 0x7f60040b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:48.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.316+0000 7f600999d700 1 --2- 172.21.15.71:0/453527515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60040b1de0 0x7f60040c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:48.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.316+0000 7f600999d700 1 --2- 172.21.15.71:0/453527515 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60040c6c60 0x7f60040c8120 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:48.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.316+0000 7f600999d700 1 -- 172.21.15.71:0/453527515 >> 172.21.15.71:0/453527515 conn(0x7f600406ddb0 msgr2=0x7f600406e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:48.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.316+0000 7f600999d700 1 -- 172.21.15.71:0/453527515 shutdown_connections 2023-10-09T06:54:48.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.316+0000 7f600999d700 1 -- 172.21.15.71:0/453527515 wait complete. 2023-10-09T06:54:48.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.317+0000 7f600999d700 1 Processor -- start 2023-10-09T06:54:48.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.317+0000 7f600999d700 1 -- start start 2023-10-09T06:54:48.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.318+0000 7f600999d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60040b1de0 0x7f6004153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:48.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.318+0000 7f600999d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60040c6c60 0x7f600415ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:48.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.318+0000 7f600999d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60041595a0 0x7f600415e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:48.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.318+0000 7f600999d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600415c940 con 0x7f60040b1de0 2023-10-09T06:54:48.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.318+0000 7f600999d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600415a330 con 0x7f60041595a0 2023-10-09T06:54:48.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.318+0000 7f600999d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6004153f50 con 0x7f60040c6c60 2023-10-09T06:54:48.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.319+0000 7f600899b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60040b1de0 0x7f6004153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:48.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.319+0000 7f600899b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60040b1de0 0x7f6004153a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56168/0 (socket says 172.21.15.71:56168) 2023-10-09T06:54:48.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.319+0000 7f600899b700 1 -- 172.21.15.71:0/1635970091 learned_addr learned my addr 172.21.15.71:0/1635970091 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:48.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.319+0000 7f6003fff700 1 --2- 172.21.15.71:0/1635970091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60040c6c60 0x7f600415ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:48.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.319+0000 7f600919c700 1 --2- 172.21.15.71:0/1635970091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60041595a0 0x7f600415e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:48.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.319+0000 7f600899b700 1 -- 172.21.15.71:0/1635970091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60040c6c60 msgr2=0x7f600415ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:48.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.319+0000 7f600899b700 1 --2- 172.21.15.71:0/1635970091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60040c6c60 0x7f600415ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:48.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.319+0000 7f600899b700 1 -- 172.21.15.71:0/1635970091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60041595a0 msgr2=0x7f600415e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:48.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.319+0000 7f600899b700 1 --2- 172.21.15.71:0/1635970091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60041595a0 0x7f600415e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:48.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.319+0000 7f600899b700 1 -- 172.21.15.71:0/1635970091 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff00094f0 con 0x7f60040b1de0 2023-10-09T06:54:48.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.319+0000 7f600899b700 1 --2- 172.21.15.71:0/1635970091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60040b1de0 0x7f6004153a10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800e930 tx=0x7f5ff80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:48.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.320+0000 7f6000ff9700 1 -- 172.21.15.71:0/1635970091 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8013680 con 0x7f60040b1de0 2023-10-09T06:54:48.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.320+0000 7f6000ff9700 1 -- 172.21.15.71:0/1635970091 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff80137e0 con 0x7f60040b1de0 2023-10-09T06:54:48.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.320+0000 7f6000ff9700 1 -- 172.21.15.71:0/1635970091 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8013b80 con 0x7f60040b1de0 2023-10-09T06:54:48.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.320+0000 7f600999d700 1 -- 172.21.15.71:0/1635970091 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f600415c380 con 0x7f60040b1de0 2023-10-09T06:54:48.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.320+0000 7f600999d700 1 -- 172.21.15.71:0/1635970091 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600415a5a0 con 0x7f60040b1de0 2023-10-09T06:54:48.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.321+0000 7f600999d700 1 -- 172.21.15.71:0/1635970091 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6004156c10 con 0x7f60040b1de0 2023-10-09T06:54:48.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.323+0000 7f6000ff9700 1 -- 172.21.15.71:0/1635970091 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f5ff800c3e0 con 0x7f60040b1de0 2023-10-09T06:54:48.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.323+0000 7f6000ff9700 1 --2- 172.21.15.71:0/1635970091 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5fe8067110 0x7f5fe80695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:48.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.323+0000 7f6000ff9700 1 -- 172.21.15.71:0/1635970091 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6579+0+0 (secure 0 0 0) 0x7f5ff8085460 con 0x7f60040b1de0 2023-10-09T06:54:48.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.324+0000 7f6003fff700 1 -- 172.21.15.71:0/1635970091 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5fe8067110 msgr2=0x7f5fe80695c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:54:48.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.324+0000 7f6003fff700 1 --2- 172.21.15.71:0/1635970091 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5fe8067110 0x7f5fe80695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:54:48.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.327+0000 7f6000ff9700 1 -- 172.21.15.71:0/1635970091 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ff8052160 con 0x7f60040b1de0 2023-10-09T06:54:48.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.525+0000 7f6003fff700 1 -- 172.21.15.71:0/1635970091 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5fe8067110 msgr2=0x7f5fe80695c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:54:48.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.525+0000 7f6003fff700 1 --2- 172.21.15.71:0/1635970091 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5fe8067110 0x7f5fe80695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:54:48.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.571+0000 7f600999d700 1 -- 172.21.15.71:0/1635970091 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f600404c3c0 con 0x7f60040b1de0 2023-10-09T06:54:48.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.572+0000 7f6000ff9700 1 -- 172.21.15.71:0/1635970091 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f5ff8055780 con 0x7f60040b1de0 2023-10-09T06:54:48.573 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:54:48.573 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2315236875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":2315236875},{"type":"v1","addr":"172.21.15.71:6835","nonce":2315236875}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4628,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2455384244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2455384244},{"type":"v1","addr":"172.21.15.179:6836","nonce":2455384244}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3668669622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3668669622},{"type":"v1","addr":"172.21.15.179:6837","nonce":3668669622}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:43:32.039618+0000","modified":"2023-10-09T06:43:35.597837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4905":{"gid":4905,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6834/4010179291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":4010179291},{"type":"v1","addr":"172.21.15.71:6834","nonce":4010179291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T06:54:48.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.574+0000 7f600999d700 1 -- 172.21.15.71:0/1635970091 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5fe8067110 msgr2=0x7f5fe80695c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:54:48.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.574+0000 7f600999d700 1 --2- 172.21.15.71:0/1635970091 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5fe8067110 0x7f5fe80695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:48.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.574+0000 7f600999d700 1 -- 172.21.15.71:0/1635970091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60040b1de0 msgr2=0x7f6004153a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:48.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.574+0000 7f600999d700 1 --2- 172.21.15.71:0/1635970091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60040b1de0 0x7f6004153a10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800e930 tx=0x7f5ff80091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:48.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.574+0000 7f600999d700 1 -- 172.21.15.71:0/1635970091 shutdown_connections 2023-10-09T06:54:48.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.574+0000 7f600999d700 1 --2- 172.21.15.71:0/1635970091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60041595a0 0x7f600415e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:48.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.574+0000 7f600999d700 1 --2- 172.21.15.71:0/1635970091 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5fe8067110 0x7f5fe80695c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:48.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.574+0000 7f600999d700 1 --2- 172.21.15.71:0/1635970091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60040b1de0 0x7f6004153a10 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:48.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.574+0000 7f600999d700 1 --2- 172.21.15.71:0/1635970091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60040c6c60 0x7f600415ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:48.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.574+0000 7f600999d700 1 -- 172.21.15.71:0/1635970091 >> 172.21.15.71:0/1635970091 conn(0x7f600406ddb0 msgr2=0x7f60040c6160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:48.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.574+0000 7f600999d700 1 -- 172.21.15.71:0/1635970091 shutdown_connections 2023-10-09T06:54:48.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.574+0000 7f600999d700 1 -- 172.21.15.71:0/1635970091 wait complete. 2023-10-09T06:54:48.576 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 15 2023-10-09T06:54:48.593 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:54:48.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.782+0000 7fa40a99d700 1 Processor -- start 2023-10-09T06:54:48.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.782+0000 7fa40a99d700 1 -- start start 2023-10-09T06:54:48.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.784+0000 7fa40a99d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa4041566e0 0x7fa4040ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:48.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.784+0000 7fa40a99d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4040ca860 con 0x7fa4040cb900 2023-10-09T06:54:48.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.784+0000 7fa40a99d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4040cab40 con 0x7fa404156310 2023-10-09T06:54:48.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.784+0000 7fa40a99d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4040cae20 con 0x7fa4041566e0 2023-10-09T06:54:48.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.784+0000 7fa40a19c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa4040cb900 0x7fa4040c6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51414/0 (socket says 172.21.15.71:51414) 2023-10-09T06:54:48.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.784+0000 7fa40a19c700 1 -- 172.21.15.71:0/3406124878 learned_addr learned my addr 172.21.15.71:0/3406124878 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:48.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.784+0000 7fa40919a700 1 --2- 172.21.15.71:0/3406124878 >> v2:172.21.15.179:3300/0 conn(0x7fa4041566e0 0x7fa4040ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:48.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.784+0000 7fa408999700 1 -- 172.21.15.71:0/3406124878 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2589214795 0 0) 0x7fa4040ca860 con 0x7fa4040cb900 2023-10-09T06:54:48.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.784+0000 7fa408999700 1 -- 172.21.15.71:0/3406124878 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3f0003570 con 0x7fa4040cb900 2023-10-09T06:54:48.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.785+0000 7fa40919a700 1 -- 172.21.15.71:0/3406124878 >> v1:172.21.15.179:6789/0 conn(0x7fa404156310 legacy=0x7fa4040c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:48.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.785+0000 7fa408999700 1 -- 172.21.15.71:0/3406124878 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294167375 0 0) 0x7fa4040cab40 con 0x7fa404156310 2023-10-09T06:54:48.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.785+0000 7fa40919a700 1 -- 172.21.15.71:0/3406124878 >> v1:172.21.15.71:6789/0 conn(0x7fa4040cb900 legacy=0x7fa4040c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:48.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.785+0000 7fa40919a700 1 -- 172.21.15.71:0/3406124878 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4040cb100 con 0x7fa4041566e0 2023-10-09T06:54:48.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.785+0000 7fa40919a700 1 --2- 172.21.15.71:0/3406124878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4041566e0 0x7fa4040ae000 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40098e0 tx=0x7fa3f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69bd86678c918520 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:48.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.785+0000 7fa408999700 1 -- 172.21.15.71:0/3406124878 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f400b640 con 0x7fa4041566e0 2023-10-09T06:54:48.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.785+0000 7fa408999700 1 -- 172.21.15.71:0/3406124878 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f400b7a0 con 0x7fa4041566e0 2023-10-09T06:54:48.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.785+0000 7fa408999700 1 -- 172.21.15.71:0/3406124878 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f400bb40 con 0x7fa4041566e0 2023-10-09T06:54:48.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.786+0000 7fa40a99d700 1 -- 172.21.15.71:0/3406124878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4041566e0 msgr2=0x7fa4040ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:48.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.786+0000 7fa40a99d700 1 --2- 172.21.15.71:0/3406124878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4041566e0 0x7fa4040ae000 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40098e0 tx=0x7fa3f40091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:48.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.786+0000 7fa40a99d700 1 -- 172.21.15.71:0/3406124878 shutdown_connections 2023-10-09T06:54:48.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.786+0000 7fa40a99d700 1 --2- 172.21.15.71:0/3406124878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4041566e0 0x7fa4040ae000 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:48.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.786+0000 7fa40a99d700 1 -- 172.21.15.71:0/3406124878 >> 172.21.15.71:0/3406124878 conn(0x7fa4040cc1f0 msgr2=0x7fa4040cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:48.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.786+0000 7fa40a99d700 1 -- 172.21.15.71:0/3406124878 shutdown_connections 2023-10-09T06:54:48.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.786+0000 7fa40a99d700 1 -- 172.21.15.71:0/3406124878 wait complete. 2023-10-09T06:54:48.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.788+0000 7fa40a99d700 1 Processor -- start 2023-10-09T06:54:48.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.789+0000 7fa40a99d700 1 -- start start 2023-10-09T06:54:48.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.790+0000 7fa40a99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4040cb900 0x7fa40414d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:48.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.790+0000 7fa40a99d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa404156310 0x7fa404155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:48.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.790+0000 7fa40a99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4041566e0 0x7fa404155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:48.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.790+0000 7fa40a99d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa404158310 con 0x7fa404156310 2023-10-09T06:54:48.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.790+0000 7fa40a99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa404157a70 con 0x7fa4040cb900 2023-10-09T06:54:48.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.790+0000 7fa40a99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa404157d50 con 0x7fa4041566e0 2023-10-09T06:54:48.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.790+0000 7fa40919a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa404156310 0x7fa404155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:48.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.790+0000 7fa40919a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa404156310 0x7fa404155130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56176/0 (socket says 172.21.15.71:56176) 2023-10-09T06:54:48.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.790+0000 7fa40919a700 1 -- 172.21.15.71:0/2790083201 learned_addr learned my addr 172.21.15.71:0/2790083201 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:48.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.790+0000 7fa40999b700 1 --2- 172.21.15.71:0/2790083201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4040cb900 0x7fa40414d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:48.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.790+0000 7fa40a19c700 1 --2- 172.21.15.71:0/2790083201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4041566e0 0x7fa404155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:48.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.791+0000 7fa40919a700 1 -- 172.21.15.71:0/2790083201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4041566e0 msgr2=0x7fa404155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:48.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.791+0000 7fa40919a700 1 --2- 172.21.15.71:0/2790083201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4041566e0 0x7fa404155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:48.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.791+0000 7fa40919a700 1 -- 172.21.15.71:0/2790083201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4040cb900 msgr2=0x7fa40414d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:48.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.791+0000 7fa40919a700 1 --2- 172.21.15.71:0/2790083201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4040cb900 0x7fa40414d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:48.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.791+0000 7fa40919a700 1 -- 172.21.15.71:0/2790083201 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f4009420 con 0x7fa404156310 2023-10-09T06:54:48.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.791+0000 7fa40919a700 1 --2- 172.21.15.71:0/2790083201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa404156310 0x7fa404155130 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40093f0 tx=0x7fa3f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:48.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.791+0000 7fa3f9ffb700 1 -- 172.21.15.71:0/2790083201 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f400b910 con 0x7fa404156310 2023-10-09T06:54:48.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.791+0000 7fa3f9ffb700 1 -- 172.21.15.71:0/2790083201 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f400ba70 con 0x7fa404156310 2023-10-09T06:54:48.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.791+0000 7fa40a99d700 1 -- 172.21.15.71:0/2790083201 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa404158030 con 0x7fa404156310 2023-10-09T06:54:48.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.792+0000 7fa3f9ffb700 1 -- 172.21.15.71:0/2790083201 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4022690 con 0x7fa404156310 2023-10-09T06:54:48.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.792+0000 7fa40a99d700 1 -- 172.21.15.71:0/2790083201 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40414dbe0 con 0x7fa404156310 2023-10-09T06:54:48.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.793+0000 7fa40a99d700 1 -- 172.21.15.71:0/2790083201 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa40414ddd0 con 0x7fa404156310 2023-10-09T06:54:48.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.793+0000 7fa3f9ffb700 1 -- 172.21.15.71:0/2790083201 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 84911+0+0 (secure 0 0 0) 0x7fa3f4022a80 con 0x7fa404156310 2023-10-09T06:54:48.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.794+0000 7fa3f9ffb700 1 --2- 172.21.15.71:0/2790083201 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa3e80670e0 0x7fa3e8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:48.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.794+0000 7fa3f9ffb700 1 -- 172.21.15.71:0/2790083201 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6803+0+0 (secure 0 0 0) 0x7fa3f4088970 con 0x7fa404156310 2023-10-09T06:54:48.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.794+0000 7fa40999b700 1 -- 172.21.15.71:0/2790083201 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa3e80670e0 msgr2=0x7fa3e8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:54:48.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.795+0000 7fa40999b700 1 --2- 172.21.15.71:0/2790083201 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa3e80670e0 0x7fa3e8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:54:48.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.803+0000 7fa3f9ffb700 1 -- 172.21.15.71:0/2790083201 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa40414ddd0 con 0x7fa404156310 2023-10-09T06:54:48.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.996+0000 7fa40999b700 1 -- 172.21.15.71:0/2790083201 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa3e80670e0 msgr2=0x7fa3e8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:54:48.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:48.996+0000 7fa40999b700 1 --2- 172.21.15.71:0/2790083201 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa3e80670e0 0x7fa3e8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:54:49.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.015+0000 7fa40a99d700 1 -- 172.21.15.71:0/2790083201 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa404166940 con 0x7fa404156310 2023-10-09T06:54:49.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.016+0000 7fa3f9ffb700 1 -- 172.21.15.71:0/2790083201 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+17016 (secure 0 0 0) 0x7fa404166940 con 0x7fa404156310 2023-10-09T06:54:49.017 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:54:49.017 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":49,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:54:48.713989+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:43:29.634330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T06:43:31.023113+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":216,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6833/85452":"2023-10-10T06:43:52.669588+0000","172.21.15.179:0/1464937439":"2023-10-10T06:43:52.669588+0000","172.21.15.179:0/4042901359":"2023-10-10T06:43:52.669588+0000","172.21.15.179:0/3168407320":"2023-10-10T06:43:52.669588+0000","172.21.15.179:6832/85452":"2023-10-10T06:43:52.669588+0000","172.21.15.179:0/1455428643":"2023-10-10T06:43:52.669588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":108,"length":1},{"begin":191,"length":26}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":4,"length":1},{"begin":8,"length":2},{"begin":12,"length":2},{"begin":16,"length":1},{"begin":22,"length":2},{"begin":26,"length":1},{"begin":34,"length":2},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":2},{"begin":49,"length":2},{"begin":52,"length":1},{"begin":56,"length":2},{"begin":61,"length":1},{"begin":63,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":73,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":83,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":93,"length":1},{"begin":98,"length":1},{"begin":102,"length":1},{"begin":104,"length":1},{"begin":109,"length":1},{"begin":156,"length":35}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:54:49.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.018+0000 7fa40a99d700 1 -- 172.21.15.71:0/2790083201 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa3e80670e0 msgr2=0x7fa3e8069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:54:49.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.018+0000 7fa40a99d700 1 --2- 172.21.15.71:0/2790083201 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa3e80670e0 0x7fa3e8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:49.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.018+0000 7fa40a99d700 1 -- 172.21.15.71:0/2790083201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa404156310 msgr2=0x7fa404155130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:49.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.018+0000 7fa40a99d700 1 --2- 172.21.15.71:0/2790083201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa404156310 0x7fa404155130 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40093f0 tx=0x7fa3f4017000 comp rx=0 tx=0).stop 2023-10-09T06:54:49.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.018+0000 7fa40a99d700 1 -- 172.21.15.71:0/2790083201 shutdown_connections 2023-10-09T06:54:49.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.018+0000 7fa40a99d700 1 --2- 172.21.15.71:0/2790083201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4041566e0 0x7fa404155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:49.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.018+0000 7fa40a99d700 1 --2- 172.21.15.71:0/2790083201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4040cb900 0x7fa40414d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:49.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.018+0000 7fa40a99d700 1 --2- 172.21.15.71:0/2790083201 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa3e80670e0 0x7fa3e8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:49.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.018+0000 7fa40a99d700 1 --2- 172.21.15.71:0/2790083201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa404156310 0x7fa404155130 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:49.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.018+0000 7fa40a99d700 1 -- 172.21.15.71:0/2790083201 >> 172.21.15.71:0/2790083201 conn(0x7fa4040cc1f0 msgr2=0x7fa4040c0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:49.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.019+0000 7fa40a99d700 1 -- 172.21.15.71:0/2790083201 shutdown_connections 2023-10-09T06:54:49.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.019+0000 7fa40a99d700 1 -- 172.21.15.71:0/2790083201 wait complete. 2023-10-09T06:54:49.039 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:43:29.634330+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:43:31.023113+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 216, 'snap_epoch': 48, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:54:49.039 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:54:49.073 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:49.073+0000 7f305a3fe180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T06:54:49.129 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:49.128+0000 7f41bb39e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T06:54:49.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.227+0000 7fe59a19d700 1 Processor -- start 2023-10-09T06:54:49.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.227+0000 7fe59a19d700 1 -- start start 2023-10-09T06:54:49.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.230+0000 7fe59a19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5940b4e70 0x7fe5940ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:49.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.230+0000 7fe59a19d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5940cfb00 con 0x7fe5940b1b40 2023-10-09T06:54:49.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.230+0000 7fe59a19d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59415e060 con 0x7fe5940b16d0 2023-10-09T06:54:49.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.230+0000 7fe59a19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5940b5c40 con 0x7fe5940b4e70 2023-10-09T06:54:49.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.230+0000 7fe59999c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe5940b1b40 0x7fe59415d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51428/0 (socket says 172.21.15.71:51428) 2023-10-09T06:54:49.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.230+0000 7fe59999c700 1 -- 172.21.15.71:0/2553147501 learned_addr learned my addr 172.21.15.71:0/2553147501 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:49.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.230+0000 7fe59919b700 1 --2- 172.21.15.71:0/2553147501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5940b4e70 0x7fe5940ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:49.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.231+0000 7fe58bfff700 1 -- 172.21.15.71:0/2553147501 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398851851 0 0) 0x7fe5940cfb00 con 0x7fe5940b1b40 2023-10-09T06:54:49.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.231+0000 7fe58bfff700 1 -- 172.21.15.71:0/2553147501 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe580003570 con 0x7fe5940b1b40 2023-10-09T06:54:49.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.231+0000 7fe58bfff700 1 -- 172.21.15.71:0/2553147501 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 315194160 0 0) 0x7fe59415e060 con 0x7fe5940b16d0 2023-10-09T06:54:49.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.231+0000 7fe58bfff700 1 -- 172.21.15.71:0/2553147501 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5940cfb00 con 0x7fe5940b16d0 2023-10-09T06:54:49.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.231+0000 7fe59919b700 1 -- 172.21.15.71:0/2553147501 >> v1:172.21.15.179:6789/0 conn(0x7fe5940b16d0 legacy=0x7fe59415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:49.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.231+0000 7fe59919b700 1 -- 172.21.15.71:0/2553147501 >> v1:172.21.15.71:6789/0 conn(0x7fe5940b1b40 legacy=0x7fe59415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:49.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.231+0000 7fe59919b700 1 -- 172.21.15.71:0/2553147501 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5940b5f20 con 0x7fe5940b4e70 2023-10-09T06:54:49.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.231+0000 7fe59919b700 1 --2- 172.21.15.71:0/2553147501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5940b4e70 0x7fe5940ccff0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe590009910 tx=0x7fe5900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e0832f3a073600e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:49.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.231+0000 7fe58bfff700 1 -- 172.21.15.71:0/2553147501 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590011630 con 0x7fe5940b4e70 2023-10-09T06:54:49.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.231+0000 7fe58bfff700 1 -- 172.21.15.71:0/2553147501 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe590011790 con 0x7fe5940b4e70 2023-10-09T06:54:49.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.231+0000 7fe58bfff700 1 -- 172.21.15.71:0/2553147501 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590011b30 con 0x7fe5940b4e70 2023-10-09T06:54:49.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.232+0000 7fe59a19d700 1 -- 172.21.15.71:0/2553147501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5940b4e70 msgr2=0x7fe5940ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:49.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.232+0000 7fe59a19d700 1 --2- 172.21.15.71:0/2553147501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5940b4e70 0x7fe5940ccff0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe590009910 tx=0x7fe5900091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:49.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.232+0000 7fe59a19d700 1 -- 172.21.15.71:0/2553147501 shutdown_connections 2023-10-09T06:54:49.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.232+0000 7fe59a19d700 1 --2- 172.21.15.71:0/2553147501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5940b4e70 0x7fe5940ccff0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:49.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.232+0000 7fe59a19d700 1 -- 172.21.15.71:0/2553147501 >> 172.21.15.71:0/2553147501 conn(0x7fe5940d10c0 msgr2=0x7fe5940affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:49.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.232+0000 7fe59a19d700 1 -- 172.21.15.71:0/2553147501 shutdown_connections 2023-10-09T06:54:49.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.232+0000 7fe59a19d700 1 -- 172.21.15.71:0/2553147501 wait complete. 2023-10-09T06:54:49.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.233+0000 7fe59a19d700 1 Processor -- start 2023-10-09T06:54:49.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.234+0000 7fe59a19d700 1 -- start start 2023-10-09T06:54:49.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.234+0000 7fe59a19d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5940b16d0 0x7fe5940ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:49.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.234+0000 7fe59a19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5940b1b40 0x7fe5940c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:49.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.234+0000 7fe59a19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5940b4e70 0x7fe594169920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:49.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.234+0000 7fe59a19d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5940c5390 con 0x7fe5940b16d0 2023-10-09T06:54:49.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.234+0000 7fe59a19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5940c5c30 con 0x7fe5940b4e70 2023-10-09T06:54:49.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.234+0000 7fe59a19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5940c7d30 con 0x7fe5940b1b40 2023-10-09T06:54:49.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.235+0000 7fe59919b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5940b16d0 0x7fe5940ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:49.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.235+0000 7fe59919b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5940b16d0 0x7fe5940ca390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56180/0 (socket says 172.21.15.71:56180) 2023-10-09T06:54:49.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.235+0000 7fe59919b700 1 -- 172.21.15.71:0/1702719123 learned_addr learned my addr 172.21.15.71:0/1702719123 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:49.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.235+0000 7fe59899a700 1 --2- 172.21.15.71:0/1702719123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5940b1b40 0x7fe5940c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:49.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.235+0000 7fe59999c700 1 --2- 172.21.15.71:0/1702719123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5940b4e70 0x7fe594169920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:49.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.235+0000 7fe59919b700 1 -- 172.21.15.71:0/1702719123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5940b1b40 msgr2=0x7fe5940c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:49.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.235+0000 7fe59919b700 1 --2- 172.21.15.71:0/1702719123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5940b1b40 0x7fe5940c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:49.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.235+0000 7fe59919b700 1 -- 172.21.15.71:0/1702719123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5940b4e70 msgr2=0x7fe594169920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:49.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.235+0000 7fe59919b700 1 --2- 172.21.15.71:0/1702719123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5940b4e70 0x7fe594169920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:49.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.235+0000 7fe59919b700 1 -- 172.21.15.71:0/1702719123 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe590009420 con 0x7fe5940b16d0 2023-10-09T06:54:49.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.235+0000 7fe59999c700 1 --2- 172.21.15.71:0/1702719123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5940b4e70 0x7fe594169920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:54:49.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.236+0000 7fe59919b700 1 --2- 172.21.15.71:0/1702719123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5940b16d0 0x7fe5940ca390 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe594070dd0 tx=0x7fe590017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:49.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.236+0000 7fe5897fa700 1 -- 172.21.15.71:0/1702719123 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59001f070 con 0x7fe5940b16d0 2023-10-09T06:54:49.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.236+0000 7fe5897fa700 1 -- 172.21.15.71:0/1702719123 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe590002f70 con 0x7fe5940b16d0 2023-10-09T06:54:49.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.236+0000 7fe59a19d700 1 -- 172.21.15.71:0/1702719123 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5940caa80 con 0x7fe5940b16d0 2023-10-09T06:54:49.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.236+0000 7fe5897fa700 1 -- 172.21.15.71:0/1702719123 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590011900 con 0x7fe5940b16d0 2023-10-09T06:54:49.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.236+0000 7fe59a19d700 1 -- 172.21.15.71:0/1702719123 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5940c58c0 con 0x7fe5940b16d0 2023-10-09T06:54:49.240 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:49.237+0000 7f305a3fe180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T06:54:49.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.237+0000 7fe59a19d700 1 -- 172.21.15.71:0/1702719123 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe594088990 con 0x7fe5940b16d0 2023-10-09T06:54:49.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.239+0000 7fe5897fa700 1 -- 172.21.15.71:0/1702719123 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 84911+0+0 (secure 0 0 0) 0x7fe590023070 con 0x7fe5940b16d0 2023-10-09T06:54:49.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.240+0000 7fe5897fa700 1 --2- 172.21.15.71:0/1702719123 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe5780670e0 0x7fe578069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:49.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.240+0000 7fe5897fa700 1 -- 172.21.15.71:0/1702719123 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6803+0+0 (secure 0 0 0) 0x7fe590085fc0 con 0x7fe5940b16d0 2023-10-09T06:54:49.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.240+0000 7fe59899a700 1 -- 172.21.15.71:0/1702719123 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe5780670e0 msgr2=0x7fe578069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:54:49.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.240+0000 7fe59899a700 1 --2- 172.21.15.71:0/1702719123 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe5780670e0 0x7fe578069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:54:49.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.244+0000 7fe5897fa700 1 -- 172.21.15.71:0/1702719123 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe590052ac0 con 0x7fe5940b16d0 2023-10-09T06:54:49.302 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:49.301+0000 7f41bb39e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T06:54:49.323 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:49.323+0000 7f305a3fe180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T06:54:49.388 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:49.387+0000 7f41bb39e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T06:54:49.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.436+0000 7fe59a19d700 1 -- 172.21.15.71:0/1702719123 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe59404bb80 con 0x7fe5940b16d0 2023-10-09T06:54:49.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.437+0000 7fe5897fa700 1 -- 172.21.15.71:0/1702719123 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe59002a020 con 0x7fe5940b16d0 2023-10-09T06:54:49.438 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T06:54:49.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.439+0000 7fe59a19d700 1 -- 172.21.15.71:0/1702719123 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe5780670e0 msgr2=0x7fe578069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:54:49.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.439+0000 7fe59a19d700 1 --2- 172.21.15.71:0/1702719123 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe5780670e0 0x7fe578069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:49.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.439+0000 7fe59a19d700 1 -- 172.21.15.71:0/1702719123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5940b16d0 msgr2=0x7fe5940ca390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:49.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.439+0000 7fe59a19d700 1 --2- 172.21.15.71:0/1702719123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5940b16d0 0x7fe5940ca390 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe594070dd0 tx=0x7fe590017000 comp rx=0 tx=0).stop 2023-10-09T06:54:49.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.440+0000 7fe59a19d700 1 -- 172.21.15.71:0/1702719123 shutdown_connections 2023-10-09T06:54:49.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.440+0000 7fe59a19d700 1 --2- 172.21.15.71:0/1702719123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5940b4e70 0x7fe594169920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:49.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.440+0000 7fe59a19d700 1 --2- 172.21.15.71:0/1702719123 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe5780670e0 0x7fe578069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:49.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.440+0000 7fe59a19d700 1 --2- 172.21.15.71:0/1702719123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5940b16d0 0x7fe5940ca390 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:49.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.440+0000 7fe59a19d700 1 --2- 172.21.15.71:0/1702719123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5940b1b40 0x7fe5940c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:49.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.440+0000 7fe59a19d700 1 -- 172.21.15.71:0/1702719123 >> 172.21.15.71:0/1702719123 conn(0x7fe5940d10c0 msgr2=0x7fe594158e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:49.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.440+0000 7fe59a19d700 1 -- 172.21.15.71:0/1702719123 shutdown_connections 2023-10-09T06:54:49.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.440+0000 7fe59a19d700 1 -- 172.21.15.71:0/1702719123 wait complete. 2023-10-09T06:54:49.460 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:54:49.550 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:49.549+0000 7f305a3fe180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:54:49.622 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:49.621+0000 7f41bb39e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:54:49.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.649+0000 7fd1e339d700 1 Processor -- start 2023-10-09T06:54:49.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.649+0000 7fd1e339d700 1 -- start start 2023-10-09T06:54:49.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.650+0000 7fd1e339d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd1dc0b4e70 0x7fd1dc0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:49.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.650+0000 7fd1e339d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1dc0cfb00 con 0x7fd1dc0b16d0 2023-10-09T06:54:49.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.650+0000 7fd1e339d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1dc15e060 con 0x7fd1dc0b1b40 2023-10-09T06:54:49.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.650+0000 7fd1e339d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1dc0b5c40 con 0x7fd1dc0b4e70 2023-10-09T06:54:49.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.651+0000 7fd1e1b9a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd1dc0b16d0 0x7fd1dc15d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51440/0 (socket says 172.21.15.71:51440) 2023-10-09T06:54:49.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.651+0000 7fd1e1b9a700 1 -- 172.21.15.71:0/157361620 learned_addr learned my addr 172.21.15.71:0/157361620 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:49.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.651+0000 7fd1e239b700 1 --2- 172.21.15.71:0/157361620 >> v2:172.21.15.179:3300/0 conn(0x7fd1dc0b4e70 0x7fd1dc0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:49.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.651+0000 7fd1e1399700 1 -- 172.21.15.71:0/157361620 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 644330277 0 0) 0x7fd1dc0cfb00 con 0x7fd1dc0b16d0 2023-10-09T06:54:49.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.651+0000 7fd1e1399700 1 -- 172.21.15.71:0/157361620 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c8003570 con 0x7fd1dc0b16d0 2023-10-09T06:54:49.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.651+0000 7fd1e239b700 1 -- 172.21.15.71:0/157361620 >> v1:172.21.15.179:6789/0 conn(0x7fd1dc0b1b40 legacy=0x7fd1dc15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:49.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.651+0000 7fd1e239b700 1 -- 172.21.15.71:0/157361620 >> v1:172.21.15.71:6789/0 conn(0x7fd1dc0b16d0 legacy=0x7fd1dc15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:49.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.651+0000 7fd1e239b700 1 -- 172.21.15.71:0/157361620 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc0b5f20 con 0x7fd1dc0b4e70 2023-10-09T06:54:49.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.652+0000 7fd1e239b700 1 --2- 172.21.15.71:0/157361620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1dc0b4e70 0x7fd1dc0ccff0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd1d80098e0 tx=0x7fd1d80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd68284e0cbfa843 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:49.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.652+0000 7fd1e1399700 1 -- 172.21.15.71:0/157361620 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d800b640 con 0x7fd1dc0b4e70 2023-10-09T06:54:49.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.652+0000 7fd1e1399700 1 -- 172.21.15.71:0/157361620 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d800b7a0 con 0x7fd1dc0b4e70 2023-10-09T06:54:49.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.652+0000 7fd1e1399700 1 -- 172.21.15.71:0/157361620 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d800bb40 con 0x7fd1dc0b4e70 2023-10-09T06:54:49.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.653+0000 7fd1e339d700 1 -- 172.21.15.71:0/157361620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1dc0b4e70 msgr2=0x7fd1dc0ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:49.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.653+0000 7fd1e339d700 1 --2- 172.21.15.71:0/157361620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1dc0b4e70 0x7fd1dc0ccff0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd1d80098e0 tx=0x7fd1d80091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:49.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.653+0000 7fd1e339d700 1 -- 172.21.15.71:0/157361620 shutdown_connections 2023-10-09T06:54:49.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.653+0000 7fd1e339d700 1 --2- 172.21.15.71:0/157361620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1dc0b4e70 0x7fd1dc0ccff0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:49.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.653+0000 7fd1e339d700 1 -- 172.21.15.71:0/157361620 >> 172.21.15.71:0/157361620 conn(0x7fd1dc0d10c0 msgr2=0x7fd1dc0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:49.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.653+0000 7fd1e339d700 1 -- 172.21.15.71:0/157361620 shutdown_connections 2023-10-09T06:54:49.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.653+0000 7fd1e339d700 1 -- 172.21.15.71:0/157361620 wait complete. 2023-10-09T06:54:49.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.654+0000 7fd1e339d700 1 Processor -- start 2023-10-09T06:54:49.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.654+0000 7fd1e339d700 1 -- start start 2023-10-09T06:54:49.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.655+0000 7fd1e339d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1dc0b16d0 0x7fd1dc0cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:49.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.655+0000 7fd1e339d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1dc0b1b40 0x7fd1dc169d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:49.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.655+0000 7fd1e339d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1dc0b4e70 0x7fd1dc1576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:49.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.655+0000 7fd1e339d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc16ad40 con 0x7fd1dc0b4e70 2023-10-09T06:54:49.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.655+0000 7fd1e339d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc16a270 con 0x7fd1dc0b1b40 2023-10-09T06:54:49.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.655+0000 7fd1e339d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0c8770 con 0x7fd1dc0b16d0 2023-10-09T06:54:49.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.656+0000 7fd1e2b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1dc0b4e70 0x7fd1dc1576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:49.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.656+0000 7fd1e1b9a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1dc0b1b40 0x7fd1dc169d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:49.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.656+0000 7fd1e239b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1dc0b16d0 0x7fd1dc0cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:49.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.656+0000 7fd1e2b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1dc0b4e70 0x7fd1dc1576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56196/0 (socket says 172.21.15.71:56196) 2023-10-09T06:54:49.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.656+0000 7fd1e2b9c700 1 -- 172.21.15.71:0/2210482915 learned_addr learned my addr 172.21.15.71:0/2210482915 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:49.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.656+0000 7fd1e2b9c700 1 -- 172.21.15.71:0/2210482915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1dc0b16d0 msgr2=0x7fd1dc0cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:49.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.656+0000 7fd1e2b9c700 1 --2- 172.21.15.71:0/2210482915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1dc0b16d0 0x7fd1dc0cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:49.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.656+0000 7fd1e2b9c700 1 -- 172.21.15.71:0/2210482915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1dc0b1b40 msgr2=0x7fd1dc169d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:49.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.656+0000 7fd1e2b9c700 1 --2- 172.21.15.71:0/2210482915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1dc0b1b40 0x7fd1dc169d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:49.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.656+0000 7fd1e2b9c700 1 -- 172.21.15.71:0/2210482915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d8009420 con 0x7fd1dc0b4e70 2023-10-09T06:54:49.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.656+0000 7fd1e2b9c700 1 --2- 172.21.15.71:0/2210482915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1dc0b4e70 0x7fd1dc1576e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd1d400c8e0 tx=0x7fd1d4001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:49.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.656+0000 7fd1d27fc700 1 -- 172.21.15.71:0/2210482915 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4012630 con 0x7fd1dc0b4e70 2023-10-09T06:54:49.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.657+0000 7fd1d27fc700 1 -- 172.21.15.71:0/2210482915 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d4012790 con 0x7fd1dc0b4e70 2023-10-09T06:54:49.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.657+0000 7fd1e339d700 1 -- 172.21.15.71:0/2210482915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1dc16a4a0 con 0x7fd1dc0b4e70 2023-10-09T06:54:49.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.657+0000 7fd1d27fc700 1 -- 172.21.15.71:0/2210482915 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4012b50 con 0x7fd1dc0b4e70 2023-10-09T06:54:49.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.657+0000 7fd1e339d700 1 -- 172.21.15.71:0/2210482915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1dc16aa60 con 0x7fd1dc0b4e70 2023-10-09T06:54:49.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.658+0000 7fd1e339d700 1 -- 172.21.15.71:0/2210482915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1dc088990 con 0x7fd1dc0b4e70 2023-10-09T06:54:49.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.659+0000 7fd1d27fc700 1 -- 172.21.15.71:0/2210482915 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 84911+0+0 (secure 0 0 0) 0x7fd1d401a3a0 con 0x7fd1dc0b4e70 2023-10-09T06:54:49.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.659+0000 7fd1d27fc700 1 --2- 172.21.15.71:0/2210482915 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd1c00670e0 0x7fd1c0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:49.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.660+0000 7fd1d27fc700 1 -- 172.21.15.71:0/2210482915 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6803+0+0 (secure 0 0 0) 0x7fd1d4084e10 con 0x7fd1dc0b4e70 2023-10-09T06:54:49.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.660+0000 7fd1e239b700 1 -- 172.21.15.71:0/2210482915 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd1c00670e0 msgr2=0x7fd1c0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:54:49.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.660+0000 7fd1e239b700 1 --2- 172.21.15.71:0/2210482915 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd1c00670e0 0x7fd1c0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:54:49.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.667+0000 7fd1d27fc700 1 -- 172.21.15.71:0/2210482915 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1d40519b0 con 0x7fd1dc0b4e70 2023-10-09T06:54:49.734 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:49.733+0000 7f305a3fe180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T06:54:49.813 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:49.813+0000 7f41bb39e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T06:54:49.826 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:49.826+0000 7f305a3fe180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T06:54:49.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.861+0000 7fd1e239b700 1 -- 172.21.15.71:0/2210482915 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd1c00670e0 msgr2=0x7fd1c0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:54:49.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.861+0000 7fd1e239b700 1 --2- 172.21.15.71:0/2210482915 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd1c00670e0 0x7fd1c0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:54:49.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.877+0000 7fd1e339d700 1 -- 172.21.15.71:0/2210482915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd1dc0c85b0 con 0x7fd1dc0b4e70 2023-10-09T06:54:49.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.877+0000 7fd1d27fc700 1 -- 172.21.15.71:0/2210482915 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd1d4054fd0 con 0x7fd1dc0b4e70 2023-10-09T06:54:49.878 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-09T06:54:49.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.879+0000 7fd1e339d700 1 -- 172.21.15.71:0/2210482915 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd1c00670e0 msgr2=0x7fd1c0069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:54:49.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.879+0000 7fd1e339d700 1 --2- 172.21.15.71:0/2210482915 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd1c00670e0 0x7fd1c0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:49.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.879+0000 7fd1e339d700 1 -- 172.21.15.71:0/2210482915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1dc0b4e70 msgr2=0x7fd1dc1576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:49.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.879+0000 7fd1e339d700 1 --2- 172.21.15.71:0/2210482915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1dc0b4e70 0x7fd1dc1576e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd1d400c8e0 tx=0x7fd1d4001710 comp rx=0 tx=0).stop 2023-10-09T06:54:49.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.880+0000 7fd1e339d700 1 -- 172.21.15.71:0/2210482915 shutdown_connections 2023-10-09T06:54:49.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.880+0000 7fd1e339d700 1 --2- 172.21.15.71:0/2210482915 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd1c00670e0 0x7fd1c0069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:49.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.880+0000 7fd1e339d700 1 --2- 172.21.15.71:0/2210482915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1dc0b4e70 0x7fd1dc1576e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:49.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.880+0000 7fd1e339d700 1 --2- 172.21.15.71:0/2210482915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1dc0b16d0 0x7fd1dc0cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:49.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.880+0000 7fd1e339d700 1 --2- 172.21.15.71:0/2210482915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1dc0b1b40 0x7fd1dc169d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:49.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.880+0000 7fd1e339d700 1 -- 172.21.15.71:0/2210482915 >> 172.21.15.71:0/2210482915 conn(0x7fd1dc0d10c0 msgr2=0x7fd1dc0b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:49.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.880+0000 7fd1e339d700 1 -- 172.21.15.71:0/2210482915 shutdown_connections 2023-10-09T06:54:49.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:49.880+0000 7fd1e339d700 1 -- 172.21.15.71:0/2210482915 wait complete. 2023-10-09T06:54:49.899 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:54:49.915 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:49.914+0000 7f41bb39e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T06:54:49.995 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:49.995+0000 7f305a3fe180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T06:54:50.082 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:50.081+0000 7f41bb39e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T06:54:50.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.087+0000 7f071f39d700 1 Processor -- start 2023-10-09T06:54:50.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.087+0000 7f071f39d700 1 -- start start 2023-10-09T06:54:50.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.088+0000 7f071f39d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f07180ae7e0 0x7f07180c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:50.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.088+0000 7f071f39d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071806ebd0 con 0x7f071806f060 2023-10-09T06:54:50.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.088+0000 7f071f39d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071815aa70 con 0x7f07180cb1a0 2023-10-09T06:54:50.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.088+0000 7f071f39d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f071815b2e0 con 0x7f07180ae7e0 2023-10-09T06:54:50.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.089+0000 7f071db9a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f071806f060 0x7f07180ae0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51454/0 (socket says 172.21.15.71:51454) 2023-10-09T06:54:50.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.089+0000 7f071db9a700 1 -- 172.21.15.71:0/3873648993 learned_addr learned my addr 172.21.15.71:0/3873648993 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:50.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.089+0000 7f071eb9c700 1 --2- 172.21.15.71:0/3873648993 >> v2:172.21.15.179:3300/0 conn(0x7f07180ae7e0 0x7f07180c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:50.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.089+0000 7f071d399700 1 -- 172.21.15.71:0/3873648993 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477242461 0 0) 0x7f071806ebd0 con 0x7f071806f060 2023-10-09T06:54:50.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.089+0000 7f071d399700 1 -- 172.21.15.71:0/3873648993 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0704003570 con 0x7f071806f060 2023-10-09T06:54:50.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.089+0000 7f071d399700 1 -- 172.21.15.71:0/3873648993 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012526328 0 0) 0x7f071815aa70 con 0x7f07180cb1a0 2023-10-09T06:54:50.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.089+0000 7f071d399700 1 -- 172.21.15.71:0/3873648993 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f071806ebd0 con 0x7f07180cb1a0 2023-10-09T06:54:50.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.089+0000 7f071d399700 1 -- 172.21.15.71:0/3873648993 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1251497911 0 0) 0x7f0704003570 con 0x7f071806f060 2023-10-09T06:54:50.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.089+0000 7f071eb9c700 1 -- 172.21.15.71:0/3873648993 >> v1:172.21.15.179:6789/0 conn(0x7f07180cb1a0 legacy=0x7f071815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:50.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.089+0000 7f071eb9c700 1 -- 172.21.15.71:0/3873648993 >> v1:172.21.15.71:6789/0 conn(0x7f071806f060 legacy=0x7f07180ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:50.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.089+0000 7f071eb9c700 1 -- 172.21.15.71:0/3873648993 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071815ad20 con 0x7f07180ae7e0 2023-10-09T06:54:50.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.090+0000 7f071eb9c700 1 --2- 172.21.15.71:0/3873648993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07180ae7e0 0x7f07180c9db0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0710009e60 tx=0x7f0710009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f2b78c901608932 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:50.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.090+0000 7f071d399700 1 -- 172.21.15.71:0/3873648993 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071000e070 con 0x7f07180ae7e0 2023-10-09T06:54:50.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.090+0000 7f071d399700 1 -- 172.21.15.71:0/3873648993 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071000b830 con 0x7f07180ae7e0 2023-10-09T06:54:50.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.090+0000 7f071d399700 1 -- 172.21.15.71:0/3873648993 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708001470 con 0x7f07180ae7e0 2023-10-09T06:54:50.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.091+0000 7f071f39d700 1 -- 172.21.15.71:0/3873648993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07180ae7e0 msgr2=0x7f07180c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:50.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.091+0000 7f071f39d700 1 --2- 172.21.15.71:0/3873648993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07180ae7e0 0x7f07180c9db0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0710009e60 tx=0x7f0710009780 comp rx=0 tx=0).stop 2023-10-09T06:54:50.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.091+0000 7f071f39d700 1 -- 172.21.15.71:0/3873648993 shutdown_connections 2023-10-09T06:54:50.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.091+0000 7f071f39d700 1 --2- 172.21.15.71:0/3873648993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07180ae7e0 0x7f07180c9db0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:50.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.091+0000 7f071f39d700 1 -- 172.21.15.71:0/3873648993 >> 172.21.15.71:0/3873648993 conn(0x7f07180cc1e0 msgr2=0x7f07180cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:50.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.091+0000 7f071f39d700 1 -- 172.21.15.71:0/3873648993 shutdown_connections 2023-10-09T06:54:50.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.091+0000 7f071f39d700 1 -- 172.21.15.71:0/3873648993 wait complete. 2023-10-09T06:54:50.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.092+0000 7f071f39d700 1 Processor -- start 2023-10-09T06:54:50.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.093+0000 7f071f39d700 1 -- start start 2023-10-09T06:54:50.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.093+0000 7f071f39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f071806f060 0x7f0718169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:50.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.093+0000 7f071f39d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07180ae7e0 0x7f0718157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:50.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.093+0000 7f071f39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07180cb1a0 0x7f071816dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:50.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.093+0000 7f071f39d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0718159400 con 0x7f07180ae7e0 2023-10-09T06:54:50.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.093+0000 7f071f39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071816a790 con 0x7f07180cb1a0 2023-10-09T06:54:50.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.093+0000 7f071f39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071816aa70 con 0x7f071806f060 2023-10-09T06:54:50.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.094+0000 7f071db9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07180ae7e0 0x7f0718157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:50.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.094+0000 7f071e39b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f071806f060 0x7f0718169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:50.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.094+0000 7f071db9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07180ae7e0 0x7f0718157db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56200/0 (socket says 172.21.15.71:56200) 2023-10-09T06:54:50.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.094+0000 7f071db9a700 1 -- 172.21.15.71:0/819025437 learned_addr learned my addr 172.21.15.71:0/819025437 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:50.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.094+0000 7f071eb9c700 1 --2- 172.21.15.71:0/819025437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07180cb1a0 0x7f071816dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:50.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.094+0000 7f071db9a700 1 -- 172.21.15.71:0/819025437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f071806f060 msgr2=0x7f0718169ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:50.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.094+0000 7f071db9a700 1 --2- 172.21.15.71:0/819025437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f071806f060 0x7f0718169ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:50.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.094+0000 7f071db9a700 1 -- 172.21.15.71:0/819025437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07180cb1a0 msgr2=0x7f071816dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:50.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.094+0000 7f071db9a700 1 --2- 172.21.15.71:0/819025437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07180cb1a0 0x7f071816dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:50.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.094+0000 7f071db9a700 1 -- 172.21.15.71:0/819025437 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0710009a20 con 0x7f07180ae7e0 2023-10-09T06:54:50.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.094+0000 7f071db9a700 1 --2- 172.21.15.71:0/819025437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07180ae7e0 0x7f0718157db0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f070800cb90 tx=0x7f0708001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:50.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.095+0000 7f070e7fc700 1 -- 172.21.15.71:0/819025437 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708007150 con 0x7f07180ae7e0 2023-10-09T06:54:50.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.095+0000 7f070e7fc700 1 -- 172.21.15.71:0/819025437 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07080072f0 con 0x7f07180ae7e0 2023-10-09T06:54:50.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.095+0000 7f070e7fc700 1 -- 172.21.15.71:0/819025437 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07080076b0 con 0x7f07180ae7e0 2023-10-09T06:54:50.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.095+0000 7f071f39d700 1 -- 172.21.15.71:0/819025437 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f071816ad50 con 0x7f07180ae7e0 2023-10-09T06:54:50.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.095+0000 7f071f39d700 1 -- 172.21.15.71:0/819025437 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f071816d790 con 0x7f07180ae7e0 2023-10-09T06:54:50.099 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:50.097+0000 7f305a3fe180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T06:54:50.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.096+0000 7f071f39d700 1 -- 172.21.15.71:0/819025437 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f071816d9b0 con 0x7f07180ae7e0 2023-10-09T06:54:50.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.097+0000 7f070e7fc700 1 -- 172.21.15.71:0/819025437 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f0708004a40 con 0x7f07180ae7e0 2023-10-09T06:54:50.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.097+0000 7f070e7fc700 1 --2- 172.21.15.71:0/819025437 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f06fc0670e0 0x7f06fc069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:50.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.098+0000 7f070e7fc700 1 -- 172.21.15.71:0/819025437 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6371+0+0 (secure 0 0 0) 0x7f07080841c0 con 0x7f07180ae7e0 2023-10-09T06:54:50.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.098+0000 7f071e39b700 1 -- 172.21.15.71:0/819025437 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f06fc0670e0 msgr2=0x7f06fc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:54:50.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.098+0000 7f071e39b700 1 --2- 172.21.15.71:0/819025437 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f06fc0670e0 0x7f06fc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:54:50.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.101+0000 7f070e7fc700 1 -- 172.21.15.71:0/819025437 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f070804c5a0 con 0x7f07180ae7e0 2023-10-09T06:54:50.187 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:50.186+0000 7f41bb39e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T06:54:50.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.296+0000 7f071f39d700 1 -- 172.21.15.71:0/819025437 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f071815b000 con 0x7f07180ae7e0 2023-10-09T06:54:50.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.296+0000 7f070e7fc700 1 -- 172.21.15.71:0/819025437 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0708050fa0 con 0x7f07180ae7e0 2023-10-09T06:54:50.297 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-09T06:54:50.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.298+0000 7f071f39d700 1 -- 172.21.15.71:0/819025437 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f06fc0670e0 msgr2=0x7f06fc069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:54:50.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.298+0000 7f071f39d700 1 --2- 172.21.15.71:0/819025437 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f06fc0670e0 0x7f06fc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:50.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.298+0000 7f071f39d700 1 -- 172.21.15.71:0/819025437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07180ae7e0 msgr2=0x7f0718157db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:50.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.298+0000 7f071f39d700 1 --2- 172.21.15.71:0/819025437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07180ae7e0 0x7f0718157db0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f070800cb90 tx=0x7f0708001ab0 comp rx=0 tx=0).stop 2023-10-09T06:54:50.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.298+0000 7f071f39d700 1 -- 172.21.15.71:0/819025437 shutdown_connections 2023-10-09T06:54:50.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.298+0000 7f071f39d700 1 --2- 172.21.15.71:0/819025437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07180cb1a0 0x7f071816dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:50.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.298+0000 7f071f39d700 1 --2- 172.21.15.71:0/819025437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f071806f060 0x7f0718169ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:50.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.298+0000 7f071f39d700 1 --2- 172.21.15.71:0/819025437 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f06fc0670e0 0x7f06fc069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:50.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.298+0000 7f071f39d700 1 --2- 172.21.15.71:0/819025437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07180ae7e0 0x7f0718157db0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:50.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.298+0000 7f071f39d700 1 -- 172.21.15.71:0/819025437 >> 172.21.15.71:0/819025437 conn(0x7f07180cc1e0 msgr2=0x7f0718155800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:50.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.299+0000 7f071f39d700 1 -- 172.21.15.71:0/819025437 shutdown_connections 2023-10-09T06:54:50.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.299+0000 7f071f39d700 1 -- 172.21.15.71:0/819025437 wait complete. 2023-10-09T06:54:50.317 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:54:50.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.542+0000 7fb482f9d700 1 Processor -- start 2023-10-09T06:54:50.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.542+0000 7fb482f9d700 1 -- start start 2023-10-09T06:54:50.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.544+0000 7fb482f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb47c1597f0 0x7fb47c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:50.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.544+0000 7fb482f9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb47c0b11d0 con 0x7fb47c15d230 2023-10-09T06:54:50.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.544+0000 7fb482f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb47c0b14b0 con 0x7fb47c159420 2023-10-09T06:54:50.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.544+0000 7fb482f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb47c0b1790 con 0x7fb47c1597f0 2023-10-09T06:54:50.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.544+0000 7fb48279c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb47c15d230 0x7fb47c15d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51466/0 (socket says 172.21.15.71:51466) 2023-10-09T06:54:50.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.544+0000 7fb48279c700 1 -- 172.21.15.71:0/3683736428 learned_addr learned my addr 172.21.15.71:0/3683736428 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:50.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.544+0000 7fb48179a700 1 --2- 172.21.15.71:0/3683736428 >> v2:172.21.15.179:3300/0 conn(0x7fb47c1597f0 0x7fb47c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:50.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.544+0000 7fb480f99700 1 -- 172.21.15.71:0/3683736428 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576438051 0 0) 0x7fb47c0b11d0 con 0x7fb47c15d230 2023-10-09T06:54:50.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.545+0000 7fb480f99700 1 -- 172.21.15.71:0/3683736428 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb468003570 con 0x7fb47c15d230 2023-10-09T06:54:50.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.545+0000 7fb480f99700 1 -- 172.21.15.71:0/3683736428 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2072854804 0 0) 0x7fb47c0b14b0 con 0x7fb47c159420 2023-10-09T06:54:50.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.545+0000 7fb480f99700 1 -- 172.21.15.71:0/3683736428 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb47c0b11d0 con 0x7fb47c159420 2023-10-09T06:54:50.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.545+0000 7fb48179a700 1 -- 172.21.15.71:0/3683736428 >> v1:172.21.15.179:6789/0 conn(0x7fb47c159420 legacy=0x7fb47c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:50.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.545+0000 7fb48179a700 1 -- 172.21.15.71:0/3683736428 >> v1:172.21.15.71:6789/0 conn(0x7fb47c15d230 legacy=0x7fb47c15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:50.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.545+0000 7fb48179a700 1 -- 172.21.15.71:0/3683736428 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47c0b1a70 con 0x7fb47c1597f0 2023-10-09T06:54:50.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.545+0000 7fb48179a700 1 --2- 172.21.15.71:0/3683736428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb47c1597f0 0x7fb47c0b2270 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb46c0098e0 tx=0x7fb46c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbbabbfbf22fac4f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:50.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.545+0000 7fb480f99700 1 -- 172.21.15.71:0/3683736428 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c011630 con 0x7fb47c1597f0 2023-10-09T06:54:50.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.545+0000 7fb480f99700 1 -- 172.21.15.71:0/3683736428 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c011790 con 0x7fb47c1597f0 2023-10-09T06:54:50.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.545+0000 7fb480f99700 1 -- 172.21.15.71:0/3683736428 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c011b30 con 0x7fb47c1597f0 2023-10-09T06:54:50.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.546+0000 7fb482f9d700 1 -- 172.21.15.71:0/3683736428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb47c1597f0 msgr2=0x7fb47c0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:50.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.546+0000 7fb482f9d700 1 --2- 172.21.15.71:0/3683736428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb47c1597f0 0x7fb47c0b2270 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb46c0098e0 tx=0x7fb46c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:50.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.546+0000 7fb482f9d700 1 -- 172.21.15.71:0/3683736428 shutdown_connections 2023-10-09T06:54:50.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.546+0000 7fb482f9d700 1 --2- 172.21.15.71:0/3683736428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb47c1597f0 0x7fb47c0b2270 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:50.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.546+0000 7fb482f9d700 1 -- 172.21.15.71:0/3683736428 >> 172.21.15.71:0/3683736428 conn(0x7fb47c0d0660 msgr2=0x7fb47c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:50.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.546+0000 7fb482f9d700 1 -- 172.21.15.71:0/3683736428 shutdown_connections 2023-10-09T06:54:50.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.546+0000 7fb482f9d700 1 -- 172.21.15.71:0/3683736428 wait complete. 2023-10-09T06:54:50.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.547+0000 7fb482f9d700 1 Processor -- start 2023-10-09T06:54:50.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.548+0000 7fb482f9d700 1 -- start start 2023-10-09T06:54:50.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.548+0000 7fb482f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb47c159420 0x7fb47c15c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:50.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.548+0000 7fb482f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb47c1597f0 0x7fb47c068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:50.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.548+0000 7fb482f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb47c15d230 0x7fb47c0690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:50.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.548+0000 7fb482f9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c0c6fe0 con 0x7fb47c15d230 2023-10-09T06:54:50.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.548+0000 7fb482f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c0c6360 con 0x7fb47c159420 2023-10-09T06:54:50.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.548+0000 7fb482f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c0c6640 con 0x7fb47c1597f0 2023-10-09T06:54:50.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.549+0000 7fb48279c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb47c15d230 0x7fb47c0690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:50.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.549+0000 7fb48279c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb47c15d230 0x7fb47c0690f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56214/0 (socket says 172.21.15.71:56214) 2023-10-09T06:54:50.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.549+0000 7fb48279c700 1 -- 172.21.15.71:0/1077672794 learned_addr learned my addr 172.21.15.71:0/1077672794 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:50.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.549+0000 7fb481f9b700 1 --2- 172.21.15.71:0/1077672794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb47c159420 0x7fb47c15c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:50.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.549+0000 7fb48179a700 1 --2- 172.21.15.71:0/1077672794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb47c1597f0 0x7fb47c068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:50.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.549+0000 7fb48279c700 1 -- 172.21.15.71:0/1077672794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb47c1597f0 msgr2=0x7fb47c068bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:50.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.549+0000 7fb48279c700 1 --2- 172.21.15.71:0/1077672794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb47c1597f0 0x7fb47c068bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:50.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.549+0000 7fb48279c700 1 -- 172.21.15.71:0/1077672794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb47c159420 msgr2=0x7fb47c15c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:50.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.549+0000 7fb48279c700 1 --2- 172.21.15.71:0/1077672794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb47c159420 0x7fb47c15c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:50.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.549+0000 7fb48279c700 1 -- 172.21.15.71:0/1077672794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c009420 con 0x7fb47c15d230 2023-10-09T06:54:50.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.549+0000 7fb481f9b700 1 --2- 172.21.15.71:0/1077672794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb47c159420 0x7fb47c15c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:54:50.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.549+0000 7fb48279c700 1 --2- 172.21.15.71:0/1077672794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb47c15d230 0x7fb47c0690f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb474001460 tx=0x7fb474001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:50.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.550+0000 7fb471ffb700 1 -- 172.21.15.71:0/1077672794 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47400a7e0 con 0x7fb47c15d230 2023-10-09T06:54:50.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.550+0000 7fb471ffb700 1 -- 172.21.15.71:0/1077672794 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47400a980 con 0x7fb47c15d230 2023-10-09T06:54:50.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.550+0000 7fb471ffb700 1 -- 172.21.15.71:0/1077672794 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47400ad40 con 0x7fb47c15d230 2023-10-09T06:54:50.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.550+0000 7fb482f9d700 1 -- 172.21.15.71:0/1077672794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb47c0c6920 con 0x7fb47c15d230 2023-10-09T06:54:50.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.550+0000 7fb482f9d700 1 -- 172.21.15.71:0/1077672794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb47c15cc90 con 0x7fb47c15d230 2023-10-09T06:54:50.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.551+0000 7fb482f9d700 1 -- 172.21.15.71:0/1077672794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb47c0c7120 con 0x7fb47c15d230 2023-10-09T06:54:50.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.552+0000 7fb471ffb700 1 -- 172.21.15.71:0/1077672794 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 84911+0+0 (secure 0 0 0) 0x7fb474007300 con 0x7fb47c15d230 2023-10-09T06:54:50.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.552+0000 7fb471ffb700 1 --2- 172.21.15.71:0/1077672794 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb4600670e0 0x7fb460069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:50.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.553+0000 7fb471ffb700 1 -- 172.21.15.71:0/1077672794 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6371+0+0 (secure 0 0 0) 0x7fb474084de0 con 0x7fb47c15d230 2023-10-09T06:54:50.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.553+0000 7fb481f9b700 1 -- 172.21.15.71:0/1077672794 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb4600670e0 msgr2=0x7fb460069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:54:50.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.553+0000 7fb481f9b700 1 --2- 172.21.15.71:0/1077672794 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb4600670e0 0x7fb460069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:54:50.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.556+0000 7fb471ffb700 1 -- 172.21.15.71:0/1077672794 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb474051b10 con 0x7fb47c15d230 2023-10-09T06:54:50.581 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:50.581+0000 7f305a3fe180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T06:54:50.674 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:50.674+0000 7f305a3fe180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T06:54:50.689 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:50.686+0000 7f41bb39e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T06:54:50.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.754+0000 7fb481f9b700 1 -- 172.21.15.71:0/1077672794 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb4600670e0 msgr2=0x7fb460069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:54:50.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.754+0000 7fb481f9b700 1 --2- 172.21.15.71:0/1077672794 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb4600670e0 0x7fb460069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:54:50.763 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:50.763+0000 7f305a3fe180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T06:54:50.782 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:50.781+0000 7f41bb39e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T06:54:50.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.795+0000 7fb482f9d700 1 -- 172.21.15.71:0/1077672794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb47c04c3c0 con 0x7fb47c15d230 2023-10-09T06:54:50.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.795+0000 7fb471ffb700 1 -- 172.21.15.71:0/1077672794 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fb474055130 con 0x7fb47c15d230 2023-10-09T06:54:50.796 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:54:50.796 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2315236875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":2315236875},{"type":"v1","addr":"172.21.15.71:6835","nonce":2315236875}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4628,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2455384244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2455384244},{"type":"v1","addr":"172.21.15.179:6836","nonce":2455384244}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3668669622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3668669622},{"type":"v1","addr":"172.21.15.179:6837","nonce":3668669622}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:43:32.039618+0000","modified":"2023-10-09T06:43:35.597837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4905":{"gid":4905,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6834/4010179291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":4010179291},{"type":"v1","addr":"172.21.15.71:6834","nonce":4010179291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T06:54:50.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.797+0000 7fb482f9d700 1 -- 172.21.15.71:0/1077672794 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb4600670e0 msgr2=0x7fb460069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:54:50.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.797+0000 7fb482f9d700 1 --2- 172.21.15.71:0/1077672794 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb4600670e0 0x7fb460069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:50.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.797+0000 7fb482f9d700 1 -- 172.21.15.71:0/1077672794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb47c15d230 msgr2=0x7fb47c0690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:50.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.797+0000 7fb482f9d700 1 --2- 172.21.15.71:0/1077672794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb47c15d230 0x7fb47c0690f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb474001460 tx=0x7fb474001a00 comp rx=0 tx=0).stop 2023-10-09T06:54:50.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.798+0000 7fb482f9d700 1 -- 172.21.15.71:0/1077672794 shutdown_connections 2023-10-09T06:54:50.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.798+0000 7fb482f9d700 1 --2- 172.21.15.71:0/1077672794 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb4600670e0 0x7fb460069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:50.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.798+0000 7fb482f9d700 1 --2- 172.21.15.71:0/1077672794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb47c15d230 0x7fb47c0690f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:50.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.798+0000 7fb482f9d700 1 --2- 172.21.15.71:0/1077672794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb47c159420 0x7fb47c15c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:50.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.798+0000 7fb482f9d700 1 --2- 172.21.15.71:0/1077672794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb47c1597f0 0x7fb47c068bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:50.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.798+0000 7fb482f9d700 1 -- 172.21.15.71:0/1077672794 >> 172.21.15.71:0/1077672794 conn(0x7fb47c0d0660 msgr2=0x7fb47c155240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:50.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.798+0000 7fb482f9d700 1 -- 172.21.15.71:0/1077672794 shutdown_connections 2023-10-09T06:54:50.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:50.798+0000 7fb482f9d700 1 -- 172.21.15.71:0/1077672794 wait complete. 2023-10-09T06:54:50.800 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 15 2023-10-09T06:54:50.816 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:54:50.879 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:50.879+0000 7f41bb39e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T06:54:51.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.000+0000 7f3493fff700 1 Processor -- start 2023-10-09T06:54:51.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.000+0000 7f3493fff700 1 -- start start 2023-10-09T06:54:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.001+0000 7f3493fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3494159420 0x7f34940b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.001+0000 7f3493fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34940b2980 con 0x7f349415d230 2023-10-09T06:54:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.001+0000 7f3493fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34940b11d0 con 0x7f34941597f0 2023-10-09T06:54:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.001+0000 7f3493fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34940b14b0 con 0x7f3494159420 2023-10-09T06:54:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.002+0000 7f34937fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f349415d230 0x7f34940b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51480/0 (socket says 172.21.15.71:51480) 2023-10-09T06:54:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.002+0000 7f34937fe700 1 -- 172.21.15.71:0/1824452671 learned_addr learned my addr 172.21.15.71:0/1824452671 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.002+0000 7f3492ffd700 1 --2- 172.21.15.71:0/1824452671 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3494159420 0x7f34940b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.002+0000 7f3491ffb700 1 -- 172.21.15.71:0/1824452671 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3154831701 0 0) 0x7f34940b2980 con 0x7f349415d230 2023-10-09T06:54:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.002+0000 7f3491ffb700 1 -- 172.21.15.71:0/1824452671 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f347c003570 con 0x7f349415d230 2023-10-09T06:54:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.002+0000 7f3491ffb700 1 -- 172.21.15.71:0/1824452671 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435322696 0 0) 0x7f34940b11d0 con 0x7f34941597f0 2023-10-09T06:54:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.002+0000 7f3492ffd700 1 -- 172.21.15.71:0/1824452671 >> v1:172.21.15.179:6789/0 conn(0x7f34941597f0 legacy=0x7f34940b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.002+0000 7f3492ffd700 1 -- 172.21.15.71:0/1824452671 >> v1:172.21.15.71:6789/0 conn(0x7f349415d230 legacy=0x7f34940b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.002+0000 7f3492ffd700 1 -- 172.21.15.71:0/1824452671 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34940b1790 con 0x7f3494159420 2023-10-09T06:54:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.003+0000 7f3492ffd700 1 --2- 172.21.15.71:0/1824452671 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3494159420 0x7f34940b5f40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3484009910 tx=0x7f34840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=993c20b6102454d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.003+0000 7f3491ffb700 1 -- 172.21.15.71:0/1824452671 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348400b680 con 0x7f3494159420 2023-10-09T06:54:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.003+0000 7f3491ffb700 1 -- 172.21.15.71:0/1824452671 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348400b7e0 con 0x7f3494159420 2023-10-09T06:54:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.003+0000 7f3491ffb700 1 -- 172.21.15.71:0/1824452671 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348400bba0 con 0x7f3494159420 2023-10-09T06:54:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.003+0000 7f3493fff700 1 -- 172.21.15.71:0/1824452671 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3494159420 msgr2=0x7f34940b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:51.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.003+0000 7f3493fff700 1 --2- 172.21.15.71:0/1824452671 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3494159420 0x7f34940b5f40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3484009910 tx=0x7f34840091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.003+0000 7f3493fff700 1 -- 172.21.15.71:0/1824452671 shutdown_connections 2023-10-09T06:54:51.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.003+0000 7f3493fff700 1 --2- 172.21.15.71:0/1824452671 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3494159420 0x7f34940b5f40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.003+0000 7f3493fff700 1 -- 172.21.15.71:0/1824452671 >> 172.21.15.71:0/1824452671 conn(0x7f34940d0660 msgr2=0x7f34940d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:51.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.004+0000 7f3493fff700 1 -- 172.21.15.71:0/1824452671 shutdown_connections 2023-10-09T06:54:51.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.004+0000 7f3493fff700 1 -- 172.21.15.71:0/1824452671 wait complete. 2023-10-09T06:54:51.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.005+0000 7f3493fff700 1 Processor -- start 2023-10-09T06:54:51.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.005+0000 7f3493fff700 1 -- start start 2023-10-09T06:54:51.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.006+0000 7f3493fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3494159420 0x7f349416a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:51.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.006+0000 7f3493fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34941597f0 0x7f34940c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:51.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.006+0000 7f3493fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f349415d230 0x7f34940c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:51.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.006+0000 7f3493fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34941545c0 con 0x7f3494159420 2023-10-09T06:54:51.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.006+0000 7f3493fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349415ff40 con 0x7f349415d230 2023-10-09T06:54:51.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.006+0000 7f3493fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349416ad20 con 0x7f34941597f0 2023-10-09T06:54:51.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.006+0000 7f3492ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3494159420 0x7f349416a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:51.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.006+0000 7f3492ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3494159420 0x7f349416a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56220/0 (socket says 172.21.15.71:56220) 2023-10-09T06:54:51.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.006+0000 7f3492ffd700 1 -- 172.21.15.71:0/4271098910 learned_addr learned my addr 172.21.15.71:0/4271098910 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:51.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.006+0000 7f34927fc700 1 --2- 172.21.15.71:0/4271098910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34941597f0 0x7f34940c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:51.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.006+0000 7f34937fe700 1 --2- 172.21.15.71:0/4271098910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f349415d230 0x7f34940c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:51.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.007+0000 7f3492ffd700 1 -- 172.21.15.71:0/4271098910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34941597f0 msgr2=0x7f34940c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:51.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.007+0000 7f3492ffd700 1 --2- 172.21.15.71:0/4271098910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34941597f0 0x7f34940c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.007+0000 7f3492ffd700 1 -- 172.21.15.71:0/4271098910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f349415d230 msgr2=0x7f34940c5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:51.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.007+0000 7f3492ffd700 1 --2- 172.21.15.71:0/4271098910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f349415d230 0x7f34940c5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.007+0000 7f3492ffd700 1 -- 172.21.15.71:0/4271098910 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3484009420 con 0x7f3494159420 2023-10-09T06:54:51.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.007+0000 7f3492ffd700 1 --2- 172.21.15.71:0/4271098910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3494159420 0x7f349416a7e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3494089340 tx=0x7f3484017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:51.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.007+0000 7f347affd700 1 -- 172.21.15.71:0/4271098910 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348400bb60 con 0x7f3494159420 2023-10-09T06:54:51.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.007+0000 7f347affd700 1 -- 172.21.15.71:0/4271098910 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3484000c90 con 0x7f3494159420 2023-10-09T06:54:51.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.007+0000 7f3493fff700 1 -- 172.21.15.71:0/4271098910 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349416d160 con 0x7f3494159420 2023-10-09T06:54:51.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.007+0000 7f347affd700 1 -- 172.21.15.71:0/4271098910 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3484027680 con 0x7f3494159420 2023-10-09T06:54:51.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.008+0000 7f3493fff700 1 -- 172.21.15.71:0/4271098910 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349415f610 con 0x7f3494159420 2023-10-09T06:54:51.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.009+0000 7f3493fff700 1 -- 172.21.15.71:0/4271098910 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349404c3c0 con 0x7f3494159420 2023-10-09T06:54:51.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.010+0000 7f347affd700 1 -- 172.21.15.71:0/4271098910 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f348401a430 con 0x7f3494159420 2023-10-09T06:54:51.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.010+0000 7f347affd700 1 --2- 172.21.15.71:0/4271098910 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f34800670e0 0x7f3480069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:51.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.011+0000 7f347affd700 1 -- 172.21.15.71:0/4271098910 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6371+0+0 (secure 0 0 0) 0x7f3484086a20 con 0x7f3494159420 2023-10-09T06:54:51.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.011+0000 7f34927fc700 1 -- 172.21.15.71:0/4271098910 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f34800670e0 msgr2=0x7f3480069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:54:51.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.011+0000 7f34927fc700 1 --2- 172.21.15.71:0/4271098910 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f34800670e0 0x7f3480069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:54:51.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.019+0000 7f347affd700 1 -- 172.21.15.71:0/4271098910 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3484053770 con 0x7f3494159420 2023-10-09T06:54:51.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.212+0000 7f34927fc700 1 -- 172.21.15.71:0/4271098910 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f34800670e0 msgr2=0x7f3480069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:54:51.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.212+0000 7f34927fc700 1 --2- 172.21.15.71:0/4271098910 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f34800670e0 0x7f3480069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:54:51.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.215+0000 7f3493fff700 1 -- 172.21.15.71:0/4271098910 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34940b1a70 con 0x7f3494159420 2023-10-09T06:54:51.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.216+0000 7f347affd700 1 -- 172.21.15.71:0/4271098910 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16367 (secure 0 0 0) 0x7f3484056d90 con 0x7f3494159420 2023-10-09T06:54:51.217 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:54:51.217 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":50,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:54:49.716626+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:43:29.634330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T06:43:31.023113+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":217,"snap_epoch":50,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6833/85452":"2023-10-10T06:43:52.669588+0000","172.21.15.179:0/1464937439":"2023-10-10T06:43:52.669588+0000","172.21.15.179:0/4042901359":"2023-10-10T06:43:52.669588+0000","172.21.15.179:0/3168407320":"2023-10-10T06:43:52.669588+0000","172.21.15.179:6832/85452":"2023-10-10T06:43:52.669588+0000","172.21.15.179:0/1455428643":"2023-10-10T06:43:52.669588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]}],"new_removed_snaps":[{"pool":5,"snaps":[{"begin":107,"length":1},{"begin":217,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:54:51.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.219+0000 7f3493fff700 1 -- 172.21.15.71:0/4271098910 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f34800670e0 msgr2=0x7f3480069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:54:51.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.219+0000 7f3493fff700 1 --2- 172.21.15.71:0/4271098910 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f34800670e0 0x7f3480069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.219+0000 7f3493fff700 1 -- 172.21.15.71:0/4271098910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3494159420 msgr2=0x7f349416a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:51.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.219+0000 7f3493fff700 1 --2- 172.21.15.71:0/4271098910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3494159420 0x7f349416a7e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3494089340 tx=0x7f3484017000 comp rx=0 tx=0).stop 2023-10-09T06:54:51.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.219+0000 7f3493fff700 1 -- 172.21.15.71:0/4271098910 shutdown_connections 2023-10-09T06:54:51.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.219+0000 7f3493fff700 1 --2- 172.21.15.71:0/4271098910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f349415d230 0x7f34940c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.219+0000 7f3493fff700 1 --2- 172.21.15.71:0/4271098910 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f34800670e0 0x7f3480069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.219+0000 7f3493fff700 1 --2- 172.21.15.71:0/4271098910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3494159420 0x7f349416a7e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.219+0000 7f3493fff700 1 --2- 172.21.15.71:0/4271098910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34941597f0 0x7f34940c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.219+0000 7f3493fff700 1 -- 172.21.15.71:0/4271098910 >> 172.21.15.71:0/4271098910 conn(0x7f34940d0660 msgr2=0x7f34940b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:51.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.219+0000 7f3493fff700 1 -- 172.21.15.71:0/4271098910 shutdown_connections 2023-10-09T06:54:51.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.219+0000 7f3493fff700 1 -- 172.21.15.71:0/4271098910 wait complete. 2023-10-09T06:54:51.238 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T06:54:51.238 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:54:51.385 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:51.385+0000 7f305a3fe180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T06:54:51.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.445+0000 7fb2da99d700 1 Processor -- start 2023-10-09T06:54:51.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.445+0000 7fb2da99d700 1 -- start start 2023-10-09T06:54:51.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.447+0000 7fb2da99d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb2d415de70 0x7fb2d406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:51.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.447+0000 7fb2da99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2d40696c0 0x7fb2d406ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:51.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.447+0000 7fb2da99d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d406e8c0 con 0x7fb2d415daa0 2023-10-09T06:54:51.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.447+0000 7fb2da99d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d40ca740 con 0x7fb2d415de70 2023-10-09T06:54:51.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.447+0000 7fb2da99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d406e5e0 con 0x7fb2d40696c0 2023-10-09T06:54:51.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.448+0000 7fb2d999b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb2d415daa0 0x7fb2d40c7110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:43004/0 (socket says 172.21.15.71:43004) 2023-10-09T06:54:51.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.448+0000 7fb2d999b700 1 -- 172.21.15.71:0/2662138353 learned_addr learned my addr 172.21.15.71:0/2662138353 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:51.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.448+0000 7fb2da19c700 1 --2- 172.21.15.71:0/2662138353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2d40696c0 0x7fb2d406ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:51.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.448+0000 7fb2d919a700 1 --2- 172.21.15.71:0/2662138353 >> v2:172.21.15.71:3300/0 conn(0x7fb2d415de70 0x7fb2d406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:51.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.448+0000 7fb2d8999700 1 -- 172.21.15.71:0/2662138353 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186681346 0 0) 0x7fb2d406e8c0 con 0x7fb2d415daa0 2023-10-09T06:54:51.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.448+0000 7fb2d8999700 1 -- 172.21.15.71:0/2662138353 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2bc003570 con 0x7fb2d415daa0 2023-10-09T06:54:51.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.448+0000 7fb2da19c700 1 -- 172.21.15.71:0/2662138353 >> v2:172.21.15.71:3300/0 conn(0x7fb2d415de70 msgr2=0x7fb2d406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:51.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.448+0000 7fb2d8999700 1 -- 172.21.15.71:0/2662138353 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2870821487 0 0) 0x7fb2bc003570 con 0x7fb2d415daa0 2023-10-09T06:54:51.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.449+0000 7fb2da19c700 1 --2- 172.21.15.71:0/2662138353 >> v2:172.21.15.71:3300/0 conn(0x7fb2d415de70 0x7fb2d406e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.449+0000 7fb2da19c700 1 -- 172.21.15.71:0/2662138353 >> v1:172.21.15.179:6789/0 conn(0x7fb2d415daa0 legacy=0x7fb2d40c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:51.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.449+0000 7fb2da19c700 1 -- 172.21.15.71:0/2662138353 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d40ca0f0 con 0x7fb2d40696c0 2023-10-09T06:54:51.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.449+0000 7fb2d919a700 1 --2- 172.21.15.71:0/2662138353 >> v2:172.21.15.71:3300/0 conn(0x7fb2d415de70 0x7fb2d406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:54:51.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.449+0000 7fb2da19c700 1 --2- 172.21.15.71:0/2662138353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2d40696c0 0x7fb2d406ecd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb2c40098e0 tx=0x7fb2c40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a41bd209acaa641 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:51.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.449+0000 7fb2d8999700 1 -- 172.21.15.71:0/2662138353 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc0017f0 con 0x7fb2d40696c0 2023-10-09T06:54:51.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.449+0000 7fb2d8999700 1 -- 172.21.15.71:0/2662138353 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c4011420 con 0x7fb2d40696c0 2023-10-09T06:54:51.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.449+0000 7fb2d8999700 1 -- 172.21.15.71:0/2662138353 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c40117c0 con 0x7fb2d40696c0 2023-10-09T06:54:51.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.450+0000 7fb2da99d700 1 -- 172.21.15.71:0/2662138353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2d40696c0 msgr2=0x7fb2d406ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:51.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.450+0000 7fb2da99d700 1 --2- 172.21.15.71:0/2662138353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2d40696c0 0x7fb2d406ecd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb2c40098e0 tx=0x7fb2c40091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.450+0000 7fb2da99d700 1 -- 172.21.15.71:0/2662138353 shutdown_connections 2023-10-09T06:54:51.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.450+0000 7fb2da99d700 1 --2- 172.21.15.71:0/2662138353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2d40696c0 0x7fb2d406ecd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.450+0000 7fb2da99d700 1 --2- 172.21.15.71:0/2662138353 >> v2:172.21.15.71:3300/0 conn(0x7fb2d415de70 0x7fb2d406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.450+0000 7fb2da99d700 1 -- 172.21.15.71:0/2662138353 >> 172.21.15.71:0/2662138353 conn(0x7fb2d40cc1f0 msgr2=0x7fb2d40cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:51.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.451+0000 7fb2da99d700 1 -- 172.21.15.71:0/2662138353 shutdown_connections 2023-10-09T06:54:51.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.451+0000 7fb2da99d700 1 -- 172.21.15.71:0/2662138353 wait complete. 2023-10-09T06:54:51.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.453+0000 7fb2da99d700 1 Processor -- start 2023-10-09T06:54:51.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.454+0000 7fb2da99d700 1 -- start start 2023-10-09T06:54:51.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.455+0000 7fb2da99d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2d40696c0 0x7fb2d4087790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.455+0000 7fb2da99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2d415daa0 0x7fb2d414c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.455+0000 7fb2da99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2d415de70 0x7fb2d418a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.455+0000 7fb2da99d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d40b1ac0 con 0x7fb2d40696c0 2023-10-09T06:54:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.455+0000 7fb2da99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d4187080 con 0x7fb2d415de70 2023-10-09T06:54:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.455+0000 7fb2da99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d414d750 con 0x7fb2d415daa0 2023-10-09T06:54:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.456+0000 7fb2d999b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2d40696c0 0x7fb2d4087790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.456+0000 7fb2d999b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2d40696c0 0x7fb2d4087790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56234/0 (socket says 172.21.15.71:56234) 2023-10-09T06:54:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.456+0000 7fb2d999b700 1 -- 172.21.15.71:0/789942398 learned_addr learned my addr 172.21.15.71:0/789942398 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.456+0000 7fb2da19c700 1 --2- 172.21.15.71:0/789942398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2d415de70 0x7fb2d418a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.456+0000 7fb2d999b700 1 -- 172.21.15.71:0/789942398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2d415daa0 msgr2=0x7fb2d414c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.456+0000 7fb2d999b700 1 --2- 172.21.15.71:0/789942398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2d415daa0 0x7fb2d414c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.456+0000 7fb2d999b700 1 -- 172.21.15.71:0/789942398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2d415de70 msgr2=0x7fb2d418a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:51.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.456+0000 7fb2d999b700 1 --2- 172.21.15.71:0/789942398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2d415de70 0x7fb2d418a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.456+0000 7fb2d999b700 1 -- 172.21.15.71:0/789942398 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c8009420 con 0x7fb2d40696c0 2023-10-09T06:54:51.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.457+0000 7fb2d999b700 1 --2- 172.21.15.71:0/789942398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2d40696c0 0x7fb2d4087790 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00cb90 tx=0x7fb2cc007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:51.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.457+0000 7fb2d1ffb700 1 -- 172.21.15.71:0/789942398 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc004dc0 con 0x7fb2d40696c0 2023-10-09T06:54:51.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.457+0000 7fb2d1ffb700 1 -- 172.21.15.71:0/789942398 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2cc00a6c0 con 0x7fb2d40696c0 2023-10-09T06:54:51.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.458+0000 7fb2d1ffb700 1 -- 172.21.15.71:0/789942398 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc00aa80 con 0x7fb2d40696c0 2023-10-09T06:54:51.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.458+0000 7fb2da99d700 1 -- 172.21.15.71:0/789942398 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c4009420 con 0x7fb2d40696c0 2023-10-09T06:54:51.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.458+0000 7fb2da99d700 1 -- 172.21.15.71:0/789942398 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d414d100 con 0x7fb2d40696c0 2023-10-09T06:54:51.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.459+0000 7fb2da99d700 1 -- 172.21.15.71:0/789942398 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d404c3c0 con 0x7fb2d40696c0 2023-10-09T06:54:51.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.463+0000 7fb2d1ffb700 1 -- 172.21.15.71:0/789942398 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 84911+0+0 (secure 0 0 0) 0x7fb2cc007150 con 0x7fb2d40696c0 2023-10-09T06:54:51.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.464+0000 7fb2d1ffb700 1 --2- 172.21.15.71:0/789942398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb2c00670e0 0x7fb2c0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:51.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.464+0000 7fb2d1ffb700 1 -- 172.21.15.71:0/789942398 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6371+0+0 (secure 0 0 0) 0x7fb2cc084640 con 0x7fb2d40696c0 2023-10-09T06:54:51.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.464+0000 7fb2d919a700 1 -- 172.21.15.71:0/789942398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb2c00670e0 msgr2=0x7fb2c0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:54:51.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.464+0000 7fb2d919a700 1 --2- 172.21.15.71:0/789942398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb2c00670e0 0x7fb2c0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:54:51.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.467+0000 7fb2d1ffb700 1 -- 172.21.15.71:0/789942398 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2cc051370 con 0x7fb2d40696c0 2023-10-09T06:54:51.526 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:51.525+0000 7f41bb39e180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T06:54:51.559 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:51.558+0000 7f305a3fe180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:54:51.656 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:51.656+0000 7f305a3fe180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T06:54:51.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.665+0000 7fb2d919a700 1 -- 172.21.15.71:0/789942398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb2c00670e0 msgr2=0x7fb2c0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:54:51.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.665+0000 7fb2d919a700 1 --2- 172.21.15.71:0/789942398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb2c00670e0 0x7fb2c0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:54:51.702 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:51.701+0000 7f41bb39e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:54:51.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.709+0000 7fb2da99d700 1 -- 172.21.15.71:0/789942398 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2d406d950 con 0x7fb2d40696c0 2023-10-09T06:54:51.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.710+0000 7fb2d1ffb700 1 -- 172.21.15.71:0/789942398 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fb2cc054990 con 0x7fb2d40696c0 2023-10-09T06:54:51.711 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:54:51.711 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2315236875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":2315236875},{"type":"v1","addr":"172.21.15.71:6835","nonce":2315236875}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4628,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2455384244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2455384244},{"type":"v1","addr":"172.21.15.179:6836","nonce":2455384244}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3668669622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3668669622},{"type":"v1","addr":"172.21.15.179:6837","nonce":3668669622}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:43:32.039618+0000","modified":"2023-10-09T06:43:35.597837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4905":{"gid":4905,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6834/4010179291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":4010179291},{"type":"v1","addr":"172.21.15.71:6834","nonce":4010179291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T06:54:51.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.712+0000 7fb2da99d700 1 -- 172.21.15.71:0/789942398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb2c00670e0 msgr2=0x7fb2c0069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:54:51.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.712+0000 7fb2da99d700 1 --2- 172.21.15.71:0/789942398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb2c00670e0 0x7fb2c0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.712+0000 7fb2da99d700 1 -- 172.21.15.71:0/789942398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2d40696c0 msgr2=0x7fb2d4087790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:51.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.712+0000 7fb2da99d700 1 --2- 172.21.15.71:0/789942398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2d40696c0 0x7fb2d4087790 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00cb90 tx=0x7fb2cc007d20 comp rx=0 tx=0).stop 2023-10-09T06:54:51.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.712+0000 7fb2da99d700 1 -- 172.21.15.71:0/789942398 shutdown_connections 2023-10-09T06:54:51.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.712+0000 7fb2da99d700 1 --2- 172.21.15.71:0/789942398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2d415de70 0x7fb2d418a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.712+0000 7fb2da99d700 1 --2- 172.21.15.71:0/789942398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb2c00670e0 0x7fb2c0069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.712+0000 7fb2da99d700 1 --2- 172.21.15.71:0/789942398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2d40696c0 0x7fb2d4087790 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.712+0000 7fb2da99d700 1 --2- 172.21.15.71:0/789942398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2d415daa0 0x7fb2d414c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.712+0000 7fb2da99d700 1 -- 172.21.15.71:0/789942398 >> 172.21.15.71:0/789942398 conn(0x7fb2d40cc1f0 msgr2=0x7fb2d4069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:51.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.713+0000 7fb2da99d700 1 -- 172.21.15.71:0/789942398 shutdown_connections 2023-10-09T06:54:51.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.713+0000 7fb2da99d700 1 -- 172.21.15.71:0/789942398 wait complete. 2023-10-09T06:54:51.716 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 15 2023-10-09T06:54:51.732 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:54:51.804 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:51.804+0000 7f41bb39e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T06:54:51.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.920+0000 7fb647fff700 1 Processor -- start 2023-10-09T06:54:51.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.920+0000 7fb647fff700 1 -- start start 2023-10-09T06:54:51.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.921+0000 7fb647fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb648159cc0 0x7fb6480b5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:51.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.921+0000 7fb647fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb6480b2920 0x7fb64815a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:51.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.921+0000 7fb647fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6480b5b40 con 0x7fb64815a5d0 2023-10-09T06:54:51.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.921+0000 7fb647fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6480ce260 con 0x7fb6480b2920 2023-10-09T06:54:51.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.921+0000 7fb647fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6480b5e20 con 0x7fb648159cc0 2023-10-09T06:54:51.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.922+0000 7fb6467fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb6480b2920 0x7fb64815a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:51.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.922+0000 7fb6467fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb6480b2920 0x7fb64815a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56250/0 (socket says 172.21.15.71:56250) 2023-10-09T06:54:51.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.922+0000 7fb6467fc700 1 -- 172.21.15.71:0/3180671108 learned_addr learned my addr 172.21.15.71:0/3180671108 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:51.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.922+0000 7fb646ffd700 1 --2- 172.21.15.71:0/3180671108 >> v2:172.21.15.179:3300/0 conn(0x7fb648159cc0 0x7fb6480b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:51.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.922+0000 7fb6467fc700 1 -- 172.21.15.71:0/3180671108 >> v2:172.21.15.179:3300/0 conn(0x7fb648159cc0 msgr2=0x7fb6480b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:51.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.922+0000 7fb6467fc700 1 --2- 172.21.15.71:0/3180671108 >> v2:172.21.15.179:3300/0 conn(0x7fb648159cc0 0x7fb6480b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.922+0000 7fb6467fc700 1 -- 172.21.15.71:0/3180671108 >> v1:172.21.15.71:6789/0 conn(0x7fb64815a5d0 legacy=0x7fb6480ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:51.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.922+0000 7fb6467fc700 1 -- 172.21.15.71:0/3180671108 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6480b6100 con 0x7fb6480b2920 2023-10-09T06:54:51.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.922+0000 7fb6467fc700 1 --2- 172.21.15.71:0/3180671108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6480b2920 0x7fb64815a090 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb648089670 tx=0x7fb63c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3f375bd79bde56 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:51.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.923+0000 7fb645ffb700 1 -- 172.21.15.71:0/3180671108 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c009e70 con 0x7fb6480b2920 2023-10-09T06:54:51.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.923+0000 7fb645ffb700 1 -- 172.21.15.71:0/3180671108 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c00b860 con 0x7fb6480b2920 2023-10-09T06:54:51.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.923+0000 7fb645ffb700 1 -- 172.21.15.71:0/3180671108 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c00bc00 con 0x7fb6480b2920 2023-10-09T06:54:51.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.923+0000 7fb647fff700 1 -- 172.21.15.71:0/3180671108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6480b2920 msgr2=0x7fb64815a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:51.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.923+0000 7fb647fff700 1 --2- 172.21.15.71:0/3180671108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6480b2920 0x7fb64815a090 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb648089670 tx=0x7fb63c009250 comp rx=0 tx=0).stop 2023-10-09T06:54:51.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.924+0000 7fb647fff700 1 -- 172.21.15.71:0/3180671108 shutdown_connections 2023-10-09T06:54:51.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.924+0000 7fb647fff700 1 --2- 172.21.15.71:0/3180671108 >> v2:172.21.15.179:3300/0 conn(0x7fb648159cc0 0x7fb6480b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.924+0000 7fb647fff700 1 --2- 172.21.15.71:0/3180671108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb6480b2920 0x7fb64815a090 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.924+0000 7fb647fff700 1 -- 172.21.15.71:0/3180671108 >> 172.21.15.71:0/3180671108 conn(0x7fb6480d0560 msgr2=0x7fb6480d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:51.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.924+0000 7fb647fff700 1 -- 172.21.15.71:0/3180671108 shutdown_connections 2023-10-09T06:54:51.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.924+0000 7fb647fff700 1 -- 172.21.15.71:0/3180671108 wait complete. 2023-10-09T06:54:51.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.925+0000 7fb647fff700 1 Processor -- start 2023-10-09T06:54:51.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.925+0000 7fb647fff700 1 -- start start 2023-10-09T06:54:51.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.926+0000 7fb647fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6480b2920 0x7fb648155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:51.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.926+0000 7fb647fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb648159cc0 0x7fb64814d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:51.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.926+0000 7fb647fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb64815a5d0 0x7fb64815b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:51.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.926+0000 7fb647fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb648154070 con 0x7fb64815a5d0 2023-10-09T06:54:51.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.926+0000 7fb647fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb648154910 con 0x7fb648159cc0 2023-10-09T06:54:51.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.926+0000 7fb647fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64815de90 con 0x7fb6480b2920 2023-10-09T06:54:51.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.927+0000 7fb6477fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb64815a5d0 0x7fb64815b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:51.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.927+0000 7fb6467fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb648159cc0 0x7fb64814d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:51.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.927+0000 7fb646ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6480b2920 0x7fb648155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:51.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.927+0000 7fb6467fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb648159cc0 0x7fb64814d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:33096/0 (socket says 172.21.15.71:33096) 2023-10-09T06:54:51.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.927+0000 7fb6467fc700 1 -- 172.21.15.71:0/3867016985 learned_addr learned my addr 172.21.15.71:0/3867016985 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:51.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.927+0000 7fb6477fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb64815a5d0 0x7fb64815b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56256/0 (socket says 172.21.15.71:56256) 2023-10-09T06:54:51.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.927+0000 7fb6467fc700 1 -- 172.21.15.71:0/3867016985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6480b2920 msgr2=0x7fb648155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:51.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.927+0000 7fb6467fc700 1 --2- 172.21.15.71:0/3867016985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6480b2920 0x7fb648155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.927+0000 7fb6467fc700 1 -- 172.21.15.71:0/3867016985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb64815a5d0 msgr2=0x7fb64815b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:51.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.927+0000 7fb6467fc700 1 --2- 172.21.15.71:0/3867016985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb64815a5d0 0x7fb64815b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:51.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.927+0000 7fb6467fc700 1 -- 172.21.15.71:0/3867016985 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c0094f0 con 0x7fb648159cc0 2023-10-09T06:54:51.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.927+0000 7fb6467fc700 1 --2- 172.21.15.71:0/3867016985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb648159cc0 0x7fb64814d9b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb648089180 tx=0x7fb63c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:51.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.928+0000 7fb62effd700 1 -- 172.21.15.71:0/3867016985 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c00bbe0 con 0x7fb648159cc0 2023-10-09T06:54:51.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.928+0000 7fb62effd700 1 -- 172.21.15.71:0/3867016985 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c011420 con 0x7fb648159cc0 2023-10-09T06:54:51.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.928+0000 7fb62effd700 1 -- 172.21.15.71:0/3867016985 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0117c0 con 0x7fb648159cc0 2023-10-09T06:54:51.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.928+0000 7fb647fff700 1 -- 172.21.15.71:0/3867016985 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6481542c0 con 0x7fb648159cc0 2023-10-09T06:54:51.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.928+0000 7fb647fff700 1 -- 172.21.15.71:0/3867016985 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb64815db30 con 0x7fb648159cc0 2023-10-09T06:54:51.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.929+0000 7fb647fff700 1 -- 172.21.15.71:0/3867016985 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64804c3c0 con 0x7fb648159cc0 2023-10-09T06:54:51.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.930+0000 7fb62effd700 1 -- 172.21.15.71:0/3867016985 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 13) v1 ==== 84911+0+0 (secure 0 0 0) 0x7fb63c011bf0 con 0x7fb648159cc0 2023-10-09T06:54:51.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.931+0000 7fb62effd700 1 --2- 172.21.15.71:0/3867016985 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb6340670e0 0x7fb634069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:51.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.931+0000 7fb62effd700 1 -- 172.21.15.71:0/3867016985 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6371+0+0 (secure 0 0 0) 0x7fb63c085ef0 con 0x7fb648159cc0 2023-10-09T06:54:51.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.931+0000 7fb646ffd700 1 -- 172.21.15.71:0/3867016985 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb6340670e0 msgr2=0x7fb634069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:54:51.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.931+0000 7fb646ffd700 1 --2- 172.21.15.71:0/3867016985 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb6340670e0 0x7fb634069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:54:51.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:51.935+0000 7fb62effd700 1 -- 172.21.15.71:0/3867016985 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb63c052ba0 con 0x7fb648159cc0 2023-10-09T06:54:51.953 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:51.953+0000 7f305a3fe180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T06:54:52.048 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:52.048+0000 7f305a3fe180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T06:54:52.107 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:52.106+0000 7f41bb39e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T06:54:52.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.132+0000 7fb646ffd700 1 -- 172.21.15.71:0/3867016985 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb6340670e0 msgr2=0x7fb634069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:54:52.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.132+0000 7fb646ffd700 1 --2- 172.21.15.71:0/3867016985 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb6340670e0 0x7fb634069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:54:52.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.178+0000 7fb647fff700 1 -- 172.21.15.71:0/3867016985 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6480b63e0 con 0x7fb648159cc0 2023-10-09T06:54:52.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.179+0000 7fb62effd700 1 -- 172.21.15.71:0/3867016985 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fb63c0561c0 con 0x7fb648159cc0 2023-10-09T06:54:52.179 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:54:52.180 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2315236875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":2315236875},{"type":"v1","addr":"172.21.15.71:6835","nonce":2315236875}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4628,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2455384244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2455384244},{"type":"v1","addr":"172.21.15.179:6836","nonce":2455384244}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3668669622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3668669622},{"type":"v1","addr":"172.21.15.179:6837","nonce":3668669622}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:43:32.039618+0000","modified":"2023-10-09T06:43:35.597837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4905":{"gid":4905,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6834/4010179291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":4010179291},{"type":"v1","addr":"172.21.15.71:6834","nonce":4010179291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T06:54:52.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.181+0000 7fb647fff700 1 -- 172.21.15.71:0/3867016985 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb6340670e0 msgr2=0x7fb634069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:54:52.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.181+0000 7fb647fff700 1 --2- 172.21.15.71:0/3867016985 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb6340670e0 0x7fb634069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:52.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.181+0000 7fb647fff700 1 -- 172.21.15.71:0/3867016985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb648159cc0 msgr2=0x7fb64814d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:52.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.181+0000 7fb647fff700 1 --2- 172.21.15.71:0/3867016985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb648159cc0 0x7fb64814d9b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb648089180 tx=0x7fb63c017000 comp rx=0 tx=0).stop 2023-10-09T06:54:52.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.181+0000 7fb647fff700 1 -- 172.21.15.71:0/3867016985 shutdown_connections 2023-10-09T06:54:52.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.181+0000 7fb647fff700 1 --2- 172.21.15.71:0/3867016985 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb6340670e0 0x7fb634069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:52.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.181+0000 7fb647fff700 1 --2- 172.21.15.71:0/3867016985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb64815a5d0 0x7fb64815b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:52.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.181+0000 7fb647fff700 1 --2- 172.21.15.71:0/3867016985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6480b2920 0x7fb648155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:52.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.181+0000 7fb647fff700 1 --2- 172.21.15.71:0/3867016985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb648159cc0 0x7fb64814d9b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:52.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.181+0000 7fb647fff700 1 -- 172.21.15.71:0/3867016985 >> 172.21.15.71:0/3867016985 conn(0x7fb6480d0560 msgr2=0x7fb6480b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:52.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.181+0000 7fb647fff700 1 -- 172.21.15.71:0/3867016985 shutdown_connections 2023-10-09T06:54:52.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.181+0000 7fb647fff700 1 -- 172.21.15.71:0/3867016985 wait complete. 2023-10-09T06:54:52.183 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 15 2023-10-09T06:54:52.200 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:54:52.206 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:52.206+0000 7f41bb39e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T06:54:52.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.386+0000 7f80ad99d700 1 Processor -- start 2023-10-09T06:54:52.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.386+0000 7f80ad99d700 1 -- start start 2023-10-09T06:54:52.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.387+0000 7f80ad99d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f80a8156310 0x7f80a80c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:52.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.387+0000 7f80ad99d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a80ca860 con 0x7f80a81566e0 2023-10-09T06:54:52.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.387+0000 7f80ad99d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a80cab40 con 0x7f80a80ae710 2023-10-09T06:54:52.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.387+0000 7f80ad99d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a80cae20 con 0x7f80a8156310 2023-10-09T06:54:52.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.387+0000 7f80a7fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f80a81566e0 0x7f80a80ae000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51496/0 (socket says 172.21.15.71:51496) 2023-10-09T06:54:52.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.387+0000 7f80a7fff700 1 -- 172.21.15.71:0/4075264248 learned_addr learned my addr 172.21.15.71:0/4075264248 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:52.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.388+0000 7f80ac99b700 1 --2- 172.21.15.71:0/4075264248 >> v2:172.21.15.179:3300/0 conn(0x7f80a8156310 0x7f80a80c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:52.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.388+0000 7f80a77fe700 1 -- 172.21.15.71:0/4075264248 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211408465 0 0) 0x7f80a80ca860 con 0x7f80a81566e0 2023-10-09T06:54:52.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.388+0000 7f80a77fe700 1 -- 172.21.15.71:0/4075264248 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8098003570 con 0x7f80a81566e0 2023-10-09T06:54:52.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.388+0000 7f80ac99b700 1 -- 172.21.15.71:0/4075264248 >> v1:172.21.15.179:6789/0 conn(0x7f80a80ae710 legacy=0x7f80a80c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:52.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.388+0000 7f80a77fe700 1 -- 172.21.15.71:0/4075264248 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242840080 0 0) 0x7f80a80cab40 con 0x7f80a80ae710 2023-10-09T06:54:52.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.388+0000 7f80ac99b700 1 -- 172.21.15.71:0/4075264248 >> v1:172.21.15.71:6789/0 conn(0x7f80a81566e0 legacy=0x7f80a80ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:52.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.388+0000 7f80ac99b700 1 -- 172.21.15.71:0/4075264248 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a80cb100 con 0x7f80a8156310 2023-10-09T06:54:52.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.388+0000 7f80ac99b700 1 --2- 172.21.15.71:0/4075264248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80a8156310 0x7f80a80c9dc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f809c0098e0 tx=0x7f809c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df6c4400fc1ba0f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:52.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.389+0000 7f80a77fe700 1 -- 172.21.15.71:0/4075264248 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c00b640 con 0x7f80a8156310 2023-10-09T06:54:52.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.389+0000 7f80a77fe700 1 -- 172.21.15.71:0/4075264248 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c00b7a0 con 0x7f80a8156310 2023-10-09T06:54:52.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.389+0000 7f80a77fe700 1 -- 172.21.15.71:0/4075264248 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c00bb40 con 0x7f80a8156310 2023-10-09T06:54:52.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.389+0000 7f80ad99d700 1 -- 172.21.15.71:0/4075264248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80a8156310 msgr2=0x7f80a80c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:52.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.389+0000 7f80ad99d700 1 --2- 172.21.15.71:0/4075264248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80a8156310 0x7f80a80c9dc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f809c0098e0 tx=0x7f809c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:52.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.390+0000 7f80ad99d700 1 -- 172.21.15.71:0/4075264248 shutdown_connections 2023-10-09T06:54:52.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.390+0000 7f80ad99d700 1 --2- 172.21.15.71:0/4075264248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80a8156310 0x7f80a80c9dc0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:52.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.390+0000 7f80ad99d700 1 -- 172.21.15.71:0/4075264248 >> 172.21.15.71:0/4075264248 conn(0x7f80a80cc1f0 msgr2=0x7f80a80cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:52.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.390+0000 7f80ad99d700 1 -- 172.21.15.71:0/4075264248 shutdown_connections 2023-10-09T06:54:52.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.390+0000 7f80ad99d700 1 -- 172.21.15.71:0/4075264248 wait complete. 2023-10-09T06:54:52.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.392+0000 7f80ad99d700 1 Processor -- start 2023-10-09T06:54:52.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.392+0000 7f80ad99d700 1 -- start start 2023-10-09T06:54:52.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.394+0000 7f80ad99d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a80ae710 0x7f80a8146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:52.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.394+0000 7f80ad99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80a8156310 0x7f80a815a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:52.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.394+0000 7f80ad99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80a81566e0 0x7f80a80aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:52.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.394+0000 7f80ad99d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a8147270 con 0x7f80a80ae710 2023-10-09T06:54:52.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.394+0000 7f80ad99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a80c4620 con 0x7f80a81566e0 2023-10-09T06:54:52.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.394+0000 7f80ad99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a81536f0 con 0x7f80a8156310 2023-10-09T06:54:52.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.394+0000 7f80ac99b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a80ae710 0x7f80a8146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:52.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.394+0000 7f80ac99b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a80ae710 0x7f80a8146d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56258/0 (socket says 172.21.15.71:56258) 2023-10-09T06:54:52.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.394+0000 7f80ac99b700 1 -- 172.21.15.71:0/4022502803 learned_addr learned my addr 172.21.15.71:0/4022502803 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:52.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.394+0000 7f80a7fff700 1 --2- 172.21.15.71:0/4022502803 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80a8156310 0x7f80a815a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:52.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.394+0000 7f80ad19c700 1 --2- 172.21.15.71:0/4022502803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80a81566e0 0x7f80a80aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:52.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.394+0000 7f80ac99b700 1 -- 172.21.15.71:0/4022502803 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80a8156310 msgr2=0x7f80a815a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:52.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.394+0000 7f80ac99b700 1 --2- 172.21.15.71:0/4022502803 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80a8156310 0x7f80a815a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:52.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.394+0000 7f80ac99b700 1 -- 172.21.15.71:0/4022502803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80a81566e0 msgr2=0x7f80a80aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:52.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.394+0000 7f80ac99b700 1 --2- 172.21.15.71:0/4022502803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80a81566e0 0x7f80a80aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:52.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.394+0000 7f80ac99b700 1 -- 172.21.15.71:0/4022502803 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c009420 con 0x7f80a80ae710 2023-10-09T06:54:52.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.394+0000 7f80a7fff700 1 --2- 172.21.15.71:0/4022502803 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80a8156310 0x7f80a815a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:54:52.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.395+0000 7f80ac99b700 1 --2- 172.21.15.71:0/4022502803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a80ae710 0x7f80a8146d30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f80a806fe40 tx=0x7f809c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:52.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.395+0000 7f80a4ff9700 1 -- 172.21.15.71:0/4022502803 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c01f070 con 0x7f80a80ae710 2023-10-09T06:54:52.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.395+0000 7f80a4ff9700 1 -- 172.21.15.71:0/4022502803 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c000bc0 con 0x7f80a80ae710 2023-10-09T06:54:52.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.395+0000 7f80a4ff9700 1 -- 172.21.15.71:0/4022502803 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c025420 con 0x7f80a80ae710 2023-10-09T06:54:52.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.395+0000 7f80ad99d700 1 -- 172.21.15.71:0/4022502803 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a80c32a0 con 0x7f80a80ae710 2023-10-09T06:54:52.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.395+0000 7f80ad99d700 1 -- 172.21.15.71:0/4022502803 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a80c3860 con 0x7f80a80ae710 2023-10-09T06:54:52.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.396+0000 7f80ad99d700 1 -- 172.21.15.71:0/4022502803 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a80caad0 con 0x7f80a80ae710 2023-10-09T06:54:52.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.397+0000 7f80a4ff9700 1 -- 172.21.15.71:0/4022502803 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f809c023070 con 0x7f80a80ae710 2023-10-09T06:54:52.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.398+0000 7f80a4ff9700 1 --2- 172.21.15.71:0/4022502803 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f808c0670e0 0x7f808c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:52.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.398+0000 7f80a4ff9700 1 -- 172.21.15.71:0/4022502803 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6371+0+0 (secure 0 0 0) 0x7f809c085fa0 con 0x7f80a80ae710 2023-10-09T06:54:52.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.398+0000 7f80a7fff700 1 -- 172.21.15.71:0/4022502803 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f808c0670e0 msgr2=0x7f808c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:54:52.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.398+0000 7f80a7fff700 1 --2- 172.21.15.71:0/4022502803 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f808c0670e0 0x7f808c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:54:52.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.403+0000 7f80a4ff9700 1 -- 172.21.15.71:0/4022502803 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f809c0b75a0 con 0x7f80a80ae710 2023-10-09T06:54:52.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.599+0000 7f80a7fff700 1 -- 172.21.15.71:0/4022502803 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f808c0670e0 msgr2=0x7f808c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:54:52.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.599+0000 7f80a7fff700 1 --2- 172.21.15.71:0/4022502803 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f808c0670e0 0x7f808c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:54:52.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.606+0000 7f80ad99d700 1 -- 172.21.15.71:0/4022502803 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80a804c3f0 con 0x7f80a80ae710 2023-10-09T06:54:52.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.607+0000 7f80a4ff9700 1 -- 172.21.15.71:0/4022502803 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16367 (secure 0 0 0) 0x7f809c02a090 con 0x7f80a80ae710 2023-10-09T06:54:52.608 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:54:52.608 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":50,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:54:49.716626+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:43:29.634330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T06:43:31.023113+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":217,"snap_epoch":50,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6833/85452":"2023-10-10T06:43:52.669588+0000","172.21.15.179:0/1464937439":"2023-10-10T06:43:52.669588+0000","172.21.15.179:0/4042901359":"2023-10-10T06:43:52.669588+0000","172.21.15.179:0/3168407320":"2023-10-10T06:43:52.669588+0000","172.21.15.179:6832/85452":"2023-10-10T06:43:52.669588+0000","172.21.15.179:0/1455428643":"2023-10-10T06:43:52.669588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]}],"new_removed_snaps":[{"pool":5,"snaps":[{"begin":107,"length":1},{"begin":217,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:54:52.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.609+0000 7f80ad99d700 1 -- 172.21.15.71:0/4022502803 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f808c0670e0 msgr2=0x7f808c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:54:52.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.609+0000 7f80ad99d700 1 --2- 172.21.15.71:0/4022502803 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f808c0670e0 0x7f808c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:52.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.609+0000 7f80ad99d700 1 -- 172.21.15.71:0/4022502803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a80ae710 msgr2=0x7f80a8146d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:52.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.609+0000 7f80ad99d700 1 --2- 172.21.15.71:0/4022502803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a80ae710 0x7f80a8146d30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f80a806fe40 tx=0x7f809c017000 comp rx=0 tx=0).stop 2023-10-09T06:54:52.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.610+0000 7f80ad99d700 1 -- 172.21.15.71:0/4022502803 shutdown_connections 2023-10-09T06:54:52.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.610+0000 7f80ad99d700 1 --2- 172.21.15.71:0/4022502803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80a81566e0 0x7f80a80aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:52.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.610+0000 7f80ad99d700 1 --2- 172.21.15.71:0/4022502803 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f808c0670e0 0x7f808c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:52.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.610+0000 7f80ad99d700 1 --2- 172.21.15.71:0/4022502803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a80ae710 0x7f80a8146d30 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:52.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.610+0000 7f80ad99d700 1 --2- 172.21.15.71:0/4022502803 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80a8156310 0x7f80a815a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:52.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.610+0000 7f80ad99d700 1 -- 172.21.15.71:0/4022502803 >> 172.21.15.71:0/4022502803 conn(0x7f80a80cc1f0 msgr2=0x7f80a80afb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:52.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.610+0000 7f80ad99d700 1 -- 172.21.15.71:0/4022502803 shutdown_connections 2023-10-09T06:54:52.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.610+0000 7f80ad99d700 1 -- 172.21.15.71:0/4022502803 wait complete. 2023-10-09T06:54:52.630 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T06:54:52.747 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:52.747+0000 7f305a3fe180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T06:54:52.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.865+0000 7f770359e700 1 Processor -- start 2023-10-09T06:54:52.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.865+0000 7f770359e700 1 -- start start 2023-10-09T06:54:52.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.866+0000 7f770359e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7704150180 0x7f7704157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:52.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.866+0000 7f770359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77040c7410 0x7f7704069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:52.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.866+0000 7f770359e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f770406e2a0 con 0x7f7704150550 2023-10-09T06:54:52.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.867+0000 7f770359e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f770406b2e0 con 0x7f7704150180 2023-10-09T06:54:52.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.867+0000 7f770359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77040c78e0 con 0x7f77040c7410 2023-10-09T06:54:52.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.867+0000 7f7701d9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f7704150550 0x7f77040c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51502/0 (socket says 172.21.15.71:51502) 2023-10-09T06:54:52.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.867+0000 7f7701d9b700 1 -- 172.21.15.71:0/3787943828 learned_addr learned my addr 172.21.15.71:0/3787943828 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:52.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.867+0000 7f770259c700 1 --2- 172.21.15.71:0/3787943828 >> v2:172.21.15.179:3300/0 conn(0x7f7704150180 0x7f7704157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:52.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.867+0000 7f7702d9d700 1 --2- 172.21.15.71:0/3787943828 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77040c7410 0x7f7704069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:52.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.867+0000 7f770159a700 1 -- 172.21.15.71:0/3787943828 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273087083 0 0) 0x7f770406e2a0 con 0x7f7704150550 2023-10-09T06:54:52.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.867+0000 7f770159a700 1 -- 172.21.15.71:0/3787943828 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76ec003570 con 0x7f7704150550 2023-10-09T06:54:52.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.867+0000 7f770259c700 1 -- 172.21.15.71:0/3787943828 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77040c7410 msgr2=0x7f7704069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:52.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.867+0000 7f770259c700 1 --2- 172.21.15.71:0/3787943828 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77040c7410 0x7f7704069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:52.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.867+0000 7f770259c700 1 -- 172.21.15.71:0/3787943828 >> v1:172.21.15.71:6789/0 conn(0x7f7704150550 legacy=0x7f77040c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:52.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.867+0000 7f770259c700 1 -- 172.21.15.71:0/3787943828 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77040c7bc0 con 0x7f7704150180 2023-10-09T06:54:52.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.868+0000 7f770259c700 1 --2- 172.21.15.71:0/3787943828 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7704150180 0x7f7704157770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f76f400aa90 tx=0x7f76f400a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7841066589138d6f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:52.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.868+0000 7f770159a700 1 -- 172.21.15.71:0/3787943828 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f400c970 con 0x7f7704150180 2023-10-09T06:54:52.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.868+0000 7f770159a700 1 -- 172.21.15.71:0/3787943828 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f400cad0 con 0x7f7704150180 2023-10-09T06:54:52.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.868+0000 7f770159a700 1 -- 172.21.15.71:0/3787943828 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f400ce70 con 0x7f7704150180 2023-10-09T06:54:52.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.868+0000 7f770359e700 1 -- 172.21.15.71:0/3787943828 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7704150180 msgr2=0x7f7704157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:52.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.868+0000 7f770359e700 1 --2- 172.21.15.71:0/3787943828 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7704150180 0x7f7704157770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f76f400aa90 tx=0x7f76f400a330 comp rx=0 tx=0).stop 2023-10-09T06:54:52.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.869+0000 7f770359e700 1 -- 172.21.15.71:0/3787943828 shutdown_connections 2023-10-09T06:54:52.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.869+0000 7f770359e700 1 --2- 172.21.15.71:0/3787943828 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77040c7410 0x7f7704069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:52.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.869+0000 7f770359e700 1 --2- 172.21.15.71:0/3787943828 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7704150180 0x7f7704157770 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:52.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.869+0000 7f770359e700 1 -- 172.21.15.71:0/3787943828 >> 172.21.15.71:0/3787943828 conn(0x7f77040cc1f0 msgr2=0x7f77040cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:52.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.869+0000 7f770359e700 1 -- 172.21.15.71:0/3787943828 shutdown_connections 2023-10-09T06:54:52.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.869+0000 7f770359e700 1 -- 172.21.15.71:0/3787943828 wait complete. 2023-10-09T06:54:52.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.870+0000 7f770359e700 1 Processor -- start 2023-10-09T06:54:52.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.870+0000 7f770359e700 1 -- start start 2023-10-09T06:54:52.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.871+0000 7f770359e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77040c7410 0x7f770414e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:52.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.871+0000 7f770359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7704150180 0x7f770414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:52.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.871+0000 7f770359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7704150550 0x7f77040adc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:52.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.871+0000 7f770359e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77040ae9a0 con 0x7f77040c7410 2023-10-09T06:54:52.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.871+0000 7f770359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770414c960 con 0x7f7704150180 2023-10-09T06:54:52.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.871+0000 7f770359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770414b830 con 0x7f7704150550 2023-10-09T06:54:52.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.871+0000 7f770259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77040c7410 0x7f770414e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:52.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.871+0000 7f770259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77040c7410 0x7f770414e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56266/0 (socket says 172.21.15.71:56266) 2023-10-09T06:54:52.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.871+0000 7f770259c700 1 -- 172.21.15.71:0/742624681 learned_addr learned my addr 172.21.15.71:0/742624681 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:52.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.871+0000 7f7701d9b700 1 --2- 172.21.15.71:0/742624681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7704150180 0x7f770414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:52.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.871+0000 7f7702d9d700 1 --2- 172.21.15.71:0/742624681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7704150550 0x7f77040adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:52.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.872+0000 7f770259c700 1 -- 172.21.15.71:0/742624681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7704150550 msgr2=0x7f77040adc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:52.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.872+0000 7f770259c700 1 --2- 172.21.15.71:0/742624681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7704150550 0x7f77040adc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:52.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.872+0000 7f770259c700 1 -- 172.21.15.71:0/742624681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7704150180 msgr2=0x7f770414b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:52.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.872+0000 7f770259c700 1 --2- 172.21.15.71:0/742624681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7704150180 0x7f770414b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:52.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.872+0000 7f770259c700 1 -- 172.21.15.71:0/742624681 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f400a5d0 con 0x7f77040c7410 2023-10-09T06:54:52.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.872+0000 7f770259c700 1 --2- 172.21.15.71:0/742624681 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77040c7410 0x7f770414e710 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f76f4019aa0 tx=0x7f76f401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:52.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.872+0000 7f76f27fc700 1 -- 172.21.15.71:0/742624681 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4021430 con 0x7f77040c7410 2023-10-09T06:54:52.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.872+0000 7f76f27fc700 1 -- 172.21.15.71:0/742624681 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f4021590 con 0x7f77040c7410 2023-10-09T06:54:52.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.872+0000 7f770359e700 1 -- 172.21.15.71:0/742624681 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77040ae140 con 0x7f77040c7410 2023-10-09T06:54:52.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.872+0000 7f76f27fc700 1 -- 172.21.15.71:0/742624681 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4021950 con 0x7f77040c7410 2023-10-09T06:54:52.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.873+0000 7f770359e700 1 -- 172.21.15.71:0/742624681 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77040ae6c0 con 0x7f77040c7410 2023-10-09T06:54:52.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.874+0000 7f770359e700 1 -- 172.21.15.71:0/742624681 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770404c3c0 con 0x7f77040c7410 2023-10-09T06:54:52.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.874+0000 7f76f27fc700 1 -- 172.21.15.71:0/742624681 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f76f40103f0 con 0x7f77040c7410 2023-10-09T06:54:52.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.876+0000 7f76f27fc700 1 --2- 172.21.15.71:0/742624681 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f76e40670e0 0x7f76e4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:52.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.876+0000 7f76f27fc700 1 -- 172.21.15.71:0/742624681 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6371+0+0 (secure 0 0 0) 0x7f76f40863f0 con 0x7f77040c7410 2023-10-09T06:54:52.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.876+0000 7f7701d9b700 1 -- 172.21.15.71:0/742624681 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f76e40670e0 msgr2=0x7f76e4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:54:52.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.877+0000 7f7701d9b700 1 --2- 172.21.15.71:0/742624681 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f76e40670e0 0x7f76e4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:54:52.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:52.879+0000 7f76f27fc700 1 -- 172.21.15.71:0/742624681 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76f40530a0 con 0x7f77040c7410 2023-10-09T06:54:52.994 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:52.993+0000 7f41bb39e180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T06:54:53.035 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:53.035+0000 7f305a3fe180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T06:54:53.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.078+0000 7f7701d9b700 1 -- 172.21.15.71:0/742624681 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f76e40670e0 msgr2=0x7f76e4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:54:53.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.078+0000 7f7701d9b700 1 --2- 172.21.15.71:0/742624681 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f76e40670e0 0x7f76e4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:54:53.127 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:53.126+0000 7f305a3fe180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T06:54:53.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.170+0000 7f770359e700 1 -- 172.21.15.71:0/742624681 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f770406d650 con 0x7f77040c7410 2023-10-09T06:54:53.171 INFO:tasks.ceph.mon.a.smithi071.stderr:2023-10-09T06:54:53.170+0000 7fdb445f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T06:54:53.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.176+0000 7f76f27fc700 1 -- 172.21.15.71:0/742624681 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7f76f40566c0 con 0x7f77040c7410 2023-10-09T06:54:53.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.180+0000 7f770359e700 1 -- 172.21.15.71:0/742624681 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f76e40670e0 msgr2=0x7f76e4069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:54:53.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.180+0000 7f770359e700 1 --2- 172.21.15.71:0/742624681 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f76e40670e0 0x7f76e4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:53.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.180+0000 7f770359e700 1 -- 172.21.15.71:0/742624681 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77040c7410 msgr2=0x7f770414e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:53.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.180+0000 7f770359e700 1 --2- 172.21.15.71:0/742624681 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77040c7410 0x7f770414e710 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f76f4019aa0 tx=0x7f76f401a000 comp rx=0 tx=0).stop 2023-10-09T06:54:53.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.180+0000 7f770359e700 1 -- 172.21.15.71:0/742624681 shutdown_connections 2023-10-09T06:54:53.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.180+0000 7f770359e700 1 --2- 172.21.15.71:0/742624681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7704150550 0x7f77040adc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:53.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.180+0000 7f770359e700 1 --2- 172.21.15.71:0/742624681 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f76e40670e0 0x7f76e4069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:53.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.180+0000 7f770359e700 1 --2- 172.21.15.71:0/742624681 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77040c7410 0x7f770414e710 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:53.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.180+0000 7f770359e700 1 --2- 172.21.15.71:0/742624681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7704150180 0x7f770414b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:53.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.180+0000 7f770359e700 1 -- 172.21.15.71:0/742624681 >> 172.21.15.71:0/742624681 conn(0x7f77040cc1f0 msgr2=0x7f77040696c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:53.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.180+0000 7f770359e700 1 -- 172.21.15.71:0/742624681 shutdown_connections 2023-10-09T06:54:53.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.180+0000 7f770359e700 1 -- 172.21.15.71:0/742624681 wait complete. 2023-10-09T06:54:53.181 INFO:teuthology.orchestra.run.smithi071.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T06:54:53.198 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T06:54:53.251 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-10-09T06:54:53.281 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:53.281+0000 7f305a3fe180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T06:54:53.295 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:53.296+0000 7f41bb39e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T06:54:53.384 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:53.384+0000 7f305a3fe180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T06:54:53.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.387+0000 7f3bd89fe700 1 Processor -- start 2023-10-09T06:54:53.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.388+0000 7f3bd89fe700 1 -- start start 2023-10-09T06:54:53.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.389+0000 7f3bd89fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3bd40b4e70 0x7f3bd40ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:53.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.389+0000 7f3bd89fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3bd40b16d0 0x7f3bd40b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:53.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.389+0000 7f3bd89fe700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd40b2080 con 0x7f3bd415d240 2023-10-09T06:54:53.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.389+0000 7f3bd89fe700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd40cfb00 con 0x7f3bd40b4e70 2023-10-09T06:54:53.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.389+0000 7f3bd89fe700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd40b5c40 con 0x7f3bd40b16d0 2023-10-09T06:54:53.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.389+0000 7f3bd359e700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3bd415d240 0x7f3bd415d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51520/0 (socket says 172.21.15.71:51520) 2023-10-09T06:54:53.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.389+0000 7f3bd359e700 1 -- 172.21.15.71:0/1129407904 learned_addr learned my addr 172.21.15.71:0/1129407904 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:53.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.389+0000 7f3bd2d9d700 1 --2- 172.21.15.71:0/1129407904 >> v2:172.21.15.71:3300/0 conn(0x7f3bd40b4e70 0x7f3bd40ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:53.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.389+0000 7f3bd259c700 1 --2- 172.21.15.71:0/1129407904 >> v2:172.21.15.179:3300/0 conn(0x7f3bd40b16d0 0x7f3bd40b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:53.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.389+0000 7f3bd1d9b700 1 -- 172.21.15.71:0/1129407904 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1871074199 0 0) 0x7f3bd40b2080 con 0x7f3bd415d240 2023-10-09T06:54:53.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.390+0000 7f3bd1d9b700 1 -- 172.21.15.71:0/1129407904 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bbc003570 con 0x7f3bd415d240 2023-10-09T06:54:53.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.390+0000 7f3bd2d9d700 1 -- 172.21.15.71:0/1129407904 >> v2:172.21.15.179:3300/0 conn(0x7f3bd40b16d0 msgr2=0x7f3bd40b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:53.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.390+0000 7f3bd2d9d700 1 --2- 172.21.15.71:0/1129407904 >> v2:172.21.15.179:3300/0 conn(0x7f3bd40b16d0 0x7f3bd40b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:53.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.390+0000 7f3bd2d9d700 1 -- 172.21.15.71:0/1129407904 >> v1:172.21.15.71:6789/0 conn(0x7f3bd415d240 legacy=0x7f3bd415d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:53.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.390+0000 7f3bd2d9d700 1 -- 172.21.15.71:0/1129407904 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd40b5f20 con 0x7f3bd40b4e70 2023-10-09T06:54:53.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.390+0000 7f3bd2d9d700 1 --2- 172.21.15.71:0/1129407904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bd40b4e70 0x7f3bd40ccff0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4089830 tx=0x7f3bc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8bca4b1eef97d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:53.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.390+0000 7f3bd1d9b700 1 -- 172.21.15.71:0/1129407904 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4011630 con 0x7f3bd40b4e70 2023-10-09T06:54:53.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.390+0000 7f3bd1d9b700 1 -- 172.21.15.71:0/1129407904 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc40117b0 con 0x7f3bd40b4e70 2023-10-09T06:54:53.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.390+0000 7f3bd1d9b700 1 -- 172.21.15.71:0/1129407904 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4011b30 con 0x7f3bd40b4e70 2023-10-09T06:54:53.393 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:53.391+0000 7f41bb39e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T06:54:53.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.391+0000 7f3bd89fe700 1 -- 172.21.15.71:0/1129407904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bd40b4e70 msgr2=0x7f3bd40ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:53.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.391+0000 7f3bd89fe700 1 --2- 172.21.15.71:0/1129407904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bd40b4e70 0x7f3bd40ccff0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4089830 tx=0x7f3bc40091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:53.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.391+0000 7f3bd89fe700 1 -- 172.21.15.71:0/1129407904 shutdown_connections 2023-10-09T06:54:53.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.391+0000 7f3bd89fe700 1 --2- 172.21.15.71:0/1129407904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bd40b4e70 0x7f3bd40ccff0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:53.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.391+0000 7f3bd89fe700 1 --2- 172.21.15.71:0/1129407904 >> v2:172.21.15.179:3300/0 conn(0x7f3bd40b16d0 0x7f3bd40b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:53.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.391+0000 7f3bd89fe700 1 -- 172.21.15.71:0/1129407904 >> 172.21.15.71:0/1129407904 conn(0x7f3bd40d10c0 msgr2=0x7f3bd40affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:53.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.391+0000 7f3bd89fe700 1 -- 172.21.15.71:0/1129407904 shutdown_connections 2023-10-09T06:54:53.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.391+0000 7f3bd89fe700 1 -- 172.21.15.71:0/1129407904 wait complete. 2023-10-09T06:54:53.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.392+0000 7f3bd89fe700 1 Processor -- start 2023-10-09T06:54:53.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.392+0000 7f3bd89fe700 1 -- start start 2023-10-09T06:54:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.393+0000 7f3bd89fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bd40b16d0 0x7f3bd40c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.393+0000 7f3bd89fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bd40b4e70 0x7f3bd414b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.393+0000 7f3bd89fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bd415d240 0x7f3bd40cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.393+0000 7f3bd89fe700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd40c5390 con 0x7f3bd415d240 2023-10-09T06:54:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.393+0000 7f3bd89fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd40c5950 con 0x7f3bd40b16d0 2023-10-09T06:54:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.393+0000 7f3bd89fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd414b700 con 0x7f3bd40b4e70 2023-10-09T06:54:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.394+0000 7f3bd359e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bd415d240 0x7f3bd40cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.394+0000 7f3bd359e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bd415d240 0x7f3bd40cb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56288/0 (socket says 172.21.15.71:56288) 2023-10-09T06:54:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.394+0000 7f3bd359e700 1 -- 172.21.15.71:0/1316542012 learned_addr learned my addr 172.21.15.71:0/1316542012 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.394+0000 7f3bd2d9d700 1 --2- 172.21.15.71:0/1316542012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bd40b16d0 0x7f3bd40c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.394+0000 7f3bd259c700 1 --2- 172.21.15.71:0/1316542012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bd40b4e70 0x7f3bd414b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.394+0000 7f3bd359e700 1 -- 172.21.15.71:0/1316542012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bd40b4e70 msgr2=0x7f3bd414b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.394+0000 7f3bd359e700 1 --2- 172.21.15.71:0/1316542012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bd40b4e70 0x7f3bd414b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.394+0000 7f3bd359e700 1 -- 172.21.15.71:0/1316542012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bd40b16d0 msgr2=0x7f3bd40c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.394+0000 7f3bd359e700 1 --2- 172.21.15.71:0/1316542012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bd40b16d0 0x7f3bd40c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.394+0000 7f3bd359e700 1 -- 172.21.15.71:0/1316542012 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc4009420 con 0x7f3bd415d240 2023-10-09T06:54:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.394+0000 7f3bd359e700 1 --2- 172.21.15.71:0/1316542012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bd415d240 0x7f3bd40cb660 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc001460 tx=0x7f3bcc001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.394+0000 7f3bbaffd700 1 -- 172.21.15.71:0/1316542012 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc00a870 con 0x7f3bd415d240 2023-10-09T06:54:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.394+0000 7f3bbaffd700 1 -- 172.21.15.71:0/1316542012 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bcc00a9d0 con 0x7f3bd415d240 2023-10-09T06:54:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.394+0000 7f3bd89fe700 1 -- 172.21.15.71:0/1316542012 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd40cbed0 con 0x7f3bd415d240 2023-10-09T06:54:53.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.394+0000 7f3bbaffd700 1 -- 172.21.15.71:0/1316542012 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc00ad50 con 0x7f3bd415d240 2023-10-09T06:54:53.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.395+0000 7f3bd89fe700 1 -- 172.21.15.71:0/1316542012 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd40c55e0 con 0x7f3bd415d240 2023-10-09T06:54:53.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.396+0000 7f3bb8ff9700 1 -- 172.21.15.71:0/1316542012 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bac0052b0 con 0x7f3bd415d240 2023-10-09T06:54:53.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.397+0000 7f3bbaffd700 1 -- 172.21.15.71:0/1316542012 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f3bcc007300 con 0x7f3bd415d240 2023-10-09T06:54:53.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.398+0000 7f3bbaffd700 1 --2- 172.21.15.71:0/1316542012 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3bc00670e0 0x7f3bc0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:53.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.398+0000 7f3bbaffd700 1 -- 172.21.15.71:0/1316542012 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f3bcc084e50 con 0x7f3bd415d240 2023-10-09T06:54:53.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.398+0000 7f3bd2d9d700 1 -- 172.21.15.71:0/1316542012 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3bc00670e0 msgr2=0x7f3bc0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:54:53.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.398+0000 7f3bd2d9d700 1 --2- 172.21.15.71:0/1316542012 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3bc00670e0 0x7f3bc0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:54:53.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.401+0000 7f3bbaffd700 1 -- 172.21.15.71:0/1316542012 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bcc051b60 con 0x7f3bd415d240 2023-10-09T06:54:53.552 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:53.551+0000 7f41bb39e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T06:54:53.571 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:53.571+0000 7f305a3fe180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T06:54:53.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.599+0000 7f3bd2d9d700 1 -- 172.21.15.71:0/1316542012 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3bc00670e0 msgr2=0x7f3bc0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:54:53.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.599+0000 7f3bd2d9d700 1 --2- 172.21.15.71:0/1316542012 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3bc00670e0 0x7f3bc0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:54:53.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.647+0000 7f3bb8ff9700 1 -- 172.21.15.71:0/1316542012 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3bac005ae0 con 0x7f3bd415d240 2023-10-09T06:54:53.657 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:53.656+0000 7f41bb39e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T06:54:53.663 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:53.662+0000 7f305a3fe180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T06:54:53.753 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:53.752+0000 7f305a3fe180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T06:54:53.846 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:53.846+0000 7f41bb39e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T06:54:53.847 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:53.846+0000 7f305a3fe180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T06:54:53.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.860+0000 7f3bbaffd700 1 -- 172.21.15.71:0/1316542012 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 14) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f3bcc051f30 con 0x7f3bd415d240 2023-10-09T06:54:53.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.860+0000 7f3bbaffd700 1 -- 172.21.15.71:0/1316542012 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3bc00670e0 msgr2=0x7f3bc0069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:54:53.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:53.860+0000 7f3bbaffd700 1 --2- 172.21.15.71:0/1316542012 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3bc00670e0 0x7f3bc0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:53.927 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:53.927+0000 7f2fd8a49700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:54:53.927 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:53.927+0000 7f2fd8a49700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:54:53.927 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:53.927+0000 7f2fd8a49700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:54:53.928 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:53.927+0000 7f2fd8a49700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:54:53.928 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:53.927+0000 7f2fd8a49700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:54:53.929 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:53.929+0000 7f2fd5a43700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:54:53.929 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:53.929+0000 7f2fd5a43700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:54:53.929 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:53.929+0000 7f2fd5a43700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:54:53.929 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:53.929+0000 7f2fd5a43700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:54:53.929 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:54:53.929+0000 7f2fd5a43700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:54:53.948 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:53.948+0000 7f41bb39e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T06:54:54.039 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:54.039+0000 7f41bb39e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T06:54:54.131 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:54:54.132+0000 7f41bb39e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T06:54:54.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.178+0000 7f3bbaffd700 1 -- 172.21.15.71:0/1316542012 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3bcc0811a0 con 0x7f3bd415d240 2023-10-09T06:54:54.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.180+0000 7f3bb8ff9700 1 -- 172.21.15.71:0/1316542012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bd415d240 msgr2=0x7f3bd40cb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:54.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.180+0000 7f3bb8ff9700 1 --2- 172.21.15.71:0/1316542012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bd415d240 0x7f3bd40cb660 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc001460 tx=0x7f3bcc001a40 comp rx=0 tx=0).stop 2023-10-09T06:54:54.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.181+0000 7f3bb8ff9700 1 -- 172.21.15.71:0/1316542012 shutdown_connections 2023-10-09T06:54:54.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.181+0000 7f3bb8ff9700 1 --2- 172.21.15.71:0/1316542012 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3bc00670e0 0x7f3bc0069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:54.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.181+0000 7f3bb8ff9700 1 --2- 172.21.15.71:0/1316542012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bd415d240 0x7f3bd40cb660 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:54.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.181+0000 7f3bb8ff9700 1 --2- 172.21.15.71:0/1316542012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bd40b16d0 0x7f3bd40c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:54.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.181+0000 7f3bb8ff9700 1 --2- 172.21.15.71:0/1316542012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bd40b4e70 0x7f3bd414b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:54.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.181+0000 7f3bb8ff9700 1 -- 172.21.15.71:0/1316542012 >> 172.21.15.71:0/1316542012 conn(0x7f3bd40d10c0 msgr2=0x7f3bd4159210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:54.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.181+0000 7f3bb8ff9700 1 -- 172.21.15.71:0/1316542012 shutdown_connections 2023-10-09T06:54:54.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.181+0000 7f3bb8ff9700 1 -- 172.21.15.71:0/1316542012 wait complete. 2023-10-09T06:54:54.199 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T06:54:54.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.383+0000 7fe9395ff700 1 Processor -- start 2023-10-09T06:54:54.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.383+0000 7fe9395ff700 1 -- start start 2023-10-09T06:54:54.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.384+0000 7fe9395ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe9341563b0 0x7fe934156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:54.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.384+0000 7fe9395ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe93415a440 0x7fe9340acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:54.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.384+0000 7fe9395ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe934068890 0x7fe9340c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:54.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.384+0000 7fe9395ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe93415a9b0 con 0x7fe934068890 2023-10-09T06:54:54.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.384+0000 7fe9395ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe93415ac90 con 0x7fe9341563b0 2023-10-09T06:54:54.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.384+0000 7fe9395ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93415af70 con 0x7fe93415a440 2023-10-09T06:54:54.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.385+0000 7fe9337fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe934068890 0x7fe9340c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:54.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.385+0000 7fe9337fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe934068890 0x7fe9340c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56296/0 (socket says 172.21.15.71:56296) 2023-10-09T06:54:54.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.385+0000 7fe9337fe700 1 -- 172.21.15.71:0/3459612281 learned_addr learned my addr 172.21.15.71:0/3459612281 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:54.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.385+0000 7fe932ffd700 1 --2- 172.21.15.71:0/3459612281 >> v2:172.21.15.179:3300/0 conn(0x7fe9341563b0 0x7fe934156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:54.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.385+0000 7fe92bfff700 1 --2- 172.21.15.71:0/3459612281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe93415a440 0x7fe9340acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:54.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.385+0000 7fe9337fe700 1 -- 172.21.15.71:0/3459612281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe93415a440 msgr2=0x7fe9340acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:54.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.385+0000 7fe9337fe700 1 --2- 172.21.15.71:0/3459612281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe93415a440 0x7fe9340acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:54.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.385+0000 7fe9337fe700 1 -- 172.21.15.71:0/3459612281 >> v2:172.21.15.179:3300/0 conn(0x7fe9341563b0 msgr2=0x7fe934156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:54.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.385+0000 7fe9337fe700 1 --2- 172.21.15.71:0/3459612281 >> v2:172.21.15.179:3300/0 conn(0x7fe9341563b0 0x7fe934156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:54.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.385+0000 7fe9337fe700 1 -- 172.21.15.71:0/3459612281 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93415b250 con 0x7fe934068890 2023-10-09T06:54:54.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.385+0000 7fe9337fe700 1 --2- 172.21.15.71:0/3459612281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe934068890 0x7fe9340c8230 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe93406a9f0 tx=0x7fe92c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0024506e9fcf8b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:54.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.386+0000 7fe9327fc700 1 -- 172.21.15.71:0/3459612281 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c00e070 con 0x7fe934068890 2023-10-09T06:54:54.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.386+0000 7fe9327fc700 1 -- 172.21.15.71:0/3459612281 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92c00b970 con 0x7fe934068890 2023-10-09T06:54:54.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.386+0000 7fe9327fc700 1 -- 172.21.15.71:0/3459612281 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c0092e0 con 0x7fe934068890 2023-10-09T06:54:54.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.386+0000 7fe9395ff700 1 -- 172.21.15.71:0/3459612281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe934068890 msgr2=0x7fe9340c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:54.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.386+0000 7fe9395ff700 1 --2- 172.21.15.71:0/3459612281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe934068890 0x7fe9340c8230 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe93406a9f0 tx=0x7fe92c009840 comp rx=0 tx=0).stop 2023-10-09T06:54:54.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.386+0000 7fe9395ff700 1 -- 172.21.15.71:0/3459612281 shutdown_connections 2023-10-09T06:54:54.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.386+0000 7fe9395ff700 1 --2- 172.21.15.71:0/3459612281 >> v2:172.21.15.179:3300/0 conn(0x7fe9341563b0 0x7fe934156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:54.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.386+0000 7fe9395ff700 1 --2- 172.21.15.71:0/3459612281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe934068890 0x7fe9340c8230 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:54.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.386+0000 7fe9395ff700 1 --2- 172.21.15.71:0/3459612281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe93415a440 0x7fe9340acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:54.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.386+0000 7fe9395ff700 1 -- 172.21.15.71:0/3459612281 >> 172.21.15.71:0/3459612281 conn(0x7fe9340c8f90 msgr2=0x7fe9340c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:54.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.386+0000 7fe9395ff700 1 -- 172.21.15.71:0/3459612281 shutdown_connections 2023-10-09T06:54:54.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.386+0000 7fe9395ff700 1 -- 172.21.15.71:0/3459612281 wait complete. 2023-10-09T06:54:54.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.388+0000 7fe9395ff700 1 Processor -- start 2023-10-09T06:54:54.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.388+0000 7fe9395ff700 1 -- start start 2023-10-09T06:54:54.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.389+0000 7fe9395ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe934068890 0x7fe934153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:54.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.389+0000 7fe9395ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9341563b0 0x7fe934169c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:54.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.389+0000 7fe9395ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe93415a440 0x7fe9340c2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:54.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.389+0000 7fe9395ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9340cb300 con 0x7fe9341563b0 2023-10-09T06:54:54.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.389+0000 7fe9395ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9340c1430 con 0x7fe93415a440 2023-10-09T06:54:54.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.389+0000 7fe9395ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9340c2100 con 0x7fe934068890 2023-10-09T06:54:54.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.389+0000 7fe92bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9341563b0 0x7fe934169c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:54.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.389+0000 7fe92bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9341563b0 0x7fe934169c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56312/0 (socket says 172.21.15.71:56312) 2023-10-09T06:54:54.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.389+0000 7fe92bfff700 1 -- 172.21.15.71:0/2073742455 learned_addr learned my addr 172.21.15.71:0/2073742455 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:54.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.389+0000 7fe9337fe700 1 --2- 172.21.15.71:0/2073742455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe93415a440 0x7fe9340c2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:54.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.389+0000 7fe932ffd700 1 --2- 172.21.15.71:0/2073742455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe934068890 0x7fe934153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:54.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.389+0000 7fe92bfff700 1 -- 172.21.15.71:0/2073742455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe934068890 msgr2=0x7fe934153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:54.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.389+0000 7fe92bfff700 1 --2- 172.21.15.71:0/2073742455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe934068890 0x7fe934153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:54.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.389+0000 7fe92bfff700 1 -- 172.21.15.71:0/2073742455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe93415a440 msgr2=0x7fe9340c2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:54.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.389+0000 7fe92bfff700 1 --2- 172.21.15.71:0/2073742455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe93415a440 0x7fe9340c2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:54.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.389+0000 7fe92bfff700 1 -- 172.21.15.71:0/2073742455 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c009ae0 con 0x7fe9341563b0 2023-10-09T06:54:54.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.390+0000 7fe92bfff700 1 --2- 172.21.15.71:0/2073742455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9341563b0 0x7fe934169c70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00e980 tx=0x7fe91c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:54.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.390+0000 7fe92affd700 1 -- 172.21.15.71:0/2073742455 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c00c850 con 0x7fe9341563b0 2023-10-09T06:54:54.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.390+0000 7fe92affd700 1 -- 172.21.15.71:0/2073742455 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c00c9b0 con 0x7fe9341563b0 2023-10-09T06:54:54.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.390+0000 7fe92affd700 1 -- 172.21.15.71:0/2073742455 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c00cdb0 con 0x7fe9341563b0 2023-10-09T06:54:54.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.390+0000 7fe9395ff700 1 -- 172.21.15.71:0/2073742455 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe934153bb0 con 0x7fe9341563b0 2023-10-09T06:54:54.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.390+0000 7fe9395ff700 1 -- 172.21.15.71:0/2073742455 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9340c1d90 con 0x7fe9341563b0 2023-10-09T06:54:54.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.391+0000 7fe9395ff700 1 -- 172.21.15.71:0/2073742455 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe93406ebd0 con 0x7fe9341563b0 2023-10-09T06:54:54.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.392+0000 7fe92affd700 1 -- 172.21.15.71:0/2073742455 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 14) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fe91c013680 con 0x7fe9341563b0 2023-10-09T06:54:54.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.393+0000 7fe92affd700 1 -- 172.21.15.71:0/2073742455 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6714+0+0 (secure 0 0 0) 0x7fe91c0846c0 con 0x7fe9341563b0 2023-10-09T06:54:54.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.398+0000 7fe92affd700 1 -- 172.21.15.71:0/2073742455 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe91c051900 con 0x7fe9341563b0 2023-10-09T06:54:54.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.587+0000 7fe9395ff700 1 -- 172.21.15.71:0/2073742455 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe9340718b0 con 0x7fe9341563b0 2023-10-09T06:54:54.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.860+0000 7fe92affd700 1 -- 172.21.15.71:0/2073742455 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 15) v1 ==== 84578+0+0 (secure 0 0 0) 0x7fe91c0513b0 con 0x7fe9341563b0 2023-10-09T06:54:54.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.861+0000 7fe92affd700 1 --2- 172.21.15.71:0/2073742455 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe91406c980 0x7fe91406ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:54.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.861+0000 7fe932ffd700 1 --2- 172.21.15.71:0/2073742455 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe91406c980 0x7fe91406ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:54.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:54.864+0000 7fe932ffd700 1 --2- 172.21.15.71:0/2073742455 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe91406c980 0x7fe91406ed60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe92400b240 tx=0x7fe92400b430 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:55.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.181+0000 7fe92affd700 1 -- 172.21.15.71:0/2073742455 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe91c06fe50 con 0x7fe9341563b0 2023-10-09T06:54:55.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.184+0000 7fe9395ff700 1 -- 172.21.15.71:0/2073742455 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe91406c980 msgr2=0x7fe91406ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:55.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.184+0000 7fe9395ff700 1 --2- 172.21.15.71:0/2073742455 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe91406c980 0x7fe91406ed60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe92400b240 tx=0x7fe92400b430 comp rx=0 tx=0).stop 2023-10-09T06:54:55.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.184+0000 7fe9395ff700 1 -- 172.21.15.71:0/2073742455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9341563b0 msgr2=0x7fe934169c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:55.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.184+0000 7fe9395ff700 1 --2- 172.21.15.71:0/2073742455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9341563b0 0x7fe934169c70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00e980 tx=0x7fe91c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:55.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.184+0000 7fe9395ff700 1 -- 172.21.15.71:0/2073742455 shutdown_connections 2023-10-09T06:54:55.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.184+0000 7fe9395ff700 1 --2- 172.21.15.71:0/2073742455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe93415a440 0x7fe9340c2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:55.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.184+0000 7fe9395ff700 1 --2- 172.21.15.71:0/2073742455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe934068890 0x7fe934153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:55.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.184+0000 7fe9395ff700 1 --2- 172.21.15.71:0/2073742455 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe91406c980 0x7fe91406ed60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:55.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.184+0000 7fe9395ff700 1 --2- 172.21.15.71:0/2073742455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9341563b0 0x7fe934169c70 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:55.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.184+0000 7fe9395ff700 1 -- 172.21.15.71:0/2073742455 >> 172.21.15.71:0/2073742455 conn(0x7fe9340c8f90 msgr2=0x7fe9340af5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:55.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.186+0000 7fe9395ff700 1 -- 172.21.15.71:0/2073742455 shutdown_connections 2023-10-09T06:54:55.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.186+0000 7fe9395ff700 1 -- 172.21.15.71:0/2073742455 wait complete. 2023-10-09T06:54:55.187 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' removed 2023-10-09T06:54:55.205 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T06:54:55.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.396+0000 7f862919d700 1 Processor -- start 2023-10-09T06:54:55.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.397+0000 7f862919d700 1 -- start start 2023-10-09T06:54:55.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.398+0000 7f862919d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8624153480 0x7f86240ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:55.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.398+0000 7f862919d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8624153850 0x7f86241596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:55.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.398+0000 7f862919d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f862415a050 con 0x7f8624159bf0 2023-10-09T06:54:55.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.398+0000 7f862919d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86240aec90 con 0x7f8624153850 2023-10-09T06:54:55.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.398+0000 7f862919d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862415a480 con 0x7f8624153480 2023-10-09T06:54:55.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.398+0000 7f862899c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8624159bf0 0x7f86241560b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:41970/0 (socket says 172.21.15.71:41970) 2023-10-09T06:54:55.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.398+0000 7f862899c700 1 -- 172.21.15.71:0/2303197885 learned_addr learned my addr 172.21.15.71:0/2303197885 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:55.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.398+0000 7f86237fe700 1 --2- 172.21.15.71:0/2303197885 >> v2:172.21.15.179:3300/0 conn(0x7f8624153850 0x7f86241596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:55.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.398+0000 7f8623fff700 1 --2- 172.21.15.71:0/2303197885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8624153480 0x7f86240ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:55.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.399+0000 7f8622ffd700 1 -- 172.21.15.71:0/2303197885 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2829004442 0 0) 0x7f861c001490 con 0x7f8624159bf0 2023-10-09T06:54:55.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.399+0000 7f8622ffd700 1 -- 172.21.15.71:0/2303197885 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f860c003570 con 0x7f8624159bf0 2023-10-09T06:54:55.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.399+0000 7f8622ffd700 1 -- 172.21.15.71:0/2303197885 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 623001910 0 0) 0x7f860c003570 con 0x7f8624159bf0 2023-10-09T06:54:55.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.399+0000 7f8622ffd700 1 -- 172.21.15.71:0/2303197885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8624153480 msgr2=0x7f86240ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:55.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.399+0000 7f8622ffd700 1 --2- 172.21.15.71:0/2303197885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8624153480 0x7f86240ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:55.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.399+0000 7f8622ffd700 1 -- 172.21.15.71:0/2303197885 >> v2:172.21.15.179:3300/0 conn(0x7f8624153850 msgr2=0x7f86241596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:55.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.399+0000 7f8622ffd700 1 --2- 172.21.15.71:0/2303197885 >> v2:172.21.15.179:3300/0 conn(0x7f8624153850 0x7f86241596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:55.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.399+0000 7f8622ffd700 1 -- 172.21.15.71:0/2303197885 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86240afb40 con 0x7f8624159bf0 2023-10-09T06:54:55.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.399+0000 7f8622ffd700 1 -- 172.21.15.71:0/2303197885 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f861c001980 con 0x7f8624159bf0 2023-10-09T06:54:55.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.399+0000 7f8622ffd700 1 -- 172.21.15.71:0/2303197885 >> v1:172.21.15.71:6789/0 conn(0x7f8624159bf0 legacy=0x7f86241560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:55.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.399+0000 7f8622ffd700 1 --2- 172.21.15.71:0/2303197885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8624153480 0x7f860c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:55.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.399+0000 7f8622ffd700 1 --2- 172.21.15.71:0/2303197885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f860c003fe0 0x7f860c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:55.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.399+0000 7f8622ffd700 1 --2- 172.21.15.71:0/2303197885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f860c004d50 0x7f860c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:55.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.399+0000 7f8622ffd700 1 -- 172.21.15.71:0/2303197885 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86240aec90 con 0x7f860c004d50 2023-10-09T06:54:55.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.399+0000 7f8622ffd700 1 -- 172.21.15.71:0/2303197885 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862415a480 con 0x7f860c003fe0 2023-10-09T06:54:55.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.399+0000 7f8622ffd700 1 -- 172.21.15.71:0/2303197885 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c00dca0 con 0x7f8624153480 2023-10-09T06:54:55.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.399+0000 7f86237fe700 1 --2- 172.21.15.71:0/2303197885 >> v2:172.21.15.179:3300/0 conn(0x7f8624153850 0x7f86241596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:54:55.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.399+0000 7f862899c700 1 --2- 172.21.15.71:0/2303197885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f860c004d50 0x7f860c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:55.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.399+0000 7f8623fff700 1 --2- 172.21.15.71:0/2303197885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8624153480 0x7f860c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:55.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.400+0000 7f86237fe700 1 --2- 172.21.15.71:0/2303197885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f860c003fe0 0x7f860c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:55.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.400+0000 7f862899c700 1 -- 172.21.15.71:0/2303197885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8624153480 msgr2=0x7f860c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:55.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.400+0000 7f862899c700 1 --2- 172.21.15.71:0/2303197885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8624153480 0x7f860c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:55.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.400+0000 7f862899c700 1 -- 172.21.15.71:0/2303197885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f860c003fe0 msgr2=0x7f860c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:55.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.400+0000 7f862899c700 1 --2- 172.21.15.71:0/2303197885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f860c003fe0 0x7f860c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:55.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.400+0000 7f862899c700 1 -- 172.21.15.71:0/2303197885 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c003570 con 0x7f860c004d50 2023-10-09T06:54:55.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.400+0000 7f862899c700 1 --2- 172.21.15.71:0/2303197885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f860c004d50 0x7f860c0051c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f861c00ab00 tx=0x7f861c00a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff30fcb5557dc4dd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:55.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.400+0000 7f8622ffd700 1 -- 172.21.15.71:0/2303197885 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c00a490 con 0x7f860c004d50 2023-10-09T06:54:55.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.400+0000 7f8622ffd700 1 -- 172.21.15.71:0/2303197885 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861c00c570 con 0x7f860c004d50 2023-10-09T06:54:55.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.400+0000 7f8622ffd700 1 -- 172.21.15.71:0/2303197885 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c00c930 con 0x7f860c004d50 2023-10-09T06:54:55.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.401+0000 7f862919d700 1 -- 172.21.15.71:0/2303197885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f860c004d50 msgr2=0x7f860c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:55.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.401+0000 7f862919d700 1 --2- 172.21.15.71:0/2303197885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f860c004d50 0x7f860c0051c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f861c00ab00 tx=0x7f861c00a1a0 comp rx=0 tx=0).stop 2023-10-09T06:54:55.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.401+0000 7f862899c700 1 -- 172.21.15.71:0/2303197885 reap_dead start 2023-10-09T06:54:55.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.401+0000 7f862919d700 1 -- 172.21.15.71:0/2303197885 shutdown_connections 2023-10-09T06:54:55.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.401+0000 7f862919d700 1 -- 172.21.15.71:0/2303197885 >> 172.21.15.71:0/2303197885 conn(0x7f8624068e20 msgr2=0x7f86240cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:55.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.401+0000 7f862919d700 1 -- 172.21.15.71:0/2303197885 shutdown_connections 2023-10-09T06:54:55.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.401+0000 7f862919d700 1 -- 172.21.15.71:0/2303197885 wait complete. 2023-10-09T06:54:55.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.402+0000 7f862919d700 1 Processor -- start 2023-10-09T06:54:55.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.402+0000 7f862919d700 1 -- start start 2023-10-09T06:54:55.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.403+0000 7f862919d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f860c004d50 0x7f8624152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:55.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.403+0000 7f862919d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8624155d90 0x7f862415bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:55.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.403+0000 7f862919d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86240ca1c0 0x7f86240ca640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:55.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.403+0000 7f862919d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86240cab80 con 0x7f860c004d50 2023-10-09T06:54:55.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.403+0000 7f862919d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8624156200 con 0x7f8624155d90 2023-10-09T06:54:55.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.403+0000 7f862919d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86241564a0 con 0x7f86240ca1c0 2023-10-09T06:54:55.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.403+0000 7f8623fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f860c004d50 0x7f8624152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:55.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.404+0000 7f8623fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f860c004d50 0x7f8624152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38248/0 (socket says 172.21.15.71:38248) 2023-10-09T06:54:55.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.404+0000 7f8623fff700 1 -- 172.21.15.71:0/1519405077 learned_addr learned my addr 172.21.15.71:0/1519405077 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:55.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.404+0000 7f8623fff700 1 -- 172.21.15.71:0/1519405077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86240ca1c0 msgr2=0x7f86240ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:55.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.404+0000 7f8623fff700 1 --2- 172.21.15.71:0/1519405077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86240ca1c0 0x7f86240ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:55.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.404+0000 7f8623fff700 1 -- 172.21.15.71:0/1519405077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8624155d90 msgr2=0x7f862415bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:55.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.404+0000 7f86237fe700 1 --2- 172.21.15.71:0/1519405077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8624155d90 0x7f862415bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:55.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.404+0000 7f8623fff700 1 --2- 172.21.15.71:0/1519405077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8624155d90 0x7f862415bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:55.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.404+0000 7f8623fff700 1 -- 172.21.15.71:0/1519405077 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8624156780 con 0x7f860c004d50 2023-10-09T06:54:55.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.404+0000 7f86237fe700 1 --2- 172.21.15.71:0/1519405077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8624155d90 0x7f862415bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:54:55.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.404+0000 7f8623fff700 1 --2- 172.21.15.71:0/1519405077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f860c004d50 0x7f8624152070 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8614006ac0 tx=0x7f86140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:55.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.404+0000 7f860bfff700 1 -- 172.21.15.71:0/1519405077 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861400fa10 con 0x7f860c004d50 2023-10-09T06:54:55.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.404+0000 7f860bfff700 1 -- 172.21.15.71:0/1519405077 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861400fb70 con 0x7f860c004d50 2023-10-09T06:54:55.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.404+0000 7f860bfff700 1 -- 172.21.15.71:0/1519405077 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8614014440 con 0x7f860c004d50 2023-10-09T06:54:55.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.404+0000 7f862919d700 1 -- 172.21.15.71:0/1519405077 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8624156a60 con 0x7f860c004d50 2023-10-09T06:54:55.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.405+0000 7f862919d700 1 -- 172.21.15.71:0/1519405077 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f862415c050 con 0x7f860c004d50 2023-10-09T06:54:55.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.406+0000 7f862919d700 1 -- 172.21.15.71:0/1519405077 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f862404c3c0 con 0x7f860c004d50 2023-10-09T06:54:55.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.406+0000 7f860bfff700 1 -- 172.21.15.71:0/1519405077 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 15) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f8614014830 con 0x7f860c004d50 2023-10-09T06:54:55.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.407+0000 7f860bfff700 1 --2- 172.21.15.71:0/1519405077 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8610066d80 0x7f8610069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:55.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.407+0000 7f860bfff700 1 -- 172.21.15.71:0/1519405077 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6276+0+0 (secure 0 0 0) 0x7f8614018030 con 0x7f860c004d50 2023-10-09T06:54:55.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.408+0000 7f86237fe700 1 --2- 172.21.15.71:0/1519405077 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8610066d80 0x7f8610069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:55.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.408+0000 7f86237fe700 1 --2- 172.21.15.71:0/1519405077 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8610066d80 0x7f8610069230 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8618006f00 tx=0x7f8618008040 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:55.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.412+0000 7f860bfff700 1 -- 172.21.15.71:0/1519405077 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86140521a0 con 0x7f860c004d50 2023-10-09T06:54:55.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:55.603+0000 7f862919d700 1 -- 172.21.15.71:0/1519405077 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f86240afe20 con 0x7f860c004d50 2023-10-09T06:54:56.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.186+0000 7f860bfff700 1 -- 172.21.15.71:0/1519405077 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8614052570 con 0x7f860c004d50 2023-10-09T06:54:56.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.194+0000 7f860bfff700 1 -- 172.21.15.71:0/1519405077 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) v1 ==== 169+0+0 (secure 0 0 0) 0x7f86140519b0 con 0x7f860c004d50 2023-10-09T06:54:56.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.197+0000 7f862919d700 1 -- 172.21.15.71:0/1519405077 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8610066d80 msgr2=0x7f8610069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:56.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.197+0000 7f862919d700 1 --2- 172.21.15.71:0/1519405077 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8610066d80 0x7f8610069230 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8618006f00 tx=0x7f8618008040 comp rx=0 tx=0).stop 2023-10-09T06:54:56.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.197+0000 7f862919d700 1 -- 172.21.15.71:0/1519405077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f860c004d50 msgr2=0x7f8624152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:56.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.197+0000 7f862919d700 1 --2- 172.21.15.71:0/1519405077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f860c004d50 0x7f8624152070 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8614006ac0 tx=0x7f86140091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:56.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.198+0000 7f862919d700 1 -- 172.21.15.71:0/1519405077 shutdown_connections 2023-10-09T06:54:56.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.198+0000 7f862919d700 1 --2- 172.21.15.71:0/1519405077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86240ca1c0 0x7f86240ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:56.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.198+0000 7f862919d700 1 --2- 172.21.15.71:0/1519405077 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8610066d80 0x7f8610069230 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:56.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.198+0000 7f862919d700 1 --2- 172.21.15.71:0/1519405077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f860c004d50 0x7f8624152070 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:56.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.198+0000 7f862919d700 1 --2- 172.21.15.71:0/1519405077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8624155d90 0x7f862415bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:56.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.198+0000 7f862919d700 1 -- 172.21.15.71:0/1519405077 >> 172.21.15.71:0/1519405077 conn(0x7f8624068e20 msgr2=0x7f862406e370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:56.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.198+0000 7f862919d700 1 -- 172.21.15.71:0/1519405077 shutdown_connections 2023-10-09T06:54:56.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.198+0000 7f862919d700 1 -- 172.21.15.71:0/1519405077 wait complete. 2023-10-09T06:54:56.199 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' removed 2023-10-09T06:54:56.217 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T06:54:56.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.401+0000 7fa41ef9d700 1 Processor -- start 2023-10-09T06:54:56.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.401+0000 7fa41ef9d700 1 -- start start 2023-10-09T06:54:56.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.402+0000 7fa41ef9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa4180b16d0 0x7fa4180b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:56.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.402+0000 7fa41ef9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4180b2080 con 0x7fa4180b4e70 2023-10-09T06:54:56.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.402+0000 7fa41ef9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4180cfb00 con 0x7fa4180b33b0 2023-10-09T06:54:56.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.402+0000 7fa41ef9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4180b5c40 con 0x7fa4180b16d0 2023-10-09T06:54:56.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.402+0000 7fa41d79a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa4180b16d0 0x7fa4180b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:56.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.403+0000 7fa41d79a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa4180b16d0 0x7fa4180b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38252/0 (socket says 172.21.15.71:38252) 2023-10-09T06:54:56.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.403+0000 7fa41d79a700 1 -- 172.21.15.71:0/279392978 learned_addr learned my addr 172.21.15.71:0/279392978 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:56.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.403+0000 7fa41d79a700 1 -- 172.21.15.71:0/279392978 >> v1:172.21.15.179:6789/0 conn(0x7fa4180b33b0 legacy=0x7fa4180b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:56.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.403+0000 7fa41d79a700 1 -- 172.21.15.71:0/279392978 >> v1:172.21.15.71:6789/0 conn(0x7fa4180b4e70 legacy=0x7fa4180ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:56.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.403+0000 7fa41d79a700 1 -- 172.21.15.71:0/279392978 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4180b5f20 con 0x7fa4180b16d0 2023-10-09T06:54:56.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.403+0000 7fa41d79a700 1 --2- 172.21.15.71:0/279392978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4180b16d0 0x7fa4180b1b40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa4080099b0 tx=0x7fa408009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=624986ba0933ccd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:56.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.403+0000 7fa41cf99700 1 -- 172.21.15.71:0/279392978 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40800b860 con 0x7fa4180b16d0 2023-10-09T06:54:56.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.403+0000 7fa41cf99700 1 -- 172.21.15.71:0/279392978 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40800b9c0 con 0x7fa4180b16d0 2023-10-09T06:54:56.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.403+0000 7fa41cf99700 1 -- 172.21.15.71:0/279392978 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40800bd80 con 0x7fa4180b16d0 2023-10-09T06:54:56.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.404+0000 7fa41ef9d700 1 -- 172.21.15.71:0/279392978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4180b16d0 msgr2=0x7fa4180b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:56.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.404+0000 7fa41ef9d700 1 --2- 172.21.15.71:0/279392978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4180b16d0 0x7fa4180b1b40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa4080099b0 tx=0x7fa408009250 comp rx=0 tx=0).stop 2023-10-09T06:54:56.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.404+0000 7fa41ef9d700 1 -- 172.21.15.71:0/279392978 shutdown_connections 2023-10-09T06:54:56.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.404+0000 7fa41ef9d700 1 --2- 172.21.15.71:0/279392978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4180b16d0 0x7fa4180b1b40 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:56.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.404+0000 7fa41ef9d700 1 -- 172.21.15.71:0/279392978 >> 172.21.15.71:0/279392978 conn(0x7fa4180d10c0 msgr2=0x7fa4180affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:56.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.404+0000 7fa41ef9d700 1 -- 172.21.15.71:0/279392978 shutdown_connections 2023-10-09T06:54:56.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.404+0000 7fa41ef9d700 1 -- 172.21.15.71:0/279392978 wait complete. 2023-10-09T06:54:56.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.405+0000 7fa41ef9d700 1 Processor -- start 2023-10-09T06:54:56.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.406+0000 7fa41ef9d700 1 -- start start 2023-10-09T06:54:56.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.406+0000 7fa41ef9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4180b16d0 0x7fa41815ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:56.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.406+0000 7fa41ef9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4180b33b0 0x7fa418160600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:56.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.407+0000 7fa41ef9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4180b4e70 0x7fa4181699d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:56.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.407+0000 7fa41ef9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4180cc340 con 0x7fa4180b4e70 2023-10-09T06:54:56.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.407+0000 7fa41ef9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41815bf80 con 0x7fa4180b16d0 2023-10-09T06:54:56.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.407+0000 7fa41ef9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41815c4a0 con 0x7fa4180b33b0 2023-10-09T06:54:56.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.407+0000 7fa41e79c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4180b4e70 0x7fa4181699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:56.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.407+0000 7fa41e79c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4180b4e70 0x7fa4181699d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38266/0 (socket says 172.21.15.71:38266) 2023-10-09T06:54:56.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.407+0000 7fa41e79c700 1 -- 172.21.15.71:0/3445995303 learned_addr learned my addr 172.21.15.71:0/3445995303 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:56.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.407+0000 7fa41df9b700 1 --2- 172.21.15.71:0/3445995303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4180b16d0 0x7fa41815ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:56.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.407+0000 7fa41d79a700 1 --2- 172.21.15.71:0/3445995303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4180b33b0 0x7fa418160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:56.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.407+0000 7fa41e79c700 1 -- 172.21.15.71:0/3445995303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4180b33b0 msgr2=0x7fa418160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:56.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.407+0000 7fa41e79c700 1 --2- 172.21.15.71:0/3445995303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4180b33b0 0x7fa418160600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:56.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.407+0000 7fa41e79c700 1 -- 172.21.15.71:0/3445995303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4180b16d0 msgr2=0x7fa41815ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:56.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.407+0000 7fa41e79c700 1 --2- 172.21.15.71:0/3445995303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4180b16d0 0x7fa41815ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:56.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.407+0000 7fa41e79c700 1 -- 172.21.15.71:0/3445995303 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4080094f0 con 0x7fa4180b4e70 2023-10-09T06:54:56.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.407+0000 7fa41df9b700 1 --2- 172.21.15.71:0/3445995303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4180b16d0 0x7fa41815ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:54:56.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.407+0000 7fa41d79a700 1 --2- 172.21.15.71:0/3445995303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4180b33b0 0x7fa418160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:54:56.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.407+0000 7fa41e79c700 1 --2- 172.21.15.71:0/3445995303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4180b4e70 0x7fa4181699d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa41000c8e0 tx=0x7fa410001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:56.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.408+0000 7fa40dffb700 1 -- 172.21.15.71:0/3445995303 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41000ce80 con 0x7fa4180b4e70 2023-10-09T06:54:56.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.408+0000 7fa40dffb700 1 -- 172.21.15.71:0/3445995303 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41000a7e0 con 0x7fa4180b4e70 2023-10-09T06:54:56.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.408+0000 7fa41ef9d700 1 -- 172.21.15.71:0/3445995303 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa41815c780 con 0x7fa4180b4e70 2023-10-09T06:54:56.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.408+0000 7fa40dffb700 1 -- 172.21.15.71:0/3445995303 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41000ab80 con 0x7fa4180b4e70 2023-10-09T06:54:56.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.408+0000 7fa41ef9d700 1 -- 172.21.15.71:0/3445995303 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41815cd40 con 0x7fa4180b4e70 2023-10-09T06:54:56.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.409+0000 7fa41ef9d700 1 -- 172.21.15.71:0/3445995303 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa418088990 con 0x7fa4180b4e70 2023-10-09T06:54:56.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.410+0000 7fa40dffb700 1 -- 172.21.15.71:0/3445995303 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa410012420 con 0x7fa4180b4e70 2023-10-09T06:54:56.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.410+0000 7fa40dffb700 1 --2- 172.21.15.71:0/3445995303 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa3fc066f30 0x7fa3fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:56.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.411+0000 7fa40dffb700 1 -- 172.21.15.71:0/3445995303 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5862+0+0 (secure 0 0 0) 0x7fa4100848c0 con 0x7fa4180b4e70 2023-10-09T06:54:56.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.411+0000 7fa41df9b700 1 --2- 172.21.15.71:0/3445995303 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa3fc066f30 0x7fa3fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:56.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.412+0000 7fa41df9b700 1 --2- 172.21.15.71:0/3445995303 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa3fc066f30 0x7fa3fc0693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa4140017a0 tx=0x7fa414009040 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:56.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.414+0000 7fa40dffb700 1 -- 172.21.15.71:0/3445995303 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa410051a90 con 0x7fa4180b4e70 2023-10-09T06:54:56.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.605+0000 7fa41ef9d700 1 -- 172.21.15.71:0/3445995303 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa41804bb80 con 0x7fa4180b4e70 2023-10-09T06:54:56.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.610+0000 7fa40dffb700 1 -- 172.21.15.71:0/3445995303 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa4100550b0 con 0x7fa4180b4e70 2023-10-09T06:54:56.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.612+0000 7fa41ef9d700 1 -- 172.21.15.71:0/3445995303 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa3fc066f30 msgr2=0x7fa3fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:56.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.612+0000 7fa41ef9d700 1 --2- 172.21.15.71:0/3445995303 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa3fc066f30 0x7fa3fc0693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa4140017a0 tx=0x7fa414009040 comp rx=0 tx=0).stop 2023-10-09T06:54:56.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.612+0000 7fa41ef9d700 1 -- 172.21.15.71:0/3445995303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4180b4e70 msgr2=0x7fa4181699d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:56.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.612+0000 7fa41ef9d700 1 --2- 172.21.15.71:0/3445995303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4180b4e70 0x7fa4181699d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa41000c8e0 tx=0x7fa410001710 comp rx=0 tx=0).stop 2023-10-09T06:54:56.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.612+0000 7fa41ef9d700 1 -- 172.21.15.71:0/3445995303 shutdown_connections 2023-10-09T06:54:56.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.612+0000 7fa41ef9d700 1 --2- 172.21.15.71:0/3445995303 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa3fc066f30 0x7fa3fc0693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:56.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.612+0000 7fa41ef9d700 1 --2- 172.21.15.71:0/3445995303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4180b4e70 0x7fa4181699d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:56.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.612+0000 7fa41ef9d700 1 --2- 172.21.15.71:0/3445995303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4180b16d0 0x7fa41815ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:56.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.612+0000 7fa41ef9d700 1 --2- 172.21.15.71:0/3445995303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4180b33b0 0x7fa418160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:56.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.612+0000 7fa41ef9d700 1 -- 172.21.15.71:0/3445995303 >> 172.21.15.71:0/3445995303 conn(0x7fa4180d10c0 msgr2=0x7fa4180c5770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:56.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.612+0000 7fa41ef9d700 1 -- 172.21.15.71:0/3445995303 shutdown_connections 2023-10-09T06:54:56.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.613+0000 7fa41ef9d700 1 -- 172.21.15.71:0/3445995303 wait complete. 2023-10-09T06:54:56.630 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-09T06:54:56.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.813+0000 7f82ff5ff700 1 Processor -- start 2023-10-09T06:54:56.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.814+0000 7f82ff5ff700 1 -- start start 2023-10-09T06:54:56.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.815+0000 7f82ff5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f82f8069d90 0x7f82f81596d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:56.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.815+0000 7f82ff5ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f815a090 con 0x7f82f8159c10 2023-10-09T06:54:56.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.815+0000 7f82ff5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f806de10 con 0x7f82f80699c0 2023-10-09T06:54:56.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.815+0000 7f82ff5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f806e0f0 con 0x7f82f8069d90 2023-10-09T06:54:56.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.815+0000 7f82fdb9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f82f8159c10 0x7f82f80ca100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:41978/0 (socket says 172.21.15.71:41978) 2023-10-09T06:54:56.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.815+0000 7f82fdb9c700 1 -- 172.21.15.71:0/1267212273 learned_addr learned my addr 172.21.15.71:0/1267212273 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:56.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.815+0000 7f82fcb9a700 1 --2- 172.21.15.71:0/1267212273 >> v2:172.21.15.179:3300/0 conn(0x7f82f8069d90 0x7f82f81596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:56.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.815+0000 7f82effff700 1 -- 172.21.15.71:0/1267212273 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365038279 0 0) 0x7f82f815a090 con 0x7f82f8159c10 2023-10-09T06:54:56.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.815+0000 7f82effff700 1 -- 172.21.15.71:0/1267212273 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82e4003570 con 0x7f82f8159c10 2023-10-09T06:54:56.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.816+0000 7f82effff700 1 -- 172.21.15.71:0/1267212273 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3510050990 0 0) 0x7f82f806de10 con 0x7f82f80699c0 2023-10-09T06:54:56.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.816+0000 7f82effff700 1 -- 172.21.15.71:0/1267212273 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82f815a090 con 0x7f82f80699c0 2023-10-09T06:54:56.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.816+0000 7f82effff700 1 -- 172.21.15.71:0/1267212273 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3165176353 0 0) 0x7f82e4003570 con 0x7f82f8159c10 2023-10-09T06:54:56.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.816+0000 7f82effff700 1 -- 172.21.15.71:0/1267212273 >> v2:172.21.15.179:3300/0 conn(0x7f82f8069d90 msgr2=0x7f82f81596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:56.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.816+0000 7f82effff700 1 --2- 172.21.15.71:0/1267212273 >> v2:172.21.15.179:3300/0 conn(0x7f82f8069d90 0x7f82f81596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:56.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.816+0000 7f82effff700 1 -- 172.21.15.71:0/1267212273 >> v1:172.21.15.179:6789/0 conn(0x7f82f80699c0 legacy=0x7f82f806f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:56.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.816+0000 7f82effff700 1 -- 172.21.15.71:0/1267212273 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f806e3d0 con 0x7f82f8159c10 2023-10-09T06:54:56.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.816+0000 7f82effff700 1 -- 172.21.15.71:0/1267212273 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f82f00017f0 con 0x7f82f8159c10 2023-10-09T06:54:56.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.816+0000 7f82effff700 1 -- 172.21.15.71:0/1267212273 >> v1:172.21.15.71:6789/0 conn(0x7f82f8159c10 legacy=0x7f82f80ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:56.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.816+0000 7f82effff700 1 --2- 172.21.15.71:0/1267212273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82e4003c40 0x7f82e4004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:56.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.816+0000 7f82effff700 1 --2- 172.21.15.71:0/1267212273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82e4004810 0x7f82e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:56.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.816+0000 7f82effff700 1 --2- 172.21.15.71:0/1267212273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82e4005210 0x7f82e400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:56.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.816+0000 7f82effff700 1 -- 172.21.15.71:0/1267212273 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f806e0f0 con 0x7f82e4004810 2023-10-09T06:54:56.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.816+0000 7f82effff700 1 -- 172.21.15.71:0/1267212273 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e400c130 con 0x7f82e4005210 2023-10-09T06:54:56.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.816+0000 7f82effff700 1 -- 172.21.15.71:0/1267212273 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e400c2c0 con 0x7f82e4003c40 2023-10-09T06:54:56.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.816+0000 7f82fdb9c700 1 --2- 172.21.15.71:0/1267212273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82e4005210 0x7f82e400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:56.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.816+0000 7f82fd39b700 1 --2- 172.21.15.71:0/1267212273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82e4003c40 0x7f82e4004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:56.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.816+0000 7f82fcb9a700 1 --2- 172.21.15.71:0/1267212273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82e4004810 0x7f82e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:56.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.817+0000 7f82fcb9a700 1 -- 172.21.15.71:0/1267212273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82e4003c40 msgr2=0x7f82e4004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:56.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.817+0000 7f82fcb9a700 1 --2- 172.21.15.71:0/1267212273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82e4003c40 0x7f82e4004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:56.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.817+0000 7f82fcb9a700 1 -- 172.21.15.71:0/1267212273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82e4005210 msgr2=0x7f82e400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:56.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.817+0000 7f82fcb9a700 1 --2- 172.21.15.71:0/1267212273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82e4005210 0x7f82e400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:56.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.817+0000 7f82fcb9a700 1 -- 172.21.15.71:0/1267212273 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e4003570 con 0x7f82e4004810 2023-10-09T06:54:56.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.817+0000 7f82fdb9c700 1 --2- 172.21.15.71:0/1267212273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82e4005210 0x7f82e400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:54:56.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.817+0000 7f82fdb9c700 1 -- 172.21.15.71:0/1267212273 reap_dead start 2023-10-09T06:54:56.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.817+0000 7f82fcb9a700 1 --2- 172.21.15.71:0/1267212273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82e4004810 0x7f82e4004c80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009c30 tx=0x7f82e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6564a79050d8cfdf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:56.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.817+0000 7f82effff700 1 -- 172.21.15.71:0/1267212273 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e80095b0 con 0x7f82e4004810 2023-10-09T06:54:56.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.817+0000 7f82effff700 1 -- 172.21.15.71:0/1267212273 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e800e710 con 0x7f82e4004810 2023-10-09T06:54:56.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.817+0000 7f82effff700 1 -- 172.21.15.71:0/1267212273 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e800ead0 con 0x7f82e4004810 2023-10-09T06:54:56.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.818+0000 7f82ff5ff700 1 -- 172.21.15.71:0/1267212273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82e4004810 msgr2=0x7f82e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:56.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.818+0000 7f82ff5ff700 1 --2- 172.21.15.71:0/1267212273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82e4004810 0x7f82e4004c80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009c30 tx=0x7f82e80091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:56.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.818+0000 7f82ff5ff700 1 -- 172.21.15.71:0/1267212273 shutdown_connections 2023-10-09T06:54:56.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.818+0000 7f82ff5ff700 1 --2- 172.21.15.71:0/1267212273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82e4004810 0x7f82e4004c80 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:56.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.818+0000 7f82ff5ff700 1 -- 172.21.15.71:0/1267212273 >> 172.21.15.71:0/1267212273 conn(0x7f82f8068e10 msgr2=0x7f82f80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:56.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.818+0000 7f82ff5ff700 1 -- 172.21.15.71:0/1267212273 shutdown_connections 2023-10-09T06:54:56.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.818+0000 7f82ff5ff700 1 -- 172.21.15.71:0/1267212273 wait complete. 2023-10-09T06:54:56.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.819+0000 7f82ff5ff700 1 Processor -- start 2023-10-09T06:54:56.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.819+0000 7f82ff5ff700 1 -- start start 2023-10-09T06:54:56.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.820+0000 7f82ff5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82e4004810 0x7f82f8157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:56.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.820+0000 7f82ff5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82f80af2d0 0x7f82f814d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:56.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.820+0000 7f82ff5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82f80c2450 0x7f82f80c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:56.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.820+0000 7f82ff5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f814d6a0 con 0x7f82e4004810 2023-10-09T06:54:56.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.820+0000 7f82ff5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f81573d0 con 0x7f82f80af2d0 2023-10-09T06:54:56.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.820+0000 7f82ff5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f80c2e00 con 0x7f82f80c2450 2023-10-09T06:54:56.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.820+0000 7f82fd39b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82e4004810 0x7f82f8157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:56.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.821+0000 7f82fd39b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82e4004810 0x7f82f8157f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38288/0 (socket says 172.21.15.71:38288) 2023-10-09T06:54:56.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.821+0000 7f82fd39b700 1 -- 172.21.15.71:0/635727050 learned_addr learned my addr 172.21.15.71:0/635727050 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:56.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.821+0000 7f82fcb9a700 1 --2- 172.21.15.71:0/635727050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82f80af2d0 0x7f82f814d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:56.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.821+0000 7f82fdb9c700 1 --2- 172.21.15.71:0/635727050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82f80c2450 0x7f82f80c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:56.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.821+0000 7f82fd39b700 1 -- 172.21.15.71:0/635727050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82f80c2450 msgr2=0x7f82f80c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:56.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.821+0000 7f82fd39b700 1 --2- 172.21.15.71:0/635727050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82f80c2450 0x7f82f80c28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:56.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.821+0000 7f82fd39b700 1 -- 172.21.15.71:0/635727050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82f80af2d0 msgr2=0x7f82f814d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:56.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.821+0000 7f82fd39b700 1 --2- 172.21.15.71:0/635727050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82f80af2d0 0x7f82f814d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:56.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.821+0000 7f82fd39b700 1 -- 172.21.15.71:0/635727050 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f80b05e0 con 0x7f82e4004810 2023-10-09T06:54:56.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.821+0000 7f82fd39b700 1 --2- 172.21.15.71:0/635727050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82e4004810 0x7f82f8157f80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f82f4002ab0 tx=0x7f82f4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:56.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.821+0000 7f82ed7fa700 1 -- 172.21.15.71:0/635727050 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f400f9a0 con 0x7f82e4004810 2023-10-09T06:54:56.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.821+0000 7f82ed7fa700 1 -- 172.21.15.71:0/635727050 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f400fb00 con 0x7f82e4004810 2023-10-09T06:54:56.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.821+0000 7f82ff5ff700 1 -- 172.21.15.71:0/635727050 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f80af740 con 0x7f82e4004810 2023-10-09T06:54:56.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.821+0000 7f82ed7fa700 1 -- 172.21.15.71:0/635727050 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f400fec0 con 0x7f82e4004810 2023-10-09T06:54:56.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.822+0000 7f82ff5ff700 1 -- 172.21.15.71:0/635727050 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f80afcb0 con 0x7f82e4004810 2023-10-09T06:54:56.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.823+0000 7f82ff5ff700 1 -- 172.21.15.71:0/635727050 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f804c3c0 con 0x7f82e4004810 2023-10-09T06:54:56.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.823+0000 7f82ed7fa700 1 -- 172.21.15.71:0/635727050 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82f4013600 con 0x7f82e4004810 2023-10-09T06:54:56.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.824+0000 7f82ed7fa700 1 --2- 172.21.15.71:0/635727050 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f82dc066f30 0x7f82dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:56.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.825+0000 7f82ed7fa700 1 -- 172.21.15.71:0/635727050 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5862+0+0 (secure 0 0 0) 0x7f82f4084c90 con 0x7f82e4004810 2023-10-09T06:54:56.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.825+0000 7f82fcb9a700 1 --2- 172.21.15.71:0/635727050 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f82dc066f30 0x7f82dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:56.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.826+0000 7f82fcb9a700 1 --2- 172.21.15.71:0/635727050 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f82dc066f30 0x7f82dc0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f82e80091e0 tx=0x7f82e801a000 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:56.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:56.829+0000 7f82ed7fa700 1 -- 172.21.15.71:0/635727050 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82f4051e60 con 0x7f82e4004810 2023-10-09T06:54:57.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.020+0000 7f82ff5ff700 1 -- 172.21.15.71:0/635727050 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f82f806e6b0 con 0x7f82e4004810 2023-10-09T06:54:57.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.025+0000 7f82ed7fa700 1 -- 172.21.15.71:0/635727050 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v14) v1 ==== 115+0+0 (secure 0 0 0) 0x7f82f40170b0 con 0x7f82e4004810 2023-10-09T06:54:57.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.027+0000 7f82ff5ff700 1 -- 172.21.15.71:0/635727050 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f82dc066f30 msgr2=0x7f82dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:57.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.027+0000 7f82ff5ff700 1 --2- 172.21.15.71:0/635727050 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f82dc066f30 0x7f82dc0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f82e80091e0 tx=0x7f82e801a000 comp rx=0 tx=0).stop 2023-10-09T06:54:57.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.027+0000 7f82ff5ff700 1 -- 172.21.15.71:0/635727050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82e4004810 msgr2=0x7f82f8157f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:57.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.027+0000 7f82ff5ff700 1 --2- 172.21.15.71:0/635727050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82e4004810 0x7f82f8157f80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f82f4002ab0 tx=0x7f82f4007d30 comp rx=0 tx=0).stop 2023-10-09T06:54:57.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.027+0000 7f82ff5ff700 1 -- 172.21.15.71:0/635727050 shutdown_connections 2023-10-09T06:54:57.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.027+0000 7f82ff5ff700 1 --2- 172.21.15.71:0/635727050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82f80c2450 0x7f82f80c28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:57.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.027+0000 7f82ff5ff700 1 --2- 172.21.15.71:0/635727050 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f82dc066f30 0x7f82dc0693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:57.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.027+0000 7f82ff5ff700 1 --2- 172.21.15.71:0/635727050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82e4004810 0x7f82f8157f80 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:57.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.027+0000 7f82ff5ff700 1 --2- 172.21.15.71:0/635727050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82f80af2d0 0x7f82f814d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:57.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.027+0000 7f82ff5ff700 1 -- 172.21.15.71:0/635727050 >> 172.21.15.71:0/635727050 conn(0x7f82f8068e10 msgr2=0x7f82f80ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:57.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.027+0000 7f82ff5ff700 1 -- 172.21.15.71:0/635727050 shutdown_connections 2023-10-09T06:54:57.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.027+0000 7f82ff5ff700 1 -- 172.21.15.71:0/635727050 wait complete. 2023-10-09T06:54:57.044 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-09T06:54:57.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.231+0000 7fab7299d700 1 Processor -- start 2023-10-09T06:54:57.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.231+0000 7fab7299d700 1 -- start start 2023-10-09T06:54:57.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.232+0000 7fab7299d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab6c06a710 0x7fab6c160e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:57.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.232+0000 7fab7299d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6c06e150 con 0x7fab6c153900 2023-10-09T06:54:57.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.232+0000 7fab7299d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6c0c7800 con 0x7fab6c0c9db0 2023-10-09T06:54:57.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.232+0000 7fab7299d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0c7610 con 0x7fab6c06a710 2023-10-09T06:54:57.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.232+0000 7fab7199b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fab6c153900 0x7fab6c0c6f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:41992/0 (socket says 172.21.15.71:41992) 2023-10-09T06:54:57.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.232+0000 7fab7199b700 1 -- 172.21.15.71:0/1863286756 learned_addr learned my addr 172.21.15.71:0/1863286756 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:57.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.233+0000 7fab7219c700 1 --2- 172.21.15.71:0/1863286756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab6c06a710 0x7fab6c160e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:57.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.233+0000 7fab70999700 1 -- 172.21.15.71:0/1863286756 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377403922 0 0) 0x7fab6c06e150 con 0x7fab6c153900 2023-10-09T06:54:57.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.233+0000 7fab70999700 1 -- 172.21.15.71:0/1863286756 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab58003570 con 0x7fab6c153900 2023-10-09T06:54:57.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.233+0000 7fab70999700 1 -- 172.21.15.71:0/1863286756 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1044306388 0 0) 0x7fab58003570 con 0x7fab6c153900 2023-10-09T06:54:57.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.233+0000 7fab70999700 1 -- 172.21.15.71:0/1863286756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab6c06a710 msgr2=0x7fab6c160e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:57.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.233+0000 7fab70999700 1 --2- 172.21.15.71:0/1863286756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab6c06a710 0x7fab6c160e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:57.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.233+0000 7fab70999700 1 -- 172.21.15.71:0/1863286756 >> v1:172.21.15.179:6789/0 conn(0x7fab6c0c9db0 legacy=0x7fab6c06a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:57.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.233+0000 7fab70999700 1 -- 172.21.15.71:0/1863286756 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c0c7ae0 con 0x7fab6c153900 2023-10-09T06:54:57.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.233+0000 7fab70999700 1 -- 172.21.15.71:0/1863286756 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fab68001470 con 0x7fab6c153900 2023-10-09T06:54:57.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.233+0000 7fab70999700 1 -- 172.21.15.71:0/1863286756 >> v1:172.21.15.71:6789/0 conn(0x7fab6c153900 legacy=0x7fab6c0c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:57.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.233+0000 7fab70999700 1 --2- 172.21.15.71:0/1863286756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab58003a90 0x7fab58003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:57.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.233+0000 7fab70999700 1 --2- 172.21.15.71:0/1863286756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab6c06a710 0x7fab58004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:57.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.233+0000 7fab70999700 1 --2- 172.21.15.71:0/1863286756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab58004d50 0x7fab580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:57.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.233+0000 7fab70999700 1 -- 172.21.15.71:0/1863286756 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5800bbf0 con 0x7fab58003a90 2023-10-09T06:54:57.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.233+0000 7fab70999700 1 -- 172.21.15.71:0/1863286756 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5800bd30 con 0x7fab58004d50 2023-10-09T06:54:57.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.233+0000 7fab70999700 1 -- 172.21.15.71:0/1863286756 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5800e0d0 con 0x7fab6c06a710 2023-10-09T06:54:57.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.233+0000 7fab7199b700 1 --2- 172.21.15.71:0/1863286756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab58003a90 0x7fab58003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:57.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.234+0000 7fab7219c700 1 --2- 172.21.15.71:0/1863286756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab58004d50 0x7fab580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:57.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.234+0000 7fab7119a700 1 --2- 172.21.15.71:0/1863286756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab6c06a710 0x7fab58004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:57.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.234+0000 7fab7199b700 1 -- 172.21.15.71:0/1863286756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab6c06a710 msgr2=0x7fab58004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:57.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.234+0000 7fab7199b700 1 --2- 172.21.15.71:0/1863286756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab6c06a710 0x7fab58004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:57.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.234+0000 7fab7199b700 1 -- 172.21.15.71:0/1863286756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab58004d50 msgr2=0x7fab580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:57.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.234+0000 7fab7199b700 1 --2- 172.21.15.71:0/1863286756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab58004d50 0x7fab580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:57.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.234+0000 7fab7199b700 1 -- 172.21.15.71:0/1863286756 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab58003570 con 0x7fab58003a90 2023-10-09T06:54:57.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.234+0000 7fab7199b700 1 --2- 172.21.15.71:0/1863286756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab58003a90 0x7fab58003ea0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fab6800c2d0 tx=0x7fab68001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac8cd7e9f35de70 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:57.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.234+0000 7fab70999700 1 -- 172.21.15.71:0/1863286756 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6800cba0 con 0x7fab58003a90 2023-10-09T06:54:57.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.234+0000 7fab70999700 1 -- 172.21.15.71:0/1863286756 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6800cd00 con 0x7fab58003a90 2023-10-09T06:54:57.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.234+0000 7fab70999700 1 -- 172.21.15.71:0/1863286756 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab68005b50 con 0x7fab58003a90 2023-10-09T06:54:57.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.235+0000 7fab7299d700 1 -- 172.21.15.71:0/1863286756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab58003a90 msgr2=0x7fab58003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:57.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.235+0000 7fab7299d700 1 --2- 172.21.15.71:0/1863286756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab58003a90 0x7fab58003ea0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fab6800c2d0 tx=0x7fab68001da0 comp rx=0 tx=0).stop 2023-10-09T06:54:57.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.235+0000 7fab7219c700 1 -- 172.21.15.71:0/1863286756 reap_dead start 2023-10-09T06:54:57.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.235+0000 7fab7299d700 1 -- 172.21.15.71:0/1863286756 shutdown_connections 2023-10-09T06:54:57.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.235+0000 7fab7299d700 1 -- 172.21.15.71:0/1863286756 >> 172.21.15.71:0/1863286756 conn(0x7fab6c0cc1e0 msgr2=0x7fab6c0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:57.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.235+0000 7fab7299d700 1 -- 172.21.15.71:0/1863286756 shutdown_connections 2023-10-09T06:54:57.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.235+0000 7fab7299d700 1 -- 172.21.15.71:0/1863286756 wait complete. 2023-10-09T06:54:57.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.236+0000 7fab7299d700 1 Processor -- start 2023-10-09T06:54:57.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.237+0000 7fab7299d700 1 -- start start 2023-10-09T06:54:57.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.237+0000 7fab7299d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab58003a90 0x7fab6c149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:57.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.237+0000 7fab7299d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab6c0ac760 0x7fab6c0acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:57.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.237+0000 7fab7299d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab6c0a98d0 0x7fab6c0a9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:57.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.237+0000 7fab7299d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c16abf0 con 0x7fab6c0a98d0 2023-10-09T06:54:57.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.237+0000 7fab7299d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c16a910 con 0x7fab6c0ac760 2023-10-09T06:54:57.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.238+0000 7fab7299d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0abc80 con 0x7fab58003a90 2023-10-09T06:54:57.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.238+0000 7fab7219c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab6c0a98d0 0x7fab6c0a9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:57.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.238+0000 7fab7219c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab6c0a98d0 0x7fab6c0a9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38304/0 (socket says 172.21.15.71:38304) 2023-10-09T06:54:57.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.238+0000 7fab7219c700 1 -- 172.21.15.71:0/686939231 learned_addr learned my addr 172.21.15.71:0/686939231 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:57.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.238+0000 7fab7199b700 1 --2- 172.21.15.71:0/686939231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab58003a90 0x7fab6c149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:57.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.238+0000 7fab7119a700 1 --2- 172.21.15.71:0/686939231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab6c0ac760 0x7fab6c0acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:57.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.238+0000 7fab7219c700 1 -- 172.21.15.71:0/686939231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab58003a90 msgr2=0x7fab6c149f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:57.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.238+0000 7fab7219c700 1 --2- 172.21.15.71:0/686939231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab58003a90 0x7fab6c149f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:57.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.238+0000 7fab7219c700 1 -- 172.21.15.71:0/686939231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab6c0ac760 msgr2=0x7fab6c0acbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:57.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.238+0000 7fab7219c700 1 --2- 172.21.15.71:0/686939231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab6c0ac760 0x7fab6c0acbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:57.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.238+0000 7fab7219c700 1 -- 172.21.15.71:0/686939231 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c0abf60 con 0x7fab6c0a98d0 2023-10-09T06:54:57.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.238+0000 7fab7219c700 1 --2- 172.21.15.71:0/686939231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab6c0a98d0 0x7fab6c0a9d40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fab6c06ab10 tx=0x7fab6400a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:57.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.239+0000 7fab61ffb700 1 -- 172.21.15.71:0/686939231 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab64008e50 con 0x7fab6c0a98d0 2023-10-09T06:54:57.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.239+0000 7fab61ffb700 1 -- 172.21.15.71:0/686939231 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab64010040 con 0x7fab6c0a98d0 2023-10-09T06:54:57.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.239+0000 7fab61ffb700 1 -- 172.21.15.71:0/686939231 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab64007da0 con 0x7fab6c0a98d0 2023-10-09T06:54:57.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.239+0000 7fab7299d700 1 -- 172.21.15.71:0/686939231 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6c0ac240 con 0x7fab6c0a98d0 2023-10-09T06:54:57.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.239+0000 7fab7299d700 1 -- 172.21.15.71:0/686939231 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6c0c25c0 con 0x7fab6c0a98d0 2023-10-09T06:54:57.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.240+0000 7fab7299d700 1 -- 172.21.15.71:0/686939231 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6c0abae0 con 0x7fab6c0a98d0 2023-10-09T06:54:57.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.241+0000 7fab61ffb700 1 -- 172.21.15.71:0/686939231 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab64016650 con 0x7fab6c0a98d0 2023-10-09T06:54:57.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.242+0000 7fab61ffb700 1 --2- 172.21.15.71:0/686939231 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fab50066f30 0x7fab500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:57.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.242+0000 7fab61ffb700 1 -- 172.21.15.71:0/686939231 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5862+0+0 (secure 0 0 0) 0x7fab64084730 con 0x7fab6c0a98d0 2023-10-09T06:54:57.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.242+0000 7fab7199b700 1 --2- 172.21.15.71:0/686939231 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fab50066f30 0x7fab500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:57.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.243+0000 7fab7199b700 1 --2- 172.21.15.71:0/686939231 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fab50066f30 0x7fab500693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fab68000fd0 tx=0x7fab68015000 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:57.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.246+0000 7fab61ffb700 1 -- 172.21.15.71:0/686939231 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab6c0abae0 con 0x7fab6c0a98d0 2023-10-09T06:54:57.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.437+0000 7fab7299d700 1 -- 172.21.15.71:0/686939231 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fab6c0abae0 con 0x7fab6c0a98d0 2023-10-09T06:54:57.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.441+0000 7fab61ffb700 1 -- 172.21.15.71:0/686939231 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v15) v1 ==== 120+0+0 (secure 0 0 0) 0x7fab6c0abae0 con 0x7fab6c0a98d0 2023-10-09T06:54:57.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.443+0000 7fab7299d700 1 -- 172.21.15.71:0/686939231 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fab50066f30 msgr2=0x7fab500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:57.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.443+0000 7fab7299d700 1 --2- 172.21.15.71:0/686939231 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fab50066f30 0x7fab500693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fab68000fd0 tx=0x7fab68015000 comp rx=0 tx=0).stop 2023-10-09T06:54:57.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.443+0000 7fab7299d700 1 -- 172.21.15.71:0/686939231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab6c0a98d0 msgr2=0x7fab6c0a9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:57.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.443+0000 7fab7299d700 1 --2- 172.21.15.71:0/686939231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab6c0a98d0 0x7fab6c0a9d40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fab6c06ab10 tx=0x7fab6400a890 comp rx=0 tx=0).stop 2023-10-09T06:54:57.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.444+0000 7fab7299d700 1 -- 172.21.15.71:0/686939231 shutdown_connections 2023-10-09T06:54:57.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.444+0000 7fab7299d700 1 --2- 172.21.15.71:0/686939231 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fab50066f30 0x7fab500693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:57.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.444+0000 7fab7299d700 1 --2- 172.21.15.71:0/686939231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab6c0a98d0 0x7fab6c0a9d40 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:57.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.444+0000 7fab7299d700 1 --2- 172.21.15.71:0/686939231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab58003a90 0x7fab6c149f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:57.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.444+0000 7fab7299d700 1 --2- 172.21.15.71:0/686939231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab6c0ac760 0x7fab6c0acbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:57.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.444+0000 7fab7299d700 1 -- 172.21.15.71:0/686939231 >> 172.21.15.71:0/686939231 conn(0x7fab6c0cc1e0 msgr2=0x7fab6c069540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:57.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.444+0000 7fab7299d700 1 -- 172.21.15.71:0/686939231 shutdown_connections 2023-10-09T06:54:57.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.444+0000 7fab7299d700 1 -- 172.21.15.71:0/686939231 wait complete. 2023-10-09T06:54:57.461 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-10-09T06:54:57.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.641+0000 7f85671ff700 1 Processor -- start 2023-10-09T06:54:57.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.641+0000 7f85671ff700 1 -- start start 2023-10-09T06:54:57.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.643+0000 7f85671ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f85600cbf30 0x7f85600ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:57.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.643+0000 7f85671ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f85600b1420 0x7f85600c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:57.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.643+0000 7f85671ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85600cc300 con 0x7f85600ccf90 2023-10-09T06:54:57.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.643+0000 7f85671ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8560156bf0 con 0x7f85600cbf30 2023-10-09T06:54:57.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.643+0000 7f85671ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85600ae950 con 0x7f85600b1420 2023-10-09T06:54:57.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.643+0000 7f8564f9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f85600cbf30 0x7f85600ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:57.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.643+0000 7f8564f9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f85600cbf30 0x7f85600ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38310/0 (socket says 172.21.15.71:38310) 2023-10-09T06:54:57.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.643+0000 7f8564f9b700 1 -- 172.21.15.71:0/3647838873 learned_addr learned my addr 172.21.15.71:0/3647838873 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:57.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.643+0000 7f856579c700 1 --2- 172.21.15.71:0/3647838873 >> v2:172.21.15.179:3300/0 conn(0x7f85600b1420 0x7f85600c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:57.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.643+0000 7f8564f9b700 1 -- 172.21.15.71:0/3647838873 >> v2:172.21.15.179:3300/0 conn(0x7f85600b1420 msgr2=0x7f85600c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:57.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.643+0000 7f8564f9b700 1 --2- 172.21.15.71:0/3647838873 >> v2:172.21.15.179:3300/0 conn(0x7f85600b1420 0x7f85600c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:57.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.643+0000 7f8564f9b700 1 -- 172.21.15.71:0/3647838873 >> v1:172.21.15.179:6789/0 conn(0x7f85600ccf90 legacy=0x7f85600b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:57.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.644+0000 7f8564f9b700 1 -- 172.21.15.71:0/3647838873 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85600ad370 con 0x7f85600cbf30 2023-10-09T06:54:57.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.644+0000 7f8564f9b700 1 --2- 172.21.15.71:0/3647838873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85600cbf30 0x7f85600ae410 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f85600b19e0 tx=0x7f8554009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00b50332d52ce8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:57.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.644+0000 7f855f7fe700 1 -- 172.21.15.71:0/3647838873 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8554009ea0 con 0x7f85600cbf30 2023-10-09T06:54:57.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.644+0000 7f855f7fe700 1 -- 172.21.15.71:0/3647838873 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855400b820 con 0x7f85600cbf30 2023-10-09T06:54:57.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.644+0000 7f855f7fe700 1 -- 172.21.15.71:0/3647838873 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855400bbc0 con 0x7f85600cbf30 2023-10-09T06:54:57.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.645+0000 7f85671ff700 1 -- 172.21.15.71:0/3647838873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85600cbf30 msgr2=0x7f85600ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:57.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.645+0000 7f85671ff700 1 --2- 172.21.15.71:0/3647838873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85600cbf30 0x7f85600ae410 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f85600b19e0 tx=0x7f8554009250 comp rx=0 tx=0).stop 2023-10-09T06:54:57.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.645+0000 7f85671ff700 1 -- 172.21.15.71:0/3647838873 shutdown_connections 2023-10-09T06:54:57.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.645+0000 7f85671ff700 1 --2- 172.21.15.71:0/3647838873 >> v2:172.21.15.179:3300/0 conn(0x7f85600b1420 0x7f85600c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:57.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.645+0000 7f85671ff700 1 --2- 172.21.15.71:0/3647838873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85600cbf30 0x7f85600ae410 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:57.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.645+0000 7f85671ff700 1 -- 172.21.15.71:0/3647838873 >> 172.21.15.71:0/3647838873 conn(0x7f856006a320 msgr2=0x7f85600cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:57.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.645+0000 7f85671ff700 1 -- 172.21.15.71:0/3647838873 shutdown_connections 2023-10-09T06:54:57.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.645+0000 7f85671ff700 1 -- 172.21.15.71:0/3647838873 wait complete. 2023-10-09T06:54:57.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.646+0000 7f85671ff700 1 Processor -- start 2023-10-09T06:54:57.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.646+0000 7f85671ff700 1 -- start start 2023-10-09T06:54:57.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.647+0000 7f85671ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85600b1420 0x7f85600a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:57.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.647+0000 7f85671ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85600cbf30 0x7f856015bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:57.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.647+0000 7f85671ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85600ccf90 0x7f856015c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:57.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.647+0000 7f85671ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8560158440 con 0x7f85600ccf90 2023-10-09T06:54:57.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.647+0000 7f85671ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8560157590 con 0x7f85600b1420 2023-10-09T06:54:57.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.647+0000 7f85671ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8560144650 con 0x7f85600cbf30 2023-10-09T06:54:57.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.647+0000 7f856579c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85600ccf90 0x7f856015c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:57.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.647+0000 7f856579c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85600ccf90 0x7f856015c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38314/0 (socket says 172.21.15.71:38314) 2023-10-09T06:54:57.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.647+0000 7f856579c700 1 -- 172.21.15.71:0/2780194812 learned_addr learned my addr 172.21.15.71:0/2780194812 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:57.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.648+0000 7f855ffff700 1 --2- 172.21.15.71:0/2780194812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85600cbf30 0x7f856015bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:57.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.648+0000 7f8564f9b700 1 --2- 172.21.15.71:0/2780194812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85600b1420 0x7f85600a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:57.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.648+0000 7f856579c700 1 -- 172.21.15.71:0/2780194812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85600cbf30 msgr2=0x7f856015bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:57.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.648+0000 7f856579c700 1 --2- 172.21.15.71:0/2780194812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85600cbf30 0x7f856015bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:57.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.648+0000 7f856579c700 1 -- 172.21.15.71:0/2780194812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85600b1420 msgr2=0x7f85600a54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:57.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.648+0000 7f856579c700 1 --2- 172.21.15.71:0/2780194812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85600b1420 0x7f85600a54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:57.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.648+0000 7f856579c700 1 -- 172.21.15.71:0/2780194812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85540094f0 con 0x7f85600ccf90 2023-10-09T06:54:57.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.648+0000 7f856579c700 1 --2- 172.21.15.71:0/2780194812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85600ccf90 0x7f856015c1a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8558009e90 tx=0x7f855800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:57.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.648+0000 7f855cff9700 1 -- 172.21.15.71:0/2780194812 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855800cc20 con 0x7f85600ccf90 2023-10-09T06:54:57.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.648+0000 7f855cff9700 1 -- 172.21.15.71:0/2780194812 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855800f040 con 0x7f85600ccf90 2023-10-09T06:54:57.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.648+0000 7f85671ff700 1 -- 172.21.15.71:0/2780194812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8560157830 con 0x7f85600ccf90 2023-10-09T06:54:57.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.648+0000 7f855cff9700 1 -- 172.21.15.71:0/2780194812 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8558014480 con 0x7f85600ccf90 2023-10-09T06:54:57.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.648+0000 7f85671ff700 1 -- 172.21.15.71:0/2780194812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8560157df0 con 0x7f85600ccf90 2023-10-09T06:54:57.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.649+0000 7f85671ff700 1 -- 172.21.15.71:0/2780194812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85601585f0 con 0x7f85600ccf90 2023-10-09T06:54:57.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.650+0000 7f855cff9700 1 -- 172.21.15.71:0/2780194812 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8558014830 con 0x7f85600ccf90 2023-10-09T06:54:57.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.651+0000 7f855cff9700 1 --2- 172.21.15.71:0/2780194812 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8544066f30 0x7f85440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:57.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.651+0000 7f855cff9700 1 -- 172.21.15.71:0/2780194812 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5862+0+0 (secure 0 0 0) 0x7f8558085370 con 0x7f85600ccf90 2023-10-09T06:54:57.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.651+0000 7f8564f9b700 1 --2- 172.21.15.71:0/2780194812 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8544066f30 0x7f85440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:57.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.652+0000 7f8564f9b700 1 --2- 172.21.15.71:0/2780194812 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8544066f30 0x7f85440693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f85600b19e0 tx=0x7f8554017000 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:57.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.655+0000 7f855cff9700 1 -- 172.21.15.71:0/2780194812 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85601585f0 con 0x7f85600ccf90 2023-10-09T06:54:57.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:57.930+0000 7f85671ff700 1 -- 172.21.15.71:0/2780194812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7f856004c3c0 con 0x7f85600ccf90 2023-10-09T06:54:58.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:58.876+0000 7f855cff9700 1 -- 172.21.15.71:0/2780194812 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v444) v1 ==== 158+0+0 (secure 0 0 0) 0x7f8558055ca0 con 0x7f85600ccf90 2023-10-09T06:54:58.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:58.879+0000 7f85671ff700 1 -- 172.21.15.71:0/2780194812 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8544066f30 msgr2=0x7f85440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:58.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:58.879+0000 7f85671ff700 1 --2- 172.21.15.71:0/2780194812 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8544066f30 0x7f85440693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f85600b19e0 tx=0x7f8554017000 comp rx=0 tx=0).stop 2023-10-09T06:54:58.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:58.879+0000 7f85671ff700 1 -- 172.21.15.71:0/2780194812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85600ccf90 msgr2=0x7f856015c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:58.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:58.879+0000 7f85671ff700 1 --2- 172.21.15.71:0/2780194812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85600ccf90 0x7f856015c1a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8558009e90 tx=0x7f855800b040 comp rx=0 tx=0).stop 2023-10-09T06:54:58.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:58.879+0000 7f85671ff700 1 -- 172.21.15.71:0/2780194812 shutdown_connections 2023-10-09T06:54:58.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:58.879+0000 7f85671ff700 1 --2- 172.21.15.71:0/2780194812 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8544066f30 0x7f85440693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:58.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:58.879+0000 7f85671ff700 1 --2- 172.21.15.71:0/2780194812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85600ccf90 0x7f856015c1a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:58.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:58.879+0000 7f85671ff700 1 --2- 172.21.15.71:0/2780194812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85600b1420 0x7f85600a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:58.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:58.879+0000 7f85671ff700 1 --2- 172.21.15.71:0/2780194812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85600cbf30 0x7f856015bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:58.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:58.879+0000 7f85671ff700 1 -- 172.21.15.71:0/2780194812 >> 172.21.15.71:0/2780194812 conn(0x7f856006a320 msgr2=0x7f8560155100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:58.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:58.879+0000 7f85671ff700 1 -- 172.21.15.71:0/2780194812 shutdown_connections 2023-10-09T06:54:58.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:58.879+0000 7f85671ff700 1 -- 172.21.15.71:0/2780194812 wait complete. 2023-10-09T06:54:58.898 INFO:tasks.cephfs_test_runner:Test concurrent snap creates in same file-system without db issues ... ok 2023-10-09T06:54:58.898 INFO:tasks.cephfs_test_runner:Starting test: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test exisitence of multiple scheduled snapshots 2023-10-09T06:54:58.898 INFO:tasks.cephfs_test_runner:test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-09T06:54:58.899 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-10-09T06:54:59.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.081+0000 7f24b19ff700 1 Processor -- start 2023-10-09T06:54:59.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.081+0000 7f24b19ff700 1 -- start start 2023-10-09T06:54:59.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.082+0000 7f24b19ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24ac0ccc40 0x7f24ac155c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:59.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.082+0000 7f24b19ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f24ac156150 0x7f24ac0ac230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:59.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.082+0000 7f24b19ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ac0ad930 con 0x7f24ac0cd010 2023-10-09T06:54:59.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.082+0000 7f24b19ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24ac0acd20 con 0x7f24ac156150 2023-10-09T06:54:59.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.082+0000 7f24b19ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac0ad000 con 0x7f24ac0ccc40 2023-10-09T06:54:59.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.082+0000 7f24ab7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f24ac0cd010 0x7f24ac0af2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:42000/0 (socket says 172.21.15.71:42000) 2023-10-09T06:54:59.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.082+0000 7f24ab7fe700 1 -- 172.21.15.71:0/1071313103 learned_addr learned my addr 172.21.15.71:0/1071313103 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:54:59.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.083+0000 7f24aaffd700 1 --2- 172.21.15.71:0/1071313103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24ac0ccc40 0x7f24ac155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:59.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.083+0000 7f24aa7fc700 1 --2- 172.21.15.71:0/1071313103 >> v2:172.21.15.179:3300/0 conn(0x7f24ac156150 0x7f24ac0ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:59.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.083+0000 7f24a9ffb700 1 -- 172.21.15.71:0/1071313103 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140301507 0 0) 0x7f24ac0ad930 con 0x7f24ac0cd010 2023-10-09T06:54:59.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.083+0000 7f24a9ffb700 1 -- 172.21.15.71:0/1071313103 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2494003570 con 0x7f24ac0cd010 2023-10-09T06:54:59.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.083+0000 7f24aaffd700 1 -- 172.21.15.71:0/1071313103 >> v2:172.21.15.179:3300/0 conn(0x7f24ac156150 msgr2=0x7f24ac0ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:54:59.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.083+0000 7f24aaffd700 1 --2- 172.21.15.71:0/1071313103 >> v2:172.21.15.179:3300/0 conn(0x7f24ac156150 0x7f24ac0ac230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:59.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.083+0000 7f24aaffd700 1 -- 172.21.15.71:0/1071313103 >> v1:172.21.15.71:6789/0 conn(0x7f24ac0cd010 legacy=0x7f24ac0af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:59.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.083+0000 7f24aaffd700 1 -- 172.21.15.71:0/1071313103 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac0ad2e0 con 0x7f24ac0ccc40 2023-10-09T06:54:59.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.083+0000 7f24aaffd700 1 --2- 172.21.15.71:0/1071313103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24ac0ccc40 0x7f24ac155c10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f249c0098e0 tx=0x7f249c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2daf0449c403c22 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:59.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.084+0000 7f24a9ffb700 1 -- 172.21.15.71:0/1071313103 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c011630 con 0x7f24ac0ccc40 2023-10-09T06:54:59.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.084+0000 7f24a9ffb700 1 -- 172.21.15.71:0/1071313103 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c011790 con 0x7f24ac0ccc40 2023-10-09T06:54:59.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.084+0000 7f24a9ffb700 1 -- 172.21.15.71:0/1071313103 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c011b30 con 0x7f24ac0ccc40 2023-10-09T06:54:59.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.084+0000 7f24b19ff700 1 -- 172.21.15.71:0/1071313103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24ac0ccc40 msgr2=0x7f24ac155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:59.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.084+0000 7f24b19ff700 1 --2- 172.21.15.71:0/1071313103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24ac0ccc40 0x7f24ac155c10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f249c0098e0 tx=0x7f249c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:59.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.084+0000 7f24b19ff700 1 -- 172.21.15.71:0/1071313103 shutdown_connections 2023-10-09T06:54:59.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.084+0000 7f24b19ff700 1 --2- 172.21.15.71:0/1071313103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24ac0ccc40 0x7f24ac155c10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:59.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.084+0000 7f24b19ff700 1 --2- 172.21.15.71:0/1071313103 >> v2:172.21.15.179:3300/0 conn(0x7f24ac156150 0x7f24ac0ac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:59.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.084+0000 7f24b19ff700 1 -- 172.21.15.71:0/1071313103 >> 172.21.15.71:0/1071313103 conn(0x7f24ac06a320 msgr2=0x7f24ac0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:59.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.084+0000 7f24b19ff700 1 -- 172.21.15.71:0/1071313103 shutdown_connections 2023-10-09T06:54:59.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.084+0000 7f24b19ff700 1 -- 172.21.15.71:0/1071313103 wait complete. 2023-10-09T06:54:59.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.086+0000 7f24b19ff700 1 Processor -- start 2023-10-09T06:54:59.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.086+0000 7f24b19ff700 1 -- start start 2023-10-09T06:54:59.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.087+0000 7f24b19ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24ac0ccc40 0x7f24ac145050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:59.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.087+0000 7f24b19ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24ac0cd010 0x7f24ac15c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:59.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.087+0000 7f24b19ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24ac156150 0x7f24ac06d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:59.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.087+0000 7f24b19ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac0aaf10 con 0x7f24ac0ccc40 2023-10-09T06:54:59.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.087+0000 7f24b19ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac145590 con 0x7f24ac156150 2023-10-09T06:54:59.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.087+0000 7f24b19ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac15c310 con 0x7f24ac0cd010 2023-10-09T06:54:59.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.087+0000 7f24aaffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24ac0ccc40 0x7f24ac145050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:59.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.087+0000 7f24aaffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24ac0ccc40 0x7f24ac145050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38316/0 (socket says 172.21.15.71:38316) 2023-10-09T06:54:59.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.087+0000 7f24aaffd700 1 -- 172.21.15.71:0/2063938641 learned_addr learned my addr 172.21.15.71:0/2063938641 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:54:59.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.088+0000 7f24aaffd700 1 -- 172.21.15.71:0/2063938641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24ac0cd010 msgr2=0x7f24ac15c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:59.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.088+0000 7f24aaffd700 1 --2- 172.21.15.71:0/2063938641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24ac0cd010 0x7f24ac15c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:59.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.088+0000 7f24aaffd700 1 -- 172.21.15.71:0/2063938641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24ac156150 msgr2=0x7f24ac06d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:59.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.088+0000 7f24aaffd700 1 --2- 172.21.15.71:0/2063938641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24ac156150 0x7f24ac06d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:59.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.088+0000 7f24aaffd700 1 -- 172.21.15.71:0/2063938641 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249c009420 con 0x7f24ac0ccc40 2023-10-09T06:54:59.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.088+0000 7f24aaffd700 1 --2- 172.21.15.71:0/2063938641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24ac0ccc40 0x7f24ac145050 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f249c009ed0 tx=0x7f249c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:59.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.088+0000 7f2492ffd700 1 -- 172.21.15.71:0/2063938641 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c011b10 con 0x7f24ac0ccc40 2023-10-09T06:54:59.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.088+0000 7f2492ffd700 1 -- 172.21.15.71:0/2063938641 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c0253f0 con 0x7f24ac0ccc40 2023-10-09T06:54:59.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.088+0000 7f2492ffd700 1 -- 172.21.15.71:0/2063938641 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c0257b0 con 0x7f24ac0ccc40 2023-10-09T06:54:59.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.088+0000 7f24b19ff700 1 -- 172.21.15.71:0/2063938641 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24ac16a870 con 0x7f24ac0ccc40 2023-10-09T06:54:59.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.088+0000 7f24b19ff700 1 -- 172.21.15.71:0/2063938641 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24ac15bcc0 con 0x7f24ac0ccc40 2023-10-09T06:54:59.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.089+0000 7f24b19ff700 1 -- 172.21.15.71:0/2063938641 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24ac15bb20 con 0x7f24ac0ccc40 2023-10-09T06:54:59.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.090+0000 7f2492ffd700 1 -- 172.21.15.71:0/2063938641 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f249c025ba0 con 0x7f24ac0ccc40 2023-10-09T06:54:59.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.091+0000 7f2492ffd700 1 --2- 172.21.15.71:0/2063938641 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2498066f30 0x7f24980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:54:59.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.091+0000 7f2492ffd700 1 -- 172.21.15.71:0/2063938641 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5862+0+0 (secure 0 0 0) 0x7f249c085ed0 con 0x7f24ac0ccc40 2023-10-09T06:54:59.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.091+0000 7f24aa7fc700 1 --2- 172.21.15.71:0/2063938641 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2498066f30 0x7f24980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:54:59.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.092+0000 7f24aa7fc700 1 --2- 172.21.15.71:0/2063938641 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2498066f30 0x7f24980693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f24ac0cb020 tx=0x7f24a00091a0 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:54:59.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.095+0000 7f2492ffd700 1 -- 172.21.15.71:0/2063938641 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24ac15bb20 con 0x7f24ac0ccc40 2023-10-09T06:54:59.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.362+0000 7f24b19ff700 1 -- 172.21.15.71:0/2063938641 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f24ac15bb20 con 0x7f24ac0ccc40 2023-10-09T06:54:59.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.881+0000 7f2492ffd700 1 -- 172.21.15.71:0/2063938641 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v445) v1 ==== 157+0+0 (secure 0 0 0) 0x7f24ac15bb20 con 0x7f24ac0ccc40 2023-10-09T06:54:59.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.884+0000 7f24b19ff700 1 -- 172.21.15.71:0/2063938641 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2498066f30 msgr2=0x7f24980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:59.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.884+0000 7f24b19ff700 1 --2- 172.21.15.71:0/2063938641 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2498066f30 0x7f24980693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f24ac0cb020 tx=0x7f24a00091a0 comp rx=0 tx=0).stop 2023-10-09T06:54:59.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.884+0000 7f24b19ff700 1 -- 172.21.15.71:0/2063938641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24ac0ccc40 msgr2=0x7f24ac145050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:54:59.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.884+0000 7f24b19ff700 1 --2- 172.21.15.71:0/2063938641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24ac0ccc40 0x7f24ac145050 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f249c009ed0 tx=0x7f249c017000 comp rx=0 tx=0).stop 2023-10-09T06:54:59.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.884+0000 7f24b19ff700 1 -- 172.21.15.71:0/2063938641 shutdown_connections 2023-10-09T06:54:59.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.884+0000 7f24b19ff700 1 --2- 172.21.15.71:0/2063938641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24ac156150 0x7f24ac06d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:59.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.884+0000 7f24b19ff700 1 --2- 172.21.15.71:0/2063938641 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2498066f30 0x7f24980693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:59.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.884+0000 7f24b19ff700 1 --2- 172.21.15.71:0/2063938641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24ac0ccc40 0x7f24ac145050 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:59.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.884+0000 7f24b19ff700 1 --2- 172.21.15.71:0/2063938641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24ac0cd010 0x7f24ac15c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:54:59.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.884+0000 7f24b19ff700 1 -- 172.21.15.71:0/2063938641 >> 172.21.15.71:0/2063938641 conn(0x7f24ac06a320 msgr2=0x7f24ac0c97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:54:59.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.884+0000 7f24b19ff700 1 -- 172.21.15.71:0/2063938641 shutdown_connections 2023-10-09T06:54:59.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:54:59.884+0000 7f24b19ff700 1 -- 172.21.15.71:0/2063938641 wait complete. 2023-10-09T06:54:59.902 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T06:55:00.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.086+0000 7ffb3c3ff700 1 Processor -- start 2023-10-09T06:55:00.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.086+0000 7ffb3c3ff700 1 -- start start 2023-10-09T06:55:00.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.088+0000 7ffb3c3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb340b0a70 0x7ffb341625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:00.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.088+0000 7ffb3c3ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb340af2f0 con 0x7ffb3415ac80 2023-10-09T06:55:00.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.088+0000 7ffb3c3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb340af5d0 con 0x7ffb34069e80 2023-10-09T06:55:00.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.088+0000 7ffb3c3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340c8660 con 0x7ffb340b0a70 2023-10-09T06:55:00.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.088+0000 7ffb3a19b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ffb3415ac80 0x7ffb34069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:42008/0 (socket says 172.21.15.71:42008) 2023-10-09T06:55:00.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.088+0000 7ffb3a19b700 1 -- 172.21.15.71:0/763632588 learned_addr learned my addr 172.21.15.71:0/763632588 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:55:00.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.088+0000 7ffb3a99c700 1 --2- 172.21.15.71:0/763632588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb340b0a70 0x7ffb341625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:00.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.088+0000 7ffb39199700 1 -- 172.21.15.71:0/763632588 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987307475 0 0) 0x7ffb340af2f0 con 0x7ffb3415ac80 2023-10-09T06:55:00.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.088+0000 7ffb39199700 1 -- 172.21.15.71:0/763632588 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb20003570 con 0x7ffb3415ac80 2023-10-09T06:55:00.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.089+0000 7ffb39199700 1 -- 172.21.15.71:0/763632588 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1986128482 0 0) 0x7ffb340af5d0 con 0x7ffb34069e80 2023-10-09T06:55:00.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.089+0000 7ffb39199700 1 -- 172.21.15.71:0/763632588 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb340af2f0 con 0x7ffb34069e80 2023-10-09T06:55:00.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.089+0000 7ffb39199700 1 -- 172.21.15.71:0/763632588 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 978005316 0 0) 0x7ffb20003570 con 0x7ffb3415ac80 2023-10-09T06:55:00.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.089+0000 7ffb3a99c700 1 -- 172.21.15.71:0/763632588 >> v1:172.21.15.179:6789/0 conn(0x7ffb34069e80 legacy=0x7ffb340c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:00.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.089+0000 7ffb3a99c700 1 -- 172.21.15.71:0/763632588 >> v1:172.21.15.71:6789/0 conn(0x7ffb3415ac80 legacy=0x7ffb34069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:00.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.089+0000 7ffb3a99c700 1 -- 172.21.15.71:0/763632588 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb340c8940 con 0x7ffb340b0a70 2023-10-09T06:55:00.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.089+0000 7ffb3a99c700 1 --2- 172.21.15.71:0/763632588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb340b0a70 0x7ffb341625e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c009e90 tx=0x7ffb2c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e23128e88a2886dc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:00.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.089+0000 7ffb39199700 1 -- 172.21.15.71:0/763632588 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c00e070 con 0x7ffb340b0a70 2023-10-09T06:55:00.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.089+0000 7ffb39199700 1 -- 172.21.15.71:0/763632588 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c00b870 con 0x7ffb340b0a70 2023-10-09T06:55:00.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.089+0000 7ffb39199700 1 -- 172.21.15.71:0/763632588 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30001470 con 0x7ffb340b0a70 2023-10-09T06:55:00.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.090+0000 7ffb3c3ff700 1 -- 172.21.15.71:0/763632588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb340b0a70 msgr2=0x7ffb341625e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:00.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.090+0000 7ffb3c3ff700 1 --2- 172.21.15.71:0/763632588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb340b0a70 0x7ffb341625e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c009e90 tx=0x7ffb2c009780 comp rx=0 tx=0).stop 2023-10-09T06:55:00.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.090+0000 7ffb3c3ff700 1 -- 172.21.15.71:0/763632588 shutdown_connections 2023-10-09T06:55:00.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.090+0000 7ffb3c3ff700 1 --2- 172.21.15.71:0/763632588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb340b0a70 0x7ffb341625e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:00.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.090+0000 7ffb3c3ff700 1 -- 172.21.15.71:0/763632588 >> 172.21.15.71:0/763632588 conn(0x7ffb34068e10 msgr2=0x7ffb340cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:00.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.090+0000 7ffb3c3ff700 1 -- 172.21.15.71:0/763632588 shutdown_connections 2023-10-09T06:55:00.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.090+0000 7ffb3c3ff700 1 -- 172.21.15.71:0/763632588 wait complete. 2023-10-09T06:55:00.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.091+0000 7ffb3c3ff700 1 Processor -- start 2023-10-09T06:55:00.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.091+0000 7ffb3c3ff700 1 -- start start 2023-10-09T06:55:00.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.092+0000 7ffb3c3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb34069e80 0x7ffb34159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:00.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.092+0000 7ffb3c3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb340b0a70 0x7ffb3416a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:00.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.092+0000 7ffb3c3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb3415ac80 0x7ffb34158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:00.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.092+0000 7ffb3c3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3415a500 con 0x7ffb340b0a70 2023-10-09T06:55:00.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.092+0000 7ffb3c3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb34168620 con 0x7ffb3415ac80 2023-10-09T06:55:00.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.092+0000 7ffb3c3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb34167a10 con 0x7ffb34069e80 2023-10-09T06:55:00.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.093+0000 7ffb3999a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb340b0a70 0x7ffb3416a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:00.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.093+0000 7ffb3999a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb340b0a70 0x7ffb3416a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38328/0 (socket says 172.21.15.71:38328) 2023-10-09T06:55:00.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.093+0000 7ffb3999a700 1 -- 172.21.15.71:0/297026723 learned_addr learned my addr 172.21.15.71:0/297026723 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:00.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.093+0000 7ffb3a19b700 1 --2- 172.21.15.71:0/297026723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb34069e80 0x7ffb34159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:00.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.093+0000 7ffb3a99c700 1 --2- 172.21.15.71:0/297026723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb3415ac80 0x7ffb34158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:00.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.093+0000 7ffb3999a700 1 -- 172.21.15.71:0/297026723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb34069e80 msgr2=0x7ffb34159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:00.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.093+0000 7ffb3999a700 1 --2- 172.21.15.71:0/297026723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb34069e80 0x7ffb34159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:00.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.093+0000 7ffb3999a700 1 -- 172.21.15.71:0/297026723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb3415ac80 msgr2=0x7ffb34158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:00.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.093+0000 7ffb3999a700 1 --2- 172.21.15.71:0/297026723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb3415ac80 0x7ffb34158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:00.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.093+0000 7ffb3999a700 1 -- 172.21.15.71:0/297026723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c009a20 con 0x7ffb340b0a70 2023-10-09T06:55:00.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.093+0000 7ffb3a99c700 1 --2- 172.21.15.71:0/297026723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb3415ac80 0x7ffb34158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:55:00.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.093+0000 7ffb3999a700 1 --2- 172.21.15.71:0/297026723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb340b0a70 0x7ffb3416a530 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400c7c0 tx=0x7ffb24007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:00.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.093+0000 7ffb2a7fc700 1 -- 172.21.15.71:0/297026723 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb24010510 con 0x7ffb340b0a70 2023-10-09T06:55:00.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.094+0000 7ffb2a7fc700 1 -- 172.21.15.71:0/297026723 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb24002e90 con 0x7ffb340b0a70 2023-10-09T06:55:00.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.094+0000 7ffb2a7fc700 1 -- 172.21.15.71:0/297026723 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb240108e0 con 0x7ffb340b0a70 2023-10-09T06:55:00.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.094+0000 7ffb3c3ff700 1 -- 172.21.15.71:0/297026723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb34167cf0 con 0x7ffb340b0a70 2023-10-09T06:55:00.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.094+0000 7ffb3c3ff700 1 -- 172.21.15.71:0/297026723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb341682b0 con 0x7ffb340b0a70 2023-10-09T06:55:00.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.095+0000 7ffb3c3ff700 1 -- 172.21.15.71:0/297026723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb341687d0 con 0x7ffb340b0a70 2023-10-09T06:55:00.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.095+0000 7ffb2a7fc700 1 -- 172.21.15.71:0/297026723 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffb24010c90 con 0x7ffb340b0a70 2023-10-09T06:55:00.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.096+0000 7ffb2a7fc700 1 --2- 172.21.15.71:0/297026723 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffb18066f30 0x7ffb180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:00.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.096+0000 7ffb2a7fc700 1 -- 172.21.15.71:0/297026723 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5862+0+0 (secure 0 0 0) 0x7ffb24083cd0 con 0x7ffb340b0a70 2023-10-09T06:55:00.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.097+0000 7ffb3a19b700 1 --2- 172.21.15.71:0/297026723 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffb18066f30 0x7ffb180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:00.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.098+0000 7ffb3a19b700 1 --2- 172.21.15.71:0/297026723 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffb18066f30 0x7ffb180693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffb300011e0 tx=0x7ffb30000bc0 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:00.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.100+0000 7ffb2a7fc700 1 -- 172.21.15.71:0/297026723 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb341687d0 con 0x7ffb340b0a70 2023-10-09T06:55:00.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.292+0000 7ffb3c3ff700 1 -- 172.21.15.71:0/297026723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ffb34168790 con 0x7ffb340b0a70 2023-10-09T06:55:00.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.297+0000 7ffb2a7fc700 1 -- 172.21.15.71:0/297026723 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7ffb24017070 con 0x7ffb340b0a70 2023-10-09T06:55:00.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.299+0000 7ffb3c3ff700 1 -- 172.21.15.71:0/297026723 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffb18066f30 msgr2=0x7ffb180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:00.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.299+0000 7ffb3c3ff700 1 --2- 172.21.15.71:0/297026723 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffb18066f30 0x7ffb180693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffb300011e0 tx=0x7ffb30000bc0 comp rx=0 tx=0).stop 2023-10-09T06:55:00.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.299+0000 7ffb3c3ff700 1 -- 172.21.15.71:0/297026723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb340b0a70 msgr2=0x7ffb3416a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:00.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.299+0000 7ffb3c3ff700 1 --2- 172.21.15.71:0/297026723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb340b0a70 0x7ffb3416a530 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400c7c0 tx=0x7ffb24007de0 comp rx=0 tx=0).stop 2023-10-09T06:55:00.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.300+0000 7ffb3c3ff700 1 -- 172.21.15.71:0/297026723 shutdown_connections 2023-10-09T06:55:00.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.300+0000 7ffb3c3ff700 1 --2- 172.21.15.71:0/297026723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb3415ac80 0x7ffb34158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:00.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.300+0000 7ffb3c3ff700 1 --2- 172.21.15.71:0/297026723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb34069e80 0x7ffb34159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:00.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.300+0000 7ffb3c3ff700 1 --2- 172.21.15.71:0/297026723 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffb18066f30 0x7ffb180693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:00.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.300+0000 7ffb3c3ff700 1 --2- 172.21.15.71:0/297026723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb340b0a70 0x7ffb3416a530 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:00.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.300+0000 7ffb3c3ff700 1 -- 172.21.15.71:0/297026723 >> 172.21.15.71:0/297026723 conn(0x7ffb34068e10 msgr2=0x7ffb340c2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:00.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.300+0000 7ffb3c3ff700 1 -- 172.21.15.71:0/297026723 shutdown_connections 2023-10-09T06:55:00.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.300+0000 7ffb3c3ff700 1 -- 172.21.15.71:0/297026723 wait complete. 2023-10-09T06:55:00.317 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:55:00.317 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:55:00.392 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:55:00.478 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:55:00.478 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T06:55:00.478 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:55:00.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.660+0000 7f7cc699d700 1 Processor -- start 2023-10-09T06:55:00.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.660+0000 7f7cc699d700 1 -- start start 2023-10-09T06:55:00.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.661+0000 7f7cc699d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7cc0150550 0x7f7cc0157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:00.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.661+0000 7f7cc699d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7cc00c7410 0x7f7cc0069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:00.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.661+0000 7f7cc699d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc006e2a0 con 0x7f7cc0150180 2023-10-09T06:55:00.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.661+0000 7f7cc699d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc006b2e0 con 0x7f7cc0150550 2023-10-09T06:55:00.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.661+0000 7f7cc699d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc00c78e0 con 0x7f7cc00c7410 2023-10-09T06:55:00.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.662+0000 7f7cc519a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7cc0150550 0x7f7cc0157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:00.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.662+0000 7f7cc519a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7cc0150550 0x7f7cc0157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38340/0 (socket says 172.21.15.71:38340) 2023-10-09T06:55:00.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.662+0000 7f7cc519a700 1 -- 172.21.15.71:0/2048052937 learned_addr learned my addr 172.21.15.71:0/2048052937 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:00.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.662+0000 7f7cc519a700 1 -- 172.21.15.71:0/2048052937 >> v2:172.21.15.179:3300/0 conn(0x7f7cc00c7410 msgr2=0x7f7cc0069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:00.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.662+0000 7f7cc619c700 1 --2- 172.21.15.71:0/2048052937 >> v2:172.21.15.179:3300/0 conn(0x7f7cc00c7410 0x7f7cc0069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:00.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.662+0000 7f7cc519a700 1 --2- 172.21.15.71:0/2048052937 >> v2:172.21.15.179:3300/0 conn(0x7f7cc00c7410 0x7f7cc0069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:00.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.662+0000 7f7cc519a700 1 -- 172.21.15.71:0/2048052937 >> v1:172.21.15.179:6789/0 conn(0x7f7cc0150180 legacy=0x7f7cc00c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:00.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.662+0000 7f7cc519a700 1 -- 172.21.15.71:0/2048052937 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc00c7bc0 con 0x7f7cc0150550 2023-10-09T06:55:00.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.662+0000 7f7cc619c700 1 --2- 172.21.15.71:0/2048052937 >> v2:172.21.15.179:3300/0 conn(0x7f7cc00c7410 0x7f7cc0069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:55:00.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.662+0000 7f7cc519a700 1 --2- 172.21.15.71:0/2048052937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc0150550 0x7f7cc0157770 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0156270 tx=0x7f7cb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5446dbc6a2e388 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:00.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.663+0000 7f7cc4999700 1 -- 172.21.15.71:0/2048052937 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb000b820 con 0x7f7cc0150550 2023-10-09T06:55:00.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.663+0000 7f7cc4999700 1 -- 172.21.15.71:0/2048052937 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb000b980 con 0x7f7cc0150550 2023-10-09T06:55:00.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.663+0000 7f7cc4999700 1 -- 172.21.15.71:0/2048052937 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb000bd20 con 0x7f7cc0150550 2023-10-09T06:55:00.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.663+0000 7f7cc699d700 1 -- 172.21.15.71:0/2048052937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc0150550 msgr2=0x7f7cc0157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:00.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.663+0000 7f7cc699d700 1 --2- 172.21.15.71:0/2048052937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc0150550 0x7f7cc0157770 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0156270 tx=0x7f7cb0009250 comp rx=0 tx=0).stop 2023-10-09T06:55:00.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.663+0000 7f7cc699d700 1 -- 172.21.15.71:0/2048052937 shutdown_connections 2023-10-09T06:55:00.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.663+0000 7f7cc699d700 1 --2- 172.21.15.71:0/2048052937 >> v2:172.21.15.179:3300/0 conn(0x7f7cc00c7410 0x7f7cc0069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:00.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.663+0000 7f7cc699d700 1 --2- 172.21.15.71:0/2048052937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc0150550 0x7f7cc0157770 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:00.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.663+0000 7f7cc699d700 1 -- 172.21.15.71:0/2048052937 >> 172.21.15.71:0/2048052937 conn(0x7f7cc00cc1f0 msgr2=0x7f7cc00cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:00.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.663+0000 7f7cc699d700 1 -- 172.21.15.71:0/2048052937 shutdown_connections 2023-10-09T06:55:00.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.663+0000 7f7cc699d700 1 -- 172.21.15.71:0/2048052937 wait complete. 2023-10-09T06:55:00.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.665+0000 7f7cc699d700 1 Processor -- start 2023-10-09T06:55:00.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.665+0000 7f7cc699d700 1 -- start start 2023-10-09T06:55:00.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.666+0000 7f7cc699d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cc00c7410 0x7f7cc013fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:00.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.666+0000 7f7cc699d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cc0150180 0x7f7cc00ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:00.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.666+0000 7f7cc699d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc0150550 0x7f7cc00c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:00.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.666+0000 7f7cc699d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc00aef90 con 0x7f7cc0150550 2023-10-09T06:55:00.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.666+0000 7f7cc699d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc00af270 con 0x7f7cc0150180 2023-10-09T06:55:00.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.666+0000 7f7cc699d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc00acea0 con 0x7f7cc00c7410 2023-10-09T06:55:00.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.666+0000 7f7cc619c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc0150550 0x7f7cc00c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:00.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.666+0000 7f7cc619c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc0150550 0x7f7cc00c42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38352/0 (socket says 172.21.15.71:38352) 2023-10-09T06:55:00.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.666+0000 7f7cc619c700 1 -- 172.21.15.71:0/145069228 learned_addr learned my addr 172.21.15.71:0/145069228 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:00.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.666+0000 7f7cc519a700 1 --2- 172.21.15.71:0/145069228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cc0150180 0x7f7cc00ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:00.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.666+0000 7f7cc599b700 1 --2- 172.21.15.71:0/145069228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cc00c7410 0x7f7cc013fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:00.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.666+0000 7f7cc619c700 1 -- 172.21.15.71:0/145069228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cc00c7410 msgr2=0x7f7cc013fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:00.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.667+0000 7f7cc619c700 1 --2- 172.21.15.71:0/145069228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cc00c7410 0x7f7cc013fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:00.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.667+0000 7f7cc619c700 1 -- 172.21.15.71:0/145069228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cc0150180 msgr2=0x7f7cc00ae1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:00.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.667+0000 7f7cc619c700 1 --2- 172.21.15.71:0/145069228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cc0150180 0x7f7cc00ae1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:00.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.667+0000 7f7cc619c700 1 -- 172.21.15.71:0/145069228 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb00094f0 con 0x7f7cc0150550 2023-10-09T06:55:00.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.667+0000 7f7cc619c700 1 --2- 172.21.15.71:0/145069228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc0150550 0x7f7cc00c42e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7cb800cef0 tx=0x7f7cb8007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:00.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.667+0000 7f7cb5ffb700 1 -- 172.21.15.71:0/145069228 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb800add0 con 0x7f7cc0150550 2023-10-09T06:55:00.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.667+0000 7f7cb5ffb700 1 -- 172.21.15.71:0/145069228 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb8016420 con 0x7f7cc0150550 2023-10-09T06:55:00.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.667+0000 7f7cc699d700 1 -- 172.21.15.71:0/145069228 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc00ad180 con 0x7f7cc0150550 2023-10-09T06:55:00.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.667+0000 7f7cb5ffb700 1 -- 172.21.15.71:0/145069228 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb80167e0 con 0x7f7cc0150550 2023-10-09T06:55:00.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.667+0000 7f7cc699d700 1 -- 172.21.15.71:0/145069228 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc0140120 con 0x7f7cc0150550 2023-10-09T06:55:00.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.668+0000 7f7cc699d700 1 -- 172.21.15.71:0/145069228 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc004c3c0 con 0x7f7cc0150550 2023-10-09T06:55:00.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.669+0000 7f7cb5ffb700 1 -- 172.21.15.71:0/145069228 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7cb8016bd0 con 0x7f7cc0150550 2023-10-09T06:55:00.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.670+0000 7f7cb5ffb700 1 --2- 172.21.15.71:0/145069228 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ca4066f30 0x7f7ca40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:00.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.670+0000 7f7cb5ffb700 1 -- 172.21.15.71:0/145069228 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5862+0+0 (secure 0 0 0) 0x7f7cb8012070 con 0x7f7cc0150550 2023-10-09T06:55:00.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.671+0000 7f7cc599b700 1 --2- 172.21.15.71:0/145069228 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ca4066f30 0x7f7ca40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:00.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.671+0000 7f7cc599b700 1 --2- 172.21.15.71:0/145069228 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ca4066f30 0x7f7ca40693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc006fd0 tx=0x7f7cbc008040 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:00.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.674+0000 7f7cb5ffb700 1 -- 172.21.15.71:0/145069228 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7cb804e5a0 con 0x7f7cc0150550 2023-10-09T06:55:00.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.906+0000 7f7cc699d700 1 -- 172.21.15.71:0/145069228 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7cc00af3b0 con 0x7f7cc0150550 2023-10-09T06:55:00.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.907+0000 7f7cb5ffb700 1 -- 172.21.15.71:0/145069228 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f7cb80521b0 con 0x7f7cc0150550 2023-10-09T06:55:00.907 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:55:00.907 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2315236875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":2315236875},{"type":"v1","addr":"172.21.15.71:6835","nonce":2315236875}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4628,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2455384244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2455384244},{"type":"v1","addr":"172.21.15.179:6836","nonce":2455384244}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3668669622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3668669622},{"type":"v1","addr":"172.21.15.179:6837","nonce":3668669622}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/1291101157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":1291101157},{"type":"v1","addr":"172.21.15.71:6834","nonce":1291101157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[]} 2023-10-09T06:55:00.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.909+0000 7f7cc699d700 1 -- 172.21.15.71:0/145069228 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ca4066f30 msgr2=0x7f7ca40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:00.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.909+0000 7f7cc699d700 1 --2- 172.21.15.71:0/145069228 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ca4066f30 0x7f7ca40693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc006fd0 tx=0x7f7cbc008040 comp rx=0 tx=0).stop 2023-10-09T06:55:00.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.909+0000 7f7cc699d700 1 -- 172.21.15.71:0/145069228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc0150550 msgr2=0x7f7cc00c42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:00.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.909+0000 7f7cc699d700 1 --2- 172.21.15.71:0/145069228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc0150550 0x7f7cc00c42e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7cb800cef0 tx=0x7f7cb8007830 comp rx=0 tx=0).stop 2023-10-09T06:55:00.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.909+0000 7f7cc699d700 1 -- 172.21.15.71:0/145069228 shutdown_connections 2023-10-09T06:55:00.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.909+0000 7f7cc699d700 1 --2- 172.21.15.71:0/145069228 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ca4066f30 0x7f7ca40693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:00.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.909+0000 7f7cc699d700 1 --2- 172.21.15.71:0/145069228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cc0150550 0x7f7cc00c42e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:00.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.909+0000 7f7cc699d700 1 --2- 172.21.15.71:0/145069228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cc00c7410 0x7f7cc013fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:00.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.909+0000 7f7cc699d700 1 --2- 172.21.15.71:0/145069228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cc0150180 0x7f7cc00ae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:00.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.909+0000 7f7cc699d700 1 -- 172.21.15.71:0/145069228 >> 172.21.15.71:0/145069228 conn(0x7f7cc00cc1f0 msgr2=0x7f7cc01562e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:00.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.909+0000 7f7cc699d700 1 -- 172.21.15.71:0/145069228 shutdown_connections 2023-10-09T06:55:00.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:00.909+0000 7f7cc699d700 1 -- 172.21.15.71:0/145069228 wait complete. 2023-10-09T06:55:00.911 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 17 2023-10-09T06:55:00.927 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T06:55:00.927 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T06:55:00.927 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T06:55:00.927 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:55:00.928 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T06:55:00.928 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T06:55:00.929 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T06:55:00.929 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:55:00.929 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T06:55:00.929 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T06:55:00.929 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T06:55:00.929 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:55:00.930 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T06:55:00.930 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T06:55:00.930 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T06:55:00.930 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:55:00.941 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T06:55:00.941 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T06:55:00.942 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T06:55:00.942 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T06:55:00.947 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T06:55:00.947 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T06:55:00.947 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T06:55:00.948 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T06:55:00.986 INFO:tasks.ceph.mds.a:Started 2023-10-09T06:55:00.987 DEBUG:teuthology.parallel:result is None 2023-10-09T06:55:00.990 INFO:tasks.ceph.mds.c:Started 2023-10-09T06:55:00.990 DEBUG:teuthology.parallel:result is None 2023-10-09T06:55:00.992 INFO:tasks.ceph.mds.d:Started 2023-10-09T06:55:00.992 DEBUG:teuthology.parallel:result is None 2023-10-09T06:55:00.994 INFO:tasks.ceph.mds.b:Started 2023-10-09T06:55:00.994 DEBUG:teuthology.parallel:result is None 2023-10-09T06:55:00.995 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T06:55:01.121 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2023-10-09T06:55:01.127 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-10-09T06:55:01.132 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-09T06:55:01.132 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-09T06:55:01.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.188+0000 7f3425bff700 1 Processor -- start 2023-10-09T06:55:01.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.189+0000 7f3425bff700 1 -- start start 2023-10-09T06:55:01.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.190+0000 7f3425bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f34200b1c20 0x7f34201572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:01.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.190+0000 7f3425bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3420157820 0x7f34200abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:01.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.190+0000 7f3425bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3420157c60 con 0x7f34200b1850 2023-10-09T06:55:01.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.190+0000 7f3425bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f342006fc30 con 0x7f34200b1c20 2023-10-09T06:55:01.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.190+0000 7f3425bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34200cc260 con 0x7f3420157820 2023-10-09T06:55:01.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.190+0000 7f341effd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f34200b1c20 0x7f34201572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:01.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.190+0000 7f341effd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f34200b1c20 0x7f34201572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38390/0 (socket says 172.21.15.71:38390) 2023-10-09T06:55:01.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.190+0000 7f341effd700 1 -- 172.21.15.71:0/1240425570 learned_addr learned my addr 172.21.15.71:0/1240425570 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:01.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.190+0000 7f341ffff700 1 --2- 172.21.15.71:0/1240425570 >> v2:172.21.15.179:3300/0 conn(0x7f3420157820 0x7f34200abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:01.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.191+0000 7f341effd700 1 -- 172.21.15.71:0/1240425570 >> v2:172.21.15.179:3300/0 conn(0x7f3420157820 msgr2=0x7f34200abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:01.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.191+0000 7f341effd700 1 --2- 172.21.15.71:0/1240425570 >> v2:172.21.15.179:3300/0 conn(0x7f3420157820 0x7f34200abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:01.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.191+0000 7f341effd700 1 -- 172.21.15.71:0/1240425570 >> v1:172.21.15.179:6789/0 conn(0x7f34200b1850 legacy=0x7f34200ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:01.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.191+0000 7f341effd700 1 -- 172.21.15.71:0/1240425570 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34200cb300 con 0x7f34200b1c20 2023-10-09T06:55:01.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.191+0000 7f341effd700 1 --2- 172.21.15.71:0/1240425570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34200b1c20 0x7f34201572e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f34200cc160 tx=0x7f3414009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8fed89a82c1d18 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:01.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.191+0000 7f341e7fc700 1 -- 172.21.15.71:0/1240425570 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3414009e70 con 0x7f34200b1c20 2023-10-09T06:55:01.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.191+0000 7f341e7fc700 1 -- 172.21.15.71:0/1240425570 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341400b860 con 0x7f34200b1c20 2023-10-09T06:55:01.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.191+0000 7f341e7fc700 1 -- 172.21.15.71:0/1240425570 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341400bc00 con 0x7f34200b1c20 2023-10-09T06:55:01.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.192+0000 7f3425bff700 1 -- 172.21.15.71:0/1240425570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34200b1c20 msgr2=0x7f34201572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:01.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.192+0000 7f3425bff700 1 --2- 172.21.15.71:0/1240425570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34200b1c20 0x7f34201572e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f34200cc160 tx=0x7f3414009250 comp rx=0 tx=0).stop 2023-10-09T06:55:01.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.192+0000 7f3425bff700 1 -- 172.21.15.71:0/1240425570 shutdown_connections 2023-10-09T06:55:01.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.192+0000 7f3425bff700 1 --2- 172.21.15.71:0/1240425570 >> v2:172.21.15.179:3300/0 conn(0x7f3420157820 0x7f34200abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:01.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.192+0000 7f3425bff700 1 --2- 172.21.15.71:0/1240425570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34200b1c20 0x7f34201572e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:01.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.192+0000 7f3425bff700 1 -- 172.21.15.71:0/1240425570 >> 172.21.15.71:0/1240425570 conn(0x7f342006a320 msgr2=0x7f34200cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:01.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.192+0000 7f3425bff700 1 -- 172.21.15.71:0/1240425570 shutdown_connections 2023-10-09T06:55:01.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.192+0000 7f3425bff700 1 -- 172.21.15.71:0/1240425570 wait complete. 2023-10-09T06:55:01.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.193+0000 7f3425bff700 1 Processor -- start 2023-10-09T06:55:01.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.193+0000 7f3425bff700 1 -- start start 2023-10-09T06:55:01.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.194+0000 7f3425bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34200b1850 0x7f3420151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:01.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.194+0000 7f3425bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34200b1c20 0x7f342016b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:01.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.194+0000 7f3425bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3420157820 0x7f342013c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:01.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.194+0000 7f3425bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3420168b30 con 0x7f3420157820 2023-10-09T06:55:01.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.194+0000 7f3425bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34201690d0 con 0x7f34200b1c20 2023-10-09T06:55:01.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.194+0000 7f3425bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342016ba50 con 0x7f34200b1850 2023-10-09T06:55:01.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.194+0000 7f341ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3420157820 0x7f342013c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:01.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.195+0000 7f341ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3420157820 0x7f342013c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38398/0 (socket says 172.21.15.71:38398) 2023-10-09T06:55:01.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.195+0000 7f341ffff700 1 -- 172.21.15.71:0/2506433822 learned_addr learned my addr 172.21.15.71:0/2506433822 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:01.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.195+0000 7f341effd700 1 --2- 172.21.15.71:0/2506433822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34200b1c20 0x7f342016b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:01.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.195+0000 7f341f7fe700 1 --2- 172.21.15.71:0/2506433822 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34200b1850 0x7f3420151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:01.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.195+0000 7f341ffff700 1 -- 172.21.15.71:0/2506433822 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34200b1850 msgr2=0x7f3420151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:01.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.195+0000 7f341ffff700 1 --2- 172.21.15.71:0/2506433822 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34200b1850 0x7f3420151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:01.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.195+0000 7f341ffff700 1 -- 172.21.15.71:0/2506433822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34200b1c20 msgr2=0x7f342016b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:01.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.195+0000 7f341ffff700 1 --2- 172.21.15.71:0/2506433822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34200b1c20 0x7f342016b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:01.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.195+0000 7f341ffff700 1 -- 172.21.15.71:0/2506433822 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34140094f0 con 0x7f3420157820 2023-10-09T06:55:01.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.195+0000 7f341effd700 1 --2- 172.21.15.71:0/2506433822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34200b1c20 0x7f342016b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:55:01.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.195+0000 7f341ffff700 1 --2- 172.21.15.71:0/2506433822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3420157820 0x7f342013c400 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f3418009df0 tx=0x7f341800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:01.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.195+0000 7f34077fe700 1 -- 172.21.15.71:0/2506433822 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341800cb50 con 0x7f3420157820 2023-10-09T06:55:01.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.195+0000 7f34077fe700 1 -- 172.21.15.71:0/2506433822 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341800f040 con 0x7f3420157820 2023-10-09T06:55:01.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.195+0000 7f34077fe700 1 -- 172.21.15.71:0/2506433822 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3418014480 con 0x7f3420157820 2023-10-09T06:55:01.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.195+0000 7f3425bff700 1 -- 172.21.15.71:0/2506433822 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f342016bd30 con 0x7f3420157820 2023-10-09T06:55:01.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.196+0000 7f3425bff700 1 -- 172.21.15.71:0/2506433822 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3420150340 con 0x7f3420157820 2023-10-09T06:55:01.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.196+0000 7f3425bff700 1 -- 172.21.15.71:0/2506433822 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3420169240 con 0x7f3420157820 2023-10-09T06:55:01.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.197+0000 7f34077fe700 1 -- 172.21.15.71:0/2506433822 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3418014830 con 0x7f3420157820 2023-10-09T06:55:01.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.198+0000 7f34077fe700 1 --2- 172.21.15.71:0/2506433822 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f340c066f30 0x7f340c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:01.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.198+0000 7f34077fe700 1 -- 172.21.15.71:0/2506433822 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5862+0+0 (secure 0 0 0) 0x7f3418084ff0 con 0x7f3420157820 2023-10-09T06:55:01.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.199+0000 7f341f7fe700 1 --2- 172.21.15.71:0/2506433822 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f340c066f30 0x7f340c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:01.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.199+0000 7f341f7fe700 1 --2- 172.21.15.71:0/2506433822 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f340c066f30 0x7f340c0693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f34100037c0 tx=0x7f3410009040 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:01.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.202+0000 7f34077fe700 1 -- 172.21.15.71:0/2506433822 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3418052120 con 0x7f3420157820 2023-10-09T06:55:01.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.407+0000 7f3425bff700 1 -- 172.21.15.71:0/2506433822 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f342004c3c0 con 0x7f3420157820 2023-10-09T06:55:01.747 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:55:01.752 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:55:01.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.904+0000 7f34077fe700 1 -- 172.21.15.71:0/2506433822 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v56) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3418055740 con 0x7f3420157820 2023-10-09T06:55:01.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.906+0000 7f3425bff700 1 -- 172.21.15.71:0/2506433822 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f340c066f30 msgr2=0x7f340c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:01.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.906+0000 7f3425bff700 1 --2- 172.21.15.71:0/2506433822 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f340c066f30 0x7f340c0693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f34100037c0 tx=0x7f3410009040 comp rx=0 tx=0).stop 2023-10-09T06:55:01.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.906+0000 7f3425bff700 1 -- 172.21.15.71:0/2506433822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3420157820 msgr2=0x7f342013c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:01.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.906+0000 7f3425bff700 1 --2- 172.21.15.71:0/2506433822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3420157820 0x7f342013c400 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f3418009df0 tx=0x7f341800b040 comp rx=0 tx=0).stop 2023-10-09T06:55:01.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.906+0000 7f3425bff700 1 -- 172.21.15.71:0/2506433822 shutdown_connections 2023-10-09T06:55:01.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.906+0000 7f3425bff700 1 --2- 172.21.15.71:0/2506433822 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f340c066f30 0x7f340c0693e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:01.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.906+0000 7f3425bff700 1 --2- 172.21.15.71:0/2506433822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3420157820 0x7f342013c400 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:01.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.906+0000 7f3425bff700 1 --2- 172.21.15.71:0/2506433822 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34200b1850 0x7f3420151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:01.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.906+0000 7f3425bff700 1 --2- 172.21.15.71:0/2506433822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34200b1c20 0x7f342016b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:01.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.906+0000 7f3425bff700 1 -- 172.21.15.71:0/2506433822 >> 172.21.15.71:0/2506433822 conn(0x7f342006a320 msgr2=0x7f3420153120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:01.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.906+0000 7f3425bff700 1 -- 172.21.15.71:0/2506433822 shutdown_connections 2023-10-09T06:55:01.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:01.906+0000 7f3425bff700 1 -- 172.21.15.71:0/2506433822 wait complete. 2023-10-09T06:55:01.908 INFO:teuthology.orchestra.run.smithi071.stderr: removed all blocklist entries 2023-10-09T06:55:01.925 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T06:55:02.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.105+0000 7fdb6ad9d700 1 Processor -- start 2023-10-09T06:55:02.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.106+0000 7fdb6ad9d700 1 -- start start 2023-10-09T06:55:02.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.107+0000 7fdb6ad9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb64150180 0x7fdb64157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:02.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.107+0000 7fdb6ad9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdb64150550 0x7fdb640c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:02.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.107+0000 7fdb6ad9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6406e2a0 con 0x7fdb640c7240 2023-10-09T06:55:02.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.107+0000 7fdb6ad9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb640c76e0 con 0x7fdb64150550 2023-10-09T06:55:02.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.107+0000 7fdb6ad9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6406b2e0 con 0x7fdb64150180 2023-10-09T06:55:02.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.107+0000 7fdb6959a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdb64150550 0x7fdb640c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:02.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.107+0000 7fdb6a59c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fdb640c7240 0x7fdb64069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:42024/0 (socket says 172.21.15.71:42024) 2023-10-09T06:55:02.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.107+0000 7fdb6959a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdb64150550 0x7fdb640c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38404/0 (socket says 172.21.15.71:38404) 2023-10-09T06:55:02.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.107+0000 7fdb6a59c700 1 -- 172.21.15.71:0/2118014939 learned_addr learned my addr 172.21.15.71:0/2118014939 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:55:02.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.107+0000 7fdb69d9b700 1 --2- 172.21.15.71:0/2118014939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb64150180 0x7fdb64157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:02.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.108+0000 7fdb6959a700 1 -- 172.21.15.71:0/2118014939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb64150180 msgr2=0x7fdb64157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:02.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.108+0000 7fdb6959a700 1 --2- 172.21.15.71:0/2118014939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb64150180 0x7fdb64157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:02.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.108+0000 7fdb6959a700 1 -- 172.21.15.71:0/2118014939 >> v1:172.21.15.71:6789/0 conn(0x7fdb640c7240 legacy=0x7fdb64069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:02.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.108+0000 7fdb6959a700 1 -- 172.21.15.71:0/2118014939 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb640c78e0 con 0x7fdb64150550 2023-10-09T06:55:02.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.108+0000 7fdb68d99700 1 -- 172.21.15.71:0/2118014939 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149338000 0 0) 0x7fdb6406e2a0 con 0x7fdb640c7240 2023-10-09T06:55:02.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.108+0000 7fdb6959a700 1 --2- 172.21.15.71:0/2118014939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb64150550 0x7fdb640c6d00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400bb90 tx=0x7fdb5400b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b10cfbe8d2b380a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:02.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.108+0000 7fdb68d99700 1 -- 172.21.15.71:0/2118014939 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5400db40 con 0x7fdb64150550 2023-10-09T06:55:02.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.108+0000 7fdb68d99700 1 -- 172.21.15.71:0/2118014939 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5400dca0 con 0x7fdb64150550 2023-10-09T06:55:02.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.108+0000 7fdb68d99700 1 -- 172.21.15.71:0/2118014939 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb540196b0 con 0x7fdb64150550 2023-10-09T06:55:02.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.109+0000 7fdb6ad9d700 1 -- 172.21.15.71:0/2118014939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb64150550 msgr2=0x7fdb640c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:02.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.109+0000 7fdb6ad9d700 1 --2- 172.21.15.71:0/2118014939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb64150550 0x7fdb640c6d00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400bb90 tx=0x7fdb5400b430 comp rx=0 tx=0).stop 2023-10-09T06:55:02.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.109+0000 7fdb6ad9d700 1 -- 172.21.15.71:0/2118014939 shutdown_connections 2023-10-09T06:55:02.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.109+0000 7fdb6ad9d700 1 --2- 172.21.15.71:0/2118014939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb64150180 0x7fdb64157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:02.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.109+0000 7fdb6ad9d700 1 --2- 172.21.15.71:0/2118014939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb64150550 0x7fdb640c6d00 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:02.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.109+0000 7fdb6ad9d700 1 -- 172.21.15.71:0/2118014939 >> 172.21.15.71:0/2118014939 conn(0x7fdb640cc1f0 msgr2=0x7fdb640cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:02.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.109+0000 7fdb6ad9d700 1 -- 172.21.15.71:0/2118014939 shutdown_connections 2023-10-09T06:55:02.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.109+0000 7fdb6ad9d700 1 -- 172.21.15.71:0/2118014939 wait complete. 2023-10-09T06:55:02.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.110+0000 7fdb6ad9d700 1 Processor -- start 2023-10-09T06:55:02.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.110+0000 7fdb6ad9d700 1 -- start start 2023-10-09T06:55:02.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.111+0000 7fdb6ad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb640c7240 0x7fdb6414af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:02.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.111+0000 7fdb6ad9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb64150180 0x7fdb640b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:02.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.111+0000 7fdb6ad9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb64150550 0x7fdb64069dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:02.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.111+0000 7fdb6ad9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6414d760 con 0x7fdb640c7240 2023-10-09T06:55:02.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.111+0000 7fdb6ad9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6414d430 con 0x7fdb64150180 2023-10-09T06:55:02.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.111+0000 7fdb6ad9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640afa40 con 0x7fdb64150550 2023-10-09T06:55:02.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.112+0000 7fdb69d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb640c7240 0x7fdb6414af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:02.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.112+0000 7fdb69d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb640c7240 0x7fdb6414af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38420/0 (socket says 172.21.15.71:38420) 2023-10-09T06:55:02.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.112+0000 7fdb69d9b700 1 -- 172.21.15.71:0/4001528085 learned_addr learned my addr 172.21.15.71:0/4001528085 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:02.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.112+0000 7fdb6959a700 1 --2- 172.21.15.71:0/4001528085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb64150180 0x7fdb640b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:02.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.112+0000 7fdb6a59c700 1 --2- 172.21.15.71:0/4001528085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb64150550 0x7fdb64069dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:02.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.112+0000 7fdb69d9b700 1 -- 172.21.15.71:0/4001528085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb64150550 msgr2=0x7fdb64069dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:02.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.112+0000 7fdb69d9b700 1 --2- 172.21.15.71:0/4001528085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb64150550 0x7fdb64069dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:02.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.112+0000 7fdb69d9b700 1 -- 172.21.15.71:0/4001528085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb64150180 msgr2=0x7fdb640b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:02.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.112+0000 7fdb69d9b700 1 --2- 172.21.15.71:0/4001528085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb64150180 0x7fdb640b15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:02.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.112+0000 7fdb69d9b700 1 -- 172.21.15.71:0/4001528085 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5400b6d0 con 0x7fdb640c7240 2023-10-09T06:55:02.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.112+0000 7fdb69d9b700 1 --2- 172.21.15.71:0/4001528085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb640c7240 0x7fdb6414af30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000ec80 tx=0x7fdb600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:02.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.112+0000 7fdb59ffb700 1 -- 172.21.15.71:0/4001528085 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6000c850 con 0x7fdb640c7240 2023-10-09T06:55:02.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.112+0000 7fdb59ffb700 1 -- 172.21.15.71:0/4001528085 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6000c9b0 con 0x7fdb640c7240 2023-10-09T06:55:02.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.113+0000 7fdb6ad9d700 1 -- 172.21.15.71:0/4001528085 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb640afd20 con 0x7fdb640c7240 2023-10-09T06:55:02.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.113+0000 7fdb59ffb700 1 -- 172.21.15.71:0/4001528085 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6000cd50 con 0x7fdb640c7240 2023-10-09T06:55:02.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.113+0000 7fdb6ad9d700 1 -- 172.21.15.71:0/4001528085 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb640b0000 con 0x7fdb640c7240 2023-10-09T06:55:02.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.114+0000 7fdb6ad9d700 1 -- 172.21.15.71:0/4001528085 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6414da40 con 0x7fdb640c7240 2023-10-09T06:55:02.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.114+0000 7fdb59ffb700 1 -- 172.21.15.71:0/4001528085 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb60013680 con 0x7fdb640c7240 2023-10-09T06:55:02.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.116+0000 7fdb59ffb700 1 --2- 172.21.15.71:0/4001528085 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb48066f30 0x7fdb480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:02.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.116+0000 7fdb59ffb700 1 -- 172.21.15.71:0/4001528085 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5217+0+0 (secure 0 0 0) 0x7fdb600846b0 con 0x7fdb640c7240 2023-10-09T06:55:02.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.116+0000 7fdb6959a700 1 --2- 172.21.15.71:0/4001528085 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb48066f30 0x7fdb480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:02.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.117+0000 7fdb6959a700 1 --2- 172.21.15.71:0/4001528085 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb48066f30 0x7fdb480693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400b6a0 tx=0x7fdb5401b000 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:02.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.120+0000 7fdb59ffb700 1 -- 172.21.15.71:0/4001528085 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb60051a60 con 0x7fdb640c7240 2023-10-09T06:55:02.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.385+0000 7fdb6ad9d700 1 -- 172.21.15.71:0/4001528085 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fdb6414c380 con 0x7fdb640c7240 2023-10-09T06:55:02.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.386+0000 7fdb59ffb700 1 -- 172.21.15.71:0/4001528085 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fdb60055080 con 0x7fdb640c7240 2023-10-09T06:55:02.386 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:55:02.386 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T06:55:02.386 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_dump": [ 2023-10-09T06:55:02.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:55:02.386 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.a", 2023-10-09T06:55:02.386 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlpI5JCRAAGBgrs6g+6KZFXv1eq0fkwQ==", 2023-10-09T06:55:02.386 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:55:02.386 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:55:02.386 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:55:02.386 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:55:02.387 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:55:02.387 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:55:02.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:55:02.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:55:02.387 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.b", 2023-10-09T06:55:02.387 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlDZQYHhAA2LGKHPLrBVKlGMK0TKup7A==", 2023-10-09T06:55:02.387 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:55:02.387 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:55:02.387 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:55:02.387 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:55:02.387 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:55:02.387 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:55:02.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:55:02.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:55:02.388 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.c", 2023-10-09T06:55:02.388 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlLKKfExAA65+KIyYd16iQ2L5topDPkg==", 2023-10-09T06:55:02.388 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:55:02.388 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:55:02.388 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:55:02.388 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:55:02.388 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:55:02.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:55:02.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:55:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:55:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.d", 2023-10-09T06:55:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlpQKTKBAAP59h/znElthIdqbK9tKJww==", 2023-10-09T06:55:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:55:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:55:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:55:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:55:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:55:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:55:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:55:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:55:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.0", 2023-10-09T06:55:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCgoCNll7hBIBAAtZ8mBx+MPAwEou48boP4Hw==", 2023-10-09T06:55:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:55:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:55:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:55:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:55:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:55:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:55:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:55:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.1", 2023-10-09T06:55:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCjoCNl7uRMIxAAztQi4ZsulyN2FHcMRzZ82Q==", 2023-10-09T06:55:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:55:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:55:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:55:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:55:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:55:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:55:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:55:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.2", 2023-10-09T06:55:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCmoCNlW/cNJhAAfFdnRC95YJwpCngJS956cA==", 2023-10-09T06:55:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:55:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:55:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:55:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:55:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:55:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:55:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:55:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.3", 2023-10-09T06:55:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCpoCNlAIlYKRAAD5IGHWZ14ckpQAU4wBifbg==", 2023-10-09T06:55:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:55:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:55:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:55:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:55:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:55:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:55:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:55:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.4", 2023-10-09T06:55:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCvoCNltrA4ORAAtifmL9hr1xKd+jsMf5Nf+Q==", 2023-10-09T06:55:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:55:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:55:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:55:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:55:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:55:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:55:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:55:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.5", 2023-10-09T06:55:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCyoCNlA/IOOxAAQWRPQ+00o9xrpScAvY/87w==", 2023-10-09T06:55:02.394 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:55:02.394 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:55:02.394 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:55:02.394 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:55:02.394 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:55:02.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:55:02.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:55:02.394 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.6", 2023-10-09T06:55:02.394 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQC2oCNlvRusARAAcRaGyCROIRVTHeKhrncN8g==", 2023-10-09T06:55:02.394 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:55:02.394 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:55:02.395 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:55:02.395 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:55:02.395 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:55:02.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:55:02.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:55:02.395 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.7", 2023-10-09T06:55:02.395 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQC5oCNli/3NAxAAIMYuED41ZSx1xF384N6y1A==", 2023-10-09T06:55:02.395 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:55:02.395 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:55:02.395 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:55:02.395 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:55:02.395 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:55:02.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:55:02.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:55:02.396 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.0", 2023-10-09T06:55:02.396 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlHrKWMRAAyIfmryGSgqIFwWEJyixprw==", 2023-10-09T06:55:02.396 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:55:02.396 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:55:02.396 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow r", 2023-10-09T06:55:02.396 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T06:55:02.396 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:55:02.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:55:02.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:55:02.396 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.1", 2023-10-09T06:55:02.397 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCdoCNldq1xAxAAxCpmelS0qDEY187u19JkcQ==", 2023-10-09T06:55:02.397 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:55:02.397 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:55:02.397 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T06:55:02.397 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T06:55:02.397 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T06:55:02.397 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:55:02.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:55:02.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:55:02.397 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.2", 2023-10-09T06:55:02.397 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlM3JHOBAA8fszREXH+WnYb+3vIaakcA==", 2023-10-09T06:55:02.397 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:55:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:55:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T06:55:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T06:55:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T06:55:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:55:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:55:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:55:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.3", 2023-10-09T06:55:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCdoCNlgkEqChAAwntdv9UOo30x40pVa70yag==", 2023-10-09T06:55:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:55:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:55:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T06:55:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T06:55:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T06:55:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:55:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:55:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:55:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.admin", 2023-10-09T06:55:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCboCNlj2W4EhAAUnfX6NBeDyMj2nY/G2ciEg==", 2023-10-09T06:55:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:55:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T06:55:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:55:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:55:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:55:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:55:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:55:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:55:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.x", 2023-10-09T06:55:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlwwJ/AhAAjHMhAX1/yWgh9no7yQqP6Q==", 2023-10-09T06:55:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:55:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T06:55:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-09T06:55:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:55:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:55:02.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:55:02.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:55:02.401 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.y", 2023-10-09T06:55:02.401 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCboCNly/XVNRAAlKr9arCbsDbzZ9bpIU5dng==", 2023-10-09T06:55:02.401 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:55:02.401 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T06:55:02.401 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-09T06:55:02.401 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:55:02.401 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:55:02.401 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:55:02.401 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2023-10-09T06:55:02.401 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T06:55:02.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.388+0000 7fdb6ad9d700 1 -- 172.21.15.71:0/4001528085 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb48066f30 msgr2=0x7fdb480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:02.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.388+0000 7fdb6ad9d700 1 --2- 172.21.15.71:0/4001528085 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb48066f30 0x7fdb480693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400b6a0 tx=0x7fdb5401b000 comp rx=0 tx=0).stop 2023-10-09T06:55:02.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.388+0000 7fdb6ad9d700 1 -- 172.21.15.71:0/4001528085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb640c7240 msgr2=0x7fdb6414af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:02.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.388+0000 7fdb6ad9d700 1 --2- 172.21.15.71:0/4001528085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb640c7240 0x7fdb6414af30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000ec80 tx=0x7fdb600091a0 comp rx=0 tx=0).stop 2023-10-09T06:55:02.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.388+0000 7fdb6ad9d700 1 -- 172.21.15.71:0/4001528085 shutdown_connections 2023-10-09T06:55:02.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.388+0000 7fdb6ad9d700 1 --2- 172.21.15.71:0/4001528085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb64150550 0x7fdb64069dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:02.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.388+0000 7fdb6ad9d700 1 --2- 172.21.15.71:0/4001528085 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb48066f30 0x7fdb480693e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:02.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.388+0000 7fdb6ad9d700 1 --2- 172.21.15.71:0/4001528085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb640c7240 0x7fdb6414af30 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:02.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.388+0000 7fdb6ad9d700 1 --2- 172.21.15.71:0/4001528085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb64150180 0x7fdb640b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:02.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.388+0000 7fdb6ad9d700 1 -- 172.21.15.71:0/4001528085 >> 172.21.15.71:0/4001528085 conn(0x7fdb640cc1f0 msgr2=0x7fdb64156b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:02.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.388+0000 7fdb6ad9d700 1 -- 172.21.15.71:0/4001528085 shutdown_connections 2023-10-09T06:55:02.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.388+0000 7fdb6ad9d700 1 -- 172.21.15.71:0/4001528085 wait complete. 2023-10-09T06:55:02.405 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:55:02.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.584+0000 7f320d3ff700 1 Processor -- start 2023-10-09T06:55:02.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.584+0000 7f320d3ff700 1 -- start start 2023-10-09T06:55:02.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.585+0000 7f320d3ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3208159890 0x7f320815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:02.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.585+0000 7f320d3ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f320815a160 con 0x7f3208159c60 2023-10-09T06:55:02.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.585+0000 7f320d3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32080d13a0 con 0x7f3208069560 2023-10-09T06:55:02.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.585+0000 7f320d3ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f320815e140 con 0x7f3208159890 2023-10-09T06:55:02.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.586+0000 7f3206ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3208159890 0x7f320815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:02.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.586+0000 7f3206ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3208159890 0x7f320815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38436/0 (socket says 172.21.15.71:38436) 2023-10-09T06:55:02.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.586+0000 7f3206ffd700 1 -- 172.21.15.71:0/4053869122 learned_addr learned my addr 172.21.15.71:0/4053869122 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:02.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.586+0000 7f32067fc700 1 --1- 172.21.15.71:0/4053869122 >> v1:172.21.15.71:6789/0 conn(0x7f3208159c60 0x7f320815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:42040/0 (socket says 172.21.15.71:42040) 2023-10-09T06:55:02.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.586+0000 7f3206ffd700 1 -- 172.21.15.71:0/4053869122 >> v1:172.21.15.179:6789/0 conn(0x7f3208069560 legacy=0x7f32080ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:02.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.586+0000 7f3206ffd700 1 -- 172.21.15.71:0/4053869122 >> v1:172.21.15.71:6789/0 conn(0x7f3208159c60 legacy=0x7f320815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:02.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.586+0000 7f3206ffd700 1 -- 172.21.15.71:0/4053869122 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320815a3d0 con 0x7f3208159890 2023-10-09T06:55:02.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.586+0000 7f3206ffd700 1 --2- 172.21.15.71:0/4053869122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3208159890 0x7f320815abd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f31f80099b0 tx=0x7f31f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e924dd4141f5279 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:02.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.587+0000 7f3205ffb700 1 -- 172.21.15.71:0/4053869122 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f800b860 con 0x7f3208159890 2023-10-09T06:55:02.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.587+0000 7f3205ffb700 1 -- 172.21.15.71:0/4053869122 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f800b9c0 con 0x7f3208159890 2023-10-09T06:55:02.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.587+0000 7f3205ffb700 1 -- 172.21.15.71:0/4053869122 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f800bd60 con 0x7f3208159890 2023-10-09T06:55:02.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.587+0000 7f320d3ff700 1 -- 172.21.15.71:0/4053869122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3208159890 msgr2=0x7f320815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:02.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.587+0000 7f320d3ff700 1 --2- 172.21.15.71:0/4053869122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3208159890 0x7f320815abd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f31f80099b0 tx=0x7f31f8009250 comp rx=0 tx=0).stop 2023-10-09T06:55:02.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.587+0000 7f320d3ff700 1 -- 172.21.15.71:0/4053869122 shutdown_connections 2023-10-09T06:55:02.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.587+0000 7f320d3ff700 1 --2- 172.21.15.71:0/4053869122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3208159890 0x7f320815abd0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:02.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.587+0000 7f320d3ff700 1 -- 172.21.15.71:0/4053869122 >> 172.21.15.71:0/4053869122 conn(0x7f3208068e20 msgr2=0x7f32080d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:02.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.587+0000 7f320d3ff700 1 -- 172.21.15.71:0/4053869122 shutdown_connections 2023-10-09T06:55:02.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.587+0000 7f320d3ff700 1 -- 172.21.15.71:0/4053869122 wait complete. 2023-10-09T06:55:02.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.589+0000 7f320d3ff700 1 Processor -- start 2023-10-09T06:55:02.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.589+0000 7f320d3ff700 1 -- start start 2023-10-09T06:55:02.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.590+0000 7f320d3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3208069560 0x7f32080b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:02.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.590+0000 7f320d3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3208159890 0x7f320814d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:02.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.590+0000 7f320d3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3208159c60 0x7f32080cea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:02.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.590+0000 7f320d3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32080b3f50 con 0x7f3208159890 2023-10-09T06:55:02.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.590+0000 7f320d3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32080b4140 con 0x7f3208159c60 2023-10-09T06:55:02.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.590+0000 7f320d3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32080b4420 con 0x7f3208069560 2023-10-09T06:55:02.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.590+0000 7f32067fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3208159890 0x7f320814d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:02.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.590+0000 7f32067fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3208159890 0x7f320814d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38448/0 (socket says 172.21.15.71:38448) 2023-10-09T06:55:02.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.590+0000 7f32067fc700 1 -- 172.21.15.71:0/4290763807 learned_addr learned my addr 172.21.15.71:0/4290763807 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:02.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.590+0000 7f3206ffd700 1 --2- 172.21.15.71:0/4290763807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3208069560 0x7f32080b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:02.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.590+0000 7f32077fe700 1 --2- 172.21.15.71:0/4290763807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3208159c60 0x7f32080cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:02.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.590+0000 7f32067fc700 1 -- 172.21.15.71:0/4290763807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3208069560 msgr2=0x7f32080b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:02.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.590+0000 7f32067fc700 1 --2- 172.21.15.71:0/4290763807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3208069560 0x7f32080b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:02.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.590+0000 7f32067fc700 1 -- 172.21.15.71:0/4290763807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3208159c60 msgr2=0x7f32080cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:02.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.590+0000 7f32067fc700 1 --2- 172.21.15.71:0/4290763807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3208159c60 0x7f32080cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:02.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.590+0000 7f32067fc700 1 -- 172.21.15.71:0/4290763807 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f80094f0 con 0x7f3208159890 2023-10-09T06:55:02.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.590+0000 7f32077fe700 1 --2- 172.21.15.71:0/4290763807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3208159c60 0x7f32080cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:55:02.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.590+0000 7f3206ffd700 1 --2- 172.21.15.71:0/4290763807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3208069560 0x7f32080b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:55:02.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.591+0000 7f32067fc700 1 --2- 172.21.15.71:0/4290763807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3208159890 0x7f320814d140 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00c560 tx=0x7f31fc007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:02.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.591+0000 7f31eeffd700 1 -- 172.21.15.71:0/4290763807 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc005a70 con 0x7f3208159890 2023-10-09T06:55:02.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.591+0000 7f31eeffd700 1 -- 172.21.15.71:0/4290763807 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc005bd0 con 0x7f3208159890 2023-10-09T06:55:02.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.591+0000 7f31eeffd700 1 -- 172.21.15.71:0/4290763807 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc0070d0 con 0x7f3208159890 2023-10-09T06:55:02.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.591+0000 7f320d3ff700 1 -- 172.21.15.71:0/4290763807 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32080b4700 con 0x7f3208159890 2023-10-09T06:55:02.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.591+0000 7f320d3ff700 1 -- 172.21.15.71:0/4290763807 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32080b4d40 con 0x7f3208159890 2023-10-09T06:55:02.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.592+0000 7f320d3ff700 1 -- 172.21.15.71:0/4290763807 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32080b4f00 con 0x7f3208159890 2023-10-09T06:55:02.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.593+0000 7f31eeffd700 1 -- 172.21.15.71:0/4290763807 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f31fc007480 con 0x7f3208159890 2023-10-09T06:55:02.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.594+0000 7f31eeffd700 1 --2- 172.21.15.71:0/4290763807 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f31f4066f60 0x7f31f4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:02.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.594+0000 7f31eeffd700 1 -- 172.21.15.71:0/4290763807 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5217+0+0 (secure 0 0 0) 0x7f31fc083900 con 0x7f3208159890 2023-10-09T06:55:02.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.594+0000 7f3206ffd700 1 --2- 172.21.15.71:0/4290763807 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f31f4066f60 0x7f31f4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:02.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.595+0000 7f3206ffd700 1 --2- 172.21.15.71:0/4290763807 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f31f4066f60 0x7f31f4069410 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f31f80099b0 tx=0x7f31f8017000 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:02.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.598+0000 7f31eeffd700 1 -- 172.21.15.71:0/4290763807 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32080b4f00 con 0x7f3208159890 2023-10-09T06:55:02.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.790+0000 7f320d3ff700 1 -- 172.21.15.71:0/4290763807 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32080b4f00 con 0x7f3208159890 2023-10-09T06:55:02.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.791+0000 7f31eeffd700 1 -- 172.21.15.71:0/4290763807 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+12684 (secure 0 0 0) 0x7f32080b4f00 con 0x7f3208159890 2023-10-09T06:55:02.792 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:55:02.792 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":58,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:55:01.909930+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:55:02.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.793+0000 7f320d3ff700 1 -- 172.21.15.71:0/4290763807 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f31f4066f60 msgr2=0x7f31f4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:02.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.793+0000 7f320d3ff700 1 --2- 172.21.15.71:0/4290763807 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f31f4066f60 0x7f31f4069410 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f31f80099b0 tx=0x7f31f8017000 comp rx=0 tx=0).stop 2023-10-09T06:55:02.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.793+0000 7f320d3ff700 1 -- 172.21.15.71:0/4290763807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3208159890 msgr2=0x7f320814d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:02.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.793+0000 7f320d3ff700 1 --2- 172.21.15.71:0/4290763807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3208159890 0x7f320814d140 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00c560 tx=0x7f31fc007f70 comp rx=0 tx=0).stop 2023-10-09T06:55:02.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.793+0000 7f320d3ff700 1 -- 172.21.15.71:0/4290763807 shutdown_connections 2023-10-09T06:55:02.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.793+0000 7f320d3ff700 1 --2- 172.21.15.71:0/4290763807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3208159c60 0x7f32080cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:02.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.793+0000 7f320d3ff700 1 --2- 172.21.15.71:0/4290763807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3208069560 0x7f32080b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:02.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.793+0000 7f320d3ff700 1 --2- 172.21.15.71:0/4290763807 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f31f4066f60 0x7f31f4069410 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:02.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.793+0000 7f320d3ff700 1 --2- 172.21.15.71:0/4290763807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3208159890 0x7f320814d140 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:02.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.793+0000 7f320d3ff700 1 -- 172.21.15.71:0/4290763807 >> 172.21.15.71:0/4290763807 conn(0x7f3208068e20 msgr2=0x7f32080b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:02.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.793+0000 7f320d3ff700 1 -- 172.21.15.71:0/4290763807 shutdown_connections 2023-10-09T06:55:02.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.793+0000 7f320d3ff700 1 -- 172.21.15.71:0/4290763807 wait complete. 2023-10-09T06:55:02.812 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T06:55:02.812 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:55:02.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.995+0000 7fe8af39d700 1 Processor -- start 2023-10-09T06:55:02.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.996+0000 7fe8af39d700 1 -- start start 2023-10-09T06:55:02.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.997+0000 7fe8af39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8a8153900 0x7fe8a80c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:02.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.997+0000 7fe8af39d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe8a80c9db0 0x7fe8a806a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:02.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.997+0000 7fe8af39d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a806e150 con 0x7fe8a8157130 2023-10-09T06:55:02.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.997+0000 7fe8af39d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a80c7800 con 0x7fe8a80c9db0 2023-10-09T06:55:02.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.997+0000 7fe8af39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a80c7ae0 con 0x7fe8a8153900 2023-10-09T06:55:02.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.997+0000 7fe8aeb9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe8a8157130 0x7fe8a8159ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:42050/0 (socket says 172.21.15.71:42050) 2023-10-09T06:55:02.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.997+0000 7fe8aeb9c700 1 -- 172.21.15.71:0/172176036 learned_addr learned my addr 172.21.15.71:0/172176036 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:55:03.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.998+0000 7fe8adb9a700 1 --2- 172.21.15.71:0/172176036 >> v2:172.21.15.179:3300/0 conn(0x7fe8a80c9db0 0x7fe8a806a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:03.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.998+0000 7fe8ae39b700 1 --2- 172.21.15.71:0/172176036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8a8153900 0x7fe8a80c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:03.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.998+0000 7fe8ad399700 1 -- 172.21.15.71:0/172176036 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144520220 0 0) 0x7fe8a806e150 con 0x7fe8a8157130 2023-10-09T06:55:03.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.998+0000 7fe8ad399700 1 -- 172.21.15.71:0/172176036 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe894003570 con 0x7fe8a8157130 2023-10-09T06:55:03.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.998+0000 7fe8ad399700 1 -- 172.21.15.71:0/172176036 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2006703858 0 0) 0x7fe894003570 con 0x7fe8a8157130 2023-10-09T06:55:03.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.998+0000 7fe8ad399700 1 -- 172.21.15.71:0/172176036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8a8153900 msgr2=0x7fe8a80c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:03.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.998+0000 7fe8ad399700 1 --2- 172.21.15.71:0/172176036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8a8153900 0x7fe8a80c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.998+0000 7fe8ad399700 1 -- 172.21.15.71:0/172176036 >> v2:172.21.15.179:3300/0 conn(0x7fe8a80c9db0 msgr2=0x7fe8a806a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:03.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.998+0000 7fe8ad399700 1 --2- 172.21.15.71:0/172176036 >> v2:172.21.15.179:3300/0 conn(0x7fe8a80c9db0 0x7fe8a806a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.998+0000 7fe8ad399700 1 -- 172.21.15.71:0/172176036 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a80c7dc0 con 0x7fe8a8157130 2023-10-09T06:55:03.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.998+0000 7fe8ad399700 1 -- 172.21.15.71:0/172176036 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fe8a00017f0 con 0x7fe8a8157130 2023-10-09T06:55:03.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.998+0000 7fe8ad399700 1 -- 172.21.15.71:0/172176036 >> v1:172.21.15.71:6789/0 conn(0x7fe8a8157130 legacy=0x7fe8a8159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:03.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.998+0000 7fe8ad399700 1 --2- 172.21.15.71:0/172176036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe894003a60 0x7fe894003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:03.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.998+0000 7fe8ad399700 1 --2- 172.21.15.71:0/172176036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8a8153900 0x7fe894004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:03.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.998+0000 7fe8ad399700 1 --2- 172.21.15.71:0/172176036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe894004d50 0x7fe8940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:03.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.998+0000 7fe8ad399700 1 -- 172.21.15.71:0/172176036 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a80c7800 con 0x7fe894004d50 2023-10-09T06:55:03.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.998+0000 7fe8ad399700 1 -- 172.21.15.71:0/172176036 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a80c7ae0 con 0x7fe894003a60 2023-10-09T06:55:03.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.998+0000 7fe8ad399700 1 -- 172.21.15.71:0/172176036 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89400ba60 con 0x7fe8a8153900 2023-10-09T06:55:03.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.998+0000 7fe8aeb9c700 1 --2- 172.21.15.71:0/172176036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe894004d50 0x7fe8940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:03.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.999+0000 7fe8ae39b700 1 --2- 172.21.15.71:0/172176036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe894003a60 0x7fe894003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:03.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.999+0000 7fe8adb9a700 1 --2- 172.21.15.71:0/172176036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8a8153900 0x7fe894004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:03.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.999+0000 7fe8aeb9c700 1 -- 172.21.15.71:0/172176036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8a8153900 msgr2=0x7fe894004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:03.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.999+0000 7fe8aeb9c700 1 --2- 172.21.15.71:0/172176036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8a8153900 0x7fe894004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.999+0000 7fe8aeb9c700 1 -- 172.21.15.71:0/172176036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe894003a60 msgr2=0x7fe894003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:03.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.999+0000 7fe8aeb9c700 1 --2- 172.21.15.71:0/172176036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe894003a60 0x7fe894003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.999+0000 7fe8aeb9c700 1 -- 172.21.15.71:0/172176036 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe894003570 con 0x7fe894004d50 2023-10-09T06:55:03.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.999+0000 7fe8aeb9c700 1 --2- 172.21.15.71:0/172176036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe894004d50 0x7fe8940051c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000a940 tx=0x7fe8a0002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de7c045bc63d3c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:03.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.999+0000 7fe8ad399700 1 -- 172.21.15.71:0/172176036 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0012440 con 0x7fe894004d50 2023-10-09T06:55:03.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.999+0000 7fe8ad399700 1 -- 172.21.15.71:0/172176036 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a00125c0 con 0x7fe894004d50 2023-10-09T06:55:03.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:02.999+0000 7fe8ad399700 1 -- 172.21.15.71:0/172176036 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0012980 con 0x7fe894004d50 2023-10-09T06:55:03.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.000+0000 7fe8af39d700 1 -- 172.21.15.71:0/172176036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe894004d50 msgr2=0x7fe8940051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:03.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.000+0000 7fe8af39d700 1 --2- 172.21.15.71:0/172176036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe894004d50 0x7fe8940051c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000a940 tx=0x7fe8a0002210 comp rx=0 tx=0).stop 2023-10-09T06:55:03.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.000+0000 7fe8aeb9c700 1 -- 172.21.15.71:0/172176036 reap_dead start 2023-10-09T06:55:03.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.000+0000 7fe8af39d700 1 -- 172.21.15.71:0/172176036 shutdown_connections 2023-10-09T06:55:03.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.000+0000 7fe8af39d700 1 -- 172.21.15.71:0/172176036 >> 172.21.15.71:0/172176036 conn(0x7fe8a80cc1e0 msgr2=0x7fe8a80cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:03.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.000+0000 7fe8af39d700 1 -- 172.21.15.71:0/172176036 shutdown_connections 2023-10-09T06:55:03.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.000+0000 7fe8af39d700 1 -- 172.21.15.71:0/172176036 wait complete. 2023-10-09T06:55:03.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.002+0000 7fe8af39d700 1 Processor -- start 2023-10-09T06:55:03.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.002+0000 7fe8af39d700 1 -- start start 2023-10-09T06:55:03.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.003+0000 7fe8af39d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe894004d50 0x7fe8a80af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:03.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.003+0000 7fe8af39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8a8166970 0x7fe8a80b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:03.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.003+0000 7fe8af39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8a813f570 0x7fe8a813f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:03.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.003+0000 7fe8af39d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a80b1fa0 con 0x7fe894004d50 2023-10-09T06:55:03.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.003+0000 7fe8af39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a8158090 con 0x7fe8a8166970 2023-10-09T06:55:03.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.003+0000 7fe8af39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a81577a0 con 0x7fe8a813f570 2023-10-09T06:55:03.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.003+0000 7fe8ae39b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe894004d50 0x7fe8a80af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:03.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.003+0000 7fe8ae39b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe894004d50 0x7fe8a80af420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38466/0 (socket says 172.21.15.71:38466) 2023-10-09T06:55:03.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.003+0000 7fe8ae39b700 1 -- 172.21.15.71:0/859934742 learned_addr learned my addr 172.21.15.71:0/859934742 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:03.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.003+0000 7fe8ae39b700 1 -- 172.21.15.71:0/859934742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8a813f570 msgr2=0x7fe8a813f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:03.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.003+0000 7fe8ae39b700 1 --2- 172.21.15.71:0/859934742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8a813f570 0x7fe8a813f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.003+0000 7fe8ae39b700 1 -- 172.21.15.71:0/859934742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8a8166970 msgr2=0x7fe8a80b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:03.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.003+0000 7fe8ae39b700 1 --2- 172.21.15.71:0/859934742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8a8166970 0x7fe8a80b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.003+0000 7fe8ae39b700 1 -- 172.21.15.71:0/859934742 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a8157a40 con 0x7fe894004d50 2023-10-09T06:55:03.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.003+0000 7fe8ae39b700 1 --2- 172.21.15.71:0/859934742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe894004d50 0x7fe8a80af420 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4011bb0 tx=0x7fe8a400a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:03.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.004+0000 7fe89e7fc700 1 -- 172.21.15.71:0/859934742 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a400fb60 con 0x7fe894004d50 2023-10-09T06:55:03.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.004+0000 7fe89e7fc700 1 -- 172.21.15.71:0/859934742 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a400fcc0 con 0x7fe894004d50 2023-10-09T06:55:03.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.004+0000 7fe8af39d700 1 -- 172.21.15.71:0/859934742 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a8157d20 con 0x7fe894004d50 2023-10-09T06:55:03.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.004+0000 7fe89e7fc700 1 -- 172.21.15.71:0/859934742 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a4013440 con 0x7fe894004d50 2023-10-09T06:55:03.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.004+0000 7fe8af39d700 1 -- 172.21.15.71:0/859934742 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a80b1bf0 con 0x7fe894004d50 2023-10-09T06:55:03.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.005+0000 7fe8af39d700 1 -- 172.21.15.71:0/859934742 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a806c450 con 0x7fe894004d50 2023-10-09T06:55:03.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.006+0000 7fe89e7fc700 1 -- 172.21.15.71:0/859934742 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe8a4013830 con 0x7fe894004d50 2023-10-09T06:55:03.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.007+0000 7fe89e7fc700 1 --2- 172.21.15.71:0/859934742 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe88c066f30 0x7fe88c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:03.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.007+0000 7fe89e7fc700 1 -- 172.21.15.71:0/859934742 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5217+0+0 (secure 0 0 0) 0x7fe8a4017070 con 0x7fe894004d50 2023-10-09T06:55:03.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.007+0000 7fe8adb9a700 1 --2- 172.21.15.71:0/859934742 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe88c066f30 0x7fe88c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:03.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.008+0000 7fe8adb9a700 1 --2- 172.21.15.71:0/859934742 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe88c066f30 0x7fe88c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe898006eb0 tx=0x7fe8980091a0 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:03.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.011+0000 7fe89e7fc700 1 -- 172.21.15.71:0/859934742 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8a40521f0 con 0x7fe894004d50 2023-10-09T06:55:03.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.201+0000 7fe8af39d700 1 -- 172.21.15.71:0/859934742 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8a806dd20 con 0x7fe894004d50 2023-10-09T06:55:03.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.201+0000 7fe89e7fc700 1 -- 172.21.15.71:0/859934742 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8a4055810 con 0x7fe894004d50 2023-10-09T06:55:03.203 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T06:55:03.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.204+0000 7fe8af39d700 1 -- 172.21.15.71:0/859934742 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe88c066f30 msgr2=0x7fe88c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:03.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.204+0000 7fe8af39d700 1 --2- 172.21.15.71:0/859934742 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe88c066f30 0x7fe88c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe898006eb0 tx=0x7fe8980091a0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.204+0000 7fe8af39d700 1 -- 172.21.15.71:0/859934742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe894004d50 msgr2=0x7fe8a80af420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:03.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.204+0000 7fe8af39d700 1 --2- 172.21.15.71:0/859934742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe894004d50 0x7fe8a80af420 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4011bb0 tx=0x7fe8a400a330 comp rx=0 tx=0).stop 2023-10-09T06:55:03.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.204+0000 7fe8af39d700 1 -- 172.21.15.71:0/859934742 shutdown_connections 2023-10-09T06:55:03.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.204+0000 7fe8af39d700 1 --2- 172.21.15.71:0/859934742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8a813f570 0x7fe8a813f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.204+0000 7fe8af39d700 1 --2- 172.21.15.71:0/859934742 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe88c066f30 0x7fe88c0693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.204+0000 7fe8af39d700 1 --2- 172.21.15.71:0/859934742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe894004d50 0x7fe8a80af420 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.204+0000 7fe8af39d700 1 --2- 172.21.15.71:0/859934742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8a8166970 0x7fe8a80b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.204+0000 7fe8af39d700 1 -- 172.21.15.71:0/859934742 >> 172.21.15.71:0/859934742 conn(0x7fe8a80cc1e0 msgr2=0x7fe8a80c1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:03.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.204+0000 7fe8af39d700 1 -- 172.21.15.71:0/859934742 shutdown_connections 2023-10-09T06:55:03.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.204+0000 7fe8af39d700 1 -- 172.21.15.71:0/859934742 wait complete. 2023-10-09T06:55:03.222 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T06:55:03.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.400+0000 7f9b375ff700 1 Processor -- start 2023-10-09T06:55:03.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.400+0000 7f9b375ff700 1 -- start start 2023-10-09T06:55:03.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.402+0000 7f9b375ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9b30155c10 0x7f9b30155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:03.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.402+0000 7f9b375ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9b300ac230 0x7f9b300ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:03.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.402+0000 7f9b375ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b300ad930 con 0x7f9b301568a0 2023-10-09T06:55:03.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.402+0000 7f9b375ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b300acd20 con 0x7f9b300ac230 2023-10-09T06:55:03.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.402+0000 7f9b375ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b300ad000 con 0x7f9b30155c10 2023-10-09T06:55:03.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.402+0000 7f9b34b9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9b300ac230 0x7f9b300ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:03.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.402+0000 7f9b34b9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9b300ac230 0x7f9b300ac6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38470/0 (socket says 172.21.15.71:38470) 2023-10-09T06:55:03.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.402+0000 7f9b34b9a700 1 -- 172.21.15.71:0/927576969 learned_addr learned my addr 172.21.15.71:0/927576969 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:03.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.402+0000 7f9b35b9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9b301568a0 0x7f9b30156c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:42054/0 (socket says 172.21.15.71:42054) 2023-10-09T06:55:03.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.402+0000 7f9b3539b700 1 --2- 172.21.15.71:0/927576969 >> v2:172.21.15.179:3300/0 conn(0x7f9b30155c10 0x7f9b30155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:03.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.402+0000 7f9b34b9a700 1 -- 172.21.15.71:0/927576969 >> v2:172.21.15.179:3300/0 conn(0x7f9b30155c10 msgr2=0x7f9b30155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:03.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.402+0000 7f9b34b9a700 1 --2- 172.21.15.71:0/927576969 >> v2:172.21.15.179:3300/0 conn(0x7f9b30155c10 0x7f9b30155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.402+0000 7f9b34b9a700 1 -- 172.21.15.71:0/927576969 >> v1:172.21.15.71:6789/0 conn(0x7f9b301568a0 legacy=0x7f9b30156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:03.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.402+0000 7f9b34b9a700 1 -- 172.21.15.71:0/927576969 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b300ad2e0 con 0x7f9b300ac230 2023-10-09T06:55:03.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.402+0000 7f9b27fff700 1 -- 172.21.15.71:0/927576969 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2637434855 0 0) 0x7f9b300ad930 con 0x7f9b301568a0 2023-10-09T06:55:03.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.403+0000 7f9b34b9a700 1 --2- 172.21.15.71:0/927576969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b300ac230 0x7f9b300ac6d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9b30063d40 tx=0x7f9b2000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0935789f066b4cc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:03.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.403+0000 7f9b27fff700 1 -- 172.21.15.71:0/927576969 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2000dba0 con 0x7f9b300ac230 2023-10-09T06:55:03.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.403+0000 7f9b27fff700 1 -- 172.21.15.71:0/927576969 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2000dd00 con 0x7f9b300ac230 2023-10-09T06:55:03.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.403+0000 7f9b27fff700 1 -- 172.21.15.71:0/927576969 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b200196d0 con 0x7f9b300ac230 2023-10-09T06:55:03.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.403+0000 7f9b375ff700 1 -- 172.21.15.71:0/927576969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b300ac230 msgr2=0x7f9b300ac6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:03.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.403+0000 7f9b375ff700 1 --2- 172.21.15.71:0/927576969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b300ac230 0x7f9b300ac6d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9b30063d40 tx=0x7f9b2000b4f0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.404+0000 7f9b375ff700 1 -- 172.21.15.71:0/927576969 shutdown_connections 2023-10-09T06:55:03.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.404+0000 7f9b375ff700 1 --2- 172.21.15.71:0/927576969 >> v2:172.21.15.179:3300/0 conn(0x7f9b30155c10 0x7f9b30155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.404+0000 7f9b375ff700 1 --2- 172.21.15.71:0/927576969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b300ac230 0x7f9b300ac6d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.404+0000 7f9b375ff700 1 -- 172.21.15.71:0/927576969 >> 172.21.15.71:0/927576969 conn(0x7f9b3006a320 msgr2=0x7f9b300cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:03.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.404+0000 7f9b375ff700 1 -- 172.21.15.71:0/927576969 shutdown_connections 2023-10-09T06:55:03.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.404+0000 7f9b375ff700 1 -- 172.21.15.71:0/927576969 wait complete. 2023-10-09T06:55:03.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.405+0000 7f9b375ff700 1 Processor -- start 2023-10-09T06:55:03.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.405+0000 7f9b375ff700 1 -- start start 2023-10-09T06:55:03.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.406+0000 7f9b375ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b300ac230 0x7f9b30169dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:03.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.406+0000 7f9b375ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b30155c10 0x7f9b3014ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:03.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.406+0000 7f9b375ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b301568a0 0x7f9b300aa790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:03.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.406+0000 7f9b375ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3016a300 con 0x7f9b300ac230 2023-10-09T06:55:03.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.406+0000 7f9b375ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b300a9bd0 con 0x7f9b30155c10 2023-10-09T06:55:03.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.406+0000 7f9b375ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b300c9870 con 0x7f9b301568a0 2023-10-09T06:55:03.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.406+0000 7f9b3539b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b300ac230 0x7f9b30169dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:03.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.406+0000 7f9b3539b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b300ac230 0x7f9b30169dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38486/0 (socket says 172.21.15.71:38486) 2023-10-09T06:55:03.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.406+0000 7f9b3539b700 1 -- 172.21.15.71:0/2567851126 learned_addr learned my addr 172.21.15.71:0/2567851126 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:03.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.407+0000 7f9b34b9a700 1 --2- 172.21.15.71:0/2567851126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b30155c10 0x7f9b3014ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:03.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.407+0000 7f9b35b9c700 1 --2- 172.21.15.71:0/2567851126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b301568a0 0x7f9b300aa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:03.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.407+0000 7f9b3539b700 1 -- 172.21.15.71:0/2567851126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b301568a0 msgr2=0x7f9b300aa790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:03.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.407+0000 7f9b3539b700 1 --2- 172.21.15.71:0/2567851126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b301568a0 0x7f9b300aa790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.407+0000 7f9b3539b700 1 -- 172.21.15.71:0/2567851126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b30155c10 msgr2=0x7f9b3014ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:03.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.407+0000 7f9b3539b700 1 --2- 172.21.15.71:0/2567851126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b30155c10 0x7f9b3014ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.407+0000 7f9b3539b700 1 -- 172.21.15.71:0/2567851126 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2000b790 con 0x7f9b300ac230 2023-10-09T06:55:03.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.407+0000 7f9b3539b700 1 --2- 172.21.15.71:0/2567851126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b300ac230 0x7f9b30169dc0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00ec80 tx=0x7f9b2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:03.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.407+0000 7f9b257fa700 1 -- 172.21.15.71:0/2567851126 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c00c9d0 con 0x7f9b300ac230 2023-10-09T06:55:03.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.407+0000 7f9b257fa700 1 -- 172.21.15.71:0/2567851126 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c00cb30 con 0x7f9b300ac230 2023-10-09T06:55:03.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.407+0000 7f9b375ff700 1 -- 172.21.15.71:0/2567851126 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b300ca3f0 con 0x7f9b300ac230 2023-10-09T06:55:03.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.407+0000 7f9b257fa700 1 -- 172.21.15.71:0/2567851126 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c013470 con 0x7f9b300ac230 2023-10-09T06:55:03.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.407+0000 7f9b375ff700 1 -- 172.21.15.71:0/2567851126 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b300c9da0 con 0x7f9b300ac230 2023-10-09T06:55:03.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.408+0000 7f9b375ff700 1 -- 172.21.15.71:0/2567851126 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b300ca6d0 con 0x7f9b300ac230 2023-10-09T06:55:03.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.409+0000 7f9b257fa700 1 -- 172.21.15.71:0/2567851126 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b2c013820 con 0x7f9b300ac230 2023-10-09T06:55:03.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.410+0000 7f9b257fa700 1 --2- 172.21.15.71:0/2567851126 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9b14066f30 0x7f9b140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:03.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.410+0000 7f9b257fa700 1 -- 172.21.15.71:0/2567851126 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5217+0+0 (secure 0 0 0) 0x7f9b2c084780 con 0x7f9b300ac230 2023-10-09T06:55:03.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.410+0000 7f9b34b9a700 1 --2- 172.21.15.71:0/2567851126 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9b14066f30 0x7f9b140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:03.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.411+0000 7f9b34b9a700 1 --2- 172.21.15.71:0/2567851126 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9b14066f30 0x7f9b140693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9b30063d40 tx=0x7f9b2001b000 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:03.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.414+0000 7f9b257fa700 1 -- 172.21.15.71:0/2567851126 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b2c051b30 con 0x7f9b300ac230 2023-10-09T06:55:03.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.607+0000 7f9b375ff700 1 -- 172.21.15.71:0/2567851126 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9b3004c3c0 con 0x7f9b300ac230 2023-10-09T06:55:03.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.608+0000 7f9b257fa700 1 -- 172.21.15.71:0/2567851126 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v58) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9b2c055150 con 0x7f9b300ac230 2023-10-09T06:55:03.609 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:55:03.609 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-09T06:55:03.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:55:03.609 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 1, 2023-10-09T06:55:03.609 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": ".mgr" 2023-10-09T06:55:03.609 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:55:03.610 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-09T06:55:03.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.610+0000 7f9b375ff700 1 -- 172.21.15.71:0/2567851126 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9b14066f30 msgr2=0x7f9b140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:03.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.610+0000 7f9b375ff700 1 --2- 172.21.15.71:0/2567851126 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9b14066f30 0x7f9b140693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9b30063d40 tx=0x7f9b2001b000 comp rx=0 tx=0).stop 2023-10-09T06:55:03.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.610+0000 7f9b375ff700 1 -- 172.21.15.71:0/2567851126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b300ac230 msgr2=0x7f9b30169dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:03.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.610+0000 7f9b375ff700 1 --2- 172.21.15.71:0/2567851126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b300ac230 0x7f9b30169dc0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00ec80 tx=0x7f9b2c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.610+0000 7f9b375ff700 1 -- 172.21.15.71:0/2567851126 shutdown_connections 2023-10-09T06:55:03.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.610+0000 7f9b375ff700 1 --2- 172.21.15.71:0/2567851126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b301568a0 0x7f9b300aa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.610+0000 7f9b375ff700 1 --2- 172.21.15.71:0/2567851126 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9b14066f30 0x7f9b140693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.610+0000 7f9b375ff700 1 --2- 172.21.15.71:0/2567851126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b300ac230 0x7f9b30169dc0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.610+0000 7f9b375ff700 1 --2- 172.21.15.71:0/2567851126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b30155c10 0x7f9b3014ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.610+0000 7f9b375ff700 1 -- 172.21.15.71:0/2567851126 >> 172.21.15.71:0/2567851126 conn(0x7f9b3006a320 msgr2=0x7f9b30154850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:03.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.610+0000 7f9b375ff700 1 -- 172.21.15.71:0/2567851126 shutdown_connections 2023-10-09T06:55:03.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.610+0000 7f9b375ff700 1 -- 172.21.15.71:0/2567851126 wait complete. 2023-10-09T06:55:03.628 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T06:55:03.629 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T06:55:03.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.814+0000 7f4dacd9d700 1 Processor -- start 2023-10-09T06:55:03.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.814+0000 7f4dacd9d700 1 -- start start 2023-10-09T06:55:03.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.815+0000 7f4dacd9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4da8153850 0x7f4da81596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:03.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.815+0000 7f4dacd9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4da8159bf0 0x7f4da8157280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:03.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.815+0000 7f4dacd9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da815a030 con 0x7f4da8153480 2023-10-09T06:55:03.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.815+0000 7f4dacd9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da815a480 con 0x7f4da8159bf0 2023-10-09T06:55:03.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.815+0000 7f4dacd9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da80afb40 con 0x7f4da8153850 2023-10-09T06:55:03.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.815+0000 7f4da7fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4da8159bf0 0x7f4da8157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:03.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.815+0000 7f4da7fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4da8159bf0 0x7f4da8157280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38492/0 (socket says 172.21.15.71:38492) 2023-10-09T06:55:03.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.815+0000 7f4da7fff700 1 -- 172.21.15.71:0/3029986768 learned_addr learned my addr 172.21.15.71:0/3029986768 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:03.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.816+0000 7f4da6ffd700 1 --2- 172.21.15.71:0/3029986768 >> v2:172.21.15.179:3300/0 conn(0x7f4da8153850 0x7f4da81596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:03.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.816+0000 7f4da7fff700 1 -- 172.21.15.71:0/3029986768 >> v2:172.21.15.179:3300/0 conn(0x7f4da8153850 msgr2=0x7f4da81596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:03.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.816+0000 7f4da7fff700 1 --2- 172.21.15.71:0/3029986768 >> v2:172.21.15.179:3300/0 conn(0x7f4da8153850 0x7f4da81596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.816+0000 7f4da7fff700 1 -- 172.21.15.71:0/3029986768 >> v1:172.21.15.179:6789/0 conn(0x7f4da8153480 legacy=0x7f4da80ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:03.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.816+0000 7f4da7fff700 1 -- 172.21.15.71:0/3029986768 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da80afe20 con 0x7f4da8159bf0 2023-10-09T06:55:03.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.816+0000 7f4da6ffd700 1 --2- 172.21.15.71:0/3029986768 >> v2:172.21.15.179:3300/0 conn(0x7f4da8153850 0x7f4da81596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:55:03.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.816+0000 7f4da7fff700 1 --2- 172.21.15.71:0/3029986768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4da8159bf0 0x7f4da8157280 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4da8064f60 tx=0x7f4da0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c32a8895308811 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:03.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.816+0000 7f4da67fc700 1 -- 172.21.15.71:0/3029986768 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da000e070 con 0x7f4da8159bf0 2023-10-09T06:55:03.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.816+0000 7f4da67fc700 1 -- 172.21.15.71:0/3029986768 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da000ba10 con 0x7f4da8159bf0 2023-10-09T06:55:03.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.816+0000 7f4da67fc700 1 -- 172.21.15.71:0/3029986768 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da00092e0 con 0x7f4da8159bf0 2023-10-09T06:55:03.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.817+0000 7f4dacd9d700 1 -- 172.21.15.71:0/3029986768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4da8159bf0 msgr2=0x7f4da8157280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:03.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.817+0000 7f4dacd9d700 1 --2- 172.21.15.71:0/3029986768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4da8159bf0 0x7f4da8157280 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4da8064f60 tx=0x7f4da0009840 comp rx=0 tx=0).stop 2023-10-09T06:55:03.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.817+0000 7f4dacd9d700 1 -- 172.21.15.71:0/3029986768 shutdown_connections 2023-10-09T06:55:03.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.817+0000 7f4dacd9d700 1 --2- 172.21.15.71:0/3029986768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4da8159bf0 0x7f4da8157280 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.817+0000 7f4dacd9d700 1 --2- 172.21.15.71:0/3029986768 >> v2:172.21.15.179:3300/0 conn(0x7f4da8153850 0x7f4da81596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.817+0000 7f4dacd9d700 1 -- 172.21.15.71:0/3029986768 >> 172.21.15.71:0/3029986768 conn(0x7f4da8068e20 msgr2=0x7f4da80cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:03.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.817+0000 7f4dacd9d700 1 -- 172.21.15.71:0/3029986768 shutdown_connections 2023-10-09T06:55:03.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.817+0000 7f4dacd9d700 1 -- 172.21.15.71:0/3029986768 wait complete. 2023-10-09T06:55:03.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.818+0000 7f4dacd9d700 1 Processor -- start 2023-10-09T06:55:03.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.819+0000 7f4dacd9d700 1 -- start start 2023-10-09T06:55:03.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.819+0000 7f4dacd9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4da8153480 0x7f4da8145c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:03.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.819+0000 7f4dacd9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4da8153850 0x7f4da80c1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:03.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.819+0000 7f4dacd9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4da8159bf0 0x7f4da8156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:03.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.819+0000 7f4dacd9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da8156ae0 con 0x7f4da8153850 2023-10-09T06:55:03.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.819+0000 7f4dacd9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da8155f10 con 0x7f4da8159bf0 2023-10-09T06:55:03.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.819+0000 7f4dacd9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da81561b0 con 0x7f4da8153480 2023-10-09T06:55:03.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.820+0000 7f4da6ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4da8153850 0x7f4da80c1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:03.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.820+0000 7f4da6ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4da8153850 0x7f4da80c1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38496/0 (socket says 172.21.15.71:38496) 2023-10-09T06:55:03.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.820+0000 7f4da6ffd700 1 -- 172.21.15.71:0/3848484281 learned_addr learned my addr 172.21.15.71:0/3848484281 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:03.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.820+0000 7f4da7fff700 1 --2- 172.21.15.71:0/3848484281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4da8159bf0 0x7f4da8156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:03.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.820+0000 7f4da77fe700 1 --2- 172.21.15.71:0/3848484281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4da8153480 0x7f4da8145c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:03.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.820+0000 7f4da6ffd700 1 -- 172.21.15.71:0/3848484281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4da8153480 msgr2=0x7f4da8145c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:03.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.820+0000 7f4da6ffd700 1 --2- 172.21.15.71:0/3848484281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4da8153480 0x7f4da8145c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.820+0000 7f4da6ffd700 1 -- 172.21.15.71:0/3848484281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4da8159bf0 msgr2=0x7f4da8156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:03.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.820+0000 7f4da6ffd700 1 --2- 172.21.15.71:0/3848484281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4da8159bf0 0x7f4da8156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:03.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.820+0000 7f4da6ffd700 1 -- 172.21.15.71:0/3848484281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da0009ae0 con 0x7f4da8153850 2023-10-09T06:55:03.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.820+0000 7f4da7fff700 1 --2- 172.21.15.71:0/3848484281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4da8159bf0 0x7f4da8156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:55:03.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.820+0000 7f4da6ffd700 1 --2- 172.21.15.71:0/3848484281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4da8153850 0x7f4da80c1a60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00c830 tx=0x7f4d9c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:03.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.821+0000 7f4d8f7fe700 1 -- 172.21.15.71:0/3848484281 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c011600 con 0x7f4da8153850 2023-10-09T06:55:03.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.821+0000 7f4d8f7fe700 1 -- 172.21.15.71:0/3848484281 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9c011760 con 0x7f4da8153850 2023-10-09T06:55:03.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.821+0000 7f4dacd9d700 1 -- 172.21.15.71:0/3848484281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da8156490 con 0x7f4da8153850 2023-10-09T06:55:03.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.821+0000 7f4d8f7fe700 1 -- 172.21.15.71:0/3848484281 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c011b20 con 0x7f4da8153850 2023-10-09T06:55:03.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.821+0000 7f4dacd9d700 1 -- 172.21.15.71:0/3848484281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da81461c0 con 0x7f4da8153850 2023-10-09T06:55:03.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.822+0000 7f4dacd9d700 1 -- 172.21.15.71:0/3848484281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da8156c90 con 0x7f4da8153850 2023-10-09T06:55:03.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.823+0000 7f4d8f7fe700 1 -- 172.21.15.71:0/3848484281 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d9c00a3e0 con 0x7f4da8153850 2023-10-09T06:55:03.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.823+0000 7f4d8f7fe700 1 --2- 172.21.15.71:0/3848484281 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4d94066f30 0x7f4d940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:03.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.824+0000 7f4d8f7fe700 1 -- 172.21.15.71:0/3848484281 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5217+0+0 (secure 0 0 0) 0x7f4d9c084820 con 0x7f4da8153850 2023-10-09T06:55:03.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.824+0000 7f4da77fe700 1 --2- 172.21.15.71:0/3848484281 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4d94066f30 0x7f4d940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:03.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.825+0000 7f4da77fe700 1 --2- 172.21.15.71:0/3848484281 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4d94066f30 0x7f4d940693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4d98003870 tx=0x7f4d98009040 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:03.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:03.828+0000 7f4d8f7fe700 1 -- 172.21.15.71:0/3848484281 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4da8156c90 con 0x7f4da8153850 2023-10-09T06:55:04.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:04.020+0000 7f4dacd9d700 1 -- 172.21.15.71:0/3848484281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4da804c3c0 con 0x7f4da8153850 2023-10-09T06:55:04.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:04.907+0000 7f4d8f7fe700 1 -- 172.21.15.71:0/3848484281 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4d9c0150b0 con 0x7f4da8153850 2023-10-09T06:55:04.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:04.914+0000 7f4dacd9d700 1 -- 172.21.15.71:0/3848484281 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4d94066f30 msgr2=0x7f4d940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:04.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:04.914+0000 7f4dacd9d700 1 --2- 172.21.15.71:0/3848484281 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4d94066f30 0x7f4d940693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4d98003870 tx=0x7f4d98009040 comp rx=0 tx=0).stop 2023-10-09T06:55:04.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:04.914+0000 7f4dacd9d700 1 -- 172.21.15.71:0/3848484281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4da8153850 msgr2=0x7f4da80c1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:04.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:04.914+0000 7f4dacd9d700 1 --2- 172.21.15.71:0/3848484281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4da8153850 0x7f4da80c1a60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00c830 tx=0x7f4d9c008040 comp rx=0 tx=0).stop 2023-10-09T06:55:04.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:04.915+0000 7f4dacd9d700 1 -- 172.21.15.71:0/3848484281 shutdown_connections 2023-10-09T06:55:04.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:04.915+0000 7f4dacd9d700 1 --2- 172.21.15.71:0/3848484281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4da8159bf0 0x7f4da8156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:04.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:04.915+0000 7f4dacd9d700 1 --2- 172.21.15.71:0/3848484281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4da8153480 0x7f4da8145c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:04.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:04.915+0000 7f4dacd9d700 1 --2- 172.21.15.71:0/3848484281 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4d94066f30 0x7f4d940693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:04.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:04.915+0000 7f4dacd9d700 1 --2- 172.21.15.71:0/3848484281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4da8153850 0x7f4da80c1a60 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:04.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:04.915+0000 7f4dacd9d700 1 -- 172.21.15.71:0/3848484281 >> 172.21.15.71:0/3848484281 conn(0x7f4da8068e20 msgr2=0x7f4da80cb210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:04.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:04.916+0000 7f4dacd9d700 1 -- 172.21.15.71:0/3848484281 shutdown_connections 2023-10-09T06:55:04.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:04.916+0000 7f4dacd9d700 1 -- 172.21.15.71:0/3848484281 wait complete. 2023-10-09T06:55:04.918 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' created 2023-10-09T06:55:04.938 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T06:55:05.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.126+0000 7fa294d9d700 1 Processor -- start 2023-10-09T06:55:05.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.127+0000 7fa294d9d700 1 -- start start 2023-10-09T06:55:05.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.128+0000 7fa294d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2900caee0 0x7fa2900ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:05.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.128+0000 7fa294d9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2900cbe50 con 0x7fa290156780 2023-10-09T06:55:05.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.128+0000 7fa294d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2900cb370 con 0x7fa2901563b0 2023-10-09T06:55:05.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.128+0000 7fa294d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2900cb650 con 0x7fa2900caee0 2023-10-09T06:55:05.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.128+0000 7fa28ffff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa290156780 0x7fa2900c7340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48584/0 (socket says 172.21.15.71:48584) 2023-10-09T06:55:05.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.128+0000 7fa28ffff700 1 -- 172.21.15.71:0/703800327 learned_addr learned my addr 172.21.15.71:0/703800327 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:55:05.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.128+0000 7fa287fff700 1 --2- 172.21.15.71:0/703800327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2900caee0 0x7fa2900ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:05.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.129+0000 7fa28effd700 1 -- 172.21.15.71:0/703800327 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2075995764 0 0) 0x7fa2900cbe50 con 0x7fa290156780 2023-10-09T06:55:05.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.129+0000 7fa28effd700 1 -- 172.21.15.71:0/703800327 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa27c003570 con 0x7fa290156780 2023-10-09T06:55:05.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.129+0000 7fa287fff700 1 -- 172.21.15.71:0/703800327 >> v1:172.21.15.179:6789/0 conn(0x7fa2901563b0 legacy=0x7fa2900ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:05.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.129+0000 7fa28effd700 1 -- 172.21.15.71:0/703800327 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223107646 0 0) 0x7fa2900cb370 con 0x7fa2901563b0 2023-10-09T06:55:05.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.129+0000 7fa287fff700 1 -- 172.21.15.71:0/703800327 >> v1:172.21.15.71:6789/0 conn(0x7fa290156780 legacy=0x7fa2900c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:05.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.129+0000 7fa287fff700 1 -- 172.21.15.71:0/703800327 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2900c6860 con 0x7fa2900caee0 2023-10-09T06:55:05.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.129+0000 7fa287fff700 1 --2- 172.21.15.71:0/703800327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2900caee0 0x7fa2900ae2b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa278009910 tx=0x7fa2780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=422f4f8fd764b877 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:05.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.129+0000 7fa28effd700 1 -- 172.21.15.71:0/703800327 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27800b680 con 0x7fa2900caee0 2023-10-09T06:55:05.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.130+0000 7fa28effd700 1 -- 172.21.15.71:0/703800327 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27800b7e0 con 0x7fa2900caee0 2023-10-09T06:55:05.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.130+0000 7fa28effd700 1 -- 172.21.15.71:0/703800327 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27800bba0 con 0x7fa2900caee0 2023-10-09T06:55:05.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.130+0000 7fa294d9d700 1 -- 172.21.15.71:0/703800327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2900caee0 msgr2=0x7fa2900ae2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:05.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.130+0000 7fa294d9d700 1 --2- 172.21.15.71:0/703800327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2900caee0 0x7fa2900ae2b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa278009910 tx=0x7fa2780091a0 comp rx=0 tx=0).stop 2023-10-09T06:55:05.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.130+0000 7fa294d9d700 1 -- 172.21.15.71:0/703800327 shutdown_connections 2023-10-09T06:55:05.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.130+0000 7fa294d9d700 1 --2- 172.21.15.71:0/703800327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2900caee0 0x7fa2900ae2b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:05.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.130+0000 7fa294d9d700 1 -- 172.21.15.71:0/703800327 >> 172.21.15.71:0/703800327 conn(0x7fa290068e20 msgr2=0x7fa2900cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:05.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.130+0000 7fa294d9d700 1 -- 172.21.15.71:0/703800327 shutdown_connections 2023-10-09T06:55:05.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.130+0000 7fa294d9d700 1 -- 172.21.15.71:0/703800327 wait complete. 2023-10-09T06:55:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.132+0000 7fa294d9d700 1 Processor -- start 2023-10-09T06:55:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.132+0000 7fa294d9d700 1 -- start start 2023-10-09T06:55:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.133+0000 7fa294d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2900caee0 0x7fa2900c1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.133+0000 7fa294d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2901563b0 0x7fa2901698a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.133+0000 7fa294d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa290156780 0x7fa290169de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.133+0000 7fa294d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2900c61e0 con 0x7fa290156780 2023-10-09T06:55:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.133+0000 7fa294d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2900c2a10 con 0x7fa2901563b0 2023-10-09T06:55:05.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.133+0000 7fa294d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2900c2580 con 0x7fa2900caee0 2023-10-09T06:55:05.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.133+0000 7fa28ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa290156780 0x7fa290169de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:05.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.133+0000 7fa28ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa290156780 0x7fa290169de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39268/0 (socket says 172.21.15.71:39268) 2023-10-09T06:55:05.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.133+0000 7fa28ffff700 1 -- 172.21.15.71:0/2813574695 learned_addr learned my addr 172.21.15.71:0/2813574695 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:05.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.133+0000 7fa287fff700 1 --2- 172.21.15.71:0/2813574695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2901563b0 0x7fa2901698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:05.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.133+0000 7fa28f7fe700 1 --2- 172.21.15.71:0/2813574695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2900caee0 0x7fa2900c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:05.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.133+0000 7fa28ffff700 1 -- 172.21.15.71:0/2813574695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2900caee0 msgr2=0x7fa2900c1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:05.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.133+0000 7fa28ffff700 1 --2- 172.21.15.71:0/2813574695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2900caee0 0x7fa2900c1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:05.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.133+0000 7fa28ffff700 1 -- 172.21.15.71:0/2813574695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2901563b0 msgr2=0x7fa2901698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:05.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.133+0000 7fa28ffff700 1 --2- 172.21.15.71:0/2813574695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2901563b0 0x7fa2901698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:05.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.133+0000 7fa28ffff700 1 -- 172.21.15.71:0/2813574695 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa278009420 con 0x7fa290156780 2023-10-09T06:55:05.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.134+0000 7fa28ffff700 1 --2- 172.21.15.71:0/2813574695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa290156780 0x7fa290169de0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa28800cc40 tx=0x7fa288001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:05.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.134+0000 7fa2877fe700 1 -- 172.21.15.71:0/2813574695 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28800a830 con 0x7fa290156780 2023-10-09T06:55:05.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.134+0000 7fa2877fe700 1 -- 172.21.15.71:0/2813574695 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28800a990 con 0x7fa290156780 2023-10-09T06:55:05.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.134+0000 7fa294d9d700 1 -- 172.21.15.71:0/2813574695 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2900c1970 con 0x7fa290156780 2023-10-09T06:55:05.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.134+0000 7fa2877fe700 1 -- 172.21.15.71:0/2813574695 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28800ad10 con 0x7fa290156780 2023-10-09T06:55:05.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.134+0000 7fa294d9d700 1 -- 172.21.15.71:0/2813574695 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2900c1f30 con 0x7fa290156780 2023-10-09T06:55:05.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.135+0000 7fa294d9d700 1 -- 172.21.15.71:0/2813574695 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2900c26f0 con 0x7fa290156780 2023-10-09T06:55:05.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.136+0000 7fa2877fe700 1 -- 172.21.15.71:0/2813574695 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa288007300 con 0x7fa290156780 2023-10-09T06:55:05.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.137+0000 7fa2877fe700 1 --2- 172.21.15.71:0/2813574695 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa270066f30 0x7fa2700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:05.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.137+0000 7fa2877fe700 1 -- 172.21.15.71:0/2813574695 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5587+0+0 (secure 0 0 0) 0x7fa288084850 con 0x7fa290156780 2023-10-09T06:55:05.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.137+0000 7fa28f7fe700 1 --2- 172.21.15.71:0/2813574695 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa270066f30 0x7fa2700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:05.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.138+0000 7fa28f7fe700 1 --2- 172.21.15.71:0/2813574695 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa270066f30 0x7fa2700693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa290154de0 tx=0x7fa280009040 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:05.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.142+0000 7fa2877fe700 1 -- 172.21.15.71:0/2813574695 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa288051a80 con 0x7fa290156780 2023-10-09T06:55:05.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.331+0000 7fa294d9d700 1 -- 172.21.15.71:0/2813574695 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa29004c3c0 con 0x7fa290156780 2023-10-09T06:55:05.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.920+0000 7fa2877fe700 1 -- 172.21.15.71:0/2813574695 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v60) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa2880550a0 con 0x7fa290156780 2023-10-09T06:55:05.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.929+0000 7fa294d9d700 1 -- 172.21.15.71:0/2813574695 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa270066f30 msgr2=0x7fa2700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:05.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.929+0000 7fa294d9d700 1 --2- 172.21.15.71:0/2813574695 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa270066f30 0x7fa2700693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa290154de0 tx=0x7fa280009040 comp rx=0 tx=0).stop 2023-10-09T06:55:05.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.929+0000 7fa294d9d700 1 -- 172.21.15.71:0/2813574695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa290156780 msgr2=0x7fa290169de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:05.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.929+0000 7fa294d9d700 1 --2- 172.21.15.71:0/2813574695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa290156780 0x7fa290169de0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa28800cc40 tx=0x7fa288001a40 comp rx=0 tx=0).stop 2023-10-09T06:55:05.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.932+0000 7fa294d9d700 1 -- 172.21.15.71:0/2813574695 shutdown_connections 2023-10-09T06:55:05.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.932+0000 7fa294d9d700 1 --2- 172.21.15.71:0/2813574695 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa270066f30 0x7fa2700693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:05.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.932+0000 7fa294d9d700 1 --2- 172.21.15.71:0/2813574695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa290156780 0x7fa290169de0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:05.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.932+0000 7fa294d9d700 1 --2- 172.21.15.71:0/2813574695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2900caee0 0x7fa2900c1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:05.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.932+0000 7fa294d9d700 1 --2- 172.21.15.71:0/2813574695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2901563b0 0x7fa2901698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:05.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.932+0000 7fa294d9d700 1 -- 172.21.15.71:0/2813574695 >> 172.21.15.71:0/2813574695 conn(0x7fa290068e20 msgr2=0x7fa2900cc060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:05.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.934+0000 7fa294d9d700 1 -- 172.21.15.71:0/2813574695 shutdown_connections 2023-10-09T06:55:05.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:05.934+0000 7fa294d9d700 1 -- 172.21.15.71:0/2813574695 wait complete. 2023-10-09T06:55:05.939 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' created 2023-10-09T06:55:05.957 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T06:55:06.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.138+0000 7f62f4dff700 1 Processor -- start 2023-10-09T06:55:06.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.138+0000 7f62f4dff700 1 -- start start 2023-10-09T06:55:06.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.140+0000 7f62f4dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f62f0155eb0 0x7f62f006e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:06.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.140+0000 7f62f4dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f62f00c70b0 0x7f62f0069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:06.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.140+0000 7f62f4dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f0069cb0 0x7f62f0159a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:06.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.140+0000 7f62f4dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f006a130 con 0x7f62f0155eb0 2023-10-09T06:55:06.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.140+0000 7f62f4dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f006eb90 con 0x7f62f00c70b0 2023-10-09T06:55:06.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.140+0000 7f62f4dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f006ee70 con 0x7f62f0069cb0 2023-10-09T06:55:06.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.140+0000 7f62ee59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f62f0155eb0 0x7f62f006e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:06.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.140+0000 7f62ee59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f62f0155eb0 0x7f62f006e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39278/0 (socket says 172.21.15.71:39278) 2023-10-09T06:55:06.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.140+0000 7f62ee59c700 1 -- 172.21.15.71:0/1999871361 learned_addr learned my addr 172.21.15.71:0/1999871361 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:06.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.140+0000 7f62eed9d700 1 --2- 172.21.15.71:0/1999871361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f0069cb0 0x7f62f0159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:06.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.140+0000 7f62edd9b700 1 --2- 172.21.15.71:0/1999871361 >> v2:172.21.15.179:3300/0 conn(0x7f62f00c70b0 0x7f62f0069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:06.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.140+0000 7f62ee59c700 1 -- 172.21.15.71:0/1999871361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f0069cb0 msgr2=0x7f62f0159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:06.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.140+0000 7f62ee59c700 1 --2- 172.21.15.71:0/1999871361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f0069cb0 0x7f62f0159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:06.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.140+0000 7f62ee59c700 1 -- 172.21.15.71:0/1999871361 >> v2:172.21.15.179:3300/0 conn(0x7f62f00c70b0 msgr2=0x7f62f0069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:06.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.140+0000 7f62ee59c700 1 --2- 172.21.15.71:0/1999871361 >> v2:172.21.15.179:3300/0 conn(0x7f62f00c70b0 0x7f62f0069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:06.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.140+0000 7f62ee59c700 1 -- 172.21.15.71:0/1999871361 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f006f150 con 0x7f62f0155eb0 2023-10-09T06:55:06.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.141+0000 7f62ee59c700 1 --2- 172.21.15.71:0/1999871361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f0155eb0 0x7f62f006e240 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f62f0065130 tx=0x7f62e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f979fb4708dbc98f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:06.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.141+0000 7f62ed59a700 1 -- 172.21.15.71:0/1999871361 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e000b640 con 0x7f62f0155eb0 2023-10-09T06:55:06.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.141+0000 7f62ed59a700 1 -- 172.21.15.71:0/1999871361 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e000b7a0 con 0x7f62f0155eb0 2023-10-09T06:55:06.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.141+0000 7f62ed59a700 1 -- 172.21.15.71:0/1999871361 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e000bb40 con 0x7f62f0155eb0 2023-10-09T06:55:06.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.141+0000 7f62f4dff700 1 -- 172.21.15.71:0/1999871361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f0155eb0 msgr2=0x7f62f006e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:06.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.141+0000 7f62f4dff700 1 --2- 172.21.15.71:0/1999871361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f0155eb0 0x7f62f006e240 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f62f0065130 tx=0x7f62e0009250 comp rx=0 tx=0).stop 2023-10-09T06:55:06.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.142+0000 7f62f4dff700 1 -- 172.21.15.71:0/1999871361 shutdown_connections 2023-10-09T06:55:06.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.142+0000 7f62f4dff700 1 --2- 172.21.15.71:0/1999871361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f0069cb0 0x7f62f0159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:06.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.142+0000 7f62f4dff700 1 --2- 172.21.15.71:0/1999871361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f0155eb0 0x7f62f006e240 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:06.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.142+0000 7f62f4dff700 1 --2- 172.21.15.71:0/1999871361 >> v2:172.21.15.179:3300/0 conn(0x7f62f00c70b0 0x7f62f0069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:06.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.142+0000 7f62f4dff700 1 -- 172.21.15.71:0/1999871361 >> 172.21.15.71:0/1999871361 conn(0x7f62f0068e10 msgr2=0x7f62f00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:06.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.142+0000 7f62f4dff700 1 -- 172.21.15.71:0/1999871361 shutdown_connections 2023-10-09T06:55:06.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.142+0000 7f62f4dff700 1 -- 172.21.15.71:0/1999871361 wait complete. 2023-10-09T06:55:06.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.143+0000 7f62f4dff700 1 Processor -- start 2023-10-09T06:55:06.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.143+0000 7f62f4dff700 1 -- start start 2023-10-09T06:55:06.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.144+0000 7f62f4dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62f0069cb0 0x7f62f0150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:06.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.144+0000 7f62f4dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f00c70b0 0x7f62f0154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:06.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.144+0000 7f62f4dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f0155eb0 0x7f62f00ad5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:06.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.144+0000 7f62f4dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f00aa950 con 0x7f62f00c70b0 2023-10-09T06:55:06.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.144+0000 7f62f4dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f01546e0 con 0x7f62f0069cb0 2023-10-09T06:55:06.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.144+0000 7f62f4dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f00aa670 con 0x7f62f0155eb0 2023-10-09T06:55:06.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.144+0000 7f62edd9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f00c70b0 0x7f62f0154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:06.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.144+0000 7f62edd9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f00c70b0 0x7f62f0154b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39288/0 (socket says 172.21.15.71:39288) 2023-10-09T06:55:06.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.144+0000 7f62edd9b700 1 -- 172.21.15.71:0/3266261185 learned_addr learned my addr 172.21.15.71:0/3266261185 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:06.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.144+0000 7f62ee59c700 1 --2- 172.21.15.71:0/3266261185 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62f0069cb0 0x7f62f0150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:06.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.145+0000 7f62eed9d700 1 --2- 172.21.15.71:0/3266261185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f0155eb0 0x7f62f00ad5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:06.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.145+0000 7f62edd9b700 1 -- 172.21.15.71:0/3266261185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f0155eb0 msgr2=0x7f62f00ad5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:06.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.145+0000 7f62edd9b700 1 --2- 172.21.15.71:0/3266261185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f0155eb0 0x7f62f00ad5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:06.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.145+0000 7f62edd9b700 1 -- 172.21.15.71:0/3266261185 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62f0069cb0 msgr2=0x7f62f0150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:06.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.145+0000 7f62edd9b700 1 --2- 172.21.15.71:0/3266261185 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62f0069cb0 0x7f62f0150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:06.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.145+0000 7f62edd9b700 1 -- 172.21.15.71:0/3266261185 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e00094f0 con 0x7f62f00c70b0 2023-10-09T06:55:06.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.145+0000 7f62edd9b700 1 --2- 172.21.15.71:0/3266261185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f00c70b0 0x7f62f0154b70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f62e400ec80 tx=0x7f62e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:06.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.145+0000 7f62de7fc700 1 -- 172.21.15.71:0/3266261185 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e400c850 con 0x7f62f00c70b0 2023-10-09T06:55:06.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.145+0000 7f62de7fc700 1 -- 172.21.15.71:0/3266261185 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e400c9b0 con 0x7f62f00c70b0 2023-10-09T06:55:06.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.145+0000 7f62f4dff700 1 -- 172.21.15.71:0/3266261185 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f0154090 con 0x7f62f00c70b0 2023-10-09T06:55:06.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.145+0000 7f62de7fc700 1 -- 172.21.15.71:0/3266261185 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e400cd50 con 0x7f62f00c70b0 2023-10-09T06:55:06.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.146+0000 7f62f4dff700 1 -- 172.21.15.71:0/3266261185 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f0151180 con 0x7f62f00c70b0 2023-10-09T06:55:06.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.147+0000 7f62f4dff700 1 -- 172.21.15.71:0/3266261185 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f004c3c0 con 0x7f62f00c70b0 2023-10-09T06:55:06.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.148+0000 7f62de7fc700 1 -- 172.21.15.71:0/3266261185 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f62e4013680 con 0x7f62f00c70b0 2023-10-09T06:55:06.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.149+0000 7f62de7fc700 1 --2- 172.21.15.71:0/3266261185 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f62d0066f30 0x7f62d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:06.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.149+0000 7f62de7fc700 1 -- 172.21.15.71:0/3266261185 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f62e40848c0 con 0x7f62f00c70b0 2023-10-09T06:55:06.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.149+0000 7f62ee59c700 1 --2- 172.21.15.71:0/3266261185 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f62d0066f30 0x7f62d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:06.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.150+0000 7f62ee59c700 1 --2- 172.21.15.71:0/3266261185 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f62d0066f30 0x7f62d00693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f62f0065130 tx=0x7f62e0017000 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:06.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.153+0000 7f62de7fc700 1 -- 172.21.15.71:0/3266261185 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62e4051a20 con 0x7f62f00c70b0 2023-10-09T06:55:06.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.385+0000 7f62f4dff700 1 -- 172.21.15.71:0/3266261185 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f62f006f430 con 0x7f62f00c70b0 2023-10-09T06:55:06.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.918+0000 7f62de7fc700 1 -- 172.21.15.71:0/3266261185 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7f62e4055040 con 0x7f62f00c70b0 2023-10-09T06:55:06.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.929+0000 7f62f4dff700 1 -- 172.21.15.71:0/3266261185 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f62d0066f30 msgr2=0x7f62d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:06.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.929+0000 7f62f4dff700 1 --2- 172.21.15.71:0/3266261185 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f62d0066f30 0x7f62d00693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f62f0065130 tx=0x7f62e0017000 comp rx=0 tx=0).stop 2023-10-09T06:55:06.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.929+0000 7f62f4dff700 1 -- 172.21.15.71:0/3266261185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f00c70b0 msgr2=0x7f62f0154b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:06.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.929+0000 7f62f4dff700 1 --2- 172.21.15.71:0/3266261185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f00c70b0 0x7f62f0154b70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f62e400ec80 tx=0x7f62e40091a0 comp rx=0 tx=0).stop 2023-10-09T06:55:06.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.930+0000 7f62f4dff700 1 -- 172.21.15.71:0/3266261185 shutdown_connections 2023-10-09T06:55:06.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.930+0000 7f62f4dff700 1 --2- 172.21.15.71:0/3266261185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f0155eb0 0x7f62f00ad5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:06.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.930+0000 7f62f4dff700 1 --2- 172.21.15.71:0/3266261185 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62f0069cb0 0x7f62f0150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:06.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.930+0000 7f62f4dff700 1 --2- 172.21.15.71:0/3266261185 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f62d0066f30 0x7f62d00693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:06.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.930+0000 7f62f4dff700 1 --2- 172.21.15.71:0/3266261185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f00c70b0 0x7f62f0154b70 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:06.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.930+0000 7f62f4dff700 1 -- 172.21.15.71:0/3266261185 >> 172.21.15.71:0/3266261185 conn(0x7f62f0068e10 msgr2=0x7f62f00cc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:06.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.931+0000 7f62f4dff700 1 -- 172.21.15.71:0/3266261185 shutdown_connections 2023-10-09T06:55:06.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:06.931+0000 7f62f4dff700 1 -- 172.21.15.71:0/3266261185 wait complete. 2023-10-09T06:55:06.940 INFO:teuthology.orchestra.run.smithi071.stderr:new fs with metadata pool 6 and data pool 7 2023-10-09T06:55:06.965 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:55:07.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.144+0000 7faf5ddff700 1 Processor -- start 2023-10-09T06:55:07.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.144+0000 7faf5ddff700 1 -- start start 2023-10-09T06:55:07.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.146+0000 7faf5ddff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faf580b1850 0x7faf580b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:07.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.146+0000 7faf5ddff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7faf580ae680 0x7faf581572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:07.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.146+0000 7faf5ddff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf580aeb00 0x7faf58157820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:07.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.146+0000 7faf5ddff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf5806fc30 con 0x7faf580b1850 2023-10-09T06:55:07.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.146+0000 7faf5ddff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf580cc260 con 0x7faf580ae680 2023-10-09T06:55:07.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.146+0000 7faf5ddff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf580cb300 con 0x7faf580aeb00 2023-10-09T06:55:07.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.146+0000 7faf577fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faf580b1850 0x7faf580b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:07.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.146+0000 7faf577fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faf580b1850 0x7faf580b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39296/0 (socket says 172.21.15.71:39296) 2023-10-09T06:55:07.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.146+0000 7faf577fe700 1 -- 172.21.15.71:0/2704081180 learned_addr learned my addr 172.21.15.71:0/2704081180 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:07.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.146+0000 7faf57fff700 1 --2- 172.21.15.71:0/2704081180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf580aeb00 0x7faf58157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:07.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.146+0000 7faf577fe700 1 -- 172.21.15.71:0/2704081180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf580aeb00 msgr2=0x7faf58157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:07.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.146+0000 7faf56ffd700 1 --2- 172.21.15.71:0/2704081180 >> v2:172.21.15.179:3300/0 conn(0x7faf580ae680 0x7faf581572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:07.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.146+0000 7faf577fe700 1 --2- 172.21.15.71:0/2704081180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf580aeb00 0x7faf58157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.146+0000 7faf577fe700 1 -- 172.21.15.71:0/2704081180 >> v2:172.21.15.179:3300/0 conn(0x7faf580ae680 msgr2=0x7faf581572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:07.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.146+0000 7faf577fe700 1 --2- 172.21.15.71:0/2704081180 >> v2:172.21.15.179:3300/0 conn(0x7faf580ae680 0x7faf581572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.146+0000 7faf577fe700 1 -- 172.21.15.71:0/2704081180 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf580cb5e0 con 0x7faf580b1850 2023-10-09T06:55:07.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.146+0000 7faf57fff700 1 --2- 172.21.15.71:0/2704081180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf580aeb00 0x7faf58157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:55:07.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.146+0000 7faf56ffd700 1 --2- 172.21.15.71:0/2704081180 >> v2:172.21.15.179:3300/0 conn(0x7faf580ae680 0x7faf581572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:55:07.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.147+0000 7faf577fe700 1 --2- 172.21.15.71:0/2704081180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf580b1850 0x7faf580b1c20 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7faf5806d340 tx=0x7faf48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40fa47f2db2b2cd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:07.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.147+0000 7faf567fc700 1 -- 172.21.15.71:0/2704081180 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4800b820 con 0x7faf580b1850 2023-10-09T06:55:07.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.147+0000 7faf567fc700 1 -- 172.21.15.71:0/2704081180 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4800b980 con 0x7faf580b1850 2023-10-09T06:55:07.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.147+0000 7faf567fc700 1 -- 172.21.15.71:0/2704081180 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4800bd20 con 0x7faf580b1850 2023-10-09T06:55:07.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.147+0000 7faf5ddff700 1 -- 172.21.15.71:0/2704081180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf580b1850 msgr2=0x7faf580b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:07.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.147+0000 7faf5ddff700 1 --2- 172.21.15.71:0/2704081180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf580b1850 0x7faf580b1c20 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7faf5806d340 tx=0x7faf48009250 comp rx=0 tx=0).stop 2023-10-09T06:55:07.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.148+0000 7faf5ddff700 1 -- 172.21.15.71:0/2704081180 shutdown_connections 2023-10-09T06:55:07.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.148+0000 7faf5ddff700 1 --2- 172.21.15.71:0/2704081180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf580aeb00 0x7faf58157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.148+0000 7faf5ddff700 1 --2- 172.21.15.71:0/2704081180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf580b1850 0x7faf580b1c20 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.148+0000 7faf5ddff700 1 --2- 172.21.15.71:0/2704081180 >> v2:172.21.15.179:3300/0 conn(0x7faf580ae680 0x7faf581572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.148+0000 7faf5ddff700 1 -- 172.21.15.71:0/2704081180 >> 172.21.15.71:0/2704081180 conn(0x7faf5806a320 msgr2=0x7faf580cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:07.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.148+0000 7faf5ddff700 1 -- 172.21.15.71:0/2704081180 shutdown_connections 2023-10-09T06:55:07.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.148+0000 7faf5ddff700 1 -- 172.21.15.71:0/2704081180 wait complete. 2023-10-09T06:55:07.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.149+0000 7faf5ddff700 1 Processor -- start 2023-10-09T06:55:07.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.149+0000 7faf5ddff700 1 -- start start 2023-10-09T06:55:07.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.150+0000 7faf5ddff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf580ae680 0x7faf5814b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:07.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.150+0000 7faf5ddff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf580aeb00 0x7faf5814d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:07.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.150+0000 7faf5ddff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf580b1850 0x7faf58151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:07.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.150+0000 7faf5ddff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5814f7c0 con 0x7faf580b1850 2023-10-09T06:55:07.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.150+0000 7faf5ddff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5814d550 con 0x7faf580aeb00 2023-10-09T06:55:07.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.150+0000 7faf5ddff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5814ba50 con 0x7faf580ae680 2023-10-09T06:55:07.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.150+0000 7faf57fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf580b1850 0x7faf58151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:07.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.150+0000 7faf57fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf580b1850 0x7faf58151e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39302/0 (socket says 172.21.15.71:39302) 2023-10-09T06:55:07.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.150+0000 7faf57fff700 1 -- 172.21.15.71:0/2026724410 learned_addr learned my addr 172.21.15.71:0/2026724410 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:07.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.151+0000 7faf577fe700 1 --2- 172.21.15.71:0/2026724410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf580ae680 0x7faf5814b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:07.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.151+0000 7faf56ffd700 1 --2- 172.21.15.71:0/2026724410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf580aeb00 0x7faf5814d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:07.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.151+0000 7faf57fff700 1 -- 172.21.15.71:0/2026724410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf580ae680 msgr2=0x7faf5814b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:07.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.151+0000 7faf57fff700 1 --2- 172.21.15.71:0/2026724410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf580ae680 0x7faf5814b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.151+0000 7faf57fff700 1 -- 172.21.15.71:0/2026724410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf580aeb00 msgr2=0x7faf5814d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:07.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.151+0000 7faf57fff700 1 --2- 172.21.15.71:0/2026724410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf580aeb00 0x7faf5814d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.151+0000 7faf57fff700 1 -- 172.21.15.71:0/2026724410 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf480094f0 con 0x7faf580b1850 2023-10-09T06:55:07.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.151+0000 7faf577fe700 1 --2- 172.21.15.71:0/2026724410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf580ae680 0x7faf5814b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:55:07.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.151+0000 7faf56ffd700 1 --2- 172.21.15.71:0/2026724410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf580aeb00 0x7faf5814d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:55:07.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.151+0000 7faf57fff700 1 --2- 172.21.15.71:0/2026724410 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf580b1850 0x7faf58151e70 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7faf5000a380 tx=0x7faf50007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:07.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.151+0000 7faf3f7fe700 1 -- 172.21.15.71:0/2026724410 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5000ae10 con 0x7faf580b1850 2023-10-09T06:55:07.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.151+0000 7faf3f7fe700 1 -- 172.21.15.71:0/2026724410 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5000d650 con 0x7faf580b1850 2023-10-09T06:55:07.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.151+0000 7faf3f7fe700 1 -- 172.21.15.71:0/2026724410 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5000da10 con 0x7faf580b1850 2023-10-09T06:55:07.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.151+0000 7faf5ddff700 1 -- 172.21.15.71:0/2026724410 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5814c940 con 0x7faf580b1850 2023-10-09T06:55:07.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.151+0000 7faf5ddff700 1 -- 172.21.15.71:0/2026724410 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5814cf00 con 0x7faf580b1850 2023-10-09T06:55:07.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.152+0000 7faf5ddff700 1 -- 172.21.15.71:0/2026724410 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5814d6e0 con 0x7faf580b1850 2023-10-09T06:55:07.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.153+0000 7faf3f7fe700 1 -- 172.21.15.71:0/2026724410 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf5001e3b0 con 0x7faf580b1850 2023-10-09T06:55:07.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.154+0000 7faf3f7fe700 1 --2- 172.21.15.71:0/2026724410 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faf44066f30 0x7faf440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:07.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.154+0000 7faf3f7fe700 1 -- 172.21.15.71:0/2026724410 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6069+0+0 (secure 0 0 0) 0x7faf50085150 con 0x7faf580b1850 2023-10-09T06:55:07.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.154+0000 7faf577fe700 1 --2- 172.21.15.71:0/2026724410 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faf44066f30 0x7faf440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:07.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.155+0000 7faf577fe700 1 --2- 172.21.15.71:0/2026724410 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faf44066f30 0x7faf440693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faf5806d340 tx=0x7faf48017000 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:07.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.158+0000 7faf3f7fe700 1 -- 172.21.15.71:0/2026724410 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf500521b0 con 0x7faf580b1850 2023-10-09T06:55:07.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.348+0000 7faf5ddff700 1 -- 172.21.15.71:0/2026724410 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf5804c3c0 con 0x7faf580b1850 2023-10-09T06:55:07.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.349+0000 7faf3f7fe700 1 -- 172.21.15.71:0/2026724410 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+15913 (secure 0 0 0) 0x7faf500557d0 con 0x7faf580b1850 2023-10-09T06:55:07.350 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:55:07.350 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":61,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:55:06.387567+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:55:04.058830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T06:55:05.370158+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:55:07.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.351+0000 7faf5ddff700 1 -- 172.21.15.71:0/2026724410 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faf44066f30 msgr2=0x7faf440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:07.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.351+0000 7faf5ddff700 1 --2- 172.21.15.71:0/2026724410 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faf44066f30 0x7faf440693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faf5806d340 tx=0x7faf48017000 comp rx=0 tx=0).stop 2023-10-09T06:55:07.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.351+0000 7faf5ddff700 1 -- 172.21.15.71:0/2026724410 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf580b1850 msgr2=0x7faf58151e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:07.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.351+0000 7faf5ddff700 1 --2- 172.21.15.71:0/2026724410 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf580b1850 0x7faf58151e70 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7faf5000a380 tx=0x7faf50007900 comp rx=0 tx=0).stop 2023-10-09T06:55:07.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.351+0000 7faf5ddff700 1 -- 172.21.15.71:0/2026724410 shutdown_connections 2023-10-09T06:55:07.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.351+0000 7faf5ddff700 1 --2- 172.21.15.71:0/2026724410 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faf44066f30 0x7faf440693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.351+0000 7faf5ddff700 1 --2- 172.21.15.71:0/2026724410 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf580b1850 0x7faf58151e70 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.351+0000 7faf5ddff700 1 --2- 172.21.15.71:0/2026724410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf580ae680 0x7faf5814b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.351+0000 7faf5ddff700 1 --2- 172.21.15.71:0/2026724410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf580aeb00 0x7faf5814d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.351+0000 7faf5ddff700 1 -- 172.21.15.71:0/2026724410 >> 172.21.15.71:0/2026724410 conn(0x7faf5806a320 msgr2=0x7faf5814be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:07.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.351+0000 7faf5ddff700 1 -- 172.21.15.71:0/2026724410 shutdown_connections 2023-10-09T06:55:07.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.351+0000 7faf5ddff700 1 -- 172.21.15.71:0/2026724410 wait complete. 2023-10-09T06:55:07.369 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:55:07.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.549+0000 7fd0835ff700 1 Processor -- start 2023-10-09T06:55:07.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.549+0000 7fd0835ff700 1 -- start start 2023-10-09T06:55:07.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.550+0000 7fd0835ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd07c159890 0x7fd07c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:07.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.550+0000 7fd0835ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd07c069560 0x7fd07c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:07.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.550+0000 7fd0835ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd07c069ee0 con 0x7fd07c159c60 2023-10-09T06:55:07.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.550+0000 7fd0835ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd07c15a160 con 0x7fd07c069560 2023-10-09T06:55:07.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.550+0000 7fd0835ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd07c0d13a0 con 0x7fd07c159890 2023-10-09T06:55:07.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.551+0000 7fd081b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd07c069560 0x7fd07c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:07.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.551+0000 7fd080b9a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd07c159c60 0x7fd07c15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48588/0 (socket says 172.21.15.71:48588) 2023-10-09T06:55:07.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.551+0000 7fd080b9a700 1 -- 172.21.15.71:0/2973984169 learned_addr learned my addr 172.21.15.71:0/2973984169 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:55:07.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.551+0000 7fd08139b700 1 --2- 172.21.15.71:0/2973984169 >> v2:172.21.15.179:3300/0 conn(0x7fd07c159890 0x7fd07c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:07.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.551+0000 7fd081b9c700 1 -- 172.21.15.71:0/2973984169 >> v2:172.21.15.179:3300/0 conn(0x7fd07c159890 msgr2=0x7fd07c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:07.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.551+0000 7fd081b9c700 1 --2- 172.21.15.71:0/2973984169 >> v2:172.21.15.179:3300/0 conn(0x7fd07c159890 0x7fd07c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.551+0000 7fd081b9c700 1 -- 172.21.15.71:0/2973984169 >> v1:172.21.15.71:6789/0 conn(0x7fd07c159c60 legacy=0x7fd07c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:07.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.551+0000 7fd081b9c700 1 -- 172.21.15.71:0/2973984169 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd07c15e140 con 0x7fd07c069560 2023-10-09T06:55:07.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.551+0000 7fd073fff700 1 -- 172.21.15.71:0/2973984169 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520987348 0 0) 0x7fd07c069ee0 con 0x7fd07c159c60 2023-10-09T06:55:07.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.551+0000 7fd081b9c700 1 --2- 172.21.15.71:0/2973984169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd07c069560 0x7fd07c0699a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd07c0d1090 tx=0x7fd074009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3555b828483005d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:07.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.552+0000 7fd073fff700 1 -- 172.21.15.71:0/2973984169 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07400e070 con 0x7fd07c069560 2023-10-09T06:55:07.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.552+0000 7fd073fff700 1 -- 172.21.15.71:0/2973984169 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07400bc30 con 0x7fd07c069560 2023-10-09T06:55:07.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.552+0000 7fd073fff700 1 -- 172.21.15.71:0/2973984169 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074012430 con 0x7fd07c069560 2023-10-09T06:55:07.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.552+0000 7fd0835ff700 1 -- 172.21.15.71:0/2973984169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd07c069560 msgr2=0x7fd07c0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:07.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.552+0000 7fd0835ff700 1 --2- 172.21.15.71:0/2973984169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd07c069560 0x7fd07c0699a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd07c0d1090 tx=0x7fd074009780 comp rx=0 tx=0).stop 2023-10-09T06:55:07.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.552+0000 7fd0835ff700 1 -- 172.21.15.71:0/2973984169 shutdown_connections 2023-10-09T06:55:07.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.552+0000 7fd0835ff700 1 --2- 172.21.15.71:0/2973984169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd07c069560 0x7fd07c0699a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.552+0000 7fd0835ff700 1 --2- 172.21.15.71:0/2973984169 >> v2:172.21.15.179:3300/0 conn(0x7fd07c159890 0x7fd07c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.552+0000 7fd0835ff700 1 -- 172.21.15.71:0/2973984169 >> 172.21.15.71:0/2973984169 conn(0x7fd07c068e20 msgr2=0x7fd07c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:07.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.552+0000 7fd0835ff700 1 -- 172.21.15.71:0/2973984169 shutdown_connections 2023-10-09T06:55:07.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.552+0000 7fd0835ff700 1 -- 172.21.15.71:0/2973984169 wait complete. 2023-10-09T06:55:07.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.554+0000 7fd0835ff700 1 Processor -- start 2023-10-09T06:55:07.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.554+0000 7fd0835ff700 1 -- start start 2023-10-09T06:55:07.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.555+0000 7fd0835ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd07c069560 0x7fd07c0b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:07.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.555+0000 7fd0835ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd07c159890 0x7fd07c0cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:07.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.555+0000 7fd0835ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd07c159c60 0x7fd07c0b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:07.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.555+0000 7fd0835ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07c16dfd0 con 0x7fd07c069560 2023-10-09T06:55:07.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.555+0000 7fd0835ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07c16d6a0 con 0x7fd07c159c60 2023-10-09T06:55:07.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.555+0000 7fd0835ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd07c16d980 con 0x7fd07c159890 2023-10-09T06:55:07.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.555+0000 7fd08139b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd07c069560 0x7fd07c0b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:07.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.555+0000 7fd08139b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd07c069560 0x7fd07c0b5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39330/0 (socket says 172.21.15.71:39330) 2023-10-09T06:55:07.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.555+0000 7fd08139b700 1 -- 172.21.15.71:0/328335670 learned_addr learned my addr 172.21.15.71:0/328335670 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:07.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.555+0000 7fd08139b700 1 -- 172.21.15.71:0/328335670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd07c159890 msgr2=0x7fd07c0cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:07.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.555+0000 7fd08139b700 1 --2- 172.21.15.71:0/328335670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd07c159890 0x7fd07c0cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.555+0000 7fd08139b700 1 -- 172.21.15.71:0/328335670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd07c159c60 msgr2=0x7fd07c0b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:07.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.555+0000 7fd08139b700 1 --2- 172.21.15.71:0/328335670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd07c159c60 0x7fd07c0b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.555+0000 7fd08139b700 1 -- 172.21.15.71:0/328335670 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd074009a20 con 0x7fd07c069560 2023-10-09T06:55:07.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.556+0000 7fd08139b700 1 --2- 172.21.15.71:0/328335670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd07c069560 0x7fd07c0b5ad0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd07800d890 tx=0x7fd078008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:07.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.556+0000 7fd0717fa700 1 -- 172.21.15.71:0/328335670 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07800b600 con 0x7fd07c069560 2023-10-09T06:55:07.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.556+0000 7fd0717fa700 1 -- 172.21.15.71:0/328335670 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07800b760 con 0x7fd07c069560 2023-10-09T06:55:07.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.556+0000 7fd0835ff700 1 -- 172.21.15.71:0/328335670 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd07c16dc60 con 0x7fd07c069560 2023-10-09T06:55:07.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.556+0000 7fd0717fa700 1 -- 172.21.15.71:0/328335670 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07800bae0 con 0x7fd07c069560 2023-10-09T06:55:07.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.556+0000 7fd0835ff700 1 -- 172.21.15.71:0/328335670 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd07c0cfc10 con 0x7fd07c069560 2023-10-09T06:55:07.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.557+0000 7fd0835ff700 1 -- 172.21.15.71:0/328335670 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd07c0cc600 con 0x7fd07c069560 2023-10-09T06:55:07.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.558+0000 7fd0717fa700 1 -- 172.21.15.71:0/328335670 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd07801e460 con 0x7fd07c069560 2023-10-09T06:55:07.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.559+0000 7fd0717fa700 1 --2- 172.21.15.71:0/328335670 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd060066f30 0x7fd0600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:07.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.559+0000 7fd0717fa700 1 -- 172.21.15.71:0/328335670 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd078084de0 con 0x7fd07c069560 2023-10-09T06:55:07.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.559+0000 7fd080b9a700 1 --2- 172.21.15.71:0/328335670 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd060066f30 0x7fd0600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:07.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.560+0000 7fd080b9a700 1 --2- 172.21.15.71:0/328335670 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd060066f30 0x7fd0600693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd07c0cd800 tx=0x7fd06c007bd0 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:07.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.563+0000 7fd0717fa700 1 -- 172.21.15.71:0/328335670 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd078051e40 con 0x7fd07c069560 2023-10-09T06:55:07.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.753+0000 7fd0835ff700 1 -- 172.21.15.71:0/328335670 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd07c16e2b0 con 0x7fd07c069560 2023-10-09T06:55:07.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.754+0000 7fd0717fa700 1 -- 172.21.15.71:0/328335670 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+15913 (secure 0 0 0) 0x7fd078055460 con 0x7fd07c069560 2023-10-09T06:55:07.755 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:55:07.756 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":61,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:55:06.387567+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:55:04.058830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T06:55:05.370158+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:55:07.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.756+0000 7fd0835ff700 1 -- 172.21.15.71:0/328335670 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd060066f30 msgr2=0x7fd0600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:07.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.757+0000 7fd0835ff700 1 --2- 172.21.15.71:0/328335670 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd060066f30 0x7fd0600693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd07c0cd800 tx=0x7fd06c007bd0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.757+0000 7fd0835ff700 1 -- 172.21.15.71:0/328335670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd07c069560 msgr2=0x7fd07c0b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:07.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.757+0000 7fd0835ff700 1 --2- 172.21.15.71:0/328335670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd07c069560 0x7fd07c0b5ad0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd07800d890 tx=0x7fd078008040 comp rx=0 tx=0).stop 2023-10-09T06:55:07.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.757+0000 7fd0835ff700 1 -- 172.21.15.71:0/328335670 shutdown_connections 2023-10-09T06:55:07.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.757+0000 7fd0835ff700 1 --2- 172.21.15.71:0/328335670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd07c159c60 0x7fd07c0b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.757+0000 7fd0835ff700 1 --2- 172.21.15.71:0/328335670 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd060066f30 0x7fd0600693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.757+0000 7fd0835ff700 1 --2- 172.21.15.71:0/328335670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd07c069560 0x7fd07c0b5ad0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.757+0000 7fd0835ff700 1 --2- 172.21.15.71:0/328335670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd07c159890 0x7fd07c0cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.757+0000 7fd0835ff700 1 -- 172.21.15.71:0/328335670 >> 172.21.15.71:0/328335670 conn(0x7fd07c068e20 msgr2=0x7fd07c157e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:07.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.757+0000 7fd0835ff700 1 -- 172.21.15.71:0/328335670 shutdown_connections 2023-10-09T06:55:07.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.757+0000 7fd0835ff700 1 -- 172.21.15.71:0/328335670 wait complete. 2023-10-09T06:55:07.775 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T06:55:07.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.962+0000 7f78c319d700 1 Processor -- start 2023-10-09T06:55:07.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.962+0000 7f78c319d700 1 -- start start 2023-10-09T06:55:07.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.964+0000 7f78c319d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78bc06f060 0x7f78bc0ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:07.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.964+0000 7f78c319d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f78bc06f4b0 0x7f78bc0ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:07.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.964+0000 7f78c319d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78bc06ebd0 con 0x7f78bc0cb1a0 2023-10-09T06:55:07.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.964+0000 7f78c319d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78bc15b2e0 con 0x7f78bc06f4b0 2023-10-09T06:55:07.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.964+0000 7f78c319d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc15aa70 con 0x7f78bc06f060 2023-10-09T06:55:07.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.964+0000 7f78c219b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f78bc0cb1a0 0x7f78bc15a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48600/0 (socket says 172.21.15.71:48600) 2023-10-09T06:55:07.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.965+0000 7f78c219b700 1 -- 172.21.15.71:0/106608075 learned_addr learned my addr 172.21.15.71:0/106608075 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:55:07.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.965+0000 7f78c299c700 1 --2- 172.21.15.71:0/106608075 >> v2:172.21.15.179:3300/0 conn(0x7f78bc06f4b0 0x7f78bc0ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:07.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.965+0000 7f78c199a700 1 --2- 172.21.15.71:0/106608075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78bc06f060 0x7f78bc0ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:07.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.965+0000 7f78c1199700 1 -- 172.21.15.71:0/106608075 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1770437145 0 0) 0x7f78bc06ebd0 con 0x7f78bc0cb1a0 2023-10-09T06:55:07.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.965+0000 7f78c1199700 1 -- 172.21.15.71:0/106608075 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78a8003570 con 0x7f78bc0cb1a0 2023-10-09T06:55:07.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.965+0000 7f78c299c700 1 -- 172.21.15.71:0/106608075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78bc06f060 msgr2=0x7f78bc0ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:07.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.965+0000 7f78c299c700 1 --2- 172.21.15.71:0/106608075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78bc06f060 0x7f78bc0ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.965+0000 7f78c299c700 1 -- 172.21.15.71:0/106608075 >> v1:172.21.15.71:6789/0 conn(0x7f78bc0cb1a0 legacy=0x7f78bc15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:07.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.965+0000 7f78c299c700 1 -- 172.21.15.71:0/106608075 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc15ad20 con 0x7f78bc06f4b0 2023-10-09T06:55:07.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.965+0000 7f78c199a700 1 --2- 172.21.15.71:0/106608075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78bc06f060 0x7f78bc0ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:55:07.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.965+0000 7f78c299c700 1 --2- 172.21.15.71:0/106608075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78bc06f4b0 0x7f78bc0ae610 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009e60 tx=0x7f78b4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5634ce06f0b2820c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:07.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.966+0000 7f78c1199700 1 -- 172.21.15.71:0/106608075 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b400e070 con 0x7f78bc06f4b0 2023-10-09T06:55:07.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.966+0000 7f78c1199700 1 -- 172.21.15.71:0/106608075 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b400bb40 con 0x7f78bc06f4b0 2023-10-09T06:55:07.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.966+0000 7f78c1199700 1 -- 172.21.15.71:0/106608075 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b4012430 con 0x7f78bc06f4b0 2023-10-09T06:55:07.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.966+0000 7f78c319d700 1 -- 172.21.15.71:0/106608075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78bc06f4b0 msgr2=0x7f78bc0ae610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:07.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.966+0000 7f78c319d700 1 --2- 172.21.15.71:0/106608075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78bc06f4b0 0x7f78bc0ae610 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009e60 tx=0x7f78b4009780 comp rx=0 tx=0).stop 2023-10-09T06:55:07.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.966+0000 7f78c319d700 1 -- 172.21.15.71:0/106608075 shutdown_connections 2023-10-09T06:55:07.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.966+0000 7f78c319d700 1 --2- 172.21.15.71:0/106608075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78bc06f4b0 0x7f78bc0ae610 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.966+0000 7f78c319d700 1 --2- 172.21.15.71:0/106608075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78bc06f060 0x7f78bc0ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.966+0000 7f78c319d700 1 -- 172.21.15.71:0/106608075 >> 172.21.15.71:0/106608075 conn(0x7f78bc0cc1e0 msgr2=0x7f78bc0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:07.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.966+0000 7f78c319d700 1 -- 172.21.15.71:0/106608075 shutdown_connections 2023-10-09T06:55:07.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.967+0000 7f78c319d700 1 -- 172.21.15.71:0/106608075 wait complete. 2023-10-09T06:55:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.968+0000 7f78c319d700 1 Processor -- start 2023-10-09T06:55:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.968+0000 7f78c319d700 1 -- start start 2023-10-09T06:55:07.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.969+0000 7f78c319d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78bc06f060 0x7f78bc1448f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:07.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.969+0000 7f78c319d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78bc06f4b0 0x7f78bc143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:07.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.969+0000 7f78c319d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78bc0cb1a0 0x7f78bc158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:07.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.969+0000 7f78c319d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc15d7d0 con 0x7f78bc06f4b0 2023-10-09T06:55:07.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.969+0000 7f78c319d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc15dab0 con 0x7f78bc06f060 2023-10-09T06:55:07.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.969+0000 7f78c319d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc15dd90 con 0x7f78bc0cb1a0 2023-10-09T06:55:07.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.969+0000 7f78c199a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78bc06f4b0 0x7f78bc143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:07.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.969+0000 7f78c199a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78bc06f4b0 0x7f78bc143d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39344/0 (socket says 172.21.15.71:39344) 2023-10-09T06:55:07.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.969+0000 7f78c199a700 1 -- 172.21.15.71:0/698652314 learned_addr learned my addr 172.21.15.71:0/698652314 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:07.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.969+0000 7f78c299c700 1 --2- 172.21.15.71:0/698652314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78bc0cb1a0 0x7f78bc158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:07.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.969+0000 7f78c219b700 1 --2- 172.21.15.71:0/698652314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78bc06f060 0x7f78bc1448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:07.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.970+0000 7f78c199a700 1 -- 172.21.15.71:0/698652314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78bc0cb1a0 msgr2=0x7f78bc158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:07.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.970+0000 7f78c199a700 1 --2- 172.21.15.71:0/698652314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78bc0cb1a0 0x7f78bc158990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.970+0000 7f78c199a700 1 -- 172.21.15.71:0/698652314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78bc06f060 msgr2=0x7f78bc1448f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:07.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.970+0000 7f78c199a700 1 --2- 172.21.15.71:0/698652314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78bc06f060 0x7f78bc1448f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:07.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.970+0000 7f78c199a700 1 -- 172.21.15.71:0/698652314 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac009420 con 0x7f78bc06f4b0 2023-10-09T06:55:07.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.970+0000 7f78c199a700 1 --2- 172.21.15.71:0/698652314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78bc06f4b0 0x7f78bc143d60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00ec80 tx=0x7f78ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:07.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.970+0000 7f78b27fc700 1 -- 172.21.15.71:0/698652314 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac00c920 con 0x7f78bc06f4b0 2023-10-09T06:55:07.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.970+0000 7f78b27fc700 1 -- 172.21.15.71:0/698652314 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac00ca80 con 0x7f78bc06f4b0 2023-10-09T06:55:07.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.970+0000 7f78c319d700 1 -- 172.21.15.71:0/698652314 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b4009a20 con 0x7f78bc06f4b0 2023-10-09T06:55:07.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.970+0000 7f78b27fc700 1 -- 172.21.15.71:0/698652314 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac00ce00 con 0x7f78bc06f4b0 2023-10-09T06:55:07.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.970+0000 7f78c319d700 1 -- 172.21.15.71:0/698652314 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc15e350 con 0x7f78bc06f4b0 2023-10-09T06:55:07.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.971+0000 7f78c319d700 1 -- 172.21.15.71:0/698652314 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78bc0cbf90 con 0x7f78bc06f4b0 2023-10-09T06:55:07.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.972+0000 7f78b27fc700 1 -- 172.21.15.71:0/698652314 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f78ac013680 con 0x7f78bc06f4b0 2023-10-09T06:55:07.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.973+0000 7f78b27fc700 1 --2- 172.21.15.71:0/698652314 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f78a0066f30 0x7f78a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:07.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.973+0000 7f78b27fc700 1 -- 172.21.15.71:0/698652314 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f78ac084d90 con 0x7f78bc06f4b0 2023-10-09T06:55:07.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.973+0000 7f78c219b700 1 --2- 172.21.15.71:0/698652314 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f78a0066f30 0x7f78a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:07.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.974+0000 7f78c219b700 1 --2- 172.21.15.71:0/698652314 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f78a0066f30 0x7f78a00693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f78b8007fd0 tx=0x7f78b8009040 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:07.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:07.977+0000 7f78b27fc700 1 -- 172.21.15.71:0/698652314 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78ac051e90 con 0x7f78bc06f4b0 2023-10-09T06:55:08.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:08.212+0000 7f78c319d700 1 -- 172.21.15.71:0/698652314 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f78bc15e570 con 0x7f78bc06f4b0 2023-10-09T06:55:08.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:08.941+0000 7f78b27fc700 1 -- 172.21.15.71:0/698652314 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) v1 ==== 118+0+0 (secure 0 0 0) 0x7f78ac0170b0 con 0x7f78bc06f4b0 2023-10-09T06:55:08.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:08.944+0000 7f78c319d700 1 -- 172.21.15.71:0/698652314 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f78a0066f30 msgr2=0x7f78a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:08.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:08.944+0000 7f78c319d700 1 --2- 172.21.15.71:0/698652314 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f78a0066f30 0x7f78a00693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f78b8007fd0 tx=0x7f78b8009040 comp rx=0 tx=0).stop 2023-10-09T06:55:08.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:08.944+0000 7f78c319d700 1 -- 172.21.15.71:0/698652314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78bc06f4b0 msgr2=0x7f78bc143d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:08.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:08.944+0000 7f78c319d700 1 --2- 172.21.15.71:0/698652314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78bc06f4b0 0x7f78bc143d60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00ec80 tx=0x7f78ac0091a0 comp rx=0 tx=0).stop 2023-10-09T06:55:08.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:08.944+0000 7f78c319d700 1 -- 172.21.15.71:0/698652314 shutdown_connections 2023-10-09T06:55:08.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:08.944+0000 7f78c319d700 1 --2- 172.21.15.71:0/698652314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78bc0cb1a0 0x7f78bc158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:08.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:08.944+0000 7f78c319d700 1 --2- 172.21.15.71:0/698652314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78bc06f060 0x7f78bc1448f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:08.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:08.944+0000 7f78c319d700 1 --2- 172.21.15.71:0/698652314 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f78a0066f30 0x7f78a00693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:08.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:08.944+0000 7f78c319d700 1 --2- 172.21.15.71:0/698652314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78bc06f4b0 0x7f78bc143d60 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:08.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:08.944+0000 7f78c319d700 1 -- 172.21.15.71:0/698652314 >> 172.21.15.71:0/698652314 conn(0x7f78bc0cc1e0 msgr2=0x7f78bc0b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:08.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:08.944+0000 7f78c319d700 1 -- 172.21.15.71:0/698652314 shutdown_connections 2023-10-09T06:55:08.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:08.944+0000 7f78c319d700 1 -- 172.21.15.71:0/698652314 wait complete. 2023-10-09T06:55:08.964 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T06:55:09.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.148+0000 7f6434bff700 1 Processor -- start 2023-10-09T06:55:09.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.148+0000 7f6434bff700 1 -- start start 2023-10-09T06:55:09.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.150+0000 7f6434bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64300ccee0 0x7f64301561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:09.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.150+0000 7f6434bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f64300c87c0 0x7f6430156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:09.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.150+0000 7f6434bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643015b0d0 con 0x7f64300c83f0 2023-10-09T06:55:09.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.150+0000 7f6434bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6430156c50 con 0x7f64300c87c0 2023-10-09T06:55:09.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.150+0000 7f6434bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643015a4c0 con 0x7f64300ccee0 2023-10-09T06:55:09.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.150+0000 7f642ed9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f64300c87c0 0x7f6430156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:09.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.150+0000 7f6427fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64300ccee0 0x7f64301561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:09.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.150+0000 7f642ed9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f64300c87c0 0x7f6430156710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:46764/0 (socket says 172.21.15.71:46764) 2023-10-09T06:55:09.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.150+0000 7f642ed9d700 1 -- 172.21.15.71:0/802279172 learned_addr learned my addr 172.21.15.71:0/802279172 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:09.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.150+0000 7f642e59c700 1 --1- 172.21.15.71:0/802279172 >> v1:172.21.15.179:6789/0 conn(0x7f64300c83f0 0x7f64300c7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:45790/0 (socket says 172.21.15.71:45790) 2023-10-09T06:55:09.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.151+0000 7f6427fff700 1 -- 172.21.15.71:0/802279172 >> v2:172.21.15.179:3300/0 conn(0x7f64300c87c0 msgr2=0x7f6430156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:09.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.151+0000 7f6427fff700 1 --2- 172.21.15.71:0/802279172 >> v2:172.21.15.179:3300/0 conn(0x7f64300c87c0 0x7f6430156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:09.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.151+0000 7f6427fff700 1 -- 172.21.15.71:0/802279172 >> v1:172.21.15.179:6789/0 conn(0x7f64300c83f0 legacy=0x7f64300c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:09.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.151+0000 7f6427fff700 1 -- 172.21.15.71:0/802279172 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643015a7a0 con 0x7f64300ccee0 2023-10-09T06:55:09.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.151+0000 7f6427fff700 1 --2- 172.21.15.71:0/802279172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64300ccee0 0x7f64301561d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f64180098e0 tx=0x7f64180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3848d2188890019d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:09.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.151+0000 7f642dd9b700 1 -- 172.21.15.71:0/802279172 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641800b640 con 0x7f64300ccee0 2023-10-09T06:55:09.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.151+0000 7f642dd9b700 1 -- 172.21.15.71:0/802279172 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641800b7a0 con 0x7f64300ccee0 2023-10-09T06:55:09.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.151+0000 7f642dd9b700 1 -- 172.21.15.71:0/802279172 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641800bb40 con 0x7f64300ccee0 2023-10-09T06:55:09.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.152+0000 7f6434bff700 1 -- 172.21.15.71:0/802279172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64300ccee0 msgr2=0x7f64301561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:09.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.152+0000 7f6434bff700 1 --2- 172.21.15.71:0/802279172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64300ccee0 0x7f64301561d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f64180098e0 tx=0x7f64180091a0 comp rx=0 tx=0).stop 2023-10-09T06:55:09.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.152+0000 7f6434bff700 1 -- 172.21.15.71:0/802279172 shutdown_connections 2023-10-09T06:55:09.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.152+0000 7f6434bff700 1 --2- 172.21.15.71:0/802279172 >> v2:172.21.15.179:3300/0 conn(0x7f64300c87c0 0x7f6430156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:09.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.152+0000 7f6434bff700 1 --2- 172.21.15.71:0/802279172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64300ccee0 0x7f64301561d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:09.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.152+0000 7f6434bff700 1 -- 172.21.15.71:0/802279172 >> 172.21.15.71:0/802279172 conn(0x7f6430068e10 msgr2=0x7f64300cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:09.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.152+0000 7f6434bff700 1 -- 172.21.15.71:0/802279172 shutdown_connections 2023-10-09T06:55:09.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.152+0000 7f6434bff700 1 -- 172.21.15.71:0/802279172 wait complete. 2023-10-09T06:55:09.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.153+0000 7f6434bff700 1 Processor -- start 2023-10-09T06:55:09.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.153+0000 7f6434bff700 1 -- start start 2023-10-09T06:55:09.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.154+0000 7f6434bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64300c83f0 0x7f6430147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:09.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.154+0000 7f6434bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64300c87c0 0x7f64300b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:09.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.154+0000 7f6434bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64300ccee0 0x7f64300c2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:09.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.154+0000 7f6434bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64300c4710 con 0x7f64300c83f0 2023-10-09T06:55:09.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.154+0000 7f6434bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64300b2010 con 0x7f64300ccee0 2023-10-09T06:55:09.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.154+0000 7f6434bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64300c3de0 con 0x7f64300c87c0 2023-10-09T06:55:09.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.154+0000 7f642e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64300c83f0 0x7f6430147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:09.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.155+0000 7f642e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64300c83f0 0x7f6430147280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39346/0 (socket says 172.21.15.71:39346) 2023-10-09T06:55:09.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.155+0000 7f642e59c700 1 -- 172.21.15.71:0/916020524 learned_addr learned my addr 172.21.15.71:0/916020524 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:09.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.155+0000 7f642ed9d700 1 --2- 172.21.15.71:0/916020524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64300ccee0 0x7f64300c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:09.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.155+0000 7f6427fff700 1 --2- 172.21.15.71:0/916020524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64300c87c0 0x7f64300b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:09.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.155+0000 7f642e59c700 1 -- 172.21.15.71:0/916020524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64300c87c0 msgr2=0x7f64300b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:09.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.155+0000 7f642e59c700 1 --2- 172.21.15.71:0/916020524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64300c87c0 0x7f64300b15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:09.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.155+0000 7f642e59c700 1 -- 172.21.15.71:0/916020524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64300ccee0 msgr2=0x7f64300c2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:09.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.155+0000 7f642e59c700 1 --2- 172.21.15.71:0/916020524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64300ccee0 0x7f64300c2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:09.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.155+0000 7f642e59c700 1 -- 172.21.15.71:0/916020524 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6418009420 con 0x7f64300c83f0 2023-10-09T06:55:09.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.155+0000 7f6427fff700 1 --2- 172.21.15.71:0/916020524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64300c87c0 0x7f64300b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:55:09.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.155+0000 7f642e59c700 1 --2- 172.21.15.71:0/916020524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64300c83f0 0x7f6430147280 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f642000c560 tx=0x7f6420007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:09.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.155+0000 7f64267fc700 1 -- 172.21.15.71:0/916020524 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6420005a70 con 0x7f64300c83f0 2023-10-09T06:55:09.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.155+0000 7f64267fc700 1 -- 172.21.15.71:0/916020524 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6420005bd0 con 0x7f64300c83f0 2023-10-09T06:55:09.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.155+0000 7f64267fc700 1 -- 172.21.15.71:0/916020524 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64200070d0 con 0x7f64300c83f0 2023-10-09T06:55:09.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.155+0000 7f6434bff700 1 -- 172.21.15.71:0/916020524 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64300c40c0 con 0x7f64300c83f0 2023-10-09T06:55:09.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.156+0000 7f6434bff700 1 -- 172.21.15.71:0/916020524 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64300af3f0 con 0x7f64300c83f0 2023-10-09T06:55:09.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.157+0000 7f6434bff700 1 -- 172.21.15.71:0/916020524 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64300af610 con 0x7f64300c83f0 2023-10-09T06:55:09.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.157+0000 7f64267fc700 1 -- 172.21.15.71:0/916020524 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6420007440 con 0x7f64300c83f0 2023-10-09T06:55:09.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.158+0000 7f64267fc700 1 --2- 172.21.15.71:0/916020524 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6410066f30 0x7f64100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:09.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.158+0000 7f64267fc700 1 -- 172.21.15.71:0/916020524 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f6420083b90 con 0x7f64300c83f0 2023-10-09T06:55:09.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.159+0000 7f6427fff700 1 --2- 172.21.15.71:0/916020524 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6410066f30 0x7f64100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:09.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.159+0000 7f6427fff700 1 --2- 172.21.15.71:0/916020524 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6410066f30 0x7f64100693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f64180093f0 tx=0x7f6418017000 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:09.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.162+0000 7f64267fc700 1 -- 172.21.15.71:0/916020524 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64300af610 con 0x7f64300c83f0 2023-10-09T06:55:09.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.394+0000 7f6434bff700 1 -- 172.21.15.71:0/916020524 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f64300af610 con 0x7f64300c83f0 2023-10-09T06:55:09.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.949+0000 7f64267fc700 1 -- 172.21.15.71:0/916020524 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f64300af610 con 0x7f64300c83f0 2023-10-09T06:55:09.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.952+0000 7f6434bff700 1 -- 172.21.15.71:0/916020524 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6410066f30 msgr2=0x7f64100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:09.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.952+0000 7f6434bff700 1 --2- 172.21.15.71:0/916020524 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6410066f30 0x7f64100693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f64180093f0 tx=0x7f6418017000 comp rx=0 tx=0).stop 2023-10-09T06:55:09.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.952+0000 7f6434bff700 1 -- 172.21.15.71:0/916020524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64300c83f0 msgr2=0x7f6430147280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:09.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.952+0000 7f6434bff700 1 --2- 172.21.15.71:0/916020524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64300c83f0 0x7f6430147280 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f642000c560 tx=0x7f6420007f70 comp rx=0 tx=0).stop 2023-10-09T06:55:09.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.952+0000 7f6434bff700 1 -- 172.21.15.71:0/916020524 shutdown_connections 2023-10-09T06:55:09.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.952+0000 7f6434bff700 1 --2- 172.21.15.71:0/916020524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64300ccee0 0x7f64300c2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:09.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.952+0000 7f6434bff700 1 --2- 172.21.15.71:0/916020524 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6410066f30 0x7f64100693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:09.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.952+0000 7f6434bff700 1 --2- 172.21.15.71:0/916020524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64300c83f0 0x7f6430147280 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:09.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.952+0000 7f6434bff700 1 --2- 172.21.15.71:0/916020524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64300c87c0 0x7f64300b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:09.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.952+0000 7f6434bff700 1 -- 172.21.15.71:0/916020524 >> 172.21.15.71:0/916020524 conn(0x7f6430068e10 msgr2=0x7f643014e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:09.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.953+0000 7f6434bff700 1 -- 172.21.15.71:0/916020524 shutdown_connections 2023-10-09T06:55:09.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:09.953+0000 7f6434bff700 1 -- 172.21.15.71:0/916020524 wait complete. 2023-10-09T06:55:09.971 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:55:10.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.153+0000 7f0df9dff700 1 Processor -- start 2023-10-09T06:55:10.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.153+0000 7f0df9dff700 1 -- start start 2023-10-09T06:55:10.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.155+0000 7f0df9dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0df4155c10 0x7f0df4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:10.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.155+0000 7f0df9dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0df40ac6d0 0x7f0df40b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:10.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.155+0000 7f0df9dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df40acac0 con 0x7f0df40ac230 2023-10-09T06:55:10.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.155+0000 7f0df9dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df40ad930 con 0x7f0df4155c10 2023-10-09T06:55:10.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.155+0000 7f0df9dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df40acd20 con 0x7f0df40ac6d0 2023-10-09T06:55:10.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.155+0000 7f0df37fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0df4155c10 0x7f0df4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:10.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.155+0000 7f0df3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0df40ac6d0 0x7f0df40b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:10.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.155+0000 7f0df37fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0df4155c10 0x7f0df4155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:46788/0 (socket says 172.21.15.71:46788) 2023-10-09T06:55:10.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.155+0000 7f0df37fe700 1 -- 172.21.15.71:0/1006977295 learned_addr learned my addr 172.21.15.71:0/1006977295 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:10.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.155+0000 7f0df2ffd700 1 --1- 172.21.15.71:0/1006977295 >> v1:172.21.15.179:6789/0 conn(0x7f0df40ac230 0x7f0df41568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:45800/0 (socket says 172.21.15.71:45800) 2023-10-09T06:55:10.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.156+0000 7f0df3fff700 1 -- 172.21.15.71:0/1006977295 >> v2:172.21.15.179:3300/0 conn(0x7f0df4155c10 msgr2=0x7f0df4155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:10.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.156+0000 7f0df3fff700 1 --2- 172.21.15.71:0/1006977295 >> v2:172.21.15.179:3300/0 conn(0x7f0df4155c10 0x7f0df4155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:10.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.156+0000 7f0df3fff700 1 -- 172.21.15.71:0/1006977295 >> v1:172.21.15.179:6789/0 conn(0x7f0df40ac230 legacy=0x7f0df41568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:10.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.156+0000 7f0df3fff700 1 -- 172.21.15.71:0/1006977295 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df40ad000 con 0x7f0df40ac6d0 2023-10-09T06:55:10.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.156+0000 7f0df3fff700 1 --2- 172.21.15.71:0/1006977295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0df40ac6d0 0x7f0df40b0300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0df40acc50 tx=0x7f0dec009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63e221b3169e0571 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:10.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.156+0000 7f0df27fc700 1 -- 172.21.15.71:0/1006977295 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec016070 con 0x7f0df40ac6d0 2023-10-09T06:55:10.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.156+0000 7f0df27fc700 1 -- 172.21.15.71:0/1006977295 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec00bb60 con 0x7f0df40ac6d0 2023-10-09T06:55:10.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.156+0000 7f0df27fc700 1 -- 172.21.15.71:0/1006977295 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec00e070 con 0x7f0df40ac6d0 2023-10-09T06:55:10.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.157+0000 7f0df9dff700 1 -- 172.21.15.71:0/1006977295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0df40ac6d0 msgr2=0x7f0df40b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:10.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.157+0000 7f0df9dff700 1 --2- 172.21.15.71:0/1006977295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0df40ac6d0 0x7f0df40b0300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0df40acc50 tx=0x7f0dec009780 comp rx=0 tx=0).stop 2023-10-09T06:55:10.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.157+0000 7f0df9dff700 1 -- 172.21.15.71:0/1006977295 shutdown_connections 2023-10-09T06:55:10.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.157+0000 7f0df9dff700 1 --2- 172.21.15.71:0/1006977295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0df40ac6d0 0x7f0df40b0300 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:10.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.157+0000 7f0df9dff700 1 --2- 172.21.15.71:0/1006977295 >> v2:172.21.15.179:3300/0 conn(0x7f0df4155c10 0x7f0df4155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:10.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.157+0000 7f0df9dff700 1 -- 172.21.15.71:0/1006977295 >> 172.21.15.71:0/1006977295 conn(0x7f0df406a320 msgr2=0x7f0df40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:10.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.157+0000 7f0df9dff700 1 -- 172.21.15.71:0/1006977295 shutdown_connections 2023-10-09T06:55:10.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.157+0000 7f0df9dff700 1 -- 172.21.15.71:0/1006977295 wait complete. 2023-10-09T06:55:10.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.158+0000 7f0df9dff700 1 Processor -- start 2023-10-09T06:55:10.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.159+0000 7f0df9dff700 1 -- start start 2023-10-09T06:55:10.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.159+0000 7f0df9dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0df40ac230 0x7f0df4147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:10.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.159+0000 7f0df9dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0df40ac6d0 0x7f0df414e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:10.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.159+0000 7f0df9dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0df4155c10 0x7f0df41546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:10.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.160+0000 7f0df9dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df416daa0 con 0x7f0df40ac6d0 2023-10-09T06:55:10.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.160+0000 7f0df9dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df414ecf0 con 0x7f0df4155c10 2023-10-09T06:55:10.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.160+0000 7f0df9dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df414efd0 con 0x7f0df40ac230 2023-10-09T06:55:10.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.160+0000 7f0df2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0df40ac6d0 0x7f0df414e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:10.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.160+0000 7f0df2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0df40ac6d0 0x7f0df414e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39360/0 (socket says 172.21.15.71:39360) 2023-10-09T06:55:10.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.160+0000 7f0df2ffd700 1 -- 172.21.15.71:0/853250096 learned_addr learned my addr 172.21.15.71:0/853250096 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:10.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.160+0000 7f0df3fff700 1 --2- 172.21.15.71:0/853250096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0df4155c10 0x7f0df41546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:10.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.160+0000 7f0df37fe700 1 --2- 172.21.15.71:0/853250096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0df40ac230 0x7f0df4147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:10.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.160+0000 7f0df2ffd700 1 -- 172.21.15.71:0/853250096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0df40ac230 msgr2=0x7f0df4147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:10.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.160+0000 7f0df2ffd700 1 --2- 172.21.15.71:0/853250096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0df40ac230 0x7f0df4147ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:10.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.160+0000 7f0df2ffd700 1 -- 172.21.15.71:0/853250096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0df4155c10 msgr2=0x7f0df41546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:10.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.160+0000 7f0df2ffd700 1 --2- 172.21.15.71:0/853250096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0df4155c10 0x7f0df41546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:10.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.160+0000 7f0df2ffd700 1 -- 172.21.15.71:0/853250096 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dec009a20 con 0x7f0df40ac6d0 2023-10-09T06:55:10.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.160+0000 7f0df2ffd700 1 --2- 172.21.15.71:0/853250096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0df40ac6d0 0x7f0df414e380 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0de800c7c0 tx=0x7f0de8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:10.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.161+0000 7f0ddb7fe700 1 -- 172.21.15.71:0/853250096 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de8005a70 con 0x7f0df40ac6d0 2023-10-09T06:55:10.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.161+0000 7f0ddb7fe700 1 -- 172.21.15.71:0/853250096 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de8005bd0 con 0x7f0df40ac6d0 2023-10-09T06:55:10.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.161+0000 7f0ddb7fe700 1 -- 172.21.15.71:0/853250096 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de80070d0 con 0x7f0df40ac6d0 2023-10-09T06:55:10.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.161+0000 7f0df9dff700 1 -- 172.21.15.71:0/853250096 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df416d450 con 0x7f0df40ac6d0 2023-10-09T06:55:10.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.161+0000 7f0df9dff700 1 -- 172.21.15.71:0/853250096 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df4148420 con 0x7f0df40ac6d0 2023-10-09T06:55:10.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.162+0000 7f0df9dff700 1 -- 172.21.15.71:0/853250096 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df416dc50 con 0x7f0df40ac6d0 2023-10-09T06:55:10.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.163+0000 7f0ddb7fe700 1 -- 172.21.15.71:0/853250096 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0de8007480 con 0x7f0df40ac6d0 2023-10-09T06:55:10.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.163+0000 7f0ddb7fe700 1 --2- 172.21.15.71:0/853250096 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0de0066f30 0x7f0de00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:10.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.164+0000 7f0ddb7fe700 1 -- 172.21.15.71:0/853250096 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f0de8083b30 con 0x7f0df40ac6d0 2023-10-09T06:55:10.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.164+0000 7f0df37fe700 1 --2- 172.21.15.71:0/853250096 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0de0066f30 0x7f0de00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:10.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.165+0000 7f0df37fe700 1 --2- 172.21.15.71:0/853250096 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0de0066f30 0x7f0de00693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0de4006fd0 tx=0x7f0de4009250 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:10.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.168+0000 7f0ddb7fe700 1 -- 172.21.15.71:0/853250096 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0df416dc50 con 0x7f0df40ac6d0 2023-10-09T06:55:10.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.397+0000 7f0df9dff700 1 -- 172.21.15.71:0/853250096 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0df4156360 con 0x7f0df40ac6d0 2023-10-09T06:55:10.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.398+0000 7f0ddb7fe700 1 -- 172.21.15.71:0/853250096 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f0de8017020 con 0x7f0df40ac6d0 2023-10-09T06:55:10.399 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:55:10.399 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5153,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3904949177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3904949177},{"type":"v1","addr":"172.21.15.179:6837","nonce":3904949177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5617,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2761847814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2761847814},{"type":"v1","addr":"172.21.15.71:6833","nonce":2761847814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5632,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3251743580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3251743580},{"type":"v1","addr":"172.21.15.179:6836","nonce":3251743580}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:55:06.387910+0000","modified":"2023-10-09T06:55:09.941744+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5727},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5727":{"gid":5727,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/4151615916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":4151615916},{"type":"v1","addr":"172.21.15.71:6835","nonce":4151615916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T06:55:10.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.400+0000 7f0df9dff700 1 -- 172.21.15.71:0/853250096 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0de0066f30 msgr2=0x7f0de00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:10.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.400+0000 7f0df9dff700 1 --2- 172.21.15.71:0/853250096 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0de0066f30 0x7f0de00693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0de4006fd0 tx=0x7f0de4009250 comp rx=0 tx=0).stop 2023-10-09T06:55:10.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.400+0000 7f0df9dff700 1 -- 172.21.15.71:0/853250096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0df40ac6d0 msgr2=0x7f0df414e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:10.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.400+0000 7f0df9dff700 1 --2- 172.21.15.71:0/853250096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0df40ac6d0 0x7f0df414e380 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0de800c7c0 tx=0x7f0de8007f70 comp rx=0 tx=0).stop 2023-10-09T06:55:10.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.400+0000 7f0df9dff700 1 -- 172.21.15.71:0/853250096 shutdown_connections 2023-10-09T06:55:10.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.400+0000 7f0df9dff700 1 --2- 172.21.15.71:0/853250096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0df4155c10 0x7f0df41546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:10.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.400+0000 7f0df9dff700 1 --2- 172.21.15.71:0/853250096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0df40ac230 0x7f0df4147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:10.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.400+0000 7f0df9dff700 1 --2- 172.21.15.71:0/853250096 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0de0066f30 0x7f0de00693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:10.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.400+0000 7f0df9dff700 1 --2- 172.21.15.71:0/853250096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0df40ac6d0 0x7f0df414e380 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:10.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.400+0000 7f0df9dff700 1 -- 172.21.15.71:0/853250096 >> 172.21.15.71:0/853250096 conn(0x7f0df406a320 msgr2=0x7f0df406e430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:10.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.400+0000 7f0df9dff700 1 -- 172.21.15.71:0/853250096 shutdown_connections 2023-10-09T06:55:10.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.400+0000 7f0df9dff700 1 -- 172.21.15.71:0/853250096 wait complete. 2023-10-09T06:55:10.403 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 24 2023-10-09T06:55:10.418 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:55:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.599+0000 7f2efa1ff700 1 Processor -- start 2023-10-09T06:55:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.599+0000 7f2efa1ff700 1 -- start start 2023-10-09T06:55:10.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.600+0000 7f2efa1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef4159890 0x7f2ef415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:10.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.600+0000 7f2efa1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2ef4159c60 0x7f2ef415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:10.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.601+0000 7f2efa1ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2ef415db10 0x7f2ef4069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:10.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.601+0000 7f2efa1ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef415a160 con 0x7f2ef415db10 2023-10-09T06:55:10.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.601+0000 7f2efa1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef40d13a0 con 0x7f2ef4159c60 2023-10-09T06:55:10.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.601+0000 7f2efa1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef415e140 con 0x7f2ef4159890 2023-10-09T06:55:10.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.601+0000 7f2ef3fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2ef415db10 0x7f2ef4069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:10.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.601+0000 7f2ef3fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2ef415db10 0x7f2ef4069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39376/0 (socket says 172.21.15.71:39376) 2023-10-09T06:55:10.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.601+0000 7f2ef3fff700 1 -- 172.21.15.71:0/2623151370 learned_addr learned my addr 172.21.15.71:0/2623151370 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:10.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.601+0000 7f2ef2ffd700 1 --2- 172.21.15.71:0/2623151370 >> v2:172.21.15.179:3300/0 conn(0x7f2ef4159c60 0x7f2ef415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:10.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.601+0000 7f2ef37fe700 1 --2- 172.21.15.71:0/2623151370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef4159890 0x7f2ef415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:10.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.601+0000 7f2ef3fff700 1 -- 172.21.15.71:0/2623151370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef4159890 msgr2=0x7f2ef415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:10.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.601+0000 7f2ef3fff700 1 --2- 172.21.15.71:0/2623151370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef4159890 0x7f2ef415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:10.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.601+0000 7f2ef3fff700 1 -- 172.21.15.71:0/2623151370 >> v2:172.21.15.179:3300/0 conn(0x7f2ef4159c60 msgr2=0x7f2ef415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:10.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.601+0000 7f2ef3fff700 1 --2- 172.21.15.71:0/2623151370 >> v2:172.21.15.179:3300/0 conn(0x7f2ef4159c60 0x7f2ef415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:10.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.601+0000 7f2ef3fff700 1 -- 172.21.15.71:0/2623151370 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef415a3d0 con 0x7f2ef415db10 2023-10-09T06:55:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.602+0000 7f2ef3fff700 1 --2- 172.21.15.71:0/2623151370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef415db10 0x7f2ef4069560 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40650f0 tx=0x7f2eec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22fb0e229502f6a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.602+0000 7f2ef27fc700 1 -- 172.21.15.71:0/2623151370 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec00e070 con 0x7f2ef415db10 2023-10-09T06:55:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.602+0000 7f2ef27fc700 1 -- 172.21.15.71:0/2623151370 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eec00b970 con 0x7f2ef415db10 2023-10-09T06:55:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.602+0000 7f2ef27fc700 1 -- 172.21.15.71:0/2623151370 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec0092e0 con 0x7f2ef415db10 2023-10-09T06:55:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.602+0000 7f2efa1ff700 1 -- 172.21.15.71:0/2623151370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef415db10 msgr2=0x7f2ef4069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.602+0000 7f2efa1ff700 1 --2- 172.21.15.71:0/2623151370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef415db10 0x7f2ef4069560 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40650f0 tx=0x7f2eec009840 comp rx=0 tx=0).stop 2023-10-09T06:55:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.602+0000 7f2efa1ff700 1 -- 172.21.15.71:0/2623151370 shutdown_connections 2023-10-09T06:55:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.602+0000 7f2efa1ff700 1 --2- 172.21.15.71:0/2623151370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef415db10 0x7f2ef4069560 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.602+0000 7f2efa1ff700 1 --2- 172.21.15.71:0/2623151370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef4159890 0x7f2ef415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.602+0000 7f2efa1ff700 1 --2- 172.21.15.71:0/2623151370 >> v2:172.21.15.179:3300/0 conn(0x7f2ef4159c60 0x7f2ef415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:10.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.603+0000 7f2efa1ff700 1 -- 172.21.15.71:0/2623151370 >> 172.21.15.71:0/2623151370 conn(0x7f2ef4068e20 msgr2=0x7f2ef40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:10.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.603+0000 7f2efa1ff700 1 -- 172.21.15.71:0/2623151370 shutdown_connections 2023-10-09T06:55:10.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.603+0000 7f2efa1ff700 1 -- 172.21.15.71:0/2623151370 wait complete. 2023-10-09T06:55:10.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.604+0000 7f2efa1ff700 1 Processor -- start 2023-10-09T06:55:10.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.604+0000 7f2efa1ff700 1 -- start start 2023-10-09T06:55:10.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.605+0000 7f2efa1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ef4159890 0x7f2ef414c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:10.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.605+0000 7f2efa1ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef4159c60 0x7f2ef416a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.605+0000 7f2efa1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef415db10 0x7f2ef4152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.605+0000 7f2efa1ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef41563f0 con 0x7f2ef4159c60 2023-10-09T06:55:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.605+0000 7f2efa1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef416a8d0 con 0x7f2ef4159890 2023-10-09T06:55:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.605+0000 7f2efa1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef41523c0 con 0x7f2ef415db10 2023-10-09T06:55:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.605+0000 7f2ef2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef4159c60 0x7f2ef416a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.605+0000 7f2ef2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef4159c60 0x7f2ef416a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39386/0 (socket says 172.21.15.71:39386) 2023-10-09T06:55:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.605+0000 7f2ef2ffd700 1 -- 172.21.15.71:0/3257127776 learned_addr learned my addr 172.21.15.71:0/3257127776 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.605+0000 7f2ef37fe700 1 --2- 172.21.15.71:0/3257127776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ef4159890 0x7f2ef414c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.605+0000 7f2ef3fff700 1 --2- 172.21.15.71:0/3257127776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef415db10 0x7f2ef4152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.606+0000 7f2ef2ffd700 1 -- 172.21.15.71:0/3257127776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef415db10 msgr2=0x7f2ef4152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.606+0000 7f2ef2ffd700 1 --2- 172.21.15.71:0/3257127776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef415db10 0x7f2ef4152850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.606+0000 7f2ef2ffd700 1 -- 172.21.15.71:0/3257127776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ef4159890 msgr2=0x7f2ef414c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.606+0000 7f2ef2ffd700 1 --2- 172.21.15.71:0/3257127776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ef4159890 0x7f2ef414c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.606+0000 7f2ef2ffd700 1 -- 172.21.15.71:0/3257127776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec009ae0 con 0x7f2ef4159c60 2023-10-09T06:55:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.606+0000 7f2ef2ffd700 1 --2- 172.21.15.71:0/3257127776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef4159c60 0x7f2ef416a390 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800ec80 tx=0x7f2ee80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.606+0000 7f2edb7fe700 1 -- 172.21.15.71:0/3257127776 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee800c7f0 con 0x7f2ef4159c60 2023-10-09T06:55:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.606+0000 7f2efa1ff700 1 -- 172.21.15.71:0/3257127776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef41517b0 con 0x7f2ef4159c60 2023-10-09T06:55:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.606+0000 7f2efa1ff700 1 -- 172.21.15.71:0/3257127776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef4151d70 con 0x7f2ef4159c60 2023-10-09T06:55:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.607+0000 7f2edb7fe700 1 -- 172.21.15.71:0/3257127776 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee800cb60 con 0x7f2ef4159c60 2023-10-09T06:55:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.607+0000 7f2edb7fe700 1 -- 172.21.15.71:0/3257127776 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee800ccd0 con 0x7f2ef4159c60 2023-10-09T06:55:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.607+0000 7f2efa1ff700 1 -- 172.21.15.71:0/3257127776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed40052b0 con 0x7f2ef4159c60 2023-10-09T06:55:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.608+0000 7f2edb7fe700 1 -- 172.21.15.71:0/3257127776 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ee8005a00 con 0x7f2ef4159c60 2023-10-09T06:55:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.609+0000 7f2edb7fe700 1 --2- 172.21.15.71:0/3257127776 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2ee0066f30 0x7f2ee00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.609+0000 7f2edb7fe700 1 -- 172.21.15.71:0/3257127776 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f2ee8084690 con 0x7f2ef4159c60 2023-10-09T06:55:10.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.610+0000 7f2ef37fe700 1 --2- 172.21.15.71:0/3257127776 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2ee0066f30 0x7f2ee00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:10.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.610+0000 7f2ef37fe700 1 --2- 172.21.15.71:0/3257127776 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2ee0066f30 0x7f2ee00693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40cad90 tx=0x7f2ee40091a0 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:10.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.613+0000 7f2edb7fe700 1 -- 172.21.15.71:0/3257127776 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ee80516f0 con 0x7f2ef4159c60 2023-10-09T06:55:10.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.802+0000 7f2efa1ff700 1 -- 172.21.15.71:0/3257127776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ed4005560 con 0x7f2ef4159c60 2023-10-09T06:55:10.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.803+0000 7f2edb7fe700 1 -- 172.21.15.71:0/3257127776 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+15900 (secure 0 0 0) 0x7f2ee8005cb0 con 0x7f2ef4159c60 2023-10-09T06:55:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:55:10.804 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":62,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:55:07.915702+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:55:04.058830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T06:55:05.370158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:55:10.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.805+0000 7f2efa1ff700 1 -- 172.21.15.71:0/3257127776 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2ee0066f30 msgr2=0x7f2ee00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:10.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.805+0000 7f2efa1ff700 1 --2- 172.21.15.71:0/3257127776 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2ee0066f30 0x7f2ee00693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40cad90 tx=0x7f2ee40091a0 comp rx=0 tx=0).stop 2023-10-09T06:55:10.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.805+0000 7f2efa1ff700 1 -- 172.21.15.71:0/3257127776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef4159c60 msgr2=0x7f2ef416a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:10.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.805+0000 7f2efa1ff700 1 --2- 172.21.15.71:0/3257127776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef4159c60 0x7f2ef416a390 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800ec80 tx=0x7f2ee80091a0 comp rx=0 tx=0).stop 2023-10-09T06:55:10.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.805+0000 7f2efa1ff700 1 -- 172.21.15.71:0/3257127776 shutdown_connections 2023-10-09T06:55:10.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.805+0000 7f2efa1ff700 1 --2- 172.21.15.71:0/3257127776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef415db10 0x7f2ef4152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:10.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.805+0000 7f2efa1ff700 1 --2- 172.21.15.71:0/3257127776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ef4159890 0x7f2ef414c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:10.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.805+0000 7f2efa1ff700 1 --2- 172.21.15.71:0/3257127776 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2ee0066f30 0x7f2ee00693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:10.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.805+0000 7f2efa1ff700 1 --2- 172.21.15.71:0/3257127776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef4159c60 0x7f2ef416a390 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:10.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.805+0000 7f2efa1ff700 1 -- 172.21.15.71:0/3257127776 >> 172.21.15.71:0/3257127776 conn(0x7f2ef4068e20 msgr2=0x7f2ef414d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:10.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.805+0000 7f2efa1ff700 1 -- 172.21.15.71:0/3257127776 shutdown_connections 2023-10-09T06:55:10.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:10.805+0000 7f2efa1ff700 1 -- 172.21.15.71:0/3257127776 wait complete. 2023-10-09T06:55:10.823 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T06:55:10.824 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:55:11.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.005+0000 7febbb9ff700 1 Processor -- start 2023-10-09T06:55:11.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.005+0000 7febbb9ff700 1 -- start start 2023-10-09T06:55:11.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.007+0000 7febbb9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febb4155c10 0x7febb4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:11.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.007+0000 7febbb9ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7febb40ac6a0 0x7febb40b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:11.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.007+0000 7febbb9ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb40acac0 con 0x7febb40ac230 2023-10-09T06:55:11.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.007+0000 7febbb9ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb40ad930 con 0x7febb40ac6a0 2023-10-09T06:55:11.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.007+0000 7febbb9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb40acd20 con 0x7febb4155c10 2023-10-09T06:55:11.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.007+0000 7febb9f9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7febb40ac6a0 0x7febb40b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:11.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.007+0000 7febb9f9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7febb40ac6a0 0x7febb40b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39400/0 (socket says 172.21.15.71:39400) 2023-10-09T06:55:11.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.007+0000 7febb9f9c700 1 -- 172.21.15.71:0/1775370387 learned_addr learned my addr 172.21.15.71:0/1775370387 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:11.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.007+0000 7febb8f9a700 1 --1- 172.21.15.71:0/1775370387 >> v1:172.21.15.71:6789/0 conn(0x7febb40ac230 0x7febb41568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48606/0 (socket says 172.21.15.71:48606) 2023-10-09T06:55:11.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.007+0000 7febb979b700 1 --2- 172.21.15.71:0/1775370387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febb4155c10 0x7febb4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.007+0000 7febb9f9c700 1 -- 172.21.15.71:0/1775370387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febb4155c10 msgr2=0x7febb4155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.007+0000 7febb9f9c700 1 --2- 172.21.15.71:0/1775370387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febb4155c10 0x7febb4155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.008+0000 7febb9f9c700 1 -- 172.21.15.71:0/1775370387 >> v1:172.21.15.71:6789/0 conn(0x7febb40ac230 legacy=0x7febb41568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.008+0000 7febb9f9c700 1 -- 172.21.15.71:0/1775370387 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb40ad000 con 0x7febb40ac6a0 2023-10-09T06:55:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.008+0000 7febabfff700 1 -- 172.21.15.71:0/1775370387 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418909253 0 0) 0x7febb40acac0 con 0x7febb40ac230 2023-10-09T06:55:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.008+0000 7febb9f9c700 1 --2- 172.21.15.71:0/1775370387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febb40ac6a0 0x7febb40b0300 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7febac009f20 tx=0x7febac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9daa99b1e02e8a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.008+0000 7febabfff700 1 -- 172.21.15.71:0/1775370387 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac0092e0 con 0x7febb40ac6a0 2023-10-09T06:55:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.008+0000 7febabfff700 1 -- 172.21.15.71:0/1775370387 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febac00ba80 con 0x7febb40ac6a0 2023-10-09T06:55:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.008+0000 7febabfff700 1 -- 172.21.15.71:0/1775370387 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac00be40 con 0x7febb40ac6a0 2023-10-09T06:55:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.009+0000 7febbb9ff700 1 -- 172.21.15.71:0/1775370387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febb40ac6a0 msgr2=0x7febb40b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.009+0000 7febbb9ff700 1 --2- 172.21.15.71:0/1775370387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febb40ac6a0 0x7febb40b0300 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7febac009f20 tx=0x7febac009840 comp rx=0 tx=0).stop 2023-10-09T06:55:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.009+0000 7febbb9ff700 1 -- 172.21.15.71:0/1775370387 shutdown_connections 2023-10-09T06:55:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.009+0000 7febbb9ff700 1 --2- 172.21.15.71:0/1775370387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febb40ac6a0 0x7febb40b0300 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.009+0000 7febbb9ff700 1 --2- 172.21.15.71:0/1775370387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febb4155c10 0x7febb4155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.009+0000 7febbb9ff700 1 -- 172.21.15.71:0/1775370387 >> 172.21.15.71:0/1775370387 conn(0x7febb406a320 msgr2=0x7febb40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.009+0000 7febbb9ff700 1 -- 172.21.15.71:0/1775370387 shutdown_connections 2023-10-09T06:55:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.009+0000 7febbb9ff700 1 -- 172.21.15.71:0/1775370387 wait complete. 2023-10-09T06:55:11.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.010+0000 7febbb9ff700 1 Processor -- start 2023-10-09T06:55:11.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.010+0000 7febbb9ff700 1 -- start start 2023-10-09T06:55:11.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.011+0000 7febbb9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febb40ac230 0x7febb4157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:11.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.011+0000 7febbb9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febb40ac6a0 0x7febb406eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:11.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.011+0000 7febbb9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febb4155c10 0x7febb40a9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:11.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.011+0000 7febbb9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb406e5d0 con 0x7febb40ac230 2023-10-09T06:55:11.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.011+0000 7febbb9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb406d9c0 con 0x7febb40ac6a0 2023-10-09T06:55:11.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.011+0000 7febbb9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb406dca0 con 0x7febb4155c10 2023-10-09T06:55:11.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.011+0000 7febb979b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febb40ac230 0x7febb4157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.012+0000 7febb979b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febb40ac230 0x7febb4157e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39404/0 (socket says 172.21.15.71:39404) 2023-10-09T06:55:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.012+0000 7febb979b700 1 -- 172.21.15.71:0/1612811546 learned_addr learned my addr 172.21.15.71:0/1612811546 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.012+0000 7febb8f9a700 1 --2- 172.21.15.71:0/1612811546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febb40ac6a0 0x7febb406eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.012+0000 7febb979b700 1 -- 172.21.15.71:0/1612811546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febb4155c10 msgr2=0x7febb40a9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.012+0000 7febb9f9c700 1 --2- 172.21.15.71:0/1612811546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febb4155c10 0x7febb40a9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.012+0000 7febb979b700 1 --2- 172.21.15.71:0/1612811546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febb4155c10 0x7febb40a9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.012+0000 7febb979b700 1 -- 172.21.15.71:0/1612811546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febb40ac6a0 msgr2=0x7febb406eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.012+0000 7febb979b700 1 --2- 172.21.15.71:0/1612811546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febb40ac6a0 0x7febb406eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.012+0000 7febb979b700 1 -- 172.21.15.71:0/1612811546 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac009ae0 con 0x7febb40ac230 2023-10-09T06:55:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.012+0000 7febb8f9a700 1 --2- 172.21.15.71:0/1612811546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febb40ac6a0 0x7febb406eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:55:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.012+0000 7febb9f9c700 1 --2- 172.21.15.71:0/1612811546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febb4155c10 0x7febb40a9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:55:11.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.012+0000 7febb979b700 1 --2- 172.21.15.71:0/1612811546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febb40ac230 0x7febb4157e80 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7febb000d860 tx=0x7febb0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:11.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.012+0000 7feba97fa700 1 -- 172.21.15.71:0/1612811546 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb0009610 con 0x7febb40ac230 2023-10-09T06:55:11.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.012+0000 7feba97fa700 1 -- 172.21.15.71:0/1612811546 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb0009770 con 0x7febb40ac230 2023-10-09T06:55:11.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.012+0000 7feba97fa700 1 -- 172.21.15.71:0/1612811546 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb0009b30 con 0x7febb40ac230 2023-10-09T06:55:11.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.013+0000 7febbb9ff700 1 -- 172.21.15.71:0/1612811546 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb406df80 con 0x7febb40ac230 2023-10-09T06:55:11.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.013+0000 7febbb9ff700 1 -- 172.21.15.71:0/1612811546 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb406f080 con 0x7febb40ac230 2023-10-09T06:55:11.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.014+0000 7febbb9ff700 1 -- 172.21.15.71:0/1612811546 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febb404c3c0 con 0x7febb40ac230 2023-10-09T06:55:11.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.015+0000 7feba97fa700 1 -- 172.21.15.71:0/1612811546 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7febb001e460 con 0x7febb40ac230 2023-10-09T06:55:11.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.015+0000 7feba97fa700 1 --2- 172.21.15.71:0/1612811546 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7feb98066f30 0x7feb980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:11.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.015+0000 7feba97fa700 1 -- 172.21.15.71:0/1612811546 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7febb0084ca0 con 0x7febb40ac230 2023-10-09T06:55:11.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.016+0000 7febb8f9a700 1 --2- 172.21.15.71:0/1612811546 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7feb98066f30 0x7feb980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:11.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.017+0000 7febb8f9a700 1 --2- 172.21.15.71:0/1612811546 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7feb98066f30 0x7feb980693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7febb416cd10 tx=0x7feba4009040 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:11.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.019+0000 7feba97fa700 1 -- 172.21.15.71:0/1612811546 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febb0051d00 con 0x7febb40ac230 2023-10-09T06:55:11.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.207+0000 7febbb9ff700 1 -- 172.21.15.71:0/1612811546 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7febb406e710 con 0x7feb98066f30 2023-10-09T06:55:11.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.218+0000 7feba97fa700 1 -- 172.21.15.71:0/1612811546 <== mgr.5015 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283721 (secure 0 0 0) 0x7feba40014f0 con 0x7feb98066f30 2023-10-09T06:55:11.223 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:55:11.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.222+0000 7febbb9ff700 1 -- 172.21.15.71:0/1612811546 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7feb98066f30 msgr2=0x7feb980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:11.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.222+0000 7febbb9ff700 1 --2- 172.21.15.71:0/1612811546 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7feb98066f30 0x7feb980693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7febb416cd10 tx=0x7feba4009040 comp rx=0 tx=0).stop 2023-10-09T06:55:11.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.222+0000 7febbb9ff700 1 -- 172.21.15.71:0/1612811546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febb40ac230 msgr2=0x7febb4157e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:11.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.222+0000 7febbb9ff700 1 --2- 172.21.15.71:0/1612811546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febb40ac230 0x7febb4157e80 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7febb000d860 tx=0x7febb0008040 comp rx=0 tx=0).stop 2023-10-09T06:55:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.222+0000 7febbb9ff700 1 -- 172.21.15.71:0/1612811546 shutdown_connections 2023-10-09T06:55:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.222+0000 7febbb9ff700 1 --2- 172.21.15.71:0/1612811546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febb4155c10 0x7febb40a9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.222+0000 7febbb9ff700 1 --2- 172.21.15.71:0/1612811546 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7feb98066f30 0x7feb980693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.222+0000 7febbb9ff700 1 --2- 172.21.15.71:0/1612811546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febb40ac230 0x7febb4157e80 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.222+0000 7febbb9ff700 1 --2- 172.21.15.71:0/1612811546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febb40ac6a0 0x7febb406eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.222+0000 7febbb9ff700 1 -- 172.21.15.71:0/1612811546 >> 172.21.15.71:0/1612811546 conn(0x7febb406a320 msgr2=0x7febb4153790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.222+0000 7febbb9ff700 1 -- 172.21.15.71:0/1612811546 shutdown_connections 2023-10-09T06:55:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.223+0000 7febbb9ff700 1 -- 172.21.15.71:0/1612811546 wait complete. 2023-10-09T06:55:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:55:11.241 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-09T06:55:09.872868+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592604,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":236,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":124,"acting":124,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":2417888,"kb_used_data":6816,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752556832,"statfs":{"total":773094113280,"available":770618195968,"internally_reserved":0,"allocated":6979584,"data_stored":3872325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2236,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.963748"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953251+0000","last_change":"2023-10-09T06:55:06.941941+0000","last_active":"2023-10-09T06:55:06.953251+0000","last_peered":"2023-10-09T06:55:06.953251+0000","last_clean":"2023-10-09T06:55:06.953251+0000","last_became_active":"2023-10-09T06:55:06.941652+0000","last_became_peered":"2023-10-09T06:55:06.941652+0000","last_unstale":"2023-10-09T06:55:06.953251+0000","last_undegraded":"2023-10-09T06:55:06.953251+0000","last_fullsized":"2023-10-09T06:55:06.953251+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:13.874146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.957583+0000","last_change":"2023-10-09T06:55:06.953644+0000","last_active":"2023-10-09T06:55:06.957583+0000","last_peered":"2023-10-09T06:55:06.957583+0000","last_clean":"2023-10-09T06:55:06.957583+0000","last_became_active":"2023-10-09T06:55:06.953144+0000","last_became_peered":"2023-10-09T06:55:06.953144+0000","last_unstale":"2023-10-09T06:55:06.957583+0000","last_undegraded":"2023-10-09T06:55:06.957583+0000","last_fullsized":"2023-10-09T06:55:06.957583+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:04.806773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.941216+0000","last_change":"2023-10-09T06:55:06.932908+0000","last_active":"2023-10-09T06:55:06.941216+0000","last_peered":"2023-10-09T06:55:06.941216+0000","last_clean":"2023-10-09T06:55:06.941216+0000","last_became_active":"2023-10-09T06:55:06.932692+0000","last_became_peered":"2023-10-09T06:55:06.932692+0000","last_unstale":"2023-10-09T06:55:06.941216+0000","last_undegraded":"2023-10-09T06:55:06.941216+0000","last_fullsized":"2023-10-09T06:55:06.941216+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:56:01.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.949558+0000","last_change":"2023-10-09T06:55:06.939597+0000","last_active":"2023-10-09T06:55:06.949558+0000","last_peered":"2023-10-09T06:55:06.949558+0000","last_clean":"2023-10-09T06:55:06.949558+0000","last_became_active":"2023-10-09T06:55:06.939344+0000","last_became_peered":"2023-10-09T06:55:06.939344+0000","last_unstale":"2023-10-09T06:55:06.949558+0000","last_undegraded":"2023-10-09T06:55:06.949558+0000","last_fullsized":"2023-10-09T06:55:06.949558+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:27.488161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953884+0000","last_change":"2023-10-09T06:55:06.952049+0000","last_active":"2023-10-09T06:55:06.953884+0000","last_peered":"2023-10-09T06:55:06.953884+0000","last_clean":"2023-10-09T06:55:06.953884+0000","last_became_active":"2023-10-09T06:55:06.951794+0000","last_became_peered":"2023-10-09T06:55:06.951794+0000","last_unstale":"2023-10-09T06:55:06.953884+0000","last_undegraded":"2023-10-09T06:55:06.953884+0000","last_fullsized":"2023-10-09T06:55:06.953884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:58:23.011522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.947762+0000","last_change":"2023-10-09T06:55:06.942297+0000","last_active":"2023-10-09T06:55:06.947762+0000","last_peered":"2023-10-09T06:55:06.947762+0000","last_clean":"2023-10-09T06:55:06.947762+0000","last_became_active":"2023-10-09T06:55:06.941997+0000","last_became_peered":"2023-10-09T06:55:06.941997+0000","last_unstale":"2023-10-09T06:55:06.947762+0000","last_undegraded":"2023-10-09T06:55:06.947762+0000","last_fullsized":"2023-10-09T06:55:06.947762+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:27.365626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.957594+0000","last_change":"2023-10-09T06:55:06.954659+0000","last_active":"2023-10-09T06:55:06.957594+0000","last_peered":"2023-10-09T06:55:06.957594+0000","last_clean":"2023-10-09T06:55:06.957594+0000","last_became_active":"2023-10-09T06:55:06.954424+0000","last_became_peered":"2023-10-09T06:55:06.954424+0000","last_unstale":"2023-10-09T06:55:06.957594+0000","last_undegraded":"2023-10-09T06:55:06.957594+0000","last_fullsized":"2023-10-09T06:55:06.957594+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:26:52.867345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.943599+0000","last_change":"2023-10-09T06:55:06.941384+0000","last_active":"2023-10-09T06:55:06.943599+0000","last_peered":"2023-10-09T06:55:06.943599+0000","last_clean":"2023-10-09T06:55:06.943599+0000","last_became_active":"2023-10-09T06:55:06.935944+0000","last_became_peered":"2023-10-09T06:55:06.935944+0000","last_unstale":"2023-10-09T06:55:06.943599+0000","last_undegraded":"2023-10-09T06:55:06.943599+0000","last_fullsized":"2023-10-09T06:55:06.943599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:48:10.713903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.934730+0000","last_change":"2023-10-09T06:55:06.929812+0000","last_active":"2023-10-09T06:55:06.934730+0000","last_peered":"2023-10-09T06:55:06.934730+0000","last_clean":"2023-10-09T06:55:06.934730+0000","last_became_active":"2023-10-09T06:55:06.929471+0000","last_became_peered":"2023-10-09T06:55:06.929471+0000","last_unstale":"2023-10-09T06:55:06.934730+0000","last_undegraded":"2023-10-09T06:55:06.934730+0000","last_fullsized":"2023-10-09T06:55:06.934730+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:44.668078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.943753+0000","last_change":"2023-10-09T06:55:06.940701+0000","last_active":"2023-10-09T06:55:06.943753+0000","last_peered":"2023-10-09T06:55:06.943753+0000","last_clean":"2023-10-09T06:55:06.943753+0000","last_became_active":"2023-10-09T06:55:06.935669+0000","last_became_peered":"2023-10-09T06:55:06.935669+0000","last_unstale":"2023-10-09T06:55:06.943753+0000","last_undegraded":"2023-10-09T06:55:06.943753+0000","last_fullsized":"2023-10-09T06:55:06.943753+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:27.310704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948019+0000","last_change":"2023-10-09T06:55:06.941609+0000","last_active":"2023-10-09T06:55:06.948019+0000","last_peered":"2023-10-09T06:55:06.948019+0000","last_clean":"2023-10-09T06:55:06.948019+0000","last_became_active":"2023-10-09T06:55:06.941358+0000","last_became_peered":"2023-10-09T06:55:06.941358+0000","last_unstale":"2023-10-09T06:55:06.948019+0000","last_undegraded":"2023-10-09T06:55:06.948019+0000","last_fullsized":"2023-10-09T06:55:06.948019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:44.434314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.946692+0000","last_change":"2023-10-09T06:55:06.945053+0000","last_active":"2023-10-09T06:55:06.946692+0000","last_peered":"2023-10-09T06:55:06.946692+0000","last_clean":"2023-10-09T06:55:06.946692+0000","last_became_active":"2023-10-09T06:55:06.944789+0000","last_became_peered":"2023-10-09T06:55:06.944789+0000","last_unstale":"2023-10-09T06:55:06.946692+0000","last_undegraded":"2023-10-09T06:55:06.946692+0000","last_fullsized":"2023-10-09T06:55:06.946692+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:08.244758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948157+0000","last_change":"2023-10-09T06:55:06.945836+0000","last_active":"2023-10-09T06:55:06.948157+0000","last_peered":"2023-10-09T06:55:06.948157+0000","last_clean":"2023-10-09T06:55:06.948157+0000","last_became_active":"2023-10-09T06:55:06.945564+0000","last_became_peered":"2023-10-09T06:55:06.945564+0000","last_unstale":"2023-10-09T06:55:06.948157+0000","last_undegraded":"2023-10-09T06:55:06.948157+0000","last_fullsized":"2023-10-09T06:55:06.948157+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:40.055223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955508+0000","last_change":"2023-10-09T06:55:06.953311+0000","last_active":"2023-10-09T06:55:06.955508+0000","last_peered":"2023-10-09T06:55:06.955508+0000","last_clean":"2023-10-09T06:55:06.955508+0000","last_became_active":"2023-10-09T06:55:06.952959+0000","last_became_peered":"2023-10-09T06:55:06.952959+0000","last_unstale":"2023-10-09T06:55:06.955508+0000","last_undegraded":"2023-10-09T06:55:06.955508+0000","last_fullsized":"2023-10-09T06:55:06.955508+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:12:43.264714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.942812+0000","last_change":"2023-10-09T06:55:06.939960+0000","last_active":"2023-10-09T06:55:06.942812+0000","last_peered":"2023-10-09T06:55:06.942812+0000","last_clean":"2023-10-09T06:55:06.942812+0000","last_became_active":"2023-10-09T06:55:06.939690+0000","last_became_peered":"2023-10-09T06:55:06.939690+0000","last_unstale":"2023-10-09T06:55:06.942812+0000","last_undegraded":"2023-10-09T06:55:06.942812+0000","last_fullsized":"2023-10-09T06:55:06.942812+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:07:47.321921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948071+0000","last_change":"2023-10-09T06:55:06.943815+0000","last_active":"2023-10-09T06:55:06.948071+0000","last_peered":"2023-10-09T06:55:06.948071+0000","last_clean":"2023-10-09T06:55:06.948071+0000","last_became_active":"2023-10-09T06:55:06.943558+0000","last_became_peered":"2023-10-09T06:55:06.943558+0000","last_unstale":"2023-10-09T06:55:06.948071+0000","last_undegraded":"2023-10-09T06:55:06.948071+0000","last_fullsized":"2023-10-09T06:55:06.948071+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:24:19.345593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.934846+0000","last_change":"2023-10-09T06:55:06.928130+0000","last_active":"2023-10-09T06:55:06.934846+0000","last_peered":"2023-10-09T06:55:06.934846+0000","last_clean":"2023-10-09T06:55:06.934846+0000","last_became_active":"2023-10-09T06:55:06.927851+0000","last_became_peered":"2023-10-09T06:55:06.927851+0000","last_unstale":"2023-10-09T06:55:06.934846+0000","last_undegraded":"2023-10-09T06:55:06.934846+0000","last_fullsized":"2023-10-09T06:55:06.934846+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:18.653877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954325+0000","last_change":"2023-10-09T06:55:06.952189+0000","last_active":"2023-10-09T06:55:06.954325+0000","last_peered":"2023-10-09T06:55:06.954325+0000","last_clean":"2023-10-09T06:55:06.954325+0000","last_became_active":"2023-10-09T06:55:06.951940+0000","last_became_peered":"2023-10-09T06:55:06.951940+0000","last_unstale":"2023-10-09T06:55:06.954325+0000","last_undegraded":"2023-10-09T06:55:06.954325+0000","last_fullsized":"2023-10-09T06:55:06.954325+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:22.559262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"61'4","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955223+0000","last_change":"2023-10-09T06:55:05.933796+0000","last_active":"2023-10-09T06:55:06.955223+0000","last_peered":"2023-10-09T06:55:06.955223+0000","last_clean":"2023-10-09T06:55:06.955223+0000","last_became_active":"2023-10-09T06:55:05.933559+0000","last_became_peered":"2023-10-09T06:55:05.933559+0000","last_unstale":"2023-10-09T06:55:06.955223+0000","last_undegraded":"2023-10-09T06:55:06.955223+0000","last_fullsized":"2023-10-09T06:55:06.955223+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:09.365369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:04.900841+0000","last_change":"2023-10-09T06:55:04.900841+0000","last_active":"2023-10-09T06:55:04.900841+0000","last_peered":"2023-10-09T06:55:04.900841+0000","last_clean":"2023-10-09T06:55:04.900841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:04.900841+0000","last_undegraded":"2023-10-09T06:55:04.900841+0000","last_fullsized":"2023-10-09T06:55:04.900841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.952611+0000","last_change":"2023-10-09T06:55:05.936463+0000","last_active":"2023-10-09T06:55:06.952611+0000","last_peered":"2023-10-09T06:55:06.952611+0000","last_clean":"2023-10-09T06:55:06.952611+0000","last_became_active":"2023-10-09T06:55:05.936166+0000","last_became_peered":"2023-10-09T06:55:05.936166+0000","last_unstale":"2023-10-09T06:55:06.952611+0000","last_undegraded":"2023-10-09T06:55:06.952611+0000","last_fullsized":"2023-10-09T06:55:06.952611+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:30.427585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.945118+0000","last_change":"2023-10-09T06:55:06.944529+0000","last_active":"2023-10-09T06:55:06.945118+0000","last_peered":"2023-10-09T06:55:06.945118+0000","last_clean":"2023-10-09T06:55:06.945118+0000","last_became_active":"2023-10-09T06:55:06.944264+0000","last_became_peered":"2023-10-09T06:55:06.944264+0000","last_unstale":"2023-10-09T06:55:06.945118+0000","last_undegraded":"2023-10-09T06:55:06.945118+0000","last_fullsized":"2023-10-09T06:55:06.945118+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:47.548592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955066+0000","last_change":"2023-10-09T06:55:05.935262+0000","last_active":"2023-10-09T06:55:06.955066+0000","last_peered":"2023-10-09T06:55:06.955066+0000","last_clean":"2023-10-09T06:55:06.955066+0000","last_became_active":"2023-10-09T06:55:05.934932+0000","last_became_peered":"2023-10-09T06:55:05.934932+0000","last_unstale":"2023-10-09T06:55:06.955066+0000","last_undegraded":"2023-10-09T06:55:06.955066+0000","last_fullsized":"2023-10-09T06:55:06.955066+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:02:48.884634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953637+0000","last_change":"2023-10-09T06:55:05.931537+0000","last_active":"2023-10-09T06:55:06.953637+0000","last_peered":"2023-10-09T06:55:06.953637+0000","last_clean":"2023-10-09T06:55:06.953637+0000","last_became_active":"2023-10-09T06:55:05.931300+0000","last_became_peered":"2023-10-09T06:55:05.931300+0000","last_unstale":"2023-10-09T06:55:06.953637+0000","last_undegraded":"2023-10-09T06:55:06.953637+0000","last_fullsized":"2023-10-09T06:55:06.953637+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:07.028150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.944440+0000","last_change":"2023-10-09T06:55:06.938409+0000","last_active":"2023-10-09T06:55:06.944440+0000","last_peered":"2023-10-09T06:55:06.944440+0000","last_clean":"2023-10-09T06:55:06.944440+0000","last_became_active":"2023-10-09T06:55:06.938160+0000","last_became_peered":"2023-10-09T06:55:06.938160+0000","last_unstale":"2023-10-09T06:55:06.944440+0000","last_undegraded":"2023-10-09T06:55:06.944440+0000","last_fullsized":"2023-10-09T06:55:06.944440+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:29:45.885127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:04.900841+0000","last_change":"2023-10-09T06:55:04.900841+0000","last_active":"2023-10-09T06:55:04.900841+0000","last_peered":"2023-10-09T06:55:04.900841+0000","last_clean":"2023-10-09T06:55:04.900841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:04.900841+0000","last_undegraded":"2023-10-09T06:55:04.900841+0000","last_fullsized":"2023-10-09T06:55:04.900841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955407+0000","last_change":"2023-10-09T06:55:06.952666+0000","last_active":"2023-10-09T06:55:06.955407+0000","last_peered":"2023-10-09T06:55:06.955407+0000","last_clean":"2023-10-09T06:55:06.955407+0000","last_became_active":"2023-10-09T06:55:06.952418+0000","last_became_peered":"2023-10-09T06:55:06.952418+0000","last_unstale":"2023-10-09T06:55:06.955407+0000","last_undegraded":"2023-10-09T06:55:06.955407+0000","last_fullsized":"2023-10-09T06:55:06.955407+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:43:07.311728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:04.900841+0000","last_change":"2023-10-09T06:55:04.900841+0000","last_active":"2023-10-09T06:55:04.900841+0000","last_peered":"2023-10-09T06:55:04.900841+0000","last_clean":"2023-10-09T06:55:04.900841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:04.900841+0000","last_undegraded":"2023-10-09T06:55:04.900841+0000","last_fullsized":"2023-10-09T06:55:04.900841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.923500+0000","last_change":"2023-10-09T06:55:05.932660+0000","last_active":"2023-10-09T06:55:06.923500+0000","last_peered":"2023-10-09T06:55:06.923500+0000","last_clean":"2023-10-09T06:55:06.923500+0000","last_became_active":"2023-10-09T06:55:05.932396+0000","last_became_peered":"2023-10-09T06:55:05.932396+0000","last_unstale":"2023-10-09T06:55:06.923500+0000","last_undegraded":"2023-10-09T06:55:06.923500+0000","last_fullsized":"2023-10-09T06:55:06.923500+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:46.541894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:04.900841+0000","last_change":"2023-10-09T06:55:04.900841+0000","last_active":"2023-10-09T06:55:04.900841+0000","last_peered":"2023-10-09T06:55:04.900841+0000","last_clean":"2023-10-09T06:55:04.900841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:04.900841+0000","last_undegraded":"2023-10-09T06:55:04.900841+0000","last_fullsized":"2023-10-09T06:55:04.900841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953271+0000","last_change":"2023-10-09T06:55:06.948696+0000","last_active":"2023-10-09T06:55:06.953271+0000","last_peered":"2023-10-09T06:55:06.953271+0000","last_clean":"2023-10-09T06:55:06.953271+0000","last_became_active":"2023-10-09T06:55:06.948292+0000","last_became_peered":"2023-10-09T06:55:06.948292+0000","last_unstale":"2023-10-09T06:55:06.953271+0000","last_undegraded":"2023-10-09T06:55:06.953271+0000","last_fullsized":"2023-10-09T06:55:06.953271+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:27.342291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.933075+0000","last_change":"2023-10-09T06:55:05.932297+0000","last_active":"2023-10-09T06:55:06.933075+0000","last_peered":"2023-10-09T06:55:06.933075+0000","last_clean":"2023-10-09T06:55:06.933075+0000","last_became_active":"2023-10-09T06:55:05.931969+0000","last_became_peered":"2023-10-09T06:55:05.931969+0000","last_unstale":"2023-10-09T06:55:06.933075+0000","last_undegraded":"2023-10-09T06:55:06.933075+0000","last_fullsized":"2023-10-09T06:55:06.933075+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:04:29.076275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.932452+0000","last_change":"2023-10-09T06:55:06.928878+0000","last_active":"2023-10-09T06:55:06.932452+0000","last_peered":"2023-10-09T06:55:06.932452+0000","last_clean":"2023-10-09T06:55:06.932452+0000","last_became_active":"2023-10-09T06:55:06.928633+0000","last_became_peered":"2023-10-09T06:55:06.928633+0000","last_unstale":"2023-10-09T06:55:06.932452+0000","last_undegraded":"2023-10-09T06:55:06.932452+0000","last_fullsized":"2023-10-09T06:55:06.932452+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:48:10.713903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"61'3","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.956479+0000","last_change":"2023-10-09T06:55:05.938582+0000","last_active":"2023-10-09T06:55:06.956479+0000","last_peered":"2023-10-09T06:55:06.956479+0000","last_clean":"2023-10-09T06:55:06.956479+0000","last_became_active":"2023-10-09T06:55:05.938239+0000","last_became_peered":"2023-10-09T06:55:05.938239+0000","last_unstale":"2023-10-09T06:55:06.956479+0000","last_undegraded":"2023-10-09T06:55:06.956479+0000","last_fullsized":"2023-10-09T06:55:06.956479+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:21.552564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953095+0000","last_change":"2023-10-09T06:55:06.942075+0000","last_active":"2023-10-09T06:55:06.953095+0000","last_peered":"2023-10-09T06:55:06.953095+0000","last_clean":"2023-10-09T06:55:06.953095+0000","last_became_active":"2023-10-09T06:55:06.941725+0000","last_became_peered":"2023-10-09T06:55:06.941725+0000","last_unstale":"2023-10-09T06:55:06.953095+0000","last_undegraded":"2023-10-09T06:55:06.953095+0000","last_fullsized":"2023-10-09T06:55:06.953095+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:50:27.836402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"61'6","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.958234+0000","last_change":"2023-10-09T06:55:05.931955+0000","last_active":"2023-10-09T06:55:06.958234+0000","last_peered":"2023-10-09T06:55:06.958234+0000","last_clean":"2023-10-09T06:55:06.958234+0000","last_became_active":"2023-10-09T06:55:05.931712+0000","last_became_peered":"2023-10-09T06:55:05.931712+0000","last_unstale":"2023-10-09T06:55:06.958234+0000","last_undegraded":"2023-10-09T06:55:06.958234+0000","last_fullsized":"2023-10-09T06:55:06.958234+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:17.429884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.949612+0000","last_change":"2023-10-09T06:55:05.941482+0000","last_active":"2023-10-09T06:55:06.949612+0000","last_peered":"2023-10-09T06:55:06.949612+0000","last_clean":"2023-10-09T06:55:06.949612+0000","last_became_active":"2023-10-09T06:55:05.941132+0000","last_became_peered":"2023-10-09T06:55:05.941132+0000","last_unstale":"2023-10-09T06:55:06.949612+0000","last_undegraded":"2023-10-09T06:55:06.949612+0000","last_fullsized":"2023-10-09T06:55:06.949612+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:47.392667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.944422+0000","last_change":"2023-10-09T06:55:06.934503+0000","last_active":"2023-10-09T06:55:06.944422+0000","last_peered":"2023-10-09T06:55:06.944422+0000","last_clean":"2023-10-09T06:55:06.944422+0000","last_became_active":"2023-10-09T06:55:06.934249+0000","last_became_peered":"2023-10-09T06:55:06.934249+0000","last_unstale":"2023-10-09T06:55:06.944422+0000","last_undegraded":"2023-10-09T06:55:06.944422+0000","last_fullsized":"2023-10-09T06:55:06.944422+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:04.244093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.929902+0000","last_change":"2023-10-09T06:55:05.931993+0000","last_active":"2023-10-09T06:55:06.929902+0000","last_peered":"2023-10-09T06:55:06.929902+0000","last_clean":"2023-10-09T06:55:06.929902+0000","last_became_active":"2023-10-09T06:55:05.931747+0000","last_became_peered":"2023-10-09T06:55:05.931747+0000","last_unstale":"2023-10-09T06:55:06.929902+0000","last_undegraded":"2023-10-09T06:55:06.929902+0000","last_fullsized":"2023-10-09T06:55:06.929902+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:49:48.304060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.928958+0000","last_change":"2023-10-09T06:55:06.926676+0000","last_active":"2023-10-09T06:55:06.928958+0000","last_peered":"2023-10-09T06:55:06.928958+0000","last_clean":"2023-10-09T06:55:06.928958+0000","last_became_active":"2023-10-09T06:55:06.926433+0000","last_became_peered":"2023-10-09T06:55:06.926433+0000","last_unstale":"2023-10-09T06:55:06.928958+0000","last_undegraded":"2023-10-09T06:55:06.928958+0000","last_fullsized":"2023-10-09T06:55:06.928958+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:26:52.867345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.923136+0000","last_change":"2023-10-09T06:55:05.935304+0000","last_active":"2023-10-09T06:55:06.923136+0000","last_peered":"2023-10-09T06:55:06.923136+0000","last_clean":"2023-10-09T06:55:06.923136+0000","last_became_active":"2023-10-09T06:55:05.935055+0000","last_became_peered":"2023-10-09T06:55:05.935055+0000","last_unstale":"2023-10-09T06:55:06.923136+0000","last_undegraded":"2023-10-09T06:55:06.923136+0000","last_fullsized":"2023-10-09T06:55:06.923136+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:16:25.613767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954291+0000","last_change":"2023-10-09T06:55:06.953060+0000","last_active":"2023-10-09T06:55:06.954291+0000","last_peered":"2023-10-09T06:55:06.954291+0000","last_clean":"2023-10-09T06:55:06.954291+0000","last_became_active":"2023-10-09T06:55:06.952769+0000","last_became_peered":"2023-10-09T06:55:06.952769+0000","last_unstale":"2023-10-09T06:55:06.954291+0000","last_undegraded":"2023-10-09T06:55:06.954291+0000","last_fullsized":"2023-10-09T06:55:06.954291+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:12:43.264714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"61'8","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955749+0000","last_change":"2023-10-09T06:55:05.939559+0000","last_active":"2023-10-09T06:55:06.955749+0000","last_peered":"2023-10-09T06:55:06.955749+0000","last_clean":"2023-10-09T06:55:06.955749+0000","last_became_active":"2023-10-09T06:55:05.939250+0000","last_became_peered":"2023-10-09T06:55:05.939250+0000","last_unstale":"2023-10-09T06:55:06.955749+0000","last_undegraded":"2023-10-09T06:55:06.955749+0000","last_fullsized":"2023-10-09T06:55:06.955749+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:57.104240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.943570+0000","last_change":"2023-10-09T06:55:06.940395+0000","last_active":"2023-10-09T06:55:06.943570+0000","last_peered":"2023-10-09T06:55:06.943570+0000","last_clean":"2023-10-09T06:55:06.943570+0000","last_became_active":"2023-10-09T06:55:06.940110+0000","last_became_peered":"2023-10-09T06:55:06.940110+0000","last_unstale":"2023-10-09T06:55:06.943570+0000","last_undegraded":"2023-10-09T06:55:06.943570+0000","last_fullsized":"2023-10-09T06:55:06.943570+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:11.042189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.947490+0000","last_change":"2023-10-09T06:55:05.932965+0000","last_active":"2023-10-09T06:55:06.947490+0000","last_peered":"2023-10-09T06:55:06.947490+0000","last_clean":"2023-10-09T06:55:06.947490+0000","last_became_active":"2023-10-09T06:55:05.932676+0000","last_became_peered":"2023-10-09T06:55:05.932676+0000","last_unstale":"2023-10-09T06:55:06.947490+0000","last_undegraded":"2023-10-09T06:55:06.947490+0000","last_fullsized":"2023-10-09T06:55:06.947490+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:03:56.177535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948676+0000","last_change":"2023-10-09T06:55:06.944157+0000","last_active":"2023-10-09T06:55:06.948676+0000","last_peered":"2023-10-09T06:55:06.948676+0000","last_clean":"2023-10-09T06:55:06.948676+0000","last_became_active":"2023-10-09T06:55:06.943866+0000","last_became_peered":"2023-10-09T06:55:06.943866+0000","last_unstale":"2023-10-09T06:55:06.948676+0000","last_undegraded":"2023-10-09T06:55:06.948676+0000","last_fullsized":"2023-10-09T06:55:06.948676+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:12.040675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:04.900841+0000","last_change":"2023-10-09T06:55:04.900841+0000","last_active":"2023-10-09T06:55:04.900841+0000","last_peered":"2023-10-09T06:55:04.900841+0000","last_clean":"2023-10-09T06:55:04.900841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:04.900841+0000","last_undegraded":"2023-10-09T06:55:04.900841+0000","last_fullsized":"2023-10-09T06:55:04.900841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:04.900841+0000","last_change":"2023-10-09T06:55:04.900841+0000","last_active":"2023-10-09T06:55:04.900841+0000","last_peered":"2023-10-09T06:55:04.900841+0000","last_clean":"2023-10-09T06:55:04.900841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:04.900841+0000","last_undegraded":"2023-10-09T06:55:04.900841+0000","last_fullsized":"2023-10-09T06:55:04.900841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.925347+0000","last_change":"2023-10-09T06:55:05.933315+0000","last_active":"2023-10-09T06:55:06.925347+0000","last_peered":"2023-10-09T06:55:06.925347+0000","last_clean":"2023-10-09T06:55:06.925347+0000","last_became_active":"2023-10-09T06:55:05.933044+0000","last_became_peered":"2023-10-09T06:55:05.933044+0000","last_unstale":"2023-10-09T06:55:06.925347+0000","last_undegraded":"2023-10-09T06:55:06.925347+0000","last_fullsized":"2023-10-09T06:55:06.925347+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:51.403402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.941236+0000","last_change":"2023-10-09T06:55:06.935138+0000","last_active":"2023-10-09T06:55:06.941236+0000","last_peered":"2023-10-09T06:55:06.941236+0000","last_clean":"2023-10-09T06:55:06.941236+0000","last_became_active":"2023-10-09T06:55:06.934886+0000","last_became_peered":"2023-10-09T06:55:06.934886+0000","last_unstale":"2023-10-09T06:55:06.941236+0000","last_undegraded":"2023-10-09T06:55:06.941236+0000","last_fullsized":"2023-10-09T06:55:06.941236+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:28.982187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953731+0000","last_change":"2023-10-09T06:55:05.930744+0000","last_active":"2023-10-09T06:55:06.953731+0000","last_peered":"2023-10-09T06:55:06.953731+0000","last_clean":"2023-10-09T06:55:06.953731+0000","last_became_active":"2023-10-09T06:55:05.930460+0000","last_became_peered":"2023-10-09T06:55:05.930460+0000","last_unstale":"2023-10-09T06:55:06.953731+0000","last_undegraded":"2023-10-09T06:55:06.953731+0000","last_fullsized":"2023-10-09T06:55:06.953731+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:18:05.242002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954278+0000","last_change":"2023-10-09T06:55:06.951304+0000","last_active":"2023-10-09T06:55:06.954278+0000","last_peered":"2023-10-09T06:55:06.954278+0000","last_clean":"2023-10-09T06:55:06.954278+0000","last_became_active":"2023-10-09T06:55:06.950931+0000","last_became_peered":"2023-10-09T06:55:06.950931+0000","last_unstale":"2023-10-09T06:55:06.954278+0000","last_undegraded":"2023-10-09T06:55:06.954278+0000","last_fullsized":"2023-10-09T06:55:06.954278+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:17.846967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:04.900841+0000","last_change":"2023-10-09T06:55:04.900841+0000","last_active":"2023-10-09T06:55:04.900841+0000","last_peered":"2023-10-09T06:55:04.900841+0000","last_clean":"2023-10-09T06:55:04.900841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:04.900841+0000","last_undegraded":"2023-10-09T06:55:04.900841+0000","last_fullsized":"2023-10-09T06:55:04.900841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.936298+0000","last_change":"2023-10-09T06:55:06.933965+0000","last_active":"2023-10-09T06:55:06.936298+0000","last_peered":"2023-10-09T06:55:06.936298+0000","last_clean":"2023-10-09T06:55:06.936298+0000","last_became_active":"2023-10-09T06:55:06.933697+0000","last_became_peered":"2023-10-09T06:55:06.933697+0000","last_unstale":"2023-10-09T06:55:06.936298+0000","last_undegraded":"2023-10-09T06:55:06.936298+0000","last_fullsized":"2023-10-09T06:55:06.936298+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:52.068938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.932376+0000","last_change":"2023-10-09T06:55:05.939438+0000","last_active":"2023-10-09T06:55:06.932376+0000","last_peered":"2023-10-09T06:55:06.932376+0000","last_clean":"2023-10-09T06:55:06.932376+0000","last_became_active":"2023-10-09T06:55:05.939179+0000","last_became_peered":"2023-10-09T06:55:05.939179+0000","last_unstale":"2023-10-09T06:55:06.932376+0000","last_undegraded":"2023-10-09T06:55:06.932376+0000","last_fullsized":"2023-10-09T06:55:06.932376+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:21.552564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.944385+0000","last_change":"2023-10-09T06:55:06.941903+0000","last_active":"2023-10-09T06:55:06.944385+0000","last_peered":"2023-10-09T06:55:06.944385+0000","last_clean":"2023-10-09T06:55:06.944385+0000","last_became_active":"2023-10-09T06:55:06.941654+0000","last_became_peered":"2023-10-09T06:55:06.941654+0000","last_unstale":"2023-10-09T06:55:06.944385+0000","last_undegraded":"2023-10-09T06:55:06.944385+0000","last_fullsized":"2023-10-09T06:55:06.944385+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:36.964322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.929584+0000","last_change":"2023-10-09T06:55:05.937191+0000","last_active":"2023-10-09T06:55:06.929584+0000","last_peered":"2023-10-09T06:55:06.929584+0000","last_clean":"2023-10-09T06:55:06.929584+0000","last_became_active":"2023-10-09T06:55:05.936808+0000","last_became_peered":"2023-10-09T06:55:05.936808+0000","last_unstale":"2023-10-09T06:55:06.929584+0000","last_undegraded":"2023-10-09T06:55:06.929584+0000","last_fullsized":"2023-10-09T06:55:06.929584+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:57.104240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.926093+0000","last_change":"2023-10-09T06:55:05.930677+0000","last_active":"2023-10-09T06:55:06.926093+0000","last_peered":"2023-10-09T06:55:06.926093+0000","last_clean":"2023-10-09T06:55:06.926093+0000","last_became_active":"2023-10-09T06:55:05.930333+0000","last_became_peered":"2023-10-09T06:55:05.930333+0000","last_unstale":"2023-10-09T06:55:06.926093+0000","last_undegraded":"2023-10-09T06:55:06.926093+0000","last_fullsized":"2023-10-09T06:55:06.926093+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:12:42.258017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948591+0000","last_change":"2023-10-09T06:55:06.944396+0000","last_active":"2023-10-09T06:55:06.948591+0000","last_peered":"2023-10-09T06:55:06.948591+0000","last_clean":"2023-10-09T06:55:06.948591+0000","last_became_active":"2023-10-09T06:55:06.944150+0000","last_became_peered":"2023-10-09T06:55:06.944150+0000","last_unstale":"2023-10-09T06:55:06.948591+0000","last_undegraded":"2023-10-09T06:55:06.948591+0000","last_fullsized":"2023-10-09T06:55:06.948591+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:01.783980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.931050+0000","last_change":"2023-10-09T06:55:05.938596+0000","last_active":"2023-10-09T06:55:06.931050+0000","last_peered":"2023-10-09T06:55:06.931050+0000","last_clean":"2023-10-09T06:55:06.931050+0000","last_became_active":"2023-10-09T06:55:05.938360+0000","last_became_peered":"2023-10-09T06:55:05.938360+0000","last_unstale":"2023-10-09T06:55:06.931050+0000","last_undegraded":"2023-10-09T06:55:06.931050+0000","last_fullsized":"2023-10-09T06:55:06.931050+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:48:20.803864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953115+0000","last_change":"2023-10-09T06:55:06.942255+0000","last_active":"2023-10-09T06:55:06.953115+0000","last_peered":"2023-10-09T06:55:06.953115+0000","last_clean":"2023-10-09T06:55:06.953115+0000","last_became_active":"2023-10-09T06:55:06.941345+0000","last_became_peered":"2023-10-09T06:55:06.941345+0000","last_unstale":"2023-10-09T06:55:06.953115+0000","last_undegraded":"2023-10-09T06:55:06.953115+0000","last_fullsized":"2023-10-09T06:55:06.953115+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:16:26.620465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.929937+0000","last_change":"2023-10-09T06:55:05.935598+0000","last_active":"2023-10-09T06:55:06.929937+0000","last_peered":"2023-10-09T06:55:06.929937+0000","last_clean":"2023-10-09T06:55:06.929937+0000","last_became_active":"2023-10-09T06:55:05.935350+0000","last_became_peered":"2023-10-09T06:55:05.935350+0000","last_unstale":"2023-10-09T06:55:06.929937+0000","last_undegraded":"2023-10-09T06:55:06.929937+0000","last_fullsized":"2023-10-09T06:55:06.929937+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:25.646016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.941254+0000","last_change":"2023-10-09T06:55:06.935866+0000","last_active":"2023-10-09T06:55:06.941254+0000","last_peered":"2023-10-09T06:55:06.941254+0000","last_clean":"2023-10-09T06:55:06.941254+0000","last_became_active":"2023-10-09T06:55:06.935633+0000","last_became_peered":"2023-10-09T06:55:06.935633+0000","last_unstale":"2023-10-09T06:55:06.941254+0000","last_undegraded":"2023-10-09T06:55:06.941254+0000","last_fullsized":"2023-10-09T06:55:06.941254+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:29:45.885127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.930431+0000","last_change":"2023-10-09T06:55:05.935761+0000","last_active":"2023-10-09T06:55:06.930431+0000","last_peered":"2023-10-09T06:55:06.930431+0000","last_clean":"2023-10-09T06:55:06.930431+0000","last_became_active":"2023-10-09T06:55:05.935464+0000","last_became_peered":"2023-10-09T06:55:05.935464+0000","last_unstale":"2023-10-09T06:55:06.930431+0000","last_undegraded":"2023-10-09T06:55:06.930431+0000","last_fullsized":"2023-10-09T06:55:06.930431+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:16.840270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.932428+0000","last_change":"2023-10-09T06:55:06.927262+0000","last_active":"2023-10-09T06:55:06.932428+0000","last_peered":"2023-10-09T06:55:06.932428+0000","last_clean":"2023-10-09T06:55:06.932428+0000","last_became_active":"2023-10-09T06:55:06.926992+0000","last_became_peered":"2023-10-09T06:55:06.926992+0000","last_unstale":"2023-10-09T06:55:06.932428+0000","last_undegraded":"2023-10-09T06:55:06.932428+0000","last_fullsized":"2023-10-09T06:55:06.932428+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:12.040675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:04.900841+0000","last_change":"2023-10-09T06:55:04.900841+0000","last_active":"2023-10-09T06:55:04.900841+0000","last_peered":"2023-10-09T06:55:04.900841+0000","last_clean":"2023-10-09T06:55:04.900841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:04.900841+0000","last_undegraded":"2023-10-09T06:55:04.900841+0000","last_fullsized":"2023-10-09T06:55:04.900841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.930275+0000","last_change":"2023-10-09T06:55:05.936971+0000","last_active":"2023-10-09T06:55:06.930275+0000","last_peered":"2023-10-09T06:55:06.930275+0000","last_clean":"2023-10-09T06:55:06.930275+0000","last_became_active":"2023-10-09T06:55:05.936678+0000","last_became_peered":"2023-10-09T06:55:05.936678+0000","last_unstale":"2023-10-09T06:55:06.930275+0000","last_undegraded":"2023-10-09T06:55:06.930275+0000","last_fullsized":"2023-10-09T06:55:06.930275+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:18.853661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.923395+0000","last_change":"2023-10-09T06:55:05.938714+0000","last_active":"2023-10-09T06:55:06.923395+0000","last_peered":"2023-10-09T06:55:06.923395+0000","last_clean":"2023-10-09T06:55:06.923395+0000","last_became_active":"2023-10-09T06:55:05.936627+0000","last_became_peered":"2023-10-09T06:55:05.936627+0000","last_unstale":"2023-10-09T06:55:06.923395+0000","last_undegraded":"2023-10-09T06:55:06.923395+0000","last_fullsized":"2023-10-09T06:55:06.923395+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:16.840270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.943755+0000","last_change":"2023-10-09T06:55:06.941611+0000","last_active":"2023-10-09T06:55:06.943755+0000","last_peered":"2023-10-09T06:55:06.943755+0000","last_clean":"2023-10-09T06:55:06.943755+0000","last_became_active":"2023-10-09T06:55:06.941376+0000","last_became_peered":"2023-10-09T06:55:06.941376+0000","last_unstale":"2023-10-09T06:55:06.943755+0000","last_undegraded":"2023-10-09T06:55:06.943755+0000","last_fullsized":"2023-10-09T06:55:06.943755+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:28.056882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:04.900841+0000","last_change":"2023-10-09T06:55:04.900841+0000","last_active":"2023-10-09T06:55:04.900841+0000","last_peered":"2023-10-09T06:55:04.900841+0000","last_clean":"2023-10-09T06:55:04.900841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:04.900841+0000","last_undegraded":"2023-10-09T06:55:04.900841+0000","last_fullsized":"2023-10-09T06:55:04.900841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"52'139","reported_seq":278,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.929711+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:55:06.929711+0000","last_peered":"2023-10-09T06:55:06.929711+0000","last_clean":"2023-10-09T06:55:06.929711+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:55:06.929711+0000","last_undegraded":"2023-10-09T06:55:06.929711+0000","last_fullsized":"2023-10-09T06:55:06.929711+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":76,"acting":76,"num_store_stats":5},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2236,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":46,"acting":46,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575003,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":936574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71899999999999997,"15min":0.71699999999999997},"min":{"1min":0.36299999999999999,"5min":0.316,"15min":0.316},"max":{"1min":1.732,"5min":1.732,"15min":1.9490000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73199999999999998,"15min":0.75},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.29999999999999999},"max":{"1min":0.94399999999999995,"5min":1.0169999999999999,"15min":3.448},"last":0.85999999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72199999999999998,"15min":0.77500000000000002},"min":{"1min":0.437,"5min":0.379,"15min":0.379},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":5.617},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.753},"min":{"1min":0.45800000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":2.016},"last":0.68400000000000005}]},{"osd":2,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.74099999999999999,"15min":0.752},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44800000000000001},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":2.052},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76900000000000002,"15min":0.79200000000000004},"min":{"1min":0.48299999999999998,"5min":0.45200000000000001,"15min":0.44700000000000001},"max":{"1min":2.6629999999999998,"5min":2.6629999999999998,"15min":3.5019999999999998},"last":0.69799999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71799999999999997,"15min":0.79300000000000004},"min":{"1min":0.498,"5min":0.45600000000000002,"15min":0.45000000000000001},"max":{"1min":0.85199999999999998,"5min":1.0409999999999999,"15min":5.5800000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.84999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.47099999999999997},"max":{"1min":1.827,"5min":1.827,"15min":6.9299999999999997},"last":0.61399999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.60099999999999998,"15min":0.64800000000000002},"min":{"1min":0.47299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89900000000000002,"5min":0.90400000000000003,"15min":3.125},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.64900000000000002,"15min":0.71399999999999997},"min":{"1min":0.42199999999999999,"5min":0.41999999999999998,"15min":0.40500000000000003},"max":{"1min":2.577,"5min":2.577,"15min":4.8380000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.67300000000000004,"15min":0.72899999999999998},"min":{"1min":0.438,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":4.1929999999999996},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.71199999999999997,"15min":0.76700000000000002},"min":{"1min":0.52900000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.9590000000000001,"5min":2.9590000000000001,"15min":3.6749999999999998},"last":0.82299999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.753,"15min":0.81799999999999995},"min":{"1min":0.58099999999999996,"5min":0.53300000000000003,"15min":0.49199999999999999},"max":{"1min":3.0019999999999998,"5min":3.0019999999999998,"15min":4.0250000000000004},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.73199999999999998,"15min":0.83199999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.44700000000000001},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":7.0259999999999998},"last":0.79600000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575001,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302056,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069784,"statfs":{"total":96636764160,"available":96327458816,"internally_reserved":0,"allocated":688128,"data_stored":319549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.71799999999999997,"15min":0.70599999999999996},"min":{"1min":0.48099999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81999999999999995,"5min":0.97899999999999998,"15min":1.022},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.72099999999999997,"15min":0.69299999999999995},"min":{"1min":0.47499999999999998,"5min":0.41999999999999998,"15min":0.36599999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.079},"last":0.629}]},{"osd":1,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.73099999999999998,"15min":0.71599999999999997},"min":{"1min":0.45500000000000002,"5min":0.44800000000000001,"15min":0.42799999999999999},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.72299999999999998,"15min":0.71799999999999997},"min":{"1min":0.501,"5min":0.48299999999999998,"15min":0.438},"max":{"1min":0.84999999999999998,"5min":1.0109999999999999,"15min":1.034},"last":0.55300000000000005}]},{"osd":2,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.42599999999999999},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.45200000000000001},"max":{"1min":0.79200000000000004,"5min":0.96699999999999997,"15min":1.0900000000000001},"last":0.59499999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.71299999999999997,"15min":0.69199999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.89800000000000002,"5min":0.91700000000000004,"15min":1.046},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77000000000000002,"15min":0.753},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.497},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.73299999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63,"15min":0.63700000000000001},"min":{"1min":0.41299999999999998,"5min":0.38,"15min":0.377},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.501},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.626},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.51800000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64600000000000002,"15min":0.65800000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68600000000000005,"15min":0.70199999999999996},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.42299999999999999},"max":{"1min":0.84099999999999997,"5min":1.012,"15min":1.0669999999999999},"last":0.71199999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68200000000000005,"15min":0.68600000000000005},"min":{"1min":0.47299999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.72499999999999998,"15min":0.73199999999999998},"min":{"1min":0.44600000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.76300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":346186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46000000000000002,"15min":0.45600000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56999999999999995,"5min":0.90300000000000002,"15min":1.2729999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48799999999999999,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.311,"15min":0.23699999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.91200000000000003},"last":0.44500000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.498,"15min":0.48599999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.29599999999999999},"max":{"1min":0.64900000000000002,"5min":0.67800000000000005,"15min":0.91900000000000004},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57799999999999996,"15min":0.56699999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77900000000000003,"5min":0.83999999999999997,"15min":1.3340000000000001},"last":0.48199999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.622,"15min":0.59899999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.34100000000000003},"max":{"1min":0.73699999999999999,"5min":0.89500000000000002,"15min":1.365},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.34100000000000003},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.63300000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.78400000000000003,"15min":0.77200000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.995,"5min":1.0529999999999999,"15min":1.234},"last":0.66000000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79200000000000004,"15min":0.77200000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0309999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.78600000000000003,"15min":0.77600000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.47999999999999998},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.69099999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.80500000000000005,"15min":0.79000000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.3029999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.80400000000000005,"15min":0.79200000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0980000000000001,"5min":1.222,"15min":1.222},"last":0.69999999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.83599999999999997,"15min":0.82599999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.53500000000000003},"max":{"1min":1.129,"5min":1.129,"15min":1.4510000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.82999999999999996,"15min":0.81899999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.115,"5min":1.179,"15min":1.1970000000000001},"last":0.76600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575002,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":1335296,"data_stored":936518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47499999999999998,"15min":0.47099999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.23000000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":1.2729999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.56699999999999995,"15min":0.53300000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.28899999999999998},"max":{"1min":4.5819999999999999,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":0.45100000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.58799999999999997,"15min":0.55600000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":4.6980000000000004,"5min":4.6980000000000004,"15min":4.6980000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.51500000000000001,"15min":0.48999999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.55100000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.7130000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.63500000000000001,"15min":0.61799999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":4.734,"5min":4.734,"15min":4.734},"last":0.495}]},{"osd":4,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.78300000000000003,"15min":0.77500000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.103,"5min":1.218,"15min":1.752},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.82399999999999995,"15min":0.80800000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":4.6619999999999999,"5min":4.6619999999999999,"15min":4.6619999999999999},"last":0.75800000000000001}]},{"osd":5,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.2769999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.80100000000000005,"15min":0.80700000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0840000000000001,"5min":1.2809999999999999,"15min":1.7889999999999999},"last":0.88400000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.83399999999999996,"15min":0.82599999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.50900000000000001},"max":{"1min":4.6239999999999997,"5min":4.6239999999999997,"15min":4.6239999999999997},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.80600000000000005,"15min":0.81200000000000006},"min":{"1min":0.50800000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.228,"5min":1.2689999999999999,"15min":1.4370000000000001},"last":0.74399999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.83499999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.256,"5min":1.256,"15min":1.518},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.85599999999999998,"15min":0.85999999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.702,"5min":1.702,"15min":1.8200000000000001},"last":0.82199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575002,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306216,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065624,"statfs":{"total":96636764160,"available":96323198976,"internally_reserved":0,"allocated":753664,"data_stored":347674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.46000000000000002,"15min":0.45800000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.25900000000000001},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.498,"15min":0.499},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.484},"last":0.56200000000000006}]},{"osd":1,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.47899999999999998,"15min":0.496},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.623,"5min":0.80700000000000005,"15min":1.865},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.50800000000000001,"15min":0.52600000000000002},"min":{"1min":0.36199999999999999,"5min":0.33700000000000002,"15min":0.32200000000000001},"max":{"1min":0.66500000000000004,"5min":0.747,"15min":1.79},"last":0.65700000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.41699999999999998,"5min":0.38600000000000001,"15min":0.35799999999999998},"max":{"1min":0.84499999999999997,"5min":0.87,"15min":1.8999999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.38500000000000001},"max":{"1min":0.84799999999999998,"5min":0.85199999999999998,"15min":1.8220000000000001},"last":0.61799999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.77900000000000003,"15min":0.754},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.42899999999999999},"max":{"1min":1.1799999999999999,"5min":1.256,"15min":1.256},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.77800000000000002,"15min":0.77400000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.44800000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.63}]},{"osd":5,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78800000000000003,"15min":0.76900000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.79100000000000004,"15min":0.77300000000000002},"min":{"1min":0.58299999999999996,"5min":0.57199999999999995,"15min":0.503},"max":{"1min":0.98799999999999999,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.69499999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.79900000000000004,"15min":0.78800000000000003},"min":{"1min":0.55100000000000005,"5min":0.54900000000000004,"15min":0.48599999999999999},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.81200000000000006,"15min":0.79800000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.5309999999999999},"last":0.71099999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.82399999999999995,"15min":0.80800000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.84399999999999997,"15min":0.82399999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.50900000000000001},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.81799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575003,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302116,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069724,"statfs":{"total":96636764160,"available":96327397376,"internally_reserved":0,"allocated":749568,"data_stored":346726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47599999999999998,"15min":0.45900000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.24099999999999999},"max":{"1min":0.81200000000000006,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50900000000000001,"15min":0.47799999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.28100000000000003},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.42899999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.499,"15min":0.47899999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.55700000000000005,"15min":0.53400000000000003},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.67800000000000005,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52900000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59599999999999997,"15min":0.57099999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.38500000000000001},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.64600000000000002,"15min":0.61899999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":3.8900000000000001,"5min":3.8900000000000001,"15min":3.8900000000000001},"last":0.59799999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76100000000000001,"15min":0.74299999999999999},"min":{"1min":0.48299999999999998,"5min":0.47199999999999998,"15min":0.40799999999999997},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.83999999999999997,"15min":0.81599999999999995},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.52200000000000002},"max":{"1min":1.081,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.77800000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.76900000000000002,"15min":0.749},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96999999999999997,"5min":1.091,"15min":2.1549999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.81599999999999995,"15min":0.79600000000000004},"min":{"1min":0.58199999999999996,"5min":0.56499999999999995,"15min":0.50600000000000001},"max":{"1min":0.97299999999999998,"5min":1.0800000000000001,"15min":1.419},"last":0.68799999999999994}]},{"osd":6,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.79700000000000004,"15min":0.77500000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.51700000000000002},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.81200000000000006,"15min":0.77500000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.51500000000000001},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.83599999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.84799999999999998,"15min":0.82499999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.55500000000000005},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":2.0880000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.84699999999999998,"15min":0.82699999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.56499999999999995},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.71599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575001,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306152,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065688,"statfs":{"total":96636764160,"available":96323264512,"internally_reserved":0,"allocated":688128,"data_stored":319549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73699999999999999,"15min":0.69499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35499999999999998},"max":{"1min":3.1139999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.73599999999999999,"15min":0.70899999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.39300000000000002},"max":{"1min":2.8130000000000002,"5min":2.8130000000000002,"15min":3.23},"last":0.68700000000000006}]},{"osd":1,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73199999999999998,"15min":0.70099999999999996},"min":{"1min":0.46999999999999997,"5min":0.45800000000000002,"15min":0.373},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.78200000000000003,"15min":0.74199999999999999},"min":{"1min":0.46300000000000002,"5min":0.45100000000000001,"15min":0.40500000000000003},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.75800000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78100000000000003,"15min":0.754},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.38100000000000001},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":3.7509999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.80100000000000005,"15min":0.77900000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":0.85099999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76400000000000001,"15min":0.751},"min":{"1min":0.51000000000000001,"5min":0.434,"15min":0.434},"max":{"1min":2.6440000000000001,"5min":2.6440000000000001,"15min":3.6970000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.78900000000000003,"15min":0.73799999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.6899999999999999,"5min":3.6899999999999999,"15min":3.6899999999999999},"last":0.71199999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":3.3860000000000001,"5min":3.3860000000000001,"15min":3.4780000000000002},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.68799999999999994,"15min":0.68000000000000005},"min":{"1min":0.39100000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.79100000000000004}]},{"osd":6,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.67000000000000004,"15min":0.66700000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":3.5270000000000001,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.374},"max":{"1min":3.4740000000000002,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.85899999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.7210000000000001,"5min":2.7210000000000001,"15min":3.2789999999999999},"last":0.87},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":3.7280000000000002,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.95499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575002,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302056,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069784,"statfs":{"total":96636764160,"available":96327458816,"internally_reserved":0,"allocated":688128,"data_stored":319549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.69299999999999995,"15min":0.70199999999999996},"min":{"1min":0.39800000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.91600000000000004,"15min":1.655},"last":0.438},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.68500000000000005,"15min":0.68999999999999995},"min":{"1min":0.34499999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79800000000000004,"5min":0.99099999999999999,"15min":1.1359999999999999},"last":0.60399999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.66800000000000004,"15min":0.71599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79500000000000004,"5min":1.034,"15min":2.4159999999999999},"last":0.499},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.71199999999999997,"15min":0.73099999999999998},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81699999999999995,"5min":1.0229999999999999,"15min":1.706},"last":0.755}]},{"osd":2,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.72099999999999997,"15min":0.74299999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.42999999999999999},"max":{"1min":0.79900000000000004,"5min":0.97499999999999998,"15min":1.79},"last":0.63},{"interface":"front","average":{"1min":0.626,"5min":0.69599999999999995,"15min":0.73399999999999999},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.442},"max":{"1min":0.80300000000000005,"5min":1.004,"15min":2.4889999999999999},"last":0.59499999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.69699999999999995,"15min":0.72699999999999998},"min":{"1min":0.503,"5min":0.435,"15min":0.435},"max":{"1min":0.84299999999999997,"5min":0.95499999999999996,"15min":1.409},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.75800000000000001,"15min":0.79400000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.88600000000000001,"5min":1.0629999999999999,"15min":2.532},"last":0.73999999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59099999999999997,"15min":0.63600000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84799999999999998,"5min":0.91300000000000003,"15min":1.766},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.65500000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.35799999999999998},"max":{"1min":0.86199999999999999,"5min":0.98199999999999998,"15min":2.7829999999999999},"last":0.77200000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.628,"15min":0.67300000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.93000000000000005,"5min":0.97699999999999998,"15min":2.5739999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.67100000000000004,"15min":0.69899999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.38900000000000001},"max":{"1min":0.86899999999999999,"5min":0.95299999999999996,"15min":1.8080000000000001},"last":0.79600000000000004}]},{"osd":7,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67800000000000005,"15min":0.72499999999999998},"min":{"1min":0.48599999999999999,"5min":0.45500000000000002,"15min":0.436},"max":{"1min":0.91500000000000004,"5min":0.94499999999999995,"15min":2.9609999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75,"15min":0.80400000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.45900000000000002},"max":{"1min":0.96699999999999997,"5min":0.998,"15min":2.613},"last":0.78900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:55:11.248 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:55:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.461+0000 7faa93bff700 1 Processor -- start 2023-10-09T06:55:11.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.461+0000 7faa93bff700 1 -- start start 2023-10-09T06:55:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.463+0000 7faa93bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faa8c0cbf30 0x7faa8c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.463+0000 7faa93bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa8c0cc300 con 0x7faa8c0ccf90 2023-10-09T06:55:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.463+0000 7faa93bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa8c0ad370 con 0x7faa8c0b1420 2023-10-09T06:55:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.463+0000 7faa93bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8c156bf0 con 0x7faa8c0cbf30 2023-10-09T06:55:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.463+0000 7faa9199b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faa8c0cbf30 0x7faa8c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.463+0000 7faa9119a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7faa8c0ccf90 0x7faa8c0b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48610/0 (socket says 172.21.15.71:48610) 2023-10-09T06:55:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.463+0000 7faa9119a700 1 -- 172.21.15.71:0/930209534 learned_addr learned my addr 172.21.15.71:0/930209534 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:55:11.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.463+0000 7faa9199b700 1 -- 172.21.15.71:0/930209534 >> v1:172.21.15.179:6789/0 conn(0x7faa8c0b1420 legacy=0x7faa8c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:11.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.463+0000 7faa9199b700 1 -- 172.21.15.71:0/930209534 >> v1:172.21.15.71:6789/0 conn(0x7faa8c0ccf90 legacy=0x7faa8c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:11.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.463+0000 7faa9199b700 1 -- 172.21.15.71:0/930209534 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8c0ad650 con 0x7faa8c0cbf30 2023-10-09T06:55:11.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.464+0000 7faa9199b700 1 --2- 172.21.15.71:0/930209534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa8c0cbf30 0x7faa8c0ae410 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7faa880098e0 tx=0x7faa880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9cb4a72fbdfce22 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:11.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.464+0000 7faa90999700 1 -- 172.21.15.71:0/930209534 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa88009e80 con 0x7faa8c0cbf30 2023-10-09T06:55:11.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.464+0000 7faa90999700 1 -- 172.21.15.71:0/930209534 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8800b860 con 0x7faa8c0cbf30 2023-10-09T06:55:11.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.464+0000 7faa90999700 1 -- 172.21.15.71:0/930209534 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8800bbe0 con 0x7faa8c0cbf30 2023-10-09T06:55:11.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.464+0000 7faa93bff700 1 -- 172.21.15.71:0/930209534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa8c0cbf30 msgr2=0x7faa8c0ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:11.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.464+0000 7faa93bff700 1 --2- 172.21.15.71:0/930209534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa8c0cbf30 0x7faa8c0ae410 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7faa880098e0 tx=0x7faa880091a0 comp rx=0 tx=0).stop 2023-10-09T06:55:11.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.465+0000 7faa93bff700 1 -- 172.21.15.71:0/930209534 shutdown_connections 2023-10-09T06:55:11.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.465+0000 7faa93bff700 1 --2- 172.21.15.71:0/930209534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa8c0cbf30 0x7faa8c0ae410 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:11.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.465+0000 7faa93bff700 1 -- 172.21.15.71:0/930209534 >> 172.21.15.71:0/930209534 conn(0x7faa8c06a320 msgr2=0x7faa8c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:11.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.465+0000 7faa93bff700 1 -- 172.21.15.71:0/930209534 shutdown_connections 2023-10-09T06:55:11.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.465+0000 7faa93bff700 1 -- 172.21.15.71:0/930209534 wait complete. 2023-10-09T06:55:11.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.466+0000 7faa93bff700 1 Processor -- start 2023-10-09T06:55:11.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.466+0000 7faa93bff700 1 -- start start 2023-10-09T06:55:11.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.467+0000 7faa93bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa8c0b1420 0x7faa8c1597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:11.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.467+0000 7faa93bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa8c0cbf30 0x7faa8c16a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:11.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.467+0000 7faa93bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa8c0ccf90 0x7faa8c16ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:11.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.467+0000 7faa93bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c16bdd0 con 0x7faa8c0ccf90 2023-10-09T06:55:11.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.467+0000 7faa93bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c16b190 con 0x7faa8c0cbf30 2023-10-09T06:55:11.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.467+0000 7faa93bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c16b780 con 0x7faa8c0b1420 2023-10-09T06:55:11.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.467+0000 7faa9219c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa8c0ccf90 0x7faa8c16ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:11.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.467+0000 7faa9219c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa8c0ccf90 0x7faa8c16ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39418/0 (socket says 172.21.15.71:39418) 2023-10-09T06:55:11.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.467+0000 7faa9219c700 1 -- 172.21.15.71:0/2342708157 learned_addr learned my addr 172.21.15.71:0/2342708157 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:11.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.468+0000 7faa9119a700 1 --2- 172.21.15.71:0/2342708157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa8c0cbf30 0x7faa8c16a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:11.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.468+0000 7faa9199b700 1 --2- 172.21.15.71:0/2342708157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa8c0b1420 0x7faa8c1597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:11.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.468+0000 7faa9219c700 1 -- 172.21.15.71:0/2342708157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa8c0b1420 msgr2=0x7faa8c1597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:11.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.468+0000 7faa9219c700 1 --2- 172.21.15.71:0/2342708157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa8c0b1420 0x7faa8c1597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:11.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.468+0000 7faa9219c700 1 -- 172.21.15.71:0/2342708157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa8c0cbf30 msgr2=0x7faa8c16a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:11.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.468+0000 7faa9219c700 1 --2- 172.21.15.71:0/2342708157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa8c0cbf30 0x7faa8c16a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:11.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.468+0000 7faa9219c700 1 -- 172.21.15.71:0/2342708157 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa88009420 con 0x7faa8c0ccf90 2023-10-09T06:55:11.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.468+0000 7faa9199b700 1 --2- 172.21.15.71:0/2342708157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa8c0b1420 0x7faa8c1597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:55:11.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.468+0000 7faa9219c700 1 --2- 172.21.15.71:0/2342708157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa8c0ccf90 0x7faa8c16ab30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7faa8400c8e0 tx=0x7faa84001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:11.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.468+0000 7faa81ffb700 1 -- 172.21.15.71:0/2342708157 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8400ce80 con 0x7faa8c0ccf90 2023-10-09T06:55:11.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.468+0000 7faa81ffb700 1 -- 172.21.15.71:0/2342708157 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8400a7e0 con 0x7faa8c0ccf90 2023-10-09T06:55:11.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.468+0000 7faa81ffb700 1 -- 172.21.15.71:0/2342708157 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8400ab80 con 0x7faa8c0ccf90 2023-10-09T06:55:11.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.468+0000 7faa93bff700 1 -- 172.21.15.71:0/2342708157 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8c16ba60 con 0x7faa8c0ccf90 2023-10-09T06:55:11.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.468+0000 7faa93bff700 1 -- 172.21.15.71:0/2342708157 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8c1556f0 con 0x7faa8c0ccf90 2023-10-09T06:55:11.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.469+0000 7faa93bff700 1 -- 172.21.15.71:0/2342708157 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa8c04c3c0 con 0x7faa8c0ccf90 2023-10-09T06:55:11.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.470+0000 7faa81ffb700 1 -- 172.21.15.71:0/2342708157 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa84012420 con 0x7faa8c0ccf90 2023-10-09T06:55:11.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.471+0000 7faa81ffb700 1 --2- 172.21.15.71:0/2342708157 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faa70066f30 0x7faa700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:11.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.471+0000 7faa81ffb700 1 -- 172.21.15.71:0/2342708157 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7faa840849f0 con 0x7faa8c0ccf90 2023-10-09T06:55:11.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.472+0000 7faa9199b700 1 --2- 172.21.15.71:0/2342708157 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faa70066f30 0x7faa700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:11.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.472+0000 7faa9199b700 1 --2- 172.21.15.71:0/2342708157 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faa70066f30 0x7faa700693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faa8c16db10 tx=0x7faa88019000 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:11.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.475+0000 7faa81ffb700 1 -- 172.21.15.71:0/2342708157 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa84051a50 con 0x7faa8c0ccf90 2023-10-09T06:55:11.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.660+0000 7faa93bff700 1 -- 172.21.15.71:0/2342708157 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faa8c15a260 con 0x7faa70066f30 2023-10-09T06:55:11.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.669+0000 7faa81ffb700 1 -- 172.21.15.71:0/2342708157 <== mgr.5015 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283721 (secure 0 0 0) 0x7faa8c15a260 con 0x7faa70066f30 2023-10-09T06:55:11.673 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:55:11.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.672+0000 7faa93bff700 1 -- 172.21.15.71:0/2342708157 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faa70066f30 msgr2=0x7faa700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:11.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.672+0000 7faa93bff700 1 --2- 172.21.15.71:0/2342708157 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faa70066f30 0x7faa700693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faa8c16db10 tx=0x7faa88019000 comp rx=0 tx=0).stop 2023-10-09T06:55:11.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.672+0000 7faa93bff700 1 -- 172.21.15.71:0/2342708157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa8c0ccf90 msgr2=0x7faa8c16ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:11.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.672+0000 7faa93bff700 1 --2- 172.21.15.71:0/2342708157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa8c0ccf90 0x7faa8c16ab30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7faa8400c8e0 tx=0x7faa84001710 comp rx=0 tx=0).stop 2023-10-09T06:55:11.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.673+0000 7faa93bff700 1 -- 172.21.15.71:0/2342708157 shutdown_connections 2023-10-09T06:55:11.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.673+0000 7faa93bff700 1 --2- 172.21.15.71:0/2342708157 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7faa70066f30 0x7faa700693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:11.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.673+0000 7faa93bff700 1 --2- 172.21.15.71:0/2342708157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa8c0ccf90 0x7faa8c16ab30 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:11.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.673+0000 7faa93bff700 1 --2- 172.21.15.71:0/2342708157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa8c0b1420 0x7faa8c1597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:11.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.673+0000 7faa93bff700 1 --2- 172.21.15.71:0/2342708157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa8c0cbf30 0x7faa8c16a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:11.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.673+0000 7faa93bff700 1 -- 172.21.15.71:0/2342708157 >> 172.21.15.71:0/2342708157 conn(0x7faa8c06a320 msgr2=0x7faa8c0cac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:11.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.673+0000 7faa93bff700 1 -- 172.21.15.71:0/2342708157 shutdown_connections 2023-10-09T06:55:11.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.673+0000 7faa93bff700 1 -- 172.21.15.71:0/2342708157 wait complete. 2023-10-09T06:55:11.676 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:55:11.691 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-09T06:55:09.872868+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592604,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":236,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":124,"acting":124,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":2417888,"kb_used_data":6816,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752556832,"statfs":{"total":773094113280,"available":770618195968,"internally_reserved":0,"allocated":6979584,"data_stored":3872325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2236,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.963748"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953251+0000","last_change":"2023-10-09T06:55:06.941941+0000","last_active":"2023-10-09T06:55:06.953251+0000","last_peered":"2023-10-09T06:55:06.953251+0000","last_clean":"2023-10-09T06:55:06.953251+0000","last_became_active":"2023-10-09T06:55:06.941652+0000","last_became_peered":"2023-10-09T06:55:06.941652+0000","last_unstale":"2023-10-09T06:55:06.953251+0000","last_undegraded":"2023-10-09T06:55:06.953251+0000","last_fullsized":"2023-10-09T06:55:06.953251+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:13.874146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.957583+0000","last_change":"2023-10-09T06:55:06.953644+0000","last_active":"2023-10-09T06:55:06.957583+0000","last_peered":"2023-10-09T06:55:06.957583+0000","last_clean":"2023-10-09T06:55:06.957583+0000","last_became_active":"2023-10-09T06:55:06.953144+0000","last_became_peered":"2023-10-09T06:55:06.953144+0000","last_unstale":"2023-10-09T06:55:06.957583+0000","last_undegraded":"2023-10-09T06:55:06.957583+0000","last_fullsized":"2023-10-09T06:55:06.957583+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:04.806773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.941216+0000","last_change":"2023-10-09T06:55:06.932908+0000","last_active":"2023-10-09T06:55:06.941216+0000","last_peered":"2023-10-09T06:55:06.941216+0000","last_clean":"2023-10-09T06:55:06.941216+0000","last_became_active":"2023-10-09T06:55:06.932692+0000","last_became_peered":"2023-10-09T06:55:06.932692+0000","last_unstale":"2023-10-09T06:55:06.941216+0000","last_undegraded":"2023-10-09T06:55:06.941216+0000","last_fullsized":"2023-10-09T06:55:06.941216+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:56:01.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.949558+0000","last_change":"2023-10-09T06:55:06.939597+0000","last_active":"2023-10-09T06:55:06.949558+0000","last_peered":"2023-10-09T06:55:06.949558+0000","last_clean":"2023-10-09T06:55:06.949558+0000","last_became_active":"2023-10-09T06:55:06.939344+0000","last_became_peered":"2023-10-09T06:55:06.939344+0000","last_unstale":"2023-10-09T06:55:06.949558+0000","last_undegraded":"2023-10-09T06:55:06.949558+0000","last_fullsized":"2023-10-09T06:55:06.949558+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:27.488161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953884+0000","last_change":"2023-10-09T06:55:06.952049+0000","last_active":"2023-10-09T06:55:06.953884+0000","last_peered":"2023-10-09T06:55:06.953884+0000","last_clean":"2023-10-09T06:55:06.953884+0000","last_became_active":"2023-10-09T06:55:06.951794+0000","last_became_peered":"2023-10-09T06:55:06.951794+0000","last_unstale":"2023-10-09T06:55:06.953884+0000","last_undegraded":"2023-10-09T06:55:06.953884+0000","last_fullsized":"2023-10-09T06:55:06.953884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:58:23.011522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.947762+0000","last_change":"2023-10-09T06:55:06.942297+0000","last_active":"2023-10-09T06:55:06.947762+0000","last_peered":"2023-10-09T06:55:06.947762+0000","last_clean":"2023-10-09T06:55:06.947762+0000","last_became_active":"2023-10-09T06:55:06.941997+0000","last_became_peered":"2023-10-09T06:55:06.941997+0000","last_unstale":"2023-10-09T06:55:06.947762+0000","last_undegraded":"2023-10-09T06:55:06.947762+0000","last_fullsized":"2023-10-09T06:55:06.947762+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:27.365626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.957594+0000","last_change":"2023-10-09T06:55:06.954659+0000","last_active":"2023-10-09T06:55:06.957594+0000","last_peered":"2023-10-09T06:55:06.957594+0000","last_clean":"2023-10-09T06:55:06.957594+0000","last_became_active":"2023-10-09T06:55:06.954424+0000","last_became_peered":"2023-10-09T06:55:06.954424+0000","last_unstale":"2023-10-09T06:55:06.957594+0000","last_undegraded":"2023-10-09T06:55:06.957594+0000","last_fullsized":"2023-10-09T06:55:06.957594+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:26:52.867345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.943599+0000","last_change":"2023-10-09T06:55:06.941384+0000","last_active":"2023-10-09T06:55:06.943599+0000","last_peered":"2023-10-09T06:55:06.943599+0000","last_clean":"2023-10-09T06:55:06.943599+0000","last_became_active":"2023-10-09T06:55:06.935944+0000","last_became_peered":"2023-10-09T06:55:06.935944+0000","last_unstale":"2023-10-09T06:55:06.943599+0000","last_undegraded":"2023-10-09T06:55:06.943599+0000","last_fullsized":"2023-10-09T06:55:06.943599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:48:10.713903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.934730+0000","last_change":"2023-10-09T06:55:06.929812+0000","last_active":"2023-10-09T06:55:06.934730+0000","last_peered":"2023-10-09T06:55:06.934730+0000","last_clean":"2023-10-09T06:55:06.934730+0000","last_became_active":"2023-10-09T06:55:06.929471+0000","last_became_peered":"2023-10-09T06:55:06.929471+0000","last_unstale":"2023-10-09T06:55:06.934730+0000","last_undegraded":"2023-10-09T06:55:06.934730+0000","last_fullsized":"2023-10-09T06:55:06.934730+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:44.668078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.943753+0000","last_change":"2023-10-09T06:55:06.940701+0000","last_active":"2023-10-09T06:55:06.943753+0000","last_peered":"2023-10-09T06:55:06.943753+0000","last_clean":"2023-10-09T06:55:06.943753+0000","last_became_active":"2023-10-09T06:55:06.935669+0000","last_became_peered":"2023-10-09T06:55:06.935669+0000","last_unstale":"2023-10-09T06:55:06.943753+0000","last_undegraded":"2023-10-09T06:55:06.943753+0000","last_fullsized":"2023-10-09T06:55:06.943753+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:27.310704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948019+0000","last_change":"2023-10-09T06:55:06.941609+0000","last_active":"2023-10-09T06:55:06.948019+0000","last_peered":"2023-10-09T06:55:06.948019+0000","last_clean":"2023-10-09T06:55:06.948019+0000","last_became_active":"2023-10-09T06:55:06.941358+0000","last_became_peered":"2023-10-09T06:55:06.941358+0000","last_unstale":"2023-10-09T06:55:06.948019+0000","last_undegraded":"2023-10-09T06:55:06.948019+0000","last_fullsized":"2023-10-09T06:55:06.948019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:44.434314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.946692+0000","last_change":"2023-10-09T06:55:06.945053+0000","last_active":"2023-10-09T06:55:06.946692+0000","last_peered":"2023-10-09T06:55:06.946692+0000","last_clean":"2023-10-09T06:55:06.946692+0000","last_became_active":"2023-10-09T06:55:06.944789+0000","last_became_peered":"2023-10-09T06:55:06.944789+0000","last_unstale":"2023-10-09T06:55:06.946692+0000","last_undegraded":"2023-10-09T06:55:06.946692+0000","last_fullsized":"2023-10-09T06:55:06.946692+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:08.244758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948157+0000","last_change":"2023-10-09T06:55:06.945836+0000","last_active":"2023-10-09T06:55:06.948157+0000","last_peered":"2023-10-09T06:55:06.948157+0000","last_clean":"2023-10-09T06:55:06.948157+0000","last_became_active":"2023-10-09T06:55:06.945564+0000","last_became_peered":"2023-10-09T06:55:06.945564+0000","last_unstale":"2023-10-09T06:55:06.948157+0000","last_undegraded":"2023-10-09T06:55:06.948157+0000","last_fullsized":"2023-10-09T06:55:06.948157+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:40.055223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955508+0000","last_change":"2023-10-09T06:55:06.953311+0000","last_active":"2023-10-09T06:55:06.955508+0000","last_peered":"2023-10-09T06:55:06.955508+0000","last_clean":"2023-10-09T06:55:06.955508+0000","last_became_active":"2023-10-09T06:55:06.952959+0000","last_became_peered":"2023-10-09T06:55:06.952959+0000","last_unstale":"2023-10-09T06:55:06.955508+0000","last_undegraded":"2023-10-09T06:55:06.955508+0000","last_fullsized":"2023-10-09T06:55:06.955508+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:12:43.264714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.942812+0000","last_change":"2023-10-09T06:55:06.939960+0000","last_active":"2023-10-09T06:55:06.942812+0000","last_peered":"2023-10-09T06:55:06.942812+0000","last_clean":"2023-10-09T06:55:06.942812+0000","last_became_active":"2023-10-09T06:55:06.939690+0000","last_became_peered":"2023-10-09T06:55:06.939690+0000","last_unstale":"2023-10-09T06:55:06.942812+0000","last_undegraded":"2023-10-09T06:55:06.942812+0000","last_fullsized":"2023-10-09T06:55:06.942812+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:07:47.321921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948071+0000","last_change":"2023-10-09T06:55:06.943815+0000","last_active":"2023-10-09T06:55:06.948071+0000","last_peered":"2023-10-09T06:55:06.948071+0000","last_clean":"2023-10-09T06:55:06.948071+0000","last_became_active":"2023-10-09T06:55:06.943558+0000","last_became_peered":"2023-10-09T06:55:06.943558+0000","last_unstale":"2023-10-09T06:55:06.948071+0000","last_undegraded":"2023-10-09T06:55:06.948071+0000","last_fullsized":"2023-10-09T06:55:06.948071+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:24:19.345593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.934846+0000","last_change":"2023-10-09T06:55:06.928130+0000","last_active":"2023-10-09T06:55:06.934846+0000","last_peered":"2023-10-09T06:55:06.934846+0000","last_clean":"2023-10-09T06:55:06.934846+0000","last_became_active":"2023-10-09T06:55:06.927851+0000","last_became_peered":"2023-10-09T06:55:06.927851+0000","last_unstale":"2023-10-09T06:55:06.934846+0000","last_undegraded":"2023-10-09T06:55:06.934846+0000","last_fullsized":"2023-10-09T06:55:06.934846+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:18.653877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954325+0000","last_change":"2023-10-09T06:55:06.952189+0000","last_active":"2023-10-09T06:55:06.954325+0000","last_peered":"2023-10-09T06:55:06.954325+0000","last_clean":"2023-10-09T06:55:06.954325+0000","last_became_active":"2023-10-09T06:55:06.951940+0000","last_became_peered":"2023-10-09T06:55:06.951940+0000","last_unstale":"2023-10-09T06:55:06.954325+0000","last_undegraded":"2023-10-09T06:55:06.954325+0000","last_fullsized":"2023-10-09T06:55:06.954325+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:22.559262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"61'4","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955223+0000","last_change":"2023-10-09T06:55:05.933796+0000","last_active":"2023-10-09T06:55:06.955223+0000","last_peered":"2023-10-09T06:55:06.955223+0000","last_clean":"2023-10-09T06:55:06.955223+0000","last_became_active":"2023-10-09T06:55:05.933559+0000","last_became_peered":"2023-10-09T06:55:05.933559+0000","last_unstale":"2023-10-09T06:55:06.955223+0000","last_undegraded":"2023-10-09T06:55:06.955223+0000","last_fullsized":"2023-10-09T06:55:06.955223+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:09.365369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:04.900841+0000","last_change":"2023-10-09T06:55:04.900841+0000","last_active":"2023-10-09T06:55:04.900841+0000","last_peered":"2023-10-09T06:55:04.900841+0000","last_clean":"2023-10-09T06:55:04.900841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:04.900841+0000","last_undegraded":"2023-10-09T06:55:04.900841+0000","last_fullsized":"2023-10-09T06:55:04.900841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.952611+0000","last_change":"2023-10-09T06:55:05.936463+0000","last_active":"2023-10-09T06:55:06.952611+0000","last_peered":"2023-10-09T06:55:06.952611+0000","last_clean":"2023-10-09T06:55:06.952611+0000","last_became_active":"2023-10-09T06:55:05.936166+0000","last_became_peered":"2023-10-09T06:55:05.936166+0000","last_unstale":"2023-10-09T06:55:06.952611+0000","last_undegraded":"2023-10-09T06:55:06.952611+0000","last_fullsized":"2023-10-09T06:55:06.952611+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:30.427585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.945118+0000","last_change":"2023-10-09T06:55:06.944529+0000","last_active":"2023-10-09T06:55:06.945118+0000","last_peered":"2023-10-09T06:55:06.945118+0000","last_clean":"2023-10-09T06:55:06.945118+0000","last_became_active":"2023-10-09T06:55:06.944264+0000","last_became_peered":"2023-10-09T06:55:06.944264+0000","last_unstale":"2023-10-09T06:55:06.945118+0000","last_undegraded":"2023-10-09T06:55:06.945118+0000","last_fullsized":"2023-10-09T06:55:06.945118+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:47.548592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955066+0000","last_change":"2023-10-09T06:55:05.935262+0000","last_active":"2023-10-09T06:55:06.955066+0000","last_peered":"2023-10-09T06:55:06.955066+0000","last_clean":"2023-10-09T06:55:06.955066+0000","last_became_active":"2023-10-09T06:55:05.934932+0000","last_became_peered":"2023-10-09T06:55:05.934932+0000","last_unstale":"2023-10-09T06:55:06.955066+0000","last_undegraded":"2023-10-09T06:55:06.955066+0000","last_fullsized":"2023-10-09T06:55:06.955066+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:02:48.884634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953637+0000","last_change":"2023-10-09T06:55:05.931537+0000","last_active":"2023-10-09T06:55:06.953637+0000","last_peered":"2023-10-09T06:55:06.953637+0000","last_clean":"2023-10-09T06:55:06.953637+0000","last_became_active":"2023-10-09T06:55:05.931300+0000","last_became_peered":"2023-10-09T06:55:05.931300+0000","last_unstale":"2023-10-09T06:55:06.953637+0000","last_undegraded":"2023-10-09T06:55:06.953637+0000","last_fullsized":"2023-10-09T06:55:06.953637+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:07.028150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.944440+0000","last_change":"2023-10-09T06:55:06.938409+0000","last_active":"2023-10-09T06:55:06.944440+0000","last_peered":"2023-10-09T06:55:06.944440+0000","last_clean":"2023-10-09T06:55:06.944440+0000","last_became_active":"2023-10-09T06:55:06.938160+0000","last_became_peered":"2023-10-09T06:55:06.938160+0000","last_unstale":"2023-10-09T06:55:06.944440+0000","last_undegraded":"2023-10-09T06:55:06.944440+0000","last_fullsized":"2023-10-09T06:55:06.944440+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:29:45.885127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:04.900841+0000","last_change":"2023-10-09T06:55:04.900841+0000","last_active":"2023-10-09T06:55:04.900841+0000","last_peered":"2023-10-09T06:55:04.900841+0000","last_clean":"2023-10-09T06:55:04.900841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:04.900841+0000","last_undegraded":"2023-10-09T06:55:04.900841+0000","last_fullsized":"2023-10-09T06:55:04.900841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955407+0000","last_change":"2023-10-09T06:55:06.952666+0000","last_active":"2023-10-09T06:55:06.955407+0000","last_peered":"2023-10-09T06:55:06.955407+0000","last_clean":"2023-10-09T06:55:06.955407+0000","last_became_active":"2023-10-09T06:55:06.952418+0000","last_became_peered":"2023-10-09T06:55:06.952418+0000","last_unstale":"2023-10-09T06:55:06.955407+0000","last_undegraded":"2023-10-09T06:55:06.955407+0000","last_fullsized":"2023-10-09T06:55:06.955407+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:43:07.311728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:04.900841+0000","last_change":"2023-10-09T06:55:04.900841+0000","last_active":"2023-10-09T06:55:04.900841+0000","last_peered":"2023-10-09T06:55:04.900841+0000","last_clean":"2023-10-09T06:55:04.900841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:04.900841+0000","last_undegraded":"2023-10-09T06:55:04.900841+0000","last_fullsized":"2023-10-09T06:55:04.900841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.923500+0000","last_change":"2023-10-09T06:55:05.932660+0000","last_active":"2023-10-09T06:55:06.923500+0000","last_peered":"2023-10-09T06:55:06.923500+0000","last_clean":"2023-10-09T06:55:06.923500+0000","last_became_active":"2023-10-09T06:55:05.932396+0000","last_became_peered":"2023-10-09T06:55:05.932396+0000","last_unstale":"2023-10-09T06:55:06.923500+0000","last_undegraded":"2023-10-09T06:55:06.923500+0000","last_fullsized":"2023-10-09T06:55:06.923500+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:46.541894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:04.900841+0000","last_change":"2023-10-09T06:55:04.900841+0000","last_active":"2023-10-09T06:55:04.900841+0000","last_peered":"2023-10-09T06:55:04.900841+0000","last_clean":"2023-10-09T06:55:04.900841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:04.900841+0000","last_undegraded":"2023-10-09T06:55:04.900841+0000","last_fullsized":"2023-10-09T06:55:04.900841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953271+0000","last_change":"2023-10-09T06:55:06.948696+0000","last_active":"2023-10-09T06:55:06.953271+0000","last_peered":"2023-10-09T06:55:06.953271+0000","last_clean":"2023-10-09T06:55:06.953271+0000","last_became_active":"2023-10-09T06:55:06.948292+0000","last_became_peered":"2023-10-09T06:55:06.948292+0000","last_unstale":"2023-10-09T06:55:06.953271+0000","last_undegraded":"2023-10-09T06:55:06.953271+0000","last_fullsized":"2023-10-09T06:55:06.953271+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:27.342291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.933075+0000","last_change":"2023-10-09T06:55:05.932297+0000","last_active":"2023-10-09T06:55:06.933075+0000","last_peered":"2023-10-09T06:55:06.933075+0000","last_clean":"2023-10-09T06:55:06.933075+0000","last_became_active":"2023-10-09T06:55:05.931969+0000","last_became_peered":"2023-10-09T06:55:05.931969+0000","last_unstale":"2023-10-09T06:55:06.933075+0000","last_undegraded":"2023-10-09T06:55:06.933075+0000","last_fullsized":"2023-10-09T06:55:06.933075+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:04:29.076275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.932452+0000","last_change":"2023-10-09T06:55:06.928878+0000","last_active":"2023-10-09T06:55:06.932452+0000","last_peered":"2023-10-09T06:55:06.932452+0000","last_clean":"2023-10-09T06:55:06.932452+0000","last_became_active":"2023-10-09T06:55:06.928633+0000","last_became_peered":"2023-10-09T06:55:06.928633+0000","last_unstale":"2023-10-09T06:55:06.932452+0000","last_undegraded":"2023-10-09T06:55:06.932452+0000","last_fullsized":"2023-10-09T06:55:06.932452+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:48:10.713903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"61'3","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.956479+0000","last_change":"2023-10-09T06:55:05.938582+0000","last_active":"2023-10-09T06:55:06.956479+0000","last_peered":"2023-10-09T06:55:06.956479+0000","last_clean":"2023-10-09T06:55:06.956479+0000","last_became_active":"2023-10-09T06:55:05.938239+0000","last_became_peered":"2023-10-09T06:55:05.938239+0000","last_unstale":"2023-10-09T06:55:06.956479+0000","last_undegraded":"2023-10-09T06:55:06.956479+0000","last_fullsized":"2023-10-09T06:55:06.956479+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:21.552564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953095+0000","last_change":"2023-10-09T06:55:06.942075+0000","last_active":"2023-10-09T06:55:06.953095+0000","last_peered":"2023-10-09T06:55:06.953095+0000","last_clean":"2023-10-09T06:55:06.953095+0000","last_became_active":"2023-10-09T06:55:06.941725+0000","last_became_peered":"2023-10-09T06:55:06.941725+0000","last_unstale":"2023-10-09T06:55:06.953095+0000","last_undegraded":"2023-10-09T06:55:06.953095+0000","last_fullsized":"2023-10-09T06:55:06.953095+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:50:27.836402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"61'6","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.958234+0000","last_change":"2023-10-09T06:55:05.931955+0000","last_active":"2023-10-09T06:55:06.958234+0000","last_peered":"2023-10-09T06:55:06.958234+0000","last_clean":"2023-10-09T06:55:06.958234+0000","last_became_active":"2023-10-09T06:55:05.931712+0000","last_became_peered":"2023-10-09T06:55:05.931712+0000","last_unstale":"2023-10-09T06:55:06.958234+0000","last_undegraded":"2023-10-09T06:55:06.958234+0000","last_fullsized":"2023-10-09T06:55:06.958234+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:17.429884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.949612+0000","last_change":"2023-10-09T06:55:05.941482+0000","last_active":"2023-10-09T06:55:06.949612+0000","last_peered":"2023-10-09T06:55:06.949612+0000","last_clean":"2023-10-09T06:55:06.949612+0000","last_became_active":"2023-10-09T06:55:05.941132+0000","last_became_peered":"2023-10-09T06:55:05.941132+0000","last_unstale":"2023-10-09T06:55:06.949612+0000","last_undegraded":"2023-10-09T06:55:06.949612+0000","last_fullsized":"2023-10-09T06:55:06.949612+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:47.392667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.944422+0000","last_change":"2023-10-09T06:55:06.934503+0000","last_active":"2023-10-09T06:55:06.944422+0000","last_peered":"2023-10-09T06:55:06.944422+0000","last_clean":"2023-10-09T06:55:06.944422+0000","last_became_active":"2023-10-09T06:55:06.934249+0000","last_became_peered":"2023-10-09T06:55:06.934249+0000","last_unstale":"2023-10-09T06:55:06.944422+0000","last_undegraded":"2023-10-09T06:55:06.944422+0000","last_fullsized":"2023-10-09T06:55:06.944422+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:04.244093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.929902+0000","last_change":"2023-10-09T06:55:05.931993+0000","last_active":"2023-10-09T06:55:06.929902+0000","last_peered":"2023-10-09T06:55:06.929902+0000","last_clean":"2023-10-09T06:55:06.929902+0000","last_became_active":"2023-10-09T06:55:05.931747+0000","last_became_peered":"2023-10-09T06:55:05.931747+0000","last_unstale":"2023-10-09T06:55:06.929902+0000","last_undegraded":"2023-10-09T06:55:06.929902+0000","last_fullsized":"2023-10-09T06:55:06.929902+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:49:48.304060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.928958+0000","last_change":"2023-10-09T06:55:06.926676+0000","last_active":"2023-10-09T06:55:06.928958+0000","last_peered":"2023-10-09T06:55:06.928958+0000","last_clean":"2023-10-09T06:55:06.928958+0000","last_became_active":"2023-10-09T06:55:06.926433+0000","last_became_peered":"2023-10-09T06:55:06.926433+0000","last_unstale":"2023-10-09T06:55:06.928958+0000","last_undegraded":"2023-10-09T06:55:06.928958+0000","last_fullsized":"2023-10-09T06:55:06.928958+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:26:52.867345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.923136+0000","last_change":"2023-10-09T06:55:05.935304+0000","last_active":"2023-10-09T06:55:06.923136+0000","last_peered":"2023-10-09T06:55:06.923136+0000","last_clean":"2023-10-09T06:55:06.923136+0000","last_became_active":"2023-10-09T06:55:05.935055+0000","last_became_peered":"2023-10-09T06:55:05.935055+0000","last_unstale":"2023-10-09T06:55:06.923136+0000","last_undegraded":"2023-10-09T06:55:06.923136+0000","last_fullsized":"2023-10-09T06:55:06.923136+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:16:25.613767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954291+0000","last_change":"2023-10-09T06:55:06.953060+0000","last_active":"2023-10-09T06:55:06.954291+0000","last_peered":"2023-10-09T06:55:06.954291+0000","last_clean":"2023-10-09T06:55:06.954291+0000","last_became_active":"2023-10-09T06:55:06.952769+0000","last_became_peered":"2023-10-09T06:55:06.952769+0000","last_unstale":"2023-10-09T06:55:06.954291+0000","last_undegraded":"2023-10-09T06:55:06.954291+0000","last_fullsized":"2023-10-09T06:55:06.954291+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:12:43.264714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"61'8","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955749+0000","last_change":"2023-10-09T06:55:05.939559+0000","last_active":"2023-10-09T06:55:06.955749+0000","last_peered":"2023-10-09T06:55:06.955749+0000","last_clean":"2023-10-09T06:55:06.955749+0000","last_became_active":"2023-10-09T06:55:05.939250+0000","last_became_peered":"2023-10-09T06:55:05.939250+0000","last_unstale":"2023-10-09T06:55:06.955749+0000","last_undegraded":"2023-10-09T06:55:06.955749+0000","last_fullsized":"2023-10-09T06:55:06.955749+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:57.104240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.943570+0000","last_change":"2023-10-09T06:55:06.940395+0000","last_active":"2023-10-09T06:55:06.943570+0000","last_peered":"2023-10-09T06:55:06.943570+0000","last_clean":"2023-10-09T06:55:06.943570+0000","last_became_active":"2023-10-09T06:55:06.940110+0000","last_became_peered":"2023-10-09T06:55:06.940110+0000","last_unstale":"2023-10-09T06:55:06.943570+0000","last_undegraded":"2023-10-09T06:55:06.943570+0000","last_fullsized":"2023-10-09T06:55:06.943570+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:11.042189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.947490+0000","last_change":"2023-10-09T06:55:05.932965+0000","last_active":"2023-10-09T06:55:06.947490+0000","last_peered":"2023-10-09T06:55:06.947490+0000","last_clean":"2023-10-09T06:55:06.947490+0000","last_became_active":"2023-10-09T06:55:05.932676+0000","last_became_peered":"2023-10-09T06:55:05.932676+0000","last_unstale":"2023-10-09T06:55:06.947490+0000","last_undegraded":"2023-10-09T06:55:06.947490+0000","last_fullsized":"2023-10-09T06:55:06.947490+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:03:56.177535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948676+0000","last_change":"2023-10-09T06:55:06.944157+0000","last_active":"2023-10-09T06:55:06.948676+0000","last_peered":"2023-10-09T06:55:06.948676+0000","last_clean":"2023-10-09T06:55:06.948676+0000","last_became_active":"2023-10-09T06:55:06.943866+0000","last_became_peered":"2023-10-09T06:55:06.943866+0000","last_unstale":"2023-10-09T06:55:06.948676+0000","last_undegraded":"2023-10-09T06:55:06.948676+0000","last_fullsized":"2023-10-09T06:55:06.948676+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:12.040675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:04.900841+0000","last_change":"2023-10-09T06:55:04.900841+0000","last_active":"2023-10-09T06:55:04.900841+0000","last_peered":"2023-10-09T06:55:04.900841+0000","last_clean":"2023-10-09T06:55:04.900841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:04.900841+0000","last_undegraded":"2023-10-09T06:55:04.900841+0000","last_fullsized":"2023-10-09T06:55:04.900841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:04.900841+0000","last_change":"2023-10-09T06:55:04.900841+0000","last_active":"2023-10-09T06:55:04.900841+0000","last_peered":"2023-10-09T06:55:04.900841+0000","last_clean":"2023-10-09T06:55:04.900841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:04.900841+0000","last_undegraded":"2023-10-09T06:55:04.900841+0000","last_fullsized":"2023-10-09T06:55:04.900841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.925347+0000","last_change":"2023-10-09T06:55:05.933315+0000","last_active":"2023-10-09T06:55:06.925347+0000","last_peered":"2023-10-09T06:55:06.925347+0000","last_clean":"2023-10-09T06:55:06.925347+0000","last_became_active":"2023-10-09T06:55:05.933044+0000","last_became_peered":"2023-10-09T06:55:05.933044+0000","last_unstale":"2023-10-09T06:55:06.925347+0000","last_undegraded":"2023-10-09T06:55:06.925347+0000","last_fullsized":"2023-10-09T06:55:06.925347+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:51.403402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.941236+0000","last_change":"2023-10-09T06:55:06.935138+0000","last_active":"2023-10-09T06:55:06.941236+0000","last_peered":"2023-10-09T06:55:06.941236+0000","last_clean":"2023-10-09T06:55:06.941236+0000","last_became_active":"2023-10-09T06:55:06.934886+0000","last_became_peered":"2023-10-09T06:55:06.934886+0000","last_unstale":"2023-10-09T06:55:06.941236+0000","last_undegraded":"2023-10-09T06:55:06.941236+0000","last_fullsized":"2023-10-09T06:55:06.941236+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:28.982187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953731+0000","last_change":"2023-10-09T06:55:05.930744+0000","last_active":"2023-10-09T06:55:06.953731+0000","last_peered":"2023-10-09T06:55:06.953731+0000","last_clean":"2023-10-09T06:55:06.953731+0000","last_became_active":"2023-10-09T06:55:05.930460+0000","last_became_peered":"2023-10-09T06:55:05.930460+0000","last_unstale":"2023-10-09T06:55:06.953731+0000","last_undegraded":"2023-10-09T06:55:06.953731+0000","last_fullsized":"2023-10-09T06:55:06.953731+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:18:05.242002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954278+0000","last_change":"2023-10-09T06:55:06.951304+0000","last_active":"2023-10-09T06:55:06.954278+0000","last_peered":"2023-10-09T06:55:06.954278+0000","last_clean":"2023-10-09T06:55:06.954278+0000","last_became_active":"2023-10-09T06:55:06.950931+0000","last_became_peered":"2023-10-09T06:55:06.950931+0000","last_unstale":"2023-10-09T06:55:06.954278+0000","last_undegraded":"2023-10-09T06:55:06.954278+0000","last_fullsized":"2023-10-09T06:55:06.954278+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:17.846967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:04.900841+0000","last_change":"2023-10-09T06:55:04.900841+0000","last_active":"2023-10-09T06:55:04.900841+0000","last_peered":"2023-10-09T06:55:04.900841+0000","last_clean":"2023-10-09T06:55:04.900841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:04.900841+0000","last_undegraded":"2023-10-09T06:55:04.900841+0000","last_fullsized":"2023-10-09T06:55:04.900841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.936298+0000","last_change":"2023-10-09T06:55:06.933965+0000","last_active":"2023-10-09T06:55:06.936298+0000","last_peered":"2023-10-09T06:55:06.936298+0000","last_clean":"2023-10-09T06:55:06.936298+0000","last_became_active":"2023-10-09T06:55:06.933697+0000","last_became_peered":"2023-10-09T06:55:06.933697+0000","last_unstale":"2023-10-09T06:55:06.936298+0000","last_undegraded":"2023-10-09T06:55:06.936298+0000","last_fullsized":"2023-10-09T06:55:06.936298+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:52.068938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.932376+0000","last_change":"2023-10-09T06:55:05.939438+0000","last_active":"2023-10-09T06:55:06.932376+0000","last_peered":"2023-10-09T06:55:06.932376+0000","last_clean":"2023-10-09T06:55:06.932376+0000","last_became_active":"2023-10-09T06:55:05.939179+0000","last_became_peered":"2023-10-09T06:55:05.939179+0000","last_unstale":"2023-10-09T06:55:06.932376+0000","last_undegraded":"2023-10-09T06:55:06.932376+0000","last_fullsized":"2023-10-09T06:55:06.932376+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:21.552564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.944385+0000","last_change":"2023-10-09T06:55:06.941903+0000","last_active":"2023-10-09T06:55:06.944385+0000","last_peered":"2023-10-09T06:55:06.944385+0000","last_clean":"2023-10-09T06:55:06.944385+0000","last_became_active":"2023-10-09T06:55:06.941654+0000","last_became_peered":"2023-10-09T06:55:06.941654+0000","last_unstale":"2023-10-09T06:55:06.944385+0000","last_undegraded":"2023-10-09T06:55:06.944385+0000","last_fullsized":"2023-10-09T06:55:06.944385+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:36.964322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.929584+0000","last_change":"2023-10-09T06:55:05.937191+0000","last_active":"2023-10-09T06:55:06.929584+0000","last_peered":"2023-10-09T06:55:06.929584+0000","last_clean":"2023-10-09T06:55:06.929584+0000","last_became_active":"2023-10-09T06:55:05.936808+0000","last_became_peered":"2023-10-09T06:55:05.936808+0000","last_unstale":"2023-10-09T06:55:06.929584+0000","last_undegraded":"2023-10-09T06:55:06.929584+0000","last_fullsized":"2023-10-09T06:55:06.929584+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:57.104240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.926093+0000","last_change":"2023-10-09T06:55:05.930677+0000","last_active":"2023-10-09T06:55:06.926093+0000","last_peered":"2023-10-09T06:55:06.926093+0000","last_clean":"2023-10-09T06:55:06.926093+0000","last_became_active":"2023-10-09T06:55:05.930333+0000","last_became_peered":"2023-10-09T06:55:05.930333+0000","last_unstale":"2023-10-09T06:55:06.926093+0000","last_undegraded":"2023-10-09T06:55:06.926093+0000","last_fullsized":"2023-10-09T06:55:06.926093+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:12:42.258017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948591+0000","last_change":"2023-10-09T06:55:06.944396+0000","last_active":"2023-10-09T06:55:06.948591+0000","last_peered":"2023-10-09T06:55:06.948591+0000","last_clean":"2023-10-09T06:55:06.948591+0000","last_became_active":"2023-10-09T06:55:06.944150+0000","last_became_peered":"2023-10-09T06:55:06.944150+0000","last_unstale":"2023-10-09T06:55:06.948591+0000","last_undegraded":"2023-10-09T06:55:06.948591+0000","last_fullsized":"2023-10-09T06:55:06.948591+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:01.783980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.931050+0000","last_change":"2023-10-09T06:55:05.938596+0000","last_active":"2023-10-09T06:55:06.931050+0000","last_peered":"2023-10-09T06:55:06.931050+0000","last_clean":"2023-10-09T06:55:06.931050+0000","last_became_active":"2023-10-09T06:55:05.938360+0000","last_became_peered":"2023-10-09T06:55:05.938360+0000","last_unstale":"2023-10-09T06:55:06.931050+0000","last_undegraded":"2023-10-09T06:55:06.931050+0000","last_fullsized":"2023-10-09T06:55:06.931050+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:48:20.803864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953115+0000","last_change":"2023-10-09T06:55:06.942255+0000","last_active":"2023-10-09T06:55:06.953115+0000","last_peered":"2023-10-09T06:55:06.953115+0000","last_clean":"2023-10-09T06:55:06.953115+0000","last_became_active":"2023-10-09T06:55:06.941345+0000","last_became_peered":"2023-10-09T06:55:06.941345+0000","last_unstale":"2023-10-09T06:55:06.953115+0000","last_undegraded":"2023-10-09T06:55:06.953115+0000","last_fullsized":"2023-10-09T06:55:06.953115+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:16:26.620465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.929937+0000","last_change":"2023-10-09T06:55:05.935598+0000","last_active":"2023-10-09T06:55:06.929937+0000","last_peered":"2023-10-09T06:55:06.929937+0000","last_clean":"2023-10-09T06:55:06.929937+0000","last_became_active":"2023-10-09T06:55:05.935350+0000","last_became_peered":"2023-10-09T06:55:05.935350+0000","last_unstale":"2023-10-09T06:55:06.929937+0000","last_undegraded":"2023-10-09T06:55:06.929937+0000","last_fullsized":"2023-10-09T06:55:06.929937+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:25.646016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.941254+0000","last_change":"2023-10-09T06:55:06.935866+0000","last_active":"2023-10-09T06:55:06.941254+0000","last_peered":"2023-10-09T06:55:06.941254+0000","last_clean":"2023-10-09T06:55:06.941254+0000","last_became_active":"2023-10-09T06:55:06.935633+0000","last_became_peered":"2023-10-09T06:55:06.935633+0000","last_unstale":"2023-10-09T06:55:06.941254+0000","last_undegraded":"2023-10-09T06:55:06.941254+0000","last_fullsized":"2023-10-09T06:55:06.941254+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:29:45.885127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.930431+0000","last_change":"2023-10-09T06:55:05.935761+0000","last_active":"2023-10-09T06:55:06.930431+0000","last_peered":"2023-10-09T06:55:06.930431+0000","last_clean":"2023-10-09T06:55:06.930431+0000","last_became_active":"2023-10-09T06:55:05.935464+0000","last_became_peered":"2023-10-09T06:55:05.935464+0000","last_unstale":"2023-10-09T06:55:06.930431+0000","last_undegraded":"2023-10-09T06:55:06.930431+0000","last_fullsized":"2023-10-09T06:55:06.930431+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:16.840270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.932428+0000","last_change":"2023-10-09T06:55:06.927262+0000","last_active":"2023-10-09T06:55:06.932428+0000","last_peered":"2023-10-09T06:55:06.932428+0000","last_clean":"2023-10-09T06:55:06.932428+0000","last_became_active":"2023-10-09T06:55:06.926992+0000","last_became_peered":"2023-10-09T06:55:06.926992+0000","last_unstale":"2023-10-09T06:55:06.932428+0000","last_undegraded":"2023-10-09T06:55:06.932428+0000","last_fullsized":"2023-10-09T06:55:06.932428+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:12.040675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:04.900841+0000","last_change":"2023-10-09T06:55:04.900841+0000","last_active":"2023-10-09T06:55:04.900841+0000","last_peered":"2023-10-09T06:55:04.900841+0000","last_clean":"2023-10-09T06:55:04.900841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:04.900841+0000","last_undegraded":"2023-10-09T06:55:04.900841+0000","last_fullsized":"2023-10-09T06:55:04.900841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.930275+0000","last_change":"2023-10-09T06:55:05.936971+0000","last_active":"2023-10-09T06:55:06.930275+0000","last_peered":"2023-10-09T06:55:06.930275+0000","last_clean":"2023-10-09T06:55:06.930275+0000","last_became_active":"2023-10-09T06:55:05.936678+0000","last_became_peered":"2023-10-09T06:55:05.936678+0000","last_unstale":"2023-10-09T06:55:06.930275+0000","last_undegraded":"2023-10-09T06:55:06.930275+0000","last_fullsized":"2023-10-09T06:55:06.930275+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:18.853661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:05.907539+0000","last_change":"2023-10-09T06:55:05.907539+0000","last_active":"2023-10-09T06:55:05.907539+0000","last_peered":"2023-10-09T06:55:05.907539+0000","last_clean":"2023-10-09T06:55:05.907539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:05.907539+0000","last_undegraded":"2023-10-09T06:55:05.907539+0000","last_fullsized":"2023-10-09T06:55:05.907539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.923395+0000","last_change":"2023-10-09T06:55:05.938714+0000","last_active":"2023-10-09T06:55:06.923395+0000","last_peered":"2023-10-09T06:55:06.923395+0000","last_clean":"2023-10-09T06:55:06.923395+0000","last_became_active":"2023-10-09T06:55:05.936627+0000","last_became_peered":"2023-10-09T06:55:05.936627+0000","last_unstale":"2023-10-09T06:55:06.923395+0000","last_undegraded":"2023-10-09T06:55:06.923395+0000","last_fullsized":"2023-10-09T06:55:06.923395+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:16.840270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.943755+0000","last_change":"2023-10-09T06:55:06.941611+0000","last_active":"2023-10-09T06:55:06.943755+0000","last_peered":"2023-10-09T06:55:06.943755+0000","last_clean":"2023-10-09T06:55:06.943755+0000","last_became_active":"2023-10-09T06:55:06.941376+0000","last_became_peered":"2023-10-09T06:55:06.941376+0000","last_unstale":"2023-10-09T06:55:06.943755+0000","last_undegraded":"2023-10-09T06:55:06.943755+0000","last_fullsized":"2023-10-09T06:55:06.943755+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:28.056882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:55:04.900841+0000","last_change":"2023-10-09T06:55:04.900841+0000","last_active":"2023-10-09T06:55:04.900841+0000","last_peered":"2023-10-09T06:55:04.900841+0000","last_clean":"2023-10-09T06:55:04.900841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:55:04.900841+0000","last_undegraded":"2023-10-09T06:55:04.900841+0000","last_fullsized":"2023-10-09T06:55:04.900841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"52'139","reported_seq":278,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.929711+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:55:06.929711+0000","last_peered":"2023-10-09T06:55:06.929711+0000","last_clean":"2023-10-09T06:55:06.929711+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:55:06.929711+0000","last_undegraded":"2023-10-09T06:55:06.929711+0000","last_fullsized":"2023-10-09T06:55:06.929711+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":76,"acting":76,"num_store_stats":5},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2236,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":46,"acting":46,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575003,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":936574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71899999999999997,"15min":0.71699999999999997},"min":{"1min":0.36299999999999999,"5min":0.316,"15min":0.316},"max":{"1min":1.732,"5min":1.732,"15min":1.9490000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73199999999999998,"15min":0.75},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.29999999999999999},"max":{"1min":0.94399999999999995,"5min":1.0169999999999999,"15min":3.448},"last":0.85999999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72199999999999998,"15min":0.77500000000000002},"min":{"1min":0.437,"5min":0.379,"15min":0.379},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":5.617},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.753},"min":{"1min":0.45800000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":2.016},"last":0.68400000000000005}]},{"osd":2,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.74099999999999999,"15min":0.752},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44800000000000001},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":2.052},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76900000000000002,"15min":0.79200000000000004},"min":{"1min":0.48299999999999998,"5min":0.45200000000000001,"15min":0.44700000000000001},"max":{"1min":2.6629999999999998,"5min":2.6629999999999998,"15min":3.5019999999999998},"last":0.69799999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71799999999999997,"15min":0.79300000000000004},"min":{"1min":0.498,"5min":0.45600000000000002,"15min":0.45000000000000001},"max":{"1min":0.85199999999999998,"5min":1.0409999999999999,"15min":5.5800000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.84999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.47099999999999997},"max":{"1min":1.827,"5min":1.827,"15min":6.9299999999999997},"last":0.61399999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.60099999999999998,"15min":0.64800000000000002},"min":{"1min":0.47299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89900000000000002,"5min":0.90400000000000003,"15min":3.125},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.64900000000000002,"15min":0.71399999999999997},"min":{"1min":0.42199999999999999,"5min":0.41999999999999998,"15min":0.40500000000000003},"max":{"1min":2.577,"5min":2.577,"15min":4.8380000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.67300000000000004,"15min":0.72899999999999998},"min":{"1min":0.438,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":4.1929999999999996},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.71199999999999997,"15min":0.76700000000000002},"min":{"1min":0.52900000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.9590000000000001,"5min":2.9590000000000001,"15min":3.6749999999999998},"last":0.82299999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.753,"15min":0.81799999999999995},"min":{"1min":0.58099999999999996,"5min":0.53300000000000003,"15min":0.49199999999999999},"max":{"1min":3.0019999999999998,"5min":3.0019999999999998,"15min":4.0250000000000004},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.73199999999999998,"15min":0.83199999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.44700000000000001},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":7.0259999999999998},"last":0.79600000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575001,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302056,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069784,"statfs":{"total":96636764160,"available":96327458816,"internally_reserved":0,"allocated":688128,"data_stored":319549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.71799999999999997,"15min":0.70599999999999996},"min":{"1min":0.48099999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81999999999999995,"5min":0.97899999999999998,"15min":1.022},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.72099999999999997,"15min":0.69299999999999995},"min":{"1min":0.47499999999999998,"5min":0.41999999999999998,"15min":0.36599999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.079},"last":0.629}]},{"osd":1,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.73099999999999998,"15min":0.71599999999999997},"min":{"1min":0.45500000000000002,"5min":0.44800000000000001,"15min":0.42799999999999999},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.72299999999999998,"15min":0.71799999999999997},"min":{"1min":0.501,"5min":0.48299999999999998,"15min":0.438},"max":{"1min":0.84999999999999998,"5min":1.0109999999999999,"15min":1.034},"last":0.55300000000000005}]},{"osd":2,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.42599999999999999},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.45200000000000001},"max":{"1min":0.79200000000000004,"5min":0.96699999999999997,"15min":1.0900000000000001},"last":0.59499999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.71299999999999997,"15min":0.69199999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.89800000000000002,"5min":0.91700000000000004,"15min":1.046},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77000000000000002,"15min":0.753},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.497},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.73299999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63,"15min":0.63700000000000001},"min":{"1min":0.41299999999999998,"5min":0.38,"15min":0.377},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.501},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.626},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.51800000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64600000000000002,"15min":0.65800000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68600000000000005,"15min":0.70199999999999996},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.42299999999999999},"max":{"1min":0.84099999999999997,"5min":1.012,"15min":1.0669999999999999},"last":0.71199999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68200000000000005,"15min":0.68600000000000005},"min":{"1min":0.47299999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.72499999999999998,"15min":0.73199999999999998},"min":{"1min":0.44600000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.76300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":346186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46000000000000002,"15min":0.45600000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56999999999999995,"5min":0.90300000000000002,"15min":1.2729999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48799999999999999,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.311,"15min":0.23699999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.91200000000000003},"last":0.44500000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.498,"15min":0.48599999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.29599999999999999},"max":{"1min":0.64900000000000002,"5min":0.67800000000000005,"15min":0.91900000000000004},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57799999999999996,"15min":0.56699999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77900000000000003,"5min":0.83999999999999997,"15min":1.3340000000000001},"last":0.48199999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.622,"15min":0.59899999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.34100000000000003},"max":{"1min":0.73699999999999999,"5min":0.89500000000000002,"15min":1.365},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.34100000000000003},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.63300000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.78400000000000003,"15min":0.77200000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.995,"5min":1.0529999999999999,"15min":1.234},"last":0.66000000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79200000000000004,"15min":0.77200000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0309999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.78600000000000003,"15min":0.77600000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.47999999999999998},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.69099999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.80500000000000005,"15min":0.79000000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.3029999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.80400000000000005,"15min":0.79200000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0980000000000001,"5min":1.222,"15min":1.222},"last":0.69999999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.83599999999999997,"15min":0.82599999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.53500000000000003},"max":{"1min":1.129,"5min":1.129,"15min":1.4510000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.82999999999999996,"15min":0.81899999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.115,"5min":1.179,"15min":1.1970000000000001},"last":0.76600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575002,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":1335296,"data_stored":936518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47499999999999998,"15min":0.47099999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.23000000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":1.2729999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.56699999999999995,"15min":0.53300000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.28899999999999998},"max":{"1min":4.5819999999999999,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":0.45100000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.58799999999999997,"15min":0.55600000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":4.6980000000000004,"5min":4.6980000000000004,"15min":4.6980000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.51500000000000001,"15min":0.48999999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.55100000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.7130000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.63500000000000001,"15min":0.61799999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":4.734,"5min":4.734,"15min":4.734},"last":0.495}]},{"osd":4,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.78300000000000003,"15min":0.77500000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.103,"5min":1.218,"15min":1.752},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.82399999999999995,"15min":0.80800000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":4.6619999999999999,"5min":4.6619999999999999,"15min":4.6619999999999999},"last":0.75800000000000001}]},{"osd":5,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.2769999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.80100000000000005,"15min":0.80700000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0840000000000001,"5min":1.2809999999999999,"15min":1.7889999999999999},"last":0.88400000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.83399999999999996,"15min":0.82599999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.50900000000000001},"max":{"1min":4.6239999999999997,"5min":4.6239999999999997,"15min":4.6239999999999997},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.80600000000000005,"15min":0.81200000000000006},"min":{"1min":0.50800000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.228,"5min":1.2689999999999999,"15min":1.4370000000000001},"last":0.74399999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.83499999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.256,"5min":1.256,"15min":1.518},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.85599999999999998,"15min":0.85999999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.702,"5min":1.702,"15min":1.8200000000000001},"last":0.82199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575002,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306216,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065624,"statfs":{"total":96636764160,"available":96323198976,"internally_reserved":0,"allocated":753664,"data_stored":347674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.46000000000000002,"15min":0.45800000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.25900000000000001},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.498,"15min":0.499},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.484},"last":0.56200000000000006}]},{"osd":1,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.47899999999999998,"15min":0.496},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.623,"5min":0.80700000000000005,"15min":1.865},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.50800000000000001,"15min":0.52600000000000002},"min":{"1min":0.36199999999999999,"5min":0.33700000000000002,"15min":0.32200000000000001},"max":{"1min":0.66500000000000004,"5min":0.747,"15min":1.79},"last":0.65700000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.41699999999999998,"5min":0.38600000000000001,"15min":0.35799999999999998},"max":{"1min":0.84499999999999997,"5min":0.87,"15min":1.8999999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.38500000000000001},"max":{"1min":0.84799999999999998,"5min":0.85199999999999998,"15min":1.8220000000000001},"last":0.61799999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.77900000000000003,"15min":0.754},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.42899999999999999},"max":{"1min":1.1799999999999999,"5min":1.256,"15min":1.256},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.77800000000000002,"15min":0.77400000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.44800000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.63}]},{"osd":5,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78800000000000003,"15min":0.76900000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.79100000000000004,"15min":0.77300000000000002},"min":{"1min":0.58299999999999996,"5min":0.57199999999999995,"15min":0.503},"max":{"1min":0.98799999999999999,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.69499999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.79900000000000004,"15min":0.78800000000000003},"min":{"1min":0.55100000000000005,"5min":0.54900000000000004,"15min":0.48599999999999999},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.81200000000000006,"15min":0.79800000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.5309999999999999},"last":0.71099999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.82399999999999995,"15min":0.80800000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.84399999999999997,"15min":0.82399999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.50900000000000001},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.81799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575003,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302116,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069724,"statfs":{"total":96636764160,"available":96327397376,"internally_reserved":0,"allocated":749568,"data_stored":346726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47599999999999998,"15min":0.45900000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.24099999999999999},"max":{"1min":0.81200000000000006,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50900000000000001,"15min":0.47799999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.28100000000000003},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.42899999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.499,"15min":0.47899999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.55700000000000005,"15min":0.53400000000000003},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.67800000000000005,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52900000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59599999999999997,"15min":0.57099999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.38500000000000001},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.64600000000000002,"15min":0.61899999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":3.8900000000000001,"5min":3.8900000000000001,"15min":3.8900000000000001},"last":0.59799999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76100000000000001,"15min":0.74299999999999999},"min":{"1min":0.48299999999999998,"5min":0.47199999999999998,"15min":0.40799999999999997},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.83999999999999997,"15min":0.81599999999999995},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.52200000000000002},"max":{"1min":1.081,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.77800000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.76900000000000002,"15min":0.749},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96999999999999997,"5min":1.091,"15min":2.1549999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.81599999999999995,"15min":0.79600000000000004},"min":{"1min":0.58199999999999996,"5min":0.56499999999999995,"15min":0.50600000000000001},"max":{"1min":0.97299999999999998,"5min":1.0800000000000001,"15min":1.419},"last":0.68799999999999994}]},{"osd":6,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.79700000000000004,"15min":0.77500000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.51700000000000002},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.81200000000000006,"15min":0.77500000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.51500000000000001},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.83599999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.84799999999999998,"15min":0.82499999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.55500000000000005},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":2.0880000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.84699999999999998,"15min":0.82699999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.56499999999999995},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.71599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575001,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306152,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065688,"statfs":{"total":96636764160,"available":96323264512,"internally_reserved":0,"allocated":688128,"data_stored":319549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73699999999999999,"15min":0.69499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35499999999999998},"max":{"1min":3.1139999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.73599999999999999,"15min":0.70899999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.39300000000000002},"max":{"1min":2.8130000000000002,"5min":2.8130000000000002,"15min":3.23},"last":0.68700000000000006}]},{"osd":1,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73199999999999998,"15min":0.70099999999999996},"min":{"1min":0.46999999999999997,"5min":0.45800000000000002,"15min":0.373},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.78200000000000003,"15min":0.74199999999999999},"min":{"1min":0.46300000000000002,"5min":0.45100000000000001,"15min":0.40500000000000003},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.75800000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78100000000000003,"15min":0.754},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.38100000000000001},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":3.7509999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.80100000000000005,"15min":0.77900000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":0.85099999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76400000000000001,"15min":0.751},"min":{"1min":0.51000000000000001,"5min":0.434,"15min":0.434},"max":{"1min":2.6440000000000001,"5min":2.6440000000000001,"15min":3.6970000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.78900000000000003,"15min":0.73799999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.6899999999999999,"5min":3.6899999999999999,"15min":3.6899999999999999},"last":0.71199999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":3.3860000000000001,"5min":3.3860000000000001,"15min":3.4780000000000002},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.68799999999999994,"15min":0.68000000000000005},"min":{"1min":0.39100000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.79100000000000004}]},{"osd":6,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.67000000000000004,"15min":0.66700000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":3.5270000000000001,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.374},"max":{"1min":3.4740000000000002,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.85899999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.7210000000000001,"5min":2.7210000000000001,"15min":3.2789999999999999},"last":0.87},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":3.7280000000000002,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.95499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575002,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302056,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069784,"statfs":{"total":96636764160,"available":96327458816,"internally_reserved":0,"allocated":688128,"data_stored":319549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.69299999999999995,"15min":0.70199999999999996},"min":{"1min":0.39800000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.91600000000000004,"15min":1.655},"last":0.438},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.68500000000000005,"15min":0.68999999999999995},"min":{"1min":0.34499999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79800000000000004,"5min":0.99099999999999999,"15min":1.1359999999999999},"last":0.60399999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.66800000000000004,"15min":0.71599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79500000000000004,"5min":1.034,"15min":2.4159999999999999},"last":0.499},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.71199999999999997,"15min":0.73099999999999998},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81699999999999995,"5min":1.0229999999999999,"15min":1.706},"last":0.755}]},{"osd":2,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.72099999999999997,"15min":0.74299999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.42999999999999999},"max":{"1min":0.79900000000000004,"5min":0.97499999999999998,"15min":1.79},"last":0.63},{"interface":"front","average":{"1min":0.626,"5min":0.69599999999999995,"15min":0.73399999999999999},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.442},"max":{"1min":0.80300000000000005,"5min":1.004,"15min":2.4889999999999999},"last":0.59499999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.69699999999999995,"15min":0.72699999999999998},"min":{"1min":0.503,"5min":0.435,"15min":0.435},"max":{"1min":0.84299999999999997,"5min":0.95499999999999996,"15min":1.409},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.75800000000000001,"15min":0.79400000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.88600000000000001,"5min":1.0629999999999999,"15min":2.532},"last":0.73999999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59099999999999997,"15min":0.63600000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84799999999999998,"5min":0.91300000000000003,"15min":1.766},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.65500000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.35799999999999998},"max":{"1min":0.86199999999999999,"5min":0.98199999999999998,"15min":2.7829999999999999},"last":0.77200000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.628,"15min":0.67300000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.93000000000000005,"5min":0.97699999999999998,"15min":2.5739999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.67100000000000004,"15min":0.69899999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.38900000000000001},"max":{"1min":0.86899999999999999,"5min":0.95299999999999996,"15min":1.8080000000000001},"last":0.79600000000000004}]},{"osd":7,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67800000000000005,"15min":0.72499999999999998},"min":{"1min":0.48599999999999999,"5min":0.45500000000000002,"15min":0.436},"max":{"1min":0.91500000000000004,"5min":0.94499999999999995,"15min":2.9609999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75,"15min":0.80400000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.45900000000000002},"max":{"1min":0.96699999999999997,"5min":0.998,"15min":2.613},"last":0.78900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:55:11.697 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:55:11.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.911+0000 7f40b35ff700 1 Processor -- start 2023-10-09T06:55:11.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.911+0000 7f40b35ff700 1 -- start start 2023-10-09T06:55:11.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.912+0000 7f40b35ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f40ac155c10 0x7f40ac155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:11.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.912+0000 7f40b35ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40ac0acac0 con 0x7f40ac0ac6d0 2023-10-09T06:55:11.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.912+0000 7f40b35ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40ac0ad930 con 0x7f40ac0ac230 2023-10-09T06:55:11.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.912+0000 7f40b35ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ac0acd20 con 0x7f40ac155c10 2023-10-09T06:55:11.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.913+0000 7f40b139b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f40ac155c10 0x7f40ac155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:11.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.913+0000 7f40b1b9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f40ac0ac6d0 0x7f40ac0b0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48616/0 (socket says 172.21.15.71:48616) 2023-10-09T06:55:11.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.913+0000 7f40b1b9c700 1 -- 172.21.15.71:0/1216362322 learned_addr learned my addr 172.21.15.71:0/1216362322 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:55:11.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.913+0000 7f40b139b700 1 -- 172.21.15.71:0/1216362322 >> v1:172.21.15.179:6789/0 conn(0x7f40ac0ac230 legacy=0x7f40ac1568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:11.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.913+0000 7f40b139b700 1 -- 172.21.15.71:0/1216362322 >> v1:172.21.15.71:6789/0 conn(0x7f40ac0ac6d0 legacy=0x7f40ac0b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:11.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.913+0000 7f40b139b700 1 -- 172.21.15.71:0/1216362322 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac0ad000 con 0x7f40ac155c10 2023-10-09T06:55:11.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.913+0000 7f40a3fff700 1 -- 172.21.15.71:0/1216362322 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171524621 0 0) 0x7f40ac0acac0 con 0x7f40ac0ac6d0 2023-10-09T06:55:11.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.913+0000 7f40b139b700 1 --2- 172.21.15.71:0/1216362322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40ac155c10 0x7f40ac155fe0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f40a800bb90 tx=0x7f40a800b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d68d31da456c716 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:11.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.914+0000 7f40a3fff700 1 -- 172.21.15.71:0/1216362322 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a800dba0 con 0x7f40ac155c10 2023-10-09T06:55:11.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.914+0000 7f40a3fff700 1 -- 172.21.15.71:0/1216362322 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a800dd00 con 0x7f40ac155c10 2023-10-09T06:55:11.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.914+0000 7f40a3fff700 1 -- 172.21.15.71:0/1216362322 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a80196b0 con 0x7f40ac155c10 2023-10-09T06:55:11.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.914+0000 7f40b35ff700 1 -- 172.21.15.71:0/1216362322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40ac155c10 msgr2=0x7f40ac155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:11.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.914+0000 7f40b35ff700 1 --2- 172.21.15.71:0/1216362322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40ac155c10 0x7f40ac155fe0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f40a800bb90 tx=0x7f40a800b430 comp rx=0 tx=0).stop 2023-10-09T06:55:11.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.914+0000 7f40b35ff700 1 -- 172.21.15.71:0/1216362322 shutdown_connections 2023-10-09T06:55:11.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.914+0000 7f40b35ff700 1 --2- 172.21.15.71:0/1216362322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40ac155c10 0x7f40ac155fe0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:11.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.914+0000 7f40b35ff700 1 -- 172.21.15.71:0/1216362322 >> 172.21.15.71:0/1216362322 conn(0x7f40ac06a320 msgr2=0x7f40ac0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:11.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.914+0000 7f40b35ff700 1 -- 172.21.15.71:0/1216362322 shutdown_connections 2023-10-09T06:55:11.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.914+0000 7f40b35ff700 1 -- 172.21.15.71:0/1216362322 wait complete. 2023-10-09T06:55:11.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.916+0000 7f40b35ff700 1 Processor -- start 2023-10-09T06:55:11.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.916+0000 7f40b35ff700 1 -- start start 2023-10-09T06:55:11.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.917+0000 7f40b35ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40ac0ac230 0x7f40ac0ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:11.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.917+0000 7f40b35ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40ac0ac6d0 0x7f40ac0cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.917+0000 7f40b35ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40ac155c10 0x7f40ac165640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.917+0000 7f40b35ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac14fd80 con 0x7f40ac0ac6d0 2023-10-09T06:55:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.917+0000 7f40b35ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac1508c0 con 0x7f40ac155c10 2023-10-09T06:55:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.917+0000 7f40b35ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac14ff90 con 0x7f40ac0ac230 2023-10-09T06:55:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.917+0000 7f40b0b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40ac0ac6d0 0x7f40ac0cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.917+0000 7f40b0b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40ac0ac6d0 0x7f40ac0cb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39432/0 (socket says 172.21.15.71:39432) 2023-10-09T06:55:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.917+0000 7f40b0b9a700 1 -- 172.21.15.71:0/4051504768 learned_addr learned my addr 172.21.15.71:0/4051504768 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.917+0000 7f40b1b9c700 1 --2- 172.21.15.71:0/4051504768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40ac155c10 0x7f40ac165640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.917+0000 7f40b139b700 1 --2- 172.21.15.71:0/4051504768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40ac0ac230 0x7f40ac0ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.918+0000 7f40b0b9a700 1 -- 172.21.15.71:0/4051504768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40ac0ac230 msgr2=0x7f40ac0ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.918+0000 7f40b0b9a700 1 --2- 172.21.15.71:0/4051504768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40ac0ac230 0x7f40ac0ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.918+0000 7f40b0b9a700 1 -- 172.21.15.71:0/4051504768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40ac155c10 msgr2=0x7f40ac165640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.918+0000 7f40b0b9a700 1 --2- 172.21.15.71:0/4051504768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40ac155c10 0x7f40ac165640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.918+0000 7f40b0b9a700 1 -- 172.21.15.71:0/4051504768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a800b6d0 con 0x7f40ac0ac6d0 2023-10-09T06:55:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.918+0000 7f40b1b9c700 1 --2- 172.21.15.71:0/4051504768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40ac155c10 0x7f40ac165640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:55:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.918+0000 7f40b0b9a700 1 --2- 172.21.15.71:0/4051504768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40ac0ac6d0 0x7f40ac0cb580 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f409c00c590 tx=0x7f409c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.918+0000 7f40a17fa700 1 -- 172.21.15.71:0/4051504768 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c011590 con 0x7f40ac0ac6d0 2023-10-09T06:55:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.918+0000 7f40a17fa700 1 -- 172.21.15.71:0/4051504768 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409c0116f0 con 0x7f40ac0ac6d0 2023-10-09T06:55:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.918+0000 7f40b35ff700 1 -- 172.21.15.71:0/4051504768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ac150270 con 0x7f40ac0ac6d0 2023-10-09T06:55:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.918+0000 7f40a17fa700 1 -- 172.21.15.71:0/4051504768 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c011ab0 con 0x7f40ac0ac6d0 2023-10-09T06:55:11.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.918+0000 7f40b35ff700 1 -- 172.21.15.71:0/4051504768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ac0ca710 con 0x7f40ac0ac6d0 2023-10-09T06:55:11.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.919+0000 7f40b35ff700 1 -- 172.21.15.71:0/4051504768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ac150a50 con 0x7f40ac0ac6d0 2023-10-09T06:55:11.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.920+0000 7f40a17fa700 1 -- 172.21.15.71:0/4051504768 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f409c01b3b0 con 0x7f40ac0ac6d0 2023-10-09T06:55:11.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.921+0000 7f40a17fa700 1 --2- 172.21.15.71:0/4051504768 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4090066f30 0x7f40900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:11.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.921+0000 7f40a17fa700 1 -- 172.21.15.71:0/4051504768 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f409c083c00 con 0x7f40ac0ac6d0 2023-10-09T06:55:11.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.921+0000 7f40b139b700 1 --2- 172.21.15.71:0/4051504768 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4090066f30 0x7f40900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:11.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.922+0000 7f40b139b700 1 --2- 172.21.15.71:0/4051504768 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4090066f30 0x7f40900693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f40a800b2c0 tx=0x7f40a801b000 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:11.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:11.925+0000 7f40a17fa700 1 -- 172.21.15.71:0/4051504768 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f409c08a080 con 0x7f40ac0ac6d0 2023-10-09T06:55:12.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.113+0000 7f40b35ff700 1 -- 172.21.15.71:0/4051504768 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40ac04c3c0 con 0x7f4090066f30 2023-10-09T06:55:12.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.122+0000 7f40a17fa700 1 -- 172.21.15.71:0/4051504768 <== mgr.5015 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289166 (secure 0 0 0) 0x7f40ac04c3c0 con 0x7f4090066f30 2023-10-09T06:55:12.127 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:55:12.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.126+0000 7f40b35ff700 1 -- 172.21.15.71:0/4051504768 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4090066f30 msgr2=0x7f40900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:12.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.126+0000 7f40b35ff700 1 --2- 172.21.15.71:0/4051504768 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4090066f30 0x7f40900693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f40a800b2c0 tx=0x7f40a801b000 comp rx=0 tx=0).stop 2023-10-09T06:55:12.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.126+0000 7f40b35ff700 1 -- 172.21.15.71:0/4051504768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40ac0ac6d0 msgr2=0x7f40ac0cb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:12.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.126+0000 7f40b35ff700 1 --2- 172.21.15.71:0/4051504768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40ac0ac6d0 0x7f40ac0cb580 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f409c00c590 tx=0x7f409c00c950 comp rx=0 tx=0).stop 2023-10-09T06:55:12.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.126+0000 7f40b35ff700 1 -- 172.21.15.71:0/4051504768 shutdown_connections 2023-10-09T06:55:12.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.126+0000 7f40b35ff700 1 --2- 172.21.15.71:0/4051504768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40ac155c10 0x7f40ac165640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:12.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.126+0000 7f40b35ff700 1 --2- 172.21.15.71:0/4051504768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40ac0ac230 0x7f40ac0ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:12.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.126+0000 7f40b35ff700 1 --2- 172.21.15.71:0/4051504768 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4090066f30 0x7f40900693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:12.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.126+0000 7f40b35ff700 1 --2- 172.21.15.71:0/4051504768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40ac0ac6d0 0x7f40ac0cb580 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:12.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.126+0000 7f40b35ff700 1 -- 172.21.15.71:0/4051504768 >> 172.21.15.71:0/4051504768 conn(0x7f40ac06a320 msgr2=0x7f40ac06d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:12.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.126+0000 7f40b35ff700 1 -- 172.21.15.71:0/4051504768 shutdown_connections 2023-10-09T06:55:12.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.126+0000 7f40b35ff700 1 -- 172.21.15.71:0/4051504768 wait complete. 2023-10-09T06:55:12.130 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:55:12.145 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T06:55:11.873340+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":243,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":177,"ondisk_log_size":177,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2418056,"kb_used_data":6984,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752556664,"statfs":{"total":773094113280,"available":770618023936,"internally_reserved":0,"allocated":7151616,"data_stored":3954276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001411"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953251+0000","last_change":"2023-10-09T06:55:06.941941+0000","last_active":"2023-10-09T06:55:06.953251+0000","last_peered":"2023-10-09T06:55:06.953251+0000","last_clean":"2023-10-09T06:55:06.953251+0000","last_became_active":"2023-10-09T06:55:06.941652+0000","last_became_peered":"2023-10-09T06:55:06.941652+0000","last_unstale":"2023-10-09T06:55:06.953251+0000","last_undegraded":"2023-10-09T06:55:06.953251+0000","last_fullsized":"2023-10-09T06:55:06.953251+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:13.874146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.952191+0000","last_change":"2023-10-09T06:55:06.949443+0000","last_active":"2023-10-09T06:55:06.952191+0000","last_peered":"2023-10-09T06:55:06.952191+0000","last_clean":"2023-10-09T06:55:06.952191+0000","last_became_active":"2023-10-09T06:55:06.948195+0000","last_became_peered":"2023-10-09T06:55:06.948195+0000","last_unstale":"2023-10-09T06:55:06.952191+0000","last_undegraded":"2023-10-09T06:55:06.952191+0000","last_fullsized":"2023-10-09T06:55:06.952191+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:08.034847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.937992+0000","last_change":"2023-10-09T06:55:06.928307+0000","last_active":"2023-10-09T06:55:06.937992+0000","last_peered":"2023-10-09T06:55:06.937992+0000","last_clean":"2023-10-09T06:55:06.937992+0000","last_became_active":"2023-10-09T06:55:06.928024+0000","last_became_peered":"2023-10-09T06:55:06.928024+0000","last_unstale":"2023-10-09T06:55:06.937992+0000","last_undegraded":"2023-10-09T06:55:06.937992+0000","last_fullsized":"2023-10-09T06:55:06.937992+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:10:57.887526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.957583+0000","last_change":"2023-10-09T06:55:06.953644+0000","last_active":"2023-10-09T06:55:06.957583+0000","last_peered":"2023-10-09T06:55:06.957583+0000","last_clean":"2023-10-09T06:55:06.957583+0000","last_became_active":"2023-10-09T06:55:06.953144+0000","last_became_peered":"2023-10-09T06:55:06.953144+0000","last_unstale":"2023-10-09T06:55:06.957583+0000","last_undegraded":"2023-10-09T06:55:06.957583+0000","last_fullsized":"2023-10-09T06:55:06.957583+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:04.806773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.950648+0000","last_change":"2023-10-09T06:55:06.939943+0000","last_active":"2023-10-09T06:55:06.950648+0000","last_peered":"2023-10-09T06:55:06.950648+0000","last_clean":"2023-10-09T06:55:06.950648+0000","last_became_active":"2023-10-09T06:55:06.939675+0000","last_became_peered":"2023-10-09T06:55:06.939675+0000","last_unstale":"2023-10-09T06:55:06.950648+0000","last_undegraded":"2023-10-09T06:55:06.950648+0000","last_fullsized":"2023-10-09T06:55:06.950648+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:48.399364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.941216+0000","last_change":"2023-10-09T06:55:06.932908+0000","last_active":"2023-10-09T06:55:06.941216+0000","last_peered":"2023-10-09T06:55:06.941216+0000","last_clean":"2023-10-09T06:55:06.941216+0000","last_became_active":"2023-10-09T06:55:06.932692+0000","last_became_peered":"2023-10-09T06:55:06.932692+0000","last_unstale":"2023-10-09T06:55:06.941216+0000","last_undegraded":"2023-10-09T06:55:06.941216+0000","last_fullsized":"2023-10-09T06:55:06.941216+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:56:01.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.949558+0000","last_change":"2023-10-09T06:55:06.939597+0000","last_active":"2023-10-09T06:55:06.949558+0000","last_peered":"2023-10-09T06:55:06.949558+0000","last_clean":"2023-10-09T06:55:06.949558+0000","last_became_active":"2023-10-09T06:55:06.939344+0000","last_became_peered":"2023-10-09T06:55:06.939344+0000","last_unstale":"2023-10-09T06:55:06.949558+0000","last_undegraded":"2023-10-09T06:55:06.949558+0000","last_fullsized":"2023-10-09T06:55:06.949558+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:27.488161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953884+0000","last_change":"2023-10-09T06:55:06.952049+0000","last_active":"2023-10-09T06:55:06.953884+0000","last_peered":"2023-10-09T06:55:06.953884+0000","last_clean":"2023-10-09T06:55:06.953884+0000","last_became_active":"2023-10-09T06:55:06.951794+0000","last_became_peered":"2023-10-09T06:55:06.951794+0000","last_unstale":"2023-10-09T06:55:06.953884+0000","last_undegraded":"2023-10-09T06:55:06.953884+0000","last_fullsized":"2023-10-09T06:55:06.953884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:58:23.011522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.947762+0000","last_change":"2023-10-09T06:55:06.942297+0000","last_active":"2023-10-09T06:55:06.947762+0000","last_peered":"2023-10-09T06:55:06.947762+0000","last_clean":"2023-10-09T06:55:06.947762+0000","last_became_active":"2023-10-09T06:55:06.941997+0000","last_became_peered":"2023-10-09T06:55:06.941997+0000","last_unstale":"2023-10-09T06:55:06.947762+0000","last_undegraded":"2023-10-09T06:55:06.947762+0000","last_fullsized":"2023-10-09T06:55:06.947762+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:27.365626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.957594+0000","last_change":"2023-10-09T06:55:06.954659+0000","last_active":"2023-10-09T06:55:06.957594+0000","last_peered":"2023-10-09T06:55:06.957594+0000","last_clean":"2023-10-09T06:55:06.957594+0000","last_became_active":"2023-10-09T06:55:06.954424+0000","last_became_peered":"2023-10-09T06:55:06.954424+0000","last_unstale":"2023-10-09T06:55:06.957594+0000","last_undegraded":"2023-10-09T06:55:06.957594+0000","last_fullsized":"2023-10-09T06:55:06.957594+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:26:52.867345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.943599+0000","last_change":"2023-10-09T06:55:06.941384+0000","last_active":"2023-10-09T06:55:06.943599+0000","last_peered":"2023-10-09T06:55:06.943599+0000","last_clean":"2023-10-09T06:55:06.943599+0000","last_became_active":"2023-10-09T06:55:06.935944+0000","last_became_peered":"2023-10-09T06:55:06.935944+0000","last_unstale":"2023-10-09T06:55:06.943599+0000","last_undegraded":"2023-10-09T06:55:06.943599+0000","last_fullsized":"2023-10-09T06:55:06.943599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:48:10.713903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.940869+0000","last_change":"2023-10-09T06:55:06.936144+0000","last_active":"2023-10-09T06:55:06.940869+0000","last_peered":"2023-10-09T06:55:06.940869+0000","last_clean":"2023-10-09T06:55:06.940869+0000","last_became_active":"2023-10-09T06:55:06.935757+0000","last_became_peered":"2023-10-09T06:55:06.935757+0000","last_unstale":"2023-10-09T06:55:06.940869+0000","last_undegraded":"2023-10-09T06:55:06.940869+0000","last_fullsized":"2023-10-09T06:55:06.940869+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:18:06.248699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.934730+0000","last_change":"2023-10-09T06:55:06.929812+0000","last_active":"2023-10-09T06:55:06.934730+0000","last_peered":"2023-10-09T06:55:06.934730+0000","last_clean":"2023-10-09T06:55:06.934730+0000","last_became_active":"2023-10-09T06:55:06.929471+0000","last_became_peered":"2023-10-09T06:55:06.929471+0000","last_unstale":"2023-10-09T06:55:06.934730+0000","last_undegraded":"2023-10-09T06:55:06.934730+0000","last_fullsized":"2023-10-09T06:55:06.934730+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:44.668078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.943753+0000","last_change":"2023-10-09T06:55:06.940701+0000","last_active":"2023-10-09T06:55:06.943753+0000","last_peered":"2023-10-09T06:55:06.943753+0000","last_clean":"2023-10-09T06:55:06.943753+0000","last_became_active":"2023-10-09T06:55:06.935669+0000","last_became_peered":"2023-10-09T06:55:06.935669+0000","last_unstale":"2023-10-09T06:55:06.943753+0000","last_undegraded":"2023-10-09T06:55:06.943753+0000","last_fullsized":"2023-10-09T06:55:06.943753+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:27.310704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948019+0000","last_change":"2023-10-09T06:55:06.941609+0000","last_active":"2023-10-09T06:55:06.948019+0000","last_peered":"2023-10-09T06:55:06.948019+0000","last_clean":"2023-10-09T06:55:06.948019+0000","last_became_active":"2023-10-09T06:55:06.941358+0000","last_became_peered":"2023-10-09T06:55:06.941358+0000","last_unstale":"2023-10-09T06:55:06.948019+0000","last_undegraded":"2023-10-09T06:55:06.948019+0000","last_fullsized":"2023-10-09T06:55:06.948019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:44.434314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953937+0000","last_change":"2023-10-09T06:55:06.951154+0000","last_active":"2023-10-09T06:55:06.953937+0000","last_peered":"2023-10-09T06:55:06.953937+0000","last_clean":"2023-10-09T06:55:06.953937+0000","last_became_active":"2023-10-09T06:55:06.950918+0000","last_became_peered":"2023-10-09T06:55:06.950918+0000","last_unstale":"2023-10-09T06:55:06.953937+0000","last_undegraded":"2023-10-09T06:55:06.953937+0000","last_fullsized":"2023-10-09T06:55:06.953937+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:27.342291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.943250+0000","last_change":"2023-10-09T06:55:06.938814+0000","last_active":"2023-10-09T06:55:06.943250+0000","last_peered":"2023-10-09T06:55:06.943250+0000","last_clean":"2023-10-09T06:55:06.943250+0000","last_became_active":"2023-10-09T06:55:06.938536+0000","last_became_peered":"2023-10-09T06:55:06.938536+0000","last_unstale":"2023-10-09T06:55:06.943250+0000","last_undegraded":"2023-10-09T06:55:06.943250+0000","last_fullsized":"2023-10-09T06:55:06.943250+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:00.077635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.951506+0000","last_change":"2023-10-09T06:55:06.947089+0000","last_active":"2023-10-09T06:55:06.951506+0000","last_peered":"2023-10-09T06:55:06.951506+0000","last_clean":"2023-10-09T06:55:06.951506+0000","last_became_active":"2023-10-09T06:55:06.946423+0000","last_became_peered":"2023-10-09T06:55:06.946423+0000","last_unstale":"2023-10-09T06:55:06.951506+0000","last_undegraded":"2023-10-09T06:55:06.951506+0000","last_fullsized":"2023-10-09T06:55:06.951506+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:27.342291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953339+0000","last_change":"2023-10-09T06:55:06.947260+0000","last_active":"2023-10-09T06:55:06.953339+0000","last_peered":"2023-10-09T06:55:06.953339+0000","last_clean":"2023-10-09T06:55:06.953339+0000","last_became_active":"2023-10-09T06:55:06.946996+0000","last_became_peered":"2023-10-09T06:55:06.946996+0000","last_unstale":"2023-10-09T06:55:06.953339+0000","last_undegraded":"2023-10-09T06:55:06.953339+0000","last_fullsized":"2023-10-09T06:55:06.953339+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:13.874146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.946692+0000","last_change":"2023-10-09T06:55:06.945053+0000","last_active":"2023-10-09T06:55:06.946692+0000","last_peered":"2023-10-09T06:55:06.946692+0000","last_clean":"2023-10-09T06:55:06.946692+0000","last_became_active":"2023-10-09T06:55:06.944789+0000","last_became_peered":"2023-10-09T06:55:06.944789+0000","last_unstale":"2023-10-09T06:55:06.946692+0000","last_undegraded":"2023-10-09T06:55:06.946692+0000","last_fullsized":"2023-10-09T06:55:06.946692+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:08.244758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948157+0000","last_change":"2023-10-09T06:55:06.945836+0000","last_active":"2023-10-09T06:55:06.948157+0000","last_peered":"2023-10-09T06:55:06.948157+0000","last_clean":"2023-10-09T06:55:06.948157+0000","last_became_active":"2023-10-09T06:55:06.945564+0000","last_became_peered":"2023-10-09T06:55:06.945564+0000","last_unstale":"2023-10-09T06:55:06.948157+0000","last_undegraded":"2023-10-09T06:55:06.948157+0000","last_fullsized":"2023-10-09T06:55:06.948157+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:40.055223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955508+0000","last_change":"2023-10-09T06:55:06.953311+0000","last_active":"2023-10-09T06:55:06.955508+0000","last_peered":"2023-10-09T06:55:06.955508+0000","last_clean":"2023-10-09T06:55:06.955508+0000","last_became_active":"2023-10-09T06:55:06.952959+0000","last_became_peered":"2023-10-09T06:55:06.952959+0000","last_unstale":"2023-10-09T06:55:06.955508+0000","last_undegraded":"2023-10-09T06:55:06.955508+0000","last_fullsized":"2023-10-09T06:55:06.955508+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:12:43.264714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948265+0000","last_change":"2023-10-09T06:55:06.942933+0000","last_active":"2023-10-09T06:55:06.948265+0000","last_peered":"2023-10-09T06:55:06.948265+0000","last_clean":"2023-10-09T06:55:06.948265+0000","last_became_active":"2023-10-09T06:55:06.942300+0000","last_became_peered":"2023-10-09T06:55:06.942300+0000","last_unstale":"2023-10-09T06:55:06.948265+0000","last_undegraded":"2023-10-09T06:55:06.948265+0000","last_fullsized":"2023-10-09T06:55:06.948265+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:21.359666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948195+0000","last_change":"2023-10-09T06:55:06.942752+0000","last_active":"2023-10-09T06:55:06.948195+0000","last_peered":"2023-10-09T06:55:06.948195+0000","last_clean":"2023-10-09T06:55:06.948195+0000","last_became_active":"2023-10-09T06:55:06.942448+0000","last_became_peered":"2023-10-09T06:55:06.942448+0000","last_unstale":"2023-10-09T06:55:06.948195+0000","last_undegraded":"2023-10-09T06:55:06.948195+0000","last_fullsized":"2023-10-09T06:55:06.948195+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:47.548592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954067+0000","last_change":"2023-10-09T06:55:06.948333+0000","last_active":"2023-10-09T06:55:06.954067+0000","last_peered":"2023-10-09T06:55:06.954067+0000","last_clean":"2023-10-09T06:55:06.954067+0000","last_became_active":"2023-10-09T06:55:06.946602+0000","last_became_peered":"2023-10-09T06:55:06.946602+0000","last_unstale":"2023-10-09T06:55:06.954067+0000","last_undegraded":"2023-10-09T06:55:06.954067+0000","last_fullsized":"2023-10-09T06:55:06.954067+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:26:48.145004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.942812+0000","last_change":"2023-10-09T06:55:06.939960+0000","last_active":"2023-10-09T06:55:06.942812+0000","last_peered":"2023-10-09T06:55:06.942812+0000","last_clean":"2023-10-09T06:55:06.942812+0000","last_became_active":"2023-10-09T06:55:06.939690+0000","last_became_peered":"2023-10-09T06:55:06.939690+0000","last_unstale":"2023-10-09T06:55:06.942812+0000","last_undegraded":"2023-10-09T06:55:06.942812+0000","last_fullsized":"2023-10-09T06:55:06.942812+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:07:47.321921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.951144+0000","last_change":"2023-10-09T06:55:06.940527+0000","last_active":"2023-10-09T06:55:06.951144+0000","last_peered":"2023-10-09T06:55:06.951144+0000","last_clean":"2023-10-09T06:55:06.951144+0000","last_became_active":"2023-10-09T06:55:06.940228+0000","last_became_peered":"2023-10-09T06:55:06.940228+0000","last_unstale":"2023-10-09T06:55:06.951144+0000","last_undegraded":"2023-10-09T06:55:06.951144+0000","last_fullsized":"2023-10-09T06:55:06.951144+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:21.359666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.950449+0000","last_change":"2023-10-09T06:55:06.938753+0000","last_active":"2023-10-09T06:55:06.950449+0000","last_peered":"2023-10-09T06:55:06.950449+0000","last_clean":"2023-10-09T06:55:06.950449+0000","last_became_active":"2023-10-09T06:55:06.938454+0000","last_became_peered":"2023-10-09T06:55:06.938454+0000","last_unstale":"2023-10-09T06:55:06.950449+0000","last_undegraded":"2023-10-09T06:55:06.950449+0000","last_fullsized":"2023-10-09T06:55:06.950449+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:10.372066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954064+0000","last_change":"2023-10-09T06:55:06.945602+0000","last_active":"2023-10-09T06:55:06.954064+0000","last_peered":"2023-10-09T06:55:06.954064+0000","last_clean":"2023-10-09T06:55:06.954064+0000","last_became_active":"2023-10-09T06:55:06.945315+0000","last_became_peered":"2023-10-09T06:55:06.945315+0000","last_unstale":"2023-10-09T06:55:06.954064+0000","last_undegraded":"2023-10-09T06:55:06.954064+0000","last_fullsized":"2023-10-09T06:55:06.954064+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:22.559262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.939241+0000","last_change":"2023-10-09T06:55:06.932066+0000","last_active":"2023-10-09T06:55:06.939241+0000","last_peered":"2023-10-09T06:55:06.939241+0000","last_clean":"2023-10-09T06:55:06.939241+0000","last_became_active":"2023-10-09T06:55:06.931575+0000","last_became_peered":"2023-10-09T06:55:06.931575+0000","last_unstale":"2023-10-09T06:55:06.939241+0000","last_undegraded":"2023-10-09T06:55:06.939241+0000","last_fullsized":"2023-10-09T06:55:06.939241+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:30:30.430228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948071+0000","last_change":"2023-10-09T06:55:06.943815+0000","last_active":"2023-10-09T06:55:06.948071+0000","last_peered":"2023-10-09T06:55:06.948071+0000","last_clean":"2023-10-09T06:55:06.948071+0000","last_became_active":"2023-10-09T06:55:06.943558+0000","last_became_peered":"2023-10-09T06:55:06.943558+0000","last_unstale":"2023-10-09T06:55:06.948071+0000","last_undegraded":"2023-10-09T06:55:06.948071+0000","last_fullsized":"2023-10-09T06:55:06.948071+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:24:19.345593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.934846+0000","last_change":"2023-10-09T06:55:06.928130+0000","last_active":"2023-10-09T06:55:06.934846+0000","last_peered":"2023-10-09T06:55:06.934846+0000","last_clean":"2023-10-09T06:55:06.934846+0000","last_became_active":"2023-10-09T06:55:06.927851+0000","last_became_peered":"2023-10-09T06:55:06.927851+0000","last_unstale":"2023-10-09T06:55:06.934846+0000","last_undegraded":"2023-10-09T06:55:06.934846+0000","last_fullsized":"2023-10-09T06:55:06.934846+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:18.653877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954325+0000","last_change":"2023-10-09T06:55:06.952189+0000","last_active":"2023-10-09T06:55:06.954325+0000","last_peered":"2023-10-09T06:55:06.954325+0000","last_clean":"2023-10-09T06:55:06.954325+0000","last_became_active":"2023-10-09T06:55:06.951940+0000","last_became_peered":"2023-10-09T06:55:06.951940+0000","last_unstale":"2023-10-09T06:55:06.954325+0000","last_undegraded":"2023-10-09T06:55:06.954325+0000","last_fullsized":"2023-10-09T06:55:06.954325+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:22.559262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"61'4","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955223+0000","last_change":"2023-10-09T06:55:05.933796+0000","last_active":"2023-10-09T06:55:06.955223+0000","last_peered":"2023-10-09T06:55:06.955223+0000","last_clean":"2023-10-09T06:55:06.955223+0000","last_became_active":"2023-10-09T06:55:05.933559+0000","last_became_peered":"2023-10-09T06:55:05.933559+0000","last_unstale":"2023-10-09T06:55:06.955223+0000","last_undegraded":"2023-10-09T06:55:06.955223+0000","last_fullsized":"2023-10-09T06:55:06.955223+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:09.365369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954161+0000","last_change":"2023-10-09T06:55:06.950139+0000","last_active":"2023-10-09T06:55:06.954161+0000","last_peered":"2023-10-09T06:55:06.954161+0000","last_clean":"2023-10-09T06:55:06.954161+0000","last_became_active":"2023-10-09T06:55:06.949821+0000","last_became_peered":"2023-10-09T06:55:06.949821+0000","last_unstale":"2023-10-09T06:55:06.954161+0000","last_undegraded":"2023-10-09T06:55:06.954161+0000","last_fullsized":"2023-10-09T06:55:06.954161+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:00.077635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.952794+0000","last_change":"2023-10-09T06:55:05.931291+0000","last_active":"2023-10-09T06:55:06.952794+0000","last_peered":"2023-10-09T06:55:06.952794+0000","last_clean":"2023-10-09T06:55:06.952794+0000","last_became_active":"2023-10-09T06:55:05.931030+0000","last_became_peered":"2023-10-09T06:55:05.931030+0000","last_unstale":"2023-10-09T06:55:06.952794+0000","last_undegraded":"2023-10-09T06:55:06.952794+0000","last_fullsized":"2023-10-09T06:55:06.952794+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:02:17.540297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.952106+0000","last_change":"2023-10-09T06:55:06.944084+0000","last_active":"2023-10-09T06:55:06.952106+0000","last_peered":"2023-10-09T06:55:06.952106+0000","last_clean":"2023-10-09T06:55:06.952106+0000","last_became_active":"2023-10-09T06:55:06.943799+0000","last_became_peered":"2023-10-09T06:55:06.943799+0000","last_unstale":"2023-10-09T06:55:06.952106+0000","last_undegraded":"2023-10-09T06:55:06.952106+0000","last_fullsized":"2023-10-09T06:55:06.952106+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:12:43.264714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.952611+0000","last_change":"2023-10-09T06:55:05.936463+0000","last_active":"2023-10-09T06:55:06.952611+0000","last_peered":"2023-10-09T06:55:06.952611+0000","last_clean":"2023-10-09T06:55:06.952611+0000","last_became_active":"2023-10-09T06:55:05.936166+0000","last_became_peered":"2023-10-09T06:55:05.936166+0000","last_unstale":"2023-10-09T06:55:06.952611+0000","last_undegraded":"2023-10-09T06:55:06.952611+0000","last_fullsized":"2023-10-09T06:55:06.952611+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:30.427585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.945118+0000","last_change":"2023-10-09T06:55:06.944529+0000","last_active":"2023-10-09T06:55:06.945118+0000","last_peered":"2023-10-09T06:55:06.945118+0000","last_clean":"2023-10-09T06:55:06.945118+0000","last_became_active":"2023-10-09T06:55:06.944264+0000","last_became_peered":"2023-10-09T06:55:06.944264+0000","last_unstale":"2023-10-09T06:55:06.945118+0000","last_undegraded":"2023-10-09T06:55:06.945118+0000","last_fullsized":"2023-10-09T06:55:06.945118+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:47.548592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955066+0000","last_change":"2023-10-09T06:55:05.935262+0000","last_active":"2023-10-09T06:55:06.955066+0000","last_peered":"2023-10-09T06:55:06.955066+0000","last_clean":"2023-10-09T06:55:06.955066+0000","last_became_active":"2023-10-09T06:55:05.934932+0000","last_became_peered":"2023-10-09T06:55:05.934932+0000","last_unstale":"2023-10-09T06:55:06.955066+0000","last_undegraded":"2023-10-09T06:55:06.955066+0000","last_fullsized":"2023-10-09T06:55:06.955066+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:02:48.884634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.951329+0000","last_change":"2023-10-09T06:55:06.939358+0000","last_active":"2023-10-09T06:55:06.951329+0000","last_peered":"2023-10-09T06:55:06.951329+0000","last_clean":"2023-10-09T06:55:06.951329+0000","last_became_active":"2023-10-09T06:55:06.939058+0000","last_became_peered":"2023-10-09T06:55:06.939058+0000","last_unstale":"2023-10-09T06:55:06.951329+0000","last_undegraded":"2023-10-09T06:55:06.951329+0000","last_fullsized":"2023-10-09T06:55:06.951329+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:13.874146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953637+0000","last_change":"2023-10-09T06:55:05.931537+0000","last_active":"2023-10-09T06:55:06.953637+0000","last_peered":"2023-10-09T06:55:06.953637+0000","last_clean":"2023-10-09T06:55:06.953637+0000","last_became_active":"2023-10-09T06:55:05.931300+0000","last_became_peered":"2023-10-09T06:55:05.931300+0000","last_unstale":"2023-10-09T06:55:06.953637+0000","last_undegraded":"2023-10-09T06:55:06.953637+0000","last_fullsized":"2023-10-09T06:55:06.953637+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:07.028150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.944440+0000","last_change":"2023-10-09T06:55:06.938409+0000","last_active":"2023-10-09T06:55:06.944440+0000","last_peered":"2023-10-09T06:55:06.944440+0000","last_clean":"2023-10-09T06:55:06.944440+0000","last_became_active":"2023-10-09T06:55:06.938160+0000","last_became_peered":"2023-10-09T06:55:06.938160+0000","last_unstale":"2023-10-09T06:55:06.944440+0000","last_undegraded":"2023-10-09T06:55:06.944440+0000","last_fullsized":"2023-10-09T06:55:06.944440+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:29:45.885127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.941331+0000","last_change":"2023-10-09T06:55:05.923991+0000","last_active":"2023-10-09T06:55:06.941331+0000","last_peered":"2023-10-09T06:55:06.941331+0000","last_clean":"2023-10-09T06:55:06.941331+0000","last_became_active":"2023-10-09T06:55:05.923625+0000","last_became_peered":"2023-10-09T06:55:05.923625+0000","last_unstale":"2023-10-09T06:55:06.941331+0000","last_undegraded":"2023-10-09T06:55:06.941331+0000","last_fullsized":"2023-10-09T06:55:06.941331+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:26:41.909058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955407+0000","last_change":"2023-10-09T06:55:06.952666+0000","last_active":"2023-10-09T06:55:06.955407+0000","last_peered":"2023-10-09T06:55:06.955407+0000","last_clean":"2023-10-09T06:55:06.955407+0000","last_became_active":"2023-10-09T06:55:06.952418+0000","last_became_peered":"2023-10-09T06:55:06.952418+0000","last_unstale":"2023-10-09T06:55:06.955407+0000","last_undegraded":"2023-10-09T06:55:06.955407+0000","last_fullsized":"2023-10-09T06:55:06.955407+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:43:07.311728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.927159+0000","last_change":"2023-10-09T06:55:05.932956+0000","last_active":"2023-10-09T06:55:06.927159+0000","last_peered":"2023-10-09T06:55:06.927159+0000","last_clean":"2023-10-09T06:55:06.927159+0000","last_became_active":"2023-10-09T06:55:05.932697+0000","last_became_peered":"2023-10-09T06:55:05.932697+0000","last_unstale":"2023-10-09T06:55:06.927159+0000","last_undegraded":"2023-10-09T06:55:06.927159+0000","last_fullsized":"2023-10-09T06:55:06.927159+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:59.070938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948242+0000","last_change":"2023-10-09T06:55:06.942850+0000","last_active":"2023-10-09T06:55:06.948242+0000","last_peered":"2023-10-09T06:55:06.948242+0000","last_clean":"2023-10-09T06:55:06.948242+0000","last_became_active":"2023-10-09T06:55:06.942558+0000","last_became_peered":"2023-10-09T06:55:06.942558+0000","last_unstale":"2023-10-09T06:55:06.948242+0000","last_undegraded":"2023-10-09T06:55:06.948242+0000","last_fullsized":"2023-10-09T06:55:06.948242+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:10:57.887526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.923500+0000","last_change":"2023-10-09T06:55:05.932660+0000","last_active":"2023-10-09T06:55:06.923500+0000","last_peered":"2023-10-09T06:55:06.923500+0000","last_clean":"2023-10-09T06:55:06.923500+0000","last_became_active":"2023-10-09T06:55:05.932396+0000","last_became_peered":"2023-10-09T06:55:05.932396+0000","last_unstale":"2023-10-09T06:55:06.923500+0000","last_undegraded":"2023-10-09T06:55:06.923500+0000","last_fullsized":"2023-10-09T06:55:06.923500+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:46.541894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.951486+0000","last_change":"2023-10-09T06:55:06.946914+0000","last_active":"2023-10-09T06:55:06.951486+0000","last_peered":"2023-10-09T06:55:06.951486+0000","last_clean":"2023-10-09T06:55:06.951486+0000","last_became_active":"2023-10-09T06:55:06.946064+0000","last_became_peered":"2023-10-09T06:55:06.946064+0000","last_unstale":"2023-10-09T06:55:06.951486+0000","last_undegraded":"2023-10-09T06:55:06.951486+0000","last_fullsized":"2023-10-09T06:55:06.951486+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:26:48.145004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.923498+0000","last_change":"2023-10-09T06:55:05.933823+0000","last_active":"2023-10-09T06:55:06.923498+0000","last_peered":"2023-10-09T06:55:06.923498+0000","last_clean":"2023-10-09T06:55:06.923498+0000","last_became_active":"2023-10-09T06:55:05.933566+0000","last_became_peered":"2023-10-09T06:55:05.933566+0000","last_unstale":"2023-10-09T06:55:06.923498+0000","last_undegraded":"2023-10-09T06:55:06.923498+0000","last_fullsized":"2023-10-09T06:55:06.923498+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:52:41.277241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953271+0000","last_change":"2023-10-09T06:55:06.948696+0000","last_active":"2023-10-09T06:55:06.953271+0000","last_peered":"2023-10-09T06:55:06.953271+0000","last_clean":"2023-10-09T06:55:06.953271+0000","last_became_active":"2023-10-09T06:55:06.948292+0000","last_became_peered":"2023-10-09T06:55:06.948292+0000","last_unstale":"2023-10-09T06:55:06.953271+0000","last_undegraded":"2023-10-09T06:55:06.953271+0000","last_fullsized":"2023-10-09T06:55:06.953271+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:27.342291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.933075+0000","last_change":"2023-10-09T06:55:05.932297+0000","last_active":"2023-10-09T06:55:06.933075+0000","last_peered":"2023-10-09T06:55:06.933075+0000","last_clean":"2023-10-09T06:55:06.933075+0000","last_became_active":"2023-10-09T06:55:05.931969+0000","last_became_peered":"2023-10-09T06:55:05.931969+0000","last_unstale":"2023-10-09T06:55:06.933075+0000","last_undegraded":"2023-10-09T06:55:06.933075+0000","last_fullsized":"2023-10-09T06:55:06.933075+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:04:29.076275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.932452+0000","last_change":"2023-10-09T06:55:06.928878+0000","last_active":"2023-10-09T06:55:06.932452+0000","last_peered":"2023-10-09T06:55:06.932452+0000","last_clean":"2023-10-09T06:55:06.932452+0000","last_became_active":"2023-10-09T06:55:06.928633+0000","last_became_peered":"2023-10-09T06:55:06.928633+0000","last_unstale":"2023-10-09T06:55:06.932452+0000","last_undegraded":"2023-10-09T06:55:06.932452+0000","last_fullsized":"2023-10-09T06:55:06.932452+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:48:10.713903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"61'3","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.956479+0000","last_change":"2023-10-09T06:55:05.938582+0000","last_active":"2023-10-09T06:55:06.956479+0000","last_peered":"2023-10-09T06:55:06.956479+0000","last_clean":"2023-10-09T06:55:06.956479+0000","last_became_active":"2023-10-09T06:55:05.938239+0000","last_became_peered":"2023-10-09T06:55:05.938239+0000","last_unstale":"2023-10-09T06:55:06.956479+0000","last_undegraded":"2023-10-09T06:55:06.956479+0000","last_fullsized":"2023-10-09T06:55:06.956479+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:21.552564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953095+0000","last_change":"2023-10-09T06:55:06.942075+0000","last_active":"2023-10-09T06:55:06.953095+0000","last_peered":"2023-10-09T06:55:06.953095+0000","last_clean":"2023-10-09T06:55:06.953095+0000","last_became_active":"2023-10-09T06:55:06.941725+0000","last_became_peered":"2023-10-09T06:55:06.941725+0000","last_unstale":"2023-10-09T06:55:06.953095+0000","last_undegraded":"2023-10-09T06:55:06.953095+0000","last_fullsized":"2023-10-09T06:55:06.953095+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:50:27.836402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"61'6","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.958234+0000","last_change":"2023-10-09T06:55:05.931955+0000","last_active":"2023-10-09T06:55:06.958234+0000","last_peered":"2023-10-09T06:55:06.958234+0000","last_clean":"2023-10-09T06:55:06.958234+0000","last_became_active":"2023-10-09T06:55:05.931712+0000","last_became_peered":"2023-10-09T06:55:05.931712+0000","last_unstale":"2023-10-09T06:55:06.958234+0000","last_undegraded":"2023-10-09T06:55:06.958234+0000","last_fullsized":"2023-10-09T06:55:06.958234+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:17.429884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953854+0000","last_change":"2023-10-09T06:55:06.948630+0000","last_active":"2023-10-09T06:55:06.953854+0000","last_peered":"2023-10-09T06:55:06.953854+0000","last_clean":"2023-10-09T06:55:06.953854+0000","last_became_active":"2023-10-09T06:55:06.947635+0000","last_became_peered":"2023-10-09T06:55:06.947635+0000","last_unstale":"2023-10-09T06:55:06.953854+0000","last_undegraded":"2023-10-09T06:55:06.953854+0000","last_fullsized":"2023-10-09T06:55:06.953854+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:19.860358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.949612+0000","last_change":"2023-10-09T06:55:05.941482+0000","last_active":"2023-10-09T06:55:06.949612+0000","last_peered":"2023-10-09T06:55:06.949612+0000","last_clean":"2023-10-09T06:55:06.949612+0000","last_became_active":"2023-10-09T06:55:05.941132+0000","last_became_peered":"2023-10-09T06:55:05.941132+0000","last_unstale":"2023-10-09T06:55:06.949612+0000","last_undegraded":"2023-10-09T06:55:06.949612+0000","last_fullsized":"2023-10-09T06:55:06.949612+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:47.392667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.944422+0000","last_change":"2023-10-09T06:55:06.934503+0000","last_active":"2023-10-09T06:55:06.944422+0000","last_peered":"2023-10-09T06:55:06.944422+0000","last_clean":"2023-10-09T06:55:06.944422+0000","last_became_active":"2023-10-09T06:55:06.934249+0000","last_became_peered":"2023-10-09T06:55:06.934249+0000","last_unstale":"2023-10-09T06:55:06.944422+0000","last_undegraded":"2023-10-09T06:55:06.944422+0000","last_fullsized":"2023-10-09T06:55:06.944422+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:04.244093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.929902+0000","last_change":"2023-10-09T06:55:05.931993+0000","last_active":"2023-10-09T06:55:06.929902+0000","last_peered":"2023-10-09T06:55:06.929902+0000","last_clean":"2023-10-09T06:55:06.929902+0000","last_became_active":"2023-10-09T06:55:05.931747+0000","last_became_peered":"2023-10-09T06:55:05.931747+0000","last_unstale":"2023-10-09T06:55:06.929902+0000","last_undegraded":"2023-10-09T06:55:06.929902+0000","last_fullsized":"2023-10-09T06:55:06.929902+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:49:48.304060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.928958+0000","last_change":"2023-10-09T06:55:06.926676+0000","last_active":"2023-10-09T06:55:06.928958+0000","last_peered":"2023-10-09T06:55:06.928958+0000","last_clean":"2023-10-09T06:55:06.928958+0000","last_became_active":"2023-10-09T06:55:06.926433+0000","last_became_peered":"2023-10-09T06:55:06.926433+0000","last_unstale":"2023-10-09T06:55:06.928958+0000","last_undegraded":"2023-10-09T06:55:06.928958+0000","last_fullsized":"2023-10-09T06:55:06.928958+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:26:52.867345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.923136+0000","last_change":"2023-10-09T06:55:05.935304+0000","last_active":"2023-10-09T06:55:06.923136+0000","last_peered":"2023-10-09T06:55:06.923136+0000","last_clean":"2023-10-09T06:55:06.923136+0000","last_became_active":"2023-10-09T06:55:05.935055+0000","last_became_peered":"2023-10-09T06:55:05.935055+0000","last_unstale":"2023-10-09T06:55:06.923136+0000","last_undegraded":"2023-10-09T06:55:06.923136+0000","last_fullsized":"2023-10-09T06:55:06.923136+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:16:25.613767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954291+0000","last_change":"2023-10-09T06:55:06.953060+0000","last_active":"2023-10-09T06:55:06.954291+0000","last_peered":"2023-10-09T06:55:06.954291+0000","last_clean":"2023-10-09T06:55:06.954291+0000","last_became_active":"2023-10-09T06:55:06.952769+0000","last_became_peered":"2023-10-09T06:55:06.952769+0000","last_unstale":"2023-10-09T06:55:06.954291+0000","last_undegraded":"2023-10-09T06:55:06.954291+0000","last_fullsized":"2023-10-09T06:55:06.954291+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:12:43.264714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"61'8","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955749+0000","last_change":"2023-10-09T06:55:05.939559+0000","last_active":"2023-10-09T06:55:06.955749+0000","last_peered":"2023-10-09T06:55:06.955749+0000","last_clean":"2023-10-09T06:55:06.955749+0000","last_became_active":"2023-10-09T06:55:05.939250+0000","last_became_peered":"2023-10-09T06:55:05.939250+0000","last_unstale":"2023-10-09T06:55:06.955749+0000","last_undegraded":"2023-10-09T06:55:06.955749+0000","last_fullsized":"2023-10-09T06:55:06.955749+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:57.104240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.943570+0000","last_change":"2023-10-09T06:55:06.940395+0000","last_active":"2023-10-09T06:55:06.943570+0000","last_peered":"2023-10-09T06:55:06.943570+0000","last_clean":"2023-10-09T06:55:06.943570+0000","last_became_active":"2023-10-09T06:55:06.940110+0000","last_became_peered":"2023-10-09T06:55:06.940110+0000","last_unstale":"2023-10-09T06:55:06.943570+0000","last_undegraded":"2023-10-09T06:55:06.943570+0000","last_fullsized":"2023-10-09T06:55:06.943570+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:11.042189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.947490+0000","last_change":"2023-10-09T06:55:05.932965+0000","last_active":"2023-10-09T06:55:06.947490+0000","last_peered":"2023-10-09T06:55:06.947490+0000","last_clean":"2023-10-09T06:55:06.947490+0000","last_became_active":"2023-10-09T06:55:05.932676+0000","last_became_peered":"2023-10-09T06:55:05.932676+0000","last_unstale":"2023-10-09T06:55:06.947490+0000","last_undegraded":"2023-10-09T06:55:06.947490+0000","last_fullsized":"2023-10-09T06:55:06.947490+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:03:56.177535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948676+0000","last_change":"2023-10-09T06:55:06.944157+0000","last_active":"2023-10-09T06:55:06.948676+0000","last_peered":"2023-10-09T06:55:06.948676+0000","last_clean":"2023-10-09T06:55:06.948676+0000","last_became_active":"2023-10-09T06:55:06.943866+0000","last_became_peered":"2023-10-09T06:55:06.943866+0000","last_unstale":"2023-10-09T06:55:06.948676+0000","last_undegraded":"2023-10-09T06:55:06.948676+0000","last_fullsized":"2023-10-09T06:55:06.948676+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:12.040675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.947250+0000","last_change":"2023-10-09T06:55:05.930339+0000","last_active":"2023-10-09T06:55:06.947250+0000","last_peered":"2023-10-09T06:55:06.947250+0000","last_clean":"2023-10-09T06:55:06.947250+0000","last_became_active":"2023-10-09T06:55:05.930075+0000","last_became_peered":"2023-10-09T06:55:05.930075+0000","last_unstale":"2023-10-09T06:55:06.947250+0000","last_undegraded":"2023-10-09T06:55:06.947250+0000","last_fullsized":"2023-10-09T06:55:06.947250+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:25.646016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953398+0000","last_change":"2023-10-09T06:55:06.946543+0000","last_active":"2023-10-09T06:55:06.953398+0000","last_peered":"2023-10-09T06:55:06.953398+0000","last_clean":"2023-10-09T06:55:06.953398+0000","last_became_active":"2023-10-09T06:55:06.946212+0000","last_became_peered":"2023-10-09T06:55:06.946212+0000","last_unstale":"2023-10-09T06:55:06.953398+0000","last_undegraded":"2023-10-09T06:55:06.953398+0000","last_fullsized":"2023-10-09T06:55:06.953398+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:04:30.082972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955241+0000","last_change":"2023-10-09T06:55:05.933469+0000","last_active":"2023-10-09T06:55:06.955241+0000","last_peered":"2023-10-09T06:55:06.955241+0000","last_clean":"2023-10-09T06:55:06.955241+0000","last_became_active":"2023-10-09T06:55:05.933182+0000","last_became_peered":"2023-10-09T06:55:05.933182+0000","last_unstale":"2023-10-09T06:55:06.955241+0000","last_undegraded":"2023-10-09T06:55:06.955241+0000","last_fullsized":"2023-10-09T06:55:06.955241+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:20.352969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953318+0000","last_change":"2023-10-09T06:55:06.944943+0000","last_active":"2023-10-09T06:55:06.953318+0000","last_peered":"2023-10-09T06:55:06.953318+0000","last_clean":"2023-10-09T06:55:06.953318+0000","last_became_active":"2023-10-09T06:55:06.944651+0000","last_became_peered":"2023-10-09T06:55:06.944651+0000","last_unstale":"2023-10-09T06:55:06.953318+0000","last_undegraded":"2023-10-09T06:55:06.953318+0000","last_fullsized":"2023-10-09T06:55:06.953318+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:30:30.430228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.925347+0000","last_change":"2023-10-09T06:55:05.933315+0000","last_active":"2023-10-09T06:55:06.925347+0000","last_peered":"2023-10-09T06:55:06.925347+0000","last_clean":"2023-10-09T06:55:06.925347+0000","last_became_active":"2023-10-09T06:55:05.933044+0000","last_became_peered":"2023-10-09T06:55:05.933044+0000","last_unstale":"2023-10-09T06:55:06.925347+0000","last_undegraded":"2023-10-09T06:55:06.925347+0000","last_fullsized":"2023-10-09T06:55:06.925347+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:51.403402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.941236+0000","last_change":"2023-10-09T06:55:06.935138+0000","last_active":"2023-10-09T06:55:06.941236+0000","last_peered":"2023-10-09T06:55:06.941236+0000","last_clean":"2023-10-09T06:55:06.941236+0000","last_became_active":"2023-10-09T06:55:06.934886+0000","last_became_peered":"2023-10-09T06:55:06.934886+0000","last_unstale":"2023-10-09T06:55:06.941236+0000","last_undegraded":"2023-10-09T06:55:06.941236+0000","last_fullsized":"2023-10-09T06:55:06.941236+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:28.982187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953731+0000","last_change":"2023-10-09T06:55:05.930744+0000","last_active":"2023-10-09T06:55:06.953731+0000","last_peered":"2023-10-09T06:55:06.953731+0000","last_clean":"2023-10-09T06:55:06.953731+0000","last_became_active":"2023-10-09T06:55:05.930460+0000","last_became_peered":"2023-10-09T06:55:05.930460+0000","last_unstale":"2023-10-09T06:55:06.953731+0000","last_undegraded":"2023-10-09T06:55:06.953731+0000","last_fullsized":"2023-10-09T06:55:06.953731+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:18:05.242002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954278+0000","last_change":"2023-10-09T06:55:06.951304+0000","last_active":"2023-10-09T06:55:06.954278+0000","last_peered":"2023-10-09T06:55:06.954278+0000","last_clean":"2023-10-09T06:55:06.954278+0000","last_became_active":"2023-10-09T06:55:06.950931+0000","last_became_peered":"2023-10-09T06:55:06.950931+0000","last_unstale":"2023-10-09T06:55:06.954278+0000","last_undegraded":"2023-10-09T06:55:06.954278+0000","last_fullsized":"2023-10-09T06:55:06.954278+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:17.846967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.927303+0000","last_change":"2023-10-09T06:55:05.932114+0000","last_active":"2023-10-09T06:55:06.927303+0000","last_peered":"2023-10-09T06:55:06.927303+0000","last_clean":"2023-10-09T06:55:06.927303+0000","last_became_active":"2023-10-09T06:55:05.931130+0000","last_became_peered":"2023-10-09T06:55:05.931130+0000","last_unstale":"2023-10-09T06:55:06.927303+0000","last_undegraded":"2023-10-09T06:55:06.927303+0000","last_fullsized":"2023-10-09T06:55:06.927303+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:04:29.076275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.936298+0000","last_change":"2023-10-09T06:55:06.933965+0000","last_active":"2023-10-09T06:55:06.936298+0000","last_peered":"2023-10-09T06:55:06.936298+0000","last_clean":"2023-10-09T06:55:06.936298+0000","last_became_active":"2023-10-09T06:55:06.933697+0000","last_became_peered":"2023-10-09T06:55:06.933697+0000","last_unstale":"2023-10-09T06:55:06.936298+0000","last_undegraded":"2023-10-09T06:55:06.936298+0000","last_fullsized":"2023-10-09T06:55:06.936298+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:52.068938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.932376+0000","last_change":"2023-10-09T06:55:05.939438+0000","last_active":"2023-10-09T06:55:06.932376+0000","last_peered":"2023-10-09T06:55:06.932376+0000","last_clean":"2023-10-09T06:55:06.932376+0000","last_became_active":"2023-10-09T06:55:05.939179+0000","last_became_peered":"2023-10-09T06:55:05.939179+0000","last_unstale":"2023-10-09T06:55:06.932376+0000","last_undegraded":"2023-10-09T06:55:06.932376+0000","last_fullsized":"2023-10-09T06:55:06.932376+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:21.552564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.944385+0000","last_change":"2023-10-09T06:55:06.941903+0000","last_active":"2023-10-09T06:55:06.944385+0000","last_peered":"2023-10-09T06:55:06.944385+0000","last_clean":"2023-10-09T06:55:06.944385+0000","last_became_active":"2023-10-09T06:55:06.941654+0000","last_became_peered":"2023-10-09T06:55:06.941654+0000","last_unstale":"2023-10-09T06:55:06.944385+0000","last_undegraded":"2023-10-09T06:55:06.944385+0000","last_fullsized":"2023-10-09T06:55:06.944385+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:36.964322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.929584+0000","last_change":"2023-10-09T06:55:05.937191+0000","last_active":"2023-10-09T06:55:06.929584+0000","last_peered":"2023-10-09T06:55:06.929584+0000","last_clean":"2023-10-09T06:55:06.929584+0000","last_became_active":"2023-10-09T06:55:05.936808+0000","last_became_peered":"2023-10-09T06:55:05.936808+0000","last_unstale":"2023-10-09T06:55:06.929584+0000","last_undegraded":"2023-10-09T06:55:06.929584+0000","last_fullsized":"2023-10-09T06:55:06.929584+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:57.104240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954182+0000","last_change":"2023-10-09T06:55:06.950960+0000","last_active":"2023-10-09T06:55:06.954182+0000","last_peered":"2023-10-09T06:55:06.954182+0000","last_clean":"2023-10-09T06:55:06.954182+0000","last_became_active":"2023-10-09T06:55:06.950716+0000","last_became_peered":"2023-10-09T06:55:06.950716+0000","last_unstale":"2023-10-09T06:55:06.954182+0000","last_undegraded":"2023-10-09T06:55:06.954182+0000","last_fullsized":"2023-10-09T06:55:06.954182+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:50:27.836402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.926093+0000","last_change":"2023-10-09T06:55:05.930677+0000","last_active":"2023-10-09T06:55:06.926093+0000","last_peered":"2023-10-09T06:55:06.926093+0000","last_clean":"2023-10-09T06:55:06.926093+0000","last_became_active":"2023-10-09T06:55:05.930333+0000","last_became_peered":"2023-10-09T06:55:05.930333+0000","last_unstale":"2023-10-09T06:55:06.926093+0000","last_undegraded":"2023-10-09T06:55:06.926093+0000","last_fullsized":"2023-10-09T06:55:06.926093+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:12:42.258017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948591+0000","last_change":"2023-10-09T06:55:06.944396+0000","last_active":"2023-10-09T06:55:06.948591+0000","last_peered":"2023-10-09T06:55:06.948591+0000","last_clean":"2023-10-09T06:55:06.948591+0000","last_became_active":"2023-10-09T06:55:06.944150+0000","last_became_peered":"2023-10-09T06:55:06.944150+0000","last_unstale":"2023-10-09T06:55:06.948591+0000","last_undegraded":"2023-10-09T06:55:06.948591+0000","last_fullsized":"2023-10-09T06:55:06.948591+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:01.783980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.931050+0000","last_change":"2023-10-09T06:55:05.938596+0000","last_active":"2023-10-09T06:55:06.931050+0000","last_peered":"2023-10-09T06:55:06.931050+0000","last_clean":"2023-10-09T06:55:06.931050+0000","last_became_active":"2023-10-09T06:55:05.938360+0000","last_became_peered":"2023-10-09T06:55:05.938360+0000","last_unstale":"2023-10-09T06:55:06.931050+0000","last_undegraded":"2023-10-09T06:55:06.931050+0000","last_fullsized":"2023-10-09T06:55:06.931050+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:48:20.803864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953115+0000","last_change":"2023-10-09T06:55:06.942255+0000","last_active":"2023-10-09T06:55:06.953115+0000","last_peered":"2023-10-09T06:55:06.953115+0000","last_clean":"2023-10-09T06:55:06.953115+0000","last_became_active":"2023-10-09T06:55:06.941345+0000","last_became_peered":"2023-10-09T06:55:06.941345+0000","last_unstale":"2023-10-09T06:55:06.953115+0000","last_undegraded":"2023-10-09T06:55:06.953115+0000","last_fullsized":"2023-10-09T06:55:06.953115+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:16:26.620465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.929937+0000","last_change":"2023-10-09T06:55:05.935598+0000","last_active":"2023-10-09T06:55:06.929937+0000","last_peered":"2023-10-09T06:55:06.929937+0000","last_clean":"2023-10-09T06:55:06.929937+0000","last_became_active":"2023-10-09T06:55:05.935350+0000","last_became_peered":"2023-10-09T06:55:05.935350+0000","last_unstale":"2023-10-09T06:55:06.929937+0000","last_undegraded":"2023-10-09T06:55:06.929937+0000","last_fullsized":"2023-10-09T06:55:06.929937+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:25.646016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.941254+0000","last_change":"2023-10-09T06:55:06.935866+0000","last_active":"2023-10-09T06:55:06.941254+0000","last_peered":"2023-10-09T06:55:06.941254+0000","last_clean":"2023-10-09T06:55:06.941254+0000","last_became_active":"2023-10-09T06:55:06.935633+0000","last_became_peered":"2023-10-09T06:55:06.935633+0000","last_unstale":"2023-10-09T06:55:06.941254+0000","last_undegraded":"2023-10-09T06:55:06.941254+0000","last_fullsized":"2023-10-09T06:55:06.941254+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:29:45.885127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.930431+0000","last_change":"2023-10-09T06:55:05.935761+0000","last_active":"2023-10-09T06:55:06.930431+0000","last_peered":"2023-10-09T06:55:06.930431+0000","last_clean":"2023-10-09T06:55:06.930431+0000","last_became_active":"2023-10-09T06:55:05.935464+0000","last_became_peered":"2023-10-09T06:55:05.935464+0000","last_unstale":"2023-10-09T06:55:06.930431+0000","last_undegraded":"2023-10-09T06:55:06.930431+0000","last_fullsized":"2023-10-09T06:55:06.930431+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:16.840270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.932428+0000","last_change":"2023-10-09T06:55:06.927262+0000","last_active":"2023-10-09T06:55:06.932428+0000","last_peered":"2023-10-09T06:55:06.932428+0000","last_clean":"2023-10-09T06:55:06.932428+0000","last_became_active":"2023-10-09T06:55:06.926992+0000","last_became_peered":"2023-10-09T06:55:06.926992+0000","last_unstale":"2023-10-09T06:55:06.932428+0000","last_undegraded":"2023-10-09T06:55:06.932428+0000","last_fullsized":"2023-10-09T06:55:06.932428+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:12.040675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.924148+0000","last_change":"2023-10-09T06:55:05.931207+0000","last_active":"2023-10-09T06:55:06.924148+0000","last_peered":"2023-10-09T06:55:06.924148+0000","last_clean":"2023-10-09T06:55:06.924148+0000","last_became_active":"2023-10-09T06:55:05.930948+0000","last_became_peered":"2023-10-09T06:55:05.930948+0000","last_unstale":"2023-10-09T06:55:06.924148+0000","last_undegraded":"2023-10-09T06:55:06.924148+0000","last_fullsized":"2023-10-09T06:55:06.924148+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:19.802470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.940773+0000","last_change":"2023-10-09T06:55:06.936312+0000","last_active":"2023-10-09T06:55:06.940773+0000","last_peered":"2023-10-09T06:55:06.940773+0000","last_clean":"2023-10-09T06:55:06.940773+0000","last_became_active":"2023-10-09T06:55:06.936032+0000","last_became_peered":"2023-10-09T06:55:06.936032+0000","last_unstale":"2023-10-09T06:55:06.940773+0000","last_undegraded":"2023-10-09T06:55:06.940773+0000","last_fullsized":"2023-10-09T06:55:06.940773+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:52.410099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.930275+0000","last_change":"2023-10-09T06:55:05.936971+0000","last_active":"2023-10-09T06:55:06.930275+0000","last_peered":"2023-10-09T06:55:06.930275+0000","last_clean":"2023-10-09T06:55:06.930275+0000","last_became_active":"2023-10-09T06:55:05.936678+0000","last_became_peered":"2023-10-09T06:55:05.936678+0000","last_unstale":"2023-10-09T06:55:06.930275+0000","last_undegraded":"2023-10-09T06:55:06.930275+0000","last_fullsized":"2023-10-09T06:55:06.930275+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:18.853661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.951285+0000","last_change":"2023-10-09T06:55:06.944842+0000","last_active":"2023-10-09T06:55:06.951285+0000","last_peered":"2023-10-09T06:55:06.951285+0000","last_clean":"2023-10-09T06:55:06.951285+0000","last_became_active":"2023-10-09T06:55:06.944016+0000","last_became_peered":"2023-10-09T06:55:06.944016+0000","last_unstale":"2023-10-09T06:55:06.951285+0000","last_undegraded":"2023-10-09T06:55:06.951285+0000","last_fullsized":"2023-10-09T06:55:06.951285+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:04:30.082972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.923395+0000","last_change":"2023-10-09T06:55:05.938714+0000","last_active":"2023-10-09T06:55:06.923395+0000","last_peered":"2023-10-09T06:55:06.923395+0000","last_clean":"2023-10-09T06:55:06.923395+0000","last_became_active":"2023-10-09T06:55:05.936627+0000","last_became_peered":"2023-10-09T06:55:05.936627+0000","last_unstale":"2023-10-09T06:55:06.923395+0000","last_undegraded":"2023-10-09T06:55:06.923395+0000","last_fullsized":"2023-10-09T06:55:06.923395+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:16.840270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.943755+0000","last_change":"2023-10-09T06:55:06.941611+0000","last_active":"2023-10-09T06:55:06.943755+0000","last_peered":"2023-10-09T06:55:06.943755+0000","last_clean":"2023-10-09T06:55:06.943755+0000","last_became_active":"2023-10-09T06:55:06.941376+0000","last_became_peered":"2023-10-09T06:55:06.941376+0000","last_unstale":"2023-10-09T06:55:06.943755+0000","last_undegraded":"2023-10-09T06:55:06.943755+0000","last_fullsized":"2023-10-09T06:55:06.943755+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:28.056882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.952233+0000","last_change":"2023-10-09T06:55:05.933117+0000","last_active":"2023-10-09T06:55:06.952233+0000","last_peered":"2023-10-09T06:55:06.952233+0000","last_clean":"2023-10-09T06:55:06.952233+0000","last_became_active":"2023-10-09T06:55:05.932796+0000","last_became_peered":"2023-10-09T06:55:05.932796+0000","last_unstale":"2023-10-09T06:55:06.952233+0000","last_undegraded":"2023-10-09T06:55:06.952233+0000","last_fullsized":"2023-10-09T06:55:06.952233+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:10:56.880829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"52'139","reported_seq":278,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.929711+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:55:06.929711+0000","last_peered":"2023-10-09T06:55:06.929711+0000","last_clean":"2023-10-09T06:55:06.929711+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:55:06.929711+0000","last_undegraded":"2023-10-09T06:55:06.929711+0000","last_fullsized":"2023-10-09T06:55:06.929711+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575003,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":936574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71899999999999997,"15min":0.71699999999999997},"min":{"1min":0.36299999999999999,"5min":0.316,"15min":0.316},"max":{"1min":1.732,"5min":1.732,"15min":1.9490000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73199999999999998,"15min":0.75},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.29999999999999999},"max":{"1min":0.94399999999999995,"5min":1.0169999999999999,"15min":3.448},"last":0.85999999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72199999999999998,"15min":0.77500000000000002},"min":{"1min":0.437,"5min":0.379,"15min":0.379},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":5.617},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.753},"min":{"1min":0.45800000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":2.016},"last":0.68400000000000005}]},{"osd":2,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.74099999999999999,"15min":0.752},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44800000000000001},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":2.052},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76900000000000002,"15min":0.79200000000000004},"min":{"1min":0.48299999999999998,"5min":0.45200000000000001,"15min":0.44700000000000001},"max":{"1min":2.6629999999999998,"5min":2.6629999999999998,"15min":3.5019999999999998},"last":0.69799999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71799999999999997,"15min":0.79300000000000004},"min":{"1min":0.498,"5min":0.45600000000000002,"15min":0.45000000000000001},"max":{"1min":0.85199999999999998,"5min":1.0409999999999999,"15min":5.5800000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.84999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.47099999999999997},"max":{"1min":1.827,"5min":1.827,"15min":6.9299999999999997},"last":0.61399999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.60099999999999998,"15min":0.64800000000000002},"min":{"1min":0.47299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89900000000000002,"5min":0.90400000000000003,"15min":3.125},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.64900000000000002,"15min":0.71399999999999997},"min":{"1min":0.42199999999999999,"5min":0.41999999999999998,"15min":0.40500000000000003},"max":{"1min":2.577,"5min":2.577,"15min":4.8380000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.67300000000000004,"15min":0.72899999999999998},"min":{"1min":0.438,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":4.1929999999999996},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.71199999999999997,"15min":0.76700000000000002},"min":{"1min":0.52900000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.9590000000000001,"5min":2.9590000000000001,"15min":3.6749999999999998},"last":0.82299999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.753,"15min":0.81799999999999995},"min":{"1min":0.58099999999999996,"5min":0.53300000000000003,"15min":0.49199999999999999},"max":{"1min":3.0019999999999998,"5min":3.0019999999999998,"15min":4.0250000000000004},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.73199999999999998,"15min":0.83199999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.44700000000000001},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":7.0259999999999998},"last":0.79600000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575002,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302112,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069728,"statfs":{"total":96636764160,"available":96327401472,"internally_reserved":0,"allocated":745472,"data_stored":346760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.71799999999999997,"15min":0.70599999999999996},"min":{"1min":0.48099999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81999999999999995,"5min":0.97899999999999998,"15min":1.022},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.72099999999999997,"15min":0.69299999999999995},"min":{"1min":0.47499999999999998,"5min":0.41999999999999998,"15min":0.36599999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.079},"last":0.76100000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.73099999999999998,"15min":0.71599999999999997},"min":{"1min":0.45500000000000002,"5min":0.44800000000000001,"15min":0.42799999999999999},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.72299999999999998,"15min":0.71799999999999997},"min":{"1min":0.501,"5min":0.48299999999999998,"15min":0.438},"max":{"1min":0.84999999999999998,"5min":1.0109999999999999,"15min":1.034},"last":0.78900000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.42599999999999999},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.45200000000000001},"max":{"1min":0.79200000000000004,"5min":0.96699999999999997,"15min":1.0900000000000001},"last":0.55900000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.71299999999999997,"15min":0.69199999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.89800000000000002,"5min":0.91700000000000004,"15min":1.046},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77000000000000002,"15min":0.753},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.497},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.88}]},{"osd":4,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63,"15min":0.63700000000000001},"min":{"1min":0.41299999999999998,"5min":0.38,"15min":0.377},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.626},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.98499999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64600000000000002,"15min":0.65800000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68600000000000005,"15min":0.70199999999999996},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.42299999999999999},"max":{"1min":0.84099999999999997,"5min":1.012,"15min":1.0669999999999999},"last":0.81599999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68200000000000005,"15min":0.68600000000000005},"min":{"1min":0.47299999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.72499999999999998,"15min":0.73199999999999998},"min":{"1min":0.44600000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.96499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":346186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46000000000000002,"15min":0.45600000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56999999999999995,"5min":0.90300000000000002,"15min":1.2729999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48799999999999999,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.311,"15min":0.23699999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.91200000000000003},"last":0.44500000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.498,"15min":0.48599999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.29599999999999999},"max":{"1min":0.64900000000000002,"5min":0.67800000000000005,"15min":0.91900000000000004},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57799999999999996,"15min":0.56699999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77900000000000003,"5min":0.83999999999999997,"15min":1.3340000000000001},"last":0.48199999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.622,"15min":0.59899999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.34100000000000003},"max":{"1min":0.73699999999999999,"5min":0.89500000000000002,"15min":1.365},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.34100000000000003},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.63300000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.78400000000000003,"15min":0.77200000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.995,"5min":1.0529999999999999,"15min":1.234},"last":0.66000000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79200000000000004,"15min":0.77200000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0309999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.78600000000000003,"15min":0.77600000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.47999999999999998},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.69099999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.80500000000000005,"15min":0.79000000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.3029999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.80400000000000005,"15min":0.79200000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0980000000000001,"5min":1.222,"15min":1.222},"last":0.69999999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.83599999999999997,"15min":0.82599999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.53500000000000003},"max":{"1min":1.129,"5min":1.129,"15min":1.4510000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.82999999999999996,"15min":0.81899999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.115,"5min":1.179,"15min":1.1970000000000001},"last":0.76600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575002,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":1335296,"data_stored":936518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47499999999999998,"15min":0.47099999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.23000000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":1.2729999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.56699999999999995,"15min":0.53300000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.28899999999999998},"max":{"1min":4.5819999999999999,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":0.45100000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.58799999999999997,"15min":0.55600000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":4.6980000000000004,"5min":4.6980000000000004,"15min":4.6980000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.51500000000000001,"15min":0.48999999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.55100000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.7130000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.63500000000000001,"15min":0.61799999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":4.734,"5min":4.734,"15min":4.734},"last":0.495}]},{"osd":4,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.78300000000000003,"15min":0.77500000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.103,"5min":1.218,"15min":1.752},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.82399999999999995,"15min":0.80800000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":4.6619999999999999,"5min":4.6619999999999999,"15min":4.6619999999999999},"last":0.75800000000000001}]},{"osd":5,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.2769999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.80100000000000005,"15min":0.80700000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0840000000000001,"5min":1.2809999999999999,"15min":1.7889999999999999},"last":0.88400000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.83399999999999996,"15min":0.82599999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.50900000000000001},"max":{"1min":4.6239999999999997,"5min":4.6239999999999997,"15min":4.6239999999999997},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.80600000000000005,"15min":0.81200000000000006},"min":{"1min":0.50800000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.228,"5min":1.2689999999999999,"15min":1.4370000000000001},"last":0.74399999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.83499999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.256,"5min":1.256,"15min":1.518},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.85599999999999998,"15min":0.85999999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.702,"5min":1.702,"15min":1.8200000000000001},"last":0.82199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575002,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306216,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065624,"statfs":{"total":96636764160,"available":96323198976,"internally_reserved":0,"allocated":753664,"data_stored":347674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.46000000000000002,"15min":0.45800000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.25900000000000001},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.498,"15min":0.499},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.484},"last":0.56200000000000006}]},{"osd":1,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.47899999999999998,"15min":0.496},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.623,"5min":0.80700000000000005,"15min":1.865},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.50800000000000001,"15min":0.52600000000000002},"min":{"1min":0.36199999999999999,"5min":0.33700000000000002,"15min":0.32200000000000001},"max":{"1min":0.66500000000000004,"5min":0.747,"15min":1.79},"last":0.65700000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.41699999999999998,"5min":0.38600000000000001,"15min":0.35799999999999998},"max":{"1min":0.84499999999999997,"5min":0.87,"15min":1.8999999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.38500000000000001},"max":{"1min":0.84799999999999998,"5min":0.85199999999999998,"15min":1.8220000000000001},"last":0.61799999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.77900000000000003,"15min":0.754},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.42899999999999999},"max":{"1min":1.1799999999999999,"5min":1.256,"15min":1.256},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.77800000000000002,"15min":0.77400000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.44800000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.63}]},{"osd":5,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78800000000000003,"15min":0.76900000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.79100000000000004,"15min":0.77300000000000002},"min":{"1min":0.58299999999999996,"5min":0.57199999999999995,"15min":0.503},"max":{"1min":0.98799999999999999,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.69499999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.79900000000000004,"15min":0.78800000000000003},"min":{"1min":0.55100000000000005,"5min":0.54900000000000004,"15min":0.48599999999999999},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.81200000000000006,"15min":0.79800000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.5309999999999999},"last":0.71099999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.82399999999999995,"15min":0.80800000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.84399999999999997,"15min":0.82399999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.50900000000000001},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.81799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575003,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302116,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069724,"statfs":{"total":96636764160,"available":96327397376,"internally_reserved":0,"allocated":749568,"data_stored":346726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47599999999999998,"15min":0.45900000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.24099999999999999},"max":{"1min":0.81200000000000006,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50900000000000001,"15min":0.47799999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.28100000000000003},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.42899999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.499,"15min":0.47899999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.55700000000000005,"15min":0.53400000000000003},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.67800000000000005,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52900000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59599999999999997,"15min":0.57099999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.38500000000000001},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.64600000000000002,"15min":0.61899999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":3.8900000000000001,"5min":3.8900000000000001,"15min":3.8900000000000001},"last":0.59799999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76100000000000001,"15min":0.74299999999999999},"min":{"1min":0.48299999999999998,"5min":0.47199999999999998,"15min":0.40799999999999997},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.83999999999999997,"15min":0.81599999999999995},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.52200000000000002},"max":{"1min":1.081,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.77800000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.76900000000000002,"15min":0.749},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96999999999999997,"5min":1.091,"15min":2.1549999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.81599999999999995,"15min":0.79600000000000004},"min":{"1min":0.58199999999999996,"5min":0.56499999999999995,"15min":0.50600000000000001},"max":{"1min":0.97299999999999998,"5min":1.0800000000000001,"15min":1.419},"last":0.68799999999999994}]},{"osd":6,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.79700000000000004,"15min":0.77500000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.51700000000000002},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.81200000000000006,"15min":0.77500000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.51500000000000001},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.83599999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.84799999999999998,"15min":0.82499999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.55500000000000005},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":2.0880000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.84699999999999998,"15min":0.82699999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.56499999999999995},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.71599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575002,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306212,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065628,"statfs":{"total":96636764160,"available":96323203072,"internally_reserved":0,"allocated":749568,"data_stored":347652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73699999999999999,"15min":0.69499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35499999999999998},"max":{"1min":3.1139999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.73599999999999999,"15min":0.70899999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.39300000000000002},"max":{"1min":2.8130000000000002,"5min":2.8130000000000002,"15min":3.23},"last":0.74299999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73199999999999998,"15min":0.70099999999999996},"min":{"1min":0.46999999999999997,"5min":0.45800000000000002,"15min":0.373},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.78200000000000003,"15min":0.74199999999999999},"min":{"1min":0.46300000000000002,"5min":0.45100000000000001,"15min":0.40500000000000003},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.69499999999999995}]},{"osd":2,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78100000000000003,"15min":0.754},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.38100000000000001},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":3.7509999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.80100000000000005,"15min":0.77900000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":0.71199999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76400000000000001,"15min":0.751},"min":{"1min":0.51000000000000001,"5min":0.434,"15min":0.434},"max":{"1min":2.6440000000000001,"5min":2.6440000000000001,"15min":3.6970000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.78900000000000003,"15min":0.73799999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.6899999999999999,"5min":3.6899999999999999,"15min":3.6899999999999999},"last":0.80200000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":3.3860000000000001,"5min":3.3860000000000001,"15min":3.4780000000000002},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.68799999999999994,"15min":0.68000000000000005},"min":{"1min":0.39100000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.45800000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.67000000000000004,"15min":0.66700000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":3.5270000000000001,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.374},"max":{"1min":3.4740000000000002,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.53500000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.7210000000000001,"5min":2.7210000000000001,"15min":3.2789999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":3.7280000000000002,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.57499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575003,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":346186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.69299999999999995,"15min":0.70199999999999996},"min":{"1min":0.39800000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.91600000000000004,"15min":1.655},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.68500000000000005,"15min":0.68999999999999995},"min":{"1min":0.34499999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79800000000000004,"5min":0.99099999999999999,"15min":1.1359999999999999},"last":0.57899999999999996}]},{"osd":1,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.66800000000000004,"15min":0.71599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79500000000000004,"5min":1.034,"15min":2.4159999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.71199999999999997,"15min":0.73099999999999998},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81699999999999995,"5min":1.0229999999999999,"15min":1.706},"last":0.64700000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.72099999999999997,"15min":0.74299999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.42999999999999999},"max":{"1min":0.79900000000000004,"5min":0.97499999999999998,"15min":1.79},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.69599999999999995,"15min":0.73399999999999999},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.442},"max":{"1min":0.80300000000000005,"5min":1.004,"15min":2.4889999999999999},"last":0.72299999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.69699999999999995,"15min":0.72699999999999998},"min":{"1min":0.503,"5min":0.435,"15min":0.435},"max":{"1min":0.84299999999999997,"5min":0.95499999999999996,"15min":1.409},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.75800000000000001,"15min":0.79400000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.88600000000000001,"5min":1.0629999999999999,"15min":2.532},"last":0.66300000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59099999999999997,"15min":0.63600000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84799999999999998,"5min":0.91300000000000003,"15min":1.766},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.65500000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.35799999999999998},"max":{"1min":0.86199999999999999,"5min":0.98199999999999998,"15min":2.7829999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.628,"15min":0.67300000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.93000000000000005,"5min":0.97699999999999998,"15min":2.5739999999999998},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.67100000000000004,"15min":0.69899999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.38900000000000001},"max":{"1min":0.86899999999999999,"5min":0.95299999999999996,"15min":1.8080000000000001},"last":0.623}]},{"osd":7,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67800000000000005,"15min":0.72499999999999998},"min":{"1min":0.48599999999999999,"5min":0.45500000000000002,"15min":0.436},"max":{"1min":0.91500000000000004,"5min":0.94499999999999995,"15min":2.9609999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75,"15min":0.80400000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.45900000000000002},"max":{"1min":0.96699999999999997,"5min":0.998,"15min":2.613},"last":0.74299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:55:12.152 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T06:55:12.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.362+0000 7f801ebff700 1 Processor -- start 2023-10-09T06:55:12.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.362+0000 7f801ebff700 1 -- start start 2023-10-09T06:55:12.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.364+0000 7f801ebff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f80180b12e0 0x7f80180af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:12.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.364+0000 7f801ebff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80180c9810 con 0x7f80180cacb0 2023-10-09T06:55:12.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.364+0000 7f801ebff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80180adf80 con 0x7f8018156770 2023-10-09T06:55:12.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.364+0000 7f801ebff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80180c9680 con 0x7f80180b12e0 2023-10-09T06:55:12.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.364+0000 7f801d19c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f80180cacb0 0x7f80180af830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48630/0 (socket says 172.21.15.71:48630) 2023-10-09T06:55:12.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.364+0000 7f801d19c700 1 -- 172.21.15.71:0/2781551042 learned_addr learned my addr 172.21.15.71:0/2781551042 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:55:12.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.364+0000 7f8017fff700 1 --2- 172.21.15.71:0/2781551042 >> v2:172.21.15.179:3300/0 conn(0x7f80180b12e0 0x7f80180af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:12.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.364+0000 7f80177fe700 1 -- 172.21.15.71:0/2781551042 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364652652 0 0) 0x7f80180c9810 con 0x7f80180cacb0 2023-10-09T06:55:12.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.364+0000 7f80177fe700 1 -- 172.21.15.71:0/2781551042 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8008003570 con 0x7f80180cacb0 2023-10-09T06:55:12.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.365+0000 7f80177fe700 1 -- 172.21.15.71:0/2781551042 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977735175 0 0) 0x7f80180adf80 con 0x7f8018156770 2023-10-09T06:55:12.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.365+0000 7f80177fe700 1 -- 172.21.15.71:0/2781551042 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80180c9810 con 0x7f8018156770 2023-10-09T06:55:12.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.365+0000 7f80177fe700 1 -- 172.21.15.71:0/2781551042 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 830197682 0 0) 0x7f8008003570 con 0x7f80180cacb0 2023-10-09T06:55:12.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.365+0000 7f80177fe700 1 -- 172.21.15.71:0/2781551042 >> v2:172.21.15.179:3300/0 conn(0x7f80180b12e0 msgr2=0x7f80180af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:12.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.365+0000 7f80177fe700 1 --2- 172.21.15.71:0/2781551042 >> v2:172.21.15.179:3300/0 conn(0x7f80180b12e0 0x7f80180af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:12.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.365+0000 7f80177fe700 1 -- 172.21.15.71:0/2781551042 >> v1:172.21.15.179:6789/0 conn(0x7f8018156770 legacy=0x7f80180b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:12.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.365+0000 7f80177fe700 1 -- 172.21.15.71:0/2781551042 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80180ae260 con 0x7f80180cacb0 2023-10-09T06:55:12.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.365+0000 7f80177fe700 1 -- 172.21.15.71:0/2781551042 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f80100017f0 con 0x7f80180cacb0 2023-10-09T06:55:12.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.365+0000 7f80177fe700 1 -- 172.21.15.71:0/2781551042 >> v1:172.21.15.71:6789/0 conn(0x7f80180cacb0 legacy=0x7f80180af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:12.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.365+0000 7f80177fe700 1 --2- 172.21.15.71:0/2781551042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8008003bf0 0x7f8008003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:12.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.365+0000 7f80177fe700 1 --2- 172.21.15.71:0/2781551042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8008004810 0x7f8008004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:12.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.365+0000 7f80177fe700 1 --2- 172.21.15.71:0/2781551042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80080051c0 0x7f800800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:12.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.365+0000 7f80177fe700 1 -- 172.21.15.71:0/2781551042 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80180c9680 con 0x7f80080051c0 2023-10-09T06:55:12.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.365+0000 7f80177fe700 1 -- 172.21.15.71:0/2781551042 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800800c0b0 con 0x7f8008004810 2023-10-09T06:55:12.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.365+0000 7f80177fe700 1 -- 172.21.15.71:0/2781551042 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800800e480 con 0x7f8008003bf0 2023-10-09T06:55:12.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.365+0000 7f801d19c700 1 --2- 172.21.15.71:0/2781551042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80080051c0 0x7f800800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:12.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.365+0000 7f8017fff700 1 --2- 172.21.15.71:0/2781551042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8008004810 0x7f8008004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:12.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.365+0000 7f801c99b700 1 --2- 172.21.15.71:0/2781551042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8008003bf0 0x7f8008003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:12.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.366+0000 7f801d19c700 1 -- 172.21.15.71:0/2781551042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8008003bf0 msgr2=0x7f8008003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:12.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.366+0000 7f801d19c700 1 --2- 172.21.15.71:0/2781551042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8008003bf0 0x7f8008003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:12.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.366+0000 7f801d19c700 1 -- 172.21.15.71:0/2781551042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8008004810 msgr2=0x7f8008004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:12.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.366+0000 7f801d19c700 1 --2- 172.21.15.71:0/2781551042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8008004810 0x7f8008004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:12.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.366+0000 7f801d19c700 1 -- 172.21.15.71:0/2781551042 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8008003570 con 0x7f80080051c0 2023-10-09T06:55:12.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.366+0000 7f801d19c700 1 -- 172.21.15.71:0/2781551042 reap_dead start 2023-10-09T06:55:12.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.366+0000 7f801d19c700 1 --2- 172.21.15.71:0/2781551042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80080051c0 0x7f800800ba60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f801000a8d0 tx=0x7f8010002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0623731bea54c92 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:12.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.366+0000 7f80177fe700 1 -- 172.21.15.71:0/2781551042 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80100070d0 con 0x7f80080051c0 2023-10-09T06:55:12.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.366+0000 7f80177fe700 1 -- 172.21.15.71:0/2781551042 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8010007270 con 0x7f80080051c0 2023-10-09T06:55:12.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.366+0000 7f80177fe700 1 -- 172.21.15.71:0/2781551042 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8010007630 con 0x7f80080051c0 2023-10-09T06:55:12.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.367+0000 7f801ebff700 1 -- 172.21.15.71:0/2781551042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80080051c0 msgr2=0x7f800800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:12.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.367+0000 7f801ebff700 1 --2- 172.21.15.71:0/2781551042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80080051c0 0x7f800800ba60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f801000a8d0 tx=0x7f8010002190 comp rx=0 tx=0).stop 2023-10-09T06:55:12.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.367+0000 7f801ebff700 1 -- 172.21.15.71:0/2781551042 shutdown_connections 2023-10-09T06:55:12.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.367+0000 7f801ebff700 1 --2- 172.21.15.71:0/2781551042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80080051c0 0x7f800800ba60 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:12.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.367+0000 7f801ebff700 1 -- 172.21.15.71:0/2781551042 >> 172.21.15.71:0/2781551042 conn(0x7f801806a310 msgr2=0x7f80180cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:12.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.367+0000 7f801ebff700 1 -- 172.21.15.71:0/2781551042 shutdown_connections 2023-10-09T06:55:12.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.367+0000 7f801ebff700 1 -- 172.21.15.71:0/2781551042 wait complete. 2023-10-09T06:55:12.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.368+0000 7f801ebff700 1 Processor -- start 2023-10-09T06:55:12.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.368+0000 7f801ebff700 1 -- start start 2023-10-09T06:55:12.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.369+0000 7f801ebff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80080051c0 0x7f801815a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:12.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.369+0000 7f801ebff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f801806de30 0x7f801806f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:12.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.369+0000 7f801ebff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f801813fdf0 0x7f80180af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:12.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.369+0000 7f801ebff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801806e2a0 con 0x7f80080051c0 2023-10-09T06:55:12.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.369+0000 7f801ebff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8018157e00 con 0x7f801813fdf0 2023-10-09T06:55:12.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.369+0000 7f801ebff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801806faa0 con 0x7f801806de30 2023-10-09T06:55:12.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.369+0000 7f801c99b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80080051c0 0x7f801815a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:12.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.369+0000 7f801c99b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80080051c0 0x7f801815a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39462/0 (socket says 172.21.15.71:39462) 2023-10-09T06:55:12.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.369+0000 7f801c99b700 1 -- 172.21.15.71:0/3776797680 learned_addr learned my addr 172.21.15.71:0/3776797680 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:12.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.370+0000 7f8017fff700 1 --2- 172.21.15.71:0/3776797680 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f801806de30 0x7f801806f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:12.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.370+0000 7f801d19c700 1 --2- 172.21.15.71:0/3776797680 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f801813fdf0 0x7f80180af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:12.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.370+0000 7f801c99b700 1 -- 172.21.15.71:0/3776797680 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f801806de30 msgr2=0x7f801806f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:12.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.370+0000 7f801c99b700 1 --2- 172.21.15.71:0/3776797680 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f801806de30 0x7f801806f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:12.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.370+0000 7f801c99b700 1 -- 172.21.15.71:0/3776797680 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f801813fdf0 msgr2=0x7f80180af4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:12.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.370+0000 7f801c99b700 1 --2- 172.21.15.71:0/3776797680 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f801813fdf0 0x7f80180af4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:12.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.370+0000 7f801c99b700 1 -- 172.21.15.71:0/3776797680 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801806e4c0 con 0x7f80080051c0 2023-10-09T06:55:12.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.370+0000 7f8017fff700 1 --2- 172.21.15.71:0/3776797680 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f801806de30 0x7f801806f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:55:12.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.370+0000 7f801c99b700 1 --2- 172.21.15.71:0/3776797680 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80080051c0 0x7f801815a480 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f800c002b20 tx=0x7f800c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:12.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.370+0000 7f8014ff9700 1 -- 172.21.15.71:0/3776797680 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c00f9a0 con 0x7f80080051c0 2023-10-09T06:55:12.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.370+0000 7f8014ff9700 1 -- 172.21.15.71:0/3776797680 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c00fb20 con 0x7f80080051c0 2023-10-09T06:55:12.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.370+0000 7f801ebff700 1 -- 172.21.15.71:0/3776797680 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801806e7a0 con 0x7f80080051c0 2023-10-09T06:55:12.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.370+0000 7f8014ff9700 1 -- 172.21.15.71:0/3776797680 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c00fee0 con 0x7f80080051c0 2023-10-09T06:55:12.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.370+0000 7f801ebff700 1 -- 172.21.15.71:0/3776797680 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801806ed60 con 0x7f80080051c0 2023-10-09T06:55:12.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.371+0000 7f801ebff700 1 -- 172.21.15.71:0/3776797680 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f801804c3c0 con 0x7f80080051c0 2023-10-09T06:55:12.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.372+0000 7f8014ff9700 1 -- 172.21.15.71:0/3776797680 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f800c013600 con 0x7f80080051c0 2023-10-09T06:55:12.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.373+0000 7f8014ff9700 1 --2- 172.21.15.71:0/3776797680 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ffc066f30 0x7f7ffc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:12.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.374+0000 7f8014ff9700 1 -- 172.21.15.71:0/3776797680 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f800c084f30 con 0x7f80080051c0 2023-10-09T06:55:12.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.374+0000 7f8017fff700 1 --2- 172.21.15.71:0/3776797680 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ffc066f30 0x7f7ffc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:12.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.375+0000 7f8017fff700 1 --2- 172.21.15.71:0/3776797680 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ffc066f30 0x7f7ffc0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8004006f00 tx=0x7f8004008040 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:12.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.377+0000 7f8014ff9700 1 -- 172.21.15.71:0/3776797680 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f800c051f90 con 0x7f80080051c0 2023-10-09T06:55:12.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.642+0000 7f801ebff700 1 -- 172.21.15.71:0/3776797680 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f80180ae540 con 0x7f80080051c0 2023-10-09T06:55:12.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.642+0000 7f8014ff9700 1 -- 172.21.15.71:0/3776797680 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1015 (secure 0 0 0) 0x7f800c0555b0 con 0x7f80080051c0 2023-10-09T06:55:12.729 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:55:12.729 INFO:teuthology.orchestra.run.smithi071.stdout:{"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":778,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":62,"num_osds":8,"num_up_osds":8,"osd_up_since":1696833745,"num_in_osds":8,"osd_in_since":1696833737,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592674,"bytes_used":2476089344,"bytes_avail":770618023936,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":24,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5727}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-10-09T06:44:54.703310+0000","services":{}},"progress_events":{}} 2023-10-09T06:55:12.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.644+0000 7f801ebff700 1 -- 172.21.15.71:0/3776797680 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ffc066f30 msgr2=0x7f7ffc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:12.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.644+0000 7f801ebff700 1 --2- 172.21.15.71:0/3776797680 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ffc066f30 0x7f7ffc0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8004006f00 tx=0x7f8004008040 comp rx=0 tx=0).stop 2023-10-09T06:55:12.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.644+0000 7f801ebff700 1 -- 172.21.15.71:0/3776797680 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80080051c0 msgr2=0x7f801815a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:12.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.644+0000 7f801ebff700 1 --2- 172.21.15.71:0/3776797680 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80080051c0 0x7f801815a480 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f800c002b20 tx=0x7f800c007d30 comp rx=0 tx=0).stop 2023-10-09T06:55:12.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.645+0000 7f801ebff700 1 -- 172.21.15.71:0/3776797680 shutdown_connections 2023-10-09T06:55:12.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.645+0000 7f801ebff700 1 --2- 172.21.15.71:0/3776797680 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f801813fdf0 0x7f80180af4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:12.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.645+0000 7f801ebff700 1 --2- 172.21.15.71:0/3776797680 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7ffc066f30 0x7f7ffc0693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:12.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.645+0000 7f801ebff700 1 --2- 172.21.15.71:0/3776797680 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80080051c0 0x7f801815a480 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:12.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.645+0000 7f801ebff700 1 --2- 172.21.15.71:0/3776797680 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f801806de30 0x7f801806f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:12.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.645+0000 7f801ebff700 1 -- 172.21.15.71:0/3776797680 >> 172.21.15.71:0/3776797680 conn(0x7f801806a310 msgr2=0x7f80180abd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:12.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.645+0000 7f801ebff700 1 -- 172.21.15.71:0/3776797680 shutdown_connections 2023-10-09T06:55:12.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.645+0000 7f801ebff700 1 -- 172.21.15.71:0/3776797680 wait complete. 2023-10-09T06:55:12.732 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T06:55:12.732 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:55:12.903 INFO:tasks.ceph.mds.c.smithi071.stderr:2023-10-09T06:55:12.902+0000 7f09129f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:55:12.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.912+0000 7fc8a29ff700 1 Processor -- start 2023-10-09T06:55:12.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.912+0000 7fc8a29ff700 1 -- start start 2023-10-09T06:55:12.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.914+0000 7fc8a29ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc89c155c10 0x7fc89c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:12.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.914+0000 7fc8a29ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89c0ac6d0 0x7fc89c0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:12.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.914+0000 7fc8a29ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc89c0acac0 con 0x7fc89c0ac230 2023-10-09T06:55:12.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.914+0000 7fc8a29ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc89c0ad930 con 0x7fc89c155c10 2023-10-09T06:55:12.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.914+0000 7fc8a29ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c0acd20 con 0x7fc89c0ac6d0 2023-10-09T06:55:12.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.914+0000 7fc89bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc89c155c10 0x7fc89c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:12.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.914+0000 7fc89bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc89c155c10 0x7fc89c155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39464/0 (socket says 172.21.15.71:39464) 2023-10-09T06:55:12.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.914+0000 7fc89bfff700 1 -- 172.21.15.71:0/1863493216 learned_addr learned my addr 172.21.15.71:0/1863493216 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:12.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.914+0000 7fc8a0f9c700 1 --2- 172.21.15.71:0/1863493216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89c0ac6d0 0x7fc89c0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:12.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.915+0000 7fc89bfff700 1 -- 172.21.15.71:0/1863493216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89c0ac6d0 msgr2=0x7fc89c0b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:12.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.915+0000 7fc89bfff700 1 --2- 172.21.15.71:0/1863493216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89c0ac6d0 0x7fc89c0b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:12.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.915+0000 7fc89bfff700 1 -- 172.21.15.71:0/1863493216 >> v1:172.21.15.71:6789/0 conn(0x7fc89c0ac230 legacy=0x7fc89c1568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:12.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.915+0000 7fc89bfff700 1 -- 172.21.15.71:0/1863493216 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89c0ad000 con 0x7fc89c155c10 2023-10-09T06:55:12.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.915+0000 7fc89bfff700 1 --2- 172.21.15.71:0/1863493216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc89c155c10 0x7fc89c155fe0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0acc50 tx=0x7fc88c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05e232c27397769 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:12.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.915+0000 7fc89b7fe700 1 -- 172.21.15.71:0/1863493216 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c00dc50 con 0x7fc89c155c10 2023-10-09T06:55:12.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.915+0000 7fc89b7fe700 1 -- 172.21.15.71:0/1863493216 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88c00ddb0 con 0x7fc89c155c10 2023-10-09T06:55:12.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.915+0000 7fc89b7fe700 1 -- 172.21.15.71:0/1863493216 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c0106a0 con 0x7fc89c155c10 2023-10-09T06:55:12.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.916+0000 7fc8a29ff700 1 -- 172.21.15.71:0/1863493216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc89c155c10 msgr2=0x7fc89c155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:12.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.916+0000 7fc8a29ff700 1 --2- 172.21.15.71:0/1863493216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc89c155c10 0x7fc89c155fe0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0acc50 tx=0x7fc88c00b4f0 comp rx=0 tx=0).stop 2023-10-09T06:55:12.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.916+0000 7fc8a29ff700 1 -- 172.21.15.71:0/1863493216 shutdown_connections 2023-10-09T06:55:12.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.916+0000 7fc8a29ff700 1 --2- 172.21.15.71:0/1863493216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89c0ac6d0 0x7fc89c0b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:12.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.916+0000 7fc8a29ff700 1 --2- 172.21.15.71:0/1863493216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc89c155c10 0x7fc89c155fe0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:12.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.916+0000 7fc8a29ff700 1 -- 172.21.15.71:0/1863493216 >> 172.21.15.71:0/1863493216 conn(0x7fc89c06a320 msgr2=0x7fc89c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:12.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.916+0000 7fc8a29ff700 1 -- 172.21.15.71:0/1863493216 shutdown_connections 2023-10-09T06:55:12.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.916+0000 7fc8a29ff700 1 -- 172.21.15.71:0/1863493216 wait complete. 2023-10-09T06:55:12.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.917+0000 7fc8a29ff700 1 Processor -- start 2023-10-09T06:55:12.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.917+0000 7fc8a29ff700 1 -- start start 2023-10-09T06:55:12.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.918+0000 7fc8a29ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc89c0ac230 0x7fc89c148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:12.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.918+0000 7fc8a29ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89c0ac6d0 0x7fc89c1513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:12.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.918+0000 7fc8a29ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc89c155c10 0x7fc89c0aaac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:12.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.918+0000 7fc8a29ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c150070 con 0x7fc89c0ac230 2023-10-09T06:55:12.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.918+0000 7fc8a29ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c150350 con 0x7fc89c155c10 2023-10-09T06:55:12.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.918+0000 7fc8a29ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c150630 con 0x7fc89c0ac6d0 2023-10-09T06:55:12.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.918+0000 7fc89bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc89c0ac230 0x7fc89c148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:12.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.919+0000 7fc89bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc89c0ac230 0x7fc89c148080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39470/0 (socket says 172.21.15.71:39470) 2023-10-09T06:55:12.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.919+0000 7fc89bfff700 1 -- 172.21.15.71:0/655979248 learned_addr learned my addr 172.21.15.71:0/655979248 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:12.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.919+0000 7fc89bfff700 1 -- 172.21.15.71:0/655979248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89c0ac6d0 msgr2=0x7fc89c1513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.919+0000 7fc89bfff700 1 --2- 172.21.15.71:0/655979248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89c0ac6d0 0x7fc89c1513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.919+0000 7fc89bfff700 1 -- 172.21.15.71:0/655979248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc89c155c10 msgr2=0x7fc89c0aaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.919+0000 7fc89bfff700 1 --2- 172.21.15.71:0/655979248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc89c155c10 0x7fc89c0aaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.919+0000 7fc89bfff700 1 -- 172.21.15.71:0/655979248 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88c00b790 con 0x7fc89c0ac230 2023-10-09T06:55:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.919+0000 7fc89bfff700 1 --2- 172.21.15.71:0/655979248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc89c0ac230 0x7fc89c148080 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00b530 tx=0x7fc88c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.919+0000 7fc898ff9700 1 -- 172.21.15.71:0/655979248 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c018800 con 0x7fc89c0ac230 2023-10-09T06:55:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.919+0000 7fc898ff9700 1 -- 172.21.15.71:0/655979248 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88c018980 con 0x7fc89c0ac230 2023-10-09T06:55:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.919+0000 7fc8a29ff700 1 -- 172.21.15.71:0/655979248 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc89c150910 con 0x7fc89c0ac230 2023-10-09T06:55:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.919+0000 7fc898ff9700 1 -- 172.21.15.71:0/655979248 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c018d40 con 0x7fc89c0ac230 2023-10-09T06:55:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.920+0000 7fc8a29ff700 1 -- 172.21.15.71:0/655979248 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc89c150ed0 con 0x7fc89c0ac230 2023-10-09T06:55:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.921+0000 7fc8a29ff700 1 -- 172.21.15.71:0/655979248 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc89c1510c0 con 0x7fc89c0ac230 2023-10-09T06:55:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.921+0000 7fc898ff9700 1 -- 172.21.15.71:0/655979248 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc88c00f3d0 con 0x7fc89c0ac230 2023-10-09T06:55:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.922+0000 7fc898ff9700 1 --2- 172.21.15.71:0/655979248 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc87c066f30 0x7fc87c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.922+0000 7fc898ff9700 1 -- 172.21.15.71:0/655979248 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fc88c014070 con 0x7fc89c0ac230 2023-10-09T06:55:12.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.923+0000 7fc893fff700 1 --2- 172.21.15.71:0/655979248 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc87c066f30 0x7fc87c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:12.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.924+0000 7fc893fff700 1 --2- 172.21.15.71:0/655979248 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc87c066f30 0x7fc87c0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0b0d50 tx=0x7fc884007b40 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:12.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:12.927+0000 7fc898ff9700 1 -- 172.21.15.71:0/655979248 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc88c0b75a0 con 0x7fc89c0ac230 2023-10-09T06:55:13.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:13.115+0000 7fc8a29ff700 1 -- 172.21.15.71:0/655979248 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc89c04c3c0 con 0x7fc87c066f30 2023-10-09T06:55:13.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:13.125+0000 7fc898ff9700 1 -- 172.21.15.71:0/655979248 <== mgr.5015 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289166 (secure 0 0 0) 0x7fc89c04c3c0 con 0x7fc87c066f30 2023-10-09T06:55:13.134 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:55:13.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:13.129+0000 7fc8a29ff700 1 -- 172.21.15.71:0/655979248 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc87c066f30 msgr2=0x7fc87c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:13.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:13.129+0000 7fc8a29ff700 1 --2- 172.21.15.71:0/655979248 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc87c066f30 0x7fc87c0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0b0d50 tx=0x7fc884007b40 comp rx=0 tx=0).stop 2023-10-09T06:55:13.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:13.129+0000 7fc8a29ff700 1 -- 172.21.15.71:0/655979248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc89c0ac230 msgr2=0x7fc89c148080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:13.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:13.129+0000 7fc8a29ff700 1 --2- 172.21.15.71:0/655979248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc89c0ac230 0x7fc89c148080 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00b530 tx=0x7fc88c01a000 comp rx=0 tx=0).stop 2023-10-09T06:55:13.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:13.129+0000 7fc8a29ff700 1 -- 172.21.15.71:0/655979248 shutdown_connections 2023-10-09T06:55:13.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:13.129+0000 7fc8a29ff700 1 --2- 172.21.15.71:0/655979248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc89c155c10 0x7fc89c0aaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:13.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:13.129+0000 7fc8a29ff700 1 --2- 172.21.15.71:0/655979248 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc87c066f30 0x7fc87c0693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:13.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:13.129+0000 7fc8a29ff700 1 --2- 172.21.15.71:0/655979248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc89c0ac230 0x7fc89c148080 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:13.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:13.129+0000 7fc8a29ff700 1 --2- 172.21.15.71:0/655979248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89c0ac6d0 0x7fc89c1513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:13.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:13.129+0000 7fc8a29ff700 1 -- 172.21.15.71:0/655979248 >> 172.21.15.71:0/655979248 conn(0x7fc89c06a320 msgr2=0x7fc89c153b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:13.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:13.129+0000 7fc8a29ff700 1 -- 172.21.15.71:0/655979248 shutdown_connections 2023-10-09T06:55:13.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:13.129+0000 7fc8a29ff700 1 -- 172.21.15.71:0/655979248 wait complete. 2023-10-09T06:55:13.137 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:55:13.147 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T06:55:11.873340+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":243,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":177,"ondisk_log_size":177,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2418056,"kb_used_data":6984,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752556664,"statfs":{"total":773094113280,"available":770618023936,"internally_reserved":0,"allocated":7151616,"data_stored":3954276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001411"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953251+0000","last_change":"2023-10-09T06:55:06.941941+0000","last_active":"2023-10-09T06:55:06.953251+0000","last_peered":"2023-10-09T06:55:06.953251+0000","last_clean":"2023-10-09T06:55:06.953251+0000","last_became_active":"2023-10-09T06:55:06.941652+0000","last_became_peered":"2023-10-09T06:55:06.941652+0000","last_unstale":"2023-10-09T06:55:06.953251+0000","last_undegraded":"2023-10-09T06:55:06.953251+0000","last_fullsized":"2023-10-09T06:55:06.953251+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:13.874146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.952191+0000","last_change":"2023-10-09T06:55:06.949443+0000","last_active":"2023-10-09T06:55:06.952191+0000","last_peered":"2023-10-09T06:55:06.952191+0000","last_clean":"2023-10-09T06:55:06.952191+0000","last_became_active":"2023-10-09T06:55:06.948195+0000","last_became_peered":"2023-10-09T06:55:06.948195+0000","last_unstale":"2023-10-09T06:55:06.952191+0000","last_undegraded":"2023-10-09T06:55:06.952191+0000","last_fullsized":"2023-10-09T06:55:06.952191+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:08.034847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.937992+0000","last_change":"2023-10-09T06:55:06.928307+0000","last_active":"2023-10-09T06:55:06.937992+0000","last_peered":"2023-10-09T06:55:06.937992+0000","last_clean":"2023-10-09T06:55:06.937992+0000","last_became_active":"2023-10-09T06:55:06.928024+0000","last_became_peered":"2023-10-09T06:55:06.928024+0000","last_unstale":"2023-10-09T06:55:06.937992+0000","last_undegraded":"2023-10-09T06:55:06.937992+0000","last_fullsized":"2023-10-09T06:55:06.937992+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:10:57.887526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.957583+0000","last_change":"2023-10-09T06:55:06.953644+0000","last_active":"2023-10-09T06:55:06.957583+0000","last_peered":"2023-10-09T06:55:06.957583+0000","last_clean":"2023-10-09T06:55:06.957583+0000","last_became_active":"2023-10-09T06:55:06.953144+0000","last_became_peered":"2023-10-09T06:55:06.953144+0000","last_unstale":"2023-10-09T06:55:06.957583+0000","last_undegraded":"2023-10-09T06:55:06.957583+0000","last_fullsized":"2023-10-09T06:55:06.957583+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:04.806773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.950648+0000","last_change":"2023-10-09T06:55:06.939943+0000","last_active":"2023-10-09T06:55:06.950648+0000","last_peered":"2023-10-09T06:55:06.950648+0000","last_clean":"2023-10-09T06:55:06.950648+0000","last_became_active":"2023-10-09T06:55:06.939675+0000","last_became_peered":"2023-10-09T06:55:06.939675+0000","last_unstale":"2023-10-09T06:55:06.950648+0000","last_undegraded":"2023-10-09T06:55:06.950648+0000","last_fullsized":"2023-10-09T06:55:06.950648+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:48.399364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.941216+0000","last_change":"2023-10-09T06:55:06.932908+0000","last_active":"2023-10-09T06:55:06.941216+0000","last_peered":"2023-10-09T06:55:06.941216+0000","last_clean":"2023-10-09T06:55:06.941216+0000","last_became_active":"2023-10-09T06:55:06.932692+0000","last_became_peered":"2023-10-09T06:55:06.932692+0000","last_unstale":"2023-10-09T06:55:06.941216+0000","last_undegraded":"2023-10-09T06:55:06.941216+0000","last_fullsized":"2023-10-09T06:55:06.941216+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:56:01.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.949558+0000","last_change":"2023-10-09T06:55:06.939597+0000","last_active":"2023-10-09T06:55:06.949558+0000","last_peered":"2023-10-09T06:55:06.949558+0000","last_clean":"2023-10-09T06:55:06.949558+0000","last_became_active":"2023-10-09T06:55:06.939344+0000","last_became_peered":"2023-10-09T06:55:06.939344+0000","last_unstale":"2023-10-09T06:55:06.949558+0000","last_undegraded":"2023-10-09T06:55:06.949558+0000","last_fullsized":"2023-10-09T06:55:06.949558+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:27.488161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953884+0000","last_change":"2023-10-09T06:55:06.952049+0000","last_active":"2023-10-09T06:55:06.953884+0000","last_peered":"2023-10-09T06:55:06.953884+0000","last_clean":"2023-10-09T06:55:06.953884+0000","last_became_active":"2023-10-09T06:55:06.951794+0000","last_became_peered":"2023-10-09T06:55:06.951794+0000","last_unstale":"2023-10-09T06:55:06.953884+0000","last_undegraded":"2023-10-09T06:55:06.953884+0000","last_fullsized":"2023-10-09T06:55:06.953884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:58:23.011522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.947762+0000","last_change":"2023-10-09T06:55:06.942297+0000","last_active":"2023-10-09T06:55:06.947762+0000","last_peered":"2023-10-09T06:55:06.947762+0000","last_clean":"2023-10-09T06:55:06.947762+0000","last_became_active":"2023-10-09T06:55:06.941997+0000","last_became_peered":"2023-10-09T06:55:06.941997+0000","last_unstale":"2023-10-09T06:55:06.947762+0000","last_undegraded":"2023-10-09T06:55:06.947762+0000","last_fullsized":"2023-10-09T06:55:06.947762+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:27.365626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.957594+0000","last_change":"2023-10-09T06:55:06.954659+0000","last_active":"2023-10-09T06:55:06.957594+0000","last_peered":"2023-10-09T06:55:06.957594+0000","last_clean":"2023-10-09T06:55:06.957594+0000","last_became_active":"2023-10-09T06:55:06.954424+0000","last_became_peered":"2023-10-09T06:55:06.954424+0000","last_unstale":"2023-10-09T06:55:06.957594+0000","last_undegraded":"2023-10-09T06:55:06.957594+0000","last_fullsized":"2023-10-09T06:55:06.957594+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:26:52.867345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.943599+0000","last_change":"2023-10-09T06:55:06.941384+0000","last_active":"2023-10-09T06:55:06.943599+0000","last_peered":"2023-10-09T06:55:06.943599+0000","last_clean":"2023-10-09T06:55:06.943599+0000","last_became_active":"2023-10-09T06:55:06.935944+0000","last_became_peered":"2023-10-09T06:55:06.935944+0000","last_unstale":"2023-10-09T06:55:06.943599+0000","last_undegraded":"2023-10-09T06:55:06.943599+0000","last_fullsized":"2023-10-09T06:55:06.943599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:48:10.713903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.940869+0000","last_change":"2023-10-09T06:55:06.936144+0000","last_active":"2023-10-09T06:55:06.940869+0000","last_peered":"2023-10-09T06:55:06.940869+0000","last_clean":"2023-10-09T06:55:06.940869+0000","last_became_active":"2023-10-09T06:55:06.935757+0000","last_became_peered":"2023-10-09T06:55:06.935757+0000","last_unstale":"2023-10-09T06:55:06.940869+0000","last_undegraded":"2023-10-09T06:55:06.940869+0000","last_fullsized":"2023-10-09T06:55:06.940869+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:18:06.248699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.934730+0000","last_change":"2023-10-09T06:55:06.929812+0000","last_active":"2023-10-09T06:55:06.934730+0000","last_peered":"2023-10-09T06:55:06.934730+0000","last_clean":"2023-10-09T06:55:06.934730+0000","last_became_active":"2023-10-09T06:55:06.929471+0000","last_became_peered":"2023-10-09T06:55:06.929471+0000","last_unstale":"2023-10-09T06:55:06.934730+0000","last_undegraded":"2023-10-09T06:55:06.934730+0000","last_fullsized":"2023-10-09T06:55:06.934730+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:44.668078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.943753+0000","last_change":"2023-10-09T06:55:06.940701+0000","last_active":"2023-10-09T06:55:06.943753+0000","last_peered":"2023-10-09T06:55:06.943753+0000","last_clean":"2023-10-09T06:55:06.943753+0000","last_became_active":"2023-10-09T06:55:06.935669+0000","last_became_peered":"2023-10-09T06:55:06.935669+0000","last_unstale":"2023-10-09T06:55:06.943753+0000","last_undegraded":"2023-10-09T06:55:06.943753+0000","last_fullsized":"2023-10-09T06:55:06.943753+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:27.310704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948019+0000","last_change":"2023-10-09T06:55:06.941609+0000","last_active":"2023-10-09T06:55:06.948019+0000","last_peered":"2023-10-09T06:55:06.948019+0000","last_clean":"2023-10-09T06:55:06.948019+0000","last_became_active":"2023-10-09T06:55:06.941358+0000","last_became_peered":"2023-10-09T06:55:06.941358+0000","last_unstale":"2023-10-09T06:55:06.948019+0000","last_undegraded":"2023-10-09T06:55:06.948019+0000","last_fullsized":"2023-10-09T06:55:06.948019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:44.434314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953937+0000","last_change":"2023-10-09T06:55:06.951154+0000","last_active":"2023-10-09T06:55:06.953937+0000","last_peered":"2023-10-09T06:55:06.953937+0000","last_clean":"2023-10-09T06:55:06.953937+0000","last_became_active":"2023-10-09T06:55:06.950918+0000","last_became_peered":"2023-10-09T06:55:06.950918+0000","last_unstale":"2023-10-09T06:55:06.953937+0000","last_undegraded":"2023-10-09T06:55:06.953937+0000","last_fullsized":"2023-10-09T06:55:06.953937+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:27.342291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.943250+0000","last_change":"2023-10-09T06:55:06.938814+0000","last_active":"2023-10-09T06:55:06.943250+0000","last_peered":"2023-10-09T06:55:06.943250+0000","last_clean":"2023-10-09T06:55:06.943250+0000","last_became_active":"2023-10-09T06:55:06.938536+0000","last_became_peered":"2023-10-09T06:55:06.938536+0000","last_unstale":"2023-10-09T06:55:06.943250+0000","last_undegraded":"2023-10-09T06:55:06.943250+0000","last_fullsized":"2023-10-09T06:55:06.943250+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:00.077635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.951506+0000","last_change":"2023-10-09T06:55:06.947089+0000","last_active":"2023-10-09T06:55:06.951506+0000","last_peered":"2023-10-09T06:55:06.951506+0000","last_clean":"2023-10-09T06:55:06.951506+0000","last_became_active":"2023-10-09T06:55:06.946423+0000","last_became_peered":"2023-10-09T06:55:06.946423+0000","last_unstale":"2023-10-09T06:55:06.951506+0000","last_undegraded":"2023-10-09T06:55:06.951506+0000","last_fullsized":"2023-10-09T06:55:06.951506+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:27.342291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953339+0000","last_change":"2023-10-09T06:55:06.947260+0000","last_active":"2023-10-09T06:55:06.953339+0000","last_peered":"2023-10-09T06:55:06.953339+0000","last_clean":"2023-10-09T06:55:06.953339+0000","last_became_active":"2023-10-09T06:55:06.946996+0000","last_became_peered":"2023-10-09T06:55:06.946996+0000","last_unstale":"2023-10-09T06:55:06.953339+0000","last_undegraded":"2023-10-09T06:55:06.953339+0000","last_fullsized":"2023-10-09T06:55:06.953339+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:13.874146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.946692+0000","last_change":"2023-10-09T06:55:06.945053+0000","last_active":"2023-10-09T06:55:06.946692+0000","last_peered":"2023-10-09T06:55:06.946692+0000","last_clean":"2023-10-09T06:55:06.946692+0000","last_became_active":"2023-10-09T06:55:06.944789+0000","last_became_peered":"2023-10-09T06:55:06.944789+0000","last_unstale":"2023-10-09T06:55:06.946692+0000","last_undegraded":"2023-10-09T06:55:06.946692+0000","last_fullsized":"2023-10-09T06:55:06.946692+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:08.244758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948157+0000","last_change":"2023-10-09T06:55:06.945836+0000","last_active":"2023-10-09T06:55:06.948157+0000","last_peered":"2023-10-09T06:55:06.948157+0000","last_clean":"2023-10-09T06:55:06.948157+0000","last_became_active":"2023-10-09T06:55:06.945564+0000","last_became_peered":"2023-10-09T06:55:06.945564+0000","last_unstale":"2023-10-09T06:55:06.948157+0000","last_undegraded":"2023-10-09T06:55:06.948157+0000","last_fullsized":"2023-10-09T06:55:06.948157+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:40.055223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955508+0000","last_change":"2023-10-09T06:55:06.953311+0000","last_active":"2023-10-09T06:55:06.955508+0000","last_peered":"2023-10-09T06:55:06.955508+0000","last_clean":"2023-10-09T06:55:06.955508+0000","last_became_active":"2023-10-09T06:55:06.952959+0000","last_became_peered":"2023-10-09T06:55:06.952959+0000","last_unstale":"2023-10-09T06:55:06.955508+0000","last_undegraded":"2023-10-09T06:55:06.955508+0000","last_fullsized":"2023-10-09T06:55:06.955508+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:12:43.264714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948265+0000","last_change":"2023-10-09T06:55:06.942933+0000","last_active":"2023-10-09T06:55:06.948265+0000","last_peered":"2023-10-09T06:55:06.948265+0000","last_clean":"2023-10-09T06:55:06.948265+0000","last_became_active":"2023-10-09T06:55:06.942300+0000","last_became_peered":"2023-10-09T06:55:06.942300+0000","last_unstale":"2023-10-09T06:55:06.948265+0000","last_undegraded":"2023-10-09T06:55:06.948265+0000","last_fullsized":"2023-10-09T06:55:06.948265+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:21.359666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948195+0000","last_change":"2023-10-09T06:55:06.942752+0000","last_active":"2023-10-09T06:55:06.948195+0000","last_peered":"2023-10-09T06:55:06.948195+0000","last_clean":"2023-10-09T06:55:06.948195+0000","last_became_active":"2023-10-09T06:55:06.942448+0000","last_became_peered":"2023-10-09T06:55:06.942448+0000","last_unstale":"2023-10-09T06:55:06.948195+0000","last_undegraded":"2023-10-09T06:55:06.948195+0000","last_fullsized":"2023-10-09T06:55:06.948195+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:47.548592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954067+0000","last_change":"2023-10-09T06:55:06.948333+0000","last_active":"2023-10-09T06:55:06.954067+0000","last_peered":"2023-10-09T06:55:06.954067+0000","last_clean":"2023-10-09T06:55:06.954067+0000","last_became_active":"2023-10-09T06:55:06.946602+0000","last_became_peered":"2023-10-09T06:55:06.946602+0000","last_unstale":"2023-10-09T06:55:06.954067+0000","last_undegraded":"2023-10-09T06:55:06.954067+0000","last_fullsized":"2023-10-09T06:55:06.954067+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:26:48.145004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.942812+0000","last_change":"2023-10-09T06:55:06.939960+0000","last_active":"2023-10-09T06:55:06.942812+0000","last_peered":"2023-10-09T06:55:06.942812+0000","last_clean":"2023-10-09T06:55:06.942812+0000","last_became_active":"2023-10-09T06:55:06.939690+0000","last_became_peered":"2023-10-09T06:55:06.939690+0000","last_unstale":"2023-10-09T06:55:06.942812+0000","last_undegraded":"2023-10-09T06:55:06.942812+0000","last_fullsized":"2023-10-09T06:55:06.942812+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:07:47.321921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.951144+0000","last_change":"2023-10-09T06:55:06.940527+0000","last_active":"2023-10-09T06:55:06.951144+0000","last_peered":"2023-10-09T06:55:06.951144+0000","last_clean":"2023-10-09T06:55:06.951144+0000","last_became_active":"2023-10-09T06:55:06.940228+0000","last_became_peered":"2023-10-09T06:55:06.940228+0000","last_unstale":"2023-10-09T06:55:06.951144+0000","last_undegraded":"2023-10-09T06:55:06.951144+0000","last_fullsized":"2023-10-09T06:55:06.951144+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:21.359666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.950449+0000","last_change":"2023-10-09T06:55:06.938753+0000","last_active":"2023-10-09T06:55:06.950449+0000","last_peered":"2023-10-09T06:55:06.950449+0000","last_clean":"2023-10-09T06:55:06.950449+0000","last_became_active":"2023-10-09T06:55:06.938454+0000","last_became_peered":"2023-10-09T06:55:06.938454+0000","last_unstale":"2023-10-09T06:55:06.950449+0000","last_undegraded":"2023-10-09T06:55:06.950449+0000","last_fullsized":"2023-10-09T06:55:06.950449+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:10.372066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954064+0000","last_change":"2023-10-09T06:55:06.945602+0000","last_active":"2023-10-09T06:55:06.954064+0000","last_peered":"2023-10-09T06:55:06.954064+0000","last_clean":"2023-10-09T06:55:06.954064+0000","last_became_active":"2023-10-09T06:55:06.945315+0000","last_became_peered":"2023-10-09T06:55:06.945315+0000","last_unstale":"2023-10-09T06:55:06.954064+0000","last_undegraded":"2023-10-09T06:55:06.954064+0000","last_fullsized":"2023-10-09T06:55:06.954064+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:22.559262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.939241+0000","last_change":"2023-10-09T06:55:06.932066+0000","last_active":"2023-10-09T06:55:06.939241+0000","last_peered":"2023-10-09T06:55:06.939241+0000","last_clean":"2023-10-09T06:55:06.939241+0000","last_became_active":"2023-10-09T06:55:06.931575+0000","last_became_peered":"2023-10-09T06:55:06.931575+0000","last_unstale":"2023-10-09T06:55:06.939241+0000","last_undegraded":"2023-10-09T06:55:06.939241+0000","last_fullsized":"2023-10-09T06:55:06.939241+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:30:30.430228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948071+0000","last_change":"2023-10-09T06:55:06.943815+0000","last_active":"2023-10-09T06:55:06.948071+0000","last_peered":"2023-10-09T06:55:06.948071+0000","last_clean":"2023-10-09T06:55:06.948071+0000","last_became_active":"2023-10-09T06:55:06.943558+0000","last_became_peered":"2023-10-09T06:55:06.943558+0000","last_unstale":"2023-10-09T06:55:06.948071+0000","last_undegraded":"2023-10-09T06:55:06.948071+0000","last_fullsized":"2023-10-09T06:55:06.948071+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:24:19.345593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.934846+0000","last_change":"2023-10-09T06:55:06.928130+0000","last_active":"2023-10-09T06:55:06.934846+0000","last_peered":"2023-10-09T06:55:06.934846+0000","last_clean":"2023-10-09T06:55:06.934846+0000","last_became_active":"2023-10-09T06:55:06.927851+0000","last_became_peered":"2023-10-09T06:55:06.927851+0000","last_unstale":"2023-10-09T06:55:06.934846+0000","last_undegraded":"2023-10-09T06:55:06.934846+0000","last_fullsized":"2023-10-09T06:55:06.934846+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:18.653877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954325+0000","last_change":"2023-10-09T06:55:06.952189+0000","last_active":"2023-10-09T06:55:06.954325+0000","last_peered":"2023-10-09T06:55:06.954325+0000","last_clean":"2023-10-09T06:55:06.954325+0000","last_became_active":"2023-10-09T06:55:06.951940+0000","last_became_peered":"2023-10-09T06:55:06.951940+0000","last_unstale":"2023-10-09T06:55:06.954325+0000","last_undegraded":"2023-10-09T06:55:06.954325+0000","last_fullsized":"2023-10-09T06:55:06.954325+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:22.559262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"61'4","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955223+0000","last_change":"2023-10-09T06:55:05.933796+0000","last_active":"2023-10-09T06:55:06.955223+0000","last_peered":"2023-10-09T06:55:06.955223+0000","last_clean":"2023-10-09T06:55:06.955223+0000","last_became_active":"2023-10-09T06:55:05.933559+0000","last_became_peered":"2023-10-09T06:55:05.933559+0000","last_unstale":"2023-10-09T06:55:06.955223+0000","last_undegraded":"2023-10-09T06:55:06.955223+0000","last_fullsized":"2023-10-09T06:55:06.955223+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:09.365369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954161+0000","last_change":"2023-10-09T06:55:06.950139+0000","last_active":"2023-10-09T06:55:06.954161+0000","last_peered":"2023-10-09T06:55:06.954161+0000","last_clean":"2023-10-09T06:55:06.954161+0000","last_became_active":"2023-10-09T06:55:06.949821+0000","last_became_peered":"2023-10-09T06:55:06.949821+0000","last_unstale":"2023-10-09T06:55:06.954161+0000","last_undegraded":"2023-10-09T06:55:06.954161+0000","last_fullsized":"2023-10-09T06:55:06.954161+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:00.077635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.952794+0000","last_change":"2023-10-09T06:55:05.931291+0000","last_active":"2023-10-09T06:55:06.952794+0000","last_peered":"2023-10-09T06:55:06.952794+0000","last_clean":"2023-10-09T06:55:06.952794+0000","last_became_active":"2023-10-09T06:55:05.931030+0000","last_became_peered":"2023-10-09T06:55:05.931030+0000","last_unstale":"2023-10-09T06:55:06.952794+0000","last_undegraded":"2023-10-09T06:55:06.952794+0000","last_fullsized":"2023-10-09T06:55:06.952794+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:02:17.540297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.952106+0000","last_change":"2023-10-09T06:55:06.944084+0000","last_active":"2023-10-09T06:55:06.952106+0000","last_peered":"2023-10-09T06:55:06.952106+0000","last_clean":"2023-10-09T06:55:06.952106+0000","last_became_active":"2023-10-09T06:55:06.943799+0000","last_became_peered":"2023-10-09T06:55:06.943799+0000","last_unstale":"2023-10-09T06:55:06.952106+0000","last_undegraded":"2023-10-09T06:55:06.952106+0000","last_fullsized":"2023-10-09T06:55:06.952106+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:12:43.264714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.952611+0000","last_change":"2023-10-09T06:55:05.936463+0000","last_active":"2023-10-09T06:55:06.952611+0000","last_peered":"2023-10-09T06:55:06.952611+0000","last_clean":"2023-10-09T06:55:06.952611+0000","last_became_active":"2023-10-09T06:55:05.936166+0000","last_became_peered":"2023-10-09T06:55:05.936166+0000","last_unstale":"2023-10-09T06:55:06.952611+0000","last_undegraded":"2023-10-09T06:55:06.952611+0000","last_fullsized":"2023-10-09T06:55:06.952611+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:30.427585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.945118+0000","last_change":"2023-10-09T06:55:06.944529+0000","last_active":"2023-10-09T06:55:06.945118+0000","last_peered":"2023-10-09T06:55:06.945118+0000","last_clean":"2023-10-09T06:55:06.945118+0000","last_became_active":"2023-10-09T06:55:06.944264+0000","last_became_peered":"2023-10-09T06:55:06.944264+0000","last_unstale":"2023-10-09T06:55:06.945118+0000","last_undegraded":"2023-10-09T06:55:06.945118+0000","last_fullsized":"2023-10-09T06:55:06.945118+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:47.548592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955066+0000","last_change":"2023-10-09T06:55:05.935262+0000","last_active":"2023-10-09T06:55:06.955066+0000","last_peered":"2023-10-09T06:55:06.955066+0000","last_clean":"2023-10-09T06:55:06.955066+0000","last_became_active":"2023-10-09T06:55:05.934932+0000","last_became_peered":"2023-10-09T06:55:05.934932+0000","last_unstale":"2023-10-09T06:55:06.955066+0000","last_undegraded":"2023-10-09T06:55:06.955066+0000","last_fullsized":"2023-10-09T06:55:06.955066+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:02:48.884634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.951329+0000","last_change":"2023-10-09T06:55:06.939358+0000","last_active":"2023-10-09T06:55:06.951329+0000","last_peered":"2023-10-09T06:55:06.951329+0000","last_clean":"2023-10-09T06:55:06.951329+0000","last_became_active":"2023-10-09T06:55:06.939058+0000","last_became_peered":"2023-10-09T06:55:06.939058+0000","last_unstale":"2023-10-09T06:55:06.951329+0000","last_undegraded":"2023-10-09T06:55:06.951329+0000","last_fullsized":"2023-10-09T06:55:06.951329+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:13.874146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953637+0000","last_change":"2023-10-09T06:55:05.931537+0000","last_active":"2023-10-09T06:55:06.953637+0000","last_peered":"2023-10-09T06:55:06.953637+0000","last_clean":"2023-10-09T06:55:06.953637+0000","last_became_active":"2023-10-09T06:55:05.931300+0000","last_became_peered":"2023-10-09T06:55:05.931300+0000","last_unstale":"2023-10-09T06:55:06.953637+0000","last_undegraded":"2023-10-09T06:55:06.953637+0000","last_fullsized":"2023-10-09T06:55:06.953637+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:07.028150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.944440+0000","last_change":"2023-10-09T06:55:06.938409+0000","last_active":"2023-10-09T06:55:06.944440+0000","last_peered":"2023-10-09T06:55:06.944440+0000","last_clean":"2023-10-09T06:55:06.944440+0000","last_became_active":"2023-10-09T06:55:06.938160+0000","last_became_peered":"2023-10-09T06:55:06.938160+0000","last_unstale":"2023-10-09T06:55:06.944440+0000","last_undegraded":"2023-10-09T06:55:06.944440+0000","last_fullsized":"2023-10-09T06:55:06.944440+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:29:45.885127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.941331+0000","last_change":"2023-10-09T06:55:05.923991+0000","last_active":"2023-10-09T06:55:06.941331+0000","last_peered":"2023-10-09T06:55:06.941331+0000","last_clean":"2023-10-09T06:55:06.941331+0000","last_became_active":"2023-10-09T06:55:05.923625+0000","last_became_peered":"2023-10-09T06:55:05.923625+0000","last_unstale":"2023-10-09T06:55:06.941331+0000","last_undegraded":"2023-10-09T06:55:06.941331+0000","last_fullsized":"2023-10-09T06:55:06.941331+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:26:41.909058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955407+0000","last_change":"2023-10-09T06:55:06.952666+0000","last_active":"2023-10-09T06:55:06.955407+0000","last_peered":"2023-10-09T06:55:06.955407+0000","last_clean":"2023-10-09T06:55:06.955407+0000","last_became_active":"2023-10-09T06:55:06.952418+0000","last_became_peered":"2023-10-09T06:55:06.952418+0000","last_unstale":"2023-10-09T06:55:06.955407+0000","last_undegraded":"2023-10-09T06:55:06.955407+0000","last_fullsized":"2023-10-09T06:55:06.955407+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:43:07.311728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.927159+0000","last_change":"2023-10-09T06:55:05.932956+0000","last_active":"2023-10-09T06:55:06.927159+0000","last_peered":"2023-10-09T06:55:06.927159+0000","last_clean":"2023-10-09T06:55:06.927159+0000","last_became_active":"2023-10-09T06:55:05.932697+0000","last_became_peered":"2023-10-09T06:55:05.932697+0000","last_unstale":"2023-10-09T06:55:06.927159+0000","last_undegraded":"2023-10-09T06:55:06.927159+0000","last_fullsized":"2023-10-09T06:55:06.927159+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:59.070938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948242+0000","last_change":"2023-10-09T06:55:06.942850+0000","last_active":"2023-10-09T06:55:06.948242+0000","last_peered":"2023-10-09T06:55:06.948242+0000","last_clean":"2023-10-09T06:55:06.948242+0000","last_became_active":"2023-10-09T06:55:06.942558+0000","last_became_peered":"2023-10-09T06:55:06.942558+0000","last_unstale":"2023-10-09T06:55:06.948242+0000","last_undegraded":"2023-10-09T06:55:06.948242+0000","last_fullsized":"2023-10-09T06:55:06.948242+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:10:57.887526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.923500+0000","last_change":"2023-10-09T06:55:05.932660+0000","last_active":"2023-10-09T06:55:06.923500+0000","last_peered":"2023-10-09T06:55:06.923500+0000","last_clean":"2023-10-09T06:55:06.923500+0000","last_became_active":"2023-10-09T06:55:05.932396+0000","last_became_peered":"2023-10-09T06:55:05.932396+0000","last_unstale":"2023-10-09T06:55:06.923500+0000","last_undegraded":"2023-10-09T06:55:06.923500+0000","last_fullsized":"2023-10-09T06:55:06.923500+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:46.541894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.951486+0000","last_change":"2023-10-09T06:55:06.946914+0000","last_active":"2023-10-09T06:55:06.951486+0000","last_peered":"2023-10-09T06:55:06.951486+0000","last_clean":"2023-10-09T06:55:06.951486+0000","last_became_active":"2023-10-09T06:55:06.946064+0000","last_became_peered":"2023-10-09T06:55:06.946064+0000","last_unstale":"2023-10-09T06:55:06.951486+0000","last_undegraded":"2023-10-09T06:55:06.951486+0000","last_fullsized":"2023-10-09T06:55:06.951486+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:26:48.145004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.923498+0000","last_change":"2023-10-09T06:55:05.933823+0000","last_active":"2023-10-09T06:55:06.923498+0000","last_peered":"2023-10-09T06:55:06.923498+0000","last_clean":"2023-10-09T06:55:06.923498+0000","last_became_active":"2023-10-09T06:55:05.933566+0000","last_became_peered":"2023-10-09T06:55:05.933566+0000","last_unstale":"2023-10-09T06:55:06.923498+0000","last_undegraded":"2023-10-09T06:55:06.923498+0000","last_fullsized":"2023-10-09T06:55:06.923498+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:52:41.277241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953271+0000","last_change":"2023-10-09T06:55:06.948696+0000","last_active":"2023-10-09T06:55:06.953271+0000","last_peered":"2023-10-09T06:55:06.953271+0000","last_clean":"2023-10-09T06:55:06.953271+0000","last_became_active":"2023-10-09T06:55:06.948292+0000","last_became_peered":"2023-10-09T06:55:06.948292+0000","last_unstale":"2023-10-09T06:55:06.953271+0000","last_undegraded":"2023-10-09T06:55:06.953271+0000","last_fullsized":"2023-10-09T06:55:06.953271+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:27.342291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.933075+0000","last_change":"2023-10-09T06:55:05.932297+0000","last_active":"2023-10-09T06:55:06.933075+0000","last_peered":"2023-10-09T06:55:06.933075+0000","last_clean":"2023-10-09T06:55:06.933075+0000","last_became_active":"2023-10-09T06:55:05.931969+0000","last_became_peered":"2023-10-09T06:55:05.931969+0000","last_unstale":"2023-10-09T06:55:06.933075+0000","last_undegraded":"2023-10-09T06:55:06.933075+0000","last_fullsized":"2023-10-09T06:55:06.933075+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:04:29.076275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.932452+0000","last_change":"2023-10-09T06:55:06.928878+0000","last_active":"2023-10-09T06:55:06.932452+0000","last_peered":"2023-10-09T06:55:06.932452+0000","last_clean":"2023-10-09T06:55:06.932452+0000","last_became_active":"2023-10-09T06:55:06.928633+0000","last_became_peered":"2023-10-09T06:55:06.928633+0000","last_unstale":"2023-10-09T06:55:06.932452+0000","last_undegraded":"2023-10-09T06:55:06.932452+0000","last_fullsized":"2023-10-09T06:55:06.932452+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:48:10.713903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"61'3","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.956479+0000","last_change":"2023-10-09T06:55:05.938582+0000","last_active":"2023-10-09T06:55:06.956479+0000","last_peered":"2023-10-09T06:55:06.956479+0000","last_clean":"2023-10-09T06:55:06.956479+0000","last_became_active":"2023-10-09T06:55:05.938239+0000","last_became_peered":"2023-10-09T06:55:05.938239+0000","last_unstale":"2023-10-09T06:55:06.956479+0000","last_undegraded":"2023-10-09T06:55:06.956479+0000","last_fullsized":"2023-10-09T06:55:06.956479+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:21.552564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953095+0000","last_change":"2023-10-09T06:55:06.942075+0000","last_active":"2023-10-09T06:55:06.953095+0000","last_peered":"2023-10-09T06:55:06.953095+0000","last_clean":"2023-10-09T06:55:06.953095+0000","last_became_active":"2023-10-09T06:55:06.941725+0000","last_became_peered":"2023-10-09T06:55:06.941725+0000","last_unstale":"2023-10-09T06:55:06.953095+0000","last_undegraded":"2023-10-09T06:55:06.953095+0000","last_fullsized":"2023-10-09T06:55:06.953095+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:50:27.836402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"61'6","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.958234+0000","last_change":"2023-10-09T06:55:05.931955+0000","last_active":"2023-10-09T06:55:06.958234+0000","last_peered":"2023-10-09T06:55:06.958234+0000","last_clean":"2023-10-09T06:55:06.958234+0000","last_became_active":"2023-10-09T06:55:05.931712+0000","last_became_peered":"2023-10-09T06:55:05.931712+0000","last_unstale":"2023-10-09T06:55:06.958234+0000","last_undegraded":"2023-10-09T06:55:06.958234+0000","last_fullsized":"2023-10-09T06:55:06.958234+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:17.429884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953854+0000","last_change":"2023-10-09T06:55:06.948630+0000","last_active":"2023-10-09T06:55:06.953854+0000","last_peered":"2023-10-09T06:55:06.953854+0000","last_clean":"2023-10-09T06:55:06.953854+0000","last_became_active":"2023-10-09T06:55:06.947635+0000","last_became_peered":"2023-10-09T06:55:06.947635+0000","last_unstale":"2023-10-09T06:55:06.953854+0000","last_undegraded":"2023-10-09T06:55:06.953854+0000","last_fullsized":"2023-10-09T06:55:06.953854+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:19.860358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.949612+0000","last_change":"2023-10-09T06:55:05.941482+0000","last_active":"2023-10-09T06:55:06.949612+0000","last_peered":"2023-10-09T06:55:06.949612+0000","last_clean":"2023-10-09T06:55:06.949612+0000","last_became_active":"2023-10-09T06:55:05.941132+0000","last_became_peered":"2023-10-09T06:55:05.941132+0000","last_unstale":"2023-10-09T06:55:06.949612+0000","last_undegraded":"2023-10-09T06:55:06.949612+0000","last_fullsized":"2023-10-09T06:55:06.949612+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:47.392667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.944422+0000","last_change":"2023-10-09T06:55:06.934503+0000","last_active":"2023-10-09T06:55:06.944422+0000","last_peered":"2023-10-09T06:55:06.944422+0000","last_clean":"2023-10-09T06:55:06.944422+0000","last_became_active":"2023-10-09T06:55:06.934249+0000","last_became_peered":"2023-10-09T06:55:06.934249+0000","last_unstale":"2023-10-09T06:55:06.944422+0000","last_undegraded":"2023-10-09T06:55:06.944422+0000","last_fullsized":"2023-10-09T06:55:06.944422+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:04.244093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.929902+0000","last_change":"2023-10-09T06:55:05.931993+0000","last_active":"2023-10-09T06:55:06.929902+0000","last_peered":"2023-10-09T06:55:06.929902+0000","last_clean":"2023-10-09T06:55:06.929902+0000","last_became_active":"2023-10-09T06:55:05.931747+0000","last_became_peered":"2023-10-09T06:55:05.931747+0000","last_unstale":"2023-10-09T06:55:06.929902+0000","last_undegraded":"2023-10-09T06:55:06.929902+0000","last_fullsized":"2023-10-09T06:55:06.929902+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:49:48.304060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.928958+0000","last_change":"2023-10-09T06:55:06.926676+0000","last_active":"2023-10-09T06:55:06.928958+0000","last_peered":"2023-10-09T06:55:06.928958+0000","last_clean":"2023-10-09T06:55:06.928958+0000","last_became_active":"2023-10-09T06:55:06.926433+0000","last_became_peered":"2023-10-09T06:55:06.926433+0000","last_unstale":"2023-10-09T06:55:06.928958+0000","last_undegraded":"2023-10-09T06:55:06.928958+0000","last_fullsized":"2023-10-09T06:55:06.928958+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:26:52.867345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.923136+0000","last_change":"2023-10-09T06:55:05.935304+0000","last_active":"2023-10-09T06:55:06.923136+0000","last_peered":"2023-10-09T06:55:06.923136+0000","last_clean":"2023-10-09T06:55:06.923136+0000","last_became_active":"2023-10-09T06:55:05.935055+0000","last_became_peered":"2023-10-09T06:55:05.935055+0000","last_unstale":"2023-10-09T06:55:06.923136+0000","last_undegraded":"2023-10-09T06:55:06.923136+0000","last_fullsized":"2023-10-09T06:55:06.923136+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:16:25.613767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954291+0000","last_change":"2023-10-09T06:55:06.953060+0000","last_active":"2023-10-09T06:55:06.954291+0000","last_peered":"2023-10-09T06:55:06.954291+0000","last_clean":"2023-10-09T06:55:06.954291+0000","last_became_active":"2023-10-09T06:55:06.952769+0000","last_became_peered":"2023-10-09T06:55:06.952769+0000","last_unstale":"2023-10-09T06:55:06.954291+0000","last_undegraded":"2023-10-09T06:55:06.954291+0000","last_fullsized":"2023-10-09T06:55:06.954291+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:12:43.264714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"61'8","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955749+0000","last_change":"2023-10-09T06:55:05.939559+0000","last_active":"2023-10-09T06:55:06.955749+0000","last_peered":"2023-10-09T06:55:06.955749+0000","last_clean":"2023-10-09T06:55:06.955749+0000","last_became_active":"2023-10-09T06:55:05.939250+0000","last_became_peered":"2023-10-09T06:55:05.939250+0000","last_unstale":"2023-10-09T06:55:06.955749+0000","last_undegraded":"2023-10-09T06:55:06.955749+0000","last_fullsized":"2023-10-09T06:55:06.955749+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:57.104240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.943570+0000","last_change":"2023-10-09T06:55:06.940395+0000","last_active":"2023-10-09T06:55:06.943570+0000","last_peered":"2023-10-09T06:55:06.943570+0000","last_clean":"2023-10-09T06:55:06.943570+0000","last_became_active":"2023-10-09T06:55:06.940110+0000","last_became_peered":"2023-10-09T06:55:06.940110+0000","last_unstale":"2023-10-09T06:55:06.943570+0000","last_undegraded":"2023-10-09T06:55:06.943570+0000","last_fullsized":"2023-10-09T06:55:06.943570+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:11.042189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.947490+0000","last_change":"2023-10-09T06:55:05.932965+0000","last_active":"2023-10-09T06:55:06.947490+0000","last_peered":"2023-10-09T06:55:06.947490+0000","last_clean":"2023-10-09T06:55:06.947490+0000","last_became_active":"2023-10-09T06:55:05.932676+0000","last_became_peered":"2023-10-09T06:55:05.932676+0000","last_unstale":"2023-10-09T06:55:06.947490+0000","last_undegraded":"2023-10-09T06:55:06.947490+0000","last_fullsized":"2023-10-09T06:55:06.947490+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:03:56.177535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948676+0000","last_change":"2023-10-09T06:55:06.944157+0000","last_active":"2023-10-09T06:55:06.948676+0000","last_peered":"2023-10-09T06:55:06.948676+0000","last_clean":"2023-10-09T06:55:06.948676+0000","last_became_active":"2023-10-09T06:55:06.943866+0000","last_became_peered":"2023-10-09T06:55:06.943866+0000","last_unstale":"2023-10-09T06:55:06.948676+0000","last_undegraded":"2023-10-09T06:55:06.948676+0000","last_fullsized":"2023-10-09T06:55:06.948676+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:12.040675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.947250+0000","last_change":"2023-10-09T06:55:05.930339+0000","last_active":"2023-10-09T06:55:06.947250+0000","last_peered":"2023-10-09T06:55:06.947250+0000","last_clean":"2023-10-09T06:55:06.947250+0000","last_became_active":"2023-10-09T06:55:05.930075+0000","last_became_peered":"2023-10-09T06:55:05.930075+0000","last_unstale":"2023-10-09T06:55:06.947250+0000","last_undegraded":"2023-10-09T06:55:06.947250+0000","last_fullsized":"2023-10-09T06:55:06.947250+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:25.646016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953398+0000","last_change":"2023-10-09T06:55:06.946543+0000","last_active":"2023-10-09T06:55:06.953398+0000","last_peered":"2023-10-09T06:55:06.953398+0000","last_clean":"2023-10-09T06:55:06.953398+0000","last_became_active":"2023-10-09T06:55:06.946212+0000","last_became_peered":"2023-10-09T06:55:06.946212+0000","last_unstale":"2023-10-09T06:55:06.953398+0000","last_undegraded":"2023-10-09T06:55:06.953398+0000","last_fullsized":"2023-10-09T06:55:06.953398+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:04:30.082972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955241+0000","last_change":"2023-10-09T06:55:05.933469+0000","last_active":"2023-10-09T06:55:06.955241+0000","last_peered":"2023-10-09T06:55:06.955241+0000","last_clean":"2023-10-09T06:55:06.955241+0000","last_became_active":"2023-10-09T06:55:05.933182+0000","last_became_peered":"2023-10-09T06:55:05.933182+0000","last_unstale":"2023-10-09T06:55:06.955241+0000","last_undegraded":"2023-10-09T06:55:06.955241+0000","last_fullsized":"2023-10-09T06:55:06.955241+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:20.352969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953318+0000","last_change":"2023-10-09T06:55:06.944943+0000","last_active":"2023-10-09T06:55:06.953318+0000","last_peered":"2023-10-09T06:55:06.953318+0000","last_clean":"2023-10-09T06:55:06.953318+0000","last_became_active":"2023-10-09T06:55:06.944651+0000","last_became_peered":"2023-10-09T06:55:06.944651+0000","last_unstale":"2023-10-09T06:55:06.953318+0000","last_undegraded":"2023-10-09T06:55:06.953318+0000","last_fullsized":"2023-10-09T06:55:06.953318+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:30:30.430228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.925347+0000","last_change":"2023-10-09T06:55:05.933315+0000","last_active":"2023-10-09T06:55:06.925347+0000","last_peered":"2023-10-09T06:55:06.925347+0000","last_clean":"2023-10-09T06:55:06.925347+0000","last_became_active":"2023-10-09T06:55:05.933044+0000","last_became_peered":"2023-10-09T06:55:05.933044+0000","last_unstale":"2023-10-09T06:55:06.925347+0000","last_undegraded":"2023-10-09T06:55:06.925347+0000","last_fullsized":"2023-10-09T06:55:06.925347+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:51.403402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.941236+0000","last_change":"2023-10-09T06:55:06.935138+0000","last_active":"2023-10-09T06:55:06.941236+0000","last_peered":"2023-10-09T06:55:06.941236+0000","last_clean":"2023-10-09T06:55:06.941236+0000","last_became_active":"2023-10-09T06:55:06.934886+0000","last_became_peered":"2023-10-09T06:55:06.934886+0000","last_unstale":"2023-10-09T06:55:06.941236+0000","last_undegraded":"2023-10-09T06:55:06.941236+0000","last_fullsized":"2023-10-09T06:55:06.941236+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:28.982187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953731+0000","last_change":"2023-10-09T06:55:05.930744+0000","last_active":"2023-10-09T06:55:06.953731+0000","last_peered":"2023-10-09T06:55:06.953731+0000","last_clean":"2023-10-09T06:55:06.953731+0000","last_became_active":"2023-10-09T06:55:05.930460+0000","last_became_peered":"2023-10-09T06:55:05.930460+0000","last_unstale":"2023-10-09T06:55:06.953731+0000","last_undegraded":"2023-10-09T06:55:06.953731+0000","last_fullsized":"2023-10-09T06:55:06.953731+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:18:05.242002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954278+0000","last_change":"2023-10-09T06:55:06.951304+0000","last_active":"2023-10-09T06:55:06.954278+0000","last_peered":"2023-10-09T06:55:06.954278+0000","last_clean":"2023-10-09T06:55:06.954278+0000","last_became_active":"2023-10-09T06:55:06.950931+0000","last_became_peered":"2023-10-09T06:55:06.950931+0000","last_unstale":"2023-10-09T06:55:06.954278+0000","last_undegraded":"2023-10-09T06:55:06.954278+0000","last_fullsized":"2023-10-09T06:55:06.954278+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:17.846967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.927303+0000","last_change":"2023-10-09T06:55:05.932114+0000","last_active":"2023-10-09T06:55:06.927303+0000","last_peered":"2023-10-09T06:55:06.927303+0000","last_clean":"2023-10-09T06:55:06.927303+0000","last_became_active":"2023-10-09T06:55:05.931130+0000","last_became_peered":"2023-10-09T06:55:05.931130+0000","last_unstale":"2023-10-09T06:55:06.927303+0000","last_undegraded":"2023-10-09T06:55:06.927303+0000","last_fullsized":"2023-10-09T06:55:06.927303+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:04:29.076275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.936298+0000","last_change":"2023-10-09T06:55:06.933965+0000","last_active":"2023-10-09T06:55:06.936298+0000","last_peered":"2023-10-09T06:55:06.936298+0000","last_clean":"2023-10-09T06:55:06.936298+0000","last_became_active":"2023-10-09T06:55:06.933697+0000","last_became_peered":"2023-10-09T06:55:06.933697+0000","last_unstale":"2023-10-09T06:55:06.936298+0000","last_undegraded":"2023-10-09T06:55:06.936298+0000","last_fullsized":"2023-10-09T06:55:06.936298+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:52.068938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.932376+0000","last_change":"2023-10-09T06:55:05.939438+0000","last_active":"2023-10-09T06:55:06.932376+0000","last_peered":"2023-10-09T06:55:06.932376+0000","last_clean":"2023-10-09T06:55:06.932376+0000","last_became_active":"2023-10-09T06:55:05.939179+0000","last_became_peered":"2023-10-09T06:55:05.939179+0000","last_unstale":"2023-10-09T06:55:06.932376+0000","last_undegraded":"2023-10-09T06:55:06.932376+0000","last_fullsized":"2023-10-09T06:55:06.932376+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:21.552564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.944385+0000","last_change":"2023-10-09T06:55:06.941903+0000","last_active":"2023-10-09T06:55:06.944385+0000","last_peered":"2023-10-09T06:55:06.944385+0000","last_clean":"2023-10-09T06:55:06.944385+0000","last_became_active":"2023-10-09T06:55:06.941654+0000","last_became_peered":"2023-10-09T06:55:06.941654+0000","last_unstale":"2023-10-09T06:55:06.944385+0000","last_undegraded":"2023-10-09T06:55:06.944385+0000","last_fullsized":"2023-10-09T06:55:06.944385+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:36.964322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.929584+0000","last_change":"2023-10-09T06:55:05.937191+0000","last_active":"2023-10-09T06:55:06.929584+0000","last_peered":"2023-10-09T06:55:06.929584+0000","last_clean":"2023-10-09T06:55:06.929584+0000","last_became_active":"2023-10-09T06:55:05.936808+0000","last_became_peered":"2023-10-09T06:55:05.936808+0000","last_unstale":"2023-10-09T06:55:06.929584+0000","last_undegraded":"2023-10-09T06:55:06.929584+0000","last_fullsized":"2023-10-09T06:55:06.929584+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:57.104240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954182+0000","last_change":"2023-10-09T06:55:06.950960+0000","last_active":"2023-10-09T06:55:06.954182+0000","last_peered":"2023-10-09T06:55:06.954182+0000","last_clean":"2023-10-09T06:55:06.954182+0000","last_became_active":"2023-10-09T06:55:06.950716+0000","last_became_peered":"2023-10-09T06:55:06.950716+0000","last_unstale":"2023-10-09T06:55:06.954182+0000","last_undegraded":"2023-10-09T06:55:06.954182+0000","last_fullsized":"2023-10-09T06:55:06.954182+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:50:27.836402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.926093+0000","last_change":"2023-10-09T06:55:05.930677+0000","last_active":"2023-10-09T06:55:06.926093+0000","last_peered":"2023-10-09T06:55:06.926093+0000","last_clean":"2023-10-09T06:55:06.926093+0000","last_became_active":"2023-10-09T06:55:05.930333+0000","last_became_peered":"2023-10-09T06:55:05.930333+0000","last_unstale":"2023-10-09T06:55:06.926093+0000","last_undegraded":"2023-10-09T06:55:06.926093+0000","last_fullsized":"2023-10-09T06:55:06.926093+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:12:42.258017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948591+0000","last_change":"2023-10-09T06:55:06.944396+0000","last_active":"2023-10-09T06:55:06.948591+0000","last_peered":"2023-10-09T06:55:06.948591+0000","last_clean":"2023-10-09T06:55:06.948591+0000","last_became_active":"2023-10-09T06:55:06.944150+0000","last_became_peered":"2023-10-09T06:55:06.944150+0000","last_unstale":"2023-10-09T06:55:06.948591+0000","last_undegraded":"2023-10-09T06:55:06.948591+0000","last_fullsized":"2023-10-09T06:55:06.948591+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:01.783980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.931050+0000","last_change":"2023-10-09T06:55:05.938596+0000","last_active":"2023-10-09T06:55:06.931050+0000","last_peered":"2023-10-09T06:55:06.931050+0000","last_clean":"2023-10-09T06:55:06.931050+0000","last_became_active":"2023-10-09T06:55:05.938360+0000","last_became_peered":"2023-10-09T06:55:05.938360+0000","last_unstale":"2023-10-09T06:55:06.931050+0000","last_undegraded":"2023-10-09T06:55:06.931050+0000","last_fullsized":"2023-10-09T06:55:06.931050+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:48:20.803864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953115+0000","last_change":"2023-10-09T06:55:06.942255+0000","last_active":"2023-10-09T06:55:06.953115+0000","last_peered":"2023-10-09T06:55:06.953115+0000","last_clean":"2023-10-09T06:55:06.953115+0000","last_became_active":"2023-10-09T06:55:06.941345+0000","last_became_peered":"2023-10-09T06:55:06.941345+0000","last_unstale":"2023-10-09T06:55:06.953115+0000","last_undegraded":"2023-10-09T06:55:06.953115+0000","last_fullsized":"2023-10-09T06:55:06.953115+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:16:26.620465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.929937+0000","last_change":"2023-10-09T06:55:05.935598+0000","last_active":"2023-10-09T06:55:06.929937+0000","last_peered":"2023-10-09T06:55:06.929937+0000","last_clean":"2023-10-09T06:55:06.929937+0000","last_became_active":"2023-10-09T06:55:05.935350+0000","last_became_peered":"2023-10-09T06:55:05.935350+0000","last_unstale":"2023-10-09T06:55:06.929937+0000","last_undegraded":"2023-10-09T06:55:06.929937+0000","last_fullsized":"2023-10-09T06:55:06.929937+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:25.646016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.941254+0000","last_change":"2023-10-09T06:55:06.935866+0000","last_active":"2023-10-09T06:55:06.941254+0000","last_peered":"2023-10-09T06:55:06.941254+0000","last_clean":"2023-10-09T06:55:06.941254+0000","last_became_active":"2023-10-09T06:55:06.935633+0000","last_became_peered":"2023-10-09T06:55:06.935633+0000","last_unstale":"2023-10-09T06:55:06.941254+0000","last_undegraded":"2023-10-09T06:55:06.941254+0000","last_fullsized":"2023-10-09T06:55:06.941254+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:29:45.885127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.930431+0000","last_change":"2023-10-09T06:55:05.935761+0000","last_active":"2023-10-09T06:55:06.930431+0000","last_peered":"2023-10-09T06:55:06.930431+0000","last_clean":"2023-10-09T06:55:06.930431+0000","last_became_active":"2023-10-09T06:55:05.935464+0000","last_became_peered":"2023-10-09T06:55:05.935464+0000","last_unstale":"2023-10-09T06:55:06.930431+0000","last_undegraded":"2023-10-09T06:55:06.930431+0000","last_fullsized":"2023-10-09T06:55:06.930431+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:16.840270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.932428+0000","last_change":"2023-10-09T06:55:06.927262+0000","last_active":"2023-10-09T06:55:06.932428+0000","last_peered":"2023-10-09T06:55:06.932428+0000","last_clean":"2023-10-09T06:55:06.932428+0000","last_became_active":"2023-10-09T06:55:06.926992+0000","last_became_peered":"2023-10-09T06:55:06.926992+0000","last_unstale":"2023-10-09T06:55:06.932428+0000","last_undegraded":"2023-10-09T06:55:06.932428+0000","last_fullsized":"2023-10-09T06:55:06.932428+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:12.040675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.924148+0000","last_change":"2023-10-09T06:55:05.931207+0000","last_active":"2023-10-09T06:55:06.924148+0000","last_peered":"2023-10-09T06:55:06.924148+0000","last_clean":"2023-10-09T06:55:06.924148+0000","last_became_active":"2023-10-09T06:55:05.930948+0000","last_became_peered":"2023-10-09T06:55:05.930948+0000","last_unstale":"2023-10-09T06:55:06.924148+0000","last_undegraded":"2023-10-09T06:55:06.924148+0000","last_fullsized":"2023-10-09T06:55:06.924148+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:19.802470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.940773+0000","last_change":"2023-10-09T06:55:06.936312+0000","last_active":"2023-10-09T06:55:06.940773+0000","last_peered":"2023-10-09T06:55:06.940773+0000","last_clean":"2023-10-09T06:55:06.940773+0000","last_became_active":"2023-10-09T06:55:06.936032+0000","last_became_peered":"2023-10-09T06:55:06.936032+0000","last_unstale":"2023-10-09T06:55:06.940773+0000","last_undegraded":"2023-10-09T06:55:06.940773+0000","last_fullsized":"2023-10-09T06:55:06.940773+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:52.410099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.930275+0000","last_change":"2023-10-09T06:55:05.936971+0000","last_active":"2023-10-09T06:55:06.930275+0000","last_peered":"2023-10-09T06:55:06.930275+0000","last_clean":"2023-10-09T06:55:06.930275+0000","last_became_active":"2023-10-09T06:55:05.936678+0000","last_became_peered":"2023-10-09T06:55:05.936678+0000","last_unstale":"2023-10-09T06:55:06.930275+0000","last_undegraded":"2023-10-09T06:55:06.930275+0000","last_fullsized":"2023-10-09T06:55:06.930275+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:18.853661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.951285+0000","last_change":"2023-10-09T06:55:06.944842+0000","last_active":"2023-10-09T06:55:06.951285+0000","last_peered":"2023-10-09T06:55:06.951285+0000","last_clean":"2023-10-09T06:55:06.951285+0000","last_became_active":"2023-10-09T06:55:06.944016+0000","last_became_peered":"2023-10-09T06:55:06.944016+0000","last_unstale":"2023-10-09T06:55:06.951285+0000","last_undegraded":"2023-10-09T06:55:06.951285+0000","last_fullsized":"2023-10-09T06:55:06.951285+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:04:30.082972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.923395+0000","last_change":"2023-10-09T06:55:05.938714+0000","last_active":"2023-10-09T06:55:06.923395+0000","last_peered":"2023-10-09T06:55:06.923395+0000","last_clean":"2023-10-09T06:55:06.923395+0000","last_became_active":"2023-10-09T06:55:05.936627+0000","last_became_peered":"2023-10-09T06:55:05.936627+0000","last_unstale":"2023-10-09T06:55:06.923395+0000","last_undegraded":"2023-10-09T06:55:06.923395+0000","last_fullsized":"2023-10-09T06:55:06.923395+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:16.840270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.943755+0000","last_change":"2023-10-09T06:55:06.941611+0000","last_active":"2023-10-09T06:55:06.943755+0000","last_peered":"2023-10-09T06:55:06.943755+0000","last_clean":"2023-10-09T06:55:06.943755+0000","last_became_active":"2023-10-09T06:55:06.941376+0000","last_became_peered":"2023-10-09T06:55:06.941376+0000","last_unstale":"2023-10-09T06:55:06.943755+0000","last_undegraded":"2023-10-09T06:55:06.943755+0000","last_fullsized":"2023-10-09T06:55:06.943755+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:28.056882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.952233+0000","last_change":"2023-10-09T06:55:05.933117+0000","last_active":"2023-10-09T06:55:06.952233+0000","last_peered":"2023-10-09T06:55:06.952233+0000","last_clean":"2023-10-09T06:55:06.952233+0000","last_became_active":"2023-10-09T06:55:05.932796+0000","last_became_peered":"2023-10-09T06:55:05.932796+0000","last_unstale":"2023-10-09T06:55:06.952233+0000","last_undegraded":"2023-10-09T06:55:06.952233+0000","last_fullsized":"2023-10-09T06:55:06.952233+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:10:56.880829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"52'139","reported_seq":278,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.929711+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:55:06.929711+0000","last_peered":"2023-10-09T06:55:06.929711+0000","last_clean":"2023-10-09T06:55:06.929711+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:55:06.929711+0000","last_undegraded":"2023-10-09T06:55:06.929711+0000","last_fullsized":"2023-10-09T06:55:06.929711+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575003,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":936574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71899999999999997,"15min":0.71699999999999997},"min":{"1min":0.36299999999999999,"5min":0.316,"15min":0.316},"max":{"1min":1.732,"5min":1.732,"15min":1.9490000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73199999999999998,"15min":0.75},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.29999999999999999},"max":{"1min":0.94399999999999995,"5min":1.0169999999999999,"15min":3.448},"last":0.85999999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72199999999999998,"15min":0.77500000000000002},"min":{"1min":0.437,"5min":0.379,"15min":0.379},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":5.617},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.753},"min":{"1min":0.45800000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":2.016},"last":0.68400000000000005}]},{"osd":2,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.74099999999999999,"15min":0.752},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44800000000000001},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":2.052},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76900000000000002,"15min":0.79200000000000004},"min":{"1min":0.48299999999999998,"5min":0.45200000000000001,"15min":0.44700000000000001},"max":{"1min":2.6629999999999998,"5min":2.6629999999999998,"15min":3.5019999999999998},"last":0.69799999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71799999999999997,"15min":0.79300000000000004},"min":{"1min":0.498,"5min":0.45600000000000002,"15min":0.45000000000000001},"max":{"1min":0.85199999999999998,"5min":1.0409999999999999,"15min":5.5800000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.84999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.47099999999999997},"max":{"1min":1.827,"5min":1.827,"15min":6.9299999999999997},"last":0.61399999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.60099999999999998,"15min":0.64800000000000002},"min":{"1min":0.47299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89900000000000002,"5min":0.90400000000000003,"15min":3.125},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.64900000000000002,"15min":0.71399999999999997},"min":{"1min":0.42199999999999999,"5min":0.41999999999999998,"15min":0.40500000000000003},"max":{"1min":2.577,"5min":2.577,"15min":4.8380000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.67300000000000004,"15min":0.72899999999999998},"min":{"1min":0.438,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":4.1929999999999996},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.71199999999999997,"15min":0.76700000000000002},"min":{"1min":0.52900000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.9590000000000001,"5min":2.9590000000000001,"15min":3.6749999999999998},"last":0.82299999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.753,"15min":0.81799999999999995},"min":{"1min":0.58099999999999996,"5min":0.53300000000000003,"15min":0.49199999999999999},"max":{"1min":3.0019999999999998,"5min":3.0019999999999998,"15min":4.0250000000000004},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.73199999999999998,"15min":0.83199999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.44700000000000001},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":7.0259999999999998},"last":0.79600000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575002,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302112,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069728,"statfs":{"total":96636764160,"available":96327401472,"internally_reserved":0,"allocated":745472,"data_stored":346760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.71799999999999997,"15min":0.70599999999999996},"min":{"1min":0.48099999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81999999999999995,"5min":0.97899999999999998,"15min":1.022},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.72099999999999997,"15min":0.69299999999999995},"min":{"1min":0.47499999999999998,"5min":0.41999999999999998,"15min":0.36599999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.079},"last":0.76100000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.73099999999999998,"15min":0.71599999999999997},"min":{"1min":0.45500000000000002,"5min":0.44800000000000001,"15min":0.42799999999999999},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.72299999999999998,"15min":0.71799999999999997},"min":{"1min":0.501,"5min":0.48299999999999998,"15min":0.438},"max":{"1min":0.84999999999999998,"5min":1.0109999999999999,"15min":1.034},"last":0.78900000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.42599999999999999},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.45200000000000001},"max":{"1min":0.79200000000000004,"5min":0.96699999999999997,"15min":1.0900000000000001},"last":0.55900000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.71299999999999997,"15min":0.69199999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.89800000000000002,"5min":0.91700000000000004,"15min":1.046},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77000000000000002,"15min":0.753},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.497},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.88}]},{"osd":4,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63,"15min":0.63700000000000001},"min":{"1min":0.41299999999999998,"5min":0.38,"15min":0.377},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.626},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.98499999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64600000000000002,"15min":0.65800000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68600000000000005,"15min":0.70199999999999996},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.42299999999999999},"max":{"1min":0.84099999999999997,"5min":1.012,"15min":1.0669999999999999},"last":0.81599999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68200000000000005,"15min":0.68600000000000005},"min":{"1min":0.47299999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.72499999999999998,"15min":0.73199999999999998},"min":{"1min":0.44600000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.96499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":346186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46000000000000002,"15min":0.45600000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56999999999999995,"5min":0.90300000000000002,"15min":1.2729999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48799999999999999,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.311,"15min":0.23699999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.91200000000000003},"last":0.44500000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.498,"15min":0.48599999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.29599999999999999},"max":{"1min":0.64900000000000002,"5min":0.67800000000000005,"15min":0.91900000000000004},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57799999999999996,"15min":0.56699999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77900000000000003,"5min":0.83999999999999997,"15min":1.3340000000000001},"last":0.48199999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.622,"15min":0.59899999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.34100000000000003},"max":{"1min":0.73699999999999999,"5min":0.89500000000000002,"15min":1.365},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.34100000000000003},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.63300000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.78400000000000003,"15min":0.77200000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.995,"5min":1.0529999999999999,"15min":1.234},"last":0.66000000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79200000000000004,"15min":0.77200000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0309999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.78600000000000003,"15min":0.77600000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.47999999999999998},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.69099999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.80500000000000005,"15min":0.79000000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.3029999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.80400000000000005,"15min":0.79200000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0980000000000001,"5min":1.222,"15min":1.222},"last":0.69999999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.83599999999999997,"15min":0.82599999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.53500000000000003},"max":{"1min":1.129,"5min":1.129,"15min":1.4510000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.82999999999999996,"15min":0.81899999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.115,"5min":1.179,"15min":1.1970000000000001},"last":0.76600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575002,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":1335296,"data_stored":936518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47499999999999998,"15min":0.47099999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.23000000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":1.2729999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.56699999999999995,"15min":0.53300000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.28899999999999998},"max":{"1min":4.5819999999999999,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":0.45100000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.58799999999999997,"15min":0.55600000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":4.6980000000000004,"5min":4.6980000000000004,"15min":4.6980000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.51500000000000001,"15min":0.48999999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.55100000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.7130000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.63500000000000001,"15min":0.61799999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":4.734,"5min":4.734,"15min":4.734},"last":0.495}]},{"osd":4,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.78300000000000003,"15min":0.77500000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.103,"5min":1.218,"15min":1.752},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.82399999999999995,"15min":0.80800000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":4.6619999999999999,"5min":4.6619999999999999,"15min":4.6619999999999999},"last":0.75800000000000001}]},{"osd":5,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.2769999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.80100000000000005,"15min":0.80700000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0840000000000001,"5min":1.2809999999999999,"15min":1.7889999999999999},"last":0.88400000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.83399999999999996,"15min":0.82599999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.50900000000000001},"max":{"1min":4.6239999999999997,"5min":4.6239999999999997,"15min":4.6239999999999997},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.80600000000000005,"15min":0.81200000000000006},"min":{"1min":0.50800000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.228,"5min":1.2689999999999999,"15min":1.4370000000000001},"last":0.74399999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.83499999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.256,"5min":1.256,"15min":1.518},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.85599999999999998,"15min":0.85999999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.702,"5min":1.702,"15min":1.8200000000000001},"last":0.82199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575002,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306216,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065624,"statfs":{"total":96636764160,"available":96323198976,"internally_reserved":0,"allocated":753664,"data_stored":347674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.46000000000000002,"15min":0.45800000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.25900000000000001},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.498,"15min":0.499},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.484},"last":0.56200000000000006}]},{"osd":1,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.47899999999999998,"15min":0.496},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.623,"5min":0.80700000000000005,"15min":1.865},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.50800000000000001,"15min":0.52600000000000002},"min":{"1min":0.36199999999999999,"5min":0.33700000000000002,"15min":0.32200000000000001},"max":{"1min":0.66500000000000004,"5min":0.747,"15min":1.79},"last":0.65700000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.41699999999999998,"5min":0.38600000000000001,"15min":0.35799999999999998},"max":{"1min":0.84499999999999997,"5min":0.87,"15min":1.8999999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.38500000000000001},"max":{"1min":0.84799999999999998,"5min":0.85199999999999998,"15min":1.8220000000000001},"last":0.61799999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.77900000000000003,"15min":0.754},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.42899999999999999},"max":{"1min":1.1799999999999999,"5min":1.256,"15min":1.256},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.77800000000000002,"15min":0.77400000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.44800000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.63}]},{"osd":5,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78800000000000003,"15min":0.76900000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.79100000000000004,"15min":0.77300000000000002},"min":{"1min":0.58299999999999996,"5min":0.57199999999999995,"15min":0.503},"max":{"1min":0.98799999999999999,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.69499999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.79900000000000004,"15min":0.78800000000000003},"min":{"1min":0.55100000000000005,"5min":0.54900000000000004,"15min":0.48599999999999999},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.81200000000000006,"15min":0.79800000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.5309999999999999},"last":0.71099999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.82399999999999995,"15min":0.80800000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.84399999999999997,"15min":0.82399999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.50900000000000001},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.81799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575003,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302116,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069724,"statfs":{"total":96636764160,"available":96327397376,"internally_reserved":0,"allocated":749568,"data_stored":346726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47599999999999998,"15min":0.45900000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.24099999999999999},"max":{"1min":0.81200000000000006,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50900000000000001,"15min":0.47799999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.28100000000000003},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.42899999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.499,"15min":0.47899999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.55700000000000005,"15min":0.53400000000000003},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.67800000000000005,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52900000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59599999999999997,"15min":0.57099999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.38500000000000001},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.64600000000000002,"15min":0.61899999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":3.8900000000000001,"5min":3.8900000000000001,"15min":3.8900000000000001},"last":0.59799999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76100000000000001,"15min":0.74299999999999999},"min":{"1min":0.48299999999999998,"5min":0.47199999999999998,"15min":0.40799999999999997},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.83999999999999997,"15min":0.81599999999999995},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.52200000000000002},"max":{"1min":1.081,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.77800000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.76900000000000002,"15min":0.749},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96999999999999997,"5min":1.091,"15min":2.1549999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.81599999999999995,"15min":0.79600000000000004},"min":{"1min":0.58199999999999996,"5min":0.56499999999999995,"15min":0.50600000000000001},"max":{"1min":0.97299999999999998,"5min":1.0800000000000001,"15min":1.419},"last":0.68799999999999994}]},{"osd":6,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.79700000000000004,"15min":0.77500000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.51700000000000002},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.81200000000000006,"15min":0.77500000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.51500000000000001},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.83599999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.84799999999999998,"15min":0.82499999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.55500000000000005},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":2.0880000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.84699999999999998,"15min":0.82699999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.56499999999999995},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.71599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575002,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306212,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065628,"statfs":{"total":96636764160,"available":96323203072,"internally_reserved":0,"allocated":749568,"data_stored":347652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73699999999999999,"15min":0.69499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35499999999999998},"max":{"1min":3.1139999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.73599999999999999,"15min":0.70899999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.39300000000000002},"max":{"1min":2.8130000000000002,"5min":2.8130000000000002,"15min":3.23},"last":0.74299999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73199999999999998,"15min":0.70099999999999996},"min":{"1min":0.46999999999999997,"5min":0.45800000000000002,"15min":0.373},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.78200000000000003,"15min":0.74199999999999999},"min":{"1min":0.46300000000000002,"5min":0.45100000000000001,"15min":0.40500000000000003},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.69499999999999995}]},{"osd":2,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78100000000000003,"15min":0.754},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.38100000000000001},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":3.7509999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.80100000000000005,"15min":0.77900000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":0.71199999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76400000000000001,"15min":0.751},"min":{"1min":0.51000000000000001,"5min":0.434,"15min":0.434},"max":{"1min":2.6440000000000001,"5min":2.6440000000000001,"15min":3.6970000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.78900000000000003,"15min":0.73799999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.6899999999999999,"5min":3.6899999999999999,"15min":3.6899999999999999},"last":0.80200000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":3.3860000000000001,"5min":3.3860000000000001,"15min":3.4780000000000002},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.68799999999999994,"15min":0.68000000000000005},"min":{"1min":0.39100000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.45800000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.67000000000000004,"15min":0.66700000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":3.5270000000000001,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.374},"max":{"1min":3.4740000000000002,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.53500000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.7210000000000001,"5min":2.7210000000000001,"15min":3.2789999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":3.7280000000000002,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.57499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575003,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":346186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.69299999999999995,"15min":0.70199999999999996},"min":{"1min":0.39800000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.91600000000000004,"15min":1.655},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.68500000000000005,"15min":0.68999999999999995},"min":{"1min":0.34499999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79800000000000004,"5min":0.99099999999999999,"15min":1.1359999999999999},"last":0.57899999999999996}]},{"osd":1,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.66800000000000004,"15min":0.71599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79500000000000004,"5min":1.034,"15min":2.4159999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.71199999999999997,"15min":0.73099999999999998},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81699999999999995,"5min":1.0229999999999999,"15min":1.706},"last":0.64700000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.72099999999999997,"15min":0.74299999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.42999999999999999},"max":{"1min":0.79900000000000004,"5min":0.97499999999999998,"15min":1.79},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.69599999999999995,"15min":0.73399999999999999},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.442},"max":{"1min":0.80300000000000005,"5min":1.004,"15min":2.4889999999999999},"last":0.72299999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.69699999999999995,"15min":0.72699999999999998},"min":{"1min":0.503,"5min":0.435,"15min":0.435},"max":{"1min":0.84299999999999997,"5min":0.95499999999999996,"15min":1.409},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.75800000000000001,"15min":0.79400000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.88600000000000001,"5min":1.0629999999999999,"15min":2.532},"last":0.66300000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59099999999999997,"15min":0.63600000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84799999999999998,"5min":0.91300000000000003,"15min":1.766},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.65500000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.35799999999999998},"max":{"1min":0.86199999999999999,"5min":0.98199999999999998,"15min":2.7829999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.628,"15min":0.67300000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.93000000000000005,"5min":0.97699999999999998,"15min":2.5739999999999998},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.67100000000000004,"15min":0.69899999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.38900000000000001},"max":{"1min":0.86899999999999999,"5min":0.95299999999999996,"15min":1.8080000000000001},"last":0.623}]},{"osd":7,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67800000000000005,"15min":0.72499999999999998},"min":{"1min":0.48599999999999999,"5min":0.45500000000000002,"15min":0.436},"max":{"1min":0.91500000000000004,"5min":0.94499999999999995,"15min":2.9609999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75,"15min":0.80400000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.45900000000000002},"max":{"1min":0.96699999999999997,"5min":0.998,"15min":2.613},"last":0.74299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:55:16.157 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:55:16.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.347+0000 7f1827fff700 1 Processor -- start 2023-10-09T06:55:16.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.347+0000 7f1827fff700 1 -- start start 2023-10-09T06:55:16.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.348+0000 7f1827fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f18281597f0 0x7f18280b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:16.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.348+0000 7f1827fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18280b11d0 con 0x7f182815d230 2023-10-09T06:55:16.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.348+0000 7f1827fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18280b14b0 con 0x7f1828159420 2023-10-09T06:55:16.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.348+0000 7f1827fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18280b1790 con 0x7f18281597f0 2023-10-09T06:55:16.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.348+0000 7f18277fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f182815d230 0x7f182815d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60392/0 (socket says 172.21.15.71:60392) 2023-10-09T06:55:16.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.348+0000 7f18277fe700 1 -- 172.21.15.71:0/182258345 learned_addr learned my addr 172.21.15.71:0/182258345 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:55:16.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.349+0000 7f18267fc700 1 --2- 172.21.15.71:0/182258345 >> v2:172.21.15.179:3300/0 conn(0x7f18281597f0 0x7f18280b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:16.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.349+0000 7f1825ffb700 1 -- 172.21.15.71:0/182258345 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2293915901 0 0) 0x7f18280b11d0 con 0x7f182815d230 2023-10-09T06:55:16.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.349+0000 7f1825ffb700 1 -- 172.21.15.71:0/182258345 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1810003570 con 0x7f182815d230 2023-10-09T06:55:16.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.349+0000 7f18267fc700 1 -- 172.21.15.71:0/182258345 >> v1:172.21.15.179:6789/0 conn(0x7f1828159420 legacy=0x7f18280b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:16.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.349+0000 7f18267fc700 1 -- 172.21.15.71:0/182258345 >> v1:172.21.15.71:6789/0 conn(0x7f182815d230 legacy=0x7f182815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:16.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.349+0000 7f18267fc700 1 -- 172.21.15.71:0/182258345 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18280b1a70 con 0x7f18281597f0 2023-10-09T06:55:16.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.349+0000 7f18267fc700 1 --2- 172.21.15.71:0/182258345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18281597f0 0x7f18280b2270 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f181c0098e0 tx=0x7f181c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b133a9b128c7631e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:16.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.350+0000 7f1825ffb700 1 -- 172.21.15.71:0/182258345 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c00b640 con 0x7f18281597f0 2023-10-09T06:55:16.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.350+0000 7f1825ffb700 1 -- 172.21.15.71:0/182258345 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181c00b7a0 con 0x7f18281597f0 2023-10-09T06:55:16.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.350+0000 7f1825ffb700 1 -- 172.21.15.71:0/182258345 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c00bb20 con 0x7f18281597f0 2023-10-09T06:55:16.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.350+0000 7f1827fff700 1 -- 172.21.15.71:0/182258345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18281597f0 msgr2=0x7f18280b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:16.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.350+0000 7f1827fff700 1 --2- 172.21.15.71:0/182258345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18281597f0 0x7f18280b2270 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f181c0098e0 tx=0x7f181c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:55:16.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.350+0000 7f1827fff700 1 -- 172.21.15.71:0/182258345 shutdown_connections 2023-10-09T06:55:16.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.350+0000 7f1827fff700 1 --2- 172.21.15.71:0/182258345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18281597f0 0x7f18280b2270 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:16.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.350+0000 7f1827fff700 1 -- 172.21.15.71:0/182258345 >> 172.21.15.71:0/182258345 conn(0x7f18280d0660 msgr2=0x7f18280d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:16.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.350+0000 7f1827fff700 1 -- 172.21.15.71:0/182258345 shutdown_connections 2023-10-09T06:55:16.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.350+0000 7f1827fff700 1 -- 172.21.15.71:0/182258345 wait complete. 2023-10-09T06:55:16.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.352+0000 7f1827fff700 1 Processor -- start 2023-10-09T06:55:16.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.352+0000 7f1827fff700 1 -- start start 2023-10-09T06:55:16.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.353+0000 7f1827fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1828159420 0x7f18280b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:16.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.353+0000 7f1827fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18281597f0 0x7f18280c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:16.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.353+0000 7f1827fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f182815d230 0x7f1828153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:16.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.353+0000 7f1827fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182815bb20 con 0x7f182815d230 2023-10-09T06:55:16.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.353+0000 7f1827fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182815ac70 con 0x7f18281597f0 2023-10-09T06:55:16.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.353+0000 7f1827fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182815bfb0 con 0x7f1828159420 2023-10-09T06:55:16.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.353+0000 7f18277fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f182815d230 0x7f1828153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:16.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.353+0000 7f18277fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f182815d230 0x7f1828153990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56570/0 (socket says 172.21.15.71:56570) 2023-10-09T06:55:16.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.353+0000 7f18277fe700 1 -- 172.21.15.71:0/2067654363 learned_addr learned my addr 172.21.15.71:0/2067654363 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:16.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.353+0000 7f1826ffd700 1 --2- 172.21.15.71:0/2067654363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1828159420 0x7f18280b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:16.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.353+0000 7f18267fc700 1 --2- 172.21.15.71:0/2067654363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18281597f0 0x7f18280c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:16.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.353+0000 7f18277fe700 1 -- 172.21.15.71:0/2067654363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1828159420 msgr2=0x7f18280b23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:16.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.353+0000 7f18277fe700 1 --2- 172.21.15.71:0/2067654363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1828159420 0x7f18280b23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:16.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.353+0000 7f18277fe700 1 -- 172.21.15.71:0/2067654363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18281597f0 msgr2=0x7f18280c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:16.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.353+0000 7f18277fe700 1 --2- 172.21.15.71:0/2067654363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18281597f0 0x7f18280c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:16.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.353+0000 7f18277fe700 1 -- 172.21.15.71:0/2067654363 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c009420 con 0x7f182815d230 2023-10-09T06:55:16.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.353+0000 7f1826ffd700 1 --2- 172.21.15.71:0/2067654363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1828159420 0x7f18280b23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:55:16.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.353+0000 7f18267fc700 1 --2- 172.21.15.71:0/2067654363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18281597f0 0x7f18280c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:55:16.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.354+0000 7f18277fe700 1 --2- 172.21.15.71:0/2067654363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f182815d230 0x7f1828153990 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f182000cc40 tx=0x7f1820001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:16.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.354+0000 7f180effd700 1 -- 172.21.15.71:0/2067654363 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182000a960 con 0x7f182815d230 2023-10-09T06:55:16.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.354+0000 7f180effd700 1 -- 172.21.15.71:0/2067654363 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182000aac0 con 0x7f182815d230 2023-10-09T06:55:16.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.354+0000 7f180effd700 1 -- 172.21.15.71:0/2067654363 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182000ae40 con 0x7f182815d230 2023-10-09T06:55:16.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.354+0000 7f1827fff700 1 -- 172.21.15.71:0/2067654363 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182815af10 con 0x7f182815d230 2023-10-09T06:55:16.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.354+0000 7f1827fff700 1 -- 172.21.15.71:0/2067654363 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182815b4d0 con 0x7f182815d230 2023-10-09T06:55:16.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.355+0000 7f1827fff700 1 -- 172.21.15.71:0/2067654363 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182804c3c0 con 0x7f182815d230 2023-10-09T06:55:16.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.356+0000 7f180effd700 1 -- 172.21.15.71:0/2067654363 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1820007300 con 0x7f182815d230 2023-10-09T06:55:16.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.357+0000 7f180effd700 1 --2- 172.21.15.71:0/2067654363 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1814066f30 0x7f18140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:16.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.357+0000 7f180effd700 1 -- 172.21.15.71:0/2067654363 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f1820084b30 con 0x7f182815d230 2023-10-09T06:55:16.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.358+0000 7f1826ffd700 1 --2- 172.21.15.71:0/2067654363 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1814066f30 0x7f18140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:16.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.358+0000 7f1826ffd700 1 --2- 172.21.15.71:0/2067654363 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1814066f30 0x7f18140693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1818007fd0 tx=0x7f1818009040 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:16.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.361+0000 7f180effd700 1 -- 172.21.15.71:0/2067654363 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1820051c20 con 0x7f182815d230 2023-10-09T06:55:16.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.550+0000 7f1827fff700 1 -- 172.21.15.71:0/2067654363 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f18280b1d50 con 0x7f1814066f30 2023-10-09T06:55:16.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.559+0000 7f180effd700 1 -- 172.21.15.71:0/2067654363 <== mgr.5015 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288988 (secure 0 0 0) 0x7f18280b1d50 con 0x7f1814066f30 2023-10-09T06:55:16.563 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:55:16.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.563+0000 7f1827fff700 1 -- 172.21.15.71:0/2067654363 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1814066f30 msgr2=0x7f18140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:16.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.563+0000 7f1827fff700 1 --2- 172.21.15.71:0/2067654363 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1814066f30 0x7f18140693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1818007fd0 tx=0x7f1818009040 comp rx=0 tx=0).stop 2023-10-09T06:55:16.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.563+0000 7f1827fff700 1 -- 172.21.15.71:0/2067654363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f182815d230 msgr2=0x7f1828153990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:16.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.563+0000 7f1827fff700 1 --2- 172.21.15.71:0/2067654363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f182815d230 0x7f1828153990 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f182000cc40 tx=0x7f1820001a00 comp rx=0 tx=0).stop 2023-10-09T06:55:16.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.563+0000 7f1827fff700 1 -- 172.21.15.71:0/2067654363 shutdown_connections 2023-10-09T06:55:16.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.563+0000 7f1827fff700 1 --2- 172.21.15.71:0/2067654363 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1814066f30 0x7f18140693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:16.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.563+0000 7f1827fff700 1 --2- 172.21.15.71:0/2067654363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f182815d230 0x7f1828153990 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:16.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.563+0000 7f1827fff700 1 --2- 172.21.15.71:0/2067654363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1828159420 0x7f18280b23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:16.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.563+0000 7f1827fff700 1 --2- 172.21.15.71:0/2067654363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18281597f0 0x7f18280c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:16.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.563+0000 7f1827fff700 1 -- 172.21.15.71:0/2067654363 >> 172.21.15.71:0/2067654363 conn(0x7f18280d0660 msgr2=0x7f18280b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:16.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.563+0000 7f1827fff700 1 -- 172.21.15.71:0/2067654363 shutdown_connections 2023-10-09T06:55:16.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.563+0000 7f1827fff700 1 -- 172.21.15.71:0/2067654363 wait complete. 2023-10-09T06:55:16.569 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:55:16.582 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-09T06:55:15.874467+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":244,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2418056,"kb_used_data":6984,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752556664,"statfs":{"total":773094113280,"available":770618023936,"internally_reserved":0,"allocated":7151616,"data_stored":3954276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.952611"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953251+0000","last_change":"2023-10-09T06:55:06.941941+0000","last_active":"2023-10-09T06:55:06.953251+0000","last_peered":"2023-10-09T06:55:06.953251+0000","last_clean":"2023-10-09T06:55:06.953251+0000","last_became_active":"2023-10-09T06:55:06.941652+0000","last_became_peered":"2023-10-09T06:55:06.941652+0000","last_unstale":"2023-10-09T06:55:06.953251+0000","last_undegraded":"2023-10-09T06:55:06.953251+0000","last_fullsized":"2023-10-09T06:55:06.953251+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:13.874146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.952191+0000","last_change":"2023-10-09T06:55:06.949443+0000","last_active":"2023-10-09T06:55:06.952191+0000","last_peered":"2023-10-09T06:55:06.952191+0000","last_clean":"2023-10-09T06:55:06.952191+0000","last_became_active":"2023-10-09T06:55:06.948195+0000","last_became_peered":"2023-10-09T06:55:06.948195+0000","last_unstale":"2023-10-09T06:55:06.952191+0000","last_undegraded":"2023-10-09T06:55:06.952191+0000","last_fullsized":"2023-10-09T06:55:06.952191+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:08.034847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.937992+0000","last_change":"2023-10-09T06:55:06.928307+0000","last_active":"2023-10-09T06:55:06.937992+0000","last_peered":"2023-10-09T06:55:06.937992+0000","last_clean":"2023-10-09T06:55:06.937992+0000","last_became_active":"2023-10-09T06:55:06.928024+0000","last_became_peered":"2023-10-09T06:55:06.928024+0000","last_unstale":"2023-10-09T06:55:06.937992+0000","last_undegraded":"2023-10-09T06:55:06.937992+0000","last_fullsized":"2023-10-09T06:55:06.937992+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:10:57.887526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.957583+0000","last_change":"2023-10-09T06:55:06.953644+0000","last_active":"2023-10-09T06:55:06.957583+0000","last_peered":"2023-10-09T06:55:06.957583+0000","last_clean":"2023-10-09T06:55:06.957583+0000","last_became_active":"2023-10-09T06:55:06.953144+0000","last_became_peered":"2023-10-09T06:55:06.953144+0000","last_unstale":"2023-10-09T06:55:06.957583+0000","last_undegraded":"2023-10-09T06:55:06.957583+0000","last_fullsized":"2023-10-09T06:55:06.957583+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:04.806773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.950648+0000","last_change":"2023-10-09T06:55:06.939943+0000","last_active":"2023-10-09T06:55:06.950648+0000","last_peered":"2023-10-09T06:55:06.950648+0000","last_clean":"2023-10-09T06:55:06.950648+0000","last_became_active":"2023-10-09T06:55:06.939675+0000","last_became_peered":"2023-10-09T06:55:06.939675+0000","last_unstale":"2023-10-09T06:55:06.950648+0000","last_undegraded":"2023-10-09T06:55:06.950648+0000","last_fullsized":"2023-10-09T06:55:06.950648+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:48.399364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.941216+0000","last_change":"2023-10-09T06:55:06.932908+0000","last_active":"2023-10-09T06:55:06.941216+0000","last_peered":"2023-10-09T06:55:06.941216+0000","last_clean":"2023-10-09T06:55:06.941216+0000","last_became_active":"2023-10-09T06:55:06.932692+0000","last_became_peered":"2023-10-09T06:55:06.932692+0000","last_unstale":"2023-10-09T06:55:06.941216+0000","last_undegraded":"2023-10-09T06:55:06.941216+0000","last_fullsized":"2023-10-09T06:55:06.941216+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:56:01.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.949558+0000","last_change":"2023-10-09T06:55:06.939597+0000","last_active":"2023-10-09T06:55:06.949558+0000","last_peered":"2023-10-09T06:55:06.949558+0000","last_clean":"2023-10-09T06:55:06.949558+0000","last_became_active":"2023-10-09T06:55:06.939344+0000","last_became_peered":"2023-10-09T06:55:06.939344+0000","last_unstale":"2023-10-09T06:55:06.949558+0000","last_undegraded":"2023-10-09T06:55:06.949558+0000","last_fullsized":"2023-10-09T06:55:06.949558+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:43:27.488161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953884+0000","last_change":"2023-10-09T06:55:06.952049+0000","last_active":"2023-10-09T06:55:06.953884+0000","last_peered":"2023-10-09T06:55:06.953884+0000","last_clean":"2023-10-09T06:55:06.953884+0000","last_became_active":"2023-10-09T06:55:06.951794+0000","last_became_peered":"2023-10-09T06:55:06.951794+0000","last_unstale":"2023-10-09T06:55:06.953884+0000","last_undegraded":"2023-10-09T06:55:06.953884+0000","last_fullsized":"2023-10-09T06:55:06.953884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:58:23.011522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.947762+0000","last_change":"2023-10-09T06:55:06.942297+0000","last_active":"2023-10-09T06:55:06.947762+0000","last_peered":"2023-10-09T06:55:06.947762+0000","last_clean":"2023-10-09T06:55:06.947762+0000","last_became_active":"2023-10-09T06:55:06.941997+0000","last_became_peered":"2023-10-09T06:55:06.941997+0000","last_unstale":"2023-10-09T06:55:06.947762+0000","last_undegraded":"2023-10-09T06:55:06.947762+0000","last_fullsized":"2023-10-09T06:55:06.947762+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:27.365626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.957594+0000","last_change":"2023-10-09T06:55:06.954659+0000","last_active":"2023-10-09T06:55:06.957594+0000","last_peered":"2023-10-09T06:55:06.957594+0000","last_clean":"2023-10-09T06:55:06.957594+0000","last_became_active":"2023-10-09T06:55:06.954424+0000","last_became_peered":"2023-10-09T06:55:06.954424+0000","last_unstale":"2023-10-09T06:55:06.957594+0000","last_undegraded":"2023-10-09T06:55:06.957594+0000","last_fullsized":"2023-10-09T06:55:06.957594+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:26:52.867345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.943599+0000","last_change":"2023-10-09T06:55:06.941384+0000","last_active":"2023-10-09T06:55:06.943599+0000","last_peered":"2023-10-09T06:55:06.943599+0000","last_clean":"2023-10-09T06:55:06.943599+0000","last_became_active":"2023-10-09T06:55:06.935944+0000","last_became_peered":"2023-10-09T06:55:06.935944+0000","last_unstale":"2023-10-09T06:55:06.943599+0000","last_undegraded":"2023-10-09T06:55:06.943599+0000","last_fullsized":"2023-10-09T06:55:06.943599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:48:10.713903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.940869+0000","last_change":"2023-10-09T06:55:06.936144+0000","last_active":"2023-10-09T06:55:06.940869+0000","last_peered":"2023-10-09T06:55:06.940869+0000","last_clean":"2023-10-09T06:55:06.940869+0000","last_became_active":"2023-10-09T06:55:06.935757+0000","last_became_peered":"2023-10-09T06:55:06.935757+0000","last_unstale":"2023-10-09T06:55:06.940869+0000","last_undegraded":"2023-10-09T06:55:06.940869+0000","last_fullsized":"2023-10-09T06:55:06.940869+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:18:06.248699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.934730+0000","last_change":"2023-10-09T06:55:06.929812+0000","last_active":"2023-10-09T06:55:06.934730+0000","last_peered":"2023-10-09T06:55:06.934730+0000","last_clean":"2023-10-09T06:55:06.934730+0000","last_became_active":"2023-10-09T06:55:06.929471+0000","last_became_peered":"2023-10-09T06:55:06.929471+0000","last_unstale":"2023-10-09T06:55:06.934730+0000","last_undegraded":"2023-10-09T06:55:06.934730+0000","last_fullsized":"2023-10-09T06:55:06.934730+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:44.668078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.943753+0000","last_change":"2023-10-09T06:55:06.940701+0000","last_active":"2023-10-09T06:55:06.943753+0000","last_peered":"2023-10-09T06:55:06.943753+0000","last_clean":"2023-10-09T06:55:06.943753+0000","last_became_active":"2023-10-09T06:55:06.935669+0000","last_became_peered":"2023-10-09T06:55:06.935669+0000","last_unstale":"2023-10-09T06:55:06.943753+0000","last_undegraded":"2023-10-09T06:55:06.943753+0000","last_fullsized":"2023-10-09T06:55:06.943753+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:27.310704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948019+0000","last_change":"2023-10-09T06:55:06.941609+0000","last_active":"2023-10-09T06:55:06.948019+0000","last_peered":"2023-10-09T06:55:06.948019+0000","last_clean":"2023-10-09T06:55:06.948019+0000","last_became_active":"2023-10-09T06:55:06.941358+0000","last_became_peered":"2023-10-09T06:55:06.941358+0000","last_unstale":"2023-10-09T06:55:06.948019+0000","last_undegraded":"2023-10-09T06:55:06.948019+0000","last_fullsized":"2023-10-09T06:55:06.948019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:33:44.434314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953937+0000","last_change":"2023-10-09T06:55:06.951154+0000","last_active":"2023-10-09T06:55:06.953937+0000","last_peered":"2023-10-09T06:55:06.953937+0000","last_clean":"2023-10-09T06:55:06.953937+0000","last_became_active":"2023-10-09T06:55:06.950918+0000","last_became_peered":"2023-10-09T06:55:06.950918+0000","last_unstale":"2023-10-09T06:55:06.953937+0000","last_undegraded":"2023-10-09T06:55:06.953937+0000","last_fullsized":"2023-10-09T06:55:06.953937+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:27.342291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.943250+0000","last_change":"2023-10-09T06:55:06.938814+0000","last_active":"2023-10-09T06:55:06.943250+0000","last_peered":"2023-10-09T06:55:06.943250+0000","last_clean":"2023-10-09T06:55:06.943250+0000","last_became_active":"2023-10-09T06:55:06.938536+0000","last_became_peered":"2023-10-09T06:55:06.938536+0000","last_unstale":"2023-10-09T06:55:06.943250+0000","last_undegraded":"2023-10-09T06:55:06.943250+0000","last_fullsized":"2023-10-09T06:55:06.943250+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:00.077635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.951506+0000","last_change":"2023-10-09T06:55:06.947089+0000","last_active":"2023-10-09T06:55:06.951506+0000","last_peered":"2023-10-09T06:55:06.951506+0000","last_clean":"2023-10-09T06:55:06.951506+0000","last_became_active":"2023-10-09T06:55:06.946423+0000","last_became_peered":"2023-10-09T06:55:06.946423+0000","last_unstale":"2023-10-09T06:55:06.951506+0000","last_undegraded":"2023-10-09T06:55:06.951506+0000","last_fullsized":"2023-10-09T06:55:06.951506+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:27.342291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953339+0000","last_change":"2023-10-09T06:55:06.947260+0000","last_active":"2023-10-09T06:55:06.953339+0000","last_peered":"2023-10-09T06:55:06.953339+0000","last_clean":"2023-10-09T06:55:06.953339+0000","last_became_active":"2023-10-09T06:55:06.946996+0000","last_became_peered":"2023-10-09T06:55:06.946996+0000","last_unstale":"2023-10-09T06:55:06.953339+0000","last_undegraded":"2023-10-09T06:55:06.953339+0000","last_fullsized":"2023-10-09T06:55:06.953339+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:13.874146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.946692+0000","last_change":"2023-10-09T06:55:06.945053+0000","last_active":"2023-10-09T06:55:06.946692+0000","last_peered":"2023-10-09T06:55:06.946692+0000","last_clean":"2023-10-09T06:55:06.946692+0000","last_became_active":"2023-10-09T06:55:06.944789+0000","last_became_peered":"2023-10-09T06:55:06.944789+0000","last_unstale":"2023-10-09T06:55:06.946692+0000","last_undegraded":"2023-10-09T06:55:06.946692+0000","last_fullsized":"2023-10-09T06:55:06.946692+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:08.244758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948157+0000","last_change":"2023-10-09T06:55:06.945836+0000","last_active":"2023-10-09T06:55:06.948157+0000","last_peered":"2023-10-09T06:55:06.948157+0000","last_clean":"2023-10-09T06:55:06.948157+0000","last_became_active":"2023-10-09T06:55:06.945564+0000","last_became_peered":"2023-10-09T06:55:06.945564+0000","last_unstale":"2023-10-09T06:55:06.948157+0000","last_undegraded":"2023-10-09T06:55:06.948157+0000","last_fullsized":"2023-10-09T06:55:06.948157+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:40.055223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955508+0000","last_change":"2023-10-09T06:55:06.953311+0000","last_active":"2023-10-09T06:55:06.955508+0000","last_peered":"2023-10-09T06:55:06.955508+0000","last_clean":"2023-10-09T06:55:06.955508+0000","last_became_active":"2023-10-09T06:55:06.952959+0000","last_became_peered":"2023-10-09T06:55:06.952959+0000","last_unstale":"2023-10-09T06:55:06.955508+0000","last_undegraded":"2023-10-09T06:55:06.955508+0000","last_fullsized":"2023-10-09T06:55:06.955508+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:12:43.264714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948265+0000","last_change":"2023-10-09T06:55:06.942933+0000","last_active":"2023-10-09T06:55:06.948265+0000","last_peered":"2023-10-09T06:55:06.948265+0000","last_clean":"2023-10-09T06:55:06.948265+0000","last_became_active":"2023-10-09T06:55:06.942300+0000","last_became_peered":"2023-10-09T06:55:06.942300+0000","last_unstale":"2023-10-09T06:55:06.948265+0000","last_undegraded":"2023-10-09T06:55:06.948265+0000","last_fullsized":"2023-10-09T06:55:06.948265+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:21.359666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948195+0000","last_change":"2023-10-09T06:55:06.942752+0000","last_active":"2023-10-09T06:55:06.948195+0000","last_peered":"2023-10-09T06:55:06.948195+0000","last_clean":"2023-10-09T06:55:06.948195+0000","last_became_active":"2023-10-09T06:55:06.942448+0000","last_became_peered":"2023-10-09T06:55:06.942448+0000","last_unstale":"2023-10-09T06:55:06.948195+0000","last_undegraded":"2023-10-09T06:55:06.948195+0000","last_fullsized":"2023-10-09T06:55:06.948195+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:47.548592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954067+0000","last_change":"2023-10-09T06:55:06.948333+0000","last_active":"2023-10-09T06:55:06.954067+0000","last_peered":"2023-10-09T06:55:06.954067+0000","last_clean":"2023-10-09T06:55:06.954067+0000","last_became_active":"2023-10-09T06:55:06.946602+0000","last_became_peered":"2023-10-09T06:55:06.946602+0000","last_unstale":"2023-10-09T06:55:06.954067+0000","last_undegraded":"2023-10-09T06:55:06.954067+0000","last_fullsized":"2023-10-09T06:55:06.954067+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:26:48.145004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.942812+0000","last_change":"2023-10-09T06:55:06.939960+0000","last_active":"2023-10-09T06:55:06.942812+0000","last_peered":"2023-10-09T06:55:06.942812+0000","last_clean":"2023-10-09T06:55:06.942812+0000","last_became_active":"2023-10-09T06:55:06.939690+0000","last_became_peered":"2023-10-09T06:55:06.939690+0000","last_unstale":"2023-10-09T06:55:06.942812+0000","last_undegraded":"2023-10-09T06:55:06.942812+0000","last_fullsized":"2023-10-09T06:55:06.942812+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:07:47.321921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.951144+0000","last_change":"2023-10-09T06:55:06.940527+0000","last_active":"2023-10-09T06:55:06.951144+0000","last_peered":"2023-10-09T06:55:06.951144+0000","last_clean":"2023-10-09T06:55:06.951144+0000","last_became_active":"2023-10-09T06:55:06.940228+0000","last_became_peered":"2023-10-09T06:55:06.940228+0000","last_unstale":"2023-10-09T06:55:06.951144+0000","last_undegraded":"2023-10-09T06:55:06.951144+0000","last_fullsized":"2023-10-09T06:55:06.951144+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:21.359666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.950449+0000","last_change":"2023-10-09T06:55:06.938753+0000","last_active":"2023-10-09T06:55:06.950449+0000","last_peered":"2023-10-09T06:55:06.950449+0000","last_clean":"2023-10-09T06:55:06.950449+0000","last_became_active":"2023-10-09T06:55:06.938454+0000","last_became_peered":"2023-10-09T06:55:06.938454+0000","last_unstale":"2023-10-09T06:55:06.950449+0000","last_undegraded":"2023-10-09T06:55:06.950449+0000","last_fullsized":"2023-10-09T06:55:06.950449+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:10.372066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954064+0000","last_change":"2023-10-09T06:55:06.945602+0000","last_active":"2023-10-09T06:55:06.954064+0000","last_peered":"2023-10-09T06:55:06.954064+0000","last_clean":"2023-10-09T06:55:06.954064+0000","last_became_active":"2023-10-09T06:55:06.945315+0000","last_became_peered":"2023-10-09T06:55:06.945315+0000","last_unstale":"2023-10-09T06:55:06.954064+0000","last_undegraded":"2023-10-09T06:55:06.954064+0000","last_fullsized":"2023-10-09T06:55:06.954064+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:22.559262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.939241+0000","last_change":"2023-10-09T06:55:06.932066+0000","last_active":"2023-10-09T06:55:06.939241+0000","last_peered":"2023-10-09T06:55:06.939241+0000","last_clean":"2023-10-09T06:55:06.939241+0000","last_became_active":"2023-10-09T06:55:06.931575+0000","last_became_peered":"2023-10-09T06:55:06.931575+0000","last_unstale":"2023-10-09T06:55:06.939241+0000","last_undegraded":"2023-10-09T06:55:06.939241+0000","last_fullsized":"2023-10-09T06:55:06.939241+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:30:30.430228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948071+0000","last_change":"2023-10-09T06:55:06.943815+0000","last_active":"2023-10-09T06:55:06.948071+0000","last_peered":"2023-10-09T06:55:06.948071+0000","last_clean":"2023-10-09T06:55:06.948071+0000","last_became_active":"2023-10-09T06:55:06.943558+0000","last_became_peered":"2023-10-09T06:55:06.943558+0000","last_unstale":"2023-10-09T06:55:06.948071+0000","last_undegraded":"2023-10-09T06:55:06.948071+0000","last_fullsized":"2023-10-09T06:55:06.948071+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:24:19.345593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.934846+0000","last_change":"2023-10-09T06:55:06.928130+0000","last_active":"2023-10-09T06:55:06.934846+0000","last_peered":"2023-10-09T06:55:06.934846+0000","last_clean":"2023-10-09T06:55:06.934846+0000","last_became_active":"2023-10-09T06:55:06.927851+0000","last_became_peered":"2023-10-09T06:55:06.927851+0000","last_unstale":"2023-10-09T06:55:06.934846+0000","last_undegraded":"2023-10-09T06:55:06.934846+0000","last_fullsized":"2023-10-09T06:55:06.934846+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:18.653877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954325+0000","last_change":"2023-10-09T06:55:06.952189+0000","last_active":"2023-10-09T06:55:06.954325+0000","last_peered":"2023-10-09T06:55:06.954325+0000","last_clean":"2023-10-09T06:55:06.954325+0000","last_became_active":"2023-10-09T06:55:06.951940+0000","last_became_peered":"2023-10-09T06:55:06.951940+0000","last_unstale":"2023-10-09T06:55:06.954325+0000","last_undegraded":"2023-10-09T06:55:06.954325+0000","last_fullsized":"2023-10-09T06:55:06.954325+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:22.559262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"61'4","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955223+0000","last_change":"2023-10-09T06:55:05.933796+0000","last_active":"2023-10-09T06:55:06.955223+0000","last_peered":"2023-10-09T06:55:06.955223+0000","last_clean":"2023-10-09T06:55:06.955223+0000","last_became_active":"2023-10-09T06:55:05.933559+0000","last_became_peered":"2023-10-09T06:55:05.933559+0000","last_unstale":"2023-10-09T06:55:06.955223+0000","last_undegraded":"2023-10-09T06:55:06.955223+0000","last_fullsized":"2023-10-09T06:55:06.955223+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:09.365369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954161+0000","last_change":"2023-10-09T06:55:06.950139+0000","last_active":"2023-10-09T06:55:06.954161+0000","last_peered":"2023-10-09T06:55:06.954161+0000","last_clean":"2023-10-09T06:55:06.954161+0000","last_became_active":"2023-10-09T06:55:06.949821+0000","last_became_peered":"2023-10-09T06:55:06.949821+0000","last_unstale":"2023-10-09T06:55:06.954161+0000","last_undegraded":"2023-10-09T06:55:06.954161+0000","last_fullsized":"2023-10-09T06:55:06.954161+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:00.077635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.952794+0000","last_change":"2023-10-09T06:55:05.931291+0000","last_active":"2023-10-09T06:55:06.952794+0000","last_peered":"2023-10-09T06:55:06.952794+0000","last_clean":"2023-10-09T06:55:06.952794+0000","last_became_active":"2023-10-09T06:55:05.931030+0000","last_became_peered":"2023-10-09T06:55:05.931030+0000","last_unstale":"2023-10-09T06:55:06.952794+0000","last_undegraded":"2023-10-09T06:55:06.952794+0000","last_fullsized":"2023-10-09T06:55:06.952794+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:02:17.540297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.952106+0000","last_change":"2023-10-09T06:55:06.944084+0000","last_active":"2023-10-09T06:55:06.952106+0000","last_peered":"2023-10-09T06:55:06.952106+0000","last_clean":"2023-10-09T06:55:06.952106+0000","last_became_active":"2023-10-09T06:55:06.943799+0000","last_became_peered":"2023-10-09T06:55:06.943799+0000","last_unstale":"2023-10-09T06:55:06.952106+0000","last_undegraded":"2023-10-09T06:55:06.952106+0000","last_fullsized":"2023-10-09T06:55:06.952106+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:12:43.264714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.952611+0000","last_change":"2023-10-09T06:55:05.936463+0000","last_active":"2023-10-09T06:55:06.952611+0000","last_peered":"2023-10-09T06:55:06.952611+0000","last_clean":"2023-10-09T06:55:06.952611+0000","last_became_active":"2023-10-09T06:55:05.936166+0000","last_became_peered":"2023-10-09T06:55:05.936166+0000","last_unstale":"2023-10-09T06:55:06.952611+0000","last_undegraded":"2023-10-09T06:55:06.952611+0000","last_fullsized":"2023-10-09T06:55:06.952611+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:30.427585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.945118+0000","last_change":"2023-10-09T06:55:06.944529+0000","last_active":"2023-10-09T06:55:06.945118+0000","last_peered":"2023-10-09T06:55:06.945118+0000","last_clean":"2023-10-09T06:55:06.945118+0000","last_became_active":"2023-10-09T06:55:06.944264+0000","last_became_peered":"2023-10-09T06:55:06.944264+0000","last_unstale":"2023-10-09T06:55:06.945118+0000","last_undegraded":"2023-10-09T06:55:06.945118+0000","last_fullsized":"2023-10-09T06:55:06.945118+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:47.548592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955066+0000","last_change":"2023-10-09T06:55:05.935262+0000","last_active":"2023-10-09T06:55:06.955066+0000","last_peered":"2023-10-09T06:55:06.955066+0000","last_clean":"2023-10-09T06:55:06.955066+0000","last_became_active":"2023-10-09T06:55:05.934932+0000","last_became_peered":"2023-10-09T06:55:05.934932+0000","last_unstale":"2023-10-09T06:55:06.955066+0000","last_undegraded":"2023-10-09T06:55:06.955066+0000","last_fullsized":"2023-10-09T06:55:06.955066+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:02:48.884634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.951329+0000","last_change":"2023-10-09T06:55:06.939358+0000","last_active":"2023-10-09T06:55:06.951329+0000","last_peered":"2023-10-09T06:55:06.951329+0000","last_clean":"2023-10-09T06:55:06.951329+0000","last_became_active":"2023-10-09T06:55:06.939058+0000","last_became_peered":"2023-10-09T06:55:06.939058+0000","last_unstale":"2023-10-09T06:55:06.951329+0000","last_undegraded":"2023-10-09T06:55:06.951329+0000","last_fullsized":"2023-10-09T06:55:06.951329+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:13.874146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953637+0000","last_change":"2023-10-09T06:55:05.931537+0000","last_active":"2023-10-09T06:55:06.953637+0000","last_peered":"2023-10-09T06:55:06.953637+0000","last_clean":"2023-10-09T06:55:06.953637+0000","last_became_active":"2023-10-09T06:55:05.931300+0000","last_became_peered":"2023-10-09T06:55:05.931300+0000","last_unstale":"2023-10-09T06:55:06.953637+0000","last_undegraded":"2023-10-09T06:55:06.953637+0000","last_fullsized":"2023-10-09T06:55:06.953637+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:07.028150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.944440+0000","last_change":"2023-10-09T06:55:06.938409+0000","last_active":"2023-10-09T06:55:06.944440+0000","last_peered":"2023-10-09T06:55:06.944440+0000","last_clean":"2023-10-09T06:55:06.944440+0000","last_became_active":"2023-10-09T06:55:06.938160+0000","last_became_peered":"2023-10-09T06:55:06.938160+0000","last_unstale":"2023-10-09T06:55:06.944440+0000","last_undegraded":"2023-10-09T06:55:06.944440+0000","last_fullsized":"2023-10-09T06:55:06.944440+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:29:45.885127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.941331+0000","last_change":"2023-10-09T06:55:05.923991+0000","last_active":"2023-10-09T06:55:06.941331+0000","last_peered":"2023-10-09T06:55:06.941331+0000","last_clean":"2023-10-09T06:55:06.941331+0000","last_became_active":"2023-10-09T06:55:05.923625+0000","last_became_peered":"2023-10-09T06:55:05.923625+0000","last_unstale":"2023-10-09T06:55:06.941331+0000","last_undegraded":"2023-10-09T06:55:06.941331+0000","last_fullsized":"2023-10-09T06:55:06.941331+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:26:41.909058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955407+0000","last_change":"2023-10-09T06:55:06.952666+0000","last_active":"2023-10-09T06:55:06.955407+0000","last_peered":"2023-10-09T06:55:06.955407+0000","last_clean":"2023-10-09T06:55:06.955407+0000","last_became_active":"2023-10-09T06:55:06.952418+0000","last_became_peered":"2023-10-09T06:55:06.952418+0000","last_unstale":"2023-10-09T06:55:06.955407+0000","last_undegraded":"2023-10-09T06:55:06.955407+0000","last_fullsized":"2023-10-09T06:55:06.955407+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:43:07.311728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.927159+0000","last_change":"2023-10-09T06:55:05.932956+0000","last_active":"2023-10-09T06:55:06.927159+0000","last_peered":"2023-10-09T06:55:06.927159+0000","last_clean":"2023-10-09T06:55:06.927159+0000","last_became_active":"2023-10-09T06:55:05.932697+0000","last_became_peered":"2023-10-09T06:55:05.932697+0000","last_unstale":"2023-10-09T06:55:06.927159+0000","last_undegraded":"2023-10-09T06:55:06.927159+0000","last_fullsized":"2023-10-09T06:55:06.927159+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:59.070938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948242+0000","last_change":"2023-10-09T06:55:06.942850+0000","last_active":"2023-10-09T06:55:06.948242+0000","last_peered":"2023-10-09T06:55:06.948242+0000","last_clean":"2023-10-09T06:55:06.948242+0000","last_became_active":"2023-10-09T06:55:06.942558+0000","last_became_peered":"2023-10-09T06:55:06.942558+0000","last_unstale":"2023-10-09T06:55:06.948242+0000","last_undegraded":"2023-10-09T06:55:06.948242+0000","last_fullsized":"2023-10-09T06:55:06.948242+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:10:57.887526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.923500+0000","last_change":"2023-10-09T06:55:05.932660+0000","last_active":"2023-10-09T06:55:06.923500+0000","last_peered":"2023-10-09T06:55:06.923500+0000","last_clean":"2023-10-09T06:55:06.923500+0000","last_became_active":"2023-10-09T06:55:05.932396+0000","last_became_peered":"2023-10-09T06:55:05.932396+0000","last_unstale":"2023-10-09T06:55:06.923500+0000","last_undegraded":"2023-10-09T06:55:06.923500+0000","last_fullsized":"2023-10-09T06:55:06.923500+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:46.541894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.951486+0000","last_change":"2023-10-09T06:55:06.946914+0000","last_active":"2023-10-09T06:55:06.951486+0000","last_peered":"2023-10-09T06:55:06.951486+0000","last_clean":"2023-10-09T06:55:06.951486+0000","last_became_active":"2023-10-09T06:55:06.946064+0000","last_became_peered":"2023-10-09T06:55:06.946064+0000","last_unstale":"2023-10-09T06:55:06.951486+0000","last_undegraded":"2023-10-09T06:55:06.951486+0000","last_fullsized":"2023-10-09T06:55:06.951486+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:26:48.145004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.923498+0000","last_change":"2023-10-09T06:55:05.933823+0000","last_active":"2023-10-09T06:55:06.923498+0000","last_peered":"2023-10-09T06:55:06.923498+0000","last_clean":"2023-10-09T06:55:06.923498+0000","last_became_active":"2023-10-09T06:55:05.933566+0000","last_became_peered":"2023-10-09T06:55:05.933566+0000","last_unstale":"2023-10-09T06:55:06.923498+0000","last_undegraded":"2023-10-09T06:55:06.923498+0000","last_fullsized":"2023-10-09T06:55:06.923498+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:52:41.277241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953271+0000","last_change":"2023-10-09T06:55:06.948696+0000","last_active":"2023-10-09T06:55:06.953271+0000","last_peered":"2023-10-09T06:55:06.953271+0000","last_clean":"2023-10-09T06:55:06.953271+0000","last_became_active":"2023-10-09T06:55:06.948292+0000","last_became_peered":"2023-10-09T06:55:06.948292+0000","last_unstale":"2023-10-09T06:55:06.953271+0000","last_undegraded":"2023-10-09T06:55:06.953271+0000","last_fullsized":"2023-10-09T06:55:06.953271+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:27.342291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.933075+0000","last_change":"2023-10-09T06:55:05.932297+0000","last_active":"2023-10-09T06:55:06.933075+0000","last_peered":"2023-10-09T06:55:06.933075+0000","last_clean":"2023-10-09T06:55:06.933075+0000","last_became_active":"2023-10-09T06:55:05.931969+0000","last_became_peered":"2023-10-09T06:55:05.931969+0000","last_unstale":"2023-10-09T06:55:06.933075+0000","last_undegraded":"2023-10-09T06:55:06.933075+0000","last_fullsized":"2023-10-09T06:55:06.933075+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:04:29.076275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.932452+0000","last_change":"2023-10-09T06:55:06.928878+0000","last_active":"2023-10-09T06:55:06.932452+0000","last_peered":"2023-10-09T06:55:06.932452+0000","last_clean":"2023-10-09T06:55:06.932452+0000","last_became_active":"2023-10-09T06:55:06.928633+0000","last_became_peered":"2023-10-09T06:55:06.928633+0000","last_unstale":"2023-10-09T06:55:06.932452+0000","last_undegraded":"2023-10-09T06:55:06.932452+0000","last_fullsized":"2023-10-09T06:55:06.932452+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:48:10.713903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"61'3","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.956479+0000","last_change":"2023-10-09T06:55:05.938582+0000","last_active":"2023-10-09T06:55:06.956479+0000","last_peered":"2023-10-09T06:55:06.956479+0000","last_clean":"2023-10-09T06:55:06.956479+0000","last_became_active":"2023-10-09T06:55:05.938239+0000","last_became_peered":"2023-10-09T06:55:05.938239+0000","last_unstale":"2023-10-09T06:55:06.956479+0000","last_undegraded":"2023-10-09T06:55:06.956479+0000","last_fullsized":"2023-10-09T06:55:06.956479+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:21.552564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953095+0000","last_change":"2023-10-09T06:55:06.942075+0000","last_active":"2023-10-09T06:55:06.953095+0000","last_peered":"2023-10-09T06:55:06.953095+0000","last_clean":"2023-10-09T06:55:06.953095+0000","last_became_active":"2023-10-09T06:55:06.941725+0000","last_became_peered":"2023-10-09T06:55:06.941725+0000","last_unstale":"2023-10-09T06:55:06.953095+0000","last_undegraded":"2023-10-09T06:55:06.953095+0000","last_fullsized":"2023-10-09T06:55:06.953095+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:50:27.836402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"61'6","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.958234+0000","last_change":"2023-10-09T06:55:05.931955+0000","last_active":"2023-10-09T06:55:06.958234+0000","last_peered":"2023-10-09T06:55:06.958234+0000","last_clean":"2023-10-09T06:55:06.958234+0000","last_became_active":"2023-10-09T06:55:05.931712+0000","last_became_peered":"2023-10-09T06:55:05.931712+0000","last_unstale":"2023-10-09T06:55:06.958234+0000","last_undegraded":"2023-10-09T06:55:06.958234+0000","last_fullsized":"2023-10-09T06:55:06.958234+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:17.429884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953854+0000","last_change":"2023-10-09T06:55:06.948630+0000","last_active":"2023-10-09T06:55:06.953854+0000","last_peered":"2023-10-09T06:55:06.953854+0000","last_clean":"2023-10-09T06:55:06.953854+0000","last_became_active":"2023-10-09T06:55:06.947635+0000","last_became_peered":"2023-10-09T06:55:06.947635+0000","last_unstale":"2023-10-09T06:55:06.953854+0000","last_undegraded":"2023-10-09T06:55:06.953854+0000","last_fullsized":"2023-10-09T06:55:06.953854+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:19.860358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.949612+0000","last_change":"2023-10-09T06:55:05.941482+0000","last_active":"2023-10-09T06:55:06.949612+0000","last_peered":"2023-10-09T06:55:06.949612+0000","last_clean":"2023-10-09T06:55:06.949612+0000","last_became_active":"2023-10-09T06:55:05.941132+0000","last_became_peered":"2023-10-09T06:55:05.941132+0000","last_unstale":"2023-10-09T06:55:06.949612+0000","last_undegraded":"2023-10-09T06:55:06.949612+0000","last_fullsized":"2023-10-09T06:55:06.949612+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:47.392667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.944422+0000","last_change":"2023-10-09T06:55:06.934503+0000","last_active":"2023-10-09T06:55:06.944422+0000","last_peered":"2023-10-09T06:55:06.944422+0000","last_clean":"2023-10-09T06:55:06.944422+0000","last_became_active":"2023-10-09T06:55:06.934249+0000","last_became_peered":"2023-10-09T06:55:06.934249+0000","last_unstale":"2023-10-09T06:55:06.944422+0000","last_undegraded":"2023-10-09T06:55:06.944422+0000","last_fullsized":"2023-10-09T06:55:06.944422+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:04.244093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.929902+0000","last_change":"2023-10-09T06:55:05.931993+0000","last_active":"2023-10-09T06:55:06.929902+0000","last_peered":"2023-10-09T06:55:06.929902+0000","last_clean":"2023-10-09T06:55:06.929902+0000","last_became_active":"2023-10-09T06:55:05.931747+0000","last_became_peered":"2023-10-09T06:55:05.931747+0000","last_unstale":"2023-10-09T06:55:06.929902+0000","last_undegraded":"2023-10-09T06:55:06.929902+0000","last_fullsized":"2023-10-09T06:55:06.929902+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:49:48.304060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.928958+0000","last_change":"2023-10-09T06:55:06.926676+0000","last_active":"2023-10-09T06:55:06.928958+0000","last_peered":"2023-10-09T06:55:06.928958+0000","last_clean":"2023-10-09T06:55:06.928958+0000","last_became_active":"2023-10-09T06:55:06.926433+0000","last_became_peered":"2023-10-09T06:55:06.926433+0000","last_unstale":"2023-10-09T06:55:06.928958+0000","last_undegraded":"2023-10-09T06:55:06.928958+0000","last_fullsized":"2023-10-09T06:55:06.928958+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:26:52.867345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.923136+0000","last_change":"2023-10-09T06:55:05.935304+0000","last_active":"2023-10-09T06:55:06.923136+0000","last_peered":"2023-10-09T06:55:06.923136+0000","last_clean":"2023-10-09T06:55:06.923136+0000","last_became_active":"2023-10-09T06:55:05.935055+0000","last_became_peered":"2023-10-09T06:55:05.935055+0000","last_unstale":"2023-10-09T06:55:06.923136+0000","last_undegraded":"2023-10-09T06:55:06.923136+0000","last_fullsized":"2023-10-09T06:55:06.923136+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:16:25.613767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954291+0000","last_change":"2023-10-09T06:55:06.953060+0000","last_active":"2023-10-09T06:55:06.954291+0000","last_peered":"2023-10-09T06:55:06.954291+0000","last_clean":"2023-10-09T06:55:06.954291+0000","last_became_active":"2023-10-09T06:55:06.952769+0000","last_became_peered":"2023-10-09T06:55:06.952769+0000","last_unstale":"2023-10-09T06:55:06.954291+0000","last_undegraded":"2023-10-09T06:55:06.954291+0000","last_fullsized":"2023-10-09T06:55:06.954291+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:12:43.264714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"61'8","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955749+0000","last_change":"2023-10-09T06:55:05.939559+0000","last_active":"2023-10-09T06:55:06.955749+0000","last_peered":"2023-10-09T06:55:06.955749+0000","last_clean":"2023-10-09T06:55:06.955749+0000","last_became_active":"2023-10-09T06:55:05.939250+0000","last_became_peered":"2023-10-09T06:55:05.939250+0000","last_unstale":"2023-10-09T06:55:06.955749+0000","last_undegraded":"2023-10-09T06:55:06.955749+0000","last_fullsized":"2023-10-09T06:55:06.955749+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:57.104240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.943570+0000","last_change":"2023-10-09T06:55:06.940395+0000","last_active":"2023-10-09T06:55:06.943570+0000","last_peered":"2023-10-09T06:55:06.943570+0000","last_clean":"2023-10-09T06:55:06.943570+0000","last_became_active":"2023-10-09T06:55:06.940110+0000","last_became_peered":"2023-10-09T06:55:06.940110+0000","last_unstale":"2023-10-09T06:55:06.943570+0000","last_undegraded":"2023-10-09T06:55:06.943570+0000","last_fullsized":"2023-10-09T06:55:06.943570+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:11.042189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.947490+0000","last_change":"2023-10-09T06:55:05.932965+0000","last_active":"2023-10-09T06:55:06.947490+0000","last_peered":"2023-10-09T06:55:06.947490+0000","last_clean":"2023-10-09T06:55:06.947490+0000","last_became_active":"2023-10-09T06:55:05.932676+0000","last_became_peered":"2023-10-09T06:55:05.932676+0000","last_unstale":"2023-10-09T06:55:06.947490+0000","last_undegraded":"2023-10-09T06:55:06.947490+0000","last_fullsized":"2023-10-09T06:55:06.947490+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:03:56.177535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948676+0000","last_change":"2023-10-09T06:55:06.944157+0000","last_active":"2023-10-09T06:55:06.948676+0000","last_peered":"2023-10-09T06:55:06.948676+0000","last_clean":"2023-10-09T06:55:06.948676+0000","last_became_active":"2023-10-09T06:55:06.943866+0000","last_became_peered":"2023-10-09T06:55:06.943866+0000","last_unstale":"2023-10-09T06:55:06.948676+0000","last_undegraded":"2023-10-09T06:55:06.948676+0000","last_fullsized":"2023-10-09T06:55:06.948676+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:12.040675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.947250+0000","last_change":"2023-10-09T06:55:05.930339+0000","last_active":"2023-10-09T06:55:06.947250+0000","last_peered":"2023-10-09T06:55:06.947250+0000","last_clean":"2023-10-09T06:55:06.947250+0000","last_became_active":"2023-10-09T06:55:05.930075+0000","last_became_peered":"2023-10-09T06:55:05.930075+0000","last_unstale":"2023-10-09T06:55:06.947250+0000","last_undegraded":"2023-10-09T06:55:06.947250+0000","last_fullsized":"2023-10-09T06:55:06.947250+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:25.646016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953398+0000","last_change":"2023-10-09T06:55:06.946543+0000","last_active":"2023-10-09T06:55:06.953398+0000","last_peered":"2023-10-09T06:55:06.953398+0000","last_clean":"2023-10-09T06:55:06.953398+0000","last_became_active":"2023-10-09T06:55:06.946212+0000","last_became_peered":"2023-10-09T06:55:06.946212+0000","last_unstale":"2023-10-09T06:55:06.953398+0000","last_undegraded":"2023-10-09T06:55:06.953398+0000","last_fullsized":"2023-10-09T06:55:06.953398+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:04:30.082972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.955241+0000","last_change":"2023-10-09T06:55:05.933469+0000","last_active":"2023-10-09T06:55:06.955241+0000","last_peered":"2023-10-09T06:55:06.955241+0000","last_clean":"2023-10-09T06:55:06.955241+0000","last_became_active":"2023-10-09T06:55:05.933182+0000","last_became_peered":"2023-10-09T06:55:05.933182+0000","last_unstale":"2023-10-09T06:55:06.955241+0000","last_undegraded":"2023-10-09T06:55:06.955241+0000","last_fullsized":"2023-10-09T06:55:06.955241+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:20.352969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953318+0000","last_change":"2023-10-09T06:55:06.944943+0000","last_active":"2023-10-09T06:55:06.953318+0000","last_peered":"2023-10-09T06:55:06.953318+0000","last_clean":"2023-10-09T06:55:06.953318+0000","last_became_active":"2023-10-09T06:55:06.944651+0000","last_became_peered":"2023-10-09T06:55:06.944651+0000","last_unstale":"2023-10-09T06:55:06.953318+0000","last_undegraded":"2023-10-09T06:55:06.953318+0000","last_fullsized":"2023-10-09T06:55:06.953318+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:30:30.430228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.925347+0000","last_change":"2023-10-09T06:55:05.933315+0000","last_active":"2023-10-09T06:55:06.925347+0000","last_peered":"2023-10-09T06:55:06.925347+0000","last_clean":"2023-10-09T06:55:06.925347+0000","last_became_active":"2023-10-09T06:55:05.933044+0000","last_became_peered":"2023-10-09T06:55:05.933044+0000","last_unstale":"2023-10-09T06:55:06.925347+0000","last_undegraded":"2023-10-09T06:55:06.925347+0000","last_fullsized":"2023-10-09T06:55:06.925347+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:51.403402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.941236+0000","last_change":"2023-10-09T06:55:06.935138+0000","last_active":"2023-10-09T06:55:06.941236+0000","last_peered":"2023-10-09T06:55:06.941236+0000","last_clean":"2023-10-09T06:55:06.941236+0000","last_became_active":"2023-10-09T06:55:06.934886+0000","last_became_peered":"2023-10-09T06:55:06.934886+0000","last_unstale":"2023-10-09T06:55:06.941236+0000","last_undegraded":"2023-10-09T06:55:06.941236+0000","last_fullsized":"2023-10-09T06:55:06.941236+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:28.982187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953731+0000","last_change":"2023-10-09T06:55:05.930744+0000","last_active":"2023-10-09T06:55:06.953731+0000","last_peered":"2023-10-09T06:55:06.953731+0000","last_clean":"2023-10-09T06:55:06.953731+0000","last_became_active":"2023-10-09T06:55:05.930460+0000","last_became_peered":"2023-10-09T06:55:05.930460+0000","last_unstale":"2023-10-09T06:55:06.953731+0000","last_undegraded":"2023-10-09T06:55:06.953731+0000","last_fullsized":"2023-10-09T06:55:06.953731+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:18:05.242002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954278+0000","last_change":"2023-10-09T06:55:06.951304+0000","last_active":"2023-10-09T06:55:06.954278+0000","last_peered":"2023-10-09T06:55:06.954278+0000","last_clean":"2023-10-09T06:55:06.954278+0000","last_became_active":"2023-10-09T06:55:06.950931+0000","last_became_peered":"2023-10-09T06:55:06.950931+0000","last_unstale":"2023-10-09T06:55:06.954278+0000","last_undegraded":"2023-10-09T06:55:06.954278+0000","last_fullsized":"2023-10-09T06:55:06.954278+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:17.846967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.927303+0000","last_change":"2023-10-09T06:55:05.932114+0000","last_active":"2023-10-09T06:55:06.927303+0000","last_peered":"2023-10-09T06:55:06.927303+0000","last_clean":"2023-10-09T06:55:06.927303+0000","last_became_active":"2023-10-09T06:55:05.931130+0000","last_became_peered":"2023-10-09T06:55:05.931130+0000","last_unstale":"2023-10-09T06:55:06.927303+0000","last_undegraded":"2023-10-09T06:55:06.927303+0000","last_fullsized":"2023-10-09T06:55:06.927303+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:04:29.076275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.936298+0000","last_change":"2023-10-09T06:55:06.933965+0000","last_active":"2023-10-09T06:55:06.936298+0000","last_peered":"2023-10-09T06:55:06.936298+0000","last_clean":"2023-10-09T06:55:06.936298+0000","last_became_active":"2023-10-09T06:55:06.933697+0000","last_became_peered":"2023-10-09T06:55:06.933697+0000","last_unstale":"2023-10-09T06:55:06.936298+0000","last_undegraded":"2023-10-09T06:55:06.936298+0000","last_fullsized":"2023-10-09T06:55:06.936298+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:52.068938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.932376+0000","last_change":"2023-10-09T06:55:05.939438+0000","last_active":"2023-10-09T06:55:06.932376+0000","last_peered":"2023-10-09T06:55:06.932376+0000","last_clean":"2023-10-09T06:55:06.932376+0000","last_became_active":"2023-10-09T06:55:05.939179+0000","last_became_peered":"2023-10-09T06:55:05.939179+0000","last_unstale":"2023-10-09T06:55:06.932376+0000","last_undegraded":"2023-10-09T06:55:06.932376+0000","last_fullsized":"2023-10-09T06:55:06.932376+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:21.552564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.944385+0000","last_change":"2023-10-09T06:55:06.941903+0000","last_active":"2023-10-09T06:55:06.944385+0000","last_peered":"2023-10-09T06:55:06.944385+0000","last_clean":"2023-10-09T06:55:06.944385+0000","last_became_active":"2023-10-09T06:55:06.941654+0000","last_became_peered":"2023-10-09T06:55:06.941654+0000","last_unstale":"2023-10-09T06:55:06.944385+0000","last_undegraded":"2023-10-09T06:55:06.944385+0000","last_fullsized":"2023-10-09T06:55:06.944385+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:36.964322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.929584+0000","last_change":"2023-10-09T06:55:05.937191+0000","last_active":"2023-10-09T06:55:06.929584+0000","last_peered":"2023-10-09T06:55:06.929584+0000","last_clean":"2023-10-09T06:55:06.929584+0000","last_became_active":"2023-10-09T06:55:05.936808+0000","last_became_peered":"2023-10-09T06:55:05.936808+0000","last_unstale":"2023-10-09T06:55:06.929584+0000","last_undegraded":"2023-10-09T06:55:06.929584+0000","last_fullsized":"2023-10-09T06:55:06.929584+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:57.104240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.954182+0000","last_change":"2023-10-09T06:55:06.950960+0000","last_active":"2023-10-09T06:55:06.954182+0000","last_peered":"2023-10-09T06:55:06.954182+0000","last_clean":"2023-10-09T06:55:06.954182+0000","last_became_active":"2023-10-09T06:55:06.950716+0000","last_became_peered":"2023-10-09T06:55:06.950716+0000","last_unstale":"2023-10-09T06:55:06.954182+0000","last_undegraded":"2023-10-09T06:55:06.954182+0000","last_fullsized":"2023-10-09T06:55:06.954182+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:50:27.836402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T06:55:08.965227+0000","last_change":"2023-10-09T06:55:05.930677+0000","last_active":"2023-10-09T06:55:08.965227+0000","last_peered":"2023-10-09T06:55:08.965227+0000","last_clean":"2023-10-09T06:55:08.965227+0000","last_became_active":"2023-10-09T06:55:05.930333+0000","last_became_peered":"2023-10-09T06:55:05.930333+0000","last_unstale":"2023-10-09T06:55:08.965227+0000","last_undegraded":"2023-10-09T06:55:08.965227+0000","last_fullsized":"2023-10-09T06:55:08.965227+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:12:42.258017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.948591+0000","last_change":"2023-10-09T06:55:06.944396+0000","last_active":"2023-10-09T06:55:06.948591+0000","last_peered":"2023-10-09T06:55:06.948591+0000","last_clean":"2023-10-09T06:55:06.948591+0000","last_became_active":"2023-10-09T06:55:06.944150+0000","last_became_peered":"2023-10-09T06:55:06.944150+0000","last_unstale":"2023-10-09T06:55:06.948591+0000","last_undegraded":"2023-10-09T06:55:06.948591+0000","last_fullsized":"2023-10-09T06:55:06.948591+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:01.783980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.931050+0000","last_change":"2023-10-09T06:55:05.938596+0000","last_active":"2023-10-09T06:55:06.931050+0000","last_peered":"2023-10-09T06:55:06.931050+0000","last_clean":"2023-10-09T06:55:06.931050+0000","last_became_active":"2023-10-09T06:55:05.938360+0000","last_became_peered":"2023-10-09T06:55:05.938360+0000","last_unstale":"2023-10-09T06:55:06.931050+0000","last_undegraded":"2023-10-09T06:55:06.931050+0000","last_fullsized":"2023-10-09T06:55:06.931050+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:48:20.803864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.953115+0000","last_change":"2023-10-09T06:55:06.942255+0000","last_active":"2023-10-09T06:55:06.953115+0000","last_peered":"2023-10-09T06:55:06.953115+0000","last_clean":"2023-10-09T06:55:06.953115+0000","last_became_active":"2023-10-09T06:55:06.941345+0000","last_became_peered":"2023-10-09T06:55:06.941345+0000","last_unstale":"2023-10-09T06:55:06.953115+0000","last_undegraded":"2023-10-09T06:55:06.953115+0000","last_fullsized":"2023-10-09T06:55:06.953115+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:16:26.620465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.929937+0000","last_change":"2023-10-09T06:55:05.935598+0000","last_active":"2023-10-09T06:55:06.929937+0000","last_peered":"2023-10-09T06:55:06.929937+0000","last_clean":"2023-10-09T06:55:06.929937+0000","last_became_active":"2023-10-09T06:55:05.935350+0000","last_became_peered":"2023-10-09T06:55:05.935350+0000","last_unstale":"2023-10-09T06:55:06.929937+0000","last_undegraded":"2023-10-09T06:55:06.929937+0000","last_fullsized":"2023-10-09T06:55:06.929937+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:25.646016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.941254+0000","last_change":"2023-10-09T06:55:06.935866+0000","last_active":"2023-10-09T06:55:06.941254+0000","last_peered":"2023-10-09T06:55:06.941254+0000","last_clean":"2023-10-09T06:55:06.941254+0000","last_became_active":"2023-10-09T06:55:06.935633+0000","last_became_peered":"2023-10-09T06:55:06.935633+0000","last_unstale":"2023-10-09T06:55:06.941254+0000","last_undegraded":"2023-10-09T06:55:06.941254+0000","last_fullsized":"2023-10-09T06:55:06.941254+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:29:45.885127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.930431+0000","last_change":"2023-10-09T06:55:05.935761+0000","last_active":"2023-10-09T06:55:06.930431+0000","last_peered":"2023-10-09T06:55:06.930431+0000","last_clean":"2023-10-09T06:55:06.930431+0000","last_became_active":"2023-10-09T06:55:05.935464+0000","last_became_peered":"2023-10-09T06:55:05.935464+0000","last_unstale":"2023-10-09T06:55:06.930431+0000","last_undegraded":"2023-10-09T06:55:06.930431+0000","last_fullsized":"2023-10-09T06:55:06.930431+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:16.840270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.932428+0000","last_change":"2023-10-09T06:55:06.927262+0000","last_active":"2023-10-09T06:55:06.932428+0000","last_peered":"2023-10-09T06:55:06.932428+0000","last_clean":"2023-10-09T06:55:06.932428+0000","last_became_active":"2023-10-09T06:55:06.926992+0000","last_became_peered":"2023-10-09T06:55:06.926992+0000","last_unstale":"2023-10-09T06:55:06.932428+0000","last_undegraded":"2023-10-09T06:55:06.932428+0000","last_fullsized":"2023-10-09T06:55:06.932428+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:12.040675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.924148+0000","last_change":"2023-10-09T06:55:05.931207+0000","last_active":"2023-10-09T06:55:06.924148+0000","last_peered":"2023-10-09T06:55:06.924148+0000","last_clean":"2023-10-09T06:55:06.924148+0000","last_became_active":"2023-10-09T06:55:05.930948+0000","last_became_peered":"2023-10-09T06:55:05.930948+0000","last_unstale":"2023-10-09T06:55:06.924148+0000","last_undegraded":"2023-10-09T06:55:06.924148+0000","last_fullsized":"2023-10-09T06:55:06.924148+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:19.802470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.940773+0000","last_change":"2023-10-09T06:55:06.936312+0000","last_active":"2023-10-09T06:55:06.940773+0000","last_peered":"2023-10-09T06:55:06.940773+0000","last_clean":"2023-10-09T06:55:06.940773+0000","last_became_active":"2023-10-09T06:55:06.936032+0000","last_became_peered":"2023-10-09T06:55:06.936032+0000","last_unstale":"2023-10-09T06:55:06.940773+0000","last_undegraded":"2023-10-09T06:55:06.940773+0000","last_fullsized":"2023-10-09T06:55:06.940773+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:52.410099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.930275+0000","last_change":"2023-10-09T06:55:05.936971+0000","last_active":"2023-10-09T06:55:06.930275+0000","last_peered":"2023-10-09T06:55:06.930275+0000","last_clean":"2023-10-09T06:55:06.930275+0000","last_became_active":"2023-10-09T06:55:05.936678+0000","last_became_peered":"2023-10-09T06:55:05.936678+0000","last_unstale":"2023-10-09T06:55:06.930275+0000","last_undegraded":"2023-10-09T06:55:06.930275+0000","last_fullsized":"2023-10-09T06:55:06.930275+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:18.853661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.951285+0000","last_change":"2023-10-09T06:55:06.944842+0000","last_active":"2023-10-09T06:55:06.951285+0000","last_peered":"2023-10-09T06:55:06.951285+0000","last_clean":"2023-10-09T06:55:06.951285+0000","last_became_active":"2023-10-09T06:55:06.944016+0000","last_became_peered":"2023-10-09T06:55:06.944016+0000","last_unstale":"2023-10-09T06:55:06.951285+0000","last_undegraded":"2023-10-09T06:55:06.951285+0000","last_fullsized":"2023-10-09T06:55:06.951285+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:04:30.082972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.923395+0000","last_change":"2023-10-09T06:55:05.938714+0000","last_active":"2023-10-09T06:55:06.923395+0000","last_peered":"2023-10-09T06:55:06.923395+0000","last_clean":"2023-10-09T06:55:06.923395+0000","last_became_active":"2023-10-09T06:55:05.936627+0000","last_became_peered":"2023-10-09T06:55:05.936627+0000","last_unstale":"2023-10-09T06:55:06.923395+0000","last_undegraded":"2023-10-09T06:55:06.923395+0000","last_fullsized":"2023-10-09T06:55:06.923395+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:16.840270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.943755+0000","last_change":"2023-10-09T06:55:06.941611+0000","last_active":"2023-10-09T06:55:06.943755+0000","last_peered":"2023-10-09T06:55:06.943755+0000","last_clean":"2023-10-09T06:55:06.943755+0000","last_became_active":"2023-10-09T06:55:06.941376+0000","last_became_peered":"2023-10-09T06:55:06.941376+0000","last_unstale":"2023-10-09T06:55:06.943755+0000","last_undegraded":"2023-10-09T06:55:06.943755+0000","last_fullsized":"2023-10-09T06:55:06.943755+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:05.907539+0000","last_clean_scrub_stamp":"2023-10-09T06:55:05.907539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:28.056882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.952233+0000","last_change":"2023-10-09T06:55:05.933117+0000","last_active":"2023-10-09T06:55:06.952233+0000","last_peered":"2023-10-09T06:55:06.952233+0000","last_clean":"2023-10-09T06:55:06.952233+0000","last_became_active":"2023-10-09T06:55:05.932796+0000","last_became_peered":"2023-10-09T06:55:05.932796+0000","last_unstale":"2023-10-09T06:55:06.952233+0000","last_undegraded":"2023-10-09T06:55:06.952233+0000","last_fullsized":"2023-10-09T06:55:06.952233+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:55:04.900841+0000","last_clean_scrub_stamp":"2023-10-09T06:55:04.900841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:10:56.880829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"52'139","reported_seq":278,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T06:55:06.929711+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:55:06.929711+0000","last_peered":"2023-10-09T06:55:06.929711+0000","last_clean":"2023-10-09T06:55:06.929711+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:55:06.929711+0000","last_undegraded":"2023-10-09T06:55:06.929711+0000","last_fullsized":"2023-10-09T06:55:06.929711+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575004,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":936574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71899999999999997,"15min":0.71699999999999997},"min":{"1min":0.36299999999999999,"5min":0.316,"15min":0.316},"max":{"1min":1.732,"5min":1.732,"15min":1.9490000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73199999999999998,"15min":0.75},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.29999999999999999},"max":{"1min":0.94399999999999995,"5min":1.0169999999999999,"15min":3.448},"last":0.77400000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72199999999999998,"15min":0.77500000000000002},"min":{"1min":0.437,"5min":0.379,"15min":0.379},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":5.617},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.753},"min":{"1min":0.45800000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":2.016},"last":0.65600000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.74099999999999999,"15min":0.752},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44800000000000001},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":2.052},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76900000000000002,"15min":0.79200000000000004},"min":{"1min":0.48299999999999998,"5min":0.45200000000000001,"15min":0.44700000000000001},"max":{"1min":2.6629999999999998,"5min":2.6629999999999998,"15min":3.5019999999999998},"last":0.83299999999999996}]},{"osd":3,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71799999999999997,"15min":0.79300000000000004},"min":{"1min":0.498,"5min":0.45600000000000002,"15min":0.45000000000000001},"max":{"1min":0.85199999999999998,"5min":1.0409999999999999,"15min":5.5800000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.84999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.47099999999999997},"max":{"1min":1.827,"5min":1.827,"15min":6.9299999999999997},"last":0.79500000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.60099999999999998,"15min":0.64800000000000002},"min":{"1min":0.47299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89900000000000002,"5min":0.90400000000000003,"15min":3.125},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.64900000000000002,"15min":0.71399999999999997},"min":{"1min":0.42199999999999999,"5min":0.41999999999999998,"15min":0.40500000000000003},"max":{"1min":2.577,"5min":2.577,"15min":4.8380000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.67300000000000004,"15min":0.72899999999999998},"min":{"1min":0.438,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":4.1929999999999996},"last":0.755},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.71199999999999997,"15min":0.76700000000000002},"min":{"1min":0.52900000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.9590000000000001,"5min":2.9590000000000001,"15min":3.6749999999999998},"last":0.67900000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.753,"15min":0.81799999999999995},"min":{"1min":0.58099999999999996,"5min":0.53300000000000003,"15min":0.49199999999999999},"max":{"1min":3.0019999999999998,"5min":3.0019999999999998,"15min":4.0250000000000004},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.73199999999999998,"15min":0.83199999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.44700000000000001},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":7.0259999999999998},"last":0.85899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575003,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302112,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069728,"statfs":{"total":96636764160,"available":96327401472,"internally_reserved":0,"allocated":745472,"data_stored":346760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.71799999999999997,"15min":0.70599999999999996},"min":{"1min":0.48099999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81999999999999995,"5min":0.97899999999999998,"15min":1.022},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.72099999999999997,"15min":0.69299999999999995},"min":{"1min":0.47499999999999998,"5min":0.41999999999999998,"15min":0.36599999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.079},"last":0.80600000000000005}]},{"osd":1,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.73099999999999998,"15min":0.71599999999999997},"min":{"1min":0.45500000000000002,"5min":0.44800000000000001,"15min":0.42799999999999999},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.72299999999999998,"15min":0.71799999999999997},"min":{"1min":0.501,"5min":0.48299999999999998,"15min":0.438},"max":{"1min":0.84999999999999998,"5min":1.0109999999999999,"15min":1.034},"last":0.98699999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.42599999999999999},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.45200000000000001},"max":{"1min":0.79200000000000004,"5min":0.96699999999999997,"15min":1.0900000000000001},"last":0.91000000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.71299999999999997,"15min":0.69199999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.89800000000000002,"5min":0.91700000000000004,"15min":1.046},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77000000000000002,"15min":0.753},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.497},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.76800000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63,"15min":0.63700000000000001},"min":{"1min":0.41299999999999998,"5min":0.38,"15min":0.377},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.626},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.91900000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64600000000000002,"15min":0.65800000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68600000000000005,"15min":0.70199999999999996},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.42299999999999999},"max":{"1min":0.84099999999999997,"5min":1.012,"15min":1.0669999999999999},"last":0.94699999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68200000000000005,"15min":0.68600000000000005},"min":{"1min":0.47299999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.874},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.72499999999999998,"15min":0.73199999999999998},"min":{"1min":0.44600000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.88400000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575004,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":346186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46000000000000002,"15min":0.45600000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56999999999999995,"5min":0.90300000000000002,"15min":1.2729999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48799999999999999,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.311,"15min":0.23699999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.91200000000000003},"last":0.39200000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.498,"15min":0.48599999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.29599999999999999},"max":{"1min":0.64900000000000002,"5min":0.67800000000000005,"15min":0.91900000000000004},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57799999999999996,"15min":0.56699999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77900000000000003,"5min":0.83999999999999997,"15min":1.3340000000000001},"last":0.44800000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.622,"15min":0.59899999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.34100000000000003},"max":{"1min":0.73699999999999999,"5min":0.89500000000000002,"15min":1.365},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.34100000000000003},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.48199999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.78400000000000003,"15min":0.77200000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.995,"5min":1.0529999999999999,"15min":1.234},"last":0.72299999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79200000000000004,"15min":0.77200000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0309999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.78600000000000003,"15min":0.77600000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.47999999999999998},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.70699999999999996}]},{"osd":6,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.80500000000000005,"15min":0.79000000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.3029999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.80400000000000005,"15min":0.79200000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0980000000000001,"5min":1.222,"15min":1.222},"last":0.82699999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.83599999999999997,"15min":0.82599999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.53500000000000003},"max":{"1min":1.129,"5min":1.129,"15min":1.4510000000000001},"last":0.872},{"interface":"front","average":{"1min":0.753,"5min":0.82999999999999996,"15min":0.81899999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.115,"5min":1.179,"15min":1.1970000000000001},"last":0.84099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575003,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":1335296,"data_stored":936518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47499999999999998,"15min":0.47099999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.23000000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":1.2729999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.56699999999999995,"15min":0.53300000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.28899999999999998},"max":{"1min":4.5819999999999999,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":0.40899999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.58799999999999997,"15min":0.55600000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":4.6980000000000004,"5min":4.6980000000000004,"15min":4.6980000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.51500000000000001,"15min":0.48999999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.443}]},{"osd":3,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.7130000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.63500000000000001,"15min":0.61799999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":4.734,"5min":4.734,"15min":4.734},"last":0.54000000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.78300000000000003,"15min":0.77500000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.103,"5min":1.218,"15min":1.752},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.82399999999999995,"15min":0.80800000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":4.6619999999999999,"5min":4.6619999999999999,"15min":4.6619999999999999},"last":0.70999999999999996}]},{"osd":5,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.2769999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.80100000000000005,"15min":0.80700000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0840000000000001,"5min":1.2809999999999999,"15min":1.7889999999999999},"last":0.76400000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.83399999999999996,"15min":0.82599999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.50900000000000001},"max":{"1min":4.6239999999999997,"5min":4.6239999999999997,"15min":4.6239999999999997},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.80600000000000005,"15min":0.81200000000000006},"min":{"1min":0.50800000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.228,"5min":1.2689999999999999,"15min":1.4370000000000001},"last":0.72899999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:54:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.83499999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.256,"5min":1.256,"15min":1.518},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.85599999999999998,"15min":0.85999999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.702,"5min":1.702,"15min":1.8200000000000001},"last":0.85699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575003,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306216,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065624,"statfs":{"total":96636764160,"available":96323198976,"internally_reserved":0,"allocated":753664,"data_stored":347674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.46000000000000002,"15min":0.45800000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.25900000000000001},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.498,"15min":0.499},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.484},"last":0.58199999999999996}]},{"osd":1,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.47899999999999998,"15min":0.496},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.623,"5min":0.80700000000000005,"15min":1.865},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.50800000000000001,"15min":0.52600000000000002},"min":{"1min":0.36199999999999999,"5min":0.33700000000000002,"15min":0.32200000000000001},"max":{"1min":0.66500000000000004,"5min":0.747,"15min":1.79},"last":0.35299999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.41699999999999998,"5min":0.38600000000000001,"15min":0.35799999999999998},"max":{"1min":0.84499999999999997,"5min":0.87,"15min":1.8999999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.38500000000000001},"max":{"1min":0.84799999999999998,"5min":0.85199999999999998,"15min":1.8220000000000001},"last":0.47099999999999997}]},{"osd":4,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.77900000000000003,"15min":0.754},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.42899999999999999},"max":{"1min":1.1799999999999999,"5min":1.256,"15min":1.256},"last":0.752},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.77800000000000002,"15min":0.77400000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.44800000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.71599999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78800000000000003,"15min":0.76900000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.79100000000000004,"15min":0.77300000000000002},"min":{"1min":0.58299999999999996,"5min":0.57199999999999995,"15min":0.503},"max":{"1min":0.98799999999999999,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.69099999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.79900000000000004,"15min":0.78800000000000003},"min":{"1min":0.55100000000000005,"5min":0.54900000000000004,"15min":0.48599999999999999},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.81200000000000006,"15min":0.79800000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.5309999999999999},"last":0.78100000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.82399999999999995,"15min":0.80800000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.84399999999999997,"15min":0.82399999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.50900000000000001},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.80300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575004,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302116,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069724,"statfs":{"total":96636764160,"available":96327397376,"internally_reserved":0,"allocated":749568,"data_stored":346726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47599999999999998,"15min":0.45900000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.24099999999999999},"max":{"1min":0.81200000000000006,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50900000000000001,"15min":0.47799999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.28100000000000003},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.35399999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.499,"15min":0.47899999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.55700000000000005,"15min":0.53400000000000003},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.67800000000000005,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.56000000000000005}]},{"osd":2,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59599999999999997,"15min":0.57099999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.38500000000000001},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.64600000000000002,"15min":0.61899999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":3.8900000000000001,"5min":3.8900000000000001,"15min":3.8900000000000001},"last":0.61699999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76100000000000001,"15min":0.74299999999999999},"min":{"1min":0.48299999999999998,"5min":0.47199999999999998,"15min":0.40799999999999997},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.83999999999999997,"15min":0.81599999999999995},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.52200000000000002},"max":{"1min":1.081,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.71799999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.76900000000000002,"15min":0.749},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96999999999999997,"5min":1.091,"15min":2.1549999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.81599999999999995,"15min":0.79600000000000004},"min":{"1min":0.58199999999999996,"5min":0.56499999999999995,"15min":0.50600000000000001},"max":{"1min":0.97299999999999998,"5min":1.0800000000000001,"15min":1.419},"last":0.66500000000000004}]},{"osd":6,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.79700000000000004,"15min":0.77500000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.51700000000000002},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.81200000000000006,"15min":0.77500000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.51500000000000001},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.60099999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:54:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.84799999999999998,"15min":0.82499999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.55500000000000005},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":2.0880000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.84699999999999998,"15min":0.82699999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.56499999999999995},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.747}]}]},{"osd":4,"up_from":13,"seq":55834575003,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306212,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065628,"statfs":{"total":96636764160,"available":96323203072,"internally_reserved":0,"allocated":749568,"data_stored":347652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73699999999999999,"15min":0.69499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35499999999999998},"max":{"1min":3.1139999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.439},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.73599999999999999,"15min":0.70899999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.39300000000000002},"max":{"1min":2.8130000000000002,"5min":2.8130000000000002,"15min":3.23},"last":0.59499999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73199999999999998,"15min":0.70099999999999996},"min":{"1min":0.46999999999999997,"5min":0.45800000000000002,"15min":0.373},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.78200000000000003,"15min":0.74199999999999999},"min":{"1min":0.46300000000000002,"5min":0.45100000000000001,"15min":0.40500000000000003},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.64500000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78100000000000003,"15min":0.754},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.38100000000000001},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":3.7509999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.80100000000000005,"15min":0.77900000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":0.621}]},{"osd":3,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76400000000000001,"15min":0.751},"min":{"1min":0.51000000000000001,"5min":0.434,"15min":0.434},"max":{"1min":2.6440000000000001,"5min":2.6440000000000001,"15min":3.6970000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.78900000000000003,"15min":0.73799999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.6899999999999999,"5min":3.6899999999999999,"15min":3.6899999999999999},"last":0.66400000000000003}]},{"osd":5,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":3.3860000000000001,"5min":3.3860000000000001,"15min":3.4780000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.68799999999999994,"15min":0.68000000000000005},"min":{"1min":0.39100000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.745}]},{"osd":6,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.67000000000000004,"15min":0.66700000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":3.5270000000000001,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.374},"max":{"1min":3.4740000000000002,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.69699999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.7210000000000001,"5min":2.7210000000000001,"15min":3.2789999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":3.7280000000000002,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.68899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575004,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":346186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.69299999999999995,"15min":0.70199999999999996},"min":{"1min":0.39800000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.91600000000000004,"15min":1.655},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.68500000000000005,"15min":0.68999999999999995},"min":{"1min":0.34499999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79800000000000004,"5min":0.99099999999999999,"15min":1.1359999999999999},"last":0.53000000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.66800000000000004,"15min":0.71599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79500000000000004,"5min":1.034,"15min":2.4159999999999999},"last":0.623},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.71199999999999997,"15min":0.73099999999999998},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81699999999999995,"5min":1.0229999999999999,"15min":1.706},"last":0.59799999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.72099999999999997,"15min":0.74299999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.42999999999999999},"max":{"1min":0.79900000000000004,"5min":0.97499999999999998,"15min":1.79},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.69599999999999995,"15min":0.73399999999999999},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.442},"max":{"1min":0.80300000000000005,"5min":1.004,"15min":2.4889999999999999},"last":0.56999999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.69699999999999995,"15min":0.72699999999999998},"min":{"1min":0.503,"5min":0.435,"15min":0.435},"max":{"1min":0.84299999999999997,"5min":0.95499999999999996,"15min":1.409},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.75800000000000001,"15min":0.79400000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.88600000000000001,"5min":1.0629999999999999,"15min":2.532},"last":0.67700000000000005}]},{"osd":4,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59099999999999997,"15min":0.63600000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84799999999999998,"5min":0.91300000000000003,"15min":1.766},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.65500000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.35799999999999998},"max":{"1min":0.86199999999999999,"5min":0.98199999999999998,"15min":2.7829999999999999},"last":0.84099999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.628,"15min":0.67300000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.93000000000000005,"5min":0.97699999999999998,"15min":2.5739999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.67100000000000004,"15min":0.69899999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.38900000000000001},"max":{"1min":0.86899999999999999,"5min":0.95299999999999996,"15min":1.8080000000000001},"last":0.85899999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67800000000000005,"15min":0.72499999999999998},"min":{"1min":0.48599999999999999,"5min":0.45500000000000002,"15min":0.436},"max":{"1min":0.91500000000000004,"5min":0.94499999999999995,"15min":2.9609999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75,"15min":0.80400000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.45900000000000002},"max":{"1min":0.96699999999999997,"5min":0.998,"15min":2.613},"last":0.77200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:55:16.589 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T06:55:16.589 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T06:55:16.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.808+0000 7fc1e359e700 1 Processor -- start 2023-10-09T06:55:16.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.809+0000 7fc1e359e700 1 -- start start 2023-10-09T06:55:16.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.810+0000 7fc1e359e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc1e41563b0 0x7fc1e40ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:16.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.810+0000 7fc1e359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e4156780 0x7fc1e40cad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:16.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.810+0000 7fc1e359e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e40cbe50 con 0x7fc1e40ae2b0 2023-10-09T06:55:16.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.810+0000 7fc1e359e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e40cb370 con 0x7fc1e41563b0 2023-10-09T06:55:16.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.810+0000 7fc1e359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e40cb650 con 0x7fc1e4156780 2023-10-09T06:55:16.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.810+0000 7fc1e259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc1e41563b0 0x7fc1e40ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:16.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.810+0000 7fc1e259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc1e41563b0 0x7fc1e40ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56576/0 (socket says 172.21.15.71:56576) 2023-10-09T06:55:16.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.810+0000 7fc1e259c700 1 -- 172.21.15.71:0/676117866 learned_addr learned my addr 172.21.15.71:0/676117866 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:16.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.810+0000 7fc1e1d9b700 1 --2- 172.21.15.71:0/676117866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e4156780 0x7fc1e40cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:16.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.810+0000 7fc1e259c700 1 -- 172.21.15.71:0/676117866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e4156780 msgr2=0x7fc1e40cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:16.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.810+0000 7fc1e259c700 1 --2- 172.21.15.71:0/676117866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e4156780 0x7fc1e40cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:16.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.811+0000 7fc1e259c700 1 -- 172.21.15.71:0/676117866 >> v1:172.21.15.179:6789/0 conn(0x7fc1e40ae2b0 legacy=0x7fc1e406e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:16.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.811+0000 7fc1e259c700 1 -- 172.21.15.71:0/676117866 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e40c6860 con 0x7fc1e41563b0 2023-10-09T06:55:16.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.811+0000 7fc1e259c700 1 --2- 172.21.15.71:0/676117866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1e41563b0 0x7fc1e40ca7d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40099b0 tx=0x7fc1d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f400b496e4a9383 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:16.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.811+0000 7fc1e159a700 1 -- 172.21.15.71:0/676117866 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d400b860 con 0x7fc1e41563b0 2023-10-09T06:55:16.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.811+0000 7fc1e159a700 1 -- 172.21.15.71:0/676117866 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d400b9c0 con 0x7fc1e41563b0 2023-10-09T06:55:16.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.811+0000 7fc1e159a700 1 -- 172.21.15.71:0/676117866 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d400bd60 con 0x7fc1e41563b0 2023-10-09T06:55:16.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.812+0000 7fc1e359e700 1 -- 172.21.15.71:0/676117866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1e41563b0 msgr2=0x7fc1e40ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:16.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.812+0000 7fc1e359e700 1 --2- 172.21.15.71:0/676117866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1e41563b0 0x7fc1e40ca7d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40099b0 tx=0x7fc1d4009250 comp rx=0 tx=0).stop 2023-10-09T06:55:16.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.812+0000 7fc1e359e700 1 -- 172.21.15.71:0/676117866 shutdown_connections 2023-10-09T06:55:16.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.812+0000 7fc1e359e700 1 --2- 172.21.15.71:0/676117866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1e41563b0 0x7fc1e40ca7d0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:16.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.812+0000 7fc1e359e700 1 --2- 172.21.15.71:0/676117866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e4156780 0x7fc1e40cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:16.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.812+0000 7fc1e359e700 1 -- 172.21.15.71:0/676117866 >> 172.21.15.71:0/676117866 conn(0x7fc1e4068e20 msgr2=0x7fc1e40cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:16.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.812+0000 7fc1e359e700 1 -- 172.21.15.71:0/676117866 shutdown_connections 2023-10-09T06:55:16.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.812+0000 7fc1e359e700 1 -- 172.21.15.71:0/676117866 wait complete. 2023-10-09T06:55:16.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.813+0000 7fc1e359e700 1 Processor -- start 2023-10-09T06:55:16.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.813+0000 7fc1e359e700 1 -- start start 2023-10-09T06:55:16.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.814+0000 7fc1e359e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1e40ae2b0 0x7fc1e40c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:16.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.814+0000 7fc1e359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e41563b0 0x7fc1e414ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:16.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.814+0000 7fc1e359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e4156780 0x7fc1e415b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:16.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.814+0000 7fc1e359e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e40c5f60 con 0x7fc1e40ae2b0 2023-10-09T06:55:16.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.814+0000 7fc1e359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e40c5c80 con 0x7fc1e4156780 2023-10-09T06:55:16.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.814+0000 7fc1e359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e41537e0 con 0x7fc1e41563b0 2023-10-09T06:55:16.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.814+0000 7fc1e259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1e40ae2b0 0x7fc1e40c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:16.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.814+0000 7fc1e259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1e40ae2b0 0x7fc1e40c5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56580/0 (socket says 172.21.15.71:56580) 2023-10-09T06:55:16.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.814+0000 7fc1e259c700 1 -- 172.21.15.71:0/2630974516 learned_addr learned my addr 172.21.15.71:0/2630974516 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:16.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.815+0000 7fc1e2d9d700 1 --2- 172.21.15.71:0/2630974516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e4156780 0x7fc1e415b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:16.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.815+0000 7fc1e1d9b700 1 --2- 172.21.15.71:0/2630974516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e41563b0 0x7fc1e414ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:16.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.815+0000 7fc1e259c700 1 -- 172.21.15.71:0/2630974516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e41563b0 msgr2=0x7fc1e414ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:16.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.815+0000 7fc1e259c700 1 --2- 172.21.15.71:0/2630974516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e41563b0 0x7fc1e414ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:16.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.815+0000 7fc1e259c700 1 -- 172.21.15.71:0/2630974516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e4156780 msgr2=0x7fc1e415b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:16.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.815+0000 7fc1e259c700 1 --2- 172.21.15.71:0/2630974516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e4156780 0x7fc1e415b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:16.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.815+0000 7fc1e259c700 1 -- 172.21.15.71:0/2630974516 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d40094f0 con 0x7fc1e40ae2b0 2023-10-09T06:55:16.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.815+0000 7fc1e2d9d700 1 --2- 172.21.15.71:0/2630974516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e4156780 0x7fc1e415b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:55:16.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.815+0000 7fc1e259c700 1 --2- 172.21.15.71:0/2630974516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1e40ae2b0 0x7fc1e40c5430 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4064f90 tx=0x7fc1d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:16.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.815+0000 7fc1d27fc700 1 -- 172.21.15.71:0/2630974516 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d401a420 con 0x7fc1e40ae2b0 2023-10-09T06:55:16.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.815+0000 7fc1d27fc700 1 -- 172.21.15.71:0/2630974516 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d401a5a0 con 0x7fc1e40ae2b0 2023-10-09T06:55:16.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.815+0000 7fc1d27fc700 1 -- 172.21.15.71:0/2630974516 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d401a960 con 0x7fc1e40ae2b0 2023-10-09T06:55:16.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.815+0000 7fc1e359e700 1 -- 172.21.15.71:0/2630974516 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e4153ac0 con 0x7fc1e40ae2b0 2023-10-09T06:55:16.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.816+0000 7fc1e359e700 1 -- 172.21.15.71:0/2630974516 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e40c5970 con 0x7fc1e40ae2b0 2023-10-09T06:55:16.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.816+0000 7fc1e359e700 1 -- 172.21.15.71:0/2630974516 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e404c3c0 con 0x7fc1e40ae2b0 2023-10-09T06:55:16.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.817+0000 7fc1d27fc700 1 -- 172.21.15.71:0/2630974516 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc1d401ad10 con 0x7fc1e40ae2b0 2023-10-09T06:55:16.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.819+0000 7fc1d27fc700 1 --2- 172.21.15.71:0/2630974516 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc1c4066f30 0x7fc1c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:16.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.819+0000 7fc1d27fc700 1 -- 172.21.15.71:0/2630974516 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fc1d4086180 con 0x7fc1e40ae2b0 2023-10-09T06:55:16.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.820+0000 7fc1e1d9b700 1 --2- 172.21.15.71:0/2630974516 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc1c4066f30 0x7fc1c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:16.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.820+0000 7fc1e1d9b700 1 --2- 172.21.15.71:0/2630974516 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc1c4066f30 0x7fc1c40693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40c6310 tx=0x7fc1d8008040 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:16.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:16.823+0000 7fc1d27fc700 1 -- 172.21.15.71:0/2630974516 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1d40531e0 con 0x7fc1e40ae2b0 2023-10-09T06:55:17.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.090+0000 7fc1e359e700 1 -- 172.21.15.71:0/2630974516 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc1e40c6b40 con 0x7fc1e40ae2b0 2023-10-09T06:55:17.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.095+0000 7fc1d27fc700 1 -- 172.21.15.71:0/2630974516 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc1d4056800 con 0x7fc1e40ae2b0 2023-10-09T06:55:17.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.097+0000 7fc1e359e700 1 -- 172.21.15.71:0/2630974516 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc1c4066f30 msgr2=0x7fc1c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:17.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.097+0000 7fc1e359e700 1 --2- 172.21.15.71:0/2630974516 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc1c4066f30 0x7fc1c40693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40c6310 tx=0x7fc1d8008040 comp rx=0 tx=0).stop 2023-10-09T06:55:17.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.097+0000 7fc1e359e700 1 -- 172.21.15.71:0/2630974516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1e40ae2b0 msgr2=0x7fc1e40c5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:17.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.097+0000 7fc1e359e700 1 --2- 172.21.15.71:0/2630974516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1e40ae2b0 0x7fc1e40c5430 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4064f90 tx=0x7fc1d4017000 comp rx=0 tx=0).stop 2023-10-09T06:55:17.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.097+0000 7fc1e359e700 1 -- 172.21.15.71:0/2630974516 shutdown_connections 2023-10-09T06:55:17.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.097+0000 7fc1e359e700 1 --2- 172.21.15.71:0/2630974516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e4156780 0x7fc1e415b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:17.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.097+0000 7fc1e359e700 1 --2- 172.21.15.71:0/2630974516 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc1c4066f30 0x7fc1c40693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:17.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.097+0000 7fc1e359e700 1 --2- 172.21.15.71:0/2630974516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1e40ae2b0 0x7fc1e40c5430 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:17.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.097+0000 7fc1e359e700 1 --2- 172.21.15.71:0/2630974516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e41563b0 0x7fc1e414ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:17.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.097+0000 7fc1e359e700 1 -- 172.21.15.71:0/2630974516 >> 172.21.15.71:0/2630974516 conn(0x7fc1e4068e20 msgr2=0x7fc1e40ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:17.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.097+0000 7fc1e359e700 1 -- 172.21.15.71:0/2630974516 shutdown_connections 2023-10-09T06:55:17.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.097+0000 7fc1e359e700 1 -- 172.21.15.71:0/2630974516 wait complete. 2023-10-09T06:55:17.099 INFO:teuthology.orchestra.run.smithi071.stderr:updated caps for client.0 2023-10-09T06:55:17.116 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:55:17.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.298+0000 7f3fe7dff700 1 Processor -- start 2023-10-09T06:55:17.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.298+0000 7f3fe7dff700 1 -- start start 2023-10-09T06:55:17.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.300+0000 7f3fe7dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3fe00cbb30 0x7f3fe0069ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:17.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.300+0000 7f3fe7dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe0069ff0 0x7f3fe00af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:17.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.300+0000 7f3fe7dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe00acdb0 con 0x7f3fe00cb760 2023-10-09T06:55:17.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.300+0000 7f3fe7dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe00c8a10 con 0x7f3fe00cbb30 2023-10-09T06:55:17.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.300+0000 7f3fe7dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe006a430 con 0x7f3fe0069ff0 2023-10-09T06:55:17.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.300+0000 7f3fe539a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3fe00cbb30 0x7f3fe0069ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:17.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.300+0000 7f3fe539a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3fe00cbb30 0x7f3fe0069ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56594/0 (socket says 172.21.15.71:56594) 2023-10-09T06:55:17.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.300+0000 7f3fe539a700 1 -- 172.21.15.71:0/1117445796 learned_addr learned my addr 172.21.15.71:0/1117445796 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:17.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.300+0000 7f3fe5b9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3fe00cb760 0x7f3fe00c8300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60406/0 (socket says 172.21.15.71:60406) 2023-10-09T06:55:17.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.300+0000 7f3fe539a700 1 -- 172.21.15.71:0/1117445796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe0069ff0 msgr2=0x7f3fe00af0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:17.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.300+0000 7f3fe539a700 1 --2- 172.21.15.71:0/1117445796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe0069ff0 0x7f3fe00af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:17.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.300+0000 7f3fe539a700 1 -- 172.21.15.71:0/1117445796 >> v1:172.21.15.71:6789/0 conn(0x7f3fe00cb760 legacy=0x7f3fe00c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:17.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.300+0000 7f3fe539a700 1 -- 172.21.15.71:0/1117445796 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe00ad000 con 0x7f3fe00cbb30 2023-10-09T06:55:17.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.301+0000 7f3fe539a700 1 --2- 172.21.15.71:0/1117445796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe00cbb30 0x7f3fe0069ab0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00099b0 tx=0x7f3fd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a4bf5d778ce7f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:17.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.301+0000 7f3fe4b99700 1 -- 172.21.15.71:0/1117445796 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd000b760 con 0x7f3fe00cbb30 2023-10-09T06:55:17.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.301+0000 7f3fe4b99700 1 -- 172.21.15.71:0/1117445796 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd000b8c0 con 0x7f3fe00cbb30 2023-10-09T06:55:17.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.301+0000 7f3fe4b99700 1 -- 172.21.15.71:0/1117445796 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd000bc80 con 0x7f3fe00cbb30 2023-10-09T06:55:17.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.301+0000 7f3fe7dff700 1 -- 172.21.15.71:0/1117445796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe00cbb30 msgr2=0x7f3fe0069ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:17.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.301+0000 7f3fe7dff700 1 --2- 172.21.15.71:0/1117445796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe00cbb30 0x7f3fe0069ab0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00099b0 tx=0x7f3fd0009250 comp rx=0 tx=0).stop 2023-10-09T06:55:17.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.301+0000 7f3fe7dff700 1 -- 172.21.15.71:0/1117445796 shutdown_connections 2023-10-09T06:55:17.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.301+0000 7f3fe7dff700 1 --2- 172.21.15.71:0/1117445796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe0069ff0 0x7f3fe00af0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:17.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.301+0000 7f3fe7dff700 1 --2- 172.21.15.71:0/1117445796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe00cbb30 0x7f3fe0069ab0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:17.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.301+0000 7f3fe7dff700 1 -- 172.21.15.71:0/1117445796 >> 172.21.15.71:0/1117445796 conn(0x7f3fe006d5a0 msgr2=0x7f3fe0068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:17.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.302+0000 7f3fe7dff700 1 -- 172.21.15.71:0/1117445796 shutdown_connections 2023-10-09T06:55:17.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.302+0000 7f3fe7dff700 1 -- 172.21.15.71:0/1117445796 wait complete. 2023-10-09T06:55:17.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.303+0000 7f3fe7dff700 1 Processor -- start 2023-10-09T06:55:17.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.303+0000 7f3fe7dff700 1 -- start start 2023-10-09T06:55:17.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.304+0000 7f3fe7dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe0069ff0 0x7f3fe014b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:17.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.304+0000 7f3fe7dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fe00cb760 0x7f3fe006dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:17.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.304+0000 7f3fe7dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe00cbb30 0x7f3fe006e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:17.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.304+0000 7f3fe7dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe015c1e0 con 0x7f3fe0069ff0 2023-10-09T06:55:17.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.304+0000 7f3fe7dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe016dd80 con 0x7f3fe00cb760 2023-10-09T06:55:17.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.304+0000 7f3fe7dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe015bb90 con 0x7f3fe00cbb30 2023-10-09T06:55:17.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.304+0000 7f3fe5b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe0069ff0 0x7f3fe014b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:17.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.304+0000 7f3fe5b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe0069ff0 0x7f3fe014b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56606/0 (socket says 172.21.15.71:56606) 2023-10-09T06:55:17.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.304+0000 7f3fe5b9b700 1 -- 172.21.15.71:0/1979158452 learned_addr learned my addr 172.21.15.71:0/1979158452 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:17.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.304+0000 7f3fe5b9b700 1 -- 172.21.15.71:0/1979158452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe00cbb30 msgr2=0x7f3fe006e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:17.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.304+0000 7f3fe5b9b700 1 --2- 172.21.15.71:0/1979158452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe00cbb30 0x7f3fe006e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:17.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.304+0000 7f3fe5b9b700 1 -- 172.21.15.71:0/1979158452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fe00cb760 msgr2=0x7f3fe006dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:17.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.304+0000 7f3fe5b9b700 1 --2- 172.21.15.71:0/1979158452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fe00cb760 0x7f3fe006dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:17.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.304+0000 7f3fe5b9b700 1 -- 172.21.15.71:0/1979158452 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd00094f0 con 0x7f3fe0069ff0 2023-10-09T06:55:17.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.305+0000 7f3fe5b9b700 1 --2- 172.21.15.71:0/1979158452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe0069ff0 0x7f3fe014b5d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00c810 tx=0x7f3fdc007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:17.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.305+0000 7f3fd5ffb700 1 -- 172.21.15.71:0/1979158452 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc007300 con 0x7f3fe0069ff0 2023-10-09T06:55:17.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.305+0000 7f3fd5ffb700 1 -- 172.21.15.71:0/1979158452 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc007480 con 0x7f3fe0069ff0 2023-10-09T06:55:17.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.305+0000 7f3fd5ffb700 1 -- 172.21.15.71:0/1979158452 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc004830 con 0x7f3fe0069ff0 2023-10-09T06:55:17.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.305+0000 7f3fe7dff700 1 -- 172.21.15.71:0/1979158452 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe015be70 con 0x7f3fe0069ff0 2023-10-09T06:55:17.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.305+0000 7f3fe7dff700 1 -- 172.21.15.71:0/1979158452 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe016d090 con 0x7f3fe0069ff0 2023-10-09T06:55:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.306+0000 7f3fe7dff700 1 -- 172.21.15.71:0/1979158452 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe015c000 con 0x7f3fe0069ff0 2023-10-09T06:55:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.307+0000 7f3fd5ffb700 1 -- 172.21.15.71:0/1979158452 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3fdc004ba0 con 0x7f3fe0069ff0 2023-10-09T06:55:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.308+0000 7f3fd5ffb700 1 --2- 172.21.15.71:0/1979158452 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3fc4066f30 0x7f3fc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.308+0000 7f3fd5ffb700 1 -- 172.21.15.71:0/1979158452 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f3fdc0839f0 con 0x7f3fe0069ff0 2023-10-09T06:55:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.308+0000 7f3fe539a700 1 --2- 172.21.15.71:0/1979158452 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3fc4066f30 0x7f3fc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:17.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.309+0000 7f3fe539a700 1 --2- 172.21.15.71:0/1979158452 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3fc4066f30 0x7f3fc40693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00099b0 tx=0x7f3fd0016000 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:17.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.312+0000 7f3fd5ffb700 1 -- 172.21.15.71:0/1979158452 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fdc050ad0 con 0x7f3fe0069ff0 2023-10-09T06:55:17.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.545+0000 7f3fe7dff700 1 -- 172.21.15.71:0/1979158452 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3fe015b9f0 con 0x7f3fe0069ff0 2023-10-09T06:55:17.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.545+0000 7f3fd5ffb700 1 -- 172.21.15.71:0/1979158452 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f3fe015b9f0 con 0x7f3fe0069ff0 2023-10-09T06:55:17.547 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:55:17.547 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5153,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3904949177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3904949177},{"type":"v1","addr":"172.21.15.179:6837","nonce":3904949177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5617,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2761847814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2761847814},{"type":"v1","addr":"172.21.15.71:6833","nonce":2761847814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5632,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3251743580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3251743580},{"type":"v1","addr":"172.21.15.179:6836","nonce":3251743580}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:55:06.387910+0000","modified":"2023-10-09T06:55:09.941744+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5727},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5727":{"gid":5727,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/4151615916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":4151615916},{"type":"v1","addr":"172.21.15.71:6835","nonce":4151615916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T06:55:17.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.547+0000 7f3fe7dff700 1 -- 172.21.15.71:0/1979158452 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3fc4066f30 msgr2=0x7f3fc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:17.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.547+0000 7f3fe7dff700 1 --2- 172.21.15.71:0/1979158452 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3fc4066f30 0x7f3fc40693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00099b0 tx=0x7f3fd0016000 comp rx=0 tx=0).stop 2023-10-09T06:55:17.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.547+0000 7f3fe7dff700 1 -- 172.21.15.71:0/1979158452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe0069ff0 msgr2=0x7f3fe014b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:17.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.547+0000 7f3fe7dff700 1 --2- 172.21.15.71:0/1979158452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe0069ff0 0x7f3fe014b5d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00c810 tx=0x7f3fdc007f30 comp rx=0 tx=0).stop 2023-10-09T06:55:17.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.548+0000 7f3fe7dff700 1 -- 172.21.15.71:0/1979158452 shutdown_connections 2023-10-09T06:55:17.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.548+0000 7f3fe7dff700 1 --2- 172.21.15.71:0/1979158452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe00cbb30 0x7f3fe006e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:17.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.548+0000 7f3fe7dff700 1 --2- 172.21.15.71:0/1979158452 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3fc4066f30 0x7f3fc40693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:17.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.548+0000 7f3fe7dff700 1 --2- 172.21.15.71:0/1979158452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe0069ff0 0x7f3fe014b5d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:17.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.548+0000 7f3fe7dff700 1 --2- 172.21.15.71:0/1979158452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fe00cb760 0x7f3fe006dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:17.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.548+0000 7f3fe7dff700 1 -- 172.21.15.71:0/1979158452 >> 172.21.15.71:0/1979158452 conn(0x7f3fe006d5a0 msgr2=0x7f3fe01594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:17.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.548+0000 7f3fe7dff700 1 -- 172.21.15.71:0/1979158452 shutdown_connections 2023-10-09T06:55:17.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:17.548+0000 7f3fe7dff700 1 -- 172.21.15.71:0/1979158452 wait complete. 2023-10-09T06:55:17.552 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 24 2023-10-09T06:55:17.969 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T06:55:06.387910+0000', 'modified': '2023-10-09T06:55:09.941744+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5727}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5727': {'gid': 5727, 'name': 'c', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.71:6835/4151615916', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6834', 'nonce': 4151615916}, {'type': 'v1', 'addr': '172.21.15.71:6835', 'nonce': 4151615916}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T06:55:17.969 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T06:55:17.969 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-09T06:55:18.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.152+0000 7f36e3fff700 1 Processor -- start 2023-10-09T06:55:18.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.152+0000 7f36e3fff700 1 -- start start 2023-10-09T06:55:18.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.154+0000 7f36e3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36e4150180 0x7f36e4157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.154+0000 7f36e3fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f36e40c7410 0x7f36e4069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.154+0000 7f36e3fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e406e2a0 con 0x7f36e4150550 2023-10-09T06:55:18.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.154+0000 7f36e3fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e406b2e0 con 0x7f36e40c7410 2023-10-09T06:55:18.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.154+0000 7f36e3fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e40c78e0 con 0x7f36e4150180 2023-10-09T06:55:18.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.154+0000 7f36e37fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f36e40c7410 0x7f36e4069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:18.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.154+0000 7f36e37fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f36e40c7410 0x7f36e4069f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56610/0 (socket says 172.21.15.71:56610) 2023-10-09T06:55:18.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.154+0000 7f36e27fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f36e4150550 0x7f36e40c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60414/0 (socket says 172.21.15.71:60414) 2023-10-09T06:55:18.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.154+0000 7f36e37fe700 1 -- 172.21.15.71:0/2958684374 learned_addr learned my addr 172.21.15.71:0/2958684374 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:18.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.154+0000 7f36e2ffd700 1 --2- 172.21.15.71:0/2958684374 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36e4150180 0x7f36e4157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:18.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.154+0000 7f36e37fe700 1 -- 172.21.15.71:0/2958684374 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36e4150180 msgr2=0x7f36e4157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:18.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.154+0000 7f36e37fe700 1 --2- 172.21.15.71:0/2958684374 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36e4150180 0x7f36e4157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.154+0000 7f36e37fe700 1 -- 172.21.15.71:0/2958684374 >> v1:172.21.15.71:6789/0 conn(0x7f36e4150550 legacy=0x7f36e40c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:18.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.154+0000 7f36e37fe700 1 -- 172.21.15.71:0/2958684374 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e40c7bc0 con 0x7f36e40c7410 2023-10-09T06:55:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.155+0000 7f36e2ffd700 1 --2- 172.21.15.71:0/2958684374 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36e4150180 0x7f36e4157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:55:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.154+0000 7f36e1ffb700 1 -- 172.21.15.71:0/2958684374 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433397768 0 0) 0x7f36e406e2a0 con 0x7f36e4150550 2023-10-09T06:55:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.155+0000 7f36e37fe700 1 --2- 172.21.15.71:0/2958684374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36e40c7410 0x7f36e4069f50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f36dc009f20 tx=0x7f36dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff01c6ba9f38fac4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.155+0000 7f36e1ffb700 1 -- 172.21.15.71:0/2958684374 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc00e070 con 0x7f36e40c7410 2023-10-09T06:55:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.155+0000 7f36e1ffb700 1 -- 172.21.15.71:0/2958684374 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36dc00ba80 con 0x7f36e40c7410 2023-10-09T06:55:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.155+0000 7f36e1ffb700 1 -- 172.21.15.71:0/2958684374 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc0092e0 con 0x7f36e40c7410 2023-10-09T06:55:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.155+0000 7f36e3fff700 1 -- 172.21.15.71:0/2958684374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36e40c7410 msgr2=0x7f36e4069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.155+0000 7f36e3fff700 1 --2- 172.21.15.71:0/2958684374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36e40c7410 0x7f36e4069f50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f36dc009f20 tx=0x7f36dc009840 comp rx=0 tx=0).stop 2023-10-09T06:55:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.156+0000 7f36e3fff700 1 -- 172.21.15.71:0/2958684374 shutdown_connections 2023-10-09T06:55:18.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.156+0000 7f36e3fff700 1 --2- 172.21.15.71:0/2958684374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36e40c7410 0x7f36e4069f50 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.156+0000 7f36e3fff700 1 --2- 172.21.15.71:0/2958684374 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36e4150180 0x7f36e4157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.156+0000 7f36e3fff700 1 -- 172.21.15.71:0/2958684374 >> 172.21.15.71:0/2958684374 conn(0x7f36e40cc1f0 msgr2=0x7f36e40cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:18.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.156+0000 7f36e3fff700 1 -- 172.21.15.71:0/2958684374 shutdown_connections 2023-10-09T06:55:18.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.156+0000 7f36e3fff700 1 -- 172.21.15.71:0/2958684374 wait complete. 2023-10-09T06:55:18.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.157+0000 7f36e3fff700 1 Processor -- start 2023-10-09T06:55:18.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.157+0000 7f36e3fff700 1 -- start start 2023-10-09T06:55:18.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.158+0000 7f36e3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36e40c7410 0x7f36e40c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.158+0000 7f36e3fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36e4150180 0x7f36e40c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.158+0000 7f36e3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36e4150550 0x7f36e40c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.158+0000 7f36e3fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e40af130 con 0x7f36e40c7410 2023-10-09T06:55:18.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.158+0000 7f36e3fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e40ca680 con 0x7f36e4150180 2023-10-09T06:55:18.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.158+0000 7f36e3fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e40c9b60 con 0x7f36e4150550 2023-10-09T06:55:18.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.158+0000 7f36e2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36e40c7410 0x7f36e40c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:18.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.158+0000 7f36e2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36e40c7410 0x7f36e40c6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56616/0 (socket says 172.21.15.71:56616) 2023-10-09T06:55:18.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.158+0000 7f36e2ffd700 1 -- 172.21.15.71:0/3007428311 learned_addr learned my addr 172.21.15.71:0/3007428311 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:18.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.159+0000 7f36e37fe700 1 --2- 172.21.15.71:0/3007428311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36e4150550 0x7f36e40c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:18.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.159+0000 7f36e27fc700 1 --2- 172.21.15.71:0/3007428311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36e4150180 0x7f36e40c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:18.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.159+0000 7f36e2ffd700 1 -- 172.21.15.71:0/3007428311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36e4150550 msgr2=0x7f36e40c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:18.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.159+0000 7f36e2ffd700 1 --2- 172.21.15.71:0/3007428311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36e4150550 0x7f36e40c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.159+0000 7f36e2ffd700 1 -- 172.21.15.71:0/3007428311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36e4150180 msgr2=0x7f36e40c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:18.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.159+0000 7f36e2ffd700 1 --2- 172.21.15.71:0/3007428311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36e4150180 0x7f36e40c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.159+0000 7f36e2ffd700 1 -- 172.21.15.71:0/3007428311 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36dc009ae0 con 0x7f36e40c7410 2023-10-09T06:55:18.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.159+0000 7f36e37fe700 1 --2- 172.21.15.71:0/3007428311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36e4150550 0x7f36e40c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:55:18.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.159+0000 7f36e27fc700 1 --2- 172.21.15.71:0/3007428311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36e4150180 0x7f36e40c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:55:18.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.159+0000 7f36e2ffd700 1 --2- 172.21.15.71:0/3007428311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36e40c7410 0x7f36e40c6370 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f36d400ac40 tx=0x7f36d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:18.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.159+0000 7f36caffd700 1 -- 172.21.15.71:0/3007428311 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d4012070 con 0x7f36e40c7410 2023-10-09T06:55:18.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.159+0000 7f36caffd700 1 -- 172.21.15.71:0/3007428311 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d400f930 con 0x7f36e40c7410 2023-10-09T06:55:18.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.159+0000 7f36e3fff700 1 -- 172.21.15.71:0/3007428311 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e40c9de0 con 0x7f36e40c7410 2023-10-09T06:55:18.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.159+0000 7f36caffd700 1 -- 172.21.15.71:0/3007428311 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d400fcd0 con 0x7f36e40c7410 2023-10-09T06:55:18.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.159+0000 7f36e3fff700 1 -- 172.21.15.71:0/3007428311 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e40ca3a0 con 0x7f36e40c7410 2023-10-09T06:55:18.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.161+0000 7f36caffd700 1 -- 172.21.15.71:0/3007428311 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f36d4016430 con 0x7f36e40c7410 2023-10-09T06:55:18.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.162+0000 7f36caffd700 1 --2- 172.21.15.71:0/3007428311 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f36d0066f30 0x7f36d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.162+0000 7f36caffd700 1 -- 172.21.15.71:0/3007428311 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f36d4085e80 con 0x7f36e40c7410 2023-10-09T06:55:18.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.163+0000 7f36e27fc700 1 --2- 172.21.15.71:0/3007428311 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f36d0066f30 0x7f36d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:18.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.163+0000 7f36e27fc700 1 --2- 172.21.15.71:0/3007428311 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f36d0066f30 0x7f36d00693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f36e40cbc60 tx=0x7f36d8009040 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:18.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.164+0000 7f36f8168b80 1 Processor -- start 2023-10-09T06:55:18.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.164+0000 7f36f8168b80 1 -- start start 2023-10-09T06:55:18.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.165+0000 7f36f8168b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fc45480 0x55d58fc247d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.165+0000 7f36f8168b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d58fbf85f0 0x55d58fc45850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.165+0000 7f36f8168b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58fbfab80 0x55d58fbfaff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.165+0000 7f36f8168b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d58fb51a70 con 0x55d58fc45480 2023-10-09T06:55:18.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.165+0000 7f36f8168b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d58fb4f270 con 0x55d58fbfab80 2023-10-09T06:55:18.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.165+0000 7f36f8168b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d58fb4b060 con 0x55d58fbf85f0 2023-10-09T06:55:18.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.165+0000 7f36e2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fc45480 0x55d58fc247d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:18.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.165+0000 7f36e2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fc45480 0x55d58fc247d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56628/0 (socket says 172.21.15.71:56628) 2023-10-09T06:55:18.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.165+0000 7f36e2ffd700 1 -- 172.21.15.71:0/25104962 learned_addr learned my addr 172.21.15.71:0/25104962 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:18.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.165+0000 7f36e27fc700 1 --2- 172.21.15.71:0/25104962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d58fbf85f0 0x55d58fc45850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:18.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.165+0000 7f36e37fe700 1 --2- 172.21.15.71:0/25104962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58fbfab80 0x55d58fbfaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:18.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.166+0000 7f36e2ffd700 1 -- 172.21.15.71:0/25104962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d58fbf85f0 msgr2=0x55d58fc45850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:18.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.166+0000 7f36e2ffd700 1 --2- 172.21.15.71:0/25104962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d58fbf85f0 0x55d58fc45850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.166+0000 7f36e2ffd700 1 -- 172.21.15.71:0/25104962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58fbfab80 msgr2=0x55d58fbfaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:18.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.166+0000 7f36e2ffd700 1 --2- 172.21.15.71:0/25104962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58fbfab80 0x55d58fbfaff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.166+0000 7f36e2ffd700 1 -- 172.21.15.71:0/25104962 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d58f9e5270 con 0x55d58fc45480 2023-10-09T06:55:18.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.166+0000 7f36e27fc700 1 --2- 172.21.15.71:0/25104962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d58fbf85f0 0x55d58fc45850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:55:18.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.166+0000 7f36e37fe700 1 --2- 172.21.15.71:0/25104962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58fbfab80 0x55d58fbfaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:55:18.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.166+0000 7f36e2ffd700 1 --2- 172.21.15.71:0/25104962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fc45480 0x55d58fc247d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f36d4084230 tx=0x7f36d4084190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae672c393599108 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:18.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.166+0000 7f36c3fff700 1 -- 172.21.15.71:0/25104962 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d4059e90 con 0x55d58fc45480 2023-10-09T06:55:18.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.166+0000 7f36c3fff700 1 -- 172.21.15.71:0/25104962 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d405dbe0 con 0x55d58fc45480 2023-10-09T06:55:18.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.166+0000 7f36c3fff700 1 -- 172.21.15.71:0/25104962 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d4054fe0 con 0x55d58fc45480 2023-10-09T06:55:18.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.167+0000 7f36f8168b80 1 -- 172.21.15.71:0/25104962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fc45480 msgr2=0x55d58fc247d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:18.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.167+0000 7f36f8168b80 1 --2- 172.21.15.71:0/25104962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fc45480 0x55d58fc247d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f36d4084230 tx=0x7f36d4084190 comp rx=0 tx=0).stop 2023-10-09T06:55:18.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.167+0000 7f36f8168b80 1 -- 172.21.15.71:0/25104962 shutdown_connections 2023-10-09T06:55:18.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.167+0000 7f36f8168b80 1 --2- 172.21.15.71:0/25104962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58fbfab80 0x55d58fbfaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.167+0000 7f36f8168b80 1 --2- 172.21.15.71:0/25104962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fc45480 0x55d58fc247d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.167+0000 7f36f8168b80 1 --2- 172.21.15.71:0/25104962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d58fbf85f0 0x55d58fc45850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.167+0000 7f36f8168b80 1 -- 172.21.15.71:0/25104962 >> 172.21.15.71:0/25104962 conn(0x55d58fbfc0c0 msgr2=0x55d58fbfc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:18.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.167+0000 7f36f8168b80 1 -- 172.21.15.71:0/25104962 shutdown_connections 2023-10-09T06:55:18.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.167+0000 7f36f8168b80 1 -- 172.21.15.71:0/25104962 wait complete. 2023-10-09T06:55:18.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.167+0000 7f36f8168b80 1 -- start start 2023-10-09T06:55:18.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.168+0000 7f36f8168b80 1 Processor -- start 2023-10-09T06:55:18.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.169+0000 7f36f8168b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fbf85f0 0x55d58fc55e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.169+0000 7f36f8168b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d58fbfab80 0x55d58fbf1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.169+0000 7f36f8168b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58fc45480 0x55d58fbf1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.169+0000 7f36f8168b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d58faf6890 con 0x55d58fbf85f0 2023-10-09T06:55:18.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.169+0000 7f36f8168b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d58fb11ea0 con 0x55d58fc45480 2023-10-09T06:55:18.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.169+0000 7f36f8168b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d58f9cde30 con 0x55d58fbfab80 2023-10-09T06:55:18.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.169+0000 7f36f8168b80 10 client.0 _ll_register_callbacks cb 0x55d58fbbe2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:55:18.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.169+0000 7f36e2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fbf85f0 0x55d58fc55e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:18.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.169+0000 7f36e2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fbf85f0 0x55d58fc55e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56644/0 (socket says 172.21.15.71:56644) 2023-10-09T06:55:18.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.169+0000 7f36e2ffd700 1 -- 172.21.15.71:0/2459080841 learned_addr learned my addr 172.21.15.71:0/2459080841 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:18.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.169+0000 7f36e2ffd700 1 -- 172.21.15.71:0/2459080841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d58fbfab80 msgr2=0x55d58fbf1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:18.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.169+0000 7f36e2ffd700 1 --2- 172.21.15.71:0/2459080841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d58fbfab80 0x55d58fbf1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.169+0000 7f36e2ffd700 1 -- 172.21.15.71:0/2459080841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58fc45480 msgr2=0x55d58fbf1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:18.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.169+0000 7f36e2ffd700 1 --2- 172.21.15.71:0/2459080841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58fc45480 0x55d58fbf1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.169+0000 7f36e2ffd700 1 -- 172.21.15.71:0/2459080841 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e40ca3a0 con 0x55d58fbf85f0 2023-10-09T06:55:18.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.169+0000 7f36e2ffd700 1 --2- 172.21.15.71:0/2459080841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fbf85f0 0x55d58fc55e10 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f36d4053140 tx=0x7f36d406b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94dafac615a23377 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:18.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.169+0000 7f36c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T06:55:18.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.170+0000 7f36c17fa700 1 -- 172.21.15.71:0/2459080841 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d4059e90 con 0x55d58fbf85f0 2023-10-09T06:55:18.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.170+0000 7f36c17fa700 1 -- 172.21.15.71:0/2459080841 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f36d4054d80 con 0x55d58fbf85f0 2023-10-09T06:55:18.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.170+0000 7f36f8168b80 1 -- 172.21.15.71:0/2459080841 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d58fbefcd0 con 0x55d58fbf85f0 2023-10-09T06:55:18.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.170+0000 7f36c17fa700 1 -- 172.21.15.71:0/2459080841 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36d405abd0 con 0x55d58fbf85f0 2023-10-09T06:55:18.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.170+0000 7f36f8168b80 10 client.5901 fetch_fsmap learned FSMap version 24 2023-10-09T06:55:18.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.170+0000 7f36f8168b80 1 -- 172.21.15.71:0/2459080841 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55d58f987fe0 con 0x55d58fbf85f0 2023-10-09T06:55:18.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.170+0000 7f36c17fa700 1 -- 172.21.15.71:0/2459080841 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d58fbefcd0 con 0x55d58fbf85f0 2023-10-09T06:55:18.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.170+0000 7f36c17fa700 1 -- 172.21.15.71:0/2459080841 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f36d405d750 con 0x55d58fbf85f0 2023-10-09T06:55:18.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.170+0000 7f36f8168b80 10 client.5901 fetch_fsmap finished waiting for FSMap version 24 2023-10-09T06:55:18.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.170+0000 7f36f8168b80 10 client.5901 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T06:55:18.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.170+0000 7f36f8168b80 20 client.5901 populate_metadata read hostname 'smithi071' 2023-10-09T06:55:18.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.170+0000 7f36f8168b80 1 --2- 172.21.15.71:0/2459080841 >> [v2:172.21.15.71:6834/4151615916,v1:172.21.15.71:6835/4151615916] conn(0x55d58fc41980 0x55d58fc236f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.170+0000 7f36f8168b80 4 client.5901 mds_command: new command op to 5727 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T06:55:18.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.170+0000 7f36f8168b80 1 -- 172.21.15.71:0/2459080841 --> [v2:172.21.15.71:6834/4151615916,v1:172.21.15.71:6835/4151615916] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d58fbccaa0 con 0x55d58fc41980 2023-10-09T06:55:18.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.170+0000 7f36e27fc700 1 --2- 172.21.15.71:0/2459080841 >> [v2:172.21.15.71:6834/4151615916,v1:172.21.15.71:6835/4151615916] conn(0x55d58fc41980 0x55d58fc236f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:18.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.171+0000 7f36c17fa700 10 client.5901 ms_handle_connect on v2:172.21.15.71:6834/4151615916 2023-10-09T06:55:18.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.171+0000 7f36e27fc700 1 --2- 172.21.15.71:0/2459080841 >> [v2:172.21.15.71:6834/4151615916,v1:172.21.15.71:6835/4151615916] conn(0x55d58fc41980 0x55d58fc236f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94b2a2c4e4f04004 server_cookie=922fb8cd2d5eb3c0 in_seq=0 out_seq=0 2023-10-09T06:55:18.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.172+0000 7f36c17fa700 1 -- 172.21.15.71:0/2459080841 <== mds.0 v2:172.21.15.71:6834/4151615916 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55d58fbccaa0 con 0x55d58fc41980 2023-10-09T06:55:18.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.172+0000 7f36c17fa700 10 client.5901 handle_command_reply: tid=0 2023-10-09T06:55:18.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.172+0000 7f36f8168b80 1 client.5901 shutdown 2023-10-09T06:55:18.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.172+0000 7f36f8168b80 1 -- 172.21.15.71:0/2459080841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fbf85f0 msgr2=0x55d58fc55e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:18.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.172+0000 7f36f8168b80 1 --2- 172.21.15.71:0/2459080841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fbf85f0 0x55d58fc55e10 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f36d4053140 tx=0x7f36d406b000 comp rx=0 tx=0).stop 2023-10-09T06:55:18.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.172+0000 7f36f8168b80 1 -- 172.21.15.71:0/2459080841 shutdown_connections 2023-10-09T06:55:18.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.172+0000 7f36f8168b80 1 --2- 172.21.15.71:0/2459080841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58fc45480 0x55d58fbf1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.172+0000 7f36f8168b80 1 --2- 172.21.15.71:0/2459080841 >> [v2:172.21.15.71:6834/4151615916,v1:172.21.15.71:6835/4151615916] conn(0x55d58fc41980 0x55d58fc236f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.172+0000 7f36f8168b80 1 --2- 172.21.15.71:0/2459080841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fbf85f0 0x55d58fc55e10 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.172+0000 7f36f8168b80 1 --2- 172.21.15.71:0/2459080841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d58fbfab80 0x55d58fbf1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.172+0000 7f36c17fa700 0 client.5901 ms_handle_reset on v2:172.21.15.71:6834/4151615916 2023-10-09T06:55:18.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.172+0000 7f36f8168b80 1 -- 172.21.15.71:0/2459080841 >> 172.21.15.71:0/2459080841 conn(0x55d58fbfc0c0 msgr2=0x55d58fbfe530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:18.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.173+0000 7f36f8168b80 1 -- 172.21.15.71:0/2459080841 shutdown_connections 2023-10-09T06:55:18.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.173+0000 7f36f8168b80 1 -- 172.21.15.71:0/2459080841 wait complete. 2023-10-09T06:55:18.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.173+0000 7f36f8168b80 20 client.5901 trim_cache size 0 max 16384 2023-10-09T06:55:18.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.190+0000 7f36f8168b80 1 Processor -- start 2023-10-09T06:55:18.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.190+0000 7f36f8168b80 1 -- start start 2023-10-09T06:55:18.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.190+0000 7f36f8168b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d58fbf85f0 0x55d58fc41250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.190+0000 7f36f8168b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58fbfab80 0x55d58fc23b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.190+0000 7f36f8168b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fc45480 0x55d58fbf7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.191+0000 7f36f8168b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d58fc24410 con 0x55d58fc45480 2023-10-09T06:55:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.191+0000 7f36f8168b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d58fc22a70 con 0x55d58fbfab80 2023-10-09T06:55:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.191+0000 7f36f8168b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d58fc44c00 con 0x55d58fbf85f0 2023-10-09T06:55:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.191+0000 7f36e37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fc45480 0x55d58fbf7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.191+0000 7f36e37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fc45480 0x55d58fbf7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56656/0 (socket says 172.21.15.71:56656) 2023-10-09T06:55:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.191+0000 7f36e37fe700 1 -- 172.21.15.71:0/1789623626 learned_addr learned my addr 172.21.15.71:0/1789623626 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:18.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.191+0000 7f36e37fe700 1 -- 172.21.15.71:0/1789623626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d58fbf85f0 msgr2=0x55d58fc41250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:18.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.191+0000 7f36e37fe700 1 --2- 172.21.15.71:0/1789623626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d58fbf85f0 0x55d58fc41250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.191+0000 7f36e37fe700 1 -- 172.21.15.71:0/1789623626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58fbfab80 msgr2=0x55d58fc23b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:18.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.191+0000 7f36e37fe700 1 --2- 172.21.15.71:0/1789623626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58fbfab80 0x55d58fc23b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.191+0000 7f36e37fe700 1 -- 172.21.15.71:0/1789623626 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d58fc245a0 con 0x55d58fc45480 2023-10-09T06:55:18.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.191+0000 7f36e37fe700 1 --2- 172.21.15.71:0/1789623626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fc45480 0x55d58fbf7a70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f36e406fe40 tx=0x7f36dc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760ff61bcb8f3971 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:18.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.192+0000 7f36c8ff9700 1 -- 172.21.15.71:0/1789623626 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc0032f0 con 0x55d58fc45480 2023-10-09T06:55:18.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.192+0000 7f36c8ff9700 1 -- 172.21.15.71:0/1789623626 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36dc00bbf0 con 0x55d58fc45480 2023-10-09T06:55:18.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.192+0000 7f36c8ff9700 1 -- 172.21.15.71:0/1789623626 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc007610 con 0x55d58fc45480 2023-10-09T06:55:18.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.192+0000 7f36f8168b80 1 -- 172.21.15.71:0/1789623626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fc45480 msgr2=0x55d58fbf7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:18.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.192+0000 7f36f8168b80 1 --2- 172.21.15.71:0/1789623626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fc45480 0x55d58fbf7a70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f36e406fe40 tx=0x7f36dc018000 comp rx=0 tx=0).stop 2023-10-09T06:55:18.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.192+0000 7f36f8168b80 1 -- 172.21.15.71:0/1789623626 shutdown_connections 2023-10-09T06:55:18.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.192+0000 7f36f8168b80 1 --2- 172.21.15.71:0/1789623626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fc45480 0x55d58fbf7a70 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.192+0000 7f36f8168b80 1 --2- 172.21.15.71:0/1789623626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d58fbf85f0 0x55d58fc41250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.192+0000 7f36f8168b80 1 --2- 172.21.15.71:0/1789623626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58fbfab80 0x55d58fc23b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.192+0000 7f36f8168b80 1 -- 172.21.15.71:0/1789623626 >> 172.21.15.71:0/1789623626 conn(0x55d58fbfc0c0 msgr2=0x55d58fbf7070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:18.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.192+0000 7f36f8168b80 1 -- 172.21.15.71:0/1789623626 shutdown_connections 2023-10-09T06:55:18.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.192+0000 7f36f8168b80 1 -- 172.21.15.71:0/1789623626 wait complete. 2023-10-09T06:55:18.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.193+0000 7f36f8168b80 1 -- start start 2023-10-09T06:55:18.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.193+0000 7f36f8168b80 1 Processor -- start 2023-10-09T06:55:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.194+0000 7f36f8168b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58fbf85f0 0x55d58fcaad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.194+0000 7f36f8168b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fbfab80 0x55d58fc5aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.194+0000 7f36f8168b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d58fc45480 0x55d58fbf7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.194+0000 7f36f8168b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d58fbfd500 con 0x55d58fbfab80 2023-10-09T06:55:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.194+0000 7f36f8168b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d58fc25360 con 0x55d58fbf85f0 2023-10-09T06:55:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.194+0000 7f36f8168b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d58fc5df10 con 0x55d58fc45480 2023-10-09T06:55:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.194+0000 7f36f8168b80 10 client.0 _ll_register_callbacks cb 0x55d58fbbe2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:55:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.194+0000 7f36e27fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fbfab80 0x55d58fc5aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.194+0000 7f36e27fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fbfab80 0x55d58fc5aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56670/0 (socket says 172.21.15.71:56670) 2023-10-09T06:55:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.194+0000 7f36e27fc700 1 -- 172.21.15.71:0/1666379282 learned_addr learned my addr 172.21.15.71:0/1666379282 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.195+0000 7f36e27fc700 1 -- 172.21.15.71:0/1666379282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d58fc45480 msgr2=0x55d58fbf7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.195+0000 7f36e27fc700 1 --2- 172.21.15.71:0/1666379282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d58fc45480 0x55d58fbf7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.195+0000 7f36e27fc700 1 -- 172.21.15.71:0/1666379282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58fbf85f0 msgr2=0x55d58fcaad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.195+0000 7f36e27fc700 1 --2- 172.21.15.71:0/1666379282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58fbf85f0 0x55d58fcaad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.195+0000 7f36e27fc700 1 -- 172.21.15.71:0/1666379282 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e40c7bc0 con 0x55d58fbfab80 2023-10-09T06:55:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.195+0000 7f36e27fc700 1 --2- 172.21.15.71:0/1666379282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fbfab80 0x55d58fc5aa80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x55d58fbf9d50 tx=0x7f36d8014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96ff3c1441bfa5f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.195+0000 7f36c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T06:55:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.195+0000 7f36c17fa700 1 -- 172.21.15.71:0/1666379282 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d8026030 con 0x55d58fbfab80 2023-10-09T06:55:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.195+0000 7f36c17fa700 1 -- 172.21.15.71:0/1666379282 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f36d8027070 con 0x55d58fbfab80 2023-10-09T06:55:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.195+0000 7f36f8168b80 1 -- 172.21.15.71:0/1666379282 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f36e40c24c0 con 0x55d58fbfab80 2023-10-09T06:55:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.195+0000 7f36c17fa700 1 -- 172.21.15.71:0/1666379282 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36d800dab0 con 0x55d58fbfab80 2023-10-09T06:55:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.195+0000 7f36f8168b80 10 client.5907 fetch_fsmap learned FSMap version 24 2023-10-09T06:55:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.195+0000 7f36f8168b80 1 -- 172.21.15.71:0/1666379282 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55d58fb19780 con 0x55d58fbfab80 2023-10-09T06:55:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.196+0000 7f36c17fa700 1 -- 172.21.15.71:0/1666379282 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d8031020 con 0x55d58fbfab80 2023-10-09T06:55:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.196+0000 7f36c17fa700 1 -- 172.21.15.71:0/1666379282 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f36d800dc10 con 0x55d58fbfab80 2023-10-09T06:55:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.196+0000 7f36f8168b80 10 client.5907 fetch_fsmap finished waiting for FSMap version 24 2023-10-09T06:55:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.196+0000 7f36f8168b80 10 client.5907 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T06:55:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.196+0000 7f36f8168b80 20 client.5907 populate_metadata read hostname 'smithi071' 2023-10-09T06:55:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.196+0000 7f36f8168b80 1 --2- 172.21.15.71:0/1666379282 >> [v2:172.21.15.71:6834/4151615916,v1:172.21.15.71:6835/4151615916] conn(0x55d58fc55aa0 0x55d58fc5cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.196+0000 7f36f8168b80 4 client.5907 mds_command: new command op to 5727 tid=0[{"prefix": "status"}] 2023-10-09T06:55:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.196+0000 7f36f8168b80 1 -- 172.21.15.71:0/1666379282 --> [v2:172.21.15.71:6834/4151615916,v1:172.21.15.71:6835/4151615916] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f36d405dbe0 con 0x55d58fc55aa0 2023-10-09T06:55:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.196+0000 7f36e2ffd700 1 --2- 172.21.15.71:0/1666379282 >> [v2:172.21.15.71:6834/4151615916,v1:172.21.15.71:6835/4151615916] conn(0x55d58fc55aa0 0x55d58fc5cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.196+0000 7f36c17fa700 10 client.5907 ms_handle_connect on v2:172.21.15.71:6834/4151615916 2023-10-09T06:55:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.196+0000 7f36e2ffd700 1 --2- 172.21.15.71:0/1666379282 >> [v2:172.21.15.71:6834/4151615916,v1:172.21.15.71:6835/4151615916] conn(0x55d58fc55aa0 0x55d58fc5cbd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54a24cf8044e8519 server_cookie=3620cefa6f66bebb in_seq=0 out_seq=0 2023-10-09T06:55:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.197+0000 7f36c17fa700 1 -- 172.21.15.71:0/1666379282 <== mds.0 v2:172.21.15.71:6834/4151615916 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7f36d405dbe0 con 0x55d58fc55aa0 2023-10-09T06:55:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.197+0000 7f36c17fa700 10 client.5907 handle_command_reply: tid=0 2023-10-09T06:55:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.197+0000 7f36f8168b80 1 client.5907 shutdown 2023-10-09T06:55:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.197+0000 7f36f8168b80 1 -- 172.21.15.71:0/1666379282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fbfab80 msgr2=0x55d58fc5aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.197+0000 7f36f8168b80 1 --2- 172.21.15.71:0/1666379282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fbfab80 0x55d58fc5aa80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x55d58fbf9d50 tx=0x7f36d8014040 comp rx=0 tx=0).stop 2023-10-09T06:55:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.197+0000 7f36f8168b80 1 -- 172.21.15.71:0/1666379282 shutdown_connections 2023-10-09T06:55:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.197+0000 7f36f8168b80 1 --2- 172.21.15.71:0/1666379282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d58fc45480 0x55d58fbf7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.197+0000 7f36f8168b80 1 --2- 172.21.15.71:0/1666379282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58fbf85f0 0x55d58fcaad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.197+0000 7f36f8168b80 1 --2- 172.21.15.71:0/1666379282 >> [v2:172.21.15.71:6834/4151615916,v1:172.21.15.71:6835/4151615916] conn(0x55d58fc55aa0 0x55d58fc5cbd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.197+0000 7f36f8168b80 1 --2- 172.21.15.71:0/1666379282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d58fbfab80 0x55d58fc5aa80 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.197+0000 7f36c17fa700 0 client.5907 ms_handle_reset on v2:172.21.15.71:6834/4151615916 2023-10-09T06:55:18.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.197+0000 7f36f8168b80 1 -- 172.21.15.71:0/1666379282 >> 172.21.15.71:0/1666379282 conn(0x55d58fbfc0c0 msgr2=0x55d58fc27ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:18.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.197+0000 7f36f8168b80 1 -- 172.21.15.71:0/1666379282 shutdown_connections 2023-10-09T06:55:18.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.197+0000 7f36f8168b80 1 -- 172.21.15.71:0/1666379282 wait complete. 2023-10-09T06:55:18.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.197+0000 7f36f8168b80 20 client.5907 trim_cache size 0 max 16384 2023-10-09T06:55:18.203 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T06:55:18.203 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "604c5619-653a-4ab6-912c-ab2e5464fe4a", 2023-10-09T06:55:18.204 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2023-10-09T06:55:18.204 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 5727, 2023-10-09T06:55:18.204 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2023-10-09T06:55:18.204 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2023-10-09T06:55:18.204 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2023-10-09T06:55:18.204 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 11.281885472000001, 2023-10-09T06:55:18.204 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 24, 2023-10-09T06:55:18.204 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 62, 2023-10-09T06:55:18.204 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 62, 2023-10-09T06:55:18.204 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 17.066734497999999 2023-10-09T06:55:18.204 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T06:55:18.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.198+0000 7f36e3fff700 1 -- 172.21.15.71:0/3007428311 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f36d0066f30 msgr2=0x7f36d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:18.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.198+0000 7f36e3fff700 1 --2- 172.21.15.71:0/3007428311 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f36d0066f30 0x7f36d00693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f36e40cbc60 tx=0x7f36d8009040 comp rx=0 tx=0).stop 2023-10-09T06:55:18.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.198+0000 7f36e3fff700 1 -- 172.21.15.71:0/3007428311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36e40c7410 msgr2=0x7f36e40c6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:18.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.198+0000 7f36e3fff700 1 --2- 172.21.15.71:0/3007428311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36e40c7410 0x7f36e40c6370 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f36d400ac40 tx=0x7f36d4008040 comp rx=0 tx=0).stop 2023-10-09T06:55:18.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.198+0000 7f36e3fff700 1 -- 172.21.15.71:0/3007428311 shutdown_connections 2023-10-09T06:55:18.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.198+0000 7f36e3fff700 1 --2- 172.21.15.71:0/3007428311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36e4150550 0x7f36e40c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.198+0000 7f36e3fff700 1 --2- 172.21.15.71:0/3007428311 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f36d0066f30 0x7f36d00693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.198+0000 7f36e3fff700 1 --2- 172.21.15.71:0/3007428311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36e40c7410 0x7f36e40c6370 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.198+0000 7f36e3fff700 1 --2- 172.21.15.71:0/3007428311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36e4150180 0x7f36e40c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.198+0000 7f36e3fff700 1 -- 172.21.15.71:0/3007428311 >> 172.21.15.71:0/3007428311 conn(0x7f36e40cc1f0 msgr2=0x7f36e4158000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:18.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.198+0000 7f36e3fff700 1 -- 172.21.15.71:0/3007428311 shutdown_connections 2023-10-09T06:55:18.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.198+0000 7f36e3fff700 1 -- 172.21.15.71:0/3007428311 wait complete. 2023-10-09T06:55:18.215 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:55:18.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.394+0000 7fa70b7ff700 1 Processor -- start 2023-10-09T06:55:18.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.394+0000 7fa70b7ff700 1 -- start start 2023-10-09T06:55:18.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.395+0000 7fa70b7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7040cbf30 0x7fa7040ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.395+0000 7fa70b7ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa7040ccf90 0x7fa7040b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.395+0000 7fa70b7ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7040cc300 con 0x7fa70415a270 2023-10-09T06:55:18.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.395+0000 7fa70b7ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa704156bf0 con 0x7fa7040ccf90 2023-10-09T06:55:18.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.395+0000 7fa70b7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7040ae950 con 0x7fa7040cbf30 2023-10-09T06:55:18.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.396+0000 7fa708d9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa7040ccf90 0x7fa7040b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:18.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.396+0000 7fa709d9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa70415a270 0x7fa7040c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60424/0 (socket says 172.21.15.71:60424) 2023-10-09T06:55:18.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.396+0000 7fa709d9c700 1 -- 172.21.15.71:0/672072979 learned_addr learned my addr 172.21.15.71:0/672072979 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:55:18.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.396+0000 7fa70959b700 1 --2- 172.21.15.71:0/672072979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7040cbf30 0x7fa7040ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:18.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.396+0000 7fa6fbfff700 1 -- 172.21.15.71:0/672072979 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181161032 0 0) 0x7fa7040cc300 con 0x7fa70415a270 2023-10-09T06:55:18.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.396+0000 7fa6fbfff700 1 -- 172.21.15.71:0/672072979 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6f0003570 con 0x7fa70415a270 2023-10-09T06:55:18.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.396+0000 7fa708d9a700 1 -- 172.21.15.71:0/672072979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7040cbf30 msgr2=0x7fa7040ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:18.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.396+0000 7fa708d9a700 1 --2- 172.21.15.71:0/672072979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7040cbf30 0x7fa7040ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.396+0000 7fa708d9a700 1 -- 172.21.15.71:0/672072979 >> v1:172.21.15.71:6789/0 conn(0x7fa70415a270 legacy=0x7fa7040c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:18.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.396+0000 7fa708d9a700 1 -- 172.21.15.71:0/672072979 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7040ad370 con 0x7fa7040ccf90 2023-10-09T06:55:18.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.396+0000 7fa708d9a700 1 --2- 172.21.15.71:0/672072979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7040ccf90 0x7fa7040b0d10 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009910 tx=0x7fa6f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19cfab483aadf896 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:18.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.397+0000 7fa6fbfff700 1 -- 172.21.15.71:0/672072979 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4011630 con 0x7fa7040ccf90 2023-10-09T06:55:18.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.397+0000 7fa6fbfff700 1 -- 172.21.15.71:0/672072979 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f4011790 con 0x7fa7040ccf90 2023-10-09T06:55:18.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.397+0000 7fa6fbfff700 1 -- 172.21.15.71:0/672072979 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4011b30 con 0x7fa7040ccf90 2023-10-09T06:55:18.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.397+0000 7fa70b7ff700 1 -- 172.21.15.71:0/672072979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7040ccf90 msgr2=0x7fa7040b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:18.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.397+0000 7fa70b7ff700 1 --2- 172.21.15.71:0/672072979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7040ccf90 0x7fa7040b0d10 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009910 tx=0x7fa6f40091a0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.397+0000 7fa70b7ff700 1 -- 172.21.15.71:0/672072979 shutdown_connections 2023-10-09T06:55:18.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.397+0000 7fa70b7ff700 1 --2- 172.21.15.71:0/672072979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7040cbf30 0x7fa7040ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.397+0000 7fa70b7ff700 1 --2- 172.21.15.71:0/672072979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7040ccf90 0x7fa7040b0d10 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.397+0000 7fa70b7ff700 1 -- 172.21.15.71:0/672072979 >> 172.21.15.71:0/672072979 conn(0x7fa70406a320 msgr2=0x7fa7040cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:18.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.397+0000 7fa70b7ff700 1 -- 172.21.15.71:0/672072979 shutdown_connections 2023-10-09T06:55:18.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.397+0000 7fa70b7ff700 1 -- 172.21.15.71:0/672072979 wait complete. 2023-10-09T06:55:18.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.399+0000 7fa70b7ff700 1 Processor -- start 2023-10-09T06:55:18.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.399+0000 7fa70b7ff700 1 -- start start 2023-10-09T06:55:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.400+0000 7fa70b7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7040cbf30 0x7fa70416cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.400+0000 7fa70b7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7040ccf90 0x7fa704169e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.400+0000 7fa70b7ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa70415a270 0x7fa704159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.400+0000 7fa70b7ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70416ae00 con 0x7fa70415a270 2023-10-09T06:55:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.400+0000 7fa70b7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70416a840 con 0x7fa7040ccf90 2023-10-09T06:55:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.400+0000 7fa70b7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70416ab20 con 0x7fa7040cbf30 2023-10-09T06:55:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.400+0000 7fa709d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa70415a270 0x7fa704159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.400+0000 7fa709d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa70415a270 0x7fa704159220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56688/0 (socket says 172.21.15.71:56688) 2023-10-09T06:55:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.400+0000 7fa709d9c700 1 -- 172.21.15.71:0/2796536678 learned_addr learned my addr 172.21.15.71:0/2796536678 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.400+0000 7fa708d9a700 1 --2- 172.21.15.71:0/2796536678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7040ccf90 0x7fa704169e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.400+0000 7fa70959b700 1 --2- 172.21.15.71:0/2796536678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7040cbf30 0x7fa70416cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.400+0000 7fa709d9c700 1 -- 172.21.15.71:0/2796536678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7040cbf30 msgr2=0x7fa70416cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.400+0000 7fa709d9c700 1 --2- 172.21.15.71:0/2796536678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7040cbf30 0x7fa70416cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.400+0000 7fa709d9c700 1 -- 172.21.15.71:0/2796536678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7040ccf90 msgr2=0x7fa704169e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.400+0000 7fa709d9c700 1 --2- 172.21.15.71:0/2796536678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7040ccf90 0x7fa704169e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.400+0000 7fa709d9c700 1 -- 172.21.15.71:0/2796536678 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f4009420 con 0x7fa70415a270 2023-10-09T06:55:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.400+0000 7fa708d9a700 1 --2- 172.21.15.71:0/2796536678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7040ccf90 0x7fa704169e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:55:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.400+0000 7fa70959b700 1 --2- 172.21.15.71:0/2796536678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7040cbf30 0x7fa70416cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:55:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.401+0000 7fa709d9c700 1 --2- 172.21.15.71:0/2796536678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa70415a270 0x7fa704159220 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc001460 tx=0x7fa6fc001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.401+0000 7fa6f97fa700 1 -- 172.21.15.71:0/2796536678 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc00a950 con 0x7fa70415a270 2023-10-09T06:55:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.401+0000 7fa6f97fa700 1 -- 172.21.15.71:0/2796536678 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6fc00aab0 con 0x7fa70415a270 2023-10-09T06:55:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.401+0000 7fa6f97fa700 1 -- 172.21.15.71:0/2796536678 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc00ae30 con 0x7fa70415a270 2023-10-09T06:55:18.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.401+0000 7fa70b7ff700 1 -- 172.21.15.71:0/2796536678 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7040c1370 con 0x7fa70415a270 2023-10-09T06:55:18.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.401+0000 7fa70b7ff700 1 -- 172.21.15.71:0/2796536678 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70416b380 con 0x7fa70415a270 2023-10-09T06:55:18.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.402+0000 7fa70b7ff700 1 -- 172.21.15.71:0/2796536678 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa70404c3c0 con 0x7fa70415a270 2023-10-09T06:55:18.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.403+0000 7fa6f97fa700 1 -- 172.21.15.71:0/2796536678 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa6fc007300 con 0x7fa70415a270 2023-10-09T06:55:18.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.404+0000 7fa6f97fa700 1 --2- 172.21.15.71:0/2796536678 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa6e8066f30 0x7fa6e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:18.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.404+0000 7fa6f97fa700 1 -- 172.21.15.71:0/2796536678 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fa6fc084bb0 con 0x7fa70415a270 2023-10-09T06:55:18.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.404+0000 7fa70959b700 1 --2- 172.21.15.71:0/2796536678 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa6e8066f30 0x7fa6e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:18.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.405+0000 7fa70959b700 1 --2- 172.21.15.71:0/2796536678 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa6e8066f30 0x7fa6e80693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa700006f00 tx=0x7fa700008040 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:18.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.408+0000 7fa6f97fa700 1 -- 172.21.15.71:0/2796536678 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6fc051c90 con 0x7fa70415a270 2023-10-09T06:55:18.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.643+0000 7fa70b7ff700 1 -- 172.21.15.71:0/2796536678 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa70406f8a0 con 0x7fa70415a270 2023-10-09T06:55:18.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.643+0000 7fa6f97fa700 1 -- 172.21.15.71:0/2796536678 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa6fc0552b0 con 0x7fa70415a270 2023-10-09T06:55:18.644 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:55:18.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.646+0000 7fa70b7ff700 1 -- 172.21.15.71:0/2796536678 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa6e8066f30 msgr2=0x7fa6e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:18.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.646+0000 7fa70b7ff700 1 --2- 172.21.15.71:0/2796536678 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa6e8066f30 0x7fa6e80693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa700006f00 tx=0x7fa700008040 comp rx=0 tx=0).stop 2023-10-09T06:55:18.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.646+0000 7fa70b7ff700 1 -- 172.21.15.71:0/2796536678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa70415a270 msgr2=0x7fa704159220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:18.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.646+0000 7fa70b7ff700 1 --2- 172.21.15.71:0/2796536678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa70415a270 0x7fa704159220 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc001460 tx=0x7fa6fc001a40 comp rx=0 tx=0).stop 2023-10-09T06:55:18.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.646+0000 7fa70b7ff700 1 -- 172.21.15.71:0/2796536678 shutdown_connections 2023-10-09T06:55:18.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.646+0000 7fa70b7ff700 1 --2- 172.21.15.71:0/2796536678 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa6e8066f30 0x7fa6e80693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.646+0000 7fa70b7ff700 1 --2- 172.21.15.71:0/2796536678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa70415a270 0x7fa704159220 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.646+0000 7fa70b7ff700 1 --2- 172.21.15.71:0/2796536678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7040cbf30 0x7fa70416cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.646+0000 7fa70b7ff700 1 --2- 172.21.15.71:0/2796536678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7040ccf90 0x7fa704169e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:18.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.646+0000 7fa70b7ff700 1 -- 172.21.15.71:0/2796536678 >> 172.21.15.71:0/2796536678 conn(0x7fa70406a320 msgr2=0x7fa704155b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:18.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.646+0000 7fa70b7ff700 1 -- 172.21.15.71:0/2796536678 shutdown_connections 2023-10-09T06:55:18.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:18.646+0000 7fa70b7ff700 1 -- 172.21.15.71:0/2796536678 wait complete. 2023-10-09T06:55:18.664 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:55:18.664 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:55:18.664 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2023-10-09T06:55:18.664 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T06:55:18.664 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T06:55:18.664 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:55:18.664 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:55:18.664 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:55:18.664 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:55:18.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:55:18.665 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2023-10-09T06:55:18.701 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:55:18.702 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:55:18.702 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:55:18.702 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:55:18.702 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-10-09T06:55:18.702 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:55:18.702 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:55:18.702 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2023-10-09T06:55:18.702 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2023-10-09T06:55:18.702 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:55:18.702 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2023-10-09T06:55:18.703 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2023-10-09T06:55:18.703 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:55:18.703 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:55:18.703 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:55:18.703 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:55:18.703 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T06:55:18.703 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 41517sec preferred_lft 41517sec 2023-10-09T06:55:18.703 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2023-10-09T06:55:18.703 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:55:18.703 INFO:teuthology.orchestra.run.smithi071.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:55:18.703 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5a:a1:ec:c7:41:8f brd ff:ff:ff:ff:ff:ff 2023-10-09T06:55:18.703 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:55:18.704 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:55:18.704 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::8052:a9ff:fe85:8756/64 scope link 2023-10-09T06:55:18.704 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:55:18.704 INFO:teuthology.orchestra.run.smithi071.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:55:18.704 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether ae:1f:c9:59:0c:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T06:55:18.704 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ac1f:c9ff:fe59:c1b/64 scope link 2023-10-09T06:55:18.704 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:55:18.704 INFO:teuthology.orchestra.run.smithi071.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:55:18.704 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5a:a1:ec:c7:41:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T06:55:18.704 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::58a1:ecff:fec7:418f/64 scope link 2023-10-09T06:55:18.705 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:55:18.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:55:18.705 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:55:18.801 INFO:teuthology.orchestra.run.smithi071.stdout:1 2023-10-09T06:55:18.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:55:18.804 DEBUG:teuthology.orchestra.run.smithi071:> route 2023-10-09T06:55:18.842 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2023-10-09T06:55:18.843 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:55:18.843 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T06:55:18.843 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T06:55:18.843 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:55:18.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:55:18.844 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-09T06:55:18.844 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-09T06:55:18.844 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T06:55:18.844 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T06:55:18.844 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T06:55:18.845 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-09T06:55:19.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:55:19.039 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-09T06:55:19.074 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T06:55:19.074 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T06:55:19.075 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:55:19.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:55:19.075 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2023-10-09T06:55:19.177 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:55:19.177 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T06:55:19.213 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:55:19.213 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:55:19.214 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:55:19.289 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T06:55:19.289 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:55:19.289 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:55:19.419 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:55:19.419 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:55:19.448 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:55:19.448 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:55:19.448 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.71:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-09T06:55:19.448 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with new device syntax: 0@604c5619-653a-4ab6-912c-ab2e5464fe4a.cephfs=/ 2023-10-09T06:55:19.448 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.71:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-10-09T06:55:19.453 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:55:19.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:55:19.454 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:55:19.514 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T06:55:19.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.695+0000 7f4fc099d700 1 Processor -- start 2023-10-09T06:55:19.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.695+0000 7f4fc099d700 1 -- start start 2023-10-09T06:55:19.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.696+0000 7f4fc099d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4fbc1597f0 0x7f4fbc0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:19.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.696+0000 7f4fc099d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fbc15d230 0x7f4fbc15d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:19.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.696+0000 7f4fc099d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fbc15dbb0 con 0x7f4fbc159420 2023-10-09T06:55:19.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.696+0000 7f4fc099d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fbc0b11d0 con 0x7f4fbc1597f0 2023-10-09T06:55:19.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.696+0000 7f4fc099d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc0b14b0 con 0x7f4fbc15d230 2023-10-09T06:55:19.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.696+0000 7f4fbaffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4fbc1597f0 0x7f4fbc0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:19.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.697+0000 7f4fbaffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4fbc1597f0 0x7f4fbc0b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56692/0 (socket says 172.21.15.71:56692) 2023-10-09T06:55:19.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.697+0000 7f4fbaffd700 1 -- 172.21.15.71:0/1708553386 learned_addr learned my addr 172.21.15.71:0/1708553386 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:19.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.697+0000 7f4fbbfff700 1 --2- 172.21.15.71:0/1708553386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fbc15d230 0x7f4fbc15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:19.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.697+0000 7f4fbaffd700 1 -- 172.21.15.71:0/1708553386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fbc15d230 msgr2=0x7f4fbc15d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:19.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.697+0000 7f4fbaffd700 1 --2- 172.21.15.71:0/1708553386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fbc15d230 0x7f4fbc15d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:19.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.697+0000 7f4fbaffd700 1 -- 172.21.15.71:0/1708553386 >> v1:172.21.15.179:6789/0 conn(0x7f4fbc159420 legacy=0x7f4fbc0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:19.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.697+0000 7f4fbaffd700 1 -- 172.21.15.71:0/1708553386 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc0b1790 con 0x7f4fbc1597f0 2023-10-09T06:55:19.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.697+0000 7f4fbaffd700 1 --2- 172.21.15.71:0/1708553386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fbc1597f0 0x7f4fbc0b2270 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4fb00099b0 tx=0x7f4fb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb9021bd78f5249 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:19.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.697+0000 7f4fba7fc700 1 -- 172.21.15.71:0/1708553386 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb000b860 con 0x7f4fbc1597f0 2023-10-09T06:55:19.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.698+0000 7f4fba7fc700 1 -- 172.21.15.71:0/1708553386 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb000b9c0 con 0x7f4fbc1597f0 2023-10-09T06:55:19.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.698+0000 7f4fba7fc700 1 -- 172.21.15.71:0/1708553386 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb000bd60 con 0x7f4fbc1597f0 2023-10-09T06:55:19.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.698+0000 7f4fc099d700 1 -- 172.21.15.71:0/1708553386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fbc1597f0 msgr2=0x7f4fbc0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:19.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.698+0000 7f4fc099d700 1 --2- 172.21.15.71:0/1708553386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fbc1597f0 0x7f4fbc0b2270 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4fb00099b0 tx=0x7f4fb0009250 comp rx=0 tx=0).stop 2023-10-09T06:55:19.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.698+0000 7f4fc099d700 1 -- 172.21.15.71:0/1708553386 shutdown_connections 2023-10-09T06:55:19.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.698+0000 7f4fc099d700 1 --2- 172.21.15.71:0/1708553386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fbc15d230 0x7f4fbc15d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:19.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.698+0000 7f4fc099d700 1 --2- 172.21.15.71:0/1708553386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fbc1597f0 0x7f4fbc0b2270 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:19.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.698+0000 7f4fc099d700 1 -- 172.21.15.71:0/1708553386 >> 172.21.15.71:0/1708553386 conn(0x7f4fbc0d0660 msgr2=0x7f4fbc0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:19.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.698+0000 7f4fc099d700 1 -- 172.21.15.71:0/1708553386 shutdown_connections 2023-10-09T06:55:19.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.698+0000 7f4fc099d700 1 -- 172.21.15.71:0/1708553386 wait complete. 2023-10-09T06:55:19.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.700+0000 7f4fc099d700 1 Processor -- start 2023-10-09T06:55:19.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.700+0000 7f4fc099d700 1 -- start start 2023-10-09T06:55:19.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.701+0000 7f4fc099d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fbc159420 0x7f4fbc146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:19.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.701+0000 7f4fc099d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fbc1597f0 0x7f4fbc155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:19.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.701+0000 7f4fc099d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fbc15d230 0x7f4fbc1560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:19.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.701+0000 7f4fc099d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc0c5400 con 0x7f4fbc15d230 2023-10-09T06:55:19.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.701+0000 7f4fc099d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc16be20 con 0x7f4fbc159420 2023-10-09T06:55:19.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.701+0000 7f4fc099d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc146690 con 0x7f4fbc1597f0 2023-10-09T06:55:19.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.701+0000 7f4fbbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fbc15d230 0x7f4fbc1560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:19.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.701+0000 7f4fbbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fbc15d230 0x7f4fbc1560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56696/0 (socket says 172.21.15.71:56696) 2023-10-09T06:55:19.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.701+0000 7f4fbbfff700 1 -- 172.21.15.71:0/391514276 learned_addr learned my addr 172.21.15.71:0/391514276 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:19.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.701+0000 7f4fbaffd700 1 --2- 172.21.15.71:0/391514276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fbc1597f0 0x7f4fbc155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:19.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.701+0000 7f4fbb7fe700 1 --2- 172.21.15.71:0/391514276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fbc159420 0x7f4fbc146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:19.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.701+0000 7f4fbbfff700 1 -- 172.21.15.71:0/391514276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fbc1597f0 msgr2=0x7f4fbc155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:19.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.701+0000 7f4fbbfff700 1 --2- 172.21.15.71:0/391514276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fbc1597f0 0x7f4fbc155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:19.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.701+0000 7f4fbbfff700 1 -- 172.21.15.71:0/391514276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fbc159420 msgr2=0x7f4fbc146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:19.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.701+0000 7f4fbbfff700 1 --2- 172.21.15.71:0/391514276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fbc159420 0x7f4fbc146150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:19.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.701+0000 7f4fbbfff700 1 -- 172.21.15.71:0/391514276 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb00094f0 con 0x7f4fbc15d230 2023-10-09T06:55:19.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.702+0000 7f4fbbfff700 1 --2- 172.21.15.71:0/391514276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fbc15d230 0x7f4fbc1560e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4007f20 tx=0x7f4fb4009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:19.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.702+0000 7f4fa37fe700 1 -- 172.21.15.71:0/391514276 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb400eca0 con 0x7f4fbc15d230 2023-10-09T06:55:19.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.702+0000 7f4fa37fe700 1 -- 172.21.15.71:0/391514276 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb400ee20 con 0x7f4fbc15d230 2023-10-09T06:55:19.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.702+0000 7f4fc099d700 1 -- 172.21.15.71:0/391514276 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fbc16b210 con 0x7f4fbc15d230 2023-10-09T06:55:19.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.702+0000 7f4fa37fe700 1 -- 172.21.15.71:0/391514276 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4014670 con 0x7f4fbc15d230 2023-10-09T06:55:19.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.702+0000 7f4fc099d700 1 -- 172.21.15.71:0/391514276 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fbc16b7d0 con 0x7f4fbc15d230 2023-10-09T06:55:19.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.703+0000 7f4fc099d700 1 -- 172.21.15.71:0/391514276 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fbc04c3c0 con 0x7f4fbc15d230 2023-10-09T06:55:19.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.704+0000 7f4fa37fe700 1 -- 172.21.15.71:0/391514276 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4fb40149e0 con 0x7f4fbc15d230 2023-10-09T06:55:19.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.704+0000 7f4fa37fe700 1 --2- 172.21.15.71:0/391514276 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4fa8066f30 0x7f4fa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:19.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.705+0000 7f4fa37fe700 1 -- 172.21.15.71:0/391514276 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f4fb4084e30 con 0x7f4fbc15d230 2023-10-09T06:55:19.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.705+0000 7f4fbb7fe700 1 --2- 172.21.15.71:0/391514276 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4fa8066f30 0x7f4fa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:19.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.706+0000 7f4fbb7fe700 1 --2- 172.21.15.71:0/391514276 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4fa8066f30 0x7f4fa80693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4fac003860 tx=0x7f4fac009040 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:19.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.709+0000 7f4fa37fe700 1 -- 172.21.15.71:0/391514276 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4fb4051e90 con 0x7f4fbc15d230 2023-10-09T06:55:19.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.929+0000 7f4fc099d700 1 -- 172.21.15.71:0/391514276 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fbc0b1a70 con 0x7f4fa8066f30 2023-10-09T06:55:19.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.931+0000 7f4fa37fe700 1 -- 172.21.15.71:0/391514276 <== mgr.5015 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f4fbc0b1a70 con 0x7f4fa8066f30 2023-10-09T06:55:19.932 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-09T06:55:19.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:55:19.932 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cephfs" 2023-10-09T06:55:19.932 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:55:19.932 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-09T06:55:19.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.933+0000 7f4fc099d700 1 -- 172.21.15.71:0/391514276 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4fa8066f30 msgr2=0x7f4fa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:19.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.933+0000 7f4fc099d700 1 --2- 172.21.15.71:0/391514276 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4fa8066f30 0x7f4fa80693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4fac003860 tx=0x7f4fac009040 comp rx=0 tx=0).stop 2023-10-09T06:55:19.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.933+0000 7f4fc099d700 1 -- 172.21.15.71:0/391514276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fbc15d230 msgr2=0x7f4fbc1560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:19.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.933+0000 7f4fc099d700 1 --2- 172.21.15.71:0/391514276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fbc15d230 0x7f4fbc1560e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4007f20 tx=0x7f4fb4009860 comp rx=0 tx=0).stop 2023-10-09T06:55:19.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.933+0000 7f4fc099d700 1 -- 172.21.15.71:0/391514276 shutdown_connections 2023-10-09T06:55:19.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.933+0000 7f4fc099d700 1 --2- 172.21.15.71:0/391514276 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4fa8066f30 0x7f4fa80693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:19.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.933+0000 7f4fc099d700 1 --2- 172.21.15.71:0/391514276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fbc15d230 0x7f4fbc1560e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:19.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.933+0000 7f4fc099d700 1 --2- 172.21.15.71:0/391514276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fbc159420 0x7f4fbc146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:19.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.933+0000 7f4fc099d700 1 --2- 172.21.15.71:0/391514276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fbc1597f0 0x7f4fbc155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:19.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.933+0000 7f4fc099d700 1 -- 172.21.15.71:0/391514276 >> 172.21.15.71:0/391514276 conn(0x7f4fbc0d0660 msgr2=0x7f4fbc155080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:19.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.934+0000 7f4fc099d700 1 -- 172.21.15.71:0/391514276 shutdown_connections 2023-10-09T06:55:19.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:19.934+0000 7f4fc099d700 1 -- 172.21.15.71:0/391514276 wait complete. 2023-10-09T06:55:19.952 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-09T06:55:20.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.133+0000 7f6837dff700 1 Processor -- start 2023-10-09T06:55:20.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.133+0000 7f6837dff700 1 -- start start 2023-10-09T06:55:20.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.134+0000 7f6837dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f68300c83f0 0x7f68300c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:20.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.134+0000 7f6837dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68300ccee0 0x7f68301561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:20.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.134+0000 7f6837dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f68300c87c0 0x7f6830156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:20.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.135+0000 7f6837dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6830156c50 con 0x7f68300c83f0 2023-10-09T06:55:20.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.135+0000 7f6837dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f683015b0d0 con 0x7f68300c87c0 2023-10-09T06:55:20.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.135+0000 7f6837dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68300c7a60 con 0x7f68300ccee0 2023-10-09T06:55:20.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.135+0000 7f6835b9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f68300c83f0 0x7f68300c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:20.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.135+0000 7f6835b9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f68300c83f0 0x7f68300c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56704/0 (socket says 172.21.15.71:56704) 2023-10-09T06:55:20.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.135+0000 7f6835b9b700 1 -- 172.21.15.71:0/1385060025 learned_addr learned my addr 172.21.15.71:0/1385060025 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:20.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.135+0000 7f683639c700 1 --2- 172.21.15.71:0/1385060025 >> v2:172.21.15.179:3300/0 conn(0x7f68300c87c0 0x7f6830156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:20.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.135+0000 7f683539a700 1 --2- 172.21.15.71:0/1385060025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68300ccee0 0x7f68301561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:20.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.135+0000 7f6835b9b700 1 -- 172.21.15.71:0/1385060025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68300ccee0 msgr2=0x7f68301561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:20.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.135+0000 7f6835b9b700 1 --2- 172.21.15.71:0/1385060025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68300ccee0 0x7f68301561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:20.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.135+0000 7f6835b9b700 1 -- 172.21.15.71:0/1385060025 >> v2:172.21.15.179:3300/0 conn(0x7f68300c87c0 msgr2=0x7f6830156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:20.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.135+0000 7f6835b9b700 1 --2- 172.21.15.71:0/1385060025 >> v2:172.21.15.179:3300/0 conn(0x7f68300c87c0 0x7f6830156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:20.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.135+0000 7f6835b9b700 1 -- 172.21.15.71:0/1385060025 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f683015a4c0 con 0x7f68300c83f0 2023-10-09T06:55:20.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.136+0000 7f6835b9b700 1 --2- 172.21.15.71:0/1385060025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68300c83f0 0x7f68300c7520 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f68300cc340 tx=0x7f682c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67aa209305da5612 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:20.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.136+0000 7f6834b99700 1 -- 172.21.15.71:0/1385060025 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c00b640 con 0x7f68300c83f0 2023-10-09T06:55:20.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.136+0000 7f6834b99700 1 -- 172.21.15.71:0/1385060025 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682c00b7a0 con 0x7f68300c83f0 2023-10-09T06:55:20.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.136+0000 7f6834b99700 1 -- 172.21.15.71:0/1385060025 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c00bb40 con 0x7f68300c83f0 2023-10-09T06:55:20.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.136+0000 7f6837dff700 1 -- 172.21.15.71:0/1385060025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68300c83f0 msgr2=0x7f68300c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:20.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.136+0000 7f6837dff700 1 --2- 172.21.15.71:0/1385060025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68300c83f0 0x7f68300c7520 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f68300cc340 tx=0x7f682c009250 comp rx=0 tx=0).stop 2023-10-09T06:55:20.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.136+0000 7f6837dff700 1 -- 172.21.15.71:0/1385060025 shutdown_connections 2023-10-09T06:55:20.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.136+0000 7f6837dff700 1 --2- 172.21.15.71:0/1385060025 >> v2:172.21.15.179:3300/0 conn(0x7f68300c87c0 0x7f6830156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:20.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.136+0000 7f6837dff700 1 --2- 172.21.15.71:0/1385060025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68300c83f0 0x7f68300c7520 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:20.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.136+0000 7f6837dff700 1 --2- 172.21.15.71:0/1385060025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68300ccee0 0x7f68301561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:20.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.136+0000 7f6837dff700 1 -- 172.21.15.71:0/1385060025 >> 172.21.15.71:0/1385060025 conn(0x7f6830068e10 msgr2=0x7f68300cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:20.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.137+0000 7f6837dff700 1 -- 172.21.15.71:0/1385060025 shutdown_connections 2023-10-09T06:55:20.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.137+0000 7f6837dff700 1 -- 172.21.15.71:0/1385060025 wait complete. 2023-10-09T06:55:20.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.138+0000 7f6837dff700 1 Processor -- start 2023-10-09T06:55:20.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.138+0000 7f6837dff700 1 -- start start 2023-10-09T06:55:20.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.139+0000 7f6837dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68300c83f0 0x7f683014c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:20.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.139+0000 7f6837dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68300c87c0 0x7f68300c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:20.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.139+0000 7f6837dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68300ccee0 0x7f683006ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:20.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.139+0000 7f6837dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6830156d90 con 0x7f68300c83f0 2023-10-09T06:55:20.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.139+0000 7f6837dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68301578a0 con 0x7f68300ccee0 2023-10-09T06:55:20.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.139+0000 7f6837dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6830157d30 con 0x7f68300c87c0 2023-10-09T06:55:20.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.139+0000 7f6835b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68300c83f0 0x7f683014c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:20.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.139+0000 7f6835b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68300c83f0 0x7f683014c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56714/0 (socket says 172.21.15.71:56714) 2023-10-09T06:55:20.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.139+0000 7f6835b9b700 1 -- 172.21.15.71:0/4066330211 learned_addr learned my addr 172.21.15.71:0/4066330211 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:20.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.140+0000 7f683539a700 1 --2- 172.21.15.71:0/4066330211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68300c87c0 0x7f68300c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:20.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.140+0000 7f683639c700 1 --2- 172.21.15.71:0/4066330211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68300ccee0 0x7f683006ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:20.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.140+0000 7f6835b9b700 1 -- 172.21.15.71:0/4066330211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68300c87c0 msgr2=0x7f68300c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:20.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.140+0000 7f6835b9b700 1 --2- 172.21.15.71:0/4066330211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68300c87c0 0x7f68300c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:20.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.140+0000 7f6835b9b700 1 -- 172.21.15.71:0/4066330211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68300ccee0 msgr2=0x7f683006ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:20.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.140+0000 7f6835b9b700 1 --2- 172.21.15.71:0/4066330211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68300ccee0 0x7f683006ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:20.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.140+0000 7f6835b9b700 1 -- 172.21.15.71:0/4066330211 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682c0094f0 con 0x7f68300c83f0 2023-10-09T06:55:20.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.140+0000 7f683639c700 1 --2- 172.21.15.71:0/4066330211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68300ccee0 0x7f683006ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:55:20.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.140+0000 7f6835b9b700 1 --2- 172.21.15.71:0/4066330211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68300c83f0 0x7f683014c620 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f682c009930 tx=0x7f682c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:20.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.140+0000 7f6825ffb700 1 -- 172.21.15.71:0/4066330211 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c000d10 con 0x7f68300c83f0 2023-10-09T06:55:20.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.140+0000 7f6825ffb700 1 -- 172.21.15.71:0/4066330211 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682c00bb20 con 0x7f68300c83f0 2023-10-09T06:55:20.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.140+0000 7f6825ffb700 1 -- 172.21.15.71:0/4066330211 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c011670 con 0x7f68300c83f0 2023-10-09T06:55:20.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.140+0000 7f6837dff700 1 -- 172.21.15.71:0/4066330211 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6830156f70 con 0x7f68300c83f0 2023-10-09T06:55:20.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.141+0000 7f6837dff700 1 -- 172.21.15.71:0/4066330211 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6830157530 con 0x7f68300c83f0 2023-10-09T06:55:20.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.141+0000 7f6837dff700 1 -- 172.21.15.71:0/4066330211 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6830157b80 con 0x7f68300c83f0 2023-10-09T06:55:20.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.142+0000 7f6825ffb700 1 -- 172.21.15.71:0/4066330211 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f682c011a20 con 0x7f68300c83f0 2023-10-09T06:55:20.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.143+0000 7f6825ffb700 1 --2- 172.21.15.71:0/4066330211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6814066f30 0x7f68140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:20.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.143+0000 7f6825ffb700 1 -- 172.21.15.71:0/4066330211 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f682c085e70 con 0x7f68300c83f0 2023-10-09T06:55:20.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.144+0000 7f683539a700 1 --2- 172.21.15.71:0/4066330211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6814066f30 0x7f68140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:20.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.144+0000 7f683539a700 1 --2- 172.21.15.71:0/4066330211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6814066f30 0x7f68140693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6830156170 tx=0x7f68200091a0 comp rx=0 tx=0).ready entity=mgr.5015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:20.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.148+0000 7f6825ffb700 1 -- 172.21.15.71:0/4066330211 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f682c052f70 con 0x7f68300c83f0 2023-10-09T06:55:20.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.387+0000 7f6837dff700 1 -- 172.21.15.71:0/4066330211 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f683004c3c0 con 0x7f68300c83f0 2023-10-09T06:55:20.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.756+0000 7f6825ffb700 1 -- 172.21.15.71:0/4066330211 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 17) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f682c053340 con 0x7f68300c83f0 2023-10-09T06:55:20.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.757+0000 7f6825ffb700 1 -- 172.21.15.71:0/4066330211 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v17) v1 ==== 92+0+0 (secure 0 0 0) 0x7f682c056a00 con 0x7f68300c83f0 2023-10-09T06:55:20.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.760+0000 7f6837dff700 1 -- 172.21.15.71:0/4066330211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6814066f30 msgr2=0x7f68140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:20.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.760+0000 7f6837dff700 1 --2- 172.21.15.71:0/4066330211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6814066f30 0x7f68140693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6830156170 tx=0x7f68200091a0 comp rx=0 tx=0).stop 2023-10-09T06:55:20.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.760+0000 7f6837dff700 1 -- 172.21.15.71:0/4066330211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68300c83f0 msgr2=0x7f683014c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:20.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.760+0000 7f6837dff700 1 --2- 172.21.15.71:0/4066330211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68300c83f0 0x7f683014c620 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f682c009930 tx=0x7f682c017000 comp rx=0 tx=0).stop 2023-10-09T06:55:20.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.760+0000 7f6837dff700 1 -- 172.21.15.71:0/4066330211 shutdown_connections 2023-10-09T06:55:20.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.760+0000 7f6837dff700 1 --2- 172.21.15.71:0/4066330211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68300ccee0 0x7f683006ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:20.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.760+0000 7f6837dff700 1 --2- 172.21.15.71:0/4066330211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6814066f30 0x7f68140693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:20.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.760+0000 7f6837dff700 1 --2- 172.21.15.71:0/4066330211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68300c83f0 0x7f683014c620 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:20.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.760+0000 7f6837dff700 1 --2- 172.21.15.71:0/4066330211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68300c87c0 0x7f68300c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:20.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.760+0000 7f6837dff700 1 -- 172.21.15.71:0/4066330211 >> 172.21.15.71:0/4066330211 conn(0x7f6830068e10 msgr2=0x7f68300cabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:20.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.760+0000 7f6837dff700 1 -- 172.21.15.71:0/4066330211 shutdown_connections 2023-10-09T06:55:20.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.760+0000 7f6837dff700 1 -- 172.21.15.71:0/4066330211 wait complete. 2023-10-09T06:55:20.780 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-09T06:55:20.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.969+0000 7f364699d700 1 Processor -- start 2023-10-09T06:55:20.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.969+0000 7f364699d700 1 -- start start 2023-10-09T06:55:20.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.971+0000 7f364699d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36400b16d0 0x7f36400b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:20.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.971+0000 7f364699d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36400b2080 con 0x7f36400b33b0 2023-10-09T06:55:20.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.971+0000 7f364699d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36400cfb00 con 0x7f36400b4e70 2023-10-09T06:55:20.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.971+0000 7f364699d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36400b5c40 con 0x7f36400b16d0 2023-10-09T06:55:20.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.971+0000 7f364619c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f36400b33b0 0x7f36400b3830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60438/0 (socket says 172.21.15.71:60438) 2023-10-09T06:55:20.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.971+0000 7f364619c700 1 -- 172.21.15.71:0/3097846057 learned_addr learned my addr 172.21.15.71:0/3097846057 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:55:20.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.971+0000 7f364519a700 1 --2- 172.21.15.71:0/3097846057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36400b16d0 0x7f36400b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:20.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.971+0000 7f3644999700 1 -- 172.21.15.71:0/3097846057 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674613807 0 0) 0x7f36400b2080 con 0x7f36400b33b0 2023-10-09T06:55:20.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.971+0000 7f3644999700 1 -- 172.21.15.71:0/3097846057 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f362c003570 con 0x7f36400b33b0 2023-10-09T06:55:20.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.972+0000 7f3644999700 1 -- 172.21.15.71:0/3097846057 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 744637566 0 0) 0x7f36400cfb00 con 0x7f36400b4e70 2023-10-09T06:55:20.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.972+0000 7f3644999700 1 -- 172.21.15.71:0/3097846057 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36400b2080 con 0x7f36400b4e70 2023-10-09T06:55:20.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.972+0000 7f364519a700 1 -- 172.21.15.71:0/3097846057 >> v1:172.21.15.179:6789/0 conn(0x7f36400b4e70 legacy=0x7f36400ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:20.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.972+0000 7f364519a700 1 -- 172.21.15.71:0/3097846057 >> v1:172.21.15.71:6789/0 conn(0x7f36400b33b0 legacy=0x7f36400b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:20.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.972+0000 7f364519a700 1 -- 172.21.15.71:0/3097846057 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36400b5f20 con 0x7f36400b16d0 2023-10-09T06:55:20.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.972+0000 7f364519a700 1 --2- 172.21.15.71:0/3097846057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36400b16d0 0x7f36400b1b40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3630009910 tx=0x7f36300091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f783b62ff25109e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:20.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.972+0000 7f3644999700 1 -- 172.21.15.71:0/3097846057 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630011630 con 0x7f36400b16d0 2023-10-09T06:55:20.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.972+0000 7f3644999700 1 -- 172.21.15.71:0/3097846057 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3630011790 con 0x7f36400b16d0 2023-10-09T06:55:20.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.972+0000 7f3644999700 1 -- 172.21.15.71:0/3097846057 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630011b30 con 0x7f36400b16d0 2023-10-09T06:55:20.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.973+0000 7f364699d700 1 -- 172.21.15.71:0/3097846057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36400b16d0 msgr2=0x7f36400b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:20.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.973+0000 7f364699d700 1 --2- 172.21.15.71:0/3097846057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36400b16d0 0x7f36400b1b40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3630009910 tx=0x7f36300091a0 comp rx=0 tx=0).stop 2023-10-09T06:55:20.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.973+0000 7f364699d700 1 -- 172.21.15.71:0/3097846057 shutdown_connections 2023-10-09T06:55:20.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.973+0000 7f364699d700 1 --2- 172.21.15.71:0/3097846057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36400b16d0 0x7f36400b1b40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:20.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.973+0000 7f364699d700 1 -- 172.21.15.71:0/3097846057 >> 172.21.15.71:0/3097846057 conn(0x7f36400d10c0 msgr2=0x7f36400affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:20.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.973+0000 7f364699d700 1 -- 172.21.15.71:0/3097846057 shutdown_connections 2023-10-09T06:55:20.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.973+0000 7f364699d700 1 -- 172.21.15.71:0/3097846057 wait complete. 2023-10-09T06:55:20.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.974+0000 7f364699d700 1 Processor -- start 2023-10-09T06:55:20.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.975+0000 7f364699d700 1 -- start start 2023-10-09T06:55:20.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.975+0000 7f364699d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36400b16d0 0x7f3640156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:20.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.976+0000 7f364699d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36400b33b0 0x7f364015b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:20.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.976+0000 7f364699d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36400b4e70 0x7f364015ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:20.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.976+0000 7f364699d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364015cf90 con 0x7f36400b33b0 2023-10-09T06:55:20.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.976+0000 7f364699d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3640169a00 con 0x7f36400b4e70 2023-10-09T06:55:20.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.976+0000 7f364699d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364015ba10 con 0x7f36400b16d0 2023-10-09T06:55:20.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.976+0000 7f364519a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36400b33b0 0x7f364015b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:20.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.976+0000 7f364519a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36400b33b0 0x7f364015b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56744/0 (socket says 172.21.15.71:56744) 2023-10-09T06:55:20.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.976+0000 7f364599b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36400b16d0 0x7f3640156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:20.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.976+0000 7f364519a700 1 -- 172.21.15.71:0/1976572111 learned_addr learned my addr 172.21.15.71:0/1976572111 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:20.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.976+0000 7f364619c700 1 --2- 172.21.15.71:0/1976572111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36400b4e70 0x7f364015ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:20.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.976+0000 7f364519a700 1 -- 172.21.15.71:0/1976572111 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36400b16d0 msgr2=0x7f3640156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:20.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.976+0000 7f364519a700 1 --2- 172.21.15.71:0/1976572111 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36400b16d0 0x7f3640156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:20.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.976+0000 7f364519a700 1 -- 172.21.15.71:0/1976572111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36400b4e70 msgr2=0x7f364015ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:20.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.976+0000 7f364519a700 1 --2- 172.21.15.71:0/1976572111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36400b4e70 0x7f364015ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:20.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.976+0000 7f364519a700 1 -- 172.21.15.71:0/1976572111 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3630009420 con 0x7f36400b33b0 2023-10-09T06:55:20.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.977+0000 7f364519a700 1 --2- 172.21.15.71:0/1976572111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36400b33b0 0x7f364015b330 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3630009f00 tx=0x7f3630017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:20.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.977+0000 7f3635ffb700 1 -- 172.21.15.71:0/1976572111 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363001f070 con 0x7f36400b33b0 2023-10-09T06:55:20.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.977+0000 7f3635ffb700 1 -- 172.21.15.71:0/1976572111 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3630002f70 con 0x7f36400b33b0 2023-10-09T06:55:20.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.977+0000 7f364699d700 1 -- 172.21.15.71:0/1976572111 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364015bcf0 con 0x7f36400b33b0 2023-10-09T06:55:20.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.977+0000 7f3635ffb700 1 -- 172.21.15.71:0/1976572111 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630011900 con 0x7f36400b33b0 2023-10-09T06:55:20.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.977+0000 7f364699d700 1 -- 172.21.15.71:0/1976572111 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364015c2b0 con 0x7f36400b33b0 2023-10-09T06:55:20.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.978+0000 7f364699d700 1 -- 172.21.15.71:0/1976572111 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3640088990 con 0x7f36400b33b0 2023-10-09T06:55:20.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.979+0000 7f3635ffb700 1 -- 172.21.15.71:0/1976572111 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f3630023070 con 0x7f36400b33b0 2023-10-09T06:55:20.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.980+0000 7f3635ffb700 1 --2- 172.21.15.71:0/1976572111 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3624066f80 0x7f3624069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:20.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.980+0000 7f3635ffb700 1 -- 172.21.15.71:0/1976572111 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f36300859a0 con 0x7f36400b33b0 2023-10-09T06:55:20.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.980+0000 7f364599b700 1 -- 172.21.15.71:0/1976572111 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3624066f80 msgr2=0x7f3624069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:55:20.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.980+0000 7f364599b700 1 --2- 172.21.15.71:0/1976572111 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3624066f80 0x7f3624069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:55:20.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:20.984+0000 7f3635ffb700 1 -- 172.21.15.71:0/1976572111 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3630052aa0 con 0x7f36400b33b0 2023-10-09T06:55:21.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.181+0000 7f364599b700 1 -- 172.21.15.71:0/1976572111 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3624066f80 msgr2=0x7f3624069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:55:21.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.181+0000 7f364599b700 1 --2- 172.21.15.71:0/1976572111 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3624066f80 0x7f3624069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:55:21.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.186+0000 7f364699d700 1 -- 172.21.15.71:0/1976572111 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f364004bb80 con 0x7f36400b33b0 2023-10-09T06:55:21.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.190+0000 7f3635ffb700 1 -- 172.21.15.71:0/1976572111 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v17)=0 v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f363002a0d0 con 0x7f36400b33b0 2023-10-09T06:55:21.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.192+0000 7f364699d700 1 -- 172.21.15.71:0/1976572111 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3624066f80 msgr2=0x7f3624069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:55:21.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.192+0000 7f364699d700 1 --2- 172.21.15.71:0/1976572111 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3624066f80 0x7f3624069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:21.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.192+0000 7f364699d700 1 -- 172.21.15.71:0/1976572111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36400b33b0 msgr2=0x7f364015b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:21.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.192+0000 7f364699d700 1 --2- 172.21.15.71:0/1976572111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36400b33b0 0x7f364015b330 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3630009f00 tx=0x7f3630017000 comp rx=0 tx=0).stop 2023-10-09T06:55:21.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.192+0000 7f364699d700 1 -- 172.21.15.71:0/1976572111 shutdown_connections 2023-10-09T06:55:21.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.192+0000 7f364699d700 1 --2- 172.21.15.71:0/1976572111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36400b4e70 0x7f364015ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:21.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.192+0000 7f364699d700 1 --2- 172.21.15.71:0/1976572111 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36400b16d0 0x7f3640156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:21.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.192+0000 7f364699d700 1 --2- 172.21.15.71:0/1976572111 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3624066f80 0x7f3624069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:21.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.192+0000 7f364699d700 1 --2- 172.21.15.71:0/1976572111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36400b33b0 0x7f364015b330 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:21.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.192+0000 7f364699d700 1 -- 172.21.15.71:0/1976572111 >> 172.21.15.71:0/1976572111 conn(0x7f36400d10c0 msgr2=0x7f36401590c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:21.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.192+0000 7f364699d700 1 -- 172.21.15.71:0/1976572111 shutdown_connections 2023-10-09T06:55:21.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.192+0000 7f364699d700 1 -- 172.21.15.71:0/1976572111 wait complete. 2023-10-09T06:55:21.211 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-09T06:55:21.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.399+0000 7fc6ea79d700 1 Processor -- start 2023-10-09T06:55:21.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.399+0000 7fc6ea79d700 1 -- start start 2023-10-09T06:55:21.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.400+0000 7fc6ea79d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc6e406dc00 0x7fc6e41627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:21.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.400+0000 7fc6ea79d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e40c6820 con 0x7fc6e4140bb0 2023-10-09T06:55:21.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.400+0000 7fc6ea79d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e40c6de0 con 0x7fc6e41407e0 2023-10-09T06:55:21.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.400+0000 7fc6ea79d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e4141270 con 0x7fc6e406dc00 2023-10-09T06:55:21.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.401+0000 7fc6e8f9a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc6e4140bb0 0x7fc6e406d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60450/0 (socket says 172.21.15.71:60450) 2023-10-09T06:55:21.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.401+0000 7fc6e8f9a700 1 -- 172.21.15.71:0/2205614094 learned_addr learned my addr 172.21.15.71:0/2205614094 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:55:21.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.401+0000 7fc6e9f9c700 1 --2- 172.21.15.71:0/2205614094 >> v2:172.21.15.179:3300/0 conn(0x7fc6e406dc00 0x7fc6e41627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:21.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.401+0000 7fc6dbfff700 1 -- 172.21.15.71:0/2205614094 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3319253592 0 0) 0x7fc6e40c6820 con 0x7fc6e4140bb0 2023-10-09T06:55:21.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.401+0000 7fc6dbfff700 1 -- 172.21.15.71:0/2205614094 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6d0003570 con 0x7fc6e4140bb0 2023-10-09T06:55:21.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.401+0000 7fc6e9f9c700 1 -- 172.21.15.71:0/2205614094 >> v1:172.21.15.179:6789/0 conn(0x7fc6e41407e0 legacy=0x7fc6e406a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:21.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.401+0000 7fc6e9f9c700 1 -- 172.21.15.71:0/2205614094 >> v1:172.21.15.71:6789/0 conn(0x7fc6e4140bb0 legacy=0x7fc6e406d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:21.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.401+0000 7fc6e9f9c700 1 -- 172.21.15.71:0/2205614094 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e406acf0 con 0x7fc6e406dc00 2023-10-09T06:55:21.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.402+0000 7fc6e9f9c700 1 --2- 172.21.15.71:0/2205614094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6e406dc00 0x7fc6e41627e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc009e60 tx=0x7fc6dc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a470587b85c37c10 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:21.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.402+0000 7fc6dbfff700 1 -- 172.21.15.71:0/2205614094 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc00e070 con 0x7fc6e406dc00 2023-10-09T06:55:21.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.402+0000 7fc6dbfff700 1 -- 172.21.15.71:0/2205614094 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6dc00bb60 con 0x7fc6e406dc00 2023-10-09T06:55:21.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.402+0000 7fc6dbfff700 1 -- 172.21.15.71:0/2205614094 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc012430 con 0x7fc6e406dc00 2023-10-09T06:55:21.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.402+0000 7fc6ea79d700 1 -- 172.21.15.71:0/2205614094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6e406dc00 msgr2=0x7fc6e41627e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:21.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.402+0000 7fc6ea79d700 1 --2- 172.21.15.71:0/2205614094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6e406dc00 0x7fc6e41627e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc009e60 tx=0x7fc6dc009780 comp rx=0 tx=0).stop 2023-10-09T06:55:21.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.402+0000 7fc6ea79d700 1 -- 172.21.15.71:0/2205614094 shutdown_connections 2023-10-09T06:55:21.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.402+0000 7fc6ea79d700 1 --2- 172.21.15.71:0/2205614094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6e406dc00 0x7fc6e41627e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:21.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.402+0000 7fc6ea79d700 1 -- 172.21.15.71:0/2205614094 >> 172.21.15.71:0/2205614094 conn(0x7fc6e40cc1e0 msgr2=0x7fc6e40cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:21.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.403+0000 7fc6ea79d700 1 -- 172.21.15.71:0/2205614094 shutdown_connections 2023-10-09T06:55:21.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.403+0000 7fc6ea79d700 1 -- 172.21.15.71:0/2205614094 wait complete. 2023-10-09T06:55:21.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.404+0000 7fc6ea79d700 1 Processor -- start 2023-10-09T06:55:21.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.404+0000 7fc6ea79d700 1 -- start start 2023-10-09T06:55:21.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.405+0000 7fc6ea79d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6e406dc00 0x7fc6e40c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:21.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.405+0000 7fc6ea79d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6e41407e0 0x7fc6e40c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:21.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.405+0000 7fc6ea79d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6e4140bb0 0x7fc6e4156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:21.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.405+0000 7fc6ea79d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e4169c50 con 0x7fc6e41407e0 2023-10-09T06:55:21.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.405+0000 7fc6ea79d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e415c4e0 con 0x7fc6e4140bb0 2023-10-09T06:55:21.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.405+0000 7fc6ea79d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e415c7c0 con 0x7fc6e406dc00 2023-10-09T06:55:21.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.405+0000 7fc6e8f9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6e41407e0 0x7fc6e40c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:21.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.405+0000 7fc6e979b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6e406dc00 0x7fc6e40c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:21.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.405+0000 7fc6e8f9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6e41407e0 0x7fc6e40c25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56758/0 (socket says 172.21.15.71:56758) 2023-10-09T06:55:21.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.405+0000 7fc6e8f9a700 1 -- 172.21.15.71:0/3342132660 learned_addr learned my addr 172.21.15.71:0/3342132660 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:21.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.405+0000 7fc6e9f9c700 1 --2- 172.21.15.71:0/3342132660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6e4140bb0 0x7fc6e4156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:21.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.406+0000 7fc6e979b700 1 -- 172.21.15.71:0/3342132660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6e4140bb0 msgr2=0x7fc6e4156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:21.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.406+0000 7fc6e979b700 1 --2- 172.21.15.71:0/3342132660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6e4140bb0 0x7fc6e4156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:21.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.406+0000 7fc6e979b700 1 -- 172.21.15.71:0/3342132660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6e41407e0 msgr2=0x7fc6e40c25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:21.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.406+0000 7fc6e979b700 1 --2- 172.21.15.71:0/3342132660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6e41407e0 0x7fc6e40c25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:21.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.406+0000 7fc6e979b700 1 -- 172.21.15.71:0/3342132660 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc009a20 con 0x7fc6e406dc00 2023-10-09T06:55:21.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.406+0000 7fc6e979b700 1 --2- 172.21.15.71:0/3342132660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6e406dc00 0x7fc6e40c6080 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000c590 tx=0x7fc6e0007ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:21.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.406+0000 7fc6d97fa700 1 -- 172.21.15.71:0/3342132660 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0011590 con 0x7fc6e406dc00 2023-10-09T06:55:21.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.406+0000 7fc6d97fa700 1 -- 172.21.15.71:0/3342132660 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e0011710 con 0x7fc6e406dc00 2023-10-09T06:55:21.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.406+0000 7fc6ea79d700 1 -- 172.21.15.71:0/3342132660 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e415caa0 con 0x7fc6e406dc00 2023-10-09T06:55:21.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.406+0000 7fc6d97fa700 1 -- 172.21.15.71:0/3342132660 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0011ad0 con 0x7fc6e406dc00 2023-10-09T06:55:21.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.407+0000 7fc6ea79d700 1 -- 172.21.15.71:0/3342132660 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e415d060 con 0x7fc6e406dc00 2023-10-09T06:55:21.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.407+0000 7fc6ea79d700 1 -- 172.21.15.71:0/3342132660 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e415dc20 con 0x7fc6e406dc00 2023-10-09T06:55:21.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.408+0000 7fc6d97fa700 1 -- 172.21.15.71:0/3342132660 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 17) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fc6e001b3b0 con 0x7fc6e406dc00 2023-10-09T06:55:21.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.409+0000 7fc6d97fa700 1 --2- 172.21.15.71:0/3342132660 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc6c8066f80 0x7fc6c8069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:21.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.409+0000 7fc6d97fa700 1 -- 172.21.15.71:0/3342132660 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fc6e0083b50 con 0x7fc6e406dc00 2023-10-09T06:55:21.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.409+0000 7fc6e8f9a700 1 -- 172.21.15.71:0/3342132660 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc6c8066f80 msgr2=0x7fc6c8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:55:21.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.409+0000 7fc6e8f9a700 1 --2- 172.21.15.71:0/3342132660 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc6c8066f80 0x7fc6c8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:55:21.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.414+0000 7fc6d97fa700 1 -- 172.21.15.71:0/3342132660 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6e0050bb0 con 0x7fc6e406dc00 2023-10-09T06:55:21.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.610+0000 7fc6e8f9a700 1 -- 172.21.15.71:0/3342132660 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc6c8066f80 msgr2=0x7fc6c8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:55:21.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.610+0000 7fc6e8f9a700 1 --2- 172.21.15.71:0/3342132660 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc6c8066f80 0x7fc6c8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:55:21.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.616+0000 7fc6ea79d700 1 -- 172.21.15.71:0/3342132660 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fc6e406afd0 con 0x7fc6e406dc00 2023-10-09T06:55:21.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.622+0000 7fc6d97fa700 1 -- 172.21.15.71:0/3342132660 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v18)=0 v18) v1 ==== 133+0+0 (secure 0 0 0) 0x7fc6e0017070 con 0x7fc6e406dc00 2023-10-09T06:55:21.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.624+0000 7fc6ea79d700 1 -- 172.21.15.71:0/3342132660 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc6c8066f80 msgr2=0x7fc6c8069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:55:21.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.624+0000 7fc6ea79d700 1 --2- 172.21.15.71:0/3342132660 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc6c8066f80 0x7fc6c8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:21.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.624+0000 7fc6ea79d700 1 -- 172.21.15.71:0/3342132660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6e406dc00 msgr2=0x7fc6e40c6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:21.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.624+0000 7fc6ea79d700 1 --2- 172.21.15.71:0/3342132660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6e406dc00 0x7fc6e40c6080 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000c590 tx=0x7fc6e0007ec0 comp rx=0 tx=0).stop 2023-10-09T06:55:21.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.624+0000 7fc6ea79d700 1 -- 172.21.15.71:0/3342132660 shutdown_connections 2023-10-09T06:55:21.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.624+0000 7fc6ea79d700 1 --2- 172.21.15.71:0/3342132660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6e4140bb0 0x7fc6e4156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:21.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.624+0000 7fc6ea79d700 1 --2- 172.21.15.71:0/3342132660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6e406dc00 0x7fc6e40c6080 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:21.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.624+0000 7fc6ea79d700 1 --2- 172.21.15.71:0/3342132660 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc6c8066f80 0x7fc6c8069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:21.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.624+0000 7fc6ea79d700 1 --2- 172.21.15.71:0/3342132660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6e41407e0 0x7fc6e40c25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:21.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.624+0000 7fc6ea79d700 1 -- 172.21.15.71:0/3342132660 >> 172.21.15.71:0/3342132660 conn(0x7fc6e40cc1e0 msgr2=0x7fc6e40ca6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:21.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.624+0000 7fc6ea79d700 1 -- 172.21.15.71:0/3342132660 shutdown_connections 2023-10-09T06:55:21.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.624+0000 7fc6ea79d700 1 -- 172.21.15.71:0/3342132660 wait complete. 2023-10-09T06:55:21.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:21.643 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-09T06:55:21.684 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-10-09T06:55:21.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.914+0000 7fcbb759d700 1 Processor -- start 2023-10-09T06:55:21.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.915+0000 7fcbb759d700 1 -- start start 2023-10-09T06:55:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.916+0000 7fcbb759d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcbb00b03c0 0x7fcbb00cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.916+0000 7fcbb759d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcbb00b0790 0x7fcbb00b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.916+0000 7fcbb759d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb00cfa00 con 0x7fcbb01591e0 2023-10-09T06:55:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.916+0000 7fcbb759d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb00cb580 con 0x7fcbb00b03c0 2023-10-09T06:55:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.916+0000 7fcbb759d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb00b2de0 con 0x7fcbb00b0790 2023-10-09T06:55:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.916+0000 7fcbb659b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcbb00b03c0 0x7fcbb00cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.916+0000 7fcbb659b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcbb00b03c0 0x7fcbb00cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56770/0 (socket says 172.21.15.71:56770) 2023-10-09T06:55:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.916+0000 7fcbb659b700 1 -- 172.21.15.71:0/775033327 learned_addr learned my addr 172.21.15.71:0/775033327 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.916+0000 7fcbb6d9c700 1 --1- 172.21.15.71:0/775033327 >> v1:172.21.15.71:6789/0 conn(0x7fcbb01591e0 0x7fcbb0159600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60458/0 (socket says 172.21.15.71:60458) 2023-10-09T06:55:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.916+0000 7fcbb5d9a700 1 --2- 172.21.15.71:0/775033327 >> v2:172.21.15.179:3300/0 conn(0x7fcbb00b0790 0x7fcbb00b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:21.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.916+0000 7fcbb659b700 1 -- 172.21.15.71:0/775033327 >> v2:172.21.15.179:3300/0 conn(0x7fcbb00b0790 msgr2=0x7fcbb00b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:21.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.916+0000 7fcbb659b700 1 --2- 172.21.15.71:0/775033327 >> v2:172.21.15.179:3300/0 conn(0x7fcbb00b0790 0x7fcbb00b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:21.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.917+0000 7fcbb659b700 1 -- 172.21.15.71:0/775033327 >> v1:172.21.15.71:6789/0 conn(0x7fcbb01591e0 legacy=0x7fcbb0159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:21.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.917+0000 7fcbb659b700 1 -- 172.21.15.71:0/775033327 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb00cf160 con 0x7fcbb00b03c0 2023-10-09T06:55:21.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.917+0000 7fcbb659b700 1 --2- 172.21.15.71:0/775033327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcbb00b03c0 0x7fcbb00cea70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0099b0 tx=0x7fcbac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d7b229d08773cc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:21.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.917+0000 7fcbb5599700 1 -- 172.21.15.71:0/775033327 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac009ea0 con 0x7fcbb00b03c0 2023-10-09T06:55:21.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.917+0000 7fcbb5599700 1 -- 172.21.15.71:0/775033327 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbac00b820 con 0x7fcbb00b03c0 2023-10-09T06:55:21.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.917+0000 7fcbb5599700 1 -- 172.21.15.71:0/775033327 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac00bbe0 con 0x7fcbb00b03c0 2023-10-09T06:55:21.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.918+0000 7fcbb759d700 1 -- 172.21.15.71:0/775033327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcbb00b03c0 msgr2=0x7fcbb00cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:21.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.918+0000 7fcbb759d700 1 --2- 172.21.15.71:0/775033327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcbb00b03c0 0x7fcbb00cea70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0099b0 tx=0x7fcbac009250 comp rx=0 tx=0).stop 2023-10-09T06:55:21.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.918+0000 7fcbb759d700 1 -- 172.21.15.71:0/775033327 shutdown_connections 2023-10-09T06:55:21.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.918+0000 7fcbb759d700 1 --2- 172.21.15.71:0/775033327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcbb00b03c0 0x7fcbb00cea70 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:21.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.918+0000 7fcbb759d700 1 --2- 172.21.15.71:0/775033327 >> v2:172.21.15.179:3300/0 conn(0x7fcbb00b0790 0x7fcbb00b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:21.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.918+0000 7fcbb759d700 1 -- 172.21.15.71:0/775033327 >> 172.21.15.71:0/775033327 conn(0x7fcbb0063230 msgr2=0x7fcbb0063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:21.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.918+0000 7fcbb759d700 1 -- 172.21.15.71:0/775033327 shutdown_connections 2023-10-09T06:55:21.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.918+0000 7fcbb759d700 1 -- 172.21.15.71:0/775033327 wait complete. 2023-10-09T06:55:21.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.919+0000 7fcbb759d700 1 Processor -- start 2023-10-09T06:55:21.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.919+0000 7fcbb759d700 1 -- start start 2023-10-09T06:55:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.920+0000 7fcbb759d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbb00b03c0 0x7fcbb00ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.920+0000 7fcbb759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbb00b0790 0x7fcbb0157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.920+0000 7fcbb759d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcbb01591e0 0x7fcbb0169d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.920+0000 7fcbb759d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb00c9410 con 0x7fcbb01591e0 2023-10-09T06:55:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.920+0000 7fcbb759d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb015a190 con 0x7fcbb00b03c0 2023-10-09T06:55:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.920+0000 7fcbb759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb016a5d0 con 0x7fcbb00b0790 2023-10-09T06:55:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.921+0000 7fcbb6d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcbb01591e0 0x7fcbb0169d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.921+0000 7fcbb659b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbb00b03c0 0x7fcbb00ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.921+0000 7fcbb6d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcbb01591e0 0x7fcbb0169d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56784/0 (socket says 172.21.15.71:56784) 2023-10-09T06:55:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.921+0000 7fcbb659b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbb00b03c0 0x7fcbb00ca020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:57634/0 (socket says 172.21.15.71:57634) 2023-10-09T06:55:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.921+0000 7fcbb6d9c700 1 -- 172.21.15.71:0/4159363069 learned_addr learned my addr 172.21.15.71:0/4159363069 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.921+0000 7fcbb5d9a700 1 --2- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbb00b0790 0x7fcbb0157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.921+0000 7fcbb6d9c700 1 -- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbb00b0790 msgr2=0x7fcbb0157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.921+0000 7fcbb6d9c700 1 --2- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbb00b0790 0x7fcbb0157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.921+0000 7fcbb6d9c700 1 -- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbb00b03c0 msgr2=0x7fcbb00ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.921+0000 7fcbb6d9c700 1 --2- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbb00b03c0 0x7fcbb00ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.921+0000 7fcbb6d9c700 1 -- 172.21.15.71:0/4159363069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac0094f0 con 0x7fcbb01591e0 2023-10-09T06:55:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.922+0000 7fcbb6d9c700 1 --2- 172.21.15.71:0/4159363069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcbb01591e0 0x7fcbb0169d90 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fcba800cca0 tx=0x7fcba8001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.922+0000 7fcba67fc700 1 -- 172.21.15.71:0/4159363069 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba8005df0 con 0x7fcbb01591e0 2023-10-09T06:55:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.922+0000 7fcba67fc700 1 -- 172.21.15.71:0/4159363069 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba800a5f0 con 0x7fcbb01591e0 2023-10-09T06:55:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.922+0000 7fcbb759d700 1 -- 172.21.15.71:0/4159363069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb016a8b0 con 0x7fcbb01591e0 2023-10-09T06:55:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.922+0000 7fcba67fc700 1 -- 172.21.15.71:0/4159363069 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba800a970 con 0x7fcbb01591e0 2023-10-09T06:55:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.922+0000 7fcbb759d700 1 -- 172.21.15.71:0/4159363069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb0159e20 con 0x7fcbb01591e0 2023-10-09T06:55:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.923+0000 7fcbb759d700 1 -- 172.21.15.71:0/4159363069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb0157be0 con 0x7fcbb01591e0 2023-10-09T06:55:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.925+0000 7fcba67fc700 1 -- 172.21.15.71:0/4159363069 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fcba800ad20 con 0x7fcbb01591e0 2023-10-09T06:55:21.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.926+0000 7fcba67fc700 1 --2- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcb94066f80 0x7fcb94069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:21.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.926+0000 7fcba67fc700 1 -- 172.21.15.71:0/4159363069 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fcba8084600 con 0x7fcbb01591e0 2023-10-09T06:55:21.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.926+0000 7fcbb659b700 1 -- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcb94066f80 msgr2=0x7fcb94069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:55:21.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.926+0000 7fcbb659b700 1 --2- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcb94066f80 0x7fcb94069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:55:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:21.931+0000 7fcba67fc700 1 -- 172.21.15.71:0/4159363069 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcba8051780 con 0x7fcbb01591e0 2023-10-09T06:55:22.039 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:22.038+0000 7fa8eea9e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T06:55:22.082 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:22.081+0000 7f1313675180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T06:55:22.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:22.127+0000 7fcbb659b700 1 -- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcb94066f80 msgr2=0x7fcb94069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:55:22.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:22.127+0000 7fcbb659b700 1 --2- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcb94066f80 0x7fcb94069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:55:22.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:22.156+0000 7fcbb759d700 1 -- 172.21.15.71:0/4159363069 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbb004c3c0 con 0x7fcb94066f80 2023-10-09T06:55:22.202 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:22.202+0000 7fa8eea9e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T06:55:22.248 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:22.247+0000 7f1313675180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T06:55:22.287 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:22.287+0000 7fa8eea9e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T06:55:22.333 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:22.332+0000 7f1313675180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T06:55:22.510 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:22.510+0000 7fa8eea9e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:55:22.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:22.528+0000 7fcbb659b700 1 -- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcb94066f80 msgr2=0x7fcb94069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:55:22.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:22.528+0000 7fcbb659b700 1 --2- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcb94066f80 0x7fcb94069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T06:55:22.556 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:22.555+0000 7f1313675180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:55:22.687 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:22.687+0000 7fa8eea9e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T06:55:22.733 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:22.732+0000 7f1313675180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T06:55:22.778 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:22.778+0000 7fa8eea9e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T06:55:22.825 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:22.824+0000 7f1313675180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T06:55:22.941 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:22.940+0000 7fa8eea9e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T06:55:22.990 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:22.989+0000 7f1313675180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T06:55:23.042 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:23.042+0000 7fa8eea9e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T06:55:23.090 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:23.089+0000 7f1313675180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T06:55:23.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:23.329+0000 7fcbb659b700 1 -- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcb94066f80 msgr2=0x7fcb94069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:55:23.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:23.329+0000 7fcbb659b700 1 --2- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcb94066f80 0x7fcb94069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T06:55:23.520 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:23.520+0000 7fa8eea9e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T06:55:23.571 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:23.570+0000 7f1313675180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T06:55:23.613 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:23.613+0000 7fa8eea9e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T06:55:23.665 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:23.664+0000 7f1313675180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T06:55:23.702 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:23.702+0000 7fa8eea9e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T06:55:23.755 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:23.755+0000 7f1313675180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T06:55:24.324 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:24.323+0000 7fa8eea9e180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T06:55:24.376 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:24.375+0000 7f1313675180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T06:55:24.495 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:24.495+0000 7fa8eea9e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:55:24.548 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:24.547+0000 7f1313675180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:55:24.591 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:24.591+0000 7fa8eea9e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T06:55:24.644 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:24.643+0000 7f1313675180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T06:55:24.884 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:24.884+0000 7fa8eea9e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T06:55:24.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:24.931+0000 7fcbb659b700 1 -- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcb94066f80 msgr2=0x7fcb94069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:55:24.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:24.931+0000 7fcbb659b700 1 --2- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcb94066f80 0x7fcb94069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-09T06:55:24.934 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:24.933+0000 7f1313675180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T06:55:24.980 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:24.980+0000 7fa8eea9e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T06:55:25.030 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:25.029+0000 7f1313675180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T06:55:25.677 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:25.677+0000 7fa8eea9e180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T06:55:25.728 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:25.727+0000 7f1313675180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T06:55:25.963 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:25.963+0000 7fa8eea9e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T06:55:26.011 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:26.010+0000 7f1313675180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T06:55:26.054 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:26.054+0000 7fa8eea9e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T06:55:26.102 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:26.101+0000 7f1313675180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T06:55:26.207 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:26.207+0000 7fa8eea9e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T06:55:26.255 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:26.254+0000 7f1313675180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T06:55:26.310 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:26.310+0000 7fa8eea9e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T06:55:26.358 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:26.357+0000 7f1313675180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T06:55:26.497 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:26.497+0000 7fa8eea9e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T06:55:26.543 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:26.543+0000 7f1313675180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T06:55:26.588 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:26.588+0000 7fa8eea9e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T06:55:26.633 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:26.633+0000 7f1313675180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T06:55:26.679 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:26.678+0000 7fa8eea9e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T06:55:26.723 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:26.723+0000 7f1313675180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T06:55:26.771 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:26.771+0000 7fa8eea9e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T06:55:26.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:26.780+0000 7fcba67fc700 1 -- 172.21.15.71:0/4159363069 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 18) v1 ==== 84468+0+0 (secure 0 0 0) 0x7fcba8051b50 con 0x7fcbb01591e0 2023-10-09T06:55:26.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:26.781+0000 7fcba67fc700 1 -- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcb94066f80 msgr2=0x7fcb94069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:55:26.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:26.781+0000 7fcba67fc700 1 --2- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcb94066f80 0x7fcb94069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:26.821 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:55:26.821+0000 7f1313675180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T06:55:26.902 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:26.902+0000 7fa863df7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:55:26.903 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:26.902+0000 7fa863df7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:55:26.903 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:26.902+0000 7fa863df7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:55:26.903 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:26.902+0000 7fa863df7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:55:26.903 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:26.902+0000 7fa863df7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:55:26.904 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:26.903+0000 7fa860df1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:55:26.905 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:26.903+0000 7fa860df1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:55:26.905 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:26.903+0000 7fa860df1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:55:26.905 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:26.903+0000 7fa860df1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:55:26.905 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:55:26.903+0000 7fa860df1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:55:27.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:27.787+0000 7fcba67fc700 1 -- 172.21.15.71:0/4159363069 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mgrmap(e 19) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fcba80828f0 con 0x7fcbb01591e0 2023-10-09T06:55:27.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:27.788+0000 7fcba67fc700 1 --2- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcb94066f80 0x7fcb94069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:27.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:27.788+0000 7fcba67fc700 1 -- 172.21.15.71:0/4159363069 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbb004c3c0 con 0x7fcb94066f80 2023-10-09T06:55:27.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:27.792+0000 7fcbb659b700 1 --2- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcb94066f80 0x7fcb94069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:27.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:27.796+0000 7fcbb659b700 1 --2- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcb94066f80 0x7fcb94069430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0099b0 tx=0x7fcbac017000 comp rx=0 tx=0).ready entity=mgr.5264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:27.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:27.856+0000 7fcba67fc700 1 -- 172.21.15.71:0/4159363069 <== mgr.5264 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fcbb004c3c0 con 0x7fcb94066f80 2023-10-09T06:55:27.858 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule set for path snap_test_dir1 2023-10-09T06:55:27.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:27.859+0000 7fcbb759d700 1 -- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcb94066f80 msgr2=0x7fcb94069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:27.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:27.859+0000 7fcbb759d700 1 --2- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcb94066f80 0x7fcb94069430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0099b0 tx=0x7fcbac017000 comp rx=0 tx=0).stop 2023-10-09T06:55:27.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:27.859+0000 7fcbb759d700 1 -- 172.21.15.71:0/4159363069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcbb01591e0 msgr2=0x7fcbb0169d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:27.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:27.859+0000 7fcbb759d700 1 --2- 172.21.15.71:0/4159363069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcbb01591e0 0x7fcbb0169d90 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fcba800cca0 tx=0x7fcba8001a70 comp rx=0 tx=0).stop 2023-10-09T06:55:27.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:27.859+0000 7fcbb759d700 1 -- 172.21.15.71:0/4159363069 shutdown_connections 2023-10-09T06:55:27.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:27.859+0000 7fcbb759d700 1 --2- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcb94066f80 0x7fcb94069430 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:27.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:27.859+0000 7fcbb759d700 1 --2- 172.21.15.71:0/4159363069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcbb01591e0 0x7fcbb0169d90 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:27.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:27.859+0000 7fcbb759d700 1 --2- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbb00b03c0 0x7fcbb00ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:27.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:27.859+0000 7fcbb759d700 1 --2- 172.21.15.71:0/4159363069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbb00b0790 0x7fcbb0157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:27.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:27.859+0000 7fcbb759d700 1 -- 172.21.15.71:0/4159363069 >> 172.21.15.71:0/4159363069 conn(0x7fcbb0063230 msgr2=0x7fcbb0069740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:27.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:27.859+0000 7fcbb759d700 1 -- 172.21.15.71:0/4159363069 shutdown_connections 2023-10-09T06:55:27.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:27.859+0000 7fcbb759d700 1 -- 172.21.15.71:0/4159363069 wait complete. 2023-10-09T06:55:27.879 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-09T06:55:27.879 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 2M 2023-10-09T06:55:28.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.063+0000 7f14aadff700 1 Processor -- start 2023-10-09T06:55:28.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.063+0000 7f14aadff700 1 -- start start 2023-10-09T06:55:28.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.065+0000 7f14aadff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f14a415a440 0x7f14a40acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:28.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.065+0000 7f14aadff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14a4068890 0x7f14a40c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:28.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.065+0000 7f14aadff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a415a9b0 con 0x7f14a41563b0 2023-10-09T06:55:28.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.065+0000 7f14aadff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a415ac90 con 0x7f14a415a440 2023-10-09T06:55:28.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.065+0000 7f14aadff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a415af70 con 0x7f14a4068890 2023-10-09T06:55:28.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.065+0000 7f14a8b9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f14a41563b0 0x7f14a4156780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:36504/0 (socket says 172.21.15.71:36504) 2023-10-09T06:55:28.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.065+0000 7f14a8b9b700 1 -- 172.21.15.71:0/1891775400 learned_addr learned my addr 172.21.15.71:0/1891775400 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:55:28.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.065+0000 7f14a3fff700 1 --2- 172.21.15.71:0/1891775400 >> v2:172.21.15.179:3300/0 conn(0x7f14a415a440 0x7f14a40acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:28.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.065+0000 7f14a939c700 1 --2- 172.21.15.71:0/1891775400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14a4068890 0x7f14a40c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.065+0000 7f14a37fe700 1 -- 172.21.15.71:0/1891775400 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919693966 0 0) 0x7f14a415a9b0 con 0x7f14a41563b0 2023-10-09T06:55:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.065+0000 7f14a37fe700 1 -- 172.21.15.71:0/1891775400 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1494003570 con 0x7f14a41563b0 2023-10-09T06:55:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.065+0000 7f14a3fff700 1 -- 172.21.15.71:0/1891775400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14a4068890 msgr2=0x7f14a40c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.065+0000 7f14a3fff700 1 --2- 172.21.15.71:0/1891775400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14a4068890 0x7f14a40c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.065+0000 7f14a3fff700 1 -- 172.21.15.71:0/1891775400 >> v1:172.21.15.71:6789/0 conn(0x7f14a41563b0 legacy=0x7f14a4156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.066+0000 7f14a3fff700 1 -- 172.21.15.71:0/1891775400 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a415b250 con 0x7f14a415a440 2023-10-09T06:55:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.066+0000 7f14a939c700 1 --2- 172.21.15.71:0/1891775400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14a4068890 0x7f14a40c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:55:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.066+0000 7f14a3fff700 1 --2- 172.21.15.71:0/1891775400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14a415a440 0x7f14a40acf30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f14900098e0 tx=0x7f14900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cee063949feaf74 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.066+0000 7f14a37fe700 1 -- 172.21.15.71:0/1891775400 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1490011630 con 0x7f14a415a440 2023-10-09T06:55:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.066+0000 7f14a37fe700 1 -- 172.21.15.71:0/1891775400 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1490011790 con 0x7f14a415a440 2023-10-09T06:55:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.066+0000 7f14a37fe700 1 -- 172.21.15.71:0/1891775400 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1490011b10 con 0x7f14a415a440 2023-10-09T06:55:28.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.067+0000 7f14aadff700 1 -- 172.21.15.71:0/1891775400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14a415a440 msgr2=0x7f14a40acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:28.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.067+0000 7f14aadff700 1 --2- 172.21.15.71:0/1891775400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14a415a440 0x7f14a40acf30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f14900098e0 tx=0x7f14900091a0 comp rx=0 tx=0).stop 2023-10-09T06:55:28.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.067+0000 7f14aadff700 1 -- 172.21.15.71:0/1891775400 shutdown_connections 2023-10-09T06:55:28.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.067+0000 7f14aadff700 1 --2- 172.21.15.71:0/1891775400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14a4068890 0x7f14a40c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:28.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.067+0000 7f14aadff700 1 --2- 172.21.15.71:0/1891775400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14a415a440 0x7f14a40acf30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:28.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.067+0000 7f14aadff700 1 -- 172.21.15.71:0/1891775400 >> 172.21.15.71:0/1891775400 conn(0x7f14a40c8f90 msgr2=0x7f14a40c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:28.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.067+0000 7f14aadff700 1 -- 172.21.15.71:0/1891775400 shutdown_connections 2023-10-09T06:55:28.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.067+0000 7f14aadff700 1 -- 172.21.15.71:0/1891775400 wait complete. 2023-10-09T06:55:28.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.068+0000 7f14aadff700 1 Processor -- start 2023-10-09T06:55:28.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.068+0000 7f14aadff700 1 -- start start 2023-10-09T06:55:28.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.069+0000 7f14aadff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14a4068890 0x7f14a4155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:28.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.069+0000 7f14aadff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14a41563b0 0x7f14a40c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:28.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.069+0000 7f14aadff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14a415a440 0x7f14a414ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:28.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.069+0000 7f14aadff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a4155f50 con 0x7f14a415a440 2023-10-09T06:55:28.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.069+0000 7f14aadff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a40c0960 con 0x7f14a41563b0 2023-10-09T06:55:28.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.069+0000 7f14aadff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a4153280 con 0x7f14a4068890 2023-10-09T06:55:28.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.070+0000 7f14a939c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14a415a440 0x7f14a414ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:28.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.070+0000 7f14a939c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14a415a440 0x7f14a414ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54738/0 (socket says 172.21.15.71:54738) 2023-10-09T06:55:28.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.070+0000 7f14a939c700 1 -- 172.21.15.71:0/1208854506 learned_addr learned my addr 172.21.15.71:0/1208854506 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:28.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.070+0000 7f14a3fff700 1 --2- 172.21.15.71:0/1208854506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14a41563b0 0x7f14a40c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:28.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.070+0000 7f14a8b9b700 1 --2- 172.21.15.71:0/1208854506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14a4068890 0x7f14a4155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:28.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.070+0000 7f14a939c700 1 -- 172.21.15.71:0/1208854506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14a4068890 msgr2=0x7f14a4155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:28.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.070+0000 7f14a939c700 1 --2- 172.21.15.71:0/1208854506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14a4068890 0x7f14a4155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:28.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.070+0000 7f14a939c700 1 -- 172.21.15.71:0/1208854506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14a41563b0 msgr2=0x7f14a40c27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:28.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.070+0000 7f14a939c700 1 --2- 172.21.15.71:0/1208854506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14a41563b0 0x7f14a40c27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:28.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.070+0000 7f14a939c700 1 -- 172.21.15.71:0/1208854506 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c009a20 con 0x7f14a415a440 2023-10-09T06:55:28.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.070+0000 7f14a939c700 1 --2- 172.21.15.71:0/1208854506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14a415a440 0x7f14a414ffc0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f149c009f50 tx=0x7f149c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:28.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.070+0000 7f14a0ff9700 1 -- 172.21.15.71:0/1208854506 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c00ccb0 con 0x7f14a415a440 2023-10-09T06:55:28.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.070+0000 7f14a0ff9700 1 -- 172.21.15.71:0/1208854506 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149c00f040 con 0x7f14a415a440 2023-10-09T06:55:28.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.070+0000 7f14aadff700 1 -- 172.21.15.71:0/1208854506 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1490009420 con 0x7f14a415a440 2023-10-09T06:55:28.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.070+0000 7f14a0ff9700 1 -- 172.21.15.71:0/1208854506 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c014480 con 0x7f14a415a440 2023-10-09T06:55:28.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.071+0000 7f14aadff700 1 -- 172.21.15.71:0/1208854506 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a4152f10 con 0x7f14a415a440 2023-10-09T06:55:28.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.072+0000 7f14aadff700 1 -- 172.21.15.71:0/1208854506 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a40718b0 con 0x7f14a415a440 2023-10-09T06:55:28.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.072+0000 7f14a0ff9700 1 -- 172.21.15.71:0/1208854506 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f149c003020 con 0x7f14a415a440 2023-10-09T06:55:28.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.073+0000 7f14a0ff9700 1 --2- 172.21.15.71:0/1208854506 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1488066dd0 0x7f1488069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:28.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.073+0000 7f14a0ff9700 1 -- 172.21.15.71:0/1208854506 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6327+0+0 (secure 0 0 0) 0x7f149c084e50 con 0x7f14a415a440 2023-10-09T06:55:28.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.074+0000 7f14a8b9b700 1 --2- 172.21.15.71:0/1208854506 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1488066dd0 0x7f1488069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:28.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.074+0000 7f14a8b9b700 1 --2- 172.21.15.71:0/1208854506 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1488066dd0 0x7f1488069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f14980058d0 tx=0x7f1498009040 comp rx=0 tx=0).ready entity=mgr.5264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:28.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.078+0000 7f14a0ff9700 1 -- 172.21.15.71:0/1208854506 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f149c052100 con 0x7f14a415a440 2023-10-09T06:55:28.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.292+0000 7f14aadff700 1 -- 172.21.15.71:0/1208854506 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "2M", "target": ["mon-mgr", ""]}) v1 -- 0x7f14a41533c0 con 0x7f1488066dd0 2023-10-09T06:55:28.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.346+0000 7f14a0ff9700 1 -- 172.21.15.71:0/1208854506 <== mgr.5264 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f14a41533c0 con 0x7f1488066dd0 2023-10-09T06:55:28.347 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule set for path snap_test_dir1 2023-10-09T06:55:28.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.349+0000 7f14aadff700 1 -- 172.21.15.71:0/1208854506 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1488066dd0 msgr2=0x7f1488069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:28.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.349+0000 7f14aadff700 1 --2- 172.21.15.71:0/1208854506 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1488066dd0 0x7f1488069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f14980058d0 tx=0x7f1498009040 comp rx=0 tx=0).stop 2023-10-09T06:55:28.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.349+0000 7f14aadff700 1 -- 172.21.15.71:0/1208854506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14a415a440 msgr2=0x7f14a414ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:28.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.349+0000 7f14aadff700 1 --2- 172.21.15.71:0/1208854506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14a415a440 0x7f14a414ffc0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f149c009f50 tx=0x7f149c00b040 comp rx=0 tx=0).stop 2023-10-09T06:55:28.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.349+0000 7f14aadff700 1 -- 172.21.15.71:0/1208854506 shutdown_connections 2023-10-09T06:55:28.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.349+0000 7f14aadff700 1 --2- 172.21.15.71:0/1208854506 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1488066dd0 0x7f1488069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:28.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.349+0000 7f14aadff700 1 --2- 172.21.15.71:0/1208854506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14a415a440 0x7f14a414ffc0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:28.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.349+0000 7f14aadff700 1 --2- 172.21.15.71:0/1208854506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14a4068890 0x7f14a4155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:28.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.349+0000 7f14aadff700 1 --2- 172.21.15.71:0/1208854506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14a41563b0 0x7f14a40c27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:28.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.349+0000 7f14aadff700 1 -- 172.21.15.71:0/1208854506 >> 172.21.15.71:0/1208854506 conn(0x7f14a40c8f90 msgr2=0x7f14a4152280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:28.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.349+0000 7f14aadff700 1 -- 172.21.15.71:0/1208854506 shutdown_connections 2023-10-09T06:55:28.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.349+0000 7f14aadff700 1 -- 172.21.15.71:0/1208854506 wait complete. 2023-10-09T06:55:28.368 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-09T06:55:28.368 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-09-06_56_00 in ~32s... 2023-10-09T06:55:28.368 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-09-06_57_00 in ~92s... 2023-10-09T06:55:28.368 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M', '2M'], expected_retention: [] 2023-10-09T06:55:28.368 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-10-09T06:55:28.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.551+0000 7ff4309fe700 1 Processor -- start 2023-10-09T06:55:28.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.551+0000 7ff4309fe700 1 -- start start 2023-10-09T06:55:28.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.552+0000 7ff4309fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff42c156350 0x7ff42c157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:28.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.552+0000 7ff4309fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff42c0b0760 0x7ff42c0b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:28.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.552+0000 7ff4309fe700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42c0b1110 con 0x7ff42c159f20 2023-10-09T06:55:28.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.552+0000 7ff4309fe700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42c0b0570 con 0x7ff42c0b0760 2023-10-09T06:55:28.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.552+0000 7ff4309fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c1578b0 con 0x7ff42c156350 2023-10-09T06:55:28.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.552+0000 7ff42b59e700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff42c159f20 0x7ff42c15a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:36512/0 (socket says 172.21.15.71:36512) 2023-10-09T06:55:28.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.552+0000 7ff42b59e700 1 -- 172.21.15.71:0/3035349597 learned_addr learned my addr 172.21.15.71:0/3035349597 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:55:28.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.552+0000 7ff42ad9d700 1 --2- 172.21.15.71:0/3035349597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff42c156350 0x7ff42c157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.552+0000 7ff42a59c700 1 --2- 172.21.15.71:0/3035349597 >> v2:172.21.15.179:3300/0 conn(0x7ff42c0b0760 0x7ff42c0b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.553+0000 7ff429d9b700 1 -- 172.21.15.71:0/3035349597 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594818594 0 0) 0x7ff42c0b1110 con 0x7ff42c159f20 2023-10-09T06:55:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.553+0000 7ff429d9b700 1 -- 172.21.15.71:0/3035349597 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff414003570 con 0x7ff42c159f20 2023-10-09T06:55:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.553+0000 7ff42ad9d700 1 -- 172.21.15.71:0/3035349597 >> v2:172.21.15.179:3300/0 conn(0x7ff42c0b0760 msgr2=0x7ff42c0b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:55:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.553+0000 7ff42ad9d700 1 --2- 172.21.15.71:0/3035349597 >> v2:172.21.15.179:3300/0 conn(0x7ff42c0b0760 0x7ff42c0b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.553+0000 7ff42ad9d700 1 -- 172.21.15.71:0/3035349597 >> v1:172.21.15.71:6789/0 conn(0x7ff42c159f20 legacy=0x7ff42c15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.553+0000 7ff42ad9d700 1 -- 172.21.15.71:0/3035349597 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c0af4d0 con 0x7ff42c156350 2023-10-09T06:55:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.553+0000 7ff42ad9d700 1 --2- 172.21.15.71:0/3035349597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff42c156350 0x7ff42c157370 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0098e0 tx=0x7ff41c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e67a930b58d1722 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.553+0000 7ff429d9b700 1 -- 172.21.15.71:0/3035349597 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c011630 con 0x7ff42c156350 2023-10-09T06:55:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.554+0000 7ff429d9b700 1 -- 172.21.15.71:0/3035349597 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41c011790 con 0x7ff42c156350 2023-10-09T06:55:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.554+0000 7ff429d9b700 1 -- 172.21.15.71:0/3035349597 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c011b30 con 0x7ff42c156350 2023-10-09T06:55:28.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.554+0000 7ff4309fe700 1 -- 172.21.15.71:0/3035349597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff42c156350 msgr2=0x7ff42c157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:28.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.554+0000 7ff4309fe700 1 --2- 172.21.15.71:0/3035349597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff42c156350 0x7ff42c157370 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0098e0 tx=0x7ff41c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:55:28.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.554+0000 7ff4309fe700 1 -- 172.21.15.71:0/3035349597 shutdown_connections 2023-10-09T06:55:28.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.554+0000 7ff4309fe700 1 --2- 172.21.15.71:0/3035349597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff42c156350 0x7ff42c157370 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:28.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.554+0000 7ff4309fe700 1 --2- 172.21.15.71:0/3035349597 >> v2:172.21.15.179:3300/0 conn(0x7ff42c0b0760 0x7ff42c0b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:28.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.554+0000 7ff4309fe700 1 -- 172.21.15.71:0/3035349597 >> 172.21.15.71:0/3035349597 conn(0x7ff42c068e20 msgr2=0x7ff42c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:28.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.554+0000 7ff4309fe700 1 -- 172.21.15.71:0/3035349597 shutdown_connections 2023-10-09T06:55:28.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.554+0000 7ff4309fe700 1 -- 172.21.15.71:0/3035349597 wait complete. 2023-10-09T06:55:28.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.556+0000 7ff4309fe700 1 Processor -- start 2023-10-09T06:55:28.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.556+0000 7ff4309fe700 1 -- start start 2023-10-09T06:55:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.557+0000 7ff4309fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff42c0b0760 0x7ff42c144d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.557+0000 7ff4309fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff42c156350 0x7ff42c0caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.557+0000 7ff4309fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff42c159f20 0x7ff42c0cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.557+0000 7ff4309fe700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c145240 con 0x7ff42c0b0760 2023-10-09T06:55:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.557+0000 7ff4309fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c16a510 con 0x7ff42c159f20 2023-10-09T06:55:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.557+0000 7ff4309fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c0cb5c0 con 0x7ff42c156350 2023-10-09T06:55:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.557+0000 7ff42ad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff42c0b0760 0x7ff42c144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.557+0000 7ff42ad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff42c0b0760 0x7ff42c144d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54748/0 (socket says 172.21.15.71:54748) 2023-10-09T06:55:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.557+0000 7ff42ad9d700 1 -- 172.21.15.71:0/2968515205 learned_addr learned my addr 172.21.15.71:0/2968515205 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:55:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.557+0000 7ff42a59c700 1 --2- 172.21.15.71:0/2968515205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff42c156350 0x7ff42c0caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.557+0000 7ff42b59e700 1 --2- 172.21.15.71:0/2968515205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff42c159f20 0x7ff42c0cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.557+0000 7ff42ad9d700 1 -- 172.21.15.71:0/2968515205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff42c156350 msgr2=0x7ff42c0caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.557+0000 7ff42ad9d700 1 --2- 172.21.15.71:0/2968515205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff42c156350 0x7ff42c0caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.557+0000 7ff42ad9d700 1 -- 172.21.15.71:0/2968515205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff42c159f20 msgr2=0x7ff42c0cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.557+0000 7ff42ad9d700 1 --2- 172.21.15.71:0/2968515205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff42c159f20 0x7ff42c0cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.557+0000 7ff42ad9d700 1 -- 172.21.15.71:0/2968515205 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c009420 con 0x7ff42c0b0760 2023-10-09T06:55:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.558+0000 7ff42ad9d700 1 --2- 172.21.15.71:0/2968515205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff42c0b0760 0x7ff42c144d00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff42c1579f0 tx=0x7ff41c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.558+0000 7ff412ffd700 1 -- 172.21.15.71:0/2968515205 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c011900 con 0x7ff42c0b0760 2023-10-09T06:55:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.558+0000 7ff412ffd700 1 -- 172.21.15.71:0/2968515205 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41c011a60 con 0x7ff42c0b0760 2023-10-09T06:55:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.558+0000 7ff412ffd700 1 -- 172.21.15.71:0/2968515205 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c025640 con 0x7ff42c0b0760 2023-10-09T06:55:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.558+0000 7ff4309fe700 1 -- 172.21.15.71:0/2968515205 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42c169ec0 con 0x7ff42c0b0760 2023-10-09T06:55:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.558+0000 7ff4309fe700 1 -- 172.21.15.71:0/2968515205 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42c169bd0 con 0x7ff42c0b0760 2023-10-09T06:55:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.559+0000 7ff4309fe700 1 -- 172.21.15.71:0/2968515205 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff42c04c3c0 con 0x7ff42c0b0760 2023-10-09T06:55:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.560+0000 7ff412ffd700 1 -- 172.21.15.71:0/2968515205 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 84595+0+0 (secure 0 0 0) 0x7ff41c025a30 con 0x7ff42c0b0760 2023-10-09T06:55:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.561+0000 7ff412ffd700 1 --2- 172.21.15.71:0/2968515205 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff418066dd0 0x7ff418069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:55:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.561+0000 7ff412ffd700 1 -- 172.21.15.71:0/2968515205 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6327+0+0 (secure 0 0 0) 0x7ff41c085c00 con 0x7ff42c0b0760 2023-10-09T06:55:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.561+0000 7ff42a59c700 1 --2- 172.21.15.71:0/2968515205 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff418066dd0 0x7ff418069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:55:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.562+0000 7ff42a59c700 1 --2- 172.21.15.71:0/2968515205 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff418066dd0 0x7ff418069280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0ca470 tx=0x7ff4200091a0 comp rx=0 tx=0).ready entity=mgr.5264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:55:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.565+0000 7ff412ffd700 1 -- 172.21.15.71:0/2968515205 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff41c052de0 con 0x7ff42c0b0760 2023-10-09T06:55:28.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.783+0000 7ff4309fe700 1 -- 172.21.15.71:0/2968515205 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff42c0af7b0 con 0x7ff418066dd0 2023-10-09T06:55:28.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.793+0000 7ff412ffd700 1 -- 172.21.15.71:0/2968515205 <== mgr.5264 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+76 (secure 0 0 0) 0x7ff42c0af7b0 con 0x7ff418066dd0 2023-10-09T06:55:28.794 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:55:28.794 INFO:teuthology.orchestra.run.smithi071.stdout:{"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-10-09T06:55:28.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.796+0000 7ff4309fe700 1 -- 172.21.15.71:0/2968515205 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff418066dd0 msgr2=0x7ff418069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:28.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.796+0000 7ff4309fe700 1 --2- 172.21.15.71:0/2968515205 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff418066dd0 0x7ff418069280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0ca470 tx=0x7ff4200091a0 comp rx=0 tx=0).stop 2023-10-09T06:55:28.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.796+0000 7ff4309fe700 1 -- 172.21.15.71:0/2968515205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff42c0b0760 msgr2=0x7ff42c144d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:55:28.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.796+0000 7ff4309fe700 1 --2- 172.21.15.71:0/2968515205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff42c0b0760 0x7ff42c144d00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff42c1579f0 tx=0x7ff41c017000 comp rx=0 tx=0).stop 2023-10-09T06:55:28.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.796+0000 7ff4309fe700 1 -- 172.21.15.71:0/2968515205 shutdown_connections 2023-10-09T06:55:28.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.796+0000 7ff4309fe700 1 --2- 172.21.15.71:0/2968515205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff42c159f20 0x7ff42c0cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:28.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.796+0000 7ff4309fe700 1 --2- 172.21.15.71:0/2968515205 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff418066dd0 0x7ff418069280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:28.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.796+0000 7ff4309fe700 1 --2- 172.21.15.71:0/2968515205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff42c0b0760 0x7ff42c144d00 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:28.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.796+0000 7ff4309fe700 1 --2- 172.21.15.71:0/2968515205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff42c156350 0x7ff42c0caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:55:28.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.796+0000 7ff4309fe700 1 -- 172.21.15.71:0/2968515205 >> 172.21.15.71:0/2968515205 conn(0x7ff42c068e20 msgr2=0x7ff42c158070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:55:28.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.796+0000 7ff4309fe700 1 -- 172.21.15.71:0/2968515205 shutdown_connections 2023-10-09T06:55:28.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:55:28.796+0000 7ff4309fe700 1 -- 172.21.15.71:0/2968515205 wait complete. 2023-10-09T06:55:28.814 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-10-09T06:55:28.815 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M', '2M'], 'retention': [{}, {}]} 2023-10-09T06:55:28.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:28.815 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:28.853 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:28.854 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:28.854 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:29.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:29.855 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:29.896 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:29.897 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:29.897 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:30.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:30.897 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:30.941 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:30.941 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:30.941 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:31.858 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:55:31.864 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:55:31.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:31.943 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:31.983 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:31.983 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:31.983 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:32.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:32.984 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:33.027 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:33.027 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:33.027 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:34.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:34.028 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:34.073 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:34.074 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:34.074 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:35.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:35.075 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:35.117 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:35.117 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:35.117 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:36.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:36.118 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:36.161 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:36.161 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:36.161 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:37.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:37.162 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:37.206 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:37.206 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:37.206 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:38.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:38.207 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:38.250 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:38.250 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:38.250 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:39.252 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:39.252 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:39.294 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:39.294 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:39.294 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:40.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:40.295 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:40.338 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:40.338 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:40.338 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:41.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:41.340 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:41.383 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:41.384 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:41.384 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:42.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:42.385 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:42.428 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:42.428 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:42.428 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:43.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:43.430 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:43.472 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:43.473 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:43.473 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:44.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:44.474 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:44.516 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:44.517 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:44.517 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:45.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:45.518 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:45.561 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:45.561 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:45.561 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:46.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:46.562 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:46.604 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:46.605 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:46.605 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:47.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:47.606 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:47.650 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:47.650 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:47.650 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:48.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:48.652 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:48.695 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:48.695 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:48.695 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:49.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:49.696 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:49.740 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:49.740 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:49.740 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:50.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:50.741 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:50.784 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:50.784 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:50.784 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:51.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:51.786 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:51.828 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:51.828 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:51.829 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:52.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:52.829 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:52.872 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:52.872 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:52.873 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:53.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:53.874 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:53.917 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:53.917 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:53.917 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:54.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:54.918 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:54.965 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:54.965 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:54.966 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:55.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:55.967 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:56.010 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:56.010 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:56.010 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:57.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:57.012 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:57.055 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:57.055 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:57.055 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:58.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:58.056 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:58.098 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:58.099 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:58.099 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:55:59.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:55:59.100 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:55:59.144 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:55:59.144 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:55:59.144 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:00.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:00.146 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:00.189 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T06:56:00.189 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:00.189 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:00.360 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:56:00.358+0000 7fa852dd5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:56:00.360 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:56:00.358+0000 7fa852dd5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:56:00.360 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:56:00.358+0000 7fa852dd5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:56:00.360 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:56:00.358+0000 7fa852dd5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:56:00.360 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:56:00.358+0000 7fa852dd5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:56:01.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:01.190 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:01.231 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:01.232 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:01.232 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:01.232 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:01.232 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-10-09-06_56_00_UTC'] 2023-10-09T06:56:01.232 DEBUG:tasks.cephfs.test_snap_schedules:exec=1696834528.3682709, now = 1696834561.2328806, timo = 32 2023-10-09T06:56:01.964 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:56:01.970 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:56:02.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:02.233 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:02.274 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:02.275 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:02.275 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:02.276 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:03.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:03.277 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:03.318 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:03.319 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:03.319 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:03.320 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:04.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:04.321 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:04.362 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:04.363 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:04.364 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:04.364 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:05.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:05.365 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:05.409 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:05.411 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:05.411 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:05.411 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:06.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:06.411 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:06.453 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:06.454 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:06.454 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:06.454 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:07.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:07.457 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:07.499 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:07.500 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:07.500 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:07.501 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:08.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:08.502 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:08.544 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:08.545 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:08.545 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:08.545 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:09.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:09.546 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:09.588 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:09.589 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:09.589 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:09.589 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:10.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:10.590 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:10.632 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:10.633 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:10.633 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:10.633 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:11.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:11.635 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:11.676 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:11.677 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:11.677 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:11.677 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:12.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:12.679 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:12.720 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:12.721 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:12.722 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:12.722 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:13.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:13.723 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:13.766 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:13.767 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:13.768 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:13.768 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:14.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:14.774 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:14.816 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:14.817 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:14.817 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:14.817 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:15.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:15.818 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:15.859 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:15.860 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:15.861 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:15.861 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:16.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:16.862 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:16.904 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:16.905 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:16.905 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:16.905 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:17.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:17.906 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:17.948 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:17.949 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:17.950 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:17.950 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:18.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:18.951 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:18.991 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:18.992 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:18.992 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:18.992 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:19.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:19.993 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:20.036 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:20.037 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:20.037 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:20.037 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:21.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:21.039 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:21.081 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:21.082 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:21.082 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:21.082 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:22.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:22.083 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:22.124 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:22.125 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:22.125 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:22.125 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:23.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:23.126 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:23.168 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:23.169 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:23.169 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:23.169 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:24.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:24.170 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:24.212 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:24.213 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:24.213 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:24.214 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:25.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:25.215 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:25.256 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:25.257 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:25.257 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:25.258 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:26.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:26.259 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:26.300 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:26.302 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:26.303 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:26.303 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:27.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:27.304 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:27.346 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:27.347 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:27.347 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:27.347 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:28.349 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:28.349 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:28.391 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:28.392 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:28.392 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:28.392 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:29.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:29.393 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:29.435 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:29.437 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:29.437 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:29.437 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:30.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:30.438 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:30.480 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:30.481 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:30.481 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:30.481 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:31.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:31.482 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:31.526 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:31.528 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:31.528 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:31.528 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:32.079 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:56:32.084 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:56:32.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:32.529 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:32.571 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:32.572 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:32.572 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:32.572 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:33.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:33.573 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:33.615 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:33.616 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:33.616 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:33.616 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:34.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:34.617 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:34.659 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:34.660 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:34.660 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:34.660 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:35.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:35.662 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:35.703 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:35.704 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:35.704 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:35.704 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:36.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:36.706 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:36.747 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:36.748 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:36.748 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:36.748 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:37.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:37.749 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:37.791 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:37.792 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:37.792 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:37.792 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:38.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:38.793 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:38.835 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:38.836 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:38.836 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:38.837 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:39.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:39.837 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:39.879 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:39.880 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:39.880 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:39.880 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:40.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:40.881 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:40.922 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:40.923 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:40.924 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:40.924 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:41.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:41.925 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:41.968 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:41.969 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:41.969 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:41.969 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:42.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:42.971 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:43.011 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:43.012 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:43.013 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:43.013 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:44.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:44.013 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:44.055 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:44.056 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:44.056 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:44.056 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:45.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:45.057 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:45.099 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:45.100 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:45.100 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:45.100 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:46.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:46.101 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:46.142 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:46.143 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:46.144 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:46.144 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:47.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:47.144 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:47.186 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:47.187 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:47.187 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:47.188 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:48.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:48.189 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:48.230 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:48.231 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:48.231 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:48.232 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:49.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:49.232 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:49.274 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:49.275 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:49.275 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:49.275 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:50.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:50.277 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:50.319 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:50.320 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:50.320 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:50.320 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:51.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:51.321 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:51.367 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:51.369 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:51.369 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:51.369 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:52.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:52.370 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:52.411 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:52.412 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:52.412 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:52.412 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:53.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:53.414 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:53.455 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:53.456 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:53.456 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:53.456 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:54.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:54.457 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:54.499 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:54.500 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:54.500 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:54.500 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:55.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:55.501 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:55.543 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:55.544 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:55.544 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:55.544 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:56.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:56.545 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:56.587 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:56.588 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:56.588 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:56.588 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:57.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:57.589 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:57.630 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:57.631 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:57.631 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:57.632 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:58.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:58.633 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:58.674 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:58.676 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:58.676 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:58.676 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:56:59.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:56:59.677 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:56:59.719 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:56:59.720 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC'} 2023-10-09T06:56:59.720 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T06:56:59.720 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:57:00.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:57:00.722 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:57:00.764 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:57:00.764 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_57_00_UTC 2023-10-09T06:57:00.765 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-06_56_00_UTC', 'scheduled-2023-10-09-06_57_00_UTC'} 2023-10-09T06:57:00.765 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-10-09-06_57_00_UTC'} 2023-10-09T06:57:00.765 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T06:57:00.765 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-10-09-06_57_00_UTC'] 2023-10-09T06:57:00.765 DEBUG:tasks.cephfs.test_snap_schedules:exec=1696834528.3682709, now = 1696834620.7658796, timo = 92 2023-10-09T06:57:01.766 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-09T06:57:01.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.959+0000 7f8d343ff700 1 Processor -- start 2023-10-09T06:57:01.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.960+0000 7f8d343ff700 1 -- start start 2023-10-09T06:57:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.961+0000 7f8d343ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8d2c068890 0x7f8d2c0c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.961+0000 7f8d343ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2c15a9b0 con 0x7f8d2c1563b0 2023-10-09T06:57:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.961+0000 7f8d343ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2c15ac90 con 0x7f8d2c15a440 2023-10-09T06:57:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.961+0000 7f8d343ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d2c15af70 con 0x7f8d2c068890 2023-10-09T06:57:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.961+0000 7f8d3219b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8d2c1563b0 0x7f8d2c156780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60328/0 (socket says 172.21.15.71:60328) 2023-10-09T06:57:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.961+0000 7f8d3219b700 1 -- 172.21.15.71:0/2396331677 learned_addr learned my addr 172.21.15.71:0/2396331677 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.961+0000 7f8d31199700 1 -- 172.21.15.71:0/2396331677 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1508293921 0 0) 0x7f8d2c15a9b0 con 0x7f8d2c1563b0 2023-10-09T06:57:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.961+0000 7f8d3299c700 1 --2- 172.21.15.71:0/2396331677 >> v2:172.21.15.179:3300/0 conn(0x7f8d2c068890 0x7f8d2c0c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.961+0000 7f8d31199700 1 -- 172.21.15.71:0/2396331677 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d18003570 con 0x7f8d2c1563b0 2023-10-09T06:57:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.962+0000 7f8d31199700 1 -- 172.21.15.71:0/2396331677 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3116249740 0 0) 0x7f8d18003570 con 0x7f8d2c1563b0 2023-10-09T06:57:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.962+0000 7f8d31199700 1 -- 172.21.15.71:0/2396331677 >> v2:172.21.15.179:3300/0 conn(0x7f8d2c068890 msgr2=0x7f8d2c0c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.962+0000 7f8d31199700 1 --2- 172.21.15.71:0/2396331677 >> v2:172.21.15.179:3300/0 conn(0x7f8d2c068890 0x7f8d2c0c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.962+0000 7f8d31199700 1 -- 172.21.15.71:0/2396331677 >> v1:172.21.15.179:6789/0 conn(0x7f8d2c15a440 legacy=0x7f8d2c0acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.962+0000 7f8d31199700 1 -- 172.21.15.71:0/2396331677 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2c15b250 con 0x7f8d2c1563b0 2023-10-09T06:57:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.962+0000 7f8d31199700 1 -- 172.21.15.71:0/2396331677 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f8d28001470 con 0x7f8d2c1563b0 2023-10-09T06:57:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.962+0000 7f8d31199700 1 -- 172.21.15.71:0/2396331677 >> v1:172.21.15.71:6789/0 conn(0x7f8d2c1563b0 legacy=0x7f8d2c156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.962+0000 7f8d31199700 1 --2- 172.21.15.71:0/2396331677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d18003ab0 0x7f8d18003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.962+0000 7f8d31199700 1 --2- 172.21.15.71:0/2396331677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d18004810 0x7f8d18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:01.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.962+0000 7f8d31199700 1 --2- 172.21.15.71:0/2396331677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d18005210 0x7f8d1800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:01.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.962+0000 7f8d31199700 1 -- 172.21.15.71:0/2396331677 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c15af70 con 0x7f8d18004810 2023-10-09T06:57:01.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.962+0000 7f8d31199700 1 -- 172.21.15.71:0/2396331677 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1800c130 con 0x7f8d18005210 2023-10-09T06:57:01.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.962+0000 7f8d31199700 1 -- 172.21.15.71:0/2396331677 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1800e500 con 0x7f8d18003ab0 2023-10-09T06:57:01.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.962+0000 7f8d3199a700 1 --2- 172.21.15.71:0/2396331677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d18004810 0x7f8d18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:01.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.962+0000 7f8d3219b700 1 --2- 172.21.15.71:0/2396331677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d18003ab0 0x7f8d18003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:01.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.962+0000 7f8d3299c700 1 --2- 172.21.15.71:0/2396331677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d18005210 0x7f8d1800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:01.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.963+0000 7f8d3199a700 1 -- 172.21.15.71:0/2396331677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d18003ab0 msgr2=0x7f8d18003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:01.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.963+0000 7f8d3199a700 1 --2- 172.21.15.71:0/2396331677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d18003ab0 0x7f8d18003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:01.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.963+0000 7f8d3199a700 1 -- 172.21.15.71:0/2396331677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d18005210 msgr2=0x7f8d1800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:01.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.963+0000 7f8d3199a700 1 --2- 172.21.15.71:0/2396331677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d18005210 0x7f8d1800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.963+0000 7f8d3199a700 1 -- 172.21.15.71:0/2396331677 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d18003570 con 0x7f8d18004810 2023-10-09T06:57:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.963+0000 7f8d3299c700 1 -- 172.21.15.71:0/2396331677 reap_dead start 2023-10-09T06:57:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.963+0000 7f8d3199a700 1 --2- 172.21.15.71:0/2396331677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d18004810 0x7f8d18004c80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0018b0 tx=0x7f8d1c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411fdfae22adfbb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.963+0000 7f8d31199700 1 -- 172.21.15.71:0/2396331677 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c012420 con 0x7f8d18004810 2023-10-09T06:57:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.963+0000 7f8d31199700 1 -- 172.21.15.71:0/2396331677 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1c0125a0 con 0x7f8d18004810 2023-10-09T06:57:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.963+0000 7f8d31199700 1 -- 172.21.15.71:0/2396331677 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c012960 con 0x7f8d18004810 2023-10-09T06:57:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.963+0000 7f8d343ff700 1 -- 172.21.15.71:0/2396331677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d18004810 msgr2=0x7f8d18004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.963+0000 7f8d343ff700 1 --2- 172.21.15.71:0/2396331677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d18004810 0x7f8d18004c80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0018b0 tx=0x7f8d1c007d30 comp rx=0 tx=0).stop 2023-10-09T06:57:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.964+0000 7f8d343ff700 1 -- 172.21.15.71:0/2396331677 shutdown_connections 2023-10-09T06:57:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.964+0000 7f8d343ff700 1 --2- 172.21.15.71:0/2396331677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d18004810 0x7f8d18004c80 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.964+0000 7f8d343ff700 1 -- 172.21.15.71:0/2396331677 >> 172.21.15.71:0/2396331677 conn(0x7f8d2c0c8f90 msgr2=0x7f8d2c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.964+0000 7f8d343ff700 1 -- 172.21.15.71:0/2396331677 shutdown_connections 2023-10-09T06:57:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.964+0000 7f8d343ff700 1 -- 172.21.15.71:0/2396331677 wait complete. 2023-10-09T06:57:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.965+0000 7f8d343ff700 1 Processor -- start 2023-10-09T06:57:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.965+0000 7f8d343ff700 1 -- start start 2023-10-09T06:57:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.966+0000 7f8d343ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d18004810 0x7f8d2c14da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.966+0000 7f8d343ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d2c159070 0x7f8d2c1594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.966+0000 7f8d343ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d2c156f30 0x7f8d2c157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.966+0000 7f8d343ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c159a20 con 0x7f8d2c156f30 2023-10-09T06:57:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.966+0000 7f8d343ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c158800 con 0x7f8d2c159070 2023-10-09T06:57:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.966+0000 7f8d343ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c157bf0 con 0x7f8d18004810 2023-10-09T06:57:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.966+0000 7f8d3299c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d2c156f30 0x7f8d2c157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.966+0000 7f8d3299c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d2c156f30 0x7f8d2c157380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54768/0 (socket says 172.21.15.71:54768) 2023-10-09T06:57:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.966+0000 7f8d3299c700 1 -- 172.21.15.71:0/3380334148 learned_addr learned my addr 172.21.15.71:0/3380334148 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.966+0000 7f8d3199a700 1 --2- 172.21.15.71:0/3380334148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d2c159070 0x7f8d2c1594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.966+0000 7f8d3219b700 1 --2- 172.21.15.71:0/3380334148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d18004810 0x7f8d2c14da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.967+0000 7f8d3299c700 1 -- 172.21.15.71:0/3380334148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d18004810 msgr2=0x7f8d2c14da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.967+0000 7f8d3299c700 1 --2- 172.21.15.71:0/3380334148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d18004810 0x7f8d2c14da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.967+0000 7f8d3299c700 1 -- 172.21.15.71:0/3380334148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d2c159070 msgr2=0x7f8d2c1594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.967+0000 7f8d3299c700 1 --2- 172.21.15.71:0/3380334148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d2c159070 0x7f8d2c1594e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.967+0000 7f8d3299c700 1 -- 172.21.15.71:0/3380334148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2c157ed0 con 0x7f8d2c156f30 2023-10-09T06:57:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.967+0000 7f8d3299c700 1 --2- 172.21.15.71:0/3380334148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d2c156f30 0x7f8d2c157380 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c0abef0 tx=0x7f8d2400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:01.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.967+0000 7f8d227fc700 1 -- 172.21.15.71:0/3380334148 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2400e040 con 0x7f8d2c156f30 2023-10-09T06:57:01.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.967+0000 7f8d227fc700 1 -- 172.21.15.71:0/3380334148 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2400f040 con 0x7f8d2c156f30 2023-10-09T06:57:01.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.967+0000 7f8d343ff700 1 -- 172.21.15.71:0/3380334148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d2c1581b0 con 0x7f8d2c156f30 2023-10-09T06:57:01.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.967+0000 7f8d227fc700 1 -- 172.21.15.71:0/3380334148 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2400fd70 con 0x7f8d2c156f30 2023-10-09T06:57:01.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.967+0000 7f8d343ff700 1 -- 172.21.15.71:0/3380334148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2c14dfa0 con 0x7f8d2c156f30 2023-10-09T06:57:01.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.968+0000 7f8d343ff700 1 -- 172.21.15.71:0/3380334148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d2c0718b0 con 0x7f8d2c156f30 2023-10-09T06:57:01.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.969+0000 7f8d227fc700 1 -- 172.21.15.71:0/3380334148 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 22) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f8d24015640 con 0x7f8d2c156f30 2023-10-09T06:57:01.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.970+0000 7f8d227fc700 1 --2- 172.21.15.71:0/3380334148 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8d100670a0 0x7f8d10069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:01.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.970+0000 7f8d227fc700 1 -- 172.21.15.71:0/3380334148 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f8d24085320 con 0x7f8d2c156f30 2023-10-09T06:57:01.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.971+0000 7f8d3219b700 1 --2- 172.21.15.71:0/3380334148 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8d100670a0 0x7f8d10069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:01.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.971+0000 7f8d3219b700 1 --2- 172.21.15.71:0/3380334148 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8d100670a0 0x7f8d10069550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8d28001050 tx=0x7f8d28001d80 comp rx=0 tx=0).ready entity=mgr.5264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:01.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:01.975+0000 7f8d227fc700 1 -- 172.21.15.71:0/3380334148 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d240520c0 con 0x7f8d2c156f30 2023-10-09T06:57:02.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.192+0000 7f8d343ff700 1 -- 172.21.15.71:0/3380334148 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d2c06d6a0 con 0x7f8d100670a0 2023-10-09T06:57:02.210 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:57:02.215 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:57:02.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.259+0000 7f8d227fc700 1 -- 172.21.15.71:0/3380334148 <== mgr.5264 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f8d2c06d6a0 con 0x7f8d100670a0 2023-10-09T06:57:02.261 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule removed for path snap_test_dir1 2023-10-09T06:57:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.262+0000 7f8d343ff700 1 -- 172.21.15.71:0/3380334148 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8d100670a0 msgr2=0x7f8d10069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.262+0000 7f8d343ff700 1 --2- 172.21.15.71:0/3380334148 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8d100670a0 0x7f8d10069550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8d28001050 tx=0x7f8d28001d80 comp rx=0 tx=0).stop 2023-10-09T06:57:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.262+0000 7f8d343ff700 1 -- 172.21.15.71:0/3380334148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d2c156f30 msgr2=0x7f8d2c157380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.262+0000 7f8d343ff700 1 --2- 172.21.15.71:0/3380334148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d2c156f30 0x7f8d2c157380 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c0abef0 tx=0x7f8d2400b040 comp rx=0 tx=0).stop 2023-10-09T06:57:02.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.262+0000 7f8d343ff700 1 -- 172.21.15.71:0/3380334148 shutdown_connections 2023-10-09T06:57:02.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.262+0000 7f8d343ff700 1 --2- 172.21.15.71:0/3380334148 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8d100670a0 0x7f8d10069550 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:02.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.262+0000 7f8d343ff700 1 --2- 172.21.15.71:0/3380334148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d2c156f30 0x7f8d2c157380 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:02.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.262+0000 7f8d343ff700 1 --2- 172.21.15.71:0/3380334148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d18004810 0x7f8d2c14da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:02.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.262+0000 7f8d343ff700 1 --2- 172.21.15.71:0/3380334148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d2c159070 0x7f8d2c1594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:02.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.262+0000 7f8d343ff700 1 -- 172.21.15.71:0/3380334148 >> 172.21.15.71:0/3380334148 conn(0x7f8d2c0c8f90 msgr2=0x7f8d2c151fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:02.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.262+0000 7f8d343ff700 1 -- 172.21.15.71:0/3380334148 shutdown_connections 2023-10-09T06:57:02.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.262+0000 7f8d343ff700 1 -- 172.21.15.71:0/3380334148 wait complete. 2023-10-09T06:57:02.283 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-09T06:57:02.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:57:02.283 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T06:57:02.320 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:57:02.320 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-06_57_00_UTC 2023-10-09T06:57:02.321 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-06_56_00_UTC 2023-10-09T06:57:02.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:57:02.322 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-06_56_00_UTC) 2023-10-09T06:57:02.403 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-06_57_00_UTC 2023-10-09T06:57:02.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:57:02.404 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-06_57_00_UTC) 2023-10-09T06:57:02.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:57:02.486 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-09T06:57:02.566 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-09T06:57:02.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.787+0000 7f01273ff700 1 Processor -- start 2023-10-09T06:57:02.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.787+0000 7f01273ff700 1 -- start start 2023-10-09T06:57:02.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.788+0000 7f01273ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f012006bcd0 0x7f01200caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:02.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.788+0000 7f01273ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f012006c0a0 0x7f012015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:02.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.788+0000 7f01273ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012015d7e0 con 0x7f012015df50 2023-10-09T06:57:02.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.788+0000 7f01273ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f012015dac0 con 0x7f012006bcd0 2023-10-09T06:57:02.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.788+0000 7f01273ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012015aa30 con 0x7f012006c0a0 2023-10-09T06:57:02.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.788+0000 7f012519b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f012006bcd0 0x7f01200caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:02.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.789+0000 7f012519b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f012006bcd0 0x7f01200caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54778/0 (socket says 172.21.15.71:54778) 2023-10-09T06:57:02.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.789+0000 7f012519b700 1 -- 172.21.15.71:0/2622349818 learned_addr learned my addr 172.21.15.71:0/2622349818 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:02.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.789+0000 7f012499a700 1 --2- 172.21.15.71:0/2622349818 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f012006c0a0 0x7f012015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:02.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.789+0000 7f012519b700 1 -- 172.21.15.71:0/2622349818 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f012006c0a0 msgr2=0x7f012015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:02.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.789+0000 7f012519b700 1 --2- 172.21.15.71:0/2622349818 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f012006c0a0 0x7f012015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:02.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.789+0000 7f012519b700 1 -- 172.21.15.71:0/2622349818 >> v1:172.21.15.179:6789/0 conn(0x7f012015df50 legacy=0x7f01200c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:02.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.789+0000 7f012519b700 1 -- 172.21.15.71:0/2622349818 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012015ad10 con 0x7f012006bcd0 2023-10-09T06:57:02.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.789+0000 7f012499a700 1 --2- 172.21.15.71:0/2622349818 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f012006c0a0 0x7f012015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:57:02.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.789+0000 7f012519b700 1 --2- 172.21.15.71:0/2622349818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f012006bcd0 0x7f01200caa90 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f011c0099b0 tx=0x7f011c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107c9dcb08c4d03e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:02.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.789+0000 7f0117fff700 1 -- 172.21.15.71:0/2622349818 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c00b820 con 0x7f012006bcd0 2023-10-09T06:57:02.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.790+0000 7f0117fff700 1 -- 172.21.15.71:0/2622349818 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011c00b980 con 0x7f012006bcd0 2023-10-09T06:57:02.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.790+0000 7f0117fff700 1 -- 172.21.15.71:0/2622349818 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c00bd40 con 0x7f012006bcd0 2023-10-09T06:57:02.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.790+0000 7f01273ff700 1 -- 172.21.15.71:0/2622349818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f012006bcd0 msgr2=0x7f01200caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:02.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.790+0000 7f01273ff700 1 --2- 172.21.15.71:0/2622349818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f012006bcd0 0x7f01200caa90 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f011c0099b0 tx=0x7f011c009250 comp rx=0 tx=0).stop 2023-10-09T06:57:02.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.790+0000 7f01273ff700 1 -- 172.21.15.71:0/2622349818 shutdown_connections 2023-10-09T06:57:02.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.790+0000 7f01273ff700 1 --2- 172.21.15.71:0/2622349818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f012006bcd0 0x7f01200caa90 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:02.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.790+0000 7f01273ff700 1 --2- 172.21.15.71:0/2622349818 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f012006c0a0 0x7f012015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:02.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.790+0000 7f01273ff700 1 -- 172.21.15.71:0/2622349818 >> 172.21.15.71:0/2622349818 conn(0x7f01200ce600 msgr2=0x7f01200cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:02.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.790+0000 7f01273ff700 1 -- 172.21.15.71:0/2622349818 shutdown_connections 2023-10-09T06:57:02.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.790+0000 7f01273ff700 1 -- 172.21.15.71:0/2622349818 wait complete. 2023-10-09T06:57:02.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.792+0000 7f01273ff700 1 Processor -- start 2023-10-09T06:57:02.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.792+0000 7f01273ff700 1 -- start start 2023-10-09T06:57:02.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.793+0000 7f01273ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f012006bcd0 0x7f01200b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:02.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.793+0000 7f01273ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f012006c0a0 0x7f012016ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:02.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.793+0000 7f01273ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f012015df50 0x7f01200c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:02.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.793+0000 7f01273ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01200b41e0 con 0x7f012006bcd0 2023-10-09T06:57:02.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.793+0000 7f01273ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01200b3160 con 0x7f012015df50 2023-10-09T06:57:02.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.793+0000 7f01273ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012016b0a0 con 0x7f012006c0a0 2023-10-09T06:57:02.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.793+0000 7f012519b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f012006bcd0 0x7f01200b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:02.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.793+0000 7f012519b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f012006bcd0 0x7f01200b2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54784/0 (socket says 172.21.15.71:54784) 2023-10-09T06:57:02.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.793+0000 7f012519b700 1 -- 172.21.15.71:0/156027981 learned_addr learned my addr 172.21.15.71:0/156027981 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:02.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.793+0000 7f012499a700 1 --2- 172.21.15.71:0/156027981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f012006c0a0 0x7f012016ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:02.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.793+0000 7f012599c700 1 --2- 172.21.15.71:0/156027981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f012015df50 0x7f01200c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:02.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.793+0000 7f012519b700 1 -- 172.21.15.71:0/156027981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f012006c0a0 msgr2=0x7f012016ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:02.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.793+0000 7f012519b700 1 --2- 172.21.15.71:0/156027981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f012006c0a0 0x7f012016ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:02.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.793+0000 7f012519b700 1 -- 172.21.15.71:0/156027981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f012015df50 msgr2=0x7f01200c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:02.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.793+0000 7f012519b700 1 --2- 172.21.15.71:0/156027981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f012015df50 0x7f01200c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:02.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.793+0000 7f012519b700 1 -- 172.21.15.71:0/156027981 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011c0094f0 con 0x7f012006bcd0 2023-10-09T06:57:02.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.793+0000 7f012599c700 1 --2- 172.21.15.71:0/156027981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f012015df50 0x7f01200c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:57:02.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.793+0000 7f012519b700 1 --2- 172.21.15.71:0/156027981 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f012006bcd0 0x7f01200b2c20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0120069220 tx=0x7f011c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:02.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.794+0000 7f01157fa700 1 -- 172.21.15.71:0/156027981 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c011c80 con 0x7f012006bcd0 2023-10-09T06:57:02.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.794+0000 7f01157fa700 1 -- 172.21.15.71:0/156027981 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011c020070 con 0x7f012006bcd0 2023-10-09T06:57:02.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.794+0000 7f01273ff700 1 -- 172.21.15.71:0/156027981 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01200b3560 con 0x7f012006bcd0 2023-10-09T06:57:02.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.794+0000 7f01157fa700 1 -- 172.21.15.71:0/156027981 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c01b6a0 con 0x7f012006bcd0 2023-10-09T06:57:02.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.794+0000 7f01273ff700 1 -- 172.21.15.71:0/156027981 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01200b3b20 con 0x7f012006bcd0 2023-10-09T06:57:02.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.795+0000 7f01273ff700 1 -- 172.21.15.71:0/156027981 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01200b32b0 con 0x7f012006bcd0 2023-10-09T06:57:02.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.796+0000 7f01157fa700 1 -- 172.21.15.71:0/156027981 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 22) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f011c022030 con 0x7f012006bcd0 2023-10-09T06:57:02.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.797+0000 7f01157fa700 1 --2- 172.21.15.71:0/156027981 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f01040670a0 0x7f0104069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:02.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.797+0000 7f01157fa700 1 -- 172.21.15.71:0/156027981 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f011c086840 con 0x7f012006bcd0 2023-10-09T06:57:02.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.797+0000 7f012499a700 1 --2- 172.21.15.71:0/156027981 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f01040670a0 0x7f0104069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:02.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.798+0000 7f012499a700 1 --2- 172.21.15.71:0/156027981 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f01040670a0 0x7f0104069550 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f011000ac00 tx=0x7f0110006f90 comp rx=0 tx=0).ready entity=mgr.5264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:02.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:02.801+0000 7f01157fa700 1 -- 172.21.15.71:0/156027981 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f011c0536f0 con 0x7f012006bcd0 2023-10-09T06:57:03.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:03.051+0000 7f01273ff700 1 -- 172.21.15.71:0/156027981 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f012004c3c0 con 0x7f012006bcd0 2023-10-09T06:57:03.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:03.931+0000 7f01157fa700 1 -- 172.21.15.71:0/156027981 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 23) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f011c053ac0 con 0x7f012006bcd0 2023-10-09T06:57:03.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:03.933+0000 7f01157fa700 1 -- 172.21.15.71:0/156027981 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v23) v1 ==== 93+0+0 (secure 0 0 0) 0x7f011c057180 con 0x7f012006bcd0 2023-10-09T06:57:03.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:03.936+0000 7f01273ff700 1 -- 172.21.15.71:0/156027981 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f01040670a0 msgr2=0x7f0104069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:03.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:03.936+0000 7f01273ff700 1 --2- 172.21.15.71:0/156027981 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f01040670a0 0x7f0104069550 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f011000ac00 tx=0x7f0110006f90 comp rx=0 tx=0).stop 2023-10-09T06:57:03.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:03.936+0000 7f01273ff700 1 -- 172.21.15.71:0/156027981 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f012006bcd0 msgr2=0x7f01200b2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:03.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:03.936+0000 7f01273ff700 1 --2- 172.21.15.71:0/156027981 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f012006bcd0 0x7f01200b2c20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0120069220 tx=0x7f011c016000 comp rx=0 tx=0).stop 2023-10-09T06:57:03.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:03.936+0000 7f01273ff700 1 -- 172.21.15.71:0/156027981 shutdown_connections 2023-10-09T06:57:03.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:03.936+0000 7f01273ff700 1 --2- 172.21.15.71:0/156027981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f012015df50 0x7f01200c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:03.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:03.936+0000 7f01273ff700 1 --2- 172.21.15.71:0/156027981 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f01040670a0 0x7f0104069550 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:03.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:03.936+0000 7f01273ff700 1 --2- 172.21.15.71:0/156027981 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f012006bcd0 0x7f01200b2c20 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:03.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:03.936+0000 7f01273ff700 1 --2- 172.21.15.71:0/156027981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f012006c0a0 0x7f012016ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:03.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:03.936+0000 7f01273ff700 1 -- 172.21.15.71:0/156027981 >> 172.21.15.71:0/156027981 conn(0x7f01200ce600 msgr2=0x7f01201575a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:03.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:03.936+0000 7f01273ff700 1 -- 172.21.15.71:0/156027981 shutdown_connections 2023-10-09T06:57:03.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:03.936+0000 7f01273ff700 1 -- 172.21.15.71:0/156027981 wait complete. 2023-10-09T06:57:03.957 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:57:03.958 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:57:04.049 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:57:04.124 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:57:04.124 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T06:57:04.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:57:04.124 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T06:57:04.204 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T06:57:04.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:57:04.205 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T06:57:04.247 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:57:04.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.471+0000 7fe476d9d700 1 Processor -- start 2023-10-09T06:57:04.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.472+0000 7fe476d9d700 1 -- start start 2023-10-09T06:57:04.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.473+0000 7fe476d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe470156310 0x7fe4700c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:04.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.473+0000 7fe476d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe4700ae710 0x7fe4700c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:04.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.473+0000 7fe476d9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4700ca860 con 0x7fe4701566e0 2023-10-09T06:57:04.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.473+0000 7fe476d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4700cab40 con 0x7fe4700ae710 2023-10-09T06:57:04.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.473+0000 7fe476d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700cae20 con 0x7fe470156310 2023-10-09T06:57:04.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.473+0000 7fe47559a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe4701566e0 0x7fe4700ae000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60356/0 (socket says 172.21.15.71:60356) 2023-10-09T06:57:04.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.473+0000 7fe47559a700 1 -- 172.21.15.71:0/853841486 learned_addr learned my addr 172.21.15.71:0/853841486 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:04.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.473+0000 7fe475d9b700 1 --2- 172.21.15.71:0/853841486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe470156310 0x7fe4700c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.473+0000 7fe47659c700 1 --2- 172.21.15.71:0/853841486 >> v2:172.21.15.179:3300/0 conn(0x7fe4700ae710 0x7fe4700c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.474+0000 7fe474d99700 1 -- 172.21.15.71:0/853841486 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3686864480 0 0) 0x7fe4700ca860 con 0x7fe4701566e0 2023-10-09T06:57:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.474+0000 7fe474d99700 1 -- 172.21.15.71:0/853841486 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe45c003570 con 0x7fe4701566e0 2023-10-09T06:57:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.474+0000 7fe475d9b700 1 -- 172.21.15.71:0/853841486 >> v2:172.21.15.179:3300/0 conn(0x7fe4700ae710 msgr2=0x7fe4700c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.474+0000 7fe475d9b700 1 --2- 172.21.15.71:0/853841486 >> v2:172.21.15.179:3300/0 conn(0x7fe4700ae710 0x7fe4700c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.474+0000 7fe475d9b700 1 -- 172.21.15.71:0/853841486 >> v1:172.21.15.71:6789/0 conn(0x7fe4701566e0 legacy=0x7fe4700ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.474+0000 7fe475d9b700 1 -- 172.21.15.71:0/853841486 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4700cb100 con 0x7fe470156310 2023-10-09T06:57:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.474+0000 7fe475d9b700 1 --2- 172.21.15.71:0/853841486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe470156310 0x7fe4700c9dc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0098e0 tx=0x7fe46c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a950eb5c59d6d775 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.474+0000 7fe474d99700 1 -- 172.21.15.71:0/853841486 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c011630 con 0x7fe470156310 2023-10-09T06:57:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.474+0000 7fe474d99700 1 -- 172.21.15.71:0/853841486 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c011790 con 0x7fe470156310 2023-10-09T06:57:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.474+0000 7fe474d99700 1 -- 172.21.15.71:0/853841486 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c011b10 con 0x7fe470156310 2023-10-09T06:57:04.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.475+0000 7fe476d9d700 1 -- 172.21.15.71:0/853841486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe470156310 msgr2=0x7fe4700c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.475+0000 7fe476d9d700 1 --2- 172.21.15.71:0/853841486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe470156310 0x7fe4700c9dc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0098e0 tx=0x7fe46c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.475+0000 7fe476d9d700 1 -- 172.21.15.71:0/853841486 shutdown_connections 2023-10-09T06:57:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.475+0000 7fe476d9d700 1 --2- 172.21.15.71:0/853841486 >> v2:172.21.15.179:3300/0 conn(0x7fe4700ae710 0x7fe4700c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.475+0000 7fe476d9d700 1 --2- 172.21.15.71:0/853841486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe470156310 0x7fe4700c9dc0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.475+0000 7fe476d9d700 1 -- 172.21.15.71:0/853841486 >> 172.21.15.71:0/853841486 conn(0x7fe4700cc1f0 msgr2=0x7fe4700cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.475+0000 7fe476d9d700 1 -- 172.21.15.71:0/853841486 shutdown_connections 2023-10-09T06:57:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.475+0000 7fe476d9d700 1 -- 172.21.15.71:0/853841486 wait complete. 2023-10-09T06:57:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.477+0000 7fe476d9d700 1 Processor -- start 2023-10-09T06:57:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.477+0000 7fe476d9d700 1 -- start start 2023-10-09T06:57:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.478+0000 7fe476d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4700ae710 0x7fe47016a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.478+0000 7fe476d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe470156310 0x7fe4700a6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.478+0000 7fe476d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4701566e0 0x7fe47016b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.478+0000 7fe476d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700ad390 con 0x7fe4700ae710 2023-10-09T06:57:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.478+0000 7fe476d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700a63b0 con 0x7fe4701566e0 2023-10-09T06:57:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.478+0000 7fe476d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700a54c0 con 0x7fe470156310 2023-10-09T06:57:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.478+0000 7fe475d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4700ae710 0x7fe47016a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.478+0000 7fe475d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4700ae710 0x7fe47016a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54806/0 (socket says 172.21.15.71:54806) 2023-10-09T06:57:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.478+0000 7fe475d9b700 1 -- 172.21.15.71:0/3385427937 learned_addr learned my addr 172.21.15.71:0/3385427937 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.478+0000 7fe47559a700 1 --2- 172.21.15.71:0/3385427937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe470156310 0x7fe4700a6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.478+0000 7fe47659c700 1 --2- 172.21.15.71:0/3385427937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4701566e0 0x7fe47016b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.478+0000 7fe475d9b700 1 -- 172.21.15.71:0/3385427937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe470156310 msgr2=0x7fe4700a6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.478+0000 7fe475d9b700 1 --2- 172.21.15.71:0/3385427937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe470156310 0x7fe4700a6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.478+0000 7fe475d9b700 1 -- 172.21.15.71:0/3385427937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4701566e0 msgr2=0x7fe47016b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.478+0000 7fe475d9b700 1 --2- 172.21.15.71:0/3385427937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4701566e0 0x7fe47016b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:04.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.478+0000 7fe475d9b700 1 -- 172.21.15.71:0/3385427937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c009420 con 0x7fe4700ae710 2023-10-09T06:57:04.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.479+0000 7fe475d9b700 1 --2- 172.21.15.71:0/3385427937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4700ae710 0x7fe47016a960 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe4700caf60 tx=0x7fe46c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:04.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.479+0000 7fe465ffb700 1 -- 172.21.15.71:0/3385427937 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c011900 con 0x7fe4700ae710 2023-10-09T06:57:04.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.479+0000 7fe465ffb700 1 -- 172.21.15.71:0/3385427937 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c011a60 con 0x7fe4700ae710 2023-10-09T06:57:04.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.479+0000 7fe476d9d700 1 -- 172.21.15.71:0/3385427937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4700a57a0 con 0x7fe4700ae710 2023-10-09T06:57:04.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.479+0000 7fe465ffb700 1 -- 172.21.15.71:0/3385427937 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c01a680 con 0x7fe4700ae710 2023-10-09T06:57:04.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.479+0000 7fe476d9d700 1 -- 172.21.15.71:0/3385427937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4700a5d60 con 0x7fe4700ae710 2023-10-09T06:57:04.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.480+0000 7fe476d9d700 1 -- 172.21.15.71:0/3385427937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe47004c3c0 con 0x7fe4700ae710 2023-10-09T06:57:04.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.481+0000 7fe465ffb700 1 -- 172.21.15.71:0/3385427937 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 23) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fe46c01aa30 con 0x7fe4700ae710 2023-10-09T06:57:04.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.482+0000 7fe465ffb700 1 --2- 172.21.15.71:0/3385427937 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe454067050 0x7fe454069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:04.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.482+0000 7fe465ffb700 1 -- 172.21.15.71:0/3385427937 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fe46c086590 con 0x7fe4700ae710 2023-10-09T06:57:04.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.482+0000 7fe47559a700 1 -- 172.21.15.71:0/3385427937 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe454067050 msgr2=0x7fe454069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:04.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.482+0000 7fe47559a700 1 --2- 172.21.15.71:0/3385427937 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe454067050 0x7fe454069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:04.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.486+0000 7fe465ffb700 1 -- 172.21.15.71:0/3385427937 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe46c053440 con 0x7fe4700ae710 2023-10-09T06:57:04.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.683+0000 7fe47559a700 1 -- 172.21.15.71:0/3385427937 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe454067050 msgr2=0x7fe454069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:04.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.683+0000 7fe47559a700 1 --2- 172.21.15.71:0/3385427937 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe454067050 0x7fe454069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:04.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.723+0000 7fe476d9d700 1 -- 172.21.15.71:0/3385427937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe47015aa20 con 0x7fe4700ae710 2023-10-09T06:57:04.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.724+0000 7fe465ffb700 1 -- 172.21.15.71:0/3385427937 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fe46c056a60 con 0x7fe4700ae710 2023-10-09T06:57:04.725 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:04.725 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5153,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3904949177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3904949177},{"type":"v1","addr":"172.21.15.179:6837","nonce":3904949177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5617,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2761847814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2761847814},{"type":"v1","addr":"172.21.15.71:6833","nonce":2761847814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5632,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3251743580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3251743580},{"type":"v1","addr":"172.21.15.179:6836","nonce":3251743580}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:55:06.387910+0000","modified":"2023-10-09T06:55:09.941744+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5727},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5727":{"gid":5727,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/4151615916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":4151615916},{"type":"v1","addr":"172.21.15.71:6835","nonce":4151615916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T06:57:04.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.726+0000 7fe476d9d700 1 -- 172.21.15.71:0/3385427937 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe454067050 msgr2=0x7fe454069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:04.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.726+0000 7fe476d9d700 1 --2- 172.21.15.71:0/3385427937 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe454067050 0x7fe454069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:04.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.726+0000 7fe476d9d700 1 -- 172.21.15.71:0/3385427937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4700ae710 msgr2=0x7fe47016a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:04.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.726+0000 7fe476d9d700 1 --2- 172.21.15.71:0/3385427937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4700ae710 0x7fe47016a960 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe4700caf60 tx=0x7fe46c017000 comp rx=0 tx=0).stop 2023-10-09T06:57:04.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.726+0000 7fe476d9d700 1 -- 172.21.15.71:0/3385427937 shutdown_connections 2023-10-09T06:57:04.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.726+0000 7fe476d9d700 1 --2- 172.21.15.71:0/3385427937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4701566e0 0x7fe47016b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:04.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.726+0000 7fe476d9d700 1 --2- 172.21.15.71:0/3385427937 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe454067050 0x7fe454069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:04.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.726+0000 7fe476d9d700 1 --2- 172.21.15.71:0/3385427937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4700ae710 0x7fe47016a960 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:04.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.726+0000 7fe476d9d700 1 --2- 172.21.15.71:0/3385427937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe470156310 0x7fe4700a6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:04.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.726+0000 7fe476d9d700 1 -- 172.21.15.71:0/3385427937 >> 172.21.15.71:0/3385427937 conn(0x7fe4700cc1f0 msgr2=0x7fe4701552b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:04.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.726+0000 7fe476d9d700 1 -- 172.21.15.71:0/3385427937 shutdown_connections 2023-10-09T06:57:04.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.726+0000 7fe476d9d700 1 -- 172.21.15.71:0/3385427937 wait complete. 2023-10-09T06:57:04.729 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 24 2023-10-09T06:57:04.745 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:57:04.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.930+0000 7f0d3199d700 1 Processor -- start 2023-10-09T06:57:04.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.930+0000 7f0d3199d700 1 -- start start 2023-10-09T06:57:04.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.931+0000 7f0d3199d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d2c159420 0x7f0d2c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:04.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.931+0000 7f0d3199d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0d2c1597f0 0x7f0d2c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:04.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.931+0000 7f0d3199d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2c0b11d0 con 0x7f0d2c15d230 2023-10-09T06:57:04.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.931+0000 7f0d3199d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2c0b14b0 con 0x7f0d2c1597f0 2023-10-09T06:57:04.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.931+0000 7f0d3199d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c0b1790 con 0x7f0d2c159420 2023-10-09T06:57:04.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.931+0000 7f0d3119c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f0d2c15d230 0x7f0d2c0b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60358/0 (socket says 172.21.15.71:60358) 2023-10-09T06:57:04.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.931+0000 7f0d3119c700 1 -- 172.21.15.71:0/32993183 learned_addr learned my addr 172.21.15.71:0/32993183 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:04.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.932+0000 7f0d3099b700 1 --2- 172.21.15.71:0/32993183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d2c159420 0x7f0d2c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:04.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.932+0000 7f0d2bfff700 1 --2- 172.21.15.71:0/32993183 >> v2:172.21.15.179:3300/0 conn(0x7f0d2c1597f0 0x7f0d2c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:04.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.932+0000 7f0d2b7fe700 1 -- 172.21.15.71:0/32993183 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2902515989 0 0) 0x7f0d2c0b11d0 con 0x7f0d2c15d230 2023-10-09T06:57:04.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.932+0000 7f0d2b7fe700 1 -- 172.21.15.71:0/32993183 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d1c003570 con 0x7f0d2c15d230 2023-10-09T06:57:04.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.932+0000 7f0d3099b700 1 -- 172.21.15.71:0/32993183 >> v2:172.21.15.179:3300/0 conn(0x7f0d2c1597f0 msgr2=0x7f0d2c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:04.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.932+0000 7f0d3099b700 1 --2- 172.21.15.71:0/32993183 >> v2:172.21.15.179:3300/0 conn(0x7f0d2c1597f0 0x7f0d2c0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:04.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.932+0000 7f0d3099b700 1 -- 172.21.15.71:0/32993183 >> v1:172.21.15.71:6789/0 conn(0x7f0d2c15d230 legacy=0x7f0d2c0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:04.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.932+0000 7f0d3099b700 1 -- 172.21.15.71:0/32993183 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2c0b1a70 con 0x7f0d2c159420 2023-10-09T06:57:04.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.932+0000 7f0d2bfff700 1 --2- 172.21.15.71:0/32993183 >> v2:172.21.15.179:3300/0 conn(0x7f0d2c1597f0 0x7f0d2c0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:57:04.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.932+0000 7f0d3099b700 1 --2- 172.21.15.71:0/32993183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d2c159420 0x7f0d2c0b5f40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0d200098e0 tx=0x7f0d200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bfaa7849a2e3c45 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:04.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.933+0000 7f0d2b7fe700 1 -- 172.21.15.71:0/32993183 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d20011630 con 0x7f0d2c159420 2023-10-09T06:57:04.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.933+0000 7f0d2b7fe700 1 -- 172.21.15.71:0/32993183 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d20011790 con 0x7f0d2c159420 2023-10-09T06:57:04.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.933+0000 7f0d2b7fe700 1 -- 172.21.15.71:0/32993183 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d20011b30 con 0x7f0d2c159420 2023-10-09T06:57:04.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.933+0000 7f0d3199d700 1 -- 172.21.15.71:0/32993183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d2c159420 msgr2=0x7f0d2c0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:04.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.933+0000 7f0d3199d700 1 --2- 172.21.15.71:0/32993183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d2c159420 0x7f0d2c0b5f40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0d200098e0 tx=0x7f0d200091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:04.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.933+0000 7f0d3199d700 1 -- 172.21.15.71:0/32993183 shutdown_connections 2023-10-09T06:57:04.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.933+0000 7f0d3199d700 1 --2- 172.21.15.71:0/32993183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d2c159420 0x7f0d2c0b5f40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:04.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.933+0000 7f0d3199d700 1 --2- 172.21.15.71:0/32993183 >> v2:172.21.15.179:3300/0 conn(0x7f0d2c1597f0 0x7f0d2c0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:04.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.933+0000 7f0d3199d700 1 -- 172.21.15.71:0/32993183 >> 172.21.15.71:0/32993183 conn(0x7f0d2c0d0660 msgr2=0x7f0d2c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:04.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.934+0000 7f0d3199d700 1 -- 172.21.15.71:0/32993183 shutdown_connections 2023-10-09T06:57:04.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.934+0000 7f0d3199d700 1 -- 172.21.15.71:0/32993183 wait complete. 2023-10-09T06:57:04.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.935+0000 7f0d3199d700 1 Processor -- start 2023-10-09T06:57:04.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.935+0000 7f0d3199d700 1 -- start start 2023-10-09T06:57:04.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.936+0000 7f0d3199d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d2c159420 0x7f0d2c15bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:04.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.936+0000 7f0d3199d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d2c1597f0 0x7f0d2c16aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:04.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.936+0000 7f0d3199d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d2c15d230 0x7f0d2c16af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:04.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.936+0000 7f0d3199d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c15b930 con 0x7f0d2c159420 2023-10-09T06:57:04.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.936+0000 7f0d3199d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c15ad60 con 0x7f0d2c1597f0 2023-10-09T06:57:04.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.936+0000 7f0d3199d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c15b000 con 0x7f0d2c15d230 2023-10-09T06:57:04.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.936+0000 7f0d3099b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d2c159420 0x7f0d2c15bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:04.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.936+0000 7f0d3099b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d2c159420 0x7f0d2c15bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54822/0 (socket says 172.21.15.71:54822) 2023-10-09T06:57:04.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.936+0000 7f0d3099b700 1 -- 172.21.15.71:0/294898386 learned_addr learned my addr 172.21.15.71:0/294898386 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:04.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.936+0000 7f0d2bfff700 1 --2- 172.21.15.71:0/294898386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d2c1597f0 0x7f0d2c16aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:04.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.936+0000 7f0d3119c700 1 --2- 172.21.15.71:0/294898386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d2c15d230 0x7f0d2c16af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:04.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.937+0000 7f0d3099b700 1 -- 172.21.15.71:0/294898386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d2c15d230 msgr2=0x7f0d2c16af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:04.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.937+0000 7f0d3099b700 1 --2- 172.21.15.71:0/294898386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d2c15d230 0x7f0d2c16af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:04.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.937+0000 7f0d3099b700 1 -- 172.21.15.71:0/294898386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d2c1597f0 msgr2=0x7f0d2c16aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:04.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.937+0000 7f0d3099b700 1 --2- 172.21.15.71:0/294898386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d2c1597f0 0x7f0d2c16aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:04.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.937+0000 7f0d3099b700 1 -- 172.21.15.71:0/294898386 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d18009420 con 0x7f0d2c159420 2023-10-09T06:57:04.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.937+0000 7f0d3099b700 1 --2- 172.21.15.71:0/294898386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d2c159420 0x7f0d2c15bdc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0b18d0 tx=0x7f0d20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:04.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.937+0000 7f0d28ff9700 1 -- 172.21.15.71:0/294898386 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d20011900 con 0x7f0d2c159420 2023-10-09T06:57:04.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.937+0000 7f0d28ff9700 1 -- 172.21.15.71:0/294898386 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d20011a60 con 0x7f0d2c159420 2023-10-09T06:57:04.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.937+0000 7f0d3199d700 1 -- 172.21.15.71:0/294898386 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d20009420 con 0x7f0d2c159420 2023-10-09T06:57:04.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.937+0000 7f0d28ff9700 1 -- 172.21.15.71:0/294898386 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d20025640 con 0x7f0d2c159420 2023-10-09T06:57:04.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.937+0000 7f0d3199d700 1 -- 172.21.15.71:0/294898386 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2c15b5c0 con 0x7f0d2c159420 2023-10-09T06:57:04.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.938+0000 7f0d3199d700 1 -- 172.21.15.71:0/294898386 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2c04c3c0 con 0x7f0d2c159420 2023-10-09T06:57:04.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.939+0000 7f0d28ff9700 1 -- 172.21.15.71:0/294898386 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 23) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f0d20025a30 con 0x7f0d2c159420 2023-10-09T06:57:04.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.940+0000 7f0d28ff9700 1 --2- 172.21.15.71:0/294898386 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0d10067050 0x7f0d10069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:04.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.940+0000 7f0d2bfff700 1 -- 172.21.15.71:0/294898386 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0d10067050 msgr2=0x7f0d10069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:04.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.940+0000 7f0d28ff9700 1 -- 172.21.15.71:0/294898386 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f0d20086040 con 0x7f0d2c159420 2023-10-09T06:57:04.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.940+0000 7f0d2bfff700 1 --2- 172.21.15.71:0/294898386 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0d10067050 0x7f0d10069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:04.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:04.945+0000 7f0d28ff9700 1 -- 172.21.15.71:0/294898386 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d20052ef0 con 0x7f0d2c159420 2023-10-09T06:57:05.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.141+0000 7f0d2bfff700 1 -- 172.21.15.71:0/294898386 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0d10067050 msgr2=0x7f0d10069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:05.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.141+0000 7f0d2bfff700 1 --2- 172.21.15.71:0/294898386 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0d10067050 0x7f0d10069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:05.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.143+0000 7f0d3199d700 1 -- 172.21.15.71:0/294898386 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d2c0b1d50 con 0x7f0d2c159420 2023-10-09T06:57:05.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.144+0000 7f0d28ff9700 1 -- 172.21.15.71:0/294898386 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16369 (secure 0 0 0) 0x7f0d20056510 con 0x7f0d2c159420 2023-10-09T06:57:05.145 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:05.145 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":65,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:56:27.868727+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:55:04.058830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T06:55:05.370158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.32","mappings":[{"from":0,"to":5}]},{"pgid":"7.37","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:0/2392477914":"2023-10-10T06:55:26.774306+0000","172.21.15.179:0/1885947609":"2023-10-10T06:55:26.774306+0000","172.21.15.179:6833/85452":"2023-10-10T06:55:26.774306+0000","172.21.15.179:0/1151339543":"2023-10-10T06:55:26.774306+0000","172.21.15.179:6832/85452":"2023-10-10T06:55:26.774306+0000","172.21.15.179:0/3804390923":"2023-10-10T06:55:26.774306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:57:05.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.146+0000 7f0d3199d700 1 -- 172.21.15.71:0/294898386 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0d10067050 msgr2=0x7f0d10069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:05.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.146+0000 7f0d3199d700 1 --2- 172.21.15.71:0/294898386 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0d10067050 0x7f0d10069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.146+0000 7f0d3199d700 1 -- 172.21.15.71:0/294898386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d2c159420 msgr2=0x7f0d2c15bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:05.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.146+0000 7f0d3199d700 1 --2- 172.21.15.71:0/294898386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d2c159420 0x7f0d2c15bdc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0b18d0 tx=0x7f0d20017000 comp rx=0 tx=0).stop 2023-10-09T06:57:05.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.146+0000 7f0d3199d700 1 -- 172.21.15.71:0/294898386 shutdown_connections 2023-10-09T06:57:05.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.146+0000 7f0d3199d700 1 --2- 172.21.15.71:0/294898386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d2c15d230 0x7f0d2c16af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.146+0000 7f0d3199d700 1 --2- 172.21.15.71:0/294898386 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0d10067050 0x7f0d10069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.146+0000 7f0d3199d700 1 --2- 172.21.15.71:0/294898386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d2c159420 0x7f0d2c15bdc0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.146+0000 7f0d3199d700 1 --2- 172.21.15.71:0/294898386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d2c1597f0 0x7f0d2c16aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.146+0000 7f0d3199d700 1 -- 172.21.15.71:0/294898386 >> 172.21.15.71:0/294898386 conn(0x7f0d2c0d0660 msgr2=0x7f0d2c1573e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:05.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.146+0000 7f0d3199d700 1 -- 172.21.15.71:0/294898386 shutdown_connections 2023-10-09T06:57:05.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.146+0000 7f0d3199d700 1 -- 172.21.15.71:0/294898386 wait complete. 2023-10-09T06:57:05.165 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:55:04.058830+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:55:05.370158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:57:05.165 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:57:05.217 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:05.217+0000 7fa5dc499180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T06:57:05.262 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:05.261+0000 7f4ddd045180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T06:57:05.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.353+0000 7f9d2639d700 1 Processor -- start 2023-10-09T06:57:05.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.353+0000 7f9d2639d700 1 -- start start 2023-10-09T06:57:05.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.354+0000 7f9d2639d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d200b16d0 0x7f9d200b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:05.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.354+0000 7f9d2639d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9d200b33b0 0x7f9d200b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:05.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.354+0000 7f9d2639d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d200b2080 con 0x7f9d200b4e70 2023-10-09T06:57:05.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.354+0000 7f9d2639d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d200cfb00 con 0x7f9d200b33b0 2023-10-09T06:57:05.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.354+0000 7f9d2639d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200b5c40 con 0x7f9d200b16d0 2023-10-09T06:57:05.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.355+0000 7f9d25b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9d200b33b0 0x7f9d200b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:05.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.355+0000 7f9d25b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9d200b33b0 0x7f9d200b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37948/0 (socket says 172.21.15.71:37948) 2023-10-09T06:57:05.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.355+0000 7f9d25b9c700 1 -- 172.21.15.71:0/2604038810 learned_addr learned my addr 172.21.15.71:0/2604038810 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:05.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.355+0000 7f9d2539b700 1 --1- 172.21.15.71:0/2604038810 >> v1:172.21.15.71:6789/0 conn(0x7f9d200b4e70 0x7f9d200ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35358/0 (socket says 172.21.15.71:35358) 2023-10-09T06:57:05.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.355+0000 7f9d24b9a700 1 --2- 172.21.15.71:0/2604038810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d200b16d0 0x7f9d200b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:05.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.355+0000 7f9d25b9c700 1 -- 172.21.15.71:0/2604038810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d200b16d0 msgr2=0x7f9d200b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:05.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.355+0000 7f9d25b9c700 1 --2- 172.21.15.71:0/2604038810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d200b16d0 0x7f9d200b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.355+0000 7f9d25b9c700 1 -- 172.21.15.71:0/2604038810 >> v1:172.21.15.71:6789/0 conn(0x7f9d200b4e70 legacy=0x7f9d200ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:05.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.355+0000 7f9d25b9c700 1 -- 172.21.15.71:0/2604038810 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d200b5f20 con 0x7f9d200b33b0 2023-10-09T06:57:05.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.355+0000 7f9d17fff700 1 -- 172.21.15.71:0/2604038810 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506083774 0 0) 0x7f9d200b2080 con 0x7f9d200b4e70 2023-10-09T06:57:05.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.355+0000 7f9d25b9c700 1 --2- 172.21.15.71:0/2604038810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d200b33b0 0x7f9d200b3830 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009f20 tx=0x7f9d18009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34f11254aa4f10d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:05.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.356+0000 7f9d17fff700 1 -- 172.21.15.71:0/2604038810 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1800e070 con 0x7f9d200b33b0 2023-10-09T06:57:05.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.356+0000 7f9d17fff700 1 -- 172.21.15.71:0/2604038810 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1800b9d0 con 0x7f9d200b33b0 2023-10-09T06:57:05.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.356+0000 7f9d17fff700 1 -- 172.21.15.71:0/2604038810 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d180092e0 con 0x7f9d200b33b0 2023-10-09T06:57:05.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.356+0000 7f9d2639d700 1 -- 172.21.15.71:0/2604038810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d200b33b0 msgr2=0x7f9d200b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:05.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.356+0000 7f9d2639d700 1 --2- 172.21.15.71:0/2604038810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d200b33b0 0x7f9d200b3830 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009f20 tx=0x7f9d18009840 comp rx=0 tx=0).stop 2023-10-09T06:57:05.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.356+0000 7f9d2639d700 1 -- 172.21.15.71:0/2604038810 shutdown_connections 2023-10-09T06:57:05.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.356+0000 7f9d2639d700 1 --2- 172.21.15.71:0/2604038810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d200b33b0 0x7f9d200b3830 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.356+0000 7f9d2639d700 1 --2- 172.21.15.71:0/2604038810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d200b16d0 0x7f9d200b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.356+0000 7f9d2639d700 1 -- 172.21.15.71:0/2604038810 >> 172.21.15.71:0/2604038810 conn(0x7f9d200d10c0 msgr2=0x7f9d200affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:05.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.356+0000 7f9d2639d700 1 -- 172.21.15.71:0/2604038810 shutdown_connections 2023-10-09T06:57:05.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.356+0000 7f9d2639d700 1 -- 172.21.15.71:0/2604038810 wait complete. 2023-10-09T06:57:05.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.358+0000 7f9d2639d700 1 Processor -- start 2023-10-09T06:57:05.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.358+0000 7f9d2639d700 1 -- start start 2023-10-09T06:57:05.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.359+0000 7f9d2639d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d200b16d0 0x7f9d200ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:05.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.359+0000 7f9d2639d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d200b33b0 0x7f9d20068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:05.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.359+0000 7f9d2639d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d200b4e70 0x7f9d20068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:05.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.359+0000 7f9d2639d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200c6660 con 0x7f9d200b4e70 2023-10-09T06:57:05.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.359+0000 7f9d2639d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2016dfa0 con 0x7f9d200b33b0 2023-10-09T06:57:05.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.359+0000 7f9d2639d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200c5d30 con 0x7f9d200b16d0 2023-10-09T06:57:05.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.359+0000 7f9d25b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d200b4e70 0x7f9d20068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:05.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.359+0000 7f9d25b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d200b4e70 0x7f9d20068f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37962/0 (socket says 172.21.15.71:37962) 2023-10-09T06:57:05.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.359+0000 7f9d25b9c700 1 -- 172.21.15.71:0/3660044609 learned_addr learned my addr 172.21.15.71:0/3660044609 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:05.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.359+0000 7f9d2539b700 1 --2- 172.21.15.71:0/3660044609 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d200b16d0 0x7f9d200ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:05.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.359+0000 7f9d24b9a700 1 --2- 172.21.15.71:0/3660044609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d200b33b0 0x7f9d20068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:05.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.359+0000 7f9d25b9c700 1 -- 172.21.15.71:0/3660044609 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d200b16d0 msgr2=0x7f9d200ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:05.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.359+0000 7f9d25b9c700 1 --2- 172.21.15.71:0/3660044609 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d200b16d0 0x7f9d200ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.359+0000 7f9d25b9c700 1 -- 172.21.15.71:0/3660044609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d200b33b0 msgr2=0x7f9d20068a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:05.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.359+0000 7f9d25b9c700 1 --2- 172.21.15.71:0/3660044609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d200b33b0 0x7f9d20068a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.360+0000 7f9d25b9c700 1 -- 172.21.15.71:0/3660044609 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d18009ae0 con 0x7f9d200b4e70 2023-10-09T06:57:05.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.360+0000 7f9d25b9c700 1 --2- 172.21.15.71:0/3660044609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d200b4e70 0x7f9d20068f40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800b610 tx=0x7f9d18018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:05.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.360+0000 7f9d157fa700 1 -- 172.21.15.71:0/3660044609 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d180070a0 con 0x7f9d200b4e70 2023-10-09T06:57:05.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.360+0000 7f9d157fa700 1 -- 172.21.15.71:0/3660044609 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d18007b40 con 0x7f9d200b4e70 2023-10-09T06:57:05.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.360+0000 7f9d157fa700 1 -- 172.21.15.71:0/3660044609 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1801d420 con 0x7f9d200b4e70 2023-10-09T06:57:05.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.360+0000 7f9d2639d700 1 -- 172.21.15.71:0/3660044609 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d200c6010 con 0x7f9d200b4e70 2023-10-09T06:57:05.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.360+0000 7f9d2639d700 1 -- 172.21.15.71:0/3660044609 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d200ca790 con 0x7f9d200b4e70 2023-10-09T06:57:05.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.361+0000 7f9d2639d700 1 -- 172.21.15.71:0/3660044609 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d20088990 con 0x7f9d200b4e70 2023-10-09T06:57:05.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.362+0000 7f9d157fa700 1 -- 172.21.15.71:0/3660044609 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 23) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f9d18003050 con 0x7f9d200b4e70 2023-10-09T06:57:05.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.363+0000 7f9d157fa700 1 --2- 172.21.15.71:0/3660044609 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9d04067050 0x7f9d04069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:05.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.363+0000 7f9d157fa700 1 -- 172.21.15.71:0/3660044609 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f9d180865e0 con 0x7f9d200b4e70 2023-10-09T06:57:05.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.363+0000 7f9d2539b700 1 -- 172.21.15.71:0/3660044609 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9d04067050 msgr2=0x7f9d04069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:05.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.363+0000 7f9d2539b700 1 --2- 172.21.15.71:0/3660044609 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9d04067050 0x7f9d04069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:05.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.367+0000 7f9d157fa700 1 -- 172.21.15.71:0/3660044609 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d18053380 con 0x7f9d200b4e70 2023-10-09T06:57:05.378 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:05.378+0000 7fa5dc499180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T06:57:05.433 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:05.432+0000 7f4ddd045180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T06:57:05.463 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:05.463+0000 7fa5dc499180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T06:57:05.520 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:05.519+0000 7f4ddd045180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T06:57:05.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.563+0000 7f9d2639d700 1 -- 172.21.15.71:0/3660044609 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9d200c67a0 con 0x7f9d200b4e70 2023-10-09T06:57:05.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.563+0000 7f9d157fa700 1 -- 172.21.15.71:0/3660044609 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9d180569a0 con 0x7f9d200b4e70 2023-10-09T06:57:05.564 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T06:57:05.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.564+0000 7f9d2539b700 1 -- 172.21.15.71:0/3660044609 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9d04067050 msgr2=0x7f9d04069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:05.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.564+0000 7f9d2539b700 1 --2- 172.21.15.71:0/3660044609 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9d04067050 0x7f9d04069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:05.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.565+0000 7f9d2639d700 1 -- 172.21.15.71:0/3660044609 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9d04067050 msgr2=0x7f9d04069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:05.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.565+0000 7f9d2639d700 1 --2- 172.21.15.71:0/3660044609 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9d04067050 0x7f9d04069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.565+0000 7f9d2639d700 1 -- 172.21.15.71:0/3660044609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d200b4e70 msgr2=0x7f9d20068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:05.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.565+0000 7f9d2639d700 1 --2- 172.21.15.71:0/3660044609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d200b4e70 0x7f9d20068f40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800b610 tx=0x7f9d18018000 comp rx=0 tx=0).stop 2023-10-09T06:57:05.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.566+0000 7f9d2639d700 1 -- 172.21.15.71:0/3660044609 shutdown_connections 2023-10-09T06:57:05.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.566+0000 7f9d2639d700 1 --2- 172.21.15.71:0/3660044609 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9d04067050 0x7f9d04069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.566+0000 7f9d2639d700 1 --2- 172.21.15.71:0/3660044609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d200b4e70 0x7f9d20068f40 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.566+0000 7f9d2639d700 1 --2- 172.21.15.71:0/3660044609 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d200b16d0 0x7f9d200ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.566+0000 7f9d2639d700 1 --2- 172.21.15.71:0/3660044609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d200b33b0 0x7f9d20068a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.566+0000 7f9d2639d700 1 -- 172.21.15.71:0/3660044609 >> 172.21.15.71:0/3660044609 conn(0x7f9d200d10c0 msgr2=0x7f9d20158ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:05.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.566+0000 7f9d2639d700 1 -- 172.21.15.71:0/3660044609 shutdown_connections 2023-10-09T06:57:05.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.566+0000 7f9d2639d700 1 -- 172.21.15.71:0/3660044609 wait complete. 2023-10-09T06:57:05.587 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:57:05.685 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:05.685+0000 7fa5dc499180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:57:05.752 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:05.751+0000 7f4ddd045180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:57:05.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.774+0000 7f55b6f9d700 1 Processor -- start 2023-10-09T06:57:05.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.774+0000 7f55b6f9d700 1 -- start start 2023-10-09T06:57:05.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.775+0000 7f55b6f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55b00b4e70 0x7f55b00ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:05.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.775+0000 7f55b6f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f55b00b16d0 0x7f55b00b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:05.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.775+0000 7f55b6f9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f55b015d240 0x7f55b015d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:05.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.775+0000 7f55b6f9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b00b2080 con 0x7f55b015d240 2023-10-09T06:57:05.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.775+0000 7f55b6f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b00cfb00 con 0x7f55b00b16d0 2023-10-09T06:57:05.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.775+0000 7f55b6f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b00b5c40 con 0x7f55b00b4e70 2023-10-09T06:57:05.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.776+0000 7f55b579a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f55b00b16d0 0x7f55b00b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:05.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.776+0000 7f55b679c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f55b015d240 0x7f55b015d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:05.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.776+0000 7f55b5f9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55b00b4e70 0x7f55b00ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:05.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.776+0000 7f55b579a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f55b00b16d0 0x7f55b00b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:55166/0 (socket says 172.21.15.71:55166) 2023-10-09T06:57:05.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.776+0000 7f55b579a700 1 -- 172.21.15.71:0/4244984499 learned_addr learned my addr 172.21.15.71:0/4244984499 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:05.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.776+0000 7f55b579a700 1 -- 172.21.15.71:0/4244984499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55b00b4e70 msgr2=0x7f55b00ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:05.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.776+0000 7f55b579a700 1 --2- 172.21.15.71:0/4244984499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55b00b4e70 0x7f55b00ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.776+0000 7f55b579a700 1 -- 172.21.15.71:0/4244984499 >> v2:172.21.15.71:3300/0 conn(0x7f55b015d240 msgr2=0x7f55b015d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:05.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.776+0000 7f55b579a700 1 --2- 172.21.15.71:0/4244984499 >> v2:172.21.15.71:3300/0 conn(0x7f55b015d240 0x7f55b015d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.776+0000 7f55b579a700 1 -- 172.21.15.71:0/4244984499 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b00b5f20 con 0x7f55b00b16d0 2023-10-09T06:57:05.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.776+0000 7f55b579a700 1 --2- 172.21.15.71:0/4244984499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55b00b16d0 0x7f55b00b1b40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f55b0089440 tx=0x7f55a0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a12c3c01b980cf72 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:05.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.777+0000 7f55b4f99700 1 -- 172.21.15.71:0/4244984499 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a000b640 con 0x7f55b00b16d0 2023-10-09T06:57:05.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.777+0000 7f55b4f99700 1 -- 172.21.15.71:0/4244984499 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a000b7a0 con 0x7f55b00b16d0 2023-10-09T06:57:05.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.777+0000 7f55b4f99700 1 -- 172.21.15.71:0/4244984499 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a000bb60 con 0x7f55b00b16d0 2023-10-09T06:57:05.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.777+0000 7f55b6f9d700 1 -- 172.21.15.71:0/4244984499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55b00b16d0 msgr2=0x7f55b00b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:05.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.777+0000 7f55b6f9d700 1 --2- 172.21.15.71:0/4244984499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55b00b16d0 0x7f55b00b1b40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f55b0089440 tx=0x7f55a0009250 comp rx=0 tx=0).stop 2023-10-09T06:57:05.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.777+0000 7f55b6f9d700 1 -- 172.21.15.71:0/4244984499 shutdown_connections 2023-10-09T06:57:05.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.777+0000 7f55b6f9d700 1 --2- 172.21.15.71:0/4244984499 >> v2:172.21.15.71:3300/0 conn(0x7f55b015d240 0x7f55b015d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.777+0000 7f55b6f9d700 1 --2- 172.21.15.71:0/4244984499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55b00b4e70 0x7f55b00ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.777+0000 7f55b6f9d700 1 --2- 172.21.15.71:0/4244984499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55b00b16d0 0x7f55b00b1b40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.777+0000 7f55b6f9d700 1 -- 172.21.15.71:0/4244984499 >> 172.21.15.71:0/4244984499 conn(0x7f55b00d10c0 msgr2=0x7f55b00affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:05.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.777+0000 7f55b6f9d700 1 -- 172.21.15.71:0/4244984499 shutdown_connections 2023-10-09T06:57:05.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.777+0000 7f55b6f9d700 1 -- 172.21.15.71:0/4244984499 wait complete. 2023-10-09T06:57:05.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.779+0000 7f55b6f9d700 1 Processor -- start 2023-10-09T06:57:05.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.779+0000 7f55b6f9d700 1 -- start start 2023-10-09T06:57:05.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.780+0000 7f55b6f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b00b16d0 0x7f55b00cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:05.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.780+0000 7f55b6f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55b00b4e70 0x7f55b014c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:05.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.780+0000 7f55b6f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55b015d240 0x7f55b00c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:05.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.780+0000 7f55b6f9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b00c8030 con 0x7f55b00b16d0 2023-10-09T06:57:05.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.780+0000 7f55b6f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b014c790 con 0x7f55b015d240 2023-10-09T06:57:05.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.780+0000 7f55b6f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b016abf0 con 0x7f55b00b4e70 2023-10-09T06:57:05.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.780+0000 7f55b5f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b00b16d0 0x7f55b00cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:05.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.780+0000 7f55b5f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b00b16d0 0x7f55b00cc070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37986/0 (socket says 172.21.15.71:37986) 2023-10-09T06:57:05.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.780+0000 7f55b5f9b700 1 -- 172.21.15.71:0/3284085777 learned_addr learned my addr 172.21.15.71:0/3284085777 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:05.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.780+0000 7f55b679c700 1 --2- 172.21.15.71:0/3284085777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55b015d240 0x7f55b00c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:05.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.780+0000 7f55b579a700 1 --2- 172.21.15.71:0/3284085777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55b00b4e70 0x7f55b014c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:05.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.780+0000 7f55b5f9b700 1 -- 172.21.15.71:0/3284085777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55b00b4e70 msgr2=0x7f55b014c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:05.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.780+0000 7f55b5f9b700 1 --2- 172.21.15.71:0/3284085777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55b00b4e70 0x7f55b014c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.780+0000 7f55b5f9b700 1 -- 172.21.15.71:0/3284085777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55b015d240 msgr2=0x7f55b00c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:05.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.780+0000 7f55b5f9b700 1 --2- 172.21.15.71:0/3284085777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55b015d240 0x7f55b00c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.780+0000 7f55b5f9b700 1 -- 172.21.15.71:0/3284085777 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a00094f0 con 0x7f55b00b16d0 2023-10-09T06:57:05.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.781+0000 7f55b5f9b700 1 --2- 172.21.15.71:0/3284085777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b00b16d0 0x7f55b00cc070 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f55ac00ec80 tx=0x7f55ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:05.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.781+0000 7f55a5ffb700 1 -- 172.21.15.71:0/3284085777 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac00c850 con 0x7f55b00b16d0 2023-10-09T06:57:05.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.781+0000 7f55a5ffb700 1 -- 172.21.15.71:0/3284085777 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ac00c9d0 con 0x7f55b00b16d0 2023-10-09T06:57:05.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.781+0000 7f55a5ffb700 1 -- 172.21.15.71:0/3284085777 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac00cd90 con 0x7f55b00b16d0 2023-10-09T06:57:05.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.781+0000 7f55b6f9d700 1 -- 172.21.15.71:0/3284085777 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b00c8210 con 0x7f55b00b16d0 2023-10-09T06:57:05.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.781+0000 7f55b6f9d700 1 -- 172.21.15.71:0/3284085777 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b00c87d0 con 0x7f55b00b16d0 2023-10-09T06:57:05.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.782+0000 7f55b6f9d700 1 -- 172.21.15.71:0/3284085777 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b00c89f0 con 0x7f55b00b16d0 2023-10-09T06:57:05.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.783+0000 7f55a5ffb700 1 -- 172.21.15.71:0/3284085777 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 23) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f55ac013680 con 0x7f55b00b16d0 2023-10-09T06:57:05.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.784+0000 7f55a5ffb700 1 --2- 172.21.15.71:0/3284085777 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5594067050 0x7f5594069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:05.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.784+0000 7f55a5ffb700 1 -- 172.21.15.71:0/3284085777 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f55ac084c30 con 0x7f55b00b16d0 2023-10-09T06:57:05.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.784+0000 7f55b579a700 1 -- 172.21.15.71:0/3284085777 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5594067050 msgr2=0x7f5594069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:05.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.784+0000 7f55b579a700 1 --2- 172.21.15.71:0/3284085777 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5594067050 0x7f5594069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:05.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.788+0000 7f55a5ffb700 1 -- 172.21.15.71:0/3284085777 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55ac051a40 con 0x7f55b00b16d0 2023-10-09T06:57:05.861 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:05.861+0000 7fa5dc499180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T06:57:05.936 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:05.935+0000 7f4ddd045180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T06:57:05.956 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:05.955+0000 7fa5dc499180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T06:57:05.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.985+0000 7f55b579a700 1 -- 172.21.15.71:0/3284085777 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5594067050 msgr2=0x7f5594069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:05.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.985+0000 7f55b579a700 1 --2- 172.21.15.71:0/3284085777 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5594067050 0x7f5594069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:05.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.988+0000 7f55b6f9d700 1 -- 172.21.15.71:0/3284085777 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f55b015cf60 con 0x7f55b00b16d0 2023-10-09T06:57:05.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.988+0000 7f55a5ffb700 1 -- 172.21.15.71:0/3284085777 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) v1 ==== 104+0+11 (secure 0 0 0) 0x7f55ac055060 con 0x7f55b00b16d0 2023-10-09T06:57:05.989 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-09T06:57:05.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.990+0000 7f55b6f9d700 1 -- 172.21.15.71:0/3284085777 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5594067050 msgr2=0x7f5594069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:05.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.990+0000 7f55b6f9d700 1 --2- 172.21.15.71:0/3284085777 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5594067050 0x7f5594069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.990+0000 7f55b6f9d700 1 -- 172.21.15.71:0/3284085777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b00b16d0 msgr2=0x7f55b00cc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:05.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.990+0000 7f55b6f9d700 1 --2- 172.21.15.71:0/3284085777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b00b16d0 0x7f55b00cc070 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f55ac00ec80 tx=0x7f55ac0091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.991+0000 7f55b6f9d700 1 -- 172.21.15.71:0/3284085777 shutdown_connections 2023-10-09T06:57:05.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.991+0000 7f55b6f9d700 1 --2- 172.21.15.71:0/3284085777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55b015d240 0x7f55b00c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.991+0000 7f55b6f9d700 1 --2- 172.21.15.71:0/3284085777 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5594067050 0x7f5594069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.991+0000 7f55b6f9d700 1 --2- 172.21.15.71:0/3284085777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b00b16d0 0x7f55b00cc070 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.991+0000 7f55b6f9d700 1 --2- 172.21.15.71:0/3284085777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55b00b4e70 0x7f55b014c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:05.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.991+0000 7f55b6f9d700 1 -- 172.21.15.71:0/3284085777 >> 172.21.15.71:0/3284085777 conn(0x7f55b00d10c0 msgr2=0x7f55b0069860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:05.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.991+0000 7f55b6f9d700 1 -- 172.21.15.71:0/3284085777 shutdown_connections 2023-10-09T06:57:05.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:05.991+0000 7f55b6f9d700 1 -- 172.21.15.71:0/3284085777 wait complete. 2023-10-09T06:57:06.010 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:57:06.033 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:06.032+0000 7f4ddd045180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T06:57:06.117 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:06.116+0000 7fa5dc499180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T06:57:06.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.198+0000 7fc3d899d700 1 Processor -- start 2023-10-09T06:57:06.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.198+0000 7fc3d899d700 1 -- start start 2023-10-09T06:57:06.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.199+0000 7fc3d899d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc3d40b4e70 0x7fc3d40ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:06.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.199+0000 7fc3d899d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d40b1b40 0x7fc3d415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:06.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.199+0000 7fc3d899d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3d40cfb00 con 0x7fc3d40b16d0 2023-10-09T06:57:06.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.199+0000 7fc3d899d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d40b5c40 con 0x7fc3d40b4e70 2023-10-09T06:57:06.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.199+0000 7fc3d899d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d40b5f20 con 0x7fc3d40b1b40 2023-10-09T06:57:06.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.200+0000 7fc3d37fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc3d40b4e70 0x7fc3d40ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:06.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.200+0000 7fc3d37fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc3d40b4e70 0x7fc3d40ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37992/0 (socket says 172.21.15.71:37992) 2023-10-09T06:57:06.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.200+0000 7fc3d37fe700 1 -- 172.21.15.71:0/2268860572 learned_addr learned my addr 172.21.15.71:0/2268860572 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:06.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.200+0000 7fc3d3fff700 1 --2- 172.21.15.71:0/2268860572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d40b1b40 0x7fc3d415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:06.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.200+0000 7fc3d37fe700 1 -- 172.21.15.71:0/2268860572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d40b1b40 msgr2=0x7fc3d415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:06.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.200+0000 7fc3d37fe700 1 --2- 172.21.15.71:0/2268860572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d40b1b40 0x7fc3d415d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:06.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.200+0000 7fc3d37fe700 1 -- 172.21.15.71:0/2268860572 >> v1:172.21.15.179:6789/0 conn(0x7fc3d40b16d0 legacy=0x7fc3d415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:06.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.200+0000 7fc3d37fe700 1 -- 172.21.15.71:0/2268860572 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d40b6200 con 0x7fc3d40b4e70 2023-10-09T06:57:06.202 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:06.200+0000 7f4ddd045180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T06:57:06.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.200+0000 7fc3d37fe700 1 --2- 172.21.15.71:0/2268860572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d40b4e70 0x7fc3d40ccff0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40099b0 tx=0x7fc3c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83496a7384b43219 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:06.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.201+0000 7fc3d27fc700 1 -- 172.21.15.71:0/2268860572 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4009ea0 con 0x7fc3d40b4e70 2023-10-09T06:57:06.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.201+0000 7fc3d27fc700 1 -- 172.21.15.71:0/2268860572 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c400b860 con 0x7fc3d40b4e70 2023-10-09T06:57:06.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.201+0000 7fc3d27fc700 1 -- 172.21.15.71:0/2268860572 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c400bc00 con 0x7fc3d40b4e70 2023-10-09T06:57:06.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.201+0000 7fc3d899d700 1 -- 172.21.15.71:0/2268860572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d40b4e70 msgr2=0x7fc3d40ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:06.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.201+0000 7fc3d899d700 1 --2- 172.21.15.71:0/2268860572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d40b4e70 0x7fc3d40ccff0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40099b0 tx=0x7fc3c4009250 comp rx=0 tx=0).stop 2023-10-09T06:57:06.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.201+0000 7fc3d899d700 1 -- 172.21.15.71:0/2268860572 shutdown_connections 2023-10-09T06:57:06.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.201+0000 7fc3d899d700 1 --2- 172.21.15.71:0/2268860572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d40b1b40 0x7fc3d415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:06.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.201+0000 7fc3d899d700 1 --2- 172.21.15.71:0/2268860572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d40b4e70 0x7fc3d40ccff0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:06.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.201+0000 7fc3d899d700 1 -- 172.21.15.71:0/2268860572 >> 172.21.15.71:0/2268860572 conn(0x7fc3d40d10c0 msgr2=0x7fc3d40affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:06.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.201+0000 7fc3d899d700 1 -- 172.21.15.71:0/2268860572 shutdown_connections 2023-10-09T06:57:06.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.201+0000 7fc3d899d700 1 -- 172.21.15.71:0/2268860572 wait complete. 2023-10-09T06:57:06.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.203+0000 7fc3d899d700 1 Processor -- start 2023-10-09T06:57:06.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.203+0000 7fc3d899d700 1 -- start start 2023-10-09T06:57:06.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.204+0000 7fc3d899d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d40b16d0 0x7fc3d4157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:06.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.204+0000 7fc3d899d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d40b1b40 0x7fc3d40c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:06.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.204+0000 7fc3d899d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3d40b4e70 0x7fc3d4068390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:06.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.204+0000 7fc3d899d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d4157c40 con 0x7fc3d40b16d0 2023-10-09T06:57:06.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.204+0000 7fc3d899d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d416a240 con 0x7fc3d40b4e70 2023-10-09T06:57:06.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.204+0000 7fc3d899d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d40ca620 con 0x7fc3d40b1b40 2023-10-09T06:57:06.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.204+0000 7fc3d37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d40b16d0 0x7fc3d4157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:06.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.204+0000 7fc3d37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d40b16d0 0x7fc3d4157700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37996/0 (socket says 172.21.15.71:37996) 2023-10-09T06:57:06.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.204+0000 7fc3d37fe700 1 -- 172.21.15.71:0/2169939334 learned_addr learned my addr 172.21.15.71:0/2169939334 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:06.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.204+0000 7fc3d3fff700 1 --2- 172.21.15.71:0/2169939334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3d40b4e70 0x7fc3d4068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:06.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.204+0000 7fc3d2ffd700 1 --2- 172.21.15.71:0/2169939334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d40b1b40 0x7fc3d40c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:06.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.204+0000 7fc3d37fe700 1 -- 172.21.15.71:0/2169939334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d40b1b40 msgr2=0x7fc3d40c9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:06.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.204+0000 7fc3d37fe700 1 --2- 172.21.15.71:0/2169939334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d40b1b40 0x7fc3d40c9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:06.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.204+0000 7fc3d37fe700 1 -- 172.21.15.71:0/2169939334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3d40b4e70 msgr2=0x7fc3d4068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:06.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.204+0000 7fc3d37fe700 1 --2- 172.21.15.71:0/2169939334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3d40b4e70 0x7fc3d4068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:06.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.204+0000 7fc3d37fe700 1 -- 172.21.15.71:0/2169939334 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c40094f0 con 0x7fc3d40b16d0 2023-10-09T06:57:06.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.205+0000 7fc3d37fe700 1 --2- 172.21.15.71:0/2169939334 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d40b16d0 0x7fc3d4157700 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4070dd0 tx=0x7fc3c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:06.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.205+0000 7fc3bb7fe700 1 -- 172.21.15.71:0/2169939334 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4000d10 con 0x7fc3d40b16d0 2023-10-09T06:57:06.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.205+0000 7fc3bb7fe700 1 -- 172.21.15.71:0/2169939334 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c400bbe0 con 0x7fc3d40b16d0 2023-10-09T06:57:06.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.205+0000 7fc3d899d700 1 -- 172.21.15.71:0/2169939334 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d40ca900 con 0x7fc3d40b16d0 2023-10-09T06:57:06.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.205+0000 7fc3bb7fe700 1 -- 172.21.15.71:0/2169939334 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4011670 con 0x7fc3d40b16d0 2023-10-09T06:57:06.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.205+0000 7fc3d899d700 1 -- 172.21.15.71:0/2169939334 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d4169ed0 con 0x7fc3d40b16d0 2023-10-09T06:57:06.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.206+0000 7fc3d899d700 1 -- 172.21.15.71:0/2169939334 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d4088990 con 0x7fc3d40b16d0 2023-10-09T06:57:06.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.207+0000 7fc3bb7fe700 1 -- 172.21.15.71:0/2169939334 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 23) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fc3c4011aa0 con 0x7fc3d40b16d0 2023-10-09T06:57:06.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.208+0000 7fc3bb7fe700 1 --2- 172.21.15.71:0/2169939334 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc3c0067050 0x7fc3c0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:06.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.208+0000 7fc3bb7fe700 1 -- 172.21.15.71:0/2169939334 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fc3c40861c0 con 0x7fc3d40b16d0 2023-10-09T06:57:06.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.208+0000 7fc3d2ffd700 1 -- 172.21.15.71:0/2169939334 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc3c0067050 msgr2=0x7fc3c0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:06.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.208+0000 7fc3d2ffd700 1 --2- 172.21.15.71:0/2169939334 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc3c0067050 0x7fc3c0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:06.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.216+0000 7fc3bb7fe700 1 -- 172.21.15.71:0/2169939334 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3c4053070 con 0x7fc3d40b16d0 2023-10-09T06:57:06.217 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:06.217+0000 7fa5dc499180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T06:57:06.308 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:06.307+0000 7f4ddd045180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T06:57:06.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.409+0000 7fc3d2ffd700 1 -- 172.21.15.71:0/2169939334 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc3c0067050 msgr2=0x7fc3c0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:06.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.409+0000 7fc3d2ffd700 1 --2- 172.21.15.71:0/2169939334 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc3c0067050 0x7fc3c0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:06.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.412+0000 7fc3d899d700 1 -- 172.21.15.71:0/2169939334 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc3d404bb80 con 0x7fc3d40b16d0 2023-10-09T06:57:06.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.413+0000 7fc3bb7fe700 1 -- 172.21.15.71:0/2169939334 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc3c4056690 con 0x7fc3d40b16d0 2023-10-09T06:57:06.414 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-09T06:57:06.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.415+0000 7fc3d899d700 1 -- 172.21.15.71:0/2169939334 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc3c0067050 msgr2=0x7fc3c0069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:06.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.415+0000 7fc3d899d700 1 --2- 172.21.15.71:0/2169939334 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc3c0067050 0x7fc3c0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:06.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.416+0000 7fc3d899d700 1 -- 172.21.15.71:0/2169939334 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d40b16d0 msgr2=0x7fc3d4157700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:06.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.416+0000 7fc3d899d700 1 --2- 172.21.15.71:0/2169939334 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d40b16d0 0x7fc3d4157700 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4070dd0 tx=0x7fc3c4017000 comp rx=0 tx=0).stop 2023-10-09T06:57:06.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.416+0000 7fc3d899d700 1 -- 172.21.15.71:0/2169939334 shutdown_connections 2023-10-09T06:57:06.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.416+0000 7fc3d899d700 1 --2- 172.21.15.71:0/2169939334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3d40b4e70 0x7fc3d4068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:06.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.416+0000 7fc3d899d700 1 --2- 172.21.15.71:0/2169939334 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc3c0067050 0x7fc3c0069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:06.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.416+0000 7fc3d899d700 1 --2- 172.21.15.71:0/2169939334 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d40b16d0 0x7fc3d4157700 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:06.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.416+0000 7fc3d899d700 1 --2- 172.21.15.71:0/2169939334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d40b1b40 0x7fc3d40c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:06.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.416+0000 7fc3d899d700 1 -- 172.21.15.71:0/2169939334 >> 172.21.15.71:0/2169939334 conn(0x7fc3d40d10c0 msgr2=0x7fc3d415ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:06.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.416+0000 7fc3d899d700 1 -- 172.21.15.71:0/2169939334 shutdown_connections 2023-10-09T06:57:06.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.416+0000 7fc3d899d700 1 -- 172.21.15.71:0/2169939334 wait complete. 2023-10-09T06:57:06.435 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:57:06.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.660+0000 7f8c78f9d700 1 Processor -- start 2023-10-09T06:57:06.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.661+0000 7f8c78f9d700 1 -- start start 2023-10-09T06:57:06.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.662+0000 7f8c78f9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8c741597f0 0x7f8c740b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:06.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.662+0000 7f8c78f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8c7415d230 0x7f8c7415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:06.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.662+0000 7f8c78f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7415db70 con 0x7f8c74159420 2023-10-09T06:57:06.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.662+0000 7f8c78f9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c740b11d0 con 0x7f8c741597f0 2023-10-09T06:57:06.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.662+0000 7f8c78f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c740b14b0 con 0x7f8c7415d230 2023-10-09T06:57:06.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.662+0000 7f8c72ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8c741597f0 0x7f8c740b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:06.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.662+0000 7f8c72ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8c741597f0 0x7f8c740b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38008/0 (socket says 172.21.15.71:38008) 2023-10-09T06:57:06.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.662+0000 7f8c72ffd700 1 -- 172.21.15.71:0/3402240564 learned_addr learned my addr 172.21.15.71:0/3402240564 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:06.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.662+0000 7f8c73fff700 1 --2- 172.21.15.71:0/3402240564 >> v2:172.21.15.179:3300/0 conn(0x7f8c7415d230 0x7f8c7415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:06.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.663+0000 7f8c72ffd700 1 -- 172.21.15.71:0/3402240564 >> v2:172.21.15.179:3300/0 conn(0x7f8c7415d230 msgr2=0x7f8c7415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:06.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.663+0000 7f8c72ffd700 1 --2- 172.21.15.71:0/3402240564 >> v2:172.21.15.179:3300/0 conn(0x7f8c7415d230 0x7f8c7415d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:06.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.663+0000 7f8c72ffd700 1 -- 172.21.15.71:0/3402240564 >> v1:172.21.15.179:6789/0 conn(0x7f8c74159420 legacy=0x7f8c740b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:06.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.663+0000 7f8c72ffd700 1 -- 172.21.15.71:0/3402240564 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c740b1790 con 0x7f8c741597f0 2023-10-09T06:57:06.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.663+0000 7f8c72ffd700 1 --2- 172.21.15.71:0/3402240564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c741597f0 0x7f8c740b2270 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8c7415d170 tx=0x7f8c68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19fd37381673fa7f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.663+0000 7f8c727fc700 1 -- 172.21.15.71:0/3402240564 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800b860 con 0x7f8c741597f0 2023-10-09T06:57:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.663+0000 7f8c727fc700 1 -- 172.21.15.71:0/3402240564 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6800b9c0 con 0x7f8c741597f0 2023-10-09T06:57:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.663+0000 7f8c727fc700 1 -- 172.21.15.71:0/3402240564 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800bd60 con 0x7f8c741597f0 2023-10-09T06:57:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.664+0000 7f8c78f9d700 1 -- 172.21.15.71:0/3402240564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c741597f0 msgr2=0x7f8c740b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.664+0000 7f8c78f9d700 1 --2- 172.21.15.71:0/3402240564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c741597f0 0x7f8c740b2270 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8c7415d170 tx=0x7f8c68009250 comp rx=0 tx=0).stop 2023-10-09T06:57:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.664+0000 7f8c78f9d700 1 -- 172.21.15.71:0/3402240564 shutdown_connections 2023-10-09T06:57:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.664+0000 7f8c78f9d700 1 --2- 172.21.15.71:0/3402240564 >> v2:172.21.15.179:3300/0 conn(0x7f8c7415d230 0x7f8c7415d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.664+0000 7f8c78f9d700 1 --2- 172.21.15.71:0/3402240564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c741597f0 0x7f8c740b2270 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.664+0000 7f8c78f9d700 1 -- 172.21.15.71:0/3402240564 >> 172.21.15.71:0/3402240564 conn(0x7f8c740d0660 msgr2=0x7f8c740d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.664+0000 7f8c78f9d700 1 -- 172.21.15.71:0/3402240564 shutdown_connections 2023-10-09T06:57:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.664+0000 7f8c78f9d700 1 -- 172.21.15.71:0/3402240564 wait complete. 2023-10-09T06:57:06.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.665+0000 7f8c78f9d700 1 Processor -- start 2023-10-09T06:57:06.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.665+0000 7f8c78f9d700 1 -- start start 2023-10-09T06:57:06.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.666+0000 7f8c78f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c74159420 0x7f8c74148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:06.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.666+0000 7f8c78f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c741597f0 0x7f8c740c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:06.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.666+0000 7f8c78f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c7415d230 0x7f8c740b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:06.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.666+0000 7f8c78f9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7415d010 con 0x7f8c7415d230 2023-10-09T06:57:06.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.666+0000 7f8c78f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c74148640 con 0x7f8c74159420 2023-10-09T06:57:06.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.666+0000 7f8c78f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7415c400 con 0x7f8c741597f0 2023-10-09T06:57:06.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.666+0000 7f8c73fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c7415d230 0x7f8c740b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:06.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.667+0000 7f8c73fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c7415d230 0x7f8c740b4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38014/0 (socket says 172.21.15.71:38014) 2023-10-09T06:57:06.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.667+0000 7f8c73fff700 1 -- 172.21.15.71:0/4273875462 learned_addr learned my addr 172.21.15.71:0/4273875462 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:06.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.667+0000 7f8c72ffd700 1 --2- 172.21.15.71:0/4273875462 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c741597f0 0x7f8c740c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:06.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.667+0000 7f8c737fe700 1 --2- 172.21.15.71:0/4273875462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c74159420 0x7f8c74148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:06.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.667+0000 7f8c73fff700 1 -- 172.21.15.71:0/4273875462 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c741597f0 msgr2=0x7f8c740c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:06.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.667+0000 7f8c73fff700 1 --2- 172.21.15.71:0/4273875462 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c741597f0 0x7f8c740c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:06.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.667+0000 7f8c73fff700 1 -- 172.21.15.71:0/4273875462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c74159420 msgr2=0x7f8c74148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:06.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.667+0000 7f8c73fff700 1 --2- 172.21.15.71:0/4273875462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c74159420 0x7f8c74148100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:06.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.667+0000 7f8c73fff700 1 -- 172.21.15.71:0/4273875462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c680094f0 con 0x7f8c7415d230 2023-10-09T06:57:06.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.667+0000 7f8c73fff700 1 --2- 172.21.15.71:0/4273875462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c7415d230 0x7f8c740b4e20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c007f20 tx=0x7f8c6c009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:06.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.667+0000 7f8c5b7fe700 1 -- 172.21.15.71:0/4273875462 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c00eb90 con 0x7f8c7415d230 2023-10-09T06:57:06.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.668+0000 7f8c5b7fe700 1 -- 172.21.15.71:0/4273875462 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6c00ed10 con 0x7f8c7415d230 2023-10-09T06:57:06.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.668+0000 7f8c5b7fe700 1 -- 172.21.15.71:0/4273875462 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c014670 con 0x7f8c7415d230 2023-10-09T06:57:06.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.668+0000 7f8c78f9d700 1 -- 172.21.15.71:0/4273875462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7415c6e0 con 0x7f8c7415d230 2023-10-09T06:57:06.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.668+0000 7f8c78f9d700 1 -- 172.21.15.71:0/4273875462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7415cca0 con 0x7f8c7415d230 2023-10-09T06:57:06.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.669+0000 7f8c78f9d700 1 -- 172.21.15.71:0/4273875462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7404c3c0 con 0x7f8c7415d230 2023-10-09T06:57:06.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.670+0000 7f8c5b7fe700 1 -- 172.21.15.71:0/4273875462 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 23) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f8c6c0149e0 con 0x7f8c7415d230 2023-10-09T06:57:06.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.671+0000 7f8c5b7fe700 1 --2- 172.21.15.71:0/4273875462 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8c60067050 0x7f8c60069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:06.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.671+0000 7f8c5b7fe700 1 -- 172.21.15.71:0/4273875462 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f8c6c084f60 con 0x7f8c7415d230 2023-10-09T06:57:06.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.671+0000 7f8c737fe700 1 -- 172.21.15.71:0/4273875462 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8c60067050 msgr2=0x7f8c60069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:06.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.671+0000 7f8c737fe700 1 --2- 172.21.15.71:0/4273875462 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8c60067050 0x7f8c60069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:06.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.674+0000 7f8c5b7fe700 1 -- 172.21.15.71:0/4273875462 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c6c051e10 con 0x7f8c7415d230 2023-10-09T06:57:06.696 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:06.696+0000 7fa5dc499180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T06:57:06.789 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:06.788+0000 7fa5dc499180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T06:57:06.808 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:06.807+0000 7f4ddd045180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T06:57:06.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.872+0000 7f8c737fe700 1 -- 172.21.15.71:0/4273875462 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8c60067050 msgr2=0x7f8c60069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:06.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.872+0000 7f8c737fe700 1 --2- 172.21.15.71:0/4273875462 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8c60067050 0x7f8c60069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:06.877 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:06.877+0000 7fa5dc499180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T06:57:06.903 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:06.903+0000 7f4ddd045180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T06:57:06.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.913+0000 7f8c78f9d700 1 -- 172.21.15.71:0/4273875462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c740b1a70 con 0x7f8c7415d230 2023-10-09T06:57:06.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.914+0000 7f8c5b7fe700 1 -- 172.21.15.71:0/4273875462 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f8c6c055430 con 0x7f8c7415d230 2023-10-09T06:57:06.915 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:06.915 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5153,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3904949177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3904949177},{"type":"v1","addr":"172.21.15.179:6837","nonce":3904949177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5617,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2761847814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2761847814},{"type":"v1","addr":"172.21.15.71:6833","nonce":2761847814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5632,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3251743580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3251743580},{"type":"v1","addr":"172.21.15.179:6836","nonce":3251743580}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:55:06.387910+0000","modified":"2023-10-09T06:55:09.941744+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5727},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5727":{"gid":5727,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/4151615916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":4151615916},{"type":"v1","addr":"172.21.15.71:6835","nonce":4151615916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T06:57:06.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.916+0000 7f8c78f9d700 1 -- 172.21.15.71:0/4273875462 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8c60067050 msgr2=0x7f8c60069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:06.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.916+0000 7f8c78f9d700 1 --2- 172.21.15.71:0/4273875462 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8c60067050 0x7f8c60069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:06.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.917+0000 7f8c78f9d700 1 -- 172.21.15.71:0/4273875462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c7415d230 msgr2=0x7f8c740b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:06.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.917+0000 7f8c78f9d700 1 --2- 172.21.15.71:0/4273875462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c7415d230 0x7f8c740b4e20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c007f20 tx=0x7f8c6c009860 comp rx=0 tx=0).stop 2023-10-09T06:57:06.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.917+0000 7f8c78f9d700 1 -- 172.21.15.71:0/4273875462 shutdown_connections 2023-10-09T06:57:06.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.917+0000 7f8c78f9d700 1 --2- 172.21.15.71:0/4273875462 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8c60067050 0x7f8c60069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:06.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.917+0000 7f8c78f9d700 1 --2- 172.21.15.71:0/4273875462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c7415d230 0x7f8c740b4e20 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:06.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.917+0000 7f8c78f9d700 1 --2- 172.21.15.71:0/4273875462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c74159420 0x7f8c74148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:06.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.917+0000 7f8c78f9d700 1 --2- 172.21.15.71:0/4273875462 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c741597f0 0x7f8c740c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:06.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.917+0000 7f8c78f9d700 1 -- 172.21.15.71:0/4273875462 >> 172.21.15.71:0/4273875462 conn(0x7f8c740d0660 msgr2=0x7f8c74069830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:06.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.917+0000 7f8c78f9d700 1 -- 172.21.15.71:0/4273875462 shutdown_connections 2023-10-09T06:57:06.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:06.917+0000 7f8c78f9d700 1 -- 172.21.15.71:0/4273875462 wait complete. 2023-10-09T06:57:06.919 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 24 2023-10-09T06:57:06.936 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:57:07.009 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:07.008+0000 7f4ddd045180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T06:57:07.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.126+0000 7fe25499d700 1 Processor -- start 2023-10-09T06:57:07.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.126+0000 7fe25499d700 1 -- start start 2023-10-09T06:57:07.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.128+0000 7fe25499d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe2501593b0 0x7fe250159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:07.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.128+0000 7fe25499d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe2500ceaa0 0x7fe2500b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:07.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.128+0000 7fe25499d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2500b6570 con 0x7fe2500b1740 2023-10-09T06:57:07.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.128+0000 7fe25499d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2500cfe20 con 0x7fe2501593b0 2023-10-09T06:57:07.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.128+0000 7fe25499d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2500cf210 con 0x7fe2500ceaa0 2023-10-09T06:57:07.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.128+0000 7fe24f7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe2501593b0 0x7fe250159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:07.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.128+0000 7fe24ffff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe2500b1740 0x7fe2500b1b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35368/0 (socket says 172.21.15.71:35368) 2023-10-09T06:57:07.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.128+0000 7fe24f7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe2501593b0 0x7fe250159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38018/0 (socket says 172.21.15.71:38018) 2023-10-09T06:57:07.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.128+0000 7fe24ffff700 1 -- 172.21.15.71:0/1264303434 learned_addr learned my addr 172.21.15.71:0/1264303434 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:07.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.128+0000 7fe24effd700 1 --2- 172.21.15.71:0/1264303434 >> v2:172.21.15.179:3300/0 conn(0x7fe2500ceaa0 0x7fe2500b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:07.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.128+0000 7fe24f7fe700 1 -- 172.21.15.71:0/1264303434 >> v2:172.21.15.179:3300/0 conn(0x7fe2500ceaa0 msgr2=0x7fe2500b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:07.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.128+0000 7fe24f7fe700 1 --2- 172.21.15.71:0/1264303434 >> v2:172.21.15.179:3300/0 conn(0x7fe2500ceaa0 0x7fe2500b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:07.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.128+0000 7fe24f7fe700 1 -- 172.21.15.71:0/1264303434 >> v1:172.21.15.71:6789/0 conn(0x7fe2500b1740 legacy=0x7fe2500b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:07.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.128+0000 7fe24f7fe700 1 -- 172.21.15.71:0/1264303434 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2500cf4f0 con 0x7fe2501593b0 2023-10-09T06:57:07.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.128+0000 7fe24e7fc700 1 -- 172.21.15.71:0/1264303434 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335526707 0 0) 0x7fe248001490 con 0x7fe2500b1740 2023-10-09T06:57:07.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.129+0000 7fe24f7fe700 1 --2- 172.21.15.71:0/1264303434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2501593b0 0x7fe250159780 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe2500b2d90 tx=0x7fe2400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891824c6fbd1a0e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:07.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.129+0000 7fe24e7fc700 1 -- 172.21.15.71:0/1264303434 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24000b6b0 con 0x7fe2501593b0 2023-10-09T06:57:07.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.129+0000 7fe24e7fc700 1 -- 172.21.15.71:0/1264303434 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24000b810 con 0x7fe2501593b0 2023-10-09T06:57:07.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.129+0000 7fe24e7fc700 1 -- 172.21.15.71:0/1264303434 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24000bbb0 con 0x7fe2501593b0 2023-10-09T06:57:07.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.130+0000 7fe25499d700 1 -- 172.21.15.71:0/1264303434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2501593b0 msgr2=0x7fe250159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:07.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.130+0000 7fe25499d700 1 --2- 172.21.15.71:0/1264303434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2501593b0 0x7fe250159780 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe2500b2d90 tx=0x7fe2400091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:07.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.130+0000 7fe25499d700 1 -- 172.21.15.71:0/1264303434 shutdown_connections 2023-10-09T06:57:07.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.130+0000 7fe25499d700 1 --2- 172.21.15.71:0/1264303434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2501593b0 0x7fe250159780 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:07.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.130+0000 7fe25499d700 1 --2- 172.21.15.71:0/1264303434 >> v2:172.21.15.179:3300/0 conn(0x7fe2500ceaa0 0x7fe2500b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:07.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.130+0000 7fe25499d700 1 -- 172.21.15.71:0/1264303434 >> 172.21.15.71:0/1264303434 conn(0x7fe2500d1130 msgr2=0x7fe2500b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:07.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.130+0000 7fe25499d700 1 -- 172.21.15.71:0/1264303434 shutdown_connections 2023-10-09T06:57:07.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.130+0000 7fe25499d700 1 -- 172.21.15.71:0/1264303434 wait complete. 2023-10-09T06:57:07.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.131+0000 7fe25499d700 1 Processor -- start 2023-10-09T06:57:07.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.131+0000 7fe25499d700 1 -- start start 2023-10-09T06:57:07.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.132+0000 7fe25499d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2500b1740 0x7fe25015bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:07.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.132+0000 7fe25499d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2500ceaa0 0x7fe250155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:07.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.132+0000 7fe25499d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2501593b0 0x7fe25016d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:07.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.132+0000 7fe25499d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25015c740 con 0x7fe2500b1740 2023-10-09T06:57:07.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.132+0000 7fe25499d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2500c5ed0 con 0x7fe2500ceaa0 2023-10-09T06:57:07.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.132+0000 7fe25499d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2500c55a0 con 0x7fe2501593b0 2023-10-09T06:57:07.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.132+0000 7fe24f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2500b1740 0x7fe25015bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:07.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.133+0000 7fe24f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2500b1740 0x7fe25015bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38030/0 (socket says 172.21.15.71:38030) 2023-10-09T06:57:07.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.133+0000 7fe24f7fe700 1 -- 172.21.15.71:0/618901325 learned_addr learned my addr 172.21.15.71:0/618901325 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:07.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.133+0000 7fe24effd700 1 --2- 172.21.15.71:0/618901325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2500ceaa0 0x7fe250155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:07.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.133+0000 7fe24ffff700 1 --2- 172.21.15.71:0/618901325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2501593b0 0x7fe25016d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:07.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.133+0000 7fe24f7fe700 1 -- 172.21.15.71:0/618901325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2501593b0 msgr2=0x7fe25016d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:07.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.133+0000 7fe24f7fe700 1 --2- 172.21.15.71:0/618901325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2501593b0 0x7fe25016d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:07.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.133+0000 7fe24f7fe700 1 -- 172.21.15.71:0/618901325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2500ceaa0 msgr2=0x7fe250155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:07.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.133+0000 7fe24f7fe700 1 --2- 172.21.15.71:0/618901325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2500ceaa0 0x7fe250155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:07.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.133+0000 7fe24f7fe700 1 -- 172.21.15.71:0/618901325 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe240009420 con 0x7fe2500b1740 2023-10-09T06:57:07.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.133+0000 7fe24ffff700 1 --2- 172.21.15.71:0/618901325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2501593b0 0x7fe25016d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:57:07.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.133+0000 7fe24f7fe700 1 --2- 172.21.15.71:0/618901325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2500b1740 0x7fe25015bef0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe2400097b0 tx=0x7fe240017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:07.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.133+0000 7fe2377fe700 1 -- 172.21.15.71:0/618901325 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24000bb90 con 0x7fe2500b1740 2023-10-09T06:57:07.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.133+0000 7fe2377fe700 1 -- 172.21.15.71:0/618901325 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe240011420 con 0x7fe2500b1740 2023-10-09T06:57:07.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.133+0000 7fe2377fe700 1 -- 172.21.15.71:0/618901325 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2400117e0 con 0x7fe2500b1740 2023-10-09T06:57:07.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.133+0000 7fe25499d700 1 -- 172.21.15.71:0/618901325 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2500c5880 con 0x7fe2500b1740 2023-10-09T06:57:07.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.134+0000 7fe25499d700 1 -- 172.21.15.71:0/618901325 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25015c430 con 0x7fe2500b1740 2023-10-09T06:57:07.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.135+0000 7fe25499d700 1 -- 172.21.15.71:0/618901325 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe250158c40 con 0x7fe2500b1740 2023-10-09T06:57:07.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.135+0000 7fe2377fe700 1 -- 172.21.15.71:0/618901325 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 23) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fe240011bd0 con 0x7fe2500b1740 2023-10-09T06:57:07.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.136+0000 7fe2377fe700 1 --2- 172.21.15.71:0/618901325 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe23c067050 0x7fe23c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:07.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.136+0000 7fe2377fe700 1 -- 172.21.15.71:0/618901325 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6441+0+0 (secure 0 0 0) 0x7fe240086430 con 0x7fe2500b1740 2023-10-09T06:57:07.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.136+0000 7fe24effd700 1 -- 172.21.15.71:0/618901325 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe23c067050 msgr2=0x7fe23c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:07.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.136+0000 7fe24effd700 1 --2- 172.21.15.71:0/618901325 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe23c067050 0x7fe23c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:07.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.140+0000 7fe2377fe700 1 -- 172.21.15.71:0/618901325 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2400532b0 con 0x7fe2500b1740 2023-10-09T06:57:07.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.337+0000 7fe24effd700 1 -- 172.21.15.71:0/618901325 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe23c067050 msgr2=0x7fe23c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:07.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.337+0000 7fe24effd700 1 --2- 172.21.15.71:0/618901325 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe23c067050 0x7fe23c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:07.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.353+0000 7fe25499d700 1 -- 172.21.15.71:0/618901325 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe25004c3c0 con 0x7fe2500b1740 2023-10-09T06:57:07.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.354+0000 7fe2377fe700 1 -- 172.21.15.71:0/618901325 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16478 (secure 0 0 0) 0x7fe2400568d0 con 0x7fe2500b1740 2023-10-09T06:57:07.355 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:07.355 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":66,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:57:06.930551+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:55:04.058830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T06:55:05.370158+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.32","mappings":[{"from":0,"to":5}]},{"pgid":"7.37","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:0/2392477914":"2023-10-10T06:55:26.774306+0000","172.21.15.179:0/1885947609":"2023-10-10T06:55:26.774306+0000","172.21.15.179:6833/85452":"2023-10-10T06:55:26.774306+0000","172.21.15.179:0/1151339543":"2023-10-10T06:55:26.774306+0000","172.21.15.179:6832/85452":"2023-10-10T06:55:26.774306+0000","172.21.15.179:0/3804390923":"2023-10-10T06:55:26.774306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:57:07.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.357+0000 7fe25499d700 1 -- 172.21.15.71:0/618901325 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe23c067050 msgr2=0x7fe23c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:07.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.357+0000 7fe25499d700 1 --2- 172.21.15.71:0/618901325 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe23c067050 0x7fe23c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:07.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.357+0000 7fe25499d700 1 -- 172.21.15.71:0/618901325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2500b1740 msgr2=0x7fe25015bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:07.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.357+0000 7fe25499d700 1 --2- 172.21.15.71:0/618901325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2500b1740 0x7fe25015bef0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe2400097b0 tx=0x7fe240017000 comp rx=0 tx=0).stop 2023-10-09T06:57:07.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.357+0000 7fe25499d700 1 -- 172.21.15.71:0/618901325 shutdown_connections 2023-10-09T06:57:07.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.357+0000 7fe25499d700 1 --2- 172.21.15.71:0/618901325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2501593b0 0x7fe25016d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:07.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.357+0000 7fe25499d700 1 --2- 172.21.15.71:0/618901325 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe23c067050 0x7fe23c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:07.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.357+0000 7fe25499d700 1 --2- 172.21.15.71:0/618901325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2500b1740 0x7fe25015bef0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:07.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.357+0000 7fe25499d700 1 --2- 172.21.15.71:0/618901325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2500ceaa0 0x7fe250155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:07.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.357+0000 7fe25499d700 1 -- 172.21.15.71:0/618901325 >> 172.21.15.71:0/618901325 conn(0x7fe2500d1130 msgr2=0x7fe2500cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:07.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.357+0000 7fe25499d700 1 -- 172.21.15.71:0/618901325 shutdown_connections 2023-10-09T06:57:07.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.357+0000 7fe25499d700 1 -- 172.21.15.71:0/618901325 wait complete. 2023-10-09T06:57:07.376 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T06:57:07.376 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:57:07.520 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:07.520+0000 7fa5dc499180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T06:57:07.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.580+0000 7ff555b9d700 1 Processor -- start 2023-10-09T06:57:07.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.581+0000 7ff555b9d700 1 -- start start 2023-10-09T06:57:07.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.583+0000 7ff555b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff55015daa0 0x7ff55006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:07.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.583+0000 7ff555b9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff5500696c0 0x7ff55006ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:07.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.583+0000 7ff555b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff55006e8c0 con 0x7ff55015de70 2023-10-09T06:57:07.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.583+0000 7ff555b9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5500ca740 con 0x7ff5500696c0 2023-10-09T06:57:07.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.583+0000 7ff555b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55006e5e0 con 0x7ff55015daa0 2023-10-09T06:57:07.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.583+0000 7ff554b9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff55015daa0 0x7ff55006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:07.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.583+0000 7ff54ffff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7ff55015de70 0x7ff5500c7110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:56464/0 (socket says 172.21.15.71:56464) 2023-10-09T06:57:07.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.583+0000 7ff54ffff700 1 -- 172.21.15.71:0/1433392713 learned_addr learned my addr 172.21.15.71:0/1433392713 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:07.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.583+0000 7ff55539c700 1 --2- 172.21.15.71:0/1433392713 >> v2:172.21.15.71:3300/0 conn(0x7ff5500696c0 0x7ff55006ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:07.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.584+0000 7ff554b9b700 1 -- 172.21.15.71:0/1433392713 >> v2:172.21.15.71:3300/0 conn(0x7ff5500696c0 msgr2=0x7ff55006ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:07.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.584+0000 7ff554b9b700 1 --2- 172.21.15.71:0/1433392713 >> v2:172.21.15.71:3300/0 conn(0x7ff5500696c0 0x7ff55006ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:07.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.584+0000 7ff554b9b700 1 -- 172.21.15.71:0/1433392713 >> v1:172.21.15.179:6789/0 conn(0x7ff55015de70 legacy=0x7ff5500c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:07.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.584+0000 7ff554b9b700 1 -- 172.21.15.71:0/1433392713 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5500ca0f0 con 0x7ff55015daa0 2023-10-09T06:57:07.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.584+0000 7ff54f7fe700 1 -- 172.21.15.71:0/1433392713 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165898502 0 0) 0x7ff55006e8c0 con 0x7ff55015de70 2023-10-09T06:57:07.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.584+0000 7ff554b9b700 1 --2- 172.21.15.71:0/1433392713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff55015daa0 0x7ff55006e000 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff5480098e0 tx=0x7ff5480091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=156f39ab1ca98411 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:07.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.584+0000 7ff54f7fe700 1 -- 172.21.15.71:0/1433392713 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548009e80 con 0x7ff55015daa0 2023-10-09T06:57:07.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.584+0000 7ff54f7fe700 1 -- 172.21.15.71:0/1433392713 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54800b860 con 0x7ff55015daa0 2023-10-09T06:57:07.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.584+0000 7ff54f7fe700 1 -- 172.21.15.71:0/1433392713 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54800bbe0 con 0x7ff55015daa0 2023-10-09T06:57:07.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.585+0000 7ff555b9d700 1 -- 172.21.15.71:0/1433392713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff55015daa0 msgr2=0x7ff55006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:07.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.585+0000 7ff555b9d700 1 --2- 172.21.15.71:0/1433392713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff55015daa0 0x7ff55006e000 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff5480098e0 tx=0x7ff5480091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:07.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.585+0000 7ff555b9d700 1 -- 172.21.15.71:0/1433392713 shutdown_connections 2023-10-09T06:57:07.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.585+0000 7ff555b9d700 1 --2- 172.21.15.71:0/1433392713 >> v2:172.21.15.71:3300/0 conn(0x7ff5500696c0 0x7ff55006ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:07.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.585+0000 7ff555b9d700 1 --2- 172.21.15.71:0/1433392713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff55015daa0 0x7ff55006e000 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:07.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.585+0000 7ff555b9d700 1 -- 172.21.15.71:0/1433392713 >> 172.21.15.71:0/1433392713 conn(0x7ff5500cc1f0 msgr2=0x7ff5500cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.586+0000 7ff555b9d700 1 -- 172.21.15.71:0/1433392713 shutdown_connections 2023-10-09T06:57:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.586+0000 7ff555b9d700 1 -- 172.21.15.71:0/1433392713 wait complete. 2023-10-09T06:57:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.588+0000 7ff555b9d700 1 Processor -- start 2023-10-09T06:57:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.588+0000 7ff555b9d700 1 -- start start 2023-10-09T06:57:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.590+0000 7ff555b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5500696c0 0x7ff55007e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.590+0000 7ff555b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff55015daa0 0x7ff55014a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.590+0000 7ff555b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff55015de70 0x7ff55014a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.590+0000 7ff555b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff550148a80 con 0x7ff5500696c0 2023-10-09T06:57:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.590+0000 7ff555b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff550148190 con 0x7ff55015de70 2023-10-09T06:57:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.590+0000 7ff555b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff550148430 con 0x7ff55015daa0 2023-10-09T06:57:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.590+0000 7ff54ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff55015daa0 0x7ff55014a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.590+0000 7ff54ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff55015daa0 0x7ff55014a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:35916/0 (socket says 172.21.15.71:35916) 2023-10-09T06:57:07.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.590+0000 7ff54ffff700 1 -- 172.21.15.71:0/2226595241 learned_addr learned my addr 172.21.15.71:0/2226595241 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:07.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.590+0000 7ff554b9b700 1 --2- 172.21.15.71:0/2226595241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5500696c0 0x7ff55007e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:07.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.590+0000 7ff55539c700 1 --2- 172.21.15.71:0/2226595241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff55015de70 0x7ff55014a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:07.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.591+0000 7ff54ffff700 1 -- 172.21.15.71:0/2226595241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff55015de70 msgr2=0x7ff55014a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:07.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.591+0000 7ff54ffff700 1 --2- 172.21.15.71:0/2226595241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff55015de70 0x7ff55014a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:07.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.591+0000 7ff54ffff700 1 -- 172.21.15.71:0/2226595241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5500696c0 msgr2=0x7ff55007e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:07.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.591+0000 7ff54ffff700 1 --2- 172.21.15.71:0/2226595241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5500696c0 0x7ff55007e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:07.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.591+0000 7ff54ffff700 1 -- 172.21.15.71:0/2226595241 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff548009420 con 0x7ff55015daa0 2023-10-09T06:57:07.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.591+0000 7ff54ffff700 1 --2- 172.21.15.71:0/2226595241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff55015daa0 0x7ff55014a150 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff53800cd80 tx=0x7ff538001aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:07.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.591+0000 7ff54cff9700 1 -- 172.21.15.71:0/2226595241 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53800ce80 con 0x7ff55015daa0 2023-10-09T06:57:07.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.591+0000 7ff54cff9700 1 -- 172.21.15.71:0/2226595241 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53800ab70 con 0x7ff55015daa0 2023-10-09T06:57:07.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.591+0000 7ff54cff9700 1 -- 172.21.15.71:0/2226595241 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5380070f0 con 0x7ff55015daa0 2023-10-09T06:57:07.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.592+0000 7ff555b9d700 1 -- 172.21.15.71:0/2226595241 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff550148710 con 0x7ff55015daa0 2023-10-09T06:57:07.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.592+0000 7ff555b9d700 1 -- 172.21.15.71:0/2226595241 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff55007e5f0 con 0x7ff55015daa0 2023-10-09T06:57:07.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.593+0000 7ff555b9d700 1 -- 172.21.15.71:0/2226595241 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff550149f90 con 0x7ff55015daa0 2023-10-09T06:57:07.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.595+0000 7ff54cff9700 1 -- 172.21.15.71:0/2226595241 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 23) v1 ==== 84854+0+0 (secure 0 0 0) 0x7ff5380074e0 con 0x7ff55015daa0 2023-10-09T06:57:07.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.596+0000 7ff54cff9700 1 --2- 172.21.15.71:0/2226595241 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff5300671a0 0x7ff530069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:07.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.596+0000 7ff54cff9700 1 -- 172.21.15.71:0/2226595241 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6441+0+0 (secure 0 0 0) 0x7ff538084db0 con 0x7ff55015daa0 2023-10-09T06:57:07.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.597+0000 7ff554b9b700 1 -- 172.21.15.71:0/2226595241 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff5300671a0 msgr2=0x7ff530069650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:07.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.597+0000 7ff554b9b700 1 --2- 172.21.15.71:0/2226595241 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff5300671a0 0x7ff530069650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:07.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.600+0000 7ff54cff9700 1 -- 172.21.15.71:0/2226595241 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff538051c90 con 0x7ff55015daa0 2023-10-09T06:57:07.662 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:07.661+0000 7f4ddd045180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T06:57:07.693 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:07.693+0000 7fa5dc499180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:57:07.790 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:07.789+0000 7fa5dc499180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T06:57:07.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.798+0000 7ff554b9b700 1 -- 172.21.15.71:0/2226595241 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff5300671a0 msgr2=0x7ff530069650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:07.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.798+0000 7ff554b9b700 1 --2- 172.21.15.71:0/2226595241 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff5300671a0 0x7ff530069650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:07.839 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:07.838+0000 7f4ddd045180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:57:07.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.848+0000 7ff555b9d700 1 -- 172.21.15.71:0/2226595241 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff550148bf0 con 0x7ff55015daa0 2023-10-09T06:57:07.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.849+0000 7ff54cff9700 1 -- 172.21.15.71:0/2226595241 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4603 (secure 0 0 0) 0x7ff5380552b0 con 0x7ff55015daa0 2023-10-09T06:57:07.850 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:07.850 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5153,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3904949177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3904949177},{"type":"v1","addr":"172.21.15.179:6837","nonce":3904949177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5617,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2761847814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2761847814},{"type":"v1","addr":"172.21.15.71:6833","nonce":2761847814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5632,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3251743580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3251743580},{"type":"v1","addr":"172.21.15.179:6836","nonce":3251743580}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:55:06.387910+0000","modified":"2023-10-09T06:55:09.941744+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5727},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5727":{"gid":5727,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/4151615916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":4151615916},{"type":"v1","addr":"172.21.15.71:6835","nonce":4151615916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T06:57:07.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.851+0000 7ff555b9d700 1 -- 172.21.15.71:0/2226595241 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff5300671a0 msgr2=0x7ff530069650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:07.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.851+0000 7ff555b9d700 1 --2- 172.21.15.71:0/2226595241 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff5300671a0 0x7ff530069650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:07.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.851+0000 7ff555b9d700 1 -- 172.21.15.71:0/2226595241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff55015daa0 msgr2=0x7ff55014a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:07.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.851+0000 7ff555b9d700 1 --2- 172.21.15.71:0/2226595241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff55015daa0 0x7ff55014a150 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff53800cd80 tx=0x7ff538001aa0 comp rx=0 tx=0).stop 2023-10-09T06:57:07.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.852+0000 7ff555b9d700 1 -- 172.21.15.71:0/2226595241 shutdown_connections 2023-10-09T06:57:07.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.852+0000 7ff555b9d700 1 --2- 172.21.15.71:0/2226595241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff55015de70 0x7ff55014a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:07.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.852+0000 7ff555b9d700 1 --2- 172.21.15.71:0/2226595241 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff5300671a0 0x7ff530069650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:07.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.852+0000 7ff555b9d700 1 --2- 172.21.15.71:0/2226595241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5500696c0 0x7ff55007e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:07.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.852+0000 7ff555b9d700 1 --2- 172.21.15.71:0/2226595241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff55015daa0 0x7ff55014a150 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:07.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.852+0000 7ff555b9d700 1 -- 172.21.15.71:0/2226595241 >> 172.21.15.71:0/2226595241 conn(0x7ff5500cc1f0 msgr2=0x7ff5500c6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:07.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.852+0000 7ff555b9d700 1 -- 172.21.15.71:0/2226595241 shutdown_connections 2023-10-09T06:57:07.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:07.852+0000 7ff555b9d700 1 -- 172.21.15.71:0/2226595241 wait complete. 2023-10-09T06:57:07.854 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 24 2023-10-09T06:57:07.870 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:57:07.951 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:07.950+0000 7f4ddd045180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T06:57:08.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.068+0000 7f42bef9d700 1 Processor -- start 2023-10-09T06:57:08.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.068+0000 7f42bef9d700 1 -- start start 2023-10-09T06:57:08.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.069+0000 7f42bef9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f42b8142ea0 0x7f42b80b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:08.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.069+0000 7f42bef9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42b80ad870 0x7f42b806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:08.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.069+0000 7f42bef9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b80b40f0 con 0x7f42b80b3b70 2023-10-09T06:57:08.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.069+0000 7f42bef9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b8069640 con 0x7f42b8142ea0 2023-10-09T06:57:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.069+0000 7f42bef9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b8069920 con 0x7f42b80ad870 2023-10-09T06:57:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.070+0000 7f42be79c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f42b80b3b70 0x7f42b806cf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35376/0 (socket says 172.21.15.71:35376) 2023-10-09T06:57:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.070+0000 7f42be79c700 1 -- 172.21.15.71:0/2395754316 learned_addr learned my addr 172.21.15.71:0/2395754316 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.070+0000 7f42bdf9b700 1 --2- 172.21.15.71:0/2395754316 >> v2:172.21.15.179:3300/0 conn(0x7f42b8142ea0 0x7f42b80b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.070+0000 7f42bd79a700 1 --2- 172.21.15.71:0/2395754316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42b80ad870 0x7f42b806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.070+0000 7f42bcf99700 1 -- 172.21.15.71:0/2395754316 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435597148 0 0) 0x7f42b80b40f0 con 0x7f42b80b3b70 2023-10-09T06:57:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.070+0000 7f42bcf99700 1 -- 172.21.15.71:0/2395754316 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42a4003570 con 0x7f42b80b3b70 2023-10-09T06:57:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.070+0000 7f42bdf9b700 1 -- 172.21.15.71:0/2395754316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42b80ad870 msgr2=0x7f42b806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.070+0000 7f42bdf9b700 1 --2- 172.21.15.71:0/2395754316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42b80ad870 0x7f42b806b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.070+0000 7f42bdf9b700 1 -- 172.21.15.71:0/2395754316 >> v1:172.21.15.71:6789/0 conn(0x7f42b80b3b70 legacy=0x7f42b806cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.070+0000 7f42bdf9b700 1 -- 172.21.15.71:0/2395754316 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b8069c00 con 0x7f42b8142ea0 2023-10-09T06:57:08.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.071+0000 7f42bdf9b700 1 --2- 172.21.15.71:0/2395754316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42b8142ea0 0x7f42b80b3630 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f42b40098e0 tx=0x7f42b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3f959597ed05c5a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:08.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.071+0000 7f42bcf99700 1 -- 172.21.15.71:0/2395754316 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b4011630 con 0x7f42b8142ea0 2023-10-09T06:57:08.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.071+0000 7f42bcf99700 1 -- 172.21.15.71:0/2395754316 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b4011790 con 0x7f42b8142ea0 2023-10-09T06:57:08.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.071+0000 7f42bcf99700 1 -- 172.21.15.71:0/2395754316 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b4011b30 con 0x7f42b8142ea0 2023-10-09T06:57:08.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.072+0000 7f42bef9d700 1 -- 172.21.15.71:0/2395754316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42b8142ea0 msgr2=0x7f42b80b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:08.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.072+0000 7f42bef9d700 1 --2- 172.21.15.71:0/2395754316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42b8142ea0 0x7f42b80b3630 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f42b40098e0 tx=0x7f42b40091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.072+0000 7f42bef9d700 1 -- 172.21.15.71:0/2395754316 shutdown_connections 2023-10-09T06:57:08.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.072+0000 7f42bef9d700 1 --2- 172.21.15.71:0/2395754316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42b8142ea0 0x7f42b80b3630 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.072+0000 7f42bef9d700 1 --2- 172.21.15.71:0/2395754316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42b80ad870 0x7f42b806b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.072+0000 7f42bef9d700 1 -- 172.21.15.71:0/2395754316 >> 172.21.15.71:0/2395754316 conn(0x7f42b80ce430 msgr2=0x7f42b80ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:08.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.072+0000 7f42bef9d700 1 -- 172.21.15.71:0/2395754316 shutdown_connections 2023-10-09T06:57:08.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.072+0000 7f42bef9d700 1 -- 172.21.15.71:0/2395754316 wait complete. 2023-10-09T06:57:08.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.073+0000 7f42bef9d700 1 Processor -- start 2023-10-09T06:57:08.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.073+0000 7f42bef9d700 1 -- start start 2023-10-09T06:57:08.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.074+0000 7f42bef9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42b80b3b70 0x7f42b816a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:08.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.074+0000 7f42bef9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42b8142ea0 0x7f42b80aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:08.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.074+0000 7f42bef9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42b8158f70 0x7f42b815a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:08.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.074+0000 7f42bef9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b80c9460 con 0x7f42b8158f70 2023-10-09T06:57:08.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.074+0000 7f42bef9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b816a930 con 0x7f42b80b3b70 2023-10-09T06:57:08.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.074+0000 7f42bef9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b80c8820 con 0x7f42b8142ea0 2023-10-09T06:57:08.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.075+0000 7f42be79c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42b8158f70 0x7f42b815a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:08.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.075+0000 7f42bdf9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42b80b3b70 0x7f42b816a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:08.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.075+0000 7f42bd79a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42b8142ea0 0x7f42b80aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.075+0000 7f42bdf9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42b80b3b70 0x7f42b816a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:55268/0 (socket says 172.21.15.71:55268) 2023-10-09T06:57:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.075+0000 7f42be79c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42b8158f70 0x7f42b815a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38076/0 (socket says 172.21.15.71:38076) 2023-10-09T06:57:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.075+0000 7f42bdf9b700 1 -- 172.21.15.71:0/3381224788 learned_addr learned my addr 172.21.15.71:0/3381224788 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.075+0000 7f42bdf9b700 1 -- 172.21.15.71:0/3381224788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42b8142ea0 msgr2=0x7f42b80aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.075+0000 7f42bdf9b700 1 --2- 172.21.15.71:0/3381224788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42b8142ea0 0x7f42b80aedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.075+0000 7f42bdf9b700 1 -- 172.21.15.71:0/3381224788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42b8158f70 msgr2=0x7f42b815a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.075+0000 7f42bdf9b700 1 --2- 172.21.15.71:0/3381224788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42b8158f70 0x7f42b815a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.075+0000 7f42bdf9b700 1 -- 172.21.15.71:0/3381224788 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b4009420 con 0x7f42b80b3b70 2023-10-09T06:57:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.075+0000 7f42bdf9b700 1 --2- 172.21.15.71:0/3381224788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42b80b3b70 0x7f42b816a3f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f42b806f0d0 tx=0x7f42b4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.076+0000 7f42adffb700 1 -- 172.21.15.71:0/3381224788 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b4000d10 con 0x7f42b80b3b70 2023-10-09T06:57:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.076+0000 7f42adffb700 1 -- 172.21.15.71:0/3381224788 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b4011b10 con 0x7f42b80b3b70 2023-10-09T06:57:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.076+0000 7f42adffb700 1 -- 172.21.15.71:0/3381224788 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b4025660 con 0x7f42b80b3b70 2023-10-09T06:57:08.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.077+0000 7f42bef9d700 1 -- 172.21.15.71:0/3381224788 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b80c8e10 con 0x7f42b80b3b70 2023-10-09T06:57:08.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.077+0000 7f42bef9d700 1 -- 172.21.15.71:0/3381224788 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b80af300 con 0x7f42b80b3b70 2023-10-09T06:57:08.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.078+0000 7f42bef9d700 1 -- 172.21.15.71:0/3381224788 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b80c8c70 con 0x7f42b80b3b70 2023-10-09T06:57:08.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.079+0000 7f42adffb700 1 -- 172.21.15.71:0/3381224788 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 23) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f42b4025a50 con 0x7f42b80b3b70 2023-10-09T06:57:08.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.080+0000 7f42adffb700 1 --2- 172.21.15.71:0/3381224788 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f429c067050 0x7f429c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:08.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.080+0000 7f42adffb700 1 -- 172.21.15.71:0/3381224788 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6441+0+0 (secure 0 0 0) 0x7f42b4086130 con 0x7f42b80b3b70 2023-10-09T06:57:08.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.080+0000 7f42bd79a700 1 -- 172.21.15.71:0/3381224788 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f429c067050 msgr2=0x7f429c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:08.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.080+0000 7f42bd79a700 1 --2- 172.21.15.71:0/3381224788 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f429c067050 0x7f429c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:08.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.085+0000 7f42adffb700 1 -- 172.21.15.71:0/3381224788 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42b80c8c70 con 0x7f42b80b3b70 2023-10-09T06:57:08.090 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:08.090+0000 7fa5dc499180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T06:57:08.186 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:08.186+0000 7fa5dc499180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T06:57:08.255 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:08.254+0000 7f4ddd045180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T06:57:08.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.281+0000 7f42bd79a700 1 -- 172.21.15.71:0/3381224788 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f429c067050 msgr2=0x7f429c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:08.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.281+0000 7f42bd79a700 1 --2- 172.21.15.71:0/3381224788 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f429c067050 0x7f429c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:08.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.329+0000 7f42bef9d700 1 -- 172.21.15.71:0/3381224788 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42b80c8c70 con 0x7f42b80b3b70 2023-10-09T06:57:08.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.330+0000 7f42adffb700 1 -- 172.21.15.71:0/3381224788 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f42b80c8c70 con 0x7f42b80b3b70 2023-10-09T06:57:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:08.331 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5153,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3904949177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3904949177},{"type":"v1","addr":"172.21.15.179:6837","nonce":3904949177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5617,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2761847814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2761847814},{"type":"v1","addr":"172.21.15.71:6833","nonce":2761847814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5632,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3251743580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3251743580},{"type":"v1","addr":"172.21.15.179:6836","nonce":3251743580}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:55:06.387910+0000","modified":"2023-10-09T06:55:09.941744+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5727},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5727":{"gid":5727,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/4151615916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":4151615916},{"type":"v1","addr":"172.21.15.71:6835","nonce":4151615916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T06:57:08.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.334+0000 7f42bef9d700 1 -- 172.21.15.71:0/3381224788 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f429c067050 msgr2=0x7f429c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:08.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.334+0000 7f42bef9d700 1 --2- 172.21.15.71:0/3381224788 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f429c067050 0x7f429c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.334+0000 7f42bef9d700 1 -- 172.21.15.71:0/3381224788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42b80b3b70 msgr2=0x7f42b816a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:08.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.334+0000 7f42bef9d700 1 --2- 172.21.15.71:0/3381224788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42b80b3b70 0x7f42b816a3f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f42b806f0d0 tx=0x7f42b4017000 comp rx=0 tx=0).stop 2023-10-09T06:57:08.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.334+0000 7f42bef9d700 1 -- 172.21.15.71:0/3381224788 shutdown_connections 2023-10-09T06:57:08.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.334+0000 7f42bef9d700 1 --2- 172.21.15.71:0/3381224788 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f429c067050 0x7f429c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.334+0000 7f42bef9d700 1 --2- 172.21.15.71:0/3381224788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42b8158f70 0x7f42b815a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.334+0000 7f42bef9d700 1 --2- 172.21.15.71:0/3381224788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42b80b3b70 0x7f42b816a3f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.334+0000 7f42bef9d700 1 --2- 172.21.15.71:0/3381224788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42b8142ea0 0x7f42b80aedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.334+0000 7f42bef9d700 1 -- 172.21.15.71:0/3381224788 >> 172.21.15.71:0/3381224788 conn(0x7f42b80ce430 msgr2=0x7f42b8142120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:08.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.334+0000 7f42bef9d700 1 -- 172.21.15.71:0/3381224788 shutdown_connections 2023-10-09T06:57:08.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.334+0000 7f42bef9d700 1 -- 172.21.15.71:0/3381224788 wait complete. 2023-10-09T06:57:08.336 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 24 2023-10-09T06:57:08.360 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:57:08.364 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:08.362+0000 7f4ddd045180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T06:57:08.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.545+0000 7fd05d39d700 1 Processor -- start 2023-10-09T06:57:08.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.545+0000 7fd05d39d700 1 -- start start 2023-10-09T06:57:08.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.546+0000 7fd05d39d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd0581593b0 0x7fd058159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:08.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.546+0000 7fd05d39d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd0580ceaa0 0x7fd0580b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:08.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.546+0000 7fd05d39d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0580b6570 con 0x7fd0580b1740 2023-10-09T06:57:08.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.546+0000 7fd05d39d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0580cfe20 con 0x7fd0580ceaa0 2023-10-09T06:57:08.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.546+0000 7fd05d39d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0580cf210 con 0x7fd0581593b0 2023-10-09T06:57:08.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.547+0000 7fd0577fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd0580ceaa0 0x7fd0580b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:08.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.547+0000 7fd0577fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd0580ceaa0 0x7fd0580b6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38078/0 (socket says 172.21.15.71:38078) 2023-10-09T06:57:08.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.547+0000 7fd0577fe700 1 -- 172.21.15.71:0/3920662844 learned_addr learned my addr 172.21.15.71:0/3920662844 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:08.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.547+0000 7fd057fff700 1 --2- 172.21.15.71:0/3920662844 >> v2:172.21.15.179:3300/0 conn(0x7fd0581593b0 0x7fd058159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:08.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.547+0000 7fd057fff700 1 -- 172.21.15.71:0/3920662844 >> v2:172.21.15.71:3300/0 conn(0x7fd0580ceaa0 msgr2=0x7fd0580b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:08.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.547+0000 7fd057fff700 1 --2- 172.21.15.71:0/3920662844 >> v2:172.21.15.71:3300/0 conn(0x7fd0580ceaa0 0x7fd0580b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.547+0000 7fd057fff700 1 -- 172.21.15.71:0/3920662844 >> v1:172.21.15.179:6789/0 conn(0x7fd0580b1740 legacy=0x7fd0580b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:08.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.547+0000 7fd057fff700 1 -- 172.21.15.71:0/3920662844 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0580cf4f0 con 0x7fd0581593b0 2023-10-09T06:57:08.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.547+0000 7fd0577fe700 1 --2- 172.21.15.71:0/3920662844 >> v2:172.21.15.71:3300/0 conn(0x7fd0580ceaa0 0x7fd0580b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:57:08.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.547+0000 7fd056ffd700 1 -- 172.21.15.71:0/3920662844 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170733048 0 0) 0x7fd050001490 con 0x7fd0580b1740 2023-10-09T06:57:08.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.547+0000 7fd057fff700 1 --2- 172.21.15.71:0/3920662844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0581593b0 0x7fd058159780 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd058070d60 tx=0x7fd0480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68aa4bfd661e637 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:08.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.548+0000 7fd056ffd700 1 -- 172.21.15.71:0/3920662844 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd048011630 con 0x7fd0581593b0 2023-10-09T06:57:08.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.548+0000 7fd056ffd700 1 -- 172.21.15.71:0/3920662844 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd048011790 con 0x7fd0581593b0 2023-10-09T06:57:08.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.548+0000 7fd056ffd700 1 -- 172.21.15.71:0/3920662844 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd048011b30 con 0x7fd0581593b0 2023-10-09T06:57:08.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.548+0000 7fd05d39d700 1 -- 172.21.15.71:0/3920662844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0581593b0 msgr2=0x7fd058159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:08.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.548+0000 7fd05d39d700 1 --2- 172.21.15.71:0/3920662844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0581593b0 0x7fd058159780 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd058070d60 tx=0x7fd0480091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.548+0000 7fd05d39d700 1 -- 172.21.15.71:0/3920662844 shutdown_connections 2023-10-09T06:57:08.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.548+0000 7fd05d39d700 1 --2- 172.21.15.71:0/3920662844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0581593b0 0x7fd058159780 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.548+0000 7fd05d39d700 1 --2- 172.21.15.71:0/3920662844 >> v2:172.21.15.71:3300/0 conn(0x7fd0580ceaa0 0x7fd0580b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.548+0000 7fd05d39d700 1 -- 172.21.15.71:0/3920662844 >> 172.21.15.71:0/3920662844 conn(0x7fd0580d1130 msgr2=0x7fd0580b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:08.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.548+0000 7fd05d39d700 1 -- 172.21.15.71:0/3920662844 shutdown_connections 2023-10-09T06:57:08.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.548+0000 7fd05d39d700 1 -- 172.21.15.71:0/3920662844 wait complete. 2023-10-09T06:57:08.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.550+0000 7fd05d39d700 1 Processor -- start 2023-10-09T06:57:08.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.550+0000 7fd05d39d700 1 -- start start 2023-10-09T06:57:08.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.551+0000 7fd05d39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0580b1740 0x7fd058156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:08.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.551+0000 7fd05d39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0580ceaa0 0x7fd0580c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:08.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.551+0000 7fd05d39d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0581593b0 0x7fd05815b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:08.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.551+0000 7fd05d39d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0580c7790 con 0x7fd0581593b0 2023-10-09T06:57:08.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.551+0000 7fd05d39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0580ca930 con 0x7fd0580ceaa0 2023-10-09T06:57:08.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.551+0000 7fd05d39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0580ca600 con 0x7fd0580b1740 2023-10-09T06:57:08.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.551+0000 7fd05cb9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0581593b0 0x7fd05815b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:08.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.551+0000 7fd05cb9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0581593b0 0x7fd05815b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38086/0 (socket says 172.21.15.71:38086) 2023-10-09T06:57:08.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.551+0000 7fd05cb9c700 1 -- 172.21.15.71:0/2559584324 learned_addr learned my addr 172.21.15.71:0/2559584324 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:08.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.551+0000 7fd0577fe700 1 --2- 172.21.15.71:0/2559584324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0580ceaa0 0x7fd0580c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:08.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.551+0000 7fd057fff700 1 --2- 172.21.15.71:0/2559584324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0580b1740 0x7fd058156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:08.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.551+0000 7fd05cb9c700 1 -- 172.21.15.71:0/2559584324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0580b1740 msgr2=0x7fd058156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:08.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.551+0000 7fd05cb9c700 1 --2- 172.21.15.71:0/2559584324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0580b1740 0x7fd058156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.551+0000 7fd05cb9c700 1 -- 172.21.15.71:0/2559584324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0580ceaa0 msgr2=0x7fd0580c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:08.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.551+0000 7fd05cb9c700 1 --2- 172.21.15.71:0/2559584324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0580ceaa0 0x7fd0580c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.551+0000 7fd05cb9c700 1 -- 172.21.15.71:0/2559584324 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04c0094f0 con 0x7fd0581593b0 2023-10-09T06:57:08.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.552+0000 7fd05cb9c700 1 --2- 172.21.15.71:0/2559584324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0581593b0 0x7fd05815b1b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd05000c950 tx=0x7fd050007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:08.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.552+0000 7fd03ffff700 1 -- 172.21.15.71:0/2559584324 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050012630 con 0x7fd0581593b0 2023-10-09T06:57:08.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.552+0000 7fd05d39d700 1 -- 172.21.15.71:0/2559584324 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd048009420 con 0x7fd0581593b0 2023-10-09T06:57:08.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.552+0000 7fd03ffff700 1 -- 172.21.15.71:0/2559584324 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0500127b0 con 0x7fd0581593b0 2023-10-09T06:57:08.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.552+0000 7fd03ffff700 1 -- 172.21.15.71:0/2559584324 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050012b70 con 0x7fd0581593b0 2023-10-09T06:57:08.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.552+0000 7fd05d39d700 1 -- 172.21.15.71:0/2559584324 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0580c74b0 con 0x7fd0581593b0 2023-10-09T06:57:08.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.553+0000 7fd05d39d700 1 -- 172.21.15.71:0/2559584324 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd05804c3c0 con 0x7fd0581593b0 2023-10-09T06:57:08.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.554+0000 7fd03ffff700 1 -- 172.21.15.71:0/2559584324 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 23) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fd050003030 con 0x7fd0581593b0 2023-10-09T06:57:08.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.555+0000 7fd03ffff700 1 --2- 172.21.15.71:0/2559584324 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd044067050 0x7fd044069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:08.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.555+0000 7fd03ffff700 1 -- 172.21.15.71:0/2559584324 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6441+0+0 (secure 0 0 0) 0x7fd050084800 con 0x7fd0581593b0 2023-10-09T06:57:08.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.555+0000 7fd057fff700 1 -- 172.21.15.71:0/2559584324 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd044067050 msgr2=0x7fd044069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:08.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.555+0000 7fd057fff700 1 --2- 172.21.15.71:0/2559584324 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd044067050 0x7fd044069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:08.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.559+0000 7fd03ffff700 1 -- 172.21.15.71:0/2559584324 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd050051680 con 0x7fd0581593b0 2023-10-09T06:57:08.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.754+0000 7fd05d39d700 1 -- 172.21.15.71:0/2559584324 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0580b6570 con 0x7fd0581593b0 2023-10-09T06:57:08.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.755+0000 7fd03ffff700 1 -- 172.21.15.71:0/2559584324 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16478 (secure 0 0 0) 0x7fd0580b6570 con 0x7fd0581593b0 2023-10-09T06:57:08.756 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:08.757 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":66,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:57:06.930551+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:55:04.058830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T06:55:05.370158+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.32","mappings":[{"from":0,"to":5}]},{"pgid":"7.37","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:0/2392477914":"2023-10-10T06:55:26.774306+0000","172.21.15.179:0/1885947609":"2023-10-10T06:55:26.774306+0000","172.21.15.179:6833/85452":"2023-10-10T06:55:26.774306+0000","172.21.15.179:0/1151339543":"2023-10-10T06:55:26.774306+0000","172.21.15.179:6832/85452":"2023-10-10T06:55:26.774306+0000","172.21.15.179:0/3804390923":"2023-10-10T06:55:26.774306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:57:08.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.756+0000 7fd057fff700 1 -- 172.21.15.71:0/2559584324 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd044067050 msgr2=0x7fd044069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:08.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.756+0000 7fd057fff700 1 --2- 172.21.15.71:0/2559584324 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd044067050 0x7fd044069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:08.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.758+0000 7fd05d39d700 1 -- 172.21.15.71:0/2559584324 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd044067050 msgr2=0x7fd044069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:08.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.758+0000 7fd05d39d700 1 --2- 172.21.15.71:0/2559584324 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd044067050 0x7fd044069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.758+0000 7fd05d39d700 1 -- 172.21.15.71:0/2559584324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0581593b0 msgr2=0x7fd05815b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:08.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.758+0000 7fd05d39d700 1 --2- 172.21.15.71:0/2559584324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0581593b0 0x7fd05815b1b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd05000c950 tx=0x7fd050007f60 comp rx=0 tx=0).stop 2023-10-09T06:57:08.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.758+0000 7fd05d39d700 1 -- 172.21.15.71:0/2559584324 shutdown_connections 2023-10-09T06:57:08.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.758+0000 7fd05d39d700 1 --2- 172.21.15.71:0/2559584324 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd044067050 0x7fd044069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.758+0000 7fd05d39d700 1 --2- 172.21.15.71:0/2559584324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0581593b0 0x7fd05815b1b0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.758+0000 7fd05d39d700 1 --2- 172.21.15.71:0/2559584324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0580b1740 0x7fd058156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.758+0000 7fd05d39d700 1 --2- 172.21.15.71:0/2559584324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0580ceaa0 0x7fd0580c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.758+0000 7fd05d39d700 1 -- 172.21.15.71:0/2559584324 >> 172.21.15.71:0/2559584324 conn(0x7fd0580d1130 msgr2=0x7fd058156f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:08.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.758+0000 7fd05d39d700 1 -- 172.21.15.71:0/2559584324 shutdown_connections 2023-10-09T06:57:08.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.758+0000 7fd05d39d700 1 -- 172.21.15.71:0/2559584324 wait complete. 2023-10-09T06:57:08.778 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T06:57:08.899 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:08.899+0000 7fa5dc499180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T06:57:08.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.966+0000 7f49d159d700 1 Processor -- start 2023-10-09T06:57:08.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.966+0000 7f49d159d700 1 -- start start 2023-10-09T06:57:08.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.968+0000 7f49d159d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f49cc156310 0x7f49cc0c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:08.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.968+0000 7f49d159d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49cc0ae710 0x7f49cc0c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:08.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.968+0000 7f49d159d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49cc0ca860 con 0x7f49cc1566e0 2023-10-09T06:57:08.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.968+0000 7f49d159d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49cc0cab40 con 0x7f49cc156310 2023-10-09T06:57:08.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.968+0000 7f49d159d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc0cae20 con 0x7f49cc0ae710 2023-10-09T06:57:08.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.968+0000 7f49cbfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f49cc156310 0x7f49cc0c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:08.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.968+0000 7f49d0d9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49cc0ae710 0x7f49cc0c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:08.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.968+0000 7f49cbfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f49cc156310 0x7f49cc0c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:55280/0 (socket says 172.21.15.71:55280) 2023-10-09T06:57:08.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.968+0000 7f49cb7fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f49cc1566e0 0x7f49cc0ae000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:56482/0 (socket says 172.21.15.71:56482) 2023-10-09T06:57:08.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.968+0000 7f49d0d9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49cc0ae710 0x7f49cc0c6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:35966/0 (socket says 172.21.15.71:35966) 2023-10-09T06:57:08.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.968+0000 7f49cbfff700 1 -- 172.21.15.71:0/1615757154 learned_addr learned my addr 172.21.15.71:0/1615757154 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:08.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.969+0000 7f49caffd700 1 -- 172.21.15.71:0/1615757154 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988070646 0 0) 0x7f49cc0ca860 con 0x7f49cc1566e0 2023-10-09T06:57:08.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.969+0000 7f49cbfff700 1 -- 172.21.15.71:0/1615757154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49cc0ae710 msgr2=0x7f49cc0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:08.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.969+0000 7f49cbfff700 1 --2- 172.21.15.71:0/1615757154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49cc0ae710 0x7f49cc0c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.969+0000 7f49cbfff700 1 -- 172.21.15.71:0/1615757154 >> v1:172.21.15.179:6789/0 conn(0x7f49cc1566e0 legacy=0x7f49cc0ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:08.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.969+0000 7f49cbfff700 1 -- 172.21.15.71:0/1615757154 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49cc0cb100 con 0x7f49cc156310 2023-10-09T06:57:08.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.969+0000 7f49cbfff700 1 --2- 172.21.15.71:0/1615757154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49cc156310 0x7f49cc0c9dc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f49bc0099b0 tx=0x7f49bc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=356d08c3bd018ec2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:08.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.969+0000 7f49caffd700 1 -- 172.21.15.71:0/1615757154 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc009ea0 con 0x7f49cc156310 2023-10-09T06:57:08.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.969+0000 7f49caffd700 1 -- 172.21.15.71:0/1615757154 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49bc00b860 con 0x7f49cc156310 2023-10-09T06:57:08.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.969+0000 7f49caffd700 1 -- 172.21.15.71:0/1615757154 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc00bc00 con 0x7f49cc156310 2023-10-09T06:57:08.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.970+0000 7f49d159d700 1 -- 172.21.15.71:0/1615757154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49cc156310 msgr2=0x7f49cc0c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:08.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.970+0000 7f49d159d700 1 --2- 172.21.15.71:0/1615757154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49cc156310 0x7f49cc0c9dc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f49bc0099b0 tx=0x7f49bc009250 comp rx=0 tx=0).stop 2023-10-09T06:57:08.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.970+0000 7f49d159d700 1 -- 172.21.15.71:0/1615757154 shutdown_connections 2023-10-09T06:57:08.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.970+0000 7f49d159d700 1 --2- 172.21.15.71:0/1615757154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49cc0ae710 0x7f49cc0c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.970+0000 7f49d159d700 1 --2- 172.21.15.71:0/1615757154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49cc156310 0x7f49cc0c9dc0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.970+0000 7f49d159d700 1 -- 172.21.15.71:0/1615757154 >> 172.21.15.71:0/1615757154 conn(0x7f49cc0cc1f0 msgr2=0x7f49cc0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:08.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.970+0000 7f49d159d700 1 -- 172.21.15.71:0/1615757154 shutdown_connections 2023-10-09T06:57:08.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.970+0000 7f49d159d700 1 -- 172.21.15.71:0/1615757154 wait complete. 2023-10-09T06:57:08.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.971+0000 7f49d159d700 1 Processor -- start 2023-10-09T06:57:08.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.972+0000 7f49d159d700 1 -- start start 2023-10-09T06:57:08.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.972+0000 7f49d159d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49cc0ae710 0x7f49cc13e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:08.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.972+0000 7f49d159d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49cc156310 0x7f49cc15a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:08.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.972+0000 7f49d159d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49cc1566e0 0x7f49cc0b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:08.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.972+0000 7f49d159d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc1401a0 con 0x7f49cc0ae710 2023-10-09T06:57:08.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.972+0000 7f49d159d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc13f870 con 0x7f49cc156310 2023-10-09T06:57:08.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.972+0000 7f49d159d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc13fb50 con 0x7f49cc1566e0 2023-10-09T06:57:08.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.973+0000 7f49cbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49cc0ae710 0x7f49cc13e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:08.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.973+0000 7f49cb7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49cc156310 0x7f49cc15a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:08.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.973+0000 7f49cbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49cc0ae710 0x7f49cc13e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38090/0 (socket says 172.21.15.71:38090) 2023-10-09T06:57:08.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.973+0000 7f49cb7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49cc156310 0x7f49cc15a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:55294/0 (socket says 172.21.15.71:55294) 2023-10-09T06:57:08.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.973+0000 7f49d0d9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49cc1566e0 0x7f49cc0b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:08.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.973+0000 7f49cb7fe700 1 -- 172.21.15.71:0/770142211 learned_addr learned my addr 172.21.15.71:0/770142211 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:08.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.973+0000 7f49cb7fe700 1 -- 172.21.15.71:0/770142211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49cc1566e0 msgr2=0x7f49cc0b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:08.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.973+0000 7f49cb7fe700 1 --2- 172.21.15.71:0/770142211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49cc1566e0 0x7f49cc0b09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.973+0000 7f49cb7fe700 1 -- 172.21.15.71:0/770142211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49cc0ae710 msgr2=0x7f49cc13e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:08.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.973+0000 7f49cb7fe700 1 --2- 172.21.15.71:0/770142211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49cc0ae710 0x7f49cc13e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:08.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.973+0000 7f49cb7fe700 1 -- 172.21.15.71:0/770142211 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49bc0094f0 con 0x7f49cc156310 2023-10-09T06:57:08.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.974+0000 7f49cb7fe700 1 --2- 172.21.15.71:0/770142211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49cc156310 0x7f49cc15a340 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f49c000c510 tx=0x7f49c000c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:08.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.974+0000 7f49b3fff700 1 -- 172.21.15.71:0/770142211 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c0005a70 con 0x7f49cc156310 2023-10-09T06:57:08.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.974+0000 7f49b3fff700 1 -- 172.21.15.71:0/770142211 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c0005bf0 con 0x7f49cc156310 2023-10-09T06:57:08.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.974+0000 7f49b3fff700 1 -- 172.21.15.71:0/770142211 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c00070d0 con 0x7f49cc156310 2023-10-09T06:57:08.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.974+0000 7f49d159d700 1 -- 172.21.15.71:0/770142211 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49cc13fe30 con 0x7f49cc156310 2023-10-09T06:57:08.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.974+0000 7f49d159d700 1 -- 172.21.15.71:0/770142211 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49cc13f440 con 0x7f49cc156310 2023-10-09T06:57:08.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.975+0000 7f49d159d700 1 -- 172.21.15.71:0/770142211 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49cc140350 con 0x7f49cc156310 2023-10-09T06:57:08.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.976+0000 7f49b3fff700 1 -- 172.21.15.71:0/770142211 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 23) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f49c0007480 con 0x7f49cc156310 2023-10-09T06:57:08.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.977+0000 7f49b3fff700 1 --2- 172.21.15.71:0/770142211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f49b8067050 0x7f49b8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:08.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.977+0000 7f49b3fff700 1 -- 172.21.15.71:0/770142211 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6441+0+0 (secure 0 0 0) 0x7f49c0083d20 con 0x7f49cc156310 2023-10-09T06:57:08.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.977+0000 7f49cbfff700 1 -- 172.21.15.71:0/770142211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f49b8067050 msgr2=0x7f49b8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:08.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.977+0000 7f49cbfff700 1 --2- 172.21.15.71:0/770142211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f49b8067050 0x7f49b8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:08.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:08.981+0000 7f49b3fff700 1 -- 172.21.15.71:0/770142211 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49cc140350 con 0x7f49cc156310 2023-10-09T06:57:09.110 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:09.109+0000 7f4ddd045180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T06:57:09.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.178+0000 7f49cbfff700 1 -- 172.21.15.71:0/770142211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f49b8067050 msgr2=0x7f49b8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:09.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.178+0000 7f49cbfff700 1 --2- 172.21.15.71:0/770142211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f49b8067050 0x7f49b8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:09.187 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:09.187+0000 7fa5dc499180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T06:57:09.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.222+0000 7f49d159d700 1 -- 172.21.15.71:0/770142211 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f49cc140310 con 0x7f49cc156310 2023-10-09T06:57:09.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2023-10-09T06:57:09.223+0000 7fdb445f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T06:57:09.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.232+0000 7f49b3fff700 1 -- 172.21.15.71:0/770142211 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7f49c0017020 con 0x7f49cc156310 2023-10-09T06:57:09.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.234+0000 7f49d159d700 1 -- 172.21.15.71:0/770142211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f49b8067050 msgr2=0x7f49b8069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:09.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.234+0000 7f49d159d700 1 --2- 172.21.15.71:0/770142211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f49b8067050 0x7f49b8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:09.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.234+0000 7f49d159d700 1 -- 172.21.15.71:0/770142211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49cc156310 msgr2=0x7f49cc15a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:09.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.234+0000 7f49d159d700 1 --2- 172.21.15.71:0/770142211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49cc156310 0x7f49cc15a340 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f49c000c510 tx=0x7f49c000c820 comp rx=0 tx=0).stop 2023-10-09T06:57:09.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.234+0000 7f49d159d700 1 -- 172.21.15.71:0/770142211 shutdown_connections 2023-10-09T06:57:09.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.234+0000 7f49d159d700 1 --2- 172.21.15.71:0/770142211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49cc1566e0 0x7f49cc0b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:09.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.234+0000 7f49d159d700 1 --2- 172.21.15.71:0/770142211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f49b8067050 0x7f49b8069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:09.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.234+0000 7f49d159d700 1 --2- 172.21.15.71:0/770142211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49cc0ae710 0x7f49cc13e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:09.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.234+0000 7f49d159d700 1 --2- 172.21.15.71:0/770142211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49cc156310 0x7f49cc15a340 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:09.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.234+0000 7f49d159d700 1 -- 172.21.15.71:0/770142211 >> 172.21.15.71:0/770142211 conn(0x7f49cc0cc1f0 msgr2=0x7f49cc0c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:09.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.235+0000 7f49d159d700 1 -- 172.21.15.71:0/770142211 shutdown_connections 2023-10-09T06:57:09.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.235+0000 7f49d159d700 1 -- 172.21.15.71:0/770142211 wait complete. 2023-10-09T06:57:09.237 INFO:teuthology.orchestra.run.smithi071.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T06:57:09.257 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T06:57:09.285 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:09.285+0000 7fa5dc499180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T06:57:09.295 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-10-09T06:57:09.408 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:09.407+0000 7f4ddd045180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T06:57:09.441 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:09.440+0000 7fa5dc499180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T06:57:09.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.449+0000 7f193af9d700 1 Processor -- start 2023-10-09T06:57:09.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.449+0000 7f193af9d700 1 -- start start 2023-10-09T06:57:09.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.450+0000 7f193af9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f19340aef00 0x7f193415d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:09.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.450+0000 7f193af9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19340aea70 con 0x7f193406e470 2023-10-09T06:57:09.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.450+0000 7f193af9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19340ae480 con 0x7f193415a3b0 2023-10-09T06:57:09.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.450+0000 7f193af9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193415dd30 con 0x7f19340aef00 2023-10-09T06:57:09.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.450+0000 7f193979a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f19340aef00 0x7f193415d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:09.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.450+0000 7f193a79c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f193406e470 0x7f19340c7280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35388/0 (socket says 172.21.15.71:35388) 2023-10-09T06:57:09.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.450+0000 7f193a79c700 1 -- 172.21.15.71:0/2515596870 learned_addr learned my addr 172.21.15.71:0/2515596870 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:09.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.451+0000 7f193979a700 1 -- 172.21.15.71:0/2515596870 >> v1:172.21.15.179:6789/0 conn(0x7f193415a3b0 legacy=0x7f193415a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:09.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.451+0000 7f193979a700 1 -- 172.21.15.71:0/2515596870 >> v1:172.21.15.71:6789/0 conn(0x7f193406e470 legacy=0x7f19340c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:09.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.451+0000 7f193979a700 1 -- 172.21.15.71:0/2515596870 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193415e010 con 0x7f19340aef00 2023-10-09T06:57:09.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.451+0000 7f1938f99700 1 -- 172.21.15.71:0/2515596870 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3548418925 0 0) 0x7f19340ae480 con 0x7f193415a3b0 2023-10-09T06:57:09.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.451+0000 7f193979a700 1 --2- 172.21.15.71:0/2515596870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19340aef00 0x7f193415d3c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f19240098e0 tx=0x7f19240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd42f2b1f7c570e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:09.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.451+0000 7f1938f99700 1 -- 172.21.15.71:0/2515596870 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1924009e80 con 0x7f19340aef00 2023-10-09T06:57:09.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.452+0000 7f1938f99700 1 -- 172.21.15.71:0/2515596870 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192400b760 con 0x7f19340aef00 2023-10-09T06:57:09.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.452+0000 7f1938f99700 1 -- 172.21.15.71:0/2515596870 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192400bae0 con 0x7f19340aef00 2023-10-09T06:57:09.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.452+0000 7f193af9d700 1 -- 172.21.15.71:0/2515596870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19340aef00 msgr2=0x7f193415d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:09.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.452+0000 7f193af9d700 1 --2- 172.21.15.71:0/2515596870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19340aef00 0x7f193415d3c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f19240098e0 tx=0x7f19240091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:09.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.452+0000 7f193af9d700 1 -- 172.21.15.71:0/2515596870 shutdown_connections 2023-10-09T06:57:09.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.452+0000 7f193af9d700 1 --2- 172.21.15.71:0/2515596870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19340aef00 0x7f193415d3c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:09.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.452+0000 7f193af9d700 1 -- 172.21.15.71:0/2515596870 >> 172.21.15.71:0/2515596870 conn(0x7f19340c9f70 msgr2=0x7f193406dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:09.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.453+0000 7f193af9d700 1 -- 172.21.15.71:0/2515596870 shutdown_connections 2023-10-09T06:57:09.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.453+0000 7f193af9d700 1 -- 172.21.15.71:0/2515596870 wait complete. 2023-10-09T06:57:09.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.454+0000 7f193af9d700 1 Processor -- start 2023-10-09T06:57:09.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.454+0000 7f193af9d700 1 -- start start 2023-10-09T06:57:09.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.455+0000 7f193af9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f193406e470 0x7f193413f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:09.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.455+0000 7f193af9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19340aef00 0x7f193413f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:09.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.455+0000 7f193af9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f193415a3b0 0x7f193415bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:09.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.455+0000 7f193af9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1934140f90 con 0x7f193406e470 2023-10-09T06:57:09.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.455+0000 7f193af9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1934140380 con 0x7f19340aef00 2023-10-09T06:57:09.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.455+0000 7f193af9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1934140660 con 0x7f193415a3b0 2023-10-09T06:57:09.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.455+0000 7f1939f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f193406e470 0x7f193413f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:09.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.455+0000 7f1939f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f193406e470 0x7f193413f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38110/0 (socket says 172.21.15.71:38110) 2023-10-09T06:57:09.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.455+0000 7f1939f9b700 1 -- 172.21.15.71:0/2009046513 learned_addr learned my addr 172.21.15.71:0/2009046513 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:09.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.455+0000 7f193979a700 1 --2- 172.21.15.71:0/2009046513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19340aef00 0x7f193413f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:09.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.455+0000 7f193a79c700 1 --2- 172.21.15.71:0/2009046513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f193415a3b0 0x7f193415bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:09.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.456+0000 7f1939f9b700 1 -- 172.21.15.71:0/2009046513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f193415a3b0 msgr2=0x7f193415bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:09.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.456+0000 7f1939f9b700 1 --2- 172.21.15.71:0/2009046513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f193415a3b0 0x7f193415bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:09.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.456+0000 7f1939f9b700 1 -- 172.21.15.71:0/2009046513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19340aef00 msgr2=0x7f193413f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:09.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.456+0000 7f1939f9b700 1 --2- 172.21.15.71:0/2009046513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19340aef00 0x7f193413f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:09.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.456+0000 7f1939f9b700 1 -- 172.21.15.71:0/2009046513 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1924009420 con 0x7f193406e470 2023-10-09T06:57:09.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.456+0000 7f1939f9b700 1 --2- 172.21.15.71:0/2009046513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f193406e470 0x7f193413f030 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f193000b5e0 tx=0x7f19300090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:09.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.456+0000 7f1929ffb700 1 -- 172.21.15.71:0/2009046513 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1930011630 con 0x7f193406e470 2023-10-09T06:57:09.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.456+0000 7f1929ffb700 1 -- 172.21.15.71:0/2009046513 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19300117d0 con 0x7f193406e470 2023-10-09T06:57:09.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.456+0000 7f193af9d700 1 -- 172.21.15.71:0/2009046513 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1934140940 con 0x7f193406e470 2023-10-09T06:57:09.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.457+0000 7f1929ffb700 1 -- 172.21.15.71:0/2009046513 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1930011b90 con 0x7f193406e470 2023-10-09T06:57:09.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.457+0000 7f193af9d700 1 -- 172.21.15.71:0/2009046513 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193413f570 con 0x7f193406e470 2023-10-09T06:57:09.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.458+0000 7f193af9d700 1 -- 172.21.15.71:0/2009046513 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193406cfa0 con 0x7f193406e470 2023-10-09T06:57:09.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.459+0000 7f1929ffb700 1 -- 172.21.15.71:0/2009046513 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 23) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f19300193b0 con 0x7f193406e470 2023-10-09T06:57:09.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.460+0000 7f1929ffb700 1 --2- 172.21.15.71:0/2009046513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1918067050 0x7f1918069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:09.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.460+0000 7f1929ffb700 1 -- 172.21.15.71:0/2009046513 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6499+0+0 (secure 0 0 0) 0x7f1930084390 con 0x7f193406e470 2023-10-09T06:57:09.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.460+0000 7f193979a700 1 -- 172.21.15.71:0/2009046513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1918067050 msgr2=0x7f1918069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:09.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.460+0000 7f193979a700 1 --2- 172.21.15.71:0/2009046513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1918067050 0x7f1918069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:09.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.465+0000 7f1929ffb700 1 -- 172.21.15.71:0/2009046513 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1930051130 con 0x7f193406e470 2023-10-09T06:57:09.507 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:09.506+0000 7f4ddd045180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T06:57:09.546 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:09.545+0000 7fa5dc499180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T06:57:09.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.661+0000 7f193979a700 1 -- 172.21.15.71:0/2009046513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1918067050 msgr2=0x7f1918069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:09.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.661+0000 7f193979a700 1 --2- 172.21.15.71:0/2009046513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1918067050 0x7f1918069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:09.663 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:09.662+0000 7f4ddd045180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T06:57:09.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:09.704+0000 7f193af9d700 1 -- 172.21.15.71:0/2009046513 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f19340ae700 con 0x7f193406e470 2023-10-09T06:57:09.735 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:09.734+0000 7fa5dc499180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T06:57:09.768 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:09.767+0000 7f4ddd045180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T06:57:09.827 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:09.827+0000 7fa5dc499180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T06:57:09.919 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:09.918+0000 7fa5dc499180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T06:57:09.955 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:09.954+0000 7f4ddd045180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T06:57:10.014 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:10.014+0000 7fa5dc499180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T06:57:10.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.023+0000 7f1929ffb700 1 -- 172.21.15.71:0/2009046513 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 24) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f1930051500 con 0x7f193406e470 2023-10-09T06:57:10.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.023+0000 7f1929ffb700 1 -- 172.21.15.71:0/2009046513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1918067050 msgr2=0x7f1918069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:10.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.023+0000 7f1929ffb700 1 --2- 172.21.15.71:0/2009046513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1918067050 0x7f1918069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:10.051 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:10.050+0000 7f4ddd045180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T06:57:10.094 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:10.094+0000 7fa556000700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:10.095 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:10.094+0000 7fa556000700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:10.095 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:10.094+0000 7fa556000700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:10.095 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:10.094+0000 7fa556000700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:10.095 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:10.094+0000 7fa556000700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:10.096 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:10.095+0000 7fa55a809700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:10.096 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:10.095+0000 7fa55a809700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:10.096 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:10.095+0000 7fa55a809700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:10.096 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:10.095+0000 7fa55a809700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:10.096 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:10.095+0000 7fa55a809700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:10.148 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:10.148+0000 7f4ddd045180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T06:57:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.229+0000 7f1929ffb700 1 -- 172.21.15.71:0/2009046513 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7f193007eeb0 con 0x7f193406e470 2023-10-09T06:57:10.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.231+0000 7f193af9d700 1 -- 172.21.15.71:0/2009046513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f193406e470 msgr2=0x7f193413f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:10.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.231+0000 7f193af9d700 1 --2- 172.21.15.71:0/2009046513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f193406e470 0x7f193413f030 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f193000b5e0 tx=0x7f19300090f0 comp rx=0 tx=0).stop 2023-10-09T06:57:10.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.231+0000 7f193af9d700 1 -- 172.21.15.71:0/2009046513 shutdown_connections 2023-10-09T06:57:10.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.231+0000 7f193af9d700 1 --2- 172.21.15.71:0/2009046513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f193415a3b0 0x7f193415bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:10.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.231+0000 7f193af9d700 1 --2- 172.21.15.71:0/2009046513 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1918067050 0x7f1918069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:10.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.231+0000 7f193af9d700 1 --2- 172.21.15.71:0/2009046513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f193406e470 0x7f193413f030 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:10.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.231+0000 7f193af9d700 1 --2- 172.21.15.71:0/2009046513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19340aef00 0x7f193413f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:10.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.231+0000 7f193af9d700 1 -- 172.21.15.71:0/2009046513 >> 172.21.15.71:0/2009046513 conn(0x7f19340c9f70 msgr2=0x7f193406eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:10.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.231+0000 7f193af9d700 1 -- 172.21.15.71:0/2009046513 shutdown_connections 2023-10-09T06:57:10.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.231+0000 7f193af9d700 1 -- 172.21.15.71:0/2009046513 wait complete. 2023-10-09T06:57:10.241 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:10.241+0000 7f4ddd045180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T06:57:10.251 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T06:57:10.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.474+0000 7f218a19d700 1 Processor -- start 2023-10-09T06:57:10.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.474+0000 7f218a19d700 1 -- start start 2023-10-09T06:57:10.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.475+0000 7f218a19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f218415b050 0x7f21840ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:10.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.475+0000 7f218a19d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f218415bb30 0x7f21840ada30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:10.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.475+0000 7f218a19d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2184157a50 con 0x7f21840cc8d0 2023-10-09T06:57:10.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.475+0000 7f218a19d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2184158f10 con 0x7f218415bb30 2023-10-09T06:57:10.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.475+0000 7f218a19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21841591b0 con 0x7f218415b050 2023-10-09T06:57:10.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.475+0000 7f218999c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f218415bb30 0x7f21840ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:10.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.475+0000 7f218899a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f21840cc8d0 0x7f218415b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35394/0 (socket says 172.21.15.71:35394) 2023-10-09T06:57:10.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.475+0000 7f218999c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f218415bb30 0x7f21840ada30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38122/0 (socket says 172.21.15.71:38122) 2023-10-09T06:57:10.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.475+0000 7f218899a700 1 -- 172.21.15.71:0/3831552146 learned_addr learned my addr 172.21.15.71:0/3831552146 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:10.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.476+0000 7f218919b700 1 --2- 172.21.15.71:0/3831552146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f218415b050 0x7f21840ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:10.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.476+0000 7f218999c700 1 -- 172.21.15.71:0/3831552146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f218415b050 msgr2=0x7f21840ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:10.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.476+0000 7f218999c700 1 --2- 172.21.15.71:0/3831552146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f218415b050 0x7f21840ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:10.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.476+0000 7f218999c700 1 -- 172.21.15.71:0/3831552146 >> v1:172.21.15.71:6789/0 conn(0x7f21840cc8d0 legacy=0x7f218415b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:10.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.476+0000 7f218999c700 1 -- 172.21.15.71:0/3831552146 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21840ca9e0 con 0x7f218415bb30 2023-10-09T06:57:10.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.476+0000 7f217bfff700 1 -- 172.21.15.71:0/3831552146 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782190032 0 0) 0x7f2184157a50 con 0x7f21840cc8d0 2023-10-09T06:57:10.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.476+0000 7f218999c700 1 --2- 172.21.15.71:0/3831552146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f218415bb30 0x7f21840ada30 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f217c009e60 tx=0x7f217c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a615ba1d20d0b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:10.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.476+0000 7f217bfff700 1 -- 172.21.15.71:0/3831552146 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c00e070 con 0x7f218415bb30 2023-10-09T06:57:10.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.476+0000 7f217bfff700 1 -- 172.21.15.71:0/3831552146 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217c00bc30 con 0x7f218415bb30 2023-10-09T06:57:10.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.476+0000 7f217bfff700 1 -- 172.21.15.71:0/3831552146 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c012430 con 0x7f218415bb30 2023-10-09T06:57:10.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.477+0000 7f218a19d700 1 -- 172.21.15.71:0/3831552146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f218415bb30 msgr2=0x7f21840ada30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:10.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.477+0000 7f218a19d700 1 --2- 172.21.15.71:0/3831552146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f218415bb30 0x7f21840ada30 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f217c009e60 tx=0x7f217c009780 comp rx=0 tx=0).stop 2023-10-09T06:57:10.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.477+0000 7f218a19d700 1 -- 172.21.15.71:0/3831552146 shutdown_connections 2023-10-09T06:57:10.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.477+0000 7f218a19d700 1 --2- 172.21.15.71:0/3831552146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f218415bb30 0x7f21840ada30 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:10.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.477+0000 7f218a19d700 1 --2- 172.21.15.71:0/3831552146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f218415b050 0x7f21840ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:10.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.477+0000 7f218a19d700 1 -- 172.21.15.71:0/3831552146 >> 172.21.15.71:0/3831552146 conn(0x7f2184068e20 msgr2=0x7f21840cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:10.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.477+0000 7f218a19d700 1 -- 172.21.15.71:0/3831552146 shutdown_connections 2023-10-09T06:57:10.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.477+0000 7f218a19d700 1 -- 172.21.15.71:0/3831552146 wait complete. 2023-10-09T06:57:10.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.478+0000 7f218a19d700 1 Processor -- start 2023-10-09T06:57:10.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.479+0000 7f218a19d700 1 -- start start 2023-10-09T06:57:10.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.479+0000 7f218a19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21840cc8d0 0x7f21840c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:10.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.480+0000 7f218a19d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f218415b050 0x7f2184147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:10.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.480+0000 7f218a19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f218415bb30 0x7f21840c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:10.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.480+0000 7f218a19d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21840af1f0 con 0x7f218415b050 2023-10-09T06:57:10.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.480+0000 7f218a19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21840c6740 con 0x7f21840cc8d0 2023-10-09T06:57:10.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.480+0000 7f218a19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21840c6a20 con 0x7f218415bb30 2023-10-09T06:57:10.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.480+0000 7f218899a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f218415b050 0x7f2184147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:10.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.480+0000 7f218899a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f218415b050 0x7f2184147c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38138/0 (socket says 172.21.15.71:38138) 2023-10-09T06:57:10.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.480+0000 7f218899a700 1 -- 172.21.15.71:0/2353036063 learned_addr learned my addr 172.21.15.71:0/2353036063 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:10.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.480+0000 7f218919b700 1 --2- 172.21.15.71:0/2353036063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21840cc8d0 0x7f21840c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:10.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.480+0000 7f218999c700 1 --2- 172.21.15.71:0/2353036063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f218415bb30 0x7f21840c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:10.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.480+0000 7f218899a700 1 -- 172.21.15.71:0/2353036063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f218415bb30 msgr2=0x7f21840c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:10.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.480+0000 7f218899a700 1 --2- 172.21.15.71:0/2353036063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f218415bb30 0x7f21840c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:10.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.480+0000 7f218899a700 1 -- 172.21.15.71:0/2353036063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21840cc8d0 msgr2=0x7f21840c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:10.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.480+0000 7f218899a700 1 --2- 172.21.15.71:0/2353036063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21840cc8d0 0x7f21840c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:10.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.480+0000 7f218899a700 1 -- 172.21.15.71:0/2353036063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217c009a20 con 0x7f218415b050 2023-10-09T06:57:10.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.481+0000 7f218899a700 1 --2- 172.21.15.71:0/2353036063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f218415b050 0x7f2184147c30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f217400c5b0 tx=0x7f2174001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:10.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.481+0000 7f21797fa700 1 -- 172.21.15.71:0/2353036063 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174005b30 con 0x7f218415b050 2023-10-09T06:57:10.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.481+0000 7f21797fa700 1 -- 172.21.15.71:0/2353036063 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2174005c90 con 0x7f218415b050 2023-10-09T06:57:10.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.481+0000 7f21797fa700 1 -- 172.21.15.71:0/2353036063 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174007300 con 0x7f218415b050 2023-10-09T06:57:10.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.481+0000 7f218a19d700 1 -- 172.21.15.71:0/2353036063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21840c6d00 con 0x7f218415b050 2023-10-09T06:57:10.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.481+0000 7f218a19d700 1 -- 172.21.15.71:0/2353036063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2184148170 con 0x7f218415b050 2023-10-09T06:57:10.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.482+0000 7f218a19d700 1 -- 172.21.15.71:0/2353036063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2184157340 con 0x7f218415b050 2023-10-09T06:57:10.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.483+0000 7f21797fa700 1 -- 172.21.15.71:0/2353036063 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 24) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f217401b3b0 con 0x7f218415b050 2023-10-09T06:57:10.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.484+0000 7f21797fa700 1 -- 172.21.15.71:0/2353036063 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f21740838c0 con 0x7f218415b050 2023-10-09T06:57:10.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.487+0000 7f21797fa700 1 -- 172.21.15.71:0/2353036063 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2174050ad0 con 0x7f218415b050 2023-10-09T06:57:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:10.676+0000 7f218a19d700 1 -- 172.21.15.71:0/2353036063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f218404c3c0 con 0x7f218415b050 2023-10-09T06:57:11.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.028+0000 7f21797fa700 1 -- 172.21.15.71:0/2353036063 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 25) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f2174050580 con 0x7f218415b050 2023-10-09T06:57:11.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.028+0000 7f21797fa700 1 --2- 172.21.15.71:0/2353036063 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f216806ca50 0x7f216806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:11.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.030+0000 7f218919b700 1 --2- 172.21.15.71:0/2353036063 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f216806ca50 0x7f216806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:11.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.035+0000 7f218919b700 1 --2- 172.21.15.71:0/2353036063 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f216806ca50 0x7f216806ee30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2180006fd0 tx=0x7f2180008040 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:11.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.232+0000 7f21797fa700 1 -- 172.21.15.71:0/2353036063 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v69) v1 ==== 181+0+0 (secure 0 0 0) 0x7f217406fa50 con 0x7f218415b050 2023-10-09T06:57:11.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.236+0000 7f218a19d700 1 -- 172.21.15.71:0/2353036063 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f216806ca50 msgr2=0x7f216806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:11.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.236+0000 7f218a19d700 1 --2- 172.21.15.71:0/2353036063 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f216806ca50 0x7f216806ee30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2180006fd0 tx=0x7f2180008040 comp rx=0 tx=0).stop 2023-10-09T06:57:11.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.236+0000 7f218a19d700 1 -- 172.21.15.71:0/2353036063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f218415b050 msgr2=0x7f2184147c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:11.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.236+0000 7f218a19d700 1 --2- 172.21.15.71:0/2353036063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f218415b050 0x7f2184147c30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f217400c5b0 tx=0x7f2174001070 comp rx=0 tx=0).stop 2023-10-09T06:57:11.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.236+0000 7f218a19d700 1 -- 172.21.15.71:0/2353036063 shutdown_connections 2023-10-09T06:57:11.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.236+0000 7f218a19d700 1 --2- 172.21.15.71:0/2353036063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f218415bb30 0x7f21840c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:11.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.236+0000 7f218a19d700 1 --2- 172.21.15.71:0/2353036063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21840cc8d0 0x7f21840c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:11.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.236+0000 7f218a19d700 1 --2- 172.21.15.71:0/2353036063 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f216806ca50 0x7f216806ee30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.236+0000 7f218a19d700 1 --2- 172.21.15.71:0/2353036063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f218415b050 0x7f2184147c30 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.236+0000 7f218a19d700 1 -- 172.21.15.71:0/2353036063 >> 172.21.15.71:0/2353036063 conn(0x7f2184068e20 msgr2=0x7f21841593b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.236+0000 7f218a19d700 1 -- 172.21.15.71:0/2353036063 shutdown_connections 2023-10-09T06:57:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.236+0000 7f218a19d700 1 -- 172.21.15.71:0/2353036063 wait complete. 2023-10-09T06:57:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' removed 2023-10-09T06:57:11.257 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T06:57:11.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.442+0000 7fe7eedff700 1 Processor -- start 2023-10-09T06:57:11.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.443+0000 7fe7eedff700 1 -- start start 2023-10-09T06:57:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.444+0000 7fe7eedff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e815a440 0x7fe7e80acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.444+0000 7fe7eedff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe7e8068890 0x7fe7e80c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.444+0000 7fe7eedff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e815a9b0 con 0x7fe7e81563b0 2023-10-09T06:57:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.444+0000 7fe7eedff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7e815ac90 con 0x7fe7e8068890 2023-10-09T06:57:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.444+0000 7fe7eedff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e815af70 con 0x7fe7e815a440 2023-10-09T06:57:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.444+0000 7fe7ed39c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe7e8068890 0x7fe7e80c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.444+0000 7fe7e7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e815a440 0x7fe7e80acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.444+0000 7fe7ed39c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe7e8068890 0x7fe7e80c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:55338/0 (socket says 172.21.15.71:55338) 2023-10-09T06:57:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.444+0000 7fe7e7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e815a440 0x7fe7e80acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:36020/0 (socket says 172.21.15.71:36020) 2023-10-09T06:57:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.444+0000 7fe7ed39c700 1 -- 172.21.15.71:0/1990199036 learned_addr learned my addr 172.21.15.71:0/1990199036 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.444+0000 7fe7ecb9b700 1 --1- 172.21.15.71:0/1990199036 >> v1:172.21.15.179:6789/0 conn(0x7fe7e81563b0 0x7fe7e8156780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:56514/0 (socket says 172.21.15.71:56514) 2023-10-09T06:57:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.445+0000 7fe7e7fff700 1 -- 172.21.15.71:0/1990199036 >> v2:172.21.15.179:3300/0 conn(0x7fe7e8068890 msgr2=0x7fe7e80c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.445+0000 7fe7e7fff700 1 --2- 172.21.15.71:0/1990199036 >> v2:172.21.15.179:3300/0 conn(0x7fe7e8068890 0x7fe7e80c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.445+0000 7fe7e7fff700 1 -- 172.21.15.71:0/1990199036 >> v1:172.21.15.179:6789/0 conn(0x7fe7e81563b0 legacy=0x7fe7e8156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.445+0000 7fe7e77fe700 1 -- 172.21.15.71:0/1990199036 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229878022 0 0) 0x7fe7e815a9b0 con 0x7fe7e81563b0 2023-10-09T06:57:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.445+0000 7fe7e7fff700 1 -- 172.21.15.71:0/1990199036 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e815b250 con 0x7fe7e815a440 2023-10-09T06:57:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.445+0000 7fe7e7fff700 1 --2- 172.21.15.71:0/1990199036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e815a440 0x7fe7e80acf30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40098e0 tx=0x7fe7d40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65805f0407bc3384 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.445+0000 7fe7e77fe700 1 -- 172.21.15.71:0/1990199036 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d400b640 con 0x7fe7e815a440 2023-10-09T06:57:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.446+0000 7fe7e77fe700 1 -- 172.21.15.71:0/1990199036 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d400b7a0 con 0x7fe7e815a440 2023-10-09T06:57:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.446+0000 7fe7e77fe700 1 -- 172.21.15.71:0/1990199036 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d400bb40 con 0x7fe7e815a440 2023-10-09T06:57:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.446+0000 7fe7eedff700 1 -- 172.21.15.71:0/1990199036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e815a440 msgr2=0x7fe7e80acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.446+0000 7fe7eedff700 1 --2- 172.21.15.71:0/1990199036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e815a440 0x7fe7e80acf30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40098e0 tx=0x7fe7d40091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.446+0000 7fe7eedff700 1 -- 172.21.15.71:0/1990199036 shutdown_connections 2023-10-09T06:57:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.446+0000 7fe7eedff700 1 --2- 172.21.15.71:0/1990199036 >> v2:172.21.15.179:3300/0 conn(0x7fe7e8068890 0x7fe7e80c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.446+0000 7fe7eedff700 1 --2- 172.21.15.71:0/1990199036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e815a440 0x7fe7e80acf30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.446+0000 7fe7eedff700 1 -- 172.21.15.71:0/1990199036 >> 172.21.15.71:0/1990199036 conn(0x7fe7e80c8f90 msgr2=0x7fe7e80c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.446+0000 7fe7eedff700 1 -- 172.21.15.71:0/1990199036 shutdown_connections 2023-10-09T06:57:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.446+0000 7fe7eedff700 1 -- 172.21.15.71:0/1990199036 wait complete. 2023-10-09T06:57:11.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.448+0000 7fe7eedff700 1 Processor -- start 2023-10-09T06:57:11.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.448+0000 7fe7eedff700 1 -- start start 2023-10-09T06:57:11.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.449+0000 7fe7eedff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e8068890 0x7fe7e80b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.449+0000 7fe7eedff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7e81563b0 0x7fe7e814dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.449+0000 7fe7eedff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7e815a440 0x7fe7e80cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.449+0000 7fe7eedff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e80cc520 con 0x7fe7e815a440 2023-10-09T06:57:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.449+0000 7fe7eedff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e80cad90 con 0x7fe7e81563b0 2023-10-09T06:57:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.449+0000 7fe7eedff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e814e4e0 con 0x7fe7e8068890 2023-10-09T06:57:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.449+0000 7fe7ed39c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7e815a440 0x7fe7e80cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.449+0000 7fe7ecb9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e8068890 0x7fe7e80b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.449+0000 7fe7ed39c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7e815a440 0x7fe7e80cb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38144/0 (socket says 172.21.15.71:38144) 2023-10-09T06:57:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.449+0000 7fe7ed39c700 1 -- 172.21.15.71:0/1247068791 learned_addr learned my addr 172.21.15.71:0/1247068791 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.449+0000 7fe7e7fff700 1 --2- 172.21.15.71:0/1247068791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7e81563b0 0x7fe7e814dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.449+0000 7fe7ed39c700 1 -- 172.21.15.71:0/1247068791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e8068890 msgr2=0x7fe7e80b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.449+0000 7fe7ed39c700 1 --2- 172.21.15.71:0/1247068791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e8068890 0x7fe7e80b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.449+0000 7fe7ed39c700 1 -- 172.21.15.71:0/1247068791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7e81563b0 msgr2=0x7fe7e814dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.449+0000 7fe7ed39c700 1 --2- 172.21.15.71:0/1247068791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7e81563b0 0x7fe7e814dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.449+0000 7fe7ed39c700 1 -- 172.21.15.71:0/1247068791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d4009420 con 0x7fe7e815a440 2023-10-09T06:57:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.450+0000 7fe7ed39c700 1 --2- 172.21.15.71:0/1247068791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7e815a440 0x7fe7e80cb220 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe7e00094d0 tx=0x7fe7e000d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.450+0000 7fe7e4ff9700 1 -- 172.21.15.71:0/1247068791 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e0010040 con 0x7fe7e815a440 2023-10-09T06:57:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.450+0000 7fe7e4ff9700 1 -- 172.21.15.71:0/1247068791 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e000b3f0 con 0x7fe7e815a440 2023-10-09T06:57:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.450+0000 7fe7e4ff9700 1 -- 172.21.15.71:0/1247068791 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e000eba0 con 0x7fe7e815a440 2023-10-09T06:57:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.450+0000 7fe7eedff700 1 -- 172.21.15.71:0/1247068791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e80ca180 con 0x7fe7e815a440 2023-10-09T06:57:11.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.450+0000 7fe7eedff700 1 -- 172.21.15.71:0/1247068791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e80ca740 con 0x7fe7e815a440 2023-10-09T06:57:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.451+0000 7fe7eedff700 1 -- 172.21.15.71:0/1247068791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e80caf20 con 0x7fe7e815a440 2023-10-09T06:57:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.452+0000 7fe7e4ff9700 1 -- 172.21.15.71:0/1247068791 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) v1 ==== 84578+0+0 (secure 0 0 0) 0x7fe7e0009610 con 0x7fe7e815a440 2023-10-09T06:57:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.453+0000 7fe7e4ff9700 1 --2- 172.21.15.71:0/1247068791 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe7cc066d80 0x7fe7cc069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.453+0000 7fe7e4ff9700 1 -- 172.21.15.71:0/1247068791 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6319+0+0 (secure 0 0 0) 0x7fe7e00847b0 con 0x7fe7e815a440 2023-10-09T06:57:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.453+0000 7fe7ecb9b700 1 --2- 172.21.15.71:0/1247068791 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe7cc066d80 0x7fe7cc069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.454+0000 7fe7ecb9b700 1 --2- 172.21.15.71:0/1247068791 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe7cc066d80 0x7fe7cc069230 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc007fd0 tx=0x7fe7dc007d50 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:11.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.457+0000 7fe7e4ff9700 1 -- 172.21.15.71:0/1247068791 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7e004d5a0 con 0x7fe7e815a440 2023-10-09T06:57:11.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:11.647+0000 7fe7eedff700 1 -- 172.21.15.71:0/1247068791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe7e80718b0 con 0x7fe7e815a440 2023-10-09T06:57:12.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.235+0000 7fe7e4ff9700 1 -- 172.21.15.71:0/1247068791 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe7e0086d00 con 0x7fe7e815a440 2023-10-09T06:57:12.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.242+0000 7fe7e4ff9700 1 -- 172.21.15.71:0/1247068791 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v70) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe7e0018120 con 0x7fe7e815a440 2023-10-09T06:57:12.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.246+0000 7fe7eedff700 1 -- 172.21.15.71:0/1247068791 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe7cc066d80 msgr2=0x7fe7cc069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:12.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.246+0000 7fe7eedff700 1 --2- 172.21.15.71:0/1247068791 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe7cc066d80 0x7fe7cc069230 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc007fd0 tx=0x7fe7dc007d50 comp rx=0 tx=0).stop 2023-10-09T06:57:12.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.246+0000 7fe7eedff700 1 -- 172.21.15.71:0/1247068791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7e815a440 msgr2=0x7fe7e80cb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:12.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.246+0000 7fe7eedff700 1 --2- 172.21.15.71:0/1247068791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7e815a440 0x7fe7e80cb220 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe7e00094d0 tx=0x7fe7e000d040 comp rx=0 tx=0).stop 2023-10-09T06:57:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.246+0000 7fe7eedff700 1 -- 172.21.15.71:0/1247068791 shutdown_connections 2023-10-09T06:57:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.246+0000 7fe7eedff700 1 --2- 172.21.15.71:0/1247068791 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe7cc066d80 0x7fe7cc069230 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.246+0000 7fe7eedff700 1 --2- 172.21.15.71:0/1247068791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7e815a440 0x7fe7e80cb220 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.246+0000 7fe7eedff700 1 --2- 172.21.15.71:0/1247068791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e8068890 0x7fe7e80b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.246+0000 7fe7eedff700 1 --2- 172.21.15.71:0/1247068791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7e81563b0 0x7fe7e814dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.246+0000 7fe7eedff700 1 -- 172.21.15.71:0/1247068791 >> 172.21.15.71:0/1247068791 conn(0x7fe7e80c8f90 msgr2=0x7fe7e8155760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.246+0000 7fe7eedff700 1 -- 172.21.15.71:0/1247068791 shutdown_connections 2023-10-09T06:57:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.246+0000 7fe7eedff700 1 -- 172.21.15.71:0/1247068791 wait complete. 2023-10-09T06:57:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' removed 2023-10-09T06:57:12.267 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T06:57:12.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.454+0000 7f938359d700 1 Processor -- start 2023-10-09T06:57:12.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.454+0000 7f938359d700 1 -- start start 2023-10-09T06:57:12.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.455+0000 7f938359d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f937c0b4e70 0x7f937c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:12.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.456+0000 7f938359d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f937c0b16d0 0x7f937c0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:12.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.456+0000 7f938359d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f937c0b2080 con 0x7f937c15d240 2023-10-09T06:57:12.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.456+0000 7f938359d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f937c0cfb00 con 0x7f937c0b16d0 2023-10-09T06:57:12.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.456+0000 7f938359d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937c0b5c40 con 0x7f937c0b4e70 2023-10-09T06:57:12.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.456+0000 7f9382d9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f937c15d240 0x7f937c15d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35396/0 (socket says 172.21.15.71:35396) 2023-10-09T06:57:12.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.456+0000 7f9382d9c700 1 -- 172.21.15.71:0/326299702 learned_addr learned my addr 172.21.15.71:0/326299702 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:12.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.456+0000 7f938259b700 1 --2- 172.21.15.71:0/326299702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f937c0b4e70 0x7f937c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:12.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.456+0000 7f9381d9a700 1 --2- 172.21.15.71:0/326299702 >> v2:172.21.15.179:3300/0 conn(0x7f937c0b16d0 0x7f937c0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:12.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.456+0000 7f9381599700 1 -- 172.21.15.71:0/326299702 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4091304156 0 0) 0x7f937c0b2080 con 0x7f937c15d240 2023-10-09T06:57:12.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.456+0000 7f9381599700 1 -- 172.21.15.71:0/326299702 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9368003570 con 0x7f937c15d240 2023-10-09T06:57:12.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.457+0000 7f9381599700 1 -- 172.21.15.71:0/326299702 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1050749227 0 0) 0x7f9368003570 con 0x7f937c15d240 2023-10-09T06:57:12.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.457+0000 7f9381599700 1 -- 172.21.15.71:0/326299702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f937c0b4e70 msgr2=0x7f937c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:12.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.457+0000 7f9381599700 1 --2- 172.21.15.71:0/326299702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f937c0b4e70 0x7f937c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:12.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.457+0000 7f9381599700 1 -- 172.21.15.71:0/326299702 >> v2:172.21.15.179:3300/0 conn(0x7f937c0b16d0 msgr2=0x7f937c0b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:12.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.457+0000 7f9381599700 1 --2- 172.21.15.71:0/326299702 >> v2:172.21.15.179:3300/0 conn(0x7f937c0b16d0 0x7f937c0b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:12.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.457+0000 7f9381599700 1 -- 172.21.15.71:0/326299702 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937c0b5f20 con 0x7f937c15d240 2023-10-09T06:57:12.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.457+0000 7f9381599700 1 -- 172.21.15.71:0/326299702 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f93740017f0 con 0x7f937c15d240 2023-10-09T06:57:12.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.457+0000 7f9381599700 1 -- 172.21.15.71:0/326299702 >> v1:172.21.15.71:6789/0 conn(0x7f937c15d240 legacy=0x7f937c15d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:12.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.457+0000 7f9381599700 1 --2- 172.21.15.71:0/326299702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9368003ae0 0x7f9368003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:12.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.457+0000 7f9381599700 1 --2- 172.21.15.71:0/326299702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9368004810 0x7f9368004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:12.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.457+0000 7f9381599700 1 --2- 172.21.15.71:0/326299702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f937c0b4e70 0x7f93680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:12.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.457+0000 7f9381599700 1 -- 172.21.15.71:0/326299702 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937c0cfb00 con 0x7f9368004810 2023-10-09T06:57:12.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.457+0000 7f9381599700 1 -- 172.21.15.71:0/326299702 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937c0b5c40 con 0x7f9368003ae0 2023-10-09T06:57:12.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.457+0000 7f9381599700 1 -- 172.21.15.71:0/326299702 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936800bb10 con 0x7f937c0b4e70 2023-10-09T06:57:12.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.457+0000 7f9381d9a700 1 --2- 172.21.15.71:0/326299702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9368004810 0x7f9368004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:12.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.457+0000 7f9382d9c700 1 --2- 172.21.15.71:0/326299702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f937c0b4e70 0x7f93680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:12.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.457+0000 7f938259b700 1 --2- 172.21.15.71:0/326299702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9368003ae0 0x7f9368003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:12.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.457+0000 7f9381d9a700 1 -- 172.21.15.71:0/326299702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f937c0b4e70 msgr2=0x7f93680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:12.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.457+0000 7f9381d9a700 1 --2- 172.21.15.71:0/326299702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f937c0b4e70 0x7f93680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:12.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.457+0000 7f9381d9a700 1 -- 172.21.15.71:0/326299702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9368003ae0 msgr2=0x7f9368003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:12.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.457+0000 7f9381d9a700 1 --2- 172.21.15.71:0/326299702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9368003ae0 0x7f9368003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:12.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.457+0000 7f9381d9a700 1 -- 172.21.15.71:0/326299702 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9368003570 con 0x7f9368004810 2023-10-09T06:57:12.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.458+0000 7f938259b700 1 --2- 172.21.15.71:0/326299702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9368003ae0 0x7f9368003ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:12.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.458+0000 7f9381d9a700 1 --2- 172.21.15.71:0/326299702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9368004810 0x7f9368004c80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f936c009c00 tx=0x7f936c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917eb78be6901341 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:12.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.458+0000 7f9381599700 1 -- 172.21.15.71:0/326299702 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c00e710 con 0x7f9368004810 2023-10-09T06:57:12.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.458+0000 7f9381599700 1 -- 172.21.15.71:0/326299702 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936c00e870 con 0x7f9368004810 2023-10-09T06:57:12.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.458+0000 7f9381599700 1 -- 172.21.15.71:0/326299702 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c00ec30 con 0x7f9368004810 2023-10-09T06:57:12.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.458+0000 7f938359d700 1 -- 172.21.15.71:0/326299702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9368004810 msgr2=0x7f9368004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:12.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.458+0000 7f938359d700 1 --2- 172.21.15.71:0/326299702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9368004810 0x7f9368004c80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f936c009c00 tx=0x7f936c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:12.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.458+0000 7f9382d9c700 1 -- 172.21.15.71:0/326299702 reap_dead start 2023-10-09T06:57:12.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.459+0000 7f938359d700 1 -- 172.21.15.71:0/326299702 shutdown_connections 2023-10-09T06:57:12.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.459+0000 7f938359d700 1 -- 172.21.15.71:0/326299702 >> 172.21.15.71:0/326299702 conn(0x7f937c0d10c0 msgr2=0x7f937c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:12.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.459+0000 7f938359d700 1 -- 172.21.15.71:0/326299702 shutdown_connections 2023-10-09T06:57:12.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.459+0000 7f938359d700 1 -- 172.21.15.71:0/326299702 wait complete. 2023-10-09T06:57:12.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.460+0000 7f938359d700 1 Processor -- start 2023-10-09T06:57:12.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.460+0000 7f938359d700 1 -- start start 2023-10-09T06:57:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.461+0000 7f938359d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9368004810 0x7f937c0c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.461+0000 7f938359d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f937c0c58d0 0x7f937c15bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.461+0000 7f938359d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f937c15c320 0x7f937c157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.461+0000 7f938359d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937c0c7470 con 0x7f937c15c320 2023-10-09T06:57:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.461+0000 7f938359d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937c0c5d70 con 0x7f937c0c58d0 2023-10-09T06:57:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.461+0000 7f938359d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937c0c6050 con 0x7f9368004810 2023-10-09T06:57:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.461+0000 7f9382d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f937c15c320 0x7f937c157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.461+0000 7f9382d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f937c15c320 0x7f937c157420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38162/0 (socket says 172.21.15.71:38162) 2023-10-09T06:57:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.461+0000 7f9382d9c700 1 -- 172.21.15.71:0/2586971236 learned_addr learned my addr 172.21.15.71:0/2586971236 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.462+0000 7f938259b700 1 --2- 172.21.15.71:0/2586971236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9368004810 0x7f937c0c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.462+0000 7f9381d9a700 1 --2- 172.21.15.71:0/2586971236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f937c0c58d0 0x7f937c15bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.462+0000 7f9382d9c700 1 -- 172.21.15.71:0/2586971236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9368004810 msgr2=0x7f937c0c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:12.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.462+0000 7f9382d9c700 1 --2- 172.21.15.71:0/2586971236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9368004810 0x7f937c0c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:12.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.462+0000 7f9382d9c700 1 -- 172.21.15.71:0/2586971236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f937c0c58d0 msgr2=0x7f937c15bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:12.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.462+0000 7f9382d9c700 1 --2- 172.21.15.71:0/2586971236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f937c0c58d0 0x7f937c15bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:12.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.462+0000 7f9382d9c700 1 -- 172.21.15.71:0/2586971236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937c0c6330 con 0x7f937c15c320 2023-10-09T06:57:12.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.462+0000 7f938259b700 1 --2- 172.21.15.71:0/2586971236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9368004810 0x7f937c0c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:12.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.462+0000 7f9382d9c700 1 --2- 172.21.15.71:0/2586971236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f937c15c320 0x7f937c157420 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f937c071380 tx=0x7f9374002140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:12.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.462+0000 7f93727fc700 1 -- 172.21.15.71:0/2586971236 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937400acb0 con 0x7f937c15c320 2023-10-09T06:57:12.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.462+0000 7f93727fc700 1 -- 172.21.15.71:0/2586971236 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937400ae30 con 0x7f937c15c320 2023-10-09T06:57:12.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.462+0000 7f938359d700 1 -- 172.21.15.71:0/2586971236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f937c0c70e0 con 0x7f937c15c320 2023-10-09T06:57:12.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.462+0000 7f93727fc700 1 -- 172.21.15.71:0/2586971236 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9374013640 con 0x7f937c15c320 2023-10-09T06:57:12.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.462+0000 7f938359d700 1 -- 172.21.15.71:0/2586971236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f937c0cb9d0 con 0x7f937c15c320 2023-10-09T06:57:12.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.463+0000 7f938359d700 1 -- 172.21.15.71:0/2586971236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f937c088990 con 0x7f937c15c320 2023-10-09T06:57:12.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.464+0000 7f93727fc700 1 -- 172.21.15.71:0/2586971236 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f93740139f0 con 0x7f937c15c320 2023-10-09T06:57:12.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.465+0000 7f93727fc700 1 --2- 172.21.15.71:0/2586971236 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9360066f30 0x7f93600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:12.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.465+0000 7f93727fc700 1 -- 172.21.15.71:0/2586971236 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5847+0+0 (secure 0 0 0) 0x7f9374084e30 con 0x7f937c15c320 2023-10-09T06:57:12.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.466+0000 7f938259b700 1 --2- 172.21.15.71:0/2586971236 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9360066f30 0x7f93600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:12.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.466+0000 7f938259b700 1 --2- 172.21.15.71:0/2586971236 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9360066f30 0x7f93600693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9378006dc0 tx=0x7f9378008040 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:12.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.469+0000 7f93727fc700 1 -- 172.21.15.71:0/2586971236 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9374052010 con 0x7f937c15c320 2023-10-09T06:57:12.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.660+0000 7f938359d700 1 -- 172.21.15.71:0/2586971236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f937c0c75b0 con 0x7f937c15c320 2023-10-09T06:57:12.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.664+0000 7f93727fc700 1 -- 172.21.15.71:0/2586971236 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9374055630 con 0x7f937c15c320 2023-10-09T06:57:12.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.667+0000 7f938359d700 1 -- 172.21.15.71:0/2586971236 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9360066f30 msgr2=0x7f93600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:12.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.667+0000 7f938359d700 1 --2- 172.21.15.71:0/2586971236 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9360066f30 0x7f93600693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9378006dc0 tx=0x7f9378008040 comp rx=0 tx=0).stop 2023-10-09T06:57:12.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.667+0000 7f938359d700 1 -- 172.21.15.71:0/2586971236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f937c15c320 msgr2=0x7f937c157420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:12.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.667+0000 7f938359d700 1 --2- 172.21.15.71:0/2586971236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f937c15c320 0x7f937c157420 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f937c071380 tx=0x7f9374002140 comp rx=0 tx=0).stop 2023-10-09T06:57:12.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.667+0000 7f938359d700 1 -- 172.21.15.71:0/2586971236 shutdown_connections 2023-10-09T06:57:12.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.667+0000 7f938359d700 1 --2- 172.21.15.71:0/2586971236 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9360066f30 0x7f93600693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:12.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.667+0000 7f938359d700 1 --2- 172.21.15.71:0/2586971236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f937c15c320 0x7f937c157420 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:12.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.667+0000 7f938359d700 1 --2- 172.21.15.71:0/2586971236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9368004810 0x7f937c0c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:12.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.667+0000 7f938359d700 1 --2- 172.21.15.71:0/2586971236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f937c0c58d0 0x7f937c15bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:12.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.667+0000 7f938359d700 1 -- 172.21.15.71:0/2586971236 >> 172.21.15.71:0/2586971236 conn(0x7f937c0d10c0 msgr2=0x7f937c15c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:12.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.667+0000 7f938359d700 1 -- 172.21.15.71:0/2586971236 shutdown_connections 2023-10-09T06:57:12.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.667+0000 7f938359d700 1 -- 172.21.15.71:0/2586971236 wait complete. 2023-10-09T06:57:12.685 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-09T06:57:12.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.871+0000 7f6570f9d700 1 Processor -- start 2023-10-09T06:57:12.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.871+0000 7f6570f9d700 1 -- start start 2023-10-09T06:57:12.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.872+0000 7f6570f9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f656c0c9db0 0x7f656c06a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:12.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.872+0000 7f6570f9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f656c06e150 con 0x7f656c153900 2023-10-09T06:57:12.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.872+0000 7f6570f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f656c0c7800 con 0x7f656c157130 2023-10-09T06:57:12.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.872+0000 7f6570f9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f656c0c7610 con 0x7f656c0c9db0 2023-10-09T06:57:12.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.872+0000 7f656affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f656c0c9db0 0x7f656c06a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:12.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.872+0000 7f656affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f656c0c9db0 0x7f656c06a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38176/0 (socket says 172.21.15.71:38176) 2023-10-09T06:57:12.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.872+0000 7f656affd700 1 -- 172.21.15.71:0/1017799379 learned_addr learned my addr 172.21.15.71:0/1017799379 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:12.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.873+0000 7f656affd700 1 -- 172.21.15.71:0/1017799379 >> v1:172.21.15.179:6789/0 conn(0x7f656c157130 legacy=0x7f656c06e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:12.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.873+0000 7f656affd700 1 -- 172.21.15.71:0/1017799379 >> v1:172.21.15.71:6789/0 conn(0x7f656c153900 legacy=0x7f656c0c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:12.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.873+0000 7f656affd700 1 -- 172.21.15.71:0/1017799379 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656c0c7ae0 con 0x7f656c0c9db0 2023-10-09T06:57:12.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.873+0000 7f656affd700 1 --2- 172.21.15.71:0/1017799379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f656c0c9db0 0x7f656c06a000 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f65600099b0 tx=0x7f6560009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb9202d06fc0eda server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:12.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.873+0000 7f656a7fc700 1 -- 172.21.15.71:0/1017799379 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656000b820 con 0x7f656c0c9db0 2023-10-09T06:57:12.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.873+0000 7f656a7fc700 1 -- 172.21.15.71:0/1017799379 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656000b980 con 0x7f656c0c9db0 2023-10-09T06:57:12.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.873+0000 7f656a7fc700 1 -- 172.21.15.71:0/1017799379 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656000bd20 con 0x7f656c0c9db0 2023-10-09T06:57:12.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.874+0000 7f6570f9d700 1 -- 172.21.15.71:0/1017799379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f656c0c9db0 msgr2=0x7f656c06a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:12.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.874+0000 7f6570f9d700 1 --2- 172.21.15.71:0/1017799379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f656c0c9db0 0x7f656c06a000 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f65600099b0 tx=0x7f6560009250 comp rx=0 tx=0).stop 2023-10-09T06:57:12.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.874+0000 7f6570f9d700 1 -- 172.21.15.71:0/1017799379 shutdown_connections 2023-10-09T06:57:12.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.874+0000 7f6570f9d700 1 --2- 172.21.15.71:0/1017799379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f656c0c9db0 0x7f656c06a000 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:12.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.874+0000 7f6570f9d700 1 -- 172.21.15.71:0/1017799379 >> 172.21.15.71:0/1017799379 conn(0x7f656c0cc1e0 msgr2=0x7f656c0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:12.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.874+0000 7f6570f9d700 1 -- 172.21.15.71:0/1017799379 shutdown_connections 2023-10-09T06:57:12.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.874+0000 7f6570f9d700 1 -- 172.21.15.71:0/1017799379 wait complete. 2023-10-09T06:57:12.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.875+0000 7f6570f9d700 1 Processor -- start 2023-10-09T06:57:12.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.875+0000 7f6570f9d700 1 -- start start 2023-10-09T06:57:12.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.876+0000 7f6570f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f656c0c9db0 0x7f656c145160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:12.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.876+0000 7f6570f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f656c153900 0x7f656c0cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:12.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.876+0000 7f6570f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f656c157130 0x7f656c0cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:12.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.876+0000 7f6570f9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656c16b460 con 0x7f656c157130 2023-10-09T06:57:12.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.876+0000 7f6570f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656c0af090 con 0x7f656c153900 2023-10-09T06:57:12.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.876+0000 7f6570f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656c1591a0 con 0x7f656c0c9db0 2023-10-09T06:57:12.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.876+0000 7f656bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f656c157130 0x7f656c0cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:12.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.876+0000 7f656bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f656c157130 0x7f656c0cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38178/0 (socket says 172.21.15.71:38178) 2023-10-09T06:57:12.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.876+0000 7f656bfff700 1 -- 172.21.15.71:0/1840144737 learned_addr learned my addr 172.21.15.71:0/1840144737 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:12.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.877+0000 7f656affd700 1 --2- 172.21.15.71:0/1840144737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f656c153900 0x7f656c0cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:12.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.877+0000 7f656bfff700 1 -- 172.21.15.71:0/1840144737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f656c0c9db0 msgr2=0x7f656c145160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:12.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.877+0000 7f656b7fe700 1 --2- 172.21.15.71:0/1840144737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f656c0c9db0 0x7f656c145160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:12.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.877+0000 7f656bfff700 1 --2- 172.21.15.71:0/1840144737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f656c0c9db0 0x7f656c145160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:12.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.877+0000 7f656bfff700 1 -- 172.21.15.71:0/1840144737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f656c153900 msgr2=0x7f656c0cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:12.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.877+0000 7f656bfff700 1 --2- 172.21.15.71:0/1840144737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f656c153900 0x7f656c0cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:12.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.877+0000 7f656bfff700 1 -- 172.21.15.71:0/1840144737 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65600094f0 con 0x7f656c157130 2023-10-09T06:57:12.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.877+0000 7f656affd700 1 --2- 172.21.15.71:0/1840144737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f656c153900 0x7f656c0cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:57:12.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.877+0000 7f656b7fe700 1 --2- 172.21.15.71:0/1840144737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f656c0c9db0 0x7f656c145160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:57:12.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.877+0000 7f656bfff700 1 --2- 172.21.15.71:0/1840144737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f656c157130 0x7f656c0cb370 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f656400bc30 tx=0x7f6564009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:12.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.877+0000 7f65537fe700 1 -- 172.21.15.71:0/1840144737 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656400ca40 con 0x7f656c157130 2023-10-09T06:57:12.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.877+0000 7f65537fe700 1 -- 172.21.15.71:0/1840144737 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656400cbe0 con 0x7f656c157130 2023-10-09T06:57:12.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.877+0000 7f65537fe700 1 -- 172.21.15.71:0/1840144737 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6564014410 con 0x7f656c157130 2023-10-09T06:57:12.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.877+0000 7f6570f9d700 1 -- 172.21.15.71:0/1840144737 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f656c16af10 con 0x7f656c157130 2023-10-09T06:57:12.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.878+0000 7f6570f9d700 1 -- 172.21.15.71:0/1840144737 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f656c0abe60 con 0x7f656c157130 2023-10-09T06:57:12.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.879+0000 7f6570f9d700 1 -- 172.21.15.71:0/1840144737 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f656c06c450 con 0x7f656c157130 2023-10-09T06:57:12.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.879+0000 7f65537fe700 1 -- 172.21.15.71:0/1840144737 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6564014800 con 0x7f656c157130 2023-10-09T06:57:12.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.880+0000 7f65537fe700 1 --2- 172.21.15.71:0/1840144737 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6558066f30 0x7f65580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:12.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.880+0000 7f65537fe700 1 -- 172.21.15.71:0/1840144737 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5847+0+0 (secure 0 0 0) 0x7f6564084730 con 0x7f656c157130 2023-10-09T06:57:12.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.881+0000 7f656b7fe700 1 --2- 172.21.15.71:0/1840144737 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6558066f30 0x7f65580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:12.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.881+0000 7f656b7fe700 1 --2- 172.21.15.71:0/1840144737 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6558066f30 0x7f65580693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f656c0cba30 tx=0x7f655c009040 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:12.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:12.884+0000 7f65537fe700 1 -- 172.21.15.71:0/1840144737 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f656404c5a0 con 0x7f656c157130 2023-10-09T06:57:13.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.077+0000 7f6570f9d700 1 -- 172.21.15.71:0/1840144737 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f656c0c7dc0 con 0x7f656c157130 2023-10-09T06:57:13.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.081+0000 7f65537fe700 1 -- 172.21.15.71:0/1840144737 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v20) v1 ==== 115+0+0 (secure 0 0 0) 0x7f65640553a0 con 0x7f656c157130 2023-10-09T06:57:13.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.083+0000 7f6570f9d700 1 -- 172.21.15.71:0/1840144737 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6558066f30 msgr2=0x7f65580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:13.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.083+0000 7f6570f9d700 1 --2- 172.21.15.71:0/1840144737 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6558066f30 0x7f65580693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f656c0cba30 tx=0x7f655c009040 comp rx=0 tx=0).stop 2023-10-09T06:57:13.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.083+0000 7f6570f9d700 1 -- 172.21.15.71:0/1840144737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f656c157130 msgr2=0x7f656c0cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:13.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.083+0000 7f6570f9d700 1 --2- 172.21.15.71:0/1840144737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f656c157130 0x7f656c0cb370 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f656400bc30 tx=0x7f6564009820 comp rx=0 tx=0).stop 2023-10-09T06:57:13.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.083+0000 7f6570f9d700 1 -- 172.21.15.71:0/1840144737 shutdown_connections 2023-10-09T06:57:13.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.083+0000 7f6570f9d700 1 --2- 172.21.15.71:0/1840144737 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6558066f30 0x7f65580693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:13.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.083+0000 7f6570f9d700 1 --2- 172.21.15.71:0/1840144737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f656c157130 0x7f656c0cb370 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:13.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.083+0000 7f6570f9d700 1 --2- 172.21.15.71:0/1840144737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f656c0c9db0 0x7f656c145160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:13.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.083+0000 7f6570f9d700 1 --2- 172.21.15.71:0/1840144737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f656c153900 0x7f656c0cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:13.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.083+0000 7f6570f9d700 1 -- 172.21.15.71:0/1840144737 >> 172.21.15.71:0/1840144737 conn(0x7f656c0cc1e0 msgr2=0x7f656c1470d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:13.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.083+0000 7f6570f9d700 1 -- 172.21.15.71:0/1840144737 shutdown_connections 2023-10-09T06:57:13.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.083+0000 7f6570f9d700 1 -- 172.21.15.71:0/1840144737 wait complete. 2023-10-09T06:57:13.101 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-09T06:57:13.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.282+0000 7f3059fff700 1 Processor -- start 2023-10-09T06:57:13.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.282+0000 7f3059fff700 1 -- start start 2023-10-09T06:57:13.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.283+0000 7f3059fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3054155eb0 0x7f305406e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:13.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.283+0000 7f3059fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3054069770 0x7f3054069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:13.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.283+0000 7f3059fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3054156320 con 0x7f30540c70b0 2023-10-09T06:57:13.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.283+0000 7f3059fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30540cd350 con 0x7f3054155eb0 2023-10-09T06:57:13.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.283+0000 7f3059fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f305406a130 con 0x7f3054069770 2023-10-09T06:57:13.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.284+0000 7f30537fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f30540c70b0 0x7f30540ccc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35416/0 (socket says 172.21.15.71:35416) 2023-10-09T06:57:13.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.284+0000 7f30537fe700 1 -- 172.21.15.71:0/1176855901 learned_addr learned my addr 172.21.15.71:0/1176855901 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:13.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.284+0000 7f3052ffd700 1 --2- 172.21.15.71:0/1176855901 >> v2:172.21.15.71:3300/0 conn(0x7f3054155eb0 0x7f305406e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:13.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.284+0000 7f3053fff700 1 --2- 172.21.15.71:0/1176855901 >> v2:172.21.15.179:3300/0 conn(0x7f3054069770 0x7f3054069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:13.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.284+0000 7f30527fc700 1 -- 172.21.15.71:0/1176855901 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438877893 0 0) 0x7f3054156320 con 0x7f30540c70b0 2023-10-09T06:57:13.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.284+0000 7f30527fc700 1 -- 172.21.15.71:0/1176855901 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f303c003570 con 0x7f30540c70b0 2023-10-09T06:57:13.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.284+0000 7f3052ffd700 1 -- 172.21.15.71:0/1176855901 >> v2:172.21.15.179:3300/0 conn(0x7f3054069770 msgr2=0x7f3054069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:13.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.284+0000 7f3052ffd700 1 --2- 172.21.15.71:0/1176855901 >> v2:172.21.15.179:3300/0 conn(0x7f3054069770 0x7f3054069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:13.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.284+0000 7f3052ffd700 1 -- 172.21.15.71:0/1176855901 >> v1:172.21.15.71:6789/0 conn(0x7f30540c70b0 legacy=0x7f30540ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:13.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.284+0000 7f3052ffd700 1 -- 172.21.15.71:0/1176855901 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305406eb90 con 0x7f3054155eb0 2023-10-09T06:57:13.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.284+0000 7f3053fff700 1 --2- 172.21.15.71:0/1176855901 >> v2:172.21.15.179:3300/0 conn(0x7f3054069770 0x7f3054069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:13.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.285+0000 7f3052ffd700 1 --2- 172.21.15.71:0/1176855901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3054155eb0 0x7f305406e240 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f30540cc450 tx=0x7f30480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3b80bad2144b3c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:13.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.285+0000 7f30527fc700 1 -- 172.21.15.71:0/1176855901 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3048011630 con 0x7f3054155eb0 2023-10-09T06:57:13.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.285+0000 7f30527fc700 1 -- 172.21.15.71:0/1176855901 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3048011790 con 0x7f3054155eb0 2023-10-09T06:57:13.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.285+0000 7f30527fc700 1 -- 172.21.15.71:0/1176855901 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3048011b30 con 0x7f3054155eb0 2023-10-09T06:57:13.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.285+0000 7f3059fff700 1 -- 172.21.15.71:0/1176855901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3054155eb0 msgr2=0x7f305406e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:13.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.285+0000 7f3059fff700 1 --2- 172.21.15.71:0/1176855901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3054155eb0 0x7f305406e240 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f30540cc450 tx=0x7f30480091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:13.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.285+0000 7f3059fff700 1 -- 172.21.15.71:0/1176855901 shutdown_connections 2023-10-09T06:57:13.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.285+0000 7f3059fff700 1 --2- 172.21.15.71:0/1176855901 >> v2:172.21.15.179:3300/0 conn(0x7f3054069770 0x7f3054069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:13.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.285+0000 7f3059fff700 1 --2- 172.21.15.71:0/1176855901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3054155eb0 0x7f305406e240 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:13.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.285+0000 7f3059fff700 1 -- 172.21.15.71:0/1176855901 >> 172.21.15.71:0/1176855901 conn(0x7f3054068e10 msgr2=0x7f30540cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:13.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.285+0000 7f3059fff700 1 -- 172.21.15.71:0/1176855901 shutdown_connections 2023-10-09T06:57:13.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.285+0000 7f3059fff700 1 -- 172.21.15.71:0/1176855901 wait complete. 2023-10-09T06:57:13.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.287+0000 7f3059fff700 1 Processor -- start 2023-10-09T06:57:13.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.287+0000 7f3059fff700 1 -- start start 2023-10-09T06:57:13.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.288+0000 7f3059fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3054069770 0x7f3054156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:13.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.288+0000 7f3059fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30540c70b0 0x7f3054150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:13.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.288+0000 7f3059fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3054155eb0 0x7f30540cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:13.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.288+0000 7f3059fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3054157ff0 con 0x7f3054155eb0 2023-10-09T06:57:13.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.288+0000 7f3059fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3054157180 con 0x7f3054069770 2023-10-09T06:57:13.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.288+0000 7f3059fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3054157460 con 0x7f30540c70b0 2023-10-09T06:57:13.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.288+0000 7f3053fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3054155eb0 0x7f30540cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:13.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.288+0000 7f3053fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3054155eb0 0x7f30540cafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38186/0 (socket says 172.21.15.71:38186) 2023-10-09T06:57:13.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.288+0000 7f3053fff700 1 -- 172.21.15.71:0/1446881317 learned_addr learned my addr 172.21.15.71:0/1446881317 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:13.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.288+0000 7f30537fe700 1 --2- 172.21.15.71:0/1446881317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3054069770 0x7f3054156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:13.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.288+0000 7f3052ffd700 1 --2- 172.21.15.71:0/1446881317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30540c70b0 0x7f3054150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:13.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.288+0000 7f3053fff700 1 -- 172.21.15.71:0/1446881317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30540c70b0 msgr2=0x7f3054150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:13.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.288+0000 7f3053fff700 1 --2- 172.21.15.71:0/1446881317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30540c70b0 0x7f3054150330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:13.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.288+0000 7f3053fff700 1 -- 172.21.15.71:0/1446881317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3054069770 msgr2=0x7f3054156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:13.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.288+0000 7f3053fff700 1 --2- 172.21.15.71:0/1446881317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3054069770 0x7f3054156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:13.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.288+0000 7f3053fff700 1 -- 172.21.15.71:0/1446881317 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3048009420 con 0x7f3054155eb0 2023-10-09T06:57:13.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.289+0000 7f3053fff700 1 --2- 172.21.15.71:0/1446881317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3054155eb0 0x7f30540cafb0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f304c009fc0 tx=0x7f304c0099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:13.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.289+0000 7f303b7fe700 1 -- 172.21.15.71:0/1446881317 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c00dd40 con 0x7f3054155eb0 2023-10-09T06:57:13.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.289+0000 7f303b7fe700 1 -- 172.21.15.71:0/1446881317 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c00f040 con 0x7f3054155eb0 2023-10-09T06:57:13.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.289+0000 7f3059fff700 1 -- 172.21.15.71:0/1446881317 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3054157740 con 0x7f3054155eb0 2023-10-09T06:57:13.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.289+0000 7f303b7fe700 1 -- 172.21.15.71:0/1446881317 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c015690 con 0x7f3054155eb0 2023-10-09T06:57:13.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.289+0000 7f3059fff700 1 -- 172.21.15.71:0/1446881317 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3054156d50 con 0x7f3054155eb0 2023-10-09T06:57:13.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.290+0000 7f3059fff700 1 -- 172.21.15.71:0/1446881317 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f305404c3c0 con 0x7f3054155eb0 2023-10-09T06:57:13.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.291+0000 7f303b7fe700 1 -- 172.21.15.71:0/1446881317 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f304c01e3b0 con 0x7f3054155eb0 2023-10-09T06:57:13.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.292+0000 7f303b7fe700 1 --2- 172.21.15.71:0/1446881317 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3040066f30 0x7f30400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:13.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.292+0000 7f303b7fe700 1 -- 172.21.15.71:0/1446881317 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5847+0+0 (secure 0 0 0) 0x7f304c084bb0 con 0x7f3054155eb0 2023-10-09T06:57:13.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.293+0000 7f30537fe700 1 --2- 172.21.15.71:0/1446881317 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3040066f30 0x7f30400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:13.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.293+0000 7f30537fe700 1 --2- 172.21.15.71:0/1446881317 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3040066f30 0x7f30400693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f30440058d0 tx=0x7f3044009040 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:13.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.296+0000 7f303b7fe700 1 -- 172.21.15.71:0/1446881317 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f304c051cf0 con 0x7f3054155eb0 2023-10-09T06:57:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.492+0000 7f3059fff700 1 -- 172.21.15.71:0/1446881317 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f3054158130 con 0x7f3054155eb0 2023-10-09T06:57:13.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.496+0000 7f303b7fe700 1 -- 172.21.15.71:0/1446881317 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v21) v1 ==== 120+0+0 (secure 0 0 0) 0x7f304c055310 con 0x7f3054155eb0 2023-10-09T06:57:13.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.499+0000 7f3059fff700 1 -- 172.21.15.71:0/1446881317 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3040066f30 msgr2=0x7f30400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:13.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.499+0000 7f3059fff700 1 --2- 172.21.15.71:0/1446881317 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3040066f30 0x7f30400693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f30440058d0 tx=0x7f3044009040 comp rx=0 tx=0).stop 2023-10-09T06:57:13.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.499+0000 7f3059fff700 1 -- 172.21.15.71:0/1446881317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3054155eb0 msgr2=0x7f30540cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:13.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.499+0000 7f3059fff700 1 --2- 172.21.15.71:0/1446881317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3054155eb0 0x7f30540cafb0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f304c009fc0 tx=0x7f304c0099b0 comp rx=0 tx=0).stop 2023-10-09T06:57:13.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.499+0000 7f3059fff700 1 -- 172.21.15.71:0/1446881317 shutdown_connections 2023-10-09T06:57:13.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.499+0000 7f3059fff700 1 --2- 172.21.15.71:0/1446881317 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3040066f30 0x7f30400693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:13.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.499+0000 7f3059fff700 1 --2- 172.21.15.71:0/1446881317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3054155eb0 0x7f30540cafb0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:13.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.499+0000 7f3059fff700 1 --2- 172.21.15.71:0/1446881317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3054069770 0x7f3054156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:13.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.499+0000 7f3059fff700 1 --2- 172.21.15.71:0/1446881317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30540c70b0 0x7f3054150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:13.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.499+0000 7f3059fff700 1 -- 172.21.15.71:0/1446881317 >> 172.21.15.71:0/1446881317 conn(0x7f3054068e10 msgr2=0x7f30540c55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:13.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.499+0000 7f3059fff700 1 -- 172.21.15.71:0/1446881317 shutdown_connections 2023-10-09T06:57:13.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.499+0000 7f3059fff700 1 -- 172.21.15.71:0/1446881317 wait complete. 2023-10-09T06:57:13.517 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-10-09T06:57:13.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.695+0000 7f2374dff700 1 Processor -- start 2023-10-09T06:57:13.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.696+0000 7f2374dff700 1 -- start start 2023-10-09T06:57:13.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.697+0000 7f2374dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f23700ccf90 0x7f23700ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:13.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.697+0000 7f2374dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23700cc300 con 0x7f23700cbf30 2023-10-09T06:57:13.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.697+0000 7f2374dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23700ad370 con 0x7f23700b1420 2023-10-09T06:57:13.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.697+0000 7f2374dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2370156bf0 con 0x7f23700ccf90 2023-10-09T06:57:13.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.697+0000 7f236e59c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f23700cbf30 0x7f23700b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35426/0 (socket says 172.21.15.71:35426) 2023-10-09T06:57:13.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.697+0000 7f236e59c700 1 -- 172.21.15.71:0/1127298271 learned_addr learned my addr 172.21.15.71:0/1127298271 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:13.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.697+0000 7f236ed9d700 1 --2- 172.21.15.71:0/1127298271 >> v2:172.21.15.179:3300/0 conn(0x7f23700ccf90 0x7f23700ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:13.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.697+0000 7f236d59a700 1 -- 172.21.15.71:0/1127298271 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088429905 0 0) 0x7f23700cc300 con 0x7f23700cbf30 2023-10-09T06:57:13.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.698+0000 7f236d59a700 1 -- 172.21.15.71:0/1127298271 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2358003570 con 0x7f23700cbf30 2023-10-09T06:57:13.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.698+0000 7f236d59a700 1 -- 172.21.15.71:0/1127298271 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3685964526 0 0) 0x7f2358003570 con 0x7f23700cbf30 2023-10-09T06:57:13.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.698+0000 7f236ed9d700 1 -- 172.21.15.71:0/1127298271 >> v1:172.21.15.179:6789/0 conn(0x7f23700b1420 legacy=0x7f23700c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:13.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.698+0000 7f236ed9d700 1 -- 172.21.15.71:0/1127298271 >> v1:172.21.15.71:6789/0 conn(0x7f23700cbf30 legacy=0x7f23700b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:13.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.698+0000 7f236ed9d700 1 -- 172.21.15.71:0/1127298271 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23700ad650 con 0x7f23700ccf90 2023-10-09T06:57:13.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.698+0000 7f236ed9d700 1 --2- 172.21.15.71:0/1127298271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700ccf90 0x7f23700ae410 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2368009e60 tx=0x7f2368009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36ca6ef26d4ae519 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:13.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.699+0000 7f236d59a700 1 -- 172.21.15.71:0/1127298271 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236800e070 con 0x7f23700ccf90 2023-10-09T06:57:13.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.699+0000 7f236d59a700 1 -- 172.21.15.71:0/1127298271 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236800b850 con 0x7f23700ccf90 2023-10-09T06:57:13.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.699+0000 7f236d59a700 1 -- 172.21.15.71:0/1127298271 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2360001470 con 0x7f23700ccf90 2023-10-09T06:57:13.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.699+0000 7f2374dff700 1 -- 172.21.15.71:0/1127298271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700ccf90 msgr2=0x7f23700ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:13.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.699+0000 7f2374dff700 1 --2- 172.21.15.71:0/1127298271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700ccf90 0x7f23700ae410 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2368009e60 tx=0x7f2368009780 comp rx=0 tx=0).stop 2023-10-09T06:57:13.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.699+0000 7f2374dff700 1 -- 172.21.15.71:0/1127298271 shutdown_connections 2023-10-09T06:57:13.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.699+0000 7f2374dff700 1 --2- 172.21.15.71:0/1127298271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700ccf90 0x7f23700ae410 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:13.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.699+0000 7f2374dff700 1 -- 172.21.15.71:0/1127298271 >> 172.21.15.71:0/1127298271 conn(0x7f237006a320 msgr2=0x7f23700cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:13.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.699+0000 7f2374dff700 1 -- 172.21.15.71:0/1127298271 shutdown_connections 2023-10-09T06:57:13.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.699+0000 7f2374dff700 1 -- 172.21.15.71:0/1127298271 wait complete. 2023-10-09T06:57:13.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.701+0000 7f2374dff700 1 Processor -- start 2023-10-09T06:57:13.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.701+0000 7f2374dff700 1 -- start start 2023-10-09T06:57:13.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.702+0000 7f2374dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23700b1420 0x7f23700c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:13.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.702+0000 7f2374dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700cbf30 0x7f2370145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:13.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.702+0000 7f2374dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23700ccf90 0x7f2370146120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:13.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.702+0000 7f2374dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23700c4910 con 0x7f23700ccf90 2023-10-09T06:57:13.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.702+0000 7f2374dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23700c51b0 con 0x7f23700cbf30 2023-10-09T06:57:13.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.702+0000 7f2374dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23700c3c10 con 0x7f23700b1420 2023-10-09T06:57:13.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.702+0000 7f236ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23700ccf90 0x7f2370146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:13.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.702+0000 7f236ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23700ccf90 0x7f2370146120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38192/0 (socket says 172.21.15.71:38192) 2023-10-09T06:57:13.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.702+0000 7f236ed9d700 1 -- 172.21.15.71:0/3678222149 learned_addr learned my addr 172.21.15.71:0/3678222149 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:13.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.702+0000 7f236dd9b700 1 --2- 172.21.15.71:0/3678222149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700cbf30 0x7f2370145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:13.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.702+0000 7f236e59c700 1 --2- 172.21.15.71:0/3678222149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23700b1420 0x7f23700c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:13.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.702+0000 7f236ed9d700 1 -- 172.21.15.71:0/3678222149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23700b1420 msgr2=0x7f23700c7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:13.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.702+0000 7f236ed9d700 1 --2- 172.21.15.71:0/3678222149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23700b1420 0x7f23700c7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:13.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.702+0000 7f236ed9d700 1 -- 172.21.15.71:0/3678222149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700cbf30 msgr2=0x7f2370145be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:13.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.702+0000 7f236ed9d700 1 --2- 172.21.15.71:0/3678222149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700cbf30 0x7f2370145be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:13.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.702+0000 7f236ed9d700 1 -- 172.21.15.71:0/3678222149 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2368009a20 con 0x7f23700ccf90 2023-10-09T06:57:13.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.702+0000 7f236dd9b700 1 --2- 172.21.15.71:0/3678222149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700cbf30 0x7f2370145be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:13.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.703+0000 7f236ed9d700 1 --2- 172.21.15.71:0/3678222149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23700ccf90 0x7f2370146120 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2370064290 tx=0x7f2368017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:13.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.703+0000 7f235e7fc700 1 -- 172.21.15.71:0/3678222149 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2368012c90 con 0x7f23700ccf90 2023-10-09T06:57:13.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.703+0000 7f235e7fc700 1 -- 172.21.15.71:0/3678222149 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2368012e10 con 0x7f23700ccf90 2023-10-09T06:57:13.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.703+0000 7f2374dff700 1 -- 172.21.15.71:0/3678222149 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23700c4b60 con 0x7f23700ccf90 2023-10-09T06:57:13.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.703+0000 7f235e7fc700 1 -- 172.21.15.71:0/3678222149 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236801e6a0 con 0x7f23700ccf90 2023-10-09T06:57:13.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.703+0000 7f2374dff700 1 -- 172.21.15.71:0/3678222149 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23700c7980 con 0x7f23700ccf90 2023-10-09T06:57:13.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.704+0000 7f2374dff700 1 -- 172.21.15.71:0/3678222149 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23700c7b70 con 0x7f23700ccf90 2023-10-09T06:57:13.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.705+0000 7f235e7fc700 1 -- 172.21.15.71:0/3678222149 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f236801ea10 con 0x7f23700ccf90 2023-10-09T06:57:13.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.706+0000 7f235e7fc700 1 --2- 172.21.15.71:0/3678222149 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2350066f30 0x7f23500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:13.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.706+0000 7f235e7fc700 1 -- 172.21.15.71:0/3678222149 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5847+0+0 (secure 0 0 0) 0x7f2368086ac0 con 0x7f23700ccf90 2023-10-09T06:57:13.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.706+0000 7f236e59c700 1 --2- 172.21.15.71:0/3678222149 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2350066f30 0x7f23500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:13.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.707+0000 7f236e59c700 1 --2- 172.21.15.71:0/3678222149 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2350066f30 0x7f23500693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f23600011e0 tx=0x7f2360000bc0 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:13.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.710+0000 7f235e7fc700 1 -- 172.21.15.71:0/3678222149 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2368053c00 con 0x7f23700ccf90 2023-10-09T06:57:13.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:13.977+0000 7f2374dff700 1 -- 172.21.15.71:0/3678222149 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f237004c3c0 con 0x7f23700ccf90 2023-10-09T06:57:14.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.042+0000 7f235e7fc700 1 -- 172.21.15.71:0/3678222149 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v529) v1 ==== 154+0+0 (secure 0 0 0) 0x7f2368057220 con 0x7f23700ccf90 2023-10-09T06:57:14.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.045+0000 7f2374dff700 1 -- 172.21.15.71:0/3678222149 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2350066f30 msgr2=0x7f23500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:14.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.045+0000 7f2374dff700 1 --2- 172.21.15.71:0/3678222149 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2350066f30 0x7f23500693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f23600011e0 tx=0x7f2360000bc0 comp rx=0 tx=0).stop 2023-10-09T06:57:14.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.045+0000 7f2374dff700 1 -- 172.21.15.71:0/3678222149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23700ccf90 msgr2=0x7f2370146120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:14.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.045+0000 7f2374dff700 1 --2- 172.21.15.71:0/3678222149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23700ccf90 0x7f2370146120 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2370064290 tx=0x7f2368017000 comp rx=0 tx=0).stop 2023-10-09T06:57:14.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.045+0000 7f2374dff700 1 -- 172.21.15.71:0/3678222149 shutdown_connections 2023-10-09T06:57:14.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.045+0000 7f2374dff700 1 --2- 172.21.15.71:0/3678222149 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2350066f30 0x7f23500693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:14.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.045+0000 7f2374dff700 1 --2- 172.21.15.71:0/3678222149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23700ccf90 0x7f2370146120 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:14.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.045+0000 7f2374dff700 1 --2- 172.21.15.71:0/3678222149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23700b1420 0x7f23700c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:14.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.045+0000 7f2374dff700 1 --2- 172.21.15.71:0/3678222149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700cbf30 0x7f2370145be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:14.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.045+0000 7f2374dff700 1 -- 172.21.15.71:0/3678222149 >> 172.21.15.71:0/3678222149 conn(0x7f237006a320 msgr2=0x7f2370155ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:14.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.045+0000 7f2374dff700 1 -- 172.21.15.71:0/3678222149 shutdown_connections 2023-10-09T06:57:14.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.045+0000 7f2374dff700 1 -- 172.21.15.71:0/3678222149 wait complete. 2023-10-09T06:57:14.063 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots ... ok 2023-10-09T06:57:14.063 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing non-existing snap schedules failure 2023-10-09T06:57:14.064 INFO:tasks.cephfs_test_runner:test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-09T06:57:14.064 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-10-09T06:57:14.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.243+0000 7f180e1ff700 1 Processor -- start 2023-10-09T06:57:14.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.243+0000 7f180e1ff700 1 -- start start 2023-10-09T06:57:14.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.244+0000 7f180e1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1808155c10 0x7f1808155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:14.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.244+0000 7f180e1ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f18080ac6d0 0x7f18080b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:14.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.244+0000 7f180e1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18080acac0 con 0x7f18080ac230 2023-10-09T06:57:14.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.244+0000 7f180e1ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18080ad930 con 0x7f18080ac6d0 2023-10-09T06:57:14.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.244+0000 7f180e1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18080acd20 con 0x7f1808155c10 2023-10-09T06:57:14.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.244+0000 7f1807fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f18080ac6d0 0x7f18080b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:14.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.244+0000 7f1807fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f18080ac6d0 0x7f18080b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38204/0 (socket says 172.21.15.71:38204) 2023-10-09T06:57:14.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.244+0000 7f1807fff700 1 -- 172.21.15.71:0/3228646771 learned_addr learned my addr 172.21.15.71:0/3228646771 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:14.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.245+0000 7f18077fe700 1 --2- 172.21.15.71:0/3228646771 >> v2:172.21.15.179:3300/0 conn(0x7f1808155c10 0x7f1808155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:14.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.245+0000 7f1807fff700 1 -- 172.21.15.71:0/3228646771 >> v2:172.21.15.179:3300/0 conn(0x7f1808155c10 msgr2=0x7f1808155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:14.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.245+0000 7f1807fff700 1 --2- 172.21.15.71:0/3228646771 >> v2:172.21.15.179:3300/0 conn(0x7f1808155c10 0x7f1808155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:14.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.245+0000 7f1807fff700 1 -- 172.21.15.71:0/3228646771 >> v1:172.21.15.179:6789/0 conn(0x7f18080ac230 legacy=0x7f18081568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:14.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.245+0000 7f1807fff700 1 -- 172.21.15.71:0/3228646771 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18080ad000 con 0x7f18080ac6d0 2023-10-09T06:57:14.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.245+0000 7f1807fff700 1 --2- 172.21.15.71:0/3228646771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18080ac6d0 0x7f18080b0300 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1808063d40 tx=0x7f1800009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b738ea69966a8820 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:14.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.245+0000 7f18067fc700 1 -- 172.21.15.71:0/3228646771 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180000e070 con 0x7f18080ac6d0 2023-10-09T06:57:14.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.245+0000 7f18067fc700 1 -- 172.21.15.71:0/3228646771 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180000ba20 con 0x7f18080ac6d0 2023-10-09T06:57:14.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.245+0000 7f18067fc700 1 -- 172.21.15.71:0/3228646771 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18000092e0 con 0x7f18080ac6d0 2023-10-09T06:57:14.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.246+0000 7f180e1ff700 1 -- 172.21.15.71:0/3228646771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18080ac6d0 msgr2=0x7f18080b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:14.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.246+0000 7f180e1ff700 1 --2- 172.21.15.71:0/3228646771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18080ac6d0 0x7f18080b0300 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1808063d40 tx=0x7f1800009840 comp rx=0 tx=0).stop 2023-10-09T06:57:14.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.246+0000 7f180e1ff700 1 -- 172.21.15.71:0/3228646771 shutdown_connections 2023-10-09T06:57:14.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.246+0000 7f180e1ff700 1 --2- 172.21.15.71:0/3228646771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18080ac6d0 0x7f18080b0300 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:14.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.246+0000 7f180e1ff700 1 --2- 172.21.15.71:0/3228646771 >> v2:172.21.15.179:3300/0 conn(0x7f1808155c10 0x7f1808155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:14.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.246+0000 7f180e1ff700 1 -- 172.21.15.71:0/3228646771 >> 172.21.15.71:0/3228646771 conn(0x7f180806a320 msgr2=0x7f18080cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:14.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.246+0000 7f180e1ff700 1 -- 172.21.15.71:0/3228646771 shutdown_connections 2023-10-09T06:57:14.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.246+0000 7f180e1ff700 1 -- 172.21.15.71:0/3228646771 wait complete. 2023-10-09T06:57:14.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.247+0000 7f180e1ff700 1 Processor -- start 2023-10-09T06:57:14.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.248+0000 7f180e1ff700 1 -- start start 2023-10-09T06:57:14.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.249+0000 7f180e1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18080ac230 0x7f18080cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:14.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.249+0000 7f180e1ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18080ac6d0 0x7f180806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:14.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.249+0000 7f180e1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1808155c10 0x7f18081526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:14.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.249+0000 7f180e1ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180816d1d0 con 0x7f18080ac6d0 2023-10-09T06:57:14.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.249+0000 7f180e1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180816a140 con 0x7f1808155c10 2023-10-09T06:57:14.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.249+0000 7f180e1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180816a420 con 0x7f18080ac230 2023-10-09T06:57:14.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.249+0000 7f1806ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18080ac6d0 0x7f180806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:14.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.249+0000 7f1806ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18080ac6d0 0x7f180806dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38210/0 (socket says 172.21.15.71:38210) 2023-10-09T06:57:14.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.249+0000 7f1806ffd700 1 -- 172.21.15.71:0/786347115 learned_addr learned my addr 172.21.15.71:0/786347115 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:14.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.249+0000 7f1807fff700 1 --2- 172.21.15.71:0/786347115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1808155c10 0x7f18081526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:14.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.249+0000 7f18077fe700 1 --2- 172.21.15.71:0/786347115 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18080ac230 0x7f18080cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:14.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.249+0000 7f1806ffd700 1 -- 172.21.15.71:0/786347115 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18080ac230 msgr2=0x7f18080cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:14.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.249+0000 7f1806ffd700 1 --2- 172.21.15.71:0/786347115 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18080ac230 0x7f18080cb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:14.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.249+0000 7f1806ffd700 1 -- 172.21.15.71:0/786347115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1808155c10 msgr2=0x7f18081526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:14.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.249+0000 7f1806ffd700 1 --2- 172.21.15.71:0/786347115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1808155c10 0x7f18081526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:14.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.249+0000 7f1806ffd700 1 -- 172.21.15.71:0/786347115 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1800009ae0 con 0x7f18080ac6d0 2023-10-09T06:57:14.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.249+0000 7f1807fff700 1 --2- 172.21.15.71:0/786347115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1808155c10 0x7f18081526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:57:14.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.249+0000 7f1806ffd700 1 --2- 172.21.15.71:0/786347115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18080ac6d0 0x7f180806dd10 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00c590 tx=0x7f17fc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:14.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.250+0000 7f17ef7fe700 1 -- 172.21.15.71:0/786347115 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc011590 con 0x7f18080ac6d0 2023-10-09T06:57:14.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.250+0000 7f17ef7fe700 1 -- 172.21.15.71:0/786347115 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17fc0116f0 con 0x7f18080ac6d0 2023-10-09T06:57:14.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.250+0000 7f180e1ff700 1 -- 172.21.15.71:0/786347115 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180816a700 con 0x7f18080ac6d0 2023-10-09T06:57:14.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.250+0000 7f17ef7fe700 1 -- 172.21.15.71:0/786347115 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc011ab0 con 0x7f18080ac6d0 2023-10-09T06:57:14.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.250+0000 7f180e1ff700 1 -- 172.21.15.71:0/786347115 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18080cb600 con 0x7f18080ac6d0 2023-10-09T06:57:14.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.251+0000 7f180e1ff700 1 -- 172.21.15.71:0/786347115 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180804c3c0 con 0x7f18080ac6d0 2023-10-09T06:57:14.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.252+0000 7f17ef7fe700 1 -- 172.21.15.71:0/786347115 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f17fc01b3b0 con 0x7f18080ac6d0 2023-10-09T06:57:14.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.252+0000 7f17ef7fe700 1 --2- 172.21.15.71:0/786347115 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f17f4066f60 0x7f17f4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:14.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.252+0000 7f17ef7fe700 1 -- 172.21.15.71:0/786347115 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5847+0+0 (secure 0 0 0) 0x7f17fc083c10 con 0x7f18080ac6d0 2023-10-09T06:57:14.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.253+0000 7f18077fe700 1 --2- 172.21.15.71:0/786347115 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f17f4066f60 0x7f17f4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:14.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.254+0000 7f18077fe700 1 --2- 172.21.15.71:0/786347115 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f17f4066f60 0x7f17f4069410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f17f8006f00 tx=0x7f17f8008040 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:14.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.257+0000 7f17ef7fe700 1 -- 172.21.15.71:0/786347115 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17fc050d50 con 0x7f18080ac6d0 2023-10-09T06:57:14.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:14.523+0000 7f180e1ff700 1 -- 172.21.15.71:0/786347115 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f18080ad2e0 con 0x7f18080ac6d0 2023-10-09T06:57:15.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.047+0000 7f17ef7fe700 1 -- 172.21.15.71:0/786347115 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v530) v1 ==== 159+0+0 (secure 0 0 0) 0x7f17fc017070 con 0x7f18080ac6d0 2023-10-09T06:57:15.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.049+0000 7f180e1ff700 1 -- 172.21.15.71:0/786347115 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f17f4066f60 msgr2=0x7f17f4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:15.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.049+0000 7f180e1ff700 1 --2- 172.21.15.71:0/786347115 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f17f4066f60 0x7f17f4069410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f17f8006f00 tx=0x7f17f8008040 comp rx=0 tx=0).stop 2023-10-09T06:57:15.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.049+0000 7f180e1ff700 1 -- 172.21.15.71:0/786347115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18080ac6d0 msgr2=0x7f180806dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:15.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.050+0000 7f180e1ff700 1 --2- 172.21.15.71:0/786347115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18080ac6d0 0x7f180806dd10 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00c590 tx=0x7f17fc00c950 comp rx=0 tx=0).stop 2023-10-09T06:57:15.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.050+0000 7f180e1ff700 1 -- 172.21.15.71:0/786347115 shutdown_connections 2023-10-09T06:57:15.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.050+0000 7f180e1ff700 1 --2- 172.21.15.71:0/786347115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1808155c10 0x7f18081526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:15.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.050+0000 7f180e1ff700 1 --2- 172.21.15.71:0/786347115 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18080ac230 0x7f18080cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:15.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.050+0000 7f180e1ff700 1 --2- 172.21.15.71:0/786347115 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f17f4066f60 0x7f17f4069410 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:15.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.050+0000 7f180e1ff700 1 --2- 172.21.15.71:0/786347115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18080ac6d0 0x7f180806dd10 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:15.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.050+0000 7f180e1ff700 1 -- 172.21.15.71:0/786347115 >> 172.21.15.71:0/786347115 conn(0x7f180806a320 msgr2=0x7f18081548f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:15.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.050+0000 7f180e1ff700 1 -- 172.21.15.71:0/786347115 shutdown_connections 2023-10-09T06:57:15.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.050+0000 7f180e1ff700 1 -- 172.21.15.71:0/786347115 wait complete. 2023-10-09T06:57:15.070 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T06:57:15.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.254+0000 7f4b76fff700 1 Processor -- start 2023-10-09T06:57:15.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.254+0000 7f4b76fff700 1 -- start start 2023-10-09T06:57:15.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.256+0000 7f4b76fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b700b0a70 0x7f4b701625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:15.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.256+0000 7f4b76fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b700af2f0 con 0x7f4b70069e80 2023-10-09T06:57:15.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.256+0000 7f4b76fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b700af5d0 con 0x7f4b7015ac80 2023-10-09T06:57:15.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.256+0000 7f4b76fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b700c8660 con 0x7f4b700b0a70 2023-10-09T06:57:15.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.256+0000 7f4b6ffff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f4b70069e80 0x7f4b700c6b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45446/0 (socket says 172.21.15.71:45446) 2023-10-09T06:57:15.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.256+0000 7f4b6ffff700 1 -- 172.21.15.71:0/2646493209 learned_addr learned my addr 172.21.15.71:0/2646493209 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:15.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.256+0000 7f4b7559c700 1 --2- 172.21.15.71:0/2646493209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b700b0a70 0x7f4b701625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:15.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.256+0000 7f4b6f7fe700 1 -- 172.21.15.71:0/2646493209 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062430132 0 0) 0x7f4b700af2f0 con 0x7f4b70069e80 2023-10-09T06:57:15.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.256+0000 7f4b6f7fe700 1 -- 172.21.15.71:0/2646493209 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b60003570 con 0x7f4b70069e80 2023-10-09T06:57:15.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.257+0000 7f4b6f7fe700 1 -- 172.21.15.71:0/2646493209 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4070102456 0 0) 0x7f4b700af5d0 con 0x7f4b7015ac80 2023-10-09T06:57:15.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.257+0000 7f4b6f7fe700 1 -- 172.21.15.71:0/2646493209 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b700af2f0 con 0x7f4b7015ac80 2023-10-09T06:57:15.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.257+0000 7f4b6f7fe700 1 -- 172.21.15.71:0/2646493209 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1222848517 0 0) 0x7f4b60003570 con 0x7f4b70069e80 2023-10-09T06:57:15.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.257+0000 7f4b6f7fe700 1 -- 172.21.15.71:0/2646493209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b700b0a70 msgr2=0x7f4b701625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:15.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.257+0000 7f4b6f7fe700 1 --2- 172.21.15.71:0/2646493209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b700b0a70 0x7f4b701625e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:15.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.257+0000 7f4b6f7fe700 1 -- 172.21.15.71:0/2646493209 >> v1:172.21.15.179:6789/0 conn(0x7f4b7015ac80 legacy=0x7f4b70069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:15.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.257+0000 7f4b6f7fe700 1 -- 172.21.15.71:0/2646493209 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b700c8940 con 0x7f4b70069e80 2023-10-09T06:57:15.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.257+0000 7f4b6f7fe700 1 -- 172.21.15.71:0/2646493209 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f4b5c001470 con 0x7f4b70069e80 2023-10-09T06:57:15.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.257+0000 7f4b6f7fe700 1 -- 172.21.15.71:0/2646493209 >> v1:172.21.15.71:6789/0 conn(0x7f4b70069e80 legacy=0x7f4b700c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:15.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.257+0000 7f4b6f7fe700 1 --2- 172.21.15.71:0/2646493209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b60003c20 0x7f4b60004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:15.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.257+0000 7f4b6f7fe700 1 --2- 172.21.15.71:0/2646493209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b60004810 0x7f4b60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:15.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.257+0000 7f4b6f7fe700 1 --2- 172.21.15.71:0/2646493209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b600051c0 0x7f4b6000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:15.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.257+0000 7f4b6f7fe700 1 -- 172.21.15.71:0/2646493209 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b700c8660 con 0x7f4b60003c20 2023-10-09T06:57:15.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.257+0000 7f4b6f7fe700 1 -- 172.21.15.71:0/2646493209 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6000c080 con 0x7f4b600051c0 2023-10-09T06:57:15.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.257+0000 7f4b6f7fe700 1 -- 172.21.15.71:0/2646493209 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6000c240 con 0x7f4b60004810 2023-10-09T06:57:15.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.257+0000 7f4b7559c700 1 --2- 172.21.15.71:0/2646493209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b700b0a70 0x7f4b701625e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:57:15.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.257+0000 7f4b74d9b700 1 --2- 172.21.15.71:0/2646493209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b60003c20 0x7f4b60004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:15.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.257+0000 7f4b6ffff700 1 --2- 172.21.15.71:0/2646493209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b60004810 0x7f4b60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:15.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.257+0000 7f4b7559c700 1 --2- 172.21.15.71:0/2646493209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b600051c0 0x7f4b6000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:15.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.258+0000 7f4b74d9b700 1 -- 172.21.15.71:0/2646493209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b60004810 msgr2=0x7f4b60004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:15.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.258+0000 7f4b74d9b700 1 --2- 172.21.15.71:0/2646493209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b60004810 0x7f4b60004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:15.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.258+0000 7f4b74d9b700 1 -- 172.21.15.71:0/2646493209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b600051c0 msgr2=0x7f4b6000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:15.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.258+0000 7f4b74d9b700 1 --2- 172.21.15.71:0/2646493209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b600051c0 0x7f4b6000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:15.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.258+0000 7f4b74d9b700 1 -- 172.21.15.71:0/2646493209 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b60003570 con 0x7f4b60003c20 2023-10-09T06:57:15.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.258+0000 7f4b74d9b700 1 --2- 172.21.15.71:0/2646493209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b60003c20 0x7f4b60004010 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4b64001a10 tx=0x7f4b64007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1ba281fa28f0d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:15.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.258+0000 7f4b6f7fe700 1 -- 172.21.15.71:0/2646493209 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6400c5d0 con 0x7f4b60003c20 2023-10-09T06:57:15.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.258+0000 7f4b6f7fe700 1 -- 172.21.15.71:0/2646493209 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6400c730 con 0x7f4b60003c20 2023-10-09T06:57:15.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.258+0000 7f4b6f7fe700 1 -- 172.21.15.71:0/2646493209 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6400cad0 con 0x7f4b60003c20 2023-10-09T06:57:15.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.259+0000 7f4b76fff700 1 -- 172.21.15.71:0/2646493209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b60003c20 msgr2=0x7f4b60004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:15.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.259+0000 7f4b76fff700 1 --2- 172.21.15.71:0/2646493209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b60003c20 0x7f4b60004010 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4b64001a10 tx=0x7f4b64007d30 comp rx=0 tx=0).stop 2023-10-09T06:57:15.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.259+0000 7f4b7559c700 1 -- 172.21.15.71:0/2646493209 reap_dead start 2023-10-09T06:57:15.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.259+0000 7f4b76fff700 1 -- 172.21.15.71:0/2646493209 shutdown_connections 2023-10-09T06:57:15.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.259+0000 7f4b76fff700 1 -- 172.21.15.71:0/2646493209 >> 172.21.15.71:0/2646493209 conn(0x7f4b70068e10 msgr2=0x7f4b700cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:15.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.259+0000 7f4b76fff700 1 -- 172.21.15.71:0/2646493209 shutdown_connections 2023-10-09T06:57:15.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.259+0000 7f4b76fff700 1 -- 172.21.15.71:0/2646493209 wait complete. 2023-10-09T06:57:15.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.260+0000 7f4b76fff700 1 Processor -- start 2023-10-09T06:57:15.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.260+0000 7f4b76fff700 1 -- start start 2023-10-09T06:57:15.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.261+0000 7f4b76fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b60003c20 0x7f4b70147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:15.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.261+0000 7f4b76fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b700ac5e0 0x7f4b70144800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:15.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.261+0000 7f4b76fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b700aca50 0x7f4b70144d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:15.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.261+0000 7f4b76fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b700ad010 con 0x7f4b700aca50 2023-10-09T06:57:15.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.261+0000 7f4b76fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b700ad2f0 con 0x7f4b700ac5e0 2023-10-09T06:57:15.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.261+0000 7f4b76fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b700ad5d0 con 0x7f4b60003c20 2023-10-09T06:57:15.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.261+0000 7f4b7559c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b700aca50 0x7f4b70144d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:15.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.261+0000 7f4b7559c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b700aca50 0x7f4b70144d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60790/0 (socket says 172.21.15.71:60790) 2023-10-09T06:57:15.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.261+0000 7f4b7559c700 1 -- 172.21.15.71:0/1302655952 learned_addr learned my addr 172.21.15.71:0/1302655952 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:15.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.262+0000 7f4b6ffff700 1 --2- 172.21.15.71:0/1302655952 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b700ac5e0 0x7f4b70144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:15.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.262+0000 7f4b74d9b700 1 --2- 172.21.15.71:0/1302655952 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b60003c20 0x7f4b70147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:15.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.262+0000 7f4b7559c700 1 -- 172.21.15.71:0/1302655952 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b60003c20 msgr2=0x7f4b70147160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:15.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.262+0000 7f4b7559c700 1 --2- 172.21.15.71:0/1302655952 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b60003c20 0x7f4b70147160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:15.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.262+0000 7f4b7559c700 1 -- 172.21.15.71:0/1302655952 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b700ac5e0 msgr2=0x7f4b70144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:15.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.262+0000 7f4b7559c700 1 --2- 172.21.15.71:0/1302655952 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b700ac5e0 0x7f4b70144800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:15.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.262+0000 7f4b7559c700 1 -- 172.21.15.71:0/1302655952 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b700ad8b0 con 0x7f4b700aca50 2023-10-09T06:57:15.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.262+0000 7f4b7559c700 1 --2- 172.21.15.71:0/1302655952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b700aca50 0x7f4b70144d40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4b7006a870 tx=0x7f4b68012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:15.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.262+0000 7f4b6cff9700 1 -- 172.21.15.71:0/1302655952 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68015e40 con 0x7f4b700aca50 2023-10-09T06:57:15.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.262+0000 7f4b6cff9700 1 -- 172.21.15.71:0/1302655952 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b68016040 con 0x7f4b700aca50 2023-10-09T06:57:15.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.262+0000 7f4b76fff700 1 -- 172.21.15.71:0/1302655952 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b701476a0 con 0x7f4b700aca50 2023-10-09T06:57:15.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.262+0000 7f4b6cff9700 1 -- 172.21.15.71:0/1302655952 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6801a840 con 0x7f4b700aca50 2023-10-09T06:57:15.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.262+0000 7f4b76fff700 1 -- 172.21.15.71:0/1302655952 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b700ae8c0 con 0x7f4b700aca50 2023-10-09T06:57:15.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.263+0000 7f4b76fff700 1 -- 172.21.15.71:0/1302655952 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b700addd0 con 0x7f4b700aca50 2023-10-09T06:57:15.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.264+0000 7f4b6cff9700 1 -- 172.21.15.71:0/1302655952 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b6801ac70 con 0x7f4b700aca50 2023-10-09T06:57:15.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.265+0000 7f4b6cff9700 1 --2- 172.21.15.71:0/1302655952 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4b54066f30 0x7f4b540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:15.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.265+0000 7f4b6cff9700 1 -- 172.21.15.71:0/1302655952 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5847+0+0 (secure 0 0 0) 0x7f4b68089650 con 0x7f4b700aca50 2023-10-09T06:57:15.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.265+0000 7f4b74d9b700 1 --2- 172.21.15.71:0/1302655952 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4b54066f30 0x7f4b540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:15.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.266+0000 7f4b74d9b700 1 --2- 172.21.15.71:0/1302655952 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4b54066f30 0x7f4b540693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4b64000c00 tx=0x7f4b64015000 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:15.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.269+0000 7f4b6cff9700 1 -- 172.21.15.71:0/1302655952 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b700addd0 con 0x7f4b700aca50 2023-10-09T06:57:15.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.461+0000 7f4b76fff700 1 -- 172.21.15.71:0/1302655952 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4b700addd0 con 0x7f4b700aca50 2023-10-09T06:57:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.465+0000 7f4b6cff9700 1 -- 172.21.15.71:0/1302655952 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4b700addd0 con 0x7f4b700aca50 2023-10-09T06:57:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.467+0000 7f4b76fff700 1 -- 172.21.15.71:0/1302655952 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4b54066f30 msgr2=0x7f4b540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.467+0000 7f4b76fff700 1 --2- 172.21.15.71:0/1302655952 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4b54066f30 0x7f4b540693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4b64000c00 tx=0x7f4b64015000 comp rx=0 tx=0).stop 2023-10-09T06:57:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.467+0000 7f4b76fff700 1 -- 172.21.15.71:0/1302655952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b700aca50 msgr2=0x7f4b70144d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.467+0000 7f4b76fff700 1 --2- 172.21.15.71:0/1302655952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b700aca50 0x7f4b70144d40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4b7006a870 tx=0x7f4b68012040 comp rx=0 tx=0).stop 2023-10-09T06:57:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.467+0000 7f4b76fff700 1 -- 172.21.15.71:0/1302655952 shutdown_connections 2023-10-09T06:57:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.467+0000 7f4b76fff700 1 --2- 172.21.15.71:0/1302655952 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4b54066f30 0x7f4b540693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.467+0000 7f4b76fff700 1 --2- 172.21.15.71:0/1302655952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b700aca50 0x7f4b70144d40 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.467+0000 7f4b76fff700 1 --2- 172.21.15.71:0/1302655952 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b60003c20 0x7f4b70147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.467+0000 7f4b76fff700 1 --2- 172.21.15.71:0/1302655952 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b700ac5e0 0x7f4b70144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.467+0000 7f4b76fff700 1 -- 172.21.15.71:0/1302655952 >> 172.21.15.71:0/1302655952 conn(0x7f4b70068e10 msgr2=0x7f4b70158660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.467+0000 7f4b76fff700 1 -- 172.21.15.71:0/1302655952 shutdown_connections 2023-10-09T06:57:15.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.467+0000 7f4b76fff700 1 -- 172.21.15.71:0/1302655952 wait complete. 2023-10-09T06:57:15.486 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:57:15.487 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:57:15.566 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:57:15.654 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:57:15.654 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T06:57:15.654 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:57:15.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.832+0000 7f999c1ff700 1 Processor -- start 2023-10-09T06:57:15.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.832+0000 7f999c1ff700 1 -- start start 2023-10-09T06:57:15.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.833+0000 7f999c1ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f99940cbf30 0x7f99940ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:15.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.833+0000 7f999c1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f99940ccf90 0x7f99940b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:15.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.833+0000 7f999c1ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99940cc300 con 0x7f999415a270 2023-10-09T06:57:15.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.833+0000 7f999c1ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9994156bf0 con 0x7f99940cbf30 2023-10-09T06:57:15.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.833+0000 7f999c1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99940ae950 con 0x7f99940ccf90 2023-10-09T06:57:15.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.834+0000 7f9999f9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f99940cbf30 0x7f99940ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:15.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.834+0000 7f999a79c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f999415a270 0x7f99940c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45450/0 (socket says 172.21.15.71:45450) 2023-10-09T06:57:15.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.834+0000 7f999a79c700 1 -- 172.21.15.71:0/3540968172 learned_addr learned my addr 172.21.15.71:0/3540968172 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:15.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.834+0000 7f999979a700 1 --2- 172.21.15.71:0/3540968172 >> v2:172.21.15.179:3300/0 conn(0x7f99940ccf90 0x7f99940b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:15.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.834+0000 7f9998f99700 1 -- 172.21.15.71:0/3540968172 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631799912 0 0) 0x7f99940cc300 con 0x7f999415a270 2023-10-09T06:57:15.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.834+0000 7f9998f99700 1 -- 172.21.15.71:0/3540968172 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9980003570 con 0x7f999415a270 2023-10-09T06:57:15.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.834+0000 7f9999f9b700 1 -- 172.21.15.71:0/3540968172 >> v2:172.21.15.179:3300/0 conn(0x7f99940ccf90 msgr2=0x7f99940b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:15.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.834+0000 7f9999f9b700 1 --2- 172.21.15.71:0/3540968172 >> v2:172.21.15.179:3300/0 conn(0x7f99940ccf90 0x7f99940b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:15.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.834+0000 7f9999f9b700 1 -- 172.21.15.71:0/3540968172 >> v1:172.21.15.71:6789/0 conn(0x7f999415a270 legacy=0x7f99940c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:15.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.834+0000 7f9999f9b700 1 -- 172.21.15.71:0/3540968172 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99940ad370 con 0x7f99940cbf30 2023-10-09T06:57:15.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.834+0000 7f9999f9b700 1 --2- 172.21.15.71:0/3540968172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99940cbf30 0x7f99940ae410 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f999406d670 tx=0x7f999000b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f339ba8ed92db82 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:15.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.835+0000 7f9998f99700 1 -- 172.21.15.71:0/3540968172 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999000da30 con 0x7f99940cbf30 2023-10-09T06:57:15.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.835+0000 7f9998f99700 1 -- 172.21.15.71:0/3540968172 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999000db90 con 0x7f99940cbf30 2023-10-09T06:57:15.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.835+0000 7f9998f99700 1 -- 172.21.15.71:0/3540968172 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9990019480 con 0x7f99940cbf30 2023-10-09T06:57:15.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.835+0000 7f999c1ff700 1 -- 172.21.15.71:0/3540968172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99940cbf30 msgr2=0x7f99940ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:15.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.835+0000 7f999c1ff700 1 --2- 172.21.15.71:0/3540968172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99940cbf30 0x7f99940ae410 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f999406d670 tx=0x7f999000b430 comp rx=0 tx=0).stop 2023-10-09T06:57:15.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.835+0000 7f999c1ff700 1 -- 172.21.15.71:0/3540968172 shutdown_connections 2023-10-09T06:57:15.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.835+0000 7f999c1ff700 1 --2- 172.21.15.71:0/3540968172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f99940cbf30 0x7f99940ae410 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:15.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.835+0000 7f999c1ff700 1 --2- 172.21.15.71:0/3540968172 >> v2:172.21.15.179:3300/0 conn(0x7f99940ccf90 0x7f99940b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:15.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.835+0000 7f999c1ff700 1 -- 172.21.15.71:0/3540968172 >> 172.21.15.71:0/3540968172 conn(0x7f999406a320 msgr2=0x7f99940cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:15.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.835+0000 7f999c1ff700 1 -- 172.21.15.71:0/3540968172 shutdown_connections 2023-10-09T06:57:15.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.835+0000 7f999c1ff700 1 -- 172.21.15.71:0/3540968172 wait complete. 2023-10-09T06:57:15.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.837+0000 7f999c1ff700 1 Processor -- start 2023-10-09T06:57:15.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.837+0000 7f999c1ff700 1 -- start start 2023-10-09T06:57:15.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.838+0000 7f999c1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99940cbf30 0x7f99940c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:15.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.838+0000 7f999c1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99940ccf90 0x7f9994156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:15.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.838+0000 7f999c1ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f999415a270 0x7f99940cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:15.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.838+0000 7f999c1ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99940c4410 con 0x7f999415a270 2023-10-09T06:57:15.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.838+0000 7f999c1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99940c3910 con 0x7f99940ccf90 2023-10-09T06:57:15.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.838+0000 7f999c1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99940c46d0 con 0x7f99940cbf30 2023-10-09T06:57:15.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.838+0000 7f999a79c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f999415a270 0x7f99940cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:15.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.838+0000 7f999a79c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f999415a270 0x7f99940cadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60802/0 (socket says 172.21.15.71:60802) 2023-10-09T06:57:15.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.838+0000 7f999a79c700 1 -- 172.21.15.71:0/3218478761 learned_addr learned my addr 172.21.15.71:0/3218478761 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:15.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.838+0000 7f9999f9b700 1 --2- 172.21.15.71:0/3218478761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99940cbf30 0x7f99940c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:15.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.838+0000 7f999979a700 1 --2- 172.21.15.71:0/3218478761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99940ccf90 0x7f9994156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:15.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.838+0000 7f999a79c700 1 -- 172.21.15.71:0/3218478761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99940cbf30 msgr2=0x7f99940c51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:15.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.838+0000 7f999a79c700 1 --2- 172.21.15.71:0/3218478761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99940cbf30 0x7f99940c51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:15.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.838+0000 7f999a79c700 1 -- 172.21.15.71:0/3218478761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99940ccf90 msgr2=0x7f9994156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:15.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.839+0000 7f999a79c700 1 --2- 172.21.15.71:0/3218478761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99940ccf90 0x7f9994156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:15.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.839+0000 7f999a79c700 1 -- 172.21.15.71:0/3218478761 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999000b6d0 con 0x7f999415a270 2023-10-09T06:57:15.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.839+0000 7f999a79c700 1 --2- 172.21.15.71:0/3218478761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f999415a270 0x7f99940cadc0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f998c001460 tx=0x7f998c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:15.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.839+0000 7f9989ffb700 1 -- 172.21.15.71:0/3218478761 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c00a890 con 0x7f999415a270 2023-10-09T06:57:15.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.839+0000 7f9989ffb700 1 -- 172.21.15.71:0/3218478761 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998c00a9f0 con 0x7f999415a270 2023-10-09T06:57:15.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.839+0000 7f999c1ff700 1 -- 172.21.15.71:0/3218478761 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99940c49b0 con 0x7f999415a270 2023-10-09T06:57:15.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.839+0000 7f9989ffb700 1 -- 172.21.15.71:0/3218478761 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c00ad70 con 0x7f999415a270 2023-10-09T06:57:15.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.839+0000 7f999c1ff700 1 -- 172.21.15.71:0/3218478761 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99941565b0 con 0x7f999415a270 2023-10-09T06:57:15.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.840+0000 7f999c1ff700 1 -- 172.21.15.71:0/3218478761 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99940c4ed0 con 0x7f999415a270 2023-10-09T06:57:15.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.841+0000 7f9989ffb700 1 -- 172.21.15.71:0/3218478761 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f998c007300 con 0x7f999415a270 2023-10-09T06:57:15.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.842+0000 7f9989ffb700 1 --2- 172.21.15.71:0/3218478761 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9978066f30 0x7f99780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:15.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.842+0000 7f9989ffb700 1 -- 172.21.15.71:0/3218478761 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5847+0+0 (secure 0 0 0) 0x7f998c084990 con 0x7f999415a270 2023-10-09T06:57:15.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.842+0000 7f9999f9b700 1 --2- 172.21.15.71:0/3218478761 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9978066f30 0x7f99780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:15.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.843+0000 7f9999f9b700 1 --2- 172.21.15.71:0/3218478761 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9978066f30 0x7f99780693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f999000bb10 tx=0x7f999001b000 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:15.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:15.846+0000 7f9989ffb700 1 -- 172.21.15.71:0/3218478761 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99940c4ed0 con 0x7f999415a270 2023-10-09T06:57:16.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:16.078+0000 7f999c1ff700 1 -- 172.21.15.71:0/3218478761 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99940c4ed0 con 0x7f999415a270 2023-10-09T06:57:16.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:16.078+0000 7f9989ffb700 1 -- 172.21.15.71:0/3218478761 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f99940c4ed0 con 0x7f999415a270 2023-10-09T06:57:16.079 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:16.080 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5153,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3904949177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3904949177},{"type":"v1","addr":"172.21.15.179:6837","nonce":3904949177}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5617,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2761847814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2761847814},{"type":"v1","addr":"172.21.15.71:6833","nonce":2761847814}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5632,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3251743580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3251743580},{"type":"v1","addr":"172.21.15.179:6836","nonce":3251743580}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5950,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/450173473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":450173473},{"type":"v1","addr":"172.21.15.71:6835","nonce":450173473}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2023-10-09T06:57:16.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:16.081+0000 7f999c1ff700 1 -- 172.21.15.71:0/3218478761 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9978066f30 msgr2=0x7f99780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:16.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:16.081+0000 7f999c1ff700 1 --2- 172.21.15.71:0/3218478761 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9978066f30 0x7f99780693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f999000bb10 tx=0x7f999001b000 comp rx=0 tx=0).stop 2023-10-09T06:57:16.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:16.081+0000 7f999c1ff700 1 -- 172.21.15.71:0/3218478761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f999415a270 msgr2=0x7f99940cadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:16.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:16.081+0000 7f999c1ff700 1 --2- 172.21.15.71:0/3218478761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f999415a270 0x7f99940cadc0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f998c001460 tx=0x7f998c001ae0 comp rx=0 tx=0).stop 2023-10-09T06:57:16.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:16.081+0000 7f999c1ff700 1 -- 172.21.15.71:0/3218478761 shutdown_connections 2023-10-09T06:57:16.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:16.081+0000 7f999c1ff700 1 --2- 172.21.15.71:0/3218478761 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9978066f30 0x7f99780693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:16.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:16.081+0000 7f999c1ff700 1 --2- 172.21.15.71:0/3218478761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f999415a270 0x7f99940cadc0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:16.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:16.081+0000 7f999c1ff700 1 --2- 172.21.15.71:0/3218478761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99940cbf30 0x7f99940c51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:16.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:16.081+0000 7f999c1ff700 1 --2- 172.21.15.71:0/3218478761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99940ccf90 0x7f9994156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:16.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:16.081+0000 7f999c1ff700 1 -- 172.21.15.71:0/3218478761 >> 172.21.15.71:0/3218478761 conn(0x7f999406a320 msgr2=0x7f99940cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:16.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:16.081+0000 7f999c1ff700 1 -- 172.21.15.71:0/3218478761 shutdown_connections 2023-10-09T06:57:16.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:16.081+0000 7f999c1ff700 1 -- 172.21.15.71:0/3218478761 wait complete. 2023-10-09T06:57:16.084 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 26 2023-10-09T06:57:16.099 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T06:57:16.100 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T06:57:16.100 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T06:57:16.100 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:57:16.100 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T06:57:16.101 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T06:57:16.101 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T06:57:16.101 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:57:16.101 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T06:57:16.102 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T06:57:16.102 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T06:57:16.102 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:57:16.102 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T06:57:16.103 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T06:57:16.103 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T06:57:16.103 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:57:16.114 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T06:57:16.115 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T06:57:16.118 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T06:57:16.119 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T06:57:16.120 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T06:57:16.120 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T06:57:16.159 INFO:tasks.ceph.mds.c:Started 2023-10-09T06:57:16.159 DEBUG:teuthology.parallel:result is None 2023-10-09T06:57:16.164 INFO:tasks.ceph.mds.b:Started 2023-10-09T06:57:16.164 DEBUG:teuthology.parallel:result is None 2023-10-09T06:57:16.167 INFO:tasks.ceph.mds.d:Started 2023-10-09T06:57:16.168 DEBUG:teuthology.parallel:result is None 2023-10-09T06:57:16.286 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-10-09T06:57:16.303 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-09T06:57:16.304 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-09T06:57:16.305 INFO:tasks.ceph.mds.d.smithi179.stderr:2023-10-09T06:57:16.305+0000 7f63bf3fd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-09T06:57:17.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-10-09T06:57:22.115 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T06:57:22.115 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T06:57:22.121 INFO:tasks.ceph.mds.a:Started 2023-10-09T06:57:22.121 DEBUG:teuthology.parallel:result is None 2023-10-09T06:57:22.122 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T06:57:22.261 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2023-10-09T06:57:22.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.316+0000 7f9ab1b9d700 1 Processor -- start 2023-10-09T06:57:22.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.316+0000 7f9ab1b9d700 1 -- start start 2023-10-09T06:57:22.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.318+0000 7f9ab1b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9aac156310 0x7f9aac0c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:22.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.318+0000 7f9ab1b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9aac1566e0 0x7f9aac0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:22.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.318+0000 7f9ab1b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aac0ca860 con 0x7f9aac0ca300 2023-10-09T06:57:22.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.318+0000 7f9ab1b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aac0cab40 con 0x7f9aac1566e0 2023-10-09T06:57:22.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.318+0000 7f9ab1b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac0cae20 con 0x7f9aac156310 2023-10-09T06:57:22.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.318+0000 7f9ab0b9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9aac156310 0x7f9aac0c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:22.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.318+0000 7f9ab139c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f9aac0ca300 0x7f9aac0c6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:60208/0 (socket says 172.21.15.71:60208) 2023-10-09T06:57:22.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.318+0000 7f9ab0b9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9aac156310 0x7f9aac0c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:43336/0 (socket says 172.21.15.71:43336) 2023-10-09T06:57:22.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.318+0000 7f9ab139c700 1 -- 172.21.15.71:0/3026960874 learned_addr learned my addr 172.21.15.71:0/3026960874 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:22.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.318+0000 7f9aabfff700 1 --2- 172.21.15.71:0/3026960874 >> v2:172.21.15.179:3300/0 conn(0x7f9aac1566e0 0x7f9aac0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:22.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.319+0000 7f9aab7fe700 1 -- 172.21.15.71:0/3026960874 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4175006441 0 0) 0x7f9aac0ca860 con 0x7f9aac0ca300 2023-10-09T06:57:22.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.319+0000 7f9aab7fe700 1 -- 172.21.15.71:0/3026960874 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a9c003570 con 0x7f9aac0ca300 2023-10-09T06:57:22.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.319+0000 7f9aabfff700 1 -- 172.21.15.71:0/3026960874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9aac156310 msgr2=0x7f9aac0c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:22.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.319+0000 7f9aabfff700 1 --2- 172.21.15.71:0/3026960874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9aac156310 0x7f9aac0c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:22.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.319+0000 7f9aabfff700 1 -- 172.21.15.71:0/3026960874 >> v1:172.21.15.179:6789/0 conn(0x7f9aac0ca300 legacy=0x7f9aac0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:22.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.319+0000 7f9aabfff700 1 -- 172.21.15.71:0/3026960874 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac0cb100 con 0x7f9aac1566e0 2023-10-09T06:57:22.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.319+0000 7f9ab0b9b700 1 --2- 172.21.15.71:0/3026960874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9aac156310 0x7f9aac0c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:57:22.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.319+0000 7f9aabfff700 1 --2- 172.21.15.71:0/3026960874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9aac1566e0 0x7f9aac0ae000 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9a980098e0 tx=0x7f9a980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=229b4e64fa02fefe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:22.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.319+0000 7f9aab7fe700 1 -- 172.21.15.71:0/3026960874 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98011630 con 0x7f9aac1566e0 2023-10-09T06:57:22.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.319+0000 7f9aab7fe700 1 -- 172.21.15.71:0/3026960874 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a98011790 con 0x7f9aac1566e0 2023-10-09T06:57:22.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.319+0000 7f9aab7fe700 1 -- 172.21.15.71:0/3026960874 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98011b10 con 0x7f9aac1566e0 2023-10-09T06:57:22.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.320+0000 7f9ab1b9d700 1 -- 172.21.15.71:0/3026960874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9aac1566e0 msgr2=0x7f9aac0ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:22.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.320+0000 7f9ab1b9d700 1 --2- 172.21.15.71:0/3026960874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9aac1566e0 0x7f9aac0ae000 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9a980098e0 tx=0x7f9a980091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:22.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.320+0000 7f9ab1b9d700 1 -- 172.21.15.71:0/3026960874 shutdown_connections 2023-10-09T06:57:22.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.320+0000 7f9ab1b9d700 1 --2- 172.21.15.71:0/3026960874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9aac156310 0x7f9aac0c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:22.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.320+0000 7f9ab1b9d700 1 --2- 172.21.15.71:0/3026960874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9aac1566e0 0x7f9aac0ae000 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:22.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.320+0000 7f9ab1b9d700 1 -- 172.21.15.71:0/3026960874 >> 172.21.15.71:0/3026960874 conn(0x7f9aac0cc1f0 msgr2=0x7f9aac0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:22.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.320+0000 7f9ab1b9d700 1 -- 172.21.15.71:0/3026960874 shutdown_connections 2023-10-09T06:57:22.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.320+0000 7f9ab1b9d700 1 -- 172.21.15.71:0/3026960874 wait complete. 2023-10-09T06:57:22.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.321+0000 7f9ab1b9d700 1 Processor -- start 2023-10-09T06:57:22.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.322+0000 7f9ab1b9d700 1 -- start start 2023-10-09T06:57:22.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.322+0000 7f9ab1b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9aac0ca300 0x7f9aac147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:22.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.322+0000 7f9ab1b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9aac156310 0x7f9aac0af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:22.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.322+0000 7f9ab1b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9aac1566e0 0x7f9aac146d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:22.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.323+0000 7f9ab1b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac154520 con 0x7f9aac1566e0 2023-10-09T06:57:22.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.323+0000 7f9ab1b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac153910 con 0x7f9aac0ca300 2023-10-09T06:57:22.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.323+0000 7f9ab1b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac153bf0 con 0x7f9aac156310 2023-10-09T06:57:22.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.323+0000 7f9ab139c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9aac1566e0 0x7f9aac146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:22.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.323+0000 7f9ab139c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9aac1566e0 0x7f9aac146d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60858/0 (socket says 172.21.15.71:60858) 2023-10-09T06:57:22.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.323+0000 7f9ab139c700 1 -- 172.21.15.71:0/294127785 learned_addr learned my addr 172.21.15.71:0/294127785 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:22.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.323+0000 7f9ab0b9b700 1 --2- 172.21.15.71:0/294127785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9aac0ca300 0x7f9aac147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:22.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.323+0000 7f9aabfff700 1 --2- 172.21.15.71:0/294127785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9aac156310 0x7f9aac0af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:22.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.323+0000 7f9ab139c700 1 -- 172.21.15.71:0/294127785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9aac156310 msgr2=0x7f9aac0af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:22.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.323+0000 7f9ab139c700 1 --2- 172.21.15.71:0/294127785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9aac156310 0x7f9aac0af930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:22.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.323+0000 7f9ab139c700 1 -- 172.21.15.71:0/294127785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9aac0ca300 msgr2=0x7f9aac147590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:22.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.323+0000 7f9ab139c700 1 --2- 172.21.15.71:0/294127785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9aac0ca300 0x7f9aac147590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:22.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.323+0000 7f9ab139c700 1 -- 172.21.15.71:0/294127785 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa0009420 con 0x7f9aac1566e0 2023-10-09T06:57:22.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.323+0000 7f9ab139c700 1 --2- 172.21.15.71:0/294127785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9aac1566e0 0x7f9aac146d50 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4001460 tx=0x7f9aa4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:22.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.324+0000 7f9aa8ff9700 1 -- 172.21.15.71:0/294127785 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa400a870 con 0x7f9aac1566e0 2023-10-09T06:57:22.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.324+0000 7f9aa8ff9700 1 -- 172.21.15.71:0/294127785 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa400a9d0 con 0x7f9aac1566e0 2023-10-09T06:57:22.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.324+0000 7f9ab1b9d700 1 -- 172.21.15.71:0/294127785 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a98009420 con 0x7f9aac1566e0 2023-10-09T06:57:22.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.324+0000 7f9aa8ff9700 1 -- 172.21.15.71:0/294127785 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa400ad50 con 0x7f9aac1566e0 2023-10-09T06:57:22.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.324+0000 7f9ab1b9d700 1 -- 172.21.15.71:0/294127785 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aac1541b0 con 0x7f9aac1566e0 2023-10-09T06:57:22.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.325+0000 7f9ab1b9d700 1 -- 172.21.15.71:0/294127785 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aac154690 con 0x7f9aac1566e0 2023-10-09T06:57:22.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.326+0000 7f9aa8ff9700 1 -- 172.21.15.71:0/294127785 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9aa4007300 con 0x7f9aac1566e0 2023-10-09T06:57:22.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.327+0000 7f9aa8ff9700 1 --2- 172.21.15.71:0/294127785 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9a90066f30 0x7f9a900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:22.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.327+0000 7f9aa8ff9700 1 -- 172.21.15.71:0/294127785 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5847+0+0 (secure 0 0 0) 0x7f9aa4084900 con 0x7f9aac1566e0 2023-10-09T06:57:22.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.327+0000 7f9ab0b9b700 1 --2- 172.21.15.71:0/294127785 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9a90066f30 0x7f9a900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:22.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.328+0000 7f9ab0b9b700 1 --2- 172.21.15.71:0/294127785 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9a90066f30 0x7f9a900693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9aac069fa0 tx=0x7f9aa00091a0 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:22.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.331+0000 7f9aa8ff9700 1 -- 172.21.15.71:0/294127785 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9aa4051ac0 con 0x7f9aac1566e0 2023-10-09T06:57:22.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:22.536+0000 7f9ab1b9d700 1 -- 172.21.15.71:0/294127785 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9aac04c3c0 con 0x7f9aac1566e0 2023-10-09T06:57:23.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.767+0000 7f9aa8ff9700 1 -- 172.21.15.71:0/294127785 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v75) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9aa40550e0 con 0x7f9aac1566e0 2023-10-09T06:57:23.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.770+0000 7f9ab1b9d700 1 -- 172.21.15.71:0/294127785 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9a90066f30 msgr2=0x7f9a900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:23.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.770+0000 7f9ab1b9d700 1 --2- 172.21.15.71:0/294127785 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9a90066f30 0x7f9a900693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9aac069fa0 tx=0x7f9aa00091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:23.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.770+0000 7f9ab1b9d700 1 -- 172.21.15.71:0/294127785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9aac1566e0 msgr2=0x7f9aac146d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:23.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.770+0000 7f9ab1b9d700 1 --2- 172.21.15.71:0/294127785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9aac1566e0 0x7f9aac146d50 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4001460 tx=0x7f9aa4001a40 comp rx=0 tx=0).stop 2023-10-09T06:57:23.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.770+0000 7f9ab1b9d700 1 -- 172.21.15.71:0/294127785 shutdown_connections 2023-10-09T06:57:23.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.770+0000 7f9ab1b9d700 1 --2- 172.21.15.71:0/294127785 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9a90066f30 0x7f9a900693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:23.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.770+0000 7f9ab1b9d700 1 --2- 172.21.15.71:0/294127785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9aac1566e0 0x7f9aac146d50 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:23.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.770+0000 7f9ab1b9d700 1 --2- 172.21.15.71:0/294127785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9aac0ca300 0x7f9aac147590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:23.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.770+0000 7f9ab1b9d700 1 --2- 172.21.15.71:0/294127785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9aac156310 0x7f9aac0af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:23.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.770+0000 7f9ab1b9d700 1 -- 172.21.15.71:0/294127785 >> 172.21.15.71:0/294127785 conn(0x7f9aac0cc1f0 msgr2=0x7f9aac06a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:23.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.771+0000 7f9ab1b9d700 1 -- 172.21.15.71:0/294127785 shutdown_connections 2023-10-09T06:57:23.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.771+0000 7f9ab1b9d700 1 -- 172.21.15.71:0/294127785 wait complete. 2023-10-09T06:57:23.773 INFO:teuthology.orchestra.run.smithi071.stderr: removed all blocklist entries 2023-10-09T06:57:23.794 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T06:57:23.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.975+0000 7f6fa6fff700 1 Processor -- start 2023-10-09T06:57:23.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.976+0000 7f6fa6fff700 1 -- start start 2023-10-09T06:57:23.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.977+0000 7f6fa6fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6fa00caa90 0x7f6fa00c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:23.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.977+0000 7f6fa6fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa015d7e0 con 0x7f6fa006bcd0 2023-10-09T06:57:23.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.977+0000 7f6fa6fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa015dac0 con 0x7f6fa006c0a0 2023-10-09T06:57:23.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.977+0000 7f6fa6fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa00caef0 con 0x7f6fa00caa90 2023-10-09T06:57:23.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.977+0000 7f6fa4d9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6fa006bcd0 0x7f6fa015a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45458/0 (socket says 172.21.15.71:45458) 2023-10-09T06:57:23.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.977+0000 7f6fa4d9b700 1 -- 172.21.15.71:0/1316546241 learned_addr learned my addr 172.21.15.71:0/1316546241 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:23.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.977+0000 7f6fa559c700 1 --2- 172.21.15.71:0/1316546241 >> v2:172.21.15.71:3300/0 conn(0x7f6fa00caa90 0x7f6fa00c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:23.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.978+0000 7f6f9f7fe700 1 -- 172.21.15.71:0/1316546241 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230056025 0 0) 0x7f6fa015d7e0 con 0x7f6fa006bcd0 2023-10-09T06:57:23.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.978+0000 7f6fa559c700 1 -- 172.21.15.71:0/1316546241 >> v1:172.21.15.179:6789/0 conn(0x7f6fa006c0a0 legacy=0x7f6fa015df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.978+0000 7f6fa559c700 1 -- 172.21.15.71:0/1316546241 >> v1:172.21.15.71:6789/0 conn(0x7f6fa006bcd0 legacy=0x7f6fa015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.978+0000 7f6fa559c700 1 -- 172.21.15.71:0/1316546241 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa015aa30 con 0x7f6fa00caa90 2023-10-09T06:57:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.978+0000 7f6fa559c700 1 --2- 172.21.15.71:0/1316546241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa00caa90 0x7f6fa00c8c40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009e60 tx=0x7f6f98009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1968956d5cb295de server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.978+0000 7f6f9f7fe700 1 -- 172.21.15.71:0/1316546241 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9800e070 con 0x7f6fa00caa90 2023-10-09T06:57:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.978+0000 7f6f9f7fe700 1 -- 172.21.15.71:0/1316546241 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9800bbf0 con 0x7f6fa00caa90 2023-10-09T06:57:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.978+0000 7f6f9f7fe700 1 -- 172.21.15.71:0/1316546241 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f98012430 con 0x7f6fa00caa90 2023-10-09T06:57:23.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.979+0000 7f6fa6fff700 1 -- 172.21.15.71:0/1316546241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa00caa90 msgr2=0x7f6fa00c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:23.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.979+0000 7f6fa6fff700 1 --2- 172.21.15.71:0/1316546241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa00caa90 0x7f6fa00c8c40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009e60 tx=0x7f6f98009780 comp rx=0 tx=0).stop 2023-10-09T06:57:23.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.979+0000 7f6fa6fff700 1 -- 172.21.15.71:0/1316546241 shutdown_connections 2023-10-09T06:57:23.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.979+0000 7f6fa6fff700 1 --2- 172.21.15.71:0/1316546241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa00caa90 0x7f6fa00c8c40 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:23.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.979+0000 7f6fa6fff700 1 -- 172.21.15.71:0/1316546241 >> 172.21.15.71:0/1316546241 conn(0x7f6fa00ce600 msgr2=0x7f6fa00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:23.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.979+0000 7f6fa6fff700 1 -- 172.21.15.71:0/1316546241 shutdown_connections 2023-10-09T06:57:23.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.979+0000 7f6fa6fff700 1 -- 172.21.15.71:0/1316546241 wait complete. 2023-10-09T06:57:23.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.980+0000 7f6fa6fff700 1 Processor -- start 2023-10-09T06:57:23.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.980+0000 7f6fa6fff700 1 -- start start 2023-10-09T06:57:23.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.981+0000 7f6fa6fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa006bcd0 0x7f6fa0160370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:23.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.981+0000 7f6fa6fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fa006c0a0 0x7f6fa016d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:23.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.981+0000 7f6fa6fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fa00caa90 0x7f6fa016d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:23.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.981+0000 7f6fa6fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa015f0d0 con 0x7f6fa006bcd0 2023-10-09T06:57:23.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.981+0000 7f6fa6fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa015e450 con 0x7f6fa006c0a0 2023-10-09T06:57:23.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.981+0000 7f6fa6fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa015e730 con 0x7f6fa00caa90 2023-10-09T06:57:23.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.981+0000 7f6fa4d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa006bcd0 0x7f6fa0160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:23.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.982+0000 7f6fa4d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa006bcd0 0x7f6fa0160370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60864/0 (socket says 172.21.15.71:60864) 2023-10-09T06:57:23.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.982+0000 7f6fa4d9b700 1 -- 172.21.15.71:0/127585539 learned_addr learned my addr 172.21.15.71:0/127585539 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:23.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.982+0000 7f6fa559c700 1 --2- 172.21.15.71:0/127585539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fa00caa90 0x7f6fa016d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:23.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.982+0000 7f6f9ffff700 1 --2- 172.21.15.71:0/127585539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fa006c0a0 0x7f6fa016d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:23.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.982+0000 7f6fa4d9b700 1 -- 172.21.15.71:0/127585539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fa00caa90 msgr2=0x7f6fa016d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:23.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.982+0000 7f6fa4d9b700 1 --2- 172.21.15.71:0/127585539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fa00caa90 0x7f6fa016d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:23.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.982+0000 7f6fa4d9b700 1 -- 172.21.15.71:0/127585539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fa006c0a0 msgr2=0x7f6fa016d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:23.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.982+0000 7f6fa4d9b700 1 --2- 172.21.15.71:0/127585539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fa006c0a0 0x7f6fa016d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:23.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.982+0000 7f6fa4d9b700 1 -- 172.21.15.71:0/127585539 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f98009a20 con 0x7f6fa006bcd0 2023-10-09T06:57:23.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.982+0000 7f6f9ffff700 1 --2- 172.21.15.71:0/127585539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fa006c0a0 0x7f6fa016d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:57:23.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.982+0000 7f6fa4d9b700 1 --2- 172.21.15.71:0/127585539 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa006bcd0 0x7f6fa0160370 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400c5b0 tx=0x7f6f94001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:23.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.982+0000 7f6f9cff9700 1 -- 172.21.15.71:0/127585539 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94005b30 con 0x7f6fa006bcd0 2023-10-09T06:57:23.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.982+0000 7f6f9cff9700 1 -- 172.21.15.71:0/127585539 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f94005c90 con 0x7f6fa006bcd0 2023-10-09T06:57:23.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.982+0000 7f6fa6fff700 1 -- 172.21.15.71:0/127585539 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa015ea10 con 0x7f6fa006bcd0 2023-10-09T06:57:23.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.982+0000 7f6f9cff9700 1 -- 172.21.15.71:0/127585539 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94007300 con 0x7f6fa006bcd0 2023-10-09T06:57:23.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.983+0000 7f6fa6fff700 1 -- 172.21.15.71:0/127585539 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa01608b0 con 0x7f6fa006bcd0 2023-10-09T06:57:23.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.984+0000 7f6fa6fff700 1 -- 172.21.15.71:0/127585539 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa004c3c0 con 0x7f6fa006bcd0 2023-10-09T06:57:23.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.984+0000 7f6f9cff9700 1 -- 172.21.15.71:0/127585539 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f940076b0 con 0x7f6fa006bcd0 2023-10-09T06:57:23.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.985+0000 7f6f9cff9700 1 --2- 172.21.15.71:0/127585539 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6f84066f30 0x7f6f840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.985+0000 7f6f9cff9700 1 -- 172.21.15.71:0/127585539 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f6f940838f0 con 0x7f6fa006bcd0 2023-10-09T06:57:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.986+0000 7f6f9ffff700 1 --2- 172.21.15.71:0/127585539 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6f84066f30 0x7f6f840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.986+0000 7f6f9ffff700 1 --2- 172.21.15.71:0/127585539 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6f84066f30 0x7f6f840693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c006fd0 tx=0x7f6f8c008040 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:23.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:23.989+0000 7f6f9cff9700 1 -- 172.21.15.71:0/127585539 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f94050c90 con 0x7f6fa006bcd0 2023-10-09T06:57:24.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.259+0000 7f6fa6fff700 1 -- 172.21.15.71:0/127585539 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6fa015ad10 con 0x7f6fa006bcd0 2023-10-09T06:57:24.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.260+0000 7f6f9cff9700 1 -- 172.21.15.71:0/127585539 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6f94017090 con 0x7f6fa006bcd0 2023-10-09T06:57:24.261 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:24.261 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T06:57:24.261 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_dump": [ 2023-10-09T06:57:24.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:57:24.261 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.a", 2023-10-09T06:57:24.262 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlpI5JCRAAGBgrs6g+6KZFXv1eq0fkwQ==", 2023-10-09T06:57:24.262 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:57:24.262 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:57:24.262 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:57:24.262 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:57:24.262 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:57:24.262 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:57:24.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:57:24.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:57:24.262 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.b", 2023-10-09T06:57:24.262 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlDZQYHhAA2LGKHPLrBVKlGMK0TKup7A==", 2023-10-09T06:57:24.263 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:57:24.263 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:57:24.263 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:57:24.263 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:57:24.263 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:57:24.263 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:57:24.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:57:24.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:57:24.263 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.c", 2023-10-09T06:57:24.264 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlLKKfExAA65+KIyYd16iQ2L5topDPkg==", 2023-10-09T06:57:24.264 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:57:24.264 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:57:24.264 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:57:24.264 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:57:24.264 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:57:24.264 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:57:24.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:57:24.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:57:24.264 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.d", 2023-10-09T06:57:24.265 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlpQKTKBAAP59h/znElthIdqbK9tKJww==", 2023-10-09T06:57:24.265 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:57:24.265 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:57:24.265 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:57:24.265 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:57:24.265 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:57:24.265 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:57:24.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:57:24.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:57:24.265 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.0", 2023-10-09T06:57:24.266 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCgoCNll7hBIBAAtZ8mBx+MPAwEou48boP4Hw==", 2023-10-09T06:57:24.266 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:57:24.266 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:57:24.266 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:57:24.266 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:57:24.266 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:57:24.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:57:24.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:57:24.266 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.1", 2023-10-09T06:57:24.266 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCjoCNl7uRMIxAAztQi4ZsulyN2FHcMRzZ82Q==", 2023-10-09T06:57:24.267 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:57:24.267 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:57:24.267 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:57:24.267 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:57:24.267 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:57:24.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:57:24.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:57:24.267 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.2", 2023-10-09T06:57:24.267 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCmoCNlW/cNJhAAfFdnRC95YJwpCngJS956cA==", 2023-10-09T06:57:24.267 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:57:24.268 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:57:24.268 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:57:24.268 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:57:24.268 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:57:24.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:57:24.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:57:24.268 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.3", 2023-10-09T06:57:24.268 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCpoCNlAIlYKRAAD5IGHWZ14ckpQAU4wBifbg==", 2023-10-09T06:57:24.268 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:57:24.268 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:57:24.269 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:57:24.269 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:57:24.269 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:57:24.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:57:24.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:57:24.269 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.4", 2023-10-09T06:57:24.269 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCvoCNltrA4ORAAtifmL9hr1xKd+jsMf5Nf+Q==", 2023-10-09T06:57:24.269 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:57:24.269 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:57:24.270 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:57:24.270 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:57:24.270 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:57:24.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:57:24.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:57:24.270 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.5", 2023-10-09T06:57:24.270 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCyoCNlA/IOOxAAQWRPQ+00o9xrpScAvY/87w==", 2023-10-09T06:57:24.270 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:57:24.270 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:57:24.270 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:57:24.271 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:57:24.271 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:57:24.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:57:24.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:57:24.271 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.6", 2023-10-09T06:57:24.271 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQC2oCNlvRusARAAcRaGyCROIRVTHeKhrncN8g==", 2023-10-09T06:57:24.271 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:57:24.271 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:57:24.271 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:57:24.271 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:57:24.272 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:57:24.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:57:24.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:57:24.272 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.7", 2023-10-09T06:57:24.272 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQC5oCNli/3NAxAAIMYuED41ZSx1xF384N6y1A==", 2023-10-09T06:57:24.272 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:57:24.272 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:57:24.272 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:57:24.272 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:57:24.272 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:57:24.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:57:24.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:57:24.273 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.0", 2023-10-09T06:57:24.273 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlHrKWMRAAyIfmryGSgqIFwWEJyixprw==", 2023-10-09T06:57:24.273 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:57:24.273 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:57:24.273 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow r", 2023-10-09T06:57:24.273 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T06:57:24.273 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:57:24.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:57:24.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:57:24.274 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.1", 2023-10-09T06:57:24.274 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCdoCNldq1xAxAAxCpmelS0qDEY187u19JkcQ==", 2023-10-09T06:57:24.274 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:57:24.274 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:57:24.274 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T06:57:24.274 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T06:57:24.274 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T06:57:24.274 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:57:24.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:57:24.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:57:24.275 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.2", 2023-10-09T06:57:24.275 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlM3JHOBAA8fszREXH+WnYb+3vIaakcA==", 2023-10-09T06:57:24.275 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:57:24.275 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:57:24.275 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T06:57:24.275 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T06:57:24.275 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T06:57:24.275 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:57:24.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:57:24.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:57:24.275 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.3", 2023-10-09T06:57:24.275 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCdoCNlgkEqChAAwntdv9UOo30x40pVa70yag==", 2023-10-09T06:57:24.276 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:57:24.276 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:57:24.276 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T06:57:24.276 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T06:57:24.276 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T06:57:24.276 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:57:24.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:57:24.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:57:24.276 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.admin", 2023-10-09T06:57:24.276 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCboCNlj2W4EhAAUnfX6NBeDyMj2nY/G2ciEg==", 2023-10-09T06:57:24.276 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:57:24.276 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T06:57:24.277 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:57:24.277 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:57:24.277 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:57:24.277 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:57:24.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:57:24.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:57:24.277 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.x", 2023-10-09T06:57:24.277 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlwwJ/AhAAjHMhAX1/yWgh9no7yQqP6Q==", 2023-10-09T06:57:24.277 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:57:24.277 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T06:57:24.278 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-09T06:57:24.278 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:57:24.278 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:57:24.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:57:24.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:57:24.278 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.y", 2023-10-09T06:57:24.278 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCboCNly/XVNRAAlKr9arCbsDbzZ9bpIU5dng==", 2023-10-09T06:57:24.278 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:57:24.278 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T06:57:24.278 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-09T06:57:24.278 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:57:24.279 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:57:24.279 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:57:24.279 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2023-10-09T06:57:24.279 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T06:57:24.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.262+0000 7f6fa6fff700 1 -- 172.21.15.71:0/127585539 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6f84066f30 msgr2=0x7f6f840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:24.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.262+0000 7f6fa6fff700 1 --2- 172.21.15.71:0/127585539 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6f84066f30 0x7f6f840693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c006fd0 tx=0x7f6f8c008040 comp rx=0 tx=0).stop 2023-10-09T06:57:24.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.262+0000 7f6fa6fff700 1 -- 172.21.15.71:0/127585539 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa006bcd0 msgr2=0x7f6fa0160370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:24.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.262+0000 7f6fa6fff700 1 --2- 172.21.15.71:0/127585539 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa006bcd0 0x7f6fa0160370 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400c5b0 tx=0x7f6f94001070 comp rx=0 tx=0).stop 2023-10-09T06:57:24.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.262+0000 7f6fa6fff700 1 -- 172.21.15.71:0/127585539 shutdown_connections 2023-10-09T06:57:24.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.262+0000 7f6fa6fff700 1 --2- 172.21.15.71:0/127585539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fa00caa90 0x7f6fa016d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:24.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.262+0000 7f6fa6fff700 1 --2- 172.21.15.71:0/127585539 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6f84066f30 0x7f6f840693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:24.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.262+0000 7f6fa6fff700 1 --2- 172.21.15.71:0/127585539 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa006bcd0 0x7f6fa0160370 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:24.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.262+0000 7f6fa6fff700 1 --2- 172.21.15.71:0/127585539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fa006c0a0 0x7f6fa016d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:24.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.262+0000 7f6fa6fff700 1 -- 172.21.15.71:0/127585539 >> 172.21.15.71:0/127585539 conn(0x7f6fa00ce600 msgr2=0x7f6fa015c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:24.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.263+0000 7f6fa6fff700 1 -- 172.21.15.71:0/127585539 shutdown_connections 2023-10-09T06:57:24.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.263+0000 7f6fa6fff700 1 -- 172.21.15.71:0/127585539 wait complete. 2023-10-09T06:57:24.282 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:57:24.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-10-09T06:57:24.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.461+0000 7f9e84b9d700 1 Processor -- start 2023-10-09T06:57:24.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.461+0000 7f9e84b9d700 1 -- start start 2023-10-09T06:57:24.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.463+0000 7f9e84b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e80150180 0x7f9e80157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:24.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.463+0000 7f9e84b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9e800c7410 0x7f9e80069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:24.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.463+0000 7f9e84b9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8006e2a0 con 0x7f9e80150550 2023-10-09T06:57:24.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.463+0000 7f9e84b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8006b2e0 con 0x7f9e800c7410 2023-10-09T06:57:24.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.463+0000 7f9e84b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e800c78e0 con 0x7f9e80150180 2023-10-09T06:57:24.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.463+0000 7f9e7effd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9e80150550 0x7f9e800c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45470/0 (socket says 172.21.15.71:45470) 2023-10-09T06:57:24.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.463+0000 7f9e7effd700 1 -- 172.21.15.71:0/2623267726 learned_addr learned my addr 172.21.15.71:0/2623267726 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:24.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.463+0000 7f9e7e7fc700 1 -- 172.21.15.71:0/2623267726 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 256136247 0 0) 0x7f9e8006e2a0 con 0x7f9e80150550 2023-10-09T06:57:24.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.463+0000 7f9e7e7fc700 1 -- 172.21.15.71:0/2623267726 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e68003570 con 0x7f9e80150550 2023-10-09T06:57:24.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.463+0000 7f9e7f7fe700 1 --2- 172.21.15.71:0/2623267726 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e80150180 0x7f9e80157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:24.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.463+0000 7f9e7ffff700 1 --2- 172.21.15.71:0/2623267726 >> v2:172.21.15.179:3300/0 conn(0x7f9e800c7410 0x7f9e80069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:24.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.464+0000 7f9e7e7fc700 1 -- 172.21.15.71:0/2623267726 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3860100579 0 0) 0x7f9e68003570 con 0x7f9e80150550 2023-10-09T06:57:24.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.464+0000 7f9e7e7fc700 1 -- 172.21.15.71:0/2623267726 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e80150180 msgr2=0x7f9e80157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:24.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.464+0000 7f9e7e7fc700 1 --2- 172.21.15.71:0/2623267726 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e80150180 0x7f9e80157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:24.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.464+0000 7f9e7e7fc700 1 -- 172.21.15.71:0/2623267726 >> v2:172.21.15.179:3300/0 conn(0x7f9e800c7410 msgr2=0x7f9e80069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:24.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.464+0000 7f9e7e7fc700 1 --2- 172.21.15.71:0/2623267726 >> v2:172.21.15.179:3300/0 conn(0x7f9e800c7410 0x7f9e80069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:24.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.464+0000 7f9e7e7fc700 1 -- 172.21.15.71:0/2623267726 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e800c7bc0 con 0x7f9e80150550 2023-10-09T06:57:24.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.464+0000 7f9e7e7fc700 1 -- 172.21.15.71:0/2623267726 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f9e74001470 con 0x7f9e80150550 2023-10-09T06:57:24.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.464+0000 7f9e7e7fc700 1 -- 172.21.15.71:0/2623267726 >> v1:172.21.15.71:6789/0 conn(0x7f9e80150550 legacy=0x7f9e800c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:24.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.464+0000 7f9e7e7fc700 1 --2- 172.21.15.71:0/2623267726 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e80150180 0x7f9e68003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:24.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.464+0000 7f9e7e7fc700 1 --2- 172.21.15.71:0/2623267726 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e68003fe0 0x7f9e68004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:24.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.464+0000 7f9e7e7fc700 1 --2- 172.21.15.71:0/2623267726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e68004d50 0x7f9e680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:24.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.464+0000 7f9e7e7fc700 1 -- 172.21.15.71:0/2623267726 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8006b2e0 con 0x7f9e68004d50 2023-10-09T06:57:24.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.464+0000 7f9e7e7fc700 1 -- 172.21.15.71:0/2623267726 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e800c78e0 con 0x7f9e68003fe0 2023-10-09T06:57:24.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.464+0000 7f9e7e7fc700 1 -- 172.21.15.71:0/2623267726 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6800dca0 con 0x7f9e80150180 2023-10-09T06:57:24.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.464+0000 7f9e7ffff700 1 --2- 172.21.15.71:0/2623267726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e68004d50 0x7f9e680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:24.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.464+0000 7f9e7effd700 1 --2- 172.21.15.71:0/2623267726 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e68003fe0 0x7f9e68004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:24.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.464+0000 7f9e7f7fe700 1 --2- 172.21.15.71:0/2623267726 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e80150180 0x7f9e68003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:24.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.464+0000 7f9e7ffff700 1 -- 172.21.15.71:0/2623267726 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e80150180 msgr2=0x7f9e68003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:24.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.464+0000 7f9e7ffff700 1 --2- 172.21.15.71:0/2623267726 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e80150180 0x7f9e68003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:24.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.464+0000 7f9e7ffff700 1 -- 172.21.15.71:0/2623267726 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e68003fe0 msgr2=0x7f9e68004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:24.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.464+0000 7f9e7ffff700 1 --2- 172.21.15.71:0/2623267726 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e68003fe0 0x7f9e68004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:24.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.464+0000 7f9e7ffff700 1 -- 172.21.15.71:0/2623267726 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e68003570 con 0x7f9e68004d50 2023-10-09T06:57:24.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.465+0000 7f9e7ffff700 1 --2- 172.21.15.71:0/2623267726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e68004d50 0x7f9e680051c0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9e800c67e0 tx=0x7f9e7800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc61e3cd2c0b30c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:24.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.465+0000 7f9e7e7fc700 1 -- 172.21.15.71:0/2623267726 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7800ea00 con 0x7f9e68004d50 2023-10-09T06:57:24.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.465+0000 7f9e7e7fc700 1 -- 172.21.15.71:0/2623267726 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7800f040 con 0x7f9e68004d50 2023-10-09T06:57:24.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.465+0000 7f9e7e7fc700 1 -- 172.21.15.71:0/2623267726 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7800edb0 con 0x7f9e68004d50 2023-10-09T06:57:24.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.465+0000 7f9e84b9d700 1 -- 172.21.15.71:0/2623267726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e68004d50 msgr2=0x7f9e680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:24.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.465+0000 7f9e84b9d700 1 --2- 172.21.15.71:0/2623267726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e68004d50 0x7f9e680051c0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9e800c67e0 tx=0x7f9e7800b040 comp rx=0 tx=0).stop 2023-10-09T06:57:24.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.465+0000 7f9e7ffff700 1 -- 172.21.15.71:0/2623267726 reap_dead start 2023-10-09T06:57:24.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.465+0000 7f9e84b9d700 1 -- 172.21.15.71:0/2623267726 shutdown_connections 2023-10-09T06:57:24.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.465+0000 7f9e84b9d700 1 -- 172.21.15.71:0/2623267726 >> 172.21.15.71:0/2623267726 conn(0x7f9e800cc1f0 msgr2=0x7f9e800cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:24.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.466+0000 7f9e84b9d700 1 -- 172.21.15.71:0/2623267726 shutdown_connections 2023-10-09T06:57:24.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.466+0000 7f9e84b9d700 1 -- 172.21.15.71:0/2623267726 wait complete. 2023-10-09T06:57:24.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.467+0000 7f9e84b9d700 1 Processor -- start 2023-10-09T06:57:24.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.467+0000 7f9e84b9d700 1 -- start start 2023-10-09T06:57:24.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.468+0000 7f9e84b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e68004d50 0x7f9e8014af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:24.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.468+0000 7f9e84b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e8014f540 0x7f9e800c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:24.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.468+0000 7f9e84b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e800aef90 0x7f9e8014bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:24.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.468+0000 7f9e84b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e800c53a0 con 0x7f9e800aef90 2023-10-09T06:57:24.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.468+0000 7f9e84b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8014b450 con 0x7f9e68004d50 2023-10-09T06:57:24.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.468+0000 7f9e84b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e800c4790 con 0x7f9e8014f540 2023-10-09T06:57:24.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.468+0000 7f9e7ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e800aef90 0x7f9e8014bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:24.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.468+0000 7f9e7ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e800aef90 0x7f9e8014bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60872/0 (socket says 172.21.15.71:60872) 2023-10-09T06:57:24.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.468+0000 7f9e7ffff700 1 -- 172.21.15.71:0/1663076223 learned_addr learned my addr 172.21.15.71:0/1663076223 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:24.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.468+0000 7f9e7f7fe700 1 --2- 172.21.15.71:0/1663076223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e68004d50 0x7f9e8014af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:24.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.468+0000 7f9e7effd700 1 --2- 172.21.15.71:0/1663076223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e8014f540 0x7f9e800c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:24.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.469+0000 7f9e7ffff700 1 -- 172.21.15.71:0/1663076223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e8014f540 msgr2=0x7f9e800c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:24.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.469+0000 7f9e7ffff700 1 --2- 172.21.15.71:0/1663076223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e8014f540 0x7f9e800c5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:24.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.469+0000 7f9e7ffff700 1 -- 172.21.15.71:0/1663076223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e68004d50 msgr2=0x7f9e8014af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:24.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.469+0000 7f9e7ffff700 1 --2- 172.21.15.71:0/1663076223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e68004d50 0x7f9e8014af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:24.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.469+0000 7f9e7ffff700 1 -- 172.21.15.71:0/1663076223 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e800c4a70 con 0x7f9e800aef90 2023-10-09T06:57:24.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.469+0000 7f9e7ffff700 1 --2- 172.21.15.71:0/1663076223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e800aef90 0x7f9e8014bd70 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009750 tx=0x7f9e7801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:24.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.469+0000 7f9e677fe700 1 -- 172.21.15.71:0/1663076223 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7801e640 con 0x7f9e800aef90 2023-10-09T06:57:24.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.469+0000 7f9e677fe700 1 -- 172.21.15.71:0/1663076223 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e78022070 con 0x7f9e800aef90 2023-10-09T06:57:24.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.469+0000 7f9e84b9d700 1 -- 172.21.15.71:0/1663076223 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e800c4d50 con 0x7f9e800aef90 2023-10-09T06:57:24.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.469+0000 7f9e677fe700 1 -- 172.21.15.71:0/1663076223 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7801e9d0 con 0x7f9e800aef90 2023-10-09T06:57:24.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.469+0000 7f9e84b9d700 1 -- 172.21.15.71:0/1663076223 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e800c43d0 con 0x7f9e800aef90 2023-10-09T06:57:24.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.470+0000 7f9e84b9d700 1 -- 172.21.15.71:0/1663076223 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e800c5510 con 0x7f9e800aef90 2023-10-09T06:57:24.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.471+0000 7f9e677fe700 1 -- 172.21.15.71:0/1663076223 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e78003040 con 0x7f9e800aef90 2023-10-09T06:57:24.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.472+0000 7f9e677fe700 1 --2- 172.21.15.71:0/1663076223 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9e6c066f30 0x7f9e6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:24.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.472+0000 7f9e677fe700 1 -- 172.21.15.71:0/1663076223 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f9e78024070 con 0x7f9e800aef90 2023-10-09T06:57:24.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.472+0000 7f9e7f7fe700 1 --2- 172.21.15.71:0/1663076223 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9e6c066f30 0x7f9e6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:24.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.473+0000 7f9e7f7fe700 1 --2- 172.21.15.71:0/1663076223 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9e6c066f30 0x7f9e6c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9e70006f00 tx=0x7f9e700091a0 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:24.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.476+0000 7f9e677fe700 1 -- 172.21.15.71:0/1663076223 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e78053840 con 0x7f9e800aef90 2023-10-09T06:57:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.668+0000 7f9e84b9d700 1 -- 172.21.15.71:0/1663076223 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e8004c3c0 con 0x7f9e800aef90 2023-10-09T06:57:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.669+0000 7f9e677fe700 1 -- 172.21.15.71:0/1663076223 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+12728 (secure 0 0 0) 0x7f9e78056e60 con 0x7f9e800aef90 2023-10-09T06:57:24.670 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:24.670 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":75,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:57:23.760642+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:57:24.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.671+0000 7f9e84b9d700 1 -- 172.21.15.71:0/1663076223 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9e6c066f30 msgr2=0x7f9e6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.671+0000 7f9e84b9d700 1 --2- 172.21.15.71:0/1663076223 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9e6c066f30 0x7f9e6c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9e70006f00 tx=0x7f9e700091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.671+0000 7f9e84b9d700 1 -- 172.21.15.71:0/1663076223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e800aef90 msgr2=0x7f9e8014bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.671+0000 7f9e84b9d700 1 --2- 172.21.15.71:0/1663076223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e800aef90 0x7f9e8014bd70 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009750 tx=0x7f9e7801a000 comp rx=0 tx=0).stop 2023-10-09T06:57:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.671+0000 7f9e84b9d700 1 -- 172.21.15.71:0/1663076223 shutdown_connections 2023-10-09T06:57:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.671+0000 7f9e84b9d700 1 --2- 172.21.15.71:0/1663076223 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9e6c066f30 0x7f9e6c0693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.671+0000 7f9e84b9d700 1 --2- 172.21.15.71:0/1663076223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e800aef90 0x7f9e8014bd70 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.671+0000 7f9e84b9d700 1 --2- 172.21.15.71:0/1663076223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e68004d50 0x7f9e8014af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.671+0000 7f9e84b9d700 1 --2- 172.21.15.71:0/1663076223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e8014f540 0x7f9e800c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.671+0000 7f9e84b9d700 1 -- 172.21.15.71:0/1663076223 >> 172.21.15.71:0/1663076223 conn(0x7f9e800cc1f0 msgr2=0x7f9e800c2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.672+0000 7f9e84b9d700 1 -- 172.21.15.71:0/1663076223 shutdown_connections 2023-10-09T06:57:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.672+0000 7f9e84b9d700 1 -- 172.21.15.71:0/1663076223 wait complete. 2023-10-09T06:57:24.690 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T06:57:24.690 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:57:24.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.873+0000 7f526659d700 1 Processor -- start 2023-10-09T06:57:24.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.874+0000 7f526659d700 1 -- start start 2023-10-09T06:57:24.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.875+0000 7f526659d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f526006f060 0x7f52600ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:24.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.875+0000 7f526659d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526006ebd0 con 0x7f526006f4b0 2023-10-09T06:57:24.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.875+0000 7f526659d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526015aa70 con 0x7f52600cb1a0 2023-10-09T06:57:24.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.875+0000 7f526659d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526015b2e0 con 0x7f526006f060 2023-10-09T06:57:24.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.875+0000 7f5264d9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f526006f060 0x7f52600ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:24.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.875+0000 7f5265d9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f526006f4b0 0x7f52600c9db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45482/0 (socket says 172.21.15.71:45482) 2023-10-09T06:57:24.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.875+0000 7f5265d9c700 1 -- 172.21.15.71:0/3360784745 learned_addr learned my addr 172.21.15.71:0/3360784745 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:24.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.876+0000 7f5264d9a700 1 -- 172.21.15.71:0/3360784745 >> v1:172.21.15.179:6789/0 conn(0x7f52600cb1a0 legacy=0x7f526015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:24.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.876+0000 7f5264d9a700 1 -- 172.21.15.71:0/3360784745 >> v1:172.21.15.71:6789/0 conn(0x7f526006f4b0 legacy=0x7f52600c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:24.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.876+0000 7f5264d9a700 1 -- 172.21.15.71:0/3360784745 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526015ad20 con 0x7f526006f060 2023-10-09T06:57:24.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.876+0000 7f5257fff700 1 -- 172.21.15.71:0/3360784745 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398186167 0 0) 0x7f526006ebd0 con 0x7f526006f4b0 2023-10-09T06:57:24.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.876+0000 7f5264d9a700 1 --2- 172.21.15.71:0/3360784745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f526006f060 0x7f52600ae0d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f52500098e0 tx=0x7f52500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20ab09ccf7df09 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:24.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.876+0000 7f5257fff700 1 -- 172.21.15.71:0/3360784745 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5250009e80 con 0x7f526006f060 2023-10-09T06:57:24.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.876+0000 7f5257fff700 1 -- 172.21.15.71:0/3360784745 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525000b8f0 con 0x7f526006f060 2023-10-09T06:57:24.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.876+0000 7f5257fff700 1 -- 172.21.15.71:0/3360784745 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525000bc70 con 0x7f526006f060 2023-10-09T06:57:24.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.877+0000 7f526659d700 1 -- 172.21.15.71:0/3360784745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f526006f060 msgr2=0x7f52600ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:24.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.877+0000 7f526659d700 1 --2- 172.21.15.71:0/3360784745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f526006f060 0x7f52600ae0d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f52500098e0 tx=0x7f52500091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:24.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.877+0000 7f526659d700 1 -- 172.21.15.71:0/3360784745 shutdown_connections 2023-10-09T06:57:24.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.877+0000 7f526659d700 1 --2- 172.21.15.71:0/3360784745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f526006f060 0x7f52600ae0d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:24.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.877+0000 7f526659d700 1 -- 172.21.15.71:0/3360784745 >> 172.21.15.71:0/3360784745 conn(0x7f52600cc1e0 msgr2=0x7f52600cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:24.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.877+0000 7f526659d700 1 -- 172.21.15.71:0/3360784745 shutdown_connections 2023-10-09T06:57:24.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.877+0000 7f526659d700 1 -- 172.21.15.71:0/3360784745 wait complete. 2023-10-09T06:57:24.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.878+0000 7f526659d700 1 Processor -- start 2023-10-09T06:57:24.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.878+0000 7f526659d700 1 -- start start 2023-10-09T06:57:24.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.879+0000 7f526659d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f526006f060 0x7f5260157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:24.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.879+0000 7f526659d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f526006f4b0 0x7f5260150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:24.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.879+0000 7f526659d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52600cb1a0 0x7f5260151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:24.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.879+0000 7f526659d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5260152430 con 0x7f526006f4b0 2023-10-09T06:57:24.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.879+0000 7f526659d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5260151b90 con 0x7f52600cb1a0 2023-10-09T06:57:24.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.879+0000 7f526659d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5260151e70 con 0x7f526006f060 2023-10-09T06:57:24.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.879+0000 7f5264d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f526006f4b0 0x7f5260150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:24.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.879+0000 7f5264d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f526006f4b0 0x7f5260150ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60882/0 (socket says 172.21.15.71:60882) 2023-10-09T06:57:24.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.879+0000 7f5264d9a700 1 -- 172.21.15.71:0/2113537162 learned_addr learned my addr 172.21.15.71:0/2113537162 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:24.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.879+0000 7f5265d9c700 1 --2- 172.21.15.71:0/2113537162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52600cb1a0 0x7f5260151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:24.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.879+0000 7f526559b700 1 --2- 172.21.15.71:0/2113537162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f526006f060 0x7f5260157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:24.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.880+0000 7f5264d9a700 1 -- 172.21.15.71:0/2113537162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f526006f060 msgr2=0x7f5260157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:24.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.880+0000 7f5264d9a700 1 --2- 172.21.15.71:0/2113537162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f526006f060 0x7f5260157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:24.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.880+0000 7f5264d9a700 1 -- 172.21.15.71:0/2113537162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52600cb1a0 msgr2=0x7f5260151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:24.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.880+0000 7f5264d9a700 1 --2- 172.21.15.71:0/2113537162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52600cb1a0 0x7f5260151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:24.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.880+0000 7f5264d9a700 1 -- 172.21.15.71:0/2113537162 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5250009420 con 0x7f526006f4b0 2023-10-09T06:57:24.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.880+0000 7f5264d9a700 1 --2- 172.21.15.71:0/2113537162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f526006f4b0 0x7f5260150ae0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f526006ce80 tx=0x7f5250017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:24.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.880+0000 7f52557fa700 1 -- 172.21.15.71:0/2113537162 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525001f070 con 0x7f526006f4b0 2023-10-09T06:57:24.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.880+0000 7f52557fa700 1 -- 172.21.15.71:0/2113537162 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525000ba60 con 0x7f526006f4b0 2023-10-09T06:57:24.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.880+0000 7f526659d700 1 -- 172.21.15.71:0/2113537162 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5260152150 con 0x7f526006f4b0 2023-10-09T06:57:24.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.880+0000 7f52557fa700 1 -- 172.21.15.71:0/2113537162 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5250025650 con 0x7f526006f4b0 2023-10-09T06:57:24.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.880+0000 7f526659d700 1 -- 172.21.15.71:0/2113537162 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5260157c80 con 0x7f526006f4b0 2023-10-09T06:57:24.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.881+0000 7f526659d700 1 -- 172.21.15.71:0/2113537162 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f526006c450 con 0x7f526006f4b0 2023-10-09T06:57:24.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.882+0000 7f52557fa700 1 -- 172.21.15.71:0/2113537162 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5250023070 con 0x7f526006f4b0 2023-10-09T06:57:24.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.883+0000 7f52557fa700 1 --2- 172.21.15.71:0/2113537162 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5244066f30 0x7f52440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:24.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.883+0000 7f52557fa700 1 -- 172.21.15.71:0/2113537162 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f52500859b0 con 0x7f526006f4b0 2023-10-09T06:57:24.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.883+0000 7f526559b700 1 --2- 172.21.15.71:0/2113537162 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5244066f30 0x7f52440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:24.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.884+0000 7f526559b700 1 --2- 172.21.15.71:0/2113537162 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5244066f30 0x7f52440693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f525c0037c0 tx=0x7f525c009040 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:24.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:24.887+0000 7f52557fa700 1 -- 172.21.15.71:0/2113537162 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5250052df0 con 0x7f526006f4b0 2023-10-09T06:57:25.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.076+0000 7f526659d700 1 -- 172.21.15.71:0/2113537162 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f526015b000 con 0x7f526006f4b0 2023-10-09T06:57:25.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.076+0000 7f52557fa700 1 -- 172.21.15.71:0/2113537162 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f525002a020 con 0x7f526006f4b0 2023-10-09T06:57:25.078 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T06:57:25.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.079+0000 7f526659d700 1 -- 172.21.15.71:0/2113537162 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5244066f30 msgr2=0x7f52440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:25.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.079+0000 7f526659d700 1 --2- 172.21.15.71:0/2113537162 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5244066f30 0x7f52440693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f525c0037c0 tx=0x7f525c009040 comp rx=0 tx=0).stop 2023-10-09T06:57:25.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.079+0000 7f526659d700 1 -- 172.21.15.71:0/2113537162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f526006f4b0 msgr2=0x7f5260150ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:25.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.079+0000 7f526659d700 1 --2- 172.21.15.71:0/2113537162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f526006f4b0 0x7f5260150ae0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f526006ce80 tx=0x7f5250017000 comp rx=0 tx=0).stop 2023-10-09T06:57:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.079+0000 7f526659d700 1 -- 172.21.15.71:0/2113537162 shutdown_connections 2023-10-09T06:57:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.079+0000 7f526659d700 1 --2- 172.21.15.71:0/2113537162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52600cb1a0 0x7f5260151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.079+0000 7f526659d700 1 --2- 172.21.15.71:0/2113537162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f526006f060 0x7f5260157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.079+0000 7f526659d700 1 --2- 172.21.15.71:0/2113537162 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5244066f30 0x7f52440693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.079+0000 7f526659d700 1 --2- 172.21.15.71:0/2113537162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f526006f4b0 0x7f5260150ae0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.079+0000 7f526659d700 1 -- 172.21.15.71:0/2113537162 >> 172.21.15.71:0/2113537162 conn(0x7f52600cc1e0 msgr2=0x7f52600c1420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.079+0000 7f526659d700 1 -- 172.21.15.71:0/2113537162 shutdown_connections 2023-10-09T06:57:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.079+0000 7f526659d700 1 -- 172.21.15.71:0/2113537162 wait complete. 2023-10-09T06:57:25.098 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T06:57:25.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.277+0000 7f9facdff700 1 Processor -- start 2023-10-09T06:57:25.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.277+0000 7f9facdff700 1 -- start start 2023-10-09T06:57:25.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.278+0000 7f9facdff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9fa8159890 0x7f9fa815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:25.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.278+0000 7f9facdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa8159c60 0x7f9fa815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:25.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.278+0000 7f9facdff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa815a160 con 0x7f9fa815db10 2023-10-09T06:57:25.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.278+0000 7f9facdff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa80d13a0 con 0x7f9fa8159890 2023-10-09T06:57:25.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.278+0000 7f9facdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa815e140 con 0x7f9fa8159c60 2023-10-09T06:57:25.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.279+0000 7f9fa6d9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9fa815db10 0x7f9fa8069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60256/0 (socket says 172.21.15.71:60256) 2023-10-09T06:57:25.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.279+0000 7f9fa6d9d700 1 -- 172.21.15.71:0/2142299839 learned_addr learned my addr 172.21.15.71:0/2142299839 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:25.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.279+0000 7f9fa5d9b700 1 --2- 172.21.15.71:0/2142299839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa8159c60 0x7f9fa815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:25.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.279+0000 7f9fa659c700 1 --2- 172.21.15.71:0/2142299839 >> v2:172.21.15.179:3300/0 conn(0x7f9fa8159890 0x7f9fa815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:25.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.279+0000 7f9fa559a700 1 -- 172.21.15.71:0/2142299839 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566756862 0 0) 0x7f9fa815a160 con 0x7f9fa815db10 2023-10-09T06:57:25.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.279+0000 7f9fa559a700 1 -- 172.21.15.71:0/2142299839 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f90003570 con 0x7f9fa815db10 2023-10-09T06:57:25.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.279+0000 7f9fa5d9b700 1 -- 172.21.15.71:0/2142299839 >> v2:172.21.15.179:3300/0 conn(0x7f9fa8159890 msgr2=0x7f9fa815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:25.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.279+0000 7f9fa5d9b700 1 --2- 172.21.15.71:0/2142299839 >> v2:172.21.15.179:3300/0 conn(0x7f9fa8159890 0x7f9fa815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:25.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.279+0000 7f9fa5d9b700 1 -- 172.21.15.71:0/2142299839 >> v1:172.21.15.71:6789/0 conn(0x7f9fa815db10 legacy=0x7f9fa8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:25.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.279+0000 7f9fa5d9b700 1 -- 172.21.15.71:0/2142299839 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa815a3d0 con 0x7f9fa8159c60 2023-10-09T06:57:25.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.279+0000 7f9fa659c700 1 --2- 172.21.15.71:0/2142299839 >> v2:172.21.15.179:3300/0 conn(0x7f9fa8159890 0x7f9fa815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:57:25.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.280+0000 7f9fa5d9b700 1 --2- 172.21.15.71:0/2142299839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa8159c60 0x7f9fa815d5d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0098e0 tx=0x7f9f9c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b809ae73a7149380 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:25.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.280+0000 7f9fa559a700 1 -- 172.21.15.71:0/2142299839 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c011630 con 0x7f9fa8159c60 2023-10-09T06:57:25.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.280+0000 7f9fa559a700 1 -- 172.21.15.71:0/2142299839 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9c011790 con 0x7f9fa8159c60 2023-10-09T06:57:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.280+0000 7f9fa559a700 1 -- 172.21.15.71:0/2142299839 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c011b10 con 0x7f9fa8159c60 2023-10-09T06:57:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.280+0000 7f9facdff700 1 -- 172.21.15.71:0/2142299839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa8159c60 msgr2=0x7f9fa815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.280+0000 7f9facdff700 1 --2- 172.21.15.71:0/2142299839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa8159c60 0x7f9fa815d5d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0098e0 tx=0x7f9f9c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.280+0000 7f9facdff700 1 -- 172.21.15.71:0/2142299839 shutdown_connections 2023-10-09T06:57:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.280+0000 7f9facdff700 1 --2- 172.21.15.71:0/2142299839 >> v2:172.21.15.179:3300/0 conn(0x7f9fa8159890 0x7f9fa815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.280+0000 7f9facdff700 1 --2- 172.21.15.71:0/2142299839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa8159c60 0x7f9fa815d5d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.280+0000 7f9facdff700 1 -- 172.21.15.71:0/2142299839 >> 172.21.15.71:0/2142299839 conn(0x7f9fa8068e20 msgr2=0x7f9fa80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.280+0000 7f9facdff700 1 -- 172.21.15.71:0/2142299839 shutdown_connections 2023-10-09T06:57:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.281+0000 7f9facdff700 1 -- 172.21.15.71:0/2142299839 wait complete. 2023-10-09T06:57:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.282+0000 7f9facdff700 1 Processor -- start 2023-10-09T06:57:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.282+0000 7f9facdff700 1 -- start start 2023-10-09T06:57:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.283+0000 7f9facdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa8159890 0x7f9fa815bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.283+0000 7f9facdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa8159c60 0x7f9fa814a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.283+0000 7f9facdff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fa815db10 0x7f9fa80b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.283+0000 7f9facdff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa815bb00 con 0x7f9fa815db10 2023-10-09T06:57:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.283+0000 7f9facdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa815b4d0 con 0x7f9fa8159c60 2023-10-09T06:57:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.283+0000 7f9facdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa80b17a0 con 0x7f9fa8159890 2023-10-09T06:57:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.283+0000 7f9fa6d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fa815db10 0x7f9fa80b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.283+0000 7f9fa6d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fa815db10 0x7f9fa80b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33970/0 (socket says 172.21.15.71:33970) 2023-10-09T06:57:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.283+0000 7f9fa6d9d700 1 -- 172.21.15.71:0/1614656398 learned_addr learned my addr 172.21.15.71:0/1614656398 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.283+0000 7f9fa659c700 1 --2- 172.21.15.71:0/1614656398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa8159890 0x7f9fa815bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.283+0000 7f9fa5d9b700 1 --2- 172.21.15.71:0/1614656398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa8159c60 0x7f9fa814a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:25.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.284+0000 7f9fa6d9d700 1 -- 172.21.15.71:0/1614656398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa8159890 msgr2=0x7f9fa815bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:25.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.284+0000 7f9fa6d9d700 1 --2- 172.21.15.71:0/1614656398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa8159890 0x7f9fa815bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:25.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.284+0000 7f9fa6d9d700 1 -- 172.21.15.71:0/1614656398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa8159c60 msgr2=0x7f9fa814a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:25.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.284+0000 7f9fa6d9d700 1 --2- 172.21.15.71:0/1614656398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa8159c60 0x7f9fa814a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:25.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.284+0000 7f9fa6d9d700 1 -- 172.21.15.71:0/1614656398 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f98009420 con 0x7f9fa815db10 2023-10-09T06:57:25.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.284+0000 7f9fa5d9b700 1 --2- 172.21.15.71:0/1614656398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa8159c60 0x7f9fa814a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:25.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.284+0000 7f9fa6d9d700 1 --2- 172.21.15.71:0/1614656398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fa815db10 0x7f9fa80b0e50 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0001460 tx=0x7f9fa0001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:25.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.284+0000 7f9f967fc700 1 -- 172.21.15.71:0/1614656398 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa000a8a0 con 0x7f9fa815db10 2023-10-09T06:57:25.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.284+0000 7f9f967fc700 1 -- 172.21.15.71:0/1614656398 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa000aa00 con 0x7f9fa815db10 2023-10-09T06:57:25.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.284+0000 7f9f967fc700 1 -- 172.21.15.71:0/1614656398 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa000ad80 con 0x7f9fa815db10 2023-10-09T06:57:25.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.284+0000 7f9facdff700 1 -- 172.21.15.71:0/1614656398 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9c009420 con 0x7f9fa815db10 2023-10-09T06:57:25.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.284+0000 7f9facdff700 1 -- 172.21.15.71:0/1614656398 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa815b790 con 0x7f9fa815db10 2023-10-09T06:57:25.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.285+0000 7f9facdff700 1 -- 172.21.15.71:0/1614656398 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa804c3c0 con 0x7f9fa815db10 2023-10-09T06:57:25.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.286+0000 7f9f967fc700 1 -- 172.21.15.71:0/1614656398 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9fa0007300 con 0x7f9fa815db10 2023-10-09T06:57:25.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.287+0000 7f9f967fc700 1 --2- 172.21.15.71:0/1614656398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9f88066f30 0x7f9f880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:25.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.287+0000 7f9f967fc700 1 -- 172.21.15.71:0/1614656398 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f9fa00846a0 con 0x7f9fa815db10 2023-10-09T06:57:25.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.288+0000 7f9fa659c700 1 --2- 172.21.15.71:0/1614656398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9f88066f30 0x7f9f880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:25.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.288+0000 7f9fa659c700 1 --2- 172.21.15.71:0/1614656398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9f88066f30 0x7f9f880693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009f40 tx=0x7f9f980091a0 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:25.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.291+0000 7f9f967fc700 1 -- 172.21.15.71:0/1614656398 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9fa0051b60 con 0x7f9fa815db10 2023-10-09T06:57:25.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.481+0000 7f9facdff700 1 -- 172.21.15.71:0/1614656398 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9fa806a5b0 con 0x7f9fa815db10 2023-10-09T06:57:25.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.482+0000 7f9f967fc700 1 -- 172.21.15.71:0/1614656398 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9fa0055180 con 0x7f9fa815db10 2023-10-09T06:57:25.483 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:25.483 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-09T06:57:25.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:57:25.483 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 1, 2023-10-09T06:57:25.483 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": ".mgr" 2023-10-09T06:57:25.484 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:57:25.484 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-09T06:57:25.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.484+0000 7f9facdff700 1 -- 172.21.15.71:0/1614656398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9f88066f30 msgr2=0x7f9f880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:25.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.484+0000 7f9facdff700 1 --2- 172.21.15.71:0/1614656398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9f88066f30 0x7f9f880693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009f40 tx=0x7f9f980091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:25.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.484+0000 7f9facdff700 1 -- 172.21.15.71:0/1614656398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fa815db10 msgr2=0x7f9fa80b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:25.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.484+0000 7f9facdff700 1 --2- 172.21.15.71:0/1614656398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fa815db10 0x7f9fa80b0e50 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0001460 tx=0x7f9fa0001a40 comp rx=0 tx=0).stop 2023-10-09T06:57:25.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.484+0000 7f9facdff700 1 -- 172.21.15.71:0/1614656398 shutdown_connections 2023-10-09T06:57:25.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.484+0000 7f9facdff700 1 --2- 172.21.15.71:0/1614656398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9f88066f30 0x7f9f880693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:25.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.484+0000 7f9facdff700 1 --2- 172.21.15.71:0/1614656398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fa815db10 0x7f9fa80b0e50 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:25.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.484+0000 7f9facdff700 1 --2- 172.21.15.71:0/1614656398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa8159890 0x7f9fa815bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:25.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.484+0000 7f9facdff700 1 --2- 172.21.15.71:0/1614656398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa8159c60 0x7f9fa814a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:25.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.484+0000 7f9facdff700 1 -- 172.21.15.71:0/1614656398 >> 172.21.15.71:0/1614656398 conn(0x7f9fa8068e20 msgr2=0x7f9fa814d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:25.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.484+0000 7f9facdff700 1 -- 172.21.15.71:0/1614656398 shutdown_connections 2023-10-09T06:57:25.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.484+0000 7f9facdff700 1 -- 172.21.15.71:0/1614656398 wait complete. 2023-10-09T06:57:25.502 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T06:57:25.502 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T06:57:25.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.687+0000 7f27413ff700 1 Processor -- start 2023-10-09T06:57:25.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.687+0000 7f27413ff700 1 -- start start 2023-10-09T06:57:25.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.688+0000 7f27413ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f273c153f50 0x7f273c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:25.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.688+0000 7f27413ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f273c154320 0x7f273c06d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:25.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.688+0000 7f27413ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273c0b4570 con 0x7f273c15a190 2023-10-09T06:57:25.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.688+0000 7f27413ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f273c15a730 con 0x7f273c153f50 2023-10-09T06:57:25.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.688+0000 7f27413ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f273c15aa10 con 0x7f273c154320 2023-10-09T06:57:25.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.689+0000 7f273affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f273c153f50 0x7f273c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:25.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.689+0000 7f273b7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f273c15a190 0x7f273c15d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60268/0 (socket says 172.21.15.71:60268) 2023-10-09T06:57:25.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.689+0000 7f273b7fe700 1 -- 172.21.15.71:0/1601771008 learned_addr learned my addr 172.21.15.71:0/1601771008 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:25.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.689+0000 7f273a7fc700 1 --2- 172.21.15.71:0/1601771008 >> v2:172.21.15.179:3300/0 conn(0x7f273c154320 0x7f273c06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:25.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.689+0000 7f2739ffb700 1 -- 172.21.15.71:0/1601771008 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326956291 0 0) 0x7f273c0b4570 con 0x7f273c15a190 2023-10-09T06:57:25.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.689+0000 7f2739ffb700 1 -- 172.21.15.71:0/1601771008 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2724003570 con 0x7f273c15a190 2023-10-09T06:57:25.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.689+0000 7f273affd700 1 -- 172.21.15.71:0/1601771008 >> v2:172.21.15.179:3300/0 conn(0x7f273c154320 msgr2=0x7f273c06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:25.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.689+0000 7f273affd700 1 --2- 172.21.15.71:0/1601771008 >> v2:172.21.15.179:3300/0 conn(0x7f273c154320 0x7f273c06d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:25.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.689+0000 7f273affd700 1 -- 172.21.15.71:0/1601771008 >> v1:172.21.15.71:6789/0 conn(0x7f273c15a190 legacy=0x7f273c15d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:25.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.689+0000 7f273affd700 1 -- 172.21.15.71:0/1601771008 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c15acf0 con 0x7f273c153f50 2023-10-09T06:57:25.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.689+0000 7f273a7fc700 1 --2- 172.21.15.71:0/1601771008 >> v2:172.21.15.179:3300/0 conn(0x7f273c154320 0x7f273c06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:25.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.689+0000 7f273affd700 1 --2- 172.21.15.71:0/1601771008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f273c153f50 0x7f273c0b2000 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f273c0b36a0 tx=0x7f272c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc47040c639cf324 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:25.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.690+0000 7f2739ffb700 1 -- 172.21.15.71:0/1601771008 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c011630 con 0x7f273c153f50 2023-10-09T06:57:25.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.690+0000 7f2739ffb700 1 -- 172.21.15.71:0/1601771008 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272c011790 con 0x7f273c153f50 2023-10-09T06:57:25.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.690+0000 7f2739ffb700 1 -- 172.21.15.71:0/1601771008 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c011b30 con 0x7f273c153f50 2023-10-09T06:57:25.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.690+0000 7f27413ff700 1 -- 172.21.15.71:0/1601771008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f273c153f50 msgr2=0x7f273c0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:25.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.690+0000 7f27413ff700 1 --2- 172.21.15.71:0/1601771008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f273c153f50 0x7f273c0b2000 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f273c0b36a0 tx=0x7f272c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:25.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.690+0000 7f27413ff700 1 -- 172.21.15.71:0/1601771008 shutdown_connections 2023-10-09T06:57:25.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.690+0000 7f27413ff700 1 --2- 172.21.15.71:0/1601771008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f273c153f50 0x7f273c0b2000 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:25.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.690+0000 7f27413ff700 1 --2- 172.21.15.71:0/1601771008 >> v2:172.21.15.179:3300/0 conn(0x7f273c154320 0x7f273c06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:25.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.690+0000 7f27413ff700 1 -- 172.21.15.71:0/1601771008 >> 172.21.15.71:0/1601771008 conn(0x7f273c06baf0 msgr2=0x7f273c06bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:25.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.690+0000 7f27413ff700 1 -- 172.21.15.71:0/1601771008 shutdown_connections 2023-10-09T06:57:25.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.690+0000 7f27413ff700 1 -- 172.21.15.71:0/1601771008 wait complete. 2023-10-09T06:57:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.692+0000 7f27413ff700 1 Processor -- start 2023-10-09T06:57:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.692+0000 7f27413ff700 1 -- start start 2023-10-09T06:57:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.693+0000 7f27413ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f273c153f50 0x7f273c16a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.693+0000 7f27413ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273c154320 0x7f273c0acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.693+0000 7f27413ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f273c15a190 0x7f273c1587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.693+0000 7f27413ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c0cb9e0 con 0x7f273c15a190 2023-10-09T06:57:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.693+0000 7f27413ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c16ac70 con 0x7f273c153f50 2023-10-09T06:57:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.693+0000 7f27413ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273c151c70 con 0x7f273c154320 2023-10-09T06:57:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.693+0000 7f273b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f273c15a190 0x7f273c1587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.693+0000 7f273b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f273c15a190 0x7f273c1587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33986/0 (socket says 172.21.15.71:33986) 2023-10-09T06:57:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.693+0000 7f273b7fe700 1 -- 172.21.15.71:0/629783705 learned_addr learned my addr 172.21.15.71:0/629783705 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.693+0000 7f273a7fc700 1 --2- 172.21.15.71:0/629783705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273c154320 0x7f273c0acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.693+0000 7f273affd700 1 --2- 172.21.15.71:0/629783705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f273c153f50 0x7f273c16a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.693+0000 7f273b7fe700 1 -- 172.21.15.71:0/629783705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273c154320 msgr2=0x7f273c0acbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.693+0000 7f273b7fe700 1 --2- 172.21.15.71:0/629783705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273c154320 0x7f273c0acbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.693+0000 7f273b7fe700 1 -- 172.21.15.71:0/629783705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f273c153f50 msgr2=0x7f273c16a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.693+0000 7f273b7fe700 1 --2- 172.21.15.71:0/629783705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f273c153f50 0x7f273c16a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.693+0000 7f273b7fe700 1 -- 172.21.15.71:0/629783705 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c009420 con 0x7f273c15a190 2023-10-09T06:57:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.693+0000 7f273a7fc700 1 --2- 172.21.15.71:0/629783705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273c154320 0x7f273c0acbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.693+0000 7f273affd700 1 --2- 172.21.15.71:0/629783705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f273c153f50 0x7f273c16a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.694+0000 7f273b7fe700 1 --2- 172.21.15.71:0/629783705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f273c15a190 0x7f273c1587c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f2734001460 tx=0x7f2734001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.694+0000 7f2722ffd700 1 -- 172.21.15.71:0/629783705 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273400ce80 con 0x7f273c15a190 2023-10-09T06:57:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.694+0000 7f2722ffd700 1 -- 172.21.15.71:0/629783705 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273400ab10 con 0x7f273c15a190 2023-10-09T06:57:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.694+0000 7f27413ff700 1 -- 172.21.15.71:0/629783705 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273c0ad120 con 0x7f273c15a190 2023-10-09T06:57:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.694+0000 7f2722ffd700 1 -- 172.21.15.71:0/629783705 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273400ae90 con 0x7f273c15a190 2023-10-09T06:57:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.694+0000 7f27413ff700 1 -- 172.21.15.71:0/629783705 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273c16da20 con 0x7f273c15a190 2023-10-09T06:57:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.695+0000 7f27413ff700 1 -- 172.21.15.71:0/629783705 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273c0718b0 con 0x7f273c15a190 2023-10-09T06:57:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.696+0000 7f2722ffd700 1 -- 172.21.15.71:0/629783705 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2734007300 con 0x7f273c15a190 2023-10-09T06:57:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.697+0000 7f2722ffd700 1 --2- 172.21.15.71:0/629783705 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2728066f30 0x7f27280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.697+0000 7f2722ffd700 1 -- 172.21.15.71:0/629783705 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f27340848f0 con 0x7f273c15a190 2023-10-09T06:57:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.697+0000 7f273affd700 1 --2- 172.21.15.71:0/629783705 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2728066f30 0x7f27280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.698+0000 7f273affd700 1 --2- 172.21.15.71:0/629783705 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2728066f30 0x7f27280693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f272c0093f0 tx=0x7f272c017000 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:25.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.701+0000 7f2722ffd700 1 -- 172.21.15.71:0/629783705 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2734051c80 con 0x7f273c15a190 2023-10-09T06:57:25.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:25.897+0000 7f27413ff700 1 -- 172.21.15.71:0/629783705 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f273c15afd0 con 0x7f273c15a190 2023-10-09T06:57:26.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:26.794+0000 7f2722ffd700 1 -- 172.21.15.71:0/629783705 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) v1 ==== 138+0+0 (secure 0 0 0) 0x7f27340552a0 con 0x7f273c15a190 2023-10-09T06:57:26.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:26.800+0000 7f27413ff700 1 -- 172.21.15.71:0/629783705 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2728066f30 msgr2=0x7f27280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:26.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:26.800+0000 7f27413ff700 1 --2- 172.21.15.71:0/629783705 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2728066f30 0x7f27280693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f272c0093f0 tx=0x7f272c017000 comp rx=0 tx=0).stop 2023-10-09T06:57:26.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:26.800+0000 7f27413ff700 1 -- 172.21.15.71:0/629783705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f273c15a190 msgr2=0x7f273c1587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:26.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:26.800+0000 7f27413ff700 1 --2- 172.21.15.71:0/629783705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f273c15a190 0x7f273c1587c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f2734001460 tx=0x7f2734001ae0 comp rx=0 tx=0).stop 2023-10-09T06:57:26.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:26.800+0000 7f27413ff700 1 -- 172.21.15.71:0/629783705 shutdown_connections 2023-10-09T06:57:26.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:26.800+0000 7f27413ff700 1 --2- 172.21.15.71:0/629783705 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2728066f30 0x7f27280693e0 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f272c0093f0 tx=0x7f272c017000 comp rx=0 tx=0).stop 2023-10-09T06:57:26.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:26.800+0000 7f27413ff700 1 --2- 172.21.15.71:0/629783705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f273c15a190 0x7f273c1587c0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:26.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:26.800+0000 7f27413ff700 1 --2- 172.21.15.71:0/629783705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f273c153f50 0x7f273c16a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:26.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:26.800+0000 7f27413ff700 1 --2- 172.21.15.71:0/629783705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273c154320 0x7f273c0acbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:26.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:26.800+0000 7f27413ff700 1 -- 172.21.15.71:0/629783705 >> 172.21.15.71:0/629783705 conn(0x7f273c06baf0 msgr2=0x7f273c0b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:26.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:26.801+0000 7f27413ff700 1 -- 172.21.15.71:0/629783705 shutdown_connections 2023-10-09T06:57:26.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:26.801+0000 7f27413ff700 1 -- 172.21.15.71:0/629783705 wait complete. 2023-10-09T06:57:26.804 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' created 2023-10-09T06:57:26.823 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T06:57:27.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.012+0000 7f0bb21ff700 1 Processor -- start 2023-10-09T06:57:27.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.012+0000 7f0bb21ff700 1 -- start start 2023-10-09T06:57:27.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.013+0000 7f0bb21ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0bac069fa0 0x7f0bac06d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:27.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.013+0000 7f0bb21ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0bac156ee0 0x7f0bac0c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:27.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.014+0000 7f0bb21ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bac156340 con 0x7f0bac0c85c0 2023-10-09T06:57:27.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.014+0000 7f0bb21ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bac0c8990 con 0x7f0bac069fa0 2023-10-09T06:57:27.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.014+0000 7f0bb21ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac06ee20 con 0x7f0bac156ee0 2023-10-09T06:57:27.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.014+0000 7f0bab7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f0bac0c85c0 0x7f0bac069890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60272/0 (socket says 172.21.15.71:60272) 2023-10-09T06:57:27.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.014+0000 7f0bab7fe700 1 -- 172.21.15.71:0/895642696 learned_addr learned my addr 172.21.15.71:0/895642696 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:27.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.014+0000 7f0ba3fff700 1 --2- 172.21.15.71:0/895642696 >> v2:172.21.15.179:3300/0 conn(0x7f0bac069fa0 0x7f0bac06d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:27.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.014+0000 7f0babfff700 1 --2- 172.21.15.71:0/895642696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0bac156ee0 0x7f0bac0c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:27.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.014+0000 7f0baaffd700 1 -- 172.21.15.71:0/895642696 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55971151 0 0) 0x7f0bac156340 con 0x7f0bac0c85c0 2023-10-09T06:57:27.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.014+0000 7f0baaffd700 1 -- 172.21.15.71:0/895642696 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b98003570 con 0x7f0bac0c85c0 2023-10-09T06:57:27.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.015+0000 7f0baaffd700 1 -- 172.21.15.71:0/895642696 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 663228595 0 0) 0x7f0b98003570 con 0x7f0bac0c85c0 2023-10-09T06:57:27.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.015+0000 7f0baaffd700 1 -- 172.21.15.71:0/895642696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0bac156ee0 msgr2=0x7f0bac0c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:27.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.015+0000 7f0baaffd700 1 --2- 172.21.15.71:0/895642696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0bac156ee0 0x7f0bac0c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:27.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.015+0000 7f0baaffd700 1 -- 172.21.15.71:0/895642696 >> v2:172.21.15.179:3300/0 conn(0x7f0bac069fa0 msgr2=0x7f0bac06d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:27.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.015+0000 7f0baaffd700 1 --2- 172.21.15.71:0/895642696 >> v2:172.21.15.179:3300/0 conn(0x7f0bac069fa0 0x7f0bac06d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:27.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.015+0000 7f0baaffd700 1 -- 172.21.15.71:0/895642696 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac06dd80 con 0x7f0bac0c85c0 2023-10-09T06:57:27.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.015+0000 7f0baaffd700 1 -- 172.21.15.71:0/895642696 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f0b9c001470 con 0x7f0bac0c85c0 2023-10-09T06:57:27.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.015+0000 7f0baaffd700 1 -- 172.21.15.71:0/895642696 >> v1:172.21.15.71:6789/0 conn(0x7f0bac0c85c0 legacy=0x7f0bac069890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:27.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.015+0000 7f0baaffd700 1 --2- 172.21.15.71:0/895642696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0bac156ee0 0x7f0b98003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:27.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.015+0000 7f0baaffd700 1 --2- 172.21.15.71:0/895642696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b98003fe0 0x7f0b98004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:27.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.015+0000 7f0baaffd700 1 --2- 172.21.15.71:0/895642696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b98004d50 0x7f0b980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:27.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.015+0000 7f0baaffd700 1 -- 172.21.15.71:0/895642696 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac0c8990 con 0x7f0b98003fe0 2023-10-09T06:57:27.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.015+0000 7f0baaffd700 1 -- 172.21.15.71:0/895642696 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac06ee20 con 0x7f0b98004d50 2023-10-09T06:57:27.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.015+0000 7f0baaffd700 1 -- 172.21.15.71:0/895642696 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9800ba90 con 0x7f0bac156ee0 2023-10-09T06:57:27.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.015+0000 7f0ba3fff700 1 --2- 172.21.15.71:0/895642696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b98003fe0 0x7f0b98004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:27.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.015+0000 7f0bab7fe700 1 --2- 172.21.15.71:0/895642696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0bac156ee0 0x7f0b98003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:27.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.015+0000 7f0babfff700 1 --2- 172.21.15.71:0/895642696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b98004d50 0x7f0b980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:27.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.015+0000 7f0ba3fff700 1 -- 172.21.15.71:0/895642696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0bac156ee0 msgr2=0x7f0b98003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:27.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.015+0000 7f0ba3fff700 1 --2- 172.21.15.71:0/895642696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0bac156ee0 0x7f0b98003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:27.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.015+0000 7f0ba3fff700 1 -- 172.21.15.71:0/895642696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b98004d50 msgr2=0x7f0b980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:27.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.015+0000 7f0ba3fff700 1 --2- 172.21.15.71:0/895642696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b98004d50 0x7f0b980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:27.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.015+0000 7f0ba3fff700 1 -- 172.21.15.71:0/895642696 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b98003570 con 0x7f0b98003fe0 2023-10-09T06:57:27.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.016+0000 7f0babfff700 1 --2- 172.21.15.71:0/895642696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b98004d50 0x7f0b980051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:27.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.016+0000 7f0ba3fff700 1 --2- 172.21.15.71:0/895642696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b98003fe0 0x7f0b98004810 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0bac06a3a0 tx=0x7f0b940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514c1a96f19c4ea3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:27.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.016+0000 7f0baaffd700 1 -- 172.21.15.71:0/895642696 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9400e6b0 con 0x7f0b98003fe0 2023-10-09T06:57:27.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.016+0000 7f0baaffd700 1 -- 172.21.15.71:0/895642696 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9400e810 con 0x7f0b98003fe0 2023-10-09T06:57:27.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.016+0000 7f0baaffd700 1 -- 172.21.15.71:0/895642696 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9400ebd0 con 0x7f0b98003fe0 2023-10-09T06:57:27.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.016+0000 7f0bb21ff700 1 -- 172.21.15.71:0/895642696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b98003fe0 msgr2=0x7f0b98004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:27.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.016+0000 7f0bb21ff700 1 --2- 172.21.15.71:0/895642696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b98003fe0 0x7f0b98004810 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0bac06a3a0 tx=0x7f0b940091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:27.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.016+0000 7f0babfff700 1 -- 172.21.15.71:0/895642696 reap_dead start 2023-10-09T06:57:27.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.017+0000 7f0bb21ff700 1 -- 172.21.15.71:0/895642696 shutdown_connections 2023-10-09T06:57:27.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.017+0000 7f0bb21ff700 1 -- 172.21.15.71:0/895642696 >> 172.21.15.71:0/895642696 conn(0x7f0bac0cc540 msgr2=0x7f0bac0cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:27.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.017+0000 7f0bb21ff700 1 -- 172.21.15.71:0/895642696 shutdown_connections 2023-10-09T06:57:27.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.017+0000 7f0bb21ff700 1 -- 172.21.15.71:0/895642696 wait complete. 2023-10-09T06:57:27.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.018+0000 7f0bb21ff700 1 Processor -- start 2023-10-09T06:57:27.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.018+0000 7f0bb21ff700 1 -- start start 2023-10-09T06:57:27.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.019+0000 7f0bb21ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b98003fe0 0x7f0bac169da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:27.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.019+0000 7f0bb21ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0bac14aa50 0x7f0bac0b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:27.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.019+0000 7f0bb21ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bac0b12f0 0x7f0bac0a9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:27.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.019+0000 7f0bb21ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac0bfbd0 con 0x7f0bac0b12f0 2023-10-09T06:57:27.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.019+0000 7f0bb21ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac0c0470 con 0x7f0bac14aa50 2023-10-09T06:57:27.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.019+0000 7f0bb21ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac0b1740 con 0x7f0b98003fe0 2023-10-09T06:57:27.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.019+0000 7f0babfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bac0b12f0 0x7f0bac0a9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:27.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.019+0000 7f0babfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bac0b12f0 0x7f0bac0a9a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33992/0 (socket says 172.21.15.71:33992) 2023-10-09T06:57:27.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.019+0000 7f0babfff700 1 -- 172.21.15.71:0/2324136298 learned_addr learned my addr 172.21.15.71:0/2324136298 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:27.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.019+0000 7f0bab7fe700 1 --2- 172.21.15.71:0/2324136298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b98003fe0 0x7f0bac169da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:27.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.019+0000 7f0ba3fff700 1 --2- 172.21.15.71:0/2324136298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0bac14aa50 0x7f0bac0b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:27.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.020+0000 7f0babfff700 1 -- 172.21.15.71:0/2324136298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b98003fe0 msgr2=0x7f0bac169da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:27.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.020+0000 7f0babfff700 1 --2- 172.21.15.71:0/2324136298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b98003fe0 0x7f0bac169da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:27.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.020+0000 7f0babfff700 1 -- 172.21.15.71:0/2324136298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0bac14aa50 msgr2=0x7f0bac0b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:27.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.020+0000 7f0babfff700 1 --2- 172.21.15.71:0/2324136298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0bac14aa50 0x7f0bac0b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:27.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.020+0000 7f0babfff700 1 -- 172.21.15.71:0/2324136298 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac16a2e0 con 0x7f0bac0b12f0 2023-10-09T06:57:27.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.020+0000 7f0ba3fff700 1 --2- 172.21.15.71:0/2324136298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0bac14aa50 0x7f0bac0b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:27.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.020+0000 7f0babfff700 1 --2- 172.21.15.71:0/2324136298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bac0b12f0 0x7f0bac0a9a30 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4009f80 tx=0x7f0ba400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:27.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.020+0000 7f0ba37fe700 1 -- 172.21.15.71:0/2324136298 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba401b070 con 0x7f0bac0b12f0 2023-10-09T06:57:27.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.020+0000 7f0ba37fe700 1 -- 172.21.15.71:0/2324136298 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba400f040 con 0x7f0bac0b12f0 2023-10-09T06:57:27.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.020+0000 7f0bb21ff700 1 -- 172.21.15.71:0/2324136298 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bac0aa760 con 0x7f0bac0b12f0 2023-10-09T06:57:27.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.020+0000 7f0ba37fe700 1 -- 172.21.15.71:0/2324136298 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba400e050 con 0x7f0bac0b12f0 2023-10-09T06:57:27.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.020+0000 7f0bb21ff700 1 -- 172.21.15.71:0/2324136298 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bac0c0100 con 0x7f0bac0b12f0 2023-10-09T06:57:27.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.021+0000 7f0bb21ff700 1 -- 172.21.15.71:0/2324136298 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bac0c0600 con 0x7f0bac0b12f0 2023-10-09T06:57:27.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.022+0000 7f0ba37fe700 1 -- 172.21.15.71:0/2324136298 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ba4003020 con 0x7f0bac0b12f0 2023-10-09T06:57:27.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.023+0000 7f0ba37fe700 1 --2- 172.21.15.71:0/2324136298 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0b8c066f60 0x7f0b8c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:27.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.023+0000 7f0ba37fe700 1 -- 172.21.15.71:0/2324136298 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5615+0+0 (secure 0 0 0) 0x7f0ba4084970 con 0x7f0bac0b12f0 2023-10-09T06:57:27.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.024+0000 7f0bab7fe700 1 --2- 172.21.15.71:0/2324136298 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0b8c066f60 0x7f0b8c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:27.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.024+0000 7f0bab7fe700 1 --2- 172.21.15.71:0/2324136298 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0b8c066f60 0x7f0b8c069410 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c000e50 tx=0x7f0b9c001e90 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:27.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.028+0000 7f0ba37fe700 1 -- 172.21.15.71:0/2324136298 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ba4051ba0 con 0x7f0bac0b12f0 2023-10-09T06:57:27.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.219+0000 7f0bb21ff700 1 -- 172.21.15.71:0/2324136298 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0bac0718b0 con 0x7f0bac0b12f0 2023-10-09T06:57:27.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.803+0000 7f0ba37fe700 1 -- 172.21.15.71:0/2324136298 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0ba4010ea0 con 0x7f0bac0b12f0 2023-10-09T06:57:27.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.809+0000 7f0bb21ff700 1 -- 172.21.15.71:0/2324136298 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0b8c066f60 msgr2=0x7f0b8c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:27.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.809+0000 7f0bb21ff700 1 --2- 172.21.15.71:0/2324136298 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0b8c066f60 0x7f0b8c069410 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c000e50 tx=0x7f0b9c001e90 comp rx=0 tx=0).stop 2023-10-09T06:57:27.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.809+0000 7f0bb21ff700 1 -- 172.21.15.71:0/2324136298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bac0b12f0 msgr2=0x7f0bac0a9a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:27.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.809+0000 7f0bb21ff700 1 --2- 172.21.15.71:0/2324136298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bac0b12f0 0x7f0bac0a9a30 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4009f80 tx=0x7f0ba400b040 comp rx=0 tx=0).stop 2023-10-09T06:57:27.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.814+0000 7f0bb21ff700 1 -- 172.21.15.71:0/2324136298 shutdown_connections 2023-10-09T06:57:27.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.814+0000 7f0bb21ff700 1 --2- 172.21.15.71:0/2324136298 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0b8c066f60 0x7f0b8c069410 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:27.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.814+0000 7f0bb21ff700 1 --2- 172.21.15.71:0/2324136298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bac0b12f0 0x7f0bac0a9a30 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:27.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.814+0000 7f0bb21ff700 1 --2- 172.21.15.71:0/2324136298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b98003fe0 0x7f0bac169da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:27.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.814+0000 7f0bb21ff700 1 --2- 172.21.15.71:0/2324136298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0bac14aa50 0x7f0bac0b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:27.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.814+0000 7f0bb21ff700 1 -- 172.21.15.71:0/2324136298 >> 172.21.15.71:0/2324136298 conn(0x7f0bac0cc540 msgr2=0x7f0bac0ca070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:27.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.818+0000 7f0bb21ff700 1 -- 172.21.15.71:0/2324136298 shutdown_connections 2023-10-09T06:57:27.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:27.818+0000 7f0bb21ff700 1 -- 172.21.15.71:0/2324136298 wait complete. 2023-10-09T06:57:27.821 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' created 2023-10-09T06:57:27.841 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T06:57:28.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.024+0000 7f2c6ddff700 1 Processor -- start 2023-10-09T06:57:28.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.024+0000 7f2c6ddff700 1 -- start start 2023-10-09T06:57:28.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.025+0000 7f2c6ddff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2c68155eb0 0x7f2c6806e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:28.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.025+0000 7f2c6ddff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c68069e80 0x7f2c680ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:28.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.025+0000 7f2c6ddff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6806eb90 con 0x7f2c680c70b0 2023-10-09T06:57:28.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.025+0000 7f2c6ddff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6806ee70 con 0x7f2c68155eb0 2023-10-09T06:57:28.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.025+0000 7f2c6ddff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6806f150 con 0x7f2c68069e80 2023-10-09T06:57:28.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.026+0000 7f2c677fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2c68155eb0 0x7f2c6806e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:28.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.026+0000 7f2c66ffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f2c680c70b0 0x7f2c68069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60278/0 (socket says 172.21.15.71:60278) 2023-10-09T06:57:28.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.026+0000 7f2c677fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2c68155eb0 0x7f2c6806e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34008/0 (socket says 172.21.15.71:34008) 2023-10-09T06:57:28.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.026+0000 7f2c66ffd700 1 -- 172.21.15.71:0/3748669188 learned_addr learned my addr 172.21.15.71:0/3748669188 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:28.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.026+0000 7f2c67fff700 1 --2- 172.21.15.71:0/3748669188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c68069e80 0x7f2c680ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:28.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.026+0000 7f2c677fe700 1 -- 172.21.15.71:0/3748669188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c68069e80 msgr2=0x7f2c680ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:28.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.026+0000 7f2c677fe700 1 --2- 172.21.15.71:0/3748669188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c68069e80 0x7f2c680ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:28.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.026+0000 7f2c677fe700 1 -- 172.21.15.71:0/3748669188 >> v1:172.21.15.71:6789/0 conn(0x7f2c680c70b0 legacy=0x7f2c68069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:28.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.026+0000 7f2c677fe700 1 -- 172.21.15.71:0/3748669188 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6806f430 con 0x7f2c68155eb0 2023-10-09T06:57:28.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.026+0000 7f2c667fc700 1 -- 172.21.15.71:0/3748669188 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129101136 0 0) 0x7f2c6806eb90 con 0x7f2c680c70b0 2023-10-09T06:57:28.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.026+0000 7f2c677fe700 1 --2- 172.21.15.71:0/3748669188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c68155eb0 0x7f2c6806e240 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800aa90 tx=0x7f2c5800a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e43323dc2299d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:28.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.027+0000 7f2c667fc700 1 -- 172.21.15.71:0/3748669188 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5800ca40 con 0x7f2c68155eb0 2023-10-09T06:57:28.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.027+0000 7f2c667fc700 1 -- 172.21.15.71:0/3748669188 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5800cba0 con 0x7f2c68155eb0 2023-10-09T06:57:28.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.027+0000 7f2c667fc700 1 -- 172.21.15.71:0/3748669188 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c58018400 con 0x7f2c68155eb0 2023-10-09T06:57:28.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.027+0000 7f2c6ddff700 1 -- 172.21.15.71:0/3748669188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c68155eb0 msgr2=0x7f2c6806e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:28.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.027+0000 7f2c6ddff700 1 --2- 172.21.15.71:0/3748669188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c68155eb0 0x7f2c6806e240 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800aa90 tx=0x7f2c5800a330 comp rx=0 tx=0).stop 2023-10-09T06:57:28.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.027+0000 7f2c6ddff700 1 -- 172.21.15.71:0/3748669188 shutdown_connections 2023-10-09T06:57:28.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.027+0000 7f2c6ddff700 1 --2- 172.21.15.71:0/3748669188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c68069e80 0x7f2c680ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:28.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.027+0000 7f2c6ddff700 1 --2- 172.21.15.71:0/3748669188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c68155eb0 0x7f2c6806e240 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:28.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.027+0000 7f2c6ddff700 1 -- 172.21.15.71:0/3748669188 >> 172.21.15.71:0/3748669188 conn(0x7f2c68068e10 msgr2=0x7f2c680cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:28.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.027+0000 7f2c6ddff700 1 -- 172.21.15.71:0/3748669188 shutdown_connections 2023-10-09T06:57:28.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.027+0000 7f2c6ddff700 1 -- 172.21.15.71:0/3748669188 wait complete. 2023-10-09T06:57:28.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.029+0000 7f2c6ddff700 1 Processor -- start 2023-10-09T06:57:28.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.029+0000 7f2c6ddff700 1 -- start start 2023-10-09T06:57:28.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.030+0000 7f2c6ddff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c68069e80 0x7f2c680aa410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:28.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.030+0000 7f2c6ddff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c680c70b0 0x7f2c68154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:28.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.030+0000 7f2c6ddff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c68155eb0 0x7f2c680a7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:28.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.030+0000 7f2c6ddff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c68167ad0 con 0x7f2c68155eb0 2023-10-09T06:57:28.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.030+0000 7f2c6ddff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c680c3a00 con 0x7f2c68069e80 2023-10-09T06:57:28.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.030+0000 7f2c6ddff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c680aac70 con 0x7f2c680c70b0 2023-10-09T06:57:28.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.030+0000 7f2c67fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c68155eb0 0x7f2c680a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:28.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.030+0000 7f2c67fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c68155eb0 0x7f2c680a7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34014/0 (socket says 172.21.15.71:34014) 2023-10-09T06:57:28.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.030+0000 7f2c67fff700 1 -- 172.21.15.71:0/2196573142 learned_addr learned my addr 172.21.15.71:0/2196573142 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:28.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.030+0000 7f2c677fe700 1 --2- 172.21.15.71:0/2196573142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c68069e80 0x7f2c680aa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.030+0000 7f2c66ffd700 1 --2- 172.21.15.71:0/2196573142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c680c70b0 0x7f2c68154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.030+0000 7f2c67fff700 1 -- 172.21.15.71:0/2196573142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c680c70b0 msgr2=0x7f2c68154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.030+0000 7f2c67fff700 1 --2- 172.21.15.71:0/2196573142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c680c70b0 0x7f2c68154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.030+0000 7f2c67fff700 1 -- 172.21.15.71:0/2196573142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c68069e80 msgr2=0x7f2c680aa410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.030+0000 7f2c67fff700 1 --2- 172.21.15.71:0/2196573142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c68069e80 0x7f2c680aa410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.030+0000 7f2c67fff700 1 -- 172.21.15.71:0/2196573142 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5800a5d0 con 0x7f2c68155eb0 2023-10-09T06:57:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.031+0000 7f2c67fff700 1 --2- 172.21.15.71:0/2196573142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c68155eb0 0x7f2c680a7760 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f2c60007f60 tx=0x7f2c600098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:28.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.031+0000 7f2c4f7fe700 1 -- 172.21.15.71:0/2196573142 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6000eb90 con 0x7f2c68155eb0 2023-10-09T06:57:28.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.031+0000 7f2c4f7fe700 1 -- 172.21.15.71:0/2196573142 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6000ecf0 con 0x7f2c68155eb0 2023-10-09T06:57:28.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.031+0000 7f2c4f7fe700 1 -- 172.21.15.71:0/2196573142 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c60014670 con 0x7f2c68155eb0 2023-10-09T06:57:28.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.031+0000 7f2c6ddff700 1 -- 172.21.15.71:0/2196573142 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c680aaf50 con 0x7f2c68155eb0 2023-10-09T06:57:28.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.031+0000 7f2c6ddff700 1 -- 172.21.15.71:0/2196573142 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c680c3690 con 0x7f2c68155eb0 2023-10-09T06:57:28.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.032+0000 7f2c6ddff700 1 -- 172.21.15.71:0/2196573142 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c680c3b90 con 0x7f2c68155eb0 2023-10-09T06:57:28.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.033+0000 7f2c4f7fe700 1 -- 172.21.15.71:0/2196573142 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c60014a20 con 0x7f2c68155eb0 2023-10-09T06:57:28.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.034+0000 7f2c4f7fe700 1 --2- 172.21.15.71:0/2196573142 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2c54066f30 0x7f2c540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:28.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.034+0000 7f2c4f7fe700 1 -- 172.21.15.71:0/2196573142 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f2c60085740 con 0x7f2c68155eb0 2023-10-09T06:57:28.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.035+0000 7f2c677fe700 1 --2- 172.21.15.71:0/2196573142 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2c54066f30 0x7f2c540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:28.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.035+0000 7f2c677fe700 1 --2- 172.21.15.71:0/2196573142 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2c54066f30 0x7f2c540693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800a5a0 tx=0x7f2c5801a000 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:28.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.038+0000 7f2c4f7fe700 1 -- 172.21.15.71:0/2196573142 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c60052870 con 0x7f2c68155eb0 2023-10-09T06:57:28.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.271+0000 7f2c6ddff700 1 -- 172.21.15.71:0/2196573142 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2c6804c3c0 con 0x7f2c68155eb0 2023-10-09T06:57:28.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.808+0000 7f2c4f7fe700 1 -- 172.21.15.71:0/2196573142 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v29) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2c60055e90 con 0x7f2c68155eb0 2023-10-09T06:57:28.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.813+0000 7f2c6ddff700 1 -- 172.21.15.71:0/2196573142 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2c54066f30 msgr2=0x7f2c540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:28.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.813+0000 7f2c6ddff700 1 --2- 172.21.15.71:0/2196573142 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2c54066f30 0x7f2c540693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800a5a0 tx=0x7f2c5801a000 comp rx=0 tx=0).stop 2023-10-09T06:57:28.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.813+0000 7f2c6ddff700 1 -- 172.21.15.71:0/2196573142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c68155eb0 msgr2=0x7f2c680a7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:28.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.813+0000 7f2c6ddff700 1 --2- 172.21.15.71:0/2196573142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c68155eb0 0x7f2c680a7760 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f2c60007f60 tx=0x7f2c600098e0 comp rx=0 tx=0).stop 2023-10-09T06:57:28.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.814+0000 7f2c6ddff700 1 -- 172.21.15.71:0/2196573142 shutdown_connections 2023-10-09T06:57:28.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.814+0000 7f2c6ddff700 1 --2- 172.21.15.71:0/2196573142 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2c54066f30 0x7f2c540693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:28.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.814+0000 7f2c6ddff700 1 --2- 172.21.15.71:0/2196573142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c68155eb0 0x7f2c680a7760 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:28.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.814+0000 7f2c6ddff700 1 --2- 172.21.15.71:0/2196573142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c68069e80 0x7f2c680aa410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:28.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.814+0000 7f2c6ddff700 1 --2- 172.21.15.71:0/2196573142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c680c70b0 0x7f2c68154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:28.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.814+0000 7f2c6ddff700 1 -- 172.21.15.71:0/2196573142 >> 172.21.15.71:0/2196573142 conn(0x7f2c68068e10 msgr2=0x7f2c680b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:28.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.814+0000 7f2c6ddff700 1 -- 172.21.15.71:0/2196573142 shutdown_connections 2023-10-09T06:57:28.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:28.815+0000 7f2c6ddff700 1 -- 172.21.15.71:0/2196573142 wait complete. 2023-10-09T06:57:28.819 INFO:teuthology.orchestra.run.smithi071.stderr:new fs with metadata pool 8 and data pool 9 2023-10-09T06:57:28.839 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:57:29.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.020+0000 7f153759d700 1 Processor -- start 2023-10-09T06:57:29.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.021+0000 7f153759d700 1 -- start start 2023-10-09T06:57:29.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.022+0000 7f153759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15301566e0 0x7f15300ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:29.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.022+0000 7f153759d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f15300cb900 0x7f15300ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:29.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.022+0000 7f153759d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15300ca860 con 0x7f1530156310 2023-10-09T06:57:29.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.022+0000 7f153759d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15300cab40 con 0x7f15300cb900 2023-10-09T06:57:29.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.022+0000 7f153759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15300cae20 con 0x7f15301566e0 2023-10-09T06:57:29.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.022+0000 7f153659b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f1530156310 0x7f15300c9dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60284/0 (socket says 172.21.15.71:60284) 2023-10-09T06:57:29.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.022+0000 7f153659b700 1 -- 172.21.15.71:0/2249827323 learned_addr learned my addr 172.21.15.71:0/2249827323 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:29.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.022+0000 7f1536d9c700 1 --2- 172.21.15.71:0/2249827323 >> v2:172.21.15.179:3300/0 conn(0x7f15300cb900 0x7f15300ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:29.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.022+0000 7f1535d9a700 1 --2- 172.21.15.71:0/2249827323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15301566e0 0x7f15300ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:29.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.023+0000 7f1535599700 1 -- 172.21.15.71:0/2249827323 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 685657163 0 0) 0x7f15300ca860 con 0x7f1530156310 2023-10-09T06:57:29.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.023+0000 7f1535599700 1 -- 172.21.15.71:0/2249827323 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f151c003570 con 0x7f1530156310 2023-10-09T06:57:29.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.023+0000 7f1535599700 1 -- 172.21.15.71:0/2249827323 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2899910998 0 0) 0x7f151c003570 con 0x7f1530156310 2023-10-09T06:57:29.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.023+0000 7f1535599700 1 -- 172.21.15.71:0/2249827323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15301566e0 msgr2=0x7f15300ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:29.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.023+0000 7f1535599700 1 --2- 172.21.15.71:0/2249827323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15301566e0 0x7f15300ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:29.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.023+0000 7f1535599700 1 -- 172.21.15.71:0/2249827323 >> v2:172.21.15.179:3300/0 conn(0x7f15300cb900 msgr2=0x7f15300ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:29.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.023+0000 7f1535599700 1 --2- 172.21.15.71:0/2249827323 >> v2:172.21.15.179:3300/0 conn(0x7f15300cb900 0x7f15300ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:29.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.023+0000 7f1535599700 1 -- 172.21.15.71:0/2249827323 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15300cb100 con 0x7f1530156310 2023-10-09T06:57:29.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.023+0000 7f1535599700 1 -- 172.21.15.71:0/2249827323 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f152c001470 con 0x7f1530156310 2023-10-09T06:57:29.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.023+0000 7f1536d9c700 1 --2- 172.21.15.71:0/2249827323 >> v2:172.21.15.179:3300/0 conn(0x7f15300cb900 0x7f15300ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:57:29.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.023+0000 7f1535599700 1 -- 172.21.15.71:0/2249827323 >> v1:172.21.15.71:6789/0 conn(0x7f1530156310 legacy=0x7f15300c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:29.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.023+0000 7f1535599700 1 --2- 172.21.15.71:0/2249827323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15301566e0 0x7f151c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:29.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.023+0000 7f1535599700 1 --2- 172.21.15.71:0/2249827323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f151c003fe0 0x7f151c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:29.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.023+0000 7f1535599700 1 --2- 172.21.15.71:0/2249827323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f151c004d50 0x7f151c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:29.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.023+0000 7f1535599700 1 -- 172.21.15.71:0/2249827323 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15300cab40 con 0x7f151c004d50 2023-10-09T06:57:29.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.023+0000 7f1535599700 1 -- 172.21.15.71:0/2249827323 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15300cae20 con 0x7f151c003fe0 2023-10-09T06:57:29.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.023+0000 7f1535599700 1 -- 172.21.15.71:0/2249827323 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151c00dca0 con 0x7f15301566e0 2023-10-09T06:57:29.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.023+0000 7f153659b700 1 --2- 172.21.15.71:0/2249827323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15301566e0 0x7f151c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:29.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.023+0000 7f1536d9c700 1 --2- 172.21.15.71:0/2249827323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f151c004d50 0x7f151c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:29.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.023+0000 7f1535d9a700 1 --2- 172.21.15.71:0/2249827323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f151c003fe0 0x7f151c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:29.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.024+0000 7f153659b700 1 -- 172.21.15.71:0/2249827323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f151c003fe0 msgr2=0x7f151c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:29.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.024+0000 7f153659b700 1 --2- 172.21.15.71:0/2249827323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f151c003fe0 0x7f151c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:29.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.024+0000 7f153659b700 1 -- 172.21.15.71:0/2249827323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f151c004d50 msgr2=0x7f151c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:29.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.024+0000 7f153659b700 1 --2- 172.21.15.71:0/2249827323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f151c004d50 0x7f151c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:29.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.024+0000 7f153659b700 1 -- 172.21.15.71:0/2249827323 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151c003570 con 0x7f15301566e0 2023-10-09T06:57:29.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.024+0000 7f1536d9c700 1 --2- 172.21.15.71:0/2249827323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f151c004d50 0x7f151c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:57:29.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.024+0000 7f153659b700 1 --2- 172.21.15.71:0/2249827323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15301566e0 0x7f151c003a60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f152c00c3c0 tx=0x7f152c001e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65f48f199def27f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:29.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.024+0000 7f1535599700 1 -- 172.21.15.71:0/2249827323 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c00cc30 con 0x7f15301566e0 2023-10-09T06:57:29.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.024+0000 7f1535599700 1 -- 172.21.15.71:0/2249827323 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152c00cdd0 con 0x7f15301566e0 2023-10-09T06:57:29.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.024+0000 7f1535599700 1 -- 172.21.15.71:0/2249827323 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c005b70 con 0x7f15301566e0 2023-10-09T06:57:29.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.025+0000 7f153759d700 1 -- 172.21.15.71:0/2249827323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15301566e0 msgr2=0x7f151c003a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:29.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.025+0000 7f153759d700 1 --2- 172.21.15.71:0/2249827323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15301566e0 0x7f151c003a60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f152c00c3c0 tx=0x7f152c001e90 comp rx=0 tx=0).stop 2023-10-09T06:57:29.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.025+0000 7f1536d9c700 1 -- 172.21.15.71:0/2249827323 reap_dead start 2023-10-09T06:57:29.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.025+0000 7f153759d700 1 -- 172.21.15.71:0/2249827323 shutdown_connections 2023-10-09T06:57:29.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.025+0000 7f153759d700 1 -- 172.21.15.71:0/2249827323 >> 172.21.15.71:0/2249827323 conn(0x7f15300cc1f0 msgr2=0x7f15300cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:29.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.025+0000 7f153759d700 1 -- 172.21.15.71:0/2249827323 shutdown_connections 2023-10-09T06:57:29.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.025+0000 7f153759d700 1 -- 172.21.15.71:0/2249827323 wait complete. 2023-10-09T06:57:29.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.026+0000 7f153759d700 1 Processor -- start 2023-10-09T06:57:29.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.027+0000 7f153759d700 1 -- start start 2023-10-09T06:57:29.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.027+0000 7f153759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15301566e0 0x7f1530141810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:29.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.027+0000 7f153759d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1530168b70 0x7f1530168fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:29.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.027+0000 7f153759d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1530143a50 0x7f1530143ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:29.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.027+0000 7f153759d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15301451a0 con 0x7f1530143a50 2023-10-09T06:57:29.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.027+0000 7f153759d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1530169520 con 0x7f1530168b70 2023-10-09T06:57:29.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.027+0000 7f153759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15301458e0 con 0x7f15301566e0 2023-10-09T06:57:29.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.028+0000 7f1536d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1530143a50 0x7f1530143ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:29.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.028+0000 7f1536d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1530143a50 0x7f1530143ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34034/0 (socket says 172.21.15.71:34034) 2023-10-09T06:57:29.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.028+0000 7f1536d9c700 1 -- 172.21.15.71:0/3699149835 learned_addr learned my addr 172.21.15.71:0/3699149835 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:29.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.028+0000 7f153659b700 1 --2- 172.21.15.71:0/3699149835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15301566e0 0x7f1530141810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:29.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.028+0000 7f1535d9a700 1 --2- 172.21.15.71:0/3699149835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1530168b70 0x7f1530168fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:29.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.028+0000 7f1536d9c700 1 -- 172.21.15.71:0/3699149835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15301566e0 msgr2=0x7f1530141810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:29.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.028+0000 7f1536d9c700 1 --2- 172.21.15.71:0/3699149835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15301566e0 0x7f1530141810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:29.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.028+0000 7f1536d9c700 1 -- 172.21.15.71:0/3699149835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1530168b70 msgr2=0x7f1530168fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:29.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.028+0000 7f1536d9c700 1 --2- 172.21.15.71:0/3699149835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1530168b70 0x7f1530168fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:29.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.028+0000 7f1536d9c700 1 -- 172.21.15.71:0/3699149835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1530144900 con 0x7f1530143a50 2023-10-09T06:57:29.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.028+0000 7f1536d9c700 1 --2- 172.21.15.71:0/3699149835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1530143a50 0x7f1530143ef0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f153006f970 tx=0x7f1528012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:29.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.028+0000 7f15267fc700 1 -- 172.21.15.71:0/3699149835 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152801b690 con 0x7f1530143a50 2023-10-09T06:57:29.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.029+0000 7f15267fc700 1 -- 172.21.15.71:0/3699149835 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1528016040 con 0x7f1530143a50 2023-10-09T06:57:29.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.029+0000 7f153759d700 1 -- 172.21.15.71:0/3699149835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1530144be0 con 0x7f1530143a50 2023-10-09T06:57:29.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.029+0000 7f15267fc700 1 -- 172.21.15.71:0/3699149835 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152801ba60 con 0x7f1530143a50 2023-10-09T06:57:29.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.029+0000 7f153759d700 1 -- 172.21.15.71:0/3699149835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1530141d50 con 0x7f1530143a50 2023-10-09T06:57:29.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.030+0000 7f153759d700 1 -- 172.21.15.71:0/3699149835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15301456b0 con 0x7f1530143a50 2023-10-09T06:57:29.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.031+0000 7f15267fc700 1 -- 172.21.15.71:0/3699149835 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f152801a3e0 con 0x7f1530143a50 2023-10-09T06:57:29.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.031+0000 7f15267fc700 1 --2- 172.21.15.71:0/3699149835 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1514066f30 0x7f15140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:29.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.032+0000 7f15267fc700 1 -- 172.21.15.71:0/3699149835 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f1528089580 con 0x7f1530143a50 2023-10-09T06:57:29.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.032+0000 7f153659b700 1 --2- 172.21.15.71:0/3699149835 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1514066f30 0x7f15140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:29.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.033+0000 7f153659b700 1 --2- 172.21.15.71:0/3699149835 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1514066f30 0x7f15140693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f152c00c3c0 tx=0x7f152c015000 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:29.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.036+0000 7f15267fc700 1 -- 172.21.15.71:0/3699149835 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f15301456b0 con 0x7f1530143a50 2023-10-09T06:57:29.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.227+0000 7f153759d700 1 -- 172.21.15.71:0/3699149835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15301456b0 con 0x7f1530143a50 2023-10-09T06:57:29.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.228+0000 7f15267fc700 1 -- 172.21.15.71:0/3699149835 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+15957 (secure 0 0 0) 0x7f15301456b0 con 0x7f1530143a50 2023-10-09T06:57:29.229 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:29.229 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":78,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:57:28.272666+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:57:25.936431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T06:57:27.258713+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:57:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.230+0000 7f153759d700 1 -- 172.21.15.71:0/3699149835 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1514066f30 msgr2=0x7f15140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.230+0000 7f153759d700 1 --2- 172.21.15.71:0/3699149835 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1514066f30 0x7f15140693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f152c00c3c0 tx=0x7f152c015000 comp rx=0 tx=0).stop 2023-10-09T06:57:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.230+0000 7f153759d700 1 -- 172.21.15.71:0/3699149835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1530143a50 msgr2=0x7f1530143ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.230+0000 7f153759d700 1 --2- 172.21.15.71:0/3699149835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1530143a50 0x7f1530143ef0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f153006f970 tx=0x7f1528012040 comp rx=0 tx=0).stop 2023-10-09T06:57:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.231+0000 7f153759d700 1 -- 172.21.15.71:0/3699149835 shutdown_connections 2023-10-09T06:57:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.231+0000 7f153759d700 1 --2- 172.21.15.71:0/3699149835 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1514066f30 0x7f15140693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.231+0000 7f153759d700 1 --2- 172.21.15.71:0/3699149835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1530143a50 0x7f1530143ef0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.231+0000 7f153759d700 1 --2- 172.21.15.71:0/3699149835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15301566e0 0x7f1530141810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.231+0000 7f153759d700 1 --2- 172.21.15.71:0/3699149835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1530168b70 0x7f1530168fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.231+0000 7f153759d700 1 -- 172.21.15.71:0/3699149835 >> 172.21.15.71:0/3699149835 conn(0x7f15300cc1f0 msgr2=0x7f15300af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:29.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.231+0000 7f153759d700 1 -- 172.21.15.71:0/3699149835 shutdown_connections 2023-10-09T06:57:29.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.231+0000 7f153759d700 1 -- 172.21.15.71:0/3699149835 wait complete. 2023-10-09T06:57:29.249 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:57:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.428+0000 7f81577ff700 1 Processor -- start 2023-10-09T06:57:29.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.428+0000 7f81577ff700 1 -- start start 2023-10-09T06:57:29.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.429+0000 7f81577ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81500b1420 0x7f81500ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:29.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.429+0000 7f81577ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f81500ccf90 0x7f81500c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:29.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.429+0000 7f81577ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81500cc300 con 0x7f81500cbf30 2023-10-09T06:57:29.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.429+0000 7f81577ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8150156bf0 con 0x7f81500ccf90 2023-10-09T06:57:29.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.429+0000 7f81577ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81500ae950 con 0x7f81500b1420 2023-10-09T06:57:29.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.430+0000 7f815559b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f81500cbf30 0x7f81500b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60298/0 (socket says 172.21.15.71:60298) 2023-10-09T06:57:29.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.430+0000 7f815559b700 1 -- 172.21.15.71:0/4231922816 learned_addr learned my addr 172.21.15.71:0/4231922816 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:29.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.430+0000 7f8147fff700 1 -- 172.21.15.71:0/4231922816 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223975198 0 0) 0x7f81500cc300 con 0x7f81500cbf30 2023-10-09T06:57:29.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.430+0000 7f8154d9a700 1 --2- 172.21.15.71:0/4231922816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81500b1420 0x7f81500ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:29.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.430+0000 7f8147fff700 1 -- 172.21.15.71:0/4231922816 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f813c003570 con 0x7f81500cbf30 2023-10-09T06:57:29.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.430+0000 7f8155d9c700 1 --2- 172.21.15.71:0/4231922816 >> v2:172.21.15.179:3300/0 conn(0x7f81500ccf90 0x7f81500c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:29.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.430+0000 7f8147fff700 1 -- 172.21.15.71:0/4231922816 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1251652329 0 0) 0x7f813c003570 con 0x7f81500cbf30 2023-10-09T06:57:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.430+0000 7f8147fff700 1 -- 172.21.15.71:0/4231922816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81500b1420 msgr2=0x7f81500ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.430+0000 7f8147fff700 1 --2- 172.21.15.71:0/4231922816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81500b1420 0x7f81500ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.430+0000 7f8147fff700 1 -- 172.21.15.71:0/4231922816 >> v2:172.21.15.179:3300/0 conn(0x7f81500ccf90 msgr2=0x7f81500c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.430+0000 7f8147fff700 1 --2- 172.21.15.71:0/4231922816 >> v2:172.21.15.179:3300/0 conn(0x7f81500ccf90 0x7f81500c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.430+0000 7f8147fff700 1 -- 172.21.15.71:0/4231922816 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81500ad370 con 0x7f81500cbf30 2023-10-09T06:57:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.430+0000 7f8147fff700 1 -- 172.21.15.71:0/4231922816 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f814c001470 con 0x7f81500cbf30 2023-10-09T06:57:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.430+0000 7f8147fff700 1 -- 172.21.15.71:0/4231922816 >> v1:172.21.15.71:6789/0 conn(0x7f81500cbf30 legacy=0x7f81500b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.431+0000 7f8147fff700 1 --2- 172.21.15.71:0/4231922816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f813c003a90 0x7f813c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.431+0000 7f8147fff700 1 --2- 172.21.15.71:0/4231922816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81500b1420 0x7f813c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.431+0000 7f8147fff700 1 --2- 172.21.15.71:0/4231922816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f813c004d50 0x7f813c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.431+0000 7f8147fff700 1 -- 172.21.15.71:0/4231922816 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8150156bf0 con 0x7f813c004d50 2023-10-09T06:57:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.431+0000 7f8147fff700 1 -- 172.21.15.71:0/4231922816 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81500ae950 con 0x7f813c003a90 2023-10-09T06:57:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.431+0000 7f8147fff700 1 -- 172.21.15.71:0/4231922816 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813c00dc70 con 0x7f81500b1420 2023-10-09T06:57:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.431+0000 7f8155d9c700 1 --2- 172.21.15.71:0/4231922816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f813c004d50 0x7f813c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.431+0000 7f815559b700 1 --2- 172.21.15.71:0/4231922816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f813c003a90 0x7f813c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.431+0000 7f8154d9a700 1 --2- 172.21.15.71:0/4231922816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81500b1420 0x7f813c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.431+0000 7f8155d9c700 1 -- 172.21.15.71:0/4231922816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81500b1420 msgr2=0x7f813c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.431+0000 7f8155d9c700 1 --2- 172.21.15.71:0/4231922816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81500b1420 0x7f813c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.431+0000 7f8155d9c700 1 -- 172.21.15.71:0/4231922816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f813c003a90 msgr2=0x7f813c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.431+0000 7f8155d9c700 1 --2- 172.21.15.71:0/4231922816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f813c003a90 0x7f813c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.431+0000 7f8155d9c700 1 -- 172.21.15.71:0/4231922816 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c003570 con 0x7f813c004d50 2023-10-09T06:57:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.431+0000 7f8155d9c700 1 --2- 172.21.15.71:0/4231922816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f813c004d50 0x7f813c0051c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f814800e210 tx=0x7f814800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bbb859cf994547b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.432+0000 7f8147fff700 1 -- 172.21.15.71:0/4231922816 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814800ea60 con 0x7f813c004d50 2023-10-09T06:57:29.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.432+0000 7f8147fff700 1 -- 172.21.15.71:0/4231922816 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814800f040 con 0x7f813c004d50 2023-10-09T06:57:29.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.432+0000 7f8147fff700 1 -- 172.21.15.71:0/4231922816 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814800ee10 con 0x7f813c004d50 2023-10-09T06:57:29.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.432+0000 7f81577ff700 1 -- 172.21.15.71:0/4231922816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f813c004d50 msgr2=0x7f813c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:29.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.432+0000 7f81577ff700 1 --2- 172.21.15.71:0/4231922816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f813c004d50 0x7f813c0051c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f814800e210 tx=0x7f814800b040 comp rx=0 tx=0).stop 2023-10-09T06:57:29.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.432+0000 7f8155d9c700 1 -- 172.21.15.71:0/4231922816 reap_dead start 2023-10-09T06:57:29.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.432+0000 7f81577ff700 1 -- 172.21.15.71:0/4231922816 shutdown_connections 2023-10-09T06:57:29.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.432+0000 7f81577ff700 1 -- 172.21.15.71:0/4231922816 >> 172.21.15.71:0/4231922816 conn(0x7f815006a320 msgr2=0x7f81500cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:29.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.432+0000 7f81577ff700 1 -- 172.21.15.71:0/4231922816 shutdown_connections 2023-10-09T06:57:29.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.432+0000 7f81577ff700 1 -- 172.21.15.71:0/4231922816 wait complete. 2023-10-09T06:57:29.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.434+0000 7f81577ff700 1 Processor -- start 2023-10-09T06:57:29.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.434+0000 7f81577ff700 1 -- start start 2023-10-09T06:57:29.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.435+0000 7f81577ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f813c004d50 0x7f8150156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:29.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.435+0000 7f81577ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81500c7830 0x7f81500c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:29.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.435+0000 7f81577ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81500ab390 0x7f81500ab800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:29.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.435+0000 7f81577ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81500c81e0 con 0x7f81500ab390 2023-10-09T06:57:29.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.435+0000 7f81577ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81500a5af0 con 0x7f813c004d50 2023-10-09T06:57:29.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.435+0000 7f81577ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81501566d0 con 0x7f81500c7830 2023-10-09T06:57:29.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.435+0000 7f8155d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81500ab390 0x7f81500ab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:29.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.435+0000 7f8155d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81500ab390 0x7f81500ab800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34048/0 (socket says 172.21.15.71:34048) 2023-10-09T06:57:29.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.435+0000 7f8155d9c700 1 -- 172.21.15.71:0/452166878 learned_addr learned my addr 172.21.15.71:0/452166878 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:29.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.435+0000 7f8154d9a700 1 --2- 172.21.15.71:0/452166878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81500c7830 0x7f81500c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:29.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.435+0000 7f815559b700 1 --2- 172.21.15.71:0/452166878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f813c004d50 0x7f8150156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:29.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.436+0000 7f8155d9c700 1 -- 172.21.15.71:0/452166878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81500c7830 msgr2=0x7f81500c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:29.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.436+0000 7f8155d9c700 1 --2- 172.21.15.71:0/452166878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81500c7830 0x7f81500c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:29.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.436+0000 7f8155d9c700 1 -- 172.21.15.71:0/452166878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f813c004d50 msgr2=0x7f8150156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:29.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.436+0000 7f8155d9c700 1 --2- 172.21.15.71:0/452166878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f813c004d50 0x7f8150156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:29.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.436+0000 7f8155d9c700 1 -- 172.21.15.71:0/452166878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81500a54c0 con 0x7f81500ab390 2023-10-09T06:57:29.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.436+0000 7f8154d9a700 1 --2- 172.21.15.71:0/452166878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81500c7830 0x7f81500c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:29.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.436+0000 7f815559b700 1 --2- 172.21.15.71:0/452166878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f813c004d50 0x7f8150156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:29.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.436+0000 7f8155d9c700 1 --2- 172.21.15.71:0/452166878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81500ab390 0x7f81500ab800 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f8148016000 tx=0x7f814801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:29.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.436+0000 7f81457fa700 1 -- 172.21.15.71:0/452166878 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814801d630 con 0x7f81500ab390 2023-10-09T06:57:29.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.436+0000 7f81457fa700 1 -- 172.21.15.71:0/452166878 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814801d790 con 0x7f81500ab390 2023-10-09T06:57:29.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.436+0000 7f81577ff700 1 -- 172.21.15.71:0/452166878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81500ac100 con 0x7f81500ab390 2023-10-09T06:57:29.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.436+0000 7f81457fa700 1 -- 172.21.15.71:0/452166878 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814801db30 con 0x7f81500ab390 2023-10-09T06:57:29.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.436+0000 7f81577ff700 1 -- 172.21.15.71:0/452166878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81500a5780 con 0x7f81500ab390 2023-10-09T06:57:29.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.437+0000 7f81577ff700 1 -- 172.21.15.71:0/452166878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f815004c3c0 con 0x7f81500ab390 2023-10-09T06:57:29.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.438+0000 7f81457fa700 1 -- 172.21.15.71:0/452166878 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8148003040 con 0x7f81500ab390 2023-10-09T06:57:29.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.439+0000 7f81457fa700 1 --2- 172.21.15.71:0/452166878 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8134066f60 0x7f8134069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:29.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.439+0000 7f81457fa700 1 -- 172.21.15.71:0/452166878 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f8148085ce0 con 0x7f81500ab390 2023-10-09T06:57:29.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.439+0000 7f815559b700 1 --2- 172.21.15.71:0/452166878 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8134066f60 0x7f8134069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:29.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.440+0000 7f815559b700 1 --2- 172.21.15.71:0/452166878 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8134066f60 0x7f8134069410 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f814c001050 tx=0x7f814c009040 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:29.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.443+0000 7f81457fa700 1 -- 172.21.15.71:0/452166878 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8148052d20 con 0x7f81500ab390 2023-10-09T06:57:29.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.633+0000 7f81577ff700 1 -- 172.21.15.71:0/452166878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81500a5c30 con 0x7f81500ab390 2023-10-09T06:57:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.634+0000 7f81457fa700 1 -- 172.21.15.71:0/452166878 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+15957 (secure 0 0 0) 0x7f8148018090 con 0x7f81500ab390 2023-10-09T06:57:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:29.635 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":78,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:57:28.272666+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:57:25.936431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T06:57:27.258713+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:57:29.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.636+0000 7f81577ff700 1 -- 172.21.15.71:0/452166878 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8134066f60 msgr2=0x7f8134069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:29.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.636+0000 7f81577ff700 1 --2- 172.21.15.71:0/452166878 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8134066f60 0x7f8134069410 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f814c001050 tx=0x7f814c009040 comp rx=0 tx=0).stop 2023-10-09T06:57:29.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.636+0000 7f81577ff700 1 -- 172.21.15.71:0/452166878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81500ab390 msgr2=0x7f81500ab800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:29.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.636+0000 7f81577ff700 1 --2- 172.21.15.71:0/452166878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81500ab390 0x7f81500ab800 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f8148016000 tx=0x7f814801a000 comp rx=0 tx=0).stop 2023-10-09T06:57:29.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.636+0000 7f81577ff700 1 -- 172.21.15.71:0/452166878 shutdown_connections 2023-10-09T06:57:29.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.636+0000 7f81577ff700 1 --2- 172.21.15.71:0/452166878 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8134066f60 0x7f8134069410 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:29.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.636+0000 7f81577ff700 1 --2- 172.21.15.71:0/452166878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81500ab390 0x7f81500ab800 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:29.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.636+0000 7f81577ff700 1 --2- 172.21.15.71:0/452166878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f813c004d50 0x7f8150156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:29.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.636+0000 7f81577ff700 1 --2- 172.21.15.71:0/452166878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81500c7830 0x7f81500c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:29.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.636+0000 7f81577ff700 1 -- 172.21.15.71:0/452166878 >> 172.21.15.71:0/452166878 conn(0x7f815006a320 msgr2=0x7f8150159320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:29.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.636+0000 7f81577ff700 1 -- 172.21.15.71:0/452166878 shutdown_connections 2023-10-09T06:57:29.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.636+0000 7f81577ff700 1 -- 172.21.15.71:0/452166878 wait complete. 2023-10-09T06:57:29.655 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T06:57:29.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.842+0000 7fc1463ff700 1 Processor -- start 2023-10-09T06:57:29.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.842+0000 7fc1463ff700 1 -- start start 2023-10-09T06:57:29.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.842+0000 7fc1463ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc1400c83f0 0x7fc1400c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:29.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.842+0000 7fc1463ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc14015b0d0 con 0x7fc1401568e0 2023-10-09T06:57:29.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.842+0000 7fc1463ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1400c7a60 con 0x7fc1400ccee0 2023-10-09T06:57:29.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.842+0000 7fc1463ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc14015a4c0 con 0x7fc1400c83f0 2023-10-09T06:57:29.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.843+0000 7fc13ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc1400c83f0 0x7fc1400c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:29.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.843+0000 7fc13ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc1400c83f0 0x7fc1400c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34050/0 (socket says 172.21.15.71:34050) 2023-10-09T06:57:29.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.843+0000 7fc13ffff700 1 -- 172.21.15.71:0/2588307354 learned_addr learned my addr 172.21.15.71:0/2588307354 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:29.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.843+0000 7fc14499c700 1 --1- 172.21.15.71:0/2588307354 >> v1:172.21.15.71:6789/0 conn(0x7fc1401568e0 0x7fc1400ca1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60300/0 (socket says 172.21.15.71:60300) 2023-10-09T06:57:29.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.843+0000 7fc13ffff700 1 -- 172.21.15.71:0/2588307354 >> v1:172.21.15.179:6789/0 conn(0x7fc1400ccee0 legacy=0x7fc1401561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:29.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.843+0000 7fc13effd700 1 -- 172.21.15.71:0/2588307354 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959029836 0 0) 0x7fc14015b0d0 con 0x7fc1401568e0 2023-10-09T06:57:29.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.843+0000 7fc13ffff700 1 -- 172.21.15.71:0/2588307354 >> v1:172.21.15.71:6789/0 conn(0x7fc1401568e0 legacy=0x7fc1400ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:29.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.843+0000 7fc13ffff700 1 -- 172.21.15.71:0/2588307354 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14015a7a0 con 0x7fc1400c83f0 2023-10-09T06:57:29.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.843+0000 7fc13ffff700 1 --2- 172.21.15.71:0/2588307354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1400c83f0 0x7fc1400c7520 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc1300099b0 tx=0x7fc130009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95d6cb7a3a704a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:29.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.844+0000 7fc13effd700 1 -- 172.21.15.71:0/2588307354 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13000b860 con 0x7fc1400c83f0 2023-10-09T06:57:29.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.844+0000 7fc13effd700 1 -- 172.21.15.71:0/2588307354 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13000b9c0 con 0x7fc1400c83f0 2023-10-09T06:57:29.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.844+0000 7fc13effd700 1 -- 172.21.15.71:0/2588307354 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13000bd60 con 0x7fc1400c83f0 2023-10-09T06:57:29.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.844+0000 7fc1463ff700 1 -- 172.21.15.71:0/2588307354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1400c83f0 msgr2=0x7fc1400c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:29.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.844+0000 7fc1463ff700 1 --2- 172.21.15.71:0/2588307354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1400c83f0 0x7fc1400c7520 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc1300099b0 tx=0x7fc130009250 comp rx=0 tx=0).stop 2023-10-09T06:57:29.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.844+0000 7fc1463ff700 1 -- 172.21.15.71:0/2588307354 shutdown_connections 2023-10-09T06:57:29.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.844+0000 7fc1463ff700 1 --2- 172.21.15.71:0/2588307354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1400c83f0 0x7fc1400c7520 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:29.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.844+0000 7fc1463ff700 1 -- 172.21.15.71:0/2588307354 >> 172.21.15.71:0/2588307354 conn(0x7fc140068e10 msgr2=0x7fc1400cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:29.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.844+0000 7fc1463ff700 1 -- 172.21.15.71:0/2588307354 shutdown_connections 2023-10-09T06:57:29.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.844+0000 7fc1463ff700 1 -- 172.21.15.71:0/2588307354 wait complete. 2023-10-09T06:57:29.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.846+0000 7fc1463ff700 1 Processor -- start 2023-10-09T06:57:29.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.846+0000 7fc1463ff700 1 -- start start 2023-10-09T06:57:29.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.847+0000 7fc1463ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1400c83f0 0x7fc1400c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:29.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.847+0000 7fc1463ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1400ccee0 0x7fc140165920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:29.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.847+0000 7fc1463ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1401568e0 0x7fc140165e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:29.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.847+0000 7fc1463ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1401556d0 con 0x7fc1400c83f0 2023-10-09T06:57:29.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.847+0000 7fc1463ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1400c39c0 con 0x7fc1401568e0 2023-10-09T06:57:29.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.847+0000 7fc1463ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc140154ac0 con 0x7fc1400ccee0 2023-10-09T06:57:29.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.847+0000 7fc13ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1400c83f0 0x7fc1400c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:29.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.847+0000 7fc13ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1400c83f0 0x7fc1400c6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34060/0 (socket says 172.21.15.71:34060) 2023-10-09T06:57:29.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.847+0000 7fc13ffff700 1 -- 172.21.15.71:0/2392514430 learned_addr learned my addr 172.21.15.71:0/2392514430 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:29.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.847+0000 7fc13ffff700 1 -- 172.21.15.71:0/2392514430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1400ccee0 msgr2=0x7fc140165920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:29.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.847+0000 7fc13ffff700 1 --2- 172.21.15.71:0/2392514430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1400ccee0 0x7fc140165920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:29.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.847+0000 7fc13ffff700 1 -- 172.21.15.71:0/2392514430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1401568e0 msgr2=0x7fc140165e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:29.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.847+0000 7fc13ffff700 1 --2- 172.21.15.71:0/2392514430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1401568e0 0x7fc140165e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:29.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.847+0000 7fc13ffff700 1 -- 172.21.15.71:0/2392514430 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1300094f0 con 0x7fc1400c83f0 2023-10-09T06:57:29.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.847+0000 7fc13ffff700 1 --2- 172.21.15.71:0/2392514430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1400c83f0 0x7fc1400c6260 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc140063d40 tx=0x7fc130017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:29.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.848+0000 7fc127fff700 1 -- 172.21.15.71:0/2392514430 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13001f070 con 0x7fc1400c83f0 2023-10-09T06:57:29.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.848+0000 7fc127fff700 1 -- 172.21.15.71:0/2392514430 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc130011d10 con 0x7fc1400c83f0 2023-10-09T06:57:29.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.848+0000 7fc1463ff700 1 -- 172.21.15.71:0/2392514430 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc140154da0 con 0x7fc1400c83f0 2023-10-09T06:57:29.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.848+0000 7fc127fff700 1 -- 172.21.15.71:0/2392514430 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc130025670 con 0x7fc1400c83f0 2023-10-09T06:57:29.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.848+0000 7fc1463ff700 1 -- 172.21.15.71:0/2392514430 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc140155360 con 0x7fc1400c83f0 2023-10-09T06:57:29.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.849+0000 7fc1463ff700 1 -- 172.21.15.71:0/2392514430 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc14004c3c0 con 0x7fc1400c83f0 2023-10-09T06:57:29.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.850+0000 7fc127fff700 1 -- 172.21.15.71:0/2392514430 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc130023070 con 0x7fc1400c83f0 2023-10-09T06:57:29.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.850+0000 7fc127fff700 1 --2- 172.21.15.71:0/2392514430 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc12c066f30 0x7fc12c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:29.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.851+0000 7fc127fff700 1 -- 172.21.15.71:0/2392514430 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fc130085c00 con 0x7fc1400c83f0 2023-10-09T06:57:29.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.851+0000 7fc13f7fe700 1 --2- 172.21.15.71:0/2392514430 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc12c066f30 0x7fc12c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:29.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.852+0000 7fc13f7fe700 1 --2- 172.21.15.71:0/2392514430 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc12c066f30 0x7fc12c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc1400caea0 tx=0x7fc134007b40 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:29.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:29.854+0000 7fc127fff700 1 -- 172.21.15.71:0/2392514430 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc13008c080 con 0x7fc1400c83f0 2023-10-09T06:57:30.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:30.087+0000 7fc1463ff700 1 -- 172.21.15.71:0/2392514430 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc14015aa80 con 0x7fc1400c83f0 2023-10-09T06:57:30.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:30.824+0000 7fc127fff700 1 -- 172.21.15.71:0/2392514430 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v32) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc1300150b0 con 0x7fc1400c83f0 2023-10-09T06:57:30.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:30.827+0000 7fc1463ff700 1 -- 172.21.15.71:0/2392514430 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc12c066f30 msgr2=0x7fc12c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:30.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:30.827+0000 7fc1463ff700 1 --2- 172.21.15.71:0/2392514430 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc12c066f30 0x7fc12c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc1400caea0 tx=0x7fc134007b40 comp rx=0 tx=0).stop 2023-10-09T06:57:30.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:30.827+0000 7fc1463ff700 1 -- 172.21.15.71:0/2392514430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1400c83f0 msgr2=0x7fc1400c6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:30.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:30.827+0000 7fc1463ff700 1 --2- 172.21.15.71:0/2392514430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1400c83f0 0x7fc1400c6260 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc140063d40 tx=0x7fc130017000 comp rx=0 tx=0).stop 2023-10-09T06:57:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:30.827+0000 7fc1463ff700 1 -- 172.21.15.71:0/2392514430 shutdown_connections 2023-10-09T06:57:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:30.827+0000 7fc1463ff700 1 --2- 172.21.15.71:0/2392514430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1401568e0 0x7fc140165e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:30.827+0000 7fc1463ff700 1 --2- 172.21.15.71:0/2392514430 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc12c066f30 0x7fc12c0693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:30.827+0000 7fc1463ff700 1 --2- 172.21.15.71:0/2392514430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1400c83f0 0x7fc1400c6260 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:30.827+0000 7fc1463ff700 1 --2- 172.21.15.71:0/2392514430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1400ccee0 0x7fc140165920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:30.827+0000 7fc1463ff700 1 -- 172.21.15.71:0/2392514430 >> 172.21.15.71:0/2392514430 conn(0x7fc140068e10 msgr2=0x7fc1400c2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:30.827+0000 7fc1463ff700 1 -- 172.21.15.71:0/2392514430 shutdown_connections 2023-10-09T06:57:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:30.827+0000 7fc1463ff700 1 -- 172.21.15.71:0/2392514430 wait complete. 2023-10-09T06:57:30.846 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T06:57:31.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.031+0000 7f20435ff700 1 Processor -- start 2023-10-09T06:57:31.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.031+0000 7f20435ff700 1 -- start start 2023-10-09T06:57:31.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.033+0000 7f20435ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f203c0ccee0 0x7f203c1561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:31.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.033+0000 7f20435ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f203c15b0d0 con 0x7f203c0c83f0 2023-10-09T06:57:31.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.033+0000 7f20435ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f203c15a4c0 con 0x7f203c0c87c0 2023-10-09T06:57:31.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.033+0000 7f20435ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f203c15a7a0 con 0x7f203c0ccee0 2023-10-09T06:57:31.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.033+0000 7f2040b9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f203c0ccee0 0x7f203c1561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:31.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.033+0000 7f204139b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f203c0c83f0 0x7f203c0c7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60316/0 (socket says 172.21.15.71:60316) 2023-10-09T06:57:31.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.033+0000 7f204139b700 1 -- 172.21.15.71:0/4105866758 learned_addr learned my addr 172.21.15.71:0/4105866758 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:31.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.033+0000 7f2040b9a700 1 -- 172.21.15.71:0/4105866758 >> v1:172.21.15.179:6789/0 conn(0x7f203c0c87c0 legacy=0x7f203c0ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:31.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.033+0000 7f2040b9a700 1 -- 172.21.15.71:0/4105866758 >> v1:172.21.15.71:6789/0 conn(0x7f203c0c83f0 legacy=0x7f203c0c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:31.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.033+0000 7f2040b9a700 1 -- 172.21.15.71:0/4105866758 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203c15aa80 con 0x7f203c0ccee0 2023-10-09T06:57:31.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.034+0000 7f2040b9a700 1 --2- 172.21.15.71:0/4105866758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c0ccee0 0x7f203c1561d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f202c0098e0 tx=0x7f202c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4042db344980418b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:31.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.034+0000 7f2033fff700 1 -- 172.21.15.71:0/4105866758 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c009e80 con 0x7f203c0ccee0 2023-10-09T06:57:31.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.034+0000 7f2033fff700 1 -- 172.21.15.71:0/4105866758 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202c00b860 con 0x7f203c0ccee0 2023-10-09T06:57:31.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.034+0000 7f2033fff700 1 -- 172.21.15.71:0/4105866758 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c00bbe0 con 0x7f203c0ccee0 2023-10-09T06:57:31.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.034+0000 7f20435ff700 1 -- 172.21.15.71:0/4105866758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c0ccee0 msgr2=0x7f203c1561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:31.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.034+0000 7f20435ff700 1 --2- 172.21.15.71:0/4105866758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c0ccee0 0x7f203c1561d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f202c0098e0 tx=0x7f202c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:31.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.034+0000 7f20435ff700 1 -- 172.21.15.71:0/4105866758 shutdown_connections 2023-10-09T06:57:31.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.034+0000 7f20435ff700 1 --2- 172.21.15.71:0/4105866758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c0ccee0 0x7f203c1561d0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:31.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.034+0000 7f20435ff700 1 -- 172.21.15.71:0/4105866758 >> 172.21.15.71:0/4105866758 conn(0x7f203c068e10 msgr2=0x7f203c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:31.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.035+0000 7f20435ff700 1 -- 172.21.15.71:0/4105866758 shutdown_connections 2023-10-09T06:57:31.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.035+0000 7f20435ff700 1 -- 172.21.15.71:0/4105866758 wait complete. 2023-10-09T06:57:31.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.036+0000 7f20435ff700 1 Processor -- start 2023-10-09T06:57:31.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.036+0000 7f20435ff700 1 -- start start 2023-10-09T06:57:31.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.037+0000 7f20435ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f203c0c83f0 0x7f203c14e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:31.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.037+0000 7f20435ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c0c87c0 0x7f203c16a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:31.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.037+0000 7f20435ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f203c0ccee0 0x7f203c1595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:31.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.037+0000 7f20435ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c157060 con 0x7f203c0c87c0 2023-10-09T06:57:31.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.037+0000 7f20435ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c156a50 con 0x7f203c0ccee0 2023-10-09T06:57:31.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.037+0000 7f20435ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203c14e870 con 0x7f203c0c83f0 2023-10-09T06:57:31.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.037+0000 7f2040b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c0c87c0 0x7f203c16a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:31.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.037+0000 7f2040b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c0c87c0 0x7f203c16a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34076/0 (socket says 172.21.15.71:34076) 2023-10-09T06:57:31.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.037+0000 7f2040b9a700 1 -- 172.21.15.71:0/2795273293 learned_addr learned my addr 172.21.15.71:0/2795273293 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:31.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.037+0000 7f204139b700 1 --2- 172.21.15.71:0/2795273293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f203c0c83f0 0x7f203c14e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:31.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.037+0000 7f2041b9c700 1 --2- 172.21.15.71:0/2795273293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f203c0ccee0 0x7f203c1595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:31.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.038+0000 7f2040b9a700 1 -- 172.21.15.71:0/2795273293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f203c0c83f0 msgr2=0x7f203c14e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:31.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.038+0000 7f2040b9a700 1 --2- 172.21.15.71:0/2795273293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f203c0c83f0 0x7f203c14e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:31.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.038+0000 7f2040b9a700 1 -- 172.21.15.71:0/2795273293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f203c0ccee0 msgr2=0x7f203c1595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:31.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.038+0000 7f2040b9a700 1 --2- 172.21.15.71:0/2795273293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f203c0ccee0 0x7f203c1595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:31.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.038+0000 7f2040b9a700 1 -- 172.21.15.71:0/2795273293 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c009420 con 0x7f203c0c87c0 2023-10-09T06:57:31.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.038+0000 7f204139b700 1 --2- 172.21.15.71:0/2795273293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f203c0c83f0 0x7f203c14e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:31.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.038+0000 7f2040b9a700 1 --2- 172.21.15.71:0/2795273293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c0c87c0 0x7f203c16a030 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f202c0030c0 tx=0x7f202c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:31.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.038+0000 7f20317fa700 1 -- 172.21.15.71:0/2795273293 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c00bb20 con 0x7f203c0c87c0 2023-10-09T06:57:31.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.038+0000 7f20317fa700 1 -- 172.21.15.71:0/2795273293 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202c020070 con 0x7f203c0c87c0 2023-10-09T06:57:31.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.038+0000 7f20317fa700 1 -- 172.21.15.71:0/2795273293 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c01b6a0 con 0x7f203c0c87c0 2023-10-09T06:57:31.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.038+0000 7f20435ff700 1 -- 172.21.15.71:0/2795273293 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203c0aeb40 con 0x7f203c0c87c0 2023-10-09T06:57:31.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.038+0000 7f20435ff700 1 -- 172.21.15.71:0/2795273293 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203c0aee20 con 0x7f203c0c87c0 2023-10-09T06:57:31.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.039+0000 7f20435ff700 1 -- 172.21.15.71:0/2795273293 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203c04c3c0 con 0x7f203c0c87c0 2023-10-09T06:57:31.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.040+0000 7f20317fa700 1 -- 172.21.15.71:0/2795273293 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f202c022030 con 0x7f203c0c87c0 2023-10-09T06:57:31.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.041+0000 7f20317fa700 1 --2- 172.21.15.71:0/2795273293 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2020066f30 0x7f20200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:31.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.041+0000 7f20317fa700 1 -- 172.21.15.71:0/2795273293 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f202c086710 con 0x7f203c0c87c0 2023-10-09T06:57:31.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.042+0000 7f204139b700 1 --2- 172.21.15.71:0/2795273293 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2020066f30 0x7f20200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:31.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.042+0000 7f204139b700 1 --2- 172.21.15.71:0/2795273293 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2020066f30 0x7f20200693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2038001820 tx=0x7f2038009040 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:31.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.045+0000 7f20317fa700 1 -- 172.21.15.71:0/2795273293 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f202c053750 con 0x7f203c0c87c0 2023-10-09T06:57:31.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.278+0000 7f20435ff700 1 -- 172.21.15.71:0/2795273293 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f203c04c3c0 con 0x7f203c0c87c0 2023-10-09T06:57:31.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.826+0000 7f20317fa700 1 -- 172.21.15.71:0/2795273293 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v33) v1 ==== 122+0+0 (secure 0 0 0) 0x7f202c056d70 con 0x7f203c0c87c0 2023-10-09T06:57:31.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.828+0000 7f20435ff700 1 -- 172.21.15.71:0/2795273293 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2020066f30 msgr2=0x7f20200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:31.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.828+0000 7f20435ff700 1 --2- 172.21.15.71:0/2795273293 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2020066f30 0x7f20200693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2038001820 tx=0x7f2038009040 comp rx=0 tx=0).stop 2023-10-09T06:57:31.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.828+0000 7f20435ff700 1 -- 172.21.15.71:0/2795273293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c0c87c0 msgr2=0x7f203c16a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:31.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.828+0000 7f20435ff700 1 --2- 172.21.15.71:0/2795273293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c0c87c0 0x7f203c16a030 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f202c0030c0 tx=0x7f202c016000 comp rx=0 tx=0).stop 2023-10-09T06:57:31.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.828+0000 7f20435ff700 1 -- 172.21.15.71:0/2795273293 shutdown_connections 2023-10-09T06:57:31.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.828+0000 7f20435ff700 1 --2- 172.21.15.71:0/2795273293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f203c0ccee0 0x7f203c1595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:31.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.828+0000 7f20435ff700 1 --2- 172.21.15.71:0/2795273293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f203c0c83f0 0x7f203c14e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:31.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.828+0000 7f20435ff700 1 --2- 172.21.15.71:0/2795273293 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2020066f30 0x7f20200693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:31.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.828+0000 7f20435ff700 1 --2- 172.21.15.71:0/2795273293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f203c0c87c0 0x7f203c16a030 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:31.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.828+0000 7f20435ff700 1 -- 172.21.15.71:0/2795273293 >> 172.21.15.71:0/2795273293 conn(0x7f203c068e10 msgr2=0x7f203c14ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:31.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.829+0000 7f20435ff700 1 -- 172.21.15.71:0/2795273293 shutdown_connections 2023-10-09T06:57:31.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:31.829+0000 7f20435ff700 1 -- 172.21.15.71:0/2795273293 wait complete. 2023-10-09T06:57:31.848 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:57:32.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.031+0000 7fe8d6d9d700 1 Processor -- start 2023-10-09T06:57:32.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.031+0000 7fe8d6d9d700 1 -- start start 2023-10-09T06:57:32.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.032+0000 7fe8d6d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe8d0156310 0x7fe8d00c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:32.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.033+0000 7fe8d6d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8d01566e0 0x7fe8d00ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:32.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.033+0000 7fe8d6d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d00ca860 con 0x7fe8d00ca300 2023-10-09T06:57:32.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.033+0000 7fe8d6d9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d00cab40 con 0x7fe8d0156310 2023-10-09T06:57:32.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.033+0000 7fe8d6d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00cae20 con 0x7fe8d01566e0 2023-10-09T06:57:32.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.033+0000 7fe8d5d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe8d0156310 0x7fe8d00c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:32.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.033+0000 7fe8d5d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe8d0156310 0x7fe8d00c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34082/0 (socket says 172.21.15.71:34082) 2023-10-09T06:57:32.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.033+0000 7fe8d5d9b700 1 -- 172.21.15.71:0/2559021558 learned_addr learned my addr 172.21.15.71:0/2559021558 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:32.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.033+0000 7fe8d5d9b700 1 -- 172.21.15.71:0/2559021558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8d01566e0 msgr2=0x7fe8d00ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:32.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.033+0000 7fe8d5d9b700 1 --2- 172.21.15.71:0/2559021558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8d01566e0 0x7fe8d00ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:32.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.033+0000 7fe8d5d9b700 1 -- 172.21.15.71:0/2559021558 >> v1:172.21.15.179:6789/0 conn(0x7fe8d00ca300 legacy=0x7fe8d00c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:32.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.033+0000 7fe8d5d9b700 1 -- 172.21.15.71:0/2559021558 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d00cb100 con 0x7fe8d0156310 2023-10-09T06:57:32.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.034+0000 7fe8d5d9b700 1 --2- 172.21.15.71:0/2559021558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8d0156310 0x7fe8d00c9dc0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc0099b0 tx=0x7fe8cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23a87dc987472f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:32.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.034+0000 7fe8d4d99700 1 -- 172.21.15.71:0/2559021558 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc00b820 con 0x7fe8d0156310 2023-10-09T06:57:32.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.034+0000 7fe8d4d99700 1 -- 172.21.15.71:0/2559021558 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc00b980 con 0x7fe8d0156310 2023-10-09T06:57:32.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.034+0000 7fe8d4d99700 1 -- 172.21.15.71:0/2559021558 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc00bd20 con 0x7fe8d0156310 2023-10-09T06:57:32.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.034+0000 7fe8d6d9d700 1 -- 172.21.15.71:0/2559021558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8d0156310 msgr2=0x7fe8d00c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:32.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.034+0000 7fe8d6d9d700 1 --2- 172.21.15.71:0/2559021558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8d0156310 0x7fe8d00c9dc0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc0099b0 tx=0x7fe8cc009250 comp rx=0 tx=0).stop 2023-10-09T06:57:32.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.034+0000 7fe8d6d9d700 1 -- 172.21.15.71:0/2559021558 shutdown_connections 2023-10-09T06:57:32.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.034+0000 7fe8d6d9d700 1 --2- 172.21.15.71:0/2559021558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8d0156310 0x7fe8d00c9dc0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:32.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.034+0000 7fe8d6d9d700 1 --2- 172.21.15.71:0/2559021558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8d01566e0 0x7fe8d00ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:32.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.034+0000 7fe8d6d9d700 1 -- 172.21.15.71:0/2559021558 >> 172.21.15.71:0/2559021558 conn(0x7fe8d00cc1f0 msgr2=0x7fe8d00cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:32.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.035+0000 7fe8d6d9d700 1 -- 172.21.15.71:0/2559021558 shutdown_connections 2023-10-09T06:57:32.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.035+0000 7fe8d6d9d700 1 -- 172.21.15.71:0/2559021558 wait complete. 2023-10-09T06:57:32.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.036+0000 7fe8d6d9d700 1 Processor -- start 2023-10-09T06:57:32.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.036+0000 7fe8d6d9d700 1 -- start start 2023-10-09T06:57:32.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.037+0000 7fe8d6d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8d00ca300 0x7fe8d016ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:32.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.037+0000 7fe8d6d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8d0156310 0x7fe8d0140a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:32.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.037+0000 7fe8d6d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8d01566e0 0x7fe8d00b0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:32.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.037+0000 7fe8d6d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d0141c40 con 0x7fe8d0156310 2023-10-09T06:57:32.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.037+0000 7fe8d6d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d01405e0 con 0x7fe8d01566e0 2023-10-09T06:57:32.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.037+0000 7fe8d6d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d016b040 con 0x7fe8d00ca300 2023-10-09T06:57:32.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.037+0000 7fe8d559a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8d0156310 0x7fe8d0140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:32.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.037+0000 7fe8d559a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8d0156310 0x7fe8d0140a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34090/0 (socket says 172.21.15.71:34090) 2023-10-09T06:57:32.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.037+0000 7fe8d559a700 1 -- 172.21.15.71:0/3226693138 learned_addr learned my addr 172.21.15.71:0/3226693138 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:32.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.037+0000 7fe8d5d9b700 1 --2- 172.21.15.71:0/3226693138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8d00ca300 0x7fe8d016ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:32.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.038+0000 7fe8d659c700 1 --2- 172.21.15.71:0/3226693138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8d01566e0 0x7fe8d00b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:32.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.038+0000 7fe8d559a700 1 -- 172.21.15.71:0/3226693138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8d00ca300 msgr2=0x7fe8d016ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:32.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.038+0000 7fe8d559a700 1 --2- 172.21.15.71:0/3226693138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8d00ca300 0x7fe8d016ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:32.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.038+0000 7fe8d559a700 1 -- 172.21.15.71:0/3226693138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8d01566e0 msgr2=0x7fe8d00b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:32.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.038+0000 7fe8d559a700 1 --2- 172.21.15.71:0/3226693138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8d01566e0 0x7fe8d00b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:32.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.038+0000 7fe8d559a700 1 -- 172.21.15.71:0/3226693138 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8cc0094f0 con 0x7fe8d0156310 2023-10-09T06:57:32.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.038+0000 7fe8d5d9b700 1 --2- 172.21.15.71:0/3226693138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8d00ca300 0x7fe8d016ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:32.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.038+0000 7fe8d659c700 1 --2- 172.21.15.71:0/3226693138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8d01566e0 0x7fe8d00b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:32.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.038+0000 7fe8d559a700 1 --2- 172.21.15.71:0/3226693138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8d0156310 0x7fe8d0140a70 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000b810 tx=0x7fe8c0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:32.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.038+0000 7fe8c5ffb700 1 -- 172.21.15.71:0/3226693138 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c000f5f0 con 0x7fe8d0156310 2023-10-09T06:57:32.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.038+0000 7fe8c5ffb700 1 -- 172.21.15.71:0/3226693138 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c000f770 con 0x7fe8d0156310 2023-10-09T06:57:32.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.038+0000 7fe8d6d9d700 1 -- 172.21.15.71:0/3226693138 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d01423e0 con 0x7fe8d0156310 2023-10-09T06:57:32.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.038+0000 7fe8c5ffb700 1 -- 172.21.15.71:0/3226693138 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c000fb30 con 0x7fe8d0156310 2023-10-09T06:57:32.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.038+0000 7fe8d6d9d700 1 -- 172.21.15.71:0/3226693138 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d0142100 con 0x7fe8d0156310 2023-10-09T06:57:32.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.040+0000 7fe8d6d9d700 1 -- 172.21.15.71:0/3226693138 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d004c3c0 con 0x7fe8d0156310 2023-10-09T06:57:32.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.040+0000 7fe8c5ffb700 1 -- 172.21.15.71:0/3226693138 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe8c0010480 con 0x7fe8d0156310 2023-10-09T06:57:32.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.041+0000 7fe8c5ffb700 1 --2- 172.21.15.71:0/3226693138 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe8b4066f30 0x7fe8b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:32.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.041+0000 7fe8c5ffb700 1 -- 172.21.15.71:0/3226693138 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fe8c0084630 con 0x7fe8d0156310 2023-10-09T06:57:32.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.042+0000 7fe8d5d9b700 1 --2- 172.21.15.71:0/3226693138 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe8b4066f30 0x7fe8b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:32.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.042+0000 7fe8d5d9b700 1 --2- 172.21.15.71:0/3226693138 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe8b4066f30 0x7fe8b40693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc0099b0 tx=0x7fe8cc016000 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:32.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.045+0000 7fe8c5ffb700 1 -- 172.21.15.71:0/3226693138 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8c0051790 con 0x7fe8d0156310 2023-10-09T06:57:32.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.281+0000 7fe8d6d9d700 1 -- 172.21.15.71:0/3226693138 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8d00cd0b0 con 0x7fe8d0156310 2023-10-09T06:57:32.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.281+0000 7fe8c5ffb700 1 -- 172.21.15.71:0/3226693138 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fe8c0054db0 con 0x7fe8d0156310 2023-10-09T06:57:32.282 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:32.282 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6055,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3774833170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3774833170},{"type":"v1","addr":"172.21.15.179:6836","nonce":3774833170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6058,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3203736717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3203736717},{"type":"v1","addr":"172.21.15.179:6837","nonce":3203736717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2747804060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2747804060},{"type":"v1","addr":"172.21.15.71:6833","nonce":2747804060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:57:28.273000+0000","modified":"2023-10-09T06:57:31.823203+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6240},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6240":{"gid":6240,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/3993456703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3993456703},{"type":"v1","addr":"172.21.15.71:6835","nonce":3993456703}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T06:57:32.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.283+0000 7fe8d6d9d700 1 -- 172.21.15.71:0/3226693138 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe8b4066f30 msgr2=0x7fe8b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:32.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.283+0000 7fe8d6d9d700 1 --2- 172.21.15.71:0/3226693138 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe8b4066f30 0x7fe8b40693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc0099b0 tx=0x7fe8cc016000 comp rx=0 tx=0).stop 2023-10-09T06:57:32.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.283+0000 7fe8d6d9d700 1 -- 172.21.15.71:0/3226693138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8d0156310 msgr2=0x7fe8d0140a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:32.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.283+0000 7fe8d6d9d700 1 --2- 172.21.15.71:0/3226693138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8d0156310 0x7fe8d0140a70 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000b810 tx=0x7fe8c0009220 comp rx=0 tx=0).stop 2023-10-09T06:57:32.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.283+0000 7fe8d6d9d700 1 -- 172.21.15.71:0/3226693138 shutdown_connections 2023-10-09T06:57:32.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.283+0000 7fe8d6d9d700 1 --2- 172.21.15.71:0/3226693138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8d01566e0 0x7fe8d00b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:32.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.283+0000 7fe8d6d9d700 1 --2- 172.21.15.71:0/3226693138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8d00ca300 0x7fe8d016ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:32.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.284+0000 7fe8d6d9d700 1 --2- 172.21.15.71:0/3226693138 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe8b4066f30 0x7fe8b40693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:32.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.284+0000 7fe8d6d9d700 1 --2- 172.21.15.71:0/3226693138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8d0156310 0x7fe8d0140a70 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:32.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.284+0000 7fe8d6d9d700 1 -- 172.21.15.71:0/3226693138 >> 172.21.15.71:0/3226693138 conn(0x7fe8d00cc1f0 msgr2=0x7fe8d00c2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:32.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.284+0000 7fe8d6d9d700 1 -- 172.21.15.71:0/3226693138 shutdown_connections 2023-10-09T06:57:32.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.284+0000 7fe8d6d9d700 1 -- 172.21.15.71:0/3226693138 wait complete. 2023-10-09T06:57:32.285 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 33 2023-10-09T06:57:32.301 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:57:32.324 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:57:32.351 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:57:32.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.487+0000 7fa9dc99d700 1 Processor -- start 2023-10-09T06:57:32.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.487+0000 7fa9dc99d700 1 -- start start 2023-10-09T06:57:32.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.488+0000 7fa9dc99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9d81597f0 0x7fa9d80b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:32.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.488+0000 7fa9dc99d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d80b11d0 con 0x7fa9d8159420 2023-10-09T06:57:32.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.488+0000 7fa9dc99d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d80b14b0 con 0x7fa9d815d230 2023-10-09T06:57:32.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.488+0000 7fa9dc99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d80b1790 con 0x7fa9d81597f0 2023-10-09T06:57:32.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.488+0000 7fa9d77fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa9d8159420 0x7fa9d80b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60330/0 (socket says 172.21.15.71:60330) 2023-10-09T06:57:32.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.488+0000 7fa9d77fe700 1 -- 172.21.15.71:0/3089332808 learned_addr learned my addr 172.21.15.71:0/3089332808 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:32.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.489+0000 7fa9d6ffd700 1 --2- 172.21.15.71:0/3089332808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9d81597f0 0x7fa9d80b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:32.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.489+0000 7fa9d67fc700 1 -- 172.21.15.71:0/3089332808 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1401756763 0 0) 0x7fa9d80b11d0 con 0x7fa9d8159420 2023-10-09T06:57:32.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.489+0000 7fa9d67fc700 1 -- 172.21.15.71:0/3089332808 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9c0003570 con 0x7fa9d8159420 2023-10-09T06:57:32.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.489+0000 7fa9d67fc700 1 -- 172.21.15.71:0/3089332808 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987927609 0 0) 0x7fa9d80b14b0 con 0x7fa9d815d230 2023-10-09T06:57:32.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.489+0000 7fa9d67fc700 1 -- 172.21.15.71:0/3089332808 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9d80b11d0 con 0x7fa9d815d230 2023-10-09T06:57:32.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.489+0000 7fa9d6ffd700 1 -- 172.21.15.71:0/3089332808 >> v1:172.21.15.179:6789/0 conn(0x7fa9d815d230 legacy=0x7fa9d80b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:32.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.489+0000 7fa9d6ffd700 1 -- 172.21.15.71:0/3089332808 >> v1:172.21.15.71:6789/0 conn(0x7fa9d8159420 legacy=0x7fa9d80b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:32.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.489+0000 7fa9d6ffd700 1 -- 172.21.15.71:0/3089332808 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d80b1a70 con 0x7fa9d81597f0 2023-10-09T06:57:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.489+0000 7fa9d6ffd700 1 --2- 172.21.15.71:0/3089332808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9d81597f0 0x7fa9d80b2270 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc009910 tx=0x7fa9cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17b760c331865cfe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.490+0000 7fa9d67fc700 1 -- 172.21.15.71:0/3089332808 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc011630 con 0x7fa9d81597f0 2023-10-09T06:57:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.490+0000 7fa9d67fc700 1 -- 172.21.15.71:0/3089332808 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc011790 con 0x7fa9d81597f0 2023-10-09T06:57:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.490+0000 7fa9d67fc700 1 -- 172.21.15.71:0/3089332808 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc011b30 con 0x7fa9d81597f0 2023-10-09T06:57:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.490+0000 7fa9dc99d700 1 -- 172.21.15.71:0/3089332808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9d81597f0 msgr2=0x7fa9d80b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.490+0000 7fa9dc99d700 1 --2- 172.21.15.71:0/3089332808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9d81597f0 0x7fa9d80b2270 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc009910 tx=0x7fa9cc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.490+0000 7fa9dc99d700 1 -- 172.21.15.71:0/3089332808 shutdown_connections 2023-10-09T06:57:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.490+0000 7fa9dc99d700 1 --2- 172.21.15.71:0/3089332808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9d81597f0 0x7fa9d80b2270 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.490+0000 7fa9dc99d700 1 -- 172.21.15.71:0/3089332808 >> 172.21.15.71:0/3089332808 conn(0x7fa9d80d0660 msgr2=0x7fa9d80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.490+0000 7fa9dc99d700 1 -- 172.21.15.71:0/3089332808 shutdown_connections 2023-10-09T06:57:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.490+0000 7fa9dc99d700 1 -- 172.21.15.71:0/3089332808 wait complete. 2023-10-09T06:57:32.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.492+0000 7fa9dc99d700 1 Processor -- start 2023-10-09T06:57:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.492+0000 7fa9dc99d700 1 -- start start 2023-10-09T06:57:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.493+0000 7fa9dc99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9d8159420 0x7fa9d80c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.493+0000 7fa9dc99d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9d81597f0 0x7fa9d815b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.493+0000 7fa9dc99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9d815d230 0x7fa9d8154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.493+0000 7fa9dc99d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d80c7180 con 0x7fa9d81597f0 2023-10-09T06:57:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.493+0000 7fa9dc99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d80c7460 con 0x7fa9d8159420 2023-10-09T06:57:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.493+0000 7fa9dc99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d80c7740 con 0x7fa9d815d230 2023-10-09T06:57:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.493+0000 7fa9d6ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9d81597f0 0x7fa9d815b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.493+0000 7fa9d6ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9d81597f0 0x7fa9d815b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34106/0 (socket says 172.21.15.71:34106) 2023-10-09T06:57:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.493+0000 7fa9d6ffd700 1 -- 172.21.15.71:0/3660385411 learned_addr learned my addr 172.21.15.71:0/3660385411 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.493+0000 7fa9d77fe700 1 --2- 172.21.15.71:0/3660385411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9d8159420 0x7fa9d80c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:32.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.493+0000 7fa9d7fff700 1 --2- 172.21.15.71:0/3660385411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9d815d230 0x7fa9d8154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:32.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.493+0000 7fa9d6ffd700 1 -- 172.21.15.71:0/3660385411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9d815d230 msgr2=0x7fa9d8154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:32.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.493+0000 7fa9d6ffd700 1 --2- 172.21.15.71:0/3660385411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9d815d230 0x7fa9d8154230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:32.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.493+0000 7fa9d6ffd700 1 -- 172.21.15.71:0/3660385411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9d8159420 msgr2=0x7fa9d80c6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:32.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.493+0000 7fa9d6ffd700 1 --2- 172.21.15.71:0/3660385411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9d8159420 0x7fa9d80c6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:32.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.493+0000 7fa9d6ffd700 1 -- 172.21.15.71:0/3660385411 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc009420 con 0x7fa9d81597f0 2023-10-09T06:57:32.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.493+0000 7fa9d77fe700 1 --2- 172.21.15.71:0/3660385411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9d8159420 0x7fa9d80c6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:57:32.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.493+0000 7fa9d7fff700 1 --2- 172.21.15.71:0/3660385411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9d815d230 0x7fa9d8154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:57:32.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.494+0000 7fa9d6ffd700 1 --2- 172.21.15.71:0/3660385411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9d81597f0 0x7fa9d815b690 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc009f00 tx=0x7fa9cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.494+0000 7fa9bf7fe700 1 -- 172.21.15.71:0/3660385411 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc01f070 con 0x7fa9d81597f0 2023-10-09T06:57:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.494+0000 7fa9bf7fe700 1 -- 172.21.15.71:0/3660385411 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc000bc0 con 0x7fa9d81597f0 2023-10-09T06:57:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.494+0000 7fa9bf7fe700 1 -- 172.21.15.71:0/3660385411 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc025420 con 0x7fa9d81597f0 2023-10-09T06:57:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.494+0000 7fa9dc99d700 1 -- 172.21.15.71:0/3660385411 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d80c7a20 con 0x7fa9d81597f0 2023-10-09T06:57:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.494+0000 7fa9dc99d700 1 -- 172.21.15.71:0/3660385411 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d8154770 con 0x7fa9d81597f0 2023-10-09T06:57:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.495+0000 7fa9dc99d700 1 -- 172.21.15.71:0/3660385411 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d804c3c0 con 0x7fa9d81597f0 2023-10-09T06:57:32.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.496+0000 7fa9bf7fe700 1 -- 172.21.15.71:0/3660385411 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9cc023070 con 0x7fa9d81597f0 2023-10-09T06:57:32.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.496+0000 7fa9bf7fe700 1 --2- 172.21.15.71:0/3660385411 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa9c4066f30 0x7fa9c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:32.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.497+0000 7fa9bf7fe700 1 -- 172.21.15.71:0/3660385411 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fa9cc085b20 con 0x7fa9d81597f0 2023-10-09T06:57:32.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.497+0000 7fa9d77fe700 1 --2- 172.21.15.71:0/3660385411 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa9c4066f30 0x7fa9c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:32.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.498+0000 7fa9d77fe700 1 --2- 172.21.15.71:0/3660385411 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa9c4066f30 0x7fa9c40693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8007fd0 tx=0x7fa9c8009040 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:32.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.501+0000 7fa9bf7fe700 1 -- 172.21.15.71:0/3660385411 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9cc052c00 con 0x7fa9d81597f0 2023-10-09T06:57:32.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.692+0000 7fa9dc99d700 1 -- 172.21.15.71:0/3660385411 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9d80b1d50 con 0x7fa9d81597f0 2023-10-09T06:57:32.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.693+0000 7fa9bf7fe700 1 -- 172.21.15.71:0/3660385411 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+15944 (secure 0 0 0) 0x7fa9cc02a090 con 0x7fa9d81597f0 2023-10-09T06:57:32.693 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:32.693 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":79,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:57:29.756550+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:57:25.936431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T06:57:27.258713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:57:32.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.695+0000 7fa9dc99d700 1 -- 172.21.15.71:0/3660385411 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa9c4066f30 msgr2=0x7fa9c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:32.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.695+0000 7fa9dc99d700 1 --2- 172.21.15.71:0/3660385411 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa9c4066f30 0x7fa9c40693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8007fd0 tx=0x7fa9c8009040 comp rx=0 tx=0).stop 2023-10-09T06:57:32.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.695+0000 7fa9dc99d700 1 -- 172.21.15.71:0/3660385411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9d81597f0 msgr2=0x7fa9d815b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:32.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.695+0000 7fa9dc99d700 1 --2- 172.21.15.71:0/3660385411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9d81597f0 0x7fa9d815b690 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc009f00 tx=0x7fa9cc017000 comp rx=0 tx=0).stop 2023-10-09T06:57:32.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.696+0000 7fa9dc99d700 1 -- 172.21.15.71:0/3660385411 shutdown_connections 2023-10-09T06:57:32.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.696+0000 7fa9dc99d700 1 --2- 172.21.15.71:0/3660385411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9d815d230 0x7fa9d8154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:32.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.696+0000 7fa9dc99d700 1 --2- 172.21.15.71:0/3660385411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9d8159420 0x7fa9d80c6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:32.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.696+0000 7fa9dc99d700 1 --2- 172.21.15.71:0/3660385411 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa9c4066f30 0x7fa9c40693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:32.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.696+0000 7fa9dc99d700 1 --2- 172.21.15.71:0/3660385411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9d81597f0 0x7fa9d815b690 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:32.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.696+0000 7fa9dc99d700 1 -- 172.21.15.71:0/3660385411 >> 172.21.15.71:0/3660385411 conn(0x7fa9d80d0660 msgr2=0x7fa9d8155bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:32.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.696+0000 7fa9dc99d700 1 -- 172.21.15.71:0/3660385411 shutdown_connections 2023-10-09T06:57:32.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.696+0000 7fa9dc99d700 1 -- 172.21.15.71:0/3660385411 wait complete. 2023-10-09T06:57:32.714 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T06:57:32.714 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:57:32.771 INFO:tasks.ceph.mds.a.smithi071.stderr:2023-10-09T06:57:32.771+0000 7f4321ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:57:32.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.899+0000 7f981759d700 1 Processor -- start 2023-10-09T06:57:32.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.899+0000 7f981759d700 1 -- start start 2023-10-09T06:57:32.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.900+0000 7f981759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98101597f0 0x7f98100b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:32.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.900+0000 7f981759d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98100b11d0 con 0x7f981015d230 2023-10-09T06:57:32.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.900+0000 7f981759d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98100b14b0 con 0x7f9810159420 2023-10-09T06:57:32.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.900+0000 7f981759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98100b1790 con 0x7f98101597f0 2023-10-09T06:57:32.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.901+0000 7f9816d9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f981015d230 0x7f98100b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60336/0 (socket says 172.21.15.71:60336) 2023-10-09T06:57:32.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.901+0000 7f9816d9c700 1 -- 172.21.15.71:0/1757560161 learned_addr learned my addr 172.21.15.71:0/1757560161 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:32.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.901+0000 7f9815d9a700 1 --2- 172.21.15.71:0/1757560161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98101597f0 0x7f98100b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:32.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.901+0000 7f9815599700 1 -- 172.21.15.71:0/1757560161 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1358932700 0 0) 0x7f98100b11d0 con 0x7f981015d230 2023-10-09T06:57:32.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.901+0000 7f9815599700 1 -- 172.21.15.71:0/1757560161 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97fc003570 con 0x7f981015d230 2023-10-09T06:57:32.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.901+0000 7f9815599700 1 -- 172.21.15.71:0/1757560161 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3244937745 0 0) 0x7f97fc003570 con 0x7f981015d230 2023-10-09T06:57:32.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.901+0000 7f9815599700 1 -- 172.21.15.71:0/1757560161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98101597f0 msgr2=0x7f98100b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:32.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.901+0000 7f9815599700 1 --2- 172.21.15.71:0/1757560161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98101597f0 0x7f98100b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:32.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.901+0000 7f9815599700 1 -- 172.21.15.71:0/1757560161 >> v1:172.21.15.179:6789/0 conn(0x7f9810159420 legacy=0x7f98100b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:32.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.901+0000 7f9815599700 1 -- 172.21.15.71:0/1757560161 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98100b1a70 con 0x7f981015d230 2023-10-09T06:57:32.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.901+0000 7f9815599700 1 -- 172.21.15.71:0/1757560161 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f98080017f0 con 0x7f981015d230 2023-10-09T06:57:32.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.901+0000 7f9815599700 1 -- 172.21.15.71:0/1757560161 >> v1:172.21.15.71:6789/0 conn(0x7f981015d230 legacy=0x7f98100b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:32.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.901+0000 7f9815599700 1 --2- 172.21.15.71:0/1757560161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97fc003a90 0x7f97fc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:32.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.901+0000 7f9815599700 1 --2- 172.21.15.71:0/1757560161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98101597f0 0x7f97fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:32.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.902+0000 7f9815599700 1 --2- 172.21.15.71:0/1757560161 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97fc004d50 0x7f97fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:32.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.902+0000 7f9815599700 1 -- 172.21.15.71:0/1757560161 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98100b1790 con 0x7f97fc004d50 2023-10-09T06:57:32.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.902+0000 7f9815599700 1 -- 172.21.15.71:0/1757560161 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97fc00bbf0 con 0x7f97fc003a90 2023-10-09T06:57:32.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.902+0000 7f9815599700 1 -- 172.21.15.71:0/1757560161 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97fc00bd80 con 0x7f98101597f0 2023-10-09T06:57:32.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.902+0000 7f9816d9c700 1 --2- 172.21.15.71:0/1757560161 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97fc004d50 0x7f97fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:32.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.902+0000 7f981659b700 1 --2- 172.21.15.71:0/1757560161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97fc003a90 0x7f97fc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:32.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.902+0000 7f9815d9a700 1 --2- 172.21.15.71:0/1757560161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98101597f0 0x7f97fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:32.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.902+0000 7f9816d9c700 1 -- 172.21.15.71:0/1757560161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98101597f0 msgr2=0x7f97fc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:32.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.902+0000 7f9816d9c700 1 --2- 172.21.15.71:0/1757560161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98101597f0 0x7f97fc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:32.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.902+0000 7f9816d9c700 1 -- 172.21.15.71:0/1757560161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97fc003a90 msgr2=0x7f97fc003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:32.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.902+0000 7f9816d9c700 1 --2- 172.21.15.71:0/1757560161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97fc003a90 0x7f97fc003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:32.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.902+0000 7f9816d9c700 1 -- 172.21.15.71:0/1757560161 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97fc003570 con 0x7f97fc004d50 2023-10-09T06:57:32.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.902+0000 7f9816d9c700 1 --2- 172.21.15.71:0/1757560161 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97fc004d50 0x7f97fc0051c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f980800a860 tx=0x7f9808002100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f17f9bc41c0b27 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:32.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.903+0000 7f9815599700 1 -- 172.21.15.71:0/1757560161 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98080070f0 con 0x7f97fc004d50 2023-10-09T06:57:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.903+0000 7f9815599700 1 -- 172.21.15.71:0/1757560161 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9808007250 con 0x7f97fc004d50 2023-10-09T06:57:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.903+0000 7f9815599700 1 -- 172.21.15.71:0/1757560161 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9808007610 con 0x7f97fc004d50 2023-10-09T06:57:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.903+0000 7f981759d700 1 -- 172.21.15.71:0/1757560161 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97fc004d50 msgr2=0x7f97fc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.903+0000 7f981759d700 1 --2- 172.21.15.71:0/1757560161 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97fc004d50 0x7f97fc0051c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f980800a860 tx=0x7f9808002100 comp rx=0 tx=0).stop 2023-10-09T06:57:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.903+0000 7f9816d9c700 1 -- 172.21.15.71:0/1757560161 reap_dead start 2023-10-09T06:57:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.903+0000 7f981759d700 1 -- 172.21.15.71:0/1757560161 shutdown_connections 2023-10-09T06:57:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.903+0000 7f981759d700 1 -- 172.21.15.71:0/1757560161 >> 172.21.15.71:0/1757560161 conn(0x7f98100d0660 msgr2=0x7f98100d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.903+0000 7f981759d700 1 -- 172.21.15.71:0/1757560161 shutdown_connections 2023-10-09T06:57:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.903+0000 7f981759d700 1 -- 172.21.15.71:0/1757560161 wait complete. 2023-10-09T06:57:32.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.905+0000 7f981759d700 1 Processor -- start 2023-10-09T06:57:32.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.905+0000 7f981759d700 1 -- start start 2023-10-09T06:57:32.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.906+0000 7f981759d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97fc004d50 0x7f981015c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:32.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.906+0000 7f981759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f981016a220 0x7f9810156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:32.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.906+0000 7f981759d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98100c7800 0x7f98100c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:32.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.906+0000 7f981759d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98100c6290 con 0x7f97fc004d50 2023-10-09T06:57:32.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.906+0000 7f981759d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98101572b0 con 0x7f98100c7800 2023-10-09T06:57:32.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.906+0000 7f981759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98100c6760 con 0x7f981016a220 2023-10-09T06:57:32.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.906+0000 7f981659b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97fc004d50 0x7f981015c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:32.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.906+0000 7f981659b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97fc004d50 0x7f981015c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34124/0 (socket says 172.21.15.71:34124) 2023-10-09T06:57:32.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.906+0000 7f981659b700 1 -- 172.21.15.71:0/3044919067 learned_addr learned my addr 172.21.15.71:0/3044919067 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:32.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.906+0000 7f9815d9a700 1 --2- 172.21.15.71:0/3044919067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f981016a220 0x7f9810156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:32.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.906+0000 7f9816d9c700 1 --2- 172.21.15.71:0/3044919067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98100c7800 0x7f98100c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:32.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.906+0000 7f981659b700 1 -- 172.21.15.71:0/3044919067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f981016a220 msgr2=0x7f9810156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:32.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.906+0000 7f981659b700 1 --2- 172.21.15.71:0/3044919067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f981016a220 0x7f9810156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:32.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.906+0000 7f981659b700 1 -- 172.21.15.71:0/3044919067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98100c7800 msgr2=0x7f98100c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.906+0000 7f981659b700 1 --2- 172.21.15.71:0/3044919067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98100c7800 0x7f98100c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.906+0000 7f981659b700 1 -- 172.21.15.71:0/3044919067 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98100c6a40 con 0x7f97fc004d50 2023-10-09T06:57:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.906+0000 7f9816d9c700 1 --2- 172.21.15.71:0/3044919067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98100c7800 0x7f98100c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:57:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.907+0000 7f981659b700 1 --2- 172.21.15.71:0/3044919067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97fc004d50 0x7f981015c940 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f980c002950 tx=0x7f980c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.907+0000 7f98067fc700 1 -- 172.21.15.71:0/3044919067 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c002e90 con 0x7f97fc004d50 2023-10-09T06:57:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.907+0000 7f98067fc700 1 -- 172.21.15.71:0/3044919067 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c00f8d0 con 0x7f97fc004d50 2023-10-09T06:57:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.907+0000 7f98067fc700 1 -- 172.21.15.71:0/3044919067 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c00fc90 con 0x7f97fc004d50 2023-10-09T06:57:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.907+0000 7f981759d700 1 -- 172.21.15.71:0/3044919067 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98100c6d20 con 0x7f97fc004d50 2023-10-09T06:57:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.907+0000 7f981759d700 1 -- 172.21.15.71:0/3044919067 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98100c72e0 con 0x7f97fc004d50 2023-10-09T06:57:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.908+0000 7f981759d700 1 -- 172.21.15.71:0/3044919067 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981004c3c0 con 0x7f97fc004d50 2023-10-09T06:57:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.909+0000 7f98067fc700 1 -- 172.21.15.71:0/3044919067 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f980c006820 con 0x7f97fc004d50 2023-10-09T06:57:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.910+0000 7f98067fc700 1 --2- 172.21.15.71:0/3044919067 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f97f4066f30 0x7f97f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.910+0000 7f98067fc700 1 -- 172.21.15.71:0/3044919067 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f980c0848d0 con 0x7f97fc004d50 2023-10-09T06:57:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.910+0000 7f9815d9a700 1 --2- 172.21.15.71:0/3044919067 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f97f4066f30 0x7f97f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.911+0000 7f9815d9a700 1 --2- 172.21.15.71:0/3044919067 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f97f4066f30 0x7f97f40693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9800006f00 tx=0x7f9800008040 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:32.913+0000 7f98067fc700 1 -- 172.21.15.71:0/3044919067 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f980c051910 con 0x7f97fc004d50 2023-10-09T06:57:33.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.098+0000 7f981759d700 1 -- 172.21.15.71:0/3044919067 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f98100b1d50 con 0x7f97f4066f30 2023-10-09T06:57:33.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.109+0000 7f98067fc700 1 -- 172.21.15.71:0/3044919067 <== mgr.5351 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288953 (secure 0 0 0) 0x7f98100b1d50 con 0x7f97f4066f30 2023-10-09T06:57:33.111 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:33.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.113+0000 7f981759d700 1 -- 172.21.15.71:0/3044919067 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f97f4066f30 msgr2=0x7f97f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:33.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.113+0000 7f981759d700 1 --2- 172.21.15.71:0/3044919067 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f97f4066f30 0x7f97f40693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9800006f00 tx=0x7f9800008040 comp rx=0 tx=0).stop 2023-10-09T06:57:33.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.113+0000 7f981759d700 1 -- 172.21.15.71:0/3044919067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97fc004d50 msgr2=0x7f981015c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:33.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.113+0000 7f981759d700 1 --2- 172.21.15.71:0/3044919067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97fc004d50 0x7f981015c940 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f980c002950 tx=0x7f980c007d30 comp rx=0 tx=0).stop 2023-10-09T06:57:33.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.113+0000 7f981759d700 1 -- 172.21.15.71:0/3044919067 shutdown_connections 2023-10-09T06:57:33.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.113+0000 7f981759d700 1 --2- 172.21.15.71:0/3044919067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98100c7800 0x7f98100c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:33.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.113+0000 7f981759d700 1 --2- 172.21.15.71:0/3044919067 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f97f4066f30 0x7f97f40693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:33.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.113+0000 7f981759d700 1 --2- 172.21.15.71:0/3044919067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97fc004d50 0x7f981015c940 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:33.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.113+0000 7f981759d700 1 --2- 172.21.15.71:0/3044919067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f981016a220 0x7f9810156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:33.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.113+0000 7f981759d700 1 -- 172.21.15.71:0/3044919067 >> 172.21.15.71:0/3044919067 conn(0x7f98100d0660 msgr2=0x7f98100b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:33.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.113+0000 7f981759d700 1 -- 172.21.15.71:0/3044919067 shutdown_connections 2023-10-09T06:57:33.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.113+0000 7f981759d700 1 -- 172.21.15.71:0/3044919067 wait complete. 2023-10-09T06:57:33.119 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:57:33.131 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-09T06:57:32.041489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":283,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":161,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427896,"kb_used_data":8632,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752546824,"statfs":{"total":773094113280,"available":770607947776,"internally_reserved":0,"allocated":8839168,"data_stored":4818284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.246628"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.782308+0000","last_change":"2023-10-09T06:57:28.779265+0000","last_active":"2023-10-09T06:57:28.782308+0000","last_peered":"2023-10-09T06:57:28.782308+0000","last_clean":"2023-10-09T06:57:28.782308+0000","last_became_active":"2023-10-09T06:57:28.778873+0000","last_became_peered":"2023-10-09T06:57:28.778873+0000","last_unstale":"2023-10-09T06:57:28.782308+0000","last_undegraded":"2023-10-09T06:57:28.782308+0000","last_fullsized":"2023-10-09T06:57:28.782308+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:05:08.914279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.787428+0000","last_change":"2023-10-09T06:57:28.784358+0000","last_active":"2023-10-09T06:57:28.787428+0000","last_peered":"2023-10-09T06:57:28.787428+0000","last_clean":"2023-10-09T06:57:28.787428+0000","last_became_active":"2023-10-09T06:57:28.783757+0000","last_became_peered":"2023-10-09T06:57:28.783757+0000","last_unstale":"2023-10-09T06:57:28.787428+0000","last_undegraded":"2023-10-09T06:57:28.787428+0000","last_fullsized":"2023-10-09T06:57:28.787428+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:01:11.013314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.777481+0000","last_change":"2023-10-09T06:57:28.773901+0000","last_active":"2023-10-09T06:57:28.777481+0000","last_peered":"2023-10-09T06:57:28.777481+0000","last_clean":"2023-10-09T06:57:28.777481+0000","last_became_active":"2023-10-09T06:57:28.773583+0000","last_became_peered":"2023-10-09T06:57:28.773583+0000","last_unstale":"2023-10-09T06:57:28.777481+0000","last_undegraded":"2023-10-09T06:57:28.777481+0000","last_fullsized":"2023-10-09T06:57:28.777481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:40.665952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.780472+0000","last_change":"2023-10-09T06:57:28.774732+0000","last_active":"2023-10-09T06:57:28.780472+0000","last_peered":"2023-10-09T06:57:28.780472+0000","last_clean":"2023-10-09T06:57:28.780472+0000","last_became_active":"2023-10-09T06:57:28.774468+0000","last_became_peered":"2023-10-09T06:57:28.774468+0000","last_unstale":"2023-10-09T06:57:28.780472+0000","last_undegraded":"2023-10-09T06:57:28.780472+0000","last_fullsized":"2023-10-09T06:57:28.780472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:27:15.264158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.771217+0000","last_change":"2023-10-09T06:57:28.769484+0000","last_active":"2023-10-09T06:57:28.771217+0000","last_peered":"2023-10-09T06:57:28.771217+0000","last_clean":"2023-10-09T06:57:28.771217+0000","last_became_active":"2023-10-09T06:57:28.769190+0000","last_became_peered":"2023-10-09T06:57:28.769190+0000","last_unstale":"2023-10-09T06:57:28.771217+0000","last_undegraded":"2023-10-09T06:57:28.771217+0000","last_fullsized":"2023-10-09T06:57:28.771217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:12:17.608271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.785731+0000","last_change":"2023-10-09T06:57:28.781191+0000","last_active":"2023-10-09T06:57:28.785731+0000","last_peered":"2023-10-09T06:57:28.785731+0000","last_clean":"2023-10-09T06:57:28.785731+0000","last_became_active":"2023-10-09T06:57:28.780933+0000","last_became_peered":"2023-10-09T06:57:28.780933+0000","last_unstale":"2023-10-09T06:57:28.785731+0000","last_undegraded":"2023-10-09T06:57:28.785731+0000","last_fullsized":"2023-10-09T06:57:28.785731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:28.363380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.767432+0000","last_change":"2023-10-09T06:57:28.765143+0000","last_active":"2023-10-09T06:57:28.767432+0000","last_peered":"2023-10-09T06:57:28.767432+0000","last_clean":"2023-10-09T06:57:28.767432+0000","last_became_active":"2023-10-09T06:57:28.764884+0000","last_became_peered":"2023-10-09T06:57:28.764884+0000","last_unstale":"2023-10-09T06:57:28.767432+0000","last_undegraded":"2023-10-09T06:57:28.767432+0000","last_fullsized":"2023-10-09T06:57:28.767432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:51:14.511810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.784465+0000","last_change":"2023-10-09T06:57:28.775020+0000","last_active":"2023-10-09T06:57:28.784465+0000","last_peered":"2023-10-09T06:57:28.784465+0000","last_clean":"2023-10-09T06:57:28.784465+0000","last_became_active":"2023-10-09T06:57:28.774778+0000","last_became_peered":"2023-10-09T06:57:28.774778+0000","last_unstale":"2023-10-09T06:57:28.784465+0000","last_undegraded":"2023-10-09T06:57:28.784465+0000","last_fullsized":"2023-10-09T06:57:28.784465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:42:43.500230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.782281+0000","last_change":"2023-10-09T06:57:28.781080+0000","last_active":"2023-10-09T06:57:28.782281+0000","last_peered":"2023-10-09T06:57:28.782281+0000","last_clean":"2023-10-09T06:57:28.782281+0000","last_became_active":"2023-10-09T06:57:28.780824+0000","last_became_peered":"2023-10-09T06:57:28.780824+0000","last_unstale":"2023-10-09T06:57:28.782281+0000","last_undegraded":"2023-10-09T06:57:28.782281+0000","last_fullsized":"2023-10-09T06:57:28.782281+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:34:47.304040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.780334+0000","last_change":"2023-10-09T06:57:28.772288+0000","last_active":"2023-10-09T06:57:28.780334+0000","last_peered":"2023-10-09T06:57:28.780334+0000","last_clean":"2023-10-09T06:57:28.780334+0000","last_became_active":"2023-10-09T06:57:28.772025+0000","last_became_peered":"2023-10-09T06:57:28.772025+0000","last_unstale":"2023-10-09T06:57:28.780334+0000","last_undegraded":"2023-10-09T06:57:28.780334+0000","last_fullsized":"2023-10-09T06:57:28.780334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:06.360677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.785778+0000","last_change":"2023-10-09T06:57:28.780584+0000","last_active":"2023-10-09T06:57:28.785778+0000","last_peered":"2023-10-09T06:57:28.785778+0000","last_clean":"2023-10-09T06:57:28.785778+0000","last_became_active":"2023-10-09T06:57:28.780291+0000","last_became_peered":"2023-10-09T06:57:28.780291+0000","last_unstale":"2023-10-09T06:57:28.785778+0000","last_undegraded":"2023-10-09T06:57:28.785778+0000","last_fullsized":"2023-10-09T06:57:28.785778+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:23.825749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.780452+0000","last_change":"2023-10-09T06:57:28.772765+0000","last_active":"2023-10-09T06:57:28.780452+0000","last_peered":"2023-10-09T06:57:28.780452+0000","last_clean":"2023-10-09T06:57:28.780452+0000","last_became_active":"2023-10-09T06:57:28.772403+0000","last_became_peered":"2023-10-09T06:57:28.772403+0000","last_unstale":"2023-10-09T06:57:28.780452+0000","last_undegraded":"2023-10-09T06:57:28.780452+0000","last_fullsized":"2023-10-09T06:57:28.780452+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:40:11.649322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.779008+0000","last_change":"2023-10-09T06:57:28.776015+0000","last_active":"2023-10-09T06:57:28.779008+0000","last_peered":"2023-10-09T06:57:28.779008+0000","last_clean":"2023-10-09T06:57:28.779008+0000","last_became_active":"2023-10-09T06:57:28.775272+0000","last_became_peered":"2023-10-09T06:57:28.775272+0000","last_unstale":"2023-10-09T06:57:28.779008+0000","last_undegraded":"2023-10-09T06:57:28.779008+0000","last_fullsized":"2023-10-09T06:57:28.779008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:10:24.179254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.781660+0000","last_change":"2023-10-09T06:57:28.779614+0000","last_active":"2023-10-09T06:57:28.781660+0000","last_peered":"2023-10-09T06:57:28.781660+0000","last_clean":"2023-10-09T06:57:28.781660+0000","last_became_active":"2023-10-09T06:57:28.779356+0000","last_became_peered":"2023-10-09T06:57:28.779356+0000","last_unstale":"2023-10-09T06:57:28.781660+0000","last_undegraded":"2023-10-09T06:57:28.781660+0000","last_fullsized":"2023-10-09T06:57:28.781660+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:31.152074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.773506+0000","last_change":"2023-10-09T06:57:28.770931+0000","last_active":"2023-10-09T06:57:28.773506+0000","last_peered":"2023-10-09T06:57:28.773506+0000","last_clean":"2023-10-09T06:57:28.773506+0000","last_became_active":"2023-10-09T06:57:28.770676+0000","last_became_peered":"2023-10-09T06:57:28.770676+0000","last_unstale":"2023-10-09T06:57:28.773506+0000","last_undegraded":"2023-10-09T06:57:28.773506+0000","last_fullsized":"2023-10-09T06:57:28.773506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:05.775143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.785224+0000","last_change":"2023-10-09T06:57:28.773865+0000","last_active":"2023-10-09T06:57:28.785224+0000","last_peered":"2023-10-09T06:57:28.785224+0000","last_clean":"2023-10-09T06:57:28.785224+0000","last_became_active":"2023-10-09T06:57:28.773600+0000","last_became_peered":"2023-10-09T06:57:28.773600+0000","last_unstale":"2023-10-09T06:57:28.785224+0000","last_undegraded":"2023-10-09T06:57:28.785224+0000","last_fullsized":"2023-10-09T06:57:28.785224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:35.883463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.784982+0000","last_change":"2023-10-09T06:57:28.777871+0000","last_active":"2023-10-09T06:57:28.784982+0000","last_peered":"2023-10-09T06:57:28.784982+0000","last_clean":"2023-10-09T06:57:28.784982+0000","last_became_active":"2023-10-09T06:57:28.777620+0000","last_became_peered":"2023-10-09T06:57:28.777620+0000","last_unstale":"2023-10-09T06:57:28.784982+0000","last_undegraded":"2023-10-09T06:57:28.784982+0000","last_fullsized":"2023-10-09T06:57:28.784982+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:48.749070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.781601+0000","last_change":"2023-10-09T06:57:28.777462+0000","last_active":"2023-10-09T06:57:28.781601+0000","last_peered":"2023-10-09T06:57:28.781601+0000","last_clean":"2023-10-09T06:57:28.781601+0000","last_became_active":"2023-10-09T06:57:28.776548+0000","last_became_peered":"2023-10-09T06:57:28.776548+0000","last_unstale":"2023-10-09T06:57:28.781601+0000","last_undegraded":"2023-10-09T06:57:28.781601+0000","last_fullsized":"2023-10-09T06:57:28.781601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:19:08.486388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.779903+0000","last_change":"2023-10-09T06:57:28.778502+0000","last_active":"2023-10-09T06:57:28.779903+0000","last_peered":"2023-10-09T06:57:28.779903+0000","last_clean":"2023-10-09T06:57:28.779903+0000","last_became_active":"2023-10-09T06:57:28.778187+0000","last_became_peered":"2023-10-09T06:57:28.778187+0000","last_unstale":"2023-10-09T06:57:28.779903+0000","last_undegraded":"2023-10-09T06:57:28.779903+0000","last_fullsized":"2023-10-09T06:57:28.779903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:51:42.386711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.784648+0000","last_change":"2023-10-09T06:57:28.779276+0000","last_active":"2023-10-09T06:57:28.784648+0000","last_peered":"2023-10-09T06:57:28.784648+0000","last_clean":"2023-10-09T06:57:28.784648+0000","last_became_active":"2023-10-09T06:57:28.778989+0000","last_became_peered":"2023-10-09T06:57:28.778989+0000","last_unstale":"2023-10-09T06:57:28.784648+0000","last_undegraded":"2023-10-09T06:57:28.784648+0000","last_fullsized":"2023-10-09T06:57:28.784648+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:02.031349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.781979+0000","last_change":"2023-10-09T06:57:28.781195+0000","last_active":"2023-10-09T06:57:28.781979+0000","last_peered":"2023-10-09T06:57:28.781979+0000","last_clean":"2023-10-09T06:57:28.781979+0000","last_became_active":"2023-10-09T06:57:28.780913+0000","last_became_peered":"2023-10-09T06:57:28.780913+0000","last_unstale":"2023-10-09T06:57:28.781979+0000","last_undegraded":"2023-10-09T06:57:28.781979+0000","last_fullsized":"2023-10-09T06:57:28.781979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:19.232519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.786539+0000","last_change":"2023-10-09T06:57:28.782651+0000","last_active":"2023-10-09T06:57:28.786539+0000","last_peered":"2023-10-09T06:57:28.786539+0000","last_clean":"2023-10-09T06:57:28.786539+0000","last_became_active":"2023-10-09T06:57:28.782373+0000","last_became_peered":"2023-10-09T06:57:28.782373+0000","last_unstale":"2023-10-09T06:57:28.786539+0000","last_undegraded":"2023-10-09T06:57:28.786539+0000","last_fullsized":"2023-10-09T06:57:28.786539+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:49:01.635714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.785579+0000","last_change":"2023-10-09T06:57:28.784831+0000","last_active":"2023-10-09T06:57:28.785579+0000","last_peered":"2023-10-09T06:57:28.785579+0000","last_clean":"2023-10-09T06:57:28.785579+0000","last_became_active":"2023-10-09T06:57:28.784576+0000","last_became_peered":"2023-10-09T06:57:28.784576+0000","last_unstale":"2023-10-09T06:57:28.785579+0000","last_undegraded":"2023-10-09T06:57:28.785579+0000","last_fullsized":"2023-10-09T06:57:28.785579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:42.960559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.777935+0000","last_change":"2023-10-09T06:57:28.776194+0000","last_active":"2023-10-09T06:57:28.777935+0000","last_peered":"2023-10-09T06:57:28.777935+0000","last_clean":"2023-10-09T06:57:28.777935+0000","last_became_active":"2023-10-09T06:57:28.774585+0000","last_became_peered":"2023-10-09T06:57:28.774585+0000","last_unstale":"2023-10-09T06:57:28.777935+0000","last_undegraded":"2023-10-09T06:57:28.777935+0000","last_fullsized":"2023-10-09T06:57:28.777935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:37.782231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.779875+0000","last_change":"2023-10-09T06:57:28.778240+0000","last_active":"2023-10-09T06:57:28.779875+0000","last_peered":"2023-10-09T06:57:28.779875+0000","last_clean":"2023-10-09T06:57:28.779875+0000","last_became_active":"2023-10-09T06:57:28.777955+0000","last_became_peered":"2023-10-09T06:57:28.777955+0000","last_unstale":"2023-10-09T06:57:28.779875+0000","last_undegraded":"2023-10-09T06:57:28.779875+0000","last_fullsized":"2023-10-09T06:57:28.779875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:11:04.743241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.777137+0000","last_change":"2023-10-09T06:57:28.764966+0000","last_active":"2023-10-09T06:57:28.777137+0000","last_peered":"2023-10-09T06:57:28.777137+0000","last_clean":"2023-10-09T06:57:28.777137+0000","last_became_active":"2023-10-09T06:57:28.764658+0000","last_became_peered":"2023-10-09T06:57:28.764658+0000","last_unstale":"2023-10-09T06:57:28.777137+0000","last_undegraded":"2023-10-09T06:57:28.777137+0000","last_fullsized":"2023-10-09T06:57:28.777137+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:30:03.448770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.785611+0000","last_change":"2023-10-09T06:57:28.774575+0000","last_active":"2023-10-09T06:57:28.785611+0000","last_peered":"2023-10-09T06:57:28.785611+0000","last_clean":"2023-10-09T06:57:28.785611+0000","last_became_active":"2023-10-09T06:57:28.774260+0000","last_became_peered":"2023-10-09T06:57:28.774260+0000","last_unstale":"2023-10-09T06:57:28.785611+0000","last_undegraded":"2023-10-09T06:57:28.785611+0000","last_fullsized":"2023-10-09T06:57:28.785611+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:29.971439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.774686+0000","last_change":"2023-10-09T06:57:28.773808+0000","last_active":"2023-10-09T06:57:28.774686+0000","last_peered":"2023-10-09T06:57:28.774686+0000","last_clean":"2023-10-09T06:57:28.774686+0000","last_became_active":"2023-10-09T06:57:28.773162+0000","last_became_peered":"2023-10-09T06:57:28.773162+0000","last_unstale":"2023-10-09T06:57:28.774686+0000","last_undegraded":"2023-10-09T06:57:28.774686+0000","last_fullsized":"2023-10-09T06:57:28.774686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:16.799727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.786576+0000","last_change":"2023-10-09T06:57:28.783075+0000","last_active":"2023-10-09T06:57:28.786576+0000","last_peered":"2023-10-09T06:57:28.786576+0000","last_clean":"2023-10-09T06:57:28.786576+0000","last_became_active":"2023-10-09T06:57:28.782830+0000","last_became_peered":"2023-10-09T06:57:28.782830+0000","last_unstale":"2023-10-09T06:57:28.786576+0000","last_undegraded":"2023-10-09T06:57:28.786576+0000","last_fullsized":"2023-10-09T06:57:28.786576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:00.375449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.778076+0000","last_change":"2023-10-09T06:57:28.773047+0000","last_active":"2023-10-09T06:57:28.778076+0000","last_peered":"2023-10-09T06:57:28.778076+0000","last_clean":"2023-10-09T06:57:28.778076+0000","last_became_active":"2023-10-09T06:57:28.772776+0000","last_became_peered":"2023-10-09T06:57:28.772776+0000","last_unstale":"2023-10-09T06:57:28.778076+0000","last_undegraded":"2023-10-09T06:57:28.778076+0000","last_fullsized":"2023-10-09T06:57:28.778076+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:45:18.416489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.782334+0000","last_change":"2023-10-09T06:57:28.779097+0000","last_active":"2023-10-09T06:57:28.782334+0000","last_peered":"2023-10-09T06:57:28.782334+0000","last_clean":"2023-10-09T06:57:28.782334+0000","last_became_active":"2023-10-09T06:57:28.778724+0000","last_became_peered":"2023-10-09T06:57:28.778724+0000","last_unstale":"2023-10-09T06:57:28.782334+0000","last_undegraded":"2023-10-09T06:57:28.782334+0000","last_fullsized":"2023-10-09T06:57:28.782334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:51.726841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.778247+0000","last_change":"2023-10-09T06:57:28.771787+0000","last_active":"2023-10-09T06:57:28.778247+0000","last_peered":"2023-10-09T06:57:28.778247+0000","last_clean":"2023-10-09T06:57:28.778247+0000","last_became_active":"2023-10-09T06:57:28.771528+0000","last_became_peered":"2023-10-09T06:57:28.771528+0000","last_unstale":"2023-10-09T06:57:28.778247+0000","last_undegraded":"2023-10-09T06:57:28.778247+0000","last_fullsized":"2023-10-09T06:57:28.778247+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:11:40.587295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.784896+0000","last_change":"2023-10-09T06:57:28.774919+0000","last_active":"2023-10-09T06:57:28.784896+0000","last_peered":"2023-10-09T06:57:28.784896+0000","last_clean":"2023-10-09T06:57:28.784896+0000","last_became_active":"2023-10-09T06:57:28.773262+0000","last_became_peered":"2023-10-09T06:57:28.773262+0000","last_unstale":"2023-10-09T06:57:28.784896+0000","last_undegraded":"2023-10-09T06:57:28.784896+0000","last_fullsized":"2023-10-09T06:57:28.784896+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:19.985683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"78'4","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.822730+0000","last_change":"2023-10-09T06:57:27.827288+0000","last_active":"2023-10-09T06:57:28.822730+0000","last_peered":"2023-10-09T06:57:28.822730+0000","last_clean":"2023-10-09T06:57:28.822730+0000","last_became_active":"2023-10-09T06:57:27.827068+0000","last_became_peered":"2023-10-09T06:57:27.827068+0000","last_unstale":"2023-10-09T06:57:28.822730+0000","last_undegraded":"2023-10-09T06:57:28.822730+0000","last_fullsized":"2023-10-09T06:57:28.822730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:45:17.407599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.787241+0000","last_change":"2023-10-09T06:57:28.783942+0000","last_active":"2023-10-09T06:57:28.787241+0000","last_peered":"2023-10-09T06:57:28.787241+0000","last_clean":"2023-10-09T06:57:28.787241+0000","last_became_active":"2023-10-09T06:57:28.783696+0000","last_became_peered":"2023-10-09T06:57:28.783696+0000","last_unstale":"2023-10-09T06:57:28.787241+0000","last_undegraded":"2023-10-09T06:57:28.787241+0000","last_fullsized":"2023-10-09T06:57:28.787241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:19:56.437836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.820142+0000","last_change":"2023-10-09T06:57:27.820121+0000","last_active":"2023-10-09T06:57:28.820142+0000","last_peered":"2023-10-09T06:57:28.820142+0000","last_clean":"2023-10-09T06:57:28.820142+0000","last_became_active":"2023-10-09T06:57:27.819862+0000","last_became_peered":"2023-10-09T06:57:27.819862+0000","last_unstale":"2023-10-09T06:57:28.820142+0000","last_undegraded":"2023-10-09T06:57:28.820142+0000","last_fullsized":"2023-10-09T06:57:28.820142+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:59:30.516930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.785698+0000","last_change":"2023-10-09T06:57:28.783599+0000","last_active":"2023-10-09T06:57:28.785698+0000","last_peered":"2023-10-09T06:57:28.785698+0000","last_clean":"2023-10-09T06:57:28.785698+0000","last_became_active":"2023-10-09T06:57:28.783347+0000","last_became_peered":"2023-10-09T06:57:28.783347+0000","last_unstale":"2023-10-09T06:57:28.785698+0000","last_undegraded":"2023-10-09T06:57:28.785698+0000","last_fullsized":"2023-10-09T06:57:28.785698+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:39:38.013732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.818302+0000","last_change":"2023-10-09T06:57:27.819428+0000","last_active":"2023-10-09T06:57:28.818302+0000","last_peered":"2023-10-09T06:57:28.818302+0000","last_clean":"2023-10-09T06:57:28.818302+0000","last_became_active":"2023-10-09T06:57:27.818916+0000","last_became_peered":"2023-10-09T06:57:27.818916+0000","last_unstale":"2023-10-09T06:57:28.818302+0000","last_undegraded":"2023-10-09T06:57:28.818302+0000","last_fullsized":"2023-10-09T06:57:28.818302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:47:43.660419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.785684+0000","last_change":"2023-10-09T06:57:28.783825+0000","last_active":"2023-10-09T06:57:28.785684+0000","last_peered":"2023-10-09T06:57:28.785684+0000","last_clean":"2023-10-09T06:57:28.785684+0000","last_became_active":"2023-10-09T06:57:28.783562+0000","last_became_peered":"2023-10-09T06:57:28.783562+0000","last_unstale":"2023-10-09T06:57:28.785684+0000","last_undegraded":"2023-10-09T06:57:28.785684+0000","last_fullsized":"2023-10-09T06:57:28.785684+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:00.475732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.820333+0000","last_change":"2023-10-09T06:57:27.827451+0000","last_active":"2023-10-09T06:57:28.820333+0000","last_peered":"2023-10-09T06:57:28.820333+0000","last_clean":"2023-10-09T06:57:28.820333+0000","last_became_active":"2023-10-09T06:57:27.827153+0000","last_became_peered":"2023-10-09T06:57:27.827153+0000","last_unstale":"2023-10-09T06:57:28.820333+0000","last_undegraded":"2023-10-09T06:57:28.820333+0000","last_fullsized":"2023-10-09T06:57:28.820333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:30.143184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.786517+0000","last_change":"2023-10-09T06:57:28.781262+0000","last_active":"2023-10-09T06:57:28.786517+0000","last_peered":"2023-10-09T06:57:28.786517+0000","last_clean":"2023-10-09T06:57:28.786517+0000","last_became_active":"2023-10-09T06:57:28.780989+0000","last_became_peered":"2023-10-09T06:57:28.780989+0000","last_unstale":"2023-10-09T06:57:28.786517+0000","last_undegraded":"2023-10-09T06:57:28.786517+0000","last_fullsized":"2023-10-09T06:57:28.786517+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:02.902780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.815493+0000","last_change":"2023-10-09T06:57:27.823910+0000","last_active":"2023-10-09T06:57:28.815493+0000","last_peered":"2023-10-09T06:57:28.815493+0000","last_clean":"2023-10-09T06:57:28.815493+0000","last_became_active":"2023-10-09T06:57:27.823598+0000","last_became_peered":"2023-10-09T06:57:27.823598+0000","last_unstale":"2023-10-09T06:57:28.815493+0000","last_undegraded":"2023-10-09T06:57:28.815493+0000","last_fullsized":"2023-10-09T06:57:28.815493+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:19:55.428947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.784472+0000","last_change":"2023-10-09T06:57:28.777093+0000","last_active":"2023-10-09T06:57:28.784472+0000","last_peered":"2023-10-09T06:57:28.784472+0000","last_clean":"2023-10-09T06:57:28.784472+0000","last_became_active":"2023-10-09T06:57:28.776845+0000","last_became_peered":"2023-10-09T06:57:28.776845+0000","last_unstale":"2023-10-09T06:57:28.784472+0000","last_undegraded":"2023-10-09T06:57:28.784472+0000","last_fullsized":"2023-10-09T06:57:28.784472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:35.883463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.816579+0000","last_change":"2023-10-09T06:57:27.815673+0000","last_active":"2023-10-09T06:57:28.816579+0000","last_peered":"2023-10-09T06:57:28.816579+0000","last_clean":"2023-10-09T06:57:28.816579+0000","last_became_active":"2023-10-09T06:57:27.815399+0000","last_became_peered":"2023-10-09T06:57:27.815399+0000","last_unstale":"2023-10-09T06:57:28.816579+0000","last_undegraded":"2023-10-09T06:57:28.816579+0000","last_fullsized":"2023-10-09T06:57:28.816579+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:32.117248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.774244+0000","last_change":"2023-10-09T06:57:28.772568+0000","last_active":"2023-10-09T06:57:28.774244+0000","last_peered":"2023-10-09T06:57:28.774244+0000","last_clean":"2023-10-09T06:57:28.774244+0000","last_became_active":"2023-10-09T06:57:28.772186+0000","last_became_peered":"2023-10-09T06:57:28.772186+0000","last_unstale":"2023-10-09T06:57:28.774244+0000","last_undegraded":"2023-10-09T06:57:28.774244+0000","last_fullsized":"2023-10-09T06:57:28.774244+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:19:56.437836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.760237+0000","last_change":"2023-10-09T06:57:27.827942+0000","last_active":"2023-10-09T06:57:28.760237+0000","last_peered":"2023-10-09T06:57:28.760237+0000","last_clean":"2023-10-09T06:57:28.760237+0000","last_became_active":"2023-10-09T06:57:27.827632+0000","last_became_peered":"2023-10-09T06:57:27.827632+0000","last_unstale":"2023-10-09T06:57:28.760237+0000","last_undegraded":"2023-10-09T06:57:28.760237+0000","last_fullsized":"2023-10-09T06:57:28.760237+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:17.134868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.784335+0000","last_change":"2023-10-09T06:57:28.775560+0000","last_active":"2023-10-09T06:57:28.784335+0000","last_peered":"2023-10-09T06:57:28.784335+0000","last_clean":"2023-10-09T06:57:28.784335+0000","last_became_active":"2023-10-09T06:57:28.775291+0000","last_became_peered":"2023-10-09T06:57:28.775291+0000","last_unstale":"2023-10-09T06:57:28.784335+0000","last_undegraded":"2023-10-09T06:57:28.784335+0000","last_fullsized":"2023-10-09T06:57:28.784335+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:19.985683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.760505+0000","last_change":"2023-10-09T06:57:27.817039+0000","last_active":"2023-10-09T06:57:28.760505+0000","last_peered":"2023-10-09T06:57:28.760505+0000","last_clean":"2023-10-09T06:57:28.760505+0000","last_became_active":"2023-10-09T06:57:27.816692+0000","last_became_peered":"2023-10-09T06:57:27.816692+0000","last_unstale":"2023-10-09T06:57:28.760505+0000","last_undegraded":"2023-10-09T06:57:28.760505+0000","last_fullsized":"2023-10-09T06:57:28.760505+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:36.773341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.774909+0000","last_change":"2023-10-09T06:57:28.773174+0000","last_active":"2023-10-09T06:57:28.774909+0000","last_peered":"2023-10-09T06:57:28.774909+0000","last_clean":"2023-10-09T06:57:28.774909+0000","last_became_active":"2023-10-09T06:57:28.772859+0000","last_became_peered":"2023-10-09T06:57:28.772859+0000","last_unstale":"2023-10-09T06:57:28.774909+0000","last_undegraded":"2023-10-09T06:57:28.774909+0000","last_fullsized":"2023-10-09T06:57:28.774909+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:58.298403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.768264+0000","last_change":"2023-10-09T06:57:27.827839+0000","last_active":"2023-10-09T06:57:28.768264+0000","last_peered":"2023-10-09T06:57:28.768264+0000","last_clean":"2023-10-09T06:57:28.768264+0000","last_became_active":"2023-10-09T06:57:27.827514+0000","last_became_peered":"2023-10-09T06:57:27.827514+0000","last_unstale":"2023-10-09T06:57:28.768264+0000","last_undegraded":"2023-10-09T06:57:28.768264+0000","last_fullsized":"2023-10-09T06:57:28.768264+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:19:55.428947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.786775+0000","last_change":"2023-10-09T06:57:28.786165+0000","last_active":"2023-10-09T06:57:28.786775+0000","last_peered":"2023-10-09T06:57:28.786775+0000","last_clean":"2023-10-09T06:57:28.786775+0000","last_became_active":"2023-10-09T06:57:28.785850+0000","last_became_peered":"2023-10-09T06:57:28.785850+0000","last_unstale":"2023-10-09T06:57:28.786775+0000","last_undegraded":"2023-10-09T06:57:28.786775+0000","last_fullsized":"2023-10-09T06:57:28.786775+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:33.126138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.769139+0000","last_change":"2023-10-09T06:57:27.823933+0000","last_active":"2023-10-09T06:57:28.769139+0000","last_peered":"2023-10-09T06:57:28.769139+0000","last_clean":"2023-10-09T06:57:28.769139+0000","last_became_active":"2023-10-09T06:57:27.823480+0000","last_became_peered":"2023-10-09T06:57:27.823480+0000","last_unstale":"2023-10-09T06:57:28.769139+0000","last_undegraded":"2023-10-09T06:57:28.769139+0000","last_fullsized":"2023-10-09T06:57:28.769139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:32.117248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.785733+0000","last_change":"2023-10-09T06:57:28.781188+0000","last_active":"2023-10-09T06:57:28.785733+0000","last_peered":"2023-10-09T06:57:28.785733+0000","last_clean":"2023-10-09T06:57:28.785733+0000","last_became_active":"2023-10-09T06:57:28.780638+0000","last_became_peered":"2023-10-09T06:57:28.780638+0000","last_unstale":"2023-10-09T06:57:28.785733+0000","last_undegraded":"2023-10-09T06:57:28.785733+0000","last_fullsized":"2023-10-09T06:57:28.785733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:17:12.768331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"78'3","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.819986+0000","last_change":"2023-10-09T06:57:27.825675+0000","last_active":"2023-10-09T06:57:28.819986+0000","last_peered":"2023-10-09T06:57:28.819986+0000","last_clean":"2023-10-09T06:57:28.819986+0000","last_became_active":"2023-10-09T06:57:27.825387+0000","last_became_peered":"2023-10-09T06:57:27.825387+0000","last_unstale":"2023-10-09T06:57:28.819986+0000","last_undegraded":"2023-10-09T06:57:28.819986+0000","last_fullsized":"2023-10-09T06:57:28.819986+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:10:23.170364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.783383+0000","last_change":"2023-10-09T06:57:28.782449+0000","last_active":"2023-10-09T06:57:28.783383+0000","last_peered":"2023-10-09T06:57:28.783383+0000","last_clean":"2023-10-09T06:57:28.783383+0000","last_became_active":"2023-10-09T06:57:28.782183+0000","last_became_peered":"2023-10-09T06:57:28.782183+0000","last_unstale":"2023-10-09T06:57:28.783383+0000","last_undegraded":"2023-10-09T06:57:28.783383+0000","last_fullsized":"2023-10-09T06:57:28.783383+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:58.537945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"78'6","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.825456+0000","last_change":"2023-10-09T06:57:27.822063+0000","last_active":"2023-10-09T06:57:28.825456+0000","last_peered":"2023-10-09T06:57:28.825456+0000","last_clean":"2023-10-09T06:57:28.825456+0000","last_became_active":"2023-10-09T06:57:27.821629+0000","last_became_peered":"2023-10-09T06:57:27.821629+0000","last_unstale":"2023-10-09T06:57:28.825456+0000","last_undegraded":"2023-10-09T06:57:28.825456+0000","last_fullsized":"2023-10-09T06:57:28.825456+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:22.816859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.781013+0000","last_change":"2023-10-09T06:57:28.779439+0000","last_active":"2023-10-09T06:57:28.781013+0000","last_peered":"2023-10-09T06:57:28.781013+0000","last_clean":"2023-10-09T06:57:28.781013+0000","last_became_active":"2023-10-09T06:57:28.779190+0000","last_became_peered":"2023-10-09T06:57:28.779190+0000","last_unstale":"2023-10-09T06:57:28.781013+0000","last_undegraded":"2023-10-09T06:57:28.781013+0000","last_fullsized":"2023-10-09T06:57:28.781013+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:43:35.868915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.822180+0000","last_change":"2023-10-09T06:57:27.825130+0000","last_active":"2023-10-09T06:57:28.822180+0000","last_peered":"2023-10-09T06:57:28.822180+0000","last_clean":"2023-10-09T06:57:28.822180+0000","last_became_active":"2023-10-09T06:57:27.824395+0000","last_became_peered":"2023-10-09T06:57:27.824395+0000","last_unstale":"2023-10-09T06:57:28.822180+0000","last_undegraded":"2023-10-09T06:57:28.822180+0000","last_fullsized":"2023-10-09T06:57:28.822180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:41.951670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.778657+0000","last_change":"2023-10-09T06:57:28.776415+0000","last_active":"2023-10-09T06:57:28.778657+0000","last_peered":"2023-10-09T06:57:28.778657+0000","last_clean":"2023-10-09T06:57:28.778657+0000","last_became_active":"2023-10-09T06:57:28.776147+0000","last_became_peered":"2023-10-09T06:57:28.776147+0000","last_unstale":"2023-10-09T06:57:28.778657+0000","last_undegraded":"2023-10-09T06:57:28.778657+0000","last_fullsized":"2023-10-09T06:57:28.778657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:47:44.669309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.765587+0000","last_change":"2023-10-09T06:57:27.819882+0000","last_active":"2023-10-09T06:57:28.765587+0000","last_peered":"2023-10-09T06:57:28.765587+0000","last_clean":"2023-10-09T06:57:28.765587+0000","last_became_active":"2023-10-09T06:57:27.819561+0000","last_became_peered":"2023-10-09T06:57:27.819561+0000","last_unstale":"2023-10-09T06:57:28.765587+0000","last_undegraded":"2023-10-09T06:57:28.765587+0000","last_fullsized":"2023-10-09T06:57:28.765587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:48:52.311049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.775098+0000","last_change":"2023-10-09T06:57:28.772528+0000","last_active":"2023-10-09T06:57:28.775098+0000","last_peered":"2023-10-09T06:57:28.775098+0000","last_clean":"2023-10-09T06:57:28.775098+0000","last_became_active":"2023-10-09T06:57:28.771911+0000","last_became_peered":"2023-10-09T06:57:28.771911+0000","last_unstale":"2023-10-09T06:57:28.775098+0000","last_undegraded":"2023-10-09T06:57:28.775098+0000","last_fullsized":"2023-10-09T06:57:28.775098+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:18.143758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.760341+0000","last_change":"2023-10-09T06:57:27.828996+0000","last_active":"2023-10-09T06:57:28.760341+0000","last_peered":"2023-10-09T06:57:28.760341+0000","last_clean":"2023-10-09T06:57:28.760341+0000","last_became_active":"2023-10-09T06:57:27.828715+0000","last_became_peered":"2023-10-09T06:57:27.828715+0000","last_unstale":"2023-10-09T06:57:28.760341+0000","last_undegraded":"2023-10-09T06:57:28.760341+0000","last_fullsized":"2023-10-09T06:57:28.760341+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:51:13.502921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.781572+0000","last_change":"2023-10-09T06:57:28.777116+0000","last_active":"2023-10-09T06:57:28.781572+0000","last_peered":"2023-10-09T06:57:28.781572+0000","last_clean":"2023-10-09T06:57:28.781572+0000","last_became_active":"2023-10-09T06:57:28.776844+0000","last_became_peered":"2023-10-09T06:57:28.776844+0000","last_unstale":"2023-10-09T06:57:28.781572+0000","last_undegraded":"2023-10-09T06:57:28.781572+0000","last_fullsized":"2023-10-09T06:57:28.781572+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:40:50.639274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"78'8","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.822999+0000","last_change":"2023-10-09T06:57:27.829349+0000","last_active":"2023-10-09T06:57:28.822999+0000","last_peered":"2023-10-09T06:57:28.822999+0000","last_clean":"2023-10-09T06:57:28.822999+0000","last_became_active":"2023-10-09T06:57:27.828936+0000","last_became_peered":"2023-10-09T06:57:27.828936+0000","last_unstale":"2023-10-09T06:57:28.822999+0000","last_undegraded":"2023-10-09T06:57:28.822999+0000","last_fullsized":"2023-10-09T06:57:28.822999+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:36.773341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.781622+0000","last_change":"2023-10-09T06:57:28.777763+0000","last_active":"2023-10-09T06:57:28.781622+0000","last_peered":"2023-10-09T06:57:28.781622+0000","last_clean":"2023-10-09T06:57:28.781622+0000","last_became_active":"2023-10-09T06:57:28.776970+0000","last_became_peered":"2023-10-09T06:57:28.776970+0000","last_unstale":"2023-10-09T06:57:28.781622+0000","last_undegraded":"2023-10-09T06:57:28.781622+0000","last_fullsized":"2023-10-09T06:57:28.781622+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:04:41.947780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.822137+0000","last_change":"2023-10-09T06:57:27.823228+0000","last_active":"2023-10-09T06:57:28.822137+0000","last_peered":"2023-10-09T06:57:28.822137+0000","last_clean":"2023-10-09T06:57:28.822137+0000","last_became_active":"2023-10-09T06:57:27.822963+0000","last_became_peered":"2023-10-09T06:57:27.822963+0000","last_unstale":"2023-10-09T06:57:28.822137+0000","last_undegraded":"2023-10-09T06:57:28.822137+0000","last_fullsized":"2023-10-09T06:57:28.822137+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:45:17.407599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.780465+0000","last_change":"2023-10-09T06:57:28.778380+0000","last_active":"2023-10-09T06:57:28.780465+0000","last_peered":"2023-10-09T06:57:28.780465+0000","last_clean":"2023-10-09T06:57:28.780465+0000","last_became_active":"2023-10-09T06:57:28.778052+0000","last_became_peered":"2023-10-09T06:57:28.778052+0000","last_unstale":"2023-10-09T06:57:28.780465+0000","last_undegraded":"2023-10-09T06:57:28.780465+0000","last_fullsized":"2023-10-09T06:57:28.780465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:40:50.639274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.818139+0000","last_change":"2023-10-09T06:57:27.823098+0000","last_active":"2023-10-09T06:57:28.818139+0000","last_peered":"2023-10-09T06:57:28.818139+0000","last_clean":"2023-10-09T06:57:28.818139+0000","last_became_active":"2023-10-09T06:57:27.822849+0000","last_became_peered":"2023-10-09T06:57:27.822849+0000","last_unstale":"2023-10-09T06:57:28.818139+0000","last_undegraded":"2023-10-09T06:57:28.818139+0000","last_fullsized":"2023-10-09T06:57:28.818139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:38.564086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.784384+0000","last_change":"2023-10-09T06:57:28.775040+0000","last_active":"2023-10-09T06:57:28.784384+0000","last_peered":"2023-10-09T06:57:28.784384+0000","last_clean":"2023-10-09T06:57:28.784384+0000","last_became_active":"2023-10-09T06:57:28.774746+0000","last_became_peered":"2023-10-09T06:57:28.774746+0000","last_unstale":"2023-10-09T06:57:28.784384+0000","last_undegraded":"2023-10-09T06:57:28.784384+0000","last_fullsized":"2023-10-09T06:57:28.784384+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:02.256685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.822890+0000","last_change":"2023-10-09T06:57:27.828354+0000","last_active":"2023-10-09T06:57:28.822890+0000","last_peered":"2023-10-09T06:57:28.822890+0000","last_clean":"2023-10-09T06:57:28.822890+0000","last_became_active":"2023-10-09T06:57:27.828099+0000","last_became_peered":"2023-10-09T06:57:27.828099+0000","last_unstale":"2023-10-09T06:57:28.822890+0000","last_undegraded":"2023-10-09T06:57:28.822890+0000","last_fullsized":"2023-10-09T06:57:28.822890+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:17.812832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.783396+0000","last_change":"2023-10-09T06:57:28.782562+0000","last_active":"2023-10-09T06:57:28.783396+0000","last_peered":"2023-10-09T06:57:28.783396+0000","last_clean":"2023-10-09T06:57:28.783396+0000","last_became_active":"2023-10-09T06:57:28.782296+0000","last_became_peered":"2023-10-09T06:57:28.782296+0000","last_unstale":"2023-10-09T06:57:28.783396+0000","last_undegraded":"2023-10-09T06:57:28.783396+0000","last_fullsized":"2023-10-09T06:57:28.783396+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:59:31.525820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.766634+0000","last_change":"2023-10-09T06:57:27.815394+0000","last_active":"2023-10-09T06:57:28.766634+0000","last_peered":"2023-10-09T06:57:28.766634+0000","last_clean":"2023-10-09T06:57:28.766634+0000","last_became_active":"2023-10-09T06:57:27.815131+0000","last_became_peered":"2023-10-09T06:57:27.815131+0000","last_unstale":"2023-10-09T06:57:28.766634+0000","last_undegraded":"2023-10-09T06:57:28.766634+0000","last_fullsized":"2023-10-09T06:57:28.766634+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:04:40.938890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.780429+0000","last_change":"2023-10-09T06:57:28.778375+0000","last_active":"2023-10-09T06:57:28.780429+0000","last_peered":"2023-10-09T06:57:28.780429+0000","last_clean":"2023-10-09T06:57:28.780429+0000","last_became_active":"2023-10-09T06:57:28.778110+0000","last_became_peered":"2023-10-09T06:57:28.778110+0000","last_unstale":"2023-10-09T06:57:28.780429+0000","last_undegraded":"2023-10-09T06:57:28.780429+0000","last_fullsized":"2023-10-09T06:57:28.780429+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:58.537945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.822590+0000","last_change":"2023-10-09T06:57:27.821135+0000","last_active":"2023-10-09T06:57:28.822590+0000","last_peered":"2023-10-09T06:57:28.822590+0000","last_clean":"2023-10-09T06:57:28.822590+0000","last_became_active":"2023-10-09T06:57:27.820867+0000","last_became_peered":"2023-10-09T06:57:27.820867+0000","last_unstale":"2023-10-09T06:57:28.822590+0000","last_undegraded":"2023-10-09T06:57:28.822590+0000","last_fullsized":"2023-10-09T06:57:28.822590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:57.529055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.785180+0000","last_change":"2023-10-09T06:57:28.773962+0000","last_active":"2023-10-09T06:57:28.785180+0000","last_peered":"2023-10-09T06:57:28.785180+0000","last_clean":"2023-10-09T06:57:28.785180+0000","last_became_active":"2023-10-09T06:57:28.773628+0000","last_became_peered":"2023-10-09T06:57:28.773628+0000","last_unstale":"2023-10-09T06:57:28.785180+0000","last_undegraded":"2023-10-09T06:57:28.785180+0000","last_fullsized":"2023-10-09T06:57:28.785180+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:02.256685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.771842+0000","last_change":"2023-10-09T06:57:27.824027+0000","last_active":"2023-10-09T06:57:28.771842+0000","last_peered":"2023-10-09T06:57:28.771842+0000","last_clean":"2023-10-09T06:57:28.771842+0000","last_became_active":"2023-10-09T06:57:27.823722+0000","last_became_peered":"2023-10-09T06:57:27.823722+0000","last_unstale":"2023-10-09T06:57:28.771842+0000","last_undegraded":"2023-10-09T06:57:28.771842+0000","last_fullsized":"2023-10-09T06:57:28.771842+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:00:26.379968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.778259+0000","last_change":"2023-10-09T06:57:28.772235+0000","last_active":"2023-10-09T06:57:28.778259+0000","last_peered":"2023-10-09T06:57:28.778259+0000","last_clean":"2023-10-09T06:57:28.778259+0000","last_became_active":"2023-10-09T06:57:28.771956+0000","last_became_peered":"2023-10-09T06:57:28.771956+0000","last_unstale":"2023-10-09T06:57:28.778259+0000","last_undegraded":"2023-10-09T06:57:28.778259+0000","last_fullsized":"2023-10-09T06:57:28.778259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:02.031349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.762177+0000","last_change":"2023-10-09T06:57:27.823674+0000","last_active":"2023-10-09T06:57:28.762177+0000","last_peered":"2023-10-09T06:57:28.762177+0000","last_clean":"2023-10-09T06:57:28.762177+0000","last_became_active":"2023-10-09T06:57:27.823266+0000","last_became_peered":"2023-10-09T06:57:27.823266+0000","last_unstale":"2023-10-09T06:57:28.762177+0000","last_undegraded":"2023-10-09T06:57:28.762177+0000","last_fullsized":"2023-10-09T06:57:28.762177+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:34:46.295150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.780352+0000","last_change":"2023-10-09T06:57:28.775313+0000","last_active":"2023-10-09T06:57:28.780352+0000","last_peered":"2023-10-09T06:57:28.780352+0000","last_clean":"2023-10-09T06:57:28.780352+0000","last_became_active":"2023-10-09T06:57:28.775070+0000","last_became_peered":"2023-10-09T06:57:28.775070+0000","last_unstale":"2023-10-09T06:57:28.780352+0000","last_undegraded":"2023-10-09T06:57:28.780352+0000","last_fullsized":"2023-10-09T06:57:28.780352+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:06:04.512661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.821159+0000","last_change":"2023-10-09T06:57:27.813803+0000","last_active":"2023-10-09T06:57:28.821159+0000","last_peered":"2023-10-09T06:57:28.821159+0000","last_clean":"2023-10-09T06:57:28.821159+0000","last_became_active":"2023-10-09T06:57:27.813554+0000","last_became_peered":"2023-10-09T06:57:27.813554+0000","last_unstale":"2023-10-09T06:57:28.821159+0000","last_undegraded":"2023-10-09T06:57:28.821159+0000","last_fullsized":"2023-10-09T06:57:28.821159+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:35.206102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.780202+0000","last_change":"2023-10-09T06:57:28.772003+0000","last_active":"2023-10-09T06:57:28.780202+0000","last_peered":"2023-10-09T06:57:28.780202+0000","last_clean":"2023-10-09T06:57:28.780202+0000","last_became_active":"2023-10-09T06:57:28.771753+0000","last_became_peered":"2023-10-09T06:57:28.771753+0000","last_unstale":"2023-10-09T06:57:28.780202+0000","last_undegraded":"2023-10-09T06:57:28.780202+0000","last_fullsized":"2023-10-09T06:57:28.780202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:38:53.460629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.766086+0000","last_change":"2023-10-09T06:57:27.816892+0000","last_active":"2023-10-09T06:57:28.766086+0000","last_peered":"2023-10-09T06:57:28.766086+0000","last_clean":"2023-10-09T06:57:28.766086+0000","last_became_active":"2023-10-09T06:57:27.816592+0000","last_became_peered":"2023-10-09T06:57:27.816592+0000","last_unstale":"2023-10-09T06:57:28.766086+0000","last_undegraded":"2023-10-09T06:57:28.766086+0000","last_fullsized":"2023-10-09T06:57:28.766086+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:59:30.516930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.785754+0000","last_change":"2023-10-09T06:57:28.781415+0000","last_active":"2023-10-09T06:57:28.785754+0000","last_peered":"2023-10-09T06:57:28.785754+0000","last_clean":"2023-10-09T06:57:28.785754+0000","last_became_active":"2023-10-09T06:57:28.776766+0000","last_became_peered":"2023-10-09T06:57:28.776766+0000","last_unstale":"2023-10-09T06:57:28.785754+0000","last_undegraded":"2023-10-09T06:57:28.785754+0000","last_fullsized":"2023-10-09T06:57:28.785754+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:00:13.023731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.766334+0000","last_change":"2023-10-09T06:57:27.820783+0000","last_active":"2023-10-09T06:57:28.766334+0000","last_peered":"2023-10-09T06:57:28.766334+0000","last_clean":"2023-10-09T06:57:28.766334+0000","last_became_active":"2023-10-09T06:57:27.820522+0000","last_became_peered":"2023-10-09T06:57:27.820522+0000","last_unstale":"2023-10-09T06:57:28.766334+0000","last_undegraded":"2023-10-09T06:57:28.766334+0000","last_fullsized":"2023-10-09T06:57:28.766334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:04:34.324994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.785662+0000","last_change":"2023-10-09T06:57:28.782031+0000","last_active":"2023-10-09T06:57:28.785662+0000","last_peered":"2023-10-09T06:57:28.785662+0000","last_clean":"2023-10-09T06:57:28.785662+0000","last_became_active":"2023-10-09T06:57:28.781756+0000","last_became_peered":"2023-10-09T06:57:28.781756+0000","last_unstale":"2023-10-09T06:57:28.785662+0000","last_undegraded":"2023-10-09T06:57:28.785662+0000","last_fullsized":"2023-10-09T06:57:28.785662+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:24.050316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.762114+0000","last_change":"2023-10-09T06:57:27.823794+0000","last_active":"2023-10-09T06:57:28.762114+0000","last_peered":"2023-10-09T06:57:28.762114+0000","last_clean":"2023-10-09T06:57:28.762114+0000","last_became_active":"2023-10-09T06:57:27.823480+0000","last_became_peered":"2023-10-09T06:57:27.823480+0000","last_unstale":"2023-10-09T06:57:28.762114+0000","last_undegraded":"2023-10-09T06:57:28.762114+0000","last_fullsized":"2023-10-09T06:57:28.762114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:04.766253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.787444+0000","last_change":"2023-10-09T06:57:28.785057+0000","last_active":"2023-10-09T06:57:28.787444+0000","last_peered":"2023-10-09T06:57:28.787444+0000","last_clean":"2023-10-09T06:57:28.787444+0000","last_became_active":"2023-10-09T06:57:28.784736+0000","last_became_peered":"2023-10-09T06:57:28.784736+0000","last_unstale":"2023-10-09T06:57:28.787444+0000","last_undegraded":"2023-10-09T06:57:28.787444+0000","last_fullsized":"2023-10-09T06:57:28.787444+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:31.721364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.771683+0000","last_change":"2023-10-09T06:57:27.825298+0000","last_active":"2023-10-09T06:57:28.771683+0000","last_peered":"2023-10-09T06:57:28.771683+0000","last_clean":"2023-10-09T06:57:28.771683+0000","last_became_active":"2023-10-09T06:57:27.824987+0000","last_became_peered":"2023-10-09T06:57:27.824987+0000","last_unstale":"2023-10-09T06:57:28.771683+0000","last_undegraded":"2023-10-09T06:57:28.771683+0000","last_fullsized":"2023-10-09T06:57:28.771683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:54.221190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.777453+0000","last_change":"2023-10-09T06:57:28.774703+0000","last_active":"2023-10-09T06:57:28.777453+0000","last_peered":"2023-10-09T06:57:28.777453+0000","last_clean":"2023-10-09T06:57:28.777453+0000","last_became_active":"2023-10-09T06:57:28.774422+0000","last_became_peered":"2023-10-09T06:57:28.774422+0000","last_unstale":"2023-10-09T06:57:28.777453+0000","last_undegraded":"2023-10-09T06:57:28.777453+0000","last_fullsized":"2023-10-09T06:57:28.777453+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:39.572976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.761548+0000","last_change":"2023-10-09T06:57:27.821816+0000","last_active":"2023-10-09T06:57:28.761548+0000","last_peered":"2023-10-09T06:57:28.761548+0000","last_clean":"2023-10-09T06:57:28.761548+0000","last_became_active":"2023-10-09T06:57:27.821483+0000","last_became_peered":"2023-10-09T06:57:27.821483+0000","last_unstale":"2023-10-09T06:57:28.761548+0000","last_undegraded":"2023-10-09T06:57:28.761548+0000","last_fullsized":"2023-10-09T06:57:28.761548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:17:11.759441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.781308+0000","last_change":"2023-10-09T06:57:28.772274+0000","last_active":"2023-10-09T06:57:28.781308+0000","last_peered":"2023-10-09T06:57:28.781308+0000","last_clean":"2023-10-09T06:57:28.781308+0000","last_became_active":"2023-10-09T06:57:28.771950+0000","last_became_peered":"2023-10-09T06:57:28.771950+0000","last_unstale":"2023-10-09T06:57:28.781308+0000","last_undegraded":"2023-10-09T06:57:28.781308+0000","last_fullsized":"2023-10-09T06:57:28.781308+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:48:53.319939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.771797+0000","last_change":"2023-10-09T06:57:27.816955+0000","last_active":"2023-10-09T06:57:28.771797+0000","last_peered":"2023-10-09T06:57:28.771797+0000","last_clean":"2023-10-09T06:57:28.771797+0000","last_became_active":"2023-10-09T06:57:27.816689+0000","last_became_peered":"2023-10-09T06:57:27.816689+0000","last_unstale":"2023-10-09T06:57:28.771797+0000","last_undegraded":"2023-10-09T06:57:28.771797+0000","last_fullsized":"2023-10-09T06:57:28.771797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:04:58.302881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.784312+0000","last_change":"2023-10-09T06:57:28.774949+0000","last_active":"2023-10-09T06:57:28.784312+0000","last_peered":"2023-10-09T06:57:28.784312+0000","last_clean":"2023-10-09T06:57:28.784312+0000","last_became_active":"2023-10-09T06:57:28.774667+0000","last_became_peered":"2023-10-09T06:57:28.774667+0000","last_unstale":"2023-10-09T06:57:28.784312+0000","last_undegraded":"2023-10-09T06:57:28.784312+0000","last_fullsized":"2023-10-09T06:57:28.784312+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:28.363380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.765845+0000","last_change":"2023-10-09T06:57:27.826592+0000","last_active":"2023-10-09T06:57:28.765845+0000","last_peered":"2023-10-09T06:57:28.765845+0000","last_clean":"2023-10-09T06:57:28.765845+0000","last_became_active":"2023-10-09T06:57:27.826332+0000","last_became_peered":"2023-10-09T06:57:27.826332+0000","last_unstale":"2023-10-09T06:57:28.765845+0000","last_undegraded":"2023-10-09T06:57:28.765845+0000","last_fullsized":"2023-10-09T06:57:28.765845+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:38.564086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.784485+0000","last_change":"2023-10-09T06:57:28.775217+0000","last_active":"2023-10-09T06:57:28.784485+0000","last_peered":"2023-10-09T06:57:28.784485+0000","last_clean":"2023-10-09T06:57:28.784485+0000","last_became_active":"2023-10-09T06:57:28.774467+0000","last_became_peered":"2023-10-09T06:57:28.774467+0000","last_unstale":"2023-10-09T06:57:28.784485+0000","last_undegraded":"2023-10-09T06:57:28.784485+0000","last_fullsized":"2023-10-09T06:57:28.784485+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:29.971439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.765536+0000","last_change":"2023-10-09T06:57:27.826224+0000","last_active":"2023-10-09T06:57:28.765536+0000","last_peered":"2023-10-09T06:57:28.765536+0000","last_clean":"2023-10-09T06:57:28.765536+0000","last_became_active":"2023-10-09T06:57:27.825956+0000","last_became_peered":"2023-10-09T06:57:27.825956+0000","last_unstale":"2023-10-09T06:57:28.765536+0000","last_undegraded":"2023-10-09T06:57:28.765536+0000","last_fullsized":"2023-10-09T06:57:28.765536+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:18.886549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"68'161","reported_seq":371,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.765760+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:57:28.765760+0000","last_peered":"2023-10-09T06:57:28.765760+0000","last_clean":"2023-10-09T06:57:28.765760+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:57:28.765760+0000","last_undegraded":"2023-10-09T06:57:28.765760+0000","last_fullsized":"2023-10-09T06:57:28.765760+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575030,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302892,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068948,"statfs":{"total":96636764160,"available":96326602752,"internally_reserved":0,"allocated":1544192,"data_stored":1041305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.71399999999999997,"15min":0.71599999999999997},"min":{"1min":0.64000000000000001,"5min":0.36299999999999999,"15min":0.316},"max":{"1min":1.0960000000000001,"5min":1.732,"15min":1.9490000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.60299999999999998,"5min":0.40200000000000002,"15min":0.29999999999999999},"max":{"1min":1.22,"5min":1.22,"15min":3.448},"last":0.78600000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72399999999999998,"15min":0.748},"min":{"1min":0.52600000000000002,"5min":0.437,"15min":0.379},"max":{"1min":0.99299999999999999,"5min":2.3559999999999999,"15min":5.617},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.58299999999999996,"5min":0.45800000000000002,"15min":0.40200000000000002},"max":{"1min":0.998,"5min":1.7869999999999999,"15min":2.016},"last":0.97599999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.746,"15min":0.748},"min":{"1min":0.57499999999999996,"5min":0.46500000000000002,"15min":0.44800000000000001},"max":{"1min":0.98399999999999999,"5min":1.9430000000000001,"15min":2.052},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.76100000000000001,"15min":0.77200000000000002},"min":{"1min":0.57599999999999996,"5min":0.48299999999999998,"15min":0.44700000000000001},"max":{"1min":1.262,"5min":2.6629999999999998,"15min":3.5019999999999998},"last":0.82399999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.71599999999999997,"15min":0.76000000000000001},"min":{"1min":0.59199999999999997,"5min":0.48499999999999999,"15min":0.45000000000000001},"max":{"1min":1.03,"5min":1.03,"15min":5.5800000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76000000000000001,"15min":0.80600000000000005},"min":{"1min":0.60099999999999998,"5min":0.496,"15min":0.47099999999999997},"max":{"1min":1.0169999999999999,"5min":1.827,"15min":6.9299999999999997},"last":0.83199999999999996}]},{"osd":4,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.622},"min":{"1min":0.46500000000000002,"5min":0.39500000000000002,"15min":0.35099999999999998},"max":{"1min":0.88200000000000001,"5min":0.95499999999999996,"15min":3.125},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65800000000000003,"15min":0.68000000000000005},"min":{"1min":0.438,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.92400000000000004,"5min":2.577,"15min":4.8380000000000001},"last":0.60699999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68100000000000005,"15min":0.69599999999999995},"min":{"1min":0.47899999999999998,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":0.879,"5min":2.5169999999999999,"15min":4.1929999999999996},"last":0.876},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71099999999999997,"15min":0.73299999999999998},"min":{"1min":0.54300000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.141,"5min":2.9590000000000001,"15min":3.6749999999999998},"last":0.628}]},{"osd":6,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.76700000000000002,"15min":0.78400000000000003},"min":{"1min":0.54100000000000004,"5min":0.498,"15min":0.49199999999999999},"max":{"1min":0.95099999999999996,"5min":3.0019999999999998,"15min":4.0250000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.72599999999999998,"15min":0.77800000000000002},"min":{"1min":0.48799999999999999,"5min":0.47399999999999998,"15min":0.44700000000000001},"max":{"1min":0.84499999999999997,"5min":2.4039999999999999,"15min":7.0259999999999998},"last":0.55200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575029,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302304,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069536,"statfs":{"total":96636764160,"available":96327204864,"internally_reserved":0,"allocated":942080,"data_stored":450777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69699999999999995,"15min":0.71099999999999997},"min":{"1min":0.52100000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85599999999999998,"5min":0.97899999999999998,"15min":1.022},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69099999999999995,"15min":0.70199999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.36599999999999999},"max":{"1min":0.80100000000000005,"5min":0.93899999999999995,"15min":1.079},"last":0.54600000000000004}]},{"osd":1,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70599999999999996,"15min":0.72199999999999998},"min":{"1min":0.47699999999999998,"5min":0.44800000000000001,"15min":0.42799999999999999},"max":{"1min":0.90400000000000003,"5min":1.135,"15min":1.135},"last":0.627},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70599999999999996,"15min":0.72399999999999998},"min":{"1min":0.56899999999999995,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83899999999999997,"5min":1.0109999999999999,"15min":1.034},"last":0.71399999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.58999999999999997,"5min":0.49199999999999999,"15min":0.42599999999999999},"max":{"1min":0.86899999999999999,"5min":1.391,"15min":1.391},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.51900000000000002,"5min":0.48899999999999999,"15min":0.45200000000000001},"max":{"1min":0.85899999999999999,"5min":0.95499999999999996,"15min":1.0900000000000001},"last":0.76500000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68300000000000005,"15min":0.69799999999999995},"min":{"1min":0.52600000000000002,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.82699999999999996,"5min":0.91700000000000004,"15min":1.046},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.497},"max":{"1min":0.86499999999999999,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.73799999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.42099999999999999,"5min":0.38,"15min":0.377},"max":{"1min":0.73399999999999999,"5min":1.768,"15min":1.768},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.437,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77700000000000002,"5min":1.601,"15min":1.601},"last":0.69399999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.46600000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.876,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.68100000000000005,"15min":0.69299999999999995},"min":{"1min":0.47699999999999998,"5min":0.44600000000000001,"15min":0.42299999999999999},"max":{"1min":0.77500000000000002,"5min":0.99299999999999999,"15min":1.0669999999999999},"last":0.83899999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.66600000000000004,"15min":0.67700000000000005},"min":{"1min":0.48699999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79400000000000004,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.45300000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83999999999999997,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.77800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073616,"statfs":{"total":96636764160,"available":96331382784,"internally_reserved":0,"allocated":958464,"data_stored":457547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46100000000000002,"15min":0.45800000000000002},"min":{"1min":0.33100000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66200000000000003,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.48999999999999999,"15min":0.47799999999999998},"min":{"1min":0.34499999999999997,"5min":0.29399999999999998,"15min":0.23699999999999999},"max":{"1min":0.79400000000000004,"5min":1.23,"15min":1.23},"last":0.30399999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.501,"15min":0.49399999999999999},"min":{"1min":0.41599999999999998,"5min":0.32600000000000001,"15min":0.29599999999999999},"max":{"1min":0.70099999999999996,"5min":1.169,"15min":1.169},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58699999999999997,"15min":0.57499999999999996},"min":{"1min":0.44800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":3.077,"15min":3.077},"last":0.46100000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.622,"15min":0.60499999999999998},"min":{"1min":0.54200000000000004,"5min":0.376,"15min":0.34100000000000003},"max":{"1min":0.81200000000000006,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.432},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.45700000000000002,"5min":0.34899999999999998,"15min":0.34100000000000003},"max":{"1min":0.74099999999999999,"5min":1.605,"15min":1.605},"last":0.48199999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.57199999999999995,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0389999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.497},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.77400000000000002,"15min":0.77700000000000002},"min":{"1min":0.60699999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0529999999999999,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.60799999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.57099999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.069,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.77400000000000002,"15min":0.78200000000000003},"min":{"1min":0.63500000000000001,"5min":0.497,"15min":0.47999999999999998},"max":{"1min":1.1040000000000001,"5min":1.637,"15min":1.637},"last":0.59799999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.80300000000000005,"15min":0.79700000000000004},"min":{"1min":0.65300000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.002,"5min":1.696,"15min":1.696},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.79400000000000004,"15min":0.79700000000000004},"min":{"1min":0.66200000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.115,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.65700000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.82399999999999995,"15min":0.82699999999999996},"min":{"1min":0.60699999999999998,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1559999999999999,"5min":1.2669999999999999,"15min":1.4510000000000001},"last":0.62},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.81599999999999995,"15min":0.82599999999999996},"min":{"1min":0.70999999999999996,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.081,"5min":1.125,"15min":1.1970000000000001},"last":0.63500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298804,"kb_used_data":1516,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073036,"statfs":{"total":96636764160,"available":96330788864,"internally_reserved":0,"allocated":1552384,"data_stored":1043235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47999999999999998,"15min":0.47099999999999997},"min":{"1min":0.38200000000000001,"5min":0.27100000000000002,"15min":0.23000000000000001},"max":{"1min":0.63,"5min":0.85799999999999998,"15min":1.2729999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56100000000000005,"15min":0.53800000000000003},"min":{"1min":0.34799999999999998,"5min":0.308,"15min":0.28899999999999998},"max":{"1min":0.73899999999999999,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":0.38300000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58399999999999996,"15min":0.55900000000000005},"min":{"1min":0.39100000000000001,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.68500000000000005,"5min":4.6980000000000004,"15min":4.6980000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.503,"15min":0.497},"min":{"1min":0.36699999999999999,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.64300000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.35199999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.40999999999999998,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":0.76200000000000001,"5min":1.2450000000000001,"15min":1.7130000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63,"15min":0.61799999999999999},"min":{"1min":0.52300000000000002,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":0.73099999999999998,"5min":4.734,"15min":4.734},"last":0.46700000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.76800000000000002,"15min":0.77200000000000002},"min":{"1min":0.69099999999999995,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91700000000000004,"5min":1.2270000000000001,"15min":1.752},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81699999999999995,"15min":0.80900000000000005},"min":{"1min":0.67800000000000005,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0269999999999999,"5min":4.6619999999999999,"15min":4.6619999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.78300000000000003,"15min":0.78000000000000003},"min":{"1min":0.65600000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0349999999999999,"5min":1.1890000000000001,"15min":1.2769999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.64100000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97899999999999998,"5min":1.2809999999999999,"15min":1.7889999999999999},"last":0.70999999999999996}]},{"osd":6,"last update":"Mon Oct 9 06:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.82899999999999996,"15min":0.82299999999999995},"min":{"1min":0.68400000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.046,"5min":4.6239999999999997,"15min":4.6239999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.80400000000000005,"15min":0.80800000000000005},"min":{"1min":0.66500000000000004,"5min":0.50800000000000001,"15min":0.47999999999999998},"max":{"1min":0.99399999999999999,"5min":1.2689999999999999,"15min":1.4370000000000001},"last":0.55600000000000005}]},{"osd":7,"last update":"Mon Oct 9 06:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.83799999999999997,"15min":0.83599999999999997},"min":{"1min":0.58299999999999996,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0760000000000001,"5min":1.256,"15min":1.518},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.84699999999999998,"15min":0.85699999999999998},"min":{"1min":0.76300000000000001,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0369999999999999,"5min":1.702,"15min":1.8200000000000001},"last":0.73599999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575029,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306420,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065420,"statfs":{"total":96636764160,"available":96322990080,"internally_reserved":0,"allocated":962560,"data_stored":457513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.47499999999999998,"15min":0.45900000000000002},"min":{"1min":0.33700000000000002,"5min":0.26500000000000001,"15min":0.25900000000000001},"max":{"1min":0.747,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.502},"min":{"1min":0.40200000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.63100000000000001,"5min":1.633,"15min":1.633},"last":0.34300000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47699999999999998,"15min":0.48799999999999999},"min":{"1min":0.34100000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64900000000000002,"5min":1.097,"15min":1.865},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.41699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.65400000000000003,"5min":1.2689999999999999,"15min":1.79},"last":0.42199999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.59299999999999997},"min":{"1min":0.48399999999999999,"5min":0.38600000000000001,"15min":0.35799999999999998},"max":{"1min":0.75,"5min":0.86699999999999999,"15min":1.8999999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.54300000000000004,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83899999999999997,"5min":1.1890000000000001,"15min":1.8220000000000001},"last":0.48799999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77100000000000002,"15min":0.76200000000000001},"min":{"1min":0.57999999999999996,"5min":0.53200000000000003,"15min":0.42899999999999999},"max":{"1min":1.1379999999999999,"5min":1.2430000000000001,"15min":1.256},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.75800000000000001,"15min":0.76700000000000002},"min":{"1min":0.48799999999999999,"5min":0.45900000000000002,"15min":0.44800000000000001},"max":{"1min":1.171,"5min":1.696,"15min":1.696},"last":0.63800000000000001}]},{"osd":5,"last update":"Mon Oct 9 06:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78200000000000003,"15min":0.77200000000000002},"min":{"1min":0.56100000000000005,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.081,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.77700000000000002,"15min":0.77800000000000002},"min":{"1min":0.625,"5min":0.52500000000000002,"15min":0.503},"max":{"1min":1.0629999999999999,"5min":1.218,"15min":1.3440000000000001},"last":0.75700000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79000000000000004,"15min":0.78500000000000003},"min":{"1min":0.64700000000000002,"5min":0.51000000000000001,"15min":0.48599999999999999},"max":{"1min":1.115,"5min":1.768,"15min":1.768},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79300000000000004,"15min":0.79700000000000004},"min":{"1min":0.61399999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.026,"5min":1.3580000000000001,"15min":1.5309999999999999},"last":0.70799999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80800000000000005,"15min":0.80600000000000005},"min":{"1min":0.57499999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0389999999999999,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82499999999999996,"15min":0.82699999999999996},"min":{"1min":0.69799999999999995,"5min":0.57599999999999996,"15min":0.50900000000000001},"max":{"1min":1.0409999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.80000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575030,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306408,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065432,"statfs":{"total":96636764160,"available":96323002368,"internally_reserved":0,"allocated":950272,"data_stored":450833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48099999999999998,"15min":0.46800000000000003},"min":{"1min":0.32300000000000001,"5min":0.29499999999999998,"15min":0.24099999999999999},"max":{"1min":0.78100000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.496,"15min":0.48699999999999999},"min":{"1min":0.32300000000000001,"5min":0.30199999999999999,"15min":0.28100000000000003},"max":{"1min":0.625,"5min":1.228,"15min":1.228},"last":0.63600000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48999999999999999,"15min":0.48099999999999998},"min":{"1min":0.36699999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63100000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.499},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.44800000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.70799999999999996,"5min":0.83399999999999996,"15min":0.85899999999999999},"last":0.52000000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58699999999999997,"15min":0.57699999999999996},"min":{"1min":0.45100000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.69499999999999995,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65000000000000002,"15min":0.628},"min":{"1min":0.53100000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.75900000000000001,"5min":3.8900000000000001,"15min":3.8900000000000001},"last":0.68100000000000005}]},{"osd":4,"last update":"Mon Oct 9 06:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.77300000000000002,"15min":0.748},"min":{"1min":0.57199999999999995,"5min":0.48299999999999998,"15min":0.40799999999999997},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.874,"5min":0.83899999999999997,"15min":0.82499999999999996},"min":{"1min":0.72399999999999998,"5min":0.59399999999999997,"15min":0.52200000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.752}]},{"osd":5,"last update":"Mon Oct 9 06:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.75,"15min":0.746},"min":{"1min":0.56299999999999994,"5min":0.441,"15min":0.441},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":2.1549999999999998},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.80100000000000005,"15min":0.80000000000000004},"min":{"1min":0.67800000000000005,"5min":0.55900000000000005,"15min":0.50600000000000001},"max":{"1min":1.1519999999999999,"5min":1.1639999999999999,"15min":1.419},"last":0.82999999999999996}]},{"osd":6,"last update":"Mon Oct 9 06:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.79000000000000004,"15min":0.77900000000000003},"min":{"1min":0.65700000000000003,"5min":0.53000000000000003,"15min":0.51700000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.875},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79700000000000004,"15min":0.77800000000000002},"min":{"1min":0.63800000000000001,"5min":0.54400000000000004,"15min":0.51500000000000001},"max":{"1min":1.1160000000000001,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84199999999999997,"15min":0.82399999999999995},"min":{"1min":0.67900000000000005,"5min":0.56000000000000005,"15min":0.55500000000000005},"max":{"1min":1.2629999999999999,"5min":1.8180000000000001,"15min":2.0880000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.84399999999999997,"15min":0.82999999999999996},"min":{"1min":0.627,"5min":0.57499999999999996,"15min":0.56499999999999995},"max":{"1min":1.1919999999999999,"5min":1.486,"15min":1.486},"last":0.84299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575029,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310520,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061320,"statfs":{"total":96636764160,"available":96318791680,"internally_reserved":0,"allocated":966656,"data_stored":458993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73199999999999998,"15min":0.70399999999999996},"min":{"1min":0.52500000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.96699999999999997,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73299999999999998,"15min":0.71999999999999997},"min":{"1min":0.53900000000000003,"5min":0.42699999999999999,"15min":0.39300000000000002},"max":{"1min":0.94399999999999995,"5min":2.8130000000000002,"15min":3.23},"last":0.77500000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73199999999999998,"15min":0.71199999999999997},"min":{"1min":0.60499999999999998,"5min":0.45800000000000002,"15min":0.373},"max":{"1min":0.86099999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77400000000000002,"15min":0.74299999999999999},"min":{"1min":0.623,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.97299999999999998,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.749}]},{"osd":2,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77600000000000002,"15min":0.76000000000000001},"min":{"1min":0.54800000000000004,"5min":0.45900000000000002,"15min":0.38100000000000001},"max":{"1min":1.0089999999999999,"5min":2.5960000000000001,"15min":3.7509999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.79500000000000004,"15min":0.78200000000000003},"min":{"1min":0.64200000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92100000000000004,"5min":2.427,"15min":2.427},"last":0.89000000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76100000000000001,"15min":0.753},"min":{"1min":0.68000000000000005,"5min":0.434,"15min":0.434},"max":{"1min":0.83999999999999997,"5min":2.6440000000000001,"15min":3.6970000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78600000000000003,"15min":0.747},"min":{"1min":0.54900000000000004,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0289999999999999,"5min":3.6899999999999999,"15min":3.6899999999999999},"last":0.91500000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63300000000000001,"15min":0.61499999999999999},"min":{"1min":0.442,"5min":0.317,"15min":0.317},"max":{"1min":0.82999999999999996,"5min":3.3860000000000001,"15min":3.4780000000000002},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.68600000000000005,"15min":0.66500000000000004},"min":{"1min":0.44800000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.89900000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.60299999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.66500000000000004,"15min":0.64700000000000002},"min":{"1min":0.42299999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76700000000000002,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71499999999999997,"15min":0.68500000000000005},"min":{"1min":0.442,"5min":0.41699999999999998,"15min":0.374},"max":{"1min":0.92300000000000004,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.69099999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73699999999999999,"15min":0.72899999999999998},"min":{"1min":0.44,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90300000000000002,"5min":2.7210000000000001,"15min":3.2789999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.79200000000000004,"15min":0.77700000000000002},"min":{"1min":0.53700000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.98999999999999999,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.93600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575030,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302324,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069516,"statfs":{"total":96636764160,"available":96327184384,"internally_reserved":0,"allocated":962560,"data_stored":458081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.34899999999999998,"15min":0.30599999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.655},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.67400000000000004,"15min":0.68899999999999995},"min":{"1min":0.40000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.1359999999999999},"last":0.78200000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68200000000000005,"15min":0.70699999999999996},"min":{"1min":0.57199999999999995,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88300000000000001,"5min":0.96899999999999997,"15min":2.4159999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.71499999999999997,"15min":0.72899999999999998},"min":{"1min":0.47299999999999998,"5min":0.44,"15min":0.40400000000000003},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.706},"last":0.67400000000000004}]},{"osd":2,"last update":"Mon Oct 9 06:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71799999999999997,"15min":0.73799999999999999},"min":{"1min":0.57499999999999996,"5min":0.48499999999999999,"15min":0.42999999999999999},"max":{"1min":0.997,"5min":0.997,"15min":1.79},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.70599999999999996,"15min":0.72599999999999998},"min":{"1min":0.53700000000000003,"5min":0.44900000000000001,"15min":0.442},"max":{"1min":0.96499999999999997,"5min":1.006,"15min":2.4889999999999999},"last":0.64100000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.69899999999999995,"15min":0.72299999999999998},"min":{"1min":0.48999999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.97799999999999998,"5min":1.0209999999999999,"15min":1.409},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.755,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.501,"15min":0.501},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":2.532},"last":0.76700000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.61599999999999999},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81799999999999995,"5min":0.90700000000000003,"15min":1.766},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61799999999999999,"15min":0.63400000000000001},"min":{"1min":0.41199999999999998,"5min":0.377,"15min":0.35799999999999998},"max":{"1min":0.79500000000000004,"5min":1.052,"15min":2.7829999999999999},"last":0.73599999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63600000000000001,"15min":0.65000000000000002},"min":{"1min":0.41099999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82599999999999996,"5min":1.018,"15min":2.5739999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66400000000000003,"15min":0.68200000000000005},"min":{"1min":0.45600000000000002,"5min":0.40000000000000002,"15min":0.38900000000000001},"max":{"1min":0.89900000000000002,"5min":0.97999999999999998,"15min":1.8080000000000001},"last":0.80600000000000005}]},{"osd":7,"last update":"Mon Oct 9 06:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68300000000000005,"15min":0.70199999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.436},"max":{"1min":0.93700000000000006,"5min":1.175,"15min":2.9609999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76500000000000001,"15min":0.78400000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.45900000000000002},"max":{"1min":1.0089999999999999,"5min":1.139,"15min":2.613},"last":0.85599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:57:33.138 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:57:33.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.360+0000 7fdad45ff700 1 Processor -- start 2023-10-09T06:57:33.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.360+0000 7fdad45ff700 1 -- start start 2023-10-09T06:57:33.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.361+0000 7fdad45ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdacc155c10 0x7fdacc155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:33.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.361+0000 7fdad45ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdacc0ac230 0x7fdacc0ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:33.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.361+0000 7fdad45ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdacc1568a0 0x7fdacc156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:33.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.361+0000 7fdad45ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdacc0ad930 con 0x7fdacc1568a0 2023-10-09T06:57:33.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.361+0000 7fdad45ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdacc0acd20 con 0x7fdacc155c10 2023-10-09T06:57:33.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.361+0000 7fdad45ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc0ad000 con 0x7fdacc0ac230 2023-10-09T06:57:33.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.362+0000 7fdad2b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdacc1568a0 0x7fdacc156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:33.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.362+0000 7fdad2b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdacc1568a0 0x7fdacc156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34134/0 (socket says 172.21.15.71:34134) 2023-10-09T06:57:33.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.362+0000 7fdad2b9c700 1 -- 172.21.15.71:0/3472784017 learned_addr learned my addr 172.21.15.71:0/3472784017 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:33.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.362+0000 7fdad1b9a700 1 --2- 172.21.15.71:0/3472784017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdacc0ac230 0x7fdacc0ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:33.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.362+0000 7fdad239b700 1 --2- 172.21.15.71:0/3472784017 >> v2:172.21.15.179:3300/0 conn(0x7fdacc155c10 0x7fdacc155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:33.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.362+0000 7fdad2b9c700 1 -- 172.21.15.71:0/3472784017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdacc0ac230 msgr2=0x7fdacc0ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:33.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.362+0000 7fdad2b9c700 1 --2- 172.21.15.71:0/3472784017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdacc0ac230 0x7fdacc0ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:33.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.362+0000 7fdad2b9c700 1 -- 172.21.15.71:0/3472784017 >> v2:172.21.15.179:3300/0 conn(0x7fdacc155c10 msgr2=0x7fdacc155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:33.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.362+0000 7fdad2b9c700 1 --2- 172.21.15.71:0/3472784017 >> v2:172.21.15.179:3300/0 conn(0x7fdacc155c10 0x7fdacc155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:33.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.362+0000 7fdad2b9c700 1 -- 172.21.15.71:0/3472784017 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc0ad2e0 con 0x7fdacc1568a0 2023-10-09T06:57:33.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.362+0000 7fdad2b9c700 1 --2- 172.21.15.71:0/3472784017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdacc1568a0 0x7fdacc156cc0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fdacc063d40 tx=0x7fdac400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103ee338e0742bcb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:33.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.363+0000 7fdad1399700 1 -- 172.21.15.71:0/3472784017 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4010070 con 0x7fdacc1568a0 2023-10-09T06:57:33.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.363+0000 7fdad1399700 1 -- 172.21.15.71:0/3472784017 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac400dd30 con 0x7fdacc1568a0 2023-10-09T06:57:33.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.363+0000 7fdad1399700 1 -- 172.21.15.71:0/3472784017 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac400dea0 con 0x7fdacc1568a0 2023-10-09T06:57:33.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.363+0000 7fdad45ff700 1 -- 172.21.15.71:0/3472784017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdacc1568a0 msgr2=0x7fdacc156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:33.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.363+0000 7fdad45ff700 1 --2- 172.21.15.71:0/3472784017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdacc1568a0 0x7fdacc156cc0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fdacc063d40 tx=0x7fdac400ba50 comp rx=0 tx=0).stop 2023-10-09T06:57:33.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.363+0000 7fdad45ff700 1 -- 172.21.15.71:0/3472784017 shutdown_connections 2023-10-09T06:57:33.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.363+0000 7fdad45ff700 1 --2- 172.21.15.71:0/3472784017 >> v2:172.21.15.179:3300/0 conn(0x7fdacc155c10 0x7fdacc155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:33.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.363+0000 7fdad45ff700 1 --2- 172.21.15.71:0/3472784017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdacc1568a0 0x7fdacc156cc0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:33.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.363+0000 7fdad45ff700 1 --2- 172.21.15.71:0/3472784017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdacc0ac230 0x7fdacc0ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:33.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.363+0000 7fdad45ff700 1 -- 172.21.15.71:0/3472784017 >> 172.21.15.71:0/3472784017 conn(0x7fdacc06a320 msgr2=0x7fdacc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:33.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.363+0000 7fdad45ff700 1 -- 172.21.15.71:0/3472784017 shutdown_connections 2023-10-09T06:57:33.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.363+0000 7fdad45ff700 1 -- 172.21.15.71:0/3472784017 wait complete. 2023-10-09T06:57:33.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.365+0000 7fdad45ff700 1 Processor -- start 2023-10-09T06:57:33.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.365+0000 7fdad45ff700 1 -- start start 2023-10-09T06:57:33.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.366+0000 7fdad45ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdacc0ac230 0x7fdacc15cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:33.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.366+0000 7fdad45ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdacc155c10 0x7fdacc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:33.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.366+0000 7fdad45ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdacc1568a0 0x7fdacc15dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:33.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.366+0000 7fdad45ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc15e620 con 0x7fdacc155c10 2023-10-09T06:57:33.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.366+0000 7fdad45ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc15bd60 con 0x7fdacc1568a0 2023-10-09T06:57:33.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.366+0000 7fdad45ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc15c040 con 0x7fdacc0ac230 2023-10-09T06:57:33.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.366+0000 7fdad1b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdacc155c10 0x7fdacc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:33.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.366+0000 7fdad1b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdacc155c10 0x7fdacc06e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34142/0 (socket says 172.21.15.71:34142) 2023-10-09T06:57:33.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.366+0000 7fdad1b9a700 1 -- 172.21.15.71:0/1696102980 learned_addr learned my addr 172.21.15.71:0/1696102980 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:33.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.366+0000 7fdad239b700 1 --2- 172.21.15.71:0/1696102980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdacc0ac230 0x7fdacc15cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:33.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.366+0000 7fdad2b9c700 1 --2- 172.21.15.71:0/1696102980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdacc1568a0 0x7fdacc15dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:33.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.366+0000 7fdad1b9a700 1 -- 172.21.15.71:0/1696102980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdacc0ac230 msgr2=0x7fdacc15cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:33.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.366+0000 7fdad1b9a700 1 --2- 172.21.15.71:0/1696102980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdacc0ac230 0x7fdacc15cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:33.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.366+0000 7fdad1b9a700 1 -- 172.21.15.71:0/1696102980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdacc1568a0 msgr2=0x7fdacc15dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:33.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.366+0000 7fdad1b9a700 1 --2- 172.21.15.71:0/1696102980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdacc1568a0 0x7fdacc15dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:33.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.366+0000 7fdad1b9a700 1 -- 172.21.15.71:0/1696102980 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac400bcf0 con 0x7fdacc155c10 2023-10-09T06:57:33.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.367+0000 7fdad1b9a700 1 --2- 172.21.15.71:0/1696102980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdacc155c10 0x7fdacc06e340 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fdabc00ec80 tx=0x7fdabc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:33.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.367+0000 7fdac27fc700 1 -- 172.21.15.71:0/1696102980 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc00c9d0 con 0x7fdacc155c10 2023-10-09T06:57:33.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.367+0000 7fdac27fc700 1 -- 172.21.15.71:0/1696102980 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc00cb30 con 0x7fdacc155c10 2023-10-09T06:57:33.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.367+0000 7fdad45ff700 1 -- 172.21.15.71:0/1696102980 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdacc15c320 con 0x7fdacc155c10 2023-10-09T06:57:33.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.367+0000 7fdac27fc700 1 -- 172.21.15.71:0/1696102980 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc013470 con 0x7fdacc155c10 2023-10-09T06:57:33.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.367+0000 7fdad45ff700 1 -- 172.21.15.71:0/1696102980 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdacc15d060 con 0x7fdacc155c10 2023-10-09T06:57:33.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.368+0000 7fdad45ff700 1 -- 172.21.15.71:0/1696102980 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdacc04c3c0 con 0x7fdacc155c10 2023-10-09T06:57:33.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.369+0000 7fdac27fc700 1 -- 172.21.15.71:0/1696102980 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdabc013820 con 0x7fdacc155c10 2023-10-09T06:57:33.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.370+0000 7fdac27fc700 1 --2- 172.21.15.71:0/1696102980 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdab0066f30 0x7fdab00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:33.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.370+0000 7fdac27fc700 1 -- 172.21.15.71:0/1696102980 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fdabc084af0 con 0x7fdacc155c10 2023-10-09T06:57:33.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.370+0000 7fdad239b700 1 --2- 172.21.15.71:0/1696102980 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdab0066f30 0x7fdab00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:33.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.371+0000 7fdad239b700 1 --2- 172.21.15.71:0/1696102980 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdab0066f30 0x7fdab00693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009d40 tx=0x7fdac8008040 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:33.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.374+0000 7fdac27fc700 1 -- 172.21.15.71:0/1696102980 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdabc051b30 con 0x7fdacc155c10 2023-10-09T06:57:33.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.560+0000 7fdad45ff700 1 -- 172.21.15.71:0/1696102980 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdacc0ad5c0 con 0x7fdab0066f30 2023-10-09T06:57:33.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.569+0000 7fdac27fc700 1 -- 172.21.15.71:0/1696102980 <== mgr.5351 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288953 (secure 0 0 0) 0x7fdacc0ad5c0 con 0x7fdab0066f30 2023-10-09T06:57:33.571 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:33.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.573+0000 7fdad45ff700 1 -- 172.21.15.71:0/1696102980 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdab0066f30 msgr2=0x7fdab00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:33.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.573+0000 7fdad45ff700 1 --2- 172.21.15.71:0/1696102980 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdab0066f30 0x7fdab00693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009d40 tx=0x7fdac8008040 comp rx=0 tx=0).stop 2023-10-09T06:57:33.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.573+0000 7fdad45ff700 1 -- 172.21.15.71:0/1696102980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdacc155c10 msgr2=0x7fdacc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:33.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.573+0000 7fdad45ff700 1 --2- 172.21.15.71:0/1696102980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdacc155c10 0x7fdacc06e340 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fdabc00ec80 tx=0x7fdabc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:33.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.573+0000 7fdad45ff700 1 -- 172.21.15.71:0/1696102980 shutdown_connections 2023-10-09T06:57:33.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.573+0000 7fdad45ff700 1 --2- 172.21.15.71:0/1696102980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdacc1568a0 0x7fdacc15dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:33.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.573+0000 7fdad45ff700 1 --2- 172.21.15.71:0/1696102980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdacc0ac230 0x7fdacc15cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:33.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.573+0000 7fdad45ff700 1 --2- 172.21.15.71:0/1696102980 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdab0066f30 0x7fdab00693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:33.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.573+0000 7fdad45ff700 1 --2- 172.21.15.71:0/1696102980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdacc155c10 0x7fdacc06e340 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:33.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.573+0000 7fdad45ff700 1 -- 172.21.15.71:0/1696102980 >> 172.21.15.71:0/1696102980 conn(0x7fdacc06a320 msgr2=0x7fdacc14f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:33.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.574+0000 7fdad45ff700 1 -- 172.21.15.71:0/1696102980 shutdown_connections 2023-10-09T06:57:33.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.574+0000 7fdad45ff700 1 -- 172.21.15.71:0/1696102980 wait complete. 2023-10-09T06:57:33.580 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:57:33.591 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-09T06:57:32.041489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":283,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":161,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427896,"kb_used_data":8632,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752546824,"statfs":{"total":773094113280,"available":770607947776,"internally_reserved":0,"allocated":8839168,"data_stored":4818284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.246628"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.782308+0000","last_change":"2023-10-09T06:57:28.779265+0000","last_active":"2023-10-09T06:57:28.782308+0000","last_peered":"2023-10-09T06:57:28.782308+0000","last_clean":"2023-10-09T06:57:28.782308+0000","last_became_active":"2023-10-09T06:57:28.778873+0000","last_became_peered":"2023-10-09T06:57:28.778873+0000","last_unstale":"2023-10-09T06:57:28.782308+0000","last_undegraded":"2023-10-09T06:57:28.782308+0000","last_fullsized":"2023-10-09T06:57:28.782308+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:05:08.914279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.787428+0000","last_change":"2023-10-09T06:57:28.784358+0000","last_active":"2023-10-09T06:57:28.787428+0000","last_peered":"2023-10-09T06:57:28.787428+0000","last_clean":"2023-10-09T06:57:28.787428+0000","last_became_active":"2023-10-09T06:57:28.783757+0000","last_became_peered":"2023-10-09T06:57:28.783757+0000","last_unstale":"2023-10-09T06:57:28.787428+0000","last_undegraded":"2023-10-09T06:57:28.787428+0000","last_fullsized":"2023-10-09T06:57:28.787428+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:01:11.013314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.777481+0000","last_change":"2023-10-09T06:57:28.773901+0000","last_active":"2023-10-09T06:57:28.777481+0000","last_peered":"2023-10-09T06:57:28.777481+0000","last_clean":"2023-10-09T06:57:28.777481+0000","last_became_active":"2023-10-09T06:57:28.773583+0000","last_became_peered":"2023-10-09T06:57:28.773583+0000","last_unstale":"2023-10-09T06:57:28.777481+0000","last_undegraded":"2023-10-09T06:57:28.777481+0000","last_fullsized":"2023-10-09T06:57:28.777481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:40.665952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.780472+0000","last_change":"2023-10-09T06:57:28.774732+0000","last_active":"2023-10-09T06:57:28.780472+0000","last_peered":"2023-10-09T06:57:28.780472+0000","last_clean":"2023-10-09T06:57:28.780472+0000","last_became_active":"2023-10-09T06:57:28.774468+0000","last_became_peered":"2023-10-09T06:57:28.774468+0000","last_unstale":"2023-10-09T06:57:28.780472+0000","last_undegraded":"2023-10-09T06:57:28.780472+0000","last_fullsized":"2023-10-09T06:57:28.780472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:27:15.264158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.771217+0000","last_change":"2023-10-09T06:57:28.769484+0000","last_active":"2023-10-09T06:57:28.771217+0000","last_peered":"2023-10-09T06:57:28.771217+0000","last_clean":"2023-10-09T06:57:28.771217+0000","last_became_active":"2023-10-09T06:57:28.769190+0000","last_became_peered":"2023-10-09T06:57:28.769190+0000","last_unstale":"2023-10-09T06:57:28.771217+0000","last_undegraded":"2023-10-09T06:57:28.771217+0000","last_fullsized":"2023-10-09T06:57:28.771217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:12:17.608271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.785731+0000","last_change":"2023-10-09T06:57:28.781191+0000","last_active":"2023-10-09T06:57:28.785731+0000","last_peered":"2023-10-09T06:57:28.785731+0000","last_clean":"2023-10-09T06:57:28.785731+0000","last_became_active":"2023-10-09T06:57:28.780933+0000","last_became_peered":"2023-10-09T06:57:28.780933+0000","last_unstale":"2023-10-09T06:57:28.785731+0000","last_undegraded":"2023-10-09T06:57:28.785731+0000","last_fullsized":"2023-10-09T06:57:28.785731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:28.363380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.767432+0000","last_change":"2023-10-09T06:57:28.765143+0000","last_active":"2023-10-09T06:57:28.767432+0000","last_peered":"2023-10-09T06:57:28.767432+0000","last_clean":"2023-10-09T06:57:28.767432+0000","last_became_active":"2023-10-09T06:57:28.764884+0000","last_became_peered":"2023-10-09T06:57:28.764884+0000","last_unstale":"2023-10-09T06:57:28.767432+0000","last_undegraded":"2023-10-09T06:57:28.767432+0000","last_fullsized":"2023-10-09T06:57:28.767432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:51:14.511810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.784465+0000","last_change":"2023-10-09T06:57:28.775020+0000","last_active":"2023-10-09T06:57:28.784465+0000","last_peered":"2023-10-09T06:57:28.784465+0000","last_clean":"2023-10-09T06:57:28.784465+0000","last_became_active":"2023-10-09T06:57:28.774778+0000","last_became_peered":"2023-10-09T06:57:28.774778+0000","last_unstale":"2023-10-09T06:57:28.784465+0000","last_undegraded":"2023-10-09T06:57:28.784465+0000","last_fullsized":"2023-10-09T06:57:28.784465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:42:43.500230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.782281+0000","last_change":"2023-10-09T06:57:28.781080+0000","last_active":"2023-10-09T06:57:28.782281+0000","last_peered":"2023-10-09T06:57:28.782281+0000","last_clean":"2023-10-09T06:57:28.782281+0000","last_became_active":"2023-10-09T06:57:28.780824+0000","last_became_peered":"2023-10-09T06:57:28.780824+0000","last_unstale":"2023-10-09T06:57:28.782281+0000","last_undegraded":"2023-10-09T06:57:28.782281+0000","last_fullsized":"2023-10-09T06:57:28.782281+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:34:47.304040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.780334+0000","last_change":"2023-10-09T06:57:28.772288+0000","last_active":"2023-10-09T06:57:28.780334+0000","last_peered":"2023-10-09T06:57:28.780334+0000","last_clean":"2023-10-09T06:57:28.780334+0000","last_became_active":"2023-10-09T06:57:28.772025+0000","last_became_peered":"2023-10-09T06:57:28.772025+0000","last_unstale":"2023-10-09T06:57:28.780334+0000","last_undegraded":"2023-10-09T06:57:28.780334+0000","last_fullsized":"2023-10-09T06:57:28.780334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:06.360677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.785778+0000","last_change":"2023-10-09T06:57:28.780584+0000","last_active":"2023-10-09T06:57:28.785778+0000","last_peered":"2023-10-09T06:57:28.785778+0000","last_clean":"2023-10-09T06:57:28.785778+0000","last_became_active":"2023-10-09T06:57:28.780291+0000","last_became_peered":"2023-10-09T06:57:28.780291+0000","last_unstale":"2023-10-09T06:57:28.785778+0000","last_undegraded":"2023-10-09T06:57:28.785778+0000","last_fullsized":"2023-10-09T06:57:28.785778+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:23.825749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.780452+0000","last_change":"2023-10-09T06:57:28.772765+0000","last_active":"2023-10-09T06:57:28.780452+0000","last_peered":"2023-10-09T06:57:28.780452+0000","last_clean":"2023-10-09T06:57:28.780452+0000","last_became_active":"2023-10-09T06:57:28.772403+0000","last_became_peered":"2023-10-09T06:57:28.772403+0000","last_unstale":"2023-10-09T06:57:28.780452+0000","last_undegraded":"2023-10-09T06:57:28.780452+0000","last_fullsized":"2023-10-09T06:57:28.780452+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:40:11.649322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.779008+0000","last_change":"2023-10-09T06:57:28.776015+0000","last_active":"2023-10-09T06:57:28.779008+0000","last_peered":"2023-10-09T06:57:28.779008+0000","last_clean":"2023-10-09T06:57:28.779008+0000","last_became_active":"2023-10-09T06:57:28.775272+0000","last_became_peered":"2023-10-09T06:57:28.775272+0000","last_unstale":"2023-10-09T06:57:28.779008+0000","last_undegraded":"2023-10-09T06:57:28.779008+0000","last_fullsized":"2023-10-09T06:57:28.779008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:10:24.179254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.781660+0000","last_change":"2023-10-09T06:57:28.779614+0000","last_active":"2023-10-09T06:57:28.781660+0000","last_peered":"2023-10-09T06:57:28.781660+0000","last_clean":"2023-10-09T06:57:28.781660+0000","last_became_active":"2023-10-09T06:57:28.779356+0000","last_became_peered":"2023-10-09T06:57:28.779356+0000","last_unstale":"2023-10-09T06:57:28.781660+0000","last_undegraded":"2023-10-09T06:57:28.781660+0000","last_fullsized":"2023-10-09T06:57:28.781660+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:31.152074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.773506+0000","last_change":"2023-10-09T06:57:28.770931+0000","last_active":"2023-10-09T06:57:28.773506+0000","last_peered":"2023-10-09T06:57:28.773506+0000","last_clean":"2023-10-09T06:57:28.773506+0000","last_became_active":"2023-10-09T06:57:28.770676+0000","last_became_peered":"2023-10-09T06:57:28.770676+0000","last_unstale":"2023-10-09T06:57:28.773506+0000","last_undegraded":"2023-10-09T06:57:28.773506+0000","last_fullsized":"2023-10-09T06:57:28.773506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:05.775143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.785224+0000","last_change":"2023-10-09T06:57:28.773865+0000","last_active":"2023-10-09T06:57:28.785224+0000","last_peered":"2023-10-09T06:57:28.785224+0000","last_clean":"2023-10-09T06:57:28.785224+0000","last_became_active":"2023-10-09T06:57:28.773600+0000","last_became_peered":"2023-10-09T06:57:28.773600+0000","last_unstale":"2023-10-09T06:57:28.785224+0000","last_undegraded":"2023-10-09T06:57:28.785224+0000","last_fullsized":"2023-10-09T06:57:28.785224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:35.883463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.784982+0000","last_change":"2023-10-09T06:57:28.777871+0000","last_active":"2023-10-09T06:57:28.784982+0000","last_peered":"2023-10-09T06:57:28.784982+0000","last_clean":"2023-10-09T06:57:28.784982+0000","last_became_active":"2023-10-09T06:57:28.777620+0000","last_became_peered":"2023-10-09T06:57:28.777620+0000","last_unstale":"2023-10-09T06:57:28.784982+0000","last_undegraded":"2023-10-09T06:57:28.784982+0000","last_fullsized":"2023-10-09T06:57:28.784982+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:48.749070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.781601+0000","last_change":"2023-10-09T06:57:28.777462+0000","last_active":"2023-10-09T06:57:28.781601+0000","last_peered":"2023-10-09T06:57:28.781601+0000","last_clean":"2023-10-09T06:57:28.781601+0000","last_became_active":"2023-10-09T06:57:28.776548+0000","last_became_peered":"2023-10-09T06:57:28.776548+0000","last_unstale":"2023-10-09T06:57:28.781601+0000","last_undegraded":"2023-10-09T06:57:28.781601+0000","last_fullsized":"2023-10-09T06:57:28.781601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:19:08.486388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.779903+0000","last_change":"2023-10-09T06:57:28.778502+0000","last_active":"2023-10-09T06:57:28.779903+0000","last_peered":"2023-10-09T06:57:28.779903+0000","last_clean":"2023-10-09T06:57:28.779903+0000","last_became_active":"2023-10-09T06:57:28.778187+0000","last_became_peered":"2023-10-09T06:57:28.778187+0000","last_unstale":"2023-10-09T06:57:28.779903+0000","last_undegraded":"2023-10-09T06:57:28.779903+0000","last_fullsized":"2023-10-09T06:57:28.779903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:51:42.386711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.784648+0000","last_change":"2023-10-09T06:57:28.779276+0000","last_active":"2023-10-09T06:57:28.784648+0000","last_peered":"2023-10-09T06:57:28.784648+0000","last_clean":"2023-10-09T06:57:28.784648+0000","last_became_active":"2023-10-09T06:57:28.778989+0000","last_became_peered":"2023-10-09T06:57:28.778989+0000","last_unstale":"2023-10-09T06:57:28.784648+0000","last_undegraded":"2023-10-09T06:57:28.784648+0000","last_fullsized":"2023-10-09T06:57:28.784648+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:02.031349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.781979+0000","last_change":"2023-10-09T06:57:28.781195+0000","last_active":"2023-10-09T06:57:28.781979+0000","last_peered":"2023-10-09T06:57:28.781979+0000","last_clean":"2023-10-09T06:57:28.781979+0000","last_became_active":"2023-10-09T06:57:28.780913+0000","last_became_peered":"2023-10-09T06:57:28.780913+0000","last_unstale":"2023-10-09T06:57:28.781979+0000","last_undegraded":"2023-10-09T06:57:28.781979+0000","last_fullsized":"2023-10-09T06:57:28.781979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:05:19.232519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.786539+0000","last_change":"2023-10-09T06:57:28.782651+0000","last_active":"2023-10-09T06:57:28.786539+0000","last_peered":"2023-10-09T06:57:28.786539+0000","last_clean":"2023-10-09T06:57:28.786539+0000","last_became_active":"2023-10-09T06:57:28.782373+0000","last_became_peered":"2023-10-09T06:57:28.782373+0000","last_unstale":"2023-10-09T06:57:28.786539+0000","last_undegraded":"2023-10-09T06:57:28.786539+0000","last_fullsized":"2023-10-09T06:57:28.786539+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:49:01.635714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.785579+0000","last_change":"2023-10-09T06:57:28.784831+0000","last_active":"2023-10-09T06:57:28.785579+0000","last_peered":"2023-10-09T06:57:28.785579+0000","last_clean":"2023-10-09T06:57:28.785579+0000","last_became_active":"2023-10-09T06:57:28.784576+0000","last_became_peered":"2023-10-09T06:57:28.784576+0000","last_unstale":"2023-10-09T06:57:28.785579+0000","last_undegraded":"2023-10-09T06:57:28.785579+0000","last_fullsized":"2023-10-09T06:57:28.785579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:42.960559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.777935+0000","last_change":"2023-10-09T06:57:28.776194+0000","last_active":"2023-10-09T06:57:28.777935+0000","last_peered":"2023-10-09T06:57:28.777935+0000","last_clean":"2023-10-09T06:57:28.777935+0000","last_became_active":"2023-10-09T06:57:28.774585+0000","last_became_peered":"2023-10-09T06:57:28.774585+0000","last_unstale":"2023-10-09T06:57:28.777935+0000","last_undegraded":"2023-10-09T06:57:28.777935+0000","last_fullsized":"2023-10-09T06:57:28.777935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:37.782231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.779875+0000","last_change":"2023-10-09T06:57:28.778240+0000","last_active":"2023-10-09T06:57:28.779875+0000","last_peered":"2023-10-09T06:57:28.779875+0000","last_clean":"2023-10-09T06:57:28.779875+0000","last_became_active":"2023-10-09T06:57:28.777955+0000","last_became_peered":"2023-10-09T06:57:28.777955+0000","last_unstale":"2023-10-09T06:57:28.779875+0000","last_undegraded":"2023-10-09T06:57:28.779875+0000","last_fullsized":"2023-10-09T06:57:28.779875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:11:04.743241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.777137+0000","last_change":"2023-10-09T06:57:28.764966+0000","last_active":"2023-10-09T06:57:28.777137+0000","last_peered":"2023-10-09T06:57:28.777137+0000","last_clean":"2023-10-09T06:57:28.777137+0000","last_became_active":"2023-10-09T06:57:28.764658+0000","last_became_peered":"2023-10-09T06:57:28.764658+0000","last_unstale":"2023-10-09T06:57:28.777137+0000","last_undegraded":"2023-10-09T06:57:28.777137+0000","last_fullsized":"2023-10-09T06:57:28.777137+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:30:03.448770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.785611+0000","last_change":"2023-10-09T06:57:28.774575+0000","last_active":"2023-10-09T06:57:28.785611+0000","last_peered":"2023-10-09T06:57:28.785611+0000","last_clean":"2023-10-09T06:57:28.785611+0000","last_became_active":"2023-10-09T06:57:28.774260+0000","last_became_peered":"2023-10-09T06:57:28.774260+0000","last_unstale":"2023-10-09T06:57:28.785611+0000","last_undegraded":"2023-10-09T06:57:28.785611+0000","last_fullsized":"2023-10-09T06:57:28.785611+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:29.971439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.774686+0000","last_change":"2023-10-09T06:57:28.773808+0000","last_active":"2023-10-09T06:57:28.774686+0000","last_peered":"2023-10-09T06:57:28.774686+0000","last_clean":"2023-10-09T06:57:28.774686+0000","last_became_active":"2023-10-09T06:57:28.773162+0000","last_became_peered":"2023-10-09T06:57:28.773162+0000","last_unstale":"2023-10-09T06:57:28.774686+0000","last_undegraded":"2023-10-09T06:57:28.774686+0000","last_fullsized":"2023-10-09T06:57:28.774686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:16.799727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.786576+0000","last_change":"2023-10-09T06:57:28.783075+0000","last_active":"2023-10-09T06:57:28.786576+0000","last_peered":"2023-10-09T06:57:28.786576+0000","last_clean":"2023-10-09T06:57:28.786576+0000","last_became_active":"2023-10-09T06:57:28.782830+0000","last_became_peered":"2023-10-09T06:57:28.782830+0000","last_unstale":"2023-10-09T06:57:28.786576+0000","last_undegraded":"2023-10-09T06:57:28.786576+0000","last_fullsized":"2023-10-09T06:57:28.786576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:00.375449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.778076+0000","last_change":"2023-10-09T06:57:28.773047+0000","last_active":"2023-10-09T06:57:28.778076+0000","last_peered":"2023-10-09T06:57:28.778076+0000","last_clean":"2023-10-09T06:57:28.778076+0000","last_became_active":"2023-10-09T06:57:28.772776+0000","last_became_peered":"2023-10-09T06:57:28.772776+0000","last_unstale":"2023-10-09T06:57:28.778076+0000","last_undegraded":"2023-10-09T06:57:28.778076+0000","last_fullsized":"2023-10-09T06:57:28.778076+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:45:18.416489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.782334+0000","last_change":"2023-10-09T06:57:28.779097+0000","last_active":"2023-10-09T06:57:28.782334+0000","last_peered":"2023-10-09T06:57:28.782334+0000","last_clean":"2023-10-09T06:57:28.782334+0000","last_became_active":"2023-10-09T06:57:28.778724+0000","last_became_peered":"2023-10-09T06:57:28.778724+0000","last_unstale":"2023-10-09T06:57:28.782334+0000","last_undegraded":"2023-10-09T06:57:28.782334+0000","last_fullsized":"2023-10-09T06:57:28.782334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:51.726841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.778247+0000","last_change":"2023-10-09T06:57:28.771787+0000","last_active":"2023-10-09T06:57:28.778247+0000","last_peered":"2023-10-09T06:57:28.778247+0000","last_clean":"2023-10-09T06:57:28.778247+0000","last_became_active":"2023-10-09T06:57:28.771528+0000","last_became_peered":"2023-10-09T06:57:28.771528+0000","last_unstale":"2023-10-09T06:57:28.778247+0000","last_undegraded":"2023-10-09T06:57:28.778247+0000","last_fullsized":"2023-10-09T06:57:28.778247+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:11:40.587295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.784896+0000","last_change":"2023-10-09T06:57:28.774919+0000","last_active":"2023-10-09T06:57:28.784896+0000","last_peered":"2023-10-09T06:57:28.784896+0000","last_clean":"2023-10-09T06:57:28.784896+0000","last_became_active":"2023-10-09T06:57:28.773262+0000","last_became_peered":"2023-10-09T06:57:28.773262+0000","last_unstale":"2023-10-09T06:57:28.784896+0000","last_undegraded":"2023-10-09T06:57:28.784896+0000","last_fullsized":"2023-10-09T06:57:28.784896+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:19.985683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"78'4","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.822730+0000","last_change":"2023-10-09T06:57:27.827288+0000","last_active":"2023-10-09T06:57:28.822730+0000","last_peered":"2023-10-09T06:57:28.822730+0000","last_clean":"2023-10-09T06:57:28.822730+0000","last_became_active":"2023-10-09T06:57:27.827068+0000","last_became_peered":"2023-10-09T06:57:27.827068+0000","last_unstale":"2023-10-09T06:57:28.822730+0000","last_undegraded":"2023-10-09T06:57:28.822730+0000","last_fullsized":"2023-10-09T06:57:28.822730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:45:17.407599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.787241+0000","last_change":"2023-10-09T06:57:28.783942+0000","last_active":"2023-10-09T06:57:28.787241+0000","last_peered":"2023-10-09T06:57:28.787241+0000","last_clean":"2023-10-09T06:57:28.787241+0000","last_became_active":"2023-10-09T06:57:28.783696+0000","last_became_peered":"2023-10-09T06:57:28.783696+0000","last_unstale":"2023-10-09T06:57:28.787241+0000","last_undegraded":"2023-10-09T06:57:28.787241+0000","last_fullsized":"2023-10-09T06:57:28.787241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:19:56.437836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.820142+0000","last_change":"2023-10-09T06:57:27.820121+0000","last_active":"2023-10-09T06:57:28.820142+0000","last_peered":"2023-10-09T06:57:28.820142+0000","last_clean":"2023-10-09T06:57:28.820142+0000","last_became_active":"2023-10-09T06:57:27.819862+0000","last_became_peered":"2023-10-09T06:57:27.819862+0000","last_unstale":"2023-10-09T06:57:28.820142+0000","last_undegraded":"2023-10-09T06:57:28.820142+0000","last_fullsized":"2023-10-09T06:57:28.820142+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:59:30.516930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.785698+0000","last_change":"2023-10-09T06:57:28.783599+0000","last_active":"2023-10-09T06:57:28.785698+0000","last_peered":"2023-10-09T06:57:28.785698+0000","last_clean":"2023-10-09T06:57:28.785698+0000","last_became_active":"2023-10-09T06:57:28.783347+0000","last_became_peered":"2023-10-09T06:57:28.783347+0000","last_unstale":"2023-10-09T06:57:28.785698+0000","last_undegraded":"2023-10-09T06:57:28.785698+0000","last_fullsized":"2023-10-09T06:57:28.785698+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:39:38.013732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.818302+0000","last_change":"2023-10-09T06:57:27.819428+0000","last_active":"2023-10-09T06:57:28.818302+0000","last_peered":"2023-10-09T06:57:28.818302+0000","last_clean":"2023-10-09T06:57:28.818302+0000","last_became_active":"2023-10-09T06:57:27.818916+0000","last_became_peered":"2023-10-09T06:57:27.818916+0000","last_unstale":"2023-10-09T06:57:28.818302+0000","last_undegraded":"2023-10-09T06:57:28.818302+0000","last_fullsized":"2023-10-09T06:57:28.818302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:47:43.660419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.785684+0000","last_change":"2023-10-09T06:57:28.783825+0000","last_active":"2023-10-09T06:57:28.785684+0000","last_peered":"2023-10-09T06:57:28.785684+0000","last_clean":"2023-10-09T06:57:28.785684+0000","last_became_active":"2023-10-09T06:57:28.783562+0000","last_became_peered":"2023-10-09T06:57:28.783562+0000","last_unstale":"2023-10-09T06:57:28.785684+0000","last_undegraded":"2023-10-09T06:57:28.785684+0000","last_fullsized":"2023-10-09T06:57:28.785684+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:00.475732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.820333+0000","last_change":"2023-10-09T06:57:27.827451+0000","last_active":"2023-10-09T06:57:28.820333+0000","last_peered":"2023-10-09T06:57:28.820333+0000","last_clean":"2023-10-09T06:57:28.820333+0000","last_became_active":"2023-10-09T06:57:27.827153+0000","last_became_peered":"2023-10-09T06:57:27.827153+0000","last_unstale":"2023-10-09T06:57:28.820333+0000","last_undegraded":"2023-10-09T06:57:28.820333+0000","last_fullsized":"2023-10-09T06:57:28.820333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:30.143184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.786517+0000","last_change":"2023-10-09T06:57:28.781262+0000","last_active":"2023-10-09T06:57:28.786517+0000","last_peered":"2023-10-09T06:57:28.786517+0000","last_clean":"2023-10-09T06:57:28.786517+0000","last_became_active":"2023-10-09T06:57:28.780989+0000","last_became_peered":"2023-10-09T06:57:28.780989+0000","last_unstale":"2023-10-09T06:57:28.786517+0000","last_undegraded":"2023-10-09T06:57:28.786517+0000","last_fullsized":"2023-10-09T06:57:28.786517+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:02.902780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.815493+0000","last_change":"2023-10-09T06:57:27.823910+0000","last_active":"2023-10-09T06:57:28.815493+0000","last_peered":"2023-10-09T06:57:28.815493+0000","last_clean":"2023-10-09T06:57:28.815493+0000","last_became_active":"2023-10-09T06:57:27.823598+0000","last_became_peered":"2023-10-09T06:57:27.823598+0000","last_unstale":"2023-10-09T06:57:28.815493+0000","last_undegraded":"2023-10-09T06:57:28.815493+0000","last_fullsized":"2023-10-09T06:57:28.815493+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:19:55.428947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.784472+0000","last_change":"2023-10-09T06:57:28.777093+0000","last_active":"2023-10-09T06:57:28.784472+0000","last_peered":"2023-10-09T06:57:28.784472+0000","last_clean":"2023-10-09T06:57:28.784472+0000","last_became_active":"2023-10-09T06:57:28.776845+0000","last_became_peered":"2023-10-09T06:57:28.776845+0000","last_unstale":"2023-10-09T06:57:28.784472+0000","last_undegraded":"2023-10-09T06:57:28.784472+0000","last_fullsized":"2023-10-09T06:57:28.784472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:35.883463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.816579+0000","last_change":"2023-10-09T06:57:27.815673+0000","last_active":"2023-10-09T06:57:28.816579+0000","last_peered":"2023-10-09T06:57:28.816579+0000","last_clean":"2023-10-09T06:57:28.816579+0000","last_became_active":"2023-10-09T06:57:27.815399+0000","last_became_peered":"2023-10-09T06:57:27.815399+0000","last_unstale":"2023-10-09T06:57:28.816579+0000","last_undegraded":"2023-10-09T06:57:28.816579+0000","last_fullsized":"2023-10-09T06:57:28.816579+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:32.117248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.774244+0000","last_change":"2023-10-09T06:57:28.772568+0000","last_active":"2023-10-09T06:57:28.774244+0000","last_peered":"2023-10-09T06:57:28.774244+0000","last_clean":"2023-10-09T06:57:28.774244+0000","last_became_active":"2023-10-09T06:57:28.772186+0000","last_became_peered":"2023-10-09T06:57:28.772186+0000","last_unstale":"2023-10-09T06:57:28.774244+0000","last_undegraded":"2023-10-09T06:57:28.774244+0000","last_fullsized":"2023-10-09T06:57:28.774244+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:19:56.437836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.760237+0000","last_change":"2023-10-09T06:57:27.827942+0000","last_active":"2023-10-09T06:57:28.760237+0000","last_peered":"2023-10-09T06:57:28.760237+0000","last_clean":"2023-10-09T06:57:28.760237+0000","last_became_active":"2023-10-09T06:57:27.827632+0000","last_became_peered":"2023-10-09T06:57:27.827632+0000","last_unstale":"2023-10-09T06:57:28.760237+0000","last_undegraded":"2023-10-09T06:57:28.760237+0000","last_fullsized":"2023-10-09T06:57:28.760237+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:17.134868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.784335+0000","last_change":"2023-10-09T06:57:28.775560+0000","last_active":"2023-10-09T06:57:28.784335+0000","last_peered":"2023-10-09T06:57:28.784335+0000","last_clean":"2023-10-09T06:57:28.784335+0000","last_became_active":"2023-10-09T06:57:28.775291+0000","last_became_peered":"2023-10-09T06:57:28.775291+0000","last_unstale":"2023-10-09T06:57:28.784335+0000","last_undegraded":"2023-10-09T06:57:28.784335+0000","last_fullsized":"2023-10-09T06:57:28.784335+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:19.985683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.760505+0000","last_change":"2023-10-09T06:57:27.817039+0000","last_active":"2023-10-09T06:57:28.760505+0000","last_peered":"2023-10-09T06:57:28.760505+0000","last_clean":"2023-10-09T06:57:28.760505+0000","last_became_active":"2023-10-09T06:57:27.816692+0000","last_became_peered":"2023-10-09T06:57:27.816692+0000","last_unstale":"2023-10-09T06:57:28.760505+0000","last_undegraded":"2023-10-09T06:57:28.760505+0000","last_fullsized":"2023-10-09T06:57:28.760505+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:36.773341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.774909+0000","last_change":"2023-10-09T06:57:28.773174+0000","last_active":"2023-10-09T06:57:28.774909+0000","last_peered":"2023-10-09T06:57:28.774909+0000","last_clean":"2023-10-09T06:57:28.774909+0000","last_became_active":"2023-10-09T06:57:28.772859+0000","last_became_peered":"2023-10-09T06:57:28.772859+0000","last_unstale":"2023-10-09T06:57:28.774909+0000","last_undegraded":"2023-10-09T06:57:28.774909+0000","last_fullsized":"2023-10-09T06:57:28.774909+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:58.298403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.768264+0000","last_change":"2023-10-09T06:57:27.827839+0000","last_active":"2023-10-09T06:57:28.768264+0000","last_peered":"2023-10-09T06:57:28.768264+0000","last_clean":"2023-10-09T06:57:28.768264+0000","last_became_active":"2023-10-09T06:57:27.827514+0000","last_became_peered":"2023-10-09T06:57:27.827514+0000","last_unstale":"2023-10-09T06:57:28.768264+0000","last_undegraded":"2023-10-09T06:57:28.768264+0000","last_fullsized":"2023-10-09T06:57:28.768264+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:19:55.428947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.786775+0000","last_change":"2023-10-09T06:57:28.786165+0000","last_active":"2023-10-09T06:57:28.786775+0000","last_peered":"2023-10-09T06:57:28.786775+0000","last_clean":"2023-10-09T06:57:28.786775+0000","last_became_active":"2023-10-09T06:57:28.785850+0000","last_became_peered":"2023-10-09T06:57:28.785850+0000","last_unstale":"2023-10-09T06:57:28.786775+0000","last_undegraded":"2023-10-09T06:57:28.786775+0000","last_fullsized":"2023-10-09T06:57:28.786775+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:33.126138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.769139+0000","last_change":"2023-10-09T06:57:27.823933+0000","last_active":"2023-10-09T06:57:28.769139+0000","last_peered":"2023-10-09T06:57:28.769139+0000","last_clean":"2023-10-09T06:57:28.769139+0000","last_became_active":"2023-10-09T06:57:27.823480+0000","last_became_peered":"2023-10-09T06:57:27.823480+0000","last_unstale":"2023-10-09T06:57:28.769139+0000","last_undegraded":"2023-10-09T06:57:28.769139+0000","last_fullsized":"2023-10-09T06:57:28.769139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:32.117248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.785733+0000","last_change":"2023-10-09T06:57:28.781188+0000","last_active":"2023-10-09T06:57:28.785733+0000","last_peered":"2023-10-09T06:57:28.785733+0000","last_clean":"2023-10-09T06:57:28.785733+0000","last_became_active":"2023-10-09T06:57:28.780638+0000","last_became_peered":"2023-10-09T06:57:28.780638+0000","last_unstale":"2023-10-09T06:57:28.785733+0000","last_undegraded":"2023-10-09T06:57:28.785733+0000","last_fullsized":"2023-10-09T06:57:28.785733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:17:12.768331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"78'3","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.819986+0000","last_change":"2023-10-09T06:57:27.825675+0000","last_active":"2023-10-09T06:57:28.819986+0000","last_peered":"2023-10-09T06:57:28.819986+0000","last_clean":"2023-10-09T06:57:28.819986+0000","last_became_active":"2023-10-09T06:57:27.825387+0000","last_became_peered":"2023-10-09T06:57:27.825387+0000","last_unstale":"2023-10-09T06:57:28.819986+0000","last_undegraded":"2023-10-09T06:57:28.819986+0000","last_fullsized":"2023-10-09T06:57:28.819986+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:10:23.170364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.783383+0000","last_change":"2023-10-09T06:57:28.782449+0000","last_active":"2023-10-09T06:57:28.783383+0000","last_peered":"2023-10-09T06:57:28.783383+0000","last_clean":"2023-10-09T06:57:28.783383+0000","last_became_active":"2023-10-09T06:57:28.782183+0000","last_became_peered":"2023-10-09T06:57:28.782183+0000","last_unstale":"2023-10-09T06:57:28.783383+0000","last_undegraded":"2023-10-09T06:57:28.783383+0000","last_fullsized":"2023-10-09T06:57:28.783383+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:58.537945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"78'6","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.825456+0000","last_change":"2023-10-09T06:57:27.822063+0000","last_active":"2023-10-09T06:57:28.825456+0000","last_peered":"2023-10-09T06:57:28.825456+0000","last_clean":"2023-10-09T06:57:28.825456+0000","last_became_active":"2023-10-09T06:57:27.821629+0000","last_became_peered":"2023-10-09T06:57:27.821629+0000","last_unstale":"2023-10-09T06:57:28.825456+0000","last_undegraded":"2023-10-09T06:57:28.825456+0000","last_fullsized":"2023-10-09T06:57:28.825456+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:22.816859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.781013+0000","last_change":"2023-10-09T06:57:28.779439+0000","last_active":"2023-10-09T06:57:28.781013+0000","last_peered":"2023-10-09T06:57:28.781013+0000","last_clean":"2023-10-09T06:57:28.781013+0000","last_became_active":"2023-10-09T06:57:28.779190+0000","last_became_peered":"2023-10-09T06:57:28.779190+0000","last_unstale":"2023-10-09T06:57:28.781013+0000","last_undegraded":"2023-10-09T06:57:28.781013+0000","last_fullsized":"2023-10-09T06:57:28.781013+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:43:35.868915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.822180+0000","last_change":"2023-10-09T06:57:27.825130+0000","last_active":"2023-10-09T06:57:28.822180+0000","last_peered":"2023-10-09T06:57:28.822180+0000","last_clean":"2023-10-09T06:57:28.822180+0000","last_became_active":"2023-10-09T06:57:27.824395+0000","last_became_peered":"2023-10-09T06:57:27.824395+0000","last_unstale":"2023-10-09T06:57:28.822180+0000","last_undegraded":"2023-10-09T06:57:28.822180+0000","last_fullsized":"2023-10-09T06:57:28.822180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:41.951670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.778657+0000","last_change":"2023-10-09T06:57:28.776415+0000","last_active":"2023-10-09T06:57:28.778657+0000","last_peered":"2023-10-09T06:57:28.778657+0000","last_clean":"2023-10-09T06:57:28.778657+0000","last_became_active":"2023-10-09T06:57:28.776147+0000","last_became_peered":"2023-10-09T06:57:28.776147+0000","last_unstale":"2023-10-09T06:57:28.778657+0000","last_undegraded":"2023-10-09T06:57:28.778657+0000","last_fullsized":"2023-10-09T06:57:28.778657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:47:44.669309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.765587+0000","last_change":"2023-10-09T06:57:27.819882+0000","last_active":"2023-10-09T06:57:28.765587+0000","last_peered":"2023-10-09T06:57:28.765587+0000","last_clean":"2023-10-09T06:57:28.765587+0000","last_became_active":"2023-10-09T06:57:27.819561+0000","last_became_peered":"2023-10-09T06:57:27.819561+0000","last_unstale":"2023-10-09T06:57:28.765587+0000","last_undegraded":"2023-10-09T06:57:28.765587+0000","last_fullsized":"2023-10-09T06:57:28.765587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:48:52.311049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.775098+0000","last_change":"2023-10-09T06:57:28.772528+0000","last_active":"2023-10-09T06:57:28.775098+0000","last_peered":"2023-10-09T06:57:28.775098+0000","last_clean":"2023-10-09T06:57:28.775098+0000","last_became_active":"2023-10-09T06:57:28.771911+0000","last_became_peered":"2023-10-09T06:57:28.771911+0000","last_unstale":"2023-10-09T06:57:28.775098+0000","last_undegraded":"2023-10-09T06:57:28.775098+0000","last_fullsized":"2023-10-09T06:57:28.775098+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:18.143758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.760341+0000","last_change":"2023-10-09T06:57:27.828996+0000","last_active":"2023-10-09T06:57:28.760341+0000","last_peered":"2023-10-09T06:57:28.760341+0000","last_clean":"2023-10-09T06:57:28.760341+0000","last_became_active":"2023-10-09T06:57:27.828715+0000","last_became_peered":"2023-10-09T06:57:27.828715+0000","last_unstale":"2023-10-09T06:57:28.760341+0000","last_undegraded":"2023-10-09T06:57:28.760341+0000","last_fullsized":"2023-10-09T06:57:28.760341+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:51:13.502921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.781572+0000","last_change":"2023-10-09T06:57:28.777116+0000","last_active":"2023-10-09T06:57:28.781572+0000","last_peered":"2023-10-09T06:57:28.781572+0000","last_clean":"2023-10-09T06:57:28.781572+0000","last_became_active":"2023-10-09T06:57:28.776844+0000","last_became_peered":"2023-10-09T06:57:28.776844+0000","last_unstale":"2023-10-09T06:57:28.781572+0000","last_undegraded":"2023-10-09T06:57:28.781572+0000","last_fullsized":"2023-10-09T06:57:28.781572+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:40:50.639274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"78'8","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.822999+0000","last_change":"2023-10-09T06:57:27.829349+0000","last_active":"2023-10-09T06:57:28.822999+0000","last_peered":"2023-10-09T06:57:28.822999+0000","last_clean":"2023-10-09T06:57:28.822999+0000","last_became_active":"2023-10-09T06:57:27.828936+0000","last_became_peered":"2023-10-09T06:57:27.828936+0000","last_unstale":"2023-10-09T06:57:28.822999+0000","last_undegraded":"2023-10-09T06:57:28.822999+0000","last_fullsized":"2023-10-09T06:57:28.822999+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:36.773341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.781622+0000","last_change":"2023-10-09T06:57:28.777763+0000","last_active":"2023-10-09T06:57:28.781622+0000","last_peered":"2023-10-09T06:57:28.781622+0000","last_clean":"2023-10-09T06:57:28.781622+0000","last_became_active":"2023-10-09T06:57:28.776970+0000","last_became_peered":"2023-10-09T06:57:28.776970+0000","last_unstale":"2023-10-09T06:57:28.781622+0000","last_undegraded":"2023-10-09T06:57:28.781622+0000","last_fullsized":"2023-10-09T06:57:28.781622+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:04:41.947780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.822137+0000","last_change":"2023-10-09T06:57:27.823228+0000","last_active":"2023-10-09T06:57:28.822137+0000","last_peered":"2023-10-09T06:57:28.822137+0000","last_clean":"2023-10-09T06:57:28.822137+0000","last_became_active":"2023-10-09T06:57:27.822963+0000","last_became_peered":"2023-10-09T06:57:27.822963+0000","last_unstale":"2023-10-09T06:57:28.822137+0000","last_undegraded":"2023-10-09T06:57:28.822137+0000","last_fullsized":"2023-10-09T06:57:28.822137+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:45:17.407599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.780465+0000","last_change":"2023-10-09T06:57:28.778380+0000","last_active":"2023-10-09T06:57:28.780465+0000","last_peered":"2023-10-09T06:57:28.780465+0000","last_clean":"2023-10-09T06:57:28.780465+0000","last_became_active":"2023-10-09T06:57:28.778052+0000","last_became_peered":"2023-10-09T06:57:28.778052+0000","last_unstale":"2023-10-09T06:57:28.780465+0000","last_undegraded":"2023-10-09T06:57:28.780465+0000","last_fullsized":"2023-10-09T06:57:28.780465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:40:50.639274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.818139+0000","last_change":"2023-10-09T06:57:27.823098+0000","last_active":"2023-10-09T06:57:28.818139+0000","last_peered":"2023-10-09T06:57:28.818139+0000","last_clean":"2023-10-09T06:57:28.818139+0000","last_became_active":"2023-10-09T06:57:27.822849+0000","last_became_peered":"2023-10-09T06:57:27.822849+0000","last_unstale":"2023-10-09T06:57:28.818139+0000","last_undegraded":"2023-10-09T06:57:28.818139+0000","last_fullsized":"2023-10-09T06:57:28.818139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:38.564086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.784384+0000","last_change":"2023-10-09T06:57:28.775040+0000","last_active":"2023-10-09T06:57:28.784384+0000","last_peered":"2023-10-09T06:57:28.784384+0000","last_clean":"2023-10-09T06:57:28.784384+0000","last_became_active":"2023-10-09T06:57:28.774746+0000","last_became_peered":"2023-10-09T06:57:28.774746+0000","last_unstale":"2023-10-09T06:57:28.784384+0000","last_undegraded":"2023-10-09T06:57:28.784384+0000","last_fullsized":"2023-10-09T06:57:28.784384+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:02.256685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.822890+0000","last_change":"2023-10-09T06:57:27.828354+0000","last_active":"2023-10-09T06:57:28.822890+0000","last_peered":"2023-10-09T06:57:28.822890+0000","last_clean":"2023-10-09T06:57:28.822890+0000","last_became_active":"2023-10-09T06:57:27.828099+0000","last_became_peered":"2023-10-09T06:57:27.828099+0000","last_unstale":"2023-10-09T06:57:28.822890+0000","last_undegraded":"2023-10-09T06:57:28.822890+0000","last_fullsized":"2023-10-09T06:57:28.822890+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:17.812832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.783396+0000","last_change":"2023-10-09T06:57:28.782562+0000","last_active":"2023-10-09T06:57:28.783396+0000","last_peered":"2023-10-09T06:57:28.783396+0000","last_clean":"2023-10-09T06:57:28.783396+0000","last_became_active":"2023-10-09T06:57:28.782296+0000","last_became_peered":"2023-10-09T06:57:28.782296+0000","last_unstale":"2023-10-09T06:57:28.783396+0000","last_undegraded":"2023-10-09T06:57:28.783396+0000","last_fullsized":"2023-10-09T06:57:28.783396+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:59:31.525820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.766634+0000","last_change":"2023-10-09T06:57:27.815394+0000","last_active":"2023-10-09T06:57:28.766634+0000","last_peered":"2023-10-09T06:57:28.766634+0000","last_clean":"2023-10-09T06:57:28.766634+0000","last_became_active":"2023-10-09T06:57:27.815131+0000","last_became_peered":"2023-10-09T06:57:27.815131+0000","last_unstale":"2023-10-09T06:57:28.766634+0000","last_undegraded":"2023-10-09T06:57:28.766634+0000","last_fullsized":"2023-10-09T06:57:28.766634+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:04:40.938890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.780429+0000","last_change":"2023-10-09T06:57:28.778375+0000","last_active":"2023-10-09T06:57:28.780429+0000","last_peered":"2023-10-09T06:57:28.780429+0000","last_clean":"2023-10-09T06:57:28.780429+0000","last_became_active":"2023-10-09T06:57:28.778110+0000","last_became_peered":"2023-10-09T06:57:28.778110+0000","last_unstale":"2023-10-09T06:57:28.780429+0000","last_undegraded":"2023-10-09T06:57:28.780429+0000","last_fullsized":"2023-10-09T06:57:28.780429+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:58.537945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.822590+0000","last_change":"2023-10-09T06:57:27.821135+0000","last_active":"2023-10-09T06:57:28.822590+0000","last_peered":"2023-10-09T06:57:28.822590+0000","last_clean":"2023-10-09T06:57:28.822590+0000","last_became_active":"2023-10-09T06:57:27.820867+0000","last_became_peered":"2023-10-09T06:57:27.820867+0000","last_unstale":"2023-10-09T06:57:28.822590+0000","last_undegraded":"2023-10-09T06:57:28.822590+0000","last_fullsized":"2023-10-09T06:57:28.822590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:57.529055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.785180+0000","last_change":"2023-10-09T06:57:28.773962+0000","last_active":"2023-10-09T06:57:28.785180+0000","last_peered":"2023-10-09T06:57:28.785180+0000","last_clean":"2023-10-09T06:57:28.785180+0000","last_became_active":"2023-10-09T06:57:28.773628+0000","last_became_peered":"2023-10-09T06:57:28.773628+0000","last_unstale":"2023-10-09T06:57:28.785180+0000","last_undegraded":"2023-10-09T06:57:28.785180+0000","last_fullsized":"2023-10-09T06:57:28.785180+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:02.256685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.771842+0000","last_change":"2023-10-09T06:57:27.824027+0000","last_active":"2023-10-09T06:57:28.771842+0000","last_peered":"2023-10-09T06:57:28.771842+0000","last_clean":"2023-10-09T06:57:28.771842+0000","last_became_active":"2023-10-09T06:57:27.823722+0000","last_became_peered":"2023-10-09T06:57:27.823722+0000","last_unstale":"2023-10-09T06:57:28.771842+0000","last_undegraded":"2023-10-09T06:57:28.771842+0000","last_fullsized":"2023-10-09T06:57:28.771842+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:00:26.379968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.778259+0000","last_change":"2023-10-09T06:57:28.772235+0000","last_active":"2023-10-09T06:57:28.778259+0000","last_peered":"2023-10-09T06:57:28.778259+0000","last_clean":"2023-10-09T06:57:28.778259+0000","last_became_active":"2023-10-09T06:57:28.771956+0000","last_became_peered":"2023-10-09T06:57:28.771956+0000","last_unstale":"2023-10-09T06:57:28.778259+0000","last_undegraded":"2023-10-09T06:57:28.778259+0000","last_fullsized":"2023-10-09T06:57:28.778259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:02.031349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.762177+0000","last_change":"2023-10-09T06:57:27.823674+0000","last_active":"2023-10-09T06:57:28.762177+0000","last_peered":"2023-10-09T06:57:28.762177+0000","last_clean":"2023-10-09T06:57:28.762177+0000","last_became_active":"2023-10-09T06:57:27.823266+0000","last_became_peered":"2023-10-09T06:57:27.823266+0000","last_unstale":"2023-10-09T06:57:28.762177+0000","last_undegraded":"2023-10-09T06:57:28.762177+0000","last_fullsized":"2023-10-09T06:57:28.762177+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:34:46.295150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.780352+0000","last_change":"2023-10-09T06:57:28.775313+0000","last_active":"2023-10-09T06:57:28.780352+0000","last_peered":"2023-10-09T06:57:28.780352+0000","last_clean":"2023-10-09T06:57:28.780352+0000","last_became_active":"2023-10-09T06:57:28.775070+0000","last_became_peered":"2023-10-09T06:57:28.775070+0000","last_unstale":"2023-10-09T06:57:28.780352+0000","last_undegraded":"2023-10-09T06:57:28.780352+0000","last_fullsized":"2023-10-09T06:57:28.780352+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:06:04.512661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.821159+0000","last_change":"2023-10-09T06:57:27.813803+0000","last_active":"2023-10-09T06:57:28.821159+0000","last_peered":"2023-10-09T06:57:28.821159+0000","last_clean":"2023-10-09T06:57:28.821159+0000","last_became_active":"2023-10-09T06:57:27.813554+0000","last_became_peered":"2023-10-09T06:57:27.813554+0000","last_unstale":"2023-10-09T06:57:28.821159+0000","last_undegraded":"2023-10-09T06:57:28.821159+0000","last_fullsized":"2023-10-09T06:57:28.821159+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:35.206102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.780202+0000","last_change":"2023-10-09T06:57:28.772003+0000","last_active":"2023-10-09T06:57:28.780202+0000","last_peered":"2023-10-09T06:57:28.780202+0000","last_clean":"2023-10-09T06:57:28.780202+0000","last_became_active":"2023-10-09T06:57:28.771753+0000","last_became_peered":"2023-10-09T06:57:28.771753+0000","last_unstale":"2023-10-09T06:57:28.780202+0000","last_undegraded":"2023-10-09T06:57:28.780202+0000","last_fullsized":"2023-10-09T06:57:28.780202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:38:53.460629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.766086+0000","last_change":"2023-10-09T06:57:27.816892+0000","last_active":"2023-10-09T06:57:28.766086+0000","last_peered":"2023-10-09T06:57:28.766086+0000","last_clean":"2023-10-09T06:57:28.766086+0000","last_became_active":"2023-10-09T06:57:27.816592+0000","last_became_peered":"2023-10-09T06:57:27.816592+0000","last_unstale":"2023-10-09T06:57:28.766086+0000","last_undegraded":"2023-10-09T06:57:28.766086+0000","last_fullsized":"2023-10-09T06:57:28.766086+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:59:30.516930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.785754+0000","last_change":"2023-10-09T06:57:28.781415+0000","last_active":"2023-10-09T06:57:28.785754+0000","last_peered":"2023-10-09T06:57:28.785754+0000","last_clean":"2023-10-09T06:57:28.785754+0000","last_became_active":"2023-10-09T06:57:28.776766+0000","last_became_peered":"2023-10-09T06:57:28.776766+0000","last_unstale":"2023-10-09T06:57:28.785754+0000","last_undegraded":"2023-10-09T06:57:28.785754+0000","last_fullsized":"2023-10-09T06:57:28.785754+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:00:13.023731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.766334+0000","last_change":"2023-10-09T06:57:27.820783+0000","last_active":"2023-10-09T06:57:28.766334+0000","last_peered":"2023-10-09T06:57:28.766334+0000","last_clean":"2023-10-09T06:57:28.766334+0000","last_became_active":"2023-10-09T06:57:27.820522+0000","last_became_peered":"2023-10-09T06:57:27.820522+0000","last_unstale":"2023-10-09T06:57:28.766334+0000","last_undegraded":"2023-10-09T06:57:28.766334+0000","last_fullsized":"2023-10-09T06:57:28.766334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:04:34.324994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.785662+0000","last_change":"2023-10-09T06:57:28.782031+0000","last_active":"2023-10-09T06:57:28.785662+0000","last_peered":"2023-10-09T06:57:28.785662+0000","last_clean":"2023-10-09T06:57:28.785662+0000","last_became_active":"2023-10-09T06:57:28.781756+0000","last_became_peered":"2023-10-09T06:57:28.781756+0000","last_unstale":"2023-10-09T06:57:28.785662+0000","last_undegraded":"2023-10-09T06:57:28.785662+0000","last_fullsized":"2023-10-09T06:57:28.785662+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:24.050316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.762114+0000","last_change":"2023-10-09T06:57:27.823794+0000","last_active":"2023-10-09T06:57:28.762114+0000","last_peered":"2023-10-09T06:57:28.762114+0000","last_clean":"2023-10-09T06:57:28.762114+0000","last_became_active":"2023-10-09T06:57:27.823480+0000","last_became_peered":"2023-10-09T06:57:27.823480+0000","last_unstale":"2023-10-09T06:57:28.762114+0000","last_undegraded":"2023-10-09T06:57:28.762114+0000","last_fullsized":"2023-10-09T06:57:28.762114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:04.766253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.787444+0000","last_change":"2023-10-09T06:57:28.785057+0000","last_active":"2023-10-09T06:57:28.787444+0000","last_peered":"2023-10-09T06:57:28.787444+0000","last_clean":"2023-10-09T06:57:28.787444+0000","last_became_active":"2023-10-09T06:57:28.784736+0000","last_became_peered":"2023-10-09T06:57:28.784736+0000","last_unstale":"2023-10-09T06:57:28.787444+0000","last_undegraded":"2023-10-09T06:57:28.787444+0000","last_fullsized":"2023-10-09T06:57:28.787444+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:31.721364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.771683+0000","last_change":"2023-10-09T06:57:27.825298+0000","last_active":"2023-10-09T06:57:28.771683+0000","last_peered":"2023-10-09T06:57:28.771683+0000","last_clean":"2023-10-09T06:57:28.771683+0000","last_became_active":"2023-10-09T06:57:27.824987+0000","last_became_peered":"2023-10-09T06:57:27.824987+0000","last_unstale":"2023-10-09T06:57:28.771683+0000","last_undegraded":"2023-10-09T06:57:28.771683+0000","last_fullsized":"2023-10-09T06:57:28.771683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:54.221190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.777453+0000","last_change":"2023-10-09T06:57:28.774703+0000","last_active":"2023-10-09T06:57:28.777453+0000","last_peered":"2023-10-09T06:57:28.777453+0000","last_clean":"2023-10-09T06:57:28.777453+0000","last_became_active":"2023-10-09T06:57:28.774422+0000","last_became_peered":"2023-10-09T06:57:28.774422+0000","last_unstale":"2023-10-09T06:57:28.777453+0000","last_undegraded":"2023-10-09T06:57:28.777453+0000","last_fullsized":"2023-10-09T06:57:28.777453+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:39.572976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.761548+0000","last_change":"2023-10-09T06:57:27.821816+0000","last_active":"2023-10-09T06:57:28.761548+0000","last_peered":"2023-10-09T06:57:28.761548+0000","last_clean":"2023-10-09T06:57:28.761548+0000","last_became_active":"2023-10-09T06:57:27.821483+0000","last_became_peered":"2023-10-09T06:57:27.821483+0000","last_unstale":"2023-10-09T06:57:28.761548+0000","last_undegraded":"2023-10-09T06:57:28.761548+0000","last_fullsized":"2023-10-09T06:57:28.761548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:17:11.759441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.781308+0000","last_change":"2023-10-09T06:57:28.772274+0000","last_active":"2023-10-09T06:57:28.781308+0000","last_peered":"2023-10-09T06:57:28.781308+0000","last_clean":"2023-10-09T06:57:28.781308+0000","last_became_active":"2023-10-09T06:57:28.771950+0000","last_became_peered":"2023-10-09T06:57:28.771950+0000","last_unstale":"2023-10-09T06:57:28.781308+0000","last_undegraded":"2023-10-09T06:57:28.781308+0000","last_fullsized":"2023-10-09T06:57:28.781308+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:48:53.319939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.771797+0000","last_change":"2023-10-09T06:57:27.816955+0000","last_active":"2023-10-09T06:57:28.771797+0000","last_peered":"2023-10-09T06:57:28.771797+0000","last_clean":"2023-10-09T06:57:28.771797+0000","last_became_active":"2023-10-09T06:57:27.816689+0000","last_became_peered":"2023-10-09T06:57:27.816689+0000","last_unstale":"2023-10-09T06:57:28.771797+0000","last_undegraded":"2023-10-09T06:57:28.771797+0000","last_fullsized":"2023-10-09T06:57:28.771797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:04:58.302881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.784312+0000","last_change":"2023-10-09T06:57:28.774949+0000","last_active":"2023-10-09T06:57:28.784312+0000","last_peered":"2023-10-09T06:57:28.784312+0000","last_clean":"2023-10-09T06:57:28.784312+0000","last_became_active":"2023-10-09T06:57:28.774667+0000","last_became_peered":"2023-10-09T06:57:28.774667+0000","last_unstale":"2023-10-09T06:57:28.784312+0000","last_undegraded":"2023-10-09T06:57:28.784312+0000","last_fullsized":"2023-10-09T06:57:28.784312+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:28.363380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.765845+0000","last_change":"2023-10-09T06:57:27.826592+0000","last_active":"2023-10-09T06:57:28.765845+0000","last_peered":"2023-10-09T06:57:28.765845+0000","last_clean":"2023-10-09T06:57:28.765845+0000","last_became_active":"2023-10-09T06:57:27.826332+0000","last_became_peered":"2023-10-09T06:57:27.826332+0000","last_unstale":"2023-10-09T06:57:28.765845+0000","last_undegraded":"2023-10-09T06:57:28.765845+0000","last_fullsized":"2023-10-09T06:57:28.765845+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:38.564086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.784485+0000","last_change":"2023-10-09T06:57:28.775217+0000","last_active":"2023-10-09T06:57:28.784485+0000","last_peered":"2023-10-09T06:57:28.784485+0000","last_clean":"2023-10-09T06:57:28.784485+0000","last_became_active":"2023-10-09T06:57:28.774467+0000","last_became_peered":"2023-10-09T06:57:28.774467+0000","last_unstale":"2023-10-09T06:57:28.784485+0000","last_undegraded":"2023-10-09T06:57:28.784485+0000","last_fullsized":"2023-10-09T06:57:28.784485+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:27.794090+0000","last_clean_scrub_stamp":"2023-10-09T06:57:27.794090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:29.971439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.765536+0000","last_change":"2023-10-09T06:57:27.826224+0000","last_active":"2023-10-09T06:57:28.765536+0000","last_peered":"2023-10-09T06:57:28.765536+0000","last_clean":"2023-10-09T06:57:28.765536+0000","last_became_active":"2023-10-09T06:57:27.825956+0000","last_became_peered":"2023-10-09T06:57:27.825956+0000","last_unstale":"2023-10-09T06:57:28.765536+0000","last_undegraded":"2023-10-09T06:57:28.765536+0000","last_fullsized":"2023-10-09T06:57:28.765536+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:57:26.785200+0000","last_clean_scrub_stamp":"2023-10-09T06:57:26.785200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:18.886549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"68'161","reported_seq":371,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-09T06:57:28.765760+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:57:28.765760+0000","last_peered":"2023-10-09T06:57:28.765760+0000","last_clean":"2023-10-09T06:57:28.765760+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:57:28.765760+0000","last_undegraded":"2023-10-09T06:57:28.765760+0000","last_fullsized":"2023-10-09T06:57:28.765760+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575030,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302892,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068948,"statfs":{"total":96636764160,"available":96326602752,"internally_reserved":0,"allocated":1544192,"data_stored":1041305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.71399999999999997,"15min":0.71599999999999997},"min":{"1min":0.64000000000000001,"5min":0.36299999999999999,"15min":0.316},"max":{"1min":1.0960000000000001,"5min":1.732,"15min":1.9490000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.60299999999999998,"5min":0.40200000000000002,"15min":0.29999999999999999},"max":{"1min":1.22,"5min":1.22,"15min":3.448},"last":0.78600000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72399999999999998,"15min":0.748},"min":{"1min":0.52600000000000002,"5min":0.437,"15min":0.379},"max":{"1min":0.99299999999999999,"5min":2.3559999999999999,"15min":5.617},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.58299999999999996,"5min":0.45800000000000002,"15min":0.40200000000000002},"max":{"1min":0.998,"5min":1.7869999999999999,"15min":2.016},"last":0.97599999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.746,"15min":0.748},"min":{"1min":0.57499999999999996,"5min":0.46500000000000002,"15min":0.44800000000000001},"max":{"1min":0.98399999999999999,"5min":1.9430000000000001,"15min":2.052},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.76100000000000001,"15min":0.77200000000000002},"min":{"1min":0.57599999999999996,"5min":0.48299999999999998,"15min":0.44700000000000001},"max":{"1min":1.262,"5min":2.6629999999999998,"15min":3.5019999999999998},"last":0.82399999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.71599999999999997,"15min":0.76000000000000001},"min":{"1min":0.59199999999999997,"5min":0.48499999999999999,"15min":0.45000000000000001},"max":{"1min":1.03,"5min":1.03,"15min":5.5800000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76000000000000001,"15min":0.80600000000000005},"min":{"1min":0.60099999999999998,"5min":0.496,"15min":0.47099999999999997},"max":{"1min":1.0169999999999999,"5min":1.827,"15min":6.9299999999999997},"last":0.83199999999999996}]},{"osd":4,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.622},"min":{"1min":0.46500000000000002,"5min":0.39500000000000002,"15min":0.35099999999999998},"max":{"1min":0.88200000000000001,"5min":0.95499999999999996,"15min":3.125},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65800000000000003,"15min":0.68000000000000005},"min":{"1min":0.438,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.92400000000000004,"5min":2.577,"15min":4.8380000000000001},"last":0.60699999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68100000000000005,"15min":0.69599999999999995},"min":{"1min":0.47899999999999998,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":0.879,"5min":2.5169999999999999,"15min":4.1929999999999996},"last":0.876},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71099999999999997,"15min":0.73299999999999998},"min":{"1min":0.54300000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.141,"5min":2.9590000000000001,"15min":3.6749999999999998},"last":0.628}]},{"osd":6,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.76700000000000002,"15min":0.78400000000000003},"min":{"1min":0.54100000000000004,"5min":0.498,"15min":0.49199999999999999},"max":{"1min":0.95099999999999996,"5min":3.0019999999999998,"15min":4.0250000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.72599999999999998,"15min":0.77800000000000002},"min":{"1min":0.48799999999999999,"5min":0.47399999999999998,"15min":0.44700000000000001},"max":{"1min":0.84499999999999997,"5min":2.4039999999999999,"15min":7.0259999999999998},"last":0.55200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575029,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302304,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069536,"statfs":{"total":96636764160,"available":96327204864,"internally_reserved":0,"allocated":942080,"data_stored":450777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69699999999999995,"15min":0.71099999999999997},"min":{"1min":0.52100000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85599999999999998,"5min":0.97899999999999998,"15min":1.022},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69099999999999995,"15min":0.70199999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.36599999999999999},"max":{"1min":0.80100000000000005,"5min":0.93899999999999995,"15min":1.079},"last":0.54600000000000004}]},{"osd":1,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70599999999999996,"15min":0.72199999999999998},"min":{"1min":0.47699999999999998,"5min":0.44800000000000001,"15min":0.42799999999999999},"max":{"1min":0.90400000000000003,"5min":1.135,"15min":1.135},"last":0.627},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70599999999999996,"15min":0.72399999999999998},"min":{"1min":0.56899999999999995,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83899999999999997,"5min":1.0109999999999999,"15min":1.034},"last":0.71399999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.58999999999999997,"5min":0.49199999999999999,"15min":0.42599999999999999},"max":{"1min":0.86899999999999999,"5min":1.391,"15min":1.391},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.51900000000000002,"5min":0.48899999999999999,"15min":0.45200000000000001},"max":{"1min":0.85899999999999999,"5min":0.95499999999999996,"15min":1.0900000000000001},"last":0.76500000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68300000000000005,"15min":0.69799999999999995},"min":{"1min":0.52600000000000002,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.82699999999999996,"5min":0.91700000000000004,"15min":1.046},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.497},"max":{"1min":0.86499999999999999,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.73799999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.42099999999999999,"5min":0.38,"15min":0.377},"max":{"1min":0.73399999999999999,"5min":1.768,"15min":1.768},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.437,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77700000000000002,"5min":1.601,"15min":1.601},"last":0.69399999999999995}]},{"osd":5,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.46600000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.876,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.68100000000000005,"15min":0.69299999999999995},"min":{"1min":0.47699999999999998,"5min":0.44600000000000001,"15min":0.42299999999999999},"max":{"1min":0.77500000000000002,"5min":0.99299999999999999,"15min":1.0669999999999999},"last":0.83899999999999997}]},{"osd":7,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.66600000000000004,"15min":0.67700000000000005},"min":{"1min":0.48699999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79400000000000004,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.45300000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83999999999999997,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.77800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073616,"statfs":{"total":96636764160,"available":96331382784,"internally_reserved":0,"allocated":958464,"data_stored":457547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46100000000000002,"15min":0.45800000000000002},"min":{"1min":0.33100000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66200000000000003,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.48999999999999999,"15min":0.47799999999999998},"min":{"1min":0.34499999999999997,"5min":0.29399999999999998,"15min":0.23699999999999999},"max":{"1min":0.79400000000000004,"5min":1.23,"15min":1.23},"last":0.30399999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.501,"15min":0.49399999999999999},"min":{"1min":0.41599999999999998,"5min":0.32600000000000001,"15min":0.29599999999999999},"max":{"1min":0.70099999999999996,"5min":1.169,"15min":1.169},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58699999999999997,"15min":0.57499999999999996},"min":{"1min":0.44800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":3.077,"15min":3.077},"last":0.46100000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.622,"15min":0.60499999999999998},"min":{"1min":0.54200000000000004,"5min":0.376,"15min":0.34100000000000003},"max":{"1min":0.81200000000000006,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.432},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.45700000000000002,"5min":0.34899999999999998,"15min":0.34100000000000003},"max":{"1min":0.74099999999999999,"5min":1.605,"15min":1.605},"last":0.48199999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.57199999999999995,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0389999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.497},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.77400000000000002,"15min":0.77700000000000002},"min":{"1min":0.60699999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0529999999999999,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.60799999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.57099999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.069,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.77400000000000002,"15min":0.78200000000000003},"min":{"1min":0.63500000000000001,"5min":0.497,"15min":0.47999999999999998},"max":{"1min":1.1040000000000001,"5min":1.637,"15min":1.637},"last":0.59799999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.80300000000000005,"15min":0.79700000000000004},"min":{"1min":0.65300000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.002,"5min":1.696,"15min":1.696},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.79400000000000004,"15min":0.79700000000000004},"min":{"1min":0.66200000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.115,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.65700000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.82399999999999995,"15min":0.82699999999999996},"min":{"1min":0.60699999999999998,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1559999999999999,"5min":1.2669999999999999,"15min":1.4510000000000001},"last":0.62},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.81599999999999995,"15min":0.82599999999999996},"min":{"1min":0.70999999999999996,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.081,"5min":1.125,"15min":1.1970000000000001},"last":0.63500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298804,"kb_used_data":1516,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073036,"statfs":{"total":96636764160,"available":96330788864,"internally_reserved":0,"allocated":1552384,"data_stored":1043235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47999999999999998,"15min":0.47099999999999997},"min":{"1min":0.38200000000000001,"5min":0.27100000000000002,"15min":0.23000000000000001},"max":{"1min":0.63,"5min":0.85799999999999998,"15min":1.2729999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56100000000000005,"15min":0.53800000000000003},"min":{"1min":0.34799999999999998,"5min":0.308,"15min":0.28899999999999998},"max":{"1min":0.73899999999999999,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":0.38300000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58399999999999996,"15min":0.55900000000000005},"min":{"1min":0.39100000000000001,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.68500000000000005,"5min":4.6980000000000004,"15min":4.6980000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.503,"15min":0.497},"min":{"1min":0.36699999999999999,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.64300000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.35199999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.40999999999999998,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":0.76200000000000001,"5min":1.2450000000000001,"15min":1.7130000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63,"15min":0.61799999999999999},"min":{"1min":0.52300000000000002,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":0.73099999999999998,"5min":4.734,"15min":4.734},"last":0.46700000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.76800000000000002,"15min":0.77200000000000002},"min":{"1min":0.69099999999999995,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91700000000000004,"5min":1.2270000000000001,"15min":1.752},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81699999999999995,"15min":0.80900000000000005},"min":{"1min":0.67800000000000005,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0269999999999999,"5min":4.6619999999999999,"15min":4.6619999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.78300000000000003,"15min":0.78000000000000003},"min":{"1min":0.65600000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0349999999999999,"5min":1.1890000000000001,"15min":1.2769999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.64100000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97899999999999998,"5min":1.2809999999999999,"15min":1.7889999999999999},"last":0.70999999999999996}]},{"osd":6,"last update":"Mon Oct 9 06:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.82899999999999996,"15min":0.82299999999999995},"min":{"1min":0.68400000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.046,"5min":4.6239999999999997,"15min":4.6239999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.80400000000000005,"15min":0.80800000000000005},"min":{"1min":0.66500000000000004,"5min":0.50800000000000001,"15min":0.47999999999999998},"max":{"1min":0.99399999999999999,"5min":1.2689999999999999,"15min":1.4370000000000001},"last":0.55600000000000005}]},{"osd":7,"last update":"Mon Oct 9 06:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.83799999999999997,"15min":0.83599999999999997},"min":{"1min":0.58299999999999996,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0760000000000001,"5min":1.256,"15min":1.518},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.84699999999999998,"15min":0.85699999999999998},"min":{"1min":0.76300000000000001,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0369999999999999,"5min":1.702,"15min":1.8200000000000001},"last":0.73599999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575029,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306420,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065420,"statfs":{"total":96636764160,"available":96322990080,"internally_reserved":0,"allocated":962560,"data_stored":457513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.47499999999999998,"15min":0.45900000000000002},"min":{"1min":0.33700000000000002,"5min":0.26500000000000001,"15min":0.25900000000000001},"max":{"1min":0.747,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.502},"min":{"1min":0.40200000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.63100000000000001,"5min":1.633,"15min":1.633},"last":0.34300000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47699999999999998,"15min":0.48799999999999999},"min":{"1min":0.34100000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64900000000000002,"5min":1.097,"15min":1.865},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.41699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.65400000000000003,"5min":1.2689999999999999,"15min":1.79},"last":0.42199999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.59299999999999997},"min":{"1min":0.48399999999999999,"5min":0.38600000000000001,"15min":0.35799999999999998},"max":{"1min":0.75,"5min":0.86699999999999999,"15min":1.8999999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.54300000000000004,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83899999999999997,"5min":1.1890000000000001,"15min":1.8220000000000001},"last":0.48799999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77100000000000002,"15min":0.76200000000000001},"min":{"1min":0.57999999999999996,"5min":0.53200000000000003,"15min":0.42899999999999999},"max":{"1min":1.1379999999999999,"5min":1.2430000000000001,"15min":1.256},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.75800000000000001,"15min":0.76700000000000002},"min":{"1min":0.48799999999999999,"5min":0.45900000000000002,"15min":0.44800000000000001},"max":{"1min":1.171,"5min":1.696,"15min":1.696},"last":0.63800000000000001}]},{"osd":5,"last update":"Mon Oct 9 06:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78200000000000003,"15min":0.77200000000000002},"min":{"1min":0.56100000000000005,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.081,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.77700000000000002,"15min":0.77800000000000002},"min":{"1min":0.625,"5min":0.52500000000000002,"15min":0.503},"max":{"1min":1.0629999999999999,"5min":1.218,"15min":1.3440000000000001},"last":0.75700000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79000000000000004,"15min":0.78500000000000003},"min":{"1min":0.64700000000000002,"5min":0.51000000000000001,"15min":0.48599999999999999},"max":{"1min":1.115,"5min":1.768,"15min":1.768},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79300000000000004,"15min":0.79700000000000004},"min":{"1min":0.61399999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.026,"5min":1.3580000000000001,"15min":1.5309999999999999},"last":0.70799999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80800000000000005,"15min":0.80600000000000005},"min":{"1min":0.57499999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0389999999999999,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82499999999999996,"15min":0.82699999999999996},"min":{"1min":0.69799999999999995,"5min":0.57599999999999996,"15min":0.50900000000000001},"max":{"1min":1.0409999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.80000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575030,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306408,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065432,"statfs":{"total":96636764160,"available":96323002368,"internally_reserved":0,"allocated":950272,"data_stored":450833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48099999999999998,"15min":0.46800000000000003},"min":{"1min":0.32300000000000001,"5min":0.29499999999999998,"15min":0.24099999999999999},"max":{"1min":0.78100000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.496,"15min":0.48699999999999999},"min":{"1min":0.32300000000000001,"5min":0.30199999999999999,"15min":0.28100000000000003},"max":{"1min":0.625,"5min":1.228,"15min":1.228},"last":0.63600000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48999999999999999,"15min":0.48099999999999998},"min":{"1min":0.36699999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63100000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.499},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.44800000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.70799999999999996,"5min":0.83399999999999996,"15min":0.85899999999999999},"last":0.52000000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58699999999999997,"15min":0.57699999999999996},"min":{"1min":0.45100000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.69499999999999995,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65000000000000002,"15min":0.628},"min":{"1min":0.53100000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.75900000000000001,"5min":3.8900000000000001,"15min":3.8900000000000001},"last":0.68100000000000005}]},{"osd":4,"last update":"Mon Oct 9 06:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.77300000000000002,"15min":0.748},"min":{"1min":0.57199999999999995,"5min":0.48299999999999998,"15min":0.40799999999999997},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.874,"5min":0.83899999999999997,"15min":0.82499999999999996},"min":{"1min":0.72399999999999998,"5min":0.59399999999999997,"15min":0.52200000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.752}]},{"osd":5,"last update":"Mon Oct 9 06:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.75,"15min":0.746},"min":{"1min":0.56299999999999994,"5min":0.441,"15min":0.441},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":2.1549999999999998},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.80100000000000005,"15min":0.80000000000000004},"min":{"1min":0.67800000000000005,"5min":0.55900000000000005,"15min":0.50600000000000001},"max":{"1min":1.1519999999999999,"5min":1.1639999999999999,"15min":1.419},"last":0.82999999999999996}]},{"osd":6,"last update":"Mon Oct 9 06:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.79000000000000004,"15min":0.77900000000000003},"min":{"1min":0.65700000000000003,"5min":0.53000000000000003,"15min":0.51700000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.875},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79700000000000004,"15min":0.77800000000000002},"min":{"1min":0.63800000000000001,"5min":0.54400000000000004,"15min":0.51500000000000001},"max":{"1min":1.1160000000000001,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84199999999999997,"15min":0.82399999999999995},"min":{"1min":0.67900000000000005,"5min":0.56000000000000005,"15min":0.55500000000000005},"max":{"1min":1.2629999999999999,"5min":1.8180000000000001,"15min":2.0880000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.84399999999999997,"15min":0.82999999999999996},"min":{"1min":0.627,"5min":0.57499999999999996,"15min":0.56499999999999995},"max":{"1min":1.1919999999999999,"5min":1.486,"15min":1.486},"last":0.84299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575029,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310520,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061320,"statfs":{"total":96636764160,"available":96318791680,"internally_reserved":0,"allocated":966656,"data_stored":458993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73199999999999998,"15min":0.70399999999999996},"min":{"1min":0.52500000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.96699999999999997,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73299999999999998,"15min":0.71999999999999997},"min":{"1min":0.53900000000000003,"5min":0.42699999999999999,"15min":0.39300000000000002},"max":{"1min":0.94399999999999995,"5min":2.8130000000000002,"15min":3.23},"last":0.77500000000000002}]},{"osd":1,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73199999999999998,"15min":0.71199999999999997},"min":{"1min":0.60499999999999998,"5min":0.45800000000000002,"15min":0.373},"max":{"1min":0.86099999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77400000000000002,"15min":0.74299999999999999},"min":{"1min":0.623,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.97299999999999998,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.749}]},{"osd":2,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77600000000000002,"15min":0.76000000000000001},"min":{"1min":0.54800000000000004,"5min":0.45900000000000002,"15min":0.38100000000000001},"max":{"1min":1.0089999999999999,"5min":2.5960000000000001,"15min":3.7509999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.79500000000000004,"15min":0.78200000000000003},"min":{"1min":0.64200000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92100000000000004,"5min":2.427,"15min":2.427},"last":0.89000000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76100000000000001,"15min":0.753},"min":{"1min":0.68000000000000005,"5min":0.434,"15min":0.434},"max":{"1min":0.83999999999999997,"5min":2.6440000000000001,"15min":3.6970000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78600000000000003,"15min":0.747},"min":{"1min":0.54900000000000004,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0289999999999999,"5min":3.6899999999999999,"15min":3.6899999999999999},"last":0.91500000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63300000000000001,"15min":0.61499999999999999},"min":{"1min":0.442,"5min":0.317,"15min":0.317},"max":{"1min":0.82999999999999996,"5min":3.3860000000000001,"15min":3.4780000000000002},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.68600000000000005,"15min":0.66500000000000004},"min":{"1min":0.44800000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.89900000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.60299999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.66500000000000004,"15min":0.64700000000000002},"min":{"1min":0.42299999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76700000000000002,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71499999999999997,"15min":0.68500000000000005},"min":{"1min":0.442,"5min":0.41699999999999998,"15min":0.374},"max":{"1min":0.92300000000000004,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.69099999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73699999999999999,"15min":0.72899999999999998},"min":{"1min":0.44,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90300000000000002,"5min":2.7210000000000001,"15min":3.2789999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.79200000000000004,"15min":0.77700000000000002},"min":{"1min":0.53700000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.98999999999999999,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.93600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575030,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302324,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069516,"statfs":{"total":96636764160,"available":96327184384,"internally_reserved":0,"allocated":962560,"data_stored":458081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.34899999999999998,"15min":0.30599999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.655},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.67400000000000004,"15min":0.68899999999999995},"min":{"1min":0.40000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.1359999999999999},"last":0.78200000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68200000000000005,"15min":0.70699999999999996},"min":{"1min":0.57199999999999995,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88300000000000001,"5min":0.96899999999999997,"15min":2.4159999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.71499999999999997,"15min":0.72899999999999998},"min":{"1min":0.47299999999999998,"5min":0.44,"15min":0.40400000000000003},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.706},"last":0.67400000000000004}]},{"osd":2,"last update":"Mon Oct 9 06:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71799999999999997,"15min":0.73799999999999999},"min":{"1min":0.57499999999999996,"5min":0.48499999999999999,"15min":0.42999999999999999},"max":{"1min":0.997,"5min":0.997,"15min":1.79},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.70599999999999996,"15min":0.72599999999999998},"min":{"1min":0.53700000000000003,"5min":0.44900000000000001,"15min":0.442},"max":{"1min":0.96499999999999997,"5min":1.006,"15min":2.4889999999999999},"last":0.64100000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.69899999999999995,"15min":0.72299999999999998},"min":{"1min":0.48999999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.97799999999999998,"5min":1.0209999999999999,"15min":1.409},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.755,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.501,"15min":0.501},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":2.532},"last":0.76700000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.61599999999999999},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81799999999999995,"5min":0.90700000000000003,"15min":1.766},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61799999999999999,"15min":0.63400000000000001},"min":{"1min":0.41199999999999998,"5min":0.377,"15min":0.35799999999999998},"max":{"1min":0.79500000000000004,"5min":1.052,"15min":2.7829999999999999},"last":0.73599999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63600000000000001,"15min":0.65000000000000002},"min":{"1min":0.41099999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82599999999999996,"5min":1.018,"15min":2.5739999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66400000000000003,"15min":0.68200000000000005},"min":{"1min":0.45600000000000002,"5min":0.40000000000000002,"15min":0.38900000000000001},"max":{"1min":0.89900000000000002,"5min":0.97999999999999998,"15min":1.8080000000000001},"last":0.80600000000000005}]},{"osd":7,"last update":"Mon Oct 9 06:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68300000000000005,"15min":0.70199999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.436},"max":{"1min":0.93700000000000006,"5min":1.175,"15min":2.9609999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76500000000000001,"15min":0.78400000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.45900000000000002},"max":{"1min":1.0089999999999999,"5min":1.139,"15min":2.613},"last":0.85599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:57:33.600 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T06:57:33.601 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T06:57:33.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.823+0000 7f6bda3ff700 1 Processor -- start 2023-10-09T06:57:33.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.823+0000 7f6bda3ff700 1 -- start start 2023-10-09T06:57:33.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.824+0000 7f6bda3ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6bd4159950 0x7f6bd40cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:33.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.824+0000 7f6bda3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6bd40af320 0x7f6bd4069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:33.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.824+0000 7f6bda3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bd4069aa0 0x7f6bd415d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:33.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.824+0000 7f6bda3ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd4069f20 con 0x7f6bd4159950 2023-10-09T06:57:33.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.824+0000 7f6bda3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd40ce380 con 0x7f6bd40af320 2023-10-09T06:57:33.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.824+0000 7f6bda3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd40cec20 con 0x7f6bd4069aa0 2023-10-09T06:57:33.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.825+0000 7f6bd3fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6bd4159950 0x7f6bd40cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:33.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.825+0000 7f6bd3fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6bd4159950 0x7f6bd40cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34156/0 (socket says 172.21.15.71:34156) 2023-10-09T06:57:33.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.825+0000 7f6bd3fff700 1 -- 172.21.15.71:0/2029161116 learned_addr learned my addr 172.21.15.71:0/2029161116 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:33.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.825+0000 7f6bd899c700 1 --2- 172.21.15.71:0/2029161116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bd4069aa0 0x7f6bd415d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:33.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.825+0000 7f6bd37fe700 1 --2- 172.21.15.71:0/2029161116 >> v2:172.21.15.179:3300/0 conn(0x7f6bd40af320 0x7f6bd4069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:33.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.825+0000 7f6bd3fff700 1 -- 172.21.15.71:0/2029161116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bd4069aa0 msgr2=0x7f6bd415d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:33.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.825+0000 7f6bd3fff700 1 --2- 172.21.15.71:0/2029161116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bd4069aa0 0x7f6bd415d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:33.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.825+0000 7f6bd3fff700 1 -- 172.21.15.71:0/2029161116 >> v2:172.21.15.179:3300/0 conn(0x7f6bd40af320 msgr2=0x7f6bd4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:33.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.825+0000 7f6bd3fff700 1 --2- 172.21.15.71:0/2029161116 >> v2:172.21.15.179:3300/0 conn(0x7f6bd40af320 0x7f6bd4069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:33.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.825+0000 7f6bd3fff700 1 -- 172.21.15.71:0/2029161116 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd40afa90 con 0x7f6bd4159950 2023-10-09T06:57:33.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.825+0000 7f6bd3fff700 1 --2- 172.21.15.71:0/2029161116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bd4159950 0x7f6bd40cbb90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6bd415d450 tx=0x7f6bc4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8205f76ca3585bc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:33.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.825+0000 7f6bd2ffd700 1 -- 172.21.15.71:0/2029161116 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc400b860 con 0x7f6bd4159950 2023-10-09T06:57:33.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.826+0000 7f6bd2ffd700 1 -- 172.21.15.71:0/2029161116 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc400b9c0 con 0x7f6bd4159950 2023-10-09T06:57:33.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.826+0000 7f6bd2ffd700 1 -- 172.21.15.71:0/2029161116 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc400bd60 con 0x7f6bd4159950 2023-10-09T06:57:33.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.826+0000 7f6bda3ff700 1 -- 172.21.15.71:0/2029161116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bd4159950 msgr2=0x7f6bd40cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:33.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.826+0000 7f6bda3ff700 1 --2- 172.21.15.71:0/2029161116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bd4159950 0x7f6bd40cbb90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6bd415d450 tx=0x7f6bc4009250 comp rx=0 tx=0).stop 2023-10-09T06:57:33.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.826+0000 7f6bda3ff700 1 -- 172.21.15.71:0/2029161116 shutdown_connections 2023-10-09T06:57:33.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.826+0000 7f6bda3ff700 1 --2- 172.21.15.71:0/2029161116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bd4069aa0 0x7f6bd415d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:33.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.826+0000 7f6bda3ff700 1 --2- 172.21.15.71:0/2029161116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bd4159950 0x7f6bd40cbb90 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:33.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.826+0000 7f6bda3ff700 1 --2- 172.21.15.71:0/2029161116 >> v2:172.21.15.179:3300/0 conn(0x7f6bd40af320 0x7f6bd4069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:33.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.826+0000 7f6bda3ff700 1 -- 172.21.15.71:0/2029161116 >> 172.21.15.71:0/2029161116 conn(0x7f6bd4068e00 msgr2=0x7f6bd40d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:33.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.826+0000 7f6bda3ff700 1 -- 172.21.15.71:0/2029161116 shutdown_connections 2023-10-09T06:57:33.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.826+0000 7f6bda3ff700 1 -- 172.21.15.71:0/2029161116 wait complete. 2023-10-09T06:57:33.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.828+0000 7f6bda3ff700 1 Processor -- start 2023-10-09T06:57:33.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.828+0000 7f6bda3ff700 1 -- start start 2023-10-09T06:57:33.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.829+0000 7f6bda3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bd4069aa0 0x7f6bd4141040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:33.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.829+0000 7f6bda3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bd40af320 0x7f6bd415bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:33.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.829+0000 7f6bda3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bd4159950 0x7f6bd415c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:33.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.829+0000 7f6bda3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd40c8b10 con 0x7f6bd4159950 2023-10-09T06:57:33.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.829+0000 7f6bda3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd415c6f0 con 0x7f6bd4069aa0 2023-10-09T06:57:33.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.829+0000 7f6bda3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd415c9d0 con 0x7f6bd40af320 2023-10-09T06:57:33.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.829+0000 7f6bd899c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bd4159950 0x7f6bd415c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:33.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.829+0000 7f6bd899c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bd4159950 0x7f6bd415c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34168/0 (socket says 172.21.15.71:34168) 2023-10-09T06:57:33.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.829+0000 7f6bd899c700 1 -- 172.21.15.71:0/1520078849 learned_addr learned my addr 172.21.15.71:0/1520078849 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:33.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.829+0000 7f6bd37fe700 1 --2- 172.21.15.71:0/1520078849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bd40af320 0x7f6bd415bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:33.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.829+0000 7f6bd3fff700 1 --2- 172.21.15.71:0/1520078849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bd4069aa0 0x7f6bd4141040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:33.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.829+0000 7f6bd899c700 1 -- 172.21.15.71:0/1520078849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bd40af320 msgr2=0x7f6bd415bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:33.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.829+0000 7f6bd899c700 1 --2- 172.21.15.71:0/1520078849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bd40af320 0x7f6bd415bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:33.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.829+0000 7f6bd899c700 1 -- 172.21.15.71:0/1520078849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bd4069aa0 msgr2=0x7f6bd4141040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:33.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.829+0000 7f6bd899c700 1 --2- 172.21.15.71:0/1520078849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bd4069aa0 0x7f6bd4141040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:33.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.829+0000 7f6bd899c700 1 -- 172.21.15.71:0/1520078849 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc40094f0 con 0x7f6bd4159950 2023-10-09T06:57:33.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.830+0000 7f6bd899c700 1 --2- 172.21.15.71:0/1520078849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bd4159950 0x7f6bd415c0d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc007f20 tx=0x7f6bcc009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:33.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.830+0000 7f6bbbfff700 1 -- 172.21.15.71:0/1520078849 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc00eca0 con 0x7f6bd4159950 2023-10-09T06:57:33.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.830+0000 7f6bbbfff700 1 -- 172.21.15.71:0/1520078849 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc00ee20 con 0x7f6bd4159950 2023-10-09T06:57:33.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.830+0000 7f6bbbfff700 1 -- 172.21.15.71:0/1520078849 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc014670 con 0x7f6bd4159950 2023-10-09T06:57:33.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.830+0000 7f6bda3ff700 1 -- 172.21.15.71:0/1520078849 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd415ccb0 con 0x7f6bd4159950 2023-10-09T06:57:33.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.830+0000 7f6bda3ff700 1 -- 172.21.15.71:0/1520078849 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd40b3cf0 con 0x7f6bd4159950 2023-10-09T06:57:33.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.831+0000 7f6bda3ff700 1 -- 172.21.15.71:0/1520078849 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd40c8cc0 con 0x7f6bd4159950 2023-10-09T06:57:33.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.832+0000 7f6bbbfff700 1 -- 172.21.15.71:0/1520078849 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6bcc0149e0 con 0x7f6bd4159950 2023-10-09T06:57:33.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.832+0000 7f6bbbfff700 1 --2- 172.21.15.71:0/1520078849 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6bc0066f30 0x7f6bc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:33.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.833+0000 7f6bbbfff700 1 -- 172.21.15.71:0/1520078849 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f6bcc084e00 con 0x7f6bd4159950 2023-10-09T06:57:33.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.833+0000 7f6bd3fff700 1 --2- 172.21.15.71:0/1520078849 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6bc0066f30 0x7f6bc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:33.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.834+0000 7f6bd3fff700 1 --2- 172.21.15.71:0/1520078849 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6bc0066f30 0x7f6bc00693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6bd415d450 tx=0x7f6bc4017000 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:33.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:33.837+0000 7f6bbbfff700 1 -- 172.21.15.71:0/1520078849 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6bd40c8cc0 con 0x7f6bd4159950 2023-10-09T06:57:34.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.102+0000 7f6bda3ff700 1 -- 172.21.15.71:0/1520078849 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6bd40718b0 con 0x7f6bd4159950 2023-10-09T06:57:34.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.107+0000 7f6bbbfff700 1 -- 172.21.15.71:0/1520078849 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6bcc051e40 con 0x7f6bd4159950 2023-10-09T06:57:34.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.110+0000 7f6bda3ff700 1 -- 172.21.15.71:0/1520078849 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6bc0066f30 msgr2=0x7f6bc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:34.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.110+0000 7f6bda3ff700 1 --2- 172.21.15.71:0/1520078849 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6bc0066f30 0x7f6bc00693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6bd415d450 tx=0x7f6bc4017000 comp rx=0 tx=0).stop 2023-10-09T06:57:34.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.110+0000 7f6bda3ff700 1 -- 172.21.15.71:0/1520078849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bd4159950 msgr2=0x7f6bd415c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:34.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.110+0000 7f6bda3ff700 1 --2- 172.21.15.71:0/1520078849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bd4159950 0x7f6bd415c0d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc007f20 tx=0x7f6bcc009860 comp rx=0 tx=0).stop 2023-10-09T06:57:34.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.110+0000 7f6bda3ff700 1 -- 172.21.15.71:0/1520078849 shutdown_connections 2023-10-09T06:57:34.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.110+0000 7f6bda3ff700 1 --2- 172.21.15.71:0/1520078849 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6bc0066f30 0x7f6bc00693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:34.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.110+0000 7f6bda3ff700 1 --2- 172.21.15.71:0/1520078849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bd4159950 0x7f6bd415c0d0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:34.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.110+0000 7f6bda3ff700 1 --2- 172.21.15.71:0/1520078849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bd4069aa0 0x7f6bd4141040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:34.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.110+0000 7f6bda3ff700 1 --2- 172.21.15.71:0/1520078849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bd40af320 0x7f6bd415bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:34.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.110+0000 7f6bda3ff700 1 -- 172.21.15.71:0/1520078849 >> 172.21.15.71:0/1520078849 conn(0x7f6bd4068e00 msgr2=0x7f6bd41532b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:34.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.110+0000 7f6bda3ff700 1 -- 172.21.15.71:0/1520078849 shutdown_connections 2023-10-09T06:57:34.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.110+0000 7f6bda3ff700 1 -- 172.21.15.71:0/1520078849 wait complete. 2023-10-09T06:57:34.113 INFO:teuthology.orchestra.run.smithi071.stderr:updated caps for client.0 2023-10-09T06:57:34.127 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:57:34.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.308+0000 7fe9c1dff700 1 Processor -- start 2023-10-09T06:57:34.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.308+0000 7fe9c1dff700 1 -- start start 2023-10-09T06:57:34.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.309+0000 7fe9c1dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe9bc159890 0x7fe9bc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:34.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.309+0000 7fe9c1dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe9bc159c60 0x7fe9bc15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:34.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.309+0000 7fe9c1dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9bc15db10 0x7fe9bc069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:34.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.309+0000 7fe9c1dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9bc15df50 con 0x7fe9bc159890 2023-10-09T06:57:34.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.309+0000 7fe9c1dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9bc15a160 con 0x7fe9bc159c60 2023-10-09T06:57:34.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.309+0000 7fe9c1dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc0d13a0 con 0x7fe9bc15db10 2023-10-09T06:57:34.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.310+0000 7fe9bb7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe9bc159890 0x7fe9bc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:34.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.310+0000 7fe9bb7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe9bc159890 0x7fe9bc15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34174/0 (socket says 172.21.15.71:34174) 2023-10-09T06:57:34.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.310+0000 7fe9bb7fe700 1 -- 172.21.15.71:0/1080058134 learned_addr learned my addr 172.21.15.71:0/1080058134 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:34.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.310+0000 7fe9bbfff700 1 --2- 172.21.15.71:0/1080058134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9bc15db10 0x7fe9bc069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:34.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.310+0000 7fe9baffd700 1 --2- 172.21.15.71:0/1080058134 >> v2:172.21.15.179:3300/0 conn(0x7fe9bc159c60 0x7fe9bc15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:34.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.310+0000 7fe9bb7fe700 1 -- 172.21.15.71:0/1080058134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9bc15db10 msgr2=0x7fe9bc069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:34.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.310+0000 7fe9bb7fe700 1 --2- 172.21.15.71:0/1080058134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9bc15db10 0x7fe9bc069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:34.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.310+0000 7fe9bb7fe700 1 -- 172.21.15.71:0/1080058134 >> v2:172.21.15.179:3300/0 conn(0x7fe9bc159c60 msgr2=0x7fe9bc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:34.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.310+0000 7fe9bb7fe700 1 --2- 172.21.15.71:0/1080058134 >> v2:172.21.15.179:3300/0 conn(0x7fe9bc159c60 0x7fe9bc15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:34.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.310+0000 7fe9bb7fe700 1 -- 172.21.15.71:0/1080058134 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9bc15e140 con 0x7fe9bc159890 2023-10-09T06:57:34.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.310+0000 7fe9bb7fe700 1 --2- 172.21.15.71:0/1080058134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9bc159890 0x7fe9bc15abd0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0b67f0 tx=0x7fe9ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d992e59f0ffd407 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:34.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.311+0000 7fe9ba7fc700 1 -- 172.21.15.71:0/1080058134 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac00b860 con 0x7fe9bc159890 2023-10-09T06:57:34.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.311+0000 7fe9ba7fc700 1 -- 172.21.15.71:0/1080058134 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac00b9c0 con 0x7fe9bc159890 2023-10-09T06:57:34.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.311+0000 7fe9ba7fc700 1 -- 172.21.15.71:0/1080058134 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac00bd60 con 0x7fe9bc159890 2023-10-09T06:57:34.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.311+0000 7fe9c1dff700 1 -- 172.21.15.71:0/1080058134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9bc159890 msgr2=0x7fe9bc15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:34.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.311+0000 7fe9c1dff700 1 --2- 172.21.15.71:0/1080058134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9bc159890 0x7fe9bc15abd0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0b67f0 tx=0x7fe9ac009250 comp rx=0 tx=0).stop 2023-10-09T06:57:34.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.311+0000 7fe9c1dff700 1 -- 172.21.15.71:0/1080058134 shutdown_connections 2023-10-09T06:57:34.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.311+0000 7fe9c1dff700 1 --2- 172.21.15.71:0/1080058134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9bc15db10 0x7fe9bc069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:34.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.311+0000 7fe9c1dff700 1 --2- 172.21.15.71:0/1080058134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9bc159890 0x7fe9bc15abd0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:34.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.311+0000 7fe9c1dff700 1 --2- 172.21.15.71:0/1080058134 >> v2:172.21.15.179:3300/0 conn(0x7fe9bc159c60 0x7fe9bc15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:34.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.311+0000 7fe9c1dff700 1 -- 172.21.15.71:0/1080058134 >> 172.21.15.71:0/1080058134 conn(0x7fe9bc068e20 msgr2=0x7fe9bc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:34.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.311+0000 7fe9c1dff700 1 -- 172.21.15.71:0/1080058134 shutdown_connections 2023-10-09T06:57:34.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.311+0000 7fe9c1dff700 1 -- 172.21.15.71:0/1080058134 wait complete. 2023-10-09T06:57:34.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.313+0000 7fe9c1dff700 1 Processor -- start 2023-10-09T06:57:34.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.313+0000 7fe9c1dff700 1 -- start start 2023-10-09T06:57:34.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.314+0000 7fe9c1dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9bc159890 0x7fe9bc158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:34.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.314+0000 7fe9c1dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9bc159c60 0x7fe9bc0cf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:34.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.314+0000 7fe9c1dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9bc15db10 0x7fe9bc0c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:34.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.314+0000 7fe9c1dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc0b4610 con 0x7fe9bc159890 2023-10-09T06:57:34.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.314+0000 7fe9c1dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc158e50 con 0x7fe9bc15db10 2023-10-09T06:57:34.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.314+0000 7fe9c1dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc0cfa50 con 0x7fe9bc159c60 2023-10-09T06:57:34.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.314+0000 7fe9bb7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9bc159890 0x7fe9bc158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:34.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.314+0000 7fe9bb7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9bc159890 0x7fe9bc158910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34190/0 (socket says 172.21.15.71:34190) 2023-10-09T06:57:34.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.314+0000 7fe9bb7fe700 1 -- 172.21.15.71:0/765190121 learned_addr learned my addr 172.21.15.71:0/765190121 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:34.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.314+0000 7fe9baffd700 1 --2- 172.21.15.71:0/765190121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9bc159c60 0x7fe9bc0cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:34.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.314+0000 7fe9bbfff700 1 --2- 172.21.15.71:0/765190121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9bc15db10 0x7fe9bc0c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:34.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.314+0000 7fe9bb7fe700 1 -- 172.21.15.71:0/765190121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9bc159c60 msgr2=0x7fe9bc0cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:34.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.314+0000 7fe9bb7fe700 1 --2- 172.21.15.71:0/765190121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9bc159c60 0x7fe9bc0cf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:34.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.314+0000 7fe9bb7fe700 1 -- 172.21.15.71:0/765190121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9bc15db10 msgr2=0x7fe9bc0c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:34.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.314+0000 7fe9bb7fe700 1 --2- 172.21.15.71:0/765190121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9bc15db10 0x7fe9bc0c82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:34.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.314+0000 7fe9bb7fe700 1 -- 172.21.15.71:0/765190121 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ac0094f0 con 0x7fe9bc159890 2023-10-09T06:57:34.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.315+0000 7fe9bb7fe700 1 --2- 172.21.15.71:0/765190121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9bc159890 0x7fe9bc158910 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac006fd0 tx=0x7fe9ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:34.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.315+0000 7fe9a37fe700 1 -- 172.21.15.71:0/765190121 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac024440 con 0x7fe9bc159890 2023-10-09T06:57:34.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.315+0000 7fe9a37fe700 1 -- 172.21.15.71:0/765190121 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac0245a0 con 0x7fe9bc159890 2023-10-09T06:57:34.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.315+0000 7fe9a37fe700 1 -- 172.21.15.71:0/765190121 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac024960 con 0x7fe9bc159890 2023-10-09T06:57:34.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.315+0000 7fe9c1dff700 1 -- 172.21.15.71:0/765190121 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9bc0cf080 con 0x7fe9bc159890 2023-10-09T06:57:34.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.315+0000 7fe9c1dff700 1 -- 172.21.15.71:0/765190121 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9bc0ce7d0 con 0x7fe9bc159890 2023-10-09T06:57:34.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.316+0000 7fe9c1dff700 1 -- 172.21.15.71:0/765190121 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9bc04c3c0 con 0x7fe9bc159890 2023-10-09T06:57:34.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.317+0000 7fe9a37fe700 1 -- 172.21.15.71:0/765190121 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe9ac01a420 con 0x7fe9bc159890 2023-10-09T06:57:34.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.318+0000 7fe9a37fe700 1 --2- 172.21.15.71:0/765190121 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe9a8066f30 0x7fe9a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:34.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.318+0000 7fe9a37fe700 1 -- 172.21.15.71:0/765190121 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fe9ac086660 con 0x7fe9bc159890 2023-10-09T06:57:34.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.319+0000 7fe9baffd700 1 --2- 172.21.15.71:0/765190121 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe9a8066f30 0x7fe9a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:34.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.319+0000 7fe9baffd700 1 --2- 172.21.15.71:0/765190121 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe9a8066f30 0x7fe9a80693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0c7a70 tx=0x7fe9b0008040 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:34.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.322+0000 7fe9a37fe700 1 -- 172.21.15.71:0/765190121 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9ac0536a0 con 0x7fe9bc159890 2023-10-09T06:57:34.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.555+0000 7fe9c1dff700 1 -- 172.21.15.71:0/765190121 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9bc0c5c80 con 0x7fe9bc159890 2023-10-09T06:57:34.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.556+0000 7fe9a37fe700 1 -- 172.21.15.71:0/765190121 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fe9ac056cc0 con 0x7fe9bc159890 2023-10-09T06:57:34.556 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:34.556 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6055,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3774833170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3774833170},{"type":"v1","addr":"172.21.15.179:6836","nonce":3774833170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6058,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3203736717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3203736717},{"type":"v1","addr":"172.21.15.179:6837","nonce":3203736717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2747804060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2747804060},{"type":"v1","addr":"172.21.15.71:6833","nonce":2747804060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:57:28.273000+0000","modified":"2023-10-09T06:57:31.823203+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6240},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6240":{"gid":6240,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/3993456703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3993456703},{"type":"v1","addr":"172.21.15.71:6835","nonce":3993456703}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T06:57:34.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.558+0000 7fe9c1dff700 1 -- 172.21.15.71:0/765190121 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe9a8066f30 msgr2=0x7fe9a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:34.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.558+0000 7fe9c1dff700 1 --2- 172.21.15.71:0/765190121 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe9a8066f30 0x7fe9a80693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0c7a70 tx=0x7fe9b0008040 comp rx=0 tx=0).stop 2023-10-09T06:57:34.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.558+0000 7fe9c1dff700 1 -- 172.21.15.71:0/765190121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9bc159890 msgr2=0x7fe9bc158910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:34.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.558+0000 7fe9c1dff700 1 --2- 172.21.15.71:0/765190121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9bc159890 0x7fe9bc158910 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac006fd0 tx=0x7fe9ac017000 comp rx=0 tx=0).stop 2023-10-09T06:57:34.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.558+0000 7fe9c1dff700 1 -- 172.21.15.71:0/765190121 shutdown_connections 2023-10-09T06:57:34.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.558+0000 7fe9c1dff700 1 --2- 172.21.15.71:0/765190121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9bc15db10 0x7fe9bc0c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:34.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.558+0000 7fe9c1dff700 1 --2- 172.21.15.71:0/765190121 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe9a8066f30 0x7fe9a80693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:34.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.558+0000 7fe9c1dff700 1 --2- 172.21.15.71:0/765190121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9bc159890 0x7fe9bc158910 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:34.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.558+0000 7fe9c1dff700 1 --2- 172.21.15.71:0/765190121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9bc159c60 0x7fe9bc0cf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:34.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.558+0000 7fe9c1dff700 1 -- 172.21.15.71:0/765190121 >> 172.21.15.71:0/765190121 conn(0x7fe9bc068e20 msgr2=0x7fe9bc069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:34.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.558+0000 7fe9c1dff700 1 -- 172.21.15.71:0/765190121 shutdown_connections 2023-10-09T06:57:34.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:34.558+0000 7fe9c1dff700 1 -- 172.21.15.71:0/765190121 wait complete. 2023-10-09T06:57:34.559 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 33 2023-10-09T06:57:34.978 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T06:57:28.273000+0000', 'modified': '2023-10-09T06:57:31.823203+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6240}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6240': {'gid': 6240, 'name': 'a', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.71:6835/3993456703', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6834', 'nonce': 3993456703}, {'type': 'v1', 'addr': '172.21.15.71:6835', 'nonce': 3993456703}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T06:57:34.978 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T06:57:34.978 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-09T06:57:35.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.161+0000 7f0b251ff700 1 Processor -- start 2023-10-09T06:57:35.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.161+0000 7f0b251ff700 1 -- start start 2023-10-09T06:57:35.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.163+0000 7f0b251ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b20155c10 0x7f0b20155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.163+0000 7f0b251ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b200acac0 con 0x7f0b200ac6a0 2023-10-09T06:57:35.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.163+0000 7f0b251ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b200ad930 con 0x7f0b200ac230 2023-10-09T06:57:35.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.163+0000 7f0b251ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b200acd20 con 0x7f0b20155c10 2023-10-09T06:57:35.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.163+0000 7f0b1f59e700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f0b200ac6a0 0x7f0b200b0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:40148/0 (socket says 172.21.15.71:40148) 2023-10-09T06:57:35.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.163+0000 7f0b1f59e700 1 -- 172.21.15.71:0/2788624194 learned_addr learned my addr 172.21.15.71:0/2788624194 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:35.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.163+0000 7f0b1ed9d700 1 --2- 172.21.15.71:0/2788624194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b20155c10 0x7f0b20155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.163+0000 7f0b1dd9b700 1 -- 172.21.15.71:0/2788624194 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497210519 0 0) 0x7f0b200acac0 con 0x7f0b200ac6a0 2023-10-09T06:57:35.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.163+0000 7f0b1dd9b700 1 -- 172.21.15.71:0/2788624194 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b08003570 con 0x7f0b200ac6a0 2023-10-09T06:57:35.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.164+0000 7f0b1dd9b700 1 -- 172.21.15.71:0/2788624194 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386014670 0 0) 0x7f0b200ad930 con 0x7f0b200ac230 2023-10-09T06:57:35.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.164+0000 7f0b1dd9b700 1 -- 172.21.15.71:0/2788624194 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b200acac0 con 0x7f0b200ac230 2023-10-09T06:57:35.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.164+0000 7f0b1dd9b700 1 -- 172.21.15.71:0/2788624194 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4021307115 0 0) 0x7f0b08003570 con 0x7f0b200ac6a0 2023-10-09T06:57:35.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.164+0000 7f0b1dd9b700 1 -- 172.21.15.71:0/2788624194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b20155c10 msgr2=0x7f0b20155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:35.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.164+0000 7f0b1dd9b700 1 --2- 172.21.15.71:0/2788624194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b20155c10 0x7f0b20155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.164+0000 7f0b1dd9b700 1 -- 172.21.15.71:0/2788624194 >> v1:172.21.15.179:6789/0 conn(0x7f0b200ac230 legacy=0x7f0b201568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:35.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.164+0000 7f0b1dd9b700 1 -- 172.21.15.71:0/2788624194 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b200ad000 con 0x7f0b200ac6a0 2023-10-09T06:57:35.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.164+0000 7f0b1dd9b700 1 -- 172.21.15.71:0/2788624194 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f0b180017f0 con 0x7f0b200ac6a0 2023-10-09T06:57:35.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.164+0000 7f0b1dd9b700 1 -- 172.21.15.71:0/2788624194 >> v1:172.21.15.71:6789/0 conn(0x7f0b200ac6a0 legacy=0x7f0b200b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:35.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.164+0000 7f0b1dd9b700 1 --2- 172.21.15.71:0/2788624194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b08003c20 0x7f0b08004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.164+0000 7f0b1dd9b700 1 --2- 172.21.15.71:0/2788624194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b08004810 0x7f0b08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.164+0000 7f0b1dd9b700 1 --2- 172.21.15.71:0/2788624194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b20155c10 0x7f0b08005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.164+0000 7f0b1dd9b700 1 -- 172.21.15.71:0/2788624194 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b200acd20 con 0x7f0b08003c20 2023-10-09T06:57:35.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.164+0000 7f0b1dd9b700 1 -- 172.21.15.71:0/2788624194 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0800bbf0 con 0x7f0b08004810 2023-10-09T06:57:35.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.164+0000 7f0b1dd9b700 1 -- 172.21.15.71:0/2788624194 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0800bdb0 con 0x7f0b20155c10 2023-10-09T06:57:35.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.164+0000 7f0b1ed9d700 1 --2- 172.21.15.71:0/2788624194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b08003c20 0x7f0b08004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.164+0000 7f0b1f59e700 1 --2- 172.21.15.71:0/2788624194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b20155c10 0x7f0b08005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.164+0000 7f0b1e59c700 1 --2- 172.21.15.71:0/2788624194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b08004810 0x7f0b08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.165+0000 7f0b1ed9d700 1 -- 172.21.15.71:0/2788624194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b20155c10 msgr2=0x7f0b08005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:35.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.165+0000 7f0b1ed9d700 1 --2- 172.21.15.71:0/2788624194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b20155c10 0x7f0b08005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.165+0000 7f0b1ed9d700 1 -- 172.21.15.71:0/2788624194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b08004810 msgr2=0x7f0b08004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:35.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.165+0000 7f0b1ed9d700 1 --2- 172.21.15.71:0/2788624194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b08004810 0x7f0b08004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.165+0000 7f0b1ed9d700 1 -- 172.21.15.71:0/2788624194 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b08003570 con 0x7f0b08003c20 2023-10-09T06:57:35.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.165+0000 7f0b1e59c700 1 --2- 172.21.15.71:0/2788624194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b08004810 0x7f0b08004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:35.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.165+0000 7f0b1ed9d700 1 --2- 172.21.15.71:0/2788624194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b08003c20 0x7f0b08004010 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009c00 tx=0x7f0b100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a005d1613bf8375 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:35.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.165+0000 7f0b1dd9b700 1 -- 172.21.15.71:0/2788624194 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1000e710 con 0x7f0b08003c20 2023-10-09T06:57:35.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.165+0000 7f0b1dd9b700 1 -- 172.21.15.71:0/2788624194 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1000e870 con 0x7f0b08003c20 2023-10-09T06:57:35.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.165+0000 7f0b1dd9b700 1 -- 172.21.15.71:0/2788624194 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1000ec30 con 0x7f0b08003c20 2023-10-09T06:57:35.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.166+0000 7f0b251ff700 1 -- 172.21.15.71:0/2788624194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b08003c20 msgr2=0x7f0b08004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:35.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.166+0000 7f0b251ff700 1 --2- 172.21.15.71:0/2788624194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b08003c20 0x7f0b08004010 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009c00 tx=0x7f0b100091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.166+0000 7f0b1f59e700 1 -- 172.21.15.71:0/2788624194 reap_dead start 2023-10-09T06:57:35.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.166+0000 7f0b251ff700 1 -- 172.21.15.71:0/2788624194 shutdown_connections 2023-10-09T06:57:35.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.166+0000 7f0b251ff700 1 -- 172.21.15.71:0/2788624194 >> 172.21.15.71:0/2788624194 conn(0x7f0b2006a320 msgr2=0x7f0b200cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:35.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.166+0000 7f0b251ff700 1 -- 172.21.15.71:0/2788624194 shutdown_connections 2023-10-09T06:57:35.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.166+0000 7f0b251ff700 1 -- 172.21.15.71:0/2788624194 wait complete. 2023-10-09T06:57:35.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.167+0000 7f0b251ff700 1 Processor -- start 2023-10-09T06:57:35.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.167+0000 7f0b251ff700 1 -- start start 2023-10-09T06:57:35.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.168+0000 7f0b251ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b08003c20 0x7f0b200cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.168+0000 7f0b251ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b2013e5f0 0x7f0b200c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.168+0000 7f0b251ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b200ca490 0x7f0b20141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.168+0000 7f0b251ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b200cc480 con 0x7f0b2013e5f0 2023-10-09T06:57:35.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.168+0000 7f0b251ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b200cbab0 con 0x7f0b08003c20 2023-10-09T06:57:35.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.168+0000 7f0b251ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b200cabc0 con 0x7f0b200ca490 2023-10-09T06:57:35.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.168+0000 7f0b1e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b2013e5f0 0x7f0b200c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.168+0000 7f0b1e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b2013e5f0 0x7f0b200c9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51986/0 (socket says 172.21.15.71:51986) 2023-10-09T06:57:35.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.168+0000 7f0b1e59c700 1 -- 172.21.15.71:0/901546562 learned_addr learned my addr 172.21.15.71:0/901546562 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:35.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.169+0000 7f0b1e59c700 1 -- 172.21.15.71:0/901546562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b200ca490 msgr2=0x7f0b20141900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:35.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.169+0000 7f0b1e59c700 1 --2- 172.21.15.71:0/901546562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b200ca490 0x7f0b20141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.169+0000 7f0b1e59c700 1 -- 172.21.15.71:0/901546562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b08003c20 msgr2=0x7f0b200cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:35.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.169+0000 7f0b1e59c700 1 --2- 172.21.15.71:0/901546562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b08003c20 0x7f0b200cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.169+0000 7f0b1e59c700 1 -- 172.21.15.71:0/901546562 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b200caea0 con 0x7f0b2013e5f0 2023-10-09T06:57:35.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.169+0000 7f0b1e59c700 1 --2- 172.21.15.71:0/901546562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b2013e5f0 0x7f0b200c9f50 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400e870 tx=0x7f0b14009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:35.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.169+0000 7f0b06ffd700 1 -- 172.21.15.71:0/901546562 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b14006820 con 0x7f0b2013e5f0 2023-10-09T06:57:35.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.169+0000 7f0b06ffd700 1 -- 172.21.15.71:0/901546562 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b14006980 con 0x7f0b2013e5f0 2023-10-09T06:57:35.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.169+0000 7f0b06ffd700 1 -- 172.21.15.71:0/901546562 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b14006d40 con 0x7f0b2013e5f0 2023-10-09T06:57:35.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.169+0000 7f0b251ff700 1 -- 172.21.15.71:0/901546562 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b200cb180 con 0x7f0b2013e5f0 2023-10-09T06:57:35.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.169+0000 7f0b251ff700 1 -- 172.21.15.71:0/901546562 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b200cb740 con 0x7f0b2013e5f0 2023-10-09T06:57:35.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.172+0000 7f0b06ffd700 1 -- 172.21.15.71:0/901546562 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0b14007230 con 0x7f0b2013e5f0 2023-10-09T06:57:35.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.173+0000 7f0b06ffd700 1 --2- 172.21.15.71:0/901546562 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0b0c066f30 0x7f0b0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.173+0000 7f0b06ffd700 1 -- 172.21.15.71:0/901546562 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f0b14084960 con 0x7f0b2013e5f0 2023-10-09T06:57:35.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.174+0000 7f0b1ed9d700 1 --2- 172.21.15.71:0/901546562 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0b0c066f30 0x7f0b0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.174+0000 7f0b1ed9d700 1 --2- 172.21.15.71:0/901546562 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0b0c066f30 0x7f0b0c0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0b100091e0 tx=0x7f0b1001a000 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:35.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.175+0000 7f0b338b8b80 1 Processor -- start 2023-10-09T06:57:35.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.175+0000 7f0b338b8b80 1 -- start start 2023-10-09T06:57:35.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.175+0000 7f0b338b8b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5612eaca9a50 0x5612eaca9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.176+0000 7f0b338b8b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eacf3d00 0x5612eacd2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.176+0000 7f0b338b8b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612eacd2f60 0x5612eaca5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.176+0000 7f0b338b8b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612eac00a70 con 0x5612eacf3d00 2023-10-09T06:57:35.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.176+0000 7f0b338b8b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612eabfe270 con 0x5612eacd2f60 2023-10-09T06:57:35.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.176+0000 7f0b338b8b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5612eabfa060 con 0x5612eaca9a50 2023-10-09T06:57:35.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.176+0000 7f0b1e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eacf3d00 0x5612eacd2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.176+0000 7f0b1e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eacf3d00 0x5612eacd2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51996/0 (socket says 172.21.15.71:51996) 2023-10-09T06:57:35.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.176+0000 7f0b1e59c700 1 -- 172.21.15.71:0/1190025116 learned_addr learned my addr 172.21.15.71:0/1190025116 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:35.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.176+0000 7f0b1ed9d700 1 --2- 172.21.15.71:0/1190025116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5612eaca9a50 0x5612eaca9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.176+0000 7f0b1f59e700 1 --2- 172.21.15.71:0/1190025116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612eacd2f60 0x5612eaca5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.176+0000 7f0b1e59c700 1 -- 172.21.15.71:0/1190025116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5612eaca9a50 msgr2=0x5612eaca9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:35.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.176+0000 7f0b1e59c700 1 --2- 172.21.15.71:0/1190025116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5612eaca9a50 0x5612eaca9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.176+0000 7f0b1e59c700 1 -- 172.21.15.71:0/1190025116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612eacd2f60 msgr2=0x5612eaca5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:35.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.176+0000 7f0b1e59c700 1 --2- 172.21.15.71:0/1190025116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612eacd2f60 0x5612eaca5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.176+0000 7f0b1e59c700 1 -- 172.21.15.71:0/1190025116 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612eaa94270 con 0x5612eacf3d00 2023-10-09T06:57:35.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.176+0000 7f0b1e59c700 1 --2- 172.21.15.71:0/1190025116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eacf3d00 0x5612eacd2a20 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0b14082cf0 tx=0x7f0b14082c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e7d0ba16d2df67 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:35.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.177+0000 7f0b04ff9700 1 -- 172.21.15.71:0/1190025116 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b14055700 con 0x5612eacf3d00 2023-10-09T06:57:35.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.177+0000 7f0b04ff9700 1 -- 172.21.15.71:0/1190025116 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b14058950 con 0x5612eacf3d00 2023-10-09T06:57:35.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.177+0000 7f0b04ff9700 1 -- 172.21.15.71:0/1190025116 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1405c6a0 con 0x5612eacf3d00 2023-10-09T06:57:35.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.177+0000 7f0b338b8b80 1 -- 172.21.15.71:0/1190025116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eacf3d00 msgr2=0x5612eacd2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:35.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.177+0000 7f0b338b8b80 1 --2- 172.21.15.71:0/1190025116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eacf3d00 0x5612eacd2a20 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0b14082cf0 tx=0x7f0b14082c50 comp rx=0 tx=0).stop 2023-10-09T06:57:35.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.177+0000 7f0b338b8b80 1 -- 172.21.15.71:0/1190025116 shutdown_connections 2023-10-09T06:57:35.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.177+0000 7f0b338b8b80 1 --2- 172.21.15.71:0/1190025116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612eacd2f60 0x5612eaca5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.177+0000 7f0b338b8b80 1 --2- 172.21.15.71:0/1190025116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5612eaca9a50 0x5612eaca9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.177+0000 7f0b338b8b80 1 --2- 172.21.15.71:0/1190025116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eacf3d00 0x5612eacd2a20 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.177+0000 7f0b338b8b80 1 -- 172.21.15.71:0/1190025116 >> 172.21.15.71:0/1190025116 conn(0x5612eacab370 msgr2=0x5612eacab740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:35.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.177+0000 7f0b338b8b80 1 -- 172.21.15.71:0/1190025116 shutdown_connections 2023-10-09T06:57:35.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.177+0000 7f0b338b8b80 1 -- 172.21.15.71:0/1190025116 wait complete. 2023-10-09T06:57:35.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.178+0000 7f0b338b8b80 1 -- start start 2023-10-09T06:57:35.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.178+0000 7f0b338b8b80 1 Processor -- start 2023-10-09T06:57:35.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.179+0000 7f0b338b8b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eaca9a50 0x5612eacebbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.179+0000 7f0b338b8b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5612eacd2f60 0x5612eacea2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.179+0000 7f0b338b8b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612eacf3d00 0x5612eacce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.179+0000 7f0b338b8b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612eaba5890 con 0x5612eaca9a50 2023-10-09T06:57:35.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.179+0000 7f0b338b8b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612eabc0ea0 con 0x5612eacf3d00 2023-10-09T06:57:35.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.179+0000 7f0b338b8b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5612eaa7ce30 con 0x5612eacd2f60 2023-10-09T06:57:35.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.179+0000 7f0b338b8b80 10 client.0 _ll_register_callbacks cb 0x5612eac6d110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:57:35.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.179+0000 7f0b1ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eaca9a50 0x5612eacebbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.180+0000 7f0b1ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eaca9a50 0x5612eacebbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52004/0 (socket says 172.21.15.71:52004) 2023-10-09T06:57:35.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.180+0000 7f0b1ed9d700 1 -- 172.21.15.71:0/3091853483 learned_addr learned my addr 172.21.15.71:0/3091853483 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:35.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.180+0000 7f0b1e59c700 1 --2- 172.21.15.71:0/3091853483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5612eacd2f60 0x5612eacea2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.180+0000 7f0b1f59e700 1 --2- 172.21.15.71:0/3091853483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612eacf3d00 0x5612eacce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.180+0000 7f0b1ed9d700 1 -- 172.21.15.71:0/3091853483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5612eacd2f60 msgr2=0x5612eacea2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:35.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.180+0000 7f0b1ed9d700 1 --2- 172.21.15.71:0/3091853483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5612eacd2f60 0x5612eacea2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.180+0000 7f0b1ed9d700 1 -- 172.21.15.71:0/3091853483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612eacf3d00 msgr2=0x5612eacce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:35.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.180+0000 7f0b1ed9d700 1 --2- 172.21.15.71:0/3091853483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612eacf3d00 0x5612eacce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.180+0000 7f0b1ed9d700 1 -- 172.21.15.71:0/3091853483 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b200cb740 con 0x5612eaca9a50 2023-10-09T06:57:35.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.180+0000 7f0b1ed9d700 1 --2- 172.21.15.71:0/3091853483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eaca9a50 0x5612eacebbe0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f0b080057f0 tx=0x7f0b10022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6620f2c461c229a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:35.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.180+0000 7f0afd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T06:57:35.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.180+0000 7f0afd7fa700 1 -- 172.21.15.71:0/3091853483 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b10030070 con 0x5612eaca9a50 2023-10-09T06:57:35.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.180+0000 7f0afd7fa700 1 -- 172.21.15.71:0/3091853483 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f0b10013d10 con 0x5612eaca9a50 2023-10-09T06:57:35.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.180+0000 7f0b338b8b80 1 -- 172.21.15.71:0/3091853483 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5612eac9eb70 con 0x5612eaca9a50 2023-10-09T06:57:35.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.181+0000 7f0afd7fa700 1 -- 172.21.15.71:0/3091853483 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b10022070 con 0x5612eaca9a50 2023-10-09T06:57:35.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.181+0000 7f0b338b8b80 10 client.6375 fetch_fsmap learned FSMap version 33 2023-10-09T06:57:35.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.181+0000 7f0b338b8b80 1 -- 172.21.15.71:0/3091853483 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x5612eaa36fe0 con 0x5612eaca9a50 2023-10-09T06:57:35.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.181+0000 7f0afd7fa700 1 -- 172.21.15.71:0/3091853483 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5612eac9eb70 con 0x5612eaca9a50 2023-10-09T06:57:35.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.181+0000 7f0afd7fa700 1 -- 172.21.15.71:0/3091853483 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 33) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0b1001c660 con 0x5612eaca9a50 2023-10-09T06:57:35.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.181+0000 7f0b338b8b80 10 client.6375 fetch_fsmap finished waiting for FSMap version 33 2023-10-09T06:57:35.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.181+0000 7f0b338b8b80 10 client.6375 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T06:57:35.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.181+0000 7f0b338b8b80 20 client.6375 populate_metadata read hostname 'smithi071' 2023-10-09T06:57:35.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.181+0000 7f0b338b8b80 1 --2- 172.21.15.71:0/3091853483 >> [v2:172.21.15.71:6834/3993456703,v1:172.21.15.71:6835/3993456703] conn(0x5612ead03850 0x5612ead03c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.181+0000 7f0b338b8b80 4 client.6375 mds_command: new command op to 6240 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T06:57:35.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.181+0000 7f0b338b8b80 1 -- 172.21.15.71:0/3091853483 --> [v2:172.21.15.71:6834/3993456703,v1:172.21.15.71:6835/3993456703] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5612eac7baa0 con 0x5612ead03850 2023-10-09T06:57:35.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.181+0000 7f0b1e59c700 1 --2- 172.21.15.71:0/3091853483 >> [v2:172.21.15.71:6834/3993456703,v1:172.21.15.71:6835/3993456703] conn(0x5612ead03850 0x5612ead03c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.182+0000 7f0afd7fa700 10 client.6375 ms_handle_connect on v2:172.21.15.71:6834/3993456703 2023-10-09T06:57:35.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.182+0000 7f0b1e59c700 1 --2- 172.21.15.71:0/3091853483 >> [v2:172.21.15.71:6834/3993456703,v1:172.21.15.71:6835/3993456703] conn(0x5612ead03850 0x5612ead03c20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bc71346266a6d17 server_cookie=3c6e1250cb317fb3 in_seq=0 out_seq=0 2023-10-09T06:57:35.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.182+0000 7f0afd7fa700 1 -- 172.21.15.71:0/3091853483 <== mds.0 v2:172.21.15.71:6834/3993456703 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5612eac7baa0 con 0x5612ead03850 2023-10-09T06:57:35.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.182+0000 7f0afd7fa700 10 client.6375 handle_command_reply: tid=0 2023-10-09T06:57:35.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.182+0000 7f0b338b8b80 1 client.6375 shutdown 2023-10-09T06:57:35.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.183+0000 7f0b338b8b80 1 -- 172.21.15.71:0/3091853483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eaca9a50 msgr2=0x5612eacebbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:35.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.183+0000 7f0b338b8b80 1 --2- 172.21.15.71:0/3091853483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eaca9a50 0x5612eacebbe0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f0b080057f0 tx=0x7f0b10022000 comp rx=0 tx=0).stop 2023-10-09T06:57:35.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.183+0000 7f0b338b8b80 1 -- 172.21.15.71:0/3091853483 shutdown_connections 2023-10-09T06:57:35.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.183+0000 7f0b338b8b80 1 --2- 172.21.15.71:0/3091853483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612eacf3d00 0x5612eacce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.183+0000 7f0b338b8b80 1 --2- 172.21.15.71:0/3091853483 >> [v2:172.21.15.71:6834/3993456703,v1:172.21.15.71:6835/3993456703] conn(0x5612ead03850 0x5612ead03c20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.183+0000 7f0b338b8b80 1 --2- 172.21.15.71:0/3091853483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eaca9a50 0x5612eacebbe0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.183+0000 7f0b338b8b80 1 --2- 172.21.15.71:0/3091853483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5612eacd2f60 0x5612eacea2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.183+0000 7f0afd7fa700 0 client.6375 ms_handle_reset on v2:172.21.15.71:6834/3993456703 2023-10-09T06:57:35.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.183+0000 7f0b338b8b80 1 -- 172.21.15.71:0/3091853483 >> 172.21.15.71:0/3091853483 conn(0x5612eacab370 msgr2=0x5612eaca68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:35.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.183+0000 7f0b338b8b80 1 -- 172.21.15.71:0/3091853483 shutdown_connections 2023-10-09T06:57:35.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.183+0000 7f0b338b8b80 1 -- 172.21.15.71:0/3091853483 wait complete. 2023-10-09T06:57:35.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.183+0000 7f0b338b8b80 20 client.6375 trim_cache size 0 max 16384 2023-10-09T06:57:35.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.200+0000 7f0b338b8b80 1 Processor -- start 2023-10-09T06:57:35.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.200+0000 7f0b338b8b80 1 -- start start 2023-10-09T06:57:35.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.201+0000 7f0b338b8b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5612eaca9a50 0x5612eacaccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.201+0000 7f0b338b8b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612eacd2f60 0x5612eaceb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.201+0000 7f0b338b8b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eacf3d00 0x5612eacd9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.201+0000 7f0b338b8b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612eacd2110 con 0x5612eacf3d00 2023-10-09T06:57:35.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.201+0000 7f0b338b8b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612eac89510 con 0x5612eacd2f60 2023-10-09T06:57:35.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.201+0000 7f0b338b8b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5612eac82410 con 0x5612eaca9a50 2023-10-09T06:57:35.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.201+0000 7f0b1f59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eacf3d00 0x5612eacd9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.201+0000 7f0b1f59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eacf3d00 0x5612eacd9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52010/0 (socket says 172.21.15.71:52010) 2023-10-09T06:57:35.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.201+0000 7f0b1f59e700 1 -- 172.21.15.71:0/1912102581 learned_addr learned my addr 172.21.15.71:0/1912102581 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:35.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.201+0000 7f0b1ed9d700 1 --2- 172.21.15.71:0/1912102581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5612eaca9a50 0x5612eacaccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.201+0000 7f0b1e59c700 1 --2- 172.21.15.71:0/1912102581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612eacd2f60 0x5612eaceb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.202+0000 7f0b1f59e700 1 -- 172.21.15.71:0/1912102581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5612eaca9a50 msgr2=0x5612eacaccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:35.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.202+0000 7f0b1f59e700 1 --2- 172.21.15.71:0/1912102581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5612eaca9a50 0x5612eacaccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.202+0000 7f0b1f59e700 1 -- 172.21.15.71:0/1912102581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612eacd2f60 msgr2=0x5612eaceb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:35.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.202+0000 7f0b1f59e700 1 --2- 172.21.15.71:0/1912102581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612eacd2f60 0x5612eaceb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.202+0000 7f0b1f59e700 1 -- 172.21.15.71:0/1912102581 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612eaccf6e0 con 0x5612eacf3d00 2023-10-09T06:57:35.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.202+0000 7f0b1e59c700 1 --2- 172.21.15.71:0/1912102581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612eacd2f60 0x5612eaceb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:35.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.202+0000 7f0b1f59e700 1 --2- 172.21.15.71:0/1912102581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eacf3d00 0x5612eacd9360 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f0b200ae0f0 tx=0x7f0b18009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40add64ca6ea608e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:35.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.202+0000 7f0b057fa700 1 -- 172.21.15.71:0/1912102581 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1801a030 con 0x5612eacf3d00 2023-10-09T06:57:35.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.202+0000 7f0b057fa700 1 -- 172.21.15.71:0/1912102581 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b18007a40 con 0x5612eacf3d00 2023-10-09T06:57:35.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.202+0000 7f0b057fa700 1 -- 172.21.15.71:0/1912102581 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b180156a0 con 0x5612eacf3d00 2023-10-09T06:57:35.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.203+0000 7f0b338b8b80 1 -- 172.21.15.71:0/1912102581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eacf3d00 msgr2=0x5612eacd9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:35.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.203+0000 7f0b338b8b80 1 --2- 172.21.15.71:0/1912102581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eacf3d00 0x5612eacd9360 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f0b200ae0f0 tx=0x7f0b18009040 comp rx=0 tx=0).stop 2023-10-09T06:57:35.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.203+0000 7f0b338b8b80 1 -- 172.21.15.71:0/1912102581 shutdown_connections 2023-10-09T06:57:35.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.203+0000 7f0b338b8b80 1 --2- 172.21.15.71:0/1912102581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eacf3d00 0x5612eacd9360 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.203+0000 7f0b338b8b80 1 --2- 172.21.15.71:0/1912102581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5612eaca9a50 0x5612eacaccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.203+0000 7f0b338b8b80 1 --2- 172.21.15.71:0/1912102581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612eacd2f60 0x5612eaceb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.203+0000 7f0b338b8b80 1 -- 172.21.15.71:0/1912102581 >> 172.21.15.71:0/1912102581 conn(0x5612eacab370 msgr2=0x5612ead01ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:35.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.203+0000 7f0b338b8b80 1 -- 172.21.15.71:0/1912102581 shutdown_connections 2023-10-09T06:57:35.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.203+0000 7f0b338b8b80 1 -- 172.21.15.71:0/1912102581 wait complete. 2023-10-09T06:57:35.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.203+0000 7f0b338b8b80 1 -- start start 2023-10-09T06:57:35.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.204+0000 7f0b338b8b80 1 Processor -- start 2023-10-09T06:57:35.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.204+0000 7f0b338b8b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eaca9a50 0x5612eacf2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.204+0000 7f0b338b8b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5612eacd2f60 0x5612ead559a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.204+0000 7f0b338b8b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612eacf3d00 0x5612eacd9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.204+0000 7f0b338b8b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ead562b0 con 0x5612eaca9a50 2023-10-09T06:57:35.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.204+0000 7f0b338b8b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612eaccdec0 con 0x5612eacf3d00 2023-10-09T06:57:35.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.204+0000 7f0b338b8b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5612eace6560 con 0x5612eacd2f60 2023-10-09T06:57:35.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.205+0000 7f0b338b8b80 10 client.0 _ll_register_callbacks cb 0x5612eac6d110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:57:35.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.205+0000 7f0b1ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eaca9a50 0x5612eacf2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.205+0000 7f0b1ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eaca9a50 0x5612eacf2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52024/0 (socket says 172.21.15.71:52024) 2023-10-09T06:57:35.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.205+0000 7f0b1ed9d700 1 -- 172.21.15.71:0/1863175965 learned_addr learned my addr 172.21.15.71:0/1863175965 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:35.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.205+0000 7f0b1e59c700 1 --2- 172.21.15.71:0/1863175965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5612eacd2f60 0x5612ead559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.205+0000 7f0b1f59e700 1 --2- 172.21.15.71:0/1863175965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612eacf3d00 0x5612eacd9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.205+0000 7f0b1ed9d700 1 -- 172.21.15.71:0/1863175965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5612eacd2f60 msgr2=0x5612ead559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:35.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.205+0000 7f0b1ed9d700 1 --2- 172.21.15.71:0/1863175965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5612eacd2f60 0x5612ead559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.205+0000 7f0b1ed9d700 1 -- 172.21.15.71:0/1863175965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612eacf3d00 msgr2=0x5612eacd9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:35.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.205+0000 7f0b1ed9d700 1 --2- 172.21.15.71:0/1863175965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612eacf3d00 0x5612eacd9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.205+0000 7f0b1ed9d700 1 -- 172.21.15.71:0/1863175965 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1800f040 con 0x5612eaca9a50 2023-10-09T06:57:35.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.205+0000 7f0b1ed9d700 1 --2- 172.21.15.71:0/1863175965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eaca9a50 0x5612eacf2680 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f0b1002ad00 tx=0x7f0b10030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557e6147e251551b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:35.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.205+0000 7f0afd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T06:57:35.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.206+0000 7f0afd7fa700 1 -- 172.21.15.71:0/1863175965 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b10022070 con 0x5612eaca9a50 2023-10-09T06:57:35.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.206+0000 7f0afd7fa700 1 -- 172.21.15.71:0/1863175965 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f0b1001c660 con 0x5612eaca9a50 2023-10-09T06:57:35.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.206+0000 7f0b338b8b80 1 -- 172.21.15.71:0/1863175965 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b20147e90 con 0x5612eaca9a50 2023-10-09T06:57:35.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.206+0000 7f0afd7fa700 1 -- 172.21.15.71:0/1863175965 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b10013d10 con 0x5612eaca9a50 2023-10-09T06:57:35.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.206+0000 7f0b338b8b80 10 client.6381 fetch_fsmap learned FSMap version 33 2023-10-09T06:57:35.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.206+0000 7f0b338b8b80 1 -- 172.21.15.71:0/1863175965 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x5612eabc8780 con 0x5612eaca9a50 2023-10-09T06:57:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.206+0000 7f0afd7fa700 1 -- 172.21.15.71:0/1863175965 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b20147e90 con 0x5612eaca9a50 2023-10-09T06:57:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.206+0000 7f0afd7fa700 1 -- 172.21.15.71:0/1863175965 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 33) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0b10006bc0 con 0x5612eaca9a50 2023-10-09T06:57:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.206+0000 7f0b338b8b80 10 client.6381 fetch_fsmap finished waiting for FSMap version 33 2023-10-09T06:57:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.206+0000 7f0b338b8b80 10 client.6381 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T06:57:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.206+0000 7f0b338b8b80 20 client.6381 populate_metadata read hostname 'smithi071' 2023-10-09T06:57:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.206+0000 7f0b338b8b80 1 --2- 172.21.15.71:0/1863175965 >> [v2:172.21.15.71:6834/3993456703,v1:172.21.15.71:6835/3993456703] conn(0x5612eacfe3b0 0x5612eacfe780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.206+0000 7f0b338b8b80 4 client.6381 mds_command: new command op to 6240 tid=0[{"prefix": "status"}] 2023-10-09T06:57:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.206+0000 7f0b338b8b80 1 -- 172.21.15.71:0/1863175965 --> [v2:172.21.15.71:6834/3993456703,v1:172.21.15.71:6835/3993456703] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f0b14058950 con 0x5612eacfe3b0 2023-10-09T06:57:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.207+0000 7f0b1e59c700 1 --2- 172.21.15.71:0/1863175965 >> [v2:172.21.15.71:6834/3993456703,v1:172.21.15.71:6835/3993456703] conn(0x5612eacfe3b0 0x5612eacfe780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.207+0000 7f0b1e59c700 1 --2- 172.21.15.71:0/1863175965 >> [v2:172.21.15.71:6834/3993456703,v1:172.21.15.71:6835/3993456703] conn(0x5612eacfe3b0 0x5612eacfe780 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b36a5115c43c7796 server_cookie=33e3e4371da8d56c in_seq=0 out_seq=0 2023-10-09T06:57:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.207+0000 7f0afd7fa700 10 client.6381 ms_handle_connect on v2:172.21.15.71:6834/3993456703 2023-10-09T06:57:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.207+0000 7f0afd7fa700 1 -- 172.21.15.71:0/1863175965 <== mds.0 v2:172.21.15.71:6834/3993456703 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x7f0b14058950 con 0x5612eacfe3b0 2023-10-09T06:57:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.207+0000 7f0afd7fa700 10 client.6381 handle_command_reply: tid=0 2023-10-09T06:57:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.207+0000 7f0b338b8b80 1 client.6381 shutdown 2023-10-09T06:57:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.207+0000 7f0b338b8b80 1 -- 172.21.15.71:0/1863175965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eaca9a50 msgr2=0x5612eacf2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.207+0000 7f0b338b8b80 1 --2- 172.21.15.71:0/1863175965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eaca9a50 0x5612eacf2680 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f0b1002ad00 tx=0x7f0b10030000 comp rx=0 tx=0).stop 2023-10-09T06:57:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.207+0000 7f0b338b8b80 1 -- 172.21.15.71:0/1863175965 shutdown_connections 2023-10-09T06:57:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.207+0000 7f0b338b8b80 1 --2- 172.21.15.71:0/1863175965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612eacf3d00 0x5612eacd9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.207+0000 7f0b338b8b80 1 --2- 172.21.15.71:0/1863175965 >> [v2:172.21.15.71:6834/3993456703,v1:172.21.15.71:6835/3993456703] conn(0x5612eacfe3b0 0x5612eacfe780 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.208+0000 7f0b338b8b80 1 --2- 172.21.15.71:0/1863175965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612eaca9a50 0x5612eacf2680 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.208+0000 7f0b338b8b80 1 --2- 172.21.15.71:0/1863175965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5612eacd2f60 0x5612ead559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.208+0000 7f0afd7fa700 0 client.6381 ms_handle_reset on v2:172.21.15.71:6834/3993456703 2023-10-09T06:57:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.208+0000 7f0b338b8b80 1 -- 172.21.15.71:0/1863175965 >> 172.21.15.71:0/1863175965 conn(0x5612eacab370 msgr2=0x5612eaceb790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.208+0000 7f0b338b8b80 1 -- 172.21.15.71:0/1863175965 shutdown_connections 2023-10-09T06:57:35.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.208+0000 7f0b338b8b80 1 -- 172.21.15.71:0/1863175965 wait complete. 2023-10-09T06:57:35.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.208+0000 7f0b338b8b80 20 client.6381 trim_cache size 0 max 16384 2023-10-09T06:57:35.214 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T06:57:35.214 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "604c5619-653a-4ab6-912c-ab2e5464fe4a", 2023-10-09T06:57:35.214 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2023-10-09T06:57:35.214 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 6240, 2023-10-09T06:57:35.214 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2023-10-09T06:57:35.214 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2023-10-09T06:57:35.215 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2023-10-09T06:57:35.215 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 6.399499498, 2023-10-09T06:57:35.215 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 33, 2023-10-09T06:57:35.215 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 79, 2023-10-09T06:57:35.215 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 79, 2023-10-09T06:57:35.215 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 12.943158702 2023-10-09T06:57:35.215 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T06:57:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.208+0000 7f0b251ff700 1 -- 172.21.15.71:0/901546562 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0b0c066f30 msgr2=0x7f0b0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.208+0000 7f0b251ff700 1 --2- 172.21.15.71:0/901546562 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0b0c066f30 0x7f0b0c0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0b100091e0 tx=0x7f0b1001a000 comp rx=0 tx=0).stop 2023-10-09T06:57:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.208+0000 7f0b251ff700 1 -- 172.21.15.71:0/901546562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b2013e5f0 msgr2=0x7f0b200c9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.208+0000 7f0b251ff700 1 --2- 172.21.15.71:0/901546562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b2013e5f0 0x7f0b200c9f50 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400e870 tx=0x7f0b14009040 comp rx=0 tx=0).stop 2023-10-09T06:57:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.208+0000 7f0b251ff700 1 -- 172.21.15.71:0/901546562 shutdown_connections 2023-10-09T06:57:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.208+0000 7f0b251ff700 1 --2- 172.21.15.71:0/901546562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b200ca490 0x7f0b20141900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.208+0000 7f0b251ff700 1 --2- 172.21.15.71:0/901546562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b08003c20 0x7f0b200cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.208+0000 7f0b251ff700 1 --2- 172.21.15.71:0/901546562 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0b0c066f30 0x7f0b0c0693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.208+0000 7f0b251ff700 1 --2- 172.21.15.71:0/901546562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b2013e5f0 0x7f0b200c9f50 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.208+0000 7f0b251ff700 1 -- 172.21.15.71:0/901546562 >> 172.21.15.71:0/901546562 conn(0x7f0b2006a320 msgr2=0x7f0b2014a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:35.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.209+0000 7f0b251ff700 1 -- 172.21.15.71:0/901546562 shutdown_connections 2023-10-09T06:57:35.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.209+0000 7f0b251ff700 1 -- 172.21.15.71:0/901546562 wait complete. 2023-10-09T06:57:35.225 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:57:35.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.404+0000 7fc8ae9ff700 1 Processor -- start 2023-10-09T06:57:35.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.404+0000 7fc8ae9ff700 1 -- start start 2023-10-09T06:57:35.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.406+0000 7fc8ae9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8a80b1420 0x7fc8a80ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.406+0000 7fc8ae9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc8a80ccf90 0x7fc8a80c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.406+0000 7fc8ae9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a80cc300 con 0x7fc8a80cbf30 2023-10-09T06:57:35.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.406+0000 7fc8ae9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a8156bf0 con 0x7fc8a80ccf90 2023-10-09T06:57:35.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.406+0000 7fc8ae9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a80ae950 con 0x7fc8a80b1420 2023-10-09T06:57:35.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.406+0000 7fc89ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8a80b1420 0x7fc8a80ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.406+0000 7fc8a7fff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fc8a80cbf30 0x7fc8a80b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:54834/0 (socket says 172.21.15.71:54834) 2023-10-09T06:57:35.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.406+0000 7fc8a7fff700 1 -- 172.21.15.71:0/2710875516 learned_addr learned my addr 172.21.15.71:0/2710875516 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:35.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.406+0000 7fc8acf9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc8a80ccf90 0x7fc8a80c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.407+0000 7fc8a77fe700 1 -- 172.21.15.71:0/2710875516 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2224230482 0 0) 0x7fc8a80cc300 con 0x7fc8a80cbf30 2023-10-09T06:57:35.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.407+0000 7fc8a77fe700 1 -- 172.21.15.71:0/2710875516 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc894003570 con 0x7fc8a80cbf30 2023-10-09T06:57:35.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.407+0000 7fc89ffff700 1 -- 172.21.15.71:0/2710875516 >> v2:172.21.15.179:3300/0 conn(0x7fc8a80ccf90 msgr2=0x7fc8a80c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:35.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.407+0000 7fc89ffff700 1 --2- 172.21.15.71:0/2710875516 >> v2:172.21.15.179:3300/0 conn(0x7fc8a80ccf90 0x7fc8a80c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.407+0000 7fc89ffff700 1 -- 172.21.15.71:0/2710875516 >> v1:172.21.15.179:6789/0 conn(0x7fc8a80cbf30 legacy=0x7fc8a80b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:35.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.407+0000 7fc89ffff700 1 -- 172.21.15.71:0/2710875516 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a80ad370 con 0x7fc8a80b1420 2023-10-09T06:57:35.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.407+0000 7fc8acf9c700 1 --2- 172.21.15.71:0/2710875516 >> v2:172.21.15.179:3300/0 conn(0x7fc8a80ccf90 0x7fc8a80c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:57:35.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.407+0000 7fc89ffff700 1 --2- 172.21.15.71:0/2710875516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8a80b1420 0x7fc8a80ae410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc8900098e0 tx=0x7fc8900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91ea8e04b47bbc04 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:35.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.407+0000 7fc8a77fe700 1 -- 172.21.15.71:0/2710875516 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc890011630 con 0x7fc8a80b1420 2023-10-09T06:57:35.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.407+0000 7fc8a77fe700 1 -- 172.21.15.71:0/2710875516 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc890011790 con 0x7fc8a80b1420 2023-10-09T06:57:35.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.407+0000 7fc8a77fe700 1 -- 172.21.15.71:0/2710875516 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc890011b30 con 0x7fc8a80b1420 2023-10-09T06:57:35.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.408+0000 7fc8ae9ff700 1 -- 172.21.15.71:0/2710875516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8a80b1420 msgr2=0x7fc8a80ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:35.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.408+0000 7fc8ae9ff700 1 --2- 172.21.15.71:0/2710875516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8a80b1420 0x7fc8a80ae410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc8900098e0 tx=0x7fc8900091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.408+0000 7fc8ae9ff700 1 -- 172.21.15.71:0/2710875516 shutdown_connections 2023-10-09T06:57:35.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.408+0000 7fc8ae9ff700 1 --2- 172.21.15.71:0/2710875516 >> v2:172.21.15.179:3300/0 conn(0x7fc8a80ccf90 0x7fc8a80c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.408+0000 7fc8ae9ff700 1 --2- 172.21.15.71:0/2710875516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8a80b1420 0x7fc8a80ae410 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.408+0000 7fc8ae9ff700 1 -- 172.21.15.71:0/2710875516 >> 172.21.15.71:0/2710875516 conn(0x7fc8a806a320 msgr2=0x7fc8a80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:35.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.408+0000 7fc8ae9ff700 1 -- 172.21.15.71:0/2710875516 shutdown_connections 2023-10-09T06:57:35.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.408+0000 7fc8ae9ff700 1 -- 172.21.15.71:0/2710875516 wait complete. 2023-10-09T06:57:35.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.410+0000 7fc8ae9ff700 1 Processor -- start 2023-10-09T06:57:35.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.410+0000 7fc8ae9ff700 1 -- start start 2023-10-09T06:57:35.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.410+0000 7fc8ae9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8a80b1420 0x7fc8a815b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.410+0000 7fc8ae9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8a80cbf30 0x7fc8a8156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.411+0000 7fc8ae9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8a80ccf90 0x7fc8a814fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.411+0000 7fc8ae9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a815b700 con 0x7fc8a80ccf90 2023-10-09T06:57:35.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.411+0000 7fc8ae9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a814f5e0 con 0x7fc8a80b1420 2023-10-09T06:57:35.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.411+0000 7fc8ae9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a8157a10 con 0x7fc8a80cbf30 2023-10-09T06:57:35.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.411+0000 7fc8acf9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8a80ccf90 0x7fc8a814fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.411+0000 7fc8acf9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8a80ccf90 0x7fc8a814fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52036/0 (socket says 172.21.15.71:52036) 2023-10-09T06:57:35.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.411+0000 7fc8acf9c700 1 -- 172.21.15.71:0/3024880393 learned_addr learned my addr 172.21.15.71:0/3024880393 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:35.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.411+0000 7fc8a7fff700 1 --2- 172.21.15.71:0/3024880393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8a80b1420 0x7fc8a815b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.411+0000 7fc89ffff700 1 --2- 172.21.15.71:0/3024880393 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8a80cbf30 0x7fc8a8156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.411+0000 7fc8acf9c700 1 -- 172.21.15.71:0/3024880393 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8a80cbf30 msgr2=0x7fc8a8156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:35.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.411+0000 7fc8acf9c700 1 --2- 172.21.15.71:0/3024880393 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8a80cbf30 0x7fc8a8156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.411+0000 7fc8acf9c700 1 -- 172.21.15.71:0/3024880393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8a80b1420 msgr2=0x7fc8a815b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:35.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.411+0000 7fc8acf9c700 1 --2- 172.21.15.71:0/3024880393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8a80b1420 0x7fc8a815b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.411+0000 7fc8acf9c700 1 -- 172.21.15.71:0/3024880393 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a0009a20 con 0x7fc8a80ccf90 2023-10-09T06:57:35.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.412+0000 7fc8acf9c700 1 --2- 172.21.15.71:0/3024880393 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8a80ccf90 0x7fc8a814fa30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0009f20 tx=0x7fc8a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:35.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.412+0000 7fc8a4ff9700 1 -- 172.21.15.71:0/3024880393 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a000cc80 con 0x7fc8a80ccf90 2023-10-09T06:57:35.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.412+0000 7fc8a4ff9700 1 -- 172.21.15.71:0/3024880393 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a000f040 con 0x7fc8a80ccf90 2023-10-09T06:57:35.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.412+0000 7fc8ae9ff700 1 -- 172.21.15.71:0/3024880393 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc890009420 con 0x7fc8a80ccf90 2023-10-09T06:57:35.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.412+0000 7fc8a4ff9700 1 -- 172.21.15.71:0/3024880393 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0014480 con 0x7fc8a80ccf90 2023-10-09T06:57:35.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.412+0000 7fc8ae9ff700 1 -- 172.21.15.71:0/3024880393 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a8158050 con 0x7fc8a80ccf90 2023-10-09T06:57:35.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.413+0000 7fc8ae9ff700 1 -- 172.21.15.71:0/3024880393 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a804c3c0 con 0x7fc8a80ccf90 2023-10-09T06:57:35.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.414+0000 7fc8a4ff9700 1 -- 172.21.15.71:0/3024880393 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc8a0003020 con 0x7fc8a80ccf90 2023-10-09T06:57:35.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.415+0000 7fc8a4ff9700 1 --2- 172.21.15.71:0/3024880393 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc888066f30 0x7fc8880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:35.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.415+0000 7fc8a4ff9700 1 -- 172.21.15.71:0/3024880393 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fc8a00850c0 con 0x7fc8a80ccf90 2023-10-09T06:57:35.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.415+0000 7fc8a7fff700 1 --2- 172.21.15.71:0/3024880393 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc888066f30 0x7fc8880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:35.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.416+0000 7fc8a7fff700 1 --2- 172.21.15.71:0/3024880393 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc888066f30 0x7fc8880693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc8a80ac600 tx=0x7fc898009040 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:35.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.419+0000 7fc8a4ff9700 1 -- 172.21.15.71:0/3024880393 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8a00521a0 con 0x7fc8a80ccf90 2023-10-09T06:57:35.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.652+0000 7fc8ae9ff700 1 -- 172.21.15.71:0/3024880393 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc8a80ad650 con 0x7fc8a80ccf90 2023-10-09T06:57:35.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.652+0000 7fc8a4ff9700 1 -- 172.21.15.71:0/3024880393 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc8a00557c0 con 0x7fc8a80ccf90 2023-10-09T06:57:35.652 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:57:35.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.655+0000 7fc8ae9ff700 1 -- 172.21.15.71:0/3024880393 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc888066f30 msgr2=0x7fc8880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:35.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.655+0000 7fc8ae9ff700 1 --2- 172.21.15.71:0/3024880393 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc888066f30 0x7fc8880693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc8a80ac600 tx=0x7fc898009040 comp rx=0 tx=0).stop 2023-10-09T06:57:35.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.655+0000 7fc8ae9ff700 1 -- 172.21.15.71:0/3024880393 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8a80ccf90 msgr2=0x7fc8a814fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:35.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.655+0000 7fc8ae9ff700 1 --2- 172.21.15.71:0/3024880393 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8a80ccf90 0x7fc8a814fa30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0009f20 tx=0x7fc8a000b040 comp rx=0 tx=0).stop 2023-10-09T06:57:35.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.655+0000 7fc8ae9ff700 1 -- 172.21.15.71:0/3024880393 shutdown_connections 2023-10-09T06:57:35.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.655+0000 7fc8ae9ff700 1 --2- 172.21.15.71:0/3024880393 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc888066f30 0x7fc8880693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.655+0000 7fc8ae9ff700 1 --2- 172.21.15.71:0/3024880393 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8a80ccf90 0x7fc8a814fa30 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.655+0000 7fc8ae9ff700 1 --2- 172.21.15.71:0/3024880393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8a80b1420 0x7fc8a815b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.655+0000 7fc8ae9ff700 1 --2- 172.21.15.71:0/3024880393 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8a80cbf30 0x7fc8a8156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:35.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.655+0000 7fc8ae9ff700 1 -- 172.21.15.71:0/3024880393 >> 172.21.15.71:0/3024880393 conn(0x7fc8a806a320 msgr2=0x7fc8a80afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:35.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.655+0000 7fc8ae9ff700 1 -- 172.21.15.71:0/3024880393 shutdown_connections 2023-10-09T06:57:35.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:35.655+0000 7fc8ae9ff700 1 -- 172.21.15.71:0/3024880393 wait complete. 2023-10-09T06:57:35.672 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:57:35.672 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:57:35.672 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2023-10-09T06:57:35.672 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T06:57:35.672 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T06:57:35.672 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:57:35.672 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:57:35.672 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:57:35.673 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:57:35.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:57:35.673 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2023-10-09T06:57:35.710 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:57:35.710 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:57:35.710 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:57:35.710 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:57:35.711 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-10-09T06:57:35.711 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:57:35.711 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:57:35.711 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2023-10-09T06:57:35.711 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2023-10-09T06:57:35.711 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:57:35.711 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2023-10-09T06:57:35.711 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2023-10-09T06:57:35.712 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:57:35.712 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:57:35.712 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:57:35.712 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:57:35.712 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T06:57:35.712 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 41380sec preferred_lft 41380sec 2023-10-09T06:57:35.712 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2023-10-09T06:57:35.712 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:57:35.713 INFO:teuthology.orchestra.run.smithi071.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:57:35.713 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5a:a1:ec:c7:41:8f brd ff:ff:ff:ff:ff:ff 2023-10-09T06:57:35.713 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:57:35.713 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:57:35.713 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::8052:a9ff:fe85:8756/64 scope link 2023-10-09T06:57:35.713 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:57:35.713 INFO:teuthology.orchestra.run.smithi071.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:57:35.714 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether ae:1f:c9:59:0c:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T06:57:35.714 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ac1f:c9ff:fe59:c1b/64 scope link 2023-10-09T06:57:35.714 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:57:35.714 INFO:teuthology.orchestra.run.smithi071.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:57:35.714 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5a:a1:ec:c7:41:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T06:57:35.714 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::58a1:ecff:fec7:418f/64 scope link 2023-10-09T06:57:35.714 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:57:35.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:57:35.715 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:57:35.809 INFO:teuthology.orchestra.run.smithi071.stdout:1 2023-10-09T06:57:35.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:57:35.812 DEBUG:teuthology.orchestra.run.smithi071:> route 2023-10-09T06:57:35.851 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2023-10-09T06:57:35.852 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:57:35.852 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T06:57:35.852 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T06:57:35.852 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:57:35.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:57:35.853 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-09T06:57:35.853 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-09T06:57:35.853 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T06:57:35.853 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T06:57:35.853 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T06:57:35.853 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-09T06:57:36.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:57:36.048 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-09T06:57:36.084 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T06:57:36.084 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T06:57:36.084 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:57:36.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:57:36.084 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2023-10-09T06:57:36.186 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:57:36.186 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T06:57:36.222 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:57:36.222 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:57:36.223 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:57:36.298 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T06:57:36.298 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:57:36.298 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:57:36.429 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:57:36.429 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:57:36.456 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:57:36.457 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:57:36.457 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.71:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-09T06:57:36.457 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with new device syntax: 0@604c5619-653a-4ab6-912c-ab2e5464fe4a.cephfs=/ 2023-10-09T06:57:36.457 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.71:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-10-09T06:57:36.462 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:57:36.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:57:36.462 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:57:36.524 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T06:57:36.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.705+0000 7f147f59e700 1 Processor -- start 2023-10-09T06:57:36.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.705+0000 7f147f59e700 1 -- start start 2023-10-09T06:57:36.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.707+0000 7f147f59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f148015da80 0x7f148006e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:36.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.707+0000 7f147f59e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f148015de50 0x7f14800c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:36.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.707+0000 7f147f59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14800696c0 0x7f148006ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:36.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.707+0000 7f147f59e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14800ca410 con 0x7f148015de50 2023-10-09T06:57:36.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.707+0000 7f147f59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14800c6f80 con 0x7f148015da80 2023-10-09T06:57:36.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.707+0000 7f147f59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14800c7220 con 0x7f14800696c0 2023-10-09T06:57:36.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.707+0000 7f1477fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f148015de50 0x7f14800c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:36.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.707+0000 7f1477fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f148015de50 0x7f14800c6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52048/0 (socket says 172.21.15.71:52048) 2023-10-09T06:57:36.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.707+0000 7f1477fff700 1 -- 172.21.15.71:0/2587647758 learned_addr learned my addr 172.21.15.71:0/2587647758 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:36.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.707+0000 7f147ed9d700 1 --2- 172.21.15.71:0/2587647758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14800696c0 0x7f148006ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:36.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.707+0000 7f147e59c700 1 --2- 172.21.15.71:0/2587647758 >> v2:172.21.15.179:3300/0 conn(0x7f148015da80 0x7f148006e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:36.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.707+0000 7f1477fff700 1 -- 172.21.15.71:0/2587647758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14800696c0 msgr2=0x7f148006ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:36.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.707+0000 7f1477fff700 1 --2- 172.21.15.71:0/2587647758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14800696c0 0x7f148006ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:36.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.707+0000 7f1477fff700 1 -- 172.21.15.71:0/2587647758 >> v2:172.21.15.179:3300/0 conn(0x7f148015da80 msgr2=0x7f148006e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:36.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.707+0000 7f1477fff700 1 --2- 172.21.15.71:0/2587647758 >> v2:172.21.15.179:3300/0 conn(0x7f148015da80 0x7f148006e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:36.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.707+0000 7f1477fff700 1 -- 172.21.15.71:0/2587647758 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14800c7500 con 0x7f148015de50 2023-10-09T06:57:36.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.707+0000 7f147e59c700 1 --2- 172.21.15.71:0/2587647758 >> v2:172.21.15.179:3300/0 conn(0x7f148015da80 0x7f148006e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:36.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.708+0000 7f1477fff700 1 --2- 172.21.15.71:0/2587647758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f148015de50 0x7f14800c6a40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f148006bfd0 tx=0x7f1468009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45251af7f9bd582 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:36.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.708+0000 7f147dd9b700 1 -- 172.21.15.71:0/2587647758 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146800b860 con 0x7f148015de50 2023-10-09T06:57:36.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.708+0000 7f147dd9b700 1 -- 172.21.15.71:0/2587647758 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146800b9c0 con 0x7f148015de50 2023-10-09T06:57:36.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.708+0000 7f147dd9b700 1 -- 172.21.15.71:0/2587647758 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146800bd80 con 0x7f148015de50 2023-10-09T06:57:36.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.709+0000 7f147f59e700 1 -- 172.21.15.71:0/2587647758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f148015de50 msgr2=0x7f14800c6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:36.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.709+0000 7f147f59e700 1 --2- 172.21.15.71:0/2587647758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f148015de50 0x7f14800c6a40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f148006bfd0 tx=0x7f1468009250 comp rx=0 tx=0).stop 2023-10-09T06:57:36.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.709+0000 7f147f59e700 1 -- 172.21.15.71:0/2587647758 shutdown_connections 2023-10-09T06:57:36.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.709+0000 7f147f59e700 1 --2- 172.21.15.71:0/2587647758 >> v2:172.21.15.179:3300/0 conn(0x7f148015da80 0x7f148006e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:36.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.709+0000 7f147f59e700 1 --2- 172.21.15.71:0/2587647758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14800696c0 0x7f148006ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:36.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.709+0000 7f147f59e700 1 --2- 172.21.15.71:0/2587647758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f148015de50 0x7f14800c6a40 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:36.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.709+0000 7f147f59e700 1 -- 172.21.15.71:0/2587647758 >> 172.21.15.71:0/2587647758 conn(0x7f14800cc1f0 msgr2=0x7f14800cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:36.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.709+0000 7f147f59e700 1 -- 172.21.15.71:0/2587647758 shutdown_connections 2023-10-09T06:57:36.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.709+0000 7f147f59e700 1 -- 172.21.15.71:0/2587647758 wait complete. 2023-10-09T06:57:36.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.710+0000 7f147f59e700 1 Processor -- start 2023-10-09T06:57:36.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.710+0000 7f147f59e700 1 -- start start 2023-10-09T06:57:36.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.711+0000 7f147f59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14800696c0 0x7f14800c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:36.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.711+0000 7f147f59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f148015da80 0x7f1480150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:36.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.711+0000 7f147f59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f148015de50 0x7f1480158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:36.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.711+0000 7f147f59e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14800c41b0 con 0x7f148015da80 2023-10-09T06:57:36.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.711+0000 7f147f59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14800c4e40 con 0x7f148015de50 2023-10-09T06:57:36.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.711+0000 7f147f59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14800c5120 con 0x7f14800696c0 2023-10-09T06:57:36.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.711+0000 7f1477fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f148015da80 0x7f1480150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:36.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.712+0000 7f1477fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f148015da80 0x7f1480150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52058/0 (socket says 172.21.15.71:52058) 2023-10-09T06:57:36.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.712+0000 7f1477fff700 1 -- 172.21.15.71:0/3360841544 learned_addr learned my addr 172.21.15.71:0/3360841544 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:36.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.712+0000 7f147e59c700 1 --2- 172.21.15.71:0/3360841544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14800696c0 0x7f14800c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:36.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.712+0000 7f147ed9d700 1 --2- 172.21.15.71:0/3360841544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f148015de50 0x7f1480158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:36.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.712+0000 7f1477fff700 1 -- 172.21.15.71:0/3360841544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14800696c0 msgr2=0x7f14800c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:36.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.712+0000 7f1477fff700 1 --2- 172.21.15.71:0/3360841544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14800696c0 0x7f14800c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.712+0000 7f1477fff700 1 -- 172.21.15.71:0/3360841544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f148015de50 msgr2=0x7f1480158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.712+0000 7f1477fff700 1 --2- 172.21.15.71:0/3360841544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f148015de50 0x7f1480158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.712+0000 7f1477fff700 1 -- 172.21.15.71:0/3360841544 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14680094f0 con 0x7f148015da80 2023-10-09T06:57:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.712+0000 7f147e59c700 1 --2- 172.21.15.71:0/3360841544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14800696c0 0x7f14800c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.712+0000 7f1477fff700 1 --2- 172.21.15.71:0/3360841544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f148015da80 0x7f1480150940 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f148006fe40 tx=0x7f1468017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.712+0000 7f14767fc700 1 -- 172.21.15.71:0/3360841544 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468006a90 con 0x7f148015da80 2023-10-09T06:57:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.712+0000 7f14767fc700 1 -- 172.21.15.71:0/3360841544 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1468026450 con 0x7f148015da80 2023-10-09T06:57:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.712+0000 7f14767fc700 1 -- 172.21.15.71:0/3360841544 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468026810 con 0x7f148015da80 2023-10-09T06:57:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.712+0000 7f147f59e700 1 -- 172.21.15.71:0/3360841544 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14800c5400 con 0x7f148015da80 2023-10-09T06:57:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.713+0000 7f147f59e700 1 -- 172.21.15.71:0/3360841544 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1480150e80 con 0x7f148015da80 2023-10-09T06:57:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.713+0000 7f147f59e700 1 -- 172.21.15.71:0/3360841544 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14800c6140 con 0x7f148015da80 2023-10-09T06:57:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.714+0000 7f14767fc700 1 -- 172.21.15.71:0/3360841544 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1468026bc0 con 0x7f148015da80 2023-10-09T06:57:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.715+0000 7f14767fc700 1 --2- 172.21.15.71:0/3360841544 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1460066f30 0x7f14600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.715+0000 7f14767fc700 1 -- 172.21.15.71:0/3360841544 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f14680861d0 con 0x7f148015da80 2023-10-09T06:57:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.716+0000 7f147e59c700 1 --2- 172.21.15.71:0/3360841544 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1460066f30 0x7f14600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.716+0000 7f147e59c700 1 --2- 172.21.15.71:0/3360841544 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1460066f30 0x7f14600693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1470006f00 tx=0x7f1470008040 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:36.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.719+0000 7f14767fc700 1 -- 172.21.15.71:0/3360841544 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1468053290 con 0x7f148015da80 2023-10-09T06:57:36.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.943+0000 7f147f59e700 1 -- 172.21.15.71:0/3360841544 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f14800c5920 con 0x7f1460066f30 2023-10-09T06:57:36.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.945+0000 7f14767fc700 1 -- 172.21.15.71:0/3360841544 <== mgr.5351 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f14800c5920 con 0x7f1460066f30 2023-10-09T06:57:36.945 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-09T06:57:36.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:57:36.945 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cephfs" 2023-10-09T06:57:36.945 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:57:36.945 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-09T06:57:36.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.947+0000 7f147f59e700 1 -- 172.21.15.71:0/3360841544 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1460066f30 msgr2=0x7f14600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:36.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.947+0000 7f147f59e700 1 --2- 172.21.15.71:0/3360841544 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1460066f30 0x7f14600693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1470006f00 tx=0x7f1470008040 comp rx=0 tx=0).stop 2023-10-09T06:57:36.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.947+0000 7f147f59e700 1 -- 172.21.15.71:0/3360841544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f148015da80 msgr2=0x7f1480150940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:36.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.947+0000 7f147f59e700 1 --2- 172.21.15.71:0/3360841544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f148015da80 0x7f1480150940 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f148006fe40 tx=0x7f1468017000 comp rx=0 tx=0).stop 2023-10-09T06:57:36.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.947+0000 7f147f59e700 1 -- 172.21.15.71:0/3360841544 shutdown_connections 2023-10-09T06:57:36.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.947+0000 7f147f59e700 1 --2- 172.21.15.71:0/3360841544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f148015de50 0x7f1480158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:36.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.947+0000 7f147f59e700 1 --2- 172.21.15.71:0/3360841544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14800696c0 0x7f14800c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:36.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.947+0000 7f147f59e700 1 --2- 172.21.15.71:0/3360841544 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1460066f30 0x7f14600693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:36.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.947+0000 7f147f59e700 1 --2- 172.21.15.71:0/3360841544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f148015da80 0x7f1480150940 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:36.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.947+0000 7f147f59e700 1 -- 172.21.15.71:0/3360841544 >> 172.21.15.71:0/3360841544 conn(0x7f14800cc1f0 msgr2=0x7f1480162120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:36.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.947+0000 7f147f59e700 1 -- 172.21.15.71:0/3360841544 shutdown_connections 2023-10-09T06:57:36.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:36.948+0000 7f147f59e700 1 -- 172.21.15.71:0/3360841544 wait complete. 2023-10-09T06:57:36.965 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-09T06:57:37.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.147+0000 7f3c5719d700 1 Processor -- start 2023-10-09T06:57:37.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.148+0000 7f3c5719d700 1 -- start start 2023-10-09T06:57:37.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.149+0000 7f3c5719d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3c5006f060 0x7f3c500ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:37.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.149+0000 7f3c5719d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c5006f4b0 0x7f3c500ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:37.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.149+0000 7f3c5719d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5006ebd0 con 0x7f3c500cb1a0 2023-10-09T06:57:37.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.149+0000 7f3c5719d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5015b2e0 con 0x7f3c5006f060 2023-10-09T06:57:37.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.149+0000 7f3c5719d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5015aa70 con 0x7f3c5006f4b0 2023-10-09T06:57:37.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.150+0000 7f3c5599a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3c5006f060 0x7f3c500ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:37.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.150+0000 7f3c5699c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c5006f4b0 0x7f3c500ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:37.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.150+0000 7f3c5619b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f3c500cb1a0 0x7f3c5015a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:54838/0 (socket says 172.21.15.71:54838) 2023-10-09T06:57:37.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.150+0000 7f3c5619b700 1 -- 172.21.15.71:0/3434033724 learned_addr learned my addr 172.21.15.71:0/3434033724 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:37.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.150+0000 7f3c55199700 1 -- 172.21.15.71:0/3434033724 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617434613 0 0) 0x7f3c5006ebd0 con 0x7f3c500cb1a0 2023-10-09T06:57:37.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.150+0000 7f3c55199700 1 -- 172.21.15.71:0/3434033724 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c3c003570 con 0x7f3c500cb1a0 2023-10-09T06:57:37.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.150+0000 7f3c5699c700 1 -- 172.21.15.71:0/3434033724 >> v2:172.21.15.179:3300/0 conn(0x7f3c5006f060 msgr2=0x7f3c500ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:37.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.150+0000 7f3c5699c700 1 --2- 172.21.15.71:0/3434033724 >> v2:172.21.15.179:3300/0 conn(0x7f3c5006f060 0x7f3c500ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:37.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.150+0000 7f3c5699c700 1 -- 172.21.15.71:0/3434033724 >> v1:172.21.15.179:6789/0 conn(0x7f3c500cb1a0 legacy=0x7f3c5015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:37.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.150+0000 7f3c5699c700 1 -- 172.21.15.71:0/3434033724 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5015ad20 con 0x7f3c5006f4b0 2023-10-09T06:57:37.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.150+0000 7f3c5599a700 1 --2- 172.21.15.71:0/3434033724 >> v2:172.21.15.179:3300/0 conn(0x7f3c5006f060 0x7f3c500ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:57:37.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.150+0000 7f3c5699c700 1 --2- 172.21.15.71:0/3434033724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c5006f4b0 0x7f3c500ae610 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009e60 tx=0x7f3c48009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8803872d1f6a938 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:37.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.151+0000 7f3c55199700 1 -- 172.21.15.71:0/3434033724 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4800e070 con 0x7f3c5006f4b0 2023-10-09T06:57:37.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.151+0000 7f3c55199700 1 -- 172.21.15.71:0/3434033724 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4800bb40 con 0x7f3c5006f4b0 2023-10-09T06:57:37.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.151+0000 7f3c55199700 1 -- 172.21.15.71:0/3434033724 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48012430 con 0x7f3c5006f4b0 2023-10-09T06:57:37.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.151+0000 7f3c5719d700 1 -- 172.21.15.71:0/3434033724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c5006f4b0 msgr2=0x7f3c500ae610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:37.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.151+0000 7f3c5719d700 1 --2- 172.21.15.71:0/3434033724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c5006f4b0 0x7f3c500ae610 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009e60 tx=0x7f3c48009780 comp rx=0 tx=0).stop 2023-10-09T06:57:37.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.151+0000 7f3c5719d700 1 -- 172.21.15.71:0/3434033724 shutdown_connections 2023-10-09T06:57:37.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.151+0000 7f3c5719d700 1 --2- 172.21.15.71:0/3434033724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c5006f4b0 0x7f3c500ae610 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:37.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.151+0000 7f3c5719d700 1 --2- 172.21.15.71:0/3434033724 >> v2:172.21.15.179:3300/0 conn(0x7f3c5006f060 0x7f3c500ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:37.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.151+0000 7f3c5719d700 1 -- 172.21.15.71:0/3434033724 >> 172.21.15.71:0/3434033724 conn(0x7f3c500cc1e0 msgr2=0x7f3c500cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:37.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.151+0000 7f3c5719d700 1 -- 172.21.15.71:0/3434033724 shutdown_connections 2023-10-09T06:57:37.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.151+0000 7f3c5719d700 1 -- 172.21.15.71:0/3434033724 wait complete. 2023-10-09T06:57:37.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.153+0000 7f3c5719d700 1 Processor -- start 2023-10-09T06:57:37.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.153+0000 7f3c5719d700 1 -- start start 2023-10-09T06:57:37.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.154+0000 7f3c5719d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c5006f060 0x7f3c50156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:37.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.154+0000 7f3c5719d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c5006f4b0 0x7f3c50150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:37.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.154+0000 7f3c5719d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c500cb1a0 0x7f3c5015f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:37.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.154+0000 7f3c5719d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5015a620 con 0x7f3c5006f060 2023-10-09T06:57:37.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.154+0000 7f3c5719d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c50159750 con 0x7f3c5006f4b0 2023-10-09T06:57:37.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.154+0000 7f3c5719d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c50159a10 con 0x7f3c500cb1a0 2023-10-09T06:57:37.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.154+0000 7f3c5619b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c5006f060 0x7f3c50156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:37.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.154+0000 7f3c5619b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c5006f060 0x7f3c50156d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52064/0 (socket says 172.21.15.71:52064) 2023-10-09T06:57:37.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.154+0000 7f3c5619b700 1 -- 172.21.15.71:0/777270237 learned_addr learned my addr 172.21.15.71:0/777270237 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:37.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.154+0000 7f3c5619b700 1 -- 172.21.15.71:0/777270237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c500cb1a0 msgr2=0x7f3c5015f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:37.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.154+0000 7f3c5619b700 1 --2- 172.21.15.71:0/777270237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c500cb1a0 0x7f3c5015f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:37.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.154+0000 7f3c5619b700 1 -- 172.21.15.71:0/777270237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c5006f4b0 msgr2=0x7f3c50150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:37.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.154+0000 7f3c5619b700 1 --2- 172.21.15.71:0/777270237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c5006f4b0 0x7f3c50150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:37.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.155+0000 7f3c5619b700 1 -- 172.21.15.71:0/777270237 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c40009420 con 0x7f3c5006f060 2023-10-09T06:57:37.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.155+0000 7f3c5619b700 1 --2- 172.21.15.71:0/777270237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c5006f060 0x7f3c50156d90 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00c590 tx=0x7f3c4c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:37.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.155+0000 7f3c467fc700 1 -- 172.21.15.71:0/777270237 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c005b30 con 0x7f3c5006f060 2023-10-09T06:57:37.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.155+0000 7f3c467fc700 1 -- 172.21.15.71:0/777270237 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c005cb0 con 0x7f3c5006f060 2023-10-09T06:57:37.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.155+0000 7f3c5719d700 1 -- 172.21.15.71:0/777270237 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c48009a20 con 0x7f3c5006f060 2023-10-09T06:57:37.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.155+0000 7f3c467fc700 1 -- 172.21.15.71:0/777270237 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c007320 con 0x7f3c5006f060 2023-10-09T06:57:37.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.155+0000 7f3c5719d700 1 -- 172.21.15.71:0/777270237 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c50159fd0 con 0x7f3c5006f060 2023-10-09T06:57:37.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.156+0000 7f3c5719d700 1 -- 172.21.15.71:0/777270237 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5006c450 con 0x7f3c5006f060 2023-10-09T06:57:37.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.157+0000 7f3c467fc700 1 -- 172.21.15.71:0/777270237 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c4c01b3b0 con 0x7f3c5006f060 2023-10-09T06:57:37.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.158+0000 7f3c467fc700 1 --2- 172.21.15.71:0/777270237 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3c34066f30 0x7f3c340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:37.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.158+0000 7f3c467fc700 1 -- 172.21.15.71:0/777270237 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f3c4c083d30 con 0x7f3c5006f060 2023-10-09T06:57:37.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.158+0000 7f3c5599a700 1 --2- 172.21.15.71:0/777270237 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3c34066f30 0x7f3c340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:37.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.159+0000 7f3c5599a700 1 --2- 172.21.15.71:0/777270237 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3c34066f30 0x7f3c340693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3c5016cbc0 tx=0x7f3c400091a0 comp rx=0 tx=0).ready entity=mgr.5351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:37.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.162+0000 7f3c467fc700 1 -- 172.21.15.71:0/777270237 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c4c050d70 con 0x7f3c5006f060 2023-10-09T06:57:37.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.405+0000 7f3c5719d700 1 -- 172.21.15.71:0/777270237 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f3c5004bb80 con 0x7f3c5006f060 2023-10-09T06:57:37.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.854+0000 7f3c467fc700 1 -- 172.21.15.71:0/777270237 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 27) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f3c4c051140 con 0x7f3c5006f060 2023-10-09T06:57:37.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.855+0000 7f3c467fc700 1 -- 172.21.15.71:0/777270237 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v27) v1 ==== 92+0+0 (secure 0 0 0) 0x7f3c4c054800 con 0x7f3c5006f060 2023-10-09T06:57:37.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.857+0000 7f3c5719d700 1 -- 172.21.15.71:0/777270237 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3c34066f30 msgr2=0x7f3c340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:37.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.857+0000 7f3c5719d700 1 --2- 172.21.15.71:0/777270237 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3c34066f30 0x7f3c340693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3c5016cbc0 tx=0x7f3c400091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:37.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.857+0000 7f3c5719d700 1 -- 172.21.15.71:0/777270237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c5006f060 msgr2=0x7f3c50156d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:37.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.857+0000 7f3c5719d700 1 --2- 172.21.15.71:0/777270237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c5006f060 0x7f3c50156d90 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00c590 tx=0x7f3c4c007e00 comp rx=0 tx=0).stop 2023-10-09T06:57:37.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.857+0000 7f3c5719d700 1 -- 172.21.15.71:0/777270237 shutdown_connections 2023-10-09T06:57:37.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.857+0000 7f3c5719d700 1 --2- 172.21.15.71:0/777270237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c500cb1a0 0x7f3c5015f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:37.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.857+0000 7f3c5719d700 1 --2- 172.21.15.71:0/777270237 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3c34066f30 0x7f3c340693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:37.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.857+0000 7f3c5719d700 1 --2- 172.21.15.71:0/777270237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c5006f060 0x7f3c50156d90 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:37.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.857+0000 7f3c5719d700 1 --2- 172.21.15.71:0/777270237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c5006f4b0 0x7f3c50150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:37.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.857+0000 7f3c5719d700 1 -- 172.21.15.71:0/777270237 >> 172.21.15.71:0/777270237 conn(0x7f3c500cc1e0 msgr2=0x7f3c500b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:37.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.858+0000 7f3c5719d700 1 -- 172.21.15.71:0/777270237 shutdown_connections 2023-10-09T06:57:37.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:37.858+0000 7f3c5719d700 1 -- 172.21.15.71:0/777270237 wait complete. 2023-10-09T06:57:37.877 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-09T06:57:38.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.069+0000 7f70183ff700 1 Processor -- start 2023-10-09T06:57:38.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.070+0000 7f70183ff700 1 -- start start 2023-10-09T06:57:38.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.071+0000 7f70183ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7010159c60 0x7f701015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:38.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.071+0000 7f70183ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f701015db10 0x7f7010069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:38.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.071+0000 7f70183ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f701015a160 con 0x7f7010159890 2023-10-09T06:57:38.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.071+0000 7f70183ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70100d13a0 con 0x7f701015db10 2023-10-09T06:57:38.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.071+0000 7f70183ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701015e140 con 0x7f7010159c60 2023-10-09T06:57:38.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.071+0000 7f701699c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f701015db10 0x7f7010069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:38.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.071+0000 7f701699c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f701015db10 0x7f7010069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52096/0 (socket says 172.21.15.71:52096) 2023-10-09T06:57:38.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.071+0000 7f701699c700 1 -- 172.21.15.71:0/2757143184 learned_addr learned my addr 172.21.15.71:0/2757143184 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:38.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.071+0000 7f701599a700 1 --2- 172.21.15.71:0/2757143184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7010159c60 0x7f701015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:38.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.072+0000 7f701699c700 1 -- 172.21.15.71:0/2757143184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7010159c60 msgr2=0x7f701015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:38.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.072+0000 7f701699c700 1 --2- 172.21.15.71:0/2757143184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7010159c60 0x7f701015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:38.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.072+0000 7f701699c700 1 -- 172.21.15.71:0/2757143184 >> v1:172.21.15.179:6789/0 conn(0x7f7010159890 legacy=0x7f701015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:38.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.072+0000 7f7015199700 1 -- 172.21.15.71:0/2757143184 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670357745 0 0) 0x7f701015a160 con 0x7f7010159890 2023-10-09T06:57:38.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.072+0000 7f701699c700 1 -- 172.21.15.71:0/2757143184 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701015a3d0 con 0x7f701015db10 2023-10-09T06:57:38.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.072+0000 7f701699c700 1 --2- 172.21.15.71:0/2757143184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f701015db10 0x7f7010069560 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f7008009f20 tx=0x7f7008009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9312eeb1348578 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:38.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.072+0000 7f7015199700 1 -- 172.21.15.71:0/2757143184 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700800e070 con 0x7f701015db10 2023-10-09T06:57:38.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.072+0000 7f7015199700 1 -- 172.21.15.71:0/2757143184 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700800b9d0 con 0x7f701015db10 2023-10-09T06:57:38.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.072+0000 7f7015199700 1 -- 172.21.15.71:0/2757143184 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70080092e0 con 0x7f701015db10 2023-10-09T06:57:38.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.073+0000 7f70183ff700 1 -- 172.21.15.71:0/2757143184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f701015db10 msgr2=0x7f7010069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:38.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.073+0000 7f70183ff700 1 --2- 172.21.15.71:0/2757143184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f701015db10 0x7f7010069560 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f7008009f20 tx=0x7f7008009840 comp rx=0 tx=0).stop 2023-10-09T06:57:38.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.073+0000 7f70183ff700 1 -- 172.21.15.71:0/2757143184 shutdown_connections 2023-10-09T06:57:38.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.073+0000 7f70183ff700 1 --2- 172.21.15.71:0/2757143184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f701015db10 0x7f7010069560 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:38.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.073+0000 7f70183ff700 1 --2- 172.21.15.71:0/2757143184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7010159c60 0x7f701015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:38.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.073+0000 7f70183ff700 1 -- 172.21.15.71:0/2757143184 >> 172.21.15.71:0/2757143184 conn(0x7f7010068e20 msgr2=0x7f70100d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:38.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.073+0000 7f70183ff700 1 -- 172.21.15.71:0/2757143184 shutdown_connections 2023-10-09T06:57:38.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.073+0000 7f70183ff700 1 -- 172.21.15.71:0/2757143184 wait complete. 2023-10-09T06:57:38.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.074+0000 7f70183ff700 1 Processor -- start 2023-10-09T06:57:38.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.075+0000 7f70183ff700 1 -- start start 2023-10-09T06:57:38.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.075+0000 7f70183ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7010159890 0x7f70100cd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:38.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.075+0000 7f70183ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7010159c60 0x7f701016d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:38.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.075+0000 7f70183ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f701015db10 0x7f701016d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:38.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.075+0000 7f70183ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70100b3b30 con 0x7f7010159c60 2023-10-09T06:57:38.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.075+0000 7f70183ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70100b3590 con 0x7f701015db10 2023-10-09T06:57:38.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.075+0000 7f70183ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70100b3850 con 0x7f7010159890 2023-10-09T06:57:38.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.076+0000 7f701599a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7010159c60 0x7f701016d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:38.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.076+0000 7f701599a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7010159c60 0x7f701016d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52108/0 (socket says 172.21.15.71:52108) 2023-10-09T06:57:38.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.076+0000 7f701599a700 1 -- 172.21.15.71:0/1229437054 learned_addr learned my addr 172.21.15.71:0/1229437054 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:38.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.076+0000 7f701619b700 1 --2- 172.21.15.71:0/1229437054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7010159890 0x7f70100cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:38.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.076+0000 7f701699c700 1 --2- 172.21.15.71:0/1229437054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f701015db10 0x7f701016d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:38.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.076+0000 7f701599a700 1 -- 172.21.15.71:0/1229437054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7010159890 msgr2=0x7f70100cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:38.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.076+0000 7f701599a700 1 --2- 172.21.15.71:0/1229437054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7010159890 0x7f70100cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:38.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.076+0000 7f701599a700 1 -- 172.21.15.71:0/1229437054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f701015db10 msgr2=0x7f701016d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:38.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.076+0000 7f701599a700 1 --2- 172.21.15.71:0/1229437054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f701015db10 0x7f701016d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:38.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.076+0000 7f701599a700 1 -- 172.21.15.71:0/1229437054 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7008009ae0 con 0x7f7010159c60 2023-10-09T06:57:38.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.076+0000 7f701599a700 1 --2- 172.21.15.71:0/1229437054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7010159c60 0x7f701016d050 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f700000ec50 tx=0x7f70000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:38.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.077+0000 7f70067fc700 1 -- 172.21.15.71:0/1229437054 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7000009690 con 0x7f7010159c60 2023-10-09T06:57:38.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.077+0000 7f70067fc700 1 -- 172.21.15.71:0/1229437054 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700000c850 con 0x7f7010159c60 2023-10-09T06:57:38.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.077+0000 7f70067fc700 1 -- 172.21.15.71:0/1229437054 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700000cc10 con 0x7f7010159c60 2023-10-09T06:57:38.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.077+0000 7f70183ff700 1 -- 172.21.15.71:0/1229437054 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70100cd2a0 con 0x7f7010159c60 2023-10-09T06:57:38.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.077+0000 7f70183ff700 1 -- 172.21.15.71:0/1229437054 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70100cdda0 con 0x7f7010159c60 2023-10-09T06:57:38.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.078+0000 7f70183ff700 1 -- 172.21.15.71:0/1229437054 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701004c3c0 con 0x7f7010159c60 2023-10-09T06:57:38.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.079+0000 7f70067fc700 1 -- 172.21.15.71:0/1229437054 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f7000013470 con 0x7f7010159c60 2023-10-09T06:57:38.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.080+0000 7f70067fc700 1 --2- 172.21.15.71:0/1229437054 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6ff4066f80 0x7f6ff4069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:38.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.080+0000 7f70067fc700 1 -- 172.21.15.71:0/1229437054 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f7000084910 con 0x7f7010159c60 2023-10-09T06:57:38.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.080+0000 7f701619b700 1 -- 172.21.15.71:0/1229437054 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6ff4066f80 msgr2=0x7f6ff4069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:38.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.080+0000 7f701619b700 1 --2- 172.21.15.71:0/1229437054 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6ff4066f80 0x7f6ff4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:38.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.084+0000 7f70067fc700 1 -- 172.21.15.71:0/1229437054 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7000051950 con 0x7f7010159c60 2023-10-09T06:57:38.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.281+0000 7f701619b700 1 -- 172.21.15.71:0/1229437054 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6ff4066f80 msgr2=0x7f6ff4069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:38.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.281+0000 7f701619b700 1 --2- 172.21.15.71:0/1229437054 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6ff4066f80 0x7f6ff4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:38.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.287+0000 7f70183ff700 1 -- 172.21.15.71:0/1229437054 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f701006a5b0 con 0x7f7010159c60 2023-10-09T06:57:38.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.294+0000 7f70067fc700 1 -- 172.21.15.71:0/1229437054 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7000054f70 con 0x7f7010159c60 2023-10-09T06:57:38.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.297+0000 7f70183ff700 1 -- 172.21.15.71:0/1229437054 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6ff4066f80 msgr2=0x7f6ff4069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:38.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.297+0000 7f70183ff700 1 --2- 172.21.15.71:0/1229437054 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6ff4066f80 0x7f6ff4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:38.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.297+0000 7f70183ff700 1 -- 172.21.15.71:0/1229437054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7010159c60 msgr2=0x7f701016d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:38.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.297+0000 7f70183ff700 1 --2- 172.21.15.71:0/1229437054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7010159c60 0x7f701016d050 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f700000ec50 tx=0x7f70000091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:38.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.297+0000 7f70183ff700 1 -- 172.21.15.71:0/1229437054 shutdown_connections 2023-10-09T06:57:38.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.297+0000 7f70183ff700 1 --2- 172.21.15.71:0/1229437054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f701015db10 0x7f701016d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:38.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.297+0000 7f70183ff700 1 --2- 172.21.15.71:0/1229437054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7010159890 0x7f70100cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:38.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.297+0000 7f70183ff700 1 --2- 172.21.15.71:0/1229437054 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6ff4066f80 0x7f6ff4069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:38.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.297+0000 7f70183ff700 1 --2- 172.21.15.71:0/1229437054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7010159c60 0x7f701016d050 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:38.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.297+0000 7f70183ff700 1 -- 172.21.15.71:0/1229437054 >> 172.21.15.71:0/1229437054 conn(0x7f7010068e20 msgr2=0x7f7010152fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:38.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.297+0000 7f70183ff700 1 -- 172.21.15.71:0/1229437054 shutdown_connections 2023-10-09T06:57:38.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.297+0000 7f70183ff700 1 -- 172.21.15.71:0/1229437054 wait complete. 2023-10-09T06:57:38.316 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-09T06:57:38.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.503+0000 7f04fa59d700 1 Processor -- start 2023-10-09T06:57:38.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.503+0000 7f04fa59d700 1 -- start start 2023-10-09T06:57:38.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.504+0000 7f04fa59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f40ccc00 0x7f04f4069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:38.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.505+0000 7f04fa59d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f04f406a020 0x7f04f40cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:38.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.505+0000 7f04fa59d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f40c9f30 con 0x7f04f4159a60 2023-10-09T06:57:38.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.505+0000 7f04fa59d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f406dfc0 con 0x7f04f406a020 2023-10-09T06:57:38.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.505+0000 7f04fa59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f40ca470 con 0x7f04f40ccc00 2023-10-09T06:57:38.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.505+0000 7f04f9d9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f04f406a020 0x7f04f40cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:38.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.505+0000 7f04f8d9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f40ccc00 0x7f04f4069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:38.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.505+0000 7f04f959b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f04f4159a60 0x7f04f40c9770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:54850/0 (socket says 172.21.15.71:54850) 2023-10-09T06:57:38.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.505+0000 7f04f959b700 1 -- 172.21.15.71:0/3733271127 learned_addr learned my addr 172.21.15.71:0/3733271127 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:38.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.505+0000 7f04f9d9c700 1 -- 172.21.15.71:0/3733271127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f40ccc00 msgr2=0x7f04f4069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:38.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.505+0000 7f04f9d9c700 1 --2- 172.21.15.71:0/3733271127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f40ccc00 0x7f04f4069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:38.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.505+0000 7f04f9d9c700 1 -- 172.21.15.71:0/3733271127 >> v1:172.21.15.179:6789/0 conn(0x7f04f4159a60 legacy=0x7f04f40c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:38.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.505+0000 7f04f9d9c700 1 -- 172.21.15.71:0/3733271127 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f40ca750 con 0x7f04f406a020 2023-10-09T06:57:38.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.505+0000 7f04ebfff700 1 -- 172.21.15.71:0/3733271127 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28701315 0 0) 0x7f04f40c9f30 con 0x7f04f4159a60 2023-10-09T06:57:38.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.506+0000 7f04f9d9c700 1 --2- 172.21.15.71:0/3733271127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f406a020 0x7f04f40cb230 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f04ec009e60 tx=0x7f04ec009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdea8d5c0c26544d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:38.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.506+0000 7f04ebfff700 1 -- 172.21.15.71:0/3733271127 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec00e070 con 0x7f04f406a020 2023-10-09T06:57:38.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.506+0000 7f04ebfff700 1 -- 172.21.15.71:0/3733271127 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ec00bbf0 con 0x7f04f406a020 2023-10-09T06:57:38.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.506+0000 7f04ebfff700 1 -- 172.21.15.71:0/3733271127 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec012430 con 0x7f04f406a020 2023-10-09T06:57:38.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.506+0000 7f04fa59d700 1 -- 172.21.15.71:0/3733271127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f406a020 msgr2=0x7f04f40cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:38.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.506+0000 7f04fa59d700 1 --2- 172.21.15.71:0/3733271127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f406a020 0x7f04f40cb230 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f04ec009e60 tx=0x7f04ec009780 comp rx=0 tx=0).stop 2023-10-09T06:57:38.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.507+0000 7f04fa59d700 1 -- 172.21.15.71:0/3733271127 shutdown_connections 2023-10-09T06:57:38.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.507+0000 7f04fa59d700 1 --2- 172.21.15.71:0/3733271127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f406a020 0x7f04f40cb230 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:38.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.507+0000 7f04fa59d700 1 --2- 172.21.15.71:0/3733271127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f40ccc00 0x7f04f4069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:38.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.507+0000 7f04fa59d700 1 -- 172.21.15.71:0/3733271127 >> 172.21.15.71:0/3733271127 conn(0x7f04f406baa0 msgr2=0x7f04f406bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:38.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.507+0000 7f04fa59d700 1 -- 172.21.15.71:0/3733271127 shutdown_connections 2023-10-09T06:57:38.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.507+0000 7f04fa59d700 1 -- 172.21.15.71:0/3733271127 wait complete. 2023-10-09T06:57:38.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.508+0000 7f04fa59d700 1 Processor -- start 2023-10-09T06:57:38.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.508+0000 7f04fa59d700 1 -- start start 2023-10-09T06:57:38.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.509+0000 7f04fa59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f406a020 0x7f04f414f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:38.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.509+0000 7f04fa59d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04f40ccc00 0x7f04f4154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:38.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.509+0000 7f04fa59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f4159a60 0x7f04f4156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:38.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.509+0000 7f04fa59d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f414fa30 con 0x7f04f40ccc00 2023-10-09T06:57:38.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.509+0000 7f04fa59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f40c4130 con 0x7f04f406a020 2023-10-09T06:57:38.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.509+0000 7f04fa59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f40c45c0 con 0x7f04f4159a60 2023-10-09T06:57:38.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.509+0000 7f04f959b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f406a020 0x7f04f414f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:38.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.509+0000 7f04f8d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04f40ccc00 0x7f04f4154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:38.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.509+0000 7f04f959b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f406a020 0x7f04f414f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:36568/0 (socket says 172.21.15.71:36568) 2023-10-09T06:57:38.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.509+0000 7f04f959b700 1 -- 172.21.15.71:0/3974771027 learned_addr learned my addr 172.21.15.71:0/3974771027 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:38.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.509+0000 7f04f9d9c700 1 --2- 172.21.15.71:0/3974771027 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f4159a60 0x7f04f4156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:38.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.510+0000 7f04f959b700 1 -- 172.21.15.71:0/3974771027 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f4159a60 msgr2=0x7f04f4156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:38.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.510+0000 7f04f959b700 1 --2- 172.21.15.71:0/3974771027 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f4159a60 0x7f04f4156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:38.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.510+0000 7f04f959b700 1 -- 172.21.15.71:0/3974771027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04f40ccc00 msgr2=0x7f04f4154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:38.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.510+0000 7f04f959b700 1 --2- 172.21.15.71:0/3974771027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04f40ccc00 0x7f04f4154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:38.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.510+0000 7f04f959b700 1 -- 172.21.15.71:0/3974771027 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ec009a20 con 0x7f04f406a020 2023-10-09T06:57:38.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.510+0000 7f04f8d9a700 1 --2- 172.21.15.71:0/3974771027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04f40ccc00 0x7f04f4154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:57:38.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.510+0000 7f04f959b700 1 --2- 172.21.15.71:0/3974771027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f406a020 0x7f04f414f4f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f04f000c5b0 tx=0x7f04f0001070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:38.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.510+0000 7f04e97fa700 1 -- 172.21.15.71:0/3974771027 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f0005b30 con 0x7f04f406a020 2023-10-09T06:57:38.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.510+0000 7f04e97fa700 1 -- 172.21.15.71:0/3974771027 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f0005c90 con 0x7f04f406a020 2023-10-09T06:57:38.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.510+0000 7f04fa59d700 1 -- 172.21.15.71:0/3974771027 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f40c3560 con 0x7f04f406a020 2023-10-09T06:57:38.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.510+0000 7f04e97fa700 1 -- 172.21.15.71:0/3974771027 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f0007300 con 0x7f04f406a020 2023-10-09T06:57:38.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.510+0000 7f04fa59d700 1 -- 172.21.15.71:0/3974771027 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f40c3ae0 con 0x7f04f406a020 2023-10-09T06:57:38.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.511+0000 7f04fa59d700 1 -- 172.21.15.71:0/3974771027 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f40c4410 con 0x7f04f406a020 2023-10-09T06:57:38.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.512+0000 7f04e97fa700 1 -- 172.21.15.71:0/3974771027 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 27) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f04f001b3b0 con 0x7f04f406a020 2023-10-09T06:57:38.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.513+0000 7f04e97fa700 1 --2- 172.21.15.71:0/3974771027 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f04d8066f80 0x7f04d8069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:38.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.513+0000 7f04e97fa700 1 -- 172.21.15.71:0/3974771027 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f04f0083bf0 con 0x7f04f406a020 2023-10-09T06:57:38.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.513+0000 7f04f8d9a700 1 -- 172.21.15.71:0/3974771027 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f04d8066f80 msgr2=0x7f04d8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:38.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.513+0000 7f04f8d9a700 1 --2- 172.21.15.71:0/3974771027 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f04d8066f80 0x7f04d8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:38.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.518+0000 7f04e97fa700 1 -- 172.21.15.71:0/3974771027 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04f0050c30 con 0x7f04f406a020 2023-10-09T06:57:38.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.714+0000 7f04f8d9a700 1 -- 172.21.15.71:0/3974771027 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f04d8066f80 msgr2=0x7f04d8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:38.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.714+0000 7f04f8d9a700 1 --2- 172.21.15.71:0/3974771027 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f04d8066f80 0x7f04d8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:38.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.719+0000 7f04fa59d700 1 -- 172.21.15.71:0/3974771027 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f04f40caa30 con 0x7f04f406a020 2023-10-09T06:57:38.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.727+0000 7f04e97fa700 1 -- 172.21.15.71:0/3974771027 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7f04f00170c0 con 0x7f04f406a020 2023-10-09T06:57:38.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.729+0000 7f04fa59d700 1 -- 172.21.15.71:0/3974771027 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f04d8066f80 msgr2=0x7f04d8069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:38.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.729+0000 7f04fa59d700 1 --2- 172.21.15.71:0/3974771027 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f04d8066f80 0x7f04d8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:38.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.729+0000 7f04fa59d700 1 -- 172.21.15.71:0/3974771027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f406a020 msgr2=0x7f04f414f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:38.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.729+0000 7f04fa59d700 1 --2- 172.21.15.71:0/3974771027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f406a020 0x7f04f414f4f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f04f000c5b0 tx=0x7f04f0001070 comp rx=0 tx=0).stop 2023-10-09T06:57:38.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.729+0000 7f04fa59d700 1 -- 172.21.15.71:0/3974771027 shutdown_connections 2023-10-09T06:57:38.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.729+0000 7f04fa59d700 1 --2- 172.21.15.71:0/3974771027 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f4159a60 0x7f04f4156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:38.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.729+0000 7f04fa59d700 1 --2- 172.21.15.71:0/3974771027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f406a020 0x7f04f414f4f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:38.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.729+0000 7f04fa59d700 1 --2- 172.21.15.71:0/3974771027 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f04d8066f80 0x7f04d8069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:38.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.729+0000 7f04fa59d700 1 --2- 172.21.15.71:0/3974771027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04f40ccc00 0x7f04f4154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:38.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.729+0000 7f04fa59d700 1 -- 172.21.15.71:0/3974771027 >> 172.21.15.71:0/3974771027 conn(0x7f04f406baa0 msgr2=0x7f04f40c93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:38.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.729+0000 7f04fa59d700 1 -- 172.21.15.71:0/3974771027 shutdown_connections 2023-10-09T06:57:38.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:38.729+0000 7f04fa59d700 1 -- 172.21.15.71:0/3974771027 wait complete. 2023-10-09T06:57:38.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:57:38.748 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-09T06:57:38.793 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-10-09T06:57:39.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.024+0000 7f6afb59e700 1 Processor -- start 2023-10-09T06:57:39.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.024+0000 7f6afb59e700 1 -- start start 2023-10-09T06:57:39.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.025+0000 7f6afb59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6afc0b0790 0x7f6afc0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:39.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.025+0000 7f6afb59e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6afc1591e0 0x7f6afc159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:39.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.025+0000 7f6afb59e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6afc0cfa00 con 0x7f6afc0b03c0 2023-10-09T06:57:39.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.025+0000 7f6afb59e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6afc0cb580 con 0x7f6afc1591e0 2023-10-09T06:57:39.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.025+0000 7f6afb59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc0cf160 con 0x7f6afc0b0790 2023-10-09T06:57:39.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.025+0000 7f6afa59c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6afc0b03c0 0x7f6afc0b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:40172/0 (socket says 172.21.15.71:40172) 2023-10-09T06:57:39.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.025+0000 7f6afa59c700 1 -- 172.21.15.71:0/3171328936 learned_addr learned my addr 172.21.15.71:0/3171328936 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:39.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.025+0000 7f6afad9d700 1 --2- 172.21.15.71:0/3171328936 >> v2:172.21.15.71:3300/0 conn(0x7f6afc1591e0 0x7f6afc159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:39.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.025+0000 7f6af9d9b700 1 --2- 172.21.15.71:0/3171328936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6afc0b0790 0x7f6afc0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:39.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.026+0000 7f6af959a700 1 -- 172.21.15.71:0/3171328936 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151808165 0 0) 0x7f6afc0cfa00 con 0x7f6afc0b03c0 2023-10-09T06:57:39.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.026+0000 7f6af959a700 1 -- 172.21.15.71:0/3171328936 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ae4003570 con 0x7f6afc0b03c0 2023-10-09T06:57:39.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.026+0000 7f6afad9d700 1 -- 172.21.15.71:0/3171328936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6afc0b0790 msgr2=0x7f6afc0cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:39.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.026+0000 7f6afad9d700 1 --2- 172.21.15.71:0/3171328936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6afc0b0790 0x7f6afc0cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:39.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.026+0000 7f6afad9d700 1 -- 172.21.15.71:0/3171328936 >> v1:172.21.15.71:6789/0 conn(0x7f6afc0b03c0 legacy=0x7f6afc0b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:39.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.026+0000 7f6afad9d700 1 -- 172.21.15.71:0/3171328936 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc0cf440 con 0x7f6afc1591e0 2023-10-09T06:57:39.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.026+0000 7f6afad9d700 1 --2- 172.21.15.71:0/3171328936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6afc1591e0 0x7f6afc159620 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6af4009e60 tx=0x7f6af4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bad700640ad35e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:39.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.026+0000 7f6af959a700 1 -- 172.21.15.71:0/3171328936 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af400e070 con 0x7f6afc1591e0 2023-10-09T06:57:39.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.026+0000 7f6af959a700 1 -- 172.21.15.71:0/3171328936 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af400bab0 con 0x7f6afc1591e0 2023-10-09T06:57:39.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.026+0000 7f6af959a700 1 -- 172.21.15.71:0/3171328936 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af400be70 con 0x7f6afc1591e0 2023-10-09T06:57:39.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.027+0000 7f6afb59e700 1 -- 172.21.15.71:0/3171328936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6afc1591e0 msgr2=0x7f6afc159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:39.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.027+0000 7f6afb59e700 1 --2- 172.21.15.71:0/3171328936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6afc1591e0 0x7f6afc159620 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6af4009e60 tx=0x7f6af4009780 comp rx=0 tx=0).stop 2023-10-09T06:57:39.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.027+0000 7f6afb59e700 1 -- 172.21.15.71:0/3171328936 shutdown_connections 2023-10-09T06:57:39.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.027+0000 7f6afb59e700 1 --2- 172.21.15.71:0/3171328936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6afc1591e0 0x7f6afc159620 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:39.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.027+0000 7f6afb59e700 1 --2- 172.21.15.71:0/3171328936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6afc0b0790 0x7f6afc0cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:39.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.027+0000 7f6afb59e700 1 -- 172.21.15.71:0/3171328936 >> 172.21.15.71:0/3171328936 conn(0x7f6afc063230 msgr2=0x7f6afc063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:39.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.027+0000 7f6afb59e700 1 -- 172.21.15.71:0/3171328936 shutdown_connections 2023-10-09T06:57:39.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.027+0000 7f6afb59e700 1 -- 172.21.15.71:0/3171328936 wait complete. 2023-10-09T06:57:39.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.029+0000 7f6afb59e700 1 Processor -- start 2023-10-09T06:57:39.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.029+0000 7f6afb59e700 1 -- start start 2023-10-09T06:57:39.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.030+0000 7f6afb59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6afc0b03c0 0x7f6afc0c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:39.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.030+0000 7f6afb59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6afc0b0790 0x7f6afc1575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:39.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.030+0000 7f6afb59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6afc1591e0 0x7f6afc0c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:39.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.030+0000 7f6afb59e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc0c9d30 con 0x7f6afc0b03c0 2023-10-09T06:57:39.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.030+0000 7f6afb59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc0c40f0 con 0x7f6afc1591e0 2023-10-09T06:57:39.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.030+0000 7f6afb59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc0c43d0 con 0x7f6afc0b0790 2023-10-09T06:57:39.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.030+0000 7f6afa59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6afc0b03c0 0x7f6afc0c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:39.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.030+0000 7f6afa59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6afc0b03c0 0x7f6afc0c9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52138/0 (socket says 172.21.15.71:52138) 2023-10-09T06:57:39.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.030+0000 7f6afa59c700 1 -- 172.21.15.71:0/4071320000 learned_addr learned my addr 172.21.15.71:0/4071320000 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:39.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.030+0000 7f6af9d9b700 1 --2- 172.21.15.71:0/4071320000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6afc0b0790 0x7f6afc1575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:39.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.030+0000 7f6afad9d700 1 --2- 172.21.15.71:0/4071320000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6afc1591e0 0x7f6afc0c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:39.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.031+0000 7f6afa59c700 1 -- 172.21.15.71:0/4071320000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6afc0b0790 msgr2=0x7f6afc1575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:39.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.031+0000 7f6afa59c700 1 --2- 172.21.15.71:0/4071320000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6afc0b0790 0x7f6afc1575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:39.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.031+0000 7f6afa59c700 1 -- 172.21.15.71:0/4071320000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6afc1591e0 msgr2=0x7f6afc0c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:39.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.031+0000 7f6afa59c700 1 --2- 172.21.15.71:0/4071320000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6afc1591e0 0x7f6afc0c6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:39.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.031+0000 7f6afa59c700 1 -- 172.21.15.71:0/4071320000 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af4009a20 con 0x7f6afc0b03c0 2023-10-09T06:57:39.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.031+0000 7f6afa59c700 1 --2- 172.21.15.71:0/4071320000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6afc0b03c0 0x7f6afc0c9470 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00c590 tx=0x7f6aec007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:39.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.031+0000 7f6aea7fc700 1 -- 172.21.15.71:0/4071320000 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec005b30 con 0x7f6afc0b03c0 2023-10-09T06:57:39.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.031+0000 7f6aea7fc700 1 -- 172.21.15.71:0/4071320000 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aec005cb0 con 0x7f6afc0b03c0 2023-10-09T06:57:39.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.031+0000 7f6afb59e700 1 -- 172.21.15.71:0/4071320000 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6afc0c46b0 con 0x7f6afc0b03c0 2023-10-09T06:57:39.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.031+0000 7f6aea7fc700 1 -- 172.21.15.71:0/4071320000 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec007320 con 0x7f6afc0b03c0 2023-10-09T06:57:39.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.032+0000 7f6afb59e700 1 -- 172.21.15.71:0/4071320000 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6afc157af0 con 0x7f6afc0b03c0 2023-10-09T06:57:39.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.033+0000 7f6afb59e700 1 -- 172.21.15.71:0/4071320000 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6afc0c48d0 con 0x7f6afc0b03c0 2023-10-09T06:57:39.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.033+0000 7f6aea7fc700 1 -- 172.21.15.71:0/4071320000 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f6aec01b3b0 con 0x7f6afc0b03c0 2023-10-09T06:57:39.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.035+0000 7f6aea7fc700 1 --2- 172.21.15.71:0/4071320000 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6adc066f80 0x7f6adc069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:39.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.035+0000 7f6aea7fc700 1 -- 172.21.15.71:0/4071320000 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f6aec083c40 con 0x7f6afc0b03c0 2023-10-09T06:57:39.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.035+0000 7f6af9d9b700 1 -- 172.21.15.71:0/4071320000 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6adc066f80 msgr2=0x7f6adc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:39.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.035+0000 7f6af9d9b700 1 --2- 172.21.15.71:0/4071320000 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6adc066f80 0x7f6adc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:39.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.040+0000 7f6aea7fc700 1 -- 172.21.15.71:0/4071320000 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6aec050c80 con 0x7f6afc0b03c0 2023-10-09T06:57:39.138 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:39.137+0000 7f4c0bd2d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T06:57:39.178 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:39.178+0000 7f94f529e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T06:57:39.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.237+0000 7f6af9d9b700 1 -- 172.21.15.71:0/4071320000 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6adc066f80 msgr2=0x7f6adc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:39.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.237+0000 7f6af9d9b700 1 --2- 172.21.15.71:0/4071320000 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6adc066f80 0x7f6adc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:39.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.260+0000 7f6afb59e700 1 -- 172.21.15.71:0/4071320000 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6afc0c3f70 con 0x7f6adc066f80 2023-10-09T06:57:39.303 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:39.301+0000 7f4c0bd2d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T06:57:39.343 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:39.344+0000 7f94f529e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T06:57:39.389 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:39.388+0000 7f4c0bd2d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T06:57:39.428 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:39.428+0000 7f94f529e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T06:57:39.613 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:39.612+0000 7f4c0bd2d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:57:39.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.637+0000 7f6af9d9b700 1 -- 172.21.15.71:0/4071320000 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6adc066f80 msgr2=0x7f6adc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:39.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:39.637+0000 7f6af9d9b700 1 --2- 172.21.15.71:0/4071320000 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6adc066f80 0x7f6adc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T06:57:39.651 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:39.650+0000 7f94f529e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:57:39.789 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:39.787+0000 7f4c0bd2d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T06:57:39.830 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:39.829+0000 7f94f529e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T06:57:39.880 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:39.878+0000 7f4c0bd2d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T06:57:39.921 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:39.920+0000 7f94f529e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T06:57:40.042 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:40.041+0000 7f4c0bd2d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T06:57:40.082 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:40.081+0000 7f94f529e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T06:57:40.142 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:40.141+0000 7f4c0bd2d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T06:57:40.182 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:40.182+0000 7f94f529e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T06:57:40.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:40.438+0000 7f6af9d9b700 1 -- 172.21.15.71:0/4071320000 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6adc066f80 msgr2=0x7f6adc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:40.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:40.438+0000 7f6af9d9b700 1 --2- 172.21.15.71:0/4071320000 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6adc066f80 0x7f6adc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T06:57:40.625 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:40.623+0000 7f4c0bd2d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T06:57:40.664 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:40.663+0000 7f94f529e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T06:57:40.718 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:40.717+0000 7f4c0bd2d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T06:57:40.758 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:40.757+0000 7f94f529e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T06:57:40.810 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:40.806+0000 7f4c0bd2d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T06:57:40.846 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:40.846+0000 7f94f529e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T06:57:41.429 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:41.428+0000 7f4c0bd2d180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T06:57:41.467 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:41.466+0000 7f94f529e180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T06:57:41.600 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:41.599+0000 7f4c0bd2d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:57:41.639 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:41.638+0000 7f94f529e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:57:41.695 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:41.693+0000 7f4c0bd2d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T06:57:41.734 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:41.733+0000 7f94f529e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T06:57:41.989 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:41.988+0000 7f4c0bd2d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T06:57:42.027 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:42.026+0000 7f94f529e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T06:57:42.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:42.040+0000 7f6af9d9b700 1 -- 172.21.15.71:0/4071320000 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6adc066f80 msgr2=0x7f6adc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:42.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:42.040+0000 7f6af9d9b700 1 --2- 172.21.15.71:0/4071320000 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6adc066f80 0x7f6adc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-09T06:57:42.084 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:42.083+0000 7f4c0bd2d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T06:57:42.122 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:42.121+0000 7f94f529e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T06:57:42.779 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:42.779+0000 7f4c0bd2d180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T06:57:42.820 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:42.819+0000 7f94f529e180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T06:57:43.065 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:43.065+0000 7f4c0bd2d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T06:57:43.102 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:43.101+0000 7f94f529e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T06:57:43.157 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:43.156+0000 7f4c0bd2d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T06:57:43.193 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:43.192+0000 7f94f529e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T06:57:43.309 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:43.308+0000 7f4c0bd2d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T06:57:43.343 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:43.342+0000 7f94f529e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T06:57:43.411 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:43.411+0000 7f4c0bd2d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T06:57:43.446 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:43.446+0000 7f94f529e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T06:57:43.598 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:43.598+0000 7f4c0bd2d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T06:57:43.635 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:43.634+0000 7f94f529e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T06:57:43.690 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:43.690+0000 7f4c0bd2d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T06:57:43.726 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:43.725+0000 7f94f529e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T06:57:43.781 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:43.781+0000 7f4c0bd2d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T06:57:43.820 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:43.819+0000 7f94f529e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T06:57:43.877 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:43.877+0000 7f4c0bd2d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T06:57:43.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:43.891+0000 7f6aea7fc700 1 -- 172.21.15.71:0/4071320000 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 28) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f6aec051050 con 0x7f6afc0b03c0 2023-10-09T06:57:43.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:43.892+0000 7f6aea7fc700 1 -- 172.21.15.71:0/4071320000 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6adc066f80 msgr2=0x7f6adc069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:43.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:43.892+0000 7f6aea7fc700 1 --2- 172.21.15.71:0/4071320000 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6adc066f80 0x7f6adc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:43.919 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:43.918+0000 7f94f529e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T06:57:44.014 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:44.013+0000 7f4b81077700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:44.014 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:44.013+0000 7f4b7e071700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:44.014 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:44.013+0000 7f4b7e071700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:44.014 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:44.013+0000 7f4b81077700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:44.014 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:44.013+0000 7f4b7e071700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:44.015 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:44.013+0000 7f4b7e071700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:44.015 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:44.013+0000 7f4b81077700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:44.015 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:44.013+0000 7f4b81077700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:44.015 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:44.013+0000 7f4b81077700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:44.015 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:44.013+0000 7f4b7e071700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:44.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:44.892+0000 7f6aea7fc700 1 -- 172.21.15.71:0/4071320000 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mgrmap(e 29) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f6aec05b450 con 0x7f6afc0b03c0 2023-10-09T06:57:44.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:44.892+0000 7f6aea7fc700 1 --2- 172.21.15.71:0/4071320000 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6adc066f80 0x7f6adc0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:44.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:44.892+0000 7f6aea7fc700 1 -- 172.21.15.71:0/4071320000 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6adc00e8c0 con 0x7f6adc066f80 2023-10-09T06:57:44.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:44.897+0000 7f6af9d9b700 1 --2- 172.21.15.71:0/4071320000 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6adc066f80 0x7f6adc0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:44.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:44.903+0000 7f6af9d9b700 1 --2- 172.21.15.71:0/4071320000 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6adc066f80 0x7f6adc0693b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6afc1670e0 tx=0x7f6af00091a0 comp rx=0 tx=0).ready entity=mgr.6193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:44.912 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:44.911+0000 7f4b88085700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-10-09T06:57:44.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:44.911+0000 7f6aea7fc700 1 -- 172.21.15.71:0/4071320000 <== mgr.6193 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f6adc00e8c0 con 0x7f6adc066f80 2023-10-09T06:57:44.914 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-10-09T06:57:44.922 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-09T06:57:44.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:57:44.923 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-09T06:57:44.961 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-09T06:57:45.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.184+0000 7f1c00b9d700 1 Processor -- start 2023-10-09T06:57:45.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.184+0000 7f1c00b9d700 1 -- start start 2023-10-09T06:57:45.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.185+0000 7f1c00b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bfc06f060 0x7f1bfc0ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:45.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.185+0000 7f1c00b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1bfc06f4b0 0x7f1bfc0ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:45.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.185+0000 7f1c00b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bfc06ebd0 con 0x7f1bfc0cb1a0 2023-10-09T06:57:45.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.185+0000 7f1c00b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bfc15b2e0 con 0x7f1bfc06f4b0 2023-10-09T06:57:45.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.185+0000 7f1c00b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc15aa70 con 0x7f1bfc06f060 2023-10-09T06:57:45.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.186+0000 7f1bfbfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1bfc06f4b0 0x7f1bfc0ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:45.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.186+0000 7f1bfaffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bfc06f060 0x7f1bfc0ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:45.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.186+0000 7f1bfbfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1bfc06f4b0 0x7f1bfc0ae610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:36320/0 (socket says 172.21.15.71:36320) 2023-10-09T06:57:45.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.186+0000 7f1bfaffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bfc06f060 0x7f1bfc0ae0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:60632/0 (socket says 172.21.15.71:60632) 2023-10-09T06:57:45.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.186+0000 7f1bfbfff700 1 -- 172.21.15.71:0/3754550017 learned_addr learned my addr 172.21.15.71:0/3754550017 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:45.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.186+0000 7f1bfa7fc700 1 -- 172.21.15.71:0/3754550017 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421227303 0 0) 0x7f1bfc06ebd0 con 0x7f1bfc0cb1a0 2023-10-09T06:57:45.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.186+0000 7f1bfa7fc700 1 -- 172.21.15.71:0/3754550017 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1be4003570 con 0x7f1bfc0cb1a0 2023-10-09T06:57:45.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.186+0000 7f1bfaffd700 1 -- 172.21.15.71:0/3754550017 >> v2:172.21.15.179:3300/0 conn(0x7f1bfc06f4b0 msgr2=0x7f1bfc0ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:45.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.186+0000 7f1bfaffd700 1 --2- 172.21.15.71:0/3754550017 >> v2:172.21.15.179:3300/0 conn(0x7f1bfc06f4b0 0x7f1bfc0ae610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:45.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.186+0000 7f1bfaffd700 1 -- 172.21.15.71:0/3754550017 >> v1:172.21.15.179:6789/0 conn(0x7f1bfc0cb1a0 legacy=0x7f1bfc15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:45.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.186+0000 7f1bfaffd700 1 -- 172.21.15.71:0/3754550017 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc15ad20 con 0x7f1bfc06f060 2023-10-09T06:57:45.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.186+0000 7f1bfbfff700 1 --2- 172.21.15.71:0/3754550017 >> v2:172.21.15.179:3300/0 conn(0x7f1bfc06f4b0 0x7f1bfc0ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:57:45.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.187+0000 7f1bfaffd700 1 --2- 172.21.15.71:0/3754550017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bfc06f060 0x7f1bfc0ae0d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00098e0 tx=0x7f1bf00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35e4f3dcbcf94f77 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:45.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.187+0000 7f1bfa7fc700 1 -- 172.21.15.71:0/3754550017 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0011630 con 0x7f1bfc06f060 2023-10-09T06:57:45.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.187+0000 7f1bfa7fc700 1 -- 172.21.15.71:0/3754550017 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf0011790 con 0x7f1bfc06f060 2023-10-09T06:57:45.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.187+0000 7f1bfa7fc700 1 -- 172.21.15.71:0/3754550017 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0011b30 con 0x7f1bfc06f060 2023-10-09T06:57:45.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.187+0000 7f1c00b9d700 1 -- 172.21.15.71:0/3754550017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bfc06f060 msgr2=0x7f1bfc0ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:45.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.187+0000 7f1c00b9d700 1 --2- 172.21.15.71:0/3754550017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bfc06f060 0x7f1bfc0ae0d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00098e0 tx=0x7f1bf00091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:45.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.187+0000 7f1c00b9d700 1 -- 172.21.15.71:0/3754550017 shutdown_connections 2023-10-09T06:57:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.187+0000 7f1c00b9d700 1 --2- 172.21.15.71:0/3754550017 >> v2:172.21.15.179:3300/0 conn(0x7f1bfc06f4b0 0x7f1bfc0ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.187+0000 7f1c00b9d700 1 --2- 172.21.15.71:0/3754550017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bfc06f060 0x7f1bfc0ae0d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.187+0000 7f1c00b9d700 1 -- 172.21.15.71:0/3754550017 >> 172.21.15.71:0/3754550017 conn(0x7f1bfc0cc1e0 msgr2=0x7f1bfc0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.187+0000 7f1c00b9d700 1 -- 172.21.15.71:0/3754550017 shutdown_connections 2023-10-09T06:57:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.187+0000 7f1c00b9d700 1 -- 172.21.15.71:0/3754550017 wait complete. 2023-10-09T06:57:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.189+0000 7f1c00b9d700 1 Processor -- start 2023-10-09T06:57:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.189+0000 7f1c00b9d700 1 -- start start 2023-10-09T06:57:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.190+0000 7f1c00b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bfc06f060 0x7f1bfc14e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.190+0000 7f1c00b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1bfc06f4b0 0x7f1bfc157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.190+0000 7f1c00b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bfc0cb1a0 0x7f1bfc155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.190+0000 7f1c00b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc14fbc0 con 0x7f1bfc06f4b0 2023-10-09T06:57:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.190+0000 7f1c00b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc14ecf0 con 0x7f1bfc06f060 2023-10-09T06:57:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.190+0000 7f1c00b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc14efb0 con 0x7f1bfc0cb1a0 2023-10-09T06:57:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.190+0000 7f1bfaffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1bfc06f4b0 0x7f1bfc157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.190+0000 7f1bfaffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1bfc06f4b0 0x7f1bfc157f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55724/0 (socket says 172.21.15.71:55724) 2023-10-09T06:57:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.190+0000 7f1bfaffd700 1 -- 172.21.15.71:0/55483497 learned_addr learned my addr 172.21.15.71:0/55483497 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.190+0000 7f1bfbfff700 1 --2- 172.21.15.71:0/55483497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bfc0cb1a0 0x7f1bfc155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.190+0000 7f1bfb7fe700 1 --2- 172.21.15.71:0/55483497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bfc06f060 0x7f1bfc14e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.191+0000 7f1bfaffd700 1 -- 172.21.15.71:0/55483497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bfc0cb1a0 msgr2=0x7f1bfc155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:45.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.191+0000 7f1bfaffd700 1 --2- 172.21.15.71:0/55483497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bfc0cb1a0 0x7f1bfc155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:45.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.191+0000 7f1bfaffd700 1 -- 172.21.15.71:0/55483497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bfc06f060 msgr2=0x7f1bfc14e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:45.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.191+0000 7f1bfaffd700 1 --2- 172.21.15.71:0/55483497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bfc06f060 0x7f1bfc14e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:45.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.191+0000 7f1bfaffd700 1 -- 172.21.15.71:0/55483497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf4009ae0 con 0x7f1bfc06f4b0 2023-10-09T06:57:45.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.191+0000 7f1bfbfff700 1 --2- 172.21.15.71:0/55483497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bfc0cb1a0 0x7f1bfc155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:45.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.191+0000 7f1bfaffd700 1 --2- 172.21.15.71:0/55483497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1bfc06f4b0 0x7f1bfc157f80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc15abb0 tx=0x7f1bf0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:45.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.191+0000 7f1be37fe700 1 -- 172.21.15.71:0/55483497 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0011b10 con 0x7f1bfc06f4b0 2023-10-09T06:57:45.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.191+0000 7f1be37fe700 1 -- 172.21.15.71:0/55483497 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf00253f0 con 0x7f1bfc06f4b0 2023-10-09T06:57:45.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.191+0000 7f1be37fe700 1 -- 172.21.15.71:0/55483497 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0025790 con 0x7f1bfc06f4b0 2023-10-09T06:57:45.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.191+0000 7f1c00b9d700 1 -- 172.21.15.71:0/55483497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf0009420 con 0x7f1bfc06f4b0 2023-10-09T06:57:45.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.191+0000 7f1c00b9d700 1 -- 172.21.15.71:0/55483497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bfc14f570 con 0x7f1bfc06f4b0 2023-10-09T06:57:45.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.192+0000 7f1c00b9d700 1 -- 172.21.15.71:0/55483497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bfc06c450 con 0x7f1bfc06f4b0 2023-10-09T06:57:45.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.193+0000 7f1be37fe700 1 -- 172.21.15.71:0/55483497 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 29) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f1bf0025bc0 con 0x7f1bfc06f4b0 2023-10-09T06:57:45.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.194+0000 7f1be37fe700 1 --2- 172.21.15.71:0/55483497 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1be8066dd0 0x7f1be8069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:45.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.194+0000 7f1be37fe700 1 -- 172.21.15.71:0/55483497 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f1bf0085ec0 con 0x7f1bfc06f4b0 2023-10-09T06:57:45.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.194+0000 7f1bfb7fe700 1 --2- 172.21.15.71:0/55483497 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1be8066dd0 0x7f1be8069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:45.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.195+0000 7f1bfb7fe700 1 --2- 172.21.15.71:0/55483497 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1be8066dd0 0x7f1be8069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1bec0037e0 tx=0x7f1bec009040 comp rx=0 tx=0).ready entity=mgr.6193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.198+0000 7f1be37fe700 1 -- 172.21.15.71:0/55483497 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1bf0053150 con 0x7f1bfc06f4b0 2023-10-09T06:57:45.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.440+0000 7f1c00b9d700 1 -- 172.21.15.71:0/55483497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f1bfc15b000 con 0x7f1bfc06f4b0 2023-10-09T06:57:45.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.896+0000 7f1be37fe700 1 -- 172.21.15.71:0/55483497 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 30) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f1bf005c020 con 0x7f1bfc06f4b0 2023-10-09T06:57:45.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.897+0000 7f1be37fe700 1 -- 172.21.15.71:0/55483497 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v30) v1 ==== 93+0+0 (secure 0 0 0) 0x7f1bf0056be0 con 0x7f1bfc06f4b0 2023-10-09T06:57:45.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.900+0000 7f1c00b9d700 1 -- 172.21.15.71:0/55483497 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1be8066dd0 msgr2=0x7f1be8069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:45.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.900+0000 7f1c00b9d700 1 --2- 172.21.15.71:0/55483497 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1be8066dd0 0x7f1be8069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1bec0037e0 tx=0x7f1bec009040 comp rx=0 tx=0).stop 2023-10-09T06:57:45.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.900+0000 7f1c00b9d700 1 -- 172.21.15.71:0/55483497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1bfc06f4b0 msgr2=0x7f1bfc157f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:45.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.900+0000 7f1c00b9d700 1 --2- 172.21.15.71:0/55483497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1bfc06f4b0 0x7f1bfc157f80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc15abb0 tx=0x7f1bf0017000 comp rx=0 tx=0).stop 2023-10-09T06:57:45.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.900+0000 7f1c00b9d700 1 -- 172.21.15.71:0/55483497 shutdown_connections 2023-10-09T06:57:45.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.900+0000 7f1c00b9d700 1 --2- 172.21.15.71:0/55483497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bfc0cb1a0 0x7f1bfc155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:45.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.900+0000 7f1c00b9d700 1 --2- 172.21.15.71:0/55483497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bfc06f060 0x7f1bfc14e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:45.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.900+0000 7f1c00b9d700 1 --2- 172.21.15.71:0/55483497 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1be8066dd0 0x7f1be8069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:45.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.900+0000 7f1c00b9d700 1 --2- 172.21.15.71:0/55483497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1bfc06f4b0 0x7f1bfc157f80 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:45.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.900+0000 7f1c00b9d700 1 -- 172.21.15.71:0/55483497 >> 172.21.15.71:0/55483497 conn(0x7f1bfc0cc1e0 msgr2=0x7f1bfc0b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:45.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.900+0000 7f1c00b9d700 1 -- 172.21.15.71:0/55483497 shutdown_connections 2023-10-09T06:57:45.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:45.900+0000 7f1c00b9d700 1 -- 172.21.15.71:0/55483497 wait complete. 2023-10-09T06:57:45.920 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:57:45.921 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:57:46.013 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:57:46.102 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:57:46.102 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T06:57:46.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:57:46.102 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T06:57:46.186 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T06:57:46.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:57:46.186 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T06:57:46.223 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:57:46.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.448+0000 7fb031b9d700 1 Processor -- start 2023-10-09T06:57:46.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.448+0000 7fb031b9d700 1 -- start start 2023-10-09T06:57:46.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.449+0000 7fb031b9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb02c142ea0 0x7fb02c0b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:46.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.449+0000 7fb031b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb02c06c0f0 0x7fb02c06a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:46.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.449+0000 7fb031b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c0b40f0 con 0x7fb02c0ad870 2023-10-09T06:57:46.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.449+0000 7fb031b9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02c069640 con 0x7fb02c142ea0 2023-10-09T06:57:46.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.449+0000 7fb031b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02c069920 con 0x7fb02c06c0f0 2023-10-09T06:57:46.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.450+0000 7fb030b9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb02c142ea0 0x7fb02c0b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:46.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.450+0000 7fb030b9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb02c142ea0 0x7fb02c0b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55748/0 (socket says 172.21.15.71:55748) 2023-10-09T06:57:46.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.450+0000 7fb030b9b700 1 -- 172.21.15.71:0/1139524550 learned_addr learned my addr 172.21.15.71:0/1139524550 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:46.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.450+0000 7fb03139c700 1 --2- 172.21.15.71:0/1139524550 >> v2:172.21.15.179:3300/0 conn(0x7fb02c06c0f0 0x7fb02c06a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:46.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.450+0000 7fb030b9b700 1 -- 172.21.15.71:0/1139524550 >> v2:172.21.15.179:3300/0 conn(0x7fb02c06c0f0 msgr2=0x7fb02c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:46.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.450+0000 7fb030b9b700 1 --2- 172.21.15.71:0/1139524550 >> v2:172.21.15.179:3300/0 conn(0x7fb02c06c0f0 0x7fb02c06a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:46.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.450+0000 7fb030b9b700 1 -- 172.21.15.71:0/1139524550 >> v1:172.21.15.179:6789/0 conn(0x7fb02c0ad870 legacy=0x7fb02c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:46.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.450+0000 7fb030b9b700 1 -- 172.21.15.71:0/1139524550 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c069c00 con 0x7fb02c142ea0 2023-10-09T06:57:46.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.451+0000 7fb030b9b700 1 --2- 172.21.15.71:0/1139524550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb02c142ea0 0x7fb02c0b3630 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb02c071330 tx=0x7fb020009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217a5b0149f076ed server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:46.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.451+0000 7fb02b7fe700 1 -- 172.21.15.71:0/1139524550 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb020009e70 con 0x7fb02c142ea0 2023-10-09T06:57:46.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.451+0000 7fb02b7fe700 1 -- 172.21.15.71:0/1139524550 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02000b860 con 0x7fb02c142ea0 2023-10-09T06:57:46.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.451+0000 7fb02b7fe700 1 -- 172.21.15.71:0/1139524550 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02000bc00 con 0x7fb02c142ea0 2023-10-09T06:57:46.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.451+0000 7fb031b9d700 1 -- 172.21.15.71:0/1139524550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb02c142ea0 msgr2=0x7fb02c0b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:46.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.451+0000 7fb031b9d700 1 --2- 172.21.15.71:0/1139524550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb02c142ea0 0x7fb02c0b3630 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb02c071330 tx=0x7fb020009250 comp rx=0 tx=0).stop 2023-10-09T06:57:46.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.451+0000 7fb031b9d700 1 -- 172.21.15.71:0/1139524550 shutdown_connections 2023-10-09T06:57:46.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.451+0000 7fb031b9d700 1 --2- 172.21.15.71:0/1139524550 >> v2:172.21.15.179:3300/0 conn(0x7fb02c06c0f0 0x7fb02c06a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:46.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.451+0000 7fb031b9d700 1 --2- 172.21.15.71:0/1139524550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb02c142ea0 0x7fb02c0b3630 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:46.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.451+0000 7fb031b9d700 1 -- 172.21.15.71:0/1139524550 >> 172.21.15.71:0/1139524550 conn(0x7fb02c0ce430 msgr2=0x7fb02c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:46.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.452+0000 7fb031b9d700 1 -- 172.21.15.71:0/1139524550 shutdown_connections 2023-10-09T06:57:46.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.452+0000 7fb031b9d700 1 -- 172.21.15.71:0/1139524550 wait complete. 2023-10-09T06:57:46.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.453+0000 7fb031b9d700 1 Processor -- start 2023-10-09T06:57:46.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.453+0000 7fb031b9d700 1 -- start start 2023-10-09T06:57:46.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.454+0000 7fb031b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb02c06c0f0 0x7fb02c15ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:46.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.454+0000 7fb031b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb02c142ea0 0x7fb02c15a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:46.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.454+0000 7fb031b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02c140150 0x7fb02c158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:46.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.454+0000 7fb031b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0c75e0 con 0x7fb02c06c0f0 2023-10-09T06:57:46.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.454+0000 7fb031b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0c78c0 con 0x7fb02c142ea0 2023-10-09T06:57:46.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.454+0000 7fb031b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0c7ba0 con 0x7fb02c140150 2023-10-09T06:57:46.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.454+0000 7fb030b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb02c06c0f0 0x7fb02c15ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:46.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.454+0000 7fb030b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb02c06c0f0 0x7fb02c15ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55758/0 (socket says 172.21.15.71:55758) 2023-10-09T06:57:46.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.454+0000 7fb030b9b700 1 -- 172.21.15.71:0/1020777866 learned_addr learned my addr 172.21.15.71:0/1020777866 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:46.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.454+0000 7fb02bfff700 1 --2- 172.21.15.71:0/1020777866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb02c142ea0 0x7fb02c15a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:46.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.454+0000 7fb03139c700 1 --2- 172.21.15.71:0/1020777866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02c140150 0x7fb02c158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:46.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.455+0000 7fb030b9b700 1 -- 172.21.15.71:0/1020777866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02c140150 msgr2=0x7fb02c158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:46.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.455+0000 7fb030b9b700 1 --2- 172.21.15.71:0/1020777866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02c140150 0x7fb02c158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:46.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.455+0000 7fb030b9b700 1 -- 172.21.15.71:0/1020777866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb02c142ea0 msgr2=0x7fb02c15a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:46.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.455+0000 7fb030b9b700 1 --2- 172.21.15.71:0/1020777866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb02c142ea0 0x7fb02c15a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:46.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.455+0000 7fb030b9b700 1 -- 172.21.15.71:0/1020777866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0200094f0 con 0x7fb02c06c0f0 2023-10-09T06:57:46.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.455+0000 7fb02bfff700 1 --2- 172.21.15.71:0/1020777866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb02c142ea0 0x7fb02c15a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:57:46.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.455+0000 7fb030b9b700 1 --2- 172.21.15.71:0/1020777866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb02c06c0f0 0x7fb02c15ebd0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb02c06f0d0 tx=0x7fb020017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:46.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.455+0000 7fb028ff9700 1 -- 172.21.15.71:0/1020777866 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02000bbe0 con 0x7fb02c06c0f0 2023-10-09T06:57:46.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.456+0000 7fb028ff9700 1 -- 172.21.15.71:0/1020777866 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb020011420 con 0x7fb02c06c0f0 2023-10-09T06:57:46.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.456+0000 7fb028ff9700 1 -- 172.21.15.71:0/1020777866 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0200117e0 con 0x7fb02c06c0f0 2023-10-09T06:57:46.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.456+0000 7fb031b9d700 1 -- 172.21.15.71:0/1020777866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02c0c7e80 con 0x7fb02c06c0f0 2023-10-09T06:57:46.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.456+0000 7fb031b9d700 1 -- 172.21.15.71:0/1020777866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c15f110 con 0x7fb02c06c0f0 2023-10-09T06:57:46.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.457+0000 7fb031b9d700 1 -- 172.21.15.71:0/1020777866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02c0c83a0 con 0x7fb02c06c0f0 2023-10-09T06:57:46.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.458+0000 7fb028ff9700 1 -- 172.21.15.71:0/1020777866 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 30) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fb020011c10 con 0x7fb02c06c0f0 2023-10-09T06:57:46.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.459+0000 7fb028ff9700 1 --2- 172.21.15.71:0/1020777866 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb0100670e0 0x7fb010069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:46.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.460+0000 7fb028ff9700 1 -- 172.21.15.71:0/1020777866 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fb0200862a0 con 0x7fb02c06c0f0 2023-10-09T06:57:46.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.460+0000 7fb02bfff700 1 -- 172.21.15.71:0/1020777866 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb0100670e0 msgr2=0x7fb010069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:46.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.460+0000 7fb02bfff700 1 --2- 172.21.15.71:0/1020777866 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb0100670e0 0x7fb010069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:46.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.464+0000 7fb028ff9700 1 -- 172.21.15.71:0/1020777866 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb02c0c83a0 con 0x7fb02c06c0f0 2023-10-09T06:57:46.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.661+0000 7fb02bfff700 1 -- 172.21.15.71:0/1020777866 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb0100670e0 msgr2=0x7fb010069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:46.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.661+0000 7fb02bfff700 1 --2- 172.21.15.71:0/1020777866 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb0100670e0 0x7fb010069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:46.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.706+0000 7fb031b9d700 1 -- 172.21.15.71:0/1020777866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb02c0c83a0 con 0x7fb02c06c0f0 2023-10-09T06:57:46.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.706+0000 7fb028ff9700 1 -- 172.21.15.71:0/1020777866 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fb02c0c83a0 con 0x7fb02c06c0f0 2023-10-09T06:57:46.708 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:46.708 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6055,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3774833170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3774833170},{"type":"v1","addr":"172.21.15.179:6836","nonce":3774833170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6058,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3203736717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3203736717},{"type":"v1","addr":"172.21.15.179:6837","nonce":3203736717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2747804060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2747804060},{"type":"v1","addr":"172.21.15.71:6833","nonce":2747804060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:57:28.273000+0000","modified":"2023-10-09T06:57:31.823203+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6240},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6240":{"gid":6240,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/3993456703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3993456703},{"type":"v1","addr":"172.21.15.71:6835","nonce":3993456703}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T06:57:46.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.709+0000 7fb031b9d700 1 -- 172.21.15.71:0/1020777866 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb0100670e0 msgr2=0x7fb010069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:46.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.709+0000 7fb031b9d700 1 --2- 172.21.15.71:0/1020777866 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb0100670e0 0x7fb010069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:46.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.709+0000 7fb031b9d700 1 -- 172.21.15.71:0/1020777866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb02c06c0f0 msgr2=0x7fb02c15ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:46.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.709+0000 7fb031b9d700 1 --2- 172.21.15.71:0/1020777866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb02c06c0f0 0x7fb02c15ebd0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb02c06f0d0 tx=0x7fb020017000 comp rx=0 tx=0).stop 2023-10-09T06:57:46.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.709+0000 7fb031b9d700 1 -- 172.21.15.71:0/1020777866 shutdown_connections 2023-10-09T06:57:46.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.709+0000 7fb031b9d700 1 --2- 172.21.15.71:0/1020777866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02c140150 0x7fb02c158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:46.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.709+0000 7fb031b9d700 1 --2- 172.21.15.71:0/1020777866 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb0100670e0 0x7fb010069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:46.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.709+0000 7fb031b9d700 1 --2- 172.21.15.71:0/1020777866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb02c06c0f0 0x7fb02c15ebd0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:46.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.709+0000 7fb031b9d700 1 --2- 172.21.15.71:0/1020777866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb02c142ea0 0x7fb02c15a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:46.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.709+0000 7fb031b9d700 1 -- 172.21.15.71:0/1020777866 >> 172.21.15.71:0/1020777866 conn(0x7fb02c0ce430 msgr2=0x7fb02c1420a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:46.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.709+0000 7fb031b9d700 1 -- 172.21.15.71:0/1020777866 shutdown_connections 2023-10-09T06:57:46.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.709+0000 7fb031b9d700 1 -- 172.21.15.71:0/1020777866 wait complete. 2023-10-09T06:57:46.712 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 33 2023-10-09T06:57:46.729 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:57:46.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.918+0000 7ff015d9d700 1 Processor -- start 2023-10-09T06:57:46.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.918+0000 7ff015d9d700 1 -- start start 2023-10-09T06:57:46.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.920+0000 7ff015d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff010159420 0x7ff0100b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:46.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.920+0000 7ff015d9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0100b2980 con 0x7ff0101597f0 2023-10-09T06:57:46.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.920+0000 7ff015d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0100b11d0 con 0x7ff01015d230 2023-10-09T06:57:46.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.920+0000 7ff015d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0100b14b0 con 0x7ff010159420 2023-10-09T06:57:46.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.920+0000 7ff00ffff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff0101597f0 0x7ff0100b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46040/0 (socket says 172.21.15.71:46040) 2023-10-09T06:57:46.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.920+0000 7ff00ffff700 1 -- 172.21.15.71:0/2434891142 learned_addr learned my addr 172.21.15.71:0/2434891142 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:46.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.920+0000 7ff014d9b700 1 --2- 172.21.15.71:0/2434891142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff010159420 0x7ff0100b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:46.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.920+0000 7ff00f7fe700 1 -- 172.21.15.71:0/2434891142 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676456301 0 0) 0x7ff0100b2980 con 0x7ff0101597f0 2023-10-09T06:57:46.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.921+0000 7ff00f7fe700 1 -- 172.21.15.71:0/2434891142 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff000003570 con 0x7ff0101597f0 2023-10-09T06:57:46.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.921+0000 7ff00f7fe700 1 -- 172.21.15.71:0/2434891142 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877710639 0 0) 0x7ff0100b11d0 con 0x7ff01015d230 2023-10-09T06:57:46.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.921+0000 7ff014d9b700 1 -- 172.21.15.71:0/2434891142 >> v1:172.21.15.179:6789/0 conn(0x7ff01015d230 legacy=0x7ff0100b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:46.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.921+0000 7ff014d9b700 1 -- 172.21.15.71:0/2434891142 >> v1:172.21.15.71:6789/0 conn(0x7ff0101597f0 legacy=0x7ff0100b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.921+0000 7ff014d9b700 1 -- 172.21.15.71:0/2434891142 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0100b1790 con 0x7ff010159420 2023-10-09T06:57:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.921+0000 7ff014d9b700 1 --2- 172.21.15.71:0/2434891142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff010159420 0x7ff0100b5f40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff004009910 tx=0x7ff0040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7503ffae5efff437 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.921+0000 7ff00f7fe700 1 -- 172.21.15.71:0/2434891142 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00400b680 con 0x7ff010159420 2023-10-09T06:57:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.922+0000 7ff00f7fe700 1 -- 172.21.15.71:0/2434891142 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00400b7e0 con 0x7ff010159420 2023-10-09T06:57:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.922+0000 7ff00f7fe700 1 -- 172.21.15.71:0/2434891142 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00400bb80 con 0x7ff010159420 2023-10-09T06:57:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.922+0000 7ff015d9d700 1 -- 172.21.15.71:0/2434891142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff010159420 msgr2=0x7ff0100b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.922+0000 7ff015d9d700 1 --2- 172.21.15.71:0/2434891142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff010159420 0x7ff0100b5f40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff004009910 tx=0x7ff0040091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.922+0000 7ff015d9d700 1 -- 172.21.15.71:0/2434891142 shutdown_connections 2023-10-09T06:57:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.922+0000 7ff015d9d700 1 --2- 172.21.15.71:0/2434891142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff010159420 0x7ff0100b5f40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.922+0000 7ff015d9d700 1 -- 172.21.15.71:0/2434891142 >> 172.21.15.71:0/2434891142 conn(0x7ff0100d0660 msgr2=0x7ff0100d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.922+0000 7ff015d9d700 1 -- 172.21.15.71:0/2434891142 shutdown_connections 2023-10-09T06:57:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.922+0000 7ff015d9d700 1 -- 172.21.15.71:0/2434891142 wait complete. 2023-10-09T06:57:46.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.924+0000 7ff015d9d700 1 Processor -- start 2023-10-09T06:57:46.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.924+0000 7ff015d9d700 1 -- start start 2023-10-09T06:57:46.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.925+0000 7ff015d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff010159420 0x7ff0100c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:46.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.925+0000 7ff015d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0101597f0 0x7ff01015eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:46.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.925+0000 7ff015d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff01015d230 0x7ff0100c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:46.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.925+0000 7ff015d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01015f0e0 con 0x7ff0101597f0 2023-10-09T06:57:46.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.925+0000 7ff015d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0100c6f00 con 0x7ff01015d230 2023-10-09T06:57:46.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.925+0000 7ff015d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0100c71e0 con 0x7ff010159420 2023-10-09T06:57:46.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.925+0000 7ff00ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0101597f0 0x7ff01015eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:46.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.925+0000 7ff00ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0101597f0 0x7ff01015eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55760/0 (socket says 172.21.15.71:55760) 2023-10-09T06:57:46.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.925+0000 7ff00ffff700 1 -- 172.21.15.71:0/3326632265 learned_addr learned my addr 172.21.15.71:0/3326632265 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:46.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.925+0000 7ff014d9b700 1 --2- 172.21.15.71:0/3326632265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff010159420 0x7ff0100c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:46.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.925+0000 7ff01559c700 1 --2- 172.21.15.71:0/3326632265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff01015d230 0x7ff0100c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:46.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.925+0000 7ff00ffff700 1 -- 172.21.15.71:0/3326632265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff010159420 msgr2=0x7ff0100c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:46.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.925+0000 7ff00ffff700 1 --2- 172.21.15.71:0/3326632265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff010159420 0x7ff0100c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:46.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.925+0000 7ff00ffff700 1 -- 172.21.15.71:0/3326632265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff01015d230 msgr2=0x7ff0100c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:46.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.925+0000 7ff00ffff700 1 --2- 172.21.15.71:0/3326632265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff01015d230 0x7ff0100c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:46.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.925+0000 7ff00ffff700 1 -- 172.21.15.71:0/3326632265 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff004009420 con 0x7ff0101597f0 2023-10-09T06:57:46.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.926+0000 7ff00ffff700 1 --2- 172.21.15.71:0/3326632265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0101597f0 0x7ff01015eba0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7feffc0011e0 tx=0x7feffc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:46.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.926+0000 7ff00cff9700 1 -- 172.21.15.71:0/3326632265 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc005b30 con 0x7ff0101597f0 2023-10-09T06:57:46.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.926+0000 7ff00cff9700 1 -- 172.21.15.71:0/3326632265 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feffc005c90 con 0x7ff0101597f0 2023-10-09T06:57:46.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.926+0000 7ff015d9d700 1 -- 172.21.15.71:0/3326632265 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0100c74c0 con 0x7ff0101597f0 2023-10-09T06:57:46.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.926+0000 7ff00cff9700 1 -- 172.21.15.71:0/3326632265 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc007300 con 0x7ff0101597f0 2023-10-09T06:57:46.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.926+0000 7ff015d9d700 1 -- 172.21.15.71:0/3326632265 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0100c7a80 con 0x7ff0101597f0 2023-10-09T06:57:46.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.927+0000 7ff015d9d700 1 -- 172.21.15.71:0/3326632265 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01004c3c0 con 0x7ff0101597f0 2023-10-09T06:57:46.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.928+0000 7ff00cff9700 1 -- 172.21.15.71:0/3326632265 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 30) v1 ==== 84899+0+0 (secure 0 0 0) 0x7feffc007670 con 0x7ff0101597f0 2023-10-09T06:57:46.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.929+0000 7ff00cff9700 1 --2- 172.21.15.71:0/3326632265 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7feff4067110 0x7feff40695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:46.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.929+0000 7ff00cff9700 1 -- 172.21.15.71:0/3326632265 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6355+0+0 (secure 0 0 0) 0x7feffc083f50 con 0x7ff0101597f0 2023-10-09T06:57:46.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.929+0000 7ff014d9b700 1 -- 172.21.15.71:0/3326632265 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7feff4067110 msgr2=0x7feff40695c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:46.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.929+0000 7ff014d9b700 1 --2- 172.21.15.71:0/3326632265 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7feff4067110 0x7feff40695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:46.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:46.937+0000 7ff00cff9700 1 -- 172.21.15.71:0/3326632265 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feffc050c10 con 0x7ff0101597f0 2023-10-09T06:57:47.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.130+0000 7ff014d9b700 1 -- 172.21.15.71:0/3326632265 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7feff4067110 msgr2=0x7feff40695c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:47.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.130+0000 7ff014d9b700 1 --2- 172.21.15.71:0/3326632265 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7feff4067110 0x7feff40695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:47.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.135+0000 7ff015d9d700 1 -- 172.21.15.71:0/3326632265 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0100b1a70 con 0x7ff0101597f0 2023-10-09T06:57:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.136+0000 7ff00cff9700 1 -- 172.21.15.71:0/3326632265 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16316 (secure 0 0 0) 0x7feffc017020 con 0x7ff0101597f0 2023-10-09T06:57:47.137 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:47.137 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":80,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:57:43.880434+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:57:25.936431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T06:57:27.258713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6833/85452":"2023-10-10T06:57:43.880403+0000","172.21.15.179:6832/85452":"2023-10-10T06:57:43.880403+0000","172.21.15.179:0/1471741869":"2023-10-10T06:57:43.880403+0000","172.21.15.179:0/988360271":"2023-10-10T06:57:43.880403+0000","172.21.15.179:0/1762902065":"2023-10-10T06:57:43.880403+0000","172.21.15.179:0/3858828816":"2023-10-10T06:57:43.880403+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:57:47.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.139+0000 7ff015d9d700 1 -- 172.21.15.71:0/3326632265 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7feff4067110 msgr2=0x7feff40695c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:47.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.139+0000 7ff015d9d700 1 --2- 172.21.15.71:0/3326632265 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7feff4067110 0x7feff40695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.139+0000 7ff015d9d700 1 -- 172.21.15.71:0/3326632265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0101597f0 msgr2=0x7ff01015eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:47.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.139+0000 7ff015d9d700 1 --2- 172.21.15.71:0/3326632265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0101597f0 0x7ff01015eba0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7feffc0011e0 tx=0x7feffc007df0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.139+0000 7ff015d9d700 1 -- 172.21.15.71:0/3326632265 shutdown_connections 2023-10-09T06:57:47.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.139+0000 7ff015d9d700 1 --2- 172.21.15.71:0/3326632265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff01015d230 0x7ff0100c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.139+0000 7ff015d9d700 1 --2- 172.21.15.71:0/3326632265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff010159420 0x7ff0100c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.139+0000 7ff015d9d700 1 --2- 172.21.15.71:0/3326632265 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7feff4067110 0x7feff40695c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.139+0000 7ff015d9d700 1 --2- 172.21.15.71:0/3326632265 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0101597f0 0x7ff01015eba0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.139+0000 7ff015d9d700 1 -- 172.21.15.71:0/3326632265 >> 172.21.15.71:0/3326632265 conn(0x7ff0100d0660 msgr2=0x7ff0100d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:47.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.139+0000 7ff015d9d700 1 -- 172.21.15.71:0/3326632265 shutdown_connections 2023-10-09T06:57:47.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.139+0000 7ff015d9d700 1 -- 172.21.15.71:0/3326632265 wait complete. 2023-10-09T06:57:47.158 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:57:25.936431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:57:27.258713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:57:47.159 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:57:47.197 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:47.197+0000 7ff21f9fe180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T06:57:47.226 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:47.225+0000 7f91f7741180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T06:57:47.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.348+0000 7fe84099d700 1 Processor -- start 2023-10-09T06:57:47.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.348+0000 7fe84099d700 1 -- start start 2023-10-09T06:57:47.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.350+0000 7fe84099d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe83c0b4e70 0x7fe83c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:47.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.350+0000 7fe84099d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe83c0b16d0 0x7fe83c0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:47.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.350+0000 7fe84099d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe83c0b2080 con 0x7fe83c15d240 2023-10-09T06:57:47.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.350+0000 7fe84099d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe83c0cfb00 con 0x7fe83c0b4e70 2023-10-09T06:57:47.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.350+0000 7fe84099d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c0b5c40 con 0x7fe83c0b16d0 2023-10-09T06:57:47.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.350+0000 7fe83bfff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe83c15d240 0x7fe83c15d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46042/0 (socket says 172.21.15.71:46042) 2023-10-09T06:57:47.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.350+0000 7fe83bfff700 1 -- 172.21.15.71:0/2583055464 learned_addr learned my addr 172.21.15.71:0/2583055464 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:47.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.351+0000 7fe83affd700 1 --2- 172.21.15.71:0/2583055464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe83c0b16d0 0x7fe83c0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:47.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.351+0000 7fe83b7fe700 1 --2- 172.21.15.71:0/2583055464 >> v2:172.21.15.179:3300/0 conn(0x7fe83c0b4e70 0x7fe83c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:47.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.351+0000 7fe83a7fc700 1 -- 172.21.15.71:0/2583055464 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 851361653 0 0) 0x7fe83c0b2080 con 0x7fe83c15d240 2023-10-09T06:57:47.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.351+0000 7fe83a7fc700 1 -- 172.21.15.71:0/2583055464 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe824003570 con 0x7fe83c15d240 2023-10-09T06:57:47.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.351+0000 7fe83affd700 1 -- 172.21.15.71:0/2583055464 >> v2:172.21.15.179:3300/0 conn(0x7fe83c0b4e70 msgr2=0x7fe83c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:47.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.351+0000 7fe83affd700 1 --2- 172.21.15.71:0/2583055464 >> v2:172.21.15.179:3300/0 conn(0x7fe83c0b4e70 0x7fe83c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.351+0000 7fe83affd700 1 -- 172.21.15.71:0/2583055464 >> v1:172.21.15.71:6789/0 conn(0x7fe83c15d240 legacy=0x7fe83c15d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:47.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.351+0000 7fe83affd700 1 -- 172.21.15.71:0/2583055464 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c0b5f20 con 0x7fe83c0b16d0 2023-10-09T06:57:47.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.351+0000 7fe83affd700 1 --2- 172.21.15.71:0/2583055464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe83c0b16d0 0x7fe83c0b1b40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe8300098e0 tx=0x7fe8300091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dad594788cc27bb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:47.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.352+0000 7fe83a7fc700 1 -- 172.21.15.71:0/2583055464 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe830011630 con 0x7fe83c0b16d0 2023-10-09T06:57:47.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.352+0000 7fe83a7fc700 1 -- 172.21.15.71:0/2583055464 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe830011790 con 0x7fe83c0b16d0 2023-10-09T06:57:47.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.352+0000 7fe83a7fc700 1 -- 172.21.15.71:0/2583055464 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe830011b30 con 0x7fe83c0b16d0 2023-10-09T06:57:47.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.352+0000 7fe84099d700 1 -- 172.21.15.71:0/2583055464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe83c0b16d0 msgr2=0x7fe83c0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:47.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.352+0000 7fe84099d700 1 --2- 172.21.15.71:0/2583055464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe83c0b16d0 0x7fe83c0b1b40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe8300098e0 tx=0x7fe8300091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.353+0000 7fe84099d700 1 -- 172.21.15.71:0/2583055464 shutdown_connections 2023-10-09T06:57:47.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.353+0000 7fe84099d700 1 --2- 172.21.15.71:0/2583055464 >> v2:172.21.15.179:3300/0 conn(0x7fe83c0b4e70 0x7fe83c0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.353+0000 7fe84099d700 1 --2- 172.21.15.71:0/2583055464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe83c0b16d0 0x7fe83c0b1b40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.353+0000 7fe84099d700 1 -- 172.21.15.71:0/2583055464 >> 172.21.15.71:0/2583055464 conn(0x7fe83c0d10c0 msgr2=0x7fe83c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:47.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.353+0000 7fe84099d700 1 -- 172.21.15.71:0/2583055464 shutdown_connections 2023-10-09T06:57:47.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.353+0000 7fe84099d700 1 -- 172.21.15.71:0/2583055464 wait complete. 2023-10-09T06:57:47.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.355+0000 7fe84099d700 1 Processor -- start 2023-10-09T06:57:47.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.355+0000 7fe84099d700 1 -- start start 2023-10-09T06:57:47.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.357+0000 7fe84099d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe83c0b16d0 0x7fe83c144780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:47.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.357+0000 7fe84099d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe83c0b4e70 0x7fe83c068390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:47.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.357+0000 7fe84099d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe83c15d240 0x7fe83c0688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:47.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.357+0000 7fe84099d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c148010 con 0x7fe83c0b16d0 2023-10-09T06:57:47.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.357+0000 7fe84099d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c145800 con 0x7fe83c15d240 2023-10-09T06:57:47.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.357+0000 7fe84099d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c0cc100 con 0x7fe83c0b4e70 2023-10-09T06:57:47.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.357+0000 7fe83b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe83c0b16d0 0x7fe83c144780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:47.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.357+0000 7fe83b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe83c0b16d0 0x7fe83c144780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55774/0 (socket says 172.21.15.71:55774) 2023-10-09T06:57:47.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.357+0000 7fe83b7fe700 1 -- 172.21.15.71:0/384287049 learned_addr learned my addr 172.21.15.71:0/384287049 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:47.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.357+0000 7fe83affd700 1 --2- 172.21.15.71:0/384287049 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe83c0b4e70 0x7fe83c068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:47.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.357+0000 7fe83b7fe700 1 -- 172.21.15.71:0/384287049 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe83c0b4e70 msgr2=0x7fe83c068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:47.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.357+0000 7fe83b7fe700 1 --2- 172.21.15.71:0/384287049 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe83c0b4e70 0x7fe83c068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.357+0000 7fe83b7fe700 1 -- 172.21.15.71:0/384287049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe83c15d240 msgr2=0x7fe83c0688d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:47.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.357+0000 7fe83b7fe700 1 --2- 172.21.15.71:0/384287049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe83c15d240 0x7fe83c0688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.357+0000 7fe83b7fe700 1 -- 172.21.15.71:0/384287049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe830009420 con 0x7fe83c0b16d0 2023-10-09T06:57:47.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.358+0000 7fe83b7fe700 1 --2- 172.21.15.71:0/384287049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe83c0b16d0 0x7fe83c144780 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00ec80 tx=0x7fe82c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:47.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.358+0000 7fe8237fe700 1 -- 172.21.15.71:0/384287049 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c00c850 con 0x7fe83c0b16d0 2023-10-09T06:57:47.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.358+0000 7fe8237fe700 1 -- 172.21.15.71:0/384287049 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c00c9b0 con 0x7fe83c0b16d0 2023-10-09T06:57:47.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.358+0000 7fe8237fe700 1 -- 172.21.15.71:0/384287049 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c00cd50 con 0x7fe83c0b16d0 2023-10-09T06:57:47.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.358+0000 7fe84099d700 1 -- 172.21.15.71:0/384287049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83c1451b0 con 0x7fe83c0b16d0 2023-10-09T06:57:47.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.358+0000 7fe84099d700 1 -- 172.21.15.71:0/384287049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83c144cc0 con 0x7fe83c0b16d0 2023-10-09T06:57:47.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.359+0000 7fe84099d700 1 -- 172.21.15.71:0/384287049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe83c145ae0 con 0x7fe83c0b16d0 2023-10-09T06:57:47.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.362+0000 7fe8237fe700 1 -- 172.21.15.71:0/384287049 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 30) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fe82c013680 con 0x7fe83c0b16d0 2023-10-09T06:57:47.363 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:47.363+0000 7ff21f9fe180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T06:57:47.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.362+0000 7fe8237fe700 1 --2- 172.21.15.71:0/384287049 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe8280670e0 0x7fe828069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:47.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.363+0000 7fe8237fe700 1 -- 172.21.15.71:0/384287049 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fe82c084da0 con 0x7fe83c0b16d0 2023-10-09T06:57:47.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.363+0000 7fe83affd700 1 -- 172.21.15.71:0/384287049 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe8280670e0 msgr2=0x7fe828069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:47.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.363+0000 7fe83affd700 1 --2- 172.21.15.71:0/384287049 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe8280670e0 0x7fe828069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:47.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.367+0000 7fe8237fe700 1 -- 172.21.15.71:0/384287049 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe82c051b00 con 0x7fe83c0b16d0 2023-10-09T06:57:47.402 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:47.401+0000 7f91f7741180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T06:57:47.449 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:47.449+0000 7ff21f9fe180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T06:57:47.490 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:47.489+0000 7f91f7741180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T06:57:47.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.564+0000 7fe83affd700 1 -- 172.21.15.71:0/384287049 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe8280670e0 msgr2=0x7fe828069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:47.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.564+0000 7fe83affd700 1 --2- 172.21.15.71:0/384287049 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe8280670e0 0x7fe828069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:47.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.565+0000 7fe84099d700 1 -- 172.21.15.71:0/384287049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe83c04bb80 con 0x7fe83c0b16d0 2023-10-09T06:57:47.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.566+0000 7fe8237fe700 1 -- 172.21.15.71:0/384287049 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe82c055120 con 0x7fe83c0b16d0 2023-10-09T06:57:47.566 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T06:57:47.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.568+0000 7fe84099d700 1 -- 172.21.15.71:0/384287049 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe8280670e0 msgr2=0x7fe828069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:47.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.568+0000 7fe84099d700 1 --2- 172.21.15.71:0/384287049 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe8280670e0 0x7fe828069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.568+0000 7fe84099d700 1 -- 172.21.15.71:0/384287049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe83c0b16d0 msgr2=0x7fe83c144780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:47.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.568+0000 7fe84099d700 1 --2- 172.21.15.71:0/384287049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe83c0b16d0 0x7fe83c144780 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00ec80 tx=0x7fe82c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.568+0000 7fe84099d700 1 -- 172.21.15.71:0/384287049 shutdown_connections 2023-10-09T06:57:47.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.568+0000 7fe84099d700 1 --2- 172.21.15.71:0/384287049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe83c15d240 0x7fe83c0688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.568+0000 7fe84099d700 1 --2- 172.21.15.71:0/384287049 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe8280670e0 0x7fe828069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.568+0000 7fe84099d700 1 --2- 172.21.15.71:0/384287049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe83c0b16d0 0x7fe83c144780 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.568+0000 7fe84099d700 1 --2- 172.21.15.71:0/384287049 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe83c0b4e70 0x7fe83c068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.568+0000 7fe84099d700 1 -- 172.21.15.71:0/384287049 >> 172.21.15.71:0/384287049 conn(0x7fe83c0d10c0 msgr2=0x7fe83c1591f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:47.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.568+0000 7fe84099d700 1 -- 172.21.15.71:0/384287049 shutdown_connections 2023-10-09T06:57:47.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.568+0000 7fe84099d700 1 -- 172.21.15.71:0/384287049 wait complete. 2023-10-09T06:57:47.587 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:57:47.676 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:47.676+0000 7ff21f9fe180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:57:47.724 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:47.723+0000 7f91f7741180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:57:47.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.775+0000 7f6a6359d700 1 Processor -- start 2023-10-09T06:57:47.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.775+0000 7f6a6359d700 1 -- start start 2023-10-09T06:57:47.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.776+0000 7f6a6359d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6a5c0b4e70 0x7f6a5c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:47.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.776+0000 7f6a6359d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5c0cfb00 con 0x7f6a5c0b16d0 2023-10-09T06:57:47.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.776+0000 7f6a6359d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5c15e060 con 0x7f6a5c0b1b40 2023-10-09T06:57:47.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.776+0000 7f6a6359d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5c0b5c40 con 0x7f6a5c0b4e70 2023-10-09T06:57:47.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.776+0000 7f6a61d9a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6a5c0b16d0 0x7f6a5c15d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46046/0 (socket says 172.21.15.71:46046) 2023-10-09T06:57:47.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.776+0000 7f6a61d9a700 1 -- 172.21.15.71:0/1281101418 learned_addr learned my addr 172.21.15.71:0/1281101418 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:47.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.777+0000 7f6a6259b700 1 --2- 172.21.15.71:0/1281101418 >> v2:172.21.15.179:3300/0 conn(0x7f6a5c0b4e70 0x7f6a5c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:47.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.777+0000 7f6a61599700 1 -- 172.21.15.71:0/1281101418 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374781758 0 0) 0x7f6a5c0cfb00 con 0x7f6a5c0b16d0 2023-10-09T06:57:47.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.777+0000 7f6a61599700 1 -- 172.21.15.71:0/1281101418 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a48003570 con 0x7f6a5c0b16d0 2023-10-09T06:57:47.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.777+0000 7f6a61599700 1 -- 172.21.15.71:0/1281101418 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927045803 0 0) 0x7f6a5c15e060 con 0x7f6a5c0b1b40 2023-10-09T06:57:47.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.777+0000 7f6a61599700 1 -- 172.21.15.71:0/1281101418 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a5c0cfb00 con 0x7f6a5c0b1b40 2023-10-09T06:57:47.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.777+0000 7f6a6259b700 1 -- 172.21.15.71:0/1281101418 >> v1:172.21.15.179:6789/0 conn(0x7f6a5c0b1b40 legacy=0x7f6a5c15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:47.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.777+0000 7f6a6259b700 1 -- 172.21.15.71:0/1281101418 >> v1:172.21.15.71:6789/0 conn(0x7f6a5c0b16d0 legacy=0x7f6a5c15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:47.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.777+0000 7f6a6259b700 1 -- 172.21.15.71:0/1281101418 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c0b5f20 con 0x7f6a5c0b4e70 2023-10-09T06:57:47.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.777+0000 7f6a6259b700 1 --2- 172.21.15.71:0/1281101418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a5c0b4e70 0x7f6a5c0ccff0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6a580098e0 tx=0x7f6a580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3aa49a16ae6f0f1a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:47.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.778+0000 7f6a61599700 1 -- 172.21.15.71:0/1281101418 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a58011630 con 0x7f6a5c0b4e70 2023-10-09T06:57:47.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.778+0000 7f6a61599700 1 -- 172.21.15.71:0/1281101418 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a58011790 con 0x7f6a5c0b4e70 2023-10-09T06:57:47.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.778+0000 7f6a61599700 1 -- 172.21.15.71:0/1281101418 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a58011b30 con 0x7f6a5c0b4e70 2023-10-09T06:57:47.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.778+0000 7f6a6359d700 1 -- 172.21.15.71:0/1281101418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a5c0b4e70 msgr2=0x7f6a5c0ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:47.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.778+0000 7f6a6359d700 1 --2- 172.21.15.71:0/1281101418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a5c0b4e70 0x7f6a5c0ccff0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6a580098e0 tx=0x7f6a580091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.778+0000 7f6a6359d700 1 -- 172.21.15.71:0/1281101418 shutdown_connections 2023-10-09T06:57:47.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.778+0000 7f6a6359d700 1 --2- 172.21.15.71:0/1281101418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a5c0b4e70 0x7f6a5c0ccff0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.778+0000 7f6a6359d700 1 -- 172.21.15.71:0/1281101418 >> 172.21.15.71:0/1281101418 conn(0x7f6a5c0d10c0 msgr2=0x7f6a5c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:47.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.778+0000 7f6a6359d700 1 -- 172.21.15.71:0/1281101418 shutdown_connections 2023-10-09T06:57:47.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.778+0000 7f6a6359d700 1 -- 172.21.15.71:0/1281101418 wait complete. 2023-10-09T06:57:47.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.780+0000 7f6a6359d700 1 Processor -- start 2023-10-09T06:57:47.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.780+0000 7f6a6359d700 1 -- start start 2023-10-09T06:57:47.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.781+0000 7f6a6359d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5c0b16d0 0x7f6a5c16aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:47.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.781+0000 7f6a6359d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a5c0b1b40 0x7f6a5c0ae820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:47.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.781+0000 7f6a6359d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a5c0b4e70 0x7f6a5c0ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.781+0000 7f6a6359d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c16afe0 con 0x7f6a5c0b1b40 2023-10-09T06:57:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.781+0000 7f6a6359d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c0c7ea0 con 0x7f6a5c0b4e70 2023-10-09T06:57:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.781+0000 7f6a6359d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c0aed60 con 0x7f6a5c0b16d0 2023-10-09T06:57:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.781+0000 7f6a61d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a5c0b1b40 0x7f6a5c0ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.781+0000 7f6a61d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a5c0b1b40 0x7f6a5c0ae820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55782/0 (socket says 172.21.15.71:55782) 2023-10-09T06:57:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.781+0000 7f6a61d9a700 1 -- 172.21.15.71:0/287611270 learned_addr learned my addr 172.21.15.71:0/287611270 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.781+0000 7f6a6259b700 1 --2- 172.21.15.71:0/287611270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5c0b16d0 0x7f6a5c16aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.781+0000 7f6a62d9c700 1 --2- 172.21.15.71:0/287611270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a5c0b4e70 0x7f6a5c0ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.782+0000 7f6a6259b700 1 -- 172.21.15.71:0/287611270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a5c0b4e70 msgr2=0x7f6a5c0ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.782+0000 7f6a6259b700 1 --2- 172.21.15.71:0/287611270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a5c0b4e70 0x7f6a5c0ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.782+0000 7f6a6259b700 1 -- 172.21.15.71:0/287611270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a5c0b1b40 msgr2=0x7f6a5c0ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:47.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.782+0000 7f6a6259b700 1 --2- 172.21.15.71:0/287611270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a5c0b1b40 0x7f6a5c0ae820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.782+0000 7f6a6259b700 1 -- 172.21.15.71:0/287611270 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a58009420 con 0x7f6a5c0b16d0 2023-10-09T06:57:47.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.782+0000 7f6a61d9a700 1 --2- 172.21.15.71:0/287611270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a5c0b1b40 0x7f6a5c0ae820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:57:47.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.782+0000 7f6a6259b700 1 --2- 172.21.15.71:0/287611270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5c0b16d0 0x7f6a5c16aaa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6a58016000 tx=0x7f6a58017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:47.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.782+0000 7f6a527fc700 1 -- 172.21.15.71:0/287611270 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5801f070 con 0x7f6a5c0b16d0 2023-10-09T06:57:47.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.782+0000 7f6a527fc700 1 -- 172.21.15.71:0/287611270 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a58000bc0 con 0x7f6a5c0b16d0 2023-10-09T06:57:47.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.782+0000 7f6a6359d700 1 -- 172.21.15.71:0/287611270 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5c0c8a30 con 0x7f6a5c0b16d0 2023-10-09T06:57:47.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.782+0000 7f6a527fc700 1 -- 172.21.15.71:0/287611270 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a58025420 con 0x7f6a5c0b16d0 2023-10-09T06:57:47.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.783+0000 7f6a6359d700 1 -- 172.21.15.71:0/287611270 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5c0c8ff0 con 0x7f6a5c0b16d0 2023-10-09T06:57:47.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.783+0000 7f6a6359d700 1 -- 172.21.15.71:0/287611270 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5c0c5390 con 0x7f6a5c0b16d0 2023-10-09T06:57:47.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.785+0000 7f6a527fc700 1 -- 172.21.15.71:0/287611270 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 30) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f6a58023070 con 0x7f6a5c0b16d0 2023-10-09T06:57:47.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.786+0000 7f6a527fc700 1 --2- 172.21.15.71:0/287611270 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6a400670e0 0x7f6a40069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:47.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.786+0000 7f6a527fc700 1 -- 172.21.15.71:0/287611270 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f6a58085890 con 0x7f6a5c0b16d0 2023-10-09T06:57:47.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.786+0000 7f6a61d9a700 1 -- 172.21.15.71:0/287611270 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6a400670e0 msgr2=0x7f6a40069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:47.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.786+0000 7f6a61d9a700 1 --2- 172.21.15.71:0/287611270 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6a400670e0 0x7f6a40069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:47.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.791+0000 7f6a527fc700 1 -- 172.21.15.71:0/287611270 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a5c0c5390 con 0x7f6a5c0b16d0 2023-10-09T06:57:47.857 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:47.857+0000 7ff21f9fe180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T06:57:47.911 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:47.910+0000 7f91f7741180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T06:57:47.951 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:47.950+0000 7ff21f9fe180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T06:57:47.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.987+0000 7f6a61d9a700 1 -- 172.21.15.71:0/287611270 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6a400670e0 msgr2=0x7f6a40069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:47.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.987+0000 7f6a61d9a700 1 --2- 172.21.15.71:0/287611270 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6a400670e0 0x7f6a40069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:47.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.993+0000 7f6a6359d700 1 -- 172.21.15.71:0/287611270 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6a5c0c5390 con 0x7f6a5c0b16d0 2023-10-09T06:57:47.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.993+0000 7f6a527fc700 1 -- 172.21.15.71:0/287611270 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6a58015020 con 0x7f6a5c0b16d0 2023-10-09T06:57:47.994 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-09T06:57:47.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.996+0000 7f6a6359d700 1 -- 172.21.15.71:0/287611270 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6a400670e0 msgr2=0x7f6a40069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:47.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.996+0000 7f6a6359d700 1 --2- 172.21.15.71:0/287611270 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6a400670e0 0x7f6a40069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.996+0000 7f6a6359d700 1 -- 172.21.15.71:0/287611270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5c0b16d0 msgr2=0x7f6a5c16aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.996+0000 7f6a6359d700 1 --2- 172.21.15.71:0/287611270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5c0b16d0 0x7f6a5c16aaa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6a58016000 tx=0x7f6a58017000 comp rx=0 tx=0).stop 2023-10-09T06:57:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.996+0000 7f6a6359d700 1 -- 172.21.15.71:0/287611270 shutdown_connections 2023-10-09T06:57:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.996+0000 7f6a6359d700 1 --2- 172.21.15.71:0/287611270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a5c0b4e70 0x7f6a5c0ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.996+0000 7f6a6359d700 1 --2- 172.21.15.71:0/287611270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5c0b16d0 0x7f6a5c16aaa0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.996+0000 7f6a6359d700 1 --2- 172.21.15.71:0/287611270 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6a400670e0 0x7f6a40069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.996+0000 7f6a6359d700 1 --2- 172.21.15.71:0/287611270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a5c0b1b40 0x7f6a5c0ae820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.996+0000 7f6a6359d700 1 -- 172.21.15.71:0/287611270 >> 172.21.15.71:0/287611270 conn(0x7f6a5c0d10c0 msgr2=0x7f6a5c0af190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.996+0000 7f6a6359d700 1 -- 172.21.15.71:0/287611270 shutdown_connections 2023-10-09T06:57:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:47.996+0000 7f6a6359d700 1 -- 172.21.15.71:0/287611270 wait complete. 2023-10-09T06:57:48.006 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:48.005+0000 7f91f7741180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T06:57:48.015 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:57:48.114 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:48.114+0000 7ff21f9fe180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T06:57:48.175 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:48.174+0000 7f91f7741180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T06:57:48.329 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:48.216+0000 7ff21f9fe180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T06:57:48.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.204+0000 7f4827fff700 1 Processor -- start 2023-10-09T06:57:48.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.204+0000 7f4827fff700 1 -- start start 2023-10-09T06:57:48.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.206+0000 7f4827fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f48280b16d0 0x7f48280b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:48.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.206+0000 7f4827fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f48280b33b0 0x7f48280b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:48.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.206+0000 7f4827fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48280b2080 con 0x7f48280b4e70 2023-10-09T06:57:48.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.206+0000 7f4827fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48280cfb00 con 0x7f48280b16d0 2023-10-09T06:57:48.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.206+0000 7f4827fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48280b5c40 con 0x7f48280b33b0 2023-10-09T06:57:48.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.206+0000 7f48267fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f48280b16d0 0x7f48280b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:48.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.206+0000 7f48277fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f48280b33b0 0x7f48280b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:48.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.206+0000 7f48267fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f48280b16d0 0x7f48280b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55788/0 (socket says 172.21.15.71:55788) 2023-10-09T06:57:48.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.206+0000 7f48267fc700 1 -- 172.21.15.71:0/674815195 learned_addr learned my addr 172.21.15.71:0/674815195 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:48.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.206+0000 7f4826ffd700 1 --1- 172.21.15.71:0/674815195 >> v1:172.21.15.179:6789/0 conn(0x7f48280b4e70 0x7f48280ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:45690/0 (socket says 172.21.15.71:45690) 2023-10-09T06:57:48.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.207+0000 7f4825ffb700 1 -- 172.21.15.71:0/674815195 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441734289 0 0) 0x7f48280b2080 con 0x7f48280b4e70 2023-10-09T06:57:48.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.207+0000 7f4825ffb700 1 -- 172.21.15.71:0/674815195 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4810003570 con 0x7f48280b4e70 2023-10-09T06:57:48.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.207+0000 7f48267fc700 1 -- 172.21.15.71:0/674815195 >> v2:172.21.15.179:3300/0 conn(0x7f48280b33b0 msgr2=0x7f48280b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:48.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.207+0000 7f48267fc700 1 --2- 172.21.15.71:0/674815195 >> v2:172.21.15.179:3300/0 conn(0x7f48280b33b0 0x7f48280b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:48.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.207+0000 7f48267fc700 1 -- 172.21.15.71:0/674815195 >> v1:172.21.15.179:6789/0 conn(0x7f48280b4e70 legacy=0x7f48280ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:48.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.207+0000 7f48267fc700 1 -- 172.21.15.71:0/674815195 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48280b5f20 con 0x7f48280b16d0 2023-10-09T06:57:48.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.207+0000 7f48277fe700 1 --2- 172.21.15.71:0/674815195 >> v2:172.21.15.179:3300/0 conn(0x7f48280b33b0 0x7f48280b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:57:48.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.207+0000 7f48267fc700 1 --2- 172.21.15.71:0/674815195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48280b16d0 0x7f48280b1b40 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4828071380 tx=0x7f481c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e56e455dbf62a300 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:48.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.207+0000 7f4825ffb700 1 -- 172.21.15.71:0/674815195 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c00b640 con 0x7f48280b16d0 2023-10-09T06:57:48.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.207+0000 7f4825ffb700 1 -- 172.21.15.71:0/674815195 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481c00b7a0 con 0x7f48280b16d0 2023-10-09T06:57:48.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.207+0000 7f4825ffb700 1 -- 172.21.15.71:0/674815195 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c00bb20 con 0x7f48280b16d0 2023-10-09T06:57:48.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.208+0000 7f4827fff700 1 -- 172.21.15.71:0/674815195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48280b16d0 msgr2=0x7f48280b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:48.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.208+0000 7f4827fff700 1 --2- 172.21.15.71:0/674815195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48280b16d0 0x7f48280b1b40 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4828071380 tx=0x7f481c009250 comp rx=0 tx=0).stop 2023-10-09T06:57:48.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.208+0000 7f4827fff700 1 -- 172.21.15.71:0/674815195 shutdown_connections 2023-10-09T06:57:48.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.208+0000 7f4827fff700 1 --2- 172.21.15.71:0/674815195 >> v2:172.21.15.179:3300/0 conn(0x7f48280b33b0 0x7f48280b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:48.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.208+0000 7f4827fff700 1 --2- 172.21.15.71:0/674815195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48280b16d0 0x7f48280b1b40 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:48.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.208+0000 7f4827fff700 1 -- 172.21.15.71:0/674815195 >> 172.21.15.71:0/674815195 conn(0x7f48280d10c0 msgr2=0x7f48280affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:48.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.208+0000 7f4827fff700 1 -- 172.21.15.71:0/674815195 shutdown_connections 2023-10-09T06:57:48.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.208+0000 7f4827fff700 1 -- 172.21.15.71:0/674815195 wait complete. 2023-10-09T06:57:48.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.209+0000 7f4827fff700 1 Processor -- start 2023-10-09T06:57:48.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.210+0000 7f4827fff700 1 -- start start 2023-10-09T06:57:48.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.210+0000 7f4827fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48280b16d0 0x7f48280c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:48.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.211+0000 7f4827fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48280b33b0 0x7f48280c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:48.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.211+0000 7f4827fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48280b4e70 0x7f48280c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:48.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.211+0000 7f4827fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48280c8fe0 con 0x7f48280b4e70 2023-10-09T06:57:48.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.211+0000 7f4827fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48280c7420 con 0x7f48280b16d0 2023-10-09T06:57:48.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.211+0000 7f4827fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48280c7700 con 0x7f48280b33b0 2023-10-09T06:57:48.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.211+0000 7f48277fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48280b4e70 0x7f48280c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:48.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.211+0000 7f48277fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48280b4e70 0x7f48280c6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55794/0 (socket says 172.21.15.71:55794) 2023-10-09T06:57:48.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.211+0000 7f48277fe700 1 -- 172.21.15.71:0/2757424749 learned_addr learned my addr 172.21.15.71:0/2757424749 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:48.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.211+0000 7f4826ffd700 1 --2- 172.21.15.71:0/2757424749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48280b16d0 0x7f48280c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:48.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.211+0000 7f48267fc700 1 --2- 172.21.15.71:0/2757424749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48280b33b0 0x7f48280c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:48.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.211+0000 7f48277fe700 1 -- 172.21.15.71:0/2757424749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48280b33b0 msgr2=0x7f48280c68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:48.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.211+0000 7f48277fe700 1 --2- 172.21.15.71:0/2757424749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48280b33b0 0x7f48280c68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:48.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.211+0000 7f48277fe700 1 -- 172.21.15.71:0/2757424749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48280b16d0 msgr2=0x7f48280c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:48.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.211+0000 7f48277fe700 1 --2- 172.21.15.71:0/2757424749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48280b16d0 0x7f48280c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:48.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.211+0000 7f48277fe700 1 -- 172.21.15.71:0/2757424749 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4820009a20 con 0x7f48280b4e70 2023-10-09T06:57:48.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.211+0000 7f48277fe700 1 --2- 172.21.15.71:0/2757424749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48280b4e70 0x7f48280c6df0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4820009fc0 tx=0x7f482000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:48.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.212+0000 7f480effd700 1 -- 172.21.15.71:0/2757424749 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482000cc80 con 0x7f48280b4e70 2023-10-09T06:57:48.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.212+0000 7f480effd700 1 -- 172.21.15.71:0/2757424749 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482000f040 con 0x7f48280b4e70 2023-10-09T06:57:48.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.212+0000 7f480effd700 1 -- 172.21.15.71:0/2757424749 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4820014480 con 0x7f48280b4e70 2023-10-09T06:57:48.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.212+0000 7f4827fff700 1 -- 172.21.15.71:0/2757424749 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f481c0094f0 con 0x7f48280b4e70 2023-10-09T06:57:48.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.212+0000 7f4827fff700 1 -- 172.21.15.71:0/2757424749 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48280c7cc0 con 0x7f48280b4e70 2023-10-09T06:57:48.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.213+0000 7f4827fff700 1 -- 172.21.15.71:0/2757424749 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4828088990 con 0x7f48280b4e70 2023-10-09T06:57:48.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.214+0000 7f480effd700 1 -- 172.21.15.71:0/2757424749 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 30) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f4820003020 con 0x7f48280b4e70 2023-10-09T06:57:48.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.215+0000 7f480effd700 1 --2- 172.21.15.71:0/2757424749 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f48140670e0 0x7f4814069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:48.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.215+0000 7f480effd700 1 -- 172.21.15.71:0/2757424749 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f4820085690 con 0x7f48280b4e70 2023-10-09T06:57:48.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.215+0000 7f4826ffd700 1 -- 172.21.15.71:0/2757424749 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f48140670e0 msgr2=0x7f4814069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:48.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.215+0000 7f4826ffd700 1 --2- 172.21.15.71:0/2757424749 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f48140670e0 0x7f4814069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:48.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.222+0000 7f480effd700 1 -- 172.21.15.71:0/2757424749 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4820052240 con 0x7f48280b4e70 2023-10-09T06:57:48.343 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:48.283+0000 7f91f7741180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T06:57:48.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.416+0000 7f4826ffd700 1 -- 172.21.15.71:0/2757424749 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f48140670e0 msgr2=0x7f4814069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:48.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.416+0000 7f4826ffd700 1 --2- 172.21.15.71:0/2757424749 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f48140670e0 0x7f4814069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:48.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.423+0000 7f4827fff700 1 -- 172.21.15.71:0/2757424749 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4828069ce0 con 0x7f48280b4e70 2023-10-09T06:57:48.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.423+0000 7f480effd700 1 -- 172.21.15.71:0/2757424749 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4820055860 con 0x7f48280b4e70 2023-10-09T06:57:48.424 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-09T06:57:48.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.426+0000 7f4827fff700 1 -- 172.21.15.71:0/2757424749 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f48140670e0 msgr2=0x7f4814069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:48.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.426+0000 7f4827fff700 1 --2- 172.21.15.71:0/2757424749 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f48140670e0 0x7f4814069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:48.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.426+0000 7f4827fff700 1 -- 172.21.15.71:0/2757424749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48280b4e70 msgr2=0x7f48280c6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:48.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.426+0000 7f4827fff700 1 --2- 172.21.15.71:0/2757424749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48280b4e70 0x7f48280c6df0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4820009fc0 tx=0x7f482000b040 comp rx=0 tx=0).stop 2023-10-09T06:57:48.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.426+0000 7f4827fff700 1 -- 172.21.15.71:0/2757424749 shutdown_connections 2023-10-09T06:57:48.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.426+0000 7f4827fff700 1 --2- 172.21.15.71:0/2757424749 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f48140670e0 0x7f4814069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:48.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.426+0000 7f4827fff700 1 --2- 172.21.15.71:0/2757424749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48280b4e70 0x7f48280c6df0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:48.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.426+0000 7f4827fff700 1 --2- 172.21.15.71:0/2757424749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48280b16d0 0x7f48280c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:48.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.426+0000 7f4827fff700 1 --2- 172.21.15.71:0/2757424749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48280b33b0 0x7f48280c68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:48.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.426+0000 7f4827fff700 1 -- 172.21.15.71:0/2757424749 >> 172.21.15.71:0/2757424749 conn(0x7f48280d10c0 msgr2=0x7f48280ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:48.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.426+0000 7f4827fff700 1 -- 172.21.15.71:0/2757424749 shutdown_connections 2023-10-09T06:57:48.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.426+0000 7f4827fff700 1 -- 172.21.15.71:0/2757424749 wait complete. 2023-10-09T06:57:48.445 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:57:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.637+0000 7f9be759d700 1 Processor -- start 2023-10-09T06:57:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.637+0000 7f9be759d700 1 -- start start 2023-10-09T06:57:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.638+0000 7f9be759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9be0156310 0x7f9be00c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.638+0000 7f9be759d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9be00ae710 0x7f9be00c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.638+0000 7f9be759d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be00ca860 con 0x7f9be01566e0 2023-10-09T06:57:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.638+0000 7f9be759d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be00cab40 con 0x7f9be00ae710 2023-10-09T06:57:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.638+0000 7f9be759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be00cae20 con 0x7f9be0156310 2023-10-09T06:57:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.639+0000 7f9be6d9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9be00ae710 0x7f9be00c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.639+0000 7f9be6d9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9be00ae710 0x7f9be00c6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55810/0 (socket says 172.21.15.71:55810) 2023-10-09T06:57:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.639+0000 7f9be6d9c700 1 -- 172.21.15.71:0/3359748300 learned_addr learned my addr 172.21.15.71:0/3359748300 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.639+0000 7f9be659b700 1 --2- 172.21.15.71:0/3359748300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9be0156310 0x7f9be00c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.639+0000 7f9be5d9a700 1 --1- 172.21.15.71:0/3359748300 >> v1:172.21.15.71:6789/0 conn(0x7f9be01566e0 0x7f9be00ae000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46052/0 (socket says 172.21.15.71:46052) 2023-10-09T06:57:48.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.639+0000 7f9be6d9c700 1 -- 172.21.15.71:0/3359748300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9be0156310 msgr2=0x7f9be00c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:48.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.639+0000 7f9be6d9c700 1 --2- 172.21.15.71:0/3359748300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9be0156310 0x7f9be00c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.639+0000 7f9be6d9c700 1 -- 172.21.15.71:0/3359748300 >> v1:172.21.15.71:6789/0 conn(0x7f9be01566e0 legacy=0x7f9be00ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.639+0000 7f9be6d9c700 1 -- 172.21.15.71:0/3359748300 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be00cb100 con 0x7f9be00ae710 2023-10-09T06:57:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.639+0000 7f9be6d9c700 1 --2- 172.21.15.71:0/3359748300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9be00ae710 0x7f9be00c6830 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8009f20 tx=0x7f9bd8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24140aaeaf7fd0f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.639+0000 7f9be5599700 1 -- 172.21.15.71:0/3359748300 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd800e070 con 0x7f9be00ae710 2023-10-09T06:57:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.640+0000 7f9be5599700 1 -- 172.21.15.71:0/3359748300 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd800b9d0 con 0x7f9be00ae710 2023-10-09T06:57:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.640+0000 7f9be5599700 1 -- 172.21.15.71:0/3359748300 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd80092e0 con 0x7f9be00ae710 2023-10-09T06:57:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.640+0000 7f9be759d700 1 -- 172.21.15.71:0/3359748300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9be00ae710 msgr2=0x7f9be00c6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.640+0000 7f9be759d700 1 --2- 172.21.15.71:0/3359748300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9be00ae710 0x7f9be00c6830 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8009f20 tx=0x7f9bd8009840 comp rx=0 tx=0).stop 2023-10-09T06:57:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.640+0000 7f9be759d700 1 -- 172.21.15.71:0/3359748300 shutdown_connections 2023-10-09T06:57:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.640+0000 7f9be759d700 1 --2- 172.21.15.71:0/3359748300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9be00ae710 0x7f9be00c6830 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.640+0000 7f9be759d700 1 --2- 172.21.15.71:0/3359748300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9be0156310 0x7f9be00c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.640+0000 7f9be759d700 1 -- 172.21.15.71:0/3359748300 >> 172.21.15.71:0/3359748300 conn(0x7f9be00cc1f0 msgr2=0x7f9be00cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.640+0000 7f9be759d700 1 -- 172.21.15.71:0/3359748300 shutdown_connections 2023-10-09T06:57:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.640+0000 7f9be759d700 1 -- 172.21.15.71:0/3359748300 wait complete. 2023-10-09T06:57:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.642+0000 7f9be759d700 1 Processor -- start 2023-10-09T06:57:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.642+0000 7f9be759d700 1 -- start start 2023-10-09T06:57:48.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.643+0000 7f9be759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9be00ae710 0x7f9be015be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:48.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.643+0000 7f9be759d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9be0156310 0x7f9be0141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:48.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.643+0000 7f9be759d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9be01566e0 0x7f9be006a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:48.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.643+0000 7f9be759d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be015ce40 con 0x7f9be0156310 2023-10-09T06:57:48.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.643+0000 7f9be759d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be015d120 con 0x7f9be01566e0 2023-10-09T06:57:48.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.643+0000 7f9be759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be015d400 con 0x7f9be00ae710 2023-10-09T06:57:48.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.643+0000 7f9be5d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9be0156310 0x7f9be0141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:48.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.643+0000 7f9be5d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9be0156310 0x7f9be0141ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55824/0 (socket says 172.21.15.71:55824) 2023-10-09T06:57:48.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.643+0000 7f9be5d9a700 1 -- 172.21.15.71:0/3588171540 learned_addr learned my addr 172.21.15.71:0/3588171540 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:48.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.643+0000 7f9be6d9c700 1 --2- 172.21.15.71:0/3588171540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9be01566e0 0x7f9be006a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:48.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.643+0000 7f9be659b700 1 --2- 172.21.15.71:0/3588171540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9be00ae710 0x7f9be015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:48.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.643+0000 7f9be5d9a700 1 -- 172.21.15.71:0/3588171540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9be00ae710 msgr2=0x7f9be015be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:48.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.643+0000 7f9be5d9a700 1 --2- 172.21.15.71:0/3588171540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9be00ae710 0x7f9be015be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:48.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.643+0000 7f9be5d9a700 1 -- 172.21.15.71:0/3588171540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9be01566e0 msgr2=0x7f9be006a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:48.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.643+0000 7f9be5d9a700 1 --2- 172.21.15.71:0/3588171540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9be01566e0 0x7f9be006a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:48.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.643+0000 7f9be5d9a700 1 -- 172.21.15.71:0/3588171540 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd8009ae0 con 0x7f9be0156310 2023-10-09T06:57:48.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.644+0000 7f9be5d9a700 1 --2- 172.21.15.71:0/3588171540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9be0156310 0x7f9be0141ad0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0001eb0 tx=0x7f9bd0007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:48.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.644+0000 7f9bd67fc700 1 -- 172.21.15.71:0/3588171540 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0005a70 con 0x7f9be0156310 2023-10-09T06:57:48.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.644+0000 7f9bd67fc700 1 -- 172.21.15.71:0/3588171540 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd0005bd0 con 0x7f9be0156310 2023-10-09T06:57:48.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.644+0000 7f9bd67fc700 1 -- 172.21.15.71:0/3588171540 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd00070d0 con 0x7f9be0156310 2023-10-09T06:57:48.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.644+0000 7f9be759d700 1 -- 172.21.15.71:0/3588171540 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be015ee10 con 0x7f9be0156310 2023-10-09T06:57:48.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.644+0000 7f9be759d700 1 -- 172.21.15.71:0/3588171540 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be015c380 con 0x7f9be0156310 2023-10-09T06:57:48.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.645+0000 7f9be759d700 1 -- 172.21.15.71:0/3588171540 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be015f050 con 0x7f9be0156310 2023-10-09T06:57:48.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.646+0000 7f9bd67fc700 1 -- 172.21.15.71:0/3588171540 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 30) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f9bd0007480 con 0x7f9be0156310 2023-10-09T06:57:48.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.647+0000 7f9bd67fc700 1 --2- 172.21.15.71:0/3588171540 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9bc4067110 0x7f9bc40695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:48.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.647+0000 7f9bd67fc700 1 -- 172.21.15.71:0/3588171540 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f9bd0083ec0 con 0x7f9be0156310 2023-10-09T06:57:48.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.647+0000 7f9be659b700 1 -- 172.21.15.71:0/3588171540 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9bc4067110 msgr2=0x7f9bc40695c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:48.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.647+0000 7f9be659b700 1 --2- 172.21.15.71:0/3588171540 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9bc4067110 0x7f9bc40695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:48.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.654+0000 7f9bd67fc700 1 -- 172.21.15.71:0/3588171540 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9be015f050 con 0x7f9be0156310 2023-10-09T06:57:48.703 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:48.703+0000 7ff21f9fe180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T06:57:48.795 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:48.794+0000 7f91f7741180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T06:57:48.798 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:48.798+0000 7ff21f9fe180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T06:57:48.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.848+0000 7f9be659b700 1 -- 172.21.15.71:0/3588171540 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9bc4067110 msgr2=0x7f9bc40695c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:48.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.848+0000 7f9be659b700 1 --2- 172.21.15.71:0/3588171540 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9bc4067110 0x7f9bc40695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:48.889 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:48.889+0000 7ff21f9fe180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T06:57:48.893 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:48.892+0000 7f91f7741180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T06:57:48.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.899+0000 7f9be759d700 1 -- 172.21.15.71:0/3588171540 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9be015f000 con 0x7f9be0156310 2023-10-09T06:57:48.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.900+0000 7f9bd67fc700 1 -- 172.21.15.71:0/3588171540 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f9bd0017020 con 0x7f9be0156310 2023-10-09T06:57:48.901 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:48.901 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6055,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3774833170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3774833170},{"type":"v1","addr":"172.21.15.179:6836","nonce":3774833170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6058,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3203736717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3203736717},{"type":"v1","addr":"172.21.15.179:6837","nonce":3203736717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2747804060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2747804060},{"type":"v1","addr":"172.21.15.71:6833","nonce":2747804060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:57:28.273000+0000","modified":"2023-10-09T06:57:31.823203+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6240},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6240":{"gid":6240,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/3993456703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3993456703},{"type":"v1","addr":"172.21.15.71:6835","nonce":3993456703}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T06:57:48.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.902+0000 7f9be759d700 1 -- 172.21.15.71:0/3588171540 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9bc4067110 msgr2=0x7f9bc40695c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:48.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.902+0000 7f9be759d700 1 --2- 172.21.15.71:0/3588171540 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9bc4067110 0x7f9bc40695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:48.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.902+0000 7f9be759d700 1 -- 172.21.15.71:0/3588171540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9be0156310 msgr2=0x7f9be0141ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:48.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.902+0000 7f9be759d700 1 --2- 172.21.15.71:0/3588171540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9be0156310 0x7f9be0141ad0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0001eb0 tx=0x7f9bd0007f40 comp rx=0 tx=0).stop 2023-10-09T06:57:48.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.902+0000 7f9be759d700 1 -- 172.21.15.71:0/3588171540 shutdown_connections 2023-10-09T06:57:48.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.902+0000 7f9be759d700 1 --2- 172.21.15.71:0/3588171540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9be01566e0 0x7f9be006a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:48.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.902+0000 7f9be759d700 1 --2- 172.21.15.71:0/3588171540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9be00ae710 0x7f9be015be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:48.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.902+0000 7f9be759d700 1 --2- 172.21.15.71:0/3588171540 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9bc4067110 0x7f9bc40695c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:48.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.902+0000 7f9be759d700 1 --2- 172.21.15.71:0/3588171540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9be0156310 0x7f9be0141ad0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:48.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.902+0000 7f9be759d700 1 -- 172.21.15.71:0/3588171540 >> 172.21.15.71:0/3588171540 conn(0x7f9be00cc1f0 msgr2=0x7f9be00adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:48.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.902+0000 7f9be759d700 1 -- 172.21.15.71:0/3588171540 shutdown_connections 2023-10-09T06:57:48.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:48.902+0000 7f9be759d700 1 -- 172.21.15.71:0/3588171540 wait complete. 2023-10-09T06:57:48.905 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 33 2023-10-09T06:57:48.921 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:57:48.992 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:48.991+0000 7f91f7741180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T06:57:49.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.107+0000 7fca9f59e700 1 Processor -- start 2023-10-09T06:57:49.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.107+0000 7fca9f59e700 1 -- start start 2023-10-09T06:57:49.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.108+0000 7fca9f59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcaa0159420 0x7fcaa00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:49.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.108+0000 7fca9f59e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcaa015d230 0x7fcaa015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:49.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.108+0000 7fca9f59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa00b2980 con 0x7fcaa01597f0 2023-10-09T06:57:49.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.108+0000 7fca9f59e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa015db70 con 0x7fcaa015d230 2023-10-09T06:57:49.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.108+0000 7fca9f59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa00b11d0 con 0x7fcaa0159420 2023-10-09T06:57:49.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.108+0000 7fca9ed9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcaa015d230 0x7fcaa015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:49.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.108+0000 7fca9ed9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcaa015d230 0x7fcaa015d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55832/0 (socket says 172.21.15.71:55832) 2023-10-09T06:57:49.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.108+0000 7fca9ed9d700 1 -- 172.21.15.71:0/289326029 learned_addr learned my addr 172.21.15.71:0/289326029 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:49.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.108+0000 7fca9e59c700 1 --2- 172.21.15.71:0/289326029 >> v2:172.21.15.179:3300/0 conn(0x7fcaa0159420 0x7fcaa00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:49.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.109+0000 7fca9ed9d700 1 -- 172.21.15.71:0/289326029 >> v2:172.21.15.179:3300/0 conn(0x7fcaa0159420 msgr2=0x7fcaa00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:49.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.109+0000 7fca9ed9d700 1 --2- 172.21.15.71:0/289326029 >> v2:172.21.15.179:3300/0 conn(0x7fcaa0159420 0x7fcaa00b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:49.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.109+0000 7fca9ed9d700 1 -- 172.21.15.71:0/289326029 >> v1:172.21.15.179:6789/0 conn(0x7fcaa01597f0 legacy=0x7fcaa00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:49.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.109+0000 7fca9ed9d700 1 -- 172.21.15.71:0/289326029 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa00b14b0 con 0x7fcaa015d230 2023-10-09T06:57:49.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.109+0000 7fca9ed9d700 1 --2- 172.21.15.71:0/289326029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaa015d230 0x7fcaa015d630 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fcaa00b2f20 tx=0x7fca98009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95787b3bdbe5b835 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:49.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.109+0000 7fca9d59a700 1 -- 172.21.15.71:0/289326029 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9800e070 con 0x7fcaa015d230 2023-10-09T06:57:49.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.109+0000 7fca9d59a700 1 -- 172.21.15.71:0/289326029 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9800ba20 con 0x7fcaa015d230 2023-10-09T06:57:49.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.109+0000 7fca9d59a700 1 -- 172.21.15.71:0/289326029 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca980092e0 con 0x7fcaa015d230 2023-10-09T06:57:49.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.110+0000 7fca9f59e700 1 -- 172.21.15.71:0/289326029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaa015d230 msgr2=0x7fcaa015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:49.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.110+0000 7fca9f59e700 1 --2- 172.21.15.71:0/289326029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaa015d230 0x7fcaa015d630 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fcaa00b2f20 tx=0x7fca98009840 comp rx=0 tx=0).stop 2023-10-09T06:57:49.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.110+0000 7fca9f59e700 1 -- 172.21.15.71:0/289326029 shutdown_connections 2023-10-09T06:57:49.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.110+0000 7fca9f59e700 1 --2- 172.21.15.71:0/289326029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaa015d230 0x7fcaa015d630 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:49.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.110+0000 7fca9f59e700 1 --2- 172.21.15.71:0/289326029 >> v2:172.21.15.179:3300/0 conn(0x7fcaa0159420 0x7fcaa00b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:49.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.110+0000 7fca9f59e700 1 -- 172.21.15.71:0/289326029 >> 172.21.15.71:0/289326029 conn(0x7fcaa00d0660 msgr2=0x7fcaa00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:49.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.110+0000 7fca9f59e700 1 -- 172.21.15.71:0/289326029 shutdown_connections 2023-10-09T06:57:49.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.110+0000 7fca9f59e700 1 -- 172.21.15.71:0/289326029 wait complete. 2023-10-09T06:57:49.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.111+0000 7fca9f59e700 1 Processor -- start 2023-10-09T06:57:49.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.112+0000 7fca9f59e700 1 -- start start 2023-10-09T06:57:49.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.112+0000 7fca9f59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa0159420 0x7fcaa015a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:49.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.112+0000 7fca9f59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaa01597f0 0x7fcaa015c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:49.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.112+0000 7fca9f59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaa015d230 0x7fcaa00b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:49.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.112+0000 7fca9f59e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa015afb0 con 0x7fcaa01597f0 2023-10-09T06:57:49.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.112+0000 7fca9f59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa015b290 con 0x7fcaa015d230 2023-10-09T06:57:49.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.112+0000 7fca9f59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa015b570 con 0x7fcaa0159420 2023-10-09T06:57:49.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.113+0000 7fca9dd9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaa01597f0 0x7fcaa015c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:49.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.113+0000 7fca9dd9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaa01597f0 0x7fcaa015c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55846/0 (socket says 172.21.15.71:55846) 2023-10-09T06:57:49.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.113+0000 7fca9dd9b700 1 -- 172.21.15.71:0/3401459301 learned_addr learned my addr 172.21.15.71:0/3401459301 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:49.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.113+0000 7fca9ed9d700 1 --2- 172.21.15.71:0/3401459301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaa015d230 0x7fcaa00b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:49.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.113+0000 7fca9e59c700 1 --2- 172.21.15.71:0/3401459301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa0159420 0x7fcaa015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:49.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.113+0000 7fca9dd9b700 1 -- 172.21.15.71:0/3401459301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa0159420 msgr2=0x7fcaa015a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:49.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.113+0000 7fca9dd9b700 1 --2- 172.21.15.71:0/3401459301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa0159420 0x7fcaa015a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:49.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.113+0000 7fca9dd9b700 1 -- 172.21.15.71:0/3401459301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaa015d230 msgr2=0x7fcaa00b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:49.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.113+0000 7fca9dd9b700 1 --2- 172.21.15.71:0/3401459301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaa015d230 0x7fcaa00b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:49.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.113+0000 7fca9dd9b700 1 -- 172.21.15.71:0/3401459301 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca98009ae0 con 0x7fcaa01597f0 2023-10-09T06:57:49.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.113+0000 7fca9dd9b700 1 --2- 172.21.15.71:0/3401459301 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaa01597f0 0x7fcaa015c050 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fca9400c7c0 tx=0x7fca94007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:49.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.114+0000 7fca8e7fc700 1 -- 172.21.15.71:0/3401459301 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca94011590 con 0x7fcaa01597f0 2023-10-09T06:57:49.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.114+0000 7fca8e7fc700 1 -- 172.21.15.71:0/3401459301 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca940116f0 con 0x7fcaa01597f0 2023-10-09T06:57:49.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.114+0000 7fca9f59e700 1 -- 172.21.15.71:0/3401459301 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa015b850 con 0x7fcaa01597f0 2023-10-09T06:57:49.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.114+0000 7fca8e7fc700 1 -- 172.21.15.71:0/3401459301 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca94011ab0 con 0x7fcaa01597f0 2023-10-09T06:57:49.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.114+0000 7fca9f59e700 1 -- 172.21.15.71:0/3401459301 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa015aba0 con 0x7fcaa01597f0 2023-10-09T06:57:49.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.115+0000 7fca9f59e700 1 -- 172.21.15.71:0/3401459301 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa004c3c0 con 0x7fcaa01597f0 2023-10-09T06:57:49.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.116+0000 7fca8e7fc700 1 -- 172.21.15.71:0/3401459301 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 30) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fca9401b3b0 con 0x7fcaa01597f0 2023-10-09T06:57:49.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.117+0000 7fca8e7fc700 1 --2- 172.21.15.71:0/3401459301 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fca800670e0 0x7fca80069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:49.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.117+0000 7fca8e7fc700 1 -- 172.21.15.71:0/3401459301 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fca94083fb0 con 0x7fcaa01597f0 2023-10-09T06:57:49.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.117+0000 7fca9e59c700 1 -- 172.21.15.71:0/3401459301 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fca800670e0 msgr2=0x7fca80069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:49.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.117+0000 7fca9e59c700 1 --2- 172.21.15.71:0/3401459301 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fca800670e0 0x7fca80069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:49.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.125+0000 7fca8e7fc700 1 -- 172.21.15.71:0/3401459301 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca94050c70 con 0x7fcaa01597f0 2023-10-09T06:57:49.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.318+0000 7fca9e59c700 1 -- 172.21.15.71:0/3401459301 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fca800670e0 msgr2=0x7fca80069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:49.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.318+0000 7fca9e59c700 1 --2- 172.21.15.71:0/3401459301 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fca800670e0 0x7fca80069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:49.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.326+0000 7fca9f59e700 1 -- 172.21.15.71:0/3401459301 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcaa00b37c0 con 0x7fcaa01597f0 2023-10-09T06:57:49.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.328+0000 7fca8e7fc700 1 -- 172.21.15.71:0/3401459301 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16316 (secure 0 0 0) 0x7fca94017070 con 0x7fcaa01597f0 2023-10-09T06:57:49.330 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:49.330 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":80,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:57:43.880434+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:57:25.936431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T06:57:27.258713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6833/85452":"2023-10-10T06:57:43.880403+0000","172.21.15.179:6832/85452":"2023-10-10T06:57:43.880403+0000","172.21.15.179:0/1471741869":"2023-10-10T06:57:43.880403+0000","172.21.15.179:0/988360271":"2023-10-10T06:57:43.880403+0000","172.21.15.179:0/1762902065":"2023-10-10T06:57:43.880403+0000","172.21.15.179:0/3858828816":"2023-10-10T06:57:43.880403+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:57:49.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.330+0000 7fca9f59e700 1 -- 172.21.15.71:0/3401459301 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fca800670e0 msgr2=0x7fca80069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:49.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.330+0000 7fca9f59e700 1 --2- 172.21.15.71:0/3401459301 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fca800670e0 0x7fca80069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:49.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.330+0000 7fca9f59e700 1 -- 172.21.15.71:0/3401459301 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaa01597f0 msgr2=0x7fcaa015c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:49.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.330+0000 7fca9f59e700 1 --2- 172.21.15.71:0/3401459301 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaa01597f0 0x7fcaa015c050 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fca9400c7c0 tx=0x7fca94007f50 comp rx=0 tx=0).stop 2023-10-09T06:57:49.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.331+0000 7fca9f59e700 1 -- 172.21.15.71:0/3401459301 shutdown_connections 2023-10-09T06:57:49.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.331+0000 7fca9f59e700 1 --2- 172.21.15.71:0/3401459301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaa015d230 0x7fcaa00b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:49.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.331+0000 7fca9f59e700 1 --2- 172.21.15.71:0/3401459301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa0159420 0x7fcaa015a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:49.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.331+0000 7fca9f59e700 1 --2- 172.21.15.71:0/3401459301 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fca800670e0 0x7fca80069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:49.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.331+0000 7fca9f59e700 1 --2- 172.21.15.71:0/3401459301 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaa01597f0 0x7fcaa015c050 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:49.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.331+0000 7fca9f59e700 1 -- 172.21.15.71:0/3401459301 >> 172.21.15.71:0/3401459301 conn(0x7fcaa00d0660 msgr2=0x7fcaa00cf210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:49.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.331+0000 7fca9f59e700 1 -- 172.21.15.71:0/3401459301 shutdown_connections 2023-10-09T06:57:49.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.331+0000 7fca9f59e700 1 -- 172.21.15.71:0/3401459301 wait complete. 2023-10-09T06:57:49.350 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T06:57:49.350 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:57:49.516 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:49.516+0000 7ff21f9fe180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T06:57:49.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.549+0000 7f1e53fff700 1 Processor -- start 2023-10-09T06:57:49.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.549+0000 7f1e53fff700 1 -- start start 2023-10-09T06:57:49.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.551+0000 7f1e53fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1e54166530 0x7f1e540c7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:49.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.551+0000 7f1e53fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1e540caad0 0x7f1e540872f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:49.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.551+0000 7f1e53fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e54087830 0x7f1e5406a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:49.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.551+0000 7f1e53fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e54069cd0 con 0x7f1e540caad0 2023-10-09T06:57:49.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.551+0000 7f1e53fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e54166900 con 0x7f1e54166530 2023-10-09T06:57:49.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.551+0000 7f1e53fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e54087c50 con 0x7f1e54087830 2023-10-09T06:57:49.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.551+0000 7f1e527fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1e540caad0 0x7f1e540872f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:49.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.551+0000 7f1e52ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1e54166530 0x7f1e540c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:49.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.551+0000 7f1e527fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1e540caad0 0x7f1e540872f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55852/0 (socket says 172.21.15.71:55852) 2023-10-09T06:57:49.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.551+0000 7f1e527fc700 1 -- 172.21.15.71:0/1107680024 learned_addr learned my addr 172.21.15.71:0/1107680024 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:49.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.551+0000 7f1e537fe700 1 --2- 172.21.15.71:0/1107680024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e54087830 0x7f1e5406a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:49.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.552+0000 7f1e527fc700 1 -- 172.21.15.71:0/1107680024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e54087830 msgr2=0x7f1e5406a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:49.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.552+0000 7f1e527fc700 1 --2- 172.21.15.71:0/1107680024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e54087830 0x7f1e5406a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:49.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.552+0000 7f1e527fc700 1 -- 172.21.15.71:0/1107680024 >> v2:172.21.15.179:3300/0 conn(0x7f1e54166530 msgr2=0x7f1e540c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:49.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.552+0000 7f1e527fc700 1 --2- 172.21.15.71:0/1107680024 >> v2:172.21.15.179:3300/0 conn(0x7f1e54166530 0x7f1e540c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:49.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.552+0000 7f1e527fc700 1 -- 172.21.15.71:0/1107680024 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e540696c0 con 0x7f1e540caad0 2023-10-09T06:57:49.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.553+0000 7f1e527fc700 1 --2- 172.21.15.71:0/1107680024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e540caad0 0x7f1e540872f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1e540c3050 tx=0x7f1e44008840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd3da283de12f06 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:49.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.553+0000 7f1e51ffb700 1 -- 172.21.15.71:0/1107680024 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4400b070 con 0x7f1e540caad0 2023-10-09T06:57:49.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.553+0000 7f1e51ffb700 1 -- 172.21.15.71:0/1107680024 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4400cc00 con 0x7f1e540caad0 2023-10-09T06:57:49.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.553+0000 7f1e51ffb700 1 -- 172.21.15.71:0/1107680024 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4400c040 con 0x7f1e540caad0 2023-10-09T06:57:49.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.554+0000 7f1e53fff700 1 -- 172.21.15.71:0/1107680024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e540caad0 msgr2=0x7f1e540872f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:49.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.554+0000 7f1e53fff700 1 --2- 172.21.15.71:0/1107680024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e540caad0 0x7f1e540872f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1e540c3050 tx=0x7f1e44008840 comp rx=0 tx=0).stop 2023-10-09T06:57:49.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.554+0000 7f1e53fff700 1 -- 172.21.15.71:0/1107680024 shutdown_connections 2023-10-09T06:57:49.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.554+0000 7f1e53fff700 1 --2- 172.21.15.71:0/1107680024 >> v2:172.21.15.179:3300/0 conn(0x7f1e54166530 0x7f1e540c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:49.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.554+0000 7f1e53fff700 1 --2- 172.21.15.71:0/1107680024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e54087830 0x7f1e5406a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:49.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.554+0000 7f1e53fff700 1 --2- 172.21.15.71:0/1107680024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e540caad0 0x7f1e540872f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:49.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.554+0000 7f1e53fff700 1 -- 172.21.15.71:0/1107680024 >> 172.21.15.71:0/1107680024 conn(0x7f1e540cc1f0 msgr2=0x7f1e540cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:49.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.554+0000 7f1e53fff700 1 -- 172.21.15.71:0/1107680024 shutdown_connections 2023-10-09T06:57:49.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.554+0000 7f1e53fff700 1 -- 172.21.15.71:0/1107680024 wait complete. 2023-10-09T06:57:49.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.558+0000 7f1e53fff700 1 Processor -- start 2023-10-09T06:57:49.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.558+0000 7f1e53fff700 1 -- start start 2023-10-09T06:57:49.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.559+0000 7f1e53fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e54087830 0x7f1e54162000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:49.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.559+0000 7f1e53fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e540caad0 0x7f1e54164c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:49.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.560+0000 7f1e53fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e54166530 0x7f1e541651c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:49.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.560+0000 7f1e53fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e54162980 con 0x7f1e540caad0 2023-10-09T06:57:49.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.560+0000 7f1e53fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e54162f40 con 0x7f1e54166530 2023-10-09T06:57:49.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.560+0000 7f1e53fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e540b1030 con 0x7f1e54087830 2023-10-09T06:57:49.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.560+0000 7f1e527fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e540caad0 0x7f1e54164c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:49.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.560+0000 7f1e527fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e540caad0 0x7f1e54164c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55858/0 (socket says 172.21.15.71:55858) 2023-10-09T06:57:49.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.560+0000 7f1e527fc700 1 -- 172.21.15.71:0/336523941 learned_addr learned my addr 172.21.15.71:0/336523941 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:49.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.560+0000 7f1e52ffd700 1 --2- 172.21.15.71:0/336523941 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e54087830 0x7f1e54162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:49.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.560+0000 7f1e537fe700 1 --2- 172.21.15.71:0/336523941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e54166530 0x7f1e541651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:49.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.561+0000 7f1e52ffd700 1 -- 172.21.15.71:0/336523941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e54166530 msgr2=0x7f1e541651c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:49.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.561+0000 7f1e52ffd700 1 --2- 172.21.15.71:0/336523941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e54166530 0x7f1e541651c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:49.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.561+0000 7f1e52ffd700 1 -- 172.21.15.71:0/336523941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e540caad0 msgr2=0x7f1e54164c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:49.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.561+0000 7f1e52ffd700 1 --2- 172.21.15.71:0/336523941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e540caad0 0x7f1e54164c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:49.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.561+0000 7f1e52ffd700 1 -- 172.21.15.71:0/336523941 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e44008ae0 con 0x7f1e54087830 2023-10-09T06:57:49.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.561+0000 7f1e527fc700 1 --2- 172.21.15.71:0/336523941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e540caad0 0x7f1e54164c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:57:49.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.561+0000 7f1e52ffd700 1 --2- 172.21.15.71:0/336523941 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e54087830 0x7f1e54162000 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00e890 tx=0x7f1e4c008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:49.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.561+0000 7f1e4affd700 1 -- 172.21.15.71:0/336523941 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c014400 con 0x7f1e54087830 2023-10-09T06:57:49.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.562+0000 7f1e4affd700 1 -- 172.21.15.71:0/336523941 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4c018070 con 0x7f1e54087830 2023-10-09T06:57:49.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.562+0000 7f1e4affd700 1 -- 172.21.15.71:0/336523941 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c0145a0 con 0x7f1e54087830 2023-10-09T06:57:49.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.562+0000 7f1e53fff700 1 -- 172.21.15.71:0/336523941 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e540b1310 con 0x7f1e54087830 2023-10-09T06:57:49.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.563+0000 7f1e53fff700 1 -- 172.21.15.71:0/336523941 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e54162540 con 0x7f1e54087830 2023-10-09T06:57:49.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.566+0000 7f1e4affd700 1 -- 172.21.15.71:0/336523941 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 30) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f1e4c010510 con 0x7f1e54087830 2023-10-09T06:57:49.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.566+0000 7f1e53fff700 1 -- 172.21.15.71:0/336523941 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e540c7260 con 0x7f1e54087830 2023-10-09T06:57:49.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.567+0000 7f1e4affd700 1 --2- 172.21.15.71:0/336523941 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1e340670e0 0x7f1e34069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:49.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.567+0000 7f1e4affd700 1 -- 172.21.15.71:0/336523941 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f1e4c014030 con 0x7f1e54087830 2023-10-09T06:57:49.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.568+0000 7f1e527fc700 1 -- 172.21.15.71:0/336523941 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1e340670e0 msgr2=0x7f1e34069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:49.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.568+0000 7f1e527fc700 1 --2- 172.21.15.71:0/336523941 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1e340670e0 0x7f1e34069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:49.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.572+0000 7f1e4affd700 1 -- 172.21.15.71:0/336523941 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e4c051620 con 0x7f1e54087830 2023-10-09T06:57:49.650 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:49.649+0000 7f91f7741180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T06:57:49.691 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:49.690+0000 7ff21f9fe180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:57:49.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.769+0000 7f1e527fc700 1 -- 172.21.15.71:0/336523941 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1e340670e0 msgr2=0x7f1e34069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:49.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.769+0000 7f1e527fc700 1 --2- 172.21.15.71:0/336523941 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1e340670e0 0x7f1e34069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:49.787 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:49.787+0000 7ff21f9fe180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T06:57:49.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.821+0000 7f1e53fff700 1 -- 172.21.15.71:0/336523941 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e540648d0 con 0x7f1e54087830 2023-10-09T06:57:49.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.822+0000 7f1e4affd700 1 -- 172.21.15.71:0/336523941 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f1e4c054c40 con 0x7f1e54087830 2023-10-09T06:57:49.823 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:49.824 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6055,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3774833170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3774833170},{"type":"v1","addr":"172.21.15.179:6836","nonce":3774833170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6058,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3203736717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3203736717},{"type":"v1","addr":"172.21.15.179:6837","nonce":3203736717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2747804060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2747804060},{"type":"v1","addr":"172.21.15.71:6833","nonce":2747804060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:57:28.273000+0000","modified":"2023-10-09T06:57:31.823203+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6240},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6240":{"gid":6240,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/3993456703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3993456703},{"type":"v1","addr":"172.21.15.71:6835","nonce":3993456703}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T06:57:49.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.825+0000 7f1e53fff700 1 -- 172.21.15.71:0/336523941 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1e340670e0 msgr2=0x7f1e34069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:49.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.825+0000 7f1e53fff700 1 --2- 172.21.15.71:0/336523941 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1e340670e0 0x7f1e34069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:49.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.825+0000 7f1e53fff700 1 -- 172.21.15.71:0/336523941 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e54087830 msgr2=0x7f1e54162000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:49.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.825+0000 7f1e53fff700 1 --2- 172.21.15.71:0/336523941 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e54087830 0x7f1e54162000 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00e890 tx=0x7f1e4c008040 comp rx=0 tx=0).stop 2023-10-09T06:57:49.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.825+0000 7f1e53fff700 1 -- 172.21.15.71:0/336523941 shutdown_connections 2023-10-09T06:57:49.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.825+0000 7f1e53fff700 1 --2- 172.21.15.71:0/336523941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e54166530 0x7f1e541651c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:49.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.825+0000 7f1e53fff700 1 --2- 172.21.15.71:0/336523941 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e54087830 0x7f1e54162000 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:49.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.825+0000 7f1e53fff700 1 --2- 172.21.15.71:0/336523941 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1e340670e0 0x7f1e34069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:49.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.825+0000 7f1e53fff700 1 --2- 172.21.15.71:0/336523941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e540caad0 0x7f1e54164c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:49.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.825+0000 7f1e53fff700 1 -- 172.21.15.71:0/336523941 >> 172.21.15.71:0/336523941 conn(0x7f1e540cc1f0 msgr2=0x7f1e5406e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:49.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.825+0000 7f1e53fff700 1 -- 172.21.15.71:0/336523941 shutdown_connections 2023-10-09T06:57:49.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:49.825+0000 7f1e53fff700 1 -- 172.21.15.71:0/336523941 wait complete. 2023-10-09T06:57:49.828 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 33 2023-10-09T06:57:49.828 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:49.827+0000 7f91f7741180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:57:49.844 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:57:49.930 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:49.930+0000 7f91f7741180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T06:57:50.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.030+0000 7fbf9a99d700 1 Processor -- start 2023-10-09T06:57:50.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.030+0000 7fbf9a99d700 1 -- start start 2023-10-09T06:57:50.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.031+0000 7fbf9a99d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbf941597f0 0x7fbf940b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:50.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.031+0000 7fbf9a99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf9415d230 0x7fbf9415d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:50.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.031+0000 7fbf9a99d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9415dbb0 con 0x7fbf94159420 2023-10-09T06:57:50.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.031+0000 7fbf9a99d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf940b11d0 con 0x7fbf941597f0 2023-10-09T06:57:50.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.031+0000 7fbf9a99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf940b14b0 con 0x7fbf9415d230 2023-10-09T06:57:50.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.031+0000 7fbf9919a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbf941597f0 0x7fbf940b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:50.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.031+0000 7fbf9919a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbf941597f0 0x7fbf940b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55860/0 (socket says 172.21.15.71:55860) 2023-10-09T06:57:50.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.031+0000 7fbf9a19c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf9415d230 0x7fbf9415d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:50.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.031+0000 7fbf9999b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fbf94159420 0x7fbf940b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:45712/0 (socket says 172.21.15.71:45712) 2023-10-09T06:57:50.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.032+0000 7fbf9919a700 1 -- 172.21.15.71:0/3070966286 learned_addr learned my addr 172.21.15.71:0/3070966286 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:50.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.032+0000 7fbf9919a700 1 -- 172.21.15.71:0/3070966286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf9415d230 msgr2=0x7fbf9415d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:50.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.032+0000 7fbf9919a700 1 --2- 172.21.15.71:0/3070966286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf9415d230 0x7fbf9415d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:50.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.032+0000 7fbf9919a700 1 -- 172.21.15.71:0/3070966286 >> v1:172.21.15.179:6789/0 conn(0x7fbf94159420 legacy=0x7fbf940b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:50.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.032+0000 7fbf9919a700 1 -- 172.21.15.71:0/3070966286 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf940b1790 con 0x7fbf941597f0 2023-10-09T06:57:50.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.032+0000 7fbf9919a700 1 --2- 172.21.15.71:0/3070966286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf941597f0 0x7fbf940b2270 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fbf840099b0 tx=0x7fbf84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68faf442c38a56a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:50.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.032+0000 7fbf98999700 1 -- 172.21.15.71:0/3070966286 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84009ea0 con 0x7fbf941597f0 2023-10-09T06:57:50.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.032+0000 7fbf98999700 1 -- 172.21.15.71:0/3070966286 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8400b760 con 0x7fbf941597f0 2023-10-09T06:57:50.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.033+0000 7fbf98999700 1 -- 172.21.15.71:0/3070966286 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8400bb00 con 0x7fbf941597f0 2023-10-09T06:57:50.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.033+0000 7fbf9a99d700 1 -- 172.21.15.71:0/3070966286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf941597f0 msgr2=0x7fbf940b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:50.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.033+0000 7fbf9a99d700 1 --2- 172.21.15.71:0/3070966286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf941597f0 0x7fbf940b2270 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fbf840099b0 tx=0x7fbf84009250 comp rx=0 tx=0).stop 2023-10-09T06:57:50.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.033+0000 7fbf9a99d700 1 -- 172.21.15.71:0/3070966286 shutdown_connections 2023-10-09T06:57:50.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.033+0000 7fbf9a99d700 1 --2- 172.21.15.71:0/3070966286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf9415d230 0x7fbf9415d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:50.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.033+0000 7fbf9a99d700 1 --2- 172.21.15.71:0/3070966286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf941597f0 0x7fbf940b2270 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:50.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.033+0000 7fbf9a99d700 1 -- 172.21.15.71:0/3070966286 >> 172.21.15.71:0/3070966286 conn(0x7fbf940d0660 msgr2=0x7fbf940d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:50.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.033+0000 7fbf9a99d700 1 -- 172.21.15.71:0/3070966286 shutdown_connections 2023-10-09T06:57:50.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.033+0000 7fbf9a99d700 1 -- 172.21.15.71:0/3070966286 wait complete. 2023-10-09T06:57:50.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.035+0000 7fbf9a99d700 1 Processor -- start 2023-10-09T06:57:50.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.035+0000 7fbf9a99d700 1 -- start start 2023-10-09T06:57:50.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.036+0000 7fbf9a99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf94159420 0x7fbf940c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:50.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.036+0000 7fbf9a99d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf941597f0 0x7fbf9416cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:50.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.036+0000 7fbf9a99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf9415d230 0x7fbf9416d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:50.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.036+0000 7fbf9a99d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf94159c30 con 0x7fbf941597f0 2023-10-09T06:57:50.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.036+0000 7fbf9a99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf94159f10 con 0x7fbf9415d230 2023-10-09T06:57:50.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.036+0000 7fbf9a99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9415a1f0 con 0x7fbf94159420 2023-10-09T06:57:50.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.036+0000 7fbf9919a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf941597f0 0x7fbf9416cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:50.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.036+0000 7fbf9999b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf94159420 0x7fbf940c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:50.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.036+0000 7fbf9919a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf941597f0 0x7fbf9416cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55870/0 (socket says 172.21.15.71:55870) 2023-10-09T06:57:50.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.036+0000 7fbf9999b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf94159420 0x7fbf940c9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:60796/0 (socket says 172.21.15.71:60796) 2023-10-09T06:57:50.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.036+0000 7fbf9919a700 1 -- 172.21.15.71:0/1974371211 learned_addr learned my addr 172.21.15.71:0/1974371211 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:50.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.036+0000 7fbf9a19c700 1 --2- 172.21.15.71:0/1974371211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf9415d230 0x7fbf9416d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:50.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.037+0000 7fbf9919a700 1 -- 172.21.15.71:0/1974371211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf94159420 msgr2=0x7fbf940c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:50.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.037+0000 7fbf9919a700 1 --2- 172.21.15.71:0/1974371211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf94159420 0x7fbf940c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:50.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.037+0000 7fbf9919a700 1 -- 172.21.15.71:0/1974371211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf9415d230 msgr2=0x7fbf9416d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:50.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.037+0000 7fbf9919a700 1 --2- 172.21.15.71:0/1974371211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf9415d230 0x7fbf9416d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:50.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.037+0000 7fbf9919a700 1 -- 172.21.15.71:0/1974371211 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf840094f0 con 0x7fbf941597f0 2023-10-09T06:57:50.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.037+0000 7fbf9919a700 1 --2- 172.21.15.71:0/1974371211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf941597f0 0x7fbf9416cf10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fbf94089340 tx=0x7fbf84016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:50.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.037+0000 7fbf89ffb700 1 -- 172.21.15.71:0/1974371211 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84011d80 con 0x7fbf941597f0 2023-10-09T06:57:50.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.037+0000 7fbf89ffb700 1 -- 172.21.15.71:0/1974371211 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8401c460 con 0x7fbf941597f0 2023-10-09T06:57:50.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.037+0000 7fbf9a99d700 1 -- 172.21.15.71:0/1974371211 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9415a4d0 con 0x7fbf941597f0 2023-10-09T06:57:50.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.037+0000 7fbf89ffb700 1 -- 172.21.15.71:0/1974371211 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8401c820 con 0x7fbf941597f0 2023-10-09T06:57:50.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.038+0000 7fbf9a99d700 1 -- 172.21.15.71:0/1974371211 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf940cba40 con 0x7fbf941597f0 2023-10-09T06:57:50.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.039+0000 7fbf9a99d700 1 -- 172.21.15.71:0/1974371211 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf9404c3c0 con 0x7fbf941597f0 2023-10-09T06:57:50.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.039+0000 7fbf89ffb700 1 -- 172.21.15.71:0/1974371211 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 30) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fbf8401cc50 con 0x7fbf941597f0 2023-10-09T06:57:50.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.040+0000 7fbf89ffb700 1 --2- 172.21.15.71:0/1974371211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbf780670e0 0x7fbf78069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:50.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.040+0000 7fbf89ffb700 1 -- 172.21.15.71:0/1974371211 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fbf84086dc0 con 0x7fbf941597f0 2023-10-09T06:57:50.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.040+0000 7fbf9999b700 1 -- 172.21.15.71:0/1974371211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbf780670e0 msgr2=0x7fbf78069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:50.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.041+0000 7fbf9999b700 1 --2- 172.21.15.71:0/1974371211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbf780670e0 0x7fbf78069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:50.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.044+0000 7fbf89ffb700 1 -- 172.21.15.71:0/1974371211 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf84053a80 con 0x7fbf941597f0 2023-10-09T06:57:50.084 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:50.084+0000 7ff21f9fe180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T06:57:50.180 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:50.179+0000 7ff21f9fe180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T06:57:50.235 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:50.234+0000 7f91f7741180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T06:57:50.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.242+0000 7fbf9999b700 1 -- 172.21.15.71:0/1974371211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbf780670e0 msgr2=0x7fbf78069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:50.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.242+0000 7fbf9999b700 1 --2- 172.21.15.71:0/1974371211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbf780670e0 0x7fbf78069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:50.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.287+0000 7fbf9a99d700 1 -- 172.21.15.71:0/1974371211 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf9404c3c0 con 0x7fbf941597f0 2023-10-09T06:57:50.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.287+0000 7fbf89ffb700 1 -- 172.21.15.71:0/1974371211 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fbf840570a0 con 0x7fbf941597f0 2023-10-09T06:57:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:50.288 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6055,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3774833170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3774833170},{"type":"v1","addr":"172.21.15.179:6836","nonce":3774833170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6058,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3203736717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3203736717},{"type":"v1","addr":"172.21.15.179:6837","nonce":3203736717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2747804060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2747804060},{"type":"v1","addr":"172.21.15.71:6833","nonce":2747804060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:57:28.273000+0000","modified":"2023-10-09T06:57:31.823203+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6240},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6240":{"gid":6240,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/3993456703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3993456703},{"type":"v1","addr":"172.21.15.71:6835","nonce":3993456703}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T06:57:50.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.289+0000 7fbf9a99d700 1 -- 172.21.15.71:0/1974371211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbf780670e0 msgr2=0x7fbf78069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:50.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.289+0000 7fbf9a99d700 1 --2- 172.21.15.71:0/1974371211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbf780670e0 0x7fbf78069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:50.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.289+0000 7fbf9a99d700 1 -- 172.21.15.71:0/1974371211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf941597f0 msgr2=0x7fbf9416cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:50.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.289+0000 7fbf9a99d700 1 --2- 172.21.15.71:0/1974371211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf941597f0 0x7fbf9416cf10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fbf94089340 tx=0x7fbf84016000 comp rx=0 tx=0).stop 2023-10-09T06:57:50.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.289+0000 7fbf9a99d700 1 -- 172.21.15.71:0/1974371211 shutdown_connections 2023-10-09T06:57:50.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.289+0000 7fbf9a99d700 1 --2- 172.21.15.71:0/1974371211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf9415d230 0x7fbf9416d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:50.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.289+0000 7fbf9a99d700 1 --2- 172.21.15.71:0/1974371211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf94159420 0x7fbf940c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:50.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.289+0000 7fbf9a99d700 1 --2- 172.21.15.71:0/1974371211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fbf780670e0 0x7fbf78069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:50.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.289+0000 7fbf9a99d700 1 --2- 172.21.15.71:0/1974371211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf941597f0 0x7fbf9416cf10 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:50.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.289+0000 7fbf9a99d700 1 -- 172.21.15.71:0/1974371211 >> 172.21.15.71:0/1974371211 conn(0x7fbf940d0660 msgr2=0x7fbf940d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:50.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.290+0000 7fbf9a99d700 1 -- 172.21.15.71:0/1974371211 shutdown_connections 2023-10-09T06:57:50.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.290+0000 7fbf9a99d700 1 -- 172.21.15.71:0/1974371211 wait complete. 2023-10-09T06:57:50.292 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 33 2023-10-09T06:57:50.309 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:57:50.335 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:50.335+0000 7f91f7741180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T06:57:50.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.493+0000 7fc90a99d700 1 Processor -- start 2023-10-09T06:57:50.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.493+0000 7fc90a99d700 1 -- start start 2023-10-09T06:57:50.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.494+0000 7fc90a99d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc9041597f0 0x7fc9040b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:50.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.494+0000 7fc90a99d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9040b11d0 con 0x7fc90415d230 2023-10-09T06:57:50.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.494+0000 7fc90a99d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9040b14b0 con 0x7fc904159420 2023-10-09T06:57:50.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.494+0000 7fc90a99d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9040b1790 con 0x7fc9041597f0 2023-10-09T06:57:50.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.495+0000 7fc90919a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc9041597f0 0x7fc9040b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:50.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.495+0000 7fc90a19c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc90415d230 0x7fc90415d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46064/0 (socket says 172.21.15.71:46064) 2023-10-09T06:57:50.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.495+0000 7fc90a19c700 1 -- 172.21.15.71:0/1607612742 learned_addr learned my addr 172.21.15.71:0/1607612742 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:50.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.495+0000 7fc90919a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc9041597f0 0x7fc9040b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55874/0 (socket says 172.21.15.71:55874) 2023-10-09T06:57:50.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.495+0000 7fc90919a700 1 -- 172.21.15.71:0/1607612742 >> v1:172.21.15.179:6789/0 conn(0x7fc904159420 legacy=0x7fc9040b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:50.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.495+0000 7fc90919a700 1 -- 172.21.15.71:0/1607612742 >> v1:172.21.15.71:6789/0 conn(0x7fc90415d230 legacy=0x7fc90415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:50.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.495+0000 7fc90919a700 1 -- 172.21.15.71:0/1607612742 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9040b1a70 con 0x7fc9041597f0 2023-10-09T06:57:50.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.495+0000 7fc908999700 1 -- 172.21.15.71:0/1607612742 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2864907815 0 0) 0x7fc9040b11d0 con 0x7fc90415d230 2023-10-09T06:57:50.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.495+0000 7fc90919a700 1 --2- 172.21.15.71:0/1607612742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9041597f0 0x7fc9040b2270 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc8f40098e0 tx=0x7fc8f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4e4d4aa030cbe7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:50.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.496+0000 7fc908999700 1 -- 172.21.15.71:0/1607612742 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4009e80 con 0x7fc9041597f0 2023-10-09T06:57:50.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.496+0000 7fc908999700 1 -- 172.21.15.71:0/1607612742 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f400b860 con 0x7fc9041597f0 2023-10-09T06:57:50.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.496+0000 7fc908999700 1 -- 172.21.15.71:0/1607612742 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f400bbe0 con 0x7fc9041597f0 2023-10-09T06:57:50.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.496+0000 7fc90a99d700 1 -- 172.21.15.71:0/1607612742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9041597f0 msgr2=0x7fc9040b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:50.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.496+0000 7fc90a99d700 1 --2- 172.21.15.71:0/1607612742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9041597f0 0x7fc9040b2270 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc8f40098e0 tx=0x7fc8f40091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:50.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.496+0000 7fc90a99d700 1 -- 172.21.15.71:0/1607612742 shutdown_connections 2023-10-09T06:57:50.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.496+0000 7fc90a99d700 1 --2- 172.21.15.71:0/1607612742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9041597f0 0x7fc9040b2270 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:50.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.496+0000 7fc90a99d700 1 -- 172.21.15.71:0/1607612742 >> 172.21.15.71:0/1607612742 conn(0x7fc9040d0660 msgr2=0x7fc9040d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:50.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.496+0000 7fc90a99d700 1 -- 172.21.15.71:0/1607612742 shutdown_connections 2023-10-09T06:57:50.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.496+0000 7fc90a99d700 1 -- 172.21.15.71:0/1607612742 wait complete. 2023-10-09T06:57:50.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.498+0000 7fc90a99d700 1 Processor -- start 2023-10-09T06:57:50.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.498+0000 7fc90a99d700 1 -- start start 2023-10-09T06:57:50.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.499+0000 7fc90a99d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc904159420 0x7fc904154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:50.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.499+0000 7fc90a99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9041597f0 0x7fc90415c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:50.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.499+0000 7fc90a99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc90415d230 0x7fc9040c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:50.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.499+0000 7fc90a99d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc904154c60 con 0x7fc904159420 2023-10-09T06:57:50.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.499+0000 7fc90a99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9040c63f0 con 0x7fc9041597f0 2023-10-09T06:57:50.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.499+0000 7fc90a99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9040c57e0 con 0x7fc90415d230 2023-10-09T06:57:50.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.499+0000 7fc90999b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc904159420 0x7fc904154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:50.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.499+0000 7fc90999b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc904159420 0x7fc904154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55876/0 (socket says 172.21.15.71:55876) 2023-10-09T06:57:50.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.499+0000 7fc90999b700 1 -- 172.21.15.71:0/3327893130 learned_addr learned my addr 172.21.15.71:0/3327893130 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:50.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.499+0000 7fc90919a700 1 --2- 172.21.15.71:0/3327893130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9041597f0 0x7fc90415c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:50.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.499+0000 7fc90a19c700 1 --2- 172.21.15.71:0/3327893130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc90415d230 0x7fc9040c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:50.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.500+0000 7fc90999b700 1 -- 172.21.15.71:0/3327893130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc90415d230 msgr2=0x7fc9040c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:50.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.500+0000 7fc90999b700 1 --2- 172.21.15.71:0/3327893130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc90415d230 0x7fc9040c70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:50.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.500+0000 7fc90999b700 1 -- 172.21.15.71:0/3327893130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9041597f0 msgr2=0x7fc90415c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:50.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.500+0000 7fc90999b700 1 --2- 172.21.15.71:0/3327893130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9041597f0 0x7fc90415c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:50.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.500+0000 7fc90999b700 1 -- 172.21.15.71:0/3327893130 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f4009420 con 0x7fc904159420 2023-10-09T06:57:50.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.500+0000 7fc90a19c700 1 --2- 172.21.15.71:0/3327893130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc90415d230 0x7fc9040c70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:50.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.500+0000 7fc90999b700 1 --2- 172.21.15.71:0/3327893130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc904159420 0x7fc904154720 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fc90000c590 tx=0x7fc90000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:50.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.500+0000 7fc8f9ffb700 1 -- 172.21.15.71:0/3327893130 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc900011590 con 0x7fc904159420 2023-10-09T06:57:50.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.500+0000 7fc8f9ffb700 1 -- 172.21.15.71:0/3327893130 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc900011710 con 0x7fc904159420 2023-10-09T06:57:50.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.500+0000 7fc90a99d700 1 -- 172.21.15.71:0/3327893130 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9040c5ac0 con 0x7fc904159420 2023-10-09T06:57:50.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.500+0000 7fc8f9ffb700 1 -- 172.21.15.71:0/3327893130 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc900011ad0 con 0x7fc904159420 2023-10-09T06:57:50.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.500+0000 7fc90a99d700 1 -- 172.21.15.71:0/3327893130 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9040c6080 con 0x7fc904159420 2023-10-09T06:57:50.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.501+0000 7fc90a99d700 1 -- 172.21.15.71:0/3327893130 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc90404c3c0 con 0x7fc904159420 2023-10-09T06:57:50.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.502+0000 7fc8f9ffb700 1 -- 172.21.15.71:0/3327893130 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 30) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fc90001b3b0 con 0x7fc904159420 2023-10-09T06:57:50.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.503+0000 7fc8f9ffb700 1 --2- 172.21.15.71:0/3327893130 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc8e80670e0 0x7fc8e8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:50.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.503+0000 7fc8f9ffb700 1 -- 172.21.15.71:0/3327893130 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fc9000840c0 con 0x7fc904159420 2023-10-09T06:57:50.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.503+0000 7fc90919a700 1 -- 172.21.15.71:0/3327893130 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc8e80670e0 msgr2=0x7fc8e8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:50.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.503+0000 7fc90919a700 1 --2- 172.21.15.71:0/3327893130 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc8e80670e0 0x7fc8e8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:50.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.507+0000 7fc8f9ffb700 1 -- 172.21.15.71:0/3327893130 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc900050d80 con 0x7fc904159420 2023-10-09T06:57:50.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.704+0000 7fc90919a700 1 -- 172.21.15.71:0/3327893130 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc8e80670e0 msgr2=0x7fc8e8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:50.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.704+0000 7fc90919a700 1 --2- 172.21.15.71:0/3327893130 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc8e80670e0 0x7fc8e8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:50.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.709+0000 7fc90a99d700 1 -- 172.21.15.71:0/3327893130 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9040b1d50 con 0x7fc904159420 2023-10-09T06:57:50.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.710+0000 7fc8f9ffb700 1 -- 172.21.15.71:0/3327893130 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16316 (secure 0 0 0) 0x7fc900017020 con 0x7fc904159420 2023-10-09T06:57:50.711 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:50.711 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":80,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:57:43.880434+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:57:25.936431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T06:57:27.258713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6833/85452":"2023-10-10T06:57:43.880403+0000","172.21.15.179:6832/85452":"2023-10-10T06:57:43.880403+0000","172.21.15.179:0/1471741869":"2023-10-10T06:57:43.880403+0000","172.21.15.179:0/988360271":"2023-10-10T06:57:43.880403+0000","172.21.15.179:0/1762902065":"2023-10-10T06:57:43.880403+0000","172.21.15.179:0/3858828816":"2023-10-10T06:57:43.880403+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:57:50.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.713+0000 7fc90a99d700 1 -- 172.21.15.71:0/3327893130 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc8e80670e0 msgr2=0x7fc8e8069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:50.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.713+0000 7fc90a99d700 1 --2- 172.21.15.71:0/3327893130 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc8e80670e0 0x7fc8e8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:50.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.713+0000 7fc90a99d700 1 -- 172.21.15.71:0/3327893130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc904159420 msgr2=0x7fc904154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:50.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.713+0000 7fc90a99d700 1 --2- 172.21.15.71:0/3327893130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc904159420 0x7fc904154720 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fc90000c590 tx=0x7fc90000c8a0 comp rx=0 tx=0).stop 2023-10-09T06:57:50.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.713+0000 7fc90a99d700 1 -- 172.21.15.71:0/3327893130 shutdown_connections 2023-10-09T06:57:50.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.713+0000 7fc90a99d700 1 --2- 172.21.15.71:0/3327893130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc90415d230 0x7fc9040c70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:50.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.713+0000 7fc90a99d700 1 --2- 172.21.15.71:0/3327893130 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc8e80670e0 0x7fc8e8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:50.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.713+0000 7fc90a99d700 1 --2- 172.21.15.71:0/3327893130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc904159420 0x7fc904154720 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:50.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.713+0000 7fc90a99d700 1 --2- 172.21.15.71:0/3327893130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9041597f0 0x7fc90415c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:50.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.713+0000 7fc90a99d700 1 -- 172.21.15.71:0/3327893130 >> 172.21.15.71:0/3327893130 conn(0x7fc9040d0660 msgr2=0x7fc904158560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:50.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.713+0000 7fc90a99d700 1 -- 172.21.15.71:0/3327893130 shutdown_connections 2023-10-09T06:57:50.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.713+0000 7fc90a99d700 1 -- 172.21.15.71:0/3327893130 wait complete. 2023-10-09T06:57:50.731 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T06:57:50.886 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:50.886+0000 7ff21f9fe180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T06:57:50.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.959+0000 7f1377fff700 1 Processor -- start 2023-10-09T06:57:50.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.959+0000 7f1377fff700 1 -- start start 2023-10-09T06:57:50.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.960+0000 7f1377fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f137815d230 0x7f137815d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:50.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.960+0000 7f1377fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13780b2980 con 0x7f1378159420 2023-10-09T06:57:50.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.960+0000 7f1377fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137815dbb0 con 0x7f13781597f0 2023-10-09T06:57:50.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.960+0000 7f1377fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13780b11d0 con 0x7f137815d230 2023-10-09T06:57:50.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.961+0000 7f1376ffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f1378159420 0x7f13780b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46070/0 (socket says 172.21.15.71:46070) 2023-10-09T06:57:50.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.961+0000 7f1376ffd700 1 -- 172.21.15.71:0/307007292 learned_addr learned my addr 172.21.15.71:0/307007292 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:50.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.961+0000 7f13777fe700 1 --2- 172.21.15.71:0/307007292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f137815d230 0x7f137815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:50.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.961+0000 7f1375ffb700 1 -- 172.21.15.71:0/307007292 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685609699 0 0) 0x7f13780b2980 con 0x7f1378159420 2023-10-09T06:57:50.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.961+0000 7f1375ffb700 1 -- 172.21.15.71:0/307007292 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1360003570 con 0x7f1378159420 2023-10-09T06:57:50.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.961+0000 7f1375ffb700 1 -- 172.21.15.71:0/307007292 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 722371327 0 0) 0x7f137815dbb0 con 0x7f13781597f0 2023-10-09T06:57:50.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.961+0000 7f1375ffb700 1 -- 172.21.15.71:0/307007292 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13780b2980 con 0x7f13781597f0 2023-10-09T06:57:50.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.961+0000 7f13777fe700 1 -- 172.21.15.71:0/307007292 >> v1:172.21.15.179:6789/0 conn(0x7f13781597f0 legacy=0x7f13780b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:50.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.961+0000 7f13777fe700 1 -- 172.21.15.71:0/307007292 >> v1:172.21.15.71:6789/0 conn(0x7f1378159420 legacy=0x7f13780b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:50.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.961+0000 7f13777fe700 1 -- 172.21.15.71:0/307007292 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13780b14b0 con 0x7f137815d230 2023-10-09T06:57:50.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.962+0000 7f13777fe700 1 --2- 172.21.15.71:0/307007292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f137815d230 0x7f137815d670 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1370009e90 tx=0x7f1370009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=295289652e2b13e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:50.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.962+0000 7f1375ffb700 1 -- 172.21.15.71:0/307007292 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137000e070 con 0x7f137815d230 2023-10-09T06:57:50.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.962+0000 7f1375ffb700 1 -- 172.21.15.71:0/307007292 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137000bb80 con 0x7f137815d230 2023-10-09T06:57:50.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.962+0000 7f1375ffb700 1 -- 172.21.15.71:0/307007292 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370012430 con 0x7f137815d230 2023-10-09T06:57:50.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.962+0000 7f1377fff700 1 -- 172.21.15.71:0/307007292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f137815d230 msgr2=0x7f137815d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:50.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.962+0000 7f1377fff700 1 --2- 172.21.15.71:0/307007292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f137815d230 0x7f137815d670 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1370009e90 tx=0x7f1370009780 comp rx=0 tx=0).stop 2023-10-09T06:57:50.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.962+0000 7f1377fff700 1 -- 172.21.15.71:0/307007292 shutdown_connections 2023-10-09T06:57:50.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.962+0000 7f1377fff700 1 --2- 172.21.15.71:0/307007292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f137815d230 0x7f137815d670 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:50.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.962+0000 7f1377fff700 1 -- 172.21.15.71:0/307007292 >> 172.21.15.71:0/307007292 conn(0x7f13780d0660 msgr2=0x7f13780d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:50.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.963+0000 7f1377fff700 1 -- 172.21.15.71:0/307007292 shutdown_connections 2023-10-09T06:57:50.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.963+0000 7f1377fff700 1 -- 172.21.15.71:0/307007292 wait complete. 2023-10-09T06:57:50.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.964+0000 7f1377fff700 1 Processor -- start 2023-10-09T06:57:50.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.964+0000 7f1377fff700 1 -- start start 2023-10-09T06:57:50.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.965+0000 7f1377fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1378159420 0x7f13780c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:50.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.965+0000 7f1377fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13781597f0 0x7f1378169f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:50.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.965+0000 7f1377fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f137815d230 0x7f13780b5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:50.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.965+0000 7f1377fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13780b53f0 con 0x7f137815d230 2023-10-09T06:57:50.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.965+0000 7f1377fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13780b47e0 con 0x7f13781597f0 2023-10-09T06:57:50.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.965+0000 7f1377fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13780b4ac0 con 0x7f1378159420 2023-10-09T06:57:50.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.965+0000 7f13777fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f137815d230 0x7f13780b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:50.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.965+0000 7f13777fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f137815d230 0x7f13780b5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55884/0 (socket says 172.21.15.71:55884) 2023-10-09T06:57:50.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.965+0000 7f13777fe700 1 -- 172.21.15.71:0/2645337848 learned_addr learned my addr 172.21.15.71:0/2645337848 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:50.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.965+0000 7f1376ffd700 1 --2- 172.21.15.71:0/2645337848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1378159420 0x7f13780c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:50.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.965+0000 7f13767fc700 1 --2- 172.21.15.71:0/2645337848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13781597f0 0x7f1378169f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:50.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.966+0000 7f13777fe700 1 -- 172.21.15.71:0/2645337848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1378159420 msgr2=0x7f13780c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:50.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.966+0000 7f13777fe700 1 --2- 172.21.15.71:0/2645337848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1378159420 0x7f13780c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:50.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.966+0000 7f13777fe700 1 -- 172.21.15.71:0/2645337848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13781597f0 msgr2=0x7f1378169f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:50.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.966+0000 7f13777fe700 1 --2- 172.21.15.71:0/2645337848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13781597f0 0x7f1378169f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:50.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.966+0000 7f13777fe700 1 -- 172.21.15.71:0/2645337848 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1370009a20 con 0x7f137815d230 2023-10-09T06:57:50.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.966+0000 7f1376ffd700 1 --2- 172.21.15.71:0/2645337848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1378159420 0x7f13780c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:50.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.966+0000 7f13777fe700 1 --2- 172.21.15.71:0/2645337848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f137815d230 0x7f13780b5880 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1378089340 tx=0x7f1370019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:50.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.966+0000 7f135effd700 1 -- 172.21.15.71:0/2645337848 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370027470 con 0x7f137815d230 2023-10-09T06:57:50.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.966+0000 7f135effd700 1 -- 172.21.15.71:0/2645337848 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13700275f0 con 0x7f137815d230 2023-10-09T06:57:50.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.966+0000 7f135effd700 1 -- 172.21.15.71:0/2645337848 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13700279b0 con 0x7f137815d230 2023-10-09T06:57:50.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.966+0000 7f1377fff700 1 -- 172.21.15.71:0/2645337848 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13780b4da0 con 0x7f137815d230 2023-10-09T06:57:50.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.966+0000 7f1377fff700 1 -- 172.21.15.71:0/2645337848 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13780c6810 con 0x7f137815d230 2023-10-09T06:57:50.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.967+0000 7f1377fff700 1 -- 172.21.15.71:0/2645337848 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137804c3c0 con 0x7f137815d230 2023-10-09T06:57:50.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.968+0000 7f135effd700 1 -- 172.21.15.71:0/2645337848 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 30) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f1370024070 con 0x7f137815d230 2023-10-09T06:57:50.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.969+0000 7f135effd700 1 --2- 172.21.15.71:0/2645337848 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f13640670e0 0x7f1364069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:50.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.969+0000 7f135effd700 1 -- 172.21.15.71:0/2645337848 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f1370087300 con 0x7f137815d230 2023-10-09T06:57:50.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.969+0000 7f1376ffd700 1 -- 172.21.15.71:0/2645337848 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f13640670e0 msgr2=0x7f1364069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:50.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.970+0000 7f1376ffd700 1 --2- 172.21.15.71:0/2645337848 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f13640670e0 0x7f1364069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:50.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:50.973+0000 7f135effd700 1 -- 172.21.15.71:0/2645337848 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1370053fc0 con 0x7f137815d230 2023-10-09T06:57:51.073 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:51.072+0000 7f91f7741180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T06:57:51.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.171+0000 7f1376ffd700 1 -- 172.21.15.71:0/2645337848 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f13640670e0 msgr2=0x7f1364069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:51.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.171+0000 7f1376ffd700 1 --2- 172.21.15.71:0/2645337848 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f13640670e0 0x7f1364069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:51.175 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:51.175+0000 7ff21f9fe180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T06:57:51.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.219+0000 7f1377fff700 1 -- 172.21.15.71:0/2645337848 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f13780b17e0 con 0x7f137815d230 2023-10-09T06:57:51.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2023-10-09T06:57:51.219+0000 7fdb445f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T06:57:51.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.224+0000 7f135effd700 1 -- 172.21.15.71:0/2645337848 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v34) v1 ==== 161+0+0 (secure 0 0 0) 0x7f13700575e0 con 0x7f137815d230 2023-10-09T06:57:51.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.227+0000 7f1377fff700 1 -- 172.21.15.71:0/2645337848 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f13640670e0 msgr2=0x7f1364069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:51.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.227+0000 7f1377fff700 1 --2- 172.21.15.71:0/2645337848 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f13640670e0 0x7f1364069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:51.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.227+0000 7f1377fff700 1 -- 172.21.15.71:0/2645337848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f137815d230 msgr2=0x7f13780b5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:51.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.227+0000 7f1377fff700 1 --2- 172.21.15.71:0/2645337848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f137815d230 0x7f13780b5880 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1378089340 tx=0x7f1370019000 comp rx=0 tx=0).stop 2023-10-09T06:57:51.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.227+0000 7f1377fff700 1 -- 172.21.15.71:0/2645337848 shutdown_connections 2023-10-09T06:57:51.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.227+0000 7f1377fff700 1 --2- 172.21.15.71:0/2645337848 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f13640670e0 0x7f1364069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:51.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.227+0000 7f1377fff700 1 --2- 172.21.15.71:0/2645337848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f137815d230 0x7f13780b5880 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:51.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.227+0000 7f1377fff700 1 --2- 172.21.15.71:0/2645337848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1378159420 0x7f13780c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:51.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.227+0000 7f1377fff700 1 --2- 172.21.15.71:0/2645337848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13781597f0 0x7f1378169f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:51.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.227+0000 7f1377fff700 1 -- 172.21.15.71:0/2645337848 >> 172.21.15.71:0/2645337848 conn(0x7f13780d0660 msgr2=0x7f13780afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:51.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.227+0000 7f1377fff700 1 -- 172.21.15.71:0/2645337848 shutdown_connections 2023-10-09T06:57:51.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.227+0000 7f1377fff700 1 -- 172.21.15.71:0/2645337848 wait complete. 2023-10-09T06:57:51.230 INFO:teuthology.orchestra.run.smithi071.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T06:57:51.232 INFO:tasks.ceph.mds.a.smithi071.stderr: -2136> 2023-10-09T06:57:32.771+0000 7f4321ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:57:51.252 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T06:57:51.271 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:51.270+0000 7ff21f9fe180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T06:57:51.300 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2023-10-09T06:57:51.380 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:51.379+0000 7f91f7741180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T06:57:51.426 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:51.426+0000 7ff21f9fe180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T06:57:51.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.440+0000 7f70b5b9d700 1 Processor -- start 2023-10-09T06:57:51.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.440+0000 7f70b5b9d700 1 -- start start 2023-10-09T06:57:51.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.441+0000 7f70b5b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f70b0159a60 0x7f70b00c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:51.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.441+0000 7f70b5b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b00cb230 0x7f70b00cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:51.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.441+0000 7f70b5b9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b00c9cb0 con 0x7f70b00ccc00 2023-10-09T06:57:51.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.441+0000 7f70b5b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b00cbbd0 con 0x7f70b0159a60 2023-10-09T06:57:51.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.441+0000 7f70b5b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b006dfc0 con 0x7f70b00cb230 2023-10-09T06:57:51.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.441+0000 7f70affff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f70b00ccc00 0x7f70b0069ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46084/0 (socket says 172.21.15.71:46084) 2023-10-09T06:57:51.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.441+0000 7f70affff700 1 -- 172.21.15.71:0/216619460 learned_addr learned my addr 172.21.15.71:0/216619460 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:51.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.442+0000 7f70b539c700 1 --2- 172.21.15.71:0/216619460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b00cb230 0x7f70b00cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:51.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.442+0000 7f70b4b9b700 1 --2- 172.21.15.71:0/216619460 >> v2:172.21.15.179:3300/0 conn(0x7f70b0159a60 0x7f70b00c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:51.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.442+0000 7f70af7fe700 1 -- 172.21.15.71:0/216619460 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167713501 0 0) 0x7f70b00c9cb0 con 0x7f70b00ccc00 2023-10-09T06:57:51.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.442+0000 7f70af7fe700 1 -- 172.21.15.71:0/216619460 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70a0003570 con 0x7f70b00ccc00 2023-10-09T06:57:51.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.442+0000 7f70b4b9b700 1 -- 172.21.15.71:0/216619460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b00cb230 msgr2=0x7f70b00cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:51.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.442+0000 7f70b4b9b700 1 --2- 172.21.15.71:0/216619460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b00cb230 0x7f70b00cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:51.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.442+0000 7f70b4b9b700 1 -- 172.21.15.71:0/216619460 >> v1:172.21.15.71:6789/0 conn(0x7f70b00ccc00 legacy=0x7f70b0069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:51.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.442+0000 7f70b4b9b700 1 -- 172.21.15.71:0/216619460 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b00c9f30 con 0x7f70b0159a60 2023-10-09T06:57:51.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.442+0000 7f70b4b9b700 1 --2- 172.21.15.71:0/216619460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b0159a60 0x7f70b00c9770 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f70a4009910 tx=0x7f70a40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81a356820e7dd819 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:51.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.443+0000 7f70af7fe700 1 -- 172.21.15.71:0/216619460 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a4011630 con 0x7f70b0159a60 2023-10-09T06:57:51.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.443+0000 7f70af7fe700 1 -- 172.21.15.71:0/216619460 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a4011790 con 0x7f70b0159a60 2023-10-09T06:57:51.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.443+0000 7f70af7fe700 1 -- 172.21.15.71:0/216619460 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a4011b10 con 0x7f70b0159a60 2023-10-09T06:57:51.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.443+0000 7f70b5b9d700 1 -- 172.21.15.71:0/216619460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b0159a60 msgr2=0x7f70b00c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:51.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.443+0000 7f70b5b9d700 1 --2- 172.21.15.71:0/216619460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b0159a60 0x7f70b00c9770 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f70a4009910 tx=0x7f70a40091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:51.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.443+0000 7f70b5b9d700 1 -- 172.21.15.71:0/216619460 shutdown_connections 2023-10-09T06:57:51.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.443+0000 7f70b5b9d700 1 --2- 172.21.15.71:0/216619460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b00cb230 0x7f70b00cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:51.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.443+0000 7f70b5b9d700 1 --2- 172.21.15.71:0/216619460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b0159a60 0x7f70b00c9770 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:51.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.443+0000 7f70b5b9d700 1 -- 172.21.15.71:0/216619460 >> 172.21.15.71:0/216619460 conn(0x7f70b006baa0 msgr2=0x7f70b006bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:51.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.443+0000 7f70b5b9d700 1 -- 172.21.15.71:0/216619460 shutdown_connections 2023-10-09T06:57:51.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.443+0000 7f70b5b9d700 1 -- 172.21.15.71:0/216619460 wait complete. 2023-10-09T06:57:51.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.445+0000 7f70b5b9d700 1 Processor -- start 2023-10-09T06:57:51.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.445+0000 7f70b5b9d700 1 -- start start 2023-10-09T06:57:51.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.446+0000 7f70b5b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b00cb230 0x7f70b014a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:51.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.446+0000 7f70b5b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b00ccc00 0x7f70b00a9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:51.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.446+0000 7f70b5b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70b0159a60 0x7f70b00a9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:51.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.446+0000 7f70b5b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b00c6cd0 con 0x7f70b0159a60 2023-10-09T06:57:51.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.446+0000 7f70b5b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b00c63a0 con 0x7f70b00ccc00 2023-10-09T06:57:51.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.446+0000 7f70b5b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b00c6680 con 0x7f70b00cb230 2023-10-09T06:57:51.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.446+0000 7f70b539c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70b0159a60 0x7f70b00a9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:51.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.446+0000 7f70b4b9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b00cb230 0x7f70b014a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:51.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.446+0000 7f70b539c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70b0159a60 0x7f70b00a9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55906/0 (socket says 172.21.15.71:55906) 2023-10-09T06:57:51.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.446+0000 7f70affff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b00ccc00 0x7f70b00a9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:51.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.446+0000 7f70b539c700 1 -- 172.21.15.71:0/94800508 learned_addr learned my addr 172.21.15.71:0/94800508 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:51.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.447+0000 7f70affff700 1 -- 172.21.15.71:0/94800508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b00cb230 msgr2=0x7f70b014a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:51.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.447+0000 7f70affff700 1 --2- 172.21.15.71:0/94800508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b00cb230 0x7f70b014a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:51.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.447+0000 7f70affff700 1 -- 172.21.15.71:0/94800508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70b0159a60 msgr2=0x7f70b00a9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:51.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.447+0000 7f70affff700 1 --2- 172.21.15.71:0/94800508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70b0159a60 0x7f70b00a9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:51.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.447+0000 7f70affff700 1 -- 172.21.15.71:0/94800508 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a4009420 con 0x7f70b00ccc00 2023-10-09T06:57:51.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.447+0000 7f70affff700 1 --2- 172.21.15.71:0/94800508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b00ccc00 0x7f70b00a9a20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f709c0058d0 tx=0x7f709c007d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:51.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.447+0000 7f70acff9700 1 -- 172.21.15.71:0/94800508 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c005b30 con 0x7f70b00ccc00 2023-10-09T06:57:51.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.447+0000 7f70acff9700 1 -- 172.21.15.71:0/94800508 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709c005cd0 con 0x7f70b00ccc00 2023-10-09T06:57:51.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.447+0000 7f70b5b9d700 1 -- 172.21.15.71:0/94800508 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b00c6960 con 0x7f70b00ccc00 2023-10-09T06:57:51.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.447+0000 7f70acff9700 1 -- 172.21.15.71:0/94800508 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c007320 con 0x7f70b00ccc00 2023-10-09T06:57:51.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.447+0000 7f70b5b9d700 1 -- 172.21.15.71:0/94800508 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b00b3120 con 0x7f70b00ccc00 2023-10-09T06:57:51.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.448+0000 7f70b5b9d700 1 -- 172.21.15.71:0/94800508 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b00c6e80 con 0x7f70b00ccc00 2023-10-09T06:57:51.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.449+0000 7f70acff9700 1 -- 172.21.15.71:0/94800508 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 30) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f709c007690 con 0x7f70b00ccc00 2023-10-09T06:57:51.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.450+0000 7f70acff9700 1 --2- 172.21.15.71:0/94800508 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f70940670e0 0x7f7094069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:51.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.450+0000 7f70acff9700 1 -- 172.21.15.71:0/94800508 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6441+0+0 (secure 0 0 0) 0x7f709c083df0 con 0x7f70b00ccc00 2023-10-09T06:57:51.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.450+0000 7f70b4b9b700 1 -- 172.21.15.71:0/94800508 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f70940670e0 msgr2=0x7f7094069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:51.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.450+0000 7f70b4b9b700 1 --2- 172.21.15.71:0/94800508 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f70940670e0 0x7f7094069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:57:51.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.455+0000 7f70acff9700 1 -- 172.21.15.71:0/94800508 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f709c04b5a0 con 0x7f70b00ccc00 2023-10-09T06:57:51.479 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:51.478+0000 7f91f7741180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T06:57:51.533 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:51.532+0000 7ff21f9fe180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T06:57:51.637 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:51.636+0000 7f91f7741180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T06:57:51.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.651+0000 7f70b4b9b700 1 -- 172.21.15.71:0/94800508 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f70940670e0 msgr2=0x7f7094069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:57:51.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.651+0000 7f70b4b9b700 1 --2- 172.21.15.71:0/94800508 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f70940670e0 0x7f7094069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:57:51.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:51.698+0000 7f70b5b9d700 1 -- 172.21.15.71:0/94800508 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f70b00ca470 con 0x7f70b00ccc00 2023-10-09T06:57:51.722 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:51.722+0000 7ff21f9fe180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T06:57:51.745 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:51.744+0000 7f91f7741180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T06:57:51.815 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:51.815+0000 7ff21f9fe180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T06:57:51.910 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:51.909+0000 7ff21f9fe180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T06:57:51.936 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:51.935+0000 7f91f7741180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T06:57:52.004 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:52.004+0000 7ff21f9fe180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T06:57:52.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.014+0000 7f70acff9700 1 -- 172.21.15.71:0/94800508 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mgrmap(e 31) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f709c050ee0 con 0x7f70b00ccc00 2023-10-09T06:57:52.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.014+0000 7f70acff9700 1 -- 172.21.15.71:0/94800508 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f70940670e0 msgr2=0x7f7094069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:57:52.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.014+0000 7f70acff9700 1 --2- 172.21.15.71:0/94800508 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f70940670e0 0x7f7094069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:52.033 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:52.032+0000 7f91f7741180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T06:57:52.085 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:52.085+0000 7ff19e049700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:52.086 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:52.085+0000 7ff19e049700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:52.086 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:52.085+0000 7ff19e049700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:52.086 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:52.085+0000 7ff19e049700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:52.086 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:52.085+0000 7ff19e049700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:52.087 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:52.086+0000 7ff19a041700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:52.087 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:52.086+0000 7ff19a041700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:52.087 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:52.086+0000 7ff19a041700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:52.087 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:52.086+0000 7ff19a041700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:52.087 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:57:52.086+0000 7ff19a041700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:57:52.132 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:52.131+0000 7f91f7741180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T06:57:52.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.225+0000 7f70acff9700 1 -- 172.21.15.71:0/94800508 <== mon.1 v2:172.21.15.179:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v35) v1 ==== 104+0+0 (secure 0 0 0) 0x7f709c07f690 con 0x7f70b00ccc00 2023-10-09T06:57:52.226 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:57:52.225+0000 7f91f7741180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T06:57:52.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.228+0000 7f70b5b9d700 1 -- 172.21.15.71:0/94800508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b00ccc00 msgr2=0x7f70b00a9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:52.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.228+0000 7f70b5b9d700 1 --2- 172.21.15.71:0/94800508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b00ccc00 0x7f70b00a9a20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f709c0058d0 tx=0x7f709c007d10 comp rx=0 tx=0).stop 2023-10-09T06:57:52.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.228+0000 7f70b5b9d700 1 -- 172.21.15.71:0/94800508 shutdown_connections 2023-10-09T06:57:52.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.228+0000 7f70b5b9d700 1 --2- 172.21.15.71:0/94800508 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f70940670e0 0x7f7094069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:52.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.228+0000 7f70b5b9d700 1 --2- 172.21.15.71:0/94800508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70b0159a60 0x7f70b00a9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:52.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.228+0000 7f70b5b9d700 1 --2- 172.21.15.71:0/94800508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b00cb230 0x7f70b014a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:52.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.228+0000 7f70b5b9d700 1 --2- 172.21.15.71:0/94800508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b00ccc00 0x7f70b00a9a20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:52.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.228+0000 7f70b5b9d700 1 -- 172.21.15.71:0/94800508 >> 172.21.15.71:0/94800508 conn(0x7f70b006baa0 msgr2=0x7f70b00ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:52.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.228+0000 7f70b5b9d700 1 -- 172.21.15.71:0/94800508 shutdown_connections 2023-10-09T06:57:52.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.228+0000 7f70b5b9d700 1 -- 172.21.15.71:0/94800508 wait complete. 2023-10-09T06:57:52.248 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T06:57:52.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.431+0000 7fb29a3ff700 1 Processor -- start 2023-10-09T06:57:52.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.431+0000 7fb29a3ff700 1 -- start start 2023-10-09T06:57:52.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.433+0000 7fb29a3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb294069a50 0x7fb2940c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:52.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.433+0000 7fb29a3ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb294069e20 0x7fb2941569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:52.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.433+0000 7fb29a3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2940ac030 con 0x7fb2940c8490 2023-10-09T06:57:52.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.433+0000 7fb29a3ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2940ab820 con 0x7fb294069e20 2023-10-09T06:57:52.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.433+0000 7fb29a3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb29406dbb0 con 0x7fb294069a50 2023-10-09T06:57:52.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.433+0000 7fb29899c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb294069e20 0x7fb2941569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:52.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.433+0000 7fb29899c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb294069e20 0x7fb2941569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55920/0 (socket says 172.21.15.71:55920) 2023-10-09T06:57:52.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.433+0000 7fb29899c700 1 -- 172.21.15.71:0/1587883532 learned_addr learned my addr 172.21.15.71:0/1587883532 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:52.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.433+0000 7fb293fff700 1 --2- 172.21.15.71:0/1587883532 >> v2:172.21.15.179:3300/0 conn(0x7fb294069a50 0x7fb2940c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:52.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.434+0000 7fb29899c700 1 -- 172.21.15.71:0/1587883532 >> v2:172.21.15.179:3300/0 conn(0x7fb294069a50 msgr2=0x7fb2940c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:52.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.434+0000 7fb29899c700 1 --2- 172.21.15.71:0/1587883532 >> v2:172.21.15.179:3300/0 conn(0x7fb294069a50 0x7fb2940c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:52.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.434+0000 7fb29899c700 1 -- 172.21.15.71:0/1587883532 >> v1:172.21.15.179:6789/0 conn(0x7fb2940c8490 legacy=0x7fb29415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:52.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.434+0000 7fb29899c700 1 -- 172.21.15.71:0/1587883532 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2940aba70 con 0x7fb294069e20 2023-10-09T06:57:52.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.434+0000 7fb293fff700 1 --2- 172.21.15.71:0/1587883532 >> v2:172.21.15.179:3300/0 conn(0x7fb294069a50 0x7fb2940c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:52.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.434+0000 7fb29899c700 1 --2- 172.21.15.71:0/1587883532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb294069e20 0x7fb2941569b0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb29406b970 tx=0x7fb28c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7a52fbe9d6520d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:52.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.434+0000 7fb2937fe700 1 -- 172.21.15.71:0/1587883532 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c0092e0 con 0x7fb294069e20 2023-10-09T06:57:52.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.434+0000 7fb2937fe700 1 -- 172.21.15.71:0/1587883532 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c00ba50 con 0x7fb294069e20 2023-10-09T06:57:52.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.434+0000 7fb2937fe700 1 -- 172.21.15.71:0/1587883532 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c00be10 con 0x7fb294069e20 2023-10-09T06:57:52.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.435+0000 7fb29a3ff700 1 -- 172.21.15.71:0/1587883532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb294069e20 msgr2=0x7fb2941569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:52.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.435+0000 7fb29a3ff700 1 --2- 172.21.15.71:0/1587883532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb294069e20 0x7fb2941569b0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb29406b970 tx=0x7fb28c009840 comp rx=0 tx=0).stop 2023-10-09T06:57:52.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.435+0000 7fb29a3ff700 1 -- 172.21.15.71:0/1587883532 shutdown_connections 2023-10-09T06:57:52.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.435+0000 7fb29a3ff700 1 --2- 172.21.15.71:0/1587883532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb294069e20 0x7fb2941569b0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:52.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.435+0000 7fb29a3ff700 1 --2- 172.21.15.71:0/1587883532 >> v2:172.21.15.179:3300/0 conn(0x7fb294069a50 0x7fb2940c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:52.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.435+0000 7fb29a3ff700 1 -- 172.21.15.71:0/1587883532 >> 172.21.15.71:0/1587883532 conn(0x7fb2940c8f90 msgr2=0x7fb2940c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:52.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.435+0000 7fb29a3ff700 1 -- 172.21.15.71:0/1587883532 shutdown_connections 2023-10-09T06:57:52.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.435+0000 7fb29a3ff700 1 -- 172.21.15.71:0/1587883532 wait complete. 2023-10-09T06:57:52.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.436+0000 7fb29a3ff700 1 Processor -- start 2023-10-09T06:57:52.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.436+0000 7fb29a3ff700 1 -- start start 2023-10-09T06:57:52.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.437+0000 7fb29a3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb294069a50 0x7fb2940b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:52.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.437+0000 7fb29a3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb294069e20 0x7fb294154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:52.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.437+0000 7fb29a3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2940c8490 0x7fb2940c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:52.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.437+0000 7fb29a3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2940c6ce0 con 0x7fb294069a50 2023-10-09T06:57:52.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.437+0000 7fb29a3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2940af2d0 con 0x7fb2940c8490 2023-10-09T06:57:52.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.437+0000 7fb29a3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2940afb70 con 0x7fb294069e20 2023-10-09T06:57:52.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.437+0000 7fb293fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb294069a50 0x7fb2940b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:52.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.438+0000 7fb293fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb294069a50 0x7fb2940b0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55926/0 (socket says 172.21.15.71:55926) 2023-10-09T06:57:52.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.438+0000 7fb293fff700 1 -- 172.21.15.71:0/2730343831 learned_addr learned my addr 172.21.15.71:0/2730343831 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:52.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.438+0000 7fb29899c700 1 --2- 172.21.15.71:0/2730343831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2940c8490 0x7fb2940c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:52.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.438+0000 7fb28bfff700 1 --2- 172.21.15.71:0/2730343831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb294069e20 0x7fb294154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:52.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.438+0000 7fb293fff700 1 -- 172.21.15.71:0/2730343831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb294069e20 msgr2=0x7fb294154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:52.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.438+0000 7fb293fff700 1 --2- 172.21.15.71:0/2730343831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb294069e20 0x7fb294154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:52.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.438+0000 7fb293fff700 1 -- 172.21.15.71:0/2730343831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2940c8490 msgr2=0x7fb2940c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:52.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.438+0000 7fb293fff700 1 --2- 172.21.15.71:0/2730343831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2940c8490 0x7fb2940c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:52.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.438+0000 7fb293fff700 1 -- 172.21.15.71:0/2730343831 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c009ae0 con 0x7fb294069a50 2023-10-09T06:57:52.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.438+0000 7fb293fff700 1 --2- 172.21.15.71:0/2730343831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb294069a50 0x7fb2940b0000 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fb28400d890 tx=0x7fb284008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:52.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.438+0000 7fb290ff9700 1 -- 172.21.15.71:0/2730343831 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2840125f0 con 0x7fb294069a50 2023-10-09T06:57:52.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.438+0000 7fb290ff9700 1 -- 172.21.15.71:0/2730343831 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb284012750 con 0x7fb294069a50 2023-10-09T06:57:52.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.438+0000 7fb29a3ff700 1 -- 172.21.15.71:0/2730343831 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2940c2830 con 0x7fb294069a50 2023-10-09T06:57:52.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.439+0000 7fb290ff9700 1 -- 172.21.15.71:0/2730343831 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb284012af0 con 0x7fb294069a50 2023-10-09T06:57:52.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.439+0000 7fb29a3ff700 1 -- 172.21.15.71:0/2730343831 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2940af800 con 0x7fb294069a50 2023-10-09T06:57:52.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.439+0000 7fb29a3ff700 1 -- 172.21.15.71:0/2730343831 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2940718b0 con 0x7fb294069a50 2023-10-09T06:57:52.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.440+0000 7fb290ff9700 1 -- 172.21.15.71:0/2730343831 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 31) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fb284014430 con 0x7fb294069a50 2023-10-09T06:57:52.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.442+0000 7fb290ff9700 1 -- 172.21.15.71:0/2730343831 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6742+0+0 (secure 0 0 0) 0x7fb284084870 con 0x7fb294069a50 2023-10-09T06:57:52.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.446+0000 7fb290ff9700 1 -- 172.21.15.71:0/2730343831 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2840519a0 con 0x7fb294069a50 2023-10-09T06:57:52.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:52.636+0000 7fb29a3ff700 1 -- 172.21.15.71:0/2730343831 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb294068e00 con 0x7fb294069a50 2023-10-09T06:57:53.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.017+0000 7fb290ff9700 1 -- 172.21.15.71:0/2730343831 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 32) v1 ==== 84578+0+0 (secure 0 0 0) 0x7fb284051450 con 0x7fb294069a50 2023-10-09T06:57:53.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.017+0000 7fb290ff9700 1 --2- 172.21.15.71:0/2730343831 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb27406c9e0 0x7fb27406edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:53.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.020+0000 7fb28bfff700 1 --2- 172.21.15.71:0/2730343831 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb27406c9e0 0x7fb27406edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:53.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.024+0000 7fb28bfff700 1 --2- 172.21.15.71:0/2730343831 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb27406c9e0 0x7fb27406edc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb29406fa40 tx=0x7fb27c007ec0 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:53.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.227+0000 7fb290ff9700 1 -- 172.21.15.71:0/2730343831 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v83) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb284070250 con 0x7fb294069a50 2023-10-09T06:57:53.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.230+0000 7fb29a3ff700 1 -- 172.21.15.71:0/2730343831 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb27406c9e0 msgr2=0x7fb27406edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:53.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.230+0000 7fb29a3ff700 1 --2- 172.21.15.71:0/2730343831 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb27406c9e0 0x7fb27406edc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb29406fa40 tx=0x7fb27c007ec0 comp rx=0 tx=0).stop 2023-10-09T06:57:53.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.230+0000 7fb29a3ff700 1 -- 172.21.15.71:0/2730343831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb294069a50 msgr2=0x7fb2940b0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:53.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.230+0000 7fb29a3ff700 1 --2- 172.21.15.71:0/2730343831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb294069a50 0x7fb2940b0000 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fb28400d890 tx=0x7fb284008040 comp rx=0 tx=0).stop 2023-10-09T06:57:53.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.230+0000 7fb29a3ff700 1 -- 172.21.15.71:0/2730343831 shutdown_connections 2023-10-09T06:57:53.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.230+0000 7fb29a3ff700 1 --2- 172.21.15.71:0/2730343831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2940c8490 0x7fb2940c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:53.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.230+0000 7fb29a3ff700 1 --2- 172.21.15.71:0/2730343831 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb27406c9e0 0x7fb27406edc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:53.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.230+0000 7fb29a3ff700 1 --2- 172.21.15.71:0/2730343831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb294069a50 0x7fb2940b0000 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:53.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.230+0000 7fb29a3ff700 1 --2- 172.21.15.71:0/2730343831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb294069e20 0x7fb294154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:53.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.230+0000 7fb29a3ff700 1 -- 172.21.15.71:0/2730343831 >> 172.21.15.71:0/2730343831 conn(0x7fb2940c8f90 msgr2=0x7fb2940c9570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:53.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.231+0000 7fb29a3ff700 1 -- 172.21.15.71:0/2730343831 shutdown_connections 2023-10-09T06:57:53.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.231+0000 7fb29a3ff700 1 -- 172.21.15.71:0/2730343831 wait complete. 2023-10-09T06:57:53.233 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' removed 2023-10-09T06:57:53.250 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T06:57:53.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.433+0000 7f1b2499d700 1 Processor -- start 2023-10-09T06:57:53.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.434+0000 7f1b2499d700 1 -- start start 2023-10-09T06:57:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.435+0000 7f1b2499d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1b20156350 0x7f1b20157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.435+0000 7f1b2499d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1b200b0760 0x7f1b200b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.435+0000 7f1b2499d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b200b0570 con 0x7f1b20159f20 2023-10-09T06:57:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.435+0000 7f1b2499d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b200b1140 con 0x7f1b200b0760 2023-10-09T06:57:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.435+0000 7f1b2499d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b201578b0 con 0x7f1b20156350 2023-10-09T06:57:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.435+0000 7f1b1effd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1b200b0760 0x7f1b200b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:53.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.435+0000 7f1b1effd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1b200b0760 0x7f1b200b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55938/0 (socket says 172.21.15.71:55938) 2023-10-09T06:57:53.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.435+0000 7f1b1effd700 1 -- 172.21.15.71:0/922092536 learned_addr learned my addr 172.21.15.71:0/922092536 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:53.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.435+0000 7f1b1f7fe700 1 --2- 172.21.15.71:0/922092536 >> v2:172.21.15.179:3300/0 conn(0x7f1b20156350 0x7f1b20157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:53.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.436+0000 7f1b1effd700 1 -- 172.21.15.71:0/922092536 >> v2:172.21.15.179:3300/0 conn(0x7f1b20156350 msgr2=0x7f1b20157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:53.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.436+0000 7f1b1effd700 1 --2- 172.21.15.71:0/922092536 >> v2:172.21.15.179:3300/0 conn(0x7f1b20156350 0x7f1b20157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:53.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.436+0000 7f1b1effd700 1 -- 172.21.15.71:0/922092536 >> v1:172.21.15.179:6789/0 conn(0x7f1b20159f20 legacy=0x7f1b2015a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:53.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.436+0000 7f1b1effd700 1 -- 172.21.15.71:0/922092536 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b200af4d0 con 0x7f1b200b0760 2023-10-09T06:57:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.436+0000 7f1b1effd700 1 --2- 172.21.15.71:0/922092536 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b200b0760 0x7f1b200b0c00 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1b20065950 tx=0x7f1b14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b8b13e2a184aa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.436+0000 7f1b1e7fc700 1 -- 172.21.15.71:0/922092536 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b14009e70 con 0x7f1b200b0760 2023-10-09T06:57:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.436+0000 7f1b1e7fc700 1 -- 172.21.15.71:0/922092536 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1400b860 con 0x7f1b200b0760 2023-10-09T06:57:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.436+0000 7f1b1e7fc700 1 -- 172.21.15.71:0/922092536 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1400bc00 con 0x7f1b200b0760 2023-10-09T06:57:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.437+0000 7f1b2499d700 1 -- 172.21.15.71:0/922092536 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b200b0760 msgr2=0x7f1b200b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.437+0000 7f1b2499d700 1 --2- 172.21.15.71:0/922092536 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b200b0760 0x7f1b200b0c00 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1b20065950 tx=0x7f1b14009250 comp rx=0 tx=0).stop 2023-10-09T06:57:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.437+0000 7f1b2499d700 1 -- 172.21.15.71:0/922092536 shutdown_connections 2023-10-09T06:57:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.437+0000 7f1b2499d700 1 --2- 172.21.15.71:0/922092536 >> v2:172.21.15.179:3300/0 conn(0x7f1b20156350 0x7f1b20157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.437+0000 7f1b2499d700 1 --2- 172.21.15.71:0/922092536 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b200b0760 0x7f1b200b0c00 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.437+0000 7f1b2499d700 1 -- 172.21.15.71:0/922092536 >> 172.21.15.71:0/922092536 conn(0x7f1b20068e20 msgr2=0x7f1b200cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.437+0000 7f1b2499d700 1 -- 172.21.15.71:0/922092536 shutdown_connections 2023-10-09T06:57:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.437+0000 7f1b2499d700 1 -- 172.21.15.71:0/922092536 wait complete. 2023-10-09T06:57:53.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.438+0000 7f1b2499d700 1 Processor -- start 2023-10-09T06:57:53.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.438+0000 7f1b2499d700 1 -- start start 2023-10-09T06:57:53.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.439+0000 7f1b2499d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b200b0760 0x7f1b2016d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:53.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.439+0000 7f1b2499d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b20156350 0x7f1b200ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:53.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.439+0000 7f1b2499d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b20159f20 0x7f1b200c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:53.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.439+0000 7f1b2499d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b20151620 con 0x7f1b20156350 2023-10-09T06:57:53.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.439+0000 7f1b2499d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200ad6e0 con 0x7f1b20159f20 2023-10-09T06:57:53.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.439+0000 7f1b2499d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200acad0 con 0x7f1b200b0760 2023-10-09T06:57:53.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.440+0000 7f1b1effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b20156350 0x7f1b200ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:53.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.440+0000 7f1b1effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b20156350 0x7f1b200ae0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55950/0 (socket says 172.21.15.71:55950) 2023-10-09T06:57:53.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.440+0000 7f1b1effd700 1 -- 172.21.15.71:0/2580979108 learned_addr learned my addr 172.21.15.71:0/2580979108 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:53.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.440+0000 7f1b1f7fe700 1 --2- 172.21.15.71:0/2580979108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b200b0760 0x7f1b2016d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:53.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.440+0000 7f1b1ffff700 1 --2- 172.21.15.71:0/2580979108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b20159f20 0x7f1b200c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:53.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.440+0000 7f1b1effd700 1 -- 172.21.15.71:0/2580979108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b200b0760 msgr2=0x7f1b2016d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:53.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.440+0000 7f1b1effd700 1 --2- 172.21.15.71:0/2580979108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b200b0760 0x7f1b2016d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:53.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.440+0000 7f1b1effd700 1 -- 172.21.15.71:0/2580979108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b20159f20 msgr2=0x7f1b200c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:53.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.440+0000 7f1b1effd700 1 --2- 172.21.15.71:0/2580979108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b20159f20 0x7f1b200c9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:53.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.440+0000 7f1b1effd700 1 -- 172.21.15.71:0/2580979108 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b140094f0 con 0x7f1b20156350 2023-10-09T06:57:53.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.440+0000 7f1b1effd700 1 --2- 172.21.15.71:0/2580979108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b20156350 0x7f1b200ae0d0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1b200714a0 tx=0x7f1b14017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:53.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.440+0000 7f1b077fe700 1 -- 172.21.15.71:0/2580979108 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b14011420 con 0x7f1b20156350 2023-10-09T06:57:53.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.440+0000 7f1b077fe700 1 -- 172.21.15.71:0/2580979108 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b14011580 con 0x7f1b20156350 2023-10-09T06:57:53.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.440+0000 7f1b2499d700 1 -- 172.21.15.71:0/2580979108 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b200acdb0 con 0x7f1b20156350 2023-10-09T06:57:53.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.440+0000 7f1b077fe700 1 -- 172.21.15.71:0/2580979108 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b14011940 con 0x7f1b20156350 2023-10-09T06:57:53.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.441+0000 7f1b2499d700 1 -- 172.21.15.71:0/2580979108 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b200ad370 con 0x7f1b20156350 2023-10-09T06:57:53.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.441+0000 7f1b2499d700 1 -- 172.21.15.71:0/2580979108 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2004c3c0 con 0x7f1b20156350 2023-10-09T06:57:53.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.442+0000 7f1b077fe700 1 -- 172.21.15.71:0/2580979108 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 32) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f1b1402c3b0 con 0x7f1b20156350 2023-10-09T06:57:53.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.443+0000 7f1b077fe700 1 --2- 172.21.15.71:0/2580979108 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1b0c066d80 0x7f1b0c069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:53.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.443+0000 7f1b077fe700 1 -- 172.21.15.71:0/2580979108 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f1b14085a00 con 0x7f1b20156350 2023-10-09T06:57:53.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.444+0000 7f1b1f7fe700 1 --2- 172.21.15.71:0/2580979108 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1b0c066d80 0x7f1b0c069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:53.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.444+0000 7f1b1f7fe700 1 --2- 172.21.15.71:0/2580979108 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1b0c066d80 0x7f1b0c069230 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1b20159a30 tx=0x7f1b10008040 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:53.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.448+0000 7f1b077fe700 1 -- 172.21.15.71:0/2580979108 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b14052cd0 con 0x7f1b20156350 2023-10-09T06:57:53.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:53.638+0000 7f1b2499d700 1 -- 172.21.15.71:0/2580979108 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1b200af7b0 con 0x7f1b20156350 2023-10-09T06:57:54.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.232+0000 7f1b077fe700 1 -- 172.21.15.71:0/2580979108 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v84) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1b140150d0 con 0x7f1b20156350 2023-10-09T06:57:54.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.237+0000 7f1b2499d700 1 -- 172.21.15.71:0/2580979108 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1b0c066d80 msgr2=0x7f1b0c069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:54.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.237+0000 7f1b2499d700 1 --2- 172.21.15.71:0/2580979108 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1b0c066d80 0x7f1b0c069230 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1b20159a30 tx=0x7f1b10008040 comp rx=0 tx=0).stop 2023-10-09T06:57:54.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.237+0000 7f1b2499d700 1 -- 172.21.15.71:0/2580979108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b20156350 msgr2=0x7f1b200ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:54.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.237+0000 7f1b2499d700 1 --2- 172.21.15.71:0/2580979108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b20156350 0x7f1b200ae0d0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1b200714a0 tx=0x7f1b14017000 comp rx=0 tx=0).stop 2023-10-09T06:57:54.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.237+0000 7f1b2499d700 1 -- 172.21.15.71:0/2580979108 shutdown_connections 2023-10-09T06:57:54.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.237+0000 7f1b2499d700 1 --2- 172.21.15.71:0/2580979108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b20159f20 0x7f1b200c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:54.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.237+0000 7f1b2499d700 1 --2- 172.21.15.71:0/2580979108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b200b0760 0x7f1b2016d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:54.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.237+0000 7f1b2499d700 1 --2- 172.21.15.71:0/2580979108 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1b0c066d80 0x7f1b0c069230 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:54.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.237+0000 7f1b2499d700 1 --2- 172.21.15.71:0/2580979108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b20156350 0x7f1b200ae0d0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:54.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.237+0000 7f1b2499d700 1 -- 172.21.15.71:0/2580979108 >> 172.21.15.71:0/2580979108 conn(0x7f1b20068e20 msgr2=0x7f1b20156720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:54.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.238+0000 7f1b2499d700 1 -- 172.21.15.71:0/2580979108 shutdown_connections 2023-10-09T06:57:54.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.238+0000 7f1b2499d700 1 -- 172.21.15.71:0/2580979108 wait complete. 2023-10-09T06:57:54.240 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' removed 2023-10-09T06:57:54.258 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T06:57:54.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.440+0000 7f3d05d9d700 1 Processor -- start 2023-10-09T06:57:54.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.441+0000 7f3d05d9d700 1 -- start start 2023-10-09T06:57:54.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.442+0000 7f3d05d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3d000aac80 0x7f3d000ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:54.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.442+0000 7f3d05d9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d000c89a0 con 0x7f3d00159a10 2023-10-09T06:57:54.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.442+0000 7f3d05d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d000c7510 con 0x7f3d00159de0 2023-10-09T06:57:54.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.442+0000 7f3d05d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d000caee0 con 0x7f3d000aac80 2023-10-09T06:57:54.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.442+0000 7f3d04d9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3d00159a10 0x7f3d000c81e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46096/0 (socket says 172.21.15.71:46096) 2023-10-09T06:57:54.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.442+0000 7f3d04d9b700 1 -- 172.21.15.71:0/1265262996 learned_addr learned my addr 172.21.15.71:0/1265262996 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:54.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.442+0000 7f3cfffff700 1 --2- 172.21.15.71:0/1265262996 >> v2:172.21.15.179:3300/0 conn(0x7f3d000aac80 0x7f3d000ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:54.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.443+0000 7f3cff7fe700 1 -- 172.21.15.71:0/1265262996 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163551698 0 0) 0x7f3d000c89a0 con 0x7f3d00159a10 2023-10-09T06:57:54.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.443+0000 7f3cff7fe700 1 -- 172.21.15.71:0/1265262996 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cf0003570 con 0x7f3d00159a10 2023-10-09T06:57:54.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.443+0000 7f3cff7fe700 1 -- 172.21.15.71:0/1265262996 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663898219 0 0) 0x7f3d000c7510 con 0x7f3d00159de0 2023-10-09T06:57:54.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.443+0000 7f3cff7fe700 1 -- 172.21.15.71:0/1265262996 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d000c89a0 con 0x7f3d00159de0 2023-10-09T06:57:54.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.443+0000 7f3cff7fe700 1 -- 172.21.15.71:0/1265262996 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 558196746 0 0) 0x7f3cf0003570 con 0x7f3d00159a10 2023-10-09T06:57:54.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.443+0000 7f3cff7fe700 1 -- 172.21.15.71:0/1265262996 >> v2:172.21.15.179:3300/0 conn(0x7f3d000aac80 msgr2=0x7f3d000ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:54.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.443+0000 7f3cff7fe700 1 --2- 172.21.15.71:0/1265262996 >> v2:172.21.15.179:3300/0 conn(0x7f3d000aac80 0x7f3d000ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:54.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.443+0000 7f3cff7fe700 1 -- 172.21.15.71:0/1265262996 >> v1:172.21.15.179:6789/0 conn(0x7f3d00159de0 legacy=0x7f3d0015a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:54.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.443+0000 7f3cff7fe700 1 -- 172.21.15.71:0/1265262996 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d000c77f0 con 0x7f3d00159a10 2023-10-09T06:57:54.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.443+0000 7f3cff7fe700 1 -- 172.21.15.71:0/1265262996 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f3cf4001470 con 0x7f3d00159a10 2023-10-09T06:57:54.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.443+0000 7f3cfffff700 1 --2- 172.21.15.71:0/1265262996 >> v2:172.21.15.179:3300/0 conn(0x7f3d000aac80 0x7f3d000ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:57:54.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.443+0000 7f3cff7fe700 1 -- 172.21.15.71:0/1265262996 >> v1:172.21.15.71:6789/0 conn(0x7f3d00159a10 legacy=0x7f3d000c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:54.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.443+0000 7f3cff7fe700 1 --2- 172.21.15.71:0/1265262996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cf0003c40 0x7f3cf0004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:54.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.443+0000 7f3cff7fe700 1 --2- 172.21.15.71:0/1265262996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cf0004810 0x7f3cf0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:54.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.443+0000 7f3cff7fe700 1 --2- 172.21.15.71:0/1265262996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cf0005210 0x7f3cf000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:54.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.443+0000 7f3cff7fe700 1 -- 172.21.15.71:0/1265262996 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf000c130 con 0x7f3cf0005210 2023-10-09T06:57:54.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.443+0000 7f3cff7fe700 1 -- 172.21.15.71:0/1265262996 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf000c270 con 0x7f3cf0004810 2023-10-09T06:57:54.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.443+0000 7f3cff7fe700 1 -- 172.21.15.71:0/1265262996 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf000c400 con 0x7f3cf0003c40 2023-10-09T06:57:54.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.443+0000 7f3d0559c700 1 --2- 172.21.15.71:0/1265262996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cf0005210 0x7f3cf000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:54.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.444+0000 7f3cfffff700 1 --2- 172.21.15.71:0/1265262996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cf0004810 0x7f3cf0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:54.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.444+0000 7f3d04d9b700 1 --2- 172.21.15.71:0/1265262996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cf0003c40 0x7f3cf0004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:54.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.444+0000 7f3d0559c700 1 -- 172.21.15.71:0/1265262996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cf0003c40 msgr2=0x7f3cf0004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:54.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.444+0000 7f3d0559c700 1 --2- 172.21.15.71:0/1265262996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cf0003c40 0x7f3cf0004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:54.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.444+0000 7f3d0559c700 1 -- 172.21.15.71:0/1265262996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cf0004810 msgr2=0x7f3cf0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:54.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.444+0000 7f3d0559c700 1 --2- 172.21.15.71:0/1265262996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cf0004810 0x7f3cf0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:54.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.444+0000 7f3d0559c700 1 -- 172.21.15.71:0/1265262996 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf0003570 con 0x7f3cf0005210 2023-10-09T06:57:54.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.444+0000 7f3cfffff700 1 --2- 172.21.15.71:0/1265262996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cf0004810 0x7f3cf0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:57:54.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.444+0000 7f3d0559c700 1 -- 172.21.15.71:0/1265262996 reap_dead start 2023-10-09T06:57:54.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.444+0000 7f3d0559c700 1 --2- 172.21.15.71:0/1265262996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cf0005210 0x7f3cf000ba60 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8002150 tx=0x7f3cf80017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77fbc8df0693f0c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:54.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.444+0000 7f3cff7fe700 1 -- 172.21.15.71:0/1265262996 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8001ab0 con 0x7f3cf0005210 2023-10-09T06:57:54.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.444+0000 7f3cff7fe700 1 -- 172.21.15.71:0/1265262996 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf800c940 con 0x7f3cf0005210 2023-10-09T06:57:54.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.444+0000 7f3cff7fe700 1 -- 172.21.15.71:0/1265262996 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf800ccc0 con 0x7f3cf0005210 2023-10-09T06:57:54.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.445+0000 7f3d05d9d700 1 -- 172.21.15.71:0/1265262996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cf0005210 msgr2=0x7f3cf000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:54.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.445+0000 7f3d05d9d700 1 --2- 172.21.15.71:0/1265262996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cf0005210 0x7f3cf000ba60 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8002150 tx=0x7f3cf80017a0 comp rx=0 tx=0).stop 2023-10-09T06:57:54.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.445+0000 7f3d05d9d700 1 -- 172.21.15.71:0/1265262996 shutdown_connections 2023-10-09T06:57:54.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.445+0000 7f3d05d9d700 1 --2- 172.21.15.71:0/1265262996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cf0005210 0x7f3cf000ba60 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:54.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.445+0000 7f3d05d9d700 1 -- 172.21.15.71:0/1265262996 >> 172.21.15.71:0/1265262996 conn(0x7f3d000cc1e0 msgr2=0x7f3d000cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:54.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.445+0000 7f3d05d9d700 1 -- 172.21.15.71:0/1265262996 shutdown_connections 2023-10-09T06:57:54.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.445+0000 7f3d05d9d700 1 -- 172.21.15.71:0/1265262996 wait complete. 2023-10-09T06:57:54.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.446+0000 7f3d05d9d700 1 Processor -- start 2023-10-09T06:57:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.447+0000 7f3d05d9d700 1 -- start start 2023-10-09T06:57:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.447+0000 7f3d05d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cf0005210 0x7f3d000abae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.447+0000 7f3d05d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d000afbe0 0x7f3d001583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.448+0000 7f3d05d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d000b0050 0x7f3d00158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.448+0000 7f3d05d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d00158f70 con 0x7f3cf0005210 2023-10-09T06:57:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.448+0000 7f3d05d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d001577e0 con 0x7f3d000b0050 2023-10-09T06:57:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.448+0000 7f3d05d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d000ac020 con 0x7f3d000afbe0 2023-10-09T06:57:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.448+0000 7f3d04d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cf0005210 0x7f3d000abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.448+0000 7f3d04d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cf0005210 0x7f3d000abae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55962/0 (socket says 172.21.15.71:55962) 2023-10-09T06:57:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.448+0000 7f3d04d9b700 1 -- 172.21.15.71:0/2668940771 learned_addr learned my addr 172.21.15.71:0/2668940771 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.448+0000 7f3d04d9b700 1 -- 172.21.15.71:0/2668940771 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d000afbe0 msgr2=0x7f3d001583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:54.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.448+0000 7f3d04d9b700 1 --2- 172.21.15.71:0/2668940771 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d000afbe0 0x7f3d001583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:54.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.448+0000 7f3d04d9b700 1 -- 172.21.15.71:0/2668940771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d000b0050 msgr2=0x7f3d00158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:54.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.448+0000 7f3d04d9b700 1 --2- 172.21.15.71:0/2668940771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d000b0050 0x7f3d00158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:54.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.448+0000 7f3d04d9b700 1 -- 172.21.15.71:0/2668940771 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0015b590 con 0x7f3cf0005210 2023-10-09T06:57:54.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.448+0000 7f3d04d9b700 1 --2- 172.21.15.71:0/2668940771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cf0005210 0x7f3d000abae0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4007390 tx=0x7f3cf4001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:54.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.448+0000 7f3cfcff9700 1 -- 172.21.15.71:0/2668940771 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4000cb0 con 0x7f3cf0005210 2023-10-09T06:57:54.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.449+0000 7f3cfcff9700 1 -- 172.21.15.71:0/2668940771 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf400f8d0 con 0x7f3cf0005210 2023-10-09T06:57:54.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.449+0000 7f3cfcff9700 1 -- 172.21.15.71:0/2668940771 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf400fc90 con 0x7f3cf0005210 2023-10-09T06:57:54.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.449+0000 7f3d05d9d700 1 -- 172.21.15.71:0/2668940771 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d0015b870 con 0x7f3cf0005210 2023-10-09T06:57:54.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.449+0000 7f3d05d9d700 1 -- 172.21.15.71:0/2668940771 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0015be30 con 0x7f3cf0005210 2023-10-09T06:57:54.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.450+0000 7f3d05d9d700 1 -- 172.21.15.71:0/2668940771 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d0006c450 con 0x7f3cf0005210 2023-10-09T06:57:54.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.450+0000 7f3cfcff9700 1 -- 172.21.15.71:0/2668940771 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 32) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f3cf40133b0 con 0x7f3cf0005210 2023-10-09T06:57:54.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.451+0000 7f3cfcff9700 1 --2- 172.21.15.71:0/2668940771 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3ce4066d80 0x7f3ce4069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:54.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.451+0000 7f3cfcff9700 1 -- 172.21.15.71:0/2668940771 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f3cf4083bd0 con 0x7f3cf0005210 2023-10-09T06:57:54.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.452+0000 7f3cfffff700 1 --2- 172.21.15.71:0/2668940771 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3ce4066d80 0x7f3ce4069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:54.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.452+0000 7f3cfffff700 1 --2- 172.21.15.71:0/2668940771 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3ce4066d80 0x7f3ce4069230 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3cec006ed0 tx=0x7f3cec0091a0 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:54.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.456+0000 7f3cfcff9700 1 -- 172.21.15.71:0/2668940771 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3cf4051030 con 0x7f3cf0005210 2023-10-09T06:57:54.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.653+0000 7f3d05d9d700 1 -- 172.21.15.71:0/2668940771 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3d0004bb80 con 0x7f3cf0005210 2023-10-09T06:57:54.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.658+0000 7f3cfcff9700 1 -- 172.21.15.71:0/2668940771 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3cf401a0a0 con 0x7f3cf0005210 2023-10-09T06:57:54.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.660+0000 7f3d05d9d700 1 -- 172.21.15.71:0/2668940771 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3ce4066d80 msgr2=0x7f3ce4069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:54.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.660+0000 7f3d05d9d700 1 --2- 172.21.15.71:0/2668940771 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3ce4066d80 0x7f3ce4069230 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3cec006ed0 tx=0x7f3cec0091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:54.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.660+0000 7f3d05d9d700 1 -- 172.21.15.71:0/2668940771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cf0005210 msgr2=0x7f3d000abae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:54.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.660+0000 7f3d05d9d700 1 --2- 172.21.15.71:0/2668940771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cf0005210 0x7f3d000abae0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4007390 tx=0x7f3cf4001d20 comp rx=0 tx=0).stop 2023-10-09T06:57:54.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.660+0000 7f3d05d9d700 1 -- 172.21.15.71:0/2668940771 shutdown_connections 2023-10-09T06:57:54.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.660+0000 7f3d05d9d700 1 --2- 172.21.15.71:0/2668940771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d000b0050 0x7f3d00158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:54.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.660+0000 7f3d05d9d700 1 --2- 172.21.15.71:0/2668940771 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3ce4066d80 0x7f3ce4069230 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:54.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.660+0000 7f3d05d9d700 1 --2- 172.21.15.71:0/2668940771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cf0005210 0x7f3d000abae0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:54.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.660+0000 7f3d05d9d700 1 --2- 172.21.15.71:0/2668940771 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d000afbe0 0x7f3d001583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:54.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.660+0000 7f3d05d9d700 1 -- 172.21.15.71:0/2668940771 >> 172.21.15.71:0/2668940771 conn(0x7f3d000cc1e0 msgr2=0x7f3d000c7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:54.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.660+0000 7f3d05d9d700 1 -- 172.21.15.71:0/2668940771 shutdown_connections 2023-10-09T06:57:54.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.660+0000 7f3d05d9d700 1 -- 172.21.15.71:0/2668940771 wait complete. 2023-10-09T06:57:54.678 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-09T06:57:54.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.862+0000 7fc60699d700 1 Processor -- start 2023-10-09T06:57:54.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.862+0000 7fc60699d700 1 -- start start 2023-10-09T06:57:54.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.863+0000 7fc60699d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc600159a60 0x7fc6000c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:54.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.863+0000 7fc60699d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6000c9cb0 con 0x7fc6000ccc00 2023-10-09T06:57:54.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.863+0000 7fc60699d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6000c9f30 con 0x7fc6000cb230 2023-10-09T06:57:54.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.863+0000 7fc60699d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc60006dfc0 con 0x7fc600159a60 2023-10-09T06:57:54.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.864+0000 7fc60519a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc6000ccc00 0x7fc600069ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46098/0 (socket says 172.21.15.71:46098) 2023-10-09T06:57:54.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.864+0000 7fc60519a700 1 -- 172.21.15.71:0/698040511 learned_addr learned my addr 172.21.15.71:0/698040511 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:54.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.864+0000 7fc60599b700 1 --2- 172.21.15.71:0/698040511 >> v2:172.21.15.179:3300/0 conn(0x7fc600159a60 0x7fc6000c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:54.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.864+0000 7fc604999700 1 -- 172.21.15.71:0/698040511 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1597746610 0 0) 0x7fc6000c9cb0 con 0x7fc6000ccc00 2023-10-09T06:57:54.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.864+0000 7fc604999700 1 -- 172.21.15.71:0/698040511 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5ec003570 con 0x7fc6000ccc00 2023-10-09T06:57:54.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.864+0000 7fc604999700 1 -- 172.21.15.71:0/698040511 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2688648138 0 0) 0x7fc5ec003570 con 0x7fc6000ccc00 2023-10-09T06:57:54.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.864+0000 7fc604999700 1 -- 172.21.15.71:0/698040511 >> v2:172.21.15.179:3300/0 conn(0x7fc600159a60 msgr2=0x7fc6000c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:54.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.864+0000 7fc604999700 1 --2- 172.21.15.71:0/698040511 >> v2:172.21.15.179:3300/0 conn(0x7fc600159a60 0x7fc6000c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:54.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.864+0000 7fc604999700 1 -- 172.21.15.71:0/698040511 >> v1:172.21.15.179:6789/0 conn(0x7fc6000cb230 legacy=0x7fc60006d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:54.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.864+0000 7fc604999700 1 -- 172.21.15.71:0/698040511 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6000ca470 con 0x7fc6000ccc00 2023-10-09T06:57:54.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.864+0000 7fc604999700 1 -- 172.21.15.71:0/698040511 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fc5f0001470 con 0x7fc6000ccc00 2023-10-09T06:57:54.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.864+0000 7fc604999700 1 -- 172.21.15.71:0/698040511 >> v1:172.21.15.71:6789/0 conn(0x7fc6000ccc00 legacy=0x7fc600069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:54.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.864+0000 7fc604999700 1 --2- 172.21.15.71:0/698040511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5ec003a60 0x7fc5ec003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:54.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.864+0000 7fc604999700 1 --2- 172.21.15.71:0/698040511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5ec004810 0x7fc5ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:54.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.864+0000 7fc604999700 1 --2- 172.21.15.71:0/698040511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5ec0051c0 0x7fc5ec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:54.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.864+0000 7fc604999700 1 -- 172.21.15.71:0/698040511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60006dfc0 con 0x7fc5ec003a60 2023-10-09T06:57:54.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.864+0000 7fc604999700 1 -- 172.21.15.71:0/698040511 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec00c0b0 con 0x7fc5ec0051c0 2023-10-09T06:57:54.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.864+0000 7fc604999700 1 -- 172.21.15.71:0/698040511 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec00c270 con 0x7fc5ec004810 2023-10-09T06:57:54.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.865+0000 7fc60599b700 1 --2- 172.21.15.71:0/698040511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5ec003a60 0x7fc5ec003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:54.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.865+0000 7fc60619c700 1 --2- 172.21.15.71:0/698040511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5ec0051c0 0x7fc5ec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:54.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.865+0000 7fc60519a700 1 --2- 172.21.15.71:0/698040511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5ec004810 0x7fc5ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:54.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.865+0000 7fc60599b700 1 -- 172.21.15.71:0/698040511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5ec004810 msgr2=0x7fc5ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:54.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.865+0000 7fc60599b700 1 --2- 172.21.15.71:0/698040511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5ec004810 0x7fc5ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:54.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.865+0000 7fc60599b700 1 -- 172.21.15.71:0/698040511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5ec0051c0 msgr2=0x7fc5ec00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:54.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.865+0000 7fc60599b700 1 --2- 172.21.15.71:0/698040511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5ec0051c0 0x7fc5ec00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:54.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.865+0000 7fc60599b700 1 -- 172.21.15.71:0/698040511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ec003570 con 0x7fc5ec003a60 2023-10-09T06:57:54.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.865+0000 7fc60619c700 1 --2- 172.21.15.71:0/698040511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5ec0051c0 0x7fc5ec00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:54.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.865+0000 7fc60619c700 1 -- 172.21.15.71:0/698040511 reap_dead start 2023-10-09T06:57:54.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.865+0000 7fc60599b700 1 --2- 172.21.15.71:0/698040511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5ec003a60 0x7fc5ec003e30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009c00 tx=0x7fc5fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb655a5908a397b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:54.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.865+0000 7fc604999700 1 -- 172.21.15.71:0/698040511 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc00e710 con 0x7fc5ec003a60 2023-10-09T06:57:54.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.866+0000 7fc604999700 1 -- 172.21.15.71:0/698040511 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5fc00e870 con 0x7fc5ec003a60 2023-10-09T06:57:54.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.866+0000 7fc604999700 1 -- 172.21.15.71:0/698040511 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc00ec30 con 0x7fc5ec003a60 2023-10-09T06:57:54.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.866+0000 7fc60699d700 1 -- 172.21.15.71:0/698040511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5ec003a60 msgr2=0x7fc5ec003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:54.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.866+0000 7fc60699d700 1 --2- 172.21.15.71:0/698040511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5ec003a60 0x7fc5ec003e30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009c00 tx=0x7fc5fc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:54.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.866+0000 7fc60699d700 1 -- 172.21.15.71:0/698040511 shutdown_connections 2023-10-09T06:57:54.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.866+0000 7fc60699d700 1 --2- 172.21.15.71:0/698040511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5ec003a60 0x7fc5ec003e30 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:54.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.866+0000 7fc60699d700 1 -- 172.21.15.71:0/698040511 >> 172.21.15.71:0/698040511 conn(0x7fc60006baa0 msgr2=0x7fc60006bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:54.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.866+0000 7fc60699d700 1 -- 172.21.15.71:0/698040511 shutdown_connections 2023-10-09T06:57:54.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.866+0000 7fc60699d700 1 -- 172.21.15.71:0/698040511 wait complete. 2023-10-09T06:57:54.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.868+0000 7fc60699d700 1 Processor -- start 2023-10-09T06:57:54.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.868+0000 7fc60699d700 1 -- start start 2023-10-09T06:57:54.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.869+0000 7fc60699d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5ec003a60 0x7fc60014a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:54.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.869+0000 7fc60699d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc600159e30 0x7fc60015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:54.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.869+0000 7fc60699d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6000b2500 0x7fc6000b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:54.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.869+0000 7fc60699d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60015a7e0 con 0x7fc5ec003a60 2023-10-09T06:57:54.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.869+0000 7fc60699d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6000b3d50 con 0x7fc600159e30 2023-10-09T06:57:54.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.869+0000 7fc60699d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6000a9c20 con 0x7fc6000b2500 2023-10-09T06:57:54.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.869+0000 7fc60599b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5ec003a60 0x7fc60014a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:54.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.869+0000 7fc60599b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5ec003a60 0x7fc60014a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55986/0 (socket says 172.21.15.71:55986) 2023-10-09T06:57:54.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.869+0000 7fc60599b700 1 -- 172.21.15.71:0/1901083111 learned_addr learned my addr 172.21.15.71:0/1901083111 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:54.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.869+0000 7fc60519a700 1 --2- 172.21.15.71:0/1901083111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc600159e30 0x7fc60015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:54.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.869+0000 7fc60619c700 1 --2- 172.21.15.71:0/1901083111 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6000b2500 0x7fc6000b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:54.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.869+0000 7fc60599b700 1 -- 172.21.15.71:0/1901083111 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6000b2500 msgr2=0x7fc6000b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:54.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.869+0000 7fc60599b700 1 --2- 172.21.15.71:0/1901083111 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6000b2500 0x7fc6000b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:54.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.869+0000 7fc60599b700 1 -- 172.21.15.71:0/1901083111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc600159e30 msgr2=0x7fc60015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:54.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.869+0000 7fc60599b700 1 --2- 172.21.15.71:0/1901083111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc600159e30 0x7fc60015a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:54.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.869+0000 7fc60599b700 1 -- 172.21.15.71:0/1901083111 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6000b2e90 con 0x7fc5ec003a60 2023-10-09T06:57:54.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.869+0000 7fc60519a700 1 --2- 172.21.15.71:0/1901083111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc600159e30 0x7fc60015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:57:54.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.869+0000 7fc60619c700 1 --2- 172.21.15.71:0/1901083111 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6000b2500 0x7fc6000b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:57:54.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.869+0000 7fc60599b700 1 --2- 172.21.15.71:0/1901083111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5ec003a60 0x7fc60014a5c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec00c080 tx=0x7fc5fc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:54.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.870+0000 7fc5f5ffb700 1 -- 172.21.15.71:0/1901083111 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc022070 con 0x7fc5ec003a60 2023-10-09T06:57:54.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.870+0000 7fc5f5ffb700 1 -- 172.21.15.71:0/1901083111 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5fc00e9e0 con 0x7fc5ec003a60 2023-10-09T06:57:54.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.870+0000 7fc60699d700 1 -- 172.21.15.71:0/1901083111 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6000b3140 con 0x7fc5ec003a60 2023-10-09T06:57:54.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.870+0000 7fc5f5ffb700 1 -- 172.21.15.71:0/1901083111 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc01c450 con 0x7fc5ec003a60 2023-10-09T06:57:54.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.870+0000 7fc60699d700 1 -- 172.21.15.71:0/1901083111 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6000b3700 con 0x7fc5ec003a60 2023-10-09T06:57:54.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.871+0000 7fc60699d700 1 -- 172.21.15.71:0/1901083111 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc60006eba0 con 0x7fc5ec003a60 2023-10-09T06:57:54.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.872+0000 7fc5f5ffb700 1 -- 172.21.15.71:0/1901083111 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc5fc01c880 con 0x7fc5ec003a60 2023-10-09T06:57:54.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.872+0000 7fc5f5ffb700 1 --2- 172.21.15.71:0/1901083111 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc5e4066f30 0x7fc5e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:54.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.873+0000 7fc5f5ffb700 1 -- 172.21.15.71:0/1901083111 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5890+0+0 (secure 0 0 0) 0x7fc5fc085d30 con 0x7fc5ec003a60 2023-10-09T06:57:54.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.873+0000 7fc60519a700 1 --2- 172.21.15.71:0/1901083111 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc5e4066f30 0x7fc5e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:54.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.873+0000 7fc60519a700 1 --2- 172.21.15.71:0/1901083111 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc5e4066f30 0x7fc5e40693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc600147b10 tx=0x7fc5f0001010 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:54.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:54.877+0000 7fc5f5ffb700 1 -- 172.21.15.71:0/1901083111 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5fc052f90 con 0x7fc5ec003a60 2023-10-09T06:57:55.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.067+0000 7fc60699d700 1 -- 172.21.15.71:0/1901083111 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fc60015a7e0 con 0x7fc5ec003a60 2023-10-09T06:57:55.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.071+0000 7fc5f5ffb700 1 -- 172.21.15.71:0/1901083111 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v26) v1 ==== 115+0+0 (secure 0 0 0) 0x7fc5fc0170b0 con 0x7fc5ec003a60 2023-10-09T06:57:55.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.073+0000 7fc60699d700 1 -- 172.21.15.71:0/1901083111 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc5e4066f30 msgr2=0x7fc5e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:55.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.073+0000 7fc60699d700 1 --2- 172.21.15.71:0/1901083111 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc5e4066f30 0x7fc5e40693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc600147b10 tx=0x7fc5f0001010 comp rx=0 tx=0).stop 2023-10-09T06:57:55.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.073+0000 7fc60699d700 1 -- 172.21.15.71:0/1901083111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5ec003a60 msgr2=0x7fc60014a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:55.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.073+0000 7fc60699d700 1 --2- 172.21.15.71:0/1901083111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5ec003a60 0x7fc60014a5c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec00c080 tx=0x7fc5fc01a000 comp rx=0 tx=0).stop 2023-10-09T06:57:55.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.073+0000 7fc60699d700 1 -- 172.21.15.71:0/1901083111 shutdown_connections 2023-10-09T06:57:55.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.073+0000 7fc60699d700 1 --2- 172.21.15.71:0/1901083111 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6000b2500 0x7fc6000b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:55.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.073+0000 7fc60699d700 1 --2- 172.21.15.71:0/1901083111 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc5e4066f30 0x7fc5e40693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:55.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.073+0000 7fc60699d700 1 --2- 172.21.15.71:0/1901083111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5ec003a60 0x7fc60014a5c0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:55.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.073+0000 7fc60699d700 1 --2- 172.21.15.71:0/1901083111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc600159e30 0x7fc60015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:55.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.073+0000 7fc60699d700 1 -- 172.21.15.71:0/1901083111 >> 172.21.15.71:0/1901083111 conn(0x7fc60006baa0 msgr2=0x7fc60006aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:55.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.073+0000 7fc60699d700 1 -- 172.21.15.71:0/1901083111 shutdown_connections 2023-10-09T06:57:55.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.074+0000 7fc60699d700 1 -- 172.21.15.71:0/1901083111 wait complete. 2023-10-09T06:57:55.092 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-09T06:57:55.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.274+0000 7f72b4b9d700 1 Processor -- start 2023-10-09T06:57:55.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.274+0000 7f72b4b9d700 1 -- start start 2023-10-09T06:57:55.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.275+0000 7f72b4b9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f72b00cb230 0x7f72b00cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.275+0000 7f72b4b9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b00cbb90 con 0x7f72b0159a60 2023-10-09T06:57:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.275+0000 7f72b4b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b00c9f30 con 0x7f72b00ccc00 2023-10-09T06:57:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.275+0000 7f72b4b9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b006dfc0 con 0x7f72b00cb230 2023-10-09T06:57:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.276+0000 7f72affff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f72b00cb230 0x7f72b00cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.276+0000 7f72af7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f72b0159a60 0x7f72b00c9770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39486/0 (socket says 172.21.15.71:39486) 2023-10-09T06:57:55.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.276+0000 7f72af7fe700 1 -- 172.21.15.71:0/1993234109 learned_addr learned my addr 172.21.15.71:0/1993234109 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:55.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.276+0000 7f72affff700 1 -- 172.21.15.71:0/1993234109 >> v1:172.21.15.179:6789/0 conn(0x7f72b00ccc00 legacy=0x7f72b0069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:55.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.276+0000 7f72affff700 1 -- 172.21.15.71:0/1993234109 >> v1:172.21.15.71:6789/0 conn(0x7f72b0159a60 legacy=0x7f72b00c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:55.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.276+0000 7f72affff700 1 -- 172.21.15.71:0/1993234109 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b00ca470 con 0x7f72b00cb230 2023-10-09T06:57:55.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.276+0000 7f72ae7fc700 1 -- 172.21.15.71:0/1993234109 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251926757 0 0) 0x7f72b00cbb90 con 0x7f72b0159a60 2023-10-09T06:57:55.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.276+0000 7f72affff700 1 --2- 172.21.15.71:0/1993234109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72b00cb230 0x7f72b00cb650 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009e60 tx=0x7f72a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40ddd8e24658185 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:55.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.276+0000 7f72ae7fc700 1 -- 172.21.15.71:0/1993234109 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a800e070 con 0x7f72b00cb230 2023-10-09T06:57:55.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.277+0000 7f72ae7fc700 1 -- 172.21.15.71:0/1993234109 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a800bcc0 con 0x7f72b00cb230 2023-10-09T06:57:55.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.277+0000 7f72ae7fc700 1 -- 172.21.15.71:0/1993234109 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a8012680 con 0x7f72b00cb230 2023-10-09T06:57:55.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.277+0000 7f72b4b9d700 1 -- 172.21.15.71:0/1993234109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72b00cb230 msgr2=0x7f72b00cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:55.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.277+0000 7f72b4b9d700 1 --2- 172.21.15.71:0/1993234109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72b00cb230 0x7f72b00cb650 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009e60 tx=0x7f72a8009780 comp rx=0 tx=0).stop 2023-10-09T06:57:55.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.277+0000 7f72b4b9d700 1 -- 172.21.15.71:0/1993234109 shutdown_connections 2023-10-09T06:57:55.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.277+0000 7f72b4b9d700 1 --2- 172.21.15.71:0/1993234109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72b00cb230 0x7f72b00cb650 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:55.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.277+0000 7f72b4b9d700 1 -- 172.21.15.71:0/1993234109 >> 172.21.15.71:0/1993234109 conn(0x7f72b006baa0 msgr2=0x7f72b006bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:55.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.277+0000 7f72b4b9d700 1 -- 172.21.15.71:0/1993234109 shutdown_connections 2023-10-09T06:57:55.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.277+0000 7f72b4b9d700 1 -- 172.21.15.71:0/1993234109 wait complete. 2023-10-09T06:57:55.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.279+0000 7f72b4b9d700 1 Processor -- start 2023-10-09T06:57:55.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.279+0000 7f72b4b9d700 1 -- start start 2023-10-09T06:57:55.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.280+0000 7f72b4b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72b00cb230 0x7f72b00c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:55.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.280+0000 7f72b4b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72b00ccc00 0x7f72b0154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:55.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.280+0000 7f72b4b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72b0159a60 0x7f72b0153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:55.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.280+0000 7f72b4b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b0157df0 con 0x7f72b00cb230 2023-10-09T06:57:55.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.280+0000 7f72b4b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b00c6b40 con 0x7f72b00ccc00 2023-10-09T06:57:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.280+0000 7f72b4b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b0155620 con 0x7f72b0159a60 2023-10-09T06:57:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.280+0000 7f72af7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72b00cb230 0x7f72b00c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.280+0000 7f72af7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72b00cb230 0x7f72b00c8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48196/0 (socket says 172.21.15.71:48196) 2023-10-09T06:57:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.280+0000 7f72af7fe700 1 -- 172.21.15.71:0/3880492534 learned_addr learned my addr 172.21.15.71:0/3880492534 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.280+0000 7f72affff700 1 --2- 172.21.15.71:0/3880492534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72b0159a60 0x7f72b0153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.280+0000 7f72aeffd700 1 --2- 172.21.15.71:0/3880492534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72b00ccc00 0x7f72b0154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.280+0000 7f72af7fe700 1 -- 172.21.15.71:0/3880492534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72b0159a60 msgr2=0x7f72b0153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.280+0000 7f72af7fe700 1 --2- 172.21.15.71:0/3880492534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72b0159a60 0x7f72b0153530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.280+0000 7f72af7fe700 1 -- 172.21.15.71:0/3880492534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72b00ccc00 msgr2=0x7f72b0154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.280+0000 7f72af7fe700 1 --2- 172.21.15.71:0/3880492534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72b00ccc00 0x7f72b0154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.280+0000 7f72af7fe700 1 -- 172.21.15.71:0/3880492534 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a8009a20 con 0x7f72b00cb230 2023-10-09T06:57:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.280+0000 7f72affff700 1 --2- 172.21.15.71:0/3880492534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72b0159a60 0x7f72b0153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:57:55.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.280+0000 7f72aeffd700 1 --2- 172.21.15.71:0/3880492534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72b00ccc00 0x7f72b0154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:57:55.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.281+0000 7f72af7fe700 1 --2- 172.21.15.71:0/3880492534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72b00cb230 0x7f72b00c8490 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f72a000c5b0 tx=0x7f72a0001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:55.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.281+0000 7f72977fe700 1 -- 172.21.15.71:0/3880492534 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a0005b30 con 0x7f72b00cb230 2023-10-09T06:57:55.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.281+0000 7f72977fe700 1 -- 172.21.15.71:0/3880492534 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a0005c90 con 0x7f72b00cb230 2023-10-09T06:57:55.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.281+0000 7f72977fe700 1 -- 172.21.15.71:0/3880492534 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a0007300 con 0x7f72b00cb230 2023-10-09T06:57:55.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.281+0000 7f72b4b9d700 1 -- 172.21.15.71:0/3880492534 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b0155900 con 0x7f72b00cb230 2023-10-09T06:57:55.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.281+0000 7f72b4b9d700 1 -- 172.21.15.71:0/3880492534 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b00c67d0 con 0x7f72b00cb230 2023-10-09T06:57:55.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.282+0000 7f72b4b9d700 1 -- 172.21.15.71:0/3880492534 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b006b630 con 0x7f72b00cb230 2023-10-09T06:57:55.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.283+0000 7f72977fe700 1 -- 172.21.15.71:0/3880492534 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72a001b3b0 con 0x7f72b00cb230 2023-10-09T06:57:55.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.284+0000 7f72977fe700 1 --2- 172.21.15.71:0/3880492534 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f729c066f30 0x7f729c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:55.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.284+0000 7f72977fe700 1 -- 172.21.15.71:0/3880492534 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f72a0083b20 con 0x7f72b00cb230 2023-10-09T06:57:55.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.285+0000 7f72aeffd700 1 --2- 172.21.15.71:0/3880492534 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f729c066f30 0x7f729c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:55.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.285+0000 7f72aeffd700 1 --2- 172.21.15.71:0/3880492534 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f729c066f30 0x7f729c0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f72b00c89d0 tx=0x7f72a4009040 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:55.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.288+0000 7f72977fe700 1 -- 172.21.15.71:0/3880492534 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72a0050cd0 con 0x7f72b00cb230 2023-10-09T06:57:55.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.480+0000 7f72b4b9d700 1 -- 172.21.15.71:0/3880492534 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f72b00ca750 con 0x7f72b00cb230 2023-10-09T06:57:55.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.484+0000 7f72977fe700 1 -- 172.21.15.71:0/3880492534 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v27) v1 ==== 120+0+0 (secure 0 0 0) 0x7f72a00542f0 con 0x7f72b00cb230 2023-10-09T06:57:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.486+0000 7f72b4b9d700 1 -- 172.21.15.71:0/3880492534 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f729c066f30 msgr2=0x7f729c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.486+0000 7f72b4b9d700 1 --2- 172.21.15.71:0/3880492534 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f729c066f30 0x7f729c0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f72b00c89d0 tx=0x7f72a4009040 comp rx=0 tx=0).stop 2023-10-09T06:57:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.486+0000 7f72b4b9d700 1 -- 172.21.15.71:0/3880492534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72b00cb230 msgr2=0x7f72b00c8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.486+0000 7f72b4b9d700 1 --2- 172.21.15.71:0/3880492534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72b00cb230 0x7f72b00c8490 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f72a000c5b0 tx=0x7f72a0001070 comp rx=0 tx=0).stop 2023-10-09T06:57:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.486+0000 7f72b4b9d700 1 -- 172.21.15.71:0/3880492534 shutdown_connections 2023-10-09T06:57:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.486+0000 7f72b4b9d700 1 --2- 172.21.15.71:0/3880492534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72b0159a60 0x7f72b0153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.486+0000 7f72b4b9d700 1 --2- 172.21.15.71:0/3880492534 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f729c066f30 0x7f729c0693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.486+0000 7f72b4b9d700 1 --2- 172.21.15.71:0/3880492534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72b00cb230 0x7f72b00c8490 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.487+0000 7f72b4b9d700 1 --2- 172.21.15.71:0/3880492534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72b00ccc00 0x7f72b0154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.487+0000 7f72b4b9d700 1 -- 172.21.15.71:0/3880492534 >> 172.21.15.71:0/3880492534 conn(0x7f72b006baa0 msgr2=0x7f72b00c93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:55.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.487+0000 7f72b4b9d700 1 -- 172.21.15.71:0/3880492534 shutdown_connections 2023-10-09T06:57:55.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.487+0000 7f72b4b9d700 1 -- 172.21.15.71:0/3880492534 wait complete. 2023-10-09T06:57:55.505 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-10-09T06:57:55.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.692+0000 7f66a35ff700 1 Processor -- start 2023-10-09T06:57:55.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.693+0000 7f66a35ff700 1 -- start start 2023-10-09T06:57:55.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.694+0000 7f66a35ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f669c0b1420 0x7f669c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:55.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.694+0000 7f66a35ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f669c0ccf90 0x7f669c0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:55.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.694+0000 7f66a35ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669c0cc300 con 0x7f669c0cbf30 2023-10-09T06:57:55.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.694+0000 7f66a35ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669c156bf0 con 0x7f669c0b1420 2023-10-09T06:57:55.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.694+0000 7f66a35ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c0ae950 con 0x7f669c0ccf90 2023-10-09T06:57:55.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.694+0000 7f66a0b9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f669c0b1420 0x7f669c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:55.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.694+0000 7f66a0b9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f669c0b1420 0x7f669c0ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48212/0 (socket says 172.21.15.71:48212) 2023-10-09T06:57:55.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.694+0000 7f66a0b9a700 1 -- 172.21.15.71:0/1564576600 learned_addr learned my addr 172.21.15.71:0/1564576600 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:55.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.694+0000 7f66a1b9c700 1 --2- 172.21.15.71:0/1564576600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f669c0ccf90 0x7f669c0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:55.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.695+0000 7f66a0b9a700 1 -- 172.21.15.71:0/1564576600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f669c0ccf90 msgr2=0x7f669c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:55.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.695+0000 7f66a0b9a700 1 --2- 172.21.15.71:0/1564576600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f669c0ccf90 0x7f669c0c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:55.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.695+0000 7f66a0b9a700 1 -- 172.21.15.71:0/1564576600 >> v1:172.21.15.179:6789/0 conn(0x7f669c0cbf30 legacy=0x7f669c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:55.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.695+0000 7f66a0b9a700 1 -- 172.21.15.71:0/1564576600 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c0ad370 con 0x7f669c0b1420 2023-10-09T06:57:55.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.695+0000 7f66a0b9a700 1 --2- 172.21.15.71:0/1564576600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f669c0b1420 0x7f669c0ae410 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f668c00bc80 tx=0x7f668c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7207cad2f30c5734 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:55.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.695+0000 7f6693fff700 1 -- 172.21.15.71:0/1564576600 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c00be90 con 0x7f669c0b1420 2023-10-09T06:57:55.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.695+0000 7f6693fff700 1 -- 172.21.15.71:0/1564576600 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c00ddc0 con 0x7f669c0b1420 2023-10-09T06:57:55.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.695+0000 7f6693fff700 1 -- 172.21.15.71:0/1564576600 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c0196b0 con 0x7f669c0b1420 2023-10-09T06:57:55.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.696+0000 7f66a35ff700 1 -- 172.21.15.71:0/1564576600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f669c0b1420 msgr2=0x7f669c0ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:55.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.696+0000 7f66a35ff700 1 --2- 172.21.15.71:0/1564576600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f669c0b1420 0x7f669c0ae410 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f668c00bc80 tx=0x7f668c00b4f0 comp rx=0 tx=0).stop 2023-10-09T06:57:55.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.696+0000 7f66a35ff700 1 -- 172.21.15.71:0/1564576600 shutdown_connections 2023-10-09T06:57:55.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.696+0000 7f66a35ff700 1 --2- 172.21.15.71:0/1564576600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f669c0ccf90 0x7f669c0c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:55.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.696+0000 7f66a35ff700 1 --2- 172.21.15.71:0/1564576600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f669c0b1420 0x7f669c0ae410 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:55.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.696+0000 7f66a35ff700 1 -- 172.21.15.71:0/1564576600 >> 172.21.15.71:0/1564576600 conn(0x7f669c06a320 msgr2=0x7f669c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:55.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.696+0000 7f66a35ff700 1 -- 172.21.15.71:0/1564576600 shutdown_connections 2023-10-09T06:57:55.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.696+0000 7f66a35ff700 1 -- 172.21.15.71:0/1564576600 wait complete. 2023-10-09T06:57:55.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.697+0000 7f66a35ff700 1 Processor -- start 2023-10-09T06:57:55.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.698+0000 7f66a35ff700 1 -- start start 2023-10-09T06:57:55.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.698+0000 7f66a35ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f669c0b1420 0x7f669c169bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:55.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.698+0000 7f66a35ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f669c0cbf30 0x7f669c0a7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:55.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.698+0000 7f66a35ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f669c0ccf90 0x7f669c0a8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:55.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.698+0000 7f66a35ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c158580 con 0x7f669c0cbf30 2023-10-09T06:57:55.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.698+0000 7f66a35ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c16a0f0 con 0x7f669c0ccf90 2023-10-09T06:57:55.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.698+0000 7f66a35ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c0a64d0 con 0x7f669c0b1420 2023-10-09T06:57:55.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.699+0000 7f66a0b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f669c0cbf30 0x7f669c0a7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:55.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.699+0000 7f66a0b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f669c0cbf30 0x7f669c0a7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48216/0 (socket says 172.21.15.71:48216) 2023-10-09T06:57:55.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.699+0000 7f66a0b9a700 1 -- 172.21.15.71:0/1353239152 learned_addr learned my addr 172.21.15.71:0/1353239152 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:55.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.699+0000 7f66a1b9c700 1 --2- 172.21.15.71:0/1353239152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f669c0ccf90 0x7f669c0a8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:55.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.699+0000 7f66a139b700 1 --2- 172.21.15.71:0/1353239152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f669c0b1420 0x7f669c169bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:55.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.699+0000 7f66a0b9a700 1 -- 172.21.15.71:0/1353239152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f669c0b1420 msgr2=0x7f669c169bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:55.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.699+0000 7f66a0b9a700 1 --2- 172.21.15.71:0/1353239152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f669c0b1420 0x7f669c169bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:55.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.699+0000 7f66a0b9a700 1 -- 172.21.15.71:0/1353239152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f669c0ccf90 msgr2=0x7f669c0a8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:55.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.699+0000 7f66a0b9a700 1 --2- 172.21.15.71:0/1353239152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f669c0ccf90 0x7f669c0a8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:55.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.699+0000 7f66a0b9a700 1 -- 172.21.15.71:0/1353239152 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c00b790 con 0x7f669c0cbf30 2023-10-09T06:57:55.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.699+0000 7f66a139b700 1 --2- 172.21.15.71:0/1353239152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f669c0b1420 0x7f669c169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:55.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.699+0000 7f66a0b9a700 1 --2- 172.21.15.71:0/1353239152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f669c0cbf30 0x7f669c0a7b50 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f668c00b530 tx=0x7f668c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:55.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.700+0000 7f66917fa700 1 -- 172.21.15.71:0/1353239152 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c010700 con 0x7f669c0cbf30 2023-10-09T06:57:55.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.700+0000 7f66917fa700 1 -- 172.21.15.71:0/1353239152 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c0108a0 con 0x7f669c0cbf30 2023-10-09T06:57:55.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.700+0000 7f66a35ff700 1 -- 172.21.15.71:0/1353239152 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669c0a58c0 con 0x7f669c0cbf30 2023-10-09T06:57:55.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.700+0000 7f66917fa700 1 -- 172.21.15.71:0/1353239152 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c010c60 con 0x7f669c0cbf30 2023-10-09T06:57:55.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.700+0000 7f66a35ff700 1 -- 172.21.15.71:0/1353239152 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669c0a5e80 con 0x7f669c0cbf30 2023-10-09T06:57:55.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.701+0000 7f66a35ff700 1 -- 172.21.15.71:0/1353239152 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669c04c3c0 con 0x7f669c0cbf30 2023-10-09T06:57:55.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.702+0000 7f66917fa700 1 -- 172.21.15.71:0/1353239152 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f668c0233f0 con 0x7f669c0cbf30 2023-10-09T06:57:55.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.702+0000 7f66917fa700 1 --2- 172.21.15.71:0/1353239152 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6680066f30 0x7f66800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:55.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.702+0000 7f66917fa700 1 -- 172.21.15.71:0/1353239152 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f668c014070 con 0x7f669c0cbf30 2023-10-09T06:57:55.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.703+0000 7f66a139b700 1 --2- 172.21.15.71:0/1353239152 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6680066f30 0x7f66800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:55.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.704+0000 7f66a139b700 1 --2- 172.21.15.71:0/1353239152 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6680066f30 0x7f66800693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6698007fd0 tx=0x7f6698009040 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:55.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.706+0000 7f66917fa700 1 -- 172.21.15.71:0/1353239152 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f668c053410 con 0x7f669c0cbf30 2023-10-09T06:57:55.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:55.975+0000 7f66a35ff700 1 -- 172.21.15.71:0/1353239152 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f669c0ad650 con 0x7f669c0cbf30 2023-10-09T06:57:56.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.232+0000 7f66917fa700 1 -- 172.21.15.71:0/1353239152 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v563) v1 ==== 156+0+0 (secure 0 0 0) 0x7f668c056a30 con 0x7f669c0cbf30 2023-10-09T06:57:56.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.234+0000 7f66a35ff700 1 -- 172.21.15.71:0/1353239152 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6680066f30 msgr2=0x7f66800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:56.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.234+0000 7f66a35ff700 1 --2- 172.21.15.71:0/1353239152 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6680066f30 0x7f66800693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6698007fd0 tx=0x7f6698009040 comp rx=0 tx=0).stop 2023-10-09T06:57:56.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.234+0000 7f66a35ff700 1 -- 172.21.15.71:0/1353239152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f669c0cbf30 msgr2=0x7f669c0a7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:56.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.234+0000 7f66a35ff700 1 --2- 172.21.15.71:0/1353239152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f669c0cbf30 0x7f669c0a7b50 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f668c00b530 tx=0x7f668c01b000 comp rx=0 tx=0).stop 2023-10-09T06:57:56.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.234+0000 7f66a35ff700 1 -- 172.21.15.71:0/1353239152 shutdown_connections 2023-10-09T06:57:56.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.234+0000 7f66a35ff700 1 --2- 172.21.15.71:0/1353239152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f669c0ccf90 0x7f669c0a8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:56.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.234+0000 7f66a35ff700 1 --2- 172.21.15.71:0/1353239152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f669c0b1420 0x7f669c169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:56.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.234+0000 7f66a35ff700 1 --2- 172.21.15.71:0/1353239152 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6680066f30 0x7f66800693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:56.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.234+0000 7f66a35ff700 1 --2- 172.21.15.71:0/1353239152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f669c0cbf30 0x7f669c0a7b50 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:56.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.234+0000 7f66a35ff700 1 -- 172.21.15.71:0/1353239152 >> 172.21.15.71:0/1353239152 conn(0x7f669c06a320 msgr2=0x7f669c0c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:56.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.234+0000 7f66a35ff700 1 -- 172.21.15.71:0/1353239152 shutdown_connections 2023-10-09T06:57:56.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.235+0000 7f66a35ff700 1 -- 172.21.15.71:0/1353239152 wait complete. 2023-10-09T06:57:56.253 INFO:tasks.cephfs_test_runner:Test listing non-existing snap schedules failure ... ok 2023-10-09T06:57:56.253 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules on a non-existing filesystem path failure 2023-10-09T06:57:56.253 INFO:tasks.cephfs_test_runner:test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-09T06:57:56.253 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-10-09T06:57:56.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.434+0000 7f2f16dff700 1 Processor -- start 2023-10-09T06:57:56.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.434+0000 7f2f16dff700 1 -- start start 2023-10-09T06:57:56.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.435+0000 7f2f16dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f100ccc40 0x7f2f10155c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:56.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.435+0000 7f2f16dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2f10156150 0x7f2f100ac230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:56.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.435+0000 7f2f16dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f100ad930 con 0x7f2f100cd010 2023-10-09T06:57:56.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.435+0000 7f2f16dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f100acd20 con 0x7f2f10156150 2023-10-09T06:57:56.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.435+0000 7f2f16dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f100ad000 con 0x7f2f100ccc40 2023-10-09T06:57:56.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.435+0000 7f2f1539c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f2f100cd010 0x7f2f100af2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39488/0 (socket says 172.21.15.71:39488) 2023-10-09T06:57:56.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.435+0000 7f2f1539c700 1 -- 172.21.15.71:0/1815747434 learned_addr learned my addr 172.21.15.71:0/1815747434 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:57:56.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.435+0000 7f2f14b9b700 1 --2- 172.21.15.71:0/1815747434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f100ccc40 0x7f2f10155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:56.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.436+0000 7f2f0ffff700 1 --2- 172.21.15.71:0/1815747434 >> v2:172.21.15.179:3300/0 conn(0x7f2f10156150 0x7f2f100ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:56.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.436+0000 7f2f0f7fe700 1 -- 172.21.15.71:0/1815747434 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860340094 0 0) 0x7f2f100ad930 con 0x7f2f100cd010 2023-10-09T06:57:56.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.436+0000 7f2f0f7fe700 1 -- 172.21.15.71:0/1815747434 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f00003570 con 0x7f2f100cd010 2023-10-09T06:57:56.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.436+0000 7f2f14b9b700 1 -- 172.21.15.71:0/1815747434 >> v2:172.21.15.179:3300/0 conn(0x7f2f10156150 msgr2=0x7f2f100ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:56.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.436+0000 7f2f14b9b700 1 --2- 172.21.15.71:0/1815747434 >> v2:172.21.15.179:3300/0 conn(0x7f2f10156150 0x7f2f100ac230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:56.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.436+0000 7f2f14b9b700 1 -- 172.21.15.71:0/1815747434 >> v1:172.21.15.71:6789/0 conn(0x7f2f100cd010 legacy=0x7f2f100af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:56.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.436+0000 7f2f14b9b700 1 -- 172.21.15.71:0/1815747434 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f100ad2e0 con 0x7f2f100ccc40 2023-10-09T06:57:56.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.436+0000 7f2f14b9b700 1 --2- 172.21.15.71:0/1815747434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f100ccc40 0x7f2f10155c10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2f04009e60 tx=0x7f2f04009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bba4d98198f7333f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:56.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.437+0000 7f2f0f7fe700 1 -- 172.21.15.71:0/1815747434 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0400e070 con 0x7f2f100ccc40 2023-10-09T06:57:56.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.437+0000 7f2f0f7fe700 1 -- 172.21.15.71:0/1815747434 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0400bab0 con 0x7f2f100ccc40 2023-10-09T06:57:56.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.437+0000 7f2f0f7fe700 1 -- 172.21.15.71:0/1815747434 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0400be70 con 0x7f2f100ccc40 2023-10-09T06:57:56.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.437+0000 7f2f16dff700 1 -- 172.21.15.71:0/1815747434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f100ccc40 msgr2=0x7f2f10155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:56.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.437+0000 7f2f16dff700 1 --2- 172.21.15.71:0/1815747434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f100ccc40 0x7f2f10155c10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2f04009e60 tx=0x7f2f04009780 comp rx=0 tx=0).stop 2023-10-09T06:57:56.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.437+0000 7f2f16dff700 1 -- 172.21.15.71:0/1815747434 shutdown_connections 2023-10-09T06:57:56.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.437+0000 7f2f16dff700 1 --2- 172.21.15.71:0/1815747434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f100ccc40 0x7f2f10155c10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:56.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.437+0000 7f2f16dff700 1 --2- 172.21.15.71:0/1815747434 >> v2:172.21.15.179:3300/0 conn(0x7f2f10156150 0x7f2f100ac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:56.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.437+0000 7f2f16dff700 1 -- 172.21.15.71:0/1815747434 >> 172.21.15.71:0/1815747434 conn(0x7f2f1006a320 msgr2=0x7f2f100cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:56.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.437+0000 7f2f16dff700 1 -- 172.21.15.71:0/1815747434 shutdown_connections 2023-10-09T06:57:56.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.437+0000 7f2f16dff700 1 -- 172.21.15.71:0/1815747434 wait complete. 2023-10-09T06:57:56.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.439+0000 7f2f16dff700 1 Processor -- start 2023-10-09T06:57:56.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.439+0000 7f2f16dff700 1 -- start start 2023-10-09T06:57:56.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.440+0000 7f2f16dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f100ccc40 0x7f2f101541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:56.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.440+0000 7f2f16dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f100cd010 0x7f2f1015e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:56.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.440+0000 7f2f16dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f10156150 0x7f2f100cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:56.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.440+0000 7f2f16dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f10157940 con 0x7f2f100cd010 2023-10-09T06:57:56.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.440+0000 7f2f16dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1015e4b0 con 0x7f2f10156150 2023-10-09T06:57:56.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.440+0000 7f2f16dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f10154710 con 0x7f2f100ccc40 2023-10-09T06:57:56.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.440+0000 7f2f0ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f100cd010 0x7f2f1015e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:56.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.440+0000 7f2f0ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f100cd010 0x7f2f1015e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48218/0 (socket says 172.21.15.71:48218) 2023-10-09T06:57:56.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.440+0000 7f2f0ffff700 1 -- 172.21.15.71:0/1343377435 learned_addr learned my addr 172.21.15.71:0/1343377435 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:56.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.440+0000 7f2f0ffff700 1 -- 172.21.15.71:0/1343377435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f100ccc40 msgr2=0x7f2f101541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:56.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.440+0000 7f2f0ffff700 1 --2- 172.21.15.71:0/1343377435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f100ccc40 0x7f2f101541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:56.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.440+0000 7f2f0ffff700 1 -- 172.21.15.71:0/1343377435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f10156150 msgr2=0x7f2f100cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:56.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.440+0000 7f2f0ffff700 1 --2- 172.21.15.71:0/1343377435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f10156150 0x7f2f100cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:56.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.440+0000 7f2f0ffff700 1 -- 172.21.15.71:0/1343377435 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f04009a20 con 0x7f2f100cd010 2023-10-09T06:57:56.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.441+0000 7f2f0ffff700 1 --2- 172.21.15.71:0/1343377435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f100cd010 0x7f2f1015e940 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00e960 tx=0x7f2efc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:56.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.441+0000 7f2f0cff9700 1 -- 172.21.15.71:0/1343377435 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc00c850 con 0x7f2f100cd010 2023-10-09T06:57:56.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.441+0000 7f2f0cff9700 1 -- 172.21.15.71:0/1343377435 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc00c9b0 con 0x7f2f100cd010 2023-10-09T06:57:56.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.441+0000 7f2f0cff9700 1 -- 172.21.15.71:0/1343377435 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc00cd50 con 0x7f2f100cd010 2023-10-09T06:57:56.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.441+0000 7f2f16dff700 1 -- 172.21.15.71:0/1343377435 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1015ca90 con 0x7f2f100cd010 2023-10-09T06:57:56.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.441+0000 7f2f16dff700 1 -- 172.21.15.71:0/1343377435 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1015de60 con 0x7f2f100cd010 2023-10-09T06:57:56.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.442+0000 7f2f16dff700 1 -- 172.21.15.71:0/1343377435 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1004c3c0 con 0x7f2f100cd010 2023-10-09T06:57:56.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.443+0000 7f2f0cff9700 1 -- 172.21.15.71:0/1343377435 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2efc013680 con 0x7f2f100cd010 2023-10-09T06:57:56.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.444+0000 7f2f0cff9700 1 --2- 172.21.15.71:0/1343377435 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2ef4066f30 0x7f2ef40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:56.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.444+0000 7f2f0cff9700 1 -- 172.21.15.71:0/1343377435 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f2efc084820 con 0x7f2f100cd010 2023-10-09T06:57:56.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.444+0000 7f2f14b9b700 1 --2- 172.21.15.71:0/1343377435 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2ef4066f30 0x7f2ef40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:56.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.445+0000 7f2f14b9b700 1 --2- 172.21.15.71:0/1343377435 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2ef4066f30 0x7f2ef40693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2f040097c0 tx=0x7f2f04019000 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:56.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.448+0000 7f2f0cff9700 1 -- 172.21.15.71:0/1343377435 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2efc0519d0 con 0x7f2f100cd010 2023-10-09T06:57:56.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:56.714+0000 7f2f16dff700 1 -- 172.21.15.71:0/1343377435 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7f2f100ad5c0 con 0x7f2f100cd010 2023-10-09T06:57:57.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.234+0000 7f2f0cff9700 1 -- 172.21.15.71:0/1343377435 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v564) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2efc054ff0 con 0x7f2f100cd010 2023-10-09T06:57:57.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.236+0000 7f2f16dff700 1 -- 172.21.15.71:0/1343377435 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2ef4066f30 msgr2=0x7f2ef40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:57.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.236+0000 7f2f16dff700 1 --2- 172.21.15.71:0/1343377435 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2ef4066f30 0x7f2ef40693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2f040097c0 tx=0x7f2f04019000 comp rx=0 tx=0).stop 2023-10-09T06:57:57.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.236+0000 7f2f16dff700 1 -- 172.21.15.71:0/1343377435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f100cd010 msgr2=0x7f2f1015e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:57.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.236+0000 7f2f16dff700 1 --2- 172.21.15.71:0/1343377435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f100cd010 0x7f2f1015e940 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00e960 tx=0x7f2efc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:57:57.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.236+0000 7f2f16dff700 1 -- 172.21.15.71:0/1343377435 shutdown_connections 2023-10-09T06:57:57.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.236+0000 7f2f16dff700 1 --2- 172.21.15.71:0/1343377435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f10156150 0x7f2f100cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:57.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.236+0000 7f2f16dff700 1 --2- 172.21.15.71:0/1343377435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f100ccc40 0x7f2f101541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:57.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.236+0000 7f2f16dff700 1 --2- 172.21.15.71:0/1343377435 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2ef4066f30 0x7f2ef40693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:57.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.236+0000 7f2f16dff700 1 --2- 172.21.15.71:0/1343377435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f100cd010 0x7f2f1015e940 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:57.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.236+0000 7f2f16dff700 1 -- 172.21.15.71:0/1343377435 >> 172.21.15.71:0/1343377435 conn(0x7f2f1006a320 msgr2=0x7f2f100af870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:57.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.237+0000 7f2f16dff700 1 -- 172.21.15.71:0/1343377435 shutdown_connections 2023-10-09T06:57:57.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.237+0000 7f2f16dff700 1 -- 172.21.15.71:0/1343377435 wait complete. 2023-10-09T06:57:57.256 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T06:57:57.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.440+0000 7fd0c299d700 1 Processor -- start 2023-10-09T06:57:57.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.440+0000 7fd0c299d700 1 -- start start 2023-10-09T06:57:57.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.441+0000 7fd0c299d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd0bc159a60 0x7fd0bc0c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:57.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.441+0000 7fd0c299d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd0bc0ccc00 0x7fd0bc069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:57.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.441+0000 7fd0c299d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0bc0c9cb0 con 0x7fd0bc06a020 2023-10-09T06:57:57.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.441+0000 7fd0c299d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0bc06dfc0 con 0x7fd0bc159a60 2023-10-09T06:57:57.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.441+0000 7fd0c299d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0bc0c9f30 con 0x7fd0bc0ccc00 2023-10-09T06:57:57.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.441+0000 7fd0c199b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd0bc159a60 0x7fd0bc0c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:57.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.441+0000 7fd0c199b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd0bc159a60 0x7fd0bc0c9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48228/0 (socket says 172.21.15.71:48228) 2023-10-09T06:57:57.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.441+0000 7fd0c199b700 1 -- 172.21.15.71:0/1884833587 learned_addr learned my addr 172.21.15.71:0/1884833587 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:57.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.442+0000 7fd0c119a700 1 --2- 172.21.15.71:0/1884833587 >> v2:172.21.15.179:3300/0 conn(0x7fd0bc0ccc00 0x7fd0bc069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:57.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.442+0000 7fd0c199b700 1 -- 172.21.15.71:0/1884833587 >> v2:172.21.15.179:3300/0 conn(0x7fd0bc0ccc00 msgr2=0x7fd0bc069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:57.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.442+0000 7fd0c199b700 1 --2- 172.21.15.71:0/1884833587 >> v2:172.21.15.179:3300/0 conn(0x7fd0bc0ccc00 0x7fd0bc069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:57.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.442+0000 7fd0c199b700 1 -- 172.21.15.71:0/1884833587 >> v1:172.21.15.179:6789/0 conn(0x7fd0bc06a020 legacy=0x7fd0bc0cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:57.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.442+0000 7fd0c199b700 1 -- 172.21.15.71:0/1884833587 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0bc0ca470 con 0x7fd0bc159a60 2023-10-09T06:57:57.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.442+0000 7fd0c199b700 1 --2- 172.21.15.71:0/1884833587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0bc159a60 0x7fd0bc0c9770 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc0cf6a0 tx=0x7fd0b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f83c9ba4c5383dc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:57.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.442+0000 7fd0c0999700 1 -- 172.21.15.71:0/1884833587 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b800b8b0 con 0x7fd0bc159a60 2023-10-09T06:57:57.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.442+0000 7fd0c0999700 1 -- 172.21.15.71:0/1884833587 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b800ba10 con 0x7fd0bc159a60 2023-10-09T06:57:57.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.442+0000 7fd0c0999700 1 -- 172.21.15.71:0/1884833587 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b800bdb0 con 0x7fd0bc159a60 2023-10-09T06:57:57.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.443+0000 7fd0c299d700 1 -- 172.21.15.71:0/1884833587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0bc159a60 msgr2=0x7fd0bc0c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:57.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.443+0000 7fd0c299d700 1 --2- 172.21.15.71:0/1884833587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0bc159a60 0x7fd0bc0c9770 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc0cf6a0 tx=0x7fd0b8009250 comp rx=0 tx=0).stop 2023-10-09T06:57:57.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.443+0000 7fd0c299d700 1 -- 172.21.15.71:0/1884833587 shutdown_connections 2023-10-09T06:57:57.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.443+0000 7fd0c299d700 1 --2- 172.21.15.71:0/1884833587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0bc159a60 0x7fd0bc0c9770 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:57.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.443+0000 7fd0c299d700 1 --2- 172.21.15.71:0/1884833587 >> v2:172.21.15.179:3300/0 conn(0x7fd0bc0ccc00 0x7fd0bc069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:57.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.443+0000 7fd0c299d700 1 -- 172.21.15.71:0/1884833587 >> 172.21.15.71:0/1884833587 conn(0x7fd0bc06baa0 msgr2=0x7fd0bc06bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:57.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.443+0000 7fd0c299d700 1 -- 172.21.15.71:0/1884833587 shutdown_connections 2023-10-09T06:57:57.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.443+0000 7fd0c299d700 1 -- 172.21.15.71:0/1884833587 wait complete. 2023-10-09T06:57:57.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.444+0000 7fd0c299d700 1 Processor -- start 2023-10-09T06:57:57.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.444+0000 7fd0c299d700 1 -- start start 2023-10-09T06:57:57.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.445+0000 7fd0c299d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0bc06a020 0x7fd0bc0c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:57.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.445+0000 7fd0c299d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0bc0ccc00 0x7fd0bc14d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:57.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.445+0000 7fd0c299d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0bc159a60 0x7fd0bc06a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:57.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.445+0000 7fd0c299d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc14fa10 con 0x7fd0bc06a020 2023-10-09T06:57:57.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.445+0000 7fd0c299d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc0c6280 con 0x7fd0bc159a60 2023-10-09T06:57:57.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.445+0000 7fd0c299d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc14fcb0 con 0x7fd0bc0ccc00 2023-10-09T06:57:57.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.446+0000 7fd0c199b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0bc06a020 0x7fd0bc0c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:57.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.446+0000 7fd0c199b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0bc06a020 0x7fd0bc0c8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48240/0 (socket says 172.21.15.71:48240) 2023-10-09T06:57:57.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.446+0000 7fd0c199b700 1 -- 172.21.15.71:0/1436490876 learned_addr learned my addr 172.21.15.71:0/1436490876 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:57.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.446+0000 7fd0c219c700 1 --2- 172.21.15.71:0/1436490876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0bc159a60 0x7fd0bc06a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:57.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.446+0000 7fd0c119a700 1 --2- 172.21.15.71:0/1436490876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0bc0ccc00 0x7fd0bc14d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:57.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.446+0000 7fd0c199b700 1 -- 172.21.15.71:0/1436490876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0bc0ccc00 msgr2=0x7fd0bc14d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:57.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.446+0000 7fd0c199b700 1 --2- 172.21.15.71:0/1436490876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0bc0ccc00 0x7fd0bc14d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:57.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.446+0000 7fd0c199b700 1 -- 172.21.15.71:0/1436490876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0bc159a60 msgr2=0x7fd0bc06a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:57.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.446+0000 7fd0c199b700 1 --2- 172.21.15.71:0/1436490876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0bc159a60 0x7fd0bc06a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:57.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.446+0000 7fd0c199b700 1 -- 172.21.15.71:0/1436490876 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b80094f0 con 0x7fd0bc06a020 2023-10-09T06:57:57.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.446+0000 7fd0c219c700 1 --2- 172.21.15.71:0/1436490876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0bc159a60 0x7fd0bc06a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:57:57.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.446+0000 7fd0c119a700 1 --2- 172.21.15.71:0/1436490876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0bc0ccc00 0x7fd0bc14d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:57:57.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.446+0000 7fd0c199b700 1 --2- 172.21.15.71:0/1436490876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0bc06a020 0x7fd0bc0c8540 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009290 tx=0x7fd0b8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:57.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.446+0000 7fd0b1ffb700 1 -- 172.21.15.71:0/1436490876 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8011e60 con 0x7fd0bc06a020 2023-10-09T06:57:57.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.447+0000 7fd0b1ffb700 1 -- 172.21.15.71:0/1436490876 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b8020070 con 0x7fd0bc06a020 2023-10-09T06:57:57.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.447+0000 7fd0b1ffb700 1 -- 172.21.15.71:0/1436490876 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b801b6a0 con 0x7fd0bc06a020 2023-10-09T06:57:57.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.447+0000 7fd0c299d700 1 -- 172.21.15.71:0/1436490876 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0bc0c6520 con 0x7fd0bc06a020 2023-10-09T06:57:57.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.447+0000 7fd0c299d700 1 -- 172.21.15.71:0/1436490876 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0bc14ff90 con 0x7fd0bc06a020 2023-10-09T06:57:57.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.448+0000 7fd0c299d700 1 -- 172.21.15.71:0/1436490876 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0bc0c60f0 con 0x7fd0bc06a020 2023-10-09T06:57:57.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.448+0000 7fd0b1ffb700 1 -- 172.21.15.71:0/1436490876 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd0b8022030 con 0x7fd0bc06a020 2023-10-09T06:57:57.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.449+0000 7fd0b1ffb700 1 --2- 172.21.15.71:0/1436490876 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd0a0066f30 0x7fd0a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:57.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.449+0000 7fd0b1ffb700 1 -- 172.21.15.71:0/1436490876 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5890+0+0 (secure 0 0 0) 0x7fd0b8086590 con 0x7fd0bc06a020 2023-10-09T06:57:57.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.450+0000 7fd0c119a700 1 --2- 172.21.15.71:0/1436490876 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd0a0066f30 0x7fd0a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:57.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.450+0000 7fd0c119a700 1 --2- 172.21.15.71:0/1436490876 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd0a0066f30 0x7fd0a00693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc0b4450 tx=0x7fd0ac008040 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:57.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.453+0000 7fd0b1ffb700 1 -- 172.21.15.71:0/1436490876 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0b8053740 con 0x7fd0bc06a020 2023-10-09T06:57:57.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.643+0000 7fd0c299d700 1 -- 172.21.15.71:0/1436490876 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd0bc0c60f0 con 0x7fd0bc06a020 2023-10-09T06:57:57.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.648+0000 7fd0b1ffb700 1 -- 172.21.15.71:0/1436490876 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd0b8056d60 con 0x7fd0bc06a020 2023-10-09T06:57:57.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.650+0000 7fd0c299d700 1 -- 172.21.15.71:0/1436490876 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd0a0066f30 msgr2=0x7fd0a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:57.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.650+0000 7fd0c299d700 1 --2- 172.21.15.71:0/1436490876 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd0a0066f30 0x7fd0a00693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc0b4450 tx=0x7fd0ac008040 comp rx=0 tx=0).stop 2023-10-09T06:57:57.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.650+0000 7fd0c299d700 1 -- 172.21.15.71:0/1436490876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0bc06a020 msgr2=0x7fd0bc0c8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:57.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.650+0000 7fd0c299d700 1 --2- 172.21.15.71:0/1436490876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0bc06a020 0x7fd0bc0c8540 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009290 tx=0x7fd0b8016000 comp rx=0 tx=0).stop 2023-10-09T06:57:57.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.650+0000 7fd0c299d700 1 -- 172.21.15.71:0/1436490876 shutdown_connections 2023-10-09T06:57:57.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.650+0000 7fd0c299d700 1 --2- 172.21.15.71:0/1436490876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0bc159a60 0x7fd0bc06a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:57.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.650+0000 7fd0c299d700 1 --2- 172.21.15.71:0/1436490876 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd0a0066f30 0x7fd0a00693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:57.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.650+0000 7fd0c299d700 1 --2- 172.21.15.71:0/1436490876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0bc06a020 0x7fd0bc0c8540 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:57.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.650+0000 7fd0c299d700 1 --2- 172.21.15.71:0/1436490876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0bc0ccc00 0x7fd0bc14d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:57.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.650+0000 7fd0c299d700 1 -- 172.21.15.71:0/1436490876 >> 172.21.15.71:0/1436490876 conn(0x7fd0bc06baa0 msgr2=0x7fd0bc158c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:57.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.650+0000 7fd0c299d700 1 -- 172.21.15.71:0/1436490876 shutdown_connections 2023-10-09T06:57:57.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:57.650+0000 7fd0c299d700 1 -- 172.21.15.71:0/1436490876 wait complete. 2023-10-09T06:57:57.669 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:57:57.669 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:57:57.750 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:57:57.837 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:57:57.837 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T06:57:57.837 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:57:58.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.017+0000 7f0a0ffff700 1 Processor -- start 2023-10-09T06:57:58.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.017+0000 7f0a0ffff700 1 -- start start 2023-10-09T06:57:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.018+0000 7f0a0ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a10159420 0x7f0a100b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.018+0000 7f0a0ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0a1015d230 0x7f0a1015d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.018+0000 7f0a0ffff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a1015dbd0 con 0x7f0a101597f0 2023-10-09T06:57:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.018+0000 7f0a0ffff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a100b2980 con 0x7f0a1015d230 2023-10-09T06:57:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.018+0000 7f0a0ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a100b11d0 con 0x7f0a10159420 2023-10-09T06:57:58.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.018+0000 7f0a0effd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a10159420 0x7f0a100b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.018+0000 7f0a0f7fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0a1015d230 0x7f0a1015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.019+0000 7f0a0effd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a10159420 0x7f0a100b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:40066/0 (socket says 172.21.15.71:40066) 2023-10-09T06:57:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.019+0000 7f0a0f7fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0a1015d230 0x7f0a1015d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:60940/0 (socket says 172.21.15.71:60940) 2023-10-09T06:57:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.019+0000 7f0a0effd700 1 -- 172.21.15.71:0/3318568432 learned_addr learned my addr 172.21.15.71:0/3318568432 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.019+0000 7f0a0e7fc700 1 --1- 172.21.15.71:0/3318568432 >> v1:172.21.15.179:6789/0 conn(0x7f0a101597f0 0x7f0a100b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:56982/0 (socket says 172.21.15.71:56982) 2023-10-09T06:57:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.019+0000 7f0a0effd700 1 -- 172.21.15.71:0/3318568432 >> v2:172.21.15.179:3300/0 conn(0x7f0a1015d230 msgr2=0x7f0a1015d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.019+0000 7f0a0effd700 1 --2- 172.21.15.71:0/3318568432 >> v2:172.21.15.179:3300/0 conn(0x7f0a1015d230 0x7f0a1015d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.019+0000 7f0a0effd700 1 -- 172.21.15.71:0/3318568432 >> v1:172.21.15.179:6789/0 conn(0x7f0a101597f0 legacy=0x7f0a100b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.019+0000 7f0a0effd700 1 -- 172.21.15.71:0/3318568432 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a100b14b0 con 0x7f0a10159420 2023-10-09T06:57:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.019+0000 7f0a0effd700 1 --2- 172.21.15.71:0/3318568432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a10159420 0x7f0a100b5f40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0a000099b0 tx=0x7f0a00009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaddb7c6d924b0fb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.020+0000 7f0a0dffb700 1 -- 172.21.15.71:0/3318568432 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a00009ea0 con 0x7f0a10159420 2023-10-09T06:57:58.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.020+0000 7f0a0dffb700 1 -- 172.21.15.71:0/3318568432 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0000b860 con 0x7f0a10159420 2023-10-09T06:57:58.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.020+0000 7f0a0dffb700 1 -- 172.21.15.71:0/3318568432 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0000bc00 con 0x7f0a10159420 2023-10-09T06:57:58.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.020+0000 7f0a0ffff700 1 -- 172.21.15.71:0/3318568432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a10159420 msgr2=0x7f0a100b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:58.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.020+0000 7f0a0ffff700 1 --2- 172.21.15.71:0/3318568432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a10159420 0x7f0a100b5f40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0a000099b0 tx=0x7f0a00009250 comp rx=0 tx=0).stop 2023-10-09T06:57:58.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.020+0000 7f0a0ffff700 1 -- 172.21.15.71:0/3318568432 shutdown_connections 2023-10-09T06:57:58.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.020+0000 7f0a0ffff700 1 --2- 172.21.15.71:0/3318568432 >> v2:172.21.15.179:3300/0 conn(0x7f0a1015d230 0x7f0a1015d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:58.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.020+0000 7f0a0ffff700 1 --2- 172.21.15.71:0/3318568432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a10159420 0x7f0a100b5f40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:58.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.020+0000 7f0a0ffff700 1 -- 172.21.15.71:0/3318568432 >> 172.21.15.71:0/3318568432 conn(0x7f0a100d0660 msgr2=0x7f0a100d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:58.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.020+0000 7f0a0ffff700 1 -- 172.21.15.71:0/3318568432 shutdown_connections 2023-10-09T06:57:58.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.020+0000 7f0a0ffff700 1 -- 172.21.15.71:0/3318568432 wait complete. 2023-10-09T06:57:58.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.022+0000 7f0a0ffff700 1 Processor -- start 2023-10-09T06:57:58.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.022+0000 7f0a0ffff700 1 -- start start 2023-10-09T06:57:58.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.023+0000 7f0a0ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a10159420 0x7f0a101503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:58.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.023+0000 7f0a0ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a101597f0 0x7f0a1015bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:58.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.023+0000 7f0a0ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a1015d230 0x7f0a10152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:58.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.023+0000 7f0a0ffff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a10169ed0 con 0x7f0a1015d230 2023-10-09T06:57:58.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.023+0000 7f0a0ffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a100c5610 con 0x7f0a10159420 2023-10-09T06:57:58.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.023+0000 7f0a0ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a10159ca0 con 0x7f0a101597f0 2023-10-09T06:57:58.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.023+0000 7f0a0f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a1015d230 0x7f0a10152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:58.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.023+0000 7f0a0f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a1015d230 0x7f0a10152390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48250/0 (socket says 172.21.15.71:48250) 2023-10-09T06:57:58.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.023+0000 7f0a0f7fe700 1 -- 172.21.15.71:0/2572558843 learned_addr learned my addr 172.21.15.71:0/2572558843 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:58.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.023+0000 7f0a0e7fc700 1 --2- 172.21.15.71:0/2572558843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a101597f0 0x7f0a1015bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:58.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.023+0000 7f0a0effd700 1 --2- 172.21.15.71:0/2572558843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a10159420 0x7f0a101503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:58.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.023+0000 7f0a0f7fe700 1 -- 172.21.15.71:0/2572558843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a101597f0 msgr2=0x7f0a1015bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:58.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.023+0000 7f0a0f7fe700 1 --2- 172.21.15.71:0/2572558843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a101597f0 0x7f0a1015bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:58.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.023+0000 7f0a0f7fe700 1 -- 172.21.15.71:0/2572558843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a10159420 msgr2=0x7f0a101503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:58.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.023+0000 7f0a0f7fe700 1 --2- 172.21.15.71:0/2572558843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a10159420 0x7f0a101503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:58.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.023+0000 7f0a0f7fe700 1 -- 172.21.15.71:0/2572558843 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a000094f0 con 0x7f0a1015d230 2023-10-09T06:57:58.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.023+0000 7f0a0effd700 1 --2- 172.21.15.71:0/2572558843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a10159420 0x7f0a101503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:58.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.023+0000 7f0a0e7fc700 1 --2- 172.21.15.71:0/2572558843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a101597f0 0x7f0a1015bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:57:58.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.024+0000 7f0a0f7fe700 1 --2- 172.21.15.71:0/2572558843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a1015d230 0x7f0a10152390 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009e20 tx=0x7f0a0800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:58.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.024+0000 7f09f6ffd700 1 -- 172.21.15.71:0/2572558843 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0800cc20 con 0x7f0a1015d230 2023-10-09T06:57:58.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.024+0000 7f09f6ffd700 1 -- 172.21.15.71:0/2572558843 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0800f040 con 0x7f0a1015d230 2023-10-09T06:57:58.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.024+0000 7f0a0ffff700 1 -- 172.21.15.71:0/2572558843 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a10159f80 con 0x7f0a1015d230 2023-10-09T06:57:58.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.024+0000 7f09f6ffd700 1 -- 172.21.15.71:0/2572558843 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a08014480 con 0x7f0a1015d230 2023-10-09T06:57:58.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.024+0000 7f0a0ffff700 1 -- 172.21.15.71:0/2572558843 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a10151fb0 con 0x7f0a1015d230 2023-10-09T06:57:58.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.025+0000 7f0a0ffff700 1 -- 172.21.15.71:0/2572558843 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1004c3c0 con 0x7f0a1015d230 2023-10-09T06:57:58.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.026+0000 7f09f6ffd700 1 -- 172.21.15.71:0/2572558843 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a08014830 con 0x7f0a1015d230 2023-10-09T06:57:58.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.027+0000 7f09f6ffd700 1 --2- 172.21.15.71:0/2572558843 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f09fc066f30 0x7f09fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:58.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.027+0000 7f09f6ffd700 1 -- 172.21.15.71:0/2572558843 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f0a08084f60 con 0x7f0a1015d230 2023-10-09T06:57:58.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.028+0000 7f0a0effd700 1 --2- 172.21.15.71:0/2572558843 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f09fc066f30 0x7f09fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:58.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.028+0000 7f0a0effd700 1 --2- 172.21.15.71:0/2572558843 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f09fc066f30 0x7f09fc0693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0a000099b0 tx=0x7f0a00017000 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:58.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.031+0000 7f09f6ffd700 1 -- 172.21.15.71:0/2572558843 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a08052110 con 0x7f0a1015d230 2023-10-09T06:57:58.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.268+0000 7f0a0ffff700 1 -- 172.21.15.71:0/2572558843 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a100b37c0 con 0x7f0a1015d230 2023-10-09T06:57:58.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.269+0000 7f09f6ffd700 1 -- 172.21.15.71:0/2572558843 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f0a08018de0 con 0x7f0a1015d230 2023-10-09T06:57:58.270 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:57:58.270 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":35,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6055,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3774833170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3774833170},{"type":"v1","addr":"172.21.15.179:6836","nonce":3774833170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6058,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3203736717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3203736717},{"type":"v1","addr":"172.21.15.179:6837","nonce":3203736717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2747804060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2747804060},{"type":"v1","addr":"172.21.15.71:6833","nonce":2747804060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6558,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3117049267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3117049267},{"type":"v1","addr":"172.21.15.71:6835","nonce":3117049267}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[]} 2023-10-09T06:57:58.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.271+0000 7f0a0ffff700 1 -- 172.21.15.71:0/2572558843 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f09fc066f30 msgr2=0x7f09fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:58.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.271+0000 7f0a0ffff700 1 --2- 172.21.15.71:0/2572558843 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f09fc066f30 0x7f09fc0693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0a000099b0 tx=0x7f0a00017000 comp rx=0 tx=0).stop 2023-10-09T06:57:58.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.271+0000 7f0a0ffff700 1 -- 172.21.15.71:0/2572558843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a1015d230 msgr2=0x7f0a10152390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:58.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.271+0000 7f0a0ffff700 1 --2- 172.21.15.71:0/2572558843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a1015d230 0x7f0a10152390 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009e20 tx=0x7f0a0800b040 comp rx=0 tx=0).stop 2023-10-09T06:57:58.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.271+0000 7f0a0ffff700 1 -- 172.21.15.71:0/2572558843 shutdown_connections 2023-10-09T06:57:58.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.271+0000 7f0a0ffff700 1 --2- 172.21.15.71:0/2572558843 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f09fc066f30 0x7f09fc0693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:58.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.271+0000 7f0a0ffff700 1 --2- 172.21.15.71:0/2572558843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a1015d230 0x7f0a10152390 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:58.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.271+0000 7f0a0ffff700 1 --2- 172.21.15.71:0/2572558843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a10159420 0x7f0a101503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:58.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.271+0000 7f0a0ffff700 1 --2- 172.21.15.71:0/2572558843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a101597f0 0x7f0a1015bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:58.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.271+0000 7f0a0ffff700 1 -- 172.21.15.71:0/2572558843 >> 172.21.15.71:0/2572558843 conn(0x7f0a100d0660 msgr2=0x7f0a100b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:58.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.271+0000 7f0a0ffff700 1 -- 172.21.15.71:0/2572558843 shutdown_connections 2023-10-09T06:57:58.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.271+0000 7f0a0ffff700 1 -- 172.21.15.71:0/2572558843 wait complete. 2023-10-09T06:57:58.273 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 35 2023-10-09T06:57:58.289 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T06:57:58.290 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T06:57:58.290 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T06:57:58.290 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:57:58.290 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T06:57:58.290 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T06:57:58.290 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T06:57:58.291 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:57:58.291 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T06:57:58.291 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T06:57:58.291 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T06:57:58.291 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:57:58.291 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T06:57:58.291 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T06:57:58.292 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T06:57:58.292 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:57:58.303 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T06:57:58.303 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T06:57:58.304 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T06:57:58.304 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T06:57:58.307 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T06:57:58.307 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T06:57:58.308 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T06:57:58.308 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T06:57:58.349 INFO:tasks.ceph.mds.a:Started 2023-10-09T06:57:58.349 DEBUG:teuthology.parallel:result is None 2023-10-09T06:57:58.351 INFO:tasks.ceph.mds.c:Started 2023-10-09T06:57:58.351 DEBUG:teuthology.parallel:result is None 2023-10-09T06:57:58.352 INFO:tasks.ceph.mds.b:Started 2023-10-09T06:57:58.352 DEBUG:teuthology.parallel:result is None 2023-10-09T06:57:58.355 INFO:tasks.ceph.mds.d:Started 2023-10-09T06:57:58.355 DEBUG:teuthology.parallel:result is None 2023-10-09T06:57:58.355 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T06:57:58.483 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2023-10-09T06:57:58.484 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-10-09T06:57:58.492 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-09T06:57:58.492 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-09T06:57:58.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.551+0000 7f9074dff700 1 Processor -- start 2023-10-09T06:57:58.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.551+0000 7f9074dff700 1 -- start start 2023-10-09T06:57:58.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.552+0000 7f9074dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9070159890 0x7f907015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:58.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.553+0000 7f9074dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f907015a160 con 0x7f9070159c60 2023-10-09T06:57:58.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.553+0000 7f9074dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90700d13a0 con 0x7f9070069560 2023-10-09T06:57:58.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.553+0000 7f9074dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f907015e140 con 0x7f9070159890 2023-10-09T06:57:58.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.553+0000 7f906e59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9070159890 0x7f907015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:58.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.553+0000 7f906e59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9070159890 0x7f907015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48274/0 (socket says 172.21.15.71:48274) 2023-10-09T06:57:58.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.553+0000 7f906e59c700 1 -- 172.21.15.71:0/4051487910 learned_addr learned my addr 172.21.15.71:0/4051487910 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:58.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.553+0000 7f906dd9b700 1 --1- 172.21.15.71:0/4051487910 >> v1:172.21.15.71:6789/0 conn(0x7f9070159c60 0x7f907015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39502/0 (socket says 172.21.15.71:39502) 2023-10-09T06:57:58.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.553+0000 7f906e59c700 1 -- 172.21.15.71:0/4051487910 >> v1:172.21.15.179:6789/0 conn(0x7f9070069560 legacy=0x7f90700ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:58.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.553+0000 7f906e59c700 1 -- 172.21.15.71:0/4051487910 >> v1:172.21.15.71:6789/0 conn(0x7f9070159c60 legacy=0x7f907015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:58.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.553+0000 7f906e59c700 1 -- 172.21.15.71:0/4051487910 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907015a3d0 con 0x7f9070159890 2023-10-09T06:57:58.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.554+0000 7f906e59c700 1 --2- 172.21.15.71:0/4051487910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9070159890 0x7f907015abd0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f90600099b0 tx=0x7f9060009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5624ce7cbc4f0618 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:58.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.554+0000 7f906d59a700 1 -- 172.21.15.71:0/4051487910 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906000b860 con 0x7f9070159890 2023-10-09T06:57:58.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.554+0000 7f906d59a700 1 -- 172.21.15.71:0/4051487910 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906000b9c0 con 0x7f9070159890 2023-10-09T06:57:58.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.554+0000 7f906d59a700 1 -- 172.21.15.71:0/4051487910 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906000bd60 con 0x7f9070159890 2023-10-09T06:57:58.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.554+0000 7f9074dff700 1 -- 172.21.15.71:0/4051487910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9070159890 msgr2=0x7f907015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:58.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.554+0000 7f9074dff700 1 --2- 172.21.15.71:0/4051487910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9070159890 0x7f907015abd0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f90600099b0 tx=0x7f9060009250 comp rx=0 tx=0).stop 2023-10-09T06:57:58.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.554+0000 7f9074dff700 1 -- 172.21.15.71:0/4051487910 shutdown_connections 2023-10-09T06:57:58.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.554+0000 7f9074dff700 1 --2- 172.21.15.71:0/4051487910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9070159890 0x7f907015abd0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:58.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.554+0000 7f9074dff700 1 -- 172.21.15.71:0/4051487910 >> 172.21.15.71:0/4051487910 conn(0x7f9070068e20 msgr2=0x7f90700d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:58.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.554+0000 7f9074dff700 1 -- 172.21.15.71:0/4051487910 shutdown_connections 2023-10-09T06:57:58.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.554+0000 7f9074dff700 1 -- 172.21.15.71:0/4051487910 wait complete. 2023-10-09T06:57:58.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.556+0000 7f9074dff700 1 Processor -- start 2023-10-09T06:57:58.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.556+0000 7f9074dff700 1 -- start start 2023-10-09T06:57:58.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.557+0000 7f9074dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9070069560 0x7f90700b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:58.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.557+0000 7f9074dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9070159890 0x7f907014d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:58.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.557+0000 7f9074dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9070159c60 0x7f90700cea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:58.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.557+0000 7f9074dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90700b3f50 con 0x7f9070069560 2023-10-09T06:57:58.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.557+0000 7f9074dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90700b4140 con 0x7f9070159890 2023-10-09T06:57:58.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.557+0000 7f9074dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90700b4420 con 0x7f9070159c60 2023-10-09T06:57:58.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.557+0000 7f906e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9070069560 0x7f90700b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:58.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.557+0000 7f906e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9070069560 0x7f90700b51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48280/0 (socket says 172.21.15.71:48280) 2023-10-09T06:57:58.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.557+0000 7f906e59c700 1 -- 172.21.15.71:0/677734087 learned_addr learned my addr 172.21.15.71:0/677734087 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:58.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.557+0000 7f906dd9b700 1 --2- 172.21.15.71:0/677734087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9070159890 0x7f907014d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:58.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.557+0000 7f906ed9d700 1 --2- 172.21.15.71:0/677734087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9070159c60 0x7f90700cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:58.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.558+0000 7f906e59c700 1 -- 172.21.15.71:0/677734087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9070159c60 msgr2=0x7f90700cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:58.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.558+0000 7f906e59c700 1 --2- 172.21.15.71:0/677734087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9070159c60 0x7f90700cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:58.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.558+0000 7f906e59c700 1 -- 172.21.15.71:0/677734087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9070159890 msgr2=0x7f907014d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:58.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.558+0000 7f906e59c700 1 --2- 172.21.15.71:0/677734087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9070159890 0x7f907014d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:58.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.558+0000 7f906e59c700 1 -- 172.21.15.71:0/677734087 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90600094f0 con 0x7f9070069560 2023-10-09T06:57:58.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.558+0000 7f906e59c700 1 --2- 172.21.15.71:0/677734087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9070069560 0x7f90700b51e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f9070070e20 tx=0x7f9060017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:58.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.558+0000 7f905e7fc700 1 -- 172.21.15.71:0/677734087 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9060024440 con 0x7f9070069560 2023-10-09T06:57:58.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.558+0000 7f905e7fc700 1 -- 172.21.15.71:0/677734087 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90600245a0 con 0x7f9070069560 2023-10-09T06:57:58.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.558+0000 7f9074dff700 1 -- 172.21.15.71:0/677734087 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90700b4700 con 0x7f9070069560 2023-10-09T06:57:58.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.558+0000 7f905e7fc700 1 -- 172.21.15.71:0/677734087 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9060024940 con 0x7f9070069560 2023-10-09T06:57:58.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.558+0000 7f9074dff700 1 -- 172.21.15.71:0/677734087 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90700b4d40 con 0x7f9070069560 2023-10-09T06:57:58.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.559+0000 7f9074dff700 1 -- 172.21.15.71:0/677734087 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90700b4ed0 con 0x7f9070069560 2023-10-09T06:57:58.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.560+0000 7f905e7fc700 1 -- 172.21.15.71:0/677734087 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f906001a420 con 0x7f9070069560 2023-10-09T06:57:58.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.561+0000 7f905e7fc700 1 --2- 172.21.15.71:0/677734087 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9050066f60 0x7f9050069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:58.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.561+0000 7f905e7fc700 1 -- 172.21.15.71:0/677734087 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f9060086540 con 0x7f9070069560 2023-10-09T06:57:58.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.562+0000 7f906dd9b700 1 --2- 172.21.15.71:0/677734087 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9050066f60 0x7f9050069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:58.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.562+0000 7f906dd9b700 1 --2- 172.21.15.71:0/677734087 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9050066f60 0x7f9050069410 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f90700b01d0 tx=0x7f9064007eb0 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:58.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.565+0000 7f905e7fc700 1 -- 172.21.15.71:0/677734087 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9060053700 con 0x7f9070069560 2023-10-09T06:57:58.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:58.775+0000 7f9074dff700 1 -- 172.21.15.71:0/677734087 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f907004c3c0 con 0x7f9070069560 2023-10-09T06:57:59.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.766+0000 7f905e7fc700 1 -- 172.21.15.71:0/677734087 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v89) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9060056d20 con 0x7f9070069560 2023-10-09T06:57:59.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.769+0000 7f9074dff700 1 -- 172.21.15.71:0/677734087 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9050066f60 msgr2=0x7f9050069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:59.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.769+0000 7f9074dff700 1 --2- 172.21.15.71:0/677734087 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9050066f60 0x7f9050069410 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f90700b01d0 tx=0x7f9064007eb0 comp rx=0 tx=0).stop 2023-10-09T06:57:59.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.769+0000 7f9074dff700 1 -- 172.21.15.71:0/677734087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9070069560 msgr2=0x7f90700b51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:59.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.769+0000 7f9074dff700 1 --2- 172.21.15.71:0/677734087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9070069560 0x7f90700b51e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f9070070e20 tx=0x7f9060017000 comp rx=0 tx=0).stop 2023-10-09T06:57:59.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.769+0000 7f9074dff700 1 -- 172.21.15.71:0/677734087 shutdown_connections 2023-10-09T06:57:59.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.769+0000 7f9074dff700 1 --2- 172.21.15.71:0/677734087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9070159c60 0x7f90700cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:59.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.769+0000 7f9074dff700 1 --2- 172.21.15.71:0/677734087 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9050066f60 0x7f9050069410 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:59.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.769+0000 7f9074dff700 1 --2- 172.21.15.71:0/677734087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9070069560 0x7f90700b51e0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:59.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.769+0000 7f9074dff700 1 --2- 172.21.15.71:0/677734087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9070159890 0x7f907014d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:59.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.769+0000 7f9074dff700 1 -- 172.21.15.71:0/677734087 >> 172.21.15.71:0/677734087 conn(0x7f9070068e20 msgr2=0x7f90700b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:59.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.769+0000 7f9074dff700 1 -- 172.21.15.71:0/677734087 shutdown_connections 2023-10-09T06:57:59.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.769+0000 7f9074dff700 1 -- 172.21.15.71:0/677734087 wait complete. 2023-10-09T06:57:59.772 INFO:teuthology.orchestra.run.smithi071.stderr: removed all blocklist entries 2023-10-09T06:57:59.791 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T06:57:59.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.974+0000 7f62a97ff700 1 Processor -- start 2023-10-09T06:57:59.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.974+0000 7f62a97ff700 1 -- start start 2023-10-09T06:57:59.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.976+0000 7f62a97ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f62a4155c10 0x7f62a4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:59.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.976+0000 7f62a97ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a40ac6d0 0x7f62a40b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:59.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.976+0000 7f62a97ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a40acac0 con 0x7f62a40ac230 2023-10-09T06:57:59.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.976+0000 7f62a97ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a40ad930 con 0x7f62a4155c10 2023-10-09T06:57:59.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.976+0000 7f62a97ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a40acd20 con 0x7f62a40ac6d0 2023-10-09T06:57:59.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.976+0000 7f62a2ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f62a4155c10 0x7f62a4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:59.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.976+0000 7f62a37fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a40ac6d0 0x7f62a40b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:59.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.976+0000 7f62a2ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f62a4155c10 0x7f62a4155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:32778/0 (socket says 172.21.15.71:32778) 2023-10-09T06:57:59.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.976+0000 7f62a37fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a40ac6d0 0x7f62a40b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:40126/0 (socket says 172.21.15.71:40126) 2023-10-09T06:57:59.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.976+0000 7f62a2ffd700 1 -- 172.21.15.71:0/3484443533 learned_addr learned my addr 172.21.15.71:0/3484443533 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:59.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.977+0000 7f62a2ffd700 1 -- 172.21.15.71:0/3484443533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a40ac6d0 msgr2=0x7f62a40b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:57:59.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.977+0000 7f62a2ffd700 1 --2- 172.21.15.71:0/3484443533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a40ac6d0 0x7f62a40b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:59.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.977+0000 7f62a2ffd700 1 -- 172.21.15.71:0/3484443533 >> v1:172.21.15.179:6789/0 conn(0x7f62a40ac230 legacy=0x7f62a41568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:59.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.977+0000 7f62a2ffd700 1 -- 172.21.15.71:0/3484443533 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a40ad000 con 0x7f62a4155c10 2023-10-09T06:57:59.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.977+0000 7f62a2ffd700 1 --2- 172.21.15.71:0/3484443533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a4155c10 0x7f62a4155fe0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f62a40acc50 tx=0x7f629400b4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbfacb282c7847d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:59.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.977+0000 7f62a1ffb700 1 -- 172.21.15.71:0/3484443533 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629400da60 con 0x7f62a4155c10 2023-10-09T06:57:59.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.978+0000 7f62a1ffb700 1 -- 172.21.15.71:0/3484443533 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629400dbc0 con 0x7f62a4155c10 2023-10-09T06:57:59.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.978+0000 7f62a1ffb700 1 -- 172.21.15.71:0/3484443533 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6294017410 con 0x7f62a4155c10 2023-10-09T06:57:59.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.978+0000 7f62a97ff700 1 -- 172.21.15.71:0/3484443533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a4155c10 msgr2=0x7f62a4155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:59.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.978+0000 7f62a97ff700 1 --2- 172.21.15.71:0/3484443533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a4155c10 0x7f62a4155fe0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f62a40acc50 tx=0x7f629400b4e0 comp rx=0 tx=0).stop 2023-10-09T06:57:59.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.978+0000 7f62a97ff700 1 -- 172.21.15.71:0/3484443533 shutdown_connections 2023-10-09T06:57:59.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.978+0000 7f62a97ff700 1 --2- 172.21.15.71:0/3484443533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a40ac6d0 0x7f62a40b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:59.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.978+0000 7f62a97ff700 1 --2- 172.21.15.71:0/3484443533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a4155c10 0x7f62a4155fe0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:59.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.978+0000 7f62a97ff700 1 -- 172.21.15.71:0/3484443533 >> 172.21.15.71:0/3484443533 conn(0x7f62a406a320 msgr2=0x7f62a40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:57:59.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.978+0000 7f62a97ff700 1 -- 172.21.15.71:0/3484443533 shutdown_connections 2023-10-09T06:57:59.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.978+0000 7f62a97ff700 1 -- 172.21.15.71:0/3484443533 wait complete. 2023-10-09T06:57:59.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.980+0000 7f62a97ff700 1 Processor -- start 2023-10-09T06:57:59.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.980+0000 7f62a97ff700 1 -- start start 2023-10-09T06:57:59.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.981+0000 7f62a97ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a40ac230 0x7f62a414e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:59.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.981+0000 7f62a97ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a40ac6d0 0x7f62a415b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:59.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.981+0000 7f62a97ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62a4155c10 0x7f62a40afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:59.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.981+0000 7f62a97ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a415b210 con 0x7f62a4155c10 2023-10-09T06:57:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.981+0000 7f62a97ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a415a7c0 con 0x7f62a40ac230 2023-10-09T06:57:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.981+0000 7f62a97ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a4156a60 con 0x7f62a40ac6d0 2023-10-09T06:57:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.981+0000 7f62a37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62a4155c10 0x7f62a40afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.981+0000 7f62a37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62a4155c10 0x7f62a40afad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48286/0 (socket says 172.21.15.71:48286) 2023-10-09T06:57:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.981+0000 7f62a37fe700 1 -- 172.21.15.71:0/715498048 learned_addr learned my addr 172.21.15.71:0/715498048 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:57:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.981+0000 7f62a2ffd700 1 --2- 172.21.15.71:0/715498048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a40ac230 0x7f62a414e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.981+0000 7f62a27fc700 1 --2- 172.21.15.71:0/715498048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a40ac6d0 0x7f62a415b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.982+0000 7f62a37fe700 1 -- 172.21.15.71:0/715498048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a40ac6d0 msgr2=0x7f62a415b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.982+0000 7f62a37fe700 1 --2- 172.21.15.71:0/715498048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a40ac6d0 0x7f62a415b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.982+0000 7f62a37fe700 1 -- 172.21.15.71:0/715498048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a40ac230 msgr2=0x7f62a414e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:57:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.982+0000 7f62a37fe700 1 --2- 172.21.15.71:0/715498048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a40ac230 0x7f62a414e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:57:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.982+0000 7f62a37fe700 1 -- 172.21.15.71:0/715498048 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629400b780 con 0x7f62a4155c10 2023-10-09T06:57:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.982+0000 7f62a37fe700 1 --2- 172.21.15.71:0/715498048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62a4155c10 0x7f62a40afad0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f629c009e90 tx=0x7f629c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.982+0000 7f628affd700 1 -- 172.21.15.71:0/715498048 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c00cb70 con 0x7f62a4155c10 2023-10-09T06:57:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.982+0000 7f628affd700 1 -- 172.21.15.71:0/715498048 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c00f040 con 0x7f62a4155c10 2023-10-09T06:57:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.982+0000 7f628affd700 1 -- 172.21.15.71:0/715498048 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c014480 con 0x7f62a4155c10 2023-10-09T06:57:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.982+0000 7f62a97ff700 1 -- 172.21.15.71:0/715498048 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a414e850 con 0x7f62a4155c10 2023-10-09T06:57:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.982+0000 7f62a97ff700 1 -- 172.21.15.71:0/715498048 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a415ac50 con 0x7f62a4155c10 2023-10-09T06:57:59.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.983+0000 7f62a97ff700 1 -- 172.21.15.71:0/715498048 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a4156bd0 con 0x7f62a4155c10 2023-10-09T06:57:59.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.984+0000 7f628affd700 1 -- 172.21.15.71:0/715498048 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f629c014830 con 0x7f62a4155c10 2023-10-09T06:57:59.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.986+0000 7f628affd700 1 --2- 172.21.15.71:0/715498048 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6290066f30 0x7f62900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:57:59.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.986+0000 7f628affd700 1 -- 172.21.15.71:0/715498048 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f629c084d90 con 0x7f62a4155c10 2023-10-09T06:57:59.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.986+0000 7f62a2ffd700 1 --2- 172.21.15.71:0/715498048 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6290066f30 0x7f62900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:57:59.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.987+0000 7f62a2ffd700 1 --2- 172.21.15.71:0/715498048 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6290066f30 0x7f62900693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f629400b520 tx=0x7f6294019000 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:57:59.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:57:59.990+0000 7f628affd700 1 -- 172.21.15.71:0/715498048 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f629c0521d0 con 0x7f62a4155c10 2023-10-09T06:58:00.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.254+0000 7f62a97ff700 1 -- 172.21.15.71:0/715498048 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f62a404c3c0 con 0x7f62a4155c10 2023-10-09T06:58:00.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.254+0000 7f628affd700 1 -- 172.21.15.71:0/715498048 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f629c0557f0 con 0x7f62a4155c10 2023-10-09T06:58:00.256 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:00.256 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T06:58:00.256 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_dump": [ 2023-10-09T06:58:00.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:00.256 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.a", 2023-10-09T06:58:00.256 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlpI5JCRAAGBgrs6g+6KZFXv1eq0fkwQ==", 2023-10-09T06:58:00.256 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:00.256 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:58:00.256 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:58:00.256 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:58:00.256 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:00.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:00.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:00.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:00.257 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.b", 2023-10-09T06:58:00.257 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlDZQYHhAA2LGKHPLrBVKlGMK0TKup7A==", 2023-10-09T06:58:00.257 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:00.257 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:58:00.257 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:58:00.257 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:58:00.257 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:00.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:00.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:00.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:00.258 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.c", 2023-10-09T06:58:00.258 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlLKKfExAA65+KIyYd16iQ2L5topDPkg==", 2023-10-09T06:58:00.258 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:00.258 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:58:00.258 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:58:00.258 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:58:00.258 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:00.258 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:00.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:00.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:00.259 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.d", 2023-10-09T06:58:00.259 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlpQKTKBAAP59h/znElthIdqbK9tKJww==", 2023-10-09T06:58:00.259 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:00.259 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:58:00.259 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:58:00.259 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:58:00.259 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:00.259 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:00.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:00.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:00.259 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.0", 2023-10-09T06:58:00.259 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCgoCNll7hBIBAAtZ8mBx+MPAwEou48boP4Hw==", 2023-10-09T06:58:00.260 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:00.260 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:58:00.260 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:58:00.260 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:00.260 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:00.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:00.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:00.260 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.1", 2023-10-09T06:58:00.260 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCjoCNl7uRMIxAAztQi4ZsulyN2FHcMRzZ82Q==", 2023-10-09T06:58:00.261 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:00.261 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:58:00.261 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:58:00.261 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:00.261 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:00.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:00.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:00.261 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.2", 2023-10-09T06:58:00.261 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCmoCNlW/cNJhAAfFdnRC95YJwpCngJS956cA==", 2023-10-09T06:58:00.262 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:00.262 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:58:00.262 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:58:00.262 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:00.262 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:00.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:00.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:00.262 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.3", 2023-10-09T06:58:00.262 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCpoCNlAIlYKRAAD5IGHWZ14ckpQAU4wBifbg==", 2023-10-09T06:58:00.262 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:00.262 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:58:00.262 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:58:00.263 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:00.263 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:00.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:00.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:00.263 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.4", 2023-10-09T06:58:00.263 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCvoCNltrA4ORAAtifmL9hr1xKd+jsMf5Nf+Q==", 2023-10-09T06:58:00.263 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:00.263 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:58:00.263 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:58:00.263 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:00.263 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:00.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:00.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:00.264 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.5", 2023-10-09T06:58:00.264 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCyoCNlA/IOOxAAQWRPQ+00o9xrpScAvY/87w==", 2023-10-09T06:58:00.264 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:00.264 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:58:00.264 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:58:00.264 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:00.264 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:00.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:00.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:00.265 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.6", 2023-10-09T06:58:00.265 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQC2oCNlvRusARAAcRaGyCROIRVTHeKhrncN8g==", 2023-10-09T06:58:00.265 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:00.265 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:58:00.265 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:58:00.265 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:00.265 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:00.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:00.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:00.265 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.7", 2023-10-09T06:58:00.265 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQC5oCNli/3NAxAAIMYuED41ZSx1xF384N6y1A==", 2023-10-09T06:58:00.265 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:00.266 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:58:00.266 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:58:00.266 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:00.266 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:00.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:00.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:00.266 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.0", 2023-10-09T06:58:00.266 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlHrKWMRAAyIfmryGSgqIFwWEJyixprw==", 2023-10-09T06:58:00.266 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:00.266 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:58:00.266 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow r", 2023-10-09T06:58:00.267 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T06:58:00.267 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:00.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:00.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:00.267 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.1", 2023-10-09T06:58:00.267 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCdoCNldq1xAxAAxCpmelS0qDEY187u19JkcQ==", 2023-10-09T06:58:00.267 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:00.267 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:58:00.267 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T06:58:00.267 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T06:58:00.267 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T06:58:00.267 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:00.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:00.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:00.268 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.2", 2023-10-09T06:58:00.268 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlM3JHOBAA8fszREXH+WnYb+3vIaakcA==", 2023-10-09T06:58:00.268 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:00.268 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:58:00.268 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T06:58:00.268 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T06:58:00.268 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T06:58:00.268 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:00.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:00.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:00.269 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.3", 2023-10-09T06:58:00.269 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCdoCNlgkEqChAAwntdv9UOo30x40pVa70yag==", 2023-10-09T06:58:00.269 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:00.269 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:58:00.269 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T06:58:00.269 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T06:58:00.269 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T06:58:00.269 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:00.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:00.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:00.269 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.admin", 2023-10-09T06:58:00.270 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCboCNlj2W4EhAAUnfX6NBeDyMj2nY/G2ciEg==", 2023-10-09T06:58:00.270 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:00.270 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T06:58:00.270 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:58:00.270 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:58:00.270 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:00.270 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:00.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:00.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:00.270 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.x", 2023-10-09T06:58:00.270 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlwwJ/AhAAjHMhAX1/yWgh9no7yQqP6Q==", 2023-10-09T06:58:00.271 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:00.271 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T06:58:00.271 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-09T06:58:00.271 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:00.271 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:00.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:00.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:00.271 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.y", 2023-10-09T06:58:00.271 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCboCNly/XVNRAAlKr9arCbsDbzZ9bpIU5dng==", 2023-10-09T06:58:00.271 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:00.272 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T06:58:00.272 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-09T06:58:00.272 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:00.272 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:00.273 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:00.273 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2023-10-09T06:58:00.273 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T06:58:00.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.257+0000 7f62a97ff700 1 -- 172.21.15.71:0/715498048 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6290066f30 msgr2=0x7f62900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:00.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.257+0000 7f62a97ff700 1 --2- 172.21.15.71:0/715498048 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6290066f30 0x7f62900693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f629400b520 tx=0x7f6294019000 comp rx=0 tx=0).stop 2023-10-09T06:58:00.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.257+0000 7f62a97ff700 1 -- 172.21.15.71:0/715498048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62a4155c10 msgr2=0x7f62a40afad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:00.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.257+0000 7f62a97ff700 1 --2- 172.21.15.71:0/715498048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62a4155c10 0x7f62a40afad0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f629c009e90 tx=0x7f629c00b040 comp rx=0 tx=0).stop 2023-10-09T06:58:00.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.257+0000 7f62a97ff700 1 -- 172.21.15.71:0/715498048 shutdown_connections 2023-10-09T06:58:00.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.257+0000 7f62a97ff700 1 --2- 172.21.15.71:0/715498048 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6290066f30 0x7f62900693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:00.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.257+0000 7f62a97ff700 1 --2- 172.21.15.71:0/715498048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62a4155c10 0x7f62a40afad0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:00.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.257+0000 7f62a97ff700 1 --2- 172.21.15.71:0/715498048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a40ac230 0x7f62a414e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:00.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.257+0000 7f62a97ff700 1 --2- 172.21.15.71:0/715498048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a40ac6d0 0x7f62a415b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:00.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.257+0000 7f62a97ff700 1 -- 172.21.15.71:0/715498048 >> 172.21.15.71:0/715498048 conn(0x7f62a406a320 msgr2=0x7f62a4153540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:00.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.257+0000 7f62a97ff700 1 -- 172.21.15.71:0/715498048 shutdown_connections 2023-10-09T06:58:00.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.257+0000 7f62a97ff700 1 -- 172.21.15.71:0/715498048 wait complete. 2023-10-09T06:58:00.276 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:58:00.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.457+0000 7f49aa3ff700 1 Processor -- start 2023-10-09T06:58:00.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.457+0000 7f49aa3ff700 1 -- start start 2023-10-09T06:58:00.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.458+0000 7f49aa3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f49a41599e0 0x7f49a4069ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:00.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.458+0000 7f49aa3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a4159db0 0x7f49a4069080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:00.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.458+0000 7f49aa3ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f49a406a2b0 0x7f49a406a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:00.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.458+0000 7f49aa3ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a40c96a0 con 0x7f49a406a2b0 2023-10-09T06:58:00.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.458+0000 7f49aa3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a40cb9e0 con 0x7f49a41599e0 2023-10-09T06:58:00.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.458+0000 7f49aa3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a40cab60 con 0x7f49a4159db0 2023-10-09T06:58:00.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.459+0000 7f49a899c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f49a406a2b0 0x7f49a406a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:00.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.459+0000 7f49a899c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f49a406a2b0 0x7f49a406a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48300/0 (socket says 172.21.15.71:48300) 2023-10-09T06:58:00.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.459+0000 7f49a899c700 1 -- 172.21.15.71:0/2083364052 learned_addr learned my addr 172.21.15.71:0/2083364052 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:00.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.459+0000 7f49a3fff700 1 --2- 172.21.15.71:0/2083364052 >> v2:172.21.15.179:3300/0 conn(0x7f49a41599e0 0x7f49a4069ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:00.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.459+0000 7f49a37fe700 1 --2- 172.21.15.71:0/2083364052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a4159db0 0x7f49a4069080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:00.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.459+0000 7f49a899c700 1 -- 172.21.15.71:0/2083364052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a4159db0 msgr2=0x7f49a4069080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:00.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.459+0000 7f49a899c700 1 --2- 172.21.15.71:0/2083364052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a4159db0 0x7f49a4069080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:00.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.459+0000 7f49a899c700 1 -- 172.21.15.71:0/2083364052 >> v2:172.21.15.179:3300/0 conn(0x7f49a41599e0 msgr2=0x7f49a4069ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:00.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.459+0000 7f49a899c700 1 --2- 172.21.15.71:0/2083364052 >> v2:172.21.15.179:3300/0 conn(0x7f49a41599e0 0x7f49a4069ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:00.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.459+0000 7f49a899c700 1 -- 172.21.15.71:0/2083364052 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a40cb420 con 0x7f49a406a2b0 2023-10-09T06:58:00.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.459+0000 7f49a37fe700 1 --2- 172.21.15.71:0/2083364052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a4159db0 0x7f49a4069080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:00.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.459+0000 7f49a899c700 1 --2- 172.21.15.71:0/2083364052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49a406a2b0 0x7f49a406a710 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f49a40712e0 tx=0x7f499c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2a65c2d6569f19 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:00.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.460+0000 7f49a2ffd700 1 -- 172.21.15.71:0/2083364052 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c00e070 con 0x7f49a406a2b0 2023-10-09T06:58:00.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.460+0000 7f49a2ffd700 1 -- 172.21.15.71:0/2083364052 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c00ba50 con 0x7f49a406a2b0 2023-10-09T06:58:00.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.460+0000 7f49a2ffd700 1 -- 172.21.15.71:0/2083364052 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c0092e0 con 0x7f49a406a2b0 2023-10-09T06:58:00.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.460+0000 7f49aa3ff700 1 -- 172.21.15.71:0/2083364052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49a406a2b0 msgr2=0x7f49a406a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:00.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.460+0000 7f49aa3ff700 1 --2- 172.21.15.71:0/2083364052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49a406a2b0 0x7f49a406a710 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f49a40712e0 tx=0x7f499c009840 comp rx=0 tx=0).stop 2023-10-09T06:58:00.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.460+0000 7f49aa3ff700 1 -- 172.21.15.71:0/2083364052 shutdown_connections 2023-10-09T06:58:00.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.460+0000 7f49aa3ff700 1 --2- 172.21.15.71:0/2083364052 >> v2:172.21.15.179:3300/0 conn(0x7f49a41599e0 0x7f49a4069ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:00.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.460+0000 7f49aa3ff700 1 --2- 172.21.15.71:0/2083364052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49a406a2b0 0x7f49a406a710 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:00.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.460+0000 7f49aa3ff700 1 --2- 172.21.15.71:0/2083364052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a4159db0 0x7f49a4069080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:00.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.460+0000 7f49aa3ff700 1 -- 172.21.15.71:0/2083364052 >> 172.21.15.71:0/2083364052 conn(0x7f49a40c9860 msgr2=0x7f49a40c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:00.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.460+0000 7f49aa3ff700 1 -- 172.21.15.71:0/2083364052 shutdown_connections 2023-10-09T06:58:00.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.460+0000 7f49aa3ff700 1 -- 172.21.15.71:0/2083364052 wait complete. 2023-10-09T06:58:00.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.462+0000 7f49aa3ff700 1 Processor -- start 2023-10-09T06:58:00.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.462+0000 7f49aa3ff700 1 -- start start 2023-10-09T06:58:00.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.463+0000 7f49aa3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a406a2b0 0x7f49a4155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:00.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.463+0000 7f49aa3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49a41599e0 0x7f49a4150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:00.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.463+0000 7f49aa3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a4159db0 0x7f49a40b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:00.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.463+0000 7f49aa3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a4151360 con 0x7f49a41599e0 2023-10-09T06:58:00.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.463+0000 7f49aa3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a40c4b90 con 0x7f49a4159db0 2023-10-09T06:58:00.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.463+0000 7f49aa3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a415bef0 con 0x7f49a406a2b0 2023-10-09T06:58:00.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.463+0000 7f49a37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49a41599e0 0x7f49a4150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:00.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.463+0000 7f49a37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49a41599e0 0x7f49a4150e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48314/0 (socket says 172.21.15.71:48314) 2023-10-09T06:58:00.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.463+0000 7f49a37fe700 1 -- 172.21.15.71:0/3208757178 learned_addr learned my addr 172.21.15.71:0/3208757178 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:00.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.463+0000 7f49a3fff700 1 --2- 172.21.15.71:0/3208757178 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a406a2b0 0x7f49a4155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:00.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.463+0000 7f49a899c700 1 --2- 172.21.15.71:0/3208757178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a4159db0 0x7f49a40b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:00.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.463+0000 7f49a37fe700 1 -- 172.21.15.71:0/3208757178 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a406a2b0 msgr2=0x7f49a4155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:00.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.463+0000 7f49a37fe700 1 --2- 172.21.15.71:0/3208757178 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a406a2b0 0x7f49a4155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:00.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.463+0000 7f49a37fe700 1 -- 172.21.15.71:0/3208757178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a4159db0 msgr2=0x7f49a40b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:00.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.463+0000 7f49a37fe700 1 --2- 172.21.15.71:0/3208757178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a4159db0 0x7f49a40b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:00.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.463+0000 7f49a37fe700 1 -- 172.21.15.71:0/3208757178 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c009ae0 con 0x7f49a41599e0 2023-10-09T06:58:00.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.463+0000 7f49a899c700 1 --2- 172.21.15.71:0/3208757178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a4159db0 0x7f49a40b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:00.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.463+0000 7f49a3fff700 1 --2- 172.21.15.71:0/3208757178 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a406a2b0 0x7f49a4155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:00.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.463+0000 7f49a37fe700 1 --2- 172.21.15.71:0/3208757178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49a41599e0 0x7f49a4150e20 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f499800c850 tx=0x7f4998008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:00.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.464+0000 7f498bfff700 1 -- 172.21.15.71:0/3208757178 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4998011600 con 0x7f49a41599e0 2023-10-09T06:58:00.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.464+0000 7f498bfff700 1 -- 172.21.15.71:0/3208757178 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4998011760 con 0x7f49a41599e0 2023-10-09T06:58:00.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.464+0000 7f49aa3ff700 1 -- 172.21.15.71:0/3208757178 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a4155720 con 0x7f49a41599e0 2023-10-09T06:58:00.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.464+0000 7f498bfff700 1 -- 172.21.15.71:0/3208757178 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4998011b00 con 0x7f49a41599e0 2023-10-09T06:58:00.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.464+0000 7f49aa3ff700 1 -- 172.21.15.71:0/3208757178 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a415b8a0 con 0x7f49a41599e0 2023-10-09T06:58:00.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.465+0000 7f49aa3ff700 1 -- 172.21.15.71:0/3208757178 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a404c3c0 con 0x7f49a41599e0 2023-10-09T06:58:00.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.466+0000 7f498bfff700 1 -- 172.21.15.71:0/3208757178 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49980073b0 con 0x7f49a41599e0 2023-10-09T06:58:00.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.466+0000 7f498bfff700 1 --2- 172.21.15.71:0/3208757178 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4990066f30 0x7f49900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:00.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.466+0000 7f498bfff700 1 -- 172.21.15.71:0/3208757178 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f49980842b0 con 0x7f49a41599e0 2023-10-09T06:58:00.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.467+0000 7f49a3fff700 1 --2- 172.21.15.71:0/3208757178 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4990066f30 0x7f49900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:00.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.468+0000 7f49a3fff700 1 --2- 172.21.15.71:0/3208757178 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4990066f30 0x7f49900693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4994006fd0 tx=0x7f4994008040 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:00.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.470+0000 7f498bfff700 1 -- 172.21.15.71:0/3208757178 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4998055180 con 0x7f49a41599e0 2023-10-09T06:58:00.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.662+0000 7f49aa3ff700 1 -- 172.21.15.71:0/3208757178 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49a40cb700 con 0x7f49a41599e0 2023-10-09T06:58:00.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.663+0000 7f498bfff700 1 -- 172.21.15.71:0/3208757178 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+12728 (secure 0 0 0) 0x7f4998054d10 con 0x7f49a41599e0 2023-10-09T06:58:00.664 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:00.664 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":89,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:57:59.761948+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:58:00.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.665+0000 7f49aa3ff700 1 -- 172.21.15.71:0/3208757178 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4990066f30 msgr2=0x7f49900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:00.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.665+0000 7f49aa3ff700 1 --2- 172.21.15.71:0/3208757178 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4990066f30 0x7f49900693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4994006fd0 tx=0x7f4994008040 comp rx=0 tx=0).stop 2023-10-09T06:58:00.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.665+0000 7f49aa3ff700 1 -- 172.21.15.71:0/3208757178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49a41599e0 msgr2=0x7f49a4150e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:00.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.665+0000 7f49aa3ff700 1 --2- 172.21.15.71:0/3208757178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49a41599e0 0x7f49a4150e20 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f499800c850 tx=0x7f4998008040 comp rx=0 tx=0).stop 2023-10-09T06:58:00.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.665+0000 7f49aa3ff700 1 -- 172.21.15.71:0/3208757178 shutdown_connections 2023-10-09T06:58:00.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.665+0000 7f49aa3ff700 1 --2- 172.21.15.71:0/3208757178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a4159db0 0x7f49a40b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:00.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.665+0000 7f49aa3ff700 1 --2- 172.21.15.71:0/3208757178 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a406a2b0 0x7f49a4155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:00.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.665+0000 7f49aa3ff700 1 --2- 172.21.15.71:0/3208757178 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4990066f30 0x7f49900693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:00.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.665+0000 7f49aa3ff700 1 --2- 172.21.15.71:0/3208757178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49a41599e0 0x7f49a4150e20 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:00.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.665+0000 7f49aa3ff700 1 -- 172.21.15.71:0/3208757178 >> 172.21.15.71:0/3208757178 conn(0x7f49a40c9860 msgr2=0x7f49a4151b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:00.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.665+0000 7f49aa3ff700 1 -- 172.21.15.71:0/3208757178 shutdown_connections 2023-10-09T06:58:00.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.665+0000 7f49aa3ff700 1 -- 172.21.15.71:0/3208757178 wait complete. 2023-10-09T06:58:00.684 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T06:58:00.684 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:58:00.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.868+0000 7fca90bff700 1 Processor -- start 2023-10-09T06:58:00.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.868+0000 7fca90bff700 1 -- start start 2023-10-09T06:58:00.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.870+0000 7fca90bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fca8c155eb0 0x7fca8c06e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:00.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.870+0000 7fca90bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fca8c069e80 0x7fca8c0ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:00.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.870+0000 7fca90bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca8c06eb90 con 0x7fca8c0c70b0 2023-10-09T06:58:00.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.870+0000 7fca90bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca8c06ee70 con 0x7fca8c155eb0 2023-10-09T06:58:00.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.870+0000 7fca90bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca8c06f150 con 0x7fca8c069e80 2023-10-09T06:58:00.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.870+0000 7fca8a59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fca8c155eb0 0x7fca8c06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:00.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.870+0000 7fca8a59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fca8c155eb0 0x7fca8c06e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48330/0 (socket says 172.21.15.71:48330) 2023-10-09T06:58:00.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.870+0000 7fca8a59c700 1 -- 172.21.15.71:0/775252439 learned_addr learned my addr 172.21.15.71:0/775252439 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:00.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.870+0000 7fca83fff700 1 --1- 172.21.15.71:0/775252439 >> v1:172.21.15.71:6789/0 conn(0x7fca8c0c70b0 0x7fca8c069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39508/0 (socket says 172.21.15.71:39508) 2023-10-09T06:58:00.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.870+0000 7fca8ad9d700 1 --2- 172.21.15.71:0/775252439 >> v2:172.21.15.179:3300/0 conn(0x7fca8c069e80 0x7fca8c0ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:00.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.870+0000 7fca8a59c700 1 -- 172.21.15.71:0/775252439 >> v2:172.21.15.179:3300/0 conn(0x7fca8c069e80 msgr2=0x7fca8c0ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:00.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.870+0000 7fca8a59c700 1 --2- 172.21.15.71:0/775252439 >> v2:172.21.15.179:3300/0 conn(0x7fca8c069e80 0x7fca8c0ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:00.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.870+0000 7fca8a59c700 1 -- 172.21.15.71:0/775252439 >> v1:172.21.15.71:6789/0 conn(0x7fca8c0c70b0 legacy=0x7fca8c069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:00.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.870+0000 7fca8a59c700 1 -- 172.21.15.71:0/775252439 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c06f430 con 0x7fca8c155eb0 2023-10-09T06:58:00.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.870+0000 7fca89d9b700 1 -- 172.21.15.71:0/775252439 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586968407 0 0) 0x7fca8c06eb90 con 0x7fca8c0c70b0 2023-10-09T06:58:00.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.871+0000 7fca8a59c700 1 --2- 172.21.15.71:0/775252439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca8c155eb0 0x7fca8c06e240 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fca8c06d270 tx=0x7fca7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ee2fa4a73d42d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:00.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.871+0000 7fca89d9b700 1 -- 172.21.15.71:0/775252439 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c00b860 con 0x7fca8c155eb0 2023-10-09T06:58:00.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.871+0000 7fca89d9b700 1 -- 172.21.15.71:0/775252439 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c00b9c0 con 0x7fca8c155eb0 2023-10-09T06:58:00.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.871+0000 7fca89d9b700 1 -- 172.21.15.71:0/775252439 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c00bd60 con 0x7fca8c155eb0 2023-10-09T06:58:00.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.871+0000 7fca90bff700 1 -- 172.21.15.71:0/775252439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca8c155eb0 msgr2=0x7fca8c06e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:00.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.871+0000 7fca90bff700 1 --2- 172.21.15.71:0/775252439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca8c155eb0 0x7fca8c06e240 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fca8c06d270 tx=0x7fca7c009250 comp rx=0 tx=0).stop 2023-10-09T06:58:00.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.871+0000 7fca90bff700 1 -- 172.21.15.71:0/775252439 shutdown_connections 2023-10-09T06:58:00.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.871+0000 7fca90bff700 1 --2- 172.21.15.71:0/775252439 >> v2:172.21.15.179:3300/0 conn(0x7fca8c069e80 0x7fca8c0ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:00.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.871+0000 7fca90bff700 1 --2- 172.21.15.71:0/775252439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca8c155eb0 0x7fca8c06e240 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:00.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.871+0000 7fca90bff700 1 -- 172.21.15.71:0/775252439 >> 172.21.15.71:0/775252439 conn(0x7fca8c068e10 msgr2=0x7fca8c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:00.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.872+0000 7fca90bff700 1 -- 172.21.15.71:0/775252439 shutdown_connections 2023-10-09T06:58:00.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.872+0000 7fca90bff700 1 -- 172.21.15.71:0/775252439 wait complete. 2023-10-09T06:58:00.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.873+0000 7fca90bff700 1 Processor -- start 2023-10-09T06:58:00.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.873+0000 7fca90bff700 1 -- start start 2023-10-09T06:58:00.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.874+0000 7fca90bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca8c069e80 0x7fca8c15ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:00.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.874+0000 7fca90bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca8c0c70b0 0x7fca8c0c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:00.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.874+0000 7fca90bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca8c155eb0 0x7fca8c154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:00.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.874+0000 7fca90bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c0cbed0 con 0x7fca8c069e80 2023-10-09T06:58:00.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.874+0000 7fca90bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c0cb5e0 con 0x7fca8c0c70b0 2023-10-09T06:58:00.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.874+0000 7fca90bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c0cb880 con 0x7fca8c155eb0 2023-10-09T06:58:00.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.874+0000 7fca8a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca8c069e80 0x7fca8c15ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:00.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.874+0000 7fca8a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca8c069e80 0x7fca8c15ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48344/0 (socket says 172.21.15.71:48344) 2023-10-09T06:58:00.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.874+0000 7fca8a59c700 1 -- 172.21.15.71:0/1329293483 learned_addr learned my addr 172.21.15.71:0/1329293483 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:00.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.874+0000 7fca83fff700 1 --2- 172.21.15.71:0/1329293483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca8c0c70b0 0x7fca8c0c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:00.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.874+0000 7fca8ad9d700 1 --2- 172.21.15.71:0/1329293483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca8c155eb0 0x7fca8c154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:00.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.875+0000 7fca8a59c700 1 -- 172.21.15.71:0/1329293483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca8c155eb0 msgr2=0x7fca8c154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:00.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.875+0000 7fca8a59c700 1 --2- 172.21.15.71:0/1329293483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca8c155eb0 0x7fca8c154ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:00.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.875+0000 7fca8a59c700 1 -- 172.21.15.71:0/1329293483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca8c0c70b0 msgr2=0x7fca8c0c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:00.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.875+0000 7fca8a59c700 1 --2- 172.21.15.71:0/1329293483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca8c0c70b0 0x7fca8c0c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:00.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.875+0000 7fca8a59c700 1 -- 172.21.15.71:0/1329293483 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c0094f0 con 0x7fca8c069e80 2023-10-09T06:58:00.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.875+0000 7fca83fff700 1 --2- 172.21.15.71:0/1329293483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca8c0c70b0 0x7fca8c0c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:00.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.875+0000 7fca8ad9d700 1 --2- 172.21.15.71:0/1329293483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca8c155eb0 0x7fca8c154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:00.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.875+0000 7fca8a59c700 1 --2- 172.21.15.71:0/1329293483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca8c069e80 0x7fca8c15ab90 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fca7c006f50 tx=0x7fca7c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:00.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.875+0000 7fca827fc700 1 -- 172.21.15.71:0/1329293483 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c024440 con 0x7fca8c069e80 2023-10-09T06:58:00.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.875+0000 7fca827fc700 1 -- 172.21.15.71:0/1329293483 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c0245e0 con 0x7fca8c069e80 2023-10-09T06:58:00.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.875+0000 7fca90bff700 1 -- 172.21.15.71:0/1329293483 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8c0cbb60 con 0x7fca8c069e80 2023-10-09T06:58:00.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.875+0000 7fca827fc700 1 -- 172.21.15.71:0/1329293483 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c0249a0 con 0x7fca8c069e80 2023-10-09T06:58:00.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.875+0000 7fca90bff700 1 -- 172.21.15.71:0/1329293483 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca8c0c4ab0 con 0x7fca8c069e80 2023-10-09T06:58:00.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.876+0000 7fca90bff700 1 -- 172.21.15.71:0/1329293483 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca8c04c3c0 con 0x7fca8c069e80 2023-10-09T06:58:00.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.877+0000 7fca827fc700 1 -- 172.21.15.71:0/1329293483 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca7c024d50 con 0x7fca8c069e80 2023-10-09T06:58:00.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.878+0000 7fca827fc700 1 --2- 172.21.15.71:0/1329293483 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fca6c066f30 0x7fca6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:00.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.878+0000 7fca827fc700 1 -- 172.21.15.71:0/1329293483 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5245+0+0 (secure 0 0 0) 0x7fca7c085f90 con 0x7fca8c069e80 2023-10-09T06:58:00.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.878+0000 7fca83fff700 1 --2- 172.21.15.71:0/1329293483 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fca6c066f30 0x7fca6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:00.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.879+0000 7fca83fff700 1 --2- 172.21.15.71:0/1329293483 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fca6c066f30 0x7fca6c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0c1f20 tx=0x7fca74007c90 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:00.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:00.882+0000 7fca827fc700 1 -- 172.21.15.71:0/1329293483 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca7c053330 con 0x7fca8c069e80 2023-10-09T06:58:01.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.071+0000 7fca90bff700 1 -- 172.21.15.71:0/1329293483 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca8c156280 con 0x7fca8c069e80 2023-10-09T06:58:01.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.072+0000 7fca827fc700 1 -- 172.21.15.71:0/1329293483 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7fca7c056950 con 0x7fca8c069e80 2023-10-09T06:58:01.073 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T06:58:01.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.074+0000 7fca90bff700 1 -- 172.21.15.71:0/1329293483 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fca6c066f30 msgr2=0x7fca6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:01.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.074+0000 7fca90bff700 1 --2- 172.21.15.71:0/1329293483 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fca6c066f30 0x7fca6c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0c1f20 tx=0x7fca74007c90 comp rx=0 tx=0).stop 2023-10-09T06:58:01.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.074+0000 7fca90bff700 1 -- 172.21.15.71:0/1329293483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca8c069e80 msgr2=0x7fca8c15ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:01.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.074+0000 7fca90bff700 1 --2- 172.21.15.71:0/1329293483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca8c069e80 0x7fca8c15ab90 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fca7c006f50 tx=0x7fca7c017000 comp rx=0 tx=0).stop 2023-10-09T06:58:01.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.074+0000 7fca90bff700 1 -- 172.21.15.71:0/1329293483 shutdown_connections 2023-10-09T06:58:01.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.074+0000 7fca90bff700 1 --2- 172.21.15.71:0/1329293483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca8c155eb0 0x7fca8c154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:01.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.074+0000 7fca90bff700 1 --2- 172.21.15.71:0/1329293483 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fca6c066f30 0x7fca6c0693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:01.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.074+0000 7fca90bff700 1 --2- 172.21.15.71:0/1329293483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca8c069e80 0x7fca8c15ab90 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:01.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.074+0000 7fca90bff700 1 --2- 172.21.15.71:0/1329293483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca8c0c70b0 0x7fca8c0c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:01.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.074+0000 7fca90bff700 1 -- 172.21.15.71:0/1329293483 >> 172.21.15.71:0/1329293483 conn(0x7fca8c068e10 msgr2=0x7fca8c0b01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:01.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.074+0000 7fca90bff700 1 -- 172.21.15.71:0/1329293483 shutdown_connections 2023-10-09T06:58:01.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.074+0000 7fca90bff700 1 -- 172.21.15.71:0/1329293483 wait complete. 2023-10-09T06:58:01.093 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T06:58:01.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.273+0000 7f9efdb9d700 1 Processor -- start 2023-10-09T06:58:01.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.274+0000 7f9efdb9d700 1 -- start start 2023-10-09T06:58:01.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.275+0000 7f9efdb9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9ef80ae710 0x7f9ef80c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:01.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.275+0000 7f9efdb9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef80ca860 con 0x7f9ef8156310 2023-10-09T06:58:01.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.275+0000 7f9efdb9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef80cab40 con 0x7f9ef81566e0 2023-10-09T06:58:01.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.275+0000 7f9efdb9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef80cae20 con 0x7f9ef80ae710 2023-10-09T06:58:01.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.275+0000 7f9efd39c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9ef80ae710 0x7f9ef80c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:01.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.275+0000 7f9efcb9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9ef8156310 0x7f9ef80c9dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39518/0 (socket says 172.21.15.71:39518) 2023-10-09T06:58:01.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.275+0000 7f9efcb9b700 1 -- 172.21.15.71:0/30760755 learned_addr learned my addr 172.21.15.71:0/30760755 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:01.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.276+0000 7f9ef77fe700 1 -- 172.21.15.71:0/30760755 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307122439 0 0) 0x7f9ef80ca860 con 0x7f9ef8156310 2023-10-09T06:58:01.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.276+0000 7f9efd39c700 1 -- 172.21.15.71:0/30760755 >> v1:172.21.15.179:6789/0 conn(0x7f9ef81566e0 legacy=0x7f9ef80ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:01.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.276+0000 7f9efd39c700 1 -- 172.21.15.71:0/30760755 >> v1:172.21.15.71:6789/0 conn(0x7f9ef8156310 legacy=0x7f9ef80c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:01.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.276+0000 7f9efd39c700 1 -- 172.21.15.71:0/30760755 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef80cb100 con 0x7f9ef80ae710 2023-10-09T06:58:01.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.276+0000 7f9efd39c700 1 --2- 172.21.15.71:0/30760755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ef80ae710 0x7f9ef80c6830 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009e60 tx=0x7f9ef0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6c6331c217a350 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:01.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.276+0000 7f9ef77fe700 1 -- 172.21.15.71:0/30760755 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef000e070 con 0x7f9ef80ae710 2023-10-09T06:58:01.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.276+0000 7f9ef77fe700 1 -- 172.21.15.71:0/30760755 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef000bbf0 con 0x7f9ef80ae710 2023-10-09T06:58:01.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.276+0000 7f9ef77fe700 1 -- 172.21.15.71:0/30760755 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0012430 con 0x7f9ef80ae710 2023-10-09T06:58:01.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.277+0000 7f9efdb9d700 1 -- 172.21.15.71:0/30760755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ef80ae710 msgr2=0x7f9ef80c6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:01.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.277+0000 7f9efdb9d700 1 --2- 172.21.15.71:0/30760755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ef80ae710 0x7f9ef80c6830 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009e60 tx=0x7f9ef0009780 comp rx=0 tx=0).stop 2023-10-09T06:58:01.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.277+0000 7f9efdb9d700 1 -- 172.21.15.71:0/30760755 shutdown_connections 2023-10-09T06:58:01.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.277+0000 7f9efdb9d700 1 --2- 172.21.15.71:0/30760755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ef80ae710 0x7f9ef80c6830 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:01.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.277+0000 7f9efdb9d700 1 -- 172.21.15.71:0/30760755 >> 172.21.15.71:0/30760755 conn(0x7f9ef80cc1f0 msgr2=0x7f9ef80cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:01.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.277+0000 7f9efdb9d700 1 -- 172.21.15.71:0/30760755 shutdown_connections 2023-10-09T06:58:01.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.277+0000 7f9efdb9d700 1 -- 172.21.15.71:0/30760755 wait complete. 2023-10-09T06:58:01.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.278+0000 7f9efdb9d700 1 Processor -- start 2023-10-09T06:58:01.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.279+0000 7f9efdb9d700 1 -- start start 2023-10-09T06:58:01.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.279+0000 7f9efdb9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef80ae710 0x7f9ef814ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:01.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.279+0000 7f9efdb9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ef8156310 0x7f9ef81502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:01.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.279+0000 7f9efdb9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ef81566e0 0x7f9ef8150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:01.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.279+0000 7f9efdb9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef815c090 con 0x7f9ef81566e0 2023-10-09T06:58:01.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.279+0000 7f9efdb9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef815c370 con 0x7f9ef8156310 2023-10-09T06:58:01.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.279+0000 7f9efdb9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef815c650 con 0x7f9ef80ae710 2023-10-09T06:58:01.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.280+0000 7f9efd39c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ef81566e0 0x7f9ef8150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:01.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.280+0000 7f9efd39c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ef81566e0 0x7f9ef8150830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48368/0 (socket says 172.21.15.71:48368) 2023-10-09T06:58:01.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.280+0000 7f9efd39c700 1 -- 172.21.15.71:0/570069190 learned_addr learned my addr 172.21.15.71:0/570069190 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:01.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.280+0000 7f9efcb9b700 1 --2- 172.21.15.71:0/570069190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef80ae710 0x7f9ef814ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:01.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.280+0000 7f9ef7fff700 1 --2- 172.21.15.71:0/570069190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ef8156310 0x7f9ef81502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:01.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.280+0000 7f9efd39c700 1 -- 172.21.15.71:0/570069190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef80ae710 msgr2=0x7f9ef814ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:01.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.280+0000 7f9efd39c700 1 --2- 172.21.15.71:0/570069190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef80ae710 0x7f9ef814ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:01.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.280+0000 7f9efd39c700 1 -- 172.21.15.71:0/570069190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ef8156310 msgr2=0x7f9ef81502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:01.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.280+0000 7f9efd39c700 1 --2- 172.21.15.71:0/570069190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ef8156310 0x7f9ef81502f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:01.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.280+0000 7f9efd39c700 1 -- 172.21.15.71:0/570069190 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef0009a20 con 0x7f9ef81566e0 2023-10-09T06:58:01.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.280+0000 7f9efcb9b700 1 --2- 172.21.15.71:0/570069190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef80ae710 0x7f9ef814ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:01.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.280+0000 7f9efd39c700 1 --2- 172.21.15.71:0/570069190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ef81566e0 0x7f9ef8150830 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9ef806fe40 tx=0x7f9ef0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:01.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.281+0000 7f9ef4ff9700 1 -- 172.21.15.71:0/570069190 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef001e710 con 0x7f9ef81566e0 2023-10-09T06:58:01.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.281+0000 7f9ef4ff9700 1 -- 172.21.15.71:0/570069190 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef001e870 con 0x7f9ef81566e0 2023-10-09T06:58:01.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.281+0000 7f9ef4ff9700 1 -- 172.21.15.71:0/570069190 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef001ec30 con 0x7f9ef81566e0 2023-10-09T06:58:01.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.281+0000 7f9efdb9d700 1 -- 172.21.15.71:0/570069190 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef815c930 con 0x7f9ef81566e0 2023-10-09T06:58:01.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.281+0000 7f9efdb9d700 1 -- 172.21.15.71:0/570069190 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef814b2c0 con 0x7f9ef81566e0 2023-10-09T06:58:01.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.282+0000 7f9efdb9d700 1 -- 172.21.15.71:0/570069190 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef804c3c0 con 0x7f9ef81566e0 2023-10-09T06:58:01.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.283+0000 7f9ef4ff9700 1 -- 172.21.15.71:0/570069190 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ef0024070 con 0x7f9ef81566e0 2023-10-09T06:58:01.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.283+0000 7f9ef4ff9700 1 --2- 172.21.15.71:0/570069190 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9edc066f30 0x7f9edc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:01.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.284+0000 7f9ef4ff9700 1 -- 172.21.15.71:0/570069190 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f9ef0086dc0 con 0x7f9ef81566e0 2023-10-09T06:58:01.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.284+0000 7f9efcb9b700 1 --2- 172.21.15.71:0/570069190 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9edc066f30 0x7f9edc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:01.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.285+0000 7f9efcb9b700 1 --2- 172.21.15.71:0/570069190 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9edc066f30 0x7f9edc0693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0011e0 tx=0x7f9eec009040 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:01.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.287+0000 7f9ef4ff9700 1 -- 172.21.15.71:0/570069190 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ef0054200 con 0x7f9ef81566e0 2023-10-09T06:58:01.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.482+0000 7f9efdb9d700 1 -- 172.21.15.71:0/570069190 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9ef80cd0b0 con 0x7f9ef81566e0 2023-10-09T06:58:01.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.482+0000 7f9ef4ff9700 1 -- 172.21.15.71:0/570069190 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v89) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9ef002c060 con 0x7f9ef81566e0 2023-10-09T06:58:01.483 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:01.484 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-09T06:58:01.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:01.484 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 1, 2023-10-09T06:58:01.484 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": ".mgr" 2023-10-09T06:58:01.484 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:01.484 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-09T06:58:01.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.485+0000 7f9efdb9d700 1 -- 172.21.15.71:0/570069190 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9edc066f30 msgr2=0x7f9edc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:01.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.485+0000 7f9efdb9d700 1 --2- 172.21.15.71:0/570069190 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9edc066f30 0x7f9edc0693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0011e0 tx=0x7f9eec009040 comp rx=0 tx=0).stop 2023-10-09T06:58:01.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.485+0000 7f9efdb9d700 1 -- 172.21.15.71:0/570069190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ef81566e0 msgr2=0x7f9ef8150830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:01.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.485+0000 7f9efdb9d700 1 --2- 172.21.15.71:0/570069190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ef81566e0 0x7f9ef8150830 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9ef806fe40 tx=0x7f9ef0018000 comp rx=0 tx=0).stop 2023-10-09T06:58:01.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.485+0000 7f9efdb9d700 1 -- 172.21.15.71:0/570069190 shutdown_connections 2023-10-09T06:58:01.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.485+0000 7f9efdb9d700 1 --2- 172.21.15.71:0/570069190 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9edc066f30 0x7f9edc0693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:01.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.485+0000 7f9efdb9d700 1 --2- 172.21.15.71:0/570069190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ef81566e0 0x7f9ef8150830 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:01.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.485+0000 7f9efdb9d700 1 --2- 172.21.15.71:0/570069190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef80ae710 0x7f9ef814ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:01.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.485+0000 7f9efdb9d700 1 --2- 172.21.15.71:0/570069190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ef8156310 0x7f9ef81502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:01.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.485+0000 7f9efdb9d700 1 -- 172.21.15.71:0/570069190 >> 172.21.15.71:0/570069190 conn(0x7f9ef80cc1f0 msgr2=0x7f9ef806a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:01.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.485+0000 7f9efdb9d700 1 -- 172.21.15.71:0/570069190 shutdown_connections 2023-10-09T06:58:01.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.485+0000 7f9efdb9d700 1 -- 172.21.15.71:0/570069190 wait complete. 2023-10-09T06:58:01.503 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T06:58:01.505 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T06:58:01.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.688+0000 7f8133bff700 1 Processor -- start 2023-10-09T06:58:01.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.688+0000 7f8133bff700 1 -- start start 2023-10-09T06:58:01.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.690+0000 7f8133bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f812c15a440 0x7f812c0acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:01.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.690+0000 7f8133bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f812c068890 0x7f812c0c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:01.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.690+0000 7f8133bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f812c15a9b0 con 0x7f812c1563b0 2023-10-09T06:58:01.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.690+0000 7f8133bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812c15ac90 con 0x7f812c068890 2023-10-09T06:58:01.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.690+0000 7f8133bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812c15af70 con 0x7f812c15a440 2023-10-09T06:58:01.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.690+0000 7f813219c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f812c068890 0x7f812c0c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:01.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.690+0000 7f813199b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f812c1563b0 0x7f812c156780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39522/0 (socket says 172.21.15.71:39522) 2023-10-09T06:58:01.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.690+0000 7f813199b700 1 -- 172.21.15.71:0/1266888715 learned_addr learned my addr 172.21.15.71:0/1266888715 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:01.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.690+0000 7f813219c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f812c068890 0x7f812c0c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48374/0 (socket says 172.21.15.71:48374) 2023-10-09T06:58:01.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.690+0000 7f813119a700 1 --2- 172.21.15.71:0/1266888715 >> v2:172.21.15.179:3300/0 conn(0x7f812c15a440 0x7f812c0acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:01.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.690+0000 7f813219c700 1 -- 172.21.15.71:0/1266888715 >> v2:172.21.15.179:3300/0 conn(0x7f812c15a440 msgr2=0x7f812c0acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:01.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.690+0000 7f813219c700 1 --2- 172.21.15.71:0/1266888715 >> v2:172.21.15.179:3300/0 conn(0x7f812c15a440 0x7f812c0acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:01.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.690+0000 7f813219c700 1 -- 172.21.15.71:0/1266888715 >> v1:172.21.15.71:6789/0 conn(0x7f812c1563b0 legacy=0x7f812c156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:01.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.690+0000 7f813219c700 1 -- 172.21.15.71:0/1266888715 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812c15b250 con 0x7f812c068890 2023-10-09T06:58:01.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.690+0000 7f8130999700 1 -- 172.21.15.71:0/1266888715 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744178784 0 0) 0x7f812c15a9b0 con 0x7f812c1563b0 2023-10-09T06:58:01.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.691+0000 7f813219c700 1 --2- 172.21.15.71:0/1266888715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f812c068890 0x7f812c0c8230 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f812c06fb10 tx=0x7f8124009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5b52119968c225 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:01.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.691+0000 7f8130999700 1 -- 172.21.15.71:0/1266888715 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812400e070 con 0x7f812c068890 2023-10-09T06:58:01.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.691+0000 7f8130999700 1 -- 172.21.15.71:0/1266888715 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812400bc30 con 0x7f812c068890 2023-10-09T06:58:01.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.691+0000 7f8130999700 1 -- 172.21.15.71:0/1266888715 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8124012430 con 0x7f812c068890 2023-10-09T06:58:01.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.691+0000 7f8133bff700 1 -- 172.21.15.71:0/1266888715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f812c068890 msgr2=0x7f812c0c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:01.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.691+0000 7f8133bff700 1 --2- 172.21.15.71:0/1266888715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f812c068890 0x7f812c0c8230 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f812c06fb10 tx=0x7f8124009780 comp rx=0 tx=0).stop 2023-10-09T06:58:01.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.692+0000 7f8133bff700 1 -- 172.21.15.71:0/1266888715 shutdown_connections 2023-10-09T06:58:01.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.692+0000 7f8133bff700 1 --2- 172.21.15.71:0/1266888715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f812c068890 0x7f812c0c8230 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:01.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.692+0000 7f8133bff700 1 --2- 172.21.15.71:0/1266888715 >> v2:172.21.15.179:3300/0 conn(0x7f812c15a440 0x7f812c0acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:01.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.692+0000 7f8133bff700 1 -- 172.21.15.71:0/1266888715 >> 172.21.15.71:0/1266888715 conn(0x7f812c0c8f90 msgr2=0x7f812c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:01.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.692+0000 7f8133bff700 1 -- 172.21.15.71:0/1266888715 shutdown_connections 2023-10-09T06:58:01.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.692+0000 7f8133bff700 1 -- 172.21.15.71:0/1266888715 wait complete. 2023-10-09T06:58:01.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.693+0000 7f8133bff700 1 Processor -- start 2023-10-09T06:58:01.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.693+0000 7f8133bff700 1 -- start start 2023-10-09T06:58:01.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.694+0000 7f8133bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f812c068890 0x7f812c14de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:01.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.694+0000 7f8133bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812c1563b0 0x7f812c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:01.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.694+0000 7f8133bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f812c15a440 0x7f812c06e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:01.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.694+0000 7f8133bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c1598e0 con 0x7f812c068890 2023-10-09T06:58:01.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.694+0000 7f8133bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c158a70 con 0x7f812c1563b0 2023-10-09T06:58:01.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.694+0000 7f8133bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812c159d70 con 0x7f812c15a440 2023-10-09T06:58:01.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.694+0000 7f813199b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f812c068890 0x7f812c14de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:01.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.694+0000 7f813199b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f812c068890 0x7f812c14de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48388/0 (socket says 172.21.15.71:48388) 2023-10-09T06:58:01.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.694+0000 7f813199b700 1 -- 172.21.15.71:0/2467876813 learned_addr learned my addr 172.21.15.71:0/2467876813 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:01.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.694+0000 7f813119a700 1 --2- 172.21.15.71:0/2467876813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812c1563b0 0x7f812c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:01.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.695+0000 7f813219c700 1 --2- 172.21.15.71:0/2467876813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f812c15a440 0x7f812c06e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:01.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.695+0000 7f813199b700 1 -- 172.21.15.71:0/2467876813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f812c15a440 msgr2=0x7f812c06e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:01.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.695+0000 7f813199b700 1 --2- 172.21.15.71:0/2467876813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f812c15a440 0x7f812c06e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:01.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.695+0000 7f813199b700 1 -- 172.21.15.71:0/2467876813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812c1563b0 msgr2=0x7f812c06e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:01.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.695+0000 7f813199b700 1 --2- 172.21.15.71:0/2467876813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812c1563b0 0x7f812c06e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:01.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.695+0000 7f813199b700 1 -- 172.21.15.71:0/2467876813 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8124009a20 con 0x7f812c068890 2023-10-09T06:58:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.695+0000 7f813199b700 1 --2- 172.21.15.71:0/2467876813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f812c068890 0x7f812c14de00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f812800c7e0 tx=0x7f8128007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.695+0000 7f8121ffb700 1 -- 172.21.15.71:0/2467876813 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128005b30 con 0x7f812c068890 2023-10-09T06:58:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.695+0000 7f8121ffb700 1 -- 172.21.15.71:0/2467876813 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8128005c90 con 0x7f812c068890 2023-10-09T06:58:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.695+0000 7f8133bff700 1 -- 172.21.15.71:0/2467876813 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812c14e340 con 0x7f812c068890 2023-10-09T06:58:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.695+0000 7f8121ffb700 1 -- 172.21.15.71:0/2467876813 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128007300 con 0x7f812c068890 2023-10-09T06:58:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.695+0000 7f8133bff700 1 -- 172.21.15.71:0/2467876813 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812c158fb0 con 0x7f812c068890 2023-10-09T06:58:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.696+0000 7f8133bff700 1 -- 172.21.15.71:0/2467876813 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812c159bc0 con 0x7f812c068890 2023-10-09T06:58:01.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.697+0000 7f8121ffb700 1 -- 172.21.15.71:0/2467876813 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f81280076b0 con 0x7f812c068890 2023-10-09T06:58:01.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.698+0000 7f8121ffb700 1 --2- 172.21.15.71:0/2467876813 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8110066f30 0x7f81100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:01.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.698+0000 7f8121ffb700 1 -- 172.21.15.71:0/2467876813 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f81280838d0 con 0x7f812c068890 2023-10-09T06:58:01.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.698+0000 7f813119a700 1 --2- 172.21.15.71:0/2467876813 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8110066f30 0x7f81100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:01.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.699+0000 7f813119a700 1 --2- 172.21.15.71:0/2467876813 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8110066f30 0x7f81100693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f812c0aecd0 tx=0x7f811c008040 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:01.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.702+0000 7f8121ffb700 1 -- 172.21.15.71:0/2467876813 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8128050d10 con 0x7f812c068890 2023-10-09T06:58:01.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:01.892+0000 7f8133bff700 1 -- 172.21.15.71:0/2467876813 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f812c0718b0 con 0x7f812c068890 2023-10-09T06:58:02.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.254+0000 7f8121ffb700 1 -- 172.21.15.71:0/2467876813 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v90) v1 ==== 138+0+0 (secure 0 0 0) 0x7f81280170b0 con 0x7f812c068890 2023-10-09T06:58:02.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.257+0000 7f8133bff700 1 -- 172.21.15.71:0/2467876813 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8110066f30 msgr2=0x7f81100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:02.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.257+0000 7f8133bff700 1 --2- 172.21.15.71:0/2467876813 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8110066f30 0x7f81100693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f812c0aecd0 tx=0x7f811c008040 comp rx=0 tx=0).stop 2023-10-09T06:58:02.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.257+0000 7f8133bff700 1 -- 172.21.15.71:0/2467876813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f812c068890 msgr2=0x7f812c14de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:02.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.257+0000 7f8133bff700 1 --2- 172.21.15.71:0/2467876813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f812c068890 0x7f812c14de00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f812800c7e0 tx=0x7f8128007df0 comp rx=0 tx=0).stop 2023-10-09T06:58:02.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.257+0000 7f8133bff700 1 -- 172.21.15.71:0/2467876813 shutdown_connections 2023-10-09T06:58:02.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.257+0000 7f8133bff700 1 --2- 172.21.15.71:0/2467876813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f812c15a440 0x7f812c06e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:02.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.257+0000 7f8133bff700 1 --2- 172.21.15.71:0/2467876813 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8110066f30 0x7f81100693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:02.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.257+0000 7f8133bff700 1 --2- 172.21.15.71:0/2467876813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f812c068890 0x7f812c14de00 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:02.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.257+0000 7f8133bff700 1 --2- 172.21.15.71:0/2467876813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812c1563b0 0x7f812c06e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:02.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.257+0000 7f8133bff700 1 -- 172.21.15.71:0/2467876813 >> 172.21.15.71:0/2467876813 conn(0x7f812c0c8f90 msgr2=0x7f812c0cbd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:02.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.257+0000 7f8133bff700 1 -- 172.21.15.71:0/2467876813 shutdown_connections 2023-10-09T06:58:02.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.257+0000 7f8133bff700 1 -- 172.21.15.71:0/2467876813 wait complete. 2023-10-09T06:58:02.260 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' created 2023-10-09T06:58:02.280 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T06:58:02.455 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:58:02.460 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:58:02.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.467+0000 7fe7eb59d700 1 Processor -- start 2023-10-09T06:58:02.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.467+0000 7fe7eb59d700 1 -- start start 2023-10-09T06:58:02.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.468+0000 7fe7eb59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e41595d0 0x7fe7e40ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:02.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.468+0000 7fe7eb59d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe7e40cf480 0x7fe7e415d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:02.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.468+0000 7fe7eb59d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe7e415d760 0x7fe7e41599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:02.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.468+0000 7fe7eb59d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7e415dbc0 con 0x7fe7e415d760 2023-10-09T06:58:02.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.468+0000 7fe7eb59d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7e40b10f0 con 0x7fe7e40cf480 2023-10-09T06:58:02.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.468+0000 7fe7eb59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e40cd530 con 0x7fe7e41595d0 2023-10-09T06:58:02.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.468+0000 7fe7ead9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe7e415d760 0x7fe7e41599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:02.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.468+0000 7fe7ead9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe7e415d760 0x7fe7e41599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48392/0 (socket says 172.21.15.71:48392) 2023-10-09T06:58:02.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.468+0000 7fe7ead9c700 1 -- 172.21.15.71:0/3016091570 learned_addr learned my addr 172.21.15.71:0/3016091570 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:02.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.468+0000 7fe7ea59b700 1 --2- 172.21.15.71:0/3016091570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e41595d0 0x7fe7e40ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:02.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.469+0000 7fe7e9d9a700 1 --2- 172.21.15.71:0/3016091570 >> v2:172.21.15.179:3300/0 conn(0x7fe7e40cf480 0x7fe7e415d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:02.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.469+0000 7fe7ead9c700 1 -- 172.21.15.71:0/3016091570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e41595d0 msgr2=0x7fe7e40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:02.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.469+0000 7fe7ead9c700 1 --2- 172.21.15.71:0/3016091570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e41595d0 0x7fe7e40ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:02.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.469+0000 7fe7ead9c700 1 -- 172.21.15.71:0/3016091570 >> v2:172.21.15.179:3300/0 conn(0x7fe7e40cf480 msgr2=0x7fe7e415d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:02.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.469+0000 7fe7ead9c700 1 --2- 172.21.15.71:0/3016091570 >> v2:172.21.15.179:3300/0 conn(0x7fe7e40cf480 0x7fe7e415d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:02.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.469+0000 7fe7ead9c700 1 -- 172.21.15.71:0/3016091570 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e415e000 con 0x7fe7e415d760 2023-10-09T06:58:02.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.469+0000 7fe7e9d9a700 1 --2- 172.21.15.71:0/3016091570 >> v2:172.21.15.179:3300/0 conn(0x7fe7e40cf480 0x7fe7e415d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:02.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.469+0000 7fe7ead9c700 1 --2- 172.21.15.71:0/3016091570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7e415d760 0x7fe7e41599a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe7e40712a0 tx=0x7fe7dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca1a7cf9f9b6827 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:02.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.469+0000 7fe7e9599700 1 -- 172.21.15.71:0/3016091570 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc00e070 con 0x7fe7e415d760 2023-10-09T06:58:02.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.470+0000 7fe7e9599700 1 -- 172.21.15.71:0/3016091570 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7dc00ba20 con 0x7fe7e415d760 2023-10-09T06:58:02.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.470+0000 7fe7e9599700 1 -- 172.21.15.71:0/3016091570 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc0092e0 con 0x7fe7e415d760 2023-10-09T06:58:02.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.470+0000 7fe7eb59d700 1 -- 172.21.15.71:0/3016091570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7e415d760 msgr2=0x7fe7e41599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:02.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.470+0000 7fe7eb59d700 1 --2- 172.21.15.71:0/3016091570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7e415d760 0x7fe7e41599a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe7e40712a0 tx=0x7fe7dc009840 comp rx=0 tx=0).stop 2023-10-09T06:58:02.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.470+0000 7fe7eb59d700 1 -- 172.21.15.71:0/3016091570 shutdown_connections 2023-10-09T06:58:02.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.470+0000 7fe7eb59d700 1 --2- 172.21.15.71:0/3016091570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7e415d760 0x7fe7e41599a0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:02.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.470+0000 7fe7eb59d700 1 --2- 172.21.15.71:0/3016091570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e41595d0 0x7fe7e40ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:02.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.470+0000 7fe7eb59d700 1 --2- 172.21.15.71:0/3016091570 >> v2:172.21.15.179:3300/0 conn(0x7fe7e40cf480 0x7fe7e415d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:02.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.470+0000 7fe7eb59d700 1 -- 172.21.15.71:0/3016091570 >> 172.21.15.71:0/3016091570 conn(0x7fe7e40d05f0 msgr2=0x7fe7e40d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:02.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.470+0000 7fe7eb59d700 1 -- 172.21.15.71:0/3016091570 shutdown_connections 2023-10-09T06:58:02.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.470+0000 7fe7eb59d700 1 -- 172.21.15.71:0/3016091570 wait complete. 2023-10-09T06:58:02.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.472+0000 7fe7eb59d700 1 Processor -- start 2023-10-09T06:58:02.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.472+0000 7fe7eb59d700 1 -- start start 2023-10-09T06:58:02.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.473+0000 7fe7eb59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7e40cf480 0x7fe7e4143f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:02.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.473+0000 7fe7eb59d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7e41595d0 0x7fe7e4156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:02.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.473+0000 7fe7eb59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e415d760 0x7fe7e4157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:02.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.473+0000 7fe7eb59d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e416a6b0 con 0x7fe7e41595d0 2023-10-09T06:58:02.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.473+0000 7fe7eb59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e4169aa0 con 0x7fe7e40cf480 2023-10-09T06:58:02.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.473+0000 7fe7eb59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e4169d80 con 0x7fe7e415d760 2023-10-09T06:58:02.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.473+0000 7fe7e9d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7e41595d0 0x7fe7e4156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:02.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.473+0000 7fe7e9d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7e41595d0 0x7fe7e4156320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48394/0 (socket says 172.21.15.71:48394) 2023-10-09T06:58:02.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.473+0000 7fe7e9d9a700 1 -- 172.21.15.71:0/398344872 learned_addr learned my addr 172.21.15.71:0/398344872 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:02.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.473+0000 7fe7ea59b700 1 --2- 172.21.15.71:0/398344872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7e40cf480 0x7fe7e4143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:02.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.473+0000 7fe7ead9c700 1 --2- 172.21.15.71:0/398344872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e415d760 0x7fe7e4157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:02.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.473+0000 7fe7e9d9a700 1 -- 172.21.15.71:0/398344872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e415d760 msgr2=0x7fe7e4157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:02.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.473+0000 7fe7e9d9a700 1 --2- 172.21.15.71:0/398344872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e415d760 0x7fe7e4157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:02.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.473+0000 7fe7e9d9a700 1 -- 172.21.15.71:0/398344872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7e40cf480 msgr2=0x7fe7e4143f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:02.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.473+0000 7fe7e9d9a700 1 --2- 172.21.15.71:0/398344872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7e40cf480 0x7fe7e4143f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:02.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.473+0000 7fe7e9d9a700 1 -- 172.21.15.71:0/398344872 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc009ae0 con 0x7fe7e41595d0 2023-10-09T06:58:02.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.473+0000 7fe7ea59b700 1 --2- 172.21.15.71:0/398344872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7e40cf480 0x7fe7e4143f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:02.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.474+0000 7fe7e9d9a700 1 --2- 172.21.15.71:0/398344872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7e41595d0 0x7fe7e4156320 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400d860 tx=0x7fe7d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:02.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.474+0000 7fe7da7fc700 1 -- 172.21.15.71:0/398344872 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d40125f0 con 0x7fe7e41595d0 2023-10-09T06:58:02.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.474+0000 7fe7da7fc700 1 -- 172.21.15.71:0/398344872 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d4012750 con 0x7fe7e41595d0 2023-10-09T06:58:02.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.474+0000 7fe7da7fc700 1 -- 172.21.15.71:0/398344872 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d4012ad0 con 0x7fe7e41595d0 2023-10-09T06:58:02.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.474+0000 7fe7eb59d700 1 -- 172.21.15.71:0/398344872 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e416a060 con 0x7fe7e41595d0 2023-10-09T06:58:02.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.474+0000 7fe7eb59d700 1 -- 172.21.15.71:0/398344872 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e4144460 con 0x7fe7e41595d0 2023-10-09T06:58:02.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.475+0000 7fe7eb59d700 1 -- 172.21.15.71:0/398344872 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e404c3c0 con 0x7fe7e41595d0 2023-10-09T06:58:02.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.476+0000 7fe7da7fc700 1 -- 172.21.15.71:0/398344872 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe7d4014430 con 0x7fe7e41595d0 2023-10-09T06:58:02.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.478+0000 7fe7da7fc700 1 --2- 172.21.15.71:0/398344872 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe7c8066f30 0x7fe7c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:02.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.478+0000 7fe7da7fc700 1 -- 172.21.15.71:0/398344872 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5615+0+0 (secure 0 0 0) 0x7fe7d4084950 con 0x7fe7e41595d0 2023-10-09T06:58:02.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.478+0000 7fe7ea59b700 1 --2- 172.21.15.71:0/398344872 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe7c8066f30 0x7fe7c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:02.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.479+0000 7fe7ea59b700 1 --2- 172.21.15.71:0/398344872 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe7c8066f30 0x7fe7c80693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0009d70 tx=0x7fe7e0008040 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:02.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.482+0000 7fe7da7fc700 1 -- 172.21.15.71:0/398344872 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7d40556b0 con 0x7fe7e41595d0 2023-10-09T06:58:02.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:02.679+0000 7fe7eb59d700 1 -- 172.21.15.71:0/398344872 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe7e416a7f0 con 0x7fe7e41595d0 2023-10-09T06:58:03.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.263+0000 7fe7da7fc700 1 -- 172.21.15.71:0/398344872 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v91) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe7d4055240 con 0x7fe7e41595d0 2023-10-09T06:58:03.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.270+0000 7fe7eb59d700 1 -- 172.21.15.71:0/398344872 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe7c8066f30 msgr2=0x7fe7c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:03.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.270+0000 7fe7eb59d700 1 --2- 172.21.15.71:0/398344872 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe7c8066f30 0x7fe7c80693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0009d70 tx=0x7fe7e0008040 comp rx=0 tx=0).stop 2023-10-09T06:58:03.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.270+0000 7fe7eb59d700 1 -- 172.21.15.71:0/398344872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7e41595d0 msgr2=0x7fe7e4156320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:03.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.270+0000 7fe7eb59d700 1 --2- 172.21.15.71:0/398344872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7e41595d0 0x7fe7e4156320 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400d860 tx=0x7fe7d4008040 comp rx=0 tx=0).stop 2023-10-09T06:58:03.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.271+0000 7fe7eb59d700 1 -- 172.21.15.71:0/398344872 shutdown_connections 2023-10-09T06:58:03.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.271+0000 7fe7eb59d700 1 --2- 172.21.15.71:0/398344872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e415d760 0x7fe7e4157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:03.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.271+0000 7fe7eb59d700 1 --2- 172.21.15.71:0/398344872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7e40cf480 0x7fe7e4143f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:03.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.271+0000 7fe7eb59d700 1 --2- 172.21.15.71:0/398344872 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe7c8066f30 0x7fe7c80693e0 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0009d70 tx=0x7fe7e0008040 comp rx=0 tx=0).stop 2023-10-09T06:58:03.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.271+0000 7fe7eb59d700 1 --2- 172.21.15.71:0/398344872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7e41595d0 0x7fe7e4156320 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:03.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.271+0000 7fe7eb59d700 1 -- 172.21.15.71:0/398344872 >> 172.21.15.71:0/398344872 conn(0x7fe7e40d05f0 msgr2=0x7fe7e40b1420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:03.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.275+0000 7fe7eb59d700 1 -- 172.21.15.71:0/398344872 shutdown_connections 2023-10-09T06:58:03.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.281+0000 7fe7eb59d700 1 -- 172.21.15.71:0/398344872 wait complete. 2023-10-09T06:58:03.285 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' created 2023-10-09T06:58:03.304 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T06:58:03.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.489+0000 7f3aee39d700 1 Processor -- start 2023-10-09T06:58:03.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.489+0000 7f3aee39d700 1 -- start start 2023-10-09T06:58:03.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.490+0000 7f3aee39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ae80b4e70 0x7f3ae80ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:03.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.490+0000 7f3aee39d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3ae80b16d0 0x7f3ae80b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:03.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.490+0000 7f3aee39d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae80b2080 con 0x7f3ae815d240 2023-10-09T06:58:03.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.490+0000 7f3aee39d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae80cfb00 con 0x7f3ae80b16d0 2023-10-09T06:58:03.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.490+0000 7f3aee39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae80b5c40 con 0x7f3ae80b4e70 2023-10-09T06:58:03.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.491+0000 7f3aecb9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3ae80b16d0 0x7f3ae80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:03.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.491+0000 7f3aedb9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3ae815d240 0x7f3ae815d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39538/0 (socket says 172.21.15.71:39538) 2023-10-09T06:58:03.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.491+0000 7f3aecb9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3ae80b16d0 0x7f3ae80b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48408/0 (socket says 172.21.15.71:48408) 2023-10-09T06:58:03.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.491+0000 7f3aedb9c700 1 -- 172.21.15.71:0/2991594774 learned_addr learned my addr 172.21.15.71:0/2991594774 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:03.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.491+0000 7f3aed39b700 1 --2- 172.21.15.71:0/2991594774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ae80b4e70 0x7f3ae80ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:03.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.491+0000 7f3aecb9a700 1 -- 172.21.15.71:0/2991594774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ae80b4e70 msgr2=0x7f3ae80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:03.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.491+0000 7f3aecb9a700 1 --2- 172.21.15.71:0/2991594774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ae80b4e70 0x7f3ae80ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:03.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.491+0000 7f3aecb9a700 1 -- 172.21.15.71:0/2991594774 >> v1:172.21.15.71:6789/0 conn(0x7f3ae815d240 legacy=0x7f3ae815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:03.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.491+0000 7f3aecb9a700 1 -- 172.21.15.71:0/2991594774 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae80b5f20 con 0x7f3ae80b16d0 2023-10-09T06:58:03.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.491+0000 7f3adffff700 1 -- 172.21.15.71:0/2991594774 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852719605 0 0) 0x7f3ae80b2080 con 0x7f3ae815d240 2023-10-09T06:58:03.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.491+0000 7f3aed39b700 1 --2- 172.21.15.71:0/2991594774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ae80b4e70 0x7f3ae80ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:03.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.491+0000 7f3aecb9a700 1 --2- 172.21.15.71:0/2991594774 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ae80b16d0 0x7f3ae80b1b40 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80098e0 tx=0x7f3ad80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5131656fbf6b742 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:03.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.492+0000 7f3adffff700 1 -- 172.21.15.71:0/2991594774 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8009e80 con 0x7f3ae80b16d0 2023-10-09T06:58:03.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.492+0000 7f3adffff700 1 -- 172.21.15.71:0/2991594774 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad800b860 con 0x7f3ae80b16d0 2023-10-09T06:58:03.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.492+0000 7f3adffff700 1 -- 172.21.15.71:0/2991594774 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad800bbe0 con 0x7f3ae80b16d0 2023-10-09T06:58:03.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.492+0000 7f3aee39d700 1 -- 172.21.15.71:0/2991594774 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ae80b16d0 msgr2=0x7f3ae80b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:03.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.492+0000 7f3aee39d700 1 --2- 172.21.15.71:0/2991594774 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ae80b16d0 0x7f3ae80b1b40 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80098e0 tx=0x7f3ad80091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:03.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.492+0000 7f3aee39d700 1 -- 172.21.15.71:0/2991594774 shutdown_connections 2023-10-09T06:58:03.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.492+0000 7f3aee39d700 1 --2- 172.21.15.71:0/2991594774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ae80b4e70 0x7f3ae80ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:03.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.492+0000 7f3aee39d700 1 --2- 172.21.15.71:0/2991594774 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ae80b16d0 0x7f3ae80b1b40 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:03.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.492+0000 7f3aee39d700 1 -- 172.21.15.71:0/2991594774 >> 172.21.15.71:0/2991594774 conn(0x7f3ae80d10c0 msgr2=0x7f3ae80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:03.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.492+0000 7f3aee39d700 1 -- 172.21.15.71:0/2991594774 shutdown_connections 2023-10-09T06:58:03.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.492+0000 7f3aee39d700 1 -- 172.21.15.71:0/2991594774 wait complete. 2023-10-09T06:58:03.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.494+0000 7f3aee39d700 1 Processor -- start 2023-10-09T06:58:03.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.494+0000 7f3aee39d700 1 -- start start 2023-10-09T06:58:03.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.495+0000 7f3aee39d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ae80b16d0 0x7f3ae8159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:03.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.495+0000 7f3aee39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ae80b4e70 0x7f3ae815f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:03.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.495+0000 7f3aee39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ae815d240 0x7f3ae815fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:03.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.495+0000 7f3aee39d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae80af090 con 0x7f3ae80b16d0 2023-10-09T06:58:03.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.495+0000 7f3aee39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae816a2b0 con 0x7f3ae80b4e70 2023-10-09T06:58:03.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.495+0000 7f3aee39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae81699c0 con 0x7f3ae815d240 2023-10-09T06:58:03.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.495+0000 7f3aed39b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ae80b16d0 0x7f3ae8159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:03.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.495+0000 7f3aed39b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ae80b16d0 0x7f3ae8159070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48410/0 (socket says 172.21.15.71:48410) 2023-10-09T06:58:03.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.495+0000 7f3aed39b700 1 -- 172.21.15.71:0/1709419228 learned_addr learned my addr 172.21.15.71:0/1709419228 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:03.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.495+0000 7f3aedb9c700 1 --2- 172.21.15.71:0/1709419228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ae815d240 0x7f3ae815fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:03.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.495+0000 7f3aecb9a700 1 --2- 172.21.15.71:0/1709419228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ae80b4e70 0x7f3ae815f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:03.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.495+0000 7f3aed39b700 1 -- 172.21.15.71:0/1709419228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ae815d240 msgr2=0x7f3ae815fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:03.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.495+0000 7f3aed39b700 1 --2- 172.21.15.71:0/1709419228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ae815d240 0x7f3ae815fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:03.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.495+0000 7f3aed39b700 1 -- 172.21.15.71:0/1709419228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ae80b4e70 msgr2=0x7f3ae815f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:03.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.495+0000 7f3aed39b700 1 --2- 172.21.15.71:0/1709419228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ae80b4e70 0x7f3ae815f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:03.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.495+0000 7f3aed39b700 1 -- 172.21.15.71:0/1709419228 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad8009420 con 0x7f3ae80b16d0 2023-10-09T06:58:03.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.496+0000 7f3aed39b700 1 --2- 172.21.15.71:0/1709419228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ae80b16d0 0x7f3ae8159070 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f3ae400e8d0 tx=0x7f3ae4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:03.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.496+0000 7f3add7fa700 1 -- 172.21.15.71:0/1709419228 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae400ee70 con 0x7f3ae80b16d0 2023-10-09T06:58:03.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.496+0000 7f3add7fa700 1 -- 172.21.15.71:0/1709419228 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae400c5e0 con 0x7f3ae80b16d0 2023-10-09T06:58:03.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.496+0000 7f3aee39d700 1 -- 172.21.15.71:0/1709419228 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae8169c60 con 0x7f3ae80b16d0 2023-10-09T06:58:03.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.496+0000 7f3add7fa700 1 -- 172.21.15.71:0/1709419228 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae400c980 con 0x7f3ae80b16d0 2023-10-09T06:58:03.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.496+0000 7f3aee39d700 1 -- 172.21.15.71:0/1709419228 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae80cc1b0 con 0x7f3ae80b16d0 2023-10-09T06:58:03.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.497+0000 7f3aee39d700 1 -- 172.21.15.71:0/1709419228 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae80cf510 con 0x7f3ae80b16d0 2023-10-09T06:58:03.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.498+0000 7f3add7fa700 1 -- 172.21.15.71:0/1709419228 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ae4025480 con 0x7f3ae80b16d0 2023-10-09T06:58:03.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.499+0000 7f3add7fa700 1 --2- 172.21.15.71:0/1709419228 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3acc066f30 0x7f3acc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:03.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.499+0000 7f3add7fa700 1 -- 172.21.15.71:0/1709419228 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f3ae40848b0 con 0x7f3ae80b16d0 2023-10-09T06:58:03.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.499+0000 7f3aecb9a700 1 --2- 172.21.15.71:0/1709419228 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3acc066f30 0x7f3acc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:03.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.500+0000 7f3aecb9a700 1 --2- 172.21.15.71:0/1709419228 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3acc066f30 0x7f3acc0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80091e0 tx=0x7f3ad8017000 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:03.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.503+0000 7f3add7fa700 1 -- 172.21.15.71:0/1709419228 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ae4055510 con 0x7f3ae80b16d0 2023-10-09T06:58:03.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:03.737+0000 7f3aee39d700 1 -- 172.21.15.71:0/1709419228 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3ae804bb80 con 0x7f3ae80b16d0 2023-10-09T06:58:04.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.283+0000 7f3add7fa700 1 -- 172.21.15.71:0/1709419228 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v37) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3ae40200c0 con 0x7f3ae80b16d0 2023-10-09T06:58:04.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.287+0000 7f3aee39d700 1 -- 172.21.15.71:0/1709419228 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3acc066f30 msgr2=0x7f3acc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:04.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.287+0000 7f3aee39d700 1 --2- 172.21.15.71:0/1709419228 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3acc066f30 0x7f3acc0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80091e0 tx=0x7f3ad8017000 comp rx=0 tx=0).stop 2023-10-09T06:58:04.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.287+0000 7f3aee39d700 1 -- 172.21.15.71:0/1709419228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ae80b16d0 msgr2=0x7f3ae8159070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:04.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.287+0000 7f3aee39d700 1 --2- 172.21.15.71:0/1709419228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ae80b16d0 0x7f3ae8159070 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f3ae400e8d0 tx=0x7f3ae4008040 comp rx=0 tx=0).stop 2023-10-09T06:58:04.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.287+0000 7f3aee39d700 1 -- 172.21.15.71:0/1709419228 shutdown_connections 2023-10-09T06:58:04.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.287+0000 7f3aee39d700 1 --2- 172.21.15.71:0/1709419228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ae815d240 0x7f3ae815fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:04.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.287+0000 7f3aee39d700 1 --2- 172.21.15.71:0/1709419228 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3acc066f30 0x7f3acc0693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:04.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.287+0000 7f3aee39d700 1 --2- 172.21.15.71:0/1709419228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ae80b16d0 0x7f3ae8159070 secure :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f3ae400e8d0 tx=0x7f3ae4008040 comp rx=0 tx=0).stop 2023-10-09T06:58:04.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.287+0000 7f3aee39d700 1 --2- 172.21.15.71:0/1709419228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ae80b4e70 0x7f3ae815f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:04.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.287+0000 7f3aee39d700 1 -- 172.21.15.71:0/1709419228 >> 172.21.15.71:0/1709419228 conn(0x7f3ae80d10c0 msgr2=0x7f3ae80b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:04.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.288+0000 7f3aee39d700 1 -- 172.21.15.71:0/1709419228 shutdown_connections 2023-10-09T06:58:04.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.289+0000 7f3aee39d700 1 -- 172.21.15.71:0/1709419228 wait complete. 2023-10-09T06:58:04.293 INFO:teuthology.orchestra.run.smithi071.stderr:new fs with metadata pool 10 and data pool 11 2023-10-09T06:58:04.312 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:58:04.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.494+0000 7f62bf39d700 1 Processor -- start 2023-10-09T06:58:04.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.494+0000 7f62bf39d700 1 -- start start 2023-10-09T06:58:04.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.495+0000 7f62bf39d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f62b81566e0 0x7f62b80ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:04.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.495+0000 7f62bf39d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b80ca860 con 0x7f62b80cb900 2023-10-09T06:58:04.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.495+0000 7f62bf39d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b80cab40 con 0x7f62b8156310 2023-10-09T06:58:04.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.495+0000 7f62bf39d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b80cae20 con 0x7f62b81566e0 2023-10-09T06:58:04.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.495+0000 7f62beb9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f62b80cb900 0x7f62b80c6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39544/0 (socket says 172.21.15.71:39544) 2023-10-09T06:58:04.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.495+0000 7f62beb9c700 1 -- 172.21.15.71:0/2913143829 learned_addr learned my addr 172.21.15.71:0/2913143829 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:04.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.495+0000 7f62bdb9a700 1 --2- 172.21.15.71:0/2913143829 >> v2:172.21.15.179:3300/0 conn(0x7f62b81566e0 0x7f62b80ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:04.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.496+0000 7f62bd399700 1 -- 172.21.15.71:0/2913143829 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828645906 0 0) 0x7f62b80ca860 con 0x7f62b80cb900 2023-10-09T06:58:04.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.496+0000 7f62bd399700 1 -- 172.21.15.71:0/2913143829 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62a4003570 con 0x7f62b80cb900 2023-10-09T06:58:04.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.496+0000 7f62bd399700 1 -- 172.21.15.71:0/2913143829 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1065330480 0 0) 0x7f62a4003570 con 0x7f62b80cb900 2023-10-09T06:58:04.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.496+0000 7f62bd399700 1 -- 172.21.15.71:0/2913143829 >> v2:172.21.15.179:3300/0 conn(0x7f62b81566e0 msgr2=0x7f62b80ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:04.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.496+0000 7f62bd399700 1 --2- 172.21.15.71:0/2913143829 >> v2:172.21.15.179:3300/0 conn(0x7f62b81566e0 0x7f62b80ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:04.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.496+0000 7f62bd399700 1 -- 172.21.15.71:0/2913143829 >> v1:172.21.15.179:6789/0 conn(0x7f62b8156310 legacy=0x7f62b80c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:04.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.496+0000 7f62bd399700 1 -- 172.21.15.71:0/2913143829 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b80cb100 con 0x7f62b80cb900 2023-10-09T06:58:04.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.496+0000 7f62bd399700 1 -- 172.21.15.71:0/2913143829 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f62b00017f0 con 0x7f62b80cb900 2023-10-09T06:58:04.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.496+0000 7f62bd399700 1 -- 172.21.15.71:0/2913143829 >> v1:172.21.15.71:6789/0 conn(0x7f62b80cb900 legacy=0x7f62b80c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:04.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.496+0000 7f62bd399700 1 --2- 172.21.15.71:0/2913143829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62a4003a60 0x7f62a4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:04.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.496+0000 7f62bd399700 1 --2- 172.21.15.71:0/2913143829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a4004810 0x7f62a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:04.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.496+0000 7f62bd399700 1 --2- 172.21.15.71:0/2913143829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a40051c0 0x7f62a400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:04.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.496+0000 7f62bd399700 1 -- 172.21.15.71:0/2913143829 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b80cae20 con 0x7f62a4003a60 2023-10-09T06:58:04.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.496+0000 7f62bd399700 1 -- 172.21.15.71:0/2913143829 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a400c0d0 con 0x7f62a40051c0 2023-10-09T06:58:04.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.496+0000 7f62bd399700 1 -- 172.21.15.71:0/2913143829 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a400c290 con 0x7f62a4004810 2023-10-09T06:58:04.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.496+0000 7f62be39b700 1 --2- 172.21.15.71:0/2913143829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62a4003a60 0x7f62a4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:04.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.497+0000 7f62beb9c700 1 --2- 172.21.15.71:0/2913143829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a40051c0 0x7f62a400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:04.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.497+0000 7f62bdb9a700 1 --2- 172.21.15.71:0/2913143829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a4004810 0x7f62a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:04.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.497+0000 7f62be39b700 1 -- 172.21.15.71:0/2913143829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a4004810 msgr2=0x7f62a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:04.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.497+0000 7f62be39b700 1 --2- 172.21.15.71:0/2913143829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62a4004810 0x7f62a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:04.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.497+0000 7f62be39b700 1 -- 172.21.15.71:0/2913143829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a40051c0 msgr2=0x7f62a400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:04.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.497+0000 7f62be39b700 1 --2- 172.21.15.71:0/2913143829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a40051c0 0x7f62a400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:04.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.497+0000 7f62be39b700 1 -- 172.21.15.71:0/2913143829 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a4003570 con 0x7f62a4003a60 2023-10-09T06:58:04.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.497+0000 7f62beb9c700 1 --2- 172.21.15.71:0/2913143829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a40051c0 0x7f62a400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:04.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.497+0000 7f62beb9c700 1 -- 172.21.15.71:0/2913143829 reap_dead start 2023-10-09T06:58:04.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.497+0000 7f62be39b700 1 --2- 172.21.15.71:0/2913143829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62a4003a60 0x7f62a4003e70 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f62b4001360 tx=0x7f62b4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c8d7cd687df7e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:04.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.497+0000 7f62bd399700 1 -- 172.21.15.71:0/2913143829 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b40104a0 con 0x7f62a4003a60 2023-10-09T06:58:04.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.497+0000 7f62bd399700 1 -- 172.21.15.71:0/2913143829 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b4010620 con 0x7f62a4003a60 2023-10-09T06:58:04.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.497+0000 7f62bd399700 1 -- 172.21.15.71:0/2913143829 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b40107d0 con 0x7f62a4003a60 2023-10-09T06:58:04.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.498+0000 7f62bf39d700 1 -- 172.21.15.71:0/2913143829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62a4003a60 msgr2=0x7f62a4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:04.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.498+0000 7f62bf39d700 1 --2- 172.21.15.71:0/2913143829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62a4003a60 0x7f62a4003e70 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f62b4001360 tx=0x7f62b4007d30 comp rx=0 tx=0).stop 2023-10-09T06:58:04.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.498+0000 7f62bf39d700 1 -- 172.21.15.71:0/2913143829 shutdown_connections 2023-10-09T06:58:04.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.498+0000 7f62bf39d700 1 --2- 172.21.15.71:0/2913143829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62a4003a60 0x7f62a4003e70 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:04.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.498+0000 7f62bf39d700 1 -- 172.21.15.71:0/2913143829 >> 172.21.15.71:0/2913143829 conn(0x7f62b80cc1f0 msgr2=0x7f62b80cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:04.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.498+0000 7f62bf39d700 1 -- 172.21.15.71:0/2913143829 shutdown_connections 2023-10-09T06:58:04.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.498+0000 7f62bf39d700 1 -- 172.21.15.71:0/2913143829 wait complete. 2023-10-09T06:58:04.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.499+0000 7f62bf39d700 1 Processor -- start 2023-10-09T06:58:04.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.499+0000 7f62bf39d700 1 -- start start 2023-10-09T06:58:04.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.500+0000 7f62bf39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a4003a60 0x7f62b8151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:04.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.500+0000 7f62bf39d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62b815a340 0x7f62b8156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:04.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.500+0000 7f62bf39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b815a7b0 0x7f62b81547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:04.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.500+0000 7f62bf39d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b8159eb0 con 0x7f62b815a340 2023-10-09T06:58:04.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.500+0000 7f62bf39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b8157640 con 0x7f62a4003a60 2023-10-09T06:58:04.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.500+0000 7f62bf39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b8157920 con 0x7f62b815a7b0 2023-10-09T06:58:04.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.501+0000 7f62bdb9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62b815a340 0x7f62b8156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:04.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.501+0000 7f62bdb9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62b815a340 0x7f62b8156b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48424/0 (socket says 172.21.15.71:48424) 2023-10-09T06:58:04.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.501+0000 7f62bdb9a700 1 -- 172.21.15.71:0/4248551262 learned_addr learned my addr 172.21.15.71:0/4248551262 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:04.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.501+0000 7f62be39b700 1 --2- 172.21.15.71:0/4248551262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a4003a60 0x7f62b8151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:04.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.501+0000 7f62beb9c700 1 --2- 172.21.15.71:0/4248551262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b815a7b0 0x7f62b81547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:04.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.501+0000 7f62bdb9a700 1 -- 172.21.15.71:0/4248551262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b815a7b0 msgr2=0x7f62b81547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:04.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.501+0000 7f62bdb9a700 1 --2- 172.21.15.71:0/4248551262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b815a7b0 0x7f62b81547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:04.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.501+0000 7f62bdb9a700 1 -- 172.21.15.71:0/4248551262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a4003a60 msgr2=0x7f62b8151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:04.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.501+0000 7f62bdb9a700 1 --2- 172.21.15.71:0/4248551262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a4003a60 0x7f62b8151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:04.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.501+0000 7f62bdb9a700 1 -- 172.21.15.71:0/4248551262 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b8159b40 con 0x7f62b815a340 2023-10-09T06:58:04.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.501+0000 7f62bdb9a700 1 --2- 172.21.15.71:0/4248551262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62b815a340 0x7f62b8156b80 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f62a8011960 tx=0x7f62a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:04.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.501+0000 7f62ae7fc700 1 -- 172.21.15.71:0/4248551262 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a8015670 con 0x7f62b815a340 2023-10-09T06:58:04.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.501+0000 7f62ae7fc700 1 -- 172.21.15.71:0/4248551262 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a80157d0 con 0x7f62b815a340 2023-10-09T06:58:04.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.501+0000 7f62ae7fc700 1 -- 172.21.15.71:0/4248551262 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a8015b90 con 0x7f62b815a340 2023-10-09T06:58:04.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.502+0000 7f62bf39d700 1 -- 172.21.15.71:0/4248551262 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b8155960 con 0x7f62b815a340 2023-10-09T06:58:04.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.502+0000 7f62bf39d700 1 -- 172.21.15.71:0/4248551262 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b81570c0 con 0x7f62b815a340 2023-10-09T06:58:04.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.503+0000 7f62bf39d700 1 -- 172.21.15.71:0/4248551262 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b81573a0 con 0x7f62b815a340 2023-10-09T06:58:04.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.504+0000 7f62ae7fc700 1 -- 172.21.15.71:0/4248551262 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f62a8013410 con 0x7f62b815a340 2023-10-09T06:58:04.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.505+0000 7f62ae7fc700 1 --2- 172.21.15.71:0/4248551262 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f629c066f30 0x7f629c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:04.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.505+0000 7f62ae7fc700 1 -- 172.21.15.71:0/4248551262 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f62a8084ca0 con 0x7f62b815a340 2023-10-09T06:58:04.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.506+0000 7f62be39b700 1 --2- 172.21.15.71:0/4248551262 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f629c066f30 0x7f629c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:04.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.506+0000 7f62be39b700 1 --2- 172.21.15.71:0/4248551262 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f629c066f30 0x7f629c0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f62b4001010 tx=0x7f62b4017000 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:04.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.509+0000 7f62ae7fc700 1 -- 172.21.15.71:0/4248551262 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62a8051e40 con 0x7f62b815a340 2023-10-09T06:58:04.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.701+0000 7f62bf39d700 1 -- 172.21.15.71:0/4248551262 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62b804c3c0 con 0x7f62b815a340 2023-10-09T06:58:04.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.702+0000 7f62ae7fc700 1 -- 172.21.15.71:0/4248551262 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+15960 (secure 0 0 0) 0x7f62a8055460 con 0x7f62b815a340 2023-10-09T06:58:04.703 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:04.703 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":92,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:58:03.738756+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:58:01.931617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T06:58:02.718563+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:58:04.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.704+0000 7f62bf39d700 1 -- 172.21.15.71:0/4248551262 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f629c066f30 msgr2=0x7f629c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:04.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.704+0000 7f62bf39d700 1 --2- 172.21.15.71:0/4248551262 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f629c066f30 0x7f629c0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f62b4001010 tx=0x7f62b4017000 comp rx=0 tx=0).stop 2023-10-09T06:58:04.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.704+0000 7f62bf39d700 1 -- 172.21.15.71:0/4248551262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62b815a340 msgr2=0x7f62b8156b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:04.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.704+0000 7f62bf39d700 1 --2- 172.21.15.71:0/4248551262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62b815a340 0x7f62b8156b80 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f62a8011960 tx=0x7f62a8008040 comp rx=0 tx=0).stop 2023-10-09T06:58:04.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.704+0000 7f62bf39d700 1 -- 172.21.15.71:0/4248551262 shutdown_connections 2023-10-09T06:58:04.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.704+0000 7f62bf39d700 1 --2- 172.21.15.71:0/4248551262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b815a7b0 0x7f62b81547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:04.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.704+0000 7f62bf39d700 1 --2- 172.21.15.71:0/4248551262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62a4003a60 0x7f62b8151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:04.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.704+0000 7f62bf39d700 1 --2- 172.21.15.71:0/4248551262 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f629c066f30 0x7f629c0693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:04.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.704+0000 7f62bf39d700 1 --2- 172.21.15.71:0/4248551262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62b815a340 0x7f62b8156b80 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:04.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.704+0000 7f62bf39d700 1 -- 172.21.15.71:0/4248551262 >> 172.21.15.71:0/4248551262 conn(0x7f62b80cc1f0 msgr2=0x7f62b8151980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:04.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.705+0000 7f62bf39d700 1 -- 172.21.15.71:0/4248551262 shutdown_connections 2023-10-09T06:58:04.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.705+0000 7f62bf39d700 1 -- 172.21.15.71:0/4248551262 wait complete. 2023-10-09T06:58:04.724 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:58:04.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.905+0000 7fa590bff700 1 Processor -- start 2023-10-09T06:58:04.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.905+0000 7fa590bff700 1 -- start start 2023-10-09T06:58:04.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.906+0000 7fa590bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa58c06bcd0 0x7fa58c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:04.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.906+0000 7fa590bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa58c15df50 0x7fa58c15e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:04.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.906+0000 7fa590bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa58c15d7e0 con 0x7fa58c06c0a0 2023-10-09T06:58:04.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.906+0000 7fa590bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa58c15dac0 con 0x7fa58c15df50 2023-10-09T06:58:04.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.906+0000 7fa590bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c15aa30 con 0x7fa58c06bcd0 2023-10-09T06:58:04.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.907+0000 7fa58ad9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa58c15df50 0x7fa58c15e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:04.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.907+0000 7fa58a59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa58c06bcd0 0x7fa58c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:04.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.907+0000 7fa589d9b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fa58c06c0a0 0x7fa58c15a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:57034/0 (socket says 172.21.15.71:57034) 2023-10-09T06:58:04.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.907+0000 7fa58ad9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa58c15df50 0x7fa58c15e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:32958/0 (socket says 172.21.15.71:32958) 2023-10-09T06:58:04.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.907+0000 7fa589d9b700 1 -- 172.21.15.71:0/4187556168 learned_addr learned my addr 172.21.15.71:0/4187556168 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:04.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.907+0000 7fa58959a700 1 -- 172.21.15.71:0/4187556168 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1652839337 0 0) 0x7fa58c15d7e0 con 0x7fa58c06c0a0 2023-10-09T06:58:04.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.907+0000 7fa58959a700 1 -- 172.21.15.71:0/4187556168 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa574003570 con 0x7fa58c06c0a0 2023-10-09T06:58:04.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.907+0000 7fa58a59c700 1 -- 172.21.15.71:0/4187556168 >> v2:172.21.15.179:3300/0 conn(0x7fa58c15df50 msgr2=0x7fa58c15e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:04.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.907+0000 7fa58a59c700 1 --2- 172.21.15.71:0/4187556168 >> v2:172.21.15.179:3300/0 conn(0x7fa58c15df50 0x7fa58c15e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:04.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.907+0000 7fa58a59c700 1 -- 172.21.15.71:0/4187556168 >> v1:172.21.15.179:6789/0 conn(0x7fa58c06c0a0 legacy=0x7fa58c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:04.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.908+0000 7fa58a59c700 1 -- 172.21.15.71:0/4187556168 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58c15ad10 con 0x7fa58c06bcd0 2023-10-09T06:58:04.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.908+0000 7fa58a59c700 1 --2- 172.21.15.71:0/4187556168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa58c06bcd0 0x7fa58c0caa90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa57c0098e0 tx=0x7fa57c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1f77a29751004c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:04.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.908+0000 7fa58959a700 1 -- 172.21.15.71:0/4187556168 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c011630 con 0x7fa58c06bcd0 2023-10-09T06:58:04.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.908+0000 7fa58959a700 1 -- 172.21.15.71:0/4187556168 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57c011790 con 0x7fa58c06bcd0 2023-10-09T06:58:04.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.908+0000 7fa58959a700 1 -- 172.21.15.71:0/4187556168 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c011b30 con 0x7fa58c06bcd0 2023-10-09T06:58:04.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.909+0000 7fa590bff700 1 -- 172.21.15.71:0/4187556168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa58c06bcd0 msgr2=0x7fa58c0caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:04.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.909+0000 7fa590bff700 1 --2- 172.21.15.71:0/4187556168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa58c06bcd0 0x7fa58c0caa90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa57c0098e0 tx=0x7fa57c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:04.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.909+0000 7fa590bff700 1 -- 172.21.15.71:0/4187556168 shutdown_connections 2023-10-09T06:58:04.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.909+0000 7fa590bff700 1 --2- 172.21.15.71:0/4187556168 >> v2:172.21.15.179:3300/0 conn(0x7fa58c15df50 0x7fa58c15e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:04.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.909+0000 7fa590bff700 1 --2- 172.21.15.71:0/4187556168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa58c06bcd0 0x7fa58c0caa90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:04.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.909+0000 7fa590bff700 1 -- 172.21.15.71:0/4187556168 >> 172.21.15.71:0/4187556168 conn(0x7fa58c0ce600 msgr2=0x7fa58c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:04.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.909+0000 7fa590bff700 1 -- 172.21.15.71:0/4187556168 shutdown_connections 2023-10-09T06:58:04.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.909+0000 7fa590bff700 1 -- 172.21.15.71:0/4187556168 wait complete. 2023-10-09T06:58:04.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.910+0000 7fa590bff700 1 Processor -- start 2023-10-09T06:58:04.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.910+0000 7fa590bff700 1 -- start start 2023-10-09T06:58:04.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.911+0000 7fa590bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa58c06bcd0 0x7fa58c154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:04.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.911+0000 7fa590bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa58c06c0a0 0x7fa58c1590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:04.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.911+0000 7fa590bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa58c15df50 0x7fa58c156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:04.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.911+0000 7fa590bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c154c70 con 0x7fa58c06bcd0 2023-10-09T06:58:04.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.911+0000 7fa590bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c0c56b0 con 0x7fa58c15df50 2023-10-09T06:58:04.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.911+0000 7fa590bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c158270 con 0x7fa58c06c0a0 2023-10-09T06:58:04.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.912+0000 7fa58a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa58c06bcd0 0x7fa58c154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:04.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.912+0000 7fa58a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa58c06bcd0 0x7fa58c154730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48432/0 (socket says 172.21.15.71:48432) 2023-10-09T06:58:04.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.912+0000 7fa58a59c700 1 -- 172.21.15.71:0/3192440847 learned_addr learned my addr 172.21.15.71:0/3192440847 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:04.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.912+0000 7fa589d9b700 1 --2- 172.21.15.71:0/3192440847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa58c06c0a0 0x7fa58c1590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:04.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.912+0000 7fa58ad9d700 1 --2- 172.21.15.71:0/3192440847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa58c15df50 0x7fa58c156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:04.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.912+0000 7fa58a59c700 1 -- 172.21.15.71:0/3192440847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa58c06c0a0 msgr2=0x7fa58c1590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:04.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.912+0000 7fa58a59c700 1 --2- 172.21.15.71:0/3192440847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa58c06c0a0 0x7fa58c1590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:04.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.912+0000 7fa58a59c700 1 -- 172.21.15.71:0/3192440847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa58c15df50 msgr2=0x7fa58c156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:04.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.912+0000 7fa58a59c700 1 --2- 172.21.15.71:0/3192440847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa58c15df50 0x7fa58c156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:04.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.912+0000 7fa58a59c700 1 -- 172.21.15.71:0/3192440847 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57c009420 con 0x7fa58c06bcd0 2023-10-09T06:58:04.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.912+0000 7fa58ad9d700 1 --2- 172.21.15.71:0/3192440847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa58c15df50 0x7fa58c156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:04.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.912+0000 7fa58a59c700 1 --2- 172.21.15.71:0/3192440847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa58c06bcd0 0x7fa58c154730 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa57c009ed0 tx=0x7fa57c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:04.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.913+0000 7fa57a7fc700 1 -- 172.21.15.71:0/3192440847 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c000d10 con 0x7fa58c06bcd0 2023-10-09T06:58:04.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.913+0000 7fa57a7fc700 1 -- 172.21.15.71:0/3192440847 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57c011b10 con 0x7fa58c06bcd0 2023-10-09T06:58:04.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.913+0000 7fa57a7fc700 1 -- 172.21.15.71:0/3192440847 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c025620 con 0x7fa58c06bcd0 2023-10-09T06:58:04.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.913+0000 7fa590bff700 1 -- 172.21.15.71:0/3192440847 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa58c158550 con 0x7fa58c06bcd0 2023-10-09T06:58:04.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.913+0000 7fa590bff700 1 -- 172.21.15.71:0/3192440847 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58c158b10 con 0x7fa58c06bcd0 2023-10-09T06:58:04.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.914+0000 7fa590bff700 1 -- 172.21.15.71:0/3192440847 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa58c064ed0 con 0x7fa58c06bcd0 2023-10-09T06:58:04.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.915+0000 7fa57a7fc700 1 -- 172.21.15.71:0/3192440847 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa57c025a10 con 0x7fa58c06bcd0 2023-10-09T06:58:04.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.915+0000 7fa57a7fc700 1 --2- 172.21.15.71:0/3192440847 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa56c066f30 0x7fa56c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:04.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.916+0000 7fa57a7fc700 1 -- 172.21.15.71:0/3192440847 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fa57c085d10 con 0x7fa58c06bcd0 2023-10-09T06:58:04.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.916+0000 7fa589d9b700 1 --2- 172.21.15.71:0/3192440847 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa56c066f30 0x7fa56c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:04.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.917+0000 7fa589d9b700 1 --2- 172.21.15.71:0/3192440847 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa56c066f30 0x7fa56c0693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0c5490 tx=0x7fa580009040 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:04.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:04.920+0000 7fa57a7fc700 1 -- 172.21.15.71:0/3192440847 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa57c052df0 con 0x7fa58c06bcd0 2023-10-09T06:58:05.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.110+0000 7fa590bff700 1 -- 172.21.15.71:0/3192440847 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa58c1556f0 con 0x7fa58c06bcd0 2023-10-09T06:58:05.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.111+0000 7fa57a7fc700 1 -- 172.21.15.71:0/3192440847 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+15947 (secure 0 0 0) 0x7fa57c015090 con 0x7fa58c06bcd0 2023-10-09T06:58:05.112 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:05.112 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":93,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:58:04.764540+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:58:01.931617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T06:58:02.718563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:58:05.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.113+0000 7fa590bff700 1 -- 172.21.15.71:0/3192440847 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa56c066f30 msgr2=0x7fa56c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:05.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.113+0000 7fa590bff700 1 --2- 172.21.15.71:0/3192440847 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa56c066f30 0x7fa56c0693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0c5490 tx=0x7fa580009040 comp rx=0 tx=0).stop 2023-10-09T06:58:05.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.113+0000 7fa590bff700 1 -- 172.21.15.71:0/3192440847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa58c06bcd0 msgr2=0x7fa58c154730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:05.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.113+0000 7fa590bff700 1 --2- 172.21.15.71:0/3192440847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa58c06bcd0 0x7fa58c154730 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa57c009ed0 tx=0x7fa57c017000 comp rx=0 tx=0).stop 2023-10-09T06:58:05.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.113+0000 7fa590bff700 1 -- 172.21.15.71:0/3192440847 shutdown_connections 2023-10-09T06:58:05.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.113+0000 7fa590bff700 1 --2- 172.21.15.71:0/3192440847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa58c15df50 0x7fa58c156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:05.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.113+0000 7fa590bff700 1 --2- 172.21.15.71:0/3192440847 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa56c066f30 0x7fa56c0693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:05.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.113+0000 7fa590bff700 1 --2- 172.21.15.71:0/3192440847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa58c06bcd0 0x7fa58c154730 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:05.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.113+0000 7fa590bff700 1 --2- 172.21.15.71:0/3192440847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa58c06c0a0 0x7fa58c1590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:05.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.113+0000 7fa590bff700 1 -- 172.21.15.71:0/3192440847 >> 172.21.15.71:0/3192440847 conn(0x7fa58c0ce600 msgr2=0x7fa58c06a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:05.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.113+0000 7fa590bff700 1 -- 172.21.15.71:0/3192440847 shutdown_connections 2023-10-09T06:58:05.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.113+0000 7fa590bff700 1 -- 172.21.15.71:0/3192440847 wait complete. 2023-10-09T06:58:05.132 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T06:58:05.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.314+0000 7fcc74dff700 1 Processor -- start 2023-10-09T06:58:05.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.314+0000 7fcc74dff700 1 -- start start 2023-10-09T06:58:05.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.315+0000 7fcc74dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcc700c83f0 0x7fcc700c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:05.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.315+0000 7fcc74dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc7015b0d0 con 0x7fcc701568e0 2023-10-09T06:58:05.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.316+0000 7fcc74dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc700c7a60 con 0x7fcc700ccee0 2023-10-09T06:58:05.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.316+0000 7fcc74dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc7015a4c0 con 0x7fcc700c83f0 2023-10-09T06:58:05.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.316+0000 7fcc6e59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcc700c83f0 0x7fcc700c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:05.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.316+0000 7fcc6e59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcc700c83f0 0x7fcc700c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59836/0 (socket says 172.21.15.71:59836) 2023-10-09T06:58:05.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.316+0000 7fcc6e59c700 1 -- 172.21.15.71:0/2564209427 learned_addr learned my addr 172.21.15.71:0/2564209427 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:05.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.316+0000 7fcc6ed9d700 1 --1- 172.21.15.71:0/2564209427 >> v1:172.21.15.71:6789/0 conn(0x7fcc701568e0 0x7fcc700ca1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:38554/0 (socket says 172.21.15.71:38554) 2023-10-09T06:58:05.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.316+0000 7fcc6e59c700 1 -- 172.21.15.71:0/2564209427 >> v1:172.21.15.179:6789/0 conn(0x7fcc700ccee0 legacy=0x7fcc701561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:05.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.316+0000 7fcc6e59c700 1 -- 172.21.15.71:0/2564209427 >> v1:172.21.15.71:6789/0 conn(0x7fcc701568e0 legacy=0x7fcc700ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:05.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.316+0000 7fcc6e59c700 1 -- 172.21.15.71:0/2564209427 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7015a7a0 con 0x7fcc700c83f0 2023-10-09T06:58:05.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.316+0000 7fcc6d59a700 1 -- 172.21.15.71:0/2564209427 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1608967031 0 0) 0x7fcc7015b0d0 con 0x7fcc701568e0 2023-10-09T06:58:05.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.317+0000 7fcc6e59c700 1 --2- 172.21.15.71:0/2564209427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc700c83f0 0x7fcc700c7520 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fcc600099b0 tx=0x7fcc60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc2fb0c54d6561f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:05.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.317+0000 7fcc6d59a700 1 -- 172.21.15.71:0/2564209427 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6000b860 con 0x7fcc700c83f0 2023-10-09T06:58:05.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.317+0000 7fcc6d59a700 1 -- 172.21.15.71:0/2564209427 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6000b9c0 con 0x7fcc700c83f0 2023-10-09T06:58:05.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.317+0000 7fcc6d59a700 1 -- 172.21.15.71:0/2564209427 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6000bd60 con 0x7fcc700c83f0 2023-10-09T06:58:05.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.317+0000 7fcc74dff700 1 -- 172.21.15.71:0/2564209427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc700c83f0 msgr2=0x7fcc700c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:05.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.317+0000 7fcc74dff700 1 --2- 172.21.15.71:0/2564209427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc700c83f0 0x7fcc700c7520 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fcc600099b0 tx=0x7fcc60009250 comp rx=0 tx=0).stop 2023-10-09T06:58:05.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.317+0000 7fcc74dff700 1 -- 172.21.15.71:0/2564209427 shutdown_connections 2023-10-09T06:58:05.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.317+0000 7fcc74dff700 1 --2- 172.21.15.71:0/2564209427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc700c83f0 0x7fcc700c7520 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:05.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.317+0000 7fcc74dff700 1 -- 172.21.15.71:0/2564209427 >> 172.21.15.71:0/2564209427 conn(0x7fcc70068e10 msgr2=0x7fcc700cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:05.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.318+0000 7fcc74dff700 1 -- 172.21.15.71:0/2564209427 shutdown_connections 2023-10-09T06:58:05.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.318+0000 7fcc74dff700 1 -- 172.21.15.71:0/2564209427 wait complete. 2023-10-09T06:58:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.319+0000 7fcc74dff700 1 Processor -- start 2023-10-09T06:58:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.319+0000 7fcc74dff700 1 -- start start 2023-10-09T06:58:05.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.320+0000 7fcc74dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc700c83f0 0x7fcc7014f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:05.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.320+0000 7fcc74dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc700ccee0 0x7fcc701552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:05.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.320+0000 7fcc74dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc701568e0 0x7fcc701594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:05.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.320+0000 7fcc74dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc701582f0 con 0x7fcc701568e0 2023-10-09T06:58:05.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.320+0000 7fcc74dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc701585d0 con 0x7fcc700c83f0 2023-10-09T06:58:05.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.320+0000 7fcc74dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc701588b0 con 0x7fcc700ccee0 2023-10-09T06:58:05.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.320+0000 7fcc6ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc701568e0 0x7fcc701594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:05.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.320+0000 7fcc6ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc701568e0 0x7fcc701594d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59842/0 (socket says 172.21.15.71:59842) 2023-10-09T06:58:05.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.320+0000 7fcc6ed9d700 1 -- 172.21.15.71:0/374073151 learned_addr learned my addr 172.21.15.71:0/374073151 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:05.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.320+0000 7fcc6e59c700 1 --2- 172.21.15.71:0/374073151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc700c83f0 0x7fcc7014f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:05.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.320+0000 7fcc6dd9b700 1 --2- 172.21.15.71:0/374073151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc700ccee0 0x7fcc701552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.321+0000 7fcc6ed9d700 1 -- 172.21.15.71:0/374073151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc700ccee0 msgr2=0x7fcc701552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.321+0000 7fcc6ed9d700 1 --2- 172.21.15.71:0/374073151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc700ccee0 0x7fcc701552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.321+0000 7fcc6ed9d700 1 -- 172.21.15.71:0/374073151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc700c83f0 msgr2=0x7fcc7014f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.321+0000 7fcc6ed9d700 1 --2- 172.21.15.71:0/374073151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc700c83f0 0x7fcc7014f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.321+0000 7fcc6ed9d700 1 -- 172.21.15.71:0/374073151 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc600094f0 con 0x7fcc701568e0 2023-10-09T06:58:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.321+0000 7fcc6dd9b700 1 --2- 172.21.15.71:0/374073151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc700ccee0 0x7fcc701552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:05.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.321+0000 7fcc6ed9d700 1 --2- 172.21.15.71:0/374073151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc701568e0 0x7fcc701594d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800ccc0 tx=0x7fcc68001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:05.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.321+0000 7fcc5e7fc700 1 -- 172.21.15.71:0/374073151 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68005df0 con 0x7fcc701568e0 2023-10-09T06:58:05.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.321+0000 7fcc5e7fc700 1 -- 172.21.15.71:0/374073151 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6800a6b0 con 0x7fcc701568e0 2023-10-09T06:58:05.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.321+0000 7fcc5e7fc700 1 -- 172.21.15.71:0/374073151 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6800aa70 con 0x7fcc701568e0 2023-10-09T06:58:05.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.321+0000 7fcc74dff700 1 -- 172.21.15.71:0/374073151 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc70158b90 con 0x7fcc701568e0 2023-10-09T06:58:05.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.321+0000 7fcc74dff700 1 -- 172.21.15.71:0/374073151 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc70155810 con 0x7fcc701568e0 2023-10-09T06:58:05.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.322+0000 7fcc74dff700 1 -- 172.21.15.71:0/374073151 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc70155a90 con 0x7fcc701568e0 2023-10-09T06:58:05.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.323+0000 7fcc5e7fc700 1 -- 172.21.15.71:0/374073151 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc680070f0 con 0x7fcc701568e0 2023-10-09T06:58:05.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.325+0000 7fcc5e7fc700 1 --2- 172.21.15.71:0/374073151 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcc50066f30 0x7fcc500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:05.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.325+0000 7fcc5e7fc700 1 -- 172.21.15.71:0/374073151 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fcc68084830 con 0x7fcc701568e0 2023-10-09T06:58:05.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.326+0000 7fcc6e59c700 1 --2- 172.21.15.71:0/374073151 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcc50066f30 0x7fcc500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:05.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.326+0000 7fcc6e59c700 1 --2- 172.21.15.71:0/374073151 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcc50066f30 0x7fcc500693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcc600099b0 tx=0x7fcc60017000 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:05.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.329+0000 7fcc5e7fc700 1 -- 172.21.15.71:0/374073151 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc68051a40 con 0x7fcc701568e0 2023-10-09T06:58:05.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:05.564+0000 7fcc74dff700 1 -- 172.21.15.71:0/374073151 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcc700c3670 con 0x7fcc701568e0 2023-10-09T06:58:06.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.308+0000 7fcc5e7fc700 1 -- 172.21.15.71:0/374073151 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v40) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcc700c3670 con 0x7fcc701568e0 2023-10-09T06:58:06.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.311+0000 7fcc74dff700 1 -- 172.21.15.71:0/374073151 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcc50066f30 msgr2=0x7fcc500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:06.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.311+0000 7fcc74dff700 1 --2- 172.21.15.71:0/374073151 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcc50066f30 0x7fcc500693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcc600099b0 tx=0x7fcc60017000 comp rx=0 tx=0).stop 2023-10-09T06:58:06.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.311+0000 7fcc74dff700 1 -- 172.21.15.71:0/374073151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc701568e0 msgr2=0x7fcc701594d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:06.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.311+0000 7fcc74dff700 1 --2- 172.21.15.71:0/374073151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc701568e0 0x7fcc701594d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800ccc0 tx=0x7fcc68001a70 comp rx=0 tx=0).stop 2023-10-09T06:58:06.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.311+0000 7fcc74dff700 1 -- 172.21.15.71:0/374073151 shutdown_connections 2023-10-09T06:58:06.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.311+0000 7fcc74dff700 1 --2- 172.21.15.71:0/374073151 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fcc50066f30 0x7fcc500693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:06.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.311+0000 7fcc74dff700 1 --2- 172.21.15.71:0/374073151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc701568e0 0x7fcc701594d0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:06.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.311+0000 7fcc74dff700 1 --2- 172.21.15.71:0/374073151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc700c83f0 0x7fcc7014f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:06.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.311+0000 7fcc74dff700 1 --2- 172.21.15.71:0/374073151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc700ccee0 0x7fcc701552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:06.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.311+0000 7fcc74dff700 1 -- 172.21.15.71:0/374073151 >> 172.21.15.71:0/374073151 conn(0x7fcc70068e10 msgr2=0x7fcc700ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:06.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.311+0000 7fcc74dff700 1 -- 172.21.15.71:0/374073151 shutdown_connections 2023-10-09T06:58:06.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.311+0000 7fcc74dff700 1 -- 172.21.15.71:0/374073151 wait complete. 2023-10-09T06:58:06.332 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T06:58:06.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.518+0000 7f4523fff700 1 Processor -- start 2023-10-09T06:58:06.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.518+0000 7f4523fff700 1 -- start start 2023-10-09T06:58:06.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.519+0000 7f4523fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f45240b4e70 0x7f45240ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:06.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.519+0000 7f4523fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45240cfb00 con 0x7f45240b16d0 2023-10-09T06:58:06.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.519+0000 7f4523fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f452415e060 con 0x7f45240b1b40 2023-10-09T06:58:06.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.519+0000 7f4523fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45240b5c40 con 0x7f45240b4e70 2023-10-09T06:58:06.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.519+0000 7f4522ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f45240b4e70 0x7f45240ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:06.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.519+0000 7f45227fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f45240b16d0 0x7f452415d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:38564/0 (socket says 172.21.15.71:38564) 2023-10-09T06:58:06.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.519+0000 7f45227fc700 1 -- 172.21.15.71:0/3483048519 learned_addr learned my addr 172.21.15.71:0/3483048519 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:06.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.520+0000 7f4522ffd700 1 -- 172.21.15.71:0/3483048519 >> v1:172.21.15.179:6789/0 conn(0x7f45240b1b40 legacy=0x7f452415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:06.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.520+0000 7f4522ffd700 1 -- 172.21.15.71:0/3483048519 >> v1:172.21.15.71:6789/0 conn(0x7f45240b16d0 legacy=0x7f452415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:06.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.520+0000 7f4522ffd700 1 -- 172.21.15.71:0/3483048519 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45240b5f20 con 0x7f45240b4e70 2023-10-09T06:58:06.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.520+0000 7f4521ffb700 1 -- 172.21.15.71:0/3483048519 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 499760305 0 0) 0x7f45240cfb00 con 0x7f45240b16d0 2023-10-09T06:58:06.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.520+0000 7f4522ffd700 1 --2- 172.21.15.71:0/3483048519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45240b4e70 0x7f45240ccff0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f45140098e0 tx=0x7f45140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3e298c8f3d427c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:06.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.520+0000 7f4521ffb700 1 -- 172.21.15.71:0/3483048519 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4514009e80 con 0x7f45240b4e70 2023-10-09T06:58:06.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.520+0000 7f4521ffb700 1 -- 172.21.15.71:0/3483048519 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451400b820 con 0x7f45240b4e70 2023-10-09T06:58:06.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.520+0000 7f4521ffb700 1 -- 172.21.15.71:0/3483048519 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451400bba0 con 0x7f45240b4e70 2023-10-09T06:58:06.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.521+0000 7f4523fff700 1 -- 172.21.15.71:0/3483048519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45240b4e70 msgr2=0x7f45240ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:06.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.521+0000 7f4523fff700 1 --2- 172.21.15.71:0/3483048519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45240b4e70 0x7f45240ccff0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f45140098e0 tx=0x7f45140091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:06.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.521+0000 7f4523fff700 1 -- 172.21.15.71:0/3483048519 shutdown_connections 2023-10-09T06:58:06.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.521+0000 7f4523fff700 1 --2- 172.21.15.71:0/3483048519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45240b4e70 0x7f45240ccff0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:06.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.521+0000 7f4523fff700 1 -- 172.21.15.71:0/3483048519 >> 172.21.15.71:0/3483048519 conn(0x7f45240d10c0 msgr2=0x7f45240affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:06.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.521+0000 7f4523fff700 1 -- 172.21.15.71:0/3483048519 shutdown_connections 2023-10-09T06:58:06.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.521+0000 7f4523fff700 1 -- 172.21.15.71:0/3483048519 wait complete. 2023-10-09T06:58:06.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.522+0000 7f4523fff700 1 Processor -- start 2023-10-09T06:58:06.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.522+0000 7f4523fff700 1 -- start start 2023-10-09T06:58:06.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.523+0000 7f4523fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45240b16d0 0x7f4524148020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:06.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.523+0000 7f4523fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45240b1b40 0x7f4524148560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:06.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.523+0000 7f4523fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45240b4e70 0x7f4524148aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:06.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.523+0000 7f4523fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4524145eb0 con 0x7f45240b4e70 2023-10-09T06:58:06.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.523+0000 7f4523fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45240c94e0 con 0x7f45240b16d0 2023-10-09T06:58:06.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.523+0000 7f4523fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45240c88d0 con 0x7f45240b1b40 2023-10-09T06:58:06.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.524+0000 7f45237fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45240b4e70 0x7f4524148aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:06.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.524+0000 7f45237fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45240b4e70 0x7f4524148aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59856/0 (socket says 172.21.15.71:59856) 2023-10-09T06:58:06.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.524+0000 7f45237fe700 1 -- 172.21.15.71:0/2476289909 learned_addr learned my addr 172.21.15.71:0/2476289909 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:06.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.524+0000 7f4522ffd700 1 --2- 172.21.15.71:0/2476289909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45240b16d0 0x7f4524148020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:06.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.524+0000 7f45227fc700 1 --2- 172.21.15.71:0/2476289909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45240b1b40 0x7f4524148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:06.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.524+0000 7f45237fe700 1 -- 172.21.15.71:0/2476289909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45240b1b40 msgr2=0x7f4524148560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:06.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.524+0000 7f45237fe700 1 --2- 172.21.15.71:0/2476289909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45240b1b40 0x7f4524148560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:06.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.524+0000 7f45237fe700 1 -- 172.21.15.71:0/2476289909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45240b16d0 msgr2=0x7f4524148020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:06.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.524+0000 7f45237fe700 1 --2- 172.21.15.71:0/2476289909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45240b16d0 0x7f4524148020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:06.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.524+0000 7f45237fe700 1 -- 172.21.15.71:0/2476289909 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4514009420 con 0x7f45240b4e70 2023-10-09T06:58:06.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.524+0000 7f45237fe700 1 --2- 172.21.15.71:0/2476289909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45240b4e70 0x7f4524148aa0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f451c00bbb0 tx=0x7f451c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:06.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.524+0000 7f450affd700 1 -- 172.21.15.71:0/2476289909 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c00c630 con 0x7f45240b4e70 2023-10-09T06:58:06.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.524+0000 7f450affd700 1 -- 172.21.15.71:0/2476289909 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451c00c7b0 con 0x7f45240b4e70 2023-10-09T06:58:06.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.524+0000 7f4523fff700 1 -- 172.21.15.71:0/2476289909 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45240c8bb0 con 0x7f45240b4e70 2023-10-09T06:58:06.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.525+0000 7f450affd700 1 -- 172.21.15.71:0/2476289909 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c00cb70 con 0x7f45240b4e70 2023-10-09T06:58:06.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.525+0000 7f4523fff700 1 -- 172.21.15.71:0/2476289909 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45240c9170 con 0x7f45240b4e70 2023-10-09T06:58:06.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.525+0000 7f4523fff700 1 -- 172.21.15.71:0/2476289909 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4524088990 con 0x7f45240b4e70 2023-10-09T06:58:06.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.526+0000 7f450affd700 1 -- 172.21.15.71:0/2476289909 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f451c012070 con 0x7f45240b4e70 2023-10-09T06:58:06.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.527+0000 7f450affd700 1 --2- 172.21.15.71:0/2476289909 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4510066f30 0x7f45100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:06.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.527+0000 7f450affd700 1 -- 172.21.15.71:0/2476289909 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f451c084280 con 0x7f45240b4e70 2023-10-09T06:58:06.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.528+0000 7f4522ffd700 1 --2- 172.21.15.71:0/2476289909 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4510066f30 0x7f45100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:06.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.528+0000 7f4522ffd700 1 --2- 172.21.15.71:0/2476289909 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4510066f30 0x7f45100693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f45140030c0 tx=0x7f4514016000 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:06.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.531+0000 7f450affd700 1 -- 172.21.15.71:0/2476289909 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f451c051360 con 0x7f45240b4e70 2023-10-09T06:58:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:06.763+0000 7f4523fff700 1 -- 172.21.15.71:0/2476289909 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f45240af990 con 0x7f45240b4e70 2023-10-09T06:58:07.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.309+0000 7f450affd700 1 -- 172.21.15.71:0/2476289909 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v41) v1 ==== 122+0+0 (secure 0 0 0) 0x7f451c054980 con 0x7f45240b4e70 2023-10-09T06:58:07.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.312+0000 7f4523fff700 1 -- 172.21.15.71:0/2476289909 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4510066f30 msgr2=0x7f45100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:07.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.312+0000 7f4523fff700 1 --2- 172.21.15.71:0/2476289909 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4510066f30 0x7f45100693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f45140030c0 tx=0x7f4514016000 comp rx=0 tx=0).stop 2023-10-09T06:58:07.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.312+0000 7f4523fff700 1 -- 172.21.15.71:0/2476289909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45240b4e70 msgr2=0x7f4524148aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:07.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.312+0000 7f4523fff700 1 --2- 172.21.15.71:0/2476289909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45240b4e70 0x7f4524148aa0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f451c00bbb0 tx=0x7f451c009840 comp rx=0 tx=0).stop 2023-10-09T06:58:07.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.312+0000 7f4523fff700 1 -- 172.21.15.71:0/2476289909 shutdown_connections 2023-10-09T06:58:07.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.312+0000 7f4523fff700 1 --2- 172.21.15.71:0/2476289909 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4510066f30 0x7f45100693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:07.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.312+0000 7f4523fff700 1 --2- 172.21.15.71:0/2476289909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45240b4e70 0x7f4524148aa0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:07.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.312+0000 7f4523fff700 1 --2- 172.21.15.71:0/2476289909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45240b16d0 0x7f4524148020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:07.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.312+0000 7f4523fff700 1 --2- 172.21.15.71:0/2476289909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45240b1b40 0x7f4524148560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:07.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.312+0000 7f4523fff700 1 -- 172.21.15.71:0/2476289909 >> 172.21.15.71:0/2476289909 conn(0x7f45240d10c0 msgr2=0x7f45240ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:07.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.312+0000 7f4523fff700 1 -- 172.21.15.71:0/2476289909 shutdown_connections 2023-10-09T06:58:07.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.312+0000 7f4523fff700 1 -- 172.21.15.71:0/2476289909 wait complete. 2023-10-09T06:58:07.333 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:58:07.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.515+0000 7f392219d700 1 Processor -- start 2023-10-09T06:58:07.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.516+0000 7f392219d700 1 -- start start 2023-10-09T06:58:07.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.517+0000 7f392219d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f391c150180 0x7f391c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:07.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.517+0000 7f392219d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f391c06e2a0 con 0x7f391c0c7410 2023-10-09T06:58:07.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.517+0000 7f392219d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f391c06b2e0 con 0x7f391c150550 2023-10-09T06:58:07.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.517+0000 7f392219d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391c0c78e0 con 0x7f391c150180 2023-10-09T06:58:07.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.517+0000 7f392199c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f391c0c7410 0x7f391c069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:38574/0 (socket says 172.21.15.71:38574) 2023-10-09T06:58:07.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.517+0000 7f392199c700 1 -- 172.21.15.71:0/2480984064 learned_addr learned my addr 172.21.15.71:0/2480984064 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:07.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.518+0000 7f392119b700 1 --2- 172.21.15.71:0/2480984064 >> v2:172.21.15.179:3300/0 conn(0x7f391c150180 0x7f391c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:07.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.518+0000 7f3913fff700 1 -- 172.21.15.71:0/2480984064 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2350987860 0 0) 0x7f391c06e2a0 con 0x7f391c0c7410 2023-10-09T06:58:07.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.518+0000 7f3913fff700 1 -- 172.21.15.71:0/2480984064 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3908003570 con 0x7f391c0c7410 2023-10-09T06:58:07.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.518+0000 7f3913fff700 1 -- 172.21.15.71:0/2480984064 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1234167408 0 0) 0x7f3908003570 con 0x7f391c0c7410 2023-10-09T06:58:07.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.518+0000 7f3913fff700 1 -- 172.21.15.71:0/2480984064 >> v2:172.21.15.179:3300/0 conn(0x7f391c150180 msgr2=0x7f391c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:07.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.518+0000 7f3913fff700 1 --2- 172.21.15.71:0/2480984064 >> v2:172.21.15.179:3300/0 conn(0x7f391c150180 0x7f391c157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:07.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.518+0000 7f3913fff700 1 -- 172.21.15.71:0/2480984064 >> v1:172.21.15.179:6789/0 conn(0x7f391c150550 legacy=0x7f391c0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:07.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.518+0000 7f3913fff700 1 -- 172.21.15.71:0/2480984064 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c0c7bc0 con 0x7f391c0c7410 2023-10-09T06:58:07.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.518+0000 7f3913fff700 1 -- 172.21.15.71:0/2480984064 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f39140017f0 con 0x7f391c0c7410 2023-10-09T06:58:07.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.518+0000 7f3913fff700 1 -- 172.21.15.71:0/2480984064 >> v1:172.21.15.71:6789/0 conn(0x7f391c0c7410 legacy=0x7f391c069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:07.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.518+0000 7f3913fff700 1 --2- 172.21.15.71:0/2480984064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3908003ab0 0x7f3908003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:07.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.518+0000 7f3913fff700 1 --2- 172.21.15.71:0/2480984064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3908004810 0x7f3908004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:07.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.518+0000 7f3913fff700 1 --2- 172.21.15.71:0/2480984064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3908005210 0x7f390800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:07.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.518+0000 7f3913fff700 1 -- 172.21.15.71:0/2480984064 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0c78e0 con 0x7f3908004810 2023-10-09T06:58:07.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.518+0000 7f3913fff700 1 -- 172.21.15.71:0/2480984064 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390800c130 con 0x7f3908003ab0 2023-10-09T06:58:07.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.518+0000 7f3913fff700 1 -- 172.21.15.71:0/2480984064 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390800c2f0 con 0x7f3908005210 2023-10-09T06:58:07.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.518+0000 7f392099a700 1 --2- 172.21.15.71:0/2480984064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3908004810 0x7f3908004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:07.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.519+0000 7f392119b700 1 --2- 172.21.15.71:0/2480984064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3908003ab0 0x7f3908003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:07.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.519+0000 7f392199c700 1 --2- 172.21.15.71:0/2480984064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3908005210 0x7f390800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:07.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.519+0000 7f392099a700 1 -- 172.21.15.71:0/2480984064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3908005210 msgr2=0x7f390800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:07.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.519+0000 7f392099a700 1 --2- 172.21.15.71:0/2480984064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3908005210 0x7f390800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:07.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.519+0000 7f392099a700 1 -- 172.21.15.71:0/2480984064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3908003ab0 msgr2=0x7f3908003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:07.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.519+0000 7f392099a700 1 --2- 172.21.15.71:0/2480984064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3908003ab0 0x7f3908003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:07.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.519+0000 7f392099a700 1 -- 172.21.15.71:0/2480984064 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3908003570 con 0x7f3908004810 2023-10-09T06:58:07.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.519+0000 7f392199c700 1 -- 172.21.15.71:0/2480984064 reap_dead start 2023-10-09T06:58:07.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.519+0000 7f392099a700 1 --2- 172.21.15.71:0/2480984064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3908004810 0x7f3908004c80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f390c0018b0 tx=0x7f390c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ddc506aded66036 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:07.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.519+0000 7f3913fff700 1 -- 172.21.15.71:0/2480984064 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c012420 con 0x7f3908004810 2023-10-09T06:58:07.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.519+0000 7f3913fff700 1 -- 172.21.15.71:0/2480984064 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390c012580 con 0x7f3908004810 2023-10-09T06:58:07.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.519+0000 7f3913fff700 1 -- 172.21.15.71:0/2480984064 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c012920 con 0x7f3908004810 2023-10-09T06:58:07.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.520+0000 7f392219d700 1 -- 172.21.15.71:0/2480984064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3908004810 msgr2=0x7f3908004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:07.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.520+0000 7f392219d700 1 --2- 172.21.15.71:0/2480984064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3908004810 0x7f3908004c80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f390c0018b0 tx=0x7f390c007d30 comp rx=0 tx=0).stop 2023-10-09T06:58:07.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.520+0000 7f392219d700 1 -- 172.21.15.71:0/2480984064 shutdown_connections 2023-10-09T06:58:07.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.520+0000 7f392219d700 1 --2- 172.21.15.71:0/2480984064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3908004810 0x7f3908004c80 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:07.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.520+0000 7f392219d700 1 -- 172.21.15.71:0/2480984064 >> 172.21.15.71:0/2480984064 conn(0x7f391c0cc1f0 msgr2=0x7f391c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:07.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.520+0000 7f392219d700 1 -- 172.21.15.71:0/2480984064 shutdown_connections 2023-10-09T06:58:07.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.520+0000 7f392219d700 1 -- 172.21.15.71:0/2480984064 wait complete. 2023-10-09T06:58:07.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.521+0000 7f392219d700 1 Processor -- start 2023-10-09T06:58:07.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.521+0000 7f392219d700 1 -- start start 2023-10-09T06:58:07.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.522+0000 7f392219d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3908004810 0x7f391c14b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:07.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.522+0000 7f392219d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f391c159500 0x7f391c0b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:07.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.522+0000 7f392219d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f391c159970 0x7f391c0b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:07.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.522+0000 7f392219d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c169710 con 0x7f3908004810 2023-10-09T06:58:07.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.522+0000 7f392219d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c16a530 con 0x7f391c159970 2023-10-09T06:58:07.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.522+0000 7f392219d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c14b7a0 con 0x7f391c159500 2023-10-09T06:58:07.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.523+0000 7f392119b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3908004810 0x7f391c14b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:07.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.523+0000 7f392119b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3908004810 0x7f391c14b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59882/0 (socket says 172.21.15.71:59882) 2023-10-09T06:58:07.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.523+0000 7f392119b700 1 -- 172.21.15.71:0/2386983433 learned_addr learned my addr 172.21.15.71:0/2386983433 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:07.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.523+0000 7f392099a700 1 --2- 172.21.15.71:0/2386983433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f391c159500 0x7f391c0b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:07.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.523+0000 7f392199c700 1 --2- 172.21.15.71:0/2386983433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f391c159970 0x7f391c0b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:07.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.523+0000 7f392119b700 1 -- 172.21.15.71:0/2386983433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f391c159500 msgr2=0x7f391c0b00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:07.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.523+0000 7f392119b700 1 --2- 172.21.15.71:0/2386983433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f391c159500 0x7f391c0b00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:07.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.523+0000 7f392119b700 1 -- 172.21.15.71:0/2386983433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f391c159970 msgr2=0x7f391c0b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:07.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.523+0000 7f392119b700 1 --2- 172.21.15.71:0/2386983433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f391c159970 0x7f391c0b05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:07.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.523+0000 7f392119b700 1 -- 172.21.15.71:0/2386983433 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c169920 con 0x7f3908004810 2023-10-09T06:58:07.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.523+0000 7f392119b700 1 --2- 172.21.15.71:0/2386983433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3908004810 0x7f391c14b260 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f3918011d40 tx=0x7f39180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:07.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.523+0000 7f39117fa700 1 -- 172.21.15.71:0/2386983433 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391800fac0 con 0x7f3908004810 2023-10-09T06:58:07.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.523+0000 7f39117fa700 1 -- 172.21.15.71:0/2386983433 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391800fc20 con 0x7f3908004810 2023-10-09T06:58:07.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.523+0000 7f392219d700 1 -- 172.21.15.71:0/2386983433 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391c169c00 con 0x7f3908004810 2023-10-09T06:58:07.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.523+0000 7f39117fa700 1 -- 172.21.15.71:0/2386983433 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3918014440 con 0x7f3908004810 2023-10-09T06:58:07.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.524+0000 7f392219d700 1 -- 172.21.15.71:0/2386983433 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391c16a1c0 con 0x7f3908004810 2023-10-09T06:58:07.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.525+0000 7f392219d700 1 -- 172.21.15.71:0/2386983433 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391c04c3c0 con 0x7f3908004810 2023-10-09T06:58:07.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.525+0000 7f39117fa700 1 -- 172.21.15.71:0/2386983433 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3918014a80 con 0x7f3908004810 2023-10-09T06:58:07.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.526+0000 7f39117fa700 1 --2- 172.21.15.71:0/2386983433 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3900066f30 0x7f39000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:07.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.526+0000 7f39117fa700 1 -- 172.21.15.71:0/2386983433 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f3918018030 con 0x7f3908004810 2023-10-09T06:58:07.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.527+0000 7f392099a700 1 --2- 172.21.15.71:0/2386983433 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3900066f30 0x7f39000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:07.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.527+0000 7f392099a700 1 --2- 172.21.15.71:0/2386983433 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3900066f30 0x7f39000693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f391c0aeab0 tx=0x7f390c015000 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:07.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.530+0000 7f39117fa700 1 -- 172.21.15.71:0/2386983433 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3918052500 con 0x7f3908004810 2023-10-09T06:58:07.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.762+0000 7f392219d700 1 -- 172.21.15.71:0/2386983433 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f391c0ab520 con 0x7f3908004810 2023-10-09T06:58:07.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.763+0000 7f39117fa700 1 -- 172.21.15.71:0/2386983433 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f3918055b20 con 0x7f3908004810 2023-10-09T06:58:07.764 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:07.764 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1982857991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1982857991},{"type":"v1","addr":"172.21.15.179:6836","nonce":1982857991}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6466,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/1002256123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":1002256123},{"type":"v1","addr":"172.21.15.179:6837","nonce":1002256123}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6660,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/3500731262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3500731262},{"type":"v1","addr":"172.21.15.71:6834","nonce":3500731262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:58:03.739223+0000","modified":"2023-10-09T06:58:07.306921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/4146861129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":4146861129},{"type":"v1","addr":"172.21.15.71:6835","nonce":4146861129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T06:58:07.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.765+0000 7f392219d700 1 -- 172.21.15.71:0/2386983433 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3900066f30 msgr2=0x7f39000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:07.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.765+0000 7f392219d700 1 --2- 172.21.15.71:0/2386983433 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3900066f30 0x7f39000693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f391c0aeab0 tx=0x7f390c015000 comp rx=0 tx=0).stop 2023-10-09T06:58:07.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.765+0000 7f392219d700 1 -- 172.21.15.71:0/2386983433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3908004810 msgr2=0x7f391c14b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:07.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.765+0000 7f392219d700 1 --2- 172.21.15.71:0/2386983433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3908004810 0x7f391c14b260 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f3918011d40 tx=0x7f39180091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:07.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.765+0000 7f392219d700 1 -- 172.21.15.71:0/2386983433 shutdown_connections 2023-10-09T06:58:07.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.765+0000 7f392219d700 1 --2- 172.21.15.71:0/2386983433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f391c159970 0x7f391c0b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:07.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.765+0000 7f392219d700 1 --2- 172.21.15.71:0/2386983433 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3900066f30 0x7f39000693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:07.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.765+0000 7f392219d700 1 --2- 172.21.15.71:0/2386983433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3908004810 0x7f391c14b260 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:07.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.765+0000 7f392219d700 1 --2- 172.21.15.71:0/2386983433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f391c159500 0x7f391c0b00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:07.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.765+0000 7f392219d700 1 -- 172.21.15.71:0/2386983433 >> 172.21.15.71:0/2386983433 conn(0x7f391c0cc1f0 msgr2=0x7f391c0c18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:07.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.765+0000 7f392219d700 1 -- 172.21.15.71:0/2386983433 shutdown_connections 2023-10-09T06:58:07.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.766+0000 7f392219d700 1 -- 172.21.15.71:0/2386983433 wait complete. 2023-10-09T06:58:07.769 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 41 2023-10-09T06:58:07.784 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:58:07.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.963+0000 7f72c359e700 1 Processor -- start 2023-10-09T06:58:07.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.963+0000 7f72c359e700 1 -- start start 2023-10-09T06:58:07.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.964+0000 7f72c359e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f72c40c6d00 0x7f72c40c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:07.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.964+0000 7f72c359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72c406e730 0x7f72c406ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:07.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.964+0000 7f72c359e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c406e2a0 con 0x7f72c4157770 2023-10-09T06:58:07.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.964+0000 7f72c359e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c4157b40 con 0x7f72c40c6d00 2023-10-09T06:58:07.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.964+0000 7f72c359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c40c7690 con 0x7f72c406e730 2023-10-09T06:58:07.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.964+0000 7f72bbfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f72c40c6d00 0x7f72c40c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:07.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.964+0000 7f72bbfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f72c40c6d00 0x7f72c40c7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59888/0 (socket says 172.21.15.71:59888) 2023-10-09T06:58:07.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.964+0000 7f72bbfff700 1 -- 172.21.15.71:0/925262689 learned_addr learned my addr 172.21.15.71:0/925262689 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:07.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.965+0000 7f72c2d9d700 1 --2- 172.21.15.71:0/925262689 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72c406e730 0x7f72c406ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:07.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.965+0000 7f72bbfff700 1 -- 172.21.15.71:0/925262689 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72c406e730 msgr2=0x7f72c406ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:07.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.965+0000 7f72bbfff700 1 --2- 172.21.15.71:0/925262689 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72c406e730 0x7f72c406ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:07.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.965+0000 7f72bbfff700 1 -- 172.21.15.71:0/925262689 >> v1:172.21.15.179:6789/0 conn(0x7f72c4157770 legacy=0x7f72c4150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:07.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.965+0000 7f72bbfff700 1 -- 172.21.15.71:0/925262689 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c406b2e0 con 0x7f72c40c6d00 2023-10-09T06:58:07.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.965+0000 7f72c1d9b700 1 -- 172.21.15.71:0/925262689 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649881233 0 0) 0x7f72c406e2a0 con 0x7f72c4157770 2023-10-09T06:58:07.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.965+0000 7f72bbfff700 1 --2- 172.21.15.71:0/925262689 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72c40c6d00 0x7f72c40c7150 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00bc50 tx=0x7f72ac00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff93fdd49bc3792 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:07.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.965+0000 7f72c1d9b700 1 -- 172.21.15.71:0/925262689 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac00dbf0 con 0x7f72c40c6d00 2023-10-09T06:58:07.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.965+0000 7f72c1d9b700 1 -- 172.21.15.71:0/925262689 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ac00dd50 con 0x7f72c40c6d00 2023-10-09T06:58:07.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.965+0000 7f72c1d9b700 1 -- 172.21.15.71:0/925262689 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac0196b0 con 0x7f72c40c6d00 2023-10-09T06:58:07.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.966+0000 7f72c359e700 1 -- 172.21.15.71:0/925262689 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72c40c6d00 msgr2=0x7f72c40c7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:07.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.966+0000 7f72c359e700 1 --2- 172.21.15.71:0/925262689 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72c40c6d00 0x7f72c40c7150 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00bc50 tx=0x7f72ac00b4f0 comp rx=0 tx=0).stop 2023-10-09T06:58:07.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.966+0000 7f72c359e700 1 -- 172.21.15.71:0/925262689 shutdown_connections 2023-10-09T06:58:07.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.966+0000 7f72c359e700 1 --2- 172.21.15.71:0/925262689 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72c406e730 0x7f72c406ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:07.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.966+0000 7f72c359e700 1 --2- 172.21.15.71:0/925262689 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72c40c6d00 0x7f72c40c7150 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:07.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.966+0000 7f72c359e700 1 -- 172.21.15.71:0/925262689 >> 172.21.15.71:0/925262689 conn(0x7f72c40cc1f0 msgr2=0x7f72c40cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:07.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.966+0000 7f72c359e700 1 -- 172.21.15.71:0/925262689 shutdown_connections 2023-10-09T06:58:07.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.966+0000 7f72c359e700 1 -- 172.21.15.71:0/925262689 wait complete. 2023-10-09T06:58:07.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.967+0000 7f72c359e700 1 Processor -- start 2023-10-09T06:58:07.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.968+0000 7f72c359e700 1 -- start start 2023-10-09T06:58:07.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.968+0000 7f72c359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72c406e730 0x7f72c414b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:07.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.968+0000 7f72c359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72c40c6d00 0x7f72c40b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:07.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.968+0000 7f72c359e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72c4157770 0x7f72c40696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:07.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.969+0000 7f72c359e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c416a670 con 0x7f72c4157770 2023-10-09T06:58:07.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.969+0000 7f72c359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c4169af0 con 0x7f72c40c6d00 2023-10-09T06:58:07.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.969+0000 7f72c359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c4169dd0 con 0x7f72c406e730 2023-10-09T06:58:07.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.969+0000 7f72c2d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72c4157770 0x7f72c40696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:07.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.969+0000 7f72c2d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72c4157770 0x7f72c40696c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59902/0 (socket says 172.21.15.71:59902) 2023-10-09T06:58:07.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.969+0000 7f72c2d9d700 1 -- 172.21.15.71:0/3609564842 learned_addr learned my addr 172.21.15.71:0/3609564842 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:07.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.969+0000 7f72c2d9d700 1 -- 172.21.15.71:0/3609564842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72c406e730 msgr2=0x7f72c414b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:07.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.969+0000 7f72bbfff700 1 --2- 172.21.15.71:0/3609564842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72c40c6d00 0x7f72c40b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:07.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.969+0000 7f72c259c700 1 --2- 172.21.15.71:0/3609564842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72c406e730 0x7f72c414b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:07.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.969+0000 7f72c2d9d700 1 --2- 172.21.15.71:0/3609564842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72c406e730 0x7f72c414b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:07.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.969+0000 7f72c2d9d700 1 -- 172.21.15.71:0/3609564842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72c40c6d00 msgr2=0x7f72c40b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.969+0000 7f72c2d9d700 1 --2- 172.21.15.71:0/3609564842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72c40c6d00 0x7f72c40b0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.969+0000 7f72c2d9d700 1 -- 172.21.15.71:0/3609564842 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ac00b790 con 0x7f72c4157770 2023-10-09T06:58:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.969+0000 7f72bbfff700 1 --2- 172.21.15.71:0/3609564842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72c40c6d00 0x7f72c40b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.969+0000 7f72c259c700 1 --2- 172.21.15.71:0/3609564842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72c406e730 0x7f72c414b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.969+0000 7f72c2d9d700 1 --2- 172.21.15.71:0/3609564842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72c4157770 0x7f72c40696c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f72bc009df0 tx=0x7f72bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.970+0000 7f72ba7fc700 1 -- 172.21.15.71:0/3609564842 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc00cb50 con 0x7f72c4157770 2023-10-09T06:58:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.970+0000 7f72ba7fc700 1 -- 172.21.15.71:0/3609564842 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72bc00f040 con 0x7f72c4157770 2023-10-09T06:58:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.970+0000 7f72ba7fc700 1 -- 172.21.15.71:0/3609564842 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc014480 con 0x7f72c4157770 2023-10-09T06:58:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.970+0000 7f72c359e700 1 -- 172.21.15.71:0/3609564842 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c416a0b0 con 0x7f72c4157770 2023-10-09T06:58:07.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.970+0000 7f72c359e700 1 -- 172.21.15.71:0/3609564842 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c414bf00 con 0x7f72c4157770 2023-10-09T06:58:07.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.971+0000 7f72c359e700 1 -- 172.21.15.71:0/3609564842 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c404c3c0 con 0x7f72c4157770 2023-10-09T06:58:07.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.972+0000 7f72ba7fc700 1 -- 172.21.15.71:0/3609564842 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72bc014830 con 0x7f72c4157770 2023-10-09T06:58:07.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.973+0000 7f72ba7fc700 1 --2- 172.21.15.71:0/3609564842 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f72a4066f30 0x7f72a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:07.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.973+0000 7f72ba7fc700 1 -- 172.21.15.71:0/3609564842 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f72bc085040 con 0x7f72c4157770 2023-10-09T06:58:07.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.973+0000 7f72c259c700 1 --2- 172.21.15.71:0/3609564842 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f72a4066f30 0x7f72a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:07.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.974+0000 7f72c259c700 1 --2- 172.21.15.71:0/3609564842 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f72a4066f30 0x7f72a40693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f72b40011e0 tx=0x7f72b4009040 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:07.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:07.976+0000 7f72ba7fc700 1 -- 172.21.15.71:0/3609564842 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72bc052120 con 0x7f72c4157770 2023-10-09T06:58:08.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.173+0000 7f72c359e700 1 -- 172.21.15.71:0/3609564842 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72c406ada0 con 0x7f72c4157770 2023-10-09T06:58:08.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.174+0000 7f72ba7fc700 1 -- 172.21.15.71:0/3609564842 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+15947 (secure 0 0 0) 0x7f72bc055740 con 0x7f72c4157770 2023-10-09T06:58:08.175 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:08.175 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":93,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:58:04.764540+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:58:01.931617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T06:58:02.718563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:58:08.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.176+0000 7f72c359e700 1 -- 172.21.15.71:0/3609564842 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f72a4066f30 msgr2=0x7f72a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:08.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.176+0000 7f72c359e700 1 --2- 172.21.15.71:0/3609564842 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f72a4066f30 0x7f72a40693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f72b40011e0 tx=0x7f72b4009040 comp rx=0 tx=0).stop 2023-10-09T06:58:08.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.176+0000 7f72c359e700 1 -- 172.21.15.71:0/3609564842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72c4157770 msgr2=0x7f72c40696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:08.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.176+0000 7f72c359e700 1 --2- 172.21.15.71:0/3609564842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72c4157770 0x7f72c40696c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f72bc009df0 tx=0x7f72bc00b040 comp rx=0 tx=0).stop 2023-10-09T06:58:08.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.176+0000 7f72c359e700 1 -- 172.21.15.71:0/3609564842 shutdown_connections 2023-10-09T06:58:08.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.176+0000 7f72c359e700 1 --2- 172.21.15.71:0/3609564842 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f72a4066f30 0x7f72a40693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:08.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.176+0000 7f72c359e700 1 --2- 172.21.15.71:0/3609564842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72c4157770 0x7f72c40696c0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:08.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.176+0000 7f72c359e700 1 --2- 172.21.15.71:0/3609564842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72c406e730 0x7f72c414b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:08.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.176+0000 7f72c359e700 1 --2- 172.21.15.71:0/3609564842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72c40c6d00 0x7f72c40b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:08.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.176+0000 7f72c359e700 1 -- 172.21.15.71:0/3609564842 >> 172.21.15.71:0/3609564842 conn(0x7f72c40cc1f0 msgr2=0x7f72c40cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:08.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.176+0000 7f72c359e700 1 -- 172.21.15.71:0/3609564842 shutdown_connections 2023-10-09T06:58:08.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.177+0000 7f72c359e700 1 -- 172.21.15.71:0/3609564842 wait complete. 2023-10-09T06:58:08.195 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T06:58:08.196 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:58:08.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.378+0000 7f9de6fff700 1 Processor -- start 2023-10-09T06:58:08.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.378+0000 7f9de6fff700 1 -- start start 2023-10-09T06:58:08.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.379+0000 7f9de6fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9de006bcd0 0x7f9de00caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:08.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.379+0000 7f9de6fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9de015df50 0x7f9de015e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:08.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.380+0000 7f9de6fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de015d7e0 con 0x7f9de006c0a0 2023-10-09T06:58:08.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.380+0000 7f9de6fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de015dac0 con 0x7f9de015df50 2023-10-09T06:58:08.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.380+0000 7f9de6fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de015aa30 con 0x7f9de006bcd0 2023-10-09T06:58:08.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.380+0000 7f9de559c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9de015df50 0x7f9de015e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:08.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.380+0000 7f9de559c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9de015df50 0x7f9de015e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59918/0 (socket says 172.21.15.71:59918) 2023-10-09T06:58:08.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.380+0000 7f9de559c700 1 -- 172.21.15.71:0/3390330483 learned_addr learned my addr 172.21.15.71:0/3390330483 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:08.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.380+0000 7f9de4d9b700 1 --2- 172.21.15.71:0/3390330483 >> v2:172.21.15.179:3300/0 conn(0x7f9de006bcd0 0x7f9de00caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:08.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.380+0000 7f9de559c700 1 -- 172.21.15.71:0/3390330483 >> v2:172.21.15.179:3300/0 conn(0x7f9de006bcd0 msgr2=0x7f9de00caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:08.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.380+0000 7f9de559c700 1 --2- 172.21.15.71:0/3390330483 >> v2:172.21.15.179:3300/0 conn(0x7f9de006bcd0 0x7f9de00caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:08.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.380+0000 7f9de559c700 1 -- 172.21.15.71:0/3390330483 >> v1:172.21.15.71:6789/0 conn(0x7f9de006c0a0 legacy=0x7f9de015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:08.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.380+0000 7f9de559c700 1 -- 172.21.15.71:0/3390330483 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de015ad10 con 0x7f9de015df50 2023-10-09T06:58:08.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.380+0000 7f9ddf7fe700 1 -- 172.21.15.71:0/3390330483 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740348148 0 0) 0x7f9de015d7e0 con 0x7f9de006c0a0 2023-10-09T06:58:08.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.381+0000 7f9de559c700 1 --2- 172.21.15.71:0/3390330483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9de015df50 0x7f9de015e3b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f9de00691a0 tx=0x7f9dd8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d3cb9bd06a178c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:08.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.381+0000 7f9ddf7fe700 1 -- 172.21.15.71:0/3390330483 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd800e070 con 0x7f9de015df50 2023-10-09T06:58:08.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.381+0000 7f9ddf7fe700 1 -- 172.21.15.71:0/3390330483 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd800ba50 con 0x7f9de015df50 2023-10-09T06:58:08.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.381+0000 7f9ddf7fe700 1 -- 172.21.15.71:0/3390330483 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd80092e0 con 0x7f9de015df50 2023-10-09T06:58:08.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.381+0000 7f9de6fff700 1 -- 172.21.15.71:0/3390330483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9de015df50 msgr2=0x7f9de015e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:08.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.381+0000 7f9de6fff700 1 --2- 172.21.15.71:0/3390330483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9de015df50 0x7f9de015e3b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f9de00691a0 tx=0x7f9dd8009840 comp rx=0 tx=0).stop 2023-10-09T06:58:08.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.381+0000 7f9de6fff700 1 -- 172.21.15.71:0/3390330483 shutdown_connections 2023-10-09T06:58:08.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.381+0000 7f9de6fff700 1 --2- 172.21.15.71:0/3390330483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9de015df50 0x7f9de015e3b0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:08.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.381+0000 7f9de6fff700 1 --2- 172.21.15.71:0/3390330483 >> v2:172.21.15.179:3300/0 conn(0x7f9de006bcd0 0x7f9de00caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:08.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.382+0000 7f9de6fff700 1 -- 172.21.15.71:0/3390330483 >> 172.21.15.71:0/3390330483 conn(0x7f9de00ce600 msgr2=0x7f9de00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:08.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.382+0000 7f9de6fff700 1 -- 172.21.15.71:0/3390330483 shutdown_connections 2023-10-09T06:58:08.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.382+0000 7f9de6fff700 1 -- 172.21.15.71:0/3390330483 wait complete. 2023-10-09T06:58:08.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.383+0000 7f9de6fff700 1 Processor -- start 2023-10-09T06:58:08.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.383+0000 7f9de6fff700 1 -- start start 2023-10-09T06:58:08.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.384+0000 7f9de6fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9de006bcd0 0x7f9de016d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:08.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.384+0000 7f9de6fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9de006c0a0 0x7f9de00b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:08.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.384+0000 7f9de6fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9de015df50 0x7f9de01590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:08.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.384+0000 7f9de6fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de016e4e0 con 0x7f9de006c0a0 2023-10-09T06:58:08.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.384+0000 7f9de6fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de00b13a0 con 0x7f9de006bcd0 2023-10-09T06:58:08.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.384+0000 7f9de6fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de00b1640 con 0x7f9de015df50 2023-10-09T06:58:08.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.384+0000 7f9ddffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9de006c0a0 0x7f9de00b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:08.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.384+0000 7f9de4d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9de006bcd0 0x7f9de016d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:08.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.384+0000 7f9ddffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9de006c0a0 0x7f9de00b3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59932/0 (socket says 172.21.15.71:59932) 2023-10-09T06:58:08.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.384+0000 7f9ddffff700 1 -- 172.21.15.71:0/2002391783 learned_addr learned my addr 172.21.15.71:0/2002391783 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:08.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.384+0000 7f9de559c700 1 --2- 172.21.15.71:0/2002391783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9de015df50 0x7f9de01590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:08.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.385+0000 7f9de4d9b700 1 -- 172.21.15.71:0/2002391783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9de015df50 msgr2=0x7f9de01590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:08.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.385+0000 7f9de4d9b700 1 --2- 172.21.15.71:0/2002391783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9de015df50 0x7f9de01590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:08.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.385+0000 7f9de4d9b700 1 -- 172.21.15.71:0/2002391783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9de006c0a0 msgr2=0x7f9de00b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:08.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.385+0000 7f9de4d9b700 1 --2- 172.21.15.71:0/2002391783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9de006c0a0 0x7f9de00b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:08.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.385+0000 7f9de4d9b700 1 -- 172.21.15.71:0/2002391783 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd8009ae0 con 0x7f9de006bcd0 2023-10-09T06:58:08.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.385+0000 7f9ddffff700 1 --2- 172.21.15.71:0/2002391783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9de006c0a0 0x7f9de00b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:58:08.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.385+0000 7f9de4d9b700 1 --2- 172.21.15.71:0/2002391783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9de006bcd0 0x7f9de016d880 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400d860 tx=0x7f9dd4008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:08.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.385+0000 7f9ddcff9700 1 -- 172.21.15.71:0/2002391783 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd40125f0 con 0x7f9de006bcd0 2023-10-09T06:58:08.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.385+0000 7f9ddcff9700 1 -- 172.21.15.71:0/2002391783 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd4012750 con 0x7f9de006bcd0 2023-10-09T06:58:08.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.385+0000 7f9ddcff9700 1 -- 172.21.15.71:0/2002391783 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4012b10 con 0x7f9de006bcd0 2023-10-09T06:58:08.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.386+0000 7f9de6fff700 1 -- 172.21.15.71:0/2002391783 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de00b1980 con 0x7f9de006bcd0 2023-10-09T06:58:08.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.386+0000 7f9de6fff700 1 -- 172.21.15.71:0/2002391783 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de00b21c0 con 0x7f9de006bcd0 2023-10-09T06:58:08.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.386+0000 7f9de6fff700 1 -- 172.21.15.71:0/2002391783 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de004c3c0 con 0x7f9de006bcd0 2023-10-09T06:58:08.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.388+0000 7f9ddcff9700 1 -- 172.21.15.71:0/2002391783 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9dd401e460 con 0x7f9de006bcd0 2023-10-09T06:58:08.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.388+0000 7f9ddcff9700 1 --2- 172.21.15.71:0/2002391783 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9dc4066f30 0x7f9dc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:08.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.389+0000 7f9ddcff9700 1 -- 172.21.15.71:0/2002391783 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f9dd4084ff0 con 0x7f9de006bcd0 2023-10-09T06:58:08.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.389+0000 7f9ddffff700 1 --2- 172.21.15.71:0/2002391783 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9dc4066f30 0x7f9dc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:08.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.390+0000 7f9ddffff700 1 --2- 172.21.15.71:0/2002391783 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9dc4066f30 0x7f9dc40693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc001e50 tx=0x7f9dcc009040 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:08.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.393+0000 7f9ddcff9700 1 -- 172.21.15.71:0/2002391783 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9dd40520f0 con 0x7f9de006bcd0 2023-10-09T06:58:08.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.583+0000 7f9de6fff700 1 -- 172.21.15.71:0/2002391783 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9de006a9d0 con 0x7f9dc4066f30 2023-10-09T06:58:08.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.594+0000 7f9ddcff9700 1 -- 172.21.15.71:0/2002391783 <== mgr.6274 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283278 (secure 0 0 0) 0x7f9de006a9d0 con 0x7f9dc4066f30 2023-10-09T06:58:08.599 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:08.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.598+0000 7f9de6fff700 1 -- 172.21.15.71:0/2002391783 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9dc4066f30 msgr2=0x7f9dc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:08.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.598+0000 7f9de6fff700 1 --2- 172.21.15.71:0/2002391783 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9dc4066f30 0x7f9dc40693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc001e50 tx=0x7f9dcc009040 comp rx=0 tx=0).stop 2023-10-09T06:58:08.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.598+0000 7f9de6fff700 1 -- 172.21.15.71:0/2002391783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9de006bcd0 msgr2=0x7f9de016d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:08.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.598+0000 7f9de6fff700 1 --2- 172.21.15.71:0/2002391783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9de006bcd0 0x7f9de016d880 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400d860 tx=0x7f9dd4008040 comp rx=0 tx=0).stop 2023-10-09T06:58:08.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.598+0000 7f9de6fff700 1 -- 172.21.15.71:0/2002391783 shutdown_connections 2023-10-09T06:58:08.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.598+0000 7f9de6fff700 1 --2- 172.21.15.71:0/2002391783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9de015df50 0x7f9de01590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:08.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.598+0000 7f9de6fff700 1 --2- 172.21.15.71:0/2002391783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9de006bcd0 0x7f9de016d880 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:08.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.598+0000 7f9de6fff700 1 --2- 172.21.15.71:0/2002391783 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9dc4066f30 0x7f9dc40693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:08.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.598+0000 7f9de6fff700 1 --2- 172.21.15.71:0/2002391783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9de006c0a0 0x7f9de00b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:08.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.598+0000 7f9de6fff700 1 -- 172.21.15.71:0/2002391783 >> 172.21.15.71:0/2002391783 conn(0x7f9de00ce600 msgr2=0x7f9de0155410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:08.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.598+0000 7f9de6fff700 1 -- 172.21.15.71:0/2002391783 shutdown_connections 2023-10-09T06:58:08.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.598+0000 7f9de6fff700 1 -- 172.21.15.71:0/2002391783 wait complete. 2023-10-09T06:58:08.602 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:58:08.617 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T06:58:08.029718+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592028,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":292,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2433256,"kb_used_data":9896,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752541464,"statfs":{"total":773094113280,"available":770602459136,"internally_reserved":0,"allocated":10133504,"data_stored":5479954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1660,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.772335"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781741+0000","last_change":"2023-10-09T06:58:03.778823+0000","last_active":"2023-10-09T06:58:03.781741+0000","last_peered":"2023-10-09T06:58:03.781741+0000","last_clean":"2023-10-09T06:58:03.781741+0000","last_became_active":"2023-10-09T06:58:03.778577+0000","last_became_peered":"2023-10-09T06:58:03.778577+0000","last_unstale":"2023-10-09T06:58:03.781741+0000","last_undegraded":"2023-10-09T06:58:03.781741+0000","last_fullsized":"2023-10-09T06:58:03.781741+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:19.132641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.791624+0000","last_change":"2023-10-09T06:58:03.790890+0000","last_active":"2023-10-09T06:58:03.791624+0000","last_peered":"2023-10-09T06:58:03.791624+0000","last_clean":"2023-10-09T06:58:03.791624+0000","last_became_active":"2023-10-09T06:58:03.790601+0000","last_became_peered":"2023-10-09T06:58:03.790601+0000","last_unstale":"2023-10-09T06:58:03.791624+0000","last_undegraded":"2023-10-09T06:58:03.791624+0000","last_fullsized":"2023-10-09T06:58:03.791624+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:39.273916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.788534+0000","last_change":"2023-10-09T06:58:03.787537+0000","last_active":"2023-10-09T06:58:03.788534+0000","last_peered":"2023-10-09T06:58:03.788534+0000","last_clean":"2023-10-09T06:58:03.788534+0000","last_became_active":"2023-10-09T06:58:03.787261+0000","last_became_peered":"2023-10-09T06:58:03.787261+0000","last_unstale":"2023-10-09T06:58:03.788534+0000","last_undegraded":"2023-10-09T06:58:03.788534+0000","last_fullsized":"2023-10-09T06:58:03.788534+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:49:37.095152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781603+0000","last_change":"2023-10-09T06:58:03.779446+0000","last_active":"2023-10-09T06:58:03.781603+0000","last_peered":"2023-10-09T06:58:03.781603+0000","last_clean":"2023-10-09T06:58:03.781603+0000","last_became_active":"2023-10-09T06:58:03.779142+0000","last_became_peered":"2023-10-09T06:58:03.779142+0000","last_unstale":"2023-10-09T06:58:03.781603+0000","last_undegraded":"2023-10-09T06:58:03.781603+0000","last_fullsized":"2023-10-09T06:58:03.781603+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:42.427200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.786488+0000","last_change":"2023-10-09T06:58:03.783075+0000","last_active":"2023-10-09T06:58:03.786488+0000","last_peered":"2023-10-09T06:58:03.786488+0000","last_clean":"2023-10-09T06:58:03.786488+0000","last_became_active":"2023-10-09T06:58:03.782836+0000","last_became_peered":"2023-10-09T06:58:03.782836+0000","last_unstale":"2023-10-09T06:58:03.786488+0000","last_undegraded":"2023-10-09T06:58:03.786488+0000","last_fullsized":"2023-10-09T06:58:03.786488+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:27.010548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.788787+0000","last_change":"2023-10-09T06:58:03.788199+0000","last_active":"2023-10-09T06:58:03.788787+0000","last_peered":"2023-10-09T06:58:03.788787+0000","last_clean":"2023-10-09T06:58:03.788787+0000","last_became_active":"2023-10-09T06:58:03.787893+0000","last_became_peered":"2023-10-09T06:58:03.787893+0000","last_unstale":"2023-10-09T06:58:03.788787+0000","last_undegraded":"2023-10-09T06:58:03.788787+0000","last_fullsized":"2023-10-09T06:58:03.788787+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:44.586446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.778194+0000","last_change":"2023-10-09T06:58:03.774830+0000","last_active":"2023-10-09T06:58:03.778194+0000","last_peered":"2023-10-09T06:58:03.778194+0000","last_clean":"2023-10-09T06:58:03.778194+0000","last_became_active":"2023-10-09T06:58:03.774540+0000","last_became_peered":"2023-10-09T06:58:03.774540+0000","last_unstale":"2023-10-09T06:58:03.778194+0000","last_undegraded":"2023-10-09T06:58:03.778194+0000","last_fullsized":"2023-10-09T06:58:03.778194+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:55.445121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.784320+0000","last_change":"2023-10-09T06:58:03.782721+0000","last_active":"2023-10-09T06:58:03.784320+0000","last_peered":"2023-10-09T06:58:03.784320+0000","last_clean":"2023-10-09T06:58:03.784320+0000","last_became_active":"2023-10-09T06:58:03.782471+0000","last_became_peered":"2023-10-09T06:58:03.782471+0000","last_unstale":"2023-10-09T06:58:03.784320+0000","last_undegraded":"2023-10-09T06:58:03.784320+0000","last_fullsized":"2023-10-09T06:58:03.784320+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:01.380815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781583+0000","last_change":"2023-10-09T06:58:03.778825+0000","last_active":"2023-10-09T06:58:03.781583+0000","last_peered":"2023-10-09T06:58:03.781583+0000","last_clean":"2023-10-09T06:58:03.781583+0000","last_became_active":"2023-10-09T06:58:03.778586+0000","last_became_peered":"2023-10-09T06:58:03.778586+0000","last_unstale":"2023-10-09T06:58:03.781583+0000","last_undegraded":"2023-10-09T06:58:03.781583+0000","last_fullsized":"2023-10-09T06:58:03.781583+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:38:42.093928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.792047+0000","last_change":"2023-10-09T06:58:03.790976+0000","last_active":"2023-10-09T06:58:03.792047+0000","last_peered":"2023-10-09T06:58:03.792047+0000","last_clean":"2023-10-09T06:58:03.792047+0000","last_became_active":"2023-10-09T06:58:03.790611+0000","last_became_peered":"2023-10-09T06:58:03.790611+0000","last_unstale":"2023-10-09T06:58:03.792047+0000","last_undegraded":"2023-10-09T06:58:03.792047+0000","last_fullsized":"2023-10-09T06:58:03.792047+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:45:13.736492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.783595+0000","last_change":"2023-10-09T06:58:03.780575+0000","last_active":"2023-10-09T06:58:03.783595+0000","last_peered":"2023-10-09T06:58:03.783595+0000","last_clean":"2023-10-09T06:58:03.783595+0000","last_became_active":"2023-10-09T06:58:03.780287+0000","last_became_peered":"2023-10-09T06:58:03.780287+0000","last_unstale":"2023-10-09T06:58:03.783595+0000","last_undegraded":"2023-10-09T06:58:03.783595+0000","last_fullsized":"2023-10-09T06:58:03.783595+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:50.836527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.780921+0000","last_change":"2023-10-09T06:58:03.778338+0000","last_active":"2023-10-09T06:58:03.780921+0000","last_peered":"2023-10-09T06:58:03.780921+0000","last_clean":"2023-10-09T06:58:03.780921+0000","last_became_active":"2023-10-09T06:58:03.778095+0000","last_became_peered":"2023-10-09T06:58:03.778095+0000","last_unstale":"2023-10-09T06:58:03.780921+0000","last_undegraded":"2023-10-09T06:58:03.780921+0000","last_fullsized":"2023-10-09T06:58:03.780921+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:50.836527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.777660+0000","last_change":"2023-10-09T06:58:03.775523+0000","last_active":"2023-10-09T06:58:03.777660+0000","last_peered":"2023-10-09T06:58:03.777660+0000","last_clean":"2023-10-09T06:58:03.777660+0000","last_became_active":"2023-10-09T06:58:03.775252+0000","last_became_peered":"2023-10-09T06:58:03.775252+0000","last_unstale":"2023-10-09T06:58:03.777660+0000","last_undegraded":"2023-10-09T06:58:03.777660+0000","last_fullsized":"2023-10-09T06:58:03.777660+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:33:52.454840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.265327+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:47:53.051745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781593+0000","last_change":"2023-10-09T06:58:03.779335+0000","last_active":"2023-10-09T06:58:03.781593+0000","last_peered":"2023-10-09T06:58:03.781593+0000","last_clean":"2023-10-09T06:58:03.781593+0000","last_became_active":"2023-10-09T06:58:03.779073+0000","last_became_peered":"2023-10-09T06:58:03.779073+0000","last_unstale":"2023-10-09T06:58:03.781593+0000","last_undegraded":"2023-10-09T06:58:03.781593+0000","last_fullsized":"2023-10-09T06:58:03.781593+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:35.834887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"92'1","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.290439+0000","last_change":"2023-10-09T06:58:03.281341+0000","last_active":"2023-10-09T06:58:04.290439+0000","last_peered":"2023-10-09T06:58:04.290439+0000","last_clean":"2023-10-09T06:58:04.290439+0000","last_became_active":"2023-10-09T06:58:03.281014+0000","last_became_peered":"2023-10-09T06:58:03.281014+0000","last_unstale":"2023-10-09T06:58:04.290439+0000","last_undegraded":"2023-10-09T06:58:04.290439+0000","last_fullsized":"2023-10-09T06:58:04.290439+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:50:35.632368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.261063+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:02.609888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.262290+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:34.825539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"92'1","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.290920+0000","last_change":"2023-10-09T06:58:03.274347+0000","last_active":"2023-10-09T06:58:04.290920+0000","last_peered":"2023-10-09T06:58:04.290920+0000","last_clean":"2023-10-09T06:58:04.290920+0000","last_became_active":"2023-10-09T06:58:03.274034+0000","last_became_peered":"2023-10-09T06:58:03.274034+0000","last_unstale":"2023-10-09T06:58:04.290920+0000","last_undegraded":"2023-10-09T06:58:04.290920+0000","last_fullsized":"2023-10-09T06:58:04.290920+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:06.817917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.264758+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:52:54.289694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.780519+0000","last_change":"2023-10-09T06:58:03.778295+0000","last_active":"2023-10-09T06:58:03.780519+0000","last_peered":"2023-10-09T06:58:03.780519+0000","last_clean":"2023-10-09T06:58:03.780519+0000","last_became_active":"2023-10-09T06:58:03.777990+0000","last_became_peered":"2023-10-09T06:58:03.777990+0000","last_unstale":"2023-10-09T06:58:03.780519+0000","last_undegraded":"2023-10-09T06:58:03.780519+0000","last_fullsized":"2023-10-09T06:58:03.780519+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:38.362218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.776114+0000","last_change":"2023-10-09T06:58:03.278385+0000","last_active":"2023-10-09T06:58:03.776114+0000","last_peered":"2023-10-09T06:58:03.776114+0000","last_clean":"2023-10-09T06:58:03.776114+0000","last_became_active":"2023-10-09T06:58:03.278063+0000","last_became_peered":"2023-10-09T06:58:03.278063+0000","last_unstale":"2023-10-09T06:58:03.776114+0000","last_undegraded":"2023-10-09T06:58:03.776114+0000","last_fullsized":"2023-10-09T06:58:03.776114+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:01:05.569394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.787641+0000","last_change":"2023-10-09T06:58:03.786407+0000","last_active":"2023-10-09T06:58:03.787641+0000","last_peered":"2023-10-09T06:58:03.787641+0000","last_clean":"2023-10-09T06:58:03.787641+0000","last_became_active":"2023-10-09T06:58:03.786139+0000","last_became_peered":"2023-10-09T06:58:03.786139+0000","last_unstale":"2023-10-09T06:58:03.787641+0000","last_undegraded":"2023-10-09T06:58:03.787641+0000","last_fullsized":"2023-10-09T06:58:03.787641+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:54:29.099122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.773510+0000","last_change":"2023-10-09T06:58:03.274854+0000","last_active":"2023-10-09T06:58:03.773510+0000","last_peered":"2023-10-09T06:58:03.773510+0000","last_clean":"2023-10-09T06:58:03.773510+0000","last_became_active":"2023-10-09T06:58:03.274591+0000","last_became_peered":"2023-10-09T06:58:03.274591+0000","last_unstale":"2023-10-09T06:58:03.773510+0000","last_undegraded":"2023-10-09T06:58:03.773510+0000","last_fullsized":"2023-10-09T06:58:03.773510+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:27:49.714248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.263208+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:38.264568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.264813+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:44:28.414578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"92'3","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.293010+0000","last_change":"2023-10-09T06:58:03.277580+0000","last_active":"2023-10-09T06:58:04.293010+0000","last_peered":"2023-10-09T06:58:04.293010+0000","last_clean":"2023-10-09T06:58:04.293010+0000","last_became_active":"2023-10-09T06:58:03.277331+0000","last_became_peered":"2023-10-09T06:58:03.277331+0000","last_unstale":"2023-10-09T06:58:04.293010+0000","last_undegraded":"2023-10-09T06:58:04.293010+0000","last_fullsized":"2023-10-09T06:58:04.293010+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:52.632381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781319+0000","last_change":"2023-10-09T06:58:03.779510+0000","last_active":"2023-10-09T06:58:03.781319+0000","last_peered":"2023-10-09T06:58:03.781319+0000","last_clean":"2023-10-09T06:58:03.781319+0000","last_became_active":"2023-10-09T06:58:03.778576+0000","last_became_peered":"2023-10-09T06:58:03.778576+0000","last_unstale":"2023-10-09T06:58:03.781319+0000","last_undegraded":"2023-10-09T06:58:03.781319+0000","last_fullsized":"2023-10-09T06:58:03.781319+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:43:18.959668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"92'6","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.295792+0000","last_change":"2023-10-09T06:58:03.281626+0000","last_active":"2023-10-09T06:58:04.295792+0000","last_peered":"2023-10-09T06:58:04.295792+0000","last_clean":"2023-10-09T06:58:04.295792+0000","last_became_active":"2023-10-09T06:58:03.280397+0000","last_became_peered":"2023-10-09T06:58:03.280397+0000","last_unstale":"2023-10-09T06:58:04.295792+0000","last_undegraded":"2023-10-09T06:58:04.295792+0000","last_fullsized":"2023-10-09T06:58:04.295792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:08:56.251029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"92'2","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.294274+0000","last_change":"2023-10-09T06:58:03.278338+0000","last_active":"2023-10-09T06:58:04.294274+0000","last_peered":"2023-10-09T06:58:04.294274+0000","last_clean":"2023-10-09T06:58:04.294274+0000","last_became_active":"2023-10-09T06:58:03.278052+0000","last_became_peered":"2023-10-09T06:58:03.278052+0000","last_unstale":"2023-10-09T06:58:04.294274+0000","last_undegraded":"2023-10-09T06:58:04.294274+0000","last_fullsized":"2023-10-09T06:58:04.294274+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:34.825539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.263951+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:01:05.569394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.787196+0000","last_change":"2023-10-09T06:58:03.786093+0000","last_active":"2023-10-09T06:58:03.787196+0000","last_peered":"2023-10-09T06:58:03.787196+0000","last_clean":"2023-10-09T06:58:03.787196+0000","last_became_active":"2023-10-09T06:58:03.785836+0000","last_became_peered":"2023-10-09T06:58:03.785836+0000","last_unstale":"2023-10-09T06:58:03.787196+0000","last_undegraded":"2023-10-09T06:58:03.787196+0000","last_fullsized":"2023-10-09T06:58:03.787196+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:10.559656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.262469+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:25:51.699892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781370+0000","last_change":"2023-10-09T06:58:03.780365+0000","last_active":"2023-10-09T06:58:03.781370+0000","last_peered":"2023-10-09T06:58:03.781370+0000","last_clean":"2023-10-09T06:58:03.781370+0000","last_became_active":"2023-10-09T06:58:03.779868+0000","last_became_peered":"2023-10-09T06:58:03.779868+0000","last_unstale":"2023-10-09T06:58:03.781370+0000","last_undegraded":"2023-10-09T06:58:03.781370+0000","last_fullsized":"2023-10-09T06:58:03.781370+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:29:24.208508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.261059+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:36.489423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.264321+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:08:56.251029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.261138+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:33.198191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.787006+0000","last_change":"2023-10-09T06:58:03.783652+0000","last_active":"2023-10-09T06:58:03.787006+0000","last_peered":"2023-10-09T06:58:03.787006+0000","last_clean":"2023-10-09T06:58:03.787006+0000","last_became_active":"2023-10-09T06:58:03.783398+0000","last_became_peered":"2023-10-09T06:58:03.783398+0000","last_unstale":"2023-10-09T06:58:03.787006+0000","last_undegraded":"2023-10-09T06:58:03.787006+0000","last_fullsized":"2023-10-09T06:58:03.787006+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:18.062792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.262122+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:43:17.950320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.779091+0000","last_change":"2023-10-09T06:58:03.775521+0000","last_active":"2023-10-09T06:58:03.779091+0000","last_peered":"2023-10-09T06:58:03.779091+0000","last_clean":"2023-10-09T06:58:03.779091+0000","last_became_active":"2023-10-09T06:58:03.775284+0000","last_became_peered":"2023-10-09T06:58:03.775284+0000","last_unstale":"2023-10-09T06:58:03.779091+0000","last_undegraded":"2023-10-09T06:58:03.779091+0000","last_fullsized":"2023-10-09T06:58:03.779091+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:01:46.472752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.264678+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:15:55.636242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.778718+0000","last_change":"2023-10-09T06:58:03.777764+0000","last_active":"2023-10-09T06:58:03.778718+0000","last_peered":"2023-10-09T06:58:03.778718+0000","last_clean":"2023-10-09T06:58:03.778718+0000","last_became_active":"2023-10-09T06:58:03.777519+0000","last_became_peered":"2023-10-09T06:58:03.777519+0000","last_unstale":"2023-10-09T06:58:03.778718+0000","last_undegraded":"2023-10-09T06:58:03.778718+0000","last_fullsized":"2023-10-09T06:58:03.778718+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:48.690134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.261963+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:37.352870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.795108+0000","last_change":"2023-10-09T06:58:03.794613+0000","last_active":"2023-10-09T06:58:03.795108+0000","last_peered":"2023-10-09T06:58:03.795108+0000","last_clean":"2023-10-09T06:58:03.795108+0000","last_became_active":"2023-10-09T06:58:03.794396+0000","last_became_peered":"2023-10-09T06:58:03.794396+0000","last_unstale":"2023-10-09T06:58:03.795108+0000","last_undegraded":"2023-10-09T06:58:03.795108+0000","last_fullsized":"2023-10-09T06:58:03.795108+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:05.501958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.261340+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:51:36.270969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.791753+0000","last_change":"2023-10-09T06:58:03.790775+0000","last_active":"2023-10-09T06:58:03.791753+0000","last_peered":"2023-10-09T06:58:03.791753+0000","last_clean":"2023-10-09T06:58:03.791753+0000","last_became_active":"2023-10-09T06:58:03.790517+0000","last_became_peered":"2023-10-09T06:58:03.790517+0000","last_unstale":"2023-10-09T06:58:03.791753+0000","last_undegraded":"2023-10-09T06:58:03.791753+0000","last_fullsized":"2023-10-09T06:58:03.791753+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:38:39.496926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.772648+0000","last_change":"2023-10-09T06:58:03.282068+0000","last_active":"2023-10-09T06:58:03.772648+0000","last_peered":"2023-10-09T06:58:03.772648+0000","last_clean":"2023-10-09T06:58:03.772648+0000","last_became_active":"2023-10-09T06:58:03.281770+0000","last_became_peered":"2023-10-09T06:58:03.281770+0000","last_unstale":"2023-10-09T06:58:03.772648+0000","last_undegraded":"2023-10-09T06:58:03.772648+0000","last_fullsized":"2023-10-09T06:58:03.772648+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:48:10.578960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.784340+0000","last_change":"2023-10-09T06:58:03.782745+0000","last_active":"2023-10-09T06:58:03.784340+0000","last_peered":"2023-10-09T06:58:03.784340+0000","last_clean":"2023-10-09T06:58:03.784340+0000","last_became_active":"2023-10-09T06:58:03.782504+0000","last_became_peered":"2023-10-09T06:58:03.782504+0000","last_unstale":"2023-10-09T06:58:03.784340+0000","last_undegraded":"2023-10-09T06:58:03.784340+0000","last_fullsized":"2023-10-09T06:58:03.784340+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:35.203503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.263774+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:41.417852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.261948+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:43.149451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.776473+0000","last_change":"2023-10-09T06:58:03.282655+0000","last_active":"2023-10-09T06:58:03.776473+0000","last_peered":"2023-10-09T06:58:03.776473+0000","last_clean":"2023-10-09T06:58:03.776473+0000","last_became_active":"2023-10-09T06:58:03.282390+0000","last_became_peered":"2023-10-09T06:58:03.282390+0000","last_unstale":"2023-10-09T06:58:03.776473+0000","last_undegraded":"2023-10-09T06:58:03.776473+0000","last_fullsized":"2023-10-09T06:58:03.776473+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:39:27.910719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.775076+0000","last_change":"2023-10-09T06:58:03.282318+0000","last_active":"2023-10-09T06:58:03.775076+0000","last_peered":"2023-10-09T06:58:03.775076+0000","last_clean":"2023-10-09T06:58:03.775076+0000","last_became_active":"2023-10-09T06:58:03.282067+0000","last_became_peered":"2023-10-09T06:58:03.282067+0000","last_unstale":"2023-10-09T06:58:03.775076+0000","last_undegraded":"2023-10-09T06:58:03.775076+0000","last_fullsized":"2023-10-09T06:58:03.775076+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:54.192461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.782118+0000","last_change":"2023-10-09T06:58:03.780989+0000","last_active":"2023-10-09T06:58:03.782118+0000","last_peered":"2023-10-09T06:58:03.782118+0000","last_clean":"2023-10-09T06:58:03.782118+0000","last_became_active":"2023-10-09T06:58:03.780759+0000","last_became_peered":"2023-10-09T06:58:03.780759+0000","last_unstale":"2023-10-09T06:58:03.782118+0000","last_undegraded":"2023-10-09T06:58:03.782118+0000","last_fullsized":"2023-10-09T06:58:03.782118+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:05.430877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.776139+0000","last_change":"2023-10-09T06:58:03.277955+0000","last_active":"2023-10-09T06:58:03.776139+0000","last_peered":"2023-10-09T06:58:03.776139+0000","last_clean":"2023-10-09T06:58:03.776139+0000","last_became_active":"2023-10-09T06:58:03.277692+0000","last_became_peered":"2023-10-09T06:58:03.277692+0000","last_unstale":"2023-10-09T06:58:03.776139+0000","last_undegraded":"2023-10-09T06:58:03.776139+0000","last_fullsized":"2023-10-09T06:58:03.776139+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:44:10.319004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.775905+0000","last_change":"2023-10-09T06:58:03.279055+0000","last_active":"2023-10-09T06:58:03.775905+0000","last_peered":"2023-10-09T06:58:03.775905+0000","last_clean":"2023-10-09T06:58:03.775905+0000","last_became_active":"2023-10-09T06:58:03.278781+0000","last_became_peered":"2023-10-09T06:58:03.278781+0000","last_unstale":"2023-10-09T06:58:03.775905+0000","last_undegraded":"2023-10-09T06:58:03.775905+0000","last_fullsized":"2023-10-09T06:58:03.775905+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:41.417852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.779579+0000","last_change":"2023-10-09T06:58:03.777888+0000","last_active":"2023-10-09T06:58:03.779579+0000","last_peered":"2023-10-09T06:58:03.779579+0000","last_clean":"2023-10-09T06:58:03.779579+0000","last_became_active":"2023-10-09T06:58:03.777552+0000","last_became_peered":"2023-10-09T06:58:03.777552+0000","last_unstale":"2023-10-09T06:58:03.779579+0000","last_undegraded":"2023-10-09T06:58:03.779579+0000","last_fullsized":"2023-10-09T06:58:03.779579+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:14.217322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.261357+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:13.207974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.262049+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:49:36.085804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.792125+0000","last_change":"2023-10-09T06:58:03.791372+0000","last_active":"2023-10-09T06:58:03.792125+0000","last_peered":"2023-10-09T06:58:03.792125+0000","last_clean":"2023-10-09T06:58:03.792125+0000","last_became_active":"2023-10-09T06:58:03.791000+0000","last_became_peered":"2023-10-09T06:58:03.791000+0000","last_unstale":"2023-10-09T06:58:03.792125+0000","last_undegraded":"2023-10-09T06:58:03.792125+0000","last_fullsized":"2023-10-09T06:58:03.792125+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:35:41.435584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.262384+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:38:41.084580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"82'183","reported_seq":457,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-09T06:58:00.805784+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:58:00.805784+0000","last_peered":"2023-10-09T06:58:00.805784+0000","last_clean":"2023-10-09T06:58:00.805784+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:58:00.805784+0000","last_undegraded":"2023-10-09T06:58:00.805784+0000","last_fullsized":"2023-10-09T06:58:00.805784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":4},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1660,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575035,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303024,"kb_used_data":1640,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068816,"statfs":{"total":96636764160,"available":96326467584,"internally_reserved":0,"allocated":1679360,"data_stored":1112406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68400000000000005,"15min":0.70799999999999996},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.316},"max":{"1min":0.81100000000000005,"5min":1.732,"15min":1.9490000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.44,"5min":0.40200000000000002,"15min":0.29999999999999999},"max":{"1min":0.83299999999999996,"5min":1.22,"15min":3.448},"last":0.71799999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.504,"5min":0.437,"15min":0.379},"max":{"1min":0.86799999999999999,"5min":2.3559999999999999,"15min":5.617},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.46999999999999997,"5min":0.45800000000000002,"15min":0.40200000000000002},"max":{"1min":0.97599999999999998,"5min":1.7869999999999999,"15min":2.016},"last":0.627}]},{"osd":2,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.72999999999999998,"15min":0.73899999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.44800000000000001},"max":{"1min":0.97999999999999998,"5min":1.9430000000000001,"15min":2.052},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.73799999999999999,"15min":0.75600000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.44700000000000001},"max":{"1min":0.82399999999999995,"5min":2.6629999999999998,"15min":3.5019999999999998},"last":0.79700000000000004}]},{"osd":3,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.73899999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.45000000000000001},"max":{"1min":0.97099999999999997,"5min":1.03,"15min":5.5800000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.746,"15min":0.78100000000000003},"min":{"1min":0.50800000000000001,"5min":0.496,"15min":0.47099999999999997},"max":{"1min":0.89800000000000002,"5min":1.827,"15min":6.9299999999999997},"last":0.74199999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.91000000000000003,"5min":0.95499999999999996,"15min":3.125},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.66500000000000004},"min":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1850000000000001,"5min":2.577,"15min":4.8380000000000001},"last":0.67000000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68700000000000006,"15min":0.68100000000000005},"min":{"1min":0.441,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":1.0309999999999999,"5min":2.5169999999999999,"15min":4.1929999999999996},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.5,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":2.9590000000000001,"15min":3.6749999999999998},"last":0.84099999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0449999999999999,"5min":3.0019999999999998,"15min":4.0250000000000004},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72699999999999998,"15min":0.752},"min":{"1min":0.498,"5min":0.47399999999999998,"15min":0.44700000000000001},"max":{"1min":1.0740000000000001,"5min":2.4039999999999999,"15min":7.0259999999999998},"last":0.81699999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575034,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302444,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069396,"statfs":{"total":96636764160,"available":96327061504,"internally_reserved":0,"allocated":1085440,"data_stored":522038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69699999999999995,"15min":0.71099999999999997},"min":{"1min":0.52100000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85599999999999998,"5min":0.97899999999999998,"15min":1.022},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69099999999999995,"15min":0.70199999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.36599999999999999},"max":{"1min":0.80100000000000005,"5min":0.93899999999999995,"15min":1.079},"last":0.66300000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70599999999999996,"15min":0.72199999999999998},"min":{"1min":0.47699999999999998,"5min":0.44800000000000001,"15min":0.42799999999999999},"max":{"1min":0.90400000000000003,"5min":1.135,"15min":1.135},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70599999999999996,"15min":0.72399999999999998},"min":{"1min":0.56899999999999995,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83899999999999997,"5min":1.0109999999999999,"15min":1.034},"last":0.71099999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.58999999999999997,"5min":0.49199999999999999,"15min":0.42599999999999999},"max":{"1min":0.86899999999999999,"5min":1.391,"15min":1.391},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.51900000000000002,"5min":0.48899999999999999,"15min":0.45200000000000001},"max":{"1min":0.85899999999999999,"5min":0.95499999999999996,"15min":1.0900000000000001},"last":0.90500000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68300000000000005,"15min":0.69799999999999995},"min":{"1min":0.52600000000000002,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.82699999999999996,"5min":0.91700000000000004,"15min":1.046},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.497},"max":{"1min":0.86499999999999999,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.82999999999999996}]},{"osd":4,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.42099999999999999,"5min":0.38,"15min":0.377},"max":{"1min":0.73399999999999999,"5min":1.768,"15min":1.768},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.437,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77700000000000002,"5min":1.601,"15min":1.601},"last":0.73899999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.46600000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.876,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.68100000000000005,"15min":0.69299999999999995},"min":{"1min":0.47699999999999998,"5min":0.44600000000000001,"15min":0.42299999999999999},"max":{"1min":0.77500000000000002,"5min":0.99299999999999999,"15min":1.0669999999999999},"last":0.75700000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.66600000000000004,"15min":0.67700000000000005},"min":{"1min":0.48699999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79400000000000004,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.45300000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83999999999999997,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.79900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302512,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069328,"statfs":{"total":96636764160,"available":96326991872,"internally_reserved":0,"allocated":1155072,"data_stored":550849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.27600000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59399999999999997,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.503,"5min":0.49199999999999999,"15min":0.48299999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.23699999999999999},"max":{"1min":1.083,"5min":1.23,"15min":1.23},"last":0.32600000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.29599999999999999},"max":{"1min":0.68500000000000005,"5min":1.169,"15min":1.169},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.439,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":3.077,"15min":3.077},"last":0.56899999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.40000000000000002,"5min":0.376,"15min":0.34100000000000003},"max":{"1min":0.76000000000000001,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.39100000000000001,"5min":0.34899999999999998,"15min":0.34100000000000003},"max":{"1min":1.056,"5min":1.605,"15min":1.605},"last":0.36099999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73899999999999999,"15min":0.76100000000000001},"min":{"1min":0.497,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.89900000000000002,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.75800000000000001,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93999999999999995,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.72299999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75800000000000001,"15min":0.77400000000000002},"min":{"1min":0.55000000000000004,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.3140000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75900000000000001,"15min":0.78100000000000003},"min":{"1min":0.54500000000000004,"5min":0.497,"15min":0.47999999999999998},"max":{"1min":0.95799999999999996,"5min":1.637,"15min":1.637},"last":0.65200000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78700000000000003,"15min":0.79600000000000004},"min":{"1min":0.54600000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97899999999999998,"5min":1.696,"15min":1.696},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78600000000000003,"15min":0.79700000000000004},"min":{"1min":0.54600000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1679999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81999999999999995,"15min":0.82599999999999996},"min":{"1min":0.55500000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1479999999999999,"5min":1.2669999999999999,"15min":1.4510000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79800000000000004,"15min":0.82299999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98699999999999999,"5min":1.125,"15min":1.1970000000000001},"last":0.69099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575035,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298976,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072864,"statfs":{"total":96636764160,"available":96330612736,"internally_reserved":0,"allocated":1728512,"data_stored":1139093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.29299999999999998,"5min":0.27100000000000002,"15min":0.23000000000000001},"max":{"1min":0.623,"5min":0.85799999999999998,"15min":1.2729999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.28899999999999998},"max":{"1min":0.60399999999999998,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":0.47499999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.63400000000000001,"5min":4.6980000000000004,"15min":4.6980000000000004},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48999999999999999,"15min":0.497},"min":{"1min":0.34000000000000002,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.71799999999999997,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.41499999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":0.63800000000000001,"5min":1.2450000000000001,"15min":1.7130000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.441,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":0.70199999999999996,"5min":4.734,"15min":4.734},"last":0.498}]},{"osd":4,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.52900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99199999999999999,"5min":1.2270000000000001,"15min":1.752},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.50700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.91500000000000004,"5min":4.6619999999999999,"15min":4.6619999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.53700000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0049999999999999,"5min":1.1890000000000001,"15min":1.2769999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.58699999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90300000000000002,"5min":1.2809999999999999,"15min":1.7889999999999999},"last":0.81699999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.80500000000000005,"15min":0.81299999999999994},"min":{"1min":0.56499999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97299999999999998,"5min":4.6239999999999997,"15min":4.6239999999999997},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79300000000000004,"15min":0.80100000000000005},"min":{"1min":0.55600000000000005,"5min":0.50800000000000001,"15min":0.47999999999999998},"max":{"1min":0.96499999999999997,"5min":1.2689999999999999,"15min":1.4370000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.82499999999999996,"15min":0.83199999999999996},"min":{"1min":0.56299999999999994,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.042,"5min":1.256,"15min":1.518},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.621,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95599999999999996,"5min":1.702,"15min":1.8200000000000001},"last":0.753}]}]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306600,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065240,"statfs":{"total":96636764160,"available":96322805760,"internally_reserved":0,"allocated":1146880,"data_stored":550261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.46800000000000003,"15min":0.45400000000000001},"min":{"1min":0.28299999999999997,"5min":0.26500000000000001,"15min":0.25900000000000001},"max":{"1min":0.76700000000000002,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.48999999999999999,"15min":0.495},"min":{"1min":0.30599999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.55300000000000005,"5min":1.633,"15min":1.633},"last":0.38800000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46400000000000002,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71599999999999997,"5min":1.097,"15min":1.865},"last":0.371},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.79700000000000004,"5min":1.2689999999999999,"15min":1.79},"last":0.45400000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.58899999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.35799999999999998},"max":{"1min":0.82599999999999996,"5min":0.86699999999999999,"15min":1.8999999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.47399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70299999999999996,"5min":1.1890000000000001,"15min":1.8220000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":0.85799999999999998,"5min":1.2430000000000001,"15min":1.256},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.55000000000000004,"5min":0.45900000000000002,"15min":0.44800000000000001},"max":{"1min":0.91400000000000003,"5min":1.696,"15min":1.696},"last":0.77800000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.753,"15min":0.76800000000000002},"min":{"1min":0.505,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85199999999999998,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.503},"max":{"1min":0.83199999999999996,"5min":1.218,"15min":1.3440000000000001},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.54000000000000004,"5min":0.51000000000000001,"15min":0.48599999999999999},"max":{"1min":0.94899999999999995,"5min":1.768,"15min":1.768},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.76400000000000001,"15min":0.79000000000000004},"min":{"1min":0.56599999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92900000000000005,"5min":1.3580000000000001,"15min":1.5309999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.61799999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97799999999999998,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.58699999999999997,"5min":0.57599999999999996,"15min":0.50900000000000001},"max":{"1min":0.92000000000000004,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.621}]}]},{"osd":3,"up_from":13,"seq":55834575036,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306596,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065244,"statfs":{"total":96636764160,"available":96322809856,"internally_reserved":0,"allocated":1142784,"data_stored":548837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.29599999999999999,"5min":0.29499999999999998,"15min":0.24099999999999999},"max":{"1min":0.86299999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.47899999999999998,"15min":0.48799999999999999},"min":{"1min":0.315,"5min":0.30199999999999999,"15min":0.28100000000000003},"max":{"1min":0.63600000000000001,"5min":1.228,"15min":1.228},"last":0.498}]},{"osd":1,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.48099999999999998,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58699999999999997,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.379}]},{"osd":2,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94099999999999995,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64800000000000002,"15min":0.63300000000000001},"min":{"1min":0.44400000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.97699999999999998,"5min":3.8900000000000001,"15min":3.8900000000000001},"last":0.56899999999999995}]},{"osd":4,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.51100000000000001,"5min":0.48299999999999998,"15min":0.40799999999999997},"max":{"1min":0.76500000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.81000000000000005,"15min":0.82299999999999995},"min":{"1min":0.623,"5min":0.59399999999999997,"15min":0.52200000000000002},"max":{"1min":1.0189999999999999,"5min":1.22,"15min":1.22},"last":0.77000000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.45000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.86199999999999999,"5min":1.3360000000000001,"15min":2.1549999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.56399999999999995,"5min":0.55900000000000005,"15min":0.50600000000000001},"max":{"1min":1.0569999999999999,"5min":1.1639999999999999,"15min":1.419},"last":0.68500000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.51700000000000002},"max":{"1min":0.875,"5min":1.304,"15min":1.304},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95199999999999996,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.69899999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91100000000000003,"5min":1.8180000000000001,"15min":2.0880000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.80800000000000005,"15min":0.82099999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92300000000000004,"5min":1.486,"15min":1.486},"last":0.77800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575034,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310648,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061192,"statfs":{"total":96636764160,"available":96318660608,"internally_reserved":0,"allocated":1097728,"data_stored":528235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71399999999999997,"15min":0.70399999999999996},"min":{"1min":0.45000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79200000000000004,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.72799999999999998,"15min":0.72299999999999998},"min":{"1min":0.50900000000000001,"5min":0.42699999999999999,"15min":0.39300000000000002},"max":{"1min":0.97399999999999998,"5min":2.8130000000000002,"15min":3.23},"last":0.66700000000000004}]},{"osd":1,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71899999999999997,"15min":0.71099999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.373},"max":{"1min":0.85699999999999998,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.53000000000000003,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.86499999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.56000000000000005}]},{"osd":2,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.755,"15min":0.75700000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.38100000000000001},"max":{"1min":0.92900000000000005,"5min":2.5960000000000001,"15min":3.7509999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.48299999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90000000000000002,"5min":2.427,"15min":2.427},"last":0.53500000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.755,"15min":0.751},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.434},"max":{"1min":0.89700000000000002,"5min":2.6440000000000001,"15min":3.6970000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.77000000000000002,"15min":0.747},"min":{"1min":0.443,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":3.6899999999999999,"15min":3.6899999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63600000000000001,"15min":0.60899999999999999},"min":{"1min":0.379,"5min":0.317,"15min":0.317},"max":{"1min":0.84899999999999998,"5min":3.3860000000000001,"15min":3.4780000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.68999999999999995,"15min":0.65800000000000003},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.34999999999999998},"max":{"1min":0.91200000000000003,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.64100000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67100000000000004,"15min":0.64000000000000001},"min":{"1min":0.47699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82299999999999995,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.63},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.71499999999999997,"15min":0.67900000000000005},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.374},"max":{"1min":0.89100000000000001,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.51200000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.49299999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.96599999999999997,"5min":2.7210000000000001,"15min":3.2789999999999999},"last":0.621},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.76900000000000002},"min":{"1min":0.56499999999999995,"5min":0.439,"15min":0.439},"max":{"1min":0.93600000000000005,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.65200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":1097728,"data_stored":528235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67600000000000005,"15min":0.69699999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.72299999999999998,"5min":0.93600000000000005,"15min":1.655},"last":0.752},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65700000000000003,"15min":0.68400000000000005},"min":{"1min":0.42899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78200000000000003,"5min":1.0269999999999999,"15min":1.1359999999999999},"last":0.47299999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71699999999999997,"5min":0.96899999999999997,"15min":2.4159999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.45400000000000001,"5min":0.44,"15min":0.40400000000000003},"max":{"1min":0.89100000000000001,"5min":0.95099999999999996,"15min":1.706},"last":0.52100000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69699999999999995,"15min":0.72799999999999998},"min":{"1min":0.501,"5min":0.48499999999999999,"15min":0.42999999999999999},"max":{"1min":0.75800000000000001,"5min":0.997,"15min":1.79},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69699999999999995,"15min":0.71599999999999997},"min":{"1min":0.49199999999999999,"5min":0.46500000000000002,"15min":0.442},"max":{"1min":0.752,"5min":1.006,"15min":2.4889999999999999},"last":0.81799999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68999999999999995,"15min":0.71699999999999997},"min":{"1min":0.46899999999999997,"5min":0.438,"15min":0.435},"max":{"1min":0.88600000000000001,"5min":1.0209999999999999,"15min":1.409},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73899999999999999,"15min":0.76900000000000002},"min":{"1min":0.56200000000000006,"5min":0.501,"15min":0.501},"max":{"1min":0.78600000000000003,"5min":0.95699999999999996,"15min":2.532},"last":0.77300000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":1.766},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.622,"15min":0.621},"min":{"1min":0.48599999999999999,"5min":0.377,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":1.052,"15min":2.7829999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.45100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82899999999999996,"5min":1.018,"15min":2.5739999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.40000000000000002,"15min":0.38900000000000001},"max":{"1min":0.84099999999999997,"5min":0.97999999999999998,"15min":1.8080000000000001},"last":0.84699999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.90700000000000003,"5min":1.175,"15min":2.9609999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.60499999999999998,"5min":0.498,"15min":0.45900000000000002},"max":{"1min":0.876,"5min":1.139,"15min":2.613},"last":0.88300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:58:08.624 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:58:08.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.837+0000 7fadd81ff700 1 Processor -- start 2023-10-09T06:58:08.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.837+0000 7fadd81ff700 1 -- start start 2023-10-09T06:58:08.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.838+0000 7fadd81ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fadd00cbf30 0x7fadd00ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:08.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.838+0000 7fadd81ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fadd00b1420 0x7fadd00c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:08.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.838+0000 7fadd81ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd00cc300 con 0x7fadd00ccf90 2023-10-09T06:58:08.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.838+0000 7fadd81ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd0156bf0 con 0x7fadd00b1420 2023-10-09T06:58:08.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.838+0000 7fadd81ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd00ae950 con 0x7fadd00cbf30 2023-10-09T06:58:08.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.839+0000 7fadd679c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fadd00b1420 0x7fadd00c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:08.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.839+0000 7fadd679c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fadd00b1420 0x7fadd00c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59942/0 (socket says 172.21.15.71:59942) 2023-10-09T06:58:08.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.839+0000 7fadd679c700 1 -- 172.21.15.71:0/833471575 learned_addr learned my addr 172.21.15.71:0/833471575 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:08.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.839+0000 7fadd5f9b700 1 --2- 172.21.15.71:0/833471575 >> v2:172.21.15.179:3300/0 conn(0x7fadd00cbf30 0x7fadd00ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:08.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.839+0000 7fadd679c700 1 -- 172.21.15.71:0/833471575 >> v2:172.21.15.179:3300/0 conn(0x7fadd00cbf30 msgr2=0x7fadd00ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:08.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.839+0000 7fadd679c700 1 --2- 172.21.15.71:0/833471575 >> v2:172.21.15.179:3300/0 conn(0x7fadd00cbf30 0x7fadd00ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:08.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.839+0000 7fadd679c700 1 -- 172.21.15.71:0/833471575 >> v1:172.21.15.179:6789/0 conn(0x7fadd00ccf90 legacy=0x7fadd00b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:08.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.839+0000 7fadd679c700 1 -- 172.21.15.71:0/833471575 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd00ad370 con 0x7fadd00b1420 2023-10-09T06:58:08.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.839+0000 7fadd679c700 1 --2- 172.21.15.71:0/833471575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadd00b1420 0x7fadd00c9740 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fadd0063d40 tx=0x7fadc8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05484e75873f58b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:08.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.840+0000 7fadd4f99700 1 -- 172.21.15.71:0/833471575 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc800e070 con 0x7fadd00b1420 2023-10-09T06:58:08.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.840+0000 7fadd4f99700 1 -- 172.21.15.71:0/833471575 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc800ba40 con 0x7fadd00b1420 2023-10-09T06:58:08.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.840+0000 7fadd4f99700 1 -- 172.21.15.71:0/833471575 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc80092e0 con 0x7fadd00b1420 2023-10-09T06:58:08.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.840+0000 7fadd81ff700 1 -- 172.21.15.71:0/833471575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadd00b1420 msgr2=0x7fadd00c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:08.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.840+0000 7fadd81ff700 1 --2- 172.21.15.71:0/833471575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadd00b1420 0x7fadd00c9740 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fadd0063d40 tx=0x7fadc8009840 comp rx=0 tx=0).stop 2023-10-09T06:58:08.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.840+0000 7fadd81ff700 1 -- 172.21.15.71:0/833471575 shutdown_connections 2023-10-09T06:58:08.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.840+0000 7fadd81ff700 1 --2- 172.21.15.71:0/833471575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadd00b1420 0x7fadd00c9740 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:08.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.840+0000 7fadd81ff700 1 --2- 172.21.15.71:0/833471575 >> v2:172.21.15.179:3300/0 conn(0x7fadd00cbf30 0x7fadd00ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:08.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.840+0000 7fadd81ff700 1 -- 172.21.15.71:0/833471575 >> 172.21.15.71:0/833471575 conn(0x7fadd006a320 msgr2=0x7fadd00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:08.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.840+0000 7fadd81ff700 1 -- 172.21.15.71:0/833471575 shutdown_connections 2023-10-09T06:58:08.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.840+0000 7fadd81ff700 1 -- 172.21.15.71:0/833471575 wait complete. 2023-10-09T06:58:08.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.842+0000 7fadd81ff700 1 Processor -- start 2023-10-09T06:58:08.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.842+0000 7fadd81ff700 1 -- start start 2023-10-09T06:58:08.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.843+0000 7fadd81ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fadd00b1420 0x7fadd01559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:08.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.843+0000 7fadd81ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadd00cbf30 0x7fadd00a7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:08.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.843+0000 7fadd81ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadd00ccf90 0x7fadd00a9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:08.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.843+0000 7fadd81ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd0158790 con 0x7fadd00cbf30 2023-10-09T06:58:08.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.843+0000 7fadd81ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd0157ea0 con 0x7fadd00ccf90 2023-10-09T06:58:08.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.843+0000 7fadd81ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd00a8830 con 0x7fadd00b1420 2023-10-09T06:58:08.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.843+0000 7fadd579a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadd00cbf30 0x7fadd00a7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:08.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.843+0000 7fadd579a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadd00cbf30 0x7fadd00a7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59944/0 (socket says 172.21.15.71:59944) 2023-10-09T06:58:08.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.843+0000 7fadd579a700 1 -- 172.21.15.71:0/3129025759 learned_addr learned my addr 172.21.15.71:0/3129025759 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:08.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.843+0000 7fadd5f9b700 1 --2- 172.21.15.71:0/3129025759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fadd00b1420 0x7fadd01559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:08.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.843+0000 7fadd679c700 1 --2- 172.21.15.71:0/3129025759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadd00ccf90 0x7fadd00a9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:08.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.844+0000 7fadd579a700 1 -- 172.21.15.71:0/3129025759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fadd00b1420 msgr2=0x7fadd01559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:08.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.844+0000 7fadd579a700 1 --2- 172.21.15.71:0/3129025759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fadd00b1420 0x7fadd01559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:08.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.844+0000 7fadd579a700 1 -- 172.21.15.71:0/3129025759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadd00ccf90 msgr2=0x7fadd00a9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:08.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.844+0000 7fadd579a700 1 --2- 172.21.15.71:0/3129025759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadd00ccf90 0x7fadd00a9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:08.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.844+0000 7fadd579a700 1 -- 172.21.15.71:0/3129025759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc8009ae0 con 0x7fadd00cbf30 2023-10-09T06:58:08.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.844+0000 7fadd579a700 1 --2- 172.21.15.71:0/3129025759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadd00cbf30 0x7fadd00a7ee0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fadc000c4e0 tx=0x7fadc000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:08.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.844+0000 7fadc5ffb700 1 -- 172.21.15.71:0/3129025759 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0011590 con 0x7fadd00cbf30 2023-10-09T06:58:08.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.844+0000 7fadc5ffb700 1 -- 172.21.15.71:0/3129025759 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc0011710 con 0x7fadd00cbf30 2023-10-09T06:58:08.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.844+0000 7fadc5ffb700 1 -- 172.21.15.71:0/3129025759 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0011ad0 con 0x7fadd00cbf30 2023-10-09T06:58:08.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.844+0000 7fadd81ff700 1 -- 172.21.15.71:0/3129025759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd0158140 con 0x7fadd00cbf30 2023-10-09T06:58:08.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.844+0000 7fadd81ff700 1 -- 172.21.15.71:0/3129025759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd00a8420 con 0x7fadd00cbf30 2023-10-09T06:58:08.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.845+0000 7fadd81ff700 1 -- 172.21.15.71:0/3129025759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd0158900 con 0x7fadd00cbf30 2023-10-09T06:58:08.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.846+0000 7fadc5ffb700 1 -- 172.21.15.71:0/3129025759 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fadc001b3b0 con 0x7fadd00cbf30 2023-10-09T06:58:08.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.847+0000 7fadc5ffb700 1 --2- 172.21.15.71:0/3129025759 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fadb4066f30 0x7fadb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:08.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.847+0000 7fadc5ffb700 1 -- 172.21.15.71:0/3129025759 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fadc0083b20 con 0x7fadd00cbf30 2023-10-09T06:58:08.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.847+0000 7fadd5f9b700 1 --2- 172.21.15.71:0/3129025759 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fadb4066f30 0x7fadb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:08.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.848+0000 7fadd5f9b700 1 --2- 172.21.15.71:0/3129025759 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fadb4066f30 0x7fadb40693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fadcc006fd0 tx=0x7fadcc008040 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:08.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:08.852+0000 7fadc5ffb700 1 -- 172.21.15.71:0/3129025759 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fadc0050b60 con 0x7fadd00cbf30 2023-10-09T06:58:09.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.040+0000 7fadd81ff700 1 -- 172.21.15.71:0/3129025759 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fadd004c3c0 con 0x7fadb4066f30 2023-10-09T06:58:09.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.048+0000 7fadc5ffb700 1 -- 172.21.15.71:0/3129025759 <== mgr.6274 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283278 (secure 0 0 0) 0x7fadd004c3c0 con 0x7fadb4066f30 2023-10-09T06:58:09.054 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:09.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.052+0000 7fadd81ff700 1 -- 172.21.15.71:0/3129025759 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fadb4066f30 msgr2=0x7fadb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:09.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.052+0000 7fadd81ff700 1 --2- 172.21.15.71:0/3129025759 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fadb4066f30 0x7fadb40693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fadcc006fd0 tx=0x7fadcc008040 comp rx=0 tx=0).stop 2023-10-09T06:58:09.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.052+0000 7fadd81ff700 1 -- 172.21.15.71:0/3129025759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadd00cbf30 msgr2=0x7fadd00a7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:09.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.052+0000 7fadd81ff700 1 --2- 172.21.15.71:0/3129025759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadd00cbf30 0x7fadd00a7ee0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fadc000c4e0 tx=0x7fadc000c7f0 comp rx=0 tx=0).stop 2023-10-09T06:58:09.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.052+0000 7fadd81ff700 1 -- 172.21.15.71:0/3129025759 shutdown_connections 2023-10-09T06:58:09.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.052+0000 7fadd81ff700 1 --2- 172.21.15.71:0/3129025759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadd00ccf90 0x7fadd00a9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:09.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.053+0000 7fadd81ff700 1 --2- 172.21.15.71:0/3129025759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fadd00b1420 0x7fadd01559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:09.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.053+0000 7fadd81ff700 1 --2- 172.21.15.71:0/3129025759 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fadb4066f30 0x7fadb40693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:09.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.053+0000 7fadd81ff700 1 --2- 172.21.15.71:0/3129025759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadd00cbf30 0x7fadd00a7ee0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:09.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.053+0000 7fadd81ff700 1 -- 172.21.15.71:0/3129025759 >> 172.21.15.71:0/3129025759 conn(0x7fadd006a320 msgr2=0x7fadd00afc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:09.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.053+0000 7fadd81ff700 1 -- 172.21.15.71:0/3129025759 shutdown_connections 2023-10-09T06:58:09.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.053+0000 7fadd81ff700 1 -- 172.21.15.71:0/3129025759 wait complete. 2023-10-09T06:58:09.058 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:58:09.072 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T06:58:08.029718+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592028,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":292,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2433256,"kb_used_data":9896,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752541464,"statfs":{"total":773094113280,"available":770602459136,"internally_reserved":0,"allocated":10133504,"data_stored":5479954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1660,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.772335"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781741+0000","last_change":"2023-10-09T06:58:03.778823+0000","last_active":"2023-10-09T06:58:03.781741+0000","last_peered":"2023-10-09T06:58:03.781741+0000","last_clean":"2023-10-09T06:58:03.781741+0000","last_became_active":"2023-10-09T06:58:03.778577+0000","last_became_peered":"2023-10-09T06:58:03.778577+0000","last_unstale":"2023-10-09T06:58:03.781741+0000","last_undegraded":"2023-10-09T06:58:03.781741+0000","last_fullsized":"2023-10-09T06:58:03.781741+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:19.132641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.791624+0000","last_change":"2023-10-09T06:58:03.790890+0000","last_active":"2023-10-09T06:58:03.791624+0000","last_peered":"2023-10-09T06:58:03.791624+0000","last_clean":"2023-10-09T06:58:03.791624+0000","last_became_active":"2023-10-09T06:58:03.790601+0000","last_became_peered":"2023-10-09T06:58:03.790601+0000","last_unstale":"2023-10-09T06:58:03.791624+0000","last_undegraded":"2023-10-09T06:58:03.791624+0000","last_fullsized":"2023-10-09T06:58:03.791624+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:39.273916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.788534+0000","last_change":"2023-10-09T06:58:03.787537+0000","last_active":"2023-10-09T06:58:03.788534+0000","last_peered":"2023-10-09T06:58:03.788534+0000","last_clean":"2023-10-09T06:58:03.788534+0000","last_became_active":"2023-10-09T06:58:03.787261+0000","last_became_peered":"2023-10-09T06:58:03.787261+0000","last_unstale":"2023-10-09T06:58:03.788534+0000","last_undegraded":"2023-10-09T06:58:03.788534+0000","last_fullsized":"2023-10-09T06:58:03.788534+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:49:37.095152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781603+0000","last_change":"2023-10-09T06:58:03.779446+0000","last_active":"2023-10-09T06:58:03.781603+0000","last_peered":"2023-10-09T06:58:03.781603+0000","last_clean":"2023-10-09T06:58:03.781603+0000","last_became_active":"2023-10-09T06:58:03.779142+0000","last_became_peered":"2023-10-09T06:58:03.779142+0000","last_unstale":"2023-10-09T06:58:03.781603+0000","last_undegraded":"2023-10-09T06:58:03.781603+0000","last_fullsized":"2023-10-09T06:58:03.781603+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:42.427200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.786488+0000","last_change":"2023-10-09T06:58:03.783075+0000","last_active":"2023-10-09T06:58:03.786488+0000","last_peered":"2023-10-09T06:58:03.786488+0000","last_clean":"2023-10-09T06:58:03.786488+0000","last_became_active":"2023-10-09T06:58:03.782836+0000","last_became_peered":"2023-10-09T06:58:03.782836+0000","last_unstale":"2023-10-09T06:58:03.786488+0000","last_undegraded":"2023-10-09T06:58:03.786488+0000","last_fullsized":"2023-10-09T06:58:03.786488+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:27.010548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.788787+0000","last_change":"2023-10-09T06:58:03.788199+0000","last_active":"2023-10-09T06:58:03.788787+0000","last_peered":"2023-10-09T06:58:03.788787+0000","last_clean":"2023-10-09T06:58:03.788787+0000","last_became_active":"2023-10-09T06:58:03.787893+0000","last_became_peered":"2023-10-09T06:58:03.787893+0000","last_unstale":"2023-10-09T06:58:03.788787+0000","last_undegraded":"2023-10-09T06:58:03.788787+0000","last_fullsized":"2023-10-09T06:58:03.788787+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:44.586446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.778194+0000","last_change":"2023-10-09T06:58:03.774830+0000","last_active":"2023-10-09T06:58:03.778194+0000","last_peered":"2023-10-09T06:58:03.778194+0000","last_clean":"2023-10-09T06:58:03.778194+0000","last_became_active":"2023-10-09T06:58:03.774540+0000","last_became_peered":"2023-10-09T06:58:03.774540+0000","last_unstale":"2023-10-09T06:58:03.778194+0000","last_undegraded":"2023-10-09T06:58:03.778194+0000","last_fullsized":"2023-10-09T06:58:03.778194+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:55.445121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.784320+0000","last_change":"2023-10-09T06:58:03.782721+0000","last_active":"2023-10-09T06:58:03.784320+0000","last_peered":"2023-10-09T06:58:03.784320+0000","last_clean":"2023-10-09T06:58:03.784320+0000","last_became_active":"2023-10-09T06:58:03.782471+0000","last_became_peered":"2023-10-09T06:58:03.782471+0000","last_unstale":"2023-10-09T06:58:03.784320+0000","last_undegraded":"2023-10-09T06:58:03.784320+0000","last_fullsized":"2023-10-09T06:58:03.784320+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:01.380815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781583+0000","last_change":"2023-10-09T06:58:03.778825+0000","last_active":"2023-10-09T06:58:03.781583+0000","last_peered":"2023-10-09T06:58:03.781583+0000","last_clean":"2023-10-09T06:58:03.781583+0000","last_became_active":"2023-10-09T06:58:03.778586+0000","last_became_peered":"2023-10-09T06:58:03.778586+0000","last_unstale":"2023-10-09T06:58:03.781583+0000","last_undegraded":"2023-10-09T06:58:03.781583+0000","last_fullsized":"2023-10-09T06:58:03.781583+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:38:42.093928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.792047+0000","last_change":"2023-10-09T06:58:03.790976+0000","last_active":"2023-10-09T06:58:03.792047+0000","last_peered":"2023-10-09T06:58:03.792047+0000","last_clean":"2023-10-09T06:58:03.792047+0000","last_became_active":"2023-10-09T06:58:03.790611+0000","last_became_peered":"2023-10-09T06:58:03.790611+0000","last_unstale":"2023-10-09T06:58:03.792047+0000","last_undegraded":"2023-10-09T06:58:03.792047+0000","last_fullsized":"2023-10-09T06:58:03.792047+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:45:13.736492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.783595+0000","last_change":"2023-10-09T06:58:03.780575+0000","last_active":"2023-10-09T06:58:03.783595+0000","last_peered":"2023-10-09T06:58:03.783595+0000","last_clean":"2023-10-09T06:58:03.783595+0000","last_became_active":"2023-10-09T06:58:03.780287+0000","last_became_peered":"2023-10-09T06:58:03.780287+0000","last_unstale":"2023-10-09T06:58:03.783595+0000","last_undegraded":"2023-10-09T06:58:03.783595+0000","last_fullsized":"2023-10-09T06:58:03.783595+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:50.836527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.780921+0000","last_change":"2023-10-09T06:58:03.778338+0000","last_active":"2023-10-09T06:58:03.780921+0000","last_peered":"2023-10-09T06:58:03.780921+0000","last_clean":"2023-10-09T06:58:03.780921+0000","last_became_active":"2023-10-09T06:58:03.778095+0000","last_became_peered":"2023-10-09T06:58:03.778095+0000","last_unstale":"2023-10-09T06:58:03.780921+0000","last_undegraded":"2023-10-09T06:58:03.780921+0000","last_fullsized":"2023-10-09T06:58:03.780921+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:50.836527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.777660+0000","last_change":"2023-10-09T06:58:03.775523+0000","last_active":"2023-10-09T06:58:03.777660+0000","last_peered":"2023-10-09T06:58:03.777660+0000","last_clean":"2023-10-09T06:58:03.777660+0000","last_became_active":"2023-10-09T06:58:03.775252+0000","last_became_peered":"2023-10-09T06:58:03.775252+0000","last_unstale":"2023-10-09T06:58:03.777660+0000","last_undegraded":"2023-10-09T06:58:03.777660+0000","last_fullsized":"2023-10-09T06:58:03.777660+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:33:52.454840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.265327+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:47:53.051745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781593+0000","last_change":"2023-10-09T06:58:03.779335+0000","last_active":"2023-10-09T06:58:03.781593+0000","last_peered":"2023-10-09T06:58:03.781593+0000","last_clean":"2023-10-09T06:58:03.781593+0000","last_became_active":"2023-10-09T06:58:03.779073+0000","last_became_peered":"2023-10-09T06:58:03.779073+0000","last_unstale":"2023-10-09T06:58:03.781593+0000","last_undegraded":"2023-10-09T06:58:03.781593+0000","last_fullsized":"2023-10-09T06:58:03.781593+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:35.834887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"92'1","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.290439+0000","last_change":"2023-10-09T06:58:03.281341+0000","last_active":"2023-10-09T06:58:04.290439+0000","last_peered":"2023-10-09T06:58:04.290439+0000","last_clean":"2023-10-09T06:58:04.290439+0000","last_became_active":"2023-10-09T06:58:03.281014+0000","last_became_peered":"2023-10-09T06:58:03.281014+0000","last_unstale":"2023-10-09T06:58:04.290439+0000","last_undegraded":"2023-10-09T06:58:04.290439+0000","last_fullsized":"2023-10-09T06:58:04.290439+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:50:35.632368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.261063+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:02.609888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.262290+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:34.825539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"92'1","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.290920+0000","last_change":"2023-10-09T06:58:03.274347+0000","last_active":"2023-10-09T06:58:04.290920+0000","last_peered":"2023-10-09T06:58:04.290920+0000","last_clean":"2023-10-09T06:58:04.290920+0000","last_became_active":"2023-10-09T06:58:03.274034+0000","last_became_peered":"2023-10-09T06:58:03.274034+0000","last_unstale":"2023-10-09T06:58:04.290920+0000","last_undegraded":"2023-10-09T06:58:04.290920+0000","last_fullsized":"2023-10-09T06:58:04.290920+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:06.817917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.264758+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:52:54.289694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.780519+0000","last_change":"2023-10-09T06:58:03.778295+0000","last_active":"2023-10-09T06:58:03.780519+0000","last_peered":"2023-10-09T06:58:03.780519+0000","last_clean":"2023-10-09T06:58:03.780519+0000","last_became_active":"2023-10-09T06:58:03.777990+0000","last_became_peered":"2023-10-09T06:58:03.777990+0000","last_unstale":"2023-10-09T06:58:03.780519+0000","last_undegraded":"2023-10-09T06:58:03.780519+0000","last_fullsized":"2023-10-09T06:58:03.780519+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:38.362218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.776114+0000","last_change":"2023-10-09T06:58:03.278385+0000","last_active":"2023-10-09T06:58:03.776114+0000","last_peered":"2023-10-09T06:58:03.776114+0000","last_clean":"2023-10-09T06:58:03.776114+0000","last_became_active":"2023-10-09T06:58:03.278063+0000","last_became_peered":"2023-10-09T06:58:03.278063+0000","last_unstale":"2023-10-09T06:58:03.776114+0000","last_undegraded":"2023-10-09T06:58:03.776114+0000","last_fullsized":"2023-10-09T06:58:03.776114+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:01:05.569394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.787641+0000","last_change":"2023-10-09T06:58:03.786407+0000","last_active":"2023-10-09T06:58:03.787641+0000","last_peered":"2023-10-09T06:58:03.787641+0000","last_clean":"2023-10-09T06:58:03.787641+0000","last_became_active":"2023-10-09T06:58:03.786139+0000","last_became_peered":"2023-10-09T06:58:03.786139+0000","last_unstale":"2023-10-09T06:58:03.787641+0000","last_undegraded":"2023-10-09T06:58:03.787641+0000","last_fullsized":"2023-10-09T06:58:03.787641+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:54:29.099122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.773510+0000","last_change":"2023-10-09T06:58:03.274854+0000","last_active":"2023-10-09T06:58:03.773510+0000","last_peered":"2023-10-09T06:58:03.773510+0000","last_clean":"2023-10-09T06:58:03.773510+0000","last_became_active":"2023-10-09T06:58:03.274591+0000","last_became_peered":"2023-10-09T06:58:03.274591+0000","last_unstale":"2023-10-09T06:58:03.773510+0000","last_undegraded":"2023-10-09T06:58:03.773510+0000","last_fullsized":"2023-10-09T06:58:03.773510+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:27:49.714248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.263208+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:38.264568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.264813+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:44:28.414578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"92'3","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.293010+0000","last_change":"2023-10-09T06:58:03.277580+0000","last_active":"2023-10-09T06:58:04.293010+0000","last_peered":"2023-10-09T06:58:04.293010+0000","last_clean":"2023-10-09T06:58:04.293010+0000","last_became_active":"2023-10-09T06:58:03.277331+0000","last_became_peered":"2023-10-09T06:58:03.277331+0000","last_unstale":"2023-10-09T06:58:04.293010+0000","last_undegraded":"2023-10-09T06:58:04.293010+0000","last_fullsized":"2023-10-09T06:58:04.293010+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:52.632381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781319+0000","last_change":"2023-10-09T06:58:03.779510+0000","last_active":"2023-10-09T06:58:03.781319+0000","last_peered":"2023-10-09T06:58:03.781319+0000","last_clean":"2023-10-09T06:58:03.781319+0000","last_became_active":"2023-10-09T06:58:03.778576+0000","last_became_peered":"2023-10-09T06:58:03.778576+0000","last_unstale":"2023-10-09T06:58:03.781319+0000","last_undegraded":"2023-10-09T06:58:03.781319+0000","last_fullsized":"2023-10-09T06:58:03.781319+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:43:18.959668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"92'6","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.295792+0000","last_change":"2023-10-09T06:58:03.281626+0000","last_active":"2023-10-09T06:58:04.295792+0000","last_peered":"2023-10-09T06:58:04.295792+0000","last_clean":"2023-10-09T06:58:04.295792+0000","last_became_active":"2023-10-09T06:58:03.280397+0000","last_became_peered":"2023-10-09T06:58:03.280397+0000","last_unstale":"2023-10-09T06:58:04.295792+0000","last_undegraded":"2023-10-09T06:58:04.295792+0000","last_fullsized":"2023-10-09T06:58:04.295792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:08:56.251029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"92'2","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.294274+0000","last_change":"2023-10-09T06:58:03.278338+0000","last_active":"2023-10-09T06:58:04.294274+0000","last_peered":"2023-10-09T06:58:04.294274+0000","last_clean":"2023-10-09T06:58:04.294274+0000","last_became_active":"2023-10-09T06:58:03.278052+0000","last_became_peered":"2023-10-09T06:58:03.278052+0000","last_unstale":"2023-10-09T06:58:04.294274+0000","last_undegraded":"2023-10-09T06:58:04.294274+0000","last_fullsized":"2023-10-09T06:58:04.294274+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:34.825539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.263951+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:01:05.569394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.787196+0000","last_change":"2023-10-09T06:58:03.786093+0000","last_active":"2023-10-09T06:58:03.787196+0000","last_peered":"2023-10-09T06:58:03.787196+0000","last_clean":"2023-10-09T06:58:03.787196+0000","last_became_active":"2023-10-09T06:58:03.785836+0000","last_became_peered":"2023-10-09T06:58:03.785836+0000","last_unstale":"2023-10-09T06:58:03.787196+0000","last_undegraded":"2023-10-09T06:58:03.787196+0000","last_fullsized":"2023-10-09T06:58:03.787196+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:10.559656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.262469+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:25:51.699892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781370+0000","last_change":"2023-10-09T06:58:03.780365+0000","last_active":"2023-10-09T06:58:03.781370+0000","last_peered":"2023-10-09T06:58:03.781370+0000","last_clean":"2023-10-09T06:58:03.781370+0000","last_became_active":"2023-10-09T06:58:03.779868+0000","last_became_peered":"2023-10-09T06:58:03.779868+0000","last_unstale":"2023-10-09T06:58:03.781370+0000","last_undegraded":"2023-10-09T06:58:03.781370+0000","last_fullsized":"2023-10-09T06:58:03.781370+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:29:24.208508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.261059+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:36.489423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.264321+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:08:56.251029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.261138+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:33.198191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.787006+0000","last_change":"2023-10-09T06:58:03.783652+0000","last_active":"2023-10-09T06:58:03.787006+0000","last_peered":"2023-10-09T06:58:03.787006+0000","last_clean":"2023-10-09T06:58:03.787006+0000","last_became_active":"2023-10-09T06:58:03.783398+0000","last_became_peered":"2023-10-09T06:58:03.783398+0000","last_unstale":"2023-10-09T06:58:03.787006+0000","last_undegraded":"2023-10-09T06:58:03.787006+0000","last_fullsized":"2023-10-09T06:58:03.787006+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:18.062792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.262122+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:43:17.950320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.779091+0000","last_change":"2023-10-09T06:58:03.775521+0000","last_active":"2023-10-09T06:58:03.779091+0000","last_peered":"2023-10-09T06:58:03.779091+0000","last_clean":"2023-10-09T06:58:03.779091+0000","last_became_active":"2023-10-09T06:58:03.775284+0000","last_became_peered":"2023-10-09T06:58:03.775284+0000","last_unstale":"2023-10-09T06:58:03.779091+0000","last_undegraded":"2023-10-09T06:58:03.779091+0000","last_fullsized":"2023-10-09T06:58:03.779091+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:01:46.472752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.264678+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:15:55.636242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.778718+0000","last_change":"2023-10-09T06:58:03.777764+0000","last_active":"2023-10-09T06:58:03.778718+0000","last_peered":"2023-10-09T06:58:03.778718+0000","last_clean":"2023-10-09T06:58:03.778718+0000","last_became_active":"2023-10-09T06:58:03.777519+0000","last_became_peered":"2023-10-09T06:58:03.777519+0000","last_unstale":"2023-10-09T06:58:03.778718+0000","last_undegraded":"2023-10-09T06:58:03.778718+0000","last_fullsized":"2023-10-09T06:58:03.778718+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:48.690134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.261963+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:37.352870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.795108+0000","last_change":"2023-10-09T06:58:03.794613+0000","last_active":"2023-10-09T06:58:03.795108+0000","last_peered":"2023-10-09T06:58:03.795108+0000","last_clean":"2023-10-09T06:58:03.795108+0000","last_became_active":"2023-10-09T06:58:03.794396+0000","last_became_peered":"2023-10-09T06:58:03.794396+0000","last_unstale":"2023-10-09T06:58:03.795108+0000","last_undegraded":"2023-10-09T06:58:03.795108+0000","last_fullsized":"2023-10-09T06:58:03.795108+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:05.501958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.261340+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:51:36.270969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.791753+0000","last_change":"2023-10-09T06:58:03.790775+0000","last_active":"2023-10-09T06:58:03.791753+0000","last_peered":"2023-10-09T06:58:03.791753+0000","last_clean":"2023-10-09T06:58:03.791753+0000","last_became_active":"2023-10-09T06:58:03.790517+0000","last_became_peered":"2023-10-09T06:58:03.790517+0000","last_unstale":"2023-10-09T06:58:03.791753+0000","last_undegraded":"2023-10-09T06:58:03.791753+0000","last_fullsized":"2023-10-09T06:58:03.791753+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:38:39.496926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.772648+0000","last_change":"2023-10-09T06:58:03.282068+0000","last_active":"2023-10-09T06:58:03.772648+0000","last_peered":"2023-10-09T06:58:03.772648+0000","last_clean":"2023-10-09T06:58:03.772648+0000","last_became_active":"2023-10-09T06:58:03.281770+0000","last_became_peered":"2023-10-09T06:58:03.281770+0000","last_unstale":"2023-10-09T06:58:03.772648+0000","last_undegraded":"2023-10-09T06:58:03.772648+0000","last_fullsized":"2023-10-09T06:58:03.772648+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:48:10.578960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.784340+0000","last_change":"2023-10-09T06:58:03.782745+0000","last_active":"2023-10-09T06:58:03.784340+0000","last_peered":"2023-10-09T06:58:03.784340+0000","last_clean":"2023-10-09T06:58:03.784340+0000","last_became_active":"2023-10-09T06:58:03.782504+0000","last_became_peered":"2023-10-09T06:58:03.782504+0000","last_unstale":"2023-10-09T06:58:03.784340+0000","last_undegraded":"2023-10-09T06:58:03.784340+0000","last_fullsized":"2023-10-09T06:58:03.784340+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:35.203503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.263774+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:41.417852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.261948+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:43.149451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.776473+0000","last_change":"2023-10-09T06:58:03.282655+0000","last_active":"2023-10-09T06:58:03.776473+0000","last_peered":"2023-10-09T06:58:03.776473+0000","last_clean":"2023-10-09T06:58:03.776473+0000","last_became_active":"2023-10-09T06:58:03.282390+0000","last_became_peered":"2023-10-09T06:58:03.282390+0000","last_unstale":"2023-10-09T06:58:03.776473+0000","last_undegraded":"2023-10-09T06:58:03.776473+0000","last_fullsized":"2023-10-09T06:58:03.776473+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:39:27.910719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.775076+0000","last_change":"2023-10-09T06:58:03.282318+0000","last_active":"2023-10-09T06:58:03.775076+0000","last_peered":"2023-10-09T06:58:03.775076+0000","last_clean":"2023-10-09T06:58:03.775076+0000","last_became_active":"2023-10-09T06:58:03.282067+0000","last_became_peered":"2023-10-09T06:58:03.282067+0000","last_unstale":"2023-10-09T06:58:03.775076+0000","last_undegraded":"2023-10-09T06:58:03.775076+0000","last_fullsized":"2023-10-09T06:58:03.775076+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:54.192461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.782118+0000","last_change":"2023-10-09T06:58:03.780989+0000","last_active":"2023-10-09T06:58:03.782118+0000","last_peered":"2023-10-09T06:58:03.782118+0000","last_clean":"2023-10-09T06:58:03.782118+0000","last_became_active":"2023-10-09T06:58:03.780759+0000","last_became_peered":"2023-10-09T06:58:03.780759+0000","last_unstale":"2023-10-09T06:58:03.782118+0000","last_undegraded":"2023-10-09T06:58:03.782118+0000","last_fullsized":"2023-10-09T06:58:03.782118+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:05.430877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.776139+0000","last_change":"2023-10-09T06:58:03.277955+0000","last_active":"2023-10-09T06:58:03.776139+0000","last_peered":"2023-10-09T06:58:03.776139+0000","last_clean":"2023-10-09T06:58:03.776139+0000","last_became_active":"2023-10-09T06:58:03.277692+0000","last_became_peered":"2023-10-09T06:58:03.277692+0000","last_unstale":"2023-10-09T06:58:03.776139+0000","last_undegraded":"2023-10-09T06:58:03.776139+0000","last_fullsized":"2023-10-09T06:58:03.776139+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:44:10.319004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.775905+0000","last_change":"2023-10-09T06:58:03.279055+0000","last_active":"2023-10-09T06:58:03.775905+0000","last_peered":"2023-10-09T06:58:03.775905+0000","last_clean":"2023-10-09T06:58:03.775905+0000","last_became_active":"2023-10-09T06:58:03.278781+0000","last_became_peered":"2023-10-09T06:58:03.278781+0000","last_unstale":"2023-10-09T06:58:03.775905+0000","last_undegraded":"2023-10-09T06:58:03.775905+0000","last_fullsized":"2023-10-09T06:58:03.775905+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:41.417852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.779579+0000","last_change":"2023-10-09T06:58:03.777888+0000","last_active":"2023-10-09T06:58:03.779579+0000","last_peered":"2023-10-09T06:58:03.779579+0000","last_clean":"2023-10-09T06:58:03.779579+0000","last_became_active":"2023-10-09T06:58:03.777552+0000","last_became_peered":"2023-10-09T06:58:03.777552+0000","last_unstale":"2023-10-09T06:58:03.779579+0000","last_undegraded":"2023-10-09T06:58:03.779579+0000","last_fullsized":"2023-10-09T06:58:03.779579+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:14.217322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.261357+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:13.207974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.262049+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:49:36.085804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.792125+0000","last_change":"2023-10-09T06:58:03.791372+0000","last_active":"2023-10-09T06:58:03.792125+0000","last_peered":"2023-10-09T06:58:03.792125+0000","last_clean":"2023-10-09T06:58:03.792125+0000","last_became_active":"2023-10-09T06:58:03.791000+0000","last_became_peered":"2023-10-09T06:58:03.791000+0000","last_unstale":"2023-10-09T06:58:03.792125+0000","last_undegraded":"2023-10-09T06:58:03.792125+0000","last_fullsized":"2023-10-09T06:58:03.792125+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:35:41.435584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.262384+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:38:41.084580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"82'183","reported_seq":457,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-09T06:58:00.805784+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:58:00.805784+0000","last_peered":"2023-10-09T06:58:00.805784+0000","last_clean":"2023-10-09T06:58:00.805784+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:58:00.805784+0000","last_undegraded":"2023-10-09T06:58:00.805784+0000","last_fullsized":"2023-10-09T06:58:00.805784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":4},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1660,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575035,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303024,"kb_used_data":1640,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068816,"statfs":{"total":96636764160,"available":96326467584,"internally_reserved":0,"allocated":1679360,"data_stored":1112406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68400000000000005,"15min":0.70799999999999996},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.316},"max":{"1min":0.81100000000000005,"5min":1.732,"15min":1.9490000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.44,"5min":0.40200000000000002,"15min":0.29999999999999999},"max":{"1min":0.83299999999999996,"5min":1.22,"15min":3.448},"last":0.71799999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.504,"5min":0.437,"15min":0.379},"max":{"1min":0.86799999999999999,"5min":2.3559999999999999,"15min":5.617},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.46999999999999997,"5min":0.45800000000000002,"15min":0.40200000000000002},"max":{"1min":0.97599999999999998,"5min":1.7869999999999999,"15min":2.016},"last":0.627}]},{"osd":2,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.72999999999999998,"15min":0.73899999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.44800000000000001},"max":{"1min":0.97999999999999998,"5min":1.9430000000000001,"15min":2.052},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.73799999999999999,"15min":0.75600000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.44700000000000001},"max":{"1min":0.82399999999999995,"5min":2.6629999999999998,"15min":3.5019999999999998},"last":0.79700000000000004}]},{"osd":3,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.73899999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.45000000000000001},"max":{"1min":0.97099999999999997,"5min":1.03,"15min":5.5800000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.746,"15min":0.78100000000000003},"min":{"1min":0.50800000000000001,"5min":0.496,"15min":0.47099999999999997},"max":{"1min":0.89800000000000002,"5min":1.827,"15min":6.9299999999999997},"last":0.74199999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.91000000000000003,"5min":0.95499999999999996,"15min":3.125},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.66500000000000004},"min":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1850000000000001,"5min":2.577,"15min":4.8380000000000001},"last":0.67000000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68700000000000006,"15min":0.68100000000000005},"min":{"1min":0.441,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":1.0309999999999999,"5min":2.5169999999999999,"15min":4.1929999999999996},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.5,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":2.9590000000000001,"15min":3.6749999999999998},"last":0.84099999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0449999999999999,"5min":3.0019999999999998,"15min":4.0250000000000004},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72699999999999998,"15min":0.752},"min":{"1min":0.498,"5min":0.47399999999999998,"15min":0.44700000000000001},"max":{"1min":1.0740000000000001,"5min":2.4039999999999999,"15min":7.0259999999999998},"last":0.81699999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575034,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302444,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069396,"statfs":{"total":96636764160,"available":96327061504,"internally_reserved":0,"allocated":1085440,"data_stored":522038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69699999999999995,"15min":0.71099999999999997},"min":{"1min":0.52100000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85599999999999998,"5min":0.97899999999999998,"15min":1.022},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69099999999999995,"15min":0.70199999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.36599999999999999},"max":{"1min":0.80100000000000005,"5min":0.93899999999999995,"15min":1.079},"last":0.66300000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70599999999999996,"15min":0.72199999999999998},"min":{"1min":0.47699999999999998,"5min":0.44800000000000001,"15min":0.42799999999999999},"max":{"1min":0.90400000000000003,"5min":1.135,"15min":1.135},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70599999999999996,"15min":0.72399999999999998},"min":{"1min":0.56899999999999995,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83899999999999997,"5min":1.0109999999999999,"15min":1.034},"last":0.71099999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.58999999999999997,"5min":0.49199999999999999,"15min":0.42599999999999999},"max":{"1min":0.86899999999999999,"5min":1.391,"15min":1.391},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.51900000000000002,"5min":0.48899999999999999,"15min":0.45200000000000001},"max":{"1min":0.85899999999999999,"5min":0.95499999999999996,"15min":1.0900000000000001},"last":0.90500000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68300000000000005,"15min":0.69799999999999995},"min":{"1min":0.52600000000000002,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.82699999999999996,"5min":0.91700000000000004,"15min":1.046},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.497},"max":{"1min":0.86499999999999999,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.82999999999999996}]},{"osd":4,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.42099999999999999,"5min":0.38,"15min":0.377},"max":{"1min":0.73399999999999999,"5min":1.768,"15min":1.768},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.437,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77700000000000002,"5min":1.601,"15min":1.601},"last":0.73899999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.46600000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.876,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.68100000000000005,"15min":0.69299999999999995},"min":{"1min":0.47699999999999998,"5min":0.44600000000000001,"15min":0.42299999999999999},"max":{"1min":0.77500000000000002,"5min":0.99299999999999999,"15min":1.0669999999999999},"last":0.75700000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.66600000000000004,"15min":0.67700000000000005},"min":{"1min":0.48699999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79400000000000004,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.45300000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83999999999999997,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.79900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302512,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069328,"statfs":{"total":96636764160,"available":96326991872,"internally_reserved":0,"allocated":1155072,"data_stored":550849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.27600000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59399999999999997,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.503,"5min":0.49199999999999999,"15min":0.48299999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.23699999999999999},"max":{"1min":1.083,"5min":1.23,"15min":1.23},"last":0.32600000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.29599999999999999},"max":{"1min":0.68500000000000005,"5min":1.169,"15min":1.169},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.439,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":3.077,"15min":3.077},"last":0.56899999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.40000000000000002,"5min":0.376,"15min":0.34100000000000003},"max":{"1min":0.76000000000000001,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.39100000000000001,"5min":0.34899999999999998,"15min":0.34100000000000003},"max":{"1min":1.056,"5min":1.605,"15min":1.605},"last":0.36099999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73899999999999999,"15min":0.76100000000000001},"min":{"1min":0.497,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.89900000000000002,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.75800000000000001,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93999999999999995,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.72299999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75800000000000001,"15min":0.77400000000000002},"min":{"1min":0.55000000000000004,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.3140000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75900000000000001,"15min":0.78100000000000003},"min":{"1min":0.54500000000000004,"5min":0.497,"15min":0.47999999999999998},"max":{"1min":0.95799999999999996,"5min":1.637,"15min":1.637},"last":0.65200000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78700000000000003,"15min":0.79600000000000004},"min":{"1min":0.54600000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97899999999999998,"5min":1.696,"15min":1.696},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78600000000000003,"15min":0.79700000000000004},"min":{"1min":0.54600000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1679999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81999999999999995,"15min":0.82599999999999996},"min":{"1min":0.55500000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1479999999999999,"5min":1.2669999999999999,"15min":1.4510000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79800000000000004,"15min":0.82299999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98699999999999999,"5min":1.125,"15min":1.1970000000000001},"last":0.69099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575035,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298976,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072864,"statfs":{"total":96636764160,"available":96330612736,"internally_reserved":0,"allocated":1728512,"data_stored":1139093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.29299999999999998,"5min":0.27100000000000002,"15min":0.23000000000000001},"max":{"1min":0.623,"5min":0.85799999999999998,"15min":1.2729999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.28899999999999998},"max":{"1min":0.60399999999999998,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":0.47499999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.63400000000000001,"5min":4.6980000000000004,"15min":4.6980000000000004},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48999999999999999,"15min":0.497},"min":{"1min":0.34000000000000002,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.71799999999999997,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.41499999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":0.63800000000000001,"5min":1.2450000000000001,"15min":1.7130000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.441,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":0.70199999999999996,"5min":4.734,"15min":4.734},"last":0.498}]},{"osd":4,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.52900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99199999999999999,"5min":1.2270000000000001,"15min":1.752},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.50700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.91500000000000004,"5min":4.6619999999999999,"15min":4.6619999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.53700000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0049999999999999,"5min":1.1890000000000001,"15min":1.2769999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.58699999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90300000000000002,"5min":1.2809999999999999,"15min":1.7889999999999999},"last":0.81699999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.80500000000000005,"15min":0.81299999999999994},"min":{"1min":0.56499999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97299999999999998,"5min":4.6239999999999997,"15min":4.6239999999999997},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79300000000000004,"15min":0.80100000000000005},"min":{"1min":0.55600000000000005,"5min":0.50800000000000001,"15min":0.47999999999999998},"max":{"1min":0.96499999999999997,"5min":1.2689999999999999,"15min":1.4370000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.82499999999999996,"15min":0.83199999999999996},"min":{"1min":0.56299999999999994,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.042,"5min":1.256,"15min":1.518},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.621,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95599999999999996,"5min":1.702,"15min":1.8200000000000001},"last":0.753}]}]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306600,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065240,"statfs":{"total":96636764160,"available":96322805760,"internally_reserved":0,"allocated":1146880,"data_stored":550261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.46800000000000003,"15min":0.45400000000000001},"min":{"1min":0.28299999999999997,"5min":0.26500000000000001,"15min":0.25900000000000001},"max":{"1min":0.76700000000000002,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.48999999999999999,"15min":0.495},"min":{"1min":0.30599999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.55300000000000005,"5min":1.633,"15min":1.633},"last":0.38800000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46400000000000002,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71599999999999997,"5min":1.097,"15min":1.865},"last":0.371},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.79700000000000004,"5min":1.2689999999999999,"15min":1.79},"last":0.45400000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.58899999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.35799999999999998},"max":{"1min":0.82599999999999996,"5min":0.86699999999999999,"15min":1.8999999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.47399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70299999999999996,"5min":1.1890000000000001,"15min":1.8220000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":0.85799999999999998,"5min":1.2430000000000001,"15min":1.256},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.55000000000000004,"5min":0.45900000000000002,"15min":0.44800000000000001},"max":{"1min":0.91400000000000003,"5min":1.696,"15min":1.696},"last":0.77800000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.753,"15min":0.76800000000000002},"min":{"1min":0.505,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85199999999999998,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.503},"max":{"1min":0.83199999999999996,"5min":1.218,"15min":1.3440000000000001},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.54000000000000004,"5min":0.51000000000000001,"15min":0.48599999999999999},"max":{"1min":0.94899999999999995,"5min":1.768,"15min":1.768},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.76400000000000001,"15min":0.79000000000000004},"min":{"1min":0.56599999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92900000000000005,"5min":1.3580000000000001,"15min":1.5309999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.61799999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97799999999999998,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.58699999999999997,"5min":0.57599999999999996,"15min":0.50900000000000001},"max":{"1min":0.92000000000000004,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.621}]}]},{"osd":3,"up_from":13,"seq":55834575036,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306596,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065244,"statfs":{"total":96636764160,"available":96322809856,"internally_reserved":0,"allocated":1142784,"data_stored":548837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.29599999999999999,"5min":0.29499999999999998,"15min":0.24099999999999999},"max":{"1min":0.86299999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.47899999999999998,"15min":0.48799999999999999},"min":{"1min":0.315,"5min":0.30199999999999999,"15min":0.28100000000000003},"max":{"1min":0.63600000000000001,"5min":1.228,"15min":1.228},"last":0.498}]},{"osd":1,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.48099999999999998,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58699999999999997,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.379}]},{"osd":2,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94099999999999995,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64800000000000002,"15min":0.63300000000000001},"min":{"1min":0.44400000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.97699999999999998,"5min":3.8900000000000001,"15min":3.8900000000000001},"last":0.56899999999999995}]},{"osd":4,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.51100000000000001,"5min":0.48299999999999998,"15min":0.40799999999999997},"max":{"1min":0.76500000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.81000000000000005,"15min":0.82299999999999995},"min":{"1min":0.623,"5min":0.59399999999999997,"15min":0.52200000000000002},"max":{"1min":1.0189999999999999,"5min":1.22,"15min":1.22},"last":0.77000000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.45000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.86199999999999999,"5min":1.3360000000000001,"15min":2.1549999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.56399999999999995,"5min":0.55900000000000005,"15min":0.50600000000000001},"max":{"1min":1.0569999999999999,"5min":1.1639999999999999,"15min":1.419},"last":0.68500000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.51700000000000002},"max":{"1min":0.875,"5min":1.304,"15min":1.304},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95199999999999996,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.69899999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91100000000000003,"5min":1.8180000000000001,"15min":2.0880000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.80800000000000005,"15min":0.82099999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92300000000000004,"5min":1.486,"15min":1.486},"last":0.77800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575034,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310648,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061192,"statfs":{"total":96636764160,"available":96318660608,"internally_reserved":0,"allocated":1097728,"data_stored":528235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71399999999999997,"15min":0.70399999999999996},"min":{"1min":0.45000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79200000000000004,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.72799999999999998,"15min":0.72299999999999998},"min":{"1min":0.50900000000000001,"5min":0.42699999999999999,"15min":0.39300000000000002},"max":{"1min":0.97399999999999998,"5min":2.8130000000000002,"15min":3.23},"last":0.66700000000000004}]},{"osd":1,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71899999999999997,"15min":0.71099999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.373},"max":{"1min":0.85699999999999998,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.53000000000000003,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.86499999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.56000000000000005}]},{"osd":2,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.755,"15min":0.75700000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.38100000000000001},"max":{"1min":0.92900000000000005,"5min":2.5960000000000001,"15min":3.7509999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.48299999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90000000000000002,"5min":2.427,"15min":2.427},"last":0.53500000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.755,"15min":0.751},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.434},"max":{"1min":0.89700000000000002,"5min":2.6440000000000001,"15min":3.6970000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.77000000000000002,"15min":0.747},"min":{"1min":0.443,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":3.6899999999999999,"15min":3.6899999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63600000000000001,"15min":0.60899999999999999},"min":{"1min":0.379,"5min":0.317,"15min":0.317},"max":{"1min":0.84899999999999998,"5min":3.3860000000000001,"15min":3.4780000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.68999999999999995,"15min":0.65800000000000003},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.34999999999999998},"max":{"1min":0.91200000000000003,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.64100000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67100000000000004,"15min":0.64000000000000001},"min":{"1min":0.47699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82299999999999995,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.63},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.71499999999999997,"15min":0.67900000000000005},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.374},"max":{"1min":0.89100000000000001,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.51200000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.49299999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.96599999999999997,"5min":2.7210000000000001,"15min":3.2789999999999999},"last":0.621},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.76900000000000002},"min":{"1min":0.56499999999999995,"5min":0.439,"15min":0.439},"max":{"1min":0.93600000000000005,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.65200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":1097728,"data_stored":528235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67600000000000005,"15min":0.69699999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.72299999999999998,"5min":0.93600000000000005,"15min":1.655},"last":0.752},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65700000000000003,"15min":0.68400000000000005},"min":{"1min":0.42899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78200000000000003,"5min":1.0269999999999999,"15min":1.1359999999999999},"last":0.47299999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71699999999999997,"5min":0.96899999999999997,"15min":2.4159999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.45400000000000001,"5min":0.44,"15min":0.40400000000000003},"max":{"1min":0.89100000000000001,"5min":0.95099999999999996,"15min":1.706},"last":0.52100000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69699999999999995,"15min":0.72799999999999998},"min":{"1min":0.501,"5min":0.48499999999999999,"15min":0.42999999999999999},"max":{"1min":0.75800000000000001,"5min":0.997,"15min":1.79},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69699999999999995,"15min":0.71599999999999997},"min":{"1min":0.49199999999999999,"5min":0.46500000000000002,"15min":0.442},"max":{"1min":0.752,"5min":1.006,"15min":2.4889999999999999},"last":0.81799999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68999999999999995,"15min":0.71699999999999997},"min":{"1min":0.46899999999999997,"5min":0.438,"15min":0.435},"max":{"1min":0.88600000000000001,"5min":1.0209999999999999,"15min":1.409},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73899999999999999,"15min":0.76900000000000002},"min":{"1min":0.56200000000000006,"5min":0.501,"15min":0.501},"max":{"1min":0.78600000000000003,"5min":0.95699999999999996,"15min":2.532},"last":0.77300000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":1.766},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.622,"15min":0.621},"min":{"1min":0.48599999999999999,"5min":0.377,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":1.052,"15min":2.7829999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.45100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82899999999999996,"5min":1.018,"15min":2.5739999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.40000000000000002,"15min":0.38900000000000001},"max":{"1min":0.84099999999999997,"5min":0.97999999999999998,"15min":1.8080000000000001},"last":0.84699999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.90700000000000003,"5min":1.175,"15min":2.9609999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.60499999999999998,"5min":0.498,"15min":0.45900000000000002},"max":{"1min":0.876,"5min":1.139,"15min":2.613},"last":0.88300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:58:09.084 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:58:09.244 INFO:tasks.ceph.mds.c.smithi071.stderr:2023-10-09T06:58:09.243+0000 7f1d197f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:58:09.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.292+0000 7f3e825ff700 1 Processor -- start 2023-10-09T06:58:09.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.292+0000 7f3e825ff700 1 -- start start 2023-10-09T06:58:09.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.293+0000 7f3e825ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e7c0b1c20 0x7f3e7c1572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:09.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.293+0000 7f3e825ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3e7c157820 0x7f3e7c0abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:09.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.293+0000 7f3e825ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e7c157c80 con 0x7f3e7c0b1850 2023-10-09T06:58:09.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.293+0000 7f3e825ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e7c06fc30 con 0x7f3e7c157820 2023-10-09T06:58:09.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.293+0000 7f3e825ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c0cc260 con 0x7f3e7c0b1c20 2023-10-09T06:58:09.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.293+0000 7f3e80b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3e7c157820 0x7f3e7c0abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:09.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.294+0000 7f3e80b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3e7c157820 0x7f3e7c0abf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59956/0 (socket says 172.21.15.71:59956) 2023-10-09T06:58:09.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.294+0000 7f3e80b9c700 1 -- 172.21.15.71:0/3751639552 learned_addr learned my addr 172.21.15.71:0/3751639552 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:09.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.294+0000 7f3e7b7fe700 1 --2- 172.21.15.71:0/3751639552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e7c0b1c20 0x7f3e7c1572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:09.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.294+0000 7f3e80b9c700 1 -- 172.21.15.71:0/3751639552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e7c0b1c20 msgr2=0x7f3e7c1572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:09.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.294+0000 7f3e80b9c700 1 --2- 172.21.15.71:0/3751639552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e7c0b1c20 0x7f3e7c1572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:09.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.294+0000 7f3e80b9c700 1 -- 172.21.15.71:0/3751639552 >> v1:172.21.15.179:6789/0 conn(0x7f3e7c0b1850 legacy=0x7f3e7c0ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:09.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.294+0000 7f3e80b9c700 1 -- 172.21.15.71:0/3751639552 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c0cb300 con 0x7f3e7c157820 2023-10-09T06:58:09.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.294+0000 7f3e80b9c700 1 --2- 172.21.15.71:0/3751639552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e7c157820 0x7f3e7c0abf60 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f3e74009f20 tx=0x7f3e74009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f325c5b29f4b67 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:09.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.294+0000 7f3e7affd700 1 -- 172.21.15.71:0/3751639552 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7400e070 con 0x7f3e7c157820 2023-10-09T06:58:09.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.295+0000 7f3e7affd700 1 -- 172.21.15.71:0/3751639552 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7400b9d0 con 0x7f3e7c157820 2023-10-09T06:58:09.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.295+0000 7f3e7affd700 1 -- 172.21.15.71:0/3751639552 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e740092e0 con 0x7f3e7c157820 2023-10-09T06:58:09.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.295+0000 7f3e825ff700 1 -- 172.21.15.71:0/3751639552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e7c157820 msgr2=0x7f3e7c0abf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:09.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.295+0000 7f3e825ff700 1 --2- 172.21.15.71:0/3751639552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e7c157820 0x7f3e7c0abf60 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f3e74009f20 tx=0x7f3e74009840 comp rx=0 tx=0).stop 2023-10-09T06:58:09.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.295+0000 7f3e825ff700 1 -- 172.21.15.71:0/3751639552 shutdown_connections 2023-10-09T06:58:09.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.295+0000 7f3e825ff700 1 --2- 172.21.15.71:0/3751639552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e7c157820 0x7f3e7c0abf60 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:09.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.295+0000 7f3e825ff700 1 --2- 172.21.15.71:0/3751639552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e7c0b1c20 0x7f3e7c1572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:09.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.295+0000 7f3e825ff700 1 -- 172.21.15.71:0/3751639552 >> 172.21.15.71:0/3751639552 conn(0x7f3e7c06a320 msgr2=0x7f3e7c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:09.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.295+0000 7f3e825ff700 1 -- 172.21.15.71:0/3751639552 shutdown_connections 2023-10-09T06:58:09.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.295+0000 7f3e825ff700 1 -- 172.21.15.71:0/3751639552 wait complete. 2023-10-09T06:58:09.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.297+0000 7f3e825ff700 1 Processor -- start 2023-10-09T06:58:09.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.297+0000 7f3e825ff700 1 -- start start 2023-10-09T06:58:09.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.298+0000 7f3e825ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e7c0b1850 0x7f3e7c15c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:09.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.298+0000 7f3e825ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e7c0b1c20 0x7f3e7c14b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:09.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.298+0000 7f3e825ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e7c157820 0x7f3e7c150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:09.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.298+0000 7f3e825ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c150140 con 0x7f3e7c0b1850 2023-10-09T06:58:09.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.298+0000 7f3e825ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c15c7f0 con 0x7f3e7c157820 2023-10-09T06:58:09.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.298+0000 7f3e825ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c15cce0 con 0x7f3e7c0b1c20 2023-10-09T06:58:09.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.298+0000 7f3e7bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e7c0b1850 0x7f3e7c15c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:09.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.298+0000 7f3e7bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e7c0b1850 0x7f3e7c15c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59970/0 (socket says 172.21.15.71:59970) 2023-10-09T06:58:09.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.298+0000 7f3e7bfff700 1 -- 172.21.15.71:0/4160490738 learned_addr learned my addr 172.21.15.71:0/4160490738 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:09.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.298+0000 7f3e7bfff700 1 -- 172.21.15.71:0/4160490738 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e7c0b1c20 msgr2=0x7f3e7c14b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:09.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.298+0000 7f3e7bfff700 1 --2- 172.21.15.71:0/4160490738 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e7c0b1c20 0x7f3e7c14b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:09.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.298+0000 7f3e7bfff700 1 -- 172.21.15.71:0/4160490738 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e7c157820 msgr2=0x7f3e7c150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:09.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.298+0000 7f3e80b9c700 1 --2- 172.21.15.71:0/4160490738 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e7c157820 0x7f3e7c150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:09.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.298+0000 7f3e7bfff700 1 --2- 172.21.15.71:0/4160490738 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e7c157820 0x7f3e7c150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:09.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.298+0000 7f3e7bfff700 1 -- 172.21.15.71:0/4160490738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e74009ae0 con 0x7f3e7c0b1850 2023-10-09T06:58:09.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.298+0000 7f3e80b9c700 1 --2- 172.21.15.71:0/4160490738 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e7c157820 0x7f3e7c150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:09.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.299+0000 7f3e7bfff700 1 --2- 172.21.15.71:0/4160490738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e7c0b1850 0x7f3e7c15c2b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00c590 tx=0x7f3e6c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:09.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.299+0000 7f3e63fff700 1 -- 172.21.15.71:0/4160490738 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c011590 con 0x7f3e7c0b1850 2023-10-09T06:58:09.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.299+0000 7f3e63fff700 1 -- 172.21.15.71:0/4160490738 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6c0116f0 con 0x7f3e7c0b1850 2023-10-09T06:58:09.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.299+0000 7f3e63fff700 1 -- 172.21.15.71:0/4160490738 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c011ab0 con 0x7f3e7c0b1850 2023-10-09T06:58:09.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.299+0000 7f3e825ff700 1 -- 172.21.15.71:0/4160490738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7c14b9b0 con 0x7f3e7c0b1850 2023-10-09T06:58:09.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.299+0000 7f3e825ff700 1 -- 172.21.15.71:0/4160490738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7c169cf0 con 0x7f3e7c0b1850 2023-10-09T06:58:09.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.300+0000 7f3e825ff700 1 -- 172.21.15.71:0/4160490738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e7c04c3c0 con 0x7f3e7c0b1850 2023-10-09T06:58:09.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.301+0000 7f3e63fff700 1 -- 172.21.15.71:0/4160490738 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e6c01b3b0 con 0x7f3e7c0b1850 2023-10-09T06:58:09.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.301+0000 7f3e63fff700 1 --2- 172.21.15.71:0/4160490738 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3e68066f30 0x7f3e680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:09.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.302+0000 7f3e63fff700 1 -- 172.21.15.71:0/4160490738 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f3e6c083c70 con 0x7f3e7c0b1850 2023-10-09T06:58:09.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.302+0000 7f3e7b7fe700 1 --2- 172.21.15.71:0/4160490738 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3e68066f30 0x7f3e680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:09.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.303+0000 7f3e7b7fe700 1 --2- 172.21.15.71:0/4160490738 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3e68066f30 0x7f3e680693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c14eed0 tx=0x7f3e700091a0 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:09.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.305+0000 7f3e63fff700 1 -- 172.21.15.71:0/4160490738 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e6c050d50 con 0x7f3e7c0b1850 2023-10-09T06:58:09.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.491+0000 7f3e825ff700 1 -- 172.21.15.71:0/4160490738 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3e7c0cb5e0 con 0x7f3e68066f30 2023-10-09T06:58:09.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.500+0000 7f3e63fff700 1 -- 172.21.15.71:0/4160490738 <== mgr.6274 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283278 (secure 0 0 0) 0x7f3e7c0cb5e0 con 0x7f3e68066f30 2023-10-09T06:58:09.506 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:09.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.504+0000 7f3e825ff700 1 -- 172.21.15.71:0/4160490738 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3e68066f30 msgr2=0x7f3e680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:09.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.504+0000 7f3e825ff700 1 --2- 172.21.15.71:0/4160490738 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3e68066f30 0x7f3e680693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c14eed0 tx=0x7f3e700091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:09.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.504+0000 7f3e825ff700 1 -- 172.21.15.71:0/4160490738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e7c0b1850 msgr2=0x7f3e7c15c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:09.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.504+0000 7f3e825ff700 1 --2- 172.21.15.71:0/4160490738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e7c0b1850 0x7f3e7c15c2b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00c590 tx=0x7f3e6c00c950 comp rx=0 tx=0).stop 2023-10-09T06:58:09.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.505+0000 7f3e825ff700 1 -- 172.21.15.71:0/4160490738 shutdown_connections 2023-10-09T06:58:09.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.505+0000 7f3e825ff700 1 --2- 172.21.15.71:0/4160490738 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e7c157820 0x7f3e7c150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:09.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.505+0000 7f3e825ff700 1 --2- 172.21.15.71:0/4160490738 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3e68066f30 0x7f3e680693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:09.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.505+0000 7f3e825ff700 1 --2- 172.21.15.71:0/4160490738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e7c0b1850 0x7f3e7c15c2b0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:09.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.505+0000 7f3e825ff700 1 --2- 172.21.15.71:0/4160490738 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e7c0b1c20 0x7f3e7c14b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:09.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.505+0000 7f3e825ff700 1 -- 172.21.15.71:0/4160490738 >> 172.21.15.71:0/4160490738 conn(0x7f3e7c06a320 msgr2=0x7f3e7c068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:09.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.505+0000 7f3e825ff700 1 -- 172.21.15.71:0/4160490738 shutdown_connections 2023-10-09T06:58:09.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.505+0000 7f3e825ff700 1 -- 172.21.15.71:0/4160490738 wait complete. 2023-10-09T06:58:09.513 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:58:09.523 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T06:58:08.029718+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592028,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":292,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2433256,"kb_used_data":9896,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752541464,"statfs":{"total":773094113280,"available":770602459136,"internally_reserved":0,"allocated":10133504,"data_stored":5479954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1660,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.772335"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781741+0000","last_change":"2023-10-09T06:58:03.778823+0000","last_active":"2023-10-09T06:58:03.781741+0000","last_peered":"2023-10-09T06:58:03.781741+0000","last_clean":"2023-10-09T06:58:03.781741+0000","last_became_active":"2023-10-09T06:58:03.778577+0000","last_became_peered":"2023-10-09T06:58:03.778577+0000","last_unstale":"2023-10-09T06:58:03.781741+0000","last_undegraded":"2023-10-09T06:58:03.781741+0000","last_fullsized":"2023-10-09T06:58:03.781741+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:19.132641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.791624+0000","last_change":"2023-10-09T06:58:03.790890+0000","last_active":"2023-10-09T06:58:03.791624+0000","last_peered":"2023-10-09T06:58:03.791624+0000","last_clean":"2023-10-09T06:58:03.791624+0000","last_became_active":"2023-10-09T06:58:03.790601+0000","last_became_peered":"2023-10-09T06:58:03.790601+0000","last_unstale":"2023-10-09T06:58:03.791624+0000","last_undegraded":"2023-10-09T06:58:03.791624+0000","last_fullsized":"2023-10-09T06:58:03.791624+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:39.273916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.788534+0000","last_change":"2023-10-09T06:58:03.787537+0000","last_active":"2023-10-09T06:58:03.788534+0000","last_peered":"2023-10-09T06:58:03.788534+0000","last_clean":"2023-10-09T06:58:03.788534+0000","last_became_active":"2023-10-09T06:58:03.787261+0000","last_became_peered":"2023-10-09T06:58:03.787261+0000","last_unstale":"2023-10-09T06:58:03.788534+0000","last_undegraded":"2023-10-09T06:58:03.788534+0000","last_fullsized":"2023-10-09T06:58:03.788534+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:49:37.095152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781603+0000","last_change":"2023-10-09T06:58:03.779446+0000","last_active":"2023-10-09T06:58:03.781603+0000","last_peered":"2023-10-09T06:58:03.781603+0000","last_clean":"2023-10-09T06:58:03.781603+0000","last_became_active":"2023-10-09T06:58:03.779142+0000","last_became_peered":"2023-10-09T06:58:03.779142+0000","last_unstale":"2023-10-09T06:58:03.781603+0000","last_undegraded":"2023-10-09T06:58:03.781603+0000","last_fullsized":"2023-10-09T06:58:03.781603+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:42.427200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.786488+0000","last_change":"2023-10-09T06:58:03.783075+0000","last_active":"2023-10-09T06:58:03.786488+0000","last_peered":"2023-10-09T06:58:03.786488+0000","last_clean":"2023-10-09T06:58:03.786488+0000","last_became_active":"2023-10-09T06:58:03.782836+0000","last_became_peered":"2023-10-09T06:58:03.782836+0000","last_unstale":"2023-10-09T06:58:03.786488+0000","last_undegraded":"2023-10-09T06:58:03.786488+0000","last_fullsized":"2023-10-09T06:58:03.786488+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:27.010548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.788787+0000","last_change":"2023-10-09T06:58:03.788199+0000","last_active":"2023-10-09T06:58:03.788787+0000","last_peered":"2023-10-09T06:58:03.788787+0000","last_clean":"2023-10-09T06:58:03.788787+0000","last_became_active":"2023-10-09T06:58:03.787893+0000","last_became_peered":"2023-10-09T06:58:03.787893+0000","last_unstale":"2023-10-09T06:58:03.788787+0000","last_undegraded":"2023-10-09T06:58:03.788787+0000","last_fullsized":"2023-10-09T06:58:03.788787+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:44.586446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.778194+0000","last_change":"2023-10-09T06:58:03.774830+0000","last_active":"2023-10-09T06:58:03.778194+0000","last_peered":"2023-10-09T06:58:03.778194+0000","last_clean":"2023-10-09T06:58:03.778194+0000","last_became_active":"2023-10-09T06:58:03.774540+0000","last_became_peered":"2023-10-09T06:58:03.774540+0000","last_unstale":"2023-10-09T06:58:03.778194+0000","last_undegraded":"2023-10-09T06:58:03.778194+0000","last_fullsized":"2023-10-09T06:58:03.778194+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:55.445121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.784320+0000","last_change":"2023-10-09T06:58:03.782721+0000","last_active":"2023-10-09T06:58:03.784320+0000","last_peered":"2023-10-09T06:58:03.784320+0000","last_clean":"2023-10-09T06:58:03.784320+0000","last_became_active":"2023-10-09T06:58:03.782471+0000","last_became_peered":"2023-10-09T06:58:03.782471+0000","last_unstale":"2023-10-09T06:58:03.784320+0000","last_undegraded":"2023-10-09T06:58:03.784320+0000","last_fullsized":"2023-10-09T06:58:03.784320+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:01.380815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781583+0000","last_change":"2023-10-09T06:58:03.778825+0000","last_active":"2023-10-09T06:58:03.781583+0000","last_peered":"2023-10-09T06:58:03.781583+0000","last_clean":"2023-10-09T06:58:03.781583+0000","last_became_active":"2023-10-09T06:58:03.778586+0000","last_became_peered":"2023-10-09T06:58:03.778586+0000","last_unstale":"2023-10-09T06:58:03.781583+0000","last_undegraded":"2023-10-09T06:58:03.781583+0000","last_fullsized":"2023-10-09T06:58:03.781583+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:38:42.093928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.792047+0000","last_change":"2023-10-09T06:58:03.790976+0000","last_active":"2023-10-09T06:58:03.792047+0000","last_peered":"2023-10-09T06:58:03.792047+0000","last_clean":"2023-10-09T06:58:03.792047+0000","last_became_active":"2023-10-09T06:58:03.790611+0000","last_became_peered":"2023-10-09T06:58:03.790611+0000","last_unstale":"2023-10-09T06:58:03.792047+0000","last_undegraded":"2023-10-09T06:58:03.792047+0000","last_fullsized":"2023-10-09T06:58:03.792047+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:45:13.736492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.783595+0000","last_change":"2023-10-09T06:58:03.780575+0000","last_active":"2023-10-09T06:58:03.783595+0000","last_peered":"2023-10-09T06:58:03.783595+0000","last_clean":"2023-10-09T06:58:03.783595+0000","last_became_active":"2023-10-09T06:58:03.780287+0000","last_became_peered":"2023-10-09T06:58:03.780287+0000","last_unstale":"2023-10-09T06:58:03.783595+0000","last_undegraded":"2023-10-09T06:58:03.783595+0000","last_fullsized":"2023-10-09T06:58:03.783595+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:50.836527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.780921+0000","last_change":"2023-10-09T06:58:03.778338+0000","last_active":"2023-10-09T06:58:03.780921+0000","last_peered":"2023-10-09T06:58:03.780921+0000","last_clean":"2023-10-09T06:58:03.780921+0000","last_became_active":"2023-10-09T06:58:03.778095+0000","last_became_peered":"2023-10-09T06:58:03.778095+0000","last_unstale":"2023-10-09T06:58:03.780921+0000","last_undegraded":"2023-10-09T06:58:03.780921+0000","last_fullsized":"2023-10-09T06:58:03.780921+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:50.836527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.777660+0000","last_change":"2023-10-09T06:58:03.775523+0000","last_active":"2023-10-09T06:58:03.777660+0000","last_peered":"2023-10-09T06:58:03.777660+0000","last_clean":"2023-10-09T06:58:03.777660+0000","last_became_active":"2023-10-09T06:58:03.775252+0000","last_became_peered":"2023-10-09T06:58:03.775252+0000","last_unstale":"2023-10-09T06:58:03.777660+0000","last_undegraded":"2023-10-09T06:58:03.777660+0000","last_fullsized":"2023-10-09T06:58:03.777660+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:33:52.454840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.265327+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:47:53.051745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781593+0000","last_change":"2023-10-09T06:58:03.779335+0000","last_active":"2023-10-09T06:58:03.781593+0000","last_peered":"2023-10-09T06:58:03.781593+0000","last_clean":"2023-10-09T06:58:03.781593+0000","last_became_active":"2023-10-09T06:58:03.779073+0000","last_became_peered":"2023-10-09T06:58:03.779073+0000","last_unstale":"2023-10-09T06:58:03.781593+0000","last_undegraded":"2023-10-09T06:58:03.781593+0000","last_fullsized":"2023-10-09T06:58:03.781593+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:35.834887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"92'1","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.290439+0000","last_change":"2023-10-09T06:58:03.281341+0000","last_active":"2023-10-09T06:58:04.290439+0000","last_peered":"2023-10-09T06:58:04.290439+0000","last_clean":"2023-10-09T06:58:04.290439+0000","last_became_active":"2023-10-09T06:58:03.281014+0000","last_became_peered":"2023-10-09T06:58:03.281014+0000","last_unstale":"2023-10-09T06:58:04.290439+0000","last_undegraded":"2023-10-09T06:58:04.290439+0000","last_fullsized":"2023-10-09T06:58:04.290439+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:50:35.632368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.261063+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:02.609888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.262290+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:34.825539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"92'1","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.290920+0000","last_change":"2023-10-09T06:58:03.274347+0000","last_active":"2023-10-09T06:58:04.290920+0000","last_peered":"2023-10-09T06:58:04.290920+0000","last_clean":"2023-10-09T06:58:04.290920+0000","last_became_active":"2023-10-09T06:58:03.274034+0000","last_became_peered":"2023-10-09T06:58:03.274034+0000","last_unstale":"2023-10-09T06:58:04.290920+0000","last_undegraded":"2023-10-09T06:58:04.290920+0000","last_fullsized":"2023-10-09T06:58:04.290920+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:06.817917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.264758+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:52:54.289694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.780519+0000","last_change":"2023-10-09T06:58:03.778295+0000","last_active":"2023-10-09T06:58:03.780519+0000","last_peered":"2023-10-09T06:58:03.780519+0000","last_clean":"2023-10-09T06:58:03.780519+0000","last_became_active":"2023-10-09T06:58:03.777990+0000","last_became_peered":"2023-10-09T06:58:03.777990+0000","last_unstale":"2023-10-09T06:58:03.780519+0000","last_undegraded":"2023-10-09T06:58:03.780519+0000","last_fullsized":"2023-10-09T06:58:03.780519+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:38.362218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.776114+0000","last_change":"2023-10-09T06:58:03.278385+0000","last_active":"2023-10-09T06:58:03.776114+0000","last_peered":"2023-10-09T06:58:03.776114+0000","last_clean":"2023-10-09T06:58:03.776114+0000","last_became_active":"2023-10-09T06:58:03.278063+0000","last_became_peered":"2023-10-09T06:58:03.278063+0000","last_unstale":"2023-10-09T06:58:03.776114+0000","last_undegraded":"2023-10-09T06:58:03.776114+0000","last_fullsized":"2023-10-09T06:58:03.776114+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:01:05.569394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.787641+0000","last_change":"2023-10-09T06:58:03.786407+0000","last_active":"2023-10-09T06:58:03.787641+0000","last_peered":"2023-10-09T06:58:03.787641+0000","last_clean":"2023-10-09T06:58:03.787641+0000","last_became_active":"2023-10-09T06:58:03.786139+0000","last_became_peered":"2023-10-09T06:58:03.786139+0000","last_unstale":"2023-10-09T06:58:03.787641+0000","last_undegraded":"2023-10-09T06:58:03.787641+0000","last_fullsized":"2023-10-09T06:58:03.787641+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:54:29.099122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.773510+0000","last_change":"2023-10-09T06:58:03.274854+0000","last_active":"2023-10-09T06:58:03.773510+0000","last_peered":"2023-10-09T06:58:03.773510+0000","last_clean":"2023-10-09T06:58:03.773510+0000","last_became_active":"2023-10-09T06:58:03.274591+0000","last_became_peered":"2023-10-09T06:58:03.274591+0000","last_unstale":"2023-10-09T06:58:03.773510+0000","last_undegraded":"2023-10-09T06:58:03.773510+0000","last_fullsized":"2023-10-09T06:58:03.773510+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:27:49.714248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.263208+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:38.264568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.264813+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:44:28.414578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"92'3","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.293010+0000","last_change":"2023-10-09T06:58:03.277580+0000","last_active":"2023-10-09T06:58:04.293010+0000","last_peered":"2023-10-09T06:58:04.293010+0000","last_clean":"2023-10-09T06:58:04.293010+0000","last_became_active":"2023-10-09T06:58:03.277331+0000","last_became_peered":"2023-10-09T06:58:03.277331+0000","last_unstale":"2023-10-09T06:58:04.293010+0000","last_undegraded":"2023-10-09T06:58:04.293010+0000","last_fullsized":"2023-10-09T06:58:04.293010+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:52.632381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781319+0000","last_change":"2023-10-09T06:58:03.779510+0000","last_active":"2023-10-09T06:58:03.781319+0000","last_peered":"2023-10-09T06:58:03.781319+0000","last_clean":"2023-10-09T06:58:03.781319+0000","last_became_active":"2023-10-09T06:58:03.778576+0000","last_became_peered":"2023-10-09T06:58:03.778576+0000","last_unstale":"2023-10-09T06:58:03.781319+0000","last_undegraded":"2023-10-09T06:58:03.781319+0000","last_fullsized":"2023-10-09T06:58:03.781319+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:43:18.959668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"92'6","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.295792+0000","last_change":"2023-10-09T06:58:03.281626+0000","last_active":"2023-10-09T06:58:04.295792+0000","last_peered":"2023-10-09T06:58:04.295792+0000","last_clean":"2023-10-09T06:58:04.295792+0000","last_became_active":"2023-10-09T06:58:03.280397+0000","last_became_peered":"2023-10-09T06:58:03.280397+0000","last_unstale":"2023-10-09T06:58:04.295792+0000","last_undegraded":"2023-10-09T06:58:04.295792+0000","last_fullsized":"2023-10-09T06:58:04.295792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:08:56.251029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"92'2","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.294274+0000","last_change":"2023-10-09T06:58:03.278338+0000","last_active":"2023-10-09T06:58:04.294274+0000","last_peered":"2023-10-09T06:58:04.294274+0000","last_clean":"2023-10-09T06:58:04.294274+0000","last_became_active":"2023-10-09T06:58:03.278052+0000","last_became_peered":"2023-10-09T06:58:03.278052+0000","last_unstale":"2023-10-09T06:58:04.294274+0000","last_undegraded":"2023-10-09T06:58:04.294274+0000","last_fullsized":"2023-10-09T06:58:04.294274+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:34.825539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.263951+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:01:05.569394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.787196+0000","last_change":"2023-10-09T06:58:03.786093+0000","last_active":"2023-10-09T06:58:03.787196+0000","last_peered":"2023-10-09T06:58:03.787196+0000","last_clean":"2023-10-09T06:58:03.787196+0000","last_became_active":"2023-10-09T06:58:03.785836+0000","last_became_peered":"2023-10-09T06:58:03.785836+0000","last_unstale":"2023-10-09T06:58:03.787196+0000","last_undegraded":"2023-10-09T06:58:03.787196+0000","last_fullsized":"2023-10-09T06:58:03.787196+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:10.559656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.262469+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:25:51.699892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781370+0000","last_change":"2023-10-09T06:58:03.780365+0000","last_active":"2023-10-09T06:58:03.781370+0000","last_peered":"2023-10-09T06:58:03.781370+0000","last_clean":"2023-10-09T06:58:03.781370+0000","last_became_active":"2023-10-09T06:58:03.779868+0000","last_became_peered":"2023-10-09T06:58:03.779868+0000","last_unstale":"2023-10-09T06:58:03.781370+0000","last_undegraded":"2023-10-09T06:58:03.781370+0000","last_fullsized":"2023-10-09T06:58:03.781370+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:29:24.208508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.261059+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:36.489423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.264321+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:08:56.251029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.261138+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:33.198191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.787006+0000","last_change":"2023-10-09T06:58:03.783652+0000","last_active":"2023-10-09T06:58:03.787006+0000","last_peered":"2023-10-09T06:58:03.787006+0000","last_clean":"2023-10-09T06:58:03.787006+0000","last_became_active":"2023-10-09T06:58:03.783398+0000","last_became_peered":"2023-10-09T06:58:03.783398+0000","last_unstale":"2023-10-09T06:58:03.787006+0000","last_undegraded":"2023-10-09T06:58:03.787006+0000","last_fullsized":"2023-10-09T06:58:03.787006+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:18.062792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.262122+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:43:17.950320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.779091+0000","last_change":"2023-10-09T06:58:03.775521+0000","last_active":"2023-10-09T06:58:03.779091+0000","last_peered":"2023-10-09T06:58:03.779091+0000","last_clean":"2023-10-09T06:58:03.779091+0000","last_became_active":"2023-10-09T06:58:03.775284+0000","last_became_peered":"2023-10-09T06:58:03.775284+0000","last_unstale":"2023-10-09T06:58:03.779091+0000","last_undegraded":"2023-10-09T06:58:03.779091+0000","last_fullsized":"2023-10-09T06:58:03.779091+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:01:46.472752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.264678+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:15:55.636242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.778718+0000","last_change":"2023-10-09T06:58:03.777764+0000","last_active":"2023-10-09T06:58:03.778718+0000","last_peered":"2023-10-09T06:58:03.778718+0000","last_clean":"2023-10-09T06:58:03.778718+0000","last_became_active":"2023-10-09T06:58:03.777519+0000","last_became_peered":"2023-10-09T06:58:03.777519+0000","last_unstale":"2023-10-09T06:58:03.778718+0000","last_undegraded":"2023-10-09T06:58:03.778718+0000","last_fullsized":"2023-10-09T06:58:03.778718+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:48.690134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.261963+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:37.352870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.795108+0000","last_change":"2023-10-09T06:58:03.794613+0000","last_active":"2023-10-09T06:58:03.795108+0000","last_peered":"2023-10-09T06:58:03.795108+0000","last_clean":"2023-10-09T06:58:03.795108+0000","last_became_active":"2023-10-09T06:58:03.794396+0000","last_became_peered":"2023-10-09T06:58:03.794396+0000","last_unstale":"2023-10-09T06:58:03.795108+0000","last_undegraded":"2023-10-09T06:58:03.795108+0000","last_fullsized":"2023-10-09T06:58:03.795108+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:05.501958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.261340+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:51:36.270969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.791753+0000","last_change":"2023-10-09T06:58:03.790775+0000","last_active":"2023-10-09T06:58:03.791753+0000","last_peered":"2023-10-09T06:58:03.791753+0000","last_clean":"2023-10-09T06:58:03.791753+0000","last_became_active":"2023-10-09T06:58:03.790517+0000","last_became_peered":"2023-10-09T06:58:03.790517+0000","last_unstale":"2023-10-09T06:58:03.791753+0000","last_undegraded":"2023-10-09T06:58:03.791753+0000","last_fullsized":"2023-10-09T06:58:03.791753+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:38:39.496926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.772648+0000","last_change":"2023-10-09T06:58:03.282068+0000","last_active":"2023-10-09T06:58:03.772648+0000","last_peered":"2023-10-09T06:58:03.772648+0000","last_clean":"2023-10-09T06:58:03.772648+0000","last_became_active":"2023-10-09T06:58:03.281770+0000","last_became_peered":"2023-10-09T06:58:03.281770+0000","last_unstale":"2023-10-09T06:58:03.772648+0000","last_undegraded":"2023-10-09T06:58:03.772648+0000","last_fullsized":"2023-10-09T06:58:03.772648+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:48:10.578960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.784340+0000","last_change":"2023-10-09T06:58:03.782745+0000","last_active":"2023-10-09T06:58:03.784340+0000","last_peered":"2023-10-09T06:58:03.784340+0000","last_clean":"2023-10-09T06:58:03.784340+0000","last_became_active":"2023-10-09T06:58:03.782504+0000","last_became_peered":"2023-10-09T06:58:03.782504+0000","last_unstale":"2023-10-09T06:58:03.784340+0000","last_undegraded":"2023-10-09T06:58:03.784340+0000","last_fullsized":"2023-10-09T06:58:03.784340+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:35.203503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.263774+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:41.417852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.261948+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:43.149451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.776473+0000","last_change":"2023-10-09T06:58:03.282655+0000","last_active":"2023-10-09T06:58:03.776473+0000","last_peered":"2023-10-09T06:58:03.776473+0000","last_clean":"2023-10-09T06:58:03.776473+0000","last_became_active":"2023-10-09T06:58:03.282390+0000","last_became_peered":"2023-10-09T06:58:03.282390+0000","last_unstale":"2023-10-09T06:58:03.776473+0000","last_undegraded":"2023-10-09T06:58:03.776473+0000","last_fullsized":"2023-10-09T06:58:03.776473+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:39:27.910719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.775076+0000","last_change":"2023-10-09T06:58:03.282318+0000","last_active":"2023-10-09T06:58:03.775076+0000","last_peered":"2023-10-09T06:58:03.775076+0000","last_clean":"2023-10-09T06:58:03.775076+0000","last_became_active":"2023-10-09T06:58:03.282067+0000","last_became_peered":"2023-10-09T06:58:03.282067+0000","last_unstale":"2023-10-09T06:58:03.775076+0000","last_undegraded":"2023-10-09T06:58:03.775076+0000","last_fullsized":"2023-10-09T06:58:03.775076+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:54.192461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.782118+0000","last_change":"2023-10-09T06:58:03.780989+0000","last_active":"2023-10-09T06:58:03.782118+0000","last_peered":"2023-10-09T06:58:03.782118+0000","last_clean":"2023-10-09T06:58:03.782118+0000","last_became_active":"2023-10-09T06:58:03.780759+0000","last_became_peered":"2023-10-09T06:58:03.780759+0000","last_unstale":"2023-10-09T06:58:03.782118+0000","last_undegraded":"2023-10-09T06:58:03.782118+0000","last_fullsized":"2023-10-09T06:58:03.782118+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:05.430877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.776139+0000","last_change":"2023-10-09T06:58:03.277955+0000","last_active":"2023-10-09T06:58:03.776139+0000","last_peered":"2023-10-09T06:58:03.776139+0000","last_clean":"2023-10-09T06:58:03.776139+0000","last_became_active":"2023-10-09T06:58:03.277692+0000","last_became_peered":"2023-10-09T06:58:03.277692+0000","last_unstale":"2023-10-09T06:58:03.776139+0000","last_undegraded":"2023-10-09T06:58:03.776139+0000","last_fullsized":"2023-10-09T06:58:03.776139+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:44:10.319004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.775905+0000","last_change":"2023-10-09T06:58:03.279055+0000","last_active":"2023-10-09T06:58:03.775905+0000","last_peered":"2023-10-09T06:58:03.775905+0000","last_clean":"2023-10-09T06:58:03.775905+0000","last_became_active":"2023-10-09T06:58:03.278781+0000","last_became_peered":"2023-10-09T06:58:03.278781+0000","last_unstale":"2023-10-09T06:58:03.775905+0000","last_undegraded":"2023-10-09T06:58:03.775905+0000","last_fullsized":"2023-10-09T06:58:03.775905+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:41.417852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.779579+0000","last_change":"2023-10-09T06:58:03.777888+0000","last_active":"2023-10-09T06:58:03.779579+0000","last_peered":"2023-10-09T06:58:03.779579+0000","last_clean":"2023-10-09T06:58:03.779579+0000","last_became_active":"2023-10-09T06:58:03.777552+0000","last_became_peered":"2023-10-09T06:58:03.777552+0000","last_unstale":"2023-10-09T06:58:03.779579+0000","last_undegraded":"2023-10-09T06:58:03.779579+0000","last_fullsized":"2023-10-09T06:58:03.779579+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:14.217322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.261357+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:13.207974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:03.253528+0000","last_change":"2023-10-09T06:58:03.253528+0000","last_active":"2023-10-09T06:58:03.253528+0000","last_peered":"2023-10-09T06:58:03.253528+0000","last_clean":"2023-10-09T06:58:03.253528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:03.253528+0000","last_undegraded":"2023-10-09T06:58:03.253528+0000","last_fullsized":"2023-10-09T06:58:03.253528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.262049+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:49:36.085804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.792125+0000","last_change":"2023-10-09T06:58:03.791372+0000","last_active":"2023-10-09T06:58:03.792125+0000","last_peered":"2023-10-09T06:58:03.792125+0000","last_clean":"2023-10-09T06:58:03.792125+0000","last_became_active":"2023-10-09T06:58:03.791000+0000","last_became_peered":"2023-10-09T06:58:03.791000+0000","last_unstale":"2023-10-09T06:58:03.792125+0000","last_undegraded":"2023-10-09T06:58:03.792125+0000","last_fullsized":"2023-10-09T06:58:03.792125+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:35:41.435584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:02.244180+0000","last_change":"2023-10-09T06:58:02.262384+0000","last_active":"2023-10-09T06:58:02.244180+0000","last_peered":"2023-10-09T06:58:02.244180+0000","last_clean":"2023-10-09T06:58:02.244180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:02.244180+0000","last_undegraded":"2023-10-09T06:58:02.244180+0000","last_fullsized":"2023-10-09T06:58:02.244180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:38:41.084580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"82'183","reported_seq":457,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-09T06:58:00.805784+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:58:00.805784+0000","last_peered":"2023-10-09T06:58:00.805784+0000","last_clean":"2023-10-09T06:58:00.805784+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:58:00.805784+0000","last_undegraded":"2023-10-09T06:58:00.805784+0000","last_fullsized":"2023-10-09T06:58:00.805784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":4},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1660,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575035,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303024,"kb_used_data":1640,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068816,"statfs":{"total":96636764160,"available":96326467584,"internally_reserved":0,"allocated":1679360,"data_stored":1112406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68400000000000005,"15min":0.70799999999999996},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.316},"max":{"1min":0.81100000000000005,"5min":1.732,"15min":1.9490000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.44,"5min":0.40200000000000002,"15min":0.29999999999999999},"max":{"1min":0.83299999999999996,"5min":1.22,"15min":3.448},"last":0.71799999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.504,"5min":0.437,"15min":0.379},"max":{"1min":0.86799999999999999,"5min":2.3559999999999999,"15min":5.617},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.46999999999999997,"5min":0.45800000000000002,"15min":0.40200000000000002},"max":{"1min":0.97599999999999998,"5min":1.7869999999999999,"15min":2.016},"last":0.627}]},{"osd":2,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.72999999999999998,"15min":0.73899999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.44800000000000001},"max":{"1min":0.97999999999999998,"5min":1.9430000000000001,"15min":2.052},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.73799999999999999,"15min":0.75600000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.44700000000000001},"max":{"1min":0.82399999999999995,"5min":2.6629999999999998,"15min":3.5019999999999998},"last":0.79700000000000004}]},{"osd":3,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.73899999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.45000000000000001},"max":{"1min":0.97099999999999997,"5min":1.03,"15min":5.5800000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.746,"15min":0.78100000000000003},"min":{"1min":0.50800000000000001,"5min":0.496,"15min":0.47099999999999997},"max":{"1min":0.89800000000000002,"5min":1.827,"15min":6.9299999999999997},"last":0.74199999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.91000000000000003,"5min":0.95499999999999996,"15min":3.125},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.66500000000000004},"min":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1850000000000001,"5min":2.577,"15min":4.8380000000000001},"last":0.67000000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68700000000000006,"15min":0.68100000000000005},"min":{"1min":0.441,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":1.0309999999999999,"5min":2.5169999999999999,"15min":4.1929999999999996},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.5,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":2.9590000000000001,"15min":3.6749999999999998},"last":0.84099999999999997}]},{"osd":6,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0449999999999999,"5min":3.0019999999999998,"15min":4.0250000000000004},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72699999999999998,"15min":0.752},"min":{"1min":0.498,"5min":0.47399999999999998,"15min":0.44700000000000001},"max":{"1min":1.0740000000000001,"5min":2.4039999999999999,"15min":7.0259999999999998},"last":0.81699999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575034,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302444,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069396,"statfs":{"total":96636764160,"available":96327061504,"internally_reserved":0,"allocated":1085440,"data_stored":522038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69699999999999995,"15min":0.71099999999999997},"min":{"1min":0.52100000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85599999999999998,"5min":0.97899999999999998,"15min":1.022},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69099999999999995,"15min":0.70199999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.36599999999999999},"max":{"1min":0.80100000000000005,"5min":0.93899999999999995,"15min":1.079},"last":0.66300000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70599999999999996,"15min":0.72199999999999998},"min":{"1min":0.47699999999999998,"5min":0.44800000000000001,"15min":0.42799999999999999},"max":{"1min":0.90400000000000003,"5min":1.135,"15min":1.135},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70599999999999996,"15min":0.72399999999999998},"min":{"1min":0.56899999999999995,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83899999999999997,"5min":1.0109999999999999,"15min":1.034},"last":0.71099999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.58999999999999997,"5min":0.49199999999999999,"15min":0.42599999999999999},"max":{"1min":0.86899999999999999,"5min":1.391,"15min":1.391},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.51900000000000002,"5min":0.48899999999999999,"15min":0.45200000000000001},"max":{"1min":0.85899999999999999,"5min":0.95499999999999996,"15min":1.0900000000000001},"last":0.90500000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68300000000000005,"15min":0.69799999999999995},"min":{"1min":0.52600000000000002,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.82699999999999996,"5min":0.91700000000000004,"15min":1.046},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.497},"max":{"1min":0.86499999999999999,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.82999999999999996}]},{"osd":4,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.42099999999999999,"5min":0.38,"15min":0.377},"max":{"1min":0.73399999999999999,"5min":1.768,"15min":1.768},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.437,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77700000000000002,"5min":1.601,"15min":1.601},"last":0.73899999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.46600000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.876,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.68100000000000005,"15min":0.69299999999999995},"min":{"1min":0.47699999999999998,"5min":0.44600000000000001,"15min":0.42299999999999999},"max":{"1min":0.77500000000000002,"5min":0.99299999999999999,"15min":1.0669999999999999},"last":0.75700000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.66600000000000004,"15min":0.67700000000000005},"min":{"1min":0.48699999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79400000000000004,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.45300000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83999999999999997,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.79900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302512,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069328,"statfs":{"total":96636764160,"available":96326991872,"internally_reserved":0,"allocated":1155072,"data_stored":550849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.27600000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59399999999999997,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.503,"5min":0.49199999999999999,"15min":0.48299999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.23699999999999999},"max":{"1min":1.083,"5min":1.23,"15min":1.23},"last":0.32600000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.29599999999999999},"max":{"1min":0.68500000000000005,"5min":1.169,"15min":1.169},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.439,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":3.077,"15min":3.077},"last":0.56899999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.40000000000000002,"5min":0.376,"15min":0.34100000000000003},"max":{"1min":0.76000000000000001,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.39100000000000001,"5min":0.34899999999999998,"15min":0.34100000000000003},"max":{"1min":1.056,"5min":1.605,"15min":1.605},"last":0.36099999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73899999999999999,"15min":0.76100000000000001},"min":{"1min":0.497,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.89900000000000002,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.75800000000000001,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93999999999999995,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.72299999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75800000000000001,"15min":0.77400000000000002},"min":{"1min":0.55000000000000004,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.3140000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75900000000000001,"15min":0.78100000000000003},"min":{"1min":0.54500000000000004,"5min":0.497,"15min":0.47999999999999998},"max":{"1min":0.95799999999999996,"5min":1.637,"15min":1.637},"last":0.65200000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78700000000000003,"15min":0.79600000000000004},"min":{"1min":0.54600000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97899999999999998,"5min":1.696,"15min":1.696},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78600000000000003,"15min":0.79700000000000004},"min":{"1min":0.54600000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1679999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81999999999999995,"15min":0.82599999999999996},"min":{"1min":0.55500000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1479999999999999,"5min":1.2669999999999999,"15min":1.4510000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79800000000000004,"15min":0.82299999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98699999999999999,"5min":1.125,"15min":1.1970000000000001},"last":0.69099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575035,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298976,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072864,"statfs":{"total":96636764160,"available":96330612736,"internally_reserved":0,"allocated":1728512,"data_stored":1139093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.29299999999999998,"5min":0.27100000000000002,"15min":0.23000000000000001},"max":{"1min":0.623,"5min":0.85799999999999998,"15min":1.2729999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.28899999999999998},"max":{"1min":0.60399999999999998,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":0.47499999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.63400000000000001,"5min":4.6980000000000004,"15min":4.6980000000000004},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48999999999999999,"15min":0.497},"min":{"1min":0.34000000000000002,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.71799999999999997,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.41499999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":0.63800000000000001,"5min":1.2450000000000001,"15min":1.7130000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.441,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":0.70199999999999996,"5min":4.734,"15min":4.734},"last":0.498}]},{"osd":4,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.52900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99199999999999999,"5min":1.2270000000000001,"15min":1.752},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.50700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.91500000000000004,"5min":4.6619999999999999,"15min":4.6619999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.53700000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0049999999999999,"5min":1.1890000000000001,"15min":1.2769999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.58699999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90300000000000002,"5min":1.2809999999999999,"15min":1.7889999999999999},"last":0.81699999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.80500000000000005,"15min":0.81299999999999994},"min":{"1min":0.56499999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97299999999999998,"5min":4.6239999999999997,"15min":4.6239999999999997},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79300000000000004,"15min":0.80100000000000005},"min":{"1min":0.55600000000000005,"5min":0.50800000000000001,"15min":0.47999999999999998},"max":{"1min":0.96499999999999997,"5min":1.2689999999999999,"15min":1.4370000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.82499999999999996,"15min":0.83199999999999996},"min":{"1min":0.56299999999999994,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.042,"5min":1.256,"15min":1.518},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.621,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95599999999999996,"5min":1.702,"15min":1.8200000000000001},"last":0.753}]}]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306600,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065240,"statfs":{"total":96636764160,"available":96322805760,"internally_reserved":0,"allocated":1146880,"data_stored":550261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.46800000000000003,"15min":0.45400000000000001},"min":{"1min":0.28299999999999997,"5min":0.26500000000000001,"15min":0.25900000000000001},"max":{"1min":0.76700000000000002,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.48999999999999999,"15min":0.495},"min":{"1min":0.30599999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.55300000000000005,"5min":1.633,"15min":1.633},"last":0.38800000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46400000000000002,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71599999999999997,"5min":1.097,"15min":1.865},"last":0.371},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.79700000000000004,"5min":1.2689999999999999,"15min":1.79},"last":0.45400000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.58899999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.35799999999999998},"max":{"1min":0.82599999999999996,"5min":0.86699999999999999,"15min":1.8999999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.47399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70299999999999996,"5min":1.1890000000000001,"15min":1.8220000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":0.85799999999999998,"5min":1.2430000000000001,"15min":1.256},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.55000000000000004,"5min":0.45900000000000002,"15min":0.44800000000000001},"max":{"1min":0.91400000000000003,"5min":1.696,"15min":1.696},"last":0.77800000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.753,"15min":0.76800000000000002},"min":{"1min":0.505,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85199999999999998,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.503},"max":{"1min":0.83199999999999996,"5min":1.218,"15min":1.3440000000000001},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.54000000000000004,"5min":0.51000000000000001,"15min":0.48599999999999999},"max":{"1min":0.94899999999999995,"5min":1.768,"15min":1.768},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.76400000000000001,"15min":0.79000000000000004},"min":{"1min":0.56599999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92900000000000005,"5min":1.3580000000000001,"15min":1.5309999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.61799999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97799999999999998,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.58699999999999997,"5min":0.57599999999999996,"15min":0.50900000000000001},"max":{"1min":0.92000000000000004,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.621}]}]},{"osd":3,"up_from":13,"seq":55834575036,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306596,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065244,"statfs":{"total":96636764160,"available":96322809856,"internally_reserved":0,"allocated":1142784,"data_stored":548837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.29599999999999999,"5min":0.29499999999999998,"15min":0.24099999999999999},"max":{"1min":0.86299999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.47899999999999998,"15min":0.48799999999999999},"min":{"1min":0.315,"5min":0.30199999999999999,"15min":0.28100000000000003},"max":{"1min":0.63600000000000001,"5min":1.228,"15min":1.228},"last":0.498}]},{"osd":1,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.48099999999999998,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58699999999999997,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.379}]},{"osd":2,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94099999999999995,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64800000000000002,"15min":0.63300000000000001},"min":{"1min":0.44400000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.97699999999999998,"5min":3.8900000000000001,"15min":3.8900000000000001},"last":0.56899999999999995}]},{"osd":4,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.51100000000000001,"5min":0.48299999999999998,"15min":0.40799999999999997},"max":{"1min":0.76500000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.81000000000000005,"15min":0.82299999999999995},"min":{"1min":0.623,"5min":0.59399999999999997,"15min":0.52200000000000002},"max":{"1min":1.0189999999999999,"5min":1.22,"15min":1.22},"last":0.77000000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.45000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.86199999999999999,"5min":1.3360000000000001,"15min":2.1549999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.56399999999999995,"5min":0.55900000000000005,"15min":0.50600000000000001},"max":{"1min":1.0569999999999999,"5min":1.1639999999999999,"15min":1.419},"last":0.68500000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.51700000000000002},"max":{"1min":0.875,"5min":1.304,"15min":1.304},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95199999999999996,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.69899999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91100000000000003,"5min":1.8180000000000001,"15min":2.0880000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.80800000000000005,"15min":0.82099999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92300000000000004,"5min":1.486,"15min":1.486},"last":0.77800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575034,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310648,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061192,"statfs":{"total":96636764160,"available":96318660608,"internally_reserved":0,"allocated":1097728,"data_stored":528235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71399999999999997,"15min":0.70399999999999996},"min":{"1min":0.45000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79200000000000004,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.72799999999999998,"15min":0.72299999999999998},"min":{"1min":0.50900000000000001,"5min":0.42699999999999999,"15min":0.39300000000000002},"max":{"1min":0.97399999999999998,"5min":2.8130000000000002,"15min":3.23},"last":0.66700000000000004}]},{"osd":1,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71899999999999997,"15min":0.71099999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.373},"max":{"1min":0.85699999999999998,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.53000000000000003,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.86499999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.56000000000000005}]},{"osd":2,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.755,"15min":0.75700000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.38100000000000001},"max":{"1min":0.92900000000000005,"5min":2.5960000000000001,"15min":3.7509999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.48299999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90000000000000002,"5min":2.427,"15min":2.427},"last":0.53500000000000003}]},{"osd":3,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.755,"15min":0.751},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.434},"max":{"1min":0.89700000000000002,"5min":2.6440000000000001,"15min":3.6970000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.77000000000000002,"15min":0.747},"min":{"1min":0.443,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":3.6899999999999999,"15min":3.6899999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63600000000000001,"15min":0.60899999999999999},"min":{"1min":0.379,"5min":0.317,"15min":0.317},"max":{"1min":0.84899999999999998,"5min":3.3860000000000001,"15min":3.4780000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.68999999999999995,"15min":0.65800000000000003},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.34999999999999998},"max":{"1min":0.91200000000000003,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.64100000000000001}]},{"osd":6,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67100000000000004,"15min":0.64000000000000001},"min":{"1min":0.47699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82299999999999995,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.63},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.71499999999999997,"15min":0.67900000000000005},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.374},"max":{"1min":0.89100000000000001,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.51200000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.49299999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.96599999999999997,"5min":2.7210000000000001,"15min":3.2789999999999999},"last":0.621},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.76900000000000002},"min":{"1min":0.56499999999999995,"5min":0.439,"15min":0.439},"max":{"1min":0.93600000000000005,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.65200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":1097728,"data_stored":528235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67600000000000005,"15min":0.69699999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.72299999999999998,"5min":0.93600000000000005,"15min":1.655},"last":0.752},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65700000000000003,"15min":0.68400000000000005},"min":{"1min":0.42899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78200000000000003,"5min":1.0269999999999999,"15min":1.1359999999999999},"last":0.47299999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71699999999999997,"5min":0.96899999999999997,"15min":2.4159999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.45400000000000001,"5min":0.44,"15min":0.40400000000000003},"max":{"1min":0.89100000000000001,"5min":0.95099999999999996,"15min":1.706},"last":0.52100000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69699999999999995,"15min":0.72799999999999998},"min":{"1min":0.501,"5min":0.48499999999999999,"15min":0.42999999999999999},"max":{"1min":0.75800000000000001,"5min":0.997,"15min":1.79},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69699999999999995,"15min":0.71599999999999997},"min":{"1min":0.49199999999999999,"5min":0.46500000000000002,"15min":0.442},"max":{"1min":0.752,"5min":1.006,"15min":2.4889999999999999},"last":0.81799999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68999999999999995,"15min":0.71699999999999997},"min":{"1min":0.46899999999999997,"5min":0.438,"15min":0.435},"max":{"1min":0.88600000000000001,"5min":1.0209999999999999,"15min":1.409},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73899999999999999,"15min":0.76900000000000002},"min":{"1min":0.56200000000000006,"5min":0.501,"15min":0.501},"max":{"1min":0.78600000000000003,"5min":0.95699999999999996,"15min":2.532},"last":0.77300000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":1.766},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.622,"15min":0.621},"min":{"1min":0.48599999999999999,"5min":0.377,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":1.052,"15min":2.7829999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.45100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82899999999999996,"5min":1.018,"15min":2.5739999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.40000000000000002,"15min":0.38900000000000001},"max":{"1min":0.84099999999999997,"5min":0.97999999999999998,"15min":1.8080000000000001},"last":0.84699999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.90700000000000003,"5min":1.175,"15min":2.9609999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.60499999999999998,"5min":0.498,"15min":0.45900000000000002},"max":{"1min":0.876,"5min":1.139,"15min":2.613},"last":0.88300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:58:09.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2023-10-09T06:58:09.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-10-09T06:58:09.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-10-09T06:58:09.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-10-09T06:58:09.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-10-09T06:58:09.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-10-09T06:58:09.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2023-10-09T06:58:09.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-10-09T06:58:09.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-10-09T06:58:09.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-10-09T06:58:09.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-10-09T06:58:09.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2023-10-09T06:58:09.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2023-10-09T06:58:09.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-10-09T06:58:09.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-10-09T06:58:09.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-10-09T06:58:09.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-10-09T06:58:09.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-10-09T06:58:09.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-10-09T06:58:09.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-10-09T06:58:09.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-10-09T06:58:09.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:02.244180+0000', 'last_change': '2023-10-09T06:58:02.265327+0000', 'last_active': '2023-10-09T06:58:02.244180+0000', 'last_peered': '2023-10-09T06:58:02.244180+0000', 'last_clean': '2023-10-09T06:58:02.244180+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:02.244180+0000', 'last_undegraded': '2023-10-09T06:58:02.244180+0000', 'last_fullsized': '2023-10-09T06:58:02.244180+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T08:47:53.051745+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:58:09.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-10-09T06:58:09.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-10-09T06:58:09.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:02.244180+0000', 'last_change': '2023-10-09T06:58:02.261063+0000', 'last_active': '2023-10-09T06:58:02.244180+0000', 'last_peered': '2023-10-09T06:58:02.244180+0000', 'last_clean': '2023-10-09T06:58:02.244180+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:02.244180+0000', 'last_undegraded': '2023-10-09T06:58:02.244180+0000', 'last_fullsized': '2023-10-09T06:58:02.244180+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:12:02.609888+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:58:09.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-10-09T06:58:09.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-10-09T06:58:09.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:02.244180+0000', 'last_change': '2023-10-09T06:58:02.262290+0000', 'last_active': '2023-10-09T06:58:02.244180+0000', 'last_peered': '2023-10-09T06:58:02.244180+0000', 'last_clean': '2023-10-09T06:58:02.244180+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:02.244180+0000', 'last_undegraded': '2023-10-09T06:58:02.244180+0000', 'last_fullsized': '2023-10-09T06:58:02.244180+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:33:34.825539+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:58:09.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-10-09T06:58:09.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-10-09T06:58:09.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-10-09T06:58:09.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:02.244180+0000', 'last_change': '2023-10-09T06:58:02.264758+0000', 'last_active': '2023-10-09T06:58:02.244180+0000', 'last_peered': '2023-10-09T06:58:02.244180+0000', 'last_clean': '2023-10-09T06:58:02.244180+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:02.244180+0000', 'last_undegraded': '2023-10-09T06:58:02.244180+0000', 'last_fullsized': '2023-10-09T06:58:02.244180+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:52:54.289694+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:58:09.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-10-09T06:58:09.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-10-09T06:58:09.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:02.244180+0000', 'last_change': '2023-10-09T06:58:02.263208+0000', 'last_active': '2023-10-09T06:58:02.244180+0000', 'last_peered': '2023-10-09T06:58:02.244180+0000', 'last_clean': '2023-10-09T06:58:02.244180+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:02.244180+0000', 'last_undegraded': '2023-10-09T06:58:02.244180+0000', 'last_fullsized': '2023-10-09T06:58:02.244180+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:44:38.264568+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:58:09.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-10-09T06:58:09.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-10-09T06:58:09.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:02.244180+0000', 'last_change': '2023-10-09T06:58:02.264813+0000', 'last_active': '2023-10-09T06:58:02.244180+0000', 'last_peered': '2023-10-09T06:58:02.244180+0000', 'last_clean': '2023-10-09T06:58:02.244180+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:02.244180+0000', 'last_undegraded': '2023-10-09T06:58:02.244180+0000', 'last_fullsized': '2023-10-09T06:58:02.244180+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:44:28.414578+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:58:09.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-10-09T06:58:09.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-10-09T06:58:09.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-10-09T06:58:09.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-10-09T06:58:09.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:02.244180+0000', 'last_change': '2023-10-09T06:58:02.263951+0000', 'last_active': '2023-10-09T06:58:02.244180+0000', 'last_peered': '2023-10-09T06:58:02.244180+0000', 'last_clean': '2023-10-09T06:58:02.244180+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:02.244180+0000', 'last_undegraded': '2023-10-09T06:58:02.244180+0000', 'last_fullsized': '2023-10-09T06:58:02.244180+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T09:01:05.569394+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:58:09.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-10-09T06:58:09.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:02.244180+0000', 'last_change': '2023-10-09T06:58:02.262469+0000', 'last_active': '2023-10-09T06:58:02.244180+0000', 'last_peered': '2023-10-09T06:58:02.244180+0000', 'last_clean': '2023-10-09T06:58:02.244180+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:02.244180+0000', 'last_undegraded': '2023-10-09T06:58:02.244180+0000', 'last_fullsized': '2023-10-09T06:58:02.244180+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:25:51.699892+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:58:09.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-10-09T06:58:09.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:02.244180+0000', 'last_change': '2023-10-09T06:58:02.261059+0000', 'last_active': '2023-10-09T06:58:02.244180+0000', 'last_peered': '2023-10-09T06:58:02.244180+0000', 'last_clean': '2023-10-09T06:58:02.244180+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:02.244180+0000', 'last_undegraded': '2023-10-09T06:58:02.244180+0000', 'last_fullsized': '2023-10-09T06:58:02.244180+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:30:36.489423+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:58:09.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-10-09T06:58:09.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-10-09T06:58:09.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:02.244180+0000', 'last_change': '2023-10-09T06:58:02.264321+0000', 'last_active': '2023-10-09T06:58:02.244180+0000', 'last_peered': '2023-10-09T06:58:02.244180+0000', 'last_clean': '2023-10-09T06:58:02.244180+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:02.244180+0000', 'last_undegraded': '2023-10-09T06:58:02.244180+0000', 'last_fullsized': '2023-10-09T06:58:02.244180+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T09:08:56.251029+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:58:09.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-10-09T06:58:09.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-10-09T06:58:09.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:02.244180+0000', 'last_change': '2023-10-09T06:58:02.261138+0000', 'last_active': '2023-10-09T06:58:02.244180+0000', 'last_peered': '2023-10-09T06:58:02.244180+0000', 'last_clean': '2023-10-09T06:58:02.244180+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:02.244180+0000', 'last_undegraded': '2023-10-09T06:58:02.244180+0000', 'last_fullsized': '2023-10-09T06:58:02.244180+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:30:33.198191+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:58:09.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-10-09T06:58:09.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:02.244180+0000', 'last_change': '2023-10-09T06:58:02.262122+0000', 'last_active': '2023-10-09T06:58:02.244180+0000', 'last_peered': '2023-10-09T06:58:02.244180+0000', 'last_clean': '2023-10-09T06:58:02.244180+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:02.244180+0000', 'last_undegraded': '2023-10-09T06:58:02.244180+0000', 'last_fullsized': '2023-10-09T06:58:02.244180+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T08:43:17.950320+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:58:09.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-10-09T06:58:09.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:02.244180+0000', 'last_change': '2023-10-09T06:58:02.264678+0000', 'last_active': '2023-10-09T06:58:02.244180+0000', 'last_peered': '2023-10-09T06:58:02.244180+0000', 'last_clean': '2023-10-09T06:58:02.244180+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:02.244180+0000', 'last_undegraded': '2023-10-09T06:58:02.244180+0000', 'last_fullsized': '2023-10-09T06:58:02.244180+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T09:15:55.636242+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:58:09.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-10-09T06:58:09.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:02.244180+0000', 'last_change': '2023-10-09T06:58:02.261963+0000', 'last_active': '2023-10-09T06:58:02.244180+0000', 'last_peered': '2023-10-09T06:58:02.244180+0000', 'last_clean': '2023-10-09T06:58:02.244180+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:02.244180+0000', 'last_undegraded': '2023-10-09T06:58:02.244180+0000', 'last_fullsized': '2023-10-09T06:58:02.244180+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:36:37.352870+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:58:09.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-10-09T06:58:09.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:02.244180+0000', 'last_change': '2023-10-09T06:58:02.261340+0000', 'last_active': '2023-10-09T06:58:02.244180+0000', 'last_peered': '2023-10-09T06:58:02.244180+0000', 'last_clean': '2023-10-09T06:58:02.244180+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:02.244180+0000', 'last_undegraded': '2023-10-09T06:58:02.244180+0000', 'last_fullsized': '2023-10-09T06:58:02.244180+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T10:51:36.270969+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:58:09.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-10-09T06:58:09.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:02.244180+0000', 'last_change': '2023-10-09T06:58:02.263774+0000', 'last_active': '2023-10-09T06:58:02.244180+0000', 'last_peered': '2023-10-09T06:58:02.244180+0000', 'last_clean': '2023-10-09T06:58:02.244180+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:02.244180+0000', 'last_undegraded': '2023-10-09T06:58:02.244180+0000', 'last_fullsized': '2023-10-09T06:58:02.244180+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:17:41.417852+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:58:09.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-10-09T06:58:09.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-10-09T06:58:09.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:02.244180+0000', 'last_change': '2023-10-09T06:58:02.261948+0000', 'last_active': '2023-10-09T06:58:02.244180+0000', 'last_peered': '2023-10-09T06:58:02.244180+0000', 'last_clean': '2023-10-09T06:58:02.244180+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:02.244180+0000', 'last_undegraded': '2023-10-09T06:58:02.244180+0000', 'last_fullsized': '2023-10-09T06:58:02.244180+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:10:43.149451+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:58:09.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-10-09T06:58:09.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-10-09T06:58:09.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-10-09T06:58:09.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.559 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-10-09T06:58:09.559 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:02.244180+0000', 'last_change': '2023-10-09T06:58:02.261357+0000', 'last_active': '2023-10-09T06:58:02.244180+0000', 'last_peered': '2023-10-09T06:58:02.244180+0000', 'last_clean': '2023-10-09T06:58:02.244180+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:02.244180+0000', 'last_undegraded': '2023-10-09T06:58:02.244180+0000', 'last_fullsized': '2023-10-09T06:58:02.244180+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T08:39:13.207974+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T06:58:09.559 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-10-09T06:58:09.559 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:03.253528+0000', 'last_change': '2023-10-09T06:58:03.253528+0000', 'last_active': '2023-10-09T06:58:03.253528+0000', 'last_peered': '2023-10-09T06:58:03.253528+0000', 'last_clean': '2023-10-09T06:58:03.253528+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:03.253528+0000', 'last_undegraded': '2023-10-09T06:58:03.253528+0000', 'last_fullsized': '2023-10-09T06:58:03.253528+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:03.253528+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:09.559 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-10-09T06:58:09.559 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:02.244180+0000', 'last_change': '2023-10-09T06:58:02.262049+0000', 'last_active': '2023-10-09T06:58:02.244180+0000', 'last_peered': '2023-10-09T06:58:02.244180+0000', 'last_clean': '2023-10-09T06:58:02.244180+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:02.244180+0000', 'last_undegraded': '2023-10-09T06:58:02.244180+0000', 'last_fullsized': '2023-10-09T06:58:02.244180+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T10:49:36.085804+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:58:09.560 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-10-09T06:58:09.560 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:02.244180+0000', 'last_change': '2023-10-09T06:58:02.262384+0000', 'last_active': '2023-10-09T06:58:02.244180+0000', 'last_peered': '2023-10-09T06:58:02.244180+0000', 'last_clean': '2023-10-09T06:58:02.244180+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:02.244180+0000', 'last_undegraded': '2023-10-09T06:58:02.244180+0000', 'last_fullsized': '2023-10-09T06:58:02.244180+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:02.244180+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T09:38:41.084580+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:58:09.561 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T06:58:09.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.748+0000 7fe0bef9d700 1 Processor -- start 2023-10-09T06:58:09.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.748+0000 7fe0bef9d700 1 -- start start 2023-10-09T06:58:09.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.749+0000 7fe0bef9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe0b81567b0 0x7fe0b806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:09.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.749+0000 7fe0bef9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0b806ece0 0x7fe0b80c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:09.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.749+0000 7fe0bef9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b806f140 con 0x7fe0b81563e0 2023-10-09T06:58:09.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.749+0000 7fe0bef9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b8156c50 con 0x7fe0b81567b0 2023-10-09T06:58:09.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.749+0000 7fe0bef9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b8157780 con 0x7fe0b806ece0 2023-10-09T06:58:09.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.750+0000 7fe0bd79a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe0b81567b0 0x7fe0b806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:09.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.750+0000 7fe0be79c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0b806ece0 0x7fe0b80c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:09.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.750+0000 7fe0bd79a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe0b81567b0 0x7fe0b806e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:46992/0 (socket says 172.21.15.71:46992) 2023-10-09T06:58:09.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.750+0000 7fe0bd79a700 1 -- 172.21.15.71:0/3078155624 learned_addr learned my addr 172.21.15.71:0/3078155624 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:09.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.750+0000 7fe0bd79a700 1 -- 172.21.15.71:0/3078155624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0b806ece0 msgr2=0x7fe0b80c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:09.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.750+0000 7fe0bd79a700 1 --2- 172.21.15.71:0/3078155624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0b806ece0 0x7fe0b80c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:09.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.750+0000 7fe0bd79a700 1 -- 172.21.15.71:0/3078155624 >> v1:172.21.15.179:6789/0 conn(0x7fe0b81563e0 legacy=0x7fe0b80c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:09.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.750+0000 7fe0bd79a700 1 -- 172.21.15.71:0/3078155624 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b8156e50 con 0x7fe0b81567b0 2023-10-09T06:58:09.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.750+0000 7fe0bcf99700 1 -- 172.21.15.71:0/3078155624 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387438219 0 0) 0x7fe0b4001110 con 0x7fe0b81563e0 2023-10-09T06:58:09.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.750+0000 7fe0be79c700 1 --2- 172.21.15.71:0/3078155624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0b806ece0 0x7fe0b80c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:58:09.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.751+0000 7fe0bd79a700 1 --2- 172.21.15.71:0/3078155624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0b81567b0 0x7fe0b806e7a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe0a80099b0 tx=0x7fe0a8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7510a2b55a4b0d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:09.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.751+0000 7fe0bcf99700 1 -- 172.21.15.71:0/3078155624 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8009ea0 con 0x7fe0b81567b0 2023-10-09T06:58:09.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.751+0000 7fe0bcf99700 1 -- 172.21.15.71:0/3078155624 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a800b860 con 0x7fe0b81567b0 2023-10-09T06:58:09.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.751+0000 7fe0bcf99700 1 -- 172.21.15.71:0/3078155624 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a800bc20 con 0x7fe0b81567b0 2023-10-09T06:58:09.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.751+0000 7fe0bef9d700 1 -- 172.21.15.71:0/3078155624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0b81567b0 msgr2=0x7fe0b806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:09.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.751+0000 7fe0bef9d700 1 --2- 172.21.15.71:0/3078155624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0b81567b0 0x7fe0b806e7a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe0a80099b0 tx=0x7fe0a8009250 comp rx=0 tx=0).stop 2023-10-09T06:58:09.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.751+0000 7fe0bef9d700 1 -- 172.21.15.71:0/3078155624 shutdown_connections 2023-10-09T06:58:09.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.751+0000 7fe0bef9d700 1 --2- 172.21.15.71:0/3078155624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0b806ece0 0x7fe0b80c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:09.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.751+0000 7fe0bef9d700 1 --2- 172.21.15.71:0/3078155624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0b81567b0 0x7fe0b806e7a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:09.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.751+0000 7fe0bef9d700 1 -- 172.21.15.71:0/3078155624 >> 172.21.15.71:0/3078155624 conn(0x7fe0b80ccca0 msgr2=0x7fe0b80c8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:09.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.752+0000 7fe0bef9d700 1 -- 172.21.15.71:0/3078155624 shutdown_connections 2023-10-09T06:58:09.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.752+0000 7fe0bef9d700 1 -- 172.21.15.71:0/3078155624 wait complete. 2023-10-09T06:58:09.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.753+0000 7fe0bef9d700 1 Processor -- start 2023-10-09T06:58:09.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.753+0000 7fe0bef9d700 1 -- start start 2023-10-09T06:58:09.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.754+0000 7fe0bef9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0b806ece0 0x7fe0b80b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:09.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.754+0000 7fe0bef9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0b81563e0 0x7fe0b814e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:09.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.754+0000 7fe0bef9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0b81567b0 0x7fe0b81594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:09.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.754+0000 7fe0bef9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b80af800 con 0x7fe0b806ece0 2023-10-09T06:58:09.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.754+0000 7fe0bef9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b80b14f0 con 0x7fe0b81563e0 2023-10-09T06:58:09.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.754+0000 7fe0bef9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b80b17d0 con 0x7fe0b81567b0 2023-10-09T06:58:09.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.754+0000 7fe0bdf9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0b806ece0 0x7fe0b80b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:09.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.754+0000 7fe0bdf9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0b806ece0 0x7fe0b80b0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59978/0 (socket says 172.21.15.71:59978) 2023-10-09T06:58:09.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.754+0000 7fe0bdf9b700 1 -- 172.21.15.71:0/1513747740 learned_addr learned my addr 172.21.15.71:0/1513747740 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:09.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.754+0000 7fe0bd79a700 1 --2- 172.21.15.71:0/1513747740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0b81563e0 0x7fe0b814e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:09.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.754+0000 7fe0be79c700 1 --2- 172.21.15.71:0/1513747740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0b81567b0 0x7fe0b81594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:09.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.755+0000 7fe0bdf9b700 1 -- 172.21.15.71:0/1513747740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0b81567b0 msgr2=0x7fe0b81594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:09.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.755+0000 7fe0bdf9b700 1 --2- 172.21.15.71:0/1513747740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0b81567b0 0x7fe0b81594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:09.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.755+0000 7fe0bdf9b700 1 -- 172.21.15.71:0/1513747740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0b81563e0 msgr2=0x7fe0b814e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:09.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.755+0000 7fe0bdf9b700 1 --2- 172.21.15.71:0/1513747740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0b81563e0 0x7fe0b814e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:09.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.755+0000 7fe0bdf9b700 1 -- 172.21.15.71:0/1513747740 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b0009a20 con 0x7fe0b806ece0 2023-10-09T06:58:09.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.755+0000 7fe0bdf9b700 1 --2- 172.21.15.71:0/1513747740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0b806ece0 0x7fe0b80b0bc0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400c7e0 tx=0x7fe0b4007c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:09.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.755+0000 7fe0adffb700 1 -- 172.21.15.71:0/1513747740 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4011590 con 0x7fe0b806ece0 2023-10-09T06:58:09.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.755+0000 7fe0adffb700 1 -- 172.21.15.71:0/1513747740 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b4011710 con 0x7fe0b806ece0 2023-10-09T06:58:09.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.755+0000 7fe0adffb700 1 -- 172.21.15.71:0/1513747740 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4011ad0 con 0x7fe0b806ece0 2023-10-09T06:58:09.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.755+0000 7fe0bef9d700 1 -- 172.21.15.71:0/1513747740 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a80094f0 con 0x7fe0b806ece0 2023-10-09T06:58:09.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.755+0000 7fe0bef9d700 1 -- 172.21.15.71:0/1513747740 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b80b1e10 con 0x7fe0b806ece0 2023-10-09T06:58:09.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.756+0000 7fe0bef9d700 1 -- 172.21.15.71:0/1513747740 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b80bfe50 con 0x7fe0b806ece0 2023-10-09T06:58:09.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.757+0000 7fe0adffb700 1 -- 172.21.15.71:0/1513747740 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0b401b3b0 con 0x7fe0b806ece0 2023-10-09T06:58:09.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.758+0000 7fe0adffb700 1 --2- 172.21.15.71:0/1513747740 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe09c066f30 0x7fe09c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:09.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.758+0000 7fe0adffb700 1 -- 172.21.15.71:0/1513747740 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fe0b40839e0 con 0x7fe0b806ece0 2023-10-09T06:58:09.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.758+0000 7fe0bd79a700 1 --2- 172.21.15.71:0/1513747740 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe09c066f30 0x7fe09c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:09.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.759+0000 7fe0bd79a700 1 --2- 172.21.15.71:0/1513747740 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe09c066f30 0x7fe09c0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe0a80099b0 tx=0x7fe0a8017000 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:09.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:09.762+0000 7fe0adffb700 1 -- 172.21.15.71:0/1513747740 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0b4050b80 con 0x7fe0b806ece0 2023-10-09T06:58:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.027+0000 7fe0bef9d700 1 -- 172.21.15.71:0/1513747740 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe0b806f140 con 0x7fe0b806ece0 2023-10-09T06:58:10.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.027+0000 7fe0adffb700 1 -- 172.21.15.71:0/1513747740 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1177 (secure 0 0 0) 0x7fe0b806f140 con 0x7fe0b806ece0 2023-10-09T06:58:10.029 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:10.029 INFO:teuthology.orchestra.run.smithi071.stdout:{"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":956,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":93,"num_osds":8,"num_up_osds":8,"osd_up_since":1696833745,"num_in_osds":8,"osd_in_since":1696833737,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":41},{"state_name":"unknown","count":36},{"state_name":"creating+peering","count":20}],"num_pgs":97,"num_pools":3,"num_objects":10,"data_bytes":592028,"bytes_used":2491654144,"bytes_avail":770602459136,"bytes_total":773094113280,"unknown_pgs_ratio":0.37113401293754578,"inactive_pgs_ratio":0.20618556439876556,"write_bytes_sec":1773,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":41,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":6666}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-10-09T06:56:28.809427+0000","services":{}},"progress_events":{}} 2023-10-09T06:58:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.030+0000 7fe0bef9d700 1 -- 172.21.15.71:0/1513747740 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe09c066f30 msgr2=0x7fe09c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.030+0000 7fe0bef9d700 1 --2- 172.21.15.71:0/1513747740 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe09c066f30 0x7fe09c0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe0a80099b0 tx=0x7fe0a8017000 comp rx=0 tx=0).stop 2023-10-09T06:58:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.030+0000 7fe0bef9d700 1 -- 172.21.15.71:0/1513747740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0b806ece0 msgr2=0x7fe0b80b0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:10.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.030+0000 7fe0bef9d700 1 --2- 172.21.15.71:0/1513747740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0b806ece0 0x7fe0b80b0bc0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400c7e0 tx=0x7fe0b4007c60 comp rx=0 tx=0).stop 2023-10-09T06:58:10.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.030+0000 7fe0bef9d700 1 -- 172.21.15.71:0/1513747740 shutdown_connections 2023-10-09T06:58:10.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.030+0000 7fe0bef9d700 1 --2- 172.21.15.71:0/1513747740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0b81567b0 0x7fe0b81594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:10.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.030+0000 7fe0bef9d700 1 --2- 172.21.15.71:0/1513747740 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe09c066f30 0x7fe09c0693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:10.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.030+0000 7fe0bef9d700 1 --2- 172.21.15.71:0/1513747740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0b806ece0 0x7fe0b80b0bc0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:10.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.030+0000 7fe0bef9d700 1 --2- 172.21.15.71:0/1513747740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0b81563e0 0x7fe0b814e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:10.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.030+0000 7fe0bef9d700 1 -- 172.21.15.71:0/1513747740 >> 172.21.15.71:0/1513747740 conn(0x7fe0b80ccca0 msgr2=0x7fe0b814f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:10.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.030+0000 7fe0bef9d700 1 -- 172.21.15.71:0/1513747740 shutdown_connections 2023-10-09T06:58:10.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.030+0000 7fe0bef9d700 1 -- 172.21.15.71:0/1513747740 wait complete. 2023-10-09T06:58:10.049 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T06:58:10.049 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:58:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.229+0000 7fd84f1ff700 1 Processor -- start 2023-10-09T06:58:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.229+0000 7fd84f1ff700 1 -- start start 2023-10-09T06:58:10.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.230+0000 7fd84f1ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd8480cbf30 0x7fd8480ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:10.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.230+0000 7fd84f1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd8480ccf90 0x7fd8480b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:10.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.230+0000 7fd84f1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd84815a270 0x7fd8480b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:10.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.230+0000 7fd84f1ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd848156bf0 con 0x7fd8480cbf30 2023-10-09T06:58:10.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.230+0000 7fd84f1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8480ae950 con 0x7fd8480ccf90 2023-10-09T06:58:10.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.230+0000 7fd84f1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480cc300 con 0x7fd84815a270 2023-10-09T06:58:10.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.231+0000 7fd84cf9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd8480cbf30 0x7fd8480ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:10.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.231+0000 7fd84cf9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd8480cbf30 0x7fd8480ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59990/0 (socket says 172.21.15.71:59990) 2023-10-09T06:58:10.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.231+0000 7fd84cf9b700 1 -- 172.21.15.71:0/3545039139 learned_addr learned my addr 172.21.15.71:0/3545039139 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:10.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.231+0000 7fd847fff700 1 --2- 172.21.15.71:0/3545039139 >> v2:172.21.15.179:3300/0 conn(0x7fd8480ccf90 0x7fd8480b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:10.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.231+0000 7fd84d79c700 1 --2- 172.21.15.71:0/3545039139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd84815a270 0x7fd8480b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:10.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.231+0000 7fd84cf9b700 1 -- 172.21.15.71:0/3545039139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd84815a270 msgr2=0x7fd8480b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:10.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.231+0000 7fd84cf9b700 1 --2- 172.21.15.71:0/3545039139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd84815a270 0x7fd8480b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:10.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.231+0000 7fd84cf9b700 1 -- 172.21.15.71:0/3545039139 >> v2:172.21.15.179:3300/0 conn(0x7fd8480ccf90 msgr2=0x7fd8480b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:10.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.231+0000 7fd84cf9b700 1 --2- 172.21.15.71:0/3545039139 >> v2:172.21.15.179:3300/0 conn(0x7fd8480ccf90 0x7fd8480b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:10.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.231+0000 7fd84cf9b700 1 -- 172.21.15.71:0/3545039139 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8480ad370 con 0x7fd8480cbf30 2023-10-09T06:58:10.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.231+0000 7fd84d79c700 1 --2- 172.21.15.71:0/3545039139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd84815a270 0x7fd8480b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:10.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.231+0000 7fd847fff700 1 --2- 172.21.15.71:0/3545039139 >> v2:172.21.15.179:3300/0 conn(0x7fd8480ccf90 0x7fd8480b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:10.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.231+0000 7fd84cf9b700 1 --2- 172.21.15.71:0/3545039139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8480cbf30 0x7fd8480ae410 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd84806d670 tx=0x7fd83c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3963974e8d69249 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:10.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.232+0000 7fd8477fe700 1 -- 172.21.15.71:0/3545039139 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c00b820 con 0x7fd8480cbf30 2023-10-09T06:58:10.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.232+0000 7fd8477fe700 1 -- 172.21.15.71:0/3545039139 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83c00b980 con 0x7fd8480cbf30 2023-10-09T06:58:10.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.232+0000 7fd8477fe700 1 -- 172.21.15.71:0/3545039139 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c00bd20 con 0x7fd8480cbf30 2023-10-09T06:58:10.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.232+0000 7fd84f1ff700 1 -- 172.21.15.71:0/3545039139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8480cbf30 msgr2=0x7fd8480ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:10.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.232+0000 7fd84f1ff700 1 --2- 172.21.15.71:0/3545039139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8480cbf30 0x7fd8480ae410 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd84806d670 tx=0x7fd83c009250 comp rx=0 tx=0).stop 2023-10-09T06:58:10.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.232+0000 7fd84f1ff700 1 -- 172.21.15.71:0/3545039139 shutdown_connections 2023-10-09T06:58:10.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.232+0000 7fd84f1ff700 1 --2- 172.21.15.71:0/3545039139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd84815a270 0x7fd8480b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:10.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.232+0000 7fd84f1ff700 1 --2- 172.21.15.71:0/3545039139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8480cbf30 0x7fd8480ae410 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:10.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.232+0000 7fd84f1ff700 1 --2- 172.21.15.71:0/3545039139 >> v2:172.21.15.179:3300/0 conn(0x7fd8480ccf90 0x7fd8480b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:10.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.232+0000 7fd84f1ff700 1 -- 172.21.15.71:0/3545039139 >> 172.21.15.71:0/3545039139 conn(0x7fd84806a320 msgr2=0x7fd8480cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:10.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.232+0000 7fd84f1ff700 1 -- 172.21.15.71:0/3545039139 shutdown_connections 2023-10-09T06:58:10.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.232+0000 7fd84f1ff700 1 -- 172.21.15.71:0/3545039139 wait complete. 2023-10-09T06:58:10.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.234+0000 7fd84f1ff700 1 Processor -- start 2023-10-09T06:58:10.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.234+0000 7fd84f1ff700 1 -- start start 2023-10-09T06:58:10.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.235+0000 7fd84f1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8480cbf30 0x7fd848163ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:10.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.235+0000 7fd84f1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8480ccf90 0x7fd84815d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:10.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.235+0000 7fd84f1ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd84815a270 0x7fd84815da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:10.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.235+0000 7fd84f1ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480ab950 con 0x7fd84815a270 2023-10-09T06:58:10.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.235+0000 7fd84f1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480abc30 con 0x7fd8480cbf30 2023-10-09T06:58:10.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.235+0000 7fd84f1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480abf10 con 0x7fd8480ccf90 2023-10-09T06:58:10.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.235+0000 7fd84d79c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd84815a270 0x7fd84815da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:10.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.235+0000 7fd84d79c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd84815a270 0x7fd84815da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60004/0 (socket says 172.21.15.71:60004) 2023-10-09T06:58:10.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.235+0000 7fd84d79c700 1 -- 172.21.15.71:0/1135720206 learned_addr learned my addr 172.21.15.71:0/1135720206 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:10.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.235+0000 7fd84cf9b700 1 --2- 172.21.15.71:0/1135720206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8480cbf30 0x7fd848163ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:10.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.235+0000 7fd847fff700 1 --2- 172.21.15.71:0/1135720206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8480ccf90 0x7fd84815d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:10.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.236+0000 7fd84d79c700 1 -- 172.21.15.71:0/1135720206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8480ccf90 msgr2=0x7fd84815d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:10.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.236+0000 7fd84d79c700 1 --2- 172.21.15.71:0/1135720206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8480ccf90 0x7fd84815d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:10.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.236+0000 7fd84d79c700 1 -- 172.21.15.71:0/1135720206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8480cbf30 msgr2=0x7fd848163ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:10.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.236+0000 7fd84d79c700 1 --2- 172.21.15.71:0/1135720206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8480cbf30 0x7fd848163ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:10.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.236+0000 7fd84d79c700 1 -- 172.21.15.71:0/1135720206 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c0094f0 con 0x7fd84815a270 2023-10-09T06:58:10.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.236+0000 7fd84d79c700 1 --2- 172.21.15.71:0/1135720206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd84815a270 0x7fd84815da40 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd84000d0d0 tx=0x7fd8400099d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:10.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.236+0000 7fd844ff9700 1 -- 172.21.15.71:0/1135720206 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84000dc10 con 0x7fd84815a270 2023-10-09T06:58:10.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.236+0000 7fd844ff9700 1 -- 172.21.15.71:0/1135720206 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84000f040 con 0x7fd84815a270 2023-10-09T06:58:10.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.236+0000 7fd844ff9700 1 -- 172.21.15.71:0/1135720206 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840015440 con 0x7fd84815a270 2023-10-09T06:58:10.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.236+0000 7fd84f1ff700 1 -- 172.21.15.71:0/1135720206 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8480ac1f0 con 0x7fd84815a270 2023-10-09T06:58:10.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.236+0000 7fd84f1ff700 1 -- 172.21.15.71:0/1135720206 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8480aac20 con 0x7fd84815a270 2023-10-09T06:58:10.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.237+0000 7fd84f1ff700 1 -- 172.21.15.71:0/1135720206 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd84804c3c0 con 0x7fd84815a270 2023-10-09T06:58:10.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.238+0000 7fd844ff9700 1 -- 172.21.15.71:0/1135720206 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd84001e3b0 con 0x7fd84815a270 2023-10-09T06:58:10.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.239+0000 7fd844ff9700 1 --2- 172.21.15.71:0/1135720206 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd82c066f30 0x7fd82c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:10.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.239+0000 7fd844ff9700 1 -- 172.21.15.71:0/1135720206 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fd840084b70 con 0x7fd84815a270 2023-10-09T06:58:10.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.239+0000 7fd84cf9b700 1 --2- 172.21.15.71:0/1135720206 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd82c066f30 0x7fd82c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:10.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.240+0000 7fd84cf9b700 1 --2- 172.21.15.71:0/1135720206 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd82c066f30 0x7fd82c0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd84806d670 tx=0x7fd83c017000 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:10.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.243+0000 7fd844ff9700 1 -- 172.21.15.71:0/1135720206 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd840051bb0 con 0x7fd84815a270 2023-10-09T06:58:10.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.427+0000 7fd84f1ff700 1 -- 172.21.15.71:0/1135720206 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8480ad0b0 con 0x7fd82c066f30 2023-10-09T06:58:10.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.437+0000 7fd844ff9700 1 -- 172.21.15.71:0/1135720206 <== mgr.6274 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289157 (secure 0 0 0) 0x7fd8480ad0b0 con 0x7fd82c066f30 2023-10-09T06:58:10.442 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.440+0000 7fd84f1ff700 1 -- 172.21.15.71:0/1135720206 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd82c066f30 msgr2=0x7fd82c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.440+0000 7fd84f1ff700 1 --2- 172.21.15.71:0/1135720206 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd82c066f30 0x7fd82c0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd84806d670 tx=0x7fd83c017000 comp rx=0 tx=0).stop 2023-10-09T06:58:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.440+0000 7fd84f1ff700 1 -- 172.21.15.71:0/1135720206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd84815a270 msgr2=0x7fd84815da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.440+0000 7fd84f1ff700 1 --2- 172.21.15.71:0/1135720206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd84815a270 0x7fd84815da40 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd84000d0d0 tx=0x7fd8400099d0 comp rx=0 tx=0).stop 2023-10-09T06:58:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.440+0000 7fd84f1ff700 1 -- 172.21.15.71:0/1135720206 shutdown_connections 2023-10-09T06:58:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.440+0000 7fd84f1ff700 1 --2- 172.21.15.71:0/1135720206 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd82c066f30 0x7fd82c0693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.440+0000 7fd84f1ff700 1 --2- 172.21.15.71:0/1135720206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd84815a270 0x7fd84815da40 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.440+0000 7fd84f1ff700 1 --2- 172.21.15.71:0/1135720206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8480cbf30 0x7fd848163ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.441+0000 7fd84f1ff700 1 --2- 172.21.15.71:0/1135720206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8480ccf90 0x7fd84815d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.441+0000 7fd84f1ff700 1 -- 172.21.15.71:0/1135720206 >> 172.21.15.71:0/1135720206 conn(0x7fd84806a320 msgr2=0x7fd84806ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.441+0000 7fd84f1ff700 1 -- 172.21.15.71:0/1135720206 shutdown_connections 2023-10-09T06:58:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:10.441+0000 7fd84f1ff700 1 -- 172.21.15.71:0/1135720206 wait complete. 2023-10-09T06:58:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:58:10.460 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-09T06:58:10.030318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":323,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2433448,"kb_used_data":10088,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752541272,"statfs":{"total":773094113280,"available":770602262528,"internally_reserved":0,"allocated":10330112,"data_stored":5575148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.770964"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.792788+0000","last_change":"2023-10-09T06:58:03.789534+0000","last_active":"2023-10-09T06:58:03.792788+0000","last_peered":"2023-10-09T06:58:03.792788+0000","last_clean":"2023-10-09T06:58:03.792788+0000","last_became_active":"2023-10-09T06:58:03.789290+0000","last_became_peered":"2023-10-09T06:58:03.789290+0000","last_unstale":"2023-10-09T06:58:03.792788+0000","last_undegraded":"2023-10-09T06:58:03.792788+0000","last_fullsized":"2023-10-09T06:58:03.792788+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:50:36.641716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.794824+0000","last_change":"2023-10-09T06:58:03.789945+0000","last_active":"2023-10-09T06:58:03.794824+0000","last_peered":"2023-10-09T06:58:03.794824+0000","last_clean":"2023-10-09T06:58:03.794824+0000","last_became_active":"2023-10-09T06:58:03.789174+0000","last_became_peered":"2023-10-09T06:58:03.789174+0000","last_unstale":"2023-10-09T06:58:03.794824+0000","last_undegraded":"2023-10-09T06:58:03.794824+0000","last_fullsized":"2023-10-09T06:58:03.794824+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:06:31.549641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781741+0000","last_change":"2023-10-09T06:58:03.778823+0000","last_active":"2023-10-09T06:58:03.781741+0000","last_peered":"2023-10-09T06:58:03.781741+0000","last_clean":"2023-10-09T06:58:03.781741+0000","last_became_active":"2023-10-09T06:58:03.778577+0000","last_became_peered":"2023-10-09T06:58:03.778577+0000","last_unstale":"2023-10-09T06:58:03.781741+0000","last_undegraded":"2023-10-09T06:58:03.781741+0000","last_fullsized":"2023-10-09T06:58:03.781741+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:19.132641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.791624+0000","last_change":"2023-10-09T06:58:03.790890+0000","last_active":"2023-10-09T06:58:03.791624+0000","last_peered":"2023-10-09T06:58:03.791624+0000","last_clean":"2023-10-09T06:58:03.791624+0000","last_became_active":"2023-10-09T06:58:03.790601+0000","last_became_peered":"2023-10-09T06:58:03.790601+0000","last_unstale":"2023-10-09T06:58:03.791624+0000","last_undegraded":"2023-10-09T06:58:03.791624+0000","last_fullsized":"2023-10-09T06:58:03.791624+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:39.273916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.788534+0000","last_change":"2023-10-09T06:58:03.787537+0000","last_active":"2023-10-09T06:58:03.788534+0000","last_peered":"2023-10-09T06:58:03.788534+0000","last_clean":"2023-10-09T06:58:03.788534+0000","last_became_active":"2023-10-09T06:58:03.787261+0000","last_became_peered":"2023-10-09T06:58:03.787261+0000","last_unstale":"2023-10-09T06:58:03.788534+0000","last_undegraded":"2023-10-09T06:58:03.788534+0000","last_fullsized":"2023-10-09T06:58:03.788534+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:49:37.095152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.791144+0000","last_change":"2023-10-09T06:58:03.786533+0000","last_active":"2023-10-09T06:58:03.791144+0000","last_peered":"2023-10-09T06:58:03.791144+0000","last_clean":"2023-10-09T06:58:03.791144+0000","last_became_active":"2023-10-09T06:58:03.786175+0000","last_became_peered":"2023-10-09T06:58:03.786175+0000","last_unstale":"2023-10-09T06:58:03.791144+0000","last_undegraded":"2023-10-09T06:58:03.791144+0000","last_fullsized":"2023-10-09T06:58:03.791144+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:47:17.600550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.785849+0000","last_change":"2023-10-09T06:58:03.783980+0000","last_active":"2023-10-09T06:58:03.785849+0000","last_peered":"2023-10-09T06:58:03.785849+0000","last_clean":"2023-10-09T06:58:03.785849+0000","last_became_active":"2023-10-09T06:58:03.783692+0000","last_became_peered":"2023-10-09T06:58:03.783692+0000","last_unstale":"2023-10-09T06:58:03.785849+0000","last_undegraded":"2023-10-09T06:58:03.785849+0000","last_fullsized":"2023-10-09T06:58:03.785849+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:31.444809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.795661+0000","last_change":"2023-10-09T06:58:03.792074+0000","last_active":"2023-10-09T06:58:03.795661+0000","last_peered":"2023-10-09T06:58:03.795661+0000","last_clean":"2023-10-09T06:58:03.795661+0000","last_became_active":"2023-10-09T06:58:03.788540+0000","last_became_peered":"2023-10-09T06:58:03.788540+0000","last_unstale":"2023-10-09T06:58:03.795661+0000","last_undegraded":"2023-10-09T06:58:03.795661+0000","last_fullsized":"2023-10-09T06:58:03.795661+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:25.556491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781603+0000","last_change":"2023-10-09T06:58:03.779446+0000","last_active":"2023-10-09T06:58:03.781603+0000","last_peered":"2023-10-09T06:58:03.781603+0000","last_clean":"2023-10-09T06:58:03.781603+0000","last_became_active":"2023-10-09T06:58:03.779142+0000","last_became_peered":"2023-10-09T06:58:03.779142+0000","last_unstale":"2023-10-09T06:58:03.781603+0000","last_undegraded":"2023-10-09T06:58:03.781603+0000","last_fullsized":"2023-10-09T06:58:03.781603+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:42.427200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.789415+0000","last_change":"2023-10-09T06:58:03.787051+0000","last_active":"2023-10-09T06:58:03.789415+0000","last_peered":"2023-10-09T06:58:03.789415+0000","last_clean":"2023-10-09T06:58:03.789415+0000","last_became_active":"2023-10-09T06:58:03.786743+0000","last_became_peered":"2023-10-09T06:58:03.786743+0000","last_unstale":"2023-10-09T06:58:03.789415+0000","last_undegraded":"2023-10-09T06:58:03.789415+0000","last_fullsized":"2023-10-09T06:58:03.789415+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:49:20.065373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.787921+0000","last_change":"2023-10-09T06:58:03.784751+0000","last_active":"2023-10-09T06:58:03.787921+0000","last_peered":"2023-10-09T06:58:03.787921+0000","last_clean":"2023-10-09T06:58:03.787921+0000","last_became_active":"2023-10-09T06:58:03.784412+0000","last_became_peered":"2023-10-09T06:58:03.784412+0000","last_unstale":"2023-10-09T06:58:03.787921+0000","last_undegraded":"2023-10-09T06:58:03.787921+0000","last_fullsized":"2023-10-09T06:58:03.787921+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:31.444809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.786488+0000","last_change":"2023-10-09T06:58:03.783075+0000","last_active":"2023-10-09T06:58:03.786488+0000","last_peered":"2023-10-09T06:58:03.786488+0000","last_clean":"2023-10-09T06:58:03.786488+0000","last_became_active":"2023-10-09T06:58:03.782836+0000","last_became_peered":"2023-10-09T06:58:03.782836+0000","last_unstale":"2023-10-09T06:58:03.786488+0000","last_undegraded":"2023-10-09T06:58:03.786488+0000","last_fullsized":"2023-10-09T06:58:03.786488+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:27.010548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.788787+0000","last_change":"2023-10-09T06:58:03.788199+0000","last_active":"2023-10-09T06:58:03.788787+0000","last_peered":"2023-10-09T06:58:03.788787+0000","last_clean":"2023-10-09T06:58:03.788787+0000","last_became_active":"2023-10-09T06:58:03.787893+0000","last_became_peered":"2023-10-09T06:58:03.787893+0000","last_unstale":"2023-10-09T06:58:03.788787+0000","last_undegraded":"2023-10-09T06:58:03.788787+0000","last_fullsized":"2023-10-09T06:58:03.788787+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:44.586446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.778194+0000","last_change":"2023-10-09T06:58:03.774830+0000","last_active":"2023-10-09T06:58:03.778194+0000","last_peered":"2023-10-09T06:58:03.778194+0000","last_clean":"2023-10-09T06:58:03.778194+0000","last_became_active":"2023-10-09T06:58:03.774540+0000","last_became_peered":"2023-10-09T06:58:03.774540+0000","last_unstale":"2023-10-09T06:58:03.778194+0000","last_undegraded":"2023-10-09T06:58:03.778194+0000","last_fullsized":"2023-10-09T06:58:03.778194+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:55.445121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.784320+0000","last_change":"2023-10-09T06:58:03.782721+0000","last_active":"2023-10-09T06:58:03.784320+0000","last_peered":"2023-10-09T06:58:03.784320+0000","last_clean":"2023-10-09T06:58:03.784320+0000","last_became_active":"2023-10-09T06:58:03.782471+0000","last_became_peered":"2023-10-09T06:58:03.782471+0000","last_unstale":"2023-10-09T06:58:03.784320+0000","last_undegraded":"2023-10-09T06:58:03.784320+0000","last_fullsized":"2023-10-09T06:58:03.784320+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:01.380815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.793615+0000","last_change":"2023-10-09T06:58:03.792174+0000","last_active":"2023-10-09T06:58:03.793615+0000","last_peered":"2023-10-09T06:58:03.793615+0000","last_clean":"2023-10-09T06:58:03.793615+0000","last_became_active":"2023-10-09T06:58:03.791905+0000","last_became_peered":"2023-10-09T06:58:03.791905+0000","last_unstale":"2023-10-09T06:58:03.793615+0000","last_undegraded":"2023-10-09T06:58:03.793615+0000","last_fullsized":"2023-10-09T06:58:03.793615+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:50.295594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781583+0000","last_change":"2023-10-09T06:58:03.778825+0000","last_active":"2023-10-09T06:58:03.781583+0000","last_peered":"2023-10-09T06:58:03.781583+0000","last_clean":"2023-10-09T06:58:03.781583+0000","last_became_active":"2023-10-09T06:58:03.778586+0000","last_became_peered":"2023-10-09T06:58:03.778586+0000","last_unstale":"2023-10-09T06:58:03.781583+0000","last_undegraded":"2023-10-09T06:58:03.781583+0000","last_fullsized":"2023-10-09T06:58:03.781583+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:38:42.093928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.792047+0000","last_change":"2023-10-09T06:58:03.790976+0000","last_active":"2023-10-09T06:58:03.792047+0000","last_peered":"2023-10-09T06:58:03.792047+0000","last_clean":"2023-10-09T06:58:03.792047+0000","last_became_active":"2023-10-09T06:58:03.790611+0000","last_became_peered":"2023-10-09T06:58:03.790611+0000","last_unstale":"2023-10-09T06:58:03.792047+0000","last_undegraded":"2023-10-09T06:58:03.792047+0000","last_fullsized":"2023-10-09T06:58:03.792047+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:45:13.736492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.794689+0000","last_change":"2023-10-09T06:58:03.789940+0000","last_active":"2023-10-09T06:58:03.794689+0000","last_peered":"2023-10-09T06:58:03.794689+0000","last_clean":"2023-10-09T06:58:03.794689+0000","last_became_active":"2023-10-09T06:58:03.789643+0000","last_became_peered":"2023-10-09T06:58:03.789643+0000","last_unstale":"2023-10-09T06:58:03.794689+0000","last_undegraded":"2023-10-09T06:58:03.794689+0000","last_fullsized":"2023-10-09T06:58:03.794689+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:57:42.341129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.783595+0000","last_change":"2023-10-09T06:58:03.780575+0000","last_active":"2023-10-09T06:58:03.783595+0000","last_peered":"2023-10-09T06:58:03.783595+0000","last_clean":"2023-10-09T06:58:03.783595+0000","last_became_active":"2023-10-09T06:58:03.780287+0000","last_became_peered":"2023-10-09T06:58:03.780287+0000","last_unstale":"2023-10-09T06:58:03.783595+0000","last_undegraded":"2023-10-09T06:58:03.783595+0000","last_fullsized":"2023-10-09T06:58:03.783595+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:50.836527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.785013+0000","last_change":"2023-10-09T06:58:03.780486+0000","last_active":"2023-10-09T06:58:03.785013+0000","last_peered":"2023-10-09T06:58:03.785013+0000","last_clean":"2023-10-09T06:58:03.785013+0000","last_became_active":"2023-10-09T06:58:03.780211+0000","last_became_peered":"2023-10-09T06:58:03.780211+0000","last_unstale":"2023-10-09T06:58:03.785013+0000","last_undegraded":"2023-10-09T06:58:03.785013+0000","last_fullsized":"2023-10-09T06:58:03.785013+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:57:42.341129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.785061+0000","last_change":"2023-10-09T06:58:03.779844+0000","last_active":"2023-10-09T06:58:03.785061+0000","last_peered":"2023-10-09T06:58:03.785061+0000","last_clean":"2023-10-09T06:58:03.785061+0000","last_became_active":"2023-10-09T06:58:03.779562+0000","last_became_peered":"2023-10-09T06:58:03.779562+0000","last_unstale":"2023-10-09T06:58:03.785061+0000","last_undegraded":"2023-10-09T06:58:03.785061+0000","last_fullsized":"2023-10-09T06:58:03.785061+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:25.556491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.783296+0000","last_change":"2023-10-09T06:58:03.782386+0000","last_active":"2023-10-09T06:58:03.783296+0000","last_peered":"2023-10-09T06:58:03.783296+0000","last_clean":"2023-10-09T06:58:03.783296+0000","last_became_active":"2023-10-09T06:58:03.782073+0000","last_became_peered":"2023-10-09T06:58:03.782073+0000","last_unstale":"2023-10-09T06:58:03.783296+0000","last_undegraded":"2023-10-09T06:58:03.783296+0000","last_fullsized":"2023-10-09T06:58:03.783296+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:48:11.588308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.796330+0000","last_change":"2023-10-09T06:58:03.795684+0000","last_active":"2023-10-09T06:58:03.796330+0000","last_peered":"2023-10-09T06:58:03.796330+0000","last_clean":"2023-10-09T06:58:03.796330+0000","last_became_active":"2023-10-09T06:58:03.795288+0000","last_became_peered":"2023-10-09T06:58:03.795288+0000","last_unstale":"2023-10-09T06:58:03.796330+0000","last_undegraded":"2023-10-09T06:58:03.796330+0000","last_fullsized":"2023-10-09T06:58:03.796330+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:07.827266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.784911+0000","last_change":"2023-10-09T06:58:03.777803+0000","last_active":"2023-10-09T06:58:03.784911+0000","last_peered":"2023-10-09T06:58:03.784911+0000","last_clean":"2023-10-09T06:58:03.784911+0000","last_became_active":"2023-10-09T06:58:03.777439+0000","last_became_peered":"2023-10-09T06:58:03.777439+0000","last_unstale":"2023-10-09T06:58:03.784911+0000","last_undegraded":"2023-10-09T06:58:03.784911+0000","last_fullsized":"2023-10-09T06:58:03.784911+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:06:31.549641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.793171+0000","last_change":"2023-10-09T06:58:03.792692+0000","last_active":"2023-10-09T06:58:03.793171+0000","last_peered":"2023-10-09T06:58:03.793171+0000","last_clean":"2023-10-09T06:58:03.793171+0000","last_became_active":"2023-10-09T06:58:03.791146+0000","last_became_peered":"2023-10-09T06:58:03.791146+0000","last_unstale":"2023-10-09T06:58:03.793171+0000","last_undegraded":"2023-10-09T06:58:03.793171+0000","last_fullsized":"2023-10-09T06:58:03.793171+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:21.136138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.780921+0000","last_change":"2023-10-09T06:58:03.778338+0000","last_active":"2023-10-09T06:58:03.780921+0000","last_peered":"2023-10-09T06:58:03.780921+0000","last_clean":"2023-10-09T06:58:03.780921+0000","last_became_active":"2023-10-09T06:58:03.778095+0000","last_became_peered":"2023-10-09T06:58:03.778095+0000","last_unstale":"2023-10-09T06:58:03.780921+0000","last_undegraded":"2023-10-09T06:58:03.780921+0000","last_fullsized":"2023-10-09T06:58:03.780921+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:50.836527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.786486+0000","last_change":"2023-10-09T06:58:03.780636+0000","last_active":"2023-10-09T06:58:03.786486+0000","last_peered":"2023-10-09T06:58:03.786486+0000","last_clean":"2023-10-09T06:58:03.786486+0000","last_became_active":"2023-10-09T06:58:03.780355+0000","last_became_peered":"2023-10-09T06:58:03.780355+0000","last_unstale":"2023-10-09T06:58:03.786486+0000","last_undegraded":"2023-10-09T06:58:03.786486+0000","last_fullsized":"2023-10-09T06:58:03.786486+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:25:52.709241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.777660+0000","last_change":"2023-10-09T06:58:03.775523+0000","last_active":"2023-10-09T06:58:03.777660+0000","last_peered":"2023-10-09T06:58:03.777660+0000","last_clean":"2023-10-09T06:58:03.777660+0000","last_became_active":"2023-10-09T06:58:03.775252+0000","last_became_peered":"2023-10-09T06:58:03.775252+0000","last_unstale":"2023-10-09T06:58:03.777660+0000","last_undegraded":"2023-10-09T06:58:03.777660+0000","last_fullsized":"2023-10-09T06:58:03.777660+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:33:52.454840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.792556+0000","last_change":"2023-10-09T06:58:03.791431+0000","last_active":"2023-10-09T06:58:03.792556+0000","last_peered":"2023-10-09T06:58:03.792556+0000","last_clean":"2023-10-09T06:58:03.792556+0000","last_became_active":"2023-10-09T06:58:03.791137+0000","last_became_peered":"2023-10-09T06:58:03.791137+0000","last_unstale":"2023-10-09T06:58:03.792556+0000","last_undegraded":"2023-10-09T06:58:03.792556+0000","last_fullsized":"2023-10-09T06:58:03.792556+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:50:36.641716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781215+0000","last_change":"2023-10-09T06:58:03.779006+0000","last_active":"2023-10-09T06:58:03.781215+0000","last_peered":"2023-10-09T06:58:03.781215+0000","last_clean":"2023-10-09T06:58:03.781215+0000","last_became_active":"2023-10-09T06:58:03.778750+0000","last_became_peered":"2023-10-09T06:58:03.778750+0000","last_unstale":"2023-10-09T06:58:03.781215+0000","last_undegraded":"2023-10-09T06:58:03.781215+0000","last_fullsized":"2023-10-09T06:58:03.781215+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:48:11.588308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.795691+0000","last_change":"2023-10-09T06:58:03.792838+0000","last_active":"2023-10-09T06:58:03.795691+0000","last_peered":"2023-10-09T06:58:03.795691+0000","last_clean":"2023-10-09T06:58:03.795691+0000","last_became_active":"2023-10-09T06:58:03.789210+0000","last_became_peered":"2023-10-09T06:58:03.789210+0000","last_unstale":"2023-10-09T06:58:03.795691+0000","last_undegraded":"2023-10-09T06:58:03.795691+0000","last_fullsized":"2023-10-09T06:58:03.795691+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:49:20.065373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.794075+0000","last_change":"2023-10-09T06:58:03.791824+0000","last_active":"2023-10-09T06:58:03.794075+0000","last_peered":"2023-10-09T06:58:03.794075+0000","last_clean":"2023-10-09T06:58:03.794075+0000","last_became_active":"2023-10-09T06:58:03.791420+0000","last_became_peered":"2023-10-09T06:58:03.791420+0000","last_unstale":"2023-10-09T06:58:03.794075+0000","last_undegraded":"2023-10-09T06:58:03.794075+0000","last_fullsized":"2023-10-09T06:58:03.794075+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:21.136138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"92'4","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.295288+0000","last_change":"2023-10-09T06:58:03.272921+0000","last_active":"2023-10-09T06:58:04.295288+0000","last_peered":"2023-10-09T06:58:04.295288+0000","last_clean":"2023-10-09T06:58:04.295288+0000","last_became_active":"2023-10-09T06:58:03.272657+0000","last_became_peered":"2023-10-09T06:58:03.272657+0000","last_unstale":"2023-10-09T06:58:04.295288+0000","last_undegraded":"2023-10-09T06:58:04.295288+0000","last_fullsized":"2023-10-09T06:58:04.295288+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:47:16.591202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781593+0000","last_change":"2023-10-09T06:58:03.779335+0000","last_active":"2023-10-09T06:58:03.781593+0000","last_peered":"2023-10-09T06:58:03.781593+0000","last_clean":"2023-10-09T06:58:03.781593+0000","last_became_active":"2023-10-09T06:58:03.779073+0000","last_became_peered":"2023-10-09T06:58:03.779073+0000","last_unstale":"2023-10-09T06:58:03.781593+0000","last_undegraded":"2023-10-09T06:58:03.781593+0000","last_fullsized":"2023-10-09T06:58:03.781593+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:35.834887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"92'1","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.290439+0000","last_change":"2023-10-09T06:58:03.281341+0000","last_active":"2023-10-09T06:58:04.290439+0000","last_peered":"2023-10-09T06:58:04.290439+0000","last_clean":"2023-10-09T06:58:04.290439+0000","last_became_active":"2023-10-09T06:58:03.281014+0000","last_became_peered":"2023-10-09T06:58:03.281014+0000","last_unstale":"2023-10-09T06:58:04.290439+0000","last_undegraded":"2023-10-09T06:58:04.290439+0000","last_fullsized":"2023-10-09T06:58:04.290439+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:50:35.632368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.794958+0000","last_change":"2023-10-09T06:58:03.790823+0000","last_active":"2023-10-09T06:58:03.794958+0000","last_peered":"2023-10-09T06:58:03.794958+0000","last_clean":"2023-10-09T06:58:03.794958+0000","last_became_active":"2023-10-09T06:58:03.790499+0000","last_became_peered":"2023-10-09T06:58:03.790499+0000","last_unstale":"2023-10-09T06:58:03.794958+0000","last_undegraded":"2023-10-09T06:58:03.794958+0000","last_fullsized":"2023-10-09T06:58:03.794958+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:43:11.121942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"92'2","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.298982+0000","last_change":"2023-10-09T06:58:03.284110+0000","last_active":"2023-10-09T06:58:04.298982+0000","last_peered":"2023-10-09T06:58:04.298982+0000","last_clean":"2023-10-09T06:58:04.298982+0000","last_became_active":"2023-10-09T06:58:03.283761+0000","last_became_peered":"2023-10-09T06:58:03.283761+0000","last_unstale":"2023-10-09T06:58:04.298982+0000","last_undegraded":"2023-10-09T06:58:04.298982+0000","last_fullsized":"2023-10-09T06:58:04.298982+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:25.142797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.787941+0000","last_change":"2023-10-09T06:58:03.785933+0000","last_active":"2023-10-09T06:58:03.787941+0000","last_peered":"2023-10-09T06:58:03.787941+0000","last_clean":"2023-10-09T06:58:03.787941+0000","last_became_active":"2023-10-09T06:58:03.785654+0000","last_became_peered":"2023-10-09T06:58:03.785654+0000","last_unstale":"2023-10-09T06:58:03.787941+0000","last_undegraded":"2023-10-09T06:58:03.787941+0000","last_fullsized":"2023-10-09T06:58:03.787941+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:53.641729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"92'2","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.296422+0000","last_change":"2023-10-09T06:58:03.284511+0000","last_active":"2023-10-09T06:58:04.296422+0000","last_peered":"2023-10-09T06:58:04.296422+0000","last_clean":"2023-10-09T06:58:04.296422+0000","last_became_active":"2023-10-09T06:58:03.283943+0000","last_became_peered":"2023-10-09T06:58:03.283943+0000","last_unstale":"2023-10-09T06:58:04.296422+0000","last_undegraded":"2023-10-09T06:58:04.296422+0000","last_fullsized":"2023-10-09T06:58:04.296422+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:45:12.727143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.785214+0000","last_change":"2023-10-09T06:58:03.781836+0000","last_active":"2023-10-09T06:58:03.785214+0000","last_peered":"2023-10-09T06:58:03.785214+0000","last_clean":"2023-10-09T06:58:03.785214+0000","last_became_active":"2023-10-09T06:58:03.781556+0000","last_became_peered":"2023-10-09T06:58:03.781556+0000","last_unstale":"2023-10-09T06:58:03.785214+0000","last_undegraded":"2023-10-09T06:58:03.785214+0000","last_fullsized":"2023-10-09T06:58:03.785214+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:37:47.124680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"92'1","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.290920+0000","last_change":"2023-10-09T06:58:03.274347+0000","last_active":"2023-10-09T06:58:04.290920+0000","last_peered":"2023-10-09T06:58:04.290920+0000","last_clean":"2023-10-09T06:58:04.290920+0000","last_became_active":"2023-10-09T06:58:03.274034+0000","last_became_peered":"2023-10-09T06:58:03.274034+0000","last_unstale":"2023-10-09T06:58:04.290920+0000","last_undegraded":"2023-10-09T06:58:04.290920+0000","last_fullsized":"2023-10-09T06:58:04.290920+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:06.817917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.789333+0000","last_change":"2023-10-09T06:58:03.787185+0000","last_active":"2023-10-09T06:58:03.789333+0000","last_peered":"2023-10-09T06:58:03.789333+0000","last_clean":"2023-10-09T06:58:03.789333+0000","last_became_active":"2023-10-09T06:58:03.786868+0000","last_became_peered":"2023-10-09T06:58:03.786868+0000","last_unstale":"2023-10-09T06:58:03.789333+0000","last_undegraded":"2023-10-09T06:58:03.789333+0000","last_fullsized":"2023-10-09T06:58:03.789333+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:43:11.121942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"92'1","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.298648+0000","last_change":"2023-10-09T06:58:03.283484+0000","last_active":"2023-10-09T06:58:04.298648+0000","last_peered":"2023-10-09T06:58:04.298648+0000","last_clean":"2023-10-09T06:58:04.298648+0000","last_became_active":"2023-10-09T06:58:03.283124+0000","last_became_peered":"2023-10-09T06:58:03.283124+0000","last_unstale":"2023-10-09T06:58:04.298648+0000","last_undegraded":"2023-10-09T06:58:04.298648+0000","last_fullsized":"2023-10-09T06:58:04.298648+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:02.609888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.780519+0000","last_change":"2023-10-09T06:58:03.778295+0000","last_active":"2023-10-09T06:58:03.780519+0000","last_peered":"2023-10-09T06:58:03.780519+0000","last_clean":"2023-10-09T06:58:03.780519+0000","last_became_active":"2023-10-09T06:58:03.777990+0000","last_became_peered":"2023-10-09T06:58:03.777990+0000","last_unstale":"2023-10-09T06:58:03.780519+0000","last_undegraded":"2023-10-09T06:58:03.780519+0000","last_fullsized":"2023-10-09T06:58:03.780519+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:38.362218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.776114+0000","last_change":"2023-10-09T06:58:03.278385+0000","last_active":"2023-10-09T06:58:03.776114+0000","last_peered":"2023-10-09T06:58:03.776114+0000","last_clean":"2023-10-09T06:58:03.776114+0000","last_became_active":"2023-10-09T06:58:03.278063+0000","last_became_peered":"2023-10-09T06:58:03.278063+0000","last_unstale":"2023-10-09T06:58:03.776114+0000","last_undegraded":"2023-10-09T06:58:03.776114+0000","last_fullsized":"2023-10-09T06:58:03.776114+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:01:05.569394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.787641+0000","last_change":"2023-10-09T06:58:03.786407+0000","last_active":"2023-10-09T06:58:03.787641+0000","last_peered":"2023-10-09T06:58:03.787641+0000","last_clean":"2023-10-09T06:58:03.787641+0000","last_became_active":"2023-10-09T06:58:03.786139+0000","last_became_peered":"2023-10-09T06:58:03.786139+0000","last_unstale":"2023-10-09T06:58:03.787641+0000","last_undegraded":"2023-10-09T06:58:03.787641+0000","last_fullsized":"2023-10-09T06:58:03.787641+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:54:29.099122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.773510+0000","last_change":"2023-10-09T06:58:03.274854+0000","last_active":"2023-10-09T06:58:03.773510+0000","last_peered":"2023-10-09T06:58:03.773510+0000","last_clean":"2023-10-09T06:58:03.773510+0000","last_became_active":"2023-10-09T06:58:03.274591+0000","last_became_peered":"2023-10-09T06:58:03.274591+0000","last_unstale":"2023-10-09T06:58:03.773510+0000","last_undegraded":"2023-10-09T06:58:03.773510+0000","last_fullsized":"2023-10-09T06:58:03.773510+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:27:49.714248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.785226+0000","last_change":"2023-10-09T06:58:03.782408+0000","last_active":"2023-10-09T06:58:03.785226+0000","last_peered":"2023-10-09T06:58:03.785226+0000","last_clean":"2023-10-09T06:58:03.785226+0000","last_became_active":"2023-10-09T06:58:03.782092+0000","last_became_peered":"2023-10-09T06:58:03.782092+0000","last_unstale":"2023-10-09T06:58:03.785226+0000","last_undegraded":"2023-10-09T06:58:03.785226+0000","last_fullsized":"2023-10-09T06:58:03.785226+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:32:56.779064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.771080+0000","last_change":"2023-10-09T06:58:03.275785+0000","last_active":"2023-10-09T06:58:03.771080+0000","last_peered":"2023-10-09T06:58:03.771080+0000","last_clean":"2023-10-09T06:58:03.771080+0000","last_became_active":"2023-10-09T06:58:03.275488+0000","last_became_peered":"2023-10-09T06:58:03.275488+0000","last_unstale":"2023-10-09T06:58:03.771080+0000","last_undegraded":"2023-10-09T06:58:03.771080+0000","last_fullsized":"2023-10-09T06:58:03.771080+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:17.053444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.794206+0000","last_change":"2023-10-09T06:58:03.792929+0000","last_active":"2023-10-09T06:58:03.794206+0000","last_peered":"2023-10-09T06:58:03.794206+0000","last_clean":"2023-10-09T06:58:03.794206+0000","last_became_active":"2023-10-09T06:58:03.792605+0000","last_became_peered":"2023-10-09T06:58:03.792605+0000","last_unstale":"2023-10-09T06:58:03.794206+0000","last_undegraded":"2023-10-09T06:58:03.794206+0000","last_fullsized":"2023-10-09T06:58:03.794206+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:37:47.124680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.785180+0000","last_change":"2023-10-09T06:58:03.283460+0000","last_active":"2023-10-09T06:58:03.785180+0000","last_peered":"2023-10-09T06:58:03.785180+0000","last_clean":"2023-10-09T06:58:03.785180+0000","last_became_active":"2023-10-09T06:58:03.283143+0000","last_became_peered":"2023-10-09T06:58:03.283143+0000","last_unstale":"2023-10-09T06:58:03.785180+0000","last_undegraded":"2023-10-09T06:58:03.785180+0000","last_fullsized":"2023-10-09T06:58:03.785180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:13.207974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.794559+0000","last_change":"2023-10-09T06:58:03.789549+0000","last_active":"2023-10-09T06:58:03.794559+0000","last_peered":"2023-10-09T06:58:03.794559+0000","last_clean":"2023-10-09T06:58:03.794559+0000","last_became_active":"2023-10-09T06:58:03.789165+0000","last_became_peered":"2023-10-09T06:58:03.789165+0000","last_unstale":"2023-10-09T06:58:03.794559+0000","last_undegraded":"2023-10-09T06:58:03.794559+0000","last_fullsized":"2023-10-09T06:58:03.794559+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:25:52.709241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"92'3","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.293010+0000","last_change":"2023-10-09T06:58:03.277580+0000","last_active":"2023-10-09T06:58:04.293010+0000","last_peered":"2023-10-09T06:58:04.293010+0000","last_clean":"2023-10-09T06:58:04.293010+0000","last_became_active":"2023-10-09T06:58:03.277331+0000","last_became_peered":"2023-10-09T06:58:03.277331+0000","last_unstale":"2023-10-09T06:58:04.293010+0000","last_undegraded":"2023-10-09T06:58:04.293010+0000","last_fullsized":"2023-10-09T06:58:04.293010+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:52.632381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781319+0000","last_change":"2023-10-09T06:58:03.779510+0000","last_active":"2023-10-09T06:58:03.781319+0000","last_peered":"2023-10-09T06:58:03.781319+0000","last_clean":"2023-10-09T06:58:03.781319+0000","last_became_active":"2023-10-09T06:58:03.778576+0000","last_became_peered":"2023-10-09T06:58:03.778576+0000","last_unstale":"2023-10-09T06:58:03.781319+0000","last_undegraded":"2023-10-09T06:58:03.781319+0000","last_fullsized":"2023-10-09T06:58:03.781319+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:43:18.959668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"92'6","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.295792+0000","last_change":"2023-10-09T06:58:03.281626+0000","last_active":"2023-10-09T06:58:04.295792+0000","last_peered":"2023-10-09T06:58:04.295792+0000","last_clean":"2023-10-09T06:58:04.295792+0000","last_became_active":"2023-10-09T06:58:03.280397+0000","last_became_peered":"2023-10-09T06:58:03.280397+0000","last_unstale":"2023-10-09T06:58:04.295792+0000","last_undegraded":"2023-10-09T06:58:04.295792+0000","last_fullsized":"2023-10-09T06:58:04.295792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:08:56.251029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.791789+0000","last_change":"2023-10-09T06:58:03.790284+0000","last_active":"2023-10-09T06:58:03.791789+0000","last_peered":"2023-10-09T06:58:03.791789+0000","last_clean":"2023-10-09T06:58:03.791789+0000","last_became_active":"2023-10-09T06:58:03.789908+0000","last_became_peered":"2023-10-09T06:58:03.789908+0000","last_unstale":"2023-10-09T06:58:03.791789+0000","last_undegraded":"2023-10-09T06:58:03.791789+0000","last_fullsized":"2023-10-09T06:58:03.791789+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:04:00.621347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"92'2","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.294274+0000","last_change":"2023-10-09T06:58:03.278338+0000","last_active":"2023-10-09T06:58:04.294274+0000","last_peered":"2023-10-09T06:58:04.294274+0000","last_clean":"2023-10-09T06:58:04.294274+0000","last_became_active":"2023-10-09T06:58:03.278052+0000","last_became_peered":"2023-10-09T06:58:03.278052+0000","last_unstale":"2023-10-09T06:58:04.294274+0000","last_undegraded":"2023-10-09T06:58:04.294274+0000","last_fullsized":"2023-10-09T06:58:04.294274+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:34.825539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.775447+0000","last_change":"2023-10-09T06:58:03.773873+0000","last_active":"2023-10-09T06:58:03.775447+0000","last_peered":"2023-10-09T06:58:03.775447+0000","last_clean":"2023-10-09T06:58:03.775447+0000","last_became_active":"2023-10-09T06:58:03.773515+0000","last_became_peered":"2023-10-09T06:58:03.773515+0000","last_unstale":"2023-10-09T06:58:03.775447+0000","last_undegraded":"2023-10-09T06:58:03.775447+0000","last_fullsized":"2023-10-09T06:58:03.775447+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:55.201809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.784360+0000","last_change":"2023-10-09T06:58:03.281877+0000","last_active":"2023-10-09T06:58:03.784360+0000","last_peered":"2023-10-09T06:58:03.784360+0000","last_clean":"2023-10-09T06:58:03.784360+0000","last_became_active":"2023-10-09T06:58:03.281627+0000","last_became_peered":"2023-10-09T06:58:03.281627+0000","last_unstale":"2023-10-09T06:58:03.784360+0000","last_undegraded":"2023-10-09T06:58:03.784360+0000","last_fullsized":"2023-10-09T06:58:03.784360+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:33.198191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.787196+0000","last_change":"2023-10-09T06:58:03.786093+0000","last_active":"2023-10-09T06:58:03.787196+0000","last_peered":"2023-10-09T06:58:03.787196+0000","last_clean":"2023-10-09T06:58:03.787196+0000","last_became_active":"2023-10-09T06:58:03.785836+0000","last_became_peered":"2023-10-09T06:58:03.785836+0000","last_unstale":"2023-10-09T06:58:03.787196+0000","last_undegraded":"2023-10-09T06:58:03.787196+0000","last_fullsized":"2023-10-09T06:58:03.787196+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:10.559656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.770284+0000","last_change":"2023-10-09T06:58:03.276634+0000","last_active":"2023-10-09T06:58:03.770284+0000","last_peered":"2023-10-09T06:58:03.770284+0000","last_clean":"2023-10-09T06:58:03.770284+0000","last_became_active":"2023-10-09T06:58:03.276352+0000","last_became_peered":"2023-10-09T06:58:03.276352+0000","last_unstale":"2023-10-09T06:58:03.770284+0000","last_undegraded":"2023-10-09T06:58:03.770284+0000","last_fullsized":"2023-10-09T06:58:03.770284+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:06:30.540293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781370+0000","last_change":"2023-10-09T06:58:03.780365+0000","last_active":"2023-10-09T06:58:03.781370+0000","last_peered":"2023-10-09T06:58:03.781370+0000","last_clean":"2023-10-09T06:58:03.781370+0000","last_became_active":"2023-10-09T06:58:03.779868+0000","last_became_peered":"2023-10-09T06:58:03.779868+0000","last_unstale":"2023-10-09T06:58:03.781370+0000","last_undegraded":"2023-10-09T06:58:03.781370+0000","last_fullsized":"2023-10-09T06:58:03.781370+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:29:24.208508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"92'8","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.299394+0000","last_change":"2023-10-09T06:58:03.277129+0000","last_active":"2023-10-09T06:58:04.299394+0000","last_peered":"2023-10-09T06:58:04.299394+0000","last_clean":"2023-10-09T06:58:04.299394+0000","last_became_active":"2023-10-09T06:58:03.276851+0000","last_became_peered":"2023-10-09T06:58:03.276851+0000","last_unstale":"2023-10-09T06:58:04.299394+0000","last_undegraded":"2023-10-09T06:58:04.299394+0000","last_fullsized":"2023-10-09T06:58:04.299394+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:45:12.727143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.784941+0000","last_change":"2023-10-09T06:58:03.778392+0000","last_active":"2023-10-09T06:58:03.784941+0000","last_peered":"2023-10-09T06:58:03.784941+0000","last_clean":"2023-10-09T06:58:03.784941+0000","last_became_active":"2023-10-09T06:58:03.778133+0000","last_became_peered":"2023-10-09T06:58:03.778133+0000","last_unstale":"2023-10-09T06:58:03.784941+0000","last_undegraded":"2023-10-09T06:58:03.784941+0000","last_fullsized":"2023-10-09T06:58:03.784941+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:46:16.740158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"92'1","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.298779+0000","last_change":"2023-10-09T06:58:03.280938+0000","last_active":"2023-10-09T06:58:04.298779+0000","last_peered":"2023-10-09T06:58:04.298779+0000","last_clean":"2023-10-09T06:58:04.298779+0000","last_became_active":"2023-10-09T06:58:03.280556+0000","last_became_peered":"2023-10-09T06:58:03.280556+0000","last_unstale":"2023-10-09T06:58:04.298779+0000","last_undegraded":"2023-10-09T06:58:04.298779+0000","last_fullsized":"2023-10-09T06:58:04.298779+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:00:45.728123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.787320+0000","last_change":"2023-10-09T06:58:03.783538+0000","last_active":"2023-10-09T06:58:03.787320+0000","last_peered":"2023-10-09T06:58:03.787320+0000","last_clean":"2023-10-09T06:58:03.787320+0000","last_became_active":"2023-10-09T06:58:03.783250+0000","last_became_peered":"2023-10-09T06:58:03.783250+0000","last_unstale":"2023-10-09T06:58:03.787320+0000","last_undegraded":"2023-10-09T06:58:03.787320+0000","last_fullsized":"2023-10-09T06:58:03.787320+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:32:56.779064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"92'2","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.299739+0000","last_change":"2023-10-09T06:58:03.284555+0000","last_active":"2023-10-09T06:58:04.299739+0000","last_peered":"2023-10-09T06:58:04.299739+0000","last_clean":"2023-10-09T06:58:04.299739+0000","last_became_active":"2023-10-09T06:58:03.284259+0000","last_became_peered":"2023-10-09T06:58:03.284259+0000","last_unstale":"2023-10-09T06:58:04.299739+0000","last_undegraded":"2023-10-09T06:58:04.299739+0000","last_fullsized":"2023-10-09T06:58:04.299739+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:28.178529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.787006+0000","last_change":"2023-10-09T06:58:03.783652+0000","last_active":"2023-10-09T06:58:03.787006+0000","last_peered":"2023-10-09T06:58:03.787006+0000","last_clean":"2023-10-09T06:58:03.787006+0000","last_became_active":"2023-10-09T06:58:03.783398+0000","last_became_peered":"2023-10-09T06:58:03.783398+0000","last_unstale":"2023-10-09T06:58:03.787006+0000","last_undegraded":"2023-10-09T06:58:03.787006+0000","last_fullsized":"2023-10-09T06:58:03.787006+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:18.062792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"92'1","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.298674+0000","last_change":"2023-10-09T06:58:03.279603+0000","last_active":"2023-10-09T06:58:04.298674+0000","last_peered":"2023-10-09T06:58:04.298674+0000","last_clean":"2023-10-09T06:58:04.298674+0000","last_became_active":"2023-10-09T06:58:03.279307+0000","last_became_peered":"2023-10-09T06:58:03.279307+0000","last_unstale":"2023-10-09T06:58:04.298674+0000","last_undegraded":"2023-10-09T06:58:04.298674+0000","last_fullsized":"2023-10-09T06:58:04.298674+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:17.053444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.779091+0000","last_change":"2023-10-09T06:58:03.775521+0000","last_active":"2023-10-09T06:58:03.779091+0000","last_peered":"2023-10-09T06:58:03.779091+0000","last_clean":"2023-10-09T06:58:03.779091+0000","last_became_active":"2023-10-09T06:58:03.775284+0000","last_became_peered":"2023-10-09T06:58:03.775284+0000","last_unstale":"2023-10-09T06:58:03.779091+0000","last_undegraded":"2023-10-09T06:58:03.779091+0000","last_fullsized":"2023-10-09T06:58:03.779091+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:01:46.472752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.775903+0000","last_change":"2023-10-09T06:58:03.276635+0000","last_active":"2023-10-09T06:58:03.775903+0000","last_peered":"2023-10-09T06:58:03.775903+0000","last_clean":"2023-10-09T06:58:03.775903+0000","last_became_active":"2023-10-09T06:58:03.276373+0000","last_became_peered":"2023-10-09T06:58:03.276373+0000","last_unstale":"2023-10-09T06:58:03.775903+0000","last_undegraded":"2023-10-09T06:58:03.775903+0000","last_fullsized":"2023-10-09T06:58:03.775903+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:27.443310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.778718+0000","last_change":"2023-10-09T06:58:03.777764+0000","last_active":"2023-10-09T06:58:03.778718+0000","last_peered":"2023-10-09T06:58:03.778718+0000","last_clean":"2023-10-09T06:58:03.778718+0000","last_became_active":"2023-10-09T06:58:03.777519+0000","last_became_peered":"2023-10-09T06:58:03.777519+0000","last_unstale":"2023-10-09T06:58:03.778718+0000","last_undegraded":"2023-10-09T06:58:03.778718+0000","last_fullsized":"2023-10-09T06:58:03.778718+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:48.690134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.784485+0000","last_change":"2023-10-09T06:58:03.279295+0000","last_active":"2023-10-09T06:58:03.784485+0000","last_peered":"2023-10-09T06:58:03.784485+0000","last_clean":"2023-10-09T06:58:03.784485+0000","last_became_active":"2023-10-09T06:58:03.279021+0000","last_became_peered":"2023-10-09T06:58:03.279021+0000","last_unstale":"2023-10-09T06:58:03.784485+0000","last_undegraded":"2023-10-09T06:58:03.784485+0000","last_fullsized":"2023-10-09T06:58:03.784485+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:36.489423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.795108+0000","last_change":"2023-10-09T06:58:03.794613+0000","last_active":"2023-10-09T06:58:03.795108+0000","last_peered":"2023-10-09T06:58:03.795108+0000","last_clean":"2023-10-09T06:58:03.795108+0000","last_became_active":"2023-10-09T06:58:03.794396+0000","last_became_peered":"2023-10-09T06:58:03.794396+0000","last_unstale":"2023-10-09T06:58:03.795108+0000","last_undegraded":"2023-10-09T06:58:03.795108+0000","last_fullsized":"2023-10-09T06:58:03.795108+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:05.501958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.770390+0000","last_change":"2023-10-09T06:58:03.276348+0000","last_active":"2023-10-09T06:58:03.770390+0000","last_peered":"2023-10-09T06:58:03.770390+0000","last_clean":"2023-10-09T06:58:03.770390+0000","last_became_active":"2023-10-09T06:58:03.276081+0000","last_became_peered":"2023-10-09T06:58:03.276081+0000","last_unstale":"2023-10-09T06:58:03.770390+0000","last_undegraded":"2023-10-09T06:58:03.770390+0000","last_fullsized":"2023-10-09T06:58:03.770390+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:43:10.112593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.791753+0000","last_change":"2023-10-09T06:58:03.790775+0000","last_active":"2023-10-09T06:58:03.791753+0000","last_peered":"2023-10-09T06:58:03.791753+0000","last_clean":"2023-10-09T06:58:03.791753+0000","last_became_active":"2023-10-09T06:58:03.790517+0000","last_became_peered":"2023-10-09T06:58:03.790517+0000","last_unstale":"2023-10-09T06:58:03.791753+0000","last_undegraded":"2023-10-09T06:58:03.791753+0000","last_fullsized":"2023-10-09T06:58:03.791753+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:38:39.496926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.772648+0000","last_change":"2023-10-09T06:58:03.282068+0000","last_active":"2023-10-09T06:58:03.772648+0000","last_peered":"2023-10-09T06:58:03.772648+0000","last_clean":"2023-10-09T06:58:03.772648+0000","last_became_active":"2023-10-09T06:58:03.281770+0000","last_became_peered":"2023-10-09T06:58:03.281770+0000","last_unstale":"2023-10-09T06:58:03.772648+0000","last_undegraded":"2023-10-09T06:58:03.772648+0000","last_fullsized":"2023-10-09T06:58:03.772648+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:48:10.578960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.784340+0000","last_change":"2023-10-09T06:58:03.782745+0000","last_active":"2023-10-09T06:58:03.784340+0000","last_peered":"2023-10-09T06:58:03.784340+0000","last_clean":"2023-10-09T06:58:03.784340+0000","last_became_active":"2023-10-09T06:58:03.782504+0000","last_became_peered":"2023-10-09T06:58:03.782504+0000","last_unstale":"2023-10-09T06:58:03.784340+0000","last_undegraded":"2023-10-09T06:58:03.784340+0000","last_fullsized":"2023-10-09T06:58:03.784340+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:35.203503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"92'2","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.295177+0000","last_change":"2023-10-09T06:58:03.281936+0000","last_active":"2023-10-09T06:58:04.295177+0000","last_peered":"2023-10-09T06:58:04.295177+0000","last_clean":"2023-10-09T06:58:04.295177+0000","last_became_active":"2023-10-09T06:58:03.281604+0000","last_became_peered":"2023-10-09T06:58:03.281604+0000","last_unstale":"2023-10-09T06:58:04.295177+0000","last_undegraded":"2023-10-09T06:58:04.295177+0000","last_fullsized":"2023-10-09T06:58:04.295177+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:30:36.943328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.786434+0000","last_change":"2023-10-09T06:58:03.783557+0000","last_active":"2023-10-09T06:58:03.786434+0000","last_peered":"2023-10-09T06:58:03.786434+0000","last_clean":"2023-10-09T06:58:03.786434+0000","last_became_active":"2023-10-09T06:58:03.783295+0000","last_became_peered":"2023-10-09T06:58:03.783295+0000","last_unstale":"2023-10-09T06:58:03.786434+0000","last_undegraded":"2023-10-09T06:58:03.786434+0000","last_fullsized":"2023-10-09T06:58:03.786434+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:34.486926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.770530+0000","last_change":"2023-10-09T06:58:03.278232+0000","last_active":"2023-10-09T06:58:03.770530+0000","last_peered":"2023-10-09T06:58:03.770530+0000","last_clean":"2023-10-09T06:58:03.770530+0000","last_became_active":"2023-10-09T06:58:03.277973+0000","last_became_peered":"2023-10-09T06:58:03.277973+0000","last_unstale":"2023-10-09T06:58:03.770530+0000","last_undegraded":"2023-10-09T06:58:03.770530+0000","last_fullsized":"2023-10-09T06:58:03.770530+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:46:15.730810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.791926+0000","last_change":"2023-10-09T06:58:03.790868+0000","last_active":"2023-10-09T06:58:03.791926+0000","last_peered":"2023-10-09T06:58:03.791926+0000","last_clean":"2023-10-09T06:58:03.791926+0000","last_became_active":"2023-10-09T06:58:03.790610+0000","last_became_peered":"2023-10-09T06:58:03.790610+0000","last_unstale":"2023-10-09T06:58:03.791926+0000","last_undegraded":"2023-10-09T06:58:03.791926+0000","last_fullsized":"2023-10-09T06:58:03.791926+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:34.486926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.776473+0000","last_change":"2023-10-09T06:58:03.282655+0000","last_active":"2023-10-09T06:58:03.776473+0000","last_peered":"2023-10-09T06:58:03.776473+0000","last_clean":"2023-10-09T06:58:03.776473+0000","last_became_active":"2023-10-09T06:58:03.282390+0000","last_became_peered":"2023-10-09T06:58:03.282390+0000","last_unstale":"2023-10-09T06:58:03.776473+0000","last_undegraded":"2023-10-09T06:58:03.776473+0000","last_fullsized":"2023-10-09T06:58:03.776473+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:39:27.910719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.789345+0000","last_change":"2023-10-09T06:58:03.788017+0000","last_active":"2023-10-09T06:58:03.789345+0000","last_peered":"2023-10-09T06:58:03.789345+0000","last_clean":"2023-10-09T06:58:03.789345+0000","last_became_active":"2023-10-09T06:58:03.786231+0000","last_became_peered":"2023-10-09T06:58:03.786231+0000","last_unstale":"2023-10-09T06:58:03.789345+0000","last_undegraded":"2023-10-09T06:58:03.789345+0000","last_fullsized":"2023-10-09T06:58:03.789345+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:55.201809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.775076+0000","last_change":"2023-10-09T06:58:03.282318+0000","last_active":"2023-10-09T06:58:03.775076+0000","last_peered":"2023-10-09T06:58:03.775076+0000","last_clean":"2023-10-09T06:58:03.775076+0000","last_became_active":"2023-10-09T06:58:03.282067+0000","last_became_peered":"2023-10-09T06:58:03.282067+0000","last_unstale":"2023-10-09T06:58:03.775076+0000","last_undegraded":"2023-10-09T06:58:03.775076+0000","last_fullsized":"2023-10-09T06:58:03.775076+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:54.192461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.782118+0000","last_change":"2023-10-09T06:58:03.780989+0000","last_active":"2023-10-09T06:58:03.782118+0000","last_peered":"2023-10-09T06:58:03.782118+0000","last_clean":"2023-10-09T06:58:03.782118+0000","last_became_active":"2023-10-09T06:58:03.780759+0000","last_became_peered":"2023-10-09T06:58:03.780759+0000","last_unstale":"2023-10-09T06:58:03.782118+0000","last_undegraded":"2023-10-09T06:58:03.782118+0000","last_fullsized":"2023-10-09T06:58:03.782118+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:05.430877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.776139+0000","last_change":"2023-10-09T06:58:03.277955+0000","last_active":"2023-10-09T06:58:03.776139+0000","last_peered":"2023-10-09T06:58:03.776139+0000","last_clean":"2023-10-09T06:58:03.776139+0000","last_became_active":"2023-10-09T06:58:03.277692+0000","last_became_peered":"2023-10-09T06:58:03.277692+0000","last_unstale":"2023-10-09T06:58:03.776139+0000","last_undegraded":"2023-10-09T06:58:03.776139+0000","last_fullsized":"2023-10-09T06:58:03.776139+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:44:10.319004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.791451+0000","last_change":"2023-10-09T06:58:03.787275+0000","last_active":"2023-10-09T06:58:03.791451+0000","last_peered":"2023-10-09T06:58:03.791451+0000","last_clean":"2023-10-09T06:58:03.791451+0000","last_became_active":"2023-10-09T06:58:03.786984+0000","last_became_peered":"2023-10-09T06:58:03.786984+0000","last_unstale":"2023-10-09T06:58:03.791451+0000","last_undegraded":"2023-10-09T06:58:03.791451+0000","last_fullsized":"2023-10-09T06:58:03.791451+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:46:16.740158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.775905+0000","last_change":"2023-10-09T06:58:03.279055+0000","last_active":"2023-10-09T06:58:03.775905+0000","last_peered":"2023-10-09T06:58:03.775905+0000","last_clean":"2023-10-09T06:58:03.775905+0000","last_became_active":"2023-10-09T06:58:03.278781+0000","last_became_peered":"2023-10-09T06:58:03.278781+0000","last_unstale":"2023-10-09T06:58:03.775905+0000","last_undegraded":"2023-10-09T06:58:03.775905+0000","last_fullsized":"2023-10-09T06:58:03.775905+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:41.417852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.779579+0000","last_change":"2023-10-09T06:58:03.777888+0000","last_active":"2023-10-09T06:58:03.779579+0000","last_peered":"2023-10-09T06:58:03.779579+0000","last_clean":"2023-10-09T06:58:03.779579+0000","last_became_active":"2023-10-09T06:58:03.777552+0000","last_became_peered":"2023-10-09T06:58:03.777552+0000","last_unstale":"2023-10-09T06:58:03.779579+0000","last_undegraded":"2023-10-09T06:58:03.779579+0000","last_fullsized":"2023-10-09T06:58:03.779579+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:14.217322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.769064+0000","last_change":"2023-10-09T06:58:03.272814+0000","last_active":"2023-10-09T06:58:03.769064+0000","last_peered":"2023-10-09T06:58:03.769064+0000","last_clean":"2023-10-09T06:58:03.769064+0000","last_became_active":"2023-10-09T06:58:03.272489+0000","last_became_peered":"2023-10-09T06:58:03.272489+0000","last_unstale":"2023-10-09T06:58:03.769064+0000","last_undegraded":"2023-10-09T06:58:03.769064+0000","last_fullsized":"2023-10-09T06:58:03.769064+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:26.001200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.791421+0000","last_change":"2023-10-09T06:58:03.786567+0000","last_active":"2023-10-09T06:58:03.791421+0000","last_peered":"2023-10-09T06:58:03.791421+0000","last_clean":"2023-10-09T06:58:03.791421+0000","last_became_active":"2023-10-09T06:58:03.786232+0000","last_became_peered":"2023-10-09T06:58:03.786232+0000","last_unstale":"2023-10-09T06:58:03.791421+0000","last_undegraded":"2023-10-09T06:58:03.791421+0000","last_fullsized":"2023-10-09T06:58:03.791421+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:50.295594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.784170+0000","last_change":"2023-10-09T06:58:03.284773+0000","last_active":"2023-10-09T06:58:03.784170+0000","last_peered":"2023-10-09T06:58:03.784170+0000","last_clean":"2023-10-09T06:58:03.784170+0000","last_became_active":"2023-10-09T06:58:03.284399+0000","last_became_peered":"2023-10-09T06:58:03.284399+0000","last_unstale":"2023-10-09T06:58:03.784170+0000","last_undegraded":"2023-10-09T06:58:03.784170+0000","last_fullsized":"2023-10-09T06:58:03.784170+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:38.264568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.792125+0000","last_change":"2023-10-09T06:58:03.791372+0000","last_active":"2023-10-09T06:58:03.792125+0000","last_peered":"2023-10-09T06:58:03.792125+0000","last_clean":"2023-10-09T06:58:03.792125+0000","last_became_active":"2023-10-09T06:58:03.791000+0000","last_became_peered":"2023-10-09T06:58:03.791000+0000","last_unstale":"2023-10-09T06:58:03.792125+0000","last_undegraded":"2023-10-09T06:58:03.792125+0000","last_fullsized":"2023-10-09T06:58:03.792125+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:35:41.435584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"92'2","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.299102+0000","last_change":"2023-10-09T06:58:03.284768+0000","last_active":"2023-10-09T06:58:04.299102+0000","last_peered":"2023-10-09T06:58:04.299102+0000","last_clean":"2023-10-09T06:58:04.299102+0000","last_became_active":"2023-10-09T06:58:03.284454+0000","last_became_peered":"2023-10-09T06:58:03.284454+0000","last_unstale":"2023-10-09T06:58:04.299102+0000","last_undegraded":"2023-10-09T06:58:04.299102+0000","last_fullsized":"2023-10-09T06:58:04.299102+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:26.001200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"82'183","reported_seq":460,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.775260+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:58:03.775260+0000","last_peered":"2023-10-09T06:58:03.775260+0000","last_clean":"2023-10-09T06:58:03.775260+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:58:03.775260+0000","last_undegraded":"2023-10-09T06:58:03.775260+0000","last_fullsized":"2023-10-09T06:58:03.775260+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575036,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303080,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068760,"statfs":{"total":96636764160,"available":96326410240,"internally_reserved":0,"allocated":1736704,"data_stored":1139681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68400000000000005,"15min":0.70799999999999996},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.316},"max":{"1min":0.81100000000000005,"5min":1.732,"15min":1.9490000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.44,"5min":0.40200000000000002,"15min":0.29999999999999999},"max":{"1min":0.83299999999999996,"5min":1.22,"15min":3.448},"last":0.70299999999999996}]},{"osd":1,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.504,"5min":0.437,"15min":0.379},"max":{"1min":0.86799999999999999,"5min":2.3559999999999999,"15min":5.617},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.46999999999999997,"5min":0.45800000000000002,"15min":0.40200000000000002},"max":{"1min":0.97599999999999998,"5min":1.7869999999999999,"15min":2.016},"last":0.79800000000000004}]},{"osd":2,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.72999999999999998,"15min":0.73899999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.44800000000000001},"max":{"1min":0.97999999999999998,"5min":1.9430000000000001,"15min":2.052},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.73799999999999999,"15min":0.75600000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.44700000000000001},"max":{"1min":0.82399999999999995,"5min":2.6629999999999998,"15min":3.5019999999999998},"last":0.51800000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.73899999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.45000000000000001},"max":{"1min":0.97099999999999997,"5min":1.03,"15min":5.5800000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.746,"15min":0.78100000000000003},"min":{"1min":0.50800000000000001,"5min":0.496,"15min":0.47099999999999997},"max":{"1min":0.89800000000000002,"5min":1.827,"15min":6.9299999999999997},"last":0.76000000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.91000000000000003,"5min":0.95499999999999996,"15min":3.125},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.66500000000000004},"min":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1850000000000001,"5min":2.577,"15min":4.8380000000000001},"last":0.73799999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68700000000000006,"15min":0.68100000000000005},"min":{"1min":0.441,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":1.0309999999999999,"5min":2.5169999999999999,"15min":4.1929999999999996},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.5,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":2.9590000000000001,"15min":3.6749999999999998},"last":0.77600000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0449999999999999,"5min":3.0019999999999998,"15min":4.0250000000000004},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72699999999999998,"15min":0.752},"min":{"1min":0.498,"5min":0.47399999999999998,"15min":0.44700000000000001},"max":{"1min":1.0740000000000001,"5min":2.4039999999999999,"15min":7.0259999999999998},"last":0.78600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575035,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302500,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1142784,"data_stored":548817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68799999999999994,"15min":0.71399999999999997},"min":{"1min":0.47599999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86899999999999999,"5min":0.97899999999999998,"15min":1.022},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66700000000000004,"15min":0.70199999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.36599999999999999},"max":{"1min":0.72999999999999998,"5min":0.93899999999999995,"15min":1.079},"last":0.71699999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.68799999999999994,"15min":0.71999999999999997},"min":{"1min":0.48199999999999998,"5min":0.45500000000000002,"15min":0.42799999999999999},"max":{"1min":0.76700000000000002,"5min":1.135,"15min":1.135},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68799999999999994,"15min":0.72499999999999998},"min":{"1min":0.47799999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81699999999999995,"5min":1.0109999999999999,"15min":1.034},"last":0.69499999999999995}]},{"osd":2,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.69999999999999996,"15min":0.73199999999999998},"min":{"1min":0.52300000000000002,"5min":0.49199999999999999,"15min":0.42599999999999999},"max":{"1min":0.86099999999999999,"5min":1.391,"15min":1.391},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.68799999999999994,"15min":0.73099999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90500000000000003,"5min":0.91000000000000003,"15min":1.0900000000000001},"last":0.58499999999999996}]},{"osd":3,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66700000000000004,"15min":0.69899999999999995},"min":{"1min":0.502,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.81899999999999995,"5min":0.91700000000000004,"15min":1.046},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.72899999999999998,"15min":0.753},"min":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.497},"max":{"1min":0.82999999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.80700000000000005}]},{"osd":4,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61399999999999999,"15min":0.621},"min":{"1min":0.38,"5min":0.38,"15min":0.377},"max":{"1min":0.84699999999999998,"5min":1.768,"15min":1.768},"last":0.437},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.36199999999999999},"max":{"1min":0.84399999999999997,"5min":1.601,"15min":1.601},"last":0.55800000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65500000000000003,"15min":0.65200000000000002},"min":{"1min":0.53100000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84099999999999997,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.42299999999999999},"max":{"1min":0.86699999999999999,"5min":0.94699999999999995,"15min":1.0669999999999999},"last":0.51400000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66900000000000004,"15min":0.67600000000000005},"min":{"1min":0.55600000000000005,"5min":0.42899999999999999,"15min":0.41799999999999998},"max":{"1min":0.95999999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56499999999999995,"5min":0.44600000000000001,"15min":0.42399999999999999},"max":{"1min":0.89600000000000002,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.73999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302512,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069328,"statfs":{"total":96636764160,"available":96326991872,"internally_reserved":0,"allocated":1155072,"data_stored":550849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.27600000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59399999999999997,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.503,"5min":0.49199999999999999,"15min":0.48299999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.23699999999999999},"max":{"1min":1.083,"5min":1.23,"15min":1.23},"last":0.32600000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.29599999999999999},"max":{"1min":0.68500000000000005,"5min":1.169,"15min":1.169},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.439,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":3.077,"15min":3.077},"last":0.56899999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.40000000000000002,"5min":0.376,"15min":0.34100000000000003},"max":{"1min":0.76000000000000001,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.39100000000000001,"5min":0.34899999999999998,"15min":0.34100000000000003},"max":{"1min":1.056,"5min":1.605,"15min":1.605},"last":0.36099999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73899999999999999,"15min":0.76100000000000001},"min":{"1min":0.497,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.89900000000000002,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.75800000000000001,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93999999999999995,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.72299999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75800000000000001,"15min":0.77400000000000002},"min":{"1min":0.55000000000000004,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.3140000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75900000000000001,"15min":0.78100000000000003},"min":{"1min":0.54500000000000004,"5min":0.497,"15min":0.47999999999999998},"max":{"1min":0.95799999999999996,"5min":1.637,"15min":1.637},"last":0.65200000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78700000000000003,"15min":0.79600000000000004},"min":{"1min":0.54600000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97899999999999998,"5min":1.696,"15min":1.696},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78600000000000003,"15min":0.79700000000000004},"min":{"1min":0.54600000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1679999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81999999999999995,"15min":0.82599999999999996},"min":{"1min":0.55500000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1479999999999999,"5min":1.2669999999999999,"15min":1.4510000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79800000000000004,"15min":0.82299999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98699999999999999,"5min":1.125,"15min":1.1970000000000001},"last":0.69099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575035,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298976,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072864,"statfs":{"total":96636764160,"available":96330612736,"internally_reserved":0,"allocated":1728512,"data_stored":1139093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.29299999999999998,"5min":0.27100000000000002,"15min":0.23000000000000001},"max":{"1min":0.623,"5min":0.85799999999999998,"15min":1.2729999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.28899999999999998},"max":{"1min":0.60399999999999998,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":0.47499999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.63400000000000001,"5min":4.6980000000000004,"15min":4.6980000000000004},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48999999999999999,"15min":0.497},"min":{"1min":0.34000000000000002,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.71799999999999997,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.41499999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":0.63800000000000001,"5min":1.2450000000000001,"15min":1.7130000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.441,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":0.70199999999999996,"5min":4.734,"15min":4.734},"last":0.498}]},{"osd":4,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.52900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99199999999999999,"5min":1.2270000000000001,"15min":1.752},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.50700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.91500000000000004,"5min":4.6619999999999999,"15min":4.6619999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.53700000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0049999999999999,"5min":1.1890000000000001,"15min":1.2769999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.58699999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90300000000000002,"5min":1.2809999999999999,"15min":1.7889999999999999},"last":0.81699999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.80500000000000005,"15min":0.81299999999999994},"min":{"1min":0.56499999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97299999999999998,"5min":4.6239999999999997,"15min":4.6239999999999997},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79300000000000004,"15min":0.80100000000000005},"min":{"1min":0.55600000000000005,"5min":0.50800000000000001,"15min":0.47999999999999998},"max":{"1min":0.96499999999999997,"5min":1.2689999999999999,"15min":1.4370000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.82499999999999996,"15min":0.83199999999999996},"min":{"1min":0.56299999999999994,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.042,"5min":1.256,"15min":1.518},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.621,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95599999999999996,"5min":1.702,"15min":1.8200000000000001},"last":0.753}]}]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306600,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065240,"statfs":{"total":96636764160,"available":96322805760,"internally_reserved":0,"allocated":1146880,"data_stored":550261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.46800000000000003,"15min":0.45400000000000001},"min":{"1min":0.28299999999999997,"5min":0.26500000000000001,"15min":0.25900000000000001},"max":{"1min":0.76700000000000002,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.48999999999999999,"15min":0.495},"min":{"1min":0.30599999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.55300000000000005,"5min":1.633,"15min":1.633},"last":0.38800000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46400000000000002,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71599999999999997,"5min":1.097,"15min":1.865},"last":0.371},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.79700000000000004,"5min":1.2689999999999999,"15min":1.79},"last":0.45400000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.58899999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.35799999999999998},"max":{"1min":0.82599999999999996,"5min":0.86699999999999999,"15min":1.8999999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.47399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70299999999999996,"5min":1.1890000000000001,"15min":1.8220000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":0.85799999999999998,"5min":1.2430000000000001,"15min":1.256},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.55000000000000004,"5min":0.45900000000000002,"15min":0.44800000000000001},"max":{"1min":0.91400000000000003,"5min":1.696,"15min":1.696},"last":0.77800000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.753,"15min":0.76800000000000002},"min":{"1min":0.505,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85199999999999998,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.503},"max":{"1min":0.83199999999999996,"5min":1.218,"15min":1.3440000000000001},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.54000000000000004,"5min":0.51000000000000001,"15min":0.48599999999999999},"max":{"1min":0.94899999999999995,"5min":1.768,"15min":1.768},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.76400000000000001,"15min":0.79000000000000004},"min":{"1min":0.56599999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92900000000000005,"5min":1.3580000000000001,"15min":1.5309999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.61799999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97799999999999998,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.58699999999999997,"5min":0.57599999999999996,"15min":0.50900000000000001},"max":{"1min":0.92000000000000004,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.621}]}]},{"osd":3,"up_from":13,"seq":55834575036,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306596,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065244,"statfs":{"total":96636764160,"available":96322809856,"internally_reserved":0,"allocated":1142784,"data_stored":548837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.29599999999999999,"5min":0.29499999999999998,"15min":0.24099999999999999},"max":{"1min":0.86299999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.47899999999999998,"15min":0.48799999999999999},"min":{"1min":0.315,"5min":0.30199999999999999,"15min":0.28100000000000003},"max":{"1min":0.63600000000000001,"5min":1.228,"15min":1.228},"last":0.498}]},{"osd":1,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.48099999999999998,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58699999999999997,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.379}]},{"osd":2,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94099999999999995,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64800000000000002,"15min":0.63300000000000001},"min":{"1min":0.44400000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.97699999999999998,"5min":3.8900000000000001,"15min":3.8900000000000001},"last":0.56899999999999995}]},{"osd":4,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.51100000000000001,"5min":0.48299999999999998,"15min":0.40799999999999997},"max":{"1min":0.76500000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.81000000000000005,"15min":0.82299999999999995},"min":{"1min":0.623,"5min":0.59399999999999997,"15min":0.52200000000000002},"max":{"1min":1.0189999999999999,"5min":1.22,"15min":1.22},"last":0.77000000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.45000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.86199999999999999,"5min":1.3360000000000001,"15min":2.1549999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.56399999999999995,"5min":0.55900000000000005,"15min":0.50600000000000001},"max":{"1min":1.0569999999999999,"5min":1.1639999999999999,"15min":1.419},"last":0.68500000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.51700000000000002},"max":{"1min":0.875,"5min":1.304,"15min":1.304},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95199999999999996,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.69899999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91100000000000003,"5min":1.8180000000000001,"15min":2.0880000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.80800000000000005,"15min":0.82099999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92300000000000004,"5min":1.486,"15min":1.486},"last":0.77800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575035,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310688,"kb_used_data":1112,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061152,"statfs":{"total":96636764160,"available":96318619648,"internally_reserved":0,"allocated":1138688,"data_stored":548795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71399999999999997,"15min":0.70399999999999996},"min":{"1min":0.45000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79200000000000004,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.72799999999999998,"15min":0.72299999999999998},"min":{"1min":0.50900000000000001,"5min":0.42699999999999999,"15min":0.39300000000000002},"max":{"1min":0.97399999999999998,"5min":2.8130000000000002,"15min":3.23},"last":0.623}]},{"osd":1,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71899999999999997,"15min":0.71099999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.373},"max":{"1min":0.85699999999999998,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.53000000000000003,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.86499999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.78900000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.755,"15min":0.75700000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.38100000000000001},"max":{"1min":0.92900000000000005,"5min":2.5960000000000001,"15min":3.7509999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.48299999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90000000000000002,"5min":2.427,"15min":2.427},"last":0.76900000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.755,"15min":0.751},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.434},"max":{"1min":0.89700000000000002,"5min":2.6440000000000001,"15min":3.6970000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.77000000000000002,"15min":0.747},"min":{"1min":0.443,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":3.6899999999999999,"15min":3.6899999999999999},"last":0.80400000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63600000000000001,"15min":0.60899999999999999},"min":{"1min":0.379,"5min":0.317,"15min":0.317},"max":{"1min":0.84899999999999998,"5min":3.3860000000000001,"15min":3.4780000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.68999999999999995,"15min":0.65800000000000003},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.34999999999999998},"max":{"1min":0.91200000000000003,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.84699999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67100000000000004,"15min":0.64000000000000001},"min":{"1min":0.47699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82299999999999995,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.71499999999999997,"15min":0.67900000000000005},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.374},"max":{"1min":0.89100000000000001,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.83099999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.49299999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.96599999999999997,"5min":2.7210000000000001,"15min":3.2789999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.76900000000000002},"min":{"1min":0.56499999999999995,"5min":0.439,"15min":0.439},"max":{"1min":0.93600000000000005,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.88700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575036,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302496,"kb_used_data":1112,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069344,"statfs":{"total":96636764160,"available":96327008256,"internally_reserved":0,"allocated":1138688,"data_stored":548815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67600000000000005,"15min":0.69699999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.72299999999999998,"5min":0.93600000000000005,"15min":1.655},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65700000000000003,"15min":0.68400000000000005},"min":{"1min":0.42899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78200000000000003,"5min":1.0269999999999999,"15min":1.1359999999999999},"last":0.59199999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71699999999999997,"5min":0.96899999999999997,"15min":2.4159999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.45400000000000001,"5min":0.44,"15min":0.40400000000000003},"max":{"1min":0.89100000000000001,"5min":0.95099999999999996,"15min":1.706},"last":0.747}]},{"osd":2,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69699999999999995,"15min":0.72799999999999998},"min":{"1min":0.501,"5min":0.48499999999999999,"15min":0.42999999999999999},"max":{"1min":0.75800000000000001,"5min":0.997,"15min":1.79},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69699999999999995,"15min":0.71599999999999997},"min":{"1min":0.49199999999999999,"5min":0.46500000000000002,"15min":0.442},"max":{"1min":0.752,"5min":1.006,"15min":2.4889999999999999},"last":0.55100000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68999999999999995,"15min":0.71699999999999997},"min":{"1min":0.46899999999999997,"5min":0.438,"15min":0.435},"max":{"1min":0.88600000000000001,"5min":1.0209999999999999,"15min":1.409},"last":0.622},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73899999999999999,"15min":0.76900000000000002},"min":{"1min":0.56200000000000006,"5min":0.501,"15min":0.501},"max":{"1min":0.78600000000000003,"5min":0.95699999999999996,"15min":2.532},"last":0.60799999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":1.766},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.622,"15min":0.621},"min":{"1min":0.48599999999999999,"5min":0.377,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":1.052,"15min":2.7829999999999999},"last":0.56599999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.45100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82899999999999996,"5min":1.018,"15min":2.5739999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.40000000000000002,"15min":0.38900000000000001},"max":{"1min":0.84099999999999997,"5min":0.97999999999999998,"15min":1.8080000000000001},"last":0.57799999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.90700000000000003,"5min":1.175,"15min":2.9609999999999999},"last":0.502},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.60499999999999998,"5min":0.498,"15min":0.45900000000000002},"max":{"1min":0.876,"5min":1.139,"15min":2.613},"last":0.72299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:58:13.467 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:58:13.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.656+0000 7f297ffff700 1 Processor -- start 2023-10-09T06:58:13.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.656+0000 7f297ffff700 1 -- start start 2023-10-09T06:58:13.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.657+0000 7f297ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f298015d230 0x7f298015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:13.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.657+0000 7f297ffff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29800b2980 con 0x7f2980159420 2023-10-09T06:58:13.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.657+0000 7f297ffff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f298015dbb0 con 0x7f29801597f0 2023-10-09T06:58:13.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.657+0000 7f297ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29800b11d0 con 0x7f298015d230 2023-10-09T06:58:13.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.657+0000 7f297effd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f2980159420 0x7f29800b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:38592/0 (socket says 172.21.15.71:38592) 2023-10-09T06:58:13.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.657+0000 7f297effd700 1 -- 172.21.15.71:0/2282450701 learned_addr learned my addr 172.21.15.71:0/2282450701 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:13.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.658+0000 7f297f7fe700 1 --2- 172.21.15.71:0/2282450701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f298015d230 0x7f298015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:13.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.658+0000 7f297dffb700 1 -- 172.21.15.71:0/2282450701 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008167895 0 0) 0x7f29800b2980 con 0x7f2980159420 2023-10-09T06:58:13.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.658+0000 7f297dffb700 1 -- 172.21.15.71:0/2282450701 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2968003570 con 0x7f2980159420 2023-10-09T06:58:13.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.658+0000 7f297dffb700 1 -- 172.21.15.71:0/2282450701 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2769959096 0 0) 0x7f2968003570 con 0x7f2980159420 2023-10-09T06:58:13.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.658+0000 7f297dffb700 1 -- 172.21.15.71:0/2282450701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f298015d230 msgr2=0x7f298015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:13.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.658+0000 7f297dffb700 1 --2- 172.21.15.71:0/2282450701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f298015d230 0x7f298015d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:13.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.658+0000 7f297dffb700 1 -- 172.21.15.71:0/2282450701 >> v1:172.21.15.179:6789/0 conn(0x7f29801597f0 legacy=0x7f29800b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:13.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.658+0000 7f297dffb700 1 -- 172.21.15.71:0/2282450701 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29800b14b0 con 0x7f2980159420 2023-10-09T06:58:13.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.658+0000 7f297dffb700 1 -- 172.21.15.71:0/2282450701 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f2970001470 con 0x7f2980159420 2023-10-09T06:58:13.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.658+0000 7f297dffb700 1 -- 172.21.15.71:0/2282450701 >> v1:172.21.15.71:6789/0 conn(0x7f2980159420 legacy=0x7f29800b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:13.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.658+0000 7f297dffb700 1 --2- 172.21.15.71:0/2282450701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f298015d230 0x7f2968003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:13.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.658+0000 7f297dffb700 1 --2- 172.21.15.71:0/2282450701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2968003fd0 0x7f2968004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:13.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.658+0000 7f297dffb700 1 --2- 172.21.15.71:0/2282450701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2968004d50 0x7f29680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:13.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.658+0000 7f297dffb700 1 -- 172.21.15.71:0/2282450701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29800b11d0 con 0x7f2968004d50 2023-10-09T06:58:13.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.658+0000 7f297dffb700 1 -- 172.21.15.71:0/2282450701 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296800bb40 con 0x7f2968003fd0 2023-10-09T06:58:13.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.658+0000 7f297dffb700 1 -- 172.21.15.71:0/2282450701 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296800bd00 con 0x7f298015d230 2023-10-09T06:58:13.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.659+0000 7f297f7fe700 1 --2- 172.21.15.71:0/2282450701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2968004d50 0x7f29680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:13.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.659+0000 7f297effd700 1 --2- 172.21.15.71:0/2282450701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f298015d230 0x7f2968003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:13.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.659+0000 7f297e7fc700 1 --2- 172.21.15.71:0/2282450701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2968003fd0 0x7f2968004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:13.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.659+0000 7f297f7fe700 1 -- 172.21.15.71:0/2282450701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f298015d230 msgr2=0x7f2968003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:13.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.659+0000 7f297f7fe700 1 --2- 172.21.15.71:0/2282450701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f298015d230 0x7f2968003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:13.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.659+0000 7f297f7fe700 1 -- 172.21.15.71:0/2282450701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2968003fd0 msgr2=0x7f2968004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:13.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.659+0000 7f297f7fe700 1 --2- 172.21.15.71:0/2282450701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2968003fd0 0x7f2968004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:13.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.659+0000 7f297f7fe700 1 -- 172.21.15.71:0/2282450701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2968003570 con 0x7f2968004d50 2023-10-09T06:58:13.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.659+0000 7f297f7fe700 1 --2- 172.21.15.71:0/2282450701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2968004d50 0x7f29680051c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f297800e210 tx=0x7f297800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b084a758e821108 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:13.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.659+0000 7f297dffb700 1 -- 172.21.15.71:0/2282450701 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297800eac0 con 0x7f2968004d50 2023-10-09T06:58:13.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.659+0000 7f297dffb700 1 -- 172.21.15.71:0/2282450701 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297800f040 con 0x7f2968004d50 2023-10-09T06:58:13.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.659+0000 7f297dffb700 1 -- 172.21.15.71:0/2282450701 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297800ee70 con 0x7f2968004d50 2023-10-09T06:58:13.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.660+0000 7f297ffff700 1 -- 172.21.15.71:0/2282450701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2968004d50 msgr2=0x7f29680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:13.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.660+0000 7f297ffff700 1 --2- 172.21.15.71:0/2282450701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2968004d50 0x7f29680051c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f297800e210 tx=0x7f297800b040 comp rx=0 tx=0).stop 2023-10-09T06:58:13.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.660+0000 7f297f7fe700 1 -- 172.21.15.71:0/2282450701 reap_dead start 2023-10-09T06:58:13.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.660+0000 7f297ffff700 1 -- 172.21.15.71:0/2282450701 shutdown_connections 2023-10-09T06:58:13.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.660+0000 7f297ffff700 1 -- 172.21.15.71:0/2282450701 >> 172.21.15.71:0/2282450701 conn(0x7f29800d0660 msgr2=0x7f29800d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:13.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.660+0000 7f297ffff700 1 -- 172.21.15.71:0/2282450701 shutdown_connections 2023-10-09T06:58:13.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.660+0000 7f297ffff700 1 -- 172.21.15.71:0/2282450701 wait complete. 2023-10-09T06:58:13.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.662+0000 7f297ffff700 1 Processor -- start 2023-10-09T06:58:13.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.662+0000 7f297ffff700 1 -- start start 2023-10-09T06:58:13.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.663+0000 7f297ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2968004d50 0x7f29801538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:13.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.663+0000 7f297ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2980159ca0 0x7f29800c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.663+0000 7f297ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f298015c4f0 0x7f298015c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.663+0000 7f297ffff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298015ce90 con 0x7f2968004d50 2023-10-09T06:58:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.663+0000 7f297ffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298016b700 con 0x7f2980159ca0 2023-10-09T06:58:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.663+0000 7f297ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29801541b0 con 0x7f298015c4f0 2023-10-09T06:58:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.663+0000 7f297effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2968004d50 0x7f29801538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.663+0000 7f297effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2968004d50 0x7f29801538c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60016/0 (socket says 172.21.15.71:60016) 2023-10-09T06:58:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.663+0000 7f297effd700 1 -- 172.21.15.71:0/1599681915 learned_addr learned my addr 172.21.15.71:0/1599681915 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.663+0000 7f297e7fc700 1 --2- 172.21.15.71:0/1599681915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2980159ca0 0x7f29800c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.663+0000 7f297f7fe700 1 --2- 172.21.15.71:0/1599681915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f298015c4f0 0x7f298015c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.663+0000 7f297effd700 1 -- 172.21.15.71:0/1599681915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f298015c4f0 msgr2=0x7f298015c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.663+0000 7f297effd700 1 --2- 172.21.15.71:0/1599681915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f298015c4f0 0x7f298015c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.663+0000 7f297effd700 1 -- 172.21.15.71:0/1599681915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2980159ca0 msgr2=0x7f29800c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:13.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.663+0000 7f297effd700 1 --2- 172.21.15.71:0/1599681915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2980159ca0 0x7f29800c5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:13.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.663+0000 7f297effd700 1 -- 172.21.15.71:0/1599681915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298016a850 con 0x7f2968004d50 2023-10-09T06:58:13.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.663+0000 7f297e7fc700 1 --2- 172.21.15.71:0/1599681915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2980159ca0 0x7f29800c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:13.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.664+0000 7f297effd700 1 --2- 172.21.15.71:0/1599681915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2968004d50 0x7f29801538c0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f2970007390 tx=0x7f2970001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:13.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.664+0000 7f2966ffd700 1 -- 172.21.15.71:0/1599681915 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970018030 con 0x7f2968004d50 2023-10-09T06:58:13.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.664+0000 7f2966ffd700 1 -- 172.21.15.71:0/1599681915 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297000f870 con 0x7f2968004d50 2023-10-09T06:58:13.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.664+0000 7f2966ffd700 1 -- 172.21.15.71:0/1599681915 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297000fc10 con 0x7f2968004d50 2023-10-09T06:58:13.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.664+0000 7f297ffff700 1 -- 172.21.15.71:0/1599681915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298016aaf0 con 0x7f2968004d50 2023-10-09T06:58:13.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.664+0000 7f297ffff700 1 -- 172.21.15.71:0/1599681915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298016b0b0 con 0x7f2968004d50 2023-10-09T06:58:13.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.665+0000 7f297ffff700 1 -- 172.21.15.71:0/1599681915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298004c3c0 con 0x7f2968004d50 2023-10-09T06:58:13.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.666+0000 7f2966ffd700 1 -- 172.21.15.71:0/1599681915 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f297001b070 con 0x7f2968004d50 2023-10-09T06:58:13.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.667+0000 7f2966ffd700 1 --2- 172.21.15.71:0/1599681915 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f296c066f00 0x7f296c0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:13.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.667+0000 7f2966ffd700 1 -- 172.21.15.71:0/1599681915 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f2970019070 con 0x7f2968004d50 2023-10-09T06:58:13.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.667+0000 7f297e7fc700 1 --2- 172.21.15.71:0/1599681915 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f296c066f00 0x7f296c0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:13.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.668+0000 7f297e7fc700 1 --2- 172.21.15.71:0/1599681915 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f296c066f00 0x7f296c0693b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2974007e20 tx=0x7f2974009040 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:13.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.671+0000 7f2966ffd700 1 -- 172.21.15.71:0/1599681915 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2970051740 con 0x7f2968004d50 2023-10-09T06:58:13.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.859+0000 7f297ffff700 1 -- 172.21.15.71:0/1599681915 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f298016b840 con 0x7f296c066f00 2023-10-09T06:58:13.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.869+0000 7f2966ffd700 1 -- 172.21.15.71:0/1599681915 <== mgr.6274 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289157 (secure 0 0 0) 0x7f29740038d0 con 0x7f296c066f00 2023-10-09T06:58:13.873 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:13.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.873+0000 7f297ffff700 1 -- 172.21.15.71:0/1599681915 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f296c066f00 msgr2=0x7f296c0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:13.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.873+0000 7f297ffff700 1 --2- 172.21.15.71:0/1599681915 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f296c066f00 0x7f296c0693b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2974007e20 tx=0x7f2974009040 comp rx=0 tx=0).stop 2023-10-09T06:58:13.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.873+0000 7f297ffff700 1 -- 172.21.15.71:0/1599681915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2968004d50 msgr2=0x7f29801538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:13.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.873+0000 7f297ffff700 1 --2- 172.21.15.71:0/1599681915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2968004d50 0x7f29801538c0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f2970007390 tx=0x7f2970001e70 comp rx=0 tx=0).stop 2023-10-09T06:58:13.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.873+0000 7f297ffff700 1 -- 172.21.15.71:0/1599681915 shutdown_connections 2023-10-09T06:58:13.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.873+0000 7f297ffff700 1 --2- 172.21.15.71:0/1599681915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f298015c4f0 0x7f298015c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:13.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.873+0000 7f297ffff700 1 --2- 172.21.15.71:0/1599681915 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f296c066f00 0x7f296c0693b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:13.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.873+0000 7f297ffff700 1 --2- 172.21.15.71:0/1599681915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2968004d50 0x7f29801538c0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:13.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.873+0000 7f297ffff700 1 --2- 172.21.15.71:0/1599681915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2980159ca0 0x7f29800c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:13.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.873+0000 7f297ffff700 1 -- 172.21.15.71:0/1599681915 >> 172.21.15.71:0/1599681915 conn(0x7f29800d0660 msgr2=0x7f298015d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:13.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.873+0000 7f297ffff700 1 -- 172.21.15.71:0/1599681915 shutdown_connections 2023-10-09T06:58:13.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:13.873+0000 7f297ffff700 1 -- 172.21.15.71:0/1599681915 wait complete. 2023-10-09T06:58:13.876 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:58:13.891 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-09T06:58:12.030962+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":323,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2433448,"kb_used_data":10088,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752541272,"statfs":{"total":773094113280,"available":770602262528,"internally_reserved":0,"allocated":10330112,"data_stored":5575148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.264842"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.792788+0000","last_change":"2023-10-09T06:58:03.789534+0000","last_active":"2023-10-09T06:58:03.792788+0000","last_peered":"2023-10-09T06:58:03.792788+0000","last_clean":"2023-10-09T06:58:03.792788+0000","last_became_active":"2023-10-09T06:58:03.789290+0000","last_became_peered":"2023-10-09T06:58:03.789290+0000","last_unstale":"2023-10-09T06:58:03.792788+0000","last_undegraded":"2023-10-09T06:58:03.792788+0000","last_fullsized":"2023-10-09T06:58:03.792788+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:50:36.641716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.794824+0000","last_change":"2023-10-09T06:58:03.789945+0000","last_active":"2023-10-09T06:58:03.794824+0000","last_peered":"2023-10-09T06:58:03.794824+0000","last_clean":"2023-10-09T06:58:03.794824+0000","last_became_active":"2023-10-09T06:58:03.789174+0000","last_became_peered":"2023-10-09T06:58:03.789174+0000","last_unstale":"2023-10-09T06:58:03.794824+0000","last_undegraded":"2023-10-09T06:58:03.794824+0000","last_fullsized":"2023-10-09T06:58:03.794824+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:06:31.549641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781741+0000","last_change":"2023-10-09T06:58:03.778823+0000","last_active":"2023-10-09T06:58:03.781741+0000","last_peered":"2023-10-09T06:58:03.781741+0000","last_clean":"2023-10-09T06:58:03.781741+0000","last_became_active":"2023-10-09T06:58:03.778577+0000","last_became_peered":"2023-10-09T06:58:03.778577+0000","last_unstale":"2023-10-09T06:58:03.781741+0000","last_undegraded":"2023-10-09T06:58:03.781741+0000","last_fullsized":"2023-10-09T06:58:03.781741+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:19.132641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.791624+0000","last_change":"2023-10-09T06:58:03.790890+0000","last_active":"2023-10-09T06:58:03.791624+0000","last_peered":"2023-10-09T06:58:03.791624+0000","last_clean":"2023-10-09T06:58:03.791624+0000","last_became_active":"2023-10-09T06:58:03.790601+0000","last_became_peered":"2023-10-09T06:58:03.790601+0000","last_unstale":"2023-10-09T06:58:03.791624+0000","last_undegraded":"2023-10-09T06:58:03.791624+0000","last_fullsized":"2023-10-09T06:58:03.791624+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:39.273916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.788534+0000","last_change":"2023-10-09T06:58:03.787537+0000","last_active":"2023-10-09T06:58:03.788534+0000","last_peered":"2023-10-09T06:58:03.788534+0000","last_clean":"2023-10-09T06:58:03.788534+0000","last_became_active":"2023-10-09T06:58:03.787261+0000","last_became_peered":"2023-10-09T06:58:03.787261+0000","last_unstale":"2023-10-09T06:58:03.788534+0000","last_undegraded":"2023-10-09T06:58:03.788534+0000","last_fullsized":"2023-10-09T06:58:03.788534+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:49:37.095152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.791144+0000","last_change":"2023-10-09T06:58:03.786533+0000","last_active":"2023-10-09T06:58:03.791144+0000","last_peered":"2023-10-09T06:58:03.791144+0000","last_clean":"2023-10-09T06:58:03.791144+0000","last_became_active":"2023-10-09T06:58:03.786175+0000","last_became_peered":"2023-10-09T06:58:03.786175+0000","last_unstale":"2023-10-09T06:58:03.791144+0000","last_undegraded":"2023-10-09T06:58:03.791144+0000","last_fullsized":"2023-10-09T06:58:03.791144+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:47:17.600550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.785849+0000","last_change":"2023-10-09T06:58:03.783980+0000","last_active":"2023-10-09T06:58:03.785849+0000","last_peered":"2023-10-09T06:58:03.785849+0000","last_clean":"2023-10-09T06:58:03.785849+0000","last_became_active":"2023-10-09T06:58:03.783692+0000","last_became_peered":"2023-10-09T06:58:03.783692+0000","last_unstale":"2023-10-09T06:58:03.785849+0000","last_undegraded":"2023-10-09T06:58:03.785849+0000","last_fullsized":"2023-10-09T06:58:03.785849+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:31.444809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.795661+0000","last_change":"2023-10-09T06:58:03.792074+0000","last_active":"2023-10-09T06:58:03.795661+0000","last_peered":"2023-10-09T06:58:03.795661+0000","last_clean":"2023-10-09T06:58:03.795661+0000","last_became_active":"2023-10-09T06:58:03.788540+0000","last_became_peered":"2023-10-09T06:58:03.788540+0000","last_unstale":"2023-10-09T06:58:03.795661+0000","last_undegraded":"2023-10-09T06:58:03.795661+0000","last_fullsized":"2023-10-09T06:58:03.795661+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:25.556491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781603+0000","last_change":"2023-10-09T06:58:03.779446+0000","last_active":"2023-10-09T06:58:03.781603+0000","last_peered":"2023-10-09T06:58:03.781603+0000","last_clean":"2023-10-09T06:58:03.781603+0000","last_became_active":"2023-10-09T06:58:03.779142+0000","last_became_peered":"2023-10-09T06:58:03.779142+0000","last_unstale":"2023-10-09T06:58:03.781603+0000","last_undegraded":"2023-10-09T06:58:03.781603+0000","last_fullsized":"2023-10-09T06:58:03.781603+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:42.427200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.789415+0000","last_change":"2023-10-09T06:58:03.787051+0000","last_active":"2023-10-09T06:58:03.789415+0000","last_peered":"2023-10-09T06:58:03.789415+0000","last_clean":"2023-10-09T06:58:03.789415+0000","last_became_active":"2023-10-09T06:58:03.786743+0000","last_became_peered":"2023-10-09T06:58:03.786743+0000","last_unstale":"2023-10-09T06:58:03.789415+0000","last_undegraded":"2023-10-09T06:58:03.789415+0000","last_fullsized":"2023-10-09T06:58:03.789415+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:49:20.065373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.787921+0000","last_change":"2023-10-09T06:58:03.784751+0000","last_active":"2023-10-09T06:58:03.787921+0000","last_peered":"2023-10-09T06:58:03.787921+0000","last_clean":"2023-10-09T06:58:03.787921+0000","last_became_active":"2023-10-09T06:58:03.784412+0000","last_became_peered":"2023-10-09T06:58:03.784412+0000","last_unstale":"2023-10-09T06:58:03.787921+0000","last_undegraded":"2023-10-09T06:58:03.787921+0000","last_fullsized":"2023-10-09T06:58:03.787921+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:31.444809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.786488+0000","last_change":"2023-10-09T06:58:03.783075+0000","last_active":"2023-10-09T06:58:03.786488+0000","last_peered":"2023-10-09T06:58:03.786488+0000","last_clean":"2023-10-09T06:58:03.786488+0000","last_became_active":"2023-10-09T06:58:03.782836+0000","last_became_peered":"2023-10-09T06:58:03.782836+0000","last_unstale":"2023-10-09T06:58:03.786488+0000","last_undegraded":"2023-10-09T06:58:03.786488+0000","last_fullsized":"2023-10-09T06:58:03.786488+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:27.010548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.788787+0000","last_change":"2023-10-09T06:58:03.788199+0000","last_active":"2023-10-09T06:58:03.788787+0000","last_peered":"2023-10-09T06:58:03.788787+0000","last_clean":"2023-10-09T06:58:03.788787+0000","last_became_active":"2023-10-09T06:58:03.787893+0000","last_became_peered":"2023-10-09T06:58:03.787893+0000","last_unstale":"2023-10-09T06:58:03.788787+0000","last_undegraded":"2023-10-09T06:58:03.788787+0000","last_fullsized":"2023-10-09T06:58:03.788787+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:44.586446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.778194+0000","last_change":"2023-10-09T06:58:03.774830+0000","last_active":"2023-10-09T06:58:03.778194+0000","last_peered":"2023-10-09T06:58:03.778194+0000","last_clean":"2023-10-09T06:58:03.778194+0000","last_became_active":"2023-10-09T06:58:03.774540+0000","last_became_peered":"2023-10-09T06:58:03.774540+0000","last_unstale":"2023-10-09T06:58:03.778194+0000","last_undegraded":"2023-10-09T06:58:03.778194+0000","last_fullsized":"2023-10-09T06:58:03.778194+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:55.445121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.784320+0000","last_change":"2023-10-09T06:58:03.782721+0000","last_active":"2023-10-09T06:58:03.784320+0000","last_peered":"2023-10-09T06:58:03.784320+0000","last_clean":"2023-10-09T06:58:03.784320+0000","last_became_active":"2023-10-09T06:58:03.782471+0000","last_became_peered":"2023-10-09T06:58:03.782471+0000","last_unstale":"2023-10-09T06:58:03.784320+0000","last_undegraded":"2023-10-09T06:58:03.784320+0000","last_fullsized":"2023-10-09T06:58:03.784320+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:01.380815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.793615+0000","last_change":"2023-10-09T06:58:03.792174+0000","last_active":"2023-10-09T06:58:03.793615+0000","last_peered":"2023-10-09T06:58:03.793615+0000","last_clean":"2023-10-09T06:58:03.793615+0000","last_became_active":"2023-10-09T06:58:03.791905+0000","last_became_peered":"2023-10-09T06:58:03.791905+0000","last_unstale":"2023-10-09T06:58:03.793615+0000","last_undegraded":"2023-10-09T06:58:03.793615+0000","last_fullsized":"2023-10-09T06:58:03.793615+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:50.295594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781583+0000","last_change":"2023-10-09T06:58:03.778825+0000","last_active":"2023-10-09T06:58:03.781583+0000","last_peered":"2023-10-09T06:58:03.781583+0000","last_clean":"2023-10-09T06:58:03.781583+0000","last_became_active":"2023-10-09T06:58:03.778586+0000","last_became_peered":"2023-10-09T06:58:03.778586+0000","last_unstale":"2023-10-09T06:58:03.781583+0000","last_undegraded":"2023-10-09T06:58:03.781583+0000","last_fullsized":"2023-10-09T06:58:03.781583+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:38:42.093928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.792047+0000","last_change":"2023-10-09T06:58:03.790976+0000","last_active":"2023-10-09T06:58:03.792047+0000","last_peered":"2023-10-09T06:58:03.792047+0000","last_clean":"2023-10-09T06:58:03.792047+0000","last_became_active":"2023-10-09T06:58:03.790611+0000","last_became_peered":"2023-10-09T06:58:03.790611+0000","last_unstale":"2023-10-09T06:58:03.792047+0000","last_undegraded":"2023-10-09T06:58:03.792047+0000","last_fullsized":"2023-10-09T06:58:03.792047+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:45:13.736492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.794689+0000","last_change":"2023-10-09T06:58:03.789940+0000","last_active":"2023-10-09T06:58:03.794689+0000","last_peered":"2023-10-09T06:58:03.794689+0000","last_clean":"2023-10-09T06:58:03.794689+0000","last_became_active":"2023-10-09T06:58:03.789643+0000","last_became_peered":"2023-10-09T06:58:03.789643+0000","last_unstale":"2023-10-09T06:58:03.794689+0000","last_undegraded":"2023-10-09T06:58:03.794689+0000","last_fullsized":"2023-10-09T06:58:03.794689+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:57:42.341129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.783595+0000","last_change":"2023-10-09T06:58:03.780575+0000","last_active":"2023-10-09T06:58:03.783595+0000","last_peered":"2023-10-09T06:58:03.783595+0000","last_clean":"2023-10-09T06:58:03.783595+0000","last_became_active":"2023-10-09T06:58:03.780287+0000","last_became_peered":"2023-10-09T06:58:03.780287+0000","last_unstale":"2023-10-09T06:58:03.783595+0000","last_undegraded":"2023-10-09T06:58:03.783595+0000","last_fullsized":"2023-10-09T06:58:03.783595+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:50.836527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.785013+0000","last_change":"2023-10-09T06:58:03.780486+0000","last_active":"2023-10-09T06:58:03.785013+0000","last_peered":"2023-10-09T06:58:03.785013+0000","last_clean":"2023-10-09T06:58:03.785013+0000","last_became_active":"2023-10-09T06:58:03.780211+0000","last_became_peered":"2023-10-09T06:58:03.780211+0000","last_unstale":"2023-10-09T06:58:03.785013+0000","last_undegraded":"2023-10-09T06:58:03.785013+0000","last_fullsized":"2023-10-09T06:58:03.785013+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:57:42.341129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.785061+0000","last_change":"2023-10-09T06:58:03.779844+0000","last_active":"2023-10-09T06:58:03.785061+0000","last_peered":"2023-10-09T06:58:03.785061+0000","last_clean":"2023-10-09T06:58:03.785061+0000","last_became_active":"2023-10-09T06:58:03.779562+0000","last_became_peered":"2023-10-09T06:58:03.779562+0000","last_unstale":"2023-10-09T06:58:03.785061+0000","last_undegraded":"2023-10-09T06:58:03.785061+0000","last_fullsized":"2023-10-09T06:58:03.785061+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:25.556491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.783296+0000","last_change":"2023-10-09T06:58:03.782386+0000","last_active":"2023-10-09T06:58:03.783296+0000","last_peered":"2023-10-09T06:58:03.783296+0000","last_clean":"2023-10-09T06:58:03.783296+0000","last_became_active":"2023-10-09T06:58:03.782073+0000","last_became_peered":"2023-10-09T06:58:03.782073+0000","last_unstale":"2023-10-09T06:58:03.783296+0000","last_undegraded":"2023-10-09T06:58:03.783296+0000","last_fullsized":"2023-10-09T06:58:03.783296+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:48:11.588308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.796330+0000","last_change":"2023-10-09T06:58:03.795684+0000","last_active":"2023-10-09T06:58:03.796330+0000","last_peered":"2023-10-09T06:58:03.796330+0000","last_clean":"2023-10-09T06:58:03.796330+0000","last_became_active":"2023-10-09T06:58:03.795288+0000","last_became_peered":"2023-10-09T06:58:03.795288+0000","last_unstale":"2023-10-09T06:58:03.796330+0000","last_undegraded":"2023-10-09T06:58:03.796330+0000","last_fullsized":"2023-10-09T06:58:03.796330+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:07.827266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.784911+0000","last_change":"2023-10-09T06:58:03.777803+0000","last_active":"2023-10-09T06:58:03.784911+0000","last_peered":"2023-10-09T06:58:03.784911+0000","last_clean":"2023-10-09T06:58:03.784911+0000","last_became_active":"2023-10-09T06:58:03.777439+0000","last_became_peered":"2023-10-09T06:58:03.777439+0000","last_unstale":"2023-10-09T06:58:03.784911+0000","last_undegraded":"2023-10-09T06:58:03.784911+0000","last_fullsized":"2023-10-09T06:58:03.784911+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:06:31.549641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.793171+0000","last_change":"2023-10-09T06:58:03.792692+0000","last_active":"2023-10-09T06:58:03.793171+0000","last_peered":"2023-10-09T06:58:03.793171+0000","last_clean":"2023-10-09T06:58:03.793171+0000","last_became_active":"2023-10-09T06:58:03.791146+0000","last_became_peered":"2023-10-09T06:58:03.791146+0000","last_unstale":"2023-10-09T06:58:03.793171+0000","last_undegraded":"2023-10-09T06:58:03.793171+0000","last_fullsized":"2023-10-09T06:58:03.793171+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:21.136138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.780921+0000","last_change":"2023-10-09T06:58:03.778338+0000","last_active":"2023-10-09T06:58:03.780921+0000","last_peered":"2023-10-09T06:58:03.780921+0000","last_clean":"2023-10-09T06:58:03.780921+0000","last_became_active":"2023-10-09T06:58:03.778095+0000","last_became_peered":"2023-10-09T06:58:03.778095+0000","last_unstale":"2023-10-09T06:58:03.780921+0000","last_undegraded":"2023-10-09T06:58:03.780921+0000","last_fullsized":"2023-10-09T06:58:03.780921+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:50.836527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.786486+0000","last_change":"2023-10-09T06:58:03.780636+0000","last_active":"2023-10-09T06:58:03.786486+0000","last_peered":"2023-10-09T06:58:03.786486+0000","last_clean":"2023-10-09T06:58:03.786486+0000","last_became_active":"2023-10-09T06:58:03.780355+0000","last_became_peered":"2023-10-09T06:58:03.780355+0000","last_unstale":"2023-10-09T06:58:03.786486+0000","last_undegraded":"2023-10-09T06:58:03.786486+0000","last_fullsized":"2023-10-09T06:58:03.786486+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:25:52.709241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.777660+0000","last_change":"2023-10-09T06:58:03.775523+0000","last_active":"2023-10-09T06:58:03.777660+0000","last_peered":"2023-10-09T06:58:03.777660+0000","last_clean":"2023-10-09T06:58:03.777660+0000","last_became_active":"2023-10-09T06:58:03.775252+0000","last_became_peered":"2023-10-09T06:58:03.775252+0000","last_unstale":"2023-10-09T06:58:03.777660+0000","last_undegraded":"2023-10-09T06:58:03.777660+0000","last_fullsized":"2023-10-09T06:58:03.777660+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:33:52.454840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.792556+0000","last_change":"2023-10-09T06:58:03.791431+0000","last_active":"2023-10-09T06:58:03.792556+0000","last_peered":"2023-10-09T06:58:03.792556+0000","last_clean":"2023-10-09T06:58:03.792556+0000","last_became_active":"2023-10-09T06:58:03.791137+0000","last_became_peered":"2023-10-09T06:58:03.791137+0000","last_unstale":"2023-10-09T06:58:03.792556+0000","last_undegraded":"2023-10-09T06:58:03.792556+0000","last_fullsized":"2023-10-09T06:58:03.792556+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:50:36.641716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781215+0000","last_change":"2023-10-09T06:58:03.779006+0000","last_active":"2023-10-09T06:58:03.781215+0000","last_peered":"2023-10-09T06:58:03.781215+0000","last_clean":"2023-10-09T06:58:03.781215+0000","last_became_active":"2023-10-09T06:58:03.778750+0000","last_became_peered":"2023-10-09T06:58:03.778750+0000","last_unstale":"2023-10-09T06:58:03.781215+0000","last_undegraded":"2023-10-09T06:58:03.781215+0000","last_fullsized":"2023-10-09T06:58:03.781215+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:48:11.588308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.795691+0000","last_change":"2023-10-09T06:58:03.792838+0000","last_active":"2023-10-09T06:58:03.795691+0000","last_peered":"2023-10-09T06:58:03.795691+0000","last_clean":"2023-10-09T06:58:03.795691+0000","last_became_active":"2023-10-09T06:58:03.789210+0000","last_became_peered":"2023-10-09T06:58:03.789210+0000","last_unstale":"2023-10-09T06:58:03.795691+0000","last_undegraded":"2023-10-09T06:58:03.795691+0000","last_fullsized":"2023-10-09T06:58:03.795691+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:49:20.065373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.794075+0000","last_change":"2023-10-09T06:58:03.791824+0000","last_active":"2023-10-09T06:58:03.794075+0000","last_peered":"2023-10-09T06:58:03.794075+0000","last_clean":"2023-10-09T06:58:03.794075+0000","last_became_active":"2023-10-09T06:58:03.791420+0000","last_became_peered":"2023-10-09T06:58:03.791420+0000","last_unstale":"2023-10-09T06:58:03.794075+0000","last_undegraded":"2023-10-09T06:58:03.794075+0000","last_fullsized":"2023-10-09T06:58:03.794075+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:21.136138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"92'4","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.295288+0000","last_change":"2023-10-09T06:58:03.272921+0000","last_active":"2023-10-09T06:58:04.295288+0000","last_peered":"2023-10-09T06:58:04.295288+0000","last_clean":"2023-10-09T06:58:04.295288+0000","last_became_active":"2023-10-09T06:58:03.272657+0000","last_became_peered":"2023-10-09T06:58:03.272657+0000","last_unstale":"2023-10-09T06:58:04.295288+0000","last_undegraded":"2023-10-09T06:58:04.295288+0000","last_fullsized":"2023-10-09T06:58:04.295288+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:47:16.591202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781593+0000","last_change":"2023-10-09T06:58:03.779335+0000","last_active":"2023-10-09T06:58:03.781593+0000","last_peered":"2023-10-09T06:58:03.781593+0000","last_clean":"2023-10-09T06:58:03.781593+0000","last_became_active":"2023-10-09T06:58:03.779073+0000","last_became_peered":"2023-10-09T06:58:03.779073+0000","last_unstale":"2023-10-09T06:58:03.781593+0000","last_undegraded":"2023-10-09T06:58:03.781593+0000","last_fullsized":"2023-10-09T06:58:03.781593+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:35.834887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"92'1","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.290439+0000","last_change":"2023-10-09T06:58:03.281341+0000","last_active":"2023-10-09T06:58:04.290439+0000","last_peered":"2023-10-09T06:58:04.290439+0000","last_clean":"2023-10-09T06:58:04.290439+0000","last_became_active":"2023-10-09T06:58:03.281014+0000","last_became_peered":"2023-10-09T06:58:03.281014+0000","last_unstale":"2023-10-09T06:58:04.290439+0000","last_undegraded":"2023-10-09T06:58:04.290439+0000","last_fullsized":"2023-10-09T06:58:04.290439+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:50:35.632368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.794958+0000","last_change":"2023-10-09T06:58:03.790823+0000","last_active":"2023-10-09T06:58:03.794958+0000","last_peered":"2023-10-09T06:58:03.794958+0000","last_clean":"2023-10-09T06:58:03.794958+0000","last_became_active":"2023-10-09T06:58:03.790499+0000","last_became_peered":"2023-10-09T06:58:03.790499+0000","last_unstale":"2023-10-09T06:58:03.794958+0000","last_undegraded":"2023-10-09T06:58:03.794958+0000","last_fullsized":"2023-10-09T06:58:03.794958+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:43:11.121942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"92'2","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.298982+0000","last_change":"2023-10-09T06:58:03.284110+0000","last_active":"2023-10-09T06:58:04.298982+0000","last_peered":"2023-10-09T06:58:04.298982+0000","last_clean":"2023-10-09T06:58:04.298982+0000","last_became_active":"2023-10-09T06:58:03.283761+0000","last_became_peered":"2023-10-09T06:58:03.283761+0000","last_unstale":"2023-10-09T06:58:04.298982+0000","last_undegraded":"2023-10-09T06:58:04.298982+0000","last_fullsized":"2023-10-09T06:58:04.298982+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:25.142797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.787941+0000","last_change":"2023-10-09T06:58:03.785933+0000","last_active":"2023-10-09T06:58:03.787941+0000","last_peered":"2023-10-09T06:58:03.787941+0000","last_clean":"2023-10-09T06:58:03.787941+0000","last_became_active":"2023-10-09T06:58:03.785654+0000","last_became_peered":"2023-10-09T06:58:03.785654+0000","last_unstale":"2023-10-09T06:58:03.787941+0000","last_undegraded":"2023-10-09T06:58:03.787941+0000","last_fullsized":"2023-10-09T06:58:03.787941+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:53.641729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"92'2","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.296422+0000","last_change":"2023-10-09T06:58:03.284511+0000","last_active":"2023-10-09T06:58:04.296422+0000","last_peered":"2023-10-09T06:58:04.296422+0000","last_clean":"2023-10-09T06:58:04.296422+0000","last_became_active":"2023-10-09T06:58:03.283943+0000","last_became_peered":"2023-10-09T06:58:03.283943+0000","last_unstale":"2023-10-09T06:58:04.296422+0000","last_undegraded":"2023-10-09T06:58:04.296422+0000","last_fullsized":"2023-10-09T06:58:04.296422+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:45:12.727143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.785214+0000","last_change":"2023-10-09T06:58:03.781836+0000","last_active":"2023-10-09T06:58:03.785214+0000","last_peered":"2023-10-09T06:58:03.785214+0000","last_clean":"2023-10-09T06:58:03.785214+0000","last_became_active":"2023-10-09T06:58:03.781556+0000","last_became_peered":"2023-10-09T06:58:03.781556+0000","last_unstale":"2023-10-09T06:58:03.785214+0000","last_undegraded":"2023-10-09T06:58:03.785214+0000","last_fullsized":"2023-10-09T06:58:03.785214+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:37:47.124680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"92'1","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.290920+0000","last_change":"2023-10-09T06:58:03.274347+0000","last_active":"2023-10-09T06:58:04.290920+0000","last_peered":"2023-10-09T06:58:04.290920+0000","last_clean":"2023-10-09T06:58:04.290920+0000","last_became_active":"2023-10-09T06:58:03.274034+0000","last_became_peered":"2023-10-09T06:58:03.274034+0000","last_unstale":"2023-10-09T06:58:04.290920+0000","last_undegraded":"2023-10-09T06:58:04.290920+0000","last_fullsized":"2023-10-09T06:58:04.290920+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:06.817917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.789333+0000","last_change":"2023-10-09T06:58:03.787185+0000","last_active":"2023-10-09T06:58:03.789333+0000","last_peered":"2023-10-09T06:58:03.789333+0000","last_clean":"2023-10-09T06:58:03.789333+0000","last_became_active":"2023-10-09T06:58:03.786868+0000","last_became_peered":"2023-10-09T06:58:03.786868+0000","last_unstale":"2023-10-09T06:58:03.789333+0000","last_undegraded":"2023-10-09T06:58:03.789333+0000","last_fullsized":"2023-10-09T06:58:03.789333+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:43:11.121942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"92'1","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.298648+0000","last_change":"2023-10-09T06:58:03.283484+0000","last_active":"2023-10-09T06:58:04.298648+0000","last_peered":"2023-10-09T06:58:04.298648+0000","last_clean":"2023-10-09T06:58:04.298648+0000","last_became_active":"2023-10-09T06:58:03.283124+0000","last_became_peered":"2023-10-09T06:58:03.283124+0000","last_unstale":"2023-10-09T06:58:04.298648+0000","last_undegraded":"2023-10-09T06:58:04.298648+0000","last_fullsized":"2023-10-09T06:58:04.298648+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:02.609888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.780519+0000","last_change":"2023-10-09T06:58:03.778295+0000","last_active":"2023-10-09T06:58:03.780519+0000","last_peered":"2023-10-09T06:58:03.780519+0000","last_clean":"2023-10-09T06:58:03.780519+0000","last_became_active":"2023-10-09T06:58:03.777990+0000","last_became_peered":"2023-10-09T06:58:03.777990+0000","last_unstale":"2023-10-09T06:58:03.780519+0000","last_undegraded":"2023-10-09T06:58:03.780519+0000","last_fullsized":"2023-10-09T06:58:03.780519+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:38.362218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.776114+0000","last_change":"2023-10-09T06:58:03.278385+0000","last_active":"2023-10-09T06:58:03.776114+0000","last_peered":"2023-10-09T06:58:03.776114+0000","last_clean":"2023-10-09T06:58:03.776114+0000","last_became_active":"2023-10-09T06:58:03.278063+0000","last_became_peered":"2023-10-09T06:58:03.278063+0000","last_unstale":"2023-10-09T06:58:03.776114+0000","last_undegraded":"2023-10-09T06:58:03.776114+0000","last_fullsized":"2023-10-09T06:58:03.776114+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:01:05.569394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.787641+0000","last_change":"2023-10-09T06:58:03.786407+0000","last_active":"2023-10-09T06:58:03.787641+0000","last_peered":"2023-10-09T06:58:03.787641+0000","last_clean":"2023-10-09T06:58:03.787641+0000","last_became_active":"2023-10-09T06:58:03.786139+0000","last_became_peered":"2023-10-09T06:58:03.786139+0000","last_unstale":"2023-10-09T06:58:03.787641+0000","last_undegraded":"2023-10-09T06:58:03.787641+0000","last_fullsized":"2023-10-09T06:58:03.787641+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:54:29.099122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.773510+0000","last_change":"2023-10-09T06:58:03.274854+0000","last_active":"2023-10-09T06:58:03.773510+0000","last_peered":"2023-10-09T06:58:03.773510+0000","last_clean":"2023-10-09T06:58:03.773510+0000","last_became_active":"2023-10-09T06:58:03.274591+0000","last_became_peered":"2023-10-09T06:58:03.274591+0000","last_unstale":"2023-10-09T06:58:03.773510+0000","last_undegraded":"2023-10-09T06:58:03.773510+0000","last_fullsized":"2023-10-09T06:58:03.773510+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:27:49.714248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.785226+0000","last_change":"2023-10-09T06:58:03.782408+0000","last_active":"2023-10-09T06:58:03.785226+0000","last_peered":"2023-10-09T06:58:03.785226+0000","last_clean":"2023-10-09T06:58:03.785226+0000","last_became_active":"2023-10-09T06:58:03.782092+0000","last_became_peered":"2023-10-09T06:58:03.782092+0000","last_unstale":"2023-10-09T06:58:03.785226+0000","last_undegraded":"2023-10-09T06:58:03.785226+0000","last_fullsized":"2023-10-09T06:58:03.785226+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:32:56.779064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.771080+0000","last_change":"2023-10-09T06:58:03.275785+0000","last_active":"2023-10-09T06:58:03.771080+0000","last_peered":"2023-10-09T06:58:03.771080+0000","last_clean":"2023-10-09T06:58:03.771080+0000","last_became_active":"2023-10-09T06:58:03.275488+0000","last_became_peered":"2023-10-09T06:58:03.275488+0000","last_unstale":"2023-10-09T06:58:03.771080+0000","last_undegraded":"2023-10-09T06:58:03.771080+0000","last_fullsized":"2023-10-09T06:58:03.771080+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:17.053444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.794206+0000","last_change":"2023-10-09T06:58:03.792929+0000","last_active":"2023-10-09T06:58:03.794206+0000","last_peered":"2023-10-09T06:58:03.794206+0000","last_clean":"2023-10-09T06:58:03.794206+0000","last_became_active":"2023-10-09T06:58:03.792605+0000","last_became_peered":"2023-10-09T06:58:03.792605+0000","last_unstale":"2023-10-09T06:58:03.794206+0000","last_undegraded":"2023-10-09T06:58:03.794206+0000","last_fullsized":"2023-10-09T06:58:03.794206+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:37:47.124680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.785180+0000","last_change":"2023-10-09T06:58:03.283460+0000","last_active":"2023-10-09T06:58:03.785180+0000","last_peered":"2023-10-09T06:58:03.785180+0000","last_clean":"2023-10-09T06:58:03.785180+0000","last_became_active":"2023-10-09T06:58:03.283143+0000","last_became_peered":"2023-10-09T06:58:03.283143+0000","last_unstale":"2023-10-09T06:58:03.785180+0000","last_undegraded":"2023-10-09T06:58:03.785180+0000","last_fullsized":"2023-10-09T06:58:03.785180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:13.207974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.794559+0000","last_change":"2023-10-09T06:58:03.789549+0000","last_active":"2023-10-09T06:58:03.794559+0000","last_peered":"2023-10-09T06:58:03.794559+0000","last_clean":"2023-10-09T06:58:03.794559+0000","last_became_active":"2023-10-09T06:58:03.789165+0000","last_became_peered":"2023-10-09T06:58:03.789165+0000","last_unstale":"2023-10-09T06:58:03.794559+0000","last_undegraded":"2023-10-09T06:58:03.794559+0000","last_fullsized":"2023-10-09T06:58:03.794559+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:25:52.709241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"92'3","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.293010+0000","last_change":"2023-10-09T06:58:03.277580+0000","last_active":"2023-10-09T06:58:04.293010+0000","last_peered":"2023-10-09T06:58:04.293010+0000","last_clean":"2023-10-09T06:58:04.293010+0000","last_became_active":"2023-10-09T06:58:03.277331+0000","last_became_peered":"2023-10-09T06:58:03.277331+0000","last_unstale":"2023-10-09T06:58:04.293010+0000","last_undegraded":"2023-10-09T06:58:04.293010+0000","last_fullsized":"2023-10-09T06:58:04.293010+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:52.632381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781319+0000","last_change":"2023-10-09T06:58:03.779510+0000","last_active":"2023-10-09T06:58:03.781319+0000","last_peered":"2023-10-09T06:58:03.781319+0000","last_clean":"2023-10-09T06:58:03.781319+0000","last_became_active":"2023-10-09T06:58:03.778576+0000","last_became_peered":"2023-10-09T06:58:03.778576+0000","last_unstale":"2023-10-09T06:58:03.781319+0000","last_undegraded":"2023-10-09T06:58:03.781319+0000","last_fullsized":"2023-10-09T06:58:03.781319+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:43:18.959668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"92'6","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.295792+0000","last_change":"2023-10-09T06:58:03.281626+0000","last_active":"2023-10-09T06:58:04.295792+0000","last_peered":"2023-10-09T06:58:04.295792+0000","last_clean":"2023-10-09T06:58:04.295792+0000","last_became_active":"2023-10-09T06:58:03.280397+0000","last_became_peered":"2023-10-09T06:58:03.280397+0000","last_unstale":"2023-10-09T06:58:04.295792+0000","last_undegraded":"2023-10-09T06:58:04.295792+0000","last_fullsized":"2023-10-09T06:58:04.295792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:08:56.251029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.791789+0000","last_change":"2023-10-09T06:58:03.790284+0000","last_active":"2023-10-09T06:58:03.791789+0000","last_peered":"2023-10-09T06:58:03.791789+0000","last_clean":"2023-10-09T06:58:03.791789+0000","last_became_active":"2023-10-09T06:58:03.789908+0000","last_became_peered":"2023-10-09T06:58:03.789908+0000","last_unstale":"2023-10-09T06:58:03.791789+0000","last_undegraded":"2023-10-09T06:58:03.791789+0000","last_fullsized":"2023-10-09T06:58:03.791789+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:04:00.621347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"92'2","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.294274+0000","last_change":"2023-10-09T06:58:03.278338+0000","last_active":"2023-10-09T06:58:04.294274+0000","last_peered":"2023-10-09T06:58:04.294274+0000","last_clean":"2023-10-09T06:58:04.294274+0000","last_became_active":"2023-10-09T06:58:03.278052+0000","last_became_peered":"2023-10-09T06:58:03.278052+0000","last_unstale":"2023-10-09T06:58:04.294274+0000","last_undegraded":"2023-10-09T06:58:04.294274+0000","last_fullsized":"2023-10-09T06:58:04.294274+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:34.825539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.775447+0000","last_change":"2023-10-09T06:58:03.773873+0000","last_active":"2023-10-09T06:58:03.775447+0000","last_peered":"2023-10-09T06:58:03.775447+0000","last_clean":"2023-10-09T06:58:03.775447+0000","last_became_active":"2023-10-09T06:58:03.773515+0000","last_became_peered":"2023-10-09T06:58:03.773515+0000","last_unstale":"2023-10-09T06:58:03.775447+0000","last_undegraded":"2023-10-09T06:58:03.775447+0000","last_fullsized":"2023-10-09T06:58:03.775447+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:55.201809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.784360+0000","last_change":"2023-10-09T06:58:03.281877+0000","last_active":"2023-10-09T06:58:03.784360+0000","last_peered":"2023-10-09T06:58:03.784360+0000","last_clean":"2023-10-09T06:58:03.784360+0000","last_became_active":"2023-10-09T06:58:03.281627+0000","last_became_peered":"2023-10-09T06:58:03.281627+0000","last_unstale":"2023-10-09T06:58:03.784360+0000","last_undegraded":"2023-10-09T06:58:03.784360+0000","last_fullsized":"2023-10-09T06:58:03.784360+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:33.198191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.787196+0000","last_change":"2023-10-09T06:58:03.786093+0000","last_active":"2023-10-09T06:58:03.787196+0000","last_peered":"2023-10-09T06:58:03.787196+0000","last_clean":"2023-10-09T06:58:03.787196+0000","last_became_active":"2023-10-09T06:58:03.785836+0000","last_became_peered":"2023-10-09T06:58:03.785836+0000","last_unstale":"2023-10-09T06:58:03.787196+0000","last_undegraded":"2023-10-09T06:58:03.787196+0000","last_fullsized":"2023-10-09T06:58:03.787196+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:55:10.559656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.770284+0000","last_change":"2023-10-09T06:58:03.276634+0000","last_active":"2023-10-09T06:58:03.770284+0000","last_peered":"2023-10-09T06:58:03.770284+0000","last_clean":"2023-10-09T06:58:03.770284+0000","last_became_active":"2023-10-09T06:58:03.276352+0000","last_became_peered":"2023-10-09T06:58:03.276352+0000","last_unstale":"2023-10-09T06:58:03.770284+0000","last_undegraded":"2023-10-09T06:58:03.770284+0000","last_fullsized":"2023-10-09T06:58:03.770284+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:06:30.540293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.781370+0000","last_change":"2023-10-09T06:58:03.780365+0000","last_active":"2023-10-09T06:58:03.781370+0000","last_peered":"2023-10-09T06:58:03.781370+0000","last_clean":"2023-10-09T06:58:03.781370+0000","last_became_active":"2023-10-09T06:58:03.779868+0000","last_became_peered":"2023-10-09T06:58:03.779868+0000","last_unstale":"2023-10-09T06:58:03.781370+0000","last_undegraded":"2023-10-09T06:58:03.781370+0000","last_fullsized":"2023-10-09T06:58:03.781370+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:29:24.208508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"92'8","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.299394+0000","last_change":"2023-10-09T06:58:03.277129+0000","last_active":"2023-10-09T06:58:04.299394+0000","last_peered":"2023-10-09T06:58:04.299394+0000","last_clean":"2023-10-09T06:58:04.299394+0000","last_became_active":"2023-10-09T06:58:03.276851+0000","last_became_peered":"2023-10-09T06:58:03.276851+0000","last_unstale":"2023-10-09T06:58:04.299394+0000","last_undegraded":"2023-10-09T06:58:04.299394+0000","last_fullsized":"2023-10-09T06:58:04.299394+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:45:12.727143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.784941+0000","last_change":"2023-10-09T06:58:03.778392+0000","last_active":"2023-10-09T06:58:03.784941+0000","last_peered":"2023-10-09T06:58:03.784941+0000","last_clean":"2023-10-09T06:58:03.784941+0000","last_became_active":"2023-10-09T06:58:03.778133+0000","last_became_peered":"2023-10-09T06:58:03.778133+0000","last_unstale":"2023-10-09T06:58:03.784941+0000","last_undegraded":"2023-10-09T06:58:03.784941+0000","last_fullsized":"2023-10-09T06:58:03.784941+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:46:16.740158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"92'1","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.298779+0000","last_change":"2023-10-09T06:58:03.280938+0000","last_active":"2023-10-09T06:58:04.298779+0000","last_peered":"2023-10-09T06:58:04.298779+0000","last_clean":"2023-10-09T06:58:04.298779+0000","last_became_active":"2023-10-09T06:58:03.280556+0000","last_became_peered":"2023-10-09T06:58:03.280556+0000","last_unstale":"2023-10-09T06:58:04.298779+0000","last_undegraded":"2023-10-09T06:58:04.298779+0000","last_fullsized":"2023-10-09T06:58:04.298779+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:00:45.728123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.787320+0000","last_change":"2023-10-09T06:58:03.783538+0000","last_active":"2023-10-09T06:58:03.787320+0000","last_peered":"2023-10-09T06:58:03.787320+0000","last_clean":"2023-10-09T06:58:03.787320+0000","last_became_active":"2023-10-09T06:58:03.783250+0000","last_became_peered":"2023-10-09T06:58:03.783250+0000","last_unstale":"2023-10-09T06:58:03.787320+0000","last_undegraded":"2023-10-09T06:58:03.787320+0000","last_fullsized":"2023-10-09T06:58:03.787320+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:32:56.779064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"92'2","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.299739+0000","last_change":"2023-10-09T06:58:03.284555+0000","last_active":"2023-10-09T06:58:04.299739+0000","last_peered":"2023-10-09T06:58:04.299739+0000","last_clean":"2023-10-09T06:58:04.299739+0000","last_became_active":"2023-10-09T06:58:03.284259+0000","last_became_peered":"2023-10-09T06:58:03.284259+0000","last_unstale":"2023-10-09T06:58:04.299739+0000","last_undegraded":"2023-10-09T06:58:04.299739+0000","last_fullsized":"2023-10-09T06:58:04.299739+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:28.178529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.787006+0000","last_change":"2023-10-09T06:58:03.783652+0000","last_active":"2023-10-09T06:58:03.787006+0000","last_peered":"2023-10-09T06:58:03.787006+0000","last_clean":"2023-10-09T06:58:03.787006+0000","last_became_active":"2023-10-09T06:58:03.783398+0000","last_became_peered":"2023-10-09T06:58:03.783398+0000","last_unstale":"2023-10-09T06:58:03.787006+0000","last_undegraded":"2023-10-09T06:58:03.787006+0000","last_fullsized":"2023-10-09T06:58:03.787006+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:18.062792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"92'1","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.298674+0000","last_change":"2023-10-09T06:58:03.279603+0000","last_active":"2023-10-09T06:58:04.298674+0000","last_peered":"2023-10-09T06:58:04.298674+0000","last_clean":"2023-10-09T06:58:04.298674+0000","last_became_active":"2023-10-09T06:58:03.279307+0000","last_became_peered":"2023-10-09T06:58:03.279307+0000","last_unstale":"2023-10-09T06:58:04.298674+0000","last_undegraded":"2023-10-09T06:58:04.298674+0000","last_fullsized":"2023-10-09T06:58:04.298674+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:17.053444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.779091+0000","last_change":"2023-10-09T06:58:03.775521+0000","last_active":"2023-10-09T06:58:03.779091+0000","last_peered":"2023-10-09T06:58:03.779091+0000","last_clean":"2023-10-09T06:58:03.779091+0000","last_became_active":"2023-10-09T06:58:03.775284+0000","last_became_peered":"2023-10-09T06:58:03.775284+0000","last_unstale":"2023-10-09T06:58:03.779091+0000","last_undegraded":"2023-10-09T06:58:03.779091+0000","last_fullsized":"2023-10-09T06:58:03.779091+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:01:46.472752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.775903+0000","last_change":"2023-10-09T06:58:03.276635+0000","last_active":"2023-10-09T06:58:03.775903+0000","last_peered":"2023-10-09T06:58:03.775903+0000","last_clean":"2023-10-09T06:58:03.775903+0000","last_became_active":"2023-10-09T06:58:03.276373+0000","last_became_peered":"2023-10-09T06:58:03.276373+0000","last_unstale":"2023-10-09T06:58:03.775903+0000","last_undegraded":"2023-10-09T06:58:03.775903+0000","last_fullsized":"2023-10-09T06:58:03.775903+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:27.443310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.778718+0000","last_change":"2023-10-09T06:58:03.777764+0000","last_active":"2023-10-09T06:58:03.778718+0000","last_peered":"2023-10-09T06:58:03.778718+0000","last_clean":"2023-10-09T06:58:03.778718+0000","last_became_active":"2023-10-09T06:58:03.777519+0000","last_became_peered":"2023-10-09T06:58:03.777519+0000","last_unstale":"2023-10-09T06:58:03.778718+0000","last_undegraded":"2023-10-09T06:58:03.778718+0000","last_fullsized":"2023-10-09T06:58:03.778718+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:48.690134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.784485+0000","last_change":"2023-10-09T06:58:03.279295+0000","last_active":"2023-10-09T06:58:03.784485+0000","last_peered":"2023-10-09T06:58:03.784485+0000","last_clean":"2023-10-09T06:58:03.784485+0000","last_became_active":"2023-10-09T06:58:03.279021+0000","last_became_peered":"2023-10-09T06:58:03.279021+0000","last_unstale":"2023-10-09T06:58:03.784485+0000","last_undegraded":"2023-10-09T06:58:03.784485+0000","last_fullsized":"2023-10-09T06:58:03.784485+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:36.489423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.795108+0000","last_change":"2023-10-09T06:58:03.794613+0000","last_active":"2023-10-09T06:58:03.795108+0000","last_peered":"2023-10-09T06:58:03.795108+0000","last_clean":"2023-10-09T06:58:03.795108+0000","last_became_active":"2023-10-09T06:58:03.794396+0000","last_became_peered":"2023-10-09T06:58:03.794396+0000","last_unstale":"2023-10-09T06:58:03.795108+0000","last_undegraded":"2023-10-09T06:58:03.795108+0000","last_fullsized":"2023-10-09T06:58:03.795108+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:05.501958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.770390+0000","last_change":"2023-10-09T06:58:03.276348+0000","last_active":"2023-10-09T06:58:03.770390+0000","last_peered":"2023-10-09T06:58:03.770390+0000","last_clean":"2023-10-09T06:58:03.770390+0000","last_became_active":"2023-10-09T06:58:03.276081+0000","last_became_peered":"2023-10-09T06:58:03.276081+0000","last_unstale":"2023-10-09T06:58:03.770390+0000","last_undegraded":"2023-10-09T06:58:03.770390+0000","last_fullsized":"2023-10-09T06:58:03.770390+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:43:10.112593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.791753+0000","last_change":"2023-10-09T06:58:03.790775+0000","last_active":"2023-10-09T06:58:03.791753+0000","last_peered":"2023-10-09T06:58:03.791753+0000","last_clean":"2023-10-09T06:58:03.791753+0000","last_became_active":"2023-10-09T06:58:03.790517+0000","last_became_peered":"2023-10-09T06:58:03.790517+0000","last_unstale":"2023-10-09T06:58:03.791753+0000","last_undegraded":"2023-10-09T06:58:03.791753+0000","last_fullsized":"2023-10-09T06:58:03.791753+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:38:39.496926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.772648+0000","last_change":"2023-10-09T06:58:03.282068+0000","last_active":"2023-10-09T06:58:03.772648+0000","last_peered":"2023-10-09T06:58:03.772648+0000","last_clean":"2023-10-09T06:58:03.772648+0000","last_became_active":"2023-10-09T06:58:03.281770+0000","last_became_peered":"2023-10-09T06:58:03.281770+0000","last_unstale":"2023-10-09T06:58:03.772648+0000","last_undegraded":"2023-10-09T06:58:03.772648+0000","last_fullsized":"2023-10-09T06:58:03.772648+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:48:10.578960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.784340+0000","last_change":"2023-10-09T06:58:03.782745+0000","last_active":"2023-10-09T06:58:03.784340+0000","last_peered":"2023-10-09T06:58:03.784340+0000","last_clean":"2023-10-09T06:58:03.784340+0000","last_became_active":"2023-10-09T06:58:03.782504+0000","last_became_peered":"2023-10-09T06:58:03.782504+0000","last_unstale":"2023-10-09T06:58:03.784340+0000","last_undegraded":"2023-10-09T06:58:03.784340+0000","last_fullsized":"2023-10-09T06:58:03.784340+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:35.203503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"92'2","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.295177+0000","last_change":"2023-10-09T06:58:03.281936+0000","last_active":"2023-10-09T06:58:04.295177+0000","last_peered":"2023-10-09T06:58:04.295177+0000","last_clean":"2023-10-09T06:58:04.295177+0000","last_became_active":"2023-10-09T06:58:03.281604+0000","last_became_peered":"2023-10-09T06:58:03.281604+0000","last_unstale":"2023-10-09T06:58:04.295177+0000","last_undegraded":"2023-10-09T06:58:04.295177+0000","last_fullsized":"2023-10-09T06:58:04.295177+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:30:36.943328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.786434+0000","last_change":"2023-10-09T06:58:03.783557+0000","last_active":"2023-10-09T06:58:03.786434+0000","last_peered":"2023-10-09T06:58:03.786434+0000","last_clean":"2023-10-09T06:58:03.786434+0000","last_became_active":"2023-10-09T06:58:03.783295+0000","last_became_peered":"2023-10-09T06:58:03.783295+0000","last_unstale":"2023-10-09T06:58:03.786434+0000","last_undegraded":"2023-10-09T06:58:03.786434+0000","last_fullsized":"2023-10-09T06:58:03.786434+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:34.486926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.770530+0000","last_change":"2023-10-09T06:58:03.278232+0000","last_active":"2023-10-09T06:58:03.770530+0000","last_peered":"2023-10-09T06:58:03.770530+0000","last_clean":"2023-10-09T06:58:03.770530+0000","last_became_active":"2023-10-09T06:58:03.277973+0000","last_became_peered":"2023-10-09T06:58:03.277973+0000","last_unstale":"2023-10-09T06:58:03.770530+0000","last_undegraded":"2023-10-09T06:58:03.770530+0000","last_fullsized":"2023-10-09T06:58:03.770530+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:46:15.730810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.791926+0000","last_change":"2023-10-09T06:58:03.790868+0000","last_active":"2023-10-09T06:58:03.791926+0000","last_peered":"2023-10-09T06:58:03.791926+0000","last_clean":"2023-10-09T06:58:03.791926+0000","last_became_active":"2023-10-09T06:58:03.790610+0000","last_became_peered":"2023-10-09T06:58:03.790610+0000","last_unstale":"2023-10-09T06:58:03.791926+0000","last_undegraded":"2023-10-09T06:58:03.791926+0000","last_fullsized":"2023-10-09T06:58:03.791926+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:34.486926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.776473+0000","last_change":"2023-10-09T06:58:03.282655+0000","last_active":"2023-10-09T06:58:03.776473+0000","last_peered":"2023-10-09T06:58:03.776473+0000","last_clean":"2023-10-09T06:58:03.776473+0000","last_became_active":"2023-10-09T06:58:03.282390+0000","last_became_peered":"2023-10-09T06:58:03.282390+0000","last_unstale":"2023-10-09T06:58:03.776473+0000","last_undegraded":"2023-10-09T06:58:03.776473+0000","last_fullsized":"2023-10-09T06:58:03.776473+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:39:27.910719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.789345+0000","last_change":"2023-10-09T06:58:03.788017+0000","last_active":"2023-10-09T06:58:03.789345+0000","last_peered":"2023-10-09T06:58:03.789345+0000","last_clean":"2023-10-09T06:58:03.789345+0000","last_became_active":"2023-10-09T06:58:03.786231+0000","last_became_peered":"2023-10-09T06:58:03.786231+0000","last_unstale":"2023-10-09T06:58:03.789345+0000","last_undegraded":"2023-10-09T06:58:03.789345+0000","last_fullsized":"2023-10-09T06:58:03.789345+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:55.201809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.775076+0000","last_change":"2023-10-09T06:58:03.282318+0000","last_active":"2023-10-09T06:58:03.775076+0000","last_peered":"2023-10-09T06:58:03.775076+0000","last_clean":"2023-10-09T06:58:03.775076+0000","last_became_active":"2023-10-09T06:58:03.282067+0000","last_became_peered":"2023-10-09T06:58:03.282067+0000","last_unstale":"2023-10-09T06:58:03.775076+0000","last_undegraded":"2023-10-09T06:58:03.775076+0000","last_fullsized":"2023-10-09T06:58:03.775076+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:54.192461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.782118+0000","last_change":"2023-10-09T06:58:03.780989+0000","last_active":"2023-10-09T06:58:03.782118+0000","last_peered":"2023-10-09T06:58:03.782118+0000","last_clean":"2023-10-09T06:58:03.782118+0000","last_became_active":"2023-10-09T06:58:03.780759+0000","last_became_peered":"2023-10-09T06:58:03.780759+0000","last_unstale":"2023-10-09T06:58:03.782118+0000","last_undegraded":"2023-10-09T06:58:03.782118+0000","last_fullsized":"2023-10-09T06:58:03.782118+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:05.430877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.776139+0000","last_change":"2023-10-09T06:58:03.277955+0000","last_active":"2023-10-09T06:58:03.776139+0000","last_peered":"2023-10-09T06:58:03.776139+0000","last_clean":"2023-10-09T06:58:03.776139+0000","last_became_active":"2023-10-09T06:58:03.277692+0000","last_became_peered":"2023-10-09T06:58:03.277692+0000","last_unstale":"2023-10-09T06:58:03.776139+0000","last_undegraded":"2023-10-09T06:58:03.776139+0000","last_fullsized":"2023-10-09T06:58:03.776139+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:44:10.319004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.791451+0000","last_change":"2023-10-09T06:58:03.787275+0000","last_active":"2023-10-09T06:58:03.791451+0000","last_peered":"2023-10-09T06:58:03.791451+0000","last_clean":"2023-10-09T06:58:03.791451+0000","last_became_active":"2023-10-09T06:58:03.786984+0000","last_became_peered":"2023-10-09T06:58:03.786984+0000","last_unstale":"2023-10-09T06:58:03.791451+0000","last_undegraded":"2023-10-09T06:58:03.791451+0000","last_fullsized":"2023-10-09T06:58:03.791451+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:46:16.740158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.775905+0000","last_change":"2023-10-09T06:58:03.279055+0000","last_active":"2023-10-09T06:58:03.775905+0000","last_peered":"2023-10-09T06:58:03.775905+0000","last_clean":"2023-10-09T06:58:03.775905+0000","last_became_active":"2023-10-09T06:58:03.278781+0000","last_became_peered":"2023-10-09T06:58:03.278781+0000","last_unstale":"2023-10-09T06:58:03.775905+0000","last_undegraded":"2023-10-09T06:58:03.775905+0000","last_fullsized":"2023-10-09T06:58:03.775905+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:41.417852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.779579+0000","last_change":"2023-10-09T06:58:03.777888+0000","last_active":"2023-10-09T06:58:03.779579+0000","last_peered":"2023-10-09T06:58:03.779579+0000","last_clean":"2023-10-09T06:58:03.779579+0000","last_became_active":"2023-10-09T06:58:03.777552+0000","last_became_peered":"2023-10-09T06:58:03.777552+0000","last_unstale":"2023-10-09T06:58:03.779579+0000","last_undegraded":"2023-10-09T06:58:03.779579+0000","last_fullsized":"2023-10-09T06:58:03.779579+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:14.217322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.769064+0000","last_change":"2023-10-09T06:58:03.272814+0000","last_active":"2023-10-09T06:58:03.769064+0000","last_peered":"2023-10-09T06:58:03.769064+0000","last_clean":"2023-10-09T06:58:03.769064+0000","last_became_active":"2023-10-09T06:58:03.272489+0000","last_became_peered":"2023-10-09T06:58:03.272489+0000","last_unstale":"2023-10-09T06:58:03.769064+0000","last_undegraded":"2023-10-09T06:58:03.769064+0000","last_fullsized":"2023-10-09T06:58:03.769064+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:26.001200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.791421+0000","last_change":"2023-10-09T06:58:03.786567+0000","last_active":"2023-10-09T06:58:03.791421+0000","last_peered":"2023-10-09T06:58:03.791421+0000","last_clean":"2023-10-09T06:58:03.791421+0000","last_became_active":"2023-10-09T06:58:03.786232+0000","last_became_peered":"2023-10-09T06:58:03.786232+0000","last_unstale":"2023-10-09T06:58:03.791421+0000","last_undegraded":"2023-10-09T06:58:03.791421+0000","last_fullsized":"2023-10-09T06:58:03.791421+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:50.295594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.784170+0000","last_change":"2023-10-09T06:58:03.284773+0000","last_active":"2023-10-09T06:58:03.784170+0000","last_peered":"2023-10-09T06:58:03.784170+0000","last_clean":"2023-10-09T06:58:03.784170+0000","last_became_active":"2023-10-09T06:58:03.284399+0000","last_became_peered":"2023-10-09T06:58:03.284399+0000","last_unstale":"2023-10-09T06:58:03.784170+0000","last_undegraded":"2023-10-09T06:58:03.784170+0000","last_fullsized":"2023-10-09T06:58:03.784170+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:38.264568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.792125+0000","last_change":"2023-10-09T06:58:03.791372+0000","last_active":"2023-10-09T06:58:03.792125+0000","last_peered":"2023-10-09T06:58:03.792125+0000","last_clean":"2023-10-09T06:58:03.792125+0000","last_became_active":"2023-10-09T06:58:03.791000+0000","last_became_peered":"2023-10-09T06:58:03.791000+0000","last_unstale":"2023-10-09T06:58:03.792125+0000","last_undegraded":"2023-10-09T06:58:03.792125+0000","last_fullsized":"2023-10-09T06:58:03.792125+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:03.253528+0000","last_clean_scrub_stamp":"2023-10-09T06:58:03.253528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:35:41.435584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"92'2","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:04.299102+0000","last_change":"2023-10-09T06:58:03.284768+0000","last_active":"2023-10-09T06:58:04.299102+0000","last_peered":"2023-10-09T06:58:04.299102+0000","last_clean":"2023-10-09T06:58:04.299102+0000","last_became_active":"2023-10-09T06:58:03.284454+0000","last_became_peered":"2023-10-09T06:58:03.284454+0000","last_unstale":"2023-10-09T06:58:04.299102+0000","last_undegraded":"2023-10-09T06:58:04.299102+0000","last_fullsized":"2023-10-09T06:58:04.299102+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:02.244180+0000","last_clean_scrub_stamp":"2023-10-09T06:58:02.244180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:26.001200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"82'183","reported_seq":460,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-09T06:58:03.775260+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:58:03.775260+0000","last_peered":"2023-10-09T06:58:03.775260+0000","last_clean":"2023-10-09T06:58:03.775260+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:58:03.775260+0000","last_undegraded":"2023-10-09T06:58:03.775260+0000","last_fullsized":"2023-10-09T06:58:03.775260+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575036,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303080,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068760,"statfs":{"total":96636764160,"available":96326410240,"internally_reserved":0,"allocated":1736704,"data_stored":1139681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68400000000000005,"15min":0.70799999999999996},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.316},"max":{"1min":0.81100000000000005,"5min":1.732,"15min":1.9490000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.44,"5min":0.40200000000000002,"15min":0.29999999999999999},"max":{"1min":0.83299999999999996,"5min":1.22,"15min":3.448},"last":0.70299999999999996}]},{"osd":1,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.504,"5min":0.437,"15min":0.379},"max":{"1min":0.86799999999999999,"5min":2.3559999999999999,"15min":5.617},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.46999999999999997,"5min":0.45800000000000002,"15min":0.40200000000000002},"max":{"1min":0.97599999999999998,"5min":1.7869999999999999,"15min":2.016},"last":0.79800000000000004}]},{"osd":2,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.72999999999999998,"15min":0.73899999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.44800000000000001},"max":{"1min":0.97999999999999998,"5min":1.9430000000000001,"15min":2.052},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.73799999999999999,"15min":0.75600000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.44700000000000001},"max":{"1min":0.82399999999999995,"5min":2.6629999999999998,"15min":3.5019999999999998},"last":0.51800000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.73899999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.45000000000000001},"max":{"1min":0.97099999999999997,"5min":1.03,"15min":5.5800000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.746,"15min":0.78100000000000003},"min":{"1min":0.50800000000000001,"5min":0.496,"15min":0.47099999999999997},"max":{"1min":0.89800000000000002,"5min":1.827,"15min":6.9299999999999997},"last":0.76000000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.91000000000000003,"5min":0.95499999999999996,"15min":3.125},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.66500000000000004},"min":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1850000000000001,"5min":2.577,"15min":4.8380000000000001},"last":0.73799999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68700000000000006,"15min":0.68100000000000005},"min":{"1min":0.441,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":1.0309999999999999,"5min":2.5169999999999999,"15min":4.1929999999999996},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.5,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":2.9590000000000001,"15min":3.6749999999999998},"last":0.77600000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0449999999999999,"5min":3.0019999999999998,"15min":4.0250000000000004},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72699999999999998,"15min":0.752},"min":{"1min":0.498,"5min":0.47399999999999998,"15min":0.44700000000000001},"max":{"1min":1.0740000000000001,"5min":2.4039999999999999,"15min":7.0259999999999998},"last":0.78600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575035,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302500,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1142784,"data_stored":548817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68799999999999994,"15min":0.71399999999999997},"min":{"1min":0.47599999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86899999999999999,"5min":0.97899999999999998,"15min":1.022},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66700000000000004,"15min":0.70199999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.36599999999999999},"max":{"1min":0.72999999999999998,"5min":0.93899999999999995,"15min":1.079},"last":0.71699999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.68799999999999994,"15min":0.71999999999999997},"min":{"1min":0.48199999999999998,"5min":0.45500000000000002,"15min":0.42799999999999999},"max":{"1min":0.76700000000000002,"5min":1.135,"15min":1.135},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68799999999999994,"15min":0.72499999999999998},"min":{"1min":0.47799999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81699999999999995,"5min":1.0109999999999999,"15min":1.034},"last":0.69499999999999995}]},{"osd":2,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.69999999999999996,"15min":0.73199999999999998},"min":{"1min":0.52300000000000002,"5min":0.49199999999999999,"15min":0.42599999999999999},"max":{"1min":0.86099999999999999,"5min":1.391,"15min":1.391},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.68799999999999994,"15min":0.73099999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90500000000000003,"5min":0.91000000000000003,"15min":1.0900000000000001},"last":0.58499999999999996}]},{"osd":3,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66700000000000004,"15min":0.69899999999999995},"min":{"1min":0.502,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.81899999999999995,"5min":0.91700000000000004,"15min":1.046},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.72899999999999998,"15min":0.753},"min":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.497},"max":{"1min":0.82999999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.80700000000000005}]},{"osd":4,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61399999999999999,"15min":0.621},"min":{"1min":0.38,"5min":0.38,"15min":0.377},"max":{"1min":0.84699999999999998,"5min":1.768,"15min":1.768},"last":0.437},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.36199999999999999},"max":{"1min":0.84399999999999997,"5min":1.601,"15min":1.601},"last":0.55800000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65500000000000003,"15min":0.65200000000000002},"min":{"1min":0.53100000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84099999999999997,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.42299999999999999},"max":{"1min":0.86699999999999999,"5min":0.94699999999999995,"15min":1.0669999999999999},"last":0.51400000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66900000000000004,"15min":0.67600000000000005},"min":{"1min":0.55600000000000005,"5min":0.42899999999999999,"15min":0.41799999999999998},"max":{"1min":0.95999999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56499999999999995,"5min":0.44600000000000001,"15min":0.42399999999999999},"max":{"1min":0.89600000000000002,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.73999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302512,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069328,"statfs":{"total":96636764160,"available":96326991872,"internally_reserved":0,"allocated":1155072,"data_stored":550849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.27600000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59399999999999997,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.503,"5min":0.49199999999999999,"15min":0.48299999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.23699999999999999},"max":{"1min":1.083,"5min":1.23,"15min":1.23},"last":0.32600000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.29599999999999999},"max":{"1min":0.68500000000000005,"5min":1.169,"15min":1.169},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.439,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":3.077,"15min":3.077},"last":0.56899999999999995}]},{"osd":3,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.40000000000000002,"5min":0.376,"15min":0.34100000000000003},"max":{"1min":0.76000000000000001,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.39100000000000001,"5min":0.34899999999999998,"15min":0.34100000000000003},"max":{"1min":1.056,"5min":1.605,"15min":1.605},"last":0.36099999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73899999999999999,"15min":0.76100000000000001},"min":{"1min":0.497,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.89900000000000002,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.75800000000000001,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93999999999999995,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.72299999999999998}]},{"osd":5,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75800000000000001,"15min":0.77400000000000002},"min":{"1min":0.55000000000000004,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.3140000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75900000000000001,"15min":0.78100000000000003},"min":{"1min":0.54500000000000004,"5min":0.497,"15min":0.47999999999999998},"max":{"1min":0.95799999999999996,"5min":1.637,"15min":1.637},"last":0.65200000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78700000000000003,"15min":0.79600000000000004},"min":{"1min":0.54600000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97899999999999998,"5min":1.696,"15min":1.696},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78600000000000003,"15min":0.79700000000000004},"min":{"1min":0.54600000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1679999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81999999999999995,"15min":0.82599999999999996},"min":{"1min":0.55500000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1479999999999999,"5min":1.2669999999999999,"15min":1.4510000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79800000000000004,"15min":0.82299999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98699999999999999,"5min":1.125,"15min":1.1970000000000001},"last":0.69099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575035,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298976,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072864,"statfs":{"total":96636764160,"available":96330612736,"internally_reserved":0,"allocated":1728512,"data_stored":1139093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.29299999999999998,"5min":0.27100000000000002,"15min":0.23000000000000001},"max":{"1min":0.623,"5min":0.85799999999999998,"15min":1.2729999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.28899999999999998},"max":{"1min":0.60399999999999998,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":0.47499999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.63400000000000001,"5min":4.6980000000000004,"15min":4.6980000000000004},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48999999999999999,"15min":0.497},"min":{"1min":0.34000000000000002,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.71799999999999997,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.41499999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":0.63800000000000001,"5min":1.2450000000000001,"15min":1.7130000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.441,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":0.70199999999999996,"5min":4.734,"15min":4.734},"last":0.498}]},{"osd":4,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.52900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99199999999999999,"5min":1.2270000000000001,"15min":1.752},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.50700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.91500000000000004,"5min":4.6619999999999999,"15min":4.6619999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.53700000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0049999999999999,"5min":1.1890000000000001,"15min":1.2769999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.58699999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90300000000000002,"5min":1.2809999999999999,"15min":1.7889999999999999},"last":0.81699999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.80500000000000005,"15min":0.81299999999999994},"min":{"1min":0.56499999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97299999999999998,"5min":4.6239999999999997,"15min":4.6239999999999997},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79300000000000004,"15min":0.80100000000000005},"min":{"1min":0.55600000000000005,"5min":0.50800000000000001,"15min":0.47999999999999998},"max":{"1min":0.96499999999999997,"5min":1.2689999999999999,"15min":1.4370000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.82499999999999996,"15min":0.83199999999999996},"min":{"1min":0.56299999999999994,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.042,"5min":1.256,"15min":1.518},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.621,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95599999999999996,"5min":1.702,"15min":1.8200000000000001},"last":0.753}]}]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306600,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065240,"statfs":{"total":96636764160,"available":96322805760,"internally_reserved":0,"allocated":1146880,"data_stored":550261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.46800000000000003,"15min":0.45400000000000001},"min":{"1min":0.28299999999999997,"5min":0.26500000000000001,"15min":0.25900000000000001},"max":{"1min":0.76700000000000002,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.48999999999999999,"15min":0.495},"min":{"1min":0.30599999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.55300000000000005,"5min":1.633,"15min":1.633},"last":0.38800000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46400000000000002,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71599999999999997,"5min":1.097,"15min":1.865},"last":0.371},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.79700000000000004,"5min":1.2689999999999999,"15min":1.79},"last":0.45400000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.58899999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.35799999999999998},"max":{"1min":0.82599999999999996,"5min":0.86699999999999999,"15min":1.8999999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.47399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70299999999999996,"5min":1.1890000000000001,"15min":1.8220000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":0.85799999999999998,"5min":1.2430000000000001,"15min":1.256},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.55000000000000004,"5min":0.45900000000000002,"15min":0.44800000000000001},"max":{"1min":0.91400000000000003,"5min":1.696,"15min":1.696},"last":0.77800000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.753,"15min":0.76800000000000002},"min":{"1min":0.505,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85199999999999998,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.503},"max":{"1min":0.83199999999999996,"5min":1.218,"15min":1.3440000000000001},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.54000000000000004,"5min":0.51000000000000001,"15min":0.48599999999999999},"max":{"1min":0.94899999999999995,"5min":1.768,"15min":1.768},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.76400000000000001,"15min":0.79000000000000004},"min":{"1min":0.56599999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92900000000000005,"5min":1.3580000000000001,"15min":1.5309999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.61799999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97799999999999998,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.58699999999999997,"5min":0.57599999999999996,"15min":0.50900000000000001},"max":{"1min":0.92000000000000004,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.621}]}]},{"osd":3,"up_from":13,"seq":55834575036,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306596,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065244,"statfs":{"total":96636764160,"available":96322809856,"internally_reserved":0,"allocated":1142784,"data_stored":548837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.29599999999999999,"5min":0.29499999999999998,"15min":0.24099999999999999},"max":{"1min":0.86299999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.47899999999999998,"15min":0.48799999999999999},"min":{"1min":0.315,"5min":0.30199999999999999,"15min":0.28100000000000003},"max":{"1min":0.63600000000000001,"5min":1.228,"15min":1.228},"last":0.498}]},{"osd":1,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.48099999999999998,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58699999999999997,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.379}]},{"osd":2,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94099999999999995,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64800000000000002,"15min":0.63300000000000001},"min":{"1min":0.44400000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.97699999999999998,"5min":3.8900000000000001,"15min":3.8900000000000001},"last":0.56899999999999995}]},{"osd":4,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.51100000000000001,"5min":0.48299999999999998,"15min":0.40799999999999997},"max":{"1min":0.76500000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.81000000000000005,"15min":0.82299999999999995},"min":{"1min":0.623,"5min":0.59399999999999997,"15min":0.52200000000000002},"max":{"1min":1.0189999999999999,"5min":1.22,"15min":1.22},"last":0.77000000000000002}]},{"osd":5,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.45000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.86199999999999999,"5min":1.3360000000000001,"15min":2.1549999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.56399999999999995,"5min":0.55900000000000005,"15min":0.50600000000000001},"max":{"1min":1.0569999999999999,"5min":1.1639999999999999,"15min":1.419},"last":0.68500000000000005}]},{"osd":6,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.51700000000000002},"max":{"1min":0.875,"5min":1.304,"15min":1.304},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95199999999999996,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.69899999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91100000000000003,"5min":1.8180000000000001,"15min":2.0880000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.80800000000000005,"15min":0.82099999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92300000000000004,"5min":1.486,"15min":1.486},"last":0.77800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575035,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310688,"kb_used_data":1112,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061152,"statfs":{"total":96636764160,"available":96318619648,"internally_reserved":0,"allocated":1138688,"data_stored":548795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71399999999999997,"15min":0.70399999999999996},"min":{"1min":0.45000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79200000000000004,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.72799999999999998,"15min":0.72299999999999998},"min":{"1min":0.50900000000000001,"5min":0.42699999999999999,"15min":0.39300000000000002},"max":{"1min":0.97399999999999998,"5min":2.8130000000000002,"15min":3.23},"last":0.623}]},{"osd":1,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71899999999999997,"15min":0.71099999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.373},"max":{"1min":0.85699999999999998,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.53000000000000003,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.86499999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.78900000000000003}]},{"osd":2,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.755,"15min":0.75700000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.38100000000000001},"max":{"1min":0.92900000000000005,"5min":2.5960000000000001,"15min":3.7509999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.48299999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90000000000000002,"5min":2.427,"15min":2.427},"last":0.76900000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.755,"15min":0.751},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.434},"max":{"1min":0.89700000000000002,"5min":2.6440000000000001,"15min":3.6970000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.77000000000000002,"15min":0.747},"min":{"1min":0.443,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":3.6899999999999999,"15min":3.6899999999999999},"last":0.80400000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63600000000000001,"15min":0.60899999999999999},"min":{"1min":0.379,"5min":0.317,"15min":0.317},"max":{"1min":0.84899999999999998,"5min":3.3860000000000001,"15min":3.4780000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.68999999999999995,"15min":0.65800000000000003},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.34999999999999998},"max":{"1min":0.91200000000000003,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.84699999999999998}]},{"osd":6,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67100000000000004,"15min":0.64000000000000001},"min":{"1min":0.47699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82299999999999995,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.71499999999999997,"15min":0.67900000000000005},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.374},"max":{"1min":0.89100000000000001,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.83099999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.49299999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.96599999999999997,"5min":2.7210000000000001,"15min":3.2789999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.76900000000000002},"min":{"1min":0.56499999999999995,"5min":0.439,"15min":0.439},"max":{"1min":0.93600000000000005,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.88700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575036,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302496,"kb_used_data":1112,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069344,"statfs":{"total":96636764160,"available":96327008256,"internally_reserved":0,"allocated":1138688,"data_stored":548815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67600000000000005,"15min":0.69699999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.72299999999999998,"5min":0.93600000000000005,"15min":1.655},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65700000000000003,"15min":0.68400000000000005},"min":{"1min":0.42899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78200000000000003,"5min":1.0269999999999999,"15min":1.1359999999999999},"last":0.59199999999999997}]},{"osd":1,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71699999999999997,"5min":0.96899999999999997,"15min":2.4159999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.45400000000000001,"5min":0.44,"15min":0.40400000000000003},"max":{"1min":0.89100000000000001,"5min":0.95099999999999996,"15min":1.706},"last":0.747}]},{"osd":2,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69699999999999995,"15min":0.72799999999999998},"min":{"1min":0.501,"5min":0.48499999999999999,"15min":0.42999999999999999},"max":{"1min":0.75800000000000001,"5min":0.997,"15min":1.79},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69699999999999995,"15min":0.71599999999999997},"min":{"1min":0.49199999999999999,"5min":0.46500000000000002,"15min":0.442},"max":{"1min":0.752,"5min":1.006,"15min":2.4889999999999999},"last":0.55100000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68999999999999995,"15min":0.71699999999999997},"min":{"1min":0.46899999999999997,"5min":0.438,"15min":0.435},"max":{"1min":0.88600000000000001,"5min":1.0209999999999999,"15min":1.409},"last":0.622},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73899999999999999,"15min":0.76900000000000002},"min":{"1min":0.56200000000000006,"5min":0.501,"15min":0.501},"max":{"1min":0.78600000000000003,"5min":0.95699999999999996,"15min":2.532},"last":0.60799999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":1.766},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.622,"15min":0.621},"min":{"1min":0.48599999999999999,"5min":0.377,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":1.052,"15min":2.7829999999999999},"last":0.56599999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.45100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82899999999999996,"5min":1.018,"15min":2.5739999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.40000000000000002,"15min":0.38900000000000001},"max":{"1min":0.84099999999999997,"5min":0.97999999999999998,"15min":1.8080000000000001},"last":0.57799999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.90700000000000003,"5min":1.175,"15min":2.9609999999999999},"last":0.502},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.60499999999999998,"5min":0.498,"15min":0.45900000000000002},"max":{"1min":0.876,"5min":1.139,"15min":2.613},"last":0.72299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:58:13.898 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T06:58:13.898 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T06:58:14.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.119+0000 7f07c81ff700 1 Processor -- start 2023-10-09T06:58:14.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.119+0000 7f07c81ff700 1 -- start start 2023-10-09T06:58:14.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.120+0000 7f07c81ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f07c0069fa0 0x7f07c006d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:14.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.120+0000 7f07c81ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c0156340 con 0x7f07c00c85c0 2023-10-09T06:58:14.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.120+0000 7f07c81ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c00c8990 con 0x7f07c0156ee0 2023-10-09T06:58:14.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.120+0000 7f07c81ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c006ee20 con 0x7f07c0069fa0 2023-10-09T06:58:14.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.120+0000 7f07c579a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f07c0069fa0 0x7f07c006d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:14.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.121+0000 7f07c579a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f07c0069fa0 0x7f07c006d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60026/0 (socket says 172.21.15.71:60026) 2023-10-09T06:58:14.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.121+0000 7f07c579a700 1 -- 172.21.15.71:0/3685927538 learned_addr learned my addr 172.21.15.71:0/3685927538 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:14.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.121+0000 7f07c5f9b700 1 --1- 172.21.15.71:0/3685927538 >> v1:172.21.15.71:6789/0 conn(0x7f07c00c85c0 0x7f07c0069890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:38598/0 (socket says 172.21.15.71:38598) 2023-10-09T06:58:14.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.121+0000 7f07c579a700 1 -- 172.21.15.71:0/3685927538 >> v1:172.21.15.179:6789/0 conn(0x7f07c0156ee0 legacy=0x7f07c00c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.121+0000 7f07c579a700 1 -- 172.21.15.71:0/3685927538 >> v1:172.21.15.71:6789/0 conn(0x7f07c00c85c0 legacy=0x7f07c0069890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.121+0000 7f07c579a700 1 -- 172.21.15.71:0/3685927538 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c006dd80 con 0x7f07c0069fa0 2023-10-09T06:58:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.121+0000 7f07c4f99700 1 -- 172.21.15.71:0/3685927538 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624729662 0 0) 0x7f07c0156340 con 0x7f07c00c85c0 2023-10-09T06:58:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.121+0000 7f07c579a700 1 --2- 172.21.15.71:0/3685927538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c0069fa0 0x7f07c006d6c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f07b00099b0 tx=0x7f07b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58102031b5578f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.121+0000 7f07c4f99700 1 -- 172.21.15.71:0/3685927538 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b000b820 con 0x7f07c0069fa0 2023-10-09T06:58:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.122+0000 7f07c4f99700 1 -- 172.21.15.71:0/3685927538 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b000b980 con 0x7f07c0069fa0 2023-10-09T06:58:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.122+0000 7f07c4f99700 1 -- 172.21.15.71:0/3685927538 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b000bd20 con 0x7f07c0069fa0 2023-10-09T06:58:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.122+0000 7f07c81ff700 1 -- 172.21.15.71:0/3685927538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c0069fa0 msgr2=0x7f07c006d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.122+0000 7f07c81ff700 1 --2- 172.21.15.71:0/3685927538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c0069fa0 0x7f07c006d6c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f07b00099b0 tx=0x7f07b0009250 comp rx=0 tx=0).stop 2023-10-09T06:58:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.122+0000 7f07c81ff700 1 -- 172.21.15.71:0/3685927538 shutdown_connections 2023-10-09T06:58:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.122+0000 7f07c81ff700 1 --2- 172.21.15.71:0/3685927538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c0069fa0 0x7f07c006d6c0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.122+0000 7f07c81ff700 1 -- 172.21.15.71:0/3685927538 >> 172.21.15.71:0/3685927538 conn(0x7f07c00cc540 msgr2=0x7f07c00cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.122+0000 7f07c81ff700 1 -- 172.21.15.71:0/3685927538 shutdown_connections 2023-10-09T06:58:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.122+0000 7f07c81ff700 1 -- 172.21.15.71:0/3685927538 wait complete. 2023-10-09T06:58:14.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.124+0000 7f07c81ff700 1 Processor -- start 2023-10-09T06:58:14.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.124+0000 7f07c81ff700 1 -- start start 2023-10-09T06:58:14.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.125+0000 7f07c81ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07c0069fa0 0x7f07c00c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:14.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.125+0000 7f07c81ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07c00c85c0 0x7f07c00aa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:14.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.125+0000 7f07c81ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c0156ee0 0x7f07c0169f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:14.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.125+0000 7f07c81ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00ab290 con 0x7f07c0156ee0 2023-10-09T06:58:14.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.125+0000 7f07c81ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00aa9f0 con 0x7f07c0069fa0 2023-10-09T06:58:14.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.125+0000 7f07c81ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00aacd0 con 0x7f07c00c85c0 2023-10-09T06:58:14.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.125+0000 7f07c679c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c0156ee0 0x7f07c0169f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:14.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.125+0000 7f07c679c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c0156ee0 0x7f07c0169f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60032/0 (socket says 172.21.15.71:60032) 2023-10-09T06:58:14.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.125+0000 7f07c679c700 1 -- 172.21.15.71:0/3588916796 learned_addr learned my addr 172.21.15.71:0/3588916796 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:14.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.125+0000 7f07c579a700 1 --2- 172.21.15.71:0/3588916796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07c00c85c0 0x7f07c00aa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:14.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.125+0000 7f07c5f9b700 1 --2- 172.21.15.71:0/3588916796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07c0069fa0 0x7f07c00c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:14.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.125+0000 7f07c679c700 1 -- 172.21.15.71:0/3588916796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07c00c85c0 msgr2=0x7f07c00aa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:14.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.125+0000 7f07c679c700 1 --2- 172.21.15.71:0/3588916796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07c00c85c0 0x7f07c00aa2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:14.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.125+0000 7f07c679c700 1 -- 172.21.15.71:0/3588916796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07c0069fa0 msgr2=0x7f07c00c37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:14.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.125+0000 7f07c679c700 1 --2- 172.21.15.71:0/3588916796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07c0069fa0 0x7f07c00c37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:14.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.125+0000 7f07c679c700 1 -- 172.21.15.71:0/3588916796 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b00094f0 con 0x7f07c0156ee0 2023-10-09T06:58:14.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.125+0000 7f07c5f9b700 1 --2- 172.21.15.71:0/3588916796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07c0069fa0 0x7f07c00c37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:14.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.126+0000 7f07c679c700 1 --2- 172.21.15.71:0/3588916796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c0156ee0 0x7f07c0169f00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f07b800bc30 tx=0x7f07b8009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:14.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.126+0000 7f07b5ffb700 1 -- 172.21.15.71:0/3588916796 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b800c9b0 con 0x7f07c0156ee0 2023-10-09T06:58:14.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.126+0000 7f07b5ffb700 1 -- 172.21.15.71:0/3588916796 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b800cb50 con 0x7f07c0156ee0 2023-10-09T06:58:14.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.126+0000 7f07b5ffb700 1 -- 172.21.15.71:0/3588916796 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b8014410 con 0x7f07c0156ee0 2023-10-09T06:58:14.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.126+0000 7f07c81ff700 1 -- 172.21.15.71:0/3588916796 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c00aafb0 con 0x7f07c0156ee0 2023-10-09T06:58:14.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.126+0000 7f07c81ff700 1 -- 172.21.15.71:0/3588916796 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c0155ea0 con 0x7f07c0156ee0 2023-10-09T06:58:14.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.127+0000 7f07c81ff700 1 -- 172.21.15.71:0/3588916796 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c00718b0 con 0x7f07c0156ee0 2023-10-09T06:58:14.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.128+0000 7f07b5ffb700 1 -- 172.21.15.71:0/3588916796 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f07b8014800 con 0x7f07c0156ee0 2023-10-09T06:58:14.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.129+0000 7f07b5ffb700 1 --2- 172.21.15.71:0/3588916796 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f07a4066f30 0x7f07a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:14.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.129+0000 7f07b5ffb700 1 -- 172.21.15.71:0/3588916796 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f07b8084770 con 0x7f07c0156ee0 2023-10-09T06:58:14.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.129+0000 7f07c5f9b700 1 --2- 172.21.15.71:0/3588916796 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f07a4066f30 0x7f07a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:14.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.130+0000 7f07c5f9b700 1 --2- 172.21.15.71:0/3588916796 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f07a4066f30 0x7f07a40693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f07bc0018b0 tx=0x7f07bc009040 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:14.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.133+0000 7f07b5ffb700 1 -- 172.21.15.71:0/3588916796 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07b804c5a0 con 0x7f07c0156ee0 2023-10-09T06:58:14.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.400+0000 7f07c81ff700 1 -- 172.21.15.71:0/3588916796 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f07c006e060 con 0x7f07c0156ee0 2023-10-09T06:58:14.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.404+0000 7f07b5ffb700 1 -- 172.21.15.71:0/3588916796 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f07b80552e0 con 0x7f07c0156ee0 2023-10-09T06:58:14.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.406+0000 7f07c81ff700 1 -- 172.21.15.71:0/3588916796 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f07a4066f30 msgr2=0x7f07a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:14.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.406+0000 7f07c81ff700 1 --2- 172.21.15.71:0/3588916796 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f07a4066f30 0x7f07a40693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f07bc0018b0 tx=0x7f07bc009040 comp rx=0 tx=0).stop 2023-10-09T06:58:14.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.406+0000 7f07c81ff700 1 -- 172.21.15.71:0/3588916796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c0156ee0 msgr2=0x7f07c0169f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:14.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.406+0000 7f07c81ff700 1 --2- 172.21.15.71:0/3588916796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c0156ee0 0x7f07c0169f00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f07b800bc30 tx=0x7f07b8009820 comp rx=0 tx=0).stop 2023-10-09T06:58:14.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.407+0000 7f07c81ff700 1 -- 172.21.15.71:0/3588916796 shutdown_connections 2023-10-09T06:58:14.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.407+0000 7f07c81ff700 1 --2- 172.21.15.71:0/3588916796 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f07a4066f30 0x7f07a40693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:14.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.407+0000 7f07c81ff700 1 --2- 172.21.15.71:0/3588916796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c0156ee0 0x7f07c0169f00 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:14.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.407+0000 7f07c81ff700 1 --2- 172.21.15.71:0/3588916796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07c0069fa0 0x7f07c00c37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:14.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.407+0000 7f07c81ff700 1 --2- 172.21.15.71:0/3588916796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07c00c85c0 0x7f07c00aa2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:14.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.407+0000 7f07c81ff700 1 -- 172.21.15.71:0/3588916796 >> 172.21.15.71:0/3588916796 conn(0x7f07c00cc540 msgr2=0x7f07c0158d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:14.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.407+0000 7f07c81ff700 1 -- 172.21.15.71:0/3588916796 shutdown_connections 2023-10-09T06:58:14.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.407+0000 7f07c81ff700 1 -- 172.21.15.71:0/3588916796 wait complete. 2023-10-09T06:58:14.413 INFO:teuthology.orchestra.run.smithi071.stderr:updated caps for client.0 2023-10-09T06:58:14.425 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:58:14.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.619+0000 7f37f679d700 1 Processor -- start 2023-10-09T06:58:14.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.619+0000 7f37f679d700 1 -- start start 2023-10-09T06:58:14.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.620+0000 7f37f679d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37f0150550 0x7f37f0157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:14.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.620+0000 7f37f679d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f006e2a0 con 0x7f37f0150180 2023-10-09T06:58:14.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.620+0000 7f37f679d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f006b2e0 con 0x7f37f00c7410 2023-10-09T06:58:14.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.620+0000 7f37f679d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f00c78e0 con 0x7f37f0150550 2023-10-09T06:58:14.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.620+0000 7f37f579b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f37f0150180 0x7f37f00c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:38600/0 (socket says 172.21.15.71:38600) 2023-10-09T06:58:14.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.621+0000 7f37f579b700 1 -- 172.21.15.71:0/3545607215 learned_addr learned my addr 172.21.15.71:0/3545607215 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:14.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.621+0000 7f37e7fff700 1 -- 172.21.15.71:0/3545607215 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970006190 0 0) 0x7f37f006e2a0 con 0x7f37f0150180 2023-10-09T06:58:14.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.621+0000 7f37f4f9a700 1 --2- 172.21.15.71:0/3545607215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37f0150550 0x7f37f0157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:14.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.621+0000 7f37e7fff700 1 -- 172.21.15.71:0/3545607215 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37dc004680 con 0x7f37f0150180 2023-10-09T06:58:14.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.621+0000 7f37e7fff700 1 -- 172.21.15.71:0/3545607215 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 588470969 0 0) 0x7f37dc004680 con 0x7f37f0150180 2023-10-09T06:58:14.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.621+0000 7f37e7fff700 1 -- 172.21.15.71:0/3545607215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37f0150550 msgr2=0x7f37f0157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:14.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.621+0000 7f37e7fff700 1 --2- 172.21.15.71:0/3545607215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37f0150550 0x7f37f0157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:14.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.621+0000 7f37e7fff700 1 -- 172.21.15.71:0/3545607215 >> v1:172.21.15.179:6789/0 conn(0x7f37f00c7410 legacy=0x7f37f0069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:14.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.621+0000 7f37e7fff700 1 -- 172.21.15.71:0/3545607215 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f00c7bc0 con 0x7f37f0150180 2023-10-09T06:58:14.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.621+0000 7f37e7fff700 1 -- 172.21.15.71:0/3545607215 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f37ec001470 con 0x7f37f0150180 2023-10-09T06:58:14.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.621+0000 7f37e7fff700 1 -- 172.21.15.71:0/3545607215 >> v1:172.21.15.71:6789/0 conn(0x7f37f0150180 legacy=0x7f37f00c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:14.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.621+0000 7f37e7fff700 1 --2- 172.21.15.71:0/3545607215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37f0150550 0x7f37dc004ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:14.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.621+0000 7f37e7fff700 1 --2- 172.21.15.71:0/3545607215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37dc005120 0x7f37dc005920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:14.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.622+0000 7f37e7fff700 1 --2- 172.21.15.71:0/3545607215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37dc005e60 0x7f37dc0062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:14.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.622+0000 7f37e7fff700 1 -- 172.21.15.71:0/3545607215 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f00c78e0 con 0x7f37dc005e60 2023-10-09T06:58:14.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.622+0000 7f37e7fff700 1 -- 172.21.15.71:0/3545607215 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc00cd00 con 0x7f37dc005120 2023-10-09T06:58:14.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.622+0000 7f37e7fff700 1 -- 172.21.15.71:0/3545607215 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc00cec0 con 0x7f37f0150550 2023-10-09T06:58:14.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.622+0000 7f37f579b700 1 --2- 172.21.15.71:0/3545607215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37f0150550 0x7f37dc004ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:14.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.622+0000 7f37f5f9c700 1 --2- 172.21.15.71:0/3545607215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37dc005e60 0x7f37dc0062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:14.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.622+0000 7f37f4f9a700 1 --2- 172.21.15.71:0/3545607215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37dc005120 0x7f37dc005920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:14.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.622+0000 7f37f5f9c700 1 -- 172.21.15.71:0/3545607215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37f0150550 msgr2=0x7f37dc004ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:14.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.622+0000 7f37f5f9c700 1 --2- 172.21.15.71:0/3545607215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37f0150550 0x7f37dc004ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:14.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.622+0000 7f37f5f9c700 1 -- 172.21.15.71:0/3545607215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37dc005120 msgr2=0x7f37dc005920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:14.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.622+0000 7f37f5f9c700 1 --2- 172.21.15.71:0/3545607215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37dc005120 0x7f37dc005920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:14.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.622+0000 7f37f5f9c700 1 -- 172.21.15.71:0/3545607215 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc004680 con 0x7f37dc005e60 2023-10-09T06:58:14.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.622+0000 7f37f5f9c700 1 --2- 172.21.15.71:0/3545607215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37dc005e60 0x7f37dc0062d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f37f00aed30 tx=0x7f37e8001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbaecde533e6c28c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:14.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.623+0000 7f37e7fff700 1 -- 172.21.15.71:0/3545607215 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e8001950 con 0x7f37dc005e60 2023-10-09T06:58:14.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.623+0000 7f37e7fff700 1 -- 172.21.15.71:0/3545607215 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e8004030 con 0x7f37dc005e60 2023-10-09T06:58:14.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.623+0000 7f37e7fff700 1 -- 172.21.15.71:0/3545607215 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e800cad0 con 0x7f37dc005e60 2023-10-09T06:58:14.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.623+0000 7f37f679d700 1 -- 172.21.15.71:0/3545607215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37dc005e60 msgr2=0x7f37dc0062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:14.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.623+0000 7f37f679d700 1 --2- 172.21.15.71:0/3545607215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37dc005e60 0x7f37dc0062d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f37f00aed30 tx=0x7f37e8001640 comp rx=0 tx=0).stop 2023-10-09T06:58:14.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.623+0000 7f37f5f9c700 1 -- 172.21.15.71:0/3545607215 reap_dead start 2023-10-09T06:58:14.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.623+0000 7f37f679d700 1 -- 172.21.15.71:0/3545607215 shutdown_connections 2023-10-09T06:58:14.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.623+0000 7f37f679d700 1 -- 172.21.15.71:0/3545607215 >> 172.21.15.71:0/3545607215 conn(0x7f37f00cc1f0 msgr2=0x7f37f00cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:14.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.623+0000 7f37f679d700 1 -- 172.21.15.71:0/3545607215 shutdown_connections 2023-10-09T06:58:14.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.623+0000 7f37f679d700 1 -- 172.21.15.71:0/3545607215 wait complete. 2023-10-09T06:58:14.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.625+0000 7f37f679d700 1 Processor -- start 2023-10-09T06:58:14.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.625+0000 7f37f679d700 1 -- start start 2023-10-09T06:58:14.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.626+0000 7f37f679d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37dc005e60 0x7f37f016a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:14.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.626+0000 7f37f679d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37f0157770 0x7f37f00ad270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:14.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.626+0000 7f37f679d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37f0168ce0 0x7f37f0169140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:14.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.626+0000 7f37f679d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f01588d0 con 0x7f37f0157770 2023-10-09T06:58:14.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.626+0000 7f37f679d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f015a4a0 con 0x7f37f0168ce0 2023-10-09T06:58:14.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.626+0000 7f37f679d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f016a830 con 0x7f37dc005e60 2023-10-09T06:58:14.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.626+0000 7f37f4f9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37f0157770 0x7f37f00ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:14.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.626+0000 7f37f4f9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37f0157770 0x7f37f00ad270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60050/0 (socket says 172.21.15.71:60050) 2023-10-09T06:58:14.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.626+0000 7f37f4f9a700 1 -- 172.21.15.71:0/2147152050 learned_addr learned my addr 172.21.15.71:0/2147152050 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:14.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.626+0000 7f37f579b700 1 --2- 172.21.15.71:0/2147152050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37dc005e60 0x7f37f016a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:14.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.626+0000 7f37f5f9c700 1 --2- 172.21.15.71:0/2147152050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37f0168ce0 0x7f37f0169140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:14.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.626+0000 7f37f4f9a700 1 -- 172.21.15.71:0/2147152050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37dc005e60 msgr2=0x7f37f016a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:14.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.626+0000 7f37f4f9a700 1 --2- 172.21.15.71:0/2147152050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37dc005e60 0x7f37f016a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:14.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.626+0000 7f37f4f9a700 1 -- 172.21.15.71:0/2147152050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37f0168ce0 msgr2=0x7f37f0169140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:14.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.626+0000 7f37f4f9a700 1 --2- 172.21.15.71:0/2147152050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37f0168ce0 0x7f37f0169140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:14.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.627+0000 7f37f4f9a700 1 -- 172.21.15.71:0/2147152050 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f0157c50 con 0x7f37f0157770 2023-10-09T06:58:14.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.627+0000 7f37f4f9a700 1 --2- 172.21.15.71:0/2147152050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37f0157770 0x7f37f00ad270 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f37e0006ac0 tx=0x7f37e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:14.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.627+0000 7f37e57fa700 1 -- 172.21.15.71:0/2147152050 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e000f940 con 0x7f37f0157770 2023-10-09T06:58:14.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.627+0000 7f37e57fa700 1 -- 172.21.15.71:0/2147152050 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e000faa0 con 0x7f37f0157770 2023-10-09T06:58:14.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.627+0000 7f37e57fa700 1 -- 172.21.15.71:0/2147152050 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e000fe20 con 0x7f37f0157770 2023-10-09T06:58:14.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.627+0000 7f37f679d700 1 -- 172.21.15.71:0/2147152050 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f0157f30 con 0x7f37f0157770 2023-10-09T06:58:14.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.627+0000 7f37f679d700 1 -- 172.21.15.71:0/2147152050 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f01584f0 con 0x7f37f0157770 2023-10-09T06:58:14.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.628+0000 7f37f679d700 1 -- 172.21.15.71:0/2147152050 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f0158a10 con 0x7f37f0157770 2023-10-09T06:58:14.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.629+0000 7f37e57fa700 1 -- 172.21.15.71:0/2147152050 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f37e0014650 con 0x7f37f0157770 2023-10-09T06:58:14.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.630+0000 7f37e57fa700 1 --2- 172.21.15.71:0/2147152050 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f37d4066f30 0x7f37d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:14.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.630+0000 7f37e57fa700 1 -- 172.21.15.71:0/2147152050 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f37e0018030 con 0x7f37f0157770 2023-10-09T06:58:14.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.630+0000 7f37f579b700 1 --2- 172.21.15.71:0/2147152050 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f37d4066f30 0x7f37d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:14.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.631+0000 7f37f579b700 1 --2- 172.21.15.71:0/2147152050 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f37d4066f30 0x7f37d40693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f37ec007e90 tx=0x7f37ec001e50 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:14.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.634+0000 7f37e57fa700 1 -- 172.21.15.71:0/2147152050 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37f0158a10 con 0x7f37f0157770 2023-10-09T06:58:14.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.866+0000 7f37f679d700 1 -- 172.21.15.71:0/2147152050 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37f0158a10 con 0x7f37f0157770 2023-10-09T06:58:14.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.867+0000 7f37e57fa700 1 -- 172.21.15.71:0/2147152050 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f37f0158a10 con 0x7f37f0157770 2023-10-09T06:58:14.868 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:14.868 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1982857991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1982857991},{"type":"v1","addr":"172.21.15.179:6836","nonce":1982857991}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6466,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/1002256123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":1002256123},{"type":"v1","addr":"172.21.15.179:6837","nonce":1002256123}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6660,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/3500731262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3500731262},{"type":"v1","addr":"172.21.15.71:6834","nonce":3500731262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:58:03.739223+0000","modified":"2023-10-09T06:58:07.306921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/4146861129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":4146861129},{"type":"v1","addr":"172.21.15.71:6835","nonce":4146861129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T06:58:14.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.869+0000 7f37f679d700 1 -- 172.21.15.71:0/2147152050 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f37d4066f30 msgr2=0x7f37d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:14.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.869+0000 7f37f679d700 1 --2- 172.21.15.71:0/2147152050 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f37d4066f30 0x7f37d40693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f37ec007e90 tx=0x7f37ec001e50 comp rx=0 tx=0).stop 2023-10-09T06:58:14.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.869+0000 7f37f679d700 1 -- 172.21.15.71:0/2147152050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37f0157770 msgr2=0x7f37f00ad270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:14.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.869+0000 7f37f679d700 1 --2- 172.21.15.71:0/2147152050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37f0157770 0x7f37f00ad270 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f37e0006ac0 tx=0x7f37e00091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:14.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.869+0000 7f37f679d700 1 -- 172.21.15.71:0/2147152050 shutdown_connections 2023-10-09T06:58:14.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.869+0000 7f37f679d700 1 --2- 172.21.15.71:0/2147152050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37f0168ce0 0x7f37f0169140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:14.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.869+0000 7f37f679d700 1 --2- 172.21.15.71:0/2147152050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37dc005e60 0x7f37f016a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:14.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.869+0000 7f37f679d700 1 --2- 172.21.15.71:0/2147152050 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f37d4066f30 0x7f37d40693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:14.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.869+0000 7f37f679d700 1 --2- 172.21.15.71:0/2147152050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37f0157770 0x7f37f00ad270 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:14.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.869+0000 7f37f679d700 1 -- 172.21.15.71:0/2147152050 >> 172.21.15.71:0/2147152050 conn(0x7f37f00cc1f0 msgr2=0x7f37f00696c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:14.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.869+0000 7f37f679d700 1 -- 172.21.15.71:0/2147152050 shutdown_connections 2023-10-09T06:58:14.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:14.869+0000 7f37f679d700 1 -- 172.21.15.71:0/2147152050 wait complete. 2023-10-09T06:58:14.872 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 41 2023-10-09T06:58:15.290 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T06:58:03.739223+0000', 'modified': '2023-10-09T06:58:07.306921+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6666}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6666': {'gid': 6666, 'name': 'c', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.71:6835/4146861129', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6833', 'nonce': 4146861129}, {'type': 'v1', 'addr': '172.21.15.71:6835', 'nonce': 4146861129}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T06:58:15.290 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T06:58:15.291 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-09T06:58:15.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.473+0000 7f82c759e700 1 Processor -- start 2023-10-09T06:58:15.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.473+0000 7f82c759e700 1 -- start start 2023-10-09T06:58:15.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.474+0000 7f82c759e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f82c8159420 0x7f82c80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.474+0000 7f82c759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82c815d230 0x7f82c815d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.474+0000 7f82c759e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c80b2980 con 0x7f82c81597f0 2023-10-09T06:58:15.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.474+0000 7f82c759e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c815dbb0 con 0x7f82c8159420 2023-10-09T06:58:15.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.474+0000 7f82c759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c80b11d0 con 0x7f82c815d230 2023-10-09T06:58:15.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.475+0000 7f82c659c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f82c8159420 0x7f82c80b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.475+0000 7f82c6d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82c815d230 0x7f82c815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.475+0000 7f82c659c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f82c8159420 0x7f82c80b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:49678/0 (socket says 172.21.15.71:49678) 2023-10-09T06:58:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.475+0000 7f82c659c700 1 -- 172.21.15.71:0/4293423893 learned_addr learned my addr 172.21.15.71:0/4293423893 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.475+0000 7f82c659c700 1 -- 172.21.15.71:0/4293423893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82c815d230 msgr2=0x7f82c815d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.475+0000 7f82c659c700 1 --2- 172.21.15.71:0/4293423893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82c815d230 0x7f82c815d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.475+0000 7f82c659c700 1 -- 172.21.15.71:0/4293423893 >> v1:172.21.15.179:6789/0 conn(0x7f82c81597f0 legacy=0x7f82c80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.475+0000 7f82c659c700 1 -- 172.21.15.71:0/4293423893 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c80b14b0 con 0x7f82c8159420 2023-10-09T06:58:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.475+0000 7f82c6d9d700 1 --2- 172.21.15.71:0/4293423893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82c815d230 0x7f82c815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:58:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.475+0000 7f82c659c700 1 --2- 172.21.15.71:0/4293423893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82c8159420 0x7f82c80b5f40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f82b80099b0 tx=0x7f82b8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=343be4b1bf5a7ae server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.476+0000 7f82c559a700 1 -- 172.21.15.71:0/4293423893 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8009ea0 con 0x7f82c8159420 2023-10-09T06:58:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.476+0000 7f82c559a700 1 -- 172.21.15.71:0/4293423893 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b800b860 con 0x7f82c8159420 2023-10-09T06:58:15.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.476+0000 7f82c559a700 1 -- 172.21.15.71:0/4293423893 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b800bc00 con 0x7f82c8159420 2023-10-09T06:58:15.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.476+0000 7f82c759e700 1 -- 172.21.15.71:0/4293423893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82c8159420 msgr2=0x7f82c80b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:15.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.476+0000 7f82c759e700 1 --2- 172.21.15.71:0/4293423893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82c8159420 0x7f82c80b5f40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f82b80099b0 tx=0x7f82b8009250 comp rx=0 tx=0).stop 2023-10-09T06:58:15.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.476+0000 7f82c759e700 1 -- 172.21.15.71:0/4293423893 shutdown_connections 2023-10-09T06:58:15.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.476+0000 7f82c759e700 1 --2- 172.21.15.71:0/4293423893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82c815d230 0x7f82c815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.476+0000 7f82c759e700 1 --2- 172.21.15.71:0/4293423893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82c8159420 0x7f82c80b5f40 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.476+0000 7f82c759e700 1 -- 172.21.15.71:0/4293423893 >> 172.21.15.71:0/4293423893 conn(0x7f82c80d0660 msgr2=0x7f82c80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:15.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.476+0000 7f82c759e700 1 -- 172.21.15.71:0/4293423893 shutdown_connections 2023-10-09T06:58:15.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.476+0000 7f82c759e700 1 -- 172.21.15.71:0/4293423893 wait complete. 2023-10-09T06:58:15.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.478+0000 7f82c759e700 1 Processor -- start 2023-10-09T06:58:15.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.478+0000 7f82c759e700 1 -- start start 2023-10-09T06:58:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.479+0000 7f82c759e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82c8159420 0x7f82c8169c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.479+0000 7f82c759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82c81597f0 0x7f82c80c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.479+0000 7f82c759e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82c815d230 0x7f82c80c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.479+0000 7f82c759e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c80ca750 con 0x7f82c815d230 2023-10-09T06:58:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.479+0000 7f82c759e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c8069380 con 0x7f82c8159420 2023-10-09T06:58:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.479+0000 7f82c759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c8069660 con 0x7f82c81597f0 2023-10-09T06:58:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.479+0000 7f82c6d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82c815d230 0x7f82c80c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.479+0000 7f82c6d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82c815d230 0x7f82c80c8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45690/0 (socket says 172.21.15.71:45690) 2023-10-09T06:58:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.479+0000 7f82c6d9d700 1 -- 172.21.15.71:0/1408833105 learned_addr learned my addr 172.21.15.71:0/1408833105 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.479+0000 7f82c5d9b700 1 --2- 172.21.15.71:0/1408833105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82c81597f0 0x7f82c80c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.479+0000 7f82c659c700 1 --2- 172.21.15.71:0/1408833105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82c8159420 0x7f82c8169c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.479+0000 7f82c6d9d700 1 -- 172.21.15.71:0/1408833105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82c81597f0 msgr2=0x7f82c80c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.479+0000 7f82c6d9d700 1 --2- 172.21.15.71:0/1408833105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82c81597f0 0x7f82c80c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.480+0000 7f82c6d9d700 1 -- 172.21.15.71:0/1408833105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82c8159420 msgr2=0x7f82c8169c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.480+0000 7f82c6d9d700 1 --2- 172.21.15.71:0/1408833105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82c8159420 0x7f82c8169c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.480+0000 7f82c6d9d700 1 -- 172.21.15.71:0/1408833105 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c0009a20 con 0x7f82c815d230 2023-10-09T06:58:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.480+0000 7f82c659c700 1 --2- 172.21.15.71:0/1408833105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82c8159420 0x7f82c8169c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.480+0000 7f82c5d9b700 1 --2- 172.21.15.71:0/1408833105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82c81597f0 0x7f82c80c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.480+0000 7f82c6d9d700 1 --2- 172.21.15.71:0/1408833105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82c815d230 0x7f82c80c8c70 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f82c0009f20 tx=0x7f82c000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.480+0000 7f82b67fc700 1 -- 172.21.15.71:0/1408833105 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c000cc80 con 0x7f82c815d230 2023-10-09T06:58:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.480+0000 7f82b67fc700 1 -- 172.21.15.71:0/1408833105 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c000f040 con 0x7f82c815d230 2023-10-09T06:58:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.480+0000 7f82c759e700 1 -- 172.21.15.71:0/1408833105 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b80094f0 con 0x7f82c815d230 2023-10-09T06:58:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.480+0000 7f82b67fc700 1 -- 172.21.15.71:0/1408833105 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c0014480 con 0x7f82c815d230 2023-10-09T06:58:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.480+0000 7f82c759e700 1 -- 172.21.15.71:0/1408833105 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c8069c20 con 0x7f82c815d230 2023-10-09T06:58:15.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.482+0000 7f82b67fc700 1 -- 172.21.15.71:0/1408833105 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82c0003020 con 0x7f82c815d230 2023-10-09T06:58:15.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.483+0000 7f82b67fc700 1 --2- 172.21.15.71:0/1408833105 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f82a8066f30 0x7f82a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.483+0000 7f82b67fc700 1 -- 172.21.15.71:0/1408833105 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f82c0085160 con 0x7f82c815d230 2023-10-09T06:58:15.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.484+0000 7f82c659c700 1 --2- 172.21.15.71:0/1408833105 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f82a8066f30 0x7f82a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:15.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.484+0000 7f82c659c700 1 --2- 172.21.15.71:0/1408833105 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f82a8066f30 0x7f82a80693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f82b80099b0 tx=0x7f82b8017000 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:15.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.485+0000 7f82db6c6b80 1 Processor -- start 2023-10-09T06:58:15.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.485+0000 7f82db6c6b80 1 -- start start 2023-10-09T06:58:15.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.485+0000 7f82db6c6b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba411480 0x55a8ba3f07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.485+0000 7f82db6c6b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8ba3c45f0 0x55a8ba411850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.486+0000 7f82db6c6b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a8ba3c6b80 0x55a8ba3c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.486+0000 7f82db6c6b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8ba31da70 con 0x55a8ba411480 2023-10-09T06:58:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.486+0000 7f82db6c6b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8ba31b270 con 0x55a8ba3c45f0 2023-10-09T06:58:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.486+0000 7f82db6c6b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8ba317060 con 0x55a8ba3c6b80 2023-10-09T06:58:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.486+0000 7f82c659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba411480 0x55a8ba3f07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.486+0000 7f82c659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba411480 0x55a8ba3f07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45706/0 (socket says 172.21.15.71:45706) 2023-10-09T06:58:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.486+0000 7f82c659c700 1 -- 172.21.15.71:0/1711432713 learned_addr learned my addr 172.21.15.71:0/1711432713 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.486+0000 7f82c6d9d700 1 --2- 172.21.15.71:0/1711432713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a8ba3c6b80 0x55a8ba3c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.486+0000 7f82c5d9b700 1 --2- 172.21.15.71:0/1711432713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8ba3c45f0 0x55a8ba411850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.486+0000 7f82c659c700 1 -- 172.21.15.71:0/1711432713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a8ba3c6b80 msgr2=0x55a8ba3c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.486+0000 7f82c659c700 1 --2- 172.21.15.71:0/1711432713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a8ba3c6b80 0x55a8ba3c6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.486+0000 7f82c659c700 1 -- 172.21.15.71:0/1711432713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8ba3c45f0 msgr2=0x55a8ba411850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:15.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.486+0000 7f82c659c700 1 --2- 172.21.15.71:0/1711432713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8ba3c45f0 0x55a8ba411850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.486+0000 7f82c659c700 1 -- 172.21.15.71:0/1711432713 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8ba1b1270 con 0x55a8ba411480 2023-10-09T06:58:15.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.486+0000 7f82c659c700 1 --2- 172.21.15.71:0/1711432713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba411480 0x55a8ba3f07d0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f82b800bc90 tx=0x7f82b8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a851b3b8787d04 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:15.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.487+0000 7f82a77fe700 1 -- 172.21.15.71:0/1711432713 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8020070 con 0x55a8ba411480 2023-10-09T06:58:15.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.487+0000 7f82a77fe700 1 -- 172.21.15.71:0/1711432713 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b8032480 con 0x55a8ba411480 2023-10-09T06:58:15.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.487+0000 7f82a77fe700 1 -- 172.21.15.71:0/1711432713 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8006b10 con 0x55a8ba411480 2023-10-09T06:58:15.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.487+0000 7f82db6c6b80 1 -- 172.21.15.71:0/1711432713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba411480 msgr2=0x55a8ba3f07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:15.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.487+0000 7f82db6c6b80 1 --2- 172.21.15.71:0/1711432713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba411480 0x55a8ba3f07d0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f82b800bc90 tx=0x7f82b8020000 comp rx=0 tx=0).stop 2023-10-09T06:58:15.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.487+0000 7f82db6c6b80 1 -- 172.21.15.71:0/1711432713 shutdown_connections 2023-10-09T06:58:15.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.487+0000 7f82db6c6b80 1 --2- 172.21.15.71:0/1711432713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a8ba3c6b80 0x55a8ba3c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.487+0000 7f82db6c6b80 1 --2- 172.21.15.71:0/1711432713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba411480 0x55a8ba3f07d0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.487+0000 7f82db6c6b80 1 --2- 172.21.15.71:0/1711432713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8ba3c45f0 0x55a8ba411850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.487+0000 7f82db6c6b80 1 -- 172.21.15.71:0/1711432713 >> 172.21.15.71:0/1711432713 conn(0x55a8ba3c80c0 msgr2=0x55a8ba3c88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:15.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.487+0000 7f82db6c6b80 1 -- 172.21.15.71:0/1711432713 shutdown_connections 2023-10-09T06:58:15.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.487+0000 7f82db6c6b80 1 -- 172.21.15.71:0/1711432713 wait complete. 2023-10-09T06:58:15.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.488+0000 7f82db6c6b80 1 -- start start 2023-10-09T06:58:15.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.488+0000 7f82db6c6b80 1 Processor -- start 2023-10-09T06:58:15.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.489+0000 7f82db6c6b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a8ba3c45f0 0x55a8ba41db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.489+0000 7f82db6c6b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba3c6b80 0x55a8ba3bd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.489+0000 7f82db6c6b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8ba411480 0x55a8ba3ef200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.489+0000 7f82db6c6b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8ba2c2890 con 0x55a8ba3c6b80 2023-10-09T06:58:15.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.489+0000 7f82db6c6b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8ba2ddea0 con 0x55a8ba411480 2023-10-09T06:58:15.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.489+0000 7f82db6c6b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8ba199e30 con 0x55a8ba3c45f0 2023-10-09T06:58:15.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.489+0000 7f82db6c6b80 10 client.0 _ll_register_callbacks cb 0x55a8ba38a2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:58:15.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.490+0000 7f82c5d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba3c6b80 0x55a8ba3bd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:15.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.490+0000 7f82c5d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba3c6b80 0x55a8ba3bd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45718/0 (socket says 172.21.15.71:45718) 2023-10-09T06:58:15.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.490+0000 7f82c5d9b700 1 -- 172.21.15.71:0/2282952390 learned_addr learned my addr 172.21.15.71:0/2282952390 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:15.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.490+0000 7f82c659c700 1 --2- 172.21.15.71:0/2282952390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a8ba3c45f0 0x55a8ba41db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:15.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.490+0000 7f82c6d9d700 1 --2- 172.21.15.71:0/2282952390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8ba411480 0x55a8ba3ef200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:15.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.490+0000 7f82c5d9b700 1 -- 172.21.15.71:0/2282952390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a8ba3c45f0 msgr2=0x55a8ba41db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:15.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.490+0000 7f82c5d9b700 1 --2- 172.21.15.71:0/2282952390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a8ba3c45f0 0x55a8ba41db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.490+0000 7f82c5d9b700 1 -- 172.21.15.71:0/2282952390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8ba411480 msgr2=0x55a8ba3ef200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:15.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.490+0000 7f82c5d9b700 1 --2- 172.21.15.71:0/2282952390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8ba411480 0x55a8ba3ef200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.490+0000 7f82c5d9b700 1 -- 172.21.15.71:0/2282952390 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c80b14b0 con 0x55a8ba3c6b80 2023-10-09T06:58:15.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.490+0000 7f82c5d9b700 1 --2- 172.21.15.71:0/2282952390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba3c6b80 0x55a8ba3bd9a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0102c0 tx=0x7f82bc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbb26993cdbd026 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:15.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.490+0000 7f82a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T06:58:15.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.490+0000 7f82a4ff9700 1 -- 172.21.15.71:0/2282952390 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc010da0 con 0x55a8ba3c6b80 2023-10-09T06:58:15.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.490+0000 7f82a4ff9700 1 -- 172.21.15.71:0/2282952390 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f82bc006820 con 0x55a8ba3c6b80 2023-10-09T06:58:15.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.490+0000 7f82db6c6b80 1 -- 172.21.15.71:0/2282952390 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a8ba3bbcd0 con 0x55a8ba3c6b80 2023-10-09T06:58:15.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.491+0000 7f82a4ff9700 1 -- 172.21.15.71:0/2282952390 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82bc006bf0 con 0x55a8ba3c6b80 2023-10-09T06:58:15.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.491+0000 7f82db6c6b80 10 client.6831 fetch_fsmap learned FSMap version 41 2023-10-09T06:58:15.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.491+0000 7f82db6c6b80 1 -- 172.21.15.71:0/2282952390 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55a8ba153fe0 con 0x55a8ba3c6b80 2023-10-09T06:58:15.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.491+0000 7f82a4ff9700 1 -- 172.21.15.71:0/2282952390 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a8ba3bbcd0 con 0x55a8ba3c6b80 2023-10-09T06:58:15.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.491+0000 7f82a4ff9700 1 -- 172.21.15.71:0/2282952390 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 41) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f82bc007020 con 0x55a8ba3c6b80 2023-10-09T06:58:15.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.491+0000 7f82db6c6b80 10 client.6831 fetch_fsmap finished waiting for FSMap version 41 2023-10-09T06:58:15.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.491+0000 7f82db6c6b80 10 client.6831 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T06:58:15.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.491+0000 7f82db6c6b80 20 client.6831 populate_metadata read hostname 'smithi071' 2023-10-09T06:58:15.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.491+0000 7f82db6c6b80 1 --2- 172.21.15.71:0/2282952390 >> [v2:172.21.15.71:6833/4146861129,v1:172.21.15.71:6835/4146861129] conn(0x55a8ba3ea9d0 0x55a8ba3eada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.491+0000 7f82db6c6b80 4 client.6831 mds_command: new command op to 6666 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T06:58:15.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.491+0000 7f82db6c6b80 1 -- 172.21.15.71:0/2282952390 --> [v2:172.21.15.71:6833/4146861129,v1:172.21.15.71:6835/4146861129] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a8ba398aa0 con 0x55a8ba3ea9d0 2023-10-09T06:58:15.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.491+0000 7f82c659c700 1 --2- 172.21.15.71:0/2282952390 >> [v2:172.21.15.71:6833/4146861129,v1:172.21.15.71:6835/4146861129] conn(0x55a8ba3ea9d0 0x55a8ba3eada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:15.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.492+0000 7f82c659c700 1 --2- 172.21.15.71:0/2282952390 >> [v2:172.21.15.71:6833/4146861129,v1:172.21.15.71:6835/4146861129] conn(0x55a8ba3ea9d0 0x55a8ba3eada0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd293d834869e854 server_cookie=a391205c0b852390 in_seq=0 out_seq=0 2023-10-09T06:58:15.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.492+0000 7f82a4ff9700 10 client.6831 ms_handle_connect on v2:172.21.15.71:6833/4146861129 2023-10-09T06:58:15.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.492+0000 7f82a4ff9700 1 -- 172.21.15.71:0/2282952390 <== mds.0 v2:172.21.15.71:6833/4146861129 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a8ba398aa0 con 0x55a8ba3ea9d0 2023-10-09T06:58:15.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.492+0000 7f82a4ff9700 10 client.6831 handle_command_reply: tid=0 2023-10-09T06:58:15.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.493+0000 7f82db6c6b80 1 client.6831 shutdown 2023-10-09T06:58:15.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.493+0000 7f82db6c6b80 1 -- 172.21.15.71:0/2282952390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba3c6b80 msgr2=0x55a8ba3bd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:15.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.493+0000 7f82db6c6b80 1 --2- 172.21.15.71:0/2282952390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba3c6b80 0x55a8ba3bd9a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0102c0 tx=0x7f82bc009040 comp rx=0 tx=0).stop 2023-10-09T06:58:15.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.493+0000 7f82db6c6b80 1 -- 172.21.15.71:0/2282952390 shutdown_connections 2023-10-09T06:58:15.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.493+0000 7f82db6c6b80 1 --2- 172.21.15.71:0/2282952390 >> [v2:172.21.15.71:6833/4146861129,v1:172.21.15.71:6835/4146861129] conn(0x55a8ba3ea9d0 0x55a8ba3eada0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.493+0000 7f82db6c6b80 1 --2- 172.21.15.71:0/2282952390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8ba411480 0x55a8ba3ef200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.493+0000 7f82db6c6b80 1 --2- 172.21.15.71:0/2282952390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a8ba3c45f0 0x55a8ba41db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.493+0000 7f82a4ff9700 0 client.6831 ms_handle_reset on v2:172.21.15.71:6833/4146861129 2023-10-09T06:58:15.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.493+0000 7f82db6c6b80 1 --2- 172.21.15.71:0/2282952390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba3c6b80 0x55a8ba3bd9a0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.493+0000 7f82db6c6b80 1 -- 172.21.15.71:0/2282952390 >> 172.21.15.71:0/2282952390 conn(0x55a8ba3c80c0 msgr2=0x55a8ba3c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:15.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.493+0000 7f82db6c6b80 1 -- 172.21.15.71:0/2282952390 shutdown_connections 2023-10-09T06:58:15.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.493+0000 7f82db6c6b80 1 -- 172.21.15.71:0/2282952390 wait complete. 2023-10-09T06:58:15.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.493+0000 7f82db6c6b80 20 client.6831 trim_cache size 0 max 16384 2023-10-09T06:58:15.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.510+0000 7f82db6c6b80 1 Processor -- start 2023-10-09T06:58:15.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.511+0000 7f82db6c6b80 1 -- start start 2023-10-09T06:58:15.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.511+0000 7f82db6c6b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8ba3c45f0 0x55a8ba3c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.511+0000 7f82db6c6b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a8ba3c6b80 0x55a8ba3c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.511+0000 7f82db6c6b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba411480 0x55a8ba3c4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.511+0000 7f82db6c6b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8ba3a65b0 con 0x55a8ba411480 2023-10-09T06:58:15.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.511+0000 7f82db6c6b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8ba3bf9e0 con 0x55a8ba3c45f0 2023-10-09T06:58:15.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.511+0000 7f82db6c6b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8ba3f1950 con 0x55a8ba3c6b80 2023-10-09T06:58:15.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.512+0000 7f82c6d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba411480 0x55a8ba3c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:15.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.512+0000 7f82c6d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba411480 0x55a8ba3c4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45726/0 (socket says 172.21.15.71:45726) 2023-10-09T06:58:15.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.512+0000 7f82c6d9d700 1 -- 172.21.15.71:0/1386883446 learned_addr learned my addr 172.21.15.71:0/1386883446 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:15.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.512+0000 7f82c5d9b700 1 --2- 172.21.15.71:0/1386883446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a8ba3c6b80 0x55a8ba3c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:15.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.512+0000 7f82c659c700 1 --2- 172.21.15.71:0/1386883446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8ba3c45f0 0x55a8ba3c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:15.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.512+0000 7f82c6d9d700 1 -- 172.21.15.71:0/1386883446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a8ba3c6b80 msgr2=0x55a8ba3c3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:15.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.512+0000 7f82c6d9d700 1 --2- 172.21.15.71:0/1386883446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a8ba3c6b80 0x55a8ba3c3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.512+0000 7f82c6d9d700 1 -- 172.21.15.71:0/1386883446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8ba3c45f0 msgr2=0x55a8ba3c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:15.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.512+0000 7f82c6d9d700 1 --2- 172.21.15.71:0/1386883446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8ba3c45f0 0x55a8ba3c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.512+0000 7f82c6d9d700 1 -- 172.21.15.71:0/1386883446 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8ba2e5780 con 0x55a8ba411480 2023-10-09T06:58:15.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.512+0000 7f82c659c700 1 --2- 172.21.15.71:0/1386883446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8ba3c45f0 0x55a8ba3c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:15.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.512+0000 7f82c5d9b700 1 --2- 172.21.15.71:0/1386883446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a8ba3c6b80 0x55a8ba3c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:15.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.512+0000 7f82c6d9d700 1 --2- 172.21.15.71:0/1386883446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba411480 0x55a8ba3c4030 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f82c0055df0 tx=0x7f82c001f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779a9810ae826ad8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:15.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.512+0000 7f82a7fff700 1 -- 172.21.15.71:0/1386883446 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c005ce00 con 0x55a8ba411480 2023-10-09T06:58:15.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.512+0000 7f82a7fff700 1 -- 172.21.15.71:0/1386883446 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c0083560 con 0x55a8ba411480 2023-10-09T06:58:15.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.512+0000 7f82a7fff700 1 -- 172.21.15.71:0/1386883446 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c005b0f0 con 0x55a8ba411480 2023-10-09T06:58:15.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.513+0000 7f82db6c6b80 1 -- 172.21.15.71:0/1386883446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba411480 msgr2=0x55a8ba3c4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:15.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.513+0000 7f82db6c6b80 1 --2- 172.21.15.71:0/1386883446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba411480 0x55a8ba3c4030 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f82c0055df0 tx=0x7f82c001f040 comp rx=0 tx=0).stop 2023-10-09T06:58:15.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.513+0000 7f82db6c6b80 1 -- 172.21.15.71:0/1386883446 shutdown_connections 2023-10-09T06:58:15.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.513+0000 7f82db6c6b80 1 --2- 172.21.15.71:0/1386883446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba411480 0x55a8ba3c4030 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.513+0000 7f82db6c6b80 1 --2- 172.21.15.71:0/1386883446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8ba3c45f0 0x55a8ba3c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.513+0000 7f82db6c6b80 1 --2- 172.21.15.71:0/1386883446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a8ba3c6b80 0x55a8ba3c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.513+0000 7f82db6c6b80 1 -- 172.21.15.71:0/1386883446 >> 172.21.15.71:0/1386883446 conn(0x55a8ba3c80c0 msgr2=0x55a8ba3c4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:15.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.513+0000 7f82db6c6b80 1 -- 172.21.15.71:0/1386883446 shutdown_connections 2023-10-09T06:58:15.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.513+0000 7f82db6c6b80 1 -- 172.21.15.71:0/1386883446 wait complete. 2023-10-09T06:58:15.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.514+0000 7f82db6c6b80 1 -- start start 2023-10-09T06:58:15.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.514+0000 7f82db6c6b80 1 Processor -- start 2023-10-09T06:58:15.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.515+0000 7f82db6c6b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8ba3c45f0 0x55a8ba472500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.515+0000 7f82db6c6b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba3c6b80 0x55a8ba3f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.515+0000 7f82db6c6b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a8ba411480 0x55a8ba3f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.515+0000 7f82db6c6b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8ba41cf00 con 0x55a8ba3c6b80 2023-10-09T06:58:15.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.515+0000 7f82db6c6b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8ba472c30 con 0x55a8ba3c45f0 2023-10-09T06:58:15.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.515+0000 7f82db6c6b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8ba40ba40 con 0x55a8ba411480 2023-10-09T06:58:15.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.515+0000 7f82db6c6b80 10 client.0 _ll_register_callbacks cb 0x55a8ba38a2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:58:15.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.515+0000 7f82c5d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba3c6b80 0x55a8ba3f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:15.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.515+0000 7f82c5d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba3c6b80 0x55a8ba3f27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45740/0 (socket says 172.21.15.71:45740) 2023-10-09T06:58:15.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.515+0000 7f82c5d9b700 1 -- 172.21.15.71:0/3329839446 learned_addr learned my addr 172.21.15.71:0/3329839446 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:15.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.516+0000 7f82c5d9b700 1 -- 172.21.15.71:0/3329839446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a8ba411480 msgr2=0x55a8ba3f2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:15.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.516+0000 7f82c5d9b700 1 --2- 172.21.15.71:0/3329839446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a8ba411480 0x55a8ba3f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.516+0000 7f82c5d9b700 1 -- 172.21.15.71:0/3329839446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8ba3c45f0 msgr2=0x55a8ba472500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:15.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.516+0000 7f82c5d9b700 1 --2- 172.21.15.71:0/3329839446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8ba3c45f0 0x55a8ba472500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.516+0000 7f82c5d9b700 1 -- 172.21.15.71:0/3329839446 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c8069c20 con 0x55a8ba3c6b80 2023-10-09T06:58:15.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.516+0000 7f82c5d9b700 1 --2- 172.21.15.71:0/3329839446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba3c6b80 0x55a8ba3f27c0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x55a8ba3ca130 tx=0x7f82bc01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7141a998d6c60da5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:15.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.516+0000 7f82a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T06:58:15.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.516+0000 7f82a4ff9700 1 -- 172.21.15.71:0/3329839446 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc006820 con 0x55a8ba3c6b80 2023-10-09T06:58:15.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.516+0000 7f82a4ff9700 1 -- 172.21.15.71:0/3329839446 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f82bc007530 con 0x55a8ba3c6b80 2023-10-09T06:58:15.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.516+0000 7f82db6c6b80 1 -- 172.21.15.71:0/3329839446 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f82c80b4f30 con 0x55a8ba3c6b80 2023-10-09T06:58:15.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.516+0000 7f82a4ff9700 1 -- 172.21.15.71:0/3329839446 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82bc0032e0 con 0x55a8ba3c6b80 2023-10-09T06:58:15.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.516+0000 7f82db6c6b80 10 client.6837 fetch_fsmap learned FSMap version 41 2023-10-09T06:58:15.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.516+0000 7f82db6c6b80 1 -- 172.21.15.71:0/3329839446 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55a8ba2cc470 con 0x55a8ba3c6b80 2023-10-09T06:58:15.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.516+0000 7f82a4ff9700 1 -- 172.21.15.71:0/3329839446 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c80b4f30 con 0x55a8ba3c6b80 2023-10-09T06:58:15.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.516+0000 7f82a4ff9700 1 -- 172.21.15.71:0/3329839446 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 41) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f82bc007020 con 0x55a8ba3c6b80 2023-10-09T06:58:15.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.517+0000 7f82db6c6b80 10 client.6837 fetch_fsmap finished waiting for FSMap version 41 2023-10-09T06:58:15.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.517+0000 7f82db6c6b80 10 client.6837 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T06:58:15.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.517+0000 7f82db6c6b80 20 client.6837 populate_metadata read hostname 'smithi071' 2023-10-09T06:58:15.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.517+0000 7f82db6c6b80 1 --2- 172.21.15.71:0/3329839446 >> [v2:172.21.15.71:6833/4146861129,v1:172.21.15.71:6835/4146861129] conn(0x55a8ba426a20 0x55a8ba426e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.517+0000 7f82db6c6b80 4 client.6837 mds_command: new command op to 6666 tid=0[{"prefix": "status"}] 2023-10-09T06:58:15.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.517+0000 7f82db6c6b80 1 -- 172.21.15.71:0/3329839446 --> [v2:172.21.15.71:6833/4146861129,v1:172.21.15.71:6835/4146861129] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f82b8032480 con 0x55a8ba426a20 2023-10-09T06:58:15.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.517+0000 7f82c659c700 1 --2- 172.21.15.71:0/3329839446 >> [v2:172.21.15.71:6833/4146861129,v1:172.21.15.71:6835/4146861129] conn(0x55a8ba426a20 0x55a8ba426e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:15.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.517+0000 7f82c659c700 1 --2- 172.21.15.71:0/3329839446 >> [v2:172.21.15.71:6833/4146861129,v1:172.21.15.71:6835/4146861129] conn(0x55a8ba426a20 0x55a8ba426e10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69866a18c926e911 server_cookie=7fc8005047fda4a in_seq=0 out_seq=0 2023-10-09T06:58:15.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.517+0000 7f82a4ff9700 10 client.6837 ms_handle_connect on v2:172.21.15.71:6833/4146861129 2023-10-09T06:58:15.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.517+0000 7f82a4ff9700 1 -- 172.21.15.71:0/3329839446 <== mds.0 v2:172.21.15.71:6833/4146861129 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7f82b8032480 con 0x55a8ba426a20 2023-10-09T06:58:15.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.517+0000 7f82a4ff9700 10 client.6837 handle_command_reply: tid=0 2023-10-09T06:58:15.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.517+0000 7f82db6c6b80 1 client.6837 shutdown 2023-10-09T06:58:15.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.518+0000 7f82db6c6b80 1 -- 172.21.15.71:0/3329839446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba3c6b80 msgr2=0x55a8ba3f27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:15.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.518+0000 7f82db6c6b80 1 --2- 172.21.15.71:0/3329839446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba3c6b80 0x55a8ba3f27c0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x55a8ba3ca130 tx=0x7f82bc01f000 comp rx=0 tx=0).stop 2023-10-09T06:58:15.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.518+0000 7f82db6c6b80 1 -- 172.21.15.71:0/3329839446 shutdown_connections 2023-10-09T06:58:15.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.518+0000 7f82db6c6b80 1 --2- 172.21.15.71:0/3329839446 >> [v2:172.21.15.71:6833/4146861129,v1:172.21.15.71:6835/4146861129] conn(0x55a8ba426a20 0x55a8ba426e10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.518+0000 7f82db6c6b80 1 --2- 172.21.15.71:0/3329839446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a8ba411480 0x55a8ba3f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.518+0000 7f82db6c6b80 1 --2- 172.21.15.71:0/3329839446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8ba3c45f0 0x55a8ba472500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.518+0000 7f82db6c6b80 1 --2- 172.21.15.71:0/3329839446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a8ba3c6b80 0x55a8ba3f27c0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.518+0000 7f82a4ff9700 0 client.6837 ms_handle_reset on v2:172.21.15.71:6833/4146861129 2023-10-09T06:58:15.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.518+0000 7f82db6c6b80 1 -- 172.21.15.71:0/3329839446 >> 172.21.15.71:0/3329839446 conn(0x55a8ba3c80c0 msgr2=0x55a8ba3bdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:15.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.518+0000 7f82db6c6b80 1 -- 172.21.15.71:0/3329839446 shutdown_connections 2023-10-09T06:58:15.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.518+0000 7f82db6c6b80 1 -- 172.21.15.71:0/3329839446 wait complete. 2023-10-09T06:58:15.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.518+0000 7f82db6c6b80 20 client.6837 trim_cache size 0 max 16384 2023-10-09T06:58:15.526 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T06:58:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "604c5619-653a-4ab6-912c-ab2e5464fe4a", 2023-10-09T06:58:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2023-10-09T06:58:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 6666, 2023-10-09T06:58:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2023-10-09T06:58:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2023-10-09T06:58:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2023-10-09T06:58:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 11.235796950999999, 2023-10-09T06:58:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 41, 2023-10-09T06:58:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 93, 2023-10-09T06:58:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 93, 2023-10-09T06:58:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 17.029750713999999 2023-10-09T06:58:15.527 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T06:58:15.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.518+0000 7f82c759e700 1 -- 172.21.15.71:0/1408833105 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f82a8066f30 msgr2=0x7f82a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:15.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.518+0000 7f82c759e700 1 --2- 172.21.15.71:0/1408833105 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f82a8066f30 0x7f82a80693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f82b80099b0 tx=0x7f82b8017000 comp rx=0 tx=0).stop 2023-10-09T06:58:15.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.519+0000 7f82c759e700 1 -- 172.21.15.71:0/1408833105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82c815d230 msgr2=0x7f82c80c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:15.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.519+0000 7f82c759e700 1 --2- 172.21.15.71:0/1408833105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82c815d230 0x7f82c80c8c70 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f82c0009f20 tx=0x7f82c000b040 comp rx=0 tx=0).stop 2023-10-09T06:58:15.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.519+0000 7f82c759e700 1 -- 172.21.15.71:0/1408833105 shutdown_connections 2023-10-09T06:58:15.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.519+0000 7f82c759e700 1 --2- 172.21.15.71:0/1408833105 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f82a8066f30 0x7f82a80693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.519+0000 7f82c759e700 1 --2- 172.21.15.71:0/1408833105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82c815d230 0x7f82c80c8c70 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.519+0000 7f82c759e700 1 --2- 172.21.15.71:0/1408833105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82c8159420 0x7f82c8169c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.519+0000 7f82c759e700 1 --2- 172.21.15.71:0/1408833105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82c81597f0 0x7f82c80c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.519+0000 7f82c759e700 1 -- 172.21.15.71:0/1408833105 >> 172.21.15.71:0/1408833105 conn(0x7f82c80d0660 msgr2=0x7f82c8156190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:15.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.519+0000 7f82c759e700 1 -- 172.21.15.71:0/1408833105 shutdown_connections 2023-10-09T06:58:15.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.519+0000 7f82c759e700 1 -- 172.21.15.71:0/1408833105 wait complete. 2023-10-09T06:58:15.536 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:58:15.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.715+0000 7f0ca6fff700 1 Processor -- start 2023-10-09T06:58:15.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.715+0000 7f0ca6fff700 1 -- start start 2023-10-09T06:58:15.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.716+0000 7f0ca6fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0ca0155c10 0x7f0ca0155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.716+0000 7f0ca6fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca00acac0 con 0x7f0ca00ac230 2023-10-09T06:58:15.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.716+0000 7f0ca6fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca00ad930 con 0x7f0ca00ac6d0 2023-10-09T06:58:15.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.716+0000 7f0ca6fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca00acd20 con 0x7f0ca0155c10 2023-10-09T06:58:15.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.717+0000 7f0ca4d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0ca0155c10 0x7f0ca0155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:15.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.717+0000 7f0ca4d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0ca0155c10 0x7f0ca0155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45744/0 (socket says 172.21.15.71:45744) 2023-10-09T06:58:15.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.717+0000 7f0ca4d9b700 1 -- 172.21.15.71:0/4089316545 learned_addr learned my addr 172.21.15.71:0/4089316545 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:15.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.717+0000 7f0ca4d9b700 1 -- 172.21.15.71:0/4089316545 >> v1:172.21.15.179:6789/0 conn(0x7f0ca00ac6d0 legacy=0x7f0ca00b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:15.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.717+0000 7f0ca4d9b700 1 -- 172.21.15.71:0/4089316545 >> v1:172.21.15.71:6789/0 conn(0x7f0ca00ac230 legacy=0x7f0ca01568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:15.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.717+0000 7f0ca4d9b700 1 -- 172.21.15.71:0/4089316545 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca00ad000 con 0x7f0ca0155c10 2023-10-09T06:58:15.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.717+0000 7f0c9f7fe700 1 -- 172.21.15.71:0/4089316545 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11083519 0 0) 0x7f0ca00acac0 con 0x7f0ca00ac230 2023-10-09T06:58:15.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.717+0000 7f0ca4d9b700 1 --2- 172.21.15.71:0/4089316545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ca0155c10 0x7f0ca0155fe0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f0c940099b0 tx=0x7f0c94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7b3838d565e5e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:15.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.718+0000 7f0c9f7fe700 1 -- 172.21.15.71:0/4089316545 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9400b860 con 0x7f0ca0155c10 2023-10-09T06:58:15.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.718+0000 7f0c9f7fe700 1 -- 172.21.15.71:0/4089316545 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9400b9c0 con 0x7f0ca0155c10 2023-10-09T06:58:15.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.718+0000 7f0c9f7fe700 1 -- 172.21.15.71:0/4089316545 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9400bd60 con 0x7f0ca0155c10 2023-10-09T06:58:15.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.718+0000 7f0ca6fff700 1 -- 172.21.15.71:0/4089316545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ca0155c10 msgr2=0x7f0ca0155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:15.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.718+0000 7f0ca6fff700 1 --2- 172.21.15.71:0/4089316545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ca0155c10 0x7f0ca0155fe0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f0c940099b0 tx=0x7f0c94009250 comp rx=0 tx=0).stop 2023-10-09T06:58:15.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.718+0000 7f0ca6fff700 1 -- 172.21.15.71:0/4089316545 shutdown_connections 2023-10-09T06:58:15.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.718+0000 7f0ca6fff700 1 --2- 172.21.15.71:0/4089316545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ca0155c10 0x7f0ca0155fe0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.718+0000 7f0ca6fff700 1 -- 172.21.15.71:0/4089316545 >> 172.21.15.71:0/4089316545 conn(0x7f0ca006a320 msgr2=0x7f0ca00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:15.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.718+0000 7f0ca6fff700 1 -- 172.21.15.71:0/4089316545 shutdown_connections 2023-10-09T06:58:15.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.718+0000 7f0ca6fff700 1 -- 172.21.15.71:0/4089316545 wait complete. 2023-10-09T06:58:15.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.720+0000 7f0ca6fff700 1 Processor -- start 2023-10-09T06:58:15.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.720+0000 7f0ca6fff700 1 -- start start 2023-10-09T06:58:15.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.721+0000 7f0ca6fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ca00ac230 0x7f0ca0150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.721+0000 7f0ca6fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ca00ac6d0 0x7f0ca00a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.721+0000 7f0ca6fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ca0155c10 0x7f0ca00a9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.721+0000 7f0ca6fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca00a69b0 con 0x7f0ca0155c10 2023-10-09T06:58:15.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.721+0000 7f0ca6fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca0150660 con 0x7f0ca00ac6d0 2023-10-09T06:58:15.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.721+0000 7f0ca6fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca00a5da0 con 0x7f0ca00ac230 2023-10-09T06:58:15.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.721+0000 7f0ca559c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ca0155c10 0x7f0ca00a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:15.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.721+0000 7f0ca559c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ca0155c10 0x7f0ca00a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45758/0 (socket says 172.21.15.71:45758) 2023-10-09T06:58:15.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.721+0000 7f0ca559c700 1 -- 172.21.15.71:0/446945602 learned_addr learned my addr 172.21.15.71:0/446945602 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:15.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.721+0000 7f0ca559c700 1 -- 172.21.15.71:0/446945602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ca00ac230 msgr2=0x7f0ca0150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:15.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.721+0000 7f0c9ffff700 1 --2- 172.21.15.71:0/446945602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ca00ac6d0 0x7f0ca00a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:15.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.721+0000 7f0ca4d9b700 1 --2- 172.21.15.71:0/446945602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ca00ac230 0x7f0ca0150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:15.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.721+0000 7f0ca559c700 1 --2- 172.21.15.71:0/446945602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ca00ac230 0x7f0ca0150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.721+0000 7f0ca559c700 1 -- 172.21.15.71:0/446945602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ca00ac6d0 msgr2=0x7f0ca00a54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:15.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.721+0000 7f0ca559c700 1 --2- 172.21.15.71:0/446945602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ca00ac6d0 0x7f0ca00a54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.721+0000 7f0ca559c700 1 -- 172.21.15.71:0/446945602 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c940094f0 con 0x7f0ca0155c10 2023-10-09T06:58:15.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.721+0000 7f0ca4d9b700 1 --2- 172.21.15.71:0/446945602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ca00ac230 0x7f0ca0150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:15.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.721+0000 7f0c9ffff700 1 --2- 172.21.15.71:0/446945602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ca00ac6d0 0x7f0ca00a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:15.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.722+0000 7f0ca559c700 1 --2- 172.21.15.71:0/446945602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ca0155c10 0x7f0ca00a9680 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800c910 tx=0x7f0c98001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:15.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.722+0000 7f0c9cff9700 1 -- 172.21.15.71:0/446945602 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9800a7a0 con 0x7f0ca0155c10 2023-10-09T06:58:15.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.722+0000 7f0c9cff9700 1 -- 172.21.15.71:0/446945602 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9800a900 con 0x7f0ca0155c10 2023-10-09T06:58:15.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.722+0000 7f0c9cff9700 1 -- 172.21.15.71:0/446945602 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9800acc0 con 0x7f0ca0155c10 2023-10-09T06:58:15.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.722+0000 7f0ca6fff700 1 -- 172.21.15.71:0/446945602 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca00a6080 con 0x7f0ca0155c10 2023-10-09T06:58:15.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.722+0000 7f0ca6fff700 1 -- 172.21.15.71:0/446945602 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca00a6640 con 0x7f0ca0155c10 2023-10-09T06:58:15.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.723+0000 7f0ca6fff700 1 -- 172.21.15.71:0/446945602 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca00a6b60 con 0x7f0ca0155c10 2023-10-09T06:58:15.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.724+0000 7f0c9cff9700 1 -- 172.21.15.71:0/446945602 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c98012630 con 0x7f0ca0155c10 2023-10-09T06:58:15.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.725+0000 7f0c9cff9700 1 --2- 172.21.15.71:0/446945602 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0c84066f30 0x7f0c840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:15.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.725+0000 7f0c9cff9700 1 -- 172.21.15.71:0/446945602 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f0c980849b0 con 0x7f0ca0155c10 2023-10-09T06:58:15.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.725+0000 7f0ca4d9b700 1 --2- 172.21.15.71:0/446945602 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0c84066f30 0x7f0c840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:15.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.726+0000 7f0ca4d9b700 1 --2- 172.21.15.71:0/446945602 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0c84066f30 0x7f0c840693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0c940099b0 tx=0x7f0c94017000 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:15.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.729+0000 7f0c9cff9700 1 -- 172.21.15.71:0/446945602 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ca00a6b60 con 0x7f0ca0155c10 2023-10-09T06:58:15.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.967+0000 7f0ca6fff700 1 -- 172.21.15.71:0/446945602 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0ca00a6b60 con 0x7f0ca0155c10 2023-10-09T06:58:15.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.967+0000 7f0c9cff9700 1 -- 172.21.15.71:0/446945602 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0ca00a6b60 con 0x7f0ca0155c10 2023-10-09T06:58:15.968 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:58:15.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.969+0000 7f0ca6fff700 1 -- 172.21.15.71:0/446945602 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0c84066f30 msgr2=0x7f0c840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:15.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.969+0000 7f0ca6fff700 1 --2- 172.21.15.71:0/446945602 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0c84066f30 0x7f0c840693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0c940099b0 tx=0x7f0c94017000 comp rx=0 tx=0).stop 2023-10-09T06:58:15.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.969+0000 7f0ca6fff700 1 -- 172.21.15.71:0/446945602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ca0155c10 msgr2=0x7f0ca00a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:15.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.969+0000 7f0ca6fff700 1 --2- 172.21.15.71:0/446945602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ca0155c10 0x7f0ca00a9680 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800c910 tx=0x7f0c98001710 comp rx=0 tx=0).stop 2023-10-09T06:58:15.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.970+0000 7f0ca6fff700 1 -- 172.21.15.71:0/446945602 shutdown_connections 2023-10-09T06:58:15.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.970+0000 7f0ca6fff700 1 --2- 172.21.15.71:0/446945602 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0c84066f30 0x7f0c840693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.970+0000 7f0ca6fff700 1 --2- 172.21.15.71:0/446945602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ca0155c10 0x7f0ca00a9680 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.970+0000 7f0ca6fff700 1 --2- 172.21.15.71:0/446945602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ca00ac230 0x7f0ca0150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.970+0000 7f0ca6fff700 1 --2- 172.21.15.71:0/446945602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ca00ac6d0 0x7f0ca00a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:15.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.970+0000 7f0ca6fff700 1 -- 172.21.15.71:0/446945602 >> 172.21.15.71:0/446945602 conn(0x7f0ca006a320 msgr2=0x7f0ca015fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:15.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.970+0000 7f0ca6fff700 1 -- 172.21.15.71:0/446945602 shutdown_connections 2023-10-09T06:58:15.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:15.970+0000 7f0ca6fff700 1 -- 172.21.15.71:0/446945602 wait complete. 2023-10-09T06:58:15.988 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:58:15.988 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:58:15.989 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2023-10-09T06:58:15.989 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T06:58:15.989 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T06:58:15.989 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:58:15.989 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:58:15.989 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:58:15.989 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:58:15.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:58:15.989 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2023-10-09T06:58:16.026 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:58:16.026 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:58:16.026 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:58:16.026 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:58:16.026 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-10-09T06:58:16.026 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:58:16.027 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:58:16.027 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2023-10-09T06:58:16.027 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2023-10-09T06:58:16.027 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:58:16.027 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2023-10-09T06:58:16.027 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2023-10-09T06:58:16.027 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:58:16.027 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:58:16.027 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:58:16.027 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:58:16.027 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T06:58:16.027 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 41340sec preferred_lft 41340sec 2023-10-09T06:58:16.027 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2023-10-09T06:58:16.027 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:58:16.029 INFO:teuthology.orchestra.run.smithi071.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:58:16.029 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5a:a1:ec:c7:41:8f brd ff:ff:ff:ff:ff:ff 2023-10-09T06:58:16.029 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:58:16.029 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:58:16.029 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::8052:a9ff:fe85:8756/64 scope link 2023-10-09T06:58:16.029 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:58:16.029 INFO:teuthology.orchestra.run.smithi071.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:58:16.030 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether ae:1f:c9:59:0c:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T06:58:16.030 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ac1f:c9ff:fe59:c1b/64 scope link 2023-10-09T06:58:16.030 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:58:16.030 INFO:teuthology.orchestra.run.smithi071.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:58:16.030 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5a:a1:ec:c7:41:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T06:58:16.030 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::58a1:ecff:fec7:418f/64 scope link 2023-10-09T06:58:16.030 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:58:16.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:58:16.031 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:58:16.125 INFO:teuthology.orchestra.run.smithi071.stdout:1 2023-10-09T06:58:16.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:58:16.128 DEBUG:teuthology.orchestra.run.smithi071:> route 2023-10-09T06:58:16.166 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2023-10-09T06:58:16.166 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:58:16.167 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T06:58:16.167 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T06:58:16.167 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:58:16.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:58:16.168 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-09T06:58:16.168 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-09T06:58:16.168 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T06:58:16.168 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T06:58:16.168 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T06:58:16.168 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-09T06:58:16.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:58:16.363 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-09T06:58:16.399 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T06:58:16.399 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T06:58:16.400 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:58:16.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:58:16.400 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2023-10-09T06:58:16.501 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:58:16.502 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T06:58:16.538 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:58:16.538 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:58:16.539 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:58:16.614 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T06:58:16.615 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:58:16.615 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:58:16.744 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:58:16.744 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:58:16.771 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:58:16.772 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:58:16.772 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.71:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-09T06:58:16.772 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with new device syntax: 0@604c5619-653a-4ab6-912c-ab2e5464fe4a.cephfs=/ 2023-10-09T06:58:16.772 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.71:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-10-09T06:58:16.776 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:58:16.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:58:16.776 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:58:16.838 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T06:58:17.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.019+0000 7f4ff69ff700 1 Processor -- start 2023-10-09T06:58:17.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.019+0000 7f4ff69ff700 1 -- start start 2023-10-09T06:58:17.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.021+0000 7f4ff69ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4ff01578b0 0x7f4ff0155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:17.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.021+0000 7f4ff69ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff00ad930 con 0x7f4ff0155c10 2023-10-09T06:58:17.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.021+0000 7f4ff69ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff00acd20 con 0x7f4ff00af2f0 2023-10-09T06:58:17.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.021+0000 7f4ff69ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff00ad000 con 0x7f4ff01578b0 2023-10-09T06:58:17.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.021+0000 7f4feffff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f4ff0155c10 0x7f4ff00ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53856/0 (socket says 172.21.15.71:53856) 2023-10-09T06:58:17.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.021+0000 7f4feffff700 1 -- 172.21.15.71:0/4215715184 learned_addr learned my addr 172.21.15.71:0/4215715184 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:17.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.021+0000 7f4fef7fe700 1 --2- 172.21.15.71:0/4215715184 >> v2:172.21.15.179:3300/0 conn(0x7f4ff01578b0 0x7f4ff0155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:17.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.021+0000 7f4feeffd700 1 -- 172.21.15.71:0/4215715184 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193851167 0 0) 0x7f4ff00ad930 con 0x7f4ff0155c10 2023-10-09T06:58:17.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.022+0000 7f4feeffd700 1 -- 172.21.15.71:0/4215715184 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fd8004680 con 0x7f4ff0155c10 2023-10-09T06:58:17.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.022+0000 7f4feeffd700 1 -- 172.21.15.71:0/4215715184 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503016101 0 0) 0x7f4ff00acd20 con 0x7f4ff00af2f0 2023-10-09T06:58:17.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.022+0000 7f4feeffd700 1 -- 172.21.15.71:0/4215715184 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ff00ad930 con 0x7f4ff00af2f0 2023-10-09T06:58:17.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.022+0000 7f4feeffd700 1 -- 172.21.15.71:0/4215715184 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3987576821 0 0) 0x7f4fd8004680 con 0x7f4ff0155c10 2023-10-09T06:58:17.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.022+0000 7f4feeffd700 1 -- 172.21.15.71:0/4215715184 >> v2:172.21.15.179:3300/0 conn(0x7f4ff01578b0 msgr2=0x7f4ff0155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:17.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.022+0000 7f4feeffd700 1 --2- 172.21.15.71:0/4215715184 >> v2:172.21.15.179:3300/0 conn(0x7f4ff01578b0 0x7f4ff0155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:17.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.022+0000 7f4feeffd700 1 -- 172.21.15.71:0/4215715184 >> v1:172.21.15.179:6789/0 conn(0x7f4ff00af2f0 legacy=0x7f4ff00af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:17.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.022+0000 7f4feeffd700 1 -- 172.21.15.71:0/4215715184 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff00ad2e0 con 0x7f4ff0155c10 2023-10-09T06:58:17.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.022+0000 7f4feeffd700 1 -- 172.21.15.71:0/4215715184 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f4fe0001470 con 0x7f4ff0155c10 2023-10-09T06:58:17.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.022+0000 7f4feeffd700 1 -- 172.21.15.71:0/4215715184 >> v1:172.21.15.71:6789/0 conn(0x7f4ff0155c10 legacy=0x7f4ff00ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:17.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.022+0000 7f4feeffd700 1 --2- 172.21.15.71:0/4215715184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fd8004d00 0x7f4fd80050f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:17.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.022+0000 7f4feeffd700 1 --2- 172.21.15.71:0/4215715184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fd8005920 0x7f4fd8005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:17.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.022+0000 7f4feeffd700 1 --2- 172.21.15.71:0/4215715184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fd80062d0 0x7f4fd800cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:17.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.022+0000 7f4feeffd700 1 -- 172.21.15.71:0/4215715184 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff00ad000 con 0x7f4fd8004d00 2023-10-09T06:58:17.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.022+0000 7f4feeffd700 1 -- 172.21.15.71:0/4215715184 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80034c0 con 0x7f4fd8005920 2023-10-09T06:58:17.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.022+0000 7f4feeffd700 1 -- 172.21.15.71:0/4215715184 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd8003680 con 0x7f4fd80062d0 2023-10-09T06:58:17.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.022+0000 7f4feffff700 1 --2- 172.21.15.71:0/4215715184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fd8004d00 0x7f4fd80050f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:17.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.022+0000 7f4fef7fe700 1 --2- 172.21.15.71:0/4215715184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fd8005920 0x7f4fd8005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:17.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.022+0000 7f4ff4f9c700 1 --2- 172.21.15.71:0/4215715184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fd80062d0 0x7f4fd800cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:17.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.023+0000 7f4feffff700 1 -- 172.21.15.71:0/4215715184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fd80062d0 msgr2=0x7f4fd800cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:17.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.023+0000 7f4feffff700 1 --2- 172.21.15.71:0/4215715184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fd80062d0 0x7f4fd800cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:17.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.023+0000 7f4feffff700 1 -- 172.21.15.71:0/4215715184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fd8005920 msgr2=0x7f4fd8005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:17.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.023+0000 7f4feffff700 1 --2- 172.21.15.71:0/4215715184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fd8005920 0x7f4fd8005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:17.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.023+0000 7f4feffff700 1 -- 172.21.15.71:0/4215715184 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd8004680 con 0x7f4fd8004d00 2023-10-09T06:58:17.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.023+0000 7f4ff4f9c700 1 -- 172.21.15.71:0/4215715184 reap_dead start 2023-10-09T06:58:17.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.023+0000 7f4feffff700 1 --2- 172.21.15.71:0/4215715184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fd8004d00 0x7f4fd80050f0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000c2d0 tx=0x7f4fe0001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82bcbfde60f5fa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:17.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.023+0000 7f4feeffd700 1 -- 172.21.15.71:0/4215715184 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe000cba0 con 0x7f4fd8004d00 2023-10-09T06:58:17.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.023+0000 7f4feeffd700 1 -- 172.21.15.71:0/4215715184 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe000cd00 con 0x7f4fd8004d00 2023-10-09T06:58:17.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.023+0000 7f4feeffd700 1 -- 172.21.15.71:0/4215715184 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0005b70 con 0x7f4fd8004d00 2023-10-09T06:58:17.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.024+0000 7f4ff69ff700 1 -- 172.21.15.71:0/4215715184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fd8004d00 msgr2=0x7f4fd80050f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:17.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.024+0000 7f4ff69ff700 1 --2- 172.21.15.71:0/4215715184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fd8004d00 0x7f4fd80050f0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000c2d0 tx=0x7f4fe0001e10 comp rx=0 tx=0).stop 2023-10-09T06:58:17.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.024+0000 7f4ff69ff700 1 -- 172.21.15.71:0/4215715184 shutdown_connections 2023-10-09T06:58:17.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.024+0000 7f4ff69ff700 1 --2- 172.21.15.71:0/4215715184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fd8004d00 0x7f4fd80050f0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:17.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.024+0000 7f4ff69ff700 1 -- 172.21.15.71:0/4215715184 >> 172.21.15.71:0/4215715184 conn(0x7f4ff006a320 msgr2=0x7f4ff00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:17.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.024+0000 7f4ff69ff700 1 -- 172.21.15.71:0/4215715184 shutdown_connections 2023-10-09T06:58:17.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.024+0000 7f4ff69ff700 1 -- 172.21.15.71:0/4215715184 wait complete. 2023-10-09T06:58:17.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.025+0000 7f4ff69ff700 1 Processor -- start 2023-10-09T06:58:17.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.025+0000 7f4ff69ff700 1 -- start start 2023-10-09T06:58:17.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.026+0000 7f4ff69ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fd8004d00 0x7f4ff0169f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:17.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.026+0000 7f4ff69ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ff0157d30 0x7f4ff00ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:17.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.026+0000 7f4ff69ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ff00afc80 0x7f4ff00b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:17.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.026+0000 7f4ff69ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff00b0630 con 0x7f4fd8004d00 2023-10-09T06:58:17.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.026+0000 7f4ff69ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff0167cc0 con 0x7f4ff00afc80 2023-10-09T06:58:17.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.026+0000 7f4ff69ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff016a530 con 0x7f4ff0157d30 2023-10-09T06:58:17.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.026+0000 7f4feffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fd8004d00 0x7f4ff0169f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:17.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.026+0000 7f4feffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fd8004d00 0x7f4ff0169f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45784/0 (socket says 172.21.15.71:45784) 2023-10-09T06:58:17.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.026+0000 7f4feffff700 1 -- 172.21.15.71:0/1764265026 learned_addr learned my addr 172.21.15.71:0/1764265026 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:17.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.027+0000 7f4fef7fe700 1 --2- 172.21.15.71:0/1764265026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ff0157d30 0x7f4ff00ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:17.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.027+0000 7f4ff4f9c700 1 --2- 172.21.15.71:0/1764265026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ff00afc80 0x7f4ff00b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:17.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.027+0000 7f4feffff700 1 -- 172.21.15.71:0/1764265026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ff0157d30 msgr2=0x7f4ff00ac2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:17.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.027+0000 7f4feffff700 1 --2- 172.21.15.71:0/1764265026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ff0157d30 0x7f4ff00ac2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:17.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.027+0000 7f4feffff700 1 -- 172.21.15.71:0/1764265026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ff00afc80 msgr2=0x7f4ff00b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:17.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.027+0000 7f4feffff700 1 --2- 172.21.15.71:0/1764265026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ff00afc80 0x7f4ff00b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:17.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.027+0000 7f4feffff700 1 -- 172.21.15.71:0/1764265026 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff016a810 con 0x7f4fd8004d00 2023-10-09T06:58:17.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.027+0000 7f4feffff700 1 --2- 172.21.15.71:0/1764265026 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fd8004d00 0x7f4ff0169f50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0007c90 tx=0x7f4fe0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:17.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.027+0000 7f4fd7fff700 1 -- 172.21.15.71:0/1764265026 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe000c8f0 con 0x7f4fd8004d00 2023-10-09T06:58:17.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.027+0000 7f4fd7fff700 1 -- 172.21.15.71:0/1764265026 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe0004e80 con 0x7f4fd8004d00 2023-10-09T06:58:17.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.027+0000 7f4ff69ff700 1 -- 172.21.15.71:0/1764265026 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff016aaf0 con 0x7f4fd8004d00 2023-10-09T06:58:17.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.027+0000 7f4fd7fff700 1 -- 172.21.15.71:0/1764265026 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe00074f0 con 0x7f4fd8004d00 2023-10-09T06:58:17.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.027+0000 7f4ff69ff700 1 -- 172.21.15.71:0/1764265026 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff0158180 con 0x7f4fd8004d00 2023-10-09T06:58:17.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.029+0000 7f4ff69ff700 1 -- 172.21.15.71:0/1764265026 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff004c3c0 con 0x7f4fd8004d00 2023-10-09T06:58:17.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.029+0000 7f4fd7fff700 1 -- 172.21.15.71:0/1764265026 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4fe001e430 con 0x7f4fd8004d00 2023-10-09T06:58:17.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.030+0000 7f4fd7fff700 1 --2- 172.21.15.71:0/1764265026 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4fdc066f60 0x7f4fdc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:17.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.030+0000 7f4fd7fff700 1 -- 172.21.15.71:0/1764265026 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f4fe0085270 con 0x7f4fd8004d00 2023-10-09T06:58:17.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.031+0000 7f4fef7fe700 1 --2- 172.21.15.71:0/1764265026 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4fdc066f60 0x7f4fdc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:17.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.031+0000 7f4fef7fe700 1 --2- 172.21.15.71:0/1764265026 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4fdc066f60 0x7f4fdc069410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4ff01547f0 tx=0x7f4fe4008040 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:17.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.034+0000 7f4fd7fff700 1 -- 172.21.15.71:0/1764265026 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4fe0052400 con 0x7f4fd8004d00 2023-10-09T06:58:17.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.249+0000 7f4ff69ff700 1 -- 172.21.15.71:0/1764265026 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ff00ad5c0 con 0x7f4fdc066f60 2023-10-09T06:58:17.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.252+0000 7f4fd7fff700 1 -- 172.21.15.71:0/1764265026 <== mgr.6274 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f4ff00ad5c0 con 0x7f4fdc066f60 2023-10-09T06:58:17.254 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-09T06:58:17.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:17.254 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cephfs" 2023-10-09T06:58:17.255 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:17.255 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-09T06:58:17.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.253+0000 7f4ff69ff700 1 -- 172.21.15.71:0/1764265026 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4fdc066f60 msgr2=0x7f4fdc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:17.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.253+0000 7f4ff69ff700 1 --2- 172.21.15.71:0/1764265026 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4fdc066f60 0x7f4fdc069410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4ff01547f0 tx=0x7f4fe4008040 comp rx=0 tx=0).stop 2023-10-09T06:58:17.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.253+0000 7f4ff69ff700 1 -- 172.21.15.71:0/1764265026 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fd8004d00 msgr2=0x7f4ff0169f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:17.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.253+0000 7f4ff69ff700 1 --2- 172.21.15.71:0/1764265026 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fd8004d00 0x7f4ff0169f50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0007c90 tx=0x7f4fe0015000 comp rx=0 tx=0).stop 2023-10-09T06:58:17.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.253+0000 7f4ff69ff700 1 -- 172.21.15.71:0/1764265026 shutdown_connections 2023-10-09T06:58:17.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.253+0000 7f4ff69ff700 1 --2- 172.21.15.71:0/1764265026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ff00afc80 0x7f4ff00b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:17.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.253+0000 7f4ff69ff700 1 --2- 172.21.15.71:0/1764265026 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4fdc066f60 0x7f4fdc069410 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:17.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.253+0000 7f4ff69ff700 1 --2- 172.21.15.71:0/1764265026 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fd8004d00 0x7f4ff0169f50 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:17.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.253+0000 7f4ff69ff700 1 --2- 172.21.15.71:0/1764265026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ff0157d30 0x7f4ff00ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:17.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.253+0000 7f4ff69ff700 1 -- 172.21.15.71:0/1764265026 >> 172.21.15.71:0/1764265026 conn(0x7f4ff006a320 msgr2=0x7f4ff0152a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:17.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.253+0000 7f4ff69ff700 1 -- 172.21.15.71:0/1764265026 shutdown_connections 2023-10-09T06:58:17.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.253+0000 7f4ff69ff700 1 -- 172.21.15.71:0/1764265026 wait complete. 2023-10-09T06:58:17.272 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-09T06:58:17.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.453+0000 7f3f041ff700 1 Processor -- start 2023-10-09T06:58:17.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.453+0000 7f3f041ff700 1 -- start start 2023-10-09T06:58:17.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.454+0000 7f3f041ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3efc0c70b0 0x7f3efc069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:17.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.454+0000 7f3f041ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3efc06e950 con 0x7f3efc069cb0 2023-10-09T06:58:17.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.454+0000 7f3f041ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3efc06eb90 con 0x7f3efc155eb0 2023-10-09T06:58:17.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.454+0000 7f3f041ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3efc06a130 con 0x7f3efc0c70b0 2023-10-09T06:58:17.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.455+0000 7f3f0179a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3efc0c70b0 0x7f3efc069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:17.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.455+0000 7f3f0279c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3efc069cb0 0x7f3efc0ca4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53862/0 (socket says 172.21.15.71:53862) 2023-10-09T06:58:17.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.455+0000 7f3f0179a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3efc0c70b0 0x7f3efc069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45788/0 (socket says 172.21.15.71:45788) 2023-10-09T06:58:17.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.455+0000 7f3f0279c700 1 -- 172.21.15.71:0/1660345623 learned_addr learned my addr 172.21.15.71:0/1660345623 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:17.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.455+0000 7f3f0179a700 1 -- 172.21.15.71:0/1660345623 >> v1:172.21.15.179:6789/0 conn(0x7f3efc155eb0 legacy=0x7f3efc06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:17.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.455+0000 7f3f0179a700 1 -- 172.21.15.71:0/1660345623 >> v1:172.21.15.71:6789/0 conn(0x7f3efc069cb0 legacy=0x7f3efc0ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:17.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.455+0000 7f3f0179a700 1 -- 172.21.15.71:0/1660345623 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc06ee70 con 0x7f3efc0c70b0 2023-10-09T06:58:17.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.455+0000 7f3f0179a700 1 --2- 172.21.15.71:0/1660345623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3efc0c70b0 0x7f3efc069770 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f3eec00bb90 tx=0x7f3eec00b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a30044ec44dbe8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:17.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.456+0000 7f3f00f99700 1 -- 172.21.15.71:0/1660345623 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec00dba0 con 0x7f3efc0c70b0 2023-10-09T06:58:17.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.456+0000 7f3f00f99700 1 -- 172.21.15.71:0/1660345623 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eec00dd00 con 0x7f3efc0c70b0 2023-10-09T06:58:17.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.456+0000 7f3f00f99700 1 -- 172.21.15.71:0/1660345623 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec0196b0 con 0x7f3efc0c70b0 2023-10-09T06:58:17.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.456+0000 7f3f041ff700 1 -- 172.21.15.71:0/1660345623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3efc0c70b0 msgr2=0x7f3efc069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:17.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.456+0000 7f3f041ff700 1 --2- 172.21.15.71:0/1660345623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3efc0c70b0 0x7f3efc069770 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f3eec00bb90 tx=0x7f3eec00b430 comp rx=0 tx=0).stop 2023-10-09T06:58:17.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.456+0000 7f3f041ff700 1 -- 172.21.15.71:0/1660345623 shutdown_connections 2023-10-09T06:58:17.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.456+0000 7f3f041ff700 1 --2- 172.21.15.71:0/1660345623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3efc0c70b0 0x7f3efc069770 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:17.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.456+0000 7f3f041ff700 1 -- 172.21.15.71:0/1660345623 >> 172.21.15.71:0/1660345623 conn(0x7f3efc068e10 msgr2=0x7f3efc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:17.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.456+0000 7f3f041ff700 1 -- 172.21.15.71:0/1660345623 shutdown_connections 2023-10-09T06:58:17.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.457+0000 7f3f041ff700 1 -- 172.21.15.71:0/1660345623 wait complete. 2023-10-09T06:58:17.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.458+0000 7f3f041ff700 1 Processor -- start 2023-10-09T06:58:17.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.458+0000 7f3f041ff700 1 -- start start 2023-10-09T06:58:17.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.459+0000 7f3f041ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3efc069cb0 0x7f3efc167140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:17.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.459+0000 7f3f041ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3efc0c70b0 0x7f3efc1669a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:17.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.459+0000 7f3f041ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3efc155eb0 0x7f3efc168ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:17.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.459+0000 7f3f041ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc0ae880 con 0x7f3efc069cb0 2023-10-09T06:58:17.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.459+0000 7f3f041ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc167680 con 0x7f3efc0c70b0 2023-10-09T06:58:17.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.459+0000 7f3f041ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc166ee0 con 0x7f3efc155eb0 2023-10-09T06:58:17.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.459+0000 7f3f01f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3efc069cb0 0x7f3efc167140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:17.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.459+0000 7f3f01f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3efc069cb0 0x7f3efc167140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45796/0 (socket says 172.21.15.71:45796) 2023-10-09T06:58:17.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.459+0000 7f3f01f9b700 1 -- 172.21.15.71:0/1334833471 learned_addr learned my addr 172.21.15.71:0/1334833471 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:17.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.459+0000 7f3f0279c700 1 --2- 172.21.15.71:0/1334833471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3efc155eb0 0x7f3efc168ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:17.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.459+0000 7f3f0179a700 1 --2- 172.21.15.71:0/1334833471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3efc0c70b0 0x7f3efc1669a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:17.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.459+0000 7f3f01f9b700 1 -- 172.21.15.71:0/1334833471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3efc155eb0 msgr2=0x7f3efc168ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:17.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.459+0000 7f3f01f9b700 1 --2- 172.21.15.71:0/1334833471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3efc155eb0 0x7f3efc168ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:17.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.459+0000 7f3f01f9b700 1 -- 172.21.15.71:0/1334833471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3efc0c70b0 msgr2=0x7f3efc1669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:17.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.459+0000 7f3f01f9b700 1 --2- 172.21.15.71:0/1334833471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3efc0c70b0 0x7f3efc1669a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:17.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.459+0000 7f3f01f9b700 1 -- 172.21.15.71:0/1334833471 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec00b6d0 con 0x7f3efc069cb0 2023-10-09T06:58:17.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.460+0000 7f3f0179a700 1 --2- 172.21.15.71:0/1334833471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3efc0c70b0 0x7f3efc1669a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:17.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.460+0000 7f3f01f9b700 1 --2- 172.21.15.71:0/1334833471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3efc069cb0 0x7f3efc167140 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800c4e0 tx=0x7f3ef800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:17.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.460+0000 7f3ef1ffb700 1 -- 172.21.15.71:0/1334833471 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8011590 con 0x7f3efc069cb0 2023-10-09T06:58:17.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.460+0000 7f3ef1ffb700 1 -- 172.21.15.71:0/1334833471 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef8011710 con 0x7f3efc069cb0 2023-10-09T06:58:17.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.460+0000 7f3f041ff700 1 -- 172.21.15.71:0/1334833471 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3efc0ac140 con 0x7f3efc069cb0 2023-10-09T06:58:17.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.460+0000 7f3ef1ffb700 1 -- 172.21.15.71:0/1334833471 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8011ad0 con 0x7f3efc069cb0 2023-10-09T06:58:17.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.460+0000 7f3f041ff700 1 -- 172.21.15.71:0/1334833471 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3efc0ac700 con 0x7f3efc069cb0 2023-10-09T06:58:17.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.461+0000 7f3f041ff700 1 -- 172.21.15.71:0/1334833471 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3efc04c3c0 con 0x7f3efc069cb0 2023-10-09T06:58:17.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.462+0000 7f3ef1ffb700 1 -- 172.21.15.71:0/1334833471 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 33) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ef801b3b0 con 0x7f3efc069cb0 2023-10-09T06:58:17.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.463+0000 7f3ef1ffb700 1 --2- 172.21.15.71:0/1334833471 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3ee0066f30 0x7f3ee00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:17.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.463+0000 7f3ef1ffb700 1 -- 172.21.15.71:0/1334833471 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f3ef8083c90 con 0x7f3efc069cb0 2023-10-09T06:58:17.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.463+0000 7f3f0179a700 1 --2- 172.21.15.71:0/1334833471 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3ee0066f30 0x7f3ee00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:17.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.464+0000 7f3f0179a700 1 --2- 172.21.15.71:0/1334833471 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3ee0066f30 0x7f3ee00693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3eec00b6a0 tx=0x7f3eec01b000 comp rx=0 tx=0).ready entity=mgr.6274 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:17.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.467+0000 7f3ef1ffb700 1 -- 172.21.15.71:0/1334833471 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ef8050cd0 con 0x7f3efc069cb0 2023-10-09T06:58:17.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.709+0000 7f3f041ff700 1 -- 172.21.15.71:0/1334833471 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f3efc06f150 con 0x7f3efc069cb0 2023-10-09T06:58:17.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.798+0000 7f3ef1ffb700 1 -- 172.21.15.71:0/1334833471 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 34) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f3ef80510a0 con 0x7f3efc069cb0 2023-10-09T06:58:17.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.799+0000 7f3ef1ffb700 1 -- 172.21.15.71:0/1334833471 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v34) v1 ==== 92+0+0 (secure 0 0 0) 0x7f3ef8054760 con 0x7f3efc069cb0 2023-10-09T06:58:17.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.802+0000 7f3f041ff700 1 -- 172.21.15.71:0/1334833471 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3ee0066f30 msgr2=0x7f3ee00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:17.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.802+0000 7f3f041ff700 1 --2- 172.21.15.71:0/1334833471 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3ee0066f30 0x7f3ee00693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3eec00b6a0 tx=0x7f3eec01b000 comp rx=0 tx=0).stop 2023-10-09T06:58:17.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.802+0000 7f3f041ff700 1 -- 172.21.15.71:0/1334833471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3efc069cb0 msgr2=0x7f3efc167140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:17.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.802+0000 7f3f041ff700 1 --2- 172.21.15.71:0/1334833471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3efc069cb0 0x7f3efc167140 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800c4e0 tx=0x7f3ef800c8a0 comp rx=0 tx=0).stop 2023-10-09T06:58:17.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.802+0000 7f3f041ff700 1 -- 172.21.15.71:0/1334833471 shutdown_connections 2023-10-09T06:58:17.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.802+0000 7f3f041ff700 1 --2- 172.21.15.71:0/1334833471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3efc155eb0 0x7f3efc168ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:17.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.802+0000 7f3f041ff700 1 --2- 172.21.15.71:0/1334833471 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3ee0066f30 0x7f3ee00693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:17.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.802+0000 7f3f041ff700 1 --2- 172.21.15.71:0/1334833471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3efc069cb0 0x7f3efc167140 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:17.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.802+0000 7f3f041ff700 1 --2- 172.21.15.71:0/1334833471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3efc0c70b0 0x7f3efc1669a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:17.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.802+0000 7f3f041ff700 1 -- 172.21.15.71:0/1334833471 >> 172.21.15.71:0/1334833471 conn(0x7f3efc068e10 msgr2=0x7f3efc0c1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:17.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.803+0000 7f3f041ff700 1 -- 172.21.15.71:0/1334833471 shutdown_connections 2023-10-09T06:58:17.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:17.803+0000 7f3f041ff700 1 -- 172.21.15.71:0/1334833471 wait complete. 2023-10-09T06:58:17.823 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-09T06:58:18.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.010+0000 7fc8a199d700 1 Processor -- start 2023-10-09T06:58:18.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.010+0000 7fc8a199d700 1 -- start start 2023-10-09T06:58:18.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.011+0000 7fc8a199d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc89c140bb0 0x7fc89c06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:18.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.011+0000 7fc8a199d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc89c06da30 0x7fc89c0c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:18.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.011+0000 7fc8a199d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc89c0c6820 con 0x7fc89c1407e0 2023-10-09T06:58:18.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.011+0000 7fc8a199d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc89c06deb0 con 0x7fc89c140bb0 2023-10-09T06:58:18.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.012+0000 7fc8a199d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc89c0c6de0 con 0x7fc89c06da30 2023-10-09T06:58:18.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.012+0000 7fc89bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc89c140bb0 0x7fc89c06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:18.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.012+0000 7fc8a099b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fc89c1407e0 0x7fc89c06a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:34586/0 (socket says 172.21.15.71:34586) 2023-10-09T06:58:18.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.012+0000 7fc8a119c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc89c06da30 0x7fc89c0c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:18.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.012+0000 7fc8a099b700 1 -- 172.21.15.71:0/4001592783 learned_addr learned my addr 172.21.15.71:0/4001592783 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:18.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.012+0000 7fc89b7fe700 1 -- 172.21.15.71:0/4001592783 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020935911 0 0) 0x7fc89c0c6820 con 0x7fc89c1407e0 2023-10-09T06:58:18.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.012+0000 7fc89bfff700 1 -- 172.21.15.71:0/4001592783 >> v2:172.21.15.179:3300/0 conn(0x7fc89c06da30 msgr2=0x7fc89c0c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:18.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.012+0000 7fc89bfff700 1 --2- 172.21.15.71:0/4001592783 >> v2:172.21.15.179:3300/0 conn(0x7fc89c06da30 0x7fc89c0c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:18.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.012+0000 7fc89bfff700 1 -- 172.21.15.71:0/4001592783 >> v1:172.21.15.179:6789/0 conn(0x7fc89c1407e0 legacy=0x7fc89c06a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:18.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.012+0000 7fc89bfff700 1 -- 172.21.15.71:0/4001592783 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89c141270 con 0x7fc89c140bb0 2023-10-09T06:58:18.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.013+0000 7fc89bfff700 1 --2- 172.21.15.71:0/4001592783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc89c140bb0 0x7fc89c06d4f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0aed40 tx=0x7fc8880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fcda9154f0ae46 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:18.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.013+0000 7fc89b7fe700 1 -- 172.21.15.71:0/4001592783 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888011630 con 0x7fc89c140bb0 2023-10-09T06:58:18.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.013+0000 7fc89b7fe700 1 -- 172.21.15.71:0/4001592783 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc888011790 con 0x7fc89c140bb0 2023-10-09T06:58:18.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.013+0000 7fc89b7fe700 1 -- 172.21.15.71:0/4001592783 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888011b30 con 0x7fc89c140bb0 2023-10-09T06:58:18.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.013+0000 7fc8a199d700 1 -- 172.21.15.71:0/4001592783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc89c140bb0 msgr2=0x7fc89c06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:18.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.013+0000 7fc8a199d700 1 --2- 172.21.15.71:0/4001592783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc89c140bb0 0x7fc89c06d4f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0aed40 tx=0x7fc8880091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:18.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.014+0000 7fc8a199d700 1 -- 172.21.15.71:0/4001592783 shutdown_connections 2023-10-09T06:58:18.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.014+0000 7fc8a199d700 1 --2- 172.21.15.71:0/4001592783 >> v2:172.21.15.179:3300/0 conn(0x7fc89c06da30 0x7fc89c0c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:18.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.014+0000 7fc8a199d700 1 --2- 172.21.15.71:0/4001592783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc89c140bb0 0x7fc89c06d4f0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:18.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.014+0000 7fc8a199d700 1 -- 172.21.15.71:0/4001592783 >> 172.21.15.71:0/4001592783 conn(0x7fc89c0cc1e0 msgr2=0x7fc89c0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:18.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.014+0000 7fc8a199d700 1 -- 172.21.15.71:0/4001592783 shutdown_connections 2023-10-09T06:58:18.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.014+0000 7fc8a199d700 1 -- 172.21.15.71:0/4001592783 wait complete. 2023-10-09T06:58:18.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.016+0000 7fc8a199d700 1 Processor -- start 2023-10-09T06:58:18.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.016+0000 7fc8a199d700 1 -- start start 2023-10-09T06:58:18.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.018+0000 7fc8a199d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc89c06da30 0x7fc89c16d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:18.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.018+0000 7fc8a199d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89c1407e0 0x7fc89c16d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:18.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.018+0000 7fc8a199d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc89c140bb0 0x7fc89c0caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:18.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.018+0000 7fc8a199d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c16ba00 con 0x7fc89c140bb0 2023-10-09T06:58:18.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.018+0000 7fc8a199d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c16b110 con 0x7fc89c06da30 2023-10-09T06:58:18.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.018+0000 7fc8a199d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c16b3b0 con 0x7fc89c1407e0 2023-10-09T06:58:18.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.018+0000 7fc8a119c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc89c140bb0 0x7fc89c0caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:18.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.018+0000 7fc8a119c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc89c140bb0 0x7fc89c0caaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45828/0 (socket says 172.21.15.71:45828) 2023-10-09T06:58:18.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.018+0000 7fc8a119c700 1 -- 172.21.15.71:0/2248827922 learned_addr learned my addr 172.21.15.71:0/2248827922 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:18.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.018+0000 7fc8a099b700 1 --2- 172.21.15.71:0/2248827922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc89c06da30 0x7fc89c16d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:18.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.018+0000 7fc89bfff700 1 --2- 172.21.15.71:0/2248827922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89c1407e0 0x7fc89c16d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:18.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.018+0000 7fc8a119c700 1 -- 172.21.15.71:0/2248827922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89c1407e0 msgr2=0x7fc89c16d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:18.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.018+0000 7fc8a119c700 1 --2- 172.21.15.71:0/2248827922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89c1407e0 0x7fc89c16d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:18.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.018+0000 7fc8a119c700 1 -- 172.21.15.71:0/2248827922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc89c06da30 msgr2=0x7fc89c16d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:18.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.018+0000 7fc8a119c700 1 --2- 172.21.15.71:0/2248827922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc89c06da30 0x7fc89c16d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:18.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.018+0000 7fc8a119c700 1 -- 172.21.15.71:0/2248827922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc888009420 con 0x7fc89c140bb0 2023-10-09T06:58:18.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.019+0000 7fc8a119c700 1 --2- 172.21.15.71:0/2248827922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc89c140bb0 0x7fc89c0caaa0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc894009e90 tx=0x7fc89400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:18.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.019+0000 7fc898ff9700 1 -- 172.21.15.71:0/2248827922 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89400cb70 con 0x7fc89c140bb0 2023-10-09T06:58:18.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.019+0000 7fc898ff9700 1 -- 172.21.15.71:0/2248827922 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89400f040 con 0x7fc89c140bb0 2023-10-09T06:58:18.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.019+0000 7fc898ff9700 1 -- 172.21.15.71:0/2248827922 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc894014480 con 0x7fc89c140bb0 2023-10-09T06:58:18.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.019+0000 7fc8a199d700 1 -- 172.21.15.71:0/2248827922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc89c16b690 con 0x7fc89c140bb0 2023-10-09T06:58:18.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.019+0000 7fc8a199d700 1 -- 172.21.15.71:0/2248827922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc89c0c6210 con 0x7fc89c140bb0 2023-10-09T06:58:18.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.020+0000 7fc8a199d700 1 -- 172.21.15.71:0/2248827922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc89c0c6460 con 0x7fc89c140bb0 2023-10-09T06:58:18.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.021+0000 7fc898ff9700 1 -- 172.21.15.71:0/2248827922 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 34) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fc894014830 con 0x7fc89c140bb0 2023-10-09T06:58:18.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.022+0000 7fc898ff9700 1 --2- 172.21.15.71:0/2248827922 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc880066f80 0x7fc880069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:18.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.022+0000 7fc898ff9700 1 -- 172.21.15.71:0/2248827922 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fc894085190 con 0x7fc89c140bb0 2023-10-09T06:58:18.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.022+0000 7fc8a099b700 1 -- 172.21.15.71:0/2248827922 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc880066f80 msgr2=0x7fc880069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:18.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.022+0000 7fc8a099b700 1 --2- 172.21.15.71:0/2248827922 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc880066f80 0x7fc880069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:58:18.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.026+0000 7fc898ff9700 1 -- 172.21.15.71:0/2248827922 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8940521d0 con 0x7fc89c140bb0 2023-10-09T06:58:18.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.223+0000 7fc8a199d700 1 -- 172.21.15.71:0/2248827922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fc89c06acf0 con 0x7fc89c140bb0 2023-10-09T06:58:18.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.223+0000 7fc8a099b700 1 -- 172.21.15.71:0/2248827922 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc880066f80 msgr2=0x7fc880069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:18.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.223+0000 7fc8a099b700 1 --2- 172.21.15.71:0/2248827922 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc880066f80 0x7fc880069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:58:18.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.229+0000 7fc898ff9700 1 -- 172.21.15.71:0/2248827922 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc8940557f0 con 0x7fc89c140bb0 2023-10-09T06:58:18.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.231+0000 7fc8a199d700 1 -- 172.21.15.71:0/2248827922 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc880066f80 msgr2=0x7fc880069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:58:18.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.231+0000 7fc8a199d700 1 --2- 172.21.15.71:0/2248827922 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc880066f80 0x7fc880069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:18.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.231+0000 7fc8a199d700 1 -- 172.21.15.71:0/2248827922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc89c140bb0 msgr2=0x7fc89c0caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:18.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.231+0000 7fc8a199d700 1 --2- 172.21.15.71:0/2248827922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc89c140bb0 0x7fc89c0caaa0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc894009e90 tx=0x7fc89400b040 comp rx=0 tx=0).stop 2023-10-09T06:58:18.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.231+0000 7fc8a199d700 1 -- 172.21.15.71:0/2248827922 shutdown_connections 2023-10-09T06:58:18.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.231+0000 7fc8a199d700 1 --2- 172.21.15.71:0/2248827922 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc880066f80 0x7fc880069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:18.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.231+0000 7fc8a199d700 1 --2- 172.21.15.71:0/2248827922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc89c140bb0 0x7fc89c0caaa0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:18.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.231+0000 7fc8a199d700 1 --2- 172.21.15.71:0/2248827922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc89c06da30 0x7fc89c16d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:18.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.231+0000 7fc8a199d700 1 --2- 172.21.15.71:0/2248827922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89c1407e0 0x7fc89c16d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:18.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.231+0000 7fc8a199d700 1 -- 172.21.15.71:0/2248827922 >> 172.21.15.71:0/2248827922 conn(0x7fc89c0cc1e0 msgr2=0x7fc89c13ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:18.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.231+0000 7fc8a199d700 1 -- 172.21.15.71:0/2248827922 shutdown_connections 2023-10-09T06:58:18.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.231+0000 7fc8a199d700 1 -- 172.21.15.71:0/2248827922 wait complete. 2023-10-09T06:58:18.251 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-09T06:58:18.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.436+0000 7fdb4759e700 1 Processor -- start 2023-10-09T06:58:18.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.436+0000 7fdb4759e700 1 -- start start 2023-10-09T06:58:18.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.437+0000 7fdb4759e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdb480b16d0 0x7fdb480b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:18.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.437+0000 7fdb4759e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb480b2080 con 0x7fdb480b4e70 2023-10-09T06:58:18.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.437+0000 7fdb4759e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb480cfb00 con 0x7fdb480b33b0 2023-10-09T06:58:18.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.437+0000 7fdb4759e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb480b5c40 con 0x7fdb480b16d0 2023-10-09T06:58:18.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.438+0000 7fdb45d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdb480b16d0 0x7fdb480b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:18.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.438+0000 7fdb4659c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fdb480b4e70 0x7fdb480ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53874/0 (socket says 172.21.15.71:53874) 2023-10-09T06:58:18.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.438+0000 7fdb4659c700 1 -- 172.21.15.71:0/43107836 learned_addr learned my addr 172.21.15.71:0/43107836 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:18.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.438+0000 7fdb45d9b700 1 -- 172.21.15.71:0/43107836 >> v1:172.21.15.179:6789/0 conn(0x7fdb480b33b0 legacy=0x7fdb480b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:18.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.438+0000 7fdb45d9b700 1 -- 172.21.15.71:0/43107836 >> v1:172.21.15.71:6789/0 conn(0x7fdb480b4e70 legacy=0x7fdb480ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:18.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.438+0000 7fdb45d9b700 1 -- 172.21.15.71:0/43107836 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb480b5f20 con 0x7fdb480b16d0 2023-10-09T06:58:18.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.438+0000 7fdb4559a700 1 -- 172.21.15.71:0/43107836 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894359065 0 0) 0x7fdb480b2080 con 0x7fdb480b4e70 2023-10-09T06:58:18.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.438+0000 7fdb45d9b700 1 --2- 172.21.15.71:0/43107836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb480b16d0 0x7fdb480b1b40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0098e0 tx=0x7fdb3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b1b1c81b57bbf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:18.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.439+0000 7fdb4559a700 1 -- 172.21.15.71:0/43107836 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c009e80 con 0x7fdb480b16d0 2023-10-09T06:58:18.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.439+0000 7fdb4559a700 1 -- 172.21.15.71:0/43107836 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c00b860 con 0x7fdb480b16d0 2023-10-09T06:58:18.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.439+0000 7fdb4559a700 1 -- 172.21.15.71:0/43107836 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c00bbe0 con 0x7fdb480b16d0 2023-10-09T06:58:18.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.439+0000 7fdb4759e700 1 -- 172.21.15.71:0/43107836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb480b16d0 msgr2=0x7fdb480b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:18.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.439+0000 7fdb4759e700 1 --2- 172.21.15.71:0/43107836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb480b16d0 0x7fdb480b1b40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0098e0 tx=0x7fdb3c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:18.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.440+0000 7fdb4759e700 1 -- 172.21.15.71:0/43107836 shutdown_connections 2023-10-09T06:58:18.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.440+0000 7fdb4759e700 1 --2- 172.21.15.71:0/43107836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb480b16d0 0x7fdb480b1b40 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:18.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.440+0000 7fdb4759e700 1 -- 172.21.15.71:0/43107836 >> 172.21.15.71:0/43107836 conn(0x7fdb480d10c0 msgr2=0x7fdb480affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:18.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.440+0000 7fdb4759e700 1 -- 172.21.15.71:0/43107836 shutdown_connections 2023-10-09T06:58:18.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.440+0000 7fdb4759e700 1 -- 172.21.15.71:0/43107836 wait complete. 2023-10-09T06:58:18.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.442+0000 7fdb4759e700 1 Processor -- start 2023-10-09T06:58:18.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.442+0000 7fdb4759e700 1 -- start start 2023-10-09T06:58:18.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.444+0000 7fdb4759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb480b16d0 0x7fdb48158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:18.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.444+0000 7fdb4759e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb480b33b0 0x7fdb480a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:18.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.444+0000 7fdb4759e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb480b4e70 0x7fdb480cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:18.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.444+0000 7fdb4759e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb480ca8f0 con 0x7fdb480b4e70 2023-10-09T06:58:18.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.444+0000 7fdb4759e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb480cabd0 con 0x7fdb480b33b0 2023-10-09T06:58:18.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.444+0000 7fdb4759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb480caeb0 con 0x7fdb480b16d0 2023-10-09T06:58:18.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.444+0000 7fdb46d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb480b4e70 0x7fdb480cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:18.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.444+0000 7fdb46d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb480b4e70 0x7fdb480cb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45856/0 (socket says 172.21.15.71:45856) 2023-10-09T06:58:18.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.444+0000 7fdb46d9d700 1 -- 172.21.15.71:0/1142212291 learned_addr learned my addr 172.21.15.71:0/1142212291 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:18.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.444+0000 7fdb45d9b700 1 --2- 172.21.15.71:0/1142212291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb480b33b0 0x7fdb480a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:18.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.444+0000 7fdb4659c700 1 --2- 172.21.15.71:0/1142212291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb480b16d0 0x7fdb48158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:18.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.444+0000 7fdb46d9d700 1 -- 172.21.15.71:0/1142212291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb480b16d0 msgr2=0x7fdb48158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:18.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.444+0000 7fdb46d9d700 1 --2- 172.21.15.71:0/1142212291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb480b16d0 0x7fdb48158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:18.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.444+0000 7fdb46d9d700 1 -- 172.21.15.71:0/1142212291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb480b33b0 msgr2=0x7fdb480a9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:18.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.444+0000 7fdb46d9d700 1 --2- 172.21.15.71:0/1142212291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb480b33b0 0x7fdb480a9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:18.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.444+0000 7fdb46d9d700 1 -- 172.21.15.71:0/1142212291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3c009420 con 0x7fdb480b4e70 2023-10-09T06:58:18.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.445+0000 7fdb46d9d700 1 --2- 172.21.15.71:0/1142212291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb480b4e70 0x7fdb480cb990 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fdb4000c8e0 tx=0x7fdb40001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:18.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.445+0000 7fdb367fc700 1 -- 172.21.15.71:0/1142212291 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40012630 con 0x7fdb480b4e70 2023-10-09T06:58:18.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.445+0000 7fdb367fc700 1 -- 172.21.15.71:0/1142212291 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb400127b0 con 0x7fdb480b4e70 2023-10-09T06:58:18.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.445+0000 7fdb367fc700 1 -- 172.21.15.71:0/1142212291 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40012b70 con 0x7fdb480b4e70 2023-10-09T06:58:18.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.445+0000 7fdb4759e700 1 -- 172.21.15.71:0/1142212291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb480cb190 con 0x7fdb480b4e70 2023-10-09T06:58:18.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.445+0000 7fdb4759e700 1 -- 172.21.15.71:0/1142212291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb48158870 con 0x7fdb480b4e70 2023-10-09T06:58:18.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.446+0000 7fdb4759e700 1 -- 172.21.15.71:0/1142212291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb48088990 con 0x7fdb480b4e70 2023-10-09T06:58:18.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.447+0000 7fdb367fc700 1 -- 172.21.15.71:0/1142212291 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 34) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fdb40003030 con 0x7fdb480b4e70 2023-10-09T06:58:18.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.448+0000 7fdb367fc700 1 --2- 172.21.15.71:0/1142212291 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb28066f80 0x7fdb28069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:18.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.448+0000 7fdb367fc700 1 -- 172.21.15.71:0/1142212291 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fdb40084610 con 0x7fdb480b4e70 2023-10-09T06:58:18.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.448+0000 7fdb4659c700 1 -- 172.21.15.71:0/1142212291 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb28066f80 msgr2=0x7fdb28069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:18.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.448+0000 7fdb4659c700 1 --2- 172.21.15.71:0/1142212291 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb28066f80 0x7fdb28069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:58:18.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.452+0000 7fdb367fc700 1 -- 172.21.15.71:0/1142212291 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb40051650 con 0x7fdb480b4e70 2023-10-09T06:58:18.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.649+0000 7fdb4659c700 1 -- 172.21.15.71:0/1142212291 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb28066f80 msgr2=0x7fdb28069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:18.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.649+0000 7fdb4659c700 1 --2- 172.21.15.71:0/1142212291 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb28066f80 0x7fdb28069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:58:18.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.652+0000 7fdb4759e700 1 -- 172.21.15.71:0/1142212291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fdb4804bb80 con 0x7fdb480b4e70 2023-10-09T06:58:18.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.658+0000 7fdb367fc700 1 -- 172.21.15.71:0/1142212291 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) v1 ==== 133+0+0 (secure 0 0 0) 0x7fdb40054c70 con 0x7fdb480b4e70 2023-10-09T06:58:18.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.660+0000 7fdb4759e700 1 -- 172.21.15.71:0/1142212291 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb28066f80 msgr2=0x7fdb28069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:58:18.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.660+0000 7fdb4759e700 1 --2- 172.21.15.71:0/1142212291 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb28066f80 0x7fdb28069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:18.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.660+0000 7fdb4759e700 1 -- 172.21.15.71:0/1142212291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb480b4e70 msgr2=0x7fdb480cb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:18.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.660+0000 7fdb4759e700 1 --2- 172.21.15.71:0/1142212291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb480b4e70 0x7fdb480cb990 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fdb4000c8e0 tx=0x7fdb40001710 comp rx=0 tx=0).stop 2023-10-09T06:58:18.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.660+0000 7fdb4759e700 1 -- 172.21.15.71:0/1142212291 shutdown_connections 2023-10-09T06:58:18.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.660+0000 7fdb4759e700 1 --2- 172.21.15.71:0/1142212291 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fdb28066f80 0x7fdb28069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:18.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.660+0000 7fdb4759e700 1 --2- 172.21.15.71:0/1142212291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb480b4e70 0x7fdb480cb990 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:18.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.660+0000 7fdb4759e700 1 --2- 172.21.15.71:0/1142212291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb480b16d0 0x7fdb48158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:18.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.660+0000 7fdb4759e700 1 --2- 172.21.15.71:0/1142212291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb480b33b0 0x7fdb480a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:18.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.660+0000 7fdb4759e700 1 -- 172.21.15.71:0/1142212291 >> 172.21.15.71:0/1142212291 conn(0x7fdb480d10c0 msgr2=0x7fdb480affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:18.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.661+0000 7fdb4759e700 1 -- 172.21.15.71:0/1142212291 shutdown_connections 2023-10-09T06:58:18.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.661+0000 7fdb4759e700 1 -- 172.21.15.71:0/1142212291 wait complete. 2023-10-09T06:58:18.682 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-10-09T06:58:18.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.870+0000 7ffa8ed9d700 1 Processor -- start 2023-10-09T06:58:18.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.870+0000 7ffa8ed9d700 1 -- start start 2023-10-09T06:58:18.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.871+0000 7ffa8ed9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa880cca20 0x7ffa880cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:18.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.871+0000 7ffa8ed9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa880cfa00 con 0x7ffa880b0790 2023-10-09T06:58:18.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.871+0000 7ffa8ed9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa880cb580 con 0x7ffa880b03c0 2023-10-09T06:58:18.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.871+0000 7ffa8ed9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880cf160 con 0x7ffa880cca20 2023-10-09T06:58:18.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.871+0000 7ffa8d59a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ffa880b0790 0x7ffa881591e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53880/0 (socket says 172.21.15.71:53880) 2023-10-09T06:58:18.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.871+0000 7ffa8d59a700 1 -- 172.21.15.71:0/457905158 learned_addr learned my addr 172.21.15.71:0/457905158 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:18.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.872+0000 7ffa8e59c700 1 --2- 172.21.15.71:0/457905158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa880cca20 0x7ffa880cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:18.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.872+0000 7ffa8cd99700 1 -- 172.21.15.71:0/457905158 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1180257292 0 0) 0x7ffa880cfa00 con 0x7ffa880b0790 2023-10-09T06:58:18.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.872+0000 7ffa8cd99700 1 -- 172.21.15.71:0/457905158 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa74003570 con 0x7ffa880b0790 2023-10-09T06:58:18.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.872+0000 7ffa8cd99700 1 -- 172.21.15.71:0/457905158 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127962615 0 0) 0x7ffa880cb580 con 0x7ffa880b03c0 2023-10-09T06:58:18.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.872+0000 7ffa8cd99700 1 -- 172.21.15.71:0/457905158 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa880cfa00 con 0x7ffa880b03c0 2023-10-09T06:58:18.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.872+0000 7ffa8e59c700 1 -- 172.21.15.71:0/457905158 >> v1:172.21.15.179:6789/0 conn(0x7ffa880b03c0 legacy=0x7ffa880b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:18.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.872+0000 7ffa8e59c700 1 -- 172.21.15.71:0/457905158 >> v1:172.21.15.71:6789/0 conn(0x7ffa880b0790 legacy=0x7ffa881591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:18.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.872+0000 7ffa8e59c700 1 -- 172.21.15.71:0/457905158 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa880cf440 con 0x7ffa880cca20 2023-10-09T06:58:18.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.872+0000 7ffa8e59c700 1 --2- 172.21.15.71:0/457905158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa880cca20 0x7ffa880cea70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009ec0 tx=0x7ffa80009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50cc1deb4e51820d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:18.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.873+0000 7ffa8cd99700 1 -- 172.21.15.71:0/457905158 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000e070 con 0x7ffa880cca20 2023-10-09T06:58:18.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.873+0000 7ffa8cd99700 1 -- 172.21.15.71:0/457905158 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8000bb40 con 0x7ffa880cca20 2023-10-09T06:58:18.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.873+0000 7ffa8cd99700 1 -- 172.21.15.71:0/457905158 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80012430 con 0x7ffa880cca20 2023-10-09T06:58:18.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.873+0000 7ffa8ed9d700 1 -- 172.21.15.71:0/457905158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa880cca20 msgr2=0x7ffa880cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:18.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.873+0000 7ffa8ed9d700 1 --2- 172.21.15.71:0/457905158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa880cca20 0x7ffa880cea70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009ec0 tx=0x7ffa80009780 comp rx=0 tx=0).stop 2023-10-09T06:58:18.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.873+0000 7ffa8ed9d700 1 -- 172.21.15.71:0/457905158 shutdown_connections 2023-10-09T06:58:18.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.873+0000 7ffa8ed9d700 1 --2- 172.21.15.71:0/457905158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa880cca20 0x7ffa880cea70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:18.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.873+0000 7ffa8ed9d700 1 -- 172.21.15.71:0/457905158 >> 172.21.15.71:0/457905158 conn(0x7ffa88063230 msgr2=0x7ffa88063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:18.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.873+0000 7ffa8ed9d700 1 -- 172.21.15.71:0/457905158 shutdown_connections 2023-10-09T06:58:18.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.873+0000 7ffa8ed9d700 1 -- 172.21.15.71:0/457905158 wait complete. 2023-10-09T06:58:18.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.875+0000 7ffa8ed9d700 1 Processor -- start 2023-10-09T06:58:18.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.875+0000 7ffa8ed9d700 1 -- start start 2023-10-09T06:58:18.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.876+0000 7ffa8ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa880b03c0 0x7ffa880c5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:18.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.876+0000 7ffa8ed9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa880b0790 0x7ffa8815a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:18.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.876+0000 7ffa8ed9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa880cca20 0x7ffa88150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:18.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.876+0000 7ffa8ed9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880c6280 con 0x7ffa880b03c0 2023-10-09T06:58:18.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.876+0000 7ffa8ed9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa88169a00 con 0x7ffa880b0790 2023-10-09T06:58:18.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.876+0000 7ffa8ed9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880c5fa0 con 0x7ffa880cca20 2023-10-09T06:58:18.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.876+0000 7ffa8dd9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa880b03c0 0x7ffa880c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:18.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.876+0000 7ffa8dd9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa880b03c0 0x7ffa880c5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45864/0 (socket says 172.21.15.71:45864) 2023-10-09T06:58:18.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.876+0000 7ffa8dd9b700 1 -- 172.21.15.71:0/4009100913 learned_addr learned my addr 172.21.15.71:0/4009100913 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:18.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.876+0000 7ffa8d59a700 1 --2- 172.21.15.71:0/4009100913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa880b0790 0x7ffa8815a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:18.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.876+0000 7ffa8e59c700 1 --2- 172.21.15.71:0/4009100913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa880cca20 0x7ffa88150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:18.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.877+0000 7ffa8dd9b700 1 -- 172.21.15.71:0/4009100913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa880cca20 msgr2=0x7ffa88150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:18.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.877+0000 7ffa8dd9b700 1 --2- 172.21.15.71:0/4009100913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa880cca20 0x7ffa88150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:18.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.877+0000 7ffa8dd9b700 1 -- 172.21.15.71:0/4009100913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa880b0790 msgr2=0x7ffa8815a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:18.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.877+0000 7ffa8dd9b700 1 --2- 172.21.15.71:0/4009100913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa880b0790 0x7ffa8815a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:18.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.877+0000 7ffa8dd9b700 1 -- 172.21.15.71:0/4009100913 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa80009a20 con 0x7ffa880b03c0 2023-10-09T06:58:18.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.877+0000 7ffa8dd9b700 1 --2- 172.21.15.71:0/4009100913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa880b03c0 0x7ffa880c5650 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7ffa8400c580 tx=0x7ffa84007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:18.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.877+0000 7ffa7dffb700 1 -- 172.21.15.71:0/4009100913 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa84010510 con 0x7ffa880b03c0 2023-10-09T06:58:18.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.877+0000 7ffa7dffb700 1 -- 172.21.15.71:0/4009100913 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa84010670 con 0x7ffa880b03c0 2023-10-09T06:58:18.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.877+0000 7ffa8ed9d700 1 -- 172.21.15.71:0/4009100913 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa88169ca0 con 0x7ffa880b03c0 2023-10-09T06:58:18.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.877+0000 7ffa7dffb700 1 -- 172.21.15.71:0/4009100913 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa84010a30 con 0x7ffa880b03c0 2023-10-09T06:58:18.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.877+0000 7ffa8ed9d700 1 -- 172.21.15.71:0/4009100913 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa880c5b90 con 0x7ffa880b03c0 2023-10-09T06:58:18.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.878+0000 7ffa8ed9d700 1 -- 172.21.15.71:0/4009100913 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa88169860 con 0x7ffa880b03c0 2023-10-09T06:58:18.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.879+0000 7ffa7dffb700 1 -- 172.21.15.71:0/4009100913 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 34) v1 ==== 84757+0+0 (secure 0 0 0) 0x7ffa8401b400 con 0x7ffa880b03c0 2023-10-09T06:58:18.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.880+0000 7ffa7dffb700 1 --2- 172.21.15.71:0/4009100913 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffa6c066f80 0x7ffa6c069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:18.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.881+0000 7ffa7dffb700 1 -- 172.21.15.71:0/4009100913 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6097+0+0 (secure 0 0 0) 0x7ffa84084310 con 0x7ffa880b03c0 2023-10-09T06:58:18.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.881+0000 7ffa8d59a700 1 -- 172.21.15.71:0/4009100913 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffa6c066f80 msgr2=0x7ffa6c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:18.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.881+0000 7ffa8d59a700 1 --2- 172.21.15.71:0/4009100913 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffa6c066f80 0x7ffa6c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:58:18.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:18.885+0000 7ffa7dffb700 1 -- 172.21.15.71:0/4009100913 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa88169860 con 0x7ffa880b03c0 2023-10-09T06:58:19.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:19.082+0000 7ffa8d59a700 1 -- 172.21.15.71:0/4009100913 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffa6c066f80 msgr2=0x7ffa6c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:19.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:19.082+0000 7ffa8d59a700 1 --2- 172.21.15.71:0/4009100913 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffa6c066f80 0x7ffa6c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:58:19.083 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:19.081+0000 7f5200c93180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T06:58:19.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:19.117+0000 7ffa8ed9d700 1 -- 172.21.15.71:0/4009100913 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa8816a1c0 con 0x7ffa6c066f80 2023-10-09T06:58:19.127 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:19.127+0000 7fb607a8b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T06:58:19.245 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:19.244+0000 7f5200c93180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T06:58:19.295 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:19.294+0000 7fb607a8b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T06:58:19.333 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:19.332+0000 7f5200c93180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T06:58:19.380 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:19.380+0000 7fb607a8b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T06:58:19.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:19.483+0000 7ffa8d59a700 1 -- 172.21.15.71:0/4009100913 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffa6c066f80 msgr2=0x7ffa6c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:19.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:19.483+0000 7ffa8d59a700 1 --2- 172.21.15.71:0/4009100913 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffa6c066f80 0x7ffa6c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T06:58:19.558 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:19.557+0000 7f5200c93180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:58:19.606 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:19.605+0000 7fb607a8b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:58:19.735 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:19.733+0000 7f5200c93180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T06:58:19.784 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:19.783+0000 7fb607a8b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T06:58:19.830 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:19.828+0000 7f5200c93180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T06:58:19.878 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:19.877+0000 7fb607a8b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T06:58:19.992 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:19.990+0000 7f5200c93180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T06:58:20.040 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:20.039+0000 7fb607a8b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T06:58:20.093 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:20.091+0000 7f5200c93180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T06:58:20.140 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:20.138+0000 7fb607a8b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T06:58:20.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:20.284+0000 7ffa8d59a700 1 -- 172.21.15.71:0/4009100913 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffa6c066f80 msgr2=0x7ffa6c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:20.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:20.284+0000 7ffa8d59a700 1 --2- 172.21.15.71:0/4009100913 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffa6c066f80 0x7ffa6c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T06:58:20.576 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:20.575+0000 7f5200c93180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T06:58:20.623 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:20.623+0000 7fb607a8b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T06:58:20.669 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:20.668+0000 7f5200c93180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T06:58:20.717 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:20.716+0000 7fb607a8b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T06:58:20.759 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:20.757+0000 7f5200c93180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T06:58:20.807 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:20.806+0000 7fb607a8b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T06:58:21.380 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:21.379+0000 7f5200c93180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T06:58:21.428 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:21.427+0000 7fb607a8b180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T06:58:21.550 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:21.549+0000 7f5200c93180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:58:21.602 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:21.601+0000 7fb607a8b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:58:21.645 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:21.644+0000 7f5200c93180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T06:58:21.698 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:21.697+0000 7fb607a8b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T06:58:21.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:21.886+0000 7ffa8d59a700 1 -- 172.21.15.71:0/4009100913 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffa6c066f80 msgr2=0x7ffa6c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:21.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:21.886+0000 7ffa8d59a700 1 --2- 172.21.15.71:0/4009100913 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffa6c066f80 0x7ffa6c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-09T06:58:21.939 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:21.938+0000 7f5200c93180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T06:58:21.991 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:21.990+0000 7fb607a8b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T06:58:22.033 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:22.032+0000 7f5200c93180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T06:58:22.086 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:22.085+0000 7fb607a8b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T06:58:22.732 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:22.731+0000 7f5200c93180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T06:58:22.788 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:22.788+0000 7fb607a8b180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T06:58:23.017 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:23.015+0000 7f5200c93180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T06:58:23.071 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:23.071+0000 7fb607a8b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T06:58:23.110 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:23.108+0000 7f5200c93180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T06:58:23.166 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:23.166+0000 7fb607a8b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T06:58:23.262 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:23.261+0000 7f5200c93180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T06:58:23.321 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:23.321+0000 7fb607a8b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T06:58:23.367 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:23.366+0000 7f5200c93180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T06:58:23.425 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:23.425+0000 7fb607a8b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T06:58:23.557 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:23.555+0000 7f5200c93180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T06:58:23.615 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:23.615+0000 7fb607a8b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T06:58:23.649 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:23.648+0000 7f5200c93180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T06:58:23.708 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:23.708+0000 7fb607a8b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T06:58:23.740 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:23.739+0000 7f5200c93180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T06:58:23.800 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:23.800+0000 7fb607a8b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T06:58:23.834 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:23.833+0000 7f5200c93180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T06:58:23.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:23.845+0000 7ffa7dffb700 1 -- 172.21.15.71:0/4009100913 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 35) v1 ==== 84468+0+0 (secure 0 0 0) 0x7ffa84051720 con 0x7ffa880b03c0 2023-10-09T06:58:23.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:23.846+0000 7ffa7dffb700 1 -- 172.21.15.71:0/4009100913 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffa6c066f80 msgr2=0x7ffa6c069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:58:23.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:23.846+0000 7ffa7dffb700 1 --2- 172.21.15.71:0/4009100913 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffa6c066f80 0x7ffa6c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:23.900 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:23.900+0000 7fb607a8b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T06:58:23.973 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:23.971+0000 7f5175f77700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:58:23.973 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:23.971+0000 7f5175f77700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:58:23.973 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:23.971+0000 7f5175f77700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:58:23.974 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:23.971+0000 7f5175f77700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:58:23.974 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:23.971+0000 7f5175f77700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:58:23.974 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:23.972+0000 7f5172f71700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:58:23.974 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:23.972+0000 7f5172f71700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:58:23.974 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:23.972+0000 7f5172f71700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:58:23.975 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:23.972+0000 7f5172f71700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:58:23.975 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:23.972+0000 7f5172f71700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:58:24.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:24.850+0000 7ffa7dffb700 1 -- 172.21.15.71:0/4009100913 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mgrmap(e 36) v1 ==== 84595+0+0 (secure 0 0 0) 0x7ffa8400f260 con 0x7ffa880b03c0 2023-10-09T06:58:24.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:24.850+0000 7ffa7dffb700 1 --2- 172.21.15.71:0/4009100913 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffa6c066f80 0x7ffa6c0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:24.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:24.851+0000 7ffa7dffb700 1 -- 172.21.15.71:0/4009100913 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa8816a1c0 con 0x7ffa6c066f80 2023-10-09T06:58:24.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:24.855+0000 7ffa8d59a700 1 --2- 172.21.15.71:0/4009100913 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffa6c066f80 0x7ffa6c0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:24.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:24.859+0000 7ffa8d59a700 1 --2- 172.21.15.71:0/4009100913 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffa6c066f80 0x7ffa6c0693b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ffa78007fd0 tx=0x7ffa78009040 comp rx=0 tx=0).ready entity=mgr.6637 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:24.867 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:24.866+0000 7f517cf85700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-10-09T06:58:24.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:24.867+0000 7ffa7dffb700 1 -- 172.21.15.71:0/4009100913 <== mgr.6637 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7ffa8816a1c0 con 0x7ffa6c066f80 2023-10-09T06:58:24.870 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-10-09T06:58:24.878 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-09T06:58:24.879 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-09T06:58:25.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.061+0000 7fef355ff700 1 Processor -- start 2023-10-09T06:58:25.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.061+0000 7fef355ff700 1 -- start start 2023-10-09T06:58:25.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.063+0000 7fef355ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef300c7a10 0x7fef3006ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:25.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.063+0000 7fef355ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3006e8c0 con 0x7fef30068aa0 2023-10-09T06:58:25.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.063+0000 7fef355ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3006e2d0 con 0x7fef301539d0 2023-10-09T06:58:25.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.063+0000 7fef355ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef30157490 con 0x7fef300c7a10 2023-10-09T06:58:25.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.063+0000 7fef2e7fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fef30068aa0 0x7fef300c7300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47392/0 (socket says 172.21.15.71:47392) 2023-10-09T06:58:25.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.063+0000 7fef2e7fc700 1 -- 172.21.15.71:0/4025569380 learned_addr learned my addr 172.21.15.71:0/4025569380 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:25.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.063+0000 7fef2f7fe700 1 --2- 172.21.15.71:0/4025569380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef300c7a10 0x7fef3006ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.063+0000 7fef2dffb700 1 -- 172.21.15.71:0/4025569380 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363493418 0 0) 0x7fef3006e8c0 con 0x7fef30068aa0 2023-10-09T06:58:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.063+0000 7fef2dffb700 1 -- 172.21.15.71:0/4025569380 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef18003570 con 0x7fef30068aa0 2023-10-09T06:58:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.064+0000 7fef2dffb700 1 -- 172.21.15.71:0/4025569380 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2695708794 0 0) 0x7fef3006e2d0 con 0x7fef301539d0 2023-10-09T06:58:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.064+0000 7fef2dffb700 1 -- 172.21.15.71:0/4025569380 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef3006e8c0 con 0x7fef301539d0 2023-10-09T06:58:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.064+0000 7fef2f7fe700 1 -- 172.21.15.71:0/4025569380 >> v1:172.21.15.179:6789/0 conn(0x7fef301539d0 legacy=0x7fef30068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.064+0000 7fef2f7fe700 1 -- 172.21.15.71:0/4025569380 >> v1:172.21.15.71:6789/0 conn(0x7fef30068aa0 legacy=0x7fef300c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.064+0000 7fef2f7fe700 1 -- 172.21.15.71:0/4025569380 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef300c7f80 con 0x7fef300c7a10 2023-10-09T06:58:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.064+0000 7fef2f7fe700 1 --2- 172.21.15.71:0/4025569380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef300c7a10 0x7fef3006ed50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fef2800afa0 tx=0x7fef2800a890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4971df0080090994 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.064+0000 7fef2dffb700 1 -- 172.21.15.71:0/4025569380 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2800f070 con 0x7fef300c7a10 2023-10-09T06:58:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.064+0000 7fef2dffb700 1 -- 172.21.15.71:0/4025569380 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2800a2e0 con 0x7fef300c7a10 2023-10-09T06:58:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.064+0000 7fef2dffb700 1 -- 172.21.15.71:0/4025569380 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2800cbf0 con 0x7fef300c7a10 2023-10-09T06:58:25.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.065+0000 7fef355ff700 1 -- 172.21.15.71:0/4025569380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef300c7a10 msgr2=0x7fef3006ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:25.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.065+0000 7fef355ff700 1 --2- 172.21.15.71:0/4025569380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef300c7a10 0x7fef3006ed50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fef2800afa0 tx=0x7fef2800a890 comp rx=0 tx=0).stop 2023-10-09T06:58:25.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.065+0000 7fef355ff700 1 -- 172.21.15.71:0/4025569380 shutdown_connections 2023-10-09T06:58:25.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.065+0000 7fef355ff700 1 --2- 172.21.15.71:0/4025569380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef300c7a10 0x7fef3006ed50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:25.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.065+0000 7fef355ff700 1 -- 172.21.15.71:0/4025569380 >> 172.21.15.71:0/4025569380 conn(0x7fef3006a360 msgr2=0x7fef300cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:25.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.065+0000 7fef355ff700 1 -- 172.21.15.71:0/4025569380 shutdown_connections 2023-10-09T06:58:25.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.065+0000 7fef355ff700 1 -- 172.21.15.71:0/4025569380 wait complete. 2023-10-09T06:58:25.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.066+0000 7fef355ff700 1 Processor -- start 2023-10-09T06:58:25.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.066+0000 7fef355ff700 1 -- start start 2023-10-09T06:58:25.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.067+0000 7fef355ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef30068aa0 0x7fef30155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:25.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.067+0000 7fef355ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef300c7a10 0x7fef3016d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:25.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.067+0000 7fef355ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef301539d0 0x7fef301526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:25.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.067+0000 7fef355ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3016db10 con 0x7fef30068aa0 2023-10-09T06:58:25.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.067+0000 7fef355ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef30152bf0 con 0x7fef300c7a10 2023-10-09T06:58:25.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.067+0000 7fef355ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3016a060 con 0x7fef301539d0 2023-10-09T06:58:25.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.068+0000 7fef2effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef30068aa0 0x7fef30155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:25.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.068+0000 7fef2e7fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef300c7a10 0x7fef3016d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:25.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.068+0000 7fef2effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef30068aa0 0x7fef30155380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53474/0 (socket says 172.21.15.71:53474) 2023-10-09T06:58:25.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.068+0000 7fef2effd700 1 -- 172.21.15.71:0/271751560 learned_addr learned my addr 172.21.15.71:0/271751560 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:25.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.068+0000 7fef2f7fe700 1 --2- 172.21.15.71:0/271751560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef301539d0 0x7fef301526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:25.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.068+0000 7fef2effd700 1 -- 172.21.15.71:0/271751560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef301539d0 msgr2=0x7fef301526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:25.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.068+0000 7fef2effd700 1 --2- 172.21.15.71:0/271751560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef301539d0 0x7fef301526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:25.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.068+0000 7fef2effd700 1 -- 172.21.15.71:0/271751560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef300c7a10 msgr2=0x7fef3016d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:25.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.068+0000 7fef2effd700 1 --2- 172.21.15.71:0/271751560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef300c7a10 0x7fef3016d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:25.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.068+0000 7fef2effd700 1 -- 172.21.15.71:0/271751560 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2800ab30 con 0x7fef30068aa0 2023-10-09T06:58:25.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.068+0000 7fef2effd700 1 --2- 172.21.15.71:0/271751560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef30068aa0 0x7fef30155380 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fef2000c560 tx=0x7fef20007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:25.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.068+0000 7fef16ffd700 1 -- 172.21.15.71:0/271751560 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef20010510 con 0x7fef30068aa0 2023-10-09T06:58:25.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.069+0000 7fef16ffd700 1 -- 172.21.15.71:0/271751560 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef20010670 con 0x7fef30068aa0 2023-10-09T06:58:25.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.069+0000 7fef16ffd700 1 -- 172.21.15.71:0/271751560 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef20010a30 con 0x7fef30068aa0 2023-10-09T06:58:25.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.069+0000 7fef355ff700 1 -- 172.21.15.71:0/271751560 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef3016dd40 con 0x7fef30068aa0 2023-10-09T06:58:25.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.069+0000 7fef355ff700 1 -- 172.21.15.71:0/271751560 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3016e300 con 0x7fef30068aa0 2023-10-09T06:58:25.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.070+0000 7fef355ff700 1 -- 172.21.15.71:0/271751560 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef30156b60 con 0x7fef30068aa0 2023-10-09T06:58:25.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.070+0000 7fef16ffd700 1 -- 172.21.15.71:0/271751560 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 36) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fef2001b400 con 0x7fef30068aa0 2023-10-09T06:58:25.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.071+0000 7fef16ffd700 1 --2- 172.21.15.71:0/271751560 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fef1c066dd0 0x7fef1c069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.072+0000 7fef16ffd700 1 -- 172.21.15.71:0/271751560 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fef20084180 con 0x7fef30068aa0 2023-10-09T06:58:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.072+0000 7fef2e7fc700 1 --2- 172.21.15.71:0/271751560 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fef1c066dd0 0x7fef1c069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.072+0000 7fef2e7fc700 1 --2- 172.21.15.71:0/271751560 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fef1c066dd0 0x7fef1c069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fef24007fd0 tx=0x7fef24009040 comp rx=0 tx=0).ready entity=mgr.6637 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.076+0000 7fef16ffd700 1 -- 172.21.15.71:0/271751560 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef20051340 con 0x7fef30068aa0 2023-10-09T06:58:25.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.320+0000 7fef355ff700 1 -- 172.21.15.71:0/271751560 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fef3016e4f0 con 0x7fef30068aa0 2023-10-09T06:58:25.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.856+0000 7fef16ffd700 1 -- 172.21.15.71:0/271751560 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 37) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fef20051710 con 0x7fef30068aa0 2023-10-09T06:58:25.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.857+0000 7fef16ffd700 1 -- 172.21.15.71:0/271751560 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v37) v1 ==== 93+0+0 (secure 0 0 0) 0x7fef20054dd0 con 0x7fef30068aa0 2023-10-09T06:58:25.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.860+0000 7fef355ff700 1 -- 172.21.15.71:0/271751560 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fef1c066dd0 msgr2=0x7fef1c069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:25.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.860+0000 7fef355ff700 1 --2- 172.21.15.71:0/271751560 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fef1c066dd0 0x7fef1c069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fef24007fd0 tx=0x7fef24009040 comp rx=0 tx=0).stop 2023-10-09T06:58:25.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.860+0000 7fef355ff700 1 -- 172.21.15.71:0/271751560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef30068aa0 msgr2=0x7fef30155380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:25.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.860+0000 7fef355ff700 1 --2- 172.21.15.71:0/271751560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef30068aa0 0x7fef30155380 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fef2000c560 tx=0x7fef20007dc0 comp rx=0 tx=0).stop 2023-10-09T06:58:25.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.860+0000 7fef355ff700 1 -- 172.21.15.71:0/271751560 shutdown_connections 2023-10-09T06:58:25.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.860+0000 7fef355ff700 1 --2- 172.21.15.71:0/271751560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef301539d0 0x7fef301526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:25.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.860+0000 7fef355ff700 1 --2- 172.21.15.71:0/271751560 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fef1c066dd0 0x7fef1c069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:25.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.860+0000 7fef355ff700 1 --2- 172.21.15.71:0/271751560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef30068aa0 0x7fef30155380 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:25.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.860+0000 7fef355ff700 1 --2- 172.21.15.71:0/271751560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef300c7a10 0x7fef3016d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:25.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.860+0000 7fef355ff700 1 -- 172.21.15.71:0/271751560 >> 172.21.15.71:0/271751560 conn(0x7fef3006a360 msgr2=0x7fef30156220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:25.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.860+0000 7fef355ff700 1 -- 172.21.15.71:0/271751560 shutdown_connections 2023-10-09T06:58:25.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:25.860+0000 7fef355ff700 1 -- 172.21.15.71:0/271751560 wait complete. 2023-10-09T06:58:25.932 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:58:25.933 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:58:26.017 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:58:26.097 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:58:26.097 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T06:58:26.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T06:58:26.097 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T06:58:26.175 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T06:58:26.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:58:26.175 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T06:58:26.212 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:58:26.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.439+0000 7f28b5d9d700 1 Processor -- start 2023-10-09T06:58:26.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.439+0000 7f28b5d9d700 1 -- start start 2023-10-09T06:58:26.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.440+0000 7f28b5d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f28b01597f0 0x7f28b00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:26.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.440+0000 7f28b5d9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b00b11d0 con 0x7f28b0159420 2023-10-09T06:58:26.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.440+0000 7f28b5d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b00b14b0 con 0x7f28b015d230 2023-10-09T06:58:26.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.440+0000 7f28b5d9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b00b1790 con 0x7f28b01597f0 2023-10-09T06:58:26.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.441+0000 7f28affff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f28b01597f0 0x7f28b00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:26.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.441+0000 7f28b4d9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f28b0159420 0x7f28b00b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47416/0 (socket says 172.21.15.71:47416) 2023-10-09T06:58:26.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.441+0000 7f28b4d9b700 1 -- 172.21.15.71:0/4103990193 learned_addr learned my addr 172.21.15.71:0/4103990193 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:26.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.441+0000 7f28af7fe700 1 -- 172.21.15.71:0/4103990193 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752192334 0 0) 0x7f28b00b11d0 con 0x7f28b0159420 2023-10-09T06:58:26.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.441+0000 7f28af7fe700 1 -- 172.21.15.71:0/4103990193 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28a0003570 con 0x7f28b0159420 2023-10-09T06:58:26.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.441+0000 7f28affff700 1 -- 172.21.15.71:0/4103990193 >> v1:172.21.15.179:6789/0 conn(0x7f28b015d230 legacy=0x7f28b015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:26.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.441+0000 7f28af7fe700 1 -- 172.21.15.71:0/4103990193 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2825484477 0 0) 0x7f28b00b14b0 con 0x7f28b015d230 2023-10-09T06:58:26.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.441+0000 7f28affff700 1 -- 172.21.15.71:0/4103990193 >> v1:172.21.15.71:6789/0 conn(0x7f28b0159420 legacy=0x7f28b00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:26.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.441+0000 7f28affff700 1 -- 172.21.15.71:0/4103990193 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b00b1a70 con 0x7f28b01597f0 2023-10-09T06:58:26.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.442+0000 7f28affff700 1 --2- 172.21.15.71:0/4103990193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28b01597f0 0x7f28b00b2270 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f289c0098e0 tx=0x7f289c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3064bf898b577de server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:26.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.442+0000 7f28af7fe700 1 -- 172.21.15.71:0/4103990193 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c00b640 con 0x7f28b01597f0 2023-10-09T06:58:26.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.442+0000 7f28af7fe700 1 -- 172.21.15.71:0/4103990193 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289c00b7a0 con 0x7f28b01597f0 2023-10-09T06:58:26.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.442+0000 7f28af7fe700 1 -- 172.21.15.71:0/4103990193 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c00bb40 con 0x7f28b01597f0 2023-10-09T06:58:26.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.442+0000 7f28b5d9d700 1 -- 172.21.15.71:0/4103990193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28b01597f0 msgr2=0x7f28b00b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:26.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.442+0000 7f28b5d9d700 1 --2- 172.21.15.71:0/4103990193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28b01597f0 0x7f28b00b2270 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f289c0098e0 tx=0x7f289c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:26.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.442+0000 7f28b5d9d700 1 -- 172.21.15.71:0/4103990193 shutdown_connections 2023-10-09T06:58:26.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.442+0000 7f28b5d9d700 1 --2- 172.21.15.71:0/4103990193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28b01597f0 0x7f28b00b2270 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:26.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.442+0000 7f28b5d9d700 1 -- 172.21.15.71:0/4103990193 >> 172.21.15.71:0/4103990193 conn(0x7f28b00d0660 msgr2=0x7f28b00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:26.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.443+0000 7f28b5d9d700 1 -- 172.21.15.71:0/4103990193 shutdown_connections 2023-10-09T06:58:26.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.443+0000 7f28b5d9d700 1 -- 172.21.15.71:0/4103990193 wait complete. 2023-10-09T06:58:26.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.444+0000 7f28b5d9d700 1 Processor -- start 2023-10-09T06:58:26.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.444+0000 7f28b5d9d700 1 -- start start 2023-10-09T06:58:26.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.445+0000 7f28b5d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28b0159420 0x7f28b00cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:26.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.445+0000 7f28b5d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28b01597f0 0x7f28b01440c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:26.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.445+0000 7f28b5d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28b015d230 0x7f28b00b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:26.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.445+0000 7f28b5d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b00caf00 con 0x7f28b0159420 2023-10-09T06:58:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.445+0000 7f28b5d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b00cb1e0 con 0x7f28b015d230 2023-10-09T06:58:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.445+0000 7f28b5d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b00cb4c0 con 0x7f28b01597f0 2023-10-09T06:58:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.445+0000 7f28b4d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28b0159420 0x7f28b00cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.445+0000 7f28b4d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28b0159420 0x7f28b00cbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53516/0 (socket says 172.21.15.71:53516) 2023-10-09T06:58:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.445+0000 7f28b4d9b700 1 -- 172.21.15.71:0/3721464112 learned_addr learned my addr 172.21.15.71:0/3721464112 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.445+0000 7f28b559c700 1 --2- 172.21.15.71:0/3721464112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28b015d230 0x7f28b00b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.446+0000 7f28affff700 1 --2- 172.21.15.71:0/3721464112 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28b01597f0 0x7f28b01440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.446+0000 7f28b4d9b700 1 -- 172.21.15.71:0/3721464112 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28b01597f0 msgr2=0x7f28b01440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.446+0000 7f28b4d9b700 1 --2- 172.21.15.71:0/3721464112 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28b01597f0 0x7f28b01440c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.446+0000 7f28b4d9b700 1 -- 172.21.15.71:0/3721464112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28b015d230 msgr2=0x7f28b00b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.446+0000 7f28b4d9b700 1 --2- 172.21.15.71:0/3721464112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28b015d230 0x7f28b00b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.446+0000 7f28b4d9b700 1 -- 172.21.15.71:0/3721464112 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c009420 con 0x7f28b0159420 2023-10-09T06:58:26.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.446+0000 7f28b4d9b700 1 --2- 172.21.15.71:0/3721464112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28b0159420 0x7f28b00cbcc0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f28a40011e0 tx=0x7f28a4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:26.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.446+0000 7f28acff9700 1 -- 172.21.15.71:0/3721464112 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a4005b30 con 0x7f28b0159420 2023-10-09T06:58:26.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.446+0000 7f28acff9700 1 -- 172.21.15.71:0/3721464112 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a4005c90 con 0x7f28b0159420 2023-10-09T06:58:26.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.446+0000 7f28acff9700 1 -- 172.21.15.71:0/3721464112 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a4007300 con 0x7f28b0159420 2023-10-09T06:58:26.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.446+0000 7f28b5d9d700 1 -- 172.21.15.71:0/3721464112 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b00cb7a0 con 0x7f28b0159420 2023-10-09T06:58:26.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.447+0000 7f28b5d9d700 1 -- 172.21.15.71:0/3721464112 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b00cab40 con 0x7f28b0159420 2023-10-09T06:58:26.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.448+0000 7f28b5d9d700 1 -- 172.21.15.71:0/3721464112 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b004c3c0 con 0x7f28b0159420 2023-10-09T06:58:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.448+0000 7f28acff9700 1 -- 172.21.15.71:0/3721464112 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f28a4007670 con 0x7f28b0159420 2023-10-09T06:58:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.449+0000 7f28acff9700 1 --2- 172.21.15.71:0/3721464112 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f28940670e0 0x7f2894069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.449+0000 7f28acff9700 1 -- 172.21.15.71:0/3721464112 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f28a4083ef0 con 0x7f28b0159420 2023-10-09T06:58:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.449+0000 7f28affff700 1 -- 172.21.15.71:0/3721464112 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f28940670e0 msgr2=0x7f2894069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.450+0000 7f28affff700 1 --2- 172.21.15.71:0/3721464112 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f28940670e0 0x7f2894069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:58:26.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.453+0000 7f28acff9700 1 -- 172.21.15.71:0/3721464112 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28a4050c50 con 0x7f28b0159420 2023-10-09T06:58:26.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.651+0000 7f28affff700 1 -- 172.21.15.71:0/3721464112 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f28940670e0 msgr2=0x7f2894069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:26.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.651+0000 7f28affff700 1 --2- 172.21.15.71:0/3721464112 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f28940670e0 0x7f2894069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:58:26.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.697+0000 7f28b5d9d700 1 -- 172.21.15.71:0/3721464112 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28b00cb040 con 0x7f28b0159420 2023-10-09T06:58:26.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.698+0000 7f28acff9700 1 -- 172.21.15.71:0/3721464112 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f28b00cb040 con 0x7f28b0159420 2023-10-09T06:58:26.698 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:26.698 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1982857991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1982857991},{"type":"v1","addr":"172.21.15.179:6836","nonce":1982857991}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6466,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/1002256123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":1002256123},{"type":"v1","addr":"172.21.15.179:6837","nonce":1002256123}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6660,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/3500731262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3500731262},{"type":"v1","addr":"172.21.15.71:6834","nonce":3500731262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:58:03.739223+0000","modified":"2023-10-09T06:58:07.306921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/4146861129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":4146861129},{"type":"v1","addr":"172.21.15.71:6835","nonce":4146861129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T06:58:26.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.700+0000 7f28b5d9d700 1 -- 172.21.15.71:0/3721464112 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f28940670e0 msgr2=0x7f2894069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:58:26.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.700+0000 7f28b5d9d700 1 --2- 172.21.15.71:0/3721464112 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f28940670e0 0x7f2894069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:26.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.700+0000 7f28b5d9d700 1 -- 172.21.15.71:0/3721464112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28b0159420 msgr2=0x7f28b00cbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:26.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.700+0000 7f28b5d9d700 1 --2- 172.21.15.71:0/3721464112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28b0159420 0x7f28b00cbcc0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f28a40011e0 tx=0x7f28a4007df0 comp rx=0 tx=0).stop 2023-10-09T06:58:26.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.700+0000 7f28b5d9d700 1 -- 172.21.15.71:0/3721464112 shutdown_connections 2023-10-09T06:58:26.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.700+0000 7f28b5d9d700 1 --2- 172.21.15.71:0/3721464112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28b015d230 0x7f28b00b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:26.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.700+0000 7f28b5d9d700 1 --2- 172.21.15.71:0/3721464112 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f28940670e0 0x7f2894069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:26.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.700+0000 7f28b5d9d700 1 --2- 172.21.15.71:0/3721464112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28b0159420 0x7f28b00cbcc0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:26.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.700+0000 7f28b5d9d700 1 --2- 172.21.15.71:0/3721464112 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28b01597f0 0x7f28b01440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:26.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.700+0000 7f28b5d9d700 1 -- 172.21.15.71:0/3721464112 >> 172.21.15.71:0/3721464112 conn(0x7f28b00d0660 msgr2=0x7f28b00ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:26.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.701+0000 7f28b5d9d700 1 -- 172.21.15.71:0/3721464112 shutdown_connections 2023-10-09T06:58:26.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.701+0000 7f28b5d9d700 1 -- 172.21.15.71:0/3721464112 wait complete. 2023-10-09T06:58:26.702 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 41 2023-10-09T06:58:26.719 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:58:26.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.909+0000 7f1e1359e700 1 Processor -- start 2023-10-09T06:58:26.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.909+0000 7f1e1359e700 1 -- start start 2023-10-09T06:58:26.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.910+0000 7f1e1359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e141593b0 0x7f1e14159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:26.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.910+0000 7f1e1359e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1e140ceaa0 0x7f1e140b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:26.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.910+0000 7f1e1359e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e140b6570 con 0x7f1e140b1740 2023-10-09T06:58:26.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.910+0000 7f1e1359e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e140cfe20 con 0x7f1e140ceaa0 2023-10-09T06:58:26.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.910+0000 7f1e1359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e140cf210 con 0x7f1e141593b0 2023-10-09T06:58:26.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.911+0000 7f1e11d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1e140ceaa0 0x7f1e140b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:26.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.911+0000 7f1e11d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1e140ceaa0 0x7f1e140b6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53524/0 (socket says 172.21.15.71:53524) 2023-10-09T06:58:26.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.911+0000 7f1e11d9b700 1 -- 172.21.15.71:0/1806387619 learned_addr learned my addr 172.21.15.71:0/1806387619 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:26.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.911+0000 7f1e1259c700 1 --2- 172.21.15.71:0/1806387619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e141593b0 0x7f1e14159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:26.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.911+0000 7f1e11d9b700 1 -- 172.21.15.71:0/1806387619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e141593b0 msgr2=0x7f1e14159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:26.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.911+0000 7f1e1159a700 1 -- 172.21.15.71:0/1806387619 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548181749 0 0) 0x7f1e0c001490 con 0x7f1e140b1740 2023-10-09T06:58:26.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.911+0000 7f1e11d9b700 1 --2- 172.21.15.71:0/1806387619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e141593b0 0x7f1e14159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:26.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.911+0000 7f1e11d9b700 1 -- 172.21.15.71:0/1806387619 >> v1:172.21.15.179:6789/0 conn(0x7f1e140b1740 legacy=0x7f1e1415d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:26.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.911+0000 7f1e11d9b700 1 -- 172.21.15.71:0/1806387619 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e140cf4f0 con 0x7f1e140ceaa0 2023-10-09T06:58:26.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.912+0000 7f1e11d9b700 1 --2- 172.21.15.71:0/1806387619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e140ceaa0 0x7f1e140b6030 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1e080099b0 tx=0x7f1e08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e92ecd5e5b0701 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:26.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.912+0000 7f1e1159a700 1 -- 172.21.15.71:0/1806387619 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e08009ea0 con 0x7f1e140ceaa0 2023-10-09T06:58:26.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.912+0000 7f1e1159a700 1 -- 172.21.15.71:0/1806387619 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0800b860 con 0x7f1e140ceaa0 2023-10-09T06:58:26.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.912+0000 7f1e1159a700 1 -- 172.21.15.71:0/1806387619 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0800bc00 con 0x7f1e140ceaa0 2023-10-09T06:58:26.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.912+0000 7f1e1359e700 1 -- 172.21.15.71:0/1806387619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e140ceaa0 msgr2=0x7f1e140b6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:26.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.912+0000 7f1e1359e700 1 --2- 172.21.15.71:0/1806387619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e140ceaa0 0x7f1e140b6030 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1e080099b0 tx=0x7f1e08009250 comp rx=0 tx=0).stop 2023-10-09T06:58:26.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.913+0000 7f1e1359e700 1 -- 172.21.15.71:0/1806387619 shutdown_connections 2023-10-09T06:58:26.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.913+0000 7f1e1359e700 1 --2- 172.21.15.71:0/1806387619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e141593b0 0x7f1e14159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:26.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.913+0000 7f1e1359e700 1 --2- 172.21.15.71:0/1806387619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e140ceaa0 0x7f1e140b6030 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:26.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.913+0000 7f1e1359e700 1 -- 172.21.15.71:0/1806387619 >> 172.21.15.71:0/1806387619 conn(0x7f1e140d1130 msgr2=0x7f1e140b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:26.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.913+0000 7f1e1359e700 1 -- 172.21.15.71:0/1806387619 shutdown_connections 2023-10-09T06:58:26.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.913+0000 7f1e1359e700 1 -- 172.21.15.71:0/1806387619 wait complete. 2023-10-09T06:58:26.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.914+0000 7f1e1359e700 1 Processor -- start 2023-10-09T06:58:26.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.914+0000 7f1e1359e700 1 -- start start 2023-10-09T06:58:26.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.915+0000 7f1e1359e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e140b1740 0x7f1e141506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:26.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.915+0000 7f1e1359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e140ceaa0 0x7f1e1413b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:26.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.915+0000 7f1e1359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e141593b0 0x7f1e1414ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:26.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.915+0000 7f1e1359e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e14150250 con 0x7f1e140b1740 2023-10-09T06:58:26.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.915+0000 7f1e1359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1414f640 con 0x7f1e140ceaa0 2023-10-09T06:58:26.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.915+0000 7f1e1359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1414f920 con 0x7f1e141593b0 2023-10-09T06:58:26.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.915+0000 7f1e1259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e140b1740 0x7f1e141506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:26.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.915+0000 7f1e1259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e140b1740 0x7f1e141506e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53530/0 (socket says 172.21.15.71:53530) 2023-10-09T06:58:26.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.915+0000 7f1e1259c700 1 -- 172.21.15.71:0/3284649452 learned_addr learned my addr 172.21.15.71:0/3284649452 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:26.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.915+0000 7f1e12d9d700 1 --2- 172.21.15.71:0/3284649452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e141593b0 0x7f1e1414ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:26.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.915+0000 7f1e11d9b700 1 --2- 172.21.15.71:0/3284649452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e140ceaa0 0x7f1e1413b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:26.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.916+0000 7f1e1259c700 1 -- 172.21.15.71:0/3284649452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e141593b0 msgr2=0x7f1e1414ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:26.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.916+0000 7f1e1259c700 1 --2- 172.21.15.71:0/3284649452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e141593b0 0x7f1e1414ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:26.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.916+0000 7f1e1259c700 1 -- 172.21.15.71:0/3284649452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e140ceaa0 msgr2=0x7f1e1413b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:26.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.916+0000 7f1e1259c700 1 --2- 172.21.15.71:0/3284649452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e140ceaa0 0x7f1e1413b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:26.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.916+0000 7f1e1259c700 1 -- 172.21.15.71:0/3284649452 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e080094f0 con 0x7f1e140b1740 2023-10-09T06:58:26.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.916+0000 7f1e1259c700 1 --2- 172.21.15.71:0/3284649452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e140b1740 0x7f1e141506e0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400ec80 tx=0x7f1e040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:26.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.916+0000 7f1e027fc700 1 -- 172.21.15.71:0/3284649452 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e04009690 con 0x7f1e140b1740 2023-10-09T06:58:26.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.917+0000 7f1e027fc700 1 -- 172.21.15.71:0/3284649452 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0400c850 con 0x7f1e140b1740 2023-10-09T06:58:26.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.917+0000 7f1e1359e700 1 -- 172.21.15.71:0/3284649452 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1414fc00 con 0x7f1e140b1740 2023-10-09T06:58:26.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.917+0000 7f1e027fc700 1 -- 172.21.15.71:0/3284649452 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0400cc10 con 0x7f1e140b1740 2023-10-09T06:58:26.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.917+0000 7f1e1359e700 1 -- 172.21.15.71:0/3284649452 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1413bad0 con 0x7f1e140b1740 2023-10-09T06:58:26.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.918+0000 7f1e1359e700 1 -- 172.21.15.71:0/3284649452 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1404c3c0 con 0x7f1e140b1740 2023-10-09T06:58:26.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.919+0000 7f1e027fc700 1 -- 172.21.15.71:0/3284649452 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f1e04013470 con 0x7f1e140b1740 2023-10-09T06:58:26.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.920+0000 7f1e027fc700 1 --2- 172.21.15.71:0/3284649452 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1df40670e0 0x7f1df4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:26.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.921+0000 7f1e027fc700 1 -- 172.21.15.71:0/3284649452 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f1e04084c40 con 0x7f1e140b1740 2023-10-09T06:58:26.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.921+0000 7f1e11d9b700 1 -- 172.21.15.71:0/3284649452 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1df40670e0 msgr2=0x7f1df4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:26.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.921+0000 7f1e11d9b700 1 --2- 172.21.15.71:0/3284649452 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1df40670e0 0x7f1df4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:58:26.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:26.928+0000 7f1e027fc700 1 -- 172.21.15.71:0/3284649452 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e04055430 con 0x7f1e140b1740 2023-10-09T06:58:27.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.122+0000 7f1e11d9b700 1 -- 172.21.15.71:0/3284649452 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1df40670e0 msgr2=0x7f1df4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:27.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.122+0000 7f1e11d9b700 1 --2- 172.21.15.71:0/3284649452 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1df40670e0 0x7f1df4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:58:27.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.124+0000 7f1e1359e700 1 -- 172.21.15.71:0/3284649452 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e140b2510 con 0x7f1e140b1740 2023-10-09T06:58:27.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.125+0000 7f1e027fc700 1 -- 172.21.15.71:0/3284649452 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+16320 (secure 0 0 0) 0x7f1e04054fc0 con 0x7f1e140b1740 2023-10-09T06:58:27.125 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:27.125 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":94,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:58:23.837542+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:58:01.931617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T06:58:02.718563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6833/85452":"2023-10-10T06:58:23.837509+0000","172.21.15.179:0/3414133961":"2023-10-10T06:58:23.837509+0000","172.21.15.179:0/1165861819":"2023-10-10T06:58:23.837509+0000","172.21.15.179:6832/85452":"2023-10-10T06:58:23.837509+0000","172.21.15.179:0/2303709833":"2023-10-10T06:58:23.837509+0000","172.21.15.179:0/4140042527":"2023-10-10T06:58:23.837509+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:58:27.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.128+0000 7f1e1359e700 1 -- 172.21.15.71:0/3284649452 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1df40670e0 msgr2=0x7f1df4069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:58:27.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.128+0000 7f1e1359e700 1 --2- 172.21.15.71:0/3284649452 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1df40670e0 0x7f1df4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:27.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.128+0000 7f1e1359e700 1 -- 172.21.15.71:0/3284649452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e140b1740 msgr2=0x7f1e141506e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:27.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.128+0000 7f1e1359e700 1 --2- 172.21.15.71:0/3284649452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e140b1740 0x7f1e141506e0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400ec80 tx=0x7f1e040091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:27.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.128+0000 7f1e1359e700 1 -- 172.21.15.71:0/3284649452 shutdown_connections 2023-10-09T06:58:27.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.128+0000 7f1e1359e700 1 --2- 172.21.15.71:0/3284649452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e141593b0 0x7f1e1414ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:27.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.128+0000 7f1e1359e700 1 --2- 172.21.15.71:0/3284649452 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1df40670e0 0x7f1df4069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:27.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.128+0000 7f1e1359e700 1 --2- 172.21.15.71:0/3284649452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e140b1740 0x7f1e141506e0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:27.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.128+0000 7f1e1359e700 1 --2- 172.21.15.71:0/3284649452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e140ceaa0 0x7f1e1413b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:27.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.128+0000 7f1e1359e700 1 -- 172.21.15.71:0/3284649452 >> 172.21.15.71:0/3284649452 conn(0x7f1e140d1130 msgr2=0x7f1e140b4540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:27.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.128+0000 7f1e1359e700 1 -- 172.21.15.71:0/3284649452 shutdown_connections 2023-10-09T06:58:27.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.128+0000 7f1e1359e700 1 -- 172.21.15.71:0/3284649452 wait complete. 2023-10-09T06:58:27.147 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:58:01.931617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:58:02.718563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T06:58:27.147 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:58:27.151 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:27.150+0000 7fa17e510180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T06:58:27.178 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:27.178+0000 7fe8b2898180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T06:58:27.316 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:27.315+0000 7fa17e510180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T06:58:27.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.338+0000 7f8e0bfff700 1 Processor -- start 2023-10-09T06:58:27.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.338+0000 7f8e0bfff700 1 -- start start 2023-10-09T06:58:27.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.339+0000 7f8e0bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8e0c0b1b40 0x7f8e0c0b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:27.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.339+0000 7f8e0bfff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e0c0cfb00 con 0x7f8e0c0b16d0 2023-10-09T06:58:27.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.339+0000 7f8e0bfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e0c0b5c40 con 0x7f8e0c0b4e70 2023-10-09T06:58:27.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.339+0000 7f8e0bfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0c0b5f20 con 0x7f8e0c0b1b40 2023-10-09T06:58:27.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.339+0000 7f8e0a7fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8e0c0b16d0 0x7f8e0c0b33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47420/0 (socket says 172.21.15.71:47420) 2023-10-09T06:58:27.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.339+0000 7f8e0a7fc700 1 -- 172.21.15.71:0/1718661080 learned_addr learned my addr 172.21.15.71:0/1718661080 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:27.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.339+0000 7f8e0b7fe700 1 --2- 172.21.15.71:0/1718661080 >> v2:172.21.15.179:3300/0 conn(0x7f8e0c0b1b40 0x7f8e0c0b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:27.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.340+0000 7f8e09ffb700 1 -- 172.21.15.71:0/1718661080 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770248212 0 0) 0x7f8e0c0cfb00 con 0x7f8e0c0b16d0 2023-10-09T06:58:27.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.340+0000 7f8e09ffb700 1 -- 172.21.15.71:0/1718661080 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8df4003570 con 0x7f8e0c0b16d0 2023-10-09T06:58:27.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.340+0000 7f8e09ffb700 1 -- 172.21.15.71:0/1718661080 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920862751 0 0) 0x7f8e0c0b5c40 con 0x7f8e0c0b4e70 2023-10-09T06:58:27.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.340+0000 7f8e09ffb700 1 -- 172.21.15.71:0/1718661080 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e0c0cfb00 con 0x7f8e0c0b4e70 2023-10-09T06:58:27.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.340+0000 7f8e0b7fe700 1 -- 172.21.15.71:0/1718661080 >> v1:172.21.15.179:6789/0 conn(0x7f8e0c0b4e70 legacy=0x7f8e0c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:27.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.340+0000 7f8e0b7fe700 1 -- 172.21.15.71:0/1718661080 >> v1:172.21.15.71:6789/0 conn(0x7f8e0c0b16d0 legacy=0x7f8e0c0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:27.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.340+0000 7f8e0b7fe700 1 -- 172.21.15.71:0/1718661080 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0c0b6200 con 0x7f8e0c0b1b40 2023-10-09T06:58:27.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.340+0000 7f8e0b7fe700 1 --2- 172.21.15.71:0/1718661080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e0c0b1b40 0x7f8e0c0b3ac0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8e04009e60 tx=0x7f8e04009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa452e0a9e916a61 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:27.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.341+0000 7f8e09ffb700 1 -- 172.21.15.71:0/1718661080 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0400e070 con 0x7f8e0c0b1b40 2023-10-09T06:58:27.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.341+0000 7f8e09ffb700 1 -- 172.21.15.71:0/1718661080 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0400bab0 con 0x7f8e0c0b1b40 2023-10-09T06:58:27.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.341+0000 7f8e09ffb700 1 -- 172.21.15.71:0/1718661080 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0400be50 con 0x7f8e0c0b1b40 2023-10-09T06:58:27.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.341+0000 7f8e0bfff700 1 -- 172.21.15.71:0/1718661080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e0c0b1b40 msgr2=0x7f8e0c0b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:27.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.341+0000 7f8e0bfff700 1 --2- 172.21.15.71:0/1718661080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e0c0b1b40 0x7f8e0c0b3ac0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8e04009e60 tx=0x7f8e04009780 comp rx=0 tx=0).stop 2023-10-09T06:58:27.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.341+0000 7f8e0bfff700 1 -- 172.21.15.71:0/1718661080 shutdown_connections 2023-10-09T06:58:27.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.341+0000 7f8e0bfff700 1 --2- 172.21.15.71:0/1718661080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e0c0b1b40 0x7f8e0c0b3ac0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:27.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.341+0000 7f8e0bfff700 1 -- 172.21.15.71:0/1718661080 >> 172.21.15.71:0/1718661080 conn(0x7f8e0c0d10c0 msgr2=0x7f8e0c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:27.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.341+0000 7f8e0bfff700 1 -- 172.21.15.71:0/1718661080 shutdown_connections 2023-10-09T06:58:27.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.341+0000 7f8e0bfff700 1 -- 172.21.15.71:0/1718661080 wait complete. 2023-10-09T06:58:27.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.343+0000 7f8e0bfff700 1 Processor -- start 2023-10-09T06:58:27.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.343+0000 7f8e0bfff700 1 -- start start 2023-10-09T06:58:27.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.344+0000 7f8e0bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e0c0b16d0 0x7f8e0c0cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:27.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.344+0000 7f8e0bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e0c0b1b40 0x7f8e0c0b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:27.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.344+0000 7f8e0bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e0c0b4e70 0x7f8e0c0b5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:27.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.344+0000 7f8e0bfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c0c87c0 con 0x7f8e0c0b4e70 2023-10-09T06:58:27.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.344+0000 7f8e0bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c0c7bb0 con 0x7f8e0c0b1b40 2023-10-09T06:58:27.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.344+0000 7f8e0bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c0c7e90 con 0x7f8e0c0b16d0 2023-10-09T06:58:27.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.344+0000 7f8e0b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e0c0b4e70 0x7f8e0c0b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:27.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.344+0000 7f8e0a7fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e0c0b1b40 0x7f8e0c0b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:27.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.344+0000 7f8e0b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e0c0b4e70 0x7f8e0c0b5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53536/0 (socket says 172.21.15.71:53536) 2023-10-09T06:58:27.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.344+0000 7f8e0b7fe700 1 -- 172.21.15.71:0/3820320909 learned_addr learned my addr 172.21.15.71:0/3820320909 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:27.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.344+0000 7f8e0affd700 1 --2- 172.21.15.71:0/3820320909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e0c0b16d0 0x7f8e0c0cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:27.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.345+0000 7f8e0b7fe700 1 -- 172.21.15.71:0/3820320909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e0c0b16d0 msgr2=0x7f8e0c0cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:27.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.345+0000 7f8e0b7fe700 1 --2- 172.21.15.71:0/3820320909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e0c0b16d0 0x7f8e0c0cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:27.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.345+0000 7f8e0b7fe700 1 -- 172.21.15.71:0/3820320909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e0c0b1b40 msgr2=0x7f8e0c0b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:27.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.345+0000 7f8e0b7fe700 1 --2- 172.21.15.71:0/3820320909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e0c0b1b40 0x7f8e0c0b5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:27.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.345+0000 7f8e0b7fe700 1 -- 172.21.15.71:0/3820320909 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e04009a20 con 0x7f8e0c0b4e70 2023-10-09T06:58:27.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.345+0000 7f8e0a7fc700 1 --2- 172.21.15.71:0/3820320909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e0c0b1b40 0x7f8e0c0b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:58:27.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.345+0000 7f8e0b7fe700 1 --2- 172.21.15.71:0/3820320909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e0c0b4e70 0x7f8e0c0b5780 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c070dd0 tx=0x7f8e04019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:27.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.345+0000 7f8df2ffd700 1 -- 172.21.15.71:0/3820320909 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e04007080 con 0x7f8e0c0b4e70 2023-10-09T06:58:27.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.345+0000 7f8df2ffd700 1 -- 172.21.15.71:0/3820320909 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e04012d00 con 0x7f8e0c0b4e70 2023-10-09T06:58:27.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.345+0000 7f8e0bfff700 1 -- 172.21.15.71:0/3820320909 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e0c0c8170 con 0x7f8e0c0b4e70 2023-10-09T06:58:27.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.345+0000 7f8df2ffd700 1 -- 172.21.15.71:0/3820320909 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e04026660 con 0x7f8e0c0b4e70 2023-10-09T06:58:27.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.345+0000 7f8e0bfff700 1 -- 172.21.15.71:0/3820320909 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e0c069db0 con 0x7f8e0c0b4e70 2023-10-09T06:58:27.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.347+0000 7f8e0bfff700 1 -- 172.21.15.71:0/3820320909 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e0c0c7900 con 0x7f8e0c0b4e70 2023-10-09T06:58:27.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.348+0000 7f8df2ffd700 1 -- 172.21.15.71:0/3820320909 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f8e04026a50 con 0x7f8e0c0b4e70 2023-10-09T06:58:27.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.349+0000 7f8df2ffd700 1 --2- 172.21.15.71:0/3820320909 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8df80670e0 0x7f8df8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:27.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.349+0000 7f8df2ffd700 1 -- 172.21.15.71:0/3820320909 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f8e04086a90 con 0x7f8e0c0b4e70 2023-10-09T06:58:27.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.349+0000 7f8e0affd700 1 -- 172.21.15.71:0/3820320909 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8df80670e0 msgr2=0x7f8df8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:27.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.349+0000 7f8e0affd700 1 --2- 172.21.15.71:0/3820320909 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8df80670e0 0x7f8df8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:58:27.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.353+0000 7f8df2ffd700 1 -- 172.21.15.71:0/3820320909 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e040536e0 con 0x7f8e0c0b4e70 2023-10-09T06:58:27.353 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:27.353+0000 7fe8b2898180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T06:58:27.404 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:27.403+0000 7fa17e510180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T06:58:27.442 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:27.443+0000 7fe8b2898180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T06:58:27.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.550+0000 7f8e0affd700 1 -- 172.21.15.71:0/3820320909 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8df80670e0 msgr2=0x7f8df8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:27.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.550+0000 7f8e0affd700 1 --2- 172.21.15.71:0/3820320909 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8df80670e0 0x7f8df8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:58:27.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.553+0000 7f8e0bfff700 1 -- 172.21.15.71:0/3820320909 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8e0c04bb80 con 0x7f8e0c0b4e70 2023-10-09T06:58:27.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.554+0000 7f8df2ffd700 1 -- 172.21.15.71:0/3820320909 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8e04056d00 con 0x7f8e0c0b4e70 2023-10-09T06:58:27.553 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T06:58:27.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.556+0000 7f8e0bfff700 1 -- 172.21.15.71:0/3820320909 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8df80670e0 msgr2=0x7f8df8069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:58:27.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.556+0000 7f8e0bfff700 1 --2- 172.21.15.71:0/3820320909 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8df80670e0 0x7f8df8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:27.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.556+0000 7f8e0bfff700 1 -- 172.21.15.71:0/3820320909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e0c0b4e70 msgr2=0x7f8e0c0b5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:27.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.556+0000 7f8e0bfff700 1 --2- 172.21.15.71:0/3820320909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e0c0b4e70 0x7f8e0c0b5780 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c070dd0 tx=0x7f8e04019000 comp rx=0 tx=0).stop 2023-10-09T06:58:27.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.556+0000 7f8e0bfff700 1 -- 172.21.15.71:0/3820320909 shutdown_connections 2023-10-09T06:58:27.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.556+0000 7f8e0bfff700 1 --2- 172.21.15.71:0/3820320909 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8df80670e0 0x7f8df8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:27.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.556+0000 7f8e0bfff700 1 --2- 172.21.15.71:0/3820320909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e0c0b4e70 0x7f8e0c0b5780 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:27.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.556+0000 7f8e0bfff700 1 --2- 172.21.15.71:0/3820320909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e0c0b16d0 0x7f8e0c0cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:27.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.556+0000 7f8e0bfff700 1 --2- 172.21.15.71:0/3820320909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e0c0b1b40 0x7f8e0c0b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:27.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.556+0000 7f8e0bfff700 1 -- 172.21.15.71:0/3820320909 >> 172.21.15.71:0/3820320909 conn(0x7f8e0c0d10c0 msgr2=0x7f8e0c0ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:27.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.556+0000 7f8e0bfff700 1 -- 172.21.15.71:0/3820320909 shutdown_connections 2023-10-09T06:58:27.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.556+0000 7f8e0bfff700 1 -- 172.21.15.71:0/3820320909 wait complete. 2023-10-09T06:58:27.574 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T06:58:27.633 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:27.629+0000 7fa17e510180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:58:27.675 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:27.675+0000 7fe8b2898180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:58:27.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.806+0000 7f260d39d700 1 Processor -- start 2023-10-09T06:58:27.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.806+0000 7f260d39d700 1 -- start start 2023-10-09T06:58:27.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.807+0000 7f260d39d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f26080b4e70 0x7f26080ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:27.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.807+0000 7f260d39d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26080cfb00 con 0x7f26080b1b40 2023-10-09T06:58:27.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.807+0000 7f260d39d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260815e060 con 0x7f26080b16d0 2023-10-09T06:58:27.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.807+0000 7f260d39d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26080b5c40 con 0x7f26080b4e70 2023-10-09T06:58:27.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.807+0000 7f2607fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f26080b4e70 0x7f26080ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:27.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.807+0000 7f260cb9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f26080b1b40 0x7f260815d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47432/0 (socket says 172.21.15.71:47432) 2023-10-09T06:58:27.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.807+0000 7f260cb9c700 1 -- 172.21.15.71:0/1117563426 learned_addr learned my addr 172.21.15.71:0/1117563426 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:27.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.808+0000 7f2606ffd700 1 -- 172.21.15.71:0/1117563426 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2897128544 0 0) 0x7f26080cfb00 con 0x7f26080b1b40 2023-10-09T06:58:27.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.808+0000 7f2607fff700 1 -- 172.21.15.71:0/1117563426 >> v1:172.21.15.179:6789/0 conn(0x7f26080b16d0 legacy=0x7f260815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:27.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.808+0000 7f2607fff700 1 -- 172.21.15.71:0/1117563426 >> v1:172.21.15.71:6789/0 conn(0x7f26080b1b40 legacy=0x7f260815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:27.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.808+0000 7f2607fff700 1 -- 172.21.15.71:0/1117563426 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26080b5f20 con 0x7f26080b4e70 2023-10-09T06:58:27.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.808+0000 7f2607fff700 1 --2- 172.21.15.71:0/1117563426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26080b4e70 0x7f26080ccff0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f25f8009860 tx=0x7f25f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a64e8e6a45f36c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:27.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.808+0000 7f2606ffd700 1 -- 172.21.15.71:0/1117563426 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f8011630 con 0x7f26080b4e70 2023-10-09T06:58:27.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.808+0000 7f2606ffd700 1 -- 172.21.15.71:0/1117563426 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f8011790 con 0x7f26080b4e70 2023-10-09T06:58:27.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.808+0000 7f2606ffd700 1 -- 172.21.15.71:0/1117563426 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f8011b50 con 0x7f26080b4e70 2023-10-09T06:58:27.812 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:27.809+0000 7fa17e510180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T06:58:27.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.809+0000 7f260d39d700 1 -- 172.21.15.71:0/1117563426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26080b4e70 msgr2=0x7f26080ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:27.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.809+0000 7f260d39d700 1 --2- 172.21.15.71:0/1117563426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26080b4e70 0x7f26080ccff0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f25f8009860 tx=0x7f25f80091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:27.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.809+0000 7f260d39d700 1 -- 172.21.15.71:0/1117563426 shutdown_connections 2023-10-09T06:58:27.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.809+0000 7f260d39d700 1 --2- 172.21.15.71:0/1117563426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26080b4e70 0x7f26080ccff0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:27.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.809+0000 7f260d39d700 1 -- 172.21.15.71:0/1117563426 >> 172.21.15.71:0/1117563426 conn(0x7f26080d10c0 msgr2=0x7f26080affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:27.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.809+0000 7f260d39d700 1 -- 172.21.15.71:0/1117563426 shutdown_connections 2023-10-09T06:58:27.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.809+0000 7f260d39d700 1 -- 172.21.15.71:0/1117563426 wait complete. 2023-10-09T06:58:27.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.810+0000 7f260d39d700 1 Processor -- start 2023-10-09T06:58:27.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.811+0000 7f260d39d700 1 -- start start 2023-10-09T06:58:27.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.811+0000 7f260d39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26080b16d0 0x7f260816d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:27.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.811+0000 7f260d39d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26080b1b40 0x7f260816d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:27.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.811+0000 7f260d39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26080b4e70 0x7f2608169e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:27.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.811+0000 7f260d39d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260816b020 con 0x7f26080b1b40 2023-10-09T06:58:27.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.811+0000 7f260d39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260816bba0 con 0x7f26080b16d0 2023-10-09T06:58:27.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.811+0000 7f260d39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260816b270 con 0x7f26080b4e70 2023-10-09T06:58:27.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.812+0000 7f2607fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26080b16d0 0x7f260816d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:27.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.812+0000 7f26077fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26080b1b40 0x7f260816d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:27.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.812+0000 7f2607fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26080b16d0 0x7f260816d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:48706/0 (socket says 172.21.15.71:48706) 2023-10-09T06:58:27.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.812+0000 7f2607fff700 1 -- 172.21.15.71:0/2142417019 learned_addr learned my addr 172.21.15.71:0/2142417019 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:27.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.812+0000 7f260cb9c700 1 --2- 172.21.15.71:0/2142417019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26080b4e70 0x7f2608169e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:27.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.812+0000 7f26077fe700 1 -- 172.21.15.71:0/2142417019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26080b4e70 msgr2=0x7f2608169e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:27.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.812+0000 7f26077fe700 1 --2- 172.21.15.71:0/2142417019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26080b4e70 0x7f2608169e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:27.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.812+0000 7f26077fe700 1 -- 172.21.15.71:0/2142417019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26080b16d0 msgr2=0x7f260816d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:27.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.812+0000 7f26077fe700 1 --2- 172.21.15.71:0/2142417019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26080b16d0 0x7f260816d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:27.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.812+0000 7f26077fe700 1 -- 172.21.15.71:0/2142417019 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f8009420 con 0x7f26080b1b40 2023-10-09T06:58:27.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.812+0000 7f2607fff700 1 --2- 172.21.15.71:0/2142417019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26080b16d0 0x7f260816d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:58:27.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.813+0000 7f26077fe700 1 --2- 172.21.15.71:0/2142417019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26080b1b40 0x7f260816d990 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00c810 tx=0x7f25fc007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:27.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.813+0000 7f25effff700 1 -- 172.21.15.71:0/2142417019 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc011590 con 0x7f26080b1b40 2023-10-09T06:58:27.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.813+0000 7f25effff700 1 -- 172.21.15.71:0/2142417019 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25fc0116f0 con 0x7f26080b1b40 2023-10-09T06:58:27.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.813+0000 7f260d39d700 1 -- 172.21.15.71:0/2142417019 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f260816b550 con 0x7f26080b1b40 2023-10-09T06:58:27.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.813+0000 7f25effff700 1 -- 172.21.15.71:0/2142417019 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc011ab0 con 0x7f26080b1b40 2023-10-09T06:58:27.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.813+0000 7f260d39d700 1 -- 172.21.15.71:0/2142417019 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26080af280 con 0x7f26080b1b40 2023-10-09T06:58:27.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.814+0000 7f260d39d700 1 -- 172.21.15.71:0/2142417019 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26080c8c20 con 0x7f26080b1b40 2023-10-09T06:58:27.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.815+0000 7f25effff700 1 -- 172.21.15.71:0/2142417019 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f25fc01b3b0 con 0x7f26080b1b40 2023-10-09T06:58:27.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.816+0000 7f25effff700 1 --2- 172.21.15.71:0/2142417019 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f25f40670e0 0x7f25f4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:27.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.816+0000 7f25effff700 1 -- 172.21.15.71:0/2142417019 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f25fc083f80 con 0x7f26080b1b40 2023-10-09T06:58:27.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.816+0000 7f2607fff700 1 -- 172.21.15.71:0/2142417019 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f25f40670e0 msgr2=0x7f25f4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:27.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.817+0000 7f2607fff700 1 --2- 172.21.15.71:0/2142417019 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f25f40670e0 0x7f25f4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:58:27.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:27.820+0000 7f25effff700 1 -- 172.21.15.71:0/2142417019 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25fc050ce0 con 0x7f26080b1b40 2023-10-09T06:58:27.864 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:27.864+0000 7fe8b2898180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T06:58:27.907 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:27.904+0000 7fa17e510180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T06:58:27.959 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:27.959+0000 7fe8b2898180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T06:58:28.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.018+0000 7f2607fff700 1 -- 172.21.15.71:0/2142417019 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f25f40670e0 msgr2=0x7f25f4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:28.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.018+0000 7f2607fff700 1 --2- 172.21.15.71:0/2142417019 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f25f40670e0 0x7f25f4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:58:28.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.020+0000 7f260d39d700 1 -- 172.21.15.71:0/2142417019 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f260816bce0 con 0x7f26080b1b40 2023-10-09T06:58:28.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.020+0000 7f25effff700 1 -- 172.21.15.71:0/2142417019 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f25fc017020 con 0x7f26080b1b40 2023-10-09T06:58:28.020 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-09T06:58:28.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.023+0000 7f260d39d700 1 -- 172.21.15.71:0/2142417019 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f25f40670e0 msgr2=0x7f25f4069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:58:28.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.023+0000 7f260d39d700 1 --2- 172.21.15.71:0/2142417019 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f25f40670e0 0x7f25f4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:28.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.023+0000 7f260d39d700 1 -- 172.21.15.71:0/2142417019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26080b1b40 msgr2=0x7f260816d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:28.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.023+0000 7f260d39d700 1 --2- 172.21.15.71:0/2142417019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26080b1b40 0x7f260816d990 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00c810 tx=0x7f25fc007ea0 comp rx=0 tx=0).stop 2023-10-09T06:58:28.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.023+0000 7f260d39d700 1 -- 172.21.15.71:0/2142417019 shutdown_connections 2023-10-09T06:58:28.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.023+0000 7f260d39d700 1 --2- 172.21.15.71:0/2142417019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26080b4e70 0x7f2608169e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:28.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.023+0000 7f260d39d700 1 --2- 172.21.15.71:0/2142417019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26080b16d0 0x7f260816d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:28.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.023+0000 7f260d39d700 1 --2- 172.21.15.71:0/2142417019 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f25f40670e0 0x7f25f4069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:28.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.023+0000 7f260d39d700 1 --2- 172.21.15.71:0/2142417019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26080b1b40 0x7f260816d990 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:28.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.023+0000 7f260d39d700 1 -- 172.21.15.71:0/2142417019 >> 172.21.15.71:0/2142417019 conn(0x7f26080d10c0 msgr2=0x7f26080b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:28.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.023+0000 7f260d39d700 1 -- 172.21.15.71:0/2142417019 shutdown_connections 2023-10-09T06:58:28.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.023+0000 7f260d39d700 1 -- 172.21.15.71:0/2142417019 wait complete. 2023-10-09T06:58:28.043 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T06:58:28.069 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:28.067+0000 7fa17e510180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T06:58:28.129 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:28.129+0000 7fe8b2898180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T06:58:28.169 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:28.168+0000 7fa17e510180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T06:58:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.232+0000 7fd455f9d700 1 Processor -- start 2023-10-09T06:58:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.232+0000 7fd455f9d700 1 -- start start 2023-10-09T06:58:28.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.233+0000 7fd455f9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd4500aac80 0x7fd4500ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:28.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.234+0000 7fd455f9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4500c89a0 con 0x7fd450159a10 2023-10-09T06:58:28.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.234+0000 7fd455f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4500c7510 con 0x7fd450159de0 2023-10-09T06:58:28.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.234+0000 7fd455f9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4500caee0 con 0x7fd4500aac80 2023-10-09T06:58:28.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.234+0000 7fd454f9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd450159a10 0x7fd4500c81e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47448/0 (socket says 172.21.15.71:47448) 2023-10-09T06:58:28.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.234+0000 7fd454f9b700 1 -- 172.21.15.71:0/4110566731 learned_addr learned my addr 172.21.15.71:0/4110566731 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:28.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.234+0000 7fd44ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd4500aac80 0x7fd4500ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.234+0000 7fd44ffff700 1 -- 172.21.15.71:0/4110566731 >> v1:172.21.15.179:6789/0 conn(0x7fd450159de0 legacy=0x7fd45015a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.234+0000 7fd44ffff700 1 -- 172.21.15.71:0/4110566731 >> v1:172.21.15.71:6789/0 conn(0x7fd450159a10 legacy=0x7fd4500c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.234+0000 7fd44f7fe700 1 -- 172.21.15.71:0/4110566731 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1118573578 0 0) 0x7fd4500c89a0 con 0x7fd450159a10 2023-10-09T06:58:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.234+0000 7fd44ffff700 1 -- 172.21.15.71:0/4110566731 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4500c77f0 con 0x7fd4500aac80 2023-10-09T06:58:28.235 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:28.235+0000 7fe8b2898180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T06:58:28.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.235+0000 7fd44ffff700 1 --2- 172.21.15.71:0/4110566731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4500aac80 0x7fd4500ca9a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0098e0 tx=0x7fd43c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb88ddb2df061002 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:28.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.235+0000 7fd44f7fe700 1 -- 172.21.15.71:0/4110566731 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c009e80 con 0x7fd4500aac80 2023-10-09T06:58:28.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.235+0000 7fd44f7fe700 1 -- 172.21.15.71:0/4110566731 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43c00b860 con 0x7fd4500aac80 2023-10-09T06:58:28.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.235+0000 7fd44f7fe700 1 -- 172.21.15.71:0/4110566731 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c00bbe0 con 0x7fd4500aac80 2023-10-09T06:58:28.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.235+0000 7fd455f9d700 1 -- 172.21.15.71:0/4110566731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4500aac80 msgr2=0x7fd4500ca9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:28.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.235+0000 7fd455f9d700 1 --2- 172.21.15.71:0/4110566731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4500aac80 0x7fd4500ca9a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0098e0 tx=0x7fd43c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:28.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.235+0000 7fd455f9d700 1 -- 172.21.15.71:0/4110566731 shutdown_connections 2023-10-09T06:58:28.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.235+0000 7fd455f9d700 1 --2- 172.21.15.71:0/4110566731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4500aac80 0x7fd4500ca9a0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:28.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.235+0000 7fd455f9d700 1 -- 172.21.15.71:0/4110566731 >> 172.21.15.71:0/4110566731 conn(0x7fd4500cc1e0 msgr2=0x7fd4500cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:28.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.236+0000 7fd455f9d700 1 -- 172.21.15.71:0/4110566731 shutdown_connections 2023-10-09T06:58:28.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.236+0000 7fd455f9d700 1 -- 172.21.15.71:0/4110566731 wait complete. 2023-10-09T06:58:28.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.237+0000 7fd455f9d700 1 Processor -- start 2023-10-09T06:58:28.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.237+0000 7fd455f9d700 1 -- start start 2023-10-09T06:58:28.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.238+0000 7fd455f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4500aac80 0x7fd450150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:28.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.238+0000 7fd455f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd450159a10 0x7fd4500c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:28.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.238+0000 7fd455f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd450159de0 0x7fd4500c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:28.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.238+0000 7fd455f9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd450169fb0 con 0x7fd450159a10 2023-10-09T06:58:28.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.238+0000 7fd455f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45016a230 con 0x7fd4500aac80 2023-10-09T06:58:28.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.238+0000 7fd455f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45016a510 con 0x7fd450159de0 2023-10-09T06:58:28.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.238+0000 7fd44ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd450159a10 0x7fd4500c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:28.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.238+0000 7fd44ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd450159a10 0x7fd4500c48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53564/0 (socket says 172.21.15.71:53564) 2023-10-09T06:58:28.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.238+0000 7fd44ffff700 1 -- 172.21.15.71:0/734809600 learned_addr learned my addr 172.21.15.71:0/734809600 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:28.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.238+0000 7fd454f9b700 1 --2- 172.21.15.71:0/734809600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4500aac80 0x7fd450150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:28.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.238+0000 7fd45579c700 1 --2- 172.21.15.71:0/734809600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd450159de0 0x7fd4500c4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:28.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.239+0000 7fd44ffff700 1 -- 172.21.15.71:0/734809600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd450159de0 msgr2=0x7fd4500c4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:28.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.239+0000 7fd44ffff700 1 --2- 172.21.15.71:0/734809600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd450159de0 0x7fd4500c4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:28.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.239+0000 7fd44ffff700 1 -- 172.21.15.71:0/734809600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4500aac80 msgr2=0x7fd450150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:28.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.239+0000 7fd44ffff700 1 --2- 172.21.15.71:0/734809600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4500aac80 0x7fd450150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:28.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.239+0000 7fd44ffff700 1 -- 172.21.15.71:0/734809600 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c009420 con 0x7fd450159a10 2023-10-09T06:58:28.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.239+0000 7fd44ffff700 1 --2- 172.21.15.71:0/734809600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd450159a10 0x7fd4500c48f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd45006ce80 tx=0x7fd43c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:28.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.239+0000 7fd44cff9700 1 -- 172.21.15.71:0/734809600 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c01f070 con 0x7fd450159a10 2023-10-09T06:58:28.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.239+0000 7fd44cff9700 1 -- 172.21.15.71:0/734809600 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43c000c90 con 0x7fd450159a10 2023-10-09T06:58:28.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.239+0000 7fd44cff9700 1 -- 172.21.15.71:0/734809600 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c025420 con 0x7fd450159a10 2023-10-09T06:58:28.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.239+0000 7fd455f9d700 1 -- 172.21.15.71:0/734809600 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45016a7f0 con 0x7fd450159a10 2023-10-09T06:58:28.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.239+0000 7fd455f9d700 1 -- 172.21.15.71:0/734809600 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd450150dd0 con 0x7fd450159a10 2023-10-09T06:58:28.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.240+0000 7fd455f9d700 1 -- 172.21.15.71:0/734809600 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd45016ad10 con 0x7fd450159a10 2023-10-09T06:58:28.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.241+0000 7fd44cff9700 1 -- 172.21.15.71:0/734809600 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fd43c023070 con 0x7fd450159a10 2023-10-09T06:58:28.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.243+0000 7fd44cff9700 1 --2- 172.21.15.71:0/734809600 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd4340670e0 0x7fd434069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:28.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.243+0000 7fd454f9b700 1 -- 172.21.15.71:0/734809600 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd4340670e0 msgr2=0x7fd434069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:28.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.243+0000 7fd44cff9700 1 -- 172.21.15.71:0/734809600 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fd43c085ff0 con 0x7fd450159a10 2023-10-09T06:58:28.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.243+0000 7fd454f9b700 1 --2- 172.21.15.71:0/734809600 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd4340670e0 0x7fd434069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:58:28.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.247+0000 7fd44cff9700 1 -- 172.21.15.71:0/734809600 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd45016ad10 con 0x7fd450159a10 2023-10-09T06:58:28.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.444+0000 7fd454f9b700 1 -- 172.21.15.71:0/734809600 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd4340670e0 msgr2=0x7fd434069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:28.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.444+0000 7fd454f9b700 1 --2- 172.21.15.71:0/734809600 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd4340670e0 0x7fd434069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:58:28.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.444+0000 7fd455f9d700 1 -- 172.21.15.71:0/734809600 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd45016ad10 con 0x7fd450159a10 2023-10-09T06:58:28.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.444+0000 7fd44cff9700 1 -- 172.21.15.71:0/734809600 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd45016ad10 con 0x7fd450159a10 2023-10-09T06:58:28.445 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-09T06:58:28.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.447+0000 7fd455f9d700 1 -- 172.21.15.71:0/734809600 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd4340670e0 msgr2=0x7fd434069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:58:28.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.447+0000 7fd455f9d700 1 --2- 172.21.15.71:0/734809600 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd4340670e0 0x7fd434069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:28.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.447+0000 7fd455f9d700 1 -- 172.21.15.71:0/734809600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd450159a10 msgr2=0x7fd4500c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:28.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.447+0000 7fd455f9d700 1 --2- 172.21.15.71:0/734809600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd450159a10 0x7fd4500c48f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd45006ce80 tx=0x7fd43c017000 comp rx=0 tx=0).stop 2023-10-09T06:58:28.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.447+0000 7fd455f9d700 1 -- 172.21.15.71:0/734809600 shutdown_connections 2023-10-09T06:58:28.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.447+0000 7fd455f9d700 1 --2- 172.21.15.71:0/734809600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd450159de0 0x7fd4500c4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:28.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.447+0000 7fd455f9d700 1 --2- 172.21.15.71:0/734809600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4500aac80 0x7fd450150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:28.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.447+0000 7fd455f9d700 1 --2- 172.21.15.71:0/734809600 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd4340670e0 0x7fd434069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:28.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.447+0000 7fd455f9d700 1 --2- 172.21.15.71:0/734809600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd450159a10 0x7fd4500c48f0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:28.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.447+0000 7fd455f9d700 1 -- 172.21.15.71:0/734809600 >> 172.21.15.71:0/734809600 conn(0x7fd4500cc1e0 msgr2=0x7fd4500c8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:28.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.447+0000 7fd455f9d700 1 -- 172.21.15.71:0/734809600 shutdown_connections 2023-10-09T06:58:28.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.447+0000 7fd455f9d700 1 -- 172.21.15.71:0/734809600 wait complete. 2023-10-09T06:58:28.466 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:58:28.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.654+0000 7f40d3fff700 1 Processor -- start 2023-10-09T06:58:28.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.654+0000 7f40d3fff700 1 -- start start 2023-10-09T06:58:28.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.656+0000 7f40d3fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f40d415d230 0x7f40d415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:28.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.656+0000 7f40d3fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d40b2980 con 0x7f40d4159420 2023-10-09T06:58:28.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.656+0000 7f40d3fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d415db70 con 0x7f40d41597f0 2023-10-09T06:58:28.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.656+0000 7f40d3fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d40b11d0 con 0x7f40d415d230 2023-10-09T06:58:28.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.656+0000 7f40d2ffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f40d4159420 0x7f40d40b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47452/0 (socket says 172.21.15.71:47452) 2023-10-09T06:58:28.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.656+0000 7f40d2ffd700 1 -- 172.21.15.71:0/719879502 learned_addr learned my addr 172.21.15.71:0/719879502 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:28.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.656+0000 7f40d37fe700 1 --2- 172.21.15.71:0/719879502 >> v2:172.21.15.179:3300/0 conn(0x7f40d415d230 0x7f40d415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:28.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.656+0000 7f40d1ffb700 1 -- 172.21.15.71:0/719879502 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213774056 0 0) 0x7f40d40b2980 con 0x7f40d4159420 2023-10-09T06:58:28.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.656+0000 7f40d1ffb700 1 -- 172.21.15.71:0/719879502 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40bc003570 con 0x7f40d4159420 2023-10-09T06:58:28.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.656+0000 7f40d1ffb700 1 -- 172.21.15.71:0/719879502 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 853907803 0 0) 0x7f40d415db70 con 0x7f40d41597f0 2023-10-09T06:58:28.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.656+0000 7f40d1ffb700 1 -- 172.21.15.71:0/719879502 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40d40b2980 con 0x7f40d41597f0 2023-10-09T06:58:28.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.657+0000 7f40d37fe700 1 -- 172.21.15.71:0/719879502 >> v1:172.21.15.179:6789/0 conn(0x7f40d41597f0 legacy=0x7f40d40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:28.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.657+0000 7f40d37fe700 1 -- 172.21.15.71:0/719879502 >> v1:172.21.15.71:6789/0 conn(0x7f40d4159420 legacy=0x7f40d40b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:28.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.657+0000 7f40d37fe700 1 -- 172.21.15.71:0/719879502 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d40b14b0 con 0x7f40d415d230 2023-10-09T06:58:28.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.657+0000 7f40d37fe700 1 --2- 172.21.15.71:0/719879502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40d415d230 0x7f40d415d630 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f40cc009e60 tx=0x7f40cc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d08d71962a05fdc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:28.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.657+0000 7f40d1ffb700 1 -- 172.21.15.71:0/719879502 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc00e070 con 0x7f40d415d230 2023-10-09T06:58:28.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.657+0000 7f40d1ffb700 1 -- 172.21.15.71:0/719879502 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40cc00bab0 con 0x7f40d415d230 2023-10-09T06:58:28.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.657+0000 7f40d1ffb700 1 -- 172.21.15.71:0/719879502 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc00be70 con 0x7f40d415d230 2023-10-09T06:58:28.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.658+0000 7f40d3fff700 1 -- 172.21.15.71:0/719879502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40d415d230 msgr2=0x7f40d415d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:28.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.658+0000 7f40d3fff700 1 --2- 172.21.15.71:0/719879502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40d415d230 0x7f40d415d630 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f40cc009e60 tx=0x7f40cc009780 comp rx=0 tx=0).stop 2023-10-09T06:58:28.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.658+0000 7f40d3fff700 1 -- 172.21.15.71:0/719879502 shutdown_connections 2023-10-09T06:58:28.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.658+0000 7f40d3fff700 1 --2- 172.21.15.71:0/719879502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40d415d230 0x7f40d415d630 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:28.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.658+0000 7f40d3fff700 1 -- 172.21.15.71:0/719879502 >> 172.21.15.71:0/719879502 conn(0x7f40d40d0660 msgr2=0x7f40d40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:28.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.658+0000 7f40d3fff700 1 -- 172.21.15.71:0/719879502 shutdown_connections 2023-10-09T06:58:28.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.658+0000 7f40d3fff700 1 -- 172.21.15.71:0/719879502 wait complete. 2023-10-09T06:58:28.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.659+0000 7f40d3fff700 1 Processor -- start 2023-10-09T06:58:28.660 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:28.657+0000 7fa17e510180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T06:58:28.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.660+0000 7f40d3fff700 1 -- start start 2023-10-09T06:58:28.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.660+0000 7f40d3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40d4159420 0x7f40d40c5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:28.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.660+0000 7f40d3fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40d41597f0 0x7f40d40b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:28.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.660+0000 7f40d3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40d415d230 0x7f40d40b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:28.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.660+0000 7f40d3fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d40b4b50 con 0x7f40d4159420 2023-10-09T06:58:28.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.660+0000 7f40d3fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d40b4d50 con 0x7f40d41597f0 2023-10-09T06:58:28.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.660+0000 7f40d3fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d40b5030 con 0x7f40d415d230 2023-10-09T06:58:28.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.661+0000 7f40d2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40d4159420 0x7f40d40c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:28.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.661+0000 7f40d2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40d4159420 0x7f40d40c5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53574/0 (socket says 172.21.15.71:53574) 2023-10-09T06:58:28.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.661+0000 7f40d2ffd700 1 -- 172.21.15.71:0/4050909998 learned_addr learned my addr 172.21.15.71:0/4050909998 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:28.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.661+0000 7f40d27fc700 1 --2- 172.21.15.71:0/4050909998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40d41597f0 0x7f40d40b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:28.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.661+0000 7f40d37fe700 1 --2- 172.21.15.71:0/4050909998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40d415d230 0x7f40d40b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:28.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.661+0000 7f40d2ffd700 1 -- 172.21.15.71:0/4050909998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40d415d230 msgr2=0x7f40d40b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:28.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.661+0000 7f40d2ffd700 1 --2- 172.21.15.71:0/4050909998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40d415d230 0x7f40d40b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:28.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.661+0000 7f40d2ffd700 1 -- 172.21.15.71:0/4050909998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40d41597f0 msgr2=0x7f40d40b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:28.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.661+0000 7f40d2ffd700 1 --2- 172.21.15.71:0/4050909998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40d41597f0 0x7f40d40b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:28.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.661+0000 7f40d2ffd700 1 -- 172.21.15.71:0/4050909998 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc009a20 con 0x7f40d4159420 2023-10-09T06:58:28.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.661+0000 7f40d2ffd700 1 --2- 172.21.15.71:0/4050909998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40d4159420 0x7f40d40c5650 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f40c400c790 tx=0x7f40c4007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:28.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.662+0000 7f40baffd700 1 -- 172.21.15.71:0/4050909998 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4005b30 con 0x7f40d4159420 2023-10-09T06:58:28.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.662+0000 7f40baffd700 1 -- 172.21.15.71:0/4050909998 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c4005cd0 con 0x7f40d4159420 2023-10-09T06:58:28.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.662+0000 7f40baffd700 1 -- 172.21.15.71:0/4050909998 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4007320 con 0x7f40d4159420 2023-10-09T06:58:28.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.662+0000 7f40d3fff700 1 -- 172.21.15.71:0/4050909998 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d40b5310 con 0x7f40d4159420 2023-10-09T06:58:28.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.662+0000 7f40d3fff700 1 -- 172.21.15.71:0/4050909998 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d40b58d0 con 0x7f40d4159420 2023-10-09T06:58:28.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.663+0000 7f40d3fff700 1 -- 172.21.15.71:0/4050909998 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d40b5af0 con 0x7f40d4159420 2023-10-09T06:58:28.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.665+0000 7f40baffd700 1 -- 172.21.15.71:0/4050909998 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f40c4012400 con 0x7f40d4159420 2023-10-09T06:58:28.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.666+0000 7f40baffd700 1 --2- 172.21.15.71:0/4050909998 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f40c00670e0 0x7f40c0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:28.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.666+0000 7f40baffd700 1 -- 172.21.15.71:0/4050909998 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f40c4083ea0 con 0x7f40d4159420 2023-10-09T06:58:28.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.666+0000 7f40d27fc700 1 -- 172.21.15.71:0/4050909998 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f40c00670e0 msgr2=0x7f40c0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:28.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.666+0000 7f40d27fc700 1 --2- 172.21.15.71:0/4050909998 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f40c00670e0 0x7f40c0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:58:28.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.670+0000 7f40baffd700 1 -- 172.21.15.71:0/4050909998 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40c404b5a0 con 0x7f40d4159420 2023-10-09T06:58:28.741 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:28.740+0000 7fe8b2898180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T06:58:28.753 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:28.752+0000 7fa17e510180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T06:58:28.839 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:28.839+0000 7fe8b2898180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T06:58:28.845 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:28.845+0000 7fa17e510180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T06:58:28.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.867+0000 7f40d27fc700 1 -- 172.21.15.71:0/4050909998 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f40c00670e0 msgr2=0x7f40c0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:28.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.867+0000 7f40d27fc700 1 --2- 172.21.15.71:0/4050909998 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f40c00670e0 0x7f40c0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:58:28.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.915+0000 7f40d3fff700 1 -- 172.21.15.71:0/4050909998 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40d404c3c0 con 0x7f40d4159420 2023-10-09T06:58:28.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.916+0000 7f40baffd700 1 -- 172.21.15.71:0/4050909998 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f40c4017090 con 0x7f40d4159420 2023-10-09T06:58:28.916 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:28.916 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1982857991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1982857991},{"type":"v1","addr":"172.21.15.179:6836","nonce":1982857991}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6466,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/1002256123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":1002256123},{"type":"v1","addr":"172.21.15.179:6837","nonce":1002256123}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6660,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/3500731262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3500731262},{"type":"v1","addr":"172.21.15.71:6834","nonce":3500731262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:58:03.739223+0000","modified":"2023-10-09T06:58:07.306921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/4146861129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":4146861129},{"type":"v1","addr":"172.21.15.71:6835","nonce":4146861129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T06:58:28.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.918+0000 7f40d3fff700 1 -- 172.21.15.71:0/4050909998 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f40c00670e0 msgr2=0x7f40c0069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:58:28.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.918+0000 7f40d3fff700 1 --2- 172.21.15.71:0/4050909998 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f40c00670e0 0x7f40c0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:28.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.918+0000 7f40d3fff700 1 -- 172.21.15.71:0/4050909998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40d4159420 msgr2=0x7f40d40c5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:28.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.918+0000 7f40d3fff700 1 --2- 172.21.15.71:0/4050909998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40d4159420 0x7f40d40c5650 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f40c400c790 tx=0x7f40c4007e80 comp rx=0 tx=0).stop 2023-10-09T06:58:28.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.918+0000 7f40d3fff700 1 -- 172.21.15.71:0/4050909998 shutdown_connections 2023-10-09T06:58:28.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.918+0000 7f40d3fff700 1 --2- 172.21.15.71:0/4050909998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40d415d230 0x7f40d40b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:28.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.918+0000 7f40d3fff700 1 --2- 172.21.15.71:0/4050909998 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f40c00670e0 0x7f40c0069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:28.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.918+0000 7f40d3fff700 1 --2- 172.21.15.71:0/4050909998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40d4159420 0x7f40d40c5650 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:28.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.918+0000 7f40d3fff700 1 --2- 172.21.15.71:0/4050909998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40d41597f0 0x7f40d40b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:28.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.918+0000 7f40d3fff700 1 -- 172.21.15.71:0/4050909998 >> 172.21.15.71:0/4050909998 conn(0x7f40d40d0660 msgr2=0x7f40d40afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:28.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.918+0000 7f40d3fff700 1 -- 172.21.15.71:0/4050909998 shutdown_connections 2023-10-09T06:58:28.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:28.919+0000 7f40d3fff700 1 -- 172.21.15.71:0/4050909998 wait complete. 2023-10-09T06:58:28.920 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 41 2023-10-09T06:58:28.934 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:28.935+0000 7fe8b2898180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T06:58:28.937 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:58:29.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.124+0000 7f5a7559d700 1 Processor -- start 2023-10-09T06:58:29.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.125+0000 7f5a7559d700 1 -- start start 2023-10-09T06:58:29.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.126+0000 7f5a7559d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5a701595a0 0x7f5a700b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:29.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.126+0000 7f5a7559d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a700c8830 0x7f5a70159970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:29.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.126+0000 7f5a7559d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a700b1410 con 0x7f5a700c6c60 2023-10-09T06:58:29.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.126+0000 7f5a7559d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a700b2b90 con 0x7f5a701595a0 2023-10-09T06:58:29.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.126+0000 7f5a7559d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a70063230 con 0x7f5a700c8830 2023-10-09T06:58:29.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.126+0000 7f5a6f7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f5a700c6c60 0x7f5a700c8120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47460/0 (socket says 172.21.15.71:47460) 2023-10-09T06:58:29.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.126+0000 7f5a6f7fe700 1 -- 172.21.15.71:0/264809369 learned_addr learned my addr 172.21.15.71:0/264809369 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:29.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.126+0000 7f5a6ffff700 1 --2- 172.21.15.71:0/264809369 >> v2:172.21.15.179:3300/0 conn(0x7f5a701595a0 0x7f5a700b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:29.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.126+0000 7f5a74d9c700 1 --2- 172.21.15.71:0/264809369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a700c8830 0x7f5a70159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:29.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.127+0000 7f5a6effd700 1 -- 172.21.15.71:0/264809369 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3034494130 0 0) 0x7f5a700b1410 con 0x7f5a700c6c60 2023-10-09T06:58:29.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.127+0000 7f5a6effd700 1 -- 172.21.15.71:0/264809369 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a58003570 con 0x7f5a700c6c60 2023-10-09T06:58:29.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.127+0000 7f5a74d9c700 1 -- 172.21.15.71:0/264809369 >> v2:172.21.15.179:3300/0 conn(0x7f5a701595a0 msgr2=0x7f5a700b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:29.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.127+0000 7f5a74d9c700 1 --2- 172.21.15.71:0/264809369 >> v2:172.21.15.179:3300/0 conn(0x7f5a701595a0 0x7f5a700b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:29.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.127+0000 7f5a74d9c700 1 -- 172.21.15.71:0/264809369 >> v1:172.21.15.71:6789/0 conn(0x7f5a700c6c60 legacy=0x7f5a700c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:29.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.127+0000 7f5a74d9c700 1 -- 172.21.15.71:0/264809369 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a700634f0 con 0x7f5a700c8830 2023-10-09T06:58:29.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.127+0000 7f5a6ffff700 1 --2- 172.21.15.71:0/264809369 >> v2:172.21.15.179:3300/0 conn(0x7f5a701595a0 0x7f5a700b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:58:29.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.127+0000 7f5a74d9c700 1 --2- 172.21.15.71:0/264809369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a700c8830 0x7f5a70159970 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5a68009e60 tx=0x7f5a68009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f009ae5457056a48 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:29.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.127+0000 7f5a6effd700 1 -- 172.21.15.71:0/264809369 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6800e070 con 0x7f5a700c8830 2023-10-09T06:58:29.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.127+0000 7f5a6effd700 1 -- 172.21.15.71:0/264809369 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6800bab0 con 0x7f5a700c8830 2023-10-09T06:58:29.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.127+0000 7f5a6effd700 1 -- 172.21.15.71:0/264809369 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6800be70 con 0x7f5a700c8830 2023-10-09T06:58:29.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.128+0000 7f5a7559d700 1 -- 172.21.15.71:0/264809369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a700c8830 msgr2=0x7f5a70159970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:29.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.128+0000 7f5a7559d700 1 --2- 172.21.15.71:0/264809369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a700c8830 0x7f5a70159970 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5a68009e60 tx=0x7f5a68009780 comp rx=0 tx=0).stop 2023-10-09T06:58:29.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.128+0000 7f5a7559d700 1 -- 172.21.15.71:0/264809369 shutdown_connections 2023-10-09T06:58:29.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.128+0000 7f5a7559d700 1 --2- 172.21.15.71:0/264809369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a700c8830 0x7f5a70159970 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:29.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.128+0000 7f5a7559d700 1 --2- 172.21.15.71:0/264809369 >> v2:172.21.15.179:3300/0 conn(0x7f5a701595a0 0x7f5a700b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:29.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.128+0000 7f5a7559d700 1 -- 172.21.15.71:0/264809369 >> 172.21.15.71:0/264809369 conn(0x7f5a7006ddb0 msgr2=0x7f5a7006e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:29.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.128+0000 7f5a7559d700 1 -- 172.21.15.71:0/264809369 shutdown_connections 2023-10-09T06:58:29.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.128+0000 7f5a7559d700 1 -- 172.21.15.71:0/264809369 wait complete. 2023-10-09T06:58:29.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.130+0000 7f5a7559d700 1 Processor -- start 2023-10-09T06:58:29.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.130+0000 7f5a7559d700 1 -- start start 2023-10-09T06:58:29.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.131+0000 7f5a7559d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a700c6c60 0x7f5a700c33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:29.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.131+0000 7f5a7559d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a700c8830 0x7f5a70169a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:29.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.131+0000 7f5a7559d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a701595a0 0x7f5a700c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:29.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.131+0000 7f5a7559d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a700c1950 con 0x7f5a701595a0 2023-10-09T06:58:29.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.131+0000 7f5a7559d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a700c1c30 con 0x7f5a700c6c60 2023-10-09T06:58:29.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.131+0000 7f5a7559d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a700c3bf0 con 0x7f5a700c8830 2023-10-09T06:58:29.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.131+0000 7f5a74d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a701595a0 0x7f5a700c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:29.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.131+0000 7f5a6ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a700c6c60 0x7f5a700c33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:29.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.131+0000 7f5a6f7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a700c8830 0x7f5a70169a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:29.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.131+0000 7f5a6ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a700c6c60 0x7f5a700c33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:48756/0 (socket says 172.21.15.71:48756) 2023-10-09T06:58:29.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.131+0000 7f5a6ffff700 1 -- 172.21.15.71:0/1633460376 learned_addr learned my addr 172.21.15.71:0/1633460376 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:29.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.132+0000 7f5a6f7fe700 1 -- 172.21.15.71:0/1633460376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a700c6c60 msgr2=0x7f5a700c33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:29.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.132+0000 7f5a6f7fe700 1 --2- 172.21.15.71:0/1633460376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a700c6c60 0x7f5a700c33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:29.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.132+0000 7f5a6f7fe700 1 -- 172.21.15.71:0/1633460376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a701595a0 msgr2=0x7f5a700c20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:29.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.132+0000 7f5a6f7fe700 1 --2- 172.21.15.71:0/1633460376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a701595a0 0x7f5a700c20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:29.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.132+0000 7f5a6f7fe700 1 -- 172.21.15.71:0/1633460376 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a60009420 con 0x7f5a700c8830 2023-10-09T06:58:29.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.132+0000 7f5a6ffff700 1 --2- 172.21.15.71:0/1633460376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a700c6c60 0x7f5a700c33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:58:29.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.132+0000 7f5a6f7fe700 1 --2- 172.21.15.71:0/1633460376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a700c8830 0x7f5a70169a90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5a700c70c0 tx=0x7f5a64007d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:29.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.132+0000 7f5a57fff700 1 -- 172.21.15.71:0/1633460376 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a64005b30 con 0x7f5a700c8830 2023-10-09T06:58:29.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.132+0000 7f5a57fff700 1 -- 172.21.15.71:0/1633460376 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a64005cb0 con 0x7f5a700c8830 2023-10-09T06:58:29.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.132+0000 7f5a7559d700 1 -- 172.21.15.71:0/1633460376 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a68009a20 con 0x7f5a700c8830 2023-10-09T06:58:29.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.132+0000 7f5a57fff700 1 -- 172.21.15.71:0/1633460376 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a64007320 con 0x7f5a700c8830 2023-10-09T06:58:29.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.132+0000 7f5a7559d700 1 -- 172.21.15.71:0/1633460376 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a700c41b0 con 0x7f5a700c8830 2023-10-09T06:58:29.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.134+0000 7f5a7559d700 1 -- 172.21.15.71:0/1633460376 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a700c43d0 con 0x7f5a700c8830 2023-10-09T06:58:29.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.134+0000 7f5a57fff700 1 -- 172.21.15.71:0/1633460376 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 37) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f5a6401b3b0 con 0x7f5a700c8830 2023-10-09T06:58:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.135+0000 7f5a57fff700 1 --2- 172.21.15.71:0/1633460376 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5a5c0670e0 0x7f5a5c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.135+0000 7f5a57fff700 1 -- 172.21.15.71:0/1633460376 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f5a64083ed0 con 0x7f5a700c8830 2023-10-09T06:58:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.136+0000 7f5a6ffff700 1 -- 172.21.15.71:0/1633460376 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5a5c0670e0 msgr2=0x7f5a5c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.136+0000 7f5a6ffff700 1 --2- 172.21.15.71:0/1633460376 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5a5c0670e0 0x7f5a5c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:58:29.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.140+0000 7f5a57fff700 1 -- 172.21.15.71:0/1633460376 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a64050c30 con 0x7f5a700c8830 2023-10-09T06:58:29.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.337+0000 7f5a6ffff700 1 -- 172.21.15.71:0/1633460376 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5a5c0670e0 msgr2=0x7f5a5c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:29.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.337+0000 7f5a6ffff700 1 --2- 172.21.15.71:0/1633460376 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5a5c0670e0 0x7f5a5c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:58:29.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.338+0000 7f5a7559d700 1 -- 172.21.15.71:0/1633460376 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a700c1da0 con 0x7f5a700c8830 2023-10-09T06:58:29.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.339+0000 7f5a57fff700 1 -- 172.21.15.71:0/1633460376 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+16320 (secure 0 0 0) 0x7f5a64017020 con 0x7f5a700c8830 2023-10-09T06:58:29.339 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:29.340 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":94,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:58:23.837542+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:58:01.931617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T06:58:02.718563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6833/85452":"2023-10-10T06:58:23.837509+0000","172.21.15.179:0/3414133961":"2023-10-10T06:58:23.837509+0000","172.21.15.179:0/1165861819":"2023-10-10T06:58:23.837509+0000","172.21.15.179:6832/85452":"2023-10-10T06:58:23.837509+0000","172.21.15.179:0/2303709833":"2023-10-10T06:58:23.837509+0000","172.21.15.179:0/4140042527":"2023-10-10T06:58:23.837509+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:58:29.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.342+0000 7f5a7559d700 1 -- 172.21.15.71:0/1633460376 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5a5c0670e0 msgr2=0x7f5a5c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:58:29.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.342+0000 7f5a7559d700 1 --2- 172.21.15.71:0/1633460376 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5a5c0670e0 0x7f5a5c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:29.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.342+0000 7f5a7559d700 1 -- 172.21.15.71:0/1633460376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a700c8830 msgr2=0x7f5a70169a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:29.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.342+0000 7f5a7559d700 1 --2- 172.21.15.71:0/1633460376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a700c8830 0x7f5a70169a90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5a700c70c0 tx=0x7f5a64007d50 comp rx=0 tx=0).stop 2023-10-09T06:58:29.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.342+0000 7f5a7559d700 1 -- 172.21.15.71:0/1633460376 shutdown_connections 2023-10-09T06:58:29.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.342+0000 7f5a7559d700 1 --2- 172.21.15.71:0/1633460376 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5a5c0670e0 0x7f5a5c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:29.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.342+0000 7f5a7559d700 1 --2- 172.21.15.71:0/1633460376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a701595a0 0x7f5a700c20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:29.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.342+0000 7f5a7559d700 1 --2- 172.21.15.71:0/1633460376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a700c6c60 0x7f5a700c33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:29.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.342+0000 7f5a7559d700 1 --2- 172.21.15.71:0/1633460376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a700c8830 0x7f5a70169a90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:29.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.342+0000 7f5a7559d700 1 -- 172.21.15.71:0/1633460376 >> 172.21.15.71:0/1633460376 conn(0x7f5a7006ddb0 msgr2=0x7f5a701582f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:29.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.342+0000 7f5a7559d700 1 -- 172.21.15.71:0/1633460376 shutdown_connections 2023-10-09T06:58:29.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.342+0000 7f5a7559d700 1 -- 172.21.15.71:0/1633460376 wait complete. 2023-10-09T06:58:29.360 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T06:58:29.360 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:58:29.470 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:29.470+0000 7fa17e510180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T06:58:29.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.573+0000 7fc37759e700 1 Processor -- start 2023-10-09T06:58:29.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.573+0000 7fc37759e700 1 -- start start 2023-10-09T06:58:29.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.574+0000 7fc37759e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc3780ad870 0x7fc37806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:29.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.574+0000 7fc37759e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc37806bf20 0x7fc37806a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:29.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.575+0000 7fc37759e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3780b40f0 con 0x7fc378142ea0 2023-10-09T06:58:29.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.575+0000 7fc37759e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc37806c3a0 con 0x7fc37806bf20 2023-10-09T06:58:29.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.575+0000 7fc37759e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc378069640 con 0x7fc3780ad870 2023-10-09T06:58:29.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.575+0000 7fc376d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc37806bf20 0x7fc37806a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:29.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.575+0000 7fc376d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc37806bf20 0x7fc37806a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53584/0 (socket says 172.21.15.71:53584) 2023-10-09T06:58:29.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.575+0000 7fc376d9d700 1 -- 172.21.15.71:0/699919312 learned_addr learned my addr 172.21.15.71:0/699919312 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:29.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.575+0000 7fc375d9b700 1 --2- 172.21.15.71:0/699919312 >> v2:172.21.15.179:3300/0 conn(0x7fc3780ad870 0x7fc37806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:29.576 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:29.575+0000 7fe8b2898180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T06:58:29.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.575+0000 7fc376d9d700 1 -- 172.21.15.71:0/699919312 >> v2:172.21.15.179:3300/0 conn(0x7fc3780ad870 msgr2=0x7fc37806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:29.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.575+0000 7fc376d9d700 1 --2- 172.21.15.71:0/699919312 >> v2:172.21.15.179:3300/0 conn(0x7fc3780ad870 0x7fc37806b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:29.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.575+0000 7fc376d9d700 1 -- 172.21.15.71:0/699919312 >> v1:172.21.15.179:6789/0 conn(0x7fc378142ea0 legacy=0x7fc3780b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:29.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.575+0000 7fc376d9d700 1 -- 172.21.15.71:0/699919312 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc378069920 con 0x7fc37806bf20 2023-10-09T06:58:29.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.575+0000 7fc37559a700 1 -- 172.21.15.71:0/699919312 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165202056 0 0) 0x7fc3780b40f0 con 0x7fc378142ea0 2023-10-09T06:58:29.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.576+0000 7fc376d9d700 1 --2- 172.21.15.71:0/699919312 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc37806bf20 0x7fc37806a120 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc3780b0e10 tx=0x7fc370009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8fca223c0031bf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:29.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.576+0000 7fc37559a700 1 -- 172.21.15.71:0/699919312 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37000e070 con 0x7fc37806bf20 2023-10-09T06:58:29.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.576+0000 7fc37559a700 1 -- 172.21.15.71:0/699919312 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37000ba20 con 0x7fc37806bf20 2023-10-09T06:58:29.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.576+0000 7fc37559a700 1 -- 172.21.15.71:0/699919312 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3700092e0 con 0x7fc37806bf20 2023-10-09T06:58:29.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.576+0000 7fc37759e700 1 -- 172.21.15.71:0/699919312 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc37806bf20 msgr2=0x7fc37806a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:29.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.576+0000 7fc37759e700 1 --2- 172.21.15.71:0/699919312 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc37806bf20 0x7fc37806a120 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc3780b0e10 tx=0x7fc370009840 comp rx=0 tx=0).stop 2023-10-09T06:58:29.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.577+0000 7fc37759e700 1 -- 172.21.15.71:0/699919312 shutdown_connections 2023-10-09T06:58:29.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.577+0000 7fc37759e700 1 --2- 172.21.15.71:0/699919312 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc37806bf20 0x7fc37806a120 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:29.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.577+0000 7fc37759e700 1 --2- 172.21.15.71:0/699919312 >> v2:172.21.15.179:3300/0 conn(0x7fc3780ad870 0x7fc37806b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:29.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.577+0000 7fc37759e700 1 -- 172.21.15.71:0/699919312 >> 172.21.15.71:0/699919312 conn(0x7fc3780ce430 msgr2=0x7fc3780ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:29.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.577+0000 7fc37759e700 1 -- 172.21.15.71:0/699919312 shutdown_connections 2023-10-09T06:58:29.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.577+0000 7fc37759e700 1 -- 172.21.15.71:0/699919312 wait complete. 2023-10-09T06:58:29.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.578+0000 7fc37759e700 1 Processor -- start 2023-10-09T06:58:29.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.578+0000 7fc37759e700 1 -- start start 2023-10-09T06:58:29.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.579+0000 7fc37759e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc37806bf20 0x7fc378158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:29.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.579+0000 7fc37759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc378142ea0 0x7fc3780c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:29.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.579+0000 7fc37759e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3780c91b0 0x7fc3780c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:29.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.579+0000 7fc37759e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3780c8d20 con 0x7fc3780c91b0 2023-10-09T06:58:29.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.579+0000 7fc37759e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3780af560 con 0x7fc37806bf20 2023-10-09T06:58:29.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.579+0000 7fc37759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3780c8110 con 0x7fc378142ea0 2023-10-09T06:58:29.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.579+0000 7fc376d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3780c91b0 0x7fc3780c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.579+0000 7fc376d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3780c91b0 0x7fc3780c7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53588/0 (socket says 172.21.15.71:53588) 2023-10-09T06:58:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.579+0000 7fc376d9d700 1 -- 172.21.15.71:0/1499443454 learned_addr learned my addr 172.21.15.71:0/1499443454 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.579+0000 7fc37659c700 1 --2- 172.21.15.71:0/1499443454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc37806bf20 0x7fc378158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.579+0000 7fc375d9b700 1 --2- 172.21.15.71:0/1499443454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc378142ea0 0x7fc3780c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.580+0000 7fc376d9d700 1 -- 172.21.15.71:0/1499443454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc378142ea0 msgr2=0x7fc3780c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.580+0000 7fc376d9d700 1 --2- 172.21.15.71:0/1499443454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc378142ea0 0x7fc3780c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.580+0000 7fc376d9d700 1 -- 172.21.15.71:0/1499443454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc37806bf20 msgr2=0x7fc378158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.580+0000 7fc376d9d700 1 --2- 172.21.15.71:0/1499443454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc37806bf20 0x7fc378158c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.580+0000 7fc376d9d700 1 -- 172.21.15.71:0/1499443454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc370009ae0 con 0x7fc3780c91b0 2023-10-09T06:58:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.580+0000 7fc376d9d700 1 --2- 172.21.15.71:0/1499443454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3780c91b0 0x7fc3780c7b20 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fc370009880 tx=0x7fc370018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.580+0000 7fc3667fc700 1 -- 172.21.15.71:0/1499443454 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc370008a80 con 0x7fc3780c91b0 2023-10-09T06:58:29.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.580+0000 7fc3667fc700 1 -- 172.21.15.71:0/1499443454 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc370008c00 con 0x7fc3780c91b0 2023-10-09T06:58:29.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.580+0000 7fc37759e700 1 -- 172.21.15.71:0/1499443454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3780c83f0 con 0x7fc3780c91b0 2023-10-09T06:58:29.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.580+0000 7fc3667fc700 1 -- 172.21.15.71:0/1499443454 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc370026460 con 0x7fc3780c91b0 2023-10-09T06:58:29.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.580+0000 7fc37759e700 1 -- 172.21.15.71:0/1499443454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3780c89b0 con 0x7fc3780c91b0 2023-10-09T06:58:29.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.582+0000 7fc37759e700 1 -- 172.21.15.71:0/1499443454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3780c8e90 con 0x7fc3780c91b0 2023-10-09T06:58:29.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.582+0000 7fc3667fc700 1 -- 172.21.15.71:0/1499443454 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fc370003040 con 0x7fc3780c91b0 2023-10-09T06:58:29.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.584+0000 7fc3667fc700 1 --2- 172.21.15.71:0/1499443454 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc358067110 0x7fc3580695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:29.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.584+0000 7fc3667fc700 1 -- 172.21.15.71:0/1499443454 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fc370086a50 con 0x7fc3780c91b0 2023-10-09T06:58:29.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.584+0000 7fc37659c700 1 -- 172.21.15.71:0/1499443454 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc358067110 msgr2=0x7fc3580695c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:29.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.584+0000 7fc37659c700 1 --2- 172.21.15.71:0/1499443454 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc358067110 0x7fc3580695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:58:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.589+0000 7fc3667fc700 1 -- 172.21.15.71:0/1499443454 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc370053750 con 0x7fc3780c91b0 2023-10-09T06:58:29.645 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:29.644+0000 7fa17e510180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:58:29.740 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:29.740+0000 7fa17e510180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T06:58:29.755 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:29.755+0000 7fe8b2898180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:58:29.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.785+0000 7fc37659c700 1 -- 172.21.15.71:0/1499443454 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc358067110 msgr2=0x7fc3580695c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:29.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.785+0000 7fc37659c700 1 --2- 172.21.15.71:0/1499443454 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc358067110 0x7fc3580695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:58:29.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.832+0000 7fc37759e700 1 -- 172.21.15.71:0/1499443454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc37804c3c0 con 0x7fc3780c91b0 2023-10-09T06:58:29.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.833+0000 7fc3667fc700 1 -- 172.21.15.71:0/1499443454 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fc370021090 con 0x7fc3780c91b0 2023-10-09T06:58:29.833 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:29.833 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1982857991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1982857991},{"type":"v1","addr":"172.21.15.179:6836","nonce":1982857991}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6466,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/1002256123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":1002256123},{"type":"v1","addr":"172.21.15.179:6837","nonce":1002256123}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6660,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/3500731262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3500731262},{"type":"v1","addr":"172.21.15.71:6834","nonce":3500731262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:58:03.739223+0000","modified":"2023-10-09T06:58:07.306921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/4146861129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":4146861129},{"type":"v1","addr":"172.21.15.71:6835","nonce":4146861129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T06:58:29.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.835+0000 7fc37759e700 1 -- 172.21.15.71:0/1499443454 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc358067110 msgr2=0x7fc3580695c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:58:29.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.835+0000 7fc37759e700 1 --2- 172.21.15.71:0/1499443454 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc358067110 0x7fc3580695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:29.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.835+0000 7fc37759e700 1 -- 172.21.15.71:0/1499443454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3780c91b0 msgr2=0x7fc3780c7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:29.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.835+0000 7fc37759e700 1 --2- 172.21.15.71:0/1499443454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3780c91b0 0x7fc3780c7b20 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fc370009880 tx=0x7fc370018000 comp rx=0 tx=0).stop 2023-10-09T06:58:29.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.835+0000 7fc37759e700 1 -- 172.21.15.71:0/1499443454 shutdown_connections 2023-10-09T06:58:29.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.835+0000 7fc37759e700 1 --2- 172.21.15.71:0/1499443454 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc358067110 0x7fc3580695c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:29.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.835+0000 7fc37759e700 1 --2- 172.21.15.71:0/1499443454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3780c91b0 0x7fc3780c7b20 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:29.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.835+0000 7fc37759e700 1 --2- 172.21.15.71:0/1499443454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc37806bf20 0x7fc378158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:29.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.835+0000 7fc37759e700 1 --2- 172.21.15.71:0/1499443454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc378142ea0 0x7fc3780c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:29.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.835+0000 7fc37759e700 1 -- 172.21.15.71:0/1499443454 >> 172.21.15.71:0/1499443454 conn(0x7fc3780ce430 msgr2=0x7fc3780b0640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:29.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.835+0000 7fc37759e700 1 -- 172.21.15.71:0/1499443454 shutdown_connections 2023-10-09T06:58:29.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:29.835+0000 7fc37759e700 1 -- 172.21.15.71:0/1499443454 wait complete. 2023-10-09T06:58:29.837 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 41 2023-10-09T06:58:29.853 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:58:29.857 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:29.855+0000 7fe8b2898180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T06:58:30.037 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:30.036+0000 7fa17e510180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T06:58:30.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.044+0000 7fc83539d700 1 Processor -- start 2023-10-09T06:58:30.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.044+0000 7fc83539d700 1 -- start start 2023-10-09T06:58:30.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.045+0000 7fc83539d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc830159420 0x7fc8300b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:30.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.045+0000 7fc83539d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc83015d230 0x7fc83015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:30.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.045+0000 7fc83539d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8300b2980 con 0x7fc8301597f0 2023-10-09T06:58:30.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.045+0000 7fc83539d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83015db70 con 0x7fc83015d230 2023-10-09T06:58:30.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.045+0000 7fc83539d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8300b11d0 con 0x7fc830159420 2023-10-09T06:58:30.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.045+0000 7fc834b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc83015d230 0x7fc83015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:30.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.045+0000 7fc82ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc830159420 0x7fc8300b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:30.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.045+0000 7fc82f7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc8301597f0 0x7fc8300b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47474/0 (socket says 172.21.15.71:47474) 2023-10-09T06:58:30.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.045+0000 7fc82f7fe700 1 -- 172.21.15.71:0/3007525647 learned_addr learned my addr 172.21.15.71:0/3007525647 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:30.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.046+0000 7fc82ffff700 1 -- 172.21.15.71:0/3007525647 >> v2:172.21.15.71:3300/0 conn(0x7fc83015d230 msgr2=0x7fc83015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:30.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.046+0000 7fc82ffff700 1 --2- 172.21.15.71:0/3007525647 >> v2:172.21.15.71:3300/0 conn(0x7fc83015d230 0x7fc83015d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.046+0000 7fc82ffff700 1 -- 172.21.15.71:0/3007525647 >> v1:172.21.15.71:6789/0 conn(0x7fc8301597f0 legacy=0x7fc8300b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:30.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.046+0000 7fc82ffff700 1 -- 172.21.15.71:0/3007525647 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8300b14b0 con 0x7fc830159420 2023-10-09T06:58:30.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.046+0000 7fc834b9c700 1 --2- 172.21.15.71:0/3007525647 >> v2:172.21.15.71:3300/0 conn(0x7fc83015d230 0x7fc83015d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:58:30.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.046+0000 7fc82ffff700 1 --2- 172.21.15.71:0/3007525647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc830159420 0x7fc8300b5f40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc8300b2f20 tx=0x7fc8200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0ab2cd3296eb6fe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:30.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.046+0000 7fc82effd700 1 -- 172.21.15.71:0/3007525647 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc820011630 con 0x7fc830159420 2023-10-09T06:58:30.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.046+0000 7fc82effd700 1 -- 172.21.15.71:0/3007525647 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc820011790 con 0x7fc830159420 2023-10-09T06:58:30.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.046+0000 7fc82effd700 1 -- 172.21.15.71:0/3007525647 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc820011b30 con 0x7fc830159420 2023-10-09T06:58:30.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.047+0000 7fc83539d700 1 -- 172.21.15.71:0/3007525647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc830159420 msgr2=0x7fc8300b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:30.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.047+0000 7fc83539d700 1 --2- 172.21.15.71:0/3007525647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc830159420 0x7fc8300b5f40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc8300b2f20 tx=0x7fc8200091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.047+0000 7fc83539d700 1 -- 172.21.15.71:0/3007525647 shutdown_connections 2023-10-09T06:58:30.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.047+0000 7fc83539d700 1 --2- 172.21.15.71:0/3007525647 >> v2:172.21.15.71:3300/0 conn(0x7fc83015d230 0x7fc83015d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.047+0000 7fc83539d700 1 --2- 172.21.15.71:0/3007525647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc830159420 0x7fc8300b5f40 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.047+0000 7fc83539d700 1 -- 172.21.15.71:0/3007525647 >> 172.21.15.71:0/3007525647 conn(0x7fc8300d0660 msgr2=0x7fc8300d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:30.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.047+0000 7fc83539d700 1 -- 172.21.15.71:0/3007525647 shutdown_connections 2023-10-09T06:58:30.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.047+0000 7fc83539d700 1 -- 172.21.15.71:0/3007525647 wait complete. 2023-10-09T06:58:30.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.049+0000 7fc83539d700 1 Processor -- start 2023-10-09T06:58:30.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.049+0000 7fc83539d700 1 -- start start 2023-10-09T06:58:30.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.050+0000 7fc83539d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc830159420 0x7fc83015b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:30.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.050+0000 7fc83539d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8301597f0 0x7fc8300c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:30.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.050+0000 7fc83539d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc83015d230 0x7fc830143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:30.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.050+0000 7fc83539d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8300c60a0 con 0x7fc830159420 2023-10-09T06:58:30.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.050+0000 7fc83539d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8300c6380 con 0x7fc8301597f0 2023-10-09T06:58:30.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.050+0000 7fc83539d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83015bb70 con 0x7fc83015d230 2023-10-09T06:58:30.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.050+0000 7fc82ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc830159420 0x7fc83015b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:30.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.050+0000 7fc82ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc830159420 0x7fc83015b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53594/0 (socket says 172.21.15.71:53594) 2023-10-09T06:58:30.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.050+0000 7fc82ffff700 1 -- 172.21.15.71:0/3601770812 learned_addr learned my addr 172.21.15.71:0/3601770812 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:30.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.050+0000 7fc82f7fe700 1 --2- 172.21.15.71:0/3601770812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8301597f0 0x7fc8300c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:30.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.050+0000 7fc834b9c700 1 --2- 172.21.15.71:0/3601770812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc83015d230 0x7fc830143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:30.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.050+0000 7fc82ffff700 1 -- 172.21.15.71:0/3601770812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc83015d230 msgr2=0x7fc830143cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:30.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.050+0000 7fc82ffff700 1 --2- 172.21.15.71:0/3601770812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc83015d230 0x7fc830143cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.050+0000 7fc82ffff700 1 -- 172.21.15.71:0/3601770812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8301597f0 msgr2=0x7fc8300c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:30.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.050+0000 7fc82ffff700 1 --2- 172.21.15.71:0/3601770812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8301597f0 0x7fc8300c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.050+0000 7fc82ffff700 1 -- 172.21.15.71:0/3601770812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc828009a20 con 0x7fc830159420 2023-10-09T06:58:30.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.051+0000 7fc82ffff700 1 --2- 172.21.15.71:0/3601770812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc830159420 0x7fc83015b630 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc820009f50 tx=0x7fc820017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:30.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.051+0000 7fc817fff700 1 -- 172.21.15.71:0/3601770812 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc820011b10 con 0x7fc830159420 2023-10-09T06:58:30.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.051+0000 7fc817fff700 1 -- 172.21.15.71:0/3601770812 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8200253f0 con 0x7fc830159420 2023-10-09T06:58:30.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.051+0000 7fc83539d700 1 -- 172.21.15.71:0/3601770812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc820009420 con 0x7fc830159420 2023-10-09T06:58:30.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.051+0000 7fc817fff700 1 -- 172.21.15.71:0/3601770812 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc820025790 con 0x7fc830159420 2023-10-09T06:58:30.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.051+0000 7fc83539d700 1 -- 172.21.15.71:0/3601770812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83015c120 con 0x7fc830159420 2023-10-09T06:58:30.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.052+0000 7fc83539d700 1 -- 172.21.15.71:0/3601770812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83004c3c0 con 0x7fc830159420 2023-10-09T06:58:30.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.053+0000 7fc817fff700 1 -- 172.21.15.71:0/3601770812 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fc820025b40 con 0x7fc830159420 2023-10-09T06:58:30.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.054+0000 7fc817fff700 1 --2- 172.21.15.71:0/3601770812 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc81c0670e0 0x7fc81c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:30.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.054+0000 7fc817fff700 1 -- 172.21.15.71:0/3601770812 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fc8200862d0 con 0x7fc830159420 2023-10-09T06:58:30.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.054+0000 7fc82f7fe700 1 -- 172.21.15.71:0/3601770812 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc81c0670e0 msgr2=0x7fc81c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:30.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.054+0000 7fc82f7fe700 1 --2- 172.21.15.71:0/3601770812 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc81c0670e0 0x7fc81c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:58:30.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.059+0000 7fc817fff700 1 -- 172.21.15.71:0/3601770812 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc820053050 con 0x7fc830159420 2023-10-09T06:58:30.132 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:30.132+0000 7fa17e510180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T06:58:30.160 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:30.160+0000 7fe8b2898180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T06:58:30.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.255+0000 7fc82f7fe700 1 -- 172.21.15.71:0/3601770812 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc81c0670e0 msgr2=0x7fc81c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:30.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.255+0000 7fc82f7fe700 1 --2- 172.21.15.71:0/3601770812 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc81c0670e0 0x7fc81c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:58:30.259 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:30.259+0000 7fe8b2898180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T06:58:30.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.300+0000 7fc83539d700 1 -- 172.21.15.71:0/3601770812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8300b1790 con 0x7fc830159420 2023-10-09T06:58:30.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.301+0000 7fc817fff700 1 -- 172.21.15.71:0/3601770812 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fc820056670 con 0x7fc830159420 2023-10-09T06:58:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:30.301 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1982857991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1982857991},{"type":"v1","addr":"172.21.15.179:6836","nonce":1982857991}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6466,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/1002256123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":1002256123},{"type":"v1","addr":"172.21.15.179:6837","nonce":1002256123}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6660,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/3500731262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3500731262},{"type":"v1","addr":"172.21.15.71:6834","nonce":3500731262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:58:03.739223+0000","modified":"2023-10-09T06:58:07.306921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6666},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6666":{"gid":6666,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/4146861129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":4146861129},{"type":"v1","addr":"172.21.15.71:6835","nonce":4146861129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T06:58:30.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.303+0000 7fc83539d700 1 -- 172.21.15.71:0/3601770812 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc81c0670e0 msgr2=0x7fc81c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:58:30.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.303+0000 7fc83539d700 1 --2- 172.21.15.71:0/3601770812 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc81c0670e0 0x7fc81c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.303+0000 7fc83539d700 1 -- 172.21.15.71:0/3601770812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc830159420 msgr2=0x7fc83015b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.303+0000 7fc83539d700 1 --2- 172.21.15.71:0/3601770812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc830159420 0x7fc83015b630 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc820009f50 tx=0x7fc820017000 comp rx=0 tx=0).stop 2023-10-09T06:58:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.303+0000 7fc83539d700 1 -- 172.21.15.71:0/3601770812 shutdown_connections 2023-10-09T06:58:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.303+0000 7fc83539d700 1 --2- 172.21.15.71:0/3601770812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc83015d230 0x7fc830143cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.303+0000 7fc83539d700 1 --2- 172.21.15.71:0/3601770812 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc81c0670e0 0x7fc81c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.303+0000 7fc83539d700 1 --2- 172.21.15.71:0/3601770812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc830159420 0x7fc83015b630 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.303+0000 7fc83539d700 1 --2- 172.21.15.71:0/3601770812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8301597f0 0x7fc8300c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.303+0000 7fc83539d700 1 -- 172.21.15.71:0/3601770812 >> 172.21.15.71:0/3601770812 conn(0x7fc8300d0660 msgr2=0x7fc8300af200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.303+0000 7fc83539d700 1 -- 172.21.15.71:0/3601770812 shutdown_connections 2023-10-09T06:58:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.303+0000 7fc83539d700 1 -- 172.21.15.71:0/3601770812 wait complete. 2023-10-09T06:58:30.305 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 41 2023-10-09T06:58:30.321 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:58:30.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.507+0000 7fa3f979d700 1 Processor -- start 2023-10-09T06:58:30.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.507+0000 7fa3f979d700 1 -- start start 2023-10-09T06:58:30.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.509+0000 7fa3f979d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa3f40ad870 0x7fa3f406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:30.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.509+0000 7fa3f979d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa3f406bf20 0x7fa3f406a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:30.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.509+0000 7fa3f979d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f40b40f0 con 0x7fa3f4142ea0 2023-10-09T06:58:30.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.509+0000 7fa3f979d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f406c3a0 con 0x7fa3f406bf20 2023-10-09T06:58:30.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.509+0000 7fa3f979d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f4069640 con 0x7fa3f40ad870 2023-10-09T06:58:30.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.509+0000 7fa3f8f9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa3f406bf20 0x7fa3f406a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:30.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.509+0000 7fa3f8f9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa3f406bf20 0x7fa3f406a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53600/0 (socket says 172.21.15.71:53600) 2023-10-09T06:58:30.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.509+0000 7fa3f8f9c700 1 -- 172.21.15.71:0/1718967373 learned_addr learned my addr 172.21.15.71:0/1718967373 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:30.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.509+0000 7fa3f37fe700 1 --2- 172.21.15.71:0/1718967373 >> v2:172.21.15.179:3300/0 conn(0x7fa3f40ad870 0x7fa3f406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:30.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.509+0000 7fa3f3fff700 1 --1- 172.21.15.71:0/1718967373 >> v1:172.21.15.179:6789/0 conn(0x7fa3f4142ea0 0x7fa3f40b3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:55108/0 (socket says 172.21.15.71:55108) 2023-10-09T06:58:30.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.509+0000 7fa3f8f9c700 1 -- 172.21.15.71:0/1718967373 >> v2:172.21.15.179:3300/0 conn(0x7fa3f40ad870 msgr2=0x7fa3f406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:30.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.509+0000 7fa3f8f9c700 1 --2- 172.21.15.71:0/1718967373 >> v2:172.21.15.179:3300/0 conn(0x7fa3f40ad870 0x7fa3f406b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.509+0000 7fa3f8f9c700 1 -- 172.21.15.71:0/1718967373 >> v1:172.21.15.179:6789/0 conn(0x7fa3f4142ea0 legacy=0x7fa3f40b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:30.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.509+0000 7fa3f8f9c700 1 -- 172.21.15.71:0/1718967373 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f4069920 con 0x7fa3f406bf20 2023-10-09T06:58:30.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.510+0000 7fa3f8f9c700 1 --2- 172.21.15.71:0/1718967373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3f406bf20 0x7fa3f406a120 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40b0e10 tx=0x7fa3ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a793325843524e84 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:30.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.510+0000 7fa3f2ffd700 1 -- 172.21.15.71:0/1718967373 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec00e070 con 0x7fa3f406bf20 2023-10-09T06:58:30.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.510+0000 7fa3f2ffd700 1 -- 172.21.15.71:0/1718967373 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ec00ba20 con 0x7fa3f406bf20 2023-10-09T06:58:30.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.510+0000 7fa3f2ffd700 1 -- 172.21.15.71:0/1718967373 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec0092e0 con 0x7fa3f406bf20 2023-10-09T06:58:30.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.510+0000 7fa3f979d700 1 -- 172.21.15.71:0/1718967373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3f406bf20 msgr2=0x7fa3f406a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:30.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.510+0000 7fa3f979d700 1 --2- 172.21.15.71:0/1718967373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3f406bf20 0x7fa3f406a120 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40b0e10 tx=0x7fa3ec009840 comp rx=0 tx=0).stop 2023-10-09T06:58:30.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.511+0000 7fa3f979d700 1 -- 172.21.15.71:0/1718967373 shutdown_connections 2023-10-09T06:58:30.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.511+0000 7fa3f979d700 1 --2- 172.21.15.71:0/1718967373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3f406bf20 0x7fa3f406a120 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.511+0000 7fa3f979d700 1 --2- 172.21.15.71:0/1718967373 >> v2:172.21.15.179:3300/0 conn(0x7fa3f40ad870 0x7fa3f406b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.511+0000 7fa3f979d700 1 -- 172.21.15.71:0/1718967373 >> 172.21.15.71:0/1718967373 conn(0x7fa3f40ce430 msgr2=0x7fa3f40ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:30.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.511+0000 7fa3f979d700 1 -- 172.21.15.71:0/1718967373 shutdown_connections 2023-10-09T06:58:30.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.511+0000 7fa3f979d700 1 -- 172.21.15.71:0/1718967373 wait complete. 2023-10-09T06:58:30.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.512+0000 7fa3f979d700 1 Processor -- start 2023-10-09T06:58:30.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.512+0000 7fa3f979d700 1 -- start start 2023-10-09T06:58:30.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.513+0000 7fa3f979d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3f406bf20 0x7fa3f4169c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:30.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.513+0000 7fa3f979d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3f4142ea0 0x7fa3f40acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:30.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.513+0000 7fa3f979d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3f40c85b0 0x7fa3f415c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:30.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.513+0000 7fa3f979d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40c9a80 con 0x7fa3f406bf20 2023-10-09T06:58:30.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.513+0000 7fa3f979d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40c8e00 con 0x7fa3f40c85b0 2023-10-09T06:58:30.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.513+0000 7fa3f979d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40c90e0 con 0x7fa3f4142ea0 2023-10-09T06:58:30.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.513+0000 7fa3f3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3f406bf20 0x7fa3f4169c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:30.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.513+0000 7fa3f3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3f406bf20 0x7fa3f4169c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53604/0 (socket says 172.21.15.71:53604) 2023-10-09T06:58:30.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.513+0000 7fa3f3fff700 1 -- 172.21.15.71:0/964927485 learned_addr learned my addr 172.21.15.71:0/964927485 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:30.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.513+0000 7fa3f8f9c700 1 --2- 172.21.15.71:0/964927485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3f40c85b0 0x7fa3f415c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:30.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.513+0000 7fa3f37fe700 1 --2- 172.21.15.71:0/964927485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3f4142ea0 0x7fa3f40acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.514+0000 7fa3f3fff700 1 -- 172.21.15.71:0/964927485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3f4142ea0 msgr2=0x7fa3f40acbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.514+0000 7fa3f3fff700 1 --2- 172.21.15.71:0/964927485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3f4142ea0 0x7fa3f40acbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.514+0000 7fa3f3fff700 1 -- 172.21.15.71:0/964927485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3f40c85b0 msgr2=0x7fa3f415c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.514+0000 7fa3f3fff700 1 --2- 172.21.15.71:0/964927485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3f40c85b0 0x7fa3f415c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.514+0000 7fa3f3fff700 1 -- 172.21.15.71:0/964927485 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec009ae0 con 0x7fa3f406bf20 2023-10-09T06:58:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.514+0000 7fa3f3fff700 1 --2- 172.21.15.71:0/964927485 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3f406bf20 0x7fa3f4169c20 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa3e400c560 tx=0x7fa3e4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:30.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.514+0000 7fa3dbfff700 1 -- 172.21.15.71:0/964927485 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4005a70 con 0x7fa3f406bf20 2023-10-09T06:58:30.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.514+0000 7fa3dbfff700 1 -- 172.21.15.71:0/964927485 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e4005bd0 con 0x7fa3f406bf20 2023-10-09T06:58:30.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.514+0000 7fa3dbfff700 1 -- 172.21.15.71:0/964927485 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e40070d0 con 0x7fa3f406bf20 2023-10-09T06:58:30.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.514+0000 7fa3f979d700 1 -- 172.21.15.71:0/964927485 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f40c93c0 con 0x7fa3f406bf20 2023-10-09T06:58:30.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.514+0000 7fa3f979d700 1 -- 172.21.15.71:0/964927485 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f40ad120 con 0x7fa3f406bf20 2023-10-09T06:58:30.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.515+0000 7fa3f979d700 1 -- 172.21.15.71:0/964927485 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f40b3e60 con 0x7fa3f406bf20 2023-10-09T06:58:30.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.516+0000 7fa3dbfff700 1 -- 172.21.15.71:0/964927485 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fa3e4007480 con 0x7fa3f406bf20 2023-10-09T06:58:30.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.517+0000 7fa3dbfff700 1 --2- 172.21.15.71:0/964927485 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa3e00670e0 0x7fa3e0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:30.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.517+0000 7fa3dbfff700 1 -- 172.21.15.71:0/964927485 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fa3e4083ef0 con 0x7fa3f406bf20 2023-10-09T06:58:30.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.517+0000 7fa3f37fe700 1 -- 172.21.15.71:0/964927485 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa3e00670e0 msgr2=0x7fa3e0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:30.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.517+0000 7fa3f37fe700 1 --2- 172.21.15.71:0/964927485 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa3e00670e0 0x7fa3e0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:58:30.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.521+0000 7fa3dbfff700 1 -- 172.21.15.71:0/964927485 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3e4050bb0 con 0x7fa3f406bf20 2023-10-09T06:58:30.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.718+0000 7fa3f37fe700 1 -- 172.21.15.71:0/964927485 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa3e00670e0 msgr2=0x7fa3e0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:30.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.718+0000 7fa3f37fe700 1 --2- 172.21.15.71:0/964927485 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa3e00670e0 0x7fa3e0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:58:30.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.724+0000 7fa3f979d700 1 -- 172.21.15.71:0/964927485 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3f404c3c0 con 0x7fa3f406bf20 2023-10-09T06:58:30.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.725+0000 7fa3dbfff700 1 -- 172.21.15.71:0/964927485 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+16320 (secure 0 0 0) 0x7fa3e4017020 con 0x7fa3f406bf20 2023-10-09T06:58:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:30.725 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":94,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:58:23.837542+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:58:01.931617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T06:58:02.718563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6833/85452":"2023-10-10T06:58:23.837509+0000","172.21.15.179:0/3414133961":"2023-10-10T06:58:23.837509+0000","172.21.15.179:0/1165861819":"2023-10-10T06:58:23.837509+0000","172.21.15.179:6832/85452":"2023-10-10T06:58:23.837509+0000","172.21.15.179:0/2303709833":"2023-10-10T06:58:23.837509+0000","172.21.15.179:0/4140042527":"2023-10-10T06:58:23.837509+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:58:30.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.727+0000 7fa3f979d700 1 -- 172.21.15.71:0/964927485 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa3e00670e0 msgr2=0x7fa3e0069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:58:30.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.727+0000 7fa3f979d700 1 --2- 172.21.15.71:0/964927485 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa3e00670e0 0x7fa3e0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.727+0000 7fa3f979d700 1 -- 172.21.15.71:0/964927485 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3f406bf20 msgr2=0x7fa3f4169c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:30.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.727+0000 7fa3f979d700 1 --2- 172.21.15.71:0/964927485 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3f406bf20 0x7fa3f4169c20 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa3e400c560 tx=0x7fa3e4007f70 comp rx=0 tx=0).stop 2023-10-09T06:58:30.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.727+0000 7fa3f979d700 1 -- 172.21.15.71:0/964927485 shutdown_connections 2023-10-09T06:58:30.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.727+0000 7fa3f979d700 1 --2- 172.21.15.71:0/964927485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3f40c85b0 0x7fa3f415c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.727+0000 7fa3f979d700 1 --2- 172.21.15.71:0/964927485 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fa3e00670e0 0x7fa3e0069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.727+0000 7fa3f979d700 1 --2- 172.21.15.71:0/964927485 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3f406bf20 0x7fa3f4169c20 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.727+0000 7fa3f979d700 1 --2- 172.21.15.71:0/964927485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3f4142ea0 0x7fa3f40acbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.727+0000 7fa3f979d700 1 -- 172.21.15.71:0/964927485 >> 172.21.15.71:0/964927485 conn(0x7fa3f40ce430 msgr2=0x7fa3f40b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:30.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.728+0000 7fa3f979d700 1 -- 172.21.15.71:0/964927485 shutdown_connections 2023-10-09T06:58:30.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.728+0000 7fa3f979d700 1 -- 172.21.15.71:0/964927485 wait complete. 2023-10-09T06:58:30.745 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T06:58:30.832 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:30.832+0000 7fa17e510180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T06:58:30.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.932+0000 7f2b9d59d700 1 Processor -- start 2023-10-09T06:58:30.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.932+0000 7f2b9d59d700 1 -- start start 2023-10-09T06:58:30.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.933+0000 7f2b9d59d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2b980c6c60 0x7f2b980c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:30.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.933+0000 7f2b9d59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b9806e8c0 0x7f2b980c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:30.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.933+0000 7f2b9d59d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b980b1410 con 0x7f2b981595a0 2023-10-09T06:58:30.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.933+0000 7f2b9d59d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b980b2b90 con 0x7f2b980c6c60 2023-10-09T06:58:30.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.933+0000 7f2b9d59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b98063230 con 0x7f2b9806e8c0 2023-10-09T06:58:30.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.934+0000 7f2b97fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f2b981595a0 0x7f2b980b18a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47482/0 (socket says 172.21.15.71:47482) 2023-10-09T06:58:30.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.934+0000 7f2b97fff700 1 -- 172.21.15.71:0/1605669918 learned_addr learned my addr 172.21.15.71:0/1605669918 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:30.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.934+0000 7f2b9cd9c700 1 --2- 172.21.15.71:0/1605669918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b9806e8c0 0x7f2b980c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:30.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.934+0000 7f2b977fe700 1 --2- 172.21.15.71:0/1605669918 >> v2:172.21.15.179:3300/0 conn(0x7f2b980c6c60 0x7f2b980c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:30.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.934+0000 7f2b96ffd700 1 -- 172.21.15.71:0/1605669918 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1459222346 0 0) 0x7f2b980b1410 con 0x7f2b981595a0 2023-10-09T06:58:30.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.934+0000 7f2b96ffd700 1 -- 172.21.15.71:0/1605669918 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b80003570 con 0x7f2b981595a0 2023-10-09T06:58:30.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.934+0000 7f2b9cd9c700 1 -- 172.21.15.71:0/1605669918 >> v2:172.21.15.179:3300/0 conn(0x7f2b980c6c60 msgr2=0x7f2b980c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:30.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.934+0000 7f2b9cd9c700 1 --2- 172.21.15.71:0/1605669918 >> v2:172.21.15.179:3300/0 conn(0x7f2b980c6c60 0x7f2b980c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.934+0000 7f2b9cd9c700 1 -- 172.21.15.71:0/1605669918 >> v1:172.21.15.71:6789/0 conn(0x7f2b981595a0 legacy=0x7f2b980b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:30.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.934+0000 7f2b9cd9c700 1 -- 172.21.15.71:0/1605669918 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b980634f0 con 0x7f2b9806e8c0 2023-10-09T06:58:30.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.934+0000 7f2b977fe700 1 --2- 172.21.15.71:0/1605669918 >> v2:172.21.15.179:3300/0 conn(0x7f2b980c6c60 0x7f2b980c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:58:30.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.935+0000 7f2b9cd9c700 1 --2- 172.21.15.71:0/1605669918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b9806e8c0 0x7f2b980c8660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2b90009e60 tx=0x7f2b90009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3cb330bf3dfb1ad server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:30.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.935+0000 7f2b96ffd700 1 -- 172.21.15.71:0/1605669918 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9000e070 con 0x7f2b9806e8c0 2023-10-09T06:58:30.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.935+0000 7f2b96ffd700 1 -- 172.21.15.71:0/1605669918 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9000bab0 con 0x7f2b9806e8c0 2023-10-09T06:58:30.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.935+0000 7f2b96ffd700 1 -- 172.21.15.71:0/1605669918 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9000be70 con 0x7f2b9806e8c0 2023-10-09T06:58:30.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.935+0000 7f2b9d59d700 1 -- 172.21.15.71:0/1605669918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b9806e8c0 msgr2=0x7f2b980c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:30.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.935+0000 7f2b9d59d700 1 --2- 172.21.15.71:0/1605669918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b9806e8c0 0x7f2b980c8660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2b90009e60 tx=0x7f2b90009780 comp rx=0 tx=0).stop 2023-10-09T06:58:30.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.935+0000 7f2b9d59d700 1 -- 172.21.15.71:0/1605669918 shutdown_connections 2023-10-09T06:58:30.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.935+0000 7f2b9d59d700 1 --2- 172.21.15.71:0/1605669918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b9806e8c0 0x7f2b980c8660 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.935+0000 7f2b9d59d700 1 --2- 172.21.15.71:0/1605669918 >> v2:172.21.15.179:3300/0 conn(0x7f2b980c6c60 0x7f2b980c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.935+0000 7f2b9d59d700 1 -- 172.21.15.71:0/1605669918 >> 172.21.15.71:0/1605669918 conn(0x7f2b9806ddb0 msgr2=0x7f2b9806e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:30.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.936+0000 7f2b9d59d700 1 -- 172.21.15.71:0/1605669918 shutdown_connections 2023-10-09T06:58:30.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.936+0000 7f2b9d59d700 1 -- 172.21.15.71:0/1605669918 wait complete. 2023-10-09T06:58:30.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.937+0000 7f2b9d59d700 1 Processor -- start 2023-10-09T06:58:30.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.937+0000 7f2b9d59d700 1 -- start start 2023-10-09T06:58:30.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.938+0000 7f2b9d59d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b9806e8c0 0x7f2b9816d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:30.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.938+0000 7f2b9d59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b980c6c60 0x7f2b981404c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:30.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.938+0000 7f2b9d59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b981595a0 0x7f2b980c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:30.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.938+0000 7f2b9d59d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b98152340 con 0x7f2b9806e8c0 2023-10-09T06:58:30.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.938+0000 7f2b9d59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b981699c0 con 0x7f2b980c6c60 2023-10-09T06:58:30.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.938+0000 7f2b9d59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9816a260 con 0x7f2b981595a0 2023-10-09T06:58:30.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.938+0000 7f2b97fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b9806e8c0 0x7f2b9816d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:30.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.938+0000 7f2b97fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b9806e8c0 0x7f2b9816d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53616/0 (socket says 172.21.15.71:53616) 2023-10-09T06:58:30.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.938+0000 7f2b97fff700 1 -- 172.21.15.71:0/2567597277 learned_addr learned my addr 172.21.15.71:0/2567597277 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:30.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.938+0000 7f2b977fe700 1 --2- 172.21.15.71:0/2567597277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b980c6c60 0x7f2b981404c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:30.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.938+0000 7f2b9cd9c700 1 --2- 172.21.15.71:0/2567597277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b981595a0 0x7f2b980c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:30.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.939+0000 7f2b97fff700 1 -- 172.21.15.71:0/2567597277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b981595a0 msgr2=0x7f2b980c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:30.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.939+0000 7f2b97fff700 1 --2- 172.21.15.71:0/2567597277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b981595a0 0x7f2b980c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.939+0000 7f2b97fff700 1 -- 172.21.15.71:0/2567597277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b980c6c60 msgr2=0x7f2b981404c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:30.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.939+0000 7f2b97fff700 1 --2- 172.21.15.71:0/2567597277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b980c6c60 0x7f2b981404c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:30.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.939+0000 7f2b97fff700 1 -- 172.21.15.71:0/2567597277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c009420 con 0x7f2b9806e8c0 2023-10-09T06:58:30.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.939+0000 7f2b9cd9c700 1 --2- 172.21.15.71:0/2567597277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b981595a0 0x7f2b980c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:30.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.939+0000 7f2b97fff700 1 --2- 172.21.15.71:0/2567597277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b9806e8c0 0x7f2b9816d9f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800c5c0 tx=0x7f2b88007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:30.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.939+0000 7f2b7ffff700 1 -- 172.21.15.71:0/2567597277 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b88005b30 con 0x7f2b9806e8c0 2023-10-09T06:58:30.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.939+0000 7f2b7ffff700 1 -- 172.21.15.71:0/2567597277 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b88005cb0 con 0x7f2b9806e8c0 2023-10-09T06:58:30.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.939+0000 7f2b7ffff700 1 -- 172.21.15.71:0/2567597277 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b88007320 con 0x7f2b9806e8c0 2023-10-09T06:58:30.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.939+0000 7f2b9d59d700 1 -- 172.21.15.71:0/2567597277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b90009a20 con 0x7f2b9806e8c0 2023-10-09T06:58:30.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.939+0000 7f2b9d59d700 1 -- 172.21.15.71:0/2567597277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b98169c10 con 0x7f2b9806e8c0 2023-10-09T06:58:30.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.940+0000 7f2b9d59d700 1 -- 172.21.15.71:0/2567597277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b9804c3c0 con 0x7f2b9806e8c0 2023-10-09T06:58:30.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.941+0000 7f2b7ffff700 1 -- 172.21.15.71:0/2567597277 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f2b8801b3b0 con 0x7f2b9806e8c0 2023-10-09T06:58:30.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.942+0000 7f2b7ffff700 1 --2- 172.21.15.71:0/2567597277 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2b840670e0 0x7f2b84069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:30.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.942+0000 7f2b7ffff700 1 -- 172.21.15.71:0/2567597277 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f2b88083fe0 con 0x7f2b9806e8c0 2023-10-09T06:58:30.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.942+0000 7f2b977fe700 1 -- 172.21.15.71:0/2567597277 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2b840670e0 msgr2=0x7f2b84069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:30.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.942+0000 7f2b977fe700 1 --2- 172.21.15.71:0/2567597277 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2b840670e0 0x7f2b84069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:58:30.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:30.946+0000 7f2b7ffff700 1 -- 172.21.15.71:0/2567597277 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b88050d00 con 0x7f2b9806e8c0 2023-10-09T06:58:30.997 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:30.997+0000 7fe8b2898180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T06:58:31.122 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:31.121+0000 7fa17e510180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T06:58:31.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.143+0000 7f2b977fe700 1 -- 172.21.15.71:0/2567597277 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2b840670e0 msgr2=0x7f2b84069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:31.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.143+0000 7f2b977fe700 1 --2- 172.21.15.71:0/2567597277 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2b840670e0 0x7f2b84069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:58:31.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.191+0000 7f2b9d59d700 1 -- 172.21.15.71:0/2567597277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2b980637d0 con 0x7f2b9806e8c0 2023-10-09T06:58:31.191 INFO:tasks.ceph.mon.a.smithi071.stderr:2023-10-09T06:58:31.191+0000 7fdb445f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T06:58:31.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.197+0000 7f2b7ffff700 1 -- 172.21.15.71:0/2567597277 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2b88017090 con 0x7f2b9806e8c0 2023-10-09T06:58:31.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.200+0000 7f2b9d59d700 1 -- 172.21.15.71:0/2567597277 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2b840670e0 msgr2=0x7f2b84069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:58:31.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.200+0000 7f2b9d59d700 1 --2- 172.21.15.71:0/2567597277 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2b840670e0 0x7f2b84069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:31.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.200+0000 7f2b9d59d700 1 -- 172.21.15.71:0/2567597277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b9806e8c0 msgr2=0x7f2b9816d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:31.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.200+0000 7f2b9d59d700 1 --2- 172.21.15.71:0/2567597277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b9806e8c0 0x7f2b9816d9f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800c5c0 tx=0x7f2b88007e00 comp rx=0 tx=0).stop 2023-10-09T06:58:31.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.200+0000 7f2b9d59d700 1 -- 172.21.15.71:0/2567597277 shutdown_connections 2023-10-09T06:58:31.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.200+0000 7f2b9d59d700 1 --2- 172.21.15.71:0/2567597277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b981595a0 0x7f2b980c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:31.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.200+0000 7f2b9d59d700 1 --2- 172.21.15.71:0/2567597277 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2b840670e0 0x7f2b84069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:31.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.200+0000 7f2b9d59d700 1 --2- 172.21.15.71:0/2567597277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b9806e8c0 0x7f2b9816d9f0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:31.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.200+0000 7f2b9d59d700 1 --2- 172.21.15.71:0/2567597277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b980c6c60 0x7f2b981404c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:31.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.200+0000 7f2b9d59d700 1 -- 172.21.15.71:0/2567597277 >> 172.21.15.71:0/2567597277 conn(0x7f2b9806ddb0 msgr2=0x7f2b980cb560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:31.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.200+0000 7f2b9d59d700 1 -- 172.21.15.71:0/2567597277 shutdown_connections 2023-10-09T06:58:31.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.200+0000 7f2b9d59d700 1 -- 172.21.15.71:0/2567597277 wait complete. 2023-10-09T06:58:31.202 INFO:teuthology.orchestra.run.smithi071.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T06:58:31.203 INFO:tasks.ceph.mds.c.smithi071.stderr: -1235> 2023-10-09T06:58:09.243+0000 7f1d197f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:58:31.216 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:31.216+0000 7fa17e510180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T06:58:31.219 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T06:58:31.241 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-10-09T06:58:31.300 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:31.300+0000 7fe8b2898180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T06:58:31.375 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:31.375+0000 7fa17e510180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T06:58:31.398 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:31.398+0000 7fe8b2898180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T06:58:31.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.414+0000 7f0779fff700 1 Processor -- start 2023-10-09T06:58:31.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.414+0000 7f0779fff700 1 -- start start 2023-10-09T06:58:31.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.416+0000 7f0779fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0774159890 0x7f077415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:31.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.416+0000 7f0779fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0774069560 0x7f07740699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:31.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.416+0000 7f0779fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0774069ee0 con 0x7f0774159c60 2023-10-09T06:58:31.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.416+0000 7f0779fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077415a160 con 0x7f0774159890 2023-10-09T06:58:31.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.416+0000 7f0779fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07740d13a0 con 0x7f0774069560 2023-10-09T06:58:31.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.416+0000 7f0772ffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f0774159c60 0x7f077415d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47494/0 (socket says 172.21.15.71:47494) 2023-10-09T06:58:31.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.416+0000 7f0772ffd700 1 -- 172.21.15.71:0/3251127523 learned_addr learned my addr 172.21.15.71:0/3251127523 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:31.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.416+0000 7f07737fe700 1 --2- 172.21.15.71:0/3251127523 >> v2:172.21.15.179:3300/0 conn(0x7f0774159890 0x7f077415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:31.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.416+0000 7f0773fff700 1 --2- 172.21.15.71:0/3251127523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0774069560 0x7f07740699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:31.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.417+0000 7f07727fc700 1 -- 172.21.15.71:0/3251127523 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468056276 0 0) 0x7f0774069ee0 con 0x7f0774159c60 2023-10-09T06:58:31.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.417+0000 7f07727fc700 1 -- 172.21.15.71:0/3251127523 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f075c003570 con 0x7f0774159c60 2023-10-09T06:58:31.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.417+0000 7f07737fe700 1 -- 172.21.15.71:0/3251127523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0774069560 msgr2=0x7f07740699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:31.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.417+0000 7f07737fe700 1 --2- 172.21.15.71:0/3251127523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0774069560 0x7f07740699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:31.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.417+0000 7f07737fe700 1 -- 172.21.15.71:0/3251127523 >> v1:172.21.15.71:6789/0 conn(0x7f0774159c60 legacy=0x7f077415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:31.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.417+0000 7f07737fe700 1 -- 172.21.15.71:0/3251127523 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077415e140 con 0x7f0774159890 2023-10-09T06:58:31.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.417+0000 7f07737fe700 1 --2- 172.21.15.71:0/3251127523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0774159890 0x7f077415abd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f07640098e0 tx=0x7f07640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c370ced8b877ed0b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:31.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.417+0000 7f07727fc700 1 -- 172.21.15.71:0/3251127523 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0764011630 con 0x7f0774159890 2023-10-09T06:58:31.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.417+0000 7f07727fc700 1 -- 172.21.15.71:0/3251127523 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0764011790 con 0x7f0774159890 2023-10-09T06:58:31.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.417+0000 7f07727fc700 1 -- 172.21.15.71:0/3251127523 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0764011b30 con 0x7f0774159890 2023-10-09T06:58:31.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.418+0000 7f0779fff700 1 -- 172.21.15.71:0/3251127523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0774159890 msgr2=0x7f077415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:31.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.418+0000 7f0779fff700 1 --2- 172.21.15.71:0/3251127523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0774159890 0x7f077415abd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f07640098e0 tx=0x7f07640091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:31.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.418+0000 7f0779fff700 1 -- 172.21.15.71:0/3251127523 shutdown_connections 2023-10-09T06:58:31.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.418+0000 7f0779fff700 1 --2- 172.21.15.71:0/3251127523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0774069560 0x7f07740699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:31.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.418+0000 7f0779fff700 1 --2- 172.21.15.71:0/3251127523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0774159890 0x7f077415abd0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:31.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.418+0000 7f0779fff700 1 -- 172.21.15.71:0/3251127523 >> 172.21.15.71:0/3251127523 conn(0x7f0774068e20 msgr2=0x7f07740d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:31.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.418+0000 7f0779fff700 1 -- 172.21.15.71:0/3251127523 shutdown_connections 2023-10-09T06:58:31.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.418+0000 7f0779fff700 1 -- 172.21.15.71:0/3251127523 wait complete. 2023-10-09T06:58:31.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.420+0000 7f0779fff700 1 Processor -- start 2023-10-09T06:58:31.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.420+0000 7f0779fff700 1 -- start start 2023-10-09T06:58:31.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.421+0000 7f0779fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0774069560 0x7f077416c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:31.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.421+0000 7f0779fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0774159890 0x7f07740c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:31.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.421+0000 7f0779fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0774159c60 0x7f07740b5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:31.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.421+0000 7f0779fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07740b4f90 con 0x7f0774159c60 2023-10-09T06:58:31.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.421+0000 7f0779fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07740b4380 con 0x7f0774069560 2023-10-09T06:58:31.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.421+0000 7f0779fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07740b4660 con 0x7f0774159890 2023-10-09T06:58:31.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.421+0000 7f0773fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0774159c60 0x7f07740b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:31.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.421+0000 7f0773fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0774159c60 0x7f07740b5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53648/0 (socket says 172.21.15.71:53648) 2023-10-09T06:58:31.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.421+0000 7f0772ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0774159890 0x7f07740c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:31.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.421+0000 7f07737fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0774069560 0x7f077416c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:31.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.421+0000 7f0773fff700 1 -- 172.21.15.71:0/910254211 learned_addr learned my addr 172.21.15.71:0/910254211 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:31.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.421+0000 7f0773fff700 1 -- 172.21.15.71:0/910254211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0774159890 msgr2=0x7f07740c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:31.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.421+0000 7f0773fff700 1 --2- 172.21.15.71:0/910254211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0774159890 0x7f07740c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:31.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.421+0000 7f0773fff700 1 -- 172.21.15.71:0/910254211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0774069560 msgr2=0x7f077416c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:31.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.421+0000 7f0773fff700 1 --2- 172.21.15.71:0/910254211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0774069560 0x7f077416c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:31.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.422+0000 7f0773fff700 1 -- 172.21.15.71:0/910254211 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0764009420 con 0x7f0774159c60 2023-10-09T06:58:31.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.422+0000 7f0773fff700 1 --2- 172.21.15.71:0/910254211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0774159c60 0x7f07740b5830 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f076c009df0 tx=0x7f076c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:31.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.422+0000 7f075b7fe700 1 -- 172.21.15.71:0/910254211 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c00caa0 con 0x7f0774159c60 2023-10-09T06:58:31.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.422+0000 7f075b7fe700 1 -- 172.21.15.71:0/910254211 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c00f040 con 0x7f0774159c60 2023-10-09T06:58:31.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.422+0000 7f0779fff700 1 -- 172.21.15.71:0/910254211 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07740b4940 con 0x7f0774159c60 2023-10-09T06:58:31.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.422+0000 7f075b7fe700 1 -- 172.21.15.71:0/910254211 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c00ce70 con 0x7f0774159c60 2023-10-09T06:58:31.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.422+0000 7f0779fff700 1 -- 172.21.15.71:0/910254211 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077416ceb0 con 0x7f0774159c60 2023-10-09T06:58:31.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.423+0000 7f0779fff700 1 -- 172.21.15.71:0/910254211 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0774169c90 con 0x7f0774159c60 2023-10-09T06:58:31.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.425+0000 7f075b7fe700 1 -- 172.21.15.71:0/910254211 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f076c014690 con 0x7f0774159c60 2023-10-09T06:58:31.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.426+0000 7f075b7fe700 1 --2- 172.21.15.71:0/910254211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f07600670e0 0x7f0760069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:31.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.426+0000 7f075b7fe700 1 -- 172.21.15.71:0/910254211 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6441+0+0 (secure 0 0 0) 0x7f076c085760 con 0x7f0774159c60 2023-10-09T06:58:31.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.426+0000 7f07737fe700 1 -- 172.21.15.71:0/910254211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f07600670e0 msgr2=0x7f0760069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:31.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.426+0000 7f07737fe700 1 --2- 172.21.15.71:0/910254211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f07600670e0 0x7f0760069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:58:31.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.430+0000 7f075b7fe700 1 -- 172.21.15.71:0/910254211 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0774169c90 con 0x7f0774159c60 2023-10-09T06:58:31.481 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:31.481+0000 7fa17e510180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T06:58:31.558 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:31.558+0000 7fe8b2898180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T06:58:31.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.627+0000 7f07737fe700 1 -- 172.21.15.71:0/910254211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f07600670e0 msgr2=0x7f0760069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:31.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.627+0000 7f07737fe700 1 --2- 172.21.15.71:0/910254211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f07600670e0 0x7f0760069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:58:31.664 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:31.665+0000 7fe8b2898180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T06:58:31.670 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:31.669+0000 7fa17e510180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T06:58:31.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.671+0000 7f0779fff700 1 -- 172.21.15.71:0/910254211 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0774169c50 con 0x7f0774159c60 2023-10-09T06:58:31.763 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:31.762+0000 7fa17e510180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T06:58:31.855 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:31.854+0000 7fa17e510180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T06:58:31.856 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:31.856+0000 7fe8b2898180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T06:58:31.949 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:31.949+0000 7fa17e510180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T06:58:31.950 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:31.950+0000 7fe8b2898180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T06:58:31.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.959+0000 7f075b7fe700 1 -- 172.21.15.71:0/910254211 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 38) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f076c052730 con 0x7f0774159c60 2023-10-09T06:58:31.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.959+0000 7f075b7fe700 1 -- 172.21.15.71:0/910254211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f07600670e0 msgr2=0x7f0760069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:58:31.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:31.959+0000 7f075b7fe700 1 --2- 172.21.15.71:0/910254211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f07600670e0 0x7f0760069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:32.027 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:32.026+0000 7fa0f98c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:58:32.027 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:32.026+0000 7fa0f98c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:58:32.028 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:32.026+0000 7fa0f98c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:58:32.028 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:32.026+0000 7fa0f98c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:58:32.028 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:32.026+0000 7fa0f98c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:58:32.028 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:32.026+0000 7fa0fc0c8700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:58:32.028 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:32.026+0000 7fa0fc0c8700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:58:32.028 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:32.026+0000 7fa0fc0c8700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:58:32.028 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:32.026+0000 7fa0fc0c8700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:58:32.028 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:32.026+0000 7fa0fc0c8700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:58:32.051 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:32.051+0000 7fe8b2898180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T06:58:32.142 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:32.143+0000 7fe8b2898180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T06:58:32.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.198+0000 7f075b7fe700 1 -- 172.21.15.71:0/910254211 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v43) v1 ==== 104+0+0 (secure 0 0 0) 0x7f076c0706e0 con 0x7f0774159c60 2023-10-09T06:58:32.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.200+0000 7f0779fff700 1 -- 172.21.15.71:0/910254211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0774159c60 msgr2=0x7f07740b5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:32.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.200+0000 7f0779fff700 1 --2- 172.21.15.71:0/910254211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0774159c60 0x7f07740b5830 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f076c009df0 tx=0x7f076c00b040 comp rx=0 tx=0).stop 2023-10-09T06:58:32.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.200+0000 7f0779fff700 1 -- 172.21.15.71:0/910254211 shutdown_connections 2023-10-09T06:58:32.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.200+0000 7f0779fff700 1 --2- 172.21.15.71:0/910254211 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f07600670e0 0x7f0760069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:32.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.200+0000 7f0779fff700 1 --2- 172.21.15.71:0/910254211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0774159c60 0x7f07740b5830 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:32.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.200+0000 7f0779fff700 1 --2- 172.21.15.71:0/910254211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0774069560 0x7f077416c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:32.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.200+0000 7f0779fff700 1 --2- 172.21.15.71:0/910254211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0774159890 0x7f07740c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:32.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.200+0000 7f0779fff700 1 -- 172.21.15.71:0/910254211 >> 172.21.15.71:0/910254211 conn(0x7f0774068e20 msgr2=0x7f07740b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:32.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.201+0000 7f0779fff700 1 -- 172.21.15.71:0/910254211 shutdown_connections 2023-10-09T06:58:32.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.201+0000 7f0779fff700 1 -- 172.21.15.71:0/910254211 wait complete. 2023-10-09T06:58:32.219 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T06:58:32.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.446+0000 7f086d5ff700 1 Processor -- start 2023-10-09T06:58:32.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.446+0000 7f086d5ff700 1 -- start start 2023-10-09T06:58:32.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.447+0000 7f086d5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0868069a50 0x7f08680c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:32.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.447+0000 7f086d5ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f08680c8490 0x7f086815a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:32.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.447+0000 7f086d5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0868069e20 0x7f086806e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:32.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.447+0000 7f086d5ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08680ac030 con 0x7f08680c8490 2023-10-09T06:58:32.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.447+0000 7f086d5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08680ab820 con 0x7f0868069a50 2023-10-09T06:58:32.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.447+0000 7f086d5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086806dbb0 con 0x7f0868069e20 2023-10-09T06:58:32.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.447+0000 7f085ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f08680c8490 0x7f086815a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:32.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.447+0000 7f085ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f08680c8490 0x7f086815a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53654/0 (socket says 172.21.15.71:53654) 2023-10-09T06:58:32.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.447+0000 7f085ffff700 1 -- 172.21.15.71:0/1696687366 learned_addr learned my addr 172.21.15.71:0/1696687366 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:32.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.447+0000 7f08677fe700 1 --2- 172.21.15.71:0/1696687366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0868069e20 0x7f086806e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:32.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.447+0000 7f0866ffd700 1 --2- 172.21.15.71:0/1696687366 >> v2:172.21.15.179:3300/0 conn(0x7f0868069a50 0x7f08680c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:32.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.448+0000 7f085ffff700 1 -- 172.21.15.71:0/1696687366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0868069e20 msgr2=0x7f086806e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:32.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.448+0000 7f085ffff700 1 --2- 172.21.15.71:0/1696687366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0868069e20 0x7f086806e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:32.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.448+0000 7f085ffff700 1 -- 172.21.15.71:0/1696687366 >> v2:172.21.15.179:3300/0 conn(0x7f0868069a50 msgr2=0x7f08680c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:32.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.448+0000 7f085ffff700 1 --2- 172.21.15.71:0/1696687366 >> v2:172.21.15.179:3300/0 conn(0x7f0868069a50 0x7f08680c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:32.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.448+0000 7f085ffff700 1 -- 172.21.15.71:0/1696687366 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086815a9d0 con 0x7f08680c8490 2023-10-09T06:58:32.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.448+0000 7f085ffff700 1 --2- 172.21.15.71:0/1696687366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08680c8490 0x7f086815a490 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f086806b970 tx=0x7f0850009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab8b9614043de57 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:32.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.448+0000 7f08667fc700 1 -- 172.21.15.71:0/1696687366 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085000b640 con 0x7f08680c8490 2023-10-09T06:58:32.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.448+0000 7f08667fc700 1 -- 172.21.15.71:0/1696687366 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085000b7a0 con 0x7f08680c8490 2023-10-09T06:58:32.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.448+0000 7f08667fc700 1 -- 172.21.15.71:0/1696687366 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085000bb60 con 0x7f08680c8490 2023-10-09T06:58:32.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.449+0000 7f086d5ff700 1 -- 172.21.15.71:0/1696687366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08680c8490 msgr2=0x7f086815a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:32.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.449+0000 7f086d5ff700 1 --2- 172.21.15.71:0/1696687366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08680c8490 0x7f086815a490 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f086806b970 tx=0x7f0850009250 comp rx=0 tx=0).stop 2023-10-09T06:58:32.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.449+0000 7f086d5ff700 1 -- 172.21.15.71:0/1696687366 shutdown_connections 2023-10-09T06:58:32.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.449+0000 7f086d5ff700 1 --2- 172.21.15.71:0/1696687366 >> v2:172.21.15.179:3300/0 conn(0x7f0868069a50 0x7f08680c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:32.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.449+0000 7f086d5ff700 1 --2- 172.21.15.71:0/1696687366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0868069e20 0x7f086806e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:32.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.449+0000 7f086d5ff700 1 --2- 172.21.15.71:0/1696687366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08680c8490 0x7f086815a490 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:32.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.449+0000 7f086d5ff700 1 -- 172.21.15.71:0/1696687366 >> 172.21.15.71:0/1696687366 conn(0x7f08680c8f90 msgr2=0x7f08680c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:32.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.449+0000 7f086d5ff700 1 -- 172.21.15.71:0/1696687366 shutdown_connections 2023-10-09T06:58:32.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.449+0000 7f086d5ff700 1 -- 172.21.15.71:0/1696687366 wait complete. 2023-10-09T06:58:32.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.450+0000 7f086d5ff700 1 Processor -- start 2023-10-09T06:58:32.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.450+0000 7f086d5ff700 1 -- start start 2023-10-09T06:58:32.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.451+0000 7f086d5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0868069a50 0x7f086814e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:32.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.451+0000 7f086d5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0868069e20 0x7f08681523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:32.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.451+0000 7f086d5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08680c8490 0x7f08680af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:32.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.451+0000 7f086d5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08680ad1f0 con 0x7f0868069e20 2023-10-09T06:58:32.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.451+0000 7f086d5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08680ae670 con 0x7f08680c8490 2023-10-09T06:58:32.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.451+0000 7f086d5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08680ac8c0 con 0x7f0868069a50 2023-10-09T06:58:32.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.452+0000 7f085ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0868069e20 0x7f08681523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:32.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.452+0000 7f085ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0868069e20 0x7f08681523e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53662/0 (socket says 172.21.15.71:53662) 2023-10-09T06:58:32.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.452+0000 7f085ffff700 1 -- 172.21.15.71:0/204154713 learned_addr learned my addr 172.21.15.71:0/204154713 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:32.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.452+0000 7f0866ffd700 1 --2- 172.21.15.71:0/204154713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0868069a50 0x7f086814e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:32.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.452+0000 7f085ffff700 1 -- 172.21.15.71:0/204154713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0868069a50 msgr2=0x7f086814e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:32.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.452+0000 7f08677fe700 1 --2- 172.21.15.71:0/204154713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08680c8490 0x7f08680af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:32.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.452+0000 7f085ffff700 1 --2- 172.21.15.71:0/204154713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0868069a50 0x7f086814e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:32.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.452+0000 7f085ffff700 1 -- 172.21.15.71:0/204154713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08680c8490 msgr2=0x7f08680af4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:32.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.452+0000 7f085ffff700 1 --2- 172.21.15.71:0/204154713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08680c8490 0x7f08680af4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:32.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.452+0000 7f085ffff700 1 -- 172.21.15.71:0/204154713 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08500094f0 con 0x7f0868069e20 2023-10-09T06:58:32.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.452+0000 7f0866ffd700 1 --2- 172.21.15.71:0/204154713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0868069a50 0x7f086814e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:32.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.452+0000 7f08677fe700 1 --2- 172.21.15.71:0/204154713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08680c8490 0x7f08680af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:32.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.452+0000 7f085ffff700 1 --2- 172.21.15.71:0/204154713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0868069e20 0x7f08681523e0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f08680cc0b0 tx=0x7f0850017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:32.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.452+0000 7f085effd700 1 -- 172.21.15.71:0/204154713 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085000b910 con 0x7f0868069e20 2023-10-09T06:58:32.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.452+0000 7f085effd700 1 -- 172.21.15.71:0/204154713 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085000ba70 con 0x7f0868069e20 2023-10-09T06:58:32.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.452+0000 7f085effd700 1 -- 172.21.15.71:0/204154713 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085001a6a0 con 0x7f0868069e20 2023-10-09T06:58:32.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.452+0000 7f086d5ff700 1 -- 172.21.15.71:0/204154713 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08680acba0 con 0x7f0868069e20 2023-10-09T06:58:32.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.453+0000 7f086d5ff700 1 -- 172.21.15.71:0/204154713 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086814eeb0 con 0x7f0868069e20 2023-10-09T06:58:32.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.454+0000 7f086d5ff700 1 -- 172.21.15.71:0/204154713 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08680ad360 con 0x7f0868069e20 2023-10-09T06:58:32.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.454+0000 7f085effd700 1 -- 172.21.15.71:0/204154713 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 38) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f085001aa90 con 0x7f0868069e20 2023-10-09T06:58:32.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.455+0000 7f085effd700 1 -- 172.21.15.71:0/204154713 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6742+0+0 (secure 0 0 0) 0x7f0850085e70 con 0x7f0868069e20 2023-10-09T06:58:32.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.459+0000 7f085effd700 1 -- 172.21.15.71:0/204154713 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0850052fa0 con 0x7f0868069e20 2023-10-09T06:58:32.562 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:58:32.567 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:58:32.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.655+0000 7f086d5ff700 1 -- 172.21.15.71:0/204154713 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f08680718b0 con 0x7f0868069e20 2023-10-09T06:58:32.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.963+0000 7f085effd700 1 -- 172.21.15.71:0/204154713 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 39) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f085001ad40 con 0x7f0868069e20 2023-10-09T06:58:32.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.963+0000 7f085effd700 1 --2- 172.21.15.71:0/204154713 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f084806c9e0 0x7f084806edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:32.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.964+0000 7f0866ffd700 1 --2- 172.21.15.71:0/204154713 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f084806c9e0 0x7f084806edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:32.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:32.966+0000 7f0866ffd700 1 --2- 172.21.15.71:0/204154713 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f084806c9e0 0x7f084806edc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0858006f00 tx=0x7f0858008040 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:33.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.203+0000 7f085effd700 1 -- 172.21.15.71:0/204154713 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v97) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0850059740 con 0x7f0868069e20 2023-10-09T06:58:33.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.206+0000 7f086d5ff700 1 -- 172.21.15.71:0/204154713 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f084806c9e0 msgr2=0x7f084806edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:33.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.206+0000 7f086d5ff700 1 --2- 172.21.15.71:0/204154713 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f084806c9e0 0x7f084806edc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0858006f00 tx=0x7f0858008040 comp rx=0 tx=0).stop 2023-10-09T06:58:33.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.206+0000 7f086d5ff700 1 -- 172.21.15.71:0/204154713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0868069e20 msgr2=0x7f08681523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:33.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.206+0000 7f086d5ff700 1 --2- 172.21.15.71:0/204154713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0868069e20 0x7f08681523e0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f08680cc0b0 tx=0x7f0850017000 comp rx=0 tx=0).stop 2023-10-09T06:58:33.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.206+0000 7f086d5ff700 1 -- 172.21.15.71:0/204154713 shutdown_connections 2023-10-09T06:58:33.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.206+0000 7f086d5ff700 1 --2- 172.21.15.71:0/204154713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08680c8490 0x7f08680af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:33.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.206+0000 7f086d5ff700 1 --2- 172.21.15.71:0/204154713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0868069a50 0x7f086814e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:33.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.206+0000 7f086d5ff700 1 --2- 172.21.15.71:0/204154713 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f084806c9e0 0x7f084806edc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:33.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.206+0000 7f086d5ff700 1 --2- 172.21.15.71:0/204154713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0868069e20 0x7f08681523e0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:33.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.206+0000 7f086d5ff700 1 -- 172.21.15.71:0/204154713 >> 172.21.15.71:0/204154713 conn(0x7f08680c8f90 msgr2=0x7f086806e040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:33.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.207+0000 7f086d5ff700 1 -- 172.21.15.71:0/204154713 shutdown_connections 2023-10-09T06:58:33.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.207+0000 7f086d5ff700 1 -- 172.21.15.71:0/204154713 wait complete. 2023-10-09T06:58:33.209 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' removed 2023-10-09T06:58:33.225 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T06:58:33.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.414+0000 7f89e49fe700 1 Processor -- start 2023-10-09T06:58:33.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.414+0000 7f89e49fe700 1 -- start start 2023-10-09T06:58:33.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.415+0000 7f89e49fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89e00b03c0 0x7f89e00cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:33.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.415+0000 7f89e49fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f89e01591e0 0x7f89e0159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:33.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.415+0000 7f89e49fe700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e00cfa00 con 0x7f89e00b0790 2023-10-09T06:58:33.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.415+0000 7f89e49fe700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e00cb580 con 0x7f89e01591e0 2023-10-09T06:58:33.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.415+0000 7f89e49fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e00cf160 con 0x7f89e00b03c0 2023-10-09T06:58:33.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.415+0000 7f89df59e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f89e01591e0 0x7f89e0159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:33.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.415+0000 7f89df59e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f89e01591e0 0x7f89e0159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53674/0 (socket says 172.21.15.71:53674) 2023-10-09T06:58:33.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.415+0000 7f89df59e700 1 -- 172.21.15.71:0/1354406995 learned_addr learned my addr 172.21.15.71:0/1354406995 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:33.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.416+0000 7f89ded9d700 1 --2- 172.21.15.71:0/1354406995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89e00b03c0 0x7f89e00cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:33.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.416+0000 7f89df59e700 1 -- 172.21.15.71:0/1354406995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89e00b03c0 msgr2=0x7f89e00cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:33.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.416+0000 7f89df59e700 1 --2- 172.21.15.71:0/1354406995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89e00b03c0 0x7f89e00cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:33.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.416+0000 7f89df59e700 1 -- 172.21.15.71:0/1354406995 >> v1:172.21.15.179:6789/0 conn(0x7f89e00b0790 legacy=0x7f89e00b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:33.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.416+0000 7f89df59e700 1 -- 172.21.15.71:0/1354406995 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e00cf440 con 0x7f89e01591e0 2023-10-09T06:58:33.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.416+0000 7f89df59e700 1 --2- 172.21.15.71:0/1354406995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e01591e0 0x7f89e0159620 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f89d8009f20 tx=0x7f89d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8477279943b710a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:33.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.416+0000 7f89ddd9b700 1 -- 172.21.15.71:0/1354406995 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d800e070 con 0x7f89e01591e0 2023-10-09T06:58:33.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.416+0000 7f89ddd9b700 1 -- 172.21.15.71:0/1354406995 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d800b9d0 con 0x7f89e01591e0 2023-10-09T06:58:33.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.416+0000 7f89ddd9b700 1 -- 172.21.15.71:0/1354406995 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d80092e0 con 0x7f89e01591e0 2023-10-09T06:58:33.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.417+0000 7f89e49fe700 1 -- 172.21.15.71:0/1354406995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e01591e0 msgr2=0x7f89e0159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:33.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.417+0000 7f89e49fe700 1 --2- 172.21.15.71:0/1354406995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e01591e0 0x7f89e0159620 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f89d8009f20 tx=0x7f89d8009840 comp rx=0 tx=0).stop 2023-10-09T06:58:33.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.417+0000 7f89e49fe700 1 -- 172.21.15.71:0/1354406995 shutdown_connections 2023-10-09T06:58:33.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.417+0000 7f89e49fe700 1 --2- 172.21.15.71:0/1354406995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e01591e0 0x7f89e0159620 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:33.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.417+0000 7f89e49fe700 1 --2- 172.21.15.71:0/1354406995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89e00b03c0 0x7f89e00cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:33.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.417+0000 7f89e49fe700 1 -- 172.21.15.71:0/1354406995 >> 172.21.15.71:0/1354406995 conn(0x7f89e0063230 msgr2=0x7f89e0063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:33.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.417+0000 7f89e49fe700 1 -- 172.21.15.71:0/1354406995 shutdown_connections 2023-10-09T06:58:33.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.417+0000 7f89e49fe700 1 -- 172.21.15.71:0/1354406995 wait complete. 2023-10-09T06:58:33.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.419+0000 7f89e49fe700 1 Processor -- start 2023-10-09T06:58:33.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.419+0000 7f89e49fe700 1 -- start start 2023-10-09T06:58:33.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.420+0000 7f89e49fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89e00b03c0 0x7f89e0158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:33.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.420+0000 7f89e49fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89e00b0790 0x7f89e015bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:33.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.420+0000 7f89e49fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e01591e0 0x7f89e0157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:33.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.420+0000 7f89e49fe700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e015cfe0 con 0x7f89e01591e0 2023-10-09T06:58:33.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.420+0000 7f89e49fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e0158210 con 0x7f89e00b0790 2023-10-09T06:58:33.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.420+0000 7f89e49fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e015c3d0 con 0x7f89e00b03c0 2023-10-09T06:58:33.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.420+0000 7f89df59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e01591e0 0x7f89e0157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:33.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.420+0000 7f89df59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e01591e0 0x7f89e0157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53688/0 (socket says 172.21.15.71:53688) 2023-10-09T06:58:33.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.420+0000 7f89df59e700 1 -- 172.21.15.71:0/91842186 learned_addr learned my addr 172.21.15.71:0/91842186 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:33.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.420+0000 7f89ded9d700 1 --2- 172.21.15.71:0/91842186 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89e00b03c0 0x7f89e0158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:33.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.420+0000 7f89de59c700 1 --2- 172.21.15.71:0/91842186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89e00b0790 0x7f89e015bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:33.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.420+0000 7f89df59e700 1 -- 172.21.15.71:0/91842186 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89e00b03c0 msgr2=0x7f89e0158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:33.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.420+0000 7f89df59e700 1 --2- 172.21.15.71:0/91842186 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89e00b03c0 0x7f89e0158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:33.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.420+0000 7f89df59e700 1 -- 172.21.15.71:0/91842186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89e00b0790 msgr2=0x7f89e015bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:33.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.420+0000 7f89df59e700 1 --2- 172.21.15.71:0/91842186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89e00b0790 0x7f89e015bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:33.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.420+0000 7f89df59e700 1 -- 172.21.15.71:0/91842186 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d8009ae0 con 0x7f89e01591e0 2023-10-09T06:58:33.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.421+0000 7f89df59e700 1 --2- 172.21.15.71:0/91842186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e01591e0 0x7f89e0157cd0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f89e00cfe40 tx=0x7f89d8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:33.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.421+0000 7f89c6ffd700 1 -- 172.21.15.71:0/91842186 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d80094e0 con 0x7f89e01591e0 2023-10-09T06:58:33.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.421+0000 7f89c6ffd700 1 -- 172.21.15.71:0/91842186 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d8008b10 con 0x7f89e01591e0 2023-10-09T06:58:33.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.421+0000 7f89e49fe700 1 -- 172.21.15.71:0/91842186 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e015c6b0 con 0x7f89e01591e0 2023-10-09T06:58:33.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.421+0000 7f89c6ffd700 1 -- 172.21.15.71:0/91842186 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d8026460 con 0x7f89e01591e0 2023-10-09T06:58:33.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.421+0000 7f89e49fe700 1 -- 172.21.15.71:0/91842186 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e015cc70 con 0x7f89e01591e0 2023-10-09T06:58:33.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.422+0000 7f89e49fe700 1 -- 172.21.15.71:0/91842186 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e004c3c0 con 0x7f89e01591e0 2023-10-09T06:58:33.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.423+0000 7f89c6ffd700 1 -- 172.21.15.71:0/91842186 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 39) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f89d8003040 con 0x7f89e01591e0 2023-10-09T06:58:33.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.424+0000 7f89c6ffd700 1 --2- 172.21.15.71:0/91842186 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f89cc066d80 0x7f89cc069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:33.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.424+0000 7f89c6ffd700 1 -- 172.21.15.71:0/91842186 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f89d8086660 con 0x7f89e01591e0 2023-10-09T06:58:33.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.424+0000 7f89ded9d700 1 --2- 172.21.15.71:0/91842186 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f89cc066d80 0x7f89cc069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:33.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.425+0000 7f89ded9d700 1 --2- 172.21.15.71:0/91842186 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f89cc066d80 0x7f89cc069230 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009d10 tx=0x7f89d00091a0 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:33.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.428+0000 7f89c6ffd700 1 -- 172.21.15.71:0/91842186 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89d8053880 con 0x7f89e01591e0 2023-10-09T06:58:33.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:33.620+0000 7f89e49fe700 1 -- 172.21.15.71:0/91842186 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f89e00cad50 con 0x7f89e01591e0 2023-10-09T06:58:34.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.205+0000 7f89c6ffd700 1 -- 172.21.15.71:0/91842186 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v98) v1 ==== 169+0+0 (secure 0 0 0) 0x7f89d8056ea0 con 0x7f89e01591e0 2023-10-09T06:58:34.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.209+0000 7f89e49fe700 1 -- 172.21.15.71:0/91842186 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f89cc066d80 msgr2=0x7f89cc069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:34.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.209+0000 7f89e49fe700 1 --2- 172.21.15.71:0/91842186 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f89cc066d80 0x7f89cc069230 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009d10 tx=0x7f89d00091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:34.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.209+0000 7f89e49fe700 1 -- 172.21.15.71:0/91842186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e01591e0 msgr2=0x7f89e0157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:34.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.209+0000 7f89e49fe700 1 --2- 172.21.15.71:0/91842186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e01591e0 0x7f89e0157cd0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f89e00cfe40 tx=0x7f89d8018000 comp rx=0 tx=0).stop 2023-10-09T06:58:34.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.209+0000 7f89e49fe700 1 -- 172.21.15.71:0/91842186 shutdown_connections 2023-10-09T06:58:34.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.209+0000 7f89e49fe700 1 --2- 172.21.15.71:0/91842186 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f89cc066d80 0x7f89cc069230 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:34.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.209+0000 7f89e49fe700 1 --2- 172.21.15.71:0/91842186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e01591e0 0x7f89e0157cd0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:34.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.209+0000 7f89e49fe700 1 --2- 172.21.15.71:0/91842186 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89e00b03c0 0x7f89e0158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:34.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.209+0000 7f89e49fe700 1 --2- 172.21.15.71:0/91842186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89e00b0790 0x7f89e015bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:34.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.209+0000 7f89e49fe700 1 -- 172.21.15.71:0/91842186 >> 172.21.15.71:0/91842186 conn(0x7f89e0063230 msgr2=0x7f89e00b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:34.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.209+0000 7f89e49fe700 1 -- 172.21.15.71:0/91842186 shutdown_connections 2023-10-09T06:58:34.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.209+0000 7f89e49fe700 1 -- 172.21.15.71:0/91842186 wait complete. 2023-10-09T06:58:34.211 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' removed 2023-10-09T06:58:34.229 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T06:58:34.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.411+0000 7ffab3fff700 1 Processor -- start 2023-10-09T06:58:34.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.412+0000 7ffab3fff700 1 -- start start 2023-10-09T06:58:34.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.413+0000 7ffab3fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ffab40ccc00 0x7ffab4069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:34.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.413+0000 7ffab3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffab406a020 0x7ffab40cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:34.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.413+0000 7ffab3fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab40c9f30 con 0x7ffab4159a60 2023-10-09T06:58:34.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.413+0000 7ffab3fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab406dfc0 con 0x7ffab40ccc00 2023-10-09T06:58:34.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.413+0000 7ffab3fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab40ca470 con 0x7ffab406a020 2023-10-09T06:58:34.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.413+0000 7ffaabfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ffab40ccc00 0x7ffab4069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:34.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.413+0000 7ffaabfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ffab40ccc00 0x7ffab4069ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53698/0 (socket says 172.21.15.71:53698) 2023-10-09T06:58:34.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.413+0000 7ffaabfff700 1 -- 172.21.15.71:0/382367900 learned_addr learned my addr 172.21.15.71:0/382367900 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:34.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.413+0000 7ffab37fe700 1 --2- 172.21.15.71:0/382367900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffab406a020 0x7ffab40cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:34.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.413+0000 7ffaabfff700 1 -- 172.21.15.71:0/382367900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffab406a020 msgr2=0x7ffab40cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:34.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.413+0000 7ffaabfff700 1 --2- 172.21.15.71:0/382367900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffab406a020 0x7ffab40cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:34.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.413+0000 7ffaabfff700 1 -- 172.21.15.71:0/382367900 >> v1:172.21.15.179:6789/0 conn(0x7ffab4159a60 legacy=0x7ffab40c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:34.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.413+0000 7ffaabfff700 1 -- 172.21.15.71:0/382367900 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab40ca750 con 0x7ffab40ccc00 2023-10-09T06:58:34.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.414+0000 7ffab37fe700 1 --2- 172.21.15.71:0/382367900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffab406a020 0x7ffab40cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:34.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.414+0000 7ffaabfff700 1 --2- 172.21.15.71:0/382367900 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffab40ccc00 0x7ffab4069ae0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0099b0 tx=0x7ffa9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9629b0f0bdc4aaf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:34.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.414+0000 7ffab27fc700 1 -- 172.21.15.71:0/382367900 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c00b8b0 con 0x7ffab40ccc00 2023-10-09T06:58:34.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.414+0000 7ffab27fc700 1 -- 172.21.15.71:0/382367900 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c00ba10 con 0x7ffab40ccc00 2023-10-09T06:58:34.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.414+0000 7ffab27fc700 1 -- 172.21.15.71:0/382367900 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c00bdb0 con 0x7ffab40ccc00 2023-10-09T06:58:34.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.415+0000 7ffab3fff700 1 -- 172.21.15.71:0/382367900 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffab40ccc00 msgr2=0x7ffab4069ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:34.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.415+0000 7ffab3fff700 1 --2- 172.21.15.71:0/382367900 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffab40ccc00 0x7ffab4069ae0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0099b0 tx=0x7ffa9c009250 comp rx=0 tx=0).stop 2023-10-09T06:58:34.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.415+0000 7ffab3fff700 1 -- 172.21.15.71:0/382367900 shutdown_connections 2023-10-09T06:58:34.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.415+0000 7ffab3fff700 1 --2- 172.21.15.71:0/382367900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffab406a020 0x7ffab40cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:34.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.415+0000 7ffab3fff700 1 --2- 172.21.15.71:0/382367900 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffab40ccc00 0x7ffab4069ae0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:34.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.415+0000 7ffab3fff700 1 -- 172.21.15.71:0/382367900 >> 172.21.15.71:0/382367900 conn(0x7ffab406baa0 msgr2=0x7ffab406bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:34.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.415+0000 7ffab3fff700 1 -- 172.21.15.71:0/382367900 shutdown_connections 2023-10-09T06:58:34.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.415+0000 7ffab3fff700 1 -- 172.21.15.71:0/382367900 wait complete. 2023-10-09T06:58:34.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.416+0000 7ffab3fff700 1 Processor -- start 2023-10-09T06:58:34.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.416+0000 7ffab3fff700 1 -- start start 2023-10-09T06:58:34.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.417+0000 7ffab3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffab406a020 0x7ffab414d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:34.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.417+0000 7ffab3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffab40ccc00 0x7ffab414f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:34.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.417+0000 7ffab3fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab4159a60 0x7ffab4159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:34.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.417+0000 7ffab3fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab414ef60 con 0x7ffab406a020 2023-10-09T06:58:34.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.417+0000 7ffab3fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab415aa10 con 0x7ffab4159a60 2023-10-09T06:58:34.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.417+0000 7ffab3fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab414e630 con 0x7ffab40ccc00 2023-10-09T06:58:34.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.417+0000 7ffab2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffab406a020 0x7ffab414d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:34.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.417+0000 7ffab2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffab406a020 0x7ffab414d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53706/0 (socket says 172.21.15.71:53706) 2023-10-09T06:58:34.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.418+0000 7ffab2ffd700 1 -- 172.21.15.71:0/1070545592 learned_addr learned my addr 172.21.15.71:0/1070545592 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:34.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.418+0000 7ffab37fe700 1 --2- 172.21.15.71:0/1070545592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab4159a60 0x7ffab4159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:34.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.418+0000 7ffaabfff700 1 --2- 172.21.15.71:0/1070545592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffab40ccc00 0x7ffab414f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:34.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.418+0000 7ffab2ffd700 1 -- 172.21.15.71:0/1070545592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffab40ccc00 msgr2=0x7ffab414f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:34.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.418+0000 7ffab2ffd700 1 --2- 172.21.15.71:0/1070545592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffab40ccc00 0x7ffab414f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:34.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.418+0000 7ffab2ffd700 1 -- 172.21.15.71:0/1070545592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab4159a60 msgr2=0x7ffab4159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:34.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.418+0000 7ffab2ffd700 1 --2- 172.21.15.71:0/1070545592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab4159a60 0x7ffab4159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:34.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.418+0000 7ffab2ffd700 1 -- 172.21.15.71:0/1070545592 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9c0094f0 con 0x7ffab406a020 2023-10-09T06:58:34.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.418+0000 7ffab2ffd700 1 --2- 172.21.15.71:0/1070545592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffab406a020 0x7ffab414d640 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400b5e0 tx=0x7ffaa4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:34.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.418+0000 7ffaaaffd700 1 -- 172.21.15.71:0/1070545592 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa400f510 con 0x7ffab406a020 2023-10-09T06:58:34.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.418+0000 7ffaaaffd700 1 -- 172.21.15.71:0/1070545592 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa400f670 con 0x7ffab406a020 2023-10-09T06:58:34.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.418+0000 7ffaaaffd700 1 -- 172.21.15.71:0/1070545592 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa400fa30 con 0x7ffab406a020 2023-10-09T06:58:34.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.418+0000 7ffab3fff700 1 -- 172.21.15.71:0/1070545592 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab414e910 con 0x7ffab406a020 2023-10-09T06:58:34.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.419+0000 7ffab3fff700 1 -- 172.21.15.71:0/1070545592 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab414db80 con 0x7ffab406a020 2023-10-09T06:58:34.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.420+0000 7ffab3fff700 1 -- 172.21.15.71:0/1070545592 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab406eba0 con 0x7ffab406a020 2023-10-09T06:58:34.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.420+0000 7ffaaaffd700 1 -- 172.21.15.71:0/1070545592 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 39) v1 ==== 84578+0+0 (secure 0 0 0) 0x7ffaa401a400 con 0x7ffab406a020 2023-10-09T06:58:34.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.422+0000 7ffaaaffd700 1 --2- 172.21.15.71:0/1070545592 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffa94066d80 0x7ffa94069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:34.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.422+0000 7ffaaaffd700 1 -- 172.21.15.71:0/1070545592 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5890+0+0 (secure 0 0 0) 0x7ffaa4083f60 con 0x7ffab406a020 2023-10-09T06:58:34.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.422+0000 7ffaabfff700 1 --2- 172.21.15.71:0/1070545592 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffa94066d80 0x7ffa94069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:34.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.423+0000 7ffaabfff700 1 --2- 172.21.15.71:0/1070545592 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffa94066d80 0x7ffa94069230 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0099b0 tx=0x7ffa9c016000 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:34.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.426+0000 7ffaaaffd700 1 -- 172.21.15.71:0/1070545592 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffaa4051370 con 0x7ffab406a020 2023-10-09T06:58:34.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.620+0000 7ffab3fff700 1 -- 172.21.15.71:0/1070545592 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ffab40caa30 con 0x7ffab406a020 2023-10-09T06:58:34.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.624+0000 7ffaaaffd700 1 -- 172.21.15.71:0/1070545592 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v31) v1 ==== 104+0+0 (secure 0 0 0) 0x7ffaa4054990 con 0x7ffab406a020 2023-10-09T06:58:34.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.627+0000 7ffab3fff700 1 -- 172.21.15.71:0/1070545592 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffa94066d80 msgr2=0x7ffa94069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:34.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.627+0000 7ffab3fff700 1 --2- 172.21.15.71:0/1070545592 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffa94066d80 0x7ffa94069230 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0099b0 tx=0x7ffa9c016000 comp rx=0 tx=0).stop 2023-10-09T06:58:34.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.627+0000 7ffab3fff700 1 -- 172.21.15.71:0/1070545592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffab406a020 msgr2=0x7ffab414d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:34.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.627+0000 7ffab3fff700 1 --2- 172.21.15.71:0/1070545592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffab406a020 0x7ffab414d640 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400b5e0 tx=0x7ffaa4009120 comp rx=0 tx=0).stop 2023-10-09T06:58:34.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.627+0000 7ffab3fff700 1 -- 172.21.15.71:0/1070545592 shutdown_connections 2023-10-09T06:58:34.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.627+0000 7ffab3fff700 1 --2- 172.21.15.71:0/1070545592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab4159a60 0x7ffab4159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:34.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.627+0000 7ffab3fff700 1 --2- 172.21.15.71:0/1070545592 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ffa94066d80 0x7ffa94069230 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:34.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.627+0000 7ffab3fff700 1 --2- 172.21.15.71:0/1070545592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffab406a020 0x7ffab414d640 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:34.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.627+0000 7ffab3fff700 1 --2- 172.21.15.71:0/1070545592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffab40ccc00 0x7ffab414f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:34.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.627+0000 7ffab3fff700 1 -- 172.21.15.71:0/1070545592 >> 172.21.15.71:0/1070545592 conn(0x7ffab406baa0 msgr2=0x7ffab406be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:34.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.627+0000 7ffab3fff700 1 -- 172.21.15.71:0/1070545592 shutdown_connections 2023-10-09T06:58:34.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.627+0000 7ffab3fff700 1 -- 172.21.15.71:0/1070545592 wait complete. 2023-10-09T06:58:34.645 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-09T06:58:34.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.830+0000 7f0e13fff700 1 Processor -- start 2023-10-09T06:58:34.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.830+0000 7f0e13fff700 1 -- start start 2023-10-09T06:58:34.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.831+0000 7f0e13fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0e0c155eb0 0x7f0e0c06e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:34.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.831+0000 7f0e13fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0e0c0c70b0 0x7f0e0c069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:34.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.831+0000 7f0e13fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e0c069cb0 0x7f0e0c159a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:34.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.831+0000 7f0e13fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e0c06a130 con 0x7f0e0c155eb0 2023-10-09T06:58:34.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.831+0000 7f0e13fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e0c06eb90 con 0x7f0e0c0c70b0 2023-10-09T06:58:34.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.831+0000 7f0e13fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c06ee70 con 0x7f0e0c069cb0 2023-10-09T06:58:34.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.832+0000 7f0e11d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0e0c155eb0 0x7f0e0c06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:34.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.832+0000 7f0e11d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0e0c155eb0 0x7f0e0c06e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53714/0 (socket says 172.21.15.71:53714) 2023-10-09T06:58:34.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.832+0000 7f0e11d9b700 1 -- 172.21.15.71:0/375589960 learned_addr learned my addr 172.21.15.71:0/375589960 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:34.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.832+0000 7f0e1259c700 1 --2- 172.21.15.71:0/375589960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e0c069cb0 0x7f0e0c159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:34.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.832+0000 7f0e1159a700 1 --2- 172.21.15.71:0/375589960 >> v2:172.21.15.179:3300/0 conn(0x7f0e0c0c70b0 0x7f0e0c069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:34.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.832+0000 7f0e11d9b700 1 -- 172.21.15.71:0/375589960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e0c069cb0 msgr2=0x7f0e0c159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:34.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.832+0000 7f0e11d9b700 1 --2- 172.21.15.71:0/375589960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e0c069cb0 0x7f0e0c159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:34.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.832+0000 7f0e11d9b700 1 -- 172.21.15.71:0/375589960 >> v2:172.21.15.179:3300/0 conn(0x7f0e0c0c70b0 msgr2=0x7f0e0c069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:34.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.832+0000 7f0e11d9b700 1 --2- 172.21.15.71:0/375589960 >> v2:172.21.15.179:3300/0 conn(0x7f0e0c0c70b0 0x7f0e0c069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:34.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.832+0000 7f0e11d9b700 1 -- 172.21.15.71:0/375589960 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0c06f150 con 0x7f0e0c155eb0 2023-10-09T06:58:34.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.832+0000 7f0e1259c700 1 --2- 172.21.15.71:0/375589960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e0c069cb0 0x7f0e0c159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:34.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.832+0000 7f0e1159a700 1 --2- 172.21.15.71:0/375589960 >> v2:172.21.15.179:3300/0 conn(0x7f0e0c0c70b0 0x7f0e0c069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:34.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.833+0000 7f0e11d9b700 1 --2- 172.21.15.71:0/375589960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e0c155eb0 0x7f0e0c06e240 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c065130 tx=0x7f0e08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c015251e5bdaef server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:34.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.833+0000 7f0e10d99700 1 -- 172.21.15.71:0/375589960 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0800b860 con 0x7f0e0c155eb0 2023-10-09T06:58:34.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.833+0000 7f0e10d99700 1 -- 172.21.15.71:0/375589960 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0800b9c0 con 0x7f0e0c155eb0 2023-10-09T06:58:34.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.833+0000 7f0e10d99700 1 -- 172.21.15.71:0/375589960 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0800bd60 con 0x7f0e0c155eb0 2023-10-09T06:58:34.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.833+0000 7f0e13fff700 1 -- 172.21.15.71:0/375589960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e0c155eb0 msgr2=0x7f0e0c06e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:34.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.833+0000 7f0e13fff700 1 --2- 172.21.15.71:0/375589960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e0c155eb0 0x7f0e0c06e240 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c065130 tx=0x7f0e08009250 comp rx=0 tx=0).stop 2023-10-09T06:58:34.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.833+0000 7f0e13fff700 1 -- 172.21.15.71:0/375589960 shutdown_connections 2023-10-09T06:58:34.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.833+0000 7f0e13fff700 1 --2- 172.21.15.71:0/375589960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e0c069cb0 0x7f0e0c159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:34.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.833+0000 7f0e13fff700 1 --2- 172.21.15.71:0/375589960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e0c155eb0 0x7f0e0c06e240 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:34.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.833+0000 7f0e13fff700 1 --2- 172.21.15.71:0/375589960 >> v2:172.21.15.179:3300/0 conn(0x7f0e0c0c70b0 0x7f0e0c069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:34.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.833+0000 7f0e13fff700 1 -- 172.21.15.71:0/375589960 >> 172.21.15.71:0/375589960 conn(0x7f0e0c068e10 msgr2=0x7f0e0c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:34.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.833+0000 7f0e13fff700 1 -- 172.21.15.71:0/375589960 shutdown_connections 2023-10-09T06:58:34.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.833+0000 7f0e13fff700 1 -- 172.21.15.71:0/375589960 wait complete. 2023-10-09T06:58:34.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.835+0000 7f0e13fff700 1 Processor -- start 2023-10-09T06:58:34.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.835+0000 7f0e13fff700 1 -- start start 2023-10-09T06:58:34.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.836+0000 7f0e13fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e0c069cb0 0x7f0e0c0c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:34.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.836+0000 7f0e13fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e0c0c70b0 0x7f0e0c0abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:34.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.836+0000 7f0e13fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e0c155eb0 0x7f0e0c1506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:34.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.836+0000 7f0e13fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c150c30 con 0x7f0e0c069cb0 2023-10-09T06:58:34.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.836+0000 7f0e13fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c0ace30 con 0x7f0e0c155eb0 2023-10-09T06:58:34.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.836+0000 7f0e13fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c0ac220 con 0x7f0e0c0c70b0 2023-10-09T06:58:34.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.836+0000 7f0e11d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e0c069cb0 0x7f0e0c0c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:34.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.836+0000 7f0e11d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e0c069cb0 0x7f0e0c0c6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53730/0 (socket says 172.21.15.71:53730) 2023-10-09T06:58:34.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.836+0000 7f0e11d9b700 1 -- 172.21.15.71:0/413054992 learned_addr learned my addr 172.21.15.71:0/413054992 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:34.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.836+0000 7f0e1259c700 1 --2- 172.21.15.71:0/413054992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e0c155eb0 0x7f0e0c1506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:34.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.836+0000 7f0e1159a700 1 --2- 172.21.15.71:0/413054992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e0c0c70b0 0x7f0e0c0abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:34.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.837+0000 7f0e11d9b700 1 -- 172.21.15.71:0/413054992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e0c0c70b0 msgr2=0x7f0e0c0abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:34.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.837+0000 7f0e11d9b700 1 --2- 172.21.15.71:0/413054992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e0c0c70b0 0x7f0e0c0abb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:34.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.837+0000 7f0e11d9b700 1 -- 172.21.15.71:0/413054992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e0c155eb0 msgr2=0x7f0e0c1506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:34.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.837+0000 7f0e11d9b700 1 --2- 172.21.15.71:0/413054992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e0c155eb0 0x7f0e0c1506f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:34.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.837+0000 7f0e11d9b700 1 -- 172.21.15.71:0/413054992 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e080094f0 con 0x7f0e0c069cb0 2023-10-09T06:58:34.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.837+0000 7f0e1259c700 1 --2- 172.21.15.71:0/413054992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e0c155eb0 0x7f0e0c1506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:34.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.837+0000 7f0e11d9b700 1 --2- 172.21.15.71:0/413054992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e0c069cb0 0x7f0e0c0c6250 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009290 tx=0x7f0e08017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:34.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.837+0000 7f0e01ffb700 1 -- 172.21.15.71:0/413054992 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e08026480 con 0x7f0e0c069cb0 2023-10-09T06:58:34.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.837+0000 7f0e01ffb700 1 -- 172.21.15.71:0/413054992 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0801f070 con 0x7f0e0c069cb0 2023-10-09T06:58:34.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.837+0000 7f0e01ffb700 1 -- 172.21.15.71:0/413054992 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e08026830 con 0x7f0e0c069cb0 2023-10-09T06:58:34.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.837+0000 7f0e13fff700 1 -- 172.21.15.71:0/413054992 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e0c0ac500 con 0x7f0e0c069cb0 2023-10-09T06:58:34.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.837+0000 7f0e13fff700 1 -- 172.21.15.71:0/413054992 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e0c0acac0 con 0x7f0e0c069cb0 2023-10-09T06:58:34.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.838+0000 7f0e13fff700 1 -- 172.21.15.71:0/413054992 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e0c04c3c0 con 0x7f0e0c069cb0 2023-10-09T06:58:34.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.839+0000 7f0e01ffb700 1 -- 172.21.15.71:0/413054992 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e08026ba0 con 0x7f0e0c069cb0 2023-10-09T06:58:34.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.840+0000 7f0e01ffb700 1 --2- 172.21.15.71:0/413054992 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0df0066fb0 0x7f0df0069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:34.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.840+0000 7f0e01ffb700 1 -- 172.21.15.71:0/413054992 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f0e08021070 con 0x7f0e0c069cb0 2023-10-09T06:58:34.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.840+0000 7f0e1159a700 1 --2- 172.21.15.71:0/413054992 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0df0066fb0 0x7f0df0069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:34.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.841+0000 7f0e1159a700 1 --2- 172.21.15.71:0/413054992 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0df0066fb0 0x7f0df0069460 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc006f00 tx=0x7f0dfc008040 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:34.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:34.844+0000 7f0e01ffb700 1 -- 172.21.15.71:0/413054992 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e08053670 con 0x7f0e0c069cb0 2023-10-09T06:58:35.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.035+0000 7f0e13fff700 1 -- 172.21.15.71:0/413054992 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f0e0c06f430 con 0x7f0e0c069cb0 2023-10-09T06:58:35.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.039+0000 7f0e01ffb700 1 -- 172.21.15.71:0/413054992 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v32) v1 ==== 115+0+0 (secure 0 0 0) 0x7f0e08056c90 con 0x7f0e0c069cb0 2023-10-09T06:58:35.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.041+0000 7f0e13fff700 1 -- 172.21.15.71:0/413054992 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0df0066fb0 msgr2=0x7f0df0069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:35.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.041+0000 7f0e13fff700 1 --2- 172.21.15.71:0/413054992 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0df0066fb0 0x7f0df0069460 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc006f00 tx=0x7f0dfc008040 comp rx=0 tx=0).stop 2023-10-09T06:58:35.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.041+0000 7f0e13fff700 1 -- 172.21.15.71:0/413054992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e0c069cb0 msgr2=0x7f0e0c0c6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:35.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.041+0000 7f0e13fff700 1 --2- 172.21.15.71:0/413054992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e0c069cb0 0x7f0e0c0c6250 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009290 tx=0x7f0e08017000 comp rx=0 tx=0).stop 2023-10-09T06:58:35.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.041+0000 7f0e13fff700 1 -- 172.21.15.71:0/413054992 shutdown_connections 2023-10-09T06:58:35.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.042+0000 7f0e13fff700 1 --2- 172.21.15.71:0/413054992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e0c155eb0 0x7f0e0c1506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:35.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.042+0000 7f0e13fff700 1 --2- 172.21.15.71:0/413054992 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0df0066fb0 0x7f0df0069460 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:35.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.042+0000 7f0e13fff700 1 --2- 172.21.15.71:0/413054992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e0c069cb0 0x7f0e0c0c6250 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:35.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.042+0000 7f0e13fff700 1 --2- 172.21.15.71:0/413054992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e0c0c70b0 0x7f0e0c0abb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:35.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.042+0000 7f0e13fff700 1 -- 172.21.15.71:0/413054992 >> 172.21.15.71:0/413054992 conn(0x7f0e0c068e10 msgr2=0x7f0e0c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:35.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.042+0000 7f0e13fff700 1 -- 172.21.15.71:0/413054992 shutdown_connections 2023-10-09T06:58:35.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.042+0000 7f0e13fff700 1 -- 172.21.15.71:0/413054992 wait complete. 2023-10-09T06:58:35.060 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-09T06:58:35.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.244+0000 7f9df959d700 1 Processor -- start 2023-10-09T06:58:35.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.245+0000 7f9df959d700 1 -- start start 2023-10-09T06:58:35.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.246+0000 7f9df959d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9df40ae7e0 0x7f9df40c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:35.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.246+0000 7f9df959d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df406ebd0 con 0x7f9df40cb1a0 2023-10-09T06:58:35.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.246+0000 7f9df959d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df415aa70 con 0x7f9df406f060 2023-10-09T06:58:35.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.246+0000 7f9df959d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df415b2e0 con 0x7f9df40ae7e0 2023-10-09T06:58:35.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.246+0000 7f9df3fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9df40cb1a0 0x7f9df415a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:50742/0 (socket says 172.21.15.71:50742) 2023-10-09T06:58:35.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.246+0000 7f9df3fff700 1 -- 172.21.15.71:0/2608536663 learned_addr learned my addr 172.21.15.71:0/2608536663 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:35.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.246+0000 7f9df8d9c700 1 --2- 172.21.15.71:0/2608536663 >> v2:172.21.15.71:3300/0 conn(0x7f9df40ae7e0 0x7f9df40c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:35.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.247+0000 7f9df8d9c700 1 -- 172.21.15.71:0/2608536663 >> v1:172.21.15.179:6789/0 conn(0x7f9df406f060 legacy=0x7f9df40ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:35.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.247+0000 7f9df8d9c700 1 -- 172.21.15.71:0/2608536663 >> v1:172.21.15.71:6789/0 conn(0x7f9df40cb1a0 legacy=0x7f9df415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:35.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.247+0000 7f9df8d9c700 1 -- 172.21.15.71:0/2608536663 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df415ad20 con 0x7f9df40ae7e0 2023-10-09T06:58:35.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.247+0000 7f9df8d9c700 1 --2- 172.21.15.71:0/2608536663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9df40ae7e0 0x7f9df40c9db0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009e60 tx=0x7f9dec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1968b376ec1a211d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:35.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.247+0000 7f9df37fe700 1 -- 172.21.15.71:0/2608536663 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec00e070 con 0x7f9df40ae7e0 2023-10-09T06:58:35.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.247+0000 7f9df37fe700 1 -- 172.21.15.71:0/2608536663 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec00bc80 con 0x7f9df40ae7e0 2023-10-09T06:58:35.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.247+0000 7f9df37fe700 1 -- 172.21.15.71:0/2608536663 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec012430 con 0x7f9df40ae7e0 2023-10-09T06:58:35.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.248+0000 7f9df959d700 1 -- 172.21.15.71:0/2608536663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9df40ae7e0 msgr2=0x7f9df40c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:35.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.248+0000 7f9df959d700 1 --2- 172.21.15.71:0/2608536663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9df40ae7e0 0x7f9df40c9db0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009e60 tx=0x7f9dec009780 comp rx=0 tx=0).stop 2023-10-09T06:58:35.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.248+0000 7f9df959d700 1 -- 172.21.15.71:0/2608536663 shutdown_connections 2023-10-09T06:58:35.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.248+0000 7f9df959d700 1 --2- 172.21.15.71:0/2608536663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9df40ae7e0 0x7f9df40c9db0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:35.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.248+0000 7f9df959d700 1 -- 172.21.15.71:0/2608536663 >> 172.21.15.71:0/2608536663 conn(0x7f9df40cc1e0 msgr2=0x7f9df40cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:35.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.248+0000 7f9df959d700 1 -- 172.21.15.71:0/2608536663 shutdown_connections 2023-10-09T06:58:35.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.248+0000 7f9df959d700 1 -- 172.21.15.71:0/2608536663 wait complete. 2023-10-09T06:58:35.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.250+0000 7f9df959d700 1 Processor -- start 2023-10-09T06:58:35.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.250+0000 7f9df959d700 1 -- start start 2023-10-09T06:58:35.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.251+0000 7f9df959d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9df406f060 0x7f9df4152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:35.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.251+0000 7f9df959d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9df40ae7e0 0x7f9df416aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:35.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.251+0000 7f9df959d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9df40cb1a0 0x7f9df4159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:35.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.251+0000 7f9df959d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df40a6170 con 0x7f9df40cb1a0 2023-10-09T06:58:35.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.251+0000 7f9df959d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df4152f70 con 0x7f9df40ae7e0 2023-10-09T06:58:35.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.251+0000 7f9df959d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df40a5560 con 0x7f9df406f060 2023-10-09T06:58:35.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.251+0000 7f9df8d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9df40cb1a0 0x7f9df4159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:35.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.251+0000 7f9df8d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9df40cb1a0 0x7f9df4159290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55512/0 (socket says 172.21.15.71:55512) 2023-10-09T06:58:35.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.251+0000 7f9df8d9c700 1 -- 172.21.15.71:0/889991430 learned_addr learned my addr 172.21.15.71:0/889991430 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:35.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.251+0000 7f9df3fff700 1 --2- 172.21.15.71:0/889991430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9df406f060 0x7f9df4152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:35.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.251+0000 7f9debfff700 1 --2- 172.21.15.71:0/889991430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9df40ae7e0 0x7f9df416aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:35.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.251+0000 7f9df8d9c700 1 -- 172.21.15.71:0/889991430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9df406f060 msgr2=0x7f9df4152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:35.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.251+0000 7f9df8d9c700 1 --2- 172.21.15.71:0/889991430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9df406f060 0x7f9df4152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:35.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.251+0000 7f9df8d9c700 1 -- 172.21.15.71:0/889991430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9df40ae7e0 msgr2=0x7f9df416aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:35.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.251+0000 7f9df8d9c700 1 --2- 172.21.15.71:0/889991430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9df40ae7e0 0x7f9df416aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:35.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.251+0000 7f9df8d9c700 1 -- 172.21.15.71:0/889991430 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec009a20 con 0x7f9df40cb1a0 2023-10-09T06:58:35.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.251+0000 7f9debfff700 1 --2- 172.21.15.71:0/889991430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9df40ae7e0 0x7f9df416aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:35.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.252+0000 7f9df8d9c700 1 --2- 172.21.15.71:0/889991430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9df40cb1a0 0x7f9df4159290 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f9dec003000 tx=0x7f9dec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:35.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.252+0000 7f9df0ff9700 1 -- 172.21.15.71:0/889991430 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec01e640 con 0x7f9df40cb1a0 2023-10-09T06:58:35.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.252+0000 7f9df0ff9700 1 -- 172.21.15.71:0/889991430 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec01e7a0 con 0x7f9df40cb1a0 2023-10-09T06:58:35.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.252+0000 7f9df0ff9700 1 -- 172.21.15.71:0/889991430 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec01eb60 con 0x7f9df40cb1a0 2023-10-09T06:58:35.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.252+0000 7f9df959d700 1 -- 172.21.15.71:0/889991430 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df40a5840 con 0x7f9df40cb1a0 2023-10-09T06:58:35.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.252+0000 7f9df959d700 1 -- 172.21.15.71:0/889991430 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df40a5e00 con 0x7f9df40cb1a0 2023-10-09T06:58:35.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.253+0000 7f9df959d700 1 -- 172.21.15.71:0/889991430 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df40a6320 con 0x7f9df40cb1a0 2023-10-09T06:58:35.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.254+0000 7f9df0ff9700 1 -- 172.21.15.71:0/889991430 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9dec024070 con 0x7f9df40cb1a0 2023-10-09T06:58:35.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.255+0000 7f9df0ff9700 1 --2- 172.21.15.71:0/889991430 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9dd4066f30 0x7f9dd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:35.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.255+0000 7f9df0ff9700 1 -- 172.21.15.71:0/889991430 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f9dec087130 con 0x7f9df40cb1a0 2023-10-09T06:58:35.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.255+0000 7f9df3fff700 1 --2- 172.21.15.71:0/889991430 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9dd4066f30 0x7f9dd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:35.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.256+0000 7f9df3fff700 1 --2- 172.21.15.71:0/889991430 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9dd4066f30 0x7f9dd40693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9de4001950 tx=0x7f9de4009040 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:35.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.259+0000 7f9df0ff9700 1 -- 172.21.15.71:0/889991430 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9df40a6320 con 0x7f9df40cb1a0 2023-10-09T06:58:35.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.453+0000 7f9df959d700 1 -- 172.21.15.71:0/889991430 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f9df40a62b0 con 0x7f9df40cb1a0 2023-10-09T06:58:35.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.457+0000 7f9df0ff9700 1 -- 172.21.15.71:0/889991430 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v33) v1 ==== 120+0+0 (secure 0 0 0) 0x7f9dec054240 con 0x7f9df40cb1a0 2023-10-09T06:58:35.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.459+0000 7f9df959d700 1 -- 172.21.15.71:0/889991430 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9dd4066f30 msgr2=0x7f9dd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:35.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.459+0000 7f9df959d700 1 --2- 172.21.15.71:0/889991430 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9dd4066f30 0x7f9dd40693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9de4001950 tx=0x7f9de4009040 comp rx=0 tx=0).stop 2023-10-09T06:58:35.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.459+0000 7f9df959d700 1 -- 172.21.15.71:0/889991430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9df40cb1a0 msgr2=0x7f9df4159290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:35.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.459+0000 7f9df959d700 1 --2- 172.21.15.71:0/889991430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9df40cb1a0 0x7f9df4159290 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f9dec003000 tx=0x7f9dec018000 comp rx=0 tx=0).stop 2023-10-09T06:58:35.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.459+0000 7f9df959d700 1 -- 172.21.15.71:0/889991430 shutdown_connections 2023-10-09T06:58:35.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.459+0000 7f9df959d700 1 --2- 172.21.15.71:0/889991430 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9dd4066f30 0x7f9dd40693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:35.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.459+0000 7f9df959d700 1 --2- 172.21.15.71:0/889991430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9df40cb1a0 0x7f9df4159290 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:35.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.459+0000 7f9df959d700 1 --2- 172.21.15.71:0/889991430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9df406f060 0x7f9df4152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:35.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.459+0000 7f9df959d700 1 --2- 172.21.15.71:0/889991430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9df40ae7e0 0x7f9df416aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:35.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.459+0000 7f9df959d700 1 -- 172.21.15.71:0/889991430 >> 172.21.15.71:0/889991430 conn(0x7f9df40cc1e0 msgr2=0x7f9df406a000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:35.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.460+0000 7f9df959d700 1 -- 172.21.15.71:0/889991430 shutdown_connections 2023-10-09T06:58:35.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.460+0000 7f9df959d700 1 -- 172.21.15.71:0/889991430 wait complete. 2023-10-09T06:58:35.478 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-10-09T06:58:35.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.662+0000 7fe0f899d700 1 Processor -- start 2023-10-09T06:58:35.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.662+0000 7fe0f899d700 1 -- start start 2023-10-09T06:58:35.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.663+0000 7fe0f899d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0f4159420 0x7fe0f40b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:35.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.663+0000 7fe0f899d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe0f415d230 0x7fe0f415d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:35.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.663+0000 7fe0f899d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0f415dbd0 con 0x7fe0f41597f0 2023-10-09T06:58:35.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.663+0000 7fe0f899d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0f40b2980 con 0x7fe0f415d230 2023-10-09T06:58:35.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.663+0000 7fe0f899d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f40b11d0 con 0x7fe0f4159420 2023-10-09T06:58:35.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.663+0000 7fe0f2ffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe0f41597f0 0x7fe0f40b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:50758/0 (socket says 172.21.15.71:50758) 2023-10-09T06:58:35.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.664+0000 7fe0f2ffd700 1 -- 172.21.15.71:0/322450672 learned_addr learned my addr 172.21.15.71:0/322450672 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:35.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.664+0000 7fe0f3fff700 1 --2- 172.21.15.71:0/322450672 >> v2:172.21.15.179:3300/0 conn(0x7fe0f415d230 0x7fe0f415d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:35.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.664+0000 7fe0f37fe700 1 --2- 172.21.15.71:0/322450672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0f4159420 0x7fe0f40b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:35.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.664+0000 7fe0f27fc700 1 -- 172.21.15.71:0/322450672 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285901161 0 0) 0x7fe0e8001110 con 0x7fe0f41597f0 2023-10-09T06:58:35.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.664+0000 7fe0f27fc700 1 -- 172.21.15.71:0/322450672 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0dc003570 con 0x7fe0f41597f0 2023-10-09T06:58:35.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.664+0000 7fe0f27fc700 1 -- 172.21.15.71:0/322450672 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4178651870 0 0) 0x7fe0dc003570 con 0x7fe0f41597f0 2023-10-09T06:58:35.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.664+0000 7fe0f3fff700 1 -- 172.21.15.71:0/322450672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0f4159420 msgr2=0x7fe0f40b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:35.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.664+0000 7fe0f3fff700 1 --2- 172.21.15.71:0/322450672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0f4159420 0x7fe0f40b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:35.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.664+0000 7fe0f3fff700 1 -- 172.21.15.71:0/322450672 >> v1:172.21.15.71:6789/0 conn(0x7fe0f41597f0 legacy=0x7fe0f40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:35.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.664+0000 7fe0f3fff700 1 -- 172.21.15.71:0/322450672 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f40b14b0 con 0x7fe0f415d230 2023-10-09T06:58:35.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.664+0000 7fe0f37fe700 1 --2- 172.21.15.71:0/322450672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0f4159420 0x7fe0f40b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:58:35.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.665+0000 7fe0f3fff700 1 --2- 172.21.15.71:0/322450672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0f415d230 0x7fe0f415d690 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009e60 tx=0x7fe0ec009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcd6d3408435e109 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:35.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.665+0000 7fe0f27fc700 1 -- 172.21.15.71:0/322450672 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec00e070 con 0x7fe0f415d230 2023-10-09T06:58:35.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.665+0000 7fe0f27fc700 1 -- 172.21.15.71:0/322450672 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ec00b7a0 con 0x7fe0f415d230 2023-10-09T06:58:35.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.665+0000 7fe0f27fc700 1 -- 172.21.15.71:0/322450672 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8001600 con 0x7fe0f415d230 2023-10-09T06:58:35.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.665+0000 7fe0f899d700 1 -- 172.21.15.71:0/322450672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0f415d230 msgr2=0x7fe0f415d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:35.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.665+0000 7fe0f899d700 1 --2- 172.21.15.71:0/322450672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0f415d230 0x7fe0f415d690 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009e60 tx=0x7fe0ec009780 comp rx=0 tx=0).stop 2023-10-09T06:58:35.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.666+0000 7fe0f899d700 1 -- 172.21.15.71:0/322450672 shutdown_connections 2023-10-09T06:58:35.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.666+0000 7fe0f899d700 1 --2- 172.21.15.71:0/322450672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0f415d230 0x7fe0f415d690 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:35.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.666+0000 7fe0f899d700 1 --2- 172.21.15.71:0/322450672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0f4159420 0x7fe0f40b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:35.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.666+0000 7fe0f899d700 1 -- 172.21.15.71:0/322450672 >> 172.21.15.71:0/322450672 conn(0x7fe0f40d0660 msgr2=0x7fe0f40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:35.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.666+0000 7fe0f899d700 1 -- 172.21.15.71:0/322450672 shutdown_connections 2023-10-09T06:58:35.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.666+0000 7fe0f899d700 1 -- 172.21.15.71:0/322450672 wait complete. 2023-10-09T06:58:35.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.667+0000 7fe0f899d700 1 Processor -- start 2023-10-09T06:58:35.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.667+0000 7fe0f899d700 1 -- start start 2023-10-09T06:58:35.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.668+0000 7fe0f899d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0f4159420 0x7fe0f4153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:35.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.668+0000 7fe0f899d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0f41597f0 0x7fe0f4069510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:35.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.668+0000 7fe0f899d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0f415d230 0x7fe0f4069a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:35.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.668+0000 7fe0f899d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f40c5400 con 0x7fe0f4159420 2023-10-09T06:58:35.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.668+0000 7fe0f899d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f40c5f80 con 0x7fe0f415d230 2023-10-09T06:58:35.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.668+0000 7fe0f899d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f40c5650 con 0x7fe0f41597f0 2023-10-09T06:58:35.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.668+0000 7fe0f37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0f4159420 0x7fe0f4153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:35.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.668+0000 7fe0f37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0f4159420 0x7fe0f4153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55526/0 (socket says 172.21.15.71:55526) 2023-10-09T06:58:35.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.668+0000 7fe0f37fe700 1 -- 172.21.15.71:0/232179666 learned_addr learned my addr 172.21.15.71:0/232179666 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:35.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.669+0000 7fe0f3fff700 1 --2- 172.21.15.71:0/232179666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0f415d230 0x7fe0f4069a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:35.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.669+0000 7fe0f2ffd700 1 --2- 172.21.15.71:0/232179666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0f41597f0 0x7fe0f4069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:35.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.669+0000 7fe0f37fe700 1 -- 172.21.15.71:0/232179666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0f41597f0 msgr2=0x7fe0f4069510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:35.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.669+0000 7fe0f37fe700 1 --2- 172.21.15.71:0/232179666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0f41597f0 0x7fe0f4069510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:35.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.669+0000 7fe0f37fe700 1 -- 172.21.15.71:0/232179666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0f415d230 msgr2=0x7fe0f4069a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:35.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.669+0000 7fe0f37fe700 1 --2- 172.21.15.71:0/232179666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0f415d230 0x7fe0f4069a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:35.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.669+0000 7fe0f37fe700 1 -- 172.21.15.71:0/232179666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e4009420 con 0x7fe0f4159420 2023-10-09T06:58:35.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.669+0000 7fe0f3fff700 1 --2- 172.21.15.71:0/232179666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0f415d230 0x7fe0f4069a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:35.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.669+0000 7fe0f37fe700 1 --2- 172.21.15.71:0/232179666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0f4159420 0x7fe0f4153340 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fe0e400ecb0 tx=0x7fe0e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:35.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.669+0000 7fe0db7fe700 1 -- 172.21.15.71:0/232179666 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e400ee60 con 0x7fe0f4159420 2023-10-09T06:58:35.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.669+0000 7fe0db7fe700 1 -- 172.21.15.71:0/232179666 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e400cbe0 con 0x7fe0f4159420 2023-10-09T06:58:35.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.669+0000 7fe0f899d700 1 -- 172.21.15.71:0/232179666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ec009a20 con 0x7fe0f4159420 2023-10-09T06:58:35.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.669+0000 7fe0db7fe700 1 -- 172.21.15.71:0/232179666 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4013470 con 0x7fe0f4159420 2023-10-09T06:58:35.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.669+0000 7fe0f899d700 1 -- 172.21.15.71:0/232179666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f40c5c10 con 0x7fe0f4159420 2023-10-09T06:58:35.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.670+0000 7fe0f899d700 1 -- 172.21.15.71:0/232179666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f404c3c0 con 0x7fe0f4159420 2023-10-09T06:58:35.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.671+0000 7fe0db7fe700 1 -- 172.21.15.71:0/232179666 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0e4013820 con 0x7fe0f4159420 2023-10-09T06:58:35.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.672+0000 7fe0db7fe700 1 --2- 172.21.15.71:0/232179666 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe0e0066f30 0x7fe0e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:35.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.672+0000 7fe0db7fe700 1 -- 172.21.15.71:0/232179666 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5890+0+0 (secure 0 0 0) 0x7fe0e4084a80 con 0x7fe0f4159420 2023-10-09T06:58:35.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.672+0000 7fe0f2ffd700 1 --2- 172.21.15.71:0/232179666 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe0e0066f30 0x7fe0e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:35.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.673+0000 7fe0f2ffd700 1 --2- 172.21.15.71:0/232179666 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe0e0066f30 0x7fe0e00693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80017b0 tx=0x7fe0e8001650 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:35.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.676+0000 7fe0db7fe700 1 -- 172.21.15.71:0/232179666 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0e4051b90 con 0x7fe0f4159420 2023-10-09T06:58:35.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:35.940+0000 7fe0f899d700 1 -- 172.21.15.71:0/232179666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7fe0f40b1790 con 0x7fe0f4159420 2023-10-09T06:58:36.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.207+0000 7fe0db7fe700 1 -- 172.21.15.71:0/232179666 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v596) v1 ==== 166+0+0 (secure 0 0 0) 0x7fe0e40551b0 con 0x7fe0f4159420 2023-10-09T06:58:36.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.210+0000 7fe0f899d700 1 -- 172.21.15.71:0/232179666 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe0e0066f30 msgr2=0x7fe0e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:36.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.210+0000 7fe0f899d700 1 --2- 172.21.15.71:0/232179666 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe0e0066f30 0x7fe0e00693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80017b0 tx=0x7fe0e8001650 comp rx=0 tx=0).stop 2023-10-09T06:58:36.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.210+0000 7fe0f899d700 1 -- 172.21.15.71:0/232179666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0f4159420 msgr2=0x7fe0f4153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:36.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.210+0000 7fe0f899d700 1 --2- 172.21.15.71:0/232179666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0f4159420 0x7fe0f4153340 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fe0e400ecb0 tx=0x7fe0e40091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:36.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.210+0000 7fe0f899d700 1 -- 172.21.15.71:0/232179666 shutdown_connections 2023-10-09T06:58:36.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.210+0000 7fe0f899d700 1 --2- 172.21.15.71:0/232179666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0f415d230 0x7fe0f4069a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:36.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.210+0000 7fe0f899d700 1 --2- 172.21.15.71:0/232179666 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fe0e0066f30 0x7fe0e00693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:36.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.210+0000 7fe0f899d700 1 --2- 172.21.15.71:0/232179666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0f4159420 0x7fe0f4153340 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:36.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.210+0000 7fe0f899d700 1 --2- 172.21.15.71:0/232179666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0f41597f0 0x7fe0f4069510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:36.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.210+0000 7fe0f899d700 1 -- 172.21.15.71:0/232179666 >> 172.21.15.71:0/232179666 conn(0x7fe0f40d0660 msgr2=0x7fe0f40b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:36.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.210+0000 7fe0f899d700 1 -- 172.21.15.71:0/232179666 shutdown_connections 2023-10-09T06:58:36.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.210+0000 7fe0f899d700 1 -- 172.21.15.71:0/232179666 wait complete. 2023-10-09T06:58:36.229 INFO:tasks.cephfs_test_runner:Test listing snap schedules on a non-existing filesystem path failure ... ok 2023-10-09T06:58:36.229 INFO:tasks.cephfs_test_runner:Starting test: test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that a non-existent path leads to schedule deactivation after a few retries. 2023-10-09T06:58:36.229 INFO:tasks.cephfs_test_runner:test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-09T06:58:36.229 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-10-09T06:58:36.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.409+0000 7f502d9ff700 1 Processor -- start 2023-10-09T06:58:36.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.410+0000 7f502d9ff700 1 -- start start 2023-10-09T06:58:36.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.411+0000 7f502d9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5028155c10 0x7f5028155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:36.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.411+0000 7f502d9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f50280ac230 0x7f50280ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:36.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.411+0000 7f502d9ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50280ad930 con 0x7f50281568a0 2023-10-09T06:58:36.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.411+0000 7f502d9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50280acd20 con 0x7f50280ac230 2023-10-09T06:58:36.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.411+0000 7f502d9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50280ad000 con 0x7f5028155c10 2023-10-09T06:58:36.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.411+0000 7f50277fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f50281568a0 0x7f5028156cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:50762/0 (socket says 172.21.15.71:50762) 2023-10-09T06:58:36.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.411+0000 7f50277fe700 1 -- 172.21.15.71:0/491820246 learned_addr learned my addr 172.21.15.71:0/491820246 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:36.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.411+0000 7f50267fc700 1 --2- 172.21.15.71:0/491820246 >> v2:172.21.15.179:3300/0 conn(0x7f50280ac230 0x7f50280ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:36.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.411+0000 7f5026ffd700 1 --2- 172.21.15.71:0/491820246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5028155c10 0x7f5028155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:36.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.411+0000 7f5025ffb700 1 -- 172.21.15.71:0/491820246 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747468720 0 0) 0x7f50280ad930 con 0x7f50281568a0 2023-10-09T06:58:36.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.411+0000 7f5025ffb700 1 -- 172.21.15.71:0/491820246 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5010003570 con 0x7f50281568a0 2023-10-09T06:58:36.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.412+0000 7f5025ffb700 1 -- 172.21.15.71:0/491820246 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3479175958 0 0) 0x7f5010003570 con 0x7f50281568a0 2023-10-09T06:58:36.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.412+0000 7f50267fc700 1 -- 172.21.15.71:0/491820246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5028155c10 msgr2=0x7f5028155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:36.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.412+0000 7f50267fc700 1 --2- 172.21.15.71:0/491820246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5028155c10 0x7f5028155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:36.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.412+0000 7f50267fc700 1 -- 172.21.15.71:0/491820246 >> v1:172.21.15.71:6789/0 conn(0x7f50281568a0 legacy=0x7f5028156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:36.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.412+0000 7f50267fc700 1 -- 172.21.15.71:0/491820246 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50280ad2e0 con 0x7f50280ac230 2023-10-09T06:58:36.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.412+0000 7f50267fc700 1 --2- 172.21.15.71:0/491820246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50280ac230 0x7f50280ac6a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f501c0098e0 tx=0x7f501c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5024affff0d74dc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:36.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.412+0000 7f5025ffb700 1 -- 172.21.15.71:0/491820246 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50200017f0 con 0x7f50280ac230 2023-10-09T06:58:36.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.412+0000 7f5025ffb700 1 -- 172.21.15.71:0/491820246 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501c011420 con 0x7f50280ac230 2023-10-09T06:58:36.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.412+0000 7f5025ffb700 1 -- 172.21.15.71:0/491820246 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c0117c0 con 0x7f50280ac230 2023-10-09T06:58:36.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.413+0000 7f502d9ff700 1 -- 172.21.15.71:0/491820246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50280ac230 msgr2=0x7f50280ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:36.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.413+0000 7f502d9ff700 1 --2- 172.21.15.71:0/491820246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50280ac230 0x7f50280ac6a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f501c0098e0 tx=0x7f501c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:36.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.413+0000 7f502d9ff700 1 -- 172.21.15.71:0/491820246 shutdown_connections 2023-10-09T06:58:36.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.413+0000 7f502d9ff700 1 --2- 172.21.15.71:0/491820246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5028155c10 0x7f5028155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:36.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.413+0000 7f502d9ff700 1 --2- 172.21.15.71:0/491820246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50280ac230 0x7f50280ac6a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:36.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.413+0000 7f502d9ff700 1 -- 172.21.15.71:0/491820246 >> 172.21.15.71:0/491820246 conn(0x7f502806a320 msgr2=0x7f50280cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:36.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.413+0000 7f502d9ff700 1 -- 172.21.15.71:0/491820246 shutdown_connections 2023-10-09T06:58:36.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.413+0000 7f502d9ff700 1 -- 172.21.15.71:0/491820246 wait complete. 2023-10-09T06:58:36.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.415+0000 7f502d9ff700 1 Processor -- start 2023-10-09T06:58:36.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.415+0000 7f502d9ff700 1 -- start start 2023-10-09T06:58:36.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.416+0000 7f502d9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50280ac230 0x7f50281453a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:36.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.416+0000 7f502d9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5028155c10 0x7f50281579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:36.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.416+0000 7f502d9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50281568a0 0x7f50280af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:36.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.416+0000 7f502d9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50280cb490 con 0x7f50281568a0 2023-10-09T06:58:36.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.416+0000 7f502d9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50281583a0 con 0x7f5028155c10 2023-10-09T06:58:36.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.416+0000 7f502d9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50280cab60 con 0x7f50280ac230 2023-10-09T06:58:36.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.416+0000 7f50277fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50281568a0 0x7f50280af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:36.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.416+0000 7f50277fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50281568a0 0x7f50280af2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55536/0 (socket says 172.21.15.71:55536) 2023-10-09T06:58:36.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.416+0000 7f50277fe700 1 -- 172.21.15.71:0/1996429355 learned_addr learned my addr 172.21.15.71:0/1996429355 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:36.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.416+0000 7f50267fc700 1 --2- 172.21.15.71:0/1996429355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5028155c10 0x7f50281579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:36.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.416+0000 7f5026ffd700 1 --2- 172.21.15.71:0/1996429355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50280ac230 0x7f50281453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:36.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.416+0000 7f50277fe700 1 -- 172.21.15.71:0/1996429355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50280ac230 msgr2=0x7f50281453a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:36.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.416+0000 7f50277fe700 1 --2- 172.21.15.71:0/1996429355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50280ac230 0x7f50281453a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:36.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.416+0000 7f50277fe700 1 -- 172.21.15.71:0/1996429355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5028155c10 msgr2=0x7f50281579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:36.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.416+0000 7f50277fe700 1 --2- 172.21.15.71:0/1996429355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5028155c10 0x7f50281579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:36.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.416+0000 7f50277fe700 1 -- 172.21.15.71:0/1996429355 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c009420 con 0x7f50281568a0 2023-10-09T06:58:36.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.416+0000 7f5026ffd700 1 --2- 172.21.15.71:0/1996429355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50280ac230 0x7f50281453a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:36.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.416+0000 7f50277fe700 1 --2- 172.21.15.71:0/1996429355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50281568a0 0x7f50280af2d0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f502000cbe0 tx=0x7f5020001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:36.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.417+0000 7f500effd700 1 -- 172.21.15.71:0/1996429355 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020004dc0 con 0x7f50281568a0 2023-10-09T06:58:36.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.417+0000 7f500effd700 1 -- 172.21.15.71:0/1996429355 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502000a6b0 con 0x7f50281568a0 2023-10-09T06:58:36.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.417+0000 7f502d9ff700 1 -- 172.21.15.71:0/1996429355 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50280cae40 con 0x7f50281568a0 2023-10-09T06:58:36.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.417+0000 7f500effd700 1 -- 172.21.15.71:0/1996429355 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502000aa70 con 0x7f50281568a0 2023-10-09T06:58:36.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.417+0000 7f502d9ff700 1 -- 172.21.15.71:0/1996429355 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50281458e0 con 0x7f50281568a0 2023-10-09T06:58:36.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.418+0000 7f502d9ff700 1 -- 172.21.15.71:0/1996429355 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f502804c3c0 con 0x7f50281568a0 2023-10-09T06:58:36.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.419+0000 7f500effd700 1 -- 172.21.15.71:0/1996429355 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5020007150 con 0x7f50281568a0 2023-10-09T06:58:36.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.420+0000 7f500effd700 1 --2- 172.21.15.71:0/1996429355 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5014066f30 0x7f50140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:36.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.420+0000 7f500effd700 1 -- 172.21.15.71:0/1996429355 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f5020084090 con 0x7f50281568a0 2023-10-09T06:58:36.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.420+0000 7f5026ffd700 1 --2- 172.21.15.71:0/1996429355 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5014066f30 0x7f50140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:36.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.421+0000 7f5026ffd700 1 --2- 172.21.15.71:0/1996429355 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5014066f30 0x7f50140693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5018006f00 tx=0x7f5018008040 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:36.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.423+0000 7f500effd700 1 -- 172.21.15.71:0/1996429355 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50200512c0 con 0x7f50281568a0 2023-10-09T06:58:36.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:36.693+0000 7f502d9ff700 1 -- 172.21.15.71:0/1996429355 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7f50280ad5c0 con 0x7f50281568a0 2023-10-09T06:58:37.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.209+0000 7f500effd700 1 -- 172.21.15.71:0/1996429355 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v597) v1 ==== 186+0+0 (secure 0 0 0) 0x7f502000ae60 con 0x7f50281568a0 2023-10-09T06:58:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.211+0000 7f502d9ff700 1 -- 172.21.15.71:0/1996429355 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5014066f30 msgr2=0x7f50140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.211+0000 7f502d9ff700 1 --2- 172.21.15.71:0/1996429355 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5014066f30 0x7f50140693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5018006f00 tx=0x7f5018008040 comp rx=0 tx=0).stop 2023-10-09T06:58:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.211+0000 7f502d9ff700 1 -- 172.21.15.71:0/1996429355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50281568a0 msgr2=0x7f50280af2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.211+0000 7f502d9ff700 1 --2- 172.21.15.71:0/1996429355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50281568a0 0x7f50280af2d0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f502000cbe0 tx=0x7f5020001640 comp rx=0 tx=0).stop 2023-10-09T06:58:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.212+0000 7f502d9ff700 1 -- 172.21.15.71:0/1996429355 shutdown_connections 2023-10-09T06:58:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.212+0000 7f502d9ff700 1 --2- 172.21.15.71:0/1996429355 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5014066f30 0x7f50140693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.212+0000 7f502d9ff700 1 --2- 172.21.15.71:0/1996429355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50281568a0 0x7f50280af2d0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:37.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.212+0000 7f502d9ff700 1 --2- 172.21.15.71:0/1996429355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50280ac230 0x7f50281453a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:37.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.212+0000 7f502d9ff700 1 --2- 172.21.15.71:0/1996429355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5028155c10 0x7f50281579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:37.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.212+0000 7f502d9ff700 1 -- 172.21.15.71:0/1996429355 >> 172.21.15.71:0/1996429355 conn(0x7f502806a320 msgr2=0x7f5028153220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:37.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.212+0000 7f502d9ff700 1 -- 172.21.15.71:0/1996429355 shutdown_connections 2023-10-09T06:58:37.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.212+0000 7f502d9ff700 1 -- 172.21.15.71:0/1996429355 wait complete. 2023-10-09T06:58:37.232 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T06:58:37.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.413+0000 7f66af3ff700 1 Processor -- start 2023-10-09T06:58:37.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.414+0000 7f66af3ff700 1 -- start start 2023-10-09T06:58:37.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.415+0000 7f66af3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f66a80c70b0 0x7f66a8069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:37.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.415+0000 7f66af3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66a8069cb0 0x7f66a80ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:37.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.415+0000 7f66af3ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a806e950 con 0x7f66a8155eb0 2023-10-09T06:58:37.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.415+0000 7f66af3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a806a130 con 0x7f66a80c70b0 2023-10-09T06:58:37.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.415+0000 7f66af3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a806eb90 con 0x7f66a8069cb0 2023-10-09T06:58:37.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.415+0000 7f66ad19b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f66a8155eb0 0x7f66a806e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:50774/0 (socket says 172.21.15.71:50774) 2023-10-09T06:58:37.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.415+0000 7f66ad19b700 1 -- 172.21.15.71:0/3885715714 learned_addr learned my addr 172.21.15.71:0/3885715714 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:37.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.415+0000 7f66ac99a700 1 --2- 172.21.15.71:0/3885715714 >> v2:172.21.15.179:3300/0 conn(0x7f66a80c70b0 0x7f66a8069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:37.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.415+0000 7f66ad99c700 1 --2- 172.21.15.71:0/3885715714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66a8069cb0 0x7f66a80ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:37.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.415+0000 7f669ffff700 1 -- 172.21.15.71:0/3885715714 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330869136 0 0) 0x7f66a4001110 con 0x7f66a8155eb0 2023-10-09T06:58:37.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.416+0000 7f669ffff700 1 -- 172.21.15.71:0/3885715714 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6694005780 con 0x7f66a8155eb0 2023-10-09T06:58:37.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.416+0000 7f669ffff700 1 -- 172.21.15.71:0/3885715714 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2576025369 0 0) 0x7f6694005780 con 0x7f66a8155eb0 2023-10-09T06:58:37.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.416+0000 7f669ffff700 1 -- 172.21.15.71:0/3885715714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66a8069cb0 msgr2=0x7f66a80ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:37.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.416+0000 7f669ffff700 1 --2- 172.21.15.71:0/3885715714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66a8069cb0 0x7f66a80ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:37.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.416+0000 7f669ffff700 1 -- 172.21.15.71:0/3885715714 >> v2:172.21.15.179:3300/0 conn(0x7f66a80c70b0 msgr2=0x7f66a8069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:37.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.416+0000 7f669ffff700 1 --2- 172.21.15.71:0/3885715714 >> v2:172.21.15.179:3300/0 conn(0x7f66a80c70b0 0x7f66a8069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:37.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.416+0000 7f669ffff700 1 -- 172.21.15.71:0/3885715714 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a806ee70 con 0x7f66a8155eb0 2023-10-09T06:58:37.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.416+0000 7f669ffff700 1 -- 172.21.15.71:0/3885715714 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f66a4001600 con 0x7f66a8155eb0 2023-10-09T06:58:37.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.416+0000 7f669ffff700 1 -- 172.21.15.71:0/3885715714 >> v1:172.21.15.71:6789/0 conn(0x7f66a8155eb0 legacy=0x7f66a806e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:37.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.416+0000 7f669ffff700 1 --2- 172.21.15.71:0/3885715714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6694005cf0 0x7f6694006100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:37.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.416+0000 7f669ffff700 1 --2- 172.21.15.71:0/3885715714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66a8069cb0 0x7f6694006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:37.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.416+0000 7f669ffff700 1 --2- 172.21.15.71:0/3885715714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6694006f60 0x7f66940073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:37.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.416+0000 7f669ffff700 1 -- 172.21.15.71:0/3885715714 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a806a130 con 0x7f6694006f60 2023-10-09T06:58:37.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.416+0000 7f669ffff700 1 -- 172.21.15.71:0/3885715714 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a806eb90 con 0x7f6694005cf0 2023-10-09T06:58:37.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.416+0000 7f669ffff700 1 -- 172.21.15.71:0/3885715714 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669400dd50 con 0x7f66a8069cb0 2023-10-09T06:58:37.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.416+0000 7f66ac99a700 1 --2- 172.21.15.71:0/3885715714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66a8069cb0 0x7f6694006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:37.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.416+0000 7f66ad19b700 1 --2- 172.21.15.71:0/3885715714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6694005cf0 0x7f6694006100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:37.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.416+0000 7f66ad99c700 1 --2- 172.21.15.71:0/3885715714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6694006f60 0x7f66940073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:37.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.417+0000 7f66ad99c700 1 -- 172.21.15.71:0/3885715714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66a8069cb0 msgr2=0x7f6694006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:37.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.417+0000 7f66ad99c700 1 --2- 172.21.15.71:0/3885715714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66a8069cb0 0x7f6694006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:37.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.417+0000 7f66ad99c700 1 -- 172.21.15.71:0/3885715714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6694005cf0 msgr2=0x7f6694006100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:37.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.417+0000 7f66ad99c700 1 --2- 172.21.15.71:0/3885715714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6694005cf0 0x7f6694006100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:37.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.417+0000 7f66ad99c700 1 -- 172.21.15.71:0/3885715714 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6694005780 con 0x7f6694006f60 2023-10-09T06:58:37.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.417+0000 7f66ad19b700 1 --2- 172.21.15.71:0/3885715714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6694005cf0 0x7f6694006100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:58:37.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.417+0000 7f66ad99c700 1 --2- 172.21.15.71:0/3885715714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6694006f60 0x7f66940073d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f66a000e210 tx=0x7f66a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6fe172e2b5b626 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:37.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.417+0000 7f669ffff700 1 -- 172.21.15.71:0/3885715714 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a000ea60 con 0x7f6694006f60 2023-10-09T06:58:37.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.417+0000 7f669ffff700 1 -- 172.21.15.71:0/3885715714 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a000f040 con 0x7f6694006f60 2023-10-09T06:58:37.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.417+0000 7f669ffff700 1 -- 172.21.15.71:0/3885715714 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a000ee10 con 0x7f6694006f60 2023-10-09T06:58:37.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.418+0000 7f66af3ff700 1 -- 172.21.15.71:0/3885715714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6694006f60 msgr2=0x7f66940073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:37.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.418+0000 7f66af3ff700 1 --2- 172.21.15.71:0/3885715714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6694006f60 0x7f66940073d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f66a000e210 tx=0x7f66a000b040 comp rx=0 tx=0).stop 2023-10-09T06:58:37.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.418+0000 7f66ad99c700 1 -- 172.21.15.71:0/3885715714 reap_dead start 2023-10-09T06:58:37.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.418+0000 7f66af3ff700 1 -- 172.21.15.71:0/3885715714 shutdown_connections 2023-10-09T06:58:37.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.418+0000 7f66af3ff700 1 -- 172.21.15.71:0/3885715714 >> 172.21.15.71:0/3885715714 conn(0x7f66a8068e10 msgr2=0x7f66a80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:37.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.418+0000 7f66af3ff700 1 -- 172.21.15.71:0/3885715714 shutdown_connections 2023-10-09T06:58:37.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.418+0000 7f66af3ff700 1 -- 172.21.15.71:0/3885715714 wait complete. 2023-10-09T06:58:37.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.419+0000 7f66af3ff700 1 Processor -- start 2023-10-09T06:58:37.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.419+0000 7f66af3ff700 1 -- start start 2023-10-09T06:58:37.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.420+0000 7f66af3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6694006f60 0x7f66a8169fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:37.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.420+0000 7f66af3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66a80c4f70 0x7f66a815a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:37.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.420+0000 7f66af3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66a80c53e0 0x7f66a815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:37.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.420+0000 7f66af3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80ac860 con 0x7f66a80c53e0 2023-10-09T06:58:37.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.420+0000 7f66af3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80abc50 con 0x7f66a80c4f70 2023-10-09T06:58:37.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.420+0000 7f66af3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80abf30 con 0x7f6694006f60 2023-10-09T06:58:37.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.421+0000 7f66ad99c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66a80c53e0 0x7f66a815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:37.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.421+0000 7f66ad99c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66a80c53e0 0x7f66a815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55556/0 (socket says 172.21.15.71:55556) 2023-10-09T06:58:37.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.421+0000 7f66ad99c700 1 -- 172.21.15.71:0/27600099 learned_addr learned my addr 172.21.15.71:0/27600099 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:37.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.421+0000 7f66ad19b700 1 --2- 172.21.15.71:0/27600099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6694006f60 0x7f66a8169fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:37.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.421+0000 7f66ac99a700 1 --2- 172.21.15.71:0/27600099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66a80c4f70 0x7f66a815a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:37.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.421+0000 7f66ad99c700 1 -- 172.21.15.71:0/27600099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6694006f60 msgr2=0x7f66a8169fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:37.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.421+0000 7f66ad99c700 1 --2- 172.21.15.71:0/27600099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6694006f60 0x7f66a8169fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:37.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.421+0000 7f66ad99c700 1 -- 172.21.15.71:0/27600099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66a80c4f70 msgr2=0x7f66a815a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:37.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.421+0000 7f66ad99c700 1 --2- 172.21.15.71:0/27600099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66a80c4f70 0x7f66a815a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:37.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.421+0000 7f66ad99c700 1 -- 172.21.15.71:0/27600099 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a80ac210 con 0x7f66a80c53e0 2023-10-09T06:58:37.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.421+0000 7f66ac99a700 1 --2- 172.21.15.71:0/27600099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66a80c4f70 0x7f66a815a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:37.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.421+0000 7f66ad99c700 1 --2- 172.21.15.71:0/27600099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66a80c53e0 0x7f66a815abd0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f66a0016000 tx=0x7f66a001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:37.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.422+0000 7f669d7fa700 1 -- 172.21.15.71:0/27600099 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a000eee0 con 0x7f66a80c53e0 2023-10-09T06:58:37.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.422+0000 7f669d7fa700 1 -- 172.21.15.71:0/27600099 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a0022070 con 0x7f66a80c53e0 2023-10-09T06:58:37.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.422+0000 7f66af3ff700 1 -- 172.21.15.71:0/27600099 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a80ac4f0 con 0x7f66a80c53e0 2023-10-09T06:58:37.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.422+0000 7f669d7fa700 1 -- 172.21.15.71:0/27600099 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a0027680 con 0x7f66a80c53e0 2023-10-09T06:58:37.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.422+0000 7f66af3ff700 1 -- 172.21.15.71:0/27600099 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a816db30 con 0x7f66a80c53e0 2023-10-09T06:58:37.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.423+0000 7f66af3ff700 1 -- 172.21.15.71:0/27600099 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a806a700 con 0x7f66a80c53e0 2023-10-09T06:58:37.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.424+0000 7f669d7fa700 1 -- 172.21.15.71:0/27600099 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f66a0024030 con 0x7f66a80c53e0 2023-10-09T06:58:37.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.425+0000 7f669d7fa700 1 --2- 172.21.15.71:0/27600099 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f668c066f30 0x7f668c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:37.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.425+0000 7f669d7fa700 1 -- 172.21.15.71:0/27600099 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f66a0086140 con 0x7f66a80c53e0 2023-10-09T06:58:37.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.425+0000 7f66ad19b700 1 --2- 172.21.15.71:0/27600099 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f668c066f30 0x7f668c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:37.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.426+0000 7f66ad19b700 1 --2- 172.21.15.71:0/27600099 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f668c066f30 0x7f668c0693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f66a4001050 tx=0x7f66a40079d0 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:37.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.429+0000 7f669d7fa700 1 -- 172.21.15.71:0/27600099 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66a00532f0 con 0x7f66a80c53e0 2023-10-09T06:58:37.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.618+0000 7f66af3ff700 1 -- 172.21.15.71:0/27600099 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f66a80cd330 con 0x7f66a80c53e0 2023-10-09T06:58:37.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.622+0000 7f669d7fa700 1 -- 172.21.15.71:0/27600099 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f66a0056910 con 0x7f66a80c53e0 2023-10-09T06:58:37.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.624+0000 7f66af3ff700 1 -- 172.21.15.71:0/27600099 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f668c066f30 msgr2=0x7f668c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:37.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.624+0000 7f66af3ff700 1 --2- 172.21.15.71:0/27600099 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f668c066f30 0x7f668c0693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f66a4001050 tx=0x7f66a40079d0 comp rx=0 tx=0).stop 2023-10-09T06:58:37.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.624+0000 7f66af3ff700 1 -- 172.21.15.71:0/27600099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66a80c53e0 msgr2=0x7f66a815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:37.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.624+0000 7f66af3ff700 1 --2- 172.21.15.71:0/27600099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66a80c53e0 0x7f66a815abd0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f66a0016000 tx=0x7f66a001a000 comp rx=0 tx=0).stop 2023-10-09T06:58:37.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.624+0000 7f66af3ff700 1 -- 172.21.15.71:0/27600099 shutdown_connections 2023-10-09T06:58:37.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.624+0000 7f66af3ff700 1 --2- 172.21.15.71:0/27600099 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f668c066f30 0x7f668c0693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:37.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.624+0000 7f66af3ff700 1 --2- 172.21.15.71:0/27600099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66a80c53e0 0x7f66a815abd0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:37.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.624+0000 7f66af3ff700 1 --2- 172.21.15.71:0/27600099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6694006f60 0x7f66a8169fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:37.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.624+0000 7f66af3ff700 1 --2- 172.21.15.71:0/27600099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66a80c4f70 0x7f66a815a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:37.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.624+0000 7f66af3ff700 1 -- 172.21.15.71:0/27600099 >> 172.21.15.71:0/27600099 conn(0x7f66a8068e10 msgr2=0x7f66a80c12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:37.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.624+0000 7f66af3ff700 1 -- 172.21.15.71:0/27600099 shutdown_connections 2023-10-09T06:58:37.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.624+0000 7f66af3ff700 1 -- 172.21.15.71:0/27600099 wait complete. 2023-10-09T06:58:37.642 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T06:58:37.643 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:58:37.724 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T06:58:37.810 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T06:58:37.810 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T06:58:37.810 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:58:37.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.991+0000 7f4f6bfff700 1 Processor -- start 2023-10-09T06:58:37.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.992+0000 7f4f6bfff700 1 -- start start 2023-10-09T06:58:37.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.993+0000 7f4f6bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4f6c156310 0x7f4f6c0c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:37.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.993+0000 7f4f6bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f6c1566e0 0x7f4f6c0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:37.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.993+0000 7f4f6bfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6c0ca860 con 0x7f4f6c0ca300 2023-10-09T06:58:37.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.993+0000 7f4f6bfff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6c0cab40 con 0x7f4f6c156310 2023-10-09T06:58:37.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.993+0000 7f4f6bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c0cae20 con 0x7f4f6c1566e0 2023-10-09T06:58:37.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.993+0000 7f4f6affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4f6c156310 0x7f4f6c0c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:37.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.993+0000 7f4f6affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4f6c156310 0x7f4f6c0c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55570/0 (socket says 172.21.15.71:55570) 2023-10-09T06:58:37.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.993+0000 7f4f6affd700 1 -- 172.21.15.71:0/3404813767 learned_addr learned my addr 172.21.15.71:0/3404813767 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:37.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.993+0000 7f4f6a7fc700 1 --2- 172.21.15.71:0/3404813767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f6c1566e0 0x7f4f6c0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:37.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.994+0000 7f4f6affd700 1 -- 172.21.15.71:0/3404813767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f6c1566e0 msgr2=0x7f4f6c0ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:37.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.994+0000 7f4f6affd700 1 --2- 172.21.15.71:0/3404813767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f6c1566e0 0x7f4f6c0ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:37.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.994+0000 7f4f6affd700 1 -- 172.21.15.71:0/3404813767 >> v1:172.21.15.179:6789/0 conn(0x7f4f6c0ca300 legacy=0x7f4f6c0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:37.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.994+0000 7f4f6affd700 1 -- 172.21.15.71:0/3404813767 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6c0cb100 con 0x7f4f6c156310 2023-10-09T06:58:37.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.994+0000 7f4f6a7fc700 1 --2- 172.21.15.71:0/3404813767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f6c1566e0 0x7f4f6c0ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:37.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.994+0000 7f4f6affd700 1 --2- 172.21.15.71:0/3404813767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f6c156310 0x7f4f6c0c9dc0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0099b0 tx=0x7f4f5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8819ea479a62a651 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:37.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.994+0000 7f4f69ffb700 1 -- 172.21.15.71:0/3404813767 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c00b860 con 0x7f4f6c156310 2023-10-09T06:58:37.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.994+0000 7f4f69ffb700 1 -- 172.21.15.71:0/3404813767 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c00b9c0 con 0x7f4f6c156310 2023-10-09T06:58:37.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.994+0000 7f4f69ffb700 1 -- 172.21.15.71:0/3404813767 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c00bd60 con 0x7f4f6c156310 2023-10-09T06:58:37.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.995+0000 7f4f6bfff700 1 -- 172.21.15.71:0/3404813767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f6c156310 msgr2=0x7f4f6c0c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:37.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.995+0000 7f4f6bfff700 1 --2- 172.21.15.71:0/3404813767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f6c156310 0x7f4f6c0c9dc0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0099b0 tx=0x7f4f5c009250 comp rx=0 tx=0).stop 2023-10-09T06:58:37.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.995+0000 7f4f6bfff700 1 -- 172.21.15.71:0/3404813767 shutdown_connections 2023-10-09T06:58:38.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.995+0000 7f4f6bfff700 1 --2- 172.21.15.71:0/3404813767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f6c156310 0x7f4f6c0c9dc0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:38.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.995+0000 7f4f6bfff700 1 --2- 172.21.15.71:0/3404813767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f6c1566e0 0x7f4f6c0ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:38.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.995+0000 7f4f6bfff700 1 -- 172.21.15.71:0/3404813767 >> 172.21.15.71:0/3404813767 conn(0x7f4f6c0cc1f0 msgr2=0x7f4f6c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:38.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.995+0000 7f4f6bfff700 1 -- 172.21.15.71:0/3404813767 shutdown_connections 2023-10-09T06:58:38.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.995+0000 7f4f6bfff700 1 -- 172.21.15.71:0/3404813767 wait complete. 2023-10-09T06:58:38.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.996+0000 7f4f6bfff700 1 Processor -- start 2023-10-09T06:58:38.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.996+0000 7f4f6bfff700 1 -- start start 2023-10-09T06:58:38.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.997+0000 7f4f6bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f6c0ca300 0x7f4f6c15dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:38.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.997+0000 7f4f6bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f6c156310 0x7f4f6c1547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:38.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.997+0000 7f4f6bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f6c1566e0 0x7f4f6c15c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:38.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.997+0000 7f4f6bfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c154320 con 0x7f4f6c0ca300 2023-10-09T06:58:38.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.997+0000 7f4f6bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c153710 con 0x7f4f6c1566e0 2023-10-09T06:58:38.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.997+0000 7f4f6bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c1539f0 con 0x7f4f6c156310 2023-10-09T06:58:38.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.997+0000 7f4f6affd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f6c0ca300 0x7f4f6c15dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:38.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.998+0000 7f4f6affd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f6c0ca300 0x7f4f6c15dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55580/0 (socket says 172.21.15.71:55580) 2023-10-09T06:58:38.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.998+0000 7f4f6affd700 1 -- 172.21.15.71:0/2338115549 learned_addr learned my addr 172.21.15.71:0/2338115549 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:38.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.998+0000 7f4f6a7fc700 1 --2- 172.21.15.71:0/2338115549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f6c156310 0x7f4f6c1547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:38.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.998+0000 7f4f6b7fe700 1 --2- 172.21.15.71:0/2338115549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f6c1566e0 0x7f4f6c15c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:38.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.998+0000 7f4f6affd700 1 -- 172.21.15.71:0/2338115549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f6c156310 msgr2=0x7f4f6c1547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:38.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.998+0000 7f4f6affd700 1 --2- 172.21.15.71:0/2338115549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f6c156310 0x7f4f6c1547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:38.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.998+0000 7f4f6affd700 1 -- 172.21.15.71:0/2338115549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f6c1566e0 msgr2=0x7f4f6c15c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:38.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.998+0000 7f4f6affd700 1 --2- 172.21.15.71:0/2338115549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f6c1566e0 0x7f4f6c15c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:38.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.998+0000 7f4f6affd700 1 -- 172.21.15.71:0/2338115549 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c0094f0 con 0x7f4f6c0ca300 2023-10-09T06:58:38.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.998+0000 7f4f6a7fc700 1 --2- 172.21.15.71:0/2338115549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f6c156310 0x7f4f6c1547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:38.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.998+0000 7f4f6affd700 1 --2- 172.21.15.71:0/2338115549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f6c0ca300 0x7f4f6c15dc70 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c009290 tx=0x7f4f5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:38.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.998+0000 7f4f52ffd700 1 -- 172.21.15.71:0/2338115549 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c024440 con 0x7f4f6c0ca300 2023-10-09T06:58:38.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.998+0000 7f4f52ffd700 1 -- 172.21.15.71:0/2338115549 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c0245a0 con 0x7f4f6c0ca300 2023-10-09T06:58:38.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.998+0000 7f4f52ffd700 1 -- 172.21.15.71:0/2338115549 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c024960 con 0x7f4f6c0ca300 2023-10-09T06:58:38.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.998+0000 7f4f6bfff700 1 -- 172.21.15.71:0/2338115549 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f6c153cd0 con 0x7f4f6c0ca300 2023-10-09T06:58:38.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:37.999+0000 7f4f6bfff700 1 -- 172.21.15.71:0/2338115549 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6c15b770 con 0x7f4f6c0ca300 2023-10-09T06:58:38.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.000+0000 7f4f6bfff700 1 -- 172.21.15.71:0/2338115549 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6c154600 con 0x7f4f6c0ca300 2023-10-09T06:58:38.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.000+0000 7f4f52ffd700 1 -- 172.21.15.71:0/2338115549 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f5c01a420 con 0x7f4f6c0ca300 2023-10-09T06:58:38.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.001+0000 7f4f52ffd700 1 --2- 172.21.15.71:0/2338115549 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4f58066f30 0x7f4f580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:38.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.002+0000 7f4f52ffd700 1 -- 172.21.15.71:0/2338115549 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f4f5c086510 con 0x7f4f6c0ca300 2023-10-09T06:58:38.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.002+0000 7f4f6a7fc700 1 --2- 172.21.15.71:0/2338115549 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4f58066f30 0x7f4f580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:38.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.003+0000 7f4f6a7fc700 1 --2- 172.21.15.71:0/2338115549 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4f58066f30 0x7f4f580693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c0ad680 tx=0x7f4f60008040 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:38.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.005+0000 7f4f52ffd700 1 -- 172.21.15.71:0/2338115549 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f5c053770 con 0x7f4f6c0ca300 2023-10-09T06:58:38.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.240+0000 7f4f6bfff700 1 -- 172.21.15.71:0/2338115549 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f6c04c3c0 con 0x7f4f6c0ca300 2023-10-09T06:58:38.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.240+0000 7f4f52ffd700 1 -- 172.21.15.71:0/2338115549 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f4f5c015de0 con 0x7f4f6c0ca300 2023-10-09T06:58:38.241 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:38.241 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":43,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1982857991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1982857991},{"type":"v1","addr":"172.21.15.179:6836","nonce":1982857991}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6056,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3722550905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":3722550905},{"type":"v1","addr":"172.21.15.71:6835","nonce":3722550905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6466,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/1002256123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":1002256123},{"type":"v1","addr":"172.21.15.179:6837","nonce":1002256123}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6660,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/3500731262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3500731262},{"type":"v1","addr":"172.21.15.71:6834","nonce":3500731262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[]} 2023-10-09T06:58:38.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.242+0000 7f4f6bfff700 1 -- 172.21.15.71:0/2338115549 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4f58066f30 msgr2=0x7f4f580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:38.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.242+0000 7f4f6bfff700 1 --2- 172.21.15.71:0/2338115549 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4f58066f30 0x7f4f580693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c0ad680 tx=0x7f4f60008040 comp rx=0 tx=0).stop 2023-10-09T06:58:38.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.242+0000 7f4f6bfff700 1 -- 172.21.15.71:0/2338115549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f6c0ca300 msgr2=0x7f4f6c15dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:38.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.242+0000 7f4f6bfff700 1 --2- 172.21.15.71:0/2338115549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f6c0ca300 0x7f4f6c15dc70 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c009290 tx=0x7f4f5c017000 comp rx=0 tx=0).stop 2023-10-09T06:58:38.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.242+0000 7f4f6bfff700 1 -- 172.21.15.71:0/2338115549 shutdown_connections 2023-10-09T06:58:38.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.242+0000 7f4f6bfff700 1 --2- 172.21.15.71:0/2338115549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f6c1566e0 0x7f4f6c15c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:38.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.242+0000 7f4f6bfff700 1 --2- 172.21.15.71:0/2338115549 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4f58066f30 0x7f4f580693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:38.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.242+0000 7f4f6bfff700 1 --2- 172.21.15.71:0/2338115549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f6c0ca300 0x7f4f6c15dc70 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:38.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.242+0000 7f4f6bfff700 1 --2- 172.21.15.71:0/2338115549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f6c156310 0x7f4f6c1547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:38.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.242+0000 7f4f6bfff700 1 -- 172.21.15.71:0/2338115549 >> 172.21.15.71:0/2338115549 conn(0x7f4f6c0cc1f0 msgr2=0x7f4f6c0c9880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:38.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.242+0000 7f4f6bfff700 1 -- 172.21.15.71:0/2338115549 shutdown_connections 2023-10-09T06:58:38.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.242+0000 7f4f6bfff700 1 -- 172.21.15.71:0/2338115549 wait complete. 2023-10-09T06:58:38.245 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 43 2023-10-09T06:58:38.262 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T06:58:38.262 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T06:58:38.262 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T06:58:38.263 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:58:38.263 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T06:58:38.263 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T06:58:38.263 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T06:58:38.264 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:58:38.264 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T06:58:38.264 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T06:58:38.264 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T06:58:38.264 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:58:38.264 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T06:58:38.265 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T06:58:38.265 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T06:58:38.265 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T06:58:38.276 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T06:58:38.276 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T06:58:38.277 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T06:58:38.277 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T06:58:38.284 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T06:58:38.284 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T06:58:38.285 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T06:58:38.286 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T06:58:38.321 INFO:tasks.ceph.mds.a:Started 2023-10-09T06:58:38.321 DEBUG:teuthology.parallel:result is None 2023-10-09T06:58:38.324 INFO:tasks.ceph.mds.c:Started 2023-10-09T06:58:38.324 DEBUG:teuthology.parallel:result is None 2023-10-09T06:58:38.329 INFO:tasks.ceph.mds.b:Started 2023-10-09T06:58:38.329 DEBUG:teuthology.parallel:result is None 2023-10-09T06:58:38.331 INFO:tasks.ceph.mds.d:Started 2023-10-09T06:58:38.332 DEBUG:teuthology.parallel:result is None 2023-10-09T06:58:38.332 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T06:58:38.456 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2023-10-09T06:58:38.456 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-10-09T06:58:38.457 INFO:tasks.ceph.mds.c.smithi071.stderr:2023-10-09T06:58:38.456+0000 7fc42b9fd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-10-09T06:58:38.469 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-09T06:58:38.469 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-09T06:58:38.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.522+0000 7f4c5afff700 1 Processor -- start 2023-10-09T06:58:38.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.522+0000 7f4c5afff700 1 -- start start 2023-10-09T06:58:38.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.524+0000 7f4c5afff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4c540b1420 0x7f4c540ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:38.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.524+0000 7f4c5afff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c540ccf90 0x7f4c540c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:38.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.524+0000 7f4c5afff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c540cc300 con 0x7f4c540cbf30 2023-10-09T06:58:38.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.524+0000 7f4c5afff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c54156bf0 con 0x7f4c540b1420 2023-10-09T06:58:38.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.524+0000 7f4c5afff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c540ae950 con 0x7f4c540ccf90 2023-10-09T06:58:38.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.524+0000 7f4c53fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4c540b1420 0x7f4c540ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:38.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.524+0000 7f4c53fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4c540b1420 0x7f4c540ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55616/0 (socket says 172.21.15.71:55616) 2023-10-09T06:58:38.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.524+0000 7f4c58d9b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f4c540cbf30 0x7f4c540b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:57996/0 (socket says 172.21.15.71:57996) 2023-10-09T06:58:38.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.524+0000 7f4c53fff700 1 -- 172.21.15.71:0/2468292270 learned_addr learned my addr 172.21.15.71:0/2468292270 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:38.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.524+0000 7f4c5959c700 1 --2- 172.21.15.71:0/2468292270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c540ccf90 0x7f4c540c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:38.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.524+0000 7f4c53fff700 1 -- 172.21.15.71:0/2468292270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c540ccf90 msgr2=0x7f4c540c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:38.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.524+0000 7f4c53fff700 1 --2- 172.21.15.71:0/2468292270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c540ccf90 0x7f4c540c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:38.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.524+0000 7f4c53fff700 1 -- 172.21.15.71:0/2468292270 >> v1:172.21.15.179:6789/0 conn(0x7f4c540cbf30 legacy=0x7f4c540b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:38.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.524+0000 7f4c53fff700 1 -- 172.21.15.71:0/2468292270 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c540ad370 con 0x7f4c540b1420 2023-10-09T06:58:38.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.525+0000 7f4c53fff700 1 --2- 172.21.15.71:0/2468292270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c540b1420 0x7f4c540ae410 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000bc80 tx=0x7f4c4000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2043b831fb000a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:38.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.525+0000 7f4c537fe700 1 -- 172.21.15.71:0/2468292270 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4000dbb0 con 0x7f4c540b1420 2023-10-09T06:58:38.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.525+0000 7f4c537fe700 1 -- 172.21.15.71:0/2468292270 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4000dd10 con 0x7f4c540b1420 2023-10-09T06:58:38.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.525+0000 7f4c537fe700 1 -- 172.21.15.71:0/2468292270 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c400196b0 con 0x7f4c540b1420 2023-10-09T06:58:38.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.525+0000 7f4c5afff700 1 -- 172.21.15.71:0/2468292270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c540b1420 msgr2=0x7f4c540ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:38.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.525+0000 7f4c5afff700 1 --2- 172.21.15.71:0/2468292270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c540b1420 0x7f4c540ae410 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000bc80 tx=0x7f4c4000b4f0 comp rx=0 tx=0).stop 2023-10-09T06:58:38.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.526+0000 7f4c5afff700 1 -- 172.21.15.71:0/2468292270 shutdown_connections 2023-10-09T06:58:38.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.526+0000 7f4c5afff700 1 --2- 172.21.15.71:0/2468292270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c540ccf90 0x7f4c540c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:38.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.526+0000 7f4c5afff700 1 --2- 172.21.15.71:0/2468292270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c540b1420 0x7f4c540ae410 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:38.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.526+0000 7f4c5afff700 1 -- 172.21.15.71:0/2468292270 >> 172.21.15.71:0/2468292270 conn(0x7f4c5406a320 msgr2=0x7f4c540cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:38.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.526+0000 7f4c5afff700 1 -- 172.21.15.71:0/2468292270 shutdown_connections 2023-10-09T06:58:38.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.526+0000 7f4c5afff700 1 -- 172.21.15.71:0/2468292270 wait complete. 2023-10-09T06:58:38.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.527+0000 7f4c5afff700 1 Processor -- start 2023-10-09T06:58:38.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.527+0000 7f4c5afff700 1 -- start start 2023-10-09T06:58:38.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.528+0000 7f4c5afff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c540b1420 0x7f4c5416ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:38.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.528+0000 7f4c5afff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c540cbf30 0x7f4c540a85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:38.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.528+0000 7f4c5afff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c540ccf90 0x7f4c540a8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:38.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.528+0000 7f4c5afff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5416a550 con 0x7f4c540cbf30 2023-10-09T06:58:38.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.528+0000 7f4c5afff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c540c7f50 con 0x7f4c540b1420 2023-10-09T06:58:38.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.528+0000 7f4c5afff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5416b150 con 0x7f4c540ccf90 2023-10-09T06:58:38.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.528+0000 7f4c53fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c540cbf30 0x7f4c540a85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:38.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.528+0000 7f4c53fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c540cbf30 0x7f4c540a85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55624/0 (socket says 172.21.15.71:55624) 2023-10-09T06:58:38.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.528+0000 7f4c53fff700 1 -- 172.21.15.71:0/3507273315 learned_addr learned my addr 172.21.15.71:0/3507273315 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:38.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.529+0000 7f4c58d9b700 1 --2- 172.21.15.71:0/3507273315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c540b1420 0x7f4c5416ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:38.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.529+0000 7f4c5959c700 1 --2- 172.21.15.71:0/3507273315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c540ccf90 0x7f4c540a8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:38.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.529+0000 7f4c53fff700 1 -- 172.21.15.71:0/3507273315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c540ccf90 msgr2=0x7f4c540a8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:38.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.529+0000 7f4c53fff700 1 --2- 172.21.15.71:0/3507273315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c540ccf90 0x7f4c540a8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:38.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.529+0000 7f4c53fff700 1 -- 172.21.15.71:0/3507273315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c540b1420 msgr2=0x7f4c5416ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:38.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.529+0000 7f4c53fff700 1 --2- 172.21.15.71:0/3507273315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c540b1420 0x7f4c5416ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:38.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.529+0000 7f4c53fff700 1 -- 172.21.15.71:0/3507273315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4000b790 con 0x7f4c540cbf30 2023-10-09T06:58:38.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.529+0000 7f4c53fff700 1 --2- 172.21.15.71:0/3507273315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c540cbf30 0x7f4c540a85d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f4c54064290 tx=0x7f4c40019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:38.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.529+0000 7f4c50ff9700 1 -- 172.21.15.71:0/3507273315 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c40010680 con 0x7f4c540cbf30 2023-10-09T06:58:38.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.529+0000 7f4c50ff9700 1 -- 172.21.15.71:0/3507273315 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c40010800 con 0x7f4c540cbf30 2023-10-09T06:58:38.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.529+0000 7f4c5afff700 1 -- 172.21.15.71:0/3507273315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c540c7340 con 0x7f4c540cbf30 2023-10-09T06:58:38.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.529+0000 7f4c50ff9700 1 -- 172.21.15.71:0/3507273315 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c40010bc0 con 0x7f4c540cbf30 2023-10-09T06:58:38.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.530+0000 7f4c5afff700 1 -- 172.21.15.71:0/3507273315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c540c7900 con 0x7f4c540cbf30 2023-10-09T06:58:38.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.530+0000 7f4c5afff700 1 -- 172.21.15.71:0/3507273315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c540c80e0 con 0x7f4c540cbf30 2023-10-09T06:58:38.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.531+0000 7f4c50ff9700 1 -- 172.21.15.71:0/3507273315 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c4002c430 con 0x7f4c540cbf30 2023-10-09T06:58:38.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.533+0000 7f4c50ff9700 1 --2- 172.21.15.71:0/3507273315 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4c38066f30 0x7f4c380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:38.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.533+0000 7f4c50ff9700 1 -- 172.21.15.71:0/3507273315 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f4c40014070 con 0x7f4c540cbf30 2023-10-09T06:58:38.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.533+0000 7f4c58d9b700 1 --2- 172.21.15.71:0/3507273315 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4c38066f30 0x7f4c380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:38.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.534+0000 7f4c58d9b700 1 --2- 172.21.15.71:0/3507273315 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4c38066f30 0x7f4c380693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4c540ccbe0 tx=0x7f4c48007eb0 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:38.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.537+0000 7f4c50ff9700 1 -- 172.21.15.71:0/3507273315 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c40053710 con 0x7f4c540cbf30 2023-10-09T06:58:38.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:38.748+0000 7f4c5afff700 1 -- 172.21.15.71:0/3507273315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4c5404c3c0 con 0x7f4c540cbf30 2023-10-09T06:58:39.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.652+0000 7f4c50ff9700 1 -- 172.21.15.71:0/3507273315 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v103) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4c40056d30 con 0x7f4c540cbf30 2023-10-09T06:58:39.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.655+0000 7f4c5afff700 1 -- 172.21.15.71:0/3507273315 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4c38066f30 msgr2=0x7f4c380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:39.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.655+0000 7f4c5afff700 1 --2- 172.21.15.71:0/3507273315 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4c38066f30 0x7f4c380693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4c540ccbe0 tx=0x7f4c48007eb0 comp rx=0 tx=0).stop 2023-10-09T06:58:39.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.655+0000 7f4c5afff700 1 -- 172.21.15.71:0/3507273315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c540cbf30 msgr2=0x7f4c540a85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:39.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.655+0000 7f4c5afff700 1 --2- 172.21.15.71:0/3507273315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c540cbf30 0x7f4c540a85d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f4c54064290 tx=0x7f4c40019000 comp rx=0 tx=0).stop 2023-10-09T06:58:39.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.655+0000 7f4c5afff700 1 -- 172.21.15.71:0/3507273315 shutdown_connections 2023-10-09T06:58:39.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.655+0000 7f4c5afff700 1 --2- 172.21.15.71:0/3507273315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c540ccf90 0x7f4c540a8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:39.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.655+0000 7f4c5afff700 1 --2- 172.21.15.71:0/3507273315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c540b1420 0x7f4c5416ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:39.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.655+0000 7f4c5afff700 1 --2- 172.21.15.71:0/3507273315 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4c38066f30 0x7f4c380693e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:39.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.655+0000 7f4c5afff700 1 --2- 172.21.15.71:0/3507273315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c540cbf30 0x7f4c540a85d0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:39.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.655+0000 7f4c5afff700 1 -- 172.21.15.71:0/3507273315 >> 172.21.15.71:0/3507273315 conn(0x7f4c5406a320 msgr2=0x7f4c540ca590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:39.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.656+0000 7f4c5afff700 1 -- 172.21.15.71:0/3507273315 shutdown_connections 2023-10-09T06:58:39.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.656+0000 7f4c5afff700 1 -- 172.21.15.71:0/3507273315 wait complete. 2023-10-09T06:58:39.658 INFO:teuthology.orchestra.run.smithi071.stderr: removed all blocklist entries 2023-10-09T06:58:39.676 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T06:58:39.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.857+0000 7f187b3ff700 1 Processor -- start 2023-10-09T06:58:39.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.857+0000 7f187b3ff700 1 -- start start 2023-10-09T06:58:39.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.858+0000 7f187b3ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f18740ccf90 0x7f18740ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:39.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.858+0000 7f187b3ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18740cc300 con 0x7f18740b1420 2023-10-09T06:58:39.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.858+0000 7f187b3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18740ad370 con 0x7f18740cbf30 2023-10-09T06:58:39.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.858+0000 7f187b3ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1874156bf0 con 0x7f18740ccf90 2023-10-09T06:58:39.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.858+0000 7f187899a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f18740b1420 0x7f18740c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:50800/0 (socket says 172.21.15.71:50800) 2023-10-09T06:58:39.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.858+0000 7f187899a700 1 -- 172.21.15.71:0/469849328 learned_addr learned my addr 172.21.15.71:0/469849328 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:39.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.859+0000 7f187999c700 1 --2- 172.21.15.71:0/469849328 >> v2:172.21.15.71:3300/0 conn(0x7f18740ccf90 0x7f18740ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:39.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.859+0000 7f186bfff700 1 -- 172.21.15.71:0/469849328 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1647929217 0 0) 0x7f18740cc300 con 0x7f18740b1420 2023-10-09T06:58:39.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.859+0000 7f186bfff700 1 -- 172.21.15.71:0/469849328 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1860003570 con 0x7f18740b1420 2023-10-09T06:58:39.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.859+0000 7f186bfff700 1 -- 172.21.15.71:0/469849328 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095576604 0 0) 0x7f18740ad370 con 0x7f18740cbf30 2023-10-09T06:58:39.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.859+0000 7f186bfff700 1 -- 172.21.15.71:0/469849328 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18740cc300 con 0x7f18740cbf30 2023-10-09T06:58:39.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.859+0000 7f187999c700 1 -- 172.21.15.71:0/469849328 >> v1:172.21.15.179:6789/0 conn(0x7f18740cbf30 legacy=0x7f18740b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:39.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.859+0000 7f187999c700 1 -- 172.21.15.71:0/469849328 >> v1:172.21.15.71:6789/0 conn(0x7f18740b1420 legacy=0x7f18740c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:39.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.859+0000 7f187999c700 1 -- 172.21.15.71:0/469849328 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18740ad650 con 0x7f18740ccf90 2023-10-09T06:58:39.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.859+0000 7f187999c700 1 --2- 172.21.15.71:0/469849328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18740ccf90 0x7f18740ae410 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f186c009e60 tx=0x7f186c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c2554d53d6146e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:39.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.859+0000 7f186bfff700 1 -- 172.21.15.71:0/469849328 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c00e070 con 0x7f18740ccf90 2023-10-09T06:58:39.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.860+0000 7f186bfff700 1 -- 172.21.15.71:0/469849328 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c00ba70 con 0x7f18740ccf90 2023-10-09T06:58:39.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.860+0000 7f186bfff700 1 -- 172.21.15.71:0/469849328 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c00be30 con 0x7f18740ccf90 2023-10-09T06:58:39.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.860+0000 7f187b3ff700 1 -- 172.21.15.71:0/469849328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18740ccf90 msgr2=0x7f18740ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:39.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.860+0000 7f187b3ff700 1 --2- 172.21.15.71:0/469849328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18740ccf90 0x7f18740ae410 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f186c009e60 tx=0x7f186c009780 comp rx=0 tx=0).stop 2023-10-09T06:58:39.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.860+0000 7f187b3ff700 1 -- 172.21.15.71:0/469849328 shutdown_connections 2023-10-09T06:58:39.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.860+0000 7f187b3ff700 1 --2- 172.21.15.71:0/469849328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18740ccf90 0x7f18740ae410 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:39.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.860+0000 7f187b3ff700 1 -- 172.21.15.71:0/469849328 >> 172.21.15.71:0/469849328 conn(0x7f187406a320 msgr2=0x7f18740cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:39.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.860+0000 7f187b3ff700 1 -- 172.21.15.71:0/469849328 shutdown_connections 2023-10-09T06:58:39.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.860+0000 7f187b3ff700 1 -- 172.21.15.71:0/469849328 wait complete. 2023-10-09T06:58:39.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.862+0000 7f187b3ff700 1 Processor -- start 2023-10-09T06:58:39.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.862+0000 7f187b3ff700 1 -- start start 2023-10-09T06:58:39.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.863+0000 7f187b3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18740b1420 0x7f187416b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:39.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.863+0000 7f187b3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18740cbf30 0x7f18740a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:39.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.863+0000 7f187b3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18740ccf90 0x7f187406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:39.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.863+0000 7f187b3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18740a54c0 con 0x7f18740ccf90 2023-10-09T06:58:39.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.863+0000 7f187b3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18740a5d60 con 0x7f18740cbf30 2023-10-09T06:58:39.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.863+0000 7f187b3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f187416ade0 con 0x7f18740b1420 2023-10-09T06:58:39.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.863+0000 7f187999c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18740ccf90 0x7f187406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:39.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.863+0000 7f187999c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18740ccf90 0x7f187406e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55648/0 (socket says 172.21.15.71:55648) 2023-10-09T06:58:39.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.863+0000 7f187999c700 1 -- 172.21.15.71:0/763106615 learned_addr learned my addr 172.21.15.71:0/763106615 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:39.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.863+0000 7f187899a700 1 --2- 172.21.15.71:0/763106615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18740cbf30 0x7f18740a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:39.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.863+0000 7f187919b700 1 --2- 172.21.15.71:0/763106615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18740b1420 0x7f187416b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:39.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.863+0000 7f187999c700 1 -- 172.21.15.71:0/763106615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18740b1420 msgr2=0x7f187416b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:39.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.863+0000 7f187999c700 1 --2- 172.21.15.71:0/763106615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18740b1420 0x7f187416b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:39.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.863+0000 7f187999c700 1 -- 172.21.15.71:0/763106615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18740cbf30 msgr2=0x7f18740a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:39.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.863+0000 7f187999c700 1 --2- 172.21.15.71:0/763106615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18740cbf30 0x7f18740a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:39.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.863+0000 7f187999c700 1 -- 172.21.15.71:0/763106615 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c009a20 con 0x7f18740ccf90 2023-10-09T06:58:39.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.864+0000 7f187999c700 1 --2- 172.21.15.71:0/763106615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18740ccf90 0x7f187406e890 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f186c00b610 tx=0x7f186c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:39.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.864+0000 7f18697fa700 1 -- 172.21.15.71:0/763106615 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c01e430 con 0x7f18740ccf90 2023-10-09T06:58:39.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.864+0000 7f18697fa700 1 -- 172.21.15.71:0/763106615 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c01e590 con 0x7f18740ccf90 2023-10-09T06:58:39.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.864+0000 7f18697fa700 1 -- 172.21.15.71:0/763106615 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c01e950 con 0x7f18740ccf90 2023-10-09T06:58:39.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.864+0000 7f187b3ff700 1 -- 172.21.15.71:0/763106615 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18740a5710 con 0x7f18740ccf90 2023-10-09T06:58:39.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.864+0000 7f187b3ff700 1 -- 172.21.15.71:0/763106615 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18740a8240 con 0x7f18740ccf90 2023-10-09T06:58:39.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.865+0000 7f187b3ff700 1 -- 172.21.15.71:0/763106615 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f187404c3c0 con 0x7f18740ccf90 2023-10-09T06:58:39.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.866+0000 7f18697fa700 1 -- 172.21.15.71:0/763106615 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f186c01ed00 con 0x7f18740ccf90 2023-10-09T06:58:39.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.867+0000 7f18697fa700 1 --2- 172.21.15.71:0/763106615 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1858066f30 0x7f18580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:39.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.867+0000 7f18697fa700 1 -- 172.21.15.71:0/763106615 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f186c0863f0 con 0x7f18740ccf90 2023-10-09T06:58:39.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.867+0000 7f187919b700 1 --2- 172.21.15.71:0/763106615 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1858066f30 0x7f18580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:39.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.868+0000 7f187919b700 1 --2- 172.21.15.71:0/763106615 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1858066f30 0x7f18580693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f18700011e0 tx=0x7f1870009040 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:39.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:39.871+0000 7f18697fa700 1 -- 172.21.15.71:0/763106615 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f186c053830 con 0x7f18740ccf90 2023-10-09T06:58:40.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.136+0000 7f187b3ff700 1 -- 172.21.15.71:0/763106615 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f18740a5ea0 con 0x7f18740ccf90 2023-10-09T06:58:40.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.136+0000 7f18697fa700 1 -- 172.21.15.71:0/763106615 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f186c056e50 con 0x7f18740ccf90 2023-10-09T06:58:40.137 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:40.138 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T06:58:40.138 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_dump": [ 2023-10-09T06:58:40.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:40.138 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.a", 2023-10-09T06:58:40.138 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlpI5JCRAAGBgrs6g+6KZFXv1eq0fkwQ==", 2023-10-09T06:58:40.138 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:40.138 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:58:40.138 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:58:40.138 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:58:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.b", 2023-10-09T06:58:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlDZQYHhAA2LGKHPLrBVKlGMK0TKup7A==", 2023-10-09T06:58:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:58:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:58:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:58:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.c", 2023-10-09T06:58:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlLKKfExAA65+KIyYd16iQ2L5topDPkg==", 2023-10-09T06:58:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:58:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:58:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:58:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.d", 2023-10-09T06:58:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlpQKTKBAAP59h/znElthIdqbK9tKJww==", 2023-10-09T06:58:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:58:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:58:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:58:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.0", 2023-10-09T06:58:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCgoCNll7hBIBAAtZ8mBx+MPAwEou48boP4Hw==", 2023-10-09T06:58:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:58:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:58:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.1", 2023-10-09T06:58:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCjoCNl7uRMIxAAztQi4ZsulyN2FHcMRzZ82Q==", 2023-10-09T06:58:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:58:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:58:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.2", 2023-10-09T06:58:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCmoCNlW/cNJhAAfFdnRC95YJwpCngJS956cA==", 2023-10-09T06:58:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:58:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:58:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.3", 2023-10-09T06:58:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCpoCNlAIlYKRAAD5IGHWZ14ckpQAU4wBifbg==", 2023-10-09T06:58:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:58:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:58:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.4", 2023-10-09T06:58:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCvoCNltrA4ORAAtifmL9hr1xKd+jsMf5Nf+Q==", 2023-10-09T06:58:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:58:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:58:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:40.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:40.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:40.146 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.5", 2023-10-09T06:58:40.146 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCyoCNlA/IOOxAAQWRPQ+00o9xrpScAvY/87w==", 2023-10-09T06:58:40.146 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:40.146 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:58:40.146 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:58:40.146 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.6", 2023-10-09T06:58:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQC2oCNlvRusARAAcRaGyCROIRVTHeKhrncN8g==", 2023-10-09T06:58:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:58:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:58:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:40.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:40.148 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.7", 2023-10-09T06:58:40.148 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQC5oCNli/3NAxAAIMYuED41ZSx1xF384N6y1A==", 2023-10-09T06:58:40.148 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:40.148 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T06:58:40.148 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T06:58:40.148 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:40.148 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:40.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:40.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:40.149 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.0", 2023-10-09T06:58:40.149 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlHrKWMRAAyIfmryGSgqIFwWEJyixprw==", 2023-10-09T06:58:40.149 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:40.149 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:58:40.149 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow r", 2023-10-09T06:58:40.149 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T06:58:40.149 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:40.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:40.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:40.150 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.1", 2023-10-09T06:58:40.150 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCdoCNldq1xAxAAxCpmelS0qDEY187u19JkcQ==", 2023-10-09T06:58:40.150 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:40.150 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:58:40.150 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T06:58:40.150 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T06:58:40.150 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T06:58:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.2", 2023-10-09T06:58:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlM3JHOBAA8fszREXH+WnYb+3vIaakcA==", 2023-10-09T06:58:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:58:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T06:58:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T06:58:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T06:58:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.3", 2023-10-09T06:58:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCdoCNlgkEqChAAwntdv9UOo30x40pVa70yag==", 2023-10-09T06:58:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T06:58:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T06:58:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T06:58:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T06:58:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.admin", 2023-10-09T06:58:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCboCNlj2W4EhAAUnfX6NBeDyMj2nY/G2ciEg==", 2023-10-09T06:58:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T06:58:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T06:58:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T06:58:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:40.154 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:40.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:40.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:40.154 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.x", 2023-10-09T06:58:40.154 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlwwJ/AhAAjHMhAX1/yWgh9no7yQqP6Q==", 2023-10-09T06:58:40.154 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:40.154 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T06:58:40.154 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-09T06:58:40.155 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:40.155 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:40.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T06:58:40.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:40.155 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.y", 2023-10-09T06:58:40.155 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCboCNly/XVNRAAlKr9arCbsDbzZ9bpIU5dng==", 2023-10-09T06:58:40.156 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T06:58:40.156 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T06:58:40.156 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-09T06:58:40.156 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T06:58:40.156 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:40.156 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:40.156 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2023-10-09T06:58:40.156 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T06:58:40.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.139+0000 7f187b3ff700 1 -- 172.21.15.71:0/763106615 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1858066f30 msgr2=0x7f18580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:40.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.139+0000 7f187b3ff700 1 --2- 172.21.15.71:0/763106615 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1858066f30 0x7f18580693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f18700011e0 tx=0x7f1870009040 comp rx=0 tx=0).stop 2023-10-09T06:58:40.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.139+0000 7f187b3ff700 1 -- 172.21.15.71:0/763106615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18740ccf90 msgr2=0x7f187406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:40.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.139+0000 7f187b3ff700 1 --2- 172.21.15.71:0/763106615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18740ccf90 0x7f187406e890 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f186c00b610 tx=0x7f186c018000 comp rx=0 tx=0).stop 2023-10-09T06:58:40.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.139+0000 7f187b3ff700 1 -- 172.21.15.71:0/763106615 shutdown_connections 2023-10-09T06:58:40.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.139+0000 7f187b3ff700 1 --2- 172.21.15.71:0/763106615 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1858066f30 0x7f18580693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:40.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.139+0000 7f187b3ff700 1 --2- 172.21.15.71:0/763106615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18740ccf90 0x7f187406e890 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:40.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.139+0000 7f187b3ff700 1 --2- 172.21.15.71:0/763106615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18740b1420 0x7f187416b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:40.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.139+0000 7f187b3ff700 1 --2- 172.21.15.71:0/763106615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18740cbf30 0x7f18740a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:40.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.139+0000 7f187b3ff700 1 -- 172.21.15.71:0/763106615 >> 172.21.15.71:0/763106615 conn(0x7f187406a320 msgr2=0x7f1874158d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:40.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.139+0000 7f187b3ff700 1 -- 172.21.15.71:0/763106615 shutdown_connections 2023-10-09T06:58:40.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.139+0000 7f187b3ff700 1 -- 172.21.15.71:0/763106615 wait complete. 2023-10-09T06:58:40.163 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:58:40.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.342+0000 7f338f59e700 1 Processor -- start 2023-10-09T06:58:40.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.343+0000 7f338f59e700 1 -- start start 2023-10-09T06:58:40.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.344+0000 7f338f59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3390150180 0x7f3390157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:40.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.344+0000 7f338f59e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f339006e2a0 con 0x7f33900c7410 2023-10-09T06:58:40.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.344+0000 7f338f59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f339006b2e0 con 0x7f3390150550 2023-10-09T06:58:40.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.344+0000 7f338f59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33900c78e0 con 0x7f3390150180 2023-10-09T06:58:40.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.344+0000 7f338ed9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f33900c7410 0x7f3390069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:50814/0 (socket says 172.21.15.71:50814) 2023-10-09T06:58:40.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.344+0000 7f338ed9d700 1 -- 172.21.15.71:0/2174651829 learned_addr learned my addr 172.21.15.71:0/2174651829 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:40.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.344+0000 7f338e59c700 1 --2- 172.21.15.71:0/2174651829 >> v2:172.21.15.179:3300/0 conn(0x7f3390150180 0x7f3390157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:40.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.345+0000 7f338d59a700 1 -- 172.21.15.71:0/2174651829 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078676690 0 0) 0x7f339006e2a0 con 0x7f33900c7410 2023-10-09T06:58:40.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.345+0000 7f338d59a700 1 -- 172.21.15.71:0/2174651829 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3378003570 con 0x7f33900c7410 2023-10-09T06:58:40.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.345+0000 7f338e59c700 1 -- 172.21.15.71:0/2174651829 >> v1:172.21.15.179:6789/0 conn(0x7f3390150550 legacy=0x7f33900c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:40.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.345+0000 7f338e59c700 1 -- 172.21.15.71:0/2174651829 >> v1:172.21.15.71:6789/0 conn(0x7f33900c7410 legacy=0x7f3390069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:40.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.345+0000 7f338e59c700 1 -- 172.21.15.71:0/2174651829 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33900c7bc0 con 0x7f3390150180 2023-10-09T06:58:40.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.345+0000 7f338e59c700 1 --2- 172.21.15.71:0/2174651829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3390150180 0x7f3390157770 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f33800098e0 tx=0x7f33800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b4e4b7f15447f6e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:40.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.345+0000 7f338d59a700 1 -- 172.21.15.71:0/2174651829 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338000b640 con 0x7f3390150180 2023-10-09T06:58:40.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.345+0000 7f338d59a700 1 -- 172.21.15.71:0/2174651829 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338000b7a0 con 0x7f3390150180 2023-10-09T06:58:40.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.345+0000 7f338d59a700 1 -- 172.21.15.71:0/2174651829 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338000bb40 con 0x7f3390150180 2023-10-09T06:58:40.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.346+0000 7f338f59e700 1 -- 172.21.15.71:0/2174651829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3390150180 msgr2=0x7f3390157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:40.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.346+0000 7f338f59e700 1 --2- 172.21.15.71:0/2174651829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3390150180 0x7f3390157770 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f33800098e0 tx=0x7f33800091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:40.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.346+0000 7f338f59e700 1 -- 172.21.15.71:0/2174651829 shutdown_connections 2023-10-09T06:58:40.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.346+0000 7f338f59e700 1 --2- 172.21.15.71:0/2174651829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3390150180 0x7f3390157770 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:40.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.346+0000 7f338f59e700 1 -- 172.21.15.71:0/2174651829 >> 172.21.15.71:0/2174651829 conn(0x7f33900cc1f0 msgr2=0x7f33900cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:40.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.346+0000 7f338f59e700 1 -- 172.21.15.71:0/2174651829 shutdown_connections 2023-10-09T06:58:40.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.346+0000 7f338f59e700 1 -- 172.21.15.71:0/2174651829 wait complete. 2023-10-09T06:58:40.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.348+0000 7f338f59e700 1 Processor -- start 2023-10-09T06:58:40.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.348+0000 7f338f59e700 1 -- start start 2023-10-09T06:58:40.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.349+0000 7f338f59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33900c7410 0x7f3390148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:40.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.349+0000 7f338f59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3390150180 0x7f3390165890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:40.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.349+0000 7f338f59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3390150550 0x7f33900c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:40.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.349+0000 7f338f59e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33901497b0 con 0x7f33900c7410 2023-10-09T06:58:40.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.349+0000 7f338f59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33901663a0 con 0x7f3390150550 2023-10-09T06:58:40.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.349+0000 7f338f59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3390166680 con 0x7f3390150180 2023-10-09T06:58:40.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.349+0000 7f338e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33900c7410 0x7f3390148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:40.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.349+0000 7f338e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33900c7410 0x7f3390148e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55662/0 (socket says 172.21.15.71:55662) 2023-10-09T06:58:40.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.349+0000 7f338e59c700 1 -- 172.21.15.71:0/3440064274 learned_addr learned my addr 172.21.15.71:0/3440064274 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:40.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.349+0000 7f338ed9d700 1 --2- 172.21.15.71:0/3440064274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3390150550 0x7f33900c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:40.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.349+0000 7f338dd9b700 1 --2- 172.21.15.71:0/3440064274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3390150180 0x7f3390165890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:40.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.349+0000 7f338e59c700 1 -- 172.21.15.71:0/3440064274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3390150180 msgr2=0x7f3390165890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:40.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.349+0000 7f338e59c700 1 --2- 172.21.15.71:0/3440064274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3390150180 0x7f3390165890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:40.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.349+0000 7f338e59c700 1 -- 172.21.15.71:0/3440064274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3390150550 msgr2=0x7f33900c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:40.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.349+0000 7f338e59c700 1 --2- 172.21.15.71:0/3440064274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3390150550 0x7f33900c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:40.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.349+0000 7f338e59c700 1 -- 172.21.15.71:0/3440064274 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3380009420 con 0x7f33900c7410 2023-10-09T06:58:40.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.349+0000 7f338ed9d700 1 --2- 172.21.15.71:0/3440064274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3390150550 0x7f33900c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:40.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.349+0000 7f338dd9b700 1 --2- 172.21.15.71:0/3440064274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3390150180 0x7f3390165890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:40.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.350+0000 7f338e59c700 1 --2- 172.21.15.71:0/3440064274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33900c7410 0x7f3390148e80 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f339006b470 tx=0x7f3380017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:40.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.350+0000 7f337e7fc700 1 -- 172.21.15.71:0/3440064274 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338000bb20 con 0x7f33900c7410 2023-10-09T06:58:40.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.350+0000 7f337e7fc700 1 -- 172.21.15.71:0/3440064274 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3380011420 con 0x7f33900c7410 2023-10-09T06:58:40.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.350+0000 7f338f59e700 1 -- 172.21.15.71:0/3440064274 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3390149a00 con 0x7f33900c7410 2023-10-09T06:58:40.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.350+0000 7f337e7fc700 1 -- 172.21.15.71:0/3440064274 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33800117c0 con 0x7f33900c7410 2023-10-09T06:58:40.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.350+0000 7f338f59e700 1 -- 172.21.15.71:0/3440064274 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339014f4d0 con 0x7f33900c7410 2023-10-09T06:58:40.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.351+0000 7f338f59e700 1 -- 172.21.15.71:0/3440064274 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3390149f20 con 0x7f33900c7410 2023-10-09T06:58:40.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.352+0000 7f337e7fc700 1 -- 172.21.15.71:0/3440064274 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3380011b70 con 0x7f33900c7410 2023-10-09T06:58:40.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.353+0000 7f337e7fc700 1 --2- 172.21.15.71:0/3440064274 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3370066f30 0x7f33700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:40.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.353+0000 7f337e7fc700 1 -- 172.21.15.71:0/3440064274 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f3380085b00 con 0x7f33900c7410 2023-10-09T06:58:40.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.353+0000 7f338dd9b700 1 --2- 172.21.15.71:0/3440064274 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3370066f30 0x7f33700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:40.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.354+0000 7f338dd9b700 1 --2- 172.21.15.71:0/3440064274 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3370066f30 0x7f33700693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3390166a10 tx=0x7f3384009040 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:40.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.357+0000 7f337e7fc700 1 -- 172.21.15.71:0/3440064274 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3390149f20 con 0x7f33900c7410 2023-10-09T06:58:40.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.548+0000 7f338f59e700 1 -- 172.21.15.71:0/3440064274 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3390149f20 con 0x7f33900c7410 2023-10-09T06:58:40.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.549+0000 7f337e7fc700 1 -- 172.21.15.71:0/3440064274 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+12730 (secure 0 0 0) 0x7f3380087e60 con 0x7f33900c7410 2023-10-09T06:58:40.550 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:40.550 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":103,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:58:39.645524+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:58:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.551+0000 7f338f59e700 1 -- 172.21.15.71:0/3440064274 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3370066f30 msgr2=0x7f33700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.551+0000 7f338f59e700 1 --2- 172.21.15.71:0/3440064274 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3370066f30 0x7f33700693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3390166a10 tx=0x7f3384009040 comp rx=0 tx=0).stop 2023-10-09T06:58:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.551+0000 7f338f59e700 1 -- 172.21.15.71:0/3440064274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33900c7410 msgr2=0x7f3390148e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.551+0000 7f338f59e700 1 --2- 172.21.15.71:0/3440064274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33900c7410 0x7f3390148e80 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f339006b470 tx=0x7f3380017000 comp rx=0 tx=0).stop 2023-10-09T06:58:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.551+0000 7f338f59e700 1 -- 172.21.15.71:0/3440064274 shutdown_connections 2023-10-09T06:58:40.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.551+0000 7f338f59e700 1 --2- 172.21.15.71:0/3440064274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3390150550 0x7f33900c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:40.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.551+0000 7f338f59e700 1 --2- 172.21.15.71:0/3440064274 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3370066f30 0x7f33700693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:40.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.551+0000 7f338f59e700 1 --2- 172.21.15.71:0/3440064274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33900c7410 0x7f3390148e80 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:40.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.551+0000 7f338f59e700 1 --2- 172.21.15.71:0/3440064274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3390150180 0x7f3390165890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:40.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.551+0000 7f338f59e700 1 -- 172.21.15.71:0/3440064274 >> 172.21.15.71:0/3440064274 conn(0x7f33900cc1f0 msgr2=0x7f33900c93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:40.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.552+0000 7f338f59e700 1 -- 172.21.15.71:0/3440064274 shutdown_connections 2023-10-09T06:58:40.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.552+0000 7f338f59e700 1 -- 172.21.15.71:0/3440064274 wait complete. 2023-10-09T06:58:40.571 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T06:58:40.571 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T06:58:40.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.755+0000 7f60347ff700 1 Processor -- start 2023-10-09T06:58:40.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.755+0000 7f60347ff700 1 -- start start 2023-10-09T06:58:40.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.757+0000 7f60347ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f602c1568e0 0x7f602c1616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:40.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.757+0000 7f60347ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602c15b0d0 con 0x7f602c0c83f0 2023-10-09T06:58:40.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.757+0000 7f60347ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602c15a4c0 con 0x7f602c0ccee0 2023-10-09T06:58:40.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.757+0000 7f60347ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602c15a7a0 con 0x7f602c1568e0 2023-10-09T06:58:40.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.757+0000 7f603259b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f602c0c83f0 0x7f602c0c7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:50820/0 (socket says 172.21.15.71:50820) 2023-10-09T06:58:40.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.757+0000 7f603259b700 1 -- 172.21.15.71:0/2461734287 learned_addr learned my addr 172.21.15.71:0/2461734287 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:40.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.757+0000 7f6032d9c700 1 --2- 172.21.15.71:0/2461734287 >> v2:172.21.15.179:3300/0 conn(0x7f602c1568e0 0x7f602c1616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:40.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.757+0000 7f6031599700 1 -- 172.21.15.71:0/2461734287 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145753041 0 0) 0x7f602c15b0d0 con 0x7f602c0c83f0 2023-10-09T06:58:40.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.757+0000 7f6031599700 1 -- 172.21.15.71:0/2461734287 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6018003570 con 0x7f602c0c83f0 2023-10-09T06:58:40.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.757+0000 7f6031599700 1 -- 172.21.15.71:0/2461734287 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 536938503 0 0) 0x7f6018003570 con 0x7f602c0c83f0 2023-10-09T06:58:40.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.758+0000 7f6032d9c700 1 -- 172.21.15.71:0/2461734287 >> v1:172.21.15.179:6789/0 conn(0x7f602c0ccee0 legacy=0x7f602c1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:40.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.758+0000 7f6032d9c700 1 -- 172.21.15.71:0/2461734287 >> v1:172.21.15.71:6789/0 conn(0x7f602c0c83f0 legacy=0x7f602c0c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:40.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.758+0000 7f6032d9c700 1 -- 172.21.15.71:0/2461734287 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602c15aa80 con 0x7f602c1568e0 2023-10-09T06:58:40.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.758+0000 7f6032d9c700 1 --2- 172.21.15.71:0/2461734287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f602c1568e0 0x7f602c1616c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6024009e60 tx=0x7f6024009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e649ec24654d325 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:40.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.758+0000 7f6031599700 1 -- 172.21.15.71:0/2461734287 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602400e070 con 0x7f602c1568e0 2023-10-09T06:58:40.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.758+0000 7f6031599700 1 -- 172.21.15.71:0/2461734287 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602400b850 con 0x7f602c1568e0 2023-10-09T06:58:40.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.758+0000 7f6031599700 1 -- 172.21.15.71:0/2461734287 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6028001470 con 0x7f602c1568e0 2023-10-09T06:58:40.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.759+0000 7f60347ff700 1 -- 172.21.15.71:0/2461734287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f602c1568e0 msgr2=0x7f602c1616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:40.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.759+0000 7f60347ff700 1 --2- 172.21.15.71:0/2461734287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f602c1568e0 0x7f602c1616c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6024009e60 tx=0x7f6024009780 comp rx=0 tx=0).stop 2023-10-09T06:58:40.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.759+0000 7f60347ff700 1 -- 172.21.15.71:0/2461734287 shutdown_connections 2023-10-09T06:58:40.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.759+0000 7f60347ff700 1 --2- 172.21.15.71:0/2461734287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f602c1568e0 0x7f602c1616c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:40.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.759+0000 7f60347ff700 1 -- 172.21.15.71:0/2461734287 >> 172.21.15.71:0/2461734287 conn(0x7f602c068e10 msgr2=0x7f602c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:40.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.759+0000 7f60347ff700 1 -- 172.21.15.71:0/2461734287 shutdown_connections 2023-10-09T06:58:40.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.759+0000 7f60347ff700 1 -- 172.21.15.71:0/2461734287 wait complete. 2023-10-09T06:58:40.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.760+0000 7f60347ff700 1 Processor -- start 2023-10-09T06:58:40.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.760+0000 7f60347ff700 1 -- start start 2023-10-09T06:58:40.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.761+0000 7f60347ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f602c0c83f0 0x7f602c159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:40.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.761+0000 7f60347ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f602c0ccee0 0x7f602c148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:40.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.761+0000 7f60347ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f602c1568e0 0x7f602c0c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:40.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.761+0000 7f60347ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c0c6280 con 0x7f602c0ccee0 2023-10-09T06:58:40.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.761+0000 7f60347ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c0b1690 con 0x7f602c1568e0 2023-10-09T06:58:40.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.761+0000 7f60347ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602c0b1970 con 0x7f602c0c83f0 2023-10-09T06:58:40.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.762+0000 7f6031d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f602c0ccee0 0x7f602c148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:40.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.762+0000 7f6031d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f602c0ccee0 0x7f602c148b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55678/0 (socket says 172.21.15.71:55678) 2023-10-09T06:58:40.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.762+0000 7f6031d9a700 1 -- 172.21.15.71:0/2429239304 learned_addr learned my addr 172.21.15.71:0/2429239304 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:40.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.762+0000 7f603259b700 1 --2- 172.21.15.71:0/2429239304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f602c0c83f0 0x7f602c159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:40.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.762+0000 7f6032d9c700 1 --2- 172.21.15.71:0/2429239304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f602c1568e0 0x7f602c0c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:40.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.762+0000 7f6031d9a700 1 -- 172.21.15.71:0/2429239304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f602c0c83f0 msgr2=0x7f602c159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:40.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.762+0000 7f6031d9a700 1 --2- 172.21.15.71:0/2429239304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f602c0c83f0 0x7f602c159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:40.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.762+0000 7f6031d9a700 1 -- 172.21.15.71:0/2429239304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f602c1568e0 msgr2=0x7f602c0c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:40.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.762+0000 7f6031d9a700 1 --2- 172.21.15.71:0/2429239304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f602c1568e0 0x7f602c0c35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:40.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.762+0000 7f6031d9a700 1 -- 172.21.15.71:0/2429239304 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6024009a20 con 0x7f602c0ccee0 2023-10-09T06:58:40.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.762+0000 7f6031d9a700 1 --2- 172.21.15.71:0/2429239304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f602c0ccee0 0x7f602c148b30 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f601c00c790 tx=0x7f601c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:40.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.763+0000 7f60227fc700 1 -- 172.21.15.71:0/2429239304 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c011590 con 0x7f602c0ccee0 2023-10-09T06:58:40.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.763+0000 7f60227fc700 1 -- 172.21.15.71:0/2429239304 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c011710 con 0x7f602c0ccee0 2023-10-09T06:58:40.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.763+0000 7f60227fc700 1 -- 172.21.15.71:0/2429239304 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c011ad0 con 0x7f602c0ccee0 2023-10-09T06:58:40.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.763+0000 7f60347ff700 1 -- 172.21.15.71:0/2429239304 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602c0c64f0 con 0x7f602c0ccee0 2023-10-09T06:58:40.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.763+0000 7f60347ff700 1 -- 172.21.15.71:0/2429239304 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602c0b1c50 con 0x7f602c0ccee0 2023-10-09T06:58:40.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.764+0000 7f60347ff700 1 -- 172.21.15.71:0/2429239304 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602c0c66e0 con 0x7f602c0ccee0 2023-10-09T06:58:40.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.765+0000 7f60227fc700 1 -- 172.21.15.71:0/2429239304 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f601c01b3b0 con 0x7f602c0ccee0 2023-10-09T06:58:40.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.765+0000 7f60227fc700 1 --2- 172.21.15.71:0/2429239304 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6010066f30 0x7f60100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:40.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.765+0000 7f60227fc700 1 -- 172.21.15.71:0/2429239304 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f601c083820 con 0x7f602c0ccee0 2023-10-09T06:58:40.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.766+0000 7f603259b700 1 --2- 172.21.15.71:0/2429239304 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6010066f30 0x7f60100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:40.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.767+0000 7f603259b700 1 --2- 172.21.15.71:0/2429239304 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6010066f30 0x7f60100693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6028001ed0 tx=0x7f6028000bc0 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:40.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.769+0000 7f60227fc700 1 -- 172.21.15.71:0/2429239304 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f601c050c60 con 0x7f602c0ccee0 2023-10-09T06:58:40.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.958+0000 7f60347ff700 1 -- 172.21.15.71:0/2429239304 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f602c04c3c0 con 0x7f602c0ccee0 2023-10-09T06:58:40.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.959+0000 7f60227fc700 1 -- 172.21.15.71:0/2429239304 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) v1 ==== 93+0+10 (secure 0 0 0) 0x7f601c017070 con 0x7f602c0ccee0 2023-10-09T06:58:40.960 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T06:58:40.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.961+0000 7f60347ff700 1 -- 172.21.15.71:0/2429239304 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6010066f30 msgr2=0x7f60100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:40.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.961+0000 7f60347ff700 1 --2- 172.21.15.71:0/2429239304 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6010066f30 0x7f60100693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6028001ed0 tx=0x7f6028000bc0 comp rx=0 tx=0).stop 2023-10-09T06:58:40.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.961+0000 7f60347ff700 1 -- 172.21.15.71:0/2429239304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f602c0ccee0 msgr2=0x7f602c148b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:40.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.961+0000 7f60347ff700 1 --2- 172.21.15.71:0/2429239304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f602c0ccee0 0x7f602c148b30 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f601c00c790 tx=0x7f601c007f60 comp rx=0 tx=0).stop 2023-10-09T06:58:40.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.961+0000 7f60347ff700 1 -- 172.21.15.71:0/2429239304 shutdown_connections 2023-10-09T06:58:40.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.961+0000 7f60347ff700 1 --2- 172.21.15.71:0/2429239304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f602c1568e0 0x7f602c0c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:40.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.961+0000 7f60347ff700 1 --2- 172.21.15.71:0/2429239304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f602c0c83f0 0x7f602c159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:40.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.961+0000 7f60347ff700 1 --2- 172.21.15.71:0/2429239304 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f6010066f30 0x7f60100693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:40.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.961+0000 7f60347ff700 1 --2- 172.21.15.71:0/2429239304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f602c0ccee0 0x7f602c148b30 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:40.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.961+0000 7f60347ff700 1 -- 172.21.15.71:0/2429239304 >> 172.21.15.71:0/2429239304 conn(0x7f602c068e10 msgr2=0x7f602c0c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:40.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.962+0000 7f60347ff700 1 -- 172.21.15.71:0/2429239304 shutdown_connections 2023-10-09T06:58:40.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:40.962+0000 7f60347ff700 1 -- 172.21.15.71:0/2429239304 wait complete. 2023-10-09T06:58:40.980 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T06:58:41.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.160+0000 7f2209bff700 1 Processor -- start 2023-10-09T06:58:41.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.160+0000 7f2209bff700 1 -- start start 2023-10-09T06:58:41.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.161+0000 7f2209bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2204155c10 0x7f2204155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:41.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.161+0000 7f2209bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f22040ac6d0 0x7f22040b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:41.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.161+0000 7f2209bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22040acac0 con 0x7f22040ac230 2023-10-09T06:58:41.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.161+0000 7f2209bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22040ad930 con 0x7f22040ac6d0 2023-10-09T06:58:41.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.161+0000 7f2209bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22040acd20 con 0x7f2204155c10 2023-10-09T06:58:41.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.162+0000 7f2203fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f22040ac6d0 0x7f22040b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:41.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.162+0000 7f2202ffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f22040ac230 0x7f22041568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:50834/0 (socket says 172.21.15.71:50834) 2023-10-09T06:58:41.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.162+0000 7f2202ffd700 1 -- 172.21.15.71:0/2264592916 learned_addr learned my addr 172.21.15.71:0/2264592916 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:41.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.162+0000 7f2203fff700 1 --2- 172.21.15.71:0/2264592916 >> v2:172.21.15.71:3300/0 conn(0x7f22040ac6d0 0x7f22040b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55680/0 (socket says 172.21.15.71:55680) 2023-10-09T06:58:41.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.162+0000 7f22037fe700 1 --2- 172.21.15.71:0/2264592916 >> v2:172.21.15.179:3300/0 conn(0x7f2204155c10 0x7f2204155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:41.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.162+0000 7f22027fc700 1 -- 172.21.15.71:0/2264592916 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3934491414 0 0) 0x7f22040acac0 con 0x7f22040ac230 2023-10-09T06:58:41.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.162+0000 7f22027fc700 1 -- 172.21.15.71:0/2264592916 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21ec003570 con 0x7f22040ac230 2023-10-09T06:58:41.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.162+0000 7f2203fff700 1 -- 172.21.15.71:0/2264592916 >> v2:172.21.15.179:3300/0 conn(0x7f2204155c10 msgr2=0x7f2204155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:41.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.162+0000 7f2203fff700 1 --2- 172.21.15.71:0/2264592916 >> v2:172.21.15.179:3300/0 conn(0x7f2204155c10 0x7f2204155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:41.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.162+0000 7f2203fff700 1 -- 172.21.15.71:0/2264592916 >> v1:172.21.15.71:6789/0 conn(0x7f22040ac230 legacy=0x7f22041568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:41.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.162+0000 7f2203fff700 1 -- 172.21.15.71:0/2264592916 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22040ad000 con 0x7f22040ac6d0 2023-10-09T06:58:41.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.163+0000 7f2203fff700 1 --2- 172.21.15.71:0/2264592916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22040ac6d0 0x7f22040b0300 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f2204063d40 tx=0x7f21fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954eddb80443a3e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:41.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.163+0000 7f22027fc700 1 -- 172.21.15.71:0/2264592916 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc009e80 con 0x7f22040ac6d0 2023-10-09T06:58:41.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.163+0000 7f22027fc700 1 -- 172.21.15.71:0/2264592916 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc00cbc0 con 0x7f22040ac6d0 2023-10-09T06:58:41.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.163+0000 7f22027fc700 1 -- 172.21.15.71:0/2264592916 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc011400 con 0x7f22040ac6d0 2023-10-09T06:58:41.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.163+0000 7f2209bff700 1 -- 172.21.15.71:0/2264592916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22040ac6d0 msgr2=0x7f22040b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:41.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.163+0000 7f2209bff700 1 --2- 172.21.15.71:0/2264592916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22040ac6d0 0x7f22040b0300 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f2204063d40 tx=0x7f21fc009780 comp rx=0 tx=0).stop 2023-10-09T06:58:41.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.163+0000 7f2209bff700 1 -- 172.21.15.71:0/2264592916 shutdown_connections 2023-10-09T06:58:41.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.163+0000 7f2209bff700 1 --2- 172.21.15.71:0/2264592916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22040ac6d0 0x7f22040b0300 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:41.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.163+0000 7f2209bff700 1 --2- 172.21.15.71:0/2264592916 >> v2:172.21.15.179:3300/0 conn(0x7f2204155c10 0x7f2204155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:41.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.163+0000 7f2209bff700 1 -- 172.21.15.71:0/2264592916 >> 172.21.15.71:0/2264592916 conn(0x7f220406a320 msgr2=0x7f22040cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:41.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.163+0000 7f2209bff700 1 -- 172.21.15.71:0/2264592916 shutdown_connections 2023-10-09T06:58:41.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.164+0000 7f2209bff700 1 -- 172.21.15.71:0/2264592916 wait complete. 2023-10-09T06:58:41.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.165+0000 7f2209bff700 1 Processor -- start 2023-10-09T06:58:41.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.165+0000 7f2209bff700 1 -- start start 2023-10-09T06:58:41.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.166+0000 7f2209bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22040ac230 0x7f220415b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:41.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.166+0000 7f2209bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22040ac6d0 0x7f22040a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:41.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.166+0000 7f2209bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2204155c10 0x7f22040c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:41.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.166+0000 7f2209bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220406d890 con 0x7f22040ac6d0 2023-10-09T06:58:41.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.166+0000 7f2209bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220406de10 con 0x7f22040ac230 2023-10-09T06:58:41.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.166+0000 7f2209bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22040aa350 con 0x7f2204155c10 2023-10-09T06:58:41.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.166+0000 7f2202ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22040ac6d0 0x7f22040a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:41.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.166+0000 7f2202ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22040ac6d0 0x7f22040a98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55694/0 (socket says 172.21.15.71:55694) 2023-10-09T06:58:41.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.166+0000 7f2202ffd700 1 -- 172.21.15.71:0/3485604922 learned_addr learned my addr 172.21.15.71:0/3485604922 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:41.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.166+0000 7f2202ffd700 1 -- 172.21.15.71:0/3485604922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2204155c10 msgr2=0x7f22040c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:41.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.166+0000 7f2202ffd700 1 --2- 172.21.15.71:0/3485604922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2204155c10 0x7f22040c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:41.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.167+0000 7f2202ffd700 1 -- 172.21.15.71:0/3485604922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22040ac230 msgr2=0x7f220415b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:41.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.167+0000 7f22037fe700 1 --2- 172.21.15.71:0/3485604922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22040ac230 0x7f220415b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:41.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.167+0000 7f2202ffd700 1 --2- 172.21.15.71:0/3485604922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22040ac230 0x7f220415b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:41.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.167+0000 7f2202ffd700 1 -- 172.21.15.71:0/3485604922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21fc00d040 con 0x7f22040ac6d0 2023-10-09T06:58:41.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.167+0000 7f22037fe700 1 --2- 172.21.15.71:0/3485604922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22040ac230 0x7f220415b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:41.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.167+0000 7f2202ffd700 1 --2- 172.21.15.71:0/3485604922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22040ac6d0 0x7f22040a98d0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f21f800c7c0 tx=0x7f21f8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:41.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.167+0000 7f21eb7fe700 1 -- 172.21.15.71:0/3485604922 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f8005b30 con 0x7f22040ac6d0 2023-10-09T06:58:41.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.167+0000 7f21eb7fe700 1 -- 172.21.15.71:0/3485604922 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f8005c90 con 0x7f22040ac6d0 2023-10-09T06:58:41.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.167+0000 7f21eb7fe700 1 -- 172.21.15.71:0/3485604922 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f8007320 con 0x7f22040ac6d0 2023-10-09T06:58:41.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.167+0000 7f2209bff700 1 -- 172.21.15.71:0/3485604922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22040aa630 con 0x7f22040ac6d0 2023-10-09T06:58:41.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.167+0000 7f2209bff700 1 -- 172.21.15.71:0/3485604922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220414d3f0 con 0x7f22040ac6d0 2023-10-09T06:58:41.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.168+0000 7f2209bff700 1 -- 172.21.15.71:0/3485604922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f220406dfc0 con 0x7f22040ac6d0 2023-10-09T06:58:41.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.169+0000 7f21eb7fe700 1 -- 172.21.15.71:0/3485604922 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21f8007690 con 0x7f22040ac6d0 2023-10-09T06:58:41.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.170+0000 7f21eb7fe700 1 --2- 172.21.15.71:0/3485604922 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f21f0066f30 0x7f21f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:41.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.170+0000 7f21eb7fe700 1 -- 172.21.15.71:0/3485604922 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f21f80839a0 con 0x7f22040ac6d0 2023-10-09T06:58:41.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.170+0000 7f22037fe700 1 --2- 172.21.15.71:0/3485604922 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f21f0066f30 0x7f21f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:41.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.171+0000 7f22037fe700 1 --2- 172.21.15.71:0/3485604922 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f21f0066f30 0x7f21f00693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f21f4006f00 tx=0x7f21f4008040 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:41.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.174+0000 7f21eb7fe700 1 -- 172.21.15.71:0/3485604922 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f220406dfc0 con 0x7f22040ac6d0 2023-10-09T06:58:41.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.368+0000 7f2209bff700 1 -- 172.21.15.71:0/3485604922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f220406ba30 con 0x7f22040ac6d0 2023-10-09T06:58:41.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.368+0000 7f21eb7fe700 1 -- 172.21.15.71:0/3485604922 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v103) v1 ==== 84+0+65 (secure 0 0 0) 0x7f21f8017070 con 0x7f22040ac6d0 2023-10-09T06:58:41.369 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:41.370 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-09T06:58:41.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:41.370 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 1, 2023-10-09T06:58:41.370 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": ".mgr" 2023-10-09T06:58:41.370 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:41.370 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-09T06:58:41.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.371+0000 7f2209bff700 1 -- 172.21.15.71:0/3485604922 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f21f0066f30 msgr2=0x7f21f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:41.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.371+0000 7f2209bff700 1 --2- 172.21.15.71:0/3485604922 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f21f0066f30 0x7f21f00693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f21f4006f00 tx=0x7f21f4008040 comp rx=0 tx=0).stop 2023-10-09T06:58:41.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.371+0000 7f2209bff700 1 -- 172.21.15.71:0/3485604922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22040ac6d0 msgr2=0x7f22040a98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:41.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.371+0000 7f2209bff700 1 --2- 172.21.15.71:0/3485604922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22040ac6d0 0x7f22040a98d0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f21f800c7c0 tx=0x7f21f8007e00 comp rx=0 tx=0).stop 2023-10-09T06:58:41.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.371+0000 7f2209bff700 1 -- 172.21.15.71:0/3485604922 shutdown_connections 2023-10-09T06:58:41.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.371+0000 7f2209bff700 1 --2- 172.21.15.71:0/3485604922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2204155c10 0x7f22040c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:41.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.371+0000 7f2209bff700 1 --2- 172.21.15.71:0/3485604922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22040ac230 0x7f220415b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:41.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.371+0000 7f2209bff700 1 --2- 172.21.15.71:0/3485604922 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f21f0066f30 0x7f21f00693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:41.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.371+0000 7f2209bff700 1 --2- 172.21.15.71:0/3485604922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22040ac6d0 0x7f22040a98d0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:41.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.371+0000 7f2209bff700 1 -- 172.21.15.71:0/3485604922 >> 172.21.15.71:0/3485604922 conn(0x7f220406a320 msgr2=0x7f22040ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:41.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.371+0000 7f2209bff700 1 -- 172.21.15.71:0/3485604922 shutdown_connections 2023-10-09T06:58:41.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.371+0000 7f2209bff700 1 -- 172.21.15.71:0/3485604922 wait complete. 2023-10-09T06:58:41.389 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T06:58:41.390 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T06:58:41.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.574+0000 7f21b579d700 1 Processor -- start 2023-10-09T06:58:41.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.574+0000 7f21b579d700 1 -- start start 2023-10-09T06:58:41.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.575+0000 7f21b579d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f21b0153480 0x7f21b00ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:41.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.575+0000 7f21b579d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f21b0159dc0 0x7f21b0157280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:41.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.575+0000 7f21b579d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b00aec90 con 0x7f21b0153850 2023-10-09T06:58:41.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.575+0000 7f21b579d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b015a480 con 0x7f21b0159dc0 2023-10-09T06:58:41.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.575+0000 7f21b579d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b00afb40 con 0x7f21b0153480 2023-10-09T06:58:41.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.575+0000 7f21b4f9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f21b0159dc0 0x7f21b0157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:41.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.575+0000 7f21af7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f21b0153850 0x7f21b01596b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:50844/0 (socket says 172.21.15.71:50844) 2023-10-09T06:58:41.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.575+0000 7f21af7fe700 1 -- 172.21.15.71:0/1391847252 learned_addr learned my addr 172.21.15.71:0/1391847252 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:41.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.576+0000 7f21affff700 1 --2- 172.21.15.71:0/1391847252 >> v2:172.21.15.179:3300/0 conn(0x7f21b0153480 0x7f21b00ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:41.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.576+0000 7f21b4f9c700 1 -- 172.21.15.71:0/1391847252 >> v2:172.21.15.179:3300/0 conn(0x7f21b0153480 msgr2=0x7f21b00ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:41.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.576+0000 7f21b4f9c700 1 --2- 172.21.15.71:0/1391847252 >> v2:172.21.15.179:3300/0 conn(0x7f21b0153480 0x7f21b00ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:41.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.576+0000 7f21b4f9c700 1 -- 172.21.15.71:0/1391847252 >> v1:172.21.15.71:6789/0 conn(0x7f21b0153850 legacy=0x7f21b01596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:41.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.576+0000 7f21aeffd700 1 -- 172.21.15.71:0/1391847252 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569408611 0 0) 0x7f21b00aec90 con 0x7f21b0153850 2023-10-09T06:58:41.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.576+0000 7f21b4f9c700 1 -- 172.21.15.71:0/1391847252 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b00afe20 con 0x7f21b0159dc0 2023-10-09T06:58:41.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.576+0000 7f21b4f9c700 1 --2- 172.21.15.71:0/1391847252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b0159dc0 0x7f21b0157280 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f21b006cf00 tx=0x7f21a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1dcd4fdeaf0359 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:41.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.576+0000 7f21aeffd700 1 -- 172.21.15.71:0/1391847252 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a800e070 con 0x7f21b0159dc0 2023-10-09T06:58:41.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.576+0000 7f21aeffd700 1 -- 172.21.15.71:0/1391847252 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a800bc30 con 0x7f21b0159dc0 2023-10-09T06:58:41.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.576+0000 7f21aeffd700 1 -- 172.21.15.71:0/1391847252 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8012430 con 0x7f21b0159dc0 2023-10-09T06:58:41.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.577+0000 7f21b579d700 1 -- 172.21.15.71:0/1391847252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b0159dc0 msgr2=0x7f21b0157280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:41.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.577+0000 7f21b579d700 1 --2- 172.21.15.71:0/1391847252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b0159dc0 0x7f21b0157280 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f21b006cf00 tx=0x7f21a8009780 comp rx=0 tx=0).stop 2023-10-09T06:58:41.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.577+0000 7f21b579d700 1 -- 172.21.15.71:0/1391847252 shutdown_connections 2023-10-09T06:58:41.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.577+0000 7f21b579d700 1 --2- 172.21.15.71:0/1391847252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b0159dc0 0x7f21b0157280 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:41.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.577+0000 7f21b579d700 1 --2- 172.21.15.71:0/1391847252 >> v2:172.21.15.179:3300/0 conn(0x7f21b0153480 0x7f21b00ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:41.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.577+0000 7f21b579d700 1 -- 172.21.15.71:0/1391847252 >> 172.21.15.71:0/1391847252 conn(0x7f21b0068e20 msgr2=0x7f21b00cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:41.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.577+0000 7f21b579d700 1 -- 172.21.15.71:0/1391847252 shutdown_connections 2023-10-09T06:58:41.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.577+0000 7f21b579d700 1 -- 172.21.15.71:0/1391847252 wait complete. 2023-10-09T06:58:41.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.579+0000 7f21b579d700 1 Processor -- start 2023-10-09T06:58:41.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.579+0000 7f21b579d700 1 -- start start 2023-10-09T06:58:41.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.580+0000 7f21b579d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b0153480 0x7f21b00a93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:41.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.580+0000 7f21b579d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21b0153850 0x7f21b016d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:41.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.580+0000 7f21b579d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21b0159dc0 0x7f21b0069880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:41.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.580+0000 7f21b579d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b00a9920 con 0x7f21b0153480 2023-10-09T06:58:41.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.580+0000 7f21b579d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b00a8640 con 0x7f21b0153850 2023-10-09T06:58:41.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.580+0000 7f21b579d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b00a62d0 con 0x7f21b0159dc0 2023-10-09T06:58:41.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.580+0000 7f21affff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b0153480 0x7f21b00a93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:41.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.580+0000 7f21affff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b0153480 0x7f21b00a93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55720/0 (socket says 172.21.15.71:55720) 2023-10-09T06:58:41.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.580+0000 7f21affff700 1 -- 172.21.15.71:0/4208320150 learned_addr learned my addr 172.21.15.71:0/4208320150 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:41.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.580+0000 7f21affff700 1 -- 172.21.15.71:0/4208320150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21b0159dc0 msgr2=0x7f21b0069880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:41.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.580+0000 7f21affff700 1 --2- 172.21.15.71:0/4208320150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21b0159dc0 0x7f21b0069880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:41.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.580+0000 7f21affff700 1 -- 172.21.15.71:0/4208320150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21b0153850 msgr2=0x7f21b016d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:41.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.580+0000 7f21affff700 1 --2- 172.21.15.71:0/4208320150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21b0153850 0x7f21b016d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:41.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.580+0000 7f21affff700 1 -- 172.21.15.71:0/4208320150 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a8009a20 con 0x7f21b0153480 2023-10-09T06:58:41.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.580+0000 7f21affff700 1 --2- 172.21.15.71:0/4208320150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b0153480 0x7f21b00a93e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f21a000d890 tx=0x7f21a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:41.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.581+0000 7f2197fff700 1 -- 172.21.15.71:0/4208320150 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a000b600 con 0x7f21b0153480 2023-10-09T06:58:41.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.581+0000 7f2197fff700 1 -- 172.21.15.71:0/4208320150 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a000b760 con 0x7f21b0153480 2023-10-09T06:58:41.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.581+0000 7f2197fff700 1 -- 172.21.15.71:0/4208320150 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a000bae0 con 0x7f21b0153480 2023-10-09T06:58:41.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.581+0000 7f21b579d700 1 -- 172.21.15.71:0/4208320150 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b00a8900 con 0x7f21b0153480 2023-10-09T06:58:41.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.581+0000 7f21b579d700 1 -- 172.21.15.71:0/4208320150 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b00a8ec0 con 0x7f21b0153480 2023-10-09T06:58:41.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.582+0000 7f21b579d700 1 -- 172.21.15.71:0/4208320150 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b00a90b0 con 0x7f21b0153480 2023-10-09T06:58:41.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.583+0000 7f2197fff700 1 -- 172.21.15.71:0/4208320150 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21a001e460 con 0x7f21b0153480 2023-10-09T06:58:41.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.584+0000 7f2197fff700 1 --2- 172.21.15.71:0/4208320150 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f219c066f30 0x7f219c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:41.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.584+0000 7f2197fff700 1 -- 172.21.15.71:0/4208320150 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f21a0084a10 con 0x7f21b0153480 2023-10-09T06:58:41.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.584+0000 7f21af7fe700 1 --2- 172.21.15.71:0/4208320150 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f219c066f30 0x7f219c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:41.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.585+0000 7f21af7fe700 1 --2- 172.21.15.71:0/4208320150 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f219c066f30 0x7f219c0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f21a40011e0 tx=0x7f21a40079d0 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:41.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.588+0000 7f2197fff700 1 -- 172.21.15.71:0/4208320150 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21a0051e50 con 0x7f21b0153480 2023-10-09T06:58:41.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:41.778+0000 7f21b579d700 1 -- 172.21.15.71:0/4208320150 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f21b004c3c0 con 0x7f21b0153480 2023-10-09T06:58:42.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.236+0000 7f2197fff700 1 -- 172.21.15.71:0/4208320150 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v104) v1 ==== 138+0+0 (secure 0 0 0) 0x7f21a0055470 con 0x7f21b0153480 2023-10-09T06:58:42.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.241+0000 7f21b579d700 1 -- 172.21.15.71:0/4208320150 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f219c066f30 msgr2=0x7f219c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:42.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.241+0000 7f21b579d700 1 --2- 172.21.15.71:0/4208320150 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f219c066f30 0x7f219c0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f21a40011e0 tx=0x7f21a40079d0 comp rx=0 tx=0).stop 2023-10-09T06:58:42.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.241+0000 7f21b579d700 1 -- 172.21.15.71:0/4208320150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b0153480 msgr2=0x7f21b00a93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:42.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.241+0000 7f21b579d700 1 --2- 172.21.15.71:0/4208320150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b0153480 0x7f21b00a93e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f21a000d890 tx=0x7f21a0008040 comp rx=0 tx=0).stop 2023-10-09T06:58:42.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.241+0000 7f21b579d700 1 -- 172.21.15.71:0/4208320150 shutdown_connections 2023-10-09T06:58:42.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.241+0000 7f21b579d700 1 --2- 172.21.15.71:0/4208320150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21b0159dc0 0x7f21b0069880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:42.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.241+0000 7f21b579d700 1 --2- 172.21.15.71:0/4208320150 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f219c066f30 0x7f219c0693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:42.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.241+0000 7f21b579d700 1 --2- 172.21.15.71:0/4208320150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b0153480 0x7f21b00a93e0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:42.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.241+0000 7f21b579d700 1 --2- 172.21.15.71:0/4208320150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21b0153850 0x7f21b016d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:42.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.241+0000 7f21b579d700 1 -- 172.21.15.71:0/4208320150 >> 172.21.15.71:0/4208320150 conn(0x7f21b0068e20 msgr2=0x7f21b0156de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:42.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.242+0000 7f21b579d700 1 -- 172.21.15.71:0/4208320150 shutdown_connections 2023-10-09T06:58:42.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.242+0000 7f21b579d700 1 -- 172.21.15.71:0/4208320150 wait complete. 2023-10-09T06:58:42.245 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' created 2023-10-09T06:58:42.261 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T06:58:42.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.448+0000 7ff2b91ff700 1 Processor -- start 2023-10-09T06:58:42.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.448+0000 7ff2b91ff700 1 -- start start 2023-10-09T06:58:42.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.449+0000 7ff2b91ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff2b4069fa0 0x7ff2b406d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:42.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.450+0000 7ff2b91ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b4156340 con 0x7ff2b40c85c0 2023-10-09T06:58:42.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.450+0000 7ff2b91ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b40c8990 con 0x7ff2b4156ee0 2023-10-09T06:58:42.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.450+0000 7ff2b91ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b406ee20 con 0x7ff2b4069fa0 2023-10-09T06:58:42.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.450+0000 7ff2b2d9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff2b40c85c0 0x7ff2b4069890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:50850/0 (socket says 172.21.15.71:50850) 2023-10-09T06:58:42.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.450+0000 7ff2b2d9d700 1 -- 172.21.15.71:0/2019067909 learned_addr learned my addr 172.21.15.71:0/2019067909 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:42.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.450+0000 7ff2b259c700 1 --2- 172.21.15.71:0/2019067909 >> v2:172.21.15.71:3300/0 conn(0x7ff2b4069fa0 0x7ff2b406d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:42.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.450+0000 7ff2b1d9b700 1 -- 172.21.15.71:0/2019067909 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592590555 0 0) 0x7ff2b4156340 con 0x7ff2b40c85c0 2023-10-09T06:58:42.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.450+0000 7ff2b1d9b700 1 -- 172.21.15.71:0/2019067909 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff29c003570 con 0x7ff2b40c85c0 2023-10-09T06:58:42.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.450+0000 7ff2b259c700 1 -- 172.21.15.71:0/2019067909 >> v1:172.21.15.179:6789/0 conn(0x7ff2b4156ee0 legacy=0x7ff2b40c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:42.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.450+0000 7ff2b259c700 1 -- 172.21.15.71:0/2019067909 >> v1:172.21.15.71:6789/0 conn(0x7ff2b40c85c0 legacy=0x7ff2b4069890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:42.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.450+0000 7ff2b259c700 1 -- 172.21.15.71:0/2019067909 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b406dd80 con 0x7ff2b4069fa0 2023-10-09T06:58:42.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.451+0000 7ff2b259c700 1 --2- 172.21.15.71:0/2019067909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2b4069fa0 0x7ff2b406d6c0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7ff2a80098e0 tx=0x7ff2a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ffefe4b1bee916 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:42.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.451+0000 7ff2b1d9b700 1 -- 172.21.15.71:0/2019067909 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a800f6b0 con 0x7ff2b4069fa0 2023-10-09T06:58:42.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.451+0000 7ff2b1d9b700 1 -- 172.21.15.71:0/2019067909 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a800f810 con 0x7ff2b4069fa0 2023-10-09T06:58:42.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.451+0000 7ff2b1d9b700 1 -- 172.21.15.71:0/2019067909 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a800fb90 con 0x7ff2b4069fa0 2023-10-09T06:58:42.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.451+0000 7ff2b91ff700 1 -- 172.21.15.71:0/2019067909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2b4069fa0 msgr2=0x7ff2b406d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:42.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.451+0000 7ff2b91ff700 1 --2- 172.21.15.71:0/2019067909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2b4069fa0 0x7ff2b406d6c0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7ff2a80098e0 tx=0x7ff2a80091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:42.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.451+0000 7ff2b91ff700 1 -- 172.21.15.71:0/2019067909 shutdown_connections 2023-10-09T06:58:42.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.451+0000 7ff2b91ff700 1 --2- 172.21.15.71:0/2019067909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2b4069fa0 0x7ff2b406d6c0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:42.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.451+0000 7ff2b91ff700 1 -- 172.21.15.71:0/2019067909 >> 172.21.15.71:0/2019067909 conn(0x7ff2b40cc540 msgr2=0x7ff2b40cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:42.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.452+0000 7ff2b91ff700 1 -- 172.21.15.71:0/2019067909 shutdown_connections 2023-10-09T06:58:42.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.452+0000 7ff2b91ff700 1 -- 172.21.15.71:0/2019067909 wait complete. 2023-10-09T06:58:42.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.453+0000 7ff2b91ff700 1 Processor -- start 2023-10-09T06:58:42.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.453+0000 7ff2b91ff700 1 -- start start 2023-10-09T06:58:42.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.454+0000 7ff2b91ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2b4069fa0 0x7ff2b4143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:42.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.454+0000 7ff2b91ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2b40c85c0 0x7ff2b40c1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:42.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.454+0000 7ff2b91ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2b4156ee0 0x7ff2b40c2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:42.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.454+0000 7ff2b91ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b40c3300 con 0x7ff2b4069fa0 2023-10-09T06:58:42.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.454+0000 7ff2b91ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b40c0ad0 con 0x7ff2b40c85c0 2023-10-09T06:58:42.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.454+0000 7ff2b91ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b40c07f0 con 0x7ff2b4156ee0 2023-10-09T06:58:42.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.454+0000 7ff2b2d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2b4069fa0 0x7ff2b4143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:42.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.454+0000 7ff2b2d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2b4069fa0 0x7ff2b4143830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55736/0 (socket says 172.21.15.71:55736) 2023-10-09T06:58:42.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.454+0000 7ff2b2d9d700 1 -- 172.21.15.71:0/1498562863 learned_addr learned my addr 172.21.15.71:0/1498562863 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:42.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.454+0000 7ff2b259c700 1 --2- 172.21.15.71:0/1498562863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2b40c85c0 0x7ff2b40c1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:42.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.454+0000 7ff2b359e700 1 --2- 172.21.15.71:0/1498562863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2b4156ee0 0x7ff2b40c2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:42.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.455+0000 7ff2b2d9d700 1 -- 172.21.15.71:0/1498562863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2b4156ee0 msgr2=0x7ff2b40c2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:42.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.455+0000 7ff2b2d9d700 1 --2- 172.21.15.71:0/1498562863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2b4156ee0 0x7ff2b40c2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:42.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.455+0000 7ff2b2d9d700 1 -- 172.21.15.71:0/1498562863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2b40c85c0 msgr2=0x7ff2b40c1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:42.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.455+0000 7ff2b2d9d700 1 --2- 172.21.15.71:0/1498562863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2b40c85c0 0x7ff2b40c1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:42.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.455+0000 7ff2b2d9d700 1 -- 172.21.15.71:0/1498562863 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a8009420 con 0x7ff2b4069fa0 2023-10-09T06:58:42.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.455+0000 7ff2b2d9d700 1 --2- 172.21.15.71:0/1498562863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2b4069fa0 0x7ff2b4143830 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7ff2a400c7c0 tx=0x7ff2a4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:42.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.455+0000 7ff29affd700 1 -- 172.21.15.71:0/1498562863 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4005cd0 con 0x7ff2b4069fa0 2023-10-09T06:58:42.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.455+0000 7ff29affd700 1 -- 172.21.15.71:0/1498562863 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a4005e30 con 0x7ff2b4069fa0 2023-10-09T06:58:42.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.455+0000 7ff2b91ff700 1 -- 172.21.15.71:0/1498562863 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b40c2cb0 con 0x7ff2b4069fa0 2023-10-09T06:58:42.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.455+0000 7ff29affd700 1 -- 172.21.15.71:0/1498562863 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4007320 con 0x7ff2b4069fa0 2023-10-09T06:58:42.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.455+0000 7ff2b91ff700 1 -- 172.21.15.71:0/1498562863 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b40c2970 con 0x7ff2b4069fa0 2023-10-09T06:58:42.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.456+0000 7ff2b91ff700 1 -- 172.21.15.71:0/1498562863 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b40718b0 con 0x7ff2b4069fa0 2023-10-09T06:58:42.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.457+0000 7ff29affd700 1 -- 172.21.15.71:0/1498562863 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff2a401b3b0 con 0x7ff2b4069fa0 2023-10-09T06:58:42.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.458+0000 7ff29affd700 1 --2- 172.21.15.71:0/1498562863 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff2a0066f30 0x7ff2a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:42.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.458+0000 7ff29affd700 1 -- 172.21.15.71:0/1498562863 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5615+0+0 (secure 0 0 0) 0x7ff2a4083c10 con 0x7ff2b4069fa0 2023-10-09T06:58:42.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.459+0000 7ff2b259c700 1 --2- 172.21.15.71:0/1498562863 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff2a0066f30 0x7ff2a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:42.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.459+0000 7ff2b259c700 1 --2- 172.21.15.71:0/1498562863 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff2a0066f30 0x7ff2a00693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff2b406a3a0 tx=0x7ff2a8019000 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:42.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.463+0000 7ff29affd700 1 -- 172.21.15.71:0/1498562863 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2a4050e40 con 0x7ff2b4069fa0 2023-10-09T06:58:42.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:42.653+0000 7ff2b91ff700 1 -- 172.21.15.71:0/1498562863 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff2b406e060 con 0x7ff2b4069fa0 2023-10-09T06:58:43.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.237+0000 7ff29affd700 1 -- 172.21.15.71:0/1498562863 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v105) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff2a4017020 con 0x7ff2b4069fa0 2023-10-09T06:58:43.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.244+0000 7ff2b91ff700 1 -- 172.21.15.71:0/1498562863 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff2a0066f30 msgr2=0x7ff2a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:43.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.244+0000 7ff2b91ff700 1 --2- 172.21.15.71:0/1498562863 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff2a0066f30 0x7ff2a00693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff2b406a3a0 tx=0x7ff2a8019000 comp rx=0 tx=0).stop 2023-10-09T06:58:43.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.244+0000 7ff2b91ff700 1 -- 172.21.15.71:0/1498562863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2b4069fa0 msgr2=0x7ff2b4143830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:43.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.244+0000 7ff2b91ff700 1 --2- 172.21.15.71:0/1498562863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2b4069fa0 0x7ff2b4143830 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7ff2a400c7c0 tx=0x7ff2a4007e00 comp rx=0 tx=0).stop 2023-10-09T06:58:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.247+0000 7ff2b91ff700 1 -- 172.21.15.71:0/1498562863 shutdown_connections 2023-10-09T06:58:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.247+0000 7ff2b91ff700 1 --2- 172.21.15.71:0/1498562863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2b4156ee0 0x7ff2b40c2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.247+0000 7ff2b91ff700 1 --2- 172.21.15.71:0/1498562863 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff2a0066f30 0x7ff2a00693e0 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff2b406a3a0 tx=0x7ff2a8019000 comp rx=0 tx=0).stop 2023-10-09T06:58:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.247+0000 7ff2b91ff700 1 --2- 172.21.15.71:0/1498562863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2b4069fa0 0x7ff2b4143830 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.247+0000 7ff2b91ff700 1 --2- 172.21.15.71:0/1498562863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2b40c85c0 0x7ff2b40c1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.247+0000 7ff2b91ff700 1 -- 172.21.15.71:0/1498562863 >> 172.21.15.71:0/1498562863 conn(0x7ff2b40cc540 msgr2=0x7ff2b4158d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:43.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.253+0000 7ff2b91ff700 1 -- 172.21.15.71:0/1498562863 shutdown_connections 2023-10-09T06:58:43.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.253+0000 7ff2b91ff700 1 -- 172.21.15.71:0/1498562863 wait complete. 2023-10-09T06:58:43.259 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' created 2023-10-09T06:58:43.276 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T06:58:43.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.459+0000 7f19671ff700 1 Processor -- start 2023-10-09T06:58:43.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.459+0000 7f19671ff700 1 -- start start 2023-10-09T06:58:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.461+0000 7f19671ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f196015ac80 0x7f1960069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.461+0000 7f19671ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f196015b050 0x7f1960069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.461+0000 7f19671ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19600af2f0 con 0x7f19600afa60 2023-10-09T06:58:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.461+0000 7f19671ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19600af5d0 con 0x7f196015ac80 2023-10-09T06:58:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.461+0000 7f19671ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19600c8660 con 0x7f196015b050 2023-10-09T06:58:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.461+0000 7f1964f9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f196015ac80 0x7f1960069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.461+0000 7f1964f9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f196015ac80 0x7f1960069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55738/0 (socket says 172.21.15.71:55738) 2023-10-09T06:58:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.461+0000 7f1964f9b700 1 -- 172.21.15.71:0/2369958548 learned_addr learned my addr 172.21.15.71:0/2369958548 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:43.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.461+0000 7f196579c700 1 --1- 172.21.15.71:0/2369958548 >> v1:172.21.15.71:6789/0 conn(0x7f19600afa60 0x7f19600afe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:50862/0 (socket says 172.21.15.71:50862) 2023-10-09T06:58:43.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.461+0000 7f195ffff700 1 --2- 172.21.15.71:0/2369958548 >> v2:172.21.15.179:3300/0 conn(0x7f196015b050 0x7f1960069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:43.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.461+0000 7f1964f9b700 1 -- 172.21.15.71:0/2369958548 >> v2:172.21.15.179:3300/0 conn(0x7f196015b050 msgr2=0x7f1960069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:43.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.461+0000 7f1964f9b700 1 --2- 172.21.15.71:0/2369958548 >> v2:172.21.15.179:3300/0 conn(0x7f196015b050 0x7f1960069cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:43.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.461+0000 7f1964f9b700 1 -- 172.21.15.71:0/2369958548 >> v1:172.21.15.71:6789/0 conn(0x7f19600afa60 legacy=0x7f19600afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:43.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.461+0000 7f1964f9b700 1 -- 172.21.15.71:0/2369958548 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19600c8940 con 0x7f196015ac80 2023-10-09T06:58:43.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.461+0000 7f195f7fe700 1 -- 172.21.15.71:0/2369958548 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426475898 0 0) 0x7f19600af2f0 con 0x7f19600afa60 2023-10-09T06:58:43.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.462+0000 7f1964f9b700 1 --2- 172.21.15.71:0/2369958548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f196015ac80 0x7f1960069770 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f19600c9fd0 tx=0x7f1954009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6199071f84e2d9f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:43.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.462+0000 7f195f7fe700 1 -- 172.21.15.71:0/2369958548 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195400b860 con 0x7f196015ac80 2023-10-09T06:58:43.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.462+0000 7f195f7fe700 1 -- 172.21.15.71:0/2369958548 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195400b9c0 con 0x7f196015ac80 2023-10-09T06:58:43.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.462+0000 7f195f7fe700 1 -- 172.21.15.71:0/2369958548 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195400bd60 con 0x7f196015ac80 2023-10-09T06:58:43.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.462+0000 7f19671ff700 1 -- 172.21.15.71:0/2369958548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f196015ac80 msgr2=0x7f1960069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:43.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.462+0000 7f19671ff700 1 --2- 172.21.15.71:0/2369958548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f196015ac80 0x7f1960069770 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f19600c9fd0 tx=0x7f1954009250 comp rx=0 tx=0).stop 2023-10-09T06:58:43.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.462+0000 7f19671ff700 1 -- 172.21.15.71:0/2369958548 shutdown_connections 2023-10-09T06:58:43.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.462+0000 7f19671ff700 1 --2- 172.21.15.71:0/2369958548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f196015ac80 0x7f1960069770 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:43.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.462+0000 7f19671ff700 1 --2- 172.21.15.71:0/2369958548 >> v2:172.21.15.179:3300/0 conn(0x7f196015b050 0x7f1960069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:43.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.462+0000 7f19671ff700 1 -- 172.21.15.71:0/2369958548 >> 172.21.15.71:0/2369958548 conn(0x7f1960068e10 msgr2=0x7f19600cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:43.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.463+0000 7f19671ff700 1 -- 172.21.15.71:0/2369958548 shutdown_connections 2023-10-09T06:58:43.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.463+0000 7f19671ff700 1 -- 172.21.15.71:0/2369958548 wait complete. 2023-10-09T06:58:43.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.464+0000 7f19671ff700 1 Processor -- start 2023-10-09T06:58:43.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.464+0000 7f19671ff700 1 -- start start 2023-10-09T06:58:43.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.465+0000 7f19671ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19600afa60 0x7f1960151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:43.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.465+0000 7f19671ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f196015ac80 0x7f19600cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:43.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.465+0000 7f19671ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f196015b050 0x7f19601526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:43.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.465+0000 7f19671ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19600a98d0 con 0x7f19600afa60 2023-10-09T06:58:43.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.465+0000 7f19671ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19600a9e90 con 0x7f196015ac80 2023-10-09T06:58:43.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.465+0000 7f19671ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19601518a0 con 0x7f196015b050 2023-10-09T06:58:43.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.465+0000 7f1964f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19600afa60 0x7f1960151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:43.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.465+0000 7f1964f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19600afa60 0x7f1960151360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55754/0 (socket says 172.21.15.71:55754) 2023-10-09T06:58:43.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.465+0000 7f1964f9b700 1 -- 172.21.15.71:0/1442977181 learned_addr learned my addr 172.21.15.71:0/1442977181 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:43.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.465+0000 7f195ffff700 1 --2- 172.21.15.71:0/1442977181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f196015ac80 0x7f19600cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:43.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.465+0000 7f196579c700 1 --2- 172.21.15.71:0/1442977181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f196015b050 0x7f19601526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:43.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.466+0000 7f1964f9b700 1 -- 172.21.15.71:0/1442977181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f196015b050 msgr2=0x7f19601526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:43.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.466+0000 7f1964f9b700 1 --2- 172.21.15.71:0/1442977181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f196015b050 0x7f19601526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:43.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.466+0000 7f1964f9b700 1 -- 172.21.15.71:0/1442977181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f196015ac80 msgr2=0x7f19600cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:43.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.466+0000 7f1964f9b700 1 --2- 172.21.15.71:0/1442977181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f196015ac80 0x7f19600cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:43.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.466+0000 7f1964f9b700 1 -- 172.21.15.71:0/1442977181 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19540094f0 con 0x7f19600afa60 2023-10-09T06:58:43.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.466+0000 7f1964f9b700 1 --2- 172.21.15.71:0/1442977181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19600afa60 0x7f1960151360 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f1960063d40 tx=0x7f1954017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:43.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.466+0000 7f195cff9700 1 -- 172.21.15.71:0/1442977181 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1954024440 con 0x7f19600afa60 2023-10-09T06:58:43.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.466+0000 7f195cff9700 1 -- 172.21.15.71:0/1442977181 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19540245c0 con 0x7f19600afa60 2023-10-09T06:58:43.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.466+0000 7f195cff9700 1 -- 172.21.15.71:0/1442977181 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1954024980 con 0x7f19600afa60 2023-10-09T06:58:43.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.466+0000 7f19671ff700 1 -- 172.21.15.71:0/1442977181 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19600cbc70 con 0x7f19600afa60 2023-10-09T06:58:43.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.466+0000 7f19671ff700 1 -- 172.21.15.71:0/1442977181 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19600a9b20 con 0x7f19600afa60 2023-10-09T06:58:43.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.467+0000 7f19671ff700 1 -- 172.21.15.71:0/1442977181 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19600cc170 con 0x7f19600afa60 2023-10-09T06:58:43.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.468+0000 7f195cff9700 1 -- 172.21.15.71:0/1442977181 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f195401a420 con 0x7f19600afa60 2023-10-09T06:58:43.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.469+0000 7f195cff9700 1 --2- 172.21.15.71:0/1442977181 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1944066f30 0x7f19440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:43.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.469+0000 7f195cff9700 1 -- 172.21.15.71:0/1442977181 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f1954086880 con 0x7f19600afa60 2023-10-09T06:58:43.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.470+0000 7f195ffff700 1 --2- 172.21.15.71:0/1442977181 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1944066f30 0x7f19440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:43.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.470+0000 7f195ffff700 1 --2- 172.21.15.71:0/1442977181 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1944066f30 0x7f19440693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f196015a160 tx=0x7f194c008040 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:43.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.473+0000 7f195cff9700 1 -- 172.21.15.71:0/1442977181 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1954053b30 con 0x7f19600afa60 2023-10-09T06:58:43.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:43.705+0000 7f19671ff700 1 -- 172.21.15.71:0/1442977181 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f196004c430 con 0x7f19600afa60 2023-10-09T06:58:44.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.249+0000 7f195cff9700 1 -- 172.21.15.71:0/1442977181 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v45) v1 ==== 174+0+0 (secure 0 0 0) 0x7f196004c430 con 0x7f19600afa60 2023-10-09T06:58:44.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.251+0000 7f19671ff700 1 -- 172.21.15.71:0/1442977181 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1944066f30 msgr2=0x7f19440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:44.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.251+0000 7f19671ff700 1 --2- 172.21.15.71:0/1442977181 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1944066f30 0x7f19440693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f196015a160 tx=0x7f194c008040 comp rx=0 tx=0).stop 2023-10-09T06:58:44.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.251+0000 7f19671ff700 1 -- 172.21.15.71:0/1442977181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19600afa60 msgr2=0x7f1960151360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:44.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.251+0000 7f19671ff700 1 --2- 172.21.15.71:0/1442977181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19600afa60 0x7f1960151360 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f1960063d40 tx=0x7f1954017000 comp rx=0 tx=0).stop 2023-10-09T06:58:44.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.252+0000 7f19671ff700 1 -- 172.21.15.71:0/1442977181 shutdown_connections 2023-10-09T06:58:44.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.252+0000 7f19671ff700 1 --2- 172.21.15.71:0/1442977181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f196015b050 0x7f19601526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:44.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.252+0000 7f19671ff700 1 --2- 172.21.15.71:0/1442977181 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f1944066f30 0x7f19440693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:44.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.252+0000 7f19671ff700 1 --2- 172.21.15.71:0/1442977181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19600afa60 0x7f1960151360 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:44.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.252+0000 7f19671ff700 1 --2- 172.21.15.71:0/1442977181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f196015ac80 0x7f19600cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:44.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.252+0000 7f19671ff700 1 -- 172.21.15.71:0/1442977181 >> 172.21.15.71:0/1442977181 conn(0x7f1960068e10 msgr2=0x7f19600cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:44.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.252+0000 7f19671ff700 1 -- 172.21.15.71:0/1442977181 shutdown_connections 2023-10-09T06:58:44.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.252+0000 7f19671ff700 1 -- 172.21.15.71:0/1442977181 wait complete. 2023-10-09T06:58:44.256 INFO:teuthology.orchestra.run.smithi071.stderr:new fs with metadata pool 12 and data pool 13 2023-10-09T06:58:44.275 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:58:44.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.454+0000 7f8b14d9d700 1 Processor -- start 2023-10-09T06:58:44.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.454+0000 7f8b14d9d700 1 -- start start 2023-10-09T06:58:44.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.456+0000 7f8b14d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b10150180 0x7f8b10157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:44.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.456+0000 7f8b14d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8b100c7410 0x7f8b10069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:44.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.456+0000 7f8b14d9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b1006e2a0 con 0x7f8b10150550 2023-10-09T06:58:44.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.456+0000 7f8b14d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b1006b2e0 con 0x7f8b100c7410 2023-10-09T06:58:44.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.456+0000 7f8b14d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b100c78e0 con 0x7f8b10150180 2023-10-09T06:58:44.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.456+0000 7f8b0effd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8b10150550 0x7f8b100c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:50872/0 (socket says 172.21.15.71:50872) 2023-10-09T06:58:44.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.456+0000 7f8b0effd700 1 -- 172.21.15.71:0/3748932052 learned_addr learned my addr 172.21.15.71:0/3748932052 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:44.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.456+0000 7f8b0ffff700 1 --2- 172.21.15.71:0/3748932052 >> v2:172.21.15.179:3300/0 conn(0x7f8b100c7410 0x7f8b10069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:44.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.456+0000 7f8b0f7fe700 1 --2- 172.21.15.71:0/3748932052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b10150180 0x7f8b10157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:44.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.457+0000 7f8b0e7fc700 1 -- 172.21.15.71:0/3748932052 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792142672 0 0) 0x7f8b1006e2a0 con 0x7f8b10150550 2023-10-09T06:58:44.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.457+0000 7f8b0e7fc700 1 -- 172.21.15.71:0/3748932052 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8af8003570 con 0x7f8b10150550 2023-10-09T06:58:44.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.457+0000 7f8b0e7fc700 1 -- 172.21.15.71:0/3748932052 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2978307302 0 0) 0x7f8af8003570 con 0x7f8b10150550 2023-10-09T06:58:44.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.457+0000 7f8b0ffff700 1 -- 172.21.15.71:0/3748932052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b10150180 msgr2=0x7f8b10157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:44.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.457+0000 7f8b0ffff700 1 --2- 172.21.15.71:0/3748932052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b10150180 0x7f8b10157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:44.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.457+0000 7f8b0ffff700 1 -- 172.21.15.71:0/3748932052 >> v1:172.21.15.71:6789/0 conn(0x7f8b10150550 legacy=0x7f8b100c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:44.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.457+0000 7f8b0ffff700 1 -- 172.21.15.71:0/3748932052 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b100c7bc0 con 0x7f8b100c7410 2023-10-09T06:58:44.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.457+0000 7f8b0f7fe700 1 --2- 172.21.15.71:0/3748932052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b10150180 0x7f8b10157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:58:44.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.457+0000 7f8b0ffff700 1 --2- 172.21.15.71:0/3748932052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b100c7410 0x7f8b10069f50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8b08009e60 tx=0x7f8b08009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66a3743acfbb39ef server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:44.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.457+0000 7f8b0e7fc700 1 -- 172.21.15.71:0/3748932052 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b04001470 con 0x7f8b100c7410 2023-10-09T06:58:44.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.458+0000 7f8b0e7fc700 1 -- 172.21.15.71:0/3748932052 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0800b7a0 con 0x7f8b100c7410 2023-10-09T06:58:44.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.458+0000 7f8b0e7fc700 1 -- 172.21.15.71:0/3748932052 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0800bb60 con 0x7f8b100c7410 2023-10-09T06:58:44.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.458+0000 7f8b14d9d700 1 -- 172.21.15.71:0/3748932052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b100c7410 msgr2=0x7f8b10069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:44.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.458+0000 7f8b14d9d700 1 --2- 172.21.15.71:0/3748932052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b100c7410 0x7f8b10069f50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8b08009e60 tx=0x7f8b08009780 comp rx=0 tx=0).stop 2023-10-09T06:58:44.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.458+0000 7f8b14d9d700 1 -- 172.21.15.71:0/3748932052 shutdown_connections 2023-10-09T06:58:44.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.458+0000 7f8b14d9d700 1 --2- 172.21.15.71:0/3748932052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b100c7410 0x7f8b10069f50 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:44.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.458+0000 7f8b14d9d700 1 --2- 172.21.15.71:0/3748932052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b10150180 0x7f8b10157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:44.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.458+0000 7f8b14d9d700 1 -- 172.21.15.71:0/3748932052 >> 172.21.15.71:0/3748932052 conn(0x7f8b100cc1f0 msgr2=0x7f8b100cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:44.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.458+0000 7f8b14d9d700 1 -- 172.21.15.71:0/3748932052 shutdown_connections 2023-10-09T06:58:44.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.458+0000 7f8b14d9d700 1 -- 172.21.15.71:0/3748932052 wait complete. 2023-10-09T06:58:44.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.460+0000 7f8b14d9d700 1 Processor -- start 2023-10-09T06:58:44.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.460+0000 7f8b14d9d700 1 -- start start 2023-10-09T06:58:44.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.461+0000 7f8b14d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b100c7410 0x7f8b100c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:44.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.461+0000 7f8b14d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b10150180 0x7f8b100c33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:44.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.461+0000 7f8b14d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b10150550 0x7f8b100ca400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:44.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.461+0000 7f8b14d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b100c9f70 con 0x7f8b100c7410 2023-10-09T06:58:44.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.461+0000 7f8b14d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b100b0c20 con 0x7f8b10150180 2023-10-09T06:58:44.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.461+0000 7f8b14d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b100c9360 con 0x7f8b10150550 2023-10-09T06:58:44.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.461+0000 7f8b0f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b100c7410 0x7f8b100c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:44.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.461+0000 7f8b0f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b100c7410 0x7f8b100c8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55756/0 (socket says 172.21.15.71:55756) 2023-10-09T06:58:44.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.461+0000 7f8b0f7fe700 1 -- 172.21.15.71:0/3280359476 learned_addr learned my addr 172.21.15.71:0/3280359476 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:44.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.461+0000 7f8b0effd700 1 --2- 172.21.15.71:0/3280359476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b10150180 0x7f8b100c33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:44.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.461+0000 7f8b0ffff700 1 --2- 172.21.15.71:0/3280359476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b10150550 0x7f8b100ca400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:44.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.461+0000 7f8b0f7fe700 1 -- 172.21.15.71:0/3280359476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b10150550 msgr2=0x7f8b100ca400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:44.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.461+0000 7f8b0f7fe700 1 --2- 172.21.15.71:0/3280359476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b10150550 0x7f8b100ca400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:44.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.461+0000 7f8b0f7fe700 1 -- 172.21.15.71:0/3280359476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b10150180 msgr2=0x7f8b100c33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:44.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.461+0000 7f8b0f7fe700 1 --2- 172.21.15.71:0/3280359476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b10150180 0x7f8b100c33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:44.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.461+0000 7f8b0f7fe700 1 -- 172.21.15.71:0/3280359476 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0000a5d0 con 0x7f8b100c7410 2023-10-09T06:58:44.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.461+0000 7f8b0ffff700 1 --2- 172.21.15.71:0/3280359476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b10150550 0x7f8b100ca400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:44.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.461+0000 7f8b0effd700 1 --2- 172.21.15.71:0/3280359476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b10150180 0x7f8b100c33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:44.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.462+0000 7f8b0f7fe700 1 --2- 172.21.15.71:0/3280359476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b100c7410 0x7f8b100c8c60 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f8b0000eaf0 tx=0x7f8b0000a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:44.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.462+0000 7f8af77fe700 1 -- 172.21.15.71:0/3280359476 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0000ca20 con 0x7f8b100c7410 2023-10-09T06:58:44.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.462+0000 7f8af77fe700 1 -- 172.21.15.71:0/3280359476 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0000cb80 con 0x7f8b100c7410 2023-10-09T06:58:44.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.462+0000 7f8b14d9d700 1 -- 172.21.15.71:0/3280359476 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b08009a20 con 0x7f8b100c7410 2023-10-09T06:58:44.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.462+0000 7f8af77fe700 1 -- 172.21.15.71:0/3280359476 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0001a430 con 0x7f8b100c7410 2023-10-09T06:58:44.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.462+0000 7f8b14d9d700 1 -- 172.21.15.71:0/3280359476 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b100c9920 con 0x7f8b100c7410 2023-10-09T06:58:44.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.463+0000 7f8b14d9d700 1 -- 172.21.15.71:0/3280359476 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b100ca250 con 0x7f8b100c7410 2023-10-09T06:58:44.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.464+0000 7f8af77fe700 1 -- 172.21.15.71:0/3280359476 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b000113f0 con 0x7f8b100c7410 2023-10-09T06:58:44.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.465+0000 7f8af77fe700 1 --2- 172.21.15.71:0/3280359476 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8afc066f30 0x7f8afc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:44.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.465+0000 7f8af77fe700 1 -- 172.21.15.71:0/3280359476 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f8b00015030 con 0x7f8b100c7410 2023-10-09T06:58:44.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.465+0000 7f8b0effd700 1 --2- 172.21.15.71:0/3280359476 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8afc066f30 0x7f8afc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:44.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.466+0000 7f8b0effd700 1 --2- 172.21.15.71:0/3280359476 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8afc066f30 0x7f8afc0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8b100b1ec0 tx=0x7f8b040015e0 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:44.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.469+0000 7f8af77fe700 1 -- 172.21.15.71:0/3280359476 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b00051a30 con 0x7f8b100c7410 2023-10-09T06:58:44.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.659+0000 7f8b14d9d700 1 -- 172.21.15.71:0/3280359476 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b1004c3c0 con 0x7f8b100c7410 2023-10-09T06:58:44.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.660+0000 7f8af77fe700 1 -- 172.21.15.71:0/3280359476 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+15971 (secure 0 0 0) 0x7f8b0001f090 con 0x7f8b100c7410 2023-10-09T06:58:44.661 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:44.661 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":106,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:58:43.706940+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:58:41.817433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T06:58:42.692884+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:58:44.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.662+0000 7f8b14d9d700 1 -- 172.21.15.71:0/3280359476 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8afc066f30 msgr2=0x7f8afc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:44.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.662+0000 7f8b14d9d700 1 --2- 172.21.15.71:0/3280359476 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8afc066f30 0x7f8afc0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8b100b1ec0 tx=0x7f8b040015e0 comp rx=0 tx=0).stop 2023-10-09T06:58:44.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.662+0000 7f8b14d9d700 1 -- 172.21.15.71:0/3280359476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b100c7410 msgr2=0x7f8b100c8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:44.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.662+0000 7f8b14d9d700 1 --2- 172.21.15.71:0/3280359476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b100c7410 0x7f8b100c8c60 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f8b0000eaf0 tx=0x7f8b0000a330 comp rx=0 tx=0).stop 2023-10-09T06:58:44.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.662+0000 7f8b14d9d700 1 -- 172.21.15.71:0/3280359476 shutdown_connections 2023-10-09T06:58:44.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.662+0000 7f8b14d9d700 1 --2- 172.21.15.71:0/3280359476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b10150550 0x7f8b100ca400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:44.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.662+0000 7f8b14d9d700 1 --2- 172.21.15.71:0/3280359476 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8afc066f30 0x7f8afc0693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:44.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.662+0000 7f8b14d9d700 1 --2- 172.21.15.71:0/3280359476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b100c7410 0x7f8b100c8c60 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:44.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.662+0000 7f8b14d9d700 1 --2- 172.21.15.71:0/3280359476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b10150180 0x7f8b100c33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:44.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.662+0000 7f8b14d9d700 1 -- 172.21.15.71:0/3280359476 >> 172.21.15.71:0/3280359476 conn(0x7f8b100cc1f0 msgr2=0x7f8b10159800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:44.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.662+0000 7f8b14d9d700 1 -- 172.21.15.71:0/3280359476 shutdown_connections 2023-10-09T06:58:44.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.662+0000 7f8b14d9d700 1 -- 172.21.15.71:0/3280359476 wait complete. 2023-10-09T06:58:44.681 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:58:44.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.861+0000 7feadabff700 1 Processor -- start 2023-10-09T06:58:44.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.861+0000 7feadabff700 1 -- start start 2023-10-09T06:58:44.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.862+0000 7feadabff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fead40cbf30 0x7fead40ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:44.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.862+0000 7feadabff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fead40b1420 0x7fead40c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:44.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.862+0000 7feadabff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead40cc300 con 0x7fead40ccf90 2023-10-09T06:58:44.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.862+0000 7feadabff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead4156bf0 con 0x7fead40cbf30 2023-10-09T06:58:44.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.862+0000 7feadabff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead40ae950 con 0x7fead40b1420 2023-10-09T06:58:44.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.862+0000 7fead3fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fead40ccf90 0x7fead40b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:50888/0 (socket says 172.21.15.71:50888) 2023-10-09T06:58:44.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.862+0000 7fead3fff700 1 -- 172.21.15.71:0/336174808 learned_addr learned my addr 172.21.15.71:0/336174808 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:44.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.863+0000 7fead899b700 1 --2- 172.21.15.71:0/336174808 >> v2:172.21.15.179:3300/0 conn(0x7fead40cbf30 0x7fead40ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:44.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.863+0000 7fead919c700 1 --2- 172.21.15.71:0/336174808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fead40b1420 0x7fead40c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:44.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.863+0000 7fead37fe700 1 -- 172.21.15.71:0/336174808 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 774714783 0 0) 0x7fead40cc300 con 0x7fead40ccf90 2023-10-09T06:58:44.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.863+0000 7fead37fe700 1 -- 172.21.15.71:0/336174808 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feac4003570 con 0x7fead40ccf90 2023-10-09T06:58:44.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.863+0000 7fead37fe700 1 -- 172.21.15.71:0/336174808 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 586631525 0 0) 0x7feac4003570 con 0x7fead40ccf90 2023-10-09T06:58:44.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.863+0000 7fead37fe700 1 -- 172.21.15.71:0/336174808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fead40b1420 msgr2=0x7fead40c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:44.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.863+0000 7fead37fe700 1 --2- 172.21.15.71:0/336174808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fead40b1420 0x7fead40c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:44.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.863+0000 7fead37fe700 1 -- 172.21.15.71:0/336174808 >> v2:172.21.15.179:3300/0 conn(0x7fead40cbf30 msgr2=0x7fead40ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:44.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.863+0000 7fead37fe700 1 --2- 172.21.15.71:0/336174808 >> v2:172.21.15.179:3300/0 conn(0x7fead40cbf30 0x7fead40ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:44.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.863+0000 7fead37fe700 1 -- 172.21.15.71:0/336174808 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead40ad370 con 0x7fead40ccf90 2023-10-09T06:58:44.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.863+0000 7fead37fe700 1 -- 172.21.15.71:0/336174808 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7feac0001470 con 0x7fead40ccf90 2023-10-09T06:58:44.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.863+0000 7fead899b700 1 --2- 172.21.15.71:0/336174808 >> v2:172.21.15.179:3300/0 conn(0x7fead40cbf30 0x7fead40ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:58:44.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.863+0000 7fead37fe700 1 -- 172.21.15.71:0/336174808 >> v1:172.21.15.71:6789/0 conn(0x7fead40ccf90 legacy=0x7fead40b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:44.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.863+0000 7fead37fe700 1 --2- 172.21.15.71:0/336174808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac4003b10 0x7feac4003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:44.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.863+0000 7fead37fe700 1 --2- 172.21.15.71:0/336174808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fead40b1420 0x7feac4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:44.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.863+0000 7fead37fe700 1 --2- 172.21.15.71:0/336174808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feac4004d50 0x7feac40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:44.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.863+0000 7fead37fe700 1 -- 172.21.15.71:0/336174808 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead4156bf0 con 0x7feac4004d50 2023-10-09T06:58:44.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.863+0000 7fead37fe700 1 -- 172.21.15.71:0/336174808 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead40ae950 con 0x7feac4003b10 2023-10-09T06:58:44.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.863+0000 7fead37fe700 1 -- 172.21.15.71:0/336174808 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac400bb40 con 0x7fead40b1420 2023-10-09T06:58:44.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.864+0000 7fead899b700 1 --2- 172.21.15.71:0/336174808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac4003b10 0x7feac4003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:44.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.864+0000 7fead919c700 1 --2- 172.21.15.71:0/336174808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feac4004d50 0x7feac40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:44.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.864+0000 7fead3fff700 1 --2- 172.21.15.71:0/336174808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fead40b1420 0x7feac4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:44.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.864+0000 7fead899b700 1 -- 172.21.15.71:0/336174808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fead40b1420 msgr2=0x7feac4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:44.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.864+0000 7fead899b700 1 --2- 172.21.15.71:0/336174808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fead40b1420 0x7feac4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:44.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.864+0000 7fead899b700 1 -- 172.21.15.71:0/336174808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feac4004d50 msgr2=0x7feac40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:44.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.864+0000 7fead899b700 1 --2- 172.21.15.71:0/336174808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feac4004d50 0x7feac40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:44.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.864+0000 7fead899b700 1 -- 172.21.15.71:0/336174808 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac4003570 con 0x7feac4003b10 2023-10-09T06:58:44.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.864+0000 7fead919c700 1 --2- 172.21.15.71:0/336174808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feac4004d50 0x7feac40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:58:44.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.864+0000 7fead899b700 1 --2- 172.21.15.71:0/336174808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac4003b10 0x7feac4003f20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7feac800e3f0 tx=0x7feac800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46cdc199c18cd218 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.865+0000 7fead37fe700 1 -- 172.21.15.71:0/336174808 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac800eca0 con 0x7feac4003b10 2023-10-09T06:58:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.865+0000 7fead37fe700 1 -- 172.21.15.71:0/336174808 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac800f040 con 0x7feac4003b10 2023-10-09T06:58:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.865+0000 7fead37fe700 1 -- 172.21.15.71:0/336174808 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac8014480 con 0x7feac4003b10 2023-10-09T06:58:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.865+0000 7feadabff700 1 -- 172.21.15.71:0/336174808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac4003b10 msgr2=0x7feac4003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.865+0000 7feadabff700 1 --2- 172.21.15.71:0/336174808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac4003b10 0x7feac4003f20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7feac800e3f0 tx=0x7feac800b040 comp rx=0 tx=0).stop 2023-10-09T06:58:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.865+0000 7fead919c700 1 -- 172.21.15.71:0/336174808 reap_dead start 2023-10-09T06:58:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.865+0000 7feadabff700 1 -- 172.21.15.71:0/336174808 shutdown_connections 2023-10-09T06:58:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.865+0000 7feadabff700 1 -- 172.21.15.71:0/336174808 >> 172.21.15.71:0/336174808 conn(0x7fead406a320 msgr2=0x7fead40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.865+0000 7feadabff700 1 -- 172.21.15.71:0/336174808 shutdown_connections 2023-10-09T06:58:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.865+0000 7feadabff700 1 -- 172.21.15.71:0/336174808 wait complete. 2023-10-09T06:58:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.867+0000 7feadabff700 1 Processor -- start 2023-10-09T06:58:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.867+0000 7feadabff700 1 -- start start 2023-10-09T06:58:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.868+0000 7feadabff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac4003b10 0x7fead414ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.868+0000 7feadabff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fead41517b0 0x7fead4146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.868+0000 7feadabff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fead414e4c0 0x7fead40c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.868+0000 7feadabff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead414f700 con 0x7fead414e4c0 2023-10-09T06:58:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.868+0000 7feadabff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead414e070 con 0x7feac4003b10 2023-10-09T06:58:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.868+0000 7feadabff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead414f460 con 0x7fead41517b0 2023-10-09T06:58:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.868+0000 7fead919c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fead414e4c0 0x7fead40c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.868+0000 7fead919c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fead414e4c0 0x7fead40c9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55776/0 (socket says 172.21.15.71:55776) 2023-10-09T06:58:44.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.868+0000 7fead919c700 1 -- 172.21.15.71:0/3294710055 learned_addr learned my addr 172.21.15.71:0/3294710055 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:44.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.868+0000 7fead899b700 1 --2- 172.21.15.71:0/3294710055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac4003b10 0x7fead414ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:44.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.868+0000 7fead919c700 1 -- 172.21.15.71:0/3294710055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fead41517b0 msgr2=0x7fead4146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:44.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.868+0000 7fead919c700 1 --2- 172.21.15.71:0/3294710055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fead41517b0 0x7fead4146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:44.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.868+0000 7fead919c700 1 -- 172.21.15.71:0/3294710055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac4003b10 msgr2=0x7fead414ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:44.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.868+0000 7fead919c700 1 --2- 172.21.15.71:0/3294710055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac4003b10 0x7fead414ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:44.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.869+0000 7fead919c700 1 -- 172.21.15.71:0/3294710055 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead4150c90 con 0x7fead414e4c0 2023-10-09T06:58:44.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.869+0000 7fead919c700 1 --2- 172.21.15.71:0/3294710055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fead414e4c0 0x7fead40c9c60 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7feacc006f00 tx=0x7feacc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:44.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.869+0000 7fead0ff9700 1 -- 172.21.15.71:0/3294710055 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc00fab0 con 0x7fead414e4c0 2023-10-09T06:58:44.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.869+0000 7fead0ff9700 1 -- 172.21.15.71:0/3294710055 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feacc00fc10 con 0x7fead414e4c0 2023-10-09T06:58:44.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.869+0000 7fead0ff9700 1 -- 172.21.15.71:0/3294710055 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc014440 con 0x7fead414e4c0 2023-10-09T06:58:44.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.869+0000 7feadabff700 1 -- 172.21.15.71:0/3294710055 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead4150f70 con 0x7fead414e4c0 2023-10-09T06:58:44.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.869+0000 7feadabff700 1 -- 172.21.15.71:0/3294710055 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead4146860 con 0x7fead414e4c0 2023-10-09T06:58:44.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.870+0000 7feadabff700 1 -- 172.21.15.71:0/3294710055 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead406c1e0 con 0x7fead414e4c0 2023-10-09T06:58:44.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.871+0000 7fead0ff9700 1 -- 172.21.15.71:0/3294710055 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feacc0147b0 con 0x7fead414e4c0 2023-10-09T06:58:44.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.872+0000 7fead0ff9700 1 --2- 172.21.15.71:0/3294710055 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7feab8066f30 0x7feab80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:44.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.872+0000 7fead0ff9700 1 -- 172.21.15.71:0/3294710055 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6097+0+0 (secure 0 0 0) 0x7feacc084f20 con 0x7fead414e4c0 2023-10-09T06:58:44.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.872+0000 7fead899b700 1 --2- 172.21.15.71:0/3294710055 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7feab8066f30 0x7feab80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:44.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.873+0000 7fead899b700 1 --2- 172.21.15.71:0/3294710055 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7feab8066f30 0x7feab80693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feac800e3f0 tx=0x7feac801a000 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:44.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:44.876+0000 7fead0ff9700 1 -- 172.21.15.71:0/3294710055 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feacc051fe0 con 0x7fead414e4c0 2023-10-09T06:58:45.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.069+0000 7feadabff700 1 -- 172.21.15.71:0/3294710055 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fead404c3c0 con 0x7fead414e4c0 2023-10-09T06:58:45.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.070+0000 7fead0ff9700 1 -- 172.21.15.71:0/3294710055 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+15958 (secure 0 0 0) 0x7feacc055600 con 0x7fead414e4c0 2023-10-09T06:58:45.071 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:45.071 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":107,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:58:44.774473+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:58:41.817433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T06:58:42.692884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:58:45.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.073+0000 7feadabff700 1 -- 172.21.15.71:0/3294710055 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7feab8066f30 msgr2=0x7feab80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:45.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.073+0000 7feadabff700 1 --2- 172.21.15.71:0/3294710055 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7feab8066f30 0x7feab80693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feac800e3f0 tx=0x7feac801a000 comp rx=0 tx=0).stop 2023-10-09T06:58:45.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.073+0000 7feadabff700 1 -- 172.21.15.71:0/3294710055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fead414e4c0 msgr2=0x7fead40c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:45.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.073+0000 7feadabff700 1 --2- 172.21.15.71:0/3294710055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fead414e4c0 0x7fead40c9c60 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7feacc006f00 tx=0x7feacc0091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:45.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.073+0000 7feadabff700 1 -- 172.21.15.71:0/3294710055 shutdown_connections 2023-10-09T06:58:45.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.073+0000 7feadabff700 1 --2- 172.21.15.71:0/3294710055 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7feab8066f30 0x7feab80693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:45.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.073+0000 7feadabff700 1 --2- 172.21.15.71:0/3294710055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fead414e4c0 0x7fead40c9c60 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:45.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.073+0000 7feadabff700 1 --2- 172.21.15.71:0/3294710055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac4003b10 0x7fead414ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:45.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.073+0000 7feadabff700 1 --2- 172.21.15.71:0/3294710055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fead41517b0 0x7fead4146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:45.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.073+0000 7feadabff700 1 -- 172.21.15.71:0/3294710055 >> 172.21.15.71:0/3294710055 conn(0x7fead406a320 msgr2=0x7fead40cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:45.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.073+0000 7feadabff700 1 -- 172.21.15.71:0/3294710055 shutdown_connections 2023-10-09T06:58:45.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.073+0000 7feadabff700 1 -- 172.21.15.71:0/3294710055 wait complete. 2023-10-09T06:58:45.091 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T06:58:45.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.274+0000 7fefc35ff700 1 Processor -- start 2023-10-09T06:58:45.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.274+0000 7fefc35ff700 1 -- start start 2023-10-09T06:58:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.275+0000 7fefc35ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fefbc06b160 0x7fefbc06b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.275+0000 7fefc35ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fefbc0637d0 0x7fefbc068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:45.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.275+0000 7fefc35ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fefbc06a2b0 0x7fefbc06a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:45.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.275+0000 7fefc35ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefbc0ac450 con 0x7fefbc0637d0 2023-10-09T06:58:45.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.275+0000 7fefc35ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefbc069d00 con 0x7fefbc06a2b0 2023-10-09T06:58:45.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.275+0000 7fefc35ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc068830 con 0x7fefbc06b160 2023-10-09T06:58:45.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.276+0000 7fefc0b9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fefbc0637d0 0x7fefbc068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:45.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.276+0000 7fefc0b9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fefbc0637d0 0x7fefbc068cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36642/0 (socket says 172.21.15.71:36642) 2023-10-09T06:58:45.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.276+0000 7fefc0b9a700 1 -- 172.21.15.71:0/3527047713 learned_addr learned my addr 172.21.15.71:0/3527047713 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.276+0000 7fefc1b9c700 1 --2- 172.21.15.71:0/3527047713 >> v2:172.21.15.179:3300/0 conn(0x7fefbc06a2b0 0x7fefbc06a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.276+0000 7fefc139b700 1 --2- 172.21.15.71:0/3527047713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fefbc06b160 0x7fefbc06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.276+0000 7fefc0b9a700 1 -- 172.21.15.71:0/3527047713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fefbc06b160 msgr2=0x7fefbc06b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.276+0000 7fefc0b9a700 1 --2- 172.21.15.71:0/3527047713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fefbc06b160 0x7fefbc06b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.276+0000 7fefc0b9a700 1 -- 172.21.15.71:0/3527047713 >> v2:172.21.15.179:3300/0 conn(0x7fefbc06a2b0 msgr2=0x7fefbc06a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.276+0000 7fefc0b9a700 1 --2- 172.21.15.71:0/3527047713 >> v2:172.21.15.179:3300/0 conn(0x7fefbc06a2b0 0x7fefbc06a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.276+0000 7fefc0b9a700 1 -- 172.21.15.71:0/3527047713 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefbc069740 con 0x7fefbc0637d0 2023-10-09T06:58:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.276+0000 7fefc0b9a700 1 --2- 172.21.15.71:0/3527047713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefbc0637d0 0x7fefbc068cc0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fefbc063560 tx=0x7fefac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b70413bbfee3ff server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.276+0000 7fefb3fff700 1 -- 172.21.15.71:0/3527047713 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac00b860 con 0x7fefbc0637d0 2023-10-09T06:58:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.277+0000 7fefb3fff700 1 -- 172.21.15.71:0/3527047713 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefac00b9c0 con 0x7fefbc0637d0 2023-10-09T06:58:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.277+0000 7fefb3fff700 1 -- 172.21.15.71:0/3527047713 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac00bd80 con 0x7fefbc0637d0 2023-10-09T06:58:45.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.277+0000 7fefc35ff700 1 -- 172.21.15.71:0/3527047713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefbc0637d0 msgr2=0x7fefbc068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:45.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.277+0000 7fefc35ff700 1 --2- 172.21.15.71:0/3527047713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefbc0637d0 0x7fefbc068cc0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fefbc063560 tx=0x7fefac009250 comp rx=0 tx=0).stop 2023-10-09T06:58:45.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.277+0000 7fefc35ff700 1 -- 172.21.15.71:0/3527047713 shutdown_connections 2023-10-09T06:58:45.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.277+0000 7fefc35ff700 1 --2- 172.21.15.71:0/3527047713 >> v2:172.21.15.179:3300/0 conn(0x7fefbc06a2b0 0x7fefbc06a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.277+0000 7fefc35ff700 1 --2- 172.21.15.71:0/3527047713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fefbc06b160 0x7fefbc06b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.277+0000 7fefc35ff700 1 --2- 172.21.15.71:0/3527047713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefbc0637d0 0x7fefbc068cc0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.277+0000 7fefc35ff700 1 -- 172.21.15.71:0/3527047713 >> 172.21.15.71:0/3527047713 conn(0x7fefbc06ded0 msgr2=0x7fefbc06e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.277+0000 7fefc35ff700 1 -- 172.21.15.71:0/3527047713 shutdown_connections 2023-10-09T06:58:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.277+0000 7fefc35ff700 1 -- 172.21.15.71:0/3527047713 wait complete. 2023-10-09T06:58:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.279+0000 7fefc35ff700 1 Processor -- start 2023-10-09T06:58:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.279+0000 7fefc35ff700 1 -- start start 2023-10-09T06:58:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.280+0000 7fefc35ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fefbc0637d0 0x7fefbc0c1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.280+0000 7fefc35ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fefbc06a2b0 0x7fefbc169cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.280+0000 7fefc35ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefbc06b160 0x7fefbc158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.280+0000 7fefc35ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc155610 con 0x7fefbc06b160 2023-10-09T06:58:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.280+0000 7fefc35ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc1558f0 con 0x7fefbc0637d0 2023-10-09T06:58:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.280+0000 7fefc35ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc155bd0 con 0x7fefbc06a2b0 2023-10-09T06:58:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.280+0000 7fefc1b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefbc06b160 0x7fefbc158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.280+0000 7fefc1b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefbc06b160 0x7fefbc158de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36646/0 (socket says 172.21.15.71:36646) 2023-10-09T06:58:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.280+0000 7fefc1b9c700 1 -- 172.21.15.71:0/1194427827 learned_addr learned my addr 172.21.15.71:0/1194427827 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.280+0000 7fefc139b700 1 --2- 172.21.15.71:0/1194427827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fefbc0637d0 0x7fefbc0c1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.280+0000 7fefc0b9a700 1 --2- 172.21.15.71:0/1194427827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fefbc06a2b0 0x7fefbc169cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.280+0000 7fefc1b9c700 1 -- 172.21.15.71:0/1194427827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fefbc06a2b0 msgr2=0x7fefbc169cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.280+0000 7fefc1b9c700 1 --2- 172.21.15.71:0/1194427827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fefbc06a2b0 0x7fefbc169cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.280+0000 7fefc1b9c700 1 -- 172.21.15.71:0/1194427827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fefbc0637d0 msgr2=0x7fefbc0c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.280+0000 7fefc1b9c700 1 --2- 172.21.15.71:0/1194427827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fefbc0637d0 0x7fefbc0c1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.280+0000 7fefc1b9c700 1 -- 172.21.15.71:0/1194427827 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac0094f0 con 0x7fefbc06b160 2023-10-09T06:58:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.280+0000 7fefc0b9a700 1 --2- 172.21.15.71:0/1194427827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fefbc06a2b0 0x7fefbc169cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.280+0000 7fefc139b700 1 --2- 172.21.15.71:0/1194427827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fefbc0637d0 0x7fefbc0c1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.281+0000 7fefc1b9c700 1 --2- 172.21.15.71:0/1194427827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefbc06b160 0x7fefbc158de0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fefb4009fa0 tx=0x7fefb4009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.281+0000 7fefb17fa700 1 -- 172.21.15.71:0/1194427827 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb400ed20 con 0x7fefbc06b160 2023-10-09T06:58:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.281+0000 7fefb17fa700 1 -- 172.21.15.71:0/1194427827 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb400ee80 con 0x7fefbc06b160 2023-10-09T06:58:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.281+0000 7fefb17fa700 1 -- 172.21.15.71:0/1194427827 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb4014670 con 0x7fefbc06b160 2023-10-09T06:58:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.281+0000 7fefc35ff700 1 -- 172.21.15.71:0/1194427827 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefbc155eb0 con 0x7fefbc06b160 2023-10-09T06:58:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.281+0000 7fefc35ff700 1 -- 172.21.15.71:0/1194427827 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefbc15a0d0 con 0x7fefbc06b160 2023-10-09T06:58:45.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.282+0000 7fefc35ff700 1 -- 172.21.15.71:0/1194427827 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefbc1563d0 con 0x7fefbc06b160 2023-10-09T06:58:45.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.283+0000 7fefb17fa700 1 -- 172.21.15.71:0/1194427827 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fefb40149e0 con 0x7fefbc06b160 2023-10-09T06:58:45.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.284+0000 7fefb17fa700 1 --2- 172.21.15.71:0/1194427827 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fefa0066f30 0x7fefa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:45.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.284+0000 7fefb17fa700 1 -- 172.21.15.71:0/1194427827 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fefb4084f50 con 0x7fefbc06b160 2023-10-09T06:58:45.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.284+0000 7fefc139b700 1 --2- 172.21.15.71:0/1194427827 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fefa0066f30 0x7fefa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:45.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.285+0000 7fefc139b700 1 --2- 172.21.15.71:0/1194427827 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fefa0066f30 0x7fefa00693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fefb8006fd0 tx=0x7fefb8008040 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:45.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.287+0000 7fefb17fa700 1 -- 172.21.15.71:0/1194427827 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fefbc1563d0 con 0x7fefbc06b160 2023-10-09T06:58:45.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:45.521+0000 7fefc35ff700 1 -- 172.21.15.71:0/1194427827 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fefbc1563d0 con 0x7fefbc06b160 2023-10-09T06:58:46.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.267+0000 7fefb17fa700 1 -- 172.21.15.71:0/1194427827 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v48) v1 ==== 118+0+0 (secure 0 0 0) 0x7fefbc1563d0 con 0x7fefbc06b160 2023-10-09T06:58:46.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.270+0000 7fefc35ff700 1 -- 172.21.15.71:0/1194427827 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fefa0066f30 msgr2=0x7fefa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:46.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.270+0000 7fefc35ff700 1 --2- 172.21.15.71:0/1194427827 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fefa0066f30 0x7fefa00693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fefb8006fd0 tx=0x7fefb8008040 comp rx=0 tx=0).stop 2023-10-09T06:58:46.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.270+0000 7fefc35ff700 1 -- 172.21.15.71:0/1194427827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefbc06b160 msgr2=0x7fefbc158de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:46.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.270+0000 7fefc35ff700 1 --2- 172.21.15.71:0/1194427827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefbc06b160 0x7fefbc158de0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fefb4009fa0 tx=0x7fefb4009900 comp rx=0 tx=0).stop 2023-10-09T06:58:46.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.270+0000 7fefc35ff700 1 -- 172.21.15.71:0/1194427827 shutdown_connections 2023-10-09T06:58:46.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.270+0000 7fefc35ff700 1 --2- 172.21.15.71:0/1194427827 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fefa0066f30 0x7fefa00693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:46.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.270+0000 7fefc35ff700 1 --2- 172.21.15.71:0/1194427827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefbc06b160 0x7fefbc158de0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:46.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.270+0000 7fefc35ff700 1 --2- 172.21.15.71:0/1194427827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fefbc0637d0 0x7fefbc0c1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:46.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.270+0000 7fefc35ff700 1 --2- 172.21.15.71:0/1194427827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fefbc06a2b0 0x7fefbc169cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:46.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.271+0000 7fefc35ff700 1 -- 172.21.15.71:0/1194427827 >> 172.21.15.71:0/1194427827 conn(0x7fefbc06ded0 msgr2=0x7fefbc0addd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:46.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.271+0000 7fefc35ff700 1 -- 172.21.15.71:0/1194427827 shutdown_connections 2023-10-09T06:58:46.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.271+0000 7fefc35ff700 1 -- 172.21.15.71:0/1194427827 wait complete. 2023-10-09T06:58:46.293 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T06:58:46.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.479+0000 7febf39ff700 1 Processor -- start 2023-10-09T06:58:46.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.479+0000 7febf39ff700 1 -- start start 2023-10-09T06:58:46.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.480+0000 7febf39ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febec0ccee0 0x7febec1561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:46.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.480+0000 7febf39ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7febec0c87c0 0x7febec156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:46.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.480+0000 7febf39ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febec15b0d0 con 0x7febec0c83f0 2023-10-09T06:58:46.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.480+0000 7febf39ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febec156c50 con 0x7febec0c87c0 2023-10-09T06:58:46.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.480+0000 7febf39ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec15a4c0 con 0x7febec0ccee0 2023-10-09T06:58:46.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.481+0000 7febf1f9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7febec0c87c0 0x7febec156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:46.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.481+0000 7febf1f9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7febec0c87c0 0x7febec156710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36660/0 (socket says 172.21.15.71:36660) 2023-10-09T06:58:46.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.481+0000 7febf1f9c700 1 -- 172.21.15.71:0/3108505137 learned_addr learned my addr 172.21.15.71:0/3108505137 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:46.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.481+0000 7febf0f9a700 1 --2- 172.21.15.71:0/3108505137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febec0ccee0 0x7febec1561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:46.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.481+0000 7febf1f9c700 1 -- 172.21.15.71:0/3108505137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febec0ccee0 msgr2=0x7febec1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:46.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.481+0000 7febf1f9c700 1 --2- 172.21.15.71:0/3108505137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febec0ccee0 0x7febec1561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:46.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.481+0000 7febf1f9c700 1 -- 172.21.15.71:0/3108505137 >> v1:172.21.15.179:6789/0 conn(0x7febec0c83f0 legacy=0x7febec0c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:46.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.481+0000 7febf1f9c700 1 -- 172.21.15.71:0/3108505137 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec15a7a0 con 0x7febec0c87c0 2023-10-09T06:58:46.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.481+0000 7febf0f9a700 1 --2- 172.21.15.71:0/3108505137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febec0ccee0 0x7febec1561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:46.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.481+0000 7febf1f9c700 1 --2- 172.21.15.71:0/3108505137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febec0c87c0 0x7febec156710 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7febe4009f20 tx=0x7febe4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f61db17458bfca server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:46.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.482+0000 7febe3fff700 1 -- 172.21.15.71:0/3108505137 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe400e070 con 0x7febec0c87c0 2023-10-09T06:58:46.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.482+0000 7febe3fff700 1 -- 172.21.15.71:0/3108505137 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe400ba40 con 0x7febec0c87c0 2023-10-09T06:58:46.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.482+0000 7febe3fff700 1 -- 172.21.15.71:0/3108505137 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe40092e0 con 0x7febec0c87c0 2023-10-09T06:58:46.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.482+0000 7febf39ff700 1 -- 172.21.15.71:0/3108505137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febec0c87c0 msgr2=0x7febec156710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:46.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.482+0000 7febf39ff700 1 --2- 172.21.15.71:0/3108505137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febec0c87c0 0x7febec156710 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7febe4009f20 tx=0x7febe4009840 comp rx=0 tx=0).stop 2023-10-09T06:58:46.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.482+0000 7febf39ff700 1 -- 172.21.15.71:0/3108505137 shutdown_connections 2023-10-09T06:58:46.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.482+0000 7febf39ff700 1 --2- 172.21.15.71:0/3108505137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febec0c87c0 0x7febec156710 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:46.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.482+0000 7febf39ff700 1 --2- 172.21.15.71:0/3108505137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febec0ccee0 0x7febec1561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:46.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.482+0000 7febf39ff700 1 -- 172.21.15.71:0/3108505137 >> 172.21.15.71:0/3108505137 conn(0x7febec068e10 msgr2=0x7febec0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:46.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.482+0000 7febf39ff700 1 -- 172.21.15.71:0/3108505137 shutdown_connections 2023-10-09T06:58:46.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.482+0000 7febf39ff700 1 -- 172.21.15.71:0/3108505137 wait complete. 2023-10-09T06:58:46.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.484+0000 7febf39ff700 1 Processor -- start 2023-10-09T06:58:46.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.484+0000 7febf39ff700 1 -- start start 2023-10-09T06:58:46.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.485+0000 7febf39ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febec0c83f0 0x7febec156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:46.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.485+0000 7febf39ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febec0c87c0 0x7febec1461a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:46.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.485+0000 7febf39ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febec0ccee0 0x7febec159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:46.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.485+0000 7febf39ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec159300 con 0x7febec0c87c0 2023-10-09T06:58:46.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.485+0000 7febf39ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec1466e0 con 0x7febec0ccee0 2023-10-09T06:58:46.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.485+0000 7febf39ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec1586f0 con 0x7febec0c83f0 2023-10-09T06:58:46.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.485+0000 7febf0f9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febec0c87c0 0x7febec1461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:46.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.485+0000 7febf0f9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febec0c87c0 0x7febec1461a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36674/0 (socket says 172.21.15.71:36674) 2023-10-09T06:58:46.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.485+0000 7febf0f9a700 1 -- 172.21.15.71:0/3217179072 learned_addr learned my addr 172.21.15.71:0/3217179072 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:46.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.485+0000 7febf1f9c700 1 --2- 172.21.15.71:0/3217179072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febec0ccee0 0x7febec159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:46.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.485+0000 7febf179b700 1 --2- 172.21.15.71:0/3217179072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febec0c83f0 0x7febec156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:46.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.486+0000 7febf0f9a700 1 -- 172.21.15.71:0/3217179072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febec0c83f0 msgr2=0x7febec156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:46.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.486+0000 7febf0f9a700 1 --2- 172.21.15.71:0/3217179072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febec0c83f0 0x7febec156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:46.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.486+0000 7febf0f9a700 1 -- 172.21.15.71:0/3217179072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febec0ccee0 msgr2=0x7febec159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:46.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.486+0000 7febf0f9a700 1 --2- 172.21.15.71:0/3217179072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febec0ccee0 0x7febec159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:46.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.486+0000 7febf0f9a700 1 -- 172.21.15.71:0/3217179072 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe4009ae0 con 0x7febec0c87c0 2023-10-09T06:58:46.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.486+0000 7febf0f9a700 1 --2- 172.21.15.71:0/3217179072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febec0c87c0 0x7febec1461a0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7febdc00c850 tx=0x7febdc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:46.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.486+0000 7febe17fa700 1 -- 172.21.15.71:0/3217179072 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc011600 con 0x7febec0c87c0 2023-10-09T06:58:46.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.486+0000 7febe17fa700 1 -- 172.21.15.71:0/3217179072 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febdc011780 con 0x7febec0c87c0 2023-10-09T06:58:46.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.486+0000 7febf39ff700 1 -- 172.21.15.71:0/3217179072 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febec1589d0 con 0x7febec0c87c0 2023-10-09T06:58:46.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.486+0000 7febe17fa700 1 -- 172.21.15.71:0/3217179072 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc011b40 con 0x7febec0c87c0 2023-10-09T06:58:46.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.486+0000 7febf39ff700 1 -- 172.21.15.71:0/3217179072 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febec158f90 con 0x7febec0c87c0 2023-10-09T06:58:46.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.487+0000 7febf39ff700 1 -- 172.21.15.71:0/3217179072 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febec04c3c0 con 0x7febec0c87c0 2023-10-09T06:58:46.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.488+0000 7febe17fa700 1 -- 172.21.15.71:0/3217179072 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7febdc0073b0 con 0x7febec0c87c0 2023-10-09T06:58:46.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.489+0000 7febe17fa700 1 --2- 172.21.15.71:0/3217179072 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7febd0066f30 0x7febd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:46.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.489+0000 7febe17fa700 1 -- 172.21.15.71:0/3217179072 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6097+0+0 (secure 0 0 0) 0x7febdc084640 con 0x7febec0c87c0 2023-10-09T06:58:46.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.489+0000 7febf179b700 1 --2- 172.21.15.71:0/3217179072 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7febd0066f30 0x7febd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:46.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.490+0000 7febf179b700 1 --2- 172.21.15.71:0/3217179072 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7febd0066f30 0x7febd00693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7febe8003870 tx=0x7febe8009040 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:46.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.493+0000 7febe17fa700 1 -- 172.21.15.71:0/3217179072 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febdc051680 con 0x7febec0c87c0 2023-10-09T06:58:46.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:46.724+0000 7febf39ff700 1 -- 172.21.15.71:0/3217179072 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7febec15aa80 con 0x7febec0c87c0 2023-10-09T06:58:47.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.274+0000 7febe17fa700 1 -- 172.21.15.71:0/3217179072 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v49) v1 ==== 122+0+0 (secure 0 0 0) 0x7febdc054ca0 con 0x7febec0c87c0 2023-10-09T06:58:47.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.277+0000 7febf39ff700 1 -- 172.21.15.71:0/3217179072 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7febd0066f30 msgr2=0x7febd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:47.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.277+0000 7febf39ff700 1 --2- 172.21.15.71:0/3217179072 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7febd0066f30 0x7febd00693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7febe8003870 tx=0x7febe8009040 comp rx=0 tx=0).stop 2023-10-09T06:58:47.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.277+0000 7febf39ff700 1 -- 172.21.15.71:0/3217179072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febec0c87c0 msgr2=0x7febec1461a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:47.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.277+0000 7febf39ff700 1 --2- 172.21.15.71:0/3217179072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febec0c87c0 0x7febec1461a0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7febdc00c850 tx=0x7febdc008040 comp rx=0 tx=0).stop 2023-10-09T06:58:47.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.277+0000 7febf39ff700 1 -- 172.21.15.71:0/3217179072 shutdown_connections 2023-10-09T06:58:47.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.277+0000 7febf39ff700 1 --2- 172.21.15.71:0/3217179072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febec0ccee0 0x7febec159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:47.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.277+0000 7febf39ff700 1 --2- 172.21.15.71:0/3217179072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febec0c83f0 0x7febec156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:47.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.277+0000 7febf39ff700 1 --2- 172.21.15.71:0/3217179072 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7febd0066f30 0x7febd00693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:47.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.278+0000 7febf39ff700 1 --2- 172.21.15.71:0/3217179072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febec0c87c0 0x7febec1461a0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:47.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.278+0000 7febf39ff700 1 -- 172.21.15.71:0/3217179072 >> 172.21.15.71:0/3217179072 conn(0x7febec068e10 msgr2=0x7febec06eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:47.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.278+0000 7febf39ff700 1 -- 172.21.15.71:0/3217179072 shutdown_connections 2023-10-09T06:58:47.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.278+0000 7febf39ff700 1 -- 172.21.15.71:0/3217179072 wait complete. 2023-10-09T06:58:47.299 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:58:47.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.483+0000 7f58101ff700 1 Processor -- start 2023-10-09T06:58:47.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.483+0000 7f58101ff700 1 -- start start 2023-10-09T06:58:47.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.484+0000 7f58101ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5808155c10 0x7f5808155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:47.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.485+0000 7f58101ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f58080ac230 0x7f58080ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:47.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.485+0000 7f58101ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58081568a0 0x7f5808156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:47.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.485+0000 7f58101ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58080ad930 con 0x7f5808155c10 2023-10-09T06:58:47.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.485+0000 7f58101ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58080acd20 con 0x7f58080ac230 2023-10-09T06:58:47.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.485+0000 7f58101ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58080ad000 con 0x7f58081568a0 2023-10-09T06:58:47.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.485+0000 7f580df9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5808155c10 0x7f5808155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:47.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.485+0000 7f580df9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5808155c10 0x7f5808155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36678/0 (socket says 172.21.15.71:36678) 2023-10-09T06:58:47.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.485+0000 7f580df9b700 1 -- 172.21.15.71:0/1569165190 learned_addr learned my addr 172.21.15.71:0/1569165190 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:47.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.485+0000 7f580d79a700 1 --2- 172.21.15.71:0/1569165190 >> v2:172.21.15.179:3300/0 conn(0x7f58080ac230 0x7f58080ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:47.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.485+0000 7f580e79c700 1 --2- 172.21.15.71:0/1569165190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58081568a0 0x7f5808156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:47.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.485+0000 7f580df9b700 1 -- 172.21.15.71:0/1569165190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58081568a0 msgr2=0x7f5808156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:47.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.485+0000 7f580df9b700 1 --2- 172.21.15.71:0/1569165190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58081568a0 0x7f5808156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:47.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.485+0000 7f580df9b700 1 -- 172.21.15.71:0/1569165190 >> v2:172.21.15.179:3300/0 conn(0x7f58080ac230 msgr2=0x7f58080ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:47.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.485+0000 7f580df9b700 1 --2- 172.21.15.71:0/1569165190 >> v2:172.21.15.179:3300/0 conn(0x7f58080ac230 0x7f58080ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:47.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.485+0000 7f580df9b700 1 -- 172.21.15.71:0/1569165190 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58080ad2e0 con 0x7f5808155c10 2023-10-09T06:58:47.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.485+0000 7f580d79a700 1 --2- 172.21.15.71:0/1569165190 >> v2:172.21.15.179:3300/0 conn(0x7f58080ac230 0x7f58080ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:47.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.486+0000 7f580df9b700 1 --2- 172.21.15.71:0/1569165190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5808155c10 0x7f5808155fe0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f5808065bb0 tx=0x7f5804009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc1b3f47914e4d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:47.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.486+0000 7f580cf99700 1 -- 172.21.15.71:0/1569165190 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580400b860 con 0x7f5808155c10 2023-10-09T06:58:47.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.486+0000 7f580cf99700 1 -- 172.21.15.71:0/1569165190 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580400b9c0 con 0x7f5808155c10 2023-10-09T06:58:47.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.486+0000 7f580cf99700 1 -- 172.21.15.71:0/1569165190 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580400bd60 con 0x7f5808155c10 2023-10-09T06:58:47.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.486+0000 7f58101ff700 1 -- 172.21.15.71:0/1569165190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5808155c10 msgr2=0x7f5808155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:47.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.486+0000 7f58101ff700 1 --2- 172.21.15.71:0/1569165190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5808155c10 0x7f5808155fe0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f5808065bb0 tx=0x7f5804009250 comp rx=0 tx=0).stop 2023-10-09T06:58:47.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.486+0000 7f58101ff700 1 -- 172.21.15.71:0/1569165190 shutdown_connections 2023-10-09T06:58:47.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.486+0000 7f58101ff700 1 --2- 172.21.15.71:0/1569165190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58081568a0 0x7f5808156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:47.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.486+0000 7f58101ff700 1 --2- 172.21.15.71:0/1569165190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5808155c10 0x7f5808155fe0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:47.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.486+0000 7f58101ff700 1 --2- 172.21.15.71:0/1569165190 >> v2:172.21.15.179:3300/0 conn(0x7f58080ac230 0x7f58080ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:47.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.486+0000 7f58101ff700 1 -- 172.21.15.71:0/1569165190 >> 172.21.15.71:0/1569165190 conn(0x7f580806a320 msgr2=0x7f58080cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:47.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.486+0000 7f58101ff700 1 -- 172.21.15.71:0/1569165190 shutdown_connections 2023-10-09T06:58:47.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.487+0000 7f58101ff700 1 -- 172.21.15.71:0/1569165190 wait complete. 2023-10-09T06:58:47.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.488+0000 7f58101ff700 1 Processor -- start 2023-10-09T06:58:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.488+0000 7f58101ff700 1 -- start start 2023-10-09T06:58:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.489+0000 7f58101ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58080ac230 0x7f58081410a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.489+0000 7f58101ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5808155c10 0x7f5808157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.489+0000 7f58101ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58081568a0 0x7f580815e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.489+0000 7f58101ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5808169890 con 0x7f5808155c10 2023-10-09T06:58:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.489+0000 7f58101ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580816a6e0 con 0x7f58080ac230 2023-10-09T06:58:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.489+0000 7f58101ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5808169ad0 con 0x7f58081568a0 2023-10-09T06:58:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.489+0000 7f580d79a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5808155c10 0x7f5808157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.489+0000 7f580d79a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5808155c10 0x7f5808157ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36690/0 (socket says 172.21.15.71:36690) 2023-10-09T06:58:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.489+0000 7f580d79a700 1 -- 172.21.15.71:0/1455872113 learned_addr learned my addr 172.21.15.71:0/1455872113 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.489+0000 7f580df9b700 1 --2- 172.21.15.71:0/1455872113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58080ac230 0x7f58081410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.489+0000 7f580e79c700 1 --2- 172.21.15.71:0/1455872113 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58081568a0 0x7f580815e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.490+0000 7f580d79a700 1 -- 172.21.15.71:0/1455872113 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58081568a0 msgr2=0x7f580815e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.490+0000 7f580d79a700 1 --2- 172.21.15.71:0/1455872113 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58081568a0 0x7f580815e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.490+0000 7f580d79a700 1 -- 172.21.15.71:0/1455872113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58080ac230 msgr2=0x7f58081410a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.490+0000 7f580d79a700 1 --2- 172.21.15.71:0/1455872113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58080ac230 0x7f58081410a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.490+0000 7f580d79a700 1 -- 172.21.15.71:0/1455872113 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58040094f0 con 0x7f5808155c10 2023-10-09T06:58:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.490+0000 7f580d79a700 1 --2- 172.21.15.71:0/1455872113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5808155c10 0x7f5808157ce0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f57f800e900 tx=0x7f57f8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.490+0000 7f57fdffb700 1 -- 172.21.15.71:0/1455872113 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f8013410 con 0x7f5808155c10 2023-10-09T06:58:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.490+0000 7f57fdffb700 1 -- 172.21.15.71:0/1455872113 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f8013570 con 0x7f5808155c10 2023-10-09T06:58:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.490+0000 7f58101ff700 1 -- 172.21.15.71:0/1455872113 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5808169db0 con 0x7f5808155c10 2023-10-09T06:58:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.490+0000 7f57fdffb700 1 -- 172.21.15.71:0/1455872113 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f8013910 con 0x7f5808155c10 2023-10-09T06:58:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.490+0000 7f58101ff700 1 -- 172.21.15.71:0/1455872113 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f580816a370 con 0x7f5808155c10 2023-10-09T06:58:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.491+0000 7f58101ff700 1 -- 172.21.15.71:0/1455872113 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f580804c3c0 con 0x7f5808155c10 2023-10-09T06:58:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.492+0000 7f57fdffb700 1 -- 172.21.15.71:0/1455872113 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f57f8013cc0 con 0x7f5808155c10 2023-10-09T06:58:47.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.493+0000 7f57fdffb700 1 --2- 172.21.15.71:0/1455872113 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f57ec066f30 0x7f57ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:47.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.493+0000 7f57fdffb700 1 -- 172.21.15.71:0/1455872113 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f57f8084380 con 0x7f5808155c10 2023-10-09T06:58:47.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.494+0000 7f580df9b700 1 --2- 172.21.15.71:0/1455872113 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f57ec066f30 0x7f57ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:47.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.494+0000 7f580df9b700 1 --2- 172.21.15.71:0/1455872113 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f57ec066f30 0x7f57ec0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5808065bb0 tx=0x7f5804017000 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:47.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.497+0000 7f57fdffb700 1 -- 172.21.15.71:0/1455872113 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57f8054ef0 con 0x7f5808155c10 2023-10-09T06:58:47.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.728+0000 7f58101ff700 1 -- 172.21.15.71:0/1455872113 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f580816a820 con 0x7f5808155c10 2023-10-09T06:58:47.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.729+0000 7f57fdffb700 1 -- 172.21.15.71:0/1455872113 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f57f8054a80 con 0x7f5808155c10 2023-10-09T06:58:47.730 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:47.730 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/2945926197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2945926197},{"type":"v1","addr":"172.21.15.71:6834","nonce":2945926197}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1112255645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1112255645},{"type":"v1","addr":"172.21.15.179:6836","nonce":1112255645}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3298180688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":3298180688},{"type":"v1","addr":"172.21.15.71:6835","nonce":3298180688}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:58:43.707312+0000","modified":"2023-10-09T06:58:47.272802+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7152},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7152":{"gid":7152,"name":"d","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/4053543999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":4053543999},{"type":"v1","addr":"172.21.15.179:6837","nonce":4053543999}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T06:58:47.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.731+0000 7f58101ff700 1 -- 172.21.15.71:0/1455872113 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f57ec066f30 msgr2=0x7f57ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:47.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.731+0000 7f58101ff700 1 --2- 172.21.15.71:0/1455872113 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f57ec066f30 0x7f57ec0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5808065bb0 tx=0x7f5804017000 comp rx=0 tx=0).stop 2023-10-09T06:58:47.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.731+0000 7f58101ff700 1 -- 172.21.15.71:0/1455872113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5808155c10 msgr2=0x7f5808157ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:47.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.731+0000 7f58101ff700 1 --2- 172.21.15.71:0/1455872113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5808155c10 0x7f5808157ce0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f57f800e900 tx=0x7f57f8008040 comp rx=0 tx=0).stop 2023-10-09T06:58:47.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.731+0000 7f58101ff700 1 -- 172.21.15.71:0/1455872113 shutdown_connections 2023-10-09T06:58:47.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.731+0000 7f58101ff700 1 --2- 172.21.15.71:0/1455872113 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58081568a0 0x7f580815e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:47.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.731+0000 7f58101ff700 1 --2- 172.21.15.71:0/1455872113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58080ac230 0x7f58081410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:47.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.731+0000 7f58101ff700 1 --2- 172.21.15.71:0/1455872113 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f57ec066f30 0x7f57ec0693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:47.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.731+0000 7f58101ff700 1 --2- 172.21.15.71:0/1455872113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5808155c10 0x7f5808157ce0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:47.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.731+0000 7f58101ff700 1 -- 172.21.15.71:0/1455872113 >> 172.21.15.71:0/1455872113 conn(0x7f580806a320 msgr2=0x7f5808154920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:47.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.732+0000 7f58101ff700 1 -- 172.21.15.71:0/1455872113 shutdown_connections 2023-10-09T06:58:47.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.732+0000 7f58101ff700 1 -- 172.21.15.71:0/1455872113 wait complete. 2023-10-09T06:58:47.734 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 49 2023-10-09T06:58:47.750 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T06:58:47.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.928+0000 7fda9e3ff700 1 Processor -- start 2023-10-09T06:58:47.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.928+0000 7fda9e3ff700 1 -- start start 2023-10-09T06:58:47.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.930+0000 7fda9e3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fda980b1420 0x7fda980ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:47.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.930+0000 7fda9e3ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda980cc300 con 0x7fda980ccf90 2023-10-09T06:58:47.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.930+0000 7fda9e3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda980ad370 con 0x7fda980cbf30 2023-10-09T06:58:47.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.930+0000 7fda9e3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda98156bf0 con 0x7fda980b1420 2023-10-09T06:58:47.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.930+0000 7fda9c99c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fda980ccf90 0x7fda980c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56896/0 (socket says 172.21.15.71:56896) 2023-10-09T06:58:47.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.930+0000 7fda9c99c700 1 -- 172.21.15.71:0/2009436136 learned_addr learned my addr 172.21.15.71:0/2009436136 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:47.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.930+0000 7fda8ffff700 1 --2- 172.21.15.71:0/2009436136 >> v2:172.21.15.179:3300/0 conn(0x7fda980b1420 0x7fda980ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:47.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.931+0000 7fda977fe700 1 -- 172.21.15.71:0/2009436136 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3348723557 0 0) 0x7fda980cc300 con 0x7fda980ccf90 2023-10-09T06:58:47.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.931+0000 7fda977fe700 1 -- 172.21.15.71:0/2009436136 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda84003570 con 0x7fda980ccf90 2023-10-09T06:58:47.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.931+0000 7fda8ffff700 1 -- 172.21.15.71:0/2009436136 >> v1:172.21.15.179:6789/0 conn(0x7fda980cbf30 legacy=0x7fda980b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:47.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.931+0000 7fda8ffff700 1 -- 172.21.15.71:0/2009436136 >> v1:172.21.15.71:6789/0 conn(0x7fda980ccf90 legacy=0x7fda980c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:47.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.931+0000 7fda8ffff700 1 -- 172.21.15.71:0/2009436136 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda980ad650 con 0x7fda980b1420 2023-10-09T06:58:47.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.931+0000 7fda8ffff700 1 --2- 172.21.15.71:0/2009436136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda980b1420 0x7fda980ae410 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fda800098e0 tx=0x7fda800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e1f8f555b7a9cf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:47.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.931+0000 7fda977fe700 1 -- 172.21.15.71:0/2009436136 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8000b640 con 0x7fda980b1420 2023-10-09T06:58:47.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.931+0000 7fda977fe700 1 -- 172.21.15.71:0/2009436136 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8000b7a0 con 0x7fda980b1420 2023-10-09T06:58:47.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.932+0000 7fda977fe700 1 -- 172.21.15.71:0/2009436136 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8000bb20 con 0x7fda980b1420 2023-10-09T06:58:47.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.932+0000 7fda9e3ff700 1 -- 172.21.15.71:0/2009436136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda980b1420 msgr2=0x7fda980ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:47.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.932+0000 7fda9e3ff700 1 --2- 172.21.15.71:0/2009436136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda980b1420 0x7fda980ae410 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fda800098e0 tx=0x7fda800091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:47.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.932+0000 7fda9e3ff700 1 -- 172.21.15.71:0/2009436136 shutdown_connections 2023-10-09T06:58:47.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.932+0000 7fda9e3ff700 1 --2- 172.21.15.71:0/2009436136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda980b1420 0x7fda980ae410 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:47.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.932+0000 7fda9e3ff700 1 -- 172.21.15.71:0/2009436136 >> 172.21.15.71:0/2009436136 conn(0x7fda9806a320 msgr2=0x7fda980cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:47.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.932+0000 7fda9e3ff700 1 -- 172.21.15.71:0/2009436136 shutdown_connections 2023-10-09T06:58:47.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.932+0000 7fda9e3ff700 1 -- 172.21.15.71:0/2009436136 wait complete. 2023-10-09T06:58:47.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.933+0000 7fda9e3ff700 1 Processor -- start 2023-10-09T06:58:47.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.934+0000 7fda9e3ff700 1 -- start start 2023-10-09T06:58:47.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.934+0000 7fda9e3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda980b1420 0x7fda980c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:47.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.934+0000 7fda9e3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda980cbf30 0x7fda980c1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:47.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.934+0000 7fda9e3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda980ccf90 0x7fda980c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:47.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.934+0000 7fda9e3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda980aa110 con 0x7fda980ccf90 2023-10-09T06:58:47.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.934+0000 7fda9e3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda980a9500 con 0x7fda980cbf30 2023-10-09T06:58:47.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.934+0000 7fda9e3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda980a97e0 con 0x7fda980b1420 2023-10-09T06:58:47.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.935+0000 7fda9c99c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda980ccf90 0x7fda980c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:47.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.935+0000 7fda9c99c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda980ccf90 0x7fda980c21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36696/0 (socket says 172.21.15.71:36696) 2023-10-09T06:58:47.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.935+0000 7fda9c99c700 1 -- 172.21.15.71:0/1371260177 learned_addr learned my addr 172.21.15.71:0/1371260177 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:47.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.935+0000 7fda8ffff700 1 --2- 172.21.15.71:0/1371260177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda980cbf30 0x7fda980c1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:47.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.935+0000 7fda97fff700 1 --2- 172.21.15.71:0/1371260177 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda980b1420 0x7fda980c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:47.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.935+0000 7fda9c99c700 1 -- 172.21.15.71:0/1371260177 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda980b1420 msgr2=0x7fda980c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:47.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.935+0000 7fda9c99c700 1 --2- 172.21.15.71:0/1371260177 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda980b1420 0x7fda980c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:47.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.935+0000 7fda9c99c700 1 -- 172.21.15.71:0/1371260177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda980cbf30 msgr2=0x7fda980c1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:47.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.935+0000 7fda9c99c700 1 --2- 172.21.15.71:0/1371260177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda980cbf30 0x7fda980c1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:47.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.935+0000 7fda9c99c700 1 -- 172.21.15.71:0/1371260177 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda80009420 con 0x7fda980ccf90 2023-10-09T06:58:47.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.935+0000 7fda97fff700 1 --2- 172.21.15.71:0/1371260177 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda980b1420 0x7fda980c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:47.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.935+0000 7fda9c99c700 1 --2- 172.21.15.71:0/1371260177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda980ccf90 0x7fda980c21e0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fda90001460 tx=0x7fda90001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:47.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.936+0000 7fda94ff9700 1 -- 172.21.15.71:0/1371260177 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9000a8a0 con 0x7fda980ccf90 2023-10-09T06:58:47.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.936+0000 7fda94ff9700 1 -- 172.21.15.71:0/1371260177 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9000aa00 con 0x7fda980ccf90 2023-10-09T06:58:47.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.936+0000 7fda9e3ff700 1 -- 172.21.15.71:0/1371260177 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda980a9ac0 con 0x7fda980ccf90 2023-10-09T06:58:47.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.936+0000 7fda94ff9700 1 -- 172.21.15.71:0/1371260177 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9000ad80 con 0x7fda980ccf90 2023-10-09T06:58:47.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.936+0000 7fda9e3ff700 1 -- 172.21.15.71:0/1371260177 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda980c8790 con 0x7fda980ccf90 2023-10-09T06:58:47.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.937+0000 7fda9e3ff700 1 -- 172.21.15.71:0/1371260177 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9804c3c0 con 0x7fda980ccf90 2023-10-09T06:58:47.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.938+0000 7fda94ff9700 1 -- 172.21.15.71:0/1371260177 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda90007300 con 0x7fda980ccf90 2023-10-09T06:58:47.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.939+0000 7fda94ff9700 1 --2- 172.21.15.71:0/1371260177 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fda78066f30 0x7fda780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:47.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.939+0000 7fda94ff9700 1 -- 172.21.15.71:0/1371260177 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fda90084b30 con 0x7fda980ccf90 2023-10-09T06:58:47.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.939+0000 7fda97fff700 1 --2- 172.21.15.71:0/1371260177 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fda78066f30 0x7fda780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:47.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.940+0000 7fda97fff700 1 --2- 172.21.15.71:0/1371260177 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fda78066f30 0x7fda780693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fda88007fd0 tx=0x7fda88009040 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:47.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:47.942+0000 7fda94ff9700 1 -- 172.21.15.71:0/1371260177 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda90051b60 con 0x7fda980ccf90 2023-10-09T06:58:48.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.139+0000 7fda9e3ff700 1 -- 172.21.15.71:0/1371260177 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda9806e1c0 con 0x7fda980ccf90 2023-10-09T06:58:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.140+0000 7fda94ff9700 1 -- 172.21.15.71:0/1371260177 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+15958 (secure 0 0 0) 0x7fda90055180 con 0x7fda980ccf90 2023-10-09T06:58:48.143 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:48.143 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":107,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T06:58:44.774473+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:58:41.817433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T06:58:42.692884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T06:58:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.142+0000 7fda9e3ff700 1 -- 172.21.15.71:0/1371260177 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fda78066f30 msgr2=0x7fda780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.142+0000 7fda9e3ff700 1 --2- 172.21.15.71:0/1371260177 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fda78066f30 0x7fda780693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fda88007fd0 tx=0x7fda88009040 comp rx=0 tx=0).stop 2023-10-09T06:58:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.142+0000 7fda9e3ff700 1 -- 172.21.15.71:0/1371260177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda980ccf90 msgr2=0x7fda980c21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.142+0000 7fda9e3ff700 1 --2- 172.21.15.71:0/1371260177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda980ccf90 0x7fda980c21e0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fda90001460 tx=0x7fda90001a40 comp rx=0 tx=0).stop 2023-10-09T06:58:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.142+0000 7fda9e3ff700 1 -- 172.21.15.71:0/1371260177 shutdown_connections 2023-10-09T06:58:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.142+0000 7fda9e3ff700 1 --2- 172.21.15.71:0/1371260177 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fda78066f30 0x7fda780693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.142+0000 7fda9e3ff700 1 --2- 172.21.15.71:0/1371260177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda980ccf90 0x7fda980c21e0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.142+0000 7fda9e3ff700 1 --2- 172.21.15.71:0/1371260177 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda980b1420 0x7fda980c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.142+0000 7fda9e3ff700 1 --2- 172.21.15.71:0/1371260177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda980cbf30 0x7fda980c1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.142+0000 7fda9e3ff700 1 -- 172.21.15.71:0/1371260177 >> 172.21.15.71:0/1371260177 conn(0x7fda9806a320 msgr2=0x7fda980afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.142+0000 7fda9e3ff700 1 -- 172.21.15.71:0/1371260177 shutdown_connections 2023-10-09T06:58:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.143+0000 7fda9e3ff700 1 -- 172.21.15.71:0/1371260177 wait complete. 2023-10-09T06:58:48.161 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T06:58:48.161 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:58:48.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.342+0000 7f879ebff700 1 Processor -- start 2023-10-09T06:58:48.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.342+0000 7f879ebff700 1 -- start start 2023-10-09T06:58:48.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.344+0000 7f879ebff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f87981578b0 0x7f8798155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:48.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.344+0000 7f879ebff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87980ad930 con 0x7f8798155c10 2023-10-09T06:58:48.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.344+0000 7f879ebff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87980acd20 con 0x7f87980af2f0 2023-10-09T06:58:48.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.344+0000 7f879ebff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87980ad000 con 0x7f87981578b0 2023-10-09T06:58:48.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.344+0000 7f8797fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f87981578b0 0x7f8798155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:48.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.344+0000 7f879c99b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8798155c10 0x7f87980ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56900/0 (socket says 172.21.15.71:56900) 2023-10-09T06:58:48.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.344+0000 7f8797fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f87981578b0 0x7f8798155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36704/0 (socket says 172.21.15.71:36704) 2023-10-09T06:58:48.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.344+0000 7f879c99b700 1 -- 172.21.15.71:0/3191876704 learned_addr learned my addr 172.21.15.71:0/3191876704 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:48.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.344+0000 7f8797fff700 1 -- 172.21.15.71:0/3191876704 >> v1:172.21.15.179:6789/0 conn(0x7f87980af2f0 legacy=0x7f87980af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:48.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.344+0000 7f8797fff700 1 -- 172.21.15.71:0/3191876704 >> v1:172.21.15.71:6789/0 conn(0x7f8798155c10 legacy=0x7f87980ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:48.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.344+0000 7f8797fff700 1 -- 172.21.15.71:0/3191876704 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87980ad2e0 con 0x7f87981578b0 2023-10-09T06:58:48.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.344+0000 7f87977fe700 1 -- 172.21.15.71:0/3191876704 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942109870 0 0) 0x7f87980ad930 con 0x7f8798155c10 2023-10-09T06:58:48.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.345+0000 7f8797fff700 1 --2- 172.21.15.71:0/3191876704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87981578b0 0x7f8798155fe0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f878400bb90 tx=0x7f878400b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72da7e6d0218d74 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:48.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.345+0000 7f87977fe700 1 -- 172.21.15.71:0/3191876704 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878400db60 con 0x7f87981578b0 2023-10-09T06:58:48.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.345+0000 7f87977fe700 1 -- 172.21.15.71:0/3191876704 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878400dcc0 con 0x7f87981578b0 2023-10-09T06:58:48.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.345+0000 7f87977fe700 1 -- 172.21.15.71:0/3191876704 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87840106a0 con 0x7f87981578b0 2023-10-09T06:58:48.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.345+0000 7f879ebff700 1 -- 172.21.15.71:0/3191876704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87981578b0 msgr2=0x7f8798155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:48.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.345+0000 7f879ebff700 1 --2- 172.21.15.71:0/3191876704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87981578b0 0x7f8798155fe0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f878400bb90 tx=0x7f878400b430 comp rx=0 tx=0).stop 2023-10-09T06:58:48.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.345+0000 7f879ebff700 1 -- 172.21.15.71:0/3191876704 shutdown_connections 2023-10-09T06:58:48.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.345+0000 7f879ebff700 1 --2- 172.21.15.71:0/3191876704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87981578b0 0x7f8798155fe0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:48.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.346+0000 7f879ebff700 1 -- 172.21.15.71:0/3191876704 >> 172.21.15.71:0/3191876704 conn(0x7f879806a320 msgr2=0x7f87980cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:48.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.346+0000 7f879ebff700 1 -- 172.21.15.71:0/3191876704 shutdown_connections 2023-10-09T06:58:48.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.346+0000 7f879ebff700 1 -- 172.21.15.71:0/3191876704 wait complete. 2023-10-09T06:58:48.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.347+0000 7f879ebff700 1 Processor -- start 2023-10-09T06:58:48.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.347+0000 7f879ebff700 1 -- start start 2023-10-09T06:58:48.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.348+0000 7f879ebff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87980af2f0 0x7f879814b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:48.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.348+0000 7f879ebff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8798155c10 0x7f879815a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:48.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.348+0000 7f879ebff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87981578b0 0x7f879814d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:48.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.348+0000 7f879ebff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87981585a0 con 0x7f87980af2f0 2023-10-09T06:58:48.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.348+0000 7f879ebff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87981582a0 con 0x7f8798155c10 2023-10-09T06:58:48.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.348+0000 7f879ebff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879814db20 con 0x7f87981578b0 2023-10-09T06:58:48.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.348+0000 7f879c99b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87980af2f0 0x7f879814b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:48.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.348+0000 7f879c99b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87980af2f0 0x7f879814b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36708/0 (socket says 172.21.15.71:36708) 2023-10-09T06:58:48.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.348+0000 7f879c99b700 1 -- 172.21.15.71:0/1716073028 learned_addr learned my addr 172.21.15.71:0/1716073028 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:48.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.349+0000 7f8797fff700 1 --2- 172.21.15.71:0/1716073028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8798155c10 0x7f879815a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:48.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.349+0000 7f879d19c700 1 --2- 172.21.15.71:0/1716073028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87981578b0 0x7f879814d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:48.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.349+0000 7f879c99b700 1 -- 172.21.15.71:0/1716073028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87981578b0 msgr2=0x7f879814d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:48.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.349+0000 7f879c99b700 1 --2- 172.21.15.71:0/1716073028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87981578b0 0x7f879814d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:48.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.349+0000 7f879c99b700 1 -- 172.21.15.71:0/1716073028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8798155c10 msgr2=0x7f879815a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:48.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.349+0000 7f879c99b700 1 --2- 172.21.15.71:0/1716073028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8798155c10 0x7f879815a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:48.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.349+0000 7f879c99b700 1 -- 172.21.15.71:0/1716073028 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878400b6d0 con 0x7f87980af2f0 2023-10-09T06:58:48.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.349+0000 7f879d19c700 1 --2- 172.21.15.71:0/1716073028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87981578b0 0x7f879814d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:48.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.349+0000 7f879c99b700 1 --2- 172.21.15.71:0/1716073028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87980af2f0 0x7f879814b1d0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f878c00c810 tx=0x7f878c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:48.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.349+0000 7f8794ff9700 1 -- 172.21.15.71:0/1716073028 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c005b30 con 0x7f87980af2f0 2023-10-09T06:58:48.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.349+0000 7f8794ff9700 1 -- 172.21.15.71:0/1716073028 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878c005c90 con 0x7f87980af2f0 2023-10-09T06:58:48.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.349+0000 7f879ebff700 1 -- 172.21.15.71:0/1716073028 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f879814ddb0 con 0x7f87980af2f0 2023-10-09T06:58:48.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.349+0000 7f8794ff9700 1 -- 172.21.15.71:0/1716073028 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c007300 con 0x7f87980af2f0 2023-10-09T06:58:48.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.349+0000 7f879ebff700 1 -- 172.21.15.71:0/1716073028 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879814e370 con 0x7f87980af2f0 2023-10-09T06:58:48.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.350+0000 7f879ebff700 1 -- 172.21.15.71:0/1716073028 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879804c3c0 con 0x7f87980af2f0 2023-10-09T06:58:48.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.351+0000 7f8794ff9700 1 -- 172.21.15.71:0/1716073028 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f878c01b400 con 0x7f87980af2f0 2023-10-09T06:58:48.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.352+0000 7f8794ff9700 1 --2- 172.21.15.71:0/1716073028 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f877c066f30 0x7f877c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:48.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.353+0000 7f8794ff9700 1 -- 172.21.15.71:0/1716073028 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f878c0842a0 con 0x7f87980af2f0 2023-10-09T06:58:48.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.353+0000 7f8797fff700 1 --2- 172.21.15.71:0/1716073028 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f877c066f30 0x7f877c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:48.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.354+0000 7f8797fff700 1 --2- 172.21.15.71:0/1716073028 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f877c066f30 0x7f877c0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f878400b470 tx=0x7f878401a000 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:48.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.357+0000 7f8794ff9700 1 -- 172.21.15.71:0/1716073028 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f878c051360 con 0x7f87980af2f0 2023-10-09T06:58:48.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.543+0000 7f879ebff700 1 -- 172.21.15.71:0/1716073028 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f87981586e0 con 0x7f877c066f30 2023-10-09T06:58:48.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.554+0000 7f8794ff9700 1 -- 172.21.15.71:0/1716073028 <== mgr.6718 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285098 (secure 0 0 0) 0x7f8784010470 con 0x7f877c066f30 2023-10-09T06:58:48.559 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:48.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.558+0000 7f879ebff700 1 -- 172.21.15.71:0/1716073028 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f877c066f30 msgr2=0x7f877c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:48.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.558+0000 7f879ebff700 1 --2- 172.21.15.71:0/1716073028 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f877c066f30 0x7f877c0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f878400b470 tx=0x7f878401a000 comp rx=0 tx=0).stop 2023-10-09T06:58:48.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.558+0000 7f879ebff700 1 -- 172.21.15.71:0/1716073028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87980af2f0 msgr2=0x7f879814b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:48.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.558+0000 7f879ebff700 1 --2- 172.21.15.71:0/1716073028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87980af2f0 0x7f879814b1d0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f878c00c810 tx=0x7f878c007df0 comp rx=0 tx=0).stop 2023-10-09T06:58:48.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.558+0000 7f879ebff700 1 -- 172.21.15.71:0/1716073028 shutdown_connections 2023-10-09T06:58:48.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.558+0000 7f879ebff700 1 --2- 172.21.15.71:0/1716073028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87981578b0 0x7f879814d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:48.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.558+0000 7f879ebff700 1 --2- 172.21.15.71:0/1716073028 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f877c066f30 0x7f877c0693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:48.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.558+0000 7f879ebff700 1 --2- 172.21.15.71:0/1716073028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87980af2f0 0x7f879814b1d0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:48.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.558+0000 7f879ebff700 1 --2- 172.21.15.71:0/1716073028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8798155c10 0x7f879815a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:48.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.558+0000 7f879ebff700 1 -- 172.21.15.71:0/1716073028 >> 172.21.15.71:0/1716073028 conn(0x7f879806a320 msgr2=0x7f879814a790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:48.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.558+0000 7f879ebff700 1 -- 172.21.15.71:0/1716073028 shutdown_connections 2023-10-09T06:58:48.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.558+0000 7f879ebff700 1 -- 172.21.15.71:0/1716073028 wait complete. 2023-10-09T06:58:48.562 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:58:48.577 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T06:58:47.972713+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":347,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":140,"acting":140,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434704,"kb_used_data":11344,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752540016,"statfs":{"total":773094113280,"available":770600976384,"internally_reserved":0,"allocated":11616256,"data_stored":6235331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.739652"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.800454+0000","last_change":"2023-10-09T06:58:43.799501+0000","last_active":"2023-10-09T06:58:43.800454+0000","last_peered":"2023-10-09T06:58:43.800454+0000","last_clean":"2023-10-09T06:58:43.800454+0000","last_became_active":"2023-10-09T06:58:43.799241+0000","last_became_peered":"2023-10-09T06:58:43.799241+0000","last_unstale":"2023-10-09T06:58:43.800454+0000","last_undegraded":"2023-10-09T06:58:43.800454+0000","last_fullsized":"2023-10-09T06:58:43.800454+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:11.893055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796119+0000","last_change":"2023-10-09T06:58:43.794396+0000","last_active":"2023-10-09T06:58:43.796119+0000","last_peered":"2023-10-09T06:58:43.796119+0000","last_clean":"2023-10-09T06:58:43.796119+0000","last_became_active":"2023-10-09T06:58:43.794124+0000","last_became_peered":"2023-10-09T06:58:43.794124+0000","last_unstale":"2023-10-09T06:58:43.796119+0000","last_undegraded":"2023-10-09T06:58:43.796119+0000","last_fullsized":"2023-10-09T06:58:43.796119+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:26:49.171285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796255+0000","last_change":"2023-10-09T06:58:43.791324+0000","last_active":"2023-10-09T06:58:43.796255+0000","last_peered":"2023-10-09T06:58:43.796255+0000","last_clean":"2023-10-09T06:58:43.796255+0000","last_became_active":"2023-10-09T06:58:43.790853+0000","last_became_peered":"2023-10-09T06:58:43.790853+0000","last_unstale":"2023-10-09T06:58:43.796255+0000","last_undegraded":"2023-10-09T06:58:43.796255+0000","last_fullsized":"2023-10-09T06:58:43.796255+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:36.821271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.793084+0000","last_change":"2023-10-09T06:58:43.791927+0000","last_active":"2023-10-09T06:58:43.793084+0000","last_peered":"2023-10-09T06:58:43.793084+0000","last_clean":"2023-10-09T06:58:43.793084+0000","last_became_active":"2023-10-09T06:58:43.791694+0000","last_became_peered":"2023-10-09T06:58:43.791694+0000","last_unstale":"2023-10-09T06:58:43.793084+0000","last_undegraded":"2023-10-09T06:58:43.793084+0000","last_fullsized":"2023-10-09T06:58:43.793084+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:41:21.133593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.794464+0000","last_change":"2023-10-09T06:58:43.790416+0000","last_active":"2023-10-09T06:58:43.794464+0000","last_peered":"2023-10-09T06:58:43.794464+0000","last_clean":"2023-10-09T06:58:43.794464+0000","last_became_active":"2023-10-09T06:58:43.790148+0000","last_became_peered":"2023-10-09T06:58:43.790148+0000","last_unstale":"2023-10-09T06:58:43.794464+0000","last_undegraded":"2023-10-09T06:58:43.794464+0000","last_fullsized":"2023-10-09T06:58:43.794464+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:26.456449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.794813+0000","last_change":"2023-10-09T06:58:43.793638+0000","last_active":"2023-10-09T06:58:43.794813+0000","last_peered":"2023-10-09T06:58:43.794813+0000","last_clean":"2023-10-09T06:58:43.794813+0000","last_became_active":"2023-10-09T06:58:43.793289+0000","last_became_peered":"2023-10-09T06:58:43.793289+0000","last_unstale":"2023-10-09T06:58:43.794813+0000","last_undegraded":"2023-10-09T06:58:43.794813+0000","last_fullsized":"2023-10-09T06:58:43.794813+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:33.042437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792088+0000","last_change":"2023-10-09T06:58:43.789987+0000","last_active":"2023-10-09T06:58:43.792088+0000","last_peered":"2023-10-09T06:58:43.792088+0000","last_clean":"2023-10-09T06:58:43.792088+0000","last_became_active":"2023-10-09T06:58:43.789753+0000","last_became_peered":"2023-10-09T06:58:43.789753+0000","last_unstale":"2023-10-09T06:58:43.792088+0000","last_undegraded":"2023-10-09T06:58:43.792088+0000","last_fullsized":"2023-10-09T06:58:43.792088+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:55.083637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801028+0000","last_change":"2023-10-09T06:58:43.799220+0000","last_active":"2023-10-09T06:58:43.801028+0000","last_peered":"2023-10-09T06:58:43.801028+0000","last_clean":"2023-10-09T06:58:43.801028+0000","last_became_active":"2023-10-09T06:58:43.798948+0000","last_became_peered":"2023-10-09T06:58:43.798948+0000","last_unstale":"2023-10-09T06:58:43.801028+0000","last_undegraded":"2023-10-09T06:58:43.801028+0000","last_fullsized":"2023-10-09T06:58:43.801028+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:32.536328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798525+0000","last_change":"2023-10-09T06:58:43.793525+0000","last_active":"2023-10-09T06:58:43.798525+0000","last_peered":"2023-10-09T06:58:43.798525+0000","last_clean":"2023-10-09T06:58:43.798525+0000","last_became_active":"2023-10-09T06:58:43.793039+0000","last_became_peered":"2023-10-09T06:58:43.793039+0000","last_unstale":"2023-10-09T06:58:43.798525+0000","last_undegraded":"2023-10-09T06:58:43.798525+0000","last_fullsized":"2023-10-09T06:58:43.798525+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:10.429867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798108+0000","last_change":"2023-10-09T06:58:43.796846+0000","last_active":"2023-10-09T06:58:43.798108+0000","last_peered":"2023-10-09T06:58:43.798108+0000","last_clean":"2023-10-09T06:58:43.798108+0000","last_became_active":"2023-10-09T06:58:43.796598+0000","last_became_peered":"2023-10-09T06:58:43.796598+0000","last_unstale":"2023-10-09T06:58:43.798108+0000","last_undegraded":"2023-10-09T06:58:43.798108+0000","last_fullsized":"2023-10-09T06:58:43.798108+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:41:05.828751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792567+0000","last_change":"2023-10-09T06:58:43.788053+0000","last_active":"2023-10-09T06:58:43.792567+0000","last_peered":"2023-10-09T06:58:43.792567+0000","last_clean":"2023-10-09T06:58:43.792567+0000","last_became_active":"2023-10-09T06:58:43.787821+0000","last_became_peered":"2023-10-09T06:58:43.787821+0000","last_unstale":"2023-10-09T06:58:43.792567+0000","last_undegraded":"2023-10-09T06:58:43.792567+0000","last_fullsized":"2023-10-09T06:58:43.792567+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:49:56.178318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798095+0000","last_change":"2023-10-09T06:58:43.796626+0000","last_active":"2023-10-09T06:58:43.798095+0000","last_peered":"2023-10-09T06:58:43.798095+0000","last_clean":"2023-10-09T06:58:43.798095+0000","last_became_active":"2023-10-09T06:58:43.796232+0000","last_became_peered":"2023-10-09T06:58:43.796232+0000","last_unstale":"2023-10-09T06:58:43.798095+0000","last_undegraded":"2023-10-09T06:58:43.798095+0000","last_fullsized":"2023-10-09T06:58:43.798095+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:45.689229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.791208+0000","last_change":"2023-10-09T06:58:43.788457+0000","last_active":"2023-10-09T06:58:43.791208+0000","last_peered":"2023-10-09T06:58:43.791208+0000","last_clean":"2023-10-09T06:58:43.791208+0000","last_became_active":"2023-10-09T06:58:43.788206+0000","last_became_peered":"2023-10-09T06:58:43.788206+0000","last_unstale":"2023-10-09T06:58:43.791208+0000","last_undegraded":"2023-10-09T06:58:43.791208+0000","last_fullsized":"2023-10-09T06:58:43.791208+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:54:13.880490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.794533+0000","last_change":"2023-10-09T06:58:43.791344+0000","last_active":"2023-10-09T06:58:43.794533+0000","last_peered":"2023-10-09T06:58:43.794533+0000","last_clean":"2023-10-09T06:58:43.794533+0000","last_became_active":"2023-10-09T06:58:43.790302+0000","last_became_peered":"2023-10-09T06:58:43.790302+0000","last_unstale":"2023-10-09T06:58:43.794533+0000","last_undegraded":"2023-10-09T06:58:43.794533+0000","last_fullsized":"2023-10-09T06:58:43.794533+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:09.624621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.791090+0000","last_change":"2023-10-09T06:58:43.787561+0000","last_active":"2023-10-09T06:58:43.791090+0000","last_peered":"2023-10-09T06:58:43.791090+0000","last_clean":"2023-10-09T06:58:43.791090+0000","last_became_active":"2023-10-09T06:58:43.787294+0000","last_became_peered":"2023-10-09T06:58:43.787294+0000","last_unstale":"2023-10-09T06:58:43.791090+0000","last_undegraded":"2023-10-09T06:58:43.791090+0000","last_fullsized":"2023-10-09T06:58:43.791090+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:15.783097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.800940+0000","last_change":"2023-10-09T06:58:43.799680+0000","last_active":"2023-10-09T06:58:43.800940+0000","last_peered":"2023-10-09T06:58:43.800940+0000","last_clean":"2023-10-09T06:58:43.800940+0000","last_became_active":"2023-10-09T06:58:43.798445+0000","last_became_peered":"2023-10-09T06:58:43.798445+0000","last_unstale":"2023-10-09T06:58:43.800940+0000","last_undegraded":"2023-10-09T06:58:43.800940+0000","last_fullsized":"2023-10-09T06:58:43.800940+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:18.050283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796612+0000","last_change":"2023-10-09T06:58:43.793097+0000","last_active":"2023-10-09T06:58:43.796612+0000","last_peered":"2023-10-09T06:58:43.796612+0000","last_clean":"2023-10-09T06:58:43.796612+0000","last_became_active":"2023-10-09T06:58:43.791977+0000","last_became_peered":"2023-10-09T06:58:43.791977+0000","last_unstale":"2023-10-09T06:58:43.796612+0000","last_undegraded":"2023-10-09T06:58:43.796612+0000","last_fullsized":"2023-10-09T06:58:43.796612+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:57.183851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.791338+0000","last_change":"2023-10-09T06:58:43.786570+0000","last_active":"2023-10-09T06:58:43.791338+0000","last_peered":"2023-10-09T06:58:43.791338+0000","last_clean":"2023-10-09T06:58:43.791338+0000","last_became_active":"2023-10-09T06:58:43.786278+0000","last_became_peered":"2023-10-09T06:58:43.786278+0000","last_unstale":"2023-10-09T06:58:43.791338+0000","last_undegraded":"2023-10-09T06:58:43.791338+0000","last_fullsized":"2023-10-09T06:58:43.791338+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:20:14.106000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.797100+0000","last_change":"2023-10-09T06:58:43.793238+0000","last_active":"2023-10-09T06:58:43.797100+0000","last_peered":"2023-10-09T06:58:43.797100+0000","last_clean":"2023-10-09T06:58:43.797100+0000","last_became_active":"2023-10-09T06:58:43.792979+0000","last_became_peered":"2023-10-09T06:58:43.792979+0000","last_unstale":"2023-10-09T06:58:43.797100+0000","last_undegraded":"2023-10-09T06:58:43.797100+0000","last_fullsized":"2023-10-09T06:58:43.797100+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:16:08.167149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796387+0000","last_change":"2023-10-09T06:58:43.793047+0000","last_active":"2023-10-09T06:58:43.796387+0000","last_peered":"2023-10-09T06:58:43.796387+0000","last_clean":"2023-10-09T06:58:43.796387+0000","last_became_active":"2023-10-09T06:58:43.792478+0000","last_became_peered":"2023-10-09T06:58:43.792478+0000","last_unstale":"2023-10-09T06:58:43.796387+0000","last_undegraded":"2023-10-09T06:58:43.796387+0000","last_fullsized":"2023-10-09T06:58:43.796387+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:20.771196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.799503+0000","last_change":"2023-10-09T06:58:43.796883+0000","last_active":"2023-10-09T06:58:43.799503+0000","last_peered":"2023-10-09T06:58:43.799503+0000","last_clean":"2023-10-09T06:58:43.799503+0000","last_became_active":"2023-10-09T06:58:43.796610+0000","last_became_peered":"2023-10-09T06:58:43.796610+0000","last_unstale":"2023-10-09T06:58:43.799503+0000","last_undegraded":"2023-10-09T06:58:43.799503+0000","last_fullsized":"2023-10-09T06:58:43.799503+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:39.554977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.240443+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:46:58.364775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.262810+0000","last_change":"2023-10-09T06:58:43.252052+0000","last_active":"2023-10-09T06:58:44.262810+0000","last_peered":"2023-10-09T06:58:44.262810+0000","last_clean":"2023-10-09T06:58:44.262810+0000","last_became_active":"2023-10-09T06:58:43.251738+0000","last_became_peered":"2023-10-09T06:58:43.251738+0000","last_unstale":"2023-10-09T06:58:44.262810+0000","last_undegraded":"2023-10-09T06:58:44.262810+0000","last_fullsized":"2023-10-09T06:58:44.262810+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:45:42.343993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.260847+0000","last_change":"2023-10-09T06:58:43.252945+0000","last_active":"2023-10-09T06:58:44.260847+0000","last_peered":"2023-10-09T06:58:44.260847+0000","last_clean":"2023-10-09T06:58:44.260847+0000","last_became_active":"2023-10-09T06:58:43.252616+0000","last_became_peered":"2023-10-09T06:58:43.252616+0000","last_unstale":"2023-10-09T06:58:44.260847+0000","last_undegraded":"2023-10-09T06:58:44.260847+0000","last_fullsized":"2023-10-09T06:58:44.260847+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:43:21.232774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.261335+0000","last_change":"2023-10-09T06:58:43.248945+0000","last_active":"2023-10-09T06:58:44.261335+0000","last_peered":"2023-10-09T06:58:44.261335+0000","last_clean":"2023-10-09T06:58:44.261335+0000","last_became_active":"2023-10-09T06:58:43.248676+0000","last_became_peered":"2023-10-09T06:58:43.248676+0000","last_unstale":"2023-10-09T06:58:44.261335+0000","last_undegraded":"2023-10-09T06:58:44.261335+0000","last_fullsized":"2023-10-09T06:58:44.261335+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:39:35.477143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.797144+0000","last_change":"2023-10-09T06:58:43.793238+0000","last_active":"2023-10-09T06:58:43.797144+0000","last_peered":"2023-10-09T06:58:43.797144+0000","last_clean":"2023-10-09T06:58:43.797144+0000","last_became_active":"2023-10-09T06:58:43.792972+0000","last_became_peered":"2023-10-09T06:58:43.792972+0000","last_unstale":"2023-10-09T06:58:43.797144+0000","last_undegraded":"2023-10-09T06:58:43.797144+0000","last_fullsized":"2023-10-09T06:58:43.797144+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:14.141466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.262947+0000","last_change":"2023-10-09T06:58:43.254364+0000","last_active":"2023-10-09T06:58:44.262947+0000","last_peered":"2023-10-09T06:58:44.262947+0000","last_clean":"2023-10-09T06:58:44.262947+0000","last_became_active":"2023-10-09T06:58:43.254116+0000","last_became_peered":"2023-10-09T06:58:43.254116+0000","last_unstale":"2023-10-09T06:58:44.262947+0000","last_undegraded":"2023-10-09T06:58:44.262947+0000","last_fullsized":"2023-10-09T06:58:44.262947+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:16:07.159805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798740+0000","last_change":"2023-10-09T06:58:43.794432+0000","last_active":"2023-10-09T06:58:43.798740+0000","last_peered":"2023-10-09T06:58:43.798740+0000","last_clean":"2023-10-09T06:58:43.798740+0000","last_became_active":"2023-10-09T06:58:43.794079+0000","last_became_peered":"2023-10-09T06:58:43.794079+0000","last_unstale":"2023-10-09T06:58:43.798740+0000","last_undegraded":"2023-10-09T06:58:43.798740+0000","last_fullsized":"2023-10-09T06:58:43.798740+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:50:22.439113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.262592+0000","last_change":"2023-10-09T06:58:43.255791+0000","last_active":"2023-10-09T06:58:44.262592+0000","last_peered":"2023-10-09T06:58:44.262592+0000","last_clean":"2023-10-09T06:58:44.262592+0000","last_became_active":"2023-10-09T06:58:43.255535+0000","last_became_peered":"2023-10-09T06:58:43.255535+0000","last_unstale":"2023-10-09T06:58:44.262592+0000","last_undegraded":"2023-10-09T06:58:44.262592+0000","last_fullsized":"2023-10-09T06:58:44.262592+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:46:58.364775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.780552+0000","last_change":"2023-10-09T06:58:43.244540+0000","last_active":"2023-10-09T06:58:43.780552+0000","last_peered":"2023-10-09T06:58:43.780552+0000","last_clean":"2023-10-09T06:58:43.780552+0000","last_became_active":"2023-10-09T06:58:43.244261+0000","last_became_peered":"2023-10-09T06:58:43.244261+0000","last_unstale":"2023-10-09T06:58:43.780552+0000","last_undegraded":"2023-10-09T06:58:43.780552+0000","last_fullsized":"2023-10-09T06:58:43.780552+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:56.176507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792065+0000","last_change":"2023-10-09T06:58:43.788475+0000","last_active":"2023-10-09T06:58:43.792065+0000","last_peered":"2023-10-09T06:58:43.792065+0000","last_clean":"2023-10-09T06:58:43.792065+0000","last_became_active":"2023-10-09T06:58:43.788225+0000","last_became_peered":"2023-10-09T06:58:43.788225+0000","last_unstale":"2023-10-09T06:58:43.792065+0000","last_undegraded":"2023-10-09T06:58:43.792065+0000","last_fullsized":"2023-10-09T06:58:43.792065+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:13:39.010325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779920+0000","last_change":"2023-10-09T06:58:43.251615+0000","last_active":"2023-10-09T06:58:43.779920+0000","last_peered":"2023-10-09T06:58:43.779920+0000","last_clean":"2023-10-09T06:58:43.779920+0000","last_became_active":"2023-10-09T06:58:43.250726+0000","last_became_peered":"2023-10-09T06:58:43.250726+0000","last_unstale":"2023-10-09T06:58:43.779920+0000","last_undegraded":"2023-10-09T06:58:43.779920+0000","last_fullsized":"2023-10-09T06:58:43.779920+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:26:48.163941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792119+0000","last_change":"2023-10-09T06:58:43.789342+0000","last_active":"2023-10-09T06:58:43.792119+0000","last_peered":"2023-10-09T06:58:43.792119+0000","last_clean":"2023-10-09T06:58:43.792119+0000","last_became_active":"2023-10-09T06:58:43.789085+0000","last_became_peered":"2023-10-09T06:58:43.789085+0000","last_unstale":"2023-10-09T06:58:43.792119+0000","last_undegraded":"2023-10-09T06:58:43.792119+0000","last_fullsized":"2023-10-09T06:58:43.792119+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:05:54.912313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.240034+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:53.286318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.238954+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:25.449105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.800375+0000","last_change":"2023-10-09T06:58:43.798126+0000","last_active":"2023-10-09T06:58:43.800375+0000","last_peered":"2023-10-09T06:58:43.800375+0000","last_clean":"2023-10-09T06:58:43.800375+0000","last_became_active":"2023-10-09T06:58:43.797884+0000","last_became_peered":"2023-10-09T06:58:43.797884+0000","last_unstale":"2023-10-09T06:58:43.800375+0000","last_undegraded":"2023-10-09T06:58:43.800375+0000","last_fullsized":"2023-10-09T06:58:43.800375+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:42:30.221135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.240065+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:13.134122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796573+0000","last_change":"2023-10-09T06:58:43.791013+0000","last_active":"2023-10-09T06:58:43.796573+0000","last_peered":"2023-10-09T06:58:43.796573+0000","last_clean":"2023-10-09T06:58:43.796573+0000","last_became_active":"2023-10-09T06:58:43.789697+0000","last_became_peered":"2023-10-09T06:58:43.789697+0000","last_unstale":"2023-10-09T06:58:43.796573+0000","last_undegraded":"2023-10-09T06:58:43.796573+0000","last_fullsized":"2023-10-09T06:58:43.796573+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:49.433121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.235537+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:17.947780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792408+0000","last_change":"2023-10-09T06:58:43.786500+0000","last_active":"2023-10-09T06:58:43.792408+0000","last_peered":"2023-10-09T06:58:43.792408+0000","last_clean":"2023-10-09T06:58:43.792408+0000","last_became_active":"2023-10-09T06:58:43.786244+0000","last_became_peered":"2023-10-09T06:58:43.786244+0000","last_unstale":"2023-10-09T06:58:43.792408+0000","last_undegraded":"2023-10-09T06:58:43.792408+0000","last_fullsized":"2023-10-09T06:58:43.792408+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:01.948441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.262408+0000","last_change":"2023-10-09T06:58:43.251369+0000","last_active":"2023-10-09T06:58:44.262408+0000","last_peered":"2023-10-09T06:58:44.262408+0000","last_clean":"2023-10-09T06:58:44.262408+0000","last_became_active":"2023-10-09T06:58:43.251090+0000","last_became_peered":"2023-10-09T06:58:43.251090+0000","last_unstale":"2023-10-09T06:58:44.262408+0000","last_undegraded":"2023-10-09T06:58:44.262408+0000","last_fullsized":"2023-10-09T06:58:44.262408+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:54:12.873146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.776377+0000","last_change":"2023-10-09T06:58:43.251912+0000","last_active":"2023-10-09T06:58:43.776377+0000","last_peered":"2023-10-09T06:58:43.776377+0000","last_clean":"2023-10-09T06:58:43.776377+0000","last_became_active":"2023-10-09T06:58:43.251661+0000","last_became_peered":"2023-10-09T06:58:43.251661+0000","last_unstale":"2023-10-09T06:58:43.776377+0000","last_undegraded":"2023-10-09T06:58:43.776377+0000","last_fullsized":"2023-10-09T06:58:43.776377+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:48.425777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.790274+0000","last_change":"2023-10-09T06:58:43.788503+0000","last_active":"2023-10-09T06:58:43.790274+0000","last_peered":"2023-10-09T06:58:43.790274+0000","last_clean":"2023-10-09T06:58:43.790274+0000","last_became_active":"2023-10-09T06:58:43.788263+0000","last_became_peered":"2023-10-09T06:58:43.788263+0000","last_unstale":"2023-10-09T06:58:43.790274+0000","last_undegraded":"2023-10-09T06:58:43.790274+0000","last_fullsized":"2023-10-09T06:58:43.790274+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:54.293662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.235578+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:46:31.472275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.799625+0000","last_change":"2023-10-09T06:58:43.797986+0000","last_active":"2023-10-09T06:58:43.799625+0000","last_peered":"2023-10-09T06:58:43.799625+0000","last_clean":"2023-10-09T06:58:43.799625+0000","last_became_active":"2023-10-09T06:58:43.797568+0000","last_became_peered":"2023-10-09T06:58:43.797568+0000","last_unstale":"2023-10-09T06:58:43.799625+0000","last_undegraded":"2023-10-09T06:58:43.799625+0000","last_fullsized":"2023-10-09T06:58:43.799625+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:29.985093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"106'8","reported_seq":18,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.263980+0000","last_change":"2023-10-09T06:58:43.253188+0000","last_active":"2023-10-09T06:58:44.263980+0000","last_peered":"2023-10-09T06:58:44.263980+0000","last_clean":"2023-10-09T06:58:44.263980+0000","last_became_active":"2023-10-09T06:58:43.252677+0000","last_became_peered":"2023-10-09T06:58:43.252677+0000","last_unstale":"2023-10-09T06:58:44.263980+0000","last_undegraded":"2023-10-09T06:58:44.263980+0000","last_fullsized":"2023-10-09T06:58:44.263980+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:33.706986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.239441+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:10.885711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.263780+0000","last_change":"2023-10-09T06:58:43.250800+0000","last_active":"2023-10-09T06:58:44.263780+0000","last_peered":"2023-10-09T06:58:44.263780+0000","last_clean":"2023-10-09T06:58:44.263780+0000","last_became_active":"2023-10-09T06:58:43.250529+0000","last_became_peered":"2023-10-09T06:58:43.250529+0000","last_unstale":"2023-10-09T06:58:44.263780+0000","last_undegraded":"2023-10-09T06:58:44.263780+0000","last_fullsized":"2023-10-09T06:58:44.263780+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:07.313495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796594+0000","last_change":"2023-10-09T06:58:43.791548+0000","last_active":"2023-10-09T06:58:43.796594+0000","last_peered":"2023-10-09T06:58:43.796594+0000","last_clean":"2023-10-09T06:58:43.796594+0000","last_became_active":"2023-10-09T06:58:43.790746+0000","last_became_peered":"2023-10-09T06:58:43.790746+0000","last_unstale":"2023-10-09T06:58:43.796594+0000","last_undegraded":"2023-10-09T06:58:43.796594+0000","last_fullsized":"2023-10-09T06:58:43.796594+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:37.545876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779490+0000","last_change":"2023-10-09T06:58:43.243471+0000","last_active":"2023-10-09T06:58:43.779490+0000","last_peered":"2023-10-09T06:58:43.779490+0000","last_clean":"2023-10-09T06:58:43.779490+0000","last_became_active":"2023-10-09T06:58:43.243230+0000","last_became_peered":"2023-10-09T06:58:43.243230+0000","last_unstale":"2023-10-09T06:58:43.779490+0000","last_undegraded":"2023-10-09T06:58:43.779490+0000","last_fullsized":"2023-10-09T06:58:43.779490+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:48.425777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796119+0000","last_change":"2023-10-09T06:58:43.794689+0000","last_active":"2023-10-09T06:58:43.796119+0000","last_peered":"2023-10-09T06:58:43.796119+0000","last_clean":"2023-10-09T06:58:43.796119+0000","last_became_active":"2023-10-09T06:58:43.793778+0000","last_became_peered":"2023-10-09T06:58:43.793778+0000","last_unstale":"2023-10-09T06:58:43.796119+0000","last_undegraded":"2023-10-09T06:58:43.796119+0000","last_fullsized":"2023-10-09T06:58:43.796119+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:22.993909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.261333+0000","last_change":"2023-10-09T06:58:43.252297+0000","last_active":"2023-10-09T06:58:44.261333+0000","last_peered":"2023-10-09T06:58:44.261333+0000","last_clean":"2023-10-09T06:58:44.261333+0000","last_became_active":"2023-10-09T06:58:43.252051+0000","last_became_peered":"2023-10-09T06:58:43.252051+0000","last_unstale":"2023-10-09T06:58:44.261333+0000","last_undegraded":"2023-10-09T06:58:44.261333+0000","last_fullsized":"2023-10-09T06:58:44.261333+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:07.313495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.784061+0000","last_change":"2023-10-09T06:58:43.255859+0000","last_active":"2023-10-09T06:58:43.784061+0000","last_peered":"2023-10-09T06:58:43.784061+0000","last_clean":"2023-10-09T06:58:43.784061+0000","last_became_active":"2023-10-09T06:58:43.255578+0000","last_became_peered":"2023-10-09T06:58:43.255578+0000","last_unstale":"2023-10-09T06:58:43.784061+0000","last_undegraded":"2023-10-09T06:58:43.784061+0000","last_fullsized":"2023-10-09T06:58:43.784061+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:40.351052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798159+0000","last_change":"2023-10-09T06:58:43.796219+0000","last_active":"2023-10-09T06:58:43.798159+0000","last_peered":"2023-10-09T06:58:43.798159+0000","last_clean":"2023-10-09T06:58:43.798159+0000","last_became_active":"2023-10-09T06:58:43.795941+0000","last_became_peered":"2023-10-09T06:58:43.795941+0000","last_unstale":"2023-10-09T06:58:43.798159+0000","last_undegraded":"2023-10-09T06:58:43.798159+0000","last_fullsized":"2023-10-09T06:58:43.798159+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:14.659129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.786291+0000","last_change":"2023-10-09T06:58:43.260159+0000","last_active":"2023-10-09T06:58:43.786291+0000","last_peered":"2023-10-09T06:58:43.786291+0000","last_clean":"2023-10-09T06:58:43.786291+0000","last_became_active":"2023-10-09T06:58:43.259901+0000","last_became_peered":"2023-10-09T06:58:43.259901+0000","last_unstale":"2023-10-09T06:58:43.786291+0000","last_undegraded":"2023-10-09T06:58:43.786291+0000","last_fullsized":"2023-10-09T06:58:43.786291+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:49:23.556684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.776097+0000","last_change":"2023-10-09T06:58:43.251771+0000","last_active":"2023-10-09T06:58:43.776097+0000","last_peered":"2023-10-09T06:58:43.776097+0000","last_clean":"2023-10-09T06:58:43.776097+0000","last_became_active":"2023-10-09T06:58:43.251526+0000","last_became_peered":"2023-10-09T06:58:43.251526+0000","last_unstale":"2023-10-09T06:58:43.776097+0000","last_undegraded":"2023-10-09T06:58:43.776097+0000","last_fullsized":"2023-10-09T06:58:43.776097+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:56.176507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.788879+0000","last_change":"2023-10-09T06:58:43.785494+0000","last_active":"2023-10-09T06:58:43.788879+0000","last_peered":"2023-10-09T06:58:43.788879+0000","last_clean":"2023-10-09T06:58:43.788879+0000","last_became_active":"2023-10-09T06:58:43.785046+0000","last_became_peered":"2023-10-09T06:58:43.785046+0000","last_unstale":"2023-10-09T06:58:43.788879+0000","last_undegraded":"2023-10-09T06:58:43.788879+0000","last_fullsized":"2023-10-09T06:58:43.788879+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:56:11.098462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.263422+0000","last_change":"2023-10-09T06:58:43.256281+0000","last_active":"2023-10-09T06:58:44.263422+0000","last_peered":"2023-10-09T06:58:44.263422+0000","last_clean":"2023-10-09T06:58:44.263422+0000","last_became_active":"2023-10-09T06:58:43.255990+0000","last_became_peered":"2023-10-09T06:58:43.255990+0000","last_unstale":"2023-10-09T06:58:44.263422+0000","last_undegraded":"2023-10-09T06:58:44.263422+0000","last_fullsized":"2023-10-09T06:58:44.263422+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:21.986566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779711+0000","last_change":"2023-10-09T06:58:43.252157+0000","last_active":"2023-10-09T06:58:43.779711+0000","last_peered":"2023-10-09T06:58:43.779711+0000","last_clean":"2023-10-09T06:58:43.779711+0000","last_became_active":"2023-10-09T06:58:43.251921+0000","last_became_peered":"2023-10-09T06:58:43.251921+0000","last_unstale":"2023-10-09T06:58:43.779711+0000","last_undegraded":"2023-10-09T06:58:43.779711+0000","last_fullsized":"2023-10-09T06:58:43.779711+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:14.775753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.239083+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:20:13.098656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792325+0000","last_change":"2023-10-09T06:58:43.787346+0000","last_active":"2023-10-09T06:58:43.792325+0000","last_peered":"2023-10-09T06:58:43.792325+0000","last_clean":"2023-10-09T06:58:43.792325+0000","last_became_active":"2023-10-09T06:58:43.786810+0000","last_became_peered":"2023-10-09T06:58:43.786810+0000","last_unstale":"2023-10-09T06:58:43.792325+0000","last_undegraded":"2023-10-09T06:58:43.792325+0000","last_fullsized":"2023-10-09T06:58:43.792325+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:39:57.258267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.239235+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:17.042939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779768+0000","last_change":"2023-10-09T06:58:43.253376+0000","last_active":"2023-10-09T06:58:43.779768+0000","last_peered":"2023-10-09T06:58:43.779768+0000","last_clean":"2023-10-09T06:58:43.779768+0000","last_became_active":"2023-10-09T06:58:43.253110+0000","last_became_peered":"2023-10-09T06:58:43.253110+0000","last_unstale":"2023-10-09T06:58:43.779768+0000","last_undegraded":"2023-10-09T06:58:43.779768+0000","last_fullsized":"2023-10-09T06:58:43.779768+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:56:21.112546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.789652+0000","last_change":"2023-10-09T06:58:43.784901+0000","last_active":"2023-10-09T06:58:43.789652+0000","last_peered":"2023-10-09T06:58:43.789652+0000","last_clean":"2023-10-09T06:58:43.789652+0000","last_became_active":"2023-10-09T06:58:43.784645+0000","last_became_peered":"2023-10-09T06:58:43.784645+0000","last_unstale":"2023-10-09T06:58:43.789652+0000","last_undegraded":"2023-10-09T06:58:43.789652+0000","last_fullsized":"2023-10-09T06:58:43.789652+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:56:33.524723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779732+0000","last_change":"2023-10-09T06:58:43.255156+0000","last_active":"2023-10-09T06:58:43.779732+0000","last_peered":"2023-10-09T06:58:43.779732+0000","last_clean":"2023-10-09T06:58:43.779732+0000","last_became_active":"2023-10-09T06:58:43.254884+0000","last_became_peered":"2023-10-09T06:58:43.254884+0000","last_unstale":"2023-10-09T06:58:43.779732+0000","last_undegraded":"2023-10-09T06:58:43.779732+0000","last_fullsized":"2023-10-09T06:58:43.779732+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:08.617277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.238885+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:12:27.841627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.781109+0000","last_change":"2023-10-09T06:58:43.256820+0000","last_active":"2023-10-09T06:58:43.781109+0000","last_peered":"2023-10-09T06:58:43.781109+0000","last_clean":"2023-10-09T06:58:43.781109+0000","last_became_active":"2023-10-09T06:58:43.256460+0000","last_became_peered":"2023-10-09T06:58:43.256460+0000","last_unstale":"2023-10-09T06:58:43.781109+0000","last_undegraded":"2023-10-09T06:58:43.781109+0000","last_fullsized":"2023-10-09T06:58:43.781109+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:51:46.519760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792081+0000","last_change":"2023-10-09T06:58:43.789965+0000","last_active":"2023-10-09T06:58:43.792081+0000","last_peered":"2023-10-09T06:58:43.792081+0000","last_clean":"2023-10-09T06:58:43.792081+0000","last_became_active":"2023-10-09T06:58:43.789716+0000","last_became_peered":"2023-10-09T06:58:43.789716+0000","last_unstale":"2023-10-09T06:58:43.792081+0000","last_undegraded":"2023-10-09T06:58:43.792081+0000","last_fullsized":"2023-10-09T06:58:43.792081+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:12:28.848971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.243296+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:20.836176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"96'205","reported_seq":547,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-09T06:58:39.914795+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:58:39.914795+0000","last_peered":"2023-10-09T06:58:39.914795+0000","last_clean":"2023-10-09T06:58:39.914795+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:58:39.914795+0000","last_undegraded":"2023-10-09T06:58:39.914795+0000","last_fullsized":"2023-10-09T06:58:39.914795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":74,"acting":74,"num_store_stats":5},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23,"ondisk_log_size":23,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575041,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303200,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068640,"statfs":{"total":96636764160,"available":96326287360,"internally_reserved":0,"allocated":1859584,"data_stored":1203674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68400000000000005,"15min":0.70799999999999996},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.316},"max":{"1min":0.81100000000000005,"5min":1.732,"15min":1.9490000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.44,"5min":0.40200000000000002,"15min":0.29999999999999999},"max":{"1min":0.83299999999999996,"5min":1.22,"15min":3.448},"last":0.80700000000000005}]},{"osd":1,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.504,"5min":0.437,"15min":0.379},"max":{"1min":0.86799999999999999,"5min":2.3559999999999999,"15min":5.617},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.46999999999999997,"5min":0.45800000000000002,"15min":0.40200000000000002},"max":{"1min":0.97599999999999998,"5min":1.7869999999999999,"15min":2.016},"last":0.82199999999999995}]},{"osd":2,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.72999999999999998,"15min":0.73899999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.44800000000000001},"max":{"1min":0.97999999999999998,"5min":1.9430000000000001,"15min":2.052},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.73799999999999999,"15min":0.75600000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.44700000000000001},"max":{"1min":0.82399999999999995,"5min":2.6629999999999998,"15min":3.5019999999999998},"last":0.77200000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.73899999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.45000000000000001},"max":{"1min":0.97099999999999997,"5min":1.03,"15min":5.5800000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.746,"15min":0.78100000000000003},"min":{"1min":0.50800000000000001,"5min":0.496,"15min":0.47099999999999997},"max":{"1min":0.89800000000000002,"5min":1.827,"15min":6.9299999999999997},"last":0.74099999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.91000000000000003,"5min":0.95499999999999996,"15min":3.125},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.66500000000000004},"min":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1850000000000001,"5min":2.577,"15min":4.8380000000000001},"last":0.58599999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68700000000000006,"15min":0.68100000000000005},"min":{"1min":0.441,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":1.0309999999999999,"5min":2.5169999999999999,"15min":4.1929999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.5,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":2.9590000000000001,"15min":3.6749999999999998},"last":0.628}]},{"osd":6,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0449999999999999,"5min":3.0019999999999998,"15min":4.0250000000000004},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72699999999999998,"15min":0.752},"min":{"1min":0.498,"5min":0.47399999999999998,"15min":0.44700000000000001},"max":{"1min":1.0740000000000001,"5min":2.4039999999999999,"15min":7.0259999999999998},"last":0.69799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575040,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302632,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069208,"statfs":{"total":96636764160,"available":96326868992,"internally_reserved":0,"allocated":1277952,"data_stored":619503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68799999999999994,"15min":0.71399999999999997},"min":{"1min":0.47599999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86899999999999999,"5min":0.97899999999999998,"15min":1.022},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66700000000000004,"15min":0.70199999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.36599999999999999},"max":{"1min":0.72999999999999998,"5min":0.93899999999999995,"15min":1.079},"last":0.93200000000000005}]},{"osd":1,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.68799999999999994,"15min":0.71999999999999997},"min":{"1min":0.48199999999999998,"5min":0.45500000000000002,"15min":0.42799999999999999},"max":{"1min":0.76700000000000002,"5min":1.135,"15min":1.135},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68799999999999994,"15min":0.72499999999999998},"min":{"1min":0.47799999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81699999999999995,"5min":1.0109999999999999,"15min":1.034},"last":0.95299999999999996}]},{"osd":2,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.69999999999999996,"15min":0.73199999999999998},"min":{"1min":0.52300000000000002,"5min":0.49199999999999999,"15min":0.42599999999999999},"max":{"1min":0.86099999999999999,"5min":1.391,"15min":1.391},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.68799999999999994,"15min":0.73099999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90500000000000003,"5min":0.91000000000000003,"15min":1.0900000000000001},"last":0.73199999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66700000000000004,"15min":0.69899999999999995},"min":{"1min":0.502,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.81899999999999995,"5min":0.91700000000000004,"15min":1.046},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.72899999999999998,"15min":0.753},"min":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.497},"max":{"1min":0.82999999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.61099999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61399999999999999,"15min":0.621},"min":{"1min":0.38,"5min":0.38,"15min":0.377},"max":{"1min":0.84699999999999998,"5min":1.768,"15min":1.768},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.36199999999999999},"max":{"1min":0.84399999999999997,"5min":1.601,"15min":1.601},"last":0.98399999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65500000000000003,"15min":0.65200000000000002},"min":{"1min":0.53100000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84099999999999997,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.42299999999999999},"max":{"1min":0.86699999999999999,"5min":0.94699999999999995,"15min":1.0669999999999999},"last":1.004}]},{"osd":7,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66900000000000004,"15min":0.67600000000000005},"min":{"1min":0.55600000000000005,"5min":0.42899999999999999,"15min":0.41799999999999998},"max":{"1min":0.95999999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.026},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56499999999999995,"5min":0.44600000000000001,"15min":0.42399999999999999},"max":{"1min":0.89600000000000002,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.86799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575042,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302680,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069160,"statfs":{"total":96636764160,"available":96326819840,"internally_reserved":0,"allocated":1327104,"data_stored":640187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.45600000000000002,"15min":0.45900000000000002},"min":{"1min":0.26600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48699999999999999,"15min":0.48499999999999999},"min":{"1min":0.313,"5min":0.29399999999999998,"15min":0.23699999999999999},"max":{"1min":1.1879999999999999,"5min":1.23,"15min":1.23},"last":0.56200000000000006}]},{"osd":2,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48299999999999998,"15min":0.495},"min":{"1min":0.34799999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.67700000000000005,"5min":1.169,"15min":1.169},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.3500000000000001,"5min":3.077,"15min":3.077},"last":0.58599999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.34100000000000003},"max":{"1min":1.6839999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.36099999999999999,"5min":0.34899999999999998,"15min":0.34100000000000003},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.60499999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.71999999999999997,"15min":0.75700000000000001},"min":{"1min":0.46700000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.995,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.745}]},{"osd":5,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.57699999999999996,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.74299999999999999,"15min":0.77900000000000003},"min":{"1min":0.52100000000000002,"5min":0.497,"15min":0.47999999999999998},"max":{"1min":1.0209999999999999,"5min":1.637,"15min":1.637},"last":0.79800000000000004}]},{"osd":6,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.78000000000000003,"15min":0.79600000000000004},"min":{"1min":0.55600000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77600000000000002,"15min":0.79800000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.86899999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.81999999999999995,"15min":0.82799999999999996},"min":{"1min":0.54400000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.4350000000000001,"5min":3.4350000000000001,"15min":3.4350000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77600000000000002,"15min":0.81899999999999995},"min":{"1min":0.51400000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1200000000000001,"5min":1.125,"15min":1.1970000000000001},"last":0.71799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575041,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299156,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072684,"statfs":{"total":96636764160,"available":96330428416,"internally_reserved":0,"allocated":1912832,"data_stored":1230395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.29299999999999998,"5min":0.27100000000000002,"15min":0.23000000000000001},"max":{"1min":0.623,"5min":0.85799999999999998,"15min":1.2729999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.28899999999999998},"max":{"1min":0.60399999999999998,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.63400000000000001,"5min":4.6980000000000004,"15min":4.6980000000000004},"last":0.436},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48999999999999999,"15min":0.497},"min":{"1min":0.34000000000000002,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.71799999999999997,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.41999999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":0.63800000000000001,"5min":1.2450000000000001,"15min":1.7130000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.441,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":0.70199999999999996,"5min":4.734,"15min":4.734},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.52900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99199999999999999,"5min":1.2270000000000001,"15min":1.752},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.50700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.91500000000000004,"5min":4.6619999999999999,"15min":4.6619999999999999},"last":0.79600000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.53700000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0049999999999999,"5min":1.1890000000000001,"15min":1.2769999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.58699999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90300000000000002,"5min":1.2809999999999999,"15min":1.7889999999999999},"last":0.69399999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.80500000000000005,"15min":0.81299999999999994},"min":{"1min":0.56499999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97299999999999998,"5min":4.6239999999999997,"15min":4.6239999999999997},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79300000000000004,"15min":0.80100000000000005},"min":{"1min":0.55600000000000005,"5min":0.50800000000000001,"15min":0.47999999999999998},"max":{"1min":0.96499999999999997,"5min":1.2689999999999999,"15min":1.4370000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.82499999999999996,"15min":0.83199999999999996},"min":{"1min":0.56299999999999994,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.042,"5min":1.256,"15min":1.518},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.621,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95599999999999996,"5min":1.702,"15min":1.8200000000000001},"last":0.81200000000000006}]}]},{"osd":2,"up_from":13,"seq":55834575041,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306768,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065072,"statfs":{"total":96636764160,"available":96322633728,"internally_reserved":0,"allocated":1318912,"data_stored":640547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.46800000000000003,"15min":0.45400000000000001},"min":{"1min":0.28299999999999997,"5min":0.26500000000000001,"15min":0.25900000000000001},"max":{"1min":0.76700000000000002,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.48999999999999999,"15min":0.495},"min":{"1min":0.30599999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.55300000000000005,"5min":1.633,"15min":1.633},"last":0.41799999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46400000000000002,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71599999999999997,"5min":1.097,"15min":1.865},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.79700000000000004,"5min":1.2689999999999999,"15min":1.79},"last":0.39100000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.58899999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.35799999999999998},"max":{"1min":0.82599999999999996,"5min":0.86699999999999999,"15min":1.8999999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.47399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70299999999999996,"5min":1.1890000000000001,"15min":1.8220000000000001},"last":0.49399999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":0.85799999999999998,"5min":1.2430000000000001,"15min":1.256},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.55000000000000004,"5min":0.45900000000000002,"15min":0.44800000000000001},"max":{"1min":0.91400000000000003,"5min":1.696,"15min":1.696},"last":0.96399999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.753,"15min":0.76800000000000002},"min":{"1min":0.505,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85199999999999998,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.143},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.503},"max":{"1min":0.83199999999999996,"5min":1.218,"15min":1.3440000000000001},"last":0.81799999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.54000000000000004,"5min":0.51000000000000001,"15min":0.48599999999999999},"max":{"1min":0.94899999999999995,"5min":1.768,"15min":1.768},"last":1.069},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.76400000000000001,"15min":0.79000000000000004},"min":{"1min":0.56599999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92900000000000005,"5min":1.3580000000000001,"15min":1.5309999999999999},"last":1.101}]},{"osd":7,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.61799999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97799999999999998,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.875},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.58699999999999997,"5min":0.57599999999999996,"15min":0.50900000000000001},"max":{"1min":0.92000000000000004,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.0209999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575042,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306776,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065064,"statfs":{"total":96636764160,"available":96322625536,"internally_reserved":0,"allocated":1327104,"data_stored":641529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.29599999999999999,"5min":0.29499999999999998,"15min":0.24099999999999999},"max":{"1min":0.86299999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.47899999999999998,"15min":0.48799999999999999},"min":{"1min":0.315,"5min":0.30199999999999999,"15min":0.28100000000000003},"max":{"1min":0.63600000000000001,"5min":1.228,"15min":1.228},"last":0.42599999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.48099999999999998,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58699999999999997,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.44500000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94099999999999995,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64800000000000002,"15min":0.63300000000000001},"min":{"1min":0.44400000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.97699999999999998,"5min":3.8900000000000001,"15min":3.8900000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.51100000000000001,"5min":0.48299999999999998,"15min":0.40799999999999997},"max":{"1min":0.76500000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.81000000000000005,"15min":0.82299999999999995},"min":{"1min":0.623,"5min":0.59399999999999997,"15min":0.52200000000000002},"max":{"1min":1.0189999999999999,"5min":1.22,"15min":1.22},"last":0.755}]},{"osd":5,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.45000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.86199999999999999,"5min":1.3360000000000001,"15min":2.1549999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.56399999999999995,"5min":0.55900000000000005,"15min":0.50600000000000001},"max":{"1min":1.0569999999999999,"5min":1.1639999999999999,"15min":1.419},"last":0.66800000000000004}]},{"osd":6,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.51700000000000002},"max":{"1min":0.875,"5min":1.304,"15min":1.304},"last":0.63},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95199999999999996,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91100000000000003,"5min":1.8180000000000001,"15min":2.0880000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.80800000000000005,"15min":0.82099999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92300000000000004,"5min":1.486,"15min":1.486},"last":0.71199999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575041,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310860,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060980,"statfs":{"total":96636764160,"available":96318443520,"internally_reserved":0,"allocated":1314816,"data_stored":639993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71399999999999997,"15min":0.70399999999999996},"min":{"1min":0.45000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79200000000000004,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.72799999999999998,"15min":0.72299999999999998},"min":{"1min":0.50900000000000001,"5min":0.42699999999999999,"15min":0.39300000000000002},"max":{"1min":0.97399999999999998,"5min":2.8130000000000002,"15min":3.23},"last":0.51000000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71899999999999997,"15min":0.71099999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.373},"max":{"1min":0.85699999999999998,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.53000000000000003,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.86499999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.71799999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.755,"15min":0.75700000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.38100000000000001},"max":{"1min":0.92900000000000005,"5min":2.5960000000000001,"15min":3.7509999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.48299999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90000000000000002,"5min":2.427,"15min":2.427},"last":0.68000000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.755,"15min":0.751},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.434},"max":{"1min":0.89700000000000002,"5min":2.6440000000000001,"15min":3.6970000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.77000000000000002,"15min":0.747},"min":{"1min":0.443,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":3.6899999999999999,"15min":3.6899999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63600000000000001,"15min":0.60899999999999999},"min":{"1min":0.379,"5min":0.317,"15min":0.317},"max":{"1min":0.84899999999999998,"5min":3.3860000000000001,"15min":3.4780000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.68999999999999995,"15min":0.65800000000000003},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.34999999999999998},"max":{"1min":0.91200000000000003,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.61899999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67100000000000004,"15min":0.64000000000000001},"min":{"1min":0.47699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82299999999999995,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.71499999999999997,"15min":0.67900000000000005},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.374},"max":{"1min":0.89100000000000001,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.82299999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.49299999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.96599999999999997,"5min":2.7210000000000001,"15min":3.2789999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.76900000000000002},"min":{"1min":0.56499999999999995,"5min":0.439,"15min":0.439},"max":{"1min":0.93600000000000005,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.752}]}]},{"osd":5,"up_from":13,"seq":55834575041,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302632,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069208,"statfs":{"total":96636764160,"available":96326868992,"internally_reserved":0,"allocated":1277952,"data_stored":619503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67600000000000005,"15min":0.69699999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.72299999999999998,"5min":0.93600000000000005,"15min":1.655},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65700000000000003,"15min":0.68400000000000005},"min":{"1min":0.42899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78200000000000003,"5min":1.0269999999999999,"15min":1.1359999999999999},"last":0.57999999999999996}]},{"osd":1,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71699999999999997,"5min":0.96899999999999997,"15min":2.4159999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.45400000000000001,"5min":0.44,"15min":0.40400000000000003},"max":{"1min":0.89100000000000001,"5min":0.95099999999999996,"15min":1.706},"last":0.60999999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69699999999999995,"15min":0.72799999999999998},"min":{"1min":0.501,"5min":0.48499999999999999,"15min":0.42999999999999999},"max":{"1min":0.75800000000000001,"5min":0.997,"15min":1.79},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69699999999999995,"15min":0.71599999999999997},"min":{"1min":0.49199999999999999,"5min":0.46500000000000002,"15min":0.442},"max":{"1min":0.752,"5min":1.006,"15min":2.4889999999999999},"last":0.46200000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68999999999999995,"15min":0.71699999999999997},"min":{"1min":0.46899999999999997,"5min":0.438,"15min":0.435},"max":{"1min":0.88600000000000001,"5min":1.0209999999999999,"15min":1.409},"last":0.629},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73899999999999999,"15min":0.76900000000000002},"min":{"1min":0.56200000000000006,"5min":0.501,"15min":0.501},"max":{"1min":0.78600000000000003,"5min":0.95699999999999996,"15min":2.532},"last":0.64400000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":1.766},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.622,"15min":0.621},"min":{"1min":0.48599999999999999,"5min":0.377,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":1.052,"15min":2.7829999999999999},"last":0.39600000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.45100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82899999999999996,"5min":1.018,"15min":2.5739999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.40000000000000002,"15min":0.38900000000000001},"max":{"1min":0.84099999999999997,"5min":0.97999999999999998,"15min":1.8080000000000001},"last":0.41199999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.90700000000000003,"5min":1.175,"15min":2.9609999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.60499999999999998,"5min":0.498,"15min":0.45900000000000002},"max":{"1min":0.876,"5min":1.139,"15min":2.613},"last":0.68899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:58:48.585 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:58:48.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.798+0000 7f73b7fff700 1 Processor -- start 2023-10-09T06:58:48.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.798+0000 7f73b7fff700 1 -- start start 2023-10-09T06:58:48.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.799+0000 7f73b7fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f73b8142ea0 0x7f73b80b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:48.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.799+0000 7f73b7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73b806c0f0 0x7f73b806a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:48.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.799+0000 7f73b7fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b80b40f0 con 0x7f73b80ad870 2023-10-09T06:58:48.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.799+0000 7f73b7fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b8069640 con 0x7f73b8142ea0 2023-10-09T06:58:48.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.799+0000 7f73b7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b8069920 con 0x7f73b806c0f0 2023-10-09T06:58:48.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.800+0000 7f73b67fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f73b80ad870 0x7f73b806b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56914/0 (socket says 172.21.15.71:56914) 2023-10-09T06:58:48.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.800+0000 7f73b67fc700 1 -- 172.21.15.71:0/4085723908 learned_addr learned my addr 172.21.15.71:0/4085723908 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:48.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.800+0000 7f73b6ffd700 1 --2- 172.21.15.71:0/4085723908 >> v2:172.21.15.179:3300/0 conn(0x7f73b8142ea0 0x7f73b80b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:48.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.800+0000 7f73b77fe700 1 --2- 172.21.15.71:0/4085723908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73b806c0f0 0x7f73b806a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:48.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.800+0000 7f73b5ffb700 1 -- 172.21.15.71:0/4085723908 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196184523 0 0) 0x7f73b80b40f0 con 0x7f73b80ad870 2023-10-09T06:58:48.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.800+0000 7f73b5ffb700 1 -- 172.21.15.71:0/4085723908 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73a0003570 con 0x7f73b80ad870 2023-10-09T06:58:48.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.800+0000 7f73b5ffb700 1 -- 172.21.15.71:0/4085723908 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 763624970 0 0) 0x7f73a0003570 con 0x7f73b80ad870 2023-10-09T06:58:48.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.800+0000 7f73b6ffd700 1 -- 172.21.15.71:0/4085723908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73b806c0f0 msgr2=0x7f73b806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:48.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.800+0000 7f73b6ffd700 1 --2- 172.21.15.71:0/4085723908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73b806c0f0 0x7f73b806a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:48.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.800+0000 7f73b6ffd700 1 -- 172.21.15.71:0/4085723908 >> v1:172.21.15.71:6789/0 conn(0x7f73b80ad870 legacy=0x7f73b806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:48.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.800+0000 7f73b6ffd700 1 -- 172.21.15.71:0/4085723908 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b8069c00 con 0x7f73b8142ea0 2023-10-09T06:58:48.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.801+0000 7f73b6ffd700 1 --2- 172.21.15.71:0/4085723908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b8142ea0 0x7f73b80b3630 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f73a80098e0 tx=0x7f73a80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0910d8863ddd753 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:48.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.801+0000 7f73b5ffb700 1 -- 172.21.15.71:0/4085723908 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ac001470 con 0x7f73b8142ea0 2023-10-09T06:58:48.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.801+0000 7f73b5ffb700 1 -- 172.21.15.71:0/4085723908 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a8011420 con 0x7f73b8142ea0 2023-10-09T06:58:48.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.801+0000 7f73b5ffb700 1 -- 172.21.15.71:0/4085723908 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a80117c0 con 0x7f73b8142ea0 2023-10-09T06:58:48.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.802+0000 7f73b7fff700 1 -- 172.21.15.71:0/4085723908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b8142ea0 msgr2=0x7f73b80b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:48.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.802+0000 7f73b7fff700 1 --2- 172.21.15.71:0/4085723908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b8142ea0 0x7f73b80b3630 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f73a80098e0 tx=0x7f73a80091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:48.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.802+0000 7f73b7fff700 1 -- 172.21.15.71:0/4085723908 shutdown_connections 2023-10-09T06:58:48.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.802+0000 7f73b7fff700 1 --2- 172.21.15.71:0/4085723908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73b806c0f0 0x7f73b806a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:48.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.802+0000 7f73b7fff700 1 --2- 172.21.15.71:0/4085723908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b8142ea0 0x7f73b80b3630 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:48.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.802+0000 7f73b7fff700 1 -- 172.21.15.71:0/4085723908 >> 172.21.15.71:0/4085723908 conn(0x7f73b80ce430 msgr2=0x7f73b80ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:48.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.802+0000 7f73b7fff700 1 -- 172.21.15.71:0/4085723908 shutdown_connections 2023-10-09T06:58:48.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.802+0000 7f73b7fff700 1 -- 172.21.15.71:0/4085723908 wait complete. 2023-10-09T06:58:48.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.803+0000 7f73b7fff700 1 Processor -- start 2023-10-09T06:58:48.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.803+0000 7f73b7fff700 1 -- start start 2023-10-09T06:58:48.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.804+0000 7f73b7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73b806c0f0 0x7f73b815e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:48.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.804+0000 7f73b7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73b8142ea0 0x7f73b8169ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:48.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.804+0000 7f73b7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b80b0220 0x7f73b8159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:48.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.804+0000 7f73b7fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b816a1e0 con 0x7f73b8142ea0 2023-10-09T06:58:48.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.804+0000 7f73b7fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b816a440 con 0x7f73b80b0220 2023-10-09T06:58:48.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.804+0000 7f73b7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b816a720 con 0x7f73b806c0f0 2023-10-09T06:58:48.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.804+0000 7f73b67fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73b8142ea0 0x7f73b8169ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:48.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.804+0000 7f73b67fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73b8142ea0 0x7f73b8169ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36712/0 (socket says 172.21.15.71:36712) 2023-10-09T06:58:48.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.804+0000 7f73b67fc700 1 -- 172.21.15.71:0/3372001297 learned_addr learned my addr 172.21.15.71:0/3372001297 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:48.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.804+0000 7f73b77fe700 1 --2- 172.21.15.71:0/3372001297 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b80b0220 0x7f73b8159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:48.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.805+0000 7f73b6ffd700 1 --2- 172.21.15.71:0/3372001297 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73b806c0f0 0x7f73b815e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:48.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.805+0000 7f73b67fc700 1 -- 172.21.15.71:0/3372001297 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73b806c0f0 msgr2=0x7f73b815e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:48.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.805+0000 7f73b67fc700 1 --2- 172.21.15.71:0/3372001297 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73b806c0f0 0x7f73b815e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:48.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.805+0000 7f73b67fc700 1 -- 172.21.15.71:0/3372001297 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b80b0220 msgr2=0x7f73b8159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:48.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.805+0000 7f73b67fc700 1 --2- 172.21.15.71:0/3372001297 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b80b0220 0x7f73b8159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:48.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.805+0000 7f73b67fc700 1 -- 172.21.15.71:0/3372001297 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a8009420 con 0x7f73b8142ea0 2023-10-09T06:58:48.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.805+0000 7f73b67fc700 1 --2- 172.21.15.71:0/3372001297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73b8142ea0 0x7f73b8169ca0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00cb90 tx=0x7f73ac001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:48.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.805+0000 7f739effd700 1 -- 172.21.15.71:0/3372001297 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ac005b30 con 0x7f73b8142ea0 2023-10-09T06:58:48.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.805+0000 7f739effd700 1 -- 172.21.15.71:0/3372001297 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ac005cb0 con 0x7f73b8142ea0 2023-10-09T06:58:48.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.805+0000 7f739effd700 1 -- 172.21.15.71:0/3372001297 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ac007340 con 0x7f73b8142ea0 2023-10-09T06:58:48.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.805+0000 7f73b7fff700 1 -- 172.21.15.71:0/3372001297 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b816aa00 con 0x7f73b8142ea0 2023-10-09T06:58:48.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.805+0000 7f73b7fff700 1 -- 172.21.15.71:0/3372001297 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b816d510 con 0x7f73b8142ea0 2023-10-09T06:58:48.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.806+0000 7f73b7fff700 1 -- 172.21.15.71:0/3372001297 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b80b3da0 con 0x7f73b8142ea0 2023-10-09T06:58:48.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.807+0000 7f739effd700 1 -- 172.21.15.71:0/3372001297 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73ac00a5d0 con 0x7f73b8142ea0 2023-10-09T06:58:48.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.808+0000 7f739effd700 1 --2- 172.21.15.71:0/3372001297 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f73a4066f30 0x7f73a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:48.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.808+0000 7f739effd700 1 -- 172.21.15.71:0/3372001297 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f73ac0843f0 con 0x7f73b8142ea0 2023-10-09T06:58:48.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.809+0000 7f73b6ffd700 1 --2- 172.21.15.71:0/3372001297 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f73a4066f30 0x7f73a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:48.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.809+0000 7f73b6ffd700 1 --2- 172.21.15.71:0/3372001297 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f73a4066f30 0x7f73a40693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f73a80030c0 tx=0x7f73a8016000 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:48.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:48.812+0000 7f739effd700 1 -- 172.21.15.71:0/3372001297 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f73ac051550 con 0x7f73b8142ea0 2023-10-09T06:58:49.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.000+0000 7f73b7fff700 1 -- 172.21.15.71:0/3372001297 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f73b816d730 con 0x7f73a4066f30 2023-10-09T06:58:49.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.009+0000 7f739effd700 1 -- 172.21.15.71:0/3372001297 <== mgr.6718 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285098 (secure 0 0 0) 0x7f73b816d730 con 0x7f73a4066f30 2023-10-09T06:58:49.013 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:49.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.013+0000 7f73b7fff700 1 -- 172.21.15.71:0/3372001297 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f73a4066f30 msgr2=0x7f73a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:49.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.013+0000 7f73b7fff700 1 --2- 172.21.15.71:0/3372001297 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f73a4066f30 0x7f73a40693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f73a80030c0 tx=0x7f73a8016000 comp rx=0 tx=0).stop 2023-10-09T06:58:49.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.013+0000 7f73b7fff700 1 -- 172.21.15.71:0/3372001297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73b8142ea0 msgr2=0x7f73b8169ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:49.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.013+0000 7f73b7fff700 1 --2- 172.21.15.71:0/3372001297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73b8142ea0 0x7f73b8169ca0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00cb90 tx=0x7f73ac001aa0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.013+0000 7f73b7fff700 1 -- 172.21.15.71:0/3372001297 shutdown_connections 2023-10-09T06:58:49.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.013+0000 7f73b7fff700 1 --2- 172.21.15.71:0/3372001297 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b80b0220 0x7f73b8159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.013+0000 7f73b7fff700 1 --2- 172.21.15.71:0/3372001297 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73b806c0f0 0x7f73b815e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.013+0000 7f73b7fff700 1 --2- 172.21.15.71:0/3372001297 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f73a4066f30 0x7f73a40693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.013+0000 7f73b7fff700 1 --2- 172.21.15.71:0/3372001297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73b8142ea0 0x7f73b8169ca0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.013+0000 7f73b7fff700 1 -- 172.21.15.71:0/3372001297 >> 172.21.15.71:0/3372001297 conn(0x7f73b80ce430 msgr2=0x7f73b8141de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:49.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.013+0000 7f73b7fff700 1 -- 172.21.15.71:0/3372001297 shutdown_connections 2023-10-09T06:58:49.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.013+0000 7f73b7fff700 1 -- 172.21.15.71:0/3372001297 wait complete. 2023-10-09T06:58:49.017 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:58:49.031 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T06:58:47.972713+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":347,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":140,"acting":140,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434704,"kb_used_data":11344,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752540016,"statfs":{"total":773094113280,"available":770600976384,"internally_reserved":0,"allocated":11616256,"data_stored":6235331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.739652"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.800454+0000","last_change":"2023-10-09T06:58:43.799501+0000","last_active":"2023-10-09T06:58:43.800454+0000","last_peered":"2023-10-09T06:58:43.800454+0000","last_clean":"2023-10-09T06:58:43.800454+0000","last_became_active":"2023-10-09T06:58:43.799241+0000","last_became_peered":"2023-10-09T06:58:43.799241+0000","last_unstale":"2023-10-09T06:58:43.800454+0000","last_undegraded":"2023-10-09T06:58:43.800454+0000","last_fullsized":"2023-10-09T06:58:43.800454+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:11.893055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796119+0000","last_change":"2023-10-09T06:58:43.794396+0000","last_active":"2023-10-09T06:58:43.796119+0000","last_peered":"2023-10-09T06:58:43.796119+0000","last_clean":"2023-10-09T06:58:43.796119+0000","last_became_active":"2023-10-09T06:58:43.794124+0000","last_became_peered":"2023-10-09T06:58:43.794124+0000","last_unstale":"2023-10-09T06:58:43.796119+0000","last_undegraded":"2023-10-09T06:58:43.796119+0000","last_fullsized":"2023-10-09T06:58:43.796119+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:26:49.171285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796255+0000","last_change":"2023-10-09T06:58:43.791324+0000","last_active":"2023-10-09T06:58:43.796255+0000","last_peered":"2023-10-09T06:58:43.796255+0000","last_clean":"2023-10-09T06:58:43.796255+0000","last_became_active":"2023-10-09T06:58:43.790853+0000","last_became_peered":"2023-10-09T06:58:43.790853+0000","last_unstale":"2023-10-09T06:58:43.796255+0000","last_undegraded":"2023-10-09T06:58:43.796255+0000","last_fullsized":"2023-10-09T06:58:43.796255+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:36.821271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.793084+0000","last_change":"2023-10-09T06:58:43.791927+0000","last_active":"2023-10-09T06:58:43.793084+0000","last_peered":"2023-10-09T06:58:43.793084+0000","last_clean":"2023-10-09T06:58:43.793084+0000","last_became_active":"2023-10-09T06:58:43.791694+0000","last_became_peered":"2023-10-09T06:58:43.791694+0000","last_unstale":"2023-10-09T06:58:43.793084+0000","last_undegraded":"2023-10-09T06:58:43.793084+0000","last_fullsized":"2023-10-09T06:58:43.793084+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:41:21.133593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.794464+0000","last_change":"2023-10-09T06:58:43.790416+0000","last_active":"2023-10-09T06:58:43.794464+0000","last_peered":"2023-10-09T06:58:43.794464+0000","last_clean":"2023-10-09T06:58:43.794464+0000","last_became_active":"2023-10-09T06:58:43.790148+0000","last_became_peered":"2023-10-09T06:58:43.790148+0000","last_unstale":"2023-10-09T06:58:43.794464+0000","last_undegraded":"2023-10-09T06:58:43.794464+0000","last_fullsized":"2023-10-09T06:58:43.794464+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:26.456449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.794813+0000","last_change":"2023-10-09T06:58:43.793638+0000","last_active":"2023-10-09T06:58:43.794813+0000","last_peered":"2023-10-09T06:58:43.794813+0000","last_clean":"2023-10-09T06:58:43.794813+0000","last_became_active":"2023-10-09T06:58:43.793289+0000","last_became_peered":"2023-10-09T06:58:43.793289+0000","last_unstale":"2023-10-09T06:58:43.794813+0000","last_undegraded":"2023-10-09T06:58:43.794813+0000","last_fullsized":"2023-10-09T06:58:43.794813+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:33.042437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792088+0000","last_change":"2023-10-09T06:58:43.789987+0000","last_active":"2023-10-09T06:58:43.792088+0000","last_peered":"2023-10-09T06:58:43.792088+0000","last_clean":"2023-10-09T06:58:43.792088+0000","last_became_active":"2023-10-09T06:58:43.789753+0000","last_became_peered":"2023-10-09T06:58:43.789753+0000","last_unstale":"2023-10-09T06:58:43.792088+0000","last_undegraded":"2023-10-09T06:58:43.792088+0000","last_fullsized":"2023-10-09T06:58:43.792088+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:55.083637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801028+0000","last_change":"2023-10-09T06:58:43.799220+0000","last_active":"2023-10-09T06:58:43.801028+0000","last_peered":"2023-10-09T06:58:43.801028+0000","last_clean":"2023-10-09T06:58:43.801028+0000","last_became_active":"2023-10-09T06:58:43.798948+0000","last_became_peered":"2023-10-09T06:58:43.798948+0000","last_unstale":"2023-10-09T06:58:43.801028+0000","last_undegraded":"2023-10-09T06:58:43.801028+0000","last_fullsized":"2023-10-09T06:58:43.801028+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:32.536328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798525+0000","last_change":"2023-10-09T06:58:43.793525+0000","last_active":"2023-10-09T06:58:43.798525+0000","last_peered":"2023-10-09T06:58:43.798525+0000","last_clean":"2023-10-09T06:58:43.798525+0000","last_became_active":"2023-10-09T06:58:43.793039+0000","last_became_peered":"2023-10-09T06:58:43.793039+0000","last_unstale":"2023-10-09T06:58:43.798525+0000","last_undegraded":"2023-10-09T06:58:43.798525+0000","last_fullsized":"2023-10-09T06:58:43.798525+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:10.429867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798108+0000","last_change":"2023-10-09T06:58:43.796846+0000","last_active":"2023-10-09T06:58:43.798108+0000","last_peered":"2023-10-09T06:58:43.798108+0000","last_clean":"2023-10-09T06:58:43.798108+0000","last_became_active":"2023-10-09T06:58:43.796598+0000","last_became_peered":"2023-10-09T06:58:43.796598+0000","last_unstale":"2023-10-09T06:58:43.798108+0000","last_undegraded":"2023-10-09T06:58:43.798108+0000","last_fullsized":"2023-10-09T06:58:43.798108+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:41:05.828751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792567+0000","last_change":"2023-10-09T06:58:43.788053+0000","last_active":"2023-10-09T06:58:43.792567+0000","last_peered":"2023-10-09T06:58:43.792567+0000","last_clean":"2023-10-09T06:58:43.792567+0000","last_became_active":"2023-10-09T06:58:43.787821+0000","last_became_peered":"2023-10-09T06:58:43.787821+0000","last_unstale":"2023-10-09T06:58:43.792567+0000","last_undegraded":"2023-10-09T06:58:43.792567+0000","last_fullsized":"2023-10-09T06:58:43.792567+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:49:56.178318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798095+0000","last_change":"2023-10-09T06:58:43.796626+0000","last_active":"2023-10-09T06:58:43.798095+0000","last_peered":"2023-10-09T06:58:43.798095+0000","last_clean":"2023-10-09T06:58:43.798095+0000","last_became_active":"2023-10-09T06:58:43.796232+0000","last_became_peered":"2023-10-09T06:58:43.796232+0000","last_unstale":"2023-10-09T06:58:43.798095+0000","last_undegraded":"2023-10-09T06:58:43.798095+0000","last_fullsized":"2023-10-09T06:58:43.798095+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:45.689229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.791208+0000","last_change":"2023-10-09T06:58:43.788457+0000","last_active":"2023-10-09T06:58:43.791208+0000","last_peered":"2023-10-09T06:58:43.791208+0000","last_clean":"2023-10-09T06:58:43.791208+0000","last_became_active":"2023-10-09T06:58:43.788206+0000","last_became_peered":"2023-10-09T06:58:43.788206+0000","last_unstale":"2023-10-09T06:58:43.791208+0000","last_undegraded":"2023-10-09T06:58:43.791208+0000","last_fullsized":"2023-10-09T06:58:43.791208+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:54:13.880490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.794533+0000","last_change":"2023-10-09T06:58:43.791344+0000","last_active":"2023-10-09T06:58:43.794533+0000","last_peered":"2023-10-09T06:58:43.794533+0000","last_clean":"2023-10-09T06:58:43.794533+0000","last_became_active":"2023-10-09T06:58:43.790302+0000","last_became_peered":"2023-10-09T06:58:43.790302+0000","last_unstale":"2023-10-09T06:58:43.794533+0000","last_undegraded":"2023-10-09T06:58:43.794533+0000","last_fullsized":"2023-10-09T06:58:43.794533+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:09.624621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.791090+0000","last_change":"2023-10-09T06:58:43.787561+0000","last_active":"2023-10-09T06:58:43.791090+0000","last_peered":"2023-10-09T06:58:43.791090+0000","last_clean":"2023-10-09T06:58:43.791090+0000","last_became_active":"2023-10-09T06:58:43.787294+0000","last_became_peered":"2023-10-09T06:58:43.787294+0000","last_unstale":"2023-10-09T06:58:43.791090+0000","last_undegraded":"2023-10-09T06:58:43.791090+0000","last_fullsized":"2023-10-09T06:58:43.791090+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:15.783097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.800940+0000","last_change":"2023-10-09T06:58:43.799680+0000","last_active":"2023-10-09T06:58:43.800940+0000","last_peered":"2023-10-09T06:58:43.800940+0000","last_clean":"2023-10-09T06:58:43.800940+0000","last_became_active":"2023-10-09T06:58:43.798445+0000","last_became_peered":"2023-10-09T06:58:43.798445+0000","last_unstale":"2023-10-09T06:58:43.800940+0000","last_undegraded":"2023-10-09T06:58:43.800940+0000","last_fullsized":"2023-10-09T06:58:43.800940+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:18.050283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796612+0000","last_change":"2023-10-09T06:58:43.793097+0000","last_active":"2023-10-09T06:58:43.796612+0000","last_peered":"2023-10-09T06:58:43.796612+0000","last_clean":"2023-10-09T06:58:43.796612+0000","last_became_active":"2023-10-09T06:58:43.791977+0000","last_became_peered":"2023-10-09T06:58:43.791977+0000","last_unstale":"2023-10-09T06:58:43.796612+0000","last_undegraded":"2023-10-09T06:58:43.796612+0000","last_fullsized":"2023-10-09T06:58:43.796612+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:57.183851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.791338+0000","last_change":"2023-10-09T06:58:43.786570+0000","last_active":"2023-10-09T06:58:43.791338+0000","last_peered":"2023-10-09T06:58:43.791338+0000","last_clean":"2023-10-09T06:58:43.791338+0000","last_became_active":"2023-10-09T06:58:43.786278+0000","last_became_peered":"2023-10-09T06:58:43.786278+0000","last_unstale":"2023-10-09T06:58:43.791338+0000","last_undegraded":"2023-10-09T06:58:43.791338+0000","last_fullsized":"2023-10-09T06:58:43.791338+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:20:14.106000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.797100+0000","last_change":"2023-10-09T06:58:43.793238+0000","last_active":"2023-10-09T06:58:43.797100+0000","last_peered":"2023-10-09T06:58:43.797100+0000","last_clean":"2023-10-09T06:58:43.797100+0000","last_became_active":"2023-10-09T06:58:43.792979+0000","last_became_peered":"2023-10-09T06:58:43.792979+0000","last_unstale":"2023-10-09T06:58:43.797100+0000","last_undegraded":"2023-10-09T06:58:43.797100+0000","last_fullsized":"2023-10-09T06:58:43.797100+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:16:08.167149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796387+0000","last_change":"2023-10-09T06:58:43.793047+0000","last_active":"2023-10-09T06:58:43.796387+0000","last_peered":"2023-10-09T06:58:43.796387+0000","last_clean":"2023-10-09T06:58:43.796387+0000","last_became_active":"2023-10-09T06:58:43.792478+0000","last_became_peered":"2023-10-09T06:58:43.792478+0000","last_unstale":"2023-10-09T06:58:43.796387+0000","last_undegraded":"2023-10-09T06:58:43.796387+0000","last_fullsized":"2023-10-09T06:58:43.796387+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:20.771196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.799503+0000","last_change":"2023-10-09T06:58:43.796883+0000","last_active":"2023-10-09T06:58:43.799503+0000","last_peered":"2023-10-09T06:58:43.799503+0000","last_clean":"2023-10-09T06:58:43.799503+0000","last_became_active":"2023-10-09T06:58:43.796610+0000","last_became_peered":"2023-10-09T06:58:43.796610+0000","last_unstale":"2023-10-09T06:58:43.799503+0000","last_undegraded":"2023-10-09T06:58:43.799503+0000","last_fullsized":"2023-10-09T06:58:43.799503+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:39.554977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.240443+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:46:58.364775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.262810+0000","last_change":"2023-10-09T06:58:43.252052+0000","last_active":"2023-10-09T06:58:44.262810+0000","last_peered":"2023-10-09T06:58:44.262810+0000","last_clean":"2023-10-09T06:58:44.262810+0000","last_became_active":"2023-10-09T06:58:43.251738+0000","last_became_peered":"2023-10-09T06:58:43.251738+0000","last_unstale":"2023-10-09T06:58:44.262810+0000","last_undegraded":"2023-10-09T06:58:44.262810+0000","last_fullsized":"2023-10-09T06:58:44.262810+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:45:42.343993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.260847+0000","last_change":"2023-10-09T06:58:43.252945+0000","last_active":"2023-10-09T06:58:44.260847+0000","last_peered":"2023-10-09T06:58:44.260847+0000","last_clean":"2023-10-09T06:58:44.260847+0000","last_became_active":"2023-10-09T06:58:43.252616+0000","last_became_peered":"2023-10-09T06:58:43.252616+0000","last_unstale":"2023-10-09T06:58:44.260847+0000","last_undegraded":"2023-10-09T06:58:44.260847+0000","last_fullsized":"2023-10-09T06:58:44.260847+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:43:21.232774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.261335+0000","last_change":"2023-10-09T06:58:43.248945+0000","last_active":"2023-10-09T06:58:44.261335+0000","last_peered":"2023-10-09T06:58:44.261335+0000","last_clean":"2023-10-09T06:58:44.261335+0000","last_became_active":"2023-10-09T06:58:43.248676+0000","last_became_peered":"2023-10-09T06:58:43.248676+0000","last_unstale":"2023-10-09T06:58:44.261335+0000","last_undegraded":"2023-10-09T06:58:44.261335+0000","last_fullsized":"2023-10-09T06:58:44.261335+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:39:35.477143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.797144+0000","last_change":"2023-10-09T06:58:43.793238+0000","last_active":"2023-10-09T06:58:43.797144+0000","last_peered":"2023-10-09T06:58:43.797144+0000","last_clean":"2023-10-09T06:58:43.797144+0000","last_became_active":"2023-10-09T06:58:43.792972+0000","last_became_peered":"2023-10-09T06:58:43.792972+0000","last_unstale":"2023-10-09T06:58:43.797144+0000","last_undegraded":"2023-10-09T06:58:43.797144+0000","last_fullsized":"2023-10-09T06:58:43.797144+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:14.141466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.262947+0000","last_change":"2023-10-09T06:58:43.254364+0000","last_active":"2023-10-09T06:58:44.262947+0000","last_peered":"2023-10-09T06:58:44.262947+0000","last_clean":"2023-10-09T06:58:44.262947+0000","last_became_active":"2023-10-09T06:58:43.254116+0000","last_became_peered":"2023-10-09T06:58:43.254116+0000","last_unstale":"2023-10-09T06:58:44.262947+0000","last_undegraded":"2023-10-09T06:58:44.262947+0000","last_fullsized":"2023-10-09T06:58:44.262947+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:16:07.159805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798740+0000","last_change":"2023-10-09T06:58:43.794432+0000","last_active":"2023-10-09T06:58:43.798740+0000","last_peered":"2023-10-09T06:58:43.798740+0000","last_clean":"2023-10-09T06:58:43.798740+0000","last_became_active":"2023-10-09T06:58:43.794079+0000","last_became_peered":"2023-10-09T06:58:43.794079+0000","last_unstale":"2023-10-09T06:58:43.798740+0000","last_undegraded":"2023-10-09T06:58:43.798740+0000","last_fullsized":"2023-10-09T06:58:43.798740+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:50:22.439113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.262592+0000","last_change":"2023-10-09T06:58:43.255791+0000","last_active":"2023-10-09T06:58:44.262592+0000","last_peered":"2023-10-09T06:58:44.262592+0000","last_clean":"2023-10-09T06:58:44.262592+0000","last_became_active":"2023-10-09T06:58:43.255535+0000","last_became_peered":"2023-10-09T06:58:43.255535+0000","last_unstale":"2023-10-09T06:58:44.262592+0000","last_undegraded":"2023-10-09T06:58:44.262592+0000","last_fullsized":"2023-10-09T06:58:44.262592+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:46:58.364775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.780552+0000","last_change":"2023-10-09T06:58:43.244540+0000","last_active":"2023-10-09T06:58:43.780552+0000","last_peered":"2023-10-09T06:58:43.780552+0000","last_clean":"2023-10-09T06:58:43.780552+0000","last_became_active":"2023-10-09T06:58:43.244261+0000","last_became_peered":"2023-10-09T06:58:43.244261+0000","last_unstale":"2023-10-09T06:58:43.780552+0000","last_undegraded":"2023-10-09T06:58:43.780552+0000","last_fullsized":"2023-10-09T06:58:43.780552+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:56.176507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792065+0000","last_change":"2023-10-09T06:58:43.788475+0000","last_active":"2023-10-09T06:58:43.792065+0000","last_peered":"2023-10-09T06:58:43.792065+0000","last_clean":"2023-10-09T06:58:43.792065+0000","last_became_active":"2023-10-09T06:58:43.788225+0000","last_became_peered":"2023-10-09T06:58:43.788225+0000","last_unstale":"2023-10-09T06:58:43.792065+0000","last_undegraded":"2023-10-09T06:58:43.792065+0000","last_fullsized":"2023-10-09T06:58:43.792065+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:13:39.010325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779920+0000","last_change":"2023-10-09T06:58:43.251615+0000","last_active":"2023-10-09T06:58:43.779920+0000","last_peered":"2023-10-09T06:58:43.779920+0000","last_clean":"2023-10-09T06:58:43.779920+0000","last_became_active":"2023-10-09T06:58:43.250726+0000","last_became_peered":"2023-10-09T06:58:43.250726+0000","last_unstale":"2023-10-09T06:58:43.779920+0000","last_undegraded":"2023-10-09T06:58:43.779920+0000","last_fullsized":"2023-10-09T06:58:43.779920+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:26:48.163941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792119+0000","last_change":"2023-10-09T06:58:43.789342+0000","last_active":"2023-10-09T06:58:43.792119+0000","last_peered":"2023-10-09T06:58:43.792119+0000","last_clean":"2023-10-09T06:58:43.792119+0000","last_became_active":"2023-10-09T06:58:43.789085+0000","last_became_peered":"2023-10-09T06:58:43.789085+0000","last_unstale":"2023-10-09T06:58:43.792119+0000","last_undegraded":"2023-10-09T06:58:43.792119+0000","last_fullsized":"2023-10-09T06:58:43.792119+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:05:54.912313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.240034+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:53.286318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.238954+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:25.449105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.800375+0000","last_change":"2023-10-09T06:58:43.798126+0000","last_active":"2023-10-09T06:58:43.800375+0000","last_peered":"2023-10-09T06:58:43.800375+0000","last_clean":"2023-10-09T06:58:43.800375+0000","last_became_active":"2023-10-09T06:58:43.797884+0000","last_became_peered":"2023-10-09T06:58:43.797884+0000","last_unstale":"2023-10-09T06:58:43.800375+0000","last_undegraded":"2023-10-09T06:58:43.800375+0000","last_fullsized":"2023-10-09T06:58:43.800375+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:42:30.221135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.240065+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:13.134122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796573+0000","last_change":"2023-10-09T06:58:43.791013+0000","last_active":"2023-10-09T06:58:43.796573+0000","last_peered":"2023-10-09T06:58:43.796573+0000","last_clean":"2023-10-09T06:58:43.796573+0000","last_became_active":"2023-10-09T06:58:43.789697+0000","last_became_peered":"2023-10-09T06:58:43.789697+0000","last_unstale":"2023-10-09T06:58:43.796573+0000","last_undegraded":"2023-10-09T06:58:43.796573+0000","last_fullsized":"2023-10-09T06:58:43.796573+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:49.433121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.235537+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:17.947780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792408+0000","last_change":"2023-10-09T06:58:43.786500+0000","last_active":"2023-10-09T06:58:43.792408+0000","last_peered":"2023-10-09T06:58:43.792408+0000","last_clean":"2023-10-09T06:58:43.792408+0000","last_became_active":"2023-10-09T06:58:43.786244+0000","last_became_peered":"2023-10-09T06:58:43.786244+0000","last_unstale":"2023-10-09T06:58:43.792408+0000","last_undegraded":"2023-10-09T06:58:43.792408+0000","last_fullsized":"2023-10-09T06:58:43.792408+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:01.948441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.262408+0000","last_change":"2023-10-09T06:58:43.251369+0000","last_active":"2023-10-09T06:58:44.262408+0000","last_peered":"2023-10-09T06:58:44.262408+0000","last_clean":"2023-10-09T06:58:44.262408+0000","last_became_active":"2023-10-09T06:58:43.251090+0000","last_became_peered":"2023-10-09T06:58:43.251090+0000","last_unstale":"2023-10-09T06:58:44.262408+0000","last_undegraded":"2023-10-09T06:58:44.262408+0000","last_fullsized":"2023-10-09T06:58:44.262408+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:54:12.873146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.776377+0000","last_change":"2023-10-09T06:58:43.251912+0000","last_active":"2023-10-09T06:58:43.776377+0000","last_peered":"2023-10-09T06:58:43.776377+0000","last_clean":"2023-10-09T06:58:43.776377+0000","last_became_active":"2023-10-09T06:58:43.251661+0000","last_became_peered":"2023-10-09T06:58:43.251661+0000","last_unstale":"2023-10-09T06:58:43.776377+0000","last_undegraded":"2023-10-09T06:58:43.776377+0000","last_fullsized":"2023-10-09T06:58:43.776377+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:48.425777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.790274+0000","last_change":"2023-10-09T06:58:43.788503+0000","last_active":"2023-10-09T06:58:43.790274+0000","last_peered":"2023-10-09T06:58:43.790274+0000","last_clean":"2023-10-09T06:58:43.790274+0000","last_became_active":"2023-10-09T06:58:43.788263+0000","last_became_peered":"2023-10-09T06:58:43.788263+0000","last_unstale":"2023-10-09T06:58:43.790274+0000","last_undegraded":"2023-10-09T06:58:43.790274+0000","last_fullsized":"2023-10-09T06:58:43.790274+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:54.293662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.235578+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:46:31.472275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.799625+0000","last_change":"2023-10-09T06:58:43.797986+0000","last_active":"2023-10-09T06:58:43.799625+0000","last_peered":"2023-10-09T06:58:43.799625+0000","last_clean":"2023-10-09T06:58:43.799625+0000","last_became_active":"2023-10-09T06:58:43.797568+0000","last_became_peered":"2023-10-09T06:58:43.797568+0000","last_unstale":"2023-10-09T06:58:43.799625+0000","last_undegraded":"2023-10-09T06:58:43.799625+0000","last_fullsized":"2023-10-09T06:58:43.799625+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:29.985093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"106'8","reported_seq":18,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.263980+0000","last_change":"2023-10-09T06:58:43.253188+0000","last_active":"2023-10-09T06:58:44.263980+0000","last_peered":"2023-10-09T06:58:44.263980+0000","last_clean":"2023-10-09T06:58:44.263980+0000","last_became_active":"2023-10-09T06:58:43.252677+0000","last_became_peered":"2023-10-09T06:58:43.252677+0000","last_unstale":"2023-10-09T06:58:44.263980+0000","last_undegraded":"2023-10-09T06:58:44.263980+0000","last_fullsized":"2023-10-09T06:58:44.263980+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:33.706986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.239441+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:10.885711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.263780+0000","last_change":"2023-10-09T06:58:43.250800+0000","last_active":"2023-10-09T06:58:44.263780+0000","last_peered":"2023-10-09T06:58:44.263780+0000","last_clean":"2023-10-09T06:58:44.263780+0000","last_became_active":"2023-10-09T06:58:43.250529+0000","last_became_peered":"2023-10-09T06:58:43.250529+0000","last_unstale":"2023-10-09T06:58:44.263780+0000","last_undegraded":"2023-10-09T06:58:44.263780+0000","last_fullsized":"2023-10-09T06:58:44.263780+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:07.313495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796594+0000","last_change":"2023-10-09T06:58:43.791548+0000","last_active":"2023-10-09T06:58:43.796594+0000","last_peered":"2023-10-09T06:58:43.796594+0000","last_clean":"2023-10-09T06:58:43.796594+0000","last_became_active":"2023-10-09T06:58:43.790746+0000","last_became_peered":"2023-10-09T06:58:43.790746+0000","last_unstale":"2023-10-09T06:58:43.796594+0000","last_undegraded":"2023-10-09T06:58:43.796594+0000","last_fullsized":"2023-10-09T06:58:43.796594+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:37.545876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779490+0000","last_change":"2023-10-09T06:58:43.243471+0000","last_active":"2023-10-09T06:58:43.779490+0000","last_peered":"2023-10-09T06:58:43.779490+0000","last_clean":"2023-10-09T06:58:43.779490+0000","last_became_active":"2023-10-09T06:58:43.243230+0000","last_became_peered":"2023-10-09T06:58:43.243230+0000","last_unstale":"2023-10-09T06:58:43.779490+0000","last_undegraded":"2023-10-09T06:58:43.779490+0000","last_fullsized":"2023-10-09T06:58:43.779490+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:48.425777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796119+0000","last_change":"2023-10-09T06:58:43.794689+0000","last_active":"2023-10-09T06:58:43.796119+0000","last_peered":"2023-10-09T06:58:43.796119+0000","last_clean":"2023-10-09T06:58:43.796119+0000","last_became_active":"2023-10-09T06:58:43.793778+0000","last_became_peered":"2023-10-09T06:58:43.793778+0000","last_unstale":"2023-10-09T06:58:43.796119+0000","last_undegraded":"2023-10-09T06:58:43.796119+0000","last_fullsized":"2023-10-09T06:58:43.796119+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:22.993909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.261333+0000","last_change":"2023-10-09T06:58:43.252297+0000","last_active":"2023-10-09T06:58:44.261333+0000","last_peered":"2023-10-09T06:58:44.261333+0000","last_clean":"2023-10-09T06:58:44.261333+0000","last_became_active":"2023-10-09T06:58:43.252051+0000","last_became_peered":"2023-10-09T06:58:43.252051+0000","last_unstale":"2023-10-09T06:58:44.261333+0000","last_undegraded":"2023-10-09T06:58:44.261333+0000","last_fullsized":"2023-10-09T06:58:44.261333+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:07.313495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.784061+0000","last_change":"2023-10-09T06:58:43.255859+0000","last_active":"2023-10-09T06:58:43.784061+0000","last_peered":"2023-10-09T06:58:43.784061+0000","last_clean":"2023-10-09T06:58:43.784061+0000","last_became_active":"2023-10-09T06:58:43.255578+0000","last_became_peered":"2023-10-09T06:58:43.255578+0000","last_unstale":"2023-10-09T06:58:43.784061+0000","last_undegraded":"2023-10-09T06:58:43.784061+0000","last_fullsized":"2023-10-09T06:58:43.784061+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:40.351052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798159+0000","last_change":"2023-10-09T06:58:43.796219+0000","last_active":"2023-10-09T06:58:43.798159+0000","last_peered":"2023-10-09T06:58:43.798159+0000","last_clean":"2023-10-09T06:58:43.798159+0000","last_became_active":"2023-10-09T06:58:43.795941+0000","last_became_peered":"2023-10-09T06:58:43.795941+0000","last_unstale":"2023-10-09T06:58:43.798159+0000","last_undegraded":"2023-10-09T06:58:43.798159+0000","last_fullsized":"2023-10-09T06:58:43.798159+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:14.659129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.786291+0000","last_change":"2023-10-09T06:58:43.260159+0000","last_active":"2023-10-09T06:58:43.786291+0000","last_peered":"2023-10-09T06:58:43.786291+0000","last_clean":"2023-10-09T06:58:43.786291+0000","last_became_active":"2023-10-09T06:58:43.259901+0000","last_became_peered":"2023-10-09T06:58:43.259901+0000","last_unstale":"2023-10-09T06:58:43.786291+0000","last_undegraded":"2023-10-09T06:58:43.786291+0000","last_fullsized":"2023-10-09T06:58:43.786291+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:49:23.556684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.776097+0000","last_change":"2023-10-09T06:58:43.251771+0000","last_active":"2023-10-09T06:58:43.776097+0000","last_peered":"2023-10-09T06:58:43.776097+0000","last_clean":"2023-10-09T06:58:43.776097+0000","last_became_active":"2023-10-09T06:58:43.251526+0000","last_became_peered":"2023-10-09T06:58:43.251526+0000","last_unstale":"2023-10-09T06:58:43.776097+0000","last_undegraded":"2023-10-09T06:58:43.776097+0000","last_fullsized":"2023-10-09T06:58:43.776097+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:56.176507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.788879+0000","last_change":"2023-10-09T06:58:43.785494+0000","last_active":"2023-10-09T06:58:43.788879+0000","last_peered":"2023-10-09T06:58:43.788879+0000","last_clean":"2023-10-09T06:58:43.788879+0000","last_became_active":"2023-10-09T06:58:43.785046+0000","last_became_peered":"2023-10-09T06:58:43.785046+0000","last_unstale":"2023-10-09T06:58:43.788879+0000","last_undegraded":"2023-10-09T06:58:43.788879+0000","last_fullsized":"2023-10-09T06:58:43.788879+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:56:11.098462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.263422+0000","last_change":"2023-10-09T06:58:43.256281+0000","last_active":"2023-10-09T06:58:44.263422+0000","last_peered":"2023-10-09T06:58:44.263422+0000","last_clean":"2023-10-09T06:58:44.263422+0000","last_became_active":"2023-10-09T06:58:43.255990+0000","last_became_peered":"2023-10-09T06:58:43.255990+0000","last_unstale":"2023-10-09T06:58:44.263422+0000","last_undegraded":"2023-10-09T06:58:44.263422+0000","last_fullsized":"2023-10-09T06:58:44.263422+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:21.986566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779711+0000","last_change":"2023-10-09T06:58:43.252157+0000","last_active":"2023-10-09T06:58:43.779711+0000","last_peered":"2023-10-09T06:58:43.779711+0000","last_clean":"2023-10-09T06:58:43.779711+0000","last_became_active":"2023-10-09T06:58:43.251921+0000","last_became_peered":"2023-10-09T06:58:43.251921+0000","last_unstale":"2023-10-09T06:58:43.779711+0000","last_undegraded":"2023-10-09T06:58:43.779711+0000","last_fullsized":"2023-10-09T06:58:43.779711+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:14.775753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.239083+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:20:13.098656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792325+0000","last_change":"2023-10-09T06:58:43.787346+0000","last_active":"2023-10-09T06:58:43.792325+0000","last_peered":"2023-10-09T06:58:43.792325+0000","last_clean":"2023-10-09T06:58:43.792325+0000","last_became_active":"2023-10-09T06:58:43.786810+0000","last_became_peered":"2023-10-09T06:58:43.786810+0000","last_unstale":"2023-10-09T06:58:43.792325+0000","last_undegraded":"2023-10-09T06:58:43.792325+0000","last_fullsized":"2023-10-09T06:58:43.792325+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:39:57.258267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.239235+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:17.042939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779768+0000","last_change":"2023-10-09T06:58:43.253376+0000","last_active":"2023-10-09T06:58:43.779768+0000","last_peered":"2023-10-09T06:58:43.779768+0000","last_clean":"2023-10-09T06:58:43.779768+0000","last_became_active":"2023-10-09T06:58:43.253110+0000","last_became_peered":"2023-10-09T06:58:43.253110+0000","last_unstale":"2023-10-09T06:58:43.779768+0000","last_undegraded":"2023-10-09T06:58:43.779768+0000","last_fullsized":"2023-10-09T06:58:43.779768+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:56:21.112546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.789652+0000","last_change":"2023-10-09T06:58:43.784901+0000","last_active":"2023-10-09T06:58:43.789652+0000","last_peered":"2023-10-09T06:58:43.789652+0000","last_clean":"2023-10-09T06:58:43.789652+0000","last_became_active":"2023-10-09T06:58:43.784645+0000","last_became_peered":"2023-10-09T06:58:43.784645+0000","last_unstale":"2023-10-09T06:58:43.789652+0000","last_undegraded":"2023-10-09T06:58:43.789652+0000","last_fullsized":"2023-10-09T06:58:43.789652+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:56:33.524723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779732+0000","last_change":"2023-10-09T06:58:43.255156+0000","last_active":"2023-10-09T06:58:43.779732+0000","last_peered":"2023-10-09T06:58:43.779732+0000","last_clean":"2023-10-09T06:58:43.779732+0000","last_became_active":"2023-10-09T06:58:43.254884+0000","last_became_peered":"2023-10-09T06:58:43.254884+0000","last_unstale":"2023-10-09T06:58:43.779732+0000","last_undegraded":"2023-10-09T06:58:43.779732+0000","last_fullsized":"2023-10-09T06:58:43.779732+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:08.617277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.238885+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:12:27.841627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.781109+0000","last_change":"2023-10-09T06:58:43.256820+0000","last_active":"2023-10-09T06:58:43.781109+0000","last_peered":"2023-10-09T06:58:43.781109+0000","last_clean":"2023-10-09T06:58:43.781109+0000","last_became_active":"2023-10-09T06:58:43.256460+0000","last_became_peered":"2023-10-09T06:58:43.256460+0000","last_unstale":"2023-10-09T06:58:43.781109+0000","last_undegraded":"2023-10-09T06:58:43.781109+0000","last_fullsized":"2023-10-09T06:58:43.781109+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:51:46.519760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792081+0000","last_change":"2023-10-09T06:58:43.789965+0000","last_active":"2023-10-09T06:58:43.792081+0000","last_peered":"2023-10-09T06:58:43.792081+0000","last_clean":"2023-10-09T06:58:43.792081+0000","last_became_active":"2023-10-09T06:58:43.789716+0000","last_became_peered":"2023-10-09T06:58:43.789716+0000","last_unstale":"2023-10-09T06:58:43.792081+0000","last_undegraded":"2023-10-09T06:58:43.792081+0000","last_fullsized":"2023-10-09T06:58:43.792081+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:12:28.848971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.243296+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:20.836176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"96'205","reported_seq":547,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-09T06:58:39.914795+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:58:39.914795+0000","last_peered":"2023-10-09T06:58:39.914795+0000","last_clean":"2023-10-09T06:58:39.914795+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:58:39.914795+0000","last_undegraded":"2023-10-09T06:58:39.914795+0000","last_fullsized":"2023-10-09T06:58:39.914795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":74,"acting":74,"num_store_stats":5},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23,"ondisk_log_size":23,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575041,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303200,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068640,"statfs":{"total":96636764160,"available":96326287360,"internally_reserved":0,"allocated":1859584,"data_stored":1203674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68400000000000005,"15min":0.70799999999999996},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.316},"max":{"1min":0.81100000000000005,"5min":1.732,"15min":1.9490000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.44,"5min":0.40200000000000002,"15min":0.29999999999999999},"max":{"1min":0.83299999999999996,"5min":1.22,"15min":3.448},"last":0.80700000000000005}]},{"osd":1,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.504,"5min":0.437,"15min":0.379},"max":{"1min":0.86799999999999999,"5min":2.3559999999999999,"15min":5.617},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.46999999999999997,"5min":0.45800000000000002,"15min":0.40200000000000002},"max":{"1min":0.97599999999999998,"5min":1.7869999999999999,"15min":2.016},"last":0.82199999999999995}]},{"osd":2,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.72999999999999998,"15min":0.73899999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.44800000000000001},"max":{"1min":0.97999999999999998,"5min":1.9430000000000001,"15min":2.052},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.73799999999999999,"15min":0.75600000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.44700000000000001},"max":{"1min":0.82399999999999995,"5min":2.6629999999999998,"15min":3.5019999999999998},"last":0.77200000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.73899999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.45000000000000001},"max":{"1min":0.97099999999999997,"5min":1.03,"15min":5.5800000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.746,"15min":0.78100000000000003},"min":{"1min":0.50800000000000001,"5min":0.496,"15min":0.47099999999999997},"max":{"1min":0.89800000000000002,"5min":1.827,"15min":6.9299999999999997},"last":0.74099999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.91000000000000003,"5min":0.95499999999999996,"15min":3.125},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.66500000000000004},"min":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1850000000000001,"5min":2.577,"15min":4.8380000000000001},"last":0.58599999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68700000000000006,"15min":0.68100000000000005},"min":{"1min":0.441,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":1.0309999999999999,"5min":2.5169999999999999,"15min":4.1929999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.5,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":2.9590000000000001,"15min":3.6749999999999998},"last":0.628}]},{"osd":6,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0449999999999999,"5min":3.0019999999999998,"15min":4.0250000000000004},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72699999999999998,"15min":0.752},"min":{"1min":0.498,"5min":0.47399999999999998,"15min":0.44700000000000001},"max":{"1min":1.0740000000000001,"5min":2.4039999999999999,"15min":7.0259999999999998},"last":0.69799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575040,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302632,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069208,"statfs":{"total":96636764160,"available":96326868992,"internally_reserved":0,"allocated":1277952,"data_stored":619503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68799999999999994,"15min":0.71399999999999997},"min":{"1min":0.47599999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86899999999999999,"5min":0.97899999999999998,"15min":1.022},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66700000000000004,"15min":0.70199999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.36599999999999999},"max":{"1min":0.72999999999999998,"5min":0.93899999999999995,"15min":1.079},"last":0.93200000000000005}]},{"osd":1,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.68799999999999994,"15min":0.71999999999999997},"min":{"1min":0.48199999999999998,"5min":0.45500000000000002,"15min":0.42799999999999999},"max":{"1min":0.76700000000000002,"5min":1.135,"15min":1.135},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68799999999999994,"15min":0.72499999999999998},"min":{"1min":0.47799999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81699999999999995,"5min":1.0109999999999999,"15min":1.034},"last":0.95299999999999996}]},{"osd":2,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.69999999999999996,"15min":0.73199999999999998},"min":{"1min":0.52300000000000002,"5min":0.49199999999999999,"15min":0.42599999999999999},"max":{"1min":0.86099999999999999,"5min":1.391,"15min":1.391},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.68799999999999994,"15min":0.73099999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90500000000000003,"5min":0.91000000000000003,"15min":1.0900000000000001},"last":0.73199999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66700000000000004,"15min":0.69899999999999995},"min":{"1min":0.502,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.81899999999999995,"5min":0.91700000000000004,"15min":1.046},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.72899999999999998,"15min":0.753},"min":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.497},"max":{"1min":0.82999999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.61099999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61399999999999999,"15min":0.621},"min":{"1min":0.38,"5min":0.38,"15min":0.377},"max":{"1min":0.84699999999999998,"5min":1.768,"15min":1.768},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.36199999999999999},"max":{"1min":0.84399999999999997,"5min":1.601,"15min":1.601},"last":0.98399999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65500000000000003,"15min":0.65200000000000002},"min":{"1min":0.53100000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84099999999999997,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.42299999999999999},"max":{"1min":0.86699999999999999,"5min":0.94699999999999995,"15min":1.0669999999999999},"last":1.004}]},{"osd":7,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66900000000000004,"15min":0.67600000000000005},"min":{"1min":0.55600000000000005,"5min":0.42899999999999999,"15min":0.41799999999999998},"max":{"1min":0.95999999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.026},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56499999999999995,"5min":0.44600000000000001,"15min":0.42399999999999999},"max":{"1min":0.89600000000000002,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.86799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575042,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302680,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069160,"statfs":{"total":96636764160,"available":96326819840,"internally_reserved":0,"allocated":1327104,"data_stored":640187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.45600000000000002,"15min":0.45900000000000002},"min":{"1min":0.26600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48699999999999999,"15min":0.48499999999999999},"min":{"1min":0.313,"5min":0.29399999999999998,"15min":0.23699999999999999},"max":{"1min":1.1879999999999999,"5min":1.23,"15min":1.23},"last":0.56200000000000006}]},{"osd":2,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48299999999999998,"15min":0.495},"min":{"1min":0.34799999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.67700000000000005,"5min":1.169,"15min":1.169},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.3500000000000001,"5min":3.077,"15min":3.077},"last":0.58599999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.34100000000000003},"max":{"1min":1.6839999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.36099999999999999,"5min":0.34899999999999998,"15min":0.34100000000000003},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.60499999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.71999999999999997,"15min":0.75700000000000001},"min":{"1min":0.46700000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.995,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.745}]},{"osd":5,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.57699999999999996,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.74299999999999999,"15min":0.77900000000000003},"min":{"1min":0.52100000000000002,"5min":0.497,"15min":0.47999999999999998},"max":{"1min":1.0209999999999999,"5min":1.637,"15min":1.637},"last":0.79800000000000004}]},{"osd":6,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.78000000000000003,"15min":0.79600000000000004},"min":{"1min":0.55600000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77600000000000002,"15min":0.79800000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.86899999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.81999999999999995,"15min":0.82799999999999996},"min":{"1min":0.54400000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.4350000000000001,"5min":3.4350000000000001,"15min":3.4350000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77600000000000002,"15min":0.81899999999999995},"min":{"1min":0.51400000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1200000000000001,"5min":1.125,"15min":1.1970000000000001},"last":0.71799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575041,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299156,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072684,"statfs":{"total":96636764160,"available":96330428416,"internally_reserved":0,"allocated":1912832,"data_stored":1230395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.29299999999999998,"5min":0.27100000000000002,"15min":0.23000000000000001},"max":{"1min":0.623,"5min":0.85799999999999998,"15min":1.2729999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.28899999999999998},"max":{"1min":0.60399999999999998,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.63400000000000001,"5min":4.6980000000000004,"15min":4.6980000000000004},"last":0.436},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48999999999999999,"15min":0.497},"min":{"1min":0.34000000000000002,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.71799999999999997,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.41999999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":0.63800000000000001,"5min":1.2450000000000001,"15min":1.7130000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.441,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":0.70199999999999996,"5min":4.734,"15min":4.734},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.52900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99199999999999999,"5min":1.2270000000000001,"15min":1.752},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.50700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.91500000000000004,"5min":4.6619999999999999,"15min":4.6619999999999999},"last":0.79600000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.53700000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0049999999999999,"5min":1.1890000000000001,"15min":1.2769999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.58699999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90300000000000002,"5min":1.2809999999999999,"15min":1.7889999999999999},"last":0.69399999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.80500000000000005,"15min":0.81299999999999994},"min":{"1min":0.56499999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97299999999999998,"5min":4.6239999999999997,"15min":4.6239999999999997},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79300000000000004,"15min":0.80100000000000005},"min":{"1min":0.55600000000000005,"5min":0.50800000000000001,"15min":0.47999999999999998},"max":{"1min":0.96499999999999997,"5min":1.2689999999999999,"15min":1.4370000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.82499999999999996,"15min":0.83199999999999996},"min":{"1min":0.56299999999999994,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.042,"5min":1.256,"15min":1.518},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.621,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95599999999999996,"5min":1.702,"15min":1.8200000000000001},"last":0.81200000000000006}]}]},{"osd":2,"up_from":13,"seq":55834575041,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306768,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065072,"statfs":{"total":96636764160,"available":96322633728,"internally_reserved":0,"allocated":1318912,"data_stored":640547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.46800000000000003,"15min":0.45400000000000001},"min":{"1min":0.28299999999999997,"5min":0.26500000000000001,"15min":0.25900000000000001},"max":{"1min":0.76700000000000002,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.48999999999999999,"15min":0.495},"min":{"1min":0.30599999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.55300000000000005,"5min":1.633,"15min":1.633},"last":0.41799999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46400000000000002,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71599999999999997,"5min":1.097,"15min":1.865},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.79700000000000004,"5min":1.2689999999999999,"15min":1.79},"last":0.39100000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.58899999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.35799999999999998},"max":{"1min":0.82599999999999996,"5min":0.86699999999999999,"15min":1.8999999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.47399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70299999999999996,"5min":1.1890000000000001,"15min":1.8220000000000001},"last":0.49399999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":0.85799999999999998,"5min":1.2430000000000001,"15min":1.256},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.55000000000000004,"5min":0.45900000000000002,"15min":0.44800000000000001},"max":{"1min":0.91400000000000003,"5min":1.696,"15min":1.696},"last":0.96399999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.753,"15min":0.76800000000000002},"min":{"1min":0.505,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85199999999999998,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.143},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.503},"max":{"1min":0.83199999999999996,"5min":1.218,"15min":1.3440000000000001},"last":0.81799999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.54000000000000004,"5min":0.51000000000000001,"15min":0.48599999999999999},"max":{"1min":0.94899999999999995,"5min":1.768,"15min":1.768},"last":1.069},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.76400000000000001,"15min":0.79000000000000004},"min":{"1min":0.56599999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92900000000000005,"5min":1.3580000000000001,"15min":1.5309999999999999},"last":1.101}]},{"osd":7,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.61799999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97799999999999998,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.875},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.58699999999999997,"5min":0.57599999999999996,"15min":0.50900000000000001},"max":{"1min":0.92000000000000004,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.0209999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575042,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306776,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065064,"statfs":{"total":96636764160,"available":96322625536,"internally_reserved":0,"allocated":1327104,"data_stored":641529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.29599999999999999,"5min":0.29499999999999998,"15min":0.24099999999999999},"max":{"1min":0.86299999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.47899999999999998,"15min":0.48799999999999999},"min":{"1min":0.315,"5min":0.30199999999999999,"15min":0.28100000000000003},"max":{"1min":0.63600000000000001,"5min":1.228,"15min":1.228},"last":0.42599999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.48099999999999998,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58699999999999997,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.44500000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94099999999999995,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64800000000000002,"15min":0.63300000000000001},"min":{"1min":0.44400000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.97699999999999998,"5min":3.8900000000000001,"15min":3.8900000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.51100000000000001,"5min":0.48299999999999998,"15min":0.40799999999999997},"max":{"1min":0.76500000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.81000000000000005,"15min":0.82299999999999995},"min":{"1min":0.623,"5min":0.59399999999999997,"15min":0.52200000000000002},"max":{"1min":1.0189999999999999,"5min":1.22,"15min":1.22},"last":0.755}]},{"osd":5,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.45000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.86199999999999999,"5min":1.3360000000000001,"15min":2.1549999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.56399999999999995,"5min":0.55900000000000005,"15min":0.50600000000000001},"max":{"1min":1.0569999999999999,"5min":1.1639999999999999,"15min":1.419},"last":0.66800000000000004}]},{"osd":6,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.51700000000000002},"max":{"1min":0.875,"5min":1.304,"15min":1.304},"last":0.63},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95199999999999996,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91100000000000003,"5min":1.8180000000000001,"15min":2.0880000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.80800000000000005,"15min":0.82099999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92300000000000004,"5min":1.486,"15min":1.486},"last":0.71199999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575041,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310860,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060980,"statfs":{"total":96636764160,"available":96318443520,"internally_reserved":0,"allocated":1314816,"data_stored":639993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71399999999999997,"15min":0.70399999999999996},"min":{"1min":0.45000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79200000000000004,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.72799999999999998,"15min":0.72299999999999998},"min":{"1min":0.50900000000000001,"5min":0.42699999999999999,"15min":0.39300000000000002},"max":{"1min":0.97399999999999998,"5min":2.8130000000000002,"15min":3.23},"last":0.51000000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71899999999999997,"15min":0.71099999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.373},"max":{"1min":0.85699999999999998,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.53000000000000003,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.86499999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.71799999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.755,"15min":0.75700000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.38100000000000001},"max":{"1min":0.92900000000000005,"5min":2.5960000000000001,"15min":3.7509999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.48299999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90000000000000002,"5min":2.427,"15min":2.427},"last":0.68000000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.755,"15min":0.751},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.434},"max":{"1min":0.89700000000000002,"5min":2.6440000000000001,"15min":3.6970000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.77000000000000002,"15min":0.747},"min":{"1min":0.443,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":3.6899999999999999,"15min":3.6899999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63600000000000001,"15min":0.60899999999999999},"min":{"1min":0.379,"5min":0.317,"15min":0.317},"max":{"1min":0.84899999999999998,"5min":3.3860000000000001,"15min":3.4780000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.68999999999999995,"15min":0.65800000000000003},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.34999999999999998},"max":{"1min":0.91200000000000003,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.61899999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67100000000000004,"15min":0.64000000000000001},"min":{"1min":0.47699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82299999999999995,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.71499999999999997,"15min":0.67900000000000005},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.374},"max":{"1min":0.89100000000000001,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.82299999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.49299999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.96599999999999997,"5min":2.7210000000000001,"15min":3.2789999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.76900000000000002},"min":{"1min":0.56499999999999995,"5min":0.439,"15min":0.439},"max":{"1min":0.93600000000000005,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.752}]}]},{"osd":5,"up_from":13,"seq":55834575041,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302632,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069208,"statfs":{"total":96636764160,"available":96326868992,"internally_reserved":0,"allocated":1277952,"data_stored":619503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67600000000000005,"15min":0.69699999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.72299999999999998,"5min":0.93600000000000005,"15min":1.655},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65700000000000003,"15min":0.68400000000000005},"min":{"1min":0.42899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78200000000000003,"5min":1.0269999999999999,"15min":1.1359999999999999},"last":0.57999999999999996}]},{"osd":1,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71699999999999997,"5min":0.96899999999999997,"15min":2.4159999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.45400000000000001,"5min":0.44,"15min":0.40400000000000003},"max":{"1min":0.89100000000000001,"5min":0.95099999999999996,"15min":1.706},"last":0.60999999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69699999999999995,"15min":0.72799999999999998},"min":{"1min":0.501,"5min":0.48499999999999999,"15min":0.42999999999999999},"max":{"1min":0.75800000000000001,"5min":0.997,"15min":1.79},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69699999999999995,"15min":0.71599999999999997},"min":{"1min":0.49199999999999999,"5min":0.46500000000000002,"15min":0.442},"max":{"1min":0.752,"5min":1.006,"15min":2.4889999999999999},"last":0.46200000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68999999999999995,"15min":0.71699999999999997},"min":{"1min":0.46899999999999997,"5min":0.438,"15min":0.435},"max":{"1min":0.88600000000000001,"5min":1.0209999999999999,"15min":1.409},"last":0.629},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73899999999999999,"15min":0.76900000000000002},"min":{"1min":0.56200000000000006,"5min":0.501,"15min":0.501},"max":{"1min":0.78600000000000003,"5min":0.95699999999999996,"15min":2.532},"last":0.64400000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":1.766},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.622,"15min":0.621},"min":{"1min":0.48599999999999999,"5min":0.377,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":1.052,"15min":2.7829999999999999},"last":0.39600000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.45100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82899999999999996,"5min":1.018,"15min":2.5739999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.40000000000000002,"15min":0.38900000000000001},"max":{"1min":0.84099999999999997,"5min":0.97999999999999998,"15min":1.8080000000000001},"last":0.41199999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.90700000000000003,"5min":1.175,"15min":2.9609999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.60499999999999998,"5min":0.498,"15min":0.45900000000000002},"max":{"1min":0.876,"5min":1.139,"15min":2.613},"last":0.68899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:58:49.038 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:58:49.222 INFO:tasks.ceph.mds.d.smithi179.stderr:2023-10-09T06:58:49.222+0000 7fbff8bf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T06:58:49.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.252+0000 7ff23359e700 1 Processor -- start 2023-10-09T06:58:49.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.253+0000 7ff23359e700 1 -- start start 2023-10-09T06:58:49.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.254+0000 7ff23359e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff234156310 0x7ff2340c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:49.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.254+0000 7ff23359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2341566e0 0x7ff2340ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:49.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.254+0000 7ff23359e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff2340ca300 0x7ff2340ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:49.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.254+0000 7ff23359e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2340ca860 con 0x7ff2340ca300 2023-10-09T06:58:49.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.254+0000 7ff23359e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2340cab40 con 0x7ff234156310 2023-10-09T06:58:49.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.254+0000 7ff23359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2340cae20 con 0x7ff2341566e0 2023-10-09T06:58:49.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.254+0000 7ff232d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff2340ca300 0x7ff2340ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:49.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.254+0000 7ff232d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff2340ca300 0x7ff2340ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36716/0 (socket says 172.21.15.71:36716) 2023-10-09T06:58:49.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.254+0000 7ff232d9d700 1 -- 172.21.15.71:0/2604872899 learned_addr learned my addr 172.21.15.71:0/2604872899 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:49.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.254+0000 7ff23259c700 1 --2- 172.21.15.71:0/2604872899 >> v2:172.21.15.179:3300/0 conn(0x7ff234156310 0x7ff2340c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:49.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.254+0000 7ff22bfff700 1 --2- 172.21.15.71:0/2604872899 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2341566e0 0x7ff2340ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:49.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.255+0000 7ff232d9d700 1 -- 172.21.15.71:0/2604872899 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2341566e0 msgr2=0x7ff2340ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:49.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.255+0000 7ff232d9d700 1 --2- 172.21.15.71:0/2604872899 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2341566e0 0x7ff2340ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.255+0000 7ff232d9d700 1 -- 172.21.15.71:0/2604872899 >> v2:172.21.15.179:3300/0 conn(0x7ff234156310 msgr2=0x7ff2340c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:49.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.255+0000 7ff232d9d700 1 --2- 172.21.15.71:0/2604872899 >> v2:172.21.15.179:3300/0 conn(0x7ff234156310 0x7ff2340c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.255+0000 7ff232d9d700 1 -- 172.21.15.71:0/2604872899 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2340cb100 con 0x7ff2340ca300 2023-10-09T06:58:49.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.255+0000 7ff232d9d700 1 --2- 172.21.15.71:0/2604872899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2340ca300 0x7ff2340ae540 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7ff2340cce20 tx=0x7ff22c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c843adc4870c60 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:49.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.255+0000 7ff231d9b700 1 -- 172.21.15.71:0/2604872899 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c00e070 con 0x7ff2340ca300 2023-10-09T06:58:49.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.255+0000 7ff231d9b700 1 -- 172.21.15.71:0/2604872899 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c00b970 con 0x7ff2340ca300 2023-10-09T06:58:49.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.255+0000 7ff231d9b700 1 -- 172.21.15.71:0/2604872899 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0092e0 con 0x7ff2340ca300 2023-10-09T06:58:49.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.256+0000 7ff23359e700 1 -- 172.21.15.71:0/2604872899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2340ca300 msgr2=0x7ff2340ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:49.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.256+0000 7ff23359e700 1 --2- 172.21.15.71:0/2604872899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2340ca300 0x7ff2340ae540 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7ff2340cce20 tx=0x7ff22c009840 comp rx=0 tx=0).stop 2023-10-09T06:58:49.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.256+0000 7ff23359e700 1 -- 172.21.15.71:0/2604872899 shutdown_connections 2023-10-09T06:58:49.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.256+0000 7ff23359e700 1 --2- 172.21.15.71:0/2604872899 >> v2:172.21.15.179:3300/0 conn(0x7ff234156310 0x7ff2340c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.256+0000 7ff23359e700 1 --2- 172.21.15.71:0/2604872899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2340ca300 0x7ff2340ae540 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.256+0000 7ff23359e700 1 --2- 172.21.15.71:0/2604872899 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2341566e0 0x7ff2340ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.256+0000 7ff23359e700 1 -- 172.21.15.71:0/2604872899 >> 172.21.15.71:0/2604872899 conn(0x7ff2340cc1f0 msgr2=0x7ff2340cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:49.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.256+0000 7ff23359e700 1 -- 172.21.15.71:0/2604872899 shutdown_connections 2023-10-09T06:58:49.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.256+0000 7ff23359e700 1 -- 172.21.15.71:0/2604872899 wait complete. 2023-10-09T06:58:49.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.257+0000 7ff23359e700 1 Processor -- start 2023-10-09T06:58:49.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.257+0000 7ff23359e700 1 -- start start 2023-10-09T06:58:49.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.258+0000 7ff23359e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2340ca300 0x7ff23414ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:49.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.258+0000 7ff23359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff234156310 0x7ff23415de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:49.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.258+0000 7ff23359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2341566e0 0x7ff234151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:49.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.258+0000 7ff23359e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2340b0270 con 0x7ff2340ca300 2023-10-09T06:58:49.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.258+0000 7ff23359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2340aff30 con 0x7ff234156310 2023-10-09T06:58:49.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.258+0000 7ff23359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23414f360 con 0x7ff2341566e0 2023-10-09T06:58:49.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.258+0000 7ff23259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2340ca300 0x7ff23414ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:49.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.258+0000 7ff23259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2340ca300 0x7ff23414ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36730/0 (socket says 172.21.15.71:36730) 2023-10-09T06:58:49.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.259+0000 7ff23259c700 1 -- 172.21.15.71:0/1700646887 learned_addr learned my addr 172.21.15.71:0/1700646887 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:49.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.259+0000 7ff22bfff700 1 --2- 172.21.15.71:0/1700646887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff234156310 0x7ff23415de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:49.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.259+0000 7ff232d9d700 1 --2- 172.21.15.71:0/1700646887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2341566e0 0x7ff234151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:49.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.259+0000 7ff23259c700 1 -- 172.21.15.71:0/1700646887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2341566e0 msgr2=0x7ff234151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:49.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.259+0000 7ff23259c700 1 --2- 172.21.15.71:0/1700646887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2341566e0 0x7ff234151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.259+0000 7ff23259c700 1 -- 172.21.15.71:0/1700646887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff234156310 msgr2=0x7ff23415de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.259+0000 7ff23259c700 1 --2- 172.21.15.71:0/1700646887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff234156310 0x7ff23415de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.259+0000 7ff23259c700 1 -- 172.21.15.71:0/1700646887 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c009ae0 con 0x7ff2340ca300 2023-10-09T06:58:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.259+0000 7ff22bfff700 1 --2- 172.21.15.71:0/1700646887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff234156310 0x7ff23415de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.259+0000 7ff23259c700 1 --2- 172.21.15.71:0/1700646887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2340ca300 0x7ff23414ee20 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7ff22400ec80 tx=0x7ff2240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.259+0000 7ff22a7fc700 1 -- 172.21.15.71:0/1700646887 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22400c9d0 con 0x7ff2340ca300 2023-10-09T06:58:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.259+0000 7ff22a7fc700 1 -- 172.21.15.71:0/1700646887 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22400cb30 con 0x7ff2340ca300 2023-10-09T06:58:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.259+0000 7ff22a7fc700 1 -- 172.21.15.71:0/1700646887 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224013470 con 0x7ff2340ca300 2023-10-09T06:58:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.259+0000 7ff23359e700 1 -- 172.21.15.71:0/1700646887 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff23415e8d0 con 0x7ff2340ca300 2023-10-09T06:58:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.260+0000 7ff23359e700 1 -- 172.21.15.71:0/1700646887 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff23415ee90 con 0x7ff2340ca300 2023-10-09T06:58:49.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.260+0000 7ff23359e700 1 -- 172.21.15.71:0/1700646887 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2340b0550 con 0x7ff2340ca300 2023-10-09T06:58:49.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.261+0000 7ff22a7fc700 1 -- 172.21.15.71:0/1700646887 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff224013820 con 0x7ff2340ca300 2023-10-09T06:58:49.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.262+0000 7ff22a7fc700 1 --2- 172.21.15.71:0/1700646887 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff214066f30 0x7ff2140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:49.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.262+0000 7ff22a7fc700 1 -- 172.21.15.71:0/1700646887 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6097+0+0 (secure 0 0 0) 0x7ff224084af0 con 0x7ff2340ca300 2023-10-09T06:58:49.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.262+0000 7ff22bfff700 1 --2- 172.21.15.71:0/1700646887 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff214066f30 0x7ff2140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:49.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.263+0000 7ff22bfff700 1 --2- 172.21.15.71:0/1700646887 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff214066f30 0x7ff2140693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff2340c2940 tx=0x7ff21c008040 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:49.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.266+0000 7ff22a7fc700 1 -- 172.21.15.71:0/1700646887 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff224051b30 con 0x7ff2340ca300 2023-10-09T06:58:49.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.450+0000 7ff23359e700 1 -- 172.21.15.71:0/1700646887 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2340b03b0 con 0x7ff214066f30 2023-10-09T06:58:49.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.459+0000 7ff22a7fc700 1 -- 172.21.15.71:0/1700646887 <== mgr.6718 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285098 (secure 0 0 0) 0x7ff21c009ac0 con 0x7ff214066f30 2023-10-09T06:58:49.464 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:49.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.463+0000 7ff23359e700 1 -- 172.21.15.71:0/1700646887 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff214066f30 msgr2=0x7ff2140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:49.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.463+0000 7ff23359e700 1 --2- 172.21.15.71:0/1700646887 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff214066f30 0x7ff2140693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff2340c2940 tx=0x7ff21c008040 comp rx=0 tx=0).stop 2023-10-09T06:58:49.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.464+0000 7ff23359e700 1 -- 172.21.15.71:0/1700646887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2340ca300 msgr2=0x7ff23414ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:49.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.464+0000 7ff23359e700 1 --2- 172.21.15.71:0/1700646887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2340ca300 0x7ff23414ee20 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7ff22400ec80 tx=0x7ff2240091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.464+0000 7ff23359e700 1 -- 172.21.15.71:0/1700646887 shutdown_connections 2023-10-09T06:58:49.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.464+0000 7ff23359e700 1 --2- 172.21.15.71:0/1700646887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2341566e0 0x7ff234151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.464+0000 7ff23359e700 1 --2- 172.21.15.71:0/1700646887 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7ff214066f30 0x7ff2140693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.464+0000 7ff23359e700 1 --2- 172.21.15.71:0/1700646887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2340ca300 0x7ff23414ee20 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.464+0000 7ff23359e700 1 --2- 172.21.15.71:0/1700646887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff234156310 0x7ff23415de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.464+0000 7ff23359e700 1 -- 172.21.15.71:0/1700646887 >> 172.21.15.71:0/1700646887 conn(0x7ff2340cc1f0 msgr2=0x7ff2340c76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:49.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.464+0000 7ff23359e700 1 -- 172.21.15.71:0/1700646887 shutdown_connections 2023-10-09T06:58:49.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.464+0000 7ff23359e700 1 -- 172.21.15.71:0/1700646887 wait complete. 2023-10-09T06:58:49.467 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:58:49.482 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T06:58:47.972713+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":347,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":140,"acting":140,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434704,"kb_used_data":11344,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752540016,"statfs":{"total":773094113280,"available":770600976384,"internally_reserved":0,"allocated":11616256,"data_stored":6235331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.739652"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.800454+0000","last_change":"2023-10-09T06:58:43.799501+0000","last_active":"2023-10-09T06:58:43.800454+0000","last_peered":"2023-10-09T06:58:43.800454+0000","last_clean":"2023-10-09T06:58:43.800454+0000","last_became_active":"2023-10-09T06:58:43.799241+0000","last_became_peered":"2023-10-09T06:58:43.799241+0000","last_unstale":"2023-10-09T06:58:43.800454+0000","last_undegraded":"2023-10-09T06:58:43.800454+0000","last_fullsized":"2023-10-09T06:58:43.800454+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:11.893055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796119+0000","last_change":"2023-10-09T06:58:43.794396+0000","last_active":"2023-10-09T06:58:43.796119+0000","last_peered":"2023-10-09T06:58:43.796119+0000","last_clean":"2023-10-09T06:58:43.796119+0000","last_became_active":"2023-10-09T06:58:43.794124+0000","last_became_peered":"2023-10-09T06:58:43.794124+0000","last_unstale":"2023-10-09T06:58:43.796119+0000","last_undegraded":"2023-10-09T06:58:43.796119+0000","last_fullsized":"2023-10-09T06:58:43.796119+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:26:49.171285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796255+0000","last_change":"2023-10-09T06:58:43.791324+0000","last_active":"2023-10-09T06:58:43.796255+0000","last_peered":"2023-10-09T06:58:43.796255+0000","last_clean":"2023-10-09T06:58:43.796255+0000","last_became_active":"2023-10-09T06:58:43.790853+0000","last_became_peered":"2023-10-09T06:58:43.790853+0000","last_unstale":"2023-10-09T06:58:43.796255+0000","last_undegraded":"2023-10-09T06:58:43.796255+0000","last_fullsized":"2023-10-09T06:58:43.796255+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:36.821271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.793084+0000","last_change":"2023-10-09T06:58:43.791927+0000","last_active":"2023-10-09T06:58:43.793084+0000","last_peered":"2023-10-09T06:58:43.793084+0000","last_clean":"2023-10-09T06:58:43.793084+0000","last_became_active":"2023-10-09T06:58:43.791694+0000","last_became_peered":"2023-10-09T06:58:43.791694+0000","last_unstale":"2023-10-09T06:58:43.793084+0000","last_undegraded":"2023-10-09T06:58:43.793084+0000","last_fullsized":"2023-10-09T06:58:43.793084+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:41:21.133593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.794464+0000","last_change":"2023-10-09T06:58:43.790416+0000","last_active":"2023-10-09T06:58:43.794464+0000","last_peered":"2023-10-09T06:58:43.794464+0000","last_clean":"2023-10-09T06:58:43.794464+0000","last_became_active":"2023-10-09T06:58:43.790148+0000","last_became_peered":"2023-10-09T06:58:43.790148+0000","last_unstale":"2023-10-09T06:58:43.794464+0000","last_undegraded":"2023-10-09T06:58:43.794464+0000","last_fullsized":"2023-10-09T06:58:43.794464+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:26.456449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.794813+0000","last_change":"2023-10-09T06:58:43.793638+0000","last_active":"2023-10-09T06:58:43.794813+0000","last_peered":"2023-10-09T06:58:43.794813+0000","last_clean":"2023-10-09T06:58:43.794813+0000","last_became_active":"2023-10-09T06:58:43.793289+0000","last_became_peered":"2023-10-09T06:58:43.793289+0000","last_unstale":"2023-10-09T06:58:43.794813+0000","last_undegraded":"2023-10-09T06:58:43.794813+0000","last_fullsized":"2023-10-09T06:58:43.794813+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:33.042437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792088+0000","last_change":"2023-10-09T06:58:43.789987+0000","last_active":"2023-10-09T06:58:43.792088+0000","last_peered":"2023-10-09T06:58:43.792088+0000","last_clean":"2023-10-09T06:58:43.792088+0000","last_became_active":"2023-10-09T06:58:43.789753+0000","last_became_peered":"2023-10-09T06:58:43.789753+0000","last_unstale":"2023-10-09T06:58:43.792088+0000","last_undegraded":"2023-10-09T06:58:43.792088+0000","last_fullsized":"2023-10-09T06:58:43.792088+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:55.083637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801028+0000","last_change":"2023-10-09T06:58:43.799220+0000","last_active":"2023-10-09T06:58:43.801028+0000","last_peered":"2023-10-09T06:58:43.801028+0000","last_clean":"2023-10-09T06:58:43.801028+0000","last_became_active":"2023-10-09T06:58:43.798948+0000","last_became_peered":"2023-10-09T06:58:43.798948+0000","last_unstale":"2023-10-09T06:58:43.801028+0000","last_undegraded":"2023-10-09T06:58:43.801028+0000","last_fullsized":"2023-10-09T06:58:43.801028+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:32.536328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798525+0000","last_change":"2023-10-09T06:58:43.793525+0000","last_active":"2023-10-09T06:58:43.798525+0000","last_peered":"2023-10-09T06:58:43.798525+0000","last_clean":"2023-10-09T06:58:43.798525+0000","last_became_active":"2023-10-09T06:58:43.793039+0000","last_became_peered":"2023-10-09T06:58:43.793039+0000","last_unstale":"2023-10-09T06:58:43.798525+0000","last_undegraded":"2023-10-09T06:58:43.798525+0000","last_fullsized":"2023-10-09T06:58:43.798525+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:10.429867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798108+0000","last_change":"2023-10-09T06:58:43.796846+0000","last_active":"2023-10-09T06:58:43.798108+0000","last_peered":"2023-10-09T06:58:43.798108+0000","last_clean":"2023-10-09T06:58:43.798108+0000","last_became_active":"2023-10-09T06:58:43.796598+0000","last_became_peered":"2023-10-09T06:58:43.796598+0000","last_unstale":"2023-10-09T06:58:43.798108+0000","last_undegraded":"2023-10-09T06:58:43.798108+0000","last_fullsized":"2023-10-09T06:58:43.798108+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:41:05.828751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792567+0000","last_change":"2023-10-09T06:58:43.788053+0000","last_active":"2023-10-09T06:58:43.792567+0000","last_peered":"2023-10-09T06:58:43.792567+0000","last_clean":"2023-10-09T06:58:43.792567+0000","last_became_active":"2023-10-09T06:58:43.787821+0000","last_became_peered":"2023-10-09T06:58:43.787821+0000","last_unstale":"2023-10-09T06:58:43.792567+0000","last_undegraded":"2023-10-09T06:58:43.792567+0000","last_fullsized":"2023-10-09T06:58:43.792567+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:49:56.178318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798095+0000","last_change":"2023-10-09T06:58:43.796626+0000","last_active":"2023-10-09T06:58:43.798095+0000","last_peered":"2023-10-09T06:58:43.798095+0000","last_clean":"2023-10-09T06:58:43.798095+0000","last_became_active":"2023-10-09T06:58:43.796232+0000","last_became_peered":"2023-10-09T06:58:43.796232+0000","last_unstale":"2023-10-09T06:58:43.798095+0000","last_undegraded":"2023-10-09T06:58:43.798095+0000","last_fullsized":"2023-10-09T06:58:43.798095+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:45.689229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.791208+0000","last_change":"2023-10-09T06:58:43.788457+0000","last_active":"2023-10-09T06:58:43.791208+0000","last_peered":"2023-10-09T06:58:43.791208+0000","last_clean":"2023-10-09T06:58:43.791208+0000","last_became_active":"2023-10-09T06:58:43.788206+0000","last_became_peered":"2023-10-09T06:58:43.788206+0000","last_unstale":"2023-10-09T06:58:43.791208+0000","last_undegraded":"2023-10-09T06:58:43.791208+0000","last_fullsized":"2023-10-09T06:58:43.791208+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:54:13.880490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.794533+0000","last_change":"2023-10-09T06:58:43.791344+0000","last_active":"2023-10-09T06:58:43.794533+0000","last_peered":"2023-10-09T06:58:43.794533+0000","last_clean":"2023-10-09T06:58:43.794533+0000","last_became_active":"2023-10-09T06:58:43.790302+0000","last_became_peered":"2023-10-09T06:58:43.790302+0000","last_unstale":"2023-10-09T06:58:43.794533+0000","last_undegraded":"2023-10-09T06:58:43.794533+0000","last_fullsized":"2023-10-09T06:58:43.794533+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:09.624621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.791090+0000","last_change":"2023-10-09T06:58:43.787561+0000","last_active":"2023-10-09T06:58:43.791090+0000","last_peered":"2023-10-09T06:58:43.791090+0000","last_clean":"2023-10-09T06:58:43.791090+0000","last_became_active":"2023-10-09T06:58:43.787294+0000","last_became_peered":"2023-10-09T06:58:43.787294+0000","last_unstale":"2023-10-09T06:58:43.791090+0000","last_undegraded":"2023-10-09T06:58:43.791090+0000","last_fullsized":"2023-10-09T06:58:43.791090+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:15.783097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.800940+0000","last_change":"2023-10-09T06:58:43.799680+0000","last_active":"2023-10-09T06:58:43.800940+0000","last_peered":"2023-10-09T06:58:43.800940+0000","last_clean":"2023-10-09T06:58:43.800940+0000","last_became_active":"2023-10-09T06:58:43.798445+0000","last_became_peered":"2023-10-09T06:58:43.798445+0000","last_unstale":"2023-10-09T06:58:43.800940+0000","last_undegraded":"2023-10-09T06:58:43.800940+0000","last_fullsized":"2023-10-09T06:58:43.800940+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:18.050283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796612+0000","last_change":"2023-10-09T06:58:43.793097+0000","last_active":"2023-10-09T06:58:43.796612+0000","last_peered":"2023-10-09T06:58:43.796612+0000","last_clean":"2023-10-09T06:58:43.796612+0000","last_became_active":"2023-10-09T06:58:43.791977+0000","last_became_peered":"2023-10-09T06:58:43.791977+0000","last_unstale":"2023-10-09T06:58:43.796612+0000","last_undegraded":"2023-10-09T06:58:43.796612+0000","last_fullsized":"2023-10-09T06:58:43.796612+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:57.183851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.791338+0000","last_change":"2023-10-09T06:58:43.786570+0000","last_active":"2023-10-09T06:58:43.791338+0000","last_peered":"2023-10-09T06:58:43.791338+0000","last_clean":"2023-10-09T06:58:43.791338+0000","last_became_active":"2023-10-09T06:58:43.786278+0000","last_became_peered":"2023-10-09T06:58:43.786278+0000","last_unstale":"2023-10-09T06:58:43.791338+0000","last_undegraded":"2023-10-09T06:58:43.791338+0000","last_fullsized":"2023-10-09T06:58:43.791338+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:20:14.106000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.797100+0000","last_change":"2023-10-09T06:58:43.793238+0000","last_active":"2023-10-09T06:58:43.797100+0000","last_peered":"2023-10-09T06:58:43.797100+0000","last_clean":"2023-10-09T06:58:43.797100+0000","last_became_active":"2023-10-09T06:58:43.792979+0000","last_became_peered":"2023-10-09T06:58:43.792979+0000","last_unstale":"2023-10-09T06:58:43.797100+0000","last_undegraded":"2023-10-09T06:58:43.797100+0000","last_fullsized":"2023-10-09T06:58:43.797100+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:16:08.167149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796387+0000","last_change":"2023-10-09T06:58:43.793047+0000","last_active":"2023-10-09T06:58:43.796387+0000","last_peered":"2023-10-09T06:58:43.796387+0000","last_clean":"2023-10-09T06:58:43.796387+0000","last_became_active":"2023-10-09T06:58:43.792478+0000","last_became_peered":"2023-10-09T06:58:43.792478+0000","last_unstale":"2023-10-09T06:58:43.796387+0000","last_undegraded":"2023-10-09T06:58:43.796387+0000","last_fullsized":"2023-10-09T06:58:43.796387+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:20.771196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.799503+0000","last_change":"2023-10-09T06:58:43.796883+0000","last_active":"2023-10-09T06:58:43.799503+0000","last_peered":"2023-10-09T06:58:43.799503+0000","last_clean":"2023-10-09T06:58:43.799503+0000","last_became_active":"2023-10-09T06:58:43.796610+0000","last_became_peered":"2023-10-09T06:58:43.796610+0000","last_unstale":"2023-10-09T06:58:43.799503+0000","last_undegraded":"2023-10-09T06:58:43.799503+0000","last_fullsized":"2023-10-09T06:58:43.799503+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:39.554977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.240443+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:46:58.364775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.262810+0000","last_change":"2023-10-09T06:58:43.252052+0000","last_active":"2023-10-09T06:58:44.262810+0000","last_peered":"2023-10-09T06:58:44.262810+0000","last_clean":"2023-10-09T06:58:44.262810+0000","last_became_active":"2023-10-09T06:58:43.251738+0000","last_became_peered":"2023-10-09T06:58:43.251738+0000","last_unstale":"2023-10-09T06:58:44.262810+0000","last_undegraded":"2023-10-09T06:58:44.262810+0000","last_fullsized":"2023-10-09T06:58:44.262810+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:45:42.343993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.260847+0000","last_change":"2023-10-09T06:58:43.252945+0000","last_active":"2023-10-09T06:58:44.260847+0000","last_peered":"2023-10-09T06:58:44.260847+0000","last_clean":"2023-10-09T06:58:44.260847+0000","last_became_active":"2023-10-09T06:58:43.252616+0000","last_became_peered":"2023-10-09T06:58:43.252616+0000","last_unstale":"2023-10-09T06:58:44.260847+0000","last_undegraded":"2023-10-09T06:58:44.260847+0000","last_fullsized":"2023-10-09T06:58:44.260847+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:43:21.232774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.261335+0000","last_change":"2023-10-09T06:58:43.248945+0000","last_active":"2023-10-09T06:58:44.261335+0000","last_peered":"2023-10-09T06:58:44.261335+0000","last_clean":"2023-10-09T06:58:44.261335+0000","last_became_active":"2023-10-09T06:58:43.248676+0000","last_became_peered":"2023-10-09T06:58:43.248676+0000","last_unstale":"2023-10-09T06:58:44.261335+0000","last_undegraded":"2023-10-09T06:58:44.261335+0000","last_fullsized":"2023-10-09T06:58:44.261335+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:39:35.477143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.797144+0000","last_change":"2023-10-09T06:58:43.793238+0000","last_active":"2023-10-09T06:58:43.797144+0000","last_peered":"2023-10-09T06:58:43.797144+0000","last_clean":"2023-10-09T06:58:43.797144+0000","last_became_active":"2023-10-09T06:58:43.792972+0000","last_became_peered":"2023-10-09T06:58:43.792972+0000","last_unstale":"2023-10-09T06:58:43.797144+0000","last_undegraded":"2023-10-09T06:58:43.797144+0000","last_fullsized":"2023-10-09T06:58:43.797144+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:14.141466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.262947+0000","last_change":"2023-10-09T06:58:43.254364+0000","last_active":"2023-10-09T06:58:44.262947+0000","last_peered":"2023-10-09T06:58:44.262947+0000","last_clean":"2023-10-09T06:58:44.262947+0000","last_became_active":"2023-10-09T06:58:43.254116+0000","last_became_peered":"2023-10-09T06:58:43.254116+0000","last_unstale":"2023-10-09T06:58:44.262947+0000","last_undegraded":"2023-10-09T06:58:44.262947+0000","last_fullsized":"2023-10-09T06:58:44.262947+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:16:07.159805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798740+0000","last_change":"2023-10-09T06:58:43.794432+0000","last_active":"2023-10-09T06:58:43.798740+0000","last_peered":"2023-10-09T06:58:43.798740+0000","last_clean":"2023-10-09T06:58:43.798740+0000","last_became_active":"2023-10-09T06:58:43.794079+0000","last_became_peered":"2023-10-09T06:58:43.794079+0000","last_unstale":"2023-10-09T06:58:43.798740+0000","last_undegraded":"2023-10-09T06:58:43.798740+0000","last_fullsized":"2023-10-09T06:58:43.798740+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:50:22.439113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.262592+0000","last_change":"2023-10-09T06:58:43.255791+0000","last_active":"2023-10-09T06:58:44.262592+0000","last_peered":"2023-10-09T06:58:44.262592+0000","last_clean":"2023-10-09T06:58:44.262592+0000","last_became_active":"2023-10-09T06:58:43.255535+0000","last_became_peered":"2023-10-09T06:58:43.255535+0000","last_unstale":"2023-10-09T06:58:44.262592+0000","last_undegraded":"2023-10-09T06:58:44.262592+0000","last_fullsized":"2023-10-09T06:58:44.262592+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:46:58.364775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.780552+0000","last_change":"2023-10-09T06:58:43.244540+0000","last_active":"2023-10-09T06:58:43.780552+0000","last_peered":"2023-10-09T06:58:43.780552+0000","last_clean":"2023-10-09T06:58:43.780552+0000","last_became_active":"2023-10-09T06:58:43.244261+0000","last_became_peered":"2023-10-09T06:58:43.244261+0000","last_unstale":"2023-10-09T06:58:43.780552+0000","last_undegraded":"2023-10-09T06:58:43.780552+0000","last_fullsized":"2023-10-09T06:58:43.780552+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:56.176507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792065+0000","last_change":"2023-10-09T06:58:43.788475+0000","last_active":"2023-10-09T06:58:43.792065+0000","last_peered":"2023-10-09T06:58:43.792065+0000","last_clean":"2023-10-09T06:58:43.792065+0000","last_became_active":"2023-10-09T06:58:43.788225+0000","last_became_peered":"2023-10-09T06:58:43.788225+0000","last_unstale":"2023-10-09T06:58:43.792065+0000","last_undegraded":"2023-10-09T06:58:43.792065+0000","last_fullsized":"2023-10-09T06:58:43.792065+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:13:39.010325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779920+0000","last_change":"2023-10-09T06:58:43.251615+0000","last_active":"2023-10-09T06:58:43.779920+0000","last_peered":"2023-10-09T06:58:43.779920+0000","last_clean":"2023-10-09T06:58:43.779920+0000","last_became_active":"2023-10-09T06:58:43.250726+0000","last_became_peered":"2023-10-09T06:58:43.250726+0000","last_unstale":"2023-10-09T06:58:43.779920+0000","last_undegraded":"2023-10-09T06:58:43.779920+0000","last_fullsized":"2023-10-09T06:58:43.779920+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:26:48.163941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792119+0000","last_change":"2023-10-09T06:58:43.789342+0000","last_active":"2023-10-09T06:58:43.792119+0000","last_peered":"2023-10-09T06:58:43.792119+0000","last_clean":"2023-10-09T06:58:43.792119+0000","last_became_active":"2023-10-09T06:58:43.789085+0000","last_became_peered":"2023-10-09T06:58:43.789085+0000","last_unstale":"2023-10-09T06:58:43.792119+0000","last_undegraded":"2023-10-09T06:58:43.792119+0000","last_fullsized":"2023-10-09T06:58:43.792119+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:05:54.912313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.240034+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:53.286318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.238954+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:25.449105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.800375+0000","last_change":"2023-10-09T06:58:43.798126+0000","last_active":"2023-10-09T06:58:43.800375+0000","last_peered":"2023-10-09T06:58:43.800375+0000","last_clean":"2023-10-09T06:58:43.800375+0000","last_became_active":"2023-10-09T06:58:43.797884+0000","last_became_peered":"2023-10-09T06:58:43.797884+0000","last_unstale":"2023-10-09T06:58:43.800375+0000","last_undegraded":"2023-10-09T06:58:43.800375+0000","last_fullsized":"2023-10-09T06:58:43.800375+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:42:30.221135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.240065+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:13.134122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796573+0000","last_change":"2023-10-09T06:58:43.791013+0000","last_active":"2023-10-09T06:58:43.796573+0000","last_peered":"2023-10-09T06:58:43.796573+0000","last_clean":"2023-10-09T06:58:43.796573+0000","last_became_active":"2023-10-09T06:58:43.789697+0000","last_became_peered":"2023-10-09T06:58:43.789697+0000","last_unstale":"2023-10-09T06:58:43.796573+0000","last_undegraded":"2023-10-09T06:58:43.796573+0000","last_fullsized":"2023-10-09T06:58:43.796573+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:49.433121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.235537+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:17.947780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792408+0000","last_change":"2023-10-09T06:58:43.786500+0000","last_active":"2023-10-09T06:58:43.792408+0000","last_peered":"2023-10-09T06:58:43.792408+0000","last_clean":"2023-10-09T06:58:43.792408+0000","last_became_active":"2023-10-09T06:58:43.786244+0000","last_became_peered":"2023-10-09T06:58:43.786244+0000","last_unstale":"2023-10-09T06:58:43.792408+0000","last_undegraded":"2023-10-09T06:58:43.792408+0000","last_fullsized":"2023-10-09T06:58:43.792408+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:01.948441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.262408+0000","last_change":"2023-10-09T06:58:43.251369+0000","last_active":"2023-10-09T06:58:44.262408+0000","last_peered":"2023-10-09T06:58:44.262408+0000","last_clean":"2023-10-09T06:58:44.262408+0000","last_became_active":"2023-10-09T06:58:43.251090+0000","last_became_peered":"2023-10-09T06:58:43.251090+0000","last_unstale":"2023-10-09T06:58:44.262408+0000","last_undegraded":"2023-10-09T06:58:44.262408+0000","last_fullsized":"2023-10-09T06:58:44.262408+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:54:12.873146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.776377+0000","last_change":"2023-10-09T06:58:43.251912+0000","last_active":"2023-10-09T06:58:43.776377+0000","last_peered":"2023-10-09T06:58:43.776377+0000","last_clean":"2023-10-09T06:58:43.776377+0000","last_became_active":"2023-10-09T06:58:43.251661+0000","last_became_peered":"2023-10-09T06:58:43.251661+0000","last_unstale":"2023-10-09T06:58:43.776377+0000","last_undegraded":"2023-10-09T06:58:43.776377+0000","last_fullsized":"2023-10-09T06:58:43.776377+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:48.425777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.790274+0000","last_change":"2023-10-09T06:58:43.788503+0000","last_active":"2023-10-09T06:58:43.790274+0000","last_peered":"2023-10-09T06:58:43.790274+0000","last_clean":"2023-10-09T06:58:43.790274+0000","last_became_active":"2023-10-09T06:58:43.788263+0000","last_became_peered":"2023-10-09T06:58:43.788263+0000","last_unstale":"2023-10-09T06:58:43.790274+0000","last_undegraded":"2023-10-09T06:58:43.790274+0000","last_fullsized":"2023-10-09T06:58:43.790274+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:54.293662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.235578+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:46:31.472275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.799625+0000","last_change":"2023-10-09T06:58:43.797986+0000","last_active":"2023-10-09T06:58:43.799625+0000","last_peered":"2023-10-09T06:58:43.799625+0000","last_clean":"2023-10-09T06:58:43.799625+0000","last_became_active":"2023-10-09T06:58:43.797568+0000","last_became_peered":"2023-10-09T06:58:43.797568+0000","last_unstale":"2023-10-09T06:58:43.799625+0000","last_undegraded":"2023-10-09T06:58:43.799625+0000","last_fullsized":"2023-10-09T06:58:43.799625+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:29.985093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"106'8","reported_seq":18,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.263980+0000","last_change":"2023-10-09T06:58:43.253188+0000","last_active":"2023-10-09T06:58:44.263980+0000","last_peered":"2023-10-09T06:58:44.263980+0000","last_clean":"2023-10-09T06:58:44.263980+0000","last_became_active":"2023-10-09T06:58:43.252677+0000","last_became_peered":"2023-10-09T06:58:43.252677+0000","last_unstale":"2023-10-09T06:58:44.263980+0000","last_undegraded":"2023-10-09T06:58:44.263980+0000","last_fullsized":"2023-10-09T06:58:44.263980+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:33.706986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.239441+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:10.885711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.263780+0000","last_change":"2023-10-09T06:58:43.250800+0000","last_active":"2023-10-09T06:58:44.263780+0000","last_peered":"2023-10-09T06:58:44.263780+0000","last_clean":"2023-10-09T06:58:44.263780+0000","last_became_active":"2023-10-09T06:58:43.250529+0000","last_became_peered":"2023-10-09T06:58:43.250529+0000","last_unstale":"2023-10-09T06:58:44.263780+0000","last_undegraded":"2023-10-09T06:58:44.263780+0000","last_fullsized":"2023-10-09T06:58:44.263780+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:07.313495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796594+0000","last_change":"2023-10-09T06:58:43.791548+0000","last_active":"2023-10-09T06:58:43.796594+0000","last_peered":"2023-10-09T06:58:43.796594+0000","last_clean":"2023-10-09T06:58:43.796594+0000","last_became_active":"2023-10-09T06:58:43.790746+0000","last_became_peered":"2023-10-09T06:58:43.790746+0000","last_unstale":"2023-10-09T06:58:43.796594+0000","last_undegraded":"2023-10-09T06:58:43.796594+0000","last_fullsized":"2023-10-09T06:58:43.796594+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:37.545876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779490+0000","last_change":"2023-10-09T06:58:43.243471+0000","last_active":"2023-10-09T06:58:43.779490+0000","last_peered":"2023-10-09T06:58:43.779490+0000","last_clean":"2023-10-09T06:58:43.779490+0000","last_became_active":"2023-10-09T06:58:43.243230+0000","last_became_peered":"2023-10-09T06:58:43.243230+0000","last_unstale":"2023-10-09T06:58:43.779490+0000","last_undegraded":"2023-10-09T06:58:43.779490+0000","last_fullsized":"2023-10-09T06:58:43.779490+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:48.425777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796119+0000","last_change":"2023-10-09T06:58:43.794689+0000","last_active":"2023-10-09T06:58:43.796119+0000","last_peered":"2023-10-09T06:58:43.796119+0000","last_clean":"2023-10-09T06:58:43.796119+0000","last_became_active":"2023-10-09T06:58:43.793778+0000","last_became_peered":"2023-10-09T06:58:43.793778+0000","last_unstale":"2023-10-09T06:58:43.796119+0000","last_undegraded":"2023-10-09T06:58:43.796119+0000","last_fullsized":"2023-10-09T06:58:43.796119+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:22.993909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.261333+0000","last_change":"2023-10-09T06:58:43.252297+0000","last_active":"2023-10-09T06:58:44.261333+0000","last_peered":"2023-10-09T06:58:44.261333+0000","last_clean":"2023-10-09T06:58:44.261333+0000","last_became_active":"2023-10-09T06:58:43.252051+0000","last_became_peered":"2023-10-09T06:58:43.252051+0000","last_unstale":"2023-10-09T06:58:44.261333+0000","last_undegraded":"2023-10-09T06:58:44.261333+0000","last_fullsized":"2023-10-09T06:58:44.261333+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:07.313495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.784061+0000","last_change":"2023-10-09T06:58:43.255859+0000","last_active":"2023-10-09T06:58:43.784061+0000","last_peered":"2023-10-09T06:58:43.784061+0000","last_clean":"2023-10-09T06:58:43.784061+0000","last_became_active":"2023-10-09T06:58:43.255578+0000","last_became_peered":"2023-10-09T06:58:43.255578+0000","last_unstale":"2023-10-09T06:58:43.784061+0000","last_undegraded":"2023-10-09T06:58:43.784061+0000","last_fullsized":"2023-10-09T06:58:43.784061+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:40.351052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798159+0000","last_change":"2023-10-09T06:58:43.796219+0000","last_active":"2023-10-09T06:58:43.798159+0000","last_peered":"2023-10-09T06:58:43.798159+0000","last_clean":"2023-10-09T06:58:43.798159+0000","last_became_active":"2023-10-09T06:58:43.795941+0000","last_became_peered":"2023-10-09T06:58:43.795941+0000","last_unstale":"2023-10-09T06:58:43.798159+0000","last_undegraded":"2023-10-09T06:58:43.798159+0000","last_fullsized":"2023-10-09T06:58:43.798159+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:14.659129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.786291+0000","last_change":"2023-10-09T06:58:43.260159+0000","last_active":"2023-10-09T06:58:43.786291+0000","last_peered":"2023-10-09T06:58:43.786291+0000","last_clean":"2023-10-09T06:58:43.786291+0000","last_became_active":"2023-10-09T06:58:43.259901+0000","last_became_peered":"2023-10-09T06:58:43.259901+0000","last_unstale":"2023-10-09T06:58:43.786291+0000","last_undegraded":"2023-10-09T06:58:43.786291+0000","last_fullsized":"2023-10-09T06:58:43.786291+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:49:23.556684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.776097+0000","last_change":"2023-10-09T06:58:43.251771+0000","last_active":"2023-10-09T06:58:43.776097+0000","last_peered":"2023-10-09T06:58:43.776097+0000","last_clean":"2023-10-09T06:58:43.776097+0000","last_became_active":"2023-10-09T06:58:43.251526+0000","last_became_peered":"2023-10-09T06:58:43.251526+0000","last_unstale":"2023-10-09T06:58:43.776097+0000","last_undegraded":"2023-10-09T06:58:43.776097+0000","last_fullsized":"2023-10-09T06:58:43.776097+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:56.176507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.788879+0000","last_change":"2023-10-09T06:58:43.785494+0000","last_active":"2023-10-09T06:58:43.788879+0000","last_peered":"2023-10-09T06:58:43.788879+0000","last_clean":"2023-10-09T06:58:43.788879+0000","last_became_active":"2023-10-09T06:58:43.785046+0000","last_became_peered":"2023-10-09T06:58:43.785046+0000","last_unstale":"2023-10-09T06:58:43.788879+0000","last_undegraded":"2023-10-09T06:58:43.788879+0000","last_fullsized":"2023-10-09T06:58:43.788879+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:56:11.098462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.263422+0000","last_change":"2023-10-09T06:58:43.256281+0000","last_active":"2023-10-09T06:58:44.263422+0000","last_peered":"2023-10-09T06:58:44.263422+0000","last_clean":"2023-10-09T06:58:44.263422+0000","last_became_active":"2023-10-09T06:58:43.255990+0000","last_became_peered":"2023-10-09T06:58:43.255990+0000","last_unstale":"2023-10-09T06:58:44.263422+0000","last_undegraded":"2023-10-09T06:58:44.263422+0000","last_fullsized":"2023-10-09T06:58:44.263422+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:21.986566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779711+0000","last_change":"2023-10-09T06:58:43.252157+0000","last_active":"2023-10-09T06:58:43.779711+0000","last_peered":"2023-10-09T06:58:43.779711+0000","last_clean":"2023-10-09T06:58:43.779711+0000","last_became_active":"2023-10-09T06:58:43.251921+0000","last_became_peered":"2023-10-09T06:58:43.251921+0000","last_unstale":"2023-10-09T06:58:43.779711+0000","last_undegraded":"2023-10-09T06:58:43.779711+0000","last_fullsized":"2023-10-09T06:58:43.779711+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:14.775753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.239083+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:20:13.098656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792325+0000","last_change":"2023-10-09T06:58:43.787346+0000","last_active":"2023-10-09T06:58:43.792325+0000","last_peered":"2023-10-09T06:58:43.792325+0000","last_clean":"2023-10-09T06:58:43.792325+0000","last_became_active":"2023-10-09T06:58:43.786810+0000","last_became_peered":"2023-10-09T06:58:43.786810+0000","last_unstale":"2023-10-09T06:58:43.792325+0000","last_undegraded":"2023-10-09T06:58:43.792325+0000","last_fullsized":"2023-10-09T06:58:43.792325+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:39:57.258267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.239235+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:17.042939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779768+0000","last_change":"2023-10-09T06:58:43.253376+0000","last_active":"2023-10-09T06:58:43.779768+0000","last_peered":"2023-10-09T06:58:43.779768+0000","last_clean":"2023-10-09T06:58:43.779768+0000","last_became_active":"2023-10-09T06:58:43.253110+0000","last_became_peered":"2023-10-09T06:58:43.253110+0000","last_unstale":"2023-10-09T06:58:43.779768+0000","last_undegraded":"2023-10-09T06:58:43.779768+0000","last_fullsized":"2023-10-09T06:58:43.779768+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:56:21.112546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.789652+0000","last_change":"2023-10-09T06:58:43.784901+0000","last_active":"2023-10-09T06:58:43.789652+0000","last_peered":"2023-10-09T06:58:43.789652+0000","last_clean":"2023-10-09T06:58:43.789652+0000","last_became_active":"2023-10-09T06:58:43.784645+0000","last_became_peered":"2023-10-09T06:58:43.784645+0000","last_unstale":"2023-10-09T06:58:43.789652+0000","last_undegraded":"2023-10-09T06:58:43.789652+0000","last_fullsized":"2023-10-09T06:58:43.789652+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:56:33.524723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779732+0000","last_change":"2023-10-09T06:58:43.255156+0000","last_active":"2023-10-09T06:58:43.779732+0000","last_peered":"2023-10-09T06:58:43.779732+0000","last_clean":"2023-10-09T06:58:43.779732+0000","last_became_active":"2023-10-09T06:58:43.254884+0000","last_became_peered":"2023-10-09T06:58:43.254884+0000","last_unstale":"2023-10-09T06:58:43.779732+0000","last_undegraded":"2023-10-09T06:58:43.779732+0000","last_fullsized":"2023-10-09T06:58:43.779732+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:08.617277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.238885+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:12:27.841627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T06:58:43.231109+0000","last_change":"2023-10-09T06:58:43.231109+0000","last_active":"2023-10-09T06:58:43.231109+0000","last_peered":"2023-10-09T06:58:43.231109+0000","last_clean":"2023-10-09T06:58:43.231109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:43.231109+0000","last_undegraded":"2023-10-09T06:58:43.231109+0000","last_fullsized":"2023-10-09T06:58:43.231109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.781109+0000","last_change":"2023-10-09T06:58:43.256820+0000","last_active":"2023-10-09T06:58:43.781109+0000","last_peered":"2023-10-09T06:58:43.781109+0000","last_clean":"2023-10-09T06:58:43.781109+0000","last_became_active":"2023-10-09T06:58:43.256460+0000","last_became_peered":"2023-10-09T06:58:43.256460+0000","last_unstale":"2023-10-09T06:58:43.781109+0000","last_undegraded":"2023-10-09T06:58:43.781109+0000","last_fullsized":"2023-10-09T06:58:43.781109+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:51:46.519760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792081+0000","last_change":"2023-10-09T06:58:43.789965+0000","last_active":"2023-10-09T06:58:43.792081+0000","last_peered":"2023-10-09T06:58:43.792081+0000","last_clean":"2023-10-09T06:58:43.792081+0000","last_became_active":"2023-10-09T06:58:43.789716+0000","last_became_peered":"2023-10-09T06:58:43.789716+0000","last_unstale":"2023-10-09T06:58:43.792081+0000","last_undegraded":"2023-10-09T06:58:43.792081+0000","last_fullsized":"2023-10-09T06:58:43.792081+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:12:28.848971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T06:58:42.223765+0000","last_change":"2023-10-09T06:58:42.243296+0000","last_active":"2023-10-09T06:58:42.223765+0000","last_peered":"2023-10-09T06:58:42.223765+0000","last_clean":"2023-10-09T06:58:42.223765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T06:58:42.223765+0000","last_undegraded":"2023-10-09T06:58:42.223765+0000","last_fullsized":"2023-10-09T06:58:42.223765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:20.836176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"96'205","reported_seq":547,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-09T06:58:39.914795+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:58:39.914795+0000","last_peered":"2023-10-09T06:58:39.914795+0000","last_clean":"2023-10-09T06:58:39.914795+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:58:39.914795+0000","last_undegraded":"2023-10-09T06:58:39.914795+0000","last_fullsized":"2023-10-09T06:58:39.914795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":74,"acting":74,"num_store_stats":5},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23,"ondisk_log_size":23,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575041,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303200,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068640,"statfs":{"total":96636764160,"available":96326287360,"internally_reserved":0,"allocated":1859584,"data_stored":1203674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68400000000000005,"15min":0.70799999999999996},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.316},"max":{"1min":0.81100000000000005,"5min":1.732,"15min":1.9490000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.44,"5min":0.40200000000000002,"15min":0.29999999999999999},"max":{"1min":0.83299999999999996,"5min":1.22,"15min":3.448},"last":0.80700000000000005}]},{"osd":1,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.504,"5min":0.437,"15min":0.379},"max":{"1min":0.86799999999999999,"5min":2.3559999999999999,"15min":5.617},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.46999999999999997,"5min":0.45800000000000002,"15min":0.40200000000000002},"max":{"1min":0.97599999999999998,"5min":1.7869999999999999,"15min":2.016},"last":0.82199999999999995}]},{"osd":2,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.72999999999999998,"15min":0.73899999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.44800000000000001},"max":{"1min":0.97999999999999998,"5min":1.9430000000000001,"15min":2.052},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.73799999999999999,"15min":0.75600000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.44700000000000001},"max":{"1min":0.82399999999999995,"5min":2.6629999999999998,"15min":3.5019999999999998},"last":0.77200000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.73899999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.45000000000000001},"max":{"1min":0.97099999999999997,"5min":1.03,"15min":5.5800000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.746,"15min":0.78100000000000003},"min":{"1min":0.50800000000000001,"5min":0.496,"15min":0.47099999999999997},"max":{"1min":0.89800000000000002,"5min":1.827,"15min":6.9299999999999997},"last":0.74099999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.91000000000000003,"5min":0.95499999999999996,"15min":3.125},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.66500000000000004},"min":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1850000000000001,"5min":2.577,"15min":4.8380000000000001},"last":0.58599999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68700000000000006,"15min":0.68100000000000005},"min":{"1min":0.441,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":1.0309999999999999,"5min":2.5169999999999999,"15min":4.1929999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.5,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":2.9590000000000001,"15min":3.6749999999999998},"last":0.628}]},{"osd":6,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0449999999999999,"5min":3.0019999999999998,"15min":4.0250000000000004},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72699999999999998,"15min":0.752},"min":{"1min":0.498,"5min":0.47399999999999998,"15min":0.44700000000000001},"max":{"1min":1.0740000000000001,"5min":2.4039999999999999,"15min":7.0259999999999998},"last":0.69799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575040,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302632,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069208,"statfs":{"total":96636764160,"available":96326868992,"internally_reserved":0,"allocated":1277952,"data_stored":619503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68799999999999994,"15min":0.71399999999999997},"min":{"1min":0.47599999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86899999999999999,"5min":0.97899999999999998,"15min":1.022},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66700000000000004,"15min":0.70199999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.36599999999999999},"max":{"1min":0.72999999999999998,"5min":0.93899999999999995,"15min":1.079},"last":0.93200000000000005}]},{"osd":1,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.68799999999999994,"15min":0.71999999999999997},"min":{"1min":0.48199999999999998,"5min":0.45500000000000002,"15min":0.42799999999999999},"max":{"1min":0.76700000000000002,"5min":1.135,"15min":1.135},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68799999999999994,"15min":0.72499999999999998},"min":{"1min":0.47799999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81699999999999995,"5min":1.0109999999999999,"15min":1.034},"last":0.95299999999999996}]},{"osd":2,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.69999999999999996,"15min":0.73199999999999998},"min":{"1min":0.52300000000000002,"5min":0.49199999999999999,"15min":0.42599999999999999},"max":{"1min":0.86099999999999999,"5min":1.391,"15min":1.391},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.68799999999999994,"15min":0.73099999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90500000000000003,"5min":0.91000000000000003,"15min":1.0900000000000001},"last":0.73199999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66700000000000004,"15min":0.69899999999999995},"min":{"1min":0.502,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.81899999999999995,"5min":0.91700000000000004,"15min":1.046},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.72899999999999998,"15min":0.753},"min":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.497},"max":{"1min":0.82999999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.61099999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61399999999999999,"15min":0.621},"min":{"1min":0.38,"5min":0.38,"15min":0.377},"max":{"1min":0.84699999999999998,"5min":1.768,"15min":1.768},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.36199999999999999},"max":{"1min":0.84399999999999997,"5min":1.601,"15min":1.601},"last":0.98399999999999999}]},{"osd":5,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65500000000000003,"15min":0.65200000000000002},"min":{"1min":0.53100000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84099999999999997,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.42299999999999999},"max":{"1min":0.86699999999999999,"5min":0.94699999999999995,"15min":1.0669999999999999},"last":1.004}]},{"osd":7,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66900000000000004,"15min":0.67600000000000005},"min":{"1min":0.55600000000000005,"5min":0.42899999999999999,"15min":0.41799999999999998},"max":{"1min":0.95999999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.026},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56499999999999995,"5min":0.44600000000000001,"15min":0.42399999999999999},"max":{"1min":0.89600000000000002,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.86799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575042,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302680,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069160,"statfs":{"total":96636764160,"available":96326819840,"internally_reserved":0,"allocated":1327104,"data_stored":640187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.45600000000000002,"15min":0.45900000000000002},"min":{"1min":0.26600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48699999999999999,"15min":0.48499999999999999},"min":{"1min":0.313,"5min":0.29399999999999998,"15min":0.23699999999999999},"max":{"1min":1.1879999999999999,"5min":1.23,"15min":1.23},"last":0.56200000000000006}]},{"osd":2,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48299999999999998,"15min":0.495},"min":{"1min":0.34799999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.67700000000000005,"5min":1.169,"15min":1.169},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.3500000000000001,"5min":3.077,"15min":3.077},"last":0.58599999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.34100000000000003},"max":{"1min":1.6839999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.36099999999999999,"5min":0.34899999999999998,"15min":0.34100000000000003},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.60499999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.71999999999999997,"15min":0.75700000000000001},"min":{"1min":0.46700000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.995,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.745}]},{"osd":5,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.57699999999999996,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.74299999999999999,"15min":0.77900000000000003},"min":{"1min":0.52100000000000002,"5min":0.497,"15min":0.47999999999999998},"max":{"1min":1.0209999999999999,"5min":1.637,"15min":1.637},"last":0.79800000000000004}]},{"osd":6,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.78000000000000003,"15min":0.79600000000000004},"min":{"1min":0.55600000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77600000000000002,"15min":0.79800000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.86899999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.81999999999999995,"15min":0.82799999999999996},"min":{"1min":0.54400000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.4350000000000001,"5min":3.4350000000000001,"15min":3.4350000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77600000000000002,"15min":0.81899999999999995},"min":{"1min":0.51400000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1200000000000001,"5min":1.125,"15min":1.1970000000000001},"last":0.71799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575041,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299156,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072684,"statfs":{"total":96636764160,"available":96330428416,"internally_reserved":0,"allocated":1912832,"data_stored":1230395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.29299999999999998,"5min":0.27100000000000002,"15min":0.23000000000000001},"max":{"1min":0.623,"5min":0.85799999999999998,"15min":1.2729999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.28899999999999998},"max":{"1min":0.60399999999999998,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.63400000000000001,"5min":4.6980000000000004,"15min":4.6980000000000004},"last":0.436},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48999999999999999,"15min":0.497},"min":{"1min":0.34000000000000002,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.71799999999999997,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.41999999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":0.63800000000000001,"5min":1.2450000000000001,"15min":1.7130000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.441,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":0.70199999999999996,"5min":4.734,"15min":4.734},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.52900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99199999999999999,"5min":1.2270000000000001,"15min":1.752},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.50700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.91500000000000004,"5min":4.6619999999999999,"15min":4.6619999999999999},"last":0.79600000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.53700000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0049999999999999,"5min":1.1890000000000001,"15min":1.2769999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.58699999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90300000000000002,"5min":1.2809999999999999,"15min":1.7889999999999999},"last":0.69399999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.80500000000000005,"15min":0.81299999999999994},"min":{"1min":0.56499999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97299999999999998,"5min":4.6239999999999997,"15min":4.6239999999999997},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79300000000000004,"15min":0.80100000000000005},"min":{"1min":0.55600000000000005,"5min":0.50800000000000001,"15min":0.47999999999999998},"max":{"1min":0.96499999999999997,"5min":1.2689999999999999,"15min":1.4370000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.82499999999999996,"15min":0.83199999999999996},"min":{"1min":0.56299999999999994,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.042,"5min":1.256,"15min":1.518},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.621,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95599999999999996,"5min":1.702,"15min":1.8200000000000001},"last":0.81200000000000006}]}]},{"osd":2,"up_from":13,"seq":55834575041,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306768,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065072,"statfs":{"total":96636764160,"available":96322633728,"internally_reserved":0,"allocated":1318912,"data_stored":640547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.46800000000000003,"15min":0.45400000000000001},"min":{"1min":0.28299999999999997,"5min":0.26500000000000001,"15min":0.25900000000000001},"max":{"1min":0.76700000000000002,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.48999999999999999,"15min":0.495},"min":{"1min":0.30599999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.55300000000000005,"5min":1.633,"15min":1.633},"last":0.41799999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46400000000000002,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71599999999999997,"5min":1.097,"15min":1.865},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.79700000000000004,"5min":1.2689999999999999,"15min":1.79},"last":0.39100000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.58899999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.35799999999999998},"max":{"1min":0.82599999999999996,"5min":0.86699999999999999,"15min":1.8999999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.47399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70299999999999996,"5min":1.1890000000000001,"15min":1.8220000000000001},"last":0.49399999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":0.85799999999999998,"5min":1.2430000000000001,"15min":1.256},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.55000000000000004,"5min":0.45900000000000002,"15min":0.44800000000000001},"max":{"1min":0.91400000000000003,"5min":1.696,"15min":1.696},"last":0.96399999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.753,"15min":0.76800000000000002},"min":{"1min":0.505,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85199999999999998,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.143},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.503},"max":{"1min":0.83199999999999996,"5min":1.218,"15min":1.3440000000000001},"last":0.81799999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.54000000000000004,"5min":0.51000000000000001,"15min":0.48599999999999999},"max":{"1min":0.94899999999999995,"5min":1.768,"15min":1.768},"last":1.069},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.76400000000000001,"15min":0.79000000000000004},"min":{"1min":0.56599999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92900000000000005,"5min":1.3580000000000001,"15min":1.5309999999999999},"last":1.101}]},{"osd":7,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.61799999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97799999999999998,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.875},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.58699999999999997,"5min":0.57599999999999996,"15min":0.50900000000000001},"max":{"1min":0.92000000000000004,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.0209999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575042,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306776,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065064,"statfs":{"total":96636764160,"available":96322625536,"internally_reserved":0,"allocated":1327104,"data_stored":641529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.29599999999999999,"5min":0.29499999999999998,"15min":0.24099999999999999},"max":{"1min":0.86299999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.47899999999999998,"15min":0.48799999999999999},"min":{"1min":0.315,"5min":0.30199999999999999,"15min":0.28100000000000003},"max":{"1min":0.63600000000000001,"5min":1.228,"15min":1.228},"last":0.42599999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.48099999999999998,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58699999999999997,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.44500000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94099999999999995,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64800000000000002,"15min":0.63300000000000001},"min":{"1min":0.44400000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.97699999999999998,"5min":3.8900000000000001,"15min":3.8900000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.51100000000000001,"5min":0.48299999999999998,"15min":0.40799999999999997},"max":{"1min":0.76500000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.81000000000000005,"15min":0.82299999999999995},"min":{"1min":0.623,"5min":0.59399999999999997,"15min":0.52200000000000002},"max":{"1min":1.0189999999999999,"5min":1.22,"15min":1.22},"last":0.755}]},{"osd":5,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.45000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.86199999999999999,"5min":1.3360000000000001,"15min":2.1549999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.56399999999999995,"5min":0.55900000000000005,"15min":0.50600000000000001},"max":{"1min":1.0569999999999999,"5min":1.1639999999999999,"15min":1.419},"last":0.66800000000000004}]},{"osd":6,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.51700000000000002},"max":{"1min":0.875,"5min":1.304,"15min":1.304},"last":0.63},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95199999999999996,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91100000000000003,"5min":1.8180000000000001,"15min":2.0880000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.80800000000000005,"15min":0.82099999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92300000000000004,"5min":1.486,"15min":1.486},"last":0.71199999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575041,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310860,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060980,"statfs":{"total":96636764160,"available":96318443520,"internally_reserved":0,"allocated":1314816,"data_stored":639993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71399999999999997,"15min":0.70399999999999996},"min":{"1min":0.45000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79200000000000004,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.72799999999999998,"15min":0.72299999999999998},"min":{"1min":0.50900000000000001,"5min":0.42699999999999999,"15min":0.39300000000000002},"max":{"1min":0.97399999999999998,"5min":2.8130000000000002,"15min":3.23},"last":0.51000000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71899999999999997,"15min":0.71099999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.373},"max":{"1min":0.85699999999999998,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.53000000000000003,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.86499999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.71799999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.755,"15min":0.75700000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.38100000000000001},"max":{"1min":0.92900000000000005,"5min":2.5960000000000001,"15min":3.7509999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.48299999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90000000000000002,"5min":2.427,"15min":2.427},"last":0.68000000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.755,"15min":0.751},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.434},"max":{"1min":0.89700000000000002,"5min":2.6440000000000001,"15min":3.6970000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.77000000000000002,"15min":0.747},"min":{"1min":0.443,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":3.6899999999999999,"15min":3.6899999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63600000000000001,"15min":0.60899999999999999},"min":{"1min":0.379,"5min":0.317,"15min":0.317},"max":{"1min":0.84899999999999998,"5min":3.3860000000000001,"15min":3.4780000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.68999999999999995,"15min":0.65800000000000003},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.34999999999999998},"max":{"1min":0.91200000000000003,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.61899999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67100000000000004,"15min":0.64000000000000001},"min":{"1min":0.47699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82299999999999995,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.71499999999999997,"15min":0.67900000000000005},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.374},"max":{"1min":0.89100000000000001,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.82299999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.49299999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.96599999999999997,"5min":2.7210000000000001,"15min":3.2789999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.76900000000000002},"min":{"1min":0.56499999999999995,"5min":0.439,"15min":0.439},"max":{"1min":0.93600000000000005,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.752}]}]},{"osd":5,"up_from":13,"seq":55834575041,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302632,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069208,"statfs":{"total":96636764160,"available":96326868992,"internally_reserved":0,"allocated":1277952,"data_stored":619503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67600000000000005,"15min":0.69699999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.72299999999999998,"5min":0.93600000000000005,"15min":1.655},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65700000000000003,"15min":0.68400000000000005},"min":{"1min":0.42899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78200000000000003,"5min":1.0269999999999999,"15min":1.1359999999999999},"last":0.57999999999999996}]},{"osd":1,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71699999999999997,"5min":0.96899999999999997,"15min":2.4159999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.45400000000000001,"5min":0.44,"15min":0.40400000000000003},"max":{"1min":0.89100000000000001,"5min":0.95099999999999996,"15min":1.706},"last":0.60999999999999999}]},{"osd":2,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69699999999999995,"15min":0.72799999999999998},"min":{"1min":0.501,"5min":0.48499999999999999,"15min":0.42999999999999999},"max":{"1min":0.75800000000000001,"5min":0.997,"15min":1.79},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69699999999999995,"15min":0.71599999999999997},"min":{"1min":0.49199999999999999,"5min":0.46500000000000002,"15min":0.442},"max":{"1min":0.752,"5min":1.006,"15min":2.4889999999999999},"last":0.46200000000000002}]},{"osd":3,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68999999999999995,"15min":0.71699999999999997},"min":{"1min":0.46899999999999997,"5min":0.438,"15min":0.435},"max":{"1min":0.88600000000000001,"5min":1.0209999999999999,"15min":1.409},"last":0.629},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73899999999999999,"15min":0.76900000000000002},"min":{"1min":0.56200000000000006,"5min":0.501,"15min":0.501},"max":{"1min":0.78600000000000003,"5min":0.95699999999999996,"15min":2.532},"last":0.64400000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":1.766},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.622,"15min":0.621},"min":{"1min":0.48599999999999999,"5min":0.377,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":1.052,"15min":2.7829999999999999},"last":0.39600000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.45100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82899999999999996,"5min":1.018,"15min":2.5739999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.40000000000000002,"15min":0.38900000000000001},"max":{"1min":0.84099999999999997,"5min":0.97999999999999998,"15min":1.8080000000000001},"last":0.41199999999999998}]},{"osd":7,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.90700000000000003,"5min":1.175,"15min":2.9609999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.60499999999999998,"5min":0.498,"15min":0.45900000000000002},"max":{"1min":0.876,"5min":1.139,"15min":2.613},"last":0.68899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:58:49.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2023-10-09T06:58:49.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2023-10-09T06:58:49.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2023-10-09T06:58:49.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2023-10-09T06:58:49.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2023-10-09T06:58:49.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2023-10-09T06:58:49.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2023-10-09T06:58:49.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2023-10-09T06:58:49.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2023-10-09T06:58:49.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2023-10-09T06:58:49.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2023-10-09T06:58:49.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2023-10-09T06:58:49.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2023-10-09T06:58:49.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:42.223765+0000', 'last_change': '2023-10-09T06:58:42.240443+0000', 'last_active': '2023-10-09T06:58:42.223765+0000', 'last_peered': '2023-10-09T06:58:42.223765+0000', 'last_clean': '2023-10-09T06:58:42.223765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:42.223765+0000', 'last_undegraded': '2023-10-09T06:58:42.223765+0000', 'last_fullsized': '2023-10-09T06:58:42.223765+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T08:46:58.364775+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:58:49.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2023-10-09T06:58:49.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2023-10-09T06:58:49.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2023-10-09T06:58:49.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2023-10-09T06:58:49.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2023-10-09T06:58:49.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:42.223765+0000', 'last_change': '2023-10-09T06:58:42.240034+0000', 'last_active': '2023-10-09T06:58:42.223765+0000', 'last_peered': '2023-10-09T06:58:42.223765+0000', 'last_clean': '2023-10-09T06:58:42.223765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:42.223765+0000', 'last_undegraded': '2023-10-09T06:58:42.223765+0000', 'last_fullsized': '2023-10-09T06:58:42.223765+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:28:53.286318+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:58:49.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2023-10-09T06:58:49.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2023-10-09T06:58:49.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:42.223765+0000', 'last_change': '2023-10-09T06:58:42.238954+0000', 'last_active': '2023-10-09T06:58:42.223765+0000', 'last_peered': '2023-10-09T06:58:42.223765+0000', 'last_clean': '2023-10-09T06:58:42.223765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:42.223765+0000', 'last_undegraded': '2023-10-09T06:58:42.223765+0000', 'last_fullsized': '2023-10-09T06:58:42.223765+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:12:25.449105+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:58:49.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2023-10-09T06:58:49.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:42.223765+0000', 'last_change': '2023-10-09T06:58:42.240065+0000', 'last_active': '2023-10-09T06:58:42.223765+0000', 'last_peered': '2023-10-09T06:58:42.223765+0000', 'last_clean': '2023-10-09T06:58:42.223765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:42.223765+0000', 'last_undegraded': '2023-10-09T06:58:42.223765+0000', 'last_fullsized': '2023-10-09T06:58:42.223765+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:53:13.134122+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:58:49.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2023-10-09T06:58:49.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:42.223765+0000', 'last_change': '2023-10-09T06:58:42.235537+0000', 'last_active': '2023-10-09T06:58:42.223765+0000', 'last_peered': '2023-10-09T06:58:42.223765+0000', 'last_clean': '2023-10-09T06:58:42.223765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:42.223765+0000', 'last_undegraded': '2023-10-09T06:58:42.223765+0000', 'last_fullsized': '2023-10-09T06:58:42.223765+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:09:17.947780+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:58:49.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2023-10-09T06:58:49.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2023-10-09T06:58:49.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:42.223765+0000', 'last_change': '2023-10-09T06:58:42.235578+0000', 'last_active': '2023-10-09T06:58:42.223765+0000', 'last_peered': '2023-10-09T06:58:42.223765+0000', 'last_clean': '2023-10-09T06:58:42.223765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:42.223765+0000', 'last_undegraded': '2023-10-09T06:58:42.223765+0000', 'last_fullsized': '2023-10-09T06:58:42.223765+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T07:46:31.472275+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T06:58:49.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2023-10-09T06:58:49.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2023-10-09T06:58:49.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:42.223765+0000', 'last_change': '2023-10-09T06:58:42.239441+0000', 'last_active': '2023-10-09T06:58:42.223765+0000', 'last_peered': '2023-10-09T06:58:42.223765+0000', 'last_clean': '2023-10-09T06:58:42.223765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:42.223765+0000', 'last_undegraded': '2023-10-09T06:58:42.223765+0000', 'last_fullsized': '2023-10-09T06:58:42.223765+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:37:10.885711+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:58:49.495 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2023-10-09T06:58:49.495 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.495 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2023-10-09T06:58:49.495 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.495 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2023-10-09T06:58:49.495 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.495 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2023-10-09T06:58:49.495 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.495 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2023-10-09T06:58:49.496 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.496 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2023-10-09T06:58:49.496 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:42.223765+0000', 'last_change': '2023-10-09T06:58:42.239083+0000', 'last_active': '2023-10-09T06:58:42.223765+0000', 'last_peered': '2023-10-09T06:58:42.223765+0000', 'last_clean': '2023-10-09T06:58:42.223765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:42.223765+0000', 'last_undegraded': '2023-10-09T06:58:42.223765+0000', 'last_fullsized': '2023-10-09T06:58:42.223765+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T09:20:13.098656+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:58:49.496 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2023-10-09T06:58:49.496 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:42.223765+0000', 'last_change': '2023-10-09T06:58:42.239235+0000', 'last_active': '2023-10-09T06:58:42.223765+0000', 'last_peered': '2023-10-09T06:58:42.223765+0000', 'last_clean': '2023-10-09T06:58:42.223765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:42.223765+0000', 'last_undegraded': '2023-10-09T06:58:42.223765+0000', 'last_fullsized': '2023-10-09T06:58:42.223765+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:48:17.042939+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:58:49.496 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2023-10-09T06:58:49.496 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.496 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2023-10-09T06:58:49.496 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2023-10-09T06:58:49.497 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:42.223765+0000', 'last_change': '2023-10-09T06:58:42.238885+0000', 'last_active': '2023-10-09T06:58:42.223765+0000', 'last_peered': '2023-10-09T06:58:42.223765+0000', 'last_clean': '2023-10-09T06:58:42.223765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:42.223765+0000', 'last_undegraded': '2023-10-09T06:58:42.223765+0000', 'last_fullsized': '2023-10-09T06:58:42.223765+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:12:27.841627+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T06:58:49.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2023-10-09T06:58:49.497 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T06:58:43.231109+0000', 'last_change': '2023-10-09T06:58:43.231109+0000', 'last_active': '2023-10-09T06:58:43.231109+0000', 'last_peered': '2023-10-09T06:58:43.231109+0000', 'last_clean': '2023-10-09T06:58:43.231109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:43.231109+0000', 'last_undegraded': '2023-10-09T06:58:43.231109+0000', 'last_fullsized': '2023-10-09T06:58:43.231109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:43.231109+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T06:58:49.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2023-10-09T06:58:49.497 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T06:58:42.223765+0000', 'last_change': '2023-10-09T06:58:42.243296+0000', 'last_active': '2023-10-09T06:58:42.223765+0000', 'last_peered': '2023-10-09T06:58:42.223765+0000', 'last_clean': '2023-10-09T06:58:42.223765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T06:58:42.223765+0000', 'last_undegraded': '2023-10-09T06:58:42.223765+0000', 'last_fullsized': '2023-10-09T06:58:42.223765+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'last_clean_scrub_stamp': '2023-10-09T06:58:42.223765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:49:20.836176+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T06:58:49.498 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T06:58:49.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.700+0000 7fb019bff700 1 Processor -- start 2023-10-09T06:58:49.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.700+0000 7fb019bff700 1 -- start start 2023-10-09T06:58:49.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.701+0000 7fb019bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb014157770 0x7fb014157b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:49.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.701+0000 7fb019bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0140abd30 0x7fb0140cce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:49.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.701+0000 7fb019bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0140acdd0 con 0x7fb0140b1600 2023-10-09T06:58:49.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.702+0000 7fb019bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0140ac1c0 con 0x7fb014157770 2023-10-09T06:58:49.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.702+0000 7fb019bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0140ac4a0 con 0x7fb0140abd30 2023-10-09T06:58:49.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.702+0000 7fb0137fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb014157770 0x7fb014157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:49.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.702+0000 7fb012ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0140abd30 0x7fb0140cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:49.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.702+0000 7fb0137fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb014157770 0x7fb014157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:36408/0 (socket says 172.21.15.71:36408) 2023-10-09T06:58:49.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.702+0000 7fb012ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0140abd30 0x7fb0140cce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:55924/0 (socket says 172.21.15.71:55924) 2023-10-09T06:58:49.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.702+0000 7fb013fff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb0140b1600 0x7fb0140ca780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:36410/0 (socket says 172.21.15.71:36410) 2023-10-09T06:58:49.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.702+0000 7fb0137fe700 1 -- 172.21.15.71:0/3929190455 learned_addr learned my addr 172.21.15.71:0/3929190455 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:49.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.703+0000 7fb0137fe700 1 -- 172.21.15.71:0/3929190455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0140abd30 msgr2=0x7fb0140cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:49.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.703+0000 7fb0137fe700 1 --2- 172.21.15.71:0/3929190455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0140abd30 0x7fb0140cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.703+0000 7fb0137fe700 1 -- 172.21.15.71:0/3929190455 >> v1:172.21.15.179:6789/0 conn(0x7fb0140b1600 legacy=0x7fb0140ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:49.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.703+0000 7fb0137fe700 1 -- 172.21.15.71:0/3929190455 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0140ac780 con 0x7fb014157770 2023-10-09T06:58:49.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.703+0000 7fb0127fc700 1 -- 172.21.15.71:0/3929190455 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2578046495 0 0) 0x7fb0140acdd0 con 0x7fb0140b1600 2023-10-09T06:58:49.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.703+0000 7fb0137fe700 1 --2- 172.21.15.71:0/3929190455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb014157770 0x7fb014157b40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb0040099b0 tx=0x7fb004009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=830a4466a1fa8b16 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:49.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.704+0000 7fb0127fc700 1 -- 172.21.15.71:0/3929190455 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb004009ea0 con 0x7fb014157770 2023-10-09T06:58:49.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.704+0000 7fb0127fc700 1 -- 172.21.15.71:0/3929190455 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00400b860 con 0x7fb014157770 2023-10-09T06:58:49.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.704+0000 7fb0127fc700 1 -- 172.21.15.71:0/3929190455 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00400bc00 con 0x7fb014157770 2023-10-09T06:58:49.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.704+0000 7fb019bff700 1 -- 172.21.15.71:0/3929190455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb014157770 msgr2=0x7fb014157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:49.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.704+0000 7fb019bff700 1 --2- 172.21.15.71:0/3929190455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb014157770 0x7fb014157b40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb0040099b0 tx=0x7fb004009250 comp rx=0 tx=0).stop 2023-10-09T06:58:49.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.704+0000 7fb019bff700 1 -- 172.21.15.71:0/3929190455 shutdown_connections 2023-10-09T06:58:49.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.704+0000 7fb019bff700 1 --2- 172.21.15.71:0/3929190455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb014157770 0x7fb014157b40 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.704+0000 7fb019bff700 1 --2- 172.21.15.71:0/3929190455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0140abd30 0x7fb0140cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.704+0000 7fb019bff700 1 -- 172.21.15.71:0/3929190455 >> 172.21.15.71:0/3929190455 conn(0x7fb01406a310 msgr2=0x7fb0140cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:49.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.704+0000 7fb019bff700 1 -- 172.21.15.71:0/3929190455 shutdown_connections 2023-10-09T06:58:49.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.704+0000 7fb019bff700 1 -- 172.21.15.71:0/3929190455 wait complete. 2023-10-09T06:58:49.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.706+0000 7fb019bff700 1 Processor -- start 2023-10-09T06:58:49.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.706+0000 7fb019bff700 1 -- start start 2023-10-09T06:58:49.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.707+0000 7fb019bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0140abd30 0x7fb0141590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:49.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.707+0000 7fb019bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0140b1600 0x7fb01415cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:49.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.707+0000 7fb019bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb014157770 0x7fb014150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:49.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.707+0000 7fb019bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01415b040 con 0x7fb014157770 2023-10-09T06:58:49.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.707+0000 7fb019bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01415d300 con 0x7fb0140b1600 2023-10-09T06:58:49.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.707+0000 7fb019bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0141676c0 con 0x7fb0140abd30 2023-10-09T06:58:49.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.707+0000 7fb013fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb014157770 0x7fb014150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:49.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.707+0000 7fb013fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb014157770 0x7fb014150e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36740/0 (socket says 172.21.15.71:36740) 2023-10-09T06:58:49.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.707+0000 7fb013fff700 1 -- 172.21.15.71:0/868153897 learned_addr learned my addr 172.21.15.71:0/868153897 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:49.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.707+0000 7fb0137fe700 1 --2- 172.21.15.71:0/868153897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0140abd30 0x7fb0141590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:49.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.707+0000 7fb012ffd700 1 --2- 172.21.15.71:0/868153897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0140b1600 0x7fb01415cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:49.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.707+0000 7fb013fff700 1 -- 172.21.15.71:0/868153897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0140abd30 msgr2=0x7fb0141590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:49.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.707+0000 7fb013fff700 1 --2- 172.21.15.71:0/868153897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0140abd30 0x7fb0141590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.707+0000 7fb013fff700 1 -- 172.21.15.71:0/868153897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0140b1600 msgr2=0x7fb01415cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:49.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.707+0000 7fb013fff700 1 --2- 172.21.15.71:0/868153897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0140b1600 0x7fb01415cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.707+0000 7fb013fff700 1 -- 172.21.15.71:0/868153897 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0040094f0 con 0x7fb014157770 2023-10-09T06:58:49.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.708+0000 7fb013fff700 1 --2- 172.21.15.71:0/868153897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb014157770 0x7fb014150e00 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00cd50 tx=0x7fb00c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:49.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.708+0000 7faffb7fe700 1 -- 172.21.15.71:0/868153897 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c005df0 con 0x7fb014157770 2023-10-09T06:58:49.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.708+0000 7faffb7fe700 1 -- 172.21.15.71:0/868153897 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c00a8b0 con 0x7fb014157770 2023-10-09T06:58:49.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.708+0000 7fb019bff700 1 -- 172.21.15.71:0/868153897 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb014159690 con 0x7fb014157770 2023-10-09T06:58:49.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.708+0000 7faffb7fe700 1 -- 172.21.15.71:0/868153897 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c00ac70 con 0x7fb014157770 2023-10-09T06:58:49.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.708+0000 7fb019bff700 1 -- 172.21.15.71:0/868153897 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb014159cd0 con 0x7fb014157770 2023-10-09T06:58:49.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.709+0000 7fb019bff700 1 -- 172.21.15.71:0/868153897 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01404c3c0 con 0x7fb014157770 2023-10-09T06:58:49.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.710+0000 7faffb7fe700 1 -- 172.21.15.71:0/868153897 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb00c007300 con 0x7fb014157770 2023-10-09T06:58:49.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.711+0000 7faffb7fe700 1 --2- 172.21.15.71:0/868153897 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb000066f30 0x7fb0000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:49.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.711+0000 7faffb7fe700 1 -- 172.21.15.71:0/868153897 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fb00c084840 con 0x7fb014157770 2023-10-09T06:58:49.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.711+0000 7fb0137fe700 1 --2- 172.21.15.71:0/868153897 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb000066f30 0x7fb0000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:49.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.712+0000 7fb0137fe700 1 --2- 172.21.15.71:0/868153897 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb000066f30 0x7fb0000693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb0040099b0 tx=0x7fb004017000 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:49.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.715+0000 7faffb7fe700 1 -- 172.21.15.71:0/868153897 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb00c051900 con 0x7fb014157770 2023-10-09T06:58:49.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.982+0000 7fb019bff700 1 -- 172.21.15.71:0/868153897 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb014159ff0 con 0x7fb014157770 2023-10-09T06:58:49.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.983+0000 7faffb7fe700 1 -- 172.21.15.71:0/868153897 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1178 (secure 0 0 0) 0x7fb00c054f20 con 0x7fb014157770 2023-10-09T06:58:49.984 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:49.984 INFO:teuthology.orchestra.run.smithi071.stdout:{"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":996,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1696833745,"num_in_osds":8,"osd_in_since":1696833737,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":59},{"state_name":"unknown","count":27},{"state_name":"creating+peering","count":11}],"num_pgs":97,"num_pools":3,"num_objects":13,"data_bytes":590402,"bytes_used":2493136896,"bytes_avail":770600976384,"bytes_total":773094113280,"unknown_pgs_ratio":0.27835050225257874,"inactive_pgs_ratio":0.11340206116437912,"write_bytes_sec":1070,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":49,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"d","status":"up:active","gid":7152}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-10-09T06:56:28.809427+0000","services":{}},"progress_events":{}} 2023-10-09T06:58:49.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.985+0000 7fb019bff700 1 -- 172.21.15.71:0/868153897 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb000066f30 msgr2=0x7fb0000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:49.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.985+0000 7fb019bff700 1 --2- 172.21.15.71:0/868153897 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb000066f30 0x7fb0000693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb0040099b0 tx=0x7fb004017000 comp rx=0 tx=0).stop 2023-10-09T06:58:49.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.985+0000 7fb019bff700 1 -- 172.21.15.71:0/868153897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb014157770 msgr2=0x7fb014150e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:49.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.985+0000 7fb019bff700 1 --2- 172.21.15.71:0/868153897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb014157770 0x7fb014150e00 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00cd50 tx=0x7fb00c001b10 comp rx=0 tx=0).stop 2023-10-09T06:58:49.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.985+0000 7fb019bff700 1 -- 172.21.15.71:0/868153897 shutdown_connections 2023-10-09T06:58:49.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.985+0000 7fb019bff700 1 --2- 172.21.15.71:0/868153897 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fb000066f30 0x7fb0000693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.985+0000 7fb019bff700 1 --2- 172.21.15.71:0/868153897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb014157770 0x7fb014150e00 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.985+0000 7fb019bff700 1 --2- 172.21.15.71:0/868153897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0140abd30 0x7fb0141590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.985+0000 7fb019bff700 1 --2- 172.21.15.71:0/868153897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0140b1600 0x7fb01415cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:49.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.985+0000 7fb019bff700 1 -- 172.21.15.71:0/868153897 >> 172.21.15.71:0/868153897 conn(0x7fb01406a310 msgr2=0x7fb0140ae190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:49.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.985+0000 7fb019bff700 1 -- 172.21.15.71:0/868153897 shutdown_connections 2023-10-09T06:58:49.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:49.985+0000 7fb019bff700 1 -- 172.21.15.71:0/868153897 wait complete. 2023-10-09T06:58:50.003 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T06:58:50.003 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:58:50.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.185+0000 7f587a79d700 1 Processor -- start 2023-10-09T06:58:50.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.185+0000 7f587a79d700 1 -- start start 2023-10-09T06:58:50.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.186+0000 7f587a79d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f58741566e0 0x7f58740ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:50.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.186+0000 7f587a79d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f58740cb900 0x7f58740ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:50.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.186+0000 7f587a79d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58740ca860 con 0x7f5874156310 2023-10-09T06:58:50.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.186+0000 7f587a79d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58740cab40 con 0x7f58740cb900 2023-10-09T06:58:50.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.186+0000 7f587a79d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58740cae20 con 0x7f58741566e0 2023-10-09T06:58:50.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.186+0000 7f5879f9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f58740cb900 0x7f58740ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:50.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.186+0000 7f5879f9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f58740cb900 0x7f58740ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36750/0 (socket says 172.21.15.71:36750) 2023-10-09T06:58:50.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.186+0000 7f5879f9c700 1 -- 172.21.15.71:0/374348811 learned_addr learned my addr 172.21.15.71:0/374348811 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:50.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.186+0000 7f5878f9a700 1 --2- 172.21.15.71:0/374348811 >> v2:172.21.15.179:3300/0 conn(0x7f58741566e0 0x7f58740ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:50.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.187+0000 7f5879f9c700 1 -- 172.21.15.71:0/374348811 >> v2:172.21.15.179:3300/0 conn(0x7f58741566e0 msgr2=0x7f58740ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:50.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.187+0000 7f5879f9c700 1 --2- 172.21.15.71:0/374348811 >> v2:172.21.15.179:3300/0 conn(0x7f58741566e0 0x7f58740ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:50.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.187+0000 7f5879f9c700 1 -- 172.21.15.71:0/374348811 >> v1:172.21.15.179:6789/0 conn(0x7f5874156310 legacy=0x7f58740c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:50.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.187+0000 7f5879f9c700 1 -- 172.21.15.71:0/374348811 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58740cb100 con 0x7f58740cb900 2023-10-09T06:58:50.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.187+0000 7f586bfff700 1 -- 172.21.15.71:0/374348811 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254874038 0 0) 0x7f58740ca860 con 0x7f5874156310 2023-10-09T06:58:50.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.187+0000 7f5879f9c700 1 --2- 172.21.15.71:0/374348811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58740cb900 0x7f58740ae540 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f587406c000 tx=0x7f586c00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489d7d6c14b5d64d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:50.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.187+0000 7f586bfff700 1 -- 172.21.15.71:0/374348811 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c010070 con 0x7f58740cb900 2023-10-09T06:58:50.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.187+0000 7f586bfff700 1 -- 172.21.15.71:0/374348811 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586c00dde0 con 0x7f58740cb900 2023-10-09T06:58:50.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.187+0000 7f586bfff700 1 -- 172.21.15.71:0/374348811 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c00b320 con 0x7f58740cb900 2023-10-09T06:58:50.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.188+0000 7f587a79d700 1 -- 172.21.15.71:0/374348811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58740cb900 msgr2=0x7f58740ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:50.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.188+0000 7f587a79d700 1 --2- 172.21.15.71:0/374348811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58740cb900 0x7f58740ae540 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f587406c000 tx=0x7f586c00ba50 comp rx=0 tx=0).stop 2023-10-09T06:58:50.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.188+0000 7f587a79d700 1 -- 172.21.15.71:0/374348811 shutdown_connections 2023-10-09T06:58:50.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.188+0000 7f587a79d700 1 --2- 172.21.15.71:0/374348811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58740cb900 0x7f58740ae540 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:50.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.188+0000 7f587a79d700 1 --2- 172.21.15.71:0/374348811 >> v2:172.21.15.179:3300/0 conn(0x7f58741566e0 0x7f58740ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:50.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.188+0000 7f587a79d700 1 -- 172.21.15.71:0/374348811 >> 172.21.15.71:0/374348811 conn(0x7f58740cc1f0 msgr2=0x7f58740cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:50.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.188+0000 7f587a79d700 1 -- 172.21.15.71:0/374348811 shutdown_connections 2023-10-09T06:58:50.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.188+0000 7f587a79d700 1 -- 172.21.15.71:0/374348811 wait complete. 2023-10-09T06:58:50.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.189+0000 7f587a79d700 1 Processor -- start 2023-10-09T06:58:50.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.190+0000 7f587a79d700 1 -- start start 2023-10-09T06:58:50.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.190+0000 7f587a79d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58740cb900 0x7f587416cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:50.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.190+0000 7f587a79d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5874156310 0x7f58740b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:50.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.191+0000 7f587a79d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58741566e0 0x7f5874140b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:50.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.191+0000 7f587a79d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587414c4b0 con 0x7f5874156310 2023-10-09T06:58:50.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.191+0000 7f587a79d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587416d5a0 con 0x7f58740cb900 2023-10-09T06:58:50.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.191+0000 7f587a79d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587416d880 con 0x7f58741566e0 2023-10-09T06:58:50.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.191+0000 7f5878f9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5874156310 0x7f58740b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:50.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.191+0000 7f5878f9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5874156310 0x7f58740b19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36760/0 (socket says 172.21.15.71:36760) 2023-10-09T06:58:50.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.191+0000 7f5878f9a700 1 -- 172.21.15.71:0/2562758200 learned_addr learned my addr 172.21.15.71:0/2562758200 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:50.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.191+0000 7f5879f9c700 1 --2- 172.21.15.71:0/2562758200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58741566e0 0x7f5874140b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:50.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.191+0000 7f587979b700 1 --2- 172.21.15.71:0/2562758200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58740cb900 0x7f587416cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:50.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.191+0000 7f5878f9a700 1 -- 172.21.15.71:0/2562758200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58741566e0 msgr2=0x7f5874140b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:50.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.191+0000 7f5878f9a700 1 --2- 172.21.15.71:0/2562758200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58741566e0 0x7f5874140b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:50.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.191+0000 7f5878f9a700 1 -- 172.21.15.71:0/2562758200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58740cb900 msgr2=0x7f587416cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:50.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.191+0000 7f5878f9a700 1 --2- 172.21.15.71:0/2562758200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58740cb900 0x7f587416cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:50.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.191+0000 7f5878f9a700 1 -- 172.21.15.71:0/2562758200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586c00bcf0 con 0x7f5874156310 2023-10-09T06:58:50.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.191+0000 7f587979b700 1 --2- 172.21.15.71:0/2562758200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58740cb900 0x7f587416cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:50.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.191+0000 7f5879f9c700 1 --2- 172.21.15.71:0/2562758200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58741566e0 0x7f5874140b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:50.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.192+0000 7f5878f9a700 1 --2- 172.21.15.71:0/2562758200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5874156310 0x7f58740b19d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f586400ec50 tx=0x7f58640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:50.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.192+0000 7f58697fa700 1 -- 172.21.15.71:0/2562758200 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586400c9d0 con 0x7f5874156310 2023-10-09T06:58:50.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.192+0000 7f58697fa700 1 -- 172.21.15.71:0/2562758200 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586400cb30 con 0x7f5874156310 2023-10-09T06:58:50.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.192+0000 7f58697fa700 1 -- 172.21.15.71:0/2562758200 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864013470 con 0x7f5874156310 2023-10-09T06:58:50.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.192+0000 7f587a79d700 1 -- 172.21.15.71:0/2562758200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587416db60 con 0x7f5874156310 2023-10-09T06:58:50.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.192+0000 7f587a79d700 1 -- 172.21.15.71:0/2562758200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5874141080 con 0x7f5874156310 2023-10-09T06:58:50.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.193+0000 7f587a79d700 1 -- 172.21.15.71:0/2562758200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587404c3c0 con 0x7f5874156310 2023-10-09T06:58:50.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.194+0000 7f58697fa700 1 -- 172.21.15.71:0/2562758200 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5864013820 con 0x7f5874156310 2023-10-09T06:58:50.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.195+0000 7f58697fa700 1 --2- 172.21.15.71:0/2562758200 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5858066f60 0x7f5858069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:50.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.195+0000 7f58697fa700 1 -- 172.21.15.71:0/2562758200 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f58640847e0 con 0x7f5874156310 2023-10-09T06:58:50.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.195+0000 7f587979b700 1 --2- 172.21.15.71:0/2562758200 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5858066f60 0x7f5858069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:50.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.196+0000 7f587979b700 1 --2- 172.21.15.71:0/2562758200 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5858066f60 0x7f5858069410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f58700011e0 tx=0x7f5870009040 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:50.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.198+0000 7f58697fa700 1 -- 172.21.15.71:0/2562758200 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5864051820 con 0x7f5874156310 2023-10-09T06:58:50.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.387+0000 7f587a79d700 1 -- 172.21.15.71:0/2562758200 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f587416d9f0 con 0x7f5858066f60 2023-10-09T06:58:50.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.396+0000 7f58697fa700 1 -- 172.21.15.71:0/2562758200 <== mgr.6718 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289535 (secure 0 0 0) 0x7f587416d9f0 con 0x7f5858066f60 2023-10-09T06:58:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:50.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.400+0000 7f587a79d700 1 -- 172.21.15.71:0/2562758200 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5858066f60 msgr2=0x7f5858069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:50.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.400+0000 7f587a79d700 1 --2- 172.21.15.71:0/2562758200 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5858066f60 0x7f5858069410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f58700011e0 tx=0x7f5870009040 comp rx=0 tx=0).stop 2023-10-09T06:58:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.400+0000 7f587a79d700 1 -- 172.21.15.71:0/2562758200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5874156310 msgr2=0x7f58740b19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.400+0000 7f587a79d700 1 --2- 172.21.15.71:0/2562758200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5874156310 0x7f58740b19d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f586400ec50 tx=0x7f58640091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.400+0000 7f587a79d700 1 -- 172.21.15.71:0/2562758200 shutdown_connections 2023-10-09T06:58:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.400+0000 7f587a79d700 1 --2- 172.21.15.71:0/2562758200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58741566e0 0x7f5874140b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.400+0000 7f587a79d700 1 --2- 172.21.15.71:0/2562758200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58740cb900 0x7f587416cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.400+0000 7f587a79d700 1 --2- 172.21.15.71:0/2562758200 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f5858066f60 0x7f5858069410 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.400+0000 7f587a79d700 1 --2- 172.21.15.71:0/2562758200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5874156310 0x7f58740b19d0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.400+0000 7f587a79d700 1 -- 172.21.15.71:0/2562758200 >> 172.21.15.71:0/2562758200 conn(0x7f58740cc1f0 msgr2=0x7f58740c2560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.400+0000 7f587a79d700 1 -- 172.21.15.71:0/2562758200 shutdown_connections 2023-10-09T06:58:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:50.400+0000 7f587a79d700 1 -- 172.21.15.71:0/2562758200 wait complete. 2023-10-09T06:58:50.404 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:58:50.419 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-09T06:58:49.973240+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":363,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":243,"ondisk_log_size":243,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434856,"kb_used_data":11496,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752539864,"statfs":{"total":773094113280,"available":770600820736,"internally_reserved":0,"allocated":11771904,"data_stored":6305292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.737649"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801963+0000","last_change":"2023-10-09T06:58:43.799264+0000","last_active":"2023-10-09T06:58:43.801963+0000","last_peered":"2023-10-09T06:58:43.801963+0000","last_clean":"2023-10-09T06:58:43.801963+0000","last_became_active":"2023-10-09T06:58:43.799025+0000","last_became_peered":"2023-10-09T06:58:43.799025+0000","last_unstale":"2023-10-09T06:58:43.801963+0000","last_undegraded":"2023-10-09T06:58:43.801963+0000","last_fullsized":"2023-10-09T06:58:43.801963+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:08.320839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.800454+0000","last_change":"2023-10-09T06:58:43.799501+0000","last_active":"2023-10-09T06:58:43.800454+0000","last_peered":"2023-10-09T06:58:43.800454+0000","last_clean":"2023-10-09T06:58:43.800454+0000","last_became_active":"2023-10-09T06:58:43.799241+0000","last_became_peered":"2023-10-09T06:58:43.799241+0000","last_unstale":"2023-10-09T06:58:43.800454+0000","last_undegraded":"2023-10-09T06:58:43.800454+0000","last_fullsized":"2023-10-09T06:58:43.800454+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:11.893055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801813+0000","last_change":"2023-10-09T06:58:43.798217+0000","last_active":"2023-10-09T06:58:43.801813+0000","last_peered":"2023-10-09T06:58:43.801813+0000","last_clean":"2023-10-09T06:58:43.801813+0000","last_became_active":"2023-10-09T06:58:43.797956+0000","last_became_peered":"2023-10-09T06:58:43.797956+0000","last_unstale":"2023-10-09T06:58:43.801813+0000","last_undegraded":"2023-10-09T06:58:43.801813+0000","last_fullsized":"2023-10-09T06:58:43.801813+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:51:20.343477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796119+0000","last_change":"2023-10-09T06:58:43.794396+0000","last_active":"2023-10-09T06:58:43.796119+0000","last_peered":"2023-10-09T06:58:43.796119+0000","last_clean":"2023-10-09T06:58:43.796119+0000","last_became_active":"2023-10-09T06:58:43.794124+0000","last_became_peered":"2023-10-09T06:58:43.794124+0000","last_unstale":"2023-10-09T06:58:43.796119+0000","last_undegraded":"2023-10-09T06:58:43.796119+0000","last_fullsized":"2023-10-09T06:58:43.796119+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:26:49.171285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796255+0000","last_change":"2023-10-09T06:58:43.791324+0000","last_active":"2023-10-09T06:58:43.796255+0000","last_peered":"2023-10-09T06:58:43.796255+0000","last_clean":"2023-10-09T06:58:43.796255+0000","last_became_active":"2023-10-09T06:58:43.790853+0000","last_became_peered":"2023-10-09T06:58:43.790853+0000","last_unstale":"2023-10-09T06:58:43.796255+0000","last_undegraded":"2023-10-09T06:58:43.796255+0000","last_fullsized":"2023-10-09T06:58:43.796255+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:36.821271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796374+0000","last_change":"2023-10-09T06:58:43.792454+0000","last_active":"2023-10-09T06:58:43.796374+0000","last_peered":"2023-10-09T06:58:43.796374+0000","last_clean":"2023-10-09T06:58:43.796374+0000","last_became_active":"2023-10-09T06:58:43.790825+0000","last_became_peered":"2023-10-09T06:58:43.790825+0000","last_unstale":"2023-10-09T06:58:43.796374+0000","last_undegraded":"2023-10-09T06:58:43.796374+0000","last_fullsized":"2023-10-09T06:58:43.796374+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:50:22.439113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.793084+0000","last_change":"2023-10-09T06:58:43.791927+0000","last_active":"2023-10-09T06:58:43.793084+0000","last_peered":"2023-10-09T06:58:43.793084+0000","last_clean":"2023-10-09T06:58:43.793084+0000","last_became_active":"2023-10-09T06:58:43.791694+0000","last_became_peered":"2023-10-09T06:58:43.791694+0000","last_unstale":"2023-10-09T06:58:43.793084+0000","last_undegraded":"2023-10-09T06:58:43.793084+0000","last_fullsized":"2023-10-09T06:58:43.793084+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:41:21.133593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.789680+0000","last_change":"2023-10-09T06:58:43.789088+0000","last_active":"2023-10-09T06:58:43.789680+0000","last_peered":"2023-10-09T06:58:43.789680+0000","last_clean":"2023-10-09T06:58:43.789680+0000","last_became_active":"2023-10-09T06:58:43.788738+0000","last_became_peered":"2023-10-09T06:58:43.788738+0000","last_unstale":"2023-10-09T06:58:43.789680+0000","last_undegraded":"2023-10-09T06:58:43.789680+0000","last_fullsized":"2023-10-09T06:58:43.789680+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:36.821271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.785868+0000","last_change":"2023-10-09T06:58:43.784419+0000","last_active":"2023-10-09T06:58:43.785868+0000","last_peered":"2023-10-09T06:58:43.785868+0000","last_clean":"2023-10-09T06:58:43.785868+0000","last_became_active":"2023-10-09T06:58:43.784130+0000","last_became_peered":"2023-10-09T06:58:43.784130+0000","last_unstale":"2023-10-09T06:58:43.785868+0000","last_undegraded":"2023-10-09T06:58:43.785868+0000","last_fullsized":"2023-10-09T06:58:43.785868+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:10.429867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801937+0000","last_change":"2023-10-09T06:58:43.798563+0000","last_active":"2023-10-09T06:58:43.801937+0000","last_peered":"2023-10-09T06:58:43.801937+0000","last_clean":"2023-10-09T06:58:43.801937+0000","last_became_active":"2023-10-09T06:58:43.798175+0000","last_became_peered":"2023-10-09T06:58:43.798175+0000","last_unstale":"2023-10-09T06:58:43.801937+0000","last_undegraded":"2023-10-09T06:58:43.801937+0000","last_fullsized":"2023-10-09T06:58:43.801937+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:39:57.258267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.794464+0000","last_change":"2023-10-09T06:58:43.790416+0000","last_active":"2023-10-09T06:58:43.794464+0000","last_peered":"2023-10-09T06:58:43.794464+0000","last_clean":"2023-10-09T06:58:43.794464+0000","last_became_active":"2023-10-09T06:58:43.790148+0000","last_became_peered":"2023-10-09T06:58:43.790148+0000","last_unstale":"2023-10-09T06:58:43.794464+0000","last_undegraded":"2023-10-09T06:58:43.794464+0000","last_fullsized":"2023-10-09T06:58:43.794464+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:26.456449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.795064+0000","last_change":"2023-10-09T06:58:43.790213+0000","last_active":"2023-10-09T06:58:43.795064+0000","last_peered":"2023-10-09T06:58:43.795064+0000","last_clean":"2023-10-09T06:58:43.795064+0000","last_became_active":"2023-10-09T06:58:43.789938+0000","last_became_peered":"2023-10-09T06:58:43.789938+0000","last_unstale":"2023-10-09T06:58:43.795064+0000","last_undegraded":"2023-10-09T06:58:43.795064+0000","last_fullsized":"2023-10-09T06:58:43.795064+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:39.554977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.794242+0000","last_change":"2023-10-09T06:58:43.791018+0000","last_active":"2023-10-09T06:58:43.794242+0000","last_peered":"2023-10-09T06:58:43.794242+0000","last_clean":"2023-10-09T06:58:43.794242+0000","last_became_active":"2023-10-09T06:58:43.790650+0000","last_became_peered":"2023-10-09T06:58:43.790650+0000","last_unstale":"2023-10-09T06:58:43.794242+0000","last_undegraded":"2023-10-09T06:58:43.794242+0000","last_fullsized":"2023-10-09T06:58:43.794242+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:37.545876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.794813+0000","last_change":"2023-10-09T06:58:43.793638+0000","last_active":"2023-10-09T06:58:43.794813+0000","last_peered":"2023-10-09T06:58:43.794813+0000","last_clean":"2023-10-09T06:58:43.794813+0000","last_became_active":"2023-10-09T06:58:43.793289+0000","last_became_peered":"2023-10-09T06:58:43.793289+0000","last_unstale":"2023-10-09T06:58:43.794813+0000","last_undegraded":"2023-10-09T06:58:43.794813+0000","last_fullsized":"2023-10-09T06:58:43.794813+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:33.042437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792088+0000","last_change":"2023-10-09T06:58:43.789987+0000","last_active":"2023-10-09T06:58:43.792088+0000","last_peered":"2023-10-09T06:58:43.792088+0000","last_clean":"2023-10-09T06:58:43.792088+0000","last_became_active":"2023-10-09T06:58:43.789753+0000","last_became_peered":"2023-10-09T06:58:43.789753+0000","last_unstale":"2023-10-09T06:58:43.792088+0000","last_undegraded":"2023-10-09T06:58:43.792088+0000","last_fullsized":"2023-10-09T06:58:43.792088+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:55.083637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801028+0000","last_change":"2023-10-09T06:58:43.799220+0000","last_active":"2023-10-09T06:58:43.801028+0000","last_peered":"2023-10-09T06:58:43.801028+0000","last_clean":"2023-10-09T06:58:43.801028+0000","last_became_active":"2023-10-09T06:58:43.798948+0000","last_became_peered":"2023-10-09T06:58:43.798948+0000","last_unstale":"2023-10-09T06:58:43.801028+0000","last_undegraded":"2023-10-09T06:58:43.801028+0000","last_fullsized":"2023-10-09T06:58:43.801028+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:32.536328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798525+0000","last_change":"2023-10-09T06:58:43.793525+0000","last_active":"2023-10-09T06:58:43.798525+0000","last_peered":"2023-10-09T06:58:43.798525+0000","last_clean":"2023-10-09T06:58:43.798525+0000","last_became_active":"2023-10-09T06:58:43.793039+0000","last_became_peered":"2023-10-09T06:58:43.793039+0000","last_unstale":"2023-10-09T06:58:43.798525+0000","last_undegraded":"2023-10-09T06:58:43.798525+0000","last_fullsized":"2023-10-09T06:58:43.798525+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:10.429867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798108+0000","last_change":"2023-10-09T06:58:43.796846+0000","last_active":"2023-10-09T06:58:43.798108+0000","last_peered":"2023-10-09T06:58:43.798108+0000","last_clean":"2023-10-09T06:58:43.798108+0000","last_became_active":"2023-10-09T06:58:43.796598+0000","last_became_peered":"2023-10-09T06:58:43.796598+0000","last_unstale":"2023-10-09T06:58:43.798108+0000","last_undegraded":"2023-10-09T06:58:43.798108+0000","last_fullsized":"2023-10-09T06:58:43.798108+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:41:05.828751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792567+0000","last_change":"2023-10-09T06:58:43.788053+0000","last_active":"2023-10-09T06:58:43.792567+0000","last_peered":"2023-10-09T06:58:43.792567+0000","last_clean":"2023-10-09T06:58:43.792567+0000","last_became_active":"2023-10-09T06:58:43.787821+0000","last_became_peered":"2023-10-09T06:58:43.787821+0000","last_unstale":"2023-10-09T06:58:43.792567+0000","last_undegraded":"2023-10-09T06:58:43.792567+0000","last_fullsized":"2023-10-09T06:58:43.792567+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:49:56.178318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798095+0000","last_change":"2023-10-09T06:58:43.796626+0000","last_active":"2023-10-09T06:58:43.798095+0000","last_peered":"2023-10-09T06:58:43.798095+0000","last_clean":"2023-10-09T06:58:43.798095+0000","last_became_active":"2023-10-09T06:58:43.796232+0000","last_became_peered":"2023-10-09T06:58:43.796232+0000","last_unstale":"2023-10-09T06:58:43.798095+0000","last_undegraded":"2023-10-09T06:58:43.798095+0000","last_fullsized":"2023-10-09T06:58:43.798095+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:45.689229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.791208+0000","last_change":"2023-10-09T06:58:43.788457+0000","last_active":"2023-10-09T06:58:43.791208+0000","last_peered":"2023-10-09T06:58:43.791208+0000","last_clean":"2023-10-09T06:58:43.791208+0000","last_became_active":"2023-10-09T06:58:43.788206+0000","last_became_peered":"2023-10-09T06:58:43.788206+0000","last_unstale":"2023-10-09T06:58:43.791208+0000","last_undegraded":"2023-10-09T06:58:43.791208+0000","last_fullsized":"2023-10-09T06:58:43.791208+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:54:13.880490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.794533+0000","last_change":"2023-10-09T06:58:43.791344+0000","last_active":"2023-10-09T06:58:43.794533+0000","last_peered":"2023-10-09T06:58:43.794533+0000","last_clean":"2023-10-09T06:58:43.794533+0000","last_became_active":"2023-10-09T06:58:43.790302+0000","last_became_peered":"2023-10-09T06:58:43.790302+0000","last_unstale":"2023-10-09T06:58:43.794533+0000","last_undegraded":"2023-10-09T06:58:43.794533+0000","last_fullsized":"2023-10-09T06:58:43.794533+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:09.624621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801641+0000","last_change":"2023-10-09T06:58:43.797058+0000","last_active":"2023-10-09T06:58:43.801641+0000","last_peered":"2023-10-09T06:58:43.801641+0000","last_clean":"2023-10-09T06:58:43.801641+0000","last_became_active":"2023-10-09T06:58:43.796791+0000","last_became_peered":"2023-10-09T06:58:43.796791+0000","last_unstale":"2023-10-09T06:58:43.801641+0000","last_undegraded":"2023-10-09T06:58:43.801641+0000","last_fullsized":"2023-10-09T06:58:43.801641+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:57.183851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.791090+0000","last_change":"2023-10-09T06:58:43.787561+0000","last_active":"2023-10-09T06:58:43.791090+0000","last_peered":"2023-10-09T06:58:43.791090+0000","last_clean":"2023-10-09T06:58:43.791090+0000","last_became_active":"2023-10-09T06:58:43.787294+0000","last_became_peered":"2023-10-09T06:58:43.787294+0000","last_unstale":"2023-10-09T06:58:43.791090+0000","last_undegraded":"2023-10-09T06:58:43.791090+0000","last_fullsized":"2023-10-09T06:58:43.791090+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:15.783097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.800940+0000","last_change":"2023-10-09T06:58:43.799680+0000","last_active":"2023-10-09T06:58:43.800940+0000","last_peered":"2023-10-09T06:58:43.800940+0000","last_clean":"2023-10-09T06:58:43.800940+0000","last_became_active":"2023-10-09T06:58:43.798445+0000","last_became_peered":"2023-10-09T06:58:43.798445+0000","last_unstale":"2023-10-09T06:58:43.800940+0000","last_undegraded":"2023-10-09T06:58:43.800940+0000","last_fullsized":"2023-10-09T06:58:43.800940+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:18.050283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.799740+0000","last_change":"2023-10-09T06:58:43.794944+0000","last_active":"2023-10-09T06:58:43.799740+0000","last_peered":"2023-10-09T06:58:43.799740+0000","last_clean":"2023-10-09T06:58:43.799740+0000","last_became_active":"2023-10-09T06:58:43.794661+0000","last_became_peered":"2023-10-09T06:58:43.794661+0000","last_unstale":"2023-10-09T06:58:43.799740+0000","last_undegraded":"2023-10-09T06:58:43.799740+0000","last_fullsized":"2023-10-09T06:58:43.799740+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:20.771196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796612+0000","last_change":"2023-10-09T06:58:43.793097+0000","last_active":"2023-10-09T06:58:43.796612+0000","last_peered":"2023-10-09T06:58:43.796612+0000","last_clean":"2023-10-09T06:58:43.796612+0000","last_became_active":"2023-10-09T06:58:43.791977+0000","last_became_peered":"2023-10-09T06:58:43.791977+0000","last_unstale":"2023-10-09T06:58:43.796612+0000","last_undegraded":"2023-10-09T06:58:43.796612+0000","last_fullsized":"2023-10-09T06:58:43.796612+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:57.183851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801959+0000","last_change":"2023-10-09T06:58:43.798714+0000","last_active":"2023-10-09T06:58:43.801959+0000","last_peered":"2023-10-09T06:58:43.801959+0000","last_clean":"2023-10-09T06:58:43.801959+0000","last_became_active":"2023-10-09T06:58:43.798446+0000","last_became_peered":"2023-10-09T06:58:43.798446+0000","last_unstale":"2023-10-09T06:58:43.801959+0000","last_undegraded":"2023-10-09T06:58:43.801959+0000","last_fullsized":"2023-10-09T06:58:43.801959+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:20.771196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.791338+0000","last_change":"2023-10-09T06:58:43.786570+0000","last_active":"2023-10-09T06:58:43.791338+0000","last_peered":"2023-10-09T06:58:43.791338+0000","last_clean":"2023-10-09T06:58:43.791338+0000","last_became_active":"2023-10-09T06:58:43.786278+0000","last_became_peered":"2023-10-09T06:58:43.786278+0000","last_unstale":"2023-10-09T06:58:43.791338+0000","last_undegraded":"2023-10-09T06:58:43.791338+0000","last_fullsized":"2023-10-09T06:58:43.791338+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:20:14.106000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.797100+0000","last_change":"2023-10-09T06:58:43.793238+0000","last_active":"2023-10-09T06:58:43.797100+0000","last_peered":"2023-10-09T06:58:43.797100+0000","last_clean":"2023-10-09T06:58:43.797100+0000","last_became_active":"2023-10-09T06:58:43.792979+0000","last_became_peered":"2023-10-09T06:58:43.792979+0000","last_unstale":"2023-10-09T06:58:43.797100+0000","last_undegraded":"2023-10-09T06:58:43.797100+0000","last_fullsized":"2023-10-09T06:58:43.797100+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:16:08.167149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796387+0000","last_change":"2023-10-09T06:58:43.793047+0000","last_active":"2023-10-09T06:58:43.796387+0000","last_peered":"2023-10-09T06:58:43.796387+0000","last_clean":"2023-10-09T06:58:43.796387+0000","last_became_active":"2023-10-09T06:58:43.792478+0000","last_became_peered":"2023-10-09T06:58:43.792478+0000","last_unstale":"2023-10-09T06:58:43.796387+0000","last_undegraded":"2023-10-09T06:58:43.796387+0000","last_fullsized":"2023-10-09T06:58:43.796387+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:20.771196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801738+0000","last_change":"2023-10-09T06:58:43.797476+0000","last_active":"2023-10-09T06:58:43.801738+0000","last_peered":"2023-10-09T06:58:43.801738+0000","last_clean":"2023-10-09T06:58:43.801738+0000","last_became_active":"2023-10-09T06:58:43.796908+0000","last_became_peered":"2023-10-09T06:58:43.796908+0000","last_unstale":"2023-10-09T06:58:43.801738+0000","last_undegraded":"2023-10-09T06:58:43.801738+0000","last_fullsized":"2023-10-09T06:58:43.801738+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:36.821271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.799503+0000","last_change":"2023-10-09T06:58:43.796883+0000","last_active":"2023-10-09T06:58:43.799503+0000","last_peered":"2023-10-09T06:58:43.799503+0000","last_clean":"2023-10-09T06:58:43.799503+0000","last_became_active":"2023-10-09T06:58:43.796610+0000","last_became_peered":"2023-10-09T06:58:43.796610+0000","last_unstale":"2023-10-09T06:58:43.799503+0000","last_undegraded":"2023-10-09T06:58:43.799503+0000","last_fullsized":"2023-10-09T06:58:43.799503+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:39.554977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"106'4","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.261583+0000","last_change":"2023-10-09T06:58:43.259535+0000","last_active":"2023-10-09T06:58:44.261583+0000","last_peered":"2023-10-09T06:58:44.261583+0000","last_clean":"2023-10-09T06:58:44.261583+0000","last_became_active":"2023-10-09T06:58:43.259336+0000","last_became_peered":"2023-10-09T06:58:43.259336+0000","last_unstale":"2023-10-09T06:58:44.261583+0000","last_undegraded":"2023-10-09T06:58:44.261583+0000","last_fullsized":"2023-10-09T06:58:44.261583+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:17.947780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801684+0000","last_change":"2023-10-09T06:58:43.797058+0000","last_active":"2023-10-09T06:58:43.801684+0000","last_peered":"2023-10-09T06:58:43.801684+0000","last_clean":"2023-10-09T06:58:43.801684+0000","last_became_active":"2023-10-09T06:58:43.796772+0000","last_became_peered":"2023-10-09T06:58:43.796772+0000","last_unstale":"2023-10-09T06:58:43.801684+0000","last_undegraded":"2023-10-09T06:58:43.801684+0000","last_fullsized":"2023-10-09T06:58:43.801684+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:37.545876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.262810+0000","last_change":"2023-10-09T06:58:43.252052+0000","last_active":"2023-10-09T06:58:44.262810+0000","last_peered":"2023-10-09T06:58:44.262810+0000","last_clean":"2023-10-09T06:58:44.262810+0000","last_became_active":"2023-10-09T06:58:43.251738+0000","last_became_peered":"2023-10-09T06:58:43.251738+0000","last_unstale":"2023-10-09T06:58:44.262810+0000","last_undegraded":"2023-10-09T06:58:44.262810+0000","last_fullsized":"2023-10-09T06:58:44.262810+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:45:42.343993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.802384+0000","last_change":"2023-10-09T06:58:43.801259+0000","last_active":"2023-10-09T06:58:43.802384+0000","last_peered":"2023-10-09T06:58:43.802384+0000","last_clean":"2023-10-09T06:58:43.802384+0000","last_became_active":"2023-10-09T06:58:43.800994+0000","last_became_peered":"2023-10-09T06:58:43.800994+0000","last_unstale":"2023-10-09T06:58:43.802384+0000","last_undegraded":"2023-10-09T06:58:43.802384+0000","last_fullsized":"2023-10-09T06:58:43.802384+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:50:22.439113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.260847+0000","last_change":"2023-10-09T06:58:43.252945+0000","last_active":"2023-10-09T06:58:44.260847+0000","last_peered":"2023-10-09T06:58:44.260847+0000","last_clean":"2023-10-09T06:58:44.260847+0000","last_became_active":"2023-10-09T06:58:43.252616+0000","last_became_peered":"2023-10-09T06:58:43.252616+0000","last_unstale":"2023-10-09T06:58:44.260847+0000","last_undegraded":"2023-10-09T06:58:44.260847+0000","last_fullsized":"2023-10-09T06:58:44.260847+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:43:21.232774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.799838+0000","last_change":"2023-10-09T06:58:43.795728+0000","last_active":"2023-10-09T06:58:43.799838+0000","last_peered":"2023-10-09T06:58:43.799838+0000","last_clean":"2023-10-09T06:58:43.799838+0000","last_became_active":"2023-10-09T06:58:43.795459+0000","last_became_peered":"2023-10-09T06:58:43.795459+0000","last_unstale":"2023-10-09T06:58:43.799838+0000","last_undegraded":"2023-10-09T06:58:43.799838+0000","last_fullsized":"2023-10-09T06:58:43.799838+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:39.554977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.261335+0000","last_change":"2023-10-09T06:58:43.248945+0000","last_active":"2023-10-09T06:58:44.261335+0000","last_peered":"2023-10-09T06:58:44.261335+0000","last_clean":"2023-10-09T06:58:44.261335+0000","last_became_active":"2023-10-09T06:58:43.248676+0000","last_became_peered":"2023-10-09T06:58:43.248676+0000","last_unstale":"2023-10-09T06:58:44.261335+0000","last_undegraded":"2023-10-09T06:58:44.261335+0000","last_fullsized":"2023-10-09T06:58:44.261335+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:39:35.477143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.797144+0000","last_change":"2023-10-09T06:58:43.793238+0000","last_active":"2023-10-09T06:58:43.797144+0000","last_peered":"2023-10-09T06:58:43.797144+0000","last_clean":"2023-10-09T06:58:43.797144+0000","last_became_active":"2023-10-09T06:58:43.792972+0000","last_became_peered":"2023-10-09T06:58:43.792972+0000","last_unstale":"2023-10-09T06:58:43.797144+0000","last_undegraded":"2023-10-09T06:58:43.797144+0000","last_fullsized":"2023-10-09T06:58:43.797144+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:14.141466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.262947+0000","last_change":"2023-10-09T06:58:43.254364+0000","last_active":"2023-10-09T06:58:44.262947+0000","last_peered":"2023-10-09T06:58:44.262947+0000","last_clean":"2023-10-09T06:58:44.262947+0000","last_became_active":"2023-10-09T06:58:43.254116+0000","last_became_peered":"2023-10-09T06:58:43.254116+0000","last_unstale":"2023-10-09T06:58:44.262947+0000","last_undegraded":"2023-10-09T06:58:44.262947+0000","last_fullsized":"2023-10-09T06:58:44.262947+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:16:07.159805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798740+0000","last_change":"2023-10-09T06:58:43.794432+0000","last_active":"2023-10-09T06:58:43.798740+0000","last_peered":"2023-10-09T06:58:43.798740+0000","last_clean":"2023-10-09T06:58:43.798740+0000","last_became_active":"2023-10-09T06:58:43.794079+0000","last_became_peered":"2023-10-09T06:58:43.794079+0000","last_unstale":"2023-10-09T06:58:43.798740+0000","last_undegraded":"2023-10-09T06:58:43.798740+0000","last_fullsized":"2023-10-09T06:58:43.798740+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:50:22.439113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.262592+0000","last_change":"2023-10-09T06:58:43.255791+0000","last_active":"2023-10-09T06:58:44.262592+0000","last_peered":"2023-10-09T06:58:44.262592+0000","last_clean":"2023-10-09T06:58:44.262592+0000","last_became_active":"2023-10-09T06:58:43.255535+0000","last_became_peered":"2023-10-09T06:58:43.255535+0000","last_unstale":"2023-10-09T06:58:44.262592+0000","last_undegraded":"2023-10-09T06:58:44.262592+0000","last_fullsized":"2023-10-09T06:58:44.262592+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:46:58.364775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.799835+0000","last_change":"2023-10-09T06:58:43.795758+0000","last_active":"2023-10-09T06:58:43.799835+0000","last_peered":"2023-10-09T06:58:43.799835+0000","last_clean":"2023-10-09T06:58:43.799835+0000","last_became_active":"2023-10-09T06:58:43.795406+0000","last_became_peered":"2023-10-09T06:58:43.795406+0000","last_unstale":"2023-10-09T06:58:43.799835+0000","last_undegraded":"2023-10-09T06:58:43.799835+0000","last_fullsized":"2023-10-09T06:58:43.799835+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:57.183851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.780552+0000","last_change":"2023-10-09T06:58:43.244540+0000","last_active":"2023-10-09T06:58:43.780552+0000","last_peered":"2023-10-09T06:58:43.780552+0000","last_clean":"2023-10-09T06:58:43.780552+0000","last_became_active":"2023-10-09T06:58:43.244261+0000","last_became_peered":"2023-10-09T06:58:43.244261+0000","last_unstale":"2023-10-09T06:58:43.780552+0000","last_undegraded":"2023-10-09T06:58:43.780552+0000","last_fullsized":"2023-10-09T06:58:43.780552+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:56.176507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792065+0000","last_change":"2023-10-09T06:58:43.788475+0000","last_active":"2023-10-09T06:58:43.792065+0000","last_peered":"2023-10-09T06:58:43.792065+0000","last_clean":"2023-10-09T06:58:43.792065+0000","last_became_active":"2023-10-09T06:58:43.788225+0000","last_became_peered":"2023-10-09T06:58:43.788225+0000","last_unstale":"2023-10-09T06:58:43.792065+0000","last_undegraded":"2023-10-09T06:58:43.792065+0000","last_fullsized":"2023-10-09T06:58:43.792065+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:13:39.010325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779920+0000","last_change":"2023-10-09T06:58:43.251615+0000","last_active":"2023-10-09T06:58:43.779920+0000","last_peered":"2023-10-09T06:58:43.779920+0000","last_clean":"2023-10-09T06:58:43.779920+0000","last_became_active":"2023-10-09T06:58:43.250726+0000","last_became_peered":"2023-10-09T06:58:43.250726+0000","last_unstale":"2023-10-09T06:58:43.779920+0000","last_undegraded":"2023-10-09T06:58:43.779920+0000","last_fullsized":"2023-10-09T06:58:43.779920+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:26:48.163941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792119+0000","last_change":"2023-10-09T06:58:43.789342+0000","last_active":"2023-10-09T06:58:43.792119+0000","last_peered":"2023-10-09T06:58:43.792119+0000","last_clean":"2023-10-09T06:58:43.792119+0000","last_became_active":"2023-10-09T06:58:43.789085+0000","last_became_peered":"2023-10-09T06:58:43.789085+0000","last_unstale":"2023-10-09T06:58:43.792119+0000","last_undegraded":"2023-10-09T06:58:43.792119+0000","last_fullsized":"2023-10-09T06:58:43.792119+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:05:54.912313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.789062+0000","last_change":"2023-10-09T06:58:43.258785+0000","last_active":"2023-10-09T06:58:43.789062+0000","last_peered":"2023-10-09T06:58:43.789062+0000","last_clean":"2023-10-09T06:58:43.789062+0000","last_became_active":"2023-10-09T06:58:43.258340+0000","last_became_peered":"2023-10-09T06:58:43.258340+0000","last_unstale":"2023-10-09T06:58:43.789062+0000","last_undegraded":"2023-10-09T06:58:43.789062+0000","last_fullsized":"2023-10-09T06:58:43.789062+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:51:46.519760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796150+0000","last_change":"2023-10-09T06:58:43.790672+0000","last_active":"2023-10-09T06:58:43.796150+0000","last_peered":"2023-10-09T06:58:43.796150+0000","last_clean":"2023-10-09T06:58:43.796150+0000","last_became_active":"2023-10-09T06:58:43.790256+0000","last_became_peered":"2023-10-09T06:58:43.790256+0000","last_unstale":"2023-10-09T06:58:43.796150+0000","last_undegraded":"2023-10-09T06:58:43.796150+0000","last_fullsized":"2023-10-09T06:58:43.796150+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:20.771196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.788826+0000","last_change":"2023-10-09T06:58:43.259889+0000","last_active":"2023-10-09T06:58:43.788826+0000","last_peered":"2023-10-09T06:58:43.788826+0000","last_clean":"2023-10-09T06:58:43.788826+0000","last_became_active":"2023-10-09T06:58:43.259534+0000","last_became_peered":"2023-10-09T06:58:43.259534+0000","last_unstale":"2023-10-09T06:58:43.788826+0000","last_undegraded":"2023-10-09T06:58:43.788826+0000","last_fullsized":"2023-10-09T06:58:43.788826+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:28.977749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.800375+0000","last_change":"2023-10-09T06:58:43.798126+0000","last_active":"2023-10-09T06:58:43.800375+0000","last_peered":"2023-10-09T06:58:43.800375+0000","last_clean":"2023-10-09T06:58:43.800375+0000","last_became_active":"2023-10-09T06:58:43.797884+0000","last_became_peered":"2023-10-09T06:58:43.797884+0000","last_unstale":"2023-10-09T06:58:43.800375+0000","last_undegraded":"2023-10-09T06:58:43.800375+0000","last_fullsized":"2023-10-09T06:58:43.800375+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:42:30.221135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"106'3","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.262691+0000","last_change":"2023-10-09T06:58:43.258779+0000","last_active":"2023-10-09T06:58:44.262691+0000","last_peered":"2023-10-09T06:58:44.262691+0000","last_clean":"2023-10-09T06:58:44.262691+0000","last_became_active":"2023-10-09T06:58:43.258443+0000","last_became_peered":"2023-10-09T06:58:43.258443+0000","last_unstale":"2023-10-09T06:58:44.262691+0000","last_undegraded":"2023-10-09T06:58:44.262691+0000","last_fullsized":"2023-10-09T06:58:44.262691+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:00.822915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796573+0000","last_change":"2023-10-09T06:58:43.791013+0000","last_active":"2023-10-09T06:58:43.796573+0000","last_peered":"2023-10-09T06:58:43.796573+0000","last_clean":"2023-10-09T06:58:43.796573+0000","last_became_active":"2023-10-09T06:58:43.789697+0000","last_became_peered":"2023-10-09T06:58:43.789697+0000","last_unstale":"2023-10-09T06:58:43.796573+0000","last_undegraded":"2023-10-09T06:58:43.796573+0000","last_fullsized":"2023-10-09T06:58:43.796573+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:49.433121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"106'6","reported_seq":16,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.264969+0000","last_change":"2023-10-09T06:58:43.249828+0000","last_active":"2023-10-09T06:58:44.264969+0000","last_peered":"2023-10-09T06:58:44.264969+0000","last_clean":"2023-10-09T06:58:44.264969+0000","last_became_active":"2023-10-09T06:58:43.249550+0000","last_became_peered":"2023-10-09T06:58:43.249550+0000","last_unstale":"2023-10-09T06:58:44.264969+0000","last_undegraded":"2023-10-09T06:58:44.264969+0000","last_fullsized":"2023-10-09T06:58:44.264969+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:57.710580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792408+0000","last_change":"2023-10-09T06:58:43.786500+0000","last_active":"2023-10-09T06:58:43.792408+0000","last_peered":"2023-10-09T06:58:43.792408+0000","last_clean":"2023-10-09T06:58:43.792408+0000","last_became_active":"2023-10-09T06:58:43.786244+0000","last_became_peered":"2023-10-09T06:58:43.786244+0000","last_unstale":"2023-10-09T06:58:43.792408+0000","last_undegraded":"2023-10-09T06:58:43.792408+0000","last_fullsized":"2023-10-09T06:58:43.792408+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:01.948441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.262408+0000","last_change":"2023-10-09T06:58:43.251369+0000","last_active":"2023-10-09T06:58:44.262408+0000","last_peered":"2023-10-09T06:58:44.262408+0000","last_clean":"2023-10-09T06:58:44.262408+0000","last_became_active":"2023-10-09T06:58:43.251090+0000","last_became_peered":"2023-10-09T06:58:43.251090+0000","last_unstale":"2023-10-09T06:58:44.262408+0000","last_undegraded":"2023-10-09T06:58:44.262408+0000","last_fullsized":"2023-10-09T06:58:44.262408+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:54:12.873146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.789917+0000","last_change":"2023-10-09T06:58:43.786782+0000","last_active":"2023-10-09T06:58:43.789917+0000","last_peered":"2023-10-09T06:58:43.789917+0000","last_clean":"2023-10-09T06:58:43.789917+0000","last_became_active":"2023-10-09T06:58:43.786468+0000","last_became_peered":"2023-10-09T06:58:43.786468+0000","last_unstale":"2023-10-09T06:58:43.789917+0000","last_undegraded":"2023-10-09T06:58:43.789917+0000","last_fullsized":"2023-10-09T06:58:43.789917+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:49.433121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.776377+0000","last_change":"2023-10-09T06:58:43.251912+0000","last_active":"2023-10-09T06:58:43.776377+0000","last_peered":"2023-10-09T06:58:43.776377+0000","last_clean":"2023-10-09T06:58:43.776377+0000","last_became_active":"2023-10-09T06:58:43.251661+0000","last_became_peered":"2023-10-09T06:58:43.251661+0000","last_unstale":"2023-10-09T06:58:43.776377+0000","last_undegraded":"2023-10-09T06:58:43.776377+0000","last_fullsized":"2023-10-09T06:58:43.776377+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:48.425777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.790274+0000","last_change":"2023-10-09T06:58:43.788503+0000","last_active":"2023-10-09T06:58:43.790274+0000","last_peered":"2023-10-09T06:58:43.790274+0000","last_clean":"2023-10-09T06:58:43.790274+0000","last_became_active":"2023-10-09T06:58:43.788263+0000","last_became_peered":"2023-10-09T06:58:43.788263+0000","last_unstale":"2023-10-09T06:58:43.790274+0000","last_undegraded":"2023-10-09T06:58:43.790274+0000","last_fullsized":"2023-10-09T06:58:43.790274+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:54.293662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779119+0000","last_change":"2023-10-09T06:58:43.248548+0000","last_active":"2023-10-09T06:58:43.779119+0000","last_peered":"2023-10-09T06:58:43.779119+0000","last_clean":"2023-10-09T06:58:43.779119+0000","last_became_active":"2023-10-09T06:58:43.248281+0000","last_became_peered":"2023-10-09T06:58:43.248281+0000","last_unstale":"2023-10-09T06:58:43.779119+0000","last_undegraded":"2023-10-09T06:58:43.779119+0000","last_fullsized":"2023-10-09T06:58:43.779119+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:20.836176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.799625+0000","last_change":"2023-10-09T06:58:43.797986+0000","last_active":"2023-10-09T06:58:43.799625+0000","last_peered":"2023-10-09T06:58:43.799625+0000","last_clean":"2023-10-09T06:58:43.799625+0000","last_became_active":"2023-10-09T06:58:43.797568+0000","last_became_peered":"2023-10-09T06:58:43.797568+0000","last_unstale":"2023-10-09T06:58:43.799625+0000","last_undegraded":"2023-10-09T06:58:43.799625+0000","last_fullsized":"2023-10-09T06:58:43.799625+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:29.985093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"106'8","reported_seq":18,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.263980+0000","last_change":"2023-10-09T06:58:43.253188+0000","last_active":"2023-10-09T06:58:44.263980+0000","last_peered":"2023-10-09T06:58:44.263980+0000","last_clean":"2023-10-09T06:58:44.263980+0000","last_became_active":"2023-10-09T06:58:43.252677+0000","last_became_peered":"2023-10-09T06:58:43.252677+0000","last_unstale":"2023-10-09T06:58:44.263980+0000","last_undegraded":"2023-10-09T06:58:44.263980+0000","last_fullsized":"2023-10-09T06:58:44.263980+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:33.706986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.799785+0000","last_change":"2023-10-09T06:58:43.795060+0000","last_active":"2023-10-09T06:58:43.799785+0000","last_peered":"2023-10-09T06:58:43.799785+0000","last_clean":"2023-10-09T06:58:43.799785+0000","last_became_active":"2023-10-09T06:58:43.794801+0000","last_became_peered":"2023-10-09T06:58:43.794801+0000","last_unstale":"2023-10-09T06:58:43.799785+0000","last_undegraded":"2023-10-09T06:58:43.799785+0000","last_fullsized":"2023-10-09T06:58:43.799785+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:50:22.439113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.261011+0000","last_change":"2023-10-09T06:58:43.259431+0000","last_active":"2023-10-09T06:58:44.261011+0000","last_peered":"2023-10-09T06:58:44.261011+0000","last_clean":"2023-10-09T06:58:44.261011+0000","last_became_active":"2023-10-09T06:58:43.259153+0000","last_became_peered":"2023-10-09T06:58:43.259153+0000","last_unstale":"2023-10-09T06:58:44.261011+0000","last_undegraded":"2023-10-09T06:58:44.261011+0000","last_fullsized":"2023-10-09T06:58:44.261011+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:45:42.343993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801731+0000","last_change":"2023-10-09T06:58:43.797881+0000","last_active":"2023-10-09T06:58:43.801731+0000","last_peered":"2023-10-09T06:58:43.801731+0000","last_clean":"2023-10-09T06:58:43.801731+0000","last_became_active":"2023-10-09T06:58:43.797524+0000","last_became_peered":"2023-10-09T06:58:43.797524+0000","last_unstale":"2023-10-09T06:58:43.801731+0000","last_undegraded":"2023-10-09T06:58:43.801731+0000","last_fullsized":"2023-10-09T06:58:43.801731+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:51:20.343477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.263780+0000","last_change":"2023-10-09T06:58:43.250800+0000","last_active":"2023-10-09T06:58:44.263780+0000","last_peered":"2023-10-09T06:58:44.263780+0000","last_clean":"2023-10-09T06:58:44.263780+0000","last_became_active":"2023-10-09T06:58:43.250529+0000","last_became_peered":"2023-10-09T06:58:43.250529+0000","last_unstale":"2023-10-09T06:58:44.263780+0000","last_undegraded":"2023-10-09T06:58:44.263780+0000","last_fullsized":"2023-10-09T06:58:44.263780+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:07.313495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796594+0000","last_change":"2023-10-09T06:58:43.791548+0000","last_active":"2023-10-09T06:58:43.796594+0000","last_peered":"2023-10-09T06:58:43.796594+0000","last_clean":"2023-10-09T06:58:43.796594+0000","last_became_active":"2023-10-09T06:58:43.790746+0000","last_became_peered":"2023-10-09T06:58:43.790746+0000","last_unstale":"2023-10-09T06:58:43.796594+0000","last_undegraded":"2023-10-09T06:58:43.796594+0000","last_fullsized":"2023-10-09T06:58:43.796594+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:37.545876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779490+0000","last_change":"2023-10-09T06:58:43.243471+0000","last_active":"2023-10-09T06:58:43.779490+0000","last_peered":"2023-10-09T06:58:43.779490+0000","last_clean":"2023-10-09T06:58:43.779490+0000","last_became_active":"2023-10-09T06:58:43.243230+0000","last_became_peered":"2023-10-09T06:58:43.243230+0000","last_unstale":"2023-10-09T06:58:43.779490+0000","last_undegraded":"2023-10-09T06:58:43.779490+0000","last_fullsized":"2023-10-09T06:58:43.779490+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:48.425777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796119+0000","last_change":"2023-10-09T06:58:43.794689+0000","last_active":"2023-10-09T06:58:43.796119+0000","last_peered":"2023-10-09T06:58:43.796119+0000","last_clean":"2023-10-09T06:58:43.796119+0000","last_became_active":"2023-10-09T06:58:43.793778+0000","last_became_peered":"2023-10-09T06:58:43.793778+0000","last_unstale":"2023-10-09T06:58:43.796119+0000","last_undegraded":"2023-10-09T06:58:43.796119+0000","last_fullsized":"2023-10-09T06:58:43.796119+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:22.993909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.261333+0000","last_change":"2023-10-09T06:58:43.252297+0000","last_active":"2023-10-09T06:58:44.261333+0000","last_peered":"2023-10-09T06:58:44.261333+0000","last_clean":"2023-10-09T06:58:44.261333+0000","last_became_active":"2023-10-09T06:58:43.252051+0000","last_became_peered":"2023-10-09T06:58:43.252051+0000","last_unstale":"2023-10-09T06:58:44.261333+0000","last_undegraded":"2023-10-09T06:58:44.261333+0000","last_fullsized":"2023-10-09T06:58:44.261333+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:07.313495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.786645+0000","last_change":"2023-10-09T06:58:43.785110+0000","last_active":"2023-10-09T06:58:43.786645+0000","last_peered":"2023-10-09T06:58:43.786645+0000","last_clean":"2023-10-09T06:58:43.786645+0000","last_became_active":"2023-10-09T06:58:43.784802+0000","last_became_peered":"2023-10-09T06:58:43.784802+0000","last_unstale":"2023-10-09T06:58:43.786645+0000","last_undegraded":"2023-10-09T06:58:43.786645+0000","last_fullsized":"2023-10-09T06:58:43.786645+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:39.554977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.784061+0000","last_change":"2023-10-09T06:58:43.255859+0000","last_active":"2023-10-09T06:58:43.784061+0000","last_peered":"2023-10-09T06:58:43.784061+0000","last_clean":"2023-10-09T06:58:43.784061+0000","last_became_active":"2023-10-09T06:58:43.255578+0000","last_became_peered":"2023-10-09T06:58:43.255578+0000","last_unstale":"2023-10-09T06:58:43.784061+0000","last_undegraded":"2023-10-09T06:58:43.784061+0000","last_fullsized":"2023-10-09T06:58:43.784061+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:40.351052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798159+0000","last_change":"2023-10-09T06:58:43.796219+0000","last_active":"2023-10-09T06:58:43.798159+0000","last_peered":"2023-10-09T06:58:43.798159+0000","last_clean":"2023-10-09T06:58:43.798159+0000","last_became_active":"2023-10-09T06:58:43.795941+0000","last_became_peered":"2023-10-09T06:58:43.795941+0000","last_unstale":"2023-10-09T06:58:43.798159+0000","last_undegraded":"2023-10-09T06:58:43.798159+0000","last_fullsized":"2023-10-09T06:58:43.798159+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:14.659129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.786291+0000","last_change":"2023-10-09T06:58:43.260159+0000","last_active":"2023-10-09T06:58:43.786291+0000","last_peered":"2023-10-09T06:58:43.786291+0000","last_clean":"2023-10-09T06:58:43.786291+0000","last_became_active":"2023-10-09T06:58:43.259901+0000","last_became_peered":"2023-10-09T06:58:43.259901+0000","last_unstale":"2023-10-09T06:58:43.786291+0000","last_undegraded":"2023-10-09T06:58:43.786291+0000","last_fullsized":"2023-10-09T06:58:43.786291+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:49:23.556684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.795419+0000","last_change":"2023-10-09T06:58:43.791886+0000","last_active":"2023-10-09T06:58:43.795419+0000","last_peered":"2023-10-09T06:58:43.795419+0000","last_clean":"2023-10-09T06:58:43.795419+0000","last_became_active":"2023-10-09T06:58:43.791584+0000","last_became_peered":"2023-10-09T06:58:43.791584+0000","last_unstale":"2023-10-09T06:58:43.795419+0000","last_undegraded":"2023-10-09T06:58:43.795419+0000","last_fullsized":"2023-10-09T06:58:43.795419+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:39:57.258267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.776097+0000","last_change":"2023-10-09T06:58:43.251771+0000","last_active":"2023-10-09T06:58:43.776097+0000","last_peered":"2023-10-09T06:58:43.776097+0000","last_clean":"2023-10-09T06:58:43.776097+0000","last_became_active":"2023-10-09T06:58:43.251526+0000","last_became_peered":"2023-10-09T06:58:43.251526+0000","last_unstale":"2023-10-09T06:58:43.776097+0000","last_undegraded":"2023-10-09T06:58:43.776097+0000","last_fullsized":"2023-10-09T06:58:43.776097+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:56.176507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.788879+0000","last_change":"2023-10-09T06:58:43.785494+0000","last_active":"2023-10-09T06:58:43.788879+0000","last_peered":"2023-10-09T06:58:43.788879+0000","last_clean":"2023-10-09T06:58:43.788879+0000","last_became_active":"2023-10-09T06:58:43.785046+0000","last_became_peered":"2023-10-09T06:58:43.785046+0000","last_unstale":"2023-10-09T06:58:43.788879+0000","last_undegraded":"2023-10-09T06:58:43.788879+0000","last_fullsized":"2023-10-09T06:58:43.788879+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:56:11.098462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.263422+0000","last_change":"2023-10-09T06:58:43.256281+0000","last_active":"2023-10-09T06:58:44.263422+0000","last_peered":"2023-10-09T06:58:44.263422+0000","last_clean":"2023-10-09T06:58:44.263422+0000","last_became_active":"2023-10-09T06:58:43.255990+0000","last_became_peered":"2023-10-09T06:58:43.255990+0000","last_unstale":"2023-10-09T06:58:44.263422+0000","last_undegraded":"2023-10-09T06:58:44.263422+0000","last_fullsized":"2023-10-09T06:58:44.263422+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:21.986566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801858+0000","last_change":"2023-10-09T06:58:43.798965+0000","last_active":"2023-10-09T06:58:43.801858+0000","last_peered":"2023-10-09T06:58:43.801858+0000","last_clean":"2023-10-09T06:58:43.801858+0000","last_became_active":"2023-10-09T06:58:43.798614+0000","last_became_peered":"2023-10-09T06:58:43.798614+0000","last_unstale":"2023-10-09T06:58:43.801858+0000","last_undegraded":"2023-10-09T06:58:43.801858+0000","last_fullsized":"2023-10-09T06:58:43.801858+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:08.320839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779711+0000","last_change":"2023-10-09T06:58:43.252157+0000","last_active":"2023-10-09T06:58:43.779711+0000","last_peered":"2023-10-09T06:58:43.779711+0000","last_clean":"2023-10-09T06:58:43.779711+0000","last_became_active":"2023-10-09T06:58:43.251921+0000","last_became_peered":"2023-10-09T06:58:43.251921+0000","last_unstale":"2023-10-09T06:58:43.779711+0000","last_undegraded":"2023-10-09T06:58:43.779711+0000","last_fullsized":"2023-10-09T06:58:43.779711+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:14.775753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.800078+0000","last_change":"2023-10-09T06:58:43.794972+0000","last_active":"2023-10-09T06:58:43.800078+0000","last_peered":"2023-10-09T06:58:43.800078+0000","last_clean":"2023-10-09T06:58:43.800078+0000","last_became_active":"2023-10-09T06:58:43.794729+0000","last_became_peered":"2023-10-09T06:58:43.794729+0000","last_unstale":"2023-10-09T06:58:43.800078+0000","last_undegraded":"2023-10-09T06:58:43.800078+0000","last_fullsized":"2023-10-09T06:58:43.800078+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:10.429867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.782591+0000","last_change":"2023-10-09T06:58:43.259081+0000","last_active":"2023-10-09T06:58:43.782591+0000","last_peered":"2023-10-09T06:58:43.782591+0000","last_clean":"2023-10-09T06:58:43.782591+0000","last_became_active":"2023-10-09T06:58:43.258729+0000","last_became_peered":"2023-10-09T06:58:43.258729+0000","last_unstale":"2023-10-09T06:58:43.782591+0000","last_undegraded":"2023-10-09T06:58:43.782591+0000","last_fullsized":"2023-10-09T06:58:43.782591+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:21:14.895980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792325+0000","last_change":"2023-10-09T06:58:43.787346+0000","last_active":"2023-10-09T06:58:43.792325+0000","last_peered":"2023-10-09T06:58:43.792325+0000","last_clean":"2023-10-09T06:58:43.792325+0000","last_became_active":"2023-10-09T06:58:43.786810+0000","last_became_peered":"2023-10-09T06:58:43.786810+0000","last_unstale":"2023-10-09T06:58:43.792325+0000","last_undegraded":"2023-10-09T06:58:43.792325+0000","last_fullsized":"2023-10-09T06:58:43.792325+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:39:57.258267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.788892+0000","last_change":"2023-10-09T06:58:43.259179+0000","last_active":"2023-10-09T06:58:43.788892+0000","last_peered":"2023-10-09T06:58:43.788892+0000","last_clean":"2023-10-09T06:58:43.788892+0000","last_became_active":"2023-10-09T06:58:43.258684+0000","last_became_peered":"2023-10-09T06:58:43.258684+0000","last_unstale":"2023-10-09T06:58:43.788892+0000","last_undegraded":"2023-10-09T06:58:43.788892+0000","last_fullsized":"2023-10-09T06:58:43.788892+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:08.617277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.786769+0000","last_change":"2023-10-09T06:58:43.785126+0000","last_active":"2023-10-09T06:58:43.786769+0000","last_peered":"2023-10-09T06:58:43.786769+0000","last_clean":"2023-10-09T06:58:43.786769+0000","last_became_active":"2023-10-09T06:58:43.784848+0000","last_became_peered":"2023-10-09T06:58:43.784848+0000","last_unstale":"2023-10-09T06:58:43.786769+0000","last_undegraded":"2023-10-09T06:58:43.786769+0000","last_fullsized":"2023-10-09T06:58:43.786769+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:37.545876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779768+0000","last_change":"2023-10-09T06:58:43.253376+0000","last_active":"2023-10-09T06:58:43.779768+0000","last_peered":"2023-10-09T06:58:43.779768+0000","last_clean":"2023-10-09T06:58:43.779768+0000","last_became_active":"2023-10-09T06:58:43.253110+0000","last_became_peered":"2023-10-09T06:58:43.253110+0000","last_unstale":"2023-10-09T06:58:43.779768+0000","last_undegraded":"2023-10-09T06:58:43.779768+0000","last_fullsized":"2023-10-09T06:58:43.779768+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:56:21.112546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.789652+0000","last_change":"2023-10-09T06:58:43.784901+0000","last_active":"2023-10-09T06:58:43.789652+0000","last_peered":"2023-10-09T06:58:43.789652+0000","last_clean":"2023-10-09T06:58:43.789652+0000","last_became_active":"2023-10-09T06:58:43.784645+0000","last_became_peered":"2023-10-09T06:58:43.784645+0000","last_unstale":"2023-10-09T06:58:43.789652+0000","last_undegraded":"2023-10-09T06:58:43.789652+0000","last_fullsized":"2023-10-09T06:58:43.789652+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:56:33.524723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779732+0000","last_change":"2023-10-09T06:58:43.255156+0000","last_active":"2023-10-09T06:58:43.779732+0000","last_peered":"2023-10-09T06:58:43.779732+0000","last_clean":"2023-10-09T06:58:43.779732+0000","last_became_active":"2023-10-09T06:58:43.254884+0000","last_became_peered":"2023-10-09T06:58:43.254884+0000","last_unstale":"2023-10-09T06:58:43.779732+0000","last_undegraded":"2023-10-09T06:58:43.779732+0000","last_fullsized":"2023-10-09T06:58:43.779732+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:08.617277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.797067+0000","last_change":"2023-10-09T06:58:43.791710+0000","last_active":"2023-10-09T06:58:43.797067+0000","last_peered":"2023-10-09T06:58:43.797067+0000","last_clean":"2023-10-09T06:58:43.797067+0000","last_became_active":"2023-10-09T06:58:43.791444+0000","last_became_peered":"2023-10-09T06:58:43.791444+0000","last_unstale":"2023-10-09T06:58:43.797067+0000","last_undegraded":"2023-10-09T06:58:43.797067+0000","last_fullsized":"2023-10-09T06:58:43.797067+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:39:57.258267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.788453+0000","last_change":"2023-10-09T06:58:43.255822+0000","last_active":"2023-10-09T06:58:43.788453+0000","last_peered":"2023-10-09T06:58:43.788453+0000","last_clean":"2023-10-09T06:58:43.788453+0000","last_became_active":"2023-10-09T06:58:43.255538+0000","last_became_peered":"2023-10-09T06:58:43.255538+0000","last_unstale":"2023-10-09T06:58:43.788453+0000","last_undegraded":"2023-10-09T06:58:43.788453+0000","last_fullsized":"2023-10-09T06:58:43.788453+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:16:07.159805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801620+0000","last_change":"2023-10-09T06:58:43.796121+0000","last_active":"2023-10-09T06:58:43.801620+0000","last_peered":"2023-10-09T06:58:43.801620+0000","last_clean":"2023-10-09T06:58:43.801620+0000","last_became_active":"2023-10-09T06:58:43.794037+0000","last_became_peered":"2023-10-09T06:58:43.794037+0000","last_unstale":"2023-10-09T06:58:43.801620+0000","last_undegraded":"2023-10-09T06:58:43.801620+0000","last_fullsized":"2023-10-09T06:58:43.801620+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:49.433121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.781109+0000","last_change":"2023-10-09T06:58:43.256820+0000","last_active":"2023-10-09T06:58:43.781109+0000","last_peered":"2023-10-09T06:58:43.781109+0000","last_clean":"2023-10-09T06:58:43.781109+0000","last_became_active":"2023-10-09T06:58:43.256460+0000","last_became_peered":"2023-10-09T06:58:43.256460+0000","last_unstale":"2023-10-09T06:58:43.781109+0000","last_undegraded":"2023-10-09T06:58:43.781109+0000","last_fullsized":"2023-10-09T06:58:43.781109+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:51:46.519760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792081+0000","last_change":"2023-10-09T06:58:43.789965+0000","last_active":"2023-10-09T06:58:43.792081+0000","last_peered":"2023-10-09T06:58:43.792081+0000","last_clean":"2023-10-09T06:58:43.792081+0000","last_became_active":"2023-10-09T06:58:43.789716+0000","last_became_peered":"2023-10-09T06:58:43.789716+0000","last_unstale":"2023-10-09T06:58:43.792081+0000","last_undegraded":"2023-10-09T06:58:43.792081+0000","last_fullsized":"2023-10-09T06:58:43.792081+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:12:28.848971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.263240+0000","last_change":"2023-10-09T06:58:43.257311+0000","last_active":"2023-10-09T06:58:44.263240+0000","last_peered":"2023-10-09T06:58:44.263240+0000","last_clean":"2023-10-09T06:58:44.263240+0000","last_became_active":"2023-10-09T06:58:43.256961+0000","last_became_peered":"2023-10-09T06:58:43.256961+0000","last_unstale":"2023-10-09T06:58:44.263240+0000","last_undegraded":"2023-10-09T06:58:44.263240+0000","last_fullsized":"2023-10-09T06:58:44.263240+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:57.710580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"96'205","reported_seq":550,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.786203+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:58:43.786203+0000","last_peered":"2023-10-09T06:58:43.786203+0000","last_clean":"2023-10-09T06:58:43.786203+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:58:43.786203+0000","last_undegraded":"2023-10-09T06:58:43.786203+0000","last_fullsized":"2023-10-09T06:58:43.786203+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575042,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303252,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068588,"statfs":{"total":96636764160,"available":96326234112,"internally_reserved":0,"allocated":1912832,"data_stored":1230431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68400000000000005,"15min":0.70799999999999996},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.316},"max":{"1min":0.81100000000000005,"5min":1.732,"15min":1.9490000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.44,"5min":0.40200000000000002,"15min":0.29999999999999999},"max":{"1min":0.83299999999999996,"5min":1.22,"15min":3.448},"last":0.66200000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.504,"5min":0.437,"15min":0.379},"max":{"1min":0.86799999999999999,"5min":2.3559999999999999,"15min":5.617},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.46999999999999997,"5min":0.45800000000000002,"15min":0.40200000000000002},"max":{"1min":0.97599999999999998,"5min":1.7869999999999999,"15min":2.016},"last":0.56299999999999994}]},{"osd":2,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.72999999999999998,"15min":0.73899999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.44800000000000001},"max":{"1min":0.97999999999999998,"5min":1.9430000000000001,"15min":2.052},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.73799999999999999,"15min":0.75600000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.44700000000000001},"max":{"1min":0.82399999999999995,"5min":2.6629999999999998,"15min":3.5019999999999998},"last":0.57899999999999996}]},{"osd":3,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.73899999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.45000000000000001},"max":{"1min":0.97099999999999997,"5min":1.03,"15min":5.5800000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.746,"15min":0.78100000000000003},"min":{"1min":0.50800000000000001,"5min":0.496,"15min":0.47099999999999997},"max":{"1min":0.89800000000000002,"5min":1.827,"15min":6.9299999999999997},"last":0.69699999999999995}]},{"osd":4,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.91000000000000003,"5min":0.95499999999999996,"15min":3.125},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.66500000000000004},"min":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1850000000000001,"5min":2.577,"15min":4.8380000000000001},"last":0.68400000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68700000000000006,"15min":0.68100000000000005},"min":{"1min":0.441,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":1.0309999999999999,"5min":2.5169999999999999,"15min":4.1929999999999996},"last":0.755},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.5,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":2.9590000000000001,"15min":3.6749999999999998},"last":0.77100000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0449999999999999,"5min":3.0019999999999998,"15min":4.0250000000000004},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72699999999999998,"15min":0.752},"min":{"1min":0.498,"5min":0.47399999999999998,"15min":0.44700000000000001},"max":{"1min":1.0740000000000001,"5min":2.4039999999999999,"15min":7.0259999999999998},"last":0.78700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575041,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302680,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069160,"statfs":{"total":96636764160,"available":96326819840,"internally_reserved":0,"allocated":1327104,"data_stored":640659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68799999999999994,"15min":0.71399999999999997},"min":{"1min":0.47599999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86899999999999999,"5min":0.97899999999999998,"15min":1.022},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66700000000000004,"15min":0.70199999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.36599999999999999},"max":{"1min":0.72999999999999998,"5min":0.93899999999999995,"15min":1.079},"last":0.57099999999999995}]},{"osd":1,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.68799999999999994,"15min":0.71999999999999997},"min":{"1min":0.48199999999999998,"5min":0.45500000000000002,"15min":0.42799999999999999},"max":{"1min":0.76700000000000002,"5min":1.135,"15min":1.135},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68799999999999994,"15min":0.72499999999999998},"min":{"1min":0.47799999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81699999999999995,"5min":1.0109999999999999,"15min":1.034},"last":0.71899999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.69999999999999996,"15min":0.73199999999999998},"min":{"1min":0.52300000000000002,"5min":0.49199999999999999,"15min":0.42599999999999999},"max":{"1min":0.86099999999999999,"5min":1.391,"15min":1.391},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.68799999999999994,"15min":0.73099999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90500000000000003,"5min":0.91000000000000003,"15min":1.0900000000000001},"last":0.54100000000000004}]},{"osd":3,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66700000000000004,"15min":0.69899999999999995},"min":{"1min":0.502,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.81899999999999995,"5min":0.91700000000000004,"15min":1.046},"last":0.626},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.72899999999999998,"15min":0.753},"min":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.497},"max":{"1min":0.82999999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.79900000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61399999999999999,"15min":0.621},"min":{"1min":0.38,"5min":0.38,"15min":0.377},"max":{"1min":0.84699999999999998,"5min":1.768,"15min":1.768},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.36199999999999999},"max":{"1min":0.84399999999999997,"5min":1.601,"15min":1.601},"last":0.68100000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65500000000000003,"15min":0.65200000000000002},"min":{"1min":0.53100000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84099999999999997,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.42299999999999999},"max":{"1min":0.86699999999999999,"5min":0.94699999999999995,"15min":1.0669999999999999},"last":0.76600000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66900000000000004,"15min":0.67600000000000005},"min":{"1min":0.55600000000000005,"5min":0.42899999999999999,"15min":0.41799999999999998},"max":{"1min":0.95999999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56499999999999995,"5min":0.44600000000000001,"15min":0.42399999999999999},"max":{"1min":0.89600000000000002,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.872}]}]},{"osd":1,"up_from":13,"seq":55834575042,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302680,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069160,"statfs":{"total":96636764160,"available":96326819840,"internally_reserved":0,"allocated":1327104,"data_stored":640187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.45600000000000002,"15min":0.45900000000000002},"min":{"1min":0.26600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48699999999999999,"15min":0.48499999999999999},"min":{"1min":0.313,"5min":0.29399999999999998,"15min":0.23699999999999999},"max":{"1min":1.1879999999999999,"5min":1.23,"15min":1.23},"last":0.56200000000000006}]},{"osd":2,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48299999999999998,"15min":0.495},"min":{"1min":0.34799999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.67700000000000005,"5min":1.169,"15min":1.169},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.3500000000000001,"5min":3.077,"15min":3.077},"last":0.58599999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.34100000000000003},"max":{"1min":1.6839999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.36099999999999999,"5min":0.34899999999999998,"15min":0.34100000000000003},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.60499999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.71999999999999997,"15min":0.75700000000000001},"min":{"1min":0.46700000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.995,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.745}]},{"osd":5,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.57699999999999996,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.74299999999999999,"15min":0.77900000000000003},"min":{"1min":0.52100000000000002,"5min":0.497,"15min":0.47999999999999998},"max":{"1min":1.0209999999999999,"5min":1.637,"15min":1.637},"last":0.79800000000000004}]},{"osd":6,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.78000000000000003,"15min":0.79600000000000004},"min":{"1min":0.55600000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77600000000000002,"15min":0.79800000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.86899999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.81999999999999995,"15min":0.82799999999999996},"min":{"1min":0.54400000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.4350000000000001,"5min":3.4350000000000001,"15min":3.4350000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77600000000000002,"15min":0.81899999999999995},"min":{"1min":0.51400000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1200000000000001,"5min":1.125,"15min":1.1970000000000001},"last":0.71799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575041,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299156,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072684,"statfs":{"total":96636764160,"available":96330428416,"internally_reserved":0,"allocated":1912832,"data_stored":1230395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.29299999999999998,"5min":0.27100000000000002,"15min":0.23000000000000001},"max":{"1min":0.623,"5min":0.85799999999999998,"15min":1.2729999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.28899999999999998},"max":{"1min":0.60399999999999998,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.63400000000000001,"5min":4.6980000000000004,"15min":4.6980000000000004},"last":0.436},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48999999999999999,"15min":0.497},"min":{"1min":0.34000000000000002,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.71799999999999997,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.41999999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":0.63800000000000001,"5min":1.2450000000000001,"15min":1.7130000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.441,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":0.70199999999999996,"5min":4.734,"15min":4.734},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.52900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99199999999999999,"5min":1.2270000000000001,"15min":1.752},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.50700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.91500000000000004,"5min":4.6619999999999999,"15min":4.6619999999999999},"last":0.79600000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.53700000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0049999999999999,"5min":1.1890000000000001,"15min":1.2769999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.58699999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90300000000000002,"5min":1.2809999999999999,"15min":1.7889999999999999},"last":0.69399999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.80500000000000005,"15min":0.81299999999999994},"min":{"1min":0.56499999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97299999999999998,"5min":4.6239999999999997,"15min":4.6239999999999997},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79300000000000004,"15min":0.80100000000000005},"min":{"1min":0.55600000000000005,"5min":0.50800000000000001,"15min":0.47999999999999998},"max":{"1min":0.96499999999999997,"5min":1.2689999999999999,"15min":1.4370000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.82499999999999996,"15min":0.83199999999999996},"min":{"1min":0.56299999999999994,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.042,"5min":1.256,"15min":1.518},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.621,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95599999999999996,"5min":1.702,"15min":1.8200000000000001},"last":0.81200000000000006}]}]},{"osd":2,"up_from":13,"seq":55834575041,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306768,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065072,"statfs":{"total":96636764160,"available":96322633728,"internally_reserved":0,"allocated":1318912,"data_stored":640547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.46800000000000003,"15min":0.45400000000000001},"min":{"1min":0.28299999999999997,"5min":0.26500000000000001,"15min":0.25900000000000001},"max":{"1min":0.76700000000000002,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.48999999999999999,"15min":0.495},"min":{"1min":0.30599999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.55300000000000005,"5min":1.633,"15min":1.633},"last":0.41799999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46400000000000002,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71599999999999997,"5min":1.097,"15min":1.865},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.79700000000000004,"5min":1.2689999999999999,"15min":1.79},"last":0.39100000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.58899999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.35799999999999998},"max":{"1min":0.82599999999999996,"5min":0.86699999999999999,"15min":1.8999999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.47399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70299999999999996,"5min":1.1890000000000001,"15min":1.8220000000000001},"last":0.49399999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":0.85799999999999998,"5min":1.2430000000000001,"15min":1.256},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.55000000000000004,"5min":0.45900000000000002,"15min":0.44800000000000001},"max":{"1min":0.91400000000000003,"5min":1.696,"15min":1.696},"last":0.96399999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.753,"15min":0.76800000000000002},"min":{"1min":0.505,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85199999999999998,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.143},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.503},"max":{"1min":0.83199999999999996,"5min":1.218,"15min":1.3440000000000001},"last":0.81799999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.54000000000000004,"5min":0.51000000000000001,"15min":0.48599999999999999},"max":{"1min":0.94899999999999995,"5min":1.768,"15min":1.768},"last":1.069},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.76400000000000001,"15min":0.79000000000000004},"min":{"1min":0.56599999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92900000000000005,"5min":1.3580000000000001,"15min":1.5309999999999999},"last":1.101}]},{"osd":7,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.61799999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97799999999999998,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.875},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.58699999999999997,"5min":0.57599999999999996,"15min":0.50900000000000001},"max":{"1min":0.92000000000000004,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.0209999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575042,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306776,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065064,"statfs":{"total":96636764160,"available":96322625536,"internally_reserved":0,"allocated":1327104,"data_stored":641529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.29599999999999999,"5min":0.29499999999999998,"15min":0.24099999999999999},"max":{"1min":0.86299999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.47899999999999998,"15min":0.48799999999999999},"min":{"1min":0.315,"5min":0.30199999999999999,"15min":0.28100000000000003},"max":{"1min":0.63600000000000001,"5min":1.228,"15min":1.228},"last":0.42599999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.48099999999999998,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58699999999999997,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.44500000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94099999999999995,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64800000000000002,"15min":0.63300000000000001},"min":{"1min":0.44400000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.97699999999999998,"5min":3.8900000000000001,"15min":3.8900000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.51100000000000001,"5min":0.48299999999999998,"15min":0.40799999999999997},"max":{"1min":0.76500000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.81000000000000005,"15min":0.82299999999999995},"min":{"1min":0.623,"5min":0.59399999999999997,"15min":0.52200000000000002},"max":{"1min":1.0189999999999999,"5min":1.22,"15min":1.22},"last":0.755}]},{"osd":5,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.45000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.86199999999999999,"5min":1.3360000000000001,"15min":2.1549999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.56399999999999995,"5min":0.55900000000000005,"15min":0.50600000000000001},"max":{"1min":1.0569999999999999,"5min":1.1639999999999999,"15min":1.419},"last":0.66800000000000004}]},{"osd":6,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.51700000000000002},"max":{"1min":0.875,"5min":1.304,"15min":1.304},"last":0.63},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95199999999999996,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91100000000000003,"5min":1.8180000000000001,"15min":2.0880000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.80800000000000005,"15min":0.82099999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92300000000000004,"5min":1.486,"15min":1.486},"last":0.71199999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575041,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310860,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060980,"statfs":{"total":96636764160,"available":96318443520,"internally_reserved":0,"allocated":1314816,"data_stored":639993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71399999999999997,"15min":0.70399999999999996},"min":{"1min":0.45000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79200000000000004,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.72799999999999998,"15min":0.72299999999999998},"min":{"1min":0.50900000000000001,"5min":0.42699999999999999,"15min":0.39300000000000002},"max":{"1min":0.97399999999999998,"5min":2.8130000000000002,"15min":3.23},"last":0.51000000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71899999999999997,"15min":0.71099999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.373},"max":{"1min":0.85699999999999998,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.53000000000000003,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.86499999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.71799999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.755,"15min":0.75700000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.38100000000000001},"max":{"1min":0.92900000000000005,"5min":2.5960000000000001,"15min":3.7509999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.48299999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90000000000000002,"5min":2.427,"15min":2.427},"last":0.68000000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.755,"15min":0.751},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.434},"max":{"1min":0.89700000000000002,"5min":2.6440000000000001,"15min":3.6970000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.77000000000000002,"15min":0.747},"min":{"1min":0.443,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":3.6899999999999999,"15min":3.6899999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63600000000000001,"15min":0.60899999999999999},"min":{"1min":0.379,"5min":0.317,"15min":0.317},"max":{"1min":0.84899999999999998,"5min":3.3860000000000001,"15min":3.4780000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.68999999999999995,"15min":0.65800000000000003},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.34999999999999998},"max":{"1min":0.91200000000000003,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.61899999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67100000000000004,"15min":0.64000000000000001},"min":{"1min":0.47699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82299999999999995,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.71499999999999997,"15min":0.67900000000000005},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.374},"max":{"1min":0.89100000000000001,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.82299999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.49299999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.96599999999999997,"5min":2.7210000000000001,"15min":3.2789999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.76900000000000002},"min":{"1min":0.56499999999999995,"5min":0.439,"15min":0.439},"max":{"1min":0.93600000000000005,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.752}]}]},{"osd":5,"up_from":13,"seq":55834575042,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302684,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069156,"statfs":{"total":96636764160,"available":96326815744,"internally_reserved":0,"allocated":1331200,"data_stored":641551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67600000000000005,"15min":0.69699999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.72299999999999998,"5min":0.93600000000000005,"15min":1.655},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65700000000000003,"15min":0.68400000000000005},"min":{"1min":0.42899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78200000000000003,"5min":1.0269999999999999,"15min":1.1359999999999999},"last":0.54000000000000004}]},{"osd":1,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71699999999999997,"5min":0.96899999999999997,"15min":2.4159999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.45400000000000001,"5min":0.44,"15min":0.40400000000000003},"max":{"1min":0.89100000000000001,"5min":0.95099999999999996,"15min":1.706},"last":0.77100000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69699999999999995,"15min":0.72799999999999998},"min":{"1min":0.501,"5min":0.48499999999999999,"15min":0.42999999999999999},"max":{"1min":0.75800000000000001,"5min":0.997,"15min":1.79},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69699999999999995,"15min":0.71599999999999997},"min":{"1min":0.49199999999999999,"5min":0.46500000000000002,"15min":0.442},"max":{"1min":0.752,"5min":1.006,"15min":2.4889999999999999},"last":0.84399999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68999999999999995,"15min":0.71699999999999997},"min":{"1min":0.46899999999999997,"5min":0.438,"15min":0.435},"max":{"1min":0.88600000000000001,"5min":1.0209999999999999,"15min":1.409},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73899999999999999,"15min":0.76900000000000002},"min":{"1min":0.56200000000000006,"5min":0.501,"15min":0.501},"max":{"1min":0.78600000000000003,"5min":0.95699999999999996,"15min":2.532},"last":0.65700000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":1.766},"last":0.876},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.622,"15min":0.621},"min":{"1min":0.48599999999999999,"5min":0.377,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":1.052,"15min":2.7829999999999999},"last":0.67500000000000004}]},{"osd":6,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.45100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82899999999999996,"5min":1.018,"15min":2.5739999999999998},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.40000000000000002,"15min":0.38900000000000001},"max":{"1min":0.84099999999999997,"5min":0.97999999999999998,"15min":1.8080000000000001},"last":0.94299999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.90700000000000003,"5min":1.175,"15min":2.9609999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.60499999999999998,"5min":0.498,"15min":0.45900000000000002},"max":{"1min":0.876,"5min":1.139,"15min":2.613},"last":0.92900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:58:53.426 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T06:58:53.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.625+0000 7f65167ff700 1 Processor -- start 2023-10-09T06:58:53.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.625+0000 7f65167ff700 1 -- start start 2023-10-09T06:58:53.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.626+0000 7f65167ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f65100b1850 0x7f65100b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:53.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.626+0000 7f65167ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65101579f0 0x7f65100abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:53.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.626+0000 7f65167ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65100cb300 con 0x7f65100ae680 2023-10-09T06:58:53.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.626+0000 7f65167ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f651006fc30 con 0x7f65100b1850 2023-10-09T06:58:53.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.626+0000 7f65167ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65100cc260 con 0x7f65101579f0 2023-10-09T06:58:53.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.627+0000 7f6514d9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65101579f0 0x7f65100abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:53.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.627+0000 7f650ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f65100b1850 0x7f65100b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:53.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.627+0000 7f6514d9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65101579f0 0x7f65100abf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:55950/0 (socket says 172.21.15.71:55950) 2023-10-09T06:58:53.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.627+0000 7f6514d9c700 1 -- 172.21.15.71:0/1861836781 learned_addr learned my addr 172.21.15.71:0/1861836781 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:53.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.627+0000 7f650ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f65100b1850 0x7f65100b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:36440/0 (socket says 172.21.15.71:36440) 2023-10-09T06:58:53.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.627+0000 7f650f7fe700 1 --1- 172.21.15.71:0/1861836781 >> v1:172.21.15.179:6789/0 conn(0x7f65100ae680 0x7f65101572e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:36436/0 (socket says 172.21.15.71:36436) 2023-10-09T06:58:53.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.627+0000 7f6514d9c700 1 -- 172.21.15.71:0/1861836781 >> v2:172.21.15.179:3300/0 conn(0x7f65100b1850 msgr2=0x7f65100b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:53.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.627+0000 7f6514d9c700 1 --2- 172.21.15.71:0/1861836781 >> v2:172.21.15.179:3300/0 conn(0x7f65100b1850 0x7f65100b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:53.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.627+0000 7f6514d9c700 1 -- 172.21.15.71:0/1861836781 >> v1:172.21.15.179:6789/0 conn(0x7f65100ae680 legacy=0x7f65101572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:53.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.628+0000 7f6514d9c700 1 -- 172.21.15.71:0/1861836781 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65100cb5e0 con 0x7f65101579f0 2023-10-09T06:58:53.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.628+0000 7f650ffff700 1 --2- 172.21.15.71:0/1861836781 >> v2:172.21.15.179:3300/0 conn(0x7f65100b1850 0x7f65100b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:58:53.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.627+0000 7f650effd700 1 -- 172.21.15.71:0/1861836781 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748358085 0 0) 0x7f65100cb300 con 0x7f65100ae680 2023-10-09T06:58:53.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.628+0000 7f6514d9c700 1 --2- 172.21.15.71:0/1861836781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65101579f0 0x7f65100abf60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6508009f20 tx=0x7f6508009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e279411b836c642 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:53.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.628+0000 7f650effd700 1 -- 172.21.15.71:0/1861836781 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650800e070 con 0x7f65101579f0 2023-10-09T06:58:53.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.628+0000 7f650effd700 1 -- 172.21.15.71:0/1861836781 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650800b9d0 con 0x7f65101579f0 2023-10-09T06:58:53.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.628+0000 7f650effd700 1 -- 172.21.15.71:0/1861836781 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65080092e0 con 0x7f65101579f0 2023-10-09T06:58:53.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.628+0000 7f65167ff700 1 -- 172.21.15.71:0/1861836781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65101579f0 msgr2=0x7f65100abf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:53.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.628+0000 7f65167ff700 1 --2- 172.21.15.71:0/1861836781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65101579f0 0x7f65100abf60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6508009f20 tx=0x7f6508009840 comp rx=0 tx=0).stop 2023-10-09T06:58:53.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.629+0000 7f65167ff700 1 -- 172.21.15.71:0/1861836781 shutdown_connections 2023-10-09T06:58:53.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.629+0000 7f65167ff700 1 --2- 172.21.15.71:0/1861836781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65101579f0 0x7f65100abf60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:53.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.629+0000 7f65167ff700 1 --2- 172.21.15.71:0/1861836781 >> v2:172.21.15.179:3300/0 conn(0x7f65100b1850 0x7f65100b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:53.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.629+0000 7f65167ff700 1 -- 172.21.15.71:0/1861836781 >> 172.21.15.71:0/1861836781 conn(0x7f651006a320 msgr2=0x7f65100cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:53.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.629+0000 7f65167ff700 1 -- 172.21.15.71:0/1861836781 shutdown_connections 2023-10-09T06:58:53.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.629+0000 7f65167ff700 1 -- 172.21.15.71:0/1861836781 wait complete. 2023-10-09T06:58:53.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.630+0000 7f65167ff700 1 Processor -- start 2023-10-09T06:58:53.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.630+0000 7f65167ff700 1 -- start start 2023-10-09T06:58:53.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.631+0000 7f65167ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65100ae680 0x7f651015d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:53.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.631+0000 7f65167ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65100b1850 0x7f651013dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:53.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.631+0000 7f65167ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65101579f0 0x7f6510169f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:53.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.631+0000 7f65167ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651015de20 con 0x7f65100ae680 2023-10-09T06:58:53.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.631+0000 7f65167ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651013e0f0 con 0x7f65100b1850 2023-10-09T06:58:53.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.631+0000 7f65167ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f651015c280 con 0x7f65101579f0 2023-10-09T06:58:53.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.631+0000 7f650ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65100ae680 0x7f651015d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:53.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.631+0000 7f650ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65100ae680 0x7f651015d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36774/0 (socket says 172.21.15.71:36774) 2023-10-09T06:58:53.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.631+0000 7f650ffff700 1 -- 172.21.15.71:0/4290808780 learned_addr learned my addr 172.21.15.71:0/4290808780 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:53.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.631+0000 7f6514d9c700 1 --2- 172.21.15.71:0/4290808780 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65101579f0 0x7f6510169f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:53.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.631+0000 7f650f7fe700 1 --2- 172.21.15.71:0/4290808780 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65100b1850 0x7f651013dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:53.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.632+0000 7f650ffff700 1 -- 172.21.15.71:0/4290808780 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65101579f0 msgr2=0x7f6510169f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:53.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.632+0000 7f650ffff700 1 --2- 172.21.15.71:0/4290808780 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65101579f0 0x7f6510169f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:53.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.632+0000 7f650ffff700 1 -- 172.21.15.71:0/4290808780 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65100b1850 msgr2=0x7f651013dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:53.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.632+0000 7f650ffff700 1 --2- 172.21.15.71:0/4290808780 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65100b1850 0x7f651013dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:53.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.632+0000 7f650ffff700 1 -- 172.21.15.71:0/4290808780 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6500009420 con 0x7f65100ae680 2023-10-09T06:58:53.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.632+0000 7f650ffff700 1 --2- 172.21.15.71:0/4290808780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65100ae680 0x7f651015d8e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f650000ec80 tx=0x7f65000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:53.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.632+0000 7f64f7fff700 1 -- 172.21.15.71:0/4290808780 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650000c8c0 con 0x7f65100ae680 2023-10-09T06:58:53.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.632+0000 7f64f7fff700 1 -- 172.21.15.71:0/4290808780 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650000ca20 con 0x7f65100ae680 2023-10-09T06:58:53.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.632+0000 7f64f7fff700 1 -- 172.21.15.71:0/4290808780 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650000cda0 con 0x7f65100ae680 2023-10-09T06:58:53.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.632+0000 7f65167ff700 1 -- 172.21.15.71:0/4290808780 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6508009ae0 con 0x7f65100ae680 2023-10-09T06:58:53.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.632+0000 7f65167ff700 1 -- 172.21.15.71:0/4290808780 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f651016a450 con 0x7f65100ae680 2023-10-09T06:58:53.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.633+0000 7f65167ff700 1 -- 172.21.15.71:0/4290808780 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f651004c3c0 con 0x7f65100ae680 2023-10-09T06:58:53.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.634+0000 7f64f7fff700 1 -- 172.21.15.71:0/4290808780 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6500013680 con 0x7f65100ae680 2023-10-09T06:58:53.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.635+0000 7f64f7fff700 1 --2- 172.21.15.71:0/4290808780 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f64fc066f30 0x7f64fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:53.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.635+0000 7f64f7fff700 1 -- 172.21.15.71:0/4290808780 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f6500084a90 con 0x7f65100ae680 2023-10-09T06:58:53.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.636+0000 7f650f7fe700 1 --2- 172.21.15.71:0/4290808780 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f64fc066f30 0x7f64fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:53.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.637+0000 7f650f7fe700 1 --2- 172.21.15.71:0/4290808780 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f64fc066f30 0x7f64fc0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6504007fd0 tx=0x7f6504007d50 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:53.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.639+0000 7f64f7fff700 1 -- 172.21.15.71:0/4290808780 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6500051ad0 con 0x7f65100ae680 2023-10-09T06:58:53.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.825+0000 7f65167ff700 1 -- 172.21.15.71:0/4290808780 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f65100cb8c0 con 0x7f64fc066f30 2023-10-09T06:58:53.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.834+0000 7f64f7fff700 1 -- 172.21.15.71:0/4290808780 <== mgr.6718 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289535 (secure 0 0 0) 0x7f65100cb8c0 con 0x7f64fc066f30 2023-10-09T06:58:53.839 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:53.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.838+0000 7f65167ff700 1 -- 172.21.15.71:0/4290808780 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f64fc066f30 msgr2=0x7f64fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:53.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.838+0000 7f65167ff700 1 --2- 172.21.15.71:0/4290808780 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f64fc066f30 0x7f64fc0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6504007fd0 tx=0x7f6504007d50 comp rx=0 tx=0).stop 2023-10-09T06:58:53.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.838+0000 7f65167ff700 1 -- 172.21.15.71:0/4290808780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65100ae680 msgr2=0x7f651015d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:53.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.838+0000 7f65167ff700 1 --2- 172.21.15.71:0/4290808780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65100ae680 0x7f651015d8e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f650000ec80 tx=0x7f65000091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:53.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.838+0000 7f65167ff700 1 -- 172.21.15.71:0/4290808780 shutdown_connections 2023-10-09T06:58:53.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.838+0000 7f65167ff700 1 --2- 172.21.15.71:0/4290808780 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65101579f0 0x7f6510169f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:53.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.838+0000 7f65167ff700 1 --2- 172.21.15.71:0/4290808780 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f64fc066f30 0x7f64fc0693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:53.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.838+0000 7f65167ff700 1 --2- 172.21.15.71:0/4290808780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65100ae680 0x7f651015d8e0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:53.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.838+0000 7f65167ff700 1 --2- 172.21.15.71:0/4290808780 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65100b1850 0x7f651013dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:53.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.838+0000 7f65167ff700 1 -- 172.21.15.71:0/4290808780 >> 172.21.15.71:0/4290808780 conn(0x7f651006a320 msgr2=0x7f65101525d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:53.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.839+0000 7f65167ff700 1 -- 172.21.15.71:0/4290808780 shutdown_connections 2023-10-09T06:58:53.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:53.839+0000 7f65167ff700 1 -- 172.21.15.71:0/4290808780 wait complete. 2023-10-09T06:58:53.842 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T06:58:53.857 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-09T06:58:51.973750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":363,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":243,"ondisk_log_size":243,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434856,"kb_used_data":11496,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752539864,"statfs":{"total":773094113280,"available":770600820736,"internally_reserved":0,"allocated":11771904,"data_stored":6305292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.197938"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801963+0000","last_change":"2023-10-09T06:58:43.799264+0000","last_active":"2023-10-09T06:58:43.801963+0000","last_peered":"2023-10-09T06:58:43.801963+0000","last_clean":"2023-10-09T06:58:43.801963+0000","last_became_active":"2023-10-09T06:58:43.799025+0000","last_became_peered":"2023-10-09T06:58:43.799025+0000","last_unstale":"2023-10-09T06:58:43.801963+0000","last_undegraded":"2023-10-09T06:58:43.801963+0000","last_fullsized":"2023-10-09T06:58:43.801963+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:08.320839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.800454+0000","last_change":"2023-10-09T06:58:43.799501+0000","last_active":"2023-10-09T06:58:43.800454+0000","last_peered":"2023-10-09T06:58:43.800454+0000","last_clean":"2023-10-09T06:58:43.800454+0000","last_became_active":"2023-10-09T06:58:43.799241+0000","last_became_peered":"2023-10-09T06:58:43.799241+0000","last_unstale":"2023-10-09T06:58:43.800454+0000","last_undegraded":"2023-10-09T06:58:43.800454+0000","last_fullsized":"2023-10-09T06:58:43.800454+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:11.893055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801813+0000","last_change":"2023-10-09T06:58:43.798217+0000","last_active":"2023-10-09T06:58:43.801813+0000","last_peered":"2023-10-09T06:58:43.801813+0000","last_clean":"2023-10-09T06:58:43.801813+0000","last_became_active":"2023-10-09T06:58:43.797956+0000","last_became_peered":"2023-10-09T06:58:43.797956+0000","last_unstale":"2023-10-09T06:58:43.801813+0000","last_undegraded":"2023-10-09T06:58:43.801813+0000","last_fullsized":"2023-10-09T06:58:43.801813+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:51:20.343477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796119+0000","last_change":"2023-10-09T06:58:43.794396+0000","last_active":"2023-10-09T06:58:43.796119+0000","last_peered":"2023-10-09T06:58:43.796119+0000","last_clean":"2023-10-09T06:58:43.796119+0000","last_became_active":"2023-10-09T06:58:43.794124+0000","last_became_peered":"2023-10-09T06:58:43.794124+0000","last_unstale":"2023-10-09T06:58:43.796119+0000","last_undegraded":"2023-10-09T06:58:43.796119+0000","last_fullsized":"2023-10-09T06:58:43.796119+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:26:49.171285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796255+0000","last_change":"2023-10-09T06:58:43.791324+0000","last_active":"2023-10-09T06:58:43.796255+0000","last_peered":"2023-10-09T06:58:43.796255+0000","last_clean":"2023-10-09T06:58:43.796255+0000","last_became_active":"2023-10-09T06:58:43.790853+0000","last_became_peered":"2023-10-09T06:58:43.790853+0000","last_unstale":"2023-10-09T06:58:43.796255+0000","last_undegraded":"2023-10-09T06:58:43.796255+0000","last_fullsized":"2023-10-09T06:58:43.796255+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:36.821271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796374+0000","last_change":"2023-10-09T06:58:43.792454+0000","last_active":"2023-10-09T06:58:43.796374+0000","last_peered":"2023-10-09T06:58:43.796374+0000","last_clean":"2023-10-09T06:58:43.796374+0000","last_became_active":"2023-10-09T06:58:43.790825+0000","last_became_peered":"2023-10-09T06:58:43.790825+0000","last_unstale":"2023-10-09T06:58:43.796374+0000","last_undegraded":"2023-10-09T06:58:43.796374+0000","last_fullsized":"2023-10-09T06:58:43.796374+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:50:22.439113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.793084+0000","last_change":"2023-10-09T06:58:43.791927+0000","last_active":"2023-10-09T06:58:43.793084+0000","last_peered":"2023-10-09T06:58:43.793084+0000","last_clean":"2023-10-09T06:58:43.793084+0000","last_became_active":"2023-10-09T06:58:43.791694+0000","last_became_peered":"2023-10-09T06:58:43.791694+0000","last_unstale":"2023-10-09T06:58:43.793084+0000","last_undegraded":"2023-10-09T06:58:43.793084+0000","last_fullsized":"2023-10-09T06:58:43.793084+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:41:21.133593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.789680+0000","last_change":"2023-10-09T06:58:43.789088+0000","last_active":"2023-10-09T06:58:43.789680+0000","last_peered":"2023-10-09T06:58:43.789680+0000","last_clean":"2023-10-09T06:58:43.789680+0000","last_became_active":"2023-10-09T06:58:43.788738+0000","last_became_peered":"2023-10-09T06:58:43.788738+0000","last_unstale":"2023-10-09T06:58:43.789680+0000","last_undegraded":"2023-10-09T06:58:43.789680+0000","last_fullsized":"2023-10-09T06:58:43.789680+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:36.821271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.785868+0000","last_change":"2023-10-09T06:58:43.784419+0000","last_active":"2023-10-09T06:58:43.785868+0000","last_peered":"2023-10-09T06:58:43.785868+0000","last_clean":"2023-10-09T06:58:43.785868+0000","last_became_active":"2023-10-09T06:58:43.784130+0000","last_became_peered":"2023-10-09T06:58:43.784130+0000","last_unstale":"2023-10-09T06:58:43.785868+0000","last_undegraded":"2023-10-09T06:58:43.785868+0000","last_fullsized":"2023-10-09T06:58:43.785868+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:10.429867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801937+0000","last_change":"2023-10-09T06:58:43.798563+0000","last_active":"2023-10-09T06:58:43.801937+0000","last_peered":"2023-10-09T06:58:43.801937+0000","last_clean":"2023-10-09T06:58:43.801937+0000","last_became_active":"2023-10-09T06:58:43.798175+0000","last_became_peered":"2023-10-09T06:58:43.798175+0000","last_unstale":"2023-10-09T06:58:43.801937+0000","last_undegraded":"2023-10-09T06:58:43.801937+0000","last_fullsized":"2023-10-09T06:58:43.801937+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:39:57.258267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.794464+0000","last_change":"2023-10-09T06:58:43.790416+0000","last_active":"2023-10-09T06:58:43.794464+0000","last_peered":"2023-10-09T06:58:43.794464+0000","last_clean":"2023-10-09T06:58:43.794464+0000","last_became_active":"2023-10-09T06:58:43.790148+0000","last_became_peered":"2023-10-09T06:58:43.790148+0000","last_unstale":"2023-10-09T06:58:43.794464+0000","last_undegraded":"2023-10-09T06:58:43.794464+0000","last_fullsized":"2023-10-09T06:58:43.794464+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:26.456449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.795064+0000","last_change":"2023-10-09T06:58:43.790213+0000","last_active":"2023-10-09T06:58:43.795064+0000","last_peered":"2023-10-09T06:58:43.795064+0000","last_clean":"2023-10-09T06:58:43.795064+0000","last_became_active":"2023-10-09T06:58:43.789938+0000","last_became_peered":"2023-10-09T06:58:43.789938+0000","last_unstale":"2023-10-09T06:58:43.795064+0000","last_undegraded":"2023-10-09T06:58:43.795064+0000","last_fullsized":"2023-10-09T06:58:43.795064+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:39.554977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.794242+0000","last_change":"2023-10-09T06:58:43.791018+0000","last_active":"2023-10-09T06:58:43.794242+0000","last_peered":"2023-10-09T06:58:43.794242+0000","last_clean":"2023-10-09T06:58:43.794242+0000","last_became_active":"2023-10-09T06:58:43.790650+0000","last_became_peered":"2023-10-09T06:58:43.790650+0000","last_unstale":"2023-10-09T06:58:43.794242+0000","last_undegraded":"2023-10-09T06:58:43.794242+0000","last_fullsized":"2023-10-09T06:58:43.794242+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:37.545876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.794813+0000","last_change":"2023-10-09T06:58:43.793638+0000","last_active":"2023-10-09T06:58:43.794813+0000","last_peered":"2023-10-09T06:58:43.794813+0000","last_clean":"2023-10-09T06:58:43.794813+0000","last_became_active":"2023-10-09T06:58:43.793289+0000","last_became_peered":"2023-10-09T06:58:43.793289+0000","last_unstale":"2023-10-09T06:58:43.794813+0000","last_undegraded":"2023-10-09T06:58:43.794813+0000","last_fullsized":"2023-10-09T06:58:43.794813+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:33.042437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792088+0000","last_change":"2023-10-09T06:58:43.789987+0000","last_active":"2023-10-09T06:58:43.792088+0000","last_peered":"2023-10-09T06:58:43.792088+0000","last_clean":"2023-10-09T06:58:43.792088+0000","last_became_active":"2023-10-09T06:58:43.789753+0000","last_became_peered":"2023-10-09T06:58:43.789753+0000","last_unstale":"2023-10-09T06:58:43.792088+0000","last_undegraded":"2023-10-09T06:58:43.792088+0000","last_fullsized":"2023-10-09T06:58:43.792088+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:55.083637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801028+0000","last_change":"2023-10-09T06:58:43.799220+0000","last_active":"2023-10-09T06:58:43.801028+0000","last_peered":"2023-10-09T06:58:43.801028+0000","last_clean":"2023-10-09T06:58:43.801028+0000","last_became_active":"2023-10-09T06:58:43.798948+0000","last_became_peered":"2023-10-09T06:58:43.798948+0000","last_unstale":"2023-10-09T06:58:43.801028+0000","last_undegraded":"2023-10-09T06:58:43.801028+0000","last_fullsized":"2023-10-09T06:58:43.801028+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:32.536328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798525+0000","last_change":"2023-10-09T06:58:43.793525+0000","last_active":"2023-10-09T06:58:43.798525+0000","last_peered":"2023-10-09T06:58:43.798525+0000","last_clean":"2023-10-09T06:58:43.798525+0000","last_became_active":"2023-10-09T06:58:43.793039+0000","last_became_peered":"2023-10-09T06:58:43.793039+0000","last_unstale":"2023-10-09T06:58:43.798525+0000","last_undegraded":"2023-10-09T06:58:43.798525+0000","last_fullsized":"2023-10-09T06:58:43.798525+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:10.429867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798108+0000","last_change":"2023-10-09T06:58:43.796846+0000","last_active":"2023-10-09T06:58:43.798108+0000","last_peered":"2023-10-09T06:58:43.798108+0000","last_clean":"2023-10-09T06:58:43.798108+0000","last_became_active":"2023-10-09T06:58:43.796598+0000","last_became_peered":"2023-10-09T06:58:43.796598+0000","last_unstale":"2023-10-09T06:58:43.798108+0000","last_undegraded":"2023-10-09T06:58:43.798108+0000","last_fullsized":"2023-10-09T06:58:43.798108+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:41:05.828751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792567+0000","last_change":"2023-10-09T06:58:43.788053+0000","last_active":"2023-10-09T06:58:43.792567+0000","last_peered":"2023-10-09T06:58:43.792567+0000","last_clean":"2023-10-09T06:58:43.792567+0000","last_became_active":"2023-10-09T06:58:43.787821+0000","last_became_peered":"2023-10-09T06:58:43.787821+0000","last_unstale":"2023-10-09T06:58:43.792567+0000","last_undegraded":"2023-10-09T06:58:43.792567+0000","last_fullsized":"2023-10-09T06:58:43.792567+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:49:56.178318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798095+0000","last_change":"2023-10-09T06:58:43.796626+0000","last_active":"2023-10-09T06:58:43.798095+0000","last_peered":"2023-10-09T06:58:43.798095+0000","last_clean":"2023-10-09T06:58:43.798095+0000","last_became_active":"2023-10-09T06:58:43.796232+0000","last_became_peered":"2023-10-09T06:58:43.796232+0000","last_unstale":"2023-10-09T06:58:43.798095+0000","last_undegraded":"2023-10-09T06:58:43.798095+0000","last_fullsized":"2023-10-09T06:58:43.798095+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:45.689229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.791208+0000","last_change":"2023-10-09T06:58:43.788457+0000","last_active":"2023-10-09T06:58:43.791208+0000","last_peered":"2023-10-09T06:58:43.791208+0000","last_clean":"2023-10-09T06:58:43.791208+0000","last_became_active":"2023-10-09T06:58:43.788206+0000","last_became_peered":"2023-10-09T06:58:43.788206+0000","last_unstale":"2023-10-09T06:58:43.791208+0000","last_undegraded":"2023-10-09T06:58:43.791208+0000","last_fullsized":"2023-10-09T06:58:43.791208+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:54:13.880490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.794533+0000","last_change":"2023-10-09T06:58:43.791344+0000","last_active":"2023-10-09T06:58:43.794533+0000","last_peered":"2023-10-09T06:58:43.794533+0000","last_clean":"2023-10-09T06:58:43.794533+0000","last_became_active":"2023-10-09T06:58:43.790302+0000","last_became_peered":"2023-10-09T06:58:43.790302+0000","last_unstale":"2023-10-09T06:58:43.794533+0000","last_undegraded":"2023-10-09T06:58:43.794533+0000","last_fullsized":"2023-10-09T06:58:43.794533+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:09.624621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801641+0000","last_change":"2023-10-09T06:58:43.797058+0000","last_active":"2023-10-09T06:58:43.801641+0000","last_peered":"2023-10-09T06:58:43.801641+0000","last_clean":"2023-10-09T06:58:43.801641+0000","last_became_active":"2023-10-09T06:58:43.796791+0000","last_became_peered":"2023-10-09T06:58:43.796791+0000","last_unstale":"2023-10-09T06:58:43.801641+0000","last_undegraded":"2023-10-09T06:58:43.801641+0000","last_fullsized":"2023-10-09T06:58:43.801641+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:57.183851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.791090+0000","last_change":"2023-10-09T06:58:43.787561+0000","last_active":"2023-10-09T06:58:43.791090+0000","last_peered":"2023-10-09T06:58:43.791090+0000","last_clean":"2023-10-09T06:58:43.791090+0000","last_became_active":"2023-10-09T06:58:43.787294+0000","last_became_peered":"2023-10-09T06:58:43.787294+0000","last_unstale":"2023-10-09T06:58:43.791090+0000","last_undegraded":"2023-10-09T06:58:43.791090+0000","last_fullsized":"2023-10-09T06:58:43.791090+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:15.783097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.800940+0000","last_change":"2023-10-09T06:58:43.799680+0000","last_active":"2023-10-09T06:58:43.800940+0000","last_peered":"2023-10-09T06:58:43.800940+0000","last_clean":"2023-10-09T06:58:43.800940+0000","last_became_active":"2023-10-09T06:58:43.798445+0000","last_became_peered":"2023-10-09T06:58:43.798445+0000","last_unstale":"2023-10-09T06:58:43.800940+0000","last_undegraded":"2023-10-09T06:58:43.800940+0000","last_fullsized":"2023-10-09T06:58:43.800940+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:18.050283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.799740+0000","last_change":"2023-10-09T06:58:43.794944+0000","last_active":"2023-10-09T06:58:43.799740+0000","last_peered":"2023-10-09T06:58:43.799740+0000","last_clean":"2023-10-09T06:58:43.799740+0000","last_became_active":"2023-10-09T06:58:43.794661+0000","last_became_peered":"2023-10-09T06:58:43.794661+0000","last_unstale":"2023-10-09T06:58:43.799740+0000","last_undegraded":"2023-10-09T06:58:43.799740+0000","last_fullsized":"2023-10-09T06:58:43.799740+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:20.771196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796612+0000","last_change":"2023-10-09T06:58:43.793097+0000","last_active":"2023-10-09T06:58:43.796612+0000","last_peered":"2023-10-09T06:58:43.796612+0000","last_clean":"2023-10-09T06:58:43.796612+0000","last_became_active":"2023-10-09T06:58:43.791977+0000","last_became_peered":"2023-10-09T06:58:43.791977+0000","last_unstale":"2023-10-09T06:58:43.796612+0000","last_undegraded":"2023-10-09T06:58:43.796612+0000","last_fullsized":"2023-10-09T06:58:43.796612+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:57.183851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801959+0000","last_change":"2023-10-09T06:58:43.798714+0000","last_active":"2023-10-09T06:58:43.801959+0000","last_peered":"2023-10-09T06:58:43.801959+0000","last_clean":"2023-10-09T06:58:43.801959+0000","last_became_active":"2023-10-09T06:58:43.798446+0000","last_became_peered":"2023-10-09T06:58:43.798446+0000","last_unstale":"2023-10-09T06:58:43.801959+0000","last_undegraded":"2023-10-09T06:58:43.801959+0000","last_fullsized":"2023-10-09T06:58:43.801959+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:20.771196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.791338+0000","last_change":"2023-10-09T06:58:43.786570+0000","last_active":"2023-10-09T06:58:43.791338+0000","last_peered":"2023-10-09T06:58:43.791338+0000","last_clean":"2023-10-09T06:58:43.791338+0000","last_became_active":"2023-10-09T06:58:43.786278+0000","last_became_peered":"2023-10-09T06:58:43.786278+0000","last_unstale":"2023-10-09T06:58:43.791338+0000","last_undegraded":"2023-10-09T06:58:43.791338+0000","last_fullsized":"2023-10-09T06:58:43.791338+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:20:14.106000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.797100+0000","last_change":"2023-10-09T06:58:43.793238+0000","last_active":"2023-10-09T06:58:43.797100+0000","last_peered":"2023-10-09T06:58:43.797100+0000","last_clean":"2023-10-09T06:58:43.797100+0000","last_became_active":"2023-10-09T06:58:43.792979+0000","last_became_peered":"2023-10-09T06:58:43.792979+0000","last_unstale":"2023-10-09T06:58:43.797100+0000","last_undegraded":"2023-10-09T06:58:43.797100+0000","last_fullsized":"2023-10-09T06:58:43.797100+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:16:08.167149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796387+0000","last_change":"2023-10-09T06:58:43.793047+0000","last_active":"2023-10-09T06:58:43.796387+0000","last_peered":"2023-10-09T06:58:43.796387+0000","last_clean":"2023-10-09T06:58:43.796387+0000","last_became_active":"2023-10-09T06:58:43.792478+0000","last_became_peered":"2023-10-09T06:58:43.792478+0000","last_unstale":"2023-10-09T06:58:43.796387+0000","last_undegraded":"2023-10-09T06:58:43.796387+0000","last_fullsized":"2023-10-09T06:58:43.796387+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:20.771196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801738+0000","last_change":"2023-10-09T06:58:43.797476+0000","last_active":"2023-10-09T06:58:43.801738+0000","last_peered":"2023-10-09T06:58:43.801738+0000","last_clean":"2023-10-09T06:58:43.801738+0000","last_became_active":"2023-10-09T06:58:43.796908+0000","last_became_peered":"2023-10-09T06:58:43.796908+0000","last_unstale":"2023-10-09T06:58:43.801738+0000","last_undegraded":"2023-10-09T06:58:43.801738+0000","last_fullsized":"2023-10-09T06:58:43.801738+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:36.821271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.799503+0000","last_change":"2023-10-09T06:58:43.796883+0000","last_active":"2023-10-09T06:58:43.799503+0000","last_peered":"2023-10-09T06:58:43.799503+0000","last_clean":"2023-10-09T06:58:43.799503+0000","last_became_active":"2023-10-09T06:58:43.796610+0000","last_became_peered":"2023-10-09T06:58:43.796610+0000","last_unstale":"2023-10-09T06:58:43.799503+0000","last_undegraded":"2023-10-09T06:58:43.799503+0000","last_fullsized":"2023-10-09T06:58:43.799503+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:39.554977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"106'4","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.261583+0000","last_change":"2023-10-09T06:58:43.259535+0000","last_active":"2023-10-09T06:58:44.261583+0000","last_peered":"2023-10-09T06:58:44.261583+0000","last_clean":"2023-10-09T06:58:44.261583+0000","last_became_active":"2023-10-09T06:58:43.259336+0000","last_became_peered":"2023-10-09T06:58:43.259336+0000","last_unstale":"2023-10-09T06:58:44.261583+0000","last_undegraded":"2023-10-09T06:58:44.261583+0000","last_fullsized":"2023-10-09T06:58:44.261583+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:17.947780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801684+0000","last_change":"2023-10-09T06:58:43.797058+0000","last_active":"2023-10-09T06:58:43.801684+0000","last_peered":"2023-10-09T06:58:43.801684+0000","last_clean":"2023-10-09T06:58:43.801684+0000","last_became_active":"2023-10-09T06:58:43.796772+0000","last_became_peered":"2023-10-09T06:58:43.796772+0000","last_unstale":"2023-10-09T06:58:43.801684+0000","last_undegraded":"2023-10-09T06:58:43.801684+0000","last_fullsized":"2023-10-09T06:58:43.801684+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:37.545876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.262810+0000","last_change":"2023-10-09T06:58:43.252052+0000","last_active":"2023-10-09T06:58:44.262810+0000","last_peered":"2023-10-09T06:58:44.262810+0000","last_clean":"2023-10-09T06:58:44.262810+0000","last_became_active":"2023-10-09T06:58:43.251738+0000","last_became_peered":"2023-10-09T06:58:43.251738+0000","last_unstale":"2023-10-09T06:58:44.262810+0000","last_undegraded":"2023-10-09T06:58:44.262810+0000","last_fullsized":"2023-10-09T06:58:44.262810+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:45:42.343993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.802384+0000","last_change":"2023-10-09T06:58:43.801259+0000","last_active":"2023-10-09T06:58:43.802384+0000","last_peered":"2023-10-09T06:58:43.802384+0000","last_clean":"2023-10-09T06:58:43.802384+0000","last_became_active":"2023-10-09T06:58:43.800994+0000","last_became_peered":"2023-10-09T06:58:43.800994+0000","last_unstale":"2023-10-09T06:58:43.802384+0000","last_undegraded":"2023-10-09T06:58:43.802384+0000","last_fullsized":"2023-10-09T06:58:43.802384+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:50:22.439113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.260847+0000","last_change":"2023-10-09T06:58:43.252945+0000","last_active":"2023-10-09T06:58:44.260847+0000","last_peered":"2023-10-09T06:58:44.260847+0000","last_clean":"2023-10-09T06:58:44.260847+0000","last_became_active":"2023-10-09T06:58:43.252616+0000","last_became_peered":"2023-10-09T06:58:43.252616+0000","last_unstale":"2023-10-09T06:58:44.260847+0000","last_undegraded":"2023-10-09T06:58:44.260847+0000","last_fullsized":"2023-10-09T06:58:44.260847+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:43:21.232774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.799838+0000","last_change":"2023-10-09T06:58:43.795728+0000","last_active":"2023-10-09T06:58:43.799838+0000","last_peered":"2023-10-09T06:58:43.799838+0000","last_clean":"2023-10-09T06:58:43.799838+0000","last_became_active":"2023-10-09T06:58:43.795459+0000","last_became_peered":"2023-10-09T06:58:43.795459+0000","last_unstale":"2023-10-09T06:58:43.799838+0000","last_undegraded":"2023-10-09T06:58:43.799838+0000","last_fullsized":"2023-10-09T06:58:43.799838+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:39.554977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.261335+0000","last_change":"2023-10-09T06:58:43.248945+0000","last_active":"2023-10-09T06:58:44.261335+0000","last_peered":"2023-10-09T06:58:44.261335+0000","last_clean":"2023-10-09T06:58:44.261335+0000","last_became_active":"2023-10-09T06:58:43.248676+0000","last_became_peered":"2023-10-09T06:58:43.248676+0000","last_unstale":"2023-10-09T06:58:44.261335+0000","last_undegraded":"2023-10-09T06:58:44.261335+0000","last_fullsized":"2023-10-09T06:58:44.261335+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:39:35.477143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.797144+0000","last_change":"2023-10-09T06:58:43.793238+0000","last_active":"2023-10-09T06:58:43.797144+0000","last_peered":"2023-10-09T06:58:43.797144+0000","last_clean":"2023-10-09T06:58:43.797144+0000","last_became_active":"2023-10-09T06:58:43.792972+0000","last_became_peered":"2023-10-09T06:58:43.792972+0000","last_unstale":"2023-10-09T06:58:43.797144+0000","last_undegraded":"2023-10-09T06:58:43.797144+0000","last_fullsized":"2023-10-09T06:58:43.797144+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:14.141466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.262947+0000","last_change":"2023-10-09T06:58:43.254364+0000","last_active":"2023-10-09T06:58:44.262947+0000","last_peered":"2023-10-09T06:58:44.262947+0000","last_clean":"2023-10-09T06:58:44.262947+0000","last_became_active":"2023-10-09T06:58:43.254116+0000","last_became_peered":"2023-10-09T06:58:43.254116+0000","last_unstale":"2023-10-09T06:58:44.262947+0000","last_undegraded":"2023-10-09T06:58:44.262947+0000","last_fullsized":"2023-10-09T06:58:44.262947+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:16:07.159805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798740+0000","last_change":"2023-10-09T06:58:43.794432+0000","last_active":"2023-10-09T06:58:43.798740+0000","last_peered":"2023-10-09T06:58:43.798740+0000","last_clean":"2023-10-09T06:58:43.798740+0000","last_became_active":"2023-10-09T06:58:43.794079+0000","last_became_peered":"2023-10-09T06:58:43.794079+0000","last_unstale":"2023-10-09T06:58:43.798740+0000","last_undegraded":"2023-10-09T06:58:43.798740+0000","last_fullsized":"2023-10-09T06:58:43.798740+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:50:22.439113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.262592+0000","last_change":"2023-10-09T06:58:43.255791+0000","last_active":"2023-10-09T06:58:44.262592+0000","last_peered":"2023-10-09T06:58:44.262592+0000","last_clean":"2023-10-09T06:58:44.262592+0000","last_became_active":"2023-10-09T06:58:43.255535+0000","last_became_peered":"2023-10-09T06:58:43.255535+0000","last_unstale":"2023-10-09T06:58:44.262592+0000","last_undegraded":"2023-10-09T06:58:44.262592+0000","last_fullsized":"2023-10-09T06:58:44.262592+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:46:58.364775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.799835+0000","last_change":"2023-10-09T06:58:43.795758+0000","last_active":"2023-10-09T06:58:43.799835+0000","last_peered":"2023-10-09T06:58:43.799835+0000","last_clean":"2023-10-09T06:58:43.799835+0000","last_became_active":"2023-10-09T06:58:43.795406+0000","last_became_peered":"2023-10-09T06:58:43.795406+0000","last_unstale":"2023-10-09T06:58:43.799835+0000","last_undegraded":"2023-10-09T06:58:43.799835+0000","last_fullsized":"2023-10-09T06:58:43.799835+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:57.183851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.780552+0000","last_change":"2023-10-09T06:58:43.244540+0000","last_active":"2023-10-09T06:58:43.780552+0000","last_peered":"2023-10-09T06:58:43.780552+0000","last_clean":"2023-10-09T06:58:43.780552+0000","last_became_active":"2023-10-09T06:58:43.244261+0000","last_became_peered":"2023-10-09T06:58:43.244261+0000","last_unstale":"2023-10-09T06:58:43.780552+0000","last_undegraded":"2023-10-09T06:58:43.780552+0000","last_fullsized":"2023-10-09T06:58:43.780552+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:56.176507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792065+0000","last_change":"2023-10-09T06:58:43.788475+0000","last_active":"2023-10-09T06:58:43.792065+0000","last_peered":"2023-10-09T06:58:43.792065+0000","last_clean":"2023-10-09T06:58:43.792065+0000","last_became_active":"2023-10-09T06:58:43.788225+0000","last_became_peered":"2023-10-09T06:58:43.788225+0000","last_unstale":"2023-10-09T06:58:43.792065+0000","last_undegraded":"2023-10-09T06:58:43.792065+0000","last_fullsized":"2023-10-09T06:58:43.792065+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:13:39.010325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779920+0000","last_change":"2023-10-09T06:58:43.251615+0000","last_active":"2023-10-09T06:58:43.779920+0000","last_peered":"2023-10-09T06:58:43.779920+0000","last_clean":"2023-10-09T06:58:43.779920+0000","last_became_active":"2023-10-09T06:58:43.250726+0000","last_became_peered":"2023-10-09T06:58:43.250726+0000","last_unstale":"2023-10-09T06:58:43.779920+0000","last_undegraded":"2023-10-09T06:58:43.779920+0000","last_fullsized":"2023-10-09T06:58:43.779920+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:26:48.163941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792119+0000","last_change":"2023-10-09T06:58:43.789342+0000","last_active":"2023-10-09T06:58:43.792119+0000","last_peered":"2023-10-09T06:58:43.792119+0000","last_clean":"2023-10-09T06:58:43.792119+0000","last_became_active":"2023-10-09T06:58:43.789085+0000","last_became_peered":"2023-10-09T06:58:43.789085+0000","last_unstale":"2023-10-09T06:58:43.792119+0000","last_undegraded":"2023-10-09T06:58:43.792119+0000","last_fullsized":"2023-10-09T06:58:43.792119+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:05:54.912313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.789062+0000","last_change":"2023-10-09T06:58:43.258785+0000","last_active":"2023-10-09T06:58:43.789062+0000","last_peered":"2023-10-09T06:58:43.789062+0000","last_clean":"2023-10-09T06:58:43.789062+0000","last_became_active":"2023-10-09T06:58:43.258340+0000","last_became_peered":"2023-10-09T06:58:43.258340+0000","last_unstale":"2023-10-09T06:58:43.789062+0000","last_undegraded":"2023-10-09T06:58:43.789062+0000","last_fullsized":"2023-10-09T06:58:43.789062+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:51:46.519760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796150+0000","last_change":"2023-10-09T06:58:43.790672+0000","last_active":"2023-10-09T06:58:43.796150+0000","last_peered":"2023-10-09T06:58:43.796150+0000","last_clean":"2023-10-09T06:58:43.796150+0000","last_became_active":"2023-10-09T06:58:43.790256+0000","last_became_peered":"2023-10-09T06:58:43.790256+0000","last_unstale":"2023-10-09T06:58:43.796150+0000","last_undegraded":"2023-10-09T06:58:43.796150+0000","last_fullsized":"2023-10-09T06:58:43.796150+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:20.771196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.788826+0000","last_change":"2023-10-09T06:58:43.259889+0000","last_active":"2023-10-09T06:58:43.788826+0000","last_peered":"2023-10-09T06:58:43.788826+0000","last_clean":"2023-10-09T06:58:43.788826+0000","last_became_active":"2023-10-09T06:58:43.259534+0000","last_became_peered":"2023-10-09T06:58:43.259534+0000","last_unstale":"2023-10-09T06:58:43.788826+0000","last_undegraded":"2023-10-09T06:58:43.788826+0000","last_fullsized":"2023-10-09T06:58:43.788826+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:28.977749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.800375+0000","last_change":"2023-10-09T06:58:43.798126+0000","last_active":"2023-10-09T06:58:43.800375+0000","last_peered":"2023-10-09T06:58:43.800375+0000","last_clean":"2023-10-09T06:58:43.800375+0000","last_became_active":"2023-10-09T06:58:43.797884+0000","last_became_peered":"2023-10-09T06:58:43.797884+0000","last_unstale":"2023-10-09T06:58:43.800375+0000","last_undegraded":"2023-10-09T06:58:43.800375+0000","last_fullsized":"2023-10-09T06:58:43.800375+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:42:30.221135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"106'3","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.262691+0000","last_change":"2023-10-09T06:58:43.258779+0000","last_active":"2023-10-09T06:58:44.262691+0000","last_peered":"2023-10-09T06:58:44.262691+0000","last_clean":"2023-10-09T06:58:44.262691+0000","last_became_active":"2023-10-09T06:58:43.258443+0000","last_became_peered":"2023-10-09T06:58:43.258443+0000","last_unstale":"2023-10-09T06:58:44.262691+0000","last_undegraded":"2023-10-09T06:58:44.262691+0000","last_fullsized":"2023-10-09T06:58:44.262691+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:00.822915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796573+0000","last_change":"2023-10-09T06:58:43.791013+0000","last_active":"2023-10-09T06:58:43.796573+0000","last_peered":"2023-10-09T06:58:43.796573+0000","last_clean":"2023-10-09T06:58:43.796573+0000","last_became_active":"2023-10-09T06:58:43.789697+0000","last_became_peered":"2023-10-09T06:58:43.789697+0000","last_unstale":"2023-10-09T06:58:43.796573+0000","last_undegraded":"2023-10-09T06:58:43.796573+0000","last_fullsized":"2023-10-09T06:58:43.796573+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:49.433121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"106'6","reported_seq":16,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.264969+0000","last_change":"2023-10-09T06:58:43.249828+0000","last_active":"2023-10-09T06:58:44.264969+0000","last_peered":"2023-10-09T06:58:44.264969+0000","last_clean":"2023-10-09T06:58:44.264969+0000","last_became_active":"2023-10-09T06:58:43.249550+0000","last_became_peered":"2023-10-09T06:58:43.249550+0000","last_unstale":"2023-10-09T06:58:44.264969+0000","last_undegraded":"2023-10-09T06:58:44.264969+0000","last_fullsized":"2023-10-09T06:58:44.264969+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:57.710580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792408+0000","last_change":"2023-10-09T06:58:43.786500+0000","last_active":"2023-10-09T06:58:43.792408+0000","last_peered":"2023-10-09T06:58:43.792408+0000","last_clean":"2023-10-09T06:58:43.792408+0000","last_became_active":"2023-10-09T06:58:43.786244+0000","last_became_peered":"2023-10-09T06:58:43.786244+0000","last_unstale":"2023-10-09T06:58:43.792408+0000","last_undegraded":"2023-10-09T06:58:43.792408+0000","last_fullsized":"2023-10-09T06:58:43.792408+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:01.948441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.262408+0000","last_change":"2023-10-09T06:58:43.251369+0000","last_active":"2023-10-09T06:58:44.262408+0000","last_peered":"2023-10-09T06:58:44.262408+0000","last_clean":"2023-10-09T06:58:44.262408+0000","last_became_active":"2023-10-09T06:58:43.251090+0000","last_became_peered":"2023-10-09T06:58:43.251090+0000","last_unstale":"2023-10-09T06:58:44.262408+0000","last_undegraded":"2023-10-09T06:58:44.262408+0000","last_fullsized":"2023-10-09T06:58:44.262408+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:54:12.873146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.789917+0000","last_change":"2023-10-09T06:58:43.786782+0000","last_active":"2023-10-09T06:58:43.789917+0000","last_peered":"2023-10-09T06:58:43.789917+0000","last_clean":"2023-10-09T06:58:43.789917+0000","last_became_active":"2023-10-09T06:58:43.786468+0000","last_became_peered":"2023-10-09T06:58:43.786468+0000","last_unstale":"2023-10-09T06:58:43.789917+0000","last_undegraded":"2023-10-09T06:58:43.789917+0000","last_fullsized":"2023-10-09T06:58:43.789917+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:49.433121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.776377+0000","last_change":"2023-10-09T06:58:43.251912+0000","last_active":"2023-10-09T06:58:43.776377+0000","last_peered":"2023-10-09T06:58:43.776377+0000","last_clean":"2023-10-09T06:58:43.776377+0000","last_became_active":"2023-10-09T06:58:43.251661+0000","last_became_peered":"2023-10-09T06:58:43.251661+0000","last_unstale":"2023-10-09T06:58:43.776377+0000","last_undegraded":"2023-10-09T06:58:43.776377+0000","last_fullsized":"2023-10-09T06:58:43.776377+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:48.425777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.790274+0000","last_change":"2023-10-09T06:58:43.788503+0000","last_active":"2023-10-09T06:58:43.790274+0000","last_peered":"2023-10-09T06:58:43.790274+0000","last_clean":"2023-10-09T06:58:43.790274+0000","last_became_active":"2023-10-09T06:58:43.788263+0000","last_became_peered":"2023-10-09T06:58:43.788263+0000","last_unstale":"2023-10-09T06:58:43.790274+0000","last_undegraded":"2023-10-09T06:58:43.790274+0000","last_fullsized":"2023-10-09T06:58:43.790274+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:54.293662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779119+0000","last_change":"2023-10-09T06:58:43.248548+0000","last_active":"2023-10-09T06:58:43.779119+0000","last_peered":"2023-10-09T06:58:43.779119+0000","last_clean":"2023-10-09T06:58:43.779119+0000","last_became_active":"2023-10-09T06:58:43.248281+0000","last_became_peered":"2023-10-09T06:58:43.248281+0000","last_unstale":"2023-10-09T06:58:43.779119+0000","last_undegraded":"2023-10-09T06:58:43.779119+0000","last_fullsized":"2023-10-09T06:58:43.779119+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:20.836176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.799625+0000","last_change":"2023-10-09T06:58:43.797986+0000","last_active":"2023-10-09T06:58:43.799625+0000","last_peered":"2023-10-09T06:58:43.799625+0000","last_clean":"2023-10-09T06:58:43.799625+0000","last_became_active":"2023-10-09T06:58:43.797568+0000","last_became_peered":"2023-10-09T06:58:43.797568+0000","last_unstale":"2023-10-09T06:58:43.799625+0000","last_undegraded":"2023-10-09T06:58:43.799625+0000","last_fullsized":"2023-10-09T06:58:43.799625+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:29.985093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"106'8","reported_seq":18,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.263980+0000","last_change":"2023-10-09T06:58:43.253188+0000","last_active":"2023-10-09T06:58:44.263980+0000","last_peered":"2023-10-09T06:58:44.263980+0000","last_clean":"2023-10-09T06:58:44.263980+0000","last_became_active":"2023-10-09T06:58:43.252677+0000","last_became_peered":"2023-10-09T06:58:43.252677+0000","last_unstale":"2023-10-09T06:58:44.263980+0000","last_undegraded":"2023-10-09T06:58:44.263980+0000","last_fullsized":"2023-10-09T06:58:44.263980+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:33.706986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.799785+0000","last_change":"2023-10-09T06:58:43.795060+0000","last_active":"2023-10-09T06:58:43.799785+0000","last_peered":"2023-10-09T06:58:43.799785+0000","last_clean":"2023-10-09T06:58:43.799785+0000","last_became_active":"2023-10-09T06:58:43.794801+0000","last_became_peered":"2023-10-09T06:58:43.794801+0000","last_unstale":"2023-10-09T06:58:43.799785+0000","last_undegraded":"2023-10-09T06:58:43.799785+0000","last_fullsized":"2023-10-09T06:58:43.799785+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:50:22.439113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.261011+0000","last_change":"2023-10-09T06:58:43.259431+0000","last_active":"2023-10-09T06:58:44.261011+0000","last_peered":"2023-10-09T06:58:44.261011+0000","last_clean":"2023-10-09T06:58:44.261011+0000","last_became_active":"2023-10-09T06:58:43.259153+0000","last_became_peered":"2023-10-09T06:58:43.259153+0000","last_unstale":"2023-10-09T06:58:44.261011+0000","last_undegraded":"2023-10-09T06:58:44.261011+0000","last_fullsized":"2023-10-09T06:58:44.261011+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:45:42.343993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801731+0000","last_change":"2023-10-09T06:58:43.797881+0000","last_active":"2023-10-09T06:58:43.801731+0000","last_peered":"2023-10-09T06:58:43.801731+0000","last_clean":"2023-10-09T06:58:43.801731+0000","last_became_active":"2023-10-09T06:58:43.797524+0000","last_became_peered":"2023-10-09T06:58:43.797524+0000","last_unstale":"2023-10-09T06:58:43.801731+0000","last_undegraded":"2023-10-09T06:58:43.801731+0000","last_fullsized":"2023-10-09T06:58:43.801731+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:51:20.343477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.263780+0000","last_change":"2023-10-09T06:58:43.250800+0000","last_active":"2023-10-09T06:58:44.263780+0000","last_peered":"2023-10-09T06:58:44.263780+0000","last_clean":"2023-10-09T06:58:44.263780+0000","last_became_active":"2023-10-09T06:58:43.250529+0000","last_became_peered":"2023-10-09T06:58:43.250529+0000","last_unstale":"2023-10-09T06:58:44.263780+0000","last_undegraded":"2023-10-09T06:58:44.263780+0000","last_fullsized":"2023-10-09T06:58:44.263780+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:07.313495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796594+0000","last_change":"2023-10-09T06:58:43.791548+0000","last_active":"2023-10-09T06:58:43.796594+0000","last_peered":"2023-10-09T06:58:43.796594+0000","last_clean":"2023-10-09T06:58:43.796594+0000","last_became_active":"2023-10-09T06:58:43.790746+0000","last_became_peered":"2023-10-09T06:58:43.790746+0000","last_unstale":"2023-10-09T06:58:43.796594+0000","last_undegraded":"2023-10-09T06:58:43.796594+0000","last_fullsized":"2023-10-09T06:58:43.796594+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:37.545876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779490+0000","last_change":"2023-10-09T06:58:43.243471+0000","last_active":"2023-10-09T06:58:43.779490+0000","last_peered":"2023-10-09T06:58:43.779490+0000","last_clean":"2023-10-09T06:58:43.779490+0000","last_became_active":"2023-10-09T06:58:43.243230+0000","last_became_peered":"2023-10-09T06:58:43.243230+0000","last_unstale":"2023-10-09T06:58:43.779490+0000","last_undegraded":"2023-10-09T06:58:43.779490+0000","last_fullsized":"2023-10-09T06:58:43.779490+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:48.425777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.796119+0000","last_change":"2023-10-09T06:58:43.794689+0000","last_active":"2023-10-09T06:58:43.796119+0000","last_peered":"2023-10-09T06:58:43.796119+0000","last_clean":"2023-10-09T06:58:43.796119+0000","last_became_active":"2023-10-09T06:58:43.793778+0000","last_became_peered":"2023-10-09T06:58:43.793778+0000","last_unstale":"2023-10-09T06:58:43.796119+0000","last_undegraded":"2023-10-09T06:58:43.796119+0000","last_fullsized":"2023-10-09T06:58:43.796119+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:22.993909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.261333+0000","last_change":"2023-10-09T06:58:43.252297+0000","last_active":"2023-10-09T06:58:44.261333+0000","last_peered":"2023-10-09T06:58:44.261333+0000","last_clean":"2023-10-09T06:58:44.261333+0000","last_became_active":"2023-10-09T06:58:43.252051+0000","last_became_peered":"2023-10-09T06:58:43.252051+0000","last_unstale":"2023-10-09T06:58:44.261333+0000","last_undegraded":"2023-10-09T06:58:44.261333+0000","last_fullsized":"2023-10-09T06:58:44.261333+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:07.313495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.786645+0000","last_change":"2023-10-09T06:58:43.785110+0000","last_active":"2023-10-09T06:58:43.786645+0000","last_peered":"2023-10-09T06:58:43.786645+0000","last_clean":"2023-10-09T06:58:43.786645+0000","last_became_active":"2023-10-09T06:58:43.784802+0000","last_became_peered":"2023-10-09T06:58:43.784802+0000","last_unstale":"2023-10-09T06:58:43.786645+0000","last_undegraded":"2023-10-09T06:58:43.786645+0000","last_fullsized":"2023-10-09T06:58:43.786645+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:39.554977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.784061+0000","last_change":"2023-10-09T06:58:43.255859+0000","last_active":"2023-10-09T06:58:43.784061+0000","last_peered":"2023-10-09T06:58:43.784061+0000","last_clean":"2023-10-09T06:58:43.784061+0000","last_became_active":"2023-10-09T06:58:43.255578+0000","last_became_peered":"2023-10-09T06:58:43.255578+0000","last_unstale":"2023-10-09T06:58:43.784061+0000","last_undegraded":"2023-10-09T06:58:43.784061+0000","last_fullsized":"2023-10-09T06:58:43.784061+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:40.351052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.798159+0000","last_change":"2023-10-09T06:58:43.796219+0000","last_active":"2023-10-09T06:58:43.798159+0000","last_peered":"2023-10-09T06:58:43.798159+0000","last_clean":"2023-10-09T06:58:43.798159+0000","last_became_active":"2023-10-09T06:58:43.795941+0000","last_became_peered":"2023-10-09T06:58:43.795941+0000","last_unstale":"2023-10-09T06:58:43.798159+0000","last_undegraded":"2023-10-09T06:58:43.798159+0000","last_fullsized":"2023-10-09T06:58:43.798159+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:14.659129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.786291+0000","last_change":"2023-10-09T06:58:43.260159+0000","last_active":"2023-10-09T06:58:43.786291+0000","last_peered":"2023-10-09T06:58:43.786291+0000","last_clean":"2023-10-09T06:58:43.786291+0000","last_became_active":"2023-10-09T06:58:43.259901+0000","last_became_peered":"2023-10-09T06:58:43.259901+0000","last_unstale":"2023-10-09T06:58:43.786291+0000","last_undegraded":"2023-10-09T06:58:43.786291+0000","last_fullsized":"2023-10-09T06:58:43.786291+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:49:23.556684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.795419+0000","last_change":"2023-10-09T06:58:43.791886+0000","last_active":"2023-10-09T06:58:43.795419+0000","last_peered":"2023-10-09T06:58:43.795419+0000","last_clean":"2023-10-09T06:58:43.795419+0000","last_became_active":"2023-10-09T06:58:43.791584+0000","last_became_peered":"2023-10-09T06:58:43.791584+0000","last_unstale":"2023-10-09T06:58:43.795419+0000","last_undegraded":"2023-10-09T06:58:43.795419+0000","last_fullsized":"2023-10-09T06:58:43.795419+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:39:57.258267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.776097+0000","last_change":"2023-10-09T06:58:43.251771+0000","last_active":"2023-10-09T06:58:43.776097+0000","last_peered":"2023-10-09T06:58:43.776097+0000","last_clean":"2023-10-09T06:58:43.776097+0000","last_became_active":"2023-10-09T06:58:43.251526+0000","last_became_peered":"2023-10-09T06:58:43.251526+0000","last_unstale":"2023-10-09T06:58:43.776097+0000","last_undegraded":"2023-10-09T06:58:43.776097+0000","last_fullsized":"2023-10-09T06:58:43.776097+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:56.176507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.788879+0000","last_change":"2023-10-09T06:58:43.785494+0000","last_active":"2023-10-09T06:58:43.788879+0000","last_peered":"2023-10-09T06:58:43.788879+0000","last_clean":"2023-10-09T06:58:43.788879+0000","last_became_active":"2023-10-09T06:58:43.785046+0000","last_became_peered":"2023-10-09T06:58:43.785046+0000","last_unstale":"2023-10-09T06:58:43.788879+0000","last_undegraded":"2023-10-09T06:58:43.788879+0000","last_fullsized":"2023-10-09T06:58:43.788879+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:56:11.098462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.263422+0000","last_change":"2023-10-09T06:58:43.256281+0000","last_active":"2023-10-09T06:58:44.263422+0000","last_peered":"2023-10-09T06:58:44.263422+0000","last_clean":"2023-10-09T06:58:44.263422+0000","last_became_active":"2023-10-09T06:58:43.255990+0000","last_became_peered":"2023-10-09T06:58:43.255990+0000","last_unstale":"2023-10-09T06:58:44.263422+0000","last_undegraded":"2023-10-09T06:58:44.263422+0000","last_fullsized":"2023-10-09T06:58:44.263422+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:21.986566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801858+0000","last_change":"2023-10-09T06:58:43.798965+0000","last_active":"2023-10-09T06:58:43.801858+0000","last_peered":"2023-10-09T06:58:43.801858+0000","last_clean":"2023-10-09T06:58:43.801858+0000","last_became_active":"2023-10-09T06:58:43.798614+0000","last_became_peered":"2023-10-09T06:58:43.798614+0000","last_unstale":"2023-10-09T06:58:43.801858+0000","last_undegraded":"2023-10-09T06:58:43.801858+0000","last_fullsized":"2023-10-09T06:58:43.801858+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:08.320839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779711+0000","last_change":"2023-10-09T06:58:43.252157+0000","last_active":"2023-10-09T06:58:43.779711+0000","last_peered":"2023-10-09T06:58:43.779711+0000","last_clean":"2023-10-09T06:58:43.779711+0000","last_became_active":"2023-10-09T06:58:43.251921+0000","last_became_peered":"2023-10-09T06:58:43.251921+0000","last_unstale":"2023-10-09T06:58:43.779711+0000","last_undegraded":"2023-10-09T06:58:43.779711+0000","last_fullsized":"2023-10-09T06:58:43.779711+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:34:14.775753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.800078+0000","last_change":"2023-10-09T06:58:43.794972+0000","last_active":"2023-10-09T06:58:43.800078+0000","last_peered":"2023-10-09T06:58:43.800078+0000","last_clean":"2023-10-09T06:58:43.800078+0000","last_became_active":"2023-10-09T06:58:43.794729+0000","last_became_peered":"2023-10-09T06:58:43.794729+0000","last_unstale":"2023-10-09T06:58:43.800078+0000","last_undegraded":"2023-10-09T06:58:43.800078+0000","last_fullsized":"2023-10-09T06:58:43.800078+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:10.429867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.782591+0000","last_change":"2023-10-09T06:58:43.259081+0000","last_active":"2023-10-09T06:58:43.782591+0000","last_peered":"2023-10-09T06:58:43.782591+0000","last_clean":"2023-10-09T06:58:43.782591+0000","last_became_active":"2023-10-09T06:58:43.258729+0000","last_became_peered":"2023-10-09T06:58:43.258729+0000","last_unstale":"2023-10-09T06:58:43.782591+0000","last_undegraded":"2023-10-09T06:58:43.782591+0000","last_fullsized":"2023-10-09T06:58:43.782591+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:21:14.895980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792325+0000","last_change":"2023-10-09T06:58:43.787346+0000","last_active":"2023-10-09T06:58:43.792325+0000","last_peered":"2023-10-09T06:58:43.792325+0000","last_clean":"2023-10-09T06:58:43.792325+0000","last_became_active":"2023-10-09T06:58:43.786810+0000","last_became_peered":"2023-10-09T06:58:43.786810+0000","last_unstale":"2023-10-09T06:58:43.792325+0000","last_undegraded":"2023-10-09T06:58:43.792325+0000","last_fullsized":"2023-10-09T06:58:43.792325+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:39:57.258267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.788892+0000","last_change":"2023-10-09T06:58:43.259179+0000","last_active":"2023-10-09T06:58:43.788892+0000","last_peered":"2023-10-09T06:58:43.788892+0000","last_clean":"2023-10-09T06:58:43.788892+0000","last_became_active":"2023-10-09T06:58:43.258684+0000","last_became_peered":"2023-10-09T06:58:43.258684+0000","last_unstale":"2023-10-09T06:58:43.788892+0000","last_undegraded":"2023-10-09T06:58:43.788892+0000","last_fullsized":"2023-10-09T06:58:43.788892+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:08.617277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.786769+0000","last_change":"2023-10-09T06:58:43.785126+0000","last_active":"2023-10-09T06:58:43.786769+0000","last_peered":"2023-10-09T06:58:43.786769+0000","last_clean":"2023-10-09T06:58:43.786769+0000","last_became_active":"2023-10-09T06:58:43.784848+0000","last_became_peered":"2023-10-09T06:58:43.784848+0000","last_unstale":"2023-10-09T06:58:43.786769+0000","last_undegraded":"2023-10-09T06:58:43.786769+0000","last_fullsized":"2023-10-09T06:58:43.786769+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:37.545876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779768+0000","last_change":"2023-10-09T06:58:43.253376+0000","last_active":"2023-10-09T06:58:43.779768+0000","last_peered":"2023-10-09T06:58:43.779768+0000","last_clean":"2023-10-09T06:58:43.779768+0000","last_became_active":"2023-10-09T06:58:43.253110+0000","last_became_peered":"2023-10-09T06:58:43.253110+0000","last_unstale":"2023-10-09T06:58:43.779768+0000","last_undegraded":"2023-10-09T06:58:43.779768+0000","last_fullsized":"2023-10-09T06:58:43.779768+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:56:21.112546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.789652+0000","last_change":"2023-10-09T06:58:43.784901+0000","last_active":"2023-10-09T06:58:43.789652+0000","last_peered":"2023-10-09T06:58:43.789652+0000","last_clean":"2023-10-09T06:58:43.789652+0000","last_became_active":"2023-10-09T06:58:43.784645+0000","last_became_peered":"2023-10-09T06:58:43.784645+0000","last_unstale":"2023-10-09T06:58:43.789652+0000","last_undegraded":"2023-10-09T06:58:43.789652+0000","last_fullsized":"2023-10-09T06:58:43.789652+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:56:33.524723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.779732+0000","last_change":"2023-10-09T06:58:43.255156+0000","last_active":"2023-10-09T06:58:43.779732+0000","last_peered":"2023-10-09T06:58:43.779732+0000","last_clean":"2023-10-09T06:58:43.779732+0000","last_became_active":"2023-10-09T06:58:43.254884+0000","last_became_peered":"2023-10-09T06:58:43.254884+0000","last_unstale":"2023-10-09T06:58:43.779732+0000","last_undegraded":"2023-10-09T06:58:43.779732+0000","last_fullsized":"2023-10-09T06:58:43.779732+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:08.617277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.797067+0000","last_change":"2023-10-09T06:58:43.791710+0000","last_active":"2023-10-09T06:58:43.797067+0000","last_peered":"2023-10-09T06:58:43.797067+0000","last_clean":"2023-10-09T06:58:43.797067+0000","last_became_active":"2023-10-09T06:58:43.791444+0000","last_became_peered":"2023-10-09T06:58:43.791444+0000","last_unstale":"2023-10-09T06:58:43.797067+0000","last_undegraded":"2023-10-09T06:58:43.797067+0000","last_fullsized":"2023-10-09T06:58:43.797067+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:39:57.258267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.788453+0000","last_change":"2023-10-09T06:58:43.255822+0000","last_active":"2023-10-09T06:58:43.788453+0000","last_peered":"2023-10-09T06:58:43.788453+0000","last_clean":"2023-10-09T06:58:43.788453+0000","last_became_active":"2023-10-09T06:58:43.255538+0000","last_became_peered":"2023-10-09T06:58:43.255538+0000","last_unstale":"2023-10-09T06:58:43.788453+0000","last_undegraded":"2023-10-09T06:58:43.788453+0000","last_fullsized":"2023-10-09T06:58:43.788453+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:16:07.159805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.801620+0000","last_change":"2023-10-09T06:58:43.796121+0000","last_active":"2023-10-09T06:58:43.801620+0000","last_peered":"2023-10-09T06:58:43.801620+0000","last_clean":"2023-10-09T06:58:43.801620+0000","last_became_active":"2023-10-09T06:58:43.794037+0000","last_became_peered":"2023-10-09T06:58:43.794037+0000","last_unstale":"2023-10-09T06:58:43.801620+0000","last_undegraded":"2023-10-09T06:58:43.801620+0000","last_fullsized":"2023-10-09T06:58:43.801620+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:49.433121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.781109+0000","last_change":"2023-10-09T06:58:43.256820+0000","last_active":"2023-10-09T06:58:43.781109+0000","last_peered":"2023-10-09T06:58:43.781109+0000","last_clean":"2023-10-09T06:58:43.781109+0000","last_became_active":"2023-10-09T06:58:43.256460+0000","last_became_peered":"2023-10-09T06:58:43.256460+0000","last_unstale":"2023-10-09T06:58:43.781109+0000","last_undegraded":"2023-10-09T06:58:43.781109+0000","last_fullsized":"2023-10-09T06:58:43.781109+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:51:46.519760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.792081+0000","last_change":"2023-10-09T06:58:43.789965+0000","last_active":"2023-10-09T06:58:43.792081+0000","last_peered":"2023-10-09T06:58:43.792081+0000","last_clean":"2023-10-09T06:58:43.792081+0000","last_became_active":"2023-10-09T06:58:43.789716+0000","last_became_peered":"2023-10-09T06:58:43.789716+0000","last_unstale":"2023-10-09T06:58:43.792081+0000","last_undegraded":"2023-10-09T06:58:43.792081+0000","last_fullsized":"2023-10-09T06:58:43.792081+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:43.231109+0000","last_clean_scrub_stamp":"2023-10-09T06:58:43.231109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:12:28.848971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:44.263240+0000","last_change":"2023-10-09T06:58:43.257311+0000","last_active":"2023-10-09T06:58:44.263240+0000","last_peered":"2023-10-09T06:58:44.263240+0000","last_clean":"2023-10-09T06:58:44.263240+0000","last_became_active":"2023-10-09T06:58:43.256961+0000","last_became_peered":"2023-10-09T06:58:43.256961+0000","last_unstale":"2023-10-09T06:58:44.263240+0000","last_undegraded":"2023-10-09T06:58:44.263240+0000","last_fullsized":"2023-10-09T06:58:44.263240+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:58:42.223765+0000","last_clean_scrub_stamp":"2023-10-09T06:58:42.223765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:57.710580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"96'205","reported_seq":550,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-09T06:58:43.786203+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T06:58:43.786203+0000","last_peered":"2023-10-09T06:58:43.786203+0000","last_clean":"2023-10-09T06:58:43.786203+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T06:58:43.786203+0000","last_undegraded":"2023-10-09T06:58:43.786203+0000","last_fullsized":"2023-10-09T06:58:43.786203+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575042,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303252,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068588,"statfs":{"total":96636764160,"available":96326234112,"internally_reserved":0,"allocated":1912832,"data_stored":1230431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68400000000000005,"15min":0.70799999999999996},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.316},"max":{"1min":0.81100000000000005,"5min":1.732,"15min":1.9490000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.44,"5min":0.40200000000000002,"15min":0.29999999999999999},"max":{"1min":0.83299999999999996,"5min":1.22,"15min":3.448},"last":0.66200000000000003}]},{"osd":1,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.504,"5min":0.437,"15min":0.379},"max":{"1min":0.86799999999999999,"5min":2.3559999999999999,"15min":5.617},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.46999999999999997,"5min":0.45800000000000002,"15min":0.40200000000000002},"max":{"1min":0.97599999999999998,"5min":1.7869999999999999,"15min":2.016},"last":0.56299999999999994}]},{"osd":2,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.72999999999999998,"15min":0.73899999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.44800000000000001},"max":{"1min":0.97999999999999998,"5min":1.9430000000000001,"15min":2.052},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.73799999999999999,"15min":0.75600000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.44700000000000001},"max":{"1min":0.82399999999999995,"5min":2.6629999999999998,"15min":3.5019999999999998},"last":0.57899999999999996}]},{"osd":3,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.73899999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.45000000000000001},"max":{"1min":0.97099999999999997,"5min":1.03,"15min":5.5800000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.746,"15min":0.78100000000000003},"min":{"1min":0.50800000000000001,"5min":0.496,"15min":0.47099999999999997},"max":{"1min":0.89800000000000002,"5min":1.827,"15min":6.9299999999999997},"last":0.69699999999999995}]},{"osd":4,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.91000000000000003,"5min":0.95499999999999996,"15min":3.125},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.66500000000000004},"min":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1850000000000001,"5min":2.577,"15min":4.8380000000000001},"last":0.68400000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68700000000000006,"15min":0.68100000000000005},"min":{"1min":0.441,"5min":0.42599999999999999,"15min":0.39000000000000001},"max":{"1min":1.0309999999999999,"5min":2.5169999999999999,"15min":4.1929999999999996},"last":0.755},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.5,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":2.9590000000000001,"15min":3.6749999999999998},"last":0.77100000000000002}]},{"osd":6,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0449999999999999,"5min":3.0019999999999998,"15min":4.0250000000000004},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72699999999999998,"15min":0.752},"min":{"1min":0.498,"5min":0.47399999999999998,"15min":0.44700000000000001},"max":{"1min":1.0740000000000001,"5min":2.4039999999999999,"15min":7.0259999999999998},"last":0.78700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575041,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302680,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069160,"statfs":{"total":96636764160,"available":96326819840,"internally_reserved":0,"allocated":1327104,"data_stored":640659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68799999999999994,"15min":0.71399999999999997},"min":{"1min":0.47599999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86899999999999999,"5min":0.97899999999999998,"15min":1.022},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66700000000000004,"15min":0.70199999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.36599999999999999},"max":{"1min":0.72999999999999998,"5min":0.93899999999999995,"15min":1.079},"last":0.57099999999999995}]},{"osd":1,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.68799999999999994,"15min":0.71999999999999997},"min":{"1min":0.48199999999999998,"5min":0.45500000000000002,"15min":0.42799999999999999},"max":{"1min":0.76700000000000002,"5min":1.135,"15min":1.135},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68799999999999994,"15min":0.72499999999999998},"min":{"1min":0.47799999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81699999999999995,"5min":1.0109999999999999,"15min":1.034},"last":0.71899999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.69999999999999996,"15min":0.73199999999999998},"min":{"1min":0.52300000000000002,"5min":0.49199999999999999,"15min":0.42599999999999999},"max":{"1min":0.86099999999999999,"5min":1.391,"15min":1.391},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.68799999999999994,"15min":0.73099999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90500000000000003,"5min":0.91000000000000003,"15min":1.0900000000000001},"last":0.54100000000000004}]},{"osd":3,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66700000000000004,"15min":0.69899999999999995},"min":{"1min":0.502,"5min":0.41499999999999998,"15min":0.40600000000000003},"max":{"1min":0.81899999999999995,"5min":0.91700000000000004,"15min":1.046},"last":0.626},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.72899999999999998,"15min":0.753},"min":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.497},"max":{"1min":0.82999999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.79900000000000004}]},{"osd":4,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61399999999999999,"15min":0.621},"min":{"1min":0.38,"5min":0.38,"15min":0.377},"max":{"1min":0.84699999999999998,"5min":1.768,"15min":1.768},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.36199999999999999},"max":{"1min":0.84399999999999997,"5min":1.601,"15min":1.601},"last":0.68100000000000005}]},{"osd":5,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65500000000000003,"15min":0.65200000000000002},"min":{"1min":0.53100000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84099999999999997,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.42299999999999999},"max":{"1min":0.86699999999999999,"5min":0.94699999999999995,"15min":1.0669999999999999},"last":0.76600000000000001}]},{"osd":7,"last update":"Mon Oct 9 06:58:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66900000000000004,"15min":0.67600000000000005},"min":{"1min":0.55600000000000005,"5min":0.42899999999999999,"15min":0.41799999999999998},"max":{"1min":0.95999999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56499999999999995,"5min":0.44600000000000001,"15min":0.42399999999999999},"max":{"1min":0.89600000000000002,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.872}]}]},{"osd":1,"up_from":13,"seq":55834575042,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302680,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069160,"statfs":{"total":96636764160,"available":96326819840,"internally_reserved":0,"allocated":1327104,"data_stored":640187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.45600000000000002,"15min":0.45900000000000002},"min":{"1min":0.26600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48699999999999999,"15min":0.48499999999999999},"min":{"1min":0.313,"5min":0.29399999999999998,"15min":0.23699999999999999},"max":{"1min":1.1879999999999999,"5min":1.23,"15min":1.23},"last":0.56200000000000006}]},{"osd":2,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48299999999999998,"15min":0.495},"min":{"1min":0.34799999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.67700000000000005,"5min":1.169,"15min":1.169},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.3500000000000001,"5min":3.077,"15min":3.077},"last":0.58599999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.34100000000000003},"max":{"1min":1.6839999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.36099999999999999,"5min":0.34899999999999998,"15min":0.34100000000000003},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.60499999999999998}]},{"osd":4,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.71999999999999997,"15min":0.75700000000000001},"min":{"1min":0.46700000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.995,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.745}]},{"osd":5,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.57699999999999996,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.74299999999999999,"15min":0.77900000000000003},"min":{"1min":0.52100000000000002,"5min":0.497,"15min":0.47999999999999998},"max":{"1min":1.0209999999999999,"5min":1.637,"15min":1.637},"last":0.79800000000000004}]},{"osd":6,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.78000000000000003,"15min":0.79600000000000004},"min":{"1min":0.55600000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77600000000000002,"15min":0.79800000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.86899999999999999}]},{"osd":7,"last update":"Mon Oct 9 06:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.81999999999999995,"15min":0.82799999999999996},"min":{"1min":0.54400000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.4350000000000001,"5min":3.4350000000000001,"15min":3.4350000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77600000000000002,"15min":0.81899999999999995},"min":{"1min":0.51400000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1200000000000001,"5min":1.125,"15min":1.1970000000000001},"last":0.71799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575041,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299156,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072684,"statfs":{"total":96636764160,"available":96330428416,"internally_reserved":0,"allocated":1912832,"data_stored":1230395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.29299999999999998,"5min":0.27100000000000002,"15min":0.23000000000000001},"max":{"1min":0.623,"5min":0.85799999999999998,"15min":1.2729999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.28899999999999998},"max":{"1min":0.60399999999999998,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.35299999999999998},"max":{"1min":0.63400000000000001,"5min":4.6980000000000004,"15min":4.6980000000000004},"last":0.436},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48999999999999999,"15min":0.497},"min":{"1min":0.34000000000000002,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.71799999999999997,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.41999999999999998}]},{"osd":3,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52400000000000002,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":0.63800000000000001,"5min":1.2450000000000001,"15min":1.7130000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.441,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":0.70199999999999996,"5min":4.734,"15min":4.734},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.52900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99199999999999999,"5min":1.2270000000000001,"15min":1.752},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.50700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.91500000000000004,"5min":4.6619999999999999,"15min":4.6619999999999999},"last":0.79600000000000004}]},{"osd":5,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.53700000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0049999999999999,"5min":1.1890000000000001,"15min":1.2769999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.58699999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90300000000000002,"5min":1.2809999999999999,"15min":1.7889999999999999},"last":0.69399999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.80500000000000005,"15min":0.81299999999999994},"min":{"1min":0.56499999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97299999999999998,"5min":4.6239999999999997,"15min":4.6239999999999997},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79300000000000004,"15min":0.80100000000000005},"min":{"1min":0.55600000000000005,"5min":0.50800000000000001,"15min":0.47999999999999998},"max":{"1min":0.96499999999999997,"5min":1.2689999999999999,"15min":1.4370000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Mon Oct 9 06:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.82499999999999996,"15min":0.83199999999999996},"min":{"1min":0.56299999999999994,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.042,"5min":1.256,"15min":1.518},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.621,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95599999999999996,"5min":1.702,"15min":1.8200000000000001},"last":0.81200000000000006}]}]},{"osd":2,"up_from":13,"seq":55834575041,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306768,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065072,"statfs":{"total":96636764160,"available":96322633728,"internally_reserved":0,"allocated":1318912,"data_stored":640547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.46800000000000003,"15min":0.45400000000000001},"min":{"1min":0.28299999999999997,"5min":0.26500000000000001,"15min":0.25900000000000001},"max":{"1min":0.76700000000000002,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.48999999999999999,"15min":0.495},"min":{"1min":0.30599999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.55300000000000005,"5min":1.633,"15min":1.633},"last":0.41799999999999998}]},{"osd":1,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46400000000000002,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71599999999999997,"5min":1.097,"15min":1.865},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.79700000000000004,"5min":1.2689999999999999,"15min":1.79},"last":0.39100000000000001}]},{"osd":3,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.58899999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.35799999999999998},"max":{"1min":0.82599999999999996,"5min":0.86699999999999999,"15min":1.8999999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.47399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70299999999999996,"5min":1.1890000000000001,"15min":1.8220000000000001},"last":0.49399999999999999}]},{"osd":4,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":0.85799999999999998,"5min":1.2430000000000001,"15min":1.256},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.55000000000000004,"5min":0.45900000000000002,"15min":0.44800000000000001},"max":{"1min":0.91400000000000003,"5min":1.696,"15min":1.696},"last":0.96399999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.753,"15min":0.76800000000000002},"min":{"1min":0.505,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85199999999999998,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.143},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.503},"max":{"1min":0.83199999999999996,"5min":1.218,"15min":1.3440000000000001},"last":0.81799999999999995}]},{"osd":6,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.78000000000000003,"15min":0.78100000000000003},"min":{"1min":0.54000000000000004,"5min":0.51000000000000001,"15min":0.48599999999999999},"max":{"1min":0.94899999999999995,"5min":1.768,"15min":1.768},"last":1.069},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.76400000000000001,"15min":0.79000000000000004},"min":{"1min":0.56599999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92900000000000005,"5min":1.3580000000000001,"15min":1.5309999999999999},"last":1.101}]},{"osd":7,"last update":"Mon Oct 9 06:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.61799999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97799999999999998,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.875},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.58699999999999997,"5min":0.57599999999999996,"15min":0.50900000000000001},"max":{"1min":0.92000000000000004,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.0209999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575042,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306776,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065064,"statfs":{"total":96636764160,"available":96322625536,"internally_reserved":0,"allocated":1327104,"data_stored":641529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.29599999999999999,"5min":0.29499999999999998,"15min":0.24099999999999999},"max":{"1min":0.86299999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.47899999999999998,"15min":0.48799999999999999},"min":{"1min":0.315,"5min":0.30199999999999999,"15min":0.28100000000000003},"max":{"1min":0.63600000000000001,"5min":1.228,"15min":1.228},"last":0.42599999999999999}]},{"osd":1,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.48099999999999998,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58699999999999997,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.44500000000000001}]},{"osd":2,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94099999999999995,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64800000000000002,"15min":0.63300000000000001},"min":{"1min":0.44400000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.97699999999999998,"5min":3.8900000000000001,"15min":3.8900000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.51100000000000001,"5min":0.48299999999999998,"15min":0.40799999999999997},"max":{"1min":0.76500000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.81000000000000005,"15min":0.82299999999999995},"min":{"1min":0.623,"5min":0.59399999999999997,"15min":0.52200000000000002},"max":{"1min":1.0189999999999999,"5min":1.22,"15min":1.22},"last":0.755}]},{"osd":5,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.45000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.86199999999999999,"5min":1.3360000000000001,"15min":2.1549999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.56399999999999995,"5min":0.55900000000000005,"15min":0.50600000000000001},"max":{"1min":1.0569999999999999,"5min":1.1639999999999999,"15min":1.419},"last":0.66800000000000004}]},{"osd":6,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.51700000000000002},"max":{"1min":0.875,"5min":1.304,"15min":1.304},"last":0.63},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95199999999999996,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Mon Oct 9 06:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91100000000000003,"5min":1.8180000000000001,"15min":2.0880000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.80800000000000005,"15min":0.82099999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92300000000000004,"5min":1.486,"15min":1.486},"last":0.71199999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575041,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310860,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060980,"statfs":{"total":96636764160,"available":96318443520,"internally_reserved":0,"allocated":1314816,"data_stored":639993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71399999999999997,"15min":0.70399999999999996},"min":{"1min":0.45000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79200000000000004,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.72799999999999998,"15min":0.72299999999999998},"min":{"1min":0.50900000000000001,"5min":0.42699999999999999,"15min":0.39300000000000002},"max":{"1min":0.97399999999999998,"5min":2.8130000000000002,"15min":3.23},"last":0.51000000000000001}]},{"osd":1,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71899999999999997,"15min":0.71099999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.373},"max":{"1min":0.85699999999999998,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.53000000000000003,"5min":0.41499999999999998,"15min":0.40500000000000003},"max":{"1min":0.86499999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.71799999999999997}]},{"osd":2,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.755,"15min":0.75700000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.38100000000000001},"max":{"1min":0.92900000000000005,"5min":2.5960000000000001,"15min":3.7509999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.48299999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90000000000000002,"5min":2.427,"15min":2.427},"last":0.68000000000000005}]},{"osd":3,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.755,"15min":0.751},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.434},"max":{"1min":0.89700000000000002,"5min":2.6440000000000001,"15min":3.6970000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.77000000000000002,"15min":0.747},"min":{"1min":0.443,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":3.6899999999999999,"15min":3.6899999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63600000000000001,"15min":0.60899999999999999},"min":{"1min":0.379,"5min":0.317,"15min":0.317},"max":{"1min":0.84899999999999998,"5min":3.3860000000000001,"15min":3.4780000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.68999999999999995,"15min":0.65800000000000003},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.34999999999999998},"max":{"1min":0.91200000000000003,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.61899999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67100000000000004,"15min":0.64000000000000001},"min":{"1min":0.47699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82299999999999995,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.71499999999999997,"15min":0.67900000000000005},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.374},"max":{"1min":0.89100000000000001,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.82299999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.49299999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.96599999999999997,"5min":2.7210000000000001,"15min":3.2789999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.76900000000000002},"min":{"1min":0.56499999999999995,"5min":0.439,"15min":0.439},"max":{"1min":0.93600000000000005,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.752}]}]},{"osd":5,"up_from":13,"seq":55834575042,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302684,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069156,"statfs":{"total":96636764160,"available":96326815744,"internally_reserved":0,"allocated":1331200,"data_stored":641551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67600000000000005,"15min":0.69699999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.72299999999999998,"5min":0.93600000000000005,"15min":1.655},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65700000000000003,"15min":0.68400000000000005},"min":{"1min":0.42899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78200000000000003,"5min":1.0269999999999999,"15min":1.1359999999999999},"last":0.54000000000000004}]},{"osd":1,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71699999999999997,"5min":0.96899999999999997,"15min":2.4159999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.45400000000000001,"5min":0.44,"15min":0.40400000000000003},"max":{"1min":0.89100000000000001,"5min":0.95099999999999996,"15min":1.706},"last":0.77100000000000002}]},{"osd":2,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69699999999999995,"15min":0.72799999999999998},"min":{"1min":0.501,"5min":0.48499999999999999,"15min":0.42999999999999999},"max":{"1min":0.75800000000000001,"5min":0.997,"15min":1.79},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69699999999999995,"15min":0.71599999999999997},"min":{"1min":0.49199999999999999,"5min":0.46500000000000002,"15min":0.442},"max":{"1min":0.752,"5min":1.006,"15min":2.4889999999999999},"last":0.84399999999999997}]},{"osd":3,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68999999999999995,"15min":0.71699999999999997},"min":{"1min":0.46899999999999997,"5min":0.438,"15min":0.435},"max":{"1min":0.88600000000000001,"5min":1.0209999999999999,"15min":1.409},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73899999999999999,"15min":0.76900000000000002},"min":{"1min":0.56200000000000006,"5min":0.501,"15min":0.501},"max":{"1min":0.78600000000000003,"5min":0.95699999999999996,"15min":2.532},"last":0.65700000000000003}]},{"osd":4,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":1.766},"last":0.876},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.622,"15min":0.621},"min":{"1min":0.48599999999999999,"5min":0.377,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":1.052,"15min":2.7829999999999999},"last":0.67500000000000004}]},{"osd":6,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.45100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82899999999999996,"5min":1.018,"15min":2.5739999999999998},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.40000000000000002,"15min":0.38900000000000001},"max":{"1min":0.84099999999999997,"5min":0.97999999999999998,"15min":1.8080000000000001},"last":0.94299999999999995}]},{"osd":7,"last update":"Mon Oct 9 06:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.90700000000000003,"5min":1.175,"15min":2.9609999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.60499999999999998,"5min":0.498,"15min":0.45900000000000002},"max":{"1min":0.876,"5min":1.139,"15min":2.613},"last":0.92900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T06:58:53.865 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T06:58:53.866 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T06:58:54.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.085+0000 7f9434dff700 1 Processor -- start 2023-10-09T06:58:54.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.086+0000 7f9434dff700 1 -- start start 2023-10-09T06:58:54.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.087+0000 7f9434dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9430068aa0 0x7f9430158a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:54.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.087+0000 7f9434dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9430158590 con 0x7f9430157630 2023-10-09T06:58:54.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.087+0000 7f9434dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9430157f80 con 0x7f9430157a00 2023-10-09T06:58:54.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.087+0000 7f9434dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94300ac7a0 con 0x7f9430068aa0 2023-10-09T06:58:54.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.087+0000 7f942e59c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9430157630 0x7f94300abd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56916/0 (socket says 172.21.15.71:56916) 2023-10-09T06:58:54.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.087+0000 7f942e59c700 1 -- 172.21.15.71:0/2242755868 learned_addr learned my addr 172.21.15.71:0/2242755868 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:54.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.087+0000 7f942d59a700 1 -- 172.21.15.71:0/2242755868 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219703149 0 0) 0x7f9430158590 con 0x7f9430157630 2023-10-09T06:58:54.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.087+0000 7f942d59a700 1 -- 172.21.15.71:0/2242755868 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9418003570 con 0x7f9430157630 2023-10-09T06:58:54.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.087+0000 7f942ed9d700 1 --2- 172.21.15.71:0/2242755868 >> v2:172.21.15.179:3300/0 conn(0x7f9430068aa0 0x7f9430158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:54.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.088+0000 7f942d59a700 1 -- 172.21.15.71:0/2242755868 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3726822665 0 0) 0x7f9418003570 con 0x7f9430157630 2023-10-09T06:58:54.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.088+0000 7f942d59a700 1 -- 172.21.15.71:0/2242755868 >> v2:172.21.15.179:3300/0 conn(0x7f9430068aa0 msgr2=0x7f9430158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:54.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.088+0000 7f942d59a700 1 --2- 172.21.15.71:0/2242755868 >> v2:172.21.15.179:3300/0 conn(0x7f9430068aa0 0x7f9430158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:54.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.088+0000 7f942d59a700 1 -- 172.21.15.71:0/2242755868 >> v1:172.21.15.179:6789/0 conn(0x7f9430157a00 legacy=0x7f9430068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:54.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.088+0000 7f942d59a700 1 -- 172.21.15.71:0/2242755868 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9430158220 con 0x7f9430157630 2023-10-09T06:58:54.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.088+0000 7f942d59a700 1 -- 172.21.15.71:0/2242755868 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f94200017f0 con 0x7f9430157630 2023-10-09T06:58:54.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.088+0000 7f942ed9d700 1 --2- 172.21.15.71:0/2242755868 >> v2:172.21.15.179:3300/0 conn(0x7f9430068aa0 0x7f9430158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:54.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.088+0000 7f942d59a700 1 -- 172.21.15.71:0/2242755868 >> v1:172.21.15.71:6789/0 conn(0x7f9430157630 legacy=0x7f94300abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:54.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.088+0000 7f942d59a700 1 --2- 172.21.15.71:0/2242755868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9418003ab0 0x7f9418003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:54.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.088+0000 7f942d59a700 1 --2- 172.21.15.71:0/2242755868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9418004810 0x7f9418004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:54.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.088+0000 7f942d59a700 1 --2- 172.21.15.71:0/2242755868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94180052e0 0x7f941800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:54.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.088+0000 7f942d59a700 1 -- 172.21.15.71:0/2242755868 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94300ac7a0 con 0x7f94180052e0 2023-10-09T06:58:54.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.088+0000 7f942d59a700 1 -- 172.21.15.71:0/2242755868 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941800c1e0 con 0x7f9418003ab0 2023-10-09T06:58:54.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.088+0000 7f942d59a700 1 -- 172.21.15.71:0/2242755868 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941800c3a0 con 0x7f9418004810 2023-10-09T06:58:54.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.088+0000 7f942ed9d700 1 --2- 172.21.15.71:0/2242755868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94180052e0 0x7f941800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:54.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.088+0000 7f942e59c700 1 --2- 172.21.15.71:0/2242755868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9418003ab0 0x7f9418003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:54.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.088+0000 7f942dd9b700 1 --2- 172.21.15.71:0/2242755868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9418004810 0x7f9418004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:54.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.089+0000 7f942ed9d700 1 -- 172.21.15.71:0/2242755868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9418004810 msgr2=0x7f9418004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:54.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.089+0000 7f942ed9d700 1 --2- 172.21.15.71:0/2242755868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9418004810 0x7f9418004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:54.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.089+0000 7f942ed9d700 1 -- 172.21.15.71:0/2242755868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9418003ab0 msgr2=0x7f9418003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:54.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.089+0000 7f942ed9d700 1 --2- 172.21.15.71:0/2242755868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9418003ab0 0x7f9418003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:54.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.089+0000 7f942ed9d700 1 -- 172.21.15.71:0/2242755868 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9418003570 con 0x7f94180052e0 2023-10-09T06:58:54.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.089+0000 7f942ed9d700 1 -- 172.21.15.71:0/2242755868 reap_dead start 2023-10-09T06:58:54.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.089+0000 7f942ed9d700 1 --2- 172.21.15.71:0/2242755868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94180052e0 0x7f941800ba60 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f9430068ea0 tx=0x7f9428008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7d0011e92b990d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:54.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.089+0000 7f942d59a700 1 -- 172.21.15.71:0/2242755868 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9428009510 con 0x7f94180052e0 2023-10-09T06:58:54.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.089+0000 7f942d59a700 1 -- 172.21.15.71:0/2242755868 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942800e5e0 con 0x7f94180052e0 2023-10-09T06:58:54.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.089+0000 7f942d59a700 1 -- 172.21.15.71:0/2242755868 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942800e790 con 0x7f94180052e0 2023-10-09T06:58:54.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.090+0000 7f9434dff700 1 -- 172.21.15.71:0/2242755868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94180052e0 msgr2=0x7f941800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:54.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.090+0000 7f9434dff700 1 --2- 172.21.15.71:0/2242755868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94180052e0 0x7f941800ba60 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f9430068ea0 tx=0x7f9428008040 comp rx=0 tx=0).stop 2023-10-09T06:58:54.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.090+0000 7f9434dff700 1 -- 172.21.15.71:0/2242755868 shutdown_connections 2023-10-09T06:58:54.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.090+0000 7f9434dff700 1 --2- 172.21.15.71:0/2242755868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94180052e0 0x7f941800ba60 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:54.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.090+0000 7f9434dff700 1 -- 172.21.15.71:0/2242755868 >> 172.21.15.71:0/2242755868 conn(0x7f94300cc540 msgr2=0x7f94300cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:54.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.090+0000 7f9434dff700 1 -- 172.21.15.71:0/2242755868 shutdown_connections 2023-10-09T06:58:54.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.090+0000 7f9434dff700 1 -- 172.21.15.71:0/2242755868 wait complete. 2023-10-09T06:58:54.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.091+0000 7f9434dff700 1 Processor -- start 2023-10-09T06:58:54.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.091+0000 7f9434dff700 1 -- start start 2023-10-09T06:58:54.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.092+0000 7f9434dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94180052e0 0x7f943015a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:54.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.092+0000 7f9434dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f943016ac40 0x7f94300c2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:54.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.092+0000 7f9434dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94300b02c0 0x7f94300b0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:54.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.092+0000 7f9434dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943015b010 con 0x7f943016ac40 2023-10-09T06:58:54.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.092+0000 7f9434dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94300c3a20 con 0x7f94180052e0 2023-10-09T06:58:54.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.092+0000 7f9434dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94300b0c50 con 0x7f94300b02c0 2023-10-09T06:58:54.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.092+0000 7f942dd9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f943016ac40 0x7f94300c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:54.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.092+0000 7f942dd9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f943016ac40 0x7f94300c2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36796/0 (socket says 172.21.15.71:36796) 2023-10-09T06:58:54.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.092+0000 7f942dd9b700 1 -- 172.21.15.71:0/1956060350 learned_addr learned my addr 172.21.15.71:0/1956060350 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:54.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.093+0000 7f942e59c700 1 --2- 172.21.15.71:0/1956060350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94180052e0 0x7f943015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:54.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.093+0000 7f942ed9d700 1 --2- 172.21.15.71:0/1956060350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94300b02c0 0x7f94300b0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:54.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.093+0000 7f942dd9b700 1 -- 172.21.15.71:0/1956060350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94300b02c0 msgr2=0x7f94300b0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:54.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.093+0000 7f942dd9b700 1 --2- 172.21.15.71:0/1956060350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94300b02c0 0x7f94300b0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:54.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.093+0000 7f942dd9b700 1 -- 172.21.15.71:0/1956060350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94180052e0 msgr2=0x7f943015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:54.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.093+0000 7f942dd9b700 1 --2- 172.21.15.71:0/1956060350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94180052e0 0x7f943015a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:54.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.093+0000 7f942dd9b700 1 -- 172.21.15.71:0/1956060350 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94300c36d0 con 0x7f943016ac40 2023-10-09T06:58:54.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.093+0000 7f942dd9b700 1 --2- 172.21.15.71:0/1956060350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f943016ac40 0x7f94300c2710 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f9424002980 tx=0x7f9424007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:54.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.093+0000 7f941e7fc700 1 -- 172.21.15.71:0/1956060350 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94240033c0 con 0x7f943016ac40 2023-10-09T06:58:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.093+0000 7f941e7fc700 1 -- 172.21.15.71:0/1956060350 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942400f870 con 0x7f943016ac40 2023-10-09T06:58:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.093+0000 7f9434dff700 1 -- 172.21.15.71:0/1956060350 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943015aa50 con 0x7f943016ac40 2023-10-09T06:58:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.093+0000 7f941e7fc700 1 -- 172.21.15.71:0/1956060350 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942400fc10 con 0x7f943016ac40 2023-10-09T06:58:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.093+0000 7f9434dff700 1 -- 172.21.15.71:0/1956060350 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943016b090 con 0x7f943016ac40 2023-10-09T06:58:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.094+0000 7f9434dff700 1 -- 172.21.15.71:0/1956060350 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94300c3bb0 con 0x7f943016ac40 2023-10-09T06:58:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.095+0000 7f941e7fc700 1 -- 172.21.15.71:0/1956060350 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9424006820 con 0x7f943016ac40 2023-10-09T06:58:54.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.096+0000 7f941e7fc700 1 --2- 172.21.15.71:0/1956060350 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9410066f60 0x7f9410069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:54.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.096+0000 7f941e7fc700 1 -- 172.21.15.71:0/1956060350 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f9424084740 con 0x7f943016ac40 2023-10-09T06:58:54.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.097+0000 7f942e59c700 1 --2- 172.21.15.71:0/1956060350 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9410066f60 0x7f9410069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:54.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.097+0000 7f942e59c700 1 --2- 172.21.15.71:0/1956060350 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9410066f60 0x7f9410069410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f94300cd270 tx=0x7f9420006040 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:54.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.100+0000 7f941e7fc700 1 -- 172.21.15.71:0/1956060350 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9424051820 con 0x7f943016ac40 2023-10-09T06:58:54.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.367+0000 7f9434dff700 1 -- 172.21.15.71:0/1956060350 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f94300718b0 con 0x7f943016ac40 2023-10-09T06:58:54.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.372+0000 7f941e7fc700 1 -- 172.21.15.71:0/1956060350 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9424054e40 con 0x7f943016ac40 2023-10-09T06:58:54.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.374+0000 7f9434dff700 1 -- 172.21.15.71:0/1956060350 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9410066f60 msgr2=0x7f9410069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:54.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.374+0000 7f9434dff700 1 --2- 172.21.15.71:0/1956060350 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9410066f60 0x7f9410069410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f94300cd270 tx=0x7f9420006040 comp rx=0 tx=0).stop 2023-10-09T06:58:54.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.374+0000 7f9434dff700 1 -- 172.21.15.71:0/1956060350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f943016ac40 msgr2=0x7f94300c2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:54.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.374+0000 7f9434dff700 1 --2- 172.21.15.71:0/1956060350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f943016ac40 0x7f94300c2710 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f9424002980 tx=0x7f9424007d30 comp rx=0 tx=0).stop 2023-10-09T06:58:54.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.374+0000 7f9434dff700 1 -- 172.21.15.71:0/1956060350 shutdown_connections 2023-10-09T06:58:54.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.374+0000 7f9434dff700 1 --2- 172.21.15.71:0/1956060350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94300b02c0 0x7f94300b0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:54.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.374+0000 7f9434dff700 1 --2- 172.21.15.71:0/1956060350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94180052e0 0x7f943015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:54.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.374+0000 7f9434dff700 1 --2- 172.21.15.71:0/1956060350 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9410066f60 0x7f9410069410 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:54.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.374+0000 7f9434dff700 1 --2- 172.21.15.71:0/1956060350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f943016ac40 0x7f94300c2710 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:54.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.374+0000 7f9434dff700 1 -- 172.21.15.71:0/1956060350 >> 172.21.15.71:0/1956060350 conn(0x7f94300cc540 msgr2=0x7f943006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:54.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.374+0000 7f9434dff700 1 -- 172.21.15.71:0/1956060350 shutdown_connections 2023-10-09T06:58:54.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.374+0000 7f9434dff700 1 -- 172.21.15.71:0/1956060350 wait complete. 2023-10-09T06:58:54.378 INFO:teuthology.orchestra.run.smithi071.stderr:updated caps for client.0 2023-10-09T06:58:54.394 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T06:58:54.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.580+0000 7f8c6b59e700 1 Processor -- start 2023-10-09T06:58:54.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.581+0000 7f8c6b59e700 1 -- start start 2023-10-09T06:58:54.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.582+0000 7f8c6b59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8c6c159510 0x7f8c6c0ca660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:54.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.582+0000 7f8c6b59e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6c0a9c20 con 0x7f8c6c06a3f0 2023-10-09T06:58:54.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.582+0000 7f8c6b59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6c159d30 con 0x7f8c6c1598e0 2023-10-09T06:58:54.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.582+0000 7f8c6b59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c15e400 con 0x7f8c6c159510 2023-10-09T06:58:54.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.582+0000 7f8c6ad9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8c6c06a3f0 0x7f8c6c06a7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56924/0 (socket says 172.21.15.71:56924) 2023-10-09T06:58:54.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.582+0000 7f8c6ad9d700 1 -- 172.21.15.71:0/3999819818 learned_addr learned my addr 172.21.15.71:0/3999819818 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:54.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.582+0000 7f8c6a59c700 1 --2- 172.21.15.71:0/3999819818 >> v2:172.21.15.179:3300/0 conn(0x7f8c6c159510 0x7f8c6c0ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:54.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.582+0000 7f8c69d9b700 1 -- 172.21.15.71:0/3999819818 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176710222 0 0) 0x7f8c6c0a9c20 con 0x7f8c6c06a3f0 2023-10-09T06:58:54.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.583+0000 7f8c69d9b700 1 -- 172.21.15.71:0/3999819818 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c58003570 con 0x7f8c6c06a3f0 2023-10-09T06:58:54.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.583+0000 7f8c69d9b700 1 -- 172.21.15.71:0/3999819818 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 240385960 0 0) 0x7f8c54001110 con 0x7f8c6c1598e0 2023-10-09T06:58:54.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.583+0000 7f8c69d9b700 1 -- 172.21.15.71:0/3999819818 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c6c0a9c20 con 0x7f8c6c1598e0 2023-10-09T06:58:54.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.583+0000 7f8c6a59c700 1 -- 172.21.15.71:0/3999819818 >> v1:172.21.15.179:6789/0 conn(0x7f8c6c1598e0 legacy=0x7f8c6c06d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:54.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.583+0000 7f8c6a59c700 1 -- 172.21.15.71:0/3999819818 >> v1:172.21.15.71:6789/0 conn(0x7f8c6c06a3f0 legacy=0x7f8c6c06a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:54.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.583+0000 7f8c6a59c700 1 -- 172.21.15.71:0/3999819818 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c0696c0 con 0x7f8c6c159510 2023-10-09T06:58:54.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.583+0000 7f8c6a59c700 1 --2- 172.21.15.71:0/3999819818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c6c159510 0x7f8c6c0ca660 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c0098e0 tx=0x7f8c5c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e1e0e42f5fdbf18 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:54.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.583+0000 7f8c69d9b700 1 -- 172.21.15.71:0/3999819818 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c011630 con 0x7f8c6c159510 2023-10-09T06:58:54.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.584+0000 7f8c69d9b700 1 -- 172.21.15.71:0/3999819818 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5c011790 con 0x7f8c6c159510 2023-10-09T06:58:54.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.584+0000 7f8c69d9b700 1 -- 172.21.15.71:0/3999819818 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c011b10 con 0x7f8c6c159510 2023-10-09T06:58:54.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.584+0000 7f8c6b59e700 1 -- 172.21.15.71:0/3999819818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c6c159510 msgr2=0x7f8c6c0ca660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:54.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.584+0000 7f8c6b59e700 1 --2- 172.21.15.71:0/3999819818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c6c159510 0x7f8c6c0ca660 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c0098e0 tx=0x7f8c5c0091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:54.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.584+0000 7f8c6b59e700 1 -- 172.21.15.71:0/3999819818 shutdown_connections 2023-10-09T06:58:54.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.584+0000 7f8c6b59e700 1 --2- 172.21.15.71:0/3999819818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c6c159510 0x7f8c6c0ca660 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:54.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.584+0000 7f8c6b59e700 1 -- 172.21.15.71:0/3999819818 >> 172.21.15.71:0/3999819818 conn(0x7f8c6c0cc1f0 msgr2=0x7f8c6c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:54.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.584+0000 7f8c6b59e700 1 -- 172.21.15.71:0/3999819818 shutdown_connections 2023-10-09T06:58:54.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.584+0000 7f8c6b59e700 1 -- 172.21.15.71:0/3999819818 wait complete. 2023-10-09T06:58:54.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.586+0000 7f8c6b59e700 1 Processor -- start 2023-10-09T06:58:54.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.586+0000 7f8c6b59e700 1 -- start start 2023-10-09T06:58:54.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.587+0000 7f8c6b59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c6c06a3f0 0x7f8c6c0afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:54.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.587+0000 7f8c6b59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c6c159510 0x7f8c6c0b1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:54.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.587+0000 7f8c6b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c6c1598e0 0x7f8c6c16d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:54.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.587+0000 7f8c6b59e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0af680 con 0x7f8c6c159510 2023-10-09T06:58:54.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.587+0000 7f8c6b59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c15a170 con 0x7f8c6c06a3f0 2023-10-09T06:58:54.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.587+0000 7f8c6b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c16e310 con 0x7f8c6c1598e0 2023-10-09T06:58:54.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.587+0000 7f8c63fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c6c159510 0x7f8c6c0b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:54.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.587+0000 7f8c63fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c6c159510 0x7f8c6c0b1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36802/0 (socket says 172.21.15.71:36802) 2023-10-09T06:58:54.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.587+0000 7f8c63fff700 1 -- 172.21.15.71:0/2078526523 learned_addr learned my addr 172.21.15.71:0/2078526523 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:54.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.587+0000 7f8c6a59c700 1 --2- 172.21.15.71:0/2078526523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c6c06a3f0 0x7f8c6c0afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:54.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.587+0000 7f8c6ad9d700 1 --2- 172.21.15.71:0/2078526523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c6c1598e0 0x7f8c6c16d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:54.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.587+0000 7f8c63fff700 1 -- 172.21.15.71:0/2078526523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c6c1598e0 msgr2=0x7f8c6c16d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:54.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.587+0000 7f8c63fff700 1 --2- 172.21.15.71:0/2078526523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c6c1598e0 0x7f8c6c16d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:54.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.587+0000 7f8c63fff700 1 -- 172.21.15.71:0/2078526523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c6c06a3f0 msgr2=0x7f8c6c0afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:54.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.587+0000 7f8c63fff700 1 --2- 172.21.15.71:0/2078526523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c6c06a3f0 0x7f8c6c0afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:54.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.587+0000 7f8c63fff700 1 -- 172.21.15.71:0/2078526523 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c009420 con 0x7f8c6c159510 2023-10-09T06:58:54.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.587+0000 7f8c6a59c700 1 --2- 172.21.15.71:0/2078526523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c6c06a3f0 0x7f8c6c0afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:54.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.587+0000 7f8c6ad9d700 1 --2- 172.21.15.71:0/2078526523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c6c1598e0 0x7f8c6c16d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:54.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.587+0000 7f8c63fff700 1 --2- 172.21.15.71:0/2078526523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c6c159510 0x7f8c6c0b1850 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400c710 tx=0x7f8c54007c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:54.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.588+0000 7f8c627fc700 1 -- 172.21.15.71:0/2078526523 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c54011590 con 0x7f8c6c159510 2023-10-09T06:58:54.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.588+0000 7f8c627fc700 1 -- 172.21.15.71:0/2078526523 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c54011710 con 0x7f8c6c159510 2023-10-09T06:58:54.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.588+0000 7f8c6b59e700 1 -- 172.21.15.71:0/2078526523 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6c0af030 con 0x7f8c6c159510 2023-10-09T06:58:54.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.588+0000 7f8c627fc700 1 -- 172.21.15.71:0/2078526523 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c54011ad0 con 0x7f8c6c159510 2023-10-09T06:58:54.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.588+0000 7f8c6b59e700 1 -- 172.21.15.71:0/2078526523 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6c0b1d90 con 0x7f8c6c159510 2023-10-09T06:58:54.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.589+0000 7f8c6b59e700 1 -- 172.21.15.71:0/2078526523 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6c0af830 con 0x7f8c6c159510 2023-10-09T06:58:54.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.590+0000 7f8c627fc700 1 -- 172.21.15.71:0/2078526523 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c5401c460 con 0x7f8c6c159510 2023-10-09T06:58:54.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.590+0000 7f8c627fc700 1 --2- 172.21.15.71:0/2078526523 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8c4c066f30 0x7f8c4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:54.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.591+0000 7f8c627fc700 1 -- 172.21.15.71:0/2078526523 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f8c54084300 con 0x7f8c6c159510 2023-10-09T06:58:54.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.591+0000 7f8c6a59c700 1 --2- 172.21.15.71:0/2078526523 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8c4c066f30 0x7f8c4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:54.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.592+0000 7f8c6a59c700 1 --2- 172.21.15.71:0/2078526523 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8c4c066f30 0x7f8c4c0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c0093f0 tx=0x7f8c5c017000 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:54.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.594+0000 7f8c627fc700 1 -- 172.21.15.71:0/2078526523 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c6c0af830 con 0x7f8c6c159510 2023-10-09T06:58:54.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.829+0000 7f8c6b59e700 1 -- 172.21.15.71:0/2078526523 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c6c159d30 con 0x7f8c6c159510 2023-10-09T06:58:54.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.829+0000 7f8c627fc700 1 -- 172.21.15.71:0/2078526523 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f8c6c159d30 con 0x7f8c6c159510 2023-10-09T06:58:54.831 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:58:54.831 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/2945926197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2945926197},{"type":"v1","addr":"172.21.15.71:6834","nonce":2945926197}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1112255645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1112255645},{"type":"v1","addr":"172.21.15.179:6836","nonce":1112255645}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3298180688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":3298180688},{"type":"v1","addr":"172.21.15.71:6835","nonce":3298180688}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:58:43.707312+0000","modified":"2023-10-09T06:58:47.272802+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7152},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7152":{"gid":7152,"name":"d","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/4053543999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":4053543999},{"type":"v1","addr":"172.21.15.179:6837","nonce":4053543999}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T06:58:54.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.832+0000 7f8c6b59e700 1 -- 172.21.15.71:0/2078526523 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8c4c066f30 msgr2=0x7f8c4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:54.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.832+0000 7f8c6b59e700 1 --2- 172.21.15.71:0/2078526523 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8c4c066f30 0x7f8c4c0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c0093f0 tx=0x7f8c5c017000 comp rx=0 tx=0).stop 2023-10-09T06:58:54.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.832+0000 7f8c6b59e700 1 -- 172.21.15.71:0/2078526523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c6c159510 msgr2=0x7f8c6c0b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:54.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.832+0000 7f8c6b59e700 1 --2- 172.21.15.71:0/2078526523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c6c159510 0x7f8c6c0b1850 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400c710 tx=0x7f8c54007c40 comp rx=0 tx=0).stop 2023-10-09T06:58:54.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.832+0000 7f8c6b59e700 1 -- 172.21.15.71:0/2078526523 shutdown_connections 2023-10-09T06:58:54.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.832+0000 7f8c6b59e700 1 --2- 172.21.15.71:0/2078526523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c6c1598e0 0x7f8c6c16d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:54.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.832+0000 7f8c6b59e700 1 --2- 172.21.15.71:0/2078526523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c6c06a3f0 0x7f8c6c0afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:54.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.832+0000 7f8c6b59e700 1 --2- 172.21.15.71:0/2078526523 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8c4c066f30 0x7f8c4c0693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:54.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.832+0000 7f8c6b59e700 1 --2- 172.21.15.71:0/2078526523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c6c159510 0x7f8c6c0b1850 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:54.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.832+0000 7f8c6b59e700 1 -- 172.21.15.71:0/2078526523 >> 172.21.15.71:0/2078526523 conn(0x7f8c6c0cc1f0 msgr2=0x7f8c6c06d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:54.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.832+0000 7f8c6b59e700 1 -- 172.21.15.71:0/2078526523 shutdown_connections 2023-10-09T06:58:54.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:54.832+0000 7f8c6b59e700 1 -- 172.21.15.71:0/2078526523 wait complete. 2023-10-09T06:58:54.835 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 49 2023-10-09T06:58:55.254 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T06:58:43.707312+0000', 'modified': '2023-10-09T06:58:47.272802+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7152}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7152': {'gid': 7152, 'name': 'd', 'rank': 0, 'incarnation': 45, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6837/4053543999', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6835', 'nonce': 4053543999}, {'type': 'v1', 'addr': '172.21.15.179:6837', 'nonce': 4053543999}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T06:58:55.254 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T06:58:55.254 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-09T06:58:55.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.437+0000 7fc8f3fff700 1 Processor -- start 2023-10-09T06:58:55.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.438+0000 7fc8f3fff700 1 -- start start 2023-10-09T06:58:55.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.439+0000 7fc8f3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f4150180 0x7fc8f4157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.439+0000 7fc8f3fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc8f4150550 0x7fc8f40c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.439+0000 7fc8f3fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f406e2a0 con 0x7fc8f40c7240 2023-10-09T06:58:55.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.439+0000 7fc8f3fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f40c76e0 con 0x7fc8f4150550 2023-10-09T06:58:55.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.439+0000 7fc8f3fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f406b2e0 con 0x7fc8f4150180 2023-10-09T06:58:55.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.439+0000 7fc8f27fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc8f4150550 0x7fc8f40c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.439+0000 7fc8f27fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc8f4150550 0x7fc8f40c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47804/0 (socket says 172.21.15.71:47804) 2023-10-09T06:58:55.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.439+0000 7fc8f27fc700 1 -- 172.21.15.71:0/910220002 learned_addr learned my addr 172.21.15.71:0/910220002 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:55.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.440+0000 7fc8f2ffd700 1 --2- 172.21.15.71:0/910220002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f4150180 0x7fc8f4157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.440+0000 7fc8f27fc700 1 -- 172.21.15.71:0/910220002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f4150180 msgr2=0x7fc8f4157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:55.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.440+0000 7fc8f27fc700 1 --2- 172.21.15.71:0/910220002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f4150180 0x7fc8f4157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.440+0000 7fc8f27fc700 1 -- 172.21.15.71:0/910220002 >> v1:172.21.15.179:6789/0 conn(0x7fc8f40c7240 legacy=0x7fc8f4069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:55.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.440+0000 7fc8f27fc700 1 -- 172.21.15.71:0/910220002 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f40c78e0 con 0x7fc8f4150550 2023-10-09T06:58:55.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.440+0000 7fc8f27fc700 1 --2- 172.21.15.71:0/910220002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8f4150550 0x7fc8f40c6d00 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800ab50 tx=0x7fc8e800a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fe49d49d4b773f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:55.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.440+0000 7fc8f1ffb700 1 -- 172.21.15.71:0/910220002 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e800ca60 con 0x7fc8f4150550 2023-10-09T06:58:55.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.440+0000 7fc8f1ffb700 1 -- 172.21.15.71:0/910220002 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e800cbc0 con 0x7fc8f4150550 2023-10-09T06:58:55.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.440+0000 7fc8f1ffb700 1 -- 172.21.15.71:0/910220002 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8018400 con 0x7fc8f4150550 2023-10-09T06:58:55.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.441+0000 7fc8f3fff700 1 -- 172.21.15.71:0/910220002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8f4150550 msgr2=0x7fc8f40c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:55.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.441+0000 7fc8f3fff700 1 --2- 172.21.15.71:0/910220002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8f4150550 0x7fc8f40c6d00 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800ab50 tx=0x7fc8e800a3f0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.441+0000 7fc8f3fff700 1 -- 172.21.15.71:0/910220002 shutdown_connections 2023-10-09T06:58:55.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.441+0000 7fc8f3fff700 1 --2- 172.21.15.71:0/910220002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f4150180 0x7fc8f4157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.441+0000 7fc8f3fff700 1 --2- 172.21.15.71:0/910220002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8f4150550 0x7fc8f40c6d00 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.441+0000 7fc8f3fff700 1 -- 172.21.15.71:0/910220002 >> 172.21.15.71:0/910220002 conn(0x7fc8f40cc1f0 msgr2=0x7fc8f40cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:55.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.441+0000 7fc8f3fff700 1 -- 172.21.15.71:0/910220002 shutdown_connections 2023-10-09T06:58:55.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.441+0000 7fc8f3fff700 1 -- 172.21.15.71:0/910220002 wait complete. 2023-10-09T06:58:55.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.442+0000 7fc8f3fff700 1 Processor -- start 2023-10-09T06:58:55.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.442+0000 7fc8f3fff700 1 -- start start 2023-10-09T06:58:55.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.443+0000 7fc8f3fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f40c7240 0x7fc8f40aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.443+0000 7fc8f3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f4150180 0x7fc8f4146e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.443+0000 7fc8f3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8f4150550 0x7fc8f415e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.443+0000 7fc8f3fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f41473a0 con 0x7fc8f4150550 2023-10-09T06:58:55.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.443+0000 7fc8f3fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f40cbcc0 con 0x7fc8f40c7240 2023-10-09T06:58:55.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.443+0000 7fc8f3fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f40c48c0 con 0x7fc8f4150180 2023-10-09T06:58:55.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.444+0000 7fc8f37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8f4150550 0x7fc8f415e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.444+0000 7fc8f37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8f4150550 0x7fc8f415e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47806/0 (socket says 172.21.15.71:47806) 2023-10-09T06:58:55.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.444+0000 7fc8f37fe700 1 -- 172.21.15.71:0/3367072353 learned_addr learned my addr 172.21.15.71:0/3367072353 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:55.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.444+0000 7fc8f37fe700 1 -- 172.21.15.71:0/3367072353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f4150180 msgr2=0x7fc8f4146e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:55.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.444+0000 7fc8f27fc700 1 --2- 172.21.15.71:0/3367072353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f4150180 0x7fc8f4146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.444+0000 7fc8f2ffd700 1 --2- 172.21.15.71:0/3367072353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f40c7240 0x7fc8f40aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.444+0000 7fc8f37fe700 1 --2- 172.21.15.71:0/3367072353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f4150180 0x7fc8f4146e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.444+0000 7fc8f37fe700 1 -- 172.21.15.71:0/3367072353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f40c7240 msgr2=0x7fc8f40aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:55.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.444+0000 7fc8f37fe700 1 --2- 172.21.15.71:0/3367072353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f40c7240 0x7fc8f40aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.444+0000 7fc8f37fe700 1 -- 172.21.15.71:0/3367072353 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e800a690 con 0x7fc8f4150550 2023-10-09T06:58:55.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.444+0000 7fc8f2ffd700 1 --2- 172.21.15.71:0/3367072353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f40c7240 0x7fc8f40aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:55.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.444+0000 7fc8f37fe700 1 --2- 172.21.15.71:0/3367072353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8f4150550 0x7fc8f415e400 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00c910 tx=0x7fc8ec001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:55.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.444+0000 7fc8daffd700 1 -- 172.21.15.71:0/3367072353 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec00a7a0 con 0x7fc8f4150550 2023-10-09T06:58:55.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.445+0000 7fc8daffd700 1 -- 172.21.15.71:0/3367072353 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ec00a900 con 0x7fc8f4150550 2023-10-09T06:58:55.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.445+0000 7fc8daffd700 1 -- 172.21.15.71:0/3367072353 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec00acc0 con 0x7fc8f4150550 2023-10-09T06:58:55.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.445+0000 7fc8f3fff700 1 -- 172.21.15.71:0/3367072353 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f40af650 con 0x7fc8f4150550 2023-10-09T06:58:55.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.445+0000 7fc8f3fff700 1 -- 172.21.15.71:0/3367072353 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f40afc10 con 0x7fc8f4150550 2023-10-09T06:58:55.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.447+0000 7fc8daffd700 1 -- 172.21.15.71:0/3367072353 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc8ec012630 con 0x7fc8f4150550 2023-10-09T06:58:55.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.448+0000 7fc8daffd700 1 --2- 172.21.15.71:0/3367072353 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc8e0066f30 0x7fc8e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.448+0000 7fc8daffd700 1 -- 172.21.15.71:0/3367072353 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fc8ec084990 con 0x7fc8f4150550 2023-10-09T06:58:55.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.448+0000 7fc8f2ffd700 1 --2- 172.21.15.71:0/3367072353 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc8e0066f30 0x7fc8e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.449+0000 7fc8f2ffd700 1 --2- 172.21.15.71:0/3367072353 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc8e0066f30 0x7fc8e00693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4006fd0 tx=0x7fc8e4008040 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:55.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.449+0000 7fc9080a7b80 1 Processor -- start 2023-10-09T06:58:55.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.449+0000 7fc9080a7b80 1 -- start start 2023-10-09T06:58:55.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.450+0000 7fc9080a7b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de57480 0x55d40de367d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.450+0000 7fc9080a7b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d40de0a5f0 0x55d40de57850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.450+0000 7fc9080a7b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d40de0cb80 0x55d40de0cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.450+0000 7fc9080a7b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d40dd63a70 con 0x55d40de57480 2023-10-09T06:58:55.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.450+0000 7fc9080a7b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d40dd61270 con 0x55d40de0a5f0 2023-10-09T06:58:55.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.450+0000 7fc9080a7b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d40dd5d060 con 0x55d40de0cb80 2023-10-09T06:58:55.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.450+0000 7fc8f2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de57480 0x55d40de367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.451+0000 7fc8f2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de57480 0x55d40de367d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47816/0 (socket says 172.21.15.71:47816) 2023-10-09T06:58:55.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.451+0000 7fc8f2ffd700 1 -- 172.21.15.71:0/743509522 learned_addr learned my addr 172.21.15.71:0/743509522 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:55.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.451+0000 7fc8f27fc700 1 --2- 172.21.15.71:0/743509522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d40de0a5f0 0x55d40de57850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.451+0000 7fc8f37fe700 1 --2- 172.21.15.71:0/743509522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d40de0cb80 0x55d40de0cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.451+0000 7fc8f2ffd700 1 -- 172.21.15.71:0/743509522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d40de0cb80 msgr2=0x55d40de0cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:55.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.451+0000 7fc8f2ffd700 1 --2- 172.21.15.71:0/743509522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d40de0cb80 0x55d40de0cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.451+0000 7fc8f2ffd700 1 -- 172.21.15.71:0/743509522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d40de0a5f0 msgr2=0x55d40de57850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:55.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.451+0000 7fc8f2ffd700 1 --2- 172.21.15.71:0/743509522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d40de0a5f0 0x55d40de57850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.451+0000 7fc8f2ffd700 1 -- 172.21.15.71:0/743509522 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d40dbf7270 con 0x55d40de57480 2023-10-09T06:58:55.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.451+0000 7fc8f27fc700 1 --2- 172.21.15.71:0/743509522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d40de0a5f0 0x55d40de57850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:55.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.451+0000 7fc8f37fe700 1 --2- 172.21.15.71:0/743509522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d40de0cb80 0x55d40de0cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T06:58:55.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.451+0000 7fc8f2ffd700 1 --2- 172.21.15.71:0/743509522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de57480 0x55d40de367d0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400ea70 tx=0x7fc8e4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843e749eafbd2482 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:55.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.451+0000 7fc8d3fff700 1 -- 172.21.15.71:0/743509522 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e401d070 con 0x55d40de57480 2023-10-09T06:58:55.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.451+0000 7fc8d3fff700 1 -- 172.21.15.71:0/743509522 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e40180d0 con 0x55d40de57480 2023-10-09T06:58:55.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.451+0000 7fc8d3fff700 1 -- 172.21.15.71:0/743509522 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e400eee0 con 0x55d40de57480 2023-10-09T06:58:55.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.452+0000 7fc9080a7b80 1 -- 172.21.15.71:0/743509522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de57480 msgr2=0x55d40de367d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:55.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.452+0000 7fc9080a7b80 1 --2- 172.21.15.71:0/743509522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de57480 0x55d40de367d0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400ea70 tx=0x7fc8e4013000 comp rx=0 tx=0).stop 2023-10-09T06:58:55.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.452+0000 7fc9080a7b80 1 -- 172.21.15.71:0/743509522 shutdown_connections 2023-10-09T06:58:55.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.452+0000 7fc9080a7b80 1 --2- 172.21.15.71:0/743509522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d40de0cb80 0x55d40de0cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.452+0000 7fc9080a7b80 1 --2- 172.21.15.71:0/743509522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de57480 0x55d40de367d0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.452+0000 7fc9080a7b80 1 --2- 172.21.15.71:0/743509522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d40de0a5f0 0x55d40de57850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.452+0000 7fc9080a7b80 1 -- 172.21.15.71:0/743509522 >> 172.21.15.71:0/743509522 conn(0x55d40de0e0c0 msgr2=0x55d40de0e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:55.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.452+0000 7fc9080a7b80 1 -- 172.21.15.71:0/743509522 shutdown_connections 2023-10-09T06:58:55.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.452+0000 7fc9080a7b80 1 -- 172.21.15.71:0/743509522 wait complete. 2023-10-09T06:58:55.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.453+0000 7fc9080a7b80 1 -- start start 2023-10-09T06:58:55.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.453+0000 7fc9080a7b80 1 Processor -- start 2023-10-09T06:58:55.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.454+0000 7fc9080a7b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d40de0a5f0 0x55d40de397e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.454+0000 7fc9080a7b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de0cb80 0x55d40de38500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.454+0000 7fc9080a7b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d40de57480 0x55d40de639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.454+0000 7fc9080a7b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d40dd08890 con 0x55d40de0cb80 2023-10-09T06:58:55.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.454+0000 7fc9080a7b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d40dd23ea0 con 0x55d40de57480 2023-10-09T06:58:55.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.454+0000 7fc9080a7b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d40dbdfe30 con 0x55d40de0a5f0 2023-10-09T06:58:55.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.454+0000 7fc9080a7b80 10 client.0 _ll_register_callbacks cb 0x55d40ddd02c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:58:55.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.454+0000 7fc8f27fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de0cb80 0x55d40de38500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.455+0000 7fc8f27fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de0cb80 0x55d40de38500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47828/0 (socket says 172.21.15.71:47828) 2023-10-09T06:58:55.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.455+0000 7fc8f27fc700 1 -- 172.21.15.71:0/213907350 learned_addr learned my addr 172.21.15.71:0/213907350 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:55.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.455+0000 7fc8f2ffd700 1 --2- 172.21.15.71:0/213907350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d40de0a5f0 0x55d40de397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.455+0000 7fc8f37fe700 1 --2- 172.21.15.71:0/213907350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d40de57480 0x55d40de639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.455+0000 7fc8f27fc700 1 -- 172.21.15.71:0/213907350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d40de0a5f0 msgr2=0x55d40de397e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:55.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.455+0000 7fc8f27fc700 1 --2- 172.21.15.71:0/213907350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d40de0a5f0 0x55d40de397e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.455+0000 7fc8f27fc700 1 -- 172.21.15.71:0/213907350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d40de57480 msgr2=0x55d40de639e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:55.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.455+0000 7fc8f27fc700 1 --2- 172.21.15.71:0/213907350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d40de57480 0x55d40de639e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.455+0000 7fc8f27fc700 1 -- 172.21.15.71:0/213907350 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e400e6f0 con 0x55d40de0cb80 2023-10-09T06:58:55.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.455+0000 7fc8f27fc700 1 --2- 172.21.15.71:0/213907350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de0cb80 0x55d40de38500 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fc8f406fe40 tx=0x7fc8e801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae7bc533c5d4304 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:55.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.455+0000 7fc8d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T06:58:55.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.455+0000 7fc8d17fa700 1 -- 172.21.15.71:0/213907350 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e801c050 con 0x55d40de0cb80 2023-10-09T06:58:55.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.455+0000 7fc8d17fa700 1 -- 172.21.15.71:0/213907350 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fc8e8018a80 con 0x55d40de0cb80 2023-10-09T06:58:55.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.455+0000 7fc9080a7b80 1 -- 172.21.15.71:0/213907350 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d40de01cd0 con 0x55d40de0cb80 2023-10-09T06:58:55.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.456+0000 7fc8d17fa700 1 -- 172.21.15.71:0/213907350 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8e8018e50 con 0x55d40de0cb80 2023-10-09T06:58:55.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.456+0000 7fc9080a7b80 10 client.7311 fetch_fsmap learned FSMap version 49 2023-10-09T06:58:55.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.456+0000 7fc9080a7b80 1 -- 172.21.15.71:0/213907350 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x55d40db99fe0 con 0x55d40de0cb80 2023-10-09T06:58:55.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.456+0000 7fc8d17fa700 1 -- 172.21.15.71:0/213907350 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e802f020 con 0x55d40de0cb80 2023-10-09T06:58:55.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.456+0000 7fc8d17fa700 1 -- 172.21.15.71:0/213907350 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 49) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc8e8016020 con 0x55d40de0cb80 2023-10-09T06:58:55.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.456+0000 7fc9080a7b80 10 client.7311 fetch_fsmap finished waiting for FSMap version 49 2023-10-09T06:58:55.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.456+0000 7fc9080a7b80 10 client.7311 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T06:58:55.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.456+0000 7fc9080a7b80 20 client.7311 populate_metadata read hostname 'smithi071' 2023-10-09T06:58:55.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.456+0000 7fc9080a7b80 1 --2- 172.21.15.71:0/213907350 >> [v2:172.21.15.179:6835/4053543999,v1:172.21.15.179:6837/4053543999] conn(0x55d40de561f0 0x55d40de565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.456+0000 7fc9080a7b80 4 client.7311 mds_command: new command op to 7152 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T06:58:55.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.456+0000 7fc9080a7b80 1 -- 172.21.15.71:0/213907350 --> [v2:172.21.15.179:6835/4053543999,v1:172.21.15.179:6837/4053543999] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d40dddeaa0 con 0x55d40de561f0 2023-10-09T06:58:55.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.456+0000 7fc8f2ffd700 1 --2- 172.21.15.71:0/213907350 >> [v2:172.21.15.179:6835/4053543999,v1:172.21.15.179:6837/4053543999] conn(0x55d40de561f0 0x55d40de565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.457+0000 7fc8f2ffd700 1 --2- 172.21.15.71:0/213907350 >> [v2:172.21.15.179:6835/4053543999,v1:172.21.15.179:6837/4053543999] conn(0x55d40de561f0 0x55d40de565c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=530850a841aee5fa server_cookie=fa172dd6a72c17d1 in_seq=0 out_seq=0 2023-10-09T06:58:55.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.457+0000 7fc8d17fa700 10 client.7311 ms_handle_connect on v2:172.21.15.179:6835/4053543999 2023-10-09T06:58:55.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.458+0000 7fc8d17fa700 1 -- 172.21.15.71:0/213907350 <== mds.0 v2:172.21.15.179:6835/4053543999 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55d40dddeaa0 con 0x55d40de561f0 2023-10-09T06:58:55.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.458+0000 7fc8d17fa700 10 client.7311 handle_command_reply: tid=0 2023-10-09T06:58:55.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.458+0000 7fc9080a7b80 1 client.7311 shutdown 2023-10-09T06:58:55.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.458+0000 7fc9080a7b80 1 -- 172.21.15.71:0/213907350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de0cb80 msgr2=0x55d40de38500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:55.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.458+0000 7fc9080a7b80 1 --2- 172.21.15.71:0/213907350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de0cb80 0x55d40de38500 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fc8f406fe40 tx=0x7fc8e801a000 comp rx=0 tx=0).stop 2023-10-09T06:58:55.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.458+0000 7fc9080a7b80 1 -- 172.21.15.71:0/213907350 shutdown_connections 2023-10-09T06:58:55.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.458+0000 7fc9080a7b80 1 --2- 172.21.15.71:0/213907350 >> [v2:172.21.15.179:6835/4053543999,v1:172.21.15.179:6837/4053543999] conn(0x55d40de561f0 0x55d40de565c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.458+0000 7fc8d17fa700 0 client.7311 ms_handle_reset on v2:172.21.15.179:6835/4053543999 2023-10-09T06:58:55.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.458+0000 7fc9080a7b80 1 --2- 172.21.15.71:0/213907350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d40de57480 0x55d40de639e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.458+0000 7fc9080a7b80 1 --2- 172.21.15.71:0/213907350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d40de0a5f0 0x55d40de397e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.458+0000 7fc9080a7b80 1 --2- 172.21.15.71:0/213907350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de0cb80 0x55d40de38500 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.458+0000 7fc9080a7b80 1 -- 172.21.15.71:0/213907350 >> 172.21.15.71:0/213907350 conn(0x55d40de0e0c0 msgr2=0x55d40de0cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:55.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.458+0000 7fc9080a7b80 1 -- 172.21.15.71:0/213907350 shutdown_connections 2023-10-09T06:58:55.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.458+0000 7fc9080a7b80 1 -- 172.21.15.71:0/213907350 wait complete. 2023-10-09T06:58:55.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.459+0000 7fc9080a7b80 20 client.7311 trim_cache size 0 max 16384 2023-10-09T06:58:55.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.476+0000 7fc9080a7b80 1 Processor -- start 2023-10-09T06:58:55.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.476+0000 7fc9080a7b80 1 -- start start 2023-10-09T06:58:55.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.476+0000 7fc9080a7b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d40de0a5f0 0x55d40de386a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.477+0000 7fc9080a7b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d40de0cb80 0x55d40de322a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.477+0000 7fc9080a7b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de57480 0x55d40de624e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.477+0000 7fc9080a7b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d40de0a3b0 con 0x55d40de57480 2023-10-09T06:58:55.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.477+0000 7fc9080a7b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d40de059e0 con 0x55d40de0cb80 2023-10-09T06:58:55.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.477+0000 7fc9080a7b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d40de57f50 con 0x55d40de0a5f0 2023-10-09T06:58:55.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.477+0000 7fc8f37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de57480 0x55d40de624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.477+0000 7fc8f37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de57480 0x55d40de624e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47836/0 (socket says 172.21.15.71:47836) 2023-10-09T06:58:55.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.477+0000 7fc8f37fe700 1 -- 172.21.15.71:0/2419683311 learned_addr learned my addr 172.21.15.71:0/2419683311 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:55.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.477+0000 7fc8f27fc700 1 --2- 172.21.15.71:0/2419683311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d40de0cb80 0x55d40de322a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.477+0000 7fc8f2ffd700 1 --2- 172.21.15.71:0/2419683311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d40de0a5f0 0x55d40de386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.477+0000 7fc8f37fe700 1 -- 172.21.15.71:0/2419683311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d40de0a5f0 msgr2=0x55d40de386a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:55.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.477+0000 7fc8f37fe700 1 --2- 172.21.15.71:0/2419683311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d40de0a5f0 0x55d40de386a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.477+0000 7fc8f37fe700 1 -- 172.21.15.71:0/2419683311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d40de0cb80 msgr2=0x55d40de322a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:55.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.477+0000 7fc8f37fe700 1 --2- 172.21.15.71:0/2419683311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d40de0cb80 0x55d40de322a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.477+0000 7fc8f37fe700 1 -- 172.21.15.71:0/2419683311 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d40dd2b780 con 0x55d40de57480 2023-10-09T06:58:55.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.477+0000 7fc8f2ffd700 1 --2- 172.21.15.71:0/2419683311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d40de0a5f0 0x55d40de386a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:55.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.478+0000 7fc8f37fe700 1 --2- 172.21.15.71:0/2419683311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de57480 0x55d40de624e0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec055430 tx=0x7fc8ec082c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b5bbe2cfaf3aa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:55.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.478+0000 7fc8d8ff9700 1 -- 172.21.15.71:0/2419683311 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec055730 con 0x55d40de57480 2023-10-09T06:58:55.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.478+0000 7fc8d8ff9700 1 -- 172.21.15.71:0/2419683311 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ec084040 con 0x55d40de57480 2023-10-09T06:58:55.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.478+0000 7fc8d8ff9700 1 -- 172.21.15.71:0/2419683311 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec058980 con 0x55d40de57480 2023-10-09T06:58:55.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.478+0000 7fc9080a7b80 1 -- 172.21.15.71:0/2419683311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de57480 msgr2=0x55d40de624e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:55.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.478+0000 7fc9080a7b80 1 --2- 172.21.15.71:0/2419683311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de57480 0x55d40de624e0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec055430 tx=0x7fc8ec082c80 comp rx=0 tx=0).stop 2023-10-09T06:58:55.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.478+0000 7fc9080a7b80 1 -- 172.21.15.71:0/2419683311 shutdown_connections 2023-10-09T06:58:55.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.478+0000 7fc9080a7b80 1 --2- 172.21.15.71:0/2419683311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de57480 0x55d40de624e0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.478+0000 7fc9080a7b80 1 --2- 172.21.15.71:0/2419683311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d40de0a5f0 0x55d40de386a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.478+0000 7fc9080a7b80 1 --2- 172.21.15.71:0/2419683311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d40de0cb80 0x55d40de322a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.478+0000 7fc9080a7b80 1 -- 172.21.15.71:0/2419683311 >> 172.21.15.71:0/2419683311 conn(0x55d40de0e0c0 msgr2=0x55d40de0d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:55.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.478+0000 7fc9080a7b80 1 -- 172.21.15.71:0/2419683311 shutdown_connections 2023-10-09T06:58:55.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.478+0000 7fc9080a7b80 1 -- 172.21.15.71:0/2419683311 wait complete. 2023-10-09T06:58:55.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.479+0000 7fc9080a7b80 1 -- start start 2023-10-09T06:58:55.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.479+0000 7fc9080a7b80 1 Processor -- start 2023-10-09T06:58:55.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.480+0000 7fc9080a7b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de0a5f0 0x55d40de6c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.480+0000 7fc9080a7b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d40de0cb80 0x55d40de0eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.480+0000 7fc9080a7b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d40de57480 0x55d40de0f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.480+0000 7fc9080a7b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d40deb9d40 con 0x55d40de0a5f0 2023-10-09T06:58:55.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.480+0000 7fc9080a7b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d40de6cad0 con 0x55d40de0cb80 2023-10-09T06:58:55.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.480+0000 7fc9080a7b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d40de35280 con 0x55d40de57480 2023-10-09T06:58:55.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.480+0000 7fc9080a7b80 10 client.0 _ll_register_callbacks cb 0x55d40ddd02c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T06:58:55.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.480+0000 7fc8f2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de0a5f0 0x55d40de6c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.480+0000 7fc8f2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de0a5f0 0x55d40de6c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47848/0 (socket says 172.21.15.71:47848) 2023-10-09T06:58:55.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.480+0000 7fc8f2ffd700 1 -- 172.21.15.71:0/2195355646 learned_addr learned my addr 172.21.15.71:0/2195355646 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:55.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.481+0000 7fc8f2ffd700 1 -- 172.21.15.71:0/2195355646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d40de57480 msgr2=0x55d40de0f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:55.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.481+0000 7fc8f2ffd700 1 --2- 172.21.15.71:0/2195355646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d40de57480 0x55d40de0f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.481+0000 7fc8f2ffd700 1 -- 172.21.15.71:0/2195355646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d40de0cb80 msgr2=0x55d40de0eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:55.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.481+0000 7fc8f2ffd700 1 --2- 172.21.15.71:0/2195355646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d40de0cb80 0x55d40de0eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.481+0000 7fc8f2ffd700 1 -- 172.21.15.71:0/2195355646 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f40afc10 con 0x55d40de0a5f0 2023-10-09T06:58:55.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.481+0000 7fc8f2ffd700 1 --2- 172.21.15.71:0/2195355646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de0a5f0 0x55d40de6c590 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400ea40 tx=0x7fc8e4003040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d7a2846885a9f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:55.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.481+0000 7fc8d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T06:58:55.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.481+0000 7fc8d17fa700 1 -- 172.21.15.71:0/2195355646 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e40189a0 con 0x55d40de0a5f0 2023-10-09T06:58:55.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.481+0000 7fc8d17fa700 1 -- 172.21.15.71:0/2195355646 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fc8e4005a00 con 0x55d40de0a5f0 2023-10-09T06:58:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.481+0000 7fc9080a7b80 1 -- 172.21.15.71:0/2195355646 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc8f414ae70 con 0x55d40de0a5f0 2023-10-09T06:58:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.481+0000 7fc8d17fa700 1 -- 172.21.15.71:0/2195355646 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8e40096c0 con 0x55d40de0a5f0 2023-10-09T06:58:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.481+0000 7fc9080a7b80 10 client.7317 fetch_fsmap learned FSMap version 49 2023-10-09T06:58:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.481+0000 7fc9080a7b80 1 -- 172.21.15.71:0/2195355646 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x55d40dd12470 con 0x55d40de0a5f0 2023-10-09T06:58:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.482+0000 7fc8d17fa700 1 -- 172.21.15.71:0/2195355646 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f414ae70 con 0x55d40de0a5f0 2023-10-09T06:58:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.482+0000 7fc8d17fa700 1 -- 172.21.15.71:0/2195355646 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 49) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc8e4034020 con 0x55d40de0a5f0 2023-10-09T06:58:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.482+0000 7fc9080a7b80 10 client.7317 fetch_fsmap finished waiting for FSMap version 49 2023-10-09T06:58:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.482+0000 7fc9080a7b80 10 client.7317 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T06:58:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.482+0000 7fc9080a7b80 20 client.7317 populate_metadata read hostname 'smithi071' 2023-10-09T06:58:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.482+0000 7fc9080a7b80 1 --2- 172.21.15.71:0/2195355646 >> [v2:172.21.15.179:6835/4053543999,v1:172.21.15.179:6837/4053543999] conn(0x55d40deb8f50 0x55d40deb9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.482+0000 7fc9080a7b80 4 client.7317 mds_command: new command op to 7152 tid=0[{"prefix": "status"}] 2023-10-09T06:58:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.482+0000 7fc9080a7b80 1 -- 172.21.15.71:0/2195355646 --> [v2:172.21.15.179:6835/4053543999,v1:172.21.15.179:6837/4053543999] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fc8e40180d0 con 0x55d40deb8f50 2023-10-09T06:58:55.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.482+0000 7fc8f27fc700 1 --2- 172.21.15.71:0/2195355646 >> [v2:172.21.15.179:6835/4053543999,v1:172.21.15.179:6837/4053543999] conn(0x55d40deb8f50 0x55d40deb9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.483+0000 7fc8d17fa700 10 client.7317 ms_handle_connect on v2:172.21.15.179:6835/4053543999 2023-10-09T06:58:55.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.483+0000 7fc8f27fc700 1 --2- 172.21.15.71:0/2195355646 >> [v2:172.21.15.179:6835/4053543999,v1:172.21.15.179:6837/4053543999] conn(0x55d40deb8f50 0x55d40deb9320 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19ddee0f0af8d985 server_cookie=c60dc723cce61667 in_seq=0 out_seq=0 2023-10-09T06:58:55.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.483+0000 7fc8d17fa700 1 -- 172.21.15.71:0/2195355646 <== mds.0 v2:172.21.15.179:6835/4053543999 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7fc8e40180d0 con 0x55d40deb8f50 2023-10-09T06:58:55.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.483+0000 7fc8d17fa700 10 client.7317 handle_command_reply: tid=0 2023-10-09T06:58:55.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.483+0000 7fc9080a7b80 1 client.7317 shutdown 2023-10-09T06:58:55.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.483+0000 7fc9080a7b80 1 -- 172.21.15.71:0/2195355646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de0a5f0 msgr2=0x55d40de6c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:55.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.483+0000 7fc9080a7b80 1 --2- 172.21.15.71:0/2195355646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de0a5f0 0x55d40de6c590 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400ea40 tx=0x7fc8e4003040 comp rx=0 tx=0).stop 2023-10-09T06:58:55.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.483+0000 7fc9080a7b80 1 -- 172.21.15.71:0/2195355646 shutdown_connections 2023-10-09T06:58:55.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.483+0000 7fc9080a7b80 1 --2- 172.21.15.71:0/2195355646 >> [v2:172.21.15.179:6835/4053543999,v1:172.21.15.179:6837/4053543999] conn(0x55d40deb8f50 0x55d40deb9320 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.483+0000 7fc9080a7b80 1 --2- 172.21.15.71:0/2195355646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d40de57480 0x55d40de0f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.483+0000 7fc9080a7b80 1 --2- 172.21.15.71:0/2195355646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d40de0a5f0 0x55d40de6c590 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.483+0000 7fc9080a7b80 1 --2- 172.21.15.71:0/2195355646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d40de0cb80 0x55d40de0eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.483+0000 7fc8d17fa700 0 client.7317 ms_handle_reset on v2:172.21.15.179:6835/4053543999 2023-10-09T06:58:55.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.483+0000 7fc9080a7b80 1 -- 172.21.15.71:0/2195355646 >> 172.21.15.71:0/2195355646 conn(0x55d40de0e0c0 msgr2=0x55d40de09020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:55.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.484+0000 7fc9080a7b80 1 -- 172.21.15.71:0/2195355646 shutdown_connections 2023-10-09T06:58:55.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.484+0000 7fc9080a7b80 1 -- 172.21.15.71:0/2195355646 wait complete. 2023-10-09T06:58:55.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.484+0000 7fc9080a7b80 20 client.7317 trim_cache size 0 max 16384 2023-10-09T06:58:55.490 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T06:58:55.490 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "604c5619-653a-4ab6-912c-ab2e5464fe4a", 2023-10-09T06:58:55.491 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2023-10-09T06:58:55.491 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 7152, 2023-10-09T06:58:55.491 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2023-10-09T06:58:55.491 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2023-10-09T06:58:55.491 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2023-10-09T06:58:55.491 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 11.235407362, 2023-10-09T06:58:55.491 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 49, 2023-10-09T06:58:55.491 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 107, 2023-10-09T06:58:55.491 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 107, 2023-10-09T06:58:55.491 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 17.011784893000002 2023-10-09T06:58:55.491 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T06:58:55.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.484+0000 7fc8f3fff700 1 -- 172.21.15.71:0/3367072353 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc8e0066f30 msgr2=0x7fc8e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:55.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.484+0000 7fc8f3fff700 1 --2- 172.21.15.71:0/3367072353 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc8e0066f30 0x7fc8e00693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4006fd0 tx=0x7fc8e4008040 comp rx=0 tx=0).stop 2023-10-09T06:58:55.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.484+0000 7fc8f3fff700 1 -- 172.21.15.71:0/3367072353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8f4150550 msgr2=0x7fc8f415e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:55.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.484+0000 7fc8f3fff700 1 --2- 172.21.15.71:0/3367072353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8f4150550 0x7fc8f415e400 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00c910 tx=0x7fc8ec001710 comp rx=0 tx=0).stop 2023-10-09T06:58:55.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.484+0000 7fc8f3fff700 1 -- 172.21.15.71:0/3367072353 shutdown_connections 2023-10-09T06:58:55.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.484+0000 7fc8f3fff700 1 --2- 172.21.15.71:0/3367072353 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc8e0066f30 0x7fc8e00693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.484+0000 7fc8f3fff700 1 --2- 172.21.15.71:0/3367072353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8f4150550 0x7fc8f415e400 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.484+0000 7fc8f3fff700 1 --2- 172.21.15.71:0/3367072353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8f40c7240 0x7fc8f40aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.484+0000 7fc8f3fff700 1 --2- 172.21.15.71:0/3367072353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8f4150180 0x7fc8f4146e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.484+0000 7fc8f3fff700 1 -- 172.21.15.71:0/3367072353 >> 172.21.15.71:0/3367072353 conn(0x7fc8f40cc1f0 msgr2=0x7fc8f40c2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:55.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.484+0000 7fc8f3fff700 1 -- 172.21.15.71:0/3367072353 shutdown_connections 2023-10-09T06:58:55.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.485+0000 7fc8f3fff700 1 -- 172.21.15.71:0/3367072353 wait complete. 2023-10-09T06:58:55.502 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T06:58:55.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.684+0000 7f3fd2d9d700 1 Processor -- start 2023-10-09T06:58:55.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.685+0000 7f3fd2d9d700 1 -- start start 2023-10-09T06:58:55.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.686+0000 7f3fd2d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3fcc06d950 0x7f3fcc0c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.686+0000 7f3fd2d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3fcc06a0a0 0x7f3fcc0c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.686+0000 7f3fd2d9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fcc06ae70 con 0x7f3fcc06dd20 2023-10-09T06:58:55.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.686+0000 7f3fd2d9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fcc06a540 con 0x7f3fcc06d950 2023-10-09T06:58:55.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.686+0000 7f3fd2d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fcc06a820 con 0x7f3fcc06a0a0 2023-10-09T06:58:55.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.686+0000 7f3fd1d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3fcc06d950 0x7f3fcc0c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.686+0000 7f3fd1d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3fcc06d950 0x7f3fcc0c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47864/0 (socket says 172.21.15.71:47864) 2023-10-09T06:58:55.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.686+0000 7f3fd1d9b700 1 -- 172.21.15.71:0/3574295466 learned_addr learned my addr 172.21.15.71:0/3574295466 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:55.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.686+0000 7f3fd259c700 1 --1- 172.21.15.71:0/3574295466 >> v1:172.21.15.71:6789/0 conn(0x7f3fcc06dd20 0x7f3fcc0c7150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59262/0 (socket says 172.21.15.71:59262) 2023-10-09T06:58:55.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.687+0000 7f3fd159a700 1 --2- 172.21.15.71:0/3574295466 >> v2:172.21.15.179:3300/0 conn(0x7f3fcc06a0a0 0x7f3fcc0c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.687+0000 7f3fd1d9b700 1 -- 172.21.15.71:0/3574295466 >> v2:172.21.15.179:3300/0 conn(0x7f3fcc06a0a0 msgr2=0x7f3fcc0c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:55.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.687+0000 7f3fd1d9b700 1 --2- 172.21.15.71:0/3574295466 >> v2:172.21.15.179:3300/0 conn(0x7f3fcc06a0a0 0x7f3fcc0c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.687+0000 7f3fd1d9b700 1 -- 172.21.15.71:0/3574295466 >> v1:172.21.15.71:6789/0 conn(0x7f3fcc06dd20 legacy=0x7f3fcc0c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:55.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.687+0000 7f3fd1d9b700 1 -- 172.21.15.71:0/3574295466 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fcc06ab00 con 0x7f3fcc06d950 2023-10-09T06:58:55.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.687+0000 7f3fd0d99700 1 -- 172.21.15.71:0/3574295466 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928578847 0 0) 0x7f3fcc06ae70 con 0x7f3fcc06dd20 2023-10-09T06:58:55.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.687+0000 7f3fd1d9b700 1 --2- 172.21.15.71:0/3574295466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fcc06d950 0x7f3fcc0c8350 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc06b0c0 tx=0x7f3fc8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4185da28ef551303 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:55.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.687+0000 7f3fd0d99700 1 -- 172.21.15.71:0/3574295466 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc800b860 con 0x7f3fcc06d950 2023-10-09T06:58:55.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.687+0000 7f3fd0d99700 1 -- 172.21.15.71:0/3574295466 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc800b9c0 con 0x7f3fcc06d950 2023-10-09T06:58:55.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.687+0000 7f3fd0d99700 1 -- 172.21.15.71:0/3574295466 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc800bd60 con 0x7f3fcc06d950 2023-10-09T06:58:55.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.688+0000 7f3fd2d9d700 1 -- 172.21.15.71:0/3574295466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fcc06d950 msgr2=0x7f3fcc0c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:55.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.688+0000 7f3fd2d9d700 1 --2- 172.21.15.71:0/3574295466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fcc06d950 0x7f3fcc0c8350 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc06b0c0 tx=0x7f3fc8009250 comp rx=0 tx=0).stop 2023-10-09T06:58:55.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.688+0000 7f3fd2d9d700 1 -- 172.21.15.71:0/3574295466 shutdown_connections 2023-10-09T06:58:55.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.688+0000 7f3fd2d9d700 1 --2- 172.21.15.71:0/3574295466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fcc06d950 0x7f3fcc0c8350 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.688+0000 7f3fd2d9d700 1 --2- 172.21.15.71:0/3574295466 >> v2:172.21.15.179:3300/0 conn(0x7f3fcc06a0a0 0x7f3fcc0c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.688+0000 7f3fd2d9d700 1 -- 172.21.15.71:0/3574295466 >> 172.21.15.71:0/3574295466 conn(0x7f3fcc0cc1f0 msgr2=0x7f3fcc0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:55.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.688+0000 7f3fd2d9d700 1 -- 172.21.15.71:0/3574295466 shutdown_connections 2023-10-09T06:58:55.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.688+0000 7f3fd2d9d700 1 -- 172.21.15.71:0/3574295466 wait complete. 2023-10-09T06:58:55.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.689+0000 7f3fd2d9d700 1 Processor -- start 2023-10-09T06:58:55.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.690+0000 7f3fd2d9d700 1 -- start start 2023-10-09T06:58:55.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.690+0000 7f3fd2d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fcc06a0a0 0x7f3fcc15abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.690+0000 7f3fd2d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fcc06d950 0x7f3fcc158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.690+0000 7f3fd2d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fcc06dd20 0x7f3fcc0c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.690+0000 7f3fd2d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc15b0f0 con 0x7f3fcc06a0a0 2023-10-09T06:58:55.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.690+0000 7f3fd2d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc15a720 con 0x7f3fcc06d950 2023-10-09T06:58:55.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.690+0000 7f3fd2d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc0c4670 con 0x7f3fcc06dd20 2023-10-09T06:58:55.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.691+0000 7f3fd1d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fcc06a0a0 0x7f3fcc15abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.691+0000 7f3fd1d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fcc06a0a0 0x7f3fcc15abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47874/0 (socket says 172.21.15.71:47874) 2023-10-09T06:58:55.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.691+0000 7f3fd1d9b700 1 -- 172.21.15.71:0/1923110029 learned_addr learned my addr 172.21.15.71:0/1923110029 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:55.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.691+0000 7f3fd159a700 1 --2- 172.21.15.71:0/1923110029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fcc06d950 0x7f3fcc158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.691+0000 7f3fd259c700 1 --2- 172.21.15.71:0/1923110029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fcc06dd20 0x7f3fcc0c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.691+0000 7f3fd1d9b700 1 -- 172.21.15.71:0/1923110029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fcc06dd20 msgr2=0x7f3fcc0c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:55.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.691+0000 7f3fd1d9b700 1 --2- 172.21.15.71:0/1923110029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fcc06dd20 0x7f3fcc0c3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.691+0000 7f3fd1d9b700 1 -- 172.21.15.71:0/1923110029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fcc06d950 msgr2=0x7f3fcc158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:55.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.691+0000 7f3fd1d9b700 1 --2- 172.21.15.71:0/1923110029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fcc06d950 0x7f3fcc158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.691+0000 7f3fd1d9b700 1 -- 172.21.15.71:0/1923110029 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc80094f0 con 0x7f3fcc06a0a0 2023-10-09T06:58:55.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.691+0000 7f3fd1d9b700 1 --2- 172.21.15.71:0/1923110029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fcc06a0a0 0x7f3fcc15abb0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8006f50 tx=0x7f3fc8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:55.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.692+0000 7f3fc1ffb700 1 -- 172.21.15.71:0/1923110029 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8011e40 con 0x7f3fcc06a0a0 2023-10-09T06:58:55.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.692+0000 7f3fc1ffb700 1 -- 172.21.15.71:0/1923110029 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc8024440 con 0x7f3fcc06a0a0 2023-10-09T06:58:55.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.692+0000 7f3fd2d9d700 1 -- 172.21.15.71:0/1923110029 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fcc16bc60 con 0x7f3fcc06a0a0 2023-10-09T06:58:55.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.692+0000 7f3fc1ffb700 1 -- 172.21.15.71:0/1923110029 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc80247e0 con 0x7f3fcc06a0a0 2023-10-09T06:58:55.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.692+0000 7f3fd2d9d700 1 -- 172.21.15.71:0/1923110029 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fcc15a3b0 con 0x7f3fcc06a0a0 2023-10-09T06:58:55.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.693+0000 7f3fd2d9d700 1 -- 172.21.15.71:0/1923110029 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fcc15aa00 con 0x7f3fcc06a0a0 2023-10-09T06:58:55.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.694+0000 7f3fc1ffb700 1 -- 172.21.15.71:0/1923110029 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3fc802d440 con 0x7f3fcc06a0a0 2023-10-09T06:58:55.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.695+0000 7f3fc1ffb700 1 --2- 172.21.15.71:0/1923110029 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3fb0066f30 0x7f3fb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:55.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.695+0000 7f3fc1ffb700 1 -- 172.21.15.71:0/1923110029 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f3fc8086120 con 0x7f3fcc06a0a0 2023-10-09T06:58:55.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.695+0000 7f3fd159a700 1 --2- 172.21.15.71:0/1923110029 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3fb0066f30 0x7f3fb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:55.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.696+0000 7f3fd159a700 1 --2- 172.21.15.71:0/1923110029 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3fb0066f30 0x7f3fb00693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc006fd0 tx=0x7f3fbc008040 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:55.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.699+0000 7f3fc1ffb700 1 -- 172.21.15.71:0/1923110029 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fc8053160 con 0x7f3fcc06a0a0 2023-10-09T06:58:55.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.934+0000 7f3fd2d9d700 1 -- 172.21.15.71:0/1923110029 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3fcc04c3c0 con 0x7f3fcc06a0a0 2023-10-09T06:58:55.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.934+0000 7f3fc1ffb700 1 -- 172.21.15.71:0/1923110029 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3fc8056780 con 0x7f3fcc06a0a0 2023-10-09T06:58:55.935 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T06:58:55.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.936+0000 7f3fd2d9d700 1 -- 172.21.15.71:0/1923110029 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3fb0066f30 msgr2=0x7f3fb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:55.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.936+0000 7f3fd2d9d700 1 --2- 172.21.15.71:0/1923110029 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3fb0066f30 0x7f3fb00693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc006fd0 tx=0x7f3fbc008040 comp rx=0 tx=0).stop 2023-10-09T06:58:55.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.936+0000 7f3fd2d9d700 1 -- 172.21.15.71:0/1923110029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fcc06a0a0 msgr2=0x7f3fcc15abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:55.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.936+0000 7f3fd2d9d700 1 --2- 172.21.15.71:0/1923110029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fcc06a0a0 0x7f3fcc15abb0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8006f50 tx=0x7f3fc8017000 comp rx=0 tx=0).stop 2023-10-09T06:58:55.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.937+0000 7f3fd2d9d700 1 -- 172.21.15.71:0/1923110029 shutdown_connections 2023-10-09T06:58:55.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.937+0000 7f3fd2d9d700 1 --2- 172.21.15.71:0/1923110029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fcc06dd20 0x7f3fcc0c3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.937+0000 7f3fd2d9d700 1 --2- 172.21.15.71:0/1923110029 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3fb0066f30 0x7f3fb00693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.937+0000 7f3fd2d9d700 1 --2- 172.21.15.71:0/1923110029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fcc06a0a0 0x7f3fcc15abb0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.937+0000 7f3fd2d9d700 1 --2- 172.21.15.71:0/1923110029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fcc06d950 0x7f3fcc158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:55.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.937+0000 7f3fd2d9d700 1 -- 172.21.15.71:0/1923110029 >> 172.21.15.71:0/1923110029 conn(0x7f3fcc0cc1f0 msgr2=0x7f3fcc0c2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:55.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.937+0000 7f3fd2d9d700 1 -- 172.21.15.71:0/1923110029 shutdown_connections 2023-10-09T06:58:55.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:55.937+0000 7f3fd2d9d700 1 -- 172.21.15.71:0/1923110029 wait complete. 2023-10-09T06:58:55.955 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T06:58:55.955 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T06:58:55.955 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2023-10-09T06:58:55.955 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T06:58:55.955 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T06:58:55.955 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T06:58:55.955 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T06:58:55.955 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T06:58:55.955 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:58:55.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:58:55.956 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2023-10-09T06:58:55.995 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T06:58:55.995 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T06:58:55.995 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T06:58:55.995 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:58:55.995 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-10-09T06:58:55.995 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:58:55.995 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:58:55.996 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2023-10-09T06:58:55.996 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2023-10-09T06:58:55.996 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:58:55.996 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2023-10-09T06:58:55.996 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2023-10-09T06:58:55.996 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T06:58:55.996 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:58:55.996 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T06:58:55.996 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2023-10-09T06:58:55.996 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T06:58:55.996 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 41300sec preferred_lft 41300sec 2023-10-09T06:58:55.997 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2023-10-09T06:58:55.997 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:58:55.997 INFO:teuthology.orchestra.run.smithi071.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T06:58:55.997 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5a:a1:ec:c7:41:8f brd ff:ff:ff:ff:ff:ff 2023-10-09T06:58:55.997 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T06:58:55.997 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:58:55.997 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::8052:a9ff:fe85:8756/64 scope link 2023-10-09T06:58:55.997 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:58:55.997 INFO:teuthology.orchestra.run.smithi071.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:58:55.997 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether ae:1f:c9:59:0c:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T06:58:55.997 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ac1f:c9ff:fe59:c1b/64 scope link 2023-10-09T06:58:55.997 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:58:55.998 INFO:teuthology.orchestra.run.smithi071.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T06:58:55.998 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5a:a1:ec:c7:41:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T06:58:55.998 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::58a1:ecff:fec7:418f/64 scope link 2023-10-09T06:58:55.998 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T06:58:55.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:58:55.998 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T06:58:56.097 INFO:teuthology.orchestra.run.smithi071.stdout:1 2023-10-09T06:58:56.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:58:56.098 DEBUG:teuthology.orchestra.run.smithi071:> route 2023-10-09T06:58:56.139 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2023-10-09T06:58:56.139 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T06:58:56.139 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T06:58:56.139 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T06:58:56.139 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T06:58:56.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:58:56.139 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-09T06:58:56.140 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-09T06:58:56.140 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T06:58:56.140 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T06:58:56.140 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T06:58:56.140 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-09T06:58:56.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:58:56.333 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-09T06:58:56.369 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T06:58:56.369 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T06:58:56.370 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:58:56.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:58:56.370 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2023-10-09T06:58:56.470 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:58:56.470 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T06:58:56.507 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T06:58:56.507 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T06:58:56.508 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:58:56.583 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T06:58:56.584 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T06:58:56.584 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:58:56.713 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:58:56.713 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:58:56.742 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T06:58:56.742 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T06:58:56.742 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.71:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-09T06:58:56.742 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with new device syntax: 0@604c5619-653a-4ab6-912c-ab2e5464fe4a.cephfs=/ 2023-10-09T06:58:56.742 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.71:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-10-09T06:58:56.747 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T06:58:56.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T06:58:56.747 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T06:58:56.810 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T06:58:56.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.991+0000 7f9a37fff700 1 Processor -- start 2023-10-09T06:58:56.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.992+0000 7f9a37fff700 1 -- start start 2023-10-09T06:58:56.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.993+0000 7f9a37fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a380ad870 0x7f9a3806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:56.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.993+0000 7f9a37fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9a3806bf20 0x7f9a3806a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:56.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.993+0000 7f9a37fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3806c350 con 0x7f9a38142ea0 2023-10-09T06:58:56.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.993+0000 7f9a37fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a380b40f0 con 0x7f9a3806bf20 2023-10-09T06:58:56.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.993+0000 7f9a37fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a38069640 con 0x7f9a380ad870 2023-10-09T06:58:56.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.993+0000 7f9a377fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9a3806bf20 0x7f9a3806a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:56.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.993+0000 7f9a2ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a380ad870 0x7f9a3806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:56.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.993+0000 7f9a2ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a380ad870 0x7f9a3806b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:51040/0 (socket says 172.21.15.71:51040) 2023-10-09T06:58:56.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.993+0000 7f9a36ffd700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f9a38142ea0 0x7f9a380b3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:42872/0 (socket says 172.21.15.71:42872) 2023-10-09T06:58:56.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.993+0000 7f9a377fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9a3806bf20 0x7f9a3806a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:43788/0 (socket says 172.21.15.71:43788) 2023-10-09T06:58:56.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.993+0000 7f9a2ffff700 1 -- 172.21.15.71:0/3304188471 learned_addr learned my addr 172.21.15.71:0/3304188471 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:56.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.994+0000 7f9a367fc700 1 -- 172.21.15.71:0/3304188471 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491094062 0 0) 0x7f9a3806c350 con 0x7f9a38142ea0 2023-10-09T06:58:56.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.994+0000 7f9a367fc700 1 -- 172.21.15.71:0/3304188471 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a24003570 con 0x7f9a38142ea0 2023-10-09T06:58:56.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.994+0000 7f9a2ffff700 1 -- 172.21.15.71:0/3304188471 >> v2:172.21.15.179:3300/0 conn(0x7f9a3806bf20 msgr2=0x7f9a3806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:56.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.994+0000 7f9a2ffff700 1 --2- 172.21.15.71:0/3304188471 >> v2:172.21.15.179:3300/0 conn(0x7f9a3806bf20 0x7f9a3806a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:56.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.994+0000 7f9a2ffff700 1 -- 172.21.15.71:0/3304188471 >> v1:172.21.15.179:6789/0 conn(0x7f9a38142ea0 legacy=0x7f9a380b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:56.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.994+0000 7f9a2ffff700 1 -- 172.21.15.71:0/3304188471 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a38069920 con 0x7f9a380ad870 2023-10-09T06:58:56.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.994+0000 7f9a377fe700 1 --2- 172.21.15.71:0/3304188471 >> v2:172.21.15.179:3300/0 conn(0x7f9a3806bf20 0x7f9a3806a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T06:58:56.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.994+0000 7f9a2ffff700 1 --2- 172.21.15.71:0/3304188471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a380ad870 0x7f9a3806b9e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9a200099b0 tx=0x7f9a20009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a9845bbbbb4d048 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:56.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.995+0000 7f9a367fc700 1 -- 172.21.15.71:0/3304188471 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2000b680 con 0x7f9a380ad870 2023-10-09T06:58:56.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.995+0000 7f9a367fc700 1 -- 172.21.15.71:0/3304188471 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2000b7e0 con 0x7f9a380ad870 2023-10-09T06:58:56.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.995+0000 7f9a367fc700 1 -- 172.21.15.71:0/3304188471 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2000bb80 con 0x7f9a380ad870 2023-10-09T06:58:56.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.995+0000 7f9a37fff700 1 -- 172.21.15.71:0/3304188471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a380ad870 msgr2=0x7f9a3806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:56.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.995+0000 7f9a37fff700 1 --2- 172.21.15.71:0/3304188471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a380ad870 0x7f9a3806b9e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9a200099b0 tx=0x7f9a20009250 comp rx=0 tx=0).stop 2023-10-09T06:58:56.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.995+0000 7f9a37fff700 1 -- 172.21.15.71:0/3304188471 shutdown_connections 2023-10-09T06:58:56.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.995+0000 7f9a37fff700 1 --2- 172.21.15.71:0/3304188471 >> v2:172.21.15.179:3300/0 conn(0x7f9a3806bf20 0x7f9a3806a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:56.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.995+0000 7f9a37fff700 1 --2- 172.21.15.71:0/3304188471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a380ad870 0x7f9a3806b9e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:56.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.995+0000 7f9a37fff700 1 -- 172.21.15.71:0/3304188471 >> 172.21.15.71:0/3304188471 conn(0x7f9a380ce430 msgr2=0x7f9a380ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:56.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.995+0000 7f9a37fff700 1 -- 172.21.15.71:0/3304188471 shutdown_connections 2023-10-09T06:58:56.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.995+0000 7f9a37fff700 1 -- 172.21.15.71:0/3304188471 wait complete. 2023-10-09T06:58:57.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.997+0000 7f9a37fff700 1 Processor -- start 2023-10-09T06:58:57.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.997+0000 7f9a37fff700 1 -- start start 2023-10-09T06:58:57.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.997+0000 7f9a37fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a3806bf20 0x7f9a380c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:57.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.998+0000 7f9a37fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a38142ea0 0x7f9a38158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:57.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.998+0000 7f9a37fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a380c85b0 0x7f9a3815ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:57.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.998+0000 7f9a37fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a380c8b00 con 0x7f9a38142ea0 2023-10-09T06:58:57.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.998+0000 7f9a37fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a380c8de0 con 0x7f9a3806bf20 2023-10-09T06:58:57.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.998+0000 7f9a37fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a380c90c0 con 0x7f9a380c85b0 2023-10-09T06:58:57.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.998+0000 7f9a2ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a38142ea0 0x7f9a38158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:57.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.998+0000 7f9a2ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a38142ea0 0x7f9a38158b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47884/0 (socket says 172.21.15.71:47884) 2023-10-09T06:58:57.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.998+0000 7f9a2ffff700 1 -- 172.21.15.71:0/334589414 learned_addr learned my addr 172.21.15.71:0/334589414 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:57.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.998+0000 7f9a36ffd700 1 --2- 172.21.15.71:0/334589414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a3806bf20 0x7f9a380c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:57.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.998+0000 7f9a377fe700 1 --2- 172.21.15.71:0/334589414 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a380c85b0 0x7f9a3815ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:57.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.998+0000 7f9a2ffff700 1 -- 172.21.15.71:0/334589414 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a380c85b0 msgr2=0x7f9a3815ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:57.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.998+0000 7f9a2ffff700 1 --2- 172.21.15.71:0/334589414 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a380c85b0 0x7f9a3815ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:57.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.998+0000 7f9a2ffff700 1 -- 172.21.15.71:0/334589414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a3806bf20 msgr2=0x7f9a380c9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:57.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.998+0000 7f9a2ffff700 1 --2- 172.21.15.71:0/334589414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a3806bf20 0x7f9a380c9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:57.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.998+0000 7f9a2ffff700 1 -- 172.21.15.71:0/334589414 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a30009a20 con 0x7f9a38142ea0 2023-10-09T06:58:57.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.999+0000 7f9a2ffff700 1 --2- 172.21.15.71:0/334589414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a38142ea0 0x7f9a38158b70 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f9a20009290 tx=0x7f9a20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:57.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.999+0000 7f9a2effd700 1 -- 172.21.15.71:0/334589414 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2000b950 con 0x7f9a38142ea0 2023-10-09T06:58:57.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.999+0000 7f9a2effd700 1 -- 172.21.15.71:0/334589414 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2000bab0 con 0x7f9a38142ea0 2023-10-09T06:58:57.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.999+0000 7f9a37fff700 1 -- 172.21.15.71:0/334589414 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a200094f0 con 0x7f9a38142ea0 2023-10-09T06:58:57.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.999+0000 7f9a2effd700 1 -- 172.21.15.71:0/334589414 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2001a680 con 0x7f9a38142ea0 2023-10-09T06:58:57.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:56.999+0000 7f9a37fff700 1 -- 172.21.15.71:0/334589414 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a380ca310 con 0x7f9a38142ea0 2023-10-09T06:58:57.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.000+0000 7f9a37fff700 1 -- 172.21.15.71:0/334589414 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a3804c3c0 con 0x7f9a38142ea0 2023-10-09T06:58:57.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.001+0000 7f9a2effd700 1 -- 172.21.15.71:0/334589414 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a2001aa70 con 0x7f9a38142ea0 2023-10-09T06:58:57.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.002+0000 7f9a2effd700 1 --2- 172.21.15.71:0/334589414 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9a18066f30 0x7f9a180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:57.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.002+0000 7f9a2effd700 1 -- 172.21.15.71:0/334589414 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f9a20086400 con 0x7f9a38142ea0 2023-10-09T06:58:57.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.002+0000 7f9a36ffd700 1 --2- 172.21.15.71:0/334589414 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9a18066f30 0x7f9a180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:57.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.003+0000 7f9a36ffd700 1 --2- 172.21.15.71:0/334589414 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9a18066f30 0x7f9a180693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a28004ee0 tx=0x7f9a28007d40 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:57.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.006+0000 7f9a2effd700 1 -- 172.21.15.71:0/334589414 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a20053440 con 0x7f9a38142ea0 2023-10-09T06:58:57.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.221+0000 7f9a37fff700 1 -- 172.21.15.71:0/334589414 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a380c8f50 con 0x7f9a18066f30 2023-10-09T06:58:57.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.223+0000 7f9a2effd700 1 -- 172.21.15.71:0/334589414 <== mgr.6718 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f9a380c8f50 con 0x7f9a18066f30 2023-10-09T06:58:57.224 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-09T06:58:57.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T06:58:57.224 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cephfs" 2023-10-09T06:58:57.224 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T06:58:57.224 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-09T06:58:57.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.225+0000 7f9a37fff700 1 -- 172.21.15.71:0/334589414 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9a18066f30 msgr2=0x7f9a180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:57.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.225+0000 7f9a37fff700 1 --2- 172.21.15.71:0/334589414 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9a18066f30 0x7f9a180693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a28004ee0 tx=0x7f9a28007d40 comp rx=0 tx=0).stop 2023-10-09T06:58:57.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.225+0000 7f9a37fff700 1 -- 172.21.15.71:0/334589414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a38142ea0 msgr2=0x7f9a38158b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:57.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.225+0000 7f9a37fff700 1 --2- 172.21.15.71:0/334589414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a38142ea0 0x7f9a38158b70 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f9a20009290 tx=0x7f9a20017000 comp rx=0 tx=0).stop 2023-10-09T06:58:57.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.225+0000 7f9a37fff700 1 -- 172.21.15.71:0/334589414 shutdown_connections 2023-10-09T06:58:57.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.225+0000 7f9a37fff700 1 --2- 172.21.15.71:0/334589414 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a380c85b0 0x7f9a3815ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:57.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.225+0000 7f9a37fff700 1 --2- 172.21.15.71:0/334589414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a3806bf20 0x7f9a380c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:57.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.225+0000 7f9a37fff700 1 --2- 172.21.15.71:0/334589414 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f9a18066f30 0x7f9a180693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:57.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.225+0000 7f9a37fff700 1 --2- 172.21.15.71:0/334589414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a38142ea0 0x7f9a38158b70 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:57.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.225+0000 7f9a37fff700 1 -- 172.21.15.71:0/334589414 >> 172.21.15.71:0/334589414 conn(0x7f9a380ce430 msgr2=0x7f9a380cc920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:57.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.225+0000 7f9a37fff700 1 -- 172.21.15.71:0/334589414 shutdown_connections 2023-10-09T06:58:57.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.226+0000 7f9a37fff700 1 -- 172.21.15.71:0/334589414 wait complete. 2023-10-09T06:58:57.244 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-09T06:58:57.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.425+0000 7f76ba9ff700 1 Processor -- start 2023-10-09T06:58:57.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.426+0000 7f76ba9ff700 1 -- start start 2023-10-09T06:58:57.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.427+0000 7f76ba9ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f76b40c70b0 0x7f76b4069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:57.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.427+0000 7f76ba9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f76b4069cb0 0x7f76b40ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:57.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.427+0000 7f76ba9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b406e950 con 0x7f76b4155eb0 2023-10-09T06:58:57.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.427+0000 7f76ba9ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b406a130 con 0x7f76b40c70b0 2023-10-09T06:58:57.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.427+0000 7f76ba9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b406eb90 con 0x7f76b4069cb0 2023-10-09T06:58:57.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.427+0000 7f76abfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f76b40c70b0 0x7f76b4069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:57.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.427+0000 7f76abfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f76b40c70b0 0x7f76b4069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47894/0 (socket says 172.21.15.71:47894) 2023-10-09T06:58:57.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.427+0000 7f76abfff700 1 -- 172.21.15.71:0/1407408621 learned_addr learned my addr 172.21.15.71:0/1407408621 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:57.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.428+0000 7f76b8f9c700 1 --2- 172.21.15.71:0/1407408621 >> v2:172.21.15.179:3300/0 conn(0x7f76b4069cb0 0x7f76b40ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:57.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.428+0000 7f76abfff700 1 -- 172.21.15.71:0/1407408621 >> v2:172.21.15.179:3300/0 conn(0x7f76b4069cb0 msgr2=0x7f76b40ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:57.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.428+0000 7f76abfff700 1 --2- 172.21.15.71:0/1407408621 >> v2:172.21.15.179:3300/0 conn(0x7f76b4069cb0 0x7f76b40ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:57.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.428+0000 7f76abfff700 1 -- 172.21.15.71:0/1407408621 >> v1:172.21.15.179:6789/0 conn(0x7f76b4155eb0 legacy=0x7f76b406e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:57.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.428+0000 7f76abfff700 1 -- 172.21.15.71:0/1407408621 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b406ee70 con 0x7f76b40c70b0 2023-10-09T06:58:57.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.428+0000 7f76abfff700 1 --2- 172.21.15.71:0/1407408621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76b40c70b0 0x7f76b4069770 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f76b40cc450 tx=0x7f769c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489eb3f633f83832 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:57.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.428+0000 7f76b37fe700 1 -- 172.21.15.71:0/1407408621 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c00dba0 con 0x7f76b40c70b0 2023-10-09T06:58:57.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.428+0000 7f76b37fe700 1 -- 172.21.15.71:0/1407408621 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769c00dd00 con 0x7f76b40c70b0 2023-10-09T06:58:57.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.428+0000 7f76b37fe700 1 -- 172.21.15.71:0/1407408621 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c0196d0 con 0x7f76b40c70b0 2023-10-09T06:58:57.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.429+0000 7f76ba9ff700 1 -- 172.21.15.71:0/1407408621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76b40c70b0 msgr2=0x7f76b4069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:57.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.429+0000 7f76ba9ff700 1 --2- 172.21.15.71:0/1407408621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76b40c70b0 0x7f76b4069770 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f76b40cc450 tx=0x7f769c00b4f0 comp rx=0 tx=0).stop 2023-10-09T06:58:57.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.429+0000 7f76ba9ff700 1 -- 172.21.15.71:0/1407408621 shutdown_connections 2023-10-09T06:58:57.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.429+0000 7f76ba9ff700 1 --2- 172.21.15.71:0/1407408621 >> v2:172.21.15.179:3300/0 conn(0x7f76b4069cb0 0x7f76b40ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:57.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.429+0000 7f76ba9ff700 1 --2- 172.21.15.71:0/1407408621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76b40c70b0 0x7f76b4069770 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:57.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.429+0000 7f76ba9ff700 1 -- 172.21.15.71:0/1407408621 >> 172.21.15.71:0/1407408621 conn(0x7f76b4068e10 msgr2=0x7f76b40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:57.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.429+0000 7f76ba9ff700 1 -- 172.21.15.71:0/1407408621 shutdown_connections 2023-10-09T06:58:57.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.429+0000 7f76ba9ff700 1 -- 172.21.15.71:0/1407408621 wait complete. 2023-10-09T06:58:57.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.430+0000 7f76ba9ff700 1 Processor -- start 2023-10-09T06:58:57.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.431+0000 7f76ba9ff700 1 -- start start 2023-10-09T06:58:57.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.431+0000 7f76ba9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76b4069cb0 0x7f76b416acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:57.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.431+0000 7f76ba9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76b40c70b0 0x7f76b40ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:57.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.431+0000 7f76ba9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76b4155eb0 0x7f76b40c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:57.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.432+0000 7f76ba9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b40aed90 con 0x7f76b40c70b0 2023-10-09T06:58:57.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.432+0000 7f76ba9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b40c5150 con 0x7f76b4069cb0 2023-10-09T06:58:57.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.432+0000 7f76ba9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b40c5430 con 0x7f76b4155eb0 2023-10-09T06:58:57.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.432+0000 7f76abfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76b40c70b0 0x7f76b40ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:57.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.432+0000 7f76abfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76b40c70b0 0x7f76b40ae850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47904/0 (socket says 172.21.15.71:47904) 2023-10-09T06:58:57.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.432+0000 7f76abfff700 1 -- 172.21.15.71:0/4288826525 learned_addr learned my addr 172.21.15.71:0/4288826525 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:57.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.432+0000 7f76b8f9c700 1 --2- 172.21.15.71:0/4288826525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76b4155eb0 0x7f76b40c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:57.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.432+0000 7f76b3fff700 1 --2- 172.21.15.71:0/4288826525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76b4069cb0 0x7f76b416acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:57.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.432+0000 7f76abfff700 1 -- 172.21.15.71:0/4288826525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76b4155eb0 msgr2=0x7f76b40c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:57.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.432+0000 7f76abfff700 1 --2- 172.21.15.71:0/4288826525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76b4155eb0 0x7f76b40c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:57.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.432+0000 7f76abfff700 1 -- 172.21.15.71:0/4288826525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76b4069cb0 msgr2=0x7f76b416acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:57.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.432+0000 7f76abfff700 1 --2- 172.21.15.71:0/4288826525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76b4069cb0 0x7f76b416acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:57.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.432+0000 7f76abfff700 1 -- 172.21.15.71:0/4288826525 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769c00b790 con 0x7f76b40c70b0 2023-10-09T06:58:57.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.433+0000 7f76abfff700 1 --2- 172.21.15.71:0/4288826525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76b40c70b0 0x7f76b40ae850 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f76b406fe40 tx=0x7f769c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:57.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.433+0000 7f76b0ff9700 1 -- 172.21.15.71:0/4288826525 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c010680 con 0x7f76b40c70b0 2023-10-09T06:58:57.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.433+0000 7f76b0ff9700 1 -- 172.21.15.71:0/4288826525 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769c0107e0 con 0x7f76b40c70b0 2023-10-09T06:58:57.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.433+0000 7f76b0ff9700 1 -- 172.21.15.71:0/4288826525 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c010ba0 con 0x7f76b40c70b0 2023-10-09T06:58:57.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.433+0000 7f76ba9ff700 1 -- 172.21.15.71:0/4288826525 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b40c5710 con 0x7f76b40c70b0 2023-10-09T06:58:57.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.433+0000 7f76ba9ff700 1 -- 172.21.15.71:0/4288826525 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b40c5cd0 con 0x7f76b40c70b0 2023-10-09T06:58:57.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.434+0000 7f76ba9ff700 1 -- 172.21.15.71:0/4288826525 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b40c5ec0 con 0x7f76b40c70b0 2023-10-09T06:58:57.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.435+0000 7f76b0ff9700 1 -- 172.21.15.71:0/4288826525 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 40) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f769c0233f0 con 0x7f76b40c70b0 2023-10-09T06:58:57.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.435+0000 7f76b0ff9700 1 --2- 172.21.15.71:0/4288826525 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7694066f30 0x7f76940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:57.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.436+0000 7f76b0ff9700 1 -- 172.21.15.71:0/4288826525 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f769c014070 con 0x7f76b40c70b0 2023-10-09T06:58:57.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.436+0000 7f76b3fff700 1 --2- 172.21.15.71:0/4288826525 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7694066f30 0x7f76940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:57.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.437+0000 7f76b3fff700 1 --2- 172.21.15.71:0/4288826525 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7694066f30 0x7f76940693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f76a40039e0 tx=0x7f76a4007ec0 comp rx=0 tx=0).ready entity=mgr.6718 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:57.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.440+0000 7f76b0ff9700 1 -- 172.21.15.71:0/4288826525 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f769c053480 con 0x7f76b40c70b0 2023-10-09T06:58:57.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.682+0000 7f76ba9ff700 1 -- 172.21.15.71:0/4288826525 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f76b404c3c0 con 0x7f76b40c70b0 2023-10-09T06:58:57.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.810+0000 7f76b0ff9700 1 -- 172.21.15.71:0/4288826525 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 41) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f769c0860f0 con 0x7f76b40c70b0 2023-10-09T06:58:57.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.812+0000 7f76b0ff9700 1 -- 172.21.15.71:0/4288826525 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v41) v1 ==== 92+0+0 (secure 0 0 0) 0x7f769c056f10 con 0x7f76b40c70b0 2023-10-09T06:58:57.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.815+0000 7f76ba9ff700 1 -- 172.21.15.71:0/4288826525 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7694066f30 msgr2=0x7f76940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:57.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.815+0000 7f76ba9ff700 1 --2- 172.21.15.71:0/4288826525 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7694066f30 0x7f76940693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f76a40039e0 tx=0x7f76a4007ec0 comp rx=0 tx=0).stop 2023-10-09T06:58:57.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.815+0000 7f76ba9ff700 1 -- 172.21.15.71:0/4288826525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76b40c70b0 msgr2=0x7f76b40ae850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:57.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.815+0000 7f76ba9ff700 1 --2- 172.21.15.71:0/4288826525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76b40c70b0 0x7f76b40ae850 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f76b406fe40 tx=0x7f769c01b000 comp rx=0 tx=0).stop 2023-10-09T06:58:57.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.815+0000 7f76ba9ff700 1 -- 172.21.15.71:0/4288826525 shutdown_connections 2023-10-09T06:58:57.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.815+0000 7f76ba9ff700 1 --2- 172.21.15.71:0/4288826525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76b4155eb0 0x7f76b40c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:57.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.815+0000 7f76ba9ff700 1 --2- 172.21.15.71:0/4288826525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76b4069cb0 0x7f76b416acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:57.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.815+0000 7f76ba9ff700 1 --2- 172.21.15.71:0/4288826525 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7694066f30 0x7f76940693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:57.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.815+0000 7f76ba9ff700 1 --2- 172.21.15.71:0/4288826525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76b40c70b0 0x7f76b40ae850 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:57.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.815+0000 7f76ba9ff700 1 -- 172.21.15.71:0/4288826525 >> 172.21.15.71:0/4288826525 conn(0x7f76b4068e10 msgr2=0x7f76b4154d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:57.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.815+0000 7f76ba9ff700 1 -- 172.21.15.71:0/4288826525 shutdown_connections 2023-10-09T06:58:57.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:57.815+0000 7f76ba9ff700 1 -- 172.21.15.71:0/4288826525 wait complete. 2023-10-09T06:58:57.834 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-09T06:58:58.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.024+0000 7f440999d700 1 Processor -- start 2023-10-09T06:58:58.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.024+0000 7f440999d700 1 -- start start 2023-10-09T06:58:58.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.026+0000 7f440999d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f44040b4e70 0x7f44040ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:58.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.026+0000 7f440999d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44040cfb00 con 0x7f44040b1b40 2023-10-09T06:58:58.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.026+0000 7f440999d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f440415e060 con 0x7f44040b16d0 2023-10-09T06:58:58.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.026+0000 7f440999d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44040b5c40 con 0x7f44040b4e70 2023-10-09T06:58:58.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.026+0000 7f440919c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f44040b1b40 0x7f440415d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59266/0 (socket says 172.21.15.71:59266) 2023-10-09T06:58:58.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.026+0000 7f440919c700 1 -- 172.21.15.71:0/3129347690 learned_addr learned my addr 172.21.15.71:0/3129347690 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:58.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.026+0000 7f440899b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f44040b4e70 0x7f44040ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:58.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.026+0000 7f44037fe700 1 -- 172.21.15.71:0/3129347690 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2084235859 0 0) 0x7f44040cfb00 con 0x7f44040b1b40 2023-10-09T06:58:58.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.027+0000 7f44037fe700 1 -- 172.21.15.71:0/3129347690 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43f4003570 con 0x7f44040b1b40 2023-10-09T06:58:58.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.027+0000 7f440899b700 1 -- 172.21.15.71:0/3129347690 >> v1:172.21.15.179:6789/0 conn(0x7f44040b16d0 legacy=0x7f440415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:58.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.027+0000 7f44037fe700 1 -- 172.21.15.71:0/3129347690 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3123337639 0 0) 0x7f440415e060 con 0x7f44040b16d0 2023-10-09T06:58:58.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.027+0000 7f440899b700 1 -- 172.21.15.71:0/3129347690 >> v1:172.21.15.71:6789/0 conn(0x7f44040b1b40 legacy=0x7f440415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:58.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.027+0000 7f440899b700 1 -- 172.21.15.71:0/3129347690 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44040b5f20 con 0x7f44040b4e70 2023-10-09T06:58:58.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.027+0000 7f440899b700 1 --2- 172.21.15.71:0/3129347690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44040b4e70 0x7f44040ccff0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f43f80098e0 tx=0x7f43f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a10fc0fa9e50aa4f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:58.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.027+0000 7f44037fe700 1 -- 172.21.15.71:0/3129347690 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f800b640 con 0x7f44040b4e70 2023-10-09T06:58:58.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.027+0000 7f44037fe700 1 -- 172.21.15.71:0/3129347690 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f800b7a0 con 0x7f44040b4e70 2023-10-09T06:58:58.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.027+0000 7f44037fe700 1 -- 172.21.15.71:0/3129347690 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f800bb40 con 0x7f44040b4e70 2023-10-09T06:58:58.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.028+0000 7f440999d700 1 -- 172.21.15.71:0/3129347690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44040b4e70 msgr2=0x7f44040ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:58.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.028+0000 7f440999d700 1 --2- 172.21.15.71:0/3129347690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44040b4e70 0x7f44040ccff0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f43f80098e0 tx=0x7f43f80091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.028+0000 7f440999d700 1 -- 172.21.15.71:0/3129347690 shutdown_connections 2023-10-09T06:58:58.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.028+0000 7f440999d700 1 --2- 172.21.15.71:0/3129347690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44040b4e70 0x7f44040ccff0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.028+0000 7f440999d700 1 -- 172.21.15.71:0/3129347690 >> 172.21.15.71:0/3129347690 conn(0x7f44040d10c0 msgr2=0x7f44040affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:58.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.028+0000 7f440999d700 1 -- 172.21.15.71:0/3129347690 shutdown_connections 2023-10-09T06:58:58.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.028+0000 7f440999d700 1 -- 172.21.15.71:0/3129347690 wait complete. 2023-10-09T06:58:58.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.029+0000 7f440999d700 1 Processor -- start 2023-10-09T06:58:58.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.030+0000 7f440999d700 1 -- start start 2023-10-09T06:58:58.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.030+0000 7f440999d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44040b16d0 0x7f44040c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:58.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.030+0000 7f440999d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44040b1b40 0x7f4404158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:58.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.030+0000 7f440999d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44040b4e70 0x7f44041591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:58.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.030+0000 7f440999d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44040c5d60 con 0x7f44040b1b40 2023-10-09T06:58:58.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.030+0000 7f440999d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44040c61f0 con 0x7f44040b16d0 2023-10-09T06:58:58.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.030+0000 7f440999d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440416ad90 con 0x7f44040b4e70 2023-10-09T06:58:58.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.031+0000 7f4403fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44040b1b40 0x7f4404158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:58.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.031+0000 7f440899b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44040b16d0 0x7f44040c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:58.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.031+0000 7f4403fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44040b1b40 0x7f4404158cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47932/0 (socket says 172.21.15.71:47932) 2023-10-09T06:58:58.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.031+0000 7f4403fff700 1 -- 172.21.15.71:0/491028851 learned_addr learned my addr 172.21.15.71:0/491028851 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:58.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.031+0000 7f440919c700 1 --2- 172.21.15.71:0/491028851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44040b4e70 0x7f44041591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:58.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.031+0000 7f4403fff700 1 -- 172.21.15.71:0/491028851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44040b4e70 msgr2=0x7f44041591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:58.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.031+0000 7f4403fff700 1 --2- 172.21.15.71:0/491028851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44040b4e70 0x7f44041591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.031+0000 7f4403fff700 1 -- 172.21.15.71:0/491028851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44040b16d0 msgr2=0x7f44040c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:58.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.031+0000 7f4403fff700 1 --2- 172.21.15.71:0/491028851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44040b16d0 0x7f44040c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.031+0000 7f4403fff700 1 -- 172.21.15.71:0/491028851 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f8009420 con 0x7f44040b1b40 2023-10-09T06:58:58.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.031+0000 7f4403fff700 1 --2- 172.21.15.71:0/491028851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44040b1b40 0x7f4404158cb0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f43f000c7e0 tx=0x7f43f0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:58.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.032+0000 7f4400ff9700 1 -- 172.21.15.71:0/491028851 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f0011590 con 0x7f44040b1b40 2023-10-09T06:58:58.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.032+0000 7f4400ff9700 1 -- 172.21.15.71:0/491028851 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f0011710 con 0x7f44040b1b40 2023-10-09T06:58:58.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.032+0000 7f4400ff9700 1 -- 172.21.15.71:0/491028851 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f0011ad0 con 0x7f44040b1b40 2023-10-09T06:58:58.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.032+0000 7f440999d700 1 -- 172.21.15.71:0/491028851 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44040c5430 con 0x7f44040b1b40 2023-10-09T06:58:58.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.032+0000 7f440999d700 1 -- 172.21.15.71:0/491028851 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44040c59f0 con 0x7f44040b1b40 2023-10-09T06:58:58.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.033+0000 7f440999d700 1 -- 172.21.15.71:0/491028851 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44040c5bb0 con 0x7f44040b1b40 2023-10-09T06:58:58.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.034+0000 7f4400ff9700 1 -- 172.21.15.71:0/491028851 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 41) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f43f001b3b0 con 0x7f44040b1b40 2023-10-09T06:58:58.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.035+0000 7f4400ff9700 1 --2- 172.21.15.71:0/491028851 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f43e8066f80 0x7f43e8069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:58.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.035+0000 7f4400ff9700 1 -- 172.21.15.71:0/491028851 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f43f0083d40 con 0x7f44040b1b40 2023-10-09T06:58:58.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.035+0000 7f440899b700 1 -- 172.21.15.71:0/491028851 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f43e8066f80 msgr2=0x7f43e8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:58.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.035+0000 7f440899b700 1 --2- 172.21.15.71:0/491028851 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f43e8066f80 0x7f43e8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:58:58.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.038+0000 7f4400ff9700 1 -- 172.21.15.71:0/491028851 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43f0050d80 con 0x7f44040b1b40 2023-10-09T06:58:58.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.236+0000 7f440899b700 1 -- 172.21.15.71:0/491028851 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f43e8066f80 msgr2=0x7f43e8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:58.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.236+0000 7f440899b700 1 --2- 172.21.15.71:0/491028851 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f43e8066f80 0x7f43e8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:58:58.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.240+0000 7f440999d700 1 -- 172.21.15.71:0/491028851 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f440404bb80 con 0x7f44040b1b40 2023-10-09T06:58:58.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.246+0000 7f4400ff9700 1 -- 172.21.15.71:0/491028851 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v35)=0 v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f43f0017070 con 0x7f44040b1b40 2023-10-09T06:58:58.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.249+0000 7f440999d700 1 -- 172.21.15.71:0/491028851 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f43e8066f80 msgr2=0x7f43e8069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:58:58.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.249+0000 7f440999d700 1 --2- 172.21.15.71:0/491028851 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f43e8066f80 0x7f43e8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.249+0000 7f440999d700 1 -- 172.21.15.71:0/491028851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44040b1b40 msgr2=0x7f4404158cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:58.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.249+0000 7f440999d700 1 --2- 172.21.15.71:0/491028851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44040b1b40 0x7f4404158cb0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f43f000c7e0 tx=0x7f43f0007df0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.249+0000 7f440999d700 1 -- 172.21.15.71:0/491028851 shutdown_connections 2023-10-09T06:58:58.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.249+0000 7f440999d700 1 --2- 172.21.15.71:0/491028851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44040b4e70 0x7f44041591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.249+0000 7f440999d700 1 --2- 172.21.15.71:0/491028851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44040b16d0 0x7f44040c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.249+0000 7f440999d700 1 --2- 172.21.15.71:0/491028851 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f43e8066f80 0x7f43e8069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.249+0000 7f440999d700 1 --2- 172.21.15.71:0/491028851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44040b1b40 0x7f4404158cb0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.249+0000 7f440999d700 1 -- 172.21.15.71:0/491028851 >> 172.21.15.71:0/491028851 conn(0x7f44040d10c0 msgr2=0x7f4404159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:58.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.249+0000 7f440999d700 1 -- 172.21.15.71:0/491028851 shutdown_connections 2023-10-09T06:58:58.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.249+0000 7f440999d700 1 -- 172.21.15.71:0/491028851 wait complete. 2023-10-09T06:58:58.268 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-09T06:58:58.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.461+0000 7f413b19d700 1 Processor -- start 2023-10-09T06:58:58.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.461+0000 7f413b19d700 1 -- start start 2023-10-09T06:58:58.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.463+0000 7f413b19d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4134159a60 0x7f41340c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:58.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.463+0000 7f413b19d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f41340ccc00 0x7f4134069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:58.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.463+0000 7f413b19d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41340c9cb0 con 0x7f413406a020 2023-10-09T06:58:58.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.463+0000 7f413b19d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f413406dfc0 con 0x7f4134159a60 2023-10-09T06:58:58.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.463+0000 7f413b19d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41340c9f30 con 0x7f41340ccc00 2023-10-09T06:58:58.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.463+0000 7f413a19b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4134159a60 0x7f41340c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:58.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.463+0000 7f413999a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f41340ccc00 0x7f4134069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:58.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.463+0000 7f413999a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f41340ccc00 0x7f4134069ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:43834/0 (socket says 172.21.15.71:43834) 2023-10-09T06:58:58.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.463+0000 7f413999a700 1 -- 172.21.15.71:0/1542997169 learned_addr learned my addr 172.21.15.71:0/1542997169 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:58.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.463+0000 7f413a19b700 1 -- 172.21.15.71:0/1542997169 >> v2:172.21.15.179:3300/0 conn(0x7f41340ccc00 msgr2=0x7f4134069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:58.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.463+0000 7f413a19b700 1 --2- 172.21.15.71:0/1542997169 >> v2:172.21.15.179:3300/0 conn(0x7f41340ccc00 0x7f4134069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.463+0000 7f413a19b700 1 -- 172.21.15.71:0/1542997169 >> v1:172.21.15.179:6789/0 conn(0x7f413406a020 legacy=0x7f41340cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:58.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.463+0000 7f413a19b700 1 -- 172.21.15.71:0/1542997169 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41340ca470 con 0x7f4134159a60 2023-10-09T06:58:58.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.464+0000 7f413a19b700 1 --2- 172.21.15.71:0/1542997169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4134159a60 0x7f41340c9770 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f41340cf6a0 tx=0x7f41300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c90f1de8dac7d6c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:58.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.464+0000 7f4139199700 1 -- 172.21.15.71:0/1542997169 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413000b690 con 0x7f4134159a60 2023-10-09T06:58:58.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.464+0000 7f4139199700 1 -- 172.21.15.71:0/1542997169 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413000b7f0 con 0x7f4134159a60 2023-10-09T06:58:58.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.464+0000 7f4139199700 1 -- 172.21.15.71:0/1542997169 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413000bb90 con 0x7f4134159a60 2023-10-09T06:58:58.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.464+0000 7f413b19d700 1 -- 172.21.15.71:0/1542997169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4134159a60 msgr2=0x7f41340c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:58.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.464+0000 7f413b19d700 1 --2- 172.21.15.71:0/1542997169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4134159a60 0x7f41340c9770 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f41340cf6a0 tx=0x7f41300091a0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.465+0000 7f413b19d700 1 -- 172.21.15.71:0/1542997169 shutdown_connections 2023-10-09T06:58:58.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.465+0000 7f413b19d700 1 --2- 172.21.15.71:0/1542997169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4134159a60 0x7f41340c9770 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.465+0000 7f413b19d700 1 --2- 172.21.15.71:0/1542997169 >> v2:172.21.15.179:3300/0 conn(0x7f41340ccc00 0x7f4134069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.465+0000 7f413b19d700 1 -- 172.21.15.71:0/1542997169 >> 172.21.15.71:0/1542997169 conn(0x7f413406baa0 msgr2=0x7f413406bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:58.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.465+0000 7f413b19d700 1 -- 172.21.15.71:0/1542997169 shutdown_connections 2023-10-09T06:58:58.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.465+0000 7f413b19d700 1 -- 172.21.15.71:0/1542997169 wait complete. 2023-10-09T06:58:58.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.466+0000 7f413b19d700 1 Processor -- start 2023-10-09T06:58:58.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.466+0000 7f413b19d700 1 -- start start 2023-10-09T06:58:58.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.467+0000 7f413b19d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f413406a020 0x7f413416a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:58.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.467+0000 7f413b19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41340ccc00 0x7f41340b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:58.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.467+0000 7f413b19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4134159a60 0x7f41340c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:58.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.467+0000 7f413b19d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413416b100 con 0x7f413406a020 2023-10-09T06:58:58.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.467+0000 7f413b19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41340b3350 con 0x7f4134159a60 2023-10-09T06:58:58.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.467+0000 7f413b19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41340b35b0 con 0x7f41340ccc00 2023-10-09T06:58:58.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.467+0000 7f413a19b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f413406a020 0x7f413416a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:58.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.467+0000 7f413a19b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f413406a020 0x7f413416a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47954/0 (socket says 172.21.15.71:47954) 2023-10-09T06:58:58.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.467+0000 7f413a19b700 1 -- 172.21.15.71:0/965926607 learned_addr learned my addr 172.21.15.71:0/965926607 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:58.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.468+0000 7f413a99c700 1 --2- 172.21.15.71:0/965926607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4134159a60 0x7f41340c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:58.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.468+0000 7f413999a700 1 --2- 172.21.15.71:0/965926607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41340ccc00 0x7f41340b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:58.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.468+0000 7f413a19b700 1 -- 172.21.15.71:0/965926607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41340ccc00 msgr2=0x7f41340b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:58.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.468+0000 7f413a19b700 1 --2- 172.21.15.71:0/965926607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41340ccc00 0x7f41340b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.468+0000 7f413a19b700 1 -- 172.21.15.71:0/965926607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4134159a60 msgr2=0x7f41340c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:58.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.468+0000 7f413a19b700 1 --2- 172.21.15.71:0/965926607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4134159a60 0x7f41340c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.468+0000 7f413a19b700 1 -- 172.21.15.71:0/965926607 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4130009420 con 0x7f413406a020 2023-10-09T06:58:58.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.468+0000 7f413999a700 1 --2- 172.21.15.71:0/965926607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41340ccc00 0x7f41340b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:58.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.468+0000 7f413a99c700 1 --2- 172.21.15.71:0/965926607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4134159a60 0x7f41340c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:58:58.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.468+0000 7f413a19b700 1 --2- 172.21.15.71:0/965926607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f413406a020 0x7f413416a920 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f413406cdc0 tx=0x7f4130017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:58.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.468+0000 7f412a7fc700 1 -- 172.21.15.71:0/965926607 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4130011420 con 0x7f413406a020 2023-10-09T06:58:58.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.468+0000 7f412a7fc700 1 -- 172.21.15.71:0/965926607 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4130011580 con 0x7f413406a020 2023-10-09T06:58:58.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.468+0000 7f413b19d700 1 -- 172.21.15.71:0/965926607 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41340b3890 con 0x7f413406a020 2023-10-09T06:58:58.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.468+0000 7f412a7fc700 1 -- 172.21.15.71:0/965926607 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4130011940 con 0x7f413406a020 2023-10-09T06:58:58.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.468+0000 7f413b19d700 1 -- 172.21.15.71:0/965926607 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4134146f10 con 0x7f413406a020 2023-10-09T06:58:58.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.470+0000 7f413b19d700 1 -- 172.21.15.71:0/965926607 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41340b3db0 con 0x7f413406a020 2023-10-09T06:58:58.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.470+0000 7f412a7fc700 1 -- 172.21.15.71:0/965926607 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 41) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f4130011d30 con 0x7f413406a020 2023-10-09T06:58:58.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.471+0000 7f412a7fc700 1 --2- 172.21.15.71:0/965926607 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4118066f80 0x7f4118069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:58.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.471+0000 7f412a7fc700 1 -- 172.21.15.71:0/965926607 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f41300860b0 con 0x7f413406a020 2023-10-09T06:58:58.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.472+0000 7f413999a700 1 -- 172.21.15.71:0/965926607 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4118066f80 msgr2=0x7f4118069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:58.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.472+0000 7f413999a700 1 --2- 172.21.15.71:0/965926607 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4118066f80 0x7f4118069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:58:58.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.476+0000 7f412a7fc700 1 -- 172.21.15.71:0/965926607 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41340b3db0 con 0x7f413406a020 2023-10-09T06:58:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.673+0000 7f413999a700 1 -- 172.21.15.71:0/965926607 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4118066f80 msgr2=0x7f4118069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.673+0000 7f413999a700 1 --2- 172.21.15.71:0/965926607 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4118066f80 0x7f4118069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:58:58.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.676+0000 7f413b19d700 1 -- 172.21.15.71:0/965926607 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f41340b3db0 con 0x7f413406a020 2023-10-09T06:58:58.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.680+0000 7f412a7fc700 1 -- 172.21.15.71:0/965926607 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v36)=0 v36) v1 ==== 133+0+0 (secure 0 0 0) 0x7f41340b3db0 con 0x7f413406a020 2023-10-09T06:58:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.682+0000 7f413b19d700 1 -- 172.21.15.71:0/965926607 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4118066f80 msgr2=0x7f4118069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:58:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.682+0000 7f413b19d700 1 --2- 172.21.15.71:0/965926607 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4118066f80 0x7f4118069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.682+0000 7f413b19d700 1 -- 172.21.15.71:0/965926607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f413406a020 msgr2=0x7f413416a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.682+0000 7f413b19d700 1 --2- 172.21.15.71:0/965926607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f413406a020 0x7f413416a920 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f413406cdc0 tx=0x7f4130017000 comp rx=0 tx=0).stop 2023-10-09T06:58:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.682+0000 7f413b19d700 1 -- 172.21.15.71:0/965926607 shutdown_connections 2023-10-09T06:58:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.682+0000 7f413b19d700 1 --2- 172.21.15.71:0/965926607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4134159a60 0x7f41340c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.682+0000 7f413b19d700 1 --2- 172.21.15.71:0/965926607 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4118066f80 0x7f4118069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.682+0000 7f413b19d700 1 --2- 172.21.15.71:0/965926607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f413406a020 0x7f413416a920 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.682+0000 7f413b19d700 1 --2- 172.21.15.71:0/965926607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41340ccc00 0x7f41340b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.682+0000 7f413b19d700 1 -- 172.21.15.71:0/965926607 >> 172.21.15.71:0/965926607 conn(0x7f413406baa0 msgr2=0x7f41341583a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.682+0000 7f413b19d700 1 -- 172.21.15.71:0/965926607 shutdown_connections 2023-10-09T06:58:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.682+0000 7f413b19d700 1 -- 172.21.15.71:0/965926607 wait complete. 2023-10-09T06:58:58.701 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /bad-path 1M 2023-10-09T06:58:58.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.896+0000 7f903559d700 1 Processor -- start 2023-10-09T06:58:58.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.896+0000 7f903559d700 1 -- start start 2023-10-09T06:58:58.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.898+0000 7f903559d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f90300b0790 0x7f90300cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:58.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.898+0000 7f903559d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f90301591e0 0x7f9030159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:58.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.898+0000 7f903559d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90300cfa00 con 0x7f90300b03c0 2023-10-09T06:58:58.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.898+0000 7f903559d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90300cb580 con 0x7f90301591e0 2023-10-09T06:58:58.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.898+0000 7f903559d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90300cf160 con 0x7f90300b0790 2023-10-09T06:58:58.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.898+0000 7f9034d9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f90301591e0 0x7f9030159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:58.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.898+0000 7f902ffff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f90300b03c0 0x7f90300b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59280/0 (socket says 172.21.15.71:59280) 2023-10-09T06:58:58.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.898+0000 7f902ffff700 1 -- 172.21.15.71:0/3152818872 learned_addr learned my addr 172.21.15.71:0/3152818872 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T06:58:58.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.898+0000 7f902f7fe700 1 --2- 172.21.15.71:0/3152818872 >> v2:172.21.15.179:3300/0 conn(0x7f90300b0790 0x7f90300cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:58.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.898+0000 7f9034d9c700 1 -- 172.21.15.71:0/3152818872 >> v2:172.21.15.179:3300/0 conn(0x7f90300b0790 msgr2=0x7f90300cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:58:58.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.898+0000 7f9034d9c700 1 --2- 172.21.15.71:0/3152818872 >> v2:172.21.15.179:3300/0 conn(0x7f90300b0790 0x7f90300cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.898+0000 7f9034d9c700 1 -- 172.21.15.71:0/3152818872 >> v1:172.21.15.71:6789/0 conn(0x7f90300b03c0 legacy=0x7f90300b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:58.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.898+0000 7f9034d9c700 1 -- 172.21.15.71:0/3152818872 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90300cf440 con 0x7f90301591e0 2023-10-09T06:58:58.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.899+0000 7f9034d9c700 1 --2- 172.21.15.71:0/3152818872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90301591e0 0x7f9030159600 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f9028009e60 tx=0x7f9028009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac5a825e2307749 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:58.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.899+0000 7f902effd700 1 -- 172.21.15.71:0/3152818872 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902800e070 con 0x7f90301591e0 2023-10-09T06:58:58.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.899+0000 7f902effd700 1 -- 172.21.15.71:0/3152818872 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902800bb20 con 0x7f90301591e0 2023-10-09T06:58:58.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.899+0000 7f902effd700 1 -- 172.21.15.71:0/3152818872 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9028012430 con 0x7f90301591e0 2023-10-09T06:58:58.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.900+0000 7f903559d700 1 -- 172.21.15.71:0/3152818872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90301591e0 msgr2=0x7f9030159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:58.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.900+0000 7f903559d700 1 --2- 172.21.15.71:0/3152818872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90301591e0 0x7f9030159600 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f9028009e60 tx=0x7f9028009780 comp rx=0 tx=0).stop 2023-10-09T06:58:58.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.900+0000 7f903559d700 1 -- 172.21.15.71:0/3152818872 shutdown_connections 2023-10-09T06:58:58.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.900+0000 7f903559d700 1 --2- 172.21.15.71:0/3152818872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90301591e0 0x7f9030159600 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.900+0000 7f903559d700 1 --2- 172.21.15.71:0/3152818872 >> v2:172.21.15.179:3300/0 conn(0x7f90300b0790 0x7f90300cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.900+0000 7f903559d700 1 -- 172.21.15.71:0/3152818872 >> 172.21.15.71:0/3152818872 conn(0x7f9030063230 msgr2=0x7f9030063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:58:58.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.900+0000 7f903559d700 1 -- 172.21.15.71:0/3152818872 shutdown_connections 2023-10-09T06:58:58.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.900+0000 7f903559d700 1 -- 172.21.15.71:0/3152818872 wait complete. 2023-10-09T06:58:58.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.901+0000 7f903559d700 1 Processor -- start 2023-10-09T06:58:58.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.901+0000 7f903559d700 1 -- start start 2023-10-09T06:58:58.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.902+0000 7f903559d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90300b03c0 0x7f903015a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:58.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.902+0000 7f903559d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90300b0790 0x7f90300c5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:58.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.902+0000 7f903559d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90301591e0 0x7f9030158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:58.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.902+0000 7f903559d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90300c5570 con 0x7f90300b03c0 2023-10-09T06:58:58.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.902+0000 7f903559d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90300c59a0 con 0x7f90301591e0 2023-10-09T06:58:58.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.902+0000 7f903559d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9030158f60 con 0x7f90300b0790 2023-10-09T06:58:58.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.902+0000 7f902ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90300b03c0 0x7f903015a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:58.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.902+0000 7f902ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90300b03c0 0x7f903015a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47970/0 (socket says 172.21.15.71:47970) 2023-10-09T06:58:58.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.902+0000 7f902ffff700 1 -- 172.21.15.71:0/1096196061 learned_addr learned my addr 172.21.15.71:0/1096196061 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:58:58.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.902+0000 7f9034d9c700 1 --2- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90301591e0 0x7f9030158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:58.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.902+0000 7f902f7fe700 1 --2- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90300b0790 0x7f90300c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:58:58.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.903+0000 7f902ffff700 1 -- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90300b0790 msgr2=0x7f90300c5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:58.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.903+0000 7f902ffff700 1 --2- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90300b0790 0x7f90300c5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.903+0000 7f902ffff700 1 -- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90301591e0 msgr2=0x7f9030158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:58:58.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.903+0000 7f902ffff700 1 --2- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90301591e0 0x7f9030158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:58:58.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.903+0000 7f902ffff700 1 -- 172.21.15.71:0/1096196061 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9028009a20 con 0x7f90300b03c0 2023-10-09T06:58:58.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.903+0000 7f902ffff700 1 --2- 172.21.15.71:0/1096196061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90300b03c0 0x7f903015a570 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f902000c560 tx=0x7f9020001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:58:58.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.903+0000 7f9017fff700 1 -- 172.21.15.71:0/1096196061 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020005b30 con 0x7f90300b03c0 2023-10-09T06:58:58.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.903+0000 7f9017fff700 1 -- 172.21.15.71:0/1096196061 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9020005cb0 con 0x7f90300b03c0 2023-10-09T06:58:58.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.903+0000 7f903559d700 1 -- 172.21.15.71:0/1096196061 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f903015cd30 con 0x7f90300b03c0 2023-10-09T06:58:58.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.903+0000 7f9017fff700 1 -- 172.21.15.71:0/1096196061 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020007320 con 0x7f90300b03c0 2023-10-09T06:58:58.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.903+0000 7f903559d700 1 -- 172.21.15.71:0/1096196061 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903015cfd0 con 0x7f90300b03c0 2023-10-09T06:58:58.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.905+0000 7f903559d700 1 -- 172.21.15.71:0/1096196061 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903004c3c0 con 0x7f90300b03c0 2023-10-09T06:58:58.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.905+0000 7f9017fff700 1 -- 172.21.15.71:0/1096196061 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 41) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f902001b3b0 con 0x7f90300b03c0 2023-10-09T06:58:58.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.906+0000 7f9017fff700 1 --2- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f901c066f80 0x7f901c069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:58:58.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.906+0000 7f9017fff700 1 -- 172.21.15.71:0/1096196061 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f9020083ab0 con 0x7f90300b03c0 2023-10-09T06:58:58.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.906+0000 7f902f7fe700 1 -- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f901c066f80 msgr2=0x7f901c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:58.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.907+0000 7f902f7fe700 1 --2- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f901c066f80 0x7f901c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T06:58:58.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:58.911+0000 7f9017fff700 1 -- 172.21.15.71:0/1096196061 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9020050af0 con 0x7f90300b03c0 2023-10-09T06:58:59.088 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:59.088+0000 7f15a448b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T06:58:59.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:59.108+0000 7f902f7fe700 1 -- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f901c066f80 msgr2=0x7f901c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:59.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:59.108+0000 7f902f7fe700 1 --2- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f901c066f80 0x7f901c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T06:58:59.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:59.134+0000 7f903559d700 1 -- 172.21.15.71:0/1096196061 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f90300c5780 con 0x7f901c066f80 2023-10-09T06:58:59.147 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:59.146+0000 7fd53085b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T06:58:59.250 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:59.250+0000 7f15a448b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T06:58:59.314 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:59.313+0000 7fd53085b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T06:58:59.338 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:59.337+0000 7f15a448b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T06:58:59.399 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:59.398+0000 7fd53085b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T06:58:59.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:59.509+0000 7f902f7fe700 1 -- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f901c066f80 msgr2=0x7f901c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:58:59.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:58:59.509+0000 7f902f7fe700 1 --2- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f901c066f80 0x7f901c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T06:58:59.562 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:59.561+0000 7f15a448b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:58:59.625 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:59.624+0000 7fd53085b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:58:59.738 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:59.738+0000 7f15a448b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T06:58:59.804 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:59.803+0000 7fd53085b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T06:58:59.833 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:59.831+0000 7f15a448b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T06:58:59.897 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:58:59.896+0000 7fd53085b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T06:58:59.995 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:58:59.994+0000 7f15a448b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T06:59:00.057 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:59:00.056+0000 7fd53085b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T06:59:00.095 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:00.094+0000 7f15a448b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T06:59:00.157 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:59:00.156+0000 7fd53085b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T06:59:00.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:00.310+0000 7f902f7fe700 1 -- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f901c066f80 msgr2=0x7f901c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:59:00.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:00.310+0000 7f902f7fe700 1 --2- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f901c066f80 0x7f901c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T06:59:00.576 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:00.575+0000 7f15a448b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T06:59:00.640 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:59:00.639+0000 7fd53085b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T06:59:00.670 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:00.669+0000 7f15a448b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T06:59:00.732 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:59:00.731+0000 7fd53085b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T06:59:00.758 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:00.757+0000 7f15a448b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T06:59:00.822 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:59:00.821+0000 7fd53085b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T06:59:01.378 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:01.377+0000 7f15a448b180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T06:59:01.443 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:59:01.443+0000 7fd53085b180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T06:59:01.549 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:01.548+0000 7f15a448b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:59:01.616 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:59:01.615+0000 7fd53085b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T06:59:01.645 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:01.643+0000 7f15a448b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T06:59:01.712 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:59:01.711+0000 7fd53085b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T06:59:01.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:01.911+0000 7f902f7fe700 1 -- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f901c066f80 msgr2=0x7f901c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T06:59:01.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:01.911+0000 7f902f7fe700 1 --2- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f901c066f80 0x7f901c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-09T06:59:01.937 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:01.936+0000 7f15a448b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T06:59:02.005 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:59:02.004+0000 7fd53085b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T06:59:02.032 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:02.030+0000 7f15a448b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T06:59:02.100 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:59:02.099+0000 7fd53085b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T06:59:02.668 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:59:02.673 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:59:02.732 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:02.730+0000 7f15a448b180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T06:59:02.808 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:59:02.807+0000 7fd53085b180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T06:59:03.020 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:03.019+0000 7f15a448b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T06:59:03.093 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:59:03.093+0000 7fd53085b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T06:59:03.112 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:03.110+0000 7f15a448b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T06:59:03.186 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:59:03.185+0000 7fd53085b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T06:59:03.263 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:03.261+0000 7f15a448b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T06:59:03.338 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:59:03.337+0000 7fd53085b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T06:59:03.367 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:03.365+0000 7f15a448b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T06:59:03.442 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:59:03.441+0000 7fd53085b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T06:59:03.555 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:03.553+0000 7f15a448b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T06:59:03.630 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:59:03.629+0000 7fd53085b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T06:59:03.646 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:03.645+0000 7f15a448b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T06:59:03.721 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:59:03.721+0000 7fd53085b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T06:59:03.737 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:03.735+0000 7f15a448b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T06:59:03.813 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:59:03.812+0000 7fd53085b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T06:59:03.830 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:03.829+0000 7f15a448b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T06:59:03.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:03.840+0000 7f9017fff700 1 -- 172.21.15.71:0/1096196061 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 42) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f9020050ec0 con 0x7f90300b03c0 2023-10-09T06:59:03.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:03.841+0000 7f9017fff700 1 -- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f901c066f80 msgr2=0x7f901c069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T06:59:03.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:03.841+0000 7f9017fff700 1 --2- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f901c066f80 0x7f901c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:59:03.919 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T06:59:03.918+0000 7fd53085b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T06:59:03.963 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:03.961+0000 7f1519777700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:59:03.964 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:03.961+0000 7f1519777700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:59:03.964 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:03.961+0000 7f1519777700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:59:03.964 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:03.961+0000 7f1519777700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:59:03.964 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:03.961+0000 7f1519777700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:59:03.964 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:03.962+0000 7f1515f70700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:59:03.964 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:03.962+0000 7f1515f70700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:59:03.964 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:03.962+0000 7f1515f70700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:59:03.964 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:03.962+0000 7f1515f70700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:59:03.964 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T06:59:03.962+0000 7f1515f70700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T06:59:04.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:04.845+0000 7f9017fff700 1 -- 172.21.15.71:0/1096196061 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mgrmap(e 43) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f902001bcf0 con 0x7f90300b03c0 2023-10-09T06:59:04.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:04.845+0000 7f9017fff700 1 --2- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f901c066f80 0x7f901c0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:59:04.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:04.845+0000 7f9017fff700 1 -- 172.21.15.71:0/1096196061 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f90300c5780 con 0x7f901c066f80 2023-10-09T06:59:04.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:04.849+0000 7f902f7fe700 1 --2- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f901c066f80 0x7f901c0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:59:04.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:04.851+0000 7f902f7fe700 1 --2- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f901c066f80 0x7f901c0693b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f90301605d0 tx=0x7f90240091a0 comp rx=0 tx=0).ready entity=mgr.6260 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:59:04.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:04.923+0000 7f9017fff700 1 -- 172.21.15.71:0/1096196061 <== mgr.6260 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f90300c5780 con 0x7f901c066f80 2023-10-09T06:59:04.924 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule set for path /bad-path 2023-10-09T06:59:04.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:04.925+0000 7f903559d700 1 -- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f901c066f80 msgr2=0x7f901c0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:59:04.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:04.925+0000 7f903559d700 1 --2- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f901c066f80 0x7f901c0693b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f90301605d0 tx=0x7f90240091a0 comp rx=0 tx=0).stop 2023-10-09T06:59:04.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:04.925+0000 7f903559d700 1 -- 172.21.15.71:0/1096196061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90300b03c0 msgr2=0x7f903015a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:59:04.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:04.925+0000 7f903559d700 1 --2- 172.21.15.71:0/1096196061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90300b03c0 0x7f903015a570 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f902000c560 tx=0x7f9020001020 comp rx=0 tx=0).stop 2023-10-09T06:59:04.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:04.925+0000 7f903559d700 1 -- 172.21.15.71:0/1096196061 shutdown_connections 2023-10-09T06:59:04.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:04.925+0000 7f903559d700 1 --2- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90301591e0 0x7f9030158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:59:04.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:04.925+0000 7f903559d700 1 --2- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f901c066f80 0x7f901c0693b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:59:04.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:04.925+0000 7f903559d700 1 --2- 172.21.15.71:0/1096196061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90300b03c0 0x7f903015a570 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:59:04.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:04.925+0000 7f903559d700 1 --2- 172.21.15.71:0/1096196061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90300b0790 0x7f90300c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:59:04.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:04.925+0000 7f903559d700 1 -- 172.21.15.71:0/1096196061 >> 172.21.15.71:0/1096196061 conn(0x7f9030063230 msgr2=0x7f90300d0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:59:04.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:04.925+0000 7f903559d700 1 -- 172.21.15.71:0/1096196061 shutdown_connections 2023-10-09T06:59:04.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:04.925+0000 7f903559d700 1 -- 172.21.15.71:0/1096196061 wait complete. 2023-10-09T06:59:04.944 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /bad-path 2023-10-09T06:59:04.944 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-10-09T06:59:05.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.129+0000 7efdcf7ff700 1 Processor -- start 2023-10-09T06:59:05.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.129+0000 7efdcf7ff700 1 -- start start 2023-10-09T06:59:05.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.130+0000 7efdcf7ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7efdc8157740 0x7efdc80adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:59:05.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.130+0000 7efdcf7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc80b2100 0x7efdc8068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:59:05.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.130+0000 7efdcf7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc806dc20 con 0x7efdc80688d0 2023-10-09T06:59:05.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.130+0000 7efdcf7ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc80acc00 con 0x7efdc8157740 2023-10-09T06:59:05.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.130+0000 7efdcf7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc806d6a0 con 0x7efdc80b2100 2023-10-09T06:59:05.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.130+0000 7efdcd59b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7efdc8157740 0x7efdc80adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:59:05.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.130+0000 7efdcd59b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7efdc8157740 0x7efdc80adfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54876/0 (socket says 172.21.15.71:54876) 2023-10-09T06:59:05.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.130+0000 7efdcd59b700 1 -- 172.21.15.71:0/3937626040 learned_addr learned my addr 172.21.15.71:0/3937626040 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:59:05.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.131+0000 7efdccd9a700 1 --2- 172.21.15.71:0/3937626040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc80b2100 0x7efdc8068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:59:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.131+0000 7efdcd59b700 1 -- 172.21.15.71:0/3937626040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc80b2100 msgr2=0x7efdc8068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T06:59:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.131+0000 7efdcd59b700 1 --2- 172.21.15.71:0/3937626040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc80b2100 0x7efdc8068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:59:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.131+0000 7efdcd59b700 1 -- 172.21.15.71:0/3937626040 >> v1:172.21.15.179:6789/0 conn(0x7efdc80688d0 legacy=0x7efdc8069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:59:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.131+0000 7efdcd59b700 1 -- 172.21.15.71:0/3937626040 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc80ae910 con 0x7efdc8157740 2023-10-09T06:59:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.131+0000 7efdcd59b700 1 --2- 172.21.15.71:0/3937626040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdc8157740 0x7efdc80adfc0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7efdc40099b0 tx=0x7efdc4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbcc636f5ffaa126 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:59:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.131+0000 7efdbffff700 1 -- 172.21.15.71:0/3937626040 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc4009ea0 con 0x7efdc8157740 2023-10-09T06:59:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.131+0000 7efdbffff700 1 -- 172.21.15.71:0/3937626040 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc400b860 con 0x7efdc8157740 2023-10-09T06:59:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.131+0000 7efdbffff700 1 -- 172.21.15.71:0/3937626040 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc400bc00 con 0x7efdc8157740 2023-10-09T06:59:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.132+0000 7efdcf7ff700 1 -- 172.21.15.71:0/3937626040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdc8157740 msgr2=0x7efdc80adfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:59:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.132+0000 7efdcf7ff700 1 --2- 172.21.15.71:0/3937626040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdc8157740 0x7efdc80adfc0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7efdc40099b0 tx=0x7efdc4009250 comp rx=0 tx=0).stop 2023-10-09T06:59:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.132+0000 7efdcf7ff700 1 -- 172.21.15.71:0/3937626040 shutdown_connections 2023-10-09T06:59:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.132+0000 7efdcf7ff700 1 --2- 172.21.15.71:0/3937626040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdc8157740 0x7efdc80adfc0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:59:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.132+0000 7efdcf7ff700 1 --2- 172.21.15.71:0/3937626040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc80b2100 0x7efdc8068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:59:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.132+0000 7efdcf7ff700 1 -- 172.21.15.71:0/3937626040 >> 172.21.15.71:0/3937626040 conn(0x7efdc80c8f90 msgr2=0x7efdc80c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:59:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.132+0000 7efdcf7ff700 1 -- 172.21.15.71:0/3937626040 shutdown_connections 2023-10-09T06:59:05.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.132+0000 7efdcf7ff700 1 -- 172.21.15.71:0/3937626040 wait complete. 2023-10-09T06:59:05.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.134+0000 7efdcf7ff700 1 Processor -- start 2023-10-09T06:59:05.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.134+0000 7efdcf7ff700 1 -- start start 2023-10-09T06:59:05.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.135+0000 7efdcf7ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdc80688d0 0x7efdc80af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:59:05.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.135+0000 7efdcf7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc80b2100 0x7efdc80aba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:59:05.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.135+0000 7efdcf7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc8157740 0x7efdc8169b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:59:05.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.135+0000 7efdcf7ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc815c4c0 con 0x7efdc80688d0 2023-10-09T06:59:05.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.135+0000 7efdcf7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc80afbd0 con 0x7efdc80b2100 2023-10-09T06:59:05.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.135+0000 7efdcf7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc80afeb0 con 0x7efdc8157740 2023-10-09T06:59:05.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.135+0000 7efdcd59b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdc80688d0 0x7efdc80af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:59:05.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.135+0000 7efdcd59b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdc80688d0 0x7efdc80af2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54880/0 (socket says 172.21.15.71:54880) 2023-10-09T06:59:05.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.135+0000 7efdcd59b700 1 -- 172.21.15.71:0/2495270326 learned_addr learned my addr 172.21.15.71:0/2495270326 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T06:59:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.135+0000 7efdccd9a700 1 --2- 172.21.15.71:0/2495270326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc80b2100 0x7efdc80aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:59:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.135+0000 7efdcdd9c700 1 --2- 172.21.15.71:0/2495270326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc8157740 0x7efdc8169b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:59:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.135+0000 7efdcd59b700 1 -- 172.21.15.71:0/2495270326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc8157740 msgr2=0x7efdc8169b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:59:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.135+0000 7efdcd59b700 1 --2- 172.21.15.71:0/2495270326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc8157740 0x7efdc8169b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:59:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.135+0000 7efdcd59b700 1 -- 172.21.15.71:0/2495270326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc80b2100 msgr2=0x7efdc80aba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:59:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.135+0000 7efdcd59b700 1 --2- 172.21.15.71:0/2495270326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc80b2100 0x7efdc80aba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:59:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.135+0000 7efdcd59b700 1 -- 172.21.15.71:0/2495270326 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc40094f0 con 0x7efdc80688d0 2023-10-09T06:59:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.135+0000 7efdccd9a700 1 --2- 172.21.15.71:0/2495270326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc80b2100 0x7efdc80aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T06:59:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.136+0000 7efdcd59b700 1 --2- 172.21.15.71:0/2495270326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdc80688d0 0x7efdc80af2d0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7efdc806b890 tx=0x7efdc4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:59:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.136+0000 7efdbd7fa700 1 -- 172.21.15.71:0/2495270326 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc400bbe0 con 0x7efdc80688d0 2023-10-09T06:59:05.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.136+0000 7efdbd7fa700 1 -- 172.21.15.71:0/2495270326 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc4011420 con 0x7efdc80688d0 2023-10-09T06:59:05.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.136+0000 7efdbd7fa700 1 -- 172.21.15.71:0/2495270326 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc40117c0 con 0x7efdc80688d0 2023-10-09T06:59:05.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.136+0000 7efdcf7ff700 1 -- 172.21.15.71:0/2495270326 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc80b0190 con 0x7efdc80688d0 2023-10-09T06:59:05.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.136+0000 7efdcf7ff700 1 -- 172.21.15.71:0/2495270326 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc80af810 con 0x7efdc80688d0 2023-10-09T06:59:05.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.137+0000 7efdcf7ff700 1 -- 172.21.15.71:0/2495270326 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc80718b0 con 0x7efdc80688d0 2023-10-09T06:59:05.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.138+0000 7efdbd7fa700 1 -- 172.21.15.71:0/2495270326 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 43) v1 ==== 84595+0+0 (secure 0 0 0) 0x7efdc4011bf0 con 0x7efdc80688d0 2023-10-09T06:59:05.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.139+0000 7efdbd7fa700 1 --2- 172.21.15.71:0/2495270326 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7efdac066dd0 0x7efdac069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T06:59:05.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.139+0000 7efdbd7fa700 1 -- 172.21.15.71:0/2495270326 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6355+0+0 (secure 0 0 0) 0x7efdc4085e60 con 0x7efdc80688d0 2023-10-09T06:59:05.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.139+0000 7efdccd9a700 1 --2- 172.21.15.71:0/2495270326 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7efdac066dd0 0x7efdac069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T06:59:05.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.140+0000 7efdccd9a700 1 --2- 172.21.15.71:0/2495270326 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7efdac066dd0 0x7efdac069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efdc815f540 tx=0x7efdb8008040 comp rx=0 tx=0).ready entity=mgr.6260 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T06:59:05.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.143+0000 7efdbd7fa700 1 -- 172.21.15.71:0/2495270326 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efdc40530f0 con 0x7efdc80688d0 2023-10-09T06:59:05.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.356+0000 7efdcf7ff700 1 -- 172.21.15.71:0/2495270326 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efdc815c600 con 0x7efdac066dd0 2023-10-09T06:59:05.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.367+0000 7efdbd7fa700 1 -- 172.21.15.71:0/2495270326 <== mgr.6260 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+287 (secure 0 0 0) 0x7efdb8009aa0 con 0x7efdac066dd0 2023-10-09T06:59:05.368 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T06:59:05.368 INFO:teuthology.orchestra.run.smithi071.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:59:04", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-10-09T06:59:05.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.369+0000 7efdcf7ff700 1 -- 172.21.15.71:0/2495270326 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7efdac066dd0 msgr2=0x7efdac069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:59:05.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.369+0000 7efdcf7ff700 1 --2- 172.21.15.71:0/2495270326 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7efdac066dd0 0x7efdac069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efdc815f540 tx=0x7efdb8008040 comp rx=0 tx=0).stop 2023-10-09T06:59:05.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.369+0000 7efdcf7ff700 1 -- 172.21.15.71:0/2495270326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdc80688d0 msgr2=0x7efdc80af2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T06:59:05.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.369+0000 7efdcf7ff700 1 --2- 172.21.15.71:0/2495270326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdc80688d0 0x7efdc80af2d0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7efdc806b890 tx=0x7efdc4017000 comp rx=0 tx=0).stop 2023-10-09T06:59:05.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.369+0000 7efdcf7ff700 1 -- 172.21.15.71:0/2495270326 shutdown_connections 2023-10-09T06:59:05.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.369+0000 7efdcf7ff700 1 --2- 172.21.15.71:0/2495270326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc8157740 0x7efdc8169b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:59:05.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.369+0000 7efdcf7ff700 1 --2- 172.21.15.71:0/2495270326 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7efdac066dd0 0x7efdac069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:59:05.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.369+0000 7efdcf7ff700 1 --2- 172.21.15.71:0/2495270326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdc80688d0 0x7efdc80af2d0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:59:05.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.369+0000 7efdcf7ff700 1 --2- 172.21.15.71:0/2495270326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc80b2100 0x7efdc80aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T06:59:05.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.369+0000 7efdcf7ff700 1 -- 172.21.15.71:0/2495270326 >> 172.21.15.71:0/2495270326 conn(0x7efdc80c8f90 msgr2=0x7efdc806ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T06:59:05.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.370+0000 7efdcf7ff700 1 -- 172.21.15.71:0/2495270326 shutdown_connections 2023-10-09T06:59:05.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T06:59:05.370+0000 7efdcf7ff700 1 -- 172.21.15.71:0/2495270326 wait complete. 2023-10-09T06:59:05.388 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:59:04", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-10-09T06:59:32.821 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T06:59:32.826 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:00:00.937 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:00.935+0000 7f1508f56700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:00.937 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:00.935+0000 7f1508f56700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:00.937 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:00.935+0000 7f1508f56700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:00.937 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:00.935+0000 7f1508f56700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:00.937 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:00.935+0000 7f1508f56700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:02.921 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:00:02.927 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:00:05.390 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-10-09T07:00:05.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.585+0000 7f0ef31ff700 1 Processor -- start 2023-10-09T07:00:05.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.585+0000 7f0ef31ff700 1 -- start start 2023-10-09T07:00:05.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.586+0000 7f0ef31ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0eec1563b0 0x7f0eec156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:05.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.586+0000 7f0ef31ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0eec15a440 0x7f0eec0acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:05.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.586+0000 7f0ef31ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eec15a9b0 con 0x7f0eec068890 2023-10-09T07:00:05.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.586+0000 7f0ef31ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eec15ac90 con 0x7f0eec15a440 2023-10-09T07:00:05.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.586+0000 7f0ef31ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eec15af70 con 0x7f0eec1563b0 2023-10-09T07:00:05.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.587+0000 7f0eebfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0eec15a440 0x7f0eec0acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:05.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.587+0000 7f0ef179c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f0eec068890 0x7f0eec0c8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56172/0 (socket says 172.21.15.71:56172) 2023-10-09T07:00:05.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.587+0000 7f0ef179c700 1 -- 172.21.15.71:0/3164047849 learned_addr learned my addr 172.21.15.71:0/3164047849 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:05.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.587+0000 7f0ef0f9b700 1 --2- 172.21.15.71:0/3164047849 >> v2:172.21.15.179:3300/0 conn(0x7f0eec1563b0 0x7f0eec156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:05.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.587+0000 7f0eebfff700 1 -- 172.21.15.71:0/3164047849 >> v2:172.21.15.179:3300/0 conn(0x7f0eec1563b0 msgr2=0x7f0eec156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:05.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.587+0000 7f0eebfff700 1 --2- 172.21.15.71:0/3164047849 >> v2:172.21.15.179:3300/0 conn(0x7f0eec1563b0 0x7f0eec156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:05.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.587+0000 7f0eebfff700 1 -- 172.21.15.71:0/3164047849 >> v1:172.21.15.71:6789/0 conn(0x7f0eec068890 legacy=0x7f0eec0c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:05.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.587+0000 7f0eebfff700 1 -- 172.21.15.71:0/3164047849 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec15b250 con 0x7f0eec15a440 2023-10-09T07:00:05.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.587+0000 7f0eeb7fe700 1 -- 172.21.15.71:0/3164047849 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4212240741 0 0) 0x7f0eec15a9b0 con 0x7f0eec068890 2023-10-09T07:00:05.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.587+0000 7f0eebfff700 1 --2- 172.21.15.71:0/3164047849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eec15a440 0x7f0eec0acf30 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f0eec06a9f0 tx=0x7f0ed80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f095ab3021e94b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:05.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.588+0000 7f0eeb7fe700 1 -- 172.21.15.71:0/3164047849 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed800b6b0 con 0x7f0eec15a440 2023-10-09T07:00:05.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.588+0000 7f0eeb7fe700 1 -- 172.21.15.71:0/3164047849 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed800b810 con 0x7f0eec15a440 2023-10-09T07:00:05.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.588+0000 7f0eeb7fe700 1 -- 172.21.15.71:0/3164047849 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed800bbb0 con 0x7f0eec15a440 2023-10-09T07:00:05.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.588+0000 7f0ef31ff700 1 -- 172.21.15.71:0/3164047849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eec15a440 msgr2=0x7f0eec0acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:05.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.588+0000 7f0ef31ff700 1 --2- 172.21.15.71:0/3164047849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eec15a440 0x7f0eec0acf30 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f0eec06a9f0 tx=0x7f0ed80091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:05.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.588+0000 7f0ef31ff700 1 -- 172.21.15.71:0/3164047849 shutdown_connections 2023-10-09T07:00:05.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.588+0000 7f0ef31ff700 1 --2- 172.21.15.71:0/3164047849 >> v2:172.21.15.179:3300/0 conn(0x7f0eec1563b0 0x7f0eec156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:05.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.588+0000 7f0ef31ff700 1 --2- 172.21.15.71:0/3164047849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eec15a440 0x7f0eec0acf30 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:05.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.588+0000 7f0ef31ff700 1 -- 172.21.15.71:0/3164047849 >> 172.21.15.71:0/3164047849 conn(0x7f0eec0c8f90 msgr2=0x7f0eec0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:05.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.588+0000 7f0ef31ff700 1 -- 172.21.15.71:0/3164047849 shutdown_connections 2023-10-09T07:00:05.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.588+0000 7f0ef31ff700 1 -- 172.21.15.71:0/3164047849 wait complete. 2023-10-09T07:00:05.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.590+0000 7f0ef31ff700 1 Processor -- start 2023-10-09T07:00:05.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.590+0000 7f0ef31ff700 1 -- start start 2023-10-09T07:00:05.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.591+0000 7f0ef31ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eec068890 0x7f0eec14a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:05.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.591+0000 7f0ef31ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0eec1563b0 0x7f0eec0afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:05.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.591+0000 7f0ef31ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eec15a440 0x7f0eec0cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:05.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.591+0000 7f0ef31ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec14ae90 con 0x7f0eec15a440 2023-10-09T07:00:05.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.591+0000 7f0ef31ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec16df60 con 0x7f0eec1563b0 2023-10-09T07:00:05.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.591+0000 7f0ef31ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec0af400 con 0x7f0eec068890 2023-10-09T07:00:05.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.591+0000 7f0ef179c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eec15a440 0x7f0eec0cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:05.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.591+0000 7f0ef179c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eec15a440 0x7f0eec0cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34544/0 (socket says 172.21.15.71:34544) 2023-10-09T07:00:05.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.591+0000 7f0ef179c700 1 -- 172.21.15.71:0/155667441 learned_addr learned my addr 172.21.15.71:0/155667441 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:05.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.591+0000 7f0eebfff700 1 --2- 172.21.15.71:0/155667441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0eec1563b0 0x7f0eec0afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:05.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.591+0000 7f0ef0f9b700 1 --2- 172.21.15.71:0/155667441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eec068890 0x7f0eec14a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:05.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.592+0000 7f0ef179c700 1 -- 172.21.15.71:0/155667441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eec068890 msgr2=0x7f0eec14a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:05.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.592+0000 7f0ef179c700 1 --2- 172.21.15.71:0/155667441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eec068890 0x7f0eec14a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:05.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.592+0000 7f0ef179c700 1 -- 172.21.15.71:0/155667441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0eec1563b0 msgr2=0x7f0eec0afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:05.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.592+0000 7f0ef179c700 1 --2- 172.21.15.71:0/155667441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0eec1563b0 0x7f0eec0afee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:05.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.592+0000 7f0ef179c700 1 -- 172.21.15.71:0/155667441 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed8009420 con 0x7f0eec15a440 2023-10-09T07:00:05.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.592+0000 7f0ef179c700 1 --2- 172.21.15.71:0/155667441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eec15a440 0x7f0eec0cb4b0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400cc90 tx=0x7f0ee4001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:05.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.592+0000 7f0ee8ff9700 1 -- 172.21.15.71:0/155667441 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee400cea0 con 0x7f0eec15a440 2023-10-09T07:00:05.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.592+0000 7f0ee8ff9700 1 -- 172.21.15.71:0/155667441 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee400ab70 con 0x7f0eec15a440 2023-10-09T07:00:05.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.592+0000 7f0ef31ff700 1 -- 172.21.15.71:0/155667441 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eec0af6e0 con 0x7f0eec15a440 2023-10-09T07:00:05.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.592+0000 7f0ee8ff9700 1 -- 172.21.15.71:0/155667441 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee40070f0 con 0x7f0eec15a440 2023-10-09T07:00:05.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.592+0000 7f0ef31ff700 1 -- 172.21.15.71:0/155667441 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eec0cb9f0 con 0x7f0eec15a440 2023-10-09T07:00:05.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.593+0000 7f0ef31ff700 1 -- 172.21.15.71:0/155667441 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eec0718b0 con 0x7f0eec15a440 2023-10-09T07:00:05.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.594+0000 7f0ee8ff9700 1 -- 172.21.15.71:0/155667441 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 45) v1 ==== 84973+0+0 (secure 0 0 0) 0x7f0ee40074a0 con 0x7f0eec15a440 2023-10-09T07:00:05.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.595+0000 7f0ee8ff9700 1 --2- 172.21.15.71:0/155667441 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0ed00671c0 0x7f0ed0069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:05.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.596+0000 7f0ee8ff9700 1 -- 172.21.15.71:0/155667441 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6384+0+0 (secure 0 0 0) 0x7f0ee4085010 con 0x7f0eec15a440 2023-10-09T07:00:05.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.596+0000 7f0ef0f9b700 1 --2- 172.21.15.71:0/155667441 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0ed00671c0 0x7f0ed0069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:05.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.597+0000 7f0ef0f9b700 1 --2- 172.21.15.71:0/155667441 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0ed00671c0 0x7f0ed0069670 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0006fd0 tx=0x7f0ee0008040 comp rx=0 tx=0).ready entity=mgr.6260 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:05.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.600+0000 7f0ee8ff9700 1 -- 172.21.15.71:0/155667441 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ee4051dd0 con 0x7f0eec15a440 2023-10-09T07:00:05.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.816+0000 7f0ef31ff700 1 -- 172.21.15.71:0/155667441 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0eec06d6a0 con 0x7f0ed00671c0 2023-10-09T07:00:05.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.827+0000 7f0ee8ff9700 1 -- 172.21.15.71:0/155667441 <== mgr.6260 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+288 (secure 0 0 0) 0x7f0eec06d6a0 con 0x7f0ed00671c0 2023-10-09T07:00:05.828 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:00:05.828 INFO:teuthology.orchestra.run.smithi071.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:59:04", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-10-09T07:00:05.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.829+0000 7f0ef31ff700 1 -- 172.21.15.71:0/155667441 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0ed00671c0 msgr2=0x7f0ed0069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:05.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.829+0000 7f0ef31ff700 1 --2- 172.21.15.71:0/155667441 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0ed00671c0 0x7f0ed0069670 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0006fd0 tx=0x7f0ee0008040 comp rx=0 tx=0).stop 2023-10-09T07:00:05.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.829+0000 7f0ef31ff700 1 -- 172.21.15.71:0/155667441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eec15a440 msgr2=0x7f0eec0cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:05.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.829+0000 7f0ef31ff700 1 --2- 172.21.15.71:0/155667441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eec15a440 0x7f0eec0cb4b0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400cc90 tx=0x7f0ee4001a80 comp rx=0 tx=0).stop 2023-10-09T07:00:05.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.829+0000 7f0ef31ff700 1 -- 172.21.15.71:0/155667441 shutdown_connections 2023-10-09T07:00:05.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.829+0000 7f0ef31ff700 1 --2- 172.21.15.71:0/155667441 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0ed00671c0 0x7f0ed0069670 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:05.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.829+0000 7f0ef31ff700 1 --2- 172.21.15.71:0/155667441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eec15a440 0x7f0eec0cb4b0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:05.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.829+0000 7f0ef31ff700 1 --2- 172.21.15.71:0/155667441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eec068890 0x7f0eec14a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:05.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.829+0000 7f0ef31ff700 1 --2- 172.21.15.71:0/155667441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0eec1563b0 0x7f0eec0afee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:05.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.829+0000 7f0ef31ff700 1 -- 172.21.15.71:0/155667441 >> 172.21.15.71:0/155667441 conn(0x7f0eec0c8f90 msgr2=0x7f0eec0ae7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:05.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.829+0000 7f0ef31ff700 1 -- 172.21.15.71:0/155667441 shutdown_connections 2023-10-09T07:00:05.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:05.829+0000 7f0ef31ff700 1 -- 172.21.15.71:0/155667441 wait complete. 2023-10-09T07:00:05.847 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T06:59:04", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-10-09T07:00:05.848 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /bad-path 2023-10-09T07:00:06.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.033+0000 7f4e343ff700 1 Processor -- start 2023-10-09T07:00:06.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.033+0000 7f4e343ff700 1 -- start start 2023-10-09T07:00:06.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.034+0000 7f4e343ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4e2c1563b0 0x7f4e2c156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:06.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.034+0000 7f4e343ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e2c068890 0x7f4e2c0c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:06.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.035+0000 7f4e343ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e2c15a9b0 con 0x7f4e2c15a440 2023-10-09T07:00:06.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.035+0000 7f4e343ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e2c15ac90 con 0x7f4e2c1563b0 2023-10-09T07:00:06.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.035+0000 7f4e343ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c15af70 con 0x7f4e2c068890 2023-10-09T07:00:06.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.035+0000 7f4e3299c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e2c068890 0x7f4e2c0c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:06.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.035+0000 7f4e3299c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e2c068890 0x7f4e2c0c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:54990/0 (socket says 172.21.15.71:54990) 2023-10-09T07:00:06.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.035+0000 7f4e3299c700 1 -- 172.21.15.71:0/1925132737 learned_addr learned my addr 172.21.15.71:0/1925132737 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:06.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.035+0000 7f4e3219b700 1 --2- 172.21.15.71:0/1925132737 >> v2:172.21.15.179:3300/0 conn(0x7f4e2c1563b0 0x7f4e2c156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:06.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.036+0000 7f4e3299c700 1 -- 172.21.15.71:0/1925132737 >> v2:172.21.15.179:3300/0 conn(0x7f4e2c1563b0 msgr2=0x7f4e2c156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:06.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.036+0000 7f4e3299c700 1 --2- 172.21.15.71:0/1925132737 >> v2:172.21.15.179:3300/0 conn(0x7f4e2c1563b0 0x7f4e2c156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:06.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.036+0000 7f4e3299c700 1 -- 172.21.15.71:0/1925132737 >> v1:172.21.15.179:6789/0 conn(0x7f4e2c15a440 legacy=0x7f4e2c0acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:06.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.036+0000 7f4e3299c700 1 -- 172.21.15.71:0/1925132737 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2c15b250 con 0x7f4e2c068890 2023-10-09T07:00:06.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.036+0000 7f4e31199700 1 -- 172.21.15.71:0/1925132737 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080748889 0 0) 0x7f4e2c15a9b0 con 0x7f4e2c15a440 2023-10-09T07:00:06.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.036+0000 7f4e3299c700 1 --2- 172.21.15.71:0/1925132737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e2c068890 0x7f4e2c0c8230 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4e24009f20 tx=0x7f4e24009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f894f3fe13ed528a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:06.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.036+0000 7f4e31199700 1 -- 172.21.15.71:0/1925132737 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2400e070 con 0x7f4e2c068890 2023-10-09T07:00:06.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.036+0000 7f4e31199700 1 -- 172.21.15.71:0/1925132737 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2400b9d0 con 0x7f4e2c068890 2023-10-09T07:00:06.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.036+0000 7f4e31199700 1 -- 172.21.15.71:0/1925132737 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e240092e0 con 0x7f4e2c068890 2023-10-09T07:00:06.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.037+0000 7f4e343ff700 1 -- 172.21.15.71:0/1925132737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e2c068890 msgr2=0x7f4e2c0c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:06.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.037+0000 7f4e343ff700 1 --2- 172.21.15.71:0/1925132737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e2c068890 0x7f4e2c0c8230 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4e24009f20 tx=0x7f4e24009840 comp rx=0 tx=0).stop 2023-10-09T07:00:06.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.037+0000 7f4e343ff700 1 -- 172.21.15.71:0/1925132737 shutdown_connections 2023-10-09T07:00:06.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.037+0000 7f4e343ff700 1 --2- 172.21.15.71:0/1925132737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e2c068890 0x7f4e2c0c8230 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:06.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.037+0000 7f4e343ff700 1 --2- 172.21.15.71:0/1925132737 >> v2:172.21.15.179:3300/0 conn(0x7f4e2c1563b0 0x7f4e2c156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:06.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.037+0000 7f4e343ff700 1 -- 172.21.15.71:0/1925132737 >> 172.21.15.71:0/1925132737 conn(0x7f4e2c0c8f90 msgr2=0x7f4e2c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:06.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.037+0000 7f4e343ff700 1 -- 172.21.15.71:0/1925132737 shutdown_connections 2023-10-09T07:00:06.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.037+0000 7f4e343ff700 1 -- 172.21.15.71:0/1925132737 wait complete. 2023-10-09T07:00:06.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.038+0000 7f4e343ff700 1 Processor -- start 2023-10-09T07:00:06.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.038+0000 7f4e343ff700 1 -- start start 2023-10-09T07:00:06.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.039+0000 7f4e343ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e2c068890 0x7f4e2c155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:06.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.039+0000 7f4e343ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e2c1563b0 0x7f4e2c0caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:06.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.039+0000 7f4e343ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e2c15a440 0x7f4e2c0c2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:06.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.039+0000 7f4e343ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c0a56e0 con 0x7f4e2c15a440 2023-10-09T07:00:06.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.039+0000 7f4e343ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c155dd0 con 0x7f4e2c068890 2023-10-09T07:00:06.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.039+0000 7f4e343ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c0ca050 con 0x7f4e2c1563b0 2023-10-09T07:00:06.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.040+0000 7f4e3299c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e2c15a440 0x7f4e2c0c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:06.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.040+0000 7f4e3299c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e2c15a440 0x7f4e2c0c2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34552/0 (socket says 172.21.15.71:34552) 2023-10-09T07:00:06.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.040+0000 7f4e3299c700 1 -- 172.21.15.71:0/924742236 learned_addr learned my addr 172.21.15.71:0/924742236 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:06.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.040+0000 7f4e3219b700 1 --2- 172.21.15.71:0/924742236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e2c068890 0x7f4e2c155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:06.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.040+0000 7f4e3199a700 1 --2- 172.21.15.71:0/924742236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e2c1563b0 0x7f4e2c0caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:06.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.040+0000 7f4e3299c700 1 -- 172.21.15.71:0/924742236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e2c1563b0 msgr2=0x7f4e2c0caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:06.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.040+0000 7f4e3299c700 1 --2- 172.21.15.71:0/924742236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e2c1563b0 0x7f4e2c0caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:06.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.040+0000 7f4e3299c700 1 -- 172.21.15.71:0/924742236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e2c068890 msgr2=0x7f4e2c155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:06.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.040+0000 7f4e3299c700 1 --2- 172.21.15.71:0/924742236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e2c068890 0x7f4e2c155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:06.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.040+0000 7f4e3299c700 1 -- 172.21.15.71:0/924742236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e24009ae0 con 0x7f4e2c15a440 2023-10-09T07:00:06.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.040+0000 7f4e3299c700 1 --2- 172.21.15.71:0/924742236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e2c15a440 0x7f4e2c0c2350 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f4e2400b610 tx=0x7f4e24018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:06.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.041+0000 7f4e227fc700 1 -- 172.21.15.71:0/924742236 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e24008ad0 con 0x7f4e2c15a440 2023-10-09T07:00:06.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.041+0000 7f4e227fc700 1 -- 172.21.15.71:0/924742236 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e24008c30 con 0x7f4e2c15a440 2023-10-09T07:00:06.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.041+0000 7f4e343ff700 1 -- 172.21.15.71:0/924742236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2c169b40 con 0x7f4e2c15a440 2023-10-09T07:00:06.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.041+0000 7f4e227fc700 1 -- 172.21.15.71:0/924742236 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e24026460 con 0x7f4e2c15a440 2023-10-09T07:00:06.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.041+0000 7f4e343ff700 1 -- 172.21.15.71:0/924742236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e2c0ca2f0 con 0x7f4e2c15a440 2023-10-09T07:00:06.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.042+0000 7f4e343ff700 1 -- 172.21.15.71:0/924742236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e2c0718b0 con 0x7f4e2c15a440 2023-10-09T07:00:06.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.043+0000 7f4e227fc700 1 -- 172.21.15.71:0/924742236 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 45) v1 ==== 84973+0+0 (secure 0 0 0) 0x7f4e24003040 con 0x7f4e2c15a440 2023-10-09T07:00:06.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.044+0000 7f4e227fc700 1 --2- 172.21.15.71:0/924742236 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4e100671c0 0x7f4e10069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:06.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.044+0000 7f4e227fc700 1 -- 172.21.15.71:0/924742236 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6384+0+0 (secure 0 0 0) 0x7f4e24086f90 con 0x7f4e2c15a440 2023-10-09T07:00:06.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.044+0000 7f4e3219b700 1 --2- 172.21.15.71:0/924742236 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4e100671c0 0x7f4e10069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:06.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.045+0000 7f4e3219b700 1 --2- 172.21.15.71:0/924742236 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4e100671c0 0x7f4e10069670 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4e28005e30 tx=0x7f4e2800b780 comp rx=0 tx=0).ready entity=mgr.6260 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:06.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.048+0000 7f4e227fc700 1 -- 172.21.15.71:0/924742236 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e24053b40 con 0x7f4e2c15a440 2023-10-09T07:00:06.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.263+0000 7f4e343ff700 1 -- 172.21.15.71:0/924742236 --> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e2c06d6a0 con 0x7f4e100671c0 2023-10-09T07:00:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.336+0000 7f4e227fc700 1 -- 172.21.15.71:0/924742236 <== mgr.6260 v2:172.21.15.179:6832/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+36 (secure 0 0 0) 0x7f4e2c06d6a0 con 0x7f4e100671c0 2023-10-09T07:00:06.337 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule removed for path /bad-path 2023-10-09T07:00:06.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.338+0000 7f4e343ff700 1 -- 172.21.15.71:0/924742236 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4e100671c0 msgr2=0x7f4e10069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:06.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.338+0000 7f4e343ff700 1 --2- 172.21.15.71:0/924742236 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4e100671c0 0x7f4e10069670 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4e28005e30 tx=0x7f4e2800b780 comp rx=0 tx=0).stop 2023-10-09T07:00:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.338+0000 7f4e343ff700 1 -- 172.21.15.71:0/924742236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e2c15a440 msgr2=0x7f4e2c0c2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.338+0000 7f4e343ff700 1 --2- 172.21.15.71:0/924742236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e2c15a440 0x7f4e2c0c2350 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f4e2400b610 tx=0x7f4e24018000 comp rx=0 tx=0).stop 2023-10-09T07:00:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.338+0000 7f4e343ff700 1 -- 172.21.15.71:0/924742236 shutdown_connections 2023-10-09T07:00:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.338+0000 7f4e343ff700 1 --2- 172.21.15.71:0/924742236 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f4e100671c0 0x7f4e10069670 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.338+0000 7f4e343ff700 1 --2- 172.21.15.71:0/924742236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e2c15a440 0x7f4e2c0c2350 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.338+0000 7f4e343ff700 1 --2- 172.21.15.71:0/924742236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e2c068890 0x7f4e2c155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.338+0000 7f4e343ff700 1 --2- 172.21.15.71:0/924742236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e2c1563b0 0x7f4e2c0caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.338+0000 7f4e343ff700 1 -- 172.21.15.71:0/924742236 >> 172.21.15.71:0/924742236 conn(0x7f4e2c0c8f90 msgr2=0x7f4e2c158de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.338+0000 7f4e343ff700 1 -- 172.21.15.71:0/924742236 shutdown_connections 2023-10-09T07:00:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.338+0000 7f4e343ff700 1 -- 172.21.15.71:0/924742236 wait complete. 2023-10-09T07:00:06.357 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /bad-path 2023-10-09T07:00:06.357 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-09T07:00:06.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.540+0000 7f76a1f9d700 1 Processor -- start 2023-10-09T07:00:06.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.540+0000 7f76a1f9d700 1 -- start start 2023-10-09T07:00:06.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.541+0000 7f76a1f9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f769c159450 0x7f769c0c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:06.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.541+0000 7f76a1f9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f769c0c8730 con 0x7f769c0c96e0 2023-10-09T07:00:06.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.541+0000 7f76a1f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f769c0c7b00 con 0x7f769c159820 2023-10-09T07:00:06.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.541+0000 7f76a1f9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f769c0c89a0 con 0x7f769c159450 2023-10-09T07:00:06.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.541+0000 7f76a0f9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f769c159450 0x7f769c0c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:06.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.541+0000 7f769bfff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f769c0c96e0 0x7f769c0a98e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56184/0 (socket says 172.21.15.71:56184) 2023-10-09T07:00:06.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.541+0000 7f769bfff700 1 -- 172.21.15.71:0/606453714 learned_addr learned my addr 172.21.15.71:0/606453714 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:06.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.542+0000 7f76a0f9b700 1 -- 172.21.15.71:0/606453714 >> v1:172.21.15.179:6789/0 conn(0x7f769c159820 legacy=0x7f769c06d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:06.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.542+0000 7f76a0f9b700 1 -- 172.21.15.71:0/606453714 >> v1:172.21.15.71:6789/0 conn(0x7f769c0c96e0 legacy=0x7f769c0a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:06.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.542+0000 7f76a0f9b700 1 -- 172.21.15.71:0/606453714 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769c0c8c80 con 0x7f769c159450 2023-10-09T07:00:06.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.542+0000 7f769b7fe700 1 -- 172.21.15.71:0/606453714 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 254381026 0 0) 0x7f769c0c8730 con 0x7f769c0c96e0 2023-10-09T07:00:06.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.542+0000 7f76a0f9b700 1 --2- 172.21.15.71:0/606453714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f769c159450 0x7f769c0c91a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f76900098e0 tx=0x7f76900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20138c7b46bd7a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:06.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.542+0000 7f769b7fe700 1 -- 172.21.15.71:0/606453714 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690009e80 con 0x7f769c159450 2023-10-09T07:00:06.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.542+0000 7f769b7fe700 1 -- 172.21.15.71:0/606453714 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769000b860 con 0x7f769c159450 2023-10-09T07:00:06.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.542+0000 7f769b7fe700 1 -- 172.21.15.71:0/606453714 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769000bbe0 con 0x7f769c159450 2023-10-09T07:00:06.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.543+0000 7f76a1f9d700 1 -- 172.21.15.71:0/606453714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f769c159450 msgr2=0x7f769c0c91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:06.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.543+0000 7f76a1f9d700 1 --2- 172.21.15.71:0/606453714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f769c159450 0x7f769c0c91a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f76900098e0 tx=0x7f76900091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:06.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.543+0000 7f76a1f9d700 1 -- 172.21.15.71:0/606453714 shutdown_connections 2023-10-09T07:00:06.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.543+0000 7f76a1f9d700 1 --2- 172.21.15.71:0/606453714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f769c159450 0x7f769c0c91a0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:06.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.543+0000 7f76a1f9d700 1 -- 172.21.15.71:0/606453714 >> 172.21.15.71:0/606453714 conn(0x7f769c0698e0 msgr2=0x7f769c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:06.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.543+0000 7f76a1f9d700 1 -- 172.21.15.71:0/606453714 shutdown_connections 2023-10-09T07:00:06.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.543+0000 7f76a1f9d700 1 -- 172.21.15.71:0/606453714 wait complete. 2023-10-09T07:00:06.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.544+0000 7f76a1f9d700 1 Processor -- start 2023-10-09T07:00:06.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.545+0000 7f76a1f9d700 1 -- start start 2023-10-09T07:00:06.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.545+0000 7f76a1f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f769c0c96e0 0x7f769c158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:06.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.545+0000 7f76a1f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f769c159450 0x7f769c0afd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:06.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.545+0000 7f76a1f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f769c159820 0x7f769c159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:06.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.545+0000 7f76a1f9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c0b1410 con 0x7f769c0c96e0 2023-10-09T07:00:06.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.545+0000 7f76a1f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c0b16f0 con 0x7f769c159820 2023-10-09T07:00:06.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.545+0000 7f76a1f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769c0b19d0 con 0x7f769c159450 2023-10-09T07:00:06.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.546+0000 7f76a0f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f769c0c96e0 0x7f769c158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.546+0000 7f76a0f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f769c0c96e0 0x7f769c158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34572/0 (socket says 172.21.15.71:34572) 2023-10-09T07:00:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.546+0000 7f76a0f9b700 1 -- 172.21.15.71:0/826502088 learned_addr learned my addr 172.21.15.71:0/826502088 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.546+0000 7f76a179c700 1 --2- 172.21.15.71:0/826502088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f769c159820 0x7f769c159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.546+0000 7f769bfff700 1 --2- 172.21.15.71:0/826502088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f769c159450 0x7f769c0afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.546+0000 7f76a0f9b700 1 -- 172.21.15.71:0/826502088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f769c159450 msgr2=0x7f769c0afd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.546+0000 7f76a0f9b700 1 --2- 172.21.15.71:0/826502088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f769c159450 0x7f769c0afd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.546+0000 7f76a0f9b700 1 -- 172.21.15.71:0/826502088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f769c159820 msgr2=0x7f769c159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.546+0000 7f76a0f9b700 1 --2- 172.21.15.71:0/826502088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f769c159820 0x7f769c159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.546+0000 7f76a0f9b700 1 -- 172.21.15.71:0/826502088 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7690009420 con 0x7f769c0c96e0 2023-10-09T07:00:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.546+0000 7f76a179c700 1 --2- 172.21.15.71:0/826502088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f769c159820 0x7f769c159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:00:06.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.546+0000 7f76a0f9b700 1 --2- 172.21.15.71:0/826502088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f769c0c96e0 0x7f769c158320 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f769c063d10 tx=0x7f7690017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:06.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.547+0000 7f7698ff9700 1 -- 172.21.15.71:0/826502088 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769001f070 con 0x7f769c0c96e0 2023-10-09T07:00:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.547+0000 7f7698ff9700 1 -- 172.21.15.71:0/826502088 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769000b9d0 con 0x7f769c0c96e0 2023-10-09T07:00:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.547+0000 7f7698ff9700 1 -- 172.21.15.71:0/826502088 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690025670 con 0x7f769c0c96e0 2023-10-09T07:00:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.547+0000 7f76a1f9d700 1 -- 172.21.15.71:0/826502088 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f769c0b1cb0 con 0x7f769c0c96e0 2023-10-09T07:00:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.547+0000 7f76a1f9d700 1 -- 172.21.15.71:0/826502088 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f769c0b0950 con 0x7f769c0c96e0 2023-10-09T07:00:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.548+0000 7f76a1f9d700 1 -- 172.21.15.71:0/826502088 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f769c06ca90 con 0x7f769c0c96e0 2023-10-09T07:00:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.549+0000 7f7698ff9700 1 -- 172.21.15.71:0/826502088 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 45) v1 ==== 84973+0+0 (secure 0 0 0) 0x7f7690023070 con 0x7f769c0c96e0 2023-10-09T07:00:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.550+0000 7f7698ff9700 1 --2- 172.21.15.71:0/826502088 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f76800671c0 0x7f7680069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:06.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.550+0000 7f7698ff9700 1 -- 172.21.15.71:0/826502088 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6384+0+0 (secure 0 0 0) 0x7f76900862c0 con 0x7f769c0c96e0 2023-10-09T07:00:06.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.550+0000 7f769bfff700 1 --2- 172.21.15.71:0/826502088 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f76800671c0 0x7f7680069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:06.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.551+0000 7f769bfff700 1 --2- 172.21.15.71:0/826502088 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f76800671c0 0x7f7680069670 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f769c0c67d0 tx=0x7f7688009040 comp rx=0 tx=0).ready entity=mgr.6260 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:06.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.554+0000 7f7698ff9700 1 -- 172.21.15.71:0/826502088 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7690052f80 con 0x7f769c0c96e0 2023-10-09T07:00:06.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.799+0000 7f76a1f9d700 1 -- 172.21.15.71:0/826502088 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f769c0c7de0 con 0x7f769c0c96e0 2023-10-09T07:00:06.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.816+0000 7f7698ff9700 1 -- 172.21.15.71:0/826502088 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 46) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f7690053350 con 0x7f769c0c96e0 2023-10-09T07:00:06.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.817+0000 7f7698ff9700 1 -- 172.21.15.71:0/826502088 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v46) v1 ==== 93+0+0 (secure 0 0 0) 0x7f7690056a10 con 0x7f769c0c96e0 2023-10-09T07:00:06.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.819+0000 7f76a1f9d700 1 -- 172.21.15.71:0/826502088 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f76800671c0 msgr2=0x7f7680069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:06.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.820+0000 7f76a1f9d700 1 --2- 172.21.15.71:0/826502088 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f76800671c0 0x7f7680069670 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f769c0c67d0 tx=0x7f7688009040 comp rx=0 tx=0).stop 2023-10-09T07:00:06.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.820+0000 7f76a1f9d700 1 -- 172.21.15.71:0/826502088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f769c0c96e0 msgr2=0x7f769c158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:06.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.820+0000 7f76a1f9d700 1 --2- 172.21.15.71:0/826502088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f769c0c96e0 0x7f769c158320 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f769c063d10 tx=0x7f7690017000 comp rx=0 tx=0).stop 2023-10-09T07:00:06.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.820+0000 7f76a1f9d700 1 -- 172.21.15.71:0/826502088 shutdown_connections 2023-10-09T07:00:06.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.820+0000 7f76a1f9d700 1 --2- 172.21.15.71:0/826502088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f769c159820 0x7f769c159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:06.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.820+0000 7f76a1f9d700 1 --2- 172.21.15.71:0/826502088 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f76800671c0 0x7f7680069670 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:06.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.820+0000 7f76a1f9d700 1 --2- 172.21.15.71:0/826502088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f769c0c96e0 0x7f769c158320 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:06.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.820+0000 7f76a1f9d700 1 --2- 172.21.15.71:0/826502088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f769c159450 0x7f769c0afd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:06.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.820+0000 7f76a1f9d700 1 -- 172.21.15.71:0/826502088 >> 172.21.15.71:0/826502088 conn(0x7f769c0698e0 msgr2=0x7f769c0a98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:06.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.820+0000 7f76a1f9d700 1 -- 172.21.15.71:0/826502088 shutdown_connections 2023-10-09T07:00:06.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:06.820+0000 7f76a1f9d700 1 -- 172.21.15.71:0/826502088 wait complete. 2023-10-09T07:00:06.842 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T07:00:06.842 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T07:00:06.932 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T07:00:07.011 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T07:00:07.011 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T07:00:07.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:00:07.011 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T07:00:07.091 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T07:00:07.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:00:07.091 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T07:00:07.130 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:00:07.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.355+0000 7feca919d700 1 Processor -- start 2023-10-09T07:00:07.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.355+0000 7feca919d700 1 -- start start 2023-10-09T07:00:07.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.356+0000 7feca919d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feca4156310 0x7feca40c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:07.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.356+0000 7feca919d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7feca40ae710 0x7feca40c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:07.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.356+0000 7feca919d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca40ca860 con 0x7feca41566e0 2023-10-09T07:00:07.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.356+0000 7feca919d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca40cab40 con 0x7feca40ae710 2023-10-09T07:00:07.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.356+0000 7feca919d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca40cae20 con 0x7feca4156310 2023-10-09T07:00:07.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.356+0000 7feca899c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7feca40ae710 0x7feca40c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:07.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.356+0000 7feca3fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feca4156310 0x7feca40c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:07.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.357+0000 7feca3fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feca4156310 0x7feca40c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:53612/0 (socket says 172.21.15.71:53612) 2023-10-09T07:00:07.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.357+0000 7feca3fff700 1 -- 172.21.15.71:0/2513837933 learned_addr learned my addr 172.21.15.71:0/2513837933 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:07.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.357+0000 7feca37fe700 1 --1- 172.21.15.71:0/2513837933 >> v1:172.21.15.179:6789/0 conn(0x7feca41566e0 0x7feca40ae000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:58498/0 (socket says 172.21.15.71:58498) 2023-10-09T07:00:07.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.357+0000 7feca899c700 1 -- 172.21.15.71:0/2513837933 >> v2:172.21.15.179:3300/0 conn(0x7feca4156310 msgr2=0x7feca40c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:07.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.357+0000 7feca899c700 1 --2- 172.21.15.71:0/2513837933 >> v2:172.21.15.179:3300/0 conn(0x7feca4156310 0x7feca40c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:07.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.357+0000 7feca899c700 1 -- 172.21.15.71:0/2513837933 >> v1:172.21.15.179:6789/0 conn(0x7feca41566e0 legacy=0x7feca40ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:07.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.357+0000 7feca899c700 1 -- 172.21.15.71:0/2513837933 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca40cb100 con 0x7feca40ae710 2023-10-09T07:00:07.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.357+0000 7feca3fff700 1 --2- 172.21.15.71:0/2513837933 >> v2:172.21.15.179:3300/0 conn(0x7feca4156310 0x7feca40c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:00:07.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.357+0000 7feca899c700 1 --2- 172.21.15.71:0/2513837933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feca40ae710 0x7feca40c6830 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7feca40cce20 tx=0x7fec9c00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f97b1226181e51 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:07.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.357+0000 7feca2ffd700 1 -- 172.21.15.71:0/2513837933 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c010070 con 0x7feca40ae710 2023-10-09T07:00:07.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.358+0000 7feca2ffd700 1 -- 172.21.15.71:0/2513837933 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c00b2e0 con 0x7feca40ae710 2023-10-09T07:00:07.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.358+0000 7feca2ffd700 1 -- 172.21.15.71:0/2513837933 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c00dd50 con 0x7feca40ae710 2023-10-09T07:00:07.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.358+0000 7feca919d700 1 -- 172.21.15.71:0/2513837933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feca40ae710 msgr2=0x7feca40c6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:07.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.358+0000 7feca919d700 1 --2- 172.21.15.71:0/2513837933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feca40ae710 0x7feca40c6830 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7feca40cce20 tx=0x7fec9c00b990 comp rx=0 tx=0).stop 2023-10-09T07:00:07.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.358+0000 7feca919d700 1 -- 172.21.15.71:0/2513837933 shutdown_connections 2023-10-09T07:00:07.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.358+0000 7feca919d700 1 --2- 172.21.15.71:0/2513837933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feca40ae710 0x7feca40c6830 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:07.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.358+0000 7feca919d700 1 --2- 172.21.15.71:0/2513837933 >> v2:172.21.15.179:3300/0 conn(0x7feca4156310 0x7feca40c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:07.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.358+0000 7feca919d700 1 -- 172.21.15.71:0/2513837933 >> 172.21.15.71:0/2513837933 conn(0x7feca40cc1f0 msgr2=0x7feca40cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:07.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.358+0000 7feca919d700 1 -- 172.21.15.71:0/2513837933 shutdown_connections 2023-10-09T07:00:07.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.358+0000 7feca919d700 1 -- 172.21.15.71:0/2513837933 wait complete. 2023-10-09T07:00:07.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.360+0000 7feca919d700 1 Processor -- start 2023-10-09T07:00:07.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.360+0000 7feca919d700 1 -- start start 2023-10-09T07:00:07.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.361+0000 7feca919d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feca40ae710 0x7feca4151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:07.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.361+0000 7feca919d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feca4156310 0x7feca4151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:07.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.361+0000 7feca919d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feca41566e0 0x7feca40aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:07.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.361+0000 7feca919d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca40b01d0 con 0x7feca4156310 2023-10-09T07:00:07.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.361+0000 7feca919d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca414a9d0 con 0x7feca41566e0 2023-10-09T07:00:07.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.361+0000 7feca919d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca40afc10 con 0x7feca40ae710 2023-10-09T07:00:07.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.361+0000 7feca37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feca4156310 0x7feca4151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:07.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.361+0000 7feca37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feca4156310 0x7feca4151aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34616/0 (socket says 172.21.15.71:34616) 2023-10-09T07:00:07.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.361+0000 7feca37fe700 1 -- 172.21.15.71:0/2723065175 learned_addr learned my addr 172.21.15.71:0/2723065175 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:07.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.361+0000 7feca899c700 1 --2- 172.21.15.71:0/2723065175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feca41566e0 0x7feca40aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:07.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.361+0000 7feca3fff700 1 --2- 172.21.15.71:0/2723065175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feca40ae710 0x7feca4151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:07.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.362+0000 7feca37fe700 1 -- 172.21.15.71:0/2723065175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feca40ae710 msgr2=0x7feca4151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:07.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.362+0000 7feca37fe700 1 --2- 172.21.15.71:0/2723065175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feca40ae710 0x7feca4151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:07.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.362+0000 7feca37fe700 1 -- 172.21.15.71:0/2723065175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feca41566e0 msgr2=0x7feca40aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:07.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.362+0000 7feca37fe700 1 --2- 172.21.15.71:0/2723065175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feca41566e0 0x7feca40aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:07.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.362+0000 7feca37fe700 1 -- 172.21.15.71:0/2723065175 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec940094f0 con 0x7feca4156310 2023-10-09T07:00:07.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.362+0000 7feca37fe700 1 --2- 172.21.15.71:0/2723065175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feca4156310 0x7feca4151aa0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fec9800c790 tx=0x7fec98007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:07.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.362+0000 7fec8bfff700 1 -- 172.21.15.71:0/2723065175 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec98005a70 con 0x7feca4156310 2023-10-09T07:00:07.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.362+0000 7fec8bfff700 1 -- 172.21.15.71:0/2723065175 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec98005bf0 con 0x7feca4156310 2023-10-09T07:00:07.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.362+0000 7fec8bfff700 1 -- 172.21.15.71:0/2723065175 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec980070d0 con 0x7feca4156310 2023-10-09T07:00:07.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.362+0000 7feca919d700 1 -- 172.21.15.71:0/2723065175 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9c00bc30 con 0x7feca4156310 2023-10-09T07:00:07.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.362+0000 7feca919d700 1 -- 172.21.15.71:0/2723065175 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca414a660 con 0x7feca4156310 2023-10-09T07:00:07.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.363+0000 7feca919d700 1 -- 172.21.15.71:0/2723065175 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca414ab60 con 0x7feca4156310 2023-10-09T07:00:07.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.364+0000 7fec8bfff700 1 -- 172.21.15.71:0/2723065175 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 46) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fec98007440 con 0x7feca4156310 2023-10-09T07:00:07.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.365+0000 7fec8bfff700 1 --2- 172.21.15.71:0/2723065175 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fec90067170 0x7fec90069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:07.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.365+0000 7fec8bfff700 1 -- 172.21.15.71:0/2723065175 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6384+0+0 (secure 0 0 0) 0x7fec98083f60 con 0x7feca4156310 2023-10-09T07:00:07.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.365+0000 7feca3fff700 1 -- 172.21.15.71:0/2723065175 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fec90067170 msgr2=0x7fec90069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T07:00:07.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.365+0000 7feca3fff700 1 --2- 172.21.15.71:0/2723065175 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fec90067170 0x7fec90069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:00:07.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.369+0000 7fec8bfff700 1 -- 172.21.15.71:0/2723065175 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec98050c20 con 0x7feca4156310 2023-10-09T07:00:07.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.566+0000 7feca3fff700 1 -- 172.21.15.71:0/2723065175 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fec90067170 msgr2=0x7fec90069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T07:00:07.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.566+0000 7feca3fff700 1 --2- 172.21.15.71:0/2723065175 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fec90067170 0x7fec90069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:00:07.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.614+0000 7feca919d700 1 -- 172.21.15.71:0/2723065175 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feca406afb0 con 0x7feca4156310 2023-10-09T07:00:07.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.615+0000 7fec8bfff700 1 -- 172.21.15.71:0/2723065175 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fec98017020 con 0x7feca4156310 2023-10-09T07:00:07.616 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:00:07.616 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/2945926197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2945926197},{"type":"v1","addr":"172.21.15.71:6834","nonce":2945926197}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1112255645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1112255645},{"type":"v1","addr":"172.21.15.179:6836","nonce":1112255645}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3298180688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":3298180688},{"type":"v1","addr":"172.21.15.71:6835","nonce":3298180688}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:58:43.707312+0000","modified":"2023-10-09T06:58:47.272802+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7152},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7152":{"gid":7152,"name":"d","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/4053543999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":4053543999},{"type":"v1","addr":"172.21.15.179:6837","nonce":4053543999}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T07:00:07.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.617+0000 7feca919d700 1 -- 172.21.15.71:0/2723065175 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fec90067170 msgr2=0x7fec90069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:00:07.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.617+0000 7feca919d700 1 --2- 172.21.15.71:0/2723065175 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fec90067170 0x7fec90069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:07.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.617+0000 7feca919d700 1 -- 172.21.15.71:0/2723065175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feca4156310 msgr2=0x7feca4151aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:07.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.617+0000 7feca919d700 1 --2- 172.21.15.71:0/2723065175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feca4156310 0x7feca4151aa0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fec9800c790 tx=0x7fec98007f40 comp rx=0 tx=0).stop 2023-10-09T07:00:07.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.617+0000 7feca919d700 1 -- 172.21.15.71:0/2723065175 shutdown_connections 2023-10-09T07:00:07.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.617+0000 7feca919d700 1 --2- 172.21.15.71:0/2723065175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feca41566e0 0x7feca40aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:07.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.617+0000 7feca919d700 1 --2- 172.21.15.71:0/2723065175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feca40ae710 0x7feca4151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:07.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.617+0000 7feca919d700 1 --2- 172.21.15.71:0/2723065175 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fec90067170 0x7fec90069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:07.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.617+0000 7feca919d700 1 --2- 172.21.15.71:0/2723065175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feca4156310 0x7feca4151aa0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:07.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.617+0000 7feca919d700 1 -- 172.21.15.71:0/2723065175 >> 172.21.15.71:0/2723065175 conn(0x7feca40cc1f0 msgr2=0x7feca40c1620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:07.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.617+0000 7feca919d700 1 -- 172.21.15.71:0/2723065175 shutdown_connections 2023-10-09T07:00:07.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.617+0000 7feca919d700 1 -- 172.21.15.71:0/2723065175 wait complete. 2023-10-09T07:00:07.620 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 49 2023-10-09T07:00:07.637 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:00:07.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.822+0000 7f0f5b59e700 1 Processor -- start 2023-10-09T07:00:07.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.822+0000 7f0f5b59e700 1 -- start start 2023-10-09T07:00:07.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.823+0000 7f0f5b59e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0f5c1595a0 0x7f0f5c0b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:07.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.823+0000 7f0f5b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f5c0c6c60 0x7f0f5c0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:07.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.823+0000 7f0f5b59e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5c0b1410 con 0x7f0f5c0b1de0 2023-10-09T07:00:07.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.823+0000 7f0f5b59e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f5c0b2b90 con 0x7f0f5c1595a0 2023-10-09T07:00:07.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.823+0000 7f0f5b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c063230 con 0x7f0f5c0c6c60 2023-10-09T07:00:07.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.824+0000 7f0f5a59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0f5c1595a0 0x7f0f5c0b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:07.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.824+0000 7f0f5ad9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f0f5c0b1de0 0x7f0f5c15d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56198/0 (socket says 172.21.15.71:56198) 2023-10-09T07:00:07.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.824+0000 7f0f5ad9d700 1 -- 172.21.15.71:0/2338473293 learned_addr learned my addr 172.21.15.71:0/2338473293 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:07.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.824+0000 7f0f59d9b700 1 --2- 172.21.15.71:0/2338473293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f5c0c6c60 0x7f0f5c0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:07.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.824+0000 7f0f5959a700 1 -- 172.21.15.71:0/2338473293 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873017655 0 0) 0x7f0f5c0b1410 con 0x7f0f5c0b1de0 2023-10-09T07:00:07.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.824+0000 7f0f5a59c700 1 -- 172.21.15.71:0/2338473293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f5c0c6c60 msgr2=0x7f0f5c0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:07.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.824+0000 7f0f5a59c700 1 --2- 172.21.15.71:0/2338473293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f5c0c6c60 0x7f0f5c0c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:07.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.824+0000 7f0f5a59c700 1 -- 172.21.15.71:0/2338473293 >> v1:172.21.15.71:6789/0 conn(0x7f0f5c0b1de0 legacy=0x7f0f5c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:07.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.824+0000 7f0f5a59c700 1 -- 172.21.15.71:0/2338473293 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c0634f0 con 0x7f0f5c1595a0 2023-10-09T07:00:07.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.824+0000 7f0f5a59c700 1 --2- 172.21.15.71:0/2338473293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f5c1595a0 0x7f0f5c0b18a0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0098e0 tx=0x7f0f4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aedf7760e6d5492 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:07.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.825+0000 7f0f5959a700 1 -- 172.21.15.71:0/2338473293 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c00b640 con 0x7f0f5c1595a0 2023-10-09T07:00:07.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.825+0000 7f0f5959a700 1 -- 172.21.15.71:0/2338473293 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c00b7a0 con 0x7f0f5c1595a0 2023-10-09T07:00:07.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.825+0000 7f0f5959a700 1 -- 172.21.15.71:0/2338473293 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c00bb40 con 0x7f0f5c1595a0 2023-10-09T07:00:07.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.825+0000 7f0f5b59e700 1 -- 172.21.15.71:0/2338473293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f5c1595a0 msgr2=0x7f0f5c0b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:07.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.825+0000 7f0f5b59e700 1 --2- 172.21.15.71:0/2338473293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f5c1595a0 0x7f0f5c0b18a0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0098e0 tx=0x7f0f4c0091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:07.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.825+0000 7f0f5b59e700 1 -- 172.21.15.71:0/2338473293 shutdown_connections 2023-10-09T07:00:07.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.825+0000 7f0f5b59e700 1 --2- 172.21.15.71:0/2338473293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f5c1595a0 0x7f0f5c0b18a0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:07.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.825+0000 7f0f5b59e700 1 --2- 172.21.15.71:0/2338473293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f5c0c6c60 0x7f0f5c0c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:07.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.825+0000 7f0f5b59e700 1 -- 172.21.15.71:0/2338473293 >> 172.21.15.71:0/2338473293 conn(0x7f0f5c06ddb0 msgr2=0x7f0f5c06e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:07.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.826+0000 7f0f5b59e700 1 -- 172.21.15.71:0/2338473293 shutdown_connections 2023-10-09T07:00:07.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.826+0000 7f0f5b59e700 1 -- 172.21.15.71:0/2338473293 wait complete. 2023-10-09T07:00:07.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.827+0000 7f0f5b59e700 1 Processor -- start 2023-10-09T07:00:07.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.827+0000 7f0f5b59e700 1 -- start start 2023-10-09T07:00:07.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.828+0000 7f0f5b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f5c0b1de0 0x7f0f5c152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:07.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.828+0000 7f0f5b59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f5c0c6c60 0x7f0f5c0c1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:07.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.828+0000 7f0f5b59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f5c1595a0 0x7f0f5c0c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:07.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.828+0000 7f0f5b59e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c152640 con 0x7f0f5c0c6c60 2023-10-09T07:00:07.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.828+0000 7f0f5b59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c0c1e90 con 0x7f0f5c1595a0 2023-10-09T07:00:07.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.828+0000 7f0f5b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c0c2130 con 0x7f0f5c0b1de0 2023-10-09T07:00:07.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.828+0000 7f0f59d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f5c0c6c60 0x7f0f5c0c1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:07.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.828+0000 7f0f59d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f5c0c6c60 0x7f0f5c0c1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34636/0 (socket says 172.21.15.71:34636) 2023-10-09T07:00:07.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.828+0000 7f0f59d9b700 1 -- 172.21.15.71:0/1530099468 learned_addr learned my addr 172.21.15.71:0/1530099468 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:07.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.828+0000 7f0f5a59c700 1 --2- 172.21.15.71:0/1530099468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f5c0b1de0 0x7f0f5c152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:07.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.828+0000 7f0f5ad9d700 1 --2- 172.21.15.71:0/1530099468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f5c1595a0 0x7f0f5c0c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:07.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.829+0000 7f0f59d9b700 1 -- 172.21.15.71:0/1530099468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f5c0b1de0 msgr2=0x7f0f5c152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:07.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.829+0000 7f0f59d9b700 1 --2- 172.21.15.71:0/1530099468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f5c0b1de0 0x7f0f5c152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:07.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.829+0000 7f0f59d9b700 1 -- 172.21.15.71:0/1530099468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f5c1595a0 msgr2=0x7f0f5c0c5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:07.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.829+0000 7f0f59d9b700 1 --2- 172.21.15.71:0/1530099468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f5c1595a0 0x7f0f5c0c5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:07.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.829+0000 7f0f59d9b700 1 -- 172.21.15.71:0/1530099468 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c009420 con 0x7f0f5c0c6c60 2023-10-09T07:00:07.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.829+0000 7f0f59d9b700 1 --2- 172.21.15.71:0/1530099468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f5c0c6c60 0x7f0f5c0c1950 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000ec80 tx=0x7f0f500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:07.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.829+0000 7f0f4a7fc700 1 -- 172.21.15.71:0/1530099468 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5000c850 con 0x7f0f5c0c6c60 2023-10-09T07:00:07.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.829+0000 7f0f4a7fc700 1 -- 172.21.15.71:0/1530099468 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5000c9b0 con 0x7f0f5c0c6c60 2023-10-09T07:00:07.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.829+0000 7f0f5b59e700 1 -- 172.21.15.71:0/1530099468 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5c0c2410 con 0x7f0f5c0c6c60 2023-10-09T07:00:07.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.829+0000 7f0f4a7fc700 1 -- 172.21.15.71:0/1530099468 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5000cd50 con 0x7f0f5c0c6c60 2023-10-09T07:00:07.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.830+0000 7f0f5b59e700 1 -- 172.21.15.71:0/1530099468 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5c0c29d0 con 0x7f0f5c0c6c60 2023-10-09T07:00:07.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.830+0000 7f0f5b59e700 1 -- 172.21.15.71:0/1530099468 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5c159a00 con 0x7f0f5c0c6c60 2023-10-09T07:00:07.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.831+0000 7f0f4a7fc700 1 -- 172.21.15.71:0/1530099468 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 46) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f0f50013680 con 0x7f0f5c0c6c60 2023-10-09T07:00:07.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.832+0000 7f0f4a7fc700 1 --2- 172.21.15.71:0/1530099468 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0f3c067170 0x7f0f3c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:07.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.832+0000 7f0f4a7fc700 1 -- 172.21.15.71:0/1530099468 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6384+0+0 (secure 0 0 0) 0x7f0f50084de0 con 0x7f0f5c0c6c60 2023-10-09T07:00:07.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.833+0000 7f0f5a59c700 1 -- 172.21.15.71:0/1530099468 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0f3c067170 msgr2=0x7f0f3c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T07:00:07.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.833+0000 7f0f5a59c700 1 --2- 172.21.15.71:0/1530099468 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0f3c067170 0x7f0f3c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:00:07.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:07.836+0000 7f0f4a7fc700 1 -- 172.21.15.71:0/1530099468 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f5c159a00 con 0x7f0f5c0c6c60 2023-10-09T07:00:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.032+0000 7f0f5b59e700 1 -- 172.21.15.71:0/1530099468 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f5c159a00 con 0x7f0f5c0c6c60 2023-10-09T07:00:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.033+0000 7f0f4a7fc700 1 -- 172.21.15.71:0/1530099468 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+16381 (secure 0 0 0) 0x7f0f5c159a00 con 0x7f0f5c0c6c60 2023-10-09T07:00:08.034 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:00:08.034 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":110,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:00:05.799686+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:58:41.817433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T06:58:42.692884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.11","mappings":[{"from":1,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6833/85452":"2023-10-10T06:59:03.833693+0000","172.21.15.179:6832/85452":"2023-10-10T06:59:03.833693+0000","172.21.15.179:0/3295056505":"2023-10-10T06:59:03.833693+0000","172.21.15.179:0/1335773422":"2023-10-10T06:59:03.833693+0000","172.21.15.179:0/2110166133":"2023-10-10T06:59:03.833693+0000","172.21.15.179:0/1934925403":"2023-10-10T06:59:03.833693+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:00:08.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.034+0000 7f0f5a59c700 1 -- 172.21.15.71:0/1530099468 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0f3c067170 msgr2=0x7f0f3c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T07:00:08.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.034+0000 7f0f5a59c700 1 --2- 172.21.15.71:0/1530099468 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0f3c067170 0x7f0f3c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:00:08.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.035+0000 7f0f5b59e700 1 -- 172.21.15.71:0/1530099468 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0f3c067170 msgr2=0x7f0f3c069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:00:08.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.035+0000 7f0f5b59e700 1 --2- 172.21.15.71:0/1530099468 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0f3c067170 0x7f0f3c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.035+0000 7f0f5b59e700 1 -- 172.21.15.71:0/1530099468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f5c0c6c60 msgr2=0x7f0f5c0c1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:08.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.035+0000 7f0f5b59e700 1 --2- 172.21.15.71:0/1530099468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f5c0c6c60 0x7f0f5c0c1950 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000ec80 tx=0x7f0f500091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.035+0000 7f0f5b59e700 1 -- 172.21.15.71:0/1530099468 shutdown_connections 2023-10-09T07:00:08.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.035+0000 7f0f5b59e700 1 --2- 172.21.15.71:0/1530099468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f5c1595a0 0x7f0f5c0c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.035+0000 7f0f5b59e700 1 --2- 172.21.15.71:0/1530099468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f5c0b1de0 0x7f0f5c152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.035+0000 7f0f5b59e700 1 --2- 172.21.15.71:0/1530099468 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f0f3c067170 0x7f0f3c069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.035+0000 7f0f5b59e700 1 --2- 172.21.15.71:0/1530099468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f5c0c6c60 0x7f0f5c0c1950 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.035+0000 7f0f5b59e700 1 -- 172.21.15.71:0/1530099468 >> 172.21.15.71:0/1530099468 conn(0x7f0f5c06ddb0 msgr2=0x7f0f5c153ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:08.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.035+0000 7f0f5b59e700 1 -- 172.21.15.71:0/1530099468 shutdown_connections 2023-10-09T07:00:08.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.035+0000 7f0f5b59e700 1 -- 172.21.15.71:0/1530099468 wait complete. 2023-10-09T07:00:08.055 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T06:58:41.817433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T06:58:42.692884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T07:00:08.055 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T07:00:08.097 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:08.097+0000 7eff3ce86180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T07:00:08.149 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:08.146+0000 7fb940e35180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T07:00:08.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.244+0000 7f51d7fff700 1 Processor -- start 2023-10-09T07:00:08.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.244+0000 7f51d7fff700 1 -- start start 2023-10-09T07:00:08.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.245+0000 7f51d7fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f51d8159a60 0x7f51d80c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:08.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.245+0000 7f51d7fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d80c9cb0 con 0x7f51d80ccc00 2023-10-09T07:00:08.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.245+0000 7f51d7fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d80c9f30 con 0x7f51d80cb230 2023-10-09T07:00:08.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.245+0000 7f51d7fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d806dfc0 con 0x7f51d8159a60 2023-10-09T07:00:08.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.246+0000 7f51d67fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f51d80ccc00 0x7f51d8069ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56202/0 (socket says 172.21.15.71:56202) 2023-10-09T07:00:08.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.246+0000 7f51d67fc700 1 -- 172.21.15.71:0/3401205371 learned_addr learned my addr 172.21.15.71:0/3401205371 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:08.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.246+0000 7f51d6ffd700 1 --2- 172.21.15.71:0/3401205371 >> v2:172.21.15.179:3300/0 conn(0x7f51d8159a60 0x7f51d80c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:08.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.246+0000 7f51d5ffb700 1 -- 172.21.15.71:0/3401205371 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120616108 0 0) 0x7f51d80c9cb0 con 0x7f51d80ccc00 2023-10-09T07:00:08.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.246+0000 7f51d5ffb700 1 -- 172.21.15.71:0/3401205371 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51c0003570 con 0x7f51d80ccc00 2023-10-09T07:00:08.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.246+0000 7f51d5ffb700 1 -- 172.21.15.71:0/3401205371 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2031308661 0 0) 0x7f51d80c9f30 con 0x7f51d80cb230 2023-10-09T07:00:08.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.246+0000 7f51d5ffb700 1 -- 172.21.15.71:0/3401205371 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51d80c9cb0 con 0x7f51d80cb230 2023-10-09T07:00:08.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.246+0000 7f51d6ffd700 1 -- 172.21.15.71:0/3401205371 >> v1:172.21.15.179:6789/0 conn(0x7f51d80cb230 legacy=0x7f51d806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:08.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.246+0000 7f51d6ffd700 1 -- 172.21.15.71:0/3401205371 >> v1:172.21.15.71:6789/0 conn(0x7f51d80ccc00 legacy=0x7f51d8069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:08.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.246+0000 7f51d6ffd700 1 -- 172.21.15.71:0/3401205371 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d80ca470 con 0x7f51d8159a60 2023-10-09T07:00:08.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.247+0000 7f51d6ffd700 1 --2- 172.21.15.71:0/3401205371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51d8159a60 0x7f51d80c9770 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f51c80098e0 tx=0x7f51c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db00924499070814 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:08.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.247+0000 7f51d5ffb700 1 -- 172.21.15.71:0/3401205371 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c8011630 con 0x7f51d8159a60 2023-10-09T07:00:08.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.247+0000 7f51d5ffb700 1 -- 172.21.15.71:0/3401205371 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c8011790 con 0x7f51d8159a60 2023-10-09T07:00:08.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.247+0000 7f51d5ffb700 1 -- 172.21.15.71:0/3401205371 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c8011b30 con 0x7f51d8159a60 2023-10-09T07:00:08.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.247+0000 7f51d7fff700 1 -- 172.21.15.71:0/3401205371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51d8159a60 msgr2=0x7f51d80c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:08.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.247+0000 7f51d7fff700 1 --2- 172.21.15.71:0/3401205371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51d8159a60 0x7f51d80c9770 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f51c80098e0 tx=0x7f51c80091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.247+0000 7f51d7fff700 1 -- 172.21.15.71:0/3401205371 shutdown_connections 2023-10-09T07:00:08.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.247+0000 7f51d7fff700 1 --2- 172.21.15.71:0/3401205371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51d8159a60 0x7f51d80c9770 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.247+0000 7f51d7fff700 1 -- 172.21.15.71:0/3401205371 >> 172.21.15.71:0/3401205371 conn(0x7f51d806baa0 msgr2=0x7f51d806bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:08.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.248+0000 7f51d7fff700 1 -- 172.21.15.71:0/3401205371 shutdown_connections 2023-10-09T07:00:08.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.248+0000 7f51d7fff700 1 -- 172.21.15.71:0/3401205371 wait complete. 2023-10-09T07:00:08.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.249+0000 7f51d7fff700 1 Processor -- start 2023-10-09T07:00:08.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.249+0000 7f51d7fff700 1 -- start start 2023-10-09T07:00:08.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.250+0000 7f51d7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51d80cb230 0x7f51d816a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:08.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.250+0000 7f51d7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51d80ccc00 0x7f51d8153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:08.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.250+0000 7f51d7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51d8159a60 0x7f51d80c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:08.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.250+0000 7f51d7fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d80b3790 con 0x7f51d80cb230 2023-10-09T07:00:08.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.250+0000 7f51d7fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d816ae50 con 0x7f51d8159a60 2023-10-09T07:00:08.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.250+0000 7f51d7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d80b0be0 con 0x7f51d80ccc00 2023-10-09T07:00:08.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.250+0000 7f51d6ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51d80cb230 0x7f51d816a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:08.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.250+0000 7f51d6ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51d80cb230 0x7f51d816a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34638/0 (socket says 172.21.15.71:34638) 2023-10-09T07:00:08.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.250+0000 7f51d6ffd700 1 -- 172.21.15.71:0/4067922398 learned_addr learned my addr 172.21.15.71:0/4067922398 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:08.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.250+0000 7f51d77fe700 1 --2- 172.21.15.71:0/4067922398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51d8159a60 0x7f51d80c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:08.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.250+0000 7f51d67fc700 1 --2- 172.21.15.71:0/4067922398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51d80ccc00 0x7f51d8153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:08.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.251+0000 7f51d6ffd700 1 -- 172.21.15.71:0/4067922398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51d80ccc00 msgr2=0x7f51d8153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:08.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.251+0000 7f51d6ffd700 1 --2- 172.21.15.71:0/4067922398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51d80ccc00 0x7f51d8153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.251+0000 7f51d6ffd700 1 -- 172.21.15.71:0/4067922398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51d8159a60 msgr2=0x7f51d80c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:08.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.251+0000 7f51d6ffd700 1 --2- 172.21.15.71:0/4067922398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51d8159a60 0x7f51d80c6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.251+0000 7f51d6ffd700 1 -- 172.21.15.71:0/4067922398 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c8009420 con 0x7f51d80cb230 2023-10-09T07:00:08.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.251+0000 7f51d6ffd700 1 --2- 172.21.15.71:0/4067922398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51d80cb230 0x7f51d816a910 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f51c8009ed0 tx=0x7f51c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:08.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.251+0000 7f51beffd700 1 -- 172.21.15.71:0/4067922398 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c801f070 con 0x7f51d80cb230 2023-10-09T07:00:08.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.251+0000 7f51beffd700 1 -- 172.21.15.71:0/4067922398 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c8002f70 con 0x7f51d80cb230 2023-10-09T07:00:08.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.251+0000 7f51beffd700 1 -- 172.21.15.71:0/4067922398 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c8011900 con 0x7f51d80cb230 2023-10-09T07:00:08.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.251+0000 7f51d7fff700 1 -- 172.21.15.71:0/4067922398 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d80b3db0 con 0x7f51d80cb230 2023-10-09T07:00:08.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.251+0000 7f51d7fff700 1 -- 172.21.15.71:0/4067922398 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d80b34b0 con 0x7f51d80cb230 2023-10-09T07:00:08.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.252+0000 7f51d7fff700 1 -- 172.21.15.71:0/4067922398 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51d80b3030 con 0x7f51d80cb230 2023-10-09T07:00:08.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.253+0000 7f51beffd700 1 -- 172.21.15.71:0/4067922398 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 46) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f51c8023070 con 0x7f51d80cb230 2023-10-09T07:00:08.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.255+0000 7f51beffd700 1 --2- 172.21.15.71:0/4067922398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f51c4067170 0x7f51c4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:08.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.255+0000 7f51beffd700 1 -- 172.21.15.71:0/4067922398 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6384+0+0 (secure 0 0 0) 0x7f51c8085ee0 con 0x7f51d80cb230 2023-10-09T07:00:08.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.255+0000 7f51d67fc700 1 -- 172.21.15.71:0/4067922398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f51c4067170 msgr2=0x7f51c4069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T07:00:08.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.255+0000 7f51d67fc700 1 --2- 172.21.15.71:0/4067922398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f51c4067170 0x7f51c4069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:00:08.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.259+0000 7f51beffd700 1 -- 172.21.15.71:0/4067922398 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51d80b3030 con 0x7f51d80cb230 2023-10-09T07:00:08.261 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:08.260+0000 7eff3ce86180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T07:00:08.317 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:08.316+0000 7fb940e35180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T07:00:08.347 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:08.347+0000 7eff3ce86180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T07:00:08.403 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:08.402+0000 7fb940e35180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T07:00:08.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.455+0000 7f51d7fff700 1 -- 172.21.15.71:0/4067922398 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51d80b3030 con 0x7f51d80cb230 2023-10-09T07:00:08.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.455+0000 7f51beffd700 1 -- 172.21.15.71:0/4067922398 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51d80b3030 con 0x7f51d80cb230 2023-10-09T07:00:08.457 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T07:00:08.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.456+0000 7f51d67fc700 1 -- 172.21.15.71:0/4067922398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f51c4067170 msgr2=0x7f51c4069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T07:00:08.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.456+0000 7f51d67fc700 1 --2- 172.21.15.71:0/4067922398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f51c4067170 0x7f51c4069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:00:08.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.458+0000 7f51d7fff700 1 -- 172.21.15.71:0/4067922398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f51c4067170 msgr2=0x7f51c4069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:00:08.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.458+0000 7f51d7fff700 1 --2- 172.21.15.71:0/4067922398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f51c4067170 0x7f51c4069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.458+0000 7f51d7fff700 1 -- 172.21.15.71:0/4067922398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51d80cb230 msgr2=0x7f51d816a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:08.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.458+0000 7f51d7fff700 1 --2- 172.21.15.71:0/4067922398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51d80cb230 0x7f51d816a910 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f51c8009ed0 tx=0x7f51c8017000 comp rx=0 tx=0).stop 2023-10-09T07:00:08.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.458+0000 7f51d7fff700 1 -- 172.21.15.71:0/4067922398 shutdown_connections 2023-10-09T07:00:08.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.458+0000 7f51d7fff700 1 --2- 172.21.15.71:0/4067922398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51d8159a60 0x7f51d80c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.458+0000 7f51d7fff700 1 --2- 172.21.15.71:0/4067922398 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f51c4067170 0x7f51c4069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.458+0000 7f51d7fff700 1 --2- 172.21.15.71:0/4067922398 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51d80cb230 0x7f51d816a910 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.458+0000 7f51d7fff700 1 --2- 172.21.15.71:0/4067922398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51d80ccc00 0x7f51d8153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.458+0000 7f51d7fff700 1 -- 172.21.15.71:0/4067922398 >> 172.21.15.71:0/4067922398 conn(0x7f51d806baa0 msgr2=0x7f51d806abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:08.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.458+0000 7f51d7fff700 1 -- 172.21.15.71:0/4067922398 shutdown_connections 2023-10-09T07:00:08.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.458+0000 7f51d7fff700 1 -- 172.21.15.71:0/4067922398 wait complete. 2023-10-09T07:00:08.479 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T07:00:08.572 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:08.572+0000 7eff3ce86180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:00:08.637 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:08.636+0000 7fb940e35180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:00:08.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.669+0000 7f3d949fe700 1 Processor -- start 2023-10-09T07:00:08.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.669+0000 7f3d949fe700 1 -- start start 2023-10-09T07:00:08.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.670+0000 7f3d949fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d901407e0 0x7f3d9006a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:08.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.670+0000 7f3d949fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3d90140bb0 0x7f3d9006a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:08.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.670+0000 7f3d949fe700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d900c6820 con 0x7f3d9006d4f0 2023-10-09T07:00:08.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.670+0000 7f3d949fe700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d900c6de0 con 0x7f3d90140bb0 2023-10-09T07:00:08.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.670+0000 7f3d949fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d90141270 con 0x7f3d901407e0 2023-10-09T07:00:08.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.671+0000 7f3d8f59e700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3d9006d4f0 0x7f3d9015b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56210/0 (socket says 172.21.15.71:56210) 2023-10-09T07:00:08.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.671+0000 7f3d8f59e700 1 -- 172.21.15.71:0/3114895735 learned_addr learned my addr 172.21.15.71:0/3114895735 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:08.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.671+0000 7f3d8e59c700 1 --2- 172.21.15.71:0/3114895735 >> v2:172.21.15.71:3300/0 conn(0x7f3d90140bb0 0x7f3d9006a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:08.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.671+0000 7f3d8ed9d700 1 --2- 172.21.15.71:0/3114895735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d901407e0 0x7f3d9006a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:08.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.671+0000 7f3d8dd9b700 1 -- 172.21.15.71:0/3114895735 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388358291 0 0) 0x7f3d900c6820 con 0x7f3d9006d4f0 2023-10-09T07:00:08.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.671+0000 7f3d8dd9b700 1 -- 172.21.15.71:0/3114895735 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d78003570 con 0x7f3d9006d4f0 2023-10-09T07:00:08.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.671+0000 7f3d8e59c700 1 -- 172.21.15.71:0/3114895735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d901407e0 msgr2=0x7f3d9006a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:08.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.671+0000 7f3d8e59c700 1 --2- 172.21.15.71:0/3114895735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d901407e0 0x7f3d9006a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.671+0000 7f3d8e59c700 1 -- 172.21.15.71:0/3114895735 >> v1:172.21.15.71:6789/0 conn(0x7f3d9006d4f0 legacy=0x7f3d9015b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:08.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.671+0000 7f3d8e59c700 1 -- 172.21.15.71:0/3114895735 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9006acf0 con 0x7f3d90140bb0 2023-10-09T07:00:08.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.671+0000 7f3d8e59c700 1 --2- 172.21.15.71:0/3114895735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d90140bb0 0x7f3d9006a6c0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f3d840098e0 tx=0x7f3d840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47693c11fe29e30d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:08.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.672+0000 7f3d8dd9b700 1 -- 172.21.15.71:0/3114895735 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84011630 con 0x7f3d90140bb0 2023-10-09T07:00:08.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.672+0000 7f3d8dd9b700 1 -- 172.21.15.71:0/3114895735 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d84011790 con 0x7f3d90140bb0 2023-10-09T07:00:08.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.672+0000 7f3d8dd9b700 1 -- 172.21.15.71:0/3114895735 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84011b30 con 0x7f3d90140bb0 2023-10-09T07:00:08.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.672+0000 7f3d949fe700 1 -- 172.21.15.71:0/3114895735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d90140bb0 msgr2=0x7f3d9006a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:08.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.672+0000 7f3d949fe700 1 --2- 172.21.15.71:0/3114895735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d90140bb0 0x7f3d9006a6c0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f3d840098e0 tx=0x7f3d840091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.672+0000 7f3d949fe700 1 -- 172.21.15.71:0/3114895735 shutdown_connections 2023-10-09T07:00:08.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.672+0000 7f3d949fe700 1 --2- 172.21.15.71:0/3114895735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d901407e0 0x7f3d9006a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.672+0000 7f3d949fe700 1 --2- 172.21.15.71:0/3114895735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d90140bb0 0x7f3d9006a6c0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.672+0000 7f3d949fe700 1 -- 172.21.15.71:0/3114895735 >> 172.21.15.71:0/3114895735 conn(0x7f3d900cc1e0 msgr2=0x7f3d900cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:08.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.672+0000 7f3d949fe700 1 -- 172.21.15.71:0/3114895735 shutdown_connections 2023-10-09T07:00:08.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.672+0000 7f3d949fe700 1 -- 172.21.15.71:0/3114895735 wait complete. 2023-10-09T07:00:08.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.674+0000 7f3d949fe700 1 Processor -- start 2023-10-09T07:00:08.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.674+0000 7f3d949fe700 1 -- start start 2023-10-09T07:00:08.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.675+0000 7f3d949fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d9006d4f0 0x7f3d9013f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:08.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.675+0000 7f3d949fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d901407e0 0x7f3d900c5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:08.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.675+0000 7f3d949fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d90140bb0 0x7f3d900c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:08.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.675+0000 7f3d949fe700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9016acd0 con 0x7f3d90140bb0 2023-10-09T07:00:08.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.675+0000 7f3d949fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9016a0c0 con 0x7f3d9006d4f0 2023-10-09T07:00:08.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.675+0000 7f3d949fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9016a3a0 con 0x7f3d901407e0 2023-10-09T07:00:08.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.675+0000 7f3d8f59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d90140bb0 0x7f3d900c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:08.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.675+0000 7f3d8f59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d90140bb0 0x7f3d900c5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34656/0 (socket says 172.21.15.71:34656) 2023-10-09T07:00:08.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.675+0000 7f3d8f59e700 1 -- 172.21.15.71:0/342250016 learned_addr learned my addr 172.21.15.71:0/342250016 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:08.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.675+0000 7f3d8ed9d700 1 --2- 172.21.15.71:0/342250016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d9006d4f0 0x7f3d9013f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:08.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.675+0000 7f3d8e59c700 1 --2- 172.21.15.71:0/342250016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d901407e0 0x7f3d900c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:08.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.675+0000 7f3d8f59e700 1 -- 172.21.15.71:0/342250016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d901407e0 msgr2=0x7f3d900c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:08.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.675+0000 7f3d8f59e700 1 --2- 172.21.15.71:0/342250016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d901407e0 0x7f3d900c5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.675+0000 7f3d8f59e700 1 -- 172.21.15.71:0/342250016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d9006d4f0 msgr2=0x7f3d9013f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:08.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.675+0000 7f3d8f59e700 1 --2- 172.21.15.71:0/342250016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d9006d4f0 0x7f3d9013f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.675+0000 7f3d8f59e700 1 -- 172.21.15.71:0/342250016 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d84009420 con 0x7f3d90140bb0 2023-10-09T07:00:08.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.676+0000 7f3d8f59e700 1 --2- 172.21.15.71:0/342250016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d90140bb0 0x7f3d900c5bd0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f3d88001460 tx=0x7f3d88001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:08.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.676+0000 7f3d76ffd700 1 -- 172.21.15.71:0/342250016 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8800a890 con 0x7f3d90140bb0 2023-10-09T07:00:08.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.676+0000 7f3d76ffd700 1 -- 172.21.15.71:0/342250016 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8800a9f0 con 0x7f3d90140bb0 2023-10-09T07:00:08.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.676+0000 7f3d76ffd700 1 -- 172.21.15.71:0/342250016 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8800ad70 con 0x7f3d90140bb0 2023-10-09T07:00:08.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.676+0000 7f3d949fe700 1 -- 172.21.15.71:0/342250016 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d9016a680 con 0x7f3d90140bb0 2023-10-09T07:00:08.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.676+0000 7f3d949fe700 1 -- 172.21.15.71:0/342250016 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d90169dd0 con 0x7f3d90140bb0 2023-10-09T07:00:08.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.677+0000 7f3d949fe700 1 -- 172.21.15.71:0/342250016 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d9006c450 con 0x7f3d90140bb0 2023-10-09T07:00:08.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.678+0000 7f3d76ffd700 1 -- 172.21.15.71:0/342250016 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 46) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f3d88007300 con 0x7f3d90140bb0 2023-10-09T07:00:08.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.679+0000 7f3d76ffd700 1 --2- 172.21.15.71:0/342250016 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3d7c067170 0x7f3d7c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:08.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.679+0000 7f3d76ffd700 1 -- 172.21.15.71:0/342250016 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6384+0+0 (secure 0 0 0) 0x7f3d88084f80 con 0x7f3d90140bb0 2023-10-09T07:00:08.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.679+0000 7f3d8ed9d700 1 -- 172.21.15.71:0/342250016 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3d7c067170 msgr2=0x7f3d7c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T07:00:08.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.679+0000 7f3d8ed9d700 1 --2- 172.21.15.71:0/342250016 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3d7c067170 0x7f3d7c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:00:08.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.683+0000 7f3d76ffd700 1 -- 172.21.15.71:0/342250016 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d88051c30 con 0x7f3d90140bb0 2023-10-09T07:00:08.751 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:08.750+0000 7eff3ce86180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T07:00:08.827 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:08.826+0000 7fb940e35180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T07:00:08.849 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:08.848+0000 7eff3ce86180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T07:00:08.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.880+0000 7f3d8ed9d700 1 -- 172.21.15.71:0/342250016 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3d7c067170 msgr2=0x7f3d7c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T07:00:08.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.880+0000 7f3d8ed9d700 1 --2- 172.21.15.71:0/342250016 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3d7c067170 0x7f3d7c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:00:08.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.891+0000 7f3d949fe700 1 -- 172.21.15.71:0/342250016 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3d9006afd0 con 0x7f3d90140bb0 2023-10-09T07:00:08.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.891+0000 7f3d76ffd700 1 -- 172.21.15.71:0/342250016 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3d88055250 con 0x7f3d90140bb0 2023-10-09T07:00:08.892 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-09T07:00:08.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.895+0000 7f3d949fe700 1 -- 172.21.15.71:0/342250016 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3d7c067170 msgr2=0x7f3d7c069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:00:08.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.895+0000 7f3d949fe700 1 --2- 172.21.15.71:0/342250016 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3d7c067170 0x7f3d7c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.895+0000 7f3d949fe700 1 -- 172.21.15.71:0/342250016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d90140bb0 msgr2=0x7f3d900c5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:08.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.895+0000 7f3d949fe700 1 --2- 172.21.15.71:0/342250016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d90140bb0 0x7f3d900c5bd0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f3d88001460 tx=0x7f3d88001ae0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.895+0000 7f3d949fe700 1 -- 172.21.15.71:0/342250016 shutdown_connections 2023-10-09T07:00:08.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.895+0000 7f3d949fe700 1 --2- 172.21.15.71:0/342250016 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f3d7c067170 0x7f3d7c069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.895+0000 7f3d949fe700 1 --2- 172.21.15.71:0/342250016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d90140bb0 0x7f3d900c5bd0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.895+0000 7f3d949fe700 1 --2- 172.21.15.71:0/342250016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d9006d4f0 0x7f3d9013f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.895+0000 7f3d949fe700 1 --2- 172.21.15.71:0/342250016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d901407e0 0x7f3d900c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:08.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.895+0000 7f3d949fe700 1 -- 172.21.15.71:0/342250016 >> 172.21.15.71:0/342250016 conn(0x7f3d900cc1e0 msgr2=0x7f3d9013faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:08.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.895+0000 7f3d949fe700 1 -- 172.21.15.71:0/342250016 shutdown_connections 2023-10-09T07:00:08.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:08.895+0000 7f3d949fe700 1 -- 172.21.15.71:0/342250016 wait complete. 2023-10-09T07:00:08.913 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T07:00:08.924 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:08.924+0000 7fb940e35180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T07:00:09.012 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:09.012+0000 7eff3ce86180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T07:00:09.092 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:09.092+0000 7fb940e35180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T07:00:09.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.101+0000 7fc2cf19d700 1 Processor -- start 2023-10-09T07:00:09.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.101+0000 7fc2cf19d700 1 -- start start 2023-10-09T07:00:09.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.102+0000 7fc2cf19d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc2c80aef00 0x7fc2c815d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:09.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.102+0000 7fc2cf19d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c80aea70 con 0x7fc2c815a3b0 2023-10-09T07:00:09.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.102+0000 7fc2cf19d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c80ae480 con 0x7fc2c806e470 2023-10-09T07:00:09.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.102+0000 7fc2cf19d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c815dd30 con 0x7fc2c80aef00 2023-10-09T07:00:09.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.103+0000 7fc2ce19b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc2c815a3b0 0x7fc2c815a780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56224/0 (socket says 172.21.15.71:56224) 2023-10-09T07:00:09.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.103+0000 7fc2ce19b700 1 -- 172.21.15.71:0/1930901248 learned_addr learned my addr 172.21.15.71:0/1930901248 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:09.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.103+0000 7fc2cd99a700 1 --2- 172.21.15.71:0/1930901248 >> v2:172.21.15.71:3300/0 conn(0x7fc2c80aef00 0x7fc2c815d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:09.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.103+0000 7fc2cd199700 1 -- 172.21.15.71:0/1930901248 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286160063 0 0) 0x7fc2c80aea70 con 0x7fc2c815a3b0 2023-10-09T07:00:09.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.103+0000 7fc2cd199700 1 -- 172.21.15.71:0/1930901248 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2b4003570 con 0x7fc2c815a3b0 2023-10-09T07:00:09.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.103+0000 7fc2cd99a700 1 -- 172.21.15.71:0/1930901248 >> v1:172.21.15.179:6789/0 conn(0x7fc2c806e470 legacy=0x7fc2c80c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:09.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.103+0000 7fc2cd99a700 1 -- 172.21.15.71:0/1930901248 >> v1:172.21.15.71:6789/0 conn(0x7fc2c815a3b0 legacy=0x7fc2c815a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:09.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.103+0000 7fc2cd99a700 1 -- 172.21.15.71:0/1930901248 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c815e010 con 0x7fc2c80aef00 2023-10-09T07:00:09.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.104+0000 7fc2cd99a700 1 --2- 172.21.15.71:0/1930901248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2c80aef00 0x7fc2c815d3c0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80098e0 tx=0x7fc2b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef57424ed62d2b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:09.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.104+0000 7fc2cd199700 1 -- 172.21.15.71:0/1930901248 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b800b640 con 0x7fc2c80aef00 2023-10-09T07:00:09.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.104+0000 7fc2cd199700 1 -- 172.21.15.71:0/1930901248 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b800b7a0 con 0x7fc2c80aef00 2023-10-09T07:00:09.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.104+0000 7fc2cd199700 1 -- 172.21.15.71:0/1930901248 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b800bb40 con 0x7fc2c80aef00 2023-10-09T07:00:09.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.104+0000 7fc2cf19d700 1 -- 172.21.15.71:0/1930901248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2c80aef00 msgr2=0x7fc2c815d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:09.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.104+0000 7fc2cf19d700 1 --2- 172.21.15.71:0/1930901248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2c80aef00 0x7fc2c815d3c0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80098e0 tx=0x7fc2b80091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:09.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.105+0000 7fc2cf19d700 1 -- 172.21.15.71:0/1930901248 shutdown_connections 2023-10-09T07:00:09.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.105+0000 7fc2cf19d700 1 --2- 172.21.15.71:0/1930901248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2c80aef00 0x7fc2c815d3c0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:09.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.105+0000 7fc2cf19d700 1 -- 172.21.15.71:0/1930901248 >> 172.21.15.71:0/1930901248 conn(0x7fc2c80c9f70 msgr2=0x7fc2c806dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:09.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.105+0000 7fc2cf19d700 1 -- 172.21.15.71:0/1930901248 shutdown_connections 2023-10-09T07:00:09.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.105+0000 7fc2cf19d700 1 -- 172.21.15.71:0/1930901248 wait complete. 2023-10-09T07:00:09.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.106+0000 7fc2cf19d700 1 Processor -- start 2023-10-09T07:00:09.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.106+0000 7fc2cf19d700 1 -- start start 2023-10-09T07:00:09.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.107+0000 7fc2cf19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2c806e470 0x7fc2c80b2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:09.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.107+0000 7fc2cf19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2c80aef00 0x7fc2c8169af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:09.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.107+0000 7fc2cf19d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2c815a3b0 0x7fc2c8151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:09.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.107+0000 7fc2cf19d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c816b030 con 0x7fc2c815a3b0 2023-10-09T07:00:09.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.107+0000 7fc2cf19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c816a3b0 con 0x7fc2c806e470 2023-10-09T07:00:09.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.107+0000 7fc2cf19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c816a690 con 0x7fc2c80aef00 2023-10-09T07:00:09.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.107+0000 7fc2ce19b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2c806e470 0x7fc2c80b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:09.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.107+0000 7fc2ce99c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2c815a3b0 0x7fc2c8151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:09.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.107+0000 7fc2ce19b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2c806e470 0x7fc2c80b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:53668/0 (socket says 172.21.15.71:53668) 2023-10-09T07:00:09.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.107+0000 7fc2ce19b700 1 -- 172.21.15.71:0/237557046 learned_addr learned my addr 172.21.15.71:0/237557046 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:09.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.107+0000 7fc2ce99c700 1 --2- 172.21.15.71:0/237557046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2c815a3b0 0x7fc2c8151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34668/0 (socket says 172.21.15.71:34668) 2023-10-09T07:00:09.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.107+0000 7fc2cd99a700 1 --2- 172.21.15.71:0/237557046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2c80aef00 0x7fc2c8169af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:09.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.108+0000 7fc2ce99c700 1 -- 172.21.15.71:0/237557046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2c80aef00 msgr2=0x7fc2c8169af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:09.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.108+0000 7fc2ce99c700 1 --2- 172.21.15.71:0/237557046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2c80aef00 0x7fc2c8169af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:09.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.108+0000 7fc2ce99c700 1 -- 172.21.15.71:0/237557046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2c806e470 msgr2=0x7fc2c80b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:09.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.108+0000 7fc2ce99c700 1 --2- 172.21.15.71:0/237557046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2c806e470 0x7fc2c80b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:09.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.108+0000 7fc2ce99c700 1 -- 172.21.15.71:0/237557046 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b8009420 con 0x7fc2c815a3b0 2023-10-09T07:00:09.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.108+0000 7fc2ce99c700 1 --2- 172.21.15.71:0/237557046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2c815a3b0 0x7fc2c8151ca0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000c830 tx=0x7fc2c0001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:09.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.108+0000 7fc2be7fc700 1 -- 172.21.15.71:0/237557046 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0012630 con 0x7fc2c815a3b0 2023-10-09T07:00:09.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.108+0000 7fc2be7fc700 1 -- 172.21.15.71:0/237557046 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c0012790 con 0x7fc2c815a3b0 2023-10-09T07:00:09.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.108+0000 7fc2be7fc700 1 -- 172.21.15.71:0/237557046 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0012b50 con 0x7fc2c815a3b0 2023-10-09T07:00:09.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.108+0000 7fc2cf19d700 1 -- 172.21.15.71:0/237557046 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c816a970 con 0x7fc2c815a3b0 2023-10-09T07:00:09.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.108+0000 7fc2cf19d700 1 -- 172.21.15.71:0/237557046 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c816a030 con 0x7fc2c815a3b0 2023-10-09T07:00:09.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.110+0000 7fc2cf19d700 1 -- 172.21.15.71:0/237557046 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c80c8110 con 0x7fc2c815a3b0 2023-10-09T07:00:09.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.110+0000 7fc2be7fc700 1 -- 172.21.15.71:0/237557046 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 46) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fc2c0011380 con 0x7fc2c815a3b0 2023-10-09T07:00:09.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.111+0000 7fc2be7fc700 1 --2- 172.21.15.71:0/237557046 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc2ac067170 0x7fc2ac069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:09.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.111+0000 7fc2be7fc700 1 -- 172.21.15.71:0/237557046 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6384+0+0 (secure 0 0 0) 0x7fc2c0084ca0 con 0x7fc2c815a3b0 2023-10-09T07:00:09.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.111+0000 7fc2ce19b700 1 -- 172.21.15.71:0/237557046 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc2ac067170 msgr2=0x7fc2ac069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T07:00:09.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.111+0000 7fc2ce19b700 1 --2- 172.21.15.71:0/237557046 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc2ac067170 0x7fc2ac069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:00:09.113 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:09.113+0000 7eff3ce86180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T07:00:09.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.115+0000 7fc2be7fc700 1 -- 172.21.15.71:0/237557046 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2c0051960 con 0x7fc2c815a3b0 2023-10-09T07:00:09.197 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:09.197+0000 7fb940e35180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T07:00:09.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.308+0000 7fc2cf19d700 1 -- 172.21.15.71:0/237557046 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc2c80ae700 con 0x7fc2c815a3b0 2023-10-09T07:00:09.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.309+0000 7fc2be7fc700 1 -- 172.21.15.71:0/237557046 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v110) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc2c0054f80 con 0x7fc2c815a3b0 2023-10-09T07:00:09.309 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-09T07:00:09.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.311+0000 7fc2cf19d700 1 -- 172.21.15.71:0/237557046 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc2ac067170 msgr2=0x7fc2ac069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:00:09.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.311+0000 7fc2cf19d700 1 --2- 172.21.15.71:0/237557046 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc2ac067170 0x7fc2ac069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:09.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.311+0000 7fc2cf19d700 1 -- 172.21.15.71:0/237557046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2c815a3b0 msgr2=0x7fc2c8151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:09.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.311+0000 7fc2cf19d700 1 --2- 172.21.15.71:0/237557046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2c815a3b0 0x7fc2c8151ca0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000c830 tx=0x7fc2c0001690 comp rx=0 tx=0).stop 2023-10-09T07:00:09.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.311+0000 7fc2cf19d700 1 -- 172.21.15.71:0/237557046 shutdown_connections 2023-10-09T07:00:09.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.311+0000 7fc2cf19d700 1 --2- 172.21.15.71:0/237557046 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fc2ac067170 0x7fc2ac069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:09.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.311+0000 7fc2cf19d700 1 --2- 172.21.15.71:0/237557046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2c815a3b0 0x7fc2c8151ca0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:09.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.311+0000 7fc2cf19d700 1 --2- 172.21.15.71:0/237557046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2c806e470 0x7fc2c80b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:09.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.311+0000 7fc2cf19d700 1 --2- 172.21.15.71:0/237557046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2c80aef00 0x7fc2c8169af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:09.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.311+0000 7fc2cf19d700 1 -- 172.21.15.71:0/237557046 >> 172.21.15.71:0/237557046 conn(0x7fc2c80c9f70 msgr2=0x7fc2c80704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:09.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.311+0000 7fc2cf19d700 1 -- 172.21.15.71:0/237557046 shutdown_connections 2023-10-09T07:00:09.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.311+0000 7fc2cf19d700 1 -- 172.21.15.71:0/237557046 wait complete. 2023-10-09T07:00:09.328 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:00:09.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.558+0000 7f2ce519d700 1 Processor -- start 2023-10-09T07:00:09.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.558+0000 7f2ce519d700 1 -- start start 2023-10-09T07:00:09.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.559+0000 7f2ce519d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2ce01597f0 0x7f2ce00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:09.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.559+0000 7f2ce519d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ce015d230 0x7f2ce015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:09.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.559+0000 7f2ce519d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce015dbb0 con 0x7f2ce0159420 2023-10-09T07:00:09.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.559+0000 7f2ce519d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce00b11d0 con 0x7f2ce01597f0 2023-10-09T07:00:09.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.559+0000 7f2ce519d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce00b14b0 con 0x7f2ce015d230 2023-10-09T07:00:09.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.559+0000 7f2cdffff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f2ce0159420 0x7f2ce00b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56240/0 (socket says 172.21.15.71:56240) 2023-10-09T07:00:09.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.559+0000 7f2cdffff700 1 -- 172.21.15.71:0/3250701488 learned_addr learned my addr 172.21.15.71:0/3250701488 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:09.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.559+0000 7f2cdf7fe700 1 --2- 172.21.15.71:0/3250701488 >> v2:172.21.15.71:3300/0 conn(0x7f2ce01597f0 0x7f2ce00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:09.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.560+0000 7f2ce499c700 1 --2- 172.21.15.71:0/3250701488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ce015d230 0x7f2ce015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:09.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.560+0000 7f2cdeffd700 1 -- 172.21.15.71:0/3250701488 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1011487363 0 0) 0x7f2ce015dbb0 con 0x7f2ce0159420 2023-10-09T07:00:09.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.560+0000 7f2cdeffd700 1 -- 172.21.15.71:0/3250701488 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cc8003570 con 0x7f2ce0159420 2023-10-09T07:00:09.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.560+0000 7f2cdf7fe700 1 -- 172.21.15.71:0/3250701488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ce015d230 msgr2=0x7f2ce015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:09.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.560+0000 7f2cdf7fe700 1 --2- 172.21.15.71:0/3250701488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ce015d230 0x7f2ce015d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:09.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.560+0000 7f2cdf7fe700 1 -- 172.21.15.71:0/3250701488 >> v1:172.21.15.71:6789/0 conn(0x7f2ce0159420 legacy=0x7f2ce00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:09.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.560+0000 7f2cdf7fe700 1 -- 172.21.15.71:0/3250701488 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce00b1790 con 0x7f2ce01597f0 2023-10-09T07:00:09.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.560+0000 7f2cdf7fe700 1 --2- 172.21.15.71:0/3250701488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ce01597f0 0x7f2ce00b2270 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40098e0 tx=0x7f2cd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb998a13ac1d8e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:09.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.560+0000 7f2cdeffd700 1 -- 172.21.15.71:0/3250701488 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4011630 con 0x7f2ce01597f0 2023-10-09T07:00:09.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.561+0000 7f2cdeffd700 1 -- 172.21.15.71:0/3250701488 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd4011790 con 0x7f2ce01597f0 2023-10-09T07:00:09.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.561+0000 7f2cdeffd700 1 -- 172.21.15.71:0/3250701488 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4011b30 con 0x7f2ce01597f0 2023-10-09T07:00:09.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.561+0000 7f2ce519d700 1 -- 172.21.15.71:0/3250701488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ce01597f0 msgr2=0x7f2ce00b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:09.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.561+0000 7f2ce519d700 1 --2- 172.21.15.71:0/3250701488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ce01597f0 0x7f2ce00b2270 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40098e0 tx=0x7f2cd40091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:09.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.561+0000 7f2ce519d700 1 -- 172.21.15.71:0/3250701488 shutdown_connections 2023-10-09T07:00:09.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.561+0000 7f2ce519d700 1 --2- 172.21.15.71:0/3250701488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ce015d230 0x7f2ce015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:09.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.561+0000 7f2ce519d700 1 --2- 172.21.15.71:0/3250701488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ce01597f0 0x7f2ce00b2270 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:09.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.561+0000 7f2ce519d700 1 -- 172.21.15.71:0/3250701488 >> 172.21.15.71:0/3250701488 conn(0x7f2ce00d0660 msgr2=0x7f2ce00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:09.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.561+0000 7f2ce519d700 1 -- 172.21.15.71:0/3250701488 shutdown_connections 2023-10-09T07:00:09.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.561+0000 7f2ce519d700 1 -- 172.21.15.71:0/3250701488 wait complete. 2023-10-09T07:00:09.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.563+0000 7f2ce519d700 1 Processor -- start 2023-10-09T07:00:09.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.563+0000 7f2ce519d700 1 -- start start 2023-10-09T07:00:09.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.564+0000 7f2ce519d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ce0159420 0x7f2ce015b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:09.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.564+0000 7f2ce519d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ce01597f0 0x7f2ce00c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:09.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.564+0000 7f2ce519d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ce015d230 0x7f2ce015c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:09.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.564+0000 7f2ce519d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce00c78c0 con 0x7f2ce01597f0 2023-10-09T07:00:09.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.564+0000 7f2ce519d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce00c69f0 con 0x7f2ce0159420 2023-10-09T07:00:09.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.564+0000 7f2ce519d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce015c430 con 0x7f2ce015d230 2023-10-09T07:00:09.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.564+0000 7f2cdf7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ce01597f0 0x7f2ce00c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:09.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.564+0000 7f2cdf7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ce01597f0 0x7f2ce00c64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34692/0 (socket says 172.21.15.71:34692) 2023-10-09T07:00:09.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.564+0000 7f2cdf7fe700 1 -- 172.21.15.71:0/1383109860 learned_addr learned my addr 172.21.15.71:0/1383109860 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:09.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.564+0000 7f2cdffff700 1 --2- 172.21.15.71:0/1383109860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ce0159420 0x7f2ce015b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:09.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.564+0000 7f2ce499c700 1 --2- 172.21.15.71:0/1383109860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ce015d230 0x7f2ce015c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:09.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.564+0000 7f2cdf7fe700 1 -- 172.21.15.71:0/1383109860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ce015d230 msgr2=0x7f2ce015c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:09.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.564+0000 7f2cdf7fe700 1 --2- 172.21.15.71:0/1383109860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ce015d230 0x7f2ce015c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:09.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.564+0000 7f2cdf7fe700 1 -- 172.21.15.71:0/1383109860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ce0159420 msgr2=0x7f2ce015b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:09.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.564+0000 7f2cdf7fe700 1 --2- 172.21.15.71:0/1383109860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ce0159420 0x7f2ce015b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:09.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.564+0000 7f2cdf7fe700 1 -- 172.21.15.71:0/1383109860 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd4009420 con 0x7f2ce01597f0 2023-10-09T07:00:09.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.565+0000 7f2cdf7fe700 1 --2- 172.21.15.71:0/1383109860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ce01597f0 0x7f2ce00c64b0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4013000 tx=0x7f2cd4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:09.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.565+0000 7f2cc7fff700 1 -- 172.21.15.71:0/1383109860 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4011900 con 0x7f2ce01597f0 2023-10-09T07:00:09.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.565+0000 7f2cc7fff700 1 -- 172.21.15.71:0/1383109860 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd4011a60 con 0x7f2ce01597f0 2023-10-09T07:00:09.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.565+0000 7f2ce519d700 1 -- 172.21.15.71:0/1383109860 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce015b820 con 0x7f2ce01597f0 2023-10-09T07:00:09.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.565+0000 7f2cc7fff700 1 -- 172.21.15.71:0/1383109860 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4025640 con 0x7f2ce01597f0 2023-10-09T07:00:09.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.565+0000 7f2ce519d700 1 -- 172.21.15.71:0/1383109860 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce015bde0 con 0x7f2ce01597f0 2023-10-09T07:00:09.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.566+0000 7f2ce519d700 1 -- 172.21.15.71:0/1383109860 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce004c3c0 con 0x7f2ce01597f0 2023-10-09T07:00:09.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.567+0000 7f2cc7fff700 1 -- 172.21.15.71:0/1383109860 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 46) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f2cd4025a30 con 0x7f2ce01597f0 2023-10-09T07:00:09.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.568+0000 7f2cc7fff700 1 --2- 172.21.15.71:0/1383109860 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2ccc067170 0x7f2ccc069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:09.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.568+0000 7f2cc7fff700 1 -- 172.21.15.71:0/1383109860 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6384+0+0 (secure 0 0 0) 0x7f2cd4086280 con 0x7f2ce01597f0 2023-10-09T07:00:09.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.568+0000 7f2cdffff700 1 -- 172.21.15.71:0/1383109860 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2ccc067170 msgr2=0x7f2ccc069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T07:00:09.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.568+0000 7f2cdffff700 1 --2- 172.21.15.71:0/1383109860 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2ccc067170 0x7f2ccc069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:00:09.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.572+0000 7f2cc7fff700 1 -- 172.21.15.71:0/1383109860 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2cd4052f40 con 0x7f2ce01597f0 2023-10-09T07:00:09.612 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:09.612+0000 7eff3ce86180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T07:00:09.703 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:09.703+0000 7fb940e35180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T07:00:09.708 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:09.708+0000 7eff3ce86180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T07:00:09.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.769+0000 7f2cdffff700 1 -- 172.21.15.71:0/1383109860 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2ccc067170 msgr2=0x7f2ccc069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T07:00:09.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.769+0000 7f2cdffff700 1 --2- 172.21.15.71:0/1383109860 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2ccc067170 0x7f2ccc069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:00:09.800 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:09.800+0000 7fb940e35180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T07:00:09.800 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:09.800+0000 7eff3ce86180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T07:00:09.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.814+0000 7f2ce519d700 1 -- 172.21.15.71:0/1383109860 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ce00b1a70 con 0x7f2ce01597f0 2023-10-09T07:00:09.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.815+0000 7f2cc7fff700 1 -- 172.21.15.71:0/1383109860 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f2cd4056560 con 0x7f2ce01597f0 2023-10-09T07:00:09.815 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:00:09.815 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/2945926197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2945926197},{"type":"v1","addr":"172.21.15.71:6834","nonce":2945926197}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1112255645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1112255645},{"type":"v1","addr":"172.21.15.179:6836","nonce":1112255645}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3298180688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":3298180688},{"type":"v1","addr":"172.21.15.71:6835","nonce":3298180688}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:58:43.707312+0000","modified":"2023-10-09T06:58:47.272802+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7152},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7152":{"gid":7152,"name":"d","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/4053543999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":4053543999},{"type":"v1","addr":"172.21.15.179:6837","nonce":4053543999}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T07:00:09.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.817+0000 7f2ce519d700 1 -- 172.21.15.71:0/1383109860 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2ccc067170 msgr2=0x7f2ccc069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:00:09.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.817+0000 7f2ce519d700 1 --2- 172.21.15.71:0/1383109860 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2ccc067170 0x7f2ccc069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:09.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.817+0000 7f2ce519d700 1 -- 172.21.15.71:0/1383109860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ce01597f0 msgr2=0x7f2ce00c64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:09.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.817+0000 7f2ce519d700 1 --2- 172.21.15.71:0/1383109860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ce01597f0 0x7f2ce00c64b0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4013000 tx=0x7f2cd4017000 comp rx=0 tx=0).stop 2023-10-09T07:00:09.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.817+0000 7f2ce519d700 1 -- 172.21.15.71:0/1383109860 shutdown_connections 2023-10-09T07:00:09.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.817+0000 7f2ce519d700 1 --2- 172.21.15.71:0/1383109860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ce015d230 0x7f2ce015c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:09.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.817+0000 7f2ce519d700 1 --2- 172.21.15.71:0/1383109860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ce0159420 0x7f2ce015b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:09.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.817+0000 7f2ce519d700 1 --2- 172.21.15.71:0/1383109860 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f2ccc067170 0x7f2ccc069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:09.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.817+0000 7f2ce519d700 1 --2- 172.21.15.71:0/1383109860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ce01597f0 0x7f2ce00c64b0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:09.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.817+0000 7f2ce519d700 1 -- 172.21.15.71:0/1383109860 >> 172.21.15.71:0/1383109860 conn(0x7f2ce00d0660 msgr2=0x7f2ce00b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:09.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.818+0000 7f2ce519d700 1 -- 172.21.15.71:0/1383109860 shutdown_connections 2023-10-09T07:00:09.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:09.818+0000 7f2ce519d700 1 -- 172.21.15.71:0/1383109860 wait complete. 2023-10-09T07:00:09.819 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 49 2023-10-09T07:00:09.837 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:00:09.897 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:09.898+0000 7fb940e35180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T07:00:10.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.023+0000 7f40e899d700 1 Processor -- start 2023-10-09T07:00:10.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.023+0000 7f40e899d700 1 -- start start 2023-10-09T07:00:10.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.025+0000 7f40e899d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e4159420 0x7f40e40b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:10.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.025+0000 7f40e899d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f40e415d230 0x7f40e415d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:10.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.025+0000 7f40e899d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e415dbd0 con 0x7f40e41597f0 2023-10-09T07:00:10.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.025+0000 7f40e899d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e40b2980 con 0x7f40e415d230 2023-10-09T07:00:10.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.025+0000 7f40e899d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40b11d0 con 0x7f40e4159420 2023-10-09T07:00:10.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.025+0000 7f40e3fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f40e415d230 0x7f40e415d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:10.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.025+0000 7f40e3fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f40e415d230 0x7f40e415d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34696/0 (socket says 172.21.15.71:34696) 2023-10-09T07:00:10.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.025+0000 7f40e3fff700 1 -- 172.21.15.71:0/2932241601 learned_addr learned my addr 172.21.15.71:0/2932241601 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:10.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.025+0000 7f40e2ffd700 1 --1- 172.21.15.71:0/2932241601 >> v1:172.21.15.179:6789/0 conn(0x7f40e41597f0 0x7f40e40b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:58542/0 (socket says 172.21.15.71:58542) 2023-10-09T07:00:10.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.025+0000 7f40e37fe700 1 --2- 172.21.15.71:0/2932241601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e4159420 0x7f40e40b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:10.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.026+0000 7f40e3fff700 1 -- 172.21.15.71:0/2932241601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e4159420 msgr2=0x7f40e40b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:10.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.026+0000 7f40e3fff700 1 --2- 172.21.15.71:0/2932241601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e4159420 0x7f40e40b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.026+0000 7f40e3fff700 1 -- 172.21.15.71:0/2932241601 >> v1:172.21.15.179:6789/0 conn(0x7f40e41597f0 legacy=0x7f40e40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.026+0000 7f40e3fff700 1 -- 172.21.15.71:0/2932241601 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e40b14b0 con 0x7f40e415d230 2023-10-09T07:00:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.026+0000 7f40e3fff700 1 --2- 172.21.15.71:0/2932241601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40e415d230 0x7f40e415d690 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f40dc009f20 tx=0x7f40dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccea3c5f189f806 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.026+0000 7f40e27fc700 1 -- 172.21.15.71:0/2932241601 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc00e070 con 0x7f40e415d230 2023-10-09T07:00:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.026+0000 7f40e27fc700 1 -- 172.21.15.71:0/2932241601 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc00b9d0 con 0x7f40e415d230 2023-10-09T07:00:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.026+0000 7f40e27fc700 1 -- 172.21.15.71:0/2932241601 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc0092e0 con 0x7f40e415d230 2023-10-09T07:00:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.027+0000 7f40e899d700 1 -- 172.21.15.71:0/2932241601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40e415d230 msgr2=0x7f40e415d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.027+0000 7f40e899d700 1 --2- 172.21.15.71:0/2932241601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40e415d230 0x7f40e415d690 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f40dc009f20 tx=0x7f40dc009840 comp rx=0 tx=0).stop 2023-10-09T07:00:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.027+0000 7f40e899d700 1 -- 172.21.15.71:0/2932241601 shutdown_connections 2023-10-09T07:00:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.027+0000 7f40e899d700 1 --2- 172.21.15.71:0/2932241601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40e415d230 0x7f40e415d690 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.027+0000 7f40e899d700 1 --2- 172.21.15.71:0/2932241601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e4159420 0x7f40e40b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.027+0000 7f40e899d700 1 -- 172.21.15.71:0/2932241601 >> 172.21.15.71:0/2932241601 conn(0x7f40e40d0660 msgr2=0x7f40e40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:10.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.027+0000 7f40e899d700 1 -- 172.21.15.71:0/2932241601 shutdown_connections 2023-10-09T07:00:10.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.027+0000 7f40e899d700 1 -- 172.21.15.71:0/2932241601 wait complete. 2023-10-09T07:00:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.028+0000 7f40e899d700 1 Processor -- start 2023-10-09T07:00:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.029+0000 7f40e899d700 1 -- start start 2023-10-09T07:00:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.029+0000 7f40e899d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40e4159420 0x7f40e41545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.029+0000 7f40e899d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e41597f0 0x7f40e40c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.029+0000 7f40e899d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40e415d230 0x7f40e40c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.029+0000 7f40e899d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e416a6b0 con 0x7f40e415d230 2023-10-09T07:00:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.029+0000 7f40e899d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e416a3d0 con 0x7f40e4159420 2023-10-09T07:00:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.029+0000 7f40e899d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40c56c0 con 0x7f40e41597f0 2023-10-09T07:00:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.030+0000 7f40e3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40e415d230 0x7f40e40c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.030+0000 7f40e37fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40e4159420 0x7f40e41545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:10.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.030+0000 7f40e2ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e41597f0 0x7f40e40c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:10.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.030+0000 7f40e3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40e415d230 0x7f40e40c77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34712/0 (socket says 172.21.15.71:34712) 2023-10-09T07:00:10.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.030+0000 7f40e3fff700 1 -- 172.21.15.71:0/2359677698 learned_addr learned my addr 172.21.15.71:0/2359677698 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:10.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.030+0000 7f40e3fff700 1 -- 172.21.15.71:0/2359677698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e41597f0 msgr2=0x7f40e40c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:10.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.030+0000 7f40e3fff700 1 --2- 172.21.15.71:0/2359677698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e41597f0 0x7f40e40c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.030+0000 7f40e3fff700 1 -- 172.21.15.71:0/2359677698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40e4159420 msgr2=0x7f40e41545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:10.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.030+0000 7f40e3fff700 1 --2- 172.21.15.71:0/2359677698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40e4159420 0x7f40e41545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.030+0000 7f40e3fff700 1 -- 172.21.15.71:0/2359677698 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc009ae0 con 0x7f40e415d230 2023-10-09T07:00:10.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.030+0000 7f40e3fff700 1 --2- 172.21.15.71:0/2359677698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40e415d230 0x7f40e40c77b0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00b610 tx=0x7f40dc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:10.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.031+0000 7f40cb7fe700 1 -- 172.21.15.71:0/2359677698 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc008ad0 con 0x7f40e415d230 2023-10-09T07:00:10.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.031+0000 7f40cb7fe700 1 -- 172.21.15.71:0/2359677698 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc008c30 con 0x7f40e415d230 2023-10-09T07:00:10.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.031+0000 7f40e899d700 1 -- 172.21.15.71:0/2359677698 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e40c59a0 con 0x7f40e415d230 2023-10-09T07:00:10.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.031+0000 7f40cb7fe700 1 -- 172.21.15.71:0/2359677698 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc025460 con 0x7f40e415d230 2023-10-09T07:00:10.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.031+0000 7f40e899d700 1 -- 172.21.15.71:0/2359677698 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e40c66e0 con 0x7f40e415d230 2023-10-09T07:00:10.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.032+0000 7f40e899d700 1 -- 172.21.15.71:0/2359677698 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e40c5520 con 0x7f40e415d230 2023-10-09T07:00:10.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.033+0000 7f40cb7fe700 1 -- 172.21.15.71:0/2359677698 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 46) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f40dc003040 con 0x7f40e415d230 2023-10-09T07:00:10.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.034+0000 7f40cb7fe700 1 --2- 172.21.15.71:0/2359677698 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f40d0067170 0x7f40d0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:10.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.034+0000 7f40cb7fe700 1 -- 172.21.15.71:0/2359677698 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6384+0+0 (secure 0 0 0) 0x7f40dc086190 con 0x7f40e415d230 2023-10-09T07:00:10.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.034+0000 7f40e37fe700 1 -- 172.21.15.71:0/2359677698 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f40d0067170 msgr2=0x7f40d0069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T07:00:10.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.034+0000 7f40e37fe700 1 --2- 172.21.15.71:0/2359677698 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f40d0067170 0x7f40d0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:00:10.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.038+0000 7f40cb7fe700 1 -- 172.21.15.71:0/2359677698 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40e40c5520 con 0x7f40e415d230 2023-10-09T07:00:10.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.235+0000 7f40e37fe700 1 -- 172.21.15.71:0/2359677698 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f40d0067170 msgr2=0x7f40d0069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T07:00:10.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.235+0000 7f40e37fe700 1 --2- 172.21.15.71:0/2359677698 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f40d0067170 0x7f40d0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:00:10.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.262+0000 7f40e899d700 1 -- 172.21.15.71:0/2359677698 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40e40c5520 con 0x7f40e415d230 2023-10-09T07:00:10.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.263+0000 7f40cb7fe700 1 -- 172.21.15.71:0/2359677698 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+16381 (secure 0 0 0) 0x7f40e40c5520 con 0x7f40e415d230 2023-10-09T07:00:10.263 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:00:10.264 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":110,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:00:05.799686+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:58:41.817433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T06:58:42.692884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.11","mappings":[{"from":1,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6833/85452":"2023-10-10T06:59:03.833693+0000","172.21.15.179:6832/85452":"2023-10-10T06:59:03.833693+0000","172.21.15.179:0/3295056505":"2023-10-10T06:59:03.833693+0000","172.21.15.179:0/1335773422":"2023-10-10T06:59:03.833693+0000","172.21.15.179:0/2110166133":"2023-10-10T06:59:03.833693+0000","172.21.15.179:0/1934925403":"2023-10-10T06:59:03.833693+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:00:10.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.266+0000 7f40e899d700 1 -- 172.21.15.71:0/2359677698 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f40d0067170 msgr2=0x7f40d0069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:00:10.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.266+0000 7f40e899d700 1 --2- 172.21.15.71:0/2359677698 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f40d0067170 0x7f40d0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.266+0000 7f40e899d700 1 -- 172.21.15.71:0/2359677698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40e415d230 msgr2=0x7f40e40c77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:10.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.266+0000 7f40e899d700 1 --2- 172.21.15.71:0/2359677698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40e415d230 0x7f40e40c77b0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00b610 tx=0x7f40dc018000 comp rx=0 tx=0).stop 2023-10-09T07:00:10.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.266+0000 7f40e899d700 1 -- 172.21.15.71:0/2359677698 shutdown_connections 2023-10-09T07:00:10.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.266+0000 7f40e899d700 1 --2- 172.21.15.71:0/2359677698 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f40d0067170 0x7f40d0069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.266+0000 7f40e899d700 1 --2- 172.21.15.71:0/2359677698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40e415d230 0x7f40e40c77b0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.266+0000 7f40e899d700 1 --2- 172.21.15.71:0/2359677698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40e4159420 0x7f40e41545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.266+0000 7f40e899d700 1 --2- 172.21.15.71:0/2359677698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e41597f0 0x7f40e40c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.266+0000 7f40e899d700 1 -- 172.21.15.71:0/2359677698 >> 172.21.15.71:0/2359677698 conn(0x7f40e40d0660 msgr2=0x7f40e40b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:10.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.266+0000 7f40e899d700 1 -- 172.21.15.71:0/2359677698 shutdown_connections 2023-10-09T07:00:10.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.266+0000 7f40e899d700 1 -- 172.21.15.71:0/2359677698 wait complete. 2023-10-09T07:00:10.284 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T07:00:10.284 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:00:10.423 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:10.423+0000 7eff3ce86180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T07:00:10.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.495+0000 7fd54359e700 1 Processor -- start 2023-10-09T07:00:10.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.495+0000 7fd54359e700 1 -- start start 2023-10-09T07:00:10.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.497+0000 7fd54359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd54415de70 0x7fd54406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:10.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.497+0000 7fd54359e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd5440696c0 0x7fd54406ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:10.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.497+0000 7fd54359e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54406e8c0 con 0x7fd54415daa0 2023-10-09T07:00:10.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.497+0000 7fd54359e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5440ca740 con 0x7fd5440696c0 2023-10-09T07:00:10.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.497+0000 7fd54359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54406e5e0 con 0x7fd54415de70 2023-10-09T07:00:10.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.498+0000 7fd541d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd54415de70 0x7fd54406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:10.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.498+0000 7fd54259c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fd54415daa0 0x7fd5440c7110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:58556/0 (socket says 172.21.15.71:58556) 2023-10-09T07:00:10.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.498+0000 7fd54259c700 1 -- 172.21.15.71:0/2356705768 learned_addr learned my addr 172.21.15.71:0/2356705768 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:10.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.498+0000 7fd542d9d700 1 --2- 172.21.15.71:0/2356705768 >> v2:172.21.15.71:3300/0 conn(0x7fd5440696c0 0x7fd54406ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:10.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.498+0000 7fd54159a700 1 -- 172.21.15.71:0/2356705768 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414441834 0 0) 0x7fd54406e8c0 con 0x7fd54415daa0 2023-10-09T07:00:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.498+0000 7fd54159a700 1 -- 172.21.15.71:0/2356705768 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd530003570 con 0x7fd54415daa0 2023-10-09T07:00:10.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.498+0000 7fd541d9b700 1 -- 172.21.15.71:0/2356705768 >> v2:172.21.15.71:3300/0 conn(0x7fd5440696c0 msgr2=0x7fd54406ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:10.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.498+0000 7fd54159a700 1 -- 172.21.15.71:0/2356705768 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4220174573 0 0) 0x7fd530003570 con 0x7fd54415daa0 2023-10-09T07:00:10.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.498+0000 7fd541d9b700 1 --2- 172.21.15.71:0/2356705768 >> v2:172.21.15.71:3300/0 conn(0x7fd5440696c0 0x7fd54406ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.499+0000 7fd541d9b700 1 -- 172.21.15.71:0/2356705768 >> v1:172.21.15.179:6789/0 conn(0x7fd54415daa0 legacy=0x7fd5440c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:10.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.499+0000 7fd541d9b700 1 -- 172.21.15.71:0/2356705768 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5440ca0f0 con 0x7fd54415de70 2023-10-09T07:00:10.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.499+0000 7fd542d9d700 1 --2- 172.21.15.71:0/2356705768 >> v2:172.21.15.71:3300/0 conn(0x7fd5440696c0 0x7fd54406ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:00:10.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.499+0000 7fd541d9b700 1 --2- 172.21.15.71:0/2356705768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd54415de70 0x7fd54406e000 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009e60 tx=0x7fd52c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=611f63ac23157f96 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.499+0000 7fd54159a700 1 -- 172.21.15.71:0/2356705768 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c00e070 con 0x7fd54415de70 2023-10-09T07:00:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.499+0000 7fd54159a700 1 -- 172.21.15.71:0/2356705768 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52c00b7a0 con 0x7fd54415de70 2023-10-09T07:00:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.499+0000 7fd54159a700 1 -- 172.21.15.71:0/2356705768 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c001470 con 0x7fd54415de70 2023-10-09T07:00:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.500+0000 7fd54359e700 1 -- 172.21.15.71:0/2356705768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd54415de70 msgr2=0x7fd54406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.500+0000 7fd54359e700 1 --2- 172.21.15.71:0/2356705768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd54415de70 0x7fd54406e000 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009e60 tx=0x7fd52c009780 comp rx=0 tx=0).stop 2023-10-09T07:00:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.500+0000 7fd54359e700 1 -- 172.21.15.71:0/2356705768 shutdown_connections 2023-10-09T07:00:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.500+0000 7fd54359e700 1 --2- 172.21.15.71:0/2356705768 >> v2:172.21.15.71:3300/0 conn(0x7fd5440696c0 0x7fd54406ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.500+0000 7fd54359e700 1 --2- 172.21.15.71:0/2356705768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd54415de70 0x7fd54406e000 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.500+0000 7fd54359e700 1 -- 172.21.15.71:0/2356705768 >> 172.21.15.71:0/2356705768 conn(0x7fd5440cc1f0 msgr2=0x7fd5440cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.500+0000 7fd54359e700 1 -- 172.21.15.71:0/2356705768 shutdown_connections 2023-10-09T07:00:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.500+0000 7fd54359e700 1 -- 172.21.15.71:0/2356705768 wait complete. 2023-10-09T07:00:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.503+0000 7fd54359e700 1 Processor -- start 2023-10-09T07:00:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.503+0000 7fd54359e700 1 -- start start 2023-10-09T07:00:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.505+0000 7fd54359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5440696c0 0x7fd54418b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.505+0000 7fd54359e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd54415daa0 0x7fd5440c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.505+0000 7fd54359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd54415de70 0x7fd5440873b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.505+0000 7fd54359e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd544147ee0 con 0x7fd54415daa0 2023-10-09T07:00:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.505+0000 7fd54359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54418ba20 con 0x7fd5440696c0 2023-10-09T07:00:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.505+0000 7fd54359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd544149a60 con 0x7fd54415de70 2023-10-09T07:00:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.505+0000 7fd541d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd54415daa0 0x7fd5440c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.505+0000 7fd541d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd54415daa0 0x7fd5440c28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34736/0 (socket says 172.21.15.71:34736) 2023-10-09T07:00:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.505+0000 7fd541d9b700 1 -- 172.21.15.71:0/1272341137 learned_addr learned my addr 172.21.15.71:0/1272341137 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.505+0000 7fd54259c700 1 --2- 172.21.15.71:0/1272341137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5440696c0 0x7fd54418b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.505+0000 7fd542d9d700 1 --2- 172.21.15.71:0/1272341137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd54415de70 0x7fd5440873b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.506+0000 7fd54259c700 1 -- 172.21.15.71:0/1272341137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd54415de70 msgr2=0x7fd5440873b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.506+0000 7fd54259c700 1 --2- 172.21.15.71:0/1272341137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd54415de70 0x7fd5440873b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.506+0000 7fd54259c700 1 -- 172.21.15.71:0/1272341137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd54415daa0 msgr2=0x7fd5440c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.506+0000 7fd54259c700 1 --2- 172.21.15.71:0/1272341137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd54415daa0 0x7fd5440c28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.506+0000 7fd54259c700 1 -- 172.21.15.71:0/1272341137 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd534009420 con 0x7fd5440696c0 2023-10-09T07:00:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.506+0000 7fd541d9b700 1 --2- 172.21.15.71:0/1272341137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd54415daa0 0x7fd5440c28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:00:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.506+0000 7fd542d9d700 1 --2- 172.21.15.71:0/1272341137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd54415de70 0x7fd5440873b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:00:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.506+0000 7fd54259c700 1 --2- 172.21.15.71:0/1272341137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5440696c0 0x7fd54418b4e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00c830 tx=0x7fd53c001930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.506+0000 7fd53a7fc700 1 -- 172.21.15.71:0/1272341137 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c007360 con 0x7fd5440696c0 2023-10-09T07:00:10.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.506+0000 7fd53a7fc700 1 -- 172.21.15.71:0/1272341137 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c0074c0 con 0x7fd5440696c0 2023-10-09T07:00:10.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.506+0000 7fd54359e700 1 -- 172.21.15.71:0/1272341137 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52c009a20 con 0x7fd5440696c0 2023-10-09T07:00:10.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.506+0000 7fd53a7fc700 1 -- 172.21.15.71:0/1272341137 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c004830 con 0x7fd5440696c0 2023-10-09T07:00:10.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.507+0000 7fd54359e700 1 -- 172.21.15.71:0/1272341137 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd544148c60 con 0x7fd5440696c0 2023-10-09T07:00:10.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.508+0000 7fd54359e700 1 -- 172.21.15.71:0/1272341137 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54404c3c0 con 0x7fd5440696c0 2023-10-09T07:00:10.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.508+0000 7fd53a7fc700 1 -- 172.21.15.71:0/1272341137 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 46) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fd53c004be0 con 0x7fd5440696c0 2023-10-09T07:00:10.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.509+0000 7fd53a7fc700 1 --2- 172.21.15.71:0/1272341137 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd524067170 0x7fd524069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:10.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.509+0000 7fd53a7fc700 1 -- 172.21.15.71:0/1272341137 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6384+0+0 (secure 0 0 0) 0x7fd53c084260 con 0x7fd5440696c0 2023-10-09T07:00:10.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.509+0000 7fd541d9b700 1 -- 172.21.15.71:0/1272341137 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd524067170 msgr2=0x7fd524069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T07:00:10.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.509+0000 7fd541d9b700 1 --2- 172.21.15.71:0/1272341137 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd524067170 0x7fd524069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:00:10.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.513+0000 7fd53a7fc700 1 -- 172.21.15.71:0/1272341137 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd53c050fa0 con 0x7fd5440696c0 2023-10-09T07:00:10.570 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:10.570+0000 7fb940e35180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T07:00:10.597 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:10.597+0000 7eff3ce86180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:00:10.692 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:10.692+0000 7eff3ce86180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T07:00:10.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.711+0000 7fd541d9b700 1 -- 172.21.15.71:0/1272341137 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd524067170 msgr2=0x7fd524069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T07:00:10.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.711+0000 7fd541d9b700 1 --2- 172.21.15.71:0/1272341137 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd524067170 0x7fd524069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:00:10.747 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:10.747+0000 7fb940e35180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:00:10.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.758+0000 7fd54359e700 1 -- 172.21.15.71:0/1272341137 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5440ca400 con 0x7fd5440696c0 2023-10-09T07:00:10.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.759+0000 7fd53a7fc700 1 -- 172.21.15.71:0/1272341137 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fd53c0545c0 con 0x7fd5440696c0 2023-10-09T07:00:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:00:10.759 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/2945926197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2945926197},{"type":"v1","addr":"172.21.15.71:6834","nonce":2945926197}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1112255645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1112255645},{"type":"v1","addr":"172.21.15.179:6836","nonce":1112255645}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3298180688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":3298180688},{"type":"v1","addr":"172.21.15.71:6835","nonce":3298180688}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:58:43.707312+0000","modified":"2023-10-09T06:58:47.272802+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7152},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7152":{"gid":7152,"name":"d","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/4053543999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":4053543999},{"type":"v1","addr":"172.21.15.179:6837","nonce":4053543999}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T07:00:10.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.762+0000 7fd54359e700 1 -- 172.21.15.71:0/1272341137 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd524067170 msgr2=0x7fd524069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:00:10.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.762+0000 7fd54359e700 1 --2- 172.21.15.71:0/1272341137 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd524067170 0x7fd524069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.762+0000 7fd54359e700 1 -- 172.21.15.71:0/1272341137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5440696c0 msgr2=0x7fd54418b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.762+0000 7fd54359e700 1 --2- 172.21.15.71:0/1272341137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5440696c0 0x7fd54418b4e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00c830 tx=0x7fd53c001930 comp rx=0 tx=0).stop 2023-10-09T07:00:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.762+0000 7fd54359e700 1 -- 172.21.15.71:0/1272341137 shutdown_connections 2023-10-09T07:00:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.762+0000 7fd54359e700 1 --2- 172.21.15.71:0/1272341137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd54415de70 0x7fd5440873b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.762+0000 7fd54359e700 1 --2- 172.21.15.71:0/1272341137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5440696c0 0x7fd54418b4e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.762+0000 7fd54359e700 1 --2- 172.21.15.71:0/1272341137 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd524067170 0x7fd524069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.762+0000 7fd54359e700 1 --2- 172.21.15.71:0/1272341137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd54415daa0 0x7fd5440c28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.762+0000 7fd54359e700 1 -- 172.21.15.71:0/1272341137 >> 172.21.15.71:0/1272341137 conn(0x7fd5440cc1f0 msgr2=0x7fd5440c1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.762+0000 7fd54359e700 1 -- 172.21.15.71:0/1272341137 shutdown_connections 2023-10-09T07:00:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.762+0000 7fd54359e700 1 -- 172.21.15.71:0/1272341137 wait complete. 2023-10-09T07:00:10.764 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 49 2023-10-09T07:00:10.780 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:00:10.851 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:10.851+0000 7fb940e35180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T07:00:10.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.967+0000 7efff41ff700 1 Processor -- start 2023-10-09T07:00:10.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.968+0000 7efff41ff700 1 -- start start 2023-10-09T07:00:10.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.969+0000 7efff41ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7effec159c60 0x7effec15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:10.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.969+0000 7efff41ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7effec15db10 0x7effec069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:10.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.969+0000 7efff41ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effec15a160 con 0x7effec159890 2023-10-09T07:00:10.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.969+0000 7efff41ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effec15df50 con 0x7effec159c60 2023-10-09T07:00:10.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.969+0000 7efff41ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effec0d13a0 con 0x7effec15db10 2023-10-09T07:00:10.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.969+0000 7efff179a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7effec159c60 0x7effec15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:10.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.969+0000 7efff179a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7effec159c60 0x7effec15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34752/0 (socket says 172.21.15.71:34752) 2023-10-09T07:00:10.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.969+0000 7efff179a700 1 -- 172.21.15.71:0/278130105 learned_addr learned my addr 172.21.15.71:0/278130105 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:10.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.969+0000 7efff279c700 1 --2- 172.21.15.71:0/278130105 >> v2:172.21.15.179:3300/0 conn(0x7effec15db10 0x7effec069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:10.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.970+0000 7efff179a700 1 -- 172.21.15.71:0/278130105 >> v2:172.21.15.179:3300/0 conn(0x7effec15db10 msgr2=0x7effec069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:10.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.970+0000 7efff179a700 1 --2- 172.21.15.71:0/278130105 >> v2:172.21.15.179:3300/0 conn(0x7effec15db10 0x7effec069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.970+0000 7efff179a700 1 -- 172.21.15.71:0/278130105 >> v1:172.21.15.179:6789/0 conn(0x7effec159890 legacy=0x7effec15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:10.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.970+0000 7efff179a700 1 -- 172.21.15.71:0/278130105 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec15e140 con 0x7effec159c60 2023-10-09T07:00:10.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.970+0000 7efff179a700 1 --2- 172.21.15.71:0/278130105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effec159c60 0x7effec15d5d0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7effec06a890 tx=0x7effdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5a3fd936c32f7e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:10.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.970+0000 7efff0f99700 1 -- 172.21.15.71:0/278130105 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc009e70 con 0x7effec159c60 2023-10-09T07:00:10.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.970+0000 7efff0f99700 1 -- 172.21.15.71:0/278130105 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effdc00b860 con 0x7effec159c60 2023-10-09T07:00:10.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.970+0000 7efff0f99700 1 -- 172.21.15.71:0/278130105 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc00bc00 con 0x7effec159c60 2023-10-09T07:00:10.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.971+0000 7efff41ff700 1 -- 172.21.15.71:0/278130105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effec159c60 msgr2=0x7effec15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:10.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.971+0000 7efff41ff700 1 --2- 172.21.15.71:0/278130105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effec159c60 0x7effec15d5d0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7effec06a890 tx=0x7effdc009250 comp rx=0 tx=0).stop 2023-10-09T07:00:10.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.971+0000 7efff41ff700 1 -- 172.21.15.71:0/278130105 shutdown_connections 2023-10-09T07:00:10.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.971+0000 7efff41ff700 1 --2- 172.21.15.71:0/278130105 >> v2:172.21.15.179:3300/0 conn(0x7effec15db10 0x7effec069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.971+0000 7efff41ff700 1 --2- 172.21.15.71:0/278130105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effec159c60 0x7effec15d5d0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.971+0000 7efff41ff700 1 -- 172.21.15.71:0/278130105 >> 172.21.15.71:0/278130105 conn(0x7effec068e20 msgr2=0x7effec0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:10.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.971+0000 7efff41ff700 1 -- 172.21.15.71:0/278130105 shutdown_connections 2023-10-09T07:00:10.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.971+0000 7efff41ff700 1 -- 172.21.15.71:0/278130105 wait complete. 2023-10-09T07:00:10.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.973+0000 7efff41ff700 1 Processor -- start 2023-10-09T07:00:10.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.973+0000 7efff41ff700 1 -- start start 2023-10-09T07:00:10.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.974+0000 7efff41ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effec159890 0x7effec140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:10.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.974+0000 7efff41ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effec159c60 0x7effec0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:10.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.974+0000 7efff41ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effec15db10 0x7effec0b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:10.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.974+0000 7efff41ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec141300 con 0x7effec159c60 2023-10-09T07:00:10.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.974+0000 7efff41ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec0cd6d0 con 0x7effec15db10 2023-10-09T07:00:10.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.974+0000 7efff41ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec0cd9b0 con 0x7effec159890 2023-10-09T07:00:10.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.974+0000 7efff179a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effec159c60 0x7effec0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:10.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.974+0000 7efff179a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effec159c60 0x7effec0b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34766/0 (socket says 172.21.15.71:34766) 2023-10-09T07:00:10.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.974+0000 7efff179a700 1 -- 172.21.15.71:0/4193253657 learned_addr learned my addr 172.21.15.71:0/4193253657 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:10.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.974+0000 7efff279c700 1 --2- 172.21.15.71:0/4193253657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effec15db10 0x7effec0b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:10.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.974+0000 7efff1f9b700 1 --2- 172.21.15.71:0/4193253657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effec159890 0x7effec140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:10.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.974+0000 7efff179a700 1 -- 172.21.15.71:0/4193253657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effec159890 msgr2=0x7effec140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:10.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.974+0000 7efff179a700 1 --2- 172.21.15.71:0/4193253657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effec159890 0x7effec140dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.974+0000 7efff179a700 1 -- 172.21.15.71:0/4193253657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effec15db10 msgr2=0x7effec0b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:10.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.974+0000 7efff179a700 1 --2- 172.21.15.71:0/4193253657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effec15db10 0x7effec0b5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:10.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.974+0000 7efff179a700 1 -- 172.21.15.71:0/4193253657 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effdc0094f0 con 0x7effec159c60 2023-10-09T07:00:10.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.974+0000 7efff279c700 1 --2- 172.21.15.71:0/4193253657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effec15db10 0x7effec0b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:00:10.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.975+0000 7efff179a700 1 --2- 172.21.15.71:0/4193253657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effec159c60 0x7effec0b3590 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7effec070e20 tx=0x7effdc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:10.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.975+0000 7effe1ffb700 1 -- 172.21.15.71:0/4193253657 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc00bbe0 con 0x7effec159c60 2023-10-09T07:00:10.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.975+0000 7effe1ffb700 1 -- 172.21.15.71:0/4193253657 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effdc011420 con 0x7effec159c60 2023-10-09T07:00:10.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.975+0000 7efff41ff700 1 -- 172.21.15.71:0/4193253657 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effec0cdc90 con 0x7effec159c60 2023-10-09T07:00:10.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.975+0000 7effe1ffb700 1 -- 172.21.15.71:0/4193253657 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc0117e0 con 0x7effec159c60 2023-10-09T07:00:10.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.975+0000 7efff41ff700 1 -- 172.21.15.71:0/4193253657 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effec0ce250 con 0x7effec159c60 2023-10-09T07:00:10.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.976+0000 7efff41ff700 1 -- 172.21.15.71:0/4193253657 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effec0ce440 con 0x7effec159c60 2023-10-09T07:00:10.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.977+0000 7effe1ffb700 1 -- 172.21.15.71:0/4193253657 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 46) v1 ==== 84956+0+0 (secure 0 0 0) 0x7effdc011c10 con 0x7effec159c60 2023-10-09T07:00:10.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.978+0000 7effe1ffb700 1 --2- 172.21.15.71:0/4193253657 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7effd0067170 0x7effd0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:10.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.978+0000 7effe1ffb700 1 -- 172.21.15.71:0/4193253657 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6384+0+0 (secure 0 0 0) 0x7effdc086c70 con 0x7effec159c60 2023-10-09T07:00:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.978+0000 7efff1f9b700 1 -- 172.21.15.71:0/4193253657 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7effd0067170 msgr2=0x7effd0069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T07:00:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.978+0000 7efff1f9b700 1 --2- 172.21.15.71:0/4193253657 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7effd0067170 0x7effd0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:00:10.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:10.984+0000 7effe1ffb700 1 -- 172.21.15.71:0/4193253657 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7effdc053970 con 0x7effec159c60 2023-10-09T07:00:10.988 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:10.987+0000 7eff3ce86180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T07:00:11.083 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:11.083+0000 7eff3ce86180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T07:00:11.156 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:11.156+0000 7fb940e35180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T07:00:11.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.179+0000 7efff1f9b700 1 -- 172.21.15.71:0/4193253657 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7effd0067170 msgr2=0x7effd0069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T07:00:11.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.179+0000 7efff1f9b700 1 --2- 172.21.15.71:0/4193253657 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7effd0067170 0x7effd0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:00:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.226+0000 7efff41ff700 1 -- 172.21.15.71:0/4193253657 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7effec04c3c0 con 0x7effec159c60 2023-10-09T07:00:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.227+0000 7effe1ffb700 1 -- 172.21.15.71:0/4193253657 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4605 (secure 0 0 0) 0x7effdc015090 con 0x7effec159c60 2023-10-09T07:00:11.227 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:00:11.227 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/2945926197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2945926197},{"type":"v1","addr":"172.21.15.71:6834","nonce":2945926197}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1112255645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1112255645},{"type":"v1","addr":"172.21.15.179:6836","nonce":1112255645}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3298180688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":3298180688},{"type":"v1","addr":"172.21.15.71:6835","nonce":3298180688}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T06:58:43.707312+0000","modified":"2023-10-09T06:58:47.272802+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7152},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7152":{"gid":7152,"name":"d","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/4053543999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":4053543999},{"type":"v1","addr":"172.21.15.179:6837","nonce":4053543999}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T07:00:11.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.229+0000 7efff41ff700 1 -- 172.21.15.71:0/4193253657 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7effd0067170 msgr2=0x7effd0069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:00:11.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.229+0000 7efff41ff700 1 --2- 172.21.15.71:0/4193253657 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7effd0067170 0x7effd0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:11.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.229+0000 7efff41ff700 1 -- 172.21.15.71:0/4193253657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effec159c60 msgr2=0x7effec0b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:11.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.229+0000 7efff41ff700 1 --2- 172.21.15.71:0/4193253657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effec159c60 0x7effec0b3590 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7effec070e20 tx=0x7effdc017000 comp rx=0 tx=0).stop 2023-10-09T07:00:11.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.229+0000 7efff41ff700 1 -- 172.21.15.71:0/4193253657 shutdown_connections 2023-10-09T07:00:11.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.229+0000 7efff41ff700 1 --2- 172.21.15.71:0/4193253657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effec15db10 0x7effec0b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:11.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.229+0000 7efff41ff700 1 --2- 172.21.15.71:0/4193253657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effec159890 0x7effec140dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:11.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.229+0000 7efff41ff700 1 --2- 172.21.15.71:0/4193253657 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7effd0067170 0x7effd0069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:11.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.229+0000 7efff41ff700 1 --2- 172.21.15.71:0/4193253657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effec159c60 0x7effec0b3590 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:11.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.229+0000 7efff41ff700 1 -- 172.21.15.71:0/4193253657 >> 172.21.15.71:0/4193253657 conn(0x7effec068e20 msgr2=0x7effec157230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:11.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.229+0000 7efff41ff700 1 -- 172.21.15.71:0/4193253657 shutdown_connections 2023-10-09T07:00:11.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.230+0000 7efff41ff700 1 -- 172.21.15.71:0/4193253657 wait complete. 2023-10-09T07:00:11.231 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 49 2023-10-09T07:00:11.247 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:00:11.256 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:11.256+0000 7fb940e35180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T07:00:11.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.433+0000 7f7e2d3ff700 1 Processor -- start 2023-10-09T07:00:11.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.433+0000 7f7e2d3ff700 1 -- start start 2023-10-09T07:00:11.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.434+0000 7f7e2d3ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7e280cbf30 0x7f7e280ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:11.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.434+0000 7f7e2d3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7e280ccf90 0x7f7e280b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:11.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.434+0000 7f7e2d3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e280cc300 con 0x7f7e2815a270 2023-10-09T07:00:11.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.435+0000 7f7e2d3ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e28156bf0 con 0x7f7e280cbf30 2023-10-09T07:00:11.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.435+0000 7f7e2d3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e280ae950 con 0x7f7e280ccf90 2023-10-09T07:00:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.435+0000 7f7e26ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7e280cbf30 0x7f7e280ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.435+0000 7f7e26ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7e280cbf30 0x7f7e280ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34780/0 (socket says 172.21.15.71:34780) 2023-10-09T07:00:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.435+0000 7f7e26ffd700 1 -- 172.21.15.71:0/2005283252 learned_addr learned my addr 172.21.15.71:0/2005283252 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.435+0000 7f7e267fc700 1 --2- 172.21.15.71:0/2005283252 >> v2:172.21.15.179:3300/0 conn(0x7f7e280ccf90 0x7f7e280b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.435+0000 7f7e26ffd700 1 -- 172.21.15.71:0/2005283252 >> v2:172.21.15.179:3300/0 conn(0x7f7e280ccf90 msgr2=0x7f7e280b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.435+0000 7f7e26ffd700 1 --2- 172.21.15.71:0/2005283252 >> v2:172.21.15.179:3300/0 conn(0x7f7e280ccf90 0x7f7e280b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.435+0000 7f7e26ffd700 1 -- 172.21.15.71:0/2005283252 >> v1:172.21.15.179:6789/0 conn(0x7f7e2815a270 legacy=0x7f7e280c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.435+0000 7f7e26ffd700 1 -- 172.21.15.71:0/2005283252 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e280ad370 con 0x7f7e280cbf30 2023-10-09T07:00:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.436+0000 7f7e26ffd700 1 --2- 172.21.15.71:0/2005283252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e280cbf30 0x7f7e280ae410 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f7e2806d670 tx=0x7f7e18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a5b4c9756b23c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.436+0000 7f7e25ffb700 1 -- 172.21.15.71:0/2005283252 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18009ea0 con 0x7f7e280cbf30 2023-10-09T07:00:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.436+0000 7f7e25ffb700 1 -- 172.21.15.71:0/2005283252 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1800b820 con 0x7f7e280cbf30 2023-10-09T07:00:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.436+0000 7f7e25ffb700 1 -- 172.21.15.71:0/2005283252 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1800bbc0 con 0x7f7e280cbf30 2023-10-09T07:00:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.436+0000 7f7e2d3ff700 1 -- 172.21.15.71:0/2005283252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e280cbf30 msgr2=0x7f7e280ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.436+0000 7f7e2d3ff700 1 --2- 172.21.15.71:0/2005283252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e280cbf30 0x7f7e280ae410 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f7e2806d670 tx=0x7f7e18009250 comp rx=0 tx=0).stop 2023-10-09T07:00:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.437+0000 7f7e2d3ff700 1 -- 172.21.15.71:0/2005283252 shutdown_connections 2023-10-09T07:00:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.437+0000 7f7e2d3ff700 1 --2- 172.21.15.71:0/2005283252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e280cbf30 0x7f7e280ae410 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.437+0000 7f7e2d3ff700 1 --2- 172.21.15.71:0/2005283252 >> v2:172.21.15.179:3300/0 conn(0x7f7e280ccf90 0x7f7e280b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.437+0000 7f7e2d3ff700 1 -- 172.21.15.71:0/2005283252 >> 172.21.15.71:0/2005283252 conn(0x7f7e2806a320 msgr2=0x7f7e280cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.437+0000 7f7e2d3ff700 1 -- 172.21.15.71:0/2005283252 shutdown_connections 2023-10-09T07:00:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.437+0000 7f7e2d3ff700 1 -- 172.21.15.71:0/2005283252 wait complete. 2023-10-09T07:00:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.438+0000 7f7e2d3ff700 1 Processor -- start 2023-10-09T07:00:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.438+0000 7f7e2d3ff700 1 -- start start 2023-10-09T07:00:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.439+0000 7f7e2d3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e280cbf30 0x7f7e28155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.439+0000 7f7e2d3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e280ccf90 0x7f7e2815db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.439+0000 7f7e2d3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e2815a270 0x7f7e2816a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.439+0000 7f7e2d3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e28156390 con 0x7f7e280ccf90 2023-10-09T07:00:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.439+0000 7f7e2d3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e280c72c0 con 0x7f7e280cbf30 2023-10-09T07:00:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.439+0000 7f7e2d3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e280c66b0 con 0x7f7e2815a270 2023-10-09T07:00:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.440+0000 7f7e26ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e280cbf30 0x7f7e28155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.440+0000 7f7e267fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e280ccf90 0x7f7e2815db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.440+0000 7f7e26ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e280cbf30 0x7f7e28155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:53714/0 (socket says 172.21.15.71:53714) 2023-10-09T07:00:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.440+0000 7f7e26ffd700 1 -- 172.21.15.71:0/2499049898 learned_addr learned my addr 172.21.15.71:0/2499049898 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.440+0000 7f7e277fe700 1 --2- 172.21.15.71:0/2499049898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e2815a270 0x7f7e2816a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.440+0000 7f7e26ffd700 1 -- 172.21.15.71:0/2499049898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e2815a270 msgr2=0x7f7e2816a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.440+0000 7f7e26ffd700 1 --2- 172.21.15.71:0/2499049898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e2815a270 0x7f7e2816a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.440+0000 7f7e26ffd700 1 -- 172.21.15.71:0/2499049898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e280ccf90 msgr2=0x7f7e2815db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.440+0000 7f7e26ffd700 1 --2- 172.21.15.71:0/2499049898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e280ccf90 0x7f7e2815db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:11.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.440+0000 7f7e26ffd700 1 -- 172.21.15.71:0/2499049898 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e180094f0 con 0x7f7e280cbf30 2023-10-09T07:00:11.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.440+0000 7f7e267fc700 1 --2- 172.21.15.71:0/2499049898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e280ccf90 0x7f7e2815db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:00:11.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.440+0000 7f7e26ffd700 1 --2- 172.21.15.71:0/2499049898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e280cbf30 0x7f7e28155e50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7e180094c0 tx=0x7f7e18017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:11.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.441+0000 7f7e0effd700 1 -- 172.21.15.71:0/2499049898 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18000d10 con 0x7f7e280cbf30 2023-10-09T07:00:11.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.441+0000 7f7e0effd700 1 -- 172.21.15.71:0/2499049898 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1800bba0 con 0x7f7e280cbf30 2023-10-09T07:00:11.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.441+0000 7f7e0effd700 1 -- 172.21.15.71:0/2499049898 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18011690 con 0x7f7e280cbf30 2023-10-09T07:00:11.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.441+0000 7f7e2d3ff700 1 -- 172.21.15.71:0/2499049898 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e280c6990 con 0x7f7e280cbf30 2023-10-09T07:00:11.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.441+0000 7f7e2d3ff700 1 -- 172.21.15.71:0/2499049898 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e280c6f50 con 0x7f7e280cbf30 2023-10-09T07:00:11.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.442+0000 7f7e2d3ff700 1 -- 172.21.15.71:0/2499049898 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e280b1ac0 con 0x7f7e280cbf30 2023-10-09T07:00:11.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.443+0000 7f7e0effd700 1 -- 172.21.15.71:0/2499049898 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 46) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f7e18011a80 con 0x7f7e280cbf30 2023-10-09T07:00:11.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.444+0000 7f7e0effd700 1 --2- 172.21.15.71:0/2499049898 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7e14067170 0x7f7e14069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:11.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.444+0000 7f7e0effd700 1 -- 172.21.15.71:0/2499049898 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6384+0+0 (secure 0 0 0) 0x7f7e18086760 con 0x7f7e280cbf30 2023-10-09T07:00:11.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.444+0000 7f7e267fc700 1 -- 172.21.15.71:0/2499049898 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7e14067170 msgr2=0x7f7e14069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T07:00:11.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.444+0000 7f7e267fc700 1 --2- 172.21.15.71:0/2499049898 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7e14067170 0x7f7e14069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:00:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.447+0000 7f7e0effd700 1 -- 172.21.15.71:0/2499049898 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e18053520 con 0x7f7e280cbf30 2023-10-09T07:00:11.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.645+0000 7f7e267fc700 1 -- 172.21.15.71:0/2499049898 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7e14067170 msgr2=0x7f7e14069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T07:00:11.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.645+0000 7f7e267fc700 1 --2- 172.21.15.71:0/2499049898 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7e14067170 0x7f7e14069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:00:11.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.646+0000 7f7e2d3ff700 1 -- 172.21.15.71:0/2499049898 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e2804c3c0 con 0x7f7e280cbf30 2023-10-09T07:00:11.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.647+0000 7f7e0effd700 1 -- 172.21.15.71:0/2499049898 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+16381 (secure 0 0 0) 0x7f7e1805c070 con 0x7f7e280cbf30 2023-10-09T07:00:11.647 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:00:11.647 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":110,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:00:05.799686+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T06:58:41.817433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T06:58:42.692884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.11","mappings":[{"from":1,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6833/85452":"2023-10-10T06:59:03.833693+0000","172.21.15.179:6832/85452":"2023-10-10T06:59:03.833693+0000","172.21.15.179:0/3295056505":"2023-10-10T06:59:03.833693+0000","172.21.15.179:0/1335773422":"2023-10-10T06:59:03.833693+0000","172.21.15.179:0/2110166133":"2023-10-10T06:59:03.833693+0000","172.21.15.179:0/1934925403":"2023-10-10T06:59:03.833693+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:00:11.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.649+0000 7f7e2d3ff700 1 -- 172.21.15.71:0/2499049898 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7e14067170 msgr2=0x7f7e14069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:00:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.649+0000 7f7e2d3ff700 1 --2- 172.21.15.71:0/2499049898 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7e14067170 0x7f7e14069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.649+0000 7f7e2d3ff700 1 -- 172.21.15.71:0/2499049898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e280cbf30 msgr2=0x7f7e28155e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.649+0000 7f7e2d3ff700 1 --2- 172.21.15.71:0/2499049898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e280cbf30 0x7f7e28155e50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7e180094c0 tx=0x7f7e18017000 comp rx=0 tx=0).stop 2023-10-09T07:00:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.649+0000 7f7e2d3ff700 1 -- 172.21.15.71:0/2499049898 shutdown_connections 2023-10-09T07:00:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.649+0000 7f7e2d3ff700 1 --2- 172.21.15.71:0/2499049898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e2815a270 0x7f7e2816a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.649+0000 7f7e2d3ff700 1 --2- 172.21.15.71:0/2499049898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e280cbf30 0x7f7e28155e50 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.649+0000 7f7e2d3ff700 1 --2- 172.21.15.71:0/2499049898 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f7e14067170 0x7f7e14069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.649+0000 7f7e2d3ff700 1 --2- 172.21.15.71:0/2499049898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e280ccf90 0x7f7e2815db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.649+0000 7f7e2d3ff700 1 -- 172.21.15.71:0/2499049898 >> 172.21.15.71:0/2499049898 conn(0x7f7e2806a320 msgr2=0x7f7e280c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.649+0000 7f7e2d3ff700 1 -- 172.21.15.71:0/2499049898 shutdown_connections 2023-10-09T07:00:11.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.649+0000 7f7e2d3ff700 1 -- 172.21.15.71:0/2499049898 wait complete. 2023-10-09T07:00:11.668 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T07:00:11.782 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:11.782+0000 7eff3ce86180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T07:00:11.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.896+0000 7fd4d6f9d700 1 Processor -- start 2023-10-09T07:00:11.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.897+0000 7fd4d6f9d700 1 -- start start 2023-10-09T07:00:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.898+0000 7fd4d6f9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd4d01595a0 0x7fd4d00b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.898+0000 7fd4d6f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4d00c6c60 0x7fd4d00c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.898+0000 7fd4d6f9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d00b1410 con 0x7fd4d00b1de0 2023-10-09T07:00:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.898+0000 7fd4d6f9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d00b2b90 con 0x7fd4d01595a0 2023-10-09T07:00:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.898+0000 7fd4d6f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d0063230 con 0x7fd4d00c6c60 2023-10-09T07:00:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.898+0000 7fd4d5f9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd4d01595a0 0x7fd4d00b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.898+0000 7fd4d5f9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd4d01595a0 0x7fd4d00b18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34804/0 (socket says 172.21.15.71:34804) 2023-10-09T07:00:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.898+0000 7fd4d5f9b700 1 -- 172.21.15.71:0/1446362133 learned_addr learned my addr 172.21.15.71:0/1446362133 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.898+0000 7fd4d679c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd4d00b1de0 0x7fd4d015d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56244/0 (socket says 172.21.15.71:56244) 2023-10-09T07:00:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.898+0000 7fd4d579a700 1 --2- 172.21.15.71:0/1446362133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4d00c6c60 0x7fd4d00c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.899+0000 7fd4d5f9b700 1 -- 172.21.15.71:0/1446362133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4d00c6c60 msgr2=0x7fd4d00c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.899+0000 7fd4d5f9b700 1 --2- 172.21.15.71:0/1446362133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4d00c6c60 0x7fd4d00c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.899+0000 7fd4d5f9b700 1 -- 172.21.15.71:0/1446362133 >> v1:172.21.15.71:6789/0 conn(0x7fd4d00b1de0 legacy=0x7fd4d015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.899+0000 7fd4d5f9b700 1 -- 172.21.15.71:0/1446362133 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d00634f0 con 0x7fd4d01595a0 2023-10-09T07:00:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.899+0000 7fd4d4f99700 1 -- 172.21.15.71:0/1446362133 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27357411 0 0) 0x7fd4d00b1410 con 0x7fd4d00b1de0 2023-10-09T07:00:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.899+0000 7fd4d5f9b700 1 --2- 172.21.15.71:0/1446362133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4d01595a0 0x7fd4d00b18a0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0099b0 tx=0x7fd4cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb86f59444b0c7f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.899+0000 7fd4d4f99700 1 -- 172.21.15.71:0/1446362133 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc009ea0 con 0x7fd4d01595a0 2023-10-09T07:00:11.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.899+0000 7fd4d4f99700 1 -- 172.21.15.71:0/1446362133 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc00b860 con 0x7fd4d01595a0 2023-10-09T07:00:11.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.899+0000 7fd4d4f99700 1 -- 172.21.15.71:0/1446362133 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc00bc00 con 0x7fd4d01595a0 2023-10-09T07:00:11.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.900+0000 7fd4d6f9d700 1 -- 172.21.15.71:0/1446362133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4d01595a0 msgr2=0x7fd4d00b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:11.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.900+0000 7fd4d6f9d700 1 --2- 172.21.15.71:0/1446362133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4d01595a0 0x7fd4d00b18a0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0099b0 tx=0x7fd4cc009250 comp rx=0 tx=0).stop 2023-10-09T07:00:11.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.900+0000 7fd4d6f9d700 1 -- 172.21.15.71:0/1446362133 shutdown_connections 2023-10-09T07:00:11.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.900+0000 7fd4d6f9d700 1 --2- 172.21.15.71:0/1446362133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4d01595a0 0x7fd4d00b18a0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:11.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.900+0000 7fd4d6f9d700 1 --2- 172.21.15.71:0/1446362133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4d00c6c60 0x7fd4d00c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:11.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.900+0000 7fd4d6f9d700 1 -- 172.21.15.71:0/1446362133 >> 172.21.15.71:0/1446362133 conn(0x7fd4d006ddb0 msgr2=0x7fd4d006e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:11.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.900+0000 7fd4d6f9d700 1 -- 172.21.15.71:0/1446362133 shutdown_connections 2023-10-09T07:00:11.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.900+0000 7fd4d6f9d700 1 -- 172.21.15.71:0/1446362133 wait complete. 2023-10-09T07:00:11.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.901+0000 7fd4d6f9d700 1 Processor -- start 2023-10-09T07:00:11.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.901+0000 7fd4d6f9d700 1 -- start start 2023-10-09T07:00:11.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.902+0000 7fd4d6f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4d00b1de0 0x7fd4d00c1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:11.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.902+0000 7fd4d6f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4d00c6c60 0x7fd4d014f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.902+0000 7fd4d6f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4d01595a0 0x7fd4d01573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.902+0000 7fd4d6f9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d00c2050 con 0x7fd4d01595a0 2023-10-09T07:00:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.902+0000 7fd4d6f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d015a590 con 0x7fd4d00b1de0 2023-10-09T07:00:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.902+0000 7fd4d6f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d015a870 con 0x7fd4d00c6c60 2023-10-09T07:00:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.903+0000 7fd4d679c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4d01595a0 0x7fd4d01573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.903+0000 7fd4d5f9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4d00b1de0 0x7fd4d00c1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.903+0000 7fd4d579a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4d00c6c60 0x7fd4d014f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.903+0000 7fd4d679c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4d01595a0 0x7fd4d01573e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34814/0 (socket says 172.21.15.71:34814) 2023-10-09T07:00:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.903+0000 7fd4d679c700 1 -- 172.21.15.71:0/76327722 learned_addr learned my addr 172.21.15.71:0/76327722 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.903+0000 7fd4d5f9b700 1 -- 172.21.15.71:0/76327722 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4d00c6c60 msgr2=0x7fd4d014f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.903+0000 7fd4d5f9b700 1 --2- 172.21.15.71:0/76327722 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4d00c6c60 0x7fd4d014f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.903+0000 7fd4d5f9b700 1 -- 172.21.15.71:0/76327722 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4d01595a0 msgr2=0x7fd4d01573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:11.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.903+0000 7fd4d5f9b700 1 --2- 172.21.15.71:0/76327722 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4d01595a0 0x7fd4d01573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:11.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.903+0000 7fd4d5f9b700 1 -- 172.21.15.71:0/76327722 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4cc0094f0 con 0x7fd4d00b1de0 2023-10-09T07:00:11.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.904+0000 7fd4d5f9b700 1 --2- 172.21.15.71:0/76327722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4d00b1de0 0x7fd4d00c1b10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd4d015d390 tx=0x7fd4cc017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:11.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.904+0000 7fd4c5ffb700 1 -- 172.21.15.71:0/76327722 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc000d10 con 0x7fd4d00b1de0 2023-10-09T07:00:11.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.904+0000 7fd4c5ffb700 1 -- 172.21.15.71:0/76327722 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc00bbe0 con 0x7fd4d00b1de0 2023-10-09T07:00:11.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.904+0000 7fd4c5ffb700 1 -- 172.21.15.71:0/76327722 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc011630 con 0x7fd4d00b1de0 2023-10-09T07:00:11.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.904+0000 7fd4d6f9d700 1 -- 172.21.15.71:0/76327722 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d015ab50 con 0x7fd4d00b1de0 2023-10-09T07:00:11.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.904+0000 7fd4d6f9d700 1 -- 172.21.15.71:0/76327722 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d00c3550 con 0x7fd4d00b1de0 2023-10-09T07:00:11.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.905+0000 7fd4d6f9d700 1 -- 172.21.15.71:0/76327722 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d00c3740 con 0x7fd4d00b1de0 2023-10-09T07:00:11.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.906+0000 7fd4c5ffb700 1 -- 172.21.15.71:0/76327722 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 46) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fd4cc011a60 con 0x7fd4d00b1de0 2023-10-09T07:00:11.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.907+0000 7fd4c5ffb700 1 --2- 172.21.15.71:0/76327722 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd4b4067170 0x7fd4b4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:11.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.907+0000 7fd4c5ffb700 1 -- 172.21.15.71:0/76327722 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6384+0+0 (secure 0 0 0) 0x7fd4cc086480 con 0x7fd4d00b1de0 2023-10-09T07:00:11.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.907+0000 7fd4d579a700 1 -- 172.21.15.71:0/76327722 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd4b4067170 msgr2=0x7fd4b4069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T07:00:11.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.907+0000 7fd4d579a700 1 --2- 172.21.15.71:0/76327722 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd4b4067170 0x7fd4b4069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:00:11.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:11.911+0000 7fd4c5ffb700 1 -- 172.21.15.71:0/76327722 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4cc0531c0 con 0x7fd4d00b1de0 2023-10-09T07:00:11.997 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:11.997+0000 7fb940e35180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T07:00:12.074 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:12.074+0000 7eff3ce86180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T07:00:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.108+0000 7fd4d579a700 1 -- 172.21.15.71:0/76327722 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd4b4067170 msgr2=0x7fd4b4069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6832/85452 2023-10-09T07:00:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.108+0000 7fd4d579a700 1 --2- 172.21.15.71:0/76327722 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd4b4067170 0x7fd4b4069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:00:12.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.153+0000 7fd4d6f9d700 1 -- 172.21.15.71:0/76327722 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd4d004c3c0 con 0x7fd4d00b1de0 2023-10-09T07:00:12.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2023-10-09T07:00:12.154+0000 7fdb445f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T07:00:12.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.161+0000 7fd4c5ffb700 1 -- 172.21.15.71:0/76327722 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd4cc0567e0 con 0x7fd4d00b1de0 2023-10-09T07:00:12.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.163+0000 7fd4d6f9d700 1 -- 172.21.15.71:0/76327722 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd4b4067170 msgr2=0x7fd4b4069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:00:12.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.163+0000 7fd4d6f9d700 1 --2- 172.21.15.71:0/76327722 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd4b4067170 0x7fd4b4069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:12.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.163+0000 7fd4d6f9d700 1 -- 172.21.15.71:0/76327722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4d00b1de0 msgr2=0x7fd4d00c1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:12.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.163+0000 7fd4d6f9d700 1 --2- 172.21.15.71:0/76327722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4d00b1de0 0x7fd4d00c1b10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd4d015d390 tx=0x7fd4cc017000 comp rx=0 tx=0).stop 2023-10-09T07:00:12.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.163+0000 7fd4d6f9d700 1 -- 172.21.15.71:0/76327722 shutdown_connections 2023-10-09T07:00:12.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.163+0000 7fd4d6f9d700 1 --2- 172.21.15.71:0/76327722 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7fd4b4067170 0x7fd4b4069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:12.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.163+0000 7fd4d6f9d700 1 --2- 172.21.15.71:0/76327722 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4d01595a0 0x7fd4d01573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:12.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.163+0000 7fd4d6f9d700 1 --2- 172.21.15.71:0/76327722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4d00b1de0 0x7fd4d00c1b10 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:12.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.163+0000 7fd4d6f9d700 1 --2- 172.21.15.71:0/76327722 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4d00c6c60 0x7fd4d014f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:12.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.163+0000 7fd4d6f9d700 1 -- 172.21.15.71:0/76327722 >> 172.21.15.71:0/76327722 conn(0x7fd4d006ddb0 msgr2=0x7fd4d0153eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:12.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.163+0000 7fd4d6f9d700 1 -- 172.21.15.71:0/76327722 shutdown_connections 2023-10-09T07:00:12.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.163+0000 7fd4d6f9d700 1 -- 172.21.15.71:0/76327722 wait complete. 2023-10-09T07:00:12.165 INFO:teuthology.orchestra.run.smithi071.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T07:00:12.167 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:12.167+0000 7eff3ce86180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T07:00:12.168 INFO:tasks.ceph.mds.d.smithi179.stderr: -5323> 2023-10-09T06:58:49.222+0000 7fbff8bf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T07:00:12.181 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T07:00:12.214 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-09T07:00:12.290 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:12.290+0000 7fb940e35180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T07:00:12.327 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:12.327+0000 7eff3ce86180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T07:00:12.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.370+0000 7f8877fff700 1 Processor -- start 2023-10-09T07:00:12.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.370+0000 7f8877fff700 1 -- start start 2023-10-09T07:00:12.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.371+0000 7f8877fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f88780b4e70 0x7f88780ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:12.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.371+0000 7f8877fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88780b1b40 0x7f887815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:12.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.371+0000 7f8877fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88780cfb00 con 0x7f88780b16d0 2023-10-09T07:00:12.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.371+0000 7f8877fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88780b5c40 con 0x7f88780b4e70 2023-10-09T07:00:12.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.371+0000 7f8877fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88780b5f20 con 0x7f88780b1b40 2023-10-09T07:00:12.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.371+0000 7f88777fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88780b1b40 0x7f887815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:12.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.371+0000 7f8876ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f88780b4e70 0x7f88780ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:12.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.371+0000 7f88767fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f88780b16d0 0x7f887815d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56254/0 (socket says 172.21.15.71:56254) 2023-10-09T07:00:12.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.371+0000 7f88767fc700 1 -- 172.21.15.71:0/1249581171 learned_addr learned my addr 172.21.15.71:0/1249581171 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:12.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.372+0000 7f8876ffd700 1 -- 172.21.15.71:0/1249581171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88780b1b40 msgr2=0x7f887815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:12.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.372+0000 7f8876ffd700 1 --2- 172.21.15.71:0/1249581171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88780b1b40 0x7f887815d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:12.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.372+0000 7f8876ffd700 1 -- 172.21.15.71:0/1249581171 >> v1:172.21.15.71:6789/0 conn(0x7f88780b16d0 legacy=0x7f887815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:12.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.372+0000 7f8875ffb700 1 -- 172.21.15.71:0/1249581171 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3381911250 0 0) 0x7f88780cfb00 con 0x7f88780b16d0 2023-10-09T07:00:12.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.372+0000 7f8876ffd700 1 -- 172.21.15.71:0/1249581171 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88780b6200 con 0x7f88780b4e70 2023-10-09T07:00:12.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.372+0000 7f8876ffd700 1 --2- 172.21.15.71:0/1249581171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88780b4e70 0x7f88780ccff0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f88680098e0 tx=0x7f88680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=670f11330029c3b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:12.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.372+0000 7f8875ffb700 1 -- 172.21.15.71:0/1249581171 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886800b640 con 0x7f88780b4e70 2023-10-09T07:00:12.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.372+0000 7f8875ffb700 1 -- 172.21.15.71:0/1249581171 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886800b7a0 con 0x7f88780b4e70 2023-10-09T07:00:12.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.372+0000 7f8875ffb700 1 -- 172.21.15.71:0/1249581171 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886800bb40 con 0x7f88780b4e70 2023-10-09T07:00:12.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.373+0000 7f8877fff700 1 -- 172.21.15.71:0/1249581171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88780b4e70 msgr2=0x7f88780ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:12.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.373+0000 7f8877fff700 1 --2- 172.21.15.71:0/1249581171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88780b4e70 0x7f88780ccff0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f88680098e0 tx=0x7f88680091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:12.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.373+0000 7f8877fff700 1 -- 172.21.15.71:0/1249581171 shutdown_connections 2023-10-09T07:00:12.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.373+0000 7f8877fff700 1 --2- 172.21.15.71:0/1249581171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88780b1b40 0x7f887815d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:12.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.373+0000 7f8877fff700 1 --2- 172.21.15.71:0/1249581171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88780b4e70 0x7f88780ccff0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:12.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.373+0000 7f8877fff700 1 -- 172.21.15.71:0/1249581171 >> 172.21.15.71:0/1249581171 conn(0x7f88780d10c0 msgr2=0x7f88780affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:12.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.373+0000 7f8877fff700 1 -- 172.21.15.71:0/1249581171 shutdown_connections 2023-10-09T07:00:12.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.373+0000 7f8877fff700 1 -- 172.21.15.71:0/1249581171 wait complete. 2023-10-09T07:00:12.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.375+0000 7f8877fff700 1 Processor -- start 2023-10-09T07:00:12.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.375+0000 7f8877fff700 1 -- start start 2023-10-09T07:00:12.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.376+0000 7f8877fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88780b16d0 0x7f88780cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:12.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.376+0000 7f8877fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88780b1b40 0x7f887816d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:12.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.376+0000 7f8877fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88780b4e70 0x7f887816ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:12.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.376+0000 7f8877fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88780cc3c0 con 0x7f88780b16d0 2023-10-09T07:00:12.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.376+0000 7f8877fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887816b460 con 0x7f88780b4e70 2023-10-09T07:00:12.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.376+0000 7f8877fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88780c8d00 con 0x7f88780b1b40 2023-10-09T07:00:12.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.376+0000 7f8876ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88780b16d0 0x7f88780cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:12.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.376+0000 7f88767fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88780b1b40 0x7f887816d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:12.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.376+0000 7f8876ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88780b16d0 0x7f88780cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34820/0 (socket says 172.21.15.71:34820) 2023-10-09T07:00:12.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.376+0000 7f8876ffd700 1 -- 172.21.15.71:0/3744840835 learned_addr learned my addr 172.21.15.71:0/3744840835 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:12.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.376+0000 7f88777fe700 1 --2- 172.21.15.71:0/3744840835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88780b4e70 0x7f887816ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:12.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.377+0000 7f88767fc700 1 -- 172.21.15.71:0/3744840835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88780b4e70 msgr2=0x7f887816ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:12.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.377+0000 7f88767fc700 1 --2- 172.21.15.71:0/3744840835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88780b4e70 0x7f887816ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:12.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.377+0000 7f88767fc700 1 -- 172.21.15.71:0/3744840835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88780b16d0 msgr2=0x7f88780cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:12.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.377+0000 7f88767fc700 1 --2- 172.21.15.71:0/3744840835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88780b16d0 0x7f88780cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:12.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.377+0000 7f88767fc700 1 -- 172.21.15.71:0/3744840835 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8868009420 con 0x7f88780b1b40 2023-10-09T07:00:12.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.377+0000 7f88767fc700 1 --2- 172.21.15.71:0/3744840835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88780b1b40 0x7f887816d890 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f886c00c4f0 tx=0x7f886c007f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:12.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.377+0000 7f885effd700 1 -- 172.21.15.71:0/3744840835 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c00cea0 con 0x7f88780b1b40 2023-10-09T07:00:12.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.377+0000 7f885effd700 1 -- 172.21.15.71:0/3744840835 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886c005b30 con 0x7f88780b1b40 2023-10-09T07:00:12.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.377+0000 7f8877fff700 1 -- 172.21.15.71:0/3744840835 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f887816b6b0 con 0x7f88780b1b40 2023-10-09T07:00:12.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.377+0000 7f885effd700 1 -- 172.21.15.71:0/3744840835 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c0070d0 con 0x7f88780b1b40 2023-10-09T07:00:12.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.377+0000 7f8877fff700 1 -- 172.21.15.71:0/3744840835 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887816bc70 con 0x7f88780b1b40 2023-10-09T07:00:12.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.378+0000 7f8877fff700 1 -- 172.21.15.71:0/3744840835 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887816be90 con 0x7f88780b1b40 2023-10-09T07:00:12.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.379+0000 7f885effd700 1 -- 172.21.15.71:0/3744840835 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 46) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f886c0074c0 con 0x7f88780b1b40 2023-10-09T07:00:12.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.380+0000 7f885effd700 1 --2- 172.21.15.71:0/3744840835 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8864067170 0x7f8864069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:12.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.380+0000 7f885effd700 1 -- 172.21.15.71:0/3744840835 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6470+0+0 (secure 0 0 0) 0x7f886c083fc0 con 0x7f88780b1b40 2023-10-09T07:00:12.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.380+0000 7f8876ffd700 1 --2- 172.21.15.71:0/3744840835 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8864067170 0x7f8864069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:12.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.380+0000 7f8876ffd700 1 --2- 172.21.15.71:0/3744840835 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8864067170 0x7f8864069620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello connection peer type does not match what peer advertises 16 != 2 2023-10-09T07:00:12.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.380+0000 7f8876ffd700 1 --2- 172.21.15.71:0/3744840835 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8864067170 0x7f8864069620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:12.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.380+0000 7f885effd700 1 -- 172.21.15.71:0/3744840835 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8864067170 msgr2=0x7f8864069620 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-10-09T07:00:12.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.380+0000 7f885effd700 1 --2- 172.21.15.71:0/3744840835 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8864067170 0x7f8864069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:12.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.384+0000 7f885effd700 1 -- 172.21.15.71:0/3744840835 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f886c050c00 con 0x7f88780b1b40 2023-10-09T07:00:12.388 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:12.388+0000 7fb940e35180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T07:00:12.434 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:12.434+0000 7eff3ce86180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T07:00:12.548 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:12.548+0000 7fb940e35180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T07:00:12.622 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:12.622+0000 7eff3ce86180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T07:00:12.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.625+0000 7f8877fff700 1 -- 172.21.15.71:0/3744840835 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f88780b14b0 con 0x7f88780b1b40 2023-10-09T07:00:12.657 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:12.656+0000 7fb940e35180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T07:00:12.715 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:12.715+0000 7eff3ce86180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T07:00:12.806 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:12.806+0000 7eff3ce86180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T07:00:12.848 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:12.848+0000 7fb940e35180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T07:00:12.901 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:12.900+0000 7eff3ce86180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T07:00:12.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:12.914+0000 7f885effd700 1 -- 172.21.15.71:0/3744840835 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mgrmap(e 47) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f886c050fd0 con 0x7f88780b1b40 2023-10-09T07:00:12.945 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:12.945+0000 7fb940e35180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T07:00:12.982 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:12.982+0000 7efebb289700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:12.983 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:12.982+0000 7efebb289700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:12.983 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:12.982+0000 7efebb289700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:12.983 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:12.982+0000 7efebb289700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:12.983 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:12.982+0000 7efebb289700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:12.984 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:12.983+0000 7efeb7a82700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:12.984 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:12.983+0000 7efeb7a82700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:12.984 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:12.983+0000 7efeb7a82700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:12.984 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:12.983+0000 7efeb7a82700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:12.984 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:12.983+0000 7efeb7a82700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:13.042 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:13.042+0000 7fb940e35180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T07:00:13.135 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:13.135+0000 7fb940e35180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T07:00:13.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.160+0000 7f885effd700 1 -- 172.21.15.71:0/3744840835 <== mon.2 v2:172.21.15.179:3301/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v51) v1 ==== 104+0+0 (secure 0 0 0) 0x7f886c054690 con 0x7f88780b1b40 2023-10-09T07:00:13.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.162+0000 7f8877fff700 1 -- 172.21.15.71:0/3744840835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88780b1b40 msgr2=0x7f887816d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:13.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.162+0000 7f8877fff700 1 --2- 172.21.15.71:0/3744840835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88780b1b40 0x7f887816d890 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f886c00c4f0 tx=0x7f886c007f50 comp rx=0 tx=0).stop 2023-10-09T07:00:13.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.162+0000 7f8877fff700 1 -- 172.21.15.71:0/3744840835 shutdown_connections 2023-10-09T07:00:13.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.162+0000 7f8877fff700 1 --2- 172.21.15.71:0/3744840835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88780b4e70 0x7f887816ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:13.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.162+0000 7f8877fff700 1 --2- 172.21.15.71:0/3744840835 >> [v2:172.21.15.179:6832/85452,v1:172.21.15.179:6833/85452] conn(0x7f8864067170 0x7f8864069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:13.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.162+0000 7f8877fff700 1 --2- 172.21.15.71:0/3744840835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88780b16d0 0x7f88780cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:13.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.162+0000 7f8877fff700 1 --2- 172.21.15.71:0/3744840835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88780b1b40 0x7f887816d890 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:13.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.162+0000 7f8877fff700 1 -- 172.21.15.71:0/3744840835 >> 172.21.15.71:0/3744840835 conn(0x7f88780d10c0 msgr2=0x7f887815c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:13.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.162+0000 7f8877fff700 1 -- 172.21.15.71:0/3744840835 shutdown_connections 2023-10-09T07:00:13.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.162+0000 7f8877fff700 1 -- 172.21.15.71:0/3744840835 wait complete. 2023-10-09T07:00:13.180 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T07:00:13.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.364+0000 7f2735d9d700 1 Processor -- start 2023-10-09T07:00:13.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.364+0000 7f2735d9d700 1 -- start start 2023-10-09T07:00:13.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.365+0000 7f2735d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2730156350 0x7f2730157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:13.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.365+0000 7f2735d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f27300b0760 0x7f27300b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:13.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.365+0000 7f2735d9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27300b1110 con 0x7f2730159f20 2023-10-09T07:00:13.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.365+0000 7f2735d9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27300b0570 con 0x7f27300b0760 2023-10-09T07:00:13.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.365+0000 7f2735d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27301578b0 con 0x7f2730156350 2023-10-09T07:00:13.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.366+0000 7f273559c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f2730159f20 0x7f273015a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56256/0 (socket says 172.21.15.71:56256) 2023-10-09T07:00:13.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.366+0000 7f272ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f27300b0760 0x7f27300b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:13.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.366+0000 7f273559c700 1 -- 172.21.15.71:0/23803201 learned_addr learned my addr 172.21.15.71:0/23803201 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:13.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.366+0000 7f2734d9b700 1 --2- 172.21.15.71:0/23803201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2730156350 0x7f2730157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:13.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.366+0000 7f272ffff700 1 -- 172.21.15.71:0/23803201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2730156350 msgr2=0x7f2730157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:13.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.366+0000 7f272ffff700 1 --2- 172.21.15.71:0/23803201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2730156350 0x7f2730157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:13.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.366+0000 7f272ffff700 1 -- 172.21.15.71:0/23803201 >> v1:172.21.15.71:6789/0 conn(0x7f2730159f20 legacy=0x7f273015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:13.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.366+0000 7f272ffff700 1 -- 172.21.15.71:0/23803201 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27300af4d0 con 0x7f27300b0760 2023-10-09T07:00:13.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.366+0000 7f272f7fe700 1 -- 172.21.15.71:0/23803201 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006938077 0 0) 0x7f27300b1110 con 0x7f2730159f20 2023-10-09T07:00:13.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.367+0000 7f272ffff700 1 --2- 172.21.15.71:0/23803201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27300b0760 0x7f27300b0bd0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f271c0098e0 tx=0x7f271c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b73b00fa2897270 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:13.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.367+0000 7f272f7fe700 1 -- 172.21.15.71:0/23803201 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c00b640 con 0x7f27300b0760 2023-10-09T07:00:13.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.367+0000 7f272f7fe700 1 -- 172.21.15.71:0/23803201 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c00b7a0 con 0x7f27300b0760 2023-10-09T07:00:13.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.367+0000 7f272f7fe700 1 -- 172.21.15.71:0/23803201 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c00bb40 con 0x7f27300b0760 2023-10-09T07:00:13.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.367+0000 7f2735d9d700 1 -- 172.21.15.71:0/23803201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27300b0760 msgr2=0x7f27300b0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:13.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.367+0000 7f2735d9d700 1 --2- 172.21.15.71:0/23803201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27300b0760 0x7f27300b0bd0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f271c0098e0 tx=0x7f271c0091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:13.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.367+0000 7f2735d9d700 1 -- 172.21.15.71:0/23803201 shutdown_connections 2023-10-09T07:00:13.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.367+0000 7f2735d9d700 1 --2- 172.21.15.71:0/23803201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2730156350 0x7f2730157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:13.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.367+0000 7f2735d9d700 1 --2- 172.21.15.71:0/23803201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27300b0760 0x7f27300b0bd0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:13.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.367+0000 7f2735d9d700 1 -- 172.21.15.71:0/23803201 >> 172.21.15.71:0/23803201 conn(0x7f2730068e20 msgr2=0x7f27300cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:13.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.367+0000 7f2735d9d700 1 -- 172.21.15.71:0/23803201 shutdown_connections 2023-10-09T07:00:13.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.368+0000 7f2735d9d700 1 -- 172.21.15.71:0/23803201 wait complete. 2023-10-09T07:00:13.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.369+0000 7f2735d9d700 1 Processor -- start 2023-10-09T07:00:13.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.369+0000 7f2735d9d700 1 -- start start 2023-10-09T07:00:13.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.370+0000 7f2735d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27300b0760 0x7f27300adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:13.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.370+0000 7f2735d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2730156350 0x7f27300cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:13.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.370+0000 7f2735d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2730159f20 0x7f2730149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:13.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.370+0000 7f2735d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27300c90c0 con 0x7f27300b0760 2023-10-09T07:00:13.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.370+0000 7f2735d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27300c9360 con 0x7f2730156350 2023-10-09T07:00:13.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.370+0000 7f2735d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27300c9640 con 0x7f2730159f20 2023-10-09T07:00:13.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.370+0000 7f2734d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27300b0760 0x7f27300adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:13.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.370+0000 7f2734d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27300b0760 0x7f27300adff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34834/0 (socket says 172.21.15.71:34834) 2023-10-09T07:00:13.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.370+0000 7f2734d9b700 1 -- 172.21.15.71:0/1680198996 learned_addr learned my addr 172.21.15.71:0/1680198996 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:13.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.370+0000 7f272ffff700 1 --2- 172.21.15.71:0/1680198996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2730156350 0x7f27300cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:13.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.370+0000 7f273559c700 1 --2- 172.21.15.71:0/1680198996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2730159f20 0x7f2730149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:13.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.370+0000 7f2734d9b700 1 -- 172.21.15.71:0/1680198996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2730159f20 msgr2=0x7f2730149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:13.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.371+0000 7f2734d9b700 1 --2- 172.21.15.71:0/1680198996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2730159f20 0x7f2730149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:13.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.371+0000 7f2734d9b700 1 -- 172.21.15.71:0/1680198996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2730156350 msgr2=0x7f27300cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:13.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.371+0000 7f2734d9b700 1 --2- 172.21.15.71:0/1680198996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2730156350 0x7f27300cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:13.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.371+0000 7f2734d9b700 1 -- 172.21.15.71:0/1680198996 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c009420 con 0x7f27300b0760 2023-10-09T07:00:13.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.371+0000 7f2734d9b700 1 --2- 172.21.15.71:0/1680198996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27300b0760 0x7f27300adff0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f272400e930 tx=0x7f27240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:13.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.371+0000 7f272cff9700 1 -- 172.21.15.71:0/1680198996 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724013680 con 0x7f27300b0760 2023-10-09T07:00:13.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.371+0000 7f272cff9700 1 -- 172.21.15.71:0/1680198996 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27240137e0 con 0x7f27300b0760 2023-10-09T07:00:13.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.371+0000 7f272cff9700 1 -- 172.21.15.71:0/1680198996 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724013b80 con 0x7f27300b0760 2023-10-09T07:00:13.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.371+0000 7f2735d9d700 1 -- 172.21.15.71:0/1680198996 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27300cb010 con 0x7f27300b0760 2023-10-09T07:00:13.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.371+0000 7f2735d9d700 1 -- 172.21.15.71:0/1680198996 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27300cacc0 con 0x7f27300b0760 2023-10-09T07:00:13.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.372+0000 7f2735d9d700 1 -- 172.21.15.71:0/1680198996 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27300cb4b0 con 0x7f27300b0760 2023-10-09T07:00:13.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.373+0000 7f272cff9700 1 -- 172.21.15.71:0/1680198996 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 47) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f272400c3e0 con 0x7f27300b0760 2023-10-09T07:00:13.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.374+0000 7f272cff9700 1 -- 172.21.15.71:0/1680198996 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6814+0+0 (secure 0 0 0) 0x7f2724084500 con 0x7f27300b0760 2023-10-09T07:00:13.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.378+0000 7f272cff9700 1 -- 172.21.15.71:0/1680198996 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27240516e0 con 0x7f27300b0760 2023-10-09T07:00:13.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.570+0000 7f2735d9d700 1 -- 172.21.15.71:0/1680198996 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f27300c9800 con 0x7f27300b0760 2023-10-09T07:00:13.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.917+0000 7f272cff9700 1 -- 172.21.15.71:0/1680198996 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 48) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f2724051190 con 0x7f27300b0760 2023-10-09T07:00:13.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.917+0000 7f272cff9700 1 --2- 172.21.15.71:0/1680198996 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f271406ca90 0x7f271406ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:13.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.921+0000 7f272ffff700 1 --2- 172.21.15.71:0/1680198996 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f271406ca90 0x7f271406ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:13.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:13.926+0000 7f272ffff700 1 --2- 172.21.15.71:0/1680198996 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f271406ca90 0x7f271406ee70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f271c0093f0 tx=0x7f271c017000 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:14.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.162+0000 7f272cff9700 1 -- 172.21.15.71:0/1680198996 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v113) v1 ==== 181+0+0 (secure 0 0 0) 0x7f272406f640 con 0x7f27300b0760 2023-10-09T07:00:14.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.165+0000 7f2735d9d700 1 -- 172.21.15.71:0/1680198996 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f271406ca90 msgr2=0x7f271406ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:14.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.165+0000 7f2735d9d700 1 --2- 172.21.15.71:0/1680198996 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f271406ca90 0x7f271406ee70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f271c0093f0 tx=0x7f271c017000 comp rx=0 tx=0).stop 2023-10-09T07:00:14.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.165+0000 7f2735d9d700 1 -- 172.21.15.71:0/1680198996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27300b0760 msgr2=0x7f27300adff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:14.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.165+0000 7f2735d9d700 1 --2- 172.21.15.71:0/1680198996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27300b0760 0x7f27300adff0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f272400e930 tx=0x7f27240091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:14.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.166+0000 7f2735d9d700 1 -- 172.21.15.71:0/1680198996 shutdown_connections 2023-10-09T07:00:14.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.166+0000 7f2735d9d700 1 --2- 172.21.15.71:0/1680198996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2730159f20 0x7f2730149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:14.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.166+0000 7f2735d9d700 1 --2- 172.21.15.71:0/1680198996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27300b0760 0x7f27300adff0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:14.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.166+0000 7f2735d9d700 1 --2- 172.21.15.71:0/1680198996 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f271406ca90 0x7f271406ee70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:14.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.166+0000 7f2735d9d700 1 --2- 172.21.15.71:0/1680198996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2730156350 0x7f27300cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:14.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.166+0000 7f2735d9d700 1 -- 172.21.15.71:0/1680198996 >> 172.21.15.71:0/1680198996 conn(0x7f2730068e20 msgr2=0x7f2730161670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:14.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.166+0000 7f2735d9d700 1 -- 172.21.15.71:0/1680198996 shutdown_connections 2023-10-09T07:00:14.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.166+0000 7f2735d9d700 1 -- 172.21.15.71:0/1680198996 wait complete. 2023-10-09T07:00:14.167 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' removed 2023-10-09T07:00:14.185 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T07:00:14.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.370+0000 7f3d811ff700 1 Processor -- start 2023-10-09T07:00:14.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.370+0000 7f3d811ff700 1 -- start start 2023-10-09T07:00:14.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.371+0000 7f3d811ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d7c153f50 0x7f3d7c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:14.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.371+0000 7f3d811ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3d7c154320 0x7f3d7c06d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:14.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.371+0000 7f3d811ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d7c0b4570 con 0x7f3d7c15a190 2023-10-09T07:00:14.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.371+0000 7f3d811ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d7c15a730 con 0x7f3d7c154320 2023-10-09T07:00:14.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.371+0000 7f3d811ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c15aa10 con 0x7f3d7c153f50 2023-10-09T07:00:14.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.372+0000 7f3d7a59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3d7c154320 0x7f3d7c06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:14.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.372+0000 7f3d7b59e700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3d7c15a190 0x7f3d7c15d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56268/0 (socket says 172.21.15.71:56268) 2023-10-09T07:00:14.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.372+0000 7f3d7b59e700 1 -- 172.21.15.71:0/833295262 learned_addr learned my addr 172.21.15.71:0/833295262 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:14.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.372+0000 7f3d7ad9d700 1 --2- 172.21.15.71:0/833295262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d7c153f50 0x7f3d7c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:14.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.372+0000 7f3d79d9b700 1 -- 172.21.15.71:0/833295262 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124628271 0 0) 0x7f3d7c0b4570 con 0x7f3d7c15a190 2023-10-09T07:00:14.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.372+0000 7f3d7a59c700 1 -- 172.21.15.71:0/833295262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d7c153f50 msgr2=0x7f3d7c0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:14.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.372+0000 7f3d7a59c700 1 --2- 172.21.15.71:0/833295262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d7c153f50 0x7f3d7c0b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:14.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.372+0000 7f3d7a59c700 1 -- 172.21.15.71:0/833295262 >> v1:172.21.15.71:6789/0 conn(0x7f3d7c15a190 legacy=0x7f3d7c15d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:14.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.372+0000 7f3d7a59c700 1 -- 172.21.15.71:0/833295262 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7c15acf0 con 0x7f3d7c154320 2023-10-09T07:00:14.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.372+0000 7f3d7ad9d700 1 --2- 172.21.15.71:0/833295262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d7c153f50 0x7f3d7c0b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:00:14.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.372+0000 7f3d7a59c700 1 --2- 172.21.15.71:0/833295262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d7c154320 0x7f3d7c06d130 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f3d700098e0 tx=0x7f3d700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ca8e8cbb81d577 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:14.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.372+0000 7f3d79d9b700 1 -- 172.21.15.71:0/833295262 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d70009e80 con 0x7f3d7c154320 2023-10-09T07:00:14.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.373+0000 7f3d79d9b700 1 -- 172.21.15.71:0/833295262 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7000b860 con 0x7f3d7c154320 2023-10-09T07:00:14.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.373+0000 7f3d79d9b700 1 -- 172.21.15.71:0/833295262 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7000bbe0 con 0x7f3d7c154320 2023-10-09T07:00:14.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.373+0000 7f3d811ff700 1 -- 172.21.15.71:0/833295262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d7c154320 msgr2=0x7f3d7c06d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:14.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.373+0000 7f3d811ff700 1 --2- 172.21.15.71:0/833295262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d7c154320 0x7f3d7c06d130 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f3d700098e0 tx=0x7f3d700091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:14.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.373+0000 7f3d811ff700 1 -- 172.21.15.71:0/833295262 shutdown_connections 2023-10-09T07:00:14.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.373+0000 7f3d811ff700 1 --2- 172.21.15.71:0/833295262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d7c153f50 0x7f3d7c0b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:14.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.373+0000 7f3d811ff700 1 --2- 172.21.15.71:0/833295262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d7c154320 0x7f3d7c06d130 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:14.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.373+0000 7f3d811ff700 1 -- 172.21.15.71:0/833295262 >> 172.21.15.71:0/833295262 conn(0x7f3d7c06baf0 msgr2=0x7f3d7c06bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:14.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.373+0000 7f3d811ff700 1 -- 172.21.15.71:0/833295262 shutdown_connections 2023-10-09T07:00:14.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.373+0000 7f3d811ff700 1 -- 172.21.15.71:0/833295262 wait complete. 2023-10-09T07:00:14.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.375+0000 7f3d811ff700 1 Processor -- start 2023-10-09T07:00:14.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.375+0000 7f3d811ff700 1 -- start start 2023-10-09T07:00:14.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.376+0000 7f3d811ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d7c153f50 0x7f3d7c159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:14.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.376+0000 7f3d811ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d7c154320 0x7f3d7c0caa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:14.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.376+0000 7f3d811ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d7c15a190 0x7f3d7c0c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:14.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.376+0000 7f3d811ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c0cb280 con 0x7f3d7c154320 2023-10-09T07:00:14.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.376+0000 7f3d811ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c151ab0 con 0x7f3d7c15a190 2023-10-09T07:00:14.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.376+0000 7f3d811ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c0caf50 con 0x7f3d7c153f50 2023-10-09T07:00:14.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.376+0000 7f3d7a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d7c154320 0x7f3d7c0caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:14.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.376+0000 7f3d7a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d7c154320 0x7f3d7c0caa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34862/0 (socket says 172.21.15.71:34862) 2023-10-09T07:00:14.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.376+0000 7f3d7a59c700 1 -- 172.21.15.71:0/796826836 learned_addr learned my addr 172.21.15.71:0/796826836 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:14.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.376+0000 7f3d7ad9d700 1 --2- 172.21.15.71:0/796826836 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d7c153f50 0x7f3d7c159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:14.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.376+0000 7f3d7a59c700 1 -- 172.21.15.71:0/796826836 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d7c153f50 msgr2=0x7f3d7c159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:14.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.376+0000 7f3d7b59e700 1 --2- 172.21.15.71:0/796826836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d7c15a190 0x7f3d7c0c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:14.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.376+0000 7f3d7a59c700 1 --2- 172.21.15.71:0/796826836 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d7c153f50 0x7f3d7c159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:14.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.376+0000 7f3d7a59c700 1 -- 172.21.15.71:0/796826836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d7c15a190 msgr2=0x7f3d7c0c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:14.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.376+0000 7f3d7a59c700 1 --2- 172.21.15.71:0/796826836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d7c15a190 0x7f3d7c0c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:14.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.376+0000 7f3d7a59c700 1 -- 172.21.15.71:0/796826836 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d70009420 con 0x7f3d7c154320 2023-10-09T07:00:14.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.376+0000 7f3d7b59e700 1 --2- 172.21.15.71:0/796826836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d7c15a190 0x7f3d7c0c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:00:14.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.376+0000 7f3d7a59c700 1 --2- 172.21.15.71:0/796826836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d7c154320 0x7f3d7c0caa10 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f3d70013000 tx=0x7f3d70017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:14.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.377+0000 7f3d62ffd700 1 -- 172.21.15.71:0/796826836 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7000bbe0 con 0x7f3d7c154320 2023-10-09T07:00:14.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.377+0000 7f3d62ffd700 1 -- 172.21.15.71:0/796826836 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d70011420 con 0x7f3d7c154320 2023-10-09T07:00:14.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.377+0000 7f3d62ffd700 1 -- 172.21.15.71:0/796826836 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d700117e0 con 0x7f3d7c154320 2023-10-09T07:00:14.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.377+0000 7f3d811ff700 1 -- 172.21.15.71:0/796826836 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d7c16d9d0 con 0x7f3d7c154320 2023-10-09T07:00:14.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.377+0000 7f3d811ff700 1 -- 172.21.15.71:0/796826836 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d7c16df90 con 0x7f3d7c154320 2023-10-09T07:00:14.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.378+0000 7f3d811ff700 1 -- 172.21.15.71:0/796826836 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d7c0cb430 con 0x7f3d7c154320 2023-10-09T07:00:14.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.379+0000 7f3d62ffd700 1 -- 172.21.15.71:0/796826836 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 48) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f3d70011c10 con 0x7f3d7c154320 2023-10-09T07:00:14.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.380+0000 7f3d62ffd700 1 --2- 172.21.15.71:0/796826836 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3d68066d80 0x7f3d68069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:14.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.380+0000 7f3d62ffd700 1 -- 172.21.15.71:0/796826836 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6376+0+0 (secure 0 0 0) 0x7f3d70085ea0 con 0x7f3d7c154320 2023-10-09T07:00:14.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.381+0000 7f3d7ad9d700 1 --2- 172.21.15.71:0/796826836 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3d68066d80 0x7f3d68069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:14.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.381+0000 7f3d7ad9d700 1 --2- 172.21.15.71:0/796826836 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3d68066d80 0x7f3d68069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c006f00 tx=0x7f3d6c008040 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:14.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.385+0000 7f3d62ffd700 1 -- 172.21.15.71:0/796826836 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d7c0cb430 con 0x7f3d7c154320 2023-10-09T07:00:14.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:14.587+0000 7f3d811ff700 1 -- 172.21.15.71:0/796826836 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3d7c0cb430 con 0x7f3d7c154320 2023-10-09T07:00:15.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.167+0000 7f3d62ffd700 1 -- 172.21.15.71:0/796826836 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d700534f0 con 0x7f3d7c154320 2023-10-09T07:00:15.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.175+0000 7f3d62ffd700 1 -- 172.21.15.71:0/796826836 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v114) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3d70056740 con 0x7f3d7c154320 2023-10-09T07:00:15.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.179+0000 7f3d811ff700 1 -- 172.21.15.71:0/796826836 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3d68066d80 msgr2=0x7f3d68069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:15.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.179+0000 7f3d811ff700 1 --2- 172.21.15.71:0/796826836 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3d68066d80 0x7f3d68069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c006f00 tx=0x7f3d6c008040 comp rx=0 tx=0).stop 2023-10-09T07:00:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.179+0000 7f3d811ff700 1 -- 172.21.15.71:0/796826836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d7c154320 msgr2=0x7f3d7c0caa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.179+0000 7f3d811ff700 1 --2- 172.21.15.71:0/796826836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d7c154320 0x7f3d7c0caa10 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f3d70013000 tx=0x7f3d70017000 comp rx=0 tx=0).stop 2023-10-09T07:00:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.179+0000 7f3d811ff700 1 -- 172.21.15.71:0/796826836 shutdown_connections 2023-10-09T07:00:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.179+0000 7f3d811ff700 1 --2- 172.21.15.71:0/796826836 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3d68066d80 0x7f3d68069230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.179+0000 7f3d811ff700 1 --2- 172.21.15.71:0/796826836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d7c15a190 0x7f3d7c0c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.179+0000 7f3d811ff700 1 --2- 172.21.15.71:0/796826836 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d7c153f50 0x7f3d7c159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.179+0000 7f3d811ff700 1 --2- 172.21.15.71:0/796826836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d7c154320 0x7f3d7c0caa10 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.179+0000 7f3d811ff700 1 -- 172.21.15.71:0/796826836 >> 172.21.15.71:0/796826836 conn(0x7f3d7c06baf0 msgr2=0x7f3d7c1534f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.179+0000 7f3d811ff700 1 -- 172.21.15.71:0/796826836 shutdown_connections 2023-10-09T07:00:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.179+0000 7f3d811ff700 1 -- 172.21.15.71:0/796826836 wait complete. 2023-10-09T07:00:15.181 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' removed 2023-10-09T07:00:15.199 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T07:00:15.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.382+0000 7fa45afff700 1 Processor -- start 2023-10-09T07:00:15.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.382+0000 7fa45afff700 1 -- start start 2023-10-09T07:00:15.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.383+0000 7fa45afff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa4540b0a70 0x7fa4541625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:15.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.383+0000 7fa45afff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4540af2f0 con 0x7fa454069e80 2023-10-09T07:00:15.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.383+0000 7fa45afff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4540af5d0 con 0x7fa45415ac80 2023-10-09T07:00:15.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.383+0000 7fa45afff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4540c8660 con 0x7fa4540b0a70 2023-10-09T07:00:15.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.383+0000 7fa45959c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa4540b0a70 0x7fa4541625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:15.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.383+0000 7fa453fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa454069e80 0x7fa4540c6b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48168/0 (socket says 172.21.15.71:48168) 2023-10-09T07:00:15.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.384+0000 7fa453fff700 1 -- 172.21.15.71:0/4261570440 learned_addr learned my addr 172.21.15.71:0/4261570440 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:15.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.384+0000 7fa45959c700 1 -- 172.21.15.71:0/4261570440 >> v1:172.21.15.179:6789/0 conn(0x7fa45415ac80 legacy=0x7fa454069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:15.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.384+0000 7fa45959c700 1 -- 172.21.15.71:0/4261570440 >> v1:172.21.15.71:6789/0 conn(0x7fa454069e80 legacy=0x7fa4540c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:15.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.384+0000 7fa45959c700 1 -- 172.21.15.71:0/4261570440 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4540c8940 con 0x7fa4540b0a70 2023-10-09T07:00:15.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.384+0000 7fa4537fe700 1 -- 172.21.15.71:0/4261570440 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 546213887 0 0) 0x7fa4540af2f0 con 0x7fa454069e80 2023-10-09T07:00:15.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.384+0000 7fa45959c700 1 --2- 172.21.15.71:0/4261570440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4540b0a70 0x7fa4541625e0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fa44c0098e0 tx=0x7fa44c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454372608907bf0a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:15.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.384+0000 7fa4537fe700 1 -- 172.21.15.71:0/4261570440 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c009e80 con 0x7fa4540b0a70 2023-10-09T07:00:15.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.384+0000 7fa4537fe700 1 -- 172.21.15.71:0/4261570440 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44c00b820 con 0x7fa4540b0a70 2023-10-09T07:00:15.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.384+0000 7fa4537fe700 1 -- 172.21.15.71:0/4261570440 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c00bba0 con 0x7fa4540b0a70 2023-10-09T07:00:15.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.385+0000 7fa45afff700 1 -- 172.21.15.71:0/4261570440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4540b0a70 msgr2=0x7fa4541625e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:15.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.385+0000 7fa45afff700 1 --2- 172.21.15.71:0/4261570440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4540b0a70 0x7fa4541625e0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fa44c0098e0 tx=0x7fa44c0091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:15.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.385+0000 7fa45afff700 1 -- 172.21.15.71:0/4261570440 shutdown_connections 2023-10-09T07:00:15.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.385+0000 7fa45afff700 1 --2- 172.21.15.71:0/4261570440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4540b0a70 0x7fa4541625e0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:15.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.385+0000 7fa45afff700 1 -- 172.21.15.71:0/4261570440 >> 172.21.15.71:0/4261570440 conn(0x7fa454068e10 msgr2=0x7fa4540cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:15.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.385+0000 7fa45afff700 1 -- 172.21.15.71:0/4261570440 shutdown_connections 2023-10-09T07:00:15.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.385+0000 7fa45afff700 1 -- 172.21.15.71:0/4261570440 wait complete. 2023-10-09T07:00:15.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.387+0000 7fa45afff700 1 Processor -- start 2023-10-09T07:00:15.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.387+0000 7fa45afff700 1 -- start start 2023-10-09T07:00:15.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.388+0000 7fa45afff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa454069e80 0x7fa45416c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:15.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.388+0000 7fa45afff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4540b0a70 0x7fa454169ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:15.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.388+0000 7fa45afff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa45415ac80 0x7fa4540b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:15.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.388+0000 7fa45afff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45415b050 con 0x7fa4540b0a70 2023-10-09T07:00:15.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.388+0000 7fa45afff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45416a5a0 con 0x7fa454069e80 2023-10-09T07:00:15.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.388+0000 7fa45afff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45416a880 con 0x7fa45415ac80 2023-10-09T07:00:15.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.388+0000 7fa453fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4540b0a70 0x7fa454169ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:15.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.388+0000 7fa453fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4540b0a70 0x7fa454169ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56926/0 (socket says 172.21.15.71:56926) 2023-10-09T07:00:15.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.388+0000 7fa453fff700 1 -- 172.21.15.71:0/3202942798 learned_addr learned my addr 172.21.15.71:0/3202942798 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:15.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.388+0000 7fa458d9b700 1 --2- 172.21.15.71:0/3202942798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa454069e80 0x7fa45416c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:15.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.388+0000 7fa45959c700 1 --2- 172.21.15.71:0/3202942798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa45415ac80 0x7fa4540b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:15.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.388+0000 7fa453fff700 1 -- 172.21.15.71:0/3202942798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa45415ac80 msgr2=0x7fa4540b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:15.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.388+0000 7fa453fff700 1 --2- 172.21.15.71:0/3202942798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa45415ac80 0x7fa4540b0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:15.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.388+0000 7fa453fff700 1 -- 172.21.15.71:0/3202942798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa454069e80 msgr2=0x7fa45416c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:15.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.388+0000 7fa453fff700 1 --2- 172.21.15.71:0/3202942798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa454069e80 0x7fa45416c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:15.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.388+0000 7fa453fff700 1 -- 172.21.15.71:0/3202942798 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44c009420 con 0x7fa4540b0a70 2023-10-09T07:00:15.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.389+0000 7fa453fff700 1 --2- 172.21.15.71:0/3202942798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4540b0a70 0x7fa454169ad0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fa44000c810 tx=0x7fa440007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:15.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.389+0000 7fa450ff9700 1 -- 172.21.15.71:0/3202942798 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa440005c00 con 0x7fa4540b0a70 2023-10-09T07:00:15.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.389+0000 7fa450ff9700 1 -- 172.21.15.71:0/3202942798 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa440005d60 con 0x7fa4540b0a70 2023-10-09T07:00:15.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.389+0000 7fa450ff9700 1 -- 172.21.15.71:0/3202942798 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa440007320 con 0x7fa4540b0a70 2023-10-09T07:00:15.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.389+0000 7fa45afff700 1 -- 172.21.15.71:0/3202942798 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa45415b230 con 0x7fa4540b0a70 2023-10-09T07:00:15.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.389+0000 7fa45afff700 1 -- 172.21.15.71:0/3202942798 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa45416cd60 con 0x7fa4540b0a70 2023-10-09T07:00:15.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.390+0000 7fa45afff700 1 -- 172.21.15.71:0/3202942798 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa45416aaa0 con 0x7fa4540b0a70 2023-10-09T07:00:15.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.391+0000 7fa450ff9700 1 -- 172.21.15.71:0/3202942798 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa44001b400 con 0x7fa4540b0a70 2023-10-09T07:00:15.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.391+0000 7fa450ff9700 1 --2- 172.21.15.71:0/3202942798 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa438066f30 0x7fa4380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:15.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.392+0000 7fa450ff9700 1 -- 172.21.15.71:0/3202942798 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5933+0+0 (secure 0 0 0) 0x7fa440084170 con 0x7fa4540b0a70 2023-10-09T07:00:15.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.392+0000 7fa458d9b700 1 --2- 172.21.15.71:0/3202942798 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa438066f30 0x7fa4380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:15.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.393+0000 7fa458d9b700 1 --2- 172.21.15.71:0/3202942798 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa438066f30 0x7fa4380693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa448009fd0 tx=0x7fa448009600 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:15.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.396+0000 7fa450ff9700 1 -- 172.21.15.71:0/3202942798 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4400512e0 con 0x7fa4540b0a70 2023-10-09T07:00:15.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.588+0000 7fa45afff700 1 -- 172.21.15.71:0/3202942798 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa4540c8c20 con 0x7fa4540b0a70 2023-10-09T07:00:15.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.592+0000 7fa450ff9700 1 -- 172.21.15.71:0/3202942798 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa440054900 con 0x7fa4540b0a70 2023-10-09T07:00:15.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.594+0000 7fa45afff700 1 -- 172.21.15.71:0/3202942798 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa438066f30 msgr2=0x7fa4380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:15.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.594+0000 7fa45afff700 1 --2- 172.21.15.71:0/3202942798 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa438066f30 0x7fa4380693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa448009fd0 tx=0x7fa448009600 comp rx=0 tx=0).stop 2023-10-09T07:00:15.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.594+0000 7fa45afff700 1 -- 172.21.15.71:0/3202942798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4540b0a70 msgr2=0x7fa454169ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:15.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.594+0000 7fa45afff700 1 --2- 172.21.15.71:0/3202942798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4540b0a70 0x7fa454169ad0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fa44000c810 tx=0x7fa440007db0 comp rx=0 tx=0).stop 2023-10-09T07:00:15.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.594+0000 7fa45afff700 1 -- 172.21.15.71:0/3202942798 shutdown_connections 2023-10-09T07:00:15.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.594+0000 7fa45afff700 1 --2- 172.21.15.71:0/3202942798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa45415ac80 0x7fa4540b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:15.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.594+0000 7fa45afff700 1 --2- 172.21.15.71:0/3202942798 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa438066f30 0x7fa4380693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:15.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.594+0000 7fa45afff700 1 --2- 172.21.15.71:0/3202942798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa454069e80 0x7fa45416c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:15.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.594+0000 7fa45afff700 1 --2- 172.21.15.71:0/3202942798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4540b0a70 0x7fa454169ad0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:15.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.594+0000 7fa45afff700 1 -- 172.21.15.71:0/3202942798 >> 172.21.15.71:0/3202942798 conn(0x7fa454068e10 msgr2=0x7fa454069770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:15.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.594+0000 7fa45afff700 1 -- 172.21.15.71:0/3202942798 shutdown_connections 2023-10-09T07:00:15.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.594+0000 7fa45afff700 1 -- 172.21.15.71:0/3202942798 wait complete. 2023-10-09T07:00:15.612 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-09T07:00:15.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.794+0000 7f1f52f9d700 1 Processor -- start 2023-10-09T07:00:15.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.794+0000 7f1f52f9d700 1 -- start start 2023-10-09T07:00:15.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.795+0000 7f1f52f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1f4c0b4e70 0x7f1f4c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:15.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.795+0000 7f1f52f9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1f4c0b16d0 0x7f1f4c0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:15.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.795+0000 7f1f52f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f4c0b2080 con 0x7f1f4c15d240 2023-10-09T07:00:15.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.795+0000 7f1f52f9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4c0cfb00 con 0x7f1f4c0b16d0 2023-10-09T07:00:15.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.795+0000 7f1f52f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4c0b5c40 con 0x7f1f4c0b4e70 2023-10-09T07:00:15.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.795+0000 7f1f5179a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1f4c0b16d0 0x7f1f4c0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:15.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.796+0000 7f1f5179a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1f4c0b16d0 0x7f1f4c0b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56930/0 (socket says 172.21.15.71:56930) 2023-10-09T07:00:15.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.796+0000 7f1f5179a700 1 -- 172.21.15.71:0/3412402292 learned_addr learned my addr 172.21.15.71:0/3412402292 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:15.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.796+0000 7f1f51f9b700 1 --2- 172.21.15.71:0/3412402292 >> v2:172.21.15.179:3300/0 conn(0x7f1f4c0b4e70 0x7f1f4c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:15.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.796+0000 7f1f5179a700 1 -- 172.21.15.71:0/3412402292 >> v2:172.21.15.179:3300/0 conn(0x7f1f4c0b4e70 msgr2=0x7f1f4c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:15.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.796+0000 7f1f5179a700 1 --2- 172.21.15.71:0/3412402292 >> v2:172.21.15.179:3300/0 conn(0x7f1f4c0b4e70 0x7f1f4c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:15.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.796+0000 7f1f5179a700 1 -- 172.21.15.71:0/3412402292 >> v1:172.21.15.179:6789/0 conn(0x7f1f4c15d240 legacy=0x7f1f4c15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:15.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.796+0000 7f1f5179a700 1 -- 172.21.15.71:0/3412402292 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c0b5f20 con 0x7f1f4c0b16d0 2023-10-09T07:00:15.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.796+0000 7f1f5179a700 1 --2- 172.21.15.71:0/3412402292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f4c0b16d0 0x7f1f4c0b1b40 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c064910 tx=0x7f1f3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8674a0988c86d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:15.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.796+0000 7f1f50f99700 1 -- 172.21.15.71:0/3412402292 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c009e70 con 0x7f1f4c0b16d0 2023-10-09T07:00:15.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.796+0000 7f1f50f99700 1 -- 172.21.15.71:0/3412402292 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c00b860 con 0x7f1f4c0b16d0 2023-10-09T07:00:15.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.796+0000 7f1f50f99700 1 -- 172.21.15.71:0/3412402292 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c00bc00 con 0x7f1f4c0b16d0 2023-10-09T07:00:15.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.797+0000 7f1f52f9d700 1 -- 172.21.15.71:0/3412402292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f4c0b16d0 msgr2=0x7f1f4c0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:15.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.797+0000 7f1f52f9d700 1 --2- 172.21.15.71:0/3412402292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f4c0b16d0 0x7f1f4c0b1b40 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c064910 tx=0x7f1f3c009250 comp rx=0 tx=0).stop 2023-10-09T07:00:15.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.797+0000 7f1f52f9d700 1 -- 172.21.15.71:0/3412402292 shutdown_connections 2023-10-09T07:00:15.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.797+0000 7f1f52f9d700 1 --2- 172.21.15.71:0/3412402292 >> v2:172.21.15.179:3300/0 conn(0x7f1f4c0b4e70 0x7f1f4c0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:15.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.797+0000 7f1f52f9d700 1 --2- 172.21.15.71:0/3412402292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f4c0b16d0 0x7f1f4c0b1b40 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:15.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.797+0000 7f1f52f9d700 1 -- 172.21.15.71:0/3412402292 >> 172.21.15.71:0/3412402292 conn(0x7f1f4c0d10c0 msgr2=0x7f1f4c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:15.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.797+0000 7f1f52f9d700 1 -- 172.21.15.71:0/3412402292 shutdown_connections 2023-10-09T07:00:15.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.797+0000 7f1f52f9d700 1 -- 172.21.15.71:0/3412402292 wait complete. 2023-10-09T07:00:15.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.799+0000 7f1f52f9d700 1 Processor -- start 2023-10-09T07:00:15.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.799+0000 7f1f52f9d700 1 -- start start 2023-10-09T07:00:15.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.799+0000 7f1f52f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f4c0b16d0 0x7f1f4c14b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:15.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.800+0000 7f1f52f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f4c0b4e70 0x7f1f4c15c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:15.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.800+0000 7f1f52f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f4c15d240 0x7f1f4c15cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:15.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.800+0000 7f1f52f9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c0c6280 con 0x7f1f4c0b16d0 2023-10-09T07:00:15.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.800+0000 7f1f52f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c14b690 con 0x7f1f4c15d240 2023-10-09T07:00:15.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.800+0000 7f1f52f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c15c1c0 con 0x7f1f4c0b4e70 2023-10-09T07:00:15.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.800+0000 7f1f51f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f4c0b16d0 0x7f1f4c14b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:15.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.800+0000 7f1f51f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f4c0b16d0 0x7f1f4c14b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56936/0 (socket says 172.21.15.71:56936) 2023-10-09T07:00:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.800+0000 7f1f51f9b700 1 -- 172.21.15.71:0/560251165 learned_addr learned my addr 172.21.15.71:0/560251165 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.800+0000 7f1f5179a700 1 --2- 172.21.15.71:0/560251165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f4c0b4e70 0x7f1f4c15c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.800+0000 7f1f5279c700 1 --2- 172.21.15.71:0/560251165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f4c15d240 0x7f1f4c15cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.800+0000 7f1f51f9b700 1 -- 172.21.15.71:0/560251165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f4c0b4e70 msgr2=0x7f1f4c15c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.800+0000 7f1f51f9b700 1 --2- 172.21.15.71:0/560251165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f4c0b4e70 0x7f1f4c15c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.800+0000 7f1f51f9b700 1 -- 172.21.15.71:0/560251165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f4c15d240 msgr2=0x7f1f4c15cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.800+0000 7f1f51f9b700 1 --2- 172.21.15.71:0/560251165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f4c15d240 0x7f1f4c15cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.800+0000 7f1f51f9b700 1 -- 172.21.15.71:0/560251165 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c0094f0 con 0x7f1f4c0b16d0 2023-10-09T07:00:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.800+0000 7f1f51f9b700 1 --2- 172.21.15.71:0/560251165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f4c0b16d0 0x7f1f4c14b150 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800ecb0 tx=0x7f1f480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.801+0000 7f1f41ffb700 1 -- 172.21.15.71:0/560251165 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4800c970 con 0x7f1f4c0b16d0 2023-10-09T07:00:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.801+0000 7f1f41ffb700 1 -- 172.21.15.71:0/560251165 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4800cad0 con 0x7f1f4c0b16d0 2023-10-09T07:00:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.801+0000 7f1f52f9d700 1 -- 172.21.15.71:0/560251165 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4c15b5b0 con 0x7f1f4c0b16d0 2023-10-09T07:00:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.801+0000 7f1f41ffb700 1 -- 172.21.15.71:0/560251165 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4800ce70 con 0x7f1f4c0b16d0 2023-10-09T07:00:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.801+0000 7f1f52f9d700 1 -- 172.21.15.71:0/560251165 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4c15b940 con 0x7f1f4c0b16d0 2023-10-09T07:00:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.802+0000 7f1f52f9d700 1 -- 172.21.15.71:0/560251165 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f4c15c4a0 con 0x7f1f4c0b16d0 2023-10-09T07:00:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.802+0000 7f1f41ffb700 1 -- 172.21.15.71:0/560251165 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f48013680 con 0x7f1f4c0b16d0 2023-10-09T07:00:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.804+0000 7f1f41ffb700 1 --2- 172.21.15.71:0/560251165 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1f30066f30 0x7f1f300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.804+0000 7f1f41ffb700 1 -- 172.21.15.71:0/560251165 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5933+0+0 (secure 0 0 0) 0x7f1f48084a60 con 0x7f1f4c0b16d0 2023-10-09T07:00:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.804+0000 7f1f5179a700 1 --2- 172.21.15.71:0/560251165 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1f30066f30 0x7f1f300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.805+0000 7f1f5179a700 1 --2- 172.21.15.71:0/560251165 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1f30066f30 0x7f1f300693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c064910 tx=0x7f1f3c017000 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:15.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:15.808+0000 7f1f41ffb700 1 -- 172.21.15.71:0/560251165 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f48051b50 con 0x7f1f4c0b16d0 2023-10-09T07:00:16.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.009+0000 7f1f52f9d700 1 -- 172.21.15.71:0/560251165 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f1f4c15bfa0 con 0x7f1f4c0b16d0 2023-10-09T07:00:16.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.015+0000 7f1f41ffb700 1 -- 172.21.15.71:0/560251165 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v38) v1 ==== 115+0+0 (secure 0 0 0) 0x7f1f48055170 con 0x7f1f4c0b16d0 2023-10-09T07:00:16.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.017+0000 7f1f52f9d700 1 -- 172.21.15.71:0/560251165 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1f30066f30 msgr2=0x7f1f300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:16.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.017+0000 7f1f52f9d700 1 --2- 172.21.15.71:0/560251165 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1f30066f30 0x7f1f300693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c064910 tx=0x7f1f3c017000 comp rx=0 tx=0).stop 2023-10-09T07:00:16.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.018+0000 7f1f52f9d700 1 -- 172.21.15.71:0/560251165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f4c0b16d0 msgr2=0x7f1f4c14b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:16.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.018+0000 7f1f52f9d700 1 --2- 172.21.15.71:0/560251165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f4c0b16d0 0x7f1f4c14b150 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800ecb0 tx=0x7f1f480091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.018+0000 7f1f52f9d700 1 -- 172.21.15.71:0/560251165 shutdown_connections 2023-10-09T07:00:16.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.018+0000 7f1f52f9d700 1 --2- 172.21.15.71:0/560251165 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1f30066f30 0x7f1f300693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.018+0000 7f1f52f9d700 1 --2- 172.21.15.71:0/560251165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f4c15d240 0x7f1f4c15cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.018+0000 7f1f52f9d700 1 --2- 172.21.15.71:0/560251165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f4c0b16d0 0x7f1f4c14b150 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.018+0000 7f1f52f9d700 1 --2- 172.21.15.71:0/560251165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f4c0b4e70 0x7f1f4c15c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.018+0000 7f1f52f9d700 1 -- 172.21.15.71:0/560251165 >> 172.21.15.71:0/560251165 conn(0x7f1f4c0d10c0 msgr2=0x7f1f4c158fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:16.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.018+0000 7f1f52f9d700 1 -- 172.21.15.71:0/560251165 shutdown_connections 2023-10-09T07:00:16.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.018+0000 7f1f52f9d700 1 -- 172.21.15.71:0/560251165 wait complete. 2023-10-09T07:00:16.036 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-09T07:00:16.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.218+0000 7f27d73ff700 1 Processor -- start 2023-10-09T07:00:16.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.218+0000 7f27d73ff700 1 -- start start 2023-10-09T07:00:16.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.219+0000 7f27d73ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27d00ccee0 0x7f27d01561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:16.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.220+0000 7f27d73ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f27d00c87c0 0x7f27d0156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:16.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.220+0000 7f27d73ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d015b0d0 con 0x7f27d00c83f0 2023-10-09T07:00:16.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.220+0000 7f27d73ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d0156c50 con 0x7f27d00c87c0 2023-10-09T07:00:16.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.220+0000 7f27d73ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d015a4c0 con 0x7f27d00ccee0 2023-10-09T07:00:16.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.220+0000 7f27d499a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27d00ccee0 0x7f27d01561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:16.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.220+0000 7f27d599c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f27d00c87c0 0x7f27d0156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:16.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.220+0000 7f27d499a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27d00ccee0 0x7f27d01561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:43104/0 (socket says 172.21.15.71:43104) 2023-10-09T07:00:16.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.220+0000 7f27d499a700 1 -- 172.21.15.71:0/3032301807 learned_addr learned my addr 172.21.15.71:0/3032301807 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:16.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.220+0000 7f27d519b700 1 --1- 172.21.15.71:0/3032301807 >> v1:172.21.15.179:6789/0 conn(0x7f27d00c83f0 0x7f27d00c7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:46990/0 (socket says 172.21.15.71:46990) 2023-10-09T07:00:16.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.221+0000 7f27c7fff700 1 -- 172.21.15.71:0/3032301807 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359558153 0 0) 0x7f27d015b0d0 con 0x7f27d00c83f0 2023-10-09T07:00:16.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.221+0000 7f27c7fff700 1 -- 172.21.15.71:0/3032301807 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27bc003570 con 0x7f27d00c83f0 2023-10-09T07:00:16.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.221+0000 7f27d599c700 1 -- 172.21.15.71:0/3032301807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27d00ccee0 msgr2=0x7f27d01561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:16.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.221+0000 7f27d599c700 1 --2- 172.21.15.71:0/3032301807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27d00ccee0 0x7f27d01561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.221+0000 7f27d599c700 1 -- 172.21.15.71:0/3032301807 >> v1:172.21.15.179:6789/0 conn(0x7f27d00c83f0 legacy=0x7f27d00c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:16.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.221+0000 7f27d599c700 1 -- 172.21.15.71:0/3032301807 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d015a7a0 con 0x7f27d00c87c0 2023-10-09T07:00:16.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.221+0000 7f27d499a700 1 --2- 172.21.15.71:0/3032301807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27d00ccee0 0x7f27d01561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:00:16.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.221+0000 7f27d599c700 1 --2- 172.21.15.71:0/3032301807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27d00c87c0 0x7f27d0156710 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f27c800bb90 tx=0x7f27c800b430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a4bab0af267c775 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:16.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.221+0000 7f27c7fff700 1 -- 172.21.15.71:0/3032301807 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c800da70 con 0x7f27d00c87c0 2023-10-09T07:00:16.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.221+0000 7f27c7fff700 1 -- 172.21.15.71:0/3032301807 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c800dbd0 con 0x7f27d00c87c0 2023-10-09T07:00:16.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.221+0000 7f27c7fff700 1 -- 172.21.15.71:0/3032301807 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c8019480 con 0x7f27d00c87c0 2023-10-09T07:00:16.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.222+0000 7f27d73ff700 1 -- 172.21.15.71:0/3032301807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27d00c87c0 msgr2=0x7f27d0156710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:16.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.222+0000 7f27d73ff700 1 --2- 172.21.15.71:0/3032301807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27d00c87c0 0x7f27d0156710 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f27c800bb90 tx=0x7f27c800b430 comp rx=0 tx=0).stop 2023-10-09T07:00:16.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.222+0000 7f27d73ff700 1 -- 172.21.15.71:0/3032301807 shutdown_connections 2023-10-09T07:00:16.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.222+0000 7f27d73ff700 1 --2- 172.21.15.71:0/3032301807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27d00c87c0 0x7f27d0156710 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.222+0000 7f27d73ff700 1 --2- 172.21.15.71:0/3032301807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27d00ccee0 0x7f27d01561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.222+0000 7f27d73ff700 1 -- 172.21.15.71:0/3032301807 >> 172.21.15.71:0/3032301807 conn(0x7f27d0068e10 msgr2=0x7f27d00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:16.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.222+0000 7f27d73ff700 1 -- 172.21.15.71:0/3032301807 shutdown_connections 2023-10-09T07:00:16.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.222+0000 7f27d73ff700 1 -- 172.21.15.71:0/3032301807 wait complete. 2023-10-09T07:00:16.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.223+0000 7f27d73ff700 1 Processor -- start 2023-10-09T07:00:16.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.224+0000 7f27d73ff700 1 -- start start 2023-10-09T07:00:16.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.224+0000 7f27d73ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27d00c83f0 0x7f27d0155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:16.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.224+0000 7f27d73ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27d00c87c0 0x7f27d00c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:16.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.224+0000 7f27d73ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27d00ccee0 0x7f27d0144f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:16.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.224+0000 7f27d73ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0145490 con 0x7f27d00c87c0 2023-10-09T07:00:16.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.224+0000 7f27d73ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0155470 con 0x7f27d00ccee0 2023-10-09T07:00:16.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.224+0000 7f27d73ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0154860 con 0x7f27d00c83f0 2023-10-09T07:00:16.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.225+0000 7f27d499a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27d00c87c0 0x7f27d00c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:16.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.225+0000 7f27d499a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27d00c87c0 0x7f27d00c2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56940/0 (socket says 172.21.15.71:56940) 2023-10-09T07:00:16.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.225+0000 7f27d499a700 1 -- 172.21.15.71:0/1248931837 learned_addr learned my addr 172.21.15.71:0/1248931837 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:16.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.225+0000 7f27d499a700 1 -- 172.21.15.71:0/1248931837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27d00c83f0 msgr2=0x7f27d0155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:16.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.225+0000 7f27d499a700 1 --2- 172.21.15.71:0/1248931837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27d00c83f0 0x7f27d0155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.225+0000 7f27d499a700 1 -- 172.21.15.71:0/1248931837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27d00ccee0 msgr2=0x7f27d0144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:16.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.225+0000 7f27d499a700 1 --2- 172.21.15.71:0/1248931837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27d00ccee0 0x7f27d0144f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.225+0000 7f27d499a700 1 -- 172.21.15.71:0/1248931837 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c00094f0 con 0x7f27d00c87c0 2023-10-09T07:00:16.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.225+0000 7f27d499a700 1 --2- 172.21.15.71:0/1248931837 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27d00c87c0 0x7f27d00c2f70 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f27c000ec50 tx=0x7f27c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:16.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.225+0000 7f27c57fa700 1 -- 172.21.15.71:0/1248931837 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c000c9d0 con 0x7f27d00c87c0 2023-10-09T07:00:16.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.226+0000 7f27c57fa700 1 -- 172.21.15.71:0/1248931837 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c000cb30 con 0x7f27d00c87c0 2023-10-09T07:00:16.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.226+0000 7f27d73ff700 1 -- 172.21.15.71:0/1248931837 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c800b6d0 con 0x7f27d00c87c0 2023-10-09T07:00:16.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.226+0000 7f27c57fa700 1 -- 172.21.15.71:0/1248931837 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c0013470 con 0x7f27d00c87c0 2023-10-09T07:00:16.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.226+0000 7f27d73ff700 1 -- 172.21.15.71:0/1248931837 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d0154e20 con 0x7f27d00c87c0 2023-10-09T07:00:16.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.227+0000 7f27d73ff700 1 -- 172.21.15.71:0/1248931837 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d004c3c0 con 0x7f27d00c87c0 2023-10-09T07:00:16.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.227+0000 7f27c57fa700 1 -- 172.21.15.71:0/1248931837 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f27c0013860 con 0x7f27d00c87c0 2023-10-09T07:00:16.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.228+0000 7f27c57fa700 1 --2- 172.21.15.71:0/1248931837 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27b4066f30 0x7f27b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:16.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.228+0000 7f27c57fa700 1 -- 172.21.15.71:0/1248931837 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5933+0+0 (secure 0 0 0) 0x7f27c0084a30 con 0x7f27d00c87c0 2023-10-09T07:00:16.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.229+0000 7f27d519b700 1 --2- 172.21.15.71:0/1248931837 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27b4066f30 0x7f27b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:16.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.230+0000 7f27d519b700 1 --2- 172.21.15.71:0/1248931837 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27b4066f30 0x7f27b40693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0021e0 tx=0x7f27cc001790 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:16.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.232+0000 7f27c57fa700 1 -- 172.21.15.71:0/1248931837 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27c0051b20 con 0x7f27d00c87c0 2023-10-09T07:00:16.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.427+0000 7f27d73ff700 1 -- 172.21.15.71:0/1248931837 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f27d01555b0 con 0x7f27d00c87c0 2023-10-09T07:00:16.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.432+0000 7f27c57fa700 1 -- 172.21.15.71:0/1248931837 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v39) v1 ==== 120+0+0 (secure 0 0 0) 0x7f27c0055140 con 0x7f27d00c87c0 2023-10-09T07:00:16.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.435+0000 7f27d73ff700 1 -- 172.21.15.71:0/1248931837 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27b4066f30 msgr2=0x7f27b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:16.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.435+0000 7f27d73ff700 1 --2- 172.21.15.71:0/1248931837 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27b4066f30 0x7f27b40693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0021e0 tx=0x7f27cc001790 comp rx=0 tx=0).stop 2023-10-09T07:00:16.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.435+0000 7f27d73ff700 1 -- 172.21.15.71:0/1248931837 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27d00c87c0 msgr2=0x7f27d00c2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:16.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.435+0000 7f27d73ff700 1 --2- 172.21.15.71:0/1248931837 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27d00c87c0 0x7f27d00c2f70 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f27c000ec50 tx=0x7f27c0009250 comp rx=0 tx=0).stop 2023-10-09T07:00:16.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.435+0000 7f27d73ff700 1 -- 172.21.15.71:0/1248931837 shutdown_connections 2023-10-09T07:00:16.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.435+0000 7f27d73ff700 1 --2- 172.21.15.71:0/1248931837 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27b4066f30 0x7f27b40693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.435+0000 7f27d73ff700 1 --2- 172.21.15.71:0/1248931837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27d00ccee0 0x7f27d0144f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.435+0000 7f27d73ff700 1 --2- 172.21.15.71:0/1248931837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27d00c83f0 0x7f27d0155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.435+0000 7f27d73ff700 1 --2- 172.21.15.71:0/1248931837 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27d00c87c0 0x7f27d00c2f70 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.435+0000 7f27d73ff700 1 -- 172.21.15.71:0/1248931837 >> 172.21.15.71:0/1248931837 conn(0x7f27d0068e10 msgr2=0x7f27d0150dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:16.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.435+0000 7f27d73ff700 1 -- 172.21.15.71:0/1248931837 shutdown_connections 2023-10-09T07:00:16.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.435+0000 7f27d73ff700 1 -- 172.21.15.71:0/1248931837 wait complete. 2023-10-09T07:00:16.452 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-10-09T07:00:16.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.632+0000 7f6372fff700 1 Processor -- start 2023-10-09T07:00:16.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.633+0000 7f6372fff700 1 -- start start 2023-10-09T07:00:16.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.634+0000 7f6372fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f636c155c10 0x7f636c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:16.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.634+0000 7f6372fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f636c0ac230 0x7f636c0ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:16.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.634+0000 7f6372fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f636c1568a0 0x7f636c156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:16.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.634+0000 7f6372fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f636c0ad930 con 0x7f636c0ac230 2023-10-09T07:00:16.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.634+0000 7f6372fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f636c0acd20 con 0x7f636c1568a0 2023-10-09T07:00:16.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.634+0000 7f6372fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f636c0ad000 con 0x7f636c155c10 2023-10-09T07:00:16.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.634+0000 7f636bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f636c0ac230 0x7f636c0ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:16.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.634+0000 7f636bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f636c0ac230 0x7f636c0ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56954/0 (socket says 172.21.15.71:56954) 2023-10-09T07:00:16.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.634+0000 7f636bfff700 1 -- 172.21.15.71:0/1291713492 learned_addr learned my addr 172.21.15.71:0/1291713492 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:16.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.635+0000 7f6370d9b700 1 --2- 172.21.15.71:0/1291713492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f636c155c10 0x7f636c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:16.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.635+0000 7f637159c700 1 --2- 172.21.15.71:0/1291713492 >> v2:172.21.15.179:3300/0 conn(0x7f636c1568a0 0x7f636c156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:16.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.635+0000 7f636bfff700 1 -- 172.21.15.71:0/1291713492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f636c155c10 msgr2=0x7f636c155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:16.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.635+0000 7f636bfff700 1 --2- 172.21.15.71:0/1291713492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f636c155c10 0x7f636c155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.635+0000 7f636bfff700 1 -- 172.21.15.71:0/1291713492 >> v2:172.21.15.179:3300/0 conn(0x7f636c1568a0 msgr2=0x7f636c156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:16.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.635+0000 7f636bfff700 1 --2- 172.21.15.71:0/1291713492 >> v2:172.21.15.179:3300/0 conn(0x7f636c1568a0 0x7f636c156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.635+0000 7f636bfff700 1 -- 172.21.15.71:0/1291713492 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636c0ad2e0 con 0x7f636c0ac230 2023-10-09T07:00:16.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.635+0000 7f636bfff700 1 --2- 172.21.15.71:0/1291713492 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f636c0ac230 0x7f636c0ac6a0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f636c0c8c60 tx=0x7f6358009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18aed9349bb101a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:16.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.635+0000 7f636b7fe700 1 -- 172.21.15.71:0/1291713492 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635800b860 con 0x7f636c0ac230 2023-10-09T07:00:16.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.635+0000 7f636b7fe700 1 -- 172.21.15.71:0/1291713492 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635800b9c0 con 0x7f636c0ac230 2023-10-09T07:00:16.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.635+0000 7f636b7fe700 1 -- 172.21.15.71:0/1291713492 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635800bd60 con 0x7f636c0ac230 2023-10-09T07:00:16.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.636+0000 7f6372fff700 1 -- 172.21.15.71:0/1291713492 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f636c0ac230 msgr2=0x7f636c0ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:16.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.636+0000 7f6372fff700 1 --2- 172.21.15.71:0/1291713492 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f636c0ac230 0x7f636c0ac6a0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f636c0c8c60 tx=0x7f6358009250 comp rx=0 tx=0).stop 2023-10-09T07:00:16.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.636+0000 7f6372fff700 1 -- 172.21.15.71:0/1291713492 shutdown_connections 2023-10-09T07:00:16.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.636+0000 7f6372fff700 1 --2- 172.21.15.71:0/1291713492 >> v2:172.21.15.179:3300/0 conn(0x7f636c1568a0 0x7f636c156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.636+0000 7f6372fff700 1 --2- 172.21.15.71:0/1291713492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f636c155c10 0x7f636c155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.636+0000 7f6372fff700 1 --2- 172.21.15.71:0/1291713492 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f636c0ac230 0x7f636c0ac6a0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.636+0000 7f6372fff700 1 -- 172.21.15.71:0/1291713492 >> 172.21.15.71:0/1291713492 conn(0x7f636c06a320 msgr2=0x7f636c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:16.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.636+0000 7f6372fff700 1 -- 172.21.15.71:0/1291713492 shutdown_connections 2023-10-09T07:00:16.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.636+0000 7f6372fff700 1 -- 172.21.15.71:0/1291713492 wait complete. 2023-10-09T07:00:16.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.637+0000 7f6372fff700 1 Processor -- start 2023-10-09T07:00:16.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.637+0000 7f6372fff700 1 -- start start 2023-10-09T07:00:16.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.638+0000 7f6372fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f636c0ac230 0x7f636c0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:16.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.638+0000 7f6372fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f636c155c10 0x7f636c154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:16.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.638+0000 7f6372fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f636c1568a0 0x7f636c14eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:16.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.638+0000 7f6372fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c159bd0 con 0x7f636c1568a0 2023-10-09T07:00:16.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.638+0000 7f6372fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c0c9eb0 con 0x7f636c155c10 2023-10-09T07:00:16.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.638+0000 7f6372fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f636c159580 con 0x7f636c0ac230 2023-10-09T07:00:16.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.639+0000 7f637159c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f636c1568a0 0x7f636c14eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:16.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.639+0000 7f637159c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f636c1568a0 0x7f636c14eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56970/0 (socket says 172.21.15.71:56970) 2023-10-09T07:00:16.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.639+0000 7f637159c700 1 -- 172.21.15.71:0/1707508988 learned_addr learned my addr 172.21.15.71:0/1707508988 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:16.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.639+0000 7f636bfff700 1 --2- 172.21.15.71:0/1707508988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f636c155c10 0x7f636c154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:16.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.639+0000 7f6370d9b700 1 --2- 172.21.15.71:0/1707508988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f636c0ac230 0x7f636c0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:16.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.639+0000 7f637159c700 1 -- 172.21.15.71:0/1707508988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f636c0ac230 msgr2=0x7f636c0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:16.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.639+0000 7f637159c700 1 --2- 172.21.15.71:0/1707508988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f636c0ac230 0x7f636c0cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.639+0000 7f637159c700 1 -- 172.21.15.71:0/1707508988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f636c155c10 msgr2=0x7f636c154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:16.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.639+0000 7f637159c700 1 --2- 172.21.15.71:0/1707508988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f636c155c10 0x7f636c154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.639+0000 7f637159c700 1 -- 172.21.15.71:0/1707508988 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63580094f0 con 0x7f636c1568a0 2023-10-09T07:00:16.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.639+0000 7f637159c700 1 --2- 172.21.15.71:0/1707508988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f636c1568a0 0x7f636c14eca0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6364009dd0 tx=0x7f636400b2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:16.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.639+0000 7f6368ff9700 1 -- 172.21.15.71:0/1707508988 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636400fb60 con 0x7f636c1568a0 2023-10-09T07:00:16.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.639+0000 7f6368ff9700 1 -- 172.21.15.71:0/1707508988 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6364011040 con 0x7f636c1568a0 2023-10-09T07:00:16.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.639+0000 7f6368ff9700 1 -- 172.21.15.71:0/1707508988 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63640153f0 con 0x7f636c1568a0 2023-10-09T07:00:16.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.640+0000 7f6372fff700 1 -- 172.21.15.71:0/1707508988 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f636c159860 con 0x7f636c1568a0 2023-10-09T07:00:16.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.640+0000 7f6372fff700 1 -- 172.21.15.71:0/1707508988 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f636c0cb130 con 0x7f636c1568a0 2023-10-09T07:00:16.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.641+0000 7f6372fff700 1 -- 172.21.15.71:0/1707508988 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f636c159d40 con 0x7f636c1568a0 2023-10-09T07:00:16.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.642+0000 7f6368ff9700 1 -- 172.21.15.71:0/1707508988 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6364015760 con 0x7f636c1568a0 2023-10-09T07:00:16.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.642+0000 7f6368ff9700 1 --2- 172.21.15.71:0/1707508988 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6350066f30 0x7f63500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:16.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.642+0000 7f6368ff9700 1 -- 172.21.15.71:0/1707508988 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5933+0+0 (secure 0 0 0) 0x7f63640869e0 con 0x7f636c1568a0 2023-10-09T07:00:16.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.643+0000 7f6370d9b700 1 --2- 172.21.15.71:0/1707508988 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6350066f30 0x7f63500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:16.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.643+0000 7f6370d9b700 1 --2- 172.21.15.71:0/1707508988 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6350066f30 0x7f63500693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6360006fd0 tx=0x7f6360008040 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:16.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.646+0000 7f6368ff9700 1 -- 172.21.15.71:0/1707508988 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6364053bf0 con 0x7f636c1568a0 2023-10-09T07:00:16.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.911+0000 7f6372fff700 1 -- 172.21.15.71:0/1707508988 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7f636c04c3c0 con 0x7f636c1568a0 2023-10-09T07:00:16.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.929+0000 7f6368ff9700 1 -- 172.21.15.71:0/1707508988 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v663) v1 ==== 183+0+0 (secure 0 0 0) 0x7f6364057210 con 0x7f636c1568a0 2023-10-09T07:00:16.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.932+0000 7f6372fff700 1 -- 172.21.15.71:0/1707508988 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6350066f30 msgr2=0x7f63500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:16.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.932+0000 7f6372fff700 1 --2- 172.21.15.71:0/1707508988 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6350066f30 0x7f63500693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6360006fd0 tx=0x7f6360008040 comp rx=0 tx=0).stop 2023-10-09T07:00:16.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.932+0000 7f6372fff700 1 -- 172.21.15.71:0/1707508988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f636c1568a0 msgr2=0x7f636c14eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:16.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.932+0000 7f6372fff700 1 --2- 172.21.15.71:0/1707508988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f636c1568a0 0x7f636c14eca0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6364009dd0 tx=0x7f636400b2d0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.932+0000 7f6372fff700 1 -- 172.21.15.71:0/1707508988 shutdown_connections 2023-10-09T07:00:16.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.932+0000 7f6372fff700 1 --2- 172.21.15.71:0/1707508988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f636c1568a0 0x7f636c14eca0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.932+0000 7f6372fff700 1 --2- 172.21.15.71:0/1707508988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f636c0ac230 0x7f636c0cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.932+0000 7f6372fff700 1 --2- 172.21.15.71:0/1707508988 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6350066f30 0x7f63500693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.932+0000 7f6372fff700 1 --2- 172.21.15.71:0/1707508988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f636c155c10 0x7f636c154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:16.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.932+0000 7f6372fff700 1 -- 172.21.15.71:0/1707508988 >> 172.21.15.71:0/1707508988 conn(0x7f636c06a320 msgr2=0x7f636c0ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:16.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.932+0000 7f6372fff700 1 -- 172.21.15.71:0/1707508988 shutdown_connections 2023-10-09T07:00:16.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:16.932+0000 7f6372fff700 1 -- 172.21.15.71:0/1707508988 wait complete. 2023-10-09T07:00:16.949 INFO:tasks.cephfs_test_runner:Test that a non-existent path leads to schedule deactivation after a few retries. ... ok 2023-10-09T07:00:16.949 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test existence of a scheduled snapshot 2023-10-09T07:00:16.950 INFO:tasks.cephfs_test_runner:test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-09T07:00:16.950 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-10-09T07:00:17.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.132+0000 7f0b4cd9d700 1 Processor -- start 2023-10-09T07:00:17.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.132+0000 7f0b4cd9d700 1 -- start start 2023-10-09T07:00:17.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.133+0000 7f0b4cd9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0b48150550 0x7f0b48157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:17.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.133+0000 7f0b4cd9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b480c7410 0x7f0b48069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:17.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.133+0000 7f0b4cd9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b4806e2a0 con 0x7f0b48150180 2023-10-09T07:00:17.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.133+0000 7f0b4cd9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b4806b2e0 con 0x7f0b48150550 2023-10-09T07:00:17.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.133+0000 7f0b4cd9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b480c78e0 con 0x7f0b480c7410 2023-10-09T07:00:17.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.134+0000 7f0b477fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f0b48150180 0x7f0b480c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48182/0 (socket says 172.21.15.71:48182) 2023-10-09T07:00:17.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.134+0000 7f0b477fe700 1 -- 172.21.15.71:0/202130737 learned_addr learned my addr 172.21.15.71:0/202130737 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:17.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.134+0000 7f0b47fff700 1 --2- 172.21.15.71:0/202130737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b480c7410 0x7f0b48069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:17.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.134+0000 7f0b46ffd700 1 --2- 172.21.15.71:0/202130737 >> v2:172.21.15.179:3300/0 conn(0x7f0b48150550 0x7f0b48157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:17.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.134+0000 7f0b467fc700 1 -- 172.21.15.71:0/202130737 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1688364506 0 0) 0x7f0b4806e2a0 con 0x7f0b48150180 2023-10-09T07:00:17.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.134+0000 7f0b467fc700 1 -- 172.21.15.71:0/202130737 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b30003570 con 0x7f0b48150180 2023-10-09T07:00:17.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.134+0000 7f0b46ffd700 1 -- 172.21.15.71:0/202130737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b480c7410 msgr2=0x7f0b48069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:17.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.134+0000 7f0b46ffd700 1 --2- 172.21.15.71:0/202130737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b480c7410 0x7f0b48069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:17.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.134+0000 7f0b46ffd700 1 -- 172.21.15.71:0/202130737 >> v1:172.21.15.71:6789/0 conn(0x7f0b48150180 legacy=0x7f0b480c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:17.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.134+0000 7f0b46ffd700 1 -- 172.21.15.71:0/202130737 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b480c7bc0 con 0x7f0b48150550 2023-10-09T07:00:17.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.134+0000 7f0b47fff700 1 --2- 172.21.15.71:0/202130737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b480c7410 0x7f0b48069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:00:17.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.135+0000 7f0b46ffd700 1 --2- 172.21.15.71:0/202130737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b48150550 0x7f0b48157770 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c00aa90 tx=0x7f0b3c00a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92ca69ca02a75481 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:17.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.135+0000 7f0b467fc700 1 -- 172.21.15.71:0/202130737 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c00c970 con 0x7f0b48150550 2023-10-09T07:00:17.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.135+0000 7f0b467fc700 1 -- 172.21.15.71:0/202130737 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3c00cad0 con 0x7f0b48150550 2023-10-09T07:00:17.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.135+0000 7f0b467fc700 1 -- 172.21.15.71:0/202130737 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c00ce70 con 0x7f0b48150550 2023-10-09T07:00:17.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.135+0000 7f0b4cd9d700 1 -- 172.21.15.71:0/202130737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b48150550 msgr2=0x7f0b48157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:17.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.135+0000 7f0b4cd9d700 1 --2- 172.21.15.71:0/202130737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b48150550 0x7f0b48157770 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c00aa90 tx=0x7f0b3c00a330 comp rx=0 tx=0).stop 2023-10-09T07:00:17.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.136+0000 7f0b4cd9d700 1 -- 172.21.15.71:0/202130737 shutdown_connections 2023-10-09T07:00:17.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.136+0000 7f0b4cd9d700 1 --2- 172.21.15.71:0/202130737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b480c7410 0x7f0b48069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:17.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.136+0000 7f0b4cd9d700 1 --2- 172.21.15.71:0/202130737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b48150550 0x7f0b48157770 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:17.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.136+0000 7f0b4cd9d700 1 -- 172.21.15.71:0/202130737 >> 172.21.15.71:0/202130737 conn(0x7f0b480cc1f0 msgr2=0x7f0b480cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:17.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.136+0000 7f0b4cd9d700 1 -- 172.21.15.71:0/202130737 shutdown_connections 2023-10-09T07:00:17.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.136+0000 7f0b4cd9d700 1 -- 172.21.15.71:0/202130737 wait complete. 2023-10-09T07:00:17.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.137+0000 7f0b4cd9d700 1 Processor -- start 2023-10-09T07:00:17.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.137+0000 7f0b4cd9d700 1 -- start start 2023-10-09T07:00:17.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.138+0000 7f0b4cd9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b480c7410 0x7f0b4816a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:17.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.138+0000 7f0b4cd9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b48150180 0x7f0b48154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:17.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.138+0000 7f0b4cd9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b48150550 0x7f0b480afb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:17.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.138+0000 7f0b4cd9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4816d9c0 con 0x7f0b48150180 2023-10-09T07:00:17.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.138+0000 7f0b4cd9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4816d0d0 con 0x7f0b48150550 2023-10-09T07:00:17.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.138+0000 7f0b4cd9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b481557f0 con 0x7f0b480c7410 2023-10-09T07:00:17.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.138+0000 7f0b46ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b48150180 0x7f0b48154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:17.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.138+0000 7f0b46ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b48150180 0x7f0b48154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56986/0 (socket says 172.21.15.71:56986) 2023-10-09T07:00:17.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.138+0000 7f0b46ffd700 1 -- 172.21.15.71:0/215502793 learned_addr learned my addr 172.21.15.71:0/215502793 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:17.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.138+0000 7f0b477fe700 1 --2- 172.21.15.71:0/215502793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b480c7410 0x7f0b4816a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:17.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.139+0000 7f0b47fff700 1 --2- 172.21.15.71:0/215502793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b48150550 0x7f0b480afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:17.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.139+0000 7f0b46ffd700 1 -- 172.21.15.71:0/215502793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b480c7410 msgr2=0x7f0b4816a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:17.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.139+0000 7f0b46ffd700 1 --2- 172.21.15.71:0/215502793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b480c7410 0x7f0b4816a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:17.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.139+0000 7f0b46ffd700 1 -- 172.21.15.71:0/215502793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b48150550 msgr2=0x7f0b480afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:17.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.139+0000 7f0b46ffd700 1 --2- 172.21.15.71:0/215502793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b48150550 0x7f0b480afb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:17.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.139+0000 7f0b46ffd700 1 -- 172.21.15.71:0/215502793 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b40009a20 con 0x7f0b48150180 2023-10-09T07:00:17.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.139+0000 7f0b46ffd700 1 --2- 172.21.15.71:0/215502793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b48150180 0x7f0b48154d30 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f0b4806fe40 tx=0x7f0b3c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:17.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.139+0000 7f0b2f7fe700 1 -- 172.21.15.71:0/215502793 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c019e90 con 0x7f0b48150180 2023-10-09T07:00:17.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.139+0000 7f0b2f7fe700 1 -- 172.21.15.71:0/215502793 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3c010600 con 0x7f0b48150180 2023-10-09T07:00:17.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.139+0000 7f0b2f7fe700 1 -- 172.21.15.71:0/215502793 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c0109c0 con 0x7f0b48150180 2023-10-09T07:00:17.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.139+0000 7f0b4cd9d700 1 -- 172.21.15.71:0/215502793 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b3c00a5d0 con 0x7f0b48150180 2023-10-09T07:00:17.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.139+0000 7f0b4cd9d700 1 -- 172.21.15.71:0/215502793 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b4816d650 con 0x7f0b48150180 2023-10-09T07:00:17.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.140+0000 7f0b4cd9d700 1 -- 172.21.15.71:0/215502793 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b4816db30 con 0x7f0b48150180 2023-10-09T07:00:17.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.141+0000 7f0b2f7fe700 1 -- 172.21.15.71:0/215502793 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0b3c02a3b0 con 0x7f0b48150180 2023-10-09T07:00:17.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.142+0000 7f0b2f7fe700 1 --2- 172.21.15.71:0/215502793 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0b34066f30 0x7f0b340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:17.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.142+0000 7f0b2f7fe700 1 -- 172.21.15.71:0/215502793 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5933+0+0 (secure 0 0 0) 0x7f0b3c085c10 con 0x7f0b48150180 2023-10-09T07:00:17.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.142+0000 7f0b477fe700 1 --2- 172.21.15.71:0/215502793 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0b34066f30 0x7f0b340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:17.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.143+0000 7f0b477fe700 1 --2- 172.21.15.71:0/215502793 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0b34066f30 0x7f0b340693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0b480c2fb0 tx=0x7f0b38009040 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:17.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.146+0000 7f0b2f7fe700 1 -- 172.21.15.71:0/215502793 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0b3c052da0 con 0x7f0b48150180 2023-10-09T07:00:17.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.410+0000 7f0b4cd9d700 1 -- 172.21.15.71:0/215502793 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7f0b4804c3c0 con 0x7f0b48150180 2023-10-09T07:00:17.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.934+0000 7f0b2f7fe700 1 -- 172.21.15.71:0/215502793 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v664) v1 ==== 151+0+0 (secure 0 0 0) 0x7f0b3c0563c0 con 0x7f0b48150180 2023-10-09T07:00:17.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.936+0000 7f0b4cd9d700 1 -- 172.21.15.71:0/215502793 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0b34066f30 msgr2=0x7f0b340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:17.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.936+0000 7f0b4cd9d700 1 --2- 172.21.15.71:0/215502793 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0b34066f30 0x7f0b340693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0b480c2fb0 tx=0x7f0b38009040 comp rx=0 tx=0).stop 2023-10-09T07:00:17.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.936+0000 7f0b4cd9d700 1 -- 172.21.15.71:0/215502793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b48150180 msgr2=0x7f0b48154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:17.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.936+0000 7f0b4cd9d700 1 --2- 172.21.15.71:0/215502793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b48150180 0x7f0b48154d30 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f0b4806fe40 tx=0x7f0b3c01a000 comp rx=0 tx=0).stop 2023-10-09T07:00:17.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.937+0000 7f0b4cd9d700 1 -- 172.21.15.71:0/215502793 shutdown_connections 2023-10-09T07:00:17.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.937+0000 7f0b4cd9d700 1 --2- 172.21.15.71:0/215502793 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0b34066f30 0x7f0b340693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:17.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.937+0000 7f0b4cd9d700 1 --2- 172.21.15.71:0/215502793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b48150550 0x7f0b480afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:17.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.937+0000 7f0b4cd9d700 1 --2- 172.21.15.71:0/215502793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b480c7410 0x7f0b4816a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:17.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.937+0000 7f0b4cd9d700 1 --2- 172.21.15.71:0/215502793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b48150180 0x7f0b48154d30 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:17.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.937+0000 7f0b4cd9d700 1 -- 172.21.15.71:0/215502793 >> 172.21.15.71:0/215502793 conn(0x7f0b480cc1f0 msgr2=0x7f0b48158870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:17.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.937+0000 7f0b4cd9d700 1 -- 172.21.15.71:0/215502793 shutdown_connections 2023-10-09T07:00:17.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:17.937+0000 7f0b4cd9d700 1 -- 172.21.15.71:0/215502793 wait complete. 2023-10-09T07:00:17.955 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T07:00:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.139+0000 7fd0913ff700 1 Processor -- start 2023-10-09T07:00:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.139+0000 7fd0913ff700 1 -- start start 2023-10-09T07:00:18.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.141+0000 7fd0913ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd08c0b0a70 0x7fd08c1625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:18.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.141+0000 7fd0913ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd08c0af2f0 con 0x7fd08c15ac80 2023-10-09T07:00:18.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.141+0000 7fd0913ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd08c0af5d0 con 0x7fd08c069e80 2023-10-09T07:00:18.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.141+0000 7fd0913ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08c0c8660 con 0x7fd08c0b0a70 2023-10-09T07:00:18.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.141+0000 7fd08affd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd08c15ac80 0x7fd08c069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48192/0 (socket says 172.21.15.71:48192) 2023-10-09T07:00:18.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.141+0000 7fd08affd700 1 -- 172.21.15.71:0/1731837851 learned_addr learned my addr 172.21.15.71:0/1731837851 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:18.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.141+0000 7fd08b7fe700 1 --2- 172.21.15.71:0/1731837851 >> v2:172.21.15.179:3300/0 conn(0x7fd08c0b0a70 0x7fd08c1625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:18.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.141+0000 7fd089ffb700 1 -- 172.21.15.71:0/1731837851 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2004926238 0 0) 0x7fd08c0af2f0 con 0x7fd08c15ac80 2023-10-09T07:00:18.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.141+0000 7fd089ffb700 1 -- 172.21.15.71:0/1731837851 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd074003570 con 0x7fd08c15ac80 2023-10-09T07:00:18.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.142+0000 7fd089ffb700 1 -- 172.21.15.71:0/1731837851 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3878409268 0 0) 0x7fd074003570 con 0x7fd08c15ac80 2023-10-09T07:00:18.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.142+0000 7fd089ffb700 1 -- 172.21.15.71:0/1731837851 >> v2:172.21.15.179:3300/0 conn(0x7fd08c0b0a70 msgr2=0x7fd08c1625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:18.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.142+0000 7fd089ffb700 1 --2- 172.21.15.71:0/1731837851 >> v2:172.21.15.179:3300/0 conn(0x7fd08c0b0a70 0x7fd08c1625e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:18.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.142+0000 7fd089ffb700 1 -- 172.21.15.71:0/1731837851 >> v1:172.21.15.179:6789/0 conn(0x7fd08c069e80 legacy=0x7fd08c0c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:18.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.142+0000 7fd089ffb700 1 -- 172.21.15.71:0/1731837851 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c0c8940 con 0x7fd08c15ac80 2023-10-09T07:00:18.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.142+0000 7fd089ffb700 1 -- 172.21.15.71:0/1731837851 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fd07c0017f0 con 0x7fd08c15ac80 2023-10-09T07:00:18.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.142+0000 7fd089ffb700 1 -- 172.21.15.71:0/1731837851 >> v1:172.21.15.71:6789/0 conn(0x7fd08c15ac80 legacy=0x7fd08c069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:18.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.142+0000 7fd089ffb700 1 --2- 172.21.15.71:0/1731837851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd074003ab0 0x7fd074003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:18.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.142+0000 7fd089ffb700 1 --2- 172.21.15.71:0/1731837851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd074004810 0x7fd074004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.142+0000 7fd089ffb700 1 --2- 172.21.15.71:0/1731837851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd074005210 0x7fd07400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.142+0000 7fd089ffb700 1 -- 172.21.15.71:0/1731837851 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c0c8660 con 0x7fd074003ab0 2023-10-09T07:00:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.142+0000 7fd089ffb700 1 -- 172.21.15.71:0/1731837851 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07400c130 con 0x7fd074005210 2023-10-09T07:00:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.142+0000 7fd089ffb700 1 -- 172.21.15.71:0/1731837851 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd07400c2f0 con 0x7fd074004810 2023-10-09T07:00:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.142+0000 7fd08affd700 1 --2- 172.21.15.71:0/1731837851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd074003ab0 0x7fd074003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.142+0000 7fd08b7fe700 1 --2- 172.21.15.71:0/1731837851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd074005210 0x7fd07400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.142+0000 7fd08a7fc700 1 --2- 172.21.15.71:0/1731837851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd074004810 0x7fd074004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.143+0000 7fd08affd700 1 -- 172.21.15.71:0/1731837851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd074004810 msgr2=0x7fd074004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.143+0000 7fd08affd700 1 --2- 172.21.15.71:0/1731837851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd074004810 0x7fd074004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.143+0000 7fd08affd700 1 -- 172.21.15.71:0/1731837851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd074005210 msgr2=0x7fd07400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.143+0000 7fd08affd700 1 --2- 172.21.15.71:0/1731837851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd074005210 0x7fd07400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.143+0000 7fd08affd700 1 -- 172.21.15.71:0/1731837851 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd074003570 con 0x7fd074003ab0 2023-10-09T07:00:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.143+0000 7fd08b7fe700 1 -- 172.21.15.71:0/1731837851 reap_dead start 2023-10-09T07:00:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.143+0000 7fd08affd700 1 --2- 172.21.15.71:0/1731837851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd074003ab0 0x7fd074003ec0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00a830 tx=0x7fd08c0af540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e86afb2ff0c768 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.143+0000 7fd089ffb700 1 -- 172.21.15.71:0/1731837851 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c0070f0 con 0x7fd074003ab0 2023-10-09T07:00:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.143+0000 7fd089ffb700 1 -- 172.21.15.71:0/1731837851 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07c007290 con 0x7fd074003ab0 2023-10-09T07:00:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.143+0000 7fd089ffb700 1 -- 172.21.15.71:0/1731837851 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c007650 con 0x7fd074003ab0 2023-10-09T07:00:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.143+0000 7fd0913ff700 1 -- 172.21.15.71:0/1731837851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd074003ab0 msgr2=0x7fd074003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.143+0000 7fd0913ff700 1 --2- 172.21.15.71:0/1731837851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd074003ab0 0x7fd074003ec0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00a830 tx=0x7fd08c0af540 comp rx=0 tx=0).stop 2023-10-09T07:00:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.144+0000 7fd0913ff700 1 -- 172.21.15.71:0/1731837851 shutdown_connections 2023-10-09T07:00:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.144+0000 7fd0913ff700 1 --2- 172.21.15.71:0/1731837851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd074003ab0 0x7fd074003ec0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.144+0000 7fd0913ff700 1 -- 172.21.15.71:0/1731837851 >> 172.21.15.71:0/1731837851 conn(0x7fd08c068e10 msgr2=0x7fd08c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.144+0000 7fd0913ff700 1 -- 172.21.15.71:0/1731837851 shutdown_connections 2023-10-09T07:00:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.144+0000 7fd0913ff700 1 -- 172.21.15.71:0/1731837851 wait complete. 2023-10-09T07:00:18.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.145+0000 7fd0913ff700 1 Processor -- start 2023-10-09T07:00:18.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.145+0000 7fd0913ff700 1 -- start start 2023-10-09T07:00:18.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.146+0000 7fd0913ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd074003ab0 0x7fd08c0ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:18.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.146+0000 7fd0913ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd08c0c7460 0x7fd08c1542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:18.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.146+0000 7fd0913ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd08c16bb40 0x7fd08c15b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:18.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.146+0000 7fd0913ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c16b3d0 con 0x7fd08c16bb40 2023-10-09T07:00:18.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.146+0000 7fd0913ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c0c78d0 con 0x7fd08c0c7460 2023-10-09T07:00:18.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.146+0000 7fd0913ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c0ac030 con 0x7fd074003ab0 2023-10-09T07:00:18.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.146+0000 7fd08b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd08c16bb40 0x7fd08c15b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:18.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.146+0000 7fd08b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd08c16bb40 0x7fd08c15b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57004/0 (socket says 172.21.15.71:57004) 2023-10-09T07:00:18.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.146+0000 7fd08b7fe700 1 -- 172.21.15.71:0/2277039448 learned_addr learned my addr 172.21.15.71:0/2277039448 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:18.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.146+0000 7fd08affd700 1 --2- 172.21.15.71:0/2277039448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd074003ab0 0x7fd08c0ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:18.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.146+0000 7fd08a7fc700 1 --2- 172.21.15.71:0/2277039448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd08c0c7460 0x7fd08c1542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:18.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.147+0000 7fd08b7fe700 1 -- 172.21.15.71:0/2277039448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd074003ab0 msgr2=0x7fd08c0ab9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:18.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.147+0000 7fd08b7fe700 1 --2- 172.21.15.71:0/2277039448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd074003ab0 0x7fd08c0ab9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:18.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.147+0000 7fd08b7fe700 1 -- 172.21.15.71:0/2277039448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd08c0c7460 msgr2=0x7fd08c1542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:18.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.147+0000 7fd08b7fe700 1 --2- 172.21.15.71:0/2277039448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd08c0c7460 0x7fd08c1542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:18.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.147+0000 7fd08b7fe700 1 -- 172.21.15.71:0/2277039448 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c0ac310 con 0x7fd08c16bb40 2023-10-09T07:00:18.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.147+0000 7fd08a7fc700 1 --2- 172.21.15.71:0/2277039448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd08c0c7460 0x7fd08c1542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:00:18.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.147+0000 7fd08b7fe700 1 --2- 172.21.15.71:0/2277039448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd08c16bb40 0x7fd08c15b050 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fd08c06a870 tx=0x7fd0840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:18.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.147+0000 7fd072ffd700 1 -- 172.21.15.71:0/2277039448 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08400f7d0 con 0x7fd08c16bb40 2023-10-09T07:00:18.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.147+0000 7fd072ffd700 1 -- 172.21.15.71:0/2277039448 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08400f930 con 0x7fd08c16bb40 2023-10-09T07:00:18.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.147+0000 7fd0913ff700 1 -- 172.21.15.71:0/2277039448 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd08c0ac5f0 con 0x7fd08c16bb40 2023-10-09T07:00:18.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.147+0000 7fd072ffd700 1 -- 172.21.15.71:0/2277039448 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08400fcd0 con 0x7fd08c16bb40 2023-10-09T07:00:18.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.147+0000 7fd0913ff700 1 -- 172.21.15.71:0/2277039448 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd08c1547f0 con 0x7fd08c16bb40 2023-10-09T07:00:18.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.148+0000 7fd0913ff700 1 -- 172.21.15.71:0/2277039448 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd08c154a10 con 0x7fd08c16bb40 2023-10-09T07:00:18.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.149+0000 7fd072ffd700 1 -- 172.21.15.71:0/2277039448 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd084014650 con 0x7fd08c16bb40 2023-10-09T07:00:18.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.150+0000 7fd072ffd700 1 --2- 172.21.15.71:0/2277039448 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd078066f30 0x7fd0780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:18.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.151+0000 7fd072ffd700 1 -- 172.21.15.71:0/2277039448 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5933+0+0 (secure 0 0 0) 0x7fd084084d20 con 0x7fd08c16bb40 2023-10-09T07:00:18.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.151+0000 7fd08affd700 1 --2- 172.21.15.71:0/2277039448 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd078066f30 0x7fd0780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:18.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.152+0000 7fd08affd700 1 --2- 172.21.15.71:0/2277039448 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd078066f30 0x7fd0780693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00a830 tx=0x7fd07c016000 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:18.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.155+0000 7fd072ffd700 1 -- 172.21.15.71:0/2277039448 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd084051e90 con 0x7fd08c16bb40 2023-10-09T07:00:18.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.343+0000 7fd0913ff700 1 -- 172.21.15.71:0/2277039448 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd08c04c3c0 con 0x7fd08c16bb40 2023-10-09T07:00:18.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.347+0000 7fd072ffd700 1 -- 172.21.15.71:0/2277039448 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd084022020 con 0x7fd08c16bb40 2023-10-09T07:00:18.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.349+0000 7fd0913ff700 1 -- 172.21.15.71:0/2277039448 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd078066f30 msgr2=0x7fd0780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:18.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.349+0000 7fd0913ff700 1 --2- 172.21.15.71:0/2277039448 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd078066f30 0x7fd0780693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00a830 tx=0x7fd07c016000 comp rx=0 tx=0).stop 2023-10-09T07:00:18.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.349+0000 7fd0913ff700 1 -- 172.21.15.71:0/2277039448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd08c16bb40 msgr2=0x7fd08c15b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:18.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.349+0000 7fd0913ff700 1 --2- 172.21.15.71:0/2277039448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd08c16bb40 0x7fd08c15b050 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fd08c06a870 tx=0x7fd0840091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:18.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.350+0000 7fd0913ff700 1 -- 172.21.15.71:0/2277039448 shutdown_connections 2023-10-09T07:00:18.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.350+0000 7fd0913ff700 1 --2- 172.21.15.71:0/2277039448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd08c16bb40 0x7fd08c15b050 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:18.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.350+0000 7fd0913ff700 1 --2- 172.21.15.71:0/2277039448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd074003ab0 0x7fd08c0ab9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:18.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.350+0000 7fd0913ff700 1 --2- 172.21.15.71:0/2277039448 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd078066f30 0x7fd0780693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:18.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.350+0000 7fd0913ff700 1 --2- 172.21.15.71:0/2277039448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd08c0c7460 0x7fd08c1542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:18.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.350+0000 7fd0913ff700 1 -- 172.21.15.71:0/2277039448 >> 172.21.15.71:0/2277039448 conn(0x7fd08c068e10 msgr2=0x7fd08c0c28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:18.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.350+0000 7fd0913ff700 1 -- 172.21.15.71:0/2277039448 shutdown_connections 2023-10-09T07:00:18.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.350+0000 7fd0913ff700 1 -- 172.21.15.71:0/2277039448 wait complete. 2023-10-09T07:00:18.368 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T07:00:18.368 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T07:00:18.447 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T07:00:18.529 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T07:00:18.529 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T07:00:18.529 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:00:18.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.709+0000 7f2eec99d700 1 Processor -- start 2023-10-09T07:00:18.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.709+0000 7f2eec99d700 1 -- start start 2023-10-09T07:00:18.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.710+0000 7f2eec99d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2ee8142ea0 0x7f2ee80b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:18.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.710+0000 7f2eec99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ee806c0f0 0x7f2ee806a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:18.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.710+0000 7f2eec99d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee80b40f0 con 0x7f2ee80ad870 2023-10-09T07:00:18.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.710+0000 7f2eec99d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee8069640 con 0x7f2ee8142ea0 2023-10-09T07:00:18.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.710+0000 7f2eec99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee8069920 con 0x7f2ee806c0f0 2023-10-09T07:00:18.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.711+0000 7f2ee77fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2ee8142ea0 0x7f2ee80b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:18.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.711+0000 7f2ee7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ee806c0f0 0x7f2ee806a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:18.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.711+0000 7f2ee77fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2ee8142ea0 0x7f2ee80b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:41730/0 (socket says 172.21.15.71:41730) 2023-10-09T07:00:18.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.711+0000 7f2ee77fe700 1 -- 172.21.15.71:0/3278228769 learned_addr learned my addr 172.21.15.71:0/3278228769 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:18.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.711+0000 7f2ee67fc700 1 -- 172.21.15.71:0/3278228769 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283679255 0 0) 0x7f2ee80b40f0 con 0x7f2ee80ad870 2023-10-09T07:00:18.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.711+0000 7f2ee67fc700 1 -- 172.21.15.71:0/3278228769 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ed0003570 con 0x7f2ee80ad870 2023-10-09T07:00:18.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.711+0000 7f2ee77fe700 1 -- 172.21.15.71:0/3278228769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ee806c0f0 msgr2=0x7f2ee806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:18.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.711+0000 7f2ee77fe700 1 --2- 172.21.15.71:0/3278228769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ee806c0f0 0x7f2ee806a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:18.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.711+0000 7f2ee77fe700 1 -- 172.21.15.71:0/3278228769 >> v1:172.21.15.179:6789/0 conn(0x7f2ee80ad870 legacy=0x7f2ee806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:18.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.711+0000 7f2ee77fe700 1 -- 172.21.15.71:0/3278228769 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee8069c00 con 0x7f2ee8142ea0 2023-10-09T07:00:18.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.711+0000 7f2ee7fff700 1 --2- 172.21.15.71:0/3278228769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ee806c0f0 0x7f2ee806a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:00:18.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.712+0000 7f2ee77fe700 1 --2- 172.21.15.71:0/3278228769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ee8142ea0 0x7f2ee80b3630 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80099b0 tx=0x7f2ed8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=293526eb1c482e7f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:18.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.712+0000 7f2ee67fc700 1 -- 172.21.15.71:0/3278228769 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed800b680 con 0x7f2ee8142ea0 2023-10-09T07:00:18.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.712+0000 7f2ee67fc700 1 -- 172.21.15.71:0/3278228769 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed800b7e0 con 0x7f2ee8142ea0 2023-10-09T07:00:18.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.712+0000 7f2ee67fc700 1 -- 172.21.15.71:0/3278228769 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed800bb80 con 0x7f2ee8142ea0 2023-10-09T07:00:18.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.712+0000 7f2eec99d700 1 -- 172.21.15.71:0/3278228769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ee8142ea0 msgr2=0x7f2ee80b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:18.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.712+0000 7f2eec99d700 1 --2- 172.21.15.71:0/3278228769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ee8142ea0 0x7f2ee80b3630 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80099b0 tx=0x7f2ed8009250 comp rx=0 tx=0).stop 2023-10-09T07:00:18.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.712+0000 7f2eec99d700 1 -- 172.21.15.71:0/3278228769 shutdown_connections 2023-10-09T07:00:18.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.712+0000 7f2eec99d700 1 --2- 172.21.15.71:0/3278228769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ee806c0f0 0x7f2ee806a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:18.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.712+0000 7f2eec99d700 1 --2- 172.21.15.71:0/3278228769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ee8142ea0 0x7f2ee80b3630 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:18.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.712+0000 7f2eec99d700 1 -- 172.21.15.71:0/3278228769 >> 172.21.15.71:0/3278228769 conn(0x7f2ee80ce430 msgr2=0x7f2ee80ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:18.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.713+0000 7f2eec99d700 1 -- 172.21.15.71:0/3278228769 shutdown_connections 2023-10-09T07:00:18.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.713+0000 7f2eec99d700 1 -- 172.21.15.71:0/3278228769 wait complete. 2023-10-09T07:00:18.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.714+0000 7f2eec99d700 1 Processor -- start 2023-10-09T07:00:18.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.714+0000 7f2eec99d700 1 -- start start 2023-10-09T07:00:18.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.715+0000 7f2eec99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ee806c0f0 0x7f2ee80c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.715+0000 7f2eec99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ee8142ea0 0x7f2ee80cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.715+0000 7f2eec99d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ee80cc9c0 0x7f2ee8158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.715+0000 7f2eec99d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee816a8f0 con 0x7f2ee80cc9c0 2023-10-09T07:00:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.715+0000 7f2eec99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee8169ce0 con 0x7f2ee8142ea0 2023-10-09T07:00:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.715+0000 7f2eec99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee8169fc0 con 0x7f2ee806c0f0 2023-10-09T07:00:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.715+0000 7f2ee7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ee80cc9c0 0x7f2ee8158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.715+0000 7f2ee77fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ee806c0f0 0x7f2ee80c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.715+0000 7f2ee77fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ee806c0f0 0x7f2ee80c9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:43194/0 (socket says 172.21.15.71:43194) 2023-10-09T07:00:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.715+0000 7f2ee77fe700 1 -- 172.21.15.71:0/1542025356 learned_addr learned my addr 172.21.15.71:0/1542025356 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.715+0000 7f2ee6ffd700 1 --2- 172.21.15.71:0/1542025356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ee8142ea0 0x7f2ee80cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:18.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.716+0000 7f2ee7fff700 1 -- 172.21.15.71:0/1542025356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ee806c0f0 msgr2=0x7f2ee80c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:18.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.716+0000 7f2ee7fff700 1 --2- 172.21.15.71:0/1542025356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ee806c0f0 0x7f2ee80c9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:18.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.716+0000 7f2ee7fff700 1 -- 172.21.15.71:0/1542025356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ee8142ea0 msgr2=0x7f2ee80cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:18.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.716+0000 7f2ee7fff700 1 --2- 172.21.15.71:0/1542025356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ee8142ea0 0x7f2ee80cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:18.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.716+0000 7f2ee7fff700 1 -- 172.21.15.71:0/1542025356 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee0009a20 con 0x7f2ee80cc9c0 2023-10-09T07:00:18.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.716+0000 7f2ee77fe700 1 --2- 172.21.15.71:0/1542025356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ee806c0f0 0x7f2ee80c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:00:18.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.716+0000 7f2ee6ffd700 1 --2- 172.21.15.71:0/1542025356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ee8142ea0 0x7f2ee80cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:00:18.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.716+0000 7f2ee7fff700 1 --2- 172.21.15.71:0/1542025356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ee80cc9c0 0x7f2ee8158c90 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0009ee0 tx=0x7f2ee000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:18.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.716+0000 7f2ecf7fe700 1 -- 172.21.15.71:0/1542025356 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee000cb70 con 0x7f2ee80cc9c0 2023-10-09T07:00:18.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.716+0000 7f2ecf7fe700 1 -- 172.21.15.71:0/1542025356 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee000f040 con 0x7f2ee80cc9c0 2023-10-09T07:00:18.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.716+0000 7f2eec99d700 1 -- 172.21.15.71:0/1542025356 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed80094f0 con 0x7f2ee80cc9c0 2023-10-09T07:00:18.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.716+0000 7f2ecf7fe700 1 -- 172.21.15.71:0/1542025356 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0014480 con 0x7f2ee80cc9c0 2023-10-09T07:00:18.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.716+0000 7f2eec99d700 1 -- 172.21.15.71:0/1542025356 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee816a580 con 0x7f2ee80cc9c0 2023-10-09T07:00:18.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.717+0000 7f2eec99d700 1 -- 172.21.15.71:0/1542025356 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee816aaa0 con 0x7f2ee80cc9c0 2023-10-09T07:00:18.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.718+0000 7f2ecf7fe700 1 -- 172.21.15.71:0/1542025356 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ee0003020 con 0x7f2ee80cc9c0 2023-10-09T07:00:18.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.719+0000 7f2ecf7fe700 1 --2- 172.21.15.71:0/1542025356 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2ed4066f30 0x7f2ed40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:18.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.719+0000 7f2ecf7fe700 1 -- 172.21.15.71:0/1542025356 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5933+0+0 (secure 0 0 0) 0x7f2ee0084e80 con 0x7f2ee80cc9c0 2023-10-09T07:00:18.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.720+0000 7f2ee77fe700 1 --2- 172.21.15.71:0/1542025356 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2ed4066f30 0x7f2ed40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:18.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.720+0000 7f2ee77fe700 1 --2- 172.21.15.71:0/1542025356 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2ed4066f30 0x7f2ed40693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8006e40 tx=0x7f2ed8017000 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:18.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.723+0000 7f2ecf7fe700 1 -- 172.21.15.71:0/1542025356 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ee816aaa0 con 0x7f2ee80cc9c0 2023-10-09T07:00:18.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.961+0000 7f2eec99d700 1 -- 172.21.15.71:0/1542025356 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ee804c3c0 con 0x7f2ee80cc9c0 2023-10-09T07:00:18.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.962+0000 7f2ecf7fe700 1 -- 172.21.15.71:0/1542025356 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f2ee0018de0 con 0x7f2ee80cc9c0 2023-10-09T07:00:18.963 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:00:18.963 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":51,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/2945926197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2945926197},{"type":"v1","addr":"172.21.15.71:6834","nonce":2945926197}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1112255645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1112255645},{"type":"v1","addr":"172.21.15.179:6836","nonce":1112255645}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3298180688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":3298180688},{"type":"v1","addr":"172.21.15.71:6835","nonce":3298180688}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/2164485173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2164485173},{"type":"v1","addr":"172.21.15.179:6833","nonce":2164485173}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[]} 2023-10-09T07:00:18.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.964+0000 7f2eec99d700 1 -- 172.21.15.71:0/1542025356 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2ed4066f30 msgr2=0x7f2ed40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:18.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.964+0000 7f2eec99d700 1 --2- 172.21.15.71:0/1542025356 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2ed4066f30 0x7f2ed40693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8006e40 tx=0x7f2ed8017000 comp rx=0 tx=0).stop 2023-10-09T07:00:18.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.964+0000 7f2eec99d700 1 -- 172.21.15.71:0/1542025356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ee80cc9c0 msgr2=0x7f2ee8158c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:18.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.964+0000 7f2eec99d700 1 --2- 172.21.15.71:0/1542025356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ee80cc9c0 0x7f2ee8158c90 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0009ee0 tx=0x7f2ee000b040 comp rx=0 tx=0).stop 2023-10-09T07:00:18.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.964+0000 7f2eec99d700 1 -- 172.21.15.71:0/1542025356 shutdown_connections 2023-10-09T07:00:18.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.964+0000 7f2eec99d700 1 --2- 172.21.15.71:0/1542025356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ee80cc9c0 0x7f2ee8158c90 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:18.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.964+0000 7f2eec99d700 1 --2- 172.21.15.71:0/1542025356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ee806c0f0 0x7f2ee80c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:18.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.964+0000 7f2eec99d700 1 --2- 172.21.15.71:0/1542025356 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2ed4066f30 0x7f2ed40693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:18.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.964+0000 7f2eec99d700 1 --2- 172.21.15.71:0/1542025356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ee8142ea0 0x7f2ee80cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:18.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.964+0000 7f2eec99d700 1 -- 172.21.15.71:0/1542025356 >> 172.21.15.71:0/1542025356 conn(0x7f2ee80ce430 msgr2=0x7f2ee806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:18.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.964+0000 7f2eec99d700 1 -- 172.21.15.71:0/1542025356 shutdown_connections 2023-10-09T07:00:18.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:18.964+0000 7f2eec99d700 1 -- 172.21.15.71:0/1542025356 wait complete. 2023-10-09T07:00:18.967 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 51 2023-10-09T07:00:18.983 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T07:00:18.983 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T07:00:18.983 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T07:00:18.983 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T07:00:18.984 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T07:00:18.984 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T07:00:18.984 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T07:00:18.984 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T07:00:18.984 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T07:00:18.984 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T07:00:18.985 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T07:00:18.985 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T07:00:18.985 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T07:00:18.985 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T07:00:18.985 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T07:00:18.985 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T07:00:18.998 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T07:00:18.999 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T07:00:19.001 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T07:00:19.001 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T07:00:19.002 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T07:00:19.002 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T07:00:19.043 INFO:tasks.ceph.mds.c:Started 2023-10-09T07:00:19.043 DEBUG:teuthology.parallel:result is None 2023-10-09T07:00:19.046 INFO:tasks.ceph.mds.d:Started 2023-10-09T07:00:19.046 DEBUG:teuthology.parallel:result is None 2023-10-09T07:00:19.048 INFO:tasks.ceph.mds.b:Started 2023-10-09T07:00:19.049 DEBUG:teuthology.parallel:result is None 2023-10-09T07:00:19.170 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-10-09T07:00:19.186 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-09T07:00:19.186 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-09T07:00:24.998 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T07:00:24.999 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T07:00:25.004 INFO:tasks.ceph.mds.a:Started 2023-10-09T07:00:25.004 DEBUG:teuthology.parallel:result is None 2023-10-09T07:00:25.005 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T07:00:25.146 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2023-10-09T07:00:25.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.200+0000 7fee93fff700 1 Processor -- start 2023-10-09T07:00:25.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.200+0000 7fee93fff700 1 -- start start 2023-10-09T07:00:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.201+0000 7fee93fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fee8c06f810 0x7fee8c1649f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.201+0000 7fee93fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee8c06ec70 con 0x7fee8c068550 2023-10-09T07:00:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.201+0000 7fee93fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee8c0b2e70 con 0x7fee8c068920 2023-10-09T07:00:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.201+0000 7fee93fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee8c068d90 con 0x7fee8c06f810 2023-10-09T07:00:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.201+0000 7fee91d9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fee8c068550 0x7fee8c15e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35656/0 (socket says 172.21.15.71:35656) 2023-10-09T07:00:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.202+0000 7fee91d9b700 1 -- 172.21.15.71:0/1944498214 learned_addr learned my addr 172.21.15.71:0/1944498214 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.202+0000 7fee9259c700 1 --2- 172.21.15.71:0/1944498214 >> v2:172.21.15.179:3300/0 conn(0x7fee8c06f810 0x7fee8c1649f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.202+0000 7fee90d99700 1 -- 172.21.15.71:0/1944498214 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 983028140 0 0) 0x7fee8c06ec70 con 0x7fee8c068550 2023-10-09T07:00:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.202+0000 7fee90d99700 1 -- 172.21.15.71:0/1944498214 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee78003570 con 0x7fee8c068550 2023-10-09T07:00:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.202+0000 7fee90d99700 1 -- 172.21.15.71:0/1944498214 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3429319870 0 0) 0x7fee78003570 con 0x7fee8c068550 2023-10-09T07:00:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.202+0000 7fee90d99700 1 -- 172.21.15.71:0/1944498214 >> v2:172.21.15.179:3300/0 conn(0x7fee8c06f810 msgr2=0x7fee8c1649f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.202+0000 7fee90d99700 1 --2- 172.21.15.71:0/1944498214 >> v2:172.21.15.179:3300/0 conn(0x7fee8c06f810 0x7fee8c1649f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.202+0000 7fee90d99700 1 -- 172.21.15.71:0/1944498214 >> v1:172.21.15.179:6789/0 conn(0x7fee8c068920 legacy=0x7fee8c06f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.202+0000 7fee90d99700 1 -- 172.21.15.71:0/1944498214 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8c0b3150 con 0x7fee8c068550 2023-10-09T07:00:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.202+0000 7fee90d99700 1 -- 172.21.15.71:0/1944498214 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fee88001470 con 0x7fee8c068550 2023-10-09T07:00:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.202+0000 7fee90d99700 1 -- 172.21.15.71:0/1944498214 >> v1:172.21.15.71:6789/0 conn(0x7fee8c068550 legacy=0x7fee8c15e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.202+0000 7fee90d99700 1 --2- 172.21.15.71:0/1944498214 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee78003a60 0x7fee78003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.202+0000 7fee90d99700 1 --2- 172.21.15.71:0/1944498214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee78004810 0x7fee78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.202+0000 7fee90d99700 1 --2- 172.21.15.71:0/1944498214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee780051c0 0x7fee7800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.202+0000 7fee90d99700 1 -- 172.21.15.71:0/1944498214 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c068d90 con 0x7fee78003a60 2023-10-09T07:00:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.202+0000 7fee90d99700 1 -- 172.21.15.71:0/1944498214 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7800c160 con 0x7fee78004810 2023-10-09T07:00:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.202+0000 7fee90d99700 1 -- 172.21.15.71:0/1944498214 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7800c320 con 0x7fee780051c0 2023-10-09T07:00:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.203+0000 7fee91d9b700 1 --2- 172.21.15.71:0/1944498214 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee78003a60 0x7fee78003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.203+0000 7fee9159a700 1 --2- 172.21.15.71:0/1944498214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee78004810 0x7fee78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.203+0000 7fee9259c700 1 --2- 172.21.15.71:0/1944498214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee780051c0 0x7fee7800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.203+0000 7fee91d9b700 1 -- 172.21.15.71:0/1944498214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee780051c0 msgr2=0x7fee7800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.203+0000 7fee91d9b700 1 --2- 172.21.15.71:0/1944498214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee780051c0 0x7fee7800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.203+0000 7fee91d9b700 1 -- 172.21.15.71:0/1944498214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee78004810 msgr2=0x7fee78004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.203+0000 7fee91d9b700 1 --2- 172.21.15.71:0/1944498214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee78004810 0x7fee78004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.203+0000 7fee91d9b700 1 -- 172.21.15.71:0/1944498214 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee78003570 con 0x7fee78003a60 2023-10-09T07:00:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.203+0000 7fee9159a700 1 --2- 172.21.15.71:0/1944498214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee78004810 0x7fee78004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:00:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.203+0000 7fee9259c700 1 -- 172.21.15.71:0/1944498214 reap_dead start 2023-10-09T07:00:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.203+0000 7fee91d9b700 1 --2- 172.21.15.71:0/1944498214 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee78003a60 0x7fee78003e70 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fee8800c3c0 tx=0x7fee88001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526e7907dbdf6f77 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.203+0000 7fee90d99700 1 -- 172.21.15.71:0/1944498214 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8800cc90 con 0x7fee78003a60 2023-10-09T07:00:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.203+0000 7fee90d99700 1 -- 172.21.15.71:0/1944498214 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8800cdf0 con 0x7fee78003a60 2023-10-09T07:00:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.203+0000 7fee90d99700 1 -- 172.21.15.71:0/1944498214 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee88005b50 con 0x7fee78003a60 2023-10-09T07:00:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.204+0000 7fee93fff700 1 -- 172.21.15.71:0/1944498214 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee78003a60 msgr2=0x7fee78003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.204+0000 7fee93fff700 1 --2- 172.21.15.71:0/1944498214 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee78003a60 0x7fee78003e70 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fee8800c3c0 tx=0x7fee88001e50 comp rx=0 tx=0).stop 2023-10-09T07:00:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.204+0000 7fee93fff700 1 -- 172.21.15.71:0/1944498214 shutdown_connections 2023-10-09T07:00:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.204+0000 7fee93fff700 1 --2- 172.21.15.71:0/1944498214 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee78003a60 0x7fee78003e70 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:25.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.204+0000 7fee93fff700 1 -- 172.21.15.71:0/1944498214 >> 172.21.15.71:0/1944498214 conn(0x7fee8c0cd480 msgr2=0x7fee8c0cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:25.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.204+0000 7fee93fff700 1 -- 172.21.15.71:0/1944498214 shutdown_connections 2023-10-09T07:00:25.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.204+0000 7fee93fff700 1 -- 172.21.15.71:0/1944498214 wait complete. 2023-10-09T07:00:25.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.205+0000 7fee93fff700 1 Processor -- start 2023-10-09T07:00:25.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.206+0000 7fee93fff700 1 -- start start 2023-10-09T07:00:25.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.206+0000 7fee93fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee78003a60 0x7fee8c0af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:25.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.207+0000 7fee93fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee8c0a98d0 0x7fee8c169960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:25.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.207+0000 7fee93fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee8c149220 0x7fee8c14a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.207+0000 7fee93fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c14d960 con 0x7fee8c149220 2023-10-09T07:00:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.207+0000 7fee93fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c0a9d40 con 0x7fee78003a60 2023-10-09T07:00:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.207+0000 7fee93fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c169ea0 con 0x7fee8c0a98d0 2023-10-09T07:00:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.207+0000 7fee9259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee8c149220 0x7fee8c14a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.207+0000 7fee9259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee8c149220 0x7fee8c14a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44340/0 (socket says 172.21.15.71:44340) 2023-10-09T07:00:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.207+0000 7fee9259c700 1 -- 172.21.15.71:0/639960134 learned_addr learned my addr 172.21.15.71:0/639960134 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.207+0000 7fee91d9b700 1 --2- 172.21.15.71:0/639960134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee78003a60 0x7fee8c0af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.207+0000 7fee9159a700 1 --2- 172.21.15.71:0/639960134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee8c0a98d0 0x7fee8c169960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.207+0000 7fee9259c700 1 -- 172.21.15.71:0/639960134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee8c0a98d0 msgr2=0x7fee8c169960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.207+0000 7fee9259c700 1 --2- 172.21.15.71:0/639960134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee8c0a98d0 0x7fee8c169960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.207+0000 7fee9259c700 1 -- 172.21.15.71:0/639960134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee78003a60 msgr2=0x7fee8c0af460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.207+0000 7fee9259c700 1 --2- 172.21.15.71:0/639960134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee78003a60 0x7fee8c0af460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.207+0000 7fee9259c700 1 -- 172.21.15.71:0/639960134 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8c0aab70 con 0x7fee8c149220 2023-10-09T07:00:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.207+0000 7fee9259c700 1 --2- 172.21.15.71:0/639960134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee8c149220 0x7fee8c14a640 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fee8c06c2c0 tx=0x7fee8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.208+0000 7fee81ffb700 1 -- 172.21.15.71:0/639960134 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8400e070 con 0x7fee8c149220 2023-10-09T07:00:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.208+0000 7fee81ffb700 1 -- 172.21.15.71:0/639960134 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee84011b80 con 0x7fee8c149220 2023-10-09T07:00:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.208+0000 7fee81ffb700 1 -- 172.21.15.71:0/639960134 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee84016470 con 0x7fee8c149220 2023-10-09T07:00:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.208+0000 7fee93fff700 1 -- 172.21.15.71:0/639960134 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee8c0a9f60 con 0x7fee8c149220 2023-10-09T07:00:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.208+0000 7fee93fff700 1 -- 172.21.15.71:0/639960134 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee8c0aa520 con 0x7fee8c149220 2023-10-09T07:00:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.209+0000 7fee93fff700 1 -- 172.21.15.71:0/639960134 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee8c0aad00 con 0x7fee8c149220 2023-10-09T07:00:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.210+0000 7fee81ffb700 1 -- 172.21.15.71:0/639960134 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee84016860 con 0x7fee8c149220 2023-10-09T07:00:25.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.211+0000 7fee81ffb700 1 --2- 172.21.15.71:0/639960134 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fee70066f30 0x7fee700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:25.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.211+0000 7fee81ffb700 1 -- 172.21.15.71:0/639960134 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5933+0+0 (secure 0 0 0) 0x7fee84084fc0 con 0x7fee8c149220 2023-10-09T07:00:25.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.211+0000 7fee91d9b700 1 --2- 172.21.15.71:0/639960134 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fee70066f30 0x7fee700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:25.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.212+0000 7fee91d9b700 1 --2- 172.21.15.71:0/639960134 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fee70066f30 0x7fee700693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fee88007cd0 tx=0x7fee88015000 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:25.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.215+0000 7fee81ffb700 1 -- 172.21.15.71:0/639960134 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee840520b0 con 0x7fee8c149220 2023-10-09T07:00:25.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:25.421+0000 7fee93fff700 1 -- 172.21.15.71:0/639960134 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fee8c04c3c0 con 0x7fee8c149220 2023-10-09T07:00:25.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-10-09T07:00:26.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:26.808+0000 7fee81ffb700 1 -- 172.21.15.71:0/639960134 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v119) v1 ==== 97+0+0 (secure 0 0 0) 0x7fee840556d0 con 0x7fee8c149220 2023-10-09T07:00:26.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:26.811+0000 7fee93fff700 1 -- 172.21.15.71:0/639960134 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fee70066f30 msgr2=0x7fee700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:26.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:26.811+0000 7fee93fff700 1 --2- 172.21.15.71:0/639960134 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fee70066f30 0x7fee700693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fee88007cd0 tx=0x7fee88015000 comp rx=0 tx=0).stop 2023-10-09T07:00:26.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:26.811+0000 7fee93fff700 1 -- 172.21.15.71:0/639960134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee8c149220 msgr2=0x7fee8c14a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:26.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:26.811+0000 7fee93fff700 1 --2- 172.21.15.71:0/639960134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee8c149220 0x7fee8c14a640 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fee8c06c2c0 tx=0x7fee8400b040 comp rx=0 tx=0).stop 2023-10-09T07:00:26.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:26.811+0000 7fee93fff700 1 -- 172.21.15.71:0/639960134 shutdown_connections 2023-10-09T07:00:26.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:26.811+0000 7fee93fff700 1 --2- 172.21.15.71:0/639960134 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee8c149220 0x7fee8c14a640 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:26.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:26.811+0000 7fee93fff700 1 --2- 172.21.15.71:0/639960134 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fee70066f30 0x7fee700693e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:26.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:26.811+0000 7fee93fff700 1 --2- 172.21.15.71:0/639960134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee78003a60 0x7fee8c0af460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:26.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:26.811+0000 7fee93fff700 1 --2- 172.21.15.71:0/639960134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee8c0a98d0 0x7fee8c169960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:26.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:26.811+0000 7fee93fff700 1 -- 172.21.15.71:0/639960134 >> 172.21.15.71:0/639960134 conn(0x7fee8c0cd480 msgr2=0x7fee8c06ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:26.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:26.812+0000 7fee93fff700 1 -- 172.21.15.71:0/639960134 shutdown_connections 2023-10-09T07:00:26.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:26.812+0000 7fee93fff700 1 -- 172.21.15.71:0/639960134 wait complete. 2023-10-09T07:00:26.815 INFO:teuthology.orchestra.run.smithi071.stderr: removed all blocklist entries 2023-10-09T07:00:26.835 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T07:00:27.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.018+0000 7f84e3fff700 1 Processor -- start 2023-10-09T07:00:27.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.018+0000 7f84e3fff700 1 -- start start 2023-10-09T07:00:27.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.019+0000 7f84e3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84e406d950 0x7f84e40c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:27.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.019+0000 7f84e3fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f84e406dd20 0x7f84e40c7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:27.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.019+0000 7f84e3fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e406ae70 con 0x7f84e406a0a0 2023-10-09T07:00:27.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.019+0000 7f84e3fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e406a540 con 0x7f84e406dd20 2023-10-09T07:00:27.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.019+0000 7f84e3fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e406a820 con 0x7f84e406d950 2023-10-09T07:00:27.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.019+0000 7f84dbfff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f84e406a0a0 0x7f84e40c6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35672/0 (socket says 172.21.15.71:35672) 2023-10-09T07:00:27.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.019+0000 7f84dbfff700 1 -- 172.21.15.71:0/2915067553 learned_addr learned my addr 172.21.15.71:0/2915067553 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:27.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.019+0000 7f84e37fe700 1 --2- 172.21.15.71:0/2915067553 >> v2:172.21.15.71:3300/0 conn(0x7f84e406dd20 0x7f84e40c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:27.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.019+0000 7f84e2ffd700 1 --2- 172.21.15.71:0/2915067553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84e406d950 0x7f84e40c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:27.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.020+0000 7f84e27fc700 1 -- 172.21.15.71:0/2915067553 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123535831 0 0) 0x7f84e406ae70 con 0x7f84e406a0a0 2023-10-09T07:00:27.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.020+0000 7f84e27fc700 1 -- 172.21.15.71:0/2915067553 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84d0003570 con 0x7f84e406a0a0 2023-10-09T07:00:27.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.020+0000 7f84e37fe700 1 -- 172.21.15.71:0/2915067553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84e406d950 msgr2=0x7f84e40c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:27.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.020+0000 7f84e37fe700 1 --2- 172.21.15.71:0/2915067553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84e406d950 0x7f84e40c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.020+0000 7f84e37fe700 1 -- 172.21.15.71:0/2915067553 >> v1:172.21.15.71:6789/0 conn(0x7f84e406a0a0 legacy=0x7f84e40c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:27.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.020+0000 7f84e37fe700 1 -- 172.21.15.71:0/2915067553 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e406ab00 con 0x7f84e406dd20 2023-10-09T07:00:27.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.020+0000 7f84e37fe700 1 --2- 172.21.15.71:0/2915067553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84e406dd20 0x7f84e40c7320 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009e60 tx=0x7f84dc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a7affc078a9fef server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:27.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.020+0000 7f84e27fc700 1 -- 172.21.15.71:0/2915067553 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc00e070 con 0x7f84e406dd20 2023-10-09T07:00:27.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.020+0000 7f84e27fc700 1 -- 172.21.15.71:0/2915067553 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84dc00bab0 con 0x7f84e406dd20 2023-10-09T07:00:27.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.020+0000 7f84e27fc700 1 -- 172.21.15.71:0/2915067553 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc00be70 con 0x7f84e406dd20 2023-10-09T07:00:27.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.021+0000 7f84e3fff700 1 -- 172.21.15.71:0/2915067553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84e406dd20 msgr2=0x7f84e40c7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:27.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.021+0000 7f84e3fff700 1 --2- 172.21.15.71:0/2915067553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84e406dd20 0x7f84e40c7320 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009e60 tx=0x7f84dc009780 comp rx=0 tx=0).stop 2023-10-09T07:00:27.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.021+0000 7f84e3fff700 1 -- 172.21.15.71:0/2915067553 shutdown_connections 2023-10-09T07:00:27.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.021+0000 7f84e3fff700 1 --2- 172.21.15.71:0/2915067553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84e406dd20 0x7f84e40c7320 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.021+0000 7f84e3fff700 1 --2- 172.21.15.71:0/2915067553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84e406d950 0x7f84e40c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.021+0000 7f84e3fff700 1 -- 172.21.15.71:0/2915067553 >> 172.21.15.71:0/2915067553 conn(0x7f84e40cc1f0 msgr2=0x7f84e40cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:27.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.021+0000 7f84e3fff700 1 -- 172.21.15.71:0/2915067553 shutdown_connections 2023-10-09T07:00:27.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.021+0000 7f84e3fff700 1 -- 172.21.15.71:0/2915067553 wait complete. 2023-10-09T07:00:27.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.022+0000 7f84e3fff700 1 Processor -- start 2023-10-09T07:00:27.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.022+0000 7f84e3fff700 1 -- start start 2023-10-09T07:00:27.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.023+0000 7f84e3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84e406a0a0 0x7f84e4153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:27.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.023+0000 7f84e3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84e406d950 0x7f84e416cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:27.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.023+0000 7f84e3fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84e406dd20 0x7f84e416d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:27.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.023+0000 7f84e3fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e415b0b0 con 0x7f84e406d950 2023-10-09T07:00:27.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.023+0000 7f84e3fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e40c6380 con 0x7f84e406dd20 2023-10-09T07:00:27.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.023+0000 7f84e3fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e4159d30 con 0x7f84e406a0a0 2023-10-09T07:00:27.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.024+0000 7f84dbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84e406d950 0x7f84e416cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:27.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.024+0000 7f84dbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84e406d950 0x7f84e416cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44358/0 (socket says 172.21.15.71:44358) 2023-10-09T07:00:27.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.024+0000 7f84dbfff700 1 -- 172.21.15.71:0/1202611297 learned_addr learned my addr 172.21.15.71:0/1202611297 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:27.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.024+0000 7f84e2ffd700 1 --2- 172.21.15.71:0/1202611297 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84e406a0a0 0x7f84e4153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:27.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.024+0000 7f84e37fe700 1 --2- 172.21.15.71:0/1202611297 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84e406dd20 0x7f84e416d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:27.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.024+0000 7f84dbfff700 1 -- 172.21.15.71:0/1202611297 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84e406a0a0 msgr2=0x7f84e4153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:27.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.024+0000 7f84dbfff700 1 --2- 172.21.15.71:0/1202611297 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84e406a0a0 0x7f84e4153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.024+0000 7f84dbfff700 1 -- 172.21.15.71:0/1202611297 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84e406dd20 msgr2=0x7f84e416d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:27.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.024+0000 7f84dbfff700 1 --2- 172.21.15.71:0/1202611297 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84e406dd20 0x7f84e416d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.024+0000 7f84dbfff700 1 -- 172.21.15.71:0/1202611297 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84dc009a20 con 0x7f84e406d950 2023-10-09T07:00:27.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.024+0000 7f84dbfff700 1 --2- 172.21.15.71:0/1202611297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84e406d950 0x7f84e416cda0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f84cc00c7c0 tx=0x7f84cc007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:27.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.025+0000 7f84daffd700 1 -- 172.21.15.71:0/1202611297 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc005c00 con 0x7f84e406d950 2023-10-09T07:00:27.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.025+0000 7f84daffd700 1 -- 172.21.15.71:0/1202611297 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84cc005d60 con 0x7f84e406d950 2023-10-09T07:00:27.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.025+0000 7f84daffd700 1 -- 172.21.15.71:0/1202611297 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc007320 con 0x7f84e406d950 2023-10-09T07:00:27.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.025+0000 7f84e3fff700 1 -- 172.21.15.71:0/1202611297 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e415a010 con 0x7f84e406d950 2023-10-09T07:00:27.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.025+0000 7f84e3fff700 1 -- 172.21.15.71:0/1202611297 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e415a5d0 con 0x7f84e406d950 2023-10-09T07:00:27.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.026+0000 7f84e3fff700 1 -- 172.21.15.71:0/1202611297 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e415b220 con 0x7f84e406d950 2023-10-09T07:00:27.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.027+0000 7f84daffd700 1 -- 172.21.15.71:0/1202611297 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84cc01b3b0 con 0x7f84e406d950 2023-10-09T07:00:27.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.027+0000 7f84daffd700 1 --2- 172.21.15.71:0/1202611297 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f84c4066f30 0x7f84c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:27.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.028+0000 7f84daffd700 1 -- 172.21.15.71:0/1202611297 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f84cc083840 con 0x7f84e406d950 2023-10-09T07:00:27.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.028+0000 7f84e2ffd700 1 --2- 172.21.15.71:0/1202611297 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f84c4066f30 0x7f84c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:27.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.029+0000 7f84e2ffd700 1 --2- 172.21.15.71:0/1202611297 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f84c4066f30 0x7f84c40693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009db0 tx=0x7f84d40091a0 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:27.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.031+0000 7f84daffd700 1 -- 172.21.15.71:0/1202611297 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84cc050c80 con 0x7f84e406d950 2023-10-09T07:00:27.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.293+0000 7f84e3fff700 1 -- 172.21.15.71:0/1202611297 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f84e404c3c0 con 0x7f84e406d950 2023-10-09T07:00:27.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.294+0000 7f84daffd700 1 -- 172.21.15.71:0/1202611297 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f84cc017070 con 0x7f84e406d950 2023-10-09T07:00:27.295 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:00:27.295 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T07:00:27.295 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_dump": [ 2023-10-09T07:00:27.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:00:27.295 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.a", 2023-10-09T07:00:27.296 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlpI5JCRAAGBgrs6g+6KZFXv1eq0fkwQ==", 2023-10-09T07:00:27.296 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:00:27.296 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:00:27.296 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T07:00:27.296 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T07:00:27.296 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:00:27.296 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:00:27.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:00:27.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:00:27.296 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.b", 2023-10-09T07:00:27.296 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlDZQYHhAA2LGKHPLrBVKlGMK0TKup7A==", 2023-10-09T07:00:27.297 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:00:27.297 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:00:27.297 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T07:00:27.297 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T07:00:27.297 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:00:27.297 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:00:27.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:00:27.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:00:27.297 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.c", 2023-10-09T07:00:27.297 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlLKKfExAA65+KIyYd16iQ2L5topDPkg==", 2023-10-09T07:00:27.297 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:00:27.298 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:00:27.298 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T07:00:27.298 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T07:00:27.298 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:00:27.298 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:00:27.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:00:27.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:00:27.298 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.d", 2023-10-09T07:00:27.298 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlpQKTKBAAP59h/znElthIdqbK9tKJww==", 2023-10-09T07:00:27.298 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:00:27.298 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:00:27.299 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T07:00:27.299 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T07:00:27.299 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:00:27.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:00:27.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:00:27.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:00:27.299 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.0", 2023-10-09T07:00:27.299 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCgoCNll7hBIBAAtZ8mBx+MPAwEou48boP4Hw==", 2023-10-09T07:00:27.299 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:00:27.299 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:00:27.299 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:00:27.299 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:00:27.300 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:00:27.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:00:27.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:00:27.300 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.1", 2023-10-09T07:00:27.300 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCjoCNl7uRMIxAAztQi4ZsulyN2FHcMRzZ82Q==", 2023-10-09T07:00:27.300 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:00:27.300 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:00:27.300 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:00:27.300 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:00:27.300 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:00:27.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:00:27.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:00:27.301 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.2", 2023-10-09T07:00:27.301 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCmoCNlW/cNJhAAfFdnRC95YJwpCngJS956cA==", 2023-10-09T07:00:27.301 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:00:27.301 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:00:27.301 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:00:27.301 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:00:27.301 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:00:27.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:00:27.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:00:27.301 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.3", 2023-10-09T07:00:27.301 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCpoCNlAIlYKRAAD5IGHWZ14ckpQAU4wBifbg==", 2023-10-09T07:00:27.301 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:00:27.302 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:00:27.302 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:00:27.302 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:00:27.302 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:00:27.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:00:27.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:00:27.302 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.4", 2023-10-09T07:00:27.302 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCvoCNltrA4ORAAtifmL9hr1xKd+jsMf5Nf+Q==", 2023-10-09T07:00:27.302 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:00:27.302 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:00:27.302 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:00:27.303 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:00:27.303 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:00:27.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:00:27.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:00:27.303 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.5", 2023-10-09T07:00:27.303 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCyoCNlA/IOOxAAQWRPQ+00o9xrpScAvY/87w==", 2023-10-09T07:00:27.303 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:00:27.303 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:00:27.303 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:00:27.303 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:00:27.303 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:00:27.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:00:27.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:00:27.304 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.6", 2023-10-09T07:00:27.304 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQC2oCNlvRusARAAcRaGyCROIRVTHeKhrncN8g==", 2023-10-09T07:00:27.304 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:00:27.304 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:00:27.304 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:00:27.304 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:00:27.304 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:00:27.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:00:27.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:00:27.304 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.7", 2023-10-09T07:00:27.304 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQC5oCNli/3NAxAAIMYuED41ZSx1xF384N6y1A==", 2023-10-09T07:00:27.305 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:00:27.305 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:00:27.305 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:00:27.305 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:00:27.305 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:00:27.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:00:27.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:00:27.305 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.0", 2023-10-09T07:00:27.305 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlHrKWMRAAyIfmryGSgqIFwWEJyixprw==", 2023-10-09T07:00:27.305 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:00:27.305 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:00:27.305 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow r", 2023-10-09T07:00:27.306 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T07:00:27.306 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:00:27.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:00:27.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:00:27.306 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.1", 2023-10-09T07:00:27.306 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCdoCNldq1xAxAAxCpmelS0qDEY187u19JkcQ==", 2023-10-09T07:00:27.306 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:00:27.306 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:00:27.306 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T07:00:27.306 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T07:00:27.306 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T07:00:27.307 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:00:27.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:00:27.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:00:27.307 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.2", 2023-10-09T07:00:27.307 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlM3JHOBAA8fszREXH+WnYb+3vIaakcA==", 2023-10-09T07:00:27.307 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:00:27.307 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:00:27.307 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T07:00:27.307 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T07:00:27.307 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T07:00:27.307 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:00:27.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:00:27.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:00:27.308 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.3", 2023-10-09T07:00:27.308 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCdoCNlgkEqChAAwntdv9UOo30x40pVa70yag==", 2023-10-09T07:00:27.308 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:00:27.308 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:00:27.308 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T07:00:27.308 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T07:00:27.308 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T07:00:27.308 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:00:27.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:00:27.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:00:27.308 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.admin", 2023-10-09T07:00:27.309 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCboCNlj2W4EhAAUnfX6NBeDyMj2nY/G2ciEg==", 2023-10-09T07:00:27.309 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:00:27.309 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T07:00:27.309 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T07:00:27.309 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T07:00:27.309 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:00:27.309 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:00:27.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:00:27.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:00:27.309 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.x", 2023-10-09T07:00:27.309 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlwwJ/AhAAjHMhAX1/yWgh9no7yQqP6Q==", 2023-10-09T07:00:27.310 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:00:27.310 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T07:00:27.310 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-09T07:00:27.310 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:00:27.310 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:00:27.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:00:27.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:00:27.310 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.y", 2023-10-09T07:00:27.310 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCboCNly/XVNRAAlKr9arCbsDbzZ9bpIU5dng==", 2023-10-09T07:00:27.310 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:00:27.310 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T07:00:27.310 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-09T07:00:27.311 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:00:27.311 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:00:27.311 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:00:27.311 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2023-10-09T07:00:27.311 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T07:00:27.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.296+0000 7f84e3fff700 1 -- 172.21.15.71:0/1202611297 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f84c4066f30 msgr2=0x7f84c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:27.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.296+0000 7f84e3fff700 1 --2- 172.21.15.71:0/1202611297 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f84c4066f30 0x7f84c40693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009db0 tx=0x7f84d40091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.296+0000 7f84e3fff700 1 -- 172.21.15.71:0/1202611297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84e406d950 msgr2=0x7f84e416cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:27.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.296+0000 7f84e3fff700 1 --2- 172.21.15.71:0/1202611297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84e406d950 0x7f84e416cda0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f84cc00c7c0 tx=0x7f84cc007dd0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.296+0000 7f84e3fff700 1 -- 172.21.15.71:0/1202611297 shutdown_connections 2023-10-09T07:00:27.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.296+0000 7f84e3fff700 1 --2- 172.21.15.71:0/1202611297 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f84c4066f30 0x7f84c40693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.296+0000 7f84e3fff700 1 --2- 172.21.15.71:0/1202611297 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84e406dd20 0x7f84e416d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.296+0000 7f84e3fff700 1 --2- 172.21.15.71:0/1202611297 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84e406a0a0 0x7f84e4153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.296+0000 7f84e3fff700 1 --2- 172.21.15.71:0/1202611297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84e406d950 0x7f84e416cda0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.296+0000 7f84e3fff700 1 -- 172.21.15.71:0/1202611297 >> 172.21.15.71:0/1202611297 conn(0x7f84e40cc1f0 msgr2=0x7f84e40c0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:27.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.297+0000 7f84e3fff700 1 -- 172.21.15.71:0/1202611297 shutdown_connections 2023-10-09T07:00:27.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.297+0000 7f84e3fff700 1 -- 172.21.15.71:0/1202611297 wait complete. 2023-10-09T07:00:27.315 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:00:27.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.494+0000 7f82d61ff700 1 Processor -- start 2023-10-09T07:00:27.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.494+0000 7f82d61ff700 1 -- start start 2023-10-09T07:00:27.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.496+0000 7f82d61ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f82d0155c10 0x7f82d0155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:27.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.496+0000 7f82d61ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82d00ac230 0x7f82d00ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:27.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.496+0000 7f82d61ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f82d01568a0 0x7f82d0156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:27.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.496+0000 7f82d61ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d00ad930 con 0x7f82d01568a0 2023-10-09T07:00:27.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.496+0000 7f82d61ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d00acd20 con 0x7f82d0155c10 2023-10-09T07:00:27.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.496+0000 7f82d61ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00ad000 con 0x7f82d00ac230 2023-10-09T07:00:27.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.496+0000 7f82cffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f82d01568a0 0x7f82d0156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:27.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.496+0000 7f82cffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f82d01568a0 0x7f82d0156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44368/0 (socket says 172.21.15.71:44368) 2023-10-09T07:00:27.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.496+0000 7f82cffff700 1 -- 172.21.15.71:0/1340468318 learned_addr learned my addr 172.21.15.71:0/1340468318 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:27.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.496+0000 7f82ceffd700 1 --2- 172.21.15.71:0/1340468318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82d00ac230 0x7f82d00ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:27.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.496+0000 7f82cf7fe700 1 --2- 172.21.15.71:0/1340468318 >> v2:172.21.15.179:3300/0 conn(0x7f82d0155c10 0x7f82d0155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:27.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.496+0000 7f82cffff700 1 -- 172.21.15.71:0/1340468318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82d00ac230 msgr2=0x7f82d00ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:27.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.496+0000 7f82cffff700 1 --2- 172.21.15.71:0/1340468318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82d00ac230 0x7f82d00ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.496+0000 7f82cffff700 1 -- 172.21.15.71:0/1340468318 >> v2:172.21.15.179:3300/0 conn(0x7f82d0155c10 msgr2=0x7f82d0155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:27.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.496+0000 7f82cffff700 1 --2- 172.21.15.71:0/1340468318 >> v2:172.21.15.179:3300/0 conn(0x7f82d0155c10 0x7f82d0155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.496+0000 7f82cffff700 1 -- 172.21.15.71:0/1340468318 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d00ad2e0 con 0x7f82d01568a0 2023-10-09T07:00:27.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.497+0000 7f82cffff700 1 --2- 172.21.15.71:0/1340468318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82d01568a0 0x7f82d0156cc0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f82d0063d40 tx=0x7f82c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1cbf90745689cd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:27.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.497+0000 7f82ce7fc700 1 -- 172.21.15.71:0/1340468318 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c800e070 con 0x7f82d01568a0 2023-10-09T07:00:27.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.497+0000 7f82ce7fc700 1 -- 172.21.15.71:0/1340468318 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c800b970 con 0x7f82d01568a0 2023-10-09T07:00:27.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.497+0000 7f82ce7fc700 1 -- 172.21.15.71:0/1340468318 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c80092e0 con 0x7f82d01568a0 2023-10-09T07:00:27.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.497+0000 7f82d61ff700 1 -- 172.21.15.71:0/1340468318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82d01568a0 msgr2=0x7f82d0156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:27.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.497+0000 7f82d61ff700 1 --2- 172.21.15.71:0/1340468318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82d01568a0 0x7f82d0156cc0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f82d0063d40 tx=0x7f82c8009840 comp rx=0 tx=0).stop 2023-10-09T07:00:27.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.498+0000 7f82d61ff700 1 -- 172.21.15.71:0/1340468318 shutdown_connections 2023-10-09T07:00:27.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.498+0000 7f82d61ff700 1 --2- 172.21.15.71:0/1340468318 >> v2:172.21.15.179:3300/0 conn(0x7f82d0155c10 0x7f82d0155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.498+0000 7f82d61ff700 1 --2- 172.21.15.71:0/1340468318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82d01568a0 0x7f82d0156cc0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.498+0000 7f82d61ff700 1 --2- 172.21.15.71:0/1340468318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82d00ac230 0x7f82d00ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.498+0000 7f82d61ff700 1 -- 172.21.15.71:0/1340468318 >> 172.21.15.71:0/1340468318 conn(0x7f82d006a320 msgr2=0x7f82d00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:27.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.498+0000 7f82d61ff700 1 -- 172.21.15.71:0/1340468318 shutdown_connections 2023-10-09T07:00:27.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.498+0000 7f82d61ff700 1 -- 172.21.15.71:0/1340468318 wait complete. 2023-10-09T07:00:27.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.499+0000 7f82d61ff700 1 Processor -- start 2023-10-09T07:00:27.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.499+0000 7f82d61ff700 1 -- start start 2023-10-09T07:00:27.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.500+0000 7f82d61ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82d00ac230 0x7f82d0156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:27.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.500+0000 7f82d61ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82d0155c10 0x7f82d0159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:27.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.500+0000 7f82d61ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82d01568a0 0x7f82d0166900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:27.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.500+0000 7f82d61ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d0158bb0 con 0x7f82d00ac230 2023-10-09T07:00:27.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.500+0000 7f82d61ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d0157680 con 0x7f82d0155c10 2023-10-09T07:00:27.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.500+0000 7f82d61ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d0159710 con 0x7f82d01568a0 2023-10-09T07:00:27.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.500+0000 7f82cf7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82d00ac230 0x7f82d0156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:27.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.500+0000 7f82cf7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82d00ac230 0x7f82d0156ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44380/0 (socket says 172.21.15.71:44380) 2023-10-09T07:00:27.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.500+0000 7f82cf7fe700 1 -- 172.21.15.71:0/2052051552 learned_addr learned my addr 172.21.15.71:0/2052051552 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:27.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.500+0000 7f82cffff700 1 --2- 172.21.15.71:0/2052051552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82d01568a0 0x7f82d0166900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:27.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.500+0000 7f82ceffd700 1 --2- 172.21.15.71:0/2052051552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82d0155c10 0x7f82d0159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:27.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.501+0000 7f82cf7fe700 1 -- 172.21.15.71:0/2052051552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82d01568a0 msgr2=0x7f82d0166900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:27.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.501+0000 7f82cf7fe700 1 --2- 172.21.15.71:0/2052051552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82d01568a0 0x7f82d0166900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.501+0000 7f82cf7fe700 1 -- 172.21.15.71:0/2052051552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82d0155c10 msgr2=0x7f82d0159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:27.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.501+0000 7f82cf7fe700 1 --2- 172.21.15.71:0/2052051552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82d0155c10 0x7f82d0159ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.501+0000 7f82cf7fe700 1 -- 172.21.15.71:0/2052051552 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c8009ae0 con 0x7f82d00ac230 2023-10-09T07:00:27.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.501+0000 7f82cf7fe700 1 --2- 172.21.15.71:0/2052051552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82d00ac230 0x7f82d0156ca0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f82c000ecb0 tx=0x7f82c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:27.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.501+0000 7f82b77fe700 1 -- 172.21.15.71:0/2052051552 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c000c850 con 0x7f82d00ac230 2023-10-09T07:00:27.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.501+0000 7f82b77fe700 1 -- 172.21.15.71:0/2052051552 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c000c9b0 con 0x7f82d00ac230 2023-10-09T07:00:27.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.501+0000 7f82d61ff700 1 -- 172.21.15.71:0/2052051552 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d0158de0 con 0x7f82d00ac230 2023-10-09T07:00:27.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.501+0000 7f82b77fe700 1 -- 172.21.15.71:0/2052051552 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c000cd50 con 0x7f82d00ac230 2023-10-09T07:00:27.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.502+0000 7f82d61ff700 1 -- 172.21.15.71:0/2052051552 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d0159170 con 0x7f82d00ac230 2023-10-09T07:00:27.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.502+0000 7f82d61ff700 1 -- 172.21.15.71:0/2052051552 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d004c3c0 con 0x7f82d00ac230 2023-10-09T07:00:27.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.503+0000 7f82b77fe700 1 -- 172.21.15.71:0/2052051552 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82c0013680 con 0x7f82d00ac230 2023-10-09T07:00:27.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.504+0000 7f82b77fe700 1 --2- 172.21.15.71:0/2052051552 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f82bc066f30 0x7f82bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:27.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.504+0000 7f82b77fe700 1 -- 172.21.15.71:0/2052051552 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f82c0084550 con 0x7f82d00ac230 2023-10-09T07:00:27.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.505+0000 7f82ceffd700 1 --2- 172.21.15.71:0/2052051552 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f82bc066f30 0x7f82bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:27.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.505+0000 7f82ceffd700 1 --2- 172.21.15.71:0/2052051552 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f82bc066f30 0x7f82bc0693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f82d0154110 tx=0x7f82c400f040 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:27.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.508+0000 7f82b77fe700 1 -- 172.21.15.71:0/2052051552 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82c0051990 con 0x7f82d00ac230 2023-10-09T07:00:27.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.697+0000 7f82d61ff700 1 -- 172.21.15.71:0/2052051552 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82d00ad5c0 con 0x7f82d00ac230 2023-10-09T07:00:27.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.698+0000 7f82b77fe700 1 -- 172.21.15.71:0/2052051552 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+12738 (secure 0 0 0) 0x7f82c0054fb0 con 0x7f82d00ac230 2023-10-09T07:00:27.699 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:00:27.700 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":119,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:00:26.804876+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:00:27.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.701+0000 7f82d61ff700 1 -- 172.21.15.71:0/2052051552 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f82bc066f30 msgr2=0x7f82bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:27.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.701+0000 7f82d61ff700 1 --2- 172.21.15.71:0/2052051552 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f82bc066f30 0x7f82bc0693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f82d0154110 tx=0x7f82c400f040 comp rx=0 tx=0).stop 2023-10-09T07:00:27.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.701+0000 7f82d61ff700 1 -- 172.21.15.71:0/2052051552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82d00ac230 msgr2=0x7f82d0156ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:27.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.701+0000 7f82d61ff700 1 --2- 172.21.15.71:0/2052051552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82d00ac230 0x7f82d0156ca0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f82c000ecb0 tx=0x7f82c00091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.701+0000 7f82d61ff700 1 -- 172.21.15.71:0/2052051552 shutdown_connections 2023-10-09T07:00:27.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.701+0000 7f82d61ff700 1 --2- 172.21.15.71:0/2052051552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82d01568a0 0x7f82d0166900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.701+0000 7f82d61ff700 1 --2- 172.21.15.71:0/2052051552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82d00ac230 0x7f82d0156ca0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.701+0000 7f82d61ff700 1 --2- 172.21.15.71:0/2052051552 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f82bc066f30 0x7f82bc0693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.701+0000 7f82d61ff700 1 --2- 172.21.15.71:0/2052051552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82d0155c10 0x7f82d0159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.701+0000 7f82d61ff700 1 -- 172.21.15.71:0/2052051552 >> 172.21.15.71:0/2052051552 conn(0x7f82d006a320 msgr2=0x7f82d006e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:27.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.701+0000 7f82d61ff700 1 -- 172.21.15.71:0/2052051552 shutdown_connections 2023-10-09T07:00:27.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.701+0000 7f82d61ff700 1 -- 172.21.15.71:0/2052051552 wait complete. 2023-10-09T07:00:27.719 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T07:00:27.720 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T07:00:27.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.904+0000 7f4527dff700 1 Processor -- start 2023-10-09T07:00:27.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.904+0000 7f4527dff700 1 -- start start 2023-10-09T07:00:27.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.905+0000 7f4527dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4520159c60 0x7f452015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:27.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.905+0000 7f4527dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f452015db10 0x7f4520069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:27.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.905+0000 7f4527dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f452015a160 con 0x7f4520159890 2023-10-09T07:00:27.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.905+0000 7f4527dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45200d13a0 con 0x7f452015db10 2023-10-09T07:00:27.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.905+0000 7f4527dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452015e140 con 0x7f4520159c60 2023-10-09T07:00:27.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.906+0000 7f452639c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f452015db10 0x7f4520069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:27.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.906+0000 7f452639c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f452015db10 0x7f4520069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44392/0 (socket says 172.21.15.71:44392) 2023-10-09T07:00:27.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.906+0000 7f452639c700 1 -- 172.21.15.71:0/3769479524 learned_addr learned my addr 172.21.15.71:0/3769479524 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:27.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.906+0000 7f452539a700 1 --2- 172.21.15.71:0/3769479524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4520159c60 0x7f452015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:27.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.906+0000 7f452639c700 1 -- 172.21.15.71:0/3769479524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4520159c60 msgr2=0x7f452015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:27.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.906+0000 7f452639c700 1 --2- 172.21.15.71:0/3769479524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4520159c60 0x7f452015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.906+0000 7f452639c700 1 -- 172.21.15.71:0/3769479524 >> v1:172.21.15.179:6789/0 conn(0x7f4520159890 legacy=0x7f452015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:27.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.906+0000 7f452639c700 1 -- 172.21.15.71:0/3769479524 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452015a3d0 con 0x7f452015db10 2023-10-09T07:00:27.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.906+0000 7f452539a700 1 --2- 172.21.15.71:0/3769479524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4520159c60 0x7f452015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:00:27.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.906+0000 7f452639c700 1 --2- 172.21.15.71:0/3769479524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f452015db10 0x7f4520069560 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f4518009f20 tx=0x7f4518009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c281cfaaa6f3d47 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:27.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.907+0000 7f4524b99700 1 -- 172.21.15.71:0/3769479524 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451800e070 con 0x7f452015db10 2023-10-09T07:00:27.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.907+0000 7f4524b99700 1 -- 172.21.15.71:0/3769479524 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451800ba80 con 0x7f452015db10 2023-10-09T07:00:27.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.907+0000 7f4524b99700 1 -- 172.21.15.71:0/3769479524 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45180092e0 con 0x7f452015db10 2023-10-09T07:00:27.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.907+0000 7f4527dff700 1 -- 172.21.15.71:0/3769479524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f452015db10 msgr2=0x7f4520069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:27.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.907+0000 7f4527dff700 1 --2- 172.21.15.71:0/3769479524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f452015db10 0x7f4520069560 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f4518009f20 tx=0x7f4518009840 comp rx=0 tx=0).stop 2023-10-09T07:00:27.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.907+0000 7f4527dff700 1 -- 172.21.15.71:0/3769479524 shutdown_connections 2023-10-09T07:00:27.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.907+0000 7f4527dff700 1 --2- 172.21.15.71:0/3769479524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f452015db10 0x7f4520069560 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.907+0000 7f4527dff700 1 --2- 172.21.15.71:0/3769479524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4520159c60 0x7f452015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.907+0000 7f4527dff700 1 -- 172.21.15.71:0/3769479524 >> 172.21.15.71:0/3769479524 conn(0x7f4520068e20 msgr2=0x7f45200d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:27.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.907+0000 7f4527dff700 1 -- 172.21.15.71:0/3769479524 shutdown_connections 2023-10-09T07:00:27.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.907+0000 7f4527dff700 1 -- 172.21.15.71:0/3769479524 wait complete. 2023-10-09T07:00:27.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.909+0000 7f4527dff700 1 Processor -- start 2023-10-09T07:00:27.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.909+0000 7f4527dff700 1 -- start start 2023-10-09T07:00:27.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.910+0000 7f4527dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4520159890 0x7f45200cf630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:27.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.910+0000 7f4527dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4520159c60 0x7f45200cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:27.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.910+0000 7f4527dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f452015db10 0x7f45200cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:27.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.910+0000 7f4527dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45200b0f80 con 0x7f4520159890 2023-10-09T07:00:27.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.910+0000 7f4527dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452014cba0 con 0x7f452015db10 2023-10-09T07:00:27.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.910+0000 7f4527dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45200b1d80 con 0x7f4520159c60 2023-10-09T07:00:27.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.910+0000 7f4525b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4520159890 0x7f45200cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:27.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.910+0000 7f4525b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4520159890 0x7f45200cf630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44402/0 (socket says 172.21.15.71:44402) 2023-10-09T07:00:27.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.910+0000 7f4525b9b700 1 -- 172.21.15.71:0/2565723082 learned_addr learned my addr 172.21.15.71:0/2565723082 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.910+0000 7f452639c700 1 --2- 172.21.15.71:0/2565723082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f452015db10 0x7f45200cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.910+0000 7f452539a700 1 --2- 172.21.15.71:0/2565723082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4520159c60 0x7f45200cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.910+0000 7f4525b9b700 1 -- 172.21.15.71:0/2565723082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4520159c60 msgr2=0x7f45200cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.910+0000 7f4525b9b700 1 --2- 172.21.15.71:0/2565723082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4520159c60 0x7f45200cfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.910+0000 7f4525b9b700 1 -- 172.21.15.71:0/2565723082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f452015db10 msgr2=0x7f45200cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.910+0000 7f4525b9b700 1 --2- 172.21.15.71:0/2565723082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f452015db10 0x7f45200cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.910+0000 7f4525b9b700 1 -- 172.21.15.71:0/2565723082 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4518009ae0 con 0x7f4520159890 2023-10-09T07:00:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.911+0000 7f4525b9b700 1 --2- 172.21.15.71:0/2565723082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4520159890 0x7f45200cf630 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f451c00c590 tx=0x7f451c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.911+0000 7f4515ffb700 1 -- 172.21.15.71:0/2565723082 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c011590 con 0x7f4520159890 2023-10-09T07:00:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.911+0000 7f4515ffb700 1 -- 172.21.15.71:0/2565723082 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451c0116f0 con 0x7f4520159890 2023-10-09T07:00:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.911+0000 7f4515ffb700 1 -- 172.21.15.71:0/2565723082 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c011ab0 con 0x7f4520159890 2023-10-09T07:00:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.911+0000 7f4527dff700 1 -- 172.21.15.71:0/2565723082 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45200b2680 con 0x7f4520159890 2023-10-09T07:00:27.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.911+0000 7f4527dff700 1 -- 172.21.15.71:0/2565723082 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45200b1170 con 0x7f4520159890 2023-10-09T07:00:27.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.912+0000 7f4527dff700 1 -- 172.21.15.71:0/2565723082 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f452004c3c0 con 0x7f4520159890 2023-10-09T07:00:27.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.913+0000 7f4515ffb700 1 -- 172.21.15.71:0/2565723082 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f451c01b3b0 con 0x7f4520159890 2023-10-09T07:00:27.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.914+0000 7f4515ffb700 1 --2- 172.21.15.71:0/2565723082 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4504066f30 0x7f45040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:27.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.914+0000 7f4515ffb700 1 -- 172.21.15.71:0/2565723082 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f451c083870 con 0x7f4520159890 2023-10-09T07:00:27.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.914+0000 7f452539a700 1 --2- 172.21.15.71:0/2565723082 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4504066f30 0x7f45040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:27.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.915+0000 7f452539a700 1 --2- 172.21.15.71:0/2565723082 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4504066f30 0x7f45040693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4510006f00 tx=0x7f4510008040 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:27.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:27.918+0000 7f4515ffb700 1 -- 172.21.15.71:0/2565723082 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f451c050cb0 con 0x7f4520159890 2023-10-09T07:00:28.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.105+0000 7f4527dff700 1 -- 172.21.15.71:0/2565723082 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f452014cd40 con 0x7f4520159890 2023-10-09T07:00:28.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.106+0000 7f4515ffb700 1 -- 172.21.15.71:0/2565723082 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v119) v1 ==== 93+0+10 (secure 0 0 0) 0x7f451c017020 con 0x7f4520159890 2023-10-09T07:00:28.107 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T07:00:28.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.108+0000 7f4527dff700 1 -- 172.21.15.71:0/2565723082 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4504066f30 msgr2=0x7f45040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:28.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.108+0000 7f4527dff700 1 --2- 172.21.15.71:0/2565723082 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4504066f30 0x7f45040693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4510006f00 tx=0x7f4510008040 comp rx=0 tx=0).stop 2023-10-09T07:00:28.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.108+0000 7f4527dff700 1 -- 172.21.15.71:0/2565723082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4520159890 msgr2=0x7f45200cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:28.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.108+0000 7f4527dff700 1 --2- 172.21.15.71:0/2565723082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4520159890 0x7f45200cf630 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f451c00c590 tx=0x7f451c00c950 comp rx=0 tx=0).stop 2023-10-09T07:00:28.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.108+0000 7f4527dff700 1 -- 172.21.15.71:0/2565723082 shutdown_connections 2023-10-09T07:00:28.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.108+0000 7f4527dff700 1 --2- 172.21.15.71:0/2565723082 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4504066f30 0x7f45040693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:28.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.108+0000 7f4527dff700 1 --2- 172.21.15.71:0/2565723082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f452015db10 0x7f45200cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:28.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.108+0000 7f4527dff700 1 --2- 172.21.15.71:0/2565723082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4520159890 0x7f45200cf630 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:28.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.108+0000 7f4527dff700 1 --2- 172.21.15.71:0/2565723082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4520159c60 0x7f45200cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:28.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.108+0000 7f4527dff700 1 -- 172.21.15.71:0/2565723082 >> 172.21.15.71:0/2565723082 conn(0x7f4520068e20 msgr2=0x7f452014d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:28.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.108+0000 7f4527dff700 1 -- 172.21.15.71:0/2565723082 shutdown_connections 2023-10-09T07:00:28.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.108+0000 7f4527dff700 1 -- 172.21.15.71:0/2565723082 wait complete. 2023-10-09T07:00:28.127 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T07:00:28.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.307+0000 7efdc4bff700 1 Processor -- start 2023-10-09T07:00:28.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.307+0000 7efdc4bff700 1 -- start start 2023-10-09T07:00:28.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.309+0000 7efdc4bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7efdc00cbf30 0x7efdc00ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:28.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.309+0000 7efdc4bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc00ccf90 0x7efdc00b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:28.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.309+0000 7efdc4bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efdc015a270 0x7efdc00b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:28.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.309+0000 7efdc4bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc0156bf0 con 0x7efdc00cbf30 2023-10-09T07:00:28.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.309+0000 7efdc4bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc00ae950 con 0x7efdc015a270 2023-10-09T07:00:28.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.309+0000 7efdc4bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc00cc300 con 0x7efdc00ccf90 2023-10-09T07:00:28.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.309+0000 7efdbe59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7efdc00cbf30 0x7efdc00ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:28.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.309+0000 7efdbe59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7efdc00cbf30 0x7efdc00ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44414/0 (socket says 172.21.15.71:44414) 2023-10-09T07:00:28.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.309+0000 7efdbe59c700 1 -- 172.21.15.71:0/655822464 learned_addr learned my addr 172.21.15.71:0/655822464 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:28.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.309+0000 7efdb7fff700 1 --2- 172.21.15.71:0/655822464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc00ccf90 0x7efdc00b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:28.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.309+0000 7efdbed9d700 1 --2- 172.21.15.71:0/655822464 >> v2:172.21.15.179:3300/0 conn(0x7efdc015a270 0x7efdc00b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:28.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.309+0000 7efdbe59c700 1 -- 172.21.15.71:0/655822464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc00ccf90 msgr2=0x7efdc00b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:28.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.309+0000 7efdbe59c700 1 --2- 172.21.15.71:0/655822464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc00ccf90 0x7efdc00b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:28.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.309+0000 7efdbe59c700 1 -- 172.21.15.71:0/655822464 >> v2:172.21.15.179:3300/0 conn(0x7efdc015a270 msgr2=0x7efdc00b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:28.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.309+0000 7efdbe59c700 1 --2- 172.21.15.71:0/655822464 >> v2:172.21.15.179:3300/0 conn(0x7efdc015a270 0x7efdc00b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:28.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.309+0000 7efdbe59c700 1 -- 172.21.15.71:0/655822464 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc00ad370 con 0x7efdc00cbf30 2023-10-09T07:00:28.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.309+0000 7efdbed9d700 1 --2- 172.21.15.71:0/655822464 >> v2:172.21.15.179:3300/0 conn(0x7efdc015a270 0x7efdc00b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:00:28.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.310+0000 7efdbe59c700 1 --2- 172.21.15.71:0/655822464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdc00cbf30 0x7efdc00ae410 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7efdc00b25e0 tx=0x7efdb000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e43c9534fb0f55 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:28.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.310+0000 7efdbdd9b700 1 -- 172.21.15.71:0/655822464 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb000dbb0 con 0x7efdc00cbf30 2023-10-09T07:00:28.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.310+0000 7efdbdd9b700 1 -- 172.21.15.71:0/655822464 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb000dd10 con 0x7efdc00cbf30 2023-10-09T07:00:28.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.310+0000 7efdbdd9b700 1 -- 172.21.15.71:0/655822464 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb00196b0 con 0x7efdc00cbf30 2023-10-09T07:00:28.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.310+0000 7efdc4bff700 1 -- 172.21.15.71:0/655822464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdc00cbf30 msgr2=0x7efdc00ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:28.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.310+0000 7efdc4bff700 1 --2- 172.21.15.71:0/655822464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdc00cbf30 0x7efdc00ae410 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7efdc00b25e0 tx=0x7efdb000b4f0 comp rx=0 tx=0).stop 2023-10-09T07:00:28.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.310+0000 7efdc4bff700 1 -- 172.21.15.71:0/655822464 shutdown_connections 2023-10-09T07:00:28.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.310+0000 7efdc4bff700 1 --2- 172.21.15.71:0/655822464 >> v2:172.21.15.179:3300/0 conn(0x7efdc015a270 0x7efdc00b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:28.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.311+0000 7efdc4bff700 1 --2- 172.21.15.71:0/655822464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdc00cbf30 0x7efdc00ae410 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:28.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.311+0000 7efdc4bff700 1 --2- 172.21.15.71:0/655822464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc00ccf90 0x7efdc00b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:28.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.311+0000 7efdc4bff700 1 -- 172.21.15.71:0/655822464 >> 172.21.15.71:0/655822464 conn(0x7efdc006a320 msgr2=0x7efdc00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:28.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.311+0000 7efdc4bff700 1 -- 172.21.15.71:0/655822464 shutdown_connections 2023-10-09T07:00:28.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.311+0000 7efdc4bff700 1 -- 172.21.15.71:0/655822464 wait complete. 2023-10-09T07:00:28.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.312+0000 7efdc4bff700 1 Processor -- start 2023-10-09T07:00:28.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.312+0000 7efdc4bff700 1 -- start start 2023-10-09T07:00:28.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.313+0000 7efdc4bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc00cbf30 0x7efdc01560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:28.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.313+0000 7efdc4bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdc00ccf90 0x7efdc00cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:28.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.313+0000 7efdc4bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc015a270 0x7efdc00cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:28.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.313+0000 7efdc4bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc015ecd0 con 0x7efdc00ccf90 2023-10-09T07:00:28.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.313+0000 7efdc4bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc015e100 con 0x7efdc015a270 2023-10-09T07:00:28.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.313+0000 7efdc4bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc015e3a0 con 0x7efdc00cbf30 2023-10-09T07:00:28.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.313+0000 7efdb7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdc00ccf90 0x7efdc00cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:28.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.313+0000 7efdb7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdc00ccf90 0x7efdc00cad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44416/0 (socket says 172.21.15.71:44416) 2023-10-09T07:00:28.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.313+0000 7efdb7fff700 1 -- 172.21.15.71:0/4132238130 learned_addr learned my addr 172.21.15.71:0/4132238130 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:28.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.314+0000 7efdbe59c700 1 --2- 172.21.15.71:0/4132238130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc00cbf30 0x7efdc01560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:28.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.314+0000 7efdbed9d700 1 --2- 172.21.15.71:0/4132238130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc015a270 0x7efdc00cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:28.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.314+0000 7efdb7fff700 1 -- 172.21.15.71:0/4132238130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc00cbf30 msgr2=0x7efdc01560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:28.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.314+0000 7efdb7fff700 1 --2- 172.21.15.71:0/4132238130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc00cbf30 0x7efdc01560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:28.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.314+0000 7efdb7fff700 1 -- 172.21.15.71:0/4132238130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc015a270 msgr2=0x7efdc00cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:28.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.314+0000 7efdb7fff700 1 --2- 172.21.15.71:0/4132238130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc015a270 0x7efdc00cb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:28.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.314+0000 7efdb7fff700 1 -- 172.21.15.71:0/4132238130 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb000b790 con 0x7efdc00ccf90 2023-10-09T07:00:28.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.314+0000 7efdbed9d700 1 --2- 172.21.15.71:0/4132238130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc015a270 0x7efdc00cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:00:28.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.314+0000 7efdb7fff700 1 --2- 172.21.15.71:0/4132238130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdc00ccf90 0x7efdc00cad40 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7efda800ec80 tx=0x7efda80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:28.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.314+0000 7efdb67fc700 1 -- 172.21.15.71:0/4132238130 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda800c850 con 0x7efdc00ccf90 2023-10-09T07:00:28.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.314+0000 7efdb67fc700 1 -- 172.21.15.71:0/4132238130 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda800c9d0 con 0x7efdc00ccf90 2023-10-09T07:00:28.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.314+0000 7efdb67fc700 1 -- 172.21.15.71:0/4132238130 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda800cd90 con 0x7efdc00ccf90 2023-10-09T07:00:28.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.314+0000 7efdc4bff700 1 -- 172.21.15.71:0/4132238130 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc015e680 con 0x7efdc00ccf90 2023-10-09T07:00:28.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.314+0000 7efdc4bff700 1 -- 172.21.15.71:0/4132238130 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc0156630 con 0x7efdc00ccf90 2023-10-09T07:00:28.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.316+0000 7efdc4bff700 1 -- 172.21.15.71:0/4132238130 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc015ee80 con 0x7efdc00ccf90 2023-10-09T07:00:28.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.316+0000 7efdb67fc700 1 -- 172.21.15.71:0/4132238130 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efda8013680 con 0x7efdc00ccf90 2023-10-09T07:00:28.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.317+0000 7efdb67fc700 1 --2- 172.21.15.71:0/4132238130 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efda0066f30 0x7efda00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:28.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.317+0000 7efdb67fc700 1 -- 172.21.15.71:0/4132238130 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5245+0+0 (secure 0 0 0) 0x7efda8084650 con 0x7efdc00ccf90 2023-10-09T07:00:28.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.317+0000 7efdbe59c700 1 --2- 172.21.15.71:0/4132238130 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efda0066f30 0x7efda00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:28.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.318+0000 7efdbe59c700 1 --2- 172.21.15.71:0/4132238130 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efda0066f30 0x7efda00693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efdc00b25e0 tx=0x7efdb001b000 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:28.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.321+0000 7efdb67fc700 1 -- 172.21.15.71:0/4132238130 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efdc015ee80 con 0x7efdc00ccf90 2023-10-09T07:00:28.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.513+0000 7efdc4bff700 1 -- 172.21.15.71:0/4132238130 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efdc004c3c0 con 0x7efdc00ccf90 2023-10-09T07:00:28.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.514+0000 7efdb67fc700 1 -- 172.21.15.71:0/4132238130 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v119) v1 ==== 84+0+65 (secure 0 0 0) 0x7efda8051a90 con 0x7efdc00ccf90 2023-10-09T07:00:28.515 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:00:28.515 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-09T07:00:28.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:00:28.515 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 1, 2023-10-09T07:00:28.515 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": ".mgr" 2023-10-09T07:00:28.515 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:00:28.516 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-09T07:00:28.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.516+0000 7efdc4bff700 1 -- 172.21.15.71:0/4132238130 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efda0066f30 msgr2=0x7efda00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:28.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.516+0000 7efdc4bff700 1 --2- 172.21.15.71:0/4132238130 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efda0066f30 0x7efda00693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efdc00b25e0 tx=0x7efdb001b000 comp rx=0 tx=0).stop 2023-10-09T07:00:28.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.516+0000 7efdc4bff700 1 -- 172.21.15.71:0/4132238130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdc00ccf90 msgr2=0x7efdc00cad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:28.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.516+0000 7efdc4bff700 1 --2- 172.21.15.71:0/4132238130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdc00ccf90 0x7efdc00cad40 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7efda800ec80 tx=0x7efda80091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:28.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.516+0000 7efdc4bff700 1 -- 172.21.15.71:0/4132238130 shutdown_connections 2023-10-09T07:00:28.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.516+0000 7efdc4bff700 1 --2- 172.21.15.71:0/4132238130 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efda0066f30 0x7efda00693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:28.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.516+0000 7efdc4bff700 1 --2- 172.21.15.71:0/4132238130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc015a270 0x7efdc00cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:28.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.516+0000 7efdc4bff700 1 --2- 172.21.15.71:0/4132238130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc00cbf30 0x7efdc01560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:28.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.516+0000 7efdc4bff700 1 --2- 172.21.15.71:0/4132238130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdc00ccf90 0x7efdc00cad40 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:28.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.516+0000 7efdc4bff700 1 -- 172.21.15.71:0/4132238130 >> 172.21.15.71:0/4132238130 conn(0x7efdc006a320 msgr2=0x7efdc00cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:28.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.516+0000 7efdc4bff700 1 -- 172.21.15.71:0/4132238130 shutdown_connections 2023-10-09T07:00:28.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.516+0000 7efdc4bff700 1 -- 172.21.15.71:0/4132238130 wait complete. 2023-10-09T07:00:28.535 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T07:00:28.535 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T07:00:28.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.717+0000 7f68ba99d700 1 Processor -- start 2023-10-09T07:00:28.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.717+0000 7f68ba99d700 1 -- start start 2023-10-09T07:00:28.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.718+0000 7f68ba99d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f68b4153850 0x7f68b41596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:28.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.719+0000 7f68ba99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68b4159bf0 0x7f68b4157280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:28.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.719+0000 7f68ba99d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b415a480 con 0x7f68b4153480 2023-10-09T07:00:28.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.719+0000 7f68ba99d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b415a070 con 0x7f68b4153850 2023-10-09T07:00:28.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.719+0000 7f68ba99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b40afb40 con 0x7f68b4159bf0 2023-10-09T07:00:28.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.719+0000 7f68b919a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f68b4153850 0x7f68b41596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:28.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.719+0000 7f68ba19c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68b4159bf0 0x7f68b4157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:28.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.719+0000 7f68ba19c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68b4159bf0 0x7f68b4157280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:45590/0 (socket says 172.21.15.71:45590) 2023-10-09T07:00:28.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.719+0000 7f68ba19c700 1 -- 172.21.15.71:0/1523924996 learned_addr learned my addr 172.21.15.71:0/1523924996 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:28.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.719+0000 7f68b999b700 1 --1- 172.21.15.71:0/1523924996 >> v1:172.21.15.179:6789/0 conn(0x7f68b4153480 0x7f68b40ae750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:42890/0 (socket says 172.21.15.71:42890) 2023-10-09T07:00:28.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.719+0000 7f68ba19c700 1 -- 172.21.15.71:0/1523924996 >> v2:172.21.15.179:3300/0 conn(0x7f68b4153850 msgr2=0x7f68b41596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.719+0000 7f68ba19c700 1 --2- 172.21.15.71:0/1523924996 >> v2:172.21.15.179:3300/0 conn(0x7f68b4153850 0x7f68b41596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.719+0000 7f68ba19c700 1 -- 172.21.15.71:0/1523924996 >> v1:172.21.15.179:6789/0 conn(0x7f68b4153480 legacy=0x7f68b40ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.719+0000 7f68ba19c700 1 -- 172.21.15.71:0/1523924996 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b40afe20 con 0x7f68b4159bf0 2023-10-09T07:00:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.719+0000 7f68b8999700 1 -- 172.21.15.71:0/1523924996 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2796884771 0 0) 0x7f68b415a480 con 0x7f68b4153480 2023-10-09T07:00:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.720+0000 7f68ba19c700 1 --2- 172.21.15.71:0/1523924996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68b4159bf0 0x7f68b4157280 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00d1a0 tx=0x7f68ac00ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20db012910e6f5da server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.720+0000 7f68b8999700 1 -- 172.21.15.71:0/1523924996 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac010070 con 0x7f68b4159bf0 2023-10-09T07:00:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.720+0000 7f68b8999700 1 -- 172.21.15.71:0/1523924996 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ac00de10 con 0x7f68b4159bf0 2023-10-09T07:00:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.720+0000 7f68b8999700 1 -- 172.21.15.71:0/1523924996 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac00b320 con 0x7f68b4159bf0 2023-10-09T07:00:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.720+0000 7f68ba99d700 1 -- 172.21.15.71:0/1523924996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68b4159bf0 msgr2=0x7f68b4157280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:28.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.720+0000 7f68ba99d700 1 --2- 172.21.15.71:0/1523924996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68b4159bf0 0x7f68b4157280 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00d1a0 tx=0x7f68ac00ba50 comp rx=0 tx=0).stop 2023-10-09T07:00:28.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.721+0000 7f68ba99d700 1 -- 172.21.15.71:0/1523924996 shutdown_connections 2023-10-09T07:00:28.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.721+0000 7f68ba99d700 1 --2- 172.21.15.71:0/1523924996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68b4159bf0 0x7f68b4157280 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:28.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.721+0000 7f68ba99d700 1 --2- 172.21.15.71:0/1523924996 >> v2:172.21.15.179:3300/0 conn(0x7f68b4153850 0x7f68b41596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:28.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.721+0000 7f68ba99d700 1 -- 172.21.15.71:0/1523924996 >> 172.21.15.71:0/1523924996 conn(0x7f68b4068e20 msgr2=0x7f68b40cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:28.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.721+0000 7f68ba99d700 1 -- 172.21.15.71:0/1523924996 shutdown_connections 2023-10-09T07:00:28.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.721+0000 7f68ba99d700 1 -- 172.21.15.71:0/1523924996 wait complete. 2023-10-09T07:00:28.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.722+0000 7f68ba99d700 1 Processor -- start 2023-10-09T07:00:28.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.722+0000 7f68ba99d700 1 -- start start 2023-10-09T07:00:28.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.723+0000 7f68ba99d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68b4153480 0x7f68b4151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:28.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.723+0000 7f68ba99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68b4153850 0x7f68b415afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:28.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.723+0000 7f68ba99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68b4159bf0 0x7f68b40c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:28.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.723+0000 7f68ba99d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b40cb830 con 0x7f68b4153480 2023-10-09T07:00:28.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.723+0000 7f68ba99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b4152280 con 0x7f68b4153850 2023-10-09T07:00:28.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.723+0000 7f68ba99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b40cac20 con 0x7f68b4159bf0 2023-10-09T07:00:28.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.723+0000 7f68b999b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68b4153480 0x7f68b4151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:28.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.723+0000 7f68b999b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68b4153480 0x7f68b4151d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44418/0 (socket says 172.21.15.71:44418) 2023-10-09T07:00:28.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.723+0000 7f68b999b700 1 -- 172.21.15.71:0/150351324 learned_addr learned my addr 172.21.15.71:0/150351324 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:28.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.723+0000 7f68ba19c700 1 --2- 172.21.15.71:0/150351324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68b4159bf0 0x7f68b40c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:28.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.724+0000 7f68b919a700 1 --2- 172.21.15.71:0/150351324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68b4153850 0x7f68b415afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:28.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.724+0000 7f68b999b700 1 -- 172.21.15.71:0/150351324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68b4159bf0 msgr2=0x7f68b40c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:28.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.724+0000 7f68b999b700 1 --2- 172.21.15.71:0/150351324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68b4159bf0 0x7f68b40c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:28.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.724+0000 7f68b999b700 1 -- 172.21.15.71:0/150351324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68b4153850 msgr2=0x7f68b415afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:28.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.724+0000 7f68b999b700 1 --2- 172.21.15.71:0/150351324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68b4153850 0x7f68b415afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:28.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.724+0000 7f68b999b700 1 -- 172.21.15.71:0/150351324 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac00bcf0 con 0x7f68b4153480 2023-10-09T07:00:28.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.724+0000 7f68b999b700 1 --2- 172.21.15.71:0/150351324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68b4153480 0x7f68b4151d40 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f68b00011e0 tx=0x7f68b0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:28.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.724+0000 7f68a9ffb700 1 -- 172.21.15.71:0/150351324 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0005a70 con 0x7f68b4153480 2023-10-09T07:00:28.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.724+0000 7f68a9ffb700 1 -- 172.21.15.71:0/150351324 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b0005bd0 con 0x7f68b4153480 2023-10-09T07:00:28.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.724+0000 7f68ba99d700 1 -- 172.21.15.71:0/150351324 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b40caf00 con 0x7f68b4153480 2023-10-09T07:00:28.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.724+0000 7f68a9ffb700 1 -- 172.21.15.71:0/150351324 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b00070d0 con 0x7f68b4153480 2023-10-09T07:00:28.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.724+0000 7f68ba99d700 1 -- 172.21.15.71:0/150351324 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b40cb4c0 con 0x7f68b4153480 2023-10-09T07:00:28.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.725+0000 7f68ba99d700 1 -- 172.21.15.71:0/150351324 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b404c3c0 con 0x7f68b4153480 2023-10-09T07:00:28.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.726+0000 7f68a9ffb700 1 -- 172.21.15.71:0/150351324 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f68b00074c0 con 0x7f68b4153480 2023-10-09T07:00:28.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.727+0000 7f68a9ffb700 1 --2- 172.21.15.71:0/150351324 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6898066f30 0x7f68980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:28.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.727+0000 7f68a9ffb700 1 -- 172.21.15.71:0/150351324 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f68b0083790 con 0x7f68b4153480 2023-10-09T07:00:28.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.727+0000 7f68b919a700 1 --2- 172.21.15.71:0/150351324 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6898066f30 0x7f68980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:28.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.728+0000 7f68b919a700 1 --2- 172.21.15.71:0/150351324 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6898066f30 0x7f68980693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f68b4158a90 tx=0x7f68a40091a0 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:28.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.731+0000 7f68a9ffb700 1 -- 172.21.15.71:0/150351324 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68b0050bd0 con 0x7f68b4153480 2023-10-09T07:00:28.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:28.925+0000 7f68ba99d700 1 -- 172.21.15.71:0/150351324 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f68b40b0100 con 0x7f68b4153480 2023-10-09T07:00:29.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:29.833+0000 7f68a9ffb700 1 -- 172.21.15.71:0/150351324 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v120) v1 ==== 138+0+0 (secure 0 0 0) 0x7f68b00170b0 con 0x7f68b4153480 2023-10-09T07:00:29.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:29.838+0000 7f68ba99d700 1 -- 172.21.15.71:0/150351324 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6898066f30 msgr2=0x7f68980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:29.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:29.838+0000 7f68ba99d700 1 --2- 172.21.15.71:0/150351324 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6898066f30 0x7f68980693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f68b4158a90 tx=0x7f68a40091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:29.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:29.838+0000 7f68ba99d700 1 -- 172.21.15.71:0/150351324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68b4153480 msgr2=0x7f68b4151d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:29.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:29.838+0000 7f68ba99d700 1 --2- 172.21.15.71:0/150351324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68b4153480 0x7f68b4151d40 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f68b00011e0 tx=0x7f68b0007e10 comp rx=0 tx=0).stop 2023-10-09T07:00:29.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:29.839+0000 7f68ba99d700 1 -- 172.21.15.71:0/150351324 shutdown_connections 2023-10-09T07:00:29.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:29.839+0000 7f68ba99d700 1 --2- 172.21.15.71:0/150351324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68b4159bf0 0x7f68b40c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:29.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:29.839+0000 7f68ba99d700 1 --2- 172.21.15.71:0/150351324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68b4153480 0x7f68b4151d40 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:29.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:29.839+0000 7f68ba99d700 1 --2- 172.21.15.71:0/150351324 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6898066f30 0x7f68980693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:29.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:29.839+0000 7f68ba99d700 1 --2- 172.21.15.71:0/150351324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68b4153850 0x7f68b415afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:29.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:29.839+0000 7f68ba99d700 1 -- 172.21.15.71:0/150351324 >> 172.21.15.71:0/150351324 conn(0x7f68b4068e20 msgr2=0x7f68b406ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:29.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:29.839+0000 7f68ba99d700 1 -- 172.21.15.71:0/150351324 shutdown_connections 2023-10-09T07:00:29.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:29.839+0000 7f68ba99d700 1 -- 172.21.15.71:0/150351324 wait complete. 2023-10-09T07:00:29.843 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' created 2023-10-09T07:00:29.861 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T07:00:30.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.050+0000 7f79e679d700 1 Processor -- start 2023-10-09T07:00:30.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.050+0000 7f79e679d700 1 -- start start 2023-10-09T07:00:30.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.052+0000 7f79e679d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f79e01563b0 0x7f79e00ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:30.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.052+0000 7f79e679d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e00ae9c0 0x7f79e00cad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:30.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.052+0000 7f79e679d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e00cbe50 con 0x7f79e0156780 2023-10-09T07:00:30.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.052+0000 7f79e679d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e00cb370 con 0x7f79e01563b0 2023-10-09T07:00:30.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.052+0000 7f79e679d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e00cb650 con 0x7f79e00ae9c0 2023-10-09T07:00:30.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.052+0000 7f79e4f9a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f79e0156780 0x7f79e00ae2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35688/0 (socket says 172.21.15.71:35688) 2023-10-09T07:00:30.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.052+0000 7f79e4f9a700 1 -- 172.21.15.71:0/4030772799 learned_addr learned my addr 172.21.15.71:0/4030772799 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:30.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.052+0000 7f79e579b700 1 --2- 172.21.15.71:0/4030772799 >> v2:172.21.15.179:3300/0 conn(0x7f79e01563b0 0x7f79e00ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:30.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.052+0000 7f79e5f9c700 1 --2- 172.21.15.71:0/4030772799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e00ae9c0 0x7f79e00cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:30.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.052+0000 7f79d7fff700 1 -- 172.21.15.71:0/4030772799 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137822000 0 0) 0x7f79e00cbe50 con 0x7f79e0156780 2023-10-09T07:00:30.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.053+0000 7f79d7fff700 1 -- 172.21.15.71:0/4030772799 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79cc003570 con 0x7f79e0156780 2023-10-09T07:00:30.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.053+0000 7f79d7fff700 1 -- 172.21.15.71:0/4030772799 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1532087416 0 0) 0x7f79cc003570 con 0x7f79e0156780 2023-10-09T07:00:30.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.053+0000 7f79d7fff700 1 -- 172.21.15.71:0/4030772799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e00ae9c0 msgr2=0x7f79e00cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:30.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.053+0000 7f79d7fff700 1 --2- 172.21.15.71:0/4030772799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e00ae9c0 0x7f79e00cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:30.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.053+0000 7f79d7fff700 1 -- 172.21.15.71:0/4030772799 >> v2:172.21.15.179:3300/0 conn(0x7f79e01563b0 msgr2=0x7f79e00ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:30.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.053+0000 7f79d7fff700 1 --2- 172.21.15.71:0/4030772799 >> v2:172.21.15.179:3300/0 conn(0x7f79e01563b0 0x7f79e00ca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:30.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.053+0000 7f79d7fff700 1 -- 172.21.15.71:0/4030772799 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e00c6860 con 0x7f79e0156780 2023-10-09T07:00:30.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.053+0000 7f79d7fff700 1 -- 172.21.15.71:0/4030772799 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f79d0001470 con 0x7f79e0156780 2023-10-09T07:00:30.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.053+0000 7f79d7fff700 1 -- 172.21.15.71:0/4030772799 >> v1:172.21.15.71:6789/0 conn(0x7f79e0156780 legacy=0x7f79e00ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:30.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.053+0000 7f79d7fff700 1 --2- 172.21.15.71:0/4030772799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79cc003a60 0x7f79cc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:30.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.053+0000 7f79d7fff700 1 --2- 172.21.15.71:0/4030772799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e00ae9c0 0x7f79cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:30.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.053+0000 7f79d7fff700 1 --2- 172.21.15.71:0/4030772799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79cc004d50 0x7f79cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:30.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.053+0000 7f79d7fff700 1 -- 172.21.15.71:0/4030772799 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e00cb370 con 0x7f79cc004d50 2023-10-09T07:00:30.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.053+0000 7f79d7fff700 1 -- 172.21.15.71:0/4030772799 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e00cb650 con 0x7f79cc003a60 2023-10-09T07:00:30.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.053+0000 7f79d7fff700 1 -- 172.21.15.71:0/4030772799 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc00dc70 con 0x7f79e00ae9c0 2023-10-09T07:00:30.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.053+0000 7f79e579b700 1 --2- 172.21.15.71:0/4030772799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79cc003a60 0x7f79cc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:30.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.053+0000 7f79e5f9c700 1 --2- 172.21.15.71:0/4030772799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79cc004d50 0x7f79cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:30.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.053+0000 7f79e4f9a700 1 --2- 172.21.15.71:0/4030772799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e00ae9c0 0x7f79cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:30.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.054+0000 7f79e579b700 1 -- 172.21.15.71:0/4030772799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e00ae9c0 msgr2=0x7f79cc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:30.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.054+0000 7f79e579b700 1 --2- 172.21.15.71:0/4030772799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e00ae9c0 0x7f79cc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:30.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.054+0000 7f79e579b700 1 -- 172.21.15.71:0/4030772799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79cc004d50 msgr2=0x7f79cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:30.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.054+0000 7f79e579b700 1 --2- 172.21.15.71:0/4030772799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79cc004d50 0x7f79cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:30.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.054+0000 7f79e579b700 1 -- 172.21.15.71:0/4030772799 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79cc003570 con 0x7f79cc003a60 2023-10-09T07:00:30.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.054+0000 7f79e5f9c700 1 --2- 172.21.15.71:0/4030772799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79cc004d50 0x7f79cc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:00:30.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.054+0000 7f79e579b700 1 --2- 172.21.15.71:0/4030772799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79cc003a60 0x7f79cc003e70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009c00 tx=0x7f79dc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9525731746baafd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:30.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.054+0000 7f79d7fff700 1 -- 172.21.15.71:0/4030772799 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc00e710 con 0x7f79cc003a60 2023-10-09T07:00:30.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.054+0000 7f79d7fff700 1 -- 172.21.15.71:0/4030772799 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc00e870 con 0x7f79cc003a60 2023-10-09T07:00:30.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.054+0000 7f79d7fff700 1 -- 172.21.15.71:0/4030772799 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc00ec30 con 0x7f79cc003a60 2023-10-09T07:00:30.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.055+0000 7f79e679d700 1 -- 172.21.15.71:0/4030772799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79cc003a60 msgr2=0x7f79cc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:30.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.055+0000 7f79e679d700 1 --2- 172.21.15.71:0/4030772799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79cc003a60 0x7f79cc003e70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009c00 tx=0x7f79dc0091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:30.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.055+0000 7f79e5f9c700 1 -- 172.21.15.71:0/4030772799 reap_dead start 2023-10-09T07:00:30.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.055+0000 7f79e679d700 1 -- 172.21.15.71:0/4030772799 shutdown_connections 2023-10-09T07:00:30.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.055+0000 7f79e679d700 1 -- 172.21.15.71:0/4030772799 >> 172.21.15.71:0/4030772799 conn(0x7f79e0068e20 msgr2=0x7f79e00cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:30.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.055+0000 7f79e679d700 1 -- 172.21.15.71:0/4030772799 shutdown_connections 2023-10-09T07:00:30.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.055+0000 7f79e679d700 1 -- 172.21.15.71:0/4030772799 wait complete. 2023-10-09T07:00:30.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.056+0000 7f79e679d700 1 Processor -- start 2023-10-09T07:00:30.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.057+0000 7f79e679d700 1 -- start start 2023-10-09T07:00:30.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.057+0000 7f79e679d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79cc003a60 0x7f79e0169970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:30.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.057+0000 7f79e679d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79e0149c60 0x7f79e0149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:30.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.057+0000 7f79e679d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e016d650 0x7f79e016dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:30.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.057+0000 7f79e679d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e016a930 con 0x7f79cc003a60 2023-10-09T07:00:30.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.057+0000 7f79e679d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e0169eb0 con 0x7f79e0149c60 2023-10-09T07:00:30.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.057+0000 7f79e679d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e016d1c0 con 0x7f79e016d650 2023-10-09T07:00:30.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.058+0000 7f79e579b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79cc003a60 0x7f79e0169970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:30.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.058+0000 7f79e579b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79cc003a60 0x7f79e0169970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44444/0 (socket says 172.21.15.71:44444) 2023-10-09T07:00:30.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.058+0000 7f79e579b700 1 -- 172.21.15.71:0/1991399562 learned_addr learned my addr 172.21.15.71:0/1991399562 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:30.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.058+0000 7f79e4f9a700 1 --2- 172.21.15.71:0/1991399562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79e0149c60 0x7f79e0149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:30.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.058+0000 7f79e5f9c700 1 --2- 172.21.15.71:0/1991399562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e016d650 0x7f79e016dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:30.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.058+0000 7f79e579b700 1 -- 172.21.15.71:0/1991399562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e016d650 msgr2=0x7f79e016dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:30.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.058+0000 7f79e579b700 1 --2- 172.21.15.71:0/1991399562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e016d650 0x7f79e016dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:30.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.058+0000 7f79e579b700 1 -- 172.21.15.71:0/1991399562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79e0149c60 msgr2=0x7f79e0149440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:30.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.058+0000 7f79e579b700 1 --2- 172.21.15.71:0/1991399562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79e0149c60 0x7f79e0149440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:30.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.058+0000 7f79e579b700 1 -- 172.21.15.71:0/1991399562 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e016a090 con 0x7f79cc003a60 2023-10-09T07:00:30.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.058+0000 7f79e5f9c700 1 --2- 172.21.15.71:0/1991399562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e016d650 0x7f79e016dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:00:30.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.058+0000 7f79e579b700 1 --2- 172.21.15.71:0/1991399562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79cc003a60 0x7f79e0169970 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f79dc013ef0 tx=0x7f79dc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:30.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.059+0000 7f79d57fa700 1 -- 172.21.15.71:0/1991399562 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc022070 con 0x7f79cc003a60 2023-10-09T07:00:30.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.059+0000 7f79d57fa700 1 -- 172.21.15.71:0/1991399562 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc00e9e0 con 0x7f79cc003a60 2023-10-09T07:00:30.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.059+0000 7f79e679d700 1 -- 172.21.15.71:0/1991399562 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e016a370 con 0x7f79cc003a60 2023-10-09T07:00:30.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.059+0000 7f79d57fa700 1 -- 172.21.15.71:0/1991399562 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc027470 con 0x7f79cc003a60 2023-10-09T07:00:30.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.059+0000 7f79e679d700 1 -- 172.21.15.71:0/1991399562 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e00b1ea0 con 0x7f79cc003a60 2023-10-09T07:00:30.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.060+0000 7f79e679d700 1 -- 172.21.15.71:0/1991399562 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e016cf90 con 0x7f79cc003a60 2023-10-09T07:00:30.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.061+0000 7f79d57fa700 1 -- 172.21.15.71:0/1991399562 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f79dc01c450 con 0x7f79cc003a60 2023-10-09T07:00:30.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.062+0000 7f79d57fa700 1 --2- 172.21.15.71:0/1991399562 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f79c4066f30 0x7f79c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:30.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.062+0000 7f79d57fa700 1 -- 172.21.15.71:0/1991399562 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5615+0+0 (secure 0 0 0) 0x7f79dc0861f0 con 0x7f79cc003a60 2023-10-09T07:00:30.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.062+0000 7f79e4f9a700 1 --2- 172.21.15.71:0/1991399562 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f79c4066f30 0x7f79c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:30.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.063+0000 7f79e4f9a700 1 --2- 172.21.15.71:0/1991399562 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f79c4066f30 0x7f79c40693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f79e0152f20 tx=0x7f79d0009040 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:30.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.066+0000 7f79d57fa700 1 -- 172.21.15.71:0/1991399562 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79dc053580 con 0x7f79cc003a60 2023-10-09T07:00:30.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.255+0000 7f79e679d700 1 -- 172.21.15.71:0/1991399562 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f79e016a890 con 0x7f79cc003a60 2023-10-09T07:00:30.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.842+0000 7f79d57fa700 1 -- 172.21.15.71:0/1991399562 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v121) v1 ==== 170+0+0 (secure 0 0 0) 0x7f79dc056b60 con 0x7f79cc003a60 2023-10-09T07:00:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.848+0000 7f79e679d700 1 -- 172.21.15.71:0/1991399562 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f79c4066f30 msgr2=0x7f79c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.848+0000 7f79e679d700 1 --2- 172.21.15.71:0/1991399562 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f79c4066f30 0x7f79c40693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f79e0152f20 tx=0x7f79d0009040 comp rx=0 tx=0).stop 2023-10-09T07:00:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.848+0000 7f79e679d700 1 -- 172.21.15.71:0/1991399562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79cc003a60 msgr2=0x7f79e0169970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.848+0000 7f79e679d700 1 --2- 172.21.15.71:0/1991399562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79cc003a60 0x7f79e0169970 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f79dc013ef0 tx=0x7f79dc01a000 comp rx=0 tx=0).stop 2023-10-09T07:00:30.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.856+0000 7f79e679d700 1 -- 172.21.15.71:0/1991399562 shutdown_connections 2023-10-09T07:00:30.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.856+0000 7f79e679d700 1 --2- 172.21.15.71:0/1991399562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e016d650 0x7f79e016dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.856+0000 7f79e679d700 1 --2- 172.21.15.71:0/1991399562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79cc003a60 0x7f79e0169970 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.856+0000 7f79e679d700 1 --2- 172.21.15.71:0/1991399562 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f79c4066f30 0x7f79c40693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.856+0000 7f79e679d700 1 --2- 172.21.15.71:0/1991399562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79e0149c60 0x7f79e0149440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.856+0000 7f79e679d700 1 -- 172.21.15.71:0/1991399562 >> 172.21.15.71:0/1991399562 conn(0x7f79e0068e20 msgr2=0x7f79e006a020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:30.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.858+0000 7f79e679d700 1 -- 172.21.15.71:0/1991399562 shutdown_connections 2023-10-09T07:00:30.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:30.859+0000 7f79e679d700 1 -- 172.21.15.71:0/1991399562 wait complete. 2023-10-09T07:00:30.863 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' created 2023-10-09T07:00:30.882 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T07:00:31.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.065+0000 7f82e1bff700 1 Processor -- start 2023-10-09T07:00:31.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.065+0000 7f82e1bff700 1 -- start start 2023-10-09T07:00:31.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.066+0000 7f82e1bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82dc0c70b0 0x7f82dc069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:31.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.066+0000 7f82e1bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f82dc069cb0 0x7f82dc0ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:31.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.066+0000 7f82e1bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82dc06e950 con 0x7f82dc155eb0 2023-10-09T07:00:31.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.066+0000 7f82e1bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82dc06a130 con 0x7f82dc069cb0 2023-10-09T07:00:31.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.066+0000 7f82e1bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc06eb90 con 0x7f82dc0c70b0 2023-10-09T07:00:31.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.067+0000 7f82db7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f82dc155eb0 0x7f82dc06e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35702/0 (socket says 172.21.15.71:35702) 2023-10-09T07:00:31.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.067+0000 7f82db7fe700 1 -- 172.21.15.71:0/926775164 learned_addr learned my addr 172.21.15.71:0/926775164 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:31.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.067+0000 7f82dbfff700 1 --2- 172.21.15.71:0/926775164 >> v2:172.21.15.71:3300/0 conn(0x7f82dc069cb0 0x7f82dc0ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:31.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.067+0000 7f82daffd700 1 --2- 172.21.15.71:0/926775164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82dc0c70b0 0x7f82dc069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:31.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.067+0000 7f82da7fc700 1 -- 172.21.15.71:0/926775164 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636092604 0 0) 0x7f82cc001110 con 0x7f82dc155eb0 2023-10-09T07:00:31.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.067+0000 7f82da7fc700 1 -- 172.21.15.71:0/926775164 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82c4003570 con 0x7f82dc155eb0 2023-10-09T07:00:31.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.067+0000 7f82dbfff700 1 -- 172.21.15.71:0/926775164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82dc0c70b0 msgr2=0x7f82dc069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:31.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.067+0000 7f82dbfff700 1 --2- 172.21.15.71:0/926775164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82dc0c70b0 0x7f82dc069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:31.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.067+0000 7f82dbfff700 1 -- 172.21.15.71:0/926775164 >> v1:172.21.15.71:6789/0 conn(0x7f82dc155eb0 legacy=0x7f82dc06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:31.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.067+0000 7f82dbfff700 1 -- 172.21.15.71:0/926775164 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82dc06ee70 con 0x7f82dc069cb0 2023-10-09T07:00:31.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.068+0000 7f82dbfff700 1 --2- 172.21.15.71:0/926775164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82dc069cb0 0x7f82dc0ca4c0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009e90 tx=0x7f82d4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3ae22dfec4a49c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:31.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.068+0000 7f82da7fc700 1 -- 172.21.15.71:0/926775164 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d400e070 con 0x7f82dc069cb0 2023-10-09T07:00:31.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.068+0000 7f82da7fc700 1 -- 172.21.15.71:0/926775164 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d400bb40 con 0x7f82dc069cb0 2023-10-09T07:00:31.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.068+0000 7f82da7fc700 1 -- 172.21.15.71:0/926775164 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d4012430 con 0x7f82dc069cb0 2023-10-09T07:00:31.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.068+0000 7f82e1bff700 1 -- 172.21.15.71:0/926775164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82dc069cb0 msgr2=0x7f82dc0ca4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:31.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.068+0000 7f82e1bff700 1 --2- 172.21.15.71:0/926775164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82dc069cb0 0x7f82dc0ca4c0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009e90 tx=0x7f82d4009780 comp rx=0 tx=0).stop 2023-10-09T07:00:31.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.068+0000 7f82e1bff700 1 -- 172.21.15.71:0/926775164 shutdown_connections 2023-10-09T07:00:31.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.068+0000 7f82e1bff700 1 --2- 172.21.15.71:0/926775164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82dc069cb0 0x7f82dc0ca4c0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:31.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.068+0000 7f82e1bff700 1 --2- 172.21.15.71:0/926775164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82dc0c70b0 0x7f82dc069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:31.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.068+0000 7f82e1bff700 1 -- 172.21.15.71:0/926775164 >> 172.21.15.71:0/926775164 conn(0x7f82dc068e10 msgr2=0x7f82dc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:31.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.069+0000 7f82e1bff700 1 -- 172.21.15.71:0/926775164 shutdown_connections 2023-10-09T07:00:31.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.069+0000 7f82e1bff700 1 -- 172.21.15.71:0/926775164 wait complete. 2023-10-09T07:00:31.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.070+0000 7f82e1bff700 1 Processor -- start 2023-10-09T07:00:31.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.070+0000 7f82e1bff700 1 -- start start 2023-10-09T07:00:31.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.071+0000 7f82e1bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82dc069cb0 0x7f82dc15ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:31.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.071+0000 7f82e1bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82dc0c70b0 0x7f82dc0acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:31.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.071+0000 7f82e1bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82dc155eb0 0x7f82dc0cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:31.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.071+0000 7f82e1bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc0abb20 con 0x7f82dc155eb0 2023-10-09T07:00:31.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.071+0000 7f82e1bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc15cf40 con 0x7f82dc0c70b0 2023-10-09T07:00:31.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.071+0000 7f82e1bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc0ad070 con 0x7f82dc069cb0 2023-10-09T07:00:31.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.071+0000 7f82dbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82dc155eb0 0x7f82dc0cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:31.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.071+0000 7f82dbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82dc155eb0 0x7f82dc0cc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44472/0 (socket says 172.21.15.71:44472) 2023-10-09T07:00:31.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.071+0000 7f82dbfff700 1 -- 172.21.15.71:0/1853155622 learned_addr learned my addr 172.21.15.71:0/1853155622 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:31.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.071+0000 7f82db7fe700 1 --2- 172.21.15.71:0/1853155622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82dc069cb0 0x7f82dc15ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:31.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.071+0000 7f82daffd700 1 --2- 172.21.15.71:0/1853155622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82dc0c70b0 0x7f82dc0acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:31.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.072+0000 7f82dbfff700 1 -- 172.21.15.71:0/1853155622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82dc069cb0 msgr2=0x7f82dc15ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:31.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.072+0000 7f82dbfff700 1 --2- 172.21.15.71:0/1853155622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82dc069cb0 0x7f82dc15ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:31.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.072+0000 7f82dbfff700 1 -- 172.21.15.71:0/1853155622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82dc0c70b0 msgr2=0x7f82dc0acb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:31.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.072+0000 7f82dbfff700 1 --2- 172.21.15.71:0/1853155622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82dc0c70b0 0x7f82dc0acb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:31.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.072+0000 7f82dbfff700 1 -- 172.21.15.71:0/1853155622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d4009a20 con 0x7f82dc155eb0 2023-10-09T07:00:31.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.072+0000 7f82dbfff700 1 --2- 172.21.15.71:0/1853155622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82dc155eb0 0x7f82dc0cc480 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f82dc06fe40 tx=0x7f82d4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:31.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.072+0000 7f82c37fe700 1 -- 172.21.15.71:0/1853155622 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d4027470 con 0x7f82dc155eb0 2023-10-09T07:00:31.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.072+0000 7f82c37fe700 1 -- 172.21.15.71:0/1853155622 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d40275d0 con 0x7f82dc155eb0 2023-10-09T07:00:31.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.072+0000 7f82c37fe700 1 -- 172.21.15.71:0/1853155622 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d4027990 con 0x7f82dc155eb0 2023-10-09T07:00:31.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.072+0000 7f82e1bff700 1 -- 172.21.15.71:0/1853155622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82dc0abd70 con 0x7f82dc155eb0 2023-10-09T07:00:31.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.072+0000 7f82e1bff700 1 -- 172.21.15.71:0/1853155622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82dc0ac330 con 0x7f82dc155eb0 2023-10-09T07:00:31.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.073+0000 7f82e1bff700 1 -- 172.21.15.71:0/1853155622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82dc0c8d50 con 0x7f82dc155eb0 2023-10-09T07:00:31.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.074+0000 7f82c37fe700 1 -- 172.21.15.71:0/1853155622 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82d4024070 con 0x7f82dc155eb0 2023-10-09T07:00:31.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.075+0000 7f82c37fe700 1 --2- 172.21.15.71:0/1853155622 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f82c8066f30 0x7f82c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:31.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.075+0000 7f82c37fe700 1 -- 172.21.15.71:0/1853155622 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f82d4086d30 con 0x7f82dc155eb0 2023-10-09T07:00:31.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.076+0000 7f82db7fe700 1 --2- 172.21.15.71:0/1853155622 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f82c8066f30 0x7f82c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:31.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.077+0000 7f82db7fe700 1 --2- 172.21.15.71:0/1853155622 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f82c8066f30 0x7f82c80693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f82cc007fd0 tx=0x7f82cc007bf0 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:31.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.080+0000 7f82c37fe700 1 -- 172.21.15.71:0/1853155622 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82d4053e80 con 0x7f82dc155eb0 2023-10-09T07:00:31.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.313+0000 7f82e1bff700 1 -- 172.21.15.71:0/1853155622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f82dc04c3c0 con 0x7f82dc155eb0 2023-10-09T07:00:31.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.864+0000 7f82c37fe700 1 -- 172.21.15.71:0/1853155622 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v54) v1 ==== 174+0+0 (secure 0 0 0) 0x7f82d40574a0 con 0x7f82dc155eb0 2023-10-09T07:00:31.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.869+0000 7f82e1bff700 1 -- 172.21.15.71:0/1853155622 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f82c8066f30 msgr2=0x7f82c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:31.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.869+0000 7f82e1bff700 1 --2- 172.21.15.71:0/1853155622 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f82c8066f30 0x7f82c80693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f82cc007fd0 tx=0x7f82cc007bf0 comp rx=0 tx=0).stop 2023-10-09T07:00:31.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.869+0000 7f82e1bff700 1 -- 172.21.15.71:0/1853155622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82dc155eb0 msgr2=0x7f82dc0cc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:31.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.869+0000 7f82e1bff700 1 --2- 172.21.15.71:0/1853155622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82dc155eb0 0x7f82dc0cc480 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f82dc06fe40 tx=0x7f82d4019000 comp rx=0 tx=0).stop 2023-10-09T07:00:31.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.870+0000 7f82e1bff700 1 -- 172.21.15.71:0/1853155622 shutdown_connections 2023-10-09T07:00:31.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.870+0000 7f82e1bff700 1 --2- 172.21.15.71:0/1853155622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82dc155eb0 0x7f82dc0cc480 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:31.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.870+0000 7f82e1bff700 1 --2- 172.21.15.71:0/1853155622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82dc069cb0 0x7f82dc15ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:31.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.870+0000 7f82e1bff700 1 --2- 172.21.15.71:0/1853155622 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f82c8066f30 0x7f82c80693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:31.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.870+0000 7f82e1bff700 1 --2- 172.21.15.71:0/1853155622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82dc0c70b0 0x7f82dc0acb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:31.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.870+0000 7f82e1bff700 1 -- 172.21.15.71:0/1853155622 >> 172.21.15.71:0/1853155622 conn(0x7f82dc068e10 msgr2=0x7f82dc0cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:31.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.873+0000 7f82e1bff700 1 -- 172.21.15.71:0/1853155622 shutdown_connections 2023-10-09T07:00:31.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:31.873+0000 7f82e1bff700 1 -- 172.21.15.71:0/1853155622 wait complete. 2023-10-09T07:00:31.879 INFO:teuthology.orchestra.run.smithi071.stderr:new fs with metadata pool 14 and data pool 15 2023-10-09T07:00:31.897 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:00:32.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.078+0000 7f6e50bff700 1 Processor -- start 2023-10-09T07:00:32.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.079+0000 7f6e50bff700 1 -- start start 2023-10-09T07:00:32.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.080+0000 7f6e50bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6e4c0ccf90 0x7f6e4c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:32.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.080+0000 7f6e50bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e4c0cc300 con 0x7f6e4c0b1420 2023-10-09T07:00:32.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.080+0000 7f6e50bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e4c0ad370 con 0x7f6e4c0cbf30 2023-10-09T07:00:32.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.080+0000 7f6e50bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e4c156bf0 con 0x7f6e4c0ccf90 2023-10-09T07:00:32.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.080+0000 7f6e43fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6e4c0b1420 0x7f6e4c0c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35714/0 (socket says 172.21.15.71:35714) 2023-10-09T07:00:32.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.080+0000 7f6e43fff700 1 -- 172.21.15.71:0/1938740639 learned_addr learned my addr 172.21.15.71:0/1938740639 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:32.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.080+0000 7f6e4ad9d700 1 --2- 172.21.15.71:0/1938740639 >> v2:172.21.15.71:3300/0 conn(0x7f6e4c0ccf90 0x7f6e4c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:32.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.080+0000 7f6e49d9b700 1 -- 172.21.15.71:0/1938740639 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813461584 0 0) 0x7f6e4c0cc300 con 0x7f6e4c0b1420 2023-10-09T07:00:32.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.081+0000 7f6e49d9b700 1 -- 172.21.15.71:0/1938740639 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e38003570 con 0x7f6e4c0b1420 2023-10-09T07:00:32.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.081+0000 7f6e49d9b700 1 -- 172.21.15.71:0/1938740639 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1925236725 0 0) 0x7f6e4c0ad370 con 0x7f6e4c0cbf30 2023-10-09T07:00:32.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.081+0000 7f6e49d9b700 1 -- 172.21.15.71:0/1938740639 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e4c0cc300 con 0x7f6e4c0cbf30 2023-10-09T07:00:32.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.081+0000 7f6e4ad9d700 1 -- 172.21.15.71:0/1938740639 >> v1:172.21.15.179:6789/0 conn(0x7f6e4c0cbf30 legacy=0x7f6e4c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:32.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.081+0000 7f6e4ad9d700 1 -- 172.21.15.71:0/1938740639 >> v1:172.21.15.71:6789/0 conn(0x7f6e4c0b1420 legacy=0x7f6e4c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:32.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.081+0000 7f6e4ad9d700 1 -- 172.21.15.71:0/1938740639 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4c0ad650 con 0x7f6e4c0ccf90 2023-10-09T07:00:32.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.081+0000 7f6e4ad9d700 1 --2- 172.21.15.71:0/1938740639 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e4c0ccf90 0x7f6e4c0ae410 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f6e44009e60 tx=0x7f6e44009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5357db3a0cbe70a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:32.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.081+0000 7f6e49d9b700 1 -- 172.21.15.71:0/1938740639 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4400e070 con 0x7f6e4c0ccf90 2023-10-09T07:00:32.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.081+0000 7f6e49d9b700 1 -- 172.21.15.71:0/1938740639 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4400bab0 con 0x7f6e4c0ccf90 2023-10-09T07:00:32.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.081+0000 7f6e49d9b700 1 -- 172.21.15.71:0/1938740639 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4400be70 con 0x7f6e4c0ccf90 2023-10-09T07:00:32.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.082+0000 7f6e50bff700 1 -- 172.21.15.71:0/1938740639 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e4c0ccf90 msgr2=0x7f6e4c0ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:32.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.082+0000 7f6e50bff700 1 --2- 172.21.15.71:0/1938740639 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e4c0ccf90 0x7f6e4c0ae410 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f6e44009e60 tx=0x7f6e44009780 comp rx=0 tx=0).stop 2023-10-09T07:00:32.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.082+0000 7f6e50bff700 1 -- 172.21.15.71:0/1938740639 shutdown_connections 2023-10-09T07:00:32.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.082+0000 7f6e50bff700 1 --2- 172.21.15.71:0/1938740639 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e4c0ccf90 0x7f6e4c0ae410 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:32.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.082+0000 7f6e50bff700 1 -- 172.21.15.71:0/1938740639 >> 172.21.15.71:0/1938740639 conn(0x7f6e4c06a320 msgr2=0x7f6e4c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:32.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.082+0000 7f6e50bff700 1 -- 172.21.15.71:0/1938740639 shutdown_connections 2023-10-09T07:00:32.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.082+0000 7f6e50bff700 1 -- 172.21.15.71:0/1938740639 wait complete. 2023-10-09T07:00:32.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.083+0000 7f6e50bff700 1 Processor -- start 2023-10-09T07:00:32.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.083+0000 7f6e50bff700 1 -- start start 2023-10-09T07:00:32.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.084+0000 7f6e50bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e4c0b1420 0x7f6e4c0abb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:32.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.084+0000 7f6e50bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e4c0cbf30 0x7f6e4c0c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:32.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.084+0000 7f6e50bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e4c0ccf90 0x7f6e4c149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:32.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.084+0000 7f6e50bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c0c1c60 con 0x7f6e4c0cbf30 2023-10-09T07:00:32.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.084+0000 7f6e50bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c0c1370 con 0x7f6e4c0b1420 2023-10-09T07:00:32.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.084+0000 7f6e50bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c0c1610 con 0x7f6e4c0ccf90 2023-10-09T07:00:32.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.084+0000 7f6e43fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e4c0cbf30 0x7f6e4c0c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:32.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.084+0000 7f6e43fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e4c0cbf30 0x7f6e4c0c38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44496/0 (socket says 172.21.15.71:44496) 2023-10-09T07:00:32.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.084+0000 7f6e43fff700 1 -- 172.21.15.71:0/1397083442 learned_addr learned my addr 172.21.15.71:0/1397083442 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:32.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.085+0000 7f6e4a59c700 1 --2- 172.21.15.71:0/1397083442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e4c0b1420 0x7f6e4c0abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:32.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.085+0000 7f6e4ad9d700 1 --2- 172.21.15.71:0/1397083442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e4c0ccf90 0x7f6e4c149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:32.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.085+0000 7f6e43fff700 1 -- 172.21.15.71:0/1397083442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e4c0ccf90 msgr2=0x7f6e4c149bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:32.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.085+0000 7f6e43fff700 1 --2- 172.21.15.71:0/1397083442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e4c0ccf90 0x7f6e4c149bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:32.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.085+0000 7f6e43fff700 1 -- 172.21.15.71:0/1397083442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e4c0b1420 msgr2=0x7f6e4c0abb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:32.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.085+0000 7f6e43fff700 1 --2- 172.21.15.71:0/1397083442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e4c0b1420 0x7f6e4c0abb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:32.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.085+0000 7f6e43fff700 1 -- 172.21.15.71:0/1397083442 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e44009a20 con 0x7f6e4c0cbf30 2023-10-09T07:00:32.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.085+0000 7f6e43fff700 1 --2- 172.21.15.71:0/1397083442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e4c0cbf30 0x7f6e4c0c38f0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f6e340058d0 tx=0x7f6e34007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:32.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.085+0000 7f6e427fc700 1 -- 172.21.15.71:0/1397083442 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34005b30 con 0x7f6e4c0cbf30 2023-10-09T07:00:32.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.085+0000 7f6e427fc700 1 -- 172.21.15.71:0/1397083442 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e34005cb0 con 0x7f6e4c0cbf30 2023-10-09T07:00:32.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.085+0000 7f6e50bff700 1 -- 172.21.15.71:0/1397083442 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4c0c18f0 con 0x7f6e4c0cbf30 2023-10-09T07:00:32.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.085+0000 7f6e427fc700 1 -- 172.21.15.71:0/1397083442 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34007320 con 0x7f6e4c0cbf30 2023-10-09T07:00:32.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.086+0000 7f6e50bff700 1 -- 172.21.15.71:0/1397083442 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4c0c43a0 con 0x7f6e4c0cbf30 2023-10-09T07:00:32.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.087+0000 7f6e50bff700 1 -- 172.21.15.71:0/1397083442 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e4c0c1dd0 con 0x7f6e4c0cbf30 2023-10-09T07:00:32.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.088+0000 7f6e427fc700 1 -- 172.21.15.71:0/1397083442 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e3401b3b0 con 0x7f6e4c0cbf30 2023-10-09T07:00:32.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.088+0000 7f6e427fc700 1 --2- 172.21.15.71:0/1397083442 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6e2c066f30 0x7f6e2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:32.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.088+0000 7f6e427fc700 1 -- 172.21.15.71:0/1397083442 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f6e34083b40 con 0x7f6e4c0cbf30 2023-10-09T07:00:32.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.089+0000 7f6e4a59c700 1 --2- 172.21.15.71:0/1397083442 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6e2c066f30 0x7f6e2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:32.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.090+0000 7f6e4a59c700 1 --2- 172.21.15.71:0/1397083442 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6e2c066f30 0x7f6e2c0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c007fd0 tx=0x7f6e3c007d50 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:32.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.093+0000 7f6e427fc700 1 -- 172.21.15.71:0/1397083442 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e34050b80 con 0x7f6e4c0cbf30 2023-10-09T07:00:32.190 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-10-09T07:00:32.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.283+0000 7f6e50bff700 1 -- 172.21.15.71:0/1397083442 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e4c04c3c0 con 0x7f6e4c0cbf30 2023-10-09T07:00:32.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.284+0000 7f6e427fc700 1 -- 172.21.15.71:0/1397083442 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+15971 (secure 0 0 0) 0x7f6e3406ae60 con 0x7f6e4c0cbf30 2023-10-09T07:00:32.285 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:00:32.285 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":122,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:00:31.314697+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:00:28.965075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T07:00:30.294796+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:00:32.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.286+0000 7f6e50bff700 1 -- 172.21.15.71:0/1397083442 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6e2c066f30 msgr2=0x7f6e2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:32.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.286+0000 7f6e50bff700 1 --2- 172.21.15.71:0/1397083442 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6e2c066f30 0x7f6e2c0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c007fd0 tx=0x7f6e3c007d50 comp rx=0 tx=0).stop 2023-10-09T07:00:32.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.286+0000 7f6e50bff700 1 -- 172.21.15.71:0/1397083442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e4c0cbf30 msgr2=0x7f6e4c0c38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:32.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.286+0000 7f6e50bff700 1 --2- 172.21.15.71:0/1397083442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e4c0cbf30 0x7f6e4c0c38f0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f6e340058d0 tx=0x7f6e34007e10 comp rx=0 tx=0).stop 2023-10-09T07:00:32.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.286+0000 7f6e50bff700 1 -- 172.21.15.71:0/1397083442 shutdown_connections 2023-10-09T07:00:32.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.286+0000 7f6e50bff700 1 --2- 172.21.15.71:0/1397083442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e4c0ccf90 0x7f6e4c149bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:32.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.286+0000 7f6e50bff700 1 --2- 172.21.15.71:0/1397083442 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6e2c066f30 0x7f6e2c0693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:32.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.286+0000 7f6e50bff700 1 --2- 172.21.15.71:0/1397083442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e4c0b1420 0x7f6e4c0abb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:32.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.286+0000 7f6e50bff700 1 --2- 172.21.15.71:0/1397083442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e4c0cbf30 0x7f6e4c0c38f0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:32.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.286+0000 7f6e50bff700 1 -- 172.21.15.71:0/1397083442 >> 172.21.15.71:0/1397083442 conn(0x7f6e4c06a320 msgr2=0x7f6e4c06ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:32.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.286+0000 7f6e50bff700 1 -- 172.21.15.71:0/1397083442 shutdown_connections 2023-10-09T07:00:32.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.287+0000 7f6e50bff700 1 -- 172.21.15.71:0/1397083442 wait complete. 2023-10-09T07:00:32.305 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:00:32.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.485+0000 7f48047ff700 1 Processor -- start 2023-10-09T07:00:32.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.486+0000 7f48047ff700 1 -- start start 2023-10-09T07:00:32.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.487+0000 7f48047ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f47fc0b1420 0x7f47fc0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:32.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.487+0000 7f48047ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47fc0ccf90 0x7f47fc0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:32.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.487+0000 7f48047ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47fc0cc300 con 0x7f47fc0cbf30 2023-10-09T07:00:32.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.487+0000 7f48047ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47fc156bf0 con 0x7f47fc0b1420 2023-10-09T07:00:32.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.487+0000 7f48047ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc0ae950 con 0x7f47fc0ccf90 2023-10-09T07:00:32.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.487+0000 7f4801d9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f47fc0b1420 0x7f47fc0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:32.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.487+0000 7f4801d9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f47fc0b1420 0x7f47fc0ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:37330/0 (socket says 172.21.15.71:37330) 2023-10-09T07:00:32.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.487+0000 7f4801d9a700 1 -- 172.21.15.71:0/1594141888 learned_addr learned my addr 172.21.15.71:0/1594141888 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:32.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.487+0000 7f4802d9c700 1 --2- 172.21.15.71:0/1594141888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47fc0ccf90 0x7f47fc0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:32.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.488+0000 7f4801d9a700 1 -- 172.21.15.71:0/1594141888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47fc0ccf90 msgr2=0x7f47fc0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:32.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.488+0000 7f4801d9a700 1 --2- 172.21.15.71:0/1594141888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47fc0ccf90 0x7f47fc0c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:32.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.488+0000 7f4801d9a700 1 -- 172.21.15.71:0/1594141888 >> v1:172.21.15.179:6789/0 conn(0x7f47fc0cbf30 legacy=0x7f47fc0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:32.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.488+0000 7f4801d9a700 1 -- 172.21.15.71:0/1594141888 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47fc0ad370 con 0x7f47fc0b1420 2023-10-09T07:00:32.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.488+0000 7f4801d9a700 1 --2- 172.21.15.71:0/1594141888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47fc0b1420 0x7f47fc0ae410 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0099e0 tx=0x7f47ec009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4995a7fcda3adb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:32.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.488+0000 7f4801599700 1 -- 172.21.15.71:0/1594141888 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec00b820 con 0x7f47fc0b1420 2023-10-09T07:00:32.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.488+0000 7f4801599700 1 -- 172.21.15.71:0/1594141888 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec00b980 con 0x7f47fc0b1420 2023-10-09T07:00:32.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.488+0000 7f4801599700 1 -- 172.21.15.71:0/1594141888 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec00bd20 con 0x7f47fc0b1420 2023-10-09T07:00:32.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.489+0000 7f48047ff700 1 -- 172.21.15.71:0/1594141888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47fc0b1420 msgr2=0x7f47fc0ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:32.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.489+0000 7f48047ff700 1 --2- 172.21.15.71:0/1594141888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47fc0b1420 0x7f47fc0ae410 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0099e0 tx=0x7f47ec009250 comp rx=0 tx=0).stop 2023-10-09T07:00:32.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.489+0000 7f48047ff700 1 -- 172.21.15.71:0/1594141888 shutdown_connections 2023-10-09T07:00:32.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.489+0000 7f48047ff700 1 --2- 172.21.15.71:0/1594141888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47fc0ccf90 0x7f47fc0c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:32.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.489+0000 7f48047ff700 1 --2- 172.21.15.71:0/1594141888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47fc0b1420 0x7f47fc0ae410 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.489+0000 7f48047ff700 1 -- 172.21.15.71:0/1594141888 >> 172.21.15.71:0/1594141888 conn(0x7f47fc06a320 msgr2=0x7f47fc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.489+0000 7f48047ff700 1 -- 172.21.15.71:0/1594141888 shutdown_connections 2023-10-09T07:00:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.489+0000 7f48047ff700 1 -- 172.21.15.71:0/1594141888 wait complete. 2023-10-09T07:00:32.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.490+0000 7f48047ff700 1 Processor -- start 2023-10-09T07:00:32.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.491+0000 7f48047ff700 1 -- start start 2023-10-09T07:00:32.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.491+0000 7f48047ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47fc0b1420 0x7f47fc168170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:32.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.491+0000 7f48047ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47fc0cbf30 0x7f47fc14a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:32.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.491+0000 7f48047ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47fc0ccf90 0x7f47fc0ab480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:32.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.491+0000 7f48047ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc1686b0 con 0x7f47fc0b1420 2023-10-09T07:00:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.492+0000 7f48047ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc14a5e0 con 0x7f47fc0cbf30 2023-10-09T07:00:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.492+0000 7f48047ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc1695b0 con 0x7f47fc0ccf90 2023-10-09T07:00:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.492+0000 7f480259b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47fc0b1420 0x7f47fc168170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.492+0000 7f480259b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47fc0b1420 0x7f47fc168170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44506/0 (socket says 172.21.15.71:44506) 2023-10-09T07:00:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.492+0000 7f480259b700 1 -- 172.21.15.71:0/1548917938 learned_addr learned my addr 172.21.15.71:0/1548917938 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.492+0000 7f4801d9a700 1 --2- 172.21.15.71:0/1548917938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47fc0cbf30 0x7f47fc14a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.492+0000 7f4802d9c700 1 --2- 172.21.15.71:0/1548917938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47fc0ccf90 0x7f47fc0ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.492+0000 7f480259b700 1 -- 172.21.15.71:0/1548917938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47fc0ccf90 msgr2=0x7f47fc0ab480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.492+0000 7f480259b700 1 --2- 172.21.15.71:0/1548917938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47fc0ccf90 0x7f47fc0ab480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.492+0000 7f480259b700 1 -- 172.21.15.71:0/1548917938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47fc0cbf30 msgr2=0x7f47fc14a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.492+0000 7f480259b700 1 --2- 172.21.15.71:0/1548917938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47fc0cbf30 0x7f47fc14a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:32.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.492+0000 7f480259b700 1 -- 172.21.15.71:0/1548917938 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec0094f0 con 0x7f47fc0b1420 2023-10-09T07:00:32.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.492+0000 7f4801d9a700 1 --2- 172.21.15.71:0/1548917938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47fc0cbf30 0x7f47fc14a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:00:32.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.492+0000 7f4802d9c700 1 --2- 172.21.15.71:0/1548917938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47fc0ccf90 0x7f47fc0ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:00:32.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.492+0000 7f480259b700 1 --2- 172.21.15.71:0/1548917938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47fc0b1420 0x7f47fc168170 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f47f800c5c0 tx=0x7f47f800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:32.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.493+0000 7f47f27fc700 1 -- 172.21.15.71:0/1548917938 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f8011590 con 0x7f47fc0b1420 2023-10-09T07:00:32.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.493+0000 7f47f27fc700 1 -- 172.21.15.71:0/1548917938 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f8011710 con 0x7f47fc0b1420 2023-10-09T07:00:32.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.493+0000 7f48047ff700 1 -- 172.21.15.71:0/1548917938 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47fc1689a0 con 0x7f47fc0b1420 2023-10-09T07:00:32.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.493+0000 7f47f27fc700 1 -- 172.21.15.71:0/1548917938 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f8011ad0 con 0x7f47fc0b1420 2023-10-09T07:00:32.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.493+0000 7f48047ff700 1 -- 172.21.15.71:0/1548917938 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47fc168f60 con 0x7f47fc0b1420 2023-10-09T07:00:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.494+0000 7f48047ff700 1 -- 172.21.15.71:0/1548917938 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47fc04c3c0 con 0x7f47fc0b1420 2023-10-09T07:00:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.495+0000 7f47f27fc700 1 -- 172.21.15.71:0/1548917938 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47f801b3b0 con 0x7f47fc0b1420 2023-10-09T07:00:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.495+0000 7f47f27fc700 1 --2- 172.21.15.71:0/1548917938 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f47e0066f30 0x7f47e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.496+0000 7f47f27fc700 1 -- 172.21.15.71:0/1548917938 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f47f8083d00 con 0x7f47fc0b1420 2023-10-09T07:00:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.496+0000 7f4801d9a700 1 --2- 172.21.15.71:0/1548917938 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f47e0066f30 0x7f47e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:32.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.497+0000 7f4801d9a700 1 --2- 172.21.15.71:0/1548917938 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f47e0066f30 0x7f47e00693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0099e0 tx=0x7f47ec017000 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:32.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.500+0000 7f47f27fc700 1 -- 172.21.15.71:0/1548917938 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47f8050d40 con 0x7f47fc0b1420 2023-10-09T07:00:32.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.692+0000 7f48047ff700 1 -- 172.21.15.71:0/1548917938 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47fc0ad650 con 0x7f47fc0b1420 2023-10-09T07:00:32.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.693+0000 7f47f27fc700 1 -- 172.21.15.71:0/1548917938 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+15971 (secure 0 0 0) 0x7f47f8017070 con 0x7f47fc0b1420 2023-10-09T07:00:32.695 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:00:32.695 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":122,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:00:31.314697+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:00:28.965075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T07:00:30.294796+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:00:32.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.696+0000 7f48047ff700 1 -- 172.21.15.71:0/1548917938 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f47e0066f30 msgr2=0x7f47e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:32.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.696+0000 7f48047ff700 1 --2- 172.21.15.71:0/1548917938 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f47e0066f30 0x7f47e00693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0099e0 tx=0x7f47ec017000 comp rx=0 tx=0).stop 2023-10-09T07:00:32.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.696+0000 7f48047ff700 1 -- 172.21.15.71:0/1548917938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47fc0b1420 msgr2=0x7f47fc168170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:32.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.696+0000 7f48047ff700 1 --2- 172.21.15.71:0/1548917938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47fc0b1420 0x7f47fc168170 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f47f800c5c0 tx=0x7f47f800c980 comp rx=0 tx=0).stop 2023-10-09T07:00:32.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.696+0000 7f48047ff700 1 -- 172.21.15.71:0/1548917938 shutdown_connections 2023-10-09T07:00:32.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.696+0000 7f48047ff700 1 --2- 172.21.15.71:0/1548917938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47fc0ccf90 0x7f47fc0ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:32.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.696+0000 7f48047ff700 1 --2- 172.21.15.71:0/1548917938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47fc0b1420 0x7f47fc168170 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:32.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.696+0000 7f48047ff700 1 --2- 172.21.15.71:0/1548917938 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f47e0066f30 0x7f47e00693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:32.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.696+0000 7f48047ff700 1 --2- 172.21.15.71:0/1548917938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47fc0cbf30 0x7f47fc14a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:32.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.696+0000 7f48047ff700 1 -- 172.21.15.71:0/1548917938 >> 172.21.15.71:0/1548917938 conn(0x7f47fc06a320 msgr2=0x7f47fc0afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:32.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.696+0000 7f48047ff700 1 -- 172.21.15.71:0/1548917938 shutdown_connections 2023-10-09T07:00:32.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.696+0000 7f48047ff700 1 -- 172.21.15.71:0/1548917938 wait complete. 2023-10-09T07:00:32.717 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T07:00:32.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.903+0000 7fdf7adff700 1 Processor -- start 2023-10-09T07:00:32.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.903+0000 7fdf7adff700 1 -- start start 2023-10-09T07:00:32.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.904+0000 7fdf7adff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf740c83f0 0x7fdf740c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.904+0000 7fdf7adff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdf740ccee0 0x7fdf741561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.904+0000 7fdf7adff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf7415b0d0 con 0x7fdf740c87c0 2023-10-09T07:00:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.904+0000 7fdf7adff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf740c7a60 con 0x7fdf740ccee0 2023-10-09T07:00:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.904+0000 7fdf7adff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7415a4c0 con 0x7fdf740c83f0 2023-10-09T07:00:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.905+0000 7fdf73fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdf740ccee0 0x7fdf741561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.905+0000 7fdf73fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdf740ccee0 0x7fdf741561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44518/0 (socket says 172.21.15.71:44518) 2023-10-09T07:00:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.905+0000 7fdf73fff700 1 -- 172.21.15.71:0/1932487425 learned_addr learned my addr 172.21.15.71:0/1932487425 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.905+0000 7fdf78b9b700 1 --2- 172.21.15.71:0/1932487425 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf740c83f0 0x7fdf740c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.905+0000 7fdf73fff700 1 -- 172.21.15.71:0/1932487425 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf740c83f0 msgr2=0x7fdf740c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.905+0000 7fdf73fff700 1 --2- 172.21.15.71:0/1932487425 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf740c83f0 0x7fdf740c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.905+0000 7fdf73fff700 1 -- 172.21.15.71:0/1932487425 >> v1:172.21.15.179:6789/0 conn(0x7fdf740c87c0 legacy=0x7fdf7406eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:32.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.905+0000 7fdf73fff700 1 -- 172.21.15.71:0/1932487425 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7415a7a0 con 0x7fdf740ccee0 2023-10-09T07:00:32.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.905+0000 7fdf78b9b700 1 --2- 172.21.15.71:0/1932487425 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf740c83f0 0x7fdf740c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:00:32.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.905+0000 7fdf73fff700 1 --2- 172.21.15.71:0/1932487425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf740ccee0 0x7fdf741561d0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fdf600099b0 tx=0x7fdf60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f36112590687d30 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:32.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.906+0000 7fdf737fe700 1 -- 172.21.15.71:0/1932487425 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6000b860 con 0x7fdf740ccee0 2023-10-09T07:00:32.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.906+0000 7fdf737fe700 1 -- 172.21.15.71:0/1932487425 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6000b9c0 con 0x7fdf740ccee0 2023-10-09T07:00:32.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.906+0000 7fdf737fe700 1 -- 172.21.15.71:0/1932487425 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6000bd60 con 0x7fdf740ccee0 2023-10-09T07:00:32.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.906+0000 7fdf7adff700 1 -- 172.21.15.71:0/1932487425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf740ccee0 msgr2=0x7fdf741561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:32.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.906+0000 7fdf7adff700 1 --2- 172.21.15.71:0/1932487425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf740ccee0 0x7fdf741561d0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fdf600099b0 tx=0x7fdf60009250 comp rx=0 tx=0).stop 2023-10-09T07:00:32.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.906+0000 7fdf7adff700 1 -- 172.21.15.71:0/1932487425 shutdown_connections 2023-10-09T07:00:32.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.906+0000 7fdf7adff700 1 --2- 172.21.15.71:0/1932487425 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf740c83f0 0x7fdf740c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:32.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.906+0000 7fdf7adff700 1 --2- 172.21.15.71:0/1932487425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf740ccee0 0x7fdf741561d0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:32.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.906+0000 7fdf7adff700 1 -- 172.21.15.71:0/1932487425 >> 172.21.15.71:0/1932487425 conn(0x7fdf74068e10 msgr2=0x7fdf740cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:32.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.906+0000 7fdf7adff700 1 -- 172.21.15.71:0/1932487425 shutdown_connections 2023-10-09T07:00:32.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.906+0000 7fdf7adff700 1 -- 172.21.15.71:0/1932487425 wait complete. 2023-10-09T07:00:32.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.908+0000 7fdf7adff700 1 Processor -- start 2023-10-09T07:00:32.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.908+0000 7fdf7adff700 1 -- start start 2023-10-09T07:00:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.909+0000 7fdf7adff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf740c83f0 0x7fdf740c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.909+0000 7fdf7adff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf740c87c0 0x7fdf7416daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.909+0000 7fdf7adff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf740ccee0 0x7fdf74169b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.909+0000 7fdf7adff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7416ab10 con 0x7fdf740c83f0 2023-10-09T07:00:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.909+0000 7fdf7adff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf74148b10 con 0x7fdf740ccee0 2023-10-09T07:00:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.909+0000 7fdf7adff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7416e030 con 0x7fdf740c87c0 2023-10-09T07:00:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.909+0000 7fdf78b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf740c83f0 0x7fdf740c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.909+0000 7fdf78b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf740c83f0 0x7fdf740c6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44522/0 (socket says 172.21.15.71:44522) 2023-10-09T07:00:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.909+0000 7fdf78b9b700 1 -- 172.21.15.71:0/1394511005 learned_addr learned my addr 172.21.15.71:0/1394511005 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.909+0000 7fdf73fff700 1 --2- 172.21.15.71:0/1394511005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf740c87c0 0x7fdf7416daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.909+0000 7fdf78b9b700 1 -- 172.21.15.71:0/1394511005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf740c87c0 msgr2=0x7fdf7416daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.909+0000 7fdf78b9b700 1 --2- 172.21.15.71:0/1394511005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf740c87c0 0x7fdf7416daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.909+0000 7fdf78b9b700 1 -- 172.21.15.71:0/1394511005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf740ccee0 msgr2=0x7fdf74169b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.909+0000 7fdf7939c700 1 --2- 172.21.15.71:0/1394511005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf740ccee0 0x7fdf74169b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.910+0000 7fdf78b9b700 1 --2- 172.21.15.71:0/1394511005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf740ccee0 0x7fdf74169b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.910+0000 7fdf78b9b700 1 -- 172.21.15.71:0/1394511005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf600094f0 con 0x7fdf740c83f0 2023-10-09T07:00:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.910+0000 7fdf73fff700 1 --2- 172.21.15.71:0/1394511005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf740c87c0 0x7fdf7416daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:00:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.910+0000 7fdf7939c700 1 --2- 172.21.15.71:0/1394511005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf740ccee0 0x7fdf74169b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:00:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.910+0000 7fdf78b9b700 1 --2- 172.21.15.71:0/1394511005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf740c83f0 0x7fdf740c6290 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800e8d0 tx=0x7fdf68008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.910+0000 7fdf70ff9700 1 -- 172.21.15.71:0/1394511005 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6800ee70 con 0x7fdf740c83f0 2023-10-09T07:00:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.910+0000 7fdf70ff9700 1 -- 172.21.15.71:0/1394511005 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6800c5e0 con 0x7fdf740c83f0 2023-10-09T07:00:32.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.910+0000 7fdf70ff9700 1 -- 172.21.15.71:0/1394511005 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6800c980 con 0x7fdf740c83f0 2023-10-09T07:00:32.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.910+0000 7fdf7adff700 1 -- 172.21.15.71:0/1394511005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf7416a550 con 0x7fdf740c83f0 2023-10-09T07:00:32.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.910+0000 7fdf7adff700 1 -- 172.21.15.71:0/1394511005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf7416d2f0 con 0x7fdf740c83f0 2023-10-09T07:00:32.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.911+0000 7fdf7adff700 1 -- 172.21.15.71:0/1394511005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf7404c3c0 con 0x7fdf740c83f0 2023-10-09T07:00:32.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.912+0000 7fdf70ff9700 1 -- 172.21.15.71:0/1394511005 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf68013410 con 0x7fdf740c83f0 2023-10-09T07:00:32.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.913+0000 7fdf70ff9700 1 --2- 172.21.15.71:0/1394511005 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdf58066f30 0x7fdf580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:32.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.913+0000 7fdf70ff9700 1 -- 172.21.15.71:0/1394511005 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fdf68084520 con 0x7fdf740c83f0 2023-10-09T07:00:32.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.913+0000 7fdf73fff700 1 --2- 172.21.15.71:0/1394511005 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdf58066f30 0x7fdf580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:32.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.914+0000 7fdf73fff700 1 --2- 172.21.15.71:0/1394511005 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdf58066f30 0x7fdf580693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdf600099b0 tx=0x7fdf60017000 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:32.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:32.917+0000 7fdf70ff9700 1 -- 172.21.15.71:0/1394511005 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf68051600 con 0x7fdf740c83f0 2023-10-09T07:00:33.027 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:00:33.032 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:00:33.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:33.160+0000 7fdf7adff700 1 -- 172.21.15.71:0/1394511005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdf7414a960 con 0x7fdf740c83f0 2023-10-09T07:00:33.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:33.864+0000 7fdf70ff9700 1 -- 172.21.15.71:0/1394511005 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v57) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdf68054c20 con 0x7fdf740c83f0 2023-10-09T07:00:33.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:33.867+0000 7fdf7adff700 1 -- 172.21.15.71:0/1394511005 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdf58066f30 msgr2=0x7fdf580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:33.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:33.867+0000 7fdf7adff700 1 --2- 172.21.15.71:0/1394511005 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdf58066f30 0x7fdf580693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdf600099b0 tx=0x7fdf60017000 comp rx=0 tx=0).stop 2023-10-09T07:00:33.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:33.867+0000 7fdf7adff700 1 -- 172.21.15.71:0/1394511005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf740c83f0 msgr2=0x7fdf740c6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:33.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:33.867+0000 7fdf7adff700 1 --2- 172.21.15.71:0/1394511005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf740c83f0 0x7fdf740c6290 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800e8d0 tx=0x7fdf68008040 comp rx=0 tx=0).stop 2023-10-09T07:00:33.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:33.867+0000 7fdf7adff700 1 -- 172.21.15.71:0/1394511005 shutdown_connections 2023-10-09T07:00:33.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:33.867+0000 7fdf7adff700 1 --2- 172.21.15.71:0/1394511005 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdf58066f30 0x7fdf580693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:33.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:33.867+0000 7fdf7adff700 1 --2- 172.21.15.71:0/1394511005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf740ccee0 0x7fdf74169b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:33.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:33.867+0000 7fdf7adff700 1 --2- 172.21.15.71:0/1394511005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf740c83f0 0x7fdf740c6290 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:33.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:33.867+0000 7fdf7adff700 1 --2- 172.21.15.71:0/1394511005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf740c87c0 0x7fdf7416daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:33.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:33.867+0000 7fdf7adff700 1 -- 172.21.15.71:0/1394511005 >> 172.21.15.71:0/1394511005 conn(0x7fdf74068e10 msgr2=0x7fdf74150310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:33.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:33.867+0000 7fdf7adff700 1 -- 172.21.15.71:0/1394511005 shutdown_connections 2023-10-09T07:00:33.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:33.867+0000 7fdf7adff700 1 -- 172.21.15.71:0/1394511005 wait complete. 2023-10-09T07:00:33.888 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T07:00:34.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.075+0000 7fb51df9d700 1 Processor -- start 2023-10-09T07:00:34.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.075+0000 7fb51df9d700 1 -- start start 2023-10-09T07:00:34.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.076+0000 7fb51df9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb51806f060 0x7fb5180ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:34.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.076+0000 7fb51df9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb51806f4b0 0x7fb5180ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:34.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.076+0000 7fb51df9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb51806ebd0 con 0x7fb5180cb1a0 2023-10-09T07:00:34.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.076+0000 7fb51df9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb51815b2e0 con 0x7fb51806f4b0 2023-10-09T07:00:34.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.076+0000 7fb51df9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51815aa70 con 0x7fb51806f060 2023-10-09T07:00:34.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.076+0000 7fb51d79c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb51806f4b0 0x7fb5180ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:34.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.076+0000 7fb51d79c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb51806f4b0 0x7fb5180ae610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44526/0 (socket says 172.21.15.71:44526) 2023-10-09T07:00:34.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.076+0000 7fb51d79c700 1 -- 172.21.15.71:0/3366501592 learned_addr learned my addr 172.21.15.71:0/3366501592 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:34.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.076+0000 7fb517fff700 1 --2- 172.21.15.71:0/3366501592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb51806f060 0x7fb5180ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:34.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.077+0000 7fb51d79c700 1 -- 172.21.15.71:0/3366501592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb51806f060 msgr2=0x7fb5180ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:34.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.077+0000 7fb51d79c700 1 --2- 172.21.15.71:0/3366501592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb51806f060 0x7fb5180ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:34.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.077+0000 7fb51d79c700 1 -- 172.21.15.71:0/3366501592 >> v1:172.21.15.179:6789/0 conn(0x7fb5180cb1a0 legacy=0x7fb51815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:34.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.077+0000 7fb51d79c700 1 -- 172.21.15.71:0/3366501592 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51815ad20 con 0x7fb51806f4b0 2023-10-09T07:00:34.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.077+0000 7fb51d79c700 1 --2- 172.21.15.71:0/3366501592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb51806f4b0 0x7fb5180ae610 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fb510009f20 tx=0x7fb510009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc20b3785d4dfc9e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:34.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.077+0000 7fb5177fe700 1 -- 172.21.15.71:0/3366501592 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51000e070 con 0x7fb51806f4b0 2023-10-09T07:00:34.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.077+0000 7fb5177fe700 1 -- 172.21.15.71:0/3366501592 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51000ba60 con 0x7fb51806f4b0 2023-10-09T07:00:34.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.077+0000 7fb5177fe700 1 -- 172.21.15.71:0/3366501592 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5100092e0 con 0x7fb51806f4b0 2023-10-09T07:00:34.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.078+0000 7fb51df9d700 1 -- 172.21.15.71:0/3366501592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb51806f4b0 msgr2=0x7fb5180ae610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:34.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.078+0000 7fb51df9d700 1 --2- 172.21.15.71:0/3366501592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb51806f4b0 0x7fb5180ae610 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fb510009f20 tx=0x7fb510009840 comp rx=0 tx=0).stop 2023-10-09T07:00:34.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.078+0000 7fb51df9d700 1 -- 172.21.15.71:0/3366501592 shutdown_connections 2023-10-09T07:00:34.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.078+0000 7fb51df9d700 1 --2- 172.21.15.71:0/3366501592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb51806f4b0 0x7fb5180ae610 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:34.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.078+0000 7fb51df9d700 1 --2- 172.21.15.71:0/3366501592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb51806f060 0x7fb5180ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:34.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.078+0000 7fb51df9d700 1 -- 172.21.15.71:0/3366501592 >> 172.21.15.71:0/3366501592 conn(0x7fb5180cc1e0 msgr2=0x7fb5180cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:34.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.078+0000 7fb51df9d700 1 -- 172.21.15.71:0/3366501592 shutdown_connections 2023-10-09T07:00:34.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.078+0000 7fb51df9d700 1 -- 172.21.15.71:0/3366501592 wait complete. 2023-10-09T07:00:34.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.079+0000 7fb51df9d700 1 Processor -- start 2023-10-09T07:00:34.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.079+0000 7fb51df9d700 1 -- start start 2023-10-09T07:00:34.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.080+0000 7fb51df9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb51806f060 0x7fb5181420a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:34.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.080+0000 7fb51df9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb51806f4b0 0x7fb51815fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:34.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.080+0000 7fb51df9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5180cb1a0 0x7fb5181594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:34.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.080+0000 7fb51df9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51815d020 con 0x7fb5180cb1a0 2023-10-09T07:00:34.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.080+0000 7fb51df9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51815d2c0 con 0x7fb51806f060 2023-10-09T07:00:34.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.080+0000 7fb51df9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51815d5a0 con 0x7fb51806f4b0 2023-10-09T07:00:34.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.081+0000 7fb51d79c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5180cb1a0 0x7fb5181594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:34.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.081+0000 7fb51d79c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5180cb1a0 0x7fb5181594b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44534/0 (socket says 172.21.15.71:44534) 2023-10-09T07:00:34.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.081+0000 7fb51d79c700 1 -- 172.21.15.71:0/3827762253 learned_addr learned my addr 172.21.15.71:0/3827762253 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:34.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.081+0000 7fb517fff700 1 --2- 172.21.15.71:0/3827762253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb51806f4b0 0x7fb51815fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:34.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.081+0000 7fb51cf9b700 1 --2- 172.21.15.71:0/3827762253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb51806f060 0x7fb5181420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:34.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.081+0000 7fb51d79c700 1 -- 172.21.15.71:0/3827762253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb51806f4b0 msgr2=0x7fb51815fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:34.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.081+0000 7fb51d79c700 1 --2- 172.21.15.71:0/3827762253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb51806f4b0 0x7fb51815fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:34.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.081+0000 7fb51d79c700 1 -- 172.21.15.71:0/3827762253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb51806f060 msgr2=0x7fb5181420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:34.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.081+0000 7fb51d79c700 1 --2- 172.21.15.71:0/3827762253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb51806f060 0x7fb5181420a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:34.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.081+0000 7fb51d79c700 1 -- 172.21.15.71:0/3827762253 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb510009ae0 con 0x7fb5180cb1a0 2023-10-09T07:00:34.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.081+0000 7fb51cf9b700 1 --2- 172.21.15.71:0/3827762253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb51806f060 0x7fb5181420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:00:34.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.081+0000 7fb51d79c700 1 --2- 172.21.15.71:0/3827762253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5180cb1a0 0x7fb5181594b0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fb51806ce80 tx=0x7fb510018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:34.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.082+0000 7fb514ff9700 1 -- 172.21.15.71:0/3827762253 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb510008e80 con 0x7fb5180cb1a0 2023-10-09T07:00:34.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.082+0000 7fb514ff9700 1 -- 172.21.15.71:0/3827762253 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5100092e0 con 0x7fb5180cb1a0 2023-10-09T07:00:34.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.082+0000 7fb514ff9700 1 -- 172.21.15.71:0/3827762253 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51001d670 con 0x7fb5180cb1a0 2023-10-09T07:00:34.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.082+0000 7fb51df9d700 1 -- 172.21.15.71:0/3827762253 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb51815d880 con 0x7fb5180cb1a0 2023-10-09T07:00:34.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.082+0000 7fb51df9d700 1 -- 172.21.15.71:0/3827762253 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5181425e0 con 0x7fb5180cb1a0 2023-10-09T07:00:34.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.083+0000 7fb51df9d700 1 -- 172.21.15.71:0/3827762253 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb51815dda0 con 0x7fb5180cb1a0 2023-10-09T07:00:34.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.084+0000 7fb514ff9700 1 -- 172.21.15.71:0/3827762253 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb510003040 con 0x7fb5180cb1a0 2023-10-09T07:00:34.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.084+0000 7fb514ff9700 1 --2- 172.21.15.71:0/3827762253 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb4fc066f30 0x7fb4fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:34.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.084+0000 7fb514ff9700 1 -- 172.21.15.71:0/3827762253 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fb510086390 con 0x7fb5180cb1a0 2023-10-09T07:00:34.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.085+0000 7fb51cf9b700 1 --2- 172.21.15.71:0/3827762253 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb4fc066f30 0x7fb4fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:34.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.086+0000 7fb51cf9b700 1 --2- 172.21.15.71:0/3827762253 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb4fc066f30 0x7fb4fc0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0017a0 tx=0x7fb50c009040 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:34.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.089+0000 7fb514ff9700 1 -- 172.21.15.71:0/3827762253 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb51815dda0 con 0x7fb5180cb1a0 2023-10-09T07:00:34.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.320+0000 7fb51df9d700 1 -- 172.21.15.71:0/3827762253 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb51815dda0 con 0x7fb5180cb1a0 2023-10-09T07:00:34.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.871+0000 7fb514ff9700 1 -- 172.21.15.71:0/3827762253 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v58) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb51815dda0 con 0x7fb5180cb1a0 2023-10-09T07:00:34.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.874+0000 7fb51df9d700 1 -- 172.21.15.71:0/3827762253 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb4fc066f30 msgr2=0x7fb4fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:34.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.874+0000 7fb51df9d700 1 --2- 172.21.15.71:0/3827762253 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb4fc066f30 0x7fb4fc0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0017a0 tx=0x7fb50c009040 comp rx=0 tx=0).stop 2023-10-09T07:00:34.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.874+0000 7fb51df9d700 1 -- 172.21.15.71:0/3827762253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5180cb1a0 msgr2=0x7fb5181594b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:34.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.874+0000 7fb51df9d700 1 --2- 172.21.15.71:0/3827762253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5180cb1a0 0x7fb5181594b0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fb51806ce80 tx=0x7fb510018000 comp rx=0 tx=0).stop 2023-10-09T07:00:34.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.874+0000 7fb51df9d700 1 -- 172.21.15.71:0/3827762253 shutdown_connections 2023-10-09T07:00:34.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.874+0000 7fb51df9d700 1 --2- 172.21.15.71:0/3827762253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5180cb1a0 0x7fb5181594b0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:34.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.874+0000 7fb51df9d700 1 --2- 172.21.15.71:0/3827762253 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb4fc066f30 0x7fb4fc0693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:34.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.874+0000 7fb51df9d700 1 --2- 172.21.15.71:0/3827762253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb51806f060 0x7fb5181420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:34.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.874+0000 7fb51df9d700 1 --2- 172.21.15.71:0/3827762253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb51806f4b0 0x7fb51815fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:34.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.874+0000 7fb51df9d700 1 -- 172.21.15.71:0/3827762253 >> 172.21.15.71:0/3827762253 conn(0x7fb5180cc1e0 msgr2=0x7fb5180c26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:34.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.874+0000 7fb51df9d700 1 -- 172.21.15.71:0/3827762253 shutdown_connections 2023-10-09T07:00:34.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:34.875+0000 7fb51df9d700 1 -- 172.21.15.71:0/3827762253 wait complete. 2023-10-09T07:00:34.895 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:00:35.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.074+0000 7f955bdff700 1 Processor -- start 2023-10-09T07:00:35.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.075+0000 7f955bdff700 1 -- start start 2023-10-09T07:00:35.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.076+0000 7f955bdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95540ccf90 0x7f95540ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:35.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.076+0000 7f955bdff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95540cc300 con 0x7f95540cbf30 2023-10-09T07:00:35.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.076+0000 7f955bdff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95540ad370 con 0x7f95540b1420 2023-10-09T07:00:35.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.076+0000 7f955bdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9554156bf0 con 0x7f95540ccf90 2023-10-09T07:00:35.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.076+0000 7f9559b9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f95540cbf30 0x7f95540b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33998/0 (socket says 172.21.15.71:33998) 2023-10-09T07:00:35.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.076+0000 7f9559b9b700 1 -- 172.21.15.71:0/3372591335 learned_addr learned my addr 172.21.15.71:0/3372591335 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:35.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.076+0000 7f955a39c700 1 --2- 172.21.15.71:0/3372591335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95540ccf90 0x7f95540ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:35.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.076+0000 7f9558b99700 1 -- 172.21.15.71:0/3372591335 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2426987695 0 0) 0x7f95540cc300 con 0x7f95540cbf30 2023-10-09T07:00:35.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.077+0000 7f9558b99700 1 -- 172.21.15.71:0/3372591335 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9540003570 con 0x7f95540cbf30 2023-10-09T07:00:35.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.077+0000 7f9558b99700 1 -- 172.21.15.71:0/3372591335 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626421199 0 0) 0x7f95540ad370 con 0x7f95540b1420 2023-10-09T07:00:35.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.077+0000 7f9558b99700 1 -- 172.21.15.71:0/3372591335 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95540cc300 con 0x7f95540b1420 2023-10-09T07:00:35.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.077+0000 7f9558b99700 1 -- 172.21.15.71:0/3372591335 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4072834190 0 0) 0x7f9540003570 con 0x7f95540cbf30 2023-10-09T07:00:35.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.077+0000 7f955a39c700 1 -- 172.21.15.71:0/3372591335 >> v1:172.21.15.179:6789/0 conn(0x7f95540b1420 legacy=0x7f95540c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:35.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.077+0000 7f955a39c700 1 -- 172.21.15.71:0/3372591335 >> v1:172.21.15.71:6789/0 conn(0x7f95540cbf30 legacy=0x7f95540b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:35.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.077+0000 7f955a39c700 1 -- 172.21.15.71:0/3372591335 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95540ad650 con 0x7f95540ccf90 2023-10-09T07:00:35.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.077+0000 7f955a39c700 1 --2- 172.21.15.71:0/3372591335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95540ccf90 0x7f95540ae410 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f954c009e90 tx=0x7f954c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=485d4434a4deaa8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:35.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.077+0000 7f9558b99700 1 -- 172.21.15.71:0/3372591335 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c00e070 con 0x7f95540ccf90 2023-10-09T07:00:35.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.077+0000 7f9558b99700 1 -- 172.21.15.71:0/3372591335 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954c00b870 con 0x7f95540ccf90 2023-10-09T07:00:35.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.077+0000 7f9558b99700 1 -- 172.21.15.71:0/3372591335 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95500013f0 con 0x7f95540ccf90 2023-10-09T07:00:35.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.078+0000 7f955bdff700 1 -- 172.21.15.71:0/3372591335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95540ccf90 msgr2=0x7f95540ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:35.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.078+0000 7f955bdff700 1 --2- 172.21.15.71:0/3372591335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95540ccf90 0x7f95540ae410 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f954c009e90 tx=0x7f954c009780 comp rx=0 tx=0).stop 2023-10-09T07:00:35.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.078+0000 7f955bdff700 1 -- 172.21.15.71:0/3372591335 shutdown_connections 2023-10-09T07:00:35.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.078+0000 7f955bdff700 1 --2- 172.21.15.71:0/3372591335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95540ccf90 0x7f95540ae410 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:35.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.078+0000 7f955bdff700 1 -- 172.21.15.71:0/3372591335 >> 172.21.15.71:0/3372591335 conn(0x7f955406a320 msgr2=0x7f95540cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:35.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.078+0000 7f955bdff700 1 -- 172.21.15.71:0/3372591335 shutdown_connections 2023-10-09T07:00:35.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.078+0000 7f955bdff700 1 -- 172.21.15.71:0/3372591335 wait complete. 2023-10-09T07:00:35.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.079+0000 7f955bdff700 1 Processor -- start 2023-10-09T07:00:35.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.080+0000 7f955bdff700 1 -- start start 2023-10-09T07:00:35.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.080+0000 7f955bdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95540b1420 0x7f955414f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:35.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.081+0000 7f955bdff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95540cbf30 0x7f9554150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:35.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.081+0000 7f955bdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95540ccf90 0x7f9554150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:35.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.081+0000 7f955bdff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95540c8af0 con 0x7f95540cbf30 2023-10-09T07:00:35.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.081+0000 7f955bdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9554158070 con 0x7f95540ccf90 2023-10-09T07:00:35.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.081+0000 7f955bdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95540c8250 con 0x7f95540b1420 2023-10-09T07:00:35.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.081+0000 7f955939a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95540cbf30 0x7f9554150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:35.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.081+0000 7f955939a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95540cbf30 0x7f9554150990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56024/0 (socket says 172.21.15.71:56024) 2023-10-09T07:00:35.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.081+0000 7f955939a700 1 -- 172.21.15.71:0/2202491415 learned_addr learned my addr 172.21.15.71:0/2202491415 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:35.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.081+0000 7f9559b9b700 1 --2- 172.21.15.71:0/2202491415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95540b1420 0x7f955414f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:35.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.081+0000 7f955a39c700 1 --2- 172.21.15.71:0/2202491415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95540ccf90 0x7f9554150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:35.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.081+0000 7f955939a700 1 -- 172.21.15.71:0/2202491415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95540b1420 msgr2=0x7f955414f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:35.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.081+0000 7f955939a700 1 --2- 172.21.15.71:0/2202491415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95540b1420 0x7f955414f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:35.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.081+0000 7f955939a700 1 -- 172.21.15.71:0/2202491415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95540ccf90 msgr2=0x7f9554150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:35.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.081+0000 7f955939a700 1 --2- 172.21.15.71:0/2202491415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95540ccf90 0x7f9554150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:35.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.081+0000 7f955939a700 1 -- 172.21.15.71:0/2202491415 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954c009a20 con 0x7f95540cbf30 2023-10-09T07:00:35.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.081+0000 7f955939a700 1 --2- 172.21.15.71:0/2202491415 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95540cbf30 0x7f9554150990 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f954400c790 tx=0x7f9544007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:35.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.082+0000 7f9549ffb700 1 -- 172.21.15.71:0/2202491415 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544010510 con 0x7f95540cbf30 2023-10-09T07:00:35.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.082+0000 7f9549ffb700 1 -- 172.21.15.71:0/2202491415 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95440106b0 con 0x7f95540cbf30 2023-10-09T07:00:35.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.082+0000 7f955bdff700 1 -- 172.21.15.71:0/2202491415 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95540c8530 con 0x7f95540cbf30 2023-10-09T07:00:35.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.082+0000 7f9549ffb700 1 -- 172.21.15.71:0/2202491415 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544010a70 con 0x7f95540cbf30 2023-10-09T07:00:35.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.082+0000 7f955bdff700 1 -- 172.21.15.71:0/2202491415 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f955414fd50 con 0x7f95540cbf30 2023-10-09T07:00:35.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.083+0000 7f955bdff700 1 -- 172.21.15.71:0/2202491415 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f955404c3c0 con 0x7f95540cbf30 2023-10-09T07:00:35.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.084+0000 7f9549ffb700 1 -- 172.21.15.71:0/2202491415 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f954401b400 con 0x7f95540cbf30 2023-10-09T07:00:35.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.084+0000 7f9549ffb700 1 --2- 172.21.15.71:0/2202491415 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9538066f30 0x7f95380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:35.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.085+0000 7f9549ffb700 1 -- 172.21.15.71:0/2202491415 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f95440842c0 con 0x7f95540cbf30 2023-10-09T07:00:35.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.085+0000 7f9559b9b700 1 --2- 172.21.15.71:0/2202491415 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9538066f30 0x7f95380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:35.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.086+0000 7f9559b9b700 1 --2- 172.21.15.71:0/2202491415 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9538066f30 0x7f95380693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9550005ba0 tx=0x7f9550001500 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:35.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.088+0000 7f9549ffb700 1 -- 172.21.15.71:0/2202491415 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95440513a0 con 0x7f95540cbf30 2023-10-09T07:00:35.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.323+0000 7f955bdff700 1 -- 172.21.15.71:0/2202491415 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f955406f8a0 con 0x7f95540cbf30 2023-10-09T07:00:35.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.323+0000 7f9549ffb700 1 -- 172.21.15.71:0/2202491415 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f95440549c0 con 0x7f95540cbf30 2023-10-09T07:00:35.325 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:00:35.325 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7378,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1918195834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1918195834},{"type":"v1","addr":"172.21.15.179:6834","nonce":1918195834}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7644,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3880476818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3880476818},{"type":"v1","addr":"172.21.15.71:6833","nonce":3880476818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7656,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/4215423233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":4215423233},{"type":"v1","addr":"172.21.15.179:6836","nonce":4215423233}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:00:31.315026+0000","modified":"2023-10-09T07:00:34.863796+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/3141191512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3141191512},{"type":"v1","addr":"172.21.15.71:6835","nonce":3141191512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T07:00:35.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.325+0000 7f955bdff700 1 -- 172.21.15.71:0/2202491415 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9538066f30 msgr2=0x7f95380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:35.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.325+0000 7f955bdff700 1 --2- 172.21.15.71:0/2202491415 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9538066f30 0x7f95380693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9550005ba0 tx=0x7f9550001500 comp rx=0 tx=0).stop 2023-10-09T07:00:35.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.325+0000 7f955bdff700 1 -- 172.21.15.71:0/2202491415 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95540cbf30 msgr2=0x7f9554150990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:35.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.325+0000 7f955bdff700 1 --2- 172.21.15.71:0/2202491415 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95540cbf30 0x7f9554150990 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f954400c790 tx=0x7f9544007e40 comp rx=0 tx=0).stop 2023-10-09T07:00:35.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.326+0000 7f955bdff700 1 -- 172.21.15.71:0/2202491415 shutdown_connections 2023-10-09T07:00:35.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.326+0000 7f955bdff700 1 --2- 172.21.15.71:0/2202491415 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9538066f30 0x7f95380693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:35.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.326+0000 7f955bdff700 1 --2- 172.21.15.71:0/2202491415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95540ccf90 0x7f9554150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:35.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.326+0000 7f955bdff700 1 --2- 172.21.15.71:0/2202491415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95540b1420 0x7f955414f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:35.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.326+0000 7f955bdff700 1 --2- 172.21.15.71:0/2202491415 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95540cbf30 0x7f9554150990 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:35.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.326+0000 7f955bdff700 1 -- 172.21.15.71:0/2202491415 >> 172.21.15.71:0/2202491415 conn(0x7f955406a320 msgr2=0x7f95540afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:35.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.326+0000 7f955bdff700 1 -- 172.21.15.71:0/2202491415 shutdown_connections 2023-10-09T07:00:35.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.326+0000 7f955bdff700 1 -- 172.21.15.71:0/2202491415 wait complete. 2023-10-09T07:00:35.329 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 58 2023-10-09T07:00:35.344 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:00:35.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.525+0000 7f280939d700 1 Processor -- start 2023-10-09T07:00:35.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.526+0000 7f280939d700 1 -- start start 2023-10-09T07:00:35.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.527+0000 7f280939d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2804150550 0x7f2804157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:35.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.527+0000 7f280939d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f28040c7410 0x7f2804069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:35.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.527+0000 7f280939d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280406e2a0 con 0x7f2804150180 2023-10-09T07:00:35.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.527+0000 7f280939d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280406b2e0 con 0x7f28040c7410 2023-10-09T07:00:35.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.527+0000 7f280939d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28040c78e0 con 0x7f2804150550 2023-10-09T07:00:35.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.527+0000 7f2808b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f28040c7410 0x7f2804069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:35.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.527+0000 7f2803fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f2804150180 0x7f28040c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34004/0 (socket says 172.21.15.71:34004) 2023-10-09T07:00:35.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.527+0000 7f2803fff700 1 -- 172.21.15.71:0/3420748194 learned_addr learned my addr 172.21.15.71:0/3420748194 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:35.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.527+0000 7f28037fe700 1 --2- 172.21.15.71:0/3420748194 >> v2:172.21.15.179:3300/0 conn(0x7f2804150550 0x7f2804157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:35.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.528+0000 7f2808b9c700 1 -- 172.21.15.71:0/3420748194 >> v2:172.21.15.179:3300/0 conn(0x7f2804150550 msgr2=0x7f2804157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:35.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.528+0000 7f2808b9c700 1 --2- 172.21.15.71:0/3420748194 >> v2:172.21.15.179:3300/0 conn(0x7f2804150550 0x7f2804157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:35.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.528+0000 7f2808b9c700 1 -- 172.21.15.71:0/3420748194 >> v1:172.21.15.71:6789/0 conn(0x7f2804150180 legacy=0x7f28040c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:35.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.528+0000 7f2808b9c700 1 -- 172.21.15.71:0/3420748194 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28040c7bc0 con 0x7f28040c7410 2023-10-09T07:00:35.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.528+0000 7f2802ffd700 1 -- 172.21.15.71:0/3420748194 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 265870868 0 0) 0x7f280406e2a0 con 0x7f2804150180 2023-10-09T07:00:35.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.528+0000 7f2808b9c700 1 --2- 172.21.15.71:0/3420748194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28040c7410 0x7f2804069f50 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f280406d1e0 tx=0x7f27fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb43676a3f92018 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:35.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.528+0000 7f2802ffd700 1 -- 172.21.15.71:0/3420748194 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc00e070 con 0x7f28040c7410 2023-10-09T07:00:35.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.528+0000 7f2802ffd700 1 -- 172.21.15.71:0/3420748194 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc00bb60 con 0x7f28040c7410 2023-10-09T07:00:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.528+0000 7f2802ffd700 1 -- 172.21.15.71:0/3420748194 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc012430 con 0x7f28040c7410 2023-10-09T07:00:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.529+0000 7f280939d700 1 -- 172.21.15.71:0/3420748194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28040c7410 msgr2=0x7f2804069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.529+0000 7f280939d700 1 --2- 172.21.15.71:0/3420748194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28040c7410 0x7f2804069f50 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f280406d1e0 tx=0x7f27fc009780 comp rx=0 tx=0).stop 2023-10-09T07:00:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.529+0000 7f280939d700 1 -- 172.21.15.71:0/3420748194 shutdown_connections 2023-10-09T07:00:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.529+0000 7f280939d700 1 --2- 172.21.15.71:0/3420748194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28040c7410 0x7f2804069f50 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.529+0000 7f280939d700 1 --2- 172.21.15.71:0/3420748194 >> v2:172.21.15.179:3300/0 conn(0x7f2804150550 0x7f2804157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.529+0000 7f280939d700 1 -- 172.21.15.71:0/3420748194 >> 172.21.15.71:0/3420748194 conn(0x7f28040cc1f0 msgr2=0x7f28040cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.529+0000 7f280939d700 1 -- 172.21.15.71:0/3420748194 shutdown_connections 2023-10-09T07:00:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.529+0000 7f280939d700 1 -- 172.21.15.71:0/3420748194 wait complete. 2023-10-09T07:00:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.530+0000 7f280939d700 1 Processor -- start 2023-10-09T07:00:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.530+0000 7f280939d700 1 -- start start 2023-10-09T07:00:35.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.531+0000 7f280939d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28040c7410 0x7f28040c0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:35.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.531+0000 7f280939d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2804150180 0x7f280416a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:35.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.531+0000 7f280939d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2804150550 0x7f28040b0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:35.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.531+0000 7f280939d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280416a5b0 con 0x7f28040c7410 2023-10-09T07:00:35.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.531+0000 7f280939d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28040c1670 con 0x7f2804150180 2023-10-09T07:00:35.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.531+0000 7f280939d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28040c1950 con 0x7f2804150550 2023-10-09T07:00:35.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.531+0000 7f2803fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28040c7410 0x7f28040c0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:35.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.531+0000 7f2803fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28040c7410 0x7f28040c0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56048/0 (socket says 172.21.15.71:56048) 2023-10-09T07:00:35.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.532+0000 7f2803fff700 1 -- 172.21.15.71:0/3972502236 learned_addr learned my addr 172.21.15.71:0/3972502236 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:35.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.532+0000 7f28037fe700 1 --2- 172.21.15.71:0/3972502236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2804150180 0x7f280416a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:35.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.532+0000 7f2808b9c700 1 --2- 172.21.15.71:0/3972502236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2804150550 0x7f28040b0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:35.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.532+0000 7f2803fff700 1 -- 172.21.15.71:0/3972502236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2804150550 msgr2=0x7f28040b0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:35.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.532+0000 7f2803fff700 1 --2- 172.21.15.71:0/3972502236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2804150550 0x7f28040b0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:35.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.532+0000 7f2803fff700 1 -- 172.21.15.71:0/3972502236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2804150180 msgr2=0x7f280416a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:35.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.532+0000 7f2803fff700 1 --2- 172.21.15.71:0/3972502236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2804150180 0x7f280416a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:35.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.532+0000 7f2803fff700 1 -- 172.21.15.71:0/3972502236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27fc009a20 con 0x7f28040c7410 2023-10-09T07:00:35.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.532+0000 7f2808b9c700 1 --2- 172.21.15.71:0/3972502236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2804150550 0x7f28040b0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:00:35.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.532+0000 7f2803fff700 1 --2- 172.21.15.71:0/3972502236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28040c7410 0x7f28040c0f90 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f27f400c5b0 tx=0x7f27f4001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:35.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.532+0000 7f27ebfff700 1 -- 172.21.15.71:0/3972502236 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f4005b30 con 0x7f28040c7410 2023-10-09T07:00:35.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.532+0000 7f27ebfff700 1 -- 172.21.15.71:0/3972502236 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f4005c90 con 0x7f28040c7410 2023-10-09T07:00:35.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.532+0000 7f27ebfff700 1 -- 172.21.15.71:0/3972502236 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f4007300 con 0x7f28040c7410 2023-10-09T07:00:35.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.532+0000 7f280939d700 1 -- 172.21.15.71:0/3972502236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28040c1c30 con 0x7f28040c7410 2023-10-09T07:00:35.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.533+0000 7f280939d700 1 -- 172.21.15.71:0/3972502236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28040c21f0 con 0x7f28040c7410 2023-10-09T07:00:35.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.534+0000 7f280939d700 1 -- 172.21.15.71:0/3972502236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280404c3c0 con 0x7f28040c7410 2023-10-09T07:00:35.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.534+0000 7f27ebfff700 1 -- 172.21.15.71:0/3972502236 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f27f401b3b0 con 0x7f28040c7410 2023-10-09T07:00:35.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.535+0000 7f27ebfff700 1 --2- 172.21.15.71:0/3972502236 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27f0066f30 0x7f27f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:35.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.535+0000 7f27ebfff700 1 -- 172.21.15.71:0/3972502236 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f27f4083bf0 con 0x7f28040c7410 2023-10-09T07:00:35.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.536+0000 7f28037fe700 1 --2- 172.21.15.71:0/3972502236 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27f0066f30 0x7f27f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:35.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.537+0000 7f28037fe700 1 --2- 172.21.15.71:0/3972502236 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27f0066f30 0x7f27f00693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f28040c6680 tx=0x7f27f80091a0 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:35.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.539+0000 7f27ebfff700 1 -- 172.21.15.71:0/3972502236 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27f4050cd0 con 0x7f28040c7410 2023-10-09T07:00:35.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.728+0000 7f280939d700 1 -- 172.21.15.71:0/3972502236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f280406ada0 con 0x7f28040c7410 2023-10-09T07:00:35.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.729+0000 7f27ebfff700 1 -- 172.21.15.71:0/3972502236 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+15958 (secure 0 0 0) 0x7f27f4017020 con 0x7f28040c7410 2023-10-09T07:00:35.730 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:00:35.731 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":123,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:00:32.852215+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:00:28.965075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T07:00:30.294796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:00:35.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.732+0000 7f280939d700 1 -- 172.21.15.71:0/3972502236 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27f0066f30 msgr2=0x7f27f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:35.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.732+0000 7f280939d700 1 --2- 172.21.15.71:0/3972502236 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27f0066f30 0x7f27f00693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f28040c6680 tx=0x7f27f80091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:35.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.732+0000 7f280939d700 1 -- 172.21.15.71:0/3972502236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28040c7410 msgr2=0x7f28040c0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:35.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.732+0000 7f280939d700 1 --2- 172.21.15.71:0/3972502236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28040c7410 0x7f28040c0f90 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f27f400c5b0 tx=0x7f27f4001070 comp rx=0 tx=0).stop 2023-10-09T07:00:35.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.732+0000 7f280939d700 1 -- 172.21.15.71:0/3972502236 shutdown_connections 2023-10-09T07:00:35.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.732+0000 7f280939d700 1 --2- 172.21.15.71:0/3972502236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2804150550 0x7f28040b0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:35.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.732+0000 7f280939d700 1 --2- 172.21.15.71:0/3972502236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28040c7410 0x7f28040c0f90 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:35.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.732+0000 7f280939d700 1 --2- 172.21.15.71:0/3972502236 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27f0066f30 0x7f27f00693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:35.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.732+0000 7f280939d700 1 --2- 172.21.15.71:0/3972502236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2804150180 0x7f280416a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:35.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.732+0000 7f280939d700 1 -- 172.21.15.71:0/3972502236 >> 172.21.15.71:0/3972502236 conn(0x7f28040cc1f0 msgr2=0x7f28041562e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:35.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.732+0000 7f280939d700 1 -- 172.21.15.71:0/3972502236 shutdown_connections 2023-10-09T07:00:35.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.732+0000 7f280939d700 1 -- 172.21.15.71:0/3972502236 wait complete. 2023-10-09T07:00:35.750 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T07:00:35.751 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T07:00:35.816 INFO:tasks.ceph.mds.a.smithi071.stderr:2023-10-09T07:00:35.815+0000 7fa8333f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T07:00:35.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.933+0000 7fc0db59e700 1 Processor -- start 2023-10-09T07:00:35.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.933+0000 7fc0db59e700 1 -- start start 2023-10-09T07:00:35.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.934+0000 7fc0db59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0dc0c6c60 0x7fc0dc0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:35.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.934+0000 7fc0db59e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc0dc06e8c0 0x7fc0dc0c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:35.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.934+0000 7fc0db59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0dc0b1410 con 0x7fc0dc1595a0 2023-10-09T07:00:35.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.934+0000 7fc0db59e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0dc0b2b90 con 0x7fc0dc06e8c0 2023-10-09T07:00:35.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.934+0000 7fc0db59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc063230 con 0x7fc0dc0c6c60 2023-10-09T07:00:35.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.934+0000 7fc0dad9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc0dc06e8c0 0x7fc0dc0c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:35.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.934+0000 7fc0dad9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc0dc06e8c0 0x7fc0dc0c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56054/0 (socket says 172.21.15.71:56054) 2023-10-09T07:00:35.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.934+0000 7fc0dad9d700 1 -- 172.21.15.71:0/3342911659 learned_addr learned my addr 172.21.15.71:0/3342911659 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:35.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.935+0000 7fc0d3fff700 1 --2- 172.21.15.71:0/3342911659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0dc0c6c60 0x7fc0dc0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:35.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.935+0000 7fc0dad9d700 1 -- 172.21.15.71:0/3342911659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0dc0c6c60 msgr2=0x7fc0dc0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:35.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.935+0000 7fc0dad9d700 1 --2- 172.21.15.71:0/3342911659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0dc0c6c60 0x7fc0dc0c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:35.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.935+0000 7fc0dad9d700 1 -- 172.21.15.71:0/3342911659 >> v1:172.21.15.179:6789/0 conn(0x7fc0dc1595a0 legacy=0x7fc0dc0b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:35.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.935+0000 7fc0dad9d700 1 -- 172.21.15.71:0/3342911659 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0dc0634f0 con 0x7fc0dc06e8c0 2023-10-09T07:00:35.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.935+0000 7fc0dad9d700 1 --2- 172.21.15.71:0/3342911659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0dc06e8c0 0x7fc0dc0c8660 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4009f20 tx=0x7fc0d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7ac2fca344e682 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:35.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.935+0000 7fc0d9d9b700 1 -- 172.21.15.71:0/3342911659 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d400e070 con 0x7fc0dc06e8c0 2023-10-09T07:00:35.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.935+0000 7fc0d9d9b700 1 -- 172.21.15.71:0/3342911659 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d400b9d0 con 0x7fc0dc06e8c0 2023-10-09T07:00:35.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.935+0000 7fc0d9d9b700 1 -- 172.21.15.71:0/3342911659 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40092e0 con 0x7fc0dc06e8c0 2023-10-09T07:00:35.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.936+0000 7fc0db59e700 1 -- 172.21.15.71:0/3342911659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0dc06e8c0 msgr2=0x7fc0dc0c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:35.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.936+0000 7fc0db59e700 1 --2- 172.21.15.71:0/3342911659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0dc06e8c0 0x7fc0dc0c8660 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4009f20 tx=0x7fc0d4009840 comp rx=0 tx=0).stop 2023-10-09T07:00:35.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.936+0000 7fc0db59e700 1 -- 172.21.15.71:0/3342911659 shutdown_connections 2023-10-09T07:00:35.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.936+0000 7fc0db59e700 1 --2- 172.21.15.71:0/3342911659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0dc06e8c0 0x7fc0dc0c8660 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:35.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.936+0000 7fc0db59e700 1 --2- 172.21.15.71:0/3342911659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0dc0c6c60 0x7fc0dc0c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:35.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.936+0000 7fc0db59e700 1 -- 172.21.15.71:0/3342911659 >> 172.21.15.71:0/3342911659 conn(0x7fc0dc06ddb0 msgr2=0x7fc0dc06e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:35.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.936+0000 7fc0db59e700 1 -- 172.21.15.71:0/3342911659 shutdown_connections 2023-10-09T07:00:35.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.936+0000 7fc0db59e700 1 -- 172.21.15.71:0/3342911659 wait complete. 2023-10-09T07:00:35.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.937+0000 7fc0db59e700 1 Processor -- start 2023-10-09T07:00:35.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.938+0000 7fc0db59e700 1 -- start start 2023-10-09T07:00:35.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.938+0000 7fc0db59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0dc06e8c0 0x7fc0dc13d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:35.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.938+0000 7fc0db59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0dc0c6c60 0x7fc0dc15a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:35.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.938+0000 7fc0db59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0dc1595a0 0x7fc0dc1515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:35.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.938+0000 7fc0db59e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc14bbc0 con 0x7fc0dc1595a0 2023-10-09T07:00:35.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.938+0000 7fc0db59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc15acb0 con 0x7fc0dc0c6c60 2023-10-09T07:00:35.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.938+0000 7fc0db59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc15af90 con 0x7fc0dc06e8c0 2023-10-09T07:00:35.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.939+0000 7fc0dad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0dc1595a0 0x7fc0dc1515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:35.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.939+0000 7fc0dad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0dc1595a0 0x7fc0dc1515d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56066/0 (socket says 172.21.15.71:56066) 2023-10-09T07:00:35.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.939+0000 7fc0dad9d700 1 -- 172.21.15.71:0/1266486076 learned_addr learned my addr 172.21.15.71:0/1266486076 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:35.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.939+0000 7fc0da59c700 1 --2- 172.21.15.71:0/1266486076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0dc06e8c0 0x7fc0dc13d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:35.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.939+0000 7fc0d3fff700 1 --2- 172.21.15.71:0/1266486076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0dc0c6c60 0x7fc0dc15a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:35.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.939+0000 7fc0dad9d700 1 -- 172.21.15.71:0/1266486076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0dc06e8c0 msgr2=0x7fc0dc13d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:35.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.939+0000 7fc0dad9d700 1 --2- 172.21.15.71:0/1266486076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0dc06e8c0 0x7fc0dc13d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:35.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.939+0000 7fc0dad9d700 1 -- 172.21.15.71:0/1266486076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0dc0c6c60 msgr2=0x7fc0dc15a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:35.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.939+0000 7fc0dad9d700 1 --2- 172.21.15.71:0/1266486076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0dc0c6c60 0x7fc0dc15a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:35.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.939+0000 7fc0dad9d700 1 -- 172.21.15.71:0/1266486076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d4009ae0 con 0x7fc0dc1595a0 2023-10-09T07:00:35.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.939+0000 7fc0dad9d700 1 --2- 172.21.15.71:0/1266486076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0dc1595a0 0x7fc0dc1515d0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fc0d400b610 tx=0x7fc0d4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:35.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.940+0000 7fc0d27fc700 1 -- 172.21.15.71:0/1266486076 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4008ae0 con 0x7fc0dc1595a0 2023-10-09T07:00:35.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.940+0000 7fc0d27fc700 1 -- 172.21.15.71:0/1266486076 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d4008c40 con 0x7fc0dc1595a0 2023-10-09T07:00:35.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.940+0000 7fc0d27fc700 1 -- 172.21.15.71:0/1266486076 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4026460 con 0x7fc0dc1595a0 2023-10-09T07:00:35.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.940+0000 7fc0db59e700 1 -- 172.21.15.71:0/1266486076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0dc15b270 con 0x7fc0dc1595a0 2023-10-09T07:00:35.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.940+0000 7fc0db59e700 1 -- 172.21.15.71:0/1266486076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0dc15a870 con 0x7fc0dc1595a0 2023-10-09T07:00:35.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.941+0000 7fc0db59e700 1 -- 172.21.15.71:0/1266486076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0dc14bd70 con 0x7fc0dc1595a0 2023-10-09T07:00:35.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.942+0000 7fc0d27fc700 1 -- 172.21.15.71:0/1266486076 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc0d4003040 con 0x7fc0dc1595a0 2023-10-09T07:00:35.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.943+0000 7fc0d27fc700 1 --2- 172.21.15.71:0/1266486076 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc0bc066f30 0x7fc0bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:35.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.943+0000 7fc0d27fc700 1 -- 172.21.15.71:0/1266486076 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fc0d4086530 con 0x7fc0dc1595a0 2023-10-09T07:00:35.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.943+0000 7fc0da59c700 1 --2- 172.21.15.71:0/1266486076 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc0bc066f30 0x7fc0bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:35.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.944+0000 7fc0da59c700 1 --2- 172.21.15.71:0/1266486076 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc0bc066f30 0x7fc0bc0693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc0039e0 tx=0x7fc0cc007ec0 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:35.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:35.947+0000 7fc0d27fc700 1 -- 172.21.15.71:0/1266486076 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0dc14bd70 con 0x7fc0dc1595a0 2023-10-09T07:00:36.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.132+0000 7fc0db59e700 1 -- 172.21.15.71:0/1266486076 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc0dc15aa90 con 0x7fc0bc066f30 2023-10-09T07:00:36.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.143+0000 7fc0d27fc700 1 -- 172.21.15.71:0/1266486076 <== mgr.7201 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289495 (secure 0 0 0) 0x7fc0cc002690 con 0x7fc0bc066f30 2023-10-09T07:00:36.148 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:00:36.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.147+0000 7fc0db59e700 1 -- 172.21.15.71:0/1266486076 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc0bc066f30 msgr2=0x7fc0bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:36.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.147+0000 7fc0db59e700 1 --2- 172.21.15.71:0/1266486076 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc0bc066f30 0x7fc0bc0693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc0039e0 tx=0x7fc0cc007ec0 comp rx=0 tx=0).stop 2023-10-09T07:00:36.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.147+0000 7fc0db59e700 1 -- 172.21.15.71:0/1266486076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0dc1595a0 msgr2=0x7fc0dc1515d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:36.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.147+0000 7fc0db59e700 1 --2- 172.21.15.71:0/1266486076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0dc1595a0 0x7fc0dc1515d0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fc0d400b610 tx=0x7fc0d4018000 comp rx=0 tx=0).stop 2023-10-09T07:00:36.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.148+0000 7fc0db59e700 1 -- 172.21.15.71:0/1266486076 shutdown_connections 2023-10-09T07:00:36.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.148+0000 7fc0db59e700 1 --2- 172.21.15.71:0/1266486076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0dc1595a0 0x7fc0dc1515d0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:36.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.148+0000 7fc0db59e700 1 --2- 172.21.15.71:0/1266486076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0dc06e8c0 0x7fc0dc13d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:36.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.148+0000 7fc0db59e700 1 --2- 172.21.15.71:0/1266486076 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc0bc066f30 0x7fc0bc0693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:36.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.148+0000 7fc0db59e700 1 --2- 172.21.15.71:0/1266486076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0dc0c6c60 0x7fc0dc15a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:36.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.148+0000 7fc0db59e700 1 -- 172.21.15.71:0/1266486076 >> 172.21.15.71:0/1266486076 conn(0x7fc0dc06ddb0 msgr2=0x7fc0dc156f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:36.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.148+0000 7fc0db59e700 1 -- 172.21.15.71:0/1266486076 shutdown_connections 2023-10-09T07:00:36.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.148+0000 7fc0db59e700 1 -- 172.21.15.71:0/1266486076 wait complete. 2023-10-09T07:00:36.151 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T07:00:36.166 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-09T07:00:34.929209+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":403,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2440552,"kb_used_data":13096,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752534168,"statfs":{"total":773094113280,"available":770594988032,"internally_reserved":0,"allocated":13410304,"data_stored":7144812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.096530"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.864829+0000","last_change":"2023-10-09T07:00:31.856989+0000","last_active":"2023-10-09T07:00:31.864829+0000","last_peered":"2023-10-09T07:00:31.864829+0000","last_clean":"2023-10-09T07:00:31.864829+0000","last_became_active":"2023-10-09T07:00:31.856727+0000","last_became_peered":"2023-10-09T07:00:31.856727+0000","last_unstale":"2023-10-09T07:00:31.864829+0000","last_undegraded":"2023-10-09T07:00:31.864829+0000","last_fullsized":"2023-10-09T07:00:31.864829+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:58:02.933062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.863501+0000","last_change":"2023-10-09T07:00:31.856051+0000","last_active":"2023-10-09T07:00:31.863501+0000","last_peered":"2023-10-09T07:00:31.863501+0000","last_clean":"2023-10-09T07:00:31.863501+0000","last_became_active":"2023-10-09T07:00:31.855775+0000","last_became_peered":"2023-10-09T07:00:31.855775+0000","last_unstale":"2023-10-09T07:00:31.863501+0000","last_undegraded":"2023-10-09T07:00:31.863501+0000","last_fullsized":"2023-10-09T07:00:31.863501+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:09.619313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.864235+0000","last_change":"2023-10-09T07:00:31.856398+0000","last_active":"2023-10-09T07:00:31.864235+0000","last_peered":"2023-10-09T07:00:31.864235+0000","last_clean":"2023-10-09T07:00:31.864235+0000","last_became_active":"2023-10-09T07:00:31.856184+0000","last_became_peered":"2023-10-09T07:00:31.856184+0000","last_unstale":"2023-10-09T07:00:31.864235+0000","last_undegraded":"2023-10-09T07:00:31.864235+0000","last_fullsized":"2023-10-09T07:00:31.864235+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:51.981587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.866563+0000","last_change":"2023-10-09T07:00:31.863594+0000","last_active":"2023-10-09T07:00:31.866563+0000","last_peered":"2023-10-09T07:00:31.866563+0000","last_clean":"2023-10-09T07:00:31.866563+0000","last_became_active":"2023-10-09T07:00:31.863355+0000","last_became_peered":"2023-10-09T07:00:31.863355+0000","last_unstale":"2023-10-09T07:00:31.866563+0000","last_undegraded":"2023-10-09T07:00:31.866563+0000","last_fullsized":"2023-10-09T07:00:31.866563+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:37:54.661947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.871572+0000","last_change":"2023-10-09T07:00:31.868795+0000","last_active":"2023-10-09T07:00:31.871572+0000","last_peered":"2023-10-09T07:00:31.871572+0000","last_clean":"2023-10-09T07:00:31.871572+0000","last_became_active":"2023-10-09T07:00:31.868524+0000","last_became_peered":"2023-10-09T07:00:31.868524+0000","last_unstale":"2023-10-09T07:00:31.871572+0000","last_undegraded":"2023-10-09T07:00:31.871572+0000","last_fullsized":"2023-10-09T07:00:31.871572+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:17:56.774259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.863416+0000","last_change":"2023-10-09T07:00:31.861908+0000","last_active":"2023-10-09T07:00:31.863416+0000","last_peered":"2023-10-09T07:00:31.863416+0000","last_clean":"2023-10-09T07:00:31.863416+0000","last_became_active":"2023-10-09T07:00:31.861616+0000","last_became_peered":"2023-10-09T07:00:31.861616+0000","last_unstale":"2023-10-09T07:00:31.863416+0000","last_undegraded":"2023-10-09T07:00:31.863416+0000","last_fullsized":"2023-10-09T07:00:31.863416+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:11:49.045249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.863183+0000","last_change":"2023-10-09T07:00:31.861356+0000","last_active":"2023-10-09T07:00:31.863183+0000","last_peered":"2023-10-09T07:00:31.863183+0000","last_clean":"2023-10-09T07:00:31.863183+0000","last_became_active":"2023-10-09T07:00:31.861091+0000","last_became_peered":"2023-10-09T07:00:31.861091+0000","last_unstale":"2023-10-09T07:00:31.863183+0000","last_undegraded":"2023-10-09T07:00:31.863183+0000","last_fullsized":"2023-10-09T07:00:31.863183+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:51:40.761624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.863955+0000","last_change":"2023-10-09T07:00:31.857953+0000","last_active":"2023-10-09T07:00:31.863955+0000","last_peered":"2023-10-09T07:00:31.863955+0000","last_clean":"2023-10-09T07:00:31.863955+0000","last_became_active":"2023-10-09T07:00:31.857634+0000","last_became_peered":"2023-10-09T07:00:31.857634+0000","last_unstale":"2023-10-09T07:00:31.863955+0000","last_undegraded":"2023-10-09T07:00:31.863955+0000","last_fullsized":"2023-10-09T07:00:31.863955+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:12.047920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.865658+0000","last_change":"2023-10-09T07:00:31.862814+0000","last_active":"2023-10-09T07:00:31.865658+0000","last_peered":"2023-10-09T07:00:31.865658+0000","last_clean":"2023-10-09T07:00:31.865658+0000","last_became_active":"2023-10-09T07:00:31.861413+0000","last_became_peered":"2023-10-09T07:00:31.861413+0000","last_unstale":"2023-10-09T07:00:31.865658+0000","last_undegraded":"2023-10-09T07:00:31.865658+0000","last_fullsized":"2023-10-09T07:00:31.865658+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:51:40.761624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.871646+0000","last_change":"2023-10-09T07:00:31.869698+0000","last_active":"2023-10-09T07:00:31.871646+0000","last_peered":"2023-10-09T07:00:31.871646+0000","last_clean":"2023-10-09T07:00:31.871646+0000","last_became_active":"2023-10-09T07:00:31.868375+0000","last_became_peered":"2023-10-09T07:00:31.868375+0000","last_unstale":"2023-10-09T07:00:31.871646+0000","last_undegraded":"2023-10-09T07:00:31.871646+0000","last_fullsized":"2023-10-09T07:00:31.871646+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:01:56.325354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.867760+0000","last_change":"2023-10-09T07:00:31.864998+0000","last_active":"2023-10-09T07:00:31.867760+0000","last_peered":"2023-10-09T07:00:31.867760+0000","last_clean":"2023-10-09T07:00:31.867760+0000","last_became_active":"2023-10-09T07:00:31.864339+0000","last_became_peered":"2023-10-09T07:00:31.864339+0000","last_unstale":"2023-10-09T07:00:31.867760+0000","last_undegraded":"2023-10-09T07:00:31.867760+0000","last_fullsized":"2023-10-09T07:00:31.867760+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:21.164187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.867674+0000","last_change":"2023-10-09T07:00:31.863923+0000","last_active":"2023-10-09T07:00:31.867674+0000","last_peered":"2023-10-09T07:00:31.867674+0000","last_clean":"2023-10-09T07:00:31.867674+0000","last_became_active":"2023-10-09T07:00:31.863676+0000","last_became_peered":"2023-10-09T07:00:31.863676+0000","last_unstale":"2023-10-09T07:00:31.867674+0000","last_undegraded":"2023-10-09T07:00:31.867674+0000","last_fullsized":"2023-10-09T07:00:31.867674+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:03:09.182739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.866576+0000","last_change":"2023-10-09T07:00:31.862343+0000","last_active":"2023-10-09T07:00:31.866576+0000","last_peered":"2023-10-09T07:00:31.866576+0000","last_clean":"2023-10-09T07:00:31.866576+0000","last_became_active":"2023-10-09T07:00:31.862048+0000","last_became_peered":"2023-10-09T07:00:31.862048+0000","last_unstale":"2023-10-09T07:00:31.866576+0000","last_undegraded":"2023-10-09T07:00:31.866576+0000","last_fullsized":"2023-10-09T07:00:31.866576+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:24:19.711264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.867642+0000","last_change":"2023-10-09T07:00:31.863975+0000","last_active":"2023-10-09T07:00:31.867642+0000","last_peered":"2023-10-09T07:00:31.867642+0000","last_clean":"2023-10-09T07:00:31.867642+0000","last_became_active":"2023-10-09T07:00:31.863389+0000","last_became_peered":"2023-10-09T07:00:31.863389+0000","last_unstale":"2023-10-09T07:00:31.867642+0000","last_undegraded":"2023-10-09T07:00:31.867642+0000","last_fullsized":"2023-10-09T07:00:31.867642+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:05:02.882687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.864762+0000","last_change":"2023-10-09T07:00:31.860500+0000","last_active":"2023-10-09T07:00:31.864762+0000","last_peered":"2023-10-09T07:00:31.864762+0000","last_clean":"2023-10-09T07:00:31.864762+0000","last_became_active":"2023-10-09T07:00:31.860093+0000","last_became_peered":"2023-10-09T07:00:31.860093+0000","last_unstale":"2023-10-09T07:00:31.864762+0000","last_undegraded":"2023-10-09T07:00:31.864762+0000","last_fullsized":"2023-10-09T07:00:31.864762+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:09.829024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.867799+0000","last_change":"2023-10-09T07:00:31.864997+0000","last_active":"2023-10-09T07:00:31.867799+0000","last_peered":"2023-10-09T07:00:31.867799+0000","last_clean":"2023-10-09T07:00:31.867799+0000","last_became_active":"2023-10-09T07:00:31.864739+0000","last_became_peered":"2023-10-09T07:00:31.864739+0000","last_unstale":"2023-10-09T07:00:31.867799+0000","last_undegraded":"2023-10-09T07:00:31.867799+0000","last_fullsized":"2023-10-09T07:00:31.867799+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:01:56.325354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.863472+0000","last_change":"2023-10-09T07:00:31.857928+0000","last_active":"2023-10-09T07:00:31.863472+0000","last_peered":"2023-10-09T07:00:31.863472+0000","last_clean":"2023-10-09T07:00:31.863472+0000","last_became_active":"2023-10-09T07:00:31.857661+0000","last_became_peered":"2023-10-09T07:00:31.857661+0000","last_unstale":"2023-10-09T07:00:31.863472+0000","last_undegraded":"2023-10-09T07:00:31.863472+0000","last_fullsized":"2023-10-09T07:00:31.863472+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:14:48.491721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.866626+0000","last_change":"2023-10-09T07:00:31.862424+0000","last_active":"2023-10-09T07:00:31.866626+0000","last_peered":"2023-10-09T07:00:31.866626+0000","last_clean":"2023-10-09T07:00:31.866626+0000","last_became_active":"2023-10-09T07:00:31.862128+0000","last_became_peered":"2023-10-09T07:00:31.862128+0000","last_unstale":"2023-10-09T07:00:31.866626+0000","last_undegraded":"2023-10-09T07:00:31.866626+0000","last_fullsized":"2023-10-09T07:00:31.866626+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:57:37.387414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.875095+0000","last_change":"2023-10-09T07:00:31.869068+0000","last_active":"2023-10-09T07:00:31.875095+0000","last_peered":"2023-10-09T07:00:31.875095+0000","last_clean":"2023-10-09T07:00:31.875095+0000","last_became_active":"2023-10-09T07:00:31.868055+0000","last_became_peered":"2023-10-09T07:00:31.868055+0000","last_unstale":"2023-10-09T07:00:31.875095+0000","last_undegraded":"2023-10-09T07:00:31.875095+0000","last_fullsized":"2023-10-09T07:00:31.875095+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:19:31.492187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.863086+0000","last_change":"2023-10-09T07:00:31.861948+0000","last_active":"2023-10-09T07:00:31.863086+0000","last_peered":"2023-10-09T07:00:31.863086+0000","last_clean":"2023-10-09T07:00:31.863086+0000","last_became_active":"2023-10-09T07:00:31.861657+0000","last_became_peered":"2023-10-09T07:00:31.861657+0000","last_unstale":"2023-10-09T07:00:31.863086+0000","last_undegraded":"2023-10-09T07:00:31.863086+0000","last_fullsized":"2023-10-09T07:00:31.863086+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:11:49.045249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.864560+0000","last_change":"2023-10-09T07:00:31.861297+0000","last_active":"2023-10-09T07:00:31.864560+0000","last_peered":"2023-10-09T07:00:31.864560+0000","last_clean":"2023-10-09T07:00:31.864560+0000","last_became_active":"2023-10-09T07:00:31.860945+0000","last_became_peered":"2023-10-09T07:00:31.860945+0000","last_unstale":"2023-10-09T07:00:31.864560+0000","last_undegraded":"2023-10-09T07:00:31.864560+0000","last_fullsized":"2023-10-09T07:00:31.864560+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:57:41.353175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.860588+0000","last_change":"2023-10-09T07:00:31.852875+0000","last_active":"2023-10-09T07:00:31.860588+0000","last_peered":"2023-10-09T07:00:31.860588+0000","last_clean":"2023-10-09T07:00:31.860588+0000","last_became_active":"2023-10-09T07:00:31.852602+0000","last_became_peered":"2023-10-09T07:00:31.852602+0000","last_unstale":"2023-10-09T07:00:31.860588+0000","last_undegraded":"2023-10-09T07:00:31.860588+0000","last_fullsized":"2023-10-09T07:00:31.860588+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:16.313119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.863567+0000","last_change":"2023-10-09T07:00:31.857690+0000","last_active":"2023-10-09T07:00:31.863567+0000","last_peered":"2023-10-09T07:00:31.863567+0000","last_clean":"2023-10-09T07:00:31.863567+0000","last_became_active":"2023-10-09T07:00:31.857403+0000","last_became_peered":"2023-10-09T07:00:31.857403+0000","last_unstale":"2023-10-09T07:00:31.863567+0000","last_undegraded":"2023-10-09T07:00:31.863567+0000","last_fullsized":"2023-10-09T07:00:31.863567+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:31:31.269146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.868245+0000","last_change":"2023-10-09T07:00:31.867439+0000","last_active":"2023-10-09T07:00:31.868245+0000","last_peered":"2023-10-09T07:00:31.868245+0000","last_clean":"2023-10-09T07:00:31.868245+0000","last_became_active":"2023-10-09T07:00:31.867099+0000","last_became_peered":"2023-10-09T07:00:31.867099+0000","last_unstale":"2023-10-09T07:00:31.868245+0000","last_undegraded":"2023-10-09T07:00:31.868245+0000","last_fullsized":"2023-10-09T07:00:31.868245+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:53.482535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.872887+0000","last_change":"2023-10-09T07:00:31.872280+0000","last_active":"2023-10-09T07:00:31.872887+0000","last_peered":"2023-10-09T07:00:31.872887+0000","last_clean":"2023-10-09T07:00:31.872887+0000","last_became_active":"2023-10-09T07:00:31.871876+0000","last_became_peered":"2023-10-09T07:00:31.871876+0000","last_unstale":"2023-10-09T07:00:31.872887+0000","last_undegraded":"2023-10-09T07:00:31.872887+0000","last_fullsized":"2023-10-09T07:00:31.872887+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:49.063716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.860491+0000","last_change":"2023-10-09T07:00:31.852123+0000","last_active":"2023-10-09T07:00:31.860491+0000","last_peered":"2023-10-09T07:00:31.860491+0000","last_clean":"2023-10-09T07:00:31.860491+0000","last_became_active":"2023-10-09T07:00:31.851803+0000","last_became_peered":"2023-10-09T07:00:31.851803+0000","last_unstale":"2023-10-09T07:00:31.860491+0000","last_undegraded":"2023-10-09T07:00:31.860491+0000","last_fullsized":"2023-10-09T07:00:31.860491+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:43.734125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.869646+0000","last_change":"2023-10-09T07:00:31.868617+0000","last_active":"2023-10-09T07:00:31.869646+0000","last_peered":"2023-10-09T07:00:31.869646+0000","last_clean":"2023-10-09T07:00:31.869646+0000","last_became_active":"2023-10-09T07:00:31.868279+0000","last_became_peered":"2023-10-09T07:00:31.868279+0000","last_unstale":"2023-10-09T07:00:31.869646+0000","last_undegraded":"2023-10-09T07:00:31.869646+0000","last_fullsized":"2023-10-09T07:00:31.869646+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:24:19.711264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.871739+0000","last_change":"2023-10-09T07:00:31.869955+0000","last_active":"2023-10-09T07:00:31.871739+0000","last_peered":"2023-10-09T07:00:31.871739+0000","last_clean":"2023-10-09T07:00:31.871739+0000","last_became_active":"2023-10-09T07:00:31.869389+0000","last_became_peered":"2023-10-09T07:00:31.869389+0000","last_unstale":"2023-10-09T07:00:31.871739+0000","last_undegraded":"2023-10-09T07:00:31.871739+0000","last_fullsized":"2023-10-09T07:00:31.871739+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:37:54.661947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.860622+0000","last_change":"2023-10-09T07:00:31.852746+0000","last_active":"2023-10-09T07:00:31.860622+0000","last_peered":"2023-10-09T07:00:31.860622+0000","last_clean":"2023-10-09T07:00:31.860622+0000","last_became_active":"2023-10-09T07:00:31.850896+0000","last_became_peered":"2023-10-09T07:00:31.850896+0000","last_unstale":"2023-10-09T07:00:31.860622+0000","last_undegraded":"2023-10-09T07:00:31.860622+0000","last_fullsized":"2023-10-09T07:00:31.860622+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:31:30.009466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.875054+0000","last_change":"2023-10-09T07:00:31.869032+0000","last_active":"2023-10-09T07:00:31.875054+0000","last_peered":"2023-10-09T07:00:31.875054+0000","last_clean":"2023-10-09T07:00:31.875054+0000","last_became_active":"2023-10-09T07:00:31.868792+0000","last_became_peered":"2023-10-09T07:00:31.868792+0000","last_unstale":"2023-10-09T07:00:31.875054+0000","last_undegraded":"2023-10-09T07:00:31.875054+0000","last_fullsized":"2023-10-09T07:00:31.875054+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:02.553149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.870559+0000","last_change":"2023-10-09T07:00:31.865984+0000","last_active":"2023-10-09T07:00:31.870559+0000","last_peered":"2023-10-09T07:00:31.870559+0000","last_clean":"2023-10-09T07:00:31.870559+0000","last_became_active":"2023-10-09T07:00:31.865684+0000","last_became_peered":"2023-10-09T07:00:31.865684+0000","last_unstale":"2023-10-09T07:00:31.870559+0000","last_undegraded":"2023-10-09T07:00:31.870559+0000","last_fullsized":"2023-10-09T07:00:31.870559+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:33.043926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.861791+0000","last_change":"2023-10-09T07:00:31.853667+0000","last_active":"2023-10-09T07:00:31.861791+0000","last_peered":"2023-10-09T07:00:31.861791+0000","last_clean":"2023-10-09T07:00:31.861791+0000","last_became_active":"2023-10-09T07:00:31.853396+0000","last_became_peered":"2023-10-09T07:00:31.853396+0000","last_unstale":"2023-10-09T07:00:31.861791+0000","last_undegraded":"2023-10-09T07:00:31.861791+0000","last_fullsized":"2023-10-09T07:00:31.861791+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:17.975207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.867484+0000","last_change":"2023-10-09T07:00:31.862754+0000","last_active":"2023-10-09T07:00:31.867484+0000","last_peered":"2023-10-09T07:00:31.867484+0000","last_clean":"2023-10-09T07:00:31.867484+0000","last_became_active":"2023-10-09T07:00:31.862508+0000","last_became_peered":"2023-10-09T07:00:31.862508+0000","last_unstale":"2023-10-09T07:00:31.867484+0000","last_undegraded":"2023-10-09T07:00:31.867484+0000","last_fullsized":"2023-10-09T07:00:31.867484+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:40:36.144071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"122'4","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.884989+0000","last_change":"2023-10-09T07:00:30.861628+0000","last_active":"2023-10-09T07:00:31.884989+0000","last_peered":"2023-10-09T07:00:31.884989+0000","last_clean":"2023-10-09T07:00:31.884989+0000","last_became_active":"2023-10-09T07:00:30.861119+0000","last_became_peered":"2023-10-09T07:00:30.861119+0000","last_unstale":"2023-10-09T07:00:31.884989+0000","last_undegraded":"2023-10-09T07:00:31.884989+0000","last_fullsized":"2023-10-09T07:00:31.884989+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:13.624752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.870499+0000","last_change":"2023-10-09T07:00:31.866106+0000","last_active":"2023-10-09T07:00:31.870499+0000","last_peered":"2023-10-09T07:00:31.870499+0000","last_clean":"2023-10-09T07:00:31.870499+0000","last_became_active":"2023-10-09T07:00:31.865758+0000","last_became_peered":"2023-10-09T07:00:31.865758+0000","last_unstale":"2023-10-09T07:00:31.870499+0000","last_undegraded":"2023-10-09T07:00:31.870499+0000","last_fullsized":"2023-10-09T07:00:31.870499+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:41:14.043969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.876067+0000","last_change":"2023-10-09T07:00:30.858804+0000","last_active":"2023-10-09T07:00:31.876067+0000","last_peered":"2023-10-09T07:00:31.876067+0000","last_clean":"2023-10-09T07:00:31.876067+0000","last_became_active":"2023-10-09T07:00:30.858480+0000","last_became_peered":"2023-10-09T07:00:30.858480+0000","last_unstale":"2023-10-09T07:00:31.876067+0000","last_undegraded":"2023-10-09T07:00:31.876067+0000","last_fullsized":"2023-10-09T07:00:31.876067+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:01:21.488599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.865003+0000","last_change":"2023-10-09T07:00:31.862120+0000","last_active":"2023-10-09T07:00:31.865003+0000","last_peered":"2023-10-09T07:00:31.865003+0000","last_clean":"2023-10-09T07:00:31.865003+0000","last_became_active":"2023-10-09T07:00:31.861856+0000","last_became_peered":"2023-10-09T07:00:31.861856+0000","last_unstale":"2023-10-09T07:00:31.865003+0000","last_undegraded":"2023-10-09T07:00:31.865003+0000","last_fullsized":"2023-10-09T07:00:31.865003+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:00:08.474575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.884914+0000","last_change":"2023-10-09T07:00:30.854153+0000","last_active":"2023-10-09T07:00:31.884914+0000","last_peered":"2023-10-09T07:00:31.884914+0000","last_clean":"2023-10-09T07:00:31.884914+0000","last_became_active":"2023-10-09T07:00:30.853893+0000","last_became_peered":"2023-10-09T07:00:30.853893+0000","last_unstale":"2023-10-09T07:00:31.884914+0000","last_undegraded":"2023-10-09T07:00:31.884914+0000","last_fullsized":"2023-10-09T07:00:31.884914+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:32.037149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.860961+0000","last_change":"2023-10-09T07:00:31.857292+0000","last_active":"2023-10-09T07:00:31.860961+0000","last_peered":"2023-10-09T07:00:31.860961+0000","last_clean":"2023-10-09T07:00:31.860961+0000","last_became_active":"2023-10-09T07:00:31.857039+0000","last_became_peered":"2023-10-09T07:00:31.857039+0000","last_unstale":"2023-10-09T07:00:31.860961+0000","last_undegraded":"2023-10-09T07:00:31.860961+0000","last_fullsized":"2023-10-09T07:00:31.860961+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:57:31.384067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.884968+0000","last_change":"2023-10-09T07:00:30.855969+0000","last_active":"2023-10-09T07:00:31.884968+0000","last_peered":"2023-10-09T07:00:31.884968+0000","last_clean":"2023-10-09T07:00:31.884968+0000","last_became_active":"2023-10-09T07:00:30.855698+0000","last_became_peered":"2023-10-09T07:00:30.855698+0000","last_unstale":"2023-10-09T07:00:31.884968+0000","last_undegraded":"2023-10-09T07:00:31.884968+0000","last_fullsized":"2023-10-09T07:00:31.884968+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:17:55.767482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.870217+0000","last_change":"2023-10-09T07:00:31.866774+0000","last_active":"2023-10-09T07:00:31.870217+0000","last_peered":"2023-10-09T07:00:31.870217+0000","last_clean":"2023-10-09T07:00:31.870217+0000","last_became_active":"2023-10-09T07:00:31.866488+0000","last_became_peered":"2023-10-09T07:00:31.866488+0000","last_unstale":"2023-10-09T07:00:31.870217+0000","last_undegraded":"2023-10-09T07:00:31.870217+0000","last_fullsized":"2023-10-09T07:00:31.870217+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:24:47.815919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.882334+0000","last_change":"2023-10-09T07:00:30.858699+0000","last_active":"2023-10-09T07:00:31.882334+0000","last_peered":"2023-10-09T07:00:31.882334+0000","last_clean":"2023-10-09T07:00:31.882334+0000","last_became_active":"2023-10-09T07:00:30.858453+0000","last_became_peered":"2023-10-09T07:00:30.858453+0000","last_unstale":"2023-10-09T07:00:31.882334+0000","last_undegraded":"2023-10-09T07:00:31.882334+0000","last_fullsized":"2023-10-09T07:00:31.882334+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:45.931492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.865100+0000","last_change":"2023-10-09T07:00:31.864038+0000","last_active":"2023-10-09T07:00:31.865100+0000","last_peered":"2023-10-09T07:00:31.865100+0000","last_clean":"2023-10-09T07:00:31.865100+0000","last_became_active":"2023-10-09T07:00:31.863780+0000","last_became_peered":"2023-10-09T07:00:31.863780+0000","last_unstale":"2023-10-09T07:00:31.865100+0000","last_undegraded":"2023-10-09T07:00:31.865100+0000","last_fullsized":"2023-10-09T07:00:31.865100+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:37:10.925516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.885035+0000","last_change":"2023-10-09T07:00:30.850599+0000","last_active":"2023-10-09T07:00:31.885035+0000","last_peered":"2023-10-09T07:00:31.885035+0000","last_clean":"2023-10-09T07:00:31.885035+0000","last_became_active":"2023-10-09T07:00:30.850362+0000","last_became_peered":"2023-10-09T07:00:30.850362+0000","last_unstale":"2023-10-09T07:00:31.885035+0000","last_undegraded":"2023-10-09T07:00:31.885035+0000","last_fullsized":"2023-10-09T07:00:31.885035+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:41:13.037192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.863007+0000","last_change":"2023-10-09T07:00:31.855028+0000","last_active":"2023-10-09T07:00:31.863007+0000","last_peered":"2023-10-09T07:00:31.863007+0000","last_clean":"2023-10-09T07:00:31.863007+0000","last_became_active":"2023-10-09T07:00:31.854093+0000","last_became_peered":"2023-10-09T07:00:31.854093+0000","last_unstale":"2023-10-09T07:00:31.863007+0000","last_undegraded":"2023-10-09T07:00:31.863007+0000","last_fullsized":"2023-10-09T07:00:31.863007+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:21.164187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.860183+0000","last_change":"2023-10-09T07:00:30.865516+0000","last_active":"2023-10-09T07:00:31.860183+0000","last_peered":"2023-10-09T07:00:31.860183+0000","last_clean":"2023-10-09T07:00:31.860183+0000","last_became_active":"2023-10-09T07:00:30.865117+0000","last_became_peered":"2023-10-09T07:00:30.865117+0000","last_unstale":"2023-10-09T07:00:31.860183+0000","last_undegraded":"2023-10-09T07:00:31.860183+0000","last_fullsized":"2023-10-09T07:00:31.860183+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:28:23.489668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.862563+0000","last_change":"2023-10-09T07:00:31.855935+0000","last_active":"2023-10-09T07:00:31.862563+0000","last_peered":"2023-10-09T07:00:31.862563+0000","last_clean":"2023-10-09T07:00:31.862563+0000","last_became_active":"2023-10-09T07:00:31.855536+0000","last_became_peered":"2023-10-09T07:00:31.855536+0000","last_unstale":"2023-10-09T07:00:31.862563+0000","last_undegraded":"2023-10-09T07:00:31.862563+0000","last_fullsized":"2023-10-09T07:00:31.862563+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:31.540757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.847964+0000","last_change":"2023-10-09T07:00:30.853530+0000","last_active":"2023-10-09T07:00:31.847964+0000","last_peered":"2023-10-09T07:00:31.847964+0000","last_clean":"2023-10-09T07:00:31.847964+0000","last_became_active":"2023-10-09T07:00:30.853273+0000","last_became_peered":"2023-10-09T07:00:30.853273+0000","last_unstale":"2023-10-09T07:00:31.847964+0000","last_undegraded":"2023-10-09T07:00:31.847964+0000","last_fullsized":"2023-10-09T07:00:31.847964+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:26:03.547881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.863537+0000","last_change":"2023-10-09T07:00:31.858005+0000","last_active":"2023-10-09T07:00:31.863537+0000","last_peered":"2023-10-09T07:00:31.863537+0000","last_clean":"2023-10-09T07:00:31.863537+0000","last_became_active":"2023-10-09T07:00:31.857742+0000","last_became_peered":"2023-10-09T07:00:31.857742+0000","last_unstale":"2023-10-09T07:00:31.863537+0000","last_undegraded":"2023-10-09T07:00:31.863537+0000","last_fullsized":"2023-10-09T07:00:31.863537+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:32:53.663177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.848822+0000","last_change":"2023-10-09T07:00:30.856704+0000","last_active":"2023-10-09T07:00:31.848822+0000","last_peered":"2023-10-09T07:00:31.848822+0000","last_clean":"2023-10-09T07:00:31.848822+0000","last_became_active":"2023-10-09T07:00:30.856456+0000","last_became_peered":"2023-10-09T07:00:30.856456+0000","last_unstale":"2023-10-09T07:00:31.848822+0000","last_undegraded":"2023-10-09T07:00:31.848822+0000","last_fullsized":"2023-10-09T07:00:31.848822+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:41:22.493206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.865639+0000","last_change":"2023-10-09T07:00:31.862758+0000","last_active":"2023-10-09T07:00:31.865639+0000","last_peered":"2023-10-09T07:00:31.865639+0000","last_clean":"2023-10-09T07:00:31.865639+0000","last_became_active":"2023-10-09T07:00:31.861784+0000","last_became_peered":"2023-10-09T07:00:31.861784+0000","last_unstale":"2023-10-09T07:00:31.865639+0000","last_undegraded":"2023-10-09T07:00:31.865639+0000","last_fullsized":"2023-10-09T07:00:31.865639+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:01.930860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.849957+0000","last_change":"2023-10-09T07:00:30.865027+0000","last_active":"2023-10-09T07:00:31.849957+0000","last_peered":"2023-10-09T07:00:31.849957+0000","last_clean":"2023-10-09T07:00:31.849957+0000","last_became_active":"2023-10-09T07:00:30.864779+0000","last_became_peered":"2023-10-09T07:00:30.864779+0000","last_unstale":"2023-10-09T07:00:31.849957+0000","last_undegraded":"2023-10-09T07:00:31.849957+0000","last_fullsized":"2023-10-09T07:00:31.849957+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:00.924083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.872566+0000","last_change":"2023-10-09T07:00:31.871652+0000","last_active":"2023-10-09T07:00:31.872566+0000","last_peered":"2023-10-09T07:00:31.872566+0000","last_clean":"2023-10-09T07:00:31.872566+0000","last_became_active":"2023-10-09T07:00:31.871274+0000","last_became_peered":"2023-10-09T07:00:31.871274+0000","last_unstale":"2023-10-09T07:00:31.872566+0000","last_undegraded":"2023-10-09T07:00:31.872566+0000","last_fullsized":"2023-10-09T07:00:31.872566+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:14.631529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"122'3","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.877559+0000","last_change":"2023-10-09T07:00:30.859218+0000","last_active":"2023-10-09T07:00:31.877559+0000","last_peered":"2023-10-09T07:00:31.877559+0000","last_clean":"2023-10-09T07:00:31.877559+0000","last_became_active":"2023-10-09T07:00:30.858926+0000","last_became_peered":"2023-10-09T07:00:30.858926+0000","last_unstale":"2023-10-09T07:00:31.877559+0000","last_undegraded":"2023-10-09T07:00:31.877559+0000","last_fullsized":"2023-10-09T07:00:31.877559+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:24:46.809142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.867780+0000","last_change":"2023-10-09T07:00:31.865175+0000","last_active":"2023-10-09T07:00:31.867780+0000","last_peered":"2023-10-09T07:00:31.867780+0000","last_clean":"2023-10-09T07:00:31.867780+0000","last_became_active":"2023-10-09T07:00:31.864678+0000","last_became_peered":"2023-10-09T07:00:31.864678+0000","last_unstale":"2023-10-09T07:00:31.867780+0000","last_undegraded":"2023-10-09T07:00:31.867780+0000","last_fullsized":"2023-10-09T07:00:31.867780+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:49.063716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"122'6","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.885309+0000","last_change":"2023-10-09T07:00:30.852565+0000","last_active":"2023-10-09T07:00:31.885309+0000","last_peered":"2023-10-09T07:00:31.885309+0000","last_clean":"2023-10-09T07:00:31.885309+0000","last_became_active":"2023-10-09T07:00:30.852189+0000","last_became_peered":"2023-10-09T07:00:30.852189+0000","last_unstale":"2023-10-09T07:00:31.885309+0000","last_undegraded":"2023-10-09T07:00:31.885309+0000","last_fullsized":"2023-10-09T07:00:31.885309+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:04:10.967996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.862802+0000","last_change":"2023-10-09T07:00:31.856114+0000","last_active":"2023-10-09T07:00:31.862802+0000","last_peered":"2023-10-09T07:00:31.862802+0000","last_clean":"2023-10-09T07:00:31.862802+0000","last_became_active":"2023-10-09T07:00:31.855852+0000","last_became_peered":"2023-10-09T07:00:31.855852+0000","last_unstale":"2023-10-09T07:00:31.862802+0000","last_undegraded":"2023-10-09T07:00:31.862802+0000","last_fullsized":"2023-10-09T07:00:31.862802+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:17:56.774259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.883393+0000","last_change":"2023-10-09T07:00:30.863710+0000","last_active":"2023-10-09T07:00:31.883393+0000","last_peered":"2023-10-09T07:00:31.883393+0000","last_clean":"2023-10-09T07:00:31.883393+0000","last_became_active":"2023-10-09T07:00:30.863221+0000","last_became_peered":"2023-10-09T07:00:30.863221+0000","last_unstale":"2023-10-09T07:00:31.883393+0000","last_undegraded":"2023-10-09T07:00:31.883393+0000","last_fullsized":"2023-10-09T07:00:31.883393+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:05.949770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.864992+0000","last_change":"2023-10-09T07:00:31.862704+0000","last_active":"2023-10-09T07:00:31.864992+0000","last_peered":"2023-10-09T07:00:31.864992+0000","last_clean":"2023-10-09T07:00:31.864992+0000","last_became_active":"2023-10-09T07:00:31.862456+0000","last_became_peered":"2023-10-09T07:00:31.862456+0000","last_unstale":"2023-10-09T07:00:31.864992+0000","last_undegraded":"2023-10-09T07:00:31.864992+0000","last_fullsized":"2023-10-09T07:00:31.864992+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:56:06.442624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.852583+0000","last_change":"2023-10-09T07:00:30.864661+0000","last_active":"2023-10-09T07:00:31.852583+0000","last_peered":"2023-10-09T07:00:31.852583+0000","last_clean":"2023-10-09T07:00:31.852583+0000","last_became_active":"2023-10-09T07:00:30.864403+0000","last_became_peered":"2023-10-09T07:00:30.864403+0000","last_unstale":"2023-10-09T07:00:31.852583+0000","last_undegraded":"2023-10-09T07:00:31.852583+0000","last_fullsized":"2023-10-09T07:00:31.852583+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:28:46.463936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.862488+0000","last_change":"2023-10-09T07:00:31.855868+0000","last_active":"2023-10-09T07:00:31.862488+0000","last_peered":"2023-10-09T07:00:31.862488+0000","last_clean":"2023-10-09T07:00:31.862488+0000","last_became_active":"2023-10-09T07:00:31.855599+0000","last_became_peered":"2023-10-09T07:00:31.855599+0000","last_unstale":"2023-10-09T07:00:31.862488+0000","last_undegraded":"2023-10-09T07:00:31.862488+0000","last_fullsized":"2023-10-09T07:00:31.862488+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:52.686400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.849829+0000","last_change":"2023-10-09T07:00:30.859086+0000","last_active":"2023-10-09T07:00:31.849829+0000","last_peered":"2023-10-09T07:00:31.849829+0000","last_clean":"2023-10-09T07:00:31.849829+0000","last_became_active":"2023-10-09T07:00:30.858796+0000","last_became_peered":"2023-10-09T07:00:30.858796+0000","last_unstale":"2023-10-09T07:00:31.849829+0000","last_undegraded":"2023-10-09T07:00:31.849829+0000","last_fullsized":"2023-10-09T07:00:31.849829+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:59.101699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.868978+0000","last_change":"2023-10-09T07:00:31.866355+0000","last_active":"2023-10-09T07:00:31.868978+0000","last_peered":"2023-10-09T07:00:31.868978+0000","last_clean":"2023-10-09T07:00:31.868978+0000","last_became_active":"2023-10-09T07:00:31.866030+0000","last_became_peered":"2023-10-09T07:00:31.866030+0000","last_unstale":"2023-10-09T07:00:31.868978+0000","last_undegraded":"2023-10-09T07:00:31.868978+0000","last_fullsized":"2023-10-09T07:00:31.868978+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:36:58.290119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"122'8","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.884776+0000","last_change":"2023-10-09T07:00:30.854984+0000","last_active":"2023-10-09T07:00:31.884776+0000","last_peered":"2023-10-09T07:00:31.884776+0000","last_clean":"2023-10-09T07:00:31.884776+0000","last_became_active":"2023-10-09T07:00:30.854733+0000","last_became_peered":"2023-10-09T07:00:30.854733+0000","last_unstale":"2023-10-09T07:00:31.884776+0000","last_undegraded":"2023-10-09T07:00:31.884776+0000","last_fullsized":"2023-10-09T07:00:31.884776+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:09:39.131347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.871844+0000","last_change":"2023-10-09T07:00:31.868986+0000","last_active":"2023-10-09T07:00:31.871844+0000","last_peered":"2023-10-09T07:00:31.871844+0000","last_clean":"2023-10-09T07:00:31.871844+0000","last_became_active":"2023-10-09T07:00:31.868122+0000","last_became_peered":"2023-10-09T07:00:31.868122+0000","last_unstale":"2023-10-09T07:00:31.871844+0000","last_undegraded":"2023-10-09T07:00:31.871844+0000","last_fullsized":"2023-10-09T07:00:31.871844+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:37:10.925516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.883772+0000","last_change":"2023-10-09T07:00:30.853994+0000","last_active":"2023-10-09T07:00:31.883772+0000","last_peered":"2023-10-09T07:00:31.883772+0000","last_clean":"2023-10-09T07:00:31.883772+0000","last_became_active":"2023-10-09T07:00:30.853716+0000","last_became_peered":"2023-10-09T07:00:30.853716+0000","last_unstale":"2023-10-09T07:00:31.883772+0000","last_undegraded":"2023-10-09T07:00:31.883772+0000","last_fullsized":"2023-10-09T07:00:31.883772+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:20:12.551262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.869620+0000","last_change":"2023-10-09T07:00:31.865997+0000","last_active":"2023-10-09T07:00:31.869620+0000","last_peered":"2023-10-09T07:00:31.869620+0000","last_clean":"2023-10-09T07:00:31.869620+0000","last_became_active":"2023-10-09T07:00:31.865707+0000","last_became_peered":"2023-10-09T07:00:31.865707+0000","last_unstale":"2023-10-09T07:00:31.869620+0000","last_undegraded":"2023-10-09T07:00:31.869620+0000","last_fullsized":"2023-10-09T07:00:31.869620+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:30.795417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.881141+0000","last_change":"2023-10-09T07:00:30.862644+0000","last_active":"2023-10-09T07:00:31.881141+0000","last_peered":"2023-10-09T07:00:31.881141+0000","last_clean":"2023-10-09T07:00:31.881141+0000","last_became_active":"2023-10-09T07:00:30.862237+0000","last_became_peered":"2023-10-09T07:00:30.862237+0000","last_unstale":"2023-10-09T07:00:31.881141+0000","last_undegraded":"2023-10-09T07:00:31.881141+0000","last_fullsized":"2023-10-09T07:00:31.881141+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:47:30.822257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.866328+0000","last_change":"2023-10-09T07:00:31.864210+0000","last_active":"2023-10-09T07:00:31.866328+0000","last_peered":"2023-10-09T07:00:31.866328+0000","last_clean":"2023-10-09T07:00:31.866328+0000","last_became_active":"2023-10-09T07:00:31.863918+0000","last_became_peered":"2023-10-09T07:00:31.863918+0000","last_unstale":"2023-10-09T07:00:31.866328+0000","last_undegraded":"2023-10-09T07:00:31.866328+0000","last_fullsized":"2023-10-09T07:00:31.866328+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:14.631529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.844282+0000","last_change":"2023-10-09T07:00:30.850080+0000","last_active":"2023-10-09T07:00:31.844282+0000","last_peered":"2023-10-09T07:00:31.844282+0000","last_clean":"2023-10-09T07:00:31.844282+0000","last_became_active":"2023-10-09T07:00:30.849370+0000","last_became_peered":"2023-10-09T07:00:30.849370+0000","last_unstale":"2023-10-09T07:00:31.844282+0000","last_undegraded":"2023-10-09T07:00:31.844282+0000","last_fullsized":"2023-10-09T07:00:31.844282+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:37:09.918739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.874944+0000","last_change":"2023-10-09T07:00:31.867774+0000","last_active":"2023-10-09T07:00:31.874944+0000","last_peered":"2023-10-09T07:00:31.874944+0000","last_clean":"2023-10-09T07:00:31.874944+0000","last_became_active":"2023-10-09T07:00:31.867457+0000","last_became_peered":"2023-10-09T07:00:31.867457+0000","last_unstale":"2023-10-09T07:00:31.874944+0000","last_undegraded":"2023-10-09T07:00:31.874944+0000","last_fullsized":"2023-10-09T07:00:31.874944+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:33.040357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.885032+0000","last_change":"2023-10-09T07:00:30.867372+0000","last_active":"2023-10-09T07:00:31.885032+0000","last_peered":"2023-10-09T07:00:31.885032+0000","last_clean":"2023-10-09T07:00:31.885032+0000","last_became_active":"2023-10-09T07:00:30.867088+0000","last_became_peered":"2023-10-09T07:00:30.867088+0000","last_unstale":"2023-10-09T07:00:31.885032+0000","last_undegraded":"2023-10-09T07:00:31.885032+0000","last_fullsized":"2023-10-09T07:00:31.885032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:37:53.655170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.875795+0000","last_change":"2023-10-09T07:00:31.868481+0000","last_active":"2023-10-09T07:00:31.875795+0000","last_peered":"2023-10-09T07:00:31.875795+0000","last_clean":"2023-10-09T07:00:31.875795+0000","last_became_active":"2023-10-09T07:00:31.868181+0000","last_became_peered":"2023-10-09T07:00:31.868181+0000","last_unstale":"2023-10-09T07:00:31.875795+0000","last_undegraded":"2023-10-09T07:00:31.875795+0000","last_fullsized":"2023-10-09T07:00:31.875795+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:51:39.132592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.849288+0000","last_change":"2023-10-09T07:00:30.859156+0000","last_active":"2023-10-09T07:00:31.849288+0000","last_peered":"2023-10-09T07:00:31.849288+0000","last_clean":"2023-10-09T07:00:31.849288+0000","last_became_active":"2023-10-09T07:00:30.858611+0000","last_became_peered":"2023-10-09T07:00:30.858611+0000","last_unstale":"2023-10-09T07:00:31.849288+0000","last_undegraded":"2023-10-09T07:00:31.849288+0000","last_fullsized":"2023-10-09T07:00:31.849288+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:20:12.551262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.869987+0000","last_change":"2023-10-09T07:00:31.867119+0000","last_active":"2023-10-09T07:00:31.869987+0000","last_peered":"2023-10-09T07:00:31.869987+0000","last_clean":"2023-10-09T07:00:31.869987+0000","last_became_active":"2023-10-09T07:00:31.866763+0000","last_became_peered":"2023-10-09T07:00:31.866763+0000","last_unstale":"2023-10-09T07:00:31.869987+0000","last_undegraded":"2023-10-09T07:00:31.869987+0000","last_fullsized":"2023-10-09T07:00:31.869987+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:35.705105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.849315+0000","last_change":"2023-10-09T07:00:30.854066+0000","last_active":"2023-10-09T07:00:31.849315+0000","last_peered":"2023-10-09T07:00:31.849315+0000","last_clean":"2023-10-09T07:00:31.849315+0000","last_became_active":"2023-10-09T07:00:30.853808+0000","last_became_peered":"2023-10-09T07:00:30.853808+0000","last_unstale":"2023-10-09T07:00:31.849315+0000","last_undegraded":"2023-10-09T07:00:31.849315+0000","last_fullsized":"2023-10-09T07:00:31.849315+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:59.101699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.871622+0000","last_change":"2023-10-09T07:00:31.867974+0000","last_active":"2023-10-09T07:00:31.871622+0000","last_peered":"2023-10-09T07:00:31.871622+0000","last_clean":"2023-10-09T07:00:31.871622+0000","last_became_active":"2023-10-09T07:00:31.867716+0000","last_became_peered":"2023-10-09T07:00:31.867716+0000","last_unstale":"2023-10-09T07:00:31.871622+0000","last_undegraded":"2023-10-09T07:00:31.871622+0000","last_fullsized":"2023-10-09T07:00:31.871622+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:21.164187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.844057+0000","last_change":"2023-10-09T07:00:30.849894+0000","last_active":"2023-10-09T07:00:31.844057+0000","last_peered":"2023-10-09T07:00:31.844057+0000","last_clean":"2023-10-09T07:00:31.844057+0000","last_became_active":"2023-10-09T07:00:30.849635+0000","last_became_peered":"2023-10-09T07:00:30.849635+0000","last_unstale":"2023-10-09T07:00:31.844057+0000","last_undegraded":"2023-10-09T07:00:31.844057+0000","last_fullsized":"2023-10-09T07:00:31.844057+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:57:36.380637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.863520+0000","last_change":"2023-10-09T07:00:31.856356+0000","last_active":"2023-10-09T07:00:31.863520+0000","last_peered":"2023-10-09T07:00:31.863520+0000","last_clean":"2023-10-09T07:00:31.863520+0000","last_became_active":"2023-10-09T07:00:31.855473+0000","last_became_peered":"2023-10-09T07:00:31.855473+0000","last_unstale":"2023-10-09T07:00:31.863520+0000","last_undegraded":"2023-10-09T07:00:31.863520+0000","last_fullsized":"2023-10-09T07:00:31.863520+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:30.260596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.878113+0000","last_change":"2023-10-09T07:00:30.851709+0000","last_active":"2023-10-09T07:00:31.878113+0000","last_peered":"2023-10-09T07:00:31.878113+0000","last_clean":"2023-10-09T07:00:31.878113+0000","last_became_active":"2023-10-09T07:00:30.851371+0000","last_became_peered":"2023-10-09T07:00:30.851371+0000","last_unstale":"2023-10-09T07:00:31.878113+0000","last_undegraded":"2023-10-09T07:00:31.878113+0000","last_fullsized":"2023-10-09T07:00:31.878113+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:04:10.967996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.870398+0000","last_change":"2023-10-09T07:00:31.864737+0000","last_active":"2023-10-09T07:00:31.870398+0000","last_peered":"2023-10-09T07:00:31.870398+0000","last_clean":"2023-10-09T07:00:31.870398+0000","last_became_active":"2023-10-09T07:00:31.864466+0000","last_became_peered":"2023-10-09T07:00:31.864466+0000","last_unstale":"2023-10-09T07:00:31.870398+0000","last_undegraded":"2023-10-09T07:00:31.870398+0000","last_fullsized":"2023-10-09T07:00:31.870398+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:35.912307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.846551+0000","last_change":"2023-10-09T07:00:30.856332+0000","last_active":"2023-10-09T07:00:31.846551+0000","last_peered":"2023-10-09T07:00:31.846551+0000","last_clean":"2023-10-09T07:00:31.846551+0000","last_became_active":"2023-10-09T07:00:30.854538+0000","last_became_peered":"2023-10-09T07:00:30.854538+0000","last_unstale":"2023-10-09T07:00:31.846551+0000","last_undegraded":"2023-10-09T07:00:31.846551+0000","last_fullsized":"2023-10-09T07:00:31.846551+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:08.822247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.870333+0000","last_change":"2023-10-09T07:00:31.864497+0000","last_active":"2023-10-09T07:00:31.870333+0000","last_peered":"2023-10-09T07:00:31.870333+0000","last_clean":"2023-10-09T07:00:31.870333+0000","last_became_active":"2023-10-09T07:00:31.864238+0000","last_became_peered":"2023-10-09T07:00:31.864238+0000","last_unstale":"2023-10-09T07:00:31.870333+0000","last_undegraded":"2023-10-09T07:00:31.870333+0000","last_fullsized":"2023-10-09T07:00:31.870333+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:35:45.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.844147+0000","last_change":"2023-10-09T07:00:30.855625+0000","last_active":"2023-10-09T07:00:31.844147+0000","last_peered":"2023-10-09T07:00:31.844147+0000","last_clean":"2023-10-09T07:00:31.844147+0000","last_became_active":"2023-10-09T07:00:30.855339+0000","last_became_peered":"2023-10-09T07:00:30.855339+0000","last_unstale":"2023-10-09T07:00:31.844147+0000","last_undegraded":"2023-10-09T07:00:31.844147+0000","last_fullsized":"2023-10-09T07:00:31.844147+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:20.157410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.871707+0000","last_change":"2023-10-09T07:00:31.869731+0000","last_active":"2023-10-09T07:00:31.871707+0000","last_peered":"2023-10-09T07:00:31.871707+0000","last_clean":"2023-10-09T07:00:31.871707+0000","last_became_active":"2023-10-09T07:00:31.869458+0000","last_became_peered":"2023-10-09T07:00:31.869458+0000","last_unstale":"2023-10-09T07:00:31.871707+0000","last_undegraded":"2023-10-09T07:00:31.871707+0000","last_fullsized":"2023-10-09T07:00:31.871707+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:09.829024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.860372+0000","last_change":"2023-10-09T07:00:30.861716+0000","last_active":"2023-10-09T07:00:31.860372+0000","last_peered":"2023-10-09T07:00:31.860372+0000","last_clean":"2023-10-09T07:00:31.860372+0000","last_became_active":"2023-10-09T07:00:30.861399+0000","last_became_peered":"2023-10-09T07:00:30.861399+0000","last_unstale":"2023-10-09T07:00:31.860372+0000","last_undegraded":"2023-10-09T07:00:31.860372+0000","last_fullsized":"2023-10-09T07:00:31.860372+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:29.788640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.867664+0000","last_change":"2023-10-09T07:00:31.864147+0000","last_active":"2023-10-09T07:00:31.867664+0000","last_peered":"2023-10-09T07:00:31.867664+0000","last_clean":"2023-10-09T07:00:31.867664+0000","last_became_active":"2023-10-09T07:00:31.863724+0000","last_became_peered":"2023-10-09T07:00:31.863724+0000","last_unstale":"2023-10-09T07:00:31.867664+0000","last_undegraded":"2023-10-09T07:00:31.867664+0000","last_fullsized":"2023-10-09T07:00:31.867664+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:15.135897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.844448+0000","last_change":"2023-10-09T07:00:30.854088+0000","last_active":"2023-10-09T07:00:31.844448+0000","last_peered":"2023-10-09T07:00:31.844448+0000","last_clean":"2023-10-09T07:00:31.844448+0000","last_became_active":"2023-10-09T07:00:30.853806+0000","last_became_peered":"2023-10-09T07:00:30.853806+0000","last_unstale":"2023-10-09T07:00:31.844448+0000","last_undegraded":"2023-10-09T07:00:31.844448+0000","last_fullsized":"2023-10-09T07:00:31.844448+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:24:18.704487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.867725+0000","last_change":"2023-10-09T07:00:31.864829+0000","last_active":"2023-10-09T07:00:31.867725+0000","last_peered":"2023-10-09T07:00:31.867725+0000","last_clean":"2023-10-09T07:00:31.867725+0000","last_became_active":"2023-10-09T07:00:31.864558+0000","last_became_peered":"2023-10-09T07:00:31.864558+0000","last_unstale":"2023-10-09T07:00:31.867725+0000","last_undegraded":"2023-10-09T07:00:31.867725+0000","last_fullsized":"2023-10-09T07:00:31.867725+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:53.482535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.860143+0000","last_change":"2023-10-09T07:00:30.863827+0000","last_active":"2023-10-09T07:00:31.860143+0000","last_peered":"2023-10-09T07:00:31.860143+0000","last_clean":"2023-10-09T07:00:31.860143+0000","last_became_active":"2023-10-09T07:00:30.863575+0000","last_became_peered":"2023-10-09T07:00:30.863575+0000","last_unstale":"2023-10-09T07:00:31.860143+0000","last_undegraded":"2023-10-09T07:00:31.860143+0000","last_fullsized":"2023-10-09T07:00:31.860143+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:24:46.809142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.868105+0000","last_change":"2023-10-09T07:00:31.865234+0000","last_active":"2023-10-09T07:00:31.868105+0000","last_peered":"2023-10-09T07:00:31.868105+0000","last_clean":"2023-10-09T07:00:31.868105+0000","last_became_active":"2023-10-09T07:00:31.864985+0000","last_became_peered":"2023-10-09T07:00:31.864985+0000","last_unstale":"2023-10-09T07:00:31.868105+0000","last_undegraded":"2023-10-09T07:00:31.868105+0000","last_fullsized":"2023-10-09T07:00:31.868105+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:06:38.607376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.850308+0000","last_change":"2023-10-09T07:00:30.860114+0000","last_active":"2023-10-09T07:00:31.850308+0000","last_peered":"2023-10-09T07:00:31.850308+0000","last_clean":"2023-10-09T07:00:31.850308+0000","last_became_active":"2023-10-09T07:00:30.859802+0000","last_became_peered":"2023-10-09T07:00:30.859802+0000","last_unstale":"2023-10-09T07:00:31.850308+0000","last_undegraded":"2023-10-09T07:00:31.850308+0000","last_fullsized":"2023-10-09T07:00:31.850308+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:51.679623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.871643+0000","last_change":"2023-10-09T07:00:31.869054+0000","last_active":"2023-10-09T07:00:31.871643+0000","last_peered":"2023-10-09T07:00:31.871643+0000","last_clean":"2023-10-09T07:00:31.871643+0000","last_became_active":"2023-10-09T07:00:31.868778+0000","last_became_peered":"2023-10-09T07:00:31.868778+0000","last_unstale":"2023-10-09T07:00:31.871643+0000","last_undegraded":"2023-10-09T07:00:31.871643+0000","last_fullsized":"2023-10-09T07:00:31.871643+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:24:19.711264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.850666+0000","last_change":"2023-10-09T07:00:30.863495+0000","last_active":"2023-10-09T07:00:31.850666+0000","last_peered":"2023-10-09T07:00:31.850666+0000","last_clean":"2023-10-09T07:00:31.850666+0000","last_became_active":"2023-10-09T07:00:30.863218+0000","last_became_peered":"2023-10-09T07:00:30.863218+0000","last_unstale":"2023-10-09T07:00:31.850666+0000","last_undegraded":"2023-10-09T07:00:31.850666+0000","last_fullsized":"2023-10-09T07:00:31.850666+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:19.505385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.874895+0000","last_change":"2023-10-09T07:00:31.867374+0000","last_active":"2023-10-09T07:00:31.874895+0000","last_peered":"2023-10-09T07:00:31.874895+0000","last_clean":"2023-10-09T07:00:31.874895+0000","last_became_active":"2023-10-09T07:00:31.866751+0000","last_became_peered":"2023-10-09T07:00:31.866751+0000","last_unstale":"2023-10-09T07:00:31.874895+0000","last_undegraded":"2023-10-09T07:00:31.874895+0000","last_fullsized":"2023-10-09T07:00:31.874895+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:41:55.893491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.877467+0000","last_change":"2023-10-09T07:00:30.853680+0000","last_active":"2023-10-09T07:00:31.877467+0000","last_peered":"2023-10-09T07:00:31.877467+0000","last_clean":"2023-10-09T07:00:31.877467+0000","last_became_active":"2023-10-09T07:00:30.853390+0000","last_became_peered":"2023-10-09T07:00:30.853390+0000","last_unstale":"2023-10-09T07:00:31.877467+0000","last_undegraded":"2023-10-09T07:00:31.877467+0000","last_fullsized":"2023-10-09T07:00:31.877467+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:47:30.822257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"112'227","reported_seq":642,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.853830+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T07:00:31.853830+0000","last_peered":"2023-10-09T07:00:31.853830+0000","last_clean":"2023-10-09T07:00:31.853830+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T07:00:31.853830+0000","last_undegraded":"2023-10-09T07:00:31.853830+0000","last_fullsized":"2023-10-09T07:00:31.853830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575061,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303456,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068384,"statfs":{"total":96636764160,"available":96326025216,"internally_reserved":0,"allocated":2121728,"data_stored":1335413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.67800000000000005,"15min":0.70899999999999996},"min":{"1min":0.44900000000000001,"5min":0.44700000000000001,"15min":0.316},"max":{"1min":1.042,"5min":1.0960000000000001,"15min":1.732},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.69799999999999995,"15min":0.72199999999999998},"min":{"1min":0.54900000000000004,"5min":0.42999999999999999,"15min":0.29999999999999999},"max":{"1min":0.99199999999999999,"5min":1.22,"15min":1.22},"last":0.57699999999999996}]},{"osd":1,"last update":"Mon Oct 9 07:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68200000000000005,"15min":0.71299999999999997},"min":{"1min":0.54000000000000004,"5min":0.5,"15min":0.379},"max":{"1min":0.91200000000000003,"5min":0.99299999999999999,"15min":2.3559999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69299999999999995,"15min":0.72399999999999998},"min":{"1min":0.56100000000000005,"5min":0.45700000000000002,"15min":0.40200000000000002},"max":{"1min":0.94499999999999995,"5min":0.998,"15min":1.7869999999999999},"last":0.627}]},{"osd":2,"last update":"Mon Oct 9 07:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70799999999999996,"15min":0.73399999999999999},"min":{"1min":0.51500000000000001,"5min":0.46300000000000002,"15min":0.44900000000000001},"max":{"1min":0.97699999999999998,"5min":0.98399999999999999,"15min":1.9430000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.70399999999999996,"15min":0.74399999999999999},"min":{"1min":0.64600000000000002,"5min":0.48199999999999998,"15min":0.44900000000000001},"max":{"1min":0.98999999999999999,"5min":1.262,"15min":2.6629999999999998},"last":0.60699999999999998}]},{"osd":3,"last update":"Mon Oct 9 07:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69399999999999995,"15min":0.71999999999999997},"min":{"1min":0.61299999999999999,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":0.97299999999999998,"5min":1.03,"15min":1.0409999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73199999999999998,"15min":0.755},"min":{"1min":0.55700000000000005,"5min":0.47999999999999998,"15min":0.47099999999999997},"max":{"1min":1.006,"5min":1.0569999999999999,"15min":1.827},"last":0.59399999999999997}]},{"osd":4,"last update":"Mon Oct 9 07:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.623,"15min":0.59599999999999997},"min":{"1min":0.46100000000000002,"5min":0.35299999999999998,"15min":0.35099999999999998},"max":{"1min":0.77400000000000002,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.65600000000000003,"15min":0.64500000000000002},"min":{"1min":0.48399999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85499999999999998,"5min":1.1850000000000001,"15min":2.577},"last":0.42399999999999999}]},{"osd":5,"last update":"Mon Oct 9 07:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66800000000000004,"15min":0.66200000000000003},"min":{"1min":0.50900000000000001,"5min":0.40699999999999997,"15min":0.39000000000000001},"max":{"1min":0.86099999999999999,"5min":1.0960000000000001,"15min":2.5169999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69199999999999995,"15min":0.69999999999999996},"min":{"1min":0.57799999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83199999999999996,"5min":1.141,"15min":2.9590000000000001},"last":0.51700000000000002}]},{"osd":6,"last update":"Mon Oct 9 07:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.745,"15min":0.748},"min":{"1min":0.56299999999999994,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93799999999999994,"5min":1.1000000000000001,"15min":3.0019999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71199999999999997,"15min":0.72199999999999998},"min":{"1min":0.5,"5min":0.374,"15min":0.374},"max":{"1min":1.02,"5min":1.0740000000000001,"15min":2.4039999999999999},"last":0.61599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575060,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302876,"kb_used_data":1492,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068964,"statfs":{"total":96636764160,"available":96326619136,"internally_reserved":0,"allocated":1527808,"data_stored":745557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:00:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.69399999999999995,"15min":0.72099999999999997},"min":{"1min":0.55500000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.66000000000000003,"15min":0.70599999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.36599999999999999},"max":{"1min":0.92800000000000005,"5min":0.93200000000000005,"15min":1.079},"last":0.67600000000000005}]},{"osd":1,"last update":"Mon Oct 9 07:00:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.68300000000000005,"15min":0.72399999999999998},"min":{"1min":0.51100000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.135},"last":0.63},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.71099999999999997,"15min":0.73499999999999999},"min":{"1min":0.61699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.81399999999999995}]},{"osd":2,"last update":"Mon Oct 9 07:00:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.69699999999999995,"15min":0.73799999999999999},"min":{"1min":0.48699999999999999,"5min":0.438,"15min":0.42599999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.391},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.69699999999999995,"15min":0.73699999999999999},"min":{"1min":0.56899999999999995,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.72799999999999998}]},{"osd":3,"last update":"Mon Oct 9 07:00:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.68100000000000005,"15min":0.70799999999999996},"min":{"1min":0.57799999999999996,"5min":0.44700000000000001,"15min":0.40600000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.0069999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71199999999999997,"15min":0.755},"min":{"1min":0.54600000000000004,"5min":0.53000000000000003,"15min":0.497},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.4750000000000001},"last":0.69699999999999995}]},{"osd":4,"last update":"Mon Oct 9 07:00:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61199999999999999,"15min":0.61899999999999999},"min":{"1min":0.432,"5min":0.38,"15min":0.38},"max":{"1min":1.329,"5min":1.329,"15min":1.768},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.46200000000000002,"5min":0.379,"15min":0.36199999999999999},"max":{"1min":0.93000000000000005,"5min":0.98499999999999999,"15min":1.601},"last":0.49299999999999999}]},{"osd":5,"last update":"Mon Oct 9 07:00:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66600000000000004,"15min":0.65300000000000002},"min":{"1min":0.437,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98199999999999998,"5min":1.0149999999999999,"15min":1.7609999999999999},"last":0.752},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70699999999999996,"15min":0.69399999999999995},"min":{"1min":0.45000000000000001,"5min":0.433,"15min":0.42299999999999999},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.52600000000000002}]},{"osd":7,"last update":"Mon Oct 9 07:00:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68600000000000005,"15min":0.67900000000000005},"min":{"1min":0.47999999999999998,"5min":0.42899999999999999,"15min":0.41799999999999998},"max":{"1min":0.95499999999999996,"5min":1.046,"15min":1.2949999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.73299999999999998,"15min":0.72499999999999998},"min":{"1min":0.5,"5min":0.45300000000000001,"15min":0.42399999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.8320000000000001},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575061,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302868,"kb_used_data":1484,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068972,"statfs":{"total":96636764160,"available":96326627328,"internally_reserved":0,"allocated":1519616,"data_stored":744933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45700000000000002,"15min":0.45600000000000002},"min":{"1min":0.30399999999999999,"5min":0.26600000000000001,"15min":0.25900000000000001},"max":{"1min":0.54100000000000004,"5min":2.153,"15min":2.153},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.34899999999999998,"5min":0.29399999999999998,"15min":0.26300000000000001},"max":{"1min":0.63600000000000001,"5min":1.23,"15min":1.23},"last":0.55800000000000005}]},{"osd":2,"last update":"Mon Oct 9 06:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48499999999999999,"15min":0.495},"min":{"1min":0.377,"5min":0.312,"15min":0.312},"max":{"1min":0.72199999999999998,"5min":1.169,"15min":1.169},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57899999999999996,"15min":0.57799999999999996},"min":{"1min":0.443,"5min":0.38300000000000001,"15min":0.34100000000000003},"max":{"1min":0.69599999999999995,"5min":3.077,"15min":3.077},"last":0.49399999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59799999999999998,"15min":0.60999999999999999},"min":{"1min":0.47499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.73499999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55900000000000005,"15min":0.56200000000000006},"min":{"1min":0.40500000000000003,"5min":0.34899999999999998,"15min":0.34100000000000003},"max":{"1min":0.76300000000000001,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.51100000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.73499999999999999,"15min":0.75800000000000001},"min":{"1min":0.57199999999999995,"5min":0.46700000000000003,"15min":0.38700000000000001},"max":{"1min":1.0009999999999999,"5min":1.0389999999999999,"15min":1.6739999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.76500000000000001,"15min":0.77800000000000002},"min":{"1min":0.56299999999999994,"5min":0.497,"15min":0.48599999999999999},"max":{"1min":0.92900000000000005,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.59299999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76000000000000001,"15min":0.77700000000000002},"min":{"1min":0.53400000000000003,"5min":0.48699999999999999,"15min":0.48099999999999998},"max":{"1min":1.0780000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74299999999999999,"15min":0.77400000000000002},"min":{"1min":0.54100000000000004,"5min":0.52100000000000002,"15min":0.47999999999999998},"max":{"1min":1.0069999999999999,"5min":1.1040000000000001,"15min":1.637},"last":0.78100000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.58399999999999996,"5min":0.50600000000000001,"15min":0.48399999999999999},"max":{"1min":0.97599999999999998,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78100000000000003,"15min":0.79600000000000004},"min":{"1min":0.58799999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.997,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.79000000000000004}]},{"osd":7,"last update":"Mon Oct 9 06:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82299999999999995,"15min":0.82799999999999996},"min":{"1min":0.56200000000000006,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.98999999999999999,"5min":3.4350000000000001,"15min":3.4350000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.78500000000000003,"15min":0.81699999999999995},"min":{"1min":0.65400000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.036,"5min":1.125,"15min":1.179},"last":0.89800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575060,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299356,"kb_used_data":2068,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072484,"statfs":{"total":96636764160,"available":96330223616,"internally_reserved":0,"allocated":2117632,"data_stored":1335855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.47899999999999998,"15min":0.47099999999999997},"min":{"1min":0.34000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.51800000000000002,"15min":0.54100000000000004},"min":{"1min":0.36799999999999999,"5min":0.313,"15min":0.28899999999999998},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":4.5819999999999999},"last":0.35999999999999999}]},{"osd":2,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.54200000000000004,"15min":0.56100000000000005},"min":{"1min":0.44600000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":4.6980000000000004},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.49199999999999999,"15min":0.504},"min":{"1min":0.35899999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.38700000000000001}]},{"osd":3,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.53200000000000003,"15min":0.53600000000000003},"min":{"1min":0.43099999999999999,"5min":0.34300000000000003,"15min":0.33200000000000002},"max":{"1min":2.4649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.47799999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":4.734},"last":0.46200000000000002}]},{"osd":4,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.55400000000000005,"5min":0.46400000000000002,"15min":0.42799999999999999},"max":{"1min":2.339,"5min":2.339,"15min":2.339},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.755,"15min":0.79700000000000004},"min":{"1min":0.66200000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.006,"5min":1.115,"15min":4.6619999999999999},"last":0.70299999999999996}]},{"osd":5,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.75700000000000001,"15min":0.77500000000000002},"min":{"1min":0.57799999999999996,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":1.0249999999999999,"5min":1.1259999999999999,"15min":1.1890000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.78400000000000003,"15min":0.79600000000000004},"min":{"1min":0.59899999999999998,"5min":0.5,"15min":0.45600000000000002},"max":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":0.93000000000000005}]},{"osd":6,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.76600000000000001,"15min":0.80900000000000005},"min":{"1min":0.66000000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.05,"5min":1.0600000000000001,"15min":4.6239999999999997},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.77400000000000002,"15min":0.79700000000000004},"min":{"1min":0.58899999999999997,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0640000000000001,"5min":1.1259999999999999,"15min":1.2689999999999999},"last":1.034}]},{"osd":7,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.80400000000000005,"15min":0.82899999999999996},"min":{"1min":0.65100000000000002,"5min":0.53700000000000003,"15min":0.46400000000000002},"max":{"1min":0.95799999999999996,"5min":1.155,"15min":1.256},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.83399999999999996,"15min":0.85099999999999998},"min":{"1min":0.65000000000000002,"5min":0.56000000000000005,"15min":0.51800000000000002},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.95599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575060,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311064,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060776,"statfs":{"total":96636764160,"available":96318234624,"internally_reserved":0,"allocated":1523712,"data_stored":744967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45300000000000001,"15min":0.45500000000000002},"min":{"1min":0.31,"5min":0.26500000000000001,"15min":0.25900000000000001},"max":{"1min":0.79800000000000004,"5min":1.673,"15min":1.8149999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.36599999999999999,"5min":0.28999999999999998,"15min":0.28000000000000003},"max":{"1min":0.68100000000000005,"5min":1.633,"15min":1.633},"last":0.58899999999999997}]},{"osd":1,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.45900000000000002,"15min":0.47299999999999998},"min":{"1min":0.38900000000000001,"5min":0.29499999999999998,"15min":0.28999999999999998},"max":{"1min":0.68999999999999995,"5min":1.097,"15min":1.097},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.502,"15min":0.51300000000000001},"min":{"1min":0.38300000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.74199999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.47699999999999998}]},{"osd":3,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.58699999999999997},"min":{"1min":0.46999999999999997,"5min":0.39000000000000001,"15min":0.38600000000000001},"max":{"1min":0.80400000000000005,"5min":0.86699999999999999,"15min":0.87},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.61399999999999999},"min":{"1min":0.51100000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79900000000000004,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.55200000000000005}]},{"osd":4,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.752,"15min":0.76700000000000002},"min":{"1min":0.55400000000000005,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":0.93000000000000005,"5min":1.2430000000000001,"15min":1.256},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.73199999999999998,"15min":0.76200000000000001},"min":{"1min":0.53000000000000003,"5min":0.48399999999999999,"15min":0.44800000000000001},"max":{"1min":0.97199999999999998,"5min":1.171,"15min":1.696},"last":0.86699999999999999}]},{"osd":5,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73899999999999999,"15min":0.77000000000000002},"min":{"1min":0.56699999999999995,"5min":0.501,"15min":0.42399999999999999},"max":{"1min":0.95399999999999996,"5min":1.143,"15min":1.3049999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.57399999999999995,"5min":0.52500000000000002,"15min":0.503},"max":{"1min":0.91800000000000004,"5min":1.218,"15min":1.3440000000000001},"last":1.038}]},{"osd":6,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77000000000000002,"15min":0.78300000000000003},"min":{"1min":0.58699999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92600000000000005,"5min":1.151,"15min":1.768},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.73699999999999999,"15min":0.78600000000000003},"min":{"1min":0.626,"5min":0.439,"15min":0.439},"max":{"1min":0.89000000000000001,"5min":1.101,"15min":1.5309999999999999},"last":0.77200000000000002}]},{"osd":7,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.77800000000000002,"15min":0.80400000000000005},"min":{"1min":0.623,"5min":0.56499999999999995,"15min":0.54600000000000004},"max":{"1min":1.0269999999999999,"5min":1.1439999999999999,"15min":1.7370000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.78600000000000003,"15min":0.82399999999999995},"min":{"1min":0.65600000000000003,"5min":0.57099999999999995,"15min":0.50900000000000001},"max":{"1min":0.98799999999999999,"5min":1.0409999999999999,"15min":1.3939999999999999},"last":0.97899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575061,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306980,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064860,"statfs":{"total":96636764160,"available":96322416640,"internally_reserved":0,"allocated":1536000,"data_stored":746491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45800000000000002,"15min":0.47199999999999998},"min":{"1min":0.33100000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.84099999999999997,"5min":0.86299999999999999,"15min":0.94299999999999995},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.47399999999999998,"15min":0.496},"min":{"1min":0.39400000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.79300000000000004,"5min":0.81799999999999995,"15min":1.228},"last":0.46400000000000002}]},{"osd":1,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.47099999999999997,"15min":0.48499999999999999},"min":{"1min":0.36799999999999999,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.81699999999999995,"5min":0.81899999999999995,"15min":2.0800000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.54300000000000004,"15min":0.55600000000000005},"min":{"1min":0.39500000000000002,"5min":0.34100000000000003,"15min":0.247},"max":{"1min":0.79200000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.39200000000000002}]},{"osd":2,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56000000000000005,"15min":0.58399999999999996},"min":{"1min":0.435,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71299999999999997,"5min":0.94099999999999995,"15min":2.3959999999999999},"last":0.442},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.626,"15min":0.63900000000000001},"min":{"1min":0.50700000000000001,"5min":0.379,"15min":0.309},"max":{"1min":0.82899999999999996,"5min":0.97699999999999998,"15min":3.8900000000000001},"last":0.47999999999999998}]},{"osd":4,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.72699999999999998,"15min":0.74399999999999999},"min":{"1min":0.59299999999999997,"5min":0.499,"15min":0.40799999999999997},"max":{"1min":1.0409999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.871},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.80700000000000005,"15min":0.82599999999999996},"min":{"1min":0.70499999999999996,"5min":0.60899999999999999,"15min":0.55300000000000005},"max":{"1min":1.1950000000000001,"5min":1.22,"15min":1.22},"last":0.90600000000000003}]},{"osd":5,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70799999999999996,"15min":0.73699999999999999},"min":{"1min":0.54500000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.0149999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.77600000000000002,"15min":0.80200000000000005},"min":{"1min":0.67100000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.141,"5min":1.1639999999999999,"15min":1.1830000000000001},"last":0.755}]},{"osd":6,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.76000000000000001,"15min":0.77900000000000003},"min":{"1min":0.63,"5min":0.53000000000000003,"15min":0.51700000000000002},"max":{"1min":1.093,"5min":1.304,"15min":1.304},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.74299999999999999,"15min":0.77600000000000002},"min":{"1min":0.61099999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.7769999999999999},"last":0.70799999999999996}]},{"osd":7,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.78900000000000003,"15min":0.81499999999999995},"min":{"1min":0.70999999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0369999999999999,"5min":1.2629999999999999,"15min":1.8180000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.79200000000000004,"15min":0.82199999999999995},"min":{"1min":0.64200000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1739999999999999,"5min":1.1919999999999999,"15min":1.486},"last":0.72799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575060,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311080,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060760,"statfs":{"total":96636764160,"available":96318218240,"internally_reserved":0,"allocated":1540096,"data_stored":746593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68899999999999995,"15min":0.70699999999999996},"min":{"1min":0.51500000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.018,"5min":1.5609999999999999,"15min":3.1139999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68999999999999995,"15min":0.71499999999999997},"min":{"1min":0.45300000000000001,"5min":0.39900000000000002,"15min":0.39300000000000002},"max":{"1min":0.84299999999999997,"5min":0.97399999999999998,"15min":2.8130000000000002},"last":0.81100000000000005}]},{"osd":1,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68799999999999994,"15min":0.71199999999999997},"min":{"1min":0.47799999999999998,"5min":0.39500000000000002,"15min":0.373},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.9279999999999999},"last":1.012},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.71199999999999997,"15min":0.73499999999999999},"min":{"1min":0.56699999999999995,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.98499999999999999,"5min":1.4339999999999999,"15min":3.4359999999999999},"last":0.622}]},{"osd":2,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71099999999999997,"15min":0.748},"min":{"1min":0.51100000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86199999999999999,"5min":1.03,"15min":2.5960000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.748,"15min":0.77700000000000002},"min":{"1min":0.56100000000000005,"5min":0.48299999999999998,"15min":0.47599999999999998},"max":{"1min":0.93200000000000005,"5min":1.0129999999999999,"15min":2.427},"last":0.59799999999999998}]},{"osd":3,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71699999999999997,"15min":0.73899999999999999},"min":{"1min":0.53000000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91600000000000004,"5min":0.94199999999999995,"15min":2.6440000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71899999999999997,"15min":0.748},"min":{"1min":0.498,"5min":0.443,"15min":0.43099999999999999},"max":{"1min":0.89500000000000002,"5min":1.0289999999999999,"15min":3.6899999999999999},"last":0.71899999999999997}]},{"osd":5,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59599999999999997,"15min":0.59799999999999998},"min":{"1min":0.41099999999999998,"5min":0.32700000000000001,"15min":0.317},"max":{"1min":0.82899999999999996,"5min":1.4870000000000001,"15min":3.3860000000000001},"last":0.433},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.627,"15min":0.64500000000000002},"min":{"1min":0.45300000000000001,"5min":0.38600000000000001,"15min":0.34999999999999998},"max":{"1min":0.88,"5min":1.0149999999999999,"15min":3.9300000000000002},"last":0.74399999999999999}]},{"osd":6,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.621,"15min":0.63500000000000001},"min":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.36499999999999999},"max":{"1min":1.042,"5min":1.042,"15min":3.5270000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67200000000000004,"15min":0.67700000000000005},"min":{"1min":0.47199999999999998,"5min":0.42499999999999999,"15min":0.374},"max":{"1min":0.94999999999999996,"5min":1.587,"15min":3.4740000000000002},"last":0.50600000000000001}]},{"osd":7,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.70399999999999996,"15min":0.71799999999999997},"min":{"1min":0.46200000000000002,"5min":0.44,"15min":0.34699999999999998},"max":{"1min":1.0900000000000001,"5min":1.1519999999999999,"15min":2.7210000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.73599999999999999,"15min":0.76400000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.439},"max":{"1min":0.97099999999999997,"5min":1.1899999999999999,"15min":3.7280000000000002},"last":0.96799999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575061,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1523712,"data_stored":745003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.67700000000000005,"15min":0.69699999999999995},"min":{"1min":0.54100000000000004,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.90500000000000003,"5min":0.93600000000000005,"15min":0.98099999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.65400000000000003,"15min":0.68400000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.32900000000000001},"max":{"1min":0.94299999999999995,"5min":1.119,"15min":1.119},"last":0.54300000000000004}]},{"osd":1,"last update":"Mon Oct 9 06:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.66900000000000004,"15min":0.68500000000000005},"min":{"1min":0.47799999999999998,"5min":0.42299999999999999,"15min":0.39700000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.034},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.71499999999999997,"15min":0.72199999999999998},"min":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.40400000000000003},"max":{"1min":0.88700000000000001,"5min":0.95099999999999996,"15min":1.0229999999999999},"last":0.72199999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.70099999999999996,"15min":0.72399999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.47299999999999998},"max":{"1min":0.92500000000000004,"5min":0.997,"15min":1.0580000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.55300000000000005,"5min":0.46200000000000002,"15min":0.442},"max":{"1min":0.89700000000000002,"5min":1.006,"15min":1.0720000000000001},"last":0.70899999999999996}]},{"osd":3,"last update":"Mon Oct 9 06:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.69799999999999995,"15min":0.71599999999999997},"min":{"1min":0.46300000000000002,"5min":0.438,"15min":0.435},"max":{"1min":0.97799999999999998,"5min":1.1499999999999999,"15min":1.302},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.74399999999999999,"15min":0.76200000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96299999999999997,"5min":1.03,"15min":1.399},"last":0.751}]},{"osd":4,"last update":"Mon Oct 9 06:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.62,"15min":0.59999999999999998},"min":{"1min":0.42299999999999999,"5min":0.377,"15min":0.36099999999999999},"max":{"1min":0.73999999999999999,"5min":0.96099999999999997,"15min":0.96799999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.62,"15min":0.61199999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77400000000000002,"5min":1.075,"15min":1.075},"last":0.42099999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.51100000000000001,"5min":0.41099999999999998,"15min":0.36599999999999999},"max":{"1min":0.79700000000000004,"5min":1.018,"15min":1.018},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.66900000000000004},"min":{"1min":0.495,"5min":0.41199999999999998,"15min":0.38900000000000001},"max":{"1min":0.92300000000000004,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.51700000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.68700000000000006,"15min":0.68400000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.90000000000000002,"5min":1.48,"15min":1.48},"last":0.499},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.76300000000000001},"min":{"1min":0.57499999999999996,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.90500000000000003,"5min":1.466,"15min":1.466},"last":0.63500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T07:00:36.173 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T07:00:36.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.386+0000 7f2805bff700 1 Processor -- start 2023-10-09T07:00:36.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.386+0000 7f2805bff700 1 -- start start 2023-10-09T07:00:36.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.387+0000 7f2805bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f280006bcd0 0x7f28000caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:36.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.387+0000 7f2805bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f280006c0a0 0x7f280015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:36.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.387+0000 7f2805bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f280015df50 0x7f280015e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:36.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.387+0000 7f2805bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280015d7e0 con 0x7f280006bcd0 2023-10-09T07:00:36.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.387+0000 7f2805bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280015dac0 con 0x7f280006c0a0 2023-10-09T07:00:36.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.387+0000 7f2805bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280015aa30 con 0x7f280015df50 2023-10-09T07:00:36.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.387+0000 7f27ff7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f280006bcd0 0x7f28000caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:36.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.387+0000 7f27ff7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f280006bcd0 0x7f28000caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56076/0 (socket says 172.21.15.71:56076) 2023-10-09T07:00:36.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.388+0000 7f27ff7fe700 1 -- 172.21.15.71:0/3776087752 learned_addr learned my addr 172.21.15.71:0/3776087752 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:36.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.388+0000 7f27feffd700 1 --2- 172.21.15.71:0/3776087752 >> v2:172.21.15.179:3300/0 conn(0x7f280006c0a0 0x7f280015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:36.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.388+0000 7f27fffff700 1 --2- 172.21.15.71:0/3776087752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f280015df50 0x7f280015e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:36.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.388+0000 7f27ff7fe700 1 -- 172.21.15.71:0/3776087752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f280015df50 msgr2=0x7f280015e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:36.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.388+0000 7f27ff7fe700 1 --2- 172.21.15.71:0/3776087752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f280015df50 0x7f280015e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:36.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.388+0000 7f27ff7fe700 1 -- 172.21.15.71:0/3776087752 >> v2:172.21.15.179:3300/0 conn(0x7f280006c0a0 msgr2=0x7f280015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:36.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.388+0000 7f27ff7fe700 1 --2- 172.21.15.71:0/3776087752 >> v2:172.21.15.179:3300/0 conn(0x7f280006c0a0 0x7f280015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:36.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.388+0000 7f27ff7fe700 1 -- 172.21.15.71:0/3776087752 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280015ad10 con 0x7f280006bcd0 2023-10-09T07:00:36.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.388+0000 7f27fffff700 1 --2- 172.21.15.71:0/3776087752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f280015df50 0x7f280015e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:00:36.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.388+0000 7f27ff7fe700 1 --2- 172.21.15.71:0/3776087752 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f280006bcd0 0x7f28000caa90 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f280006b4e0 tx=0x7f27f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08b3b202783291e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:36.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.388+0000 7f27fe7fc700 1 -- 172.21.15.71:0/3776087752 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f000b860 con 0x7f280006bcd0 2023-10-09T07:00:36.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.388+0000 7f27fe7fc700 1 -- 172.21.15.71:0/3776087752 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f000b9c0 con 0x7f280006bcd0 2023-10-09T07:00:36.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.388+0000 7f27fe7fc700 1 -- 172.21.15.71:0/3776087752 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f000bd80 con 0x7f280006bcd0 2023-10-09T07:00:36.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.389+0000 7f2805bff700 1 -- 172.21.15.71:0/3776087752 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f280006bcd0 msgr2=0x7f28000caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:36.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.389+0000 7f2805bff700 1 --2- 172.21.15.71:0/3776087752 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f280006bcd0 0x7f28000caa90 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f280006b4e0 tx=0x7f27f0009250 comp rx=0 tx=0).stop 2023-10-09T07:00:36.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.389+0000 7f2805bff700 1 -- 172.21.15.71:0/3776087752 shutdown_connections 2023-10-09T07:00:36.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.389+0000 7f2805bff700 1 --2- 172.21.15.71:0/3776087752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f280015df50 0x7f280015e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:36.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.389+0000 7f2805bff700 1 --2- 172.21.15.71:0/3776087752 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f280006bcd0 0x7f28000caa90 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:36.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.389+0000 7f2805bff700 1 --2- 172.21.15.71:0/3776087752 >> v2:172.21.15.179:3300/0 conn(0x7f280006c0a0 0x7f280015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:36.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.389+0000 7f2805bff700 1 -- 172.21.15.71:0/3776087752 >> 172.21.15.71:0/3776087752 conn(0x7f28000ce600 msgr2=0x7f28000cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:36.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.389+0000 7f2805bff700 1 -- 172.21.15.71:0/3776087752 shutdown_connections 2023-10-09T07:00:36.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.389+0000 7f2805bff700 1 -- 172.21.15.71:0/3776087752 wait complete. 2023-10-09T07:00:36.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.390+0000 7f2805bff700 1 Processor -- start 2023-10-09T07:00:36.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.391+0000 7f2805bff700 1 -- start start 2023-10-09T07:00:36.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.391+0000 7f2805bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f280006bcd0 0x7f280015c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:36.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.391+0000 7f2805bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f280006c0a0 0x7f28000c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:36.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.391+0000 7f2805bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f280015df50 0x7f280016d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:36.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.392+0000 7f2805bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28000c7630 con 0x7f280006c0a0 2023-10-09T07:00:36.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.392+0000 7f2805bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28000c65e0 con 0x7f280006bcd0 2023-10-09T07:00:36.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.392+0000 7f2805bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28000c91d0 con 0x7f280015df50 2023-10-09T07:00:36.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.392+0000 7f27feffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f280006c0a0 0x7f28000c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:36.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.392+0000 7f27feffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f280006c0a0 0x7f28000c60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56080/0 (socket says 172.21.15.71:56080) 2023-10-09T07:00:36.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.392+0000 7f27feffd700 1 -- 172.21.15.71:0/472151691 learned_addr learned my addr 172.21.15.71:0/472151691 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:36.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.392+0000 7f27ff7fe700 1 --2- 172.21.15.71:0/472151691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f280006bcd0 0x7f280015c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:36.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.392+0000 7f27fffff700 1 --2- 172.21.15.71:0/472151691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f280015df50 0x7f280016d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:36.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.392+0000 7f27feffd700 1 -- 172.21.15.71:0/472151691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f280015df50 msgr2=0x7f280016d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:36.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.392+0000 7f27feffd700 1 --2- 172.21.15.71:0/472151691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f280015df50 0x7f280016d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:36.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.392+0000 7f27feffd700 1 -- 172.21.15.71:0/472151691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f280006bcd0 msgr2=0x7f280015c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:36.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.392+0000 7f27feffd700 1 --2- 172.21.15.71:0/472151691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f280006bcd0 0x7f280015c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:36.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.392+0000 7f27feffd700 1 -- 172.21.15.71:0/472151691 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f00094f0 con 0x7f280006c0a0 2023-10-09T07:00:36.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.392+0000 7f27fffff700 1 --2- 172.21.15.71:0/472151691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f280015df50 0x7f280016d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:00:36.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.392+0000 7f27feffd700 1 --2- 172.21.15.71:0/472151691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f280006c0a0 0x7f28000c60a0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f27f400d860 tx=0x7f27f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:36.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.393+0000 7f27e77fe700 1 -- 172.21.15.71:0/472151691 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f4009610 con 0x7f280006c0a0 2023-10-09T07:00:36.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.393+0000 7f27e77fe700 1 -- 172.21.15.71:0/472151691 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f4009770 con 0x7f280006c0a0 2023-10-09T07:00:36.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.393+0000 7f27e77fe700 1 -- 172.21.15.71:0/472151691 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f4009b30 con 0x7f280006c0a0 2023-10-09T07:00:36.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.393+0000 7f2805bff700 1 -- 172.21.15.71:0/472151691 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280015bef0 con 0x7f280006c0a0 2023-10-09T07:00:36.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.393+0000 7f2805bff700 1 -- 172.21.15.71:0/472151691 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280015c4b0 con 0x7f280006c0a0 2023-10-09T07:00:36.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.394+0000 7f2805bff700 1 -- 172.21.15.71:0/472151691 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28000b4460 con 0x7f280006c0a0 2023-10-09T07:00:36.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.395+0000 7f27e77fe700 1 -- 172.21.15.71:0/472151691 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f27f401e460 con 0x7f280006c0a0 2023-10-09T07:00:36.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.395+0000 7f27e77fe700 1 --2- 172.21.15.71:0/472151691 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27ec066f30 0x7f27ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:36.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.395+0000 7f27e77fe700 1 -- 172.21.15.71:0/472151691 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f27f4084d30 con 0x7f280006c0a0 2023-10-09T07:00:36.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.396+0000 7f27ff7fe700 1 --2- 172.21.15.71:0/472151691 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27ec066f30 0x7f27ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:36.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.397+0000 7f27ff7fe700 1 --2- 172.21.15.71:0/472151691 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27ec066f30 0x7f27ec0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f280006b4e0 tx=0x7f27f0017000 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:36.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.400+0000 7f27e77fe700 1 -- 172.21.15.71:0/472151691 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27f4051e10 con 0x7f280006c0a0 2023-10-09T07:00:36.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.586+0000 7f2805bff700 1 -- 172.21.15.71:0/472151691 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f280004c3c0 con 0x7f27ec066f30 2023-10-09T07:00:36.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.595+0000 7f27e77fe700 1 -- 172.21.15.71:0/472151691 <== mgr.7201 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289495 (secure 0 0 0) 0x7f280004c3c0 con 0x7f27ec066f30 2023-10-09T07:00:36.600 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:00:36.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.599+0000 7f2805bff700 1 -- 172.21.15.71:0/472151691 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27ec066f30 msgr2=0x7f27ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:36.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.599+0000 7f2805bff700 1 --2- 172.21.15.71:0/472151691 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27ec066f30 0x7f27ec0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f280006b4e0 tx=0x7f27f0017000 comp rx=0 tx=0).stop 2023-10-09T07:00:36.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.599+0000 7f2805bff700 1 -- 172.21.15.71:0/472151691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f280006c0a0 msgr2=0x7f28000c60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:36.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.599+0000 7f2805bff700 1 --2- 172.21.15.71:0/472151691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f280006c0a0 0x7f28000c60a0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f27f400d860 tx=0x7f27f4008040 comp rx=0 tx=0).stop 2023-10-09T07:00:36.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.599+0000 7f2805bff700 1 -- 172.21.15.71:0/472151691 shutdown_connections 2023-10-09T07:00:36.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.599+0000 7f2805bff700 1 --2- 172.21.15.71:0/472151691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f280015df50 0x7f280016d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:36.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.599+0000 7f2805bff700 1 --2- 172.21.15.71:0/472151691 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27ec066f30 0x7f27ec0693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:36.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.599+0000 7f2805bff700 1 --2- 172.21.15.71:0/472151691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f280006bcd0 0x7f280015c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:36.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.599+0000 7f2805bff700 1 --2- 172.21.15.71:0/472151691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f280006c0a0 0x7f28000c60a0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:36.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.599+0000 7f2805bff700 1 -- 172.21.15.71:0/472151691 >> 172.21.15.71:0/472151691 conn(0x7f28000ce600 msgr2=0x7f28000c4290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:36.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.599+0000 7f2805bff700 1 -- 172.21.15.71:0/472151691 shutdown_connections 2023-10-09T07:00:36.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.599+0000 7f2805bff700 1 -- 172.21.15.71:0/472151691 wait complete. 2023-10-09T07:00:36.603 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T07:00:36.617 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-09T07:00:34.929209+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":403,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2440552,"kb_used_data":13096,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752534168,"statfs":{"total":773094113280,"available":770594988032,"internally_reserved":0,"allocated":13410304,"data_stored":7144812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.096530"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.864829+0000","last_change":"2023-10-09T07:00:31.856989+0000","last_active":"2023-10-09T07:00:31.864829+0000","last_peered":"2023-10-09T07:00:31.864829+0000","last_clean":"2023-10-09T07:00:31.864829+0000","last_became_active":"2023-10-09T07:00:31.856727+0000","last_became_peered":"2023-10-09T07:00:31.856727+0000","last_unstale":"2023-10-09T07:00:31.864829+0000","last_undegraded":"2023-10-09T07:00:31.864829+0000","last_fullsized":"2023-10-09T07:00:31.864829+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:58:02.933062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.863501+0000","last_change":"2023-10-09T07:00:31.856051+0000","last_active":"2023-10-09T07:00:31.863501+0000","last_peered":"2023-10-09T07:00:31.863501+0000","last_clean":"2023-10-09T07:00:31.863501+0000","last_became_active":"2023-10-09T07:00:31.855775+0000","last_became_peered":"2023-10-09T07:00:31.855775+0000","last_unstale":"2023-10-09T07:00:31.863501+0000","last_undegraded":"2023-10-09T07:00:31.863501+0000","last_fullsized":"2023-10-09T07:00:31.863501+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:09.619313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.864235+0000","last_change":"2023-10-09T07:00:31.856398+0000","last_active":"2023-10-09T07:00:31.864235+0000","last_peered":"2023-10-09T07:00:31.864235+0000","last_clean":"2023-10-09T07:00:31.864235+0000","last_became_active":"2023-10-09T07:00:31.856184+0000","last_became_peered":"2023-10-09T07:00:31.856184+0000","last_unstale":"2023-10-09T07:00:31.864235+0000","last_undegraded":"2023-10-09T07:00:31.864235+0000","last_fullsized":"2023-10-09T07:00:31.864235+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:51.981587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.866563+0000","last_change":"2023-10-09T07:00:31.863594+0000","last_active":"2023-10-09T07:00:31.866563+0000","last_peered":"2023-10-09T07:00:31.866563+0000","last_clean":"2023-10-09T07:00:31.866563+0000","last_became_active":"2023-10-09T07:00:31.863355+0000","last_became_peered":"2023-10-09T07:00:31.863355+0000","last_unstale":"2023-10-09T07:00:31.866563+0000","last_undegraded":"2023-10-09T07:00:31.866563+0000","last_fullsized":"2023-10-09T07:00:31.866563+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:37:54.661947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.871572+0000","last_change":"2023-10-09T07:00:31.868795+0000","last_active":"2023-10-09T07:00:31.871572+0000","last_peered":"2023-10-09T07:00:31.871572+0000","last_clean":"2023-10-09T07:00:31.871572+0000","last_became_active":"2023-10-09T07:00:31.868524+0000","last_became_peered":"2023-10-09T07:00:31.868524+0000","last_unstale":"2023-10-09T07:00:31.871572+0000","last_undegraded":"2023-10-09T07:00:31.871572+0000","last_fullsized":"2023-10-09T07:00:31.871572+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:17:56.774259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.863416+0000","last_change":"2023-10-09T07:00:31.861908+0000","last_active":"2023-10-09T07:00:31.863416+0000","last_peered":"2023-10-09T07:00:31.863416+0000","last_clean":"2023-10-09T07:00:31.863416+0000","last_became_active":"2023-10-09T07:00:31.861616+0000","last_became_peered":"2023-10-09T07:00:31.861616+0000","last_unstale":"2023-10-09T07:00:31.863416+0000","last_undegraded":"2023-10-09T07:00:31.863416+0000","last_fullsized":"2023-10-09T07:00:31.863416+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:11:49.045249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.863183+0000","last_change":"2023-10-09T07:00:31.861356+0000","last_active":"2023-10-09T07:00:31.863183+0000","last_peered":"2023-10-09T07:00:31.863183+0000","last_clean":"2023-10-09T07:00:31.863183+0000","last_became_active":"2023-10-09T07:00:31.861091+0000","last_became_peered":"2023-10-09T07:00:31.861091+0000","last_unstale":"2023-10-09T07:00:31.863183+0000","last_undegraded":"2023-10-09T07:00:31.863183+0000","last_fullsized":"2023-10-09T07:00:31.863183+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:51:40.761624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.863955+0000","last_change":"2023-10-09T07:00:31.857953+0000","last_active":"2023-10-09T07:00:31.863955+0000","last_peered":"2023-10-09T07:00:31.863955+0000","last_clean":"2023-10-09T07:00:31.863955+0000","last_became_active":"2023-10-09T07:00:31.857634+0000","last_became_peered":"2023-10-09T07:00:31.857634+0000","last_unstale":"2023-10-09T07:00:31.863955+0000","last_undegraded":"2023-10-09T07:00:31.863955+0000","last_fullsized":"2023-10-09T07:00:31.863955+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:12.047920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.865658+0000","last_change":"2023-10-09T07:00:31.862814+0000","last_active":"2023-10-09T07:00:31.865658+0000","last_peered":"2023-10-09T07:00:31.865658+0000","last_clean":"2023-10-09T07:00:31.865658+0000","last_became_active":"2023-10-09T07:00:31.861413+0000","last_became_peered":"2023-10-09T07:00:31.861413+0000","last_unstale":"2023-10-09T07:00:31.865658+0000","last_undegraded":"2023-10-09T07:00:31.865658+0000","last_fullsized":"2023-10-09T07:00:31.865658+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:51:40.761624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.871646+0000","last_change":"2023-10-09T07:00:31.869698+0000","last_active":"2023-10-09T07:00:31.871646+0000","last_peered":"2023-10-09T07:00:31.871646+0000","last_clean":"2023-10-09T07:00:31.871646+0000","last_became_active":"2023-10-09T07:00:31.868375+0000","last_became_peered":"2023-10-09T07:00:31.868375+0000","last_unstale":"2023-10-09T07:00:31.871646+0000","last_undegraded":"2023-10-09T07:00:31.871646+0000","last_fullsized":"2023-10-09T07:00:31.871646+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:01:56.325354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.867760+0000","last_change":"2023-10-09T07:00:31.864998+0000","last_active":"2023-10-09T07:00:31.867760+0000","last_peered":"2023-10-09T07:00:31.867760+0000","last_clean":"2023-10-09T07:00:31.867760+0000","last_became_active":"2023-10-09T07:00:31.864339+0000","last_became_peered":"2023-10-09T07:00:31.864339+0000","last_unstale":"2023-10-09T07:00:31.867760+0000","last_undegraded":"2023-10-09T07:00:31.867760+0000","last_fullsized":"2023-10-09T07:00:31.867760+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:21.164187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.867674+0000","last_change":"2023-10-09T07:00:31.863923+0000","last_active":"2023-10-09T07:00:31.867674+0000","last_peered":"2023-10-09T07:00:31.867674+0000","last_clean":"2023-10-09T07:00:31.867674+0000","last_became_active":"2023-10-09T07:00:31.863676+0000","last_became_peered":"2023-10-09T07:00:31.863676+0000","last_unstale":"2023-10-09T07:00:31.867674+0000","last_undegraded":"2023-10-09T07:00:31.867674+0000","last_fullsized":"2023-10-09T07:00:31.867674+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:03:09.182739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.866576+0000","last_change":"2023-10-09T07:00:31.862343+0000","last_active":"2023-10-09T07:00:31.866576+0000","last_peered":"2023-10-09T07:00:31.866576+0000","last_clean":"2023-10-09T07:00:31.866576+0000","last_became_active":"2023-10-09T07:00:31.862048+0000","last_became_peered":"2023-10-09T07:00:31.862048+0000","last_unstale":"2023-10-09T07:00:31.866576+0000","last_undegraded":"2023-10-09T07:00:31.866576+0000","last_fullsized":"2023-10-09T07:00:31.866576+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:24:19.711264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.867642+0000","last_change":"2023-10-09T07:00:31.863975+0000","last_active":"2023-10-09T07:00:31.867642+0000","last_peered":"2023-10-09T07:00:31.867642+0000","last_clean":"2023-10-09T07:00:31.867642+0000","last_became_active":"2023-10-09T07:00:31.863389+0000","last_became_peered":"2023-10-09T07:00:31.863389+0000","last_unstale":"2023-10-09T07:00:31.867642+0000","last_undegraded":"2023-10-09T07:00:31.867642+0000","last_fullsized":"2023-10-09T07:00:31.867642+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:05:02.882687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.864762+0000","last_change":"2023-10-09T07:00:31.860500+0000","last_active":"2023-10-09T07:00:31.864762+0000","last_peered":"2023-10-09T07:00:31.864762+0000","last_clean":"2023-10-09T07:00:31.864762+0000","last_became_active":"2023-10-09T07:00:31.860093+0000","last_became_peered":"2023-10-09T07:00:31.860093+0000","last_unstale":"2023-10-09T07:00:31.864762+0000","last_undegraded":"2023-10-09T07:00:31.864762+0000","last_fullsized":"2023-10-09T07:00:31.864762+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:09.829024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.867799+0000","last_change":"2023-10-09T07:00:31.864997+0000","last_active":"2023-10-09T07:00:31.867799+0000","last_peered":"2023-10-09T07:00:31.867799+0000","last_clean":"2023-10-09T07:00:31.867799+0000","last_became_active":"2023-10-09T07:00:31.864739+0000","last_became_peered":"2023-10-09T07:00:31.864739+0000","last_unstale":"2023-10-09T07:00:31.867799+0000","last_undegraded":"2023-10-09T07:00:31.867799+0000","last_fullsized":"2023-10-09T07:00:31.867799+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:01:56.325354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.863472+0000","last_change":"2023-10-09T07:00:31.857928+0000","last_active":"2023-10-09T07:00:31.863472+0000","last_peered":"2023-10-09T07:00:31.863472+0000","last_clean":"2023-10-09T07:00:31.863472+0000","last_became_active":"2023-10-09T07:00:31.857661+0000","last_became_peered":"2023-10-09T07:00:31.857661+0000","last_unstale":"2023-10-09T07:00:31.863472+0000","last_undegraded":"2023-10-09T07:00:31.863472+0000","last_fullsized":"2023-10-09T07:00:31.863472+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:14:48.491721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.866626+0000","last_change":"2023-10-09T07:00:31.862424+0000","last_active":"2023-10-09T07:00:31.866626+0000","last_peered":"2023-10-09T07:00:31.866626+0000","last_clean":"2023-10-09T07:00:31.866626+0000","last_became_active":"2023-10-09T07:00:31.862128+0000","last_became_peered":"2023-10-09T07:00:31.862128+0000","last_unstale":"2023-10-09T07:00:31.866626+0000","last_undegraded":"2023-10-09T07:00:31.866626+0000","last_fullsized":"2023-10-09T07:00:31.866626+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:57:37.387414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.875095+0000","last_change":"2023-10-09T07:00:31.869068+0000","last_active":"2023-10-09T07:00:31.875095+0000","last_peered":"2023-10-09T07:00:31.875095+0000","last_clean":"2023-10-09T07:00:31.875095+0000","last_became_active":"2023-10-09T07:00:31.868055+0000","last_became_peered":"2023-10-09T07:00:31.868055+0000","last_unstale":"2023-10-09T07:00:31.875095+0000","last_undegraded":"2023-10-09T07:00:31.875095+0000","last_fullsized":"2023-10-09T07:00:31.875095+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:19:31.492187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.863086+0000","last_change":"2023-10-09T07:00:31.861948+0000","last_active":"2023-10-09T07:00:31.863086+0000","last_peered":"2023-10-09T07:00:31.863086+0000","last_clean":"2023-10-09T07:00:31.863086+0000","last_became_active":"2023-10-09T07:00:31.861657+0000","last_became_peered":"2023-10-09T07:00:31.861657+0000","last_unstale":"2023-10-09T07:00:31.863086+0000","last_undegraded":"2023-10-09T07:00:31.863086+0000","last_fullsized":"2023-10-09T07:00:31.863086+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:11:49.045249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.864560+0000","last_change":"2023-10-09T07:00:31.861297+0000","last_active":"2023-10-09T07:00:31.864560+0000","last_peered":"2023-10-09T07:00:31.864560+0000","last_clean":"2023-10-09T07:00:31.864560+0000","last_became_active":"2023-10-09T07:00:31.860945+0000","last_became_peered":"2023-10-09T07:00:31.860945+0000","last_unstale":"2023-10-09T07:00:31.864560+0000","last_undegraded":"2023-10-09T07:00:31.864560+0000","last_fullsized":"2023-10-09T07:00:31.864560+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:57:41.353175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.860588+0000","last_change":"2023-10-09T07:00:31.852875+0000","last_active":"2023-10-09T07:00:31.860588+0000","last_peered":"2023-10-09T07:00:31.860588+0000","last_clean":"2023-10-09T07:00:31.860588+0000","last_became_active":"2023-10-09T07:00:31.852602+0000","last_became_peered":"2023-10-09T07:00:31.852602+0000","last_unstale":"2023-10-09T07:00:31.860588+0000","last_undegraded":"2023-10-09T07:00:31.860588+0000","last_fullsized":"2023-10-09T07:00:31.860588+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:16.313119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.863567+0000","last_change":"2023-10-09T07:00:31.857690+0000","last_active":"2023-10-09T07:00:31.863567+0000","last_peered":"2023-10-09T07:00:31.863567+0000","last_clean":"2023-10-09T07:00:31.863567+0000","last_became_active":"2023-10-09T07:00:31.857403+0000","last_became_peered":"2023-10-09T07:00:31.857403+0000","last_unstale":"2023-10-09T07:00:31.863567+0000","last_undegraded":"2023-10-09T07:00:31.863567+0000","last_fullsized":"2023-10-09T07:00:31.863567+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:31:31.269146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.868245+0000","last_change":"2023-10-09T07:00:31.867439+0000","last_active":"2023-10-09T07:00:31.868245+0000","last_peered":"2023-10-09T07:00:31.868245+0000","last_clean":"2023-10-09T07:00:31.868245+0000","last_became_active":"2023-10-09T07:00:31.867099+0000","last_became_peered":"2023-10-09T07:00:31.867099+0000","last_unstale":"2023-10-09T07:00:31.868245+0000","last_undegraded":"2023-10-09T07:00:31.868245+0000","last_fullsized":"2023-10-09T07:00:31.868245+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:53.482535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.872887+0000","last_change":"2023-10-09T07:00:31.872280+0000","last_active":"2023-10-09T07:00:31.872887+0000","last_peered":"2023-10-09T07:00:31.872887+0000","last_clean":"2023-10-09T07:00:31.872887+0000","last_became_active":"2023-10-09T07:00:31.871876+0000","last_became_peered":"2023-10-09T07:00:31.871876+0000","last_unstale":"2023-10-09T07:00:31.872887+0000","last_undegraded":"2023-10-09T07:00:31.872887+0000","last_fullsized":"2023-10-09T07:00:31.872887+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:49.063716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.860491+0000","last_change":"2023-10-09T07:00:31.852123+0000","last_active":"2023-10-09T07:00:31.860491+0000","last_peered":"2023-10-09T07:00:31.860491+0000","last_clean":"2023-10-09T07:00:31.860491+0000","last_became_active":"2023-10-09T07:00:31.851803+0000","last_became_peered":"2023-10-09T07:00:31.851803+0000","last_unstale":"2023-10-09T07:00:31.860491+0000","last_undegraded":"2023-10-09T07:00:31.860491+0000","last_fullsized":"2023-10-09T07:00:31.860491+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:43.734125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.869646+0000","last_change":"2023-10-09T07:00:31.868617+0000","last_active":"2023-10-09T07:00:31.869646+0000","last_peered":"2023-10-09T07:00:31.869646+0000","last_clean":"2023-10-09T07:00:31.869646+0000","last_became_active":"2023-10-09T07:00:31.868279+0000","last_became_peered":"2023-10-09T07:00:31.868279+0000","last_unstale":"2023-10-09T07:00:31.869646+0000","last_undegraded":"2023-10-09T07:00:31.869646+0000","last_fullsized":"2023-10-09T07:00:31.869646+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:24:19.711264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.871739+0000","last_change":"2023-10-09T07:00:31.869955+0000","last_active":"2023-10-09T07:00:31.871739+0000","last_peered":"2023-10-09T07:00:31.871739+0000","last_clean":"2023-10-09T07:00:31.871739+0000","last_became_active":"2023-10-09T07:00:31.869389+0000","last_became_peered":"2023-10-09T07:00:31.869389+0000","last_unstale":"2023-10-09T07:00:31.871739+0000","last_undegraded":"2023-10-09T07:00:31.871739+0000","last_fullsized":"2023-10-09T07:00:31.871739+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:37:54.661947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.860622+0000","last_change":"2023-10-09T07:00:31.852746+0000","last_active":"2023-10-09T07:00:31.860622+0000","last_peered":"2023-10-09T07:00:31.860622+0000","last_clean":"2023-10-09T07:00:31.860622+0000","last_became_active":"2023-10-09T07:00:31.850896+0000","last_became_peered":"2023-10-09T07:00:31.850896+0000","last_unstale":"2023-10-09T07:00:31.860622+0000","last_undegraded":"2023-10-09T07:00:31.860622+0000","last_fullsized":"2023-10-09T07:00:31.860622+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:31:30.009466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.875054+0000","last_change":"2023-10-09T07:00:31.869032+0000","last_active":"2023-10-09T07:00:31.875054+0000","last_peered":"2023-10-09T07:00:31.875054+0000","last_clean":"2023-10-09T07:00:31.875054+0000","last_became_active":"2023-10-09T07:00:31.868792+0000","last_became_peered":"2023-10-09T07:00:31.868792+0000","last_unstale":"2023-10-09T07:00:31.875054+0000","last_undegraded":"2023-10-09T07:00:31.875054+0000","last_fullsized":"2023-10-09T07:00:31.875054+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:02.553149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.870559+0000","last_change":"2023-10-09T07:00:31.865984+0000","last_active":"2023-10-09T07:00:31.870559+0000","last_peered":"2023-10-09T07:00:31.870559+0000","last_clean":"2023-10-09T07:00:31.870559+0000","last_became_active":"2023-10-09T07:00:31.865684+0000","last_became_peered":"2023-10-09T07:00:31.865684+0000","last_unstale":"2023-10-09T07:00:31.870559+0000","last_undegraded":"2023-10-09T07:00:31.870559+0000","last_fullsized":"2023-10-09T07:00:31.870559+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:33.043926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.861791+0000","last_change":"2023-10-09T07:00:31.853667+0000","last_active":"2023-10-09T07:00:31.861791+0000","last_peered":"2023-10-09T07:00:31.861791+0000","last_clean":"2023-10-09T07:00:31.861791+0000","last_became_active":"2023-10-09T07:00:31.853396+0000","last_became_peered":"2023-10-09T07:00:31.853396+0000","last_unstale":"2023-10-09T07:00:31.861791+0000","last_undegraded":"2023-10-09T07:00:31.861791+0000","last_fullsized":"2023-10-09T07:00:31.861791+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:17.975207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.867484+0000","last_change":"2023-10-09T07:00:31.862754+0000","last_active":"2023-10-09T07:00:31.867484+0000","last_peered":"2023-10-09T07:00:31.867484+0000","last_clean":"2023-10-09T07:00:31.867484+0000","last_became_active":"2023-10-09T07:00:31.862508+0000","last_became_peered":"2023-10-09T07:00:31.862508+0000","last_unstale":"2023-10-09T07:00:31.867484+0000","last_undegraded":"2023-10-09T07:00:31.867484+0000","last_fullsized":"2023-10-09T07:00:31.867484+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:40:36.144071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"122'4","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.884989+0000","last_change":"2023-10-09T07:00:30.861628+0000","last_active":"2023-10-09T07:00:31.884989+0000","last_peered":"2023-10-09T07:00:31.884989+0000","last_clean":"2023-10-09T07:00:31.884989+0000","last_became_active":"2023-10-09T07:00:30.861119+0000","last_became_peered":"2023-10-09T07:00:30.861119+0000","last_unstale":"2023-10-09T07:00:31.884989+0000","last_undegraded":"2023-10-09T07:00:31.884989+0000","last_fullsized":"2023-10-09T07:00:31.884989+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:13.624752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.870499+0000","last_change":"2023-10-09T07:00:31.866106+0000","last_active":"2023-10-09T07:00:31.870499+0000","last_peered":"2023-10-09T07:00:31.870499+0000","last_clean":"2023-10-09T07:00:31.870499+0000","last_became_active":"2023-10-09T07:00:31.865758+0000","last_became_peered":"2023-10-09T07:00:31.865758+0000","last_unstale":"2023-10-09T07:00:31.870499+0000","last_undegraded":"2023-10-09T07:00:31.870499+0000","last_fullsized":"2023-10-09T07:00:31.870499+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:41:14.043969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.876067+0000","last_change":"2023-10-09T07:00:30.858804+0000","last_active":"2023-10-09T07:00:31.876067+0000","last_peered":"2023-10-09T07:00:31.876067+0000","last_clean":"2023-10-09T07:00:31.876067+0000","last_became_active":"2023-10-09T07:00:30.858480+0000","last_became_peered":"2023-10-09T07:00:30.858480+0000","last_unstale":"2023-10-09T07:00:31.876067+0000","last_undegraded":"2023-10-09T07:00:31.876067+0000","last_fullsized":"2023-10-09T07:00:31.876067+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:01:21.488599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.865003+0000","last_change":"2023-10-09T07:00:31.862120+0000","last_active":"2023-10-09T07:00:31.865003+0000","last_peered":"2023-10-09T07:00:31.865003+0000","last_clean":"2023-10-09T07:00:31.865003+0000","last_became_active":"2023-10-09T07:00:31.861856+0000","last_became_peered":"2023-10-09T07:00:31.861856+0000","last_unstale":"2023-10-09T07:00:31.865003+0000","last_undegraded":"2023-10-09T07:00:31.865003+0000","last_fullsized":"2023-10-09T07:00:31.865003+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:00:08.474575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.884914+0000","last_change":"2023-10-09T07:00:30.854153+0000","last_active":"2023-10-09T07:00:31.884914+0000","last_peered":"2023-10-09T07:00:31.884914+0000","last_clean":"2023-10-09T07:00:31.884914+0000","last_became_active":"2023-10-09T07:00:30.853893+0000","last_became_peered":"2023-10-09T07:00:30.853893+0000","last_unstale":"2023-10-09T07:00:31.884914+0000","last_undegraded":"2023-10-09T07:00:31.884914+0000","last_fullsized":"2023-10-09T07:00:31.884914+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:32.037149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.860961+0000","last_change":"2023-10-09T07:00:31.857292+0000","last_active":"2023-10-09T07:00:31.860961+0000","last_peered":"2023-10-09T07:00:31.860961+0000","last_clean":"2023-10-09T07:00:31.860961+0000","last_became_active":"2023-10-09T07:00:31.857039+0000","last_became_peered":"2023-10-09T07:00:31.857039+0000","last_unstale":"2023-10-09T07:00:31.860961+0000","last_undegraded":"2023-10-09T07:00:31.860961+0000","last_fullsized":"2023-10-09T07:00:31.860961+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:57:31.384067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.884968+0000","last_change":"2023-10-09T07:00:30.855969+0000","last_active":"2023-10-09T07:00:31.884968+0000","last_peered":"2023-10-09T07:00:31.884968+0000","last_clean":"2023-10-09T07:00:31.884968+0000","last_became_active":"2023-10-09T07:00:30.855698+0000","last_became_peered":"2023-10-09T07:00:30.855698+0000","last_unstale":"2023-10-09T07:00:31.884968+0000","last_undegraded":"2023-10-09T07:00:31.884968+0000","last_fullsized":"2023-10-09T07:00:31.884968+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:17:55.767482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.870217+0000","last_change":"2023-10-09T07:00:31.866774+0000","last_active":"2023-10-09T07:00:31.870217+0000","last_peered":"2023-10-09T07:00:31.870217+0000","last_clean":"2023-10-09T07:00:31.870217+0000","last_became_active":"2023-10-09T07:00:31.866488+0000","last_became_peered":"2023-10-09T07:00:31.866488+0000","last_unstale":"2023-10-09T07:00:31.870217+0000","last_undegraded":"2023-10-09T07:00:31.870217+0000","last_fullsized":"2023-10-09T07:00:31.870217+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:24:47.815919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.882334+0000","last_change":"2023-10-09T07:00:30.858699+0000","last_active":"2023-10-09T07:00:31.882334+0000","last_peered":"2023-10-09T07:00:31.882334+0000","last_clean":"2023-10-09T07:00:31.882334+0000","last_became_active":"2023-10-09T07:00:30.858453+0000","last_became_peered":"2023-10-09T07:00:30.858453+0000","last_unstale":"2023-10-09T07:00:31.882334+0000","last_undegraded":"2023-10-09T07:00:31.882334+0000","last_fullsized":"2023-10-09T07:00:31.882334+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:39:45.931492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.865100+0000","last_change":"2023-10-09T07:00:31.864038+0000","last_active":"2023-10-09T07:00:31.865100+0000","last_peered":"2023-10-09T07:00:31.865100+0000","last_clean":"2023-10-09T07:00:31.865100+0000","last_became_active":"2023-10-09T07:00:31.863780+0000","last_became_peered":"2023-10-09T07:00:31.863780+0000","last_unstale":"2023-10-09T07:00:31.865100+0000","last_undegraded":"2023-10-09T07:00:31.865100+0000","last_fullsized":"2023-10-09T07:00:31.865100+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:37:10.925516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.885035+0000","last_change":"2023-10-09T07:00:30.850599+0000","last_active":"2023-10-09T07:00:31.885035+0000","last_peered":"2023-10-09T07:00:31.885035+0000","last_clean":"2023-10-09T07:00:31.885035+0000","last_became_active":"2023-10-09T07:00:30.850362+0000","last_became_peered":"2023-10-09T07:00:30.850362+0000","last_unstale":"2023-10-09T07:00:31.885035+0000","last_undegraded":"2023-10-09T07:00:31.885035+0000","last_fullsized":"2023-10-09T07:00:31.885035+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:41:13.037192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.863007+0000","last_change":"2023-10-09T07:00:31.855028+0000","last_active":"2023-10-09T07:00:31.863007+0000","last_peered":"2023-10-09T07:00:31.863007+0000","last_clean":"2023-10-09T07:00:31.863007+0000","last_became_active":"2023-10-09T07:00:31.854093+0000","last_became_peered":"2023-10-09T07:00:31.854093+0000","last_unstale":"2023-10-09T07:00:31.863007+0000","last_undegraded":"2023-10-09T07:00:31.863007+0000","last_fullsized":"2023-10-09T07:00:31.863007+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:21.164187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.860183+0000","last_change":"2023-10-09T07:00:30.865516+0000","last_active":"2023-10-09T07:00:31.860183+0000","last_peered":"2023-10-09T07:00:31.860183+0000","last_clean":"2023-10-09T07:00:31.860183+0000","last_became_active":"2023-10-09T07:00:30.865117+0000","last_became_peered":"2023-10-09T07:00:30.865117+0000","last_unstale":"2023-10-09T07:00:31.860183+0000","last_undegraded":"2023-10-09T07:00:31.860183+0000","last_fullsized":"2023-10-09T07:00:31.860183+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:28:23.489668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.862563+0000","last_change":"2023-10-09T07:00:31.855935+0000","last_active":"2023-10-09T07:00:31.862563+0000","last_peered":"2023-10-09T07:00:31.862563+0000","last_clean":"2023-10-09T07:00:31.862563+0000","last_became_active":"2023-10-09T07:00:31.855536+0000","last_became_peered":"2023-10-09T07:00:31.855536+0000","last_unstale":"2023-10-09T07:00:31.862563+0000","last_undegraded":"2023-10-09T07:00:31.862563+0000","last_fullsized":"2023-10-09T07:00:31.862563+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:31.540757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.847964+0000","last_change":"2023-10-09T07:00:30.853530+0000","last_active":"2023-10-09T07:00:31.847964+0000","last_peered":"2023-10-09T07:00:31.847964+0000","last_clean":"2023-10-09T07:00:31.847964+0000","last_became_active":"2023-10-09T07:00:30.853273+0000","last_became_peered":"2023-10-09T07:00:30.853273+0000","last_unstale":"2023-10-09T07:00:31.847964+0000","last_undegraded":"2023-10-09T07:00:31.847964+0000","last_fullsized":"2023-10-09T07:00:31.847964+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:26:03.547881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.863537+0000","last_change":"2023-10-09T07:00:31.858005+0000","last_active":"2023-10-09T07:00:31.863537+0000","last_peered":"2023-10-09T07:00:31.863537+0000","last_clean":"2023-10-09T07:00:31.863537+0000","last_became_active":"2023-10-09T07:00:31.857742+0000","last_became_peered":"2023-10-09T07:00:31.857742+0000","last_unstale":"2023-10-09T07:00:31.863537+0000","last_undegraded":"2023-10-09T07:00:31.863537+0000","last_fullsized":"2023-10-09T07:00:31.863537+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:32:53.663177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.848822+0000","last_change":"2023-10-09T07:00:30.856704+0000","last_active":"2023-10-09T07:00:31.848822+0000","last_peered":"2023-10-09T07:00:31.848822+0000","last_clean":"2023-10-09T07:00:31.848822+0000","last_became_active":"2023-10-09T07:00:30.856456+0000","last_became_peered":"2023-10-09T07:00:30.856456+0000","last_unstale":"2023-10-09T07:00:31.848822+0000","last_undegraded":"2023-10-09T07:00:31.848822+0000","last_fullsized":"2023-10-09T07:00:31.848822+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:41:22.493206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.865639+0000","last_change":"2023-10-09T07:00:31.862758+0000","last_active":"2023-10-09T07:00:31.865639+0000","last_peered":"2023-10-09T07:00:31.865639+0000","last_clean":"2023-10-09T07:00:31.865639+0000","last_became_active":"2023-10-09T07:00:31.861784+0000","last_became_peered":"2023-10-09T07:00:31.861784+0000","last_unstale":"2023-10-09T07:00:31.865639+0000","last_undegraded":"2023-10-09T07:00:31.865639+0000","last_fullsized":"2023-10-09T07:00:31.865639+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:01.930860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.849957+0000","last_change":"2023-10-09T07:00:30.865027+0000","last_active":"2023-10-09T07:00:31.849957+0000","last_peered":"2023-10-09T07:00:31.849957+0000","last_clean":"2023-10-09T07:00:31.849957+0000","last_became_active":"2023-10-09T07:00:30.864779+0000","last_became_peered":"2023-10-09T07:00:30.864779+0000","last_unstale":"2023-10-09T07:00:31.849957+0000","last_undegraded":"2023-10-09T07:00:31.849957+0000","last_fullsized":"2023-10-09T07:00:31.849957+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:00.924083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.872566+0000","last_change":"2023-10-09T07:00:31.871652+0000","last_active":"2023-10-09T07:00:31.872566+0000","last_peered":"2023-10-09T07:00:31.872566+0000","last_clean":"2023-10-09T07:00:31.872566+0000","last_became_active":"2023-10-09T07:00:31.871274+0000","last_became_peered":"2023-10-09T07:00:31.871274+0000","last_unstale":"2023-10-09T07:00:31.872566+0000","last_undegraded":"2023-10-09T07:00:31.872566+0000","last_fullsized":"2023-10-09T07:00:31.872566+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:14.631529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"122'3","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.877559+0000","last_change":"2023-10-09T07:00:30.859218+0000","last_active":"2023-10-09T07:00:31.877559+0000","last_peered":"2023-10-09T07:00:31.877559+0000","last_clean":"2023-10-09T07:00:31.877559+0000","last_became_active":"2023-10-09T07:00:30.858926+0000","last_became_peered":"2023-10-09T07:00:30.858926+0000","last_unstale":"2023-10-09T07:00:31.877559+0000","last_undegraded":"2023-10-09T07:00:31.877559+0000","last_fullsized":"2023-10-09T07:00:31.877559+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:24:46.809142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.867780+0000","last_change":"2023-10-09T07:00:31.865175+0000","last_active":"2023-10-09T07:00:31.867780+0000","last_peered":"2023-10-09T07:00:31.867780+0000","last_clean":"2023-10-09T07:00:31.867780+0000","last_became_active":"2023-10-09T07:00:31.864678+0000","last_became_peered":"2023-10-09T07:00:31.864678+0000","last_unstale":"2023-10-09T07:00:31.867780+0000","last_undegraded":"2023-10-09T07:00:31.867780+0000","last_fullsized":"2023-10-09T07:00:31.867780+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:49.063716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"122'6","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.885309+0000","last_change":"2023-10-09T07:00:30.852565+0000","last_active":"2023-10-09T07:00:31.885309+0000","last_peered":"2023-10-09T07:00:31.885309+0000","last_clean":"2023-10-09T07:00:31.885309+0000","last_became_active":"2023-10-09T07:00:30.852189+0000","last_became_peered":"2023-10-09T07:00:30.852189+0000","last_unstale":"2023-10-09T07:00:31.885309+0000","last_undegraded":"2023-10-09T07:00:31.885309+0000","last_fullsized":"2023-10-09T07:00:31.885309+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:04:10.967996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.862802+0000","last_change":"2023-10-09T07:00:31.856114+0000","last_active":"2023-10-09T07:00:31.862802+0000","last_peered":"2023-10-09T07:00:31.862802+0000","last_clean":"2023-10-09T07:00:31.862802+0000","last_became_active":"2023-10-09T07:00:31.855852+0000","last_became_peered":"2023-10-09T07:00:31.855852+0000","last_unstale":"2023-10-09T07:00:31.862802+0000","last_undegraded":"2023-10-09T07:00:31.862802+0000","last_fullsized":"2023-10-09T07:00:31.862802+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:17:56.774259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.883393+0000","last_change":"2023-10-09T07:00:30.863710+0000","last_active":"2023-10-09T07:00:31.883393+0000","last_peered":"2023-10-09T07:00:31.883393+0000","last_clean":"2023-10-09T07:00:31.883393+0000","last_became_active":"2023-10-09T07:00:30.863221+0000","last_became_peered":"2023-10-09T07:00:30.863221+0000","last_unstale":"2023-10-09T07:00:31.883393+0000","last_undegraded":"2023-10-09T07:00:31.883393+0000","last_fullsized":"2023-10-09T07:00:31.883393+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:05.949770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.864992+0000","last_change":"2023-10-09T07:00:31.862704+0000","last_active":"2023-10-09T07:00:31.864992+0000","last_peered":"2023-10-09T07:00:31.864992+0000","last_clean":"2023-10-09T07:00:31.864992+0000","last_became_active":"2023-10-09T07:00:31.862456+0000","last_became_peered":"2023-10-09T07:00:31.862456+0000","last_unstale":"2023-10-09T07:00:31.864992+0000","last_undegraded":"2023-10-09T07:00:31.864992+0000","last_fullsized":"2023-10-09T07:00:31.864992+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:56:06.442624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.852583+0000","last_change":"2023-10-09T07:00:30.864661+0000","last_active":"2023-10-09T07:00:31.852583+0000","last_peered":"2023-10-09T07:00:31.852583+0000","last_clean":"2023-10-09T07:00:31.852583+0000","last_became_active":"2023-10-09T07:00:30.864403+0000","last_became_peered":"2023-10-09T07:00:30.864403+0000","last_unstale":"2023-10-09T07:00:31.852583+0000","last_undegraded":"2023-10-09T07:00:31.852583+0000","last_fullsized":"2023-10-09T07:00:31.852583+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:28:46.463936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.862488+0000","last_change":"2023-10-09T07:00:31.855868+0000","last_active":"2023-10-09T07:00:31.862488+0000","last_peered":"2023-10-09T07:00:31.862488+0000","last_clean":"2023-10-09T07:00:31.862488+0000","last_became_active":"2023-10-09T07:00:31.855599+0000","last_became_peered":"2023-10-09T07:00:31.855599+0000","last_unstale":"2023-10-09T07:00:31.862488+0000","last_undegraded":"2023-10-09T07:00:31.862488+0000","last_fullsized":"2023-10-09T07:00:31.862488+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:52.686400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.849829+0000","last_change":"2023-10-09T07:00:30.859086+0000","last_active":"2023-10-09T07:00:31.849829+0000","last_peered":"2023-10-09T07:00:31.849829+0000","last_clean":"2023-10-09T07:00:31.849829+0000","last_became_active":"2023-10-09T07:00:30.858796+0000","last_became_peered":"2023-10-09T07:00:30.858796+0000","last_unstale":"2023-10-09T07:00:31.849829+0000","last_undegraded":"2023-10-09T07:00:31.849829+0000","last_fullsized":"2023-10-09T07:00:31.849829+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:59.101699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.868978+0000","last_change":"2023-10-09T07:00:31.866355+0000","last_active":"2023-10-09T07:00:31.868978+0000","last_peered":"2023-10-09T07:00:31.868978+0000","last_clean":"2023-10-09T07:00:31.868978+0000","last_became_active":"2023-10-09T07:00:31.866030+0000","last_became_peered":"2023-10-09T07:00:31.866030+0000","last_unstale":"2023-10-09T07:00:31.868978+0000","last_undegraded":"2023-10-09T07:00:31.868978+0000","last_fullsized":"2023-10-09T07:00:31.868978+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:36:58.290119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"122'8","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.884776+0000","last_change":"2023-10-09T07:00:30.854984+0000","last_active":"2023-10-09T07:00:31.884776+0000","last_peered":"2023-10-09T07:00:31.884776+0000","last_clean":"2023-10-09T07:00:31.884776+0000","last_became_active":"2023-10-09T07:00:30.854733+0000","last_became_peered":"2023-10-09T07:00:30.854733+0000","last_unstale":"2023-10-09T07:00:31.884776+0000","last_undegraded":"2023-10-09T07:00:31.884776+0000","last_fullsized":"2023-10-09T07:00:31.884776+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:09:39.131347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.871844+0000","last_change":"2023-10-09T07:00:31.868986+0000","last_active":"2023-10-09T07:00:31.871844+0000","last_peered":"2023-10-09T07:00:31.871844+0000","last_clean":"2023-10-09T07:00:31.871844+0000","last_became_active":"2023-10-09T07:00:31.868122+0000","last_became_peered":"2023-10-09T07:00:31.868122+0000","last_unstale":"2023-10-09T07:00:31.871844+0000","last_undegraded":"2023-10-09T07:00:31.871844+0000","last_fullsized":"2023-10-09T07:00:31.871844+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:37:10.925516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.883772+0000","last_change":"2023-10-09T07:00:30.853994+0000","last_active":"2023-10-09T07:00:31.883772+0000","last_peered":"2023-10-09T07:00:31.883772+0000","last_clean":"2023-10-09T07:00:31.883772+0000","last_became_active":"2023-10-09T07:00:30.853716+0000","last_became_peered":"2023-10-09T07:00:30.853716+0000","last_unstale":"2023-10-09T07:00:31.883772+0000","last_undegraded":"2023-10-09T07:00:31.883772+0000","last_fullsized":"2023-10-09T07:00:31.883772+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:20:12.551262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.869620+0000","last_change":"2023-10-09T07:00:31.865997+0000","last_active":"2023-10-09T07:00:31.869620+0000","last_peered":"2023-10-09T07:00:31.869620+0000","last_clean":"2023-10-09T07:00:31.869620+0000","last_became_active":"2023-10-09T07:00:31.865707+0000","last_became_peered":"2023-10-09T07:00:31.865707+0000","last_unstale":"2023-10-09T07:00:31.869620+0000","last_undegraded":"2023-10-09T07:00:31.869620+0000","last_fullsized":"2023-10-09T07:00:31.869620+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:30.795417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.881141+0000","last_change":"2023-10-09T07:00:30.862644+0000","last_active":"2023-10-09T07:00:31.881141+0000","last_peered":"2023-10-09T07:00:31.881141+0000","last_clean":"2023-10-09T07:00:31.881141+0000","last_became_active":"2023-10-09T07:00:30.862237+0000","last_became_peered":"2023-10-09T07:00:30.862237+0000","last_unstale":"2023-10-09T07:00:31.881141+0000","last_undegraded":"2023-10-09T07:00:31.881141+0000","last_fullsized":"2023-10-09T07:00:31.881141+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:47:30.822257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.866328+0000","last_change":"2023-10-09T07:00:31.864210+0000","last_active":"2023-10-09T07:00:31.866328+0000","last_peered":"2023-10-09T07:00:31.866328+0000","last_clean":"2023-10-09T07:00:31.866328+0000","last_became_active":"2023-10-09T07:00:31.863918+0000","last_became_peered":"2023-10-09T07:00:31.863918+0000","last_unstale":"2023-10-09T07:00:31.866328+0000","last_undegraded":"2023-10-09T07:00:31.866328+0000","last_fullsized":"2023-10-09T07:00:31.866328+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:14.631529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.844282+0000","last_change":"2023-10-09T07:00:30.850080+0000","last_active":"2023-10-09T07:00:31.844282+0000","last_peered":"2023-10-09T07:00:31.844282+0000","last_clean":"2023-10-09T07:00:31.844282+0000","last_became_active":"2023-10-09T07:00:30.849370+0000","last_became_peered":"2023-10-09T07:00:30.849370+0000","last_unstale":"2023-10-09T07:00:31.844282+0000","last_undegraded":"2023-10-09T07:00:31.844282+0000","last_fullsized":"2023-10-09T07:00:31.844282+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:37:09.918739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.874944+0000","last_change":"2023-10-09T07:00:31.867774+0000","last_active":"2023-10-09T07:00:31.874944+0000","last_peered":"2023-10-09T07:00:31.874944+0000","last_clean":"2023-10-09T07:00:31.874944+0000","last_became_active":"2023-10-09T07:00:31.867457+0000","last_became_peered":"2023-10-09T07:00:31.867457+0000","last_unstale":"2023-10-09T07:00:31.874944+0000","last_undegraded":"2023-10-09T07:00:31.874944+0000","last_fullsized":"2023-10-09T07:00:31.874944+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:33.040357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.885032+0000","last_change":"2023-10-09T07:00:30.867372+0000","last_active":"2023-10-09T07:00:31.885032+0000","last_peered":"2023-10-09T07:00:31.885032+0000","last_clean":"2023-10-09T07:00:31.885032+0000","last_became_active":"2023-10-09T07:00:30.867088+0000","last_became_peered":"2023-10-09T07:00:30.867088+0000","last_unstale":"2023-10-09T07:00:31.885032+0000","last_undegraded":"2023-10-09T07:00:31.885032+0000","last_fullsized":"2023-10-09T07:00:31.885032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:37:53.655170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.875795+0000","last_change":"2023-10-09T07:00:31.868481+0000","last_active":"2023-10-09T07:00:31.875795+0000","last_peered":"2023-10-09T07:00:31.875795+0000","last_clean":"2023-10-09T07:00:31.875795+0000","last_became_active":"2023-10-09T07:00:31.868181+0000","last_became_peered":"2023-10-09T07:00:31.868181+0000","last_unstale":"2023-10-09T07:00:31.875795+0000","last_undegraded":"2023-10-09T07:00:31.875795+0000","last_fullsized":"2023-10-09T07:00:31.875795+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:51:39.132592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.849288+0000","last_change":"2023-10-09T07:00:30.859156+0000","last_active":"2023-10-09T07:00:31.849288+0000","last_peered":"2023-10-09T07:00:31.849288+0000","last_clean":"2023-10-09T07:00:31.849288+0000","last_became_active":"2023-10-09T07:00:30.858611+0000","last_became_peered":"2023-10-09T07:00:30.858611+0000","last_unstale":"2023-10-09T07:00:31.849288+0000","last_undegraded":"2023-10-09T07:00:31.849288+0000","last_fullsized":"2023-10-09T07:00:31.849288+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:20:12.551262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.869987+0000","last_change":"2023-10-09T07:00:31.867119+0000","last_active":"2023-10-09T07:00:31.869987+0000","last_peered":"2023-10-09T07:00:31.869987+0000","last_clean":"2023-10-09T07:00:31.869987+0000","last_became_active":"2023-10-09T07:00:31.866763+0000","last_became_peered":"2023-10-09T07:00:31.866763+0000","last_unstale":"2023-10-09T07:00:31.869987+0000","last_undegraded":"2023-10-09T07:00:31.869987+0000","last_fullsized":"2023-10-09T07:00:31.869987+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:35.705105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.849315+0000","last_change":"2023-10-09T07:00:30.854066+0000","last_active":"2023-10-09T07:00:31.849315+0000","last_peered":"2023-10-09T07:00:31.849315+0000","last_clean":"2023-10-09T07:00:31.849315+0000","last_became_active":"2023-10-09T07:00:30.853808+0000","last_became_peered":"2023-10-09T07:00:30.853808+0000","last_unstale":"2023-10-09T07:00:31.849315+0000","last_undegraded":"2023-10-09T07:00:31.849315+0000","last_fullsized":"2023-10-09T07:00:31.849315+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:59.101699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.871622+0000","last_change":"2023-10-09T07:00:31.867974+0000","last_active":"2023-10-09T07:00:31.871622+0000","last_peered":"2023-10-09T07:00:31.871622+0000","last_clean":"2023-10-09T07:00:31.871622+0000","last_became_active":"2023-10-09T07:00:31.867716+0000","last_became_peered":"2023-10-09T07:00:31.867716+0000","last_unstale":"2023-10-09T07:00:31.871622+0000","last_undegraded":"2023-10-09T07:00:31.871622+0000","last_fullsized":"2023-10-09T07:00:31.871622+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:21.164187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.844057+0000","last_change":"2023-10-09T07:00:30.849894+0000","last_active":"2023-10-09T07:00:31.844057+0000","last_peered":"2023-10-09T07:00:31.844057+0000","last_clean":"2023-10-09T07:00:31.844057+0000","last_became_active":"2023-10-09T07:00:30.849635+0000","last_became_peered":"2023-10-09T07:00:30.849635+0000","last_unstale":"2023-10-09T07:00:31.844057+0000","last_undegraded":"2023-10-09T07:00:31.844057+0000","last_fullsized":"2023-10-09T07:00:31.844057+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:57:36.380637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.863520+0000","last_change":"2023-10-09T07:00:31.856356+0000","last_active":"2023-10-09T07:00:31.863520+0000","last_peered":"2023-10-09T07:00:31.863520+0000","last_clean":"2023-10-09T07:00:31.863520+0000","last_became_active":"2023-10-09T07:00:31.855473+0000","last_became_peered":"2023-10-09T07:00:31.855473+0000","last_unstale":"2023-10-09T07:00:31.863520+0000","last_undegraded":"2023-10-09T07:00:31.863520+0000","last_fullsized":"2023-10-09T07:00:31.863520+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:30.260596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.878113+0000","last_change":"2023-10-09T07:00:30.851709+0000","last_active":"2023-10-09T07:00:31.878113+0000","last_peered":"2023-10-09T07:00:31.878113+0000","last_clean":"2023-10-09T07:00:31.878113+0000","last_became_active":"2023-10-09T07:00:30.851371+0000","last_became_peered":"2023-10-09T07:00:30.851371+0000","last_unstale":"2023-10-09T07:00:31.878113+0000","last_undegraded":"2023-10-09T07:00:31.878113+0000","last_fullsized":"2023-10-09T07:00:31.878113+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:04:10.967996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.870398+0000","last_change":"2023-10-09T07:00:31.864737+0000","last_active":"2023-10-09T07:00:31.870398+0000","last_peered":"2023-10-09T07:00:31.870398+0000","last_clean":"2023-10-09T07:00:31.870398+0000","last_became_active":"2023-10-09T07:00:31.864466+0000","last_became_peered":"2023-10-09T07:00:31.864466+0000","last_unstale":"2023-10-09T07:00:31.870398+0000","last_undegraded":"2023-10-09T07:00:31.870398+0000","last_fullsized":"2023-10-09T07:00:31.870398+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:35.912307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.846551+0000","last_change":"2023-10-09T07:00:30.856332+0000","last_active":"2023-10-09T07:00:31.846551+0000","last_peered":"2023-10-09T07:00:31.846551+0000","last_clean":"2023-10-09T07:00:31.846551+0000","last_became_active":"2023-10-09T07:00:30.854538+0000","last_became_peered":"2023-10-09T07:00:30.854538+0000","last_unstale":"2023-10-09T07:00:31.846551+0000","last_undegraded":"2023-10-09T07:00:31.846551+0000","last_fullsized":"2023-10-09T07:00:31.846551+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:08.822247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.870333+0000","last_change":"2023-10-09T07:00:31.864497+0000","last_active":"2023-10-09T07:00:31.870333+0000","last_peered":"2023-10-09T07:00:31.870333+0000","last_clean":"2023-10-09T07:00:31.870333+0000","last_became_active":"2023-10-09T07:00:31.864238+0000","last_became_peered":"2023-10-09T07:00:31.864238+0000","last_unstale":"2023-10-09T07:00:31.870333+0000","last_undegraded":"2023-10-09T07:00:31.870333+0000","last_fullsized":"2023-10-09T07:00:31.870333+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:35:45.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.844147+0000","last_change":"2023-10-09T07:00:30.855625+0000","last_active":"2023-10-09T07:00:31.844147+0000","last_peered":"2023-10-09T07:00:31.844147+0000","last_clean":"2023-10-09T07:00:31.844147+0000","last_became_active":"2023-10-09T07:00:30.855339+0000","last_became_peered":"2023-10-09T07:00:30.855339+0000","last_unstale":"2023-10-09T07:00:31.844147+0000","last_undegraded":"2023-10-09T07:00:31.844147+0000","last_fullsized":"2023-10-09T07:00:31.844147+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:20.157410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.871707+0000","last_change":"2023-10-09T07:00:31.869731+0000","last_active":"2023-10-09T07:00:31.871707+0000","last_peered":"2023-10-09T07:00:31.871707+0000","last_clean":"2023-10-09T07:00:31.871707+0000","last_became_active":"2023-10-09T07:00:31.869458+0000","last_became_peered":"2023-10-09T07:00:31.869458+0000","last_unstale":"2023-10-09T07:00:31.871707+0000","last_undegraded":"2023-10-09T07:00:31.871707+0000","last_fullsized":"2023-10-09T07:00:31.871707+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:09.829024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.860372+0000","last_change":"2023-10-09T07:00:30.861716+0000","last_active":"2023-10-09T07:00:31.860372+0000","last_peered":"2023-10-09T07:00:31.860372+0000","last_clean":"2023-10-09T07:00:31.860372+0000","last_became_active":"2023-10-09T07:00:30.861399+0000","last_became_peered":"2023-10-09T07:00:30.861399+0000","last_unstale":"2023-10-09T07:00:31.860372+0000","last_undegraded":"2023-10-09T07:00:31.860372+0000","last_fullsized":"2023-10-09T07:00:31.860372+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:29.788640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.867664+0000","last_change":"2023-10-09T07:00:31.864147+0000","last_active":"2023-10-09T07:00:31.867664+0000","last_peered":"2023-10-09T07:00:31.867664+0000","last_clean":"2023-10-09T07:00:31.867664+0000","last_became_active":"2023-10-09T07:00:31.863724+0000","last_became_peered":"2023-10-09T07:00:31.863724+0000","last_unstale":"2023-10-09T07:00:31.867664+0000","last_undegraded":"2023-10-09T07:00:31.867664+0000","last_fullsized":"2023-10-09T07:00:31.867664+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:15.135897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.844448+0000","last_change":"2023-10-09T07:00:30.854088+0000","last_active":"2023-10-09T07:00:31.844448+0000","last_peered":"2023-10-09T07:00:31.844448+0000","last_clean":"2023-10-09T07:00:31.844448+0000","last_became_active":"2023-10-09T07:00:30.853806+0000","last_became_peered":"2023-10-09T07:00:30.853806+0000","last_unstale":"2023-10-09T07:00:31.844448+0000","last_undegraded":"2023-10-09T07:00:31.844448+0000","last_fullsized":"2023-10-09T07:00:31.844448+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:24:18.704487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.867725+0000","last_change":"2023-10-09T07:00:31.864829+0000","last_active":"2023-10-09T07:00:31.867725+0000","last_peered":"2023-10-09T07:00:31.867725+0000","last_clean":"2023-10-09T07:00:31.867725+0000","last_became_active":"2023-10-09T07:00:31.864558+0000","last_became_peered":"2023-10-09T07:00:31.864558+0000","last_unstale":"2023-10-09T07:00:31.867725+0000","last_undegraded":"2023-10-09T07:00:31.867725+0000","last_fullsized":"2023-10-09T07:00:31.867725+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:53.482535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.860143+0000","last_change":"2023-10-09T07:00:30.863827+0000","last_active":"2023-10-09T07:00:31.860143+0000","last_peered":"2023-10-09T07:00:31.860143+0000","last_clean":"2023-10-09T07:00:31.860143+0000","last_became_active":"2023-10-09T07:00:30.863575+0000","last_became_peered":"2023-10-09T07:00:30.863575+0000","last_unstale":"2023-10-09T07:00:31.860143+0000","last_undegraded":"2023-10-09T07:00:31.860143+0000","last_fullsized":"2023-10-09T07:00:31.860143+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:24:46.809142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.868105+0000","last_change":"2023-10-09T07:00:31.865234+0000","last_active":"2023-10-09T07:00:31.868105+0000","last_peered":"2023-10-09T07:00:31.868105+0000","last_clean":"2023-10-09T07:00:31.868105+0000","last_became_active":"2023-10-09T07:00:31.864985+0000","last_became_peered":"2023-10-09T07:00:31.864985+0000","last_unstale":"2023-10-09T07:00:31.868105+0000","last_undegraded":"2023-10-09T07:00:31.868105+0000","last_fullsized":"2023-10-09T07:00:31.868105+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:06:38.607376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.850308+0000","last_change":"2023-10-09T07:00:30.860114+0000","last_active":"2023-10-09T07:00:31.850308+0000","last_peered":"2023-10-09T07:00:31.850308+0000","last_clean":"2023-10-09T07:00:31.850308+0000","last_became_active":"2023-10-09T07:00:30.859802+0000","last_became_peered":"2023-10-09T07:00:30.859802+0000","last_unstale":"2023-10-09T07:00:31.850308+0000","last_undegraded":"2023-10-09T07:00:31.850308+0000","last_fullsized":"2023-10-09T07:00:31.850308+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:51.679623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.871643+0000","last_change":"2023-10-09T07:00:31.869054+0000","last_active":"2023-10-09T07:00:31.871643+0000","last_peered":"2023-10-09T07:00:31.871643+0000","last_clean":"2023-10-09T07:00:31.871643+0000","last_became_active":"2023-10-09T07:00:31.868778+0000","last_became_peered":"2023-10-09T07:00:31.868778+0000","last_unstale":"2023-10-09T07:00:31.871643+0000","last_undegraded":"2023-10-09T07:00:31.871643+0000","last_fullsized":"2023-10-09T07:00:31.871643+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:24:19.711264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.850666+0000","last_change":"2023-10-09T07:00:30.863495+0000","last_active":"2023-10-09T07:00:31.850666+0000","last_peered":"2023-10-09T07:00:31.850666+0000","last_clean":"2023-10-09T07:00:31.850666+0000","last_became_active":"2023-10-09T07:00:30.863218+0000","last_became_peered":"2023-10-09T07:00:30.863218+0000","last_unstale":"2023-10-09T07:00:31.850666+0000","last_undegraded":"2023-10-09T07:00:31.850666+0000","last_fullsized":"2023-10-09T07:00:31.850666+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:19.505385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.874895+0000","last_change":"2023-10-09T07:00:31.867374+0000","last_active":"2023-10-09T07:00:31.874895+0000","last_peered":"2023-10-09T07:00:31.874895+0000","last_clean":"2023-10-09T07:00:31.874895+0000","last_became_active":"2023-10-09T07:00:31.866751+0000","last_became_peered":"2023-10-09T07:00:31.866751+0000","last_unstale":"2023-10-09T07:00:31.874895+0000","last_undegraded":"2023-10-09T07:00:31.874895+0000","last_fullsized":"2023-10-09T07:00:31.874895+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:30.832572+0000","last_clean_scrub_stamp":"2023-10-09T07:00:30.832572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:41:55.893491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.877467+0000","last_change":"2023-10-09T07:00:30.853680+0000","last_active":"2023-10-09T07:00:31.877467+0000","last_peered":"2023-10-09T07:00:31.877467+0000","last_clean":"2023-10-09T07:00:31.877467+0000","last_became_active":"2023-10-09T07:00:30.853390+0000","last_became_peered":"2023-10-09T07:00:30.853390+0000","last_unstale":"2023-10-09T07:00:31.877467+0000","last_undegraded":"2023-10-09T07:00:31.877467+0000","last_fullsized":"2023-10-09T07:00:31.877467+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:00:29.825795+0000","last_clean_scrub_stamp":"2023-10-09T07:00:29.825795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:47:30.822257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"112'227","reported_seq":642,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-09T07:00:31.853830+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T07:00:31.853830+0000","last_peered":"2023-10-09T07:00:31.853830+0000","last_clean":"2023-10-09T07:00:31.853830+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T07:00:31.853830+0000","last_undegraded":"2023-10-09T07:00:31.853830+0000","last_fullsized":"2023-10-09T07:00:31.853830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575061,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303456,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068384,"statfs":{"total":96636764160,"available":96326025216,"internally_reserved":0,"allocated":2121728,"data_stored":1335413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.67800000000000005,"15min":0.70899999999999996},"min":{"1min":0.44900000000000001,"5min":0.44700000000000001,"15min":0.316},"max":{"1min":1.042,"5min":1.0960000000000001,"15min":1.732},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.69799999999999995,"15min":0.72199999999999998},"min":{"1min":0.54900000000000004,"5min":0.42999999999999999,"15min":0.29999999999999999},"max":{"1min":0.99199999999999999,"5min":1.22,"15min":1.22},"last":0.57699999999999996}]},{"osd":1,"last update":"Mon Oct 9 07:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68200000000000005,"15min":0.71299999999999997},"min":{"1min":0.54000000000000004,"5min":0.5,"15min":0.379},"max":{"1min":0.91200000000000003,"5min":0.99299999999999999,"15min":2.3559999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69299999999999995,"15min":0.72399999999999998},"min":{"1min":0.56100000000000005,"5min":0.45700000000000002,"15min":0.40200000000000002},"max":{"1min":0.94499999999999995,"5min":0.998,"15min":1.7869999999999999},"last":0.627}]},{"osd":2,"last update":"Mon Oct 9 07:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70799999999999996,"15min":0.73399999999999999},"min":{"1min":0.51500000000000001,"5min":0.46300000000000002,"15min":0.44900000000000001},"max":{"1min":0.97699999999999998,"5min":0.98399999999999999,"15min":1.9430000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.70399999999999996,"15min":0.74399999999999999},"min":{"1min":0.64600000000000002,"5min":0.48199999999999998,"15min":0.44900000000000001},"max":{"1min":0.98999999999999999,"5min":1.262,"15min":2.6629999999999998},"last":0.60699999999999998}]},{"osd":3,"last update":"Mon Oct 9 07:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69399999999999995,"15min":0.71999999999999997},"min":{"1min":0.61299999999999999,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":0.97299999999999998,"5min":1.03,"15min":1.0409999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73199999999999998,"15min":0.755},"min":{"1min":0.55700000000000005,"5min":0.47999999999999998,"15min":0.47099999999999997},"max":{"1min":1.006,"5min":1.0569999999999999,"15min":1.827},"last":0.59399999999999997}]},{"osd":4,"last update":"Mon Oct 9 07:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.623,"15min":0.59599999999999997},"min":{"1min":0.46100000000000002,"5min":0.35299999999999998,"15min":0.35099999999999998},"max":{"1min":0.77400000000000002,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.65600000000000003,"15min":0.64500000000000002},"min":{"1min":0.48399999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85499999999999998,"5min":1.1850000000000001,"15min":2.577},"last":0.42399999999999999}]},{"osd":5,"last update":"Mon Oct 9 07:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66800000000000004,"15min":0.66200000000000003},"min":{"1min":0.50900000000000001,"5min":0.40699999999999997,"15min":0.39000000000000001},"max":{"1min":0.86099999999999999,"5min":1.0960000000000001,"15min":2.5169999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69199999999999995,"15min":0.69999999999999996},"min":{"1min":0.57799999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83199999999999996,"5min":1.141,"15min":2.9590000000000001},"last":0.51700000000000002}]},{"osd":6,"last update":"Mon Oct 9 07:00:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.745,"15min":0.748},"min":{"1min":0.56299999999999994,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93799999999999994,"5min":1.1000000000000001,"15min":3.0019999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71199999999999997,"15min":0.72199999999999998},"min":{"1min":0.5,"5min":0.374,"15min":0.374},"max":{"1min":1.02,"5min":1.0740000000000001,"15min":2.4039999999999999},"last":0.61599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575060,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302876,"kb_used_data":1492,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068964,"statfs":{"total":96636764160,"available":96326619136,"internally_reserved":0,"allocated":1527808,"data_stored":745557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:00:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.69399999999999995,"15min":0.72099999999999997},"min":{"1min":0.55500000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.66000000000000003,"15min":0.70599999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.36599999999999999},"max":{"1min":0.92800000000000005,"5min":0.93200000000000005,"15min":1.079},"last":0.67600000000000005}]},{"osd":1,"last update":"Mon Oct 9 07:00:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.68300000000000005,"15min":0.72399999999999998},"min":{"1min":0.51100000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.135},"last":0.63},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.71099999999999997,"15min":0.73499999999999999},"min":{"1min":0.61699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.81399999999999995}]},{"osd":2,"last update":"Mon Oct 9 07:00:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.69699999999999995,"15min":0.73799999999999999},"min":{"1min":0.48699999999999999,"5min":0.438,"15min":0.42599999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.391},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.69699999999999995,"15min":0.73699999999999999},"min":{"1min":0.56899999999999995,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.72799999999999998}]},{"osd":3,"last update":"Mon Oct 9 07:00:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.68100000000000005,"15min":0.70799999999999996},"min":{"1min":0.57799999999999996,"5min":0.44700000000000001,"15min":0.40600000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.0069999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71199999999999997,"15min":0.755},"min":{"1min":0.54600000000000004,"5min":0.53000000000000003,"15min":0.497},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.4750000000000001},"last":0.69699999999999995}]},{"osd":4,"last update":"Mon Oct 9 07:00:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61199999999999999,"15min":0.61899999999999999},"min":{"1min":0.432,"5min":0.38,"15min":0.38},"max":{"1min":1.329,"5min":1.329,"15min":1.768},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.46200000000000002,"5min":0.379,"15min":0.36199999999999999},"max":{"1min":0.93000000000000005,"5min":0.98499999999999999,"15min":1.601},"last":0.49299999999999999}]},{"osd":5,"last update":"Mon Oct 9 07:00:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66600000000000004,"15min":0.65300000000000002},"min":{"1min":0.437,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98199999999999998,"5min":1.0149999999999999,"15min":1.7609999999999999},"last":0.752},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70699999999999996,"15min":0.69399999999999995},"min":{"1min":0.45000000000000001,"5min":0.433,"15min":0.42299999999999999},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.52600000000000002}]},{"osd":7,"last update":"Mon Oct 9 07:00:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68600000000000005,"15min":0.67900000000000005},"min":{"1min":0.47999999999999998,"5min":0.42899999999999999,"15min":0.41799999999999998},"max":{"1min":0.95499999999999996,"5min":1.046,"15min":1.2949999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.73299999999999998,"15min":0.72499999999999998},"min":{"1min":0.5,"5min":0.45300000000000001,"15min":0.42399999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.8320000000000001},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575061,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302868,"kb_used_data":1484,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068972,"statfs":{"total":96636764160,"available":96326627328,"internally_reserved":0,"allocated":1519616,"data_stored":744933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45700000000000002,"15min":0.45600000000000002},"min":{"1min":0.30399999999999999,"5min":0.26600000000000001,"15min":0.25900000000000001},"max":{"1min":0.54100000000000004,"5min":2.153,"15min":2.153},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.34899999999999998,"5min":0.29399999999999998,"15min":0.26300000000000001},"max":{"1min":0.63600000000000001,"5min":1.23,"15min":1.23},"last":0.55800000000000005}]},{"osd":2,"last update":"Mon Oct 9 06:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48499999999999999,"15min":0.495},"min":{"1min":0.377,"5min":0.312,"15min":0.312},"max":{"1min":0.72199999999999998,"5min":1.169,"15min":1.169},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57899999999999996,"15min":0.57799999999999996},"min":{"1min":0.443,"5min":0.38300000000000001,"15min":0.34100000000000003},"max":{"1min":0.69599999999999995,"5min":3.077,"15min":3.077},"last":0.49399999999999999}]},{"osd":3,"last update":"Mon Oct 9 06:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59799999999999998,"15min":0.60999999999999999},"min":{"1min":0.47499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.73499999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55900000000000005,"15min":0.56200000000000006},"min":{"1min":0.40500000000000003,"5min":0.34899999999999998,"15min":0.34100000000000003},"max":{"1min":0.76300000000000001,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.51100000000000001}]},{"osd":4,"last update":"Mon Oct 9 06:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.73499999999999999,"15min":0.75800000000000001},"min":{"1min":0.57199999999999995,"5min":0.46700000000000003,"15min":0.38700000000000001},"max":{"1min":1.0009999999999999,"5min":1.0389999999999999,"15min":1.6739999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.76500000000000001,"15min":0.77800000000000002},"min":{"1min":0.56299999999999994,"5min":0.497,"15min":0.48599999999999999},"max":{"1min":0.92900000000000005,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.59299999999999997}]},{"osd":5,"last update":"Mon Oct 9 06:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76000000000000001,"15min":0.77700000000000002},"min":{"1min":0.53400000000000003,"5min":0.48699999999999999,"15min":0.48099999999999998},"max":{"1min":1.0780000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74299999999999999,"15min":0.77400000000000002},"min":{"1min":0.54100000000000004,"5min":0.52100000000000002,"15min":0.47999999999999998},"max":{"1min":1.0069999999999999,"5min":1.1040000000000001,"15min":1.637},"last":0.78100000000000003}]},{"osd":6,"last update":"Mon Oct 9 06:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.58399999999999996,"5min":0.50600000000000001,"15min":0.48399999999999999},"max":{"1min":0.97599999999999998,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78100000000000003,"15min":0.79600000000000004},"min":{"1min":0.58799999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.997,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.79000000000000004}]},{"osd":7,"last update":"Mon Oct 9 06:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82299999999999995,"15min":0.82799999999999996},"min":{"1min":0.56200000000000006,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.98999999999999999,"5min":3.4350000000000001,"15min":3.4350000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.78500000000000003,"15min":0.81699999999999995},"min":{"1min":0.65400000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.036,"5min":1.125,"15min":1.179},"last":0.89800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575060,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299356,"kb_used_data":2068,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072484,"statfs":{"total":96636764160,"available":96330223616,"internally_reserved":0,"allocated":2117632,"data_stored":1335855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.47899999999999998,"15min":0.47099999999999997},"min":{"1min":0.34000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.51800000000000002,"15min":0.54100000000000004},"min":{"1min":0.36799999999999999,"5min":0.313,"15min":0.28899999999999998},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":4.5819999999999999},"last":0.35999999999999999}]},{"osd":2,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.54200000000000004,"15min":0.56100000000000005},"min":{"1min":0.44600000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":4.6980000000000004},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.49199999999999999,"15min":0.504},"min":{"1min":0.35899999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.38700000000000001}]},{"osd":3,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.53200000000000003,"15min":0.53600000000000003},"min":{"1min":0.43099999999999999,"5min":0.34300000000000003,"15min":0.33200000000000002},"max":{"1min":2.4649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.47799999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":4.734},"last":0.46200000000000002}]},{"osd":4,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.55400000000000005,"5min":0.46400000000000002,"15min":0.42799999999999999},"max":{"1min":2.339,"5min":2.339,"15min":2.339},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.755,"15min":0.79700000000000004},"min":{"1min":0.66200000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.006,"5min":1.115,"15min":4.6619999999999999},"last":0.70299999999999996}]},{"osd":5,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.75700000000000001,"15min":0.77500000000000002},"min":{"1min":0.57799999999999996,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":1.0249999999999999,"5min":1.1259999999999999,"15min":1.1890000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.78400000000000003,"15min":0.79600000000000004},"min":{"1min":0.59899999999999998,"5min":0.5,"15min":0.45600000000000002},"max":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":0.93000000000000005}]},{"osd":6,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.76600000000000001,"15min":0.80900000000000005},"min":{"1min":0.66000000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.05,"5min":1.0600000000000001,"15min":4.6239999999999997},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.77400000000000002,"15min":0.79700000000000004},"min":{"1min":0.58899999999999997,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0640000000000001,"5min":1.1259999999999999,"15min":1.2689999999999999},"last":1.034}]},{"osd":7,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.80400000000000005,"15min":0.82899999999999996},"min":{"1min":0.65100000000000002,"5min":0.53700000000000003,"15min":0.46400000000000002},"max":{"1min":0.95799999999999996,"5min":1.155,"15min":1.256},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.83399999999999996,"15min":0.85099999999999998},"min":{"1min":0.65000000000000002,"5min":0.56000000000000005,"15min":0.51800000000000002},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.95599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575060,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311064,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060776,"statfs":{"total":96636764160,"available":96318234624,"internally_reserved":0,"allocated":1523712,"data_stored":744967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45300000000000001,"15min":0.45500000000000002},"min":{"1min":0.31,"5min":0.26500000000000001,"15min":0.25900000000000001},"max":{"1min":0.79800000000000004,"5min":1.673,"15min":1.8149999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.36599999999999999,"5min":0.28999999999999998,"15min":0.28000000000000003},"max":{"1min":0.68100000000000005,"5min":1.633,"15min":1.633},"last":0.58899999999999997}]},{"osd":1,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.45900000000000002,"15min":0.47299999999999998},"min":{"1min":0.38900000000000001,"5min":0.29499999999999998,"15min":0.28999999999999998},"max":{"1min":0.68999999999999995,"5min":1.097,"15min":1.097},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.502,"15min":0.51300000000000001},"min":{"1min":0.38300000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.74199999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.47699999999999998}]},{"osd":3,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.58699999999999997},"min":{"1min":0.46999999999999997,"5min":0.39000000000000001,"15min":0.38600000000000001},"max":{"1min":0.80400000000000005,"5min":0.86699999999999999,"15min":0.87},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.61399999999999999},"min":{"1min":0.51100000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79900000000000004,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.55200000000000005}]},{"osd":4,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.752,"15min":0.76700000000000002},"min":{"1min":0.55400000000000005,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":0.93000000000000005,"5min":1.2430000000000001,"15min":1.256},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.73199999999999998,"15min":0.76200000000000001},"min":{"1min":0.53000000000000003,"5min":0.48399999999999999,"15min":0.44800000000000001},"max":{"1min":0.97199999999999998,"5min":1.171,"15min":1.696},"last":0.86699999999999999}]},{"osd":5,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73899999999999999,"15min":0.77000000000000002},"min":{"1min":0.56699999999999995,"5min":0.501,"15min":0.42399999999999999},"max":{"1min":0.95399999999999996,"5min":1.143,"15min":1.3049999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.57399999999999995,"5min":0.52500000000000002,"15min":0.503},"max":{"1min":0.91800000000000004,"5min":1.218,"15min":1.3440000000000001},"last":1.038}]},{"osd":6,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77000000000000002,"15min":0.78300000000000003},"min":{"1min":0.58699999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92600000000000005,"5min":1.151,"15min":1.768},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.73699999999999999,"15min":0.78600000000000003},"min":{"1min":0.626,"5min":0.439,"15min":0.439},"max":{"1min":0.89000000000000001,"5min":1.101,"15min":1.5309999999999999},"last":0.77200000000000002}]},{"osd":7,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.77800000000000002,"15min":0.80400000000000005},"min":{"1min":0.623,"5min":0.56499999999999995,"15min":0.54600000000000004},"max":{"1min":1.0269999999999999,"5min":1.1439999999999999,"15min":1.7370000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.78600000000000003,"15min":0.82399999999999995},"min":{"1min":0.65600000000000003,"5min":0.57099999999999995,"15min":0.50900000000000001},"max":{"1min":0.98799999999999999,"5min":1.0409999999999999,"15min":1.3939999999999999},"last":0.97899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575061,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306980,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064860,"statfs":{"total":96636764160,"available":96322416640,"internally_reserved":0,"allocated":1536000,"data_stored":746491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45800000000000002,"15min":0.47199999999999998},"min":{"1min":0.33100000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.84099999999999997,"5min":0.86299999999999999,"15min":0.94299999999999995},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.47399999999999998,"15min":0.496},"min":{"1min":0.39400000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.79300000000000004,"5min":0.81799999999999995,"15min":1.228},"last":0.46400000000000002}]},{"osd":1,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.47099999999999997,"15min":0.48499999999999999},"min":{"1min":0.36799999999999999,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.81699999999999995,"5min":0.81899999999999995,"15min":2.0800000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.54300000000000004,"15min":0.55600000000000005},"min":{"1min":0.39500000000000002,"5min":0.34100000000000003,"15min":0.247},"max":{"1min":0.79200000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.39200000000000002}]},{"osd":2,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56000000000000005,"15min":0.58399999999999996},"min":{"1min":0.435,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71299999999999997,"5min":0.94099999999999995,"15min":2.3959999999999999},"last":0.442},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.626,"15min":0.63900000000000001},"min":{"1min":0.50700000000000001,"5min":0.379,"15min":0.309},"max":{"1min":0.82899999999999996,"5min":0.97699999999999998,"15min":3.8900000000000001},"last":0.47999999999999998}]},{"osd":4,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.72699999999999998,"15min":0.74399999999999999},"min":{"1min":0.59299999999999997,"5min":0.499,"15min":0.40799999999999997},"max":{"1min":1.0409999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.871},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.80700000000000005,"15min":0.82599999999999996},"min":{"1min":0.70499999999999996,"5min":0.60899999999999999,"15min":0.55300000000000005},"max":{"1min":1.1950000000000001,"5min":1.22,"15min":1.22},"last":0.90600000000000003}]},{"osd":5,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70799999999999996,"15min":0.73699999999999999},"min":{"1min":0.54500000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.0149999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.77600000000000002,"15min":0.80200000000000005},"min":{"1min":0.67100000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.141,"5min":1.1639999999999999,"15min":1.1830000000000001},"last":0.755}]},{"osd":6,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.76000000000000001,"15min":0.77900000000000003},"min":{"1min":0.63,"5min":0.53000000000000003,"15min":0.51700000000000002},"max":{"1min":1.093,"5min":1.304,"15min":1.304},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.74299999999999999,"15min":0.77600000000000002},"min":{"1min":0.61099999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.7769999999999999},"last":0.70799999999999996}]},{"osd":7,"last update":"Mon Oct 9 07:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.78900000000000003,"15min":0.81499999999999995},"min":{"1min":0.70999999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0369999999999999,"5min":1.2629999999999999,"15min":1.8180000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.79200000000000004,"15min":0.82199999999999995},"min":{"1min":0.64200000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1739999999999999,"5min":1.1919999999999999,"15min":1.486},"last":0.72799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575060,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311080,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060760,"statfs":{"total":96636764160,"available":96318218240,"internally_reserved":0,"allocated":1540096,"data_stored":746593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68899999999999995,"15min":0.70699999999999996},"min":{"1min":0.51500000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.018,"5min":1.5609999999999999,"15min":3.1139999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68999999999999995,"15min":0.71499999999999997},"min":{"1min":0.45300000000000001,"5min":0.39900000000000002,"15min":0.39300000000000002},"max":{"1min":0.84299999999999997,"5min":0.97399999999999998,"15min":2.8130000000000002},"last":0.81100000000000005}]},{"osd":1,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68799999999999994,"15min":0.71199999999999997},"min":{"1min":0.47799999999999998,"5min":0.39500000000000002,"15min":0.373},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.9279999999999999},"last":1.012},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.71199999999999997,"15min":0.73499999999999999},"min":{"1min":0.56699999999999995,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.98499999999999999,"5min":1.4339999999999999,"15min":3.4359999999999999},"last":0.622}]},{"osd":2,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71099999999999997,"15min":0.748},"min":{"1min":0.51100000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86199999999999999,"5min":1.03,"15min":2.5960000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.748,"15min":0.77700000000000002},"min":{"1min":0.56100000000000005,"5min":0.48299999999999998,"15min":0.47599999999999998},"max":{"1min":0.93200000000000005,"5min":1.0129999999999999,"15min":2.427},"last":0.59799999999999998}]},{"osd":3,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71699999999999997,"15min":0.73899999999999999},"min":{"1min":0.53000000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91600000000000004,"5min":0.94199999999999995,"15min":2.6440000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71899999999999997,"15min":0.748},"min":{"1min":0.498,"5min":0.443,"15min":0.43099999999999999},"max":{"1min":0.89500000000000002,"5min":1.0289999999999999,"15min":3.6899999999999999},"last":0.71899999999999997}]},{"osd":5,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59599999999999997,"15min":0.59799999999999998},"min":{"1min":0.41099999999999998,"5min":0.32700000000000001,"15min":0.317},"max":{"1min":0.82899999999999996,"5min":1.4870000000000001,"15min":3.3860000000000001},"last":0.433},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.627,"15min":0.64500000000000002},"min":{"1min":0.45300000000000001,"5min":0.38600000000000001,"15min":0.34999999999999998},"max":{"1min":0.88,"5min":1.0149999999999999,"15min":3.9300000000000002},"last":0.74399999999999999}]},{"osd":6,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.621,"15min":0.63500000000000001},"min":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.36499999999999999},"max":{"1min":1.042,"5min":1.042,"15min":3.5270000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67200000000000004,"15min":0.67700000000000005},"min":{"1min":0.47199999999999998,"5min":0.42499999999999999,"15min":0.374},"max":{"1min":0.94999999999999996,"5min":1.587,"15min":3.4740000000000002},"last":0.50600000000000001}]},{"osd":7,"last update":"Mon Oct 9 07:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.70399999999999996,"15min":0.71799999999999997},"min":{"1min":0.46200000000000002,"5min":0.44,"15min":0.34699999999999998},"max":{"1min":1.0900000000000001,"5min":1.1519999999999999,"15min":2.7210000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.73599999999999999,"15min":0.76400000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.439},"max":{"1min":0.97099999999999997,"5min":1.1899999999999999,"15min":3.7280000000000002},"last":0.96799999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575061,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1523712,"data_stored":745003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 06:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.67700000000000005,"15min":0.69699999999999995},"min":{"1min":0.54100000000000004,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.90500000000000003,"5min":0.93600000000000005,"15min":0.98099999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.65400000000000003,"15min":0.68400000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.32900000000000001},"max":{"1min":0.94299999999999995,"5min":1.119,"15min":1.119},"last":0.54300000000000004}]},{"osd":1,"last update":"Mon Oct 9 06:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.66900000000000004,"15min":0.68500000000000005},"min":{"1min":0.47799999999999998,"5min":0.42299999999999999,"15min":0.39700000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.034},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.71499999999999997,"15min":0.72199999999999998},"min":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.40400000000000003},"max":{"1min":0.88700000000000001,"5min":0.95099999999999996,"15min":1.0229999999999999},"last":0.72199999999999998}]},{"osd":2,"last update":"Mon Oct 9 06:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.70099999999999996,"15min":0.72399999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.47299999999999998},"max":{"1min":0.92500000000000004,"5min":0.997,"15min":1.0580000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.55300000000000005,"5min":0.46200000000000002,"15min":0.442},"max":{"1min":0.89700000000000002,"5min":1.006,"15min":1.0720000000000001},"last":0.70899999999999996}]},{"osd":3,"last update":"Mon Oct 9 06:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.69799999999999995,"15min":0.71599999999999997},"min":{"1min":0.46300000000000002,"5min":0.438,"15min":0.435},"max":{"1min":0.97799999999999998,"5min":1.1499999999999999,"15min":1.302},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.74399999999999999,"15min":0.76200000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96299999999999997,"5min":1.03,"15min":1.399},"last":0.751}]},{"osd":4,"last update":"Mon Oct 9 06:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.62,"15min":0.59999999999999998},"min":{"1min":0.42299999999999999,"5min":0.377,"15min":0.36099999999999999},"max":{"1min":0.73999999999999999,"5min":0.96099999999999997,"15min":0.96799999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.62,"15min":0.61199999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77400000000000002,"5min":1.075,"15min":1.075},"last":0.42099999999999999}]},{"osd":6,"last update":"Mon Oct 9 06:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.51100000000000001,"5min":0.41099999999999998,"15min":0.36599999999999999},"max":{"1min":0.79700000000000004,"5min":1.018,"15min":1.018},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.66900000000000004},"min":{"1min":0.495,"5min":0.41199999999999998,"15min":0.38900000000000001},"max":{"1min":0.92300000000000004,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.51700000000000002}]},{"osd":7,"last update":"Mon Oct 9 06:59:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.68700000000000006,"15min":0.68400000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.90000000000000002,"5min":1.48,"15min":1.48},"last":0.499},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.76300000000000001},"min":{"1min":0.57499999999999996,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.90500000000000003,"5min":1.466,"15min":1.466},"last":0.63500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T07:00:36.624 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T07:00:36.624 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T07:00:36.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.845+0000 7ff8389ff700 1 Processor -- start 2023-10-09T07:00:36.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.845+0000 7ff8389ff700 1 -- start start 2023-10-09T07:00:36.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.847+0000 7ff8389ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff834156620 0x7ff8340c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:36.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.847+0000 7ff8389ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83415a6f0 con 0x7ff834068390 2023-10-09T07:00:36.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.847+0000 7ff8389ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83415a9d0 con 0x7ff8341569f0 2023-10-09T07:00:36.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.847+0000 7ff8389ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8340c8d30 con 0x7ff834156620 2023-10-09T07:00:36.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.847+0000 7ff832d9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff834068390 0x7ff83406da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34010/0 (socket says 172.21.15.71:34010) 2023-10-09T07:00:36.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.847+0000 7ff832d9d700 1 -- 172.21.15.71:0/4141400878 learned_addr learned my addr 172.21.15.71:0/4141400878 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:36.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.847+0000 7ff83259c700 1 --2- 172.21.15.71:0/4141400878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff834156620 0x7ff8340c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:36.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.847+0000 7ff831d9b700 1 -- 172.21.15.71:0/4141400878 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1076059494 0 0) 0x7ff83415a6f0 con 0x7ff834068390 2023-10-09T07:00:36.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.847+0000 7ff831d9b700 1 -- 172.21.15.71:0/4141400878 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff820003570 con 0x7ff834068390 2023-10-09T07:00:36.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.848+0000 7ff831d9b700 1 -- 172.21.15.71:0/4141400878 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3452195235 0 0) 0x7ff83415a9d0 con 0x7ff8341569f0 2023-10-09T07:00:36.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.848+0000 7ff831d9b700 1 -- 172.21.15.71:0/4141400878 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff83415a6f0 con 0x7ff8341569f0 2023-10-09T07:00:36.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.848+0000 7ff831d9b700 1 -- 172.21.15.71:0/4141400878 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3828143651 0 0) 0x7ff820003570 con 0x7ff834068390 2023-10-09T07:00:36.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.848+0000 7ff83259c700 1 -- 172.21.15.71:0/4141400878 >> v1:172.21.15.179:6789/0 conn(0x7ff8341569f0 legacy=0x7ff8340ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:36.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.848+0000 7ff83259c700 1 -- 172.21.15.71:0/4141400878 >> v1:172.21.15.71:6789/0 conn(0x7ff834068390 legacy=0x7ff83406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:36.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.848+0000 7ff83259c700 1 -- 172.21.15.71:0/4141400878 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83415acb0 con 0x7ff834156620 2023-10-09T07:00:36.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.848+0000 7ff83259c700 1 --2- 172.21.15.71:0/4141400878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff834156620 0x7ff8340c87f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff824009910 tx=0x7ff8240091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e2892fcdaf34ae7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:36.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.848+0000 7ff831d9b700 1 -- 172.21.15.71:0/4141400878 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c0017f0 con 0x7ff834156620 2023-10-09T07:00:36.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.848+0000 7ff831d9b700 1 -- 172.21.15.71:0/4141400878 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff824011420 con 0x7ff834156620 2023-10-09T07:00:36.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.848+0000 7ff831d9b700 1 -- 172.21.15.71:0/4141400878 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8240117a0 con 0x7ff834156620 2023-10-09T07:00:36.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.849+0000 7ff8389ff700 1 -- 172.21.15.71:0/4141400878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff834156620 msgr2=0x7ff8340c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:36.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.849+0000 7ff8389ff700 1 --2- 172.21.15.71:0/4141400878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff834156620 0x7ff8340c87f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff824009910 tx=0x7ff8240091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:36.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.849+0000 7ff8389ff700 1 -- 172.21.15.71:0/4141400878 shutdown_connections 2023-10-09T07:00:36.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.849+0000 7ff8389ff700 1 --2- 172.21.15.71:0/4141400878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff834156620 0x7ff8340c87f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:36.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.849+0000 7ff8389ff700 1 -- 172.21.15.71:0/4141400878 >> 172.21.15.71:0/4141400878 conn(0x7ff8340cc540 msgr2=0x7ff8340cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:36.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.849+0000 7ff8389ff700 1 -- 172.21.15.71:0/4141400878 shutdown_connections 2023-10-09T07:00:36.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.849+0000 7ff8389ff700 1 -- 172.21.15.71:0/4141400878 wait complete. 2023-10-09T07:00:36.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.850+0000 7ff8389ff700 1 Processor -- start 2023-10-09T07:00:36.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.851+0000 7ff8389ff700 1 -- start start 2023-10-09T07:00:36.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.851+0000 7ff8389ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff834068390 0x7ff834153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:36.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.851+0000 7ff8389ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff834156620 0x7ff8340c1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:36.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.851+0000 7ff8389ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8341569f0 0x7ff8340cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:36.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.851+0000 7ff8389ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8340c2760 con 0x7ff834068390 2023-10-09T07:00:36.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.851+0000 7ff8389ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8341542c0 con 0x7ff834156620 2023-10-09T07:00:36.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.851+0000 7ff8389ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8340c1b50 con 0x7ff8341569f0 2023-10-09T07:00:36.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.852+0000 7ff83259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff834068390 0x7ff834153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:36.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.852+0000 7ff83259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff834068390 0x7ff834153d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56090/0 (socket says 172.21.15.71:56090) 2023-10-09T07:00:36.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.852+0000 7ff83259c700 1 -- 172.21.15.71:0/1411590636 learned_addr learned my addr 172.21.15.71:0/1411590636 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:36.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.852+0000 7ff832d9d700 1 --2- 172.21.15.71:0/1411590636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8341569f0 0x7ff8340cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:36.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.852+0000 7ff82bfff700 1 --2- 172.21.15.71:0/1411590636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff834156620 0x7ff8340c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:36.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.852+0000 7ff83259c700 1 -- 172.21.15.71:0/1411590636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8341569f0 msgr2=0x7ff8340cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:36.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.852+0000 7ff83259c700 1 --2- 172.21.15.71:0/1411590636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8341569f0 0x7ff8340cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:36.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.852+0000 7ff83259c700 1 -- 172.21.15.71:0/1411590636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff834156620 msgr2=0x7ff8340c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:36.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.852+0000 7ff83259c700 1 --2- 172.21.15.71:0/1411590636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff834156620 0x7ff8340c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:36.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.852+0000 7ff83259c700 1 -- 172.21.15.71:0/1411590636 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff824009420 con 0x7ff834068390 2023-10-09T07:00:36.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.852+0000 7ff83259c700 1 --2- 172.21.15.71:0/1411590636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff834068390 0x7ff834153d80 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7ff824009860 tx=0x7ff824016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:36.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.853+0000 7ff82a7fc700 1 -- 172.21.15.71:0/1411590636 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82401cc50 con 0x7ff834068390 2023-10-09T07:00:36.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.853+0000 7ff82a7fc700 1 -- 172.21.15.71:0/1411590636 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82401cdd0 con 0x7ff834068390 2023-10-09T07:00:36.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.853+0000 7ff82a7fc700 1 -- 172.21.15.71:0/1411590636 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82401a6a0 con 0x7ff834068390 2023-10-09T07:00:36.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.853+0000 7ff8389ff700 1 -- 172.21.15.71:0/1411590636 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8340c1e30 con 0x7ff834068390 2023-10-09T07:00:36.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.853+0000 7ff8389ff700 1 -- 172.21.15.71:0/1411590636 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8340c23f0 con 0x7ff834068390 2023-10-09T07:00:36.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.854+0000 7ff8389ff700 1 -- 172.21.15.71:0/1411590636 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8340718b0 con 0x7ff834068390 2023-10-09T07:00:36.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.855+0000 7ff82a7fc700 1 -- 172.21.15.71:0/1411590636 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff82401aad0 con 0x7ff834068390 2023-10-09T07:00:36.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.855+0000 7ff82a7fc700 1 --2- 172.21.15.71:0/1411590636 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff814066f30 0x7ff8140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:36.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.856+0000 7ff82a7fc700 1 -- 172.21.15.71:0/1411590636 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6097+0+0 (secure 0 0 0) 0x7ff824085f10 con 0x7ff834068390 2023-10-09T07:00:36.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.856+0000 7ff82bfff700 1 --2- 172.21.15.71:0/1411590636 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff814066f30 0x7ff8140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:36.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.857+0000 7ff82bfff700 1 --2- 172.21.15.71:0/1411590636 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff814066f30 0x7ff8140693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff834159750 tx=0x7ff81c009040 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:36.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:36.859+0000 7ff82a7fc700 1 -- 172.21.15.71:0/1411590636 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff824052ff0 con 0x7ff834068390 2023-10-09T07:00:37.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.127+0000 7ff8389ff700 1 -- 172.21.15.71:0/1411590636 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff8340c2a40 con 0x7ff834068390 2023-10-09T07:00:37.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.131+0000 7ff82a7fc700 1 -- 172.21.15.71:0/1411590636 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff824056610 con 0x7ff834068390 2023-10-09T07:00:37.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.134+0000 7ff8389ff700 1 -- 172.21.15.71:0/1411590636 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff814066f30 msgr2=0x7ff8140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:37.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.134+0000 7ff8389ff700 1 --2- 172.21.15.71:0/1411590636 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff814066f30 0x7ff8140693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff834159750 tx=0x7ff81c009040 comp rx=0 tx=0).stop 2023-10-09T07:00:37.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.134+0000 7ff8389ff700 1 -- 172.21.15.71:0/1411590636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff834068390 msgr2=0x7ff834153d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:37.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.134+0000 7ff8389ff700 1 --2- 172.21.15.71:0/1411590636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff834068390 0x7ff834153d80 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7ff824009860 tx=0x7ff824016000 comp rx=0 tx=0).stop 2023-10-09T07:00:37.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.134+0000 7ff8389ff700 1 -- 172.21.15.71:0/1411590636 shutdown_connections 2023-10-09T07:00:37.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.134+0000 7ff8389ff700 1 --2- 172.21.15.71:0/1411590636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8341569f0 0x7ff8340cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:37.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.134+0000 7ff8389ff700 1 --2- 172.21.15.71:0/1411590636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff834068390 0x7ff834153d80 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:37.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.134+0000 7ff8389ff700 1 --2- 172.21.15.71:0/1411590636 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff814066f30 0x7ff8140693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:37.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.134+0000 7ff8389ff700 1 --2- 172.21.15.71:0/1411590636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff834156620 0x7ff8340c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:37.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.134+0000 7ff8389ff700 1 -- 172.21.15.71:0/1411590636 >> 172.21.15.71:0/1411590636 conn(0x7ff8340cc540 msgr2=0x7ff8340c8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:37.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.134+0000 7ff8389ff700 1 -- 172.21.15.71:0/1411590636 shutdown_connections 2023-10-09T07:00:37.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.134+0000 7ff8389ff700 1 -- 172.21.15.71:0/1411590636 wait complete. 2023-10-09T07:00:37.136 INFO:teuthology.orchestra.run.smithi071.stderr:updated caps for client.0 2023-10-09T07:00:37.152 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:00:37.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.330+0000 7f8286bff700 1 Processor -- start 2023-10-09T07:00:37.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.331+0000 7f8286bff700 1 -- start start 2023-10-09T07:00:37.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.332+0000 7f8286bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82800b1420 0x7f82800ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:37.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.332+0000 7f8286bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82800cc300 con 0x7f82800cbf30 2023-10-09T07:00:37.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.332+0000 7f8286bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82800ad370 con 0x7f82800ccf90 2023-10-09T07:00:37.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.332+0000 7f8286bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8280156bf0 con 0x7f82800b1420 2023-10-09T07:00:37.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.332+0000 7f828499b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f82800cbf30 0x7f82800b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34012/0 (socket says 172.21.15.71:34012) 2023-10-09T07:00:37.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.332+0000 7f828499b700 1 -- 172.21.15.71:0/1100445497 learned_addr learned my addr 172.21.15.71:0/1100445497 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:37.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.333+0000 7f8277fff700 1 --2- 172.21.15.71:0/1100445497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82800b1420 0x7f82800ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:37.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.333+0000 7f82777fe700 1 -- 172.21.15.71:0/1100445497 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 265630399 0 0) 0x7f82800cc300 con 0x7f82800cbf30 2023-10-09T07:00:37.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.333+0000 7f82777fe700 1 -- 172.21.15.71:0/1100445497 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8268003570 con 0x7f82800cbf30 2023-10-09T07:00:37.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.333+0000 7f82777fe700 1 -- 172.21.15.71:0/1100445497 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3242328769 0 0) 0x7f8268003570 con 0x7f82800cbf30 2023-10-09T07:00:37.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.333+0000 7f82777fe700 1 -- 172.21.15.71:0/1100445497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82800b1420 msgr2=0x7f82800ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:37.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.333+0000 7f82777fe700 1 --2- 172.21.15.71:0/1100445497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82800b1420 0x7f82800ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:37.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.333+0000 7f82777fe700 1 -- 172.21.15.71:0/1100445497 >> v1:172.21.15.179:6789/0 conn(0x7f82800ccf90 legacy=0x7f82800c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:37.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.333+0000 7f82777fe700 1 -- 172.21.15.71:0/1100445497 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82800ad650 con 0x7f82800cbf30 2023-10-09T07:00:37.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.333+0000 7f82777fe700 1 -- 172.21.15.71:0/1100445497 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f827c001470 con 0x7f82800cbf30 2023-10-09T07:00:37.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.333+0000 7f82777fe700 1 -- 172.21.15.71:0/1100445497 >> v1:172.21.15.71:6789/0 conn(0x7f82800cbf30 legacy=0x7f82800b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:37.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.333+0000 7f82777fe700 1 --2- 172.21.15.71:0/1100445497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8268003a90 0x7f8268003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:37.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.333+0000 7f82777fe700 1 --2- 172.21.15.71:0/1100445497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8268004810 0x7f8268004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:37.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.333+0000 7f82777fe700 1 --2- 172.21.15.71:0/1100445497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82800b1420 0x7f82680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:37.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.333+0000 7f82777fe700 1 -- 172.21.15.71:0/1100445497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8280156bf0 con 0x7f8268003a90 2023-10-09T07:00:37.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.333+0000 7f82777fe700 1 -- 172.21.15.71:0/1100445497 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826800dd20 con 0x7f8268004810 2023-10-09T07:00:37.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.333+0000 7f82777fe700 1 -- 172.21.15.71:0/1100445497 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f826800dee0 con 0x7f82800b1420 2023-10-09T07:00:37.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.333+0000 7f828499b700 1 --2- 172.21.15.71:0/1100445497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8268003a90 0x7f8268003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:37.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.334+0000 7f828519c700 1 --2- 172.21.15.71:0/1100445497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82800b1420 0x7f82680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:37.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.334+0000 7f8277fff700 1 --2- 172.21.15.71:0/1100445497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8268004810 0x7f8268004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:37.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.334+0000 7f828499b700 1 -- 172.21.15.71:0/1100445497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82800b1420 msgr2=0x7f82680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:37.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.334+0000 7f828499b700 1 --2- 172.21.15.71:0/1100445497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82800b1420 0x7f82680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:37.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.334+0000 7f828499b700 1 -- 172.21.15.71:0/1100445497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8268004810 msgr2=0x7f8268004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:37.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.334+0000 7f828499b700 1 --2- 172.21.15.71:0/1100445497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8268004810 0x7f8268004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:37.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.334+0000 7f828499b700 1 -- 172.21.15.71:0/1100445497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8268003570 con 0x7f8268003a90 2023-10-09T07:00:37.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.334+0000 7f828499b700 1 --2- 172.21.15.71:0/1100445497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8268003a90 0x7f8268003e60 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f827c00c2d0 tx=0x7f827c001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29d0c729ec788b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:37.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.334+0000 7f82777fe700 1 -- 172.21.15.71:0/1100445497 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c00cbc0 con 0x7f8268003a90 2023-10-09T07:00:37.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.334+0000 7f82777fe700 1 -- 172.21.15.71:0/1100445497 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c00cd20 con 0x7f8268003a90 2023-10-09T07:00:37.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.334+0000 7f82777fe700 1 -- 172.21.15.71:0/1100445497 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c005b70 con 0x7f8268003a90 2023-10-09T07:00:37.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.335+0000 7f8286bff700 1 -- 172.21.15.71:0/1100445497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8268003a90 msgr2=0x7f8268003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:37.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.335+0000 7f8286bff700 1 --2- 172.21.15.71:0/1100445497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8268003a90 0x7f8268003e60 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f827c00c2d0 tx=0x7f827c001df0 comp rx=0 tx=0).stop 2023-10-09T07:00:37.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.335+0000 7f828519c700 1 -- 172.21.15.71:0/1100445497 reap_dead start 2023-10-09T07:00:37.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.335+0000 7f8286bff700 1 -- 172.21.15.71:0/1100445497 shutdown_connections 2023-10-09T07:00:37.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.335+0000 7f8286bff700 1 -- 172.21.15.71:0/1100445497 >> 172.21.15.71:0/1100445497 conn(0x7f828006a320 msgr2=0x7f82800cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:37.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.335+0000 7f8286bff700 1 -- 172.21.15.71:0/1100445497 shutdown_connections 2023-10-09T07:00:37.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.335+0000 7f8286bff700 1 -- 172.21.15.71:0/1100445497 wait complete. 2023-10-09T07:00:37.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.336+0000 7f8286bff700 1 Processor -- start 2023-10-09T07:00:37.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.336+0000 7f8286bff700 1 -- start start 2023-10-09T07:00:37.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.337+0000 7f8286bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8268003a90 0x7f82801522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:37.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.337+0000 7f8286bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8280159dd0 0x7f8280158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:37.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.337+0000 7f8286bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82801594c0 0x7f82800a77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:37.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.337+0000 7f8286bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8280158af0 con 0x7f8280159dd0 2023-10-09T07:00:37.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.337+0000 7f8286bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8280157ee0 con 0x7f82801594c0 2023-10-09T07:00:37.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.337+0000 7f8286bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82801581c0 con 0x7f8268003a90 2023-10-09T07:00:37.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.337+0000 7f8277fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8280159dd0 0x7f8280158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:37.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.338+0000 7f8277fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8280159dd0 0x7f8280158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56102/0 (socket says 172.21.15.71:56102) 2023-10-09T07:00:37.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.338+0000 7f8277fff700 1 -- 172.21.15.71:0/3212397778 learned_addr learned my addr 172.21.15.71:0/3212397778 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:37.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.338+0000 7f828499b700 1 --2- 172.21.15.71:0/3212397778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8268003a90 0x7f82801522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:37.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.338+0000 7f828519c700 1 --2- 172.21.15.71:0/3212397778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82801594c0 0x7f82800a77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:37.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.338+0000 7f8277fff700 1 -- 172.21.15.71:0/3212397778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8268003a90 msgr2=0x7f82801522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:37.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.338+0000 7f8277fff700 1 --2- 172.21.15.71:0/3212397778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8268003a90 0x7f82801522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:37.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.338+0000 7f8277fff700 1 -- 172.21.15.71:0/3212397778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82801594c0 msgr2=0x7f82800a77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:37.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.338+0000 7f8277fff700 1 --2- 172.21.15.71:0/3212397778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82801594c0 0x7f82800a77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:37.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.338+0000 7f8277fff700 1 -- 172.21.15.71:0/3212397778 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82801584a0 con 0x7f8280159dd0 2023-10-09T07:00:37.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.338+0000 7f828499b700 1 --2- 172.21.15.71:0/3212397778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8268003a90 0x7f82801522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:00:37.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.338+0000 7f828519c700 1 --2- 172.21.15.71:0/3212397778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82801594c0 0x7f82800a77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:00:37.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.338+0000 7f8277fff700 1 --2- 172.21.15.71:0/3212397778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8280159dd0 0x7f8280158f80 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f8270011990 tx=0x7f8270008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:37.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.338+0000 7f8274ff9700 1 -- 172.21.15.71:0/3212397778 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827000f6d0 con 0x7f8280159dd0 2023-10-09T07:00:37.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.338+0000 7f8274ff9700 1 -- 172.21.15.71:0/3212397778 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827000f830 con 0x7f8280159dd0 2023-10-09T07:00:37.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.338+0000 7f8286bff700 1 -- 172.21.15.71:0/3212397778 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8280158780 con 0x7f8280159dd0 2023-10-09T07:00:37.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.338+0000 7f8274ff9700 1 -- 172.21.15.71:0/3212397778 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827000fbf0 con 0x7f8280159dd0 2023-10-09T07:00:37.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.339+0000 7f8286bff700 1 -- 172.21.15.71:0/3212397778 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82800a7d20 con 0x7f8280159dd0 2023-10-09T07:00:37.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.339+0000 7f8286bff700 1 -- 172.21.15.71:0/3212397778 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828004c3c0 con 0x7f8280159dd0 2023-10-09T07:00:37.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.340+0000 7f8274ff9700 1 -- 172.21.15.71:0/3212397778 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8270015460 con 0x7f8280159dd0 2023-10-09T07:00:37.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.341+0000 7f8274ff9700 1 --2- 172.21.15.71:0/3212397778 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f826c066f30 0x7f826c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:37.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.341+0000 7f8274ff9700 1 -- 172.21.15.71:0/3212397778 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f8270084e60 con 0x7f8280159dd0 2023-10-09T07:00:37.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.342+0000 7f828499b700 1 --2- 172.21.15.71:0/3212397778 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f826c066f30 0x7f826c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:37.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.342+0000 7f828499b700 1 --2- 172.21.15.71:0/3212397778 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f826c066f30 0x7f826c0693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f827c008fd0 tx=0x7f827c015000 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:37.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.345+0000 7f8274ff9700 1 -- 172.21.15.71:0/3212397778 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8270051f40 con 0x7f8280159dd0 2023-10-09T07:00:37.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.578+0000 7f8286bff700 1 -- 172.21.15.71:0/3212397778 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82800ad930 con 0x7f8280159dd0 2023-10-09T07:00:37.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.578+0000 7f8274ff9700 1 -- 172.21.15.71:0/3212397778 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f8270055560 con 0x7f8280159dd0 2023-10-09T07:00:37.579 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:00:37.579 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7378,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1918195834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1918195834},{"type":"v1","addr":"172.21.15.179:6834","nonce":1918195834}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7644,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3880476818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3880476818},{"type":"v1","addr":"172.21.15.71:6833","nonce":3880476818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7656,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/4215423233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":4215423233},{"type":"v1","addr":"172.21.15.179:6836","nonce":4215423233}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:00:31.315026+0000","modified":"2023-10-09T07:00:34.863796+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/3141191512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3141191512},{"type":"v1","addr":"172.21.15.71:6835","nonce":3141191512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T07:00:37.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.580+0000 7f8286bff700 1 -- 172.21.15.71:0/3212397778 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f826c066f30 msgr2=0x7f826c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:37.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.580+0000 7f8286bff700 1 --2- 172.21.15.71:0/3212397778 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f826c066f30 0x7f826c0693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f827c008fd0 tx=0x7f827c015000 comp rx=0 tx=0).stop 2023-10-09T07:00:37.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.580+0000 7f8286bff700 1 -- 172.21.15.71:0/3212397778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8280159dd0 msgr2=0x7f8280158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:37.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.580+0000 7f8286bff700 1 --2- 172.21.15.71:0/3212397778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8280159dd0 0x7f8280158f80 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f8270011990 tx=0x7f8270008040 comp rx=0 tx=0).stop 2023-10-09T07:00:37.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.580+0000 7f8286bff700 1 -- 172.21.15.71:0/3212397778 shutdown_connections 2023-10-09T07:00:37.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.580+0000 7f8286bff700 1 --2- 172.21.15.71:0/3212397778 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f826c066f30 0x7f826c0693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:37.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.580+0000 7f8286bff700 1 --2- 172.21.15.71:0/3212397778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82801594c0 0x7f82800a77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:37.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.580+0000 7f8286bff700 1 --2- 172.21.15.71:0/3212397778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8268003a90 0x7f82801522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:37.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.580+0000 7f8286bff700 1 --2- 172.21.15.71:0/3212397778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8280159dd0 0x7f8280158f80 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:37.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.580+0000 7f8286bff700 1 -- 172.21.15.71:0/3212397778 >> 172.21.15.71:0/3212397778 conn(0x7f828006a320 msgr2=0x7f82800ca9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:37.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.581+0000 7f8286bff700 1 -- 172.21.15.71:0/3212397778 shutdown_connections 2023-10-09T07:00:37.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:37.581+0000 7f8286bff700 1 -- 172.21.15.71:0/3212397778 wait complete. 2023-10-09T07:00:37.583 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 58 2023-10-09T07:00:38.001 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T07:00:31.315026+0000', 'modified': '2023-10-09T07:00:34.863796+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7662}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7662': {'gid': 7662, 'name': 'a', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.71:6835/3141191512', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6834', 'nonce': 3141191512}, {'type': 'v1', 'addr': '172.21.15.71:6835', 'nonce': 3141191512}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T07:00:38.002 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T07:00:38.002 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-09T07:00:38.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.182+0000 7f017a7ff700 1 Processor -- start 2023-10-09T07:00:38.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.182+0000 7f017a7ff700 1 -- start start 2023-10-09T07:00:38.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.184+0000 7f017a7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0174155c10 0x7f0174155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.184+0000 7f017a7ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f01740ac230 0x7f01740ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.184+0000 7f017a7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01740ccc40 0x7f01740af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.184+0000 7f017a7ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01740ad930 con 0x7f01740ac230 2023-10-09T07:00:38.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.184+0000 7f017a7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01740acd20 con 0x7f0174155c10 2023-10-09T07:00:38.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.184+0000 7f017a7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01740ad000 con 0x7f01740ccc40 2023-10-09T07:00:38.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.184+0000 7f01737fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f01740ac230 0x7f01740ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.184+0000 7f01737fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f01740ac230 0x7f01740ac6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56118/0 (socket says 172.21.15.71:56118) 2023-10-09T07:00:38.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.184+0000 7f01737fe700 1 -- 172.21.15.71:0/2826364375 learned_addr learned my addr 172.21.15.71:0/2826364375 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:38.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.184+0000 7f0178d9c700 1 --2- 172.21.15.71:0/2826364375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01740ccc40 0x7f01740af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.184+0000 7f0173fff700 1 --2- 172.21.15.71:0/2826364375 >> v2:172.21.15.179:3300/0 conn(0x7f0174155c10 0x7f0174155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.184+0000 7f01737fe700 1 -- 172.21.15.71:0/2826364375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01740ccc40 msgr2=0x7f01740af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:38.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.184+0000 7f01737fe700 1 --2- 172.21.15.71:0/2826364375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01740ccc40 0x7f01740af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.184+0000 7f01737fe700 1 -- 172.21.15.71:0/2826364375 >> v2:172.21.15.179:3300/0 conn(0x7f0174155c10 msgr2=0x7f0174155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:38.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.184+0000 7f01737fe700 1 --2- 172.21.15.71:0/2826364375 >> v2:172.21.15.179:3300/0 conn(0x7f0174155c10 0x7f0174155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.184+0000 7f01737fe700 1 -- 172.21.15.71:0/2826364375 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01740ad2e0 con 0x7f01740ac230 2023-10-09T07:00:38.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.185+0000 7f01737fe700 1 --2- 172.21.15.71:0/2826364375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01740ac230 0x7f01740ac6d0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f0174063d40 tx=0x7f016800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea89fd06e8617bbd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:38.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.185+0000 7f0172ffd700 1 -- 172.21.15.71:0/2826364375 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016800dc50 con 0x7f01740ac230 2023-10-09T07:00:38.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.185+0000 7f0172ffd700 1 -- 172.21.15.71:0/2826364375 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016800ddb0 con 0x7f01740ac230 2023-10-09T07:00:38.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.185+0000 7f0172ffd700 1 -- 172.21.15.71:0/2826364375 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01680196d0 con 0x7f01740ac230 2023-10-09T07:00:38.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.185+0000 7f017a7ff700 1 -- 172.21.15.71:0/2826364375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01740ac230 msgr2=0x7f01740ac6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:38.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.185+0000 7f017a7ff700 1 --2- 172.21.15.71:0/2826364375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01740ac230 0x7f01740ac6d0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f0174063d40 tx=0x7f016800b4f0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.186+0000 7f017a7ff700 1 -- 172.21.15.71:0/2826364375 shutdown_connections 2023-10-09T07:00:38.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.186+0000 7f017a7ff700 1 --2- 172.21.15.71:0/2826364375 >> v2:172.21.15.179:3300/0 conn(0x7f0174155c10 0x7f0174155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.186+0000 7f017a7ff700 1 --2- 172.21.15.71:0/2826364375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01740ccc40 0x7f01740af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.186+0000 7f017a7ff700 1 --2- 172.21.15.71:0/2826364375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01740ac230 0x7f01740ac6d0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.186+0000 7f017a7ff700 1 -- 172.21.15.71:0/2826364375 >> 172.21.15.71:0/2826364375 conn(0x7f017406a320 msgr2=0x7f01740cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:38.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.186+0000 7f017a7ff700 1 -- 172.21.15.71:0/2826364375 shutdown_connections 2023-10-09T07:00:38.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.186+0000 7f017a7ff700 1 -- 172.21.15.71:0/2826364375 wait complete. 2023-10-09T07:00:38.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.187+0000 7f017a7ff700 1 Processor -- start 2023-10-09T07:00:38.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.187+0000 7f017a7ff700 1 -- start start 2023-10-09T07:00:38.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.188+0000 7f017a7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01740ac230 0x7f01740a8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.188+0000 7f017a7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01740ccc40 0x7f017413ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.188+0000 7f017a7ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0174155c10 0x7f01740cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.188+0000 7f017a7ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01740a8e90 con 0x7f0174155c10 2023-10-09T07:00:38.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.188+0000 7f017a7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01740a6200 con 0x7f01740ac230 2023-10-09T07:00:38.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.188+0000 7f017a7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01740a55f0 con 0x7f01740ccc40 2023-10-09T07:00:38.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.188+0000 7f0178d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0174155c10 0x7f01740cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.188+0000 7f0178d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0174155c10 0x7f01740cb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56124/0 (socket says 172.21.15.71:56124) 2023-10-09T07:00:38.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.188+0000 7f0178d9c700 1 -- 172.21.15.71:0/3286038583 learned_addr learned my addr 172.21.15.71:0/3286038583 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:38.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.188+0000 7f0173fff700 1 --2- 172.21.15.71:0/3286038583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01740ac230 0x7f01740a8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.188+0000 7f01737fe700 1 --2- 172.21.15.71:0/3286038583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01740ccc40 0x7f017413ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.189+0000 7f0178d9c700 1 -- 172.21.15.71:0/3286038583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01740ccc40 msgr2=0x7f017413ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:38.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.189+0000 7f0178d9c700 1 --2- 172.21.15.71:0/3286038583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01740ccc40 0x7f017413ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.189+0000 7f0178d9c700 1 -- 172.21.15.71:0/3286038583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01740ac230 msgr2=0x7f01740a8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:38.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.189+0000 7f0178d9c700 1 --2- 172.21.15.71:0/3286038583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01740ac230 0x7f01740a8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.189+0000 7f0178d9c700 1 -- 172.21.15.71:0/3286038583 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016800b790 con 0x7f0174155c10 2023-10-09T07:00:38.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.189+0000 7f0178d9c700 1 --2- 172.21.15.71:0/3286038583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0174155c10 0x7f01740cb730 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f016c009fa0 tx=0x7f016c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:38.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.189+0000 7f015bfff700 1 -- 172.21.15.71:0/3286038583 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c00ebc0 con 0x7f0174155c10 2023-10-09T07:00:38.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.189+0000 7f015bfff700 1 -- 172.21.15.71:0/3286038583 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016c00ed20 con 0x7f0174155c10 2023-10-09T07:00:38.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.189+0000 7f017a7ff700 1 -- 172.21.15.71:0/3286038583 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01740a58d0 con 0x7f0174155c10 2023-10-09T07:00:38.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.189+0000 7f015bfff700 1 -- 172.21.15.71:0/3286038583 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c014670 con 0x7f0174155c10 2023-10-09T07:00:38.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.189+0000 7f017a7ff700 1 -- 172.21.15.71:0/3286038583 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01740a5e90 con 0x7f0174155c10 2023-10-09T07:00:38.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.192+0000 7f015bfff700 1 -- 172.21.15.71:0/3286038583 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f016c014a20 con 0x7f0174155c10 2023-10-09T07:00:38.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.193+0000 7f015bfff700 1 --2- 172.21.15.71:0/3286038583 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0160066f30 0x7f01600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.193+0000 7f015bfff700 1 -- 172.21.15.71:0/3286038583 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f016c084c20 con 0x7f0174155c10 2023-10-09T07:00:38.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.193+0000 7f0173fff700 1 --2- 172.21.15.71:0/3286038583 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0160066f30 0x7f01600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.194+0000 7f0173fff700 1 --2- 172.21.15.71:0/3286038583 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0160066f30 0x7f01600693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f01740cc580 tx=0x7f0164008040 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:38.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.195+0000 7f0188fd1b80 1 Processor -- start 2023-10-09T07:00:38.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.195+0000 7f0188fd1b80 1 -- start start 2023-10-09T07:00:38.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.196+0000 7f0188fd1b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d3b8c01050 0x55d3b8c01420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.196+0000 7f0188fd1b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d3b8bd8f80 0x55d3b8bd7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.196+0000 7f0188fd1b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8bd7dc0 0x55d3b8bd81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.196+0000 7f0188fd1b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3b8b2ea70 con 0x55d3b8bd7dc0 2023-10-09T07:00:38.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.196+0000 7f0188fd1b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3b8b2c270 con 0x55d3b8c01050 2023-10-09T07:00:38.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.196+0000 7f0188fd1b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d3b8b28060 con 0x55d3b8bd8f80 2023-10-09T07:00:38.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.196+0000 7f0178d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8bd7dc0 0x55d3b8bd81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.196+0000 7f0178d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8bd7dc0 0x55d3b8bd81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56136/0 (socket says 172.21.15.71:56136) 2023-10-09T07:00:38.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.196+0000 7f0178d9c700 1 -- 172.21.15.71:0/1331121940 learned_addr learned my addr 172.21.15.71:0/1331121940 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:38.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.196+0000 7f0178d9c700 1 -- 172.21.15.71:0/1331121940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d3b8bd8f80 msgr2=0x55d3b8bd7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:38.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.196+0000 7f0178d9c700 1 --2- 172.21.15.71:0/1331121940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d3b8bd8f80 0x55d3b8bd7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.196+0000 7f0178d9c700 1 -- 172.21.15.71:0/1331121940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d3b8c01050 msgr2=0x55d3b8c01420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:38.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.196+0000 7f0178d9c700 1 --2- 172.21.15.71:0/1331121940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d3b8c01050 0x55d3b8c01420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.196+0000 7f0178d9c700 1 -- 172.21.15.71:0/1331121940 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3b89c2270 con 0x55d3b8bd7dc0 2023-10-09T07:00:38.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.196+0000 7f0178d9c700 1 --2- 172.21.15.71:0/1331121940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8bd7dc0 0x55d3b8bd81f0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f016c082fe0 tx=0x7f016c082f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca9009a842b0446 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:38.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.196+0000 7f01597fa700 1 -- 172.21.15.71:0/1331121940 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c055a40 con 0x55d3b8bd7dc0 2023-10-09T07:00:38.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.197+0000 7f01597fa700 1 -- 172.21.15.71:0/1331121940 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016c058c10 con 0x55d3b8bd7dc0 2023-10-09T07:00:38.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.197+0000 7f01597fa700 1 -- 172.21.15.71:0/1331121940 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c05c960 con 0x55d3b8bd7dc0 2023-10-09T07:00:38.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.197+0000 7f0188fd1b80 1 -- 172.21.15.71:0/1331121940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8bd7dc0 msgr2=0x55d3b8bd81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:38.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.197+0000 7f0188fd1b80 1 --2- 172.21.15.71:0/1331121940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8bd7dc0 0x55d3b8bd81f0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f016c082fe0 tx=0x7f016c082f10 comp rx=0 tx=0).stop 2023-10-09T07:00:38.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.197+0000 7f0188fd1b80 1 -- 172.21.15.71:0/1331121940 shutdown_connections 2023-10-09T07:00:38.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.197+0000 7f0188fd1b80 1 --2- 172.21.15.71:0/1331121940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8bd7dc0 0x55d3b8bd81f0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.197+0000 7f0188fd1b80 1 --2- 172.21.15.71:0/1331121940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d3b8c01050 0x55d3b8c01420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.197+0000 7f0188fd1b80 1 --2- 172.21.15.71:0/1331121940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d3b8bd8f80 0x55d3b8bd7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.197+0000 7f0188fd1b80 1 -- 172.21.15.71:0/1331121940 >> 172.21.15.71:0/1331121940 conn(0x55d3b8bd9370 msgr2=0x55d3b8bd9740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:38.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.197+0000 7f0188fd1b80 1 -- 172.21.15.71:0/1331121940 shutdown_connections 2023-10-09T07:00:38.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.197+0000 7f0188fd1b80 1 -- 172.21.15.71:0/1331121940 wait complete. 2023-10-09T07:00:38.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.198+0000 7f0188fd1b80 1 -- start start 2023-10-09T07:00:38.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.198+0000 7f0188fd1b80 1 Processor -- start 2023-10-09T07:00:38.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.199+0000 7f0188fd1b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8bd7dc0 0x55d3b8bfd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.199+0000 7f0188fd1b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d3b8bd8f80 0x55d3b8bfd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.199+0000 7f0188fd1b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d3b8c01050 0x55d3b8c359b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.199+0000 7f0188fd1b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3b8ad3890 con 0x55d3b8bd7dc0 2023-10-09T07:00:38.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.199+0000 7f0188fd1b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3b8aeeea0 con 0x55d3b8c01050 2023-10-09T07:00:38.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.199+0000 7f0188fd1b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d3b89aae30 con 0x55d3b8bd8f80 2023-10-09T07:00:38.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.199+0000 7f0188fd1b80 10 client.0 _ll_register_callbacks cb 0x55d3b8b9b110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T07:00:38.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.199+0000 7f0173fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8bd7dc0 0x55d3b8bfd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.199+0000 7f0173fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8bd7dc0 0x55d3b8bfd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56142/0 (socket says 172.21.15.71:56142) 2023-10-09T07:00:38.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.199+0000 7f0173fff700 1 -- 172.21.15.71:0/3524060851 learned_addr learned my addr 172.21.15.71:0/3524060851 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:38.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.200+0000 7f0178d9c700 1 --2- 172.21.15.71:0/3524060851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d3b8c01050 0x55d3b8c359b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.200+0000 7f01737fe700 1 --2- 172.21.15.71:0/3524060851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d3b8bd8f80 0x55d3b8bfd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.200+0000 7f0173fff700 1 -- 172.21.15.71:0/3524060851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d3b8bd8f80 msgr2=0x55d3b8bfd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:38.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.200+0000 7f0173fff700 1 --2- 172.21.15.71:0/3524060851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d3b8bd8f80 0x55d3b8bfd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.200+0000 7f0173fff700 1 -- 172.21.15.71:0/3524060851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d3b8c01050 msgr2=0x55d3b8c359b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.200+0000 7f0173fff700 1 --2- 172.21.15.71:0/3524060851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d3b8c01050 0x55d3b8c359b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.200+0000 7f0173fff700 1 -- 172.21.15.71:0/3524060851 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01740a5e90 con 0x55d3b8bd7dc0 2023-10-09T07:00:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.200+0000 7f0173fff700 1 --2- 172.21.15.71:0/3524060851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8bd7dc0 0x55d3b8bfd2d0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f016400b4c0 tx=0x7f0164017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b9feddb731b8a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.200+0000 7f01527fc700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T07:00:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.200+0000 7f01527fc700 1 -- 172.21.15.71:0/3524060851 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0164016e60 con 0x55d3b8bd7dc0 2023-10-09T07:00:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.200+0000 7f01527fc700 1 -- 172.21.15.71:0/3524060851 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f016400be10 con 0x55d3b8bd7dc0 2023-10-09T07:00:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.200+0000 7f0188fd1b80 1 -- 172.21.15.71:0/3524060851 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d3b8bccb70 con 0x55d3b8bd7dc0 2023-10-09T07:00:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.201+0000 7f01527fc700 1 -- 172.21.15.71:0/3524060851 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0164014c60 con 0x55d3b8bd7dc0 2023-10-09T07:00:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.201+0000 7f0188fd1b80 10 client.7788 fetch_fsmap learned FSMap version 58 2023-10-09T07:00:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.201+0000 7f0188fd1b80 1 -- 172.21.15.71:0/3524060851 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55d3b8964fe0 con 0x55d3b8bd7dc0 2023-10-09T07:00:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.201+0000 7f01527fc700 1 -- 172.21.15.71:0/3524060851 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d3b8bccb70 con 0x55d3b8bd7dc0 2023-10-09T07:00:38.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.201+0000 7f01527fc700 1 -- 172.21.15.71:0/3524060851 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 58) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0164005a00 con 0x55d3b8bd7dc0 2023-10-09T07:00:38.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.201+0000 7f0188fd1b80 10 client.7788 fetch_fsmap finished waiting for FSMap version 58 2023-10-09T07:00:38.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.201+0000 7f0188fd1b80 10 client.7788 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T07:00:38.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.201+0000 7f0188fd1b80 20 client.7788 populate_metadata read hostname 'smithi071' 2023-10-09T07:00:38.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.201+0000 7f0188fd1b80 1 --2- 172.21.15.71:0/3524060851 >> [v2:172.21.15.71:6834/3141191512,v1:172.21.15.71:6835/3141191512] conn(0x55d3b8c363e0 0x55d3b8bfef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.201+0000 7f0188fd1b80 4 client.7788 mds_command: new command op to 7662 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T07:00:38.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.201+0000 7f0188fd1b80 1 -- 172.21.15.71:0/3524060851 --> [v2:172.21.15.71:6834/3141191512,v1:172.21.15.71:6835/3141191512] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d3b8ba9aa0 con 0x55d3b8c363e0 2023-10-09T07:00:38.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.201+0000 7f01737fe700 1 --2- 172.21.15.71:0/3524060851 >> [v2:172.21.15.71:6834/3141191512,v1:172.21.15.71:6835/3141191512] conn(0x55d3b8c363e0 0x55d3b8bfef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.202+0000 7f01737fe700 1 --2- 172.21.15.71:0/3524060851 >> [v2:172.21.15.71:6834/3141191512,v1:172.21.15.71:6835/3141191512] conn(0x55d3b8c363e0 0x55d3b8bfef60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6113bb1aa87450fb server_cookie=c477168dbafa476a in_seq=0 out_seq=0 2023-10-09T07:00:38.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.202+0000 7f01527fc700 10 client.7788 ms_handle_connect on v2:172.21.15.71:6834/3141191512 2023-10-09T07:00:38.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.202+0000 7f01527fc700 1 -- 172.21.15.71:0/3524060851 <== mds.0 v2:172.21.15.71:6834/3141191512 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55d3b8ba9aa0 con 0x55d3b8c363e0 2023-10-09T07:00:38.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.202+0000 7f01527fc700 10 client.7788 handle_command_reply: tid=0 2023-10-09T07:00:38.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.202+0000 7f0188fd1b80 1 client.7788 shutdown 2023-10-09T07:00:38.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.203+0000 7f0188fd1b80 1 -- 172.21.15.71:0/3524060851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8bd7dc0 msgr2=0x55d3b8bfd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:38.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.203+0000 7f0188fd1b80 1 --2- 172.21.15.71:0/3524060851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8bd7dc0 0x55d3b8bfd2d0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f016400b4c0 tx=0x7f0164017000 comp rx=0 tx=0).stop 2023-10-09T07:00:38.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.203+0000 7f0188fd1b80 1 -- 172.21.15.71:0/3524060851 shutdown_connections 2023-10-09T07:00:38.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.203+0000 7f0188fd1b80 1 --2- 172.21.15.71:0/3524060851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d3b8c01050 0x55d3b8c359b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.203+0000 7f0188fd1b80 1 --2- 172.21.15.71:0/3524060851 >> [v2:172.21.15.71:6834/3141191512,v1:172.21.15.71:6835/3141191512] conn(0x55d3b8c363e0 0x55d3b8bfef60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.203+0000 7f0188fd1b80 1 --2- 172.21.15.71:0/3524060851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8bd7dc0 0x55d3b8bfd2d0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.203+0000 7f0188fd1b80 1 --2- 172.21.15.71:0/3524060851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d3b8bd8f80 0x55d3b8bfd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.203+0000 7f01527fc700 0 client.7788 ms_handle_reset on v2:172.21.15.71:6834/3141191512 2023-10-09T07:00:38.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.203+0000 7f0188fd1b80 1 -- 172.21.15.71:0/3524060851 >> 172.21.15.71:0/3524060851 conn(0x55d3b8bd9370 msgr2=0x55d3b8bfe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:38.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.203+0000 7f0188fd1b80 1 -- 172.21.15.71:0/3524060851 shutdown_connections 2023-10-09T07:00:38.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.203+0000 7f0188fd1b80 1 -- 172.21.15.71:0/3524060851 wait complete. 2023-10-09T07:00:38.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.203+0000 7f0188fd1b80 20 client.7788 trim_cache size 0 max 16384 2023-10-09T07:00:38.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.220+0000 7f0188fd1b80 1 Processor -- start 2023-10-09T07:00:38.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.220+0000 7f0188fd1b80 1 -- start start 2023-10-09T07:00:38.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.221+0000 7f0188fd1b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d3b8bd7dc0 0x55d3b8c31ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.221+0000 7f0188fd1b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8bd8f80 0x55d3b8bda150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.221+0000 7f0188fd1b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d3b8c01050 0x55d3b8c164e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.221+0000 7f0188fd1b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3b8c2b620 con 0x55d3b8bd8f80 2023-10-09T07:00:38.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.221+0000 7f0188fd1b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3b8bd2c20 con 0x55d3b8bd7dc0 2023-10-09T07:00:38.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.221+0000 7f0188fd1b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d3b8bb7510 con 0x55d3b8c01050 2023-10-09T07:00:38.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.221+0000 7f01737fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8bd8f80 0x55d3b8bda150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.221+0000 7f01737fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8bd8f80 0x55d3b8bda150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56154/0 (socket says 172.21.15.71:56154) 2023-10-09T07:00:38.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.221+0000 7f01737fe700 1 -- 172.21.15.71:0/3720164723 learned_addr learned my addr 172.21.15.71:0/3720164723 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:38.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.221+0000 7f0173fff700 1 --2- 172.21.15.71:0/3720164723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d3b8bd7dc0 0x55d3b8c31ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.221+0000 7f0178d9c700 1 --2- 172.21.15.71:0/3720164723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d3b8c01050 0x55d3b8c164e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.222+0000 7f01737fe700 1 -- 172.21.15.71:0/3720164723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d3b8c01050 msgr2=0x55d3b8c164e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:38.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.222+0000 7f01737fe700 1 --2- 172.21.15.71:0/3720164723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d3b8c01050 0x55d3b8c164e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.222+0000 7f01737fe700 1 -- 172.21.15.71:0/3720164723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d3b8bd7dc0 msgr2=0x55d3b8c31ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:38.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.222+0000 7f01737fe700 1 --2- 172.21.15.71:0/3720164723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d3b8bd7dc0 0x55d3b8c31ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.222+0000 7f01737fe700 1 -- 172.21.15.71:0/3720164723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3b8bd56d0 con 0x55d3b8bd8f80 2023-10-09T07:00:38.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.222+0000 7f01737fe700 1 --2- 172.21.15.71:0/3720164723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8bd8f80 0x55d3b8bda150 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f0174064290 tx=0x7f016801b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b0646c4662a2f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:38.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.222+0000 7f0159ffb700 1 -- 172.21.15.71:0/3720164723 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0168000c70 con 0x55d3b8bd8f80 2023-10-09T07:00:38.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.222+0000 7f0159ffb700 1 -- 172.21.15.71:0/3720164723 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0168019480 con 0x55d3b8bd8f80 2023-10-09T07:00:38.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.222+0000 7f0159ffb700 1 -- 172.21.15.71:0/3720164723 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0168019630 con 0x55d3b8bd8f80 2023-10-09T07:00:38.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.222+0000 7f0188fd1b80 1 -- 172.21.15.71:0/3720164723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8bd8f80 msgr2=0x55d3b8bda150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:38.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.222+0000 7f0188fd1b80 1 --2- 172.21.15.71:0/3720164723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8bd8f80 0x55d3b8bda150 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f0174064290 tx=0x7f016801b040 comp rx=0 tx=0).stop 2023-10-09T07:00:38.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.223+0000 7f0188fd1b80 1 -- 172.21.15.71:0/3720164723 shutdown_connections 2023-10-09T07:00:38.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.223+0000 7f0188fd1b80 1 --2- 172.21.15.71:0/3720164723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d3b8c01050 0x55d3b8c164e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.223+0000 7f0188fd1b80 1 --2- 172.21.15.71:0/3720164723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d3b8bd7dc0 0x55d3b8c31ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.223+0000 7f0188fd1b80 1 --2- 172.21.15.71:0/3720164723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8bd8f80 0x55d3b8bda150 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.223+0000 7f0188fd1b80 1 -- 172.21.15.71:0/3720164723 >> 172.21.15.71:0/3720164723 conn(0x55d3b8bd9370 msgr2=0x55d3b8bf5460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:38.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.223+0000 7f0188fd1b80 1 -- 172.21.15.71:0/3720164723 shutdown_connections 2023-10-09T07:00:38.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.223+0000 7f0188fd1b80 1 -- 172.21.15.71:0/3720164723 wait complete. 2023-10-09T07:00:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.223+0000 7f0188fd1b80 1 -- start start 2023-10-09T07:00:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.223+0000 7f0188fd1b80 1 Processor -- start 2023-10-09T07:00:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.224+0000 7f0188fd1b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d3b8bd7dc0 0x55d3b8c87a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.224+0000 7f0188fd1b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d3b8bd8f80 0x55d3b8c8b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.224+0000 7f0188fd1b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8c01050 0x55d3b8c8bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.224+0000 7f0188fd1b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3b8bd3990 con 0x55d3b8c01050 2023-10-09T07:00:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.224+0000 7f0188fd1b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3b8c8c540 con 0x55d3b8bd8f80 2023-10-09T07:00:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.224+0000 7f0188fd1b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d3b8bfcc80 con 0x55d3b8bd7dc0 2023-10-09T07:00:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.224+0000 7f0188fd1b80 10 client.0 _ll_register_callbacks cb 0x55d3b8b9b110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T07:00:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.225+0000 7f0178d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8c01050 0x55d3b8c8bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.225+0000 7f0178d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8c01050 0x55d3b8c8bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56158/0 (socket says 172.21.15.71:56158) 2023-10-09T07:00:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.225+0000 7f0178d9c700 1 -- 172.21.15.71:0/1352487125 learned_addr learned my addr 172.21.15.71:0/1352487125 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.225+0000 7f0178d9c700 1 -- 172.21.15.71:0/1352487125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d3b8bd7dc0 msgr2=0x55d3b8c87a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.225+0000 7f0178d9c700 1 --2- 172.21.15.71:0/1352487125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d3b8bd7dc0 0x55d3b8c87a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.225+0000 7f0178d9c700 1 -- 172.21.15.71:0/1352487125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d3b8bd8f80 msgr2=0x55d3b8c8b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.225+0000 7f0178d9c700 1 --2- 172.21.15.71:0/1352487125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d3b8bd8f80 0x55d3b8c8b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.225+0000 7f0178d9c700 1 -- 172.21.15.71:0/1352487125 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01740ad2e0 con 0x55d3b8c01050 2023-10-09T07:00:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.225+0000 7f0178d9c700 1 --2- 172.21.15.71:0/1352487125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8c01050 0x55d3b8c8bc80 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f016c009fd0 tx=0x7f016c06b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3116f937f22c67d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.225+0000 7f01527fc700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T07:00:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.225+0000 7f01527fc700 1 -- 172.21.15.71:0/1352487125 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c053d60 con 0x55d3b8c01050 2023-10-09T07:00:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.225+0000 7f01527fc700 1 -- 172.21.15.71:0/1352487125 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f016c012dc0 con 0x55d3b8c01050 2023-10-09T07:00:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.225+0000 7f0188fd1b80 1 -- 172.21.15.71:0/1352487125 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0174152350 con 0x55d3b8c01050 2023-10-09T07:00:38.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.225+0000 7f01527fc700 1 -- 172.21.15.71:0/1352487125 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f016c0550c0 con 0x55d3b8c01050 2023-10-09T07:00:38.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.225+0000 7f0188fd1b80 10 client.7794 fetch_fsmap learned FSMap version 58 2023-10-09T07:00:38.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.225+0000 7f0188fd1b80 1 -- 172.21.15.71:0/1352487125 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55d3b8af6780 con 0x55d3b8c01050 2023-10-09T07:00:38.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.226+0000 7f01527fc700 1 -- 172.21.15.71:0/1352487125 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0174152350 con 0x55d3b8c01050 2023-10-09T07:00:38.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.226+0000 7f01527fc700 1 -- 172.21.15.71:0/1352487125 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 58) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f016c06a030 con 0x55d3b8c01050 2023-10-09T07:00:38.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.226+0000 7f0188fd1b80 10 client.7794 fetch_fsmap finished waiting for FSMap version 58 2023-10-09T07:00:38.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.226+0000 7f0188fd1b80 10 client.7794 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T07:00:38.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.226+0000 7f0188fd1b80 20 client.7794 populate_metadata read hostname 'smithi071' 2023-10-09T07:00:38.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.226+0000 7f0188fd1b80 1 --2- 172.21.15.71:0/1352487125 >> [v2:172.21.15.71:6834/3141191512,v1:172.21.15.71:6835/3141191512] conn(0x55d3b8bfc0b0 0x55d3b8bfc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.226+0000 7f0188fd1b80 4 client.7794 mds_command: new command op to 7662 tid=0[{"prefix": "status"}] 2023-10-09T07:00:38.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.226+0000 7f0188fd1b80 1 -- 172.21.15.71:0/1352487125 --> [v2:172.21.15.71:6834/3141191512,v1:172.21.15.71:6835/3141191512] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f016c058c10 con 0x55d3b8bfc0b0 2023-10-09T07:00:38.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.226+0000 7f0173fff700 1 --2- 172.21.15.71:0/1352487125 >> [v2:172.21.15.71:6834/3141191512,v1:172.21.15.71:6835/3141191512] conn(0x55d3b8bfc0b0 0x55d3b8bfc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.226+0000 7f01527fc700 10 client.7794 ms_handle_connect on v2:172.21.15.71:6834/3141191512 2023-10-09T07:00:38.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.226+0000 7f0173fff700 1 --2- 172.21.15.71:0/1352487125 >> [v2:172.21.15.71:6834/3141191512,v1:172.21.15.71:6835/3141191512] conn(0x55d3b8bfc0b0 0x55d3b8bfc480 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65100ff46ed06a16 server_cookie=73494ca9556ca3ff in_seq=0 out_seq=0 2023-10-09T07:00:38.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.227+0000 7f01527fc700 1 -- 172.21.15.71:0/1352487125 <== mds.0 v2:172.21.15.71:6834/3141191512 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x7f016c058c10 con 0x55d3b8bfc0b0 2023-10-09T07:00:38.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.227+0000 7f01527fc700 10 client.7794 handle_command_reply: tid=0 2023-10-09T07:00:38.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.227+0000 7f0188fd1b80 1 client.7794 shutdown 2023-10-09T07:00:38.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.227+0000 7f0188fd1b80 1 -- 172.21.15.71:0/1352487125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8c01050 msgr2=0x55d3b8c8bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:38.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.227+0000 7f0188fd1b80 1 --2- 172.21.15.71:0/1352487125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8c01050 0x55d3b8c8bc80 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f016c009fd0 tx=0x7f016c06b000 comp rx=0 tx=0).stop 2023-10-09T07:00:38.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.227+0000 7f0188fd1b80 1 -- 172.21.15.71:0/1352487125 shutdown_connections 2023-10-09T07:00:38.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.227+0000 7f0188fd1b80 1 --2- 172.21.15.71:0/1352487125 >> [v2:172.21.15.71:6834/3141191512,v1:172.21.15.71:6835/3141191512] conn(0x55d3b8bfc0b0 0x55d3b8bfc480 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.227+0000 7f0188fd1b80 1 --2- 172.21.15.71:0/1352487125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3b8c01050 0x55d3b8c8bc80 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.227+0000 7f0188fd1b80 1 --2- 172.21.15.71:0/1352487125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d3b8bd7dc0 0x55d3b8c87a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.227+0000 7f01527fc700 0 client.7794 ms_handle_reset on v2:172.21.15.71:6834/3141191512 2023-10-09T07:00:38.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.227+0000 7f0188fd1b80 1 --2- 172.21.15.71:0/1352487125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d3b8bd8f80 0x55d3b8c8b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.227+0000 7f0188fd1b80 1 -- 172.21.15.71:0/1352487125 >> 172.21.15.71:0/1352487125 conn(0x55d3b8bd9370 msgr2=0x55d3b8bd9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:38.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.227+0000 7f0188fd1b80 1 -- 172.21.15.71:0/1352487125 shutdown_connections 2023-10-09T07:00:38.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.227+0000 7f0188fd1b80 1 -- 172.21.15.71:0/1352487125 wait complete. 2023-10-09T07:00:38.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.227+0000 7f0188fd1b80 20 client.7794 trim_cache size 0 max 16384 2023-10-09T07:00:38.234 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T07:00:38.235 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "604c5619-653a-4ab6-912c-ab2e5464fe4a", 2023-10-09T07:00:38.235 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2023-10-09T07:00:38.235 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 7662, 2023-10-09T07:00:38.235 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2023-10-09T07:00:38.235 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2023-10-09T07:00:38.235 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2023-10-09T07:00:38.235 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 6.3749337339999999, 2023-10-09T07:00:38.235 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 58, 2023-10-09T07:00:38.235 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 123, 2023-10-09T07:00:38.235 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 123, 2023-10-09T07:00:38.236 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 13.079436644999999 2023-10-09T07:00:38.236 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T07:00:38.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.228+0000 7f017a7ff700 1 -- 172.21.15.71:0/3286038583 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0160066f30 msgr2=0x7f01600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:38.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.228+0000 7f017a7ff700 1 --2- 172.21.15.71:0/3286038583 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0160066f30 0x7f01600693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f01740cc580 tx=0x7f0164008040 comp rx=0 tx=0).stop 2023-10-09T07:00:38.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.228+0000 7f017a7ff700 1 -- 172.21.15.71:0/3286038583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0174155c10 msgr2=0x7f01740cb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:38.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.228+0000 7f017a7ff700 1 --2- 172.21.15.71:0/3286038583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0174155c10 0x7f01740cb730 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f016c009fa0 tx=0x7f016c009900 comp rx=0 tx=0).stop 2023-10-09T07:00:38.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.228+0000 7f017a7ff700 1 -- 172.21.15.71:0/3286038583 shutdown_connections 2023-10-09T07:00:38.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.228+0000 7f017a7ff700 1 --2- 172.21.15.71:0/3286038583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0174155c10 0x7f01740cb730 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.228+0000 7f017a7ff700 1 --2- 172.21.15.71:0/3286038583 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0160066f30 0x7f01600693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.228+0000 7f017a7ff700 1 --2- 172.21.15.71:0/3286038583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01740ac230 0x7f01740a8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.228+0000 7f017a7ff700 1 --2- 172.21.15.71:0/3286038583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01740ccc40 0x7f017413ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.228+0000 7f017a7ff700 1 -- 172.21.15.71:0/3286038583 >> 172.21.15.71:0/3286038583 conn(0x7f017406a320 msgr2=0x7f017406f170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:38.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.228+0000 7f017a7ff700 1 -- 172.21.15.71:0/3286038583 shutdown_connections 2023-10-09T07:00:38.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.228+0000 7f017a7ff700 1 -- 172.21.15.71:0/3286038583 wait complete. 2023-10-09T07:00:38.245 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T07:00:38.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.424+0000 7f77d159d700 1 Processor -- start 2023-10-09T07:00:38.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.424+0000 7f77d159d700 1 -- start start 2023-10-09T07:00:38.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.425+0000 7f77d159d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77cc15d230 0x7f77cc15d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.425+0000 7f77d159d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77cc0b2980 con 0x7f77cc1597f0 2023-10-09T07:00:38.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.425+0000 7f77d159d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77cc15dbb0 con 0x7f77cc159420 2023-10-09T07:00:38.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.425+0000 7f77d159d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc0b11d0 con 0x7f77cc15d230 2023-10-09T07:00:38.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.425+0000 7f77cb7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f77cc1597f0 0x7f77cc0b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34022/0 (socket says 172.21.15.71:34022) 2023-10-09T07:00:38.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.425+0000 7f77cb7fe700 1 -- 172.21.15.71:0/2801977990 learned_addr learned my addr 172.21.15.71:0/2801977990 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:38.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.426+0000 7f77d0d9c700 1 --2- 172.21.15.71:0/2801977990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77cc15d230 0x7f77cc15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.426+0000 7f77caffd700 1 -- 172.21.15.71:0/2801977990 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3548755447 0 0) 0x7f77cc0b2980 con 0x7f77cc1597f0 2023-10-09T07:00:38.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.426+0000 7f77caffd700 1 -- 172.21.15.71:0/2801977990 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77b4003570 con 0x7f77cc1597f0 2023-10-09T07:00:38.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.426+0000 7f77caffd700 1 -- 172.21.15.71:0/2801977990 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1835177373 0 0) 0x7f77b4003570 con 0x7f77cc1597f0 2023-10-09T07:00:38.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.426+0000 7f77caffd700 1 -- 172.21.15.71:0/2801977990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77cc15d230 msgr2=0x7f77cc15d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:38.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.426+0000 7f77caffd700 1 --2- 172.21.15.71:0/2801977990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77cc15d230 0x7f77cc15d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.426+0000 7f77caffd700 1 -- 172.21.15.71:0/2801977990 >> v1:172.21.15.179:6789/0 conn(0x7f77cc159420 legacy=0x7f77cc0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:38.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.426+0000 7f77caffd700 1 -- 172.21.15.71:0/2801977990 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77cc0b14b0 con 0x7f77cc1597f0 2023-10-09T07:00:38.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.426+0000 7f77caffd700 1 -- 172.21.15.71:0/2801977990 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f77c0001470 con 0x7f77cc1597f0 2023-10-09T07:00:38.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.426+0000 7f77d0d9c700 1 --2- 172.21.15.71:0/2801977990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77cc15d230 0x7f77cc15d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:00:38.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.426+0000 7f77caffd700 1 -- 172.21.15.71:0/2801977990 >> v1:172.21.15.71:6789/0 conn(0x7f77cc1597f0 legacy=0x7f77cc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:38.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.426+0000 7f77caffd700 1 --2- 172.21.15.71:0/2801977990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77b4003a90 0x7f77b4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.426+0000 7f77caffd700 1 --2- 172.21.15.71:0/2801977990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77b4004810 0x7f77b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.426+0000 7f77caffd700 1 --2- 172.21.15.71:0/2801977990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77cc15d230 0x7f77b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.426+0000 7f77caffd700 1 -- 172.21.15.71:0/2801977990 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc0b11d0 con 0x7f77b4003a90 2023-10-09T07:00:38.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.426+0000 7f77caffd700 1 -- 172.21.15.71:0/2801977990 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b400bb10 con 0x7f77b4004810 2023-10-09T07:00:38.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.426+0000 7f77caffd700 1 -- 172.21.15.71:0/2801977990 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b400bc80 con 0x7f77cc15d230 2023-10-09T07:00:38.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.427+0000 7f77cbfff700 1 --2- 172.21.15.71:0/2801977990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77b4003a90 0x7f77b4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.427+0000 7f77d0d9c700 1 --2- 172.21.15.71:0/2801977990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77cc15d230 0x7f77b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.427+0000 7f77cb7fe700 1 --2- 172.21.15.71:0/2801977990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77b4004810 0x7f77b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.427+0000 7f77cbfff700 1 -- 172.21.15.71:0/2801977990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77cc15d230 msgr2=0x7f77b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:38.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.427+0000 7f77cbfff700 1 --2- 172.21.15.71:0/2801977990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77cc15d230 0x7f77b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.427+0000 7f77cbfff700 1 -- 172.21.15.71:0/2801977990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77b4004810 msgr2=0x7f77b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.427+0000 7f77cbfff700 1 --2- 172.21.15.71:0/2801977990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77b4004810 0x7f77b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.427+0000 7f77cbfff700 1 -- 172.21.15.71:0/2801977990 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c4009a20 con 0x7f77b4003a90 2023-10-09T07:00:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.427+0000 7f77cb7fe700 1 --2- 172.21.15.71:0/2801977990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77b4004810 0x7f77b4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:00:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.427+0000 7f77cbfff700 1 --2- 172.21.15.71:0/2801977990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77b4003a90 0x7f77b4003e60 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f77bc001960 tx=0x7f77bc007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a620a263388a5136 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.427+0000 7f77caffd700 1 -- 172.21.15.71:0/2801977990 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc00c570 con 0x7f77b4003a90 2023-10-09T07:00:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.427+0000 7f77caffd700 1 -- 172.21.15.71:0/2801977990 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77bc00c6d0 con 0x7f77b4003a90 2023-10-09T07:00:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.427+0000 7f77caffd700 1 -- 172.21.15.71:0/2801977990 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc00ca70 con 0x7f77b4003a90 2023-10-09T07:00:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.428+0000 7f77d159d700 1 -- 172.21.15.71:0/2801977990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77b4003a90 msgr2=0x7f77b4003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.428+0000 7f77d159d700 1 --2- 172.21.15.71:0/2801977990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77b4003a90 0x7f77b4003e60 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f77bc001960 tx=0x7f77bc007d10 comp rx=0 tx=0).stop 2023-10-09T07:00:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.428+0000 7f77d0d9c700 1 -- 172.21.15.71:0/2801977990 reap_dead start 2023-10-09T07:00:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.428+0000 7f77d159d700 1 -- 172.21.15.71:0/2801977990 shutdown_connections 2023-10-09T07:00:38.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.428+0000 7f77d159d700 1 -- 172.21.15.71:0/2801977990 >> 172.21.15.71:0/2801977990 conn(0x7f77cc0d0660 msgr2=0x7f77cc0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:38.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.428+0000 7f77d159d700 1 -- 172.21.15.71:0/2801977990 shutdown_connections 2023-10-09T07:00:38.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.428+0000 7f77d159d700 1 -- 172.21.15.71:0/2801977990 wait complete. 2023-10-09T07:00:38.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.430+0000 7f77d159d700 1 Processor -- start 2023-10-09T07:00:38.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.430+0000 7f77d159d700 1 -- start start 2023-10-09T07:00:38.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.431+0000 7f77d159d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77b4003a90 0x7f77cc157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.431+0000 7f77d159d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77cc0c7aa0 0x7f77cc15c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.431+0000 7f77d159d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77cc0c92b0 0x7f77cc0c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.431+0000 7f77d159d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc159d40 con 0x7f77cc0c92b0 2023-10-09T07:00:38.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.431+0000 7f77d159d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc159fe0 con 0x7f77b4003a90 2023-10-09T07:00:38.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.431+0000 7f77d159d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc15a2c0 con 0x7f77cc0c7aa0 2023-10-09T07:00:38.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.431+0000 7f77d0d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77cc0c92b0 0x7f77cc0c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.431+0000 7f77d0d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77cc0c92b0 0x7f77cc0c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56178/0 (socket says 172.21.15.71:56178) 2023-10-09T07:00:38.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.431+0000 7f77d0d9c700 1 -- 172.21.15.71:0/3638546713 learned_addr learned my addr 172.21.15.71:0/3638546713 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:38.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.431+0000 7f77cb7fe700 1 --2- 172.21.15.71:0/3638546713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77cc0c7aa0 0x7f77cc15c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.431+0000 7f77cbfff700 1 --2- 172.21.15.71:0/3638546713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77b4003a90 0x7f77cc157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.431+0000 7f77d0d9c700 1 -- 172.21.15.71:0/3638546713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77cc0c7aa0 msgr2=0x7f77cc15c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:38.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.431+0000 7f77d0d9c700 1 --2- 172.21.15.71:0/3638546713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77cc0c7aa0 0x7f77cc15c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.431+0000 7f77d0d9c700 1 -- 172.21.15.71:0/3638546713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77b4003a90 msgr2=0x7f77cc157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:38.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.431+0000 7f77d0d9c700 1 --2- 172.21.15.71:0/3638546713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77b4003a90 0x7f77cc157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.431+0000 7f77d0d9c700 1 -- 172.21.15.71:0/3638546713 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77cc15a5a0 con 0x7f77cc0c92b0 2023-10-09T07:00:38.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.432+0000 7f77d0d9c700 1 --2- 172.21.15.71:0/3638546713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77cc0c92b0 0x7f77cc0c5400 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f77cc15e340 tx=0x7f77c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:38.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.432+0000 7f77b3fff700 1 -- 172.21.15.71:0/3638546713 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c400e040 con 0x7f77cc0c92b0 2023-10-09T07:00:38.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.432+0000 7f77b3fff700 1 -- 172.21.15.71:0/3638546713 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c400f040 con 0x7f77cc0c92b0 2023-10-09T07:00:38.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.432+0000 7f77d159d700 1 -- 172.21.15.71:0/3638546713 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77cc15cf10 con 0x7f77cc0c92b0 2023-10-09T07:00:38.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.432+0000 7f77b3fff700 1 -- 172.21.15.71:0/3638546713 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c4015430 con 0x7f77cc0c92b0 2023-10-09T07:00:38.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.432+0000 7f77d159d700 1 -- 172.21.15.71:0/3638546713 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77cc15cbc0 con 0x7f77cc0c92b0 2023-10-09T07:00:38.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.433+0000 7f77d159d700 1 -- 172.21.15.71:0/3638546713 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77cc04c3c0 con 0x7f77cc0c92b0 2023-10-09T07:00:38.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.434+0000 7f77b3fff700 1 -- 172.21.15.71:0/3638546713 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77c4015820 con 0x7f77cc0c92b0 2023-10-09T07:00:38.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.435+0000 7f77b3fff700 1 --2- 172.21.15.71:0/3638546713 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f77b8066f30 0x7f77b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:38.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.435+0000 7f77b3fff700 1 -- 172.21.15.71:0/3638546713 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f77c40850b0 con 0x7f77cc0c92b0 2023-10-09T07:00:38.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.435+0000 7f77cbfff700 1 --2- 172.21.15.71:0/3638546713 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f77b8066f30 0x7f77b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:38.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.436+0000 7f77cbfff700 1 --2- 172.21.15.71:0/3638546713 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f77b8066f30 0x7f77b80693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f77bc000fd0 tx=0x7f77bc015000 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:38.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.439+0000 7f77b3fff700 1 -- 172.21.15.71:0/3638546713 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77c4055c20 con 0x7f77cc0c92b0 2023-10-09T07:00:38.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.670+0000 7f77d159d700 1 -- 172.21.15.71:0/3638546713 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f77cc0b1790 con 0x7f77cc0c92b0 2023-10-09T07:00:38.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.670+0000 7f77b3fff700 1 -- 172.21.15.71:0/3638546713 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v58) v1 ==== 53+0+73 (secure 0 0 0) 0x7f77c40557b0 con 0x7f77cc0c92b0 2023-10-09T07:00:38.671 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T07:00:38.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.672+0000 7f77d159d700 1 -- 172.21.15.71:0/3638546713 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f77b8066f30 msgr2=0x7f77b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:38.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.672+0000 7f77d159d700 1 --2- 172.21.15.71:0/3638546713 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f77b8066f30 0x7f77b80693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f77bc000fd0 tx=0x7f77bc015000 comp rx=0 tx=0).stop 2023-10-09T07:00:38.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.672+0000 7f77d159d700 1 -- 172.21.15.71:0/3638546713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77cc0c92b0 msgr2=0x7f77cc0c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:38.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.673+0000 7f77d159d700 1 --2- 172.21.15.71:0/3638546713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77cc0c92b0 0x7f77cc0c5400 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f77cc15e340 tx=0x7f77c400b040 comp rx=0 tx=0).stop 2023-10-09T07:00:38.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.673+0000 7f77d159d700 1 -- 172.21.15.71:0/3638546713 shutdown_connections 2023-10-09T07:00:38.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.673+0000 7f77d159d700 1 --2- 172.21.15.71:0/3638546713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77cc0c92b0 0x7f77cc0c5400 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.673+0000 7f77d159d700 1 --2- 172.21.15.71:0/3638546713 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f77b8066f30 0x7f77b80693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.673+0000 7f77d159d700 1 --2- 172.21.15.71:0/3638546713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77b4003a90 0x7f77cc157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.673+0000 7f77d159d700 1 --2- 172.21.15.71:0/3638546713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77cc0c7aa0 0x7f77cc15c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:38.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.673+0000 7f77d159d700 1 -- 172.21.15.71:0/3638546713 >> 172.21.15.71:0/3638546713 conn(0x7f77cc0d0660 msgr2=0x7f77cc0ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:38.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.673+0000 7f77d159d700 1 -- 172.21.15.71:0/3638546713 shutdown_connections 2023-10-09T07:00:38.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:38.673+0000 7f77d159d700 1 -- 172.21.15.71:0/3638546713 wait complete. 2023-10-09T07:00:38.691 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T07:00:38.691 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T07:00:38.691 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2023-10-09T07:00:38.691 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T07:00:38.691 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T07:00:38.691 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T07:00:38.691 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T07:00:38.691 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T07:00:38.691 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T07:00:38.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:00:38.692 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2023-10-09T07:00:38.727 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T07:00:38.727 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T07:00:38.727 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T07:00:38.728 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:00:38.728 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-10-09T07:00:38.728 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:00:38.728 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T07:00:38.728 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2023-10-09T07:00:38.728 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2023-10-09T07:00:38.728 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T07:00:38.728 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2023-10-09T07:00:38.728 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2023-10-09T07:00:38.728 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T07:00:38.728 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2023-10-09T07:00:38.729 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T07:00:38.729 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2023-10-09T07:00:38.729 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T07:00:38.729 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 41197sec preferred_lft 41197sec 2023-10-09T07:00:38.729 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2023-10-09T07:00:38.729 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:00:38.729 INFO:teuthology.orchestra.run.smithi071.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T07:00:38.729 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5a:a1:ec:c7:41:8f brd ff:ff:ff:ff:ff:ff 2023-10-09T07:00:38.729 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T07:00:38.729 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:00:38.730 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::8052:a9ff:fe85:8756/64 scope link 2023-10-09T07:00:38.730 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:00:38.730 INFO:teuthology.orchestra.run.smithi071.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T07:00:38.730 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether ae:1f:c9:59:0c:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T07:00:38.730 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ac1f:c9ff:fe59:c1b/64 scope link 2023-10-09T07:00:38.730 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:00:38.730 INFO:teuthology.orchestra.run.smithi071.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T07:00:38.730 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5a:a1:ec:c7:41:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T07:00:38.730 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::58a1:ecff:fec7:418f/64 scope link 2023-10-09T07:00:38.730 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:00:38.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:00:38.731 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T07:00:38.830 INFO:teuthology.orchestra.run.smithi071.stdout:1 2023-10-09T07:00:38.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:00:38.833 DEBUG:teuthology.orchestra.run.smithi071:> route 2023-10-09T07:00:38.872 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2023-10-09T07:00:38.873 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T07:00:38.873 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T07:00:38.873 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T07:00:38.873 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T07:00:38.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:00:38.874 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-09T07:00:38.874 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-09T07:00:38.874 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T07:00:38.874 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T07:00:38.874 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T07:00:38.874 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-09T07:00:39.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:00:39.068 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-09T07:00:39.104 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T07:00:39.105 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T07:00:39.105 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T07:00:39.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:00:39.105 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2023-10-09T07:00:39.206 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T07:00:39.206 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T07:00:39.242 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T07:00:39.243 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T07:00:39.243 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T07:00:39.318 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T07:00:39.318 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T07:00:39.318 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T07:00:39.448 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T07:00:39.448 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T07:00:39.477 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T07:00:39.477 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T07:00:39.477 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.71:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-09T07:00:39.477 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with new device syntax: 0@604c5619-653a-4ab6-912c-ab2e5464fe4a.cephfs=/ 2023-10-09T07:00:39.477 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.71:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-10-09T07:00:39.482 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T07:00:39.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:00:39.482 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T07:00:39.544 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T07:00:39.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.725+0000 7f10fabff700 1 Processor -- start 2023-10-09T07:00:39.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.725+0000 7f10fabff700 1 -- start start 2023-10-09T07:00:39.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.726+0000 7f10fabff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f10f4159840 0x7f10f40cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:39.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.726+0000 7f10fabff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f10f4069bb0 0x7f10f40b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:39.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.726+0000 7f10fabff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f40cfb30 con 0x7f10f40cba70 2023-10-09T07:00:39.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.726+0000 7f10fabff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f40cbf10 con 0x7f10f4069bb0 2023-10-09T07:00:39.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.726+0000 7f10fabff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f40cf4e0 con 0x7f10f4159840 2023-10-09T07:00:39.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.727+0000 7f10f919c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f10f4069bb0 0x7f10f40b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:39.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.727+0000 7f10f919c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f10f4069bb0 0x7f10f40b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56188/0 (socket says 172.21.15.71:56188) 2023-10-09T07:00:39.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.727+0000 7f10f919c700 1 -- 172.21.15.71:0/4075718652 learned_addr learned my addr 172.21.15.71:0/4075718652 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:39.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.727+0000 7f10f899b700 1 --2- 172.21.15.71:0/4075718652 >> v2:172.21.15.179:3300/0 conn(0x7f10f4159840 0x7f10f40cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:39.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.727+0000 7f10f919c700 1 -- 172.21.15.71:0/4075718652 >> v2:172.21.15.179:3300/0 conn(0x7f10f4159840 msgr2=0x7f10f40cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:39.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.727+0000 7f10f919c700 1 --2- 172.21.15.71:0/4075718652 >> v2:172.21.15.179:3300/0 conn(0x7f10f4159840 0x7f10f40cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:39.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.727+0000 7f10f919c700 1 -- 172.21.15.71:0/4075718652 >> v1:172.21.15.179:6789/0 conn(0x7f10f40cba70 legacy=0x7f10f40694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:39.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.727+0000 7f10f919c700 1 -- 172.21.15.71:0/4075718652 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f40cf7c0 con 0x7f10f4069bb0 2023-10-09T07:00:39.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.727+0000 7f10f919c700 1 --2- 172.21.15.71:0/4075718652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10f4069bb0 0x7f10f40b05e0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f10ec009f20 tx=0x7f10ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c605db403ce90ca server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:39.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.728+0000 7f10f37fe700 1 -- 172.21.15.71:0/4075718652 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec00e070 con 0x7f10f4069bb0 2023-10-09T07:00:39.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.728+0000 7f10f37fe700 1 -- 172.21.15.71:0/4075718652 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec00b990 con 0x7f10f4069bb0 2023-10-09T07:00:39.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.728+0000 7f10f37fe700 1 -- 172.21.15.71:0/4075718652 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec0092e0 con 0x7f10f4069bb0 2023-10-09T07:00:39.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.728+0000 7f10fabff700 1 -- 172.21.15.71:0/4075718652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10f4069bb0 msgr2=0x7f10f40b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:39.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.728+0000 7f10fabff700 1 --2- 172.21.15.71:0/4075718652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10f4069bb0 0x7f10f40b05e0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f10ec009f20 tx=0x7f10ec009840 comp rx=0 tx=0).stop 2023-10-09T07:00:39.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.728+0000 7f10fabff700 1 -- 172.21.15.71:0/4075718652 shutdown_connections 2023-10-09T07:00:39.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.728+0000 7f10fabff700 1 --2- 172.21.15.71:0/4075718652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10f4069bb0 0x7f10f40b05e0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:39.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.728+0000 7f10fabff700 1 --2- 172.21.15.71:0/4075718652 >> v2:172.21.15.179:3300/0 conn(0x7f10f4159840 0x7f10f40cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:39.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.728+0000 7f10fabff700 1 -- 172.21.15.71:0/4075718652 >> 172.21.15.71:0/4075718652 conn(0x7f10f4068e10 msgr2=0x7f10f40d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:39.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.728+0000 7f10fabff700 1 -- 172.21.15.71:0/4075718652 shutdown_connections 2023-10-09T07:00:39.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.728+0000 7f10fabff700 1 -- 172.21.15.71:0/4075718652 wait complete. 2023-10-09T07:00:39.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.730+0000 7f10fabff700 1 Processor -- start 2023-10-09T07:00:39.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.730+0000 7f10fabff700 1 -- start start 2023-10-09T07:00:39.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.731+0000 7f10fabff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10f4069bb0 0x7f10f415f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:39.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.731+0000 7f10fabff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10f40cba70 0x7f10f415d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:39.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.731+0000 7f10fabff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10f4159840 0x7f10f416c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:39.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.731+0000 7f10fabff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f4140c80 con 0x7f10f4159840 2023-10-09T07:00:39.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.731+0000 7f10fabff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f40b4a10 con 0x7f10f4069bb0 2023-10-09T07:00:39.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.731+0000 7f10fabff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f415da80 con 0x7f10f40cba70 2023-10-09T07:00:39.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.731+0000 7f10f919c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10f4159840 0x7f10f416c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:39.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.731+0000 7f10f919c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10f4159840 0x7f10f416c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56198/0 (socket says 172.21.15.71:56198) 2023-10-09T07:00:39.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.731+0000 7f10f919c700 1 -- 172.21.15.71:0/2048593190 learned_addr learned my addr 172.21.15.71:0/2048593190 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:39.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.731+0000 7f10f899b700 1 --2- 172.21.15.71:0/2048593190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10f4069bb0 0x7f10f415f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:39.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.731+0000 7f10f3fff700 1 --2- 172.21.15.71:0/2048593190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10f40cba70 0x7f10f415d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:39.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.731+0000 7f10f919c700 1 -- 172.21.15.71:0/2048593190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10f40cba70 msgr2=0x7f10f415d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:39.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.731+0000 7f10f919c700 1 --2- 172.21.15.71:0/2048593190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10f40cba70 0x7f10f415d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:39.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.731+0000 7f10f919c700 1 -- 172.21.15.71:0/2048593190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10f4069bb0 msgr2=0x7f10f415f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:39.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.731+0000 7f10f919c700 1 --2- 172.21.15.71:0/2048593190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10f4069bb0 0x7f10f415f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:39.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.731+0000 7f10f919c700 1 -- 172.21.15.71:0/2048593190 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec009ae0 con 0x7f10f4159840 2023-10-09T07:00:39.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.732+0000 7f10f919c700 1 --2- 172.21.15.71:0/2048593190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10f4159840 0x7f10f416c9d0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f10ec012000 tx=0x7f10ec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:39.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.732+0000 7f10f0ff9700 1 -- 172.21.15.71:0/2048593190 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec007b70 con 0x7f10f4159840 2023-10-09T07:00:39.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.732+0000 7f10f0ff9700 1 -- 172.21.15.71:0/2048593190 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec007cf0 con 0x7f10f4159840 2023-10-09T07:00:39.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.732+0000 7f10fabff700 1 -- 172.21.15.71:0/2048593190 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f40ca6a0 con 0x7f10f4159840 2023-10-09T07:00:39.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.732+0000 7f10f0ff9700 1 -- 172.21.15.71:0/2048593190 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec0266b0 con 0x7f10f4159840 2023-10-09T07:00:39.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.732+0000 7f10fabff700 1 -- 172.21.15.71:0/2048593190 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f40b43c0 con 0x7f10f4159840 2023-10-09T07:00:39.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.733+0000 7f10fabff700 1 -- 172.21.15.71:0/2048593190 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f4064550 con 0x7f10f4159840 2023-10-09T07:00:39.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.734+0000 7f10f0ff9700 1 -- 172.21.15.71:0/2048593190 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f10ec01d420 con 0x7f10f4159840 2023-10-09T07:00:39.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.735+0000 7f10f0ff9700 1 --2- 172.21.15.71:0/2048593190 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f10d8066f60 0x7f10d8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:39.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.735+0000 7f10f0ff9700 1 -- 172.21.15.71:0/2048593190 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f10ec086540 con 0x7f10f4159840 2023-10-09T07:00:39.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.735+0000 7f10f899b700 1 --2- 172.21.15.71:0/2048593190 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f10d8066f60 0x7f10d8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:39.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.736+0000 7f10f899b700 1 --2- 172.21.15.71:0/2048593190 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f10d8066f60 0x7f10d8069410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f10e8009d10 tx=0x7f10e80091a0 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:39.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.739+0000 7f10f0ff9700 1 -- 172.21.15.71:0/2048593190 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10ec053620 con 0x7f10f4159840 2023-10-09T07:00:39.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.966+0000 7f10fabff700 1 -- 172.21.15.71:0/2048593190 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f10f404c3f0 con 0x7f10d8066f60 2023-10-09T07:00:39.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.968+0000 7f10f0ff9700 1 -- 172.21.15.71:0/2048593190 <== mgr.7201 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f10f404c3f0 con 0x7f10d8066f60 2023-10-09T07:00:39.969 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-09T07:00:39.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:00:39.970 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cephfs" 2023-10-09T07:00:39.970 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:00:39.970 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-09T07:00:39.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.971+0000 7f10fabff700 1 -- 172.21.15.71:0/2048593190 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f10d8066f60 msgr2=0x7f10d8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:39.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.971+0000 7f10fabff700 1 --2- 172.21.15.71:0/2048593190 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f10d8066f60 0x7f10d8069410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f10e8009d10 tx=0x7f10e80091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:39.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.971+0000 7f10fabff700 1 -- 172.21.15.71:0/2048593190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10f4159840 msgr2=0x7f10f416c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:39.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.971+0000 7f10fabff700 1 --2- 172.21.15.71:0/2048593190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10f4159840 0x7f10f416c9d0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f10ec012000 tx=0x7f10ec018000 comp rx=0 tx=0).stop 2023-10-09T07:00:39.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.971+0000 7f10fabff700 1 -- 172.21.15.71:0/2048593190 shutdown_connections 2023-10-09T07:00:39.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.971+0000 7f10fabff700 1 --2- 172.21.15.71:0/2048593190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10f4159840 0x7f10f416c9d0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:39.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.971+0000 7f10fabff700 1 --2- 172.21.15.71:0/2048593190 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f10d8066f60 0x7f10d8069410 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:39.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.971+0000 7f10fabff700 1 --2- 172.21.15.71:0/2048593190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10f4069bb0 0x7f10f415f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:39.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.971+0000 7f10fabff700 1 --2- 172.21.15.71:0/2048593190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10f40cba70 0x7f10f415d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:39.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.971+0000 7f10fabff700 1 -- 172.21.15.71:0/2048593190 >> 172.21.15.71:0/2048593190 conn(0x7f10f4068e10 msgr2=0x7f10f40cd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:39.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.971+0000 7f10fabff700 1 -- 172.21.15.71:0/2048593190 shutdown_connections 2023-10-09T07:00:39.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:39.971+0000 7f10fabff700 1 -- 172.21.15.71:0/2048593190 wait complete. 2023-10-09T07:00:39.990 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-09T07:00:40.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.171+0000 7fa8e83ff700 1 Processor -- start 2023-10-09T07:00:40.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.171+0000 7fa8e83ff700 1 -- start start 2023-10-09T07:00:40.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.172+0000 7fa8e83ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa8e006bcd0 0x7fa8e00caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:40.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.172+0000 7fa8e83ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa8e006c0a0 0x7fa8e015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:40.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.172+0000 7fa8e83ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8e015df50 0x7fa8e015e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:40.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.172+0000 7fa8e83ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e015d7e0 con 0x7fa8e006bcd0 2023-10-09T07:00:40.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.172+0000 7fa8e83ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e015dac0 con 0x7fa8e006c0a0 2023-10-09T07:00:40.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.172+0000 7fa8e83ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e015aa30 con 0x7fa8e015df50 2023-10-09T07:00:40.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.173+0000 7fa8e619b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa8e006bcd0 0x7fa8e00caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:40.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.173+0000 7fa8e619b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa8e006bcd0 0x7fa8e00caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56204/0 (socket says 172.21.15.71:56204) 2023-10-09T07:00:40.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.173+0000 7fa8e619b700 1 -- 172.21.15.71:0/2772106454 learned_addr learned my addr 172.21.15.71:0/2772106454 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:40.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.173+0000 7fa8e699c700 1 --2- 172.21.15.71:0/2772106454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8e015df50 0x7fa8e015e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:40.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.173+0000 7fa8e599a700 1 --2- 172.21.15.71:0/2772106454 >> v2:172.21.15.179:3300/0 conn(0x7fa8e006c0a0 0x7fa8e015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:40.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.173+0000 7fa8e619b700 1 -- 172.21.15.71:0/2772106454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8e015df50 msgr2=0x7fa8e015e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:40.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.173+0000 7fa8e619b700 1 --2- 172.21.15.71:0/2772106454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8e015df50 0x7fa8e015e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:40.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.173+0000 7fa8e619b700 1 -- 172.21.15.71:0/2772106454 >> v2:172.21.15.179:3300/0 conn(0x7fa8e006c0a0 msgr2=0x7fa8e015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:40.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.173+0000 7fa8e619b700 1 --2- 172.21.15.71:0/2772106454 >> v2:172.21.15.179:3300/0 conn(0x7fa8e006c0a0 0x7fa8e015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:40.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.173+0000 7fa8e619b700 1 -- 172.21.15.71:0/2772106454 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e015ad10 con 0x7fa8e006bcd0 2023-10-09T07:00:40.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.173+0000 7fa8e699c700 1 --2- 172.21.15.71:0/2772106454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8e015df50 0x7fa8e015e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:00:40.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.173+0000 7fa8e599a700 1 --2- 172.21.15.71:0/2772106454 >> v2:172.21.15.179:3300/0 conn(0x7fa8e006c0a0 0x7fa8e015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:00:40.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.173+0000 7fa8e619b700 1 --2- 172.21.15.71:0/2772106454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8e006bcd0 0x7fa8e00caa90 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fa8e006b4e0 tx=0x7fa8dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6575c7449905579e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:40.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.173+0000 7fa8e5199700 1 -- 172.21.15.71:0/2772106454 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc00b860 con 0x7fa8e006bcd0 2023-10-09T07:00:40.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.174+0000 7fa8e5199700 1 -- 172.21.15.71:0/2772106454 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8dc00b9c0 con 0x7fa8e006bcd0 2023-10-09T07:00:40.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.174+0000 7fa8e5199700 1 -- 172.21.15.71:0/2772106454 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc00bd80 con 0x7fa8e006bcd0 2023-10-09T07:00:40.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.174+0000 7fa8e83ff700 1 -- 172.21.15.71:0/2772106454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8e006bcd0 msgr2=0x7fa8e00caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:40.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.174+0000 7fa8e83ff700 1 --2- 172.21.15.71:0/2772106454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8e006bcd0 0x7fa8e00caa90 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fa8e006b4e0 tx=0x7fa8dc009250 comp rx=0 tx=0).stop 2023-10-09T07:00:40.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.174+0000 7fa8e83ff700 1 -- 172.21.15.71:0/2772106454 shutdown_connections 2023-10-09T07:00:40.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.174+0000 7fa8e83ff700 1 --2- 172.21.15.71:0/2772106454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8e015df50 0x7fa8e015e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:40.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.174+0000 7fa8e83ff700 1 --2- 172.21.15.71:0/2772106454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8e006bcd0 0x7fa8e00caa90 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:40.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.174+0000 7fa8e83ff700 1 --2- 172.21.15.71:0/2772106454 >> v2:172.21.15.179:3300/0 conn(0x7fa8e006c0a0 0x7fa8e015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:40.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.174+0000 7fa8e83ff700 1 -- 172.21.15.71:0/2772106454 >> 172.21.15.71:0/2772106454 conn(0x7fa8e00ce600 msgr2=0x7fa8e00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:40.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.174+0000 7fa8e83ff700 1 -- 172.21.15.71:0/2772106454 shutdown_connections 2023-10-09T07:00:40.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.174+0000 7fa8e83ff700 1 -- 172.21.15.71:0/2772106454 wait complete. 2023-10-09T07:00:40.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.176+0000 7fa8e83ff700 1 Processor -- start 2023-10-09T07:00:40.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.176+0000 7fa8e83ff700 1 -- start start 2023-10-09T07:00:40.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.177+0000 7fa8e83ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8e006bcd0 0x7fa8e0141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:40.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.177+0000 7fa8e83ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8e006c0a0 0x7fa8e00b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:40.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.177+0000 7fa8e83ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8e015df50 0x7fa8e0156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:40.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.177+0000 7fa8e83ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e00b3680 con 0x7fa8e015df50 2023-10-09T07:00:40.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.177+0000 7fa8e83ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e00b2a70 con 0x7fa8e006bcd0 2023-10-09T07:00:40.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.177+0000 7fa8e83ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e00b2d50 con 0x7fa8e006c0a0 2023-10-09T07:00:40.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.177+0000 7fa8e699c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8e015df50 0x7fa8e0156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:40.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.177+0000 7fa8e699c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8e015df50 0x7fa8e0156030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56220/0 (socket says 172.21.15.71:56220) 2023-10-09T07:00:40.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.177+0000 7fa8e699c700 1 -- 172.21.15.71:0/2391053684 learned_addr learned my addr 172.21.15.71:0/2391053684 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:40.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.177+0000 7fa8e619b700 1 --2- 172.21.15.71:0/2391053684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8e006bcd0 0x7fa8e0141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:40.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.177+0000 7fa8e599a700 1 --2- 172.21.15.71:0/2391053684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8e006c0a0 0x7fa8e00b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:40.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.178+0000 7fa8e699c700 1 -- 172.21.15.71:0/2391053684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8e006c0a0 msgr2=0x7fa8e00b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:40.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.178+0000 7fa8e699c700 1 --2- 172.21.15.71:0/2391053684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8e006c0a0 0x7fa8e00b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:40.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.178+0000 7fa8e699c700 1 -- 172.21.15.71:0/2391053684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8e006bcd0 msgr2=0x7fa8e0141bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:40.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.178+0000 7fa8e699c700 1 --2- 172.21.15.71:0/2391053684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8e006bcd0 0x7fa8e0141bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:40.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.178+0000 7fa8e699c700 1 -- 172.21.15.71:0/2391053684 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8dc0094f0 con 0x7fa8e015df50 2023-10-09T07:00:40.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.178+0000 7fa8e599a700 1 --2- 172.21.15.71:0/2391053684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8e006c0a0 0x7fa8e00b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:00:40.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.178+0000 7fa8e699c700 1 --2- 172.21.15.71:0/2391053684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8e015df50 0x7fa8e0156030 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800cef0 tx=0x7fa8d8007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:40.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.178+0000 7fa8d67fc700 1 -- 172.21.15.71:0/2391053684 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d800add0 con 0x7fa8e015df50 2023-10-09T07:00:40.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.178+0000 7fa8d67fc700 1 -- 172.21.15.71:0/2391053684 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d8016420 con 0x7fa8e015df50 2023-10-09T07:00:40.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.178+0000 7fa8d67fc700 1 -- 172.21.15.71:0/2391053684 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d80167e0 con 0x7fa8e015df50 2023-10-09T07:00:40.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.178+0000 7fa8e83ff700 1 -- 172.21.15.71:0/2391053684 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e00b3030 con 0x7fa8e015df50 2023-10-09T07:00:40.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.178+0000 7fa8e83ff700 1 -- 172.21.15.71:0/2391053684 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e0142100 con 0x7fa8e015df50 2023-10-09T07:00:40.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.179+0000 7fa8e83ff700 1 -- 172.21.15.71:0/2391053684 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e004c3c0 con 0x7fa8e015df50 2023-10-09T07:00:40.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.180+0000 7fa8d67fc700 1 -- 172.21.15.71:0/2391053684 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 49) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa8d8016bd0 con 0x7fa8e015df50 2023-10-09T07:00:40.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.181+0000 7fa8d67fc700 1 --2- 172.21.15.71:0/2391053684 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa8c4066f30 0x7fa8c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:40.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.181+0000 7fa8d67fc700 1 -- 172.21.15.71:0/2391053684 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fa8d8012070 con 0x7fa8e015df50 2023-10-09T07:00:40.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.182+0000 7fa8e619b700 1 --2- 172.21.15.71:0/2391053684 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa8c4066f30 0x7fa8c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:40.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.183+0000 7fa8e619b700 1 --2- 172.21.15.71:0/2391053684 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa8c4066f30 0x7fa8c40693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa8e006b4e0 tx=0x7fa8dc017000 comp rx=0 tx=0).ready entity=mgr.7201 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:40.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.186+0000 7fa8d67fc700 1 -- 172.21.15.71:0/2391053684 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8d804e5a0 con 0x7fa8e015df50 2023-10-09T07:00:40.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.431+0000 7fa8e83ff700 1 -- 172.21.15.71:0/2391053684 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fa8e00b37c0 con 0x7fa8e015df50 2023-10-09T07:00:40.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.901+0000 7fa8d67fc700 1 -- 172.21.15.71:0/2391053684 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 50) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fa8d8089070 con 0x7fa8e015df50 2023-10-09T07:00:40.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.902+0000 7fa8d67fc700 1 -- 172.21.15.71:0/2391053684 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v50) v1 ==== 92+0+0 (secure 0 0 0) 0x7fa8d8055b30 con 0x7fa8e015df50 2023-10-09T07:00:40.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.905+0000 7fa8e83ff700 1 -- 172.21.15.71:0/2391053684 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa8c4066f30 msgr2=0x7fa8c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:40.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.905+0000 7fa8e83ff700 1 --2- 172.21.15.71:0/2391053684 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa8c4066f30 0x7fa8c40693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa8e006b4e0 tx=0x7fa8dc017000 comp rx=0 tx=0).stop 2023-10-09T07:00:40.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.905+0000 7fa8e83ff700 1 -- 172.21.15.71:0/2391053684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8e015df50 msgr2=0x7fa8e0156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:40.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.905+0000 7fa8e83ff700 1 --2- 172.21.15.71:0/2391053684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8e015df50 0x7fa8e0156030 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800cef0 tx=0x7fa8d8007860 comp rx=0 tx=0).stop 2023-10-09T07:00:40.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.905+0000 7fa8e83ff700 1 -- 172.21.15.71:0/2391053684 shutdown_connections 2023-10-09T07:00:40.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.905+0000 7fa8e83ff700 1 --2- 172.21.15.71:0/2391053684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8e015df50 0x7fa8e0156030 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:40.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.905+0000 7fa8e83ff700 1 --2- 172.21.15.71:0/2391053684 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa8c4066f30 0x7fa8c40693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:40.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.905+0000 7fa8e83ff700 1 --2- 172.21.15.71:0/2391053684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8e006bcd0 0x7fa8e0141bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:40.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.905+0000 7fa8e83ff700 1 --2- 172.21.15.71:0/2391053684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8e006c0a0 0x7fa8e00b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:40.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.905+0000 7fa8e83ff700 1 -- 172.21.15.71:0/2391053684 >> 172.21.15.71:0/2391053684 conn(0x7fa8e00ce600 msgr2=0x7fa8e015b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:40.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.905+0000 7fa8e83ff700 1 -- 172.21.15.71:0/2391053684 shutdown_connections 2023-10-09T07:00:40.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:40.905+0000 7fa8e83ff700 1 -- 172.21.15.71:0/2391053684 wait complete. 2023-10-09T07:00:40.924 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-09T07:00:41.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.113+0000 7f743939d700 1 Processor -- start 2023-10-09T07:00:41.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.114+0000 7f743939d700 1 -- start start 2023-10-09T07:00:41.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.115+0000 7f743939d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f74340aef00 0x7f743415d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:41.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.115+0000 7f743939d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74340aea70 con 0x7f743415a3b0 2023-10-09T07:00:41.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.115+0000 7f743939d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74340ae480 con 0x7f743406e470 2023-10-09T07:00:41.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.115+0000 7f743939d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743415dd30 con 0x7f74340aef00 2023-10-09T07:00:41.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.115+0000 7f74337fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f74340aef00 0x7f743415d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:41.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.115+0000 7f7433fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f743415a3b0 0x7f743415a780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34044/0 (socket says 172.21.15.71:34044) 2023-10-09T07:00:41.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.115+0000 7f7433fff700 1 -- 172.21.15.71:0/1678506275 learned_addr learned my addr 172.21.15.71:0/1678506275 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:41.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.116+0000 7f74337fe700 1 -- 172.21.15.71:0/1678506275 >> v1:172.21.15.179:6789/0 conn(0x7f743406e470 legacy=0x7f74340c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:41.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.116+0000 7f74337fe700 1 -- 172.21.15.71:0/1678506275 >> v1:172.21.15.71:6789/0 conn(0x7f743415a3b0 legacy=0x7f743415a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:41.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.116+0000 7f74337fe700 1 -- 172.21.15.71:0/1678506275 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743415e010 con 0x7f74340aef00 2023-10-09T07:00:41.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.116+0000 7f7432ffd700 1 -- 172.21.15.71:0/1678506275 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067251300 0 0) 0x7f74340aea70 con 0x7f743415a3b0 2023-10-09T07:00:41.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.116+0000 7f74337fe700 1 --2- 172.21.15.71:0/1678506275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74340aef00 0x7f743415d3c0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f74280098e0 tx=0x7f74280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162fede4709709f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:41.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.116+0000 7f7432ffd700 1 -- 172.21.15.71:0/1678506275 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7428009e80 con 0x7f74340aef00 2023-10-09T07:00:41.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.116+0000 7f7432ffd700 1 -- 172.21.15.71:0/1678506275 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742800b860 con 0x7f74340aef00 2023-10-09T07:00:41.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.116+0000 7f7432ffd700 1 -- 172.21.15.71:0/1678506275 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742800bbe0 con 0x7f74340aef00 2023-10-09T07:00:41.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.117+0000 7f743939d700 1 -- 172.21.15.71:0/1678506275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74340aef00 msgr2=0x7f743415d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:41.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.117+0000 7f743939d700 1 --2- 172.21.15.71:0/1678506275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74340aef00 0x7f743415d3c0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f74280098e0 tx=0x7f74280091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:41.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.117+0000 7f743939d700 1 -- 172.21.15.71:0/1678506275 shutdown_connections 2023-10-09T07:00:41.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.117+0000 7f743939d700 1 --2- 172.21.15.71:0/1678506275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74340aef00 0x7f743415d3c0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:41.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.117+0000 7f743939d700 1 -- 172.21.15.71:0/1678506275 >> 172.21.15.71:0/1678506275 conn(0x7f74340c9f70 msgr2=0x7f743406dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:41.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.117+0000 7f743939d700 1 -- 172.21.15.71:0/1678506275 shutdown_connections 2023-10-09T07:00:41.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.117+0000 7f743939d700 1 -- 172.21.15.71:0/1678506275 wait complete. 2023-10-09T07:00:41.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.119+0000 7f743939d700 1 Processor -- start 2023-10-09T07:00:41.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.119+0000 7f743939d700 1 -- start start 2023-10-09T07:00:41.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.120+0000 7f743939d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f743406e470 0x7f74340b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:41.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.120+0000 7f743939d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74340aef00 0x7f74340c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:41.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.120+0000 7f743939d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f743415a3b0 0x7f7434169a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:41.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.120+0000 7f743939d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74340b1a40 con 0x7f743415a3b0 2023-10-09T07:00:41.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.120+0000 7f743939d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74340b0ab0 con 0x7f743406e470 2023-10-09T07:00:41.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.120+0000 7f743939d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74340b1070 con 0x7f74340aef00 2023-10-09T07:00:41.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.120+0000 7f7438b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f743415a3b0 0x7f7434169a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:41.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.120+0000 7f7438b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f743415a3b0 0x7f7434169a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56250/0 (socket says 172.21.15.71:56250) 2023-10-09T07:00:41.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.120+0000 7f7438b9c700 1 -- 172.21.15.71:0/1991387672 learned_addr learned my addr 172.21.15.71:0/1991387672 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:41.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.120+0000 7f74337fe700 1 --2- 172.21.15.71:0/1991387672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74340aef00 0x7f74340c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:41.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.120+0000 7f7433fff700 1 --2- 172.21.15.71:0/1991387672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f743406e470 0x7f74340b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:41.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.120+0000 7f7438b9c700 1 -- 172.21.15.71:0/1991387672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74340aef00 msgr2=0x7f74340c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:41.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.120+0000 7f7438b9c700 1 --2- 172.21.15.71:0/1991387672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74340aef00 0x7f74340c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:41.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.120+0000 7f7438b9c700 1 -- 172.21.15.71:0/1991387672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f743406e470 msgr2=0x7f74340b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:41.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.120+0000 7f7438b9c700 1 --2- 172.21.15.71:0/1991387672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f743406e470 0x7f74340b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:41.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.120+0000 7f7438b9c700 1 -- 172.21.15.71:0/1991387672 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7428009420 con 0x7f743415a3b0 2023-10-09T07:00:41.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.121+0000 7f7438b9c700 1 --2- 172.21.15.71:0/1991387672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f743415a3b0 0x7f7434169a30 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f742c00c910 tx=0x7f742c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:41.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.121+0000 7f741bfff700 1 -- 172.21.15.71:0/1991387672 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c012630 con 0x7f743415a3b0 2023-10-09T07:00:41.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.121+0000 7f741bfff700 1 -- 172.21.15.71:0/1991387672 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742c0127b0 con 0x7f743415a3b0 2023-10-09T07:00:41.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.121+0000 7f743939d700 1 -- 172.21.15.71:0/1991387672 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74340c6410 con 0x7f743415a3b0 2023-10-09T07:00:41.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.121+0000 7f741bfff700 1 -- 172.21.15.71:0/1991387672 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c012b70 con 0x7f743415a3b0 2023-10-09T07:00:41.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.121+0000 7f743939d700 1 -- 172.21.15.71:0/1991387672 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743416a840 con 0x7f743415a3b0 2023-10-09T07:00:41.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.122+0000 7f743939d700 1 -- 172.21.15.71:0/1991387672 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743406cfa0 con 0x7f743415a3b0 2023-10-09T07:00:41.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.123+0000 7f741bfff700 1 -- 172.21.15.71:0/1991387672 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 50) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f742c003030 con 0x7f743415a3b0 2023-10-09T07:00:41.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.124+0000 7f741bfff700 1 --2- 172.21.15.71:0/1991387672 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7420066f80 0x7f7420069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:41.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.124+0000 7f741bfff700 1 -- 172.21.15.71:0/1991387672 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f742c084750 con 0x7f743415a3b0 2023-10-09T07:00:41.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.124+0000 7f7433fff700 1 -- 172.21.15.71:0/1991387672 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7420066f80 msgr2=0x7f7420069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:00:41.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.124+0000 7f7433fff700 1 --2- 172.21.15.71:0/1991387672 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7420066f80 0x7f7420069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:00:41.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.129+0000 7f741bfff700 1 -- 172.21.15.71:0/1991387672 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f742c051790 con 0x7f743415a3b0 2023-10-09T07:00:41.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.325+0000 7f7433fff700 1 -- 172.21.15.71:0/1991387672 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7420066f80 msgr2=0x7f7420069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:00:41.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.325+0000 7f7433fff700 1 --2- 172.21.15.71:0/1991387672 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7420066f80 0x7f7420069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:00:41.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.327+0000 7f743939d700 1 -- 172.21.15.71:0/1991387672 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f74340b11b0 con 0x7f743415a3b0 2023-10-09T07:00:41.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.331+0000 7f741bfff700 1 -- 172.21.15.71:0/1991387672 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v41)=0 v41) v1 ==== 138+0+0 (secure 0 0 0) 0x7f742c082e60 con 0x7f743415a3b0 2023-10-09T07:00:41.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.334+0000 7f743939d700 1 -- 172.21.15.71:0/1991387672 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7420066f80 msgr2=0x7f7420069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:00:41.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.334+0000 7f743939d700 1 --2- 172.21.15.71:0/1991387672 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7420066f80 0x7f7420069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:41.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.334+0000 7f743939d700 1 -- 172.21.15.71:0/1991387672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f743415a3b0 msgr2=0x7f7434169a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:41.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.334+0000 7f743939d700 1 --2- 172.21.15.71:0/1991387672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f743415a3b0 0x7f7434169a30 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f742c00c910 tx=0x7f742c001710 comp rx=0 tx=0).stop 2023-10-09T07:00:41.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.334+0000 7f743939d700 1 -- 172.21.15.71:0/1991387672 shutdown_connections 2023-10-09T07:00:41.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.334+0000 7f743939d700 1 --2- 172.21.15.71:0/1991387672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f743415a3b0 0x7f7434169a30 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:41.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.334+0000 7f743939d700 1 --2- 172.21.15.71:0/1991387672 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7420066f80 0x7f7420069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:41.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.334+0000 7f743939d700 1 --2- 172.21.15.71:0/1991387672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f743406e470 0x7f74340b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:41.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.334+0000 7f743939d700 1 --2- 172.21.15.71:0/1991387672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74340aef00 0x7f74340c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:41.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.334+0000 7f743939d700 1 -- 172.21.15.71:0/1991387672 >> 172.21.15.71:0/1991387672 conn(0x7f74340c9f70 msgr2=0x7f74341527b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:41.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.334+0000 7f743939d700 1 -- 172.21.15.71:0/1991387672 shutdown_connections 2023-10-09T07:00:41.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.334+0000 7f743939d700 1 -- 172.21.15.71:0/1991387672 wait complete. 2023-10-09T07:00:41.353 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-09T07:00:41.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.539+0000 7f407359d700 1 Processor -- start 2023-10-09T07:00:41.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.539+0000 7f407359d700 1 -- start start 2023-10-09T07:00:41.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.540+0000 7f407359d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f406c0aef00 0x7f406c15d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:41.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.540+0000 7f407359d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f406c0aea70 con 0x7f406c15a3b0 2023-10-09T07:00:41.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.540+0000 7f407359d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f406c0ae480 con 0x7f406c06e470 2023-10-09T07:00:41.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.540+0000 7f407359d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f406c15dd30 con 0x7f406c0aef00 2023-10-09T07:00:41.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.541+0000 7f4071d9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f406c0aef00 0x7f406c15d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:41.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.541+0000 7f407259b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f406c15a3b0 0x7f406c15a780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34060/0 (socket says 172.21.15.71:34060) 2023-10-09T07:00:41.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.541+0000 7f407259b700 1 -- 172.21.15.71:0/1302127080 learned_addr learned my addr 172.21.15.71:0/1302127080 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:41.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.541+0000 7f4071599700 1 -- 172.21.15.71:0/1302127080 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230458061 0 0) 0x7f406c0aea70 con 0x7f406c15a3b0 2023-10-09T07:00:41.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.541+0000 7f4071d9a700 1 -- 172.21.15.71:0/1302127080 >> v1:172.21.15.179:6789/0 conn(0x7f406c06e470 legacy=0x7f406c0c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:41.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.541+0000 7f4071d9a700 1 -- 172.21.15.71:0/1302127080 >> v1:172.21.15.71:6789/0 conn(0x7f406c15a3b0 legacy=0x7f406c15a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:41.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.541+0000 7f4071d9a700 1 -- 172.21.15.71:0/1302127080 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406c15e010 con 0x7f406c0aef00 2023-10-09T07:00:41.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.542+0000 7f4071d9a700 1 --2- 172.21.15.71:0/1302127080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406c0aef00 0x7f406c15d3c0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f405c0098e0 tx=0x7f405c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37eb439c0d9b1bc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:41.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.542+0000 7f4071599700 1 -- 172.21.15.71:0/1302127080 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c009e80 con 0x7f406c0aef00 2023-10-09T07:00:41.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.542+0000 7f4071599700 1 -- 172.21.15.71:0/1302127080 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405c00b860 con 0x7f406c0aef00 2023-10-09T07:00:41.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.542+0000 7f4071599700 1 -- 172.21.15.71:0/1302127080 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c00bbe0 con 0x7f406c0aef00 2023-10-09T07:00:41.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.542+0000 7f407359d700 1 -- 172.21.15.71:0/1302127080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406c0aef00 msgr2=0x7f406c15d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:41.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.542+0000 7f407359d700 1 --2- 172.21.15.71:0/1302127080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406c0aef00 0x7f406c15d3c0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f405c0098e0 tx=0x7f405c0091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:41.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.542+0000 7f407359d700 1 -- 172.21.15.71:0/1302127080 shutdown_connections 2023-10-09T07:00:41.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.542+0000 7f407359d700 1 --2- 172.21.15.71:0/1302127080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406c0aef00 0x7f406c15d3c0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:41.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.542+0000 7f407359d700 1 -- 172.21.15.71:0/1302127080 >> 172.21.15.71:0/1302127080 conn(0x7f406c0c9f70 msgr2=0x7f406c06dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:41.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.542+0000 7f407359d700 1 -- 172.21.15.71:0/1302127080 shutdown_connections 2023-10-09T07:00:41.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.543+0000 7f407359d700 1 -- 172.21.15.71:0/1302127080 wait complete. 2023-10-09T07:00:41.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.544+0000 7f407359d700 1 Processor -- start 2023-10-09T07:00:41.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.544+0000 7f407359d700 1 -- start start 2023-10-09T07:00:41.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.545+0000 7f407359d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406c06e470 0x7f406c0b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:41.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.545+0000 7f407359d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f406c0aef00 0x7f406c0c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:41.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.545+0000 7f407359d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f406c15a3b0 0x7f406c169a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:41.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.545+0000 7f407359d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c0b1a40 con 0x7f406c06e470 2023-10-09T07:00:41.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.545+0000 7f407359d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c0b0ab0 con 0x7f406c0aef00 2023-10-09T07:00:41.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.545+0000 7f407359d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406c0b1070 con 0x7f406c15a3b0 2023-10-09T07:00:41.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.545+0000 7f407259b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406c06e470 0x7f406c0b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:41.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.545+0000 7f407259b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406c06e470 0x7f406c0b1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56274/0 (socket says 172.21.15.71:56274) 2023-10-09T07:00:41.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.545+0000 7f407259b700 1 -- 172.21.15.71:0/619862307 learned_addr learned my addr 172.21.15.71:0/619862307 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:41.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.545+0000 7f4071d9a700 1 --2- 172.21.15.71:0/619862307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f406c0aef00 0x7f406c0c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:41.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.545+0000 7f4072d9c700 1 --2- 172.21.15.71:0/619862307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f406c15a3b0 0x7f406c169a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:41.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.545+0000 7f407259b700 1 -- 172.21.15.71:0/619862307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f406c15a3b0 msgr2=0x7f406c169a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:41.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.545+0000 7f407259b700 1 --2- 172.21.15.71:0/619862307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f406c15a3b0 0x7f406c169a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:41.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.545+0000 7f407259b700 1 -- 172.21.15.71:0/619862307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f406c0aef00 msgr2=0x7f406c0c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:41.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.545+0000 7f407259b700 1 --2- 172.21.15.71:0/619862307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f406c0aef00 0x7f406c0c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:41.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.545+0000 7f407259b700 1 -- 172.21.15.71:0/619862307 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c009420 con 0x7f406c06e470 2023-10-09T07:00:41.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.546+0000 7f407259b700 1 --2- 172.21.15.71:0/619862307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406c06e470 0x7f406c0b1500 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f406800c590 tx=0x7f4068000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:41.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.546+0000 7f40627fc700 1 -- 172.21.15.71:0/619862307 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4068005b30 con 0x7f406c06e470 2023-10-09T07:00:41.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.546+0000 7f40627fc700 1 -- 172.21.15.71:0/619862307 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4068005c90 con 0x7f406c06e470 2023-10-09T07:00:41.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.546+0000 7f407359d700 1 -- 172.21.15.71:0/619862307 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f406c0c6410 con 0x7f406c06e470 2023-10-09T07:00:41.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.546+0000 7f40627fc700 1 -- 172.21.15.71:0/619862307 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4068007320 con 0x7f406c06e470 2023-10-09T07:00:41.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.546+0000 7f407359d700 1 -- 172.21.15.71:0/619862307 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406c16a840 con 0x7f406c06e470 2023-10-09T07:00:41.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.547+0000 7f407359d700 1 -- 172.21.15.71:0/619862307 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f406c06cfa0 con 0x7f406c06e470 2023-10-09T07:00:41.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.548+0000 7f40627fc700 1 -- 172.21.15.71:0/619862307 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 50) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f406801b3b0 con 0x7f406c06e470 2023-10-09T07:00:41.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.549+0000 7f40627fc700 1 --2- 172.21.15.71:0/619862307 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4050066f80 0x7f4050069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:41.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.549+0000 7f40627fc700 1 -- 172.21.15.71:0/619862307 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f4068083c70 con 0x7f406c06e470 2023-10-09T07:00:41.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.549+0000 7f4071d9a700 1 -- 172.21.15.71:0/619862307 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4050066f80 msgr2=0x7f4050069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:00:41.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.549+0000 7f4071d9a700 1 --2- 172.21.15.71:0/619862307 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4050066f80 0x7f4050069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:00:41.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.557+0000 7f40627fc700 1 -- 172.21.15.71:0/619862307 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4068050cb0 con 0x7f406c06e470 2023-10-09T07:00:41.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.750+0000 7f4071d9a700 1 -- 172.21.15.71:0/619862307 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4050066f80 msgr2=0x7f4050069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:00:41.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.750+0000 7f4071d9a700 1 --2- 172.21.15.71:0/619862307 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4050066f80 0x7f4050069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:00:41.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.756+0000 7f407359d700 1 -- 172.21.15.71:0/619862307 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f406c0ae700 con 0x7f406c06e470 2023-10-09T07:00:41.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.760+0000 7f40627fc700 1 -- 172.21.15.71:0/619862307 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v42)=0 v42) v1 ==== 133+0+0 (secure 0 0 0) 0x7f40680170c0 con 0x7f406c06e470 2023-10-09T07:00:41.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.762+0000 7f407359d700 1 -- 172.21.15.71:0/619862307 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4050066f80 msgr2=0x7f4050069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:00:41.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.762+0000 7f407359d700 1 --2- 172.21.15.71:0/619862307 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4050066f80 0x7f4050069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:41.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.762+0000 7f407359d700 1 -- 172.21.15.71:0/619862307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406c06e470 msgr2=0x7f406c0b1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:41.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.762+0000 7f407359d700 1 --2- 172.21.15.71:0/619862307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406c06e470 0x7f406c0b1500 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f406800c590 tx=0x7f4068000fe0 comp rx=0 tx=0).stop 2023-10-09T07:00:41.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.762+0000 7f407359d700 1 -- 172.21.15.71:0/619862307 shutdown_connections 2023-10-09T07:00:41.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.762+0000 7f407359d700 1 --2- 172.21.15.71:0/619862307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f406c15a3b0 0x7f406c169a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:41.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.762+0000 7f407359d700 1 --2- 172.21.15.71:0/619862307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406c06e470 0x7f406c0b1500 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:41.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.762+0000 7f407359d700 1 --2- 172.21.15.71:0/619862307 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4050066f80 0x7f4050069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:41.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.762+0000 7f407359d700 1 --2- 172.21.15.71:0/619862307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f406c0aef00 0x7f406c0c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:41.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.762+0000 7f407359d700 1 -- 172.21.15.71:0/619862307 >> 172.21.15.71:0/619862307 conn(0x7f406c0c9f70 msgr2=0x7f406c1527b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:41.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.762+0000 7f407359d700 1 -- 172.21.15.71:0/619862307 shutdown_connections 2023-10-09T07:00:41.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:41.762+0000 7f407359d700 1 -- 172.21.15.71:0/619862307 wait complete. 2023-10-09T07:00:41.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:00:41.782 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-09T07:00:41.823 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-10-09T07:00:42.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.054+0000 7f2b3499d700 1 Processor -- start 2023-10-09T07:00:42.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.054+0000 7f2b3499d700 1 -- start start 2023-10-09T07:00:42.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.055+0000 7f2b3499d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2b300b03c0 0x7f2b300cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:42.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.055+0000 7f2b3499d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2b300b0790 0x7f2b300b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:42.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.055+0000 7f2b3499d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b300cfa00 con 0x7f2b301591e0 2023-10-09T07:00:42.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.055+0000 7f2b3499d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b300cb580 con 0x7f2b300b0790 2023-10-09T07:00:42.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.055+0000 7f2b3499d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b300b2de0 con 0x7f2b300b03c0 2023-10-09T07:00:42.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.055+0000 7f2b2effd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2b300b0790 0x7f2b300b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:42.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.055+0000 7f2b2effd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2b300b0790 0x7f2b300b28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56288/0 (socket says 172.21.15.71:56288) 2023-10-09T07:00:42.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.055+0000 7f2b2effd700 1 -- 172.21.15.71:0/3677891840 learned_addr learned my addr 172.21.15.71:0/3677891840 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:42.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.055+0000 7f2b2f7fe700 1 --2- 172.21.15.71:0/3677891840 >> v2:172.21.15.179:3300/0 conn(0x7f2b300b03c0 0x7f2b300cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:42.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.056+0000 7f2b2effd700 1 -- 172.21.15.71:0/3677891840 >> v2:172.21.15.179:3300/0 conn(0x7f2b300b03c0 msgr2=0x7f2b300cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:42.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.056+0000 7f2b2effd700 1 --2- 172.21.15.71:0/3677891840 >> v2:172.21.15.179:3300/0 conn(0x7f2b300b03c0 0x7f2b300cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:42.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.056+0000 7f2b2effd700 1 -- 172.21.15.71:0/3677891840 >> v1:172.21.15.179:6789/0 conn(0x7f2b301591e0 legacy=0x7f2b30159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:42.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.056+0000 7f2b2effd700 1 -- 172.21.15.71:0/3677891840 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b300cf160 con 0x7f2b300b0790 2023-10-09T07:00:42.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.056+0000 7f2b2effd700 1 --2- 172.21.15.71:0/3677891840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b300b0790 0x7f2b300b28a0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f2b240099b0 tx=0x7f2b24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5fc93aabac7e96 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:42.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.056+0000 7f2b2e7fc700 1 -- 172.21.15.71:0/3677891840 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b24009ea0 con 0x7f2b300b0790 2023-10-09T07:00:42.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.056+0000 7f2b2e7fc700 1 -- 172.21.15.71:0/3677891840 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2400b820 con 0x7f2b300b0790 2023-10-09T07:00:42.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.056+0000 7f2b2e7fc700 1 -- 172.21.15.71:0/3677891840 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2400bbe0 con 0x7f2b300b0790 2023-10-09T07:00:42.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.057+0000 7f2b3499d700 1 -- 172.21.15.71:0/3677891840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b300b0790 msgr2=0x7f2b300b28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:42.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.057+0000 7f2b3499d700 1 --2- 172.21.15.71:0/3677891840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b300b0790 0x7f2b300b28a0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f2b240099b0 tx=0x7f2b24009250 comp rx=0 tx=0).stop 2023-10-09T07:00:42.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.057+0000 7f2b3499d700 1 -- 172.21.15.71:0/3677891840 shutdown_connections 2023-10-09T07:00:42.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.057+0000 7f2b3499d700 1 --2- 172.21.15.71:0/3677891840 >> v2:172.21.15.179:3300/0 conn(0x7f2b300b03c0 0x7f2b300cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:42.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.057+0000 7f2b3499d700 1 --2- 172.21.15.71:0/3677891840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b300b0790 0x7f2b300b28a0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:42.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.057+0000 7f2b3499d700 1 -- 172.21.15.71:0/3677891840 >> 172.21.15.71:0/3677891840 conn(0x7f2b30063230 msgr2=0x7f2b30063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:42.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.057+0000 7f2b3499d700 1 -- 172.21.15.71:0/3677891840 shutdown_connections 2023-10-09T07:00:42.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.057+0000 7f2b3499d700 1 -- 172.21.15.71:0/3677891840 wait complete. 2023-10-09T07:00:42.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.058+0000 7f2b3499d700 1 Processor -- start 2023-10-09T07:00:42.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.059+0000 7f2b3499d700 1 -- start start 2023-10-09T07:00:42.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.059+0000 7f2b3499d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b300b03c0 0x7f2b3016a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:42.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.059+0000 7f2b3499d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b300b0790 0x7f2b300c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:42.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.059+0000 7f2b3499d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b301591e0 0x7f2b300d0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:42.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.059+0000 7f2b3499d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3015b970 con 0x7f2b300b03c0 2023-10-09T07:00:42.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.059+0000 7f2b3499d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b30158060 con 0x7f2b300b0790 2023-10-09T07:00:42.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.059+0000 7f2b3499d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3016aa70 con 0x7f2b301591e0 2023-10-09T07:00:42.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.060+0000 7f2b2f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b300b03c0 0x7f2b3016a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:42.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.060+0000 7f2b2f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b300b03c0 0x7f2b3016a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56290/0 (socket says 172.21.15.71:56290) 2023-10-09T07:00:42.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.060+0000 7f2b2f7fe700 1 -- 172.21.15.71:0/1443105663 learned_addr learned my addr 172.21.15.71:0/1443105663 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:42.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.060+0000 7f2b2effd700 1 --2- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b300b0790 0x7f2b300c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:42.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.060+0000 7f2b2ffff700 1 --2- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b301591e0 0x7f2b300d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:42.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.060+0000 7f2b2f7fe700 1 -- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b301591e0 msgr2=0x7f2b300d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:42.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.060+0000 7f2b2f7fe700 1 --2- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b301591e0 0x7f2b300d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:42.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.060+0000 7f2b2f7fe700 1 -- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b300b0790 msgr2=0x7f2b300c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:42.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.060+0000 7f2b2f7fe700 1 --2- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b300b0790 0x7f2b300c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:42.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.060+0000 7f2b2f7fe700 1 -- 172.21.15.71:0/1443105663 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b240094f0 con 0x7f2b300b03c0 2023-10-09T07:00:42.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.060+0000 7f2b2f7fe700 1 --2- 172.21.15.71:0/1443105663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b300b03c0 0x7f2b3016a530 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000ec80 tx=0x7f2b200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:42.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.060+0000 7f2b177fe700 1 -- 172.21.15.71:0/1443105663 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2000c7f0 con 0x7f2b300b03c0 2023-10-09T07:00:42.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.061+0000 7f2b177fe700 1 -- 172.21.15.71:0/1443105663 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2000c950 con 0x7f2b300b03c0 2023-10-09T07:00:42.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.061+0000 7f2b3499d700 1 -- 172.21.15.71:0/1443105663 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b3015a3c0 con 0x7f2b300b03c0 2023-10-09T07:00:42.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.061+0000 7f2b177fe700 1 -- 172.21.15.71:0/1443105663 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2000ccf0 con 0x7f2b300b03c0 2023-10-09T07:00:42.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.061+0000 7f2b3499d700 1 -- 172.21.15.71:0/1443105663 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3015aa00 con 0x7f2b300b03c0 2023-10-09T07:00:42.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.062+0000 7f2b3499d700 1 -- 172.21.15.71:0/1443105663 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b3015ad80 con 0x7f2b300b03c0 2023-10-09T07:00:42.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.064+0000 7f2b177fe700 1 -- 172.21.15.71:0/1443105663 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 50) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f2b20013680 con 0x7f2b300b03c0 2023-10-09T07:00:42.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.065+0000 7f2b177fe700 1 --2- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2b1c066f80 0x7f2b1c069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:42.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.065+0000 7f2b177fe700 1 -- 172.21.15.71:0/1443105663 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f2b20084930 con 0x7f2b300b03c0 2023-10-09T07:00:42.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.065+0000 7f2b2effd700 1 -- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2b1c066f80 msgr2=0x7f2b1c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:00:42.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.065+0000 7f2b2effd700 1 --2- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2b1c066f80 0x7f2b1c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:00:42.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.069+0000 7f2b177fe700 1 -- 172.21.15.71:0/1443105663 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b20051a10 con 0x7f2b300b03c0 2023-10-09T07:00:42.179 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:42.177+0000 7f4f58eb6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T07:00:42.231 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:42.230+0000 7fa02ba4c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T07:00:42.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.266+0000 7f2b2effd700 1 -- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2b1c066f80 msgr2=0x7f2b1c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:00:42.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.266+0000 7f2b2effd700 1 --2- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2b1c066f80 0x7f2b1c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:00:42.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.292+0000 7f2b3499d700 1 -- 172.21.15.71:0/1443105663 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b3004c3c0 con 0x7f2b1c066f80 2023-10-09T07:00:42.342 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:42.340+0000 7f4f58eb6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T07:00:42.398 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:42.397+0000 7fa02ba4c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T07:00:42.428 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:42.426+0000 7f4f58eb6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T07:00:42.482 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:42.481+0000 7fa02ba4c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T07:00:42.651 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:42.649+0000 7f4f58eb6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:00:42.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.667+0000 7f2b2effd700 1 -- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2b1c066f80 msgr2=0x7f2b1c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:00:42.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:42.667+0000 7f2b2effd700 1 --2- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2b1c066f80 0x7f2b1c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T07:00:42.706 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:42.705+0000 7fa02ba4c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:00:42.826 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:42.825+0000 7f4f58eb6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T07:00:42.883 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:42.882+0000 7fa02ba4c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T07:00:42.918 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:42.916+0000 7f4f58eb6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T07:00:42.975 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:42.974+0000 7fa02ba4c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T07:00:43.079 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:43.077+0000 7f4f58eb6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T07:00:43.135 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:43.134+0000 7fa02ba4c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T07:00:43.179 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:43.177+0000 7f4f58eb6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T07:00:43.236 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:43.235+0000 7fa02ba4c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T07:00:43.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:43.468+0000 7f2b2effd700 1 -- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2b1c066f80 msgr2=0x7f2b1c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:00:43.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:43.468+0000 7f2b2effd700 1 --2- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2b1c066f80 0x7f2b1c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T07:00:43.662 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:43.660+0000 7f4f58eb6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T07:00:43.717 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:43.716+0000 7fa02ba4c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T07:00:43.755 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:43.754+0000 7f4f58eb6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T07:00:43.812 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:43.811+0000 7fa02ba4c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T07:00:43.846 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:43.845+0000 7f4f58eb6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T07:00:43.901 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:43.900+0000 7fa02ba4c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T07:00:44.469 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:44.467+0000 7f4f58eb6180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T07:00:44.519 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:44.518+0000 7fa02ba4c180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T07:00:44.639 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:44.638+0000 7f4f58eb6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:00:44.690 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:44.690+0000 7fa02ba4c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:00:44.734 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:44.733+0000 7f4f58eb6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T07:00:44.787 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:44.786+0000 7fa02ba4c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T07:00:45.030 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:45.028+0000 7f4f58eb6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T07:00:45.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:45.069+0000 7f2b2effd700 1 -- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2b1c066f80 msgr2=0x7f2b1c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:00:45.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:45.069+0000 7f2b2effd700 1 --2- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2b1c066f80 0x7f2b1c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-09T07:00:45.081 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:45.080+0000 7fa02ba4c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T07:00:45.125 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:45.124+0000 7f4f58eb6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T07:00:45.176 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:45.175+0000 7fa02ba4c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T07:00:45.822 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:45.821+0000 7f4f58eb6180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T07:00:45.871 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:45.870+0000 7fa02ba4c180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T07:00:46.108 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:46.107+0000 7f4f58eb6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T07:00:46.155 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:46.154+0000 7fa02ba4c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T07:00:46.201 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:46.199+0000 7f4f58eb6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T07:00:46.248 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:46.247+0000 7fa02ba4c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T07:00:46.355 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:46.354+0000 7f4f58eb6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T07:00:46.400 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:46.399+0000 7fa02ba4c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T07:00:46.459 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:46.458+0000 7f4f58eb6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T07:00:46.503 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:46.502+0000 7fa02ba4c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T07:00:46.649 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:46.648+0000 7f4f58eb6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T07:00:46.691 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:46.690+0000 7fa02ba4c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T07:00:46.742 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:46.741+0000 7f4f58eb6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T07:00:46.783 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:46.782+0000 7fa02ba4c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T07:00:46.833 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:46.832+0000 7f4f58eb6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T07:00:46.876 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:46.875+0000 7fa02ba4c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T07:00:46.931 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:46.930+0000 7f4f58eb6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T07:00:46.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:46.942+0000 7f2b177fe700 1 -- 172.21.15.71:0/1443105663 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 51) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f2b20086d50 con 0x7f2b300b03c0 2023-10-09T07:00:46.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:46.943+0000 7f2b177fe700 1 -- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2b1c066f80 msgr2=0x7f2b1c069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:00:46.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:46.943+0000 7f2b177fe700 1 --2- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2b1c066f80 0x7f2b1c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:46.975 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:00:46.974+0000 7fa02ba4c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T07:00:47.070 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:47.066+0000 7f4ece1f7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:47.071 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:47.066+0000 7f4ece1f7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:47.071 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:47.066+0000 7f4ece1f7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:47.071 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:47.066+0000 7f4ece1f7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:47.071 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:47.066+0000 7f4ece1f7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:47.071 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:47.066+0000 7f4eca9f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:47.071 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:47.066+0000 7f4eca9f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:47.072 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:47.066+0000 7f4eca9f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:47.072 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:47.066+0000 7f4eca9f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:47.072 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:00:47.066+0000 7f4eca9f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:00:47.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:47.947+0000 7f2b177fe700 1 -- 172.21.15.71:0/1443105663 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mgrmap(e 52) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f2b20086d50 con 0x7f2b300b03c0 2023-10-09T07:00:47.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:47.948+0000 7f2b177fe700 1 --2- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2b1c066f80 0x7f2b1c069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:47.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:47.948+0000 7f2b177fe700 1 -- 172.21.15.71:0/1443105663 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b3004c3c0 con 0x7f2b1c066f80 2023-10-09T07:00:47.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:47.948+0000 7f2b2effd700 1 --2- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2b1c066f80 0x7f2b1c069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:47.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:47.955+0000 7f2b2effd700 1 --2- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2b1c066f80 0x7f2b1c069430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2b240099b0 tx=0x7f2b24017000 comp rx=0 tx=0).ready entity=mgr.7531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:48.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.023+0000 7f2b177fe700 1 -- 172.21.15.71:0/1443105663 <== mgr.7531 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2b3004c3c0 con 0x7f2b1c066f80 2023-10-09T07:00:48.025 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule set for path snap_test_dir1 2023-10-09T07:00:48.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.026+0000 7f2b3499d700 1 -- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2b1c066f80 msgr2=0x7f2b1c069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.026+0000 7f2b3499d700 1 --2- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2b1c066f80 0x7f2b1c069430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2b240099b0 tx=0x7f2b24017000 comp rx=0 tx=0).stop 2023-10-09T07:00:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.026+0000 7f2b3499d700 1 -- 172.21.15.71:0/1443105663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b300b03c0 msgr2=0x7f2b3016a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.026+0000 7f2b3499d700 1 --2- 172.21.15.71:0/1443105663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b300b03c0 0x7f2b3016a530 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000ec80 tx=0x7f2b200091a0 comp rx=0 tx=0).stop 2023-10-09T07:00:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.026+0000 7f2b3499d700 1 -- 172.21.15.71:0/1443105663 shutdown_connections 2023-10-09T07:00:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.026+0000 7f2b3499d700 1 --2- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b301591e0 0x7f2b300d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.026+0000 7f2b3499d700 1 --2- 172.21.15.71:0/1443105663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b300b03c0 0x7f2b3016a530 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.026+0000 7f2b3499d700 1 --2- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2b1c066f80 0x7f2b1c069430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.026+0000 7f2b3499d700 1 --2- 172.21.15.71:0/1443105663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b300b0790 0x7f2b300c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.026+0000 7f2b3499d700 1 -- 172.21.15.71:0/1443105663 >> 172.21.15.71:0/1443105663 conn(0x7f2b30063230 msgr2=0x7f2b30068d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.026+0000 7f2b3499d700 1 -- 172.21.15.71:0/1443105663 shutdown_connections 2023-10-09T07:00:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.026+0000 7f2b3499d700 1 -- 172.21.15.71:0/1443105663 wait complete. 2023-10-09T07:00:48.046 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-09T07:00:48.046 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-09-07_01_00 in ~12s... 2023-10-09T07:00:48.047 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-10-09T07:00:48.047 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-10-09T07:00:48.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.233+0000 7f5d4bfff700 1 Processor -- start 2023-10-09T07:00:48.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.233+0000 7f5d4bfff700 1 -- start start 2023-10-09T07:00:48.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.234+0000 7f5d4bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d4c15d3f0 0x7f5d4c1538f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:48.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.234+0000 7f5d4bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5d4c0689b0 0x7f5d4c153e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:48.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.234+0000 7f5d4bfff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4c0c9480 con 0x7f5d4c0685e0 2023-10-09T07:00:48.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.234+0000 7f5d4bfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d4c15ae00 con 0x7f5d4c0689b0 2023-10-09T07:00:48.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.234+0000 7f5d4bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c15d880 con 0x7f5d4c15d3f0 2023-10-09T07:00:48.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.234+0000 7f5d4affd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f5d4c0685e0 0x7f5d4c15a6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45564/0 (socket says 172.21.15.71:45564) 2023-10-09T07:00:48.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.234+0000 7f5d4affd700 1 -- 172.21.15.71:0/632430465 learned_addr learned my addr 172.21.15.71:0/632430465 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:00:48.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.235+0000 7f5d4b7fe700 1 --2- 172.21.15.71:0/632430465 >> v2:172.21.15.179:3300/0 conn(0x7f5d4c0689b0 0x7f5d4c153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:48.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.235+0000 7f5d4a7fc700 1 --2- 172.21.15.71:0/632430465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d4c15d3f0 0x7f5d4c1538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:48.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.235+0000 7f5d49ffb700 1 -- 172.21.15.71:0/632430465 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321441736 0 0) 0x7f5d4c0c9480 con 0x7f5d4c0685e0 2023-10-09T07:00:48.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.235+0000 7f5d49ffb700 1 -- 172.21.15.71:0/632430465 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d34003570 con 0x7f5d4c0685e0 2023-10-09T07:00:48.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.235+0000 7f5d4b7fe700 1 -- 172.21.15.71:0/632430465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d4c15d3f0 msgr2=0x7f5d4c1538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:00:48.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.235+0000 7f5d4b7fe700 1 --2- 172.21.15.71:0/632430465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d4c15d3f0 0x7f5d4c1538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:48.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.235+0000 7f5d4b7fe700 1 -- 172.21.15.71:0/632430465 >> v1:172.21.15.71:6789/0 conn(0x7f5d4c0685e0 legacy=0x7f5d4c15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:48.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.235+0000 7f5d4b7fe700 1 -- 172.21.15.71:0/632430465 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c15db60 con 0x7f5d4c0689b0 2023-10-09T07:00:48.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.235+0000 7f5d4a7fc700 1 --2- 172.21.15.71:0/632430465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d4c15d3f0 0x7f5d4c1538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:00:48.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.235+0000 7f5d4b7fe700 1 --2- 172.21.15.71:0/632430465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d4c0689b0 0x7f5d4c153e30 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009e60 tx=0x7f5d44009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ea94aadfe290e96 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:48.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.236+0000 7f5d49ffb700 1 -- 172.21.15.71:0/632430465 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4400e070 con 0x7f5d4c0689b0 2023-10-09T07:00:48.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.236+0000 7f5d49ffb700 1 -- 172.21.15.71:0/632430465 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4400bb40 con 0x7f5d4c0689b0 2023-10-09T07:00:48.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.236+0000 7f5d49ffb700 1 -- 172.21.15.71:0/632430465 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44012430 con 0x7f5d4c0689b0 2023-10-09T07:00:48.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.236+0000 7f5d4bfff700 1 -- 172.21.15.71:0/632430465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d4c0689b0 msgr2=0x7f5d4c153e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:48.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.236+0000 7f5d4bfff700 1 --2- 172.21.15.71:0/632430465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d4c0689b0 0x7f5d4c153e30 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009e60 tx=0x7f5d44009780 comp rx=0 tx=0).stop 2023-10-09T07:00:48.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.236+0000 7f5d4bfff700 1 -- 172.21.15.71:0/632430465 shutdown_connections 2023-10-09T07:00:48.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.236+0000 7f5d4bfff700 1 --2- 172.21.15.71:0/632430465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d4c0689b0 0x7f5d4c153e30 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:48.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.236+0000 7f5d4bfff700 1 --2- 172.21.15.71:0/632430465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d4c15d3f0 0x7f5d4c1538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:48.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.236+0000 7f5d4bfff700 1 -- 172.21.15.71:0/632430465 >> 172.21.15.71:0/632430465 conn(0x7f5d4c06b420 msgr2=0x7f5d4c0cd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:48.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.236+0000 7f5d4bfff700 1 -- 172.21.15.71:0/632430465 shutdown_connections 2023-10-09T07:00:48.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.236+0000 7f5d4bfff700 1 -- 172.21.15.71:0/632430465 wait complete. 2023-10-09T07:00:48.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.238+0000 7f5d4bfff700 1 Processor -- start 2023-10-09T07:00:48.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.238+0000 7f5d4bfff700 1 -- start start 2023-10-09T07:00:48.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.239+0000 7f5d4bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d4c0685e0 0x7f5d4c0b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:48.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.239+0000 7f5d4bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d4c0689b0 0x7f5d4c1508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:48.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.239+0000 7f5d4bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d4c15d3f0 0x7f5d4c0cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:48.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.239+0000 7f5d4bfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c0b2be0 con 0x7f5d4c15d3f0 2023-10-09T07:00:48.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.239+0000 7f5d4bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c0c63a0 con 0x7f5d4c0685e0 2023-10-09T07:00:48.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.239+0000 7f5d4bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c0c82c0 con 0x7f5d4c0689b0 2023-10-09T07:00:48.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.239+0000 7f5d4b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d4c15d3f0 0x7f5d4c0cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:48.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.239+0000 7f5d4b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d4c15d3f0 0x7f5d4c0cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45978/0 (socket says 172.21.15.71:45978) 2023-10-09T07:00:48.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.239+0000 7f5d4b7fe700 1 -- 172.21.15.71:0/965101702 learned_addr learned my addr 172.21.15.71:0/965101702 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:00:48.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.239+0000 7f5d4affd700 1 --2- 172.21.15.71:0/965101702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d4c0685e0 0x7f5d4c0b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:48.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.239+0000 7f5d4a7fc700 1 --2- 172.21.15.71:0/965101702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d4c0689b0 0x7f5d4c1508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:48.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.240+0000 7f5d4b7fe700 1 -- 172.21.15.71:0/965101702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d4c0689b0 msgr2=0x7f5d4c1508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:48.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.240+0000 7f5d4b7fe700 1 --2- 172.21.15.71:0/965101702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d4c0689b0 0x7f5d4c1508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:48.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.240+0000 7f5d4b7fe700 1 -- 172.21.15.71:0/965101702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d4c0685e0 msgr2=0x7f5d4c0b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:48.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.240+0000 7f5d4b7fe700 1 --2- 172.21.15.71:0/965101702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d4c0685e0 0x7f5d4c0b1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:48.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.240+0000 7f5d4b7fe700 1 -- 172.21.15.71:0/965101702 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d400093c0 con 0x7f5d4c15d3f0 2023-10-09T07:00:48.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.240+0000 7f5d4b7fe700 1 --2- 172.21.15.71:0/965101702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d4c15d3f0 0x7f5d4c0cd280 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c070fe0 tx=0x7f5d44019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:48.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.240+0000 7f5d32ffd700 1 -- 172.21.15.71:0/965101702 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44012ea0 con 0x7f5d4c15d3f0 2023-10-09T07:00:48.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.240+0000 7f5d32ffd700 1 -- 172.21.15.71:0/965101702 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d44027470 con 0x7f5d4c15d3f0 2023-10-09T07:00:48.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.240+0000 7f5d4bfff700 1 -- 172.21.15.71:0/965101702 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d44009a20 con 0x7f5d4c15d3f0 2023-10-09T07:00:48.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.240+0000 7f5d32ffd700 1 -- 172.21.15.71:0/965101702 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44027850 con 0x7f5d4c15d3f0 2023-10-09T07:00:48.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.240+0000 7f5d4bfff700 1 -- 172.21.15.71:0/965101702 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4c0b2900 con 0x7f5d4c15d3f0 2023-10-09T07:00:48.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.241+0000 7f5d4bfff700 1 -- 172.21.15.71:0/965101702 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d4c06d1e0 con 0x7f5d4c15d3f0 2023-10-09T07:00:48.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.242+0000 7f5d32ffd700 1 -- 172.21.15.71:0/965101702 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 52) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f5d44024070 con 0x7f5d4c15d3f0 2023-10-09T07:00:48.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.243+0000 7f5d32ffd700 1 --2- 172.21.15.71:0/965101702 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5d38066dd0 0x7f5d38069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:00:48.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.243+0000 7f5d32ffd700 1 -- 172.21.15.71:0/965101702 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f5d44086f30 con 0x7f5d4c15d3f0 2023-10-09T07:00:48.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.244+0000 7f5d4affd700 1 --2- 172.21.15.71:0/965101702 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5d38066dd0 0x7f5d38069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:00:48.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.245+0000 7f5d4affd700 1 --2- 172.21.15.71:0/965101702 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5d38066dd0 0x7f5d38069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c007fd0 tx=0x7f5d3c009040 comp rx=0 tx=0).ready entity=mgr.7531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:00:48.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.248+0000 7f5d32ffd700 1 -- 172.21.15.71:0/965101702 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d440541c0 con 0x7f5d4c15d3f0 2023-10-09T07:00:48.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.463+0000 7f5d4bfff700 1 -- 172.21.15.71:0/965101702 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5d4c04c3c0 con 0x7f5d38066dd0 2023-10-09T07:00:48.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.473+0000 7f5d32ffd700 1 -- 172.21.15.71:0/965101702 <== mgr.7531 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7f5d4c04c3c0 con 0x7f5d38066dd0 2023-10-09T07:00:48.474 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:00:48.474 INFO:teuthology.orchestra.run.smithi071.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-10-09T07:00:48.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.475+0000 7f5d4bfff700 1 -- 172.21.15.71:0/965101702 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5d38066dd0 msgr2=0x7f5d38069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:48.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.475+0000 7f5d4bfff700 1 --2- 172.21.15.71:0/965101702 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5d38066dd0 0x7f5d38069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c007fd0 tx=0x7f5d3c009040 comp rx=0 tx=0).stop 2023-10-09T07:00:48.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.475+0000 7f5d4bfff700 1 -- 172.21.15.71:0/965101702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d4c15d3f0 msgr2=0x7f5d4c0cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:00:48.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.475+0000 7f5d4bfff700 1 --2- 172.21.15.71:0/965101702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d4c15d3f0 0x7f5d4c0cd280 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c070fe0 tx=0x7f5d44019000 comp rx=0 tx=0).stop 2023-10-09T07:00:48.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.475+0000 7f5d4bfff700 1 -- 172.21.15.71:0/965101702 shutdown_connections 2023-10-09T07:00:48.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.475+0000 7f5d4bfff700 1 --2- 172.21.15.71:0/965101702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d4c15d3f0 0x7f5d4c0cd280 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:48.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.475+0000 7f5d4bfff700 1 --2- 172.21.15.71:0/965101702 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5d38066dd0 0x7f5d38069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:48.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.475+0000 7f5d4bfff700 1 --2- 172.21.15.71:0/965101702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d4c0685e0 0x7f5d4c0b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:48.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.475+0000 7f5d4bfff700 1 --2- 172.21.15.71:0/965101702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d4c0689b0 0x7f5d4c1508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:00:48.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.475+0000 7f5d4bfff700 1 -- 172.21.15.71:0/965101702 >> 172.21.15.71:0/965101702 conn(0x7f5d4c06b420 msgr2=0x7f5d4c15a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:00:48.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.475+0000 7f5d4bfff700 1 -- 172.21.15.71:0/965101702 shutdown_connections 2023-10-09T07:00:48.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:00:48.475+0000 7f5d4bfff700 1 -- 172.21.15.71:0/965101702 wait complete. 2023-10-09T07:00:48.494 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-10-09T07:00:48.494 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{}]} 2023-10-09T07:00:48.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:00:48.494 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T07:00:48.533 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T07:00:48.533 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T07:00:48.533 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T07:00:49.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:00:49.535 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T07:00:49.578 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T07:00:49.578 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T07:00:49.578 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T07:00:50.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:00:50.580 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T07:00:50.622 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T07:00:50.623 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T07:00:50.623 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T07:00:51.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:00:51.624 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T07:00:51.668 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T07:00:51.668 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T07:00:51.669 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T07:00:52.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:00:52.669 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T07:00:52.712 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T07:00:52.712 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T07:00:52.712 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T07:00:53.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:00:53.713 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T07:00:53.756 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T07:00:53.756 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T07:00:53.756 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T07:00:54.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:00:54.757 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T07:00:54.800 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T07:00:54.800 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T07:00:54.800 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T07:00:55.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:00:55.801 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T07:00:55.844 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T07:00:55.844 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T07:00:55.844 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T07:00:56.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:00:56.845 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T07:00:56.888 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T07:00:56.888 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T07:00:56.888 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T07:00:57.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:00:57.889 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T07:00:57.931 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T07:00:57.931 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T07:00:57.932 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T07:00:58.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:00:58.932 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T07:00:58.975 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T07:00:58.975 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T07:00:58.975 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T07:00:59.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:00:59.976 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T07:01:00.019 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T07:01:00.019 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T07:01:00.019 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T07:01:00.038 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:00.037+0000 7f4ebd9d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:00.038 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:00.037+0000 7f4ebd9d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:00.038 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:00.037+0000 7f4ebd9d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:00.038 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:00.037+0000 7f4ebd9d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:00.038 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:00.037+0000 7f4ebd9d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:01.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:01:01.021 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T07:01:01.061 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_01_00_UTC 2023-10-09T07:01:01.062 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-07_01_00_UTC'} 2023-10-09T07:01:01.062 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-10-09-07_01_00_UTC'} 2023-10-09T07:01:01.062 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T07:01:01.062 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-10-09-07_01_00_UTC'] 2023-10-09T07:01:01.062 DEBUG:tasks.cephfs.test_snap_schedules:exec=1696834848.0469189, now = 1696834861.0628972, timo = 12 2023-10-09T07:01:02.064 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-09T07:01:02.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.261+0000 7fb174d9d700 1 Processor -- start 2023-10-09T07:01:02.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.261+0000 7fb174d9d700 1 -- start start 2023-10-09T07:01:02.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.262+0000 7fb174d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb170156350 0x7fb170157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:02.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.262+0000 7fb174d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb1700b0760 0x7fb1700b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:02.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.262+0000 7fb174d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1700b1110 con 0x7fb170159f20 2023-10-09T07:01:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.262+0000 7fb174d9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1700b0570 con 0x7fb1700b0760 2023-10-09T07:01:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.262+0000 7fb174d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1701578b0 con 0x7fb170156350 2023-10-09T07:01:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.263+0000 7fb16effd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb1700b0760 0x7fb1700b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.263+0000 7fb16effd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb1700b0760 0x7fb1700b0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34944/0 (socket says 172.21.15.71:34944) 2023-10-09T07:01:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.263+0000 7fb16effd700 1 -- 172.21.15.71:0/695124520 learned_addr learned my addr 172.21.15.71:0/695124520 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.263+0000 7fb16f7fe700 1 --2- 172.21.15.71:0/695124520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb170156350 0x7fb170157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.263+0000 7fb16effd700 1 -- 172.21.15.71:0/695124520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb170156350 msgr2=0x7fb170157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.263+0000 7fb16effd700 1 --2- 172.21.15.71:0/695124520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb170156350 0x7fb170157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.263+0000 7fb16effd700 1 -- 172.21.15.71:0/695124520 >> v1:172.21.15.179:6789/0 conn(0x7fb170159f20 legacy=0x7fb17015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.263+0000 7fb16effd700 1 -- 172.21.15.71:0/695124520 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1700af4d0 con 0x7fb1700b0760 2023-10-09T07:01:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.263+0000 7fb16effd700 1 --2- 172.21.15.71:0/695124520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1700b0760 0x7fb1700b0bd0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fb1640099b0 tx=0x7fb164009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef9bfbdb94fbe7dd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.263+0000 7fb16e7fc700 1 -- 172.21.15.71:0/695124520 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb164009ea0 con 0x7fb1700b0760 2023-10-09T07:01:02.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.264+0000 7fb16e7fc700 1 -- 172.21.15.71:0/695124520 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16400b860 con 0x7fb1700b0760 2023-10-09T07:01:02.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.264+0000 7fb16e7fc700 1 -- 172.21.15.71:0/695124520 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16400bc00 con 0x7fb1700b0760 2023-10-09T07:01:02.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.264+0000 7fb174d9d700 1 -- 172.21.15.71:0/695124520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1700b0760 msgr2=0x7fb1700b0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:02.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.264+0000 7fb174d9d700 1 --2- 172.21.15.71:0/695124520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1700b0760 0x7fb1700b0bd0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fb1640099b0 tx=0x7fb164009250 comp rx=0 tx=0).stop 2023-10-09T07:01:02.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.264+0000 7fb174d9d700 1 -- 172.21.15.71:0/695124520 shutdown_connections 2023-10-09T07:01:02.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.264+0000 7fb174d9d700 1 --2- 172.21.15.71:0/695124520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb170156350 0x7fb170157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:02.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.264+0000 7fb174d9d700 1 --2- 172.21.15.71:0/695124520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1700b0760 0x7fb1700b0bd0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:02.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.264+0000 7fb174d9d700 1 -- 172.21.15.71:0/695124520 >> 172.21.15.71:0/695124520 conn(0x7fb170068e20 msgr2=0x7fb1700cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:02.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.264+0000 7fb174d9d700 1 -- 172.21.15.71:0/695124520 shutdown_connections 2023-10-09T07:01:02.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.264+0000 7fb174d9d700 1 -- 172.21.15.71:0/695124520 wait complete. 2023-10-09T07:01:02.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.266+0000 7fb174d9d700 1 Processor -- start 2023-10-09T07:01:02.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.266+0000 7fb174d9d700 1 -- start start 2023-10-09T07:01:02.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.267+0000 7fb174d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1700b0760 0x7fb170154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:02.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.267+0000 7fb174d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb170156350 0x7fb1701477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:02.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.267+0000 7fb174d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb170159f20 0x7fb170147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:02.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.267+0000 7fb174d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb170148230 con 0x7fb1700b0760 2023-10-09T07:01:02.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.267+0000 7fb174d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17016d4b0 con 0x7fb170159f20 2023-10-09T07:01:02.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.267+0000 7fb174d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1700ca570 con 0x7fb170156350 2023-10-09T07:01:02.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.267+0000 7fb16f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1700b0760 0x7fb170154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:02.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.267+0000 7fb16f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1700b0760 0x7fb170154ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34958/0 (socket says 172.21.15.71:34958) 2023-10-09T07:01:02.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.267+0000 7fb16f7fe700 1 -- 172.21.15.71:0/400187039 learned_addr learned my addr 172.21.15.71:0/400187039 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:02.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.267+0000 7fb16ffff700 1 --2- 172.21.15.71:0/400187039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb170159f20 0x7fb170147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:02.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.267+0000 7fb16effd700 1 --2- 172.21.15.71:0/400187039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb170156350 0x7fb1701477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:02.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.267+0000 7fb16f7fe700 1 -- 172.21.15.71:0/400187039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb170156350 msgr2=0x7fb1701477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:02.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.267+0000 7fb16f7fe700 1 --2- 172.21.15.71:0/400187039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb170156350 0x7fb1701477b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:02.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.267+0000 7fb16f7fe700 1 -- 172.21.15.71:0/400187039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb170159f20 msgr2=0x7fb170147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:02.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.267+0000 7fb16f7fe700 1 --2- 172.21.15.71:0/400187039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb170159f20 0x7fb170147cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:02.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.267+0000 7fb16f7fe700 1 -- 172.21.15.71:0/400187039 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1640094f0 con 0x7fb1700b0760 2023-10-09T07:01:02.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.267+0000 7fb16ffff700 1 --2- 172.21.15.71:0/400187039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb170159f20 0x7fb170147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:01:02.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.268+0000 7fb16f7fe700 1 --2- 172.21.15.71:0/400187039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1700b0760 0x7fb170154ed0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fb16000e930 tx=0x7fb1600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:02.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.268+0000 7fb1577fe700 1 -- 172.21.15.71:0/400187039 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16000eed0 con 0x7fb1700b0760 2023-10-09T07:01:02.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.268+0000 7fb1577fe700 1 -- 172.21.15.71:0/400187039 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16000c850 con 0x7fb1700b0760 2023-10-09T07:01:02.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.268+0000 7fb174d9d700 1 -- 172.21.15.71:0/400187039 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17016d700 con 0x7fb1700b0760 2023-10-09T07:01:02.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.268+0000 7fb1577fe700 1 -- 172.21.15.71:0/400187039 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16000cbf0 con 0x7fb1700b0760 2023-10-09T07:01:02.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.268+0000 7fb174d9d700 1 -- 172.21.15.71:0/400187039 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17016dd40 con 0x7fb1700b0760 2023-10-09T07:01:02.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.269+0000 7fb174d9d700 1 -- 172.21.15.71:0/400187039 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17004c3c0 con 0x7fb1700b0760 2023-10-09T07:01:02.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.270+0000 7fb1577fe700 1 -- 172.21.15.71:0/400187039 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 54) v1 ==== 84973+0+0 (secure 0 0 0) 0x7fb160013470 con 0x7fb1700b0760 2023-10-09T07:01:02.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.271+0000 7fb1577fe700 1 --2- 172.21.15.71:0/400187039 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb15c0671c0 0x7fb15c069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:02.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.271+0000 7fb1577fe700 1 -- 172.21.15.71:0/400187039 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fb160084e50 con 0x7fb1700b0760 2023-10-09T07:01:02.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.272+0000 7fb16effd700 1 --2- 172.21.15.71:0/400187039 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb15c0671c0 0x7fb15c069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:02.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.273+0000 7fb16effd700 1 --2- 172.21.15.71:0/400187039 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb15c0671c0 0x7fb15c069670 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb1640099b0 tx=0x7fb164019000 comp rx=0 tx=0).ready entity=mgr.7531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:02.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.276+0000 7fb1577fe700 1 -- 172.21.15.71:0/400187039 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb160051b00 con 0x7fb1700b0760 2023-10-09T07:01:02.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.491+0000 7fb174d9d700 1 -- 172.21.15.71:0/400187039 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1700af7b0 con 0x7fb15c0671c0 2023-10-09T07:01:02.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.567+0000 7fb1577fe700 1 -- 172.21.15.71:0/400187039 <== mgr.7531 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fb1700af7b0 con 0x7fb15c0671c0 2023-10-09T07:01:02.568 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule removed for path snap_test_dir1 2023-10-09T07:01:02.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.570+0000 7fb174d9d700 1 -- 172.21.15.71:0/400187039 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb15c0671c0 msgr2=0x7fb15c069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.570+0000 7fb174d9d700 1 --2- 172.21.15.71:0/400187039 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb15c0671c0 0x7fb15c069670 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb1640099b0 tx=0x7fb164019000 comp rx=0 tx=0).stop 2023-10-09T07:01:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.570+0000 7fb174d9d700 1 -- 172.21.15.71:0/400187039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1700b0760 msgr2=0x7fb170154ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.570+0000 7fb174d9d700 1 --2- 172.21.15.71:0/400187039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1700b0760 0x7fb170154ed0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fb16000e930 tx=0x7fb1600091a0 comp rx=0 tx=0).stop 2023-10-09T07:01:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.570+0000 7fb174d9d700 1 -- 172.21.15.71:0/400187039 shutdown_connections 2023-10-09T07:01:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.570+0000 7fb174d9d700 1 --2- 172.21.15.71:0/400187039 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb15c0671c0 0x7fb15c069670 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.570+0000 7fb174d9d700 1 --2- 172.21.15.71:0/400187039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb170159f20 0x7fb170147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.570+0000 7fb174d9d700 1 --2- 172.21.15.71:0/400187039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1700b0760 0x7fb170154ed0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.570+0000 7fb174d9d700 1 --2- 172.21.15.71:0/400187039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb170156350 0x7fb1701477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.570+0000 7fb174d9d700 1 -- 172.21.15.71:0/400187039 >> 172.21.15.71:0/400187039 conn(0x7fb170068e20 msgr2=0x7fb1700704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.570+0000 7fb174d9d700 1 -- 172.21.15.71:0/400187039 shutdown_connections 2023-10-09T07:01:02.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:02.570+0000 7fb174d9d700 1 -- 172.21.15.71:0/400187039 wait complete. 2023-10-09T07:01:02.588 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-09T07:01:02.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:01:02.588 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T07:01:02.625 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_01_00_UTC 2023-10-09T07:01:02.626 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_01_00_UTC 2023-10-09T07:01:02.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:01:02.627 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_01_00_UTC) 2023-10-09T07:01:02.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:01:02.710 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-09T07:01:02.790 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-09T07:01:03.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.016+0000 7fcc39dff700 1 Processor -- start 2023-10-09T07:01:03.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.016+0000 7fcc39dff700 1 -- start start 2023-10-09T07:01:03.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.017+0000 7fcc39dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcc34155eb0 0x7fcc3406e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:03.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.018+0000 7fcc39dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcc340c70b0 0x7fcc34069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:03.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.018+0000 7fcc39dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc3406eb90 con 0x7fcc34069cb0 2023-10-09T07:01:03.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.018+0000 7fcc39dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc3406a130 con 0x7fcc340c70b0 2023-10-09T07:01:03.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.018+0000 7fcc39dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc3406ee70 con 0x7fcc34155eb0 2023-10-09T07:01:03.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.018+0000 7fcc32ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcc340c70b0 0x7fcc34069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:03.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.018+0000 7fcc32ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcc340c70b0 0x7fcc34069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34968/0 (socket says 172.21.15.71:34968) 2023-10-09T07:01:03.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.018+0000 7fcc32ffd700 1 -- 172.21.15.71:0/3168702971 learned_addr learned my addr 172.21.15.71:0/3168702971 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:03.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.018+0000 7fcc337fe700 1 --2- 172.21.15.71:0/3168702971 >> v2:172.21.15.179:3300/0 conn(0x7fcc34155eb0 0x7fcc3406e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:03.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.018+0000 7fcc32ffd700 1 -- 172.21.15.71:0/3168702971 >> v2:172.21.15.179:3300/0 conn(0x7fcc34155eb0 msgr2=0x7fcc3406e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:03.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.018+0000 7fcc32ffd700 1 --2- 172.21.15.71:0/3168702971 >> v2:172.21.15.179:3300/0 conn(0x7fcc34155eb0 0x7fcc3406e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.018+0000 7fcc32ffd700 1 -- 172.21.15.71:0/3168702971 >> v1:172.21.15.179:6789/0 conn(0x7fcc34069cb0 legacy=0x7fcc34159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.018+0000 7fcc32ffd700 1 -- 172.21.15.71:0/3168702971 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3406f150 con 0x7fcc340c70b0 2023-10-09T07:01:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.018+0000 7fcc32ffd700 1 --2- 172.21.15.71:0/3168702971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc340c70b0 0x7fcc34069770 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fcc34065160 tx=0x7fcc2800a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c296c00565362b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.019+0000 7fcc327fc700 1 -- 172.21.15.71:0/3168702971 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2800ca00 con 0x7fcc340c70b0 2023-10-09T07:01:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.019+0000 7fcc327fc700 1 -- 172.21.15.71:0/3168702971 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2800cb60 con 0x7fcc340c70b0 2023-10-09T07:01:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.019+0000 7fcc327fc700 1 -- 172.21.15.71:0/3168702971 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc280183f0 con 0x7fcc340c70b0 2023-10-09T07:01:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.019+0000 7fcc39dff700 1 -- 172.21.15.71:0/3168702971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc340c70b0 msgr2=0x7fcc34069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.019+0000 7fcc39dff700 1 --2- 172.21.15.71:0/3168702971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc340c70b0 0x7fcc34069770 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fcc34065160 tx=0x7fcc2800a3f0 comp rx=0 tx=0).stop 2023-10-09T07:01:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.019+0000 7fcc39dff700 1 -- 172.21.15.71:0/3168702971 shutdown_connections 2023-10-09T07:01:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.019+0000 7fcc39dff700 1 --2- 172.21.15.71:0/3168702971 >> v2:172.21.15.179:3300/0 conn(0x7fcc34155eb0 0x7fcc3406e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.019+0000 7fcc39dff700 1 --2- 172.21.15.71:0/3168702971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc340c70b0 0x7fcc34069770 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.019+0000 7fcc39dff700 1 -- 172.21.15.71:0/3168702971 >> 172.21.15.71:0/3168702971 conn(0x7fcc34068e10 msgr2=0x7fcc340cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:03.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.019+0000 7fcc39dff700 1 -- 172.21.15.71:0/3168702971 shutdown_connections 2023-10-09T07:01:03.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.019+0000 7fcc39dff700 1 -- 172.21.15.71:0/3168702971 wait complete. 2023-10-09T07:01:03.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.021+0000 7fcc39dff700 1 Processor -- start 2023-10-09T07:01:03.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.021+0000 7fcc39dff700 1 -- start start 2023-10-09T07:01:03.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.022+0000 7fcc39dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc34069cb0 0x7fcc34169b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:03.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.022+0000 7fcc39dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc340c70b0 0x7fcc340c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:03.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.022+0000 7fcc39dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc34155eb0 0x7fcc340c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:03.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.022+0000 7fcc39dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc340aa930 con 0x7fcc340c70b0 2023-10-09T07:01:03.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.022+0000 7fcc39dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3416a0d0 con 0x7fcc34155eb0 2023-10-09T07:01:03.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.022+0000 7fcc39dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc340a9d20 con 0x7fcc34069cb0 2023-10-09T07:01:03.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.022+0000 7fcc32ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc340c70b0 0x7fcc340c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:03.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.022+0000 7fcc32ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc340c70b0 0x7fcc340c61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34980/0 (socket says 172.21.15.71:34980) 2023-10-09T07:01:03.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.022+0000 7fcc32ffd700 1 -- 172.21.15.71:0/2262538898 learned_addr learned my addr 172.21.15.71:0/2262538898 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:03.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.022+0000 7fcc33fff700 1 --2- 172.21.15.71:0/2262538898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc34155eb0 0x7fcc340c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:03.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.022+0000 7fcc337fe700 1 --2- 172.21.15.71:0/2262538898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc34069cb0 0x7fcc34169b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:03.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.023+0000 7fcc32ffd700 1 -- 172.21.15.71:0/2262538898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc34069cb0 msgr2=0x7fcc34169b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:03.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.023+0000 7fcc32ffd700 1 --2- 172.21.15.71:0/2262538898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc34069cb0 0x7fcc34169b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:03.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.023+0000 7fcc32ffd700 1 -- 172.21.15.71:0/2262538898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc34155eb0 msgr2=0x7fcc340c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.023+0000 7fcc32ffd700 1 --2- 172.21.15.71:0/2262538898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc34155eb0 0x7fcc340c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.023+0000 7fcc32ffd700 1 -- 172.21.15.71:0/2262538898 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2800a690 con 0x7fcc340c70b0 2023-10-09T07:01:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.023+0000 7fcc337fe700 1 --2- 172.21.15.71:0/2262538898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc34069cb0 0x7fcc34169b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:01:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.023+0000 7fcc32ffd700 1 --2- 172.21.15.71:0/2262538898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc340c70b0 0x7fcc340c61c0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800a430 tx=0x7fcc28017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.023+0000 7fcc1b7fe700 1 -- 172.21.15.71:0/2262538898 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2801d070 con 0x7fcc340c70b0 2023-10-09T07:01:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.023+0000 7fcc1b7fe700 1 -- 172.21.15.71:0/2262538898 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2800ce50 con 0x7fcc340c70b0 2023-10-09T07:01:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.023+0000 7fcc1b7fe700 1 -- 172.21.15.71:0/2262538898 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc28010830 con 0x7fcc340c70b0 2023-10-09T07:01:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.023+0000 7fcc39dff700 1 -- 172.21.15.71:0/2262538898 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc340aa000 con 0x7fcc340c70b0 2023-10-09T07:01:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.023+0000 7fcc39dff700 1 -- 172.21.15.71:0/2262538898 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc340aa5c0 con 0x7fcc340c70b0 2023-10-09T07:01:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.024+0000 7fcc39dff700 1 -- 172.21.15.71:0/2262538898 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc3404c3c0 con 0x7fcc340c70b0 2023-10-09T07:01:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.025+0000 7fcc1b7fe700 1 -- 172.21.15.71:0/2262538898 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 54) v1 ==== 84973+0+0 (secure 0 0 0) 0x7fcc28010c60 con 0x7fcc340c70b0 2023-10-09T07:01:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.026+0000 7fcc1b7fe700 1 --2- 172.21.15.71:0/2262538898 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcc200671f0 0x7fcc200696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.026+0000 7fcc1b7fe700 1 -- 172.21.15.71:0/2262538898 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fcc280860a0 con 0x7fcc340c70b0 2023-10-09T07:01:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.026+0000 7fcc337fe700 1 --2- 172.21.15.71:0/2262538898 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcc200671f0 0x7fcc200696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.027+0000 7fcc337fe700 1 --2- 172.21.15.71:0/2262538898 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcc200671f0 0x7fcc200696a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcc24006fd0 tx=0x7fcc24008040 comp rx=0 tx=0).ready entity=mgr.7531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:03.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.030+0000 7fcc1b7fe700 1 -- 172.21.15.71:0/2262538898 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc28052c40 con 0x7fcc340c70b0 2023-10-09T07:01:03.151 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:01:03.158 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:01:03.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:03.285+0000 7fcc39dff700 1 -- 172.21.15.71:0/2262538898 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fcc3406f430 con 0x7fcc340c70b0 2023-10-09T07:01:04.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.005+0000 7fcc1b7fe700 1 -- 172.21.15.71:0/2262538898 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 55) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fcc28053010 con 0x7fcc340c70b0 2023-10-09T07:01:04.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.007+0000 7fcc1b7fe700 1 -- 172.21.15.71:0/2262538898 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v55) v1 ==== 93+0+0 (secure 0 0 0) 0x7fcc280566d0 con 0x7fcc340c70b0 2023-10-09T07:01:04.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.009+0000 7fcc39dff700 1 -- 172.21.15.71:0/2262538898 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcc200671f0 msgr2=0x7fcc200696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:04.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.009+0000 7fcc39dff700 1 --2- 172.21.15.71:0/2262538898 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcc200671f0 0x7fcc200696a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcc24006fd0 tx=0x7fcc24008040 comp rx=0 tx=0).stop 2023-10-09T07:01:04.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.009+0000 7fcc39dff700 1 -- 172.21.15.71:0/2262538898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc340c70b0 msgr2=0x7fcc340c61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:04.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.009+0000 7fcc39dff700 1 --2- 172.21.15.71:0/2262538898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc340c70b0 0x7fcc340c61c0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800a430 tx=0x7fcc28017000 comp rx=0 tx=0).stop 2023-10-09T07:01:04.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.009+0000 7fcc39dff700 1 -- 172.21.15.71:0/2262538898 shutdown_connections 2023-10-09T07:01:04.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.009+0000 7fcc39dff700 1 --2- 172.21.15.71:0/2262538898 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcc200671f0 0x7fcc200696a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:04.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.009+0000 7fcc39dff700 1 --2- 172.21.15.71:0/2262538898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc34155eb0 0x7fcc340c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:04.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.009+0000 7fcc39dff700 1 --2- 172.21.15.71:0/2262538898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc34069cb0 0x7fcc34169b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:04.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.009+0000 7fcc39dff700 1 --2- 172.21.15.71:0/2262538898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc340c70b0 0x7fcc340c61c0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:04.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.009+0000 7fcc39dff700 1 -- 172.21.15.71:0/2262538898 >> 172.21.15.71:0/2262538898 conn(0x7fcc34068e10 msgr2=0x7fcc340afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:04.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.010+0000 7fcc39dff700 1 -- 172.21.15.71:0/2262538898 shutdown_connections 2023-10-09T07:01:04.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.010+0000 7fcc39dff700 1 -- 172.21.15.71:0/2262538898 wait complete. 2023-10-09T07:01:04.030 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T07:01:04.030 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T07:01:04.154 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T07:01:04.239 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T07:01:04.239 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T07:01:04.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:01:04.239 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T07:01:04.336 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T07:01:04.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:01:04.336 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T07:01:04.374 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:01:04.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.601+0000 7f2221b9d700 1 Processor -- start 2023-10-09T07:01:04.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.601+0000 7f2221b9d700 1 -- start start 2023-10-09T07:01:04.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.603+0000 7f2221b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f221c159420 0x7f221c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:04.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.603+0000 7f2221b9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f221c15d230 0x7f221c15d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:04.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.603+0000 7f2221b9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f221c0b2980 con 0x7f221c1597f0 2023-10-09T07:01:04.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.603+0000 7f2221b9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f221c15db70 con 0x7f221c15d230 2023-10-09T07:01:04.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.603+0000 7f2221b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f221c0b11d0 con 0x7f221c159420 2023-10-09T07:01:04.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.603+0000 7f222139c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f221c15d230 0x7f221c15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:04.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.603+0000 7f222139c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f221c15d230 0x7f221c15d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34996/0 (socket says 172.21.15.71:34996) 2023-10-09T07:01:04.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.603+0000 7f222139c700 1 -- 172.21.15.71:0/1827463923 learned_addr learned my addr 172.21.15.71:0/1827463923 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:04.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.603+0000 7f2220b9b700 1 --2- 172.21.15.71:0/1827463923 >> v2:172.21.15.179:3300/0 conn(0x7f221c159420 0x7f221c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:04.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.603+0000 7f222139c700 1 -- 172.21.15.71:0/1827463923 >> v2:172.21.15.179:3300/0 conn(0x7f221c159420 msgr2=0x7f221c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:04.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.603+0000 7f222139c700 1 --2- 172.21.15.71:0/1827463923 >> v2:172.21.15.179:3300/0 conn(0x7f221c159420 0x7f221c0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:04.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.603+0000 7f222139c700 1 -- 172.21.15.71:0/1827463923 >> v1:172.21.15.71:6789/0 conn(0x7f221c1597f0 legacy=0x7f221c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:04.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.603+0000 7f222139c700 1 -- 172.21.15.71:0/1827463923 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221c0b14b0 con 0x7f221c15d230 2023-10-09T07:01:04.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.603+0000 7f2220b9b700 1 --2- 172.21.15.71:0/1827463923 >> v2:172.21.15.179:3300/0 conn(0x7f221c159420 0x7f221c0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:01:04.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.604+0000 7f222139c700 1 --2- 172.21.15.71:0/1827463923 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f221c15d230 0x7f221c15d630 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f221c0b2f20 tx=0x7f2214009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f9e39603b4f85c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:04.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.604+0000 7f221b7fe700 1 -- 172.21.15.71:0/1827463923 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221400e070 con 0x7f221c15d230 2023-10-09T07:01:04.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.604+0000 7f221b7fe700 1 -- 172.21.15.71:0/1827463923 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221400ba50 con 0x7f221c15d230 2023-10-09T07:01:04.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.604+0000 7f221b7fe700 1 -- 172.21.15.71:0/1827463923 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22140092e0 con 0x7f221c15d230 2023-10-09T07:01:04.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.605+0000 7f2221b9d700 1 -- 172.21.15.71:0/1827463923 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f221c15d230 msgr2=0x7f221c15d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:04.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.605+0000 7f2221b9d700 1 --2- 172.21.15.71:0/1827463923 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f221c15d230 0x7f221c15d630 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f221c0b2f20 tx=0x7f2214009840 comp rx=0 tx=0).stop 2023-10-09T07:01:04.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.605+0000 7f2221b9d700 1 -- 172.21.15.71:0/1827463923 shutdown_connections 2023-10-09T07:01:04.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.605+0000 7f2221b9d700 1 --2- 172.21.15.71:0/1827463923 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f221c15d230 0x7f221c15d630 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:04.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.605+0000 7f2221b9d700 1 --2- 172.21.15.71:0/1827463923 >> v2:172.21.15.179:3300/0 conn(0x7f221c159420 0x7f221c0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:04.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.605+0000 7f2221b9d700 1 -- 172.21.15.71:0/1827463923 >> 172.21.15.71:0/1827463923 conn(0x7f221c0d0660 msgr2=0x7f221c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:04.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.605+0000 7f2221b9d700 1 -- 172.21.15.71:0/1827463923 shutdown_connections 2023-10-09T07:01:04.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.605+0000 7f2221b9d700 1 -- 172.21.15.71:0/1827463923 wait complete. 2023-10-09T07:01:04.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.606+0000 7f2221b9d700 1 Processor -- start 2023-10-09T07:01:04.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.607+0000 7f2221b9d700 1 -- start start 2023-10-09T07:01:04.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.607+0000 7f2221b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f221c159420 0x7f221c15a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:04.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.607+0000 7f2221b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f221c1597f0 0x7f221c169a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:04.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.608+0000 7f2221b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f221c15d230 0x7f221c169f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:04.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.608+0000 7f2221b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c15b7f0 con 0x7f221c159420 2023-10-09T07:01:04.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.608+0000 7f2221b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c15ac70 con 0x7f221c15d230 2023-10-09T07:01:04.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.608+0000 7f2221b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221c15af50 con 0x7f221c1597f0 2023-10-09T07:01:04.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.608+0000 7f2220b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f221c159420 0x7f221c15a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:04.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.608+0000 7f2220b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f221c159420 0x7f221c15a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35006/0 (socket says 172.21.15.71:35006) 2023-10-09T07:01:04.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.608+0000 7f2220b9b700 1 -- 172.21.15.71:0/3875311328 learned_addr learned my addr 172.21.15.71:0/3875311328 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:04.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.608+0000 7f221bfff700 1 --2- 172.21.15.71:0/3875311328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f221c1597f0 0x7f221c169a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:04.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.608+0000 7f222139c700 1 --2- 172.21.15.71:0/3875311328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f221c15d230 0x7f221c169f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:04.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.608+0000 7f2220b9b700 1 -- 172.21.15.71:0/3875311328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f221c1597f0 msgr2=0x7f221c169a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:04.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.608+0000 7f2220b9b700 1 --2- 172.21.15.71:0/3875311328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f221c1597f0 0x7f221c169a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:04.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.608+0000 7f2220b9b700 1 -- 172.21.15.71:0/3875311328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f221c15d230 msgr2=0x7f221c169f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:04.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.608+0000 7f2220b9b700 1 --2- 172.21.15.71:0/3875311328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f221c15d230 0x7f221c169f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:04.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.608+0000 7f2220b9b700 1 -- 172.21.15.71:0/3875311328 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2214009ae0 con 0x7f221c159420 2023-10-09T07:01:04.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.608+0000 7f222139c700 1 --2- 172.21.15.71:0/3875311328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f221c15d230 0x7f221c169f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:01:04.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.608+0000 7f2220b9b700 1 --2- 172.21.15.71:0/3875311328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f221c159420 0x7f221c15a660 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f221000e8d0 tx=0x7f2210008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:04.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.609+0000 7f2218ff9700 1 -- 172.21.15.71:0/3875311328 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221000ee70 con 0x7f221c159420 2023-10-09T07:01:04.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.609+0000 7f2218ff9700 1 -- 172.21.15.71:0/3875311328 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221000c5e0 con 0x7f221c159420 2023-10-09T07:01:04.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.609+0000 7f2221b9d700 1 -- 172.21.15.71:0/3875311328 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221c15b230 con 0x7f221c159420 2023-10-09T07:01:04.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.609+0000 7f2218ff9700 1 -- 172.21.15.71:0/3875311328 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221000c980 con 0x7f221c159420 2023-10-09T07:01:04.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.609+0000 7f2221b9d700 1 -- 172.21.15.71:0/3875311328 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221c1564b0 con 0x7f221c159420 2023-10-09T07:01:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.610+0000 7f2221b9d700 1 -- 172.21.15.71:0/3875311328 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f221c16ae20 con 0x7f221c159420 2023-10-09T07:01:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.611+0000 7f2218ff9700 1 -- 172.21.15.71:0/3875311328 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 55) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f2210013410 con 0x7f221c159420 2023-10-09T07:01:04.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.612+0000 7f2218ff9700 1 --2- 172.21.15.71:0/3875311328 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2200067170 0x7f2200069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:04.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.612+0000 7f2218ff9700 1 -- 172.21.15.71:0/3875311328 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f2210084cc0 con 0x7f221c159420 2023-10-09T07:01:04.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.612+0000 7f221bfff700 1 -- 172.21.15.71:0/3875311328 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2200067170 msgr2=0x7f2200069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:04.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.612+0000 7f221bfff700 1 --2- 172.21.15.71:0/3875311328 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2200067170 0x7f2200069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:01:04.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.616+0000 7f2218ff9700 1 -- 172.21.15.71:0/3875311328 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2210051900 con 0x7f221c159420 2023-10-09T07:01:04.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.813+0000 7f221bfff700 1 -- 172.21.15.71:0/3875311328 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2200067170 msgr2=0x7f2200069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:04.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.813+0000 7f221bfff700 1 --2- 172.21.15.71:0/3875311328 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2200067170 0x7f2200069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:01:04.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.856+0000 7f2221b9d700 1 -- 172.21.15.71:0/3875311328 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f221c04c3c0 con 0x7f221c159420 2023-10-09T07:01:04.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.857+0000 7f2218ff9700 1 -- 172.21.15.71:0/3875311328 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f2210020090 con 0x7f221c159420 2023-10-09T07:01:04.857 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:01:04.857 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7378,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1918195834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1918195834},{"type":"v1","addr":"172.21.15.179:6834","nonce":1918195834}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7644,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3880476818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3880476818},{"type":"v1","addr":"172.21.15.71:6833","nonce":3880476818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7656,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/4215423233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":4215423233},{"type":"v1","addr":"172.21.15.179:6836","nonce":4215423233}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:00:31.315026+0000","modified":"2023-10-09T07:00:34.863796+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/3141191512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3141191512},{"type":"v1","addr":"172.21.15.71:6835","nonce":3141191512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T07:01:04.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.859+0000 7f2221b9d700 1 -- 172.21.15.71:0/3875311328 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2200067170 msgr2=0x7f2200069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:01:04.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.859+0000 7f2221b9d700 1 --2- 172.21.15.71:0/3875311328 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2200067170 0x7f2200069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:04.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.859+0000 7f2221b9d700 1 -- 172.21.15.71:0/3875311328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f221c159420 msgr2=0x7f221c15a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:04.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.859+0000 7f2221b9d700 1 --2- 172.21.15.71:0/3875311328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f221c159420 0x7f221c15a660 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f221000e8d0 tx=0x7f2210008040 comp rx=0 tx=0).stop 2023-10-09T07:01:04.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.860+0000 7f2221b9d700 1 -- 172.21.15.71:0/3875311328 shutdown_connections 2023-10-09T07:01:04.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.860+0000 7f2221b9d700 1 --2- 172.21.15.71:0/3875311328 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2200067170 0x7f2200069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:04.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.860+0000 7f2221b9d700 1 --2- 172.21.15.71:0/3875311328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f221c15d230 0x7f221c169f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:04.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.860+0000 7f2221b9d700 1 --2- 172.21.15.71:0/3875311328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f221c159420 0x7f221c15a660 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:04.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.860+0000 7f2221b9d700 1 --2- 172.21.15.71:0/3875311328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f221c1597f0 0x7f221c169a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:04.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.860+0000 7f2221b9d700 1 -- 172.21.15.71:0/3875311328 >> 172.21.15.71:0/3875311328 conn(0x7f221c0d0660 msgr2=0x7f221c156a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:04.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.860+0000 7f2221b9d700 1 -- 172.21.15.71:0/3875311328 shutdown_connections 2023-10-09T07:01:04.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:04.860+0000 7f2221b9d700 1 -- 172.21.15.71:0/3875311328 wait complete. 2023-10-09T07:01:04.861 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 58 2023-10-09T07:01:04.878 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:01:05.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.064+0000 7f443bfff700 1 Processor -- start 2023-10-09T07:01:05.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.064+0000 7f443bfff700 1 -- start start 2023-10-09T07:01:05.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.065+0000 7f443bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f443c159420 0x7f443c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:05.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.065+0000 7f443bfff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f443c0b2980 con 0x7f443c1597f0 2023-10-09T07:01:05.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.065+0000 7f443bfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f443c0b11d0 con 0x7f443c15d230 2023-10-09T07:01:05.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.065+0000 7f443bfff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f443c0b14b0 con 0x7f443c159420 2023-10-09T07:01:05.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.066+0000 7f443affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f443c159420 0x7f443c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:05.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.066+0000 7f443affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f443c159420 0x7f443c0b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34884/0 (socket says 172.21.15.71:34884) 2023-10-09T07:01:05.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.066+0000 7f443affd700 1 -- 172.21.15.71:0/1238704083 learned_addr learned my addr 172.21.15.71:0/1238704083 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:05.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.066+0000 7f443affd700 1 -- 172.21.15.71:0/1238704083 >> v1:172.21.15.179:6789/0 conn(0x7f443c15d230 legacy=0x7f443c15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:05.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.066+0000 7f443affd700 1 -- 172.21.15.71:0/1238704083 >> v1:172.21.15.71:6789/0 conn(0x7f443c1597f0 legacy=0x7f443c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:05.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.066+0000 7f443affd700 1 -- 172.21.15.71:0/1238704083 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c0b1790 con 0x7f443c159420 2023-10-09T07:01:05.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.066+0000 7f443affd700 1 --2- 172.21.15.71:0/1238704083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f443c159420 0x7f443c0b5f40 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f442c0099b0 tx=0x7f442c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4bf21108d35fba server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:05.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.067+0000 7f4439ffb700 1 -- 172.21.15.71:0/1238704083 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c00b820 con 0x7f443c159420 2023-10-09T07:01:05.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.067+0000 7f4439ffb700 1 -- 172.21.15.71:0/1238704083 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442c00b980 con 0x7f443c159420 2023-10-09T07:01:05.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.067+0000 7f4439ffb700 1 -- 172.21.15.71:0/1238704083 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c00bd20 con 0x7f443c159420 2023-10-09T07:01:05.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.067+0000 7f443bfff700 1 -- 172.21.15.71:0/1238704083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f443c159420 msgr2=0x7f443c0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:05.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.067+0000 7f443bfff700 1 --2- 172.21.15.71:0/1238704083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f443c159420 0x7f443c0b5f40 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f442c0099b0 tx=0x7f442c009250 comp rx=0 tx=0).stop 2023-10-09T07:01:05.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.067+0000 7f443bfff700 1 -- 172.21.15.71:0/1238704083 shutdown_connections 2023-10-09T07:01:05.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.067+0000 7f443bfff700 1 --2- 172.21.15.71:0/1238704083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f443c159420 0x7f443c0b5f40 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.067+0000 7f443bfff700 1 -- 172.21.15.71:0/1238704083 >> 172.21.15.71:0/1238704083 conn(0x7f443c0d0660 msgr2=0x7f443c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:05.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.068+0000 7f443bfff700 1 -- 172.21.15.71:0/1238704083 shutdown_connections 2023-10-09T07:01:05.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.068+0000 7f443bfff700 1 -- 172.21.15.71:0/1238704083 wait complete. 2023-10-09T07:01:05.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.069+0000 7f443bfff700 1 Processor -- start 2023-10-09T07:01:05.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.069+0000 7f443bfff700 1 -- start start 2023-10-09T07:01:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.070+0000 7f443bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f443c159420 0x7f443c1556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.070+0000 7f443bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f443c1597f0 0x7f443c0caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.070+0000 7f443bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f443c15d230 0x7f443c156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.070+0000 7f443bfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c0c95c0 con 0x7f443c15d230 2023-10-09T07:01:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.070+0000 7f443bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c155be0 con 0x7f443c1597f0 2023-10-09T07:01:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.070+0000 7f443bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443c0c92e0 con 0x7f443c159420 2023-10-09T07:01:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.070+0000 7f443affd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f443c159420 0x7f443c1556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.070+0000 7f443b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f443c15d230 0x7f443c156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.070+0000 7f443affd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f443c159420 0x7f443c1556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:39322/0 (socket says 172.21.15.71:39322) 2023-10-09T07:01:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.070+0000 7f443affd700 1 -- 172.21.15.71:0/3991613016 learned_addr learned my addr 172.21.15.71:0/3991613016 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.070+0000 7f443a7fc700 1 --2- 172.21.15.71:0/3991613016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f443c1597f0 0x7f443c0caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:05.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.071+0000 7f443affd700 1 -- 172.21.15.71:0/3991613016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f443c1597f0 msgr2=0x7f443c0caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:05.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.071+0000 7f443affd700 1 --2- 172.21.15.71:0/3991613016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f443c1597f0 0x7f443c0caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.071+0000 7f443affd700 1 -- 172.21.15.71:0/3991613016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f443c15d230 msgr2=0x7f443c156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:05.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.071+0000 7f443affd700 1 --2- 172.21.15.71:0/3991613016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f443c15d230 0x7f443c156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.071+0000 7f443affd700 1 -- 172.21.15.71:0/3991613016 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442c0094f0 con 0x7f443c159420 2023-10-09T07:01:05.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.071+0000 7f443affd700 1 --2- 172.21.15.71:0/3991613016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f443c159420 0x7f443c1556a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f442c00c010 tx=0x7f442c016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:05.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.071+0000 7f4422ffd700 1 -- 172.21.15.71:0/3991613016 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c011cb0 con 0x7f443c159420 2023-10-09T07:01:05.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.071+0000 7f4422ffd700 1 -- 172.21.15.71:0/3991613016 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442c020070 con 0x7f443c159420 2023-10-09T07:01:05.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.071+0000 7f443bfff700 1 -- 172.21.15.71:0/3991613016 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f443c0c6230 con 0x7f443c159420 2023-10-09T07:01:05.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.071+0000 7f4422ffd700 1 -- 172.21.15.71:0/3991613016 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c01b6a0 con 0x7f443c159420 2023-10-09T07:01:05.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.072+0000 7f443bfff700 1 -- 172.21.15.71:0/3991613016 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443c0c67f0 con 0x7f443c159420 2023-10-09T07:01:05.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.073+0000 7f443bfff700 1 -- 172.21.15.71:0/3991613016 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f443c0b65a0 con 0x7f443c159420 2023-10-09T07:01:05.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.074+0000 7f4422ffd700 1 -- 172.21.15.71:0/3991613016 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 55) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f442c022030 con 0x7f443c159420 2023-10-09T07:01:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.074+0000 7f4422ffd700 1 --2- 172.21.15.71:0/3991613016 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4428067170 0x7f4428069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.074+0000 7f4422ffd700 1 -- 172.21.15.71:0/3991613016 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f442c086a00 con 0x7f443c159420 2023-10-09T07:01:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.075+0000 7f443a7fc700 1 -- 172.21.15.71:0/3991613016 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4428067170 msgr2=0x7f4428069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.075+0000 7f443a7fc700 1 --2- 172.21.15.71:0/3991613016 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4428067170 0x7f4428069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:01:05.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.079+0000 7f4422ffd700 1 -- 172.21.15.71:0/3991613016 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f442c0536b0 con 0x7f443c159420 2023-10-09T07:01:05.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.276+0000 7f443a7fc700 1 -- 172.21.15.71:0/3991613016 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4428067170 msgr2=0x7f4428069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:05.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.276+0000 7f443a7fc700 1 --2- 172.21.15.71:0/3991613016 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4428067170 0x7f4428069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:01:05.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.279+0000 7f443bfff700 1 -- 172.21.15.71:0/3991613016 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f443c0b65a0 con 0x7f443c159420 2023-10-09T07:01:05.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.280+0000 7f4422ffd700 1 -- 172.21.15.71:0/3991613016 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+16331 (secure 0 0 0) 0x7f442c056cd0 con 0x7f443c159420 2023-10-09T07:01:05.280 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:01:05.280 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":124,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:00:46.934432+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:00:28.965075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T07:00:30.294796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:0/3535588607":"2023-10-10T07:00:46.934396+0000","172.21.15.179:6837/85452":"2023-10-10T07:00:46.934396+0000","172.21.15.179:6835/85452":"2023-10-10T07:00:46.934396+0000","172.21.15.179:0/1997380181":"2023-10-10T07:00:46.934396+0000","172.21.15.179:0/3456675137":"2023-10-10T07:00:46.934396+0000","172.21.15.179:0/1765057334":"2023-10-10T07:00:46.934396+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:01:05.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.282+0000 7f443bfff700 1 -- 172.21.15.71:0/3991613016 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4428067170 msgr2=0x7f4428069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:01:05.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.282+0000 7f443bfff700 1 --2- 172.21.15.71:0/3991613016 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4428067170 0x7f4428069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.282+0000 7f443bfff700 1 -- 172.21.15.71:0/3991613016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f443c159420 msgr2=0x7f443c1556a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:05.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.282+0000 7f443bfff700 1 --2- 172.21.15.71:0/3991613016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f443c159420 0x7f443c1556a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f442c00c010 tx=0x7f442c016000 comp rx=0 tx=0).stop 2023-10-09T07:01:05.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.282+0000 7f443bfff700 1 -- 172.21.15.71:0/3991613016 shutdown_connections 2023-10-09T07:01:05.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.282+0000 7f443bfff700 1 --2- 172.21.15.71:0/3991613016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f443c15d230 0x7f443c156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.282+0000 7f443bfff700 1 --2- 172.21.15.71:0/3991613016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f443c159420 0x7f443c1556a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.282+0000 7f443bfff700 1 --2- 172.21.15.71:0/3991613016 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4428067170 0x7f4428069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.282+0000 7f443bfff700 1 --2- 172.21.15.71:0/3991613016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f443c1597f0 0x7f443c0caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.282+0000 7f443bfff700 1 -- 172.21.15.71:0/3991613016 >> 172.21.15.71:0/3991613016 conn(0x7f443c0d0660 msgr2=0x7f443c0cfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:05.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.282+0000 7f443bfff700 1 -- 172.21.15.71:0/3991613016 shutdown_connections 2023-10-09T07:01:05.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.283+0000 7f443bfff700 1 -- 172.21.15.71:0/3991613016 wait complete. 2023-10-09T07:01:05.287 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:05.286+0000 7f1979ff8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T07:01:05.301 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T07:00:28.965075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T07:00:30.294796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T07:01:05.302 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T07:01:05.334 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:05.334+0000 7f6c9b721180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T07:01:05.448 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:05.448+0000 7f1979ff8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T07:01:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.492+0000 7f92fed9d700 1 Processor -- start 2023-10-09T07:01:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.492+0000 7f92fed9d700 1 -- start start 2023-10-09T07:01:05.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.493+0000 7f92fed9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f92f80b4e70 0x7f92f80ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:05.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.493+0000 7f92fed9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92f80b16d0 0x7f92f80b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:05.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.493+0000 7f92fed9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92f80b2080 con 0x7f92f815d240 2023-10-09T07:01:05.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.493+0000 7f92fed9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92f80cfb00 con 0x7f92f80b4e70 2023-10-09T07:01:05.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.493+0000 7f92fed9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f80b5c40 con 0x7f92f80b16d0 2023-10-09T07:01:05.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.493+0000 7f92fdd9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f92f80b4e70 0x7f92f80ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:05.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.493+0000 7f92fdd9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f92f80b4e70 0x7f92f80ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34904/0 (socket says 172.21.15.71:34904) 2023-10-09T07:01:05.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.493+0000 7f92fdd9b700 1 -- 172.21.15.71:0/3752893284 learned_addr learned my addr 172.21.15.71:0/3752893284 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:05.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.493+0000 7f92fd59a700 1 --2- 172.21.15.71:0/3752893284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92f80b16d0 0x7f92f80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:05.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.494+0000 7f92fcd99700 1 -- 172.21.15.71:0/3752893284 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4101573500 0 0) 0x7f92f80b2080 con 0x7f92f815d240 2023-10-09T07:01:05.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.494+0000 7f92fcd99700 1 -- 172.21.15.71:0/3752893284 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92e4003570 con 0x7f92f815d240 2023-10-09T07:01:05.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.494+0000 7f92fd59a700 1 -- 172.21.15.71:0/3752893284 >> v2:172.21.15.71:3300/0 conn(0x7f92f80b4e70 msgr2=0x7f92f80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:05.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.494+0000 7f92fd59a700 1 --2- 172.21.15.71:0/3752893284 >> v2:172.21.15.71:3300/0 conn(0x7f92f80b4e70 0x7f92f80ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.494+0000 7f92fd59a700 1 -- 172.21.15.71:0/3752893284 >> v1:172.21.15.179:6789/0 conn(0x7f92f815d240 legacy=0x7f92f815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:05.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.494+0000 7f92fd59a700 1 -- 172.21.15.71:0/3752893284 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f80b5f20 con 0x7f92f80b16d0 2023-10-09T07:01:05.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.494+0000 7f92fdd9b700 1 --2- 172.21.15.71:0/3752893284 >> v2:172.21.15.71:3300/0 conn(0x7f92f80b4e70 0x7f92f80ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:01:05.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.494+0000 7f92fd59a700 1 --2- 172.21.15.71:0/3752893284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92f80b16d0 0x7f92f80b1b40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f92e80098e0 tx=0x7f92e80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f146fefb131f5f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:05.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.494+0000 7f92fcd99700 1 -- 172.21.15.71:0/3752893284 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e8011630 con 0x7f92f80b16d0 2023-10-09T07:01:05.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.495+0000 7f92fcd99700 1 -- 172.21.15.71:0/3752893284 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e8011790 con 0x7f92f80b16d0 2023-10-09T07:01:05.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.495+0000 7f92fcd99700 1 -- 172.21.15.71:0/3752893284 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e8011b30 con 0x7f92f80b16d0 2023-10-09T07:01:05.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.495+0000 7f92fed9d700 1 -- 172.21.15.71:0/3752893284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92f80b16d0 msgr2=0x7f92f80b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:05.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.495+0000 7f92fed9d700 1 --2- 172.21.15.71:0/3752893284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92f80b16d0 0x7f92f80b1b40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f92e80098e0 tx=0x7f92e80091a0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.495+0000 7f92fed9d700 1 -- 172.21.15.71:0/3752893284 shutdown_connections 2023-10-09T07:01:05.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.495+0000 7f92fed9d700 1 --2- 172.21.15.71:0/3752893284 >> v2:172.21.15.71:3300/0 conn(0x7f92f80b4e70 0x7f92f80ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.495+0000 7f92fed9d700 1 --2- 172.21.15.71:0/3752893284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92f80b16d0 0x7f92f80b1b40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.495+0000 7f92fed9d700 1 -- 172.21.15.71:0/3752893284 >> 172.21.15.71:0/3752893284 conn(0x7f92f80d10c0 msgr2=0x7f92f80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:05.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.495+0000 7f92fed9d700 1 -- 172.21.15.71:0/3752893284 shutdown_connections 2023-10-09T07:01:05.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.495+0000 7f92fed9d700 1 -- 172.21.15.71:0/3752893284 wait complete. 2023-10-09T07:01:05.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.497+0000 7f92fed9d700 1 Processor -- start 2023-10-09T07:01:05.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.497+0000 7f92fed9d700 1 -- start start 2023-10-09T07:01:05.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.498+0000 7f92fed9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92f80b16d0 0x7f92f8150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:05.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.498+0000 7f92fed9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92f80b4e70 0x7f92f80c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:05.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.498+0000 7f92fed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92f815d240 0x7f92f80c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:05.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.498+0000 7f92fed9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f80c6ae0 con 0x7f92f815d240 2023-10-09T07:01:05.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.498+0000 7f92fed9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f80c5ed0 con 0x7f92f80b16d0 2023-10-09T07:01:05.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.498+0000 7f92fed9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f80c61b0 con 0x7f92f80b4e70 2023-10-09T07:01:05.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.498+0000 7f92fe59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92f815d240 0x7f92f80c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:05.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.498+0000 7f92fe59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92f815d240 0x7f92f80c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34912/0 (socket says 172.21.15.71:34912) 2023-10-09T07:01:05.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.498+0000 7f92fd59a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92f80b4e70 0x7f92f80c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:05.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.498+0000 7f92fe59c700 1 -- 172.21.15.71:0/1473853469 learned_addr learned my addr 172.21.15.71:0/1473853469 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:05.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.498+0000 7f92fdd9b700 1 --2- 172.21.15.71:0/1473853469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92f80b16d0 0x7f92f8150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:05.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.498+0000 7f92fe59c700 1 -- 172.21.15.71:0/1473853469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92f80b4e70 msgr2=0x7f92f80c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:05.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.498+0000 7f92fe59c700 1 --2- 172.21.15.71:0/1473853469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92f80b4e70 0x7f92f80c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.498+0000 7f92fe59c700 1 -- 172.21.15.71:0/1473853469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92f80b16d0 msgr2=0x7f92f8150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:05.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.498+0000 7f92fe59c700 1 --2- 172.21.15.71:0/1473853469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92f80b16d0 0x7f92f8150540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.498+0000 7f92fe59c700 1 -- 172.21.15.71:0/1473853469 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f40094f0 con 0x7f92f815d240 2023-10-09T07:01:05.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.498+0000 7f92fd59a700 1 --2- 172.21.15.71:0/1473853469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92f80b4e70 0x7f92f80c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:01:05.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.499+0000 7f92fe59c700 1 --2- 172.21.15.71:0/1473853469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92f815d240 0x7f92f80c7b90 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f92f000c860 tx=0x7f92f0002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:05.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.499+0000 7f92edffb700 1 -- 172.21.15.71:0/1473853469 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f0002030 con 0x7f92f815d240 2023-10-09T07:01:05.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.499+0000 7f92edffb700 1 -- 172.21.15.71:0/1473853469 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f00021b0 con 0x7f92f815d240 2023-10-09T07:01:05.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.499+0000 7f92fed9d700 1 -- 172.21.15.71:0/1473853469 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e8009420 con 0x7f92f815d240 2023-10-09T07:01:05.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.499+0000 7f92edffb700 1 -- 172.21.15.71:0/1473853469 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f0012630 con 0x7f92f815d240 2023-10-09T07:01:05.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.499+0000 7f92fed9d700 1 -- 172.21.15.71:0/1473853469 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f80c6770 con 0x7f92f815d240 2023-10-09T07:01:05.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.500+0000 7f92fed9d700 1 -- 172.21.15.71:0/1473853469 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f80c6c50 con 0x7f92f815d240 2023-10-09T07:01:05.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.502+0000 7f92edffb700 1 -- 172.21.15.71:0/1473853469 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 55) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f92f0012a20 con 0x7f92f815d240 2023-10-09T07:01:05.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.503+0000 7f92edffb700 1 --2- 172.21.15.71:0/1473853469 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f92dc067170 0x7f92dc069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:05.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.503+0000 7f92edffb700 1 -- 172.21.15.71:0/1473853469 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f92f0084b00 con 0x7f92f815d240 2023-10-09T07:01:05.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.503+0000 7f92fdd9b700 1 -- 172.21.15.71:0/1473853469 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f92dc067170 msgr2=0x7f92dc069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:05.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.503+0000 7f92fdd9b700 1 --2- 172.21.15.71:0/1473853469 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f92dc067170 0x7f92dc069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:01:05.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.507+0000 7f92edffb700 1 -- 172.21.15.71:0/1473853469 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92f0051780 con 0x7f92f815d240 2023-10-09T07:01:05.508 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:05.508+0000 7f6c9b721180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T07:01:05.535 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:05.534+0000 7f1979ff8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T07:01:05.598 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:05.598+0000 7f6c9b721180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T07:01:05.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.704+0000 7f92fdd9b700 1 -- 172.21.15.71:0/1473853469 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f92dc067170 msgr2=0x7f92dc069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:05.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.704+0000 7f92fdd9b700 1 --2- 172.21.15.71:0/1473853469 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f92dc067170 0x7f92dc069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:01:05.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.706+0000 7f92fed9d700 1 -- 172.21.15.71:0/1473853469 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92f80c6e70 con 0x7f92f815d240 2023-10-09T07:01:05.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.707+0000 7f92edffb700 1 -- 172.21.15.71:0/1473853469 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v124) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92f0054da0 con 0x7f92f815d240 2023-10-09T07:01:05.707 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T07:01:05.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.709+0000 7f92fed9d700 1 -- 172.21.15.71:0/1473853469 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f92dc067170 msgr2=0x7f92dc069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:01:05.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.709+0000 7f92fed9d700 1 --2- 172.21.15.71:0/1473853469 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f92dc067170 0x7f92dc069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.709+0000 7f92fed9d700 1 -- 172.21.15.71:0/1473853469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92f815d240 msgr2=0x7f92f80c7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:05.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.709+0000 7f92fed9d700 1 --2- 172.21.15.71:0/1473853469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92f815d240 0x7f92f80c7b90 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f92f000c860 tx=0x7f92f0002700 comp rx=0 tx=0).stop 2023-10-09T07:01:05.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.709+0000 7f92fed9d700 1 -- 172.21.15.71:0/1473853469 shutdown_connections 2023-10-09T07:01:05.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.709+0000 7f92fed9d700 1 --2- 172.21.15.71:0/1473853469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92f815d240 0x7f92f80c7b90 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.709+0000 7f92fed9d700 1 --2- 172.21.15.71:0/1473853469 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f92dc067170 0x7f92dc069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.709+0000 7f92fed9d700 1 --2- 172.21.15.71:0/1473853469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92f80b16d0 0x7f92f8150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.709+0000 7f92fed9d700 1 --2- 172.21.15.71:0/1473853469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92f80b4e70 0x7f92f80c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.709+0000 7f92fed9d700 1 -- 172.21.15.71:0/1473853469 >> 172.21.15.71:0/1473853469 conn(0x7f92f80d10c0 msgr2=0x7f92f80cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:05.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.709+0000 7f92fed9d700 1 -- 172.21.15.71:0/1473853469 shutdown_connections 2023-10-09T07:01:05.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.709+0000 7f92fed9d700 1 -- 172.21.15.71:0/1473853469 wait complete. 2023-10-09T07:01:05.727 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T07:01:05.757 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:05.757+0000 7f1979ff8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:01:05.831 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:05.831+0000 7f6c9b721180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:01:05.934 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:05.934+0000 7f1979ff8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T07:01:05.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.956+0000 7f3eeaf9d700 1 Processor -- start 2023-10-09T07:01:05.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.956+0000 7f3eeaf9d700 1 -- start start 2023-10-09T07:01:05.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.958+0000 7f3eeaf9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3ee40ccc00 0x7f3ee4069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:05.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.958+0000 7f3eeaf9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ee406a020 0x7f3ee40cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:05.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.958+0000 7f3eeaf9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee40c9f30 con 0x7f3ee4159a60 2023-10-09T07:01:05.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.958+0000 7f3eeaf9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee406dfc0 con 0x7f3ee40ccc00 2023-10-09T07:01:05.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.958+0000 7f3eeaf9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40ca470 con 0x7f3ee406a020 2023-10-09T07:01:05.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.958+0000 7f3ee979a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3ee40ccc00 0x7f3ee4069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:05.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.958+0000 7f3eea79c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ee406a020 0x7f3ee40cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:05.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.958+0000 7f3ee9f9b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f3ee4159a60 0x7f3ee40c9770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:53222/0 (socket says 172.21.15.71:53222) 2023-10-09T07:01:05.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.958+0000 7f3ee9f9b700 1 -- 172.21.15.71:0/4069319230 learned_addr learned my addr 172.21.15.71:0/4069319230 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:01:05.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.958+0000 7f3ee8f99700 1 -- 172.21.15.71:0/4069319230 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1746514826 0 0) 0x7f3ee40c9f30 con 0x7f3ee4159a60 2023-10-09T07:01:05.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.958+0000 7f3ee8f99700 1 -- 172.21.15.71:0/4069319230 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ed0003570 con 0x7f3ee4159a60 2023-10-09T07:01:05.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.958+0000 7f3ee979a700 1 -- 172.21.15.71:0/4069319230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ee406a020 msgr2=0x7f3ee40cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:05.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.959+0000 7f3ee979a700 1 --2- 172.21.15.71:0/4069319230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ee406a020 0x7f3ee40cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.959+0000 7f3ee979a700 1 -- 172.21.15.71:0/4069319230 >> v1:172.21.15.179:6789/0 conn(0x7f3ee4159a60 legacy=0x7f3ee40c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:05.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.959+0000 7f3ee979a700 1 -- 172.21.15.71:0/4069319230 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee40ca750 con 0x7f3ee40ccc00 2023-10-09T07:01:05.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.959+0000 7f3eea79c700 1 --2- 172.21.15.71:0/4069319230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ee406a020 0x7f3ee40cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:01:05.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.959+0000 7f3ee979a700 1 --2- 172.21.15.71:0/4069319230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ee40ccc00 0x7f3ee4069ae0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40098e0 tx=0x7f3ed40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=624288777312046e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:05.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.959+0000 7f3ee8f99700 1 -- 172.21.15.71:0/4069319230 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4011630 con 0x7f3ee40ccc00 2023-10-09T07:01:05.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.959+0000 7f3ee8f99700 1 -- 172.21.15.71:0/4069319230 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed4011790 con 0x7f3ee40ccc00 2023-10-09T07:01:05.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.959+0000 7f3ee8f99700 1 -- 172.21.15.71:0/4069319230 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4011b30 con 0x7f3ee40ccc00 2023-10-09T07:01:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.960+0000 7f3eeaf9d700 1 -- 172.21.15.71:0/4069319230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ee40ccc00 msgr2=0x7f3ee4069ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.960+0000 7f3eeaf9d700 1 --2- 172.21.15.71:0/4069319230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ee40ccc00 0x7f3ee4069ae0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40098e0 tx=0x7f3ed40091a0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.960+0000 7f3eeaf9d700 1 -- 172.21.15.71:0/4069319230 shutdown_connections 2023-10-09T07:01:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.960+0000 7f3eeaf9d700 1 --2- 172.21.15.71:0/4069319230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ee406a020 0x7f3ee40cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.960+0000 7f3eeaf9d700 1 --2- 172.21.15.71:0/4069319230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ee40ccc00 0x7f3ee4069ae0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.960+0000 7f3eeaf9d700 1 -- 172.21.15.71:0/4069319230 >> 172.21.15.71:0/4069319230 conn(0x7f3ee406baa0 msgr2=0x7f3ee406bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.960+0000 7f3eeaf9d700 1 -- 172.21.15.71:0/4069319230 shutdown_connections 2023-10-09T07:01:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.960+0000 7f3eeaf9d700 1 -- 172.21.15.71:0/4069319230 wait complete. 2023-10-09T07:01:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.961+0000 7f3eeaf9d700 1 Processor -- start 2023-10-09T07:01:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.961+0000 7f3eeaf9d700 1 -- start start 2023-10-09T07:01:05.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.962+0000 7f3eeaf9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ee406a020 0x7f3ee416a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:05.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.962+0000 7f3eeaf9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ee40ccc00 0x7f3ee414f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:05.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.962+0000 7f3eeaf9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ee4159a60 0x7f3ee4151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:05.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.962+0000 7f3eeaf9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee414f8c0 con 0x7f3ee4159a60 2023-10-09T07:01:05.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.962+0000 7f3eeaf9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee416af00 con 0x7f3ee40ccc00 2023-10-09T07:01:05.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.962+0000 7f3eeaf9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee4150d50 con 0x7f3ee406a020 2023-10-09T07:01:05.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.963+0000 7f3ee9f9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ee406a020 0x7f3ee416a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:05.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.963+0000 7f3ee979a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ee40ccc00 0x7f3ee414f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:05.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.963+0000 7f3eea79c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ee4159a60 0x7f3ee4151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:05.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.963+0000 7f3ee9f9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ee406a020 0x7f3ee416a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:39356/0 (socket says 172.21.15.71:39356) 2023-10-09T07:01:05.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.963+0000 7f3ee979a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ee40ccc00 0x7f3ee414f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:38976/0 (socket says 172.21.15.71:38976) 2023-10-09T07:01:05.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.963+0000 7f3ee9f9b700 1 -- 172.21.15.71:0/1785269002 learned_addr learned my addr 172.21.15.71:0/1785269002 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:05.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.963+0000 7f3ee9f9b700 1 -- 172.21.15.71:0/1785269002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ee40ccc00 msgr2=0x7f3ee414f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:05.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.963+0000 7f3ee9f9b700 1 --2- 172.21.15.71:0/1785269002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ee40ccc00 0x7f3ee414f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.963+0000 7f3ee9f9b700 1 -- 172.21.15.71:0/1785269002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ee4159a60 msgr2=0x7f3ee4151db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:05.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.963+0000 7f3ee9f9b700 1 --2- 172.21.15.71:0/1785269002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ee4159a60 0x7f3ee4151db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:05.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.963+0000 7f3ee9f9b700 1 -- 172.21.15.71:0/1785269002 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc009a20 con 0x7f3ee406a020 2023-10-09T07:01:05.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.963+0000 7f3ee9f9b700 1 --2- 172.21.15.71:0/1785269002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ee406a020 0x7f3ee416a9c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000c5c0 tx=0x7f3ee0007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:05.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.964+0000 7f3ed9ffb700 1 -- 172.21.15.71:0/1785269002 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0005b30 con 0x7f3ee406a020 2023-10-09T07:01:05.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.964+0000 7f3ed9ffb700 1 -- 172.21.15.71:0/1785269002 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee0005cb0 con 0x7f3ee406a020 2023-10-09T07:01:05.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.964+0000 7f3ed9ffb700 1 -- 172.21.15.71:0/1785269002 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0007320 con 0x7f3ee406a020 2023-10-09T07:01:05.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.964+0000 7f3eeaf9d700 1 -- 172.21.15.71:0/1785269002 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed4009420 con 0x7f3ee406a020 2023-10-09T07:01:05.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.964+0000 7f3eeaf9d700 1 -- 172.21.15.71:0/1785269002 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee4151350 con 0x7f3ee406a020 2023-10-09T07:01:05.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.965+0000 7f3eeaf9d700 1 -- 172.21.15.71:0/1785269002 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee406eba0 con 0x7f3ee406a020 2023-10-09T07:01:05.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.966+0000 7f3ed9ffb700 1 -- 172.21.15.71:0/1785269002 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 55) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f3ee001b3b0 con 0x7f3ee406a020 2023-10-09T07:01:05.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.967+0000 7f3ed9ffb700 1 --2- 172.21.15.71:0/1785269002 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3ec8067170 0x7f3ec8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:05.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.967+0000 7f3ed9ffb700 1 -- 172.21.15.71:0/1785269002 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f3ee00840c0 con 0x7f3ee406a020 2023-10-09T07:01:05.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.967+0000 7f3ee979a700 1 -- 172.21.15.71:0/1785269002 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3ec8067170 msgr2=0x7f3ec8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:05.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.967+0000 7f3ee979a700 1 --2- 172.21.15.71:0/1785269002 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3ec8067170 0x7f3ec8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:01:05.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:05.970+0000 7f3ed9ffb700 1 -- 172.21.15.71:0/1785269002 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ee0050d60 con 0x7f3ee406a020 2023-10-09T07:01:06.018 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:06.018+0000 7f6c9b721180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T07:01:06.032 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:06.031+0000 7f1979ff8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T07:01:06.115 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:06.115+0000 7f6c9b721180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T07:01:06.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.168+0000 7f3ee979a700 1 -- 172.21.15.71:0/1785269002 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3ec8067170 msgr2=0x7f3ec8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:06.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.168+0000 7f3ee979a700 1 --2- 172.21.15.71:0/1785269002 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3ec8067170 0x7f3ec8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:01:06.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.172+0000 7f3eeaf9d700 1 -- 172.21.15.71:0/1785269002 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3ee40cc1f0 con 0x7f3ee406a020 2023-10-09T07:01:06.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.173+0000 7f3ed9ffb700 1 -- 172.21.15.71:0/1785269002 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v125) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3ee0017020 con 0x7f3ee406a020 2023-10-09T07:01:06.173 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-09T07:01:06.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.176+0000 7f3eeaf9d700 1 -- 172.21.15.71:0/1785269002 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3ec8067170 msgr2=0x7f3ec8069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:01:06.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.176+0000 7f3eeaf9d700 1 --2- 172.21.15.71:0/1785269002 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3ec8067170 0x7f3ec8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:06.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.176+0000 7f3eeaf9d700 1 -- 172.21.15.71:0/1785269002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ee406a020 msgr2=0x7f3ee416a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:06.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.176+0000 7f3eeaf9d700 1 --2- 172.21.15.71:0/1785269002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ee406a020 0x7f3ee416a9c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000c5c0 tx=0x7f3ee0007e00 comp rx=0 tx=0).stop 2023-10-09T07:01:06.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.176+0000 7f3eeaf9d700 1 -- 172.21.15.71:0/1785269002 shutdown_connections 2023-10-09T07:01:06.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.176+0000 7f3eeaf9d700 1 --2- 172.21.15.71:0/1785269002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ee4159a60 0x7f3ee4151db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:06.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.176+0000 7f3eeaf9d700 1 --2- 172.21.15.71:0/1785269002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ee406a020 0x7f3ee416a9c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:06.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.176+0000 7f3eeaf9d700 1 --2- 172.21.15.71:0/1785269002 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3ec8067170 0x7f3ec8069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:06.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.176+0000 7f3eeaf9d700 1 --2- 172.21.15.71:0/1785269002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ee40ccc00 0x7f3ee414f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:06.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.176+0000 7f3eeaf9d700 1 -- 172.21.15.71:0/1785269002 >> 172.21.15.71:0/1785269002 conn(0x7f3ee406baa0 msgr2=0x7f3ee406ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:06.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.176+0000 7f3eeaf9d700 1 -- 172.21.15.71:0/1785269002 shutdown_connections 2023-10-09T07:01:06.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.176+0000 7f3eeaf9d700 1 -- 172.21.15.71:0/1785269002 wait complete. 2023-10-09T07:01:06.193 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:06.193+0000 7f1979ff8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T07:01:06.194 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T07:01:06.284 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:06.284+0000 7f6c9b721180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T07:01:06.292 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:06.291+0000 7f1979ff8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T07:01:06.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.385+0000 7f984f39d700 1 Processor -- start 2023-10-09T07:01:06.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.385+0000 7f984f39d700 1 -- start start 2023-10-09T07:01:06.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.387+0000 7f984f39d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9848159a60 0x7f98480c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:06.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.387+0000 7f984f39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98480ccc00 0x7f9848069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:06.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.387+0000 7f984f39d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f984806a020 0x7f98480cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:06.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.387+0000 7f984f39d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984806dfc0 con 0x7f984806a020 2023-10-09T07:01:06.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.387+0000 7f984f39d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98480c9cb0 con 0x7f9848159a60 2023-10-09T07:01:06.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.387+0000 7f984f39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98480c9f30 con 0x7f98480ccc00 2023-10-09T07:01:06.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.387+0000 7f984eb9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f984806a020 0x7f98480cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:06.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.387+0000 7f984eb9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f984806a020 0x7f98480cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34922/0 (socket says 172.21.15.71:34922) 2023-10-09T07:01:06.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.387+0000 7f984eb9c700 1 -- 172.21.15.71:0/2748608022 learned_addr learned my addr 172.21.15.71:0/2748608022 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:06.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.387+0000 7f984e39b700 1 --2- 172.21.15.71:0/2748608022 >> v2:172.21.15.179:3300/0 conn(0x7f9848159a60 0x7f98480c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:06.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.387+0000 7f984db9a700 1 --2- 172.21.15.71:0/2748608022 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98480ccc00 0x7f9848069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:06.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.388+0000 7f984eb9c700 1 -- 172.21.15.71:0/2748608022 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98480ccc00 msgr2=0x7f9848069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:06.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.388+0000 7f984eb9c700 1 --2- 172.21.15.71:0/2748608022 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98480ccc00 0x7f9848069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:06.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.388+0000 7f984eb9c700 1 -- 172.21.15.71:0/2748608022 >> v2:172.21.15.179:3300/0 conn(0x7f9848159a60 msgr2=0x7f98480c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:06.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.388+0000 7f984eb9c700 1 --2- 172.21.15.71:0/2748608022 >> v2:172.21.15.179:3300/0 conn(0x7f9848159a60 0x7f98480c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:06.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.388+0000 7f984eb9c700 1 -- 172.21.15.71:0/2748608022 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98480ca470 con 0x7f984806a020 2023-10-09T07:01:06.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.388+0000 7f984e39b700 1 --2- 172.21.15.71:0/2748608022 >> v2:172.21.15.179:3300/0 conn(0x7f9848159a60 0x7f98480c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:01:06.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.388+0000 7f984db9a700 1 --2- 172.21.15.71:0/2748608022 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98480ccc00 0x7f9848069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:01:06.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.388+0000 7f984eb9c700 1 --2- 172.21.15.71:0/2748608022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f984806a020 0x7f98480cb230 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f984806e510 tx=0x7f9840009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5bb1b3d670971f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:06.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.388+0000 7f984d399700 1 -- 172.21.15.71:0/2748608022 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984000e070 con 0x7f984806a020 2023-10-09T07:01:06.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.388+0000 7f984d399700 1 -- 172.21.15.71:0/2748608022 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984000ba00 con 0x7f984806a020 2023-10-09T07:01:06.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.388+0000 7f984d399700 1 -- 172.21.15.71:0/2748608022 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98400092e0 con 0x7f984806a020 2023-10-09T07:01:06.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.389+0000 7f984f39d700 1 -- 172.21.15.71:0/2748608022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f984806a020 msgr2=0x7f98480cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:06.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.389+0000 7f984f39d700 1 --2- 172.21.15.71:0/2748608022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f984806a020 0x7f98480cb230 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f984806e510 tx=0x7f9840009840 comp rx=0 tx=0).stop 2023-10-09T07:01:06.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.389+0000 7f984f39d700 1 -- 172.21.15.71:0/2748608022 shutdown_connections 2023-10-09T07:01:06.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.389+0000 7f984f39d700 1 --2- 172.21.15.71:0/2748608022 >> v2:172.21.15.179:3300/0 conn(0x7f9848159a60 0x7f98480c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:06.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.389+0000 7f984f39d700 1 --2- 172.21.15.71:0/2748608022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f984806a020 0x7f98480cb230 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:06.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.389+0000 7f984f39d700 1 --2- 172.21.15.71:0/2748608022 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98480ccc00 0x7f9848069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:06.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.389+0000 7f984f39d700 1 -- 172.21.15.71:0/2748608022 >> 172.21.15.71:0/2748608022 conn(0x7f984806baa0 msgr2=0x7f984806bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:06.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.389+0000 7f984f39d700 1 -- 172.21.15.71:0/2748608022 shutdown_connections 2023-10-09T07:01:06.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.389+0000 7f984f39d700 1 -- 172.21.15.71:0/2748608022 wait complete. 2023-10-09T07:01:06.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.390+0000 7f984f39d700 1 Processor -- start 2023-10-09T07:01:06.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.391+0000 7f984f39d700 1 -- start start 2023-10-09T07:01:06.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.391+0000 7f984f39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f984806a020 0x7f9848152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:06.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.392+0000 7f984f39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98480ccc00 0x7f984814a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:06.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.392+0000 7f984f39d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9848159a60 0x7f98480b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:06.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.392+0000 7f984f39d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9848153100 con 0x7f9848159a60 2023-10-09T07:01:06.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.392+0000 7f984f39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9848152730 con 0x7f98480ccc00 2023-10-09T07:01:06.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.392+0000 7f984f39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9848151b20 con 0x7f984806a020 2023-10-09T07:01:06.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.392+0000 7f984eb9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9848159a60 0x7f98480b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:06.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.392+0000 7f984e39b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f984806a020 0x7f9848152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.392+0000 7f984eb9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9848159a60 0x7f98480b1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34926/0 (socket says 172.21.15.71:34926) 2023-10-09T07:01:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.392+0000 7f984eb9c700 1 -- 172.21.15.71:0/3831856029 learned_addr learned my addr 172.21.15.71:0/3831856029 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.392+0000 7f984db9a700 1 --2- 172.21.15.71:0/3831856029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98480ccc00 0x7f984814a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.392+0000 7f984eb9c700 1 -- 172.21.15.71:0/3831856029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f984806a020 msgr2=0x7f9848152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.392+0000 7f984eb9c700 1 --2- 172.21.15.71:0/3831856029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f984806a020 0x7f9848152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.392+0000 7f984eb9c700 1 -- 172.21.15.71:0/3831856029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98480ccc00 msgr2=0x7f984814a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.392+0000 7f984eb9c700 1 --2- 172.21.15.71:0/3831856029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98480ccc00 0x7f984814a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.392+0000 7f984eb9c700 1 -- 172.21.15.71:0/3831856029 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9838009420 con 0x7f9848159a60 2023-10-09T07:01:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.392+0000 7f984db9a700 1 --2- 172.21.15.71:0/3831856029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98480ccc00 0x7f984814a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:01:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.393+0000 7f984eb9c700 1 --2- 172.21.15.71:0/3831856029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9848159a60 0x7f98480b1df0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f984000c010 tx=0x7f9840018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.393+0000 7f983e7fc700 1 -- 172.21.15.71:0/3831856029 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9840008b80 con 0x7f9848159a60 2023-10-09T07:01:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.393+0000 7f983e7fc700 1 -- 172.21.15.71:0/3831856029 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9840008d00 con 0x7f9848159a60 2023-10-09T07:01:06.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.393+0000 7f983e7fc700 1 -- 172.21.15.71:0/3831856029 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984001d670 con 0x7f9848159a60 2023-10-09T07:01:06.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.393+0000 7f984f39d700 1 -- 172.21.15.71:0/3831856029 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9844009420 con 0x7f9848159a60 2023-10-09T07:01:06.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.393+0000 7f984f39d700 1 -- 172.21.15.71:0/3831856029 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9840009ae0 con 0x7f9848159a60 2023-10-09T07:01:06.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.394+0000 7f984f39d700 1 -- 172.21.15.71:0/3831856029 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98481528e0 con 0x7f9848159a60 2023-10-09T07:01:06.396 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:06.395+0000 7f6c9b721180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T07:01:06.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.395+0000 7f983e7fc700 1 -- 172.21.15.71:0/3831856029 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 55) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f9840003040 con 0x7f9848159a60 2023-10-09T07:01:06.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.396+0000 7f983e7fc700 1 --2- 172.21.15.71:0/3831856029 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f982c067170 0x7f982c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:06.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.396+0000 7f983e7fc700 1 -- 172.21.15.71:0/3831856029 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f9840086740 con 0x7f9848159a60 2023-10-09T07:01:06.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.396+0000 7f984e39b700 1 -- 172.21.15.71:0/3831856029 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f982c067170 msgr2=0x7f982c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:06.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.396+0000 7f984e39b700 1 --2- 172.21.15.71:0/3831856029 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f982c067170 0x7f982c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:01:06.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.404+0000 7f983e7fc700 1 -- 172.21.15.71:0/3831856029 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9840056d40 con 0x7f9848159a60 2023-10-09T07:01:06.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.597+0000 7f984e39b700 1 -- 172.21.15.71:0/3831856029 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f982c067170 msgr2=0x7f982c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:06.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.597+0000 7f984e39b700 1 --2- 172.21.15.71:0/3831856029 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f982c067170 0x7f982c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:01:06.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.602+0000 7f984f39d700 1 -- 172.21.15.71:0/3831856029 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f984806ebd0 con 0x7f9848159a60 2023-10-09T07:01:06.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.602+0000 7f983e7fc700 1 -- 172.21.15.71:0/3831856029 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v125) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9840009940 con 0x7f9848159a60 2023-10-09T07:01:06.602 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-09T07:01:06.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.605+0000 7f984f39d700 1 -- 172.21.15.71:0/3831856029 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f982c067170 msgr2=0x7f982c069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:01:06.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.605+0000 7f984f39d700 1 --2- 172.21.15.71:0/3831856029 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f982c067170 0x7f982c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:06.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.605+0000 7f984f39d700 1 -- 172.21.15.71:0/3831856029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9848159a60 msgr2=0x7f98480b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:06.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.605+0000 7f984f39d700 1 --2- 172.21.15.71:0/3831856029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9848159a60 0x7f98480b1df0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f984000c010 tx=0x7f9840018000 comp rx=0 tx=0).stop 2023-10-09T07:01:06.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.605+0000 7f984f39d700 1 -- 172.21.15.71:0/3831856029 shutdown_connections 2023-10-09T07:01:06.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.605+0000 7f984f39d700 1 --2- 172.21.15.71:0/3831856029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9848159a60 0x7f98480b1df0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:06.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.605+0000 7f984f39d700 1 --2- 172.21.15.71:0/3831856029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f984806a020 0x7f9848152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:06.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.605+0000 7f984f39d700 1 --2- 172.21.15.71:0/3831856029 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f982c067170 0x7f982c069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:06.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.605+0000 7f984f39d700 1 --2- 172.21.15.71:0/3831856029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98480ccc00 0x7f984814a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:06.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.605+0000 7f984f39d700 1 -- 172.21.15.71:0/3831856029 >> 172.21.15.71:0/3831856029 conn(0x7f984806baa0 msgr2=0x7f9848157030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:06.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.605+0000 7f984f39d700 1 -- 172.21.15.71:0/3831856029 shutdown_connections 2023-10-09T07:01:06.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.605+0000 7f984f39d700 1 -- 172.21.15.71:0/3831856029 wait complete. 2023-10-09T07:01:06.623 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:01:06.778 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:06.778+0000 7f1979ff8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T07:01:06.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.819+0000 7f2e99d9d700 1 Processor -- start 2023-10-09T07:01:06.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.819+0000 7f2e99d9d700 1 -- start start 2023-10-09T07:01:06.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.820+0000 7f2e99d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e941593b0 0x7f2e94159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:06.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.820+0000 7f2e99d9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e940cfe20 con 0x7f2e940b1e50 2023-10-09T07:01:06.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.820+0000 7f2e99d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e940cf210 con 0x7f2e940ceaa0 2023-10-09T07:01:06.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.820+0000 7f2e99d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e940cf4f0 con 0x7f2e941593b0 2023-10-09T07:01:06.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.821+0000 7f2e98d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e941593b0 0x7f2e94159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:06.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.821+0000 7f2e93fff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f2e940ceaa0 0x7f2e940b1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:53234/0 (socket says 172.21.15.71:53234) 2023-10-09T07:01:06.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.821+0000 7f2e9959c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f2e940b1e50 0x7f2e940b3420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39796/0 (socket says 172.21.15.71:39796) 2023-10-09T07:01:06.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.821+0000 7f2e93fff700 1 -- 172.21.15.71:0/738969023 learned_addr learned my addr 172.21.15.71:0/738969023 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:01:06.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.821+0000 7f2e937fe700 1 -- 172.21.15.71:0/738969023 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045106395 0 0) 0x7f2e940cf210 con 0x7f2e940ceaa0 2023-10-09T07:01:06.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.821+0000 7f2e937fe700 1 -- 172.21.15.71:0/738969023 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e84003570 con 0x7f2e940ceaa0 2023-10-09T07:01:06.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.821+0000 7f2e937fe700 1 -- 172.21.15.71:0/738969023 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115575878 0 0) 0x7f2e940cfe20 con 0x7f2e940b1e50 2023-10-09T07:01:06.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.821+0000 7f2e937fe700 1 -- 172.21.15.71:0/738969023 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e940cf210 con 0x7f2e940b1e50 2023-10-09T07:01:06.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.821+0000 7f2e98d9b700 1 -- 172.21.15.71:0/738969023 >> v1:172.21.15.179:6789/0 conn(0x7f2e940ceaa0 legacy=0x7f2e940b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:06.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.821+0000 7f2e98d9b700 1 -- 172.21.15.71:0/738969023 >> v1:172.21.15.71:6789/0 conn(0x7f2e940b1e50 legacy=0x7f2e940b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:06.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.821+0000 7f2e98d9b700 1 -- 172.21.15.71:0/738969023 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e940cf7d0 con 0x7f2e941593b0 2023-10-09T07:01:06.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.821+0000 7f2e98d9b700 1 --2- 172.21.15.71:0/738969023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e941593b0 0x7f2e94159780 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009910 tx=0x7f2e880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bfb996e163facdd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:06.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.822+0000 7f2e937fe700 1 -- 172.21.15.71:0/738969023 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e88011630 con 0x7f2e941593b0 2023-10-09T07:01:06.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.822+0000 7f2e937fe700 1 -- 172.21.15.71:0/738969023 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e88011790 con 0x7f2e941593b0 2023-10-09T07:01:06.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.822+0000 7f2e937fe700 1 -- 172.21.15.71:0/738969023 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e88011b30 con 0x7f2e941593b0 2023-10-09T07:01:06.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.822+0000 7f2e99d9d700 1 -- 172.21.15.71:0/738969023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e941593b0 msgr2=0x7f2e94159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:06.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.822+0000 7f2e99d9d700 1 --2- 172.21.15.71:0/738969023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e941593b0 0x7f2e94159780 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009910 tx=0x7f2e880091a0 comp rx=0 tx=0).stop 2023-10-09T07:01:06.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.823+0000 7f2e99d9d700 1 -- 172.21.15.71:0/738969023 shutdown_connections 2023-10-09T07:01:06.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.823+0000 7f2e99d9d700 1 --2- 172.21.15.71:0/738969023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e941593b0 0x7f2e94159780 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:06.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.823+0000 7f2e99d9d700 1 -- 172.21.15.71:0/738969023 >> 172.21.15.71:0/738969023 conn(0x7f2e940d1130 msgr2=0x7f2e940b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:06.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.823+0000 7f2e99d9d700 1 -- 172.21.15.71:0/738969023 shutdown_connections 2023-10-09T07:01:06.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.823+0000 7f2e99d9d700 1 -- 172.21.15.71:0/738969023 wait complete. 2023-10-09T07:01:06.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.825+0000 7f2e99d9d700 1 Processor -- start 2023-10-09T07:01:06.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.825+0000 7f2e99d9d700 1 -- start start 2023-10-09T07:01:06.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.827+0000 7f2e99d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e940b1e50 0x7f2e9415c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:06.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.827+0000 7f2e99d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e940ceaa0 0x7f2e9416d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:06.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.827+0000 7f2e99d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e941593b0 0x7f2e9416d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:06.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.827+0000 7f2e99d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e94153360 con 0x7f2e941593b0 2023-10-09T07:01:06.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.827+0000 7f2e99d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e94150360 con 0x7f2e940b1e50 2023-10-09T07:01:06.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.827+0000 7f2e99d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e94152750 con 0x7f2e940ceaa0 2023-10-09T07:01:06.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.827+0000 7f2e9959c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e941593b0 0x7f2e9416d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:06.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.827+0000 7f2e98d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e940b1e50 0x7f2e9415c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:06.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.827+0000 7f2e9959c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e941593b0 0x7f2e9416d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34930/0 (socket says 172.21.15.71:34930) 2023-10-09T07:01:06.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.827+0000 7f2e9959c700 1 -- 172.21.15.71:0/2539253361 learned_addr learned my addr 172.21.15.71:0/2539253361 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:06.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.827+0000 7f2e93fff700 1 --2- 172.21.15.71:0/2539253361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e940ceaa0 0x7f2e9416d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:06.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.827+0000 7f2e9959c700 1 -- 172.21.15.71:0/2539253361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e940ceaa0 msgr2=0x7f2e9416d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:06.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.827+0000 7f2e9959c700 1 --2- 172.21.15.71:0/2539253361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e940ceaa0 0x7f2e9416d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:06.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.827+0000 7f2e9959c700 1 -- 172.21.15.71:0/2539253361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e940b1e50 msgr2=0x7f2e9415c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:06.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.827+0000 7f2e9959c700 1 --2- 172.21.15.71:0/2539253361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e940b1e50 0x7f2e9415c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:06.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.828+0000 7f2e9959c700 1 -- 172.21.15.71:0/2539253361 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e88009420 con 0x7f2e941593b0 2023-10-09T07:01:06.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.828+0000 7f2e9959c700 1 --2- 172.21.15.71:0/2539253361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e941593b0 0x7f2e9416d9b0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00cd30 tx=0x7f2e8c001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:06.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.828+0000 7f2e90ff9700 1 -- 172.21.15.71:0/2539253361 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c00ce90 con 0x7f2e941593b0 2023-10-09T07:01:06.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.828+0000 7f2e90ff9700 1 -- 172.21.15.71:0/2539253361 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c005df0 con 0x7f2e941593b0 2023-10-09T07:01:06.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.828+0000 7f2e99d9d700 1 -- 172.21.15.71:0/2539253361 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e94152a30 con 0x7f2e941593b0 2023-10-09T07:01:06.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.828+0000 7f2e90ff9700 1 -- 172.21.15.71:0/2539253361 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c00aa60 con 0x7f2e941593b0 2023-10-09T07:01:06.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.828+0000 7f2e99d9d700 1 -- 172.21.15.71:0/2539253361 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e94152ff0 con 0x7f2e941593b0 2023-10-09T07:01:06.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.829+0000 7f2e99d9d700 1 -- 172.21.15.71:0/2539253361 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9404c3c0 con 0x7f2e941593b0 2023-10-09T07:01:06.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.830+0000 7f2e90ff9700 1 -- 172.21.15.71:0/2539253361 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 55) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f2e8c0070f0 con 0x7f2e941593b0 2023-10-09T07:01:06.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.831+0000 7f2e90ff9700 1 --2- 172.21.15.71:0/2539253361 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2e78067170 0x7f2e78069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:06.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.831+0000 7f2e90ff9700 1 -- 172.21.15.71:0/2539253361 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f2e8c085630 con 0x7f2e941593b0 2023-10-09T07:01:06.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.831+0000 7f2e98d9b700 1 -- 172.21.15.71:0/2539253361 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2e78067170 msgr2=0x7f2e78069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:06.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.832+0000 7f2e98d9b700 1 --2- 172.21.15.71:0/2539253361 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2e78067170 0x7f2e78069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:01:06.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:06.835+0000 7f2e90ff9700 1 -- 172.21.15.71:0/2539253361 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e8c052420 con 0x7f2e941593b0 2023-10-09T07:01:06.874 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:06.874+0000 7f1979ff8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T07:01:06.910 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:06.909+0000 7f6c9b721180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T07:01:06.964 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:06.963+0000 7f1979ff8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T07:01:07.006 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:07.006+0000 7f6c9b721180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T07:01:07.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.033+0000 7f2e98d9b700 1 -- 172.21.15.71:0/2539253361 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2e78067170 msgr2=0x7f2e78069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:07.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.033+0000 7f2e98d9b700 1 --2- 172.21.15.71:0/2539253361 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2e78067170 0x7f2e78069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:01:07.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.082+0000 7f2e99d9d700 1 -- 172.21.15.71:0/2539253361 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e940cfab0 con 0x7f2e941593b0 2023-10-09T07:01:07.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.082+0000 7f2e90ff9700 1 -- 172.21.15.71:0/2539253361 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f2e8c055a40 con 0x7f2e941593b0 2023-10-09T07:01:07.082 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:01:07.083 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7378,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1918195834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1918195834},{"type":"v1","addr":"172.21.15.179:6834","nonce":1918195834}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7644,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3880476818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3880476818},{"type":"v1","addr":"172.21.15.71:6833","nonce":3880476818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7656,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/4215423233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":4215423233},{"type":"v1","addr":"172.21.15.179:6836","nonce":4215423233}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:00:31.315026+0000","modified":"2023-10-09T07:00:34.863796+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/3141191512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3141191512},{"type":"v1","addr":"172.21.15.71:6835","nonce":3141191512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T07:01:07.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.085+0000 7f2e99d9d700 1 -- 172.21.15.71:0/2539253361 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2e78067170 msgr2=0x7f2e78069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:01:07.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.085+0000 7f2e99d9d700 1 --2- 172.21.15.71:0/2539253361 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2e78067170 0x7f2e78069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:07.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.085+0000 7f2e99d9d700 1 -- 172.21.15.71:0/2539253361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e941593b0 msgr2=0x7f2e9416d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:07.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.085+0000 7f2e99d9d700 1 --2- 172.21.15.71:0/2539253361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e941593b0 0x7f2e9416d9b0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00cd30 tx=0x7f2e8c001b00 comp rx=0 tx=0).stop 2023-10-09T07:01:07.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.085+0000 7f2e99d9d700 1 -- 172.21.15.71:0/2539253361 shutdown_connections 2023-10-09T07:01:07.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.085+0000 7f2e99d9d700 1 --2- 172.21.15.71:0/2539253361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e941593b0 0x7f2e9416d9b0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:07.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.085+0000 7f2e99d9d700 1 --2- 172.21.15.71:0/2539253361 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2e78067170 0x7f2e78069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:07.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.085+0000 7f2e99d9d700 1 --2- 172.21.15.71:0/2539253361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e940b1e50 0x7f2e9415c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:07.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.085+0000 7f2e99d9d700 1 --2- 172.21.15.71:0/2539253361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e940ceaa0 0x7f2e9416d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:07.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.085+0000 7f2e99d9d700 1 -- 172.21.15.71:0/2539253361 >> 172.21.15.71:0/2539253361 conn(0x7f2e940d1130 msgr2=0x7f2e94157120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:07.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.085+0000 7f2e99d9d700 1 -- 172.21.15.71:0/2539253361 shutdown_connections 2023-10-09T07:01:07.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.085+0000 7f2e99d9d700 1 -- 172.21.15.71:0/2539253361 wait complete. 2023-10-09T07:01:07.086 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 58 2023-10-09T07:01:07.102 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:07.102+0000 7f6c9b721180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T07:01:07.103 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:01:07.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.291+0000 7f9e8a99d700 1 Processor -- start 2023-10-09T07:01:07.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.291+0000 7f9e8a99d700 1 -- start start 2023-10-09T07:01:07.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.293+0000 7f9e8a99d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9e841595a0 0x7f9e840b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:07.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.293+0000 7f9e8a99d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e840b1410 con 0x7f9e840c8830 2023-10-09T07:01:07.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.293+0000 7f9e8a99d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e84063230 con 0x7f9e840c6c60 2023-10-09T07:01:07.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.293+0000 7f9e8a99d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e840b2b90 con 0x7f9e841595a0 2023-10-09T07:01:07.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.293+0000 7f9e8999b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9e841595a0 0x7f9e840b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:07.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.293+0000 7f9e8999b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9e841595a0 0x7f9e840b18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34934/0 (socket says 172.21.15.71:34934) 2023-10-09T07:01:07.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.293+0000 7f9e8999b700 1 -- 172.21.15.71:0/1572361434 learned_addr learned my addr 172.21.15.71:0/1572361434 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:07.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.293+0000 7f9e8999b700 1 -- 172.21.15.71:0/1572361434 >> v1:172.21.15.179:6789/0 conn(0x7f9e840c6c60 legacy=0x7f9e840c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:07.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.293+0000 7f9e8999b700 1 -- 172.21.15.71:0/1572361434 >> v1:172.21.15.71:6789/0 conn(0x7f9e840c8830 legacy=0x7f9e84159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:07.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.293+0000 7f9e8999b700 1 -- 172.21.15.71:0/1572361434 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e840634f0 con 0x7f9e841595a0 2023-10-09T07:01:07.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.294+0000 7f9e8999b700 1 --2- 172.21.15.71:0/1572361434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e841595a0 0x7f9e840b18a0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f9e800099b0 tx=0x7f9e80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114679890e908ff9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:07.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.294+0000 7f9e88999700 1 -- 172.21.15.71:0/1572361434 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8000b860 con 0x7f9e841595a0 2023-10-09T07:01:07.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.294+0000 7f9e88999700 1 -- 172.21.15.71:0/1572361434 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8000b9c0 con 0x7f9e841595a0 2023-10-09T07:01:07.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.294+0000 7f9e88999700 1 -- 172.21.15.71:0/1572361434 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8000bd60 con 0x7f9e841595a0 2023-10-09T07:01:07.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.295+0000 7f9e8a99d700 1 -- 172.21.15.71:0/1572361434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e841595a0 msgr2=0x7f9e840b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:07.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.295+0000 7f9e8a99d700 1 --2- 172.21.15.71:0/1572361434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e841595a0 0x7f9e840b18a0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f9e800099b0 tx=0x7f9e80009250 comp rx=0 tx=0).stop 2023-10-09T07:01:07.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.295+0000 7f9e8a99d700 1 -- 172.21.15.71:0/1572361434 shutdown_connections 2023-10-09T07:01:07.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.295+0000 7f9e8a99d700 1 --2- 172.21.15.71:0/1572361434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e841595a0 0x7f9e840b18a0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:07.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.295+0000 7f9e8a99d700 1 -- 172.21.15.71:0/1572361434 >> 172.21.15.71:0/1572361434 conn(0x7f9e8406ddb0 msgr2=0x7f9e8406e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:07.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.295+0000 7f9e8a99d700 1 -- 172.21.15.71:0/1572361434 shutdown_connections 2023-10-09T07:01:07.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.295+0000 7f9e8a99d700 1 -- 172.21.15.71:0/1572361434 wait complete. 2023-10-09T07:01:07.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.296+0000 7f9e8a99d700 1 Processor -- start 2023-10-09T07:01:07.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.297+0000 7f9e8a99d700 1 -- start start 2023-10-09T07:01:07.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.297+0000 7f9e8a99d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e840c6c60 0x7f9e840c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:07.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.297+0000 7f9e8a99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e840c8830 0x7f9e840c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:07.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.297+0000 7f9e8a99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e841595a0 0x7f9e84169dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:07.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.297+0000 7f9e8a99d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e840a5880 con 0x7f9e840c6c60 2023-10-09T07:01:07.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.297+0000 7f9e8a99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e840c5450 con 0x7f9e841595a0 2023-10-09T07:01:07.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.297+0000 7f9e8a99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e840c5650 con 0x7f9e840c8830 2023-10-09T07:01:07.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.298+0000 7f9e8999b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e840c6c60 0x7f9e840c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:07.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.298+0000 7f9e8999b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e840c6c60 0x7f9e840c49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34946/0 (socket says 172.21.15.71:34946) 2023-10-09T07:01:07.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.298+0000 7f9e8999b700 1 -- 172.21.15.71:0/1733696047 learned_addr learned my addr 172.21.15.71:0/1733696047 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:07.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.298+0000 7f9e8a19c700 1 --2- 172.21.15.71:0/1733696047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e841595a0 0x7f9e84169dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:07.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.298+0000 7f9e8919a700 1 --2- 172.21.15.71:0/1733696047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e840c8830 0x7f9e840c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:07.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.298+0000 7f9e8999b700 1 -- 172.21.15.71:0/1733696047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e840c8830 msgr2=0x7f9e840c4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:07.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.298+0000 7f9e8999b700 1 --2- 172.21.15.71:0/1733696047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e840c8830 0x7f9e840c4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:07.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.298+0000 7f9e8999b700 1 -- 172.21.15.71:0/1733696047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e841595a0 msgr2=0x7f9e84169dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:07.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.298+0000 7f9e8999b700 1 --2- 172.21.15.71:0/1733696047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e841595a0 0x7f9e84169dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:07.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.298+0000 7f9e8999b700 1 -- 172.21.15.71:0/1733696047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e800094f0 con 0x7f9e840c6c60 2023-10-09T07:01:07.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.298+0000 7f9e8999b700 1 --2- 172.21.15.71:0/1733696047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e840c6c60 0x7f9e840c49d0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f9e80006fd0 tx=0x7f9e80017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:07.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.299+0000 7f9e79ffb700 1 -- 172.21.15.71:0/1733696047 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e80024440 con 0x7f9e840c6c60 2023-10-09T07:01:07.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.299+0000 7f9e79ffb700 1 -- 172.21.15.71:0/1733696047 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e800245a0 con 0x7f9e840c6c60 2023-10-09T07:01:07.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.299+0000 7f9e8a99d700 1 -- 172.21.15.71:0/1733696047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e840c5930 con 0x7f9e840c6c60 2023-10-09T07:01:07.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.299+0000 7f9e79ffb700 1 -- 172.21.15.71:0/1733696047 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e80024940 con 0x7f9e840c6c60 2023-10-09T07:01:07.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.299+0000 7f9e8a99d700 1 -- 172.21.15.71:0/1733696047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e840c5ef0 con 0x7f9e840c6c60 2023-10-09T07:01:07.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.300+0000 7f9e8a99d700 1 -- 172.21.15.71:0/1733696047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e840c6240 con 0x7f9e840c6c60 2023-10-09T07:01:07.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.301+0000 7f9e79ffb700 1 -- 172.21.15.71:0/1733696047 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 55) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f9e8001a420 con 0x7f9e840c6c60 2023-10-09T07:01:07.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.302+0000 7f9e79ffb700 1 --2- 172.21.15.71:0/1733696047 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9e68067170 0x7f9e68069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:07.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.302+0000 7f9e79ffb700 1 -- 172.21.15.71:0/1733696047 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f9e800868d0 con 0x7f9e840c6c60 2023-10-09T07:01:07.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.302+0000 7f9e8919a700 1 -- 172.21.15.71:0/1733696047 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9e68067170 msgr2=0x7f9e68069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:07.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.302+0000 7f9e8919a700 1 --2- 172.21.15.71:0/1733696047 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9e68067170 0x7f9e68069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:01:07.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.309+0000 7f9e79ffb700 1 -- 172.21.15.71:0/1733696047 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e80053680 con 0x7f9e840c6c60 2023-10-09T07:01:07.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.503+0000 7f9e8919a700 1 -- 172.21.15.71:0/1733696047 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9e68067170 msgr2=0x7f9e68069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:07.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.503+0000 7f9e8919a700 1 --2- 172.21.15.71:0/1733696047 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9e68067170 0x7f9e68069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:01:07.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.510+0000 7f9e8a99d700 1 -- 172.21.15.71:0/1733696047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e8404c3c0 con 0x7f9e840c6c60 2023-10-09T07:01:07.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.511+0000 7f9e79ffb700 1 -- 172.21.15.71:0/1733696047 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+16443 (secure 0 0 0) 0x7f9e80056ca0 con 0x7f9e840c6c60 2023-10-09T07:01:07.512 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:01:07.512 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":125,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:01:06.011610+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:00:28.965075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T07:00:30.294796+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":125,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:0/3535588607":"2023-10-10T07:00:46.934396+0000","172.21.15.179:6837/85452":"2023-10-10T07:00:46.934396+0000","172.21.15.179:6835/85452":"2023-10-10T07:00:46.934396+0000","172.21.15.179:0/1997380181":"2023-10-10T07:00:46.934396+0000","172.21.15.179:0/3456675137":"2023-10-10T07:00:46.934396+0000","172.21.15.179:0/1765057334":"2023-10-10T07:00:46.934396+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:01:07.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.514+0000 7f9e8a99d700 1 -- 172.21.15.71:0/1733696047 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9e68067170 msgr2=0x7f9e68069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:01:07.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.514+0000 7f9e8a99d700 1 --2- 172.21.15.71:0/1733696047 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9e68067170 0x7f9e68069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:07.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.514+0000 7f9e8a99d700 1 -- 172.21.15.71:0/1733696047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e840c6c60 msgr2=0x7f9e840c49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:07.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.514+0000 7f9e8a99d700 1 --2- 172.21.15.71:0/1733696047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e840c6c60 0x7f9e840c49d0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f9e80006fd0 tx=0x7f9e80017000 comp rx=0 tx=0).stop 2023-10-09T07:01:07.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.514+0000 7f9e8a99d700 1 -- 172.21.15.71:0/1733696047 shutdown_connections 2023-10-09T07:01:07.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.514+0000 7f9e8a99d700 1 --2- 172.21.15.71:0/1733696047 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9e68067170 0x7f9e68069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:07.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.514+0000 7f9e8a99d700 1 --2- 172.21.15.71:0/1733696047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e841595a0 0x7f9e84169dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:07.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.514+0000 7f9e8a99d700 1 --2- 172.21.15.71:0/1733696047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e840c6c60 0x7f9e840c49d0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:07.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.514+0000 7f9e8a99d700 1 --2- 172.21.15.71:0/1733696047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e840c8830 0x7f9e840c4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:07.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.514+0000 7f9e8a99d700 1 -- 172.21.15.71:0/1733696047 >> 172.21.15.71:0/1733696047 conn(0x7f9e8406ddb0 msgr2=0x7f9e84155300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:07.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.514+0000 7f9e8a99d700 1 -- 172.21.15.71:0/1733696047 shutdown_connections 2023-10-09T07:01:07.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.514+0000 7f9e8a99d700 1 -- 172.21.15.71:0/1733696047 wait complete. 2023-10-09T07:01:07.533 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T07:01:07.533 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:01:07.583 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:07.583+0000 7f1979ff8180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T07:01:07.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.746+0000 7f2efb59d700 1 Processor -- start 2023-10-09T07:01:07.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.746+0000 7f2efb59d700 1 -- start start 2023-10-09T07:01:07.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.747+0000 7f2efb59d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2ef41597f0 0x7f2ef40b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:07.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.747+0000 7f2efb59d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef40b11d0 con 0x7f2ef415d230 2023-10-09T07:01:07.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.747+0000 7f2efb59d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef40b14b0 con 0x7f2ef4159420 2023-10-09T07:01:07.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.747+0000 7f2efb59d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef40b1790 con 0x7f2ef41597f0 2023-10-09T07:01:07.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.748+0000 7f2ef9d9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2ef41597f0 0x7f2ef40b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:07.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.748+0000 7f2ef9d9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2ef41597f0 0x7f2ef40b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34952/0 (socket says 172.21.15.71:34952) 2023-10-09T07:01:07.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.748+0000 7f2ef9d9a700 1 -- 172.21.15.71:0/4031737100 learned_addr learned my addr 172.21.15.71:0/4031737100 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:07.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.748+0000 7f2ef9d9a700 1 -- 172.21.15.71:0/4031737100 >> v1:172.21.15.179:6789/0 conn(0x7f2ef4159420 legacy=0x7f2ef40b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:07.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.748+0000 7f2ef9d9a700 1 -- 172.21.15.71:0/4031737100 >> v1:172.21.15.71:6789/0 conn(0x7f2ef415d230 legacy=0x7f2ef415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:07.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.748+0000 7f2ef9d9a700 1 -- 172.21.15.71:0/4031737100 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef40b1a70 con 0x7f2ef41597f0 2023-10-09T07:01:07.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.748+0000 7f2ef9599700 1 -- 172.21.15.71:0/4031737100 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060886353 0 0) 0x7f2ef40b14b0 con 0x7f2ef4159420 2023-10-09T07:01:07.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.748+0000 7f2ef9d9a700 1 --2- 172.21.15.71:0/4031737100 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef41597f0 0x7f2ef40b2270 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40099b0 tx=0x7f2ee4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74405f788bacd57 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:07.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.749+0000 7f2ef9599700 1 -- 172.21.15.71:0/4031737100 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee400b860 con 0x7f2ef41597f0 2023-10-09T07:01:07.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.749+0000 7f2ef9599700 1 -- 172.21.15.71:0/4031737100 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee400b9c0 con 0x7f2ef41597f0 2023-10-09T07:01:07.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.749+0000 7f2ef9599700 1 -- 172.21.15.71:0/4031737100 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee400bd60 con 0x7f2ef41597f0 2023-10-09T07:01:07.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.749+0000 7f2efb59d700 1 -- 172.21.15.71:0/4031737100 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef41597f0 msgr2=0x7f2ef40b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:07.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.749+0000 7f2efb59d700 1 --2- 172.21.15.71:0/4031737100 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef41597f0 0x7f2ef40b2270 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40099b0 tx=0x7f2ee4009250 comp rx=0 tx=0).stop 2023-10-09T07:01:07.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.749+0000 7f2efb59d700 1 -- 172.21.15.71:0/4031737100 shutdown_connections 2023-10-09T07:01:07.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.749+0000 7f2efb59d700 1 --2- 172.21.15.71:0/4031737100 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef41597f0 0x7f2ef40b2270 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:07.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.749+0000 7f2efb59d700 1 -- 172.21.15.71:0/4031737100 >> 172.21.15.71:0/4031737100 conn(0x7f2ef40d0660 msgr2=0x7f2ef40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:07.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.749+0000 7f2efb59d700 1 -- 172.21.15.71:0/4031737100 shutdown_connections 2023-10-09T07:01:07.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.749+0000 7f2efb59d700 1 -- 172.21.15.71:0/4031737100 wait complete. 2023-10-09T07:01:07.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.751+0000 7f2efb59d700 1 Processor -- start 2023-10-09T07:01:07.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.751+0000 7f2efb59d700 1 -- start start 2023-10-09T07:01:07.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.752+0000 7f2efb59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ef4159420 0x7f2ef40c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:07.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.752+0000 7f2efb59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef41597f0 0x7f2ef40cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:07.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.752+0000 7f2efb59d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef415d230 0x7f2ef40cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:07.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.752+0000 7f2efb59d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef415c580 con 0x7f2ef415d230 2023-10-09T07:01:07.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.752+0000 7f2efb59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef40cabd0 con 0x7f2ef4159420 2023-10-09T07:01:07.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.752+0000 7f2efb59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef40c9fc0 con 0x7f2ef41597f0 2023-10-09T07:01:07.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.752+0000 7f2efad9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef415d230 0x7f2ef40cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:07.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.752+0000 7f2ef9d9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef41597f0 0x7f2ef40cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:07.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.752+0000 7f2efa59b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ef4159420 0x7f2ef40c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:07.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.752+0000 7f2ef9d9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef41597f0 0x7f2ef40cb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:39402/0 (socket says 172.21.15.71:39402) 2023-10-09T07:01:07.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.752+0000 7f2efa59b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ef4159420 0x7f2ef40c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:39026/0 (socket says 172.21.15.71:39026) 2023-10-09T07:01:07.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.752+0000 7f2ef9d9a700 1 -- 172.21.15.71:0/2398930502 learned_addr learned my addr 172.21.15.71:0/2398930502 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:07.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.753+0000 7f2efa59b700 1 -- 172.21.15.71:0/2398930502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef41597f0 msgr2=0x7f2ef40cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:07.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.753+0000 7f2efa59b700 1 --2- 172.21.15.71:0/2398930502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef41597f0 0x7f2ef40cb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:07.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.753+0000 7f2efa59b700 1 -- 172.21.15.71:0/2398930502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef415d230 msgr2=0x7f2ef40cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:07.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.753+0000 7f2efa59b700 1 --2- 172.21.15.71:0/2398930502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef415d230 0x7f2ef40cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:07.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.753+0000 7f2efa59b700 1 -- 172.21.15.71:0/2398930502 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee40094f0 con 0x7f2ef4159420 2023-10-09T07:01:07.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.753+0000 7f2ef9d9a700 1 --2- 172.21.15.71:0/2398930502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef41597f0 0x7f2ef40cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:01:07.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.753+0000 7f2efad9c700 1 --2- 172.21.15.71:0/2398930502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef415d230 0x7f2ef40cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:01:07.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.753+0000 7f2efa59b700 1 --2- 172.21.15.71:0/2398930502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ef4159420 0x7f2ef40c5400 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00011e0 tx=0x7f2ef0007d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:07.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.753+0000 7f2eea7fc700 1 -- 172.21.15.71:0/2398930502 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0011590 con 0x7f2ef4159420 2023-10-09T07:01:07.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.753+0000 7f2eea7fc700 1 -- 172.21.15.71:0/2398930502 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef0011710 con 0x7f2ef4159420 2023-10-09T07:01:07.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.753+0000 7f2efb59d700 1 -- 172.21.15.71:0/2398930502 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef40ca2a0 con 0x7f2ef4159420 2023-10-09T07:01:07.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.754+0000 7f2eea7fc700 1 -- 172.21.15.71:0/2398930502 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0011ad0 con 0x7f2ef4159420 2023-10-09T07:01:07.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.754+0000 7f2efb59d700 1 -- 172.21.15.71:0/2398930502 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef40ca860 con 0x7f2ef4159420 2023-10-09T07:01:07.756 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:07.755+0000 7f1979ff8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:01:07.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.755+0000 7f2efb59d700 1 -- 172.21.15.71:0/2398930502 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef404c3c0 con 0x7f2ef4159420 2023-10-09T07:01:07.757 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:07.755+0000 7f6c9b721180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T07:01:07.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.756+0000 7f2eea7fc700 1 -- 172.21.15.71:0/2398930502 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 55) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f2ef001b3b0 con 0x7f2ef4159420 2023-10-09T07:01:07.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.756+0000 7f2eea7fc700 1 --2- 172.21.15.71:0/2398930502 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2ed8067170 0x7f2ed8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:07.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.756+0000 7f2eea7fc700 1 -- 172.21.15.71:0/2398930502 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f2ef0083fc0 con 0x7f2ef4159420 2023-10-09T07:01:07.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.757+0000 7f2ef9d9a700 1 -- 172.21.15.71:0/2398930502 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2ed8067170 msgr2=0x7f2ed8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:07.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.757+0000 7f2ef9d9a700 1 --2- 172.21.15.71:0/2398930502 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2ed8067170 0x7f2ed8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:01:07.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.761+0000 7f2eea7fc700 1 -- 172.21.15.71:0/2398930502 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ef0050ce0 con 0x7f2ef4159420 2023-10-09T07:01:07.851 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:07.850+0000 7f1979ff8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T07:01:07.934 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:07.934+0000 7f6c9b721180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:01:07.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.958+0000 7f2ef9d9a700 1 -- 172.21.15.71:0/2398930502 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2ed8067170 msgr2=0x7f2ed8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:07.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:07.958+0000 7f2ef9d9a700 1 --2- 172.21.15.71:0/2398930502 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2ed8067170 0x7f2ed8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:01:08.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.005+0000 7f2efb59d700 1 -- 172.21.15.71:0/2398930502 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ef40b1d50 con 0x7f2ef4159420 2023-10-09T07:01:08.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.006+0000 7f2eea7fc700 1 -- 172.21.15.71:0/2398930502 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f2ef0017070 con 0x7f2ef4159420 2023-10-09T07:01:08.006 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:01:08.006 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7378,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1918195834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1918195834},{"type":"v1","addr":"172.21.15.179:6834","nonce":1918195834}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7644,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3880476818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3880476818},{"type":"v1","addr":"172.21.15.71:6833","nonce":3880476818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7656,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/4215423233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":4215423233},{"type":"v1","addr":"172.21.15.179:6836","nonce":4215423233}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:00:31.315026+0000","modified":"2023-10-09T07:00:34.863796+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/3141191512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3141191512},{"type":"v1","addr":"172.21.15.71:6835","nonce":3141191512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T07:01:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.009+0000 7f2efb59d700 1 -- 172.21.15.71:0/2398930502 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2ed8067170 msgr2=0x7f2ed8069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:01:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.009+0000 7f2efb59d700 1 --2- 172.21.15.71:0/2398930502 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2ed8067170 0x7f2ed8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.010+0000 7f2efb59d700 1 -- 172.21.15.71:0/2398930502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ef4159420 msgr2=0x7f2ef40c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.010+0000 7f2efb59d700 1 --2- 172.21.15.71:0/2398930502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ef4159420 0x7f2ef40c5400 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00011e0 tx=0x7f2ef0007d30 comp rx=0 tx=0).stop 2023-10-09T07:01:08.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.010+0000 7f2efb59d700 1 -- 172.21.15.71:0/2398930502 shutdown_connections 2023-10-09T07:01:08.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.010+0000 7f2efb59d700 1 --2- 172.21.15.71:0/2398930502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef415d230 0x7f2ef40cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.010+0000 7f2efb59d700 1 --2- 172.21.15.71:0/2398930502 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2ed8067170 0x7f2ed8069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.010+0000 7f2efb59d700 1 --2- 172.21.15.71:0/2398930502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ef4159420 0x7f2ef40c5400 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.010+0000 7f2efb59d700 1 --2- 172.21.15.71:0/2398930502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef41597f0 0x7f2ef40cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.010+0000 7f2efb59d700 1 -- 172.21.15.71:0/2398930502 >> 172.21.15.71:0/2398930502 conn(0x7f2ef40d0660 msgr2=0x7f2ef4155180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:08.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.010+0000 7f2efb59d700 1 -- 172.21.15.71:0/2398930502 shutdown_connections 2023-10-09T07:01:08.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.010+0000 7f2efb59d700 1 -- 172.21.15.71:0/2398930502 wait complete. 2023-10-09T07:01:08.012 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 58 2023-10-09T07:01:08.030 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:01:08.043 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:08.043+0000 7f6c9b721180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T07:01:08.144 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:08.144+0000 7f1979ff8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T07:01:08.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.226+0000 7f9fbcd9d700 1 Processor -- start 2023-10-09T07:01:08.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.226+0000 7f9fbcd9d700 1 -- start start 2023-10-09T07:01:08.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.227+0000 7f9fbcd9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9fb8068aa0 0x7f9fb80b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:08.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.227+0000 7f9fbcd9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9fb80b0a00 0x7f9fb815d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:08.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.227+0000 7f9fbcd9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb815a980 con 0x7f9fb8157270 2023-10-09T07:01:08.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.227+0000 7f9fbcd9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb815a050 con 0x7f9fb80b0a00 2023-10-09T07:01:08.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.227+0000 7f9fbcd9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb815a330 con 0x7f9fb8068aa0 2023-10-09T07:01:08.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.227+0000 7f9fb7fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9fb80b0a00 0x7f9fb815d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:08.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.227+0000 7f9fb7fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9fb80b0a00 0x7f9fb815d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34982/0 (socket says 172.21.15.71:34982) 2023-10-09T07:01:08.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.227+0000 7f9fb7fff700 1 -- 172.21.15.71:0/2099172432 learned_addr learned my addr 172.21.15.71:0/2099172432 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:08.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.228+0000 7f9fb6ffd700 1 --2- 172.21.15.71:0/2099172432 >> v2:172.21.15.179:3300/0 conn(0x7f9fb8068aa0 0x7f9fb80b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:08.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.228+0000 7f9fb7fff700 1 -- 172.21.15.71:0/2099172432 >> v2:172.21.15.179:3300/0 conn(0x7f9fb8068aa0 msgr2=0x7f9fb80b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:08.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.228+0000 7f9fb7fff700 1 --2- 172.21.15.71:0/2099172432 >> v2:172.21.15.179:3300/0 conn(0x7f9fb8068aa0 0x7f9fb80b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.228+0000 7f9fb7fff700 1 -- 172.21.15.71:0/2099172432 >> v1:172.21.15.179:6789/0 conn(0x7f9fb8157270 legacy=0x7f9fb8068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:08.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.228+0000 7f9fb7fff700 1 -- 172.21.15.71:0/2099172432 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb815a610 con 0x7f9fb80b0a00 2023-10-09T07:01:08.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.228+0000 7f9fb67fc700 1 -- 172.21.15.71:0/2099172432 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2519694748 0 0) 0x7f9fb815a980 con 0x7f9fb8157270 2023-10-09T07:01:08.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.228+0000 7f9fb7fff700 1 --2- 172.21.15.71:0/2099172432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fb80b0a00 0x7f9fb815d300 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80b3330 tx=0x7f9fb0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1262a2f349e60966 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:08.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.228+0000 7f9fb67fc700 1 -- 172.21.15.71:0/2099172432 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb000e070 con 0x7f9fb80b0a00 2023-10-09T07:01:08.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.228+0000 7f9fb67fc700 1 -- 172.21.15.71:0/2099172432 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb000ba20 con 0x7f9fb80b0a00 2023-10-09T07:01:08.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.228+0000 7f9fb67fc700 1 -- 172.21.15.71:0/2099172432 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb00092e0 con 0x7f9fb80b0a00 2023-10-09T07:01:08.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.229+0000 7f9fbcd9d700 1 -- 172.21.15.71:0/2099172432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fb80b0a00 msgr2=0x7f9fb815d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:08.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.229+0000 7f9fbcd9d700 1 --2- 172.21.15.71:0/2099172432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fb80b0a00 0x7f9fb815d300 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80b3330 tx=0x7f9fb0009840 comp rx=0 tx=0).stop 2023-10-09T07:01:08.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.229+0000 7f9fbcd9d700 1 -- 172.21.15.71:0/2099172432 shutdown_connections 2023-10-09T07:01:08.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.229+0000 7f9fbcd9d700 1 --2- 172.21.15.71:0/2099172432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fb80b0a00 0x7f9fb815d300 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.229+0000 7f9fbcd9d700 1 --2- 172.21.15.71:0/2099172432 >> v2:172.21.15.179:3300/0 conn(0x7f9fb8068aa0 0x7f9fb80b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.229+0000 7f9fbcd9d700 1 -- 172.21.15.71:0/2099172432 >> 172.21.15.71:0/2099172432 conn(0x7f9fb80cd310 msgr2=0x7f9fb80cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:08.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.229+0000 7f9fbcd9d700 1 -- 172.21.15.71:0/2099172432 shutdown_connections 2023-10-09T07:01:08.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.229+0000 7f9fbcd9d700 1 -- 172.21.15.71:0/2099172432 wait complete. 2023-10-09T07:01:08.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.231+0000 7f9fbcd9d700 1 Processor -- start 2023-10-09T07:01:08.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.231+0000 7f9fbcd9d700 1 -- start start 2023-10-09T07:01:08.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.232+0000 7f9fbcd9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb8068aa0 0x7f9fb8169640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:08.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.232+0000 7f9fbcd9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fb80b0a00 0x7f9fb8145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:08.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.232+0000 7f9fbcd9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb8157270 0x7f9fb80ab900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:08.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.232+0000 7f9fbcd9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb815b8f0 con 0x7f9fb80b0a00 2023-10-09T07:01:08.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.232+0000 7f9fbcd9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb815ee20 con 0x7f9fb8068aa0 2023-10-09T07:01:08.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.232+0000 7f9fbcd9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb81462e0 con 0x7f9fb8157270 2023-10-09T07:01:08.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.232+0000 7f9fb6ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fb80b0a00 0x7f9fb8145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:08.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.232+0000 7f9fb6ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fb80b0a00 0x7f9fb8145da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34994/0 (socket says 172.21.15.71:34994) 2023-10-09T07:01:08.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.232+0000 7f9fb6ffd700 1 -- 172.21.15.71:0/3296503854 learned_addr learned my addr 172.21.15.71:0/3296503854 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:08.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.232+0000 7f9fb77fe700 1 --2- 172.21.15.71:0/3296503854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb8068aa0 0x7f9fb8169640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:08.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.232+0000 7f9fb7fff700 1 --2- 172.21.15.71:0/3296503854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb8157270 0x7f9fb80ab900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:08.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.233+0000 7f9fb6ffd700 1 -- 172.21.15.71:0/3296503854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb8157270 msgr2=0x7f9fb80ab900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:08.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.233+0000 7f9fb6ffd700 1 --2- 172.21.15.71:0/3296503854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb8157270 0x7f9fb80ab900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.233+0000 7f9fb6ffd700 1 -- 172.21.15.71:0/3296503854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb8068aa0 msgr2=0x7f9fb8169640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:08.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.233+0000 7f9fb6ffd700 1 --2- 172.21.15.71:0/3296503854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb8068aa0 0x7f9fb8169640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.233+0000 7f9fb6ffd700 1 -- 172.21.15.71:0/3296503854 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb0009ae0 con 0x7f9fb80b0a00 2023-10-09T07:01:08.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.233+0000 7f9fb6ffd700 1 --2- 172.21.15.71:0/3296503854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fb80b0a00 0x7f9fb8145da0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00ec50 tx=0x7f9fac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:08.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.233+0000 7f9f9f7fe700 1 -- 172.21.15.71:0/3296503854 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac00c850 con 0x7f9fb80b0a00 2023-10-09T07:01:08.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.233+0000 7f9f9f7fe700 1 -- 172.21.15.71:0/3296503854 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac00c9b0 con 0x7f9fb80b0a00 2023-10-09T07:01:08.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.233+0000 7f9f9f7fe700 1 -- 172.21.15.71:0/3296503854 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac00cd70 con 0x7f9fb80b0a00 2023-10-09T07:01:08.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.233+0000 7f9fbcd9d700 1 -- 172.21.15.71:0/3296503854 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb815afc0 con 0x7f9fb80b0a00 2023-10-09T07:01:08.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.234+0000 7f9fbcd9d700 1 -- 172.21.15.71:0/3296503854 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb815b580 con 0x7f9fb80b0a00 2023-10-09T07:01:08.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.235+0000 7f9fbcd9d700 1 -- 172.21.15.71:0/3296503854 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb815ba60 con 0x7f9fb80b0a00 2023-10-09T07:01:08.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.235+0000 7f9f9f7fe700 1 -- 172.21.15.71:0/3296503854 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 55) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f9fac013680 con 0x7f9fb80b0a00 2023-10-09T07:01:08.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.236+0000 7f9f9f7fe700 1 --2- 172.21.15.71:0/3296503854 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9fa4067170 0x7f9fa4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:08.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.236+0000 7f9f9f7fe700 1 -- 172.21.15.71:0/3296503854 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f9fac084d60 con 0x7f9fb80b0a00 2023-10-09T07:01:08.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.237+0000 7f9fb77fe700 1 -- 172.21.15.71:0/3296503854 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9fa4067170 msgr2=0x7f9fa4069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:08.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.237+0000 7f9fb77fe700 1 --2- 172.21.15.71:0/3296503854 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9fa4067170 0x7f9fa4069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:01:08.238 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:08.238+0000 7f1979ff8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T07:01:08.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.240+0000 7f9f9f7fe700 1 -- 172.21.15.71:0/3296503854 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9fac051a80 con 0x7f9fb80b0a00 2023-10-09T07:01:08.353 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:08.353+0000 7f6c9b721180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T07:01:08.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.438+0000 7f9fb77fe700 1 -- 172.21.15.71:0/3296503854 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9fa4067170 msgr2=0x7f9fa4069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:08.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.438+0000 7f9fb77fe700 1 --2- 172.21.15.71:0/3296503854 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9fa4067170 0x7f9fa4069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:01:08.451 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:08.451+0000 7f6c9b721180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T07:01:08.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.482+0000 7f9fbcd9d700 1 -- 172.21.15.71:0/3296503854 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9fb804c3c0 con 0x7f9fb80b0a00 2023-10-09T07:01:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.483+0000 7f9f9f7fe700 1 -- 172.21.15.71:0/3296503854 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f9fac0550a0 con 0x7f9fb80b0a00 2023-10-09T07:01:08.483 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:01:08.483 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7378,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1918195834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1918195834},{"type":"v1","addr":"172.21.15.179:6834","nonce":1918195834}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7644,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3880476818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3880476818},{"type":"v1","addr":"172.21.15.71:6833","nonce":3880476818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7656,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/4215423233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":4215423233},{"type":"v1","addr":"172.21.15.179:6836","nonce":4215423233}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:00:31.315026+0000","modified":"2023-10-09T07:00:34.863796+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/3141191512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3141191512},{"type":"v1","addr":"172.21.15.71:6835","nonce":3141191512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T07:01:08.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.485+0000 7f9fbcd9d700 1 -- 172.21.15.71:0/3296503854 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9fa4067170 msgr2=0x7f9fa4069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:01:08.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.485+0000 7f9fbcd9d700 1 --2- 172.21.15.71:0/3296503854 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9fa4067170 0x7f9fa4069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.485+0000 7f9fbcd9d700 1 -- 172.21.15.71:0/3296503854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fb80b0a00 msgr2=0x7f9fb8145da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:08.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.485+0000 7f9fbcd9d700 1 --2- 172.21.15.71:0/3296503854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fb80b0a00 0x7f9fb8145da0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00ec50 tx=0x7f9fac0091a0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.485+0000 7f9fbcd9d700 1 -- 172.21.15.71:0/3296503854 shutdown_connections 2023-10-09T07:01:08.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.485+0000 7f9fbcd9d700 1 --2- 172.21.15.71:0/3296503854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb8157270 0x7f9fb80ab900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.485+0000 7f9fbcd9d700 1 --2- 172.21.15.71:0/3296503854 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9fa4067170 0x7f9fa4069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.485+0000 7f9fbcd9d700 1 --2- 172.21.15.71:0/3296503854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb8068aa0 0x7f9fb8169640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.485+0000 7f9fbcd9d700 1 --2- 172.21.15.71:0/3296503854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fb80b0a00 0x7f9fb8145da0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.485+0000 7f9fbcd9d700 1 -- 172.21.15.71:0/3296503854 >> 172.21.15.71:0/3296503854 conn(0x7f9fb80cd310 msgr2=0x7f9fb8152ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:08.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.486+0000 7f9fbcd9d700 1 -- 172.21.15.71:0/3296503854 shutdown_connections 2023-10-09T07:01:08.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.486+0000 7f9fbcd9d700 1 -- 172.21.15.71:0/3296503854 wait complete. 2023-10-09T07:01:08.487 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 58 2023-10-09T07:01:08.503 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:01:08.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.732+0000 7ff1cdb9d700 1 Processor -- start 2023-10-09T07:01:08.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.732+0000 7ff1cdb9d700 1 -- start start 2023-10-09T07:01:08.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.733+0000 7ff1cdb9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff1c8142ea0 0x7ff1c80b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:08.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.733+0000 7ff1cdb9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1c80ad870 0x7ff1c806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:08.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.734+0000 7ff1cdb9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c80b40f0 con 0x7ff1c80b3b70 2023-10-09T07:01:08.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.734+0000 7ff1cdb9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c8069640 con 0x7ff1c8142ea0 2023-10-09T07:01:08.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.734+0000 7ff1cdb9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c8069920 con 0x7ff1c80ad870 2023-10-09T07:01:08.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.734+0000 7ff1ccb9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff1c8142ea0 0x7ff1c80b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:08.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.734+0000 7ff1ccb9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff1c8142ea0 0x7ff1c80b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35010/0 (socket says 172.21.15.71:35010) 2023-10-09T07:01:08.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.734+0000 7ff1ccb9b700 1 -- 172.21.15.71:0/2446471600 learned_addr learned my addr 172.21.15.71:0/2446471600 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:08.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.734+0000 7ff1c7fff700 1 --2- 172.21.15.71:0/2446471600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1c80ad870 0x7ff1c806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:08.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.734+0000 7ff1ccb9b700 1 -- 172.21.15.71:0/2446471600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1c80ad870 msgr2=0x7ff1c806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:08.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.734+0000 7ff1ccb9b700 1 --2- 172.21.15.71:0/2446471600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1c80ad870 0x7ff1c806b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.734+0000 7ff1ccb9b700 1 -- 172.21.15.71:0/2446471600 >> v1:172.21.15.179:6789/0 conn(0x7ff1c80b3b70 legacy=0x7ff1c806cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:08.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.734+0000 7ff1ccb9b700 1 -- 172.21.15.71:0/2446471600 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c8069c00 con 0x7ff1c8142ea0 2023-10-09T07:01:08.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.735+0000 7ff1ccb9b700 1 --2- 172.21.15.71:0/2446471600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1c8142ea0 0x7ff1c80b3630 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0099b0 tx=0x7ff1bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551942ca067c0a47 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:08.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.735+0000 7ff1c77fe700 1 -- 172.21.15.71:0/2446471600 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc00b860 con 0x7ff1c8142ea0 2023-10-09T07:01:08.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.735+0000 7ff1c77fe700 1 -- 172.21.15.71:0/2446471600 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc00b9c0 con 0x7ff1c8142ea0 2023-10-09T07:01:08.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.735+0000 7ff1c77fe700 1 -- 172.21.15.71:0/2446471600 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc00bd60 con 0x7ff1c8142ea0 2023-10-09T07:01:08.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.735+0000 7ff1cdb9d700 1 -- 172.21.15.71:0/2446471600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1c8142ea0 msgr2=0x7ff1c80b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:08.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.735+0000 7ff1cdb9d700 1 --2- 172.21.15.71:0/2446471600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1c8142ea0 0x7ff1c80b3630 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0099b0 tx=0x7ff1bc009250 comp rx=0 tx=0).stop 2023-10-09T07:01:08.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.735+0000 7ff1cdb9d700 1 -- 172.21.15.71:0/2446471600 shutdown_connections 2023-10-09T07:01:08.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.735+0000 7ff1cdb9d700 1 --2- 172.21.15.71:0/2446471600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1c8142ea0 0x7ff1c80b3630 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.735+0000 7ff1cdb9d700 1 --2- 172.21.15.71:0/2446471600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1c80ad870 0x7ff1c806b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.735+0000 7ff1cdb9d700 1 -- 172.21.15.71:0/2446471600 >> 172.21.15.71:0/2446471600 conn(0x7ff1c80ce430 msgr2=0x7ff1c80ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:08.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.736+0000 7ff1cdb9d700 1 -- 172.21.15.71:0/2446471600 shutdown_connections 2023-10-09T07:01:08.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.736+0000 7ff1cdb9d700 1 -- 172.21.15.71:0/2446471600 wait complete. 2023-10-09T07:01:08.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.737+0000 7ff1cdb9d700 1 Processor -- start 2023-10-09T07:01:08.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.737+0000 7ff1cdb9d700 1 -- start start 2023-10-09T07:01:08.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.738+0000 7ff1cdb9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1c80b3b70 0x7ff1c8158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:08.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.738+0000 7ff1cdb9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1c8142ea0 0x7ff1c815ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:08.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.738+0000 7ff1cdb9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1c815b220 0x7ff1c816d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:08.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.738+0000 7ff1cdb9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c813f3a0 con 0x7ff1c815b220 2023-10-09T07:01:08.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.738+0000 7ff1cdb9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c815b680 con 0x7ff1c80b3b70 2023-10-09T07:01:08.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.738+0000 7ff1cdb9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c80ae7b0 con 0x7ff1c8142ea0 2023-10-09T07:01:08.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.738+0000 7ff1cd39c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1c815b220 0x7ff1c816d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:08.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.738+0000 7ff1ccb9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1c80b3b70 0x7ff1c8158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:08.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.738+0000 7ff1c7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1c8142ea0 0x7ff1c815ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:08.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.738+0000 7ff1ccb9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1c80b3b70 0x7ff1c8158e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:39058/0 (socket says 172.21.15.71:39058) 2023-10-09T07:01:08.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.738+0000 7ff1ccb9b700 1 -- 172.21.15.71:0/579307768 learned_addr learned my addr 172.21.15.71:0/579307768 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:08.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.738+0000 7ff1cd39c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1c815b220 0x7ff1c816d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35026/0 (socket says 172.21.15.71:35026) 2023-10-09T07:01:08.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.739+0000 7ff1cd39c700 1 -- 172.21.15.71:0/579307768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1c8142ea0 msgr2=0x7ff1c815ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:08.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.739+0000 7ff1cd39c700 1 --2- 172.21.15.71:0/579307768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1c8142ea0 0x7ff1c815ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.739+0000 7ff1cd39c700 1 -- 172.21.15.71:0/579307768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1c80b3b70 msgr2=0x7ff1c8158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:08.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.739+0000 7ff1cd39c700 1 --2- 172.21.15.71:0/579307768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1c80b3b70 0x7ff1c8158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.739+0000 7ff1cd39c700 1 -- 172.21.15.71:0/579307768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc0094f0 con 0x7ff1c815b220 2023-10-09T07:01:08.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.739+0000 7ff1cd39c700 1 --2- 172.21.15.71:0/579307768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1c815b220 0x7ff1c816d180 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000c830 tx=0x7ff1c0001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:08.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.739+0000 7ff1c4ff9700 1 -- 172.21.15.71:0/579307768 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0012630 con 0x7ff1c815b220 2023-10-09T07:01:08.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.739+0000 7ff1c4ff9700 1 -- 172.21.15.71:0/579307768 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c0012790 con 0x7ff1c815b220 2023-10-09T07:01:08.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.739+0000 7ff1cdb9d700 1 -- 172.21.15.71:0/579307768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c816ddb0 con 0x7ff1c815b220 2023-10-09T07:01:08.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.739+0000 7ff1c4ff9700 1 -- 172.21.15.71:0/579307768 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0012b50 con 0x7ff1c815b220 2023-10-09T07:01:08.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.739+0000 7ff1cdb9d700 1 -- 172.21.15.71:0/579307768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c80ae4c0 con 0x7ff1c815b220 2023-10-09T07:01:08.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.740+0000 7ff1cdb9d700 1 -- 172.21.15.71:0/579307768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c804c3c0 con 0x7ff1c815b220 2023-10-09T07:01:08.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.741+0000 7ff1c4ff9700 1 -- 172.21.15.71:0/579307768 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 55) v1 ==== 84956+0+0 (secure 0 0 0) 0x7ff1c001a3a0 con 0x7ff1c815b220 2023-10-09T07:01:08.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.743+0000 7ff1c4ff9700 1 --2- 172.21.15.71:0/579307768 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff1ac067170 0x7ff1ac069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:08.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.743+0000 7ff1c4ff9700 1 -- 172.21.15.71:0/579307768 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6411+0+0 (secure 0 0 0) 0x7ff1c0084cc0 con 0x7ff1c815b220 2023-10-09T07:01:08.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.743+0000 7ff1ccb9b700 1 -- 172.21.15.71:0/579307768 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff1ac067170 msgr2=0x7ff1ac069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:08.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.743+0000 7ff1ccb9b700 1 --2- 172.21.15.71:0/579307768 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff1ac067170 0x7ff1ac069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:01:08.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.747+0000 7ff1c4ff9700 1 -- 172.21.15.71:0/579307768 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1c008b080 con 0x7ff1c815b220 2023-10-09T07:01:08.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.944+0000 7ff1ccb9b700 1 -- 172.21.15.71:0/579307768 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff1ac067170 msgr2=0x7ff1ac069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:08.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.944+0000 7ff1ccb9b700 1 --2- 172.21.15.71:0/579307768 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff1ac067170 0x7ff1ac069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:01:08.944 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:08.944+0000 7f1979ff8180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T07:01:08.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.948+0000 7ff1cdb9d700 1 -- 172.21.15.71:0/579307768 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1c8143270 con 0x7ff1c815b220 2023-10-09T07:01:08.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.949+0000 7ff1c4ff9700 1 -- 172.21.15.71:0/579307768 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+16443 (secure 0 0 0) 0x7ff1c0051940 con 0x7ff1c815b220 2023-10-09T07:01:08.949 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:01:08.949 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":125,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:01:06.011610+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:00:28.965075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T07:00:30.294796+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":125,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:0/3535588607":"2023-10-10T07:00:46.934396+0000","172.21.15.179:6837/85452":"2023-10-10T07:00:46.934396+0000","172.21.15.179:6835/85452":"2023-10-10T07:00:46.934396+0000","172.21.15.179:0/1997380181":"2023-10-10T07:00:46.934396+0000","172.21.15.179:0/3456675137":"2023-10-10T07:00:46.934396+0000","172.21.15.179:0/1765057334":"2023-10-10T07:00:46.934396+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:01:08.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.951+0000 7ff1cdb9d700 1 -- 172.21.15.71:0/579307768 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff1ac067170 msgr2=0x7ff1ac069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:01:08.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.951+0000 7ff1cdb9d700 1 --2- 172.21.15.71:0/579307768 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff1ac067170 0x7ff1ac069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.951+0000 7ff1cdb9d700 1 -- 172.21.15.71:0/579307768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1c815b220 msgr2=0x7ff1c816d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:08.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.952+0000 7ff1cdb9d700 1 --2- 172.21.15.71:0/579307768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1c815b220 0x7ff1c816d180 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000c830 tx=0x7ff1c0001690 comp rx=0 tx=0).stop 2023-10-09T07:01:08.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.952+0000 7ff1cdb9d700 1 -- 172.21.15.71:0/579307768 shutdown_connections 2023-10-09T07:01:08.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.952+0000 7ff1cdb9d700 1 --2- 172.21.15.71:0/579307768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1c815b220 0x7ff1c816d180 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.952+0000 7ff1cdb9d700 1 --2- 172.21.15.71:0/579307768 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff1ac067170 0x7ff1ac069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.952+0000 7ff1cdb9d700 1 --2- 172.21.15.71:0/579307768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1c80b3b70 0x7ff1c8158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.952+0000 7ff1cdb9d700 1 --2- 172.21.15.71:0/579307768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1c8142ea0 0x7ff1c815ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:08.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.952+0000 7ff1cdb9d700 1 -- 172.21.15.71:0/579307768 >> 172.21.15.71:0/579307768 conn(0x7ff1c80ce430 msgr2=0x7ff1c8141f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:08.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.952+0000 7ff1cdb9d700 1 -- 172.21.15.71:0/579307768 shutdown_connections 2023-10-09T07:01:08.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:08.952+0000 7ff1cdb9d700 1 -- 172.21.15.71:0/579307768 wait complete. 2023-10-09T07:01:08.971 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T07:01:09.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.160+0000 7fcb809fe700 1 Processor -- start 2023-10-09T07:01:09.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.161+0000 7fcb809fe700 1 -- start start 2023-10-09T07:01:09.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.162+0000 7fcb809fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb7c0ad870 0x7fcb7c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:09.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.162+0000 7fcb809fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcb7c06bf20 0x7fcb7c06a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:09.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.162+0000 7fcb809fe700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb7c06c350 con 0x7fcb7c142ea0 2023-10-09T07:01:09.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.162+0000 7fcb809fe700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb7c0b40f0 con 0x7fcb7c06bf20 2023-10-09T07:01:09.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.162+0000 7fcb809fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c069640 con 0x7fcb7c0ad870 2023-10-09T07:01:09.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.162+0000 7fcb7a59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb7c0ad870 0x7fcb7c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:09.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.162+0000 7fcb7ad9d700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fcb7c142ea0 0x7fcb7c0b3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:53276/0 (socket says 172.21.15.71:53276) 2023-10-09T07:01:09.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.162+0000 7fcb7ad9d700 1 -- 172.21.15.71:0/3862355873 learned_addr learned my addr 172.21.15.71:0/3862355873 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:01:09.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.162+0000 7fcb7b59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcb7c06bf20 0x7fcb7c06a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:09.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.163+0000 7fcb79d9b700 1 -- 172.21.15.71:0/3862355873 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 714801779 0 0) 0x7fcb7c06c350 con 0x7fcb7c142ea0 2023-10-09T07:01:09.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.163+0000 7fcb79d9b700 1 -- 172.21.15.71:0/3862355873 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb64003570 con 0x7fcb7c142ea0 2023-10-09T07:01:09.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.163+0000 7fcb7a59c700 1 -- 172.21.15.71:0/3862355873 >> v2:172.21.15.179:3300/0 conn(0x7fcb7c06bf20 msgr2=0x7fcb7c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:09.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.163+0000 7fcb7a59c700 1 --2- 172.21.15.71:0/3862355873 >> v2:172.21.15.179:3300/0 conn(0x7fcb7c06bf20 0x7fcb7c06a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:09.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.163+0000 7fcb7a59c700 1 -- 172.21.15.71:0/3862355873 >> v1:172.21.15.179:6789/0 conn(0x7fcb7c142ea0 legacy=0x7fcb7c0b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:09.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.163+0000 7fcb7a59c700 1 -- 172.21.15.71:0/3862355873 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7c069920 con 0x7fcb7c0ad870 2023-10-09T07:01:09.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.163+0000 7fcb7b59e700 1 --2- 172.21.15.71:0/3862355873 >> v2:172.21.15.179:3300/0 conn(0x7fcb7c06bf20 0x7fcb7c06a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:01:09.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.163+0000 7fcb7a59c700 1 --2- 172.21.15.71:0/3862355873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb7c0ad870 0x7fcb7c06b9e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcb700098e0 tx=0x7fcb700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1582e890350e56a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:09.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.164+0000 7fcb79d9b700 1 -- 172.21.15.71:0/3862355873 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb70011630 con 0x7fcb7c0ad870 2023-10-09T07:01:09.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.164+0000 7fcb79d9b700 1 -- 172.21.15.71:0/3862355873 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb70011790 con 0x7fcb7c0ad870 2023-10-09T07:01:09.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.164+0000 7fcb79d9b700 1 -- 172.21.15.71:0/3862355873 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb70011b30 con 0x7fcb7c0ad870 2023-10-09T07:01:09.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.164+0000 7fcb809fe700 1 -- 172.21.15.71:0/3862355873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb7c0ad870 msgr2=0x7fcb7c06b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:09.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.164+0000 7fcb809fe700 1 --2- 172.21.15.71:0/3862355873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb7c0ad870 0x7fcb7c06b9e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcb700098e0 tx=0x7fcb700091a0 comp rx=0 tx=0).stop 2023-10-09T07:01:09.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.164+0000 7fcb809fe700 1 -- 172.21.15.71:0/3862355873 shutdown_connections 2023-10-09T07:01:09.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.164+0000 7fcb809fe700 1 --2- 172.21.15.71:0/3862355873 >> v2:172.21.15.179:3300/0 conn(0x7fcb7c06bf20 0x7fcb7c06a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:09.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.164+0000 7fcb809fe700 1 --2- 172.21.15.71:0/3862355873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb7c0ad870 0x7fcb7c06b9e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:09.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.164+0000 7fcb809fe700 1 -- 172.21.15.71:0/3862355873 >> 172.21.15.71:0/3862355873 conn(0x7fcb7c0ce430 msgr2=0x7fcb7c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:09.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.164+0000 7fcb809fe700 1 -- 172.21.15.71:0/3862355873 shutdown_connections 2023-10-09T07:01:09.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.164+0000 7fcb809fe700 1 -- 172.21.15.71:0/3862355873 wait complete. 2023-10-09T07:01:09.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.166+0000 7fcb809fe700 1 Processor -- start 2023-10-09T07:01:09.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.166+0000 7fcb809fe700 1 -- start start 2023-10-09T07:01:09.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.167+0000 7fcb809fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb7c06bf20 0x7fcb7c0c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:09.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.167+0000 7fcb809fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb7c142ea0 0x7fcb7c158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:09.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.167+0000 7fcb809fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb7c0c85b0 0x7fcb7c15ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:09.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.167+0000 7fcb809fe700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c0c8b00 con 0x7fcb7c06bf20 2023-10-09T07:01:09.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.167+0000 7fcb809fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c0c8de0 con 0x7fcb7c0c85b0 2023-10-09T07:01:09.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.167+0000 7fcb809fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c0c90c0 con 0x7fcb7c142ea0 2023-10-09T07:01:09.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.167+0000 7fcb7ad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb7c06bf20 0x7fcb7c0c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:09.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.167+0000 7fcb7ad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb7c06bf20 0x7fcb7c0c9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35032/0 (socket says 172.21.15.71:35032) 2023-10-09T07:01:09.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.167+0000 7fcb7ad9d700 1 -- 172.21.15.71:0/3303657268 learned_addr learned my addr 172.21.15.71:0/3303657268 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:09.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.167+0000 7fcb7a59c700 1 --2- 172.21.15.71:0/3303657268 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb7c142ea0 0x7fcb7c158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:09.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.167+0000 7fcb7b59e700 1 --2- 172.21.15.71:0/3303657268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb7c0c85b0 0x7fcb7c15ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:09.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.168+0000 7fcb7ad9d700 1 -- 172.21.15.71:0/3303657268 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb7c142ea0 msgr2=0x7fcb7c158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:09.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.168+0000 7fcb7ad9d700 1 --2- 172.21.15.71:0/3303657268 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb7c142ea0 0x7fcb7c158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:09.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.168+0000 7fcb7ad9d700 1 -- 172.21.15.71:0/3303657268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb7c0c85b0 msgr2=0x7fcb7c15ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:09.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.168+0000 7fcb7ad9d700 1 --2- 172.21.15.71:0/3303657268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb7c0c85b0 0x7fcb7c15ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:09.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.168+0000 7fcb7ad9d700 1 -- 172.21.15.71:0/3303657268 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb74009a20 con 0x7fcb7c06bf20 2023-10-09T07:01:09.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.168+0000 7fcb7ad9d700 1 --2- 172.21.15.71:0/3303657268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb7c06bf20 0x7fcb7c0c9dd0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c00c590 tx=0x7fcb6c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:09.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.168+0000 7fcb62ffd700 1 -- 172.21.15.71:0/3303657268 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c005cd0 con 0x7fcb7c06bf20 2023-10-09T07:01:09.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.168+0000 7fcb62ffd700 1 -- 172.21.15.71:0/3303657268 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6c005e50 con 0x7fcb7c06bf20 2023-10-09T07:01:09.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.168+0000 7fcb809fe700 1 -- 172.21.15.71:0/3303657268 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb70009420 con 0x7fcb7c06bf20 2023-10-09T07:01:09.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.168+0000 7fcb62ffd700 1 -- 172.21.15.71:0/3303657268 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c007320 con 0x7fcb7c06bf20 2023-10-09T07:01:09.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.168+0000 7fcb809fe700 1 -- 172.21.15.71:0/3303657268 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7c0ca310 con 0x7fcb7c06bf20 2023-10-09T07:01:09.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.169+0000 7fcb809fe700 1 -- 172.21.15.71:0/3303657268 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb7c04c3c0 con 0x7fcb7c06bf20 2023-10-09T07:01:09.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.170+0000 7fcb62ffd700 1 -- 172.21.15.71:0/3303657268 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 55) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fcb6c01b3b0 con 0x7fcb7c06bf20 2023-10-09T07:01:09.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.171+0000 7fcb62ffd700 1 --2- 172.21.15.71:0/3303657268 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcb68067170 0x7fcb68069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:09.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.171+0000 7fcb62ffd700 1 -- 172.21.15.71:0/3303657268 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6411+0+0 (secure 0 0 0) 0x7fcb6c084180 con 0x7fcb7c06bf20 2023-10-09T07:01:09.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.171+0000 7fcb7a59c700 1 -- 172.21.15.71:0/3303657268 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcb68067170 msgr2=0x7fcb68069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:09.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.172+0000 7fcb7a59c700 1 --2- 172.21.15.71:0/3303657268 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcb68067170 0x7fcb68069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:01:09.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.176+0000 7fcb62ffd700 1 -- 172.21.15.71:0/3303657268 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb6c050f60 con 0x7fcb7c06bf20 2023-10-09T07:01:09.195 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:09.195+0000 7f6c9b721180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T07:01:09.231 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:09.231+0000 7f1979ff8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T07:01:09.322 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:09.322+0000 7f1979ff8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T07:01:09.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.373+0000 7fcb7a59c700 1 -- 172.21.15.71:0/3303657268 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcb68067170 msgr2=0x7fcb68069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:09.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.373+0000 7fcb7a59c700 1 --2- 172.21.15.71:0/3303657268 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcb68067170 0x7fcb68069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:01:09.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.413+0000 7fcb809fe700 1 -- 172.21.15.71:0/3303657268 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcb7c15bda0 con 0x7fcb7c06bf20 2023-10-09T07:01:09.415 INFO:tasks.ceph.mon.a.smithi071.stderr:2023-10-09T07:01:09.414+0000 7fdb445f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T07:01:09.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.422+0000 7fcb62ffd700 1 -- 172.21.15.71:0/3303657268 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v59) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcb6c054580 con 0x7fcb7c06bf20 2023-10-09T07:01:09.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.425+0000 7fcb809fe700 1 -- 172.21.15.71:0/3303657268 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcb68067170 msgr2=0x7fcb68069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:01:09.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.425+0000 7fcb809fe700 1 --2- 172.21.15.71:0/3303657268 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcb68067170 0x7fcb68069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:09.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.425+0000 7fcb809fe700 1 -- 172.21.15.71:0/3303657268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb7c06bf20 msgr2=0x7fcb7c0c9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:09.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.425+0000 7fcb809fe700 1 --2- 172.21.15.71:0/3303657268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb7c06bf20 0x7fcb7c0c9dd0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c00c590 tx=0x7fcb6c007e00 comp rx=0 tx=0).stop 2023-10-09T07:01:09.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.425+0000 7fcb809fe700 1 -- 172.21.15.71:0/3303657268 shutdown_connections 2023-10-09T07:01:09.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.425+0000 7fcb809fe700 1 --2- 172.21.15.71:0/3303657268 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcb68067170 0x7fcb68069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:09.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.425+0000 7fcb809fe700 1 --2- 172.21.15.71:0/3303657268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb7c0c85b0 0x7fcb7c15ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:09.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.425+0000 7fcb809fe700 1 --2- 172.21.15.71:0/3303657268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb7c06bf20 0x7fcb7c0c9dd0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:09.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.425+0000 7fcb809fe700 1 --2- 172.21.15.71:0/3303657268 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb7c142ea0 0x7fcb7c158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:09.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.425+0000 7fcb809fe700 1 -- 172.21.15.71:0/3303657268 >> 172.21.15.71:0/3303657268 conn(0x7fcb7c0ce430 msgr2=0x7fcb7c0cc920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:09.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.425+0000 7fcb809fe700 1 -- 172.21.15.71:0/3303657268 shutdown_connections 2023-10-09T07:01:09.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.425+0000 7fcb809fe700 1 -- 172.21.15.71:0/3303657268 wait complete. 2023-10-09T07:01:09.426 INFO:teuthology.orchestra.run.smithi071.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T07:01:09.429 INFO:tasks.ceph.mds.a.smithi071.stderr: -4723> 2023-10-09T07:00:35.815+0000 7fa8333f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T07:01:09.443 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T07:01:09.475 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2023-10-09T07:01:09.478 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:09.478+0000 7f1979ff8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T07:01:09.492 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:09.492+0000 7f6c9b721180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T07:01:09.584 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:09.583+0000 7f1979ff8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T07:01:09.590 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:09.590+0000 7f6c9b721180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T07:01:09.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.638+0000 7f262ed9d700 1 Processor -- start 2023-10-09T07:01:09.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.638+0000 7f262ed9d700 1 -- start start 2023-10-09T07:01:09.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.640+0000 7f262ed9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26280b4e70 0x7f26280ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:09.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.640+0000 7f262ed9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f26280b1b40 0x7f262815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:09.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.640+0000 7f262ed9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26280cfb00 con 0x7f26280b16d0 2023-10-09T07:01:09.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.640+0000 7f262ed9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26280b5c40 con 0x7f26280b1b40 2023-10-09T07:01:09.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.640+0000 7f262ed9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26280b5f20 con 0x7f26280b4e70 2023-10-09T07:01:09.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.640+0000 7f262d59a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f26280b16d0 0x7f262815d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39808/0 (socket says 172.21.15.71:39808) 2023-10-09T07:01:09.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.640+0000 7f262e59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f26280b1b40 0x7f262815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:09.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.640+0000 7f262d59a700 1 -- 172.21.15.71:0/4163757850 learned_addr learned my addr 172.21.15.71:0/4163757850 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:01:09.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.640+0000 7f262dd9b700 1 --2- 172.21.15.71:0/4163757850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26280b4e70 0x7f26280ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:09.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.640+0000 7f262cd99700 1 -- 172.21.15.71:0/4163757850 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847163603 0 0) 0x7f26280cfb00 con 0x7f26280b16d0 2023-10-09T07:01:09.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.641+0000 7f262cd99700 1 -- 172.21.15.71:0/4163757850 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2614003570 con 0x7f26280b16d0 2023-10-09T07:01:09.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.641+0000 7f262e59c700 1 -- 172.21.15.71:0/4163757850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26280b4e70 msgr2=0x7f26280ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:09.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.641+0000 7f262e59c700 1 --2- 172.21.15.71:0/4163757850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26280b4e70 0x7f26280ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:09.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.641+0000 7f262e59c700 1 -- 172.21.15.71:0/4163757850 >> v1:172.21.15.71:6789/0 conn(0x7f26280b16d0 legacy=0x7f262815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:09.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.641+0000 7f262e59c700 1 -- 172.21.15.71:0/4163757850 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26280b6200 con 0x7f26280b1b40 2023-10-09T07:01:09.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.641+0000 7f262e59c700 1 --2- 172.21.15.71:0/4163757850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26280b1b40 0x7f262815d950 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f2620009e60 tx=0x7f2620009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff37429f0d14b888 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:09.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.641+0000 7f262cd99700 1 -- 172.21.15.71:0/4163757850 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262000e070 con 0x7f26280b1b40 2023-10-09T07:01:09.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.641+0000 7f262cd99700 1 -- 172.21.15.71:0/4163757850 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262000bab0 con 0x7f26280b1b40 2023-10-09T07:01:09.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.641+0000 7f262cd99700 1 -- 172.21.15.71:0/4163757850 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262000be70 con 0x7f26280b1b40 2023-10-09T07:01:09.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.642+0000 7f262ed9d700 1 -- 172.21.15.71:0/4163757850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26280b1b40 msgr2=0x7f262815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:09.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.642+0000 7f262ed9d700 1 --2- 172.21.15.71:0/4163757850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26280b1b40 0x7f262815d950 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f2620009e60 tx=0x7f2620009780 comp rx=0 tx=0).stop 2023-10-09T07:01:09.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.642+0000 7f262ed9d700 1 -- 172.21.15.71:0/4163757850 shutdown_connections 2023-10-09T07:01:09.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.642+0000 7f262ed9d700 1 --2- 172.21.15.71:0/4163757850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26280b1b40 0x7f262815d950 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:09.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.642+0000 7f262ed9d700 1 --2- 172.21.15.71:0/4163757850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26280b4e70 0x7f26280ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:09.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.642+0000 7f262ed9d700 1 -- 172.21.15.71:0/4163757850 >> 172.21.15.71:0/4163757850 conn(0x7f26280d10c0 msgr2=0x7f26280affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:09.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.642+0000 7f262ed9d700 1 -- 172.21.15.71:0/4163757850 shutdown_connections 2023-10-09T07:01:09.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.642+0000 7f262ed9d700 1 -- 172.21.15.71:0/4163757850 wait complete. 2023-10-09T07:01:09.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.643+0000 7f262ed9d700 1 Processor -- start 2023-10-09T07:01:09.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.643+0000 7f262ed9d700 1 -- start start 2023-10-09T07:01:09.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.644+0000 7f262ed9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26280b16d0 0x7f26280cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:09.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.644+0000 7f262ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26280b1b40 0x7f26280c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:09.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.644+0000 7f262ed9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26280b4e70 0x7f262814c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:09.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.644+0000 7f262ed9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26280c7a80 con 0x7f26280b1b40 2023-10-09T07:01:09.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.644+0000 7f262ed9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26280c86b0 con 0x7f26280b16d0 2023-10-09T07:01:09.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.644+0000 7f262ed9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26280c77e0 con 0x7f26280b4e70 2023-10-09T07:01:09.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.645+0000 7f262d59a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26280b1b40 0x7f26280c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:09.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.645+0000 7f262d59a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26280b1b40 0x7f26280c72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35060/0 (socket says 172.21.15.71:35060) 2023-10-09T07:01:09.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.645+0000 7f262d59a700 1 -- 172.21.15.71:0/1030127059 learned_addr learned my addr 172.21.15.71:0/1030127059 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:09.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.645+0000 7f262dd9b700 1 --2- 172.21.15.71:0/1030127059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26280b16d0 0x7f26280cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:09.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.645+0000 7f262e59c700 1 --2- 172.21.15.71:0/1030127059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26280b4e70 0x7f262814c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:09.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.645+0000 7f262d59a700 1 -- 172.21.15.71:0/1030127059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26280b4e70 msgr2=0x7f262814c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:09.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.645+0000 7f262d59a700 1 --2- 172.21.15.71:0/1030127059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26280b4e70 0x7f262814c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:09.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.645+0000 7f262d59a700 1 -- 172.21.15.71:0/1030127059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26280b16d0 msgr2=0x7f26280cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:09.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.645+0000 7f262d59a700 1 --2- 172.21.15.71:0/1030127059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26280b16d0 0x7f26280cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:09.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.645+0000 7f262d59a700 1 -- 172.21.15.71:0/1030127059 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2620009a20 con 0x7f26280b1b40 2023-10-09T07:01:09.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.645+0000 7f262d59a700 1 --2- 172.21.15.71:0/1030127059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26280b1b40 0x7f26280c72a0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f261800c7c0 tx=0x7f2618007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:09.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.646+0000 7f261dffb700 1 -- 172.21.15.71:0/1030127059 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2618005cd0 con 0x7f26280b1b40 2023-10-09T07:01:09.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.646+0000 7f261dffb700 1 -- 172.21.15.71:0/1030127059 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2618005e30 con 0x7f26280b1b40 2023-10-09T07:01:09.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.646+0000 7f261dffb700 1 -- 172.21.15.71:0/1030127059 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2618007320 con 0x7f26280b1b40 2023-10-09T07:01:09.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.646+0000 7f262ed9d700 1 -- 172.21.15.71:0/1030127059 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262814c720 con 0x7f26280b1b40 2023-10-09T07:01:09.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.646+0000 7f262ed9d700 1 -- 172.21.15.71:0/1030127059 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26280c8060 con 0x7f26280b1b40 2023-10-09T07:01:09.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.647+0000 7f262ed9d700 1 -- 172.21.15.71:0/1030127059 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26280c8860 con 0x7f26280b1b40 2023-10-09T07:01:09.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.648+0000 7f261dffb700 1 -- 172.21.15.71:0/1030127059 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 55) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f2618007690 con 0x7f26280b1b40 2023-10-09T07:01:09.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.648+0000 7f261dffb700 1 --2- 172.21.15.71:0/1030127059 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f260c067170 0x7f260c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:09.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.649+0000 7f261dffb700 1 -- 172.21.15.71:0/1030127059 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6469+0+0 (secure 0 0 0) 0x7f26180842d0 con 0x7f26280b1b40 2023-10-09T07:01:09.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.649+0000 7f262dd9b700 1 -- 172.21.15.71:0/1030127059 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f260c067170 msgr2=0x7f260c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:09.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.649+0000 7f262dd9b700 1 --2- 172.21.15.71:0/1030127059 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f260c067170 0x7f260c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:01:09.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.652+0000 7f261dffb700 1 -- 172.21.15.71:0/1030127059 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26280c8860 con 0x7f26280b1b40 2023-10-09T07:01:09.753 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:09.753+0000 7f6c9b721180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T07:01:09.772 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:09.772+0000 7f1979ff8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T07:01:09.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.850+0000 7f262dd9b700 1 -- 172.21.15.71:0/1030127059 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f260c067170 msgr2=0x7f260c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:09.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.850+0000 7f262dd9b700 1 --2- 172.21.15.71:0/1030127059 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f260c067170 0x7f260c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:01:09.862 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:09.862+0000 7f6c9b721180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T07:01:09.864 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:09.864+0000 7f1979ff8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T07:01:09.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:09.898+0000 7f262ed9d700 1 -- 172.21.15.71:0/1030127059 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f26280c8820 con 0x7f26280b1b40 2023-10-09T07:01:09.956 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:09.956+0000 7f1979ff8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T07:01:10.051 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:10.050+0000 7f1979ff8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T07:01:10.053 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:10.053+0000 7f6c9b721180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T07:01:10.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.060+0000 7f261dffb700 1 -- 172.21.15.71:0/1030127059 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 56) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f26180512e0 con 0x7f26280b1b40 2023-10-09T07:01:10.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.061+0000 7f261dffb700 1 -- 172.21.15.71:0/1030127059 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f260c067170 msgr2=0x7f260c069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:01:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.061+0000 7f261dffb700 1 --2- 172.21.15.71:0/1030127059 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f260c067170 0x7f260c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:10.129 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:10.128+0000 7f18f5603700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:10.129 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:10.128+0000 7f18f5603700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:10.129 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:10.128+0000 7f18f5603700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:10.129 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:10.128+0000 7f18f5603700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:10.130 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:10.128+0000 7f18f5603700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:10.130 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:10.129+0000 7f18f8609700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:10.130 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:10.129+0000 7f18f8609700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:10.130 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:10.129+0000 7f18f8609700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:10.130 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:10.129+0000 7f18f8609700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:10.130 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:10.129+0000 7f18f8609700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:10.155 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:10.155+0000 7f6c9b721180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T07:01:10.249 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:10.249+0000 7f6c9b721180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T07:01:10.343 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:10.343+0000 7f6c9b721180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T07:01:10.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.421+0000 7f261dffb700 1 -- 172.21.15.71:0/1030127059 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v60) v1 ==== 104+0+0 (secure 0 0 0) 0x7f261806eec0 con 0x7f26280b1b40 2023-10-09T07:01:10.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.424+0000 7f262ed9d700 1 -- 172.21.15.71:0/1030127059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26280b1b40 msgr2=0x7f26280c72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:10.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.424+0000 7f262ed9d700 1 --2- 172.21.15.71:0/1030127059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26280b1b40 0x7f26280c72a0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f261800c7c0 tx=0x7f2618007e00 comp rx=0 tx=0).stop 2023-10-09T07:01:10.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.424+0000 7f262ed9d700 1 -- 172.21.15.71:0/1030127059 shutdown_connections 2023-10-09T07:01:10.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.424+0000 7f262ed9d700 1 --2- 172.21.15.71:0/1030127059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26280b4e70 0x7f262814c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:10.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.424+0000 7f262ed9d700 1 --2- 172.21.15.71:0/1030127059 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f260c067170 0x7f260c069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:10.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.424+0000 7f262ed9d700 1 --2- 172.21.15.71:0/1030127059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26280b16d0 0x7f26280cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:10.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.424+0000 7f262ed9d700 1 --2- 172.21.15.71:0/1030127059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26280b1b40 0x7f26280c72a0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:10.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.424+0000 7f262ed9d700 1 -- 172.21.15.71:0/1030127059 >> 172.21.15.71:0/1030127059 conn(0x7f26280d10c0 msgr2=0x7f2628158ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:10.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.424+0000 7f262ed9d700 1 -- 172.21.15.71:0/1030127059 shutdown_connections 2023-10-09T07:01:10.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.424+0000 7f262ed9d700 1 -- 172.21.15.71:0/1030127059 wait complete. 2023-10-09T07:01:10.443 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T07:01:10.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.668+0000 7f9ae5fff700 1 Processor -- start 2023-10-09T07:01:10.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.668+0000 7f9ae5fff700 1 -- start start 2023-10-09T07:01:10.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.669+0000 7f9ae5fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9ae00cd910 0x7f9ae00ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:10.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.669+0000 7f9ae5fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae00b5b00 con 0x7f9ae00b55a0 2023-10-09T07:01:10.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.669+0000 7f9ae5fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae00b5da0 con 0x7f9ae0159ec0 2023-10-09T07:01:10.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.669+0000 7f9ae5fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae00b6080 con 0x7f9ae00cd910 2023-10-09T07:01:10.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.670+0000 7f9adeffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9ae00cd910 0x7f9ae00ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:10.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.670+0000 7f9adffff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9ae00b55a0 0x7f9ae00ce880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39818/0 (socket says 172.21.15.71:39818) 2023-10-09T07:01:10.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.670+0000 7f9adffff700 1 -- 172.21.15.71:0/1942158000 learned_addr learned my addr 172.21.15.71:0/1942158000 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:01:10.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.670+0000 7f9adeffd700 1 -- 172.21.15.71:0/1942158000 >> v1:172.21.15.179:6789/0 conn(0x7f9ae0159ec0 legacy=0x7f9ae00b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:10.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.670+0000 7f9adeffd700 1 -- 172.21.15.71:0/1942158000 >> v1:172.21.15.71:6789/0 conn(0x7f9ae00b55a0 legacy=0x7f9ae00ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:10.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.670+0000 7f9ade7fc700 1 -- 172.21.15.71:0/1942158000 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281725387 0 0) 0x7f9ae00b5da0 con 0x7f9ae0159ec0 2023-10-09T07:01:10.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.670+0000 7f9adeffd700 1 -- 172.21.15.71:0/1942158000 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae00cc100 con 0x7f9ae00cd910 2023-10-09T07:01:10.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.671+0000 7f9adeffd700 1 --2- 172.21.15.71:0/1942158000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ae00cd910 0x7f9ae00ce340 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4009910 tx=0x7f9ad40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f4a451a8d0f22 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.671+0000 7f9ade7fc700 1 -- 172.21.15.71:0/1942158000 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad4009eb0 con 0x7f9ae00cd910 2023-10-09T07:01:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.671+0000 7f9ade7fc700 1 -- 172.21.15.71:0/1942158000 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad400b760 con 0x7f9ae00cd910 2023-10-09T07:01:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.671+0000 7f9ade7fc700 1 -- 172.21.15.71:0/1942158000 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad400bb00 con 0x7f9ae00cd910 2023-10-09T07:01:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.671+0000 7f9ae5fff700 1 -- 172.21.15.71:0/1942158000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ae00cd910 msgr2=0x7f9ae00ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.671+0000 7f9ae5fff700 1 --2- 172.21.15.71:0/1942158000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ae00cd910 0x7f9ae00ce340 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4009910 tx=0x7f9ad40091a0 comp rx=0 tx=0).stop 2023-10-09T07:01:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.671+0000 7f9ae5fff700 1 -- 172.21.15.71:0/1942158000 shutdown_connections 2023-10-09T07:01:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.671+0000 7f9ae5fff700 1 --2- 172.21.15.71:0/1942158000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ae00cd910 0x7f9ae00ce340 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.671+0000 7f9ae5fff700 1 -- 172.21.15.71:0/1942158000 >> 172.21.15.71:0/1942158000 conn(0x7f9ae00999f0 msgr2=0x7f9ae00b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.671+0000 7f9ae5fff700 1 -- 172.21.15.71:0/1942158000 shutdown_connections 2023-10-09T07:01:10.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.671+0000 7f9ae5fff700 1 -- 172.21.15.71:0/1942158000 wait complete. 2023-10-09T07:01:10.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.673+0000 7f9ae5fff700 1 Processor -- start 2023-10-09T07:01:10.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.673+0000 7f9ae5fff700 1 -- start start 2023-10-09T07:01:10.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.674+0000 7f9ae5fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ae00b55a0 0x7f9ae01520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:10.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.674+0000 7f9ae5fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ae0159ec0 0x7f9ae0154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.674+0000 7f9ae5fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ae014e610 0x7f9ae00c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.674+0000 7f9ae5fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae00688a0 con 0x7f9ae014e610 2023-10-09T07:01:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.674+0000 7f9ae5fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae01527c0 con 0x7f9ae0159ec0 2023-10-09T07:01:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.674+0000 7f9ae5fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae0152aa0 con 0x7f9ae00b55a0 2023-10-09T07:01:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.674+0000 7f9adffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ae014e610 0x7f9ae00c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.674+0000 7f9adffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ae014e610 0x7f9ae00c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35088/0 (socket says 172.21.15.71:35088) 2023-10-09T07:01:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.674+0000 7f9adffff700 1 -- 172.21.15.71:0/1691375568 learned_addr learned my addr 172.21.15.71:0/1691375568 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.674+0000 7f9adeffd700 1 --2- 172.21.15.71:0/1691375568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ae0159ec0 0x7f9ae0154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.674+0000 7f9adf7fe700 1 --2- 172.21.15.71:0/1691375568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ae00b55a0 0x7f9ae01520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.674+0000 7f9adffff700 1 -- 172.21.15.71:0/1691375568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ae00b55a0 msgr2=0x7f9ae01520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.674+0000 7f9adffff700 1 --2- 172.21.15.71:0/1691375568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ae00b55a0 0x7f9ae01520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.674+0000 7f9adffff700 1 -- 172.21.15.71:0/1691375568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ae0159ec0 msgr2=0x7f9ae0154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.674+0000 7f9adffff700 1 --2- 172.21.15.71:0/1691375568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ae0159ec0 0x7f9ae0154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.674+0000 7f9adffff700 1 -- 172.21.15.71:0/1691375568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad4009420 con 0x7f9ae014e610 2023-10-09T07:01:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.675+0000 7f9adffff700 1 --2- 172.21.15.71:0/1691375568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ae014e610 0x7f9ae00c8a30 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f9ad800cd50 tx=0x7f9ad8001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.675+0000 7f9ac77fe700 1 -- 172.21.15.71:0/1691375568 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad800ab70 con 0x7f9ae014e610 2023-10-09T07:01:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.675+0000 7f9ac77fe700 1 -- 172.21.15.71:0/1691375568 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad800acd0 con 0x7f9ae014e610 2023-10-09T07:01:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.675+0000 7f9ae5fff700 1 -- 172.21.15.71:0/1691375568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae0068530 con 0x7f9ae014e610 2023-10-09T07:01:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.675+0000 7f9ac77fe700 1 -- 172.21.15.71:0/1691375568 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8007340 con 0x7f9ae014e610 2023-10-09T07:01:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.675+0000 7f9ae5fff700 1 -- 172.21.15.71:0/1691375568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae00c91b0 con 0x7f9ae014e610 2023-10-09T07:01:10.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.676+0000 7f9ae5fff700 1 -- 172.21.15.71:0/1691375568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae0068390 con 0x7f9ae014e610 2023-10-09T07:01:10.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.677+0000 7f9ac77fe700 1 -- 172.21.15.71:0/1691375568 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 56) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f9ad80076f0 con 0x7f9ae014e610 2023-10-09T07:01:10.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.678+0000 7f9ac77fe700 1 -- 172.21.15.71:0/1691375568 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9ad8084ab0 con 0x7f9ae014e610 2023-10-09T07:01:10.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.682+0000 7f9ac77fe700 1 -- 172.21.15.71:0/1691375568 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ae0068390 con 0x7f9ae014e610 2023-10-09T07:01:10.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:10.876+0000 7f9ae5fff700 1 -- 172.21.15.71:0/1691375568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9ae0068390 con 0x7f9ae014e610 2023-10-09T07:01:11.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.065+0000 7f9ac77fe700 1 -- 172.21.15.71:0/1691375568 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 57) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f9ad80079a0 con 0x7f9ae014e610 2023-10-09T07:01:11.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.065+0000 7f9ac77fe700 1 --2- 172.21.15.71:0/1691375568 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9acc06ca90 0x7f9acc06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:11.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.068+0000 7f9adf7fe700 1 --2- 172.21.15.71:0/1691375568 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9acc06ca90 0x7f9acc06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:11.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.073+0000 7f9adf7fe700 1 --2- 172.21.15.71:0/1691375568 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9acc06ca90 0x7f9acc06ee70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9ad00038f0 tx=0x7f9ad0009040 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:11.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.423+0000 7f9ac77fe700 1 -- 172.21.15.71:0/1691375568 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v128) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9ad80817e0 con 0x7f9ae014e610 2023-10-09T07:01:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.427+0000 7f9ae5fff700 1 -- 172.21.15.71:0/1691375568 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9acc06ca90 msgr2=0x7f9acc06ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:11.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.427+0000 7f9ae5fff700 1 --2- 172.21.15.71:0/1691375568 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9acc06ca90 0x7f9acc06ee70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9ad00038f0 tx=0x7f9ad0009040 comp rx=0 tx=0).stop 2023-10-09T07:01:11.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.427+0000 7f9ae5fff700 1 -- 172.21.15.71:0/1691375568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ae014e610 msgr2=0x7f9ae00c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:11.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.427+0000 7f9ae5fff700 1 --2- 172.21.15.71:0/1691375568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ae014e610 0x7f9ae00c8a30 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f9ad800cd50 tx=0x7f9ad8001ab0 comp rx=0 tx=0).stop 2023-10-09T07:01:11.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.427+0000 7f9ae5fff700 1 -- 172.21.15.71:0/1691375568 shutdown_connections 2023-10-09T07:01:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.427+0000 7f9ae5fff700 1 --2- 172.21.15.71:0/1691375568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ae014e610 0x7f9ae00c8a30 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.427+0000 7f9ae5fff700 1 --2- 172.21.15.71:0/1691375568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ae00b55a0 0x7f9ae01520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.427+0000 7f9ae5fff700 1 --2- 172.21.15.71:0/1691375568 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9acc06ca90 0x7f9acc06ee70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.427+0000 7f9ae5fff700 1 --2- 172.21.15.71:0/1691375568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ae0159ec0 0x7f9ae0154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.427+0000 7f9ae5fff700 1 -- 172.21.15.71:0/1691375568 >> 172.21.15.71:0/1691375568 conn(0x7f9ae00999f0 msgr2=0x7f9ae0159140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.427+0000 7f9ae5fff700 1 -- 172.21.15.71:0/1691375568 shutdown_connections 2023-10-09T07:01:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.427+0000 7f9ae5fff700 1 -- 172.21.15.71:0/1691375568 wait complete. 2023-10-09T07:01:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' removed 2023-10-09T07:01:11.452 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T07:01:11.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.637+0000 7f751df9d700 1 Processor -- start 2023-10-09T07:01:11.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.637+0000 7f751df9d700 1 -- start start 2023-10-09T07:01:11.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.638+0000 7f751df9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7518153850 0x7f75181596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:11.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.638+0000 7f751df9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7518159bf0 0x7f7518157280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:11.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.638+0000 7f751df9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f751815a030 con 0x7f7518153480 2023-10-09T07:01:11.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.638+0000 7f751df9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751815a480 con 0x7f7518153850 2023-10-09T07:01:11.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.638+0000 7f751df9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75180afb40 con 0x7f7518159bf0 2023-10-09T07:01:11.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.638+0000 7f7517fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7518153850 0x7f75181596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:11.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.638+0000 7f7517fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7518153850 0x7f75181596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35098/0 (socket says 172.21.15.71:35098) 2023-10-09T07:01:11.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.638+0000 7f7517fff700 1 -- 172.21.15.71:0/2117306452 learned_addr learned my addr 172.21.15.71:0/2117306452 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:11.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.639+0000 7f751d79c700 1 --2- 172.21.15.71:0/2117306452 >> v2:172.21.15.179:3300/0 conn(0x7f7518159bf0 0x7f7518157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:11.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.639+0000 7f7517fff700 1 -- 172.21.15.71:0/2117306452 >> v2:172.21.15.179:3300/0 conn(0x7f7518159bf0 msgr2=0x7f7518157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:11.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.639+0000 7f7517fff700 1 --2- 172.21.15.71:0/2117306452 >> v2:172.21.15.179:3300/0 conn(0x7f7518159bf0 0x7f7518157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:11.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.639+0000 7f7517fff700 1 -- 172.21.15.71:0/2117306452 >> v1:172.21.15.179:6789/0 conn(0x7f7518153480 legacy=0x7f75180ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:11.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.639+0000 7f7517fff700 1 -- 172.21.15.71:0/2117306452 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75180afe20 con 0x7f7518153850 2023-10-09T07:01:11.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.639+0000 7f7517fff700 1 --2- 172.21.15.71:0/2117306452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7518153850 0x7f75181596b0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f7518157210 tx=0x7f7504009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f260519359a49f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:11.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.639+0000 7f75177fe700 1 -- 172.21.15.71:0/2117306452 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750400b860 con 0x7f7518153850 2023-10-09T07:01:11.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.639+0000 7f75177fe700 1 -- 172.21.15.71:0/2117306452 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750400b9c0 con 0x7f7518153850 2023-10-09T07:01:11.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.639+0000 7f75177fe700 1 -- 172.21.15.71:0/2117306452 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750400bd60 con 0x7f7518153850 2023-10-09T07:01:11.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.640+0000 7f751df9d700 1 -- 172.21.15.71:0/2117306452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7518153850 msgr2=0x7f75181596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:11.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.640+0000 7f751df9d700 1 --2- 172.21.15.71:0/2117306452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7518153850 0x7f75181596b0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f7518157210 tx=0x7f7504009250 comp rx=0 tx=0).stop 2023-10-09T07:01:11.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.640+0000 7f751df9d700 1 -- 172.21.15.71:0/2117306452 shutdown_connections 2023-10-09T07:01:11.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.640+0000 7f751df9d700 1 --2- 172.21.15.71:0/2117306452 >> v2:172.21.15.179:3300/0 conn(0x7f7518159bf0 0x7f7518157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:11.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.640+0000 7f751df9d700 1 --2- 172.21.15.71:0/2117306452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7518153850 0x7f75181596b0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:11.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.640+0000 7f751df9d700 1 -- 172.21.15.71:0/2117306452 >> 172.21.15.71:0/2117306452 conn(0x7f7518068e20 msgr2=0x7f75180cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:11.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.640+0000 7f751df9d700 1 -- 172.21.15.71:0/2117306452 shutdown_connections 2023-10-09T07:01:11.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.640+0000 7f751df9d700 1 -- 172.21.15.71:0/2117306452 wait complete. 2023-10-09T07:01:11.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.641+0000 7f751df9d700 1 Processor -- start 2023-10-09T07:01:11.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.642+0000 7f751df9d700 1 -- start start 2023-10-09T07:01:11.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.642+0000 7f751df9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7518153480 0x7f751815d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:11.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.642+0000 7f751df9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7518153850 0x7f751813ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:11.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.642+0000 7f751df9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7518159bf0 0x7f7518157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:11.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.643+0000 7f751df9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751816e120 con 0x7f7518153850 2023-10-09T07:01:11.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.643+0000 7f751df9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751815de60 con 0x7f7518159bf0 2023-10-09T07:01:11.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.643+0000 7f751df9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751815d490 con 0x7f7518153480 2023-10-09T07:01:11.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.643+0000 7f7517fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7518153850 0x7f751813ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:11.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.643+0000 7f7517fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7518153850 0x7f751813ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35106/0 (socket says 172.21.15.71:35106) 2023-10-09T07:01:11.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.643+0000 7f7517fff700 1 -- 172.21.15.71:0/3253443792 learned_addr learned my addr 172.21.15.71:0/3253443792 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:11.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.643+0000 7f751cf9b700 1 --2- 172.21.15.71:0/3253443792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7518153480 0x7f751815d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:11.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.643+0000 7f751d79c700 1 --2- 172.21.15.71:0/3253443792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7518159bf0 0x7f7518157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:11.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.643+0000 7f7517fff700 1 -- 172.21.15.71:0/3253443792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7518153480 msgr2=0x7f751815d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:11.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.643+0000 7f7517fff700 1 --2- 172.21.15.71:0/3253443792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7518153480 0x7f751815d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:11.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.643+0000 7f7517fff700 1 -- 172.21.15.71:0/3253443792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7518159bf0 msgr2=0x7f7518157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:11.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.643+0000 7f7517fff700 1 --2- 172.21.15.71:0/3253443792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7518159bf0 0x7f7518157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:11.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.643+0000 7f7517fff700 1 -- 172.21.15.71:0/3253443792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75040094f0 con 0x7f7518153850 2023-10-09T07:01:11.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.643+0000 7f7517fff700 1 --2- 172.21.15.71:0/3253443792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7518153850 0x7f751813ea50 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f7504006fd0 tx=0x7f7504017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:11.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.644+0000 7f7514ff9700 1 -- 172.21.15.71:0/3253443792 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504011e20 con 0x7f7518153850 2023-10-09T07:01:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.644+0000 7f7514ff9700 1 -- 172.21.15.71:0/3253443792 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750401a630 con 0x7f7518153850 2023-10-09T07:01:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.644+0000 7f751df9d700 1 -- 172.21.15.71:0/3253443792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751815cb60 con 0x7f7518153850 2023-10-09T07:01:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.644+0000 7f7514ff9700 1 -- 172.21.15.71:0/3253443792 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750401a9f0 con 0x7f7518153850 2023-10-09T07:01:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.644+0000 7f751df9d700 1 -- 172.21.15.71:0/3253443792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751815d120 con 0x7f7518153850 2023-10-09T07:01:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.645+0000 7f751df9d700 1 -- 172.21.15.71:0/3253443792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f751804c3c0 con 0x7f7518153850 2023-10-09T07:01:11.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.645+0000 7f7514ff9700 1 -- 172.21.15.71:0/3253443792 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 57) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f750402d440 con 0x7f7518153850 2023-10-09T07:01:11.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.646+0000 7f7514ff9700 1 --2- 172.21.15.71:0/3253443792 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f74fc066d80 0x7f74fc069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:11.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.646+0000 7f7514ff9700 1 -- 172.21.15.71:0/3253443792 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f75040860b0 con 0x7f7518153850 2023-10-09T07:01:11.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.647+0000 7f751cf9b700 1 --2- 172.21.15.71:0/3253443792 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f74fc066d80 0x7f74fc069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:11.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.647+0000 7f751cf9b700 1 --2- 172.21.15.71:0/3253443792 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f74fc066d80 0x7f74fc069230 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f750c007fd0 tx=0x7f750c009040 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:11.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.651+0000 7f7514ff9700 1 -- 172.21.15.71:0/3253443792 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7504053260 con 0x7f7518153850 2023-10-09T07:01:11.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:11.843+0000 7f751df9d700 1 -- 172.21.15.71:0/3253443792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f751815d5d0 con 0x7f7518153850 2023-10-09T07:01:12.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.427+0000 7f7514ff9700 1 -- 172.21.15.71:0/3253443792 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7504053630 con 0x7f7518153850 2023-10-09T07:01:12.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.435+0000 7f7514ff9700 1 -- 172.21.15.71:0/3253443792 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v129) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7504056cf0 con 0x7f7518153850 2023-10-09T07:01:12.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.438+0000 7f751df9d700 1 -- 172.21.15.71:0/3253443792 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f74fc066d80 msgr2=0x7f74fc069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:12.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.438+0000 7f751df9d700 1 --2- 172.21.15.71:0/3253443792 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f74fc066d80 0x7f74fc069230 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f750c007fd0 tx=0x7f750c009040 comp rx=0 tx=0).stop 2023-10-09T07:01:12.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.438+0000 7f751df9d700 1 -- 172.21.15.71:0/3253443792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7518153850 msgr2=0x7f751813ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:12.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.438+0000 7f751df9d700 1 --2- 172.21.15.71:0/3253443792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7518153850 0x7f751813ea50 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f7504006fd0 tx=0x7f7504017000 comp rx=0 tx=0).stop 2023-10-09T07:01:12.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.438+0000 7f751df9d700 1 -- 172.21.15.71:0/3253443792 shutdown_connections 2023-10-09T07:01:12.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.438+0000 7f751df9d700 1 --2- 172.21.15.71:0/3253443792 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f74fc066d80 0x7f74fc069230 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:12.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.438+0000 7f751df9d700 1 --2- 172.21.15.71:0/3253443792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7518159bf0 0x7f7518157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:12.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.438+0000 7f751df9d700 1 --2- 172.21.15.71:0/3253443792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7518153480 0x7f751815d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:12.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.438+0000 7f751df9d700 1 --2- 172.21.15.71:0/3253443792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7518153850 0x7f751813ea50 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:12.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.438+0000 7f751df9d700 1 -- 172.21.15.71:0/3253443792 >> 172.21.15.71:0/3253443792 conn(0x7f7518068e20 msgr2=0x7f7518155ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:12.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.438+0000 7f751df9d700 1 -- 172.21.15.71:0/3253443792 shutdown_connections 2023-10-09T07:01:12.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.439+0000 7f751df9d700 1 -- 172.21.15.71:0/3253443792 wait complete. 2023-10-09T07:01:12.443 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' removed 2023-10-09T07:01:12.459 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T07:01:12.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.641+0000 7fdc769ff700 1 Processor -- start 2023-10-09T07:01:12.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.642+0000 7fdc769ff700 1 -- start start 2023-10-09T07:01:12.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.643+0000 7fdc769ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdc701568e0 0x7fdc701616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:12.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.643+0000 7fdc769ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7015b0d0 con 0x7fdc700c83f0 2023-10-09T07:01:12.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.643+0000 7fdc769ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7015a4c0 con 0x7fdc700ccee0 2023-10-09T07:01:12.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.643+0000 7fdc769ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc7015a7a0 con 0x7fdc701568e0 2023-10-09T07:01:12.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.643+0000 7fdc6ffff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fdc700c83f0 0x7fdc700c7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39822/0 (socket says 172.21.15.71:39822) 2023-10-09T07:01:12.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.643+0000 7fdc6ffff700 1 -- 172.21.15.71:0/3422945946 learned_addr learned my addr 172.21.15.71:0/3422945946 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:01:12.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.643+0000 7fdc74f9c700 1 --2- 172.21.15.71:0/3422945946 >> v2:172.21.15.179:3300/0 conn(0x7fdc701568e0 0x7fdc701616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:12.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.643+0000 7fdc6effd700 1 -- 172.21.15.71:0/3422945946 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2217220276 0 0) 0x7fdc7015b0d0 con 0x7fdc700c83f0 2023-10-09T07:01:12.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.643+0000 7fdc6effd700 1 -- 172.21.15.71:0/3422945946 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc58003570 con 0x7fdc700c83f0 2023-10-09T07:01:12.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.644+0000 7fdc6effd700 1 -- 172.21.15.71:0/3422945946 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3634759758 0 0) 0x7fdc7015a4c0 con 0x7fdc700ccee0 2023-10-09T07:01:12.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.644+0000 7fdc6effd700 1 -- 172.21.15.71:0/3422945946 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc7015b0d0 con 0x7fdc700ccee0 2023-10-09T07:01:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.644+0000 7fdc6effd700 1 -- 172.21.15.71:0/3422945946 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3054436778 0 0) 0x7fdc58003570 con 0x7fdc700c83f0 2023-10-09T07:01:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.644+0000 7fdc6effd700 1 -- 172.21.15.71:0/3422945946 >> v2:172.21.15.179:3300/0 conn(0x7fdc701568e0 msgr2=0x7fdc701616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.644+0000 7fdc6effd700 1 --2- 172.21.15.71:0/3422945946 >> v2:172.21.15.179:3300/0 conn(0x7fdc701568e0 0x7fdc701616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.644+0000 7fdc6effd700 1 -- 172.21.15.71:0/3422945946 >> v1:172.21.15.179:6789/0 conn(0x7fdc700ccee0 legacy=0x7fdc701561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.644+0000 7fdc6effd700 1 -- 172.21.15.71:0/3422945946 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7015aa80 con 0x7fdc700c83f0 2023-10-09T07:01:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.644+0000 7fdc6effd700 1 -- 172.21.15.71:0/3422945946 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fdc60001470 con 0x7fdc700c83f0 2023-10-09T07:01:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.644+0000 7fdc6effd700 1 -- 172.21.15.71:0/3422945946 >> v1:172.21.15.71:6789/0 conn(0x7fdc700c83f0 legacy=0x7fdc700c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.644+0000 7fdc6effd700 1 --2- 172.21.15.71:0/3422945946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc58003bf0 0x7fdc58003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.644+0000 7fdc6effd700 1 --2- 172.21.15.71:0/3422945946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc58004810 0x7fdc58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.644+0000 7fdc6effd700 1 --2- 172.21.15.71:0/3422945946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc580051c0 0x7fdc5800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.644+0000 7fdc6effd700 1 -- 172.21.15.71:0/3422945946 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7015a7a0 con 0x7fdc58003bf0 2023-10-09T07:01:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.644+0000 7fdc6effd700 1 -- 172.21.15.71:0/3422945946 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5800c0b0 con 0x7fdc580051c0 2023-10-09T07:01:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.644+0000 7fdc6effd700 1 -- 172.21.15.71:0/3422945946 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5800c270 con 0x7fdc58004810 2023-10-09T07:01:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.644+0000 7fdc6ffff700 1 --2- 172.21.15.71:0/3422945946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc58003bf0 0x7fdc58003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.644+0000 7fdc6f7fe700 1 --2- 172.21.15.71:0/3422945946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc58004810 0x7fdc58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.644+0000 7fdc74f9c700 1 --2- 172.21.15.71:0/3422945946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc580051c0 0x7fdc5800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.645+0000 7fdc6f7fe700 1 -- 172.21.15.71:0/3422945946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc580051c0 msgr2=0x7fdc5800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.645+0000 7fdc6f7fe700 1 --2- 172.21.15.71:0/3422945946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc580051c0 0x7fdc5800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.645+0000 7fdc6f7fe700 1 -- 172.21.15.71:0/3422945946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc58003bf0 msgr2=0x7fdc58003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.645+0000 7fdc6f7fe700 1 --2- 172.21.15.71:0/3422945946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc58003bf0 0x7fdc58003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.645+0000 7fdc6f7fe700 1 -- 172.21.15.71:0/3422945946 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc58003570 con 0x7fdc58004810 2023-10-09T07:01:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.645+0000 7fdc6ffff700 1 --2- 172.21.15.71:0/3422945946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc58003bf0 0x7fdc58003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:01:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.645+0000 7fdc74f9c700 1 -- 172.21.15.71:0/3422945946 reap_dead start 2023-10-09T07:01:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.645+0000 7fdc6f7fe700 1 --2- 172.21.15.71:0/3422945946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc58004810 0x7fdc58004c80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdc64001a50 tx=0x7fdc64007d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16a75039aa6b37a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.645+0000 7fdc6effd700 1 -- 172.21.15.71:0/3422945946 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6400c5d0 con 0x7fdc58004810 2023-10-09T07:01:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.645+0000 7fdc6effd700 1 -- 172.21.15.71:0/3422945946 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc64001e90 con 0x7fdc58004810 2023-10-09T07:01:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.645+0000 7fdc6effd700 1 -- 172.21.15.71:0/3422945946 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6400c980 con 0x7fdc58004810 2023-10-09T07:01:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.646+0000 7fdc769ff700 1 -- 172.21.15.71:0/3422945946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc58004810 msgr2=0x7fdc58004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.646+0000 7fdc769ff700 1 --2- 172.21.15.71:0/3422945946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc58004810 0x7fdc58004c80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdc64001a50 tx=0x7fdc64007d30 comp rx=0 tx=0).stop 2023-10-09T07:01:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.646+0000 7fdc769ff700 1 -- 172.21.15.71:0/3422945946 shutdown_connections 2023-10-09T07:01:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.646+0000 7fdc769ff700 1 --2- 172.21.15.71:0/3422945946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc58004810 0x7fdc58004c80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.646+0000 7fdc769ff700 1 -- 172.21.15.71:0/3422945946 >> 172.21.15.71:0/3422945946 conn(0x7fdc70068e10 msgr2=0x7fdc700cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:12.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.646+0000 7fdc769ff700 1 -- 172.21.15.71:0/3422945946 shutdown_connections 2023-10-09T07:01:12.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.646+0000 7fdc769ff700 1 -- 172.21.15.71:0/3422945946 wait complete. 2023-10-09T07:01:12.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.647+0000 7fdc769ff700 1 Processor -- start 2023-10-09T07:01:12.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.647+0000 7fdc769ff700 1 -- start start 2023-10-09T07:01:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.648+0000 7fdc769ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc58004810 0x7fdc70151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.648+0000 7fdc769ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7015f0d0 0x7fdc700c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.648+0000 7fdc769ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc700b1420 0x7fdc700b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.648+0000 7fdc769ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc700c4dc0 con 0x7fdc58004810 2023-10-09T07:01:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.648+0000 7fdc769ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc700b1db0 con 0x7fdc700b1420 2023-10-09T07:01:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.648+0000 7fdc769ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc700c4480 con 0x7fdc7015f0d0 2023-10-09T07:01:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.648+0000 7fdc6ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc58004810 0x7fdc70151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.648+0000 7fdc6ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc58004810 0x7fdc70151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35120/0 (socket says 172.21.15.71:35120) 2023-10-09T07:01:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.649+0000 7fdc6ffff700 1 -- 172.21.15.71:0/2294365779 learned_addr learned my addr 172.21.15.71:0/2294365779 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.649+0000 7fdc6f7fe700 1 --2- 172.21.15.71:0/2294365779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7015f0d0 0x7fdc700c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.649+0000 7fdc74f9c700 1 --2- 172.21.15.71:0/2294365779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc700b1420 0x7fdc700b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.649+0000 7fdc6ffff700 1 -- 172.21.15.71:0/2294365779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7015f0d0 msgr2=0x7fdc700c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.649+0000 7fdc6ffff700 1 --2- 172.21.15.71:0/2294365779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7015f0d0 0x7fdc700c35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.649+0000 7fdc6ffff700 1 -- 172.21.15.71:0/2294365779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc700b1420 msgr2=0x7fdc700b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.649+0000 7fdc6ffff700 1 --2- 172.21.15.71:0/2294365779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc700b1420 0x7fdc700b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.649+0000 7fdc6ffff700 1 -- 172.21.15.71:0/2294365779 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc70152160 con 0x7fdc58004810 2023-10-09T07:01:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.649+0000 7fdc74f9c700 1 --2- 172.21.15.71:0/2294365779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc700b1420 0x7fdc700b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:01:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.649+0000 7fdc6ffff700 1 --2- 172.21.15.71:0/2294365779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc58004810 0x7fdc70151c20 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fdc60007410 tx=0x7fdc60001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.649+0000 7fdc57fff700 1 -- 172.21.15.71:0/2294365779 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc60018030 con 0x7fdc58004810 2023-10-09T07:01:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.649+0000 7fdc57fff700 1 -- 172.21.15.71:0/2294365779 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6000f870 con 0x7fdc58004810 2023-10-09T07:01:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.649+0000 7fdc57fff700 1 -- 172.21.15.71:0/2294365779 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6000fc10 con 0x7fdc58004810 2023-10-09T07:01:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.649+0000 7fdc769ff700 1 -- 172.21.15.71:0/2294365779 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc700c3ec0 con 0x7fdc58004810 2023-10-09T07:01:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.650+0000 7fdc769ff700 1 -- 172.21.15.71:0/2294365779 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc700c4a50 con 0x7fdc58004810 2023-10-09T07:01:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.651+0000 7fdc769ff700 1 -- 172.21.15.71:0/2294365779 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc7004c3c0 con 0x7fdc58004810 2023-10-09T07:01:12.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.651+0000 7fdc57fff700 1 -- 172.21.15.71:0/2294365779 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc6001b070 con 0x7fdc58004810 2023-10-09T07:01:12.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.652+0000 7fdc57fff700 1 --2- 172.21.15.71:0/2294365779 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdc5c066f30 0x7fdc5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:12.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.652+0000 7fdc57fff700 1 -- 172.21.15.71:0/2294365779 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5961+0+0 (secure 0 0 0) 0x7fdc60019070 con 0x7fdc58004810 2023-10-09T07:01:12.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.653+0000 7fdc6f7fe700 1 --2- 172.21.15.71:0/2294365779 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdc5c066f30 0x7fdc5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:12.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.653+0000 7fdc6f7fe700 1 --2- 172.21.15.71:0/2294365779 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdc5c066f30 0x7fdc5c0693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdc64000c00 tx=0x7fdc64015000 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:12.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.656+0000 7fdc57fff700 1 -- 172.21.15.71:0/2294365779 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc60051830 con 0x7fdc58004810 2023-10-09T07:01:12.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.857+0000 7fdc769ff700 1 -- 172.21.15.71:0/2294365779 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fdc7015ad60 con 0x7fdc58004810 2023-10-09T07:01:12.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.861+0000 7fdc57fff700 1 -- 172.21.15.71:0/2294365779 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v43) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdc60054e50 con 0x7fdc58004810 2023-10-09T07:01:12.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.864+0000 7fdc769ff700 1 -- 172.21.15.71:0/2294365779 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdc5c066f30 msgr2=0x7fdc5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:12.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.864+0000 7fdc769ff700 1 --2- 172.21.15.71:0/2294365779 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdc5c066f30 0x7fdc5c0693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdc64000c00 tx=0x7fdc64015000 comp rx=0 tx=0).stop 2023-10-09T07:01:12.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.864+0000 7fdc769ff700 1 -- 172.21.15.71:0/2294365779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc58004810 msgr2=0x7fdc70151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:12.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.864+0000 7fdc769ff700 1 --2- 172.21.15.71:0/2294365779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc58004810 0x7fdc70151c20 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fdc60007410 tx=0x7fdc60001df0 comp rx=0 tx=0).stop 2023-10-09T07:01:12.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.864+0000 7fdc769ff700 1 -- 172.21.15.71:0/2294365779 shutdown_connections 2023-10-09T07:01:12.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.864+0000 7fdc769ff700 1 --2- 172.21.15.71:0/2294365779 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdc5c066f30 0x7fdc5c0693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:12.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.864+0000 7fdc769ff700 1 --2- 172.21.15.71:0/2294365779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc700b1420 0x7fdc700b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:12.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.864+0000 7fdc769ff700 1 --2- 172.21.15.71:0/2294365779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc58004810 0x7fdc70151c20 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:12.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.864+0000 7fdc769ff700 1 --2- 172.21.15.71:0/2294365779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7015f0d0 0x7fdc700c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:12.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.864+0000 7fdc769ff700 1 -- 172.21.15.71:0/2294365779 >> 172.21.15.71:0/2294365779 conn(0x7fdc70068e10 msgr2=0x7fdc700c87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:12.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.864+0000 7fdc769ff700 1 -- 172.21.15.71:0/2294365779 shutdown_connections 2023-10-09T07:01:12.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:12.864+0000 7fdc769ff700 1 -- 172.21.15.71:0/2294365779 wait complete. 2023-10-09T07:01:12.882 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-09T07:01:13.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.066+0000 7fcf861ff700 1 Processor -- start 2023-10-09T07:01:13.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.066+0000 7fcf861ff700 1 -- start start 2023-10-09T07:01:13.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.067+0000 7fcf861ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf80159890 0x7fcf8015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:13.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.068+0000 7fcf861ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcf80159c60 0x7fcf8015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:13.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.068+0000 7fcf861ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf8015a160 con 0x7fcf8015db10 2023-10-09T07:01:13.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.068+0000 7fcf861ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf800d13a0 con 0x7fcf80159c60 2023-10-09T07:01:13.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.068+0000 7fcf861ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8015e140 con 0x7fcf80159890 2023-10-09T07:01:13.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.068+0000 7fcf7effd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcf80159c60 0x7fcf8015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:13.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.068+0000 7fcf7effd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcf80159c60 0x7fcf8015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35122/0 (socket says 172.21.15.71:35122) 2023-10-09T07:01:13.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.068+0000 7fcf7effd700 1 -- 172.21.15.71:0/1158399572 learned_addr learned my addr 172.21.15.71:0/1158399572 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:13.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.068+0000 7fcf7f7fe700 1 --2- 172.21.15.71:0/1158399572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf80159890 0x7fcf8015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:13.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.068+0000 7fcf7effd700 1 -- 172.21.15.71:0/1158399572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf80159890 msgr2=0x7fcf8015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:13.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.068+0000 7fcf7effd700 1 --2- 172.21.15.71:0/1158399572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf80159890 0x7fcf8015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.068+0000 7fcf7effd700 1 -- 172.21.15.71:0/1158399572 >> v1:172.21.15.71:6789/0 conn(0x7fcf8015db10 legacy=0x7fcf80069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:13.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.068+0000 7fcf7effd700 1 -- 172.21.15.71:0/1158399572 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8015a3d0 con 0x7fcf80159c60 2023-10-09T07:01:13.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.069+0000 7fcf7effd700 1 --2- 172.21.15.71:0/1158399572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf80159c60 0x7fcf8015d5d0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fcf740099b0 tx=0x7fcf74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef646dbd973378f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:13.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.070+0000 7fcf7e7fc700 1 -- 172.21.15.71:0/1158399572 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf74009ea0 con 0x7fcf80159c60 2023-10-09T07:01:13.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.070+0000 7fcf7e7fc700 1 -- 172.21.15.71:0/1158399572 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7400b860 con 0x7fcf80159c60 2023-10-09T07:01:13.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.070+0000 7fcf7e7fc700 1 -- 172.21.15.71:0/1158399572 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7400bc00 con 0x7fcf80159c60 2023-10-09T07:01:13.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.070+0000 7fcf861ff700 1 -- 172.21.15.71:0/1158399572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf80159c60 msgr2=0x7fcf8015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:13.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.070+0000 7fcf861ff700 1 --2- 172.21.15.71:0/1158399572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf80159c60 0x7fcf8015d5d0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fcf740099b0 tx=0x7fcf74009250 comp rx=0 tx=0).stop 2023-10-09T07:01:13.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.070+0000 7fcf861ff700 1 -- 172.21.15.71:0/1158399572 shutdown_connections 2023-10-09T07:01:13.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.070+0000 7fcf861ff700 1 --2- 172.21.15.71:0/1158399572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf80159890 0x7fcf8015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.070+0000 7fcf861ff700 1 --2- 172.21.15.71:0/1158399572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf80159c60 0x7fcf8015d5d0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.070+0000 7fcf861ff700 1 -- 172.21.15.71:0/1158399572 >> 172.21.15.71:0/1158399572 conn(0x7fcf80068e20 msgr2=0x7fcf800d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:13.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.070+0000 7fcf861ff700 1 -- 172.21.15.71:0/1158399572 shutdown_connections 2023-10-09T07:01:13.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.070+0000 7fcf861ff700 1 -- 172.21.15.71:0/1158399572 wait complete. 2023-10-09T07:01:13.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.072+0000 7fcf861ff700 1 Processor -- start 2023-10-09T07:01:13.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.072+0000 7fcf861ff700 1 -- start start 2023-10-09T07:01:13.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.073+0000 7fcf861ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf80159890 0x7fcf80148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:13.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.073+0000 7fcf861ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf80159c60 0x7fcf800b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:13.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.073+0000 7fcf861ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf8015db10 0x7fcf800b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:13.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.073+0000 7fcf861ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf80153770 con 0x7fcf80159c60 2023-10-09T07:01:13.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.073+0000 7fcf861ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8016a310 con 0x7fcf8015db10 2023-10-09T07:01:13.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.073+0000 7fcf861ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf800b62d0 con 0x7fcf80159890 2023-10-09T07:01:13.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.073+0000 7fcf7effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf80159c60 0x7fcf800b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:13.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.073+0000 7fcf7effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf80159c60 0x7fcf800b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35130/0 (socket says 172.21.15.71:35130) 2023-10-09T07:01:13.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.073+0000 7fcf7effd700 1 -- 172.21.15.71:0/591836554 learned_addr learned my addr 172.21.15.71:0/591836554 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:13.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.073+0000 7fcf7f7fe700 1 --2- 172.21.15.71:0/591836554 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf80159890 0x7fcf80148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:13.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.073+0000 7fcf7ffff700 1 --2- 172.21.15.71:0/591836554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf8015db10 0x7fcf800b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:13.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.074+0000 7fcf7effd700 1 -- 172.21.15.71:0/591836554 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf80159890 msgr2=0x7fcf80148160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:13.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.074+0000 7fcf7effd700 1 --2- 172.21.15.71:0/591836554 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf80159890 0x7fcf80148160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.074+0000 7fcf7effd700 1 -- 172.21.15.71:0/591836554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf8015db10 msgr2=0x7fcf800b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:13.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.074+0000 7fcf7effd700 1 --2- 172.21.15.71:0/591836554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf8015db10 0x7fcf800b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.074+0000 7fcf7effd700 1 -- 172.21.15.71:0/591836554 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf740094f0 con 0x7fcf80159c60 2023-10-09T07:01:13.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.074+0000 7fcf7ffff700 1 --2- 172.21.15.71:0/591836554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf8015db10 0x7fcf800b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:01:13.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.074+0000 7fcf7effd700 1 --2- 172.21.15.71:0/591836554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf80159c60 0x7fcf800b56f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fcf800899c0 tx=0x7fcf74017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:13.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.074+0000 7fcf677fe700 1 -- 172.21.15.71:0/591836554 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7400bbe0 con 0x7fcf80159c60 2023-10-09T07:01:13.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.074+0000 7fcf677fe700 1 -- 172.21.15.71:0/591836554 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf74011420 con 0x7fcf80159c60 2023-10-09T07:01:13.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.074+0000 7fcf677fe700 1 -- 172.21.15.71:0/591836554 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf740117c0 con 0x7fcf80159c60 2023-10-09T07:01:13.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.074+0000 7fcf861ff700 1 -- 172.21.15.71:0/591836554 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf80169cc0 con 0x7fcf80159c60 2023-10-09T07:01:13.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.074+0000 7fcf861ff700 1 -- 172.21.15.71:0/591836554 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf801699b0 con 0x7fcf80159c60 2023-10-09T07:01:13.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.075+0000 7fcf861ff700 1 -- 172.21.15.71:0/591836554 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf8016a480 con 0x7fcf80159c60 2023-10-09T07:01:13.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.076+0000 7fcf677fe700 1 -- 172.21.15.71:0/591836554 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf74011bf0 con 0x7fcf80159c60 2023-10-09T07:01:13.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.077+0000 7fcf677fe700 1 --2- 172.21.15.71:0/591836554 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcf6c066f30 0x7fcf6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:13.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.078+0000 7fcf677fe700 1 -- 172.21.15.71:0/591836554 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5961+0+0 (secure 0 0 0) 0x7fcf74085fd0 con 0x7fcf80159c60 2023-10-09T07:01:13.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.078+0000 7fcf7f7fe700 1 --2- 172.21.15.71:0/591836554 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcf6c066f30 0x7fcf6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:13.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.079+0000 7fcf7f7fe700 1 --2- 172.21.15.71:0/591836554 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcf6c066f30 0x7fcf6c0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcf70009db0 tx=0x7fcf700091a0 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:13.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.082+0000 7fcf677fe700 1 -- 172.21.15.71:0/591836554 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf740530a0 con 0x7fcf80159c60 2023-10-09T07:01:13.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.278+0000 7fcf861ff700 1 -- 172.21.15.71:0/591836554 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fcf8004c3c0 con 0x7fcf80159c60 2023-10-09T07:01:13.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.283+0000 7fcf677fe700 1 -- 172.21.15.71:0/591836554 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v44) v1 ==== 115+0+0 (secure 0 0 0) 0x7fcf740566c0 con 0x7fcf80159c60 2023-10-09T07:01:13.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.286+0000 7fcf861ff700 1 -- 172.21.15.71:0/591836554 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcf6c066f30 msgr2=0x7fcf6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:13.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.286+0000 7fcf861ff700 1 --2- 172.21.15.71:0/591836554 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcf6c066f30 0x7fcf6c0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcf70009db0 tx=0x7fcf700091a0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.286+0000 7fcf861ff700 1 -- 172.21.15.71:0/591836554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf80159c60 msgr2=0x7fcf800b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:13.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.286+0000 7fcf861ff700 1 --2- 172.21.15.71:0/591836554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf80159c60 0x7fcf800b56f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fcf800899c0 tx=0x7fcf74017000 comp rx=0 tx=0).stop 2023-10-09T07:01:13.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.286+0000 7fcf861ff700 1 -- 172.21.15.71:0/591836554 shutdown_connections 2023-10-09T07:01:13.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.286+0000 7fcf861ff700 1 --2- 172.21.15.71:0/591836554 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcf6c066f30 0x7fcf6c0693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.286+0000 7fcf861ff700 1 --2- 172.21.15.71:0/591836554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf8015db10 0x7fcf800b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.286+0000 7fcf861ff700 1 --2- 172.21.15.71:0/591836554 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf80159890 0x7fcf80148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.286+0000 7fcf861ff700 1 --2- 172.21.15.71:0/591836554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf80159c60 0x7fcf800b56f0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.286+0000 7fcf861ff700 1 -- 172.21.15.71:0/591836554 >> 172.21.15.71:0/591836554 conn(0x7fcf80068e20 msgr2=0x7fcf80154310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:13.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.286+0000 7fcf861ff700 1 -- 172.21.15.71:0/591836554 shutdown_connections 2023-10-09T07:01:13.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.286+0000 7fcf861ff700 1 -- 172.21.15.71:0/591836554 wait complete. 2023-10-09T07:01:13.305 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-09T07:01:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.489+0000 7f2ff7fff700 1 Processor -- start 2023-10-09T07:01:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.489+0000 7f2ff7fff700 1 -- start start 2023-10-09T07:01:13.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.490+0000 7f2ff7fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2ff80cb1a0 0x7f2ff815a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:13.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.490+0000 7f2ff7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff815a8a0 0x7f2ff806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:13.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.490+0000 7f2ff7fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff806ebd0 con 0x7f2ff806f5a0 2023-10-09T07:01:13.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.490+0000 7f2ff7fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff815b2e0 con 0x7f2ff80cb1a0 2023-10-09T07:01:13.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.490+0000 7f2ff7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff815ad20 con 0x7f2ff815a8a0 2023-10-09T07:01:13.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.491+0000 7f2ff6ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2ff80cb1a0 0x7f2ff815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:13.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.491+0000 7f2feffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff815a8a0 0x7f2ff806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:13.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.491+0000 7f2feffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff815a8a0 0x7f2ff806f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:39532/0 (socket says 172.21.15.71:39532) 2023-10-09T07:01:13.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.491+0000 7f2feffff700 1 -- 172.21.15.71:0/3223259951 learned_addr learned my addr 172.21.15.71:0/3223259951 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:13.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.491+0000 7f2ff77fe700 1 --1- 172.21.15.71:0/3223259951 >> v1:172.21.15.179:6789/0 conn(0x7f2ff806f5a0 0x7f2ff80ae0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:53316/0 (socket says 172.21.15.71:53316) 2023-10-09T07:01:13.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.491+0000 7f2feffff700 1 -- 172.21.15.71:0/3223259951 >> v2:172.21.15.179:3300/0 conn(0x7f2ff80cb1a0 msgr2=0x7f2ff815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:13.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.491+0000 7f2feffff700 1 --2- 172.21.15.71:0/3223259951 >> v2:172.21.15.179:3300/0 conn(0x7f2ff80cb1a0 0x7f2ff815a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.491+0000 7f2feffff700 1 -- 172.21.15.71:0/3223259951 >> v1:172.21.15.179:6789/0 conn(0x7f2ff806f5a0 legacy=0x7f2ff80ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:13.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.491+0000 7f2feffff700 1 -- 172.21.15.71:0/3223259951 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff815b000 con 0x7f2ff815a8a0 2023-10-09T07:01:13.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.491+0000 7f2ff6ffd700 1 --2- 172.21.15.71:0/3223259951 >> v2:172.21.15.179:3300/0 conn(0x7f2ff80cb1a0 0x7f2ff815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:01:13.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.491+0000 7f2feffff700 1 --2- 172.21.15.71:0/3223259951 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff815a8a0 0x7f2ff806f060 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2fe00099b0 tx=0x7f2fe0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e99b24f5ead90b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:13.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.492+0000 7f2ff67fc700 1 -- 172.21.15.71:0/3223259951 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0009ea0 con 0x7f2ff815a8a0 2023-10-09T07:01:13.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.492+0000 7f2ff67fc700 1 -- 172.21.15.71:0/3223259951 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe000b8f0 con 0x7f2ff815a8a0 2023-10-09T07:01:13.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.492+0000 7f2ff67fc700 1 -- 172.21.15.71:0/3223259951 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe000bc90 con 0x7f2ff815a8a0 2023-10-09T07:01:13.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.492+0000 7f2ff7fff700 1 -- 172.21.15.71:0/3223259951 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff815a8a0 msgr2=0x7f2ff806f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:13.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.492+0000 7f2ff7fff700 1 --2- 172.21.15.71:0/3223259951 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff815a8a0 0x7f2ff806f060 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2fe00099b0 tx=0x7f2fe0009250 comp rx=0 tx=0).stop 2023-10-09T07:01:13.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.492+0000 7f2ff7fff700 1 -- 172.21.15.71:0/3223259951 shutdown_connections 2023-10-09T07:01:13.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.492+0000 7f2ff7fff700 1 --2- 172.21.15.71:0/3223259951 >> v2:172.21.15.179:3300/0 conn(0x7f2ff80cb1a0 0x7f2ff815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.492+0000 7f2ff7fff700 1 --2- 172.21.15.71:0/3223259951 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff815a8a0 0x7f2ff806f060 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.492+0000 7f2ff7fff700 1 -- 172.21.15.71:0/3223259951 >> 172.21.15.71:0/3223259951 conn(0x7f2ff80cc1e0 msgr2=0x7f2ff80cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:13.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.492+0000 7f2ff7fff700 1 -- 172.21.15.71:0/3223259951 shutdown_connections 2023-10-09T07:01:13.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.492+0000 7f2ff7fff700 1 -- 172.21.15.71:0/3223259951 wait complete. 2023-10-09T07:01:13.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.494+0000 7f2ff7fff700 1 Processor -- start 2023-10-09T07:01:13.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.494+0000 7f2ff7fff700 1 -- start start 2023-10-09T07:01:13.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.495+0000 7f2ff7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff806f5a0 0x7f2ff81490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:13.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.495+0000 7f2ff7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ff80cb1a0 0x7f2ff815c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:13.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.495+0000 7f2ff7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ff815cc90 0x7f2ff80c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:13.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.495+0000 7f2ff7fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff80c1830 con 0x7f2ff80cb1a0 2023-10-09T07:01:13.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.495+0000 7f2ff7fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff80c1b10 con 0x7f2ff815cc90 2023-10-09T07:01:13.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.495+0000 7f2ff7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff80c1df0 con 0x7f2ff806f5a0 2023-10-09T07:01:13.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.495+0000 7f2feffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ff80cb1a0 0x7f2ff815c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:13.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.495+0000 7f2feffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ff80cb1a0 0x7f2ff815c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35146/0 (socket says 172.21.15.71:35146) 2023-10-09T07:01:13.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.495+0000 7f2feffff700 1 -- 172.21.15.71:0/2754129247 learned_addr learned my addr 172.21.15.71:0/2754129247 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:13.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.495+0000 7f2ff77fe700 1 --2- 172.21.15.71:0/2754129247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ff815cc90 0x7f2ff80c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:13.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.495+0000 7f2ff6ffd700 1 --2- 172.21.15.71:0/2754129247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff806f5a0 0x7f2ff81490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:13.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.495+0000 7f2feffff700 1 -- 172.21.15.71:0/2754129247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff806f5a0 msgr2=0x7f2ff81490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:13.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.495+0000 7f2feffff700 1 --2- 172.21.15.71:0/2754129247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff806f5a0 0x7f2ff81490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.495+0000 7f2feffff700 1 -- 172.21.15.71:0/2754129247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ff815cc90 msgr2=0x7f2ff80c76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:13.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.496+0000 7f2feffff700 1 --2- 172.21.15.71:0/2754129247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ff815cc90 0x7f2ff80c76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.496+0000 7f2feffff700 1 -- 172.21.15.71:0/2754129247 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe8009420 con 0x7f2ff80cb1a0 2023-10-09T07:01:13.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.496+0000 7f2ff6ffd700 1 --2- 172.21.15.71:0/2754129247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff806f5a0 0x7f2ff81490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:01:13.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.496+0000 7f2ff77fe700 1 --2- 172.21.15.71:0/2754129247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ff815cc90 0x7f2ff80c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:01:13.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.496+0000 7f2feffff700 1 --2- 172.21.15.71:0/2754129247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ff80cb1a0 0x7f2ff815c750 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80aed40 tx=0x7f2fe0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:13.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.496+0000 7f2feeffd700 1 -- 172.21.15.71:0/2754129247 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe000bb30 con 0x7f2ff80cb1a0 2023-10-09T07:01:13.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.496+0000 7f2feeffd700 1 -- 172.21.15.71:0/2754129247 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe0026430 con 0x7f2ff80cb1a0 2023-10-09T07:01:13.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.496+0000 7f2feeffd700 1 -- 172.21.15.71:0/2754129247 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe00267f0 con 0x7f2ff80cb1a0 2023-10-09T07:01:13.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.496+0000 7f2ff7fff700 1 -- 172.21.15.71:0/2754129247 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe00094f0 con 0x7f2ff80cb1a0 2023-10-09T07:01:13.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.496+0000 7f2ff7fff700 1 -- 172.21.15.71:0/2754129247 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff80c23b0 con 0x7f2ff80cb1a0 2023-10-09T07:01:13.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.497+0000 7f2ff7fff700 1 -- 172.21.15.71:0/2754129247 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff806c450 con 0x7f2ff80cb1a0 2023-10-09T07:01:13.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.498+0000 7f2feeffd700 1 -- 172.21.15.71:0/2754129247 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2fe0023030 con 0x7f2ff80cb1a0 2023-10-09T07:01:13.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.499+0000 7f2feeffd700 1 --2- 172.21.15.71:0/2754129247 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2fd8066f30 0x7f2fd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:13.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.499+0000 7f2feeffd700 1 -- 172.21.15.71:0/2754129247 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5961+0+0 (secure 0 0 0) 0x7f2fe0085b30 con 0x7f2ff80cb1a0 2023-10-09T07:01:13.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.499+0000 7f2ff6ffd700 1 --2- 172.21.15.71:0/2754129247 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2fd8066f30 0x7f2fd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:13.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.500+0000 7f2ff6ffd700 1 --2- 172.21.15.71:0/2754129247 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2fd8066f30 0x7f2fd80693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80093f0 tx=0x7f2fe8008040 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:13.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.503+0000 7f2feeffd700 1 -- 172.21.15.71:0/2754129247 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fe0052c80 con 0x7f2ff80cb1a0 2023-10-09T07:01:13.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.694+0000 7f2ff7fff700 1 -- 172.21.15.71:0/2754129247 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f2ff806e860 con 0x7f2ff80cb1a0 2023-10-09T07:01:13.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.698+0000 7f2feeffd700 1 -- 172.21.15.71:0/2754129247 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v45) v1 ==== 120+0+0 (secure 0 0 0) 0x7f2fe00150b0 con 0x7f2ff80cb1a0 2023-10-09T07:01:13.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.701+0000 7f2ff7fff700 1 -- 172.21.15.71:0/2754129247 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2fd8066f30 msgr2=0x7f2fd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:13.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.701+0000 7f2ff7fff700 1 --2- 172.21.15.71:0/2754129247 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2fd8066f30 0x7f2fd80693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80093f0 tx=0x7f2fe8008040 comp rx=0 tx=0).stop 2023-10-09T07:01:13.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.701+0000 7f2ff7fff700 1 -- 172.21.15.71:0/2754129247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ff80cb1a0 msgr2=0x7f2ff815c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:13.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.701+0000 7f2ff7fff700 1 --2- 172.21.15.71:0/2754129247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ff80cb1a0 0x7f2ff815c750 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80aed40 tx=0x7f2fe0017000 comp rx=0 tx=0).stop 2023-10-09T07:01:13.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.701+0000 7f2ff7fff700 1 -- 172.21.15.71:0/2754129247 shutdown_connections 2023-10-09T07:01:13.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.701+0000 7f2ff7fff700 1 --2- 172.21.15.71:0/2754129247 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2fd8066f30 0x7f2fd80693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.701+0000 7f2ff7fff700 1 --2- 172.21.15.71:0/2754129247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ff815cc90 0x7f2ff80c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.701+0000 7f2ff7fff700 1 --2- 172.21.15.71:0/2754129247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff806f5a0 0x7f2ff81490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.701+0000 7f2ff7fff700 1 --2- 172.21.15.71:0/2754129247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ff80cb1a0 0x7f2ff815c750 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.701+0000 7f2ff7fff700 1 -- 172.21.15.71:0/2754129247 >> 172.21.15.71:0/2754129247 conn(0x7f2ff80cc1e0 msgr2=0x7f2ff80aef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:13.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.701+0000 7f2ff7fff700 1 -- 172.21.15.71:0/2754129247 shutdown_connections 2023-10-09T07:01:13.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.701+0000 7f2ff7fff700 1 -- 172.21.15.71:0/2754129247 wait complete. 2023-10-09T07:01:13.719 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-10-09T07:01:13.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.899+0000 7fce36f9d700 1 Processor -- start 2023-10-09T07:01:13.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.899+0000 7fce36f9d700 1 -- start start 2023-10-09T07:01:13.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.901+0000 7fce36f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce30150550 0x7fce30157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:13.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.901+0000 7fce36f9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fce300c7410 0x7fce30069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:13.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.901+0000 7fce36f9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3006e2a0 con 0x7fce30150180 2023-10-09T07:01:13.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.901+0000 7fce36f9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce3006b2e0 con 0x7fce300c7410 2023-10-09T07:01:13.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.901+0000 7fce36f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce300c78e0 con 0x7fce30150550 2023-10-09T07:01:13.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.901+0000 7fce3679c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fce300c7410 0x7fce30069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:13.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.901+0000 7fce3679c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fce300c7410 0x7fce30069f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35154/0 (socket says 172.21.15.71:35154) 2023-10-09T07:01:13.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.901+0000 7fce35f9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fce30150180 0x7fce300c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39846/0 (socket says 172.21.15.71:39846) 2023-10-09T07:01:13.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.901+0000 7fce3679c700 1 -- 172.21.15.71:0/1377761082 learned_addr learned my addr 172.21.15.71:0/1377761082 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:13.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.901+0000 7fce3579a700 1 --2- 172.21.15.71:0/1377761082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce30150550 0x7fce30157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:13.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.902+0000 7fce3679c700 1 -- 172.21.15.71:0/1377761082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce30150550 msgr2=0x7fce30157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:13.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.902+0000 7fce3679c700 1 --2- 172.21.15.71:0/1377761082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce30150550 0x7fce30157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.902+0000 7fce3679c700 1 -- 172.21.15.71:0/1377761082 >> v1:172.21.15.71:6789/0 conn(0x7fce30150180 legacy=0x7fce300c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:13.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.902+0000 7fce3679c700 1 -- 172.21.15.71:0/1377761082 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce300c7bc0 con 0x7fce300c7410 2023-10-09T07:01:13.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.902+0000 7fce3579a700 1 --2- 172.21.15.71:0/1377761082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce30150550 0x7fce30157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:01:13.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.902+0000 7fce3679c700 1 --2- 172.21.15.71:0/1377761082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce300c7410 0x7fce30069f50 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fce2800afb0 tx=0x7fce2800a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dead628b178f53ba server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:13.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.902+0000 7fce34f99700 1 -- 172.21.15.71:0/1377761082 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2800a2e0 con 0x7fce300c7410 2023-10-09T07:01:13.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.902+0000 7fce34f99700 1 -- 172.21.15.71:0/1377761082 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2800cb40 con 0x7fce300c7410 2023-10-09T07:01:13.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.902+0000 7fce34f99700 1 -- 172.21.15.71:0/1377761082 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce28008510 con 0x7fce300c7410 2023-10-09T07:01:13.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.902+0000 7fce36f9d700 1 -- 172.21.15.71:0/1377761082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce300c7410 msgr2=0x7fce30069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:13.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.903+0000 7fce36f9d700 1 --2- 172.21.15.71:0/1377761082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce300c7410 0x7fce30069f50 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fce2800afb0 tx=0x7fce2800a950 comp rx=0 tx=0).stop 2023-10-09T07:01:13.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.903+0000 7fce36f9d700 1 -- 172.21.15.71:0/1377761082 shutdown_connections 2023-10-09T07:01:13.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.903+0000 7fce36f9d700 1 --2- 172.21.15.71:0/1377761082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce300c7410 0x7fce30069f50 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.903+0000 7fce36f9d700 1 --2- 172.21.15.71:0/1377761082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce30150550 0x7fce30157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.903+0000 7fce36f9d700 1 -- 172.21.15.71:0/1377761082 >> 172.21.15.71:0/1377761082 conn(0x7fce300cc1f0 msgr2=0x7fce300cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:13.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.903+0000 7fce36f9d700 1 -- 172.21.15.71:0/1377761082 shutdown_connections 2023-10-09T07:01:13.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.903+0000 7fce36f9d700 1 -- 172.21.15.71:0/1377761082 wait complete. 2023-10-09T07:01:13.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.904+0000 7fce36f9d700 1 Processor -- start 2023-10-09T07:01:13.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.904+0000 7fce36f9d700 1 -- start start 2023-10-09T07:01:13.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.905+0000 7fce36f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce300c7410 0x7fce300b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:13.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.905+0000 7fce36f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce30150180 0x7fce3006a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:13.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.905+0000 7fce36f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce30150550 0x7fce300adf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:13.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.905+0000 7fce36f9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce300b1c30 con 0x7fce300c7410 2023-10-09T07:01:13.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.905+0000 7fce36f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce300b0740 con 0x7fce30150550 2023-10-09T07:01:13.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.905+0000 7fce36f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce300af4d0 con 0x7fce30150180 2023-10-09T07:01:13.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.905+0000 7fce35f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce300c7410 0x7fce300b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:13.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.905+0000 7fce35f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce300c7410 0x7fce300b0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35168/0 (socket says 172.21.15.71:35168) 2023-10-09T07:01:13.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.905+0000 7fce35f9b700 1 -- 172.21.15.71:0/4210633578 learned_addr learned my addr 172.21.15.71:0/4210633578 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:13.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.906+0000 7fce3579a700 1 --2- 172.21.15.71:0/4210633578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce30150180 0x7fce3006a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:13.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.906+0000 7fce3679c700 1 --2- 172.21.15.71:0/4210633578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce30150550 0x7fce300adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:13.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.906+0000 7fce35f9b700 1 -- 172.21.15.71:0/4210633578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce30150180 msgr2=0x7fce3006a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:13.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.906+0000 7fce35f9b700 1 --2- 172.21.15.71:0/4210633578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce30150180 0x7fce3006a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.906+0000 7fce35f9b700 1 -- 172.21.15.71:0/4210633578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce30150550 msgr2=0x7fce300adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:13.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.906+0000 7fce35f9b700 1 --2- 172.21.15.71:0/4210633578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce30150550 0x7fce300adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:13.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.906+0000 7fce35f9b700 1 -- 172.21.15.71:0/4210633578 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2800abf0 con 0x7fce300c7410 2023-10-09T07:01:13.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.906+0000 7fce35f9b700 1 --2- 172.21.15.71:0/4210633578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce300c7410 0x7fce300b0200 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fce2c00c7f0 tx=0x7fce2c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:13.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.906+0000 7fce25ffb700 1 -- 172.21.15.71:0/4210633578 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c005a70 con 0x7fce300c7410 2023-10-09T07:01:13.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.906+0000 7fce25ffb700 1 -- 172.21.15.71:0/4210633578 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2c005bf0 con 0x7fce300c7410 2023-10-09T07:01:13.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.906+0000 7fce25ffb700 1 -- 172.21.15.71:0/4210633578 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0070f0 con 0x7fce300c7410 2023-10-09T07:01:13.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.906+0000 7fce36f9d700 1 -- 172.21.15.71:0/4210633578 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce300ac850 con 0x7fce300c7410 2023-10-09T07:01:13.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.906+0000 7fce36f9d700 1 -- 172.21.15.71:0/4210633578 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce300afa00 con 0x7fce300c7410 2023-10-09T07:01:13.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.907+0000 7fce36f9d700 1 -- 172.21.15.71:0/4210633578 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce3004c3c0 con 0x7fce300c7410 2023-10-09T07:01:13.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.908+0000 7fce25ffb700 1 -- 172.21.15.71:0/4210633578 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce2c0074a0 con 0x7fce300c7410 2023-10-09T07:01:13.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.909+0000 7fce25ffb700 1 --2- 172.21.15.71:0/4210633578 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fce14066f30 0x7fce140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:13.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.909+0000 7fce25ffb700 1 -- 172.21.15.71:0/4210633578 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5961+0+0 (secure 0 0 0) 0x7fce2c0841b0 con 0x7fce300c7410 2023-10-09T07:01:13.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.910+0000 7fce3579a700 1 --2- 172.21.15.71:0/4210633578 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fce14066f30 0x7fce140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:13.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.912+0000 7fce3579a700 1 --2- 172.21.15.71:0/4210633578 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fce14066f30 0x7fce140693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fce20006f00 tx=0x7fce20008040 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:13.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:13.913+0000 7fce25ffb700 1 -- 172.21.15.71:0/4210633578 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce2c051300 con 0x7fce300c7410 2023-10-09T07:01:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:14.182+0000 7fce36f9d700 1 -- 172.21.15.71:0/4210633578 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7fce300b0050 con 0x7fce300c7410 2023-10-09T07:01:15.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.083+0000 7fce25ffb700 1 -- 172.21.15.71:0/4210633578 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v707) v1 ==== 148+0+0 (secure 0 0 0) 0x7fce2c054920 con 0x7fce300c7410 2023-10-09T07:01:15.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.086+0000 7fce36f9d700 1 -- 172.21.15.71:0/4210633578 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fce14066f30 msgr2=0x7fce140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:15.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.086+0000 7fce36f9d700 1 --2- 172.21.15.71:0/4210633578 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fce14066f30 0x7fce140693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fce20006f00 tx=0x7fce20008040 comp rx=0 tx=0).stop 2023-10-09T07:01:15.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.086+0000 7fce36f9d700 1 -- 172.21.15.71:0/4210633578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce300c7410 msgr2=0x7fce300b0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:15.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.086+0000 7fce36f9d700 1 --2- 172.21.15.71:0/4210633578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce300c7410 0x7fce300b0200 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fce2c00c7f0 tx=0x7fce2c007f70 comp rx=0 tx=0).stop 2023-10-09T07:01:15.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.087+0000 7fce36f9d700 1 -- 172.21.15.71:0/4210633578 shutdown_connections 2023-10-09T07:01:15.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.087+0000 7fce36f9d700 1 --2- 172.21.15.71:0/4210633578 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fce14066f30 0x7fce140693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:15.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.087+0000 7fce36f9d700 1 --2- 172.21.15.71:0/4210633578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce30150550 0x7fce300adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:15.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.087+0000 7fce36f9d700 1 --2- 172.21.15.71:0/4210633578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce300c7410 0x7fce300b0200 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:15.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.087+0000 7fce36f9d700 1 --2- 172.21.15.71:0/4210633578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce30150180 0x7fce3006a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:15.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.087+0000 7fce36f9d700 1 -- 172.21.15.71:0/4210633578 >> 172.21.15.71:0/4210633578 conn(0x7fce300cc1f0 msgr2=0x7fce300a98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:15.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.087+0000 7fce36f9d700 1 -- 172.21.15.71:0/4210633578 shutdown_connections 2023-10-09T07:01:15.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.087+0000 7fce36f9d700 1 -- 172.21.15.71:0/4210633578 wait complete. 2023-10-09T07:01:15.108 INFO:tasks.cephfs_test_runner:Test existence of a scheduled snapshot ... ok 2023-10-09T07:01:15.108 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that number of snaps retained are as per user spec. 2023-10-09T07:01:15.108 INFO:tasks.cephfs_test_runner:test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-09T07:01:15.109 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention' 2023-10-09T07:01:15.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.291+0000 7fc1cbfff700 1 Processor -- start 2023-10-09T07:01:15.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.291+0000 7fc1cbfff700 1 -- start start 2023-10-09T07:01:15.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.292+0000 7fc1cbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc1566e0 0x7fc1cc0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:15.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.292+0000 7fc1cbfff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1cc0ca860 con 0x7fc1cc156310 2023-10-09T07:01:15.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.292+0000 7fc1cbfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1cc0cab40 con 0x7fc1cc0cb900 2023-10-09T07:01:15.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.292+0000 7fc1cbfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc0cae20 con 0x7fc1cc1566e0 2023-10-09T07:01:15.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.293+0000 7fc1caffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc1cc156310 0x7fc1cc0c9dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59230/0 (socket says 172.21.15.71:59230) 2023-10-09T07:01:15.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.293+0000 7fc1caffd700 1 -- 172.21.15.71:0/1054748973 learned_addr learned my addr 172.21.15.71:0/1054748973 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:01:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.293+0000 7fc1c9ffb700 1 -- 172.21.15.71:0/1054748973 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3168806877 0 0) 0x7fc1cc0ca860 con 0x7fc1cc156310 2023-10-09T07:01:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.293+0000 7fc1ca7fc700 1 --2- 172.21.15.71:0/1054748973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc1566e0 0x7fc1cc0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.293+0000 7fc1c9ffb700 1 -- 172.21.15.71:0/1054748973 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1b4003570 con 0x7fc1cc156310 2023-10-09T07:01:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.293+0000 7fc1c9ffb700 1 -- 172.21.15.71:0/1054748973 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4079180803 0 0) 0x7fc1b4003570 con 0x7fc1cc156310 2023-10-09T07:01:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.293+0000 7fc1c9ffb700 1 -- 172.21.15.71:0/1054748973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc1566e0 msgr2=0x7fc1cc0ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.293+0000 7fc1c9ffb700 1 --2- 172.21.15.71:0/1054748973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc1566e0 0x7fc1cc0ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.293+0000 7fc1c9ffb700 1 -- 172.21.15.71:0/1054748973 >> v1:172.21.15.179:6789/0 conn(0x7fc1cc0cb900 legacy=0x7fc1cc0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.293+0000 7fc1c9ffb700 1 -- 172.21.15.71:0/1054748973 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1cc0cb100 con 0x7fc1cc156310 2023-10-09T07:01:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.293+0000 7fc1c9ffb700 1 -- 172.21.15.71:0/1054748973 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fc1bc001470 con 0x7fc1cc156310 2023-10-09T07:01:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.294+0000 7fc1c9ffb700 1 -- 172.21.15.71:0/1054748973 >> v1:172.21.15.71:6789/0 conn(0x7fc1cc156310 legacy=0x7fc1cc0c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:15.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.294+0000 7fc1c9ffb700 1 --2- 172.21.15.71:0/1054748973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc1566e0 0x7fc1b4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:15.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.294+0000 7fc1c9ffb700 1 --2- 172.21.15.71:0/1054748973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1b4004010 0x7fc1b4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:15.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.294+0000 7fc1c9ffb700 1 --2- 172.21.15.71:0/1054748973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1b4004d50 0x7fc1b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:15.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.294+0000 7fc1c9ffb700 1 -- 172.21.15.71:0/1054748973 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc0cae20 con 0x7fc1b4004d50 2023-10-09T07:01:15.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.294+0000 7fc1c9ffb700 1 -- 172.21.15.71:0/1054748973 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b400de00 con 0x7fc1b4004010 2023-10-09T07:01:15.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.294+0000 7fc1c9ffb700 1 -- 172.21.15.71:0/1054748973 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b400dfc0 con 0x7fc1cc1566e0 2023-10-09T07:01:15.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.294+0000 7fc1cb7fe700 1 --2- 172.21.15.71:0/1054748973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1b4004d50 0x7fc1b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:15.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.294+0000 7fc1ca7fc700 1 --2- 172.21.15.71:0/1054748973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1b4004010 0x7fc1b4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:15.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.294+0000 7fc1caffd700 1 --2- 172.21.15.71:0/1054748973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc1566e0 0x7fc1b4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:15.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.294+0000 7fc1cb7fe700 1 -- 172.21.15.71:0/1054748973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc1566e0 msgr2=0x7fc1b4003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:15.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.294+0000 7fc1cb7fe700 1 --2- 172.21.15.71:0/1054748973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc1566e0 0x7fc1b4003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:15.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.294+0000 7fc1cb7fe700 1 -- 172.21.15.71:0/1054748973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1b4004010 msgr2=0x7fc1b4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:15.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.294+0000 7fc1cb7fe700 1 --2- 172.21.15.71:0/1054748973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1b4004010 0x7fc1b4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:15.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.294+0000 7fc1cb7fe700 1 -- 172.21.15.71:0/1054748973 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b4003570 con 0x7fc1b4004d50 2023-10-09T07:01:15.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.294+0000 7fc1cb7fe700 1 --2- 172.21.15.71:0/1054748973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1b4004d50 0x7fc1b40051c0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4001f90 tx=0x7fc1c4001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffebd816a9c4144c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:15.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.295+0000 7fc1c9ffb700 1 -- 172.21.15.71:0/1054748973 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4001950 con 0x7fc1b4004d50 2023-10-09T07:01:15.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.295+0000 7fc1c9ffb700 1 -- 172.21.15.71:0/1054748973 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c400c8b0 con 0x7fc1b4004d50 2023-10-09T07:01:15.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.295+0000 7fc1c9ffb700 1 -- 172.21.15.71:0/1054748973 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c400cc70 con 0x7fc1b4004d50 2023-10-09T07:01:15.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.295+0000 7fc1cbfff700 1 -- 172.21.15.71:0/1054748973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1b4004d50 msgr2=0x7fc1b40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:15.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.295+0000 7fc1cbfff700 1 --2- 172.21.15.71:0/1054748973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1b4004d50 0x7fc1b40051c0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4001f90 tx=0x7fc1c4001640 comp rx=0 tx=0).stop 2023-10-09T07:01:15.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.295+0000 7fc1cb7fe700 1 -- 172.21.15.71:0/1054748973 reap_dead start 2023-10-09T07:01:15.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.295+0000 7fc1cbfff700 1 -- 172.21.15.71:0/1054748973 shutdown_connections 2023-10-09T07:01:15.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.295+0000 7fc1cbfff700 1 -- 172.21.15.71:0/1054748973 >> 172.21.15.71:0/1054748973 conn(0x7fc1cc0cc1f0 msgr2=0x7fc1cc0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:15.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.295+0000 7fc1cbfff700 1 -- 172.21.15.71:0/1054748973 shutdown_connections 2023-10-09T07:01:15.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.295+0000 7fc1cbfff700 1 -- 172.21.15.71:0/1054748973 wait complete. 2023-10-09T07:01:15.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.297+0000 7fc1cbfff700 1 Processor -- start 2023-10-09T07:01:15.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.297+0000 7fc1cbfff700 1 -- start start 2023-10-09T07:01:15.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.298+0000 7fc1cbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc144b70 0x7fc1cc0c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:15.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.298+0000 7fc1cbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1cc144f40 0x7fc1cc0c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:15.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.298+0000 7fc1cbfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1cc0ca170 0x7fc1cc158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:15.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.298+0000 7fc1cbfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc0c89a0 con 0x7fc1cc144f40 2023-10-09T07:01:15.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.298+0000 7fc1cbfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc0ca5f0 con 0x7fc1cc0ca170 2023-10-09T07:01:15.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.298+0000 7fc1cbfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc0c7d90 con 0x7fc1cc144b70 2023-10-09T07:01:15.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.298+0000 7fc1ca7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1cc144f40 0x7fc1cc0c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:15.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.298+0000 7fc1ca7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1cc144f40 0x7fc1cc0c76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44096/0 (socket says 172.21.15.71:44096) 2023-10-09T07:01:15.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.298+0000 7fc1ca7fc700 1 -- 172.21.15.71:0/951331367 learned_addr learned my addr 172.21.15.71:0/951331367 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:15.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.298+0000 7fc1cb7fe700 1 --2- 172.21.15.71:0/951331367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1cc0ca170 0x7fc1cc158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:15.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.298+0000 7fc1caffd700 1 --2- 172.21.15.71:0/951331367 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc144b70 0x7fc1cc0c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:15.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.298+0000 7fc1ca7fc700 1 -- 172.21.15.71:0/951331367 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc144b70 msgr2=0x7fc1cc0c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:15.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.298+0000 7fc1ca7fc700 1 --2- 172.21.15.71:0/951331367 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc144b70 0x7fc1cc0c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:15.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.298+0000 7fc1ca7fc700 1 -- 172.21.15.71:0/951331367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1cc0ca170 msgr2=0x7fc1cc158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:15.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.298+0000 7fc1ca7fc700 1 --2- 172.21.15.71:0/951331367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1cc0ca170 0x7fc1cc158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:15.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.298+0000 7fc1ca7fc700 1 -- 172.21.15.71:0/951331367 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1cc0c8070 con 0x7fc1cc144f40 2023-10-09T07:01:15.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.298+0000 7fc1caffd700 1 --2- 172.21.15.71:0/951331367 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc144b70 0x7fc1cc0c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:01:15.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.299+0000 7fc1ca7fc700 1 --2- 172.21.15.71:0/951331367 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1cc144f40 0x7fc1cc0c76b0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0011960 tx=0x7fc1c0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:15.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.299+0000 7fc1b2ffd700 1 -- 172.21.15.71:0/951331367 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c000f6d0 con 0x7fc1cc144f40 2023-10-09T07:01:15.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.299+0000 7fc1b2ffd700 1 -- 172.21.15.71:0/951331367 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c000f830 con 0x7fc1cc144f40 2023-10-09T07:01:15.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.299+0000 7fc1b2ffd700 1 -- 172.21.15.71:0/951331367 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c000fbd0 con 0x7fc1cc144f40 2023-10-09T07:01:15.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.299+0000 7fc1cbfff700 1 -- 172.21.15.71:0/951331367 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1cc0c8350 con 0x7fc1cc144f40 2023-10-09T07:01:15.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.299+0000 7fc1cbfff700 1 -- 172.21.15.71:0/951331367 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1cc158f70 con 0x7fc1cc144f40 2023-10-09T07:01:15.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.300+0000 7fc1cbfff700 1 -- 172.21.15.71:0/951331367 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1cc0c8b10 con 0x7fc1cc144f40 2023-10-09T07:01:15.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.301+0000 7fc1b2ffd700 1 -- 172.21.15.71:0/951331367 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc1c0015460 con 0x7fc1cc144f40 2023-10-09T07:01:15.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.303+0000 7fc1b2ffd700 1 --2- 172.21.15.71:0/951331367 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc1b8066f60 0x7fc1b8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:15.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.303+0000 7fc1b2ffd700 1 -- 172.21.15.71:0/951331367 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5961+0+0 (secure 0 0 0) 0x7fc1c0084e60 con 0x7fc1cc144f40 2023-10-09T07:01:15.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.303+0000 7fc1caffd700 1 --2- 172.21.15.71:0/951331367 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc1b8066f60 0x7fc1b8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:15.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.304+0000 7fc1caffd700 1 --2- 172.21.15.71:0/951331367 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc1b8066f60 0x7fc1b8069410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc001ed0 tx=0x7fc1bc001470 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:15.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.307+0000 7fc1b2ffd700 1 -- 172.21.15.71:0/951331367 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1c0051f30 con 0x7fc1cc144f40 2023-10-09T07:01:15.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:15.572+0000 7fc1cbfff700 1 -- 172.21.15.71:0/951331367 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]} v 0) v1 -- 0x7fc1cc04c3c0 con 0x7fc1cc144f40 2023-10-09T07:01:16.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.090+0000 7fc1b2ffd700 1 -- 172.21.15.71:0/951331367 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]}]=0 v708) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc1c0055550 con 0x7fc1cc144f40 2023-10-09T07:01:16.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.092+0000 7fc1cbfff700 1 -- 172.21.15.71:0/951331367 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc1b8066f60 msgr2=0x7fc1b8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:16.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.092+0000 7fc1cbfff700 1 --2- 172.21.15.71:0/951331367 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc1b8066f60 0x7fc1b8069410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc001ed0 tx=0x7fc1bc001470 comp rx=0 tx=0).stop 2023-10-09T07:01:16.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.093+0000 7fc1cbfff700 1 -- 172.21.15.71:0/951331367 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1cc144f40 msgr2=0x7fc1cc0c76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:16.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.093+0000 7fc1cbfff700 1 --2- 172.21.15.71:0/951331367 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1cc144f40 0x7fc1cc0c76b0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0011960 tx=0x7fc1c0008040 comp rx=0 tx=0).stop 2023-10-09T07:01:16.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.093+0000 7fc1cbfff700 1 -- 172.21.15.71:0/951331367 shutdown_connections 2023-10-09T07:01:16.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.093+0000 7fc1cbfff700 1 --2- 172.21.15.71:0/951331367 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc1b8066f60 0x7fc1b8069410 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:16.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.093+0000 7fc1cbfff700 1 --2- 172.21.15.71:0/951331367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1cc0ca170 0x7fc1cc158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:16.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.093+0000 7fc1cbfff700 1 --2- 172.21.15.71:0/951331367 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc144b70 0x7fc1cc0c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:16.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.093+0000 7fc1cbfff700 1 --2- 172.21.15.71:0/951331367 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1cc144f40 0x7fc1cc0c76b0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:16.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.093+0000 7fc1cbfff700 1 -- 172.21.15.71:0/951331367 >> 172.21.15.71:0/951331367 conn(0x7fc1cc0cc1f0 msgr2=0x7fc1cc153c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:16.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.093+0000 7fc1cbfff700 1 -- 172.21.15.71:0/951331367 shutdown_connections 2023-10-09T07:01:16.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.093+0000 7fc1cbfff700 1 -- 172.21.15.71:0/951331367 wait complete. 2023-10-09T07:01:16.113 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T07:01:16.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.297+0000 7f5792b9d700 1 Processor -- start 2023-10-09T07:01:16.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.297+0000 7f5792b9d700 1 -- start start 2023-10-09T07:01:16.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.298+0000 7f5792b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f578c0c9db0 0x7f578c06a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:16.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.298+0000 7f5792b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f578c157130 0x7f578c06a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:16.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.298+0000 7f5792b9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f578c06e150 con 0x7f578c153900 2023-10-09T07:01:16.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.298+0000 7f5792b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f578c0c7610 con 0x7f578c0c9db0 2023-10-09T07:01:16.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.298+0000 7f5792b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578c0c7800 con 0x7f578c157130 2023-10-09T07:01:16.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.298+0000 7f5791b9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f578c153900 0x7f578c0c6f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59242/0 (socket says 172.21.15.71:59242) 2023-10-09T07:01:16.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.299+0000 7f5791b9b700 1 -- 172.21.15.71:0/2367632936 learned_addr learned my addr 172.21.15.71:0/2367632936 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:01:16.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.299+0000 7f579239c700 1 --2- 172.21.15.71:0/2367632936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f578c157130 0x7f578c06a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:16.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.299+0000 7f579139a700 1 --2- 172.21.15.71:0/2367632936 >> v2:172.21.15.179:3300/0 conn(0x7f578c0c9db0 0x7f578c06a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:16.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.299+0000 7f5790b99700 1 -- 172.21.15.71:0/2367632936 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473286843 0 0) 0x7f578c06e150 con 0x7f578c153900 2023-10-09T07:01:16.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.299+0000 7f5790b99700 1 -- 172.21.15.71:0/2367632936 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5778003570 con 0x7f578c153900 2023-10-09T07:01:16.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.299+0000 7f579139a700 1 -- 172.21.15.71:0/2367632936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f578c157130 msgr2=0x7f578c06a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:16.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.299+0000 7f5790b99700 1 -- 172.21.15.71:0/2367632936 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3072493119 0 0) 0x7f5778003570 con 0x7f578c153900 2023-10-09T07:01:16.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.299+0000 7f579139a700 1 --2- 172.21.15.71:0/2367632936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f578c157130 0x7f578c06a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:16.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.299+0000 7f579139a700 1 -- 172.21.15.71:0/2367632936 >> v1:172.21.15.71:6789/0 conn(0x7f578c153900 legacy=0x7f578c0c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:16.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.299+0000 7f579139a700 1 -- 172.21.15.71:0/2367632936 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c0c7ae0 con 0x7f578c0c9db0 2023-10-09T07:01:16.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.300+0000 7f579139a700 1 --2- 172.21.15.71:0/2367632936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f578c0c9db0 0x7f578c06a000 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f577c0098e0 tx=0x7f577c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f87fb96530e77a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:16.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.300+0000 7f5790b99700 1 -- 172.21.15.71:0/2367632936 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788001470 con 0x7f578c0c9db0 2023-10-09T07:01:16.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.300+0000 7f5790b99700 1 -- 172.21.15.71:0/2367632936 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c011420 con 0x7f578c0c9db0 2023-10-09T07:01:16.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.300+0000 7f5790b99700 1 -- 172.21.15.71:0/2367632936 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c0117a0 con 0x7f578c0c9db0 2023-10-09T07:01:16.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.301+0000 7f5792b9d700 1 -- 172.21.15.71:0/2367632936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f578c0c9db0 msgr2=0x7f578c06a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:16.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.301+0000 7f5792b9d700 1 --2- 172.21.15.71:0/2367632936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f578c0c9db0 0x7f578c06a000 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f577c0098e0 tx=0x7f577c0091a0 comp rx=0 tx=0).stop 2023-10-09T07:01:16.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.301+0000 7f5792b9d700 1 -- 172.21.15.71:0/2367632936 shutdown_connections 2023-10-09T07:01:16.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.301+0000 7f5792b9d700 1 --2- 172.21.15.71:0/2367632936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f578c157130 0x7f578c06a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:16.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.301+0000 7f5792b9d700 1 --2- 172.21.15.71:0/2367632936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f578c0c9db0 0x7f578c06a000 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:16.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.301+0000 7f5792b9d700 1 -- 172.21.15.71:0/2367632936 >> 172.21.15.71:0/2367632936 conn(0x7f578c0cc1e0 msgr2=0x7f578c0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:16.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.301+0000 7f5792b9d700 1 -- 172.21.15.71:0/2367632936 shutdown_connections 2023-10-09T07:01:16.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.301+0000 7f5792b9d700 1 -- 172.21.15.71:0/2367632936 wait complete. 2023-10-09T07:01:16.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.302+0000 7f5792b9d700 1 Processor -- start 2023-10-09T07:01:16.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.302+0000 7f5792b9d700 1 -- start start 2023-10-09T07:01:16.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.303+0000 7f5792b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f578c0c9db0 0x7f578c0ae440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:16.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.303+0000 7f5792b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f578c153900 0x7f578c0affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:16.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.303+0000 7f5792b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f578c157130 0x7f578c0c3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:16.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.303+0000 7f5792b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578c0ad3c0 con 0x7f578c157130 2023-10-09T07:01:16.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.303+0000 7f5792b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578c0ad6a0 con 0x7f578c153900 2023-10-09T07:01:16.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.303+0000 7f5792b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578c0ad980 con 0x7f578c0c9db0 2023-10-09T07:01:16.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.303+0000 7f579239c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f578c157130 0x7f578c0c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:16.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.303+0000 7f579239c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f578c157130 0x7f578c0c3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44108/0 (socket says 172.21.15.71:44108) 2023-10-09T07:01:16.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.303+0000 7f579239c700 1 -- 172.21.15.71:0/1958978730 learned_addr learned my addr 172.21.15.71:0/1958978730 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:16.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.304+0000 7f579139a700 1 --2- 172.21.15.71:0/1958978730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f578c153900 0x7f578c0affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:16.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.304+0000 7f5791b9b700 1 --2- 172.21.15.71:0/1958978730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f578c0c9db0 0x7f578c0ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:16.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.304+0000 7f579239c700 1 -- 172.21.15.71:0/1958978730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f578c0c9db0 msgr2=0x7f578c0ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:16.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.304+0000 7f579239c700 1 --2- 172.21.15.71:0/1958978730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f578c0c9db0 0x7f578c0ae440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:16.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.304+0000 7f579239c700 1 -- 172.21.15.71:0/1958978730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f578c153900 msgr2=0x7f578c0affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:16.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.304+0000 7f579239c700 1 --2- 172.21.15.71:0/1958978730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f578c153900 0x7f578c0affa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:16.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.304+0000 7f579239c700 1 -- 172.21.15.71:0/1958978730 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577c009420 con 0x7f578c157130 2023-10-09T07:01:16.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.304+0000 7f579239c700 1 --2- 172.21.15.71:0/1958978730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f578c157130 0x7f578c0c3290 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f5784009de0 tx=0x7f578400a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:16.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.304+0000 7f5781ffb700 1 -- 172.21.15.71:0/1958978730 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5784007cb0 con 0x7f578c157130 2023-10-09T07:01:16.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.304+0000 7f5781ffb700 1 -- 172.21.15.71:0/1958978730 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5784010040 con 0x7f578c157130 2023-10-09T07:01:16.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.304+0000 7f5781ffb700 1 -- 172.21.15.71:0/1958978730 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5784014640 con 0x7f578c157130 2023-10-09T07:01:16.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.304+0000 7f5792b9d700 1 -- 172.21.15.71:0/1958978730 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f578c0adc60 con 0x7f578c157130 2023-10-09T07:01:16.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.304+0000 7f5792b9d700 1 -- 172.21.15.71:0/1958978730 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f578c0b04e0 con 0x7f578c157130 2023-10-09T07:01:16.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.305+0000 7f5792b9d700 1 -- 172.21.15.71:0/1958978730 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f578c0ae2b0 con 0x7f578c157130 2023-10-09T07:01:16.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.306+0000 7f5781ffb700 1 -- 172.21.15.71:0/1958978730 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5784014a30 con 0x7f578c157130 2023-10-09T07:01:16.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.307+0000 7f5781ffb700 1 --2- 172.21.15.71:0/1958978730 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5770066f30 0x7f57700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:16.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.307+0000 7f5781ffb700 1 -- 172.21.15.71:0/1958978730 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5961+0+0 (secure 0 0 0) 0x7f5784084c20 con 0x7f578c157130 2023-10-09T07:01:16.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.307+0000 7f5791b9b700 1 --2- 172.21.15.71:0/1958978730 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5770066f30 0x7f57700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:16.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.308+0000 7f5791b9b700 1 --2- 172.21.15.71:0/1958978730 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5770066f30 0x7f57700693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5788000c00 tx=0x7f5788001100 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:16.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.311+0000 7f5781ffb700 1 -- 172.21.15.71:0/1958978730 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5784051d90 con 0x7f578c157130 2023-10-09T07:01:16.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.503+0000 7f5792b9d700 1 -- 172.21.15.71:0/1958978730 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f578c0c7dc0 con 0x7f578c157130 2023-10-09T07:01:16.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.509+0000 7f5781ffb700 1 -- 172.21.15.71:0/1958978730 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) v1 ==== 122+0+0 (secure 0 0 0) 0x7f578400a390 con 0x7f578c157130 2023-10-09T07:01:16.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.511+0000 7f5792b9d700 1 -- 172.21.15.71:0/1958978730 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5770066f30 msgr2=0x7f57700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:16.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.511+0000 7f5792b9d700 1 --2- 172.21.15.71:0/1958978730 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5770066f30 0x7f57700693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5788000c00 tx=0x7f5788001100 comp rx=0 tx=0).stop 2023-10-09T07:01:16.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.511+0000 7f5792b9d700 1 -- 172.21.15.71:0/1958978730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f578c157130 msgr2=0x7f578c0c3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:16.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.511+0000 7f5792b9d700 1 --2- 172.21.15.71:0/1958978730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f578c157130 0x7f578c0c3290 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f5784009de0 tx=0x7f578400a890 comp rx=0 tx=0).stop 2023-10-09T07:01:16.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.511+0000 7f5792b9d700 1 -- 172.21.15.71:0/1958978730 shutdown_connections 2023-10-09T07:01:16.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.511+0000 7f5792b9d700 1 --2- 172.21.15.71:0/1958978730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f578c157130 0x7f578c0c3290 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:16.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.511+0000 7f5792b9d700 1 --2- 172.21.15.71:0/1958978730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f578c0c9db0 0x7f578c0ae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:16.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.511+0000 7f5792b9d700 1 --2- 172.21.15.71:0/1958978730 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5770066f30 0x7f57700693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:16.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.511+0000 7f5792b9d700 1 --2- 172.21.15.71:0/1958978730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f578c153900 0x7f578c0affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:16.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.511+0000 7f5792b9d700 1 -- 172.21.15.71:0/1958978730 >> 172.21.15.71:0/1958978730 conn(0x7f578c0cc1e0 msgr2=0x7f578c06a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:16.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.511+0000 7f5792b9d700 1 -- 172.21.15.71:0/1958978730 shutdown_connections 2023-10-09T07:01:16.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.511+0000 7f5792b9d700 1 -- 172.21.15.71:0/1958978730 wait complete. 2023-10-09T07:01:16.530 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T07:01:16.530 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T07:01:16.607 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T07:01:16.692 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T07:01:16.692 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T07:01:16.692 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:01:16.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.872+0000 7f69f91ff700 1 Processor -- start 2023-10-09T07:01:17.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.872+0000 7f69f91ff700 1 -- start start 2023-10-09T07:01:17.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.873+0000 7f69f91ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f69f4155c10 0x7f69f4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:17.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.873+0000 7f69f91ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f69f40ac230 0x7f69f40ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:17.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.873+0000 7f69f91ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f40ad930 con 0x7f69f41568a0 2023-10-09T07:01:17.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.873+0000 7f69f91ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f40acd20 con 0x7f69f4155c10 2023-10-09T07:01:17.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.873+0000 7f69f91ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f40ad000 con 0x7f69f40ac230 2023-10-09T07:01:17.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.873+0000 7f69f2d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f69f4155c10 0x7f69f4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:17.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.873+0000 7f69f2d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f69f4155c10 0x7f69f4155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44122/0 (socket says 172.21.15.71:44122) 2023-10-09T07:01:17.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.873+0000 7f69f2d9d700 1 -- 172.21.15.71:0/120559356 learned_addr learned my addr 172.21.15.71:0/120559356 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:17.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.874+0000 7f69f259c700 1 --2- 172.21.15.71:0/120559356 >> v2:172.21.15.179:3300/0 conn(0x7f69f40ac230 0x7f69f40ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:17.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.874+0000 7f69f2d9d700 1 -- 172.21.15.71:0/120559356 >> v2:172.21.15.179:3300/0 conn(0x7f69f40ac230 msgr2=0x7f69f40ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:17.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.874+0000 7f69f2d9d700 1 --2- 172.21.15.71:0/120559356 >> v2:172.21.15.179:3300/0 conn(0x7f69f40ac230 0x7f69f40ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:17.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.874+0000 7f69f2d9d700 1 -- 172.21.15.71:0/120559356 >> v1:172.21.15.179:6789/0 conn(0x7f69f41568a0 legacy=0x7f69f4156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:17.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.874+0000 7f69f2d9d700 1 -- 172.21.15.71:0/120559356 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f40ad2e0 con 0x7f69f4155c10 2023-10-09T07:01:17.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.874+0000 7f69f259c700 1 --2- 172.21.15.71:0/120559356 >> v2:172.21.15.179:3300/0 conn(0x7f69f40ac230 0x7f69f40ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:01:17.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.874+0000 7f69f2d9d700 1 --2- 172.21.15.71:0/120559356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69f4155c10 0x7f69f4155fe0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f69f4065bb0 tx=0x7f69e400b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7252aaa9593ddc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:17.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.874+0000 7f69f1d9b700 1 -- 172.21.15.71:0/120559356 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e400db10 con 0x7f69f4155c10 2023-10-09T07:01:17.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.874+0000 7f69f1d9b700 1 -- 172.21.15.71:0/120559356 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e400dc70 con 0x7f69f4155c10 2023-10-09T07:01:17.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.874+0000 7f69f1d9b700 1 -- 172.21.15.71:0/120559356 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e4017410 con 0x7f69f4155c10 2023-10-09T07:01:17.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.875+0000 7f69f91ff700 1 -- 172.21.15.71:0/120559356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69f4155c10 msgr2=0x7f69f4155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:17.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.875+0000 7f69f91ff700 1 --2- 172.21.15.71:0/120559356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69f4155c10 0x7f69f4155fe0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f69f4065bb0 tx=0x7f69e400b4e0 comp rx=0 tx=0).stop 2023-10-09T07:01:17.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.875+0000 7f69f91ff700 1 -- 172.21.15.71:0/120559356 shutdown_connections 2023-10-09T07:01:17.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.875+0000 7f69f91ff700 1 --2- 172.21.15.71:0/120559356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69f4155c10 0x7f69f4155fe0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:17.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.875+0000 7f69f91ff700 1 --2- 172.21.15.71:0/120559356 >> v2:172.21.15.179:3300/0 conn(0x7f69f40ac230 0x7f69f40ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:17.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.875+0000 7f69f91ff700 1 -- 172.21.15.71:0/120559356 >> 172.21.15.71:0/120559356 conn(0x7f69f406a320 msgr2=0x7f69f40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:17.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.875+0000 7f69f91ff700 1 -- 172.21.15.71:0/120559356 shutdown_connections 2023-10-09T07:01:17.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.875+0000 7f69f91ff700 1 -- 172.21.15.71:0/120559356 wait complete. 2023-10-09T07:01:17.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.876+0000 7f69f91ff700 1 Processor -- start 2023-10-09T07:01:17.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.877+0000 7f69f91ff700 1 -- start start 2023-10-09T07:01:17.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.877+0000 7f69f91ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69f40ac230 0x7f69f4166280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:17.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.877+0000 7f69f91ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69f4155c10 0x7f69f4151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:17.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.877+0000 7f69f91ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69f41568a0 0x7f69f40a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:17.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.877+0000 7f69f91ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f4152a80 con 0x7f69f4155c10 2023-10-09T07:01:17.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.877+0000 7f69f91ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f40a5d60 con 0x7f69f41568a0 2023-10-09T07:01:17.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.877+0000 7f69f91ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f41667c0 con 0x7f69f40ac230 2023-10-09T07:01:17.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.878+0000 7f69f259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69f4155c10 0x7f69f4151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:17.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.878+0000 7f69f259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69f4155c10 0x7f69f4151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44128/0 (socket says 172.21.15.71:44128) 2023-10-09T07:01:17.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.878+0000 7f69f259c700 1 -- 172.21.15.71:0/453412238 learned_addr learned my addr 172.21.15.71:0/453412238 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:17.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.878+0000 7f69f359e700 1 --2- 172.21.15.71:0/453412238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69f41568a0 0x7f69f40a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:17.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.878+0000 7f69f259c700 1 -- 172.21.15.71:0/453412238 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69f40ac230 msgr2=0x7f69f4166280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:17.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.878+0000 7f69f259c700 1 --2- 172.21.15.71:0/453412238 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69f40ac230 0x7f69f4166280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:17.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.878+0000 7f69f259c700 1 -- 172.21.15.71:0/453412238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69f41568a0 msgr2=0x7f69f40a5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:17.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.878+0000 7f69f259c700 1 --2- 172.21.15.71:0/453412238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69f41568a0 0x7f69f40a5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:17.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.878+0000 7f69f259c700 1 -- 172.21.15.71:0/453412238 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e400b780 con 0x7f69f4155c10 2023-10-09T07:01:17.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.878+0000 7f69f359e700 1 --2- 172.21.15.71:0/453412238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69f41568a0 0x7f69f40a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:01:17.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.878+0000 7f69f259c700 1 --2- 172.21.15.71:0/453412238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69f4155c10 0x7f69f4151ef0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f69e800e8d0 tx=0x7f69e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:17.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.878+0000 7f69daffd700 1 -- 172.21.15.71:0/453412238 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e800ee70 con 0x7f69f4155c10 2023-10-09T07:01:17.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.879+0000 7f69daffd700 1 -- 172.21.15.71:0/453412238 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e800c580 con 0x7f69f4155c10 2023-10-09T07:01:17.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.879+0000 7f69f91ff700 1 -- 172.21.15.71:0/453412238 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f4152430 con 0x7f69f4155c10 2023-10-09T07:01:17.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.879+0000 7f69daffd700 1 -- 172.21.15.71:0/453412238 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e800c920 con 0x7f69f4155c10 2023-10-09T07:01:17.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.879+0000 7f69f91ff700 1 -- 172.21.15.71:0/453412238 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f40a54c0 con 0x7f69f4155c10 2023-10-09T07:01:17.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.880+0000 7f69f91ff700 1 -- 172.21.15.71:0/453412238 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f404c3c0 con 0x7f69f4155c10 2023-10-09T07:01:17.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.881+0000 7f69daffd700 1 -- 172.21.15.71:0/453412238 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f69e800cd10 con 0x7f69f4155c10 2023-10-09T07:01:17.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.882+0000 7f69daffd700 1 --2- 172.21.15.71:0/453412238 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f69e0066f30 0x7f69e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:17.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.882+0000 7f69daffd700 1 -- 172.21.15.71:0/453412238 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5961+0+0 (secure 0 0 0) 0x7f69e8084430 con 0x7f69f4155c10 2023-10-09T07:01:17.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.883+0000 7f69f2d9d700 1 --2- 172.21.15.71:0/453412238 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f69e0066f30 0x7f69e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:17.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.883+0000 7f69f2d9d700 1 --2- 172.21.15.71:0/453412238 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f69e0066f30 0x7f69e00693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f69f40cd500 tx=0x7f69e4019000 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:17.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:16.886+0000 7f69daffd700 1 -- 172.21.15.71:0/453412238 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69e8051500 con 0x7f69f4155c10 2023-10-09T07:01:17.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.121+0000 7f69f91ff700 1 -- 172.21.15.71:0/453412238 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69f40ad5c0 con 0x7f69f4155c10 2023-10-09T07:01:17.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.121+0000 7f69daffd700 1 -- 172.21.15.71:0/453412238 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f69e8020de0 con 0x7f69f4155c10 2023-10-09T07:01:17.122 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:01:17.122 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":60,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7378,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1918195834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1918195834},{"type":"v1","addr":"172.21.15.179:6834","nonce":1918195834}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7644,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3880476818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3880476818},{"type":"v1","addr":"172.21.15.71:6833","nonce":3880476818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7656,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/4215423233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":4215423233},{"type":"v1","addr":"172.21.15.179:6836","nonce":4215423233}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2649649231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2649649231},{"type":"v1","addr":"172.21.15.71:6835","nonce":2649649231}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[]} 2023-10-09T07:01:17.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.124+0000 7f69f91ff700 1 -- 172.21.15.71:0/453412238 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f69e0066f30 msgr2=0x7f69e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:17.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.124+0000 7f69f91ff700 1 --2- 172.21.15.71:0/453412238 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f69e0066f30 0x7f69e00693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f69f40cd500 tx=0x7f69e4019000 comp rx=0 tx=0).stop 2023-10-09T07:01:17.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.124+0000 7f69f91ff700 1 -- 172.21.15.71:0/453412238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69f4155c10 msgr2=0x7f69f4151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:17.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.124+0000 7f69f91ff700 1 --2- 172.21.15.71:0/453412238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69f4155c10 0x7f69f4151ef0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f69e800e8d0 tx=0x7f69e8008040 comp rx=0 tx=0).stop 2023-10-09T07:01:17.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.124+0000 7f69f91ff700 1 -- 172.21.15.71:0/453412238 shutdown_connections 2023-10-09T07:01:17.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.124+0000 7f69f91ff700 1 --2- 172.21.15.71:0/453412238 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f69e0066f30 0x7f69e00693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:17.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.124+0000 7f69f91ff700 1 --2- 172.21.15.71:0/453412238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69f41568a0 0x7f69f40a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:17.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.124+0000 7f69f91ff700 1 --2- 172.21.15.71:0/453412238 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69f40ac230 0x7f69f4166280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:17.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.124+0000 7f69f91ff700 1 --2- 172.21.15.71:0/453412238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69f4155c10 0x7f69f4151ef0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:17.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.124+0000 7f69f91ff700 1 -- 172.21.15.71:0/453412238 >> 172.21.15.71:0/453412238 conn(0x7f69f406a320 msgr2=0x7f69f4154690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:17.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.124+0000 7f69f91ff700 1 -- 172.21.15.71:0/453412238 shutdown_connections 2023-10-09T07:01:17.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.124+0000 7f69f91ff700 1 -- 172.21.15.71:0/453412238 wait complete. 2023-10-09T07:01:17.126 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 60 2023-10-09T07:01:17.142 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T07:01:17.142 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T07:01:17.143 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T07:01:17.143 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T07:01:17.143 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T07:01:17.143 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T07:01:17.143 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T07:01:17.143 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T07:01:17.144 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T07:01:17.144 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T07:01:17.144 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T07:01:17.144 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T07:01:17.144 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T07:01:17.144 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T07:01:17.145 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T07:01:17.145 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T07:01:17.156 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T07:01:17.156 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T07:01:17.158 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T07:01:17.158 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T07:01:17.161 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T07:01:17.161 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T07:01:17.162 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T07:01:17.162 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T07:01:17.202 INFO:tasks.ceph.mds.a:Started 2023-10-09T07:01:17.202 DEBUG:teuthology.parallel:result is None 2023-10-09T07:01:17.205 INFO:tasks.ceph.mds.c:Started 2023-10-09T07:01:17.205 DEBUG:teuthology.parallel:result is None 2023-10-09T07:01:17.206 INFO:tasks.ceph.mds.b:Started 2023-10-09T07:01:17.207 DEBUG:teuthology.parallel:result is None 2023-10-09T07:01:17.209 INFO:tasks.ceph.mds.d:Started 2023-10-09T07:01:17.210 DEBUG:teuthology.parallel:result is None 2023-10-09T07:01:17.210 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T07:01:17.333 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2023-10-09T07:01:17.335 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-10-09T07:01:17.347 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-09T07:01:17.347 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-09T07:01:17.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.403+0000 7ff1ce3ff700 1 Processor -- start 2023-10-09T07:01:17.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.403+0000 7ff1ce3ff700 1 -- start start 2023-10-09T07:01:17.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.405+0000 7ff1ce3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff1c8159c60 0x7ff1c815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:17.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.405+0000 7ff1ce3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1c815db10 0x7ff1c8069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:17.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.405+0000 7ff1ce3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c815a160 con 0x7ff1c8159890 2023-10-09T07:01:17.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.405+0000 7ff1ce3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c815df50 con 0x7ff1c8159c60 2023-10-09T07:01:17.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.405+0000 7ff1ce3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c80d13a0 con 0x7ff1c815db10 2023-10-09T07:01:17.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.405+0000 7ff1cc99c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1c815db10 0x7ff1c8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:17.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.405+0000 7ff1c77fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff1c8159c60 0x7ff1c815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:17.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.405+0000 7ff1cc99c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1c815db10 0x7ff1c8069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:38890/0 (socket says 172.21.15.71:38890) 2023-10-09T07:01:17.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.405+0000 7ff1c77fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff1c8159c60 0x7ff1c815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:35290/0 (socket says 172.21.15.71:35290) 2023-10-09T07:01:17.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.405+0000 7ff1cc99c700 1 -- 172.21.15.71:0/890010895 learned_addr learned my addr 172.21.15.71:0/890010895 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:17.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.405+0000 7ff1c7fff700 1 --1- 172.21.15.71:0/890010895 >> v1:172.21.15.179:6789/0 conn(0x7ff1c8159890 0x7ff1c815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:41028/0 (socket says 172.21.15.71:41028) 2023-10-09T07:01:17.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.406+0000 7ff1c6ffd700 1 -- 172.21.15.71:0/890010895 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694838643 0 0) 0x7ff1c815a160 con 0x7ff1c8159890 2023-10-09T07:01:17.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.406+0000 7ff1c6ffd700 1 -- 172.21.15.71:0/890010895 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1b0003570 con 0x7ff1c8159890 2023-10-09T07:01:17.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.406+0000 7ff1cc99c700 1 -- 172.21.15.71:0/890010895 >> v2:172.21.15.179:3300/0 conn(0x7ff1c8159c60 msgr2=0x7ff1c815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:17.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.406+0000 7ff1cc99c700 1 --2- 172.21.15.71:0/890010895 >> v2:172.21.15.179:3300/0 conn(0x7ff1c8159c60 0x7ff1c815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:17.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.406+0000 7ff1cc99c700 1 -- 172.21.15.71:0/890010895 >> v1:172.21.15.179:6789/0 conn(0x7ff1c8159890 legacy=0x7ff1c815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:17.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.406+0000 7ff1cc99c700 1 -- 172.21.15.71:0/890010895 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c815e140 con 0x7ff1c815db10 2023-10-09T07:01:17.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.406+0000 7ff1c77fe700 1 --2- 172.21.15.71:0/890010895 >> v2:172.21.15.179:3300/0 conn(0x7ff1c8159c60 0x7ff1c815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:01:17.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.406+0000 7ff1cc99c700 1 --2- 172.21.15.71:0/890010895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1c815db10 0x7ff1c8069560 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009f20 tx=0x7ff1c0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=903b5df0123fa5c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:17.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.406+0000 7ff1c6ffd700 1 -- 172.21.15.71:0/890010895 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000e070 con 0x7ff1c815db10 2023-10-09T07:01:17.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.406+0000 7ff1c6ffd700 1 -- 172.21.15.71:0/890010895 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c000b970 con 0x7ff1c815db10 2023-10-09T07:01:17.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.406+0000 7ff1c6ffd700 1 -- 172.21.15.71:0/890010895 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c00092e0 con 0x7ff1c815db10 2023-10-09T07:01:17.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.407+0000 7ff1ce3ff700 1 -- 172.21.15.71:0/890010895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1c815db10 msgr2=0x7ff1c8069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:17.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.407+0000 7ff1ce3ff700 1 --2- 172.21.15.71:0/890010895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1c815db10 0x7ff1c8069560 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009f20 tx=0x7ff1c0009840 comp rx=0 tx=0).stop 2023-10-09T07:01:17.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.407+0000 7ff1ce3ff700 1 -- 172.21.15.71:0/890010895 shutdown_connections 2023-10-09T07:01:17.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.407+0000 7ff1ce3ff700 1 --2- 172.21.15.71:0/890010895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1c815db10 0x7ff1c8069560 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:17.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.407+0000 7ff1ce3ff700 1 --2- 172.21.15.71:0/890010895 >> v2:172.21.15.179:3300/0 conn(0x7ff1c8159c60 0x7ff1c815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:17.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.407+0000 7ff1ce3ff700 1 -- 172.21.15.71:0/890010895 >> 172.21.15.71:0/890010895 conn(0x7ff1c8068e20 msgr2=0x7ff1c80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:17.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.407+0000 7ff1ce3ff700 1 -- 172.21.15.71:0/890010895 shutdown_connections 2023-10-09T07:01:17.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.407+0000 7ff1ce3ff700 1 -- 172.21.15.71:0/890010895 wait complete. 2023-10-09T07:01:17.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.408+0000 7ff1ce3ff700 1 Processor -- start 2023-10-09T07:01:17.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.408+0000 7ff1ce3ff700 1 -- start start 2023-10-09T07:01:17.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.409+0000 7ff1ce3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1c8159890 0x7ff1c8155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:17.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.409+0000 7ff1ce3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1c8159c60 0x7ff1c80b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:17.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.409+0000 7ff1ce3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1c815db10 0x7ff1c80b5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:17.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.409+0000 7ff1ce3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c80cd340 con 0x7ff1c815db10 2023-10-09T07:01:17.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.409+0000 7ff1ce3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c80cd590 con 0x7ff1c8159c60 2023-10-09T07:01:17.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.409+0000 7ff1ce3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c80cd870 con 0x7ff1c8159890 2023-10-09T07:01:17.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.410+0000 7ff1cc99c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1c815db10 0x7ff1c80b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:17.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.410+0000 7ff1cc99c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1c815db10 0x7ff1c80b5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44164/0 (socket says 172.21.15.71:44164) 2023-10-09T07:01:17.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.410+0000 7ff1cc99c700 1 -- 172.21.15.71:0/3210682146 learned_addr learned my addr 172.21.15.71:0/3210682146 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:17.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.410+0000 7ff1c77fe700 1 --2- 172.21.15.71:0/3210682146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1c8159c60 0x7ff1c80b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:17.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.410+0000 7ff1c7fff700 1 --2- 172.21.15.71:0/3210682146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1c8159890 0x7ff1c8155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:17.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.410+0000 7ff1cc99c700 1 -- 172.21.15.71:0/3210682146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1c8159890 msgr2=0x7ff1c8155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:17.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.410+0000 7ff1cc99c700 1 --2- 172.21.15.71:0/3210682146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1c8159890 0x7ff1c8155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:17.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.410+0000 7ff1cc99c700 1 -- 172.21.15.71:0/3210682146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1c8159c60 msgr2=0x7ff1c80b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:17.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.410+0000 7ff1cc99c700 1 --2- 172.21.15.71:0/3210682146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1c8159c60 0x7ff1c80b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:17.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.410+0000 7ff1cc99c700 1 -- 172.21.15.71:0/3210682146 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc009420 con 0x7ff1c815db10 2023-10-09T07:01:17.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.410+0000 7ff1cc99c700 1 --2- 172.21.15.71:0/3210682146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1c815db10 0x7ff1c80b5430 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000b610 tx=0x7ff1c0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:17.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.410+0000 7ff1affff700 1 -- 172.21.15.71:0/3210682146 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0007c20 con 0x7ff1c815db10 2023-10-09T07:01:17.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.410+0000 7ff1affff700 1 -- 172.21.15.71:0/3210682146 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c0007d80 con 0x7ff1c815db10 2023-10-09T07:01:17.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.411+0000 7ff1ce3ff700 1 -- 172.21.15.71:0/3210682146 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c0009ae0 con 0x7ff1c815db10 2023-10-09T07:01:17.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.411+0000 7ff1affff700 1 -- 172.21.15.71:0/3210682146 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c001d650 con 0x7ff1c815db10 2023-10-09T07:01:17.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.411+0000 7ff1ce3ff700 1 -- 172.21.15.71:0/3210682146 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c80cde30 con 0x7ff1c815db10 2023-10-09T07:01:17.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.412+0000 7ff1ce3ff700 1 -- 172.21.15.71:0/3210682146 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c80ce020 con 0x7ff1c815db10 2023-10-09T07:01:17.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.413+0000 7ff1affff700 1 -- 172.21.15.71:0/3210682146 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1c0003040 con 0x7ff1c815db10 2023-10-09T07:01:17.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.414+0000 7ff1affff700 1 --2- 172.21.15.71:0/3210682146 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff1b4066f30 0x7ff1b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:17.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.414+0000 7ff1affff700 1 -- 172.21.15.71:0/3210682146 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5961+0+0 (secure 0 0 0) 0x7ff1c00861d0 con 0x7ff1c815db10 2023-10-09T07:01:17.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.415+0000 7ff1c7fff700 1 --2- 172.21.15.71:0/3210682146 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff1b4066f30 0x7ff1b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:17.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.415+0000 7ff1c7fff700 1 --2- 172.21.15.71:0/3210682146 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff1b4066f30 0x7ff1b40693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8005e50 tx=0x7ff1b8007ba0 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:17.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.418+0000 7ff1affff700 1 -- 172.21.15.71:0/3210682146 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1c0053350 con 0x7ff1c815db10 2023-10-09T07:01:17.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:17.626+0000 7ff1ce3ff700 1 -- 172.21.15.71:0/3210682146 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff1c804c3c0 con 0x7ff1c815db10 2023-10-09T07:01:18.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.111+0000 7ff1affff700 1 -- 172.21.15.71:0/3210682146 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v131) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff1c0009940 con 0x7ff1c815db10 2023-10-09T07:01:18.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.113+0000 7ff1ce3ff700 1 -- 172.21.15.71:0/3210682146 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff1b4066f30 msgr2=0x7ff1b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:18.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.113+0000 7ff1ce3ff700 1 --2- 172.21.15.71:0/3210682146 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff1b4066f30 0x7ff1b40693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8005e50 tx=0x7ff1b8007ba0 comp rx=0 tx=0).stop 2023-10-09T07:01:18.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.113+0000 7ff1ce3ff700 1 -- 172.21.15.71:0/3210682146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1c815db10 msgr2=0x7ff1c80b5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:18.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.113+0000 7ff1ce3ff700 1 --2- 172.21.15.71:0/3210682146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1c815db10 0x7ff1c80b5430 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000b610 tx=0x7ff1c0018000 comp rx=0 tx=0).stop 2023-10-09T07:01:18.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.113+0000 7ff1ce3ff700 1 -- 172.21.15.71:0/3210682146 shutdown_connections 2023-10-09T07:01:18.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.113+0000 7ff1ce3ff700 1 --2- 172.21.15.71:0/3210682146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1c815db10 0x7ff1c80b5430 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:18.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.113+0000 7ff1ce3ff700 1 --2- 172.21.15.71:0/3210682146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1c8159890 0x7ff1c8155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:18.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.113+0000 7ff1ce3ff700 1 --2- 172.21.15.71:0/3210682146 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff1b4066f30 0x7ff1b40693e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:18.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.113+0000 7ff1ce3ff700 1 --2- 172.21.15.71:0/3210682146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1c8159c60 0x7ff1c80b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:18.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.113+0000 7ff1ce3ff700 1 -- 172.21.15.71:0/3210682146 >> 172.21.15.71:0/3210682146 conn(0x7ff1c8068e20 msgr2=0x7ff1c814d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:18.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.114+0000 7ff1ce3ff700 1 -- 172.21.15.71:0/3210682146 shutdown_connections 2023-10-09T07:01:18.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.114+0000 7ff1ce3ff700 1 -- 172.21.15.71:0/3210682146 wait complete. 2023-10-09T07:01:18.116 INFO:teuthology.orchestra.run.smithi071.stderr: removed all blocklist entries 2023-10-09T07:01:18.135 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T07:01:18.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.315+0000 7f6f91bff700 1 Processor -- start 2023-10-09T07:01:18.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.315+0000 7f6f91bff700 1 -- start start 2023-10-09T07:01:18.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.316+0000 7f6f91bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f8c0b1850 0x7f6f8c0b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:18.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.316+0000 7f6f91bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6f8c0ae680 0x7f6f8c1572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:18.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.316+0000 7f6f91bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6f8c0aead0 0x7f6f8c157820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:18.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.316+0000 7f6f91bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8c06fc30 con 0x7f6f8c0aead0 2023-10-09T07:01:18.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.316+0000 7f6f91bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8c0cc260 con 0x7f6f8c0ae680 2023-10-09T07:01:18.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.316+0000 7f6f91bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c0cb300 con 0x7f6f8c0b1850 2023-10-09T07:01:18.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.316+0000 7f6f8bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6f8c0aead0 0x7f6f8c157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:18.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.317+0000 7f6f8bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6f8c0aead0 0x7f6f8c157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44166/0 (socket says 172.21.15.71:44166) 2023-10-09T07:01:18.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.317+0000 7f6f8bfff700 1 -- 172.21.15.71:0/1300985995 learned_addr learned my addr 172.21.15.71:0/1300985995 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:18.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.317+0000 7f6f8affd700 1 --2- 172.21.15.71:0/1300985995 >> v2:172.21.15.179:3300/0 conn(0x7f6f8c0ae680 0x7f6f8c1572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:18.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.317+0000 7f6f8b7fe700 1 --2- 172.21.15.71:0/1300985995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f8c0b1850 0x7f6f8c0b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:18.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.317+0000 7f6f8bfff700 1 -- 172.21.15.71:0/1300985995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f8c0b1850 msgr2=0x7f6f8c0b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:18.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.317+0000 7f6f8bfff700 1 --2- 172.21.15.71:0/1300985995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f8c0b1850 0x7f6f8c0b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:18.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.317+0000 7f6f8bfff700 1 -- 172.21.15.71:0/1300985995 >> v2:172.21.15.179:3300/0 conn(0x7f6f8c0ae680 msgr2=0x7f6f8c1572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:18.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.317+0000 7f6f8bfff700 1 --2- 172.21.15.71:0/1300985995 >> v2:172.21.15.179:3300/0 conn(0x7f6f8c0ae680 0x7f6f8c1572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:18.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.317+0000 7f6f8bfff700 1 -- 172.21.15.71:0/1300985995 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c0cb5e0 con 0x7f6f8c0aead0 2023-10-09T07:01:18.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.317+0000 7f6f8bfff700 1 --2- 172.21.15.71:0/1300985995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f8c0aead0 0x7f6f8c157820 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c06d2a0 tx=0x7f6f84009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1e985e1ed1db4b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:18.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.317+0000 7f6f8a7fc700 1 -- 172.21.15.71:0/1300985995 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8400e070 con 0x7f6f8c0aead0 2023-10-09T07:01:18.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.317+0000 7f6f8a7fc700 1 -- 172.21.15.71:0/1300985995 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8400ba50 con 0x7f6f8c0aead0 2023-10-09T07:01:18.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.318+0000 7f6f8a7fc700 1 -- 172.21.15.71:0/1300985995 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f840092e0 con 0x7f6f8c0aead0 2023-10-09T07:01:18.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.318+0000 7f6f91bff700 1 -- 172.21.15.71:0/1300985995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f8c0aead0 msgr2=0x7f6f8c157820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:18.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.318+0000 7f6f91bff700 1 --2- 172.21.15.71:0/1300985995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f8c0aead0 0x7f6f8c157820 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c06d2a0 tx=0x7f6f84009840 comp rx=0 tx=0).stop 2023-10-09T07:01:18.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.318+0000 7f6f91bff700 1 -- 172.21.15.71:0/1300985995 shutdown_connections 2023-10-09T07:01:18.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.318+0000 7f6f91bff700 1 --2- 172.21.15.71:0/1300985995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f8c0aead0 0x7f6f8c157820 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:18.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.318+0000 7f6f91bff700 1 --2- 172.21.15.71:0/1300985995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f8c0b1850 0x7f6f8c0b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:18.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.318+0000 7f6f91bff700 1 --2- 172.21.15.71:0/1300985995 >> v2:172.21.15.179:3300/0 conn(0x7f6f8c0ae680 0x7f6f8c1572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:18.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.318+0000 7f6f91bff700 1 -- 172.21.15.71:0/1300985995 >> 172.21.15.71:0/1300985995 conn(0x7f6f8c06a320 msgr2=0x7f6f8c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:18.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.318+0000 7f6f91bff700 1 -- 172.21.15.71:0/1300985995 shutdown_connections 2023-10-09T07:01:18.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.318+0000 7f6f91bff700 1 -- 172.21.15.71:0/1300985995 wait complete. 2023-10-09T07:01:18.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.320+0000 7f6f91bff700 1 Processor -- start 2023-10-09T07:01:18.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.320+0000 7f6f91bff700 1 -- start start 2023-10-09T07:01:18.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.320+0000 7f6f91bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f8c0ae680 0x7f6f8c168590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:18.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.321+0000 7f6f91bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f8c0aead0 0x7f6f8c152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:18.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.321+0000 7f6f91bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f8c0b1850 0x7f6f8c155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:18.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.321+0000 7f6f91bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c168ad0 con 0x7f6f8c0ae680 2023-10-09T07:01:18.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.321+0000 7f6f91bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c1581c0 con 0x7f6f8c0aead0 2023-10-09T07:01:18.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.321+0000 7f6f91bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c1584a0 con 0x7f6f8c0b1850 2023-10-09T07:01:18.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.321+0000 7f6f8b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f8c0ae680 0x7f6f8c168590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:18.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.321+0000 7f6f8b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f8c0ae680 0x7f6f8c168590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44182/0 (socket says 172.21.15.71:44182) 2023-10-09T07:01:18.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.321+0000 7f6f8b7fe700 1 -- 172.21.15.71:0/2411093694 learned_addr learned my addr 172.21.15.71:0/2411093694 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:18.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.321+0000 7f6f8b7fe700 1 -- 172.21.15.71:0/2411093694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f8c0b1850 msgr2=0x7f6f8c155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:18.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.321+0000 7f6f8b7fe700 1 --2- 172.21.15.71:0/2411093694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f8c0b1850 0x7f6f8c155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:18.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.321+0000 7f6f8b7fe700 1 -- 172.21.15.71:0/2411093694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f8c0aead0 msgr2=0x7f6f8c152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:18.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.321+0000 7f6f8b7fe700 1 --2- 172.21.15.71:0/2411093694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f8c0aead0 0x7f6f8c152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:18.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.321+0000 7f6f8b7fe700 1 -- 172.21.15.71:0/2411093694 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f84009ae0 con 0x7f6f8c0ae680 2023-10-09T07:01:18.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.321+0000 7f6f8b7fe700 1 --2- 172.21.15.71:0/2411093694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f8c0ae680 0x7f6f8c168590 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c00d860 tx=0x7f6f7c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:18.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.322+0000 7f6f737fe700 1 -- 172.21.15.71:0/2411093694 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c0125f0 con 0x7f6f8c0ae680 2023-10-09T07:01:18.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.322+0000 7f6f737fe700 1 -- 172.21.15.71:0/2411093694 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7c012750 con 0x7f6f8c0ae680 2023-10-09T07:01:18.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.322+0000 7f6f91bff700 1 -- 172.21.15.71:0/2411093694 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8c158780 con 0x7f6f8c0ae680 2023-10-09T07:01:18.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.322+0000 7f6f737fe700 1 -- 172.21.15.71:0/2411093694 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c012b10 con 0x7f6f8c0ae680 2023-10-09T07:01:18.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.322+0000 7f6f91bff700 1 -- 172.21.15.71:0/2411093694 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8c158d40 con 0x7f6f8c0ae680 2023-10-09T07:01:18.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.323+0000 7f6f91bff700 1 -- 172.21.15.71:0/2411093694 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8c0b2430 con 0x7f6f8c0ae680 2023-10-09T07:01:18.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.324+0000 7f6f737fe700 1 -- 172.21.15.71:0/2411093694 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f7c01e460 con 0x7f6f8c0ae680 2023-10-09T07:01:18.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.324+0000 7f6f737fe700 1 --2- 172.21.15.71:0/2411093694 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6f78066f30 0x7f6f780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:18.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.325+0000 7f6f737fe700 1 -- 172.21.15.71:0/2411093694 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5273+0+0 (secure 0 0 0) 0x7f6f7c084ab0 con 0x7f6f8c0ae680 2023-10-09T07:01:18.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.325+0000 7f6f8affd700 1 --2- 172.21.15.71:0/2411093694 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6f78066f30 0x7f6f780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:18.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.326+0000 7f6f8affd700 1 --2- 172.21.15.71:0/2411093694 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6f78066f30 0x7f6f780693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c15a8f0 tx=0x7f6f80008040 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:18.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.328+0000 7f6f737fe700 1 -- 172.21.15.71:0/2411093694 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f7c051e30 con 0x7f6f8c0ae680 2023-10-09T07:01:18.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.595+0000 7f6f91bff700 1 -- 172.21.15.71:0/2411093694 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6f8c158f60 con 0x7f6f8c0ae680 2023-10-09T07:01:18.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.596+0000 7f6f737fe700 1 -- 172.21.15.71:0/2411093694 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6f7c055450 con 0x7f6f8c0ae680 2023-10-09T07:01:18.597 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:01:18.597 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T07:01:18.597 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_dump": [ 2023-10-09T07:01:18.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:01:18.598 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.a", 2023-10-09T07:01:18.598 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlpI5JCRAAGBgrs6g+6KZFXv1eq0fkwQ==", 2023-10-09T07:01:18.598 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:01:18.598 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:01:18.598 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T07:01:18.598 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T07:01:18.598 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:01:18.598 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:01:18.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:01:18.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:01:18.598 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.b", 2023-10-09T07:01:18.599 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlDZQYHhAA2LGKHPLrBVKlGMK0TKup7A==", 2023-10-09T07:01:18.599 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:01:18.599 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:01:18.599 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T07:01:18.599 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T07:01:18.599 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:01:18.599 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:01:18.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:01:18.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:01:18.600 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.c", 2023-10-09T07:01:18.600 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlLKKfExAA65+KIyYd16iQ2L5topDPkg==", 2023-10-09T07:01:18.600 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:01:18.600 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:01:18.600 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T07:01:18.600 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T07:01:18.600 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:01:18.600 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:01:18.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:01:18.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:01:18.600 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.d", 2023-10-09T07:01:18.601 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlpQKTKBAAP59h/znElthIdqbK9tKJww==", 2023-10-09T07:01:18.601 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:01:18.601 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:01:18.601 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T07:01:18.601 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T07:01:18.601 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:01:18.601 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:01:18.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:01:18.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:01:18.601 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.0", 2023-10-09T07:01:18.601 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCgoCNll7hBIBAAtZ8mBx+MPAwEou48boP4Hw==", 2023-10-09T07:01:18.601 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:01:18.602 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:01:18.602 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:01:18.602 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:01:18.602 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:01:18.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:01:18.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:01:18.602 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.1", 2023-10-09T07:01:18.602 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCjoCNl7uRMIxAAztQi4ZsulyN2FHcMRzZ82Q==", 2023-10-09T07:01:18.602 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:01:18.602 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:01:18.602 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:01:18.602 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:01:18.603 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:01:18.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:01:18.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:01:18.603 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.2", 2023-10-09T07:01:18.603 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCmoCNlW/cNJhAAfFdnRC95YJwpCngJS956cA==", 2023-10-09T07:01:18.603 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:01:18.603 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:01:18.603 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:01:18.603 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:01:18.603 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:01:18.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:01:18.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:01:18.604 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.3", 2023-10-09T07:01:18.604 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCpoCNlAIlYKRAAD5IGHWZ14ckpQAU4wBifbg==", 2023-10-09T07:01:18.604 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:01:18.604 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:01:18.604 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:01:18.604 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:01:18.604 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:01:18.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:01:18.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:01:18.604 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.4", 2023-10-09T07:01:18.605 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCvoCNltrA4ORAAtifmL9hr1xKd+jsMf5Nf+Q==", 2023-10-09T07:01:18.605 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:01:18.605 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:01:18.605 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:01:18.605 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:01:18.605 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:01:18.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:01:18.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:01:18.605 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.5", 2023-10-09T07:01:18.606 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCyoCNlA/IOOxAAQWRPQ+00o9xrpScAvY/87w==", 2023-10-09T07:01:18.606 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:01:18.606 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:01:18.606 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:01:18.606 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:01:18.606 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:01:18.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:01:18.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:01:18.606 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.6", 2023-10-09T07:01:18.606 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQC2oCNlvRusARAAcRaGyCROIRVTHeKhrncN8g==", 2023-10-09T07:01:18.607 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:01:18.607 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:01:18.607 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:01:18.607 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:01:18.607 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:01:18.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:01:18.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:01:18.607 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.7", 2023-10-09T07:01:18.607 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQC5oCNli/3NAxAAIMYuED41ZSx1xF384N6y1A==", 2023-10-09T07:01:18.607 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:01:18.607 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:01:18.607 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:01:18.608 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:01:18.608 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:01:18.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:01:18.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:01:18.608 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.0", 2023-10-09T07:01:18.608 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlHrKWMRAAyIfmryGSgqIFwWEJyixprw==", 2023-10-09T07:01:18.608 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:01:18.608 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:01:18.608 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow r", 2023-10-09T07:01:18.608 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T07:01:18.608 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:01:18.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:01:18.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:01:18.609 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.1", 2023-10-09T07:01:18.609 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCdoCNldq1xAxAAxCpmelS0qDEY187u19JkcQ==", 2023-10-09T07:01:18.609 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:01:18.609 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:01:18.609 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T07:01:18.609 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T07:01:18.609 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T07:01:18.609 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:01:18.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:01:18.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:01:18.610 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.2", 2023-10-09T07:01:18.610 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlM3JHOBAA8fszREXH+WnYb+3vIaakcA==", 2023-10-09T07:01:18.610 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:01:18.610 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:01:18.610 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T07:01:18.610 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T07:01:18.611 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T07:01:18.611 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:01:18.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:01:18.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:01:18.611 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.3", 2023-10-09T07:01:18.611 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCdoCNlgkEqChAAwntdv9UOo30x40pVa70yag==", 2023-10-09T07:01:18.611 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:01:18.611 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:01:18.611 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T07:01:18.611 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T07:01:18.611 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T07:01:18.611 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:01:18.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:01:18.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:01:18.612 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.admin", 2023-10-09T07:01:18.612 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCboCNlj2W4EhAAUnfX6NBeDyMj2nY/G2ciEg==", 2023-10-09T07:01:18.612 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:01:18.612 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T07:01:18.612 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T07:01:18.612 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T07:01:18.612 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:01:18.612 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:01:18.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:01:18.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:01:18.613 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.x", 2023-10-09T07:01:18.613 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlwwJ/AhAAjHMhAX1/yWgh9no7yQqP6Q==", 2023-10-09T07:01:18.613 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:01:18.613 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T07:01:18.613 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-09T07:01:18.613 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:01:18.613 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:01:18.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:01:18.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:01:18.613 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.y", 2023-10-09T07:01:18.613 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCboCNly/XVNRAAlKr9arCbsDbzZ9bpIU5dng==", 2023-10-09T07:01:18.614 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:01:18.614 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T07:01:18.614 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-09T07:01:18.614 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:01:18.614 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:01:18.614 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:01:18.614 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2023-10-09T07:01:18.614 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T07:01:18.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.598+0000 7f6f91bff700 1 -- 172.21.15.71:0/2411093694 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6f78066f30 msgr2=0x7f6f780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:18.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.598+0000 7f6f91bff700 1 --2- 172.21.15.71:0/2411093694 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6f78066f30 0x7f6f780693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c15a8f0 tx=0x7f6f80008040 comp rx=0 tx=0).stop 2023-10-09T07:01:18.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.598+0000 7f6f91bff700 1 -- 172.21.15.71:0/2411093694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f8c0ae680 msgr2=0x7f6f8c168590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:18.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.598+0000 7f6f91bff700 1 --2- 172.21.15.71:0/2411093694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f8c0ae680 0x7f6f8c168590 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c00d860 tx=0x7f6f7c008040 comp rx=0 tx=0).stop 2023-10-09T07:01:18.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.598+0000 7f6f91bff700 1 -- 172.21.15.71:0/2411093694 shutdown_connections 2023-10-09T07:01:18.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.598+0000 7f6f91bff700 1 --2- 172.21.15.71:0/2411093694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f8c0b1850 0x7f6f8c155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:18.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.598+0000 7f6f91bff700 1 --2- 172.21.15.71:0/2411093694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f8c0ae680 0x7f6f8c168590 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:18.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.598+0000 7f6f91bff700 1 --2- 172.21.15.71:0/2411093694 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6f78066f30 0x7f6f780693e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:18.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.598+0000 7f6f91bff700 1 --2- 172.21.15.71:0/2411093694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f8c0aead0 0x7f6f8c152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:18.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.598+0000 7f6f91bff700 1 -- 172.21.15.71:0/2411093694 >> 172.21.15.71:0/2411093694 conn(0x7f6f8c06a320 msgr2=0x7f6f8c06ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:18.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.598+0000 7f6f91bff700 1 -- 172.21.15.71:0/2411093694 shutdown_connections 2023-10-09T07:01:18.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.598+0000 7f6f91bff700 1 -- 172.21.15.71:0/2411093694 wait complete. 2023-10-09T07:01:18.617 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:01:18.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.795+0000 7f6a4559d700 1 Processor -- start 2023-10-09T07:01:18.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.796+0000 7f6a4559d700 1 -- start start 2023-10-09T07:01:18.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.797+0000 7f6a4559d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6a40150180 0x7f6a40157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:18.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.797+0000 7f6a4559d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4006e2a0 con 0x7f6a40150550 2023-10-09T07:01:18.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.797+0000 7f6a4559d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4006b2e0 con 0x7f6a400c7410 2023-10-09T07:01:18.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.797+0000 7f6a4559d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a400c78e0 con 0x7f6a40150180 2023-10-09T07:01:18.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.797+0000 7f6a3ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6a40150180 0x7f6a40157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:18.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.797+0000 7f6a3ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6a40150180 0x7f6a40157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44198/0 (socket says 172.21.15.71:44198) 2023-10-09T07:01:18.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.797+0000 7f6a3ffff700 1 -- 172.21.15.71:0/541436369 learned_addr learned my addr 172.21.15.71:0/541436369 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:18.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.798+0000 7f6a3ffff700 1 -- 172.21.15.71:0/541436369 >> v1:172.21.15.179:6789/0 conn(0x7f6a400c7410 legacy=0x7f6a40069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:18.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.798+0000 7f6a3ffff700 1 -- 172.21.15.71:0/541436369 >> v1:172.21.15.71:6789/0 conn(0x7f6a40150550 legacy=0x7f6a400c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:18.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.798+0000 7f6a3ffff700 1 -- 172.21.15.71:0/541436369 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a400c7bc0 con 0x7f6a40150180 2023-10-09T07:01:18.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.798+0000 7f6a3ffff700 1 --2- 172.21.15.71:0/541436369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a40150180 0x7f6a40157770 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f6a3000ab50 tx=0x7f6a3000a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9875bba95112636d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:18.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.798+0000 7f6a3effd700 1 -- 172.21.15.71:0/541436369 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3000ca20 con 0x7f6a40150180 2023-10-09T07:01:18.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.798+0000 7f6a3effd700 1 -- 172.21.15.71:0/541436369 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3000cb80 con 0x7f6a40150180 2023-10-09T07:01:18.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.798+0000 7f6a3effd700 1 -- 172.21.15.71:0/541436369 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a300183f0 con 0x7f6a40150180 2023-10-09T07:01:18.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.799+0000 7f6a4559d700 1 -- 172.21.15.71:0/541436369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a40150180 msgr2=0x7f6a40157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:18.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.799+0000 7f6a4559d700 1 --2- 172.21.15.71:0/541436369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a40150180 0x7f6a40157770 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f6a3000ab50 tx=0x7f6a3000a3f0 comp rx=0 tx=0).stop 2023-10-09T07:01:18.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.799+0000 7f6a4559d700 1 -- 172.21.15.71:0/541436369 shutdown_connections 2023-10-09T07:01:18.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.799+0000 7f6a4559d700 1 --2- 172.21.15.71:0/541436369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a40150180 0x7f6a40157770 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:18.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.799+0000 7f6a4559d700 1 -- 172.21.15.71:0/541436369 >> 172.21.15.71:0/541436369 conn(0x7f6a400cc1f0 msgr2=0x7f6a400cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:18.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.799+0000 7f6a4559d700 1 -- 172.21.15.71:0/541436369 shutdown_connections 2023-10-09T07:01:18.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.799+0000 7f6a4559d700 1 -- 172.21.15.71:0/541436369 wait complete. 2023-10-09T07:01:18.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.800+0000 7f6a4559d700 1 Processor -- start 2023-10-09T07:01:18.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.800+0000 7f6a4559d700 1 -- start start 2023-10-09T07:01:18.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.801+0000 7f6a4559d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a400c7410 0x7f6a400aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:18.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.801+0000 7f6a4559d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a40150180 0x7f6a40147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:18.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.801+0000 7f6a4559d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a40150550 0x7f6a400adf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:18.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.801+0000 7f6a4559d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a400af4d0 con 0x7f6a40150550 2023-10-09T07:01:18.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.801+0000 7f6a4559d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a400b0a10 con 0x7f6a40150180 2023-10-09T07:01:18.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.801+0000 7f6a4559d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a400c2fe0 con 0x7f6a400c7410 2023-10-09T07:01:18.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.801+0000 7f6a44d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a40150550 0x7f6a400adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:18.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.801+0000 7f6a44d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a40150550 0x7f6a400adf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44214/0 (socket says 172.21.15.71:44214) 2023-10-09T07:01:18.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.801+0000 7f6a44d9c700 1 -- 172.21.15.71:0/2627413422 learned_addr learned my addr 172.21.15.71:0/2627413422 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:18.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.802+0000 7f6a44d9c700 1 -- 172.21.15.71:0/2627413422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a400c7410 msgr2=0x7f6a400aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:18.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.802+0000 7f6a44d9c700 1 --2- 172.21.15.71:0/2627413422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a400c7410 0x7f6a400aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:18.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.802+0000 7f6a44d9c700 1 -- 172.21.15.71:0/2627413422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a40150180 msgr2=0x7f6a40147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:18.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.802+0000 7f6a3f7fe700 1 --2- 172.21.15.71:0/2627413422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a40150180 0x7f6a40147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:18.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.802+0000 7f6a44d9c700 1 --2- 172.21.15.71:0/2627413422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a40150180 0x7f6a40147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:18.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.802+0000 7f6a44d9c700 1 -- 172.21.15.71:0/2627413422 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3000a690 con 0x7f6a40150550 2023-10-09T07:01:18.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.802+0000 7f6a3f7fe700 1 --2- 172.21.15.71:0/2627413422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a40150180 0x7f6a40147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:01:18.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.802+0000 7f6a44d9c700 1 --2- 172.21.15.71:0/2627413422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a40150550 0x7f6a400adf80 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800bb60 tx=0x7f6a380097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:18.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.802+0000 7f6a27fff700 1 -- 172.21.15.71:0/2627413422 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3800c940 con 0x7f6a40150550 2023-10-09T07:01:18.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.802+0000 7f6a27fff700 1 -- 172.21.15.71:0/2627413422 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3800caa0 con 0x7f6a40150550 2023-10-09T07:01:18.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.802+0000 7f6a4559d700 1 -- 172.21.15.71:0/2627413422 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a40165c50 con 0x7f6a40150550 2023-10-09T07:01:18.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.802+0000 7f6a27fff700 1 -- 172.21.15.71:0/2627413422 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3800ce60 con 0x7f6a40150550 2023-10-09T07:01:18.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.803+0000 7f6a4559d700 1 -- 172.21.15.71:0/2627413422 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a40166210 con 0x7f6a40150550 2023-10-09T07:01:18.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.803+0000 7f6a4559d700 1 -- 172.21.15.71:0/2627413422 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a4004c3c0 con 0x7f6a40150550 2023-10-09T07:01:18.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.804+0000 7f6a27fff700 1 -- 172.21.15.71:0/2627413422 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a38014620 con 0x7f6a40150550 2023-10-09T07:01:18.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.806+0000 7f6a27fff700 1 --2- 172.21.15.71:0/2627413422 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6a2c066f30 0x7f6a2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:18.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.806+0000 7f6a27fff700 1 -- 172.21.15.71:0/2627413422 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5273+0+0 (secure 0 0 0) 0x7f6a380843b0 con 0x7f6a40150550 2023-10-09T07:01:18.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.806+0000 7f6a3ffff700 1 --2- 172.21.15.71:0/2627413422 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6a2c066f30 0x7f6a2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:18.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.807+0000 7f6a3ffff700 1 --2- 172.21.15.71:0/2627413422 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6a2c066f30 0x7f6a2c0693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6a3000ab50 tx=0x7f6a30019000 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:18.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:18.810+0000 7f6a27fff700 1 -- 172.21.15.71:0/2627413422 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a3804c5a0 con 0x7f6a40150550 2023-10-09T07:01:19.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.002+0000 7f6a4559d700 1 -- 172.21.15.71:0/2627413422 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a4006ada0 con 0x7f6a40150550 2023-10-09T07:01:19.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.003+0000 7f6a27fff700 1 -- 172.21.15.71:0/2627413422 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+12783 (secure 0 0 0) 0x7f6a380517d0 con 0x7f6a40150550 2023-10-09T07:01:19.004 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:01:19.004 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":133,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:01:18.120107+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:01:19.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.005+0000 7f6a4559d700 1 -- 172.21.15.71:0/2627413422 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6a2c066f30 msgr2=0x7f6a2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:19.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.005+0000 7f6a4559d700 1 --2- 172.21.15.71:0/2627413422 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6a2c066f30 0x7f6a2c0693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6a3000ab50 tx=0x7f6a30019000 comp rx=0 tx=0).stop 2023-10-09T07:01:19.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.005+0000 7f6a4559d700 1 -- 172.21.15.71:0/2627413422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a40150550 msgr2=0x7f6a400adf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:19.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.005+0000 7f6a4559d700 1 --2- 172.21.15.71:0/2627413422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a40150550 0x7f6a400adf80 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800bb60 tx=0x7f6a380097f0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.005+0000 7f6a4559d700 1 -- 172.21.15.71:0/2627413422 shutdown_connections 2023-10-09T07:01:19.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.005+0000 7f6a4559d700 1 --2- 172.21.15.71:0/2627413422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a40150550 0x7f6a400adf80 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.005+0000 7f6a4559d700 1 --2- 172.21.15.71:0/2627413422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a400c7410 0x7f6a400aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.005+0000 7f6a4559d700 1 --2- 172.21.15.71:0/2627413422 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6a2c066f30 0x7f6a2c0693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.005+0000 7f6a4559d700 1 --2- 172.21.15.71:0/2627413422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a40150180 0x7f6a40147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.005+0000 7f6a4559d700 1 -- 172.21.15.71:0/2627413422 >> 172.21.15.71:0/2627413422 conn(0x7f6a400cc1f0 msgr2=0x7f6a40157f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:19.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.005+0000 7f6a4559d700 1 -- 172.21.15.71:0/2627413422 shutdown_connections 2023-10-09T07:01:19.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.005+0000 7f6a4559d700 1 -- 172.21.15.71:0/2627413422 wait complete. 2023-10-09T07:01:19.024 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T07:01:19.025 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T07:01:19.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.209+0000 7f5456dff700 1 Processor -- start 2023-10-09T07:01:19.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.209+0000 7f5456dff700 1 -- start start 2023-10-09T07:01:19.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.210+0000 7f5456dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54500c83f0 0x7f54500c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:19.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.210+0000 7f5456dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f54500ccee0 0x7f54501561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:19.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.210+0000 7f5456dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f545015b0d0 con 0x7f54500c87c0 2023-10-09T07:01:19.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.210+0000 7f5456dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54500c7a60 con 0x7f54500ccee0 2023-10-09T07:01:19.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.210+0000 7f5456dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545015a4c0 con 0x7f54500c83f0 2023-10-09T07:01:19.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.211+0000 7f545539c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f54500c87c0 0x7f545006eae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59266/0 (socket says 172.21.15.71:59266) 2023-10-09T07:01:19.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.211+0000 7f545539c700 1 -- 172.21.15.71:0/1739573870 learned_addr learned my addr 172.21.15.71:0/1739573870 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:01:19.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.211+0000 7f544ffff700 1 --2- 172.21.15.71:0/1739573870 >> v2:172.21.15.179:3300/0 conn(0x7f54500ccee0 0x7f54501561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:19.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.211+0000 7f5454b9b700 1 --2- 172.21.15.71:0/1739573870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54500c83f0 0x7f54500c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:19.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.211+0000 7f544f7fe700 1 -- 172.21.15.71:0/1739573870 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2039877213 0 0) 0x7f545015b0d0 con 0x7f54500c87c0 2023-10-09T07:01:19.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.211+0000 7f544f7fe700 1 -- 172.21.15.71:0/1739573870 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5440003570 con 0x7f54500c87c0 2023-10-09T07:01:19.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.211+0000 7f544ffff700 1 -- 172.21.15.71:0/1739573870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54500c83f0 msgr2=0x7f54500c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:19.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.211+0000 7f544ffff700 1 --2- 172.21.15.71:0/1739573870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54500c83f0 0x7f54500c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.211+0000 7f544ffff700 1 -- 172.21.15.71:0/1739573870 >> v1:172.21.15.71:6789/0 conn(0x7f54500c87c0 legacy=0x7f545006eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:19.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.211+0000 7f544ffff700 1 -- 172.21.15.71:0/1739573870 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545015a7a0 con 0x7f54500ccee0 2023-10-09T07:01:19.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.211+0000 7f5454b9b700 1 --2- 172.21.15.71:0/1739573870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54500c83f0 0x7f54500c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:01:19.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.212+0000 7f544ffff700 1 --2- 172.21.15.71:0/1739573870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54500ccee0 0x7f54501561d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f543c0098e0 tx=0x7f543c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acc1da01a29a8754 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:19.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.212+0000 7f544f7fe700 1 -- 172.21.15.71:0/1739573870 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c011630 con 0x7f54500ccee0 2023-10-09T07:01:19.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.212+0000 7f544f7fe700 1 -- 172.21.15.71:0/1739573870 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543c011790 con 0x7f54500ccee0 2023-10-09T07:01:19.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.212+0000 7f544f7fe700 1 -- 172.21.15.71:0/1739573870 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c011b10 con 0x7f54500ccee0 2023-10-09T07:01:19.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.212+0000 7f5456dff700 1 -- 172.21.15.71:0/1739573870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54500ccee0 msgr2=0x7f54501561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:19.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.212+0000 7f5456dff700 1 --2- 172.21.15.71:0/1739573870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54500ccee0 0x7f54501561d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f543c0098e0 tx=0x7f543c0091a0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.212+0000 7f5456dff700 1 -- 172.21.15.71:0/1739573870 shutdown_connections 2023-10-09T07:01:19.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.212+0000 7f5456dff700 1 --2- 172.21.15.71:0/1739573870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54500c83f0 0x7f54500c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.212+0000 7f5456dff700 1 --2- 172.21.15.71:0/1739573870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54500ccee0 0x7f54501561d0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.212+0000 7f5456dff700 1 -- 172.21.15.71:0/1739573870 >> 172.21.15.71:0/1739573870 conn(0x7f5450068e10 msgr2=0x7f54500cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:19.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.212+0000 7f5456dff700 1 -- 172.21.15.71:0/1739573870 shutdown_connections 2023-10-09T07:01:19.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.212+0000 7f5456dff700 1 -- 172.21.15.71:0/1739573870 wait complete. 2023-10-09T07:01:19.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.214+0000 7f5456dff700 1 Processor -- start 2023-10-09T07:01:19.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.214+0000 7f5456dff700 1 -- start start 2023-10-09T07:01:19.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.215+0000 7f5456dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54500c83f0 0x7f545016a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:19.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.215+0000 7f5456dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54500c87c0 0x7f5450156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:19.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.215+0000 7f5456dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54500ccee0 0x7f54500a5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:19.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.215+0000 7f5456dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5450158c80 con 0x7f54500c83f0 2023-10-09T07:01:19.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.215+0000 7f5456dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545016abb0 con 0x7f54500ccee0 2023-10-09T07:01:19.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.215+0000 7f5456dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5450157810 con 0x7f54500c87c0 2023-10-09T07:01:19.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.215+0000 7f5454b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54500c83f0 0x7f545016a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:19.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.215+0000 7f5454b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54500c83f0 0x7f545016a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44224/0 (socket says 172.21.15.71:44224) 2023-10-09T07:01:19.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.215+0000 7f5454b9b700 1 -- 172.21.15.71:0/2029235330 learned_addr learned my addr 172.21.15.71:0/2029235330 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:19.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.215+0000 7f545539c700 1 --2- 172.21.15.71:0/2029235330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54500ccee0 0x7f54500a5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:19.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.215+0000 7f544ffff700 1 --2- 172.21.15.71:0/2029235330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54500c87c0 0x7f5450156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:19.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.215+0000 7f5454b9b700 1 -- 172.21.15.71:0/2029235330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54500c87c0 msgr2=0x7f5450156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:19.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.215+0000 7f5454b9b700 1 --2- 172.21.15.71:0/2029235330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54500c87c0 0x7f5450156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.215+0000 7f5454b9b700 1 -- 172.21.15.71:0/2029235330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54500ccee0 msgr2=0x7f54500a5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:19.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.215+0000 7f5454b9b700 1 --2- 172.21.15.71:0/2029235330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54500ccee0 0x7f54500a5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.216+0000 7f5454b9b700 1 -- 172.21.15.71:0/2029235330 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5444009420 con 0x7f54500c83f0 2023-10-09T07:01:19.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.216+0000 7f545539c700 1 --2- 172.21.15.71:0/2029235330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54500ccee0 0x7f54500a5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:01:19.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.216+0000 7f5454b9b700 1 --2- 172.21.15.71:0/2029235330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54500c83f0 0x7f545016a670 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f544400ecb0 tx=0x7f54440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:19.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.216+0000 7f544cff9700 1 -- 172.21.15.71:0/2029235330 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544400ee60 con 0x7f54500c83f0 2023-10-09T07:01:19.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.216+0000 7f544cff9700 1 -- 172.21.15.71:0/2029235330 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544400cbe0 con 0x7f54500c83f0 2023-10-09T07:01:19.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.216+0000 7f5456dff700 1 -- 172.21.15.71:0/2029235330 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543c009420 con 0x7f54500c83f0 2023-10-09T07:01:19.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.216+0000 7f544cff9700 1 -- 172.21.15.71:0/2029235330 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5444013470 con 0x7f54500c83f0 2023-10-09T07:01:19.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.216+0000 7f5456dff700 1 -- 172.21.15.71:0/2029235330 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5450158630 con 0x7f54500c83f0 2023-10-09T07:01:19.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.217+0000 7f5456dff700 1 -- 172.21.15.71:0/2029235330 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f545004c3c0 con 0x7f54500c83f0 2023-10-09T07:01:19.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.218+0000 7f544cff9700 1 -- 172.21.15.71:0/2029235330 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5444013820 con 0x7f54500c83f0 2023-10-09T07:01:19.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.219+0000 7f544cff9700 1 --2- 172.21.15.71:0/2029235330 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5434066f30 0x7f54340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:19.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.219+0000 7f544cff9700 1 -- 172.21.15.71:0/2029235330 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5273+0+0 (secure 0 0 0) 0x7f5444084880 con 0x7f54500c83f0 2023-10-09T07:01:19.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.219+0000 7f544ffff700 1 --2- 172.21.15.71:0/2029235330 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5434066f30 0x7f54340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:19.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.220+0000 7f544ffff700 1 --2- 172.21.15.71:0/2029235330 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5434066f30 0x7f54340693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f543c0091e0 tx=0x7f543c017000 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:19.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.223+0000 7f544cff9700 1 -- 172.21.15.71:0/2029235330 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5444051c00 con 0x7f54500c83f0 2023-10-09T07:01:19.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.411+0000 7f5456dff700 1 -- 172.21.15.71:0/2029235330 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f545015aa80 con 0x7f54500c83f0 2023-10-09T07:01:19.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.411+0000 7f544cff9700 1 -- 172.21.15.71:0/2029235330 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v133) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5444055220 con 0x7f54500c83f0 2023-10-09T07:01:19.413 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T07:01:19.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.414+0000 7f5456dff700 1 -- 172.21.15.71:0/2029235330 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5434066f30 msgr2=0x7f54340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:19.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.414+0000 7f5456dff700 1 --2- 172.21.15.71:0/2029235330 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5434066f30 0x7f54340693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f543c0091e0 tx=0x7f543c017000 comp rx=0 tx=0).stop 2023-10-09T07:01:19.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.414+0000 7f5456dff700 1 -- 172.21.15.71:0/2029235330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54500c83f0 msgr2=0x7f545016a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:19.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.414+0000 7f5456dff700 1 --2- 172.21.15.71:0/2029235330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54500c83f0 0x7f545016a670 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f544400ecb0 tx=0x7f54440091a0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.414+0000 7f5456dff700 1 -- 172.21.15.71:0/2029235330 shutdown_connections 2023-10-09T07:01:19.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.414+0000 7f5456dff700 1 --2- 172.21.15.71:0/2029235330 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5434066f30 0x7f54340693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.414+0000 7f5456dff700 1 --2- 172.21.15.71:0/2029235330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54500ccee0 0x7f54500a5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.414+0000 7f5456dff700 1 --2- 172.21.15.71:0/2029235330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54500c83f0 0x7f545016a670 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.414+0000 7f5456dff700 1 --2- 172.21.15.71:0/2029235330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54500c87c0 0x7f5450156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.414+0000 7f5456dff700 1 -- 172.21.15.71:0/2029235330 >> 172.21.15.71:0/2029235330 conn(0x7f5450068e10 msgr2=0x7f5450155140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:19.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.414+0000 7f5456dff700 1 -- 172.21.15.71:0/2029235330 shutdown_connections 2023-10-09T07:01:19.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.414+0000 7f5456dff700 1 -- 172.21.15.71:0/2029235330 wait complete. 2023-10-09T07:01:19.432 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T07:01:19.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.612+0000 7ff41a19d700 1 Processor -- start 2023-10-09T07:01:19.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.612+0000 7ff41a19d700 1 -- start start 2023-10-09T07:01:19.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.613+0000 7ff41a19d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff414159420 0x7ff4140b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:19.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.613+0000 7ff41a19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff41415d230 0x7ff41415d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:19.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.613+0000 7ff41a19d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4140b2980 con 0x7ff4141597f0 2023-10-09T07:01:19.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.613+0000 7ff41a19d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41415dbb0 con 0x7ff414159420 2023-10-09T07:01:19.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.613+0000 7ff41a19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4140b11d0 con 0x7ff41415d230 2023-10-09T07:01:19.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.614+0000 7ff41919b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff414159420 0x7ff4140b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:19.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.614+0000 7ff41919b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff414159420 0x7ff4140b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44226/0 (socket says 172.21.15.71:44226) 2023-10-09T07:01:19.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.614+0000 7ff41919b700 1 -- 172.21.15.71:0/2545986617 learned_addr learned my addr 172.21.15.71:0/2545986617 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:19.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.614+0000 7ff41899a700 1 --1- 172.21.15.71:0/2545986617 >> v1:172.21.15.71:6789/0 conn(0x7ff4141597f0 0x7ff4140b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59276/0 (socket says 172.21.15.71:59276) 2023-10-09T07:01:19.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.614+0000 7ff41999c700 1 --2- 172.21.15.71:0/2545986617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff41415d230 0x7ff41415d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:19.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.614+0000 7ff41919b700 1 -- 172.21.15.71:0/2545986617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff41415d230 msgr2=0x7ff41415d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:19.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.614+0000 7ff41919b700 1 --2- 172.21.15.71:0/2545986617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff41415d230 0x7ff41415d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.614+0000 7ff41919b700 1 -- 172.21.15.71:0/2545986617 >> v1:172.21.15.71:6789/0 conn(0x7ff4141597f0 legacy=0x7ff4140b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:19.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.614+0000 7ff41919b700 1 -- 172.21.15.71:0/2545986617 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4140b14b0 con 0x7ff414159420 2023-10-09T07:01:19.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.614+0000 7ff40bfff700 1 -- 172.21.15.71:0/2545986617 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159205743 0 0) 0x7ff4140b2980 con 0x7ff4141597f0 2023-10-09T07:01:19.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.614+0000 7ff41919b700 1 --2- 172.21.15.71:0/2545986617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff414159420 0x7ff4140b5f40 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7ff4100099b0 tx=0x7ff410009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96d493586115bf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:19.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.615+0000 7ff40bfff700 1 -- 172.21.15.71:0/2545986617 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff410009ea0 con 0x7ff414159420 2023-10-09T07:01:19.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.615+0000 7ff40bfff700 1 -- 172.21.15.71:0/2545986617 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41000b860 con 0x7ff414159420 2023-10-09T07:01:19.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.615+0000 7ff40bfff700 1 -- 172.21.15.71:0/2545986617 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41000bc00 con 0x7ff414159420 2023-10-09T07:01:19.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.615+0000 7ff41a19d700 1 -- 172.21.15.71:0/2545986617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff414159420 msgr2=0x7ff4140b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:19.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.615+0000 7ff41a19d700 1 --2- 172.21.15.71:0/2545986617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff414159420 0x7ff4140b5f40 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7ff4100099b0 tx=0x7ff410009250 comp rx=0 tx=0).stop 2023-10-09T07:01:19.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.615+0000 7ff41a19d700 1 -- 172.21.15.71:0/2545986617 shutdown_connections 2023-10-09T07:01:19.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.615+0000 7ff41a19d700 1 --2- 172.21.15.71:0/2545986617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff41415d230 0x7ff41415d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.615+0000 7ff41a19d700 1 --2- 172.21.15.71:0/2545986617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff414159420 0x7ff4140b5f40 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.615+0000 7ff41a19d700 1 -- 172.21.15.71:0/2545986617 >> 172.21.15.71:0/2545986617 conn(0x7ff4140d0660 msgr2=0x7ff4140d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:19.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.615+0000 7ff41a19d700 1 -- 172.21.15.71:0/2545986617 shutdown_connections 2023-10-09T07:01:19.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.615+0000 7ff41a19d700 1 -- 172.21.15.71:0/2545986617 wait complete. 2023-10-09T07:01:19.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.617+0000 7ff41a19d700 1 Processor -- start 2023-10-09T07:01:19.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.617+0000 7ff41a19d700 1 -- start start 2023-10-09T07:01:19.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.618+0000 7ff41a19d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff414159420 0x7ff4140c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:19.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.618+0000 7ff41a19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4141597f0 0x7ff4140c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:19.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.618+0000 7ff41a19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff41415d230 0x7ff414156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:19.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.618+0000 7ff41a19d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4140c5400 con 0x7ff414159420 2023-10-09T07:01:19.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.618+0000 7ff41a19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4140c6220 con 0x7ff41415d230 2023-10-09T07:01:19.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.618+0000 7ff41a19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4140c5610 con 0x7ff4141597f0 2023-10-09T07:01:19.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.618+0000 7ff41919b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff414159420 0x7ff4140c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:19.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.618+0000 7ff41919b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff414159420 0x7ff4140c7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44230/0 (socket says 172.21.15.71:44230) 2023-10-09T07:01:19.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.618+0000 7ff41919b700 1 -- 172.21.15.71:0/1646029256 learned_addr learned my addr 172.21.15.71:0/1646029256 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:19.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.618+0000 7ff41899a700 1 --2- 172.21.15.71:0/1646029256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4141597f0 0x7ff4140c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:19.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.618+0000 7ff41999c700 1 --2- 172.21.15.71:0/1646029256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff41415d230 0x7ff414156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:19.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.618+0000 7ff41919b700 1 -- 172.21.15.71:0/1646029256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4141597f0 msgr2=0x7ff4140c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:19.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.618+0000 7ff41919b700 1 --2- 172.21.15.71:0/1646029256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4141597f0 0x7ff4140c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.618+0000 7ff41919b700 1 -- 172.21.15.71:0/1646029256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff41415d230 msgr2=0x7ff414156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:19.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.618+0000 7ff41919b700 1 --2- 172.21.15.71:0/1646029256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff41415d230 0x7ff414156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.618+0000 7ff41919b700 1 -- 172.21.15.71:0/1646029256 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4100094f0 con 0x7ff414159420 2023-10-09T07:01:19.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.618+0000 7ff41899a700 1 --2- 172.21.15.71:0/1646029256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4141597f0 0x7ff4140c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:01:19.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.618+0000 7ff41999c700 1 --2- 172.21.15.71:0/1646029256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff41415d230 0x7ff414156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:01:19.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.619+0000 7ff41919b700 1 --2- 172.21.15.71:0/1646029256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff414159420 0x7ff4140c7d30 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7ff414089340 tx=0x7ff410017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:19.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.619+0000 7ff4097fa700 1 -- 172.21.15.71:0/1646029256 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41000bbe0 con 0x7ff414159420 2023-10-09T07:01:19.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.619+0000 7ff4097fa700 1 -- 172.21.15.71:0/1646029256 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff410011420 con 0x7ff414159420 2023-10-09T07:01:19.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.619+0000 7ff41a19d700 1 -- 172.21.15.71:0/1646029256 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4140c58f0 con 0x7ff414159420 2023-10-09T07:01:19.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.619+0000 7ff4097fa700 1 -- 172.21.15.71:0/1646029256 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4100117e0 con 0x7ff414159420 2023-10-09T07:01:19.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.619+0000 7ff41a19d700 1 -- 172.21.15.71:0/1646029256 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4140c5eb0 con 0x7ff414159420 2023-10-09T07:01:19.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.620+0000 7ff41a19d700 1 -- 172.21.15.71:0/1646029256 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4140c6500 con 0x7ff414159420 2023-10-09T07:01:19.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.621+0000 7ff4097fa700 1 -- 172.21.15.71:0/1646029256 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff410011c10 con 0x7ff414159420 2023-10-09T07:01:19.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.622+0000 7ff4097fa700 1 --2- 172.21.15.71:0/1646029256 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff3f8066f30 0x7ff3f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:19.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.622+0000 7ff4097fa700 1 -- 172.21.15.71:0/1646029256 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5273+0+0 (secure 0 0 0) 0x7ff410085cf0 con 0x7ff414159420 2023-10-09T07:01:19.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.622+0000 7ff41899a700 1 --2- 172.21.15.71:0/1646029256 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff3f8066f30 0x7ff3f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:19.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.623+0000 7ff41899a700 1 --2- 172.21.15.71:0/1646029256 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff3f8066f30 0x7ff3f80693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff41415cba0 tx=0x7ff404009040 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:19.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.626+0000 7ff4097fa700 1 -- 172.21.15.71:0/1646029256 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff41008a070 con 0x7ff414159420 2023-10-09T07:01:19.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.819+0000 7ff41a19d700 1 -- 172.21.15.71:0/1646029256 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff41404c3c0 con 0x7ff414159420 2023-10-09T07:01:19.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.820+0000 7ff4097fa700 1 -- 172.21.15.71:0/1646029256 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v133) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff410015090 con 0x7ff414159420 2023-10-09T07:01:19.821 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:01:19.821 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-09T07:01:19.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:01:19.822 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 1, 2023-10-09T07:01:19.822 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": ".mgr" 2023-10-09T07:01:19.822 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:01:19.822 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-09T07:01:19.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.822+0000 7ff41a19d700 1 -- 172.21.15.71:0/1646029256 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff3f8066f30 msgr2=0x7ff3f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:19.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.822+0000 7ff41a19d700 1 --2- 172.21.15.71:0/1646029256 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff3f8066f30 0x7ff3f80693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff41415cba0 tx=0x7ff404009040 comp rx=0 tx=0).stop 2023-10-09T07:01:19.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.822+0000 7ff41a19d700 1 -- 172.21.15.71:0/1646029256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff414159420 msgr2=0x7ff4140c7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:19.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.822+0000 7ff41a19d700 1 --2- 172.21.15.71:0/1646029256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff414159420 0x7ff4140c7d30 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7ff414089340 tx=0x7ff410017000 comp rx=0 tx=0).stop 2023-10-09T07:01:19.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.822+0000 7ff41a19d700 1 -- 172.21.15.71:0/1646029256 shutdown_connections 2023-10-09T07:01:19.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.822+0000 7ff41a19d700 1 --2- 172.21.15.71:0/1646029256 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff3f8066f30 0x7ff3f80693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.822+0000 7ff41a19d700 1 --2- 172.21.15.71:0/1646029256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff41415d230 0x7ff414156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.822+0000 7ff41a19d700 1 --2- 172.21.15.71:0/1646029256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff414159420 0x7ff4140c7d30 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.822+0000 7ff41a19d700 1 --2- 172.21.15.71:0/1646029256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4141597f0 0x7ff4140c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:19.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.822+0000 7ff41a19d700 1 -- 172.21.15.71:0/1646029256 >> 172.21.15.71:0/1646029256 conn(0x7ff4140d0660 msgr2=0x7ff414068a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:19.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.822+0000 7ff41a19d700 1 -- 172.21.15.71:0/1646029256 shutdown_connections 2023-10-09T07:01:19.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:19.822+0000 7ff41a19d700 1 -- 172.21.15.71:0/1646029256 wait complete. 2023-10-09T07:01:19.840 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T07:01:19.840 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T07:01:20.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.025+0000 7f00fb7ff700 1 Processor -- start 2023-10-09T07:01:20.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.026+0000 7f00fb7ff700 1 -- start start 2023-10-09T07:01:20.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.027+0000 7f00fb7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00f4069a50 0x7f00f40c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:20.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.027+0000 7f00fb7ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f00f40c8490 0x7f00f415a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:20.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.027+0000 7f00fb7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f00f4069e20 0x7f00f4068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:20.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.027+0000 7f00fb7ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f40ac030 con 0x7f00f40c8490 2023-10-09T07:01:20.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.027+0000 7f00fb7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f40ab820 con 0x7f00f4069e20 2023-10-09T07:01:20.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.027+0000 7f00fb7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f406dbb0 con 0x7f00f4069a50 2023-10-09T07:01:20.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.027+0000 7f00f8d9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f00f40c8490 0x7f00f415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:20.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.027+0000 7f00f8d9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f00f40c8490 0x7f00f415a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44240/0 (socket says 172.21.15.71:44240) 2023-10-09T07:01:20.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.027+0000 7f00f8d9a700 1 -- 172.21.15.71:0/32338258 learned_addr learned my addr 172.21.15.71:0/32338258 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:20.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.027+0000 7f00f959b700 1 --2- 172.21.15.71:0/32338258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00f4069a50 0x7f00f40c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:20.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.027+0000 7f00f9d9c700 1 --2- 172.21.15.71:0/32338258 >> v2:172.21.15.179:3300/0 conn(0x7f00f4069e20 0x7f00f4068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:20.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.027+0000 7f00f8d9a700 1 -- 172.21.15.71:0/32338258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00f4069a50 msgr2=0x7f00f40c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:20.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.027+0000 7f00f8d9a700 1 --2- 172.21.15.71:0/32338258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00f4069a50 0x7f00f40c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:20.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.027+0000 7f00f8d9a700 1 -- 172.21.15.71:0/32338258 >> v2:172.21.15.179:3300/0 conn(0x7f00f4069e20 msgr2=0x7f00f4068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:20.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.027+0000 7f00f8d9a700 1 --2- 172.21.15.71:0/32338258 >> v2:172.21.15.179:3300/0 conn(0x7f00f4069e20 0x7f00f4068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:20.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.027+0000 7f00f8d9a700 1 -- 172.21.15.71:0/32338258 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f415a9d0 con 0x7f00f40c8490 2023-10-09T07:01:20.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.028+0000 7f00f8d9a700 1 --2- 172.21.15.71:0/32338258 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00f40c8490 0x7f00f415a490 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f00e40099b0 tx=0x7f00e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c324594d8237d18f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:20.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.028+0000 7f00ebfff700 1 -- 172.21.15.71:0/32338258 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e400b820 con 0x7f00f40c8490 2023-10-09T07:01:20.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.028+0000 7f00ebfff700 1 -- 172.21.15.71:0/32338258 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e400b980 con 0x7f00f40c8490 2023-10-09T07:01:20.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.028+0000 7f00ebfff700 1 -- 172.21.15.71:0/32338258 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e400bd20 con 0x7f00f40c8490 2023-10-09T07:01:20.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.028+0000 7f00fb7ff700 1 -- 172.21.15.71:0/32338258 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00f40c8490 msgr2=0x7f00f415a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:20.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.028+0000 7f00fb7ff700 1 --2- 172.21.15.71:0/32338258 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00f40c8490 0x7f00f415a490 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f00e40099b0 tx=0x7f00e4009250 comp rx=0 tx=0).stop 2023-10-09T07:01:20.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.029+0000 7f00fb7ff700 1 -- 172.21.15.71:0/32338258 shutdown_connections 2023-10-09T07:01:20.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.029+0000 7f00fb7ff700 1 --2- 172.21.15.71:0/32338258 >> v2:172.21.15.179:3300/0 conn(0x7f00f4069e20 0x7f00f4068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:20.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.029+0000 7f00fb7ff700 1 --2- 172.21.15.71:0/32338258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00f4069a50 0x7f00f40c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:20.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.029+0000 7f00fb7ff700 1 --2- 172.21.15.71:0/32338258 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00f40c8490 0x7f00f415a490 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:20.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.029+0000 7f00fb7ff700 1 -- 172.21.15.71:0/32338258 >> 172.21.15.71:0/32338258 conn(0x7f00f40c8f90 msgr2=0x7f00f40c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:20.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.029+0000 7f00fb7ff700 1 -- 172.21.15.71:0/32338258 shutdown_connections 2023-10-09T07:01:20.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.029+0000 7f00fb7ff700 1 -- 172.21.15.71:0/32338258 wait complete. 2023-10-09T07:01:20.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.030+0000 7f00fb7ff700 1 Processor -- start 2023-10-09T07:01:20.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.030+0000 7f00fb7ff700 1 -- start start 2023-10-09T07:01:20.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.031+0000 7f00fb7ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00f4069a50 0x7f00f4155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:20.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.031+0000 7f00fb7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00f4069e20 0x7f00f40b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:20.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.031+0000 7f00fb7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00f40c8490 0x7f00f40c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:20.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.031+0000 7f00fb7ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40c5510 con 0x7f00f4069a50 2023-10-09T07:01:20.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.031+0000 7f00fb7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40c4f00 con 0x7f00f4069e20 2023-10-09T07:01:20.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.031+0000 7f00fb7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f414d130 con 0x7f00f40c8490 2023-10-09T07:01:20.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.031+0000 7f00f959b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00f4069a50 0x7f00f4155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:20.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.031+0000 7f00f959b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00f4069a50 0x7f00f4155770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44252/0 (socket says 172.21.15.71:44252) 2023-10-09T07:01:20.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.031+0000 7f00f959b700 1 -- 172.21.15.71:0/117828588 learned_addr learned my addr 172.21.15.71:0/117828588 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:20.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.031+0000 7f00f8d9a700 1 --2- 172.21.15.71:0/117828588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00f4069e20 0x7f00f40b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:20.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.031+0000 7f00f9d9c700 1 --2- 172.21.15.71:0/117828588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00f40c8490 0x7f00f40c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:20.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.032+0000 7f00f959b700 1 -- 172.21.15.71:0/117828588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00f40c8490 msgr2=0x7f00f40c59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:20.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.032+0000 7f00f959b700 1 --2- 172.21.15.71:0/117828588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00f40c8490 0x7f00f40c59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:20.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.032+0000 7f00f959b700 1 -- 172.21.15.71:0/117828588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00f4069e20 msgr2=0x7f00f40b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:20.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.032+0000 7f00f959b700 1 --2- 172.21.15.71:0/117828588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00f4069e20 0x7f00f40b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:20.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.032+0000 7f00f959b700 1 -- 172.21.15.71:0/117828588 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e40094f0 con 0x7f00f4069a50 2023-10-09T07:01:20.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.032+0000 7f00f959b700 1 --2- 172.21.15.71:0/117828588 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00f4069a50 0x7f00f4155770 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f00f000d860 tx=0x7f00f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:20.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.032+0000 7f00e97fa700 1 -- 172.21.15.71:0/117828588 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f00125f0 con 0x7f00f4069a50 2023-10-09T07:01:20.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.032+0000 7f00e97fa700 1 -- 172.21.15.71:0/117828588 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f0012750 con 0x7f00f4069a50 2023-10-09T07:01:20.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.032+0000 7f00e97fa700 1 -- 172.21.15.71:0/117828588 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0012b10 con 0x7f00f4069a50 2023-10-09T07:01:20.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.032+0000 7f00fb7ff700 1 -- 172.21.15.71:0/117828588 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f40c51a0 con 0x7f00f4069a50 2023-10-09T07:01:20.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.032+0000 7f00fb7ff700 1 -- 172.21.15.71:0/117828588 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f414b0e0 con 0x7f00f4069a50 2023-10-09T07:01:20.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.033+0000 7f00fb7ff700 1 -- 172.21.15.71:0/117828588 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f40c57f0 con 0x7f00f4069a50 2023-10-09T07:01:20.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.034+0000 7f00e97fa700 1 -- 172.21.15.71:0/117828588 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00f001e460 con 0x7f00f4069a50 2023-10-09T07:01:20.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.036+0000 7f00e97fa700 1 --2- 172.21.15.71:0/117828588 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f00d8066f30 0x7f00d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:20.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.036+0000 7f00e97fa700 1 -- 172.21.15.71:0/117828588 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5273+0+0 (secure 0 0 0) 0x7f00f0084a40 con 0x7f00f4069a50 2023-10-09T07:01:20.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.036+0000 7f00f8d9a700 1 --2- 172.21.15.71:0/117828588 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f00d8066f30 0x7f00d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:20.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.037+0000 7f00f8d9a700 1 --2- 172.21.15.71:0/117828588 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f00d8066f30 0x7f00d80693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f00e40099b0 tx=0x7f00e4017000 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:20.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.040+0000 7f00e97fa700 1 -- 172.21.15.71:0/117828588 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00f0086e60 con 0x7f00f4069a50 2023-10-09T07:01:20.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:20.234+0000 7f00fb7ff700 1 -- 172.21.15.71:0/117828588 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f00f40718b0 con 0x7f00f4069a50 2023-10-09T07:01:21.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.124+0000 7f00e97fa700 1 -- 172.21.15.71:0/117828588 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v134) v1 ==== 138+0+0 (secure 0 0 0) 0x7f00f00558f0 con 0x7f00f4069a50 2023-10-09T07:01:21.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.131+0000 7f00fb7ff700 1 -- 172.21.15.71:0/117828588 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f00d8066f30 msgr2=0x7f00d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:21.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.131+0000 7f00fb7ff700 1 --2- 172.21.15.71:0/117828588 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f00d8066f30 0x7f00d80693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f00e40099b0 tx=0x7f00e4017000 comp rx=0 tx=0).stop 2023-10-09T07:01:21.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.131+0000 7f00fb7ff700 1 -- 172.21.15.71:0/117828588 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00f4069a50 msgr2=0x7f00f4155770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:21.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.131+0000 7f00fb7ff700 1 --2- 172.21.15.71:0/117828588 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00f4069a50 0x7f00f4155770 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f00f000d860 tx=0x7f00f0008040 comp rx=0 tx=0).stop 2023-10-09T07:01:21.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.133+0000 7f00fb7ff700 1 -- 172.21.15.71:0/117828588 shutdown_connections 2023-10-09T07:01:21.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.133+0000 7f00fb7ff700 1 --2- 172.21.15.71:0/117828588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00f40c8490 0x7f00f40c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:21.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.133+0000 7f00fb7ff700 1 --2- 172.21.15.71:0/117828588 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00f4069a50 0x7f00f4155770 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:21.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.133+0000 7f00fb7ff700 1 --2- 172.21.15.71:0/117828588 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f00d8066f30 0x7f00d80693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:21.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.133+0000 7f00fb7ff700 1 --2- 172.21.15.71:0/117828588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00f4069e20 0x7f00f40b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:21.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.133+0000 7f00fb7ff700 1 -- 172.21.15.71:0/117828588 >> 172.21.15.71:0/117828588 conn(0x7f00f40c8f90 msgr2=0x7f00f415a040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:21.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.134+0000 7f00fb7ff700 1 -- 172.21.15.71:0/117828588 shutdown_connections 2023-10-09T07:01:21.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.134+0000 7f00fb7ff700 1 -- 172.21.15.71:0/117828588 wait complete. 2023-10-09T07:01:21.137 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' created 2023-10-09T07:01:21.155 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T07:01:21.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.345+0000 7fc2d8fff700 1 Processor -- start 2023-10-09T07:01:21.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.346+0000 7fc2d8fff700 1 -- start start 2023-10-09T07:01:21.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.347+0000 7fc2d8fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc2d4156620 0x7fc2d40c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:21.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.347+0000 7fc2d8fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2d4068390 0x7fc2d4068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:21.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.347+0000 7fc2d8fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d415a6f0 con 0x7fc2d41569f0 2023-10-09T07:01:21.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.347+0000 7fc2d8fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d40c8d30 con 0x7fc2d4156620 2023-10-09T07:01:21.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.347+0000 7fc2d8fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d4068d70 con 0x7fc2d4068390 2023-10-09T07:01:21.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.347+0000 7fc2d259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc2d4156620 0x7fc2d40c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:21.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.347+0000 7fc2d259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc2d4156620 0x7fc2d40c87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44258/0 (socket says 172.21.15.71:44258) 2023-10-09T07:01:21.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.347+0000 7fc2d259c700 1 -- 172.21.15.71:0/897940978 learned_addr learned my addr 172.21.15.71:0/897940978 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:21.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.347+0000 7fc2d2d9d700 1 --2- 172.21.15.71:0/897940978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2d4068390 0x7fc2d4068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:21.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.348+0000 7fc2d259c700 1 -- 172.21.15.71:0/897940978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2d4068390 msgr2=0x7fc2d4068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:21.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.348+0000 7fc2d259c700 1 --2- 172.21.15.71:0/897940978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2d4068390 0x7fc2d4068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.348+0000 7fc2d259c700 1 -- 172.21.15.71:0/897940978 >> v1:172.21.15.71:6789/0 conn(0x7fc2d41569f0 legacy=0x7fc2d40ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.348+0000 7fc2d259c700 1 -- 172.21.15.71:0/897940978 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d415a9d0 con 0x7fc2d4156620 2023-10-09T07:01:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.348+0000 7fc2d2d9d700 1 --2- 172.21.15.71:0/897940978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2d4068390 0x7fc2d4068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:01:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.348+0000 7fc2d259c700 1 --2- 172.21.15.71:0/897940978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2d4156620 0x7fc2d40c87f0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40099b0 tx=0x7fc2c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b032cc24ed28b39f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.348+0000 7fc2d1d9b700 1 -- 172.21.15.71:0/897940978 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c400b860 con 0x7fc2d4156620 2023-10-09T07:01:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.348+0000 7fc2d1d9b700 1 -- 172.21.15.71:0/897940978 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c400b9c0 con 0x7fc2d4156620 2023-10-09T07:01:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.348+0000 7fc2d1d9b700 1 -- 172.21.15.71:0/897940978 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c400bd60 con 0x7fc2d4156620 2023-10-09T07:01:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.349+0000 7fc2d8fff700 1 -- 172.21.15.71:0/897940978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2d4156620 msgr2=0x7fc2d40c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.349+0000 7fc2d8fff700 1 --2- 172.21.15.71:0/897940978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2d4156620 0x7fc2d40c87f0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40099b0 tx=0x7fc2c4009250 comp rx=0 tx=0).stop 2023-10-09T07:01:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.349+0000 7fc2d8fff700 1 -- 172.21.15.71:0/897940978 shutdown_connections 2023-10-09T07:01:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.349+0000 7fc2d8fff700 1 --2- 172.21.15.71:0/897940978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2d4068390 0x7fc2d4068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:21.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.349+0000 7fc2d8fff700 1 --2- 172.21.15.71:0/897940978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2d4156620 0x7fc2d40c87f0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:21.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.349+0000 7fc2d8fff700 1 -- 172.21.15.71:0/897940978 >> 172.21.15.71:0/897940978 conn(0x7fc2d40cc540 msgr2=0x7fc2d40cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:21.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.349+0000 7fc2d8fff700 1 -- 172.21.15.71:0/897940978 shutdown_connections 2023-10-09T07:01:21.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.349+0000 7fc2d8fff700 1 -- 172.21.15.71:0/897940978 wait complete. 2023-10-09T07:01:21.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.350+0000 7fc2d8fff700 1 Processor -- start 2023-10-09T07:01:21.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.350+0000 7fc2d8fff700 1 -- start start 2023-10-09T07:01:21.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.351+0000 7fc2d8fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2d4068390 0x7fc2d4151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:21.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.351+0000 7fc2d8fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2d4156620 0x7fc2d4168eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:21.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.351+0000 7fc2d8fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2d41569f0 0x7fc2d40c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:21.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.351+0000 7fc2d8fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d40b0810 con 0x7fc2d4068390 2023-10-09T07:01:21.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.351+0000 7fc2d8fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d41522a0 con 0x7fc2d4156620 2023-10-09T07:01:21.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.351+0000 7fc2d8fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d41693f0 con 0x7fc2d41569f0 2023-10-09T07:01:21.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.351+0000 7fc2d259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2d4068390 0x7fc2d4151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:21.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.352+0000 7fc2d259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2d4068390 0x7fc2d4151d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44274/0 (socket says 172.21.15.71:44274) 2023-10-09T07:01:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.352+0000 7fc2d259c700 1 -- 172.21.15.71:0/2172476060 learned_addr learned my addr 172.21.15.71:0/2172476060 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.352+0000 7fc2d2d9d700 1 --2- 172.21.15.71:0/2172476060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2d41569f0 0x7fc2d40c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.352+0000 7fc2cbfff700 1 --2- 172.21.15.71:0/2172476060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2d4156620 0x7fc2d4168eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.352+0000 7fc2d259c700 1 -- 172.21.15.71:0/2172476060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2d41569f0 msgr2=0x7fc2d40c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.352+0000 7fc2d259c700 1 --2- 172.21.15.71:0/2172476060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2d41569f0 0x7fc2d40c0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.352+0000 7fc2d259c700 1 -- 172.21.15.71:0/2172476060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2d4156620 msgr2=0x7fc2d4168eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.352+0000 7fc2d259c700 1 --2- 172.21.15.71:0/2172476060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2d4156620 0x7fc2d4168eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.352+0000 7fc2d259c700 1 -- 172.21.15.71:0/2172476060 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c40094f0 con 0x7fc2d4068390 2023-10-09T07:01:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.352+0000 7fc2d259c700 1 --2- 172.21.15.71:0/2172476060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2d4068390 0x7fc2d4151d60 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4009290 tx=0x7fc2c4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.352+0000 7fc2ca7fc700 1 -- 172.21.15.71:0/2172476060 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4010470 con 0x7fc2d4068390 2023-10-09T07:01:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.353+0000 7fc2ca7fc700 1 -- 172.21.15.71:0/2172476060 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c40105f0 con 0x7fc2d4068390 2023-10-09T07:01:21.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.353+0000 7fc2d8fff700 1 -- 172.21.15.71:0/2172476060 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d40b0a80 con 0x7fc2d4068390 2023-10-09T07:01:21.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.353+0000 7fc2ca7fc700 1 -- 172.21.15.71:0/2172476060 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c40109b0 con 0x7fc2d4068390 2023-10-09T07:01:21.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.353+0000 7fc2d8fff700 1 -- 172.21.15.71:0/2172476060 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d4169900 con 0x7fc2d4068390 2023-10-09T07:01:21.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.354+0000 7fc2d8fff700 1 -- 172.21.15.71:0/2172476060 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d40718b0 con 0x7fc2d4068390 2023-10-09T07:01:21.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.355+0000 7fc2ca7fc700 1 -- 172.21.15.71:0/2172476060 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc2c402d440 con 0x7fc2d4068390 2023-10-09T07:01:21.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.356+0000 7fc2ca7fc700 1 --2- 172.21.15.71:0/2172476060 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc2b4066f30 0x7fc2b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:21.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.356+0000 7fc2ca7fc700 1 -- 172.21.15.71:0/2172476060 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5643+0+0 (secure 0 0 0) 0x7fc2c4014070 con 0x7fc2d4068390 2023-10-09T07:01:21.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.356+0000 7fc2cbfff700 1 --2- 172.21.15.71:0/2172476060 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc2b4066f30 0x7fc2b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:21.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.357+0000 7fc2cbfff700 1 --2- 172.21.15.71:0/2172476060 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc2b4066f30 0x7fc2b40693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4155e80 tx=0x7fc2bc009040 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:21.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.360+0000 7fc2ca7fc700 1 -- 172.21.15.71:0/2172476060 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2c40554f0 con 0x7fc2d4068390 2023-10-09T07:01:21.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:21.553+0000 7fc2d8fff700 1 -- 172.21.15.71:0/2172476060 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc2d41552d0 con 0x7fc2d4068390 2023-10-09T07:01:22.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.131+0000 7fc2ca7fc700 1 -- 172.21.15.71:0/2172476060 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v135) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc2c4058b10 con 0x7fc2d4068390 2023-10-09T07:01:22.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.136+0000 7fc2d8fff700 1 -- 172.21.15.71:0/2172476060 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc2b4066f30 msgr2=0x7fc2b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:22.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.136+0000 7fc2d8fff700 1 --2- 172.21.15.71:0/2172476060 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc2b4066f30 0x7fc2b40693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4155e80 tx=0x7fc2bc009040 comp rx=0 tx=0).stop 2023-10-09T07:01:22.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.136+0000 7fc2d8fff700 1 -- 172.21.15.71:0/2172476060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2d4068390 msgr2=0x7fc2d4151d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:22.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.136+0000 7fc2d8fff700 1 --2- 172.21.15.71:0/2172476060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2d4068390 0x7fc2d4151d60 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4009290 tx=0x7fc2c4019000 comp rx=0 tx=0).stop 2023-10-09T07:01:22.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.141+0000 7fc2d8fff700 1 -- 172.21.15.71:0/2172476060 shutdown_connections 2023-10-09T07:01:22.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.141+0000 7fc2d8fff700 1 --2- 172.21.15.71:0/2172476060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2d41569f0 0x7fc2d40c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.144+0000 7fc2d8fff700 1 --2- 172.21.15.71:0/2172476060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2d4068390 0x7fc2d4151d60 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.144+0000 7fc2d8fff700 1 --2- 172.21.15.71:0/2172476060 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc2b4066f30 0x7fc2b40693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.144+0000 7fc2d8fff700 1 --2- 172.21.15.71:0/2172476060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2d4156620 0x7fc2d4168eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.144+0000 7fc2d8fff700 1 -- 172.21.15.71:0/2172476060 >> 172.21.15.71:0/2172476060 conn(0x7fc2d40cc540 msgr2=0x7fc2d4152550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:22.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.146+0000 7fc2d8fff700 1 -- 172.21.15.71:0/2172476060 shutdown_connections 2023-10-09T07:01:22.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.147+0000 7fc2d8fff700 1 -- 172.21.15.71:0/2172476060 wait complete. 2023-10-09T07:01:22.154 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' created 2023-10-09T07:01:22.172 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T07:01:22.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.355+0000 7f07541ff700 1 Processor -- start 2023-10-09T07:01:22.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.355+0000 7f07541ff700 1 -- start start 2023-10-09T07:01:22.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.357+0000 7f07541ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f074c155eb0 0x7f074c06e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:22.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.357+0000 7f07541ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f074c0c70b0 0x7f074c069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:22.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.357+0000 7f07541ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f074c06eb90 con 0x7f074c069cb0 2023-10-09T07:01:22.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.357+0000 7f07541ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074c06a130 con 0x7f074c155eb0 2023-10-09T07:01:22.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.357+0000 7f07541ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c06ee70 con 0x7f074c0c70b0 2023-10-09T07:01:22.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.357+0000 7f0751f9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f074c155eb0 0x7f074c06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:22.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.357+0000 7f0751f9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f074c155eb0 0x7f074c06e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44286/0 (socket says 172.21.15.71:44286) 2023-10-09T07:01:22.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.357+0000 7f0751f9b700 1 -- 172.21.15.71:0/3846931742 learned_addr learned my addr 172.21.15.71:0/3846931742 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:22.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.357+0000 7f075179a700 1 --2- 172.21.15.71:0/3846931742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f074c0c70b0 0x7f074c069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:22.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.357+0000 7f0751f9b700 1 -- 172.21.15.71:0/3846931742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f074c0c70b0 msgr2=0x7f074c069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:22.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.357+0000 7f0751f9b700 1 --2- 172.21.15.71:0/3846931742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f074c0c70b0 0x7f074c069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:22.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.357+0000 7f0751f9b700 1 -- 172.21.15.71:0/3846931742 >> v1:172.21.15.179:6789/0 conn(0x7f074c069cb0 legacy=0x7f074c159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:22.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.357+0000 7f0751f9b700 1 -- 172.21.15.71:0/3846931742 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c06f150 con 0x7f074c155eb0 2023-10-09T07:01:22.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.357+0000 7f075179a700 1 --2- 172.21.15.71:0/3846931742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f074c0c70b0 0x7f074c069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:01:22.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.358+0000 7f0751f9b700 1 --2- 172.21.15.71:0/3846931742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f074c155eb0 0x7f074c06e240 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f07480099b0 tx=0x7f0748009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d410da106c78e449 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:22.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.358+0000 7f0750f99700 1 -- 172.21.15.71:0/3846931742 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074800b820 con 0x7f074c155eb0 2023-10-09T07:01:22.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.358+0000 7f0750f99700 1 -- 172.21.15.71:0/3846931742 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074800b980 con 0x7f074c155eb0 2023-10-09T07:01:22.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.358+0000 7f0750f99700 1 -- 172.21.15.71:0/3846931742 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074800bd20 con 0x7f074c155eb0 2023-10-09T07:01:22.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.358+0000 7f07541ff700 1 -- 172.21.15.71:0/3846931742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f074c155eb0 msgr2=0x7f074c06e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:22.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.358+0000 7f07541ff700 1 --2- 172.21.15.71:0/3846931742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f074c155eb0 0x7f074c06e240 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f07480099b0 tx=0x7f0748009250 comp rx=0 tx=0).stop 2023-10-09T07:01:22.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.359+0000 7f07541ff700 1 -- 172.21.15.71:0/3846931742 shutdown_connections 2023-10-09T07:01:22.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.359+0000 7f07541ff700 1 --2- 172.21.15.71:0/3846931742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f074c155eb0 0x7f074c06e240 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:22.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.359+0000 7f07541ff700 1 --2- 172.21.15.71:0/3846931742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f074c0c70b0 0x7f074c069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:22.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.359+0000 7f07541ff700 1 -- 172.21.15.71:0/3846931742 >> 172.21.15.71:0/3846931742 conn(0x7f074c068e10 msgr2=0x7f074c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:22.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.359+0000 7f07541ff700 1 -- 172.21.15.71:0/3846931742 shutdown_connections 2023-10-09T07:01:22.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.359+0000 7f07541ff700 1 -- 172.21.15.71:0/3846931742 wait complete. 2023-10-09T07:01:22.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.360+0000 7f07541ff700 1 Processor -- start 2023-10-09T07:01:22.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.360+0000 7f07541ff700 1 -- start start 2023-10-09T07:01:22.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.361+0000 7f07541ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f074c069cb0 0x7f074c141930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:22.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.361+0000 7f07541ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f074c0c70b0 0x7f074c0c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:22.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.361+0000 7f07541ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f074c155eb0 0x7f074c0c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:22.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.361+0000 7f07541ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c0ca5f0 con 0x7f074c069cb0 2023-10-09T07:01:22.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.361+0000 7f07541ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c0c5fd0 con 0x7f074c155eb0 2023-10-09T07:01:22.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.361+0000 7f07541ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c0c62b0 con 0x7f074c0c70b0 2023-10-09T07:01:22.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.361+0000 7f0751f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f074c069cb0 0x7f074c141930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:22.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.361+0000 7f0751f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f074c069cb0 0x7f074c141930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44288/0 (socket says 172.21.15.71:44288) 2023-10-09T07:01:22.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.361+0000 7f0751f9b700 1 -- 172.21.15.71:0/2715666397 learned_addr learned my addr 172.21.15.71:0/2715666397 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:22.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.362+0000 7f0751f9b700 1 -- 172.21.15.71:0/2715666397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f074c0c70b0 msgr2=0x7f074c0c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:22.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.362+0000 7f0751f9b700 1 --2- 172.21.15.71:0/2715666397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f074c0c70b0 0x7f074c0c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:22.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.362+0000 7f0751f9b700 1 -- 172.21.15.71:0/2715666397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f074c155eb0 msgr2=0x7f074c0c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:22.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.362+0000 7f075279c700 1 --2- 172.21.15.71:0/2715666397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f074c155eb0 0x7f074c0c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:22.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.362+0000 7f0751f9b700 1 --2- 172.21.15.71:0/2715666397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f074c155eb0 0x7f074c0c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:22.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.362+0000 7f0751f9b700 1 -- 172.21.15.71:0/2715666397 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07480094f0 con 0x7f074c069cb0 2023-10-09T07:01:22.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.362+0000 7f075279c700 1 --2- 172.21.15.71:0/2715666397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f074c155eb0 0x7f074c0c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:01:22.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.362+0000 7f0751f9b700 1 --2- 172.21.15.71:0/2715666397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f074c069cb0 0x7f074c141930 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f0748009290 tx=0x7f0748016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:22.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.362+0000 7f0741ffb700 1 -- 172.21.15.71:0/2715666397 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748011d90 con 0x7f074c069cb0 2023-10-09T07:01:22.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.362+0000 7f07541ff700 1 -- 172.21.15.71:0/2715666397 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074c0c6590 con 0x7f074c069cb0 2023-10-09T07:01:22.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.362+0000 7f0741ffb700 1 -- 172.21.15.71:0/2715666397 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0748020070 con 0x7f074c069cb0 2023-10-09T07:01:22.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.362+0000 7f0741ffb700 1 -- 172.21.15.71:0/2715666397 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074801b6a0 con 0x7f074c069cb0 2023-10-09T07:01:22.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.362+0000 7f07541ff700 1 -- 172.21.15.71:0/2715666397 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074c152690 con 0x7f074c069cb0 2023-10-09T07:01:22.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.363+0000 7f07541ff700 1 -- 172.21.15.71:0/2715666397 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074c04c3c0 con 0x7f074c069cb0 2023-10-09T07:01:22.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.364+0000 7f0741ffb700 1 -- 172.21.15.71:0/2715666397 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0748022030 con 0x7f074c069cb0 2023-10-09T07:01:22.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.365+0000 7f0741ffb700 1 --2- 172.21.15.71:0/2715666397 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0730066f30 0x7f07300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:22.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.365+0000 7f0741ffb700 1 -- 172.21.15.71:0/2715666397 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6025+0+0 (secure 0 0 0) 0x7f0748086a50 con 0x7f074c069cb0 2023-10-09T07:01:22.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.366+0000 7f075179a700 1 --2- 172.21.15.71:0/2715666397 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0730066f30 0x7f07300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:22.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.367+0000 7f075179a700 1 --2- 172.21.15.71:0/2715666397 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0730066f30 0x7f07300693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f074c0aeb20 tx=0x7f073c008040 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:22.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.369+0000 7f0741ffb700 1 -- 172.21.15.71:0/2715666397 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0748053ae0 con 0x7f074c069cb0 2023-10-09T07:01:22.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:22.603+0000 7f07541ff700 1 -- 172.21.15.71:0/2715666397 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f074c04c3c0 con 0x7f074c069cb0 2023-10-09T07:01:23.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.138+0000 7f0741ffb700 1 -- 172.21.15.71:0/2715666397 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v63) v1 ==== 174+0+0 (secure 0 0 0) 0x7f0748057100 con 0x7f074c069cb0 2023-10-09T07:01:23.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.149+0000 7f07541ff700 1 -- 172.21.15.71:0/2715666397 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0730066f30 msgr2=0x7f07300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:23.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.149+0000 7f07541ff700 1 --2- 172.21.15.71:0/2715666397 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0730066f30 0x7f07300693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f074c0aeb20 tx=0x7f073c008040 comp rx=0 tx=0).stop 2023-10-09T07:01:23.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.149+0000 7f07541ff700 1 -- 172.21.15.71:0/2715666397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f074c069cb0 msgr2=0x7f074c141930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:23.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.149+0000 7f07541ff700 1 --2- 172.21.15.71:0/2715666397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f074c069cb0 0x7f074c141930 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f0748009290 tx=0x7f0748016000 comp rx=0 tx=0).stop 2023-10-09T07:01:23.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.153+0000 7f07541ff700 1 -- 172.21.15.71:0/2715666397 shutdown_connections 2023-10-09T07:01:23.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.153+0000 7f07541ff700 1 --2- 172.21.15.71:0/2715666397 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0730066f30 0x7f07300693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:23.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.153+0000 7f07541ff700 1 --2- 172.21.15.71:0/2715666397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f074c155eb0 0x7f074c0c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:23.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.153+0000 7f07541ff700 1 --2- 172.21.15.71:0/2715666397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f074c069cb0 0x7f074c141930 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:23.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.153+0000 7f07541ff700 1 --2- 172.21.15.71:0/2715666397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f074c0c70b0 0x7f074c0c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:23.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.153+0000 7f07541ff700 1 -- 172.21.15.71:0/2715666397 >> 172.21.15.71:0/2715666397 conn(0x7f074c068e10 msgr2=0x7f074c0af9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:23.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.154+0000 7f07541ff700 1 -- 172.21.15.71:0/2715666397 shutdown_connections 2023-10-09T07:01:23.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.154+0000 7f07541ff700 1 -- 172.21.15.71:0/2715666397 wait complete. 2023-10-09T07:01:23.163 INFO:teuthology.orchestra.run.smithi071.stderr:new fs with metadata pool 16 and data pool 17 2023-10-09T07:01:23.184 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:01:23.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.363+0000 7ff6707ff700 1 Processor -- start 2023-10-09T07:01:23.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.363+0000 7ff6707ff700 1 -- start start 2023-10-09T07:01:23.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.365+0000 7ff6707ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff6681578b0 0x7ff668155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:23.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.365+0000 7ff6707ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6680ad930 con 0x7ff6680af2f0 2023-10-09T07:01:23.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.365+0000 7ff6707ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6680acd20 con 0x7ff668155c10 2023-10-09T07:01:23.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.365+0000 7ff6707ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6680ad000 con 0x7ff6681578b0 2023-10-09T07:01:23.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.365+0000 7ff66dd9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff6681578b0 0x7ff668155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:23.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.365+0000 7ff66dd9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff6681578b0 0x7ff668155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44294/0 (socket says 172.21.15.71:44294) 2023-10-09T07:01:23.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.365+0000 7ff66ed9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff6680af2f0 0x7ff6680af730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59302/0 (socket says 172.21.15.71:59302) 2023-10-09T07:01:23.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.365+0000 7ff66dd9a700 1 -- 172.21.15.71:0/349601869 learned_addr learned my addr 172.21.15.71:0/349601869 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:23.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.365+0000 7ff66dd9a700 1 -- 172.21.15.71:0/349601869 >> v1:172.21.15.179:6789/0 conn(0x7ff668155c10 legacy=0x7ff6680ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:23.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.365+0000 7ff66dd9a700 1 -- 172.21.15.71:0/349601869 >> v1:172.21.15.71:6789/0 conn(0x7ff6680af2f0 legacy=0x7ff6680af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:23.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.365+0000 7ff66dd9a700 1 -- 172.21.15.71:0/349601869 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6680ad2e0 con 0x7ff6681578b0 2023-10-09T07:01:23.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.366+0000 7ff66dd9a700 1 --2- 172.21.15.71:0/349601869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6681578b0 0x7ff668155fe0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7ff65800bc50 tx=0x7ff65800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94cbb9b54329f4e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:23.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.366+0000 7ff66d599700 1 -- 172.21.15.71:0/349601869 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65800be60 con 0x7ff6681578b0 2023-10-09T07:01:23.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.366+0000 7ff66d599700 1 -- 172.21.15.71:0/349601869 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65800dd00 con 0x7ff6681578b0 2023-10-09T07:01:23.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.366+0000 7ff66d599700 1 -- 172.21.15.71:0/349601869 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6580106a0 con 0x7ff6681578b0 2023-10-09T07:01:23.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.366+0000 7ff6707ff700 1 -- 172.21.15.71:0/349601869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6681578b0 msgr2=0x7ff668155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:23.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.366+0000 7ff6707ff700 1 --2- 172.21.15.71:0/349601869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6681578b0 0x7ff668155fe0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7ff65800bc50 tx=0x7ff65800b4f0 comp rx=0 tx=0).stop 2023-10-09T07:01:23.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.367+0000 7ff6707ff700 1 -- 172.21.15.71:0/349601869 shutdown_connections 2023-10-09T07:01:23.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.367+0000 7ff6707ff700 1 --2- 172.21.15.71:0/349601869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6681578b0 0x7ff668155fe0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:23.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.367+0000 7ff6707ff700 1 -- 172.21.15.71:0/349601869 >> 172.21.15.71:0/349601869 conn(0x7ff66806a320 msgr2=0x7ff6680cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:23.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.367+0000 7ff6707ff700 1 -- 172.21.15.71:0/349601869 shutdown_connections 2023-10-09T07:01:23.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.367+0000 7ff6707ff700 1 -- 172.21.15.71:0/349601869 wait complete. 2023-10-09T07:01:23.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.368+0000 7ff6707ff700 1 Processor -- start 2023-10-09T07:01:23.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.368+0000 7ff6707ff700 1 -- start start 2023-10-09T07:01:23.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.369+0000 7ff6707ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6680af2f0 0x7ff668152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:23.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.369+0000 7ff6707ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff668155c10 0x7ff66815a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:23.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.369+0000 7ff6707ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6681578b0 0x7ff66815a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:23.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.369+0000 7ff6707ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66816aaa0 con 0x7ff6680af2f0 2023-10-09T07:01:23.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.369+0000 7ff6707ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff668169e90 con 0x7ff6681578b0 2023-10-09T07:01:23.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.369+0000 7ff6707ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66816a170 con 0x7ff668155c10 2023-10-09T07:01:23.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.369+0000 7ff66e59b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6680af2f0 0x7ff668152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:23.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.369+0000 7ff66e59b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6680af2f0 0x7ff668152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44306/0 (socket says 172.21.15.71:44306) 2023-10-09T07:01:23.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.369+0000 7ff66e59b700 1 -- 172.21.15.71:0/2812511194 learned_addr learned my addr 172.21.15.71:0/2812511194 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:23.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.370+0000 7ff66dd9a700 1 --2- 172.21.15.71:0/2812511194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff668155c10 0x7ff66815a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:23.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.370+0000 7ff66ed9c700 1 --2- 172.21.15.71:0/2812511194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6681578b0 0x7ff66815a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:23.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.370+0000 7ff66e59b700 1 -- 172.21.15.71:0/2812511194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff668155c10 msgr2=0x7ff66815a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:23.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.370+0000 7ff66e59b700 1 --2- 172.21.15.71:0/2812511194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff668155c10 0x7ff66815a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:23.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.370+0000 7ff66e59b700 1 -- 172.21.15.71:0/2812511194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6681578b0 msgr2=0x7ff66815a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:23.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.370+0000 7ff66e59b700 1 --2- 172.21.15.71:0/2812511194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6681578b0 0x7ff66815a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:23.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.370+0000 7ff66e59b700 1 -- 172.21.15.71:0/2812511194 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65800b790 con 0x7ff6680af2f0 2023-10-09T07:01:23.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.370+0000 7ff66e59b700 1 --2- 172.21.15.71:0/2812511194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6680af2f0 0x7ff668152120 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7ff66400c590 tx=0x7ff66400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:23.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.370+0000 7ff65e7fc700 1 -- 172.21.15.71:0/2812511194 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff664011590 con 0x7ff6680af2f0 2023-10-09T07:01:23.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.370+0000 7ff65e7fc700 1 -- 172.21.15.71:0/2812511194 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6640116f0 con 0x7ff6680af2f0 2023-10-09T07:01:23.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.370+0000 7ff6707ff700 1 -- 172.21.15.71:0/2812511194 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66816a450 con 0x7ff6680af2f0 2023-10-09T07:01:23.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.370+0000 7ff65e7fc700 1 -- 172.21.15.71:0/2812511194 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff664011ab0 con 0x7ff6680af2f0 2023-10-09T07:01:23.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.370+0000 7ff6707ff700 1 -- 172.21.15.71:0/2812511194 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff668169b80 con 0x7ff6680af2f0 2023-10-09T07:01:23.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.372+0000 7ff6707ff700 1 -- 172.21.15.71:0/2812511194 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66804c3c0 con 0x7ff6680af2f0 2023-10-09T07:01:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.372+0000 7ff65e7fc700 1 -- 172.21.15.71:0/2812511194 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff66401b3b0 con 0x7ff6680af2f0 2023-10-09T07:01:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.373+0000 7ff65e7fc700 1 --2- 172.21.15.71:0/2812511194 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff64c066f30 0x7ff64c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.373+0000 7ff65e7fc700 1 -- 172.21.15.71:0/2812511194 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6125+0+0 (secure 0 0 0) 0x7ff664083c80 con 0x7ff6680af2f0 2023-10-09T07:01:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.374+0000 7ff66dd9a700 1 --2- 172.21.15.71:0/2812511194 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff64c066f30 0x7ff64c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.374+0000 7ff66dd9a700 1 --2- 172.21.15.71:0/2812511194 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff64c066f30 0x7ff64c0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff65800bc50 tx=0x7ff65801a000 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:23.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.377+0000 7ff65e7fc700 1 -- 172.21.15.71:0/2812511194 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff664050d50 con 0x7ff6680af2f0 2023-10-09T07:01:23.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.568+0000 7ff6707ff700 1 -- 172.21.15.71:0/2812511194 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6680ad5c0 con 0x7ff6680af2f0 2023-10-09T07:01:23.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.569+0000 7ff65e7fc700 1 -- 172.21.15.71:0/2812511194 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+16016 (secure 0 0 0) 0x7ff664017020 con 0x7ff6680af2f0 2023-10-09T07:01:23.570 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:01:23.570 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":136,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:01:22.604771+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:01:20.274329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T07:01:21.592220+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:01:23.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.571+0000 7ff6707ff700 1 -- 172.21.15.71:0/2812511194 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff64c066f30 msgr2=0x7ff64c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:23.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.571+0000 7ff6707ff700 1 --2- 172.21.15.71:0/2812511194 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff64c066f30 0x7ff64c0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff65800bc50 tx=0x7ff65801a000 comp rx=0 tx=0).stop 2023-10-09T07:01:23.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.571+0000 7ff6707ff700 1 -- 172.21.15.71:0/2812511194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6680af2f0 msgr2=0x7ff668152120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:23.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.571+0000 7ff6707ff700 1 --2- 172.21.15.71:0/2812511194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6680af2f0 0x7ff668152120 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7ff66400c590 tx=0x7ff66400c950 comp rx=0 tx=0).stop 2023-10-09T07:01:23.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.571+0000 7ff6707ff700 1 -- 172.21.15.71:0/2812511194 shutdown_connections 2023-10-09T07:01:23.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.571+0000 7ff6707ff700 1 --2- 172.21.15.71:0/2812511194 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff64c066f30 0x7ff64c0693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:23.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.571+0000 7ff6707ff700 1 --2- 172.21.15.71:0/2812511194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6681578b0 0x7ff66815a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:23.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.571+0000 7ff6707ff700 1 --2- 172.21.15.71:0/2812511194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6680af2f0 0x7ff668152120 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:23.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.571+0000 7ff6707ff700 1 --2- 172.21.15.71:0/2812511194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff668155c10 0x7ff66815a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:23.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.571+0000 7ff6707ff700 1 -- 172.21.15.71:0/2812511194 >> 172.21.15.71:0/2812511194 conn(0x7ff66806a320 msgr2=0x7ff668068c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:23.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.572+0000 7ff6707ff700 1 -- 172.21.15.71:0/2812511194 shutdown_connections 2023-10-09T07:01:23.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.572+0000 7ff6707ff700 1 -- 172.21.15.71:0/2812511194 wait complete. 2023-10-09T07:01:23.590 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:01:23.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.770+0000 7f780ffff700 1 Processor -- start 2023-10-09T07:01:23.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.770+0000 7f780ffff700 1 -- start start 2023-10-09T07:01:23.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.771+0000 7f780ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f78080cbf30 0x7f78080ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:23.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.771+0000 7f780ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f78080b1420 0x7f78080c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:23.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.771+0000 7f780ffff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78080cc300 con 0x7f78080ccf90 2023-10-09T07:01:23.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.771+0000 7f780ffff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7808156bf0 con 0x7f78080cbf30 2023-10-09T07:01:23.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.771+0000 7f780ffff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78080ae950 con 0x7f78080b1420 2023-10-09T07:01:23.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.772+0000 7f780dd9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f78080cbf30 0x7f78080ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:23.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.772+0000 7f780dd9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f78080cbf30 0x7f78080ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44308/0 (socket says 172.21.15.71:44308) 2023-10-09T07:01:23.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.772+0000 7f780dd9b700 1 -- 172.21.15.71:0/2196438735 learned_addr learned my addr 172.21.15.71:0/2196438735 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:23.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.772+0000 7f780e59c700 1 --2- 172.21.15.71:0/2196438735 >> v2:172.21.15.179:3300/0 conn(0x7f78080b1420 0x7f78080c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:23.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.772+0000 7f780dd9b700 1 -- 172.21.15.71:0/2196438735 >> v2:172.21.15.179:3300/0 conn(0x7f78080b1420 msgr2=0x7f78080c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:23.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.772+0000 7f780dd9b700 1 --2- 172.21.15.71:0/2196438735 >> v2:172.21.15.179:3300/0 conn(0x7f78080b1420 0x7f78080c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:23.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.772+0000 7f780dd9b700 1 -- 172.21.15.71:0/2196438735 >> v1:172.21.15.179:6789/0 conn(0x7f78080ccf90 legacy=0x7f78080b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:23.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.772+0000 7f780dd9b700 1 -- 172.21.15.71:0/2196438735 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78080ad370 con 0x7f78080cbf30 2023-10-09T07:01:23.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.772+0000 7f780dd9b700 1 --2- 172.21.15.71:0/2196438735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78080cbf30 0x7f78080ae410 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f78080b19e0 tx=0x7f7804009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987b6d3ebc97392a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:23.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.772+0000 7f780cd99700 1 -- 172.21.15.71:0/2196438735 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780400b7e0 con 0x7f78080cbf30 2023-10-09T07:01:23.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.772+0000 7f780cd99700 1 -- 172.21.15.71:0/2196438735 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780400b940 con 0x7f78080cbf30 2023-10-09T07:01:23.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.772+0000 7f780cd99700 1 -- 172.21.15.71:0/2196438735 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780400bce0 con 0x7f78080cbf30 2023-10-09T07:01:23.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.773+0000 7f780ffff700 1 -- 172.21.15.71:0/2196438735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78080cbf30 msgr2=0x7f78080ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:23.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.773+0000 7f780ffff700 1 --2- 172.21.15.71:0/2196438735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78080cbf30 0x7f78080ae410 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f78080b19e0 tx=0x7f7804009250 comp rx=0 tx=0).stop 2023-10-09T07:01:23.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.773+0000 7f780ffff700 1 -- 172.21.15.71:0/2196438735 shutdown_connections 2023-10-09T07:01:23.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.773+0000 7f780ffff700 1 --2- 172.21.15.71:0/2196438735 >> v2:172.21.15.179:3300/0 conn(0x7f78080b1420 0x7f78080c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:23.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.773+0000 7f780ffff700 1 --2- 172.21.15.71:0/2196438735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78080cbf30 0x7f78080ae410 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:23.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.773+0000 7f780ffff700 1 -- 172.21.15.71:0/2196438735 >> 172.21.15.71:0/2196438735 conn(0x7f780806a320 msgr2=0x7f78080cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:23.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.773+0000 7f780ffff700 1 -- 172.21.15.71:0/2196438735 shutdown_connections 2023-10-09T07:01:23.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.773+0000 7f780ffff700 1 -- 172.21.15.71:0/2196438735 wait complete. 2023-10-09T07:01:23.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.775+0000 7f780ffff700 1 Processor -- start 2023-10-09T07:01:23.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.775+0000 7f780ffff700 1 -- start start 2023-10-09T07:01:23.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.776+0000 7f780ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78080b1420 0x7f780815d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:23.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.776+0000 7f780ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78080cbf30 0x7f7808155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:23.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.776+0000 7f780ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78080ccf90 0x7f780815c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:23.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.776+0000 7f780ffff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780815de20 con 0x7f78080ccf90 2023-10-09T07:01:23.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.776+0000 7f780ffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7808155590 con 0x7f78080b1420 2023-10-09T07:01:23.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.776+0000 7f780ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7808155ff0 con 0x7f78080cbf30 2023-10-09T07:01:23.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.776+0000 7f780e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78080ccf90 0x7f780815c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:23.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.776+0000 7f780e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78080ccf90 0x7f780815c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44314/0 (socket says 172.21.15.71:44314) 2023-10-09T07:01:23.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.776+0000 7f780e59c700 1 -- 172.21.15.71:0/3189599453 learned_addr learned my addr 172.21.15.71:0/3189599453 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:23.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.776+0000 7f780dd9b700 1 --2- 172.21.15.71:0/3189599453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78080b1420 0x7f780815d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:23.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.776+0000 7f780d59a700 1 --2- 172.21.15.71:0/3189599453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78080cbf30 0x7f7808155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:23.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.776+0000 7f780e59c700 1 -- 172.21.15.71:0/3189599453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78080cbf30 msgr2=0x7f7808155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:23.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.776+0000 7f780e59c700 1 --2- 172.21.15.71:0/3189599453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78080cbf30 0x7f7808155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:23.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.776+0000 7f780e59c700 1 -- 172.21.15.71:0/3189599453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78080b1420 msgr2=0x7f780815d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:23.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.776+0000 7f780e59c700 1 --2- 172.21.15.71:0/3189599453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78080b1420 0x7f780815d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:23.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.776+0000 7f780e59c700 1 -- 172.21.15.71:0/3189599453 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78040094f0 con 0x7f78080ccf90 2023-10-09T07:01:23.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.776+0000 7f780d59a700 1 --2- 172.21.15.71:0/3189599453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78080cbf30 0x7f7808155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:01:23.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.777+0000 7f780e59c700 1 --2- 172.21.15.71:0/3189599453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78080ccf90 0x7f780815c670 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f7800009fa0 tx=0x7f7800009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:23.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.777+0000 7f77fdffb700 1 -- 172.21.15.71:0/3189599453 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780000ec70 con 0x7f78080ccf90 2023-10-09T07:01:23.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.777+0000 7f77fdffb700 1 -- 172.21.15.71:0/3189599453 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780000edd0 con 0x7f78080ccf90 2023-10-09T07:01:23.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.777+0000 7f780ffff700 1 -- 172.21.15.71:0/3189599453 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780815b7e0 con 0x7f78080ccf90 2023-10-09T07:01:23.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.777+0000 7f77fdffb700 1 -- 172.21.15.71:0/3189599453 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7800014670 con 0x7f78080ccf90 2023-10-09T07:01:23.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.777+0000 7f780ffff700 1 -- 172.21.15.71:0/3189599453 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780815c150 con 0x7f78080ccf90 2023-10-09T07:01:23.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.778+0000 7f780ffff700 1 -- 172.21.15.71:0/3189599453 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780804c3c0 con 0x7f78080ccf90 2023-10-09T07:01:23.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.779+0000 7f77fdffb700 1 -- 172.21.15.71:0/3189599453 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f78000149e0 con 0x7f78080ccf90 2023-10-09T07:01:23.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.780+0000 7f77fdffb700 1 --2- 172.21.15.71:0/3189599453 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f77ec066f30 0x7f77ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:23.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.780+0000 7f77fdffb700 1 -- 172.21.15.71:0/3189599453 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f7800084db0 con 0x7f78080ccf90 2023-10-09T07:01:23.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.780+0000 7f780dd9b700 1 --2- 172.21.15.71:0/3189599453 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f77ec066f30 0x7f77ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:23.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.781+0000 7f780dd9b700 1 --2- 172.21.15.71:0/3189599453 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f77ec066f30 0x7f77ec0693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f78080b19e0 tx=0x7f7804016000 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:23.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.784+0000 7f77fdffb700 1 -- 172.21.15.71:0/3189599453 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7800051e80 con 0x7f78080ccf90 2023-10-09T07:01:23.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.976+0000 7f780ffff700 1 -- 172.21.15.71:0/3189599453 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78080ad680 con 0x7f78080ccf90 2023-10-09T07:01:23.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.977+0000 7f77fdffb700 1 -- 172.21.15.71:0/3189599453 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+16016 (secure 0 0 0) 0x7f78000554a0 con 0x7f78080ccf90 2023-10-09T07:01:23.979 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:01:23.979 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":136,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:01:22.604771+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:01:20.274329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T07:01:21.592220+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:01:23.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.980+0000 7f780ffff700 1 -- 172.21.15.71:0/3189599453 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f77ec066f30 msgr2=0x7f77ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:23.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.980+0000 7f780ffff700 1 --2- 172.21.15.71:0/3189599453 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f77ec066f30 0x7f77ec0693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f78080b19e0 tx=0x7f7804016000 comp rx=0 tx=0).stop 2023-10-09T07:01:23.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.980+0000 7f780ffff700 1 -- 172.21.15.71:0/3189599453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78080ccf90 msgr2=0x7f780815c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:23.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.980+0000 7f780ffff700 1 --2- 172.21.15.71:0/3189599453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78080ccf90 0x7f780815c670 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f7800009fa0 tx=0x7f7800009900 comp rx=0 tx=0).stop 2023-10-09T07:01:23.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.980+0000 7f780ffff700 1 -- 172.21.15.71:0/3189599453 shutdown_connections 2023-10-09T07:01:23.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.980+0000 7f780ffff700 1 --2- 172.21.15.71:0/3189599453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78080ccf90 0x7f780815c670 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:23.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.980+0000 7f780ffff700 1 --2- 172.21.15.71:0/3189599453 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f77ec066f30 0x7f77ec0693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:23.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.980+0000 7f780ffff700 1 --2- 172.21.15.71:0/3189599453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78080b1420 0x7f780815d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:23.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.980+0000 7f780ffff700 1 --2- 172.21.15.71:0/3189599453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78080cbf30 0x7f7808155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:23.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.980+0000 7f780ffff700 1 -- 172.21.15.71:0/3189599453 >> 172.21.15.71:0/3189599453 conn(0x7f780806a320 msgr2=0x7f78080c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:23.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.980+0000 7f780ffff700 1 -- 172.21.15.71:0/3189599453 shutdown_connections 2023-10-09T07:01:23.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:23.980+0000 7f780ffff700 1 -- 172.21.15.71:0/3189599453 wait complete. 2023-10-09T07:01:23.999 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T07:01:24.114 INFO:tasks.ceph.mds.b.smithi179.stderr:2023-10-09T07:01:24.112+0000 7fc2a09f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T07:01:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.184+0000 7f4b597ff700 1 Processor -- start 2023-10-09T07:01:24.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.184+0000 7f4b597ff700 1 -- start start 2023-10-09T07:01:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.186+0000 7f4b597ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4b540c83f0 0x7f4b540c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.186+0000 7f4b597ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4b540ccee0 0x7f4b541561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.186+0000 7f4b597ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b540c87c0 0x7f4b54156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.186+0000 7f4b597ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b54156c50 con 0x7f4b540c83f0 2023-10-09T07:01:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.186+0000 7f4b597ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b5415b0d0 con 0x7f4b540ccee0 2023-10-09T07:01:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.186+0000 7f4b597ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b540c7a60 con 0x7f4b540c87c0 2023-10-09T07:01:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.186+0000 7f4b52ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4b540c83f0 0x7f4b540c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.186+0000 7f4b52ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4b540c83f0 0x7f4b540c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44320/0 (socket says 172.21.15.71:44320) 2023-10-09T07:01:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.186+0000 7f4b52ffd700 1 -- 172.21.15.71:0/3438485628 learned_addr learned my addr 172.21.15.71:0/3438485628 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.186+0000 7f4b527fc700 1 --2- 172.21.15.71:0/3438485628 >> v2:172.21.15.179:3300/0 conn(0x7f4b540ccee0 0x7f4b541561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.186+0000 7f4b537fe700 1 --2- 172.21.15.71:0/3438485628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b540c87c0 0x7f4b54156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.186+0000 7f4b52ffd700 1 -- 172.21.15.71:0/3438485628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b540c87c0 msgr2=0x7f4b54156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.186+0000 7f4b52ffd700 1 --2- 172.21.15.71:0/3438485628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b540c87c0 0x7f4b54156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.186+0000 7f4b52ffd700 1 -- 172.21.15.71:0/3438485628 >> v2:172.21.15.179:3300/0 conn(0x7f4b540ccee0 msgr2=0x7f4b541561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.186+0000 7f4b52ffd700 1 --2- 172.21.15.71:0/3438485628 >> v2:172.21.15.179:3300/0 conn(0x7f4b540ccee0 0x7f4b541561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.186+0000 7f4b52ffd700 1 -- 172.21.15.71:0/3438485628 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5415a4c0 con 0x7f4b540c83f0 2023-10-09T07:01:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.187+0000 7f4b52ffd700 1 --2- 172.21.15.71:0/3438485628 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b540c83f0 0x7f4b540c7520 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f4b540c7eb0 tx=0x7f4b4400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4365f526a99231 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.187+0000 7f4b51ffb700 1 -- 172.21.15.71:0/3438485628 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4400dc50 con 0x7f4b540c83f0 2023-10-09T07:01:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.187+0000 7f4b51ffb700 1 -- 172.21.15.71:0/3438485628 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4400ddb0 con 0x7f4b540c83f0 2023-10-09T07:01:24.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.187+0000 7f4b51ffb700 1 -- 172.21.15.71:0/3438485628 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b440196d0 con 0x7f4b540c83f0 2023-10-09T07:01:24.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.187+0000 7f4b597ff700 1 -- 172.21.15.71:0/3438485628 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b540c83f0 msgr2=0x7f4b540c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:24.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.187+0000 7f4b597ff700 1 --2- 172.21.15.71:0/3438485628 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b540c83f0 0x7f4b540c7520 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f4b540c7eb0 tx=0x7f4b4400b4f0 comp rx=0 tx=0).stop 2023-10-09T07:01:24.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.188+0000 7f4b597ff700 1 -- 172.21.15.71:0/3438485628 shutdown_connections 2023-10-09T07:01:24.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.188+0000 7f4b597ff700 1 --2- 172.21.15.71:0/3438485628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b540c87c0 0x7f4b54156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:24.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.188+0000 7f4b597ff700 1 --2- 172.21.15.71:0/3438485628 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b540c83f0 0x7f4b540c7520 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:24.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.188+0000 7f4b597ff700 1 --2- 172.21.15.71:0/3438485628 >> v2:172.21.15.179:3300/0 conn(0x7f4b540ccee0 0x7f4b541561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.188+0000 7f4b597ff700 1 -- 172.21.15.71:0/3438485628 >> 172.21.15.71:0/3438485628 conn(0x7f4b54068e10 msgr2=0x7f4b540cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.188+0000 7f4b597ff700 1 -- 172.21.15.71:0/3438485628 shutdown_connections 2023-10-09T07:01:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.188+0000 7f4b597ff700 1 -- 172.21.15.71:0/3438485628 wait complete. 2023-10-09T07:01:24.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.189+0000 7f4b597ff700 1 Processor -- start 2023-10-09T07:01:24.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.189+0000 7f4b597ff700 1 -- start start 2023-10-09T07:01:24.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.190+0000 7f4b597ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b540c83f0 0x7f4b54152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:24.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.190+0000 7f4b597ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b540c87c0 0x7f4b5415ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:24.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.190+0000 7f4b597ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b540ccee0 0x7f4b54157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:24.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.190+0000 7f4b597ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b541571a0 con 0x7f4b540ccee0 2023-10-09T07:01:24.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.190+0000 7f4b597ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5415f190 con 0x7f4b540c87c0 2023-10-09T07:01:24.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.190+0000 7f4b597ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b54158470 con 0x7f4b540c83f0 2023-10-09T07:01:24.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.190+0000 7f4b537fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b540ccee0 0x7f4b54157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:24.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.190+0000 7f4b537fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b540ccee0 0x7f4b54157630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44334/0 (socket says 172.21.15.71:44334) 2023-10-09T07:01:24.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.190+0000 7f4b537fe700 1 -- 172.21.15.71:0/1017587993 learned_addr learned my addr 172.21.15.71:0/1017587993 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:24.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.191+0000 7f4b52ffd700 1 --2- 172.21.15.71:0/1017587993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b540c83f0 0x7f4b54152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:24.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.191+0000 7f4b527fc700 1 --2- 172.21.15.71:0/1017587993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b540c87c0 0x7f4b5415ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:24.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.191+0000 7f4b537fe700 1 -- 172.21.15.71:0/1017587993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b540c83f0 msgr2=0x7f4b54152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:24.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.191+0000 7f4b537fe700 1 --2- 172.21.15.71:0/1017587993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b540c83f0 0x7f4b54152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:24.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.191+0000 7f4b537fe700 1 -- 172.21.15.71:0/1017587993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b540c87c0 msgr2=0x7f4b5415ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:24.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.191+0000 7f4b537fe700 1 --2- 172.21.15.71:0/1017587993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b540c87c0 0x7f4b5415ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:24.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.191+0000 7f4b537fe700 1 -- 172.21.15.71:0/1017587993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4400b790 con 0x7f4b540ccee0 2023-10-09T07:01:24.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.191+0000 7f4b537fe700 1 --2- 172.21.15.71:0/1017587993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b540ccee0 0x7f4b54157630 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c009fa0 tx=0x7f4b4c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:24.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.191+0000 7f4b3affd700 1 -- 172.21.15.71:0/1017587993 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c00ed20 con 0x7f4b540ccee0 2023-10-09T07:01:24.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.191+0000 7f4b3affd700 1 -- 172.21.15.71:0/1017587993 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4c00ee80 con 0x7f4b540ccee0 2023-10-09T07:01:24.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.191+0000 7f4b597ff700 1 -- 172.21.15.71:0/1017587993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b54158750 con 0x7f4b540ccee0 2023-10-09T07:01:24.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.191+0000 7f4b3affd700 1 -- 172.21.15.71:0/1017587993 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c014670 con 0x7f4b540ccee0 2023-10-09T07:01:24.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.191+0000 7f4b597ff700 1 -- 172.21.15.71:0/1017587993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b54156e30 con 0x7f4b540ccee0 2023-10-09T07:01:24.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.192+0000 7f4b597ff700 1 -- 172.21.15.71:0/1017587993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b54157310 con 0x7f4b540ccee0 2023-10-09T07:01:24.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.193+0000 7f4b3affd700 1 -- 172.21.15.71:0/1017587993 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b4c0149e0 con 0x7f4b540ccee0 2023-10-09T07:01:24.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.195+0000 7f4b3affd700 1 --2- 172.21.15.71:0/1017587993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4b40066f30 0x7f4b400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:24.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.195+0000 7f4b3affd700 1 -- 172.21.15.71:0/1017587993 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f4b4c084f10 con 0x7f4b540ccee0 2023-10-09T07:01:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.195+0000 7f4b52ffd700 1 --2- 172.21.15.71:0/1017587993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4b40066f30 0x7f4b400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.196+0000 7f4b52ffd700 1 --2- 172.21.15.71:0/1017587993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4b40066f30 0x7f4b400693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4b540c7eb0 tx=0x7f4b4401b000 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.199+0000 7f4b3affd700 1 -- 172.21.15.71:0/1017587993 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b4c051f40 con 0x7f4b540ccee0 2023-10-09T07:01:24.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:24.432+0000 7f4b597ff700 1 -- 172.21.15.71:0/1017587993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4b5404c3c0 con 0x7f4b540ccee0 2023-10-09T07:01:25.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.163+0000 7f4b3affd700 1 -- 172.21.15.71:0/1017587993 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v65) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4b4c055560 con 0x7f4b540ccee0 2023-10-09T07:01:25.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.166+0000 7f4b597ff700 1 -- 172.21.15.71:0/1017587993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4b40066f30 msgr2=0x7f4b400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:25.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.166+0000 7f4b597ff700 1 --2- 172.21.15.71:0/1017587993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4b40066f30 0x7f4b400693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4b540c7eb0 tx=0x7f4b4401b000 comp rx=0 tx=0).stop 2023-10-09T07:01:25.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.166+0000 7f4b597ff700 1 -- 172.21.15.71:0/1017587993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b540ccee0 msgr2=0x7f4b54157630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:25.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.166+0000 7f4b597ff700 1 --2- 172.21.15.71:0/1017587993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b540ccee0 0x7f4b54157630 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c009fa0 tx=0x7f4b4c009900 comp rx=0 tx=0).stop 2023-10-09T07:01:25.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.166+0000 7f4b597ff700 1 -- 172.21.15.71:0/1017587993 shutdown_connections 2023-10-09T07:01:25.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.166+0000 7f4b597ff700 1 --2- 172.21.15.71:0/1017587993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b540ccee0 0x7f4b54157630 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:25.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.166+0000 7f4b597ff700 1 --2- 172.21.15.71:0/1017587993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b540c83f0 0x7f4b54152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:25.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.166+0000 7f4b597ff700 1 --2- 172.21.15.71:0/1017587993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4b40066f30 0x7f4b400693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:25.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.166+0000 7f4b597ff700 1 --2- 172.21.15.71:0/1017587993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b540c87c0 0x7f4b5415ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:25.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.166+0000 7f4b597ff700 1 -- 172.21.15.71:0/1017587993 >> 172.21.15.71:0/1017587993 conn(0x7f4b54068e10 msgr2=0x7f4b540cb530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:25.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.166+0000 7f4b597ff700 1 -- 172.21.15.71:0/1017587993 shutdown_connections 2023-10-09T07:01:25.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.167+0000 7f4b597ff700 1 -- 172.21.15.71:0/1017587993 wait complete. 2023-10-09T07:01:25.188 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T07:01:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.374+0000 7ff781dff700 1 Processor -- start 2023-10-09T07:01:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.374+0000 7ff781dff700 1 -- start start 2023-10-09T07:01:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.375+0000 7ff781dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff77c159c60 0x7ff77c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.375+0000 7ff781dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff77c15db10 0x7ff77c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.375+0000 7ff781dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77c15a160 con 0x7ff77c159890 2023-10-09T07:01:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.375+0000 7ff781dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff77c15df50 con 0x7ff77c159c60 2023-10-09T07:01:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.375+0000 7ff781dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c0d13a0 con 0x7ff77c15db10 2023-10-09T07:01:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.376+0000 7ff77bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff77c15db10 0x7ff77c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.376+0000 7ff77affd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff77c159c60 0x7ff77c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.376+0000 7ff77b7fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7ff77c159890 0x7ff77c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:59288/0 (socket says 172.21.15.71:59288) 2023-10-09T07:01:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.376+0000 7ff77b7fe700 1 -- 172.21.15.71:0/2315912230 learned_addr learned my addr 172.21.15.71:0/2315912230 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:01:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.376+0000 7ff77bfff700 1 -- 172.21.15.71:0/2315912230 >> v2:172.21.15.179:3300/0 conn(0x7ff77c159c60 msgr2=0x7ff77c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.376+0000 7ff77a7fc700 1 -- 172.21.15.71:0/2315912230 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2445363535 0 0) 0x7ff77c15a160 con 0x7ff77c159890 2023-10-09T07:01:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.376+0000 7ff77bfff700 1 --2- 172.21.15.71:0/2315912230 >> v2:172.21.15.179:3300/0 conn(0x7ff77c159c60 0x7ff77c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.376+0000 7ff77bfff700 1 -- 172.21.15.71:0/2315912230 >> v1:172.21.15.179:6789/0 conn(0x7ff77c159890 legacy=0x7ff77c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.376+0000 7ff77bfff700 1 -- 172.21.15.71:0/2315912230 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c15e140 con 0x7ff77c15db10 2023-10-09T07:01:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.376+0000 7ff77affd700 1 --2- 172.21.15.71:0/2315912230 >> v2:172.21.15.179:3300/0 conn(0x7ff77c159c60 0x7ff77c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:01:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.377+0000 7ff77bfff700 1 --2- 172.21.15.71:0/2315912230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff77c15db10 0x7ff77c069560 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff774009e60 tx=0x7ff774009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cf723a756b06ae0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.377+0000 7ff77a7fc700 1 -- 172.21.15.71:0/2315912230 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77400e070 con 0x7ff77c15db10 2023-10-09T07:01:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.377+0000 7ff77a7fc700 1 -- 172.21.15.71:0/2315912230 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77400bb60 con 0x7ff77c15db10 2023-10-09T07:01:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.377+0000 7ff77a7fc700 1 -- 172.21.15.71:0/2315912230 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774012430 con 0x7ff77c15db10 2023-10-09T07:01:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.378+0000 7ff781dff700 1 -- 172.21.15.71:0/2315912230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff77c15db10 msgr2=0x7ff77c069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.378+0000 7ff781dff700 1 --2- 172.21.15.71:0/2315912230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff77c15db10 0x7ff77c069560 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff774009e60 tx=0x7ff774009780 comp rx=0 tx=0).stop 2023-10-09T07:01:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.378+0000 7ff781dff700 1 -- 172.21.15.71:0/2315912230 shutdown_connections 2023-10-09T07:01:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.378+0000 7ff781dff700 1 --2- 172.21.15.71:0/2315912230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff77c15db10 0x7ff77c069560 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.378+0000 7ff781dff700 1 --2- 172.21.15.71:0/2315912230 >> v2:172.21.15.179:3300/0 conn(0x7ff77c159c60 0x7ff77c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.378+0000 7ff781dff700 1 -- 172.21.15.71:0/2315912230 >> 172.21.15.71:0/2315912230 conn(0x7ff77c068e20 msgr2=0x7ff77c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.378+0000 7ff781dff700 1 -- 172.21.15.71:0/2315912230 shutdown_connections 2023-10-09T07:01:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.378+0000 7ff781dff700 1 -- 172.21.15.71:0/2315912230 wait complete. 2023-10-09T07:01:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.379+0000 7ff781dff700 1 Processor -- start 2023-10-09T07:01:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.380+0000 7ff781dff700 1 -- start start 2023-10-09T07:01:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.381+0000 7ff781dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff77c159890 0x7ff77c0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.381+0000 7ff781dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff77c159c60 0x7ff77c0cde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.381+0000 7ff781dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff77c15db10 0x7ff77c0ce340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.381+0000 7ff77b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff77c159890 0x7ff77c0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.381+0000 7ff781dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c0cfe50 con 0x7ff77c159890 2023-10-09T07:01:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.381+0000 7ff781dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c153210 con 0x7ff77c159c60 2023-10-09T07:01:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.382+0000 7ff77b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff77c159890 0x7ff77c0cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40034/0 (socket says 172.21.15.71:40034) 2023-10-09T07:01:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.382+0000 7ff77b7fe700 1 -- 172.21.15.71:0/410031872 learned_addr learned my addr 172.21.15.71:0/410031872 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.382+0000 7ff77bfff700 1 --2- 172.21.15.71:0/410031872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff77c15db10 0x7ff77c0ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.382+0000 7ff781dff700 1 -- 172.21.15.71:0/410031872 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c0c73e0 con 0x7ff77c15db10 2023-10-09T07:01:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.382+0000 7ff77affd700 1 --2- 172.21.15.71:0/410031872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff77c159c60 0x7ff77c0cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.382+0000 7ff77b7fe700 1 -- 172.21.15.71:0/410031872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff77c15db10 msgr2=0x7ff77c0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.382+0000 7ff77b7fe700 1 --2- 172.21.15.71:0/410031872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff77c15db10 0x7ff77c0ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.382+0000 7ff77b7fe700 1 -- 172.21.15.71:0/410031872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff77c159c60 msgr2=0x7ff77c0cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.382+0000 7ff77b7fe700 1 --2- 172.21.15.71:0/410031872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff77c159c60 0x7ff77c0cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.382+0000 7ff77b7fe700 1 -- 172.21.15.71:0/410031872 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff770009420 con 0x7ff77c159890 2023-10-09T07:01:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.382+0000 7ff77b7fe700 1 --2- 172.21.15.71:0/410031872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff77c159890 0x7ff77c0cd8c0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00c7e0 tx=0x7ff76c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.383+0000 7ff7637fe700 1 -- 172.21.15.71:0/410031872 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c005b30 con 0x7ff77c159890 2023-10-09T07:01:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.383+0000 7ff7637fe700 1 -- 172.21.15.71:0/410031872 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76c005c90 con 0x7ff77c159890 2023-10-09T07:01:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.383+0000 7ff781dff700 1 -- 172.21.15.71:0/410031872 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff774009a20 con 0x7ff77c159890 2023-10-09T07:01:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.383+0000 7ff7637fe700 1 -- 172.21.15.71:0/410031872 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c007300 con 0x7ff77c159890 2023-10-09T07:01:25.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.383+0000 7ff781dff700 1 -- 172.21.15.71:0/410031872 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77c0cf890 con 0x7ff77c159890 2023-10-09T07:01:25.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.384+0000 7ff781dff700 1 -- 172.21.15.71:0/410031872 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff77c06f900 con 0x7ff77c159890 2023-10-09T07:01:25.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.385+0000 7ff7637fe700 1 -- 172.21.15.71:0/410031872 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff76c01b3b0 con 0x7ff77c159890 2023-10-09T07:01:25.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.386+0000 7ff7637fe700 1 --2- 172.21.15.71:0/410031872 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff768066f30 0x7ff7680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:25.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.386+0000 7ff7637fe700 1 -- 172.21.15.71:0/410031872 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6125+0+0 (secure 0 0 0) 0x7ff76c083bf0 con 0x7ff77c159890 2023-10-09T07:01:25.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.386+0000 7ff77affd700 1 --2- 172.21.15.71:0/410031872 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff768066f30 0x7ff7680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:25.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.387+0000 7ff77affd700 1 --2- 172.21.15.71:0/410031872 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff768066f30 0x7ff7680693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0cd810 tx=0x7ff7700091a0 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.390+0000 7ff7637fe700 1 -- 172.21.15.71:0/410031872 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff76c050cc0 con 0x7ff77c159890 2023-10-09T07:01:25.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:25.623+0000 7ff781dff700 1 -- 172.21.15.71:0/410031872 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff77c0d0d40 con 0x7ff77c159890 2023-10-09T07:01:26.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.174+0000 7ff7637fe700 1 -- 172.21.15.71:0/410031872 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v66) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff76c017020 con 0x7ff77c159890 2023-10-09T07:01:26.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.177+0000 7ff781dff700 1 -- 172.21.15.71:0/410031872 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff768066f30 msgr2=0x7ff7680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:26.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.177+0000 7ff781dff700 1 --2- 172.21.15.71:0/410031872 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff768066f30 0x7ff7680693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0cd810 tx=0x7ff7700091a0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.177+0000 7ff781dff700 1 -- 172.21.15.71:0/410031872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff77c159890 msgr2=0x7ff77c0cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:26.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.177+0000 7ff781dff700 1 --2- 172.21.15.71:0/410031872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff77c159890 0x7ff77c0cd8c0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00c7e0 tx=0x7ff76c007df0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.177+0000 7ff781dff700 1 -- 172.21.15.71:0/410031872 shutdown_connections 2023-10-09T07:01:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.177+0000 7ff781dff700 1 --2- 172.21.15.71:0/410031872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff77c15db10 0x7ff77c0ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.177+0000 7ff781dff700 1 --2- 172.21.15.71:0/410031872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff77c159890 0x7ff77c0cd8c0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.177+0000 7ff781dff700 1 --2- 172.21.15.71:0/410031872 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff768066f30 0x7ff7680693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.177+0000 7ff781dff700 1 --2- 172.21.15.71:0/410031872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff77c159c60 0x7ff77c0cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.177+0000 7ff781dff700 1 -- 172.21.15.71:0/410031872 >> 172.21.15.71:0/410031872 conn(0x7ff77c068e20 msgr2=0x7ff77c0af8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.177+0000 7ff781dff700 1 -- 172.21.15.71:0/410031872 shutdown_connections 2023-10-09T07:01:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.177+0000 7ff781dff700 1 -- 172.21.15.71:0/410031872 wait complete. 2023-10-09T07:01:26.195 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:01:26.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.377+0000 7fa07559d700 1 Processor -- start 2023-10-09T07:01:26.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.377+0000 7fa07559d700 1 -- start start 2023-10-09T07:01:26.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.378+0000 7fa07559d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa070150180 0x7fa070157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:26.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.378+0000 7fa07559d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa070150550 0x7fa0700c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:26.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.378+0000 7fa07559d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa0700c7240 0x7fa070069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:26.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.378+0000 7fa07559d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0700c76c0 con 0x7fa0700c7240 2023-10-09T07:01:26.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.378+0000 7fa07559d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa07006e2a0 con 0x7fa070150180 2023-10-09T07:01:26.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.378+0000 7fa07559d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07006b2e0 con 0x7fa070150550 2023-10-09T07:01:26.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.378+0000 7fa074d9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa0700c7240 0x7fa070069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:26.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.379+0000 7fa074d9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa0700c7240 0x7fa070069f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40046/0 (socket says 172.21.15.71:40046) 2023-10-09T07:01:26.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.379+0000 7fa074d9c700 1 -- 172.21.15.71:0/1560783219 learned_addr learned my addr 172.21.15.71:0/1560783219 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:26.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.379+0000 7fa06ffff700 1 --2- 172.21.15.71:0/1560783219 >> v2:172.21.15.179:3300/0 conn(0x7fa070150180 0x7fa070157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:26.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.379+0000 7fa06f7fe700 1 --2- 172.21.15.71:0/1560783219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa070150550 0x7fa0700c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:26.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.379+0000 7fa074d9c700 1 -- 172.21.15.71:0/1560783219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa070150550 msgr2=0x7fa0700c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:26.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.379+0000 7fa074d9c700 1 --2- 172.21.15.71:0/1560783219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa070150550 0x7fa0700c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.379+0000 7fa074d9c700 1 -- 172.21.15.71:0/1560783219 >> v2:172.21.15.179:3300/0 conn(0x7fa070150180 msgr2=0x7fa070157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:26.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.379+0000 7fa074d9c700 1 --2- 172.21.15.71:0/1560783219 >> v2:172.21.15.179:3300/0 conn(0x7fa070150180 0x7fa070157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.379+0000 7fa074d9c700 1 -- 172.21.15.71:0/1560783219 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0700c78e0 con 0x7fa0700c7240 2023-10-09T07:01:26.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.379+0000 7fa074d9c700 1 --2- 172.21.15.71:0/1560783219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0700c7240 0x7fa070069f50 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fa068009f50 tx=0x7fa068009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27bf3a37d811e69c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:26.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.380+0000 7fa06effd700 1 -- 172.21.15.71:0/1560783219 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06800e070 con 0x7fa0700c7240 2023-10-09T07:01:26.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.380+0000 7fa06effd700 1 -- 172.21.15.71:0/1560783219 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06800b8d0 con 0x7fa0700c7240 2023-10-09T07:01:26.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.380+0000 7fa06effd700 1 -- 172.21.15.71:0/1560783219 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0680092e0 con 0x7fa0700c7240 2023-10-09T07:01:26.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.380+0000 7fa07559d700 1 -- 172.21.15.71:0/1560783219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0700c7240 msgr2=0x7fa070069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:26.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.380+0000 7fa07559d700 1 --2- 172.21.15.71:0/1560783219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0700c7240 0x7fa070069f50 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fa068009f50 tx=0x7fa068009840 comp rx=0 tx=0).stop 2023-10-09T07:01:26.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.380+0000 7fa07559d700 1 -- 172.21.15.71:0/1560783219 shutdown_connections 2023-10-09T07:01:26.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.380+0000 7fa07559d700 1 --2- 172.21.15.71:0/1560783219 >> v2:172.21.15.179:3300/0 conn(0x7fa070150180 0x7fa070157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.380+0000 7fa07559d700 1 --2- 172.21.15.71:0/1560783219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0700c7240 0x7fa070069f50 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.380+0000 7fa07559d700 1 --2- 172.21.15.71:0/1560783219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa070150550 0x7fa0700c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.380+0000 7fa07559d700 1 -- 172.21.15.71:0/1560783219 >> 172.21.15.71:0/1560783219 conn(0x7fa0700cc1f0 msgr2=0x7fa0700cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:26.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.380+0000 7fa07559d700 1 -- 172.21.15.71:0/1560783219 shutdown_connections 2023-10-09T07:01:26.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.380+0000 7fa07559d700 1 -- 172.21.15.71:0/1560783219 wait complete. 2023-10-09T07:01:26.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.382+0000 7fa07559d700 1 Processor -- start 2023-10-09T07:01:26.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.382+0000 7fa07559d700 1 -- start start 2023-10-09T07:01:26.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.383+0000 7fa07559d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0700c7240 0x7fa07016d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:26.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.383+0000 7fa07559d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa070150180 0x7fa07014b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:26.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.383+0000 7fa07559d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa070150550 0x7fa0700696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.383+0000 7fa07559d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0700b1d00 con 0x7fa070150180 2023-10-09T07:01:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.383+0000 7fa07559d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa070157f40 con 0x7fa070150550 2023-10-09T07:01:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.383+0000 7fa07559d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0700c3480 con 0x7fa0700c7240 2023-10-09T07:01:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.383+0000 7fa06f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa070150180 0x7fa07014b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.383+0000 7fa06f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa070150180 0x7fa07014b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40058/0 (socket says 172.21.15.71:40058) 2023-10-09T07:01:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.383+0000 7fa06f7fe700 1 -- 172.21.15.71:0/1674734136 learned_addr learned my addr 172.21.15.71:0/1674734136 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.383+0000 7fa06ffff700 1 --2- 172.21.15.71:0/1674734136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0700c7240 0x7fa07016d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.383+0000 7fa074d9c700 1 --2- 172.21.15.71:0/1674734136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa070150550 0x7fa0700696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.383+0000 7fa06f7fe700 1 -- 172.21.15.71:0/1674734136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0700c7240 msgr2=0x7fa07016d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.383+0000 7fa06f7fe700 1 --2- 172.21.15.71:0/1674734136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0700c7240 0x7fa07016d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.383+0000 7fa06f7fe700 1 -- 172.21.15.71:0/1674734136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa070150550 msgr2=0x7fa0700696c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:26.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.383+0000 7fa06f7fe700 1 --2- 172.21.15.71:0/1674734136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa070150550 0x7fa0700696c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.383+0000 7fa06f7fe700 1 -- 172.21.15.71:0/1674734136 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa068009ae0 con 0x7fa070150180 2023-10-09T07:01:26.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.383+0000 7fa06ffff700 1 --2- 172.21.15.71:0/1674734136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0700c7240 0x7fa07016d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:01:26.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.384+0000 7fa06f7fe700 1 --2- 172.21.15.71:0/1674734136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa070150180 0x7fa07014b030 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fa06400ec80 tx=0x7fa0640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:26.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.384+0000 7fa057fff700 1 -- 172.21.15.71:0/1674734136 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06400c9d0 con 0x7fa070150180 2023-10-09T07:01:26.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.384+0000 7fa057fff700 1 -- 172.21.15.71:0/1674734136 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06400cb50 con 0x7fa070150180 2023-10-09T07:01:26.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.384+0000 7fa07559d700 1 -- 172.21.15.71:0/1674734136 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0700b0f60 con 0x7fa070150180 2023-10-09T07:01:26.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.384+0000 7fa057fff700 1 -- 172.21.15.71:0/1674734136 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa064013470 con 0x7fa070150180 2023-10-09T07:01:26.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.384+0000 7fa07559d700 1 -- 172.21.15.71:0/1674734136 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa070157bd0 con 0x7fa070150180 2023-10-09T07:01:26.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.385+0000 7fa07559d700 1 -- 172.21.15.71:0/1674734136 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0701580d0 con 0x7fa070150180 2023-10-09T07:01:26.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.386+0000 7fa057fff700 1 -- 172.21.15.71:0/1674734136 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa064013860 con 0x7fa070150180 2023-10-09T07:01:26.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.387+0000 7fa057fff700 1 --2- 172.21.15.71:0/1674734136 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa05c066f30 0x7fa05c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:26.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.387+0000 7fa057fff700 1 -- 172.21.15.71:0/1674734136 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6125+0+0 (secure 0 0 0) 0x7fa064084b40 con 0x7fa070150180 2023-10-09T07:01:26.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.387+0000 7fa06ffff700 1 --2- 172.21.15.71:0/1674734136 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa05c066f30 0x7fa05c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:26.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.388+0000 7fa06ffff700 1 --2- 172.21.15.71:0/1674734136 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa05c066f30 0x7fa05c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa060009d80 tx=0x7fa060008040 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:26.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.391+0000 7fa057fff700 1 -- 172.21.15.71:0/1674734136 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa064051b70 con 0x7fa070150180 2023-10-09T07:01:26.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.621+0000 7fa07559d700 1 -- 172.21.15.71:0/1674734136 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa07004c3c0 con 0x7fa070150180 2023-10-09T07:01:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.622+0000 7fa057fff700 1 -- 172.21.15.71:0/1674734136 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fa064055190 con 0x7fa070150180 2023-10-09T07:01:26.626 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:01:26.626 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/4239197200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":4239197200},{"type":"v1","addr":"172.21.15.179:6836","nonce":4239197200}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":8094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/645124077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":645124077},{"type":"v1","addr":"172.21.15.71:6833","nonce":645124077}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":8097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/542229353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":542229353},{"type":"v1","addr":"172.21.15.71:6835","nonce":542229353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:01:22.605100+0000","modified":"2023-10-09T07:01:26.163625+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/2229698291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2229698291},{"type":"v1","addr":"172.21.15.179:6834","nonce":2229698291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T07:01:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.624+0000 7fa07559d700 1 -- 172.21.15.71:0/1674734136 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa05c066f30 msgr2=0x7fa05c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.624+0000 7fa07559d700 1 --2- 172.21.15.71:0/1674734136 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa05c066f30 0x7fa05c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa060009d80 tx=0x7fa060008040 comp rx=0 tx=0).stop 2023-10-09T07:01:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.624+0000 7fa07559d700 1 -- 172.21.15.71:0/1674734136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa070150180 msgr2=0x7fa07014b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.624+0000 7fa07559d700 1 --2- 172.21.15.71:0/1674734136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa070150180 0x7fa07014b030 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fa06400ec80 tx=0x7fa0640091a0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.625+0000 7fa07559d700 1 -- 172.21.15.71:0/1674734136 shutdown_connections 2023-10-09T07:01:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.625+0000 7fa07559d700 1 --2- 172.21.15.71:0/1674734136 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa05c066f30 0x7fa05c0693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.625+0000 7fa07559d700 1 --2- 172.21.15.71:0/1674734136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa070150550 0x7fa0700696c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.625+0000 7fa07559d700 1 --2- 172.21.15.71:0/1674734136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0700c7240 0x7fa07016d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.625+0000 7fa07559d700 1 --2- 172.21.15.71:0/1674734136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa070150180 0x7fa07014b030 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.625+0000 7fa07559d700 1 -- 172.21.15.71:0/1674734136 >> 172.21.15.71:0/1674734136 conn(0x7fa0700cc1f0 msgr2=0x7fa0701562a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.625+0000 7fa07559d700 1 -- 172.21.15.71:0/1674734136 shutdown_connections 2023-10-09T07:01:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.625+0000 7fa07559d700 1 -- 172.21.15.71:0/1674734136 wait complete. 2023-10-09T07:01:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 66 2023-10-09T07:01:26.643 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:01:26.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.821+0000 7f5fd91ff700 1 Processor -- start 2023-10-09T07:01:26.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.821+0000 7f5fd91ff700 1 -- start start 2023-10-09T07:01:26.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.822+0000 7f5fd91ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5fd4155c10 0x7f5fd4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:26.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.822+0000 7f5fd91ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fd40ac230 0x7f5fd40ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:26.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.822+0000 7f5fd91ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd40ad930 con 0x7f5fd41568a0 2023-10-09T07:01:26.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.822+0000 7f5fd91ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd40acd20 con 0x7f5fd4155c10 2023-10-09T07:01:26.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.822+0000 7f5fd91ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd40ad000 con 0x7f5fd40ac230 2023-10-09T07:01:26.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.823+0000 7f5fd2d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5fd4155c10 0x7f5fd4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:26.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.823+0000 7f5fd2d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5fd4155c10 0x7f5fd4155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40068/0 (socket says 172.21.15.71:40068) 2023-10-09T07:01:26.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.823+0000 7f5fd2d9d700 1 -- 172.21.15.71:0/758224512 learned_addr learned my addr 172.21.15.71:0/758224512 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:26.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.823+0000 7f5fd259c700 1 --2- 172.21.15.71:0/758224512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fd40ac230 0x7f5fd40ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:26.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.823+0000 7f5fd2d9d700 1 -- 172.21.15.71:0/758224512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fd40ac230 msgr2=0x7f5fd40ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:26.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.823+0000 7f5fd2d9d700 1 --2- 172.21.15.71:0/758224512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fd40ac230 0x7f5fd40ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.823+0000 7f5fd2d9d700 1 -- 172.21.15.71:0/758224512 >> v1:172.21.15.179:6789/0 conn(0x7f5fd41568a0 legacy=0x7f5fd4156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:26.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.823+0000 7f5fd2d9d700 1 -- 172.21.15.71:0/758224512 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd40ad2e0 con 0x7f5fd4155c10 2023-10-09T07:01:26.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.823+0000 7f5fd259c700 1 --2- 172.21.15.71:0/758224512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fd40ac230 0x7f5fd40ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:01:26.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.823+0000 7f5fd2d9d700 1 --2- 172.21.15.71:0/758224512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fd4155c10 0x7f5fd4155fe0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400bc50 tx=0x7f5fc400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd7e13f38ac1220 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:26.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.824+0000 7f5fd1d9b700 1 -- 172.21.15.71:0/758224512 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc400be60 con 0x7f5fd4155c10 2023-10-09T07:01:26.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.824+0000 7f5fd1d9b700 1 -- 172.21.15.71:0/758224512 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc400ddc0 con 0x7f5fd4155c10 2023-10-09T07:01:26.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.824+0000 7f5fd1d9b700 1 -- 172.21.15.71:0/758224512 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc40106a0 con 0x7f5fd4155c10 2023-10-09T07:01:26.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.824+0000 7f5fd91ff700 1 -- 172.21.15.71:0/758224512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fd4155c10 msgr2=0x7f5fd4155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:26.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.824+0000 7f5fd91ff700 1 --2- 172.21.15.71:0/758224512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fd4155c10 0x7f5fd4155fe0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400bc50 tx=0x7f5fc400b4f0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.824+0000 7f5fd91ff700 1 -- 172.21.15.71:0/758224512 shutdown_connections 2023-10-09T07:01:26.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.824+0000 7f5fd91ff700 1 --2- 172.21.15.71:0/758224512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fd4155c10 0x7f5fd4155fe0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.824+0000 7f5fd91ff700 1 --2- 172.21.15.71:0/758224512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fd40ac230 0x7f5fd40ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.824+0000 7f5fd91ff700 1 -- 172.21.15.71:0/758224512 >> 172.21.15.71:0/758224512 conn(0x7f5fd406a320 msgr2=0x7f5fd40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:26.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.824+0000 7f5fd91ff700 1 -- 172.21.15.71:0/758224512 shutdown_connections 2023-10-09T07:01:26.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.824+0000 7f5fd91ff700 1 -- 172.21.15.71:0/758224512 wait complete. 2023-10-09T07:01:26.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.826+0000 7f5fd91ff700 1 Processor -- start 2023-10-09T07:01:26.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.826+0000 7f5fd91ff700 1 -- start start 2023-10-09T07:01:26.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.827+0000 7f5fd91ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fd40ac230 0x7f5fd40a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:26.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.827+0000 7f5fd91ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fd4155c10 0x7f5fd4169140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:26.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.827+0000 7f5fd91ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fd41568a0 0x7f5fd4169680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:26.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.827+0000 7f5fd91ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd40a6920 con 0x7f5fd4155c10 2023-10-09T07:01:26.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.827+0000 7f5fd91ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd40a6db0 con 0x7f5fd41568a0 2023-10-09T07:01:26.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.827+0000 7f5fd91ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd40a5d10 con 0x7f5fd40ac230 2023-10-09T07:01:26.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.827+0000 7f5fd259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fd4155c10 0x7f5fd4169140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:26.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.827+0000 7f5fd259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fd4155c10 0x7f5fd4169140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40078/0 (socket says 172.21.15.71:40078) 2023-10-09T07:01:26.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.827+0000 7f5fd259c700 1 -- 172.21.15.71:0/755596428 learned_addr learned my addr 172.21.15.71:0/755596428 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:26.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.827+0000 7f5fd259c700 1 -- 172.21.15.71:0/755596428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fd40ac230 msgr2=0x7f5fd40a54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:26.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.827+0000 7f5fd259c700 1 --2- 172.21.15.71:0/755596428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fd40ac230 0x7f5fd40a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.827+0000 7f5fd259c700 1 -- 172.21.15.71:0/755596428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fd41568a0 msgr2=0x7f5fd4169680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:26.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.827+0000 7f5fd259c700 1 --2- 172.21.15.71:0/755596428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fd41568a0 0x7f5fd4169680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:26.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.827+0000 7f5fd259c700 1 -- 172.21.15.71:0/755596428 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc400b790 con 0x7f5fd4155c10 2023-10-09T07:01:26.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.828+0000 7f5fd259c700 1 --2- 172.21.15.71:0/755596428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fd4155c10 0x7f5fd4169140 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f5fc800c830 tx=0x7f5fc8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:26.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.828+0000 7f5fbaffd700 1 -- 172.21.15.71:0/755596428 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8011600 con 0x7f5fd4155c10 2023-10-09T07:01:26.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.828+0000 7f5fbaffd700 1 -- 172.21.15.71:0/755596428 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc8011760 con 0x7f5fd4155c10 2023-10-09T07:01:26.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.828+0000 7f5fd91ff700 1 -- 172.21.15.71:0/755596428 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd40a5ff0 con 0x7f5fd4155c10 2023-10-09T07:01:26.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.828+0000 7f5fbaffd700 1 -- 172.21.15.71:0/755596428 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8011b20 con 0x7f5fd4155c10 2023-10-09T07:01:26.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.828+0000 7f5fd91ff700 1 -- 172.21.15.71:0/755596428 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd40a65b0 con 0x7f5fd4155c10 2023-10-09T07:01:26.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.829+0000 7f5fd91ff700 1 -- 172.21.15.71:0/755596428 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd404c3c0 con 0x7f5fd4155c10 2023-10-09T07:01:26.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.830+0000 7f5fbaffd700 1 -- 172.21.15.71:0/755596428 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5fc800a3e0 con 0x7f5fd4155c10 2023-10-09T07:01:26.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.831+0000 7f5fbaffd700 1 --2- 172.21.15.71:0/755596428 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5fc0066f60 0x7f5fc0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:26.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.831+0000 7f5fbaffd700 1 -- 172.21.15.71:0/755596428 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f5fc8084b70 con 0x7f5fd4155c10 2023-10-09T07:01:26.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.832+0000 7f5fd2d9d700 1 --2- 172.21.15.71:0/755596428 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5fc0066f60 0x7f5fc0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:26.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.832+0000 7f5fd2d9d700 1 --2- 172.21.15.71:0/755596428 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5fc0066f60 0x7f5fc0069410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400bc50 tx=0x7f5fc401a000 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:26.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:26.836+0000 7f5fbaffd700 1 -- 172.21.15.71:0/755596428 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fc8051c40 con 0x7f5fd4155c10 2023-10-09T07:01:27.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.027+0000 7f5fd91ff700 1 -- 172.21.15.71:0/755596428 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fd40a6a60 con 0x7f5fd4155c10 2023-10-09T07:01:27.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.028+0000 7f5fbaffd700 1 -- 172.21.15.71:0/755596428 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+16003 (secure 0 0 0) 0x7f5fc8015090 con 0x7f5fd4155c10 2023-10-09T07:01:27.029 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:01:27.029 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":137,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:01:24.142704+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:01:20.274329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T07:01:21.592220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:01:27.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.030+0000 7f5fd91ff700 1 -- 172.21.15.71:0/755596428 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5fc0066f60 msgr2=0x7f5fc0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:27.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.030+0000 7f5fd91ff700 1 --2- 172.21.15.71:0/755596428 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5fc0066f60 0x7f5fc0069410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400bc50 tx=0x7f5fc401a000 comp rx=0 tx=0).stop 2023-10-09T07:01:27.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.030+0000 7f5fd91ff700 1 -- 172.21.15.71:0/755596428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fd4155c10 msgr2=0x7f5fd4169140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:27.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.030+0000 7f5fd91ff700 1 --2- 172.21.15.71:0/755596428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fd4155c10 0x7f5fd4169140 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f5fc800c830 tx=0x7f5fc8008040 comp rx=0 tx=0).stop 2023-10-09T07:01:27.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.030+0000 7f5fd91ff700 1 -- 172.21.15.71:0/755596428 shutdown_connections 2023-10-09T07:01:27.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.030+0000 7f5fd91ff700 1 --2- 172.21.15.71:0/755596428 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5fc0066f60 0x7f5fc0069410 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.030+0000 7f5fd91ff700 1 --2- 172.21.15.71:0/755596428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fd41568a0 0x7f5fd4169680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.030+0000 7f5fd91ff700 1 --2- 172.21.15.71:0/755596428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fd40ac230 0x7f5fd40a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.030+0000 7f5fd91ff700 1 --2- 172.21.15.71:0/755596428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fd4155c10 0x7f5fd4169140 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.030+0000 7f5fd91ff700 1 -- 172.21.15.71:0/755596428 >> 172.21.15.71:0/755596428 conn(0x7f5fd406a320 msgr2=0x7f5fd40aba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:27.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.030+0000 7f5fd91ff700 1 -- 172.21.15.71:0/755596428 shutdown_connections 2023-10-09T07:01:27.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.030+0000 7f5fd91ff700 1 -- 172.21.15.71:0/755596428 wait complete. 2023-10-09T07:01:27.049 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T07:01:27.049 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T07:01:27.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.231+0000 7ff7ff5ff700 1 Processor -- start 2023-10-09T07:01:27.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.231+0000 7ff7ff5ff700 1 -- start start 2023-10-09T07:01:27.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.232+0000 7ff7ff5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff7f8155c10 0x7ff7f8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:27.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.232+0000 7ff7ff5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7f80ac230 0x7ff7f80ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:27.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.232+0000 7ff7ff5ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f80ad930 con 0x7ff7f81568a0 2023-10-09T07:01:27.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.232+0000 7ff7ff5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f80acd20 con 0x7ff7f8155c10 2023-10-09T07:01:27.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.232+0000 7ff7ff5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f80ad000 con 0x7ff7f80ac230 2023-10-09T07:01:27.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.232+0000 7ff7fdb9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff7f81568a0 0x7ff7f8156cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57624/0 (socket says 172.21.15.71:57624) 2023-10-09T07:01:27.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.232+0000 7ff7fdb9c700 1 -- 172.21.15.71:0/1304684816 learned_addr learned my addr 172.21.15.71:0/1304684816 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:01:27.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.232+0000 7ff7fcb9a700 1 --2- 172.21.15.71:0/1304684816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7f80ac230 0x7ff7f80ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:27.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.232+0000 7ff7fd39b700 1 --2- 172.21.15.71:0/1304684816 >> v2:172.21.15.179:3300/0 conn(0x7ff7f8155c10 0x7ff7f8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:27.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.233+0000 7ff7effff700 1 -- 172.21.15.71:0/1304684816 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2125924416 0 0) 0x7ff7f80ad930 con 0x7ff7f81568a0 2023-10-09T07:01:27.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.233+0000 7ff7effff700 1 -- 172.21.15.71:0/1304684816 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7e4003570 con 0x7ff7f81568a0 2023-10-09T07:01:27.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.233+0000 7ff7fcb9a700 1 -- 172.21.15.71:0/1304684816 >> v2:172.21.15.179:3300/0 conn(0x7ff7f8155c10 msgr2=0x7ff7f8155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:27.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.233+0000 7ff7fcb9a700 1 --2- 172.21.15.71:0/1304684816 >> v2:172.21.15.179:3300/0 conn(0x7ff7f8155c10 0x7ff7f8155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.233+0000 7ff7fcb9a700 1 -- 172.21.15.71:0/1304684816 >> v1:172.21.15.71:6789/0 conn(0x7ff7f81568a0 legacy=0x7ff7f8156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:27.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.233+0000 7ff7fcb9a700 1 -- 172.21.15.71:0/1304684816 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f80ad2e0 con 0x7ff7f80ac230 2023-10-09T07:01:27.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.233+0000 7ff7fcb9a700 1 --2- 172.21.15.71:0/1304684816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7f80ac230 0x7ff7f80ac6a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80098e0 tx=0x7ff7e80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7900a0b24c6b8f76 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:27.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.234+0000 7ff7effff700 1 -- 172.21.15.71:0/1304684816 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8011630 con 0x7ff7f80ac230 2023-10-09T07:01:27.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.234+0000 7ff7effff700 1 -- 172.21.15.71:0/1304684816 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e8011790 con 0x7ff7f80ac230 2023-10-09T07:01:27.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.234+0000 7ff7effff700 1 -- 172.21.15.71:0/1304684816 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8011b30 con 0x7ff7f80ac230 2023-10-09T07:01:27.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.234+0000 7ff7ff5ff700 1 -- 172.21.15.71:0/1304684816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7f80ac230 msgr2=0x7ff7f80ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:27.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.234+0000 7ff7ff5ff700 1 --2- 172.21.15.71:0/1304684816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7f80ac230 0x7ff7f80ac6a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80098e0 tx=0x7ff7e80091a0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.234+0000 7ff7ff5ff700 1 -- 172.21.15.71:0/1304684816 shutdown_connections 2023-10-09T07:01:27.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.234+0000 7ff7ff5ff700 1 --2- 172.21.15.71:0/1304684816 >> v2:172.21.15.179:3300/0 conn(0x7ff7f8155c10 0x7ff7f8155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.234+0000 7ff7ff5ff700 1 --2- 172.21.15.71:0/1304684816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7f80ac230 0x7ff7f80ac6a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.234+0000 7ff7ff5ff700 1 -- 172.21.15.71:0/1304684816 >> 172.21.15.71:0/1304684816 conn(0x7ff7f806a320 msgr2=0x7ff7f80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:27.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.234+0000 7ff7ff5ff700 1 -- 172.21.15.71:0/1304684816 shutdown_connections 2023-10-09T07:01:27.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.234+0000 7ff7ff5ff700 1 -- 172.21.15.71:0/1304684816 wait complete. 2023-10-09T07:01:27.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.236+0000 7ff7ff5ff700 1 Processor -- start 2023-10-09T07:01:27.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.236+0000 7ff7ff5ff700 1 -- start start 2023-10-09T07:01:27.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.237+0000 7ff7ff5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7f80ac230 0x7ff7f8143140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:27.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.237+0000 7ff7ff5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7f8155c10 0x7ff7f8142020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.237+0000 7ff7ff5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f81568a0 0x7ff7f8147c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.237+0000 7ff7ff5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f8143680 con 0x7ff7f80ac230 2023-10-09T07:01:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.237+0000 7ff7ff5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f8142560 con 0x7ff7f81568a0 2023-10-09T07:01:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.237+0000 7ff7ff5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f8145d00 con 0x7ff7f8155c10 2023-10-09T07:01:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.237+0000 7ff7fd39b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7f80ac230 0x7ff7f8143140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.237+0000 7ff7fd39b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7f80ac230 0x7ff7f8143140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40082/0 (socket says 172.21.15.71:40082) 2023-10-09T07:01:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.237+0000 7ff7fd39b700 1 -- 172.21.15.71:0/1969931618 learned_addr learned my addr 172.21.15.71:0/1969931618 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.237+0000 7ff7fdb9c700 1 --2- 172.21.15.71:0/1969931618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f81568a0 0x7ff7f8147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.237+0000 7ff7fcb9a700 1 --2- 172.21.15.71:0/1969931618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7f8155c10 0x7ff7f8142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.237+0000 7ff7fd39b700 1 -- 172.21.15.71:0/1969931618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7f8155c10 msgr2=0x7ff7f8142020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.237+0000 7ff7fd39b700 1 --2- 172.21.15.71:0/1969931618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7f8155c10 0x7ff7f8142020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.237+0000 7ff7fd39b700 1 -- 172.21.15.71:0/1969931618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f81568a0 msgr2=0x7ff7f8147c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:27.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.237+0000 7ff7fd39b700 1 --2- 172.21.15.71:0/1969931618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f81568a0 0x7ff7f8147c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.237+0000 7ff7fd39b700 1 -- 172.21.15.71:0/1969931618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e8009420 con 0x7ff7f80ac230 2023-10-09T07:01:27.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.238+0000 7ff7fd39b700 1 --2- 172.21.15.71:0/1969931618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7f80ac230 0x7ff7f8143140 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400ec80 tx=0x7ff7f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:27.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.238+0000 7ff7ed7fa700 1 -- 172.21.15.71:0/1969931618 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f400c9d0 con 0x7ff7f80ac230 2023-10-09T07:01:27.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.238+0000 7ff7ed7fa700 1 -- 172.21.15.71:0/1969931618 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f400cb30 con 0x7ff7f80ac230 2023-10-09T07:01:27.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.238+0000 7ff7ed7fa700 1 -- 172.21.15.71:0/1969931618 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4013470 con 0x7ff7f80ac230 2023-10-09T07:01:27.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.238+0000 7ff7ff5ff700 1 -- 172.21.15.71:0/1969931618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f8145fe0 con 0x7ff7f80ac230 2023-10-09T07:01:27.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.238+0000 7ff7ff5ff700 1 -- 172.21.15.71:0/1969931618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f81465a0 con 0x7ff7f80ac230 2023-10-09T07:01:27.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.239+0000 7ff7ff5ff700 1 -- 172.21.15.71:0/1969931618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f8146bf0 con 0x7ff7f80ac230 2023-10-09T07:01:27.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.240+0000 7ff7ed7fa700 1 -- 172.21.15.71:0/1969931618 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff7f4013820 con 0x7ff7f80ac230 2023-10-09T07:01:27.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.241+0000 7ff7ed7fa700 1 --2- 172.21.15.71:0/1969931618 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff7dc066f30 0x7ff7dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:27.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.241+0000 7ff7ed7fa700 1 -- 172.21.15.71:0/1969931618 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6125+0+0 (secure 0 0 0) 0x7ff7f4084a60 con 0x7ff7f80ac230 2023-10-09T07:01:27.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.241+0000 7ff7fcb9a700 1 --2- 172.21.15.71:0/1969931618 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff7dc066f30 0x7ff7dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:27.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.242+0000 7ff7fcb9a700 1 --2- 172.21.15.71:0/1969931618 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff7dc066f30 0x7ff7dc0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80091e0 tx=0x7ff7e8017000 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:27.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.245+0000 7ff7ed7fa700 1 -- 172.21.15.71:0/1969931618 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7f4051b30 con 0x7ff7f80ac230 2023-10-09T07:01:27.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.433+0000 7ff7ff5ff700 1 -- 172.21.15.71:0/1969931618 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff7f804c3c0 con 0x7ff7dc066f30 2023-10-09T07:01:27.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.444+0000 7ff7ed7fa700 1 -- 172.21.15.71:0/1969931618 <== mgr.7627 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277892 (secure 0 0 0) 0x7ff7f804c3c0 con 0x7ff7dc066f30 2023-10-09T07:01:27.448 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:01:27.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.448+0000 7ff7ff5ff700 1 -- 172.21.15.71:0/1969931618 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff7dc066f30 msgr2=0x7ff7dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:27.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.448+0000 7ff7ff5ff700 1 --2- 172.21.15.71:0/1969931618 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff7dc066f30 0x7ff7dc0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80091e0 tx=0x7ff7e8017000 comp rx=0 tx=0).stop 2023-10-09T07:01:27.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.448+0000 7ff7ff5ff700 1 -- 172.21.15.71:0/1969931618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7f80ac230 msgr2=0x7ff7f8143140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:27.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.448+0000 7ff7ff5ff700 1 --2- 172.21.15.71:0/1969931618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7f80ac230 0x7ff7f8143140 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400ec80 tx=0x7ff7f40091a0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.448+0000 7ff7ff5ff700 1 -- 172.21.15.71:0/1969931618 shutdown_connections 2023-10-09T07:01:27.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.448+0000 7ff7ff5ff700 1 --2- 172.21.15.71:0/1969931618 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff7dc066f30 0x7ff7dc0693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.448+0000 7ff7ff5ff700 1 --2- 172.21.15.71:0/1969931618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f81568a0 0x7ff7f8147c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.448+0000 7ff7ff5ff700 1 --2- 172.21.15.71:0/1969931618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7f80ac230 0x7ff7f8143140 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.448+0000 7ff7ff5ff700 1 --2- 172.21.15.71:0/1969931618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7f8155c10 0x7ff7f8142020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.448+0000 7ff7ff5ff700 1 -- 172.21.15.71:0/1969931618 >> 172.21.15.71:0/1969931618 conn(0x7ff7f806a320 msgr2=0x7ff7f806e570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:27.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.448+0000 7ff7ff5ff700 1 -- 172.21.15.71:0/1969931618 shutdown_connections 2023-10-09T07:01:27.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.448+0000 7ff7ff5ff700 1 -- 172.21.15.71:0/1969931618 wait complete. 2023-10-09T07:01:27.452 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T07:01:27.466 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-09T07:01:26.076092+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":423,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":266,"ondisk_log_size":266,"up":46,"acting":46,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":2445720,"kb_used_data":14168,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752529000,"statfs":{"total":773094113280,"available":770589696000,"internally_reserved":0,"allocated":14508032,"data_stored":7713044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.945357"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.155043+0000","last_change":"2023-10-09T07:01:23.151380+0000","last_active":"2023-10-09T07:01:23.155043+0000","last_peered":"2023-10-09T07:01:23.155043+0000","last_clean":"2023-10-09T07:01:23.155043+0000","last_became_active":"2023-10-09T07:01:23.151124+0000","last_became_peered":"2023-10-09T07:01:23.151124+0000","last_unstale":"2023-10-09T07:01:23.155043+0000","last_undegraded":"2023-10-09T07:01:23.155043+0000","last_fullsized":"2023-10-09T07:01:23.155043+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:42:28.704095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.155518+0000","last_change":"2023-10-09T07:01:23.151375+0000","last_active":"2023-10-09T07:01:23.155518+0000","last_peered":"2023-10-09T07:01:23.155518+0000","last_clean":"2023-10-09T07:01:23.155518+0000","last_became_active":"2023-10-09T07:01:23.151112+0000","last_became_peered":"2023-10-09T07:01:23.151112+0000","last_unstale":"2023-10-09T07:01:23.155518+0000","last_undegraded":"2023-10-09T07:01:23.155518+0000","last_fullsized":"2023-10-09T07:01:23.155518+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:04.781425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168542+0000","last_change":"2023-10-09T07:01:23.164581+0000","last_active":"2023-10-09T07:01:23.168542+0000","last_peered":"2023-10-09T07:01:23.168542+0000","last_clean":"2023-10-09T07:01:23.168542+0000","last_became_active":"2023-10-09T07:01:23.164337+0000","last_became_peered":"2023-10-09T07:01:23.164337+0000","last_unstale":"2023-10-09T07:01:23.168542+0000","last_undegraded":"2023-10-09T07:01:23.168542+0000","last_fullsized":"2023-10-09T07:01:23.168542+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:16.117929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.167499+0000","last_change":"2023-10-09T07:01:23.163460+0000","last_active":"2023-10-09T07:01:23.167499+0000","last_peered":"2023-10-09T07:01:23.167499+0000","last_clean":"2023-10-09T07:01:23.167499+0000","last_became_active":"2023-10-09T07:01:23.163219+0000","last_became_peered":"2023-10-09T07:01:23.163219+0000","last_unstale":"2023-10-09T07:01:23.167499+0000","last_undegraded":"2023-10-09T07:01:23.167499+0000","last_fullsized":"2023-10-09T07:01:23.167499+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:35.224469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160700+0000","last_change":"2023-10-09T07:01:22.146764+0000","last_active":"2023-10-09T07:01:23.160700+0000","last_peered":"2023-10-09T07:01:23.160700+0000","last_clean":"2023-10-09T07:01:23.160700+0000","last_became_active":"2023-10-09T07:01:22.146458+0000","last_became_peered":"2023-10-09T07:01:22.146458+0000","last_unstale":"2023-10-09T07:01:23.160700+0000","last_undegraded":"2023-10-09T07:01:23.160700+0000","last_fullsized":"2023-10-09T07:01:23.160700+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:20:50.395740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.167923+0000","last_change":"2023-10-09T07:01:22.147417+0000","last_active":"2023-10-09T07:01:23.167923+0000","last_peered":"2023-10-09T07:01:23.167923+0000","last_clean":"2023-10-09T07:01:23.167923+0000","last_became_active":"2023-10-09T07:01:22.147144+0000","last_became_peered":"2023-10-09T07:01:22.147144+0000","last_unstale":"2023-10-09T07:01:23.167923+0000","last_undegraded":"2023-10-09T07:01:23.167923+0000","last_fullsized":"2023-10-09T07:01:23.167923+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:36:25.395738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.162203+0000","last_change":"2023-10-09T07:01:22.146261+0000","last_active":"2023-10-09T07:01:23.162203+0000","last_peered":"2023-10-09T07:01:23.162203+0000","last_clean":"2023-10-09T07:01:23.162203+0000","last_became_active":"2023-10-09T07:01:22.146020+0000","last_became_peered":"2023-10-09T07:01:22.146020+0000","last_unstale":"2023-10-09T07:01:23.162203+0000","last_undegraded":"2023-10-09T07:01:23.162203+0000","last_fullsized":"2023-10-09T07:01:23.162203+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:03:31.346374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.139944+0000","last_change":"2023-10-09T07:01:22.150785+0000","last_active":"2023-10-09T07:01:23.139944+0000","last_peered":"2023-10-09T07:01:23.139944+0000","last_clean":"2023-10-09T07:01:23.139944+0000","last_became_active":"2023-10-09T07:01:22.150522+0000","last_became_peered":"2023-10-09T07:01:22.150522+0000","last_unstale":"2023-10-09T07:01:23.139944+0000","last_undegraded":"2023-10-09T07:01:23.139944+0000","last_fullsized":"2023-10-09T07:01:23.139944+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:05.488682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.141723+0000","last_change":"2023-10-09T07:01:22.146917+0000","last_active":"2023-10-09T07:01:23.141723+0000","last_peered":"2023-10-09T07:01:23.141723+0000","last_clean":"2023-10-09T07:01:23.141723+0000","last_became_active":"2023-10-09T07:01:22.146680+0000","last_became_peered":"2023-10-09T07:01:22.146680+0000","last_unstale":"2023-10-09T07:01:23.141723+0000","last_undegraded":"2023-10-09T07:01:23.141723+0000","last_fullsized":"2023-10-09T07:01:23.141723+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:27.481750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.161105+0000","last_change":"2023-10-09T07:01:23.159690+0000","last_active":"2023-10-09T07:01:23.161105+0000","last_peered":"2023-10-09T07:01:23.161105+0000","last_clean":"2023-10-09T07:01:23.161105+0000","last_became_active":"2023-10-09T07:01:23.159405+0000","last_became_peered":"2023-10-09T07:01:23.159405+0000","last_unstale":"2023-10-09T07:01:23.161105+0000","last_undegraded":"2023-10-09T07:01:23.161105+0000","last_fullsized":"2023-10-09T07:01:23.161105+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:44.249505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.157869+0000","last_change":"2023-10-09T07:01:23.153614+0000","last_active":"2023-10-09T07:01:23.157869+0000","last_peered":"2023-10-09T07:01:23.157869+0000","last_clean":"2023-10-09T07:01:23.157869+0000","last_became_active":"2023-10-09T07:01:23.153365+0000","last_became_peered":"2023-10-09T07:01:23.153365+0000","last_unstale":"2023-10-09T07:01:23.157869+0000","last_undegraded":"2023-10-09T07:01:23.157869+0000","last_fullsized":"2023-10-09T07:01:23.157869+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:50.435038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168371+0000","last_change":"2023-10-09T07:01:23.164674+0000","last_active":"2023-10-09T07:01:23.168371+0000","last_peered":"2023-10-09T07:01:23.168371+0000","last_clean":"2023-10-09T07:01:23.168371+0000","last_became_active":"2023-10-09T07:01:23.164428+0000","last_became_peered":"2023-10-09T07:01:23.164428+0000","last_unstale":"2023-10-09T07:01:23.168371+0000","last_undegraded":"2023-10-09T07:01:23.168371+0000","last_fullsized":"2023-10-09T07:01:23.168371+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:01:34.945426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.162854+0000","last_change":"2023-10-09T07:01:23.161420+0000","last_active":"2023-10-09T07:01:23.162854+0000","last_peered":"2023-10-09T07:01:23.162854+0000","last_clean":"2023-10-09T07:01:23.162854+0000","last_became_active":"2023-10-09T07:01:23.161160+0000","last_became_peered":"2023-10-09T07:01:23.161160+0000","last_unstale":"2023-10-09T07:01:23.162854+0000","last_undegraded":"2023-10-09T07:01:23.162854+0000","last_fullsized":"2023-10-09T07:01:23.162854+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:33:26.130071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"136'8","reported_seq":18,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.172132+0000","last_change":"2023-10-09T07:01:22.146719+0000","last_active":"2023-10-09T07:01:23.172132+0000","last_peered":"2023-10-09T07:01:23.172132+0000","last_clean":"2023-10-09T07:01:23.172132+0000","last_became_active":"2023-10-09T07:01:22.146438+0000","last_became_peered":"2023-10-09T07:01:22.146438+0000","last_unstale":"2023-10-09T07:01:23.172132+0000","last_undegraded":"2023-10-09T07:01:23.172132+0000","last_fullsized":"2023-10-09T07:01:23.172132+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:59.902976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166403+0000","last_change":"2023-10-09T07:01:23.163188+0000","last_active":"2023-10-09T07:01:23.166403+0000","last_peered":"2023-10-09T07:01:23.166403+0000","last_clean":"2023-10-09T07:01:23.166403+0000","last_became_active":"2023-10-09T07:01:23.162774+0000","last_became_peered":"2023-10-09T07:01:23.162774+0000","last_unstale":"2023-10-09T07:01:23.166403+0000","last_undegraded":"2023-10-09T07:01:23.166403+0000","last_fullsized":"2023-10-09T07:01:23.166403+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:26:58.267604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.164502+0000","last_change":"2023-10-09T07:01:22.147563+0000","last_active":"2023-10-09T07:01:23.164502+0000","last_peered":"2023-10-09T07:01:23.164502+0000","last_clean":"2023-10-09T07:01:23.164502+0000","last_became_active":"2023-10-09T07:01:22.147281+0000","last_became_peered":"2023-10-09T07:01:22.147281+0000","last_unstale":"2023-10-09T07:01:23.164502+0000","last_undegraded":"2023-10-09T07:01:23.164502+0000","last_fullsized":"2023-10-09T07:01:23.164502+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:29.107018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.141899+0000","last_change":"2023-10-09T07:01:22.150874+0000","last_active":"2023-10-09T07:01:23.141899+0000","last_peered":"2023-10-09T07:01:23.141899+0000","last_clean":"2023-10-09T07:01:23.141899+0000","last_became_active":"2023-10-09T07:01:22.150612+0000","last_became_peered":"2023-10-09T07:01:22.150612+0000","last_unstale":"2023-10-09T07:01:23.141899+0000","last_undegraded":"2023-10-09T07:01:23.141899+0000","last_fullsized":"2023-10-09T07:01:23.141899+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:44:39.274431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.167911+0000","last_change":"2023-10-09T07:01:23.162779+0000","last_active":"2023-10-09T07:01:23.167911+0000","last_peered":"2023-10-09T07:01:23.167911+0000","last_clean":"2023-10-09T07:01:23.167911+0000","last_became_active":"2023-10-09T07:01:23.162539+0000","last_became_peered":"2023-10-09T07:01:23.162539+0000","last_unstale":"2023-10-09T07:01:23.167911+0000","last_undegraded":"2023-10-09T07:01:23.167911+0000","last_fullsized":"2023-10-09T07:01:23.167911+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:11:24.045926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169665+0000","last_change":"2023-10-09T07:01:22.149834+0000","last_active":"2023-10-09T07:01:23.169665+0000","last_peered":"2023-10-09T07:01:23.169665+0000","last_clean":"2023-10-09T07:01:23.169665+0000","last_became_active":"2023-10-09T07:01:22.149582+0000","last_became_peered":"2023-10-09T07:01:22.149582+0000","last_unstale":"2023-10-09T07:01:23.169665+0000","last_undegraded":"2023-10-09T07:01:23.169665+0000","last_fullsized":"2023-10-09T07:01:23.169665+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:27:24.455676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.141130+0000","last_change":"2023-10-09T07:01:22.150757+0000","last_active":"2023-10-09T07:01:23.141130+0000","last_peered":"2023-10-09T07:01:23.141130+0000","last_clean":"2023-10-09T07:01:23.141130+0000","last_became_active":"2023-10-09T07:01:22.150082+0000","last_became_peered":"2023-10-09T07:01:22.150082+0000","last_unstale":"2023-10-09T07:01:23.141130+0000","last_undegraded":"2023-10-09T07:01:23.141130+0000","last_fullsized":"2023-10-09T07:01:23.141130+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:12:37.048446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.141795+0000","last_change":"2023-10-09T07:01:22.148410+0000","last_active":"2023-10-09T07:01:23.141795+0000","last_peered":"2023-10-09T07:01:23.141795+0000","last_clean":"2023-10-09T07:01:23.141795+0000","last_became_active":"2023-10-09T07:01:22.148163+0000","last_became_peered":"2023-10-09T07:01:22.148163+0000","last_unstale":"2023-10-09T07:01:23.141795+0000","last_undegraded":"2023-10-09T07:01:23.141795+0000","last_fullsized":"2023-10-09T07:01:23.141795+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:38.775384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.157844+0000","last_change":"2023-10-09T07:01:23.155358+0000","last_active":"2023-10-09T07:01:23.157844+0000","last_peered":"2023-10-09T07:01:23.157844+0000","last_clean":"2023-10-09T07:01:23.157844+0000","last_became_active":"2023-10-09T07:01:23.155054+0000","last_became_peered":"2023-10-09T07:01:23.155054+0000","last_unstale":"2023-10-09T07:01:23.157844+0000","last_undegraded":"2023-10-09T07:01:23.157844+0000","last_fullsized":"2023-10-09T07:01:23.157844+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:27:50.013074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"127'249","reported_seq":727,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T07:01:12.685554+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T07:01:12.685554+0000","last_peered":"2023-10-09T07:01:12.685554+0000","last_clean":"2023-10-09T07:01:12.685554+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T07:01:12.685554+0000","last_undegraded":"2023-10-09T07:01:12.685554+0000","last_fullsized":"2023-10-09T07:01:12.685554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":22,"acting":22,"num_store_stats":2},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":22,"acting":22,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575069,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303576,"kb_used_data":2192,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068264,"statfs":{"total":96636764160,"available":96325902336,"internally_reserved":0,"allocated":2244608,"data_stored":1400006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68200000000000005,"15min":0.70399999999999996},"min":{"1min":0.46800000000000003,"5min":0.44700000000000001,"15min":0.316},"max":{"1min":0.91100000000000003,"5min":1.0960000000000001,"15min":1.732},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69399999999999995,"15min":0.71699999999999997},"min":{"1min":0.443,"5min":0.44,"15min":0.29999999999999999},"max":{"1min":0.94299999999999995,"5min":1.22,"15min":1.22},"last":0.68899999999999995}]},{"osd":1,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.67100000000000004,"15min":0.70599999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.379},"max":{"1min":1.004,"5min":1.004,"15min":2.3559999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69199999999999995,"15min":0.71999999999999997},"min":{"1min":0.52400000000000002,"5min":0.45700000000000002,"15min":0.40200000000000002},"max":{"1min":0.875,"5min":0.998,"15min":1.7869999999999999},"last":0.57299999999999995}]},{"osd":2,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69999999999999996,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.46300000000000002,"15min":0.44900000000000001},"max":{"1min":0.85599999999999998,"5min":0.98399999999999999,"15min":1.9430000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69999999999999996,"15min":0.73999999999999999},"min":{"1min":0.50600000000000001,"5min":0.48199999999999998,"15min":0.44900000000000001},"max":{"1min":0.98299999999999998,"5min":1.262,"15min":2.6629999999999998},"last":0.64700000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69099999999999995,"15min":0.71299999999999997},"min":{"1min":0.53500000000000003,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.749},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.88300000000000001,"5min":1.0569999999999999,"15min":1.827},"last":0.67300000000000004}]},{"osd":4,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.622,"15min":0.60099999999999998},"min":{"1min":0.44400000000000001,"5min":0.35299999999999998,"15min":0.35099999999999998},"max":{"1min":0.93999999999999995,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.42399999999999999,"5min":0.40300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79600000000000004,"5min":1.1850000000000001,"15min":2.577},"last":0.65800000000000003}]},{"osd":5,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66500000000000004,"15min":0.66600000000000004},"min":{"1min":0.48199999999999998,"5min":0.40699999999999997,"15min":0.40100000000000002},"max":{"1min":0.92900000000000005,"5min":1.0960000000000001,"15min":2.5169999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68500000000000005,"15min":0.69799999999999995},"min":{"1min":0.495,"5min":0.46500000000000002,"15min":0.45200000000000001},"max":{"1min":0.83899999999999997,"5min":1.141,"15min":2.9590000000000001},"last":0.80700000000000005}]},{"osd":6,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.748},"min":{"1min":0.54000000000000004,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89100000000000001,"5min":1.1000000000000001,"15min":3.0019999999999998},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.498,"5min":0.374,"15min":0.374},"max":{"1min":0.94199999999999995,"5min":1.0740000000000001,"15min":2.4039999999999999},"last":0.75700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575068,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302996,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068844,"statfs":{"total":96636764160,"available":96326496256,"internally_reserved":0,"allocated":1650688,"data_stored":809638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.69199999999999995,"15min":0.71199999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86799999999999999,"5min":1.238,"15min":1.238},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66000000000000003,"15min":0.69999999999999996},"min":{"1min":0.439,"5min":0.41899999999999998,"15min":0.36599999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.079},"last":0.48099999999999998}]},{"osd":1,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68000000000000005,"15min":0.71699999999999997},"min":{"1min":0.45100000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.83299999999999996,"5min":0.97199999999999998,"15min":1.135},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.016,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.65500000000000003}]},{"osd":2,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.73299999999999998},"min":{"1min":0.51100000000000001,"5min":0.438,"15min":0.42599999999999999},"max":{"1min":0.96799999999999997,"5min":1.0109999999999999,"15min":1.391},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69799999999999995,"15min":0.73099999999999998},"min":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.109,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.68600000000000005}]},{"osd":3,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.68500000000000005,"15min":0.70399999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.40600000000000003},"max":{"1min":0.86599999999999999,"5min":0.98099999999999998,"15min":1.0069999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.70699999999999996,"15min":0.75},"min":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.497},"max":{"1min":0.86299999999999999,"5min":1.0169999999999999,"15min":1.4750000000000001},"last":0.58799999999999997}]},{"osd":4,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60799999999999998,"15min":0.61899999999999999},"min":{"1min":0.45200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.871,"5min":1.329,"15min":1.768},"last":0.38},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63,"15min":0.623},"min":{"1min":0.44900000000000001,"5min":0.39100000000000001,"15min":0.36199999999999999},"max":{"1min":0.84599999999999997,"5min":0.98399999999999999,"15min":1.601},"last":0.67200000000000004}]},{"osd":5,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.40200000000000002},"max":{"1min":0.82299999999999995,"5min":1.0149999999999999,"15min":1.7609999999999999},"last":0.498},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.69199999999999995,"15min":0.69399999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91100000000000003,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.71099999999999997}]},{"osd":7,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67800000000000005,"15min":0.67900000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91400000000000003,"5min":1.046,"15min":1.2949999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.72699999999999998},"min":{"1min":0.52300000000000002,"5min":0.45300000000000001,"15min":0.42399999999999999},"max":{"1min":0.997,"5min":1.054,"15min":1.8320000000000001},"last":0.54700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575069,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302996,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068844,"statfs":{"total":96636764160,"available":96326496256,"internally_reserved":0,"allocated":1650688,"data_stored":809638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45000000000000001,"15min":0.45700000000000002},"min":{"1min":0.33800000000000002,"5min":0.26600000000000001,"15min":0.25900000000000001},"max":{"1min":0.67700000000000005,"5min":2.153,"15min":2.153},"last":0.436},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.36299999999999999,"5min":0.29399999999999998,"15min":0.26300000000000001},"max":{"1min":0.77300000000000002,"5min":1.1879999999999999,"15min":1.23},"last":0.42099999999999999}]},{"osd":2,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.68999999999999995,"5min":0.72199999999999998,"15min":1.169},"last":0.504},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56399999999999995,"15min":0.57699999999999996},"min":{"1min":0.441,"5min":0.38300000000000001,"15min":0.34100000000000003},"max":{"1min":0.73499999999999999,"5min":1.3500000000000001,"15min":3.077},"last":0.53700000000000003}]},{"osd":3,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59799999999999998,"15min":0.60999999999999999},"min":{"1min":0.47799999999999998,"5min":0.40000000000000002,"15min":0.376},"max":{"1min":0.77900000000000003,"5min":1.6839999999999999,"15min":1.7709999999999999},"last":0.495},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":0.79000000000000004,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.51300000000000001}]},{"osd":4,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.748,"15min":0.755},"min":{"1min":0.56499999999999995,"5min":0.46700000000000003,"15min":0.38700000000000001},"max":{"1min":1.069,"5min":1.069,"15min":1.6739999999999999},"last":0.754},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.58099999999999996,"5min":0.51200000000000001,"15min":0.48599999999999999},"max":{"1min":0.98999999999999999,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.81999999999999995}]},{"osd":5,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.54000000000000004,"5min":0.53400000000000003,"15min":0.48099999999999998},"max":{"1min":1.016,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.749,"15min":0.77000000000000002},"min":{"1min":0.56499999999999995,"5min":0.52100000000000002,"15min":0.47999999999999998},"max":{"1min":0.98399999999999999,"5min":1.1040000000000001,"15min":1.637},"last":0.71399999999999997}]},{"osd":6,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79300000000000004,"15min":0.79800000000000004},"min":{"1min":0.626,"5min":0.54600000000000004,"15min":0.48399999999999999},"max":{"1min":1.2769999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.626,"5min":0.504,"15min":0.504},"max":{"1min":0.96399999999999997,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.626}]},{"osd":7,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82599999999999996,"15min":0.82899999999999996},"min":{"1min":0.621,"5min":0.54400000000000004,"15min":0.51700000000000002},"max":{"1min":1.2949999999999999,"5min":3.4350000000000001,"15min":3.4350000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78900000000000003,"15min":0.81399999999999995},"min":{"1min":0.56499999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.179},"last":0.77500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575068,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303576,"kb_used_data":2192,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068264,"statfs":{"total":96636764160,"available":96325902336,"internally_reserved":0,"allocated":2244608,"data_stored":1400006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47599999999999998,"15min":0.46899999999999997},"min":{"1min":0.31900000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.73499999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51200000000000001,"15min":0.53800000000000003},"min":{"1min":0.32100000000000001,"5min":0.315,"15min":0.28899999999999998},"max":{"1min":0.78000000000000003,"5min":2.1379999999999999,"15min":4.5819999999999999},"last":0.39100000000000001}]},{"osd":2,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.52800000000000002,"15min":0.55600000000000005},"min":{"1min":0.38400000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.69799999999999995,"5min":2.1720000000000002,"15min":4.6980000000000004},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48599999999999999,"15min":0.499},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.626,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.35999999999999999}]},{"osd":3,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.53300000000000003,"15min":0.53200000000000003},"min":{"1min":0.38500000000000001,"5min":0.34300000000000003,"15min":0.33200000000000002},"max":{"1min":0.75600000000000001,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58599999999999997,"15min":0.61199999999999999},"min":{"1min":0.46000000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71199999999999997,"5min":2.1989999999999998,"15min":4.734},"last":0.373}]},{"osd":4,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.42799999999999999},"max":{"1min":0.94999999999999996,"5min":2.339,"15min":2.339},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75,"15min":0.79000000000000004},"min":{"1min":0.55400000000000005,"5min":0.50700000000000001,"15min":0.39500000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":4.6619999999999999},"last":0.67100000000000004}]},{"osd":5,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.746,"15min":0.76800000000000002},"min":{"1min":0.52600000000000002,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":0.89300000000000002,"5min":1.0349999999999999,"15min":1.1890000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78100000000000003,"15min":0.79100000000000004},"min":{"1min":0.50600000000000001,"5min":0.5,"15min":0.45600000000000002},"max":{"1min":0.96399999999999997,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":0.71999999999999997}]},{"osd":6,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76300000000000001,"15min":0.80300000000000005},"min":{"1min":0.60199999999999998,"5min":0.5,"15min":0.48599999999999999},"max":{"1min":0.98199999999999998,"5min":1.05,"15min":4.6239999999999997},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.55900000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.034,"5min":1.0640000000000001,"15min":1.2689999999999999},"last":0.83899999999999997}]},{"osd":7,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80000000000000004,"15min":0.82299999999999995},"min":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.46400000000000002},"max":{"1min":0.96699999999999997,"5min":1.0760000000000001,"15min":1.256},"last":0.746},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.83599999999999997,"15min":0.84599999999999997},"min":{"1min":0.59399999999999997,"5min":0.57599999999999996,"15min":0.51800000000000002},"max":{"1min":0.995,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.80900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575069,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311236,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060604,"statfs":{"total":96636764160,"available":96318058496,"internally_reserved":0,"allocated":1699840,"data_stored":836437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.42999999999999999,"15min":0.45400000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.25900000000000001},"max":{"1min":0.54600000000000004,"5min":0.79800000000000004,"15min":1.8149999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.47199999999999998,"15min":0.49199999999999999},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28000000000000003},"max":{"1min":0.63100000000000001,"5min":0.68100000000000005,"15min":1.633},"last":0.38400000000000001}]},{"osd":1,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44900000000000001,"15min":0.46999999999999997},"min":{"1min":0.316,"5min":0.29499999999999998,"15min":0.28999999999999998},"max":{"1min":0.66700000000000004,"5min":0.71599999999999997,"15min":1.097},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.49099999999999999,"15min":0.50800000000000001},"min":{"1min":0.35099999999999998,"5min":0.32900000000000001,"15min":0.309},"max":{"1min":0.65700000000000003,"5min":0.79700000000000004,"15min":1.2689999999999999},"last":0.46000000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55700000000000005,"15min":0.58299999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69999999999999996,"5min":0.82599999999999996,"15min":0.87},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.59199999999999997,"15min":0.60899999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.35699999999999998},"max":{"1min":0.64700000000000002,"5min":0.83899999999999997,"15min":1.1890000000000001},"last":0.499}]},{"osd":4,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.74299999999999999,"15min":0.76400000000000001},"min":{"1min":0.55100000000000005,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":0.84299999999999997,"5min":1.1379999999999999,"15min":1.256},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72499999999999998,"15min":0.75600000000000001},"min":{"1min":0.501,"5min":0.48799999999999999,"15min":0.44800000000000001},"max":{"1min":0.88500000000000001,"5min":1.171,"15min":1.696},"last":0.79600000000000004}]},{"osd":5,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73699999999999999,"15min":0.76800000000000002},"min":{"1min":0.60399999999999998,"5min":0.505,"15min":0.42399999999999999},"max":{"1min":0.95399999999999996,"5min":1.143,"15min":1.3049999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.748,"15min":0.77600000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.503},"max":{"1min":1.038,"5min":1.0629999999999999,"15min":1.3440000000000001},"last":0.81000000000000005}]},{"osd":6,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.76300000000000001,"15min":0.77900000000000003},"min":{"1min":0.53900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91100000000000003,"5min":1.115,"15min":1.768},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.78200000000000003},"min":{"1min":0.53500000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.98899999999999999,"5min":1.101,"15min":1.5309999999999999},"last":0.69999999999999996}]},{"osd":7,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.77100000000000002,"15min":0.80100000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.54600000000000004},"max":{"1min":0.93700000000000006,"5min":1.0389999999999999,"15min":1.7370000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.82099999999999995},"min":{"1min":0.64500000000000002,"5min":0.57099999999999995,"15min":0.50900000000000001},"max":{"1min":0.97899999999999998,"5min":1.0409999999999999,"15min":1.3939999999999999},"last":0.82299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575070,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307156,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064684,"statfs":{"total":96636764160,"available":96322236416,"internally_reserved":0,"allocated":1716224,"data_stored":838043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45300000000000001,"15min":0.46800000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.60099999999999998,"5min":0.86299999999999999,"15min":0.94299999999999995},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.47099999999999997,"15min":0.49099999999999999},"min":{"1min":0.32900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55500000000000005,"5min":0.81799999999999995,"15min":1.228},"last":0.38100000000000001}]},{"osd":1,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46899999999999997,"15min":0.47999999999999998},"min":{"1min":0.34599999999999997,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.65800000000000003,"5min":0.81899999999999995,"15min":2.0800000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.55000000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.247},"max":{"1min":0.68500000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41199999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55600000000000005,"15min":0.57899999999999996},"min":{"1min":0.39000000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73199999999999998,"5min":0.94099999999999995,"15min":2.3959999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.61699999999999999,"15min":0.63200000000000001},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.309},"max":{"1min":0.75,"5min":0.97699999999999998,"15min":3.8900000000000001},"last":0.59299999999999997}]},{"osd":4,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.71699999999999997,"15min":0.73699999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40799999999999997},"max":{"1min":1.014,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.871},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79600000000000004,"15min":0.81999999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.55300000000000005},"max":{"1min":0.96099999999999997,"5min":1.22,"15min":1.22},"last":0.82199999999999995}]},{"osd":5,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94799999999999995,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.628},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.76600000000000001,"15min":0.79600000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.98799999999999999,"5min":1.1519999999999999,"15min":1.1830000000000001},"last":0.64500000000000002}]},{"osd":6,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.753,"15min":0.77400000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.51700000000000002},"max":{"1min":0.93999999999999995,"5min":1.304,"15min":1.304},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.73899999999999999,"15min":0.77400000000000002},"min":{"1min":0.53100000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.016,"5min":1.1579999999999999,"15min":1.7769999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78200000000000003,"15min":0.81299999999999994},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1,"5min":1.2629999999999999,"15min":1.8180000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.78000000000000003,"15min":0.81599999999999995},"min":{"1min":0.58199999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.056,"5min":1.1919999999999999,"15min":1.486},"last":0.80400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575068,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311188,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060652,"statfs":{"total":96636764160,"available":96318107648,"internally_reserved":0,"allocated":1650688,"data_stored":809638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69899999999999995,"15min":0.70999999999999996},"min":{"1min":0.45000000000000001,"5min":0.35899999999999999,"15min":0.29799999999999999},"max":{"1min":1.109,"5min":1.5609999999999999,"15min":3.1139999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.71499999999999997,"15min":0.72299999999999998},"min":{"1min":0.47399999999999998,"5min":0.39900000000000002,"15min":0.39300000000000002},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.8130000000000002},"last":0.629}]},{"osd":1,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68799999999999994,"15min":0.71599999999999997},"min":{"1min":0.47199999999999998,"5min":0.39500000000000002,"15min":0.373},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.9279999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71299999999999997,"15min":0.73799999999999999},"min":{"1min":0.54000000000000004,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3129999999999999,"5min":1.4339999999999999,"15min":3.4359999999999999},"last":0.872}]},{"osd":2,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.72799999999999998,"15min":0.755},"min":{"1min":0.52900000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74199999999999999,"15min":0.77400000000000002},"min":{"1min":0.54900000000000004,"5min":0.48299999999999998,"15min":0.47599999999999998},"max":{"1min":0.98999999999999999,"5min":1.0129999999999999,"15min":2.427},"last":0.81200000000000006}]},{"osd":3,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.72899999999999998,"15min":0.74399999999999999},"min":{"1min":0.46999999999999997,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.8239999999999998,"5min":2.8239999999999998,"15min":2.8239999999999998},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.749},"min":{"1min":0.56499999999999995,"5min":0.443,"15min":0.43099999999999999},"max":{"1min":1.077,"5min":1.077,"15min":3.6899999999999999},"last":0.84399999999999997}]},{"osd":5,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.32700000000000001,"15min":0.317},"max":{"1min":2.234,"5min":2.234,"15min":3.3860000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.65200000000000002,"15min":0.65000000000000002},"min":{"1min":0.436,"5min":0.40999999999999998,"15min":0.34999999999999998},"max":{"1min":2.8690000000000002,"5min":2.8690000000000002,"15min":3.9300000000000002},"last":0.82899999999999996}]},{"osd":6,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.45800000000000002,"5min":0.42299999999999999,"15min":0.36499999999999999},"max":{"1min":1.262,"5min":1.262,"15min":3.5270000000000001},"last":0.747},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68500000000000005,"15min":0.68000000000000005},"min":{"1min":0.48899999999999999,"5min":0.42499999999999999,"15min":0.374},"max":{"1min":1.369,"5min":1.587,"15min":3.4740000000000002},"last":0.67700000000000005}]},{"osd":7,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.73299999999999998,"15min":0.72599999999999998},"min":{"1min":0.59399999999999997,"5min":0.44,"15min":0.34699999999999998},"max":{"1min":2.9049999999999998,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":1.004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.439},"max":{"1min":1.133,"5min":1.1899999999999999,"15min":3.7280000000000002},"last":0.97599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575069,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302996,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068844,"statfs":{"total":96636764160,"available":96326496256,"internally_reserved":0,"allocated":1650688,"data_stored":809638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66300000000000003,"15min":0.68799999999999994},"min":{"1min":0.45400000000000001,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.85299999999999998,"5min":0.93600000000000005,"15min":0.96999999999999997},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65500000000000003,"15min":0.67800000000000005},"min":{"1min":0.47099999999999997,"5min":0.379,"15min":0.32900000000000001},"max":{"1min":1.024,"5min":1.119,"15min":1.119},"last":0.754}]},{"osd":1,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66000000000000003,"15min":0.67900000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39700000000000002},"max":{"1min":0.84599999999999997,"5min":1.0029999999999999,"15min":1.034},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.69899999999999995,"15min":0.71499999999999997},"min":{"1min":0.52200000000000002,"5min":0.45400000000000001,"15min":0.40400000000000003},"max":{"1min":0.79500000000000004,"5min":0.95099999999999996,"15min":1.0229999999999999},"last":0.66700000000000004}]},{"osd":2,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68999999999999995,"15min":0.71699999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.47299999999999998},"max":{"1min":0.81000000000000005,"5min":0.997,"15min":1.0580000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.68100000000000005,"15min":0.70299999999999996},"min":{"1min":0.48099999999999998,"5min":0.46200000000000002,"15min":0.442},"max":{"1min":0.88100000000000001,"5min":0.97799999999999998,"15min":1.0720000000000001},"last":0.72599999999999998}]},{"osd":3,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70099999999999996,"15min":0.71199999999999997},"min":{"1min":0.51300000000000001,"5min":0.46300000000000002,"15min":0.435},"max":{"1min":0.96299999999999997,"5min":1.1499999999999999,"15min":1.302},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.54000000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93600000000000005,"5min":1.03,"15min":1.399},"last":0.64000000000000001}]},{"osd":4,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.621,"15min":0.60199999999999998},"min":{"1min":0.44900000000000001,"5min":0.377,"15min":0.36099999999999999},"max":{"1min":0.89000000000000001,"5min":0.96099999999999997,"15min":0.96799999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.42099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.002,"5min":1.075,"15min":1.075},"last":0.59999999999999998}]},{"osd":6,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63300000000000001,"15min":0.628},"min":{"1min":0.439,"5min":0.41099999999999998,"15min":0.36599999999999999},"max":{"1min":0.94299999999999995,"5min":1.0049999999999999,"15min":1.018},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68700000000000006,"15min":0.67100000000000004},"min":{"1min":0.48499999999999999,"5min":0.41199999999999998,"15min":0.38900000000000001},"max":{"1min":0.95299999999999996,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.625}]},{"osd":7,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68799999999999994,"15min":0.68300000000000005},"min":{"1min":0.499,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.048,"5min":1.48,"15min":1.48},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76700000000000002,"15min":0.76400000000000001},"min":{"1min":0.59499999999999997,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0189999999999999,"5min":1.466,"15min":1.466},"last":0.77000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T07:01:27.475 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T07:01:27.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.686+0000 7f899c5ff700 1 Processor -- start 2023-10-09T07:01:27.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.686+0000 7f899c5ff700 1 -- start start 2023-10-09T07:01:27.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.687+0000 7f899c5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8994155c10 0x7f8994155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:27.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.687+0000 7f899c5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89940ac230 0x7f89940ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:27.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.688+0000 7f899c5ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f89941568a0 0x7f8994156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:27.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.688+0000 7f899c5ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89940ad930 con 0x7f89941568a0 2023-10-09T07:01:27.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.688+0000 7f899c5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89940acd20 con 0x7f8994155c10 2023-10-09T07:01:27.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.688+0000 7f899c5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89940ad000 con 0x7f89940ac230 2023-10-09T07:01:27.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.688+0000 7f899ab9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f89941568a0 0x7f8994156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:27.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.688+0000 7f899ab9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f89941568a0 0x7f8994156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40092/0 (socket says 172.21.15.71:40092) 2023-10-09T07:01:27.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.688+0000 7f899ab9c700 1 -- 172.21.15.71:0/4157698784 learned_addr learned my addr 172.21.15.71:0/4157698784 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:27.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.688+0000 7f8999b9a700 1 --2- 172.21.15.71:0/4157698784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89940ac230 0x7f89940ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:27.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.688+0000 7f899a39b700 1 --2- 172.21.15.71:0/4157698784 >> v2:172.21.15.179:3300/0 conn(0x7f8994155c10 0x7f8994155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:27.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.688+0000 7f899ab9c700 1 -- 172.21.15.71:0/4157698784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89940ac230 msgr2=0x7f89940ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:27.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.688+0000 7f899ab9c700 1 --2- 172.21.15.71:0/4157698784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89940ac230 0x7f89940ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.688+0000 7f899ab9c700 1 -- 172.21.15.71:0/4157698784 >> v2:172.21.15.179:3300/0 conn(0x7f8994155c10 msgr2=0x7f8994155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:27.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.688+0000 7f899ab9c700 1 --2- 172.21.15.71:0/4157698784 >> v2:172.21.15.179:3300/0 conn(0x7f8994155c10 0x7f8994155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.688+0000 7f899ab9c700 1 -- 172.21.15.71:0/4157698784 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89940ad2e0 con 0x7f89941568a0 2023-10-09T07:01:27.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.689+0000 7f899ab9c700 1 --2- 172.21.15.71:0/4157698784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89941568a0 0x7f8994156cc0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f8994063d40 tx=0x7f898c00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc41ed80c79acaa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:27.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.689+0000 7f8999399700 1 -- 172.21.15.71:0/4157698784 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c010070 con 0x7f89941568a0 2023-10-09T07:01:27.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.689+0000 7f8999399700 1 -- 172.21.15.71:0/4157698784 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898c00de90 con 0x7f89941568a0 2023-10-09T07:01:27.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.689+0000 7f8999399700 1 -- 172.21.15.71:0/4157698784 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c00b320 con 0x7f89941568a0 2023-10-09T07:01:27.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.689+0000 7f899c5ff700 1 -- 172.21.15.71:0/4157698784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89941568a0 msgr2=0x7f8994156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:27.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.689+0000 7f899c5ff700 1 --2- 172.21.15.71:0/4157698784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89941568a0 0x7f8994156cc0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f8994063d40 tx=0x7f898c00ba50 comp rx=0 tx=0).stop 2023-10-09T07:01:27.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.689+0000 7f899c5ff700 1 -- 172.21.15.71:0/4157698784 shutdown_connections 2023-10-09T07:01:27.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.689+0000 7f899c5ff700 1 --2- 172.21.15.71:0/4157698784 >> v2:172.21.15.179:3300/0 conn(0x7f8994155c10 0x7f8994155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.689+0000 7f899c5ff700 1 --2- 172.21.15.71:0/4157698784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89941568a0 0x7f8994156cc0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.689+0000 7f899c5ff700 1 --2- 172.21.15.71:0/4157698784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89940ac230 0x7f89940ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.689+0000 7f899c5ff700 1 -- 172.21.15.71:0/4157698784 >> 172.21.15.71:0/4157698784 conn(0x7f899406a320 msgr2=0x7f89940cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:27.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.690+0000 7f899c5ff700 1 -- 172.21.15.71:0/4157698784 shutdown_connections 2023-10-09T07:01:27.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.690+0000 7f899c5ff700 1 -- 172.21.15.71:0/4157698784 wait complete. 2023-10-09T07:01:27.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.691+0000 7f899c5ff700 1 Processor -- start 2023-10-09T07:01:27.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.691+0000 7f899c5ff700 1 -- start start 2023-10-09T07:01:27.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.692+0000 7f899c5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89940ac230 0x7f8994148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:27.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.692+0000 7f899c5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8994155c10 0x7f8994149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:27.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.692+0000 7f899c5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89941568a0 0x7f899414eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:27.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.692+0000 7f899c5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899414aa20 con 0x7f89940ac230 2023-10-09T07:01:27.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.692+0000 7f899c5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899414d240 con 0x7f8994155c10 2023-10-09T07:01:27.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.692+0000 7f899c5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8994149e60 con 0x7f89941568a0 2023-10-09T07:01:27.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.692+0000 7f899a39b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89940ac230 0x7f8994148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:27.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.692+0000 7f899a39b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89940ac230 0x7f8994148b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40096/0 (socket says 172.21.15.71:40096) 2023-10-09T07:01:27.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.692+0000 7f899a39b700 1 -- 172.21.15.71:0/2018931052 learned_addr learned my addr 172.21.15.71:0/2018931052 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:27.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.693+0000 7f899ab9c700 1 --2- 172.21.15.71:0/2018931052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89941568a0 0x7f899414eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:27.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.693+0000 7f8999b9a700 1 --2- 172.21.15.71:0/2018931052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8994155c10 0x7f8994149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:27.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.693+0000 7f899a39b700 1 -- 172.21.15.71:0/2018931052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89941568a0 msgr2=0x7f899414eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:27.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.693+0000 7f899a39b700 1 --2- 172.21.15.71:0/2018931052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89941568a0 0x7f899414eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.693+0000 7f899a39b700 1 -- 172.21.15.71:0/2018931052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8994155c10 msgr2=0x7f8994149920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:27.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.693+0000 7f899a39b700 1 --2- 172.21.15.71:0/2018931052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8994155c10 0x7f8994149920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.693+0000 7f899a39b700 1 -- 172.21.15.71:0/2018931052 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c00bcf0 con 0x7f89940ac230 2023-10-09T07:01:27.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.693+0000 7f899a39b700 1 --2- 172.21.15.71:0/2018931052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89940ac230 0x7f8994148b30 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f899000d8c0 tx=0x7f8990008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:27.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.693+0000 7f898a7fc700 1 -- 172.21.15.71:0/2018931052 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899000de60 con 0x7f89940ac230 2023-10-09T07:01:27.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.693+0000 7f898a7fc700 1 -- 172.21.15.71:0/2018931052 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899000b780 con 0x7f89940ac230 2023-10-09T07:01:27.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.693+0000 7f898a7fc700 1 -- 172.21.15.71:0/2018931052 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899000bb20 con 0x7f89940ac230 2023-10-09T07:01:27.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.693+0000 7f899c5ff700 1 -- 172.21.15.71:0/2018931052 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899414f420 con 0x7f89940ac230 2023-10-09T07:01:27.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.693+0000 7f899c5ff700 1 -- 172.21.15.71:0/2018931052 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8994166180 con 0x7f89940ac230 2023-10-09T07:01:27.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.694+0000 7f899c5ff700 1 -- 172.21.15.71:0/2018931052 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f899414d520 con 0x7f89940ac230 2023-10-09T07:01:27.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.695+0000 7f898a7fc700 1 -- 172.21.15.71:0/2018931052 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f899001e460 con 0x7f89940ac230 2023-10-09T07:01:27.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.696+0000 7f898a7fc700 1 --2- 172.21.15.71:0/2018931052 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8978066f30 0x7f89780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:27.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.696+0000 7f898a7fc700 1 -- 172.21.15.71:0/2018931052 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f8990084d70 con 0x7f89940ac230 2023-10-09T07:01:27.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.696+0000 7f8999b9a700 1 --2- 172.21.15.71:0/2018931052 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8978066f30 0x7f89780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:27.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.697+0000 7f8999b9a700 1 --2- 172.21.15.71:0/2018931052 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8978066f30 0x7f89780693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f899415ae20 tx=0x7f8984008040 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:27.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.700+0000 7f898a7fc700 1 -- 172.21.15.71:0/2018931052 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8990051e40 con 0x7f89940ac230 2023-10-09T07:01:27.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.885+0000 7f899c5ff700 1 -- 172.21.15.71:0/2018931052 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8994149070 con 0x7f8978066f30 2023-10-09T07:01:27.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.895+0000 7f898a7fc700 1 -- 172.21.15.71:0/2018931052 <== mgr.7627 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277892 (secure 0 0 0) 0x7f8994149070 con 0x7f8978066f30 2023-10-09T07:01:27.899 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:01:27.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.899+0000 7f899c5ff700 1 -- 172.21.15.71:0/2018931052 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8978066f30 msgr2=0x7f89780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:27.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.899+0000 7f899c5ff700 1 --2- 172.21.15.71:0/2018931052 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8978066f30 0x7f89780693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f899415ae20 tx=0x7f8984008040 comp rx=0 tx=0).stop 2023-10-09T07:01:27.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.899+0000 7f899c5ff700 1 -- 172.21.15.71:0/2018931052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89940ac230 msgr2=0x7f8994148b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:27.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.899+0000 7f899c5ff700 1 --2- 172.21.15.71:0/2018931052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89940ac230 0x7f8994148b30 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f899000d8c0 tx=0x7f8990008040 comp rx=0 tx=0).stop 2023-10-09T07:01:27.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.899+0000 7f899c5ff700 1 -- 172.21.15.71:0/2018931052 shutdown_connections 2023-10-09T07:01:27.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.899+0000 7f899c5ff700 1 --2- 172.21.15.71:0/2018931052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89941568a0 0x7f899414eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.899+0000 7f899c5ff700 1 --2- 172.21.15.71:0/2018931052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89940ac230 0x7f8994148b30 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.899+0000 7f899c5ff700 1 --2- 172.21.15.71:0/2018931052 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8978066f30 0x7f89780693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.899+0000 7f899c5ff700 1 --2- 172.21.15.71:0/2018931052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8994155c10 0x7f8994149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:27.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.899+0000 7f899c5ff700 1 -- 172.21.15.71:0/2018931052 >> 172.21.15.71:0/2018931052 conn(0x7f899406a320 msgr2=0x7f89940b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:27.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.899+0000 7f899c5ff700 1 -- 172.21.15.71:0/2018931052 shutdown_connections 2023-10-09T07:01:27.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:27.899+0000 7f899c5ff700 1 -- 172.21.15.71:0/2018931052 wait complete. 2023-10-09T07:01:27.903 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T07:01:27.917 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-09T07:01:26.076092+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":423,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":266,"ondisk_log_size":266,"up":46,"acting":46,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":2445720,"kb_used_data":14168,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752529000,"statfs":{"total":773094113280,"available":770589696000,"internally_reserved":0,"allocated":14508032,"data_stored":7713044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.945357"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.155043+0000","last_change":"2023-10-09T07:01:23.151380+0000","last_active":"2023-10-09T07:01:23.155043+0000","last_peered":"2023-10-09T07:01:23.155043+0000","last_clean":"2023-10-09T07:01:23.155043+0000","last_became_active":"2023-10-09T07:01:23.151124+0000","last_became_peered":"2023-10-09T07:01:23.151124+0000","last_unstale":"2023-10-09T07:01:23.155043+0000","last_undegraded":"2023-10-09T07:01:23.155043+0000","last_fullsized":"2023-10-09T07:01:23.155043+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:42:28.704095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.155518+0000","last_change":"2023-10-09T07:01:23.151375+0000","last_active":"2023-10-09T07:01:23.155518+0000","last_peered":"2023-10-09T07:01:23.155518+0000","last_clean":"2023-10-09T07:01:23.155518+0000","last_became_active":"2023-10-09T07:01:23.151112+0000","last_became_peered":"2023-10-09T07:01:23.151112+0000","last_unstale":"2023-10-09T07:01:23.155518+0000","last_undegraded":"2023-10-09T07:01:23.155518+0000","last_fullsized":"2023-10-09T07:01:23.155518+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:04.781425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168542+0000","last_change":"2023-10-09T07:01:23.164581+0000","last_active":"2023-10-09T07:01:23.168542+0000","last_peered":"2023-10-09T07:01:23.168542+0000","last_clean":"2023-10-09T07:01:23.168542+0000","last_became_active":"2023-10-09T07:01:23.164337+0000","last_became_peered":"2023-10-09T07:01:23.164337+0000","last_unstale":"2023-10-09T07:01:23.168542+0000","last_undegraded":"2023-10-09T07:01:23.168542+0000","last_fullsized":"2023-10-09T07:01:23.168542+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:16.117929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.167499+0000","last_change":"2023-10-09T07:01:23.163460+0000","last_active":"2023-10-09T07:01:23.167499+0000","last_peered":"2023-10-09T07:01:23.167499+0000","last_clean":"2023-10-09T07:01:23.167499+0000","last_became_active":"2023-10-09T07:01:23.163219+0000","last_became_peered":"2023-10-09T07:01:23.163219+0000","last_unstale":"2023-10-09T07:01:23.167499+0000","last_undegraded":"2023-10-09T07:01:23.167499+0000","last_fullsized":"2023-10-09T07:01:23.167499+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:35.224469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160700+0000","last_change":"2023-10-09T07:01:22.146764+0000","last_active":"2023-10-09T07:01:23.160700+0000","last_peered":"2023-10-09T07:01:23.160700+0000","last_clean":"2023-10-09T07:01:23.160700+0000","last_became_active":"2023-10-09T07:01:22.146458+0000","last_became_peered":"2023-10-09T07:01:22.146458+0000","last_unstale":"2023-10-09T07:01:23.160700+0000","last_undegraded":"2023-10-09T07:01:23.160700+0000","last_fullsized":"2023-10-09T07:01:23.160700+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:20:50.395740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.167923+0000","last_change":"2023-10-09T07:01:22.147417+0000","last_active":"2023-10-09T07:01:23.167923+0000","last_peered":"2023-10-09T07:01:23.167923+0000","last_clean":"2023-10-09T07:01:23.167923+0000","last_became_active":"2023-10-09T07:01:22.147144+0000","last_became_peered":"2023-10-09T07:01:22.147144+0000","last_unstale":"2023-10-09T07:01:23.167923+0000","last_undegraded":"2023-10-09T07:01:23.167923+0000","last_fullsized":"2023-10-09T07:01:23.167923+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:36:25.395738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.162203+0000","last_change":"2023-10-09T07:01:22.146261+0000","last_active":"2023-10-09T07:01:23.162203+0000","last_peered":"2023-10-09T07:01:23.162203+0000","last_clean":"2023-10-09T07:01:23.162203+0000","last_became_active":"2023-10-09T07:01:22.146020+0000","last_became_peered":"2023-10-09T07:01:22.146020+0000","last_unstale":"2023-10-09T07:01:23.162203+0000","last_undegraded":"2023-10-09T07:01:23.162203+0000","last_fullsized":"2023-10-09T07:01:23.162203+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:03:31.346374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.139944+0000","last_change":"2023-10-09T07:01:22.150785+0000","last_active":"2023-10-09T07:01:23.139944+0000","last_peered":"2023-10-09T07:01:23.139944+0000","last_clean":"2023-10-09T07:01:23.139944+0000","last_became_active":"2023-10-09T07:01:22.150522+0000","last_became_peered":"2023-10-09T07:01:22.150522+0000","last_unstale":"2023-10-09T07:01:23.139944+0000","last_undegraded":"2023-10-09T07:01:23.139944+0000","last_fullsized":"2023-10-09T07:01:23.139944+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:05.488682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.141723+0000","last_change":"2023-10-09T07:01:22.146917+0000","last_active":"2023-10-09T07:01:23.141723+0000","last_peered":"2023-10-09T07:01:23.141723+0000","last_clean":"2023-10-09T07:01:23.141723+0000","last_became_active":"2023-10-09T07:01:22.146680+0000","last_became_peered":"2023-10-09T07:01:22.146680+0000","last_unstale":"2023-10-09T07:01:23.141723+0000","last_undegraded":"2023-10-09T07:01:23.141723+0000","last_fullsized":"2023-10-09T07:01:23.141723+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:27.481750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.161105+0000","last_change":"2023-10-09T07:01:23.159690+0000","last_active":"2023-10-09T07:01:23.161105+0000","last_peered":"2023-10-09T07:01:23.161105+0000","last_clean":"2023-10-09T07:01:23.161105+0000","last_became_active":"2023-10-09T07:01:23.159405+0000","last_became_peered":"2023-10-09T07:01:23.159405+0000","last_unstale":"2023-10-09T07:01:23.161105+0000","last_undegraded":"2023-10-09T07:01:23.161105+0000","last_fullsized":"2023-10-09T07:01:23.161105+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:44.249505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.157869+0000","last_change":"2023-10-09T07:01:23.153614+0000","last_active":"2023-10-09T07:01:23.157869+0000","last_peered":"2023-10-09T07:01:23.157869+0000","last_clean":"2023-10-09T07:01:23.157869+0000","last_became_active":"2023-10-09T07:01:23.153365+0000","last_became_peered":"2023-10-09T07:01:23.153365+0000","last_unstale":"2023-10-09T07:01:23.157869+0000","last_undegraded":"2023-10-09T07:01:23.157869+0000","last_fullsized":"2023-10-09T07:01:23.157869+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:50.435038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168371+0000","last_change":"2023-10-09T07:01:23.164674+0000","last_active":"2023-10-09T07:01:23.168371+0000","last_peered":"2023-10-09T07:01:23.168371+0000","last_clean":"2023-10-09T07:01:23.168371+0000","last_became_active":"2023-10-09T07:01:23.164428+0000","last_became_peered":"2023-10-09T07:01:23.164428+0000","last_unstale":"2023-10-09T07:01:23.168371+0000","last_undegraded":"2023-10-09T07:01:23.168371+0000","last_fullsized":"2023-10-09T07:01:23.168371+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:01:34.945426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.162854+0000","last_change":"2023-10-09T07:01:23.161420+0000","last_active":"2023-10-09T07:01:23.162854+0000","last_peered":"2023-10-09T07:01:23.162854+0000","last_clean":"2023-10-09T07:01:23.162854+0000","last_became_active":"2023-10-09T07:01:23.161160+0000","last_became_peered":"2023-10-09T07:01:23.161160+0000","last_unstale":"2023-10-09T07:01:23.162854+0000","last_undegraded":"2023-10-09T07:01:23.162854+0000","last_fullsized":"2023-10-09T07:01:23.162854+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:33:26.130071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"136'8","reported_seq":18,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.172132+0000","last_change":"2023-10-09T07:01:22.146719+0000","last_active":"2023-10-09T07:01:23.172132+0000","last_peered":"2023-10-09T07:01:23.172132+0000","last_clean":"2023-10-09T07:01:23.172132+0000","last_became_active":"2023-10-09T07:01:22.146438+0000","last_became_peered":"2023-10-09T07:01:22.146438+0000","last_unstale":"2023-10-09T07:01:23.172132+0000","last_undegraded":"2023-10-09T07:01:23.172132+0000","last_fullsized":"2023-10-09T07:01:23.172132+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:59.902976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166403+0000","last_change":"2023-10-09T07:01:23.163188+0000","last_active":"2023-10-09T07:01:23.166403+0000","last_peered":"2023-10-09T07:01:23.166403+0000","last_clean":"2023-10-09T07:01:23.166403+0000","last_became_active":"2023-10-09T07:01:23.162774+0000","last_became_peered":"2023-10-09T07:01:23.162774+0000","last_unstale":"2023-10-09T07:01:23.166403+0000","last_undegraded":"2023-10-09T07:01:23.166403+0000","last_fullsized":"2023-10-09T07:01:23.166403+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:26:58.267604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.164502+0000","last_change":"2023-10-09T07:01:22.147563+0000","last_active":"2023-10-09T07:01:23.164502+0000","last_peered":"2023-10-09T07:01:23.164502+0000","last_clean":"2023-10-09T07:01:23.164502+0000","last_became_active":"2023-10-09T07:01:22.147281+0000","last_became_peered":"2023-10-09T07:01:22.147281+0000","last_unstale":"2023-10-09T07:01:23.164502+0000","last_undegraded":"2023-10-09T07:01:23.164502+0000","last_fullsized":"2023-10-09T07:01:23.164502+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:29.107018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.141899+0000","last_change":"2023-10-09T07:01:22.150874+0000","last_active":"2023-10-09T07:01:23.141899+0000","last_peered":"2023-10-09T07:01:23.141899+0000","last_clean":"2023-10-09T07:01:23.141899+0000","last_became_active":"2023-10-09T07:01:22.150612+0000","last_became_peered":"2023-10-09T07:01:22.150612+0000","last_unstale":"2023-10-09T07:01:23.141899+0000","last_undegraded":"2023-10-09T07:01:23.141899+0000","last_fullsized":"2023-10-09T07:01:23.141899+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:44:39.274431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.167911+0000","last_change":"2023-10-09T07:01:23.162779+0000","last_active":"2023-10-09T07:01:23.167911+0000","last_peered":"2023-10-09T07:01:23.167911+0000","last_clean":"2023-10-09T07:01:23.167911+0000","last_became_active":"2023-10-09T07:01:23.162539+0000","last_became_peered":"2023-10-09T07:01:23.162539+0000","last_unstale":"2023-10-09T07:01:23.167911+0000","last_undegraded":"2023-10-09T07:01:23.167911+0000","last_fullsized":"2023-10-09T07:01:23.167911+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:11:24.045926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169665+0000","last_change":"2023-10-09T07:01:22.149834+0000","last_active":"2023-10-09T07:01:23.169665+0000","last_peered":"2023-10-09T07:01:23.169665+0000","last_clean":"2023-10-09T07:01:23.169665+0000","last_became_active":"2023-10-09T07:01:22.149582+0000","last_became_peered":"2023-10-09T07:01:22.149582+0000","last_unstale":"2023-10-09T07:01:23.169665+0000","last_undegraded":"2023-10-09T07:01:23.169665+0000","last_fullsized":"2023-10-09T07:01:23.169665+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:27:24.455676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.141130+0000","last_change":"2023-10-09T07:01:22.150757+0000","last_active":"2023-10-09T07:01:23.141130+0000","last_peered":"2023-10-09T07:01:23.141130+0000","last_clean":"2023-10-09T07:01:23.141130+0000","last_became_active":"2023-10-09T07:01:22.150082+0000","last_became_peered":"2023-10-09T07:01:22.150082+0000","last_unstale":"2023-10-09T07:01:23.141130+0000","last_undegraded":"2023-10-09T07:01:23.141130+0000","last_fullsized":"2023-10-09T07:01:23.141130+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:12:37.048446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.141795+0000","last_change":"2023-10-09T07:01:22.148410+0000","last_active":"2023-10-09T07:01:23.141795+0000","last_peered":"2023-10-09T07:01:23.141795+0000","last_clean":"2023-10-09T07:01:23.141795+0000","last_became_active":"2023-10-09T07:01:22.148163+0000","last_became_peered":"2023-10-09T07:01:22.148163+0000","last_unstale":"2023-10-09T07:01:23.141795+0000","last_undegraded":"2023-10-09T07:01:23.141795+0000","last_fullsized":"2023-10-09T07:01:23.141795+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:38.775384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:22.123799+0000","last_change":"2023-10-09T07:01:22.123799+0000","last_active":"2023-10-09T07:01:22.123799+0000","last_peered":"2023-10-09T07:01:22.123799+0000","last_clean":"2023-10-09T07:01:22.123799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:22.123799+0000","last_undegraded":"2023-10-09T07:01:22.123799+0000","last_fullsized":"2023-10-09T07:01:22.123799+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.157844+0000","last_change":"2023-10-09T07:01:23.155358+0000","last_active":"2023-10-09T07:01:23.157844+0000","last_peered":"2023-10-09T07:01:23.157844+0000","last_clean":"2023-10-09T07:01:23.157844+0000","last_became_active":"2023-10-09T07:01:23.155054+0000","last_became_peered":"2023-10-09T07:01:23.155054+0000","last_unstale":"2023-10-09T07:01:23.157844+0000","last_undegraded":"2023-10-09T07:01:23.157844+0000","last_fullsized":"2023-10-09T07:01:23.157844+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:27:50.013074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:01:21.116235+0000","last_change":"2023-10-09T07:01:21.116235+0000","last_active":"2023-10-09T07:01:21.116235+0000","last_peered":"2023-10-09T07:01:21.116235+0000","last_clean":"2023-10-09T07:01:21.116235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:01:21.116235+0000","last_undegraded":"2023-10-09T07:01:21.116235+0000","last_fullsized":"2023-10-09T07:01:21.116235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"127'249","reported_seq":727,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T07:01:12.685554+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T07:01:12.685554+0000","last_peered":"2023-10-09T07:01:12.685554+0000","last_clean":"2023-10-09T07:01:12.685554+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T07:01:12.685554+0000","last_undegraded":"2023-10-09T07:01:12.685554+0000","last_fullsized":"2023-10-09T07:01:12.685554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":22,"acting":22,"num_store_stats":2},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":22,"acting":22,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575069,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303576,"kb_used_data":2192,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068264,"statfs":{"total":96636764160,"available":96325902336,"internally_reserved":0,"allocated":2244608,"data_stored":1400006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68200000000000005,"15min":0.70399999999999996},"min":{"1min":0.46800000000000003,"5min":0.44700000000000001,"15min":0.316},"max":{"1min":0.91100000000000003,"5min":1.0960000000000001,"15min":1.732},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69399999999999995,"15min":0.71699999999999997},"min":{"1min":0.443,"5min":0.44,"15min":0.29999999999999999},"max":{"1min":0.94299999999999995,"5min":1.22,"15min":1.22},"last":0.68899999999999995}]},{"osd":1,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.67100000000000004,"15min":0.70599999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.379},"max":{"1min":1.004,"5min":1.004,"15min":2.3559999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69199999999999995,"15min":0.71999999999999997},"min":{"1min":0.52400000000000002,"5min":0.45700000000000002,"15min":0.40200000000000002},"max":{"1min":0.875,"5min":0.998,"15min":1.7869999999999999},"last":0.57299999999999995}]},{"osd":2,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69999999999999996,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.46300000000000002,"15min":0.44900000000000001},"max":{"1min":0.85599999999999998,"5min":0.98399999999999999,"15min":1.9430000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69999999999999996,"15min":0.73999999999999999},"min":{"1min":0.50600000000000001,"5min":0.48199999999999998,"15min":0.44900000000000001},"max":{"1min":0.98299999999999998,"5min":1.262,"15min":2.6629999999999998},"last":0.64700000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69099999999999995,"15min":0.71299999999999997},"min":{"1min":0.53500000000000003,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.749},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.88300000000000001,"5min":1.0569999999999999,"15min":1.827},"last":0.67300000000000004}]},{"osd":4,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.622,"15min":0.60099999999999998},"min":{"1min":0.44400000000000001,"5min":0.35299999999999998,"15min":0.35099999999999998},"max":{"1min":0.93999999999999995,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.42399999999999999,"5min":0.40300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79600000000000004,"5min":1.1850000000000001,"15min":2.577},"last":0.65800000000000003}]},{"osd":5,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66500000000000004,"15min":0.66600000000000004},"min":{"1min":0.48199999999999998,"5min":0.40699999999999997,"15min":0.40100000000000002},"max":{"1min":0.92900000000000005,"5min":1.0960000000000001,"15min":2.5169999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68500000000000005,"15min":0.69799999999999995},"min":{"1min":0.495,"5min":0.46500000000000002,"15min":0.45200000000000001},"max":{"1min":0.83899999999999997,"5min":1.141,"15min":2.9590000000000001},"last":0.80700000000000005}]},{"osd":6,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.748},"min":{"1min":0.54000000000000004,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89100000000000001,"5min":1.1000000000000001,"15min":3.0019999999999998},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.498,"5min":0.374,"15min":0.374},"max":{"1min":0.94199999999999995,"5min":1.0740000000000001,"15min":2.4039999999999999},"last":0.75700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575068,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302996,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068844,"statfs":{"total":96636764160,"available":96326496256,"internally_reserved":0,"allocated":1650688,"data_stored":809638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.69199999999999995,"15min":0.71199999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86799999999999999,"5min":1.238,"15min":1.238},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66000000000000003,"15min":0.69999999999999996},"min":{"1min":0.439,"5min":0.41899999999999998,"15min":0.36599999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.079},"last":0.48099999999999998}]},{"osd":1,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68000000000000005,"15min":0.71699999999999997},"min":{"1min":0.45100000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.83299999999999996,"5min":0.97199999999999998,"15min":1.135},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.016,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.65500000000000003}]},{"osd":2,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.73299999999999998},"min":{"1min":0.51100000000000001,"5min":0.438,"15min":0.42599999999999999},"max":{"1min":0.96799999999999997,"5min":1.0109999999999999,"15min":1.391},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69799999999999995,"15min":0.73099999999999998},"min":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.109,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.68600000000000005}]},{"osd":3,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.68500000000000005,"15min":0.70399999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.40600000000000003},"max":{"1min":0.86599999999999999,"5min":0.98099999999999998,"15min":1.0069999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.70699999999999996,"15min":0.75},"min":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.497},"max":{"1min":0.86299999999999999,"5min":1.0169999999999999,"15min":1.4750000000000001},"last":0.58799999999999997}]},{"osd":4,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60799999999999998,"15min":0.61899999999999999},"min":{"1min":0.45200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.871,"5min":1.329,"15min":1.768},"last":0.38},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63,"15min":0.623},"min":{"1min":0.44900000000000001,"5min":0.39100000000000001,"15min":0.36199999999999999},"max":{"1min":0.84599999999999997,"5min":0.98399999999999999,"15min":1.601},"last":0.67200000000000004}]},{"osd":5,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.40200000000000002},"max":{"1min":0.82299999999999995,"5min":1.0149999999999999,"15min":1.7609999999999999},"last":0.498},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.69199999999999995,"15min":0.69399999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91100000000000003,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.71099999999999997}]},{"osd":7,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67800000000000005,"15min":0.67900000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91400000000000003,"5min":1.046,"15min":1.2949999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.72699999999999998},"min":{"1min":0.52300000000000002,"5min":0.45300000000000001,"15min":0.42399999999999999},"max":{"1min":0.997,"5min":1.054,"15min":1.8320000000000001},"last":0.54700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575069,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302996,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068844,"statfs":{"total":96636764160,"available":96326496256,"internally_reserved":0,"allocated":1650688,"data_stored":809638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45000000000000001,"15min":0.45700000000000002},"min":{"1min":0.33800000000000002,"5min":0.26600000000000001,"15min":0.25900000000000001},"max":{"1min":0.67700000000000005,"5min":2.153,"15min":2.153},"last":0.436},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.36299999999999999,"5min":0.29399999999999998,"15min":0.26300000000000001},"max":{"1min":0.77300000000000002,"5min":1.1879999999999999,"15min":1.23},"last":0.42099999999999999}]},{"osd":2,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.68999999999999995,"5min":0.72199999999999998,"15min":1.169},"last":0.504},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56399999999999995,"15min":0.57699999999999996},"min":{"1min":0.441,"5min":0.38300000000000001,"15min":0.34100000000000003},"max":{"1min":0.73499999999999999,"5min":1.3500000000000001,"15min":3.077},"last":0.53700000000000003}]},{"osd":3,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59799999999999998,"15min":0.60999999999999999},"min":{"1min":0.47799999999999998,"5min":0.40000000000000002,"15min":0.376},"max":{"1min":0.77900000000000003,"5min":1.6839999999999999,"15min":1.7709999999999999},"last":0.495},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":0.79000000000000004,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.51300000000000001}]},{"osd":4,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.748,"15min":0.755},"min":{"1min":0.56499999999999995,"5min":0.46700000000000003,"15min":0.38700000000000001},"max":{"1min":1.069,"5min":1.069,"15min":1.6739999999999999},"last":0.754},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.58099999999999996,"5min":0.51200000000000001,"15min":0.48599999999999999},"max":{"1min":0.98999999999999999,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.81999999999999995}]},{"osd":5,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.54000000000000004,"5min":0.53400000000000003,"15min":0.48099999999999998},"max":{"1min":1.016,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.749,"15min":0.77000000000000002},"min":{"1min":0.56499999999999995,"5min":0.52100000000000002,"15min":0.47999999999999998},"max":{"1min":0.98399999999999999,"5min":1.1040000000000001,"15min":1.637},"last":0.71399999999999997}]},{"osd":6,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79300000000000004,"15min":0.79800000000000004},"min":{"1min":0.626,"5min":0.54600000000000004,"15min":0.48399999999999999},"max":{"1min":1.2769999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.626,"5min":0.504,"15min":0.504},"max":{"1min":0.96399999999999997,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.626}]},{"osd":7,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82599999999999996,"15min":0.82899999999999996},"min":{"1min":0.621,"5min":0.54400000000000004,"15min":0.51700000000000002},"max":{"1min":1.2949999999999999,"5min":3.4350000000000001,"15min":3.4350000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78900000000000003,"15min":0.81399999999999995},"min":{"1min":0.56499999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.179},"last":0.77500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575068,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303576,"kb_used_data":2192,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068264,"statfs":{"total":96636764160,"available":96325902336,"internally_reserved":0,"allocated":2244608,"data_stored":1400006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47599999999999998,"15min":0.46899999999999997},"min":{"1min":0.31900000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.73499999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51200000000000001,"15min":0.53800000000000003},"min":{"1min":0.32100000000000001,"5min":0.315,"15min":0.28899999999999998},"max":{"1min":0.78000000000000003,"5min":2.1379999999999999,"15min":4.5819999999999999},"last":0.39100000000000001}]},{"osd":2,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.52800000000000002,"15min":0.55600000000000005},"min":{"1min":0.38400000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.69799999999999995,"5min":2.1720000000000002,"15min":4.6980000000000004},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48599999999999999,"15min":0.499},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.626,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.35999999999999999}]},{"osd":3,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.53300000000000003,"15min":0.53200000000000003},"min":{"1min":0.38500000000000001,"5min":0.34300000000000003,"15min":0.33200000000000002},"max":{"1min":0.75600000000000001,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58599999999999997,"15min":0.61199999999999999},"min":{"1min":0.46000000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71199999999999997,"5min":2.1989999999999998,"15min":4.734},"last":0.373}]},{"osd":4,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.42799999999999999},"max":{"1min":0.94999999999999996,"5min":2.339,"15min":2.339},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75,"15min":0.79000000000000004},"min":{"1min":0.55400000000000005,"5min":0.50700000000000001,"15min":0.39500000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":4.6619999999999999},"last":0.67100000000000004}]},{"osd":5,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.746,"15min":0.76800000000000002},"min":{"1min":0.52600000000000002,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":0.89300000000000002,"5min":1.0349999999999999,"15min":1.1890000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78100000000000003,"15min":0.79100000000000004},"min":{"1min":0.50600000000000001,"5min":0.5,"15min":0.45600000000000002},"max":{"1min":0.96399999999999997,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":0.71999999999999997}]},{"osd":6,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76300000000000001,"15min":0.80300000000000005},"min":{"1min":0.60199999999999998,"5min":0.5,"15min":0.48599999999999999},"max":{"1min":0.98199999999999998,"5min":1.05,"15min":4.6239999999999997},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.55900000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.034,"5min":1.0640000000000001,"15min":1.2689999999999999},"last":0.83899999999999997}]},{"osd":7,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80000000000000004,"15min":0.82299999999999995},"min":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.46400000000000002},"max":{"1min":0.96699999999999997,"5min":1.0760000000000001,"15min":1.256},"last":0.746},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.83599999999999997,"15min":0.84599999999999997},"min":{"1min":0.59399999999999997,"5min":0.57599999999999996,"15min":0.51800000000000002},"max":{"1min":0.995,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.80900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575069,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311236,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060604,"statfs":{"total":96636764160,"available":96318058496,"internally_reserved":0,"allocated":1699840,"data_stored":836437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.42999999999999999,"15min":0.45400000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.25900000000000001},"max":{"1min":0.54600000000000004,"5min":0.79800000000000004,"15min":1.8149999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.47199999999999998,"15min":0.49199999999999999},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28000000000000003},"max":{"1min":0.63100000000000001,"5min":0.68100000000000005,"15min":1.633},"last":0.38400000000000001}]},{"osd":1,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44900000000000001,"15min":0.46999999999999997},"min":{"1min":0.316,"5min":0.29499999999999998,"15min":0.28999999999999998},"max":{"1min":0.66700000000000004,"5min":0.71599999999999997,"15min":1.097},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.49099999999999999,"15min":0.50800000000000001},"min":{"1min":0.35099999999999998,"5min":0.32900000000000001,"15min":0.309},"max":{"1min":0.65700000000000003,"5min":0.79700000000000004,"15min":1.2689999999999999},"last":0.46000000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55700000000000005,"15min":0.58299999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69999999999999996,"5min":0.82599999999999996,"15min":0.87},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.59199999999999997,"15min":0.60899999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.35699999999999998},"max":{"1min":0.64700000000000002,"5min":0.83899999999999997,"15min":1.1890000000000001},"last":0.499}]},{"osd":4,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.74299999999999999,"15min":0.76400000000000001},"min":{"1min":0.55100000000000005,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":0.84299999999999997,"5min":1.1379999999999999,"15min":1.256},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72499999999999998,"15min":0.75600000000000001},"min":{"1min":0.501,"5min":0.48799999999999999,"15min":0.44800000000000001},"max":{"1min":0.88500000000000001,"5min":1.171,"15min":1.696},"last":0.79600000000000004}]},{"osd":5,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73699999999999999,"15min":0.76800000000000002},"min":{"1min":0.60399999999999998,"5min":0.505,"15min":0.42399999999999999},"max":{"1min":0.95399999999999996,"5min":1.143,"15min":1.3049999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.748,"15min":0.77600000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.503},"max":{"1min":1.038,"5min":1.0629999999999999,"15min":1.3440000000000001},"last":0.81000000000000005}]},{"osd":6,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.76300000000000001,"15min":0.77900000000000003},"min":{"1min":0.53900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91100000000000003,"5min":1.115,"15min":1.768},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.78200000000000003},"min":{"1min":0.53500000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.98899999999999999,"5min":1.101,"15min":1.5309999999999999},"last":0.69999999999999996}]},{"osd":7,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.77100000000000002,"15min":0.80100000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.54600000000000004},"max":{"1min":0.93700000000000006,"5min":1.0389999999999999,"15min":1.7370000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.82099999999999995},"min":{"1min":0.64500000000000002,"5min":0.57099999999999995,"15min":0.50900000000000001},"max":{"1min":0.97899999999999998,"5min":1.0409999999999999,"15min":1.3939999999999999},"last":0.82299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575070,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307156,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064684,"statfs":{"total":96636764160,"available":96322236416,"internally_reserved":0,"allocated":1716224,"data_stored":838043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45300000000000001,"15min":0.46800000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.60099999999999998,"5min":0.86299999999999999,"15min":0.94299999999999995},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.47099999999999997,"15min":0.49099999999999999},"min":{"1min":0.32900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55500000000000005,"5min":0.81799999999999995,"15min":1.228},"last":0.38100000000000001}]},{"osd":1,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46899999999999997,"15min":0.47999999999999998},"min":{"1min":0.34599999999999997,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.65800000000000003,"5min":0.81899999999999995,"15min":2.0800000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.55000000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.247},"max":{"1min":0.68500000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41199999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55600000000000005,"15min":0.57899999999999996},"min":{"1min":0.39000000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73199999999999998,"5min":0.94099999999999995,"15min":2.3959999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.61699999999999999,"15min":0.63200000000000001},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.309},"max":{"1min":0.75,"5min":0.97699999999999998,"15min":3.8900000000000001},"last":0.59299999999999997}]},{"osd":4,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.71699999999999997,"15min":0.73699999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40799999999999997},"max":{"1min":1.014,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.871},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79600000000000004,"15min":0.81999999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.55300000000000005},"max":{"1min":0.96099999999999997,"5min":1.22,"15min":1.22},"last":0.82199999999999995}]},{"osd":5,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94799999999999995,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.628},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.76600000000000001,"15min":0.79600000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.98799999999999999,"5min":1.1519999999999999,"15min":1.1830000000000001},"last":0.64500000000000002}]},{"osd":6,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.753,"15min":0.77400000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.51700000000000002},"max":{"1min":0.93999999999999995,"5min":1.304,"15min":1.304},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.73899999999999999,"15min":0.77400000000000002},"min":{"1min":0.53100000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.016,"5min":1.1579999999999999,"15min":1.7769999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78200000000000003,"15min":0.81299999999999994},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1,"5min":1.2629999999999999,"15min":1.8180000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.78000000000000003,"15min":0.81599999999999995},"min":{"1min":0.58199999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.056,"5min":1.1919999999999999,"15min":1.486},"last":0.80400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575068,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311188,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060652,"statfs":{"total":96636764160,"available":96318107648,"internally_reserved":0,"allocated":1650688,"data_stored":809638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69899999999999995,"15min":0.70999999999999996},"min":{"1min":0.45000000000000001,"5min":0.35899999999999999,"15min":0.29799999999999999},"max":{"1min":1.109,"5min":1.5609999999999999,"15min":3.1139999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.71499999999999997,"15min":0.72299999999999998},"min":{"1min":0.47399999999999998,"5min":0.39900000000000002,"15min":0.39300000000000002},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.8130000000000002},"last":0.629}]},{"osd":1,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68799999999999994,"15min":0.71599999999999997},"min":{"1min":0.47199999999999998,"5min":0.39500000000000002,"15min":0.373},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.9279999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71299999999999997,"15min":0.73799999999999999},"min":{"1min":0.54000000000000004,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3129999999999999,"5min":1.4339999999999999,"15min":3.4359999999999999},"last":0.872}]},{"osd":2,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.72799999999999998,"15min":0.755},"min":{"1min":0.52900000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74199999999999999,"15min":0.77400000000000002},"min":{"1min":0.54900000000000004,"5min":0.48299999999999998,"15min":0.47599999999999998},"max":{"1min":0.98999999999999999,"5min":1.0129999999999999,"15min":2.427},"last":0.81200000000000006}]},{"osd":3,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.72899999999999998,"15min":0.74399999999999999},"min":{"1min":0.46999999999999997,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.8239999999999998,"5min":2.8239999999999998,"15min":2.8239999999999998},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.749},"min":{"1min":0.56499999999999995,"5min":0.443,"15min":0.43099999999999999},"max":{"1min":1.077,"5min":1.077,"15min":3.6899999999999999},"last":0.84399999999999997}]},{"osd":5,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.32700000000000001,"15min":0.317},"max":{"1min":2.234,"5min":2.234,"15min":3.3860000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.65200000000000002,"15min":0.65000000000000002},"min":{"1min":0.436,"5min":0.40999999999999998,"15min":0.34999999999999998},"max":{"1min":2.8690000000000002,"5min":2.8690000000000002,"15min":3.9300000000000002},"last":0.82899999999999996}]},{"osd":6,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.45800000000000002,"5min":0.42299999999999999,"15min":0.36499999999999999},"max":{"1min":1.262,"5min":1.262,"15min":3.5270000000000001},"last":0.747},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68500000000000005,"15min":0.68000000000000005},"min":{"1min":0.48899999999999999,"5min":0.42499999999999999,"15min":0.374},"max":{"1min":1.369,"5min":1.587,"15min":3.4740000000000002},"last":0.67700000000000005}]},{"osd":7,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.73299999999999998,"15min":0.72599999999999998},"min":{"1min":0.59399999999999997,"5min":0.44,"15min":0.34699999999999998},"max":{"1min":2.9049999999999998,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":1.004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.439},"max":{"1min":1.133,"5min":1.1899999999999999,"15min":3.7280000000000002},"last":0.97599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575069,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302996,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068844,"statfs":{"total":96636764160,"available":96326496256,"internally_reserved":0,"allocated":1650688,"data_stored":809638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66300000000000003,"15min":0.68799999999999994},"min":{"1min":0.45400000000000001,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.85299999999999998,"5min":0.93600000000000005,"15min":0.96999999999999997},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65500000000000003,"15min":0.67800000000000005},"min":{"1min":0.47099999999999997,"5min":0.379,"15min":0.32900000000000001},"max":{"1min":1.024,"5min":1.119,"15min":1.119},"last":0.754}]},{"osd":1,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66000000000000003,"15min":0.67900000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39700000000000002},"max":{"1min":0.84599999999999997,"5min":1.0029999999999999,"15min":1.034},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.69899999999999995,"15min":0.71499999999999997},"min":{"1min":0.52200000000000002,"5min":0.45400000000000001,"15min":0.40400000000000003},"max":{"1min":0.79500000000000004,"5min":0.95099999999999996,"15min":1.0229999999999999},"last":0.66700000000000004}]},{"osd":2,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68999999999999995,"15min":0.71699999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.47299999999999998},"max":{"1min":0.81000000000000005,"5min":0.997,"15min":1.0580000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.68100000000000005,"15min":0.70299999999999996},"min":{"1min":0.48099999999999998,"5min":0.46200000000000002,"15min":0.442},"max":{"1min":0.88100000000000001,"5min":0.97799999999999998,"15min":1.0720000000000001},"last":0.72599999999999998}]},{"osd":3,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70099999999999996,"15min":0.71199999999999997},"min":{"1min":0.51300000000000001,"5min":0.46300000000000002,"15min":0.435},"max":{"1min":0.96299999999999997,"5min":1.1499999999999999,"15min":1.302},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.54000000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93600000000000005,"5min":1.03,"15min":1.399},"last":0.64000000000000001}]},{"osd":4,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.621,"15min":0.60199999999999998},"min":{"1min":0.44900000000000001,"5min":0.377,"15min":0.36099999999999999},"max":{"1min":0.89000000000000001,"5min":0.96099999999999997,"15min":0.96799999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.42099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.002,"5min":1.075,"15min":1.075},"last":0.59999999999999998}]},{"osd":6,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63300000000000001,"15min":0.628},"min":{"1min":0.439,"5min":0.41099999999999998,"15min":0.36599999999999999},"max":{"1min":0.94299999999999995,"5min":1.0049999999999999,"15min":1.018},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68700000000000006,"15min":0.67100000000000004},"min":{"1min":0.48499999999999999,"5min":0.41199999999999998,"15min":0.38900000000000001},"max":{"1min":0.95299999999999996,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.625}]},{"osd":7,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68799999999999994,"15min":0.68300000000000005},"min":{"1min":0.499,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.048,"5min":1.48,"15min":1.48},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76700000000000002,"15min":0.76400000000000001},"min":{"1min":0.59499999999999997,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0189999999999999,"5min":1.466,"15min":1.466},"last":0.77000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T07:01:27.924 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T07:01:28.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.138+0000 7fe20b59e700 1 Processor -- start 2023-10-09T07:01:28.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.139+0000 7fe20b59e700 1 -- start start 2023-10-09T07:01:28.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.140+0000 7fe20b59e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe20c150550 0x7fe20c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:28.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.140+0000 7fe20b59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe20c0c7410 0x7fe20c069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:28.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.140+0000 7fe20b59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe20c06e2a0 con 0x7fe20c150180 2023-10-09T07:01:28.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.140+0000 7fe20b59e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe20c06b2e0 con 0x7fe20c150550 2023-10-09T07:01:28.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.140+0000 7fe20b59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe20c0c78e0 con 0x7fe20c0c7410 2023-10-09T07:01:28.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.140+0000 7fe209d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe20c150550 0x7fe20c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:28.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.140+0000 7fe209d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe20c150550 0x7fe20c157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40104/0 (socket says 172.21.15.71:40104) 2023-10-09T07:01:28.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.140+0000 7fe209d9b700 1 -- 172.21.15.71:0/1119821132 learned_addr learned my addr 172.21.15.71:0/1119821132 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:28.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.140+0000 7fe20ad9d700 1 --2- 172.21.15.71:0/1119821132 >> v2:172.21.15.179:3300/0 conn(0x7fe20c0c7410 0x7fe20c069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:28.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.141+0000 7fe209d9b700 1 -- 172.21.15.71:0/1119821132 >> v2:172.21.15.179:3300/0 conn(0x7fe20c0c7410 msgr2=0x7fe20c069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:28.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.141+0000 7fe209d9b700 1 --2- 172.21.15.71:0/1119821132 >> v2:172.21.15.179:3300/0 conn(0x7fe20c0c7410 0x7fe20c069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:28.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.141+0000 7fe209d9b700 1 -- 172.21.15.71:0/1119821132 >> v1:172.21.15.179:6789/0 conn(0x7fe20c150180 legacy=0x7fe20c0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:28.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.141+0000 7fe209d9b700 1 -- 172.21.15.71:0/1119821132 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20c0c7bc0 con 0x7fe20c150550 2023-10-09T07:01:28.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.141+0000 7fe20ad9d700 1 --2- 172.21.15.71:0/1119821132 >> v2:172.21.15.179:3300/0 conn(0x7fe20c0c7410 0x7fe20c069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:01:28.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.141+0000 7fe209d9b700 1 --2- 172.21.15.71:0/1119821132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe20c150550 0x7fe20c157770 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fe20c156270 tx=0x7fe200009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174f255c3d0105c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:28.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.141+0000 7fe20959a700 1 -- 172.21.15.71:0/1119821132 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20000b820 con 0x7fe20c150550 2023-10-09T07:01:28.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.141+0000 7fe20959a700 1 -- 172.21.15.71:0/1119821132 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20000b980 con 0x7fe20c150550 2023-10-09T07:01:28.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.141+0000 7fe20959a700 1 -- 172.21.15.71:0/1119821132 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20000bd20 con 0x7fe20c150550 2023-10-09T07:01:28.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.141+0000 7fe20b59e700 1 -- 172.21.15.71:0/1119821132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe20c150550 msgr2=0x7fe20c157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:28.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.141+0000 7fe20b59e700 1 --2- 172.21.15.71:0/1119821132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe20c150550 0x7fe20c157770 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fe20c156270 tx=0x7fe200009250 comp rx=0 tx=0).stop 2023-10-09T07:01:28.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.142+0000 7fe20b59e700 1 -- 172.21.15.71:0/1119821132 shutdown_connections 2023-10-09T07:01:28.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.142+0000 7fe20b59e700 1 --2- 172.21.15.71:0/1119821132 >> v2:172.21.15.179:3300/0 conn(0x7fe20c0c7410 0x7fe20c069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:28.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.142+0000 7fe20b59e700 1 --2- 172.21.15.71:0/1119821132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe20c150550 0x7fe20c157770 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:28.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.142+0000 7fe20b59e700 1 -- 172.21.15.71:0/1119821132 >> 172.21.15.71:0/1119821132 conn(0x7fe20c0cc1f0 msgr2=0x7fe20c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:28.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.142+0000 7fe20b59e700 1 -- 172.21.15.71:0/1119821132 shutdown_connections 2023-10-09T07:01:28.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.142+0000 7fe20b59e700 1 -- 172.21.15.71:0/1119821132 wait complete. 2023-10-09T07:01:28.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.143+0000 7fe20b59e700 1 Processor -- start 2023-10-09T07:01:28.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.143+0000 7fe20b59e700 1 -- start start 2023-10-09T07:01:28.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.144+0000 7fe20b59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe20c0c7410 0x7fe20c0ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:28.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.144+0000 7fe20b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe20c150180 0x7fe20c0c1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:28.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.144+0000 7fe20b59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe20c150550 0x7fe20c154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:28.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.144+0000 7fe20b59e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c0afc10 con 0x7fe20c150550 2023-10-09T07:01:28.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.144+0000 7fe20b59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c0afda0 con 0x7fe20c0c7410 2023-10-09T07:01:28.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.144+0000 7fe20b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c0ad8c0 con 0x7fe20c150180 2023-10-09T07:01:28.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.144+0000 7fe20ad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe20c150550 0x7fe20c154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:28.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.144+0000 7fe20ad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe20c150550 0x7fe20c154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40118/0 (socket says 172.21.15.71:40118) 2023-10-09T07:01:28.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.144+0000 7fe20ad9d700 1 -- 172.21.15.71:0/1480933959 learned_addr learned my addr 172.21.15.71:0/1480933959 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:28.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.144+0000 7fe20a59c700 1 --2- 172.21.15.71:0/1480933959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe20c0c7410 0x7fe20c0ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:28.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.144+0000 7fe209d9b700 1 --2- 172.21.15.71:0/1480933959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe20c150180 0x7fe20c0c1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:28.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.145+0000 7fe20ad9d700 1 -- 172.21.15.71:0/1480933959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe20c150180 msgr2=0x7fe20c0c1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:28.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.145+0000 7fe20ad9d700 1 --2- 172.21.15.71:0/1480933959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe20c150180 0x7fe20c0c1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:28.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.145+0000 7fe20ad9d700 1 -- 172.21.15.71:0/1480933959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe20c0c7410 msgr2=0x7fe20c0ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:28.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.145+0000 7fe20ad9d700 1 --2- 172.21.15.71:0/1480933959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe20c0c7410 0x7fe20c0ad230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:28.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.145+0000 7fe20ad9d700 1 -- 172.21.15.71:0/1480933959 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2000094f0 con 0x7fe20c150550 2023-10-09T07:01:28.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.145+0000 7fe20a59c700 1 --2- 172.21.15.71:0/1480933959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe20c0c7410 0x7fe20c0ad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:01:28.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.145+0000 7fe20ad9d700 1 --2- 172.21.15.71:0/1480933959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe20c150550 0x7fe20c154d30 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fe20400cef0 tx=0x7fe204007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:28.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.145+0000 7fe1fa7fc700 1 -- 172.21.15.71:0/1480933959 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20400ae30 con 0x7fe20c150550 2023-10-09T07:01:28.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.145+0000 7fe1fa7fc700 1 -- 172.21.15.71:0/1480933959 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe204016420 con 0x7fe20c150550 2023-10-09T07:01:28.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.145+0000 7fe1fa7fc700 1 -- 172.21.15.71:0/1480933959 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2040167e0 con 0x7fe20c150550 2023-10-09T07:01:28.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.145+0000 7fe20b59e700 1 -- 172.21.15.71:0/1480933959 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe20c0adba0 con 0x7fe20c150550 2023-10-09T07:01:28.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.145+0000 7fe20b59e700 1 -- 172.21.15.71:0/1480933959 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20c0ae160 con 0x7fe20c150550 2023-10-09T07:01:28.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.146+0000 7fe20b59e700 1 -- 172.21.15.71:0/1480933959 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe20c04c3c0 con 0x7fe20c150550 2023-10-09T07:01:28.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.147+0000 7fe1fa7fc700 1 -- 172.21.15.71:0/1480933959 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe204016bd0 con 0x7fe20c150550 2023-10-09T07:01:28.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.149+0000 7fe1fa7fc700 1 --2- 172.21.15.71:0/1480933959 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe1ec066f30 0x7fe1ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:28.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.149+0000 7fe1fa7fc700 1 -- 172.21.15.71:0/1480933959 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6125+0+0 (secure 0 0 0) 0x7fe204012070 con 0x7fe20c150550 2023-10-09T07:01:28.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.149+0000 7fe20a59c700 1 --2- 172.21.15.71:0/1480933959 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe1ec066f30 0x7fe1ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:28.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.150+0000 7fe20a59c700 1 --2- 172.21.15.71:0/1480933959 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe1ec066f30 0x7fe1ec0693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc006fd0 tx=0x7fe1fc008040 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:28.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.153+0000 7fe1fa7fc700 1 -- 172.21.15.71:0/1480933959 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2040521f0 con 0x7fe20c150550 2023-10-09T07:01:28.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.341+0000 7fe20b59e700 1 -- 172.21.15.71:0/1480933959 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe20c0afee0 con 0x7fe1ec066f30 2023-10-09T07:01:28.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.351+0000 7fe1fa7fc700 1 -- 172.21.15.71:0/1480933959 <== mgr.7627 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289508 (secure 0 0 0) 0x7fe20c0afee0 con 0x7fe1ec066f30 2023-10-09T07:01:28.355 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:01:28.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.355+0000 7fe20b59e700 1 -- 172.21.15.71:0/1480933959 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe1ec066f30 msgr2=0x7fe1ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:28.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.355+0000 7fe20b59e700 1 --2- 172.21.15.71:0/1480933959 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe1ec066f30 0x7fe1ec0693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc006fd0 tx=0x7fe1fc008040 comp rx=0 tx=0).stop 2023-10-09T07:01:28.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.355+0000 7fe20b59e700 1 -- 172.21.15.71:0/1480933959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe20c150550 msgr2=0x7fe20c154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:28.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.355+0000 7fe20b59e700 1 --2- 172.21.15.71:0/1480933959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe20c150550 0x7fe20c154d30 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fe20400cef0 tx=0x7fe204007830 comp rx=0 tx=0).stop 2023-10-09T07:01:28.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.355+0000 7fe20b59e700 1 -- 172.21.15.71:0/1480933959 shutdown_connections 2023-10-09T07:01:28.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.355+0000 7fe20b59e700 1 --2- 172.21.15.71:0/1480933959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe20c150550 0x7fe20c154d30 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:28.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.355+0000 7fe20b59e700 1 --2- 172.21.15.71:0/1480933959 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe1ec066f30 0x7fe1ec0693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:28.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.355+0000 7fe20b59e700 1 --2- 172.21.15.71:0/1480933959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe20c0c7410 0x7fe20c0ad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:28.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.355+0000 7fe20b59e700 1 --2- 172.21.15.71:0/1480933959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe20c150180 0x7fe20c0c1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:28.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.355+0000 7fe20b59e700 1 -- 172.21.15.71:0/1480933959 >> 172.21.15.71:0/1480933959 conn(0x7fe20c0cc1f0 msgr2=0x7fe20c0c8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:28.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.355+0000 7fe20b59e700 1 -- 172.21.15.71:0/1480933959 shutdown_connections 2023-10-09T07:01:28.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.355+0000 7fe20b59e700 1 -- 172.21.15.71:0/1480933959 wait complete. 2023-10-09T07:01:28.359 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T07:01:28.374 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T07:01:28.076708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":443,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":287,"ondisk_log_size":287,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2446056,"kb_used_data":14504,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752528664,"statfs":{"total":773094113280,"available":770589351936,"internally_reserved":0,"allocated":14852096,"data_stored":7876844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001786"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169399+0000","last_change":"2023-10-09T07:01:23.164925+0000","last_active":"2023-10-09T07:01:23.169399+0000","last_peered":"2023-10-09T07:01:23.169399+0000","last_clean":"2023-10-09T07:01:23.169399+0000","last_became_active":"2023-10-09T07:01:23.164650+0000","last_became_peered":"2023-10-09T07:01:23.164650+0000","last_unstale":"2023-10-09T07:01:23.169399+0000","last_undegraded":"2023-10-09T07:01:23.169399+0000","last_fullsized":"2023-10-09T07:01:23.169399+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:56:55.723335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160903+0000","last_change":"2023-10-09T07:01:23.152371+0000","last_active":"2023-10-09T07:01:23.160903+0000","last_peered":"2023-10-09T07:01:23.160903+0000","last_clean":"2023-10-09T07:01:23.160903+0000","last_became_active":"2023-10-09T07:01:23.149932+0000","last_became_peered":"2023-10-09T07:01:23.149932+0000","last_unstale":"2023-10-09T07:01:23.160903+0000","last_undegraded":"2023-10-09T07:01:23.160903+0000","last_fullsized":"2023-10-09T07:01:23.160903+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:28.489315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168628+0000","last_change":"2023-10-09T07:01:23.164403+0000","last_active":"2023-10-09T07:01:23.168628+0000","last_peered":"2023-10-09T07:01:23.168628+0000","last_clean":"2023-10-09T07:01:23.168628+0000","last_became_active":"2023-10-09T07:01:23.164108+0000","last_became_peered":"2023-10-09T07:01:23.164108+0000","last_unstale":"2023-10-09T07:01:23.168628+0000","last_undegraded":"2023-10-09T07:01:23.168628+0000","last_fullsized":"2023-10-09T07:01:23.168628+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:04:18.098519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169476+0000","last_change":"2023-10-09T07:01:23.162588+0000","last_active":"2023-10-09T07:01:23.169476+0000","last_peered":"2023-10-09T07:01:23.169476+0000","last_clean":"2023-10-09T07:01:23.169476+0000","last_became_active":"2023-10-09T07:01:23.162344+0000","last_became_peered":"2023-10-09T07:01:23.162344+0000","last_unstale":"2023-10-09T07:01:23.169476+0000","last_undegraded":"2023-10-09T07:01:23.169476+0000","last_fullsized":"2023-10-09T07:01:23.169476+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:51:21.311880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.155043+0000","last_change":"2023-10-09T07:01:23.151380+0000","last_active":"2023-10-09T07:01:23.155043+0000","last_peered":"2023-10-09T07:01:23.155043+0000","last_clean":"2023-10-09T07:01:23.155043+0000","last_became_active":"2023-10-09T07:01:23.151124+0000","last_became_peered":"2023-10-09T07:01:23.151124+0000","last_unstale":"2023-10-09T07:01:23.155043+0000","last_undegraded":"2023-10-09T07:01:23.155043+0000","last_fullsized":"2023-10-09T07:01:23.155043+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:42:28.704095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.150895+0000","last_change":"2023-10-09T07:01:23.147303+0000","last_active":"2023-10-09T07:01:23.150895+0000","last_peered":"2023-10-09T07:01:23.150895+0000","last_clean":"2023-10-09T07:01:23.150895+0000","last_became_active":"2023-10-09T07:01:23.147024+0000","last_became_peered":"2023-10-09T07:01:23.147024+0000","last_unstale":"2023-10-09T07:01:23.150895+0000","last_undegraded":"2023-10-09T07:01:23.150895+0000","last_fullsized":"2023-10-09T07:01:23.150895+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:09.967603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.156058+0000","last_change":"2023-10-09T07:01:23.152423+0000","last_active":"2023-10-09T07:01:23.156058+0000","last_peered":"2023-10-09T07:01:23.156058+0000","last_clean":"2023-10-09T07:01:23.156058+0000","last_became_active":"2023-10-09T07:01:23.151931+0000","last_became_peered":"2023-10-09T07:01:23.151931+0000","last_unstale":"2023-10-09T07:01:23.156058+0000","last_undegraded":"2023-10-09T07:01:23.156058+0000","last_fullsized":"2023-10-09T07:01:23.156058+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:44:26.423025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166540+0000","last_change":"2023-10-09T07:01:23.160836+0000","last_active":"2023-10-09T07:01:23.166540+0000","last_peered":"2023-10-09T07:01:23.166540+0000","last_clean":"2023-10-09T07:01:23.166540+0000","last_became_active":"2023-10-09T07:01:23.159642+0000","last_became_peered":"2023-10-09T07:01:23.159642+0000","last_unstale":"2023-10-09T07:01:23.166540+0000","last_undegraded":"2023-10-09T07:01:23.166540+0000","last_fullsized":"2023-10-09T07:01:23.166540+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:27:10.847597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169381+0000","last_change":"2023-10-09T07:01:23.162853+0000","last_active":"2023-10-09T07:01:23.169381+0000","last_peered":"2023-10-09T07:01:23.169381+0000","last_clean":"2023-10-09T07:01:23.169381+0000","last_became_active":"2023-10-09T07:01:23.162608+0000","last_became_peered":"2023-10-09T07:01:23.162608+0000","last_unstale":"2023-10-09T07:01:23.169381+0000","last_undegraded":"2023-10-09T07:01:23.169381+0000","last_fullsized":"2023-10-09T07:01:23.169381+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:14.698455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169349+0000","last_change":"2023-10-09T07:01:23.159296+0000","last_active":"2023-10-09T07:01:23.169349+0000","last_peered":"2023-10-09T07:01:23.169349+0000","last_clean":"2023-10-09T07:01:23.169349+0000","last_became_active":"2023-10-09T07:01:23.158849+0000","last_became_peered":"2023-10-09T07:01:23.158849+0000","last_unstale":"2023-10-09T07:01:23.169349+0000","last_undegraded":"2023-10-09T07:01:23.169349+0000","last_fullsized":"2023-10-09T07:01:23.169349+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:41:09.303760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160748+0000","last_change":"2023-10-09T07:01:23.153489+0000","last_active":"2023-10-09T07:01:23.160748+0000","last_peered":"2023-10-09T07:01:23.160748+0000","last_clean":"2023-10-09T07:01:23.160748+0000","last_became_active":"2023-10-09T07:01:23.153209+0000","last_became_peered":"2023-10-09T07:01:23.153209+0000","last_unstale":"2023-10-09T07:01:23.160748+0000","last_undegraded":"2023-10-09T07:01:23.160748+0000","last_fullsized":"2023-10-09T07:01:23.160748+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:11:02.068844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169360+0000","last_change":"2023-10-09T07:01:23.160349+0000","last_active":"2023-10-09T07:01:23.169360+0000","last_peered":"2023-10-09T07:01:23.169360+0000","last_clean":"2023-10-09T07:01:23.169360+0000","last_became_active":"2023-10-09T07:01:23.159129+0000","last_became_peered":"2023-10-09T07:01:23.159129+0000","last_unstale":"2023-10-09T07:01:23.169360+0000","last_undegraded":"2023-10-09T07:01:23.169360+0000","last_fullsized":"2023-10-09T07:01:23.169360+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:03.948952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.165795+0000","last_change":"2023-10-09T07:01:23.155784+0000","last_active":"2023-10-09T07:01:23.165795+0000","last_peered":"2023-10-09T07:01:23.165795+0000","last_clean":"2023-10-09T07:01:23.165795+0000","last_became_active":"2023-10-09T07:01:23.155491+0000","last_became_peered":"2023-10-09T07:01:23.155491+0000","last_unstale":"2023-10-09T07:01:23.165795+0000","last_undegraded":"2023-10-09T07:01:23.165795+0000","last_fullsized":"2023-10-09T07:01:23.165795+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:27:25.463240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166474+0000","last_change":"2023-10-09T07:01:23.159353+0000","last_active":"2023-10-09T07:01:23.166474+0000","last_peered":"2023-10-09T07:01:23.166474+0000","last_clean":"2023-10-09T07:01:23.166474+0000","last_became_active":"2023-10-09T07:01:23.158889+0000","last_became_peered":"2023-10-09T07:01:23.158889+0000","last_unstale":"2023-10-09T07:01:23.166474+0000","last_undegraded":"2023-10-09T07:01:23.166474+0000","last_fullsized":"2023-10-09T07:01:23.166474+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:51:05.796099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.155504+0000","last_change":"2023-10-09T07:01:23.149230+0000","last_active":"2023-10-09T07:01:23.155504+0000","last_peered":"2023-10-09T07:01:23.155504+0000","last_clean":"2023-10-09T07:01:23.155504+0000","last_became_active":"2023-10-09T07:01:23.148921+0000","last_became_peered":"2023-10-09T07:01:23.148921+0000","last_unstale":"2023-10-09T07:01:23.155504+0000","last_undegraded":"2023-10-09T07:01:23.155504+0000","last_fullsized":"2023-10-09T07:01:23.155504+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:01:52.583166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169227+0000","last_change":"2023-10-09T07:01:23.156333+0000","last_active":"2023-10-09T07:01:23.169227+0000","last_peered":"2023-10-09T07:01:23.169227+0000","last_clean":"2023-10-09T07:01:23.169227+0000","last_became_active":"2023-10-09T07:01:23.155976+0000","last_became_peered":"2023-10-09T07:01:23.155976+0000","last_unstale":"2023-10-09T07:01:23.169227+0000","last_undegraded":"2023-10-09T07:01:23.169227+0000","last_fullsized":"2023-10-09T07:01:23.169227+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:35.524873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160721+0000","last_change":"2023-10-09T07:01:23.153583+0000","last_active":"2023-10-09T07:01:23.160721+0000","last_peered":"2023-10-09T07:01:23.160721+0000","last_clean":"2023-10-09T07:01:23.160721+0000","last_became_active":"2023-10-09T07:01:23.153316+0000","last_became_peered":"2023-10-09T07:01:23.153316+0000","last_unstale":"2023-10-09T07:01:23.160721+0000","last_undegraded":"2023-10-09T07:01:23.160721+0000","last_fullsized":"2023-10-09T07:01:23.160721+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:39.937569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.163633+0000","last_change":"2023-10-09T07:01:23.160341+0000","last_active":"2023-10-09T07:01:23.163633+0000","last_peered":"2023-10-09T07:01:23.163633+0000","last_clean":"2023-10-09T07:01:23.163633+0000","last_became_active":"2023-10-09T07:01:23.160072+0000","last_became_peered":"2023-10-09T07:01:23.160072+0000","last_unstale":"2023-10-09T07:01:23.163633+0000","last_undegraded":"2023-10-09T07:01:23.163633+0000","last_fullsized":"2023-10-09T07:01:23.163633+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:11:02.068844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.165999+0000","last_change":"2023-10-09T07:01:23.156268+0000","last_active":"2023-10-09T07:01:23.165999+0000","last_peered":"2023-10-09T07:01:23.165999+0000","last_clean":"2023-10-09T07:01:23.165999+0000","last_became_active":"2023-10-09T07:01:23.155579+0000","last_became_peered":"2023-10-09T07:01:23.155579+0000","last_unstale":"2023-10-09T07:01:23.165999+0000","last_undegraded":"2023-10-09T07:01:23.165999+0000","last_fullsized":"2023-10-09T07:01:23.165999+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:29.980004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160306+0000","last_change":"2023-10-09T07:01:23.152079+0000","last_active":"2023-10-09T07:01:23.160306+0000","last_peered":"2023-10-09T07:01:23.160306+0000","last_clean":"2023-10-09T07:01:23.160306+0000","last_became_active":"2023-10-09T07:01:23.151814+0000","last_became_peered":"2023-10-09T07:01:23.151814+0000","last_unstale":"2023-10-09T07:01:23.160306+0000","last_undegraded":"2023-10-09T07:01:23.160306+0000","last_fullsized":"2023-10-09T07:01:23.160306+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:29.980004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.161043+0000","last_change":"2023-10-09T07:01:23.153002+0000","last_active":"2023-10-09T07:01:23.161043+0000","last_peered":"2023-10-09T07:01:23.161043+0000","last_clean":"2023-10-09T07:01:23.161043+0000","last_became_active":"2023-10-09T07:01:23.150740+0000","last_became_peered":"2023-10-09T07:01:23.150740+0000","last_unstale":"2023-10-09T07:01:23.161043+0000","last_undegraded":"2023-10-09T07:01:23.161043+0000","last_fullsized":"2023-10-09T07:01:23.161043+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:59.520657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.155518+0000","last_change":"2023-10-09T07:01:23.151375+0000","last_active":"2023-10-09T07:01:23.155518+0000","last_peered":"2023-10-09T07:01:23.155518+0000","last_clean":"2023-10-09T07:01:23.155518+0000","last_became_active":"2023-10-09T07:01:23.151112+0000","last_became_peered":"2023-10-09T07:01:23.151112+0000","last_unstale":"2023-10-09T07:01:23.155518+0000","last_undegraded":"2023-10-09T07:01:23.155518+0000","last_fullsized":"2023-10-09T07:01:23.155518+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:04.781425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160660+0000","last_change":"2023-10-09T07:01:23.152659+0000","last_active":"2023-10-09T07:01:23.160660+0000","last_peered":"2023-10-09T07:01:23.160660+0000","last_clean":"2023-10-09T07:01:23.160660+0000","last_became_active":"2023-10-09T07:01:23.150490+0000","last_became_peered":"2023-10-09T07:01:23.150490+0000","last_unstale":"2023-10-09T07:01:23.160660+0000","last_undegraded":"2023-10-09T07:01:23.160660+0000","last_fullsized":"2023-10-09T07:01:23.160660+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:04:18.098519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168542+0000","last_change":"2023-10-09T07:01:23.164581+0000","last_active":"2023-10-09T07:01:23.168542+0000","last_peered":"2023-10-09T07:01:23.168542+0000","last_clean":"2023-10-09T07:01:23.168542+0000","last_became_active":"2023-10-09T07:01:23.164337+0000","last_became_peered":"2023-10-09T07:01:23.164337+0000","last_unstale":"2023-10-09T07:01:23.168542+0000","last_undegraded":"2023-10-09T07:01:23.168542+0000","last_fullsized":"2023-10-09T07:01:23.168542+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:16.117929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160742+0000","last_change":"2023-10-09T07:01:23.154153+0000","last_active":"2023-10-09T07:01:23.160742+0000","last_peered":"2023-10-09T07:01:23.160742+0000","last_clean":"2023-10-09T07:01:23.160742+0000","last_became_active":"2023-10-09T07:01:23.153907+0000","last_became_peered":"2023-10-09T07:01:23.153907+0000","last_unstale":"2023-10-09T07:01:23.160742+0000","last_undegraded":"2023-10-09T07:01:23.160742+0000","last_fullsized":"2023-10-09T07:01:23.160742+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:13:13.307044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169370+0000","last_change":"2023-10-09T07:01:23.159971+0000","last_active":"2023-10-09T07:01:23.169370+0000","last_peered":"2023-10-09T07:01:23.169370+0000","last_clean":"2023-10-09T07:01:23.169370+0000","last_became_active":"2023-10-09T07:01:23.159558+0000","last_became_peered":"2023-10-09T07:01:23.159558+0000","last_unstale":"2023-10-09T07:01:23.169370+0000","last_undegraded":"2023-10-09T07:01:23.169370+0000","last_fullsized":"2023-10-09T07:01:23.169370+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:32:11.820612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169474+0000","last_change":"2023-10-09T07:01:23.163463+0000","last_active":"2023-10-09T07:01:23.169474+0000","last_peered":"2023-10-09T07:01:23.169474+0000","last_clean":"2023-10-09T07:01:23.169474+0000","last_became_active":"2023-10-09T07:01:23.163220+0000","last_became_peered":"2023-10-09T07:01:23.163220+0000","last_unstale":"2023-10-09T07:01:23.169474+0000","last_undegraded":"2023-10-09T07:01:23.169474+0000","last_fullsized":"2023-10-09T07:01:23.169474+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:54:03.877112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.167499+0000","last_change":"2023-10-09T07:01:23.163460+0000","last_active":"2023-10-09T07:01:23.167499+0000","last_peered":"2023-10-09T07:01:23.167499+0000","last_clean":"2023-10-09T07:01:23.167499+0000","last_became_active":"2023-10-09T07:01:23.163219+0000","last_became_peered":"2023-10-09T07:01:23.163219+0000","last_unstale":"2023-10-09T07:01:23.167499+0000","last_undegraded":"2023-10-09T07:01:23.167499+0000","last_fullsized":"2023-10-09T07:01:23.167499+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:35.224469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.161882+0000","last_change":"2023-10-09T07:01:23.157877+0000","last_active":"2023-10-09T07:01:23.161882+0000","last_peered":"2023-10-09T07:01:23.161882+0000","last_clean":"2023-10-09T07:01:23.161882+0000","last_became_active":"2023-10-09T07:01:23.156649+0000","last_became_peered":"2023-10-09T07:01:23.156649+0000","last_unstale":"2023-10-09T07:01:23.161882+0000","last_undegraded":"2023-10-09T07:01:23.161882+0000","last_fullsized":"2023-10-09T07:01:23.161882+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:03:43.822136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.155355+0000","last_change":"2023-10-09T07:01:23.147390+0000","last_active":"2023-10-09T07:01:23.155355+0000","last_peered":"2023-10-09T07:01:23.155355+0000","last_clean":"2023-10-09T07:01:23.155355+0000","last_became_active":"2023-10-09T07:01:23.147147+0000","last_became_peered":"2023-10-09T07:01:23.147147+0000","last_unstale":"2023-10-09T07:01:23.155355+0000","last_undegraded":"2023-10-09T07:01:23.155355+0000","last_fullsized":"2023-10-09T07:01:23.155355+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:12:47.806691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169117+0000","last_change":"2023-10-09T07:01:23.159774+0000","last_active":"2023-10-09T07:01:23.169117+0000","last_peered":"2023-10-09T07:01:23.169117+0000","last_clean":"2023-10-09T07:01:23.169117+0000","last_became_active":"2023-10-09T07:01:23.159430+0000","last_became_peered":"2023-10-09T07:01:23.159430+0000","last_unstale":"2023-10-09T07:01:23.169117+0000","last_undegraded":"2023-10-09T07:01:23.169117+0000","last_fullsized":"2023-10-09T07:01:23.169117+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:21:26.011332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.150788+0000","last_change":"2023-10-09T07:01:23.147125+0000","last_active":"2023-10-09T07:01:23.150788+0000","last_peered":"2023-10-09T07:01:23.150788+0000","last_clean":"2023-10-09T07:01:23.150788+0000","last_became_active":"2023-10-09T07:01:23.146875+0000","last_became_peered":"2023-10-09T07:01:23.146875+0000","last_unstale":"2023-10-09T07:01:23.150788+0000","last_undegraded":"2023-10-09T07:01:23.150788+0000","last_fullsized":"2023-10-09T07:01:23.150788+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:11:53.155142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.150752+0000","last_change":"2023-10-09T07:01:23.146731+0000","last_active":"2023-10-09T07:01:23.150752+0000","last_peered":"2023-10-09T07:01:23.150752+0000","last_clean":"2023-10-09T07:01:23.150752+0000","last_became_active":"2023-10-09T07:01:23.146485+0000","last_became_peered":"2023-10-09T07:01:23.146485+0000","last_unstale":"2023-10-09T07:01:23.150752+0000","last_undegraded":"2023-10-09T07:01:23.150752+0000","last_fullsized":"2023-10-09T07:01:23.150752+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:21:18.396544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"136'4","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166568+0000","last_change":"2023-10-09T07:01:22.147497+0000","last_active":"2023-10-09T07:01:23.166568+0000","last_peered":"2023-10-09T07:01:23.166568+0000","last_clean":"2023-10-09T07:01:23.166568+0000","last_became_active":"2023-10-09T07:01:22.147198+0000","last_became_peered":"2023-10-09T07:01:22.147198+0000","last_unstale":"2023-10-09T07:01:23.166568+0000","last_undegraded":"2023-10-09T07:01:23.166568+0000","last_fullsized":"2023-10-09T07:01:23.166568+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:13:32.149032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.155058+0000","last_change":"2023-10-09T07:01:23.152637+0000","last_active":"2023-10-09T07:01:23.155058+0000","last_peered":"2023-10-09T07:01:23.155058+0000","last_clean":"2023-10-09T07:01:23.155058+0000","last_became_active":"2023-10-09T07:01:23.152355+0000","last_became_peered":"2023-10-09T07:01:23.152355+0000","last_unstale":"2023-10-09T07:01:23.155058+0000","last_undegraded":"2023-10-09T07:01:23.155058+0000","last_fullsized":"2023-10-09T07:01:23.155058+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:39.937569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.165896+0000","last_change":"2023-10-09T07:01:22.147277+0000","last_active":"2023-10-09T07:01:23.165896+0000","last_peered":"2023-10-09T07:01:23.165896+0000","last_clean":"2023-10-09T07:01:23.165896+0000","last_became_active":"2023-10-09T07:01:22.146986+0000","last_became_peered":"2023-10-09T07:01:22.146986+0000","last_unstale":"2023-10-09T07:01:23.165896+0000","last_undegraded":"2023-10-09T07:01:23.165896+0000","last_fullsized":"2023-10-09T07:01:23.165896+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:06.347884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.145447+0000","last_change":"2023-10-09T07:01:23.143668+0000","last_active":"2023-10-09T07:01:23.145447+0000","last_peered":"2023-10-09T07:01:23.145447+0000","last_clean":"2023-10-09T07:01:23.145447+0000","last_became_active":"2023-10-09T07:01:23.143420+0000","last_became_peered":"2023-10-09T07:01:23.143420+0000","last_unstale":"2023-10-09T07:01:23.145447+0000","last_undegraded":"2023-10-09T07:01:23.145447+0000","last_fullsized":"2023-10-09T07:01:23.145447+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:48:55.565960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160700+0000","last_change":"2023-10-09T07:01:22.146764+0000","last_active":"2023-10-09T07:01:23.160700+0000","last_peered":"2023-10-09T07:01:23.160700+0000","last_clean":"2023-10-09T07:01:23.160700+0000","last_became_active":"2023-10-09T07:01:22.146458+0000","last_became_peered":"2023-10-09T07:01:22.146458+0000","last_unstale":"2023-10-09T07:01:23.160700+0000","last_undegraded":"2023-10-09T07:01:23.160700+0000","last_fullsized":"2023-10-09T07:01:23.160700+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:20:50.395740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166018+0000","last_change":"2023-10-09T07:01:23.156445+0000","last_active":"2023-10-09T07:01:23.166018+0000","last_peered":"2023-10-09T07:01:23.166018+0000","last_clean":"2023-10-09T07:01:23.166018+0000","last_became_active":"2023-10-09T07:01:23.155944+0000","last_became_peered":"2023-10-09T07:01:23.155944+0000","last_unstale":"2023-10-09T07:01:23.166018+0000","last_undegraded":"2023-10-09T07:01:23.166018+0000","last_fullsized":"2023-10-09T07:01:23.166018+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:11:02.068844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.167923+0000","last_change":"2023-10-09T07:01:22.147417+0000","last_active":"2023-10-09T07:01:23.167923+0000","last_peered":"2023-10-09T07:01:23.167923+0000","last_clean":"2023-10-09T07:01:23.167923+0000","last_became_active":"2023-10-09T07:01:22.147144+0000","last_became_peered":"2023-10-09T07:01:22.147144+0000","last_unstale":"2023-10-09T07:01:23.167923+0000","last_undegraded":"2023-10-09T07:01:23.167923+0000","last_fullsized":"2023-10-09T07:01:23.167923+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:36:25.395738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168942+0000","last_change":"2023-10-09T07:01:23.156307+0000","last_active":"2023-10-09T07:01:23.168942+0000","last_peered":"2023-10-09T07:01:23.168942+0000","last_clean":"2023-10-09T07:01:23.168942+0000","last_became_active":"2023-10-09T07:01:23.155881+0000","last_became_peered":"2023-10-09T07:01:23.155881+0000","last_unstale":"2023-10-09T07:01:23.168942+0000","last_undegraded":"2023-10-09T07:01:23.168942+0000","last_fullsized":"2023-10-09T07:01:23.168942+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:14:56.203090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160289+0000","last_change":"2023-10-09T07:01:22.147059+0000","last_active":"2023-10-09T07:01:23.160289+0000","last_peered":"2023-10-09T07:01:23.160289+0000","last_clean":"2023-10-09T07:01:23.160289+0000","last_became_active":"2023-10-09T07:01:22.146706+0000","last_became_peered":"2023-10-09T07:01:22.146706+0000","last_unstale":"2023-10-09T07:01:23.160289+0000","last_undegraded":"2023-10-09T07:01:23.160289+0000","last_fullsized":"2023-10-09T07:01:23.160289+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:55:52.026263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160279+0000","last_change":"2023-10-09T07:01:23.149840+0000","last_active":"2023-10-09T07:01:23.160279+0000","last_peered":"2023-10-09T07:01:23.160279+0000","last_clean":"2023-10-09T07:01:23.160279+0000","last_became_active":"2023-10-09T07:01:23.149547+0000","last_became_peered":"2023-10-09T07:01:23.149547+0000","last_unstale":"2023-10-09T07:01:23.160279+0000","last_undegraded":"2023-10-09T07:01:23.160279+0000","last_fullsized":"2023-10-09T07:01:23.160279+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:51:05.796099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.162203+0000","last_change":"2023-10-09T07:01:22.146261+0000","last_active":"2023-10-09T07:01:23.162203+0000","last_peered":"2023-10-09T07:01:23.162203+0000","last_clean":"2023-10-09T07:01:23.162203+0000","last_became_active":"2023-10-09T07:01:22.146020+0000","last_became_peered":"2023-10-09T07:01:22.146020+0000","last_unstale":"2023-10-09T07:01:23.162203+0000","last_undegraded":"2023-10-09T07:01:23.162203+0000","last_fullsized":"2023-10-09T07:01:23.162203+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:03:31.346374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169244+0000","last_change":"2023-10-09T07:01:23.161416+0000","last_active":"2023-10-09T07:01:23.169244+0000","last_peered":"2023-10-09T07:01:23.169244+0000","last_clean":"2023-10-09T07:01:23.169244+0000","last_became_active":"2023-10-09T07:01:23.156621+0000","last_became_peered":"2023-10-09T07:01:23.156621+0000","last_unstale":"2023-10-09T07:01:23.169244+0000","last_undegraded":"2023-10-09T07:01:23.169244+0000","last_fullsized":"2023-10-09T07:01:23.169244+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:17.826502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.138141+0000","last_change":"2023-10-09T07:01:22.152028+0000","last_active":"2023-10-09T07:01:23.138141+0000","last_peered":"2023-10-09T07:01:23.138141+0000","last_clean":"2023-10-09T07:01:23.138141+0000","last_became_active":"2023-10-09T07:01:22.151258+0000","last_became_peered":"2023-10-09T07:01:22.151258+0000","last_unstale":"2023-10-09T07:01:23.138141+0000","last_undegraded":"2023-10-09T07:01:23.138141+0000","last_fullsized":"2023-10-09T07:01:23.138141+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:51.157963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.156078+0000","last_change":"2023-10-09T07:01:23.152218+0000","last_active":"2023-10-09T07:01:23.156078+0000","last_peered":"2023-10-09T07:01:23.156078+0000","last_clean":"2023-10-09T07:01:23.156078+0000","last_became_active":"2023-10-09T07:01:23.151644+0000","last_became_peered":"2023-10-09T07:01:23.151644+0000","last_unstale":"2023-10-09T07:01:23.156078+0000","last_undegraded":"2023-10-09T07:01:23.156078+0000","last_fullsized":"2023-10-09T07:01:23.156078+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:35:21.844756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.149847+0000","last_change":"2023-10-09T07:01:22.147190+0000","last_active":"2023-10-09T07:01:23.149847+0000","last_peered":"2023-10-09T07:01:23.149847+0000","last_clean":"2023-10-09T07:01:23.149847+0000","last_became_active":"2023-10-09T07:01:22.145191+0000","last_became_peered":"2023-10-09T07:01:22.145191+0000","last_unstale":"2023-10-09T07:01:23.149847+0000","last_undegraded":"2023-10-09T07:01:23.149847+0000","last_fullsized":"2023-10-09T07:01:23.149847+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:57.874883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.155109+0000","last_change":"2023-10-09T07:01:23.146148+0000","last_active":"2023-10-09T07:01:23.155109+0000","last_peered":"2023-10-09T07:01:23.155109+0000","last_clean":"2023-10-09T07:01:23.155109+0000","last_became_active":"2023-10-09T07:01:23.145892+0000","last_became_peered":"2023-10-09T07:01:23.145892+0000","last_unstale":"2023-10-09T07:01:23.155109+0000","last_undegraded":"2023-10-09T07:01:23.155109+0000","last_fullsized":"2023-10-09T07:01:23.155109+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:28.309332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.139944+0000","last_change":"2023-10-09T07:01:22.150785+0000","last_active":"2023-10-09T07:01:23.139944+0000","last_peered":"2023-10-09T07:01:23.139944+0000","last_clean":"2023-10-09T07:01:23.139944+0000","last_became_active":"2023-10-09T07:01:22.150522+0000","last_became_peered":"2023-10-09T07:01:22.150522+0000","last_unstale":"2023-10-09T07:01:23.139944+0000","last_undegraded":"2023-10-09T07:01:23.139944+0000","last_fullsized":"2023-10-09T07:01:23.139944+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:05.488682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.165772+0000","last_change":"2023-10-09T07:01:23.162843+0000","last_active":"2023-10-09T07:01:23.165772+0000","last_peered":"2023-10-09T07:01:23.165772+0000","last_clean":"2023-10-09T07:01:23.165772+0000","last_became_active":"2023-10-09T07:01:23.162334+0000","last_became_peered":"2023-10-09T07:01:23.162334+0000","last_unstale":"2023-10-09T07:01:23.165772+0000","last_undegraded":"2023-10-09T07:01:23.165772+0000","last_fullsized":"2023-10-09T07:01:23.165772+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:13:13.307044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.141723+0000","last_change":"2023-10-09T07:01:22.146917+0000","last_active":"2023-10-09T07:01:23.141723+0000","last_peered":"2023-10-09T07:01:23.141723+0000","last_clean":"2023-10-09T07:01:23.141723+0000","last_became_active":"2023-10-09T07:01:22.146680+0000","last_became_peered":"2023-10-09T07:01:22.146680+0000","last_unstale":"2023-10-09T07:01:23.141723+0000","last_undegraded":"2023-10-09T07:01:23.141723+0000","last_fullsized":"2023-10-09T07:01:23.141723+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:27.481750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.161105+0000","last_change":"2023-10-09T07:01:23.159690+0000","last_active":"2023-10-09T07:01:23.161105+0000","last_peered":"2023-10-09T07:01:23.161105+0000","last_clean":"2023-10-09T07:01:23.161105+0000","last_became_active":"2023-10-09T07:01:23.159405+0000","last_became_peered":"2023-10-09T07:01:23.159405+0000","last_unstale":"2023-10-09T07:01:23.161105+0000","last_undegraded":"2023-10-09T07:01:23.161105+0000","last_fullsized":"2023-10-09T07:01:23.161105+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:44.249505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"136'3","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169834+0000","last_change":"2023-10-09T07:01:22.150732+0000","last_active":"2023-10-09T07:01:23.169834+0000","last_peered":"2023-10-09T07:01:23.169834+0000","last_clean":"2023-10-09T07:01:23.169834+0000","last_became_active":"2023-10-09T07:01:22.150345+0000","last_became_peered":"2023-10-09T07:01:22.150345+0000","last_unstale":"2023-10-09T07:01:23.169834+0000","last_undegraded":"2023-10-09T07:01:23.169834+0000","last_fullsized":"2023-10-09T07:01:23.169834+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:35.306975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.161241+0000","last_change":"2023-10-09T07:01:23.157619+0000","last_active":"2023-10-09T07:01:23.161241+0000","last_peered":"2023-10-09T07:01:23.161241+0000","last_clean":"2023-10-09T07:01:23.161241+0000","last_became_active":"2023-10-09T07:01:23.157323+0000","last_became_peered":"2023-10-09T07:01:23.157323+0000","last_unstale":"2023-10-09T07:01:23.161241+0000","last_undegraded":"2023-10-09T07:01:23.161241+0000","last_fullsized":"2023-10-09T07:01:23.161241+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:07.355448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"136'6","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.173102+0000","last_change":"2023-10-09T07:01:22.144728+0000","last_active":"2023-10-09T07:01:23.173102+0000","last_peered":"2023-10-09T07:01:23.173102+0000","last_clean":"2023-10-09T07:01:23.173102+0000","last_became_active":"2023-10-09T07:01:22.144438+0000","last_became_peered":"2023-10-09T07:01:22.144438+0000","last_unstale":"2023-10-09T07:01:23.173102+0000","last_undegraded":"2023-10-09T07:01:23.173102+0000","last_fullsized":"2023-10-09T07:01:23.173102+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:55:46.704780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.157869+0000","last_change":"2023-10-09T07:01:23.153614+0000","last_active":"2023-10-09T07:01:23.157869+0000","last_peered":"2023-10-09T07:01:23.157869+0000","last_clean":"2023-10-09T07:01:23.157869+0000","last_became_active":"2023-10-09T07:01:23.153365+0000","last_became_peered":"2023-10-09T07:01:23.153365+0000","last_unstale":"2023-10-09T07:01:23.157869+0000","last_undegraded":"2023-10-09T07:01:23.157869+0000","last_fullsized":"2023-10-09T07:01:23.157869+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:50.435038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.167247+0000","last_change":"2023-10-09T07:01:22.145791+0000","last_active":"2023-10-09T07:01:23.167247+0000","last_peered":"2023-10-09T07:01:23.167247+0000","last_clean":"2023-10-09T07:01:23.167247+0000","last_became_active":"2023-10-09T07:01:22.145535+0000","last_became_peered":"2023-10-09T07:01:22.145535+0000","last_unstale":"2023-10-09T07:01:23.167247+0000","last_undegraded":"2023-10-09T07:01:23.167247+0000","last_fullsized":"2023-10-09T07:01:23.167247+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:15.629974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168371+0000","last_change":"2023-10-09T07:01:23.164674+0000","last_active":"2023-10-09T07:01:23.168371+0000","last_peered":"2023-10-09T07:01:23.168371+0000","last_clean":"2023-10-09T07:01:23.168371+0000","last_became_active":"2023-10-09T07:01:23.164428+0000","last_became_peered":"2023-10-09T07:01:23.164428+0000","last_unstale":"2023-10-09T07:01:23.168371+0000","last_undegraded":"2023-10-09T07:01:23.168371+0000","last_fullsized":"2023-10-09T07:01:23.168371+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:01:34.945426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.139798+0000","last_change":"2023-10-09T07:01:22.154902+0000","last_active":"2023-10-09T07:01:23.139798+0000","last_peered":"2023-10-09T07:01:23.139798+0000","last_clean":"2023-10-09T07:01:23.139798+0000","last_became_active":"2023-10-09T07:01:22.154688+0000","last_became_peered":"2023-10-09T07:01:22.154688+0000","last_unstale":"2023-10-09T07:01:23.139798+0000","last_undegraded":"2023-10-09T07:01:23.139798+0000","last_fullsized":"2023-10-09T07:01:23.139798+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:57:10.805767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.162854+0000","last_change":"2023-10-09T07:01:23.161420+0000","last_active":"2023-10-09T07:01:23.162854+0000","last_peered":"2023-10-09T07:01:23.162854+0000","last_clean":"2023-10-09T07:01:23.162854+0000","last_became_active":"2023-10-09T07:01:23.161160+0000","last_became_peered":"2023-10-09T07:01:23.161160+0000","last_unstale":"2023-10-09T07:01:23.162854+0000","last_undegraded":"2023-10-09T07:01:23.162854+0000","last_fullsized":"2023-10-09T07:01:23.162854+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:33:26.130071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"136'8","reported_seq":18,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.172132+0000","last_change":"2023-10-09T07:01:22.146719+0000","last_active":"2023-10-09T07:01:23.172132+0000","last_peered":"2023-10-09T07:01:23.172132+0000","last_clean":"2023-10-09T07:01:23.172132+0000","last_became_active":"2023-10-09T07:01:22.146438+0000","last_became_peered":"2023-10-09T07:01:22.146438+0000","last_unstale":"2023-10-09T07:01:23.172132+0000","last_undegraded":"2023-10-09T07:01:23.172132+0000","last_fullsized":"2023-10-09T07:01:23.172132+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:59.902976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166403+0000","last_change":"2023-10-09T07:01:23.163188+0000","last_active":"2023-10-09T07:01:23.166403+0000","last_peered":"2023-10-09T07:01:23.166403+0000","last_clean":"2023-10-09T07:01:23.166403+0000","last_became_active":"2023-10-09T07:01:23.162774+0000","last_became_peered":"2023-10-09T07:01:23.162774+0000","last_unstale":"2023-10-09T07:01:23.166403+0000","last_undegraded":"2023-10-09T07:01:23.166403+0000","last_fullsized":"2023-10-09T07:01:23.166403+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:26:58.267604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169335+0000","last_change":"2023-10-09T07:01:22.157874+0000","last_active":"2023-10-09T07:01:23.169335+0000","last_peered":"2023-10-09T07:01:23.169335+0000","last_clean":"2023-10-09T07:01:23.169335+0000","last_became_active":"2023-10-09T07:01:22.157571+0000","last_became_peered":"2023-10-09T07:01:22.157571+0000","last_unstale":"2023-10-09T07:01:23.169335+0000","last_undegraded":"2023-10-09T07:01:23.169335+0000","last_fullsized":"2023-10-09T07:01:23.169335+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:48:35.226607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.170263+0000","last_change":"2023-10-09T07:01:23.167765+0000","last_active":"2023-10-09T07:01:23.170263+0000","last_peered":"2023-10-09T07:01:23.170263+0000","last_clean":"2023-10-09T07:01:23.170263+0000","last_became_active":"2023-10-09T07:01:23.167467+0000","last_became_peered":"2023-10-09T07:01:23.167467+0000","last_unstale":"2023-10-09T07:01:23.170263+0000","last_undegraded":"2023-10-09T07:01:23.170263+0000","last_fullsized":"2023-10-09T07:01:23.170263+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:48.754324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.164502+0000","last_change":"2023-10-09T07:01:22.147563+0000","last_active":"2023-10-09T07:01:23.164502+0000","last_peered":"2023-10-09T07:01:23.164502+0000","last_clean":"2023-10-09T07:01:23.164502+0000","last_became_active":"2023-10-09T07:01:22.147281+0000","last_became_peered":"2023-10-09T07:01:22.147281+0000","last_unstale":"2023-10-09T07:01:23.164502+0000","last_undegraded":"2023-10-09T07:01:23.164502+0000","last_fullsized":"2023-10-09T07:01:23.164502+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:29.107018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166568+0000","last_change":"2023-10-09T07:01:23.162598+0000","last_active":"2023-10-09T07:01:23.166568+0000","last_peered":"2023-10-09T07:01:23.166568+0000","last_clean":"2023-10-09T07:01:23.166568+0000","last_became_active":"2023-10-09T07:01:23.161029+0000","last_became_peered":"2023-10-09T07:01:23.161029+0000","last_unstale":"2023-10-09T07:01:23.166568+0000","last_undegraded":"2023-10-09T07:01:23.166568+0000","last_fullsized":"2023-10-09T07:01:23.166568+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:54.854933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.157717+0000","last_change":"2023-10-09T07:01:22.152443+0000","last_active":"2023-10-09T07:01:23.157717+0000","last_peered":"2023-10-09T07:01:23.157717+0000","last_clean":"2023-10-09T07:01:23.157717+0000","last_became_active":"2023-10-09T07:01:22.152193+0000","last_became_peered":"2023-10-09T07:01:22.152193+0000","last_unstale":"2023-10-09T07:01:23.157717+0000","last_undegraded":"2023-10-09T07:01:23.157717+0000","last_fullsized":"2023-10-09T07:01:23.157717+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:25:49.369604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166499+0000","last_change":"2023-10-09T07:01:23.158846+0000","last_active":"2023-10-09T07:01:23.166499+0000","last_peered":"2023-10-09T07:01:23.166499+0000","last_clean":"2023-10-09T07:01:23.166499+0000","last_became_active":"2023-10-09T07:01:23.158275+0000","last_became_peered":"2023-10-09T07:01:23.158275+0000","last_unstale":"2023-10-09T07:01:23.166499+0000","last_undegraded":"2023-10-09T07:01:23.166499+0000","last_fullsized":"2023-10-09T07:01:23.166499+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:39.937569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.139428+0000","last_change":"2023-10-09T07:01:22.157243+0000","last_active":"2023-10-09T07:01:23.139428+0000","last_peered":"2023-10-09T07:01:23.139428+0000","last_clean":"2023-10-09T07:01:23.139428+0000","last_became_active":"2023-10-09T07:01:22.156871+0000","last_became_peered":"2023-10-09T07:01:22.156871+0000","last_unstale":"2023-10-09T07:01:23.139428+0000","last_undegraded":"2023-10-09T07:01:23.139428+0000","last_fullsized":"2023-10-09T07:01:23.139428+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:47.746760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168705+0000","last_change":"2023-10-09T07:01:23.164436+0000","last_active":"2023-10-09T07:01:23.168705+0000","last_peered":"2023-10-09T07:01:23.168705+0000","last_clean":"2023-10-09T07:01:23.168705+0000","last_became_active":"2023-10-09T07:01:23.164159+0000","last_became_peered":"2023-10-09T07:01:23.164159+0000","last_unstale":"2023-10-09T07:01:23.168705+0000","last_undegraded":"2023-10-09T07:01:23.168705+0000","last_fullsized":"2023-10-09T07:01:23.168705+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:03:43.822136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.159404+0000","last_change":"2023-10-09T07:01:22.144527+0000","last_active":"2023-10-09T07:01:23.159404+0000","last_peered":"2023-10-09T07:01:23.159404+0000","last_clean":"2023-10-09T07:01:23.159404+0000","last_became_active":"2023-10-09T07:01:22.144279+0000","last_became_peered":"2023-10-09T07:01:22.144279+0000","last_unstale":"2023-10-09T07:01:23.159404+0000","last_undegraded":"2023-10-09T07:01:23.159404+0000","last_fullsized":"2023-10-09T07:01:23.159404+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:40.183812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169064+0000","last_change":"2023-10-09T07:01:23.156844+0000","last_active":"2023-10-09T07:01:23.169064+0000","last_peered":"2023-10-09T07:01:23.169064+0000","last_clean":"2023-10-09T07:01:23.169064+0000","last_became_active":"2023-10-09T07:01:23.156449+0000","last_became_peered":"2023-10-09T07:01:23.156449+0000","last_unstale":"2023-10-09T07:01:23.169064+0000","last_undegraded":"2023-10-09T07:01:23.169064+0000","last_fullsized":"2023-10-09T07:01:23.169064+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:07:46.684290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.141899+0000","last_change":"2023-10-09T07:01:22.150874+0000","last_active":"2023-10-09T07:01:23.141899+0000","last_peered":"2023-10-09T07:01:23.141899+0000","last_clean":"2023-10-09T07:01:23.141899+0000","last_became_active":"2023-10-09T07:01:22.150612+0000","last_became_peered":"2023-10-09T07:01:22.150612+0000","last_unstale":"2023-10-09T07:01:23.141899+0000","last_undegraded":"2023-10-09T07:01:23.141899+0000","last_fullsized":"2023-10-09T07:01:23.141899+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:44:39.274431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.165836+0000","last_change":"2023-10-09T07:01:23.156003+0000","last_active":"2023-10-09T07:01:23.165836+0000","last_peered":"2023-10-09T07:01:23.165836+0000","last_clean":"2023-10-09T07:01:23.165836+0000","last_became_active":"2023-10-09T07:01:23.155723+0000","last_became_peered":"2023-10-09T07:01:23.155723+0000","last_unstale":"2023-10-09T07:01:23.165836+0000","last_undegraded":"2023-10-09T07:01:23.165836+0000","last_fullsized":"2023-10-09T07:01:23.165836+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:13:13.307044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.136670+0000","last_change":"2023-10-09T07:01:22.144323+0000","last_active":"2023-10-09T07:01:23.136670+0000","last_peered":"2023-10-09T07:01:23.136670+0000","last_clean":"2023-10-09T07:01:23.136670+0000","last_became_active":"2023-10-09T07:01:22.143811+0000","last_became_peered":"2023-10-09T07:01:22.143811+0000","last_unstale":"2023-10-09T07:01:23.136670+0000","last_undegraded":"2023-10-09T07:01:23.136670+0000","last_fullsized":"2023-10-09T07:01:23.136670+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:36:01.146721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.167911+0000","last_change":"2023-10-09T07:01:23.162779+0000","last_active":"2023-10-09T07:01:23.167911+0000","last_peered":"2023-10-09T07:01:23.167911+0000","last_clean":"2023-10-09T07:01:23.167911+0000","last_became_active":"2023-10-09T07:01:23.162539+0000","last_became_peered":"2023-10-09T07:01:23.162539+0000","last_unstale":"2023-10-09T07:01:23.167911+0000","last_undegraded":"2023-10-09T07:01:23.167911+0000","last_fullsized":"2023-10-09T07:01:23.167911+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:11:24.045926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.149942+0000","last_change":"2023-10-09T07:01:22.148368+0000","last_active":"2023-10-09T07:01:23.149942+0000","last_peered":"2023-10-09T07:01:23.149942+0000","last_clean":"2023-10-09T07:01:23.149942+0000","last_became_active":"2023-10-09T07:01:22.148096+0000","last_became_peered":"2023-10-09T07:01:22.148096+0000","last_unstale":"2023-10-09T07:01:23.149942+0000","last_undegraded":"2023-10-09T07:01:23.149942+0000","last_fullsized":"2023-10-09T07:01:23.149942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:34:41.942673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168531+0000","last_change":"2023-10-09T07:01:23.163304+0000","last_active":"2023-10-09T07:01:23.168531+0000","last_peered":"2023-10-09T07:01:23.168531+0000","last_clean":"2023-10-09T07:01:23.168531+0000","last_became_active":"2023-10-09T07:01:23.162871+0000","last_became_peered":"2023-10-09T07:01:23.162871+0000","last_unstale":"2023-10-09T07:01:23.168531+0000","last_undegraded":"2023-10-09T07:01:23.168531+0000","last_fullsized":"2023-10-09T07:01:23.168531+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:29.980004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169665+0000","last_change":"2023-10-09T07:01:22.149834+0000","last_active":"2023-10-09T07:01:23.169665+0000","last_peered":"2023-10-09T07:01:23.169665+0000","last_clean":"2023-10-09T07:01:23.169665+0000","last_became_active":"2023-10-09T07:01:22.149582+0000","last_became_peered":"2023-10-09T07:01:22.149582+0000","last_unstale":"2023-10-09T07:01:23.169665+0000","last_undegraded":"2023-10-09T07:01:23.169665+0000","last_fullsized":"2023-10-09T07:01:23.169665+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:27:24.455676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.170551+0000","last_change":"2023-10-09T07:01:23.168344+0000","last_active":"2023-10-09T07:01:23.170551+0000","last_peered":"2023-10-09T07:01:23.170551+0000","last_clean":"2023-10-09T07:01:23.170551+0000","last_became_active":"2023-10-09T07:01:23.168036+0000","last_became_peered":"2023-10-09T07:01:23.168036+0000","last_unstale":"2023-10-09T07:01:23.170551+0000","last_undegraded":"2023-10-09T07:01:23.170551+0000","last_fullsized":"2023-10-09T07:01:23.170551+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:29.891585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.140869+0000","last_change":"2023-10-09T07:01:22.152913+0000","last_active":"2023-10-09T07:01:23.140869+0000","last_peered":"2023-10-09T07:01:23.140869+0000","last_clean":"2023-10-09T07:01:23.140869+0000","last_became_active":"2023-10-09T07:01:22.152361+0000","last_became_peered":"2023-10-09T07:01:22.152361+0000","last_unstale":"2023-10-09T07:01:23.140869+0000","last_undegraded":"2023-10-09T07:01:23.140869+0000","last_fullsized":"2023-10-09T07:01:23.140869+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:40:57.966780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169457+0000","last_change":"2023-10-09T07:01:23.161191+0000","last_active":"2023-10-09T07:01:23.169457+0000","last_peered":"2023-10-09T07:01:23.169457+0000","last_clean":"2023-10-09T07:01:23.169457+0000","last_became_active":"2023-10-09T07:01:23.160427+0000","last_became_peered":"2023-10-09T07:01:23.160427+0000","last_unstale":"2023-10-09T07:01:23.169457+0000","last_undegraded":"2023-10-09T07:01:23.169457+0000","last_fullsized":"2023-10-09T07:01:23.169457+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:05:27.389579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.153320+0000","last_change":"2023-10-09T07:01:22.150585+0000","last_active":"2023-10-09T07:01:23.153320+0000","last_peered":"2023-10-09T07:01:23.153320+0000","last_clean":"2023-10-09T07:01:23.153320+0000","last_became_active":"2023-10-09T07:01:22.150008+0000","last_became_peered":"2023-10-09T07:01:22.150008+0000","last_unstale":"2023-10-09T07:01:23.153320+0000","last_undegraded":"2023-10-09T07:01:23.153320+0000","last_fullsized":"2023-10-09T07:01:23.153320+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:24.996488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168558+0000","last_change":"2023-10-09T07:01:23.163530+0000","last_active":"2023-10-09T07:01:23.168558+0000","last_peered":"2023-10-09T07:01:23.168558+0000","last_clean":"2023-10-09T07:01:23.168558+0000","last_became_active":"2023-10-09T07:01:23.162882+0000","last_became_peered":"2023-10-09T07:01:23.162882+0000","last_unstale":"2023-10-09T07:01:23.168558+0000","last_undegraded":"2023-10-09T07:01:23.168558+0000","last_fullsized":"2023-10-09T07:01:23.168558+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:59.520657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.141130+0000","last_change":"2023-10-09T07:01:22.150757+0000","last_active":"2023-10-09T07:01:23.141130+0000","last_peered":"2023-10-09T07:01:23.141130+0000","last_clean":"2023-10-09T07:01:23.141130+0000","last_became_active":"2023-10-09T07:01:22.150082+0000","last_became_peered":"2023-10-09T07:01:22.150082+0000","last_unstale":"2023-10-09T07:01:23.141130+0000","last_undegraded":"2023-10-09T07:01:23.141130+0000","last_fullsized":"2023-10-09T07:01:23.141130+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:12:37.048446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160378+0000","last_change":"2023-10-09T07:01:23.152270+0000","last_active":"2023-10-09T07:01:23.160378+0000","last_peered":"2023-10-09T07:01:23.160378+0000","last_clean":"2023-10-09T07:01:23.160378+0000","last_became_active":"2023-10-09T07:01:23.151999+0000","last_became_peered":"2023-10-09T07:01:23.151999+0000","last_unstale":"2023-10-09T07:01:23.160378+0000","last_undegraded":"2023-10-09T07:01:23.160378+0000","last_fullsized":"2023-10-09T07:01:23.160378+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:03:32.353939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.138009+0000","last_change":"2023-10-09T07:01:22.148907+0000","last_active":"2023-10-09T07:01:23.138009+0000","last_peered":"2023-10-09T07:01:23.138009+0000","last_clean":"2023-10-09T07:01:23.138009+0000","last_became_active":"2023-10-09T07:01:22.148649+0000","last_became_peered":"2023-10-09T07:01:22.148649+0000","last_unstale":"2023-10-09T07:01:23.138009+0000","last_undegraded":"2023-10-09T07:01:23.138009+0000","last_fullsized":"2023-10-09T07:01:23.138009+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:16:09.234730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160259+0000","last_change":"2023-10-09T07:01:23.146843+0000","last_active":"2023-10-09T07:01:23.160259+0000","last_peered":"2023-10-09T07:01:23.160259+0000","last_clean":"2023-10-09T07:01:23.160259+0000","last_became_active":"2023-10-09T07:01:23.146568+0000","last_became_peered":"2023-10-09T07:01:23.146568+0000","last_unstale":"2023-10-09T07:01:23.160259+0000","last_undegraded":"2023-10-09T07:01:23.160259+0000","last_fullsized":"2023-10-09T07:01:23.160259+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:27:25.463240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.139262+0000","last_change":"2023-10-09T07:01:22.145215+0000","last_active":"2023-10-09T07:01:23.139262+0000","last_peered":"2023-10-09T07:01:23.139262+0000","last_clean":"2023-10-09T07:01:23.139262+0000","last_became_active":"2023-10-09T07:01:22.144932+0000","last_became_peered":"2023-10-09T07:01:22.144932+0000","last_unstale":"2023-10-09T07:01:23.139262+0000","last_undegraded":"2023-10-09T07:01:23.139262+0000","last_fullsized":"2023-10-09T07:01:23.139262+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:07:59.767588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166405+0000","last_change":"2023-10-09T07:01:23.158441+0000","last_active":"2023-10-09T07:01:23.166405+0000","last_peered":"2023-10-09T07:01:23.166405+0000","last_clean":"2023-10-09T07:01:23.166405+0000","last_became_active":"2023-10-09T07:01:23.158187+0000","last_became_peered":"2023-10-09T07:01:23.158187+0000","last_unstale":"2023-10-09T07:01:23.166405+0000","last_undegraded":"2023-10-09T07:01:23.166405+0000","last_fullsized":"2023-10-09T07:01:23.166405+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:59.520657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.141795+0000","last_change":"2023-10-09T07:01:22.148410+0000","last_active":"2023-10-09T07:01:23.141795+0000","last_peered":"2023-10-09T07:01:23.141795+0000","last_clean":"2023-10-09T07:01:23.141795+0000","last_became_active":"2023-10-09T07:01:22.148163+0000","last_became_peered":"2023-10-09T07:01:22.148163+0000","last_unstale":"2023-10-09T07:01:23.141795+0000","last_undegraded":"2023-10-09T07:01:23.141795+0000","last_fullsized":"2023-10-09T07:01:23.141795+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:38.775384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169093+0000","last_change":"2023-10-09T07:01:23.156342+0000","last_active":"2023-10-09T07:01:23.169093+0000","last_peered":"2023-10-09T07:01:23.169093+0000","last_clean":"2023-10-09T07:01:23.169093+0000","last_became_active":"2023-10-09T07:01:23.156058+0000","last_became_peered":"2023-10-09T07:01:23.156058+0000","last_unstale":"2023-10-09T07:01:23.169093+0000","last_undegraded":"2023-10-09T07:01:23.169093+0000","last_fullsized":"2023-10-09T07:01:23.169093+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:04:54.280984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.150006+0000","last_change":"2023-10-09T07:01:22.148215+0000","last_active":"2023-10-09T07:01:23.150006+0000","last_peered":"2023-10-09T07:01:23.150006+0000","last_clean":"2023-10-09T07:01:23.150006+0000","last_became_active":"2023-10-09T07:01:22.147957+0000","last_became_peered":"2023-10-09T07:01:22.147957+0000","last_unstale":"2023-10-09T07:01:23.150006+0000","last_undegraded":"2023-10-09T07:01:23.150006+0000","last_fullsized":"2023-10-09T07:01:23.150006+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:50:30.155260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.157844+0000","last_change":"2023-10-09T07:01:23.155358+0000","last_active":"2023-10-09T07:01:23.157844+0000","last_peered":"2023-10-09T07:01:23.157844+0000","last_clean":"2023-10-09T07:01:23.157844+0000","last_became_active":"2023-10-09T07:01:23.155054+0000","last_became_peered":"2023-10-09T07:01:23.155054+0000","last_unstale":"2023-10-09T07:01:23.157844+0000","last_undegraded":"2023-10-09T07:01:23.157844+0000","last_fullsized":"2023-10-09T07:01:23.157844+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:27:50.013074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.140699+0000","last_change":"2023-10-09T07:01:22.156704+0000","last_active":"2023-10-09T07:01:23.140699+0000","last_peered":"2023-10-09T07:01:23.140699+0000","last_clean":"2023-10-09T07:01:23.140699+0000","last_became_active":"2023-10-09T07:01:22.156398+0000","last_became_peered":"2023-10-09T07:01:22.156398+0000","last_unstale":"2023-10-09T07:01:23.140699+0000","last_undegraded":"2023-10-09T07:01:23.140699+0000","last_fullsized":"2023-10-09T07:01:23.140699+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:54:02.869547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"127'249","reported_seq":731,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.150032+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T07:01:23.150032+0000","last_peered":"2023-10-09T07:01:23.150032+0000","last_clean":"2023-10-09T07:01:23.150032+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T07:01:23.150032+0000","last_undegraded":"2023-10-09T07:01:23.150032+0000","last_fullsized":"2023-10-09T07:01:23.150032+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575070,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303632,"kb_used_data":2248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068208,"statfs":{"total":96636764160,"available":96325844992,"internally_reserved":0,"allocated":2301952,"data_stored":1427393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68200000000000005,"15min":0.70399999999999996},"min":{"1min":0.46800000000000003,"5min":0.44700000000000001,"15min":0.316},"max":{"1min":0.91100000000000003,"5min":1.0960000000000001,"15min":1.732},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69399999999999995,"15min":0.71699999999999997},"min":{"1min":0.443,"5min":0.44,"15min":0.29999999999999999},"max":{"1min":0.94299999999999995,"5min":1.22,"15min":1.22},"last":0.58899999999999997}]},{"osd":1,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.67100000000000004,"15min":0.70599999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.379},"max":{"1min":1.004,"5min":1.004,"15min":2.3559999999999999},"last":0.871},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69199999999999995,"15min":0.71999999999999997},"min":{"1min":0.52400000000000002,"5min":0.45700000000000002,"15min":0.40200000000000002},"max":{"1min":0.875,"5min":0.998,"15min":1.7869999999999999},"last":0.82699999999999996}]},{"osd":2,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69999999999999996,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.46300000000000002,"15min":0.44900000000000001},"max":{"1min":0.85599999999999998,"5min":0.98399999999999999,"15min":1.9430000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69999999999999996,"15min":0.73999999999999999},"min":{"1min":0.50600000000000001,"5min":0.48199999999999998,"15min":0.44900000000000001},"max":{"1min":0.98299999999999998,"5min":1.262,"15min":2.6629999999999998},"last":0.64200000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69099999999999995,"15min":0.71299999999999997},"min":{"1min":0.53500000000000003,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.749},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.88300000000000001,"5min":1.0569999999999999,"15min":1.827},"last":0.70799999999999996}]},{"osd":4,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.622,"15min":0.60099999999999998},"min":{"1min":0.44400000000000001,"5min":0.35299999999999998,"15min":0.35099999999999998},"max":{"1min":0.93999999999999995,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.42399999999999999,"5min":0.40300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79600000000000004,"5min":1.1850000000000001,"15min":2.577},"last":0.73199999999999998}]},{"osd":5,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66500000000000004,"15min":0.66600000000000004},"min":{"1min":0.48199999999999998,"5min":0.40699999999999997,"15min":0.40100000000000002},"max":{"1min":0.92900000000000005,"5min":1.0960000000000001,"15min":2.5169999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68500000000000005,"15min":0.69799999999999995},"min":{"1min":0.495,"5min":0.46500000000000002,"15min":0.45200000000000001},"max":{"1min":0.83899999999999997,"5min":1.141,"15min":2.9590000000000001},"last":0.96699999999999997}]},{"osd":6,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.748},"min":{"1min":0.54000000000000004,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89100000000000001,"5min":1.1000000000000001,"15min":3.0019999999999998},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.498,"5min":0.374,"15min":0.374},"max":{"1min":0.94199999999999995,"5min":1.0740000000000001,"15min":2.4039999999999999},"last":0.92600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575069,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303048,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068792,"statfs":{"total":96636764160,"available":96326443008,"internally_reserved":0,"allocated":1703936,"data_stored":836507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.69199999999999995,"15min":0.71199999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86799999999999999,"5min":1.238,"15min":1.238},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66000000000000003,"15min":0.69999999999999996},"min":{"1min":0.439,"5min":0.41899999999999998,"15min":0.36599999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.079},"last":0.56200000000000006}]},{"osd":1,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68000000000000005,"15min":0.71699999999999997},"min":{"1min":0.45100000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.83299999999999996,"5min":0.97199999999999998,"15min":1.135},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.016,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.73299999999999998},"min":{"1min":0.51100000000000001,"5min":0.438,"15min":0.42599999999999999},"max":{"1min":0.96799999999999997,"5min":1.0109999999999999,"15min":1.391},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69799999999999995,"15min":0.73099999999999998},"min":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.109,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.629}]},{"osd":3,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.68500000000000005,"15min":0.70399999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.40600000000000003},"max":{"1min":0.86599999999999999,"5min":0.98099999999999998,"15min":1.0069999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.70699999999999996,"15min":0.75},"min":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.497},"max":{"1min":0.86299999999999999,"5min":1.0169999999999999,"15min":1.4750000000000001},"last":0.65900000000000003}]},{"osd":4,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60799999999999998,"15min":0.61899999999999999},"min":{"1min":0.45200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.871,"5min":1.329,"15min":1.768},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63,"15min":0.623},"min":{"1min":0.44900000000000001,"5min":0.39100000000000001,"15min":0.36199999999999999},"max":{"1min":0.84599999999999997,"5min":0.98399999999999999,"15min":1.601},"last":0.67700000000000005}]},{"osd":5,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.40200000000000002},"max":{"1min":0.82299999999999995,"5min":1.0149999999999999,"15min":1.7609999999999999},"last":0.749},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.69199999999999995,"15min":0.69399999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91100000000000003,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.76300000000000001}]},{"osd":7,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67800000000000005,"15min":0.67900000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91400000000000003,"5min":1.046,"15min":1.2949999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.72699999999999998},"min":{"1min":0.52300000000000002,"5min":0.45300000000000001,"15min":0.42399999999999999},"max":{"1min":0.997,"5min":1.054,"15min":1.8320000000000001},"last":0.77400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575070,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303052,"kb_used_data":1668,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068788,"statfs":{"total":96636764160,"available":96326438912,"internally_reserved":0,"allocated":1708032,"data_stored":836561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45000000000000001,"15min":0.45700000000000002},"min":{"1min":0.33800000000000002,"5min":0.26600000000000001,"15min":0.25900000000000001},"max":{"1min":0.67700000000000005,"5min":2.153,"15min":2.153},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.36299999999999999,"5min":0.29399999999999998,"15min":0.26300000000000001},"max":{"1min":0.77300000000000002,"5min":1.1879999999999999,"15min":1.23},"last":0.36099999999999999}]},{"osd":2,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.68999999999999995,"5min":0.72199999999999998,"15min":1.169},"last":0.318},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56399999999999995,"15min":0.57699999999999996},"min":{"1min":0.441,"5min":0.38300000000000001,"15min":0.34100000000000003},"max":{"1min":0.73499999999999999,"5min":1.3500000000000001,"15min":3.077},"last":0.46500000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59799999999999998,"15min":0.60999999999999999},"min":{"1min":0.47799999999999998,"5min":0.40000000000000002,"15min":0.376},"max":{"1min":0.77900000000000003,"5min":1.6839999999999999,"15min":1.7709999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":0.79000000000000004,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.39400000000000002}]},{"osd":4,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.748,"15min":0.755},"min":{"1min":0.56499999999999995,"5min":0.46700000000000003,"15min":0.38700000000000001},"max":{"1min":1.069,"5min":1.069,"15min":1.6739999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.58099999999999996,"5min":0.51200000000000001,"15min":0.48599999999999999},"max":{"1min":0.98999999999999999,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.73799999999999999}]},{"osd":5,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.54000000000000004,"5min":0.53400000000000003,"15min":0.48099999999999998},"max":{"1min":1.016,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.749,"15min":0.77000000000000002},"min":{"1min":0.56499999999999995,"5min":0.52100000000000002,"15min":0.47999999999999998},"max":{"1min":0.98399999999999999,"5min":1.1040000000000001,"15min":1.637},"last":0.76400000000000001}]},{"osd":6,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79300000000000004,"15min":0.79800000000000004},"min":{"1min":0.626,"5min":0.54600000000000004,"15min":0.48399999999999999},"max":{"1min":1.2769999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.626,"5min":0.504,"15min":0.504},"max":{"1min":0.96399999999999997,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.55500000000000005}]},{"osd":7,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82599999999999996,"15min":0.82899999999999996},"min":{"1min":0.621,"5min":0.54400000000000004,"15min":0.51700000000000002},"max":{"1min":1.2949999999999999,"5min":3.4350000000000001,"15min":3.4350000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78900000000000003,"15min":0.81399999999999995},"min":{"1min":0.56499999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.179},"last":0.63500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575069,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303644,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068196,"statfs":{"total":96636764160,"available":96325832704,"internally_reserved":0,"allocated":2314240,"data_stored":1428453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47599999999999998,"15min":0.46899999999999997},"min":{"1min":0.31900000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.73499999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51200000000000001,"15min":0.53800000000000003},"min":{"1min":0.32100000000000001,"5min":0.315,"15min":0.28899999999999998},"max":{"1min":0.78000000000000003,"5min":2.1379999999999999,"15min":4.5819999999999999},"last":0.378}]},{"osd":2,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.52800000000000002,"15min":0.55600000000000005},"min":{"1min":0.38400000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.69799999999999995,"5min":2.1720000000000002,"15min":4.6980000000000004},"last":0.432},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48599999999999999,"15min":0.499},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.626,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.45000000000000001}]},{"osd":3,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.53300000000000003,"15min":0.53200000000000003},"min":{"1min":0.38500000000000001,"5min":0.34300000000000003,"15min":0.33200000000000002},"max":{"1min":0.75600000000000001,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58599999999999997,"15min":0.61199999999999999},"min":{"1min":0.46000000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71199999999999997,"5min":2.1989999999999998,"15min":4.734},"last":0.46000000000000002}]},{"osd":4,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.42799999999999999},"max":{"1min":0.94999999999999996,"5min":2.339,"15min":2.339},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75,"15min":0.79000000000000004},"min":{"1min":0.55400000000000005,"5min":0.50700000000000001,"15min":0.39500000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":4.6619999999999999},"last":0.72399999999999998}]},{"osd":5,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.746,"15min":0.76800000000000002},"min":{"1min":0.52600000000000002,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":0.89300000000000002,"5min":1.0349999999999999,"15min":1.1890000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78100000000000003,"15min":0.79100000000000004},"min":{"1min":0.50600000000000001,"5min":0.5,"15min":0.45600000000000002},"max":{"1min":0.96399999999999997,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":0.629}]},{"osd":6,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76300000000000001,"15min":0.80300000000000005},"min":{"1min":0.60199999999999998,"5min":0.5,"15min":0.48599999999999999},"max":{"1min":0.98199999999999998,"5min":1.05,"15min":4.6239999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.55900000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.034,"5min":1.0640000000000001,"15min":1.2689999999999999},"last":0.70899999999999996}]},{"osd":7,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80000000000000004,"15min":0.82299999999999995},"min":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.46400000000000002},"max":{"1min":0.96699999999999997,"5min":1.0760000000000001,"15min":1.256},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.83599999999999997,"15min":0.84599999999999997},"min":{"1min":0.59399999999999997,"5min":0.57599999999999996,"15min":0.51800000000000002},"max":{"1min":0.995,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.76400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575069,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311236,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060604,"statfs":{"total":96636764160,"available":96318058496,"internally_reserved":0,"allocated":1699840,"data_stored":836437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.42999999999999999,"15min":0.45400000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.25900000000000001},"max":{"1min":0.54600000000000004,"5min":0.79800000000000004,"15min":1.8149999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.47199999999999998,"15min":0.49199999999999999},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28000000000000003},"max":{"1min":0.63100000000000001,"5min":0.68100000000000005,"15min":1.633},"last":0.38400000000000001}]},{"osd":1,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44900000000000001,"15min":0.46999999999999997},"min":{"1min":0.316,"5min":0.29499999999999998,"15min":0.28999999999999998},"max":{"1min":0.66700000000000004,"5min":0.71599999999999997,"15min":1.097},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.49099999999999999,"15min":0.50800000000000001},"min":{"1min":0.35099999999999998,"5min":0.32900000000000001,"15min":0.309},"max":{"1min":0.65700000000000003,"5min":0.79700000000000004,"15min":1.2689999999999999},"last":0.46000000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55700000000000005,"15min":0.58299999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69999999999999996,"5min":0.82599999999999996,"15min":0.87},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.59199999999999997,"15min":0.60899999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.35699999999999998},"max":{"1min":0.64700000000000002,"5min":0.83899999999999997,"15min":1.1890000000000001},"last":0.499}]},{"osd":4,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.74299999999999999,"15min":0.76400000000000001},"min":{"1min":0.55100000000000005,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":0.84299999999999997,"5min":1.1379999999999999,"15min":1.256},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72499999999999998,"15min":0.75600000000000001},"min":{"1min":0.501,"5min":0.48799999999999999,"15min":0.44800000000000001},"max":{"1min":0.88500000000000001,"5min":1.171,"15min":1.696},"last":0.79600000000000004}]},{"osd":5,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73699999999999999,"15min":0.76800000000000002},"min":{"1min":0.60399999999999998,"5min":0.505,"15min":0.42399999999999999},"max":{"1min":0.95399999999999996,"5min":1.143,"15min":1.3049999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.748,"15min":0.77600000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.503},"max":{"1min":1.038,"5min":1.0629999999999999,"15min":1.3440000000000001},"last":0.81000000000000005}]},{"osd":6,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.76300000000000001,"15min":0.77900000000000003},"min":{"1min":0.53900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91100000000000003,"5min":1.115,"15min":1.768},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.78200000000000003},"min":{"1min":0.53500000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.98899999999999999,"5min":1.101,"15min":1.5309999999999999},"last":0.69999999999999996}]},{"osd":7,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.77100000000000002,"15min":0.80100000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.54600000000000004},"max":{"1min":0.93700000000000006,"5min":1.0389999999999999,"15min":1.7370000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.82099999999999995},"min":{"1min":0.64500000000000002,"5min":0.57099999999999995,"15min":0.50900000000000001},"max":{"1min":0.97899999999999998,"5min":1.0409999999999999,"15min":1.3939999999999999},"last":0.82299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575070,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307156,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064684,"statfs":{"total":96636764160,"available":96322236416,"internally_reserved":0,"allocated":1716224,"data_stored":838043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45300000000000001,"15min":0.46800000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.60099999999999998,"5min":0.86299999999999999,"15min":0.94299999999999995},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.47099999999999997,"15min":0.49099999999999999},"min":{"1min":0.32900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55500000000000005,"5min":0.81799999999999995,"15min":1.228},"last":0.38100000000000001}]},{"osd":1,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46899999999999997,"15min":0.47999999999999998},"min":{"1min":0.34599999999999997,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.65800000000000003,"5min":0.81899999999999995,"15min":2.0800000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.55000000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.247},"max":{"1min":0.68500000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41199999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55600000000000005,"15min":0.57899999999999996},"min":{"1min":0.39000000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73199999999999998,"5min":0.94099999999999995,"15min":2.3959999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.61699999999999999,"15min":0.63200000000000001},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.309},"max":{"1min":0.75,"5min":0.97699999999999998,"15min":3.8900000000000001},"last":0.59299999999999997}]},{"osd":4,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.71699999999999997,"15min":0.73699999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40799999999999997},"max":{"1min":1.014,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.871},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79600000000000004,"15min":0.81999999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.55300000000000005},"max":{"1min":0.96099999999999997,"5min":1.22,"15min":1.22},"last":0.82199999999999995}]},{"osd":5,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94799999999999995,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.628},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.76600000000000001,"15min":0.79600000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.98799999999999999,"5min":1.1519999999999999,"15min":1.1830000000000001},"last":0.64500000000000002}]},{"osd":6,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.753,"15min":0.77400000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.51700000000000002},"max":{"1min":0.93999999999999995,"5min":1.304,"15min":1.304},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.73899999999999999,"15min":0.77400000000000002},"min":{"1min":0.53100000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.016,"5min":1.1579999999999999,"15min":1.7769999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78200000000000003,"15min":0.81299999999999994},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1,"5min":1.2629999999999999,"15min":1.8180000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.78000000000000003,"15min":0.81599999999999995},"min":{"1min":0.58199999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.056,"5min":1.1919999999999999,"15min":1.486},"last":0.80400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575069,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311236,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060604,"statfs":{"total":96636764160,"available":96318058496,"internally_reserved":0,"allocated":1699840,"data_stored":836437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69899999999999995,"15min":0.70999999999999996},"min":{"1min":0.45000000000000001,"5min":0.35899999999999999,"15min":0.29799999999999999},"max":{"1min":1.109,"5min":1.5609999999999999,"15min":3.1139999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.71499999999999997,"15min":0.72299999999999998},"min":{"1min":0.47399999999999998,"5min":0.39900000000000002,"15min":0.39300000000000002},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.8130000000000002},"last":0.80400000000000005}]},{"osd":1,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68799999999999994,"15min":0.71599999999999997},"min":{"1min":0.47199999999999998,"5min":0.39500000000000002,"15min":0.373},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.9279999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71299999999999997,"15min":0.73799999999999999},"min":{"1min":0.54000000000000004,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3129999999999999,"5min":1.4339999999999999,"15min":3.4359999999999999},"last":0.66700000000000004}]},{"osd":2,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.72799999999999998,"15min":0.755},"min":{"1min":0.52900000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74199999999999999,"15min":0.77400000000000002},"min":{"1min":0.54900000000000004,"5min":0.48299999999999998,"15min":0.47599999999999998},"max":{"1min":0.98999999999999999,"5min":1.0129999999999999,"15min":2.427},"last":0.68999999999999995}]},{"osd":3,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.72899999999999998,"15min":0.74399999999999999},"min":{"1min":0.46999999999999997,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.8239999999999998,"5min":2.8239999999999998,"15min":2.8239999999999998},"last":0.754},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.749},"min":{"1min":0.56499999999999995,"5min":0.443,"15min":0.43099999999999999},"max":{"1min":1.077,"5min":1.077,"15min":3.6899999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.32700000000000001,"15min":0.317},"max":{"1min":2.234,"5min":2.234,"15min":3.3860000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.65200000000000002,"15min":0.65000000000000002},"min":{"1min":0.436,"5min":0.40999999999999998,"15min":0.34999999999999998},"max":{"1min":2.8690000000000002,"5min":2.8690000000000002,"15min":3.9300000000000002},"last":0.61399999999999999}]},{"osd":6,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.45800000000000002,"5min":0.42299999999999999,"15min":0.36499999999999999},"max":{"1min":1.262,"5min":1.262,"15min":3.5270000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68500000000000005,"15min":0.68000000000000005},"min":{"1min":0.48899999999999999,"5min":0.42499999999999999,"15min":0.374},"max":{"1min":1.369,"5min":1.587,"15min":3.4740000000000002},"last":0.57999999999999996}]},{"osd":7,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.73299999999999998,"15min":0.72599999999999998},"min":{"1min":0.59399999999999997,"5min":0.44,"15min":0.34699999999999998},"max":{"1min":2.9049999999999998,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.439},"max":{"1min":1.133,"5min":1.1899999999999999,"15min":3.7280000000000002},"last":0.72399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575070,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303052,"kb_used_data":1668,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068788,"statfs":{"total":96636764160,"available":96326438912,"internally_reserved":0,"allocated":1708032,"data_stored":837013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66300000000000003,"15min":0.68799999999999994},"min":{"1min":0.45400000000000001,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.85299999999999998,"5min":0.93600000000000005,"15min":0.96999999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65500000000000003,"15min":0.67800000000000005},"min":{"1min":0.47099999999999997,"5min":0.379,"15min":0.32900000000000001},"max":{"1min":1.024,"5min":1.119,"15min":1.119},"last":0.497}]},{"osd":1,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66000000000000003,"15min":0.67900000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39700000000000002},"max":{"1min":0.84599999999999997,"5min":1.0029999999999999,"15min":1.034},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.69899999999999995,"15min":0.71499999999999997},"min":{"1min":0.52200000000000002,"5min":0.45400000000000001,"15min":0.40400000000000003},"max":{"1min":0.79500000000000004,"5min":0.95099999999999996,"15min":1.0229999999999999},"last":0.54300000000000004}]},{"osd":2,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68999999999999995,"15min":0.71699999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.47299999999999998},"max":{"1min":0.81000000000000005,"5min":0.997,"15min":1.0580000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.68100000000000005,"15min":0.70299999999999996},"min":{"1min":0.48099999999999998,"5min":0.46200000000000002,"15min":0.442},"max":{"1min":0.88100000000000001,"5min":0.97799999999999998,"15min":1.0720000000000001},"last":0.67300000000000004}]},{"osd":3,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70099999999999996,"15min":0.71199999999999997},"min":{"1min":0.51300000000000001,"5min":0.46300000000000002,"15min":0.435},"max":{"1min":0.96299999999999997,"5min":1.1499999999999999,"15min":1.302},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.54000000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93600000000000005,"5min":1.03,"15min":1.399},"last":0.625}]},{"osd":4,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.621,"15min":0.60199999999999998},"min":{"1min":0.44900000000000001,"5min":0.377,"15min":0.36099999999999999},"max":{"1min":0.89000000000000001,"5min":0.96099999999999997,"15min":0.96799999999999997},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.42099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.002,"5min":1.075,"15min":1.075},"last":0.65200000000000002}]},{"osd":6,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63300000000000001,"15min":0.628},"min":{"1min":0.439,"5min":0.41099999999999998,"15min":0.36599999999999999},"max":{"1min":0.94299999999999995,"5min":1.0049999999999999,"15min":1.018},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68700000000000006,"15min":0.67100000000000004},"min":{"1min":0.48499999999999999,"5min":0.41199999999999998,"15min":0.38900000000000001},"max":{"1min":0.95299999999999996,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.76900000000000002}]},{"osd":7,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68799999999999994,"15min":0.68300000000000005},"min":{"1min":0.499,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.048,"5min":1.48,"15min":1.48},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76700000000000002,"15min":0.76400000000000001},"min":{"1min":0.59499999999999997,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0189999999999999,"5min":1.466,"15min":1.466},"last":0.73799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T07:01:28.381 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T07:01:28.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.593+0000 7f748dfff700 1 Processor -- start 2023-10-09T07:01:28.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.593+0000 7f748dfff700 1 -- start start 2023-10-09T07:01:28.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.594+0000 7f748dfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7488157770 0x7f7488157b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:28.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.595+0000 7f748dfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f74880b1600 0x7f74880b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:28.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.595+0000 7f748dfff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74880acdd0 con 0x7f74880abd30 2023-10-09T07:01:28.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.595+0000 7f748dfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74880b1fc0 con 0x7f74880b1600 2023-10-09T07:01:28.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.595+0000 7f748dfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74880ac1c0 con 0x7f7488157770 2023-10-09T07:01:28.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.595+0000 7f747ffff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f74880abd30 0x7f74880cce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57636/0 (socket says 172.21.15.71:57636) 2023-10-09T07:01:28.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.595+0000 7f747ffff700 1 -- 172.21.15.71:0/3338401772 learned_addr learned my addr 172.21.15.71:0/3338401772 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:01:28.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.595+0000 7f7487fff700 1 --2- 172.21.15.71:0/3338401772 >> v2:172.21.15.179:3300/0 conn(0x7f74880b1600 0x7f74880b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:28.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.595+0000 7f74877fe700 1 --2- 172.21.15.71:0/3338401772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7488157770 0x7f7488157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:28.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.595+0000 7f7486ffd700 1 -- 172.21.15.71:0/3338401772 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35549109 0 0) 0x7f74880acdd0 con 0x7f74880abd30 2023-10-09T07:01:28.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.595+0000 7f7486ffd700 1 -- 172.21.15.71:0/3338401772 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7474003570 con 0x7f74880abd30 2023-10-09T07:01:28.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.596+0000 7f7486ffd700 1 -- 172.21.15.71:0/3338401772 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3906253242 0 0) 0x7f7474003570 con 0x7f74880abd30 2023-10-09T07:01:28.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.596+0000 7f7486ffd700 1 -- 172.21.15.71:0/3338401772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7488157770 msgr2=0x7f7488157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:28.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.596+0000 7f7486ffd700 1 --2- 172.21.15.71:0/3338401772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7488157770 0x7f7488157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:28.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.596+0000 7f7486ffd700 1 -- 172.21.15.71:0/3338401772 >> v2:172.21.15.179:3300/0 conn(0x7f74880b1600 msgr2=0x7f74880b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:28.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.596+0000 7f7486ffd700 1 --2- 172.21.15.71:0/3338401772 >> v2:172.21.15.179:3300/0 conn(0x7f74880b1600 0x7f74880b1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:28.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.596+0000 7f7486ffd700 1 -- 172.21.15.71:0/3338401772 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74880ac4a0 con 0x7f74880abd30 2023-10-09T07:01:28.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.596+0000 7f7486ffd700 1 -- 172.21.15.71:0/3338401772 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f7470001470 con 0x7f74880abd30 2023-10-09T07:01:28.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.596+0000 7f7486ffd700 1 -- 172.21.15.71:0/3338401772 >> v1:172.21.15.71:6789/0 conn(0x7f74880abd30 legacy=0x7f74880cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:28.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.596+0000 7f7486ffd700 1 --2- 172.21.15.71:0/3338401772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7474003ae0 0x7f7474003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:28.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.596+0000 7f7486ffd700 1 --2- 172.21.15.71:0/3338401772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7474004810 0x7f7474004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:28.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.596+0000 7f7486ffd700 1 --2- 172.21.15.71:0/3338401772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7488157770 0x7f74740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:28.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.596+0000 7f7486ffd700 1 -- 172.21.15.71:0/3338401772 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74880b1fc0 con 0x7f7474004810 2023-10-09T07:01:28.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.596+0000 7f7486ffd700 1 -- 172.21.15.71:0/3338401772 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74880ac1c0 con 0x7f7474003ae0 2023-10-09T07:01:28.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.596+0000 7f7486ffd700 1 -- 172.21.15.71:0/3338401772 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747400bb10 con 0x7f7488157770 2023-10-09T07:01:28.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.596+0000 7f747ffff700 1 --2- 172.21.15.71:0/3338401772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7474004810 0x7f7474004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:28.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.596+0000 7f7487fff700 1 --2- 172.21.15.71:0/3338401772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7488157770 0x7f74740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:28.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.596+0000 7f74877fe700 1 --2- 172.21.15.71:0/3338401772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7474003ae0 0x7f7474003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:28.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.596+0000 7f747ffff700 1 -- 172.21.15.71:0/3338401772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7488157770 msgr2=0x7f74740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:28.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.596+0000 7f747ffff700 1 --2- 172.21.15.71:0/3338401772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7488157770 0x7f74740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:28.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.596+0000 7f747ffff700 1 -- 172.21.15.71:0/3338401772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7474003ae0 msgr2=0x7f7474003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:28.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.596+0000 7f747ffff700 1 --2- 172.21.15.71:0/3338401772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7474003ae0 0x7f7474003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:28.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.596+0000 7f747ffff700 1 -- 172.21.15.71:0/3338401772 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7474003570 con 0x7f7474004810 2023-10-09T07:01:28.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.597+0000 7f747ffff700 1 --2- 172.21.15.71:0/3338401772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7474004810 0x7f7474004c80 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f747000c2a0 tx=0x7f7470001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca1dc057a61bf4b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:28.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.597+0000 7f7486ffd700 1 -- 172.21.15.71:0/3338401772 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747000cb70 con 0x7f7474004810 2023-10-09T07:01:28.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.597+0000 7f7486ffd700 1 -- 172.21.15.71:0/3338401772 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747000ccf0 con 0x7f7474004810 2023-10-09T07:01:28.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.597+0000 7f7486ffd700 1 -- 172.21.15.71:0/3338401772 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7470005b70 con 0x7f7474004810 2023-10-09T07:01:28.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.597+0000 7f748dfff700 1 -- 172.21.15.71:0/3338401772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7474004810 msgr2=0x7f7474004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:28.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.597+0000 7f748dfff700 1 --2- 172.21.15.71:0/3338401772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7474004810 0x7f7474004c80 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f747000c2a0 tx=0x7f7470001dc0 comp rx=0 tx=0).stop 2023-10-09T07:01:28.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.597+0000 7f7487fff700 1 -- 172.21.15.71:0/3338401772 reap_dead start 2023-10-09T07:01:28.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.597+0000 7f748dfff700 1 -- 172.21.15.71:0/3338401772 shutdown_connections 2023-10-09T07:01:28.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.597+0000 7f748dfff700 1 -- 172.21.15.71:0/3338401772 >> 172.21.15.71:0/3338401772 conn(0x7f748806a310 msgr2=0x7f74880cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:28.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.598+0000 7f748dfff700 1 -- 172.21.15.71:0/3338401772 shutdown_connections 2023-10-09T07:01:28.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.598+0000 7f748dfff700 1 -- 172.21.15.71:0/3338401772 wait complete. 2023-10-09T07:01:28.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.599+0000 7f748dfff700 1 Processor -- start 2023-10-09T07:01:28.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.599+0000 7f748dfff700 1 -- start start 2023-10-09T07:01:28.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.600+0000 7f748dfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7474004810 0x7f74880af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:28.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.600+0000 7f748dfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74880ab150 0x7f74880aa290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:28.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.600+0000 7f748dfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7488147120 0x7f748806e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:28.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.600+0000 7f748dfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748815a900 con 0x7f7488147120 2023-10-09T07:01:28.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.600+0000 7f748dfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748815a0f0 con 0x7f74880ab150 2023-10-09T07:01:28.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.600+0000 7f748dfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748815c090 con 0x7f7474004810 2023-10-09T07:01:28.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.600+0000 7f7487fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7488147120 0x7f748806e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:28.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.600+0000 7f7487fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7488147120 0x7f748806e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40128/0 (socket says 172.21.15.71:40128) 2023-10-09T07:01:28.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.600+0000 7f7487fff700 1 -- 172.21.15.71:0/2656160929 learned_addr learned my addr 172.21.15.71:0/2656160929 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:28.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.600+0000 7f74877fe700 1 --2- 172.21.15.71:0/2656160929 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7474004810 0x7f74880af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:28.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.600+0000 7f747ffff700 1 --2- 172.21.15.71:0/2656160929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74880ab150 0x7f74880aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:28.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.601+0000 7f7487fff700 1 -- 172.21.15.71:0/2656160929 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7474004810 msgr2=0x7f74880af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:28.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.601+0000 7f7487fff700 1 --2- 172.21.15.71:0/2656160929 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7474004810 0x7f74880af3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:28.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.601+0000 7f7487fff700 1 -- 172.21.15.71:0/2656160929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74880ab150 msgr2=0x7f74880aa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:28.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.601+0000 7f7487fff700 1 --2- 172.21.15.71:0/2656160929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74880ab150 0x7f74880aa290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:28.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.601+0000 7f7487fff700 1 -- 172.21.15.71:0/2656160929 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74880aa7d0 con 0x7f7488147120 2023-10-09T07:01:28.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.601+0000 7f7487fff700 1 --2- 172.21.15.71:0/2656160929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7488147120 0x7f748806e860 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f74800094d0 tx=0x7f748000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:28.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.601+0000 7f747f7fe700 1 -- 172.21.15.71:0/2656160929 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748000e040 con 0x7f7488147120 2023-10-09T07:01:28.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.601+0000 7f747f7fe700 1 -- 172.21.15.71:0/2656160929 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748000f040 con 0x7f7488147120 2023-10-09T07:01:28.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.601+0000 7f747f7fe700 1 -- 172.21.15.71:0/2656160929 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748000fda0 con 0x7f7488147120 2023-10-09T07:01:28.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.601+0000 7f748dfff700 1 -- 172.21.15.71:0/2656160929 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f748815a340 con 0x7f7488147120 2023-10-09T07:01:28.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.601+0000 7f748dfff700 1 -- 172.21.15.71:0/2656160929 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748815bcf0 con 0x7f7488147120 2023-10-09T07:01:28.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.602+0000 7f748dfff700 1 -- 172.21.15.71:0/2656160929 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f748804c3c0 con 0x7f7488147120 2023-10-09T07:01:28.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.603+0000 7f747f7fe700 1 -- 172.21.15.71:0/2656160929 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7480015640 con 0x7f7488147120 2023-10-09T07:01:28.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.604+0000 7f747f7fe700 1 --2- 172.21.15.71:0/2656160929 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7468066f30 0x7f74680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:28.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.604+0000 7f747f7fe700 1 -- 172.21.15.71:0/2656160929 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f7480084fd0 con 0x7f7488147120 2023-10-09T07:01:28.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.604+0000 7f74877fe700 1 --2- 172.21.15.71:0/2656160929 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7468066f30 0x7f74680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:28.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.605+0000 7f74877fe700 1 --2- 172.21.15.71:0/2656160929 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7468066f30 0x7f74680693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7478006f00 tx=0x7f74780091a0 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:28.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.608+0000 7f747f7fe700 1 -- 172.21.15.71:0/2656160929 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74800520a0 con 0x7f7488147120 2023-10-09T07:01:28.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.872+0000 7f748dfff700 1 -- 172.21.15.71:0/2656160929 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f74880cc1e0 con 0x7f7488147120 2023-10-09T07:01:28.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.872+0000 7f747f7fe700 1 -- 172.21.15.71:0/2656160929 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1017 (secure 0 0 0) 0x7f74800556c0 con 0x7f7488147120 2023-10-09T07:01:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:01:28.874 INFO:teuthology.orchestra.run.smithi071.stdout:{"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1155,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":137,"num_osds":8,"num_up_osds":8,"osd_up_since":1696833745,"num_in_osds":8,"osd_in_since":1696833737,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592674,"bytes_used":2504761344,"bytes_avail":770589351936,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":66,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"b","status":"up:active","gid":8109}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-09T07:00:05.871378+0000","services":{}},"progress_events":{}} 2023-10-09T07:01:28.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.875+0000 7f748dfff700 1 -- 172.21.15.71:0/2656160929 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7468066f30 msgr2=0x7f74680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:28.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.875+0000 7f748dfff700 1 --2- 172.21.15.71:0/2656160929 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7468066f30 0x7f74680693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7478006f00 tx=0x7f74780091a0 comp rx=0 tx=0).stop 2023-10-09T07:01:28.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.875+0000 7f748dfff700 1 -- 172.21.15.71:0/2656160929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7488147120 msgr2=0x7f748806e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:28.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.875+0000 7f748dfff700 1 --2- 172.21.15.71:0/2656160929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7488147120 0x7f748806e860 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f74800094d0 tx=0x7f748000b040 comp rx=0 tx=0).stop 2023-10-09T07:01:28.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.875+0000 7f748dfff700 1 -- 172.21.15.71:0/2656160929 shutdown_connections 2023-10-09T07:01:28.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.875+0000 7f748dfff700 1 --2- 172.21.15.71:0/2656160929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7488147120 0x7f748806e860 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:28.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.875+0000 7f748dfff700 1 --2- 172.21.15.71:0/2656160929 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7474004810 0x7f74880af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:28.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.875+0000 7f748dfff700 1 --2- 172.21.15.71:0/2656160929 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7468066f30 0x7f74680693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:28.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.875+0000 7f748dfff700 1 --2- 172.21.15.71:0/2656160929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74880ab150 0x7f74880aa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:28.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.875+0000 7f748dfff700 1 -- 172.21.15.71:0/2656160929 >> 172.21.15.71:0/2656160929 conn(0x7f748806a310 msgr2=0x7f7488154bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:28.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.875+0000 7f748dfff700 1 -- 172.21.15.71:0/2656160929 shutdown_connections 2023-10-09T07:01:28.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:28.875+0000 7f748dfff700 1 -- 172.21.15.71:0/2656160929 wait complete. 2023-10-09T07:01:28.893 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T07:01:28.894 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T07:01:29.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.073+0000 7f4bbb59e700 1 Processor -- start 2023-10-09T07:01:29.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.074+0000 7f4bbb59e700 1 -- start start 2023-10-09T07:01:29.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.075+0000 7f4bbb59e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4bbc156310 0x7f4bbc0c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:29.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.075+0000 7f4bbb59e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bbc0ca860 con 0x7f4bbc1566e0 2023-10-09T07:01:29.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.075+0000 7f4bbb59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bbc0cab40 con 0x7f4bbc0ae710 2023-10-09T07:01:29.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.075+0000 7f4bbb59e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bbc0cae20 con 0x7f4bbc156310 2023-10-09T07:01:29.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.075+0000 7f4bba59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4bbc156310 0x7f4bbc0c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:29.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.075+0000 7f4bba59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4bbc156310 0x7f4bbc0c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40136/0 (socket says 172.21.15.71:40136) 2023-10-09T07:01:29.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.075+0000 7f4bba59c700 1 -- 172.21.15.71:0/2388200677 learned_addr learned my addr 172.21.15.71:0/2388200677 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:29.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.075+0000 7f4bb9d9b700 1 --1- 172.21.15.71:0/2388200677 >> v1:172.21.15.71:6789/0 conn(0x7f4bbc1566e0 0x7f4bbc0ae000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57642/0 (socket says 172.21.15.71:57642) 2023-10-09T07:01:29.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.076+0000 7f4bba59c700 1 -- 172.21.15.71:0/2388200677 >> v1:172.21.15.179:6789/0 conn(0x7f4bbc0ae710 legacy=0x7f4bbc0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:29.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.076+0000 7f4bba59c700 1 -- 172.21.15.71:0/2388200677 >> v1:172.21.15.71:6789/0 conn(0x7f4bbc1566e0 legacy=0x7f4bbc0ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:29.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.076+0000 7f4bba59c700 1 -- 172.21.15.71:0/2388200677 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bbc0cb100 con 0x7f4bbc156310 2023-10-09T07:01:29.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.076+0000 7f4bb959a700 1 -- 172.21.15.71:0/2388200677 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297086861 0 0) 0x7f4bbc0ca860 con 0x7f4bbc1566e0 2023-10-09T07:01:29.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.076+0000 7f4bba59c700 1 --2- 172.21.15.71:0/2388200677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bbc156310 0x7f4bbc0c9dc0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0099b0 tx=0x7f4bac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8ad397d46ac18d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:29.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.076+0000 7f4bb959a700 1 -- 172.21.15.71:0/2388200677 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac00b860 con 0x7f4bbc156310 2023-10-09T07:01:29.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.076+0000 7f4bb959a700 1 -- 172.21.15.71:0/2388200677 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bac00b9c0 con 0x7f4bbc156310 2023-10-09T07:01:29.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.076+0000 7f4bb959a700 1 -- 172.21.15.71:0/2388200677 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac00bd60 con 0x7f4bbc156310 2023-10-09T07:01:29.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.077+0000 7f4bbb59e700 1 -- 172.21.15.71:0/2388200677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bbc156310 msgr2=0x7f4bbc0c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:29.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.077+0000 7f4bbb59e700 1 --2- 172.21.15.71:0/2388200677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bbc156310 0x7f4bbc0c9dc0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0099b0 tx=0x7f4bac009250 comp rx=0 tx=0).stop 2023-10-09T07:01:29.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.077+0000 7f4bbb59e700 1 -- 172.21.15.71:0/2388200677 shutdown_connections 2023-10-09T07:01:29.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.077+0000 7f4bbb59e700 1 --2- 172.21.15.71:0/2388200677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bbc156310 0x7f4bbc0c9dc0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:29.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.077+0000 7f4bbb59e700 1 -- 172.21.15.71:0/2388200677 >> 172.21.15.71:0/2388200677 conn(0x7f4bbc0cc1f0 msgr2=0x7f4bbc0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:29.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.077+0000 7f4bbb59e700 1 -- 172.21.15.71:0/2388200677 shutdown_connections 2023-10-09T07:01:29.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.077+0000 7f4bbb59e700 1 -- 172.21.15.71:0/2388200677 wait complete. 2023-10-09T07:01:29.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.078+0000 7f4bbb59e700 1 Processor -- start 2023-10-09T07:01:29.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.078+0000 7f4bbb59e700 1 -- start start 2023-10-09T07:01:29.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.079+0000 7f4bbb59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bbc0ae710 0x7f4bbc0c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:29.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.079+0000 7f4bbb59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bbc156310 0x7f4bbc152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:29.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.079+0000 7f4bbb59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4bbc1566e0 0x7f4bbc0a6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:29.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.079+0000 7f4bbb59e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc0ca180 con 0x7f4bbc0ae710 2023-10-09T07:01:29.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.079+0000 7f4bbb59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc0c97b0 con 0x7f4bbc156310 2023-10-09T07:01:29.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.079+0000 7f4bbb59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc153420 con 0x7f4bbc1566e0 2023-10-09T07:01:29.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.079+0000 7f4bba59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bbc0ae710 0x7f4bbc0c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:29.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.079+0000 7f4bba59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bbc0ae710 0x7f4bbc0c9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40152/0 (socket says 172.21.15.71:40152) 2023-10-09T07:01:29.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.079+0000 7f4bba59c700 1 -- 172.21.15.71:0/3172584005 learned_addr learned my addr 172.21.15.71:0/3172584005 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:29.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.080+0000 7f4bb9d9b700 1 --2- 172.21.15.71:0/3172584005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bbc156310 0x7f4bbc152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:29.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.080+0000 7f4bbad9d700 1 --2- 172.21.15.71:0/3172584005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4bbc1566e0 0x7f4bbc0a6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:29.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.080+0000 7f4bba59c700 1 -- 172.21.15.71:0/3172584005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4bbc1566e0 msgr2=0x7f4bbc0a6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:29.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.080+0000 7f4bba59c700 1 --2- 172.21.15.71:0/3172584005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4bbc1566e0 0x7f4bbc0a6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:29.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.080+0000 7f4bba59c700 1 -- 172.21.15.71:0/3172584005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bbc156310 msgr2=0x7f4bbc152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:29.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.080+0000 7f4bba59c700 1 --2- 172.21.15.71:0/3172584005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bbc156310 0x7f4bbc152920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:29.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.080+0000 7f4bba59c700 1 -- 172.21.15.71:0/3172584005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac0094f0 con 0x7f4bbc0ae710 2023-10-09T07:01:29.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.080+0000 7f4bb9d9b700 1 --2- 172.21.15.71:0/3172584005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bbc156310 0x7f4bbc152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:01:29.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.080+0000 7f4bba59c700 1 --2- 172.21.15.71:0/3172584005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bbc0ae710 0x7f4bbc0c9c40 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0094c0 tx=0x7f4bac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:29.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.080+0000 7f4baa7fc700 1 -- 172.21.15.71:0/3172584005 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac026450 con 0x7f4bbc0ae710 2023-10-09T07:01:29.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.080+0000 7f4baa7fc700 1 -- 172.21.15.71:0/3172584005 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bac0265d0 con 0x7f4bbc0ae710 2023-10-09T07:01:29.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.080+0000 7f4baa7fc700 1 -- 172.21.15.71:0/3172584005 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac026990 con 0x7f4bbc0ae710 2023-10-09T07:01:29.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.080+0000 7f4bbb59e700 1 -- 172.21.15.71:0/3172584005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bbc0c8ba0 con 0x7f4bbc0ae710 2023-10-09T07:01:29.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.081+0000 7f4bbb59e700 1 -- 172.21.15.71:0/3172584005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bbc0c9160 con 0x7f4bbc0ae710 2023-10-09T07:01:29.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.081+0000 7f4bbb59e700 1 -- 172.21.15.71:0/3172584005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bbc0c9a90 con 0x7f4bbc0ae710 2023-10-09T07:01:29.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.082+0000 7f4baa7fc700 1 -- 172.21.15.71:0/3172584005 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4bac026d00 con 0x7f4bbc0ae710 2023-10-09T07:01:29.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.083+0000 7f4baa7fc700 1 --2- 172.21.15.71:0/3172584005 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4b9c066f30 0x7f4b9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:29.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.084+0000 7f4baa7fc700 1 -- 172.21.15.71:0/3172584005 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f4bac086410 con 0x7f4bbc0ae710 2023-10-09T07:01:29.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.084+0000 7f4bb9d9b700 1 --2- 172.21.15.71:0/3172584005 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4b9c066f30 0x7f4b9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:29.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.084+0000 7f4bb9d9b700 1 --2- 172.21.15.71:0/3172584005 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4b9c066f30 0x7f4b9c0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0a5ab0 tx=0x7f4bb0007c70 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:29.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.088+0000 7f4baa7fc700 1 -- 172.21.15.71:0/3172584005 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4bac053560 con 0x7f4bbc0ae710 2023-10-09T07:01:29.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.273+0000 7f4bbb59e700 1 -- 172.21.15.71:0/3172584005 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4bbc04c3c0 con 0x7f4b9c066f30 2023-10-09T07:01:29.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.282+0000 7f4baa7fc700 1 -- 172.21.15.71:0/3172584005 <== mgr.7627 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289508 (secure 0 0 0) 0x7f4bbc04c3c0 con 0x7f4b9c066f30 2023-10-09T07:01:29.287 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:01:29.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.286+0000 7f4bbb59e700 1 -- 172.21.15.71:0/3172584005 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4b9c066f30 msgr2=0x7f4b9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:29.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.286+0000 7f4bbb59e700 1 --2- 172.21.15.71:0/3172584005 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4b9c066f30 0x7f4b9c0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0a5ab0 tx=0x7f4bb0007c70 comp rx=0 tx=0).stop 2023-10-09T07:01:29.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.286+0000 7f4bbb59e700 1 -- 172.21.15.71:0/3172584005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bbc0ae710 msgr2=0x7f4bbc0c9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:29.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.286+0000 7f4bbb59e700 1 --2- 172.21.15.71:0/3172584005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bbc0ae710 0x7f4bbc0c9c40 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0094c0 tx=0x7f4bac017000 comp rx=0 tx=0).stop 2023-10-09T07:01:29.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.286+0000 7f4bbb59e700 1 -- 172.21.15.71:0/3172584005 shutdown_connections 2023-10-09T07:01:29.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.286+0000 7f4bbb59e700 1 --2- 172.21.15.71:0/3172584005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4bbc1566e0 0x7f4bbc0a6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:29.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.286+0000 7f4bbb59e700 1 --2- 172.21.15.71:0/3172584005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bbc0ae710 0x7f4bbc0c9c40 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:29.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.286+0000 7f4bbb59e700 1 --2- 172.21.15.71:0/3172584005 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4b9c066f30 0x7f4b9c0693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:29.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.286+0000 7f4bbb59e700 1 --2- 172.21.15.71:0/3172584005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bbc156310 0x7f4bbc152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:29.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.286+0000 7f4bbb59e700 1 -- 172.21.15.71:0/3172584005 >> 172.21.15.71:0/3172584005 conn(0x7f4bbc0cc1f0 msgr2=0x7f4bbc0c2470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:29.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.286+0000 7f4bbb59e700 1 -- 172.21.15.71:0/3172584005 shutdown_connections 2023-10-09T07:01:29.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:29.286+0000 7f4bbb59e700 1 -- 172.21.15.71:0/3172584005 wait complete. 2023-10-09T07:01:29.290 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T07:01:29.304 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T07:01:28.076708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":443,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":287,"ondisk_log_size":287,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2446056,"kb_used_data":14504,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752528664,"statfs":{"total":773094113280,"available":770589351936,"internally_reserved":0,"allocated":14852096,"data_stored":7876844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001786"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169399+0000","last_change":"2023-10-09T07:01:23.164925+0000","last_active":"2023-10-09T07:01:23.169399+0000","last_peered":"2023-10-09T07:01:23.169399+0000","last_clean":"2023-10-09T07:01:23.169399+0000","last_became_active":"2023-10-09T07:01:23.164650+0000","last_became_peered":"2023-10-09T07:01:23.164650+0000","last_unstale":"2023-10-09T07:01:23.169399+0000","last_undegraded":"2023-10-09T07:01:23.169399+0000","last_fullsized":"2023-10-09T07:01:23.169399+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:56:55.723335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160903+0000","last_change":"2023-10-09T07:01:23.152371+0000","last_active":"2023-10-09T07:01:23.160903+0000","last_peered":"2023-10-09T07:01:23.160903+0000","last_clean":"2023-10-09T07:01:23.160903+0000","last_became_active":"2023-10-09T07:01:23.149932+0000","last_became_peered":"2023-10-09T07:01:23.149932+0000","last_unstale":"2023-10-09T07:01:23.160903+0000","last_undegraded":"2023-10-09T07:01:23.160903+0000","last_fullsized":"2023-10-09T07:01:23.160903+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:28.489315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168628+0000","last_change":"2023-10-09T07:01:23.164403+0000","last_active":"2023-10-09T07:01:23.168628+0000","last_peered":"2023-10-09T07:01:23.168628+0000","last_clean":"2023-10-09T07:01:23.168628+0000","last_became_active":"2023-10-09T07:01:23.164108+0000","last_became_peered":"2023-10-09T07:01:23.164108+0000","last_unstale":"2023-10-09T07:01:23.168628+0000","last_undegraded":"2023-10-09T07:01:23.168628+0000","last_fullsized":"2023-10-09T07:01:23.168628+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:04:18.098519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169476+0000","last_change":"2023-10-09T07:01:23.162588+0000","last_active":"2023-10-09T07:01:23.169476+0000","last_peered":"2023-10-09T07:01:23.169476+0000","last_clean":"2023-10-09T07:01:23.169476+0000","last_became_active":"2023-10-09T07:01:23.162344+0000","last_became_peered":"2023-10-09T07:01:23.162344+0000","last_unstale":"2023-10-09T07:01:23.169476+0000","last_undegraded":"2023-10-09T07:01:23.169476+0000","last_fullsized":"2023-10-09T07:01:23.169476+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:51:21.311880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.155043+0000","last_change":"2023-10-09T07:01:23.151380+0000","last_active":"2023-10-09T07:01:23.155043+0000","last_peered":"2023-10-09T07:01:23.155043+0000","last_clean":"2023-10-09T07:01:23.155043+0000","last_became_active":"2023-10-09T07:01:23.151124+0000","last_became_peered":"2023-10-09T07:01:23.151124+0000","last_unstale":"2023-10-09T07:01:23.155043+0000","last_undegraded":"2023-10-09T07:01:23.155043+0000","last_fullsized":"2023-10-09T07:01:23.155043+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:42:28.704095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.150895+0000","last_change":"2023-10-09T07:01:23.147303+0000","last_active":"2023-10-09T07:01:23.150895+0000","last_peered":"2023-10-09T07:01:23.150895+0000","last_clean":"2023-10-09T07:01:23.150895+0000","last_became_active":"2023-10-09T07:01:23.147024+0000","last_became_peered":"2023-10-09T07:01:23.147024+0000","last_unstale":"2023-10-09T07:01:23.150895+0000","last_undegraded":"2023-10-09T07:01:23.150895+0000","last_fullsized":"2023-10-09T07:01:23.150895+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:09.967603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.156058+0000","last_change":"2023-10-09T07:01:23.152423+0000","last_active":"2023-10-09T07:01:23.156058+0000","last_peered":"2023-10-09T07:01:23.156058+0000","last_clean":"2023-10-09T07:01:23.156058+0000","last_became_active":"2023-10-09T07:01:23.151931+0000","last_became_peered":"2023-10-09T07:01:23.151931+0000","last_unstale":"2023-10-09T07:01:23.156058+0000","last_undegraded":"2023-10-09T07:01:23.156058+0000","last_fullsized":"2023-10-09T07:01:23.156058+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:44:26.423025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166540+0000","last_change":"2023-10-09T07:01:23.160836+0000","last_active":"2023-10-09T07:01:23.166540+0000","last_peered":"2023-10-09T07:01:23.166540+0000","last_clean":"2023-10-09T07:01:23.166540+0000","last_became_active":"2023-10-09T07:01:23.159642+0000","last_became_peered":"2023-10-09T07:01:23.159642+0000","last_unstale":"2023-10-09T07:01:23.166540+0000","last_undegraded":"2023-10-09T07:01:23.166540+0000","last_fullsized":"2023-10-09T07:01:23.166540+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:27:10.847597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169381+0000","last_change":"2023-10-09T07:01:23.162853+0000","last_active":"2023-10-09T07:01:23.169381+0000","last_peered":"2023-10-09T07:01:23.169381+0000","last_clean":"2023-10-09T07:01:23.169381+0000","last_became_active":"2023-10-09T07:01:23.162608+0000","last_became_peered":"2023-10-09T07:01:23.162608+0000","last_unstale":"2023-10-09T07:01:23.169381+0000","last_undegraded":"2023-10-09T07:01:23.169381+0000","last_fullsized":"2023-10-09T07:01:23.169381+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:14.698455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169349+0000","last_change":"2023-10-09T07:01:23.159296+0000","last_active":"2023-10-09T07:01:23.169349+0000","last_peered":"2023-10-09T07:01:23.169349+0000","last_clean":"2023-10-09T07:01:23.169349+0000","last_became_active":"2023-10-09T07:01:23.158849+0000","last_became_peered":"2023-10-09T07:01:23.158849+0000","last_unstale":"2023-10-09T07:01:23.169349+0000","last_undegraded":"2023-10-09T07:01:23.169349+0000","last_fullsized":"2023-10-09T07:01:23.169349+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:41:09.303760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160748+0000","last_change":"2023-10-09T07:01:23.153489+0000","last_active":"2023-10-09T07:01:23.160748+0000","last_peered":"2023-10-09T07:01:23.160748+0000","last_clean":"2023-10-09T07:01:23.160748+0000","last_became_active":"2023-10-09T07:01:23.153209+0000","last_became_peered":"2023-10-09T07:01:23.153209+0000","last_unstale":"2023-10-09T07:01:23.160748+0000","last_undegraded":"2023-10-09T07:01:23.160748+0000","last_fullsized":"2023-10-09T07:01:23.160748+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:11:02.068844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169360+0000","last_change":"2023-10-09T07:01:23.160349+0000","last_active":"2023-10-09T07:01:23.169360+0000","last_peered":"2023-10-09T07:01:23.169360+0000","last_clean":"2023-10-09T07:01:23.169360+0000","last_became_active":"2023-10-09T07:01:23.159129+0000","last_became_peered":"2023-10-09T07:01:23.159129+0000","last_unstale":"2023-10-09T07:01:23.169360+0000","last_undegraded":"2023-10-09T07:01:23.169360+0000","last_fullsized":"2023-10-09T07:01:23.169360+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:03.948952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.165795+0000","last_change":"2023-10-09T07:01:23.155784+0000","last_active":"2023-10-09T07:01:23.165795+0000","last_peered":"2023-10-09T07:01:23.165795+0000","last_clean":"2023-10-09T07:01:23.165795+0000","last_became_active":"2023-10-09T07:01:23.155491+0000","last_became_peered":"2023-10-09T07:01:23.155491+0000","last_unstale":"2023-10-09T07:01:23.165795+0000","last_undegraded":"2023-10-09T07:01:23.165795+0000","last_fullsized":"2023-10-09T07:01:23.165795+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:27:25.463240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166474+0000","last_change":"2023-10-09T07:01:23.159353+0000","last_active":"2023-10-09T07:01:23.166474+0000","last_peered":"2023-10-09T07:01:23.166474+0000","last_clean":"2023-10-09T07:01:23.166474+0000","last_became_active":"2023-10-09T07:01:23.158889+0000","last_became_peered":"2023-10-09T07:01:23.158889+0000","last_unstale":"2023-10-09T07:01:23.166474+0000","last_undegraded":"2023-10-09T07:01:23.166474+0000","last_fullsized":"2023-10-09T07:01:23.166474+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:51:05.796099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.155504+0000","last_change":"2023-10-09T07:01:23.149230+0000","last_active":"2023-10-09T07:01:23.155504+0000","last_peered":"2023-10-09T07:01:23.155504+0000","last_clean":"2023-10-09T07:01:23.155504+0000","last_became_active":"2023-10-09T07:01:23.148921+0000","last_became_peered":"2023-10-09T07:01:23.148921+0000","last_unstale":"2023-10-09T07:01:23.155504+0000","last_undegraded":"2023-10-09T07:01:23.155504+0000","last_fullsized":"2023-10-09T07:01:23.155504+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:01:52.583166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169227+0000","last_change":"2023-10-09T07:01:23.156333+0000","last_active":"2023-10-09T07:01:23.169227+0000","last_peered":"2023-10-09T07:01:23.169227+0000","last_clean":"2023-10-09T07:01:23.169227+0000","last_became_active":"2023-10-09T07:01:23.155976+0000","last_became_peered":"2023-10-09T07:01:23.155976+0000","last_unstale":"2023-10-09T07:01:23.169227+0000","last_undegraded":"2023-10-09T07:01:23.169227+0000","last_fullsized":"2023-10-09T07:01:23.169227+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:35.524873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160721+0000","last_change":"2023-10-09T07:01:23.153583+0000","last_active":"2023-10-09T07:01:23.160721+0000","last_peered":"2023-10-09T07:01:23.160721+0000","last_clean":"2023-10-09T07:01:23.160721+0000","last_became_active":"2023-10-09T07:01:23.153316+0000","last_became_peered":"2023-10-09T07:01:23.153316+0000","last_unstale":"2023-10-09T07:01:23.160721+0000","last_undegraded":"2023-10-09T07:01:23.160721+0000","last_fullsized":"2023-10-09T07:01:23.160721+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:39.937569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.163633+0000","last_change":"2023-10-09T07:01:23.160341+0000","last_active":"2023-10-09T07:01:23.163633+0000","last_peered":"2023-10-09T07:01:23.163633+0000","last_clean":"2023-10-09T07:01:23.163633+0000","last_became_active":"2023-10-09T07:01:23.160072+0000","last_became_peered":"2023-10-09T07:01:23.160072+0000","last_unstale":"2023-10-09T07:01:23.163633+0000","last_undegraded":"2023-10-09T07:01:23.163633+0000","last_fullsized":"2023-10-09T07:01:23.163633+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:11:02.068844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.165999+0000","last_change":"2023-10-09T07:01:23.156268+0000","last_active":"2023-10-09T07:01:23.165999+0000","last_peered":"2023-10-09T07:01:23.165999+0000","last_clean":"2023-10-09T07:01:23.165999+0000","last_became_active":"2023-10-09T07:01:23.155579+0000","last_became_peered":"2023-10-09T07:01:23.155579+0000","last_unstale":"2023-10-09T07:01:23.165999+0000","last_undegraded":"2023-10-09T07:01:23.165999+0000","last_fullsized":"2023-10-09T07:01:23.165999+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:29.980004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160306+0000","last_change":"2023-10-09T07:01:23.152079+0000","last_active":"2023-10-09T07:01:23.160306+0000","last_peered":"2023-10-09T07:01:23.160306+0000","last_clean":"2023-10-09T07:01:23.160306+0000","last_became_active":"2023-10-09T07:01:23.151814+0000","last_became_peered":"2023-10-09T07:01:23.151814+0000","last_unstale":"2023-10-09T07:01:23.160306+0000","last_undegraded":"2023-10-09T07:01:23.160306+0000","last_fullsized":"2023-10-09T07:01:23.160306+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:29.980004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.161043+0000","last_change":"2023-10-09T07:01:23.153002+0000","last_active":"2023-10-09T07:01:23.161043+0000","last_peered":"2023-10-09T07:01:23.161043+0000","last_clean":"2023-10-09T07:01:23.161043+0000","last_became_active":"2023-10-09T07:01:23.150740+0000","last_became_peered":"2023-10-09T07:01:23.150740+0000","last_unstale":"2023-10-09T07:01:23.161043+0000","last_undegraded":"2023-10-09T07:01:23.161043+0000","last_fullsized":"2023-10-09T07:01:23.161043+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:59.520657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.155518+0000","last_change":"2023-10-09T07:01:23.151375+0000","last_active":"2023-10-09T07:01:23.155518+0000","last_peered":"2023-10-09T07:01:23.155518+0000","last_clean":"2023-10-09T07:01:23.155518+0000","last_became_active":"2023-10-09T07:01:23.151112+0000","last_became_peered":"2023-10-09T07:01:23.151112+0000","last_unstale":"2023-10-09T07:01:23.155518+0000","last_undegraded":"2023-10-09T07:01:23.155518+0000","last_fullsized":"2023-10-09T07:01:23.155518+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:04.781425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160660+0000","last_change":"2023-10-09T07:01:23.152659+0000","last_active":"2023-10-09T07:01:23.160660+0000","last_peered":"2023-10-09T07:01:23.160660+0000","last_clean":"2023-10-09T07:01:23.160660+0000","last_became_active":"2023-10-09T07:01:23.150490+0000","last_became_peered":"2023-10-09T07:01:23.150490+0000","last_unstale":"2023-10-09T07:01:23.160660+0000","last_undegraded":"2023-10-09T07:01:23.160660+0000","last_fullsized":"2023-10-09T07:01:23.160660+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:04:18.098519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168542+0000","last_change":"2023-10-09T07:01:23.164581+0000","last_active":"2023-10-09T07:01:23.168542+0000","last_peered":"2023-10-09T07:01:23.168542+0000","last_clean":"2023-10-09T07:01:23.168542+0000","last_became_active":"2023-10-09T07:01:23.164337+0000","last_became_peered":"2023-10-09T07:01:23.164337+0000","last_unstale":"2023-10-09T07:01:23.168542+0000","last_undegraded":"2023-10-09T07:01:23.168542+0000","last_fullsized":"2023-10-09T07:01:23.168542+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:16.117929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160742+0000","last_change":"2023-10-09T07:01:23.154153+0000","last_active":"2023-10-09T07:01:23.160742+0000","last_peered":"2023-10-09T07:01:23.160742+0000","last_clean":"2023-10-09T07:01:23.160742+0000","last_became_active":"2023-10-09T07:01:23.153907+0000","last_became_peered":"2023-10-09T07:01:23.153907+0000","last_unstale":"2023-10-09T07:01:23.160742+0000","last_undegraded":"2023-10-09T07:01:23.160742+0000","last_fullsized":"2023-10-09T07:01:23.160742+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:13:13.307044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169370+0000","last_change":"2023-10-09T07:01:23.159971+0000","last_active":"2023-10-09T07:01:23.169370+0000","last_peered":"2023-10-09T07:01:23.169370+0000","last_clean":"2023-10-09T07:01:23.169370+0000","last_became_active":"2023-10-09T07:01:23.159558+0000","last_became_peered":"2023-10-09T07:01:23.159558+0000","last_unstale":"2023-10-09T07:01:23.169370+0000","last_undegraded":"2023-10-09T07:01:23.169370+0000","last_fullsized":"2023-10-09T07:01:23.169370+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:32:11.820612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169474+0000","last_change":"2023-10-09T07:01:23.163463+0000","last_active":"2023-10-09T07:01:23.169474+0000","last_peered":"2023-10-09T07:01:23.169474+0000","last_clean":"2023-10-09T07:01:23.169474+0000","last_became_active":"2023-10-09T07:01:23.163220+0000","last_became_peered":"2023-10-09T07:01:23.163220+0000","last_unstale":"2023-10-09T07:01:23.169474+0000","last_undegraded":"2023-10-09T07:01:23.169474+0000","last_fullsized":"2023-10-09T07:01:23.169474+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:54:03.877112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.167499+0000","last_change":"2023-10-09T07:01:23.163460+0000","last_active":"2023-10-09T07:01:23.167499+0000","last_peered":"2023-10-09T07:01:23.167499+0000","last_clean":"2023-10-09T07:01:23.167499+0000","last_became_active":"2023-10-09T07:01:23.163219+0000","last_became_peered":"2023-10-09T07:01:23.163219+0000","last_unstale":"2023-10-09T07:01:23.167499+0000","last_undegraded":"2023-10-09T07:01:23.167499+0000","last_fullsized":"2023-10-09T07:01:23.167499+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:35.224469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.161882+0000","last_change":"2023-10-09T07:01:23.157877+0000","last_active":"2023-10-09T07:01:23.161882+0000","last_peered":"2023-10-09T07:01:23.161882+0000","last_clean":"2023-10-09T07:01:23.161882+0000","last_became_active":"2023-10-09T07:01:23.156649+0000","last_became_peered":"2023-10-09T07:01:23.156649+0000","last_unstale":"2023-10-09T07:01:23.161882+0000","last_undegraded":"2023-10-09T07:01:23.161882+0000","last_fullsized":"2023-10-09T07:01:23.161882+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:03:43.822136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.155355+0000","last_change":"2023-10-09T07:01:23.147390+0000","last_active":"2023-10-09T07:01:23.155355+0000","last_peered":"2023-10-09T07:01:23.155355+0000","last_clean":"2023-10-09T07:01:23.155355+0000","last_became_active":"2023-10-09T07:01:23.147147+0000","last_became_peered":"2023-10-09T07:01:23.147147+0000","last_unstale":"2023-10-09T07:01:23.155355+0000","last_undegraded":"2023-10-09T07:01:23.155355+0000","last_fullsized":"2023-10-09T07:01:23.155355+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:12:47.806691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169117+0000","last_change":"2023-10-09T07:01:23.159774+0000","last_active":"2023-10-09T07:01:23.169117+0000","last_peered":"2023-10-09T07:01:23.169117+0000","last_clean":"2023-10-09T07:01:23.169117+0000","last_became_active":"2023-10-09T07:01:23.159430+0000","last_became_peered":"2023-10-09T07:01:23.159430+0000","last_unstale":"2023-10-09T07:01:23.169117+0000","last_undegraded":"2023-10-09T07:01:23.169117+0000","last_fullsized":"2023-10-09T07:01:23.169117+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:21:26.011332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.150788+0000","last_change":"2023-10-09T07:01:23.147125+0000","last_active":"2023-10-09T07:01:23.150788+0000","last_peered":"2023-10-09T07:01:23.150788+0000","last_clean":"2023-10-09T07:01:23.150788+0000","last_became_active":"2023-10-09T07:01:23.146875+0000","last_became_peered":"2023-10-09T07:01:23.146875+0000","last_unstale":"2023-10-09T07:01:23.150788+0000","last_undegraded":"2023-10-09T07:01:23.150788+0000","last_fullsized":"2023-10-09T07:01:23.150788+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:11:53.155142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.150752+0000","last_change":"2023-10-09T07:01:23.146731+0000","last_active":"2023-10-09T07:01:23.150752+0000","last_peered":"2023-10-09T07:01:23.150752+0000","last_clean":"2023-10-09T07:01:23.150752+0000","last_became_active":"2023-10-09T07:01:23.146485+0000","last_became_peered":"2023-10-09T07:01:23.146485+0000","last_unstale":"2023-10-09T07:01:23.150752+0000","last_undegraded":"2023-10-09T07:01:23.150752+0000","last_fullsized":"2023-10-09T07:01:23.150752+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:21:18.396544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"136'4","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166568+0000","last_change":"2023-10-09T07:01:22.147497+0000","last_active":"2023-10-09T07:01:23.166568+0000","last_peered":"2023-10-09T07:01:23.166568+0000","last_clean":"2023-10-09T07:01:23.166568+0000","last_became_active":"2023-10-09T07:01:22.147198+0000","last_became_peered":"2023-10-09T07:01:22.147198+0000","last_unstale":"2023-10-09T07:01:23.166568+0000","last_undegraded":"2023-10-09T07:01:23.166568+0000","last_fullsized":"2023-10-09T07:01:23.166568+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:13:32.149032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.155058+0000","last_change":"2023-10-09T07:01:23.152637+0000","last_active":"2023-10-09T07:01:23.155058+0000","last_peered":"2023-10-09T07:01:23.155058+0000","last_clean":"2023-10-09T07:01:23.155058+0000","last_became_active":"2023-10-09T07:01:23.152355+0000","last_became_peered":"2023-10-09T07:01:23.152355+0000","last_unstale":"2023-10-09T07:01:23.155058+0000","last_undegraded":"2023-10-09T07:01:23.155058+0000","last_fullsized":"2023-10-09T07:01:23.155058+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:39.937569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.165896+0000","last_change":"2023-10-09T07:01:22.147277+0000","last_active":"2023-10-09T07:01:23.165896+0000","last_peered":"2023-10-09T07:01:23.165896+0000","last_clean":"2023-10-09T07:01:23.165896+0000","last_became_active":"2023-10-09T07:01:22.146986+0000","last_became_peered":"2023-10-09T07:01:22.146986+0000","last_unstale":"2023-10-09T07:01:23.165896+0000","last_undegraded":"2023-10-09T07:01:23.165896+0000","last_fullsized":"2023-10-09T07:01:23.165896+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:06.347884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.145447+0000","last_change":"2023-10-09T07:01:23.143668+0000","last_active":"2023-10-09T07:01:23.145447+0000","last_peered":"2023-10-09T07:01:23.145447+0000","last_clean":"2023-10-09T07:01:23.145447+0000","last_became_active":"2023-10-09T07:01:23.143420+0000","last_became_peered":"2023-10-09T07:01:23.143420+0000","last_unstale":"2023-10-09T07:01:23.145447+0000","last_undegraded":"2023-10-09T07:01:23.145447+0000","last_fullsized":"2023-10-09T07:01:23.145447+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:48:55.565960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160700+0000","last_change":"2023-10-09T07:01:22.146764+0000","last_active":"2023-10-09T07:01:23.160700+0000","last_peered":"2023-10-09T07:01:23.160700+0000","last_clean":"2023-10-09T07:01:23.160700+0000","last_became_active":"2023-10-09T07:01:22.146458+0000","last_became_peered":"2023-10-09T07:01:22.146458+0000","last_unstale":"2023-10-09T07:01:23.160700+0000","last_undegraded":"2023-10-09T07:01:23.160700+0000","last_fullsized":"2023-10-09T07:01:23.160700+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:20:50.395740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166018+0000","last_change":"2023-10-09T07:01:23.156445+0000","last_active":"2023-10-09T07:01:23.166018+0000","last_peered":"2023-10-09T07:01:23.166018+0000","last_clean":"2023-10-09T07:01:23.166018+0000","last_became_active":"2023-10-09T07:01:23.155944+0000","last_became_peered":"2023-10-09T07:01:23.155944+0000","last_unstale":"2023-10-09T07:01:23.166018+0000","last_undegraded":"2023-10-09T07:01:23.166018+0000","last_fullsized":"2023-10-09T07:01:23.166018+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:11:02.068844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.167923+0000","last_change":"2023-10-09T07:01:22.147417+0000","last_active":"2023-10-09T07:01:23.167923+0000","last_peered":"2023-10-09T07:01:23.167923+0000","last_clean":"2023-10-09T07:01:23.167923+0000","last_became_active":"2023-10-09T07:01:22.147144+0000","last_became_peered":"2023-10-09T07:01:22.147144+0000","last_unstale":"2023-10-09T07:01:23.167923+0000","last_undegraded":"2023-10-09T07:01:23.167923+0000","last_fullsized":"2023-10-09T07:01:23.167923+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:36:25.395738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168942+0000","last_change":"2023-10-09T07:01:23.156307+0000","last_active":"2023-10-09T07:01:23.168942+0000","last_peered":"2023-10-09T07:01:23.168942+0000","last_clean":"2023-10-09T07:01:23.168942+0000","last_became_active":"2023-10-09T07:01:23.155881+0000","last_became_peered":"2023-10-09T07:01:23.155881+0000","last_unstale":"2023-10-09T07:01:23.168942+0000","last_undegraded":"2023-10-09T07:01:23.168942+0000","last_fullsized":"2023-10-09T07:01:23.168942+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:14:56.203090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160289+0000","last_change":"2023-10-09T07:01:22.147059+0000","last_active":"2023-10-09T07:01:23.160289+0000","last_peered":"2023-10-09T07:01:23.160289+0000","last_clean":"2023-10-09T07:01:23.160289+0000","last_became_active":"2023-10-09T07:01:22.146706+0000","last_became_peered":"2023-10-09T07:01:22.146706+0000","last_unstale":"2023-10-09T07:01:23.160289+0000","last_undegraded":"2023-10-09T07:01:23.160289+0000","last_fullsized":"2023-10-09T07:01:23.160289+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:55:52.026263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160279+0000","last_change":"2023-10-09T07:01:23.149840+0000","last_active":"2023-10-09T07:01:23.160279+0000","last_peered":"2023-10-09T07:01:23.160279+0000","last_clean":"2023-10-09T07:01:23.160279+0000","last_became_active":"2023-10-09T07:01:23.149547+0000","last_became_peered":"2023-10-09T07:01:23.149547+0000","last_unstale":"2023-10-09T07:01:23.160279+0000","last_undegraded":"2023-10-09T07:01:23.160279+0000","last_fullsized":"2023-10-09T07:01:23.160279+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:51:05.796099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.162203+0000","last_change":"2023-10-09T07:01:22.146261+0000","last_active":"2023-10-09T07:01:23.162203+0000","last_peered":"2023-10-09T07:01:23.162203+0000","last_clean":"2023-10-09T07:01:23.162203+0000","last_became_active":"2023-10-09T07:01:22.146020+0000","last_became_peered":"2023-10-09T07:01:22.146020+0000","last_unstale":"2023-10-09T07:01:23.162203+0000","last_undegraded":"2023-10-09T07:01:23.162203+0000","last_fullsized":"2023-10-09T07:01:23.162203+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:03:31.346374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169244+0000","last_change":"2023-10-09T07:01:23.161416+0000","last_active":"2023-10-09T07:01:23.169244+0000","last_peered":"2023-10-09T07:01:23.169244+0000","last_clean":"2023-10-09T07:01:23.169244+0000","last_became_active":"2023-10-09T07:01:23.156621+0000","last_became_peered":"2023-10-09T07:01:23.156621+0000","last_unstale":"2023-10-09T07:01:23.169244+0000","last_undegraded":"2023-10-09T07:01:23.169244+0000","last_fullsized":"2023-10-09T07:01:23.169244+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:17.826502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.138141+0000","last_change":"2023-10-09T07:01:22.152028+0000","last_active":"2023-10-09T07:01:23.138141+0000","last_peered":"2023-10-09T07:01:23.138141+0000","last_clean":"2023-10-09T07:01:23.138141+0000","last_became_active":"2023-10-09T07:01:22.151258+0000","last_became_peered":"2023-10-09T07:01:22.151258+0000","last_unstale":"2023-10-09T07:01:23.138141+0000","last_undegraded":"2023-10-09T07:01:23.138141+0000","last_fullsized":"2023-10-09T07:01:23.138141+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:51.157963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.156078+0000","last_change":"2023-10-09T07:01:23.152218+0000","last_active":"2023-10-09T07:01:23.156078+0000","last_peered":"2023-10-09T07:01:23.156078+0000","last_clean":"2023-10-09T07:01:23.156078+0000","last_became_active":"2023-10-09T07:01:23.151644+0000","last_became_peered":"2023-10-09T07:01:23.151644+0000","last_unstale":"2023-10-09T07:01:23.156078+0000","last_undegraded":"2023-10-09T07:01:23.156078+0000","last_fullsized":"2023-10-09T07:01:23.156078+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:35:21.844756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.149847+0000","last_change":"2023-10-09T07:01:22.147190+0000","last_active":"2023-10-09T07:01:23.149847+0000","last_peered":"2023-10-09T07:01:23.149847+0000","last_clean":"2023-10-09T07:01:23.149847+0000","last_became_active":"2023-10-09T07:01:22.145191+0000","last_became_peered":"2023-10-09T07:01:22.145191+0000","last_unstale":"2023-10-09T07:01:23.149847+0000","last_undegraded":"2023-10-09T07:01:23.149847+0000","last_fullsized":"2023-10-09T07:01:23.149847+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:57.874883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.155109+0000","last_change":"2023-10-09T07:01:23.146148+0000","last_active":"2023-10-09T07:01:23.155109+0000","last_peered":"2023-10-09T07:01:23.155109+0000","last_clean":"2023-10-09T07:01:23.155109+0000","last_became_active":"2023-10-09T07:01:23.145892+0000","last_became_peered":"2023-10-09T07:01:23.145892+0000","last_unstale":"2023-10-09T07:01:23.155109+0000","last_undegraded":"2023-10-09T07:01:23.155109+0000","last_fullsized":"2023-10-09T07:01:23.155109+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:28.309332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.139944+0000","last_change":"2023-10-09T07:01:22.150785+0000","last_active":"2023-10-09T07:01:23.139944+0000","last_peered":"2023-10-09T07:01:23.139944+0000","last_clean":"2023-10-09T07:01:23.139944+0000","last_became_active":"2023-10-09T07:01:22.150522+0000","last_became_peered":"2023-10-09T07:01:22.150522+0000","last_unstale":"2023-10-09T07:01:23.139944+0000","last_undegraded":"2023-10-09T07:01:23.139944+0000","last_fullsized":"2023-10-09T07:01:23.139944+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:05.488682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.165772+0000","last_change":"2023-10-09T07:01:23.162843+0000","last_active":"2023-10-09T07:01:23.165772+0000","last_peered":"2023-10-09T07:01:23.165772+0000","last_clean":"2023-10-09T07:01:23.165772+0000","last_became_active":"2023-10-09T07:01:23.162334+0000","last_became_peered":"2023-10-09T07:01:23.162334+0000","last_unstale":"2023-10-09T07:01:23.165772+0000","last_undegraded":"2023-10-09T07:01:23.165772+0000","last_fullsized":"2023-10-09T07:01:23.165772+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:13:13.307044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.141723+0000","last_change":"2023-10-09T07:01:22.146917+0000","last_active":"2023-10-09T07:01:23.141723+0000","last_peered":"2023-10-09T07:01:23.141723+0000","last_clean":"2023-10-09T07:01:23.141723+0000","last_became_active":"2023-10-09T07:01:22.146680+0000","last_became_peered":"2023-10-09T07:01:22.146680+0000","last_unstale":"2023-10-09T07:01:23.141723+0000","last_undegraded":"2023-10-09T07:01:23.141723+0000","last_fullsized":"2023-10-09T07:01:23.141723+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:27.481750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.161105+0000","last_change":"2023-10-09T07:01:23.159690+0000","last_active":"2023-10-09T07:01:23.161105+0000","last_peered":"2023-10-09T07:01:23.161105+0000","last_clean":"2023-10-09T07:01:23.161105+0000","last_became_active":"2023-10-09T07:01:23.159405+0000","last_became_peered":"2023-10-09T07:01:23.159405+0000","last_unstale":"2023-10-09T07:01:23.161105+0000","last_undegraded":"2023-10-09T07:01:23.161105+0000","last_fullsized":"2023-10-09T07:01:23.161105+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:44.249505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"136'3","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169834+0000","last_change":"2023-10-09T07:01:22.150732+0000","last_active":"2023-10-09T07:01:23.169834+0000","last_peered":"2023-10-09T07:01:23.169834+0000","last_clean":"2023-10-09T07:01:23.169834+0000","last_became_active":"2023-10-09T07:01:22.150345+0000","last_became_peered":"2023-10-09T07:01:22.150345+0000","last_unstale":"2023-10-09T07:01:23.169834+0000","last_undegraded":"2023-10-09T07:01:23.169834+0000","last_fullsized":"2023-10-09T07:01:23.169834+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:35.306975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.161241+0000","last_change":"2023-10-09T07:01:23.157619+0000","last_active":"2023-10-09T07:01:23.161241+0000","last_peered":"2023-10-09T07:01:23.161241+0000","last_clean":"2023-10-09T07:01:23.161241+0000","last_became_active":"2023-10-09T07:01:23.157323+0000","last_became_peered":"2023-10-09T07:01:23.157323+0000","last_unstale":"2023-10-09T07:01:23.161241+0000","last_undegraded":"2023-10-09T07:01:23.161241+0000","last_fullsized":"2023-10-09T07:01:23.161241+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:07.355448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"136'6","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.173102+0000","last_change":"2023-10-09T07:01:22.144728+0000","last_active":"2023-10-09T07:01:23.173102+0000","last_peered":"2023-10-09T07:01:23.173102+0000","last_clean":"2023-10-09T07:01:23.173102+0000","last_became_active":"2023-10-09T07:01:22.144438+0000","last_became_peered":"2023-10-09T07:01:22.144438+0000","last_unstale":"2023-10-09T07:01:23.173102+0000","last_undegraded":"2023-10-09T07:01:23.173102+0000","last_fullsized":"2023-10-09T07:01:23.173102+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:55:46.704780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.157869+0000","last_change":"2023-10-09T07:01:23.153614+0000","last_active":"2023-10-09T07:01:23.157869+0000","last_peered":"2023-10-09T07:01:23.157869+0000","last_clean":"2023-10-09T07:01:23.157869+0000","last_became_active":"2023-10-09T07:01:23.153365+0000","last_became_peered":"2023-10-09T07:01:23.153365+0000","last_unstale":"2023-10-09T07:01:23.157869+0000","last_undegraded":"2023-10-09T07:01:23.157869+0000","last_fullsized":"2023-10-09T07:01:23.157869+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:50.435038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.167247+0000","last_change":"2023-10-09T07:01:22.145791+0000","last_active":"2023-10-09T07:01:23.167247+0000","last_peered":"2023-10-09T07:01:23.167247+0000","last_clean":"2023-10-09T07:01:23.167247+0000","last_became_active":"2023-10-09T07:01:22.145535+0000","last_became_peered":"2023-10-09T07:01:22.145535+0000","last_unstale":"2023-10-09T07:01:23.167247+0000","last_undegraded":"2023-10-09T07:01:23.167247+0000","last_fullsized":"2023-10-09T07:01:23.167247+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:15.629974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168371+0000","last_change":"2023-10-09T07:01:23.164674+0000","last_active":"2023-10-09T07:01:23.168371+0000","last_peered":"2023-10-09T07:01:23.168371+0000","last_clean":"2023-10-09T07:01:23.168371+0000","last_became_active":"2023-10-09T07:01:23.164428+0000","last_became_peered":"2023-10-09T07:01:23.164428+0000","last_unstale":"2023-10-09T07:01:23.168371+0000","last_undegraded":"2023-10-09T07:01:23.168371+0000","last_fullsized":"2023-10-09T07:01:23.168371+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:01:34.945426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.139798+0000","last_change":"2023-10-09T07:01:22.154902+0000","last_active":"2023-10-09T07:01:23.139798+0000","last_peered":"2023-10-09T07:01:23.139798+0000","last_clean":"2023-10-09T07:01:23.139798+0000","last_became_active":"2023-10-09T07:01:22.154688+0000","last_became_peered":"2023-10-09T07:01:22.154688+0000","last_unstale":"2023-10-09T07:01:23.139798+0000","last_undegraded":"2023-10-09T07:01:23.139798+0000","last_fullsized":"2023-10-09T07:01:23.139798+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:57:10.805767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.162854+0000","last_change":"2023-10-09T07:01:23.161420+0000","last_active":"2023-10-09T07:01:23.162854+0000","last_peered":"2023-10-09T07:01:23.162854+0000","last_clean":"2023-10-09T07:01:23.162854+0000","last_became_active":"2023-10-09T07:01:23.161160+0000","last_became_peered":"2023-10-09T07:01:23.161160+0000","last_unstale":"2023-10-09T07:01:23.162854+0000","last_undegraded":"2023-10-09T07:01:23.162854+0000","last_fullsized":"2023-10-09T07:01:23.162854+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:33:26.130071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"136'8","reported_seq":18,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.172132+0000","last_change":"2023-10-09T07:01:22.146719+0000","last_active":"2023-10-09T07:01:23.172132+0000","last_peered":"2023-10-09T07:01:23.172132+0000","last_clean":"2023-10-09T07:01:23.172132+0000","last_became_active":"2023-10-09T07:01:22.146438+0000","last_became_peered":"2023-10-09T07:01:22.146438+0000","last_unstale":"2023-10-09T07:01:23.172132+0000","last_undegraded":"2023-10-09T07:01:23.172132+0000","last_fullsized":"2023-10-09T07:01:23.172132+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:59.902976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166403+0000","last_change":"2023-10-09T07:01:23.163188+0000","last_active":"2023-10-09T07:01:23.166403+0000","last_peered":"2023-10-09T07:01:23.166403+0000","last_clean":"2023-10-09T07:01:23.166403+0000","last_became_active":"2023-10-09T07:01:23.162774+0000","last_became_peered":"2023-10-09T07:01:23.162774+0000","last_unstale":"2023-10-09T07:01:23.166403+0000","last_undegraded":"2023-10-09T07:01:23.166403+0000","last_fullsized":"2023-10-09T07:01:23.166403+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:26:58.267604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169335+0000","last_change":"2023-10-09T07:01:22.157874+0000","last_active":"2023-10-09T07:01:23.169335+0000","last_peered":"2023-10-09T07:01:23.169335+0000","last_clean":"2023-10-09T07:01:23.169335+0000","last_became_active":"2023-10-09T07:01:22.157571+0000","last_became_peered":"2023-10-09T07:01:22.157571+0000","last_unstale":"2023-10-09T07:01:23.169335+0000","last_undegraded":"2023-10-09T07:01:23.169335+0000","last_fullsized":"2023-10-09T07:01:23.169335+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:48:35.226607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.170263+0000","last_change":"2023-10-09T07:01:23.167765+0000","last_active":"2023-10-09T07:01:23.170263+0000","last_peered":"2023-10-09T07:01:23.170263+0000","last_clean":"2023-10-09T07:01:23.170263+0000","last_became_active":"2023-10-09T07:01:23.167467+0000","last_became_peered":"2023-10-09T07:01:23.167467+0000","last_unstale":"2023-10-09T07:01:23.170263+0000","last_undegraded":"2023-10-09T07:01:23.170263+0000","last_fullsized":"2023-10-09T07:01:23.170263+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:48.754324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.164502+0000","last_change":"2023-10-09T07:01:22.147563+0000","last_active":"2023-10-09T07:01:23.164502+0000","last_peered":"2023-10-09T07:01:23.164502+0000","last_clean":"2023-10-09T07:01:23.164502+0000","last_became_active":"2023-10-09T07:01:22.147281+0000","last_became_peered":"2023-10-09T07:01:22.147281+0000","last_unstale":"2023-10-09T07:01:23.164502+0000","last_undegraded":"2023-10-09T07:01:23.164502+0000","last_fullsized":"2023-10-09T07:01:23.164502+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:29.107018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166568+0000","last_change":"2023-10-09T07:01:23.162598+0000","last_active":"2023-10-09T07:01:23.166568+0000","last_peered":"2023-10-09T07:01:23.166568+0000","last_clean":"2023-10-09T07:01:23.166568+0000","last_became_active":"2023-10-09T07:01:23.161029+0000","last_became_peered":"2023-10-09T07:01:23.161029+0000","last_unstale":"2023-10-09T07:01:23.166568+0000","last_undegraded":"2023-10-09T07:01:23.166568+0000","last_fullsized":"2023-10-09T07:01:23.166568+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:54.854933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.157717+0000","last_change":"2023-10-09T07:01:22.152443+0000","last_active":"2023-10-09T07:01:23.157717+0000","last_peered":"2023-10-09T07:01:23.157717+0000","last_clean":"2023-10-09T07:01:23.157717+0000","last_became_active":"2023-10-09T07:01:22.152193+0000","last_became_peered":"2023-10-09T07:01:22.152193+0000","last_unstale":"2023-10-09T07:01:23.157717+0000","last_undegraded":"2023-10-09T07:01:23.157717+0000","last_fullsized":"2023-10-09T07:01:23.157717+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:25:49.369604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166499+0000","last_change":"2023-10-09T07:01:23.158846+0000","last_active":"2023-10-09T07:01:23.166499+0000","last_peered":"2023-10-09T07:01:23.166499+0000","last_clean":"2023-10-09T07:01:23.166499+0000","last_became_active":"2023-10-09T07:01:23.158275+0000","last_became_peered":"2023-10-09T07:01:23.158275+0000","last_unstale":"2023-10-09T07:01:23.166499+0000","last_undegraded":"2023-10-09T07:01:23.166499+0000","last_fullsized":"2023-10-09T07:01:23.166499+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:39.937569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.139428+0000","last_change":"2023-10-09T07:01:22.157243+0000","last_active":"2023-10-09T07:01:23.139428+0000","last_peered":"2023-10-09T07:01:23.139428+0000","last_clean":"2023-10-09T07:01:23.139428+0000","last_became_active":"2023-10-09T07:01:22.156871+0000","last_became_peered":"2023-10-09T07:01:22.156871+0000","last_unstale":"2023-10-09T07:01:23.139428+0000","last_undegraded":"2023-10-09T07:01:23.139428+0000","last_fullsized":"2023-10-09T07:01:23.139428+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:47.746760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168705+0000","last_change":"2023-10-09T07:01:23.164436+0000","last_active":"2023-10-09T07:01:23.168705+0000","last_peered":"2023-10-09T07:01:23.168705+0000","last_clean":"2023-10-09T07:01:23.168705+0000","last_became_active":"2023-10-09T07:01:23.164159+0000","last_became_peered":"2023-10-09T07:01:23.164159+0000","last_unstale":"2023-10-09T07:01:23.168705+0000","last_undegraded":"2023-10-09T07:01:23.168705+0000","last_fullsized":"2023-10-09T07:01:23.168705+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:03:43.822136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.159404+0000","last_change":"2023-10-09T07:01:22.144527+0000","last_active":"2023-10-09T07:01:23.159404+0000","last_peered":"2023-10-09T07:01:23.159404+0000","last_clean":"2023-10-09T07:01:23.159404+0000","last_became_active":"2023-10-09T07:01:22.144279+0000","last_became_peered":"2023-10-09T07:01:22.144279+0000","last_unstale":"2023-10-09T07:01:23.159404+0000","last_undegraded":"2023-10-09T07:01:23.159404+0000","last_fullsized":"2023-10-09T07:01:23.159404+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:40.183812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169064+0000","last_change":"2023-10-09T07:01:23.156844+0000","last_active":"2023-10-09T07:01:23.169064+0000","last_peered":"2023-10-09T07:01:23.169064+0000","last_clean":"2023-10-09T07:01:23.169064+0000","last_became_active":"2023-10-09T07:01:23.156449+0000","last_became_peered":"2023-10-09T07:01:23.156449+0000","last_unstale":"2023-10-09T07:01:23.169064+0000","last_undegraded":"2023-10-09T07:01:23.169064+0000","last_fullsized":"2023-10-09T07:01:23.169064+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:07:46.684290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.141899+0000","last_change":"2023-10-09T07:01:22.150874+0000","last_active":"2023-10-09T07:01:23.141899+0000","last_peered":"2023-10-09T07:01:23.141899+0000","last_clean":"2023-10-09T07:01:23.141899+0000","last_became_active":"2023-10-09T07:01:22.150612+0000","last_became_peered":"2023-10-09T07:01:22.150612+0000","last_unstale":"2023-10-09T07:01:23.141899+0000","last_undegraded":"2023-10-09T07:01:23.141899+0000","last_fullsized":"2023-10-09T07:01:23.141899+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:44:39.274431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.165836+0000","last_change":"2023-10-09T07:01:23.156003+0000","last_active":"2023-10-09T07:01:23.165836+0000","last_peered":"2023-10-09T07:01:23.165836+0000","last_clean":"2023-10-09T07:01:23.165836+0000","last_became_active":"2023-10-09T07:01:23.155723+0000","last_became_peered":"2023-10-09T07:01:23.155723+0000","last_unstale":"2023-10-09T07:01:23.165836+0000","last_undegraded":"2023-10-09T07:01:23.165836+0000","last_fullsized":"2023-10-09T07:01:23.165836+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:13:13.307044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.136670+0000","last_change":"2023-10-09T07:01:22.144323+0000","last_active":"2023-10-09T07:01:23.136670+0000","last_peered":"2023-10-09T07:01:23.136670+0000","last_clean":"2023-10-09T07:01:23.136670+0000","last_became_active":"2023-10-09T07:01:22.143811+0000","last_became_peered":"2023-10-09T07:01:22.143811+0000","last_unstale":"2023-10-09T07:01:23.136670+0000","last_undegraded":"2023-10-09T07:01:23.136670+0000","last_fullsized":"2023-10-09T07:01:23.136670+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:36:01.146721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.167911+0000","last_change":"2023-10-09T07:01:23.162779+0000","last_active":"2023-10-09T07:01:23.167911+0000","last_peered":"2023-10-09T07:01:23.167911+0000","last_clean":"2023-10-09T07:01:23.167911+0000","last_became_active":"2023-10-09T07:01:23.162539+0000","last_became_peered":"2023-10-09T07:01:23.162539+0000","last_unstale":"2023-10-09T07:01:23.167911+0000","last_undegraded":"2023-10-09T07:01:23.167911+0000","last_fullsized":"2023-10-09T07:01:23.167911+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:11:24.045926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.149942+0000","last_change":"2023-10-09T07:01:22.148368+0000","last_active":"2023-10-09T07:01:23.149942+0000","last_peered":"2023-10-09T07:01:23.149942+0000","last_clean":"2023-10-09T07:01:23.149942+0000","last_became_active":"2023-10-09T07:01:22.148096+0000","last_became_peered":"2023-10-09T07:01:22.148096+0000","last_unstale":"2023-10-09T07:01:23.149942+0000","last_undegraded":"2023-10-09T07:01:23.149942+0000","last_fullsized":"2023-10-09T07:01:23.149942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:34:41.942673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168531+0000","last_change":"2023-10-09T07:01:23.163304+0000","last_active":"2023-10-09T07:01:23.168531+0000","last_peered":"2023-10-09T07:01:23.168531+0000","last_clean":"2023-10-09T07:01:23.168531+0000","last_became_active":"2023-10-09T07:01:23.162871+0000","last_became_peered":"2023-10-09T07:01:23.162871+0000","last_unstale":"2023-10-09T07:01:23.168531+0000","last_undegraded":"2023-10-09T07:01:23.168531+0000","last_fullsized":"2023-10-09T07:01:23.168531+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:29.980004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169665+0000","last_change":"2023-10-09T07:01:22.149834+0000","last_active":"2023-10-09T07:01:23.169665+0000","last_peered":"2023-10-09T07:01:23.169665+0000","last_clean":"2023-10-09T07:01:23.169665+0000","last_became_active":"2023-10-09T07:01:22.149582+0000","last_became_peered":"2023-10-09T07:01:22.149582+0000","last_unstale":"2023-10-09T07:01:23.169665+0000","last_undegraded":"2023-10-09T07:01:23.169665+0000","last_fullsized":"2023-10-09T07:01:23.169665+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:27:24.455676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.170551+0000","last_change":"2023-10-09T07:01:23.168344+0000","last_active":"2023-10-09T07:01:23.170551+0000","last_peered":"2023-10-09T07:01:23.170551+0000","last_clean":"2023-10-09T07:01:23.170551+0000","last_became_active":"2023-10-09T07:01:23.168036+0000","last_became_peered":"2023-10-09T07:01:23.168036+0000","last_unstale":"2023-10-09T07:01:23.170551+0000","last_undegraded":"2023-10-09T07:01:23.170551+0000","last_fullsized":"2023-10-09T07:01:23.170551+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:29.891585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.140869+0000","last_change":"2023-10-09T07:01:22.152913+0000","last_active":"2023-10-09T07:01:23.140869+0000","last_peered":"2023-10-09T07:01:23.140869+0000","last_clean":"2023-10-09T07:01:23.140869+0000","last_became_active":"2023-10-09T07:01:22.152361+0000","last_became_peered":"2023-10-09T07:01:22.152361+0000","last_unstale":"2023-10-09T07:01:23.140869+0000","last_undegraded":"2023-10-09T07:01:23.140869+0000","last_fullsized":"2023-10-09T07:01:23.140869+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:40:57.966780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169457+0000","last_change":"2023-10-09T07:01:23.161191+0000","last_active":"2023-10-09T07:01:23.169457+0000","last_peered":"2023-10-09T07:01:23.169457+0000","last_clean":"2023-10-09T07:01:23.169457+0000","last_became_active":"2023-10-09T07:01:23.160427+0000","last_became_peered":"2023-10-09T07:01:23.160427+0000","last_unstale":"2023-10-09T07:01:23.169457+0000","last_undegraded":"2023-10-09T07:01:23.169457+0000","last_fullsized":"2023-10-09T07:01:23.169457+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:05:27.389579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.153320+0000","last_change":"2023-10-09T07:01:22.150585+0000","last_active":"2023-10-09T07:01:23.153320+0000","last_peered":"2023-10-09T07:01:23.153320+0000","last_clean":"2023-10-09T07:01:23.153320+0000","last_became_active":"2023-10-09T07:01:22.150008+0000","last_became_peered":"2023-10-09T07:01:22.150008+0000","last_unstale":"2023-10-09T07:01:23.153320+0000","last_undegraded":"2023-10-09T07:01:23.153320+0000","last_fullsized":"2023-10-09T07:01:23.153320+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:24.996488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168558+0000","last_change":"2023-10-09T07:01:23.163530+0000","last_active":"2023-10-09T07:01:23.168558+0000","last_peered":"2023-10-09T07:01:23.168558+0000","last_clean":"2023-10-09T07:01:23.168558+0000","last_became_active":"2023-10-09T07:01:23.162882+0000","last_became_peered":"2023-10-09T07:01:23.162882+0000","last_unstale":"2023-10-09T07:01:23.168558+0000","last_undegraded":"2023-10-09T07:01:23.168558+0000","last_fullsized":"2023-10-09T07:01:23.168558+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:59.520657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.141130+0000","last_change":"2023-10-09T07:01:22.150757+0000","last_active":"2023-10-09T07:01:23.141130+0000","last_peered":"2023-10-09T07:01:23.141130+0000","last_clean":"2023-10-09T07:01:23.141130+0000","last_became_active":"2023-10-09T07:01:22.150082+0000","last_became_peered":"2023-10-09T07:01:22.150082+0000","last_unstale":"2023-10-09T07:01:23.141130+0000","last_undegraded":"2023-10-09T07:01:23.141130+0000","last_fullsized":"2023-10-09T07:01:23.141130+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:12:37.048446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160378+0000","last_change":"2023-10-09T07:01:23.152270+0000","last_active":"2023-10-09T07:01:23.160378+0000","last_peered":"2023-10-09T07:01:23.160378+0000","last_clean":"2023-10-09T07:01:23.160378+0000","last_became_active":"2023-10-09T07:01:23.151999+0000","last_became_peered":"2023-10-09T07:01:23.151999+0000","last_unstale":"2023-10-09T07:01:23.160378+0000","last_undegraded":"2023-10-09T07:01:23.160378+0000","last_fullsized":"2023-10-09T07:01:23.160378+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:03:32.353939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.138009+0000","last_change":"2023-10-09T07:01:22.148907+0000","last_active":"2023-10-09T07:01:23.138009+0000","last_peered":"2023-10-09T07:01:23.138009+0000","last_clean":"2023-10-09T07:01:23.138009+0000","last_became_active":"2023-10-09T07:01:22.148649+0000","last_became_peered":"2023-10-09T07:01:22.148649+0000","last_unstale":"2023-10-09T07:01:23.138009+0000","last_undegraded":"2023-10-09T07:01:23.138009+0000","last_fullsized":"2023-10-09T07:01:23.138009+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:16:09.234730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160259+0000","last_change":"2023-10-09T07:01:23.146843+0000","last_active":"2023-10-09T07:01:23.160259+0000","last_peered":"2023-10-09T07:01:23.160259+0000","last_clean":"2023-10-09T07:01:23.160259+0000","last_became_active":"2023-10-09T07:01:23.146568+0000","last_became_peered":"2023-10-09T07:01:23.146568+0000","last_unstale":"2023-10-09T07:01:23.160259+0000","last_undegraded":"2023-10-09T07:01:23.160259+0000","last_fullsized":"2023-10-09T07:01:23.160259+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:27:25.463240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.139262+0000","last_change":"2023-10-09T07:01:22.145215+0000","last_active":"2023-10-09T07:01:23.139262+0000","last_peered":"2023-10-09T07:01:23.139262+0000","last_clean":"2023-10-09T07:01:23.139262+0000","last_became_active":"2023-10-09T07:01:22.144932+0000","last_became_peered":"2023-10-09T07:01:22.144932+0000","last_unstale":"2023-10-09T07:01:23.139262+0000","last_undegraded":"2023-10-09T07:01:23.139262+0000","last_fullsized":"2023-10-09T07:01:23.139262+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:07:59.767588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166405+0000","last_change":"2023-10-09T07:01:23.158441+0000","last_active":"2023-10-09T07:01:23.166405+0000","last_peered":"2023-10-09T07:01:23.166405+0000","last_clean":"2023-10-09T07:01:23.166405+0000","last_became_active":"2023-10-09T07:01:23.158187+0000","last_became_peered":"2023-10-09T07:01:23.158187+0000","last_unstale":"2023-10-09T07:01:23.166405+0000","last_undegraded":"2023-10-09T07:01:23.166405+0000","last_fullsized":"2023-10-09T07:01:23.166405+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:59.520657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.141795+0000","last_change":"2023-10-09T07:01:22.148410+0000","last_active":"2023-10-09T07:01:23.141795+0000","last_peered":"2023-10-09T07:01:23.141795+0000","last_clean":"2023-10-09T07:01:23.141795+0000","last_became_active":"2023-10-09T07:01:22.148163+0000","last_became_peered":"2023-10-09T07:01:22.148163+0000","last_unstale":"2023-10-09T07:01:23.141795+0000","last_undegraded":"2023-10-09T07:01:23.141795+0000","last_fullsized":"2023-10-09T07:01:23.141795+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:38.775384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169093+0000","last_change":"2023-10-09T07:01:23.156342+0000","last_active":"2023-10-09T07:01:23.169093+0000","last_peered":"2023-10-09T07:01:23.169093+0000","last_clean":"2023-10-09T07:01:23.169093+0000","last_became_active":"2023-10-09T07:01:23.156058+0000","last_became_peered":"2023-10-09T07:01:23.156058+0000","last_unstale":"2023-10-09T07:01:23.169093+0000","last_undegraded":"2023-10-09T07:01:23.169093+0000","last_fullsized":"2023-10-09T07:01:23.169093+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:04:54.280984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.150006+0000","last_change":"2023-10-09T07:01:22.148215+0000","last_active":"2023-10-09T07:01:23.150006+0000","last_peered":"2023-10-09T07:01:23.150006+0000","last_clean":"2023-10-09T07:01:23.150006+0000","last_became_active":"2023-10-09T07:01:22.147957+0000","last_became_peered":"2023-10-09T07:01:22.147957+0000","last_unstale":"2023-10-09T07:01:23.150006+0000","last_undegraded":"2023-10-09T07:01:23.150006+0000","last_fullsized":"2023-10-09T07:01:23.150006+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:50:30.155260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.157844+0000","last_change":"2023-10-09T07:01:23.155358+0000","last_active":"2023-10-09T07:01:23.157844+0000","last_peered":"2023-10-09T07:01:23.157844+0000","last_clean":"2023-10-09T07:01:23.157844+0000","last_became_active":"2023-10-09T07:01:23.155054+0000","last_became_peered":"2023-10-09T07:01:23.155054+0000","last_unstale":"2023-10-09T07:01:23.157844+0000","last_undegraded":"2023-10-09T07:01:23.157844+0000","last_fullsized":"2023-10-09T07:01:23.157844+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:27:50.013074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.140699+0000","last_change":"2023-10-09T07:01:22.156704+0000","last_active":"2023-10-09T07:01:23.140699+0000","last_peered":"2023-10-09T07:01:23.140699+0000","last_clean":"2023-10-09T07:01:23.140699+0000","last_became_active":"2023-10-09T07:01:22.156398+0000","last_became_peered":"2023-10-09T07:01:22.156398+0000","last_unstale":"2023-10-09T07:01:23.140699+0000","last_undegraded":"2023-10-09T07:01:23.140699+0000","last_fullsized":"2023-10-09T07:01:23.140699+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:54:02.869547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"127'249","reported_seq":731,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.150032+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T07:01:23.150032+0000","last_peered":"2023-10-09T07:01:23.150032+0000","last_clean":"2023-10-09T07:01:23.150032+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T07:01:23.150032+0000","last_undegraded":"2023-10-09T07:01:23.150032+0000","last_fullsized":"2023-10-09T07:01:23.150032+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575070,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303632,"kb_used_data":2248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068208,"statfs":{"total":96636764160,"available":96325844992,"internally_reserved":0,"allocated":2301952,"data_stored":1427393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68200000000000005,"15min":0.70399999999999996},"min":{"1min":0.46800000000000003,"5min":0.44700000000000001,"15min":0.316},"max":{"1min":0.91100000000000003,"5min":1.0960000000000001,"15min":1.732},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69399999999999995,"15min":0.71699999999999997},"min":{"1min":0.443,"5min":0.44,"15min":0.29999999999999999},"max":{"1min":0.94299999999999995,"5min":1.22,"15min":1.22},"last":0.58899999999999997}]},{"osd":1,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.67100000000000004,"15min":0.70599999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.379},"max":{"1min":1.004,"5min":1.004,"15min":2.3559999999999999},"last":0.871},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69199999999999995,"15min":0.71999999999999997},"min":{"1min":0.52400000000000002,"5min":0.45700000000000002,"15min":0.40200000000000002},"max":{"1min":0.875,"5min":0.998,"15min":1.7869999999999999},"last":0.82699999999999996}]},{"osd":2,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69999999999999996,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.46300000000000002,"15min":0.44900000000000001},"max":{"1min":0.85599999999999998,"5min":0.98399999999999999,"15min":1.9430000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69999999999999996,"15min":0.73999999999999999},"min":{"1min":0.50600000000000001,"5min":0.48199999999999998,"15min":0.44900000000000001},"max":{"1min":0.98299999999999998,"5min":1.262,"15min":2.6629999999999998},"last":0.64200000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69099999999999995,"15min":0.71299999999999997},"min":{"1min":0.53500000000000003,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.749},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.88300000000000001,"5min":1.0569999999999999,"15min":1.827},"last":0.70799999999999996}]},{"osd":4,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.622,"15min":0.60099999999999998},"min":{"1min":0.44400000000000001,"5min":0.35299999999999998,"15min":0.35099999999999998},"max":{"1min":0.93999999999999995,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.42399999999999999,"5min":0.40300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79600000000000004,"5min":1.1850000000000001,"15min":2.577},"last":0.73199999999999998}]},{"osd":5,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66500000000000004,"15min":0.66600000000000004},"min":{"1min":0.48199999999999998,"5min":0.40699999999999997,"15min":0.40100000000000002},"max":{"1min":0.92900000000000005,"5min":1.0960000000000001,"15min":2.5169999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68500000000000005,"15min":0.69799999999999995},"min":{"1min":0.495,"5min":0.46500000000000002,"15min":0.45200000000000001},"max":{"1min":0.83899999999999997,"5min":1.141,"15min":2.9590000000000001},"last":0.96699999999999997}]},{"osd":6,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.748},"min":{"1min":0.54000000000000004,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89100000000000001,"5min":1.1000000000000001,"15min":3.0019999999999998},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.498,"5min":0.374,"15min":0.374},"max":{"1min":0.94199999999999995,"5min":1.0740000000000001,"15min":2.4039999999999999},"last":0.92600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575069,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303048,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068792,"statfs":{"total":96636764160,"available":96326443008,"internally_reserved":0,"allocated":1703936,"data_stored":836507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.69199999999999995,"15min":0.71199999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86799999999999999,"5min":1.238,"15min":1.238},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66000000000000003,"15min":0.69999999999999996},"min":{"1min":0.439,"5min":0.41899999999999998,"15min":0.36599999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.079},"last":0.56200000000000006}]},{"osd":1,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68000000000000005,"15min":0.71699999999999997},"min":{"1min":0.45100000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.83299999999999996,"5min":0.97199999999999998,"15min":1.135},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.016,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.73299999999999998},"min":{"1min":0.51100000000000001,"5min":0.438,"15min":0.42599999999999999},"max":{"1min":0.96799999999999997,"5min":1.0109999999999999,"15min":1.391},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69799999999999995,"15min":0.73099999999999998},"min":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.109,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.629}]},{"osd":3,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.68500000000000005,"15min":0.70399999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.40600000000000003},"max":{"1min":0.86599999999999999,"5min":0.98099999999999998,"15min":1.0069999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.70699999999999996,"15min":0.75},"min":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.497},"max":{"1min":0.86299999999999999,"5min":1.0169999999999999,"15min":1.4750000000000001},"last":0.65900000000000003}]},{"osd":4,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60799999999999998,"15min":0.61899999999999999},"min":{"1min":0.45200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.871,"5min":1.329,"15min":1.768},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63,"15min":0.623},"min":{"1min":0.44900000000000001,"5min":0.39100000000000001,"15min":0.36199999999999999},"max":{"1min":0.84599999999999997,"5min":0.98399999999999999,"15min":1.601},"last":0.67700000000000005}]},{"osd":5,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.40200000000000002},"max":{"1min":0.82299999999999995,"5min":1.0149999999999999,"15min":1.7609999999999999},"last":0.749},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.69199999999999995,"15min":0.69399999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91100000000000003,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.76300000000000001}]},{"osd":7,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67800000000000005,"15min":0.67900000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91400000000000003,"5min":1.046,"15min":1.2949999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.72699999999999998},"min":{"1min":0.52300000000000002,"5min":0.45300000000000001,"15min":0.42399999999999999},"max":{"1min":0.997,"5min":1.054,"15min":1.8320000000000001},"last":0.77400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575070,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303052,"kb_used_data":1668,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068788,"statfs":{"total":96636764160,"available":96326438912,"internally_reserved":0,"allocated":1708032,"data_stored":836561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45000000000000001,"15min":0.45700000000000002},"min":{"1min":0.33800000000000002,"5min":0.26600000000000001,"15min":0.25900000000000001},"max":{"1min":0.67700000000000005,"5min":2.153,"15min":2.153},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.36299999999999999,"5min":0.29399999999999998,"15min":0.26300000000000001},"max":{"1min":0.77300000000000002,"5min":1.1879999999999999,"15min":1.23},"last":0.36099999999999999}]},{"osd":2,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.68999999999999995,"5min":0.72199999999999998,"15min":1.169},"last":0.318},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56399999999999995,"15min":0.57699999999999996},"min":{"1min":0.441,"5min":0.38300000000000001,"15min":0.34100000000000003},"max":{"1min":0.73499999999999999,"5min":1.3500000000000001,"15min":3.077},"last":0.46500000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59799999999999998,"15min":0.60999999999999999},"min":{"1min":0.47799999999999998,"5min":0.40000000000000002,"15min":0.376},"max":{"1min":0.77900000000000003,"5min":1.6839999999999999,"15min":1.7709999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":0.79000000000000004,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.39400000000000002}]},{"osd":4,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.748,"15min":0.755},"min":{"1min":0.56499999999999995,"5min":0.46700000000000003,"15min":0.38700000000000001},"max":{"1min":1.069,"5min":1.069,"15min":1.6739999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.58099999999999996,"5min":0.51200000000000001,"15min":0.48599999999999999},"max":{"1min":0.98999999999999999,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.73799999999999999}]},{"osd":5,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.54000000000000004,"5min":0.53400000000000003,"15min":0.48099999999999998},"max":{"1min":1.016,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.749,"15min":0.77000000000000002},"min":{"1min":0.56499999999999995,"5min":0.52100000000000002,"15min":0.47999999999999998},"max":{"1min":0.98399999999999999,"5min":1.1040000000000001,"15min":1.637},"last":0.76400000000000001}]},{"osd":6,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79300000000000004,"15min":0.79800000000000004},"min":{"1min":0.626,"5min":0.54600000000000004,"15min":0.48399999999999999},"max":{"1min":1.2769999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.626,"5min":0.504,"15min":0.504},"max":{"1min":0.96399999999999997,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.55500000000000005}]},{"osd":7,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82599999999999996,"15min":0.82899999999999996},"min":{"1min":0.621,"5min":0.54400000000000004,"15min":0.51700000000000002},"max":{"1min":1.2949999999999999,"5min":3.4350000000000001,"15min":3.4350000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78900000000000003,"15min":0.81399999999999995},"min":{"1min":0.56499999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.179},"last":0.63500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575069,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303644,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068196,"statfs":{"total":96636764160,"available":96325832704,"internally_reserved":0,"allocated":2314240,"data_stored":1428453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47599999999999998,"15min":0.46899999999999997},"min":{"1min":0.31900000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.73499999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51200000000000001,"15min":0.53800000000000003},"min":{"1min":0.32100000000000001,"5min":0.315,"15min":0.28899999999999998},"max":{"1min":0.78000000000000003,"5min":2.1379999999999999,"15min":4.5819999999999999},"last":0.378}]},{"osd":2,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.52800000000000002,"15min":0.55600000000000005},"min":{"1min":0.38400000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.69799999999999995,"5min":2.1720000000000002,"15min":4.6980000000000004},"last":0.432},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48599999999999999,"15min":0.499},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.626,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.45000000000000001}]},{"osd":3,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.53300000000000003,"15min":0.53200000000000003},"min":{"1min":0.38500000000000001,"5min":0.34300000000000003,"15min":0.33200000000000002},"max":{"1min":0.75600000000000001,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58599999999999997,"15min":0.61199999999999999},"min":{"1min":0.46000000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71199999999999997,"5min":2.1989999999999998,"15min":4.734},"last":0.46000000000000002}]},{"osd":4,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.42799999999999999},"max":{"1min":0.94999999999999996,"5min":2.339,"15min":2.339},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75,"15min":0.79000000000000004},"min":{"1min":0.55400000000000005,"5min":0.50700000000000001,"15min":0.39500000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":4.6619999999999999},"last":0.72399999999999998}]},{"osd":5,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.746,"15min":0.76800000000000002},"min":{"1min":0.52600000000000002,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":0.89300000000000002,"5min":1.0349999999999999,"15min":1.1890000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78100000000000003,"15min":0.79100000000000004},"min":{"1min":0.50600000000000001,"5min":0.5,"15min":0.45600000000000002},"max":{"1min":0.96399999999999997,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":0.629}]},{"osd":6,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76300000000000001,"15min":0.80300000000000005},"min":{"1min":0.60199999999999998,"5min":0.5,"15min":0.48599999999999999},"max":{"1min":0.98199999999999998,"5min":1.05,"15min":4.6239999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.55900000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.034,"5min":1.0640000000000001,"15min":1.2689999999999999},"last":0.70899999999999996}]},{"osd":7,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80000000000000004,"15min":0.82299999999999995},"min":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.46400000000000002},"max":{"1min":0.96699999999999997,"5min":1.0760000000000001,"15min":1.256},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.83599999999999997,"15min":0.84599999999999997},"min":{"1min":0.59399999999999997,"5min":0.57599999999999996,"15min":0.51800000000000002},"max":{"1min":0.995,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.76400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575069,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311236,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060604,"statfs":{"total":96636764160,"available":96318058496,"internally_reserved":0,"allocated":1699840,"data_stored":836437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.42999999999999999,"15min":0.45400000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.25900000000000001},"max":{"1min":0.54600000000000004,"5min":0.79800000000000004,"15min":1.8149999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.47199999999999998,"15min":0.49199999999999999},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28000000000000003},"max":{"1min":0.63100000000000001,"5min":0.68100000000000005,"15min":1.633},"last":0.38400000000000001}]},{"osd":1,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44900000000000001,"15min":0.46999999999999997},"min":{"1min":0.316,"5min":0.29499999999999998,"15min":0.28999999999999998},"max":{"1min":0.66700000000000004,"5min":0.71599999999999997,"15min":1.097},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.49099999999999999,"15min":0.50800000000000001},"min":{"1min":0.35099999999999998,"5min":0.32900000000000001,"15min":0.309},"max":{"1min":0.65700000000000003,"5min":0.79700000000000004,"15min":1.2689999999999999},"last":0.46000000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55700000000000005,"15min":0.58299999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69999999999999996,"5min":0.82599999999999996,"15min":0.87},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.59199999999999997,"15min":0.60899999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.35699999999999998},"max":{"1min":0.64700000000000002,"5min":0.83899999999999997,"15min":1.1890000000000001},"last":0.499}]},{"osd":4,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.74299999999999999,"15min":0.76400000000000001},"min":{"1min":0.55100000000000005,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":0.84299999999999997,"5min":1.1379999999999999,"15min":1.256},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72499999999999998,"15min":0.75600000000000001},"min":{"1min":0.501,"5min":0.48799999999999999,"15min":0.44800000000000001},"max":{"1min":0.88500000000000001,"5min":1.171,"15min":1.696},"last":0.79600000000000004}]},{"osd":5,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73699999999999999,"15min":0.76800000000000002},"min":{"1min":0.60399999999999998,"5min":0.505,"15min":0.42399999999999999},"max":{"1min":0.95399999999999996,"5min":1.143,"15min":1.3049999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.748,"15min":0.77600000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.503},"max":{"1min":1.038,"5min":1.0629999999999999,"15min":1.3440000000000001},"last":0.81000000000000005}]},{"osd":6,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.76300000000000001,"15min":0.77900000000000003},"min":{"1min":0.53900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91100000000000003,"5min":1.115,"15min":1.768},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.78200000000000003},"min":{"1min":0.53500000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.98899999999999999,"5min":1.101,"15min":1.5309999999999999},"last":0.69999999999999996}]},{"osd":7,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.77100000000000002,"15min":0.80100000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.54600000000000004},"max":{"1min":0.93700000000000006,"5min":1.0389999999999999,"15min":1.7370000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.82099999999999995},"min":{"1min":0.64500000000000002,"5min":0.57099999999999995,"15min":0.50900000000000001},"max":{"1min":0.97899999999999998,"5min":1.0409999999999999,"15min":1.3939999999999999},"last":0.82299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575070,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307156,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064684,"statfs":{"total":96636764160,"available":96322236416,"internally_reserved":0,"allocated":1716224,"data_stored":838043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45300000000000001,"15min":0.46800000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.60099999999999998,"5min":0.86299999999999999,"15min":0.94299999999999995},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.47099999999999997,"15min":0.49099999999999999},"min":{"1min":0.32900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55500000000000005,"5min":0.81799999999999995,"15min":1.228},"last":0.38100000000000001}]},{"osd":1,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46899999999999997,"15min":0.47999999999999998},"min":{"1min":0.34599999999999997,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.65800000000000003,"5min":0.81899999999999995,"15min":2.0800000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.55000000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.247},"max":{"1min":0.68500000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41199999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55600000000000005,"15min":0.57899999999999996},"min":{"1min":0.39000000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73199999999999998,"5min":0.94099999999999995,"15min":2.3959999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.61699999999999999,"15min":0.63200000000000001},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.309},"max":{"1min":0.75,"5min":0.97699999999999998,"15min":3.8900000000000001},"last":0.59299999999999997}]},{"osd":4,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.71699999999999997,"15min":0.73699999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40799999999999997},"max":{"1min":1.014,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.871},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79600000000000004,"15min":0.81999999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.55300000000000005},"max":{"1min":0.96099999999999997,"5min":1.22,"15min":1.22},"last":0.82199999999999995}]},{"osd":5,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94799999999999995,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.628},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.76600000000000001,"15min":0.79600000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.98799999999999999,"5min":1.1519999999999999,"15min":1.1830000000000001},"last":0.64500000000000002}]},{"osd":6,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.753,"15min":0.77400000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.51700000000000002},"max":{"1min":0.93999999999999995,"5min":1.304,"15min":1.304},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.73899999999999999,"15min":0.77400000000000002},"min":{"1min":0.53100000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.016,"5min":1.1579999999999999,"15min":1.7769999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78200000000000003,"15min":0.81299999999999994},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1,"5min":1.2629999999999999,"15min":1.8180000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.78000000000000003,"15min":0.81599999999999995},"min":{"1min":0.58199999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.056,"5min":1.1919999999999999,"15min":1.486},"last":0.80400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575069,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311236,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060604,"statfs":{"total":96636764160,"available":96318058496,"internally_reserved":0,"allocated":1699840,"data_stored":836437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69899999999999995,"15min":0.70999999999999996},"min":{"1min":0.45000000000000001,"5min":0.35899999999999999,"15min":0.29799999999999999},"max":{"1min":1.109,"5min":1.5609999999999999,"15min":3.1139999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.71499999999999997,"15min":0.72299999999999998},"min":{"1min":0.47399999999999998,"5min":0.39900000000000002,"15min":0.39300000000000002},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.8130000000000002},"last":0.80400000000000005}]},{"osd":1,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68799999999999994,"15min":0.71599999999999997},"min":{"1min":0.47199999999999998,"5min":0.39500000000000002,"15min":0.373},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.9279999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71299999999999997,"15min":0.73799999999999999},"min":{"1min":0.54000000000000004,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3129999999999999,"5min":1.4339999999999999,"15min":3.4359999999999999},"last":0.66700000000000004}]},{"osd":2,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.72799999999999998,"15min":0.755},"min":{"1min":0.52900000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74199999999999999,"15min":0.77400000000000002},"min":{"1min":0.54900000000000004,"5min":0.48299999999999998,"15min":0.47599999999999998},"max":{"1min":0.98999999999999999,"5min":1.0129999999999999,"15min":2.427},"last":0.68999999999999995}]},{"osd":3,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.72899999999999998,"15min":0.74399999999999999},"min":{"1min":0.46999999999999997,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.8239999999999998,"5min":2.8239999999999998,"15min":2.8239999999999998},"last":0.754},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.749},"min":{"1min":0.56499999999999995,"5min":0.443,"15min":0.43099999999999999},"max":{"1min":1.077,"5min":1.077,"15min":3.6899999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.32700000000000001,"15min":0.317},"max":{"1min":2.234,"5min":2.234,"15min":3.3860000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.65200000000000002,"15min":0.65000000000000002},"min":{"1min":0.436,"5min":0.40999999999999998,"15min":0.34999999999999998},"max":{"1min":2.8690000000000002,"5min":2.8690000000000002,"15min":3.9300000000000002},"last":0.61399999999999999}]},{"osd":6,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.45800000000000002,"5min":0.42299999999999999,"15min":0.36499999999999999},"max":{"1min":1.262,"5min":1.262,"15min":3.5270000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68500000000000005,"15min":0.68000000000000005},"min":{"1min":0.48899999999999999,"5min":0.42499999999999999,"15min":0.374},"max":{"1min":1.369,"5min":1.587,"15min":3.4740000000000002},"last":0.57999999999999996}]},{"osd":7,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.73299999999999998,"15min":0.72599999999999998},"min":{"1min":0.59399999999999997,"5min":0.44,"15min":0.34699999999999998},"max":{"1min":2.9049999999999998,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.439},"max":{"1min":1.133,"5min":1.1899999999999999,"15min":3.7280000000000002},"last":0.72399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575070,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303052,"kb_used_data":1668,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068788,"statfs":{"total":96636764160,"available":96326438912,"internally_reserved":0,"allocated":1708032,"data_stored":837013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66300000000000003,"15min":0.68799999999999994},"min":{"1min":0.45400000000000001,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.85299999999999998,"5min":0.93600000000000005,"15min":0.96999999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65500000000000003,"15min":0.67800000000000005},"min":{"1min":0.47099999999999997,"5min":0.379,"15min":0.32900000000000001},"max":{"1min":1.024,"5min":1.119,"15min":1.119},"last":0.497}]},{"osd":1,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66000000000000003,"15min":0.67900000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39700000000000002},"max":{"1min":0.84599999999999997,"5min":1.0029999999999999,"15min":1.034},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.69899999999999995,"15min":0.71499999999999997},"min":{"1min":0.52200000000000002,"5min":0.45400000000000001,"15min":0.40400000000000003},"max":{"1min":0.79500000000000004,"5min":0.95099999999999996,"15min":1.0229999999999999},"last":0.54300000000000004}]},{"osd":2,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68999999999999995,"15min":0.71699999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.47299999999999998},"max":{"1min":0.81000000000000005,"5min":0.997,"15min":1.0580000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.68100000000000005,"15min":0.70299999999999996},"min":{"1min":0.48099999999999998,"5min":0.46200000000000002,"15min":0.442},"max":{"1min":0.88100000000000001,"5min":0.97799999999999998,"15min":1.0720000000000001},"last":0.67300000000000004}]},{"osd":3,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70099999999999996,"15min":0.71199999999999997},"min":{"1min":0.51300000000000001,"5min":0.46300000000000002,"15min":0.435},"max":{"1min":0.96299999999999997,"5min":1.1499999999999999,"15min":1.302},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.54000000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93600000000000005,"5min":1.03,"15min":1.399},"last":0.625}]},{"osd":4,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.621,"15min":0.60199999999999998},"min":{"1min":0.44900000000000001,"5min":0.377,"15min":0.36099999999999999},"max":{"1min":0.89000000000000001,"5min":0.96099999999999997,"15min":0.96799999999999997},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.42099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.002,"5min":1.075,"15min":1.075},"last":0.65200000000000002}]},{"osd":6,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63300000000000001,"15min":0.628},"min":{"1min":0.439,"5min":0.41099999999999998,"15min":0.36599999999999999},"max":{"1min":0.94299999999999995,"5min":1.0049999999999999,"15min":1.018},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68700000000000006,"15min":0.67100000000000004},"min":{"1min":0.48499999999999999,"5min":0.41199999999999998,"15min":0.38900000000000001},"max":{"1min":0.95299999999999996,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.76900000000000002}]},{"osd":7,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68799999999999994,"15min":0.68300000000000005},"min":{"1min":0.499,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.048,"5min":1.48,"15min":1.48},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76700000000000002,"15min":0.76400000000000001},"min":{"1min":0.59499999999999997,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0189999999999999,"5min":1.466,"15min":1.466},"last":0.73799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T07:01:32.313 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T07:01:32.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.507+0000 7f72ad5ff700 1 Processor -- start 2023-10-09T07:01:32.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.507+0000 7f72ad5ff700 1 -- start start 2023-10-09T07:01:32.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.509+0000 7f72ad5ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f72a80ccf90 0x7f72a80ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:32.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.509+0000 7f72ad5ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a80cc300 con 0x7f72a80b1420 2023-10-09T07:01:32.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.509+0000 7f72ad5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a80ad370 con 0x7f72a80cbf30 2023-10-09T07:01:32.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.509+0000 7f72ad5ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a8156bf0 con 0x7f72a80ccf90 2023-10-09T07:01:32.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.509+0000 7f72a77fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f72a80ccf90 0x7f72a80ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:32.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.509+0000 7f72a77fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f72a80ccf90 0x7f72a80ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40168/0 (socket says 172.21.15.71:40168) 2023-10-09T07:01:32.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.509+0000 7f72a77fe700 1 -- 172.21.15.71:0/2245331929 learned_addr learned my addr 172.21.15.71:0/2245331929 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:32.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.509+0000 7f729ffff700 1 --1- 172.21.15.71:0/2245331929 >> v1:172.21.15.71:6789/0 conn(0x7f72a80b1420 0x7f72a80c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57644/0 (socket says 172.21.15.71:57644) 2023-10-09T07:01:32.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.509+0000 7f72a77fe700 1 -- 172.21.15.71:0/2245331929 >> v1:172.21.15.179:6789/0 conn(0x7f72a80cbf30 legacy=0x7f72a80b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:32.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.509+0000 7f72a77fe700 1 -- 172.21.15.71:0/2245331929 >> v1:172.21.15.71:6789/0 conn(0x7f72a80b1420 legacy=0x7f72a80c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:32.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.509+0000 7f72a77fe700 1 -- 172.21.15.71:0/2245331929 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a80ad650 con 0x7f72a80ccf90 2023-10-09T07:01:32.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.510+0000 7f72a77fe700 1 --2- 172.21.15.71:0/2245331929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72a80ccf90 0x7f72a80ae410 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009f20 tx=0x7f72a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05a7929462b4ce server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:32.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.510+0000 7f72a67fc700 1 -- 172.21.15.71:0/2245331929 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a000e070 con 0x7f72a80ccf90 2023-10-09T07:01:32.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.510+0000 7f72a67fc700 1 -- 172.21.15.71:0/2245331929 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a000ba40 con 0x7f72a80ccf90 2023-10-09T07:01:32.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.510+0000 7f72a67fc700 1 -- 172.21.15.71:0/2245331929 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a00092e0 con 0x7f72a80ccf90 2023-10-09T07:01:32.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.510+0000 7f72ad5ff700 1 -- 172.21.15.71:0/2245331929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72a80ccf90 msgr2=0x7f72a80ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:32.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.510+0000 7f72ad5ff700 1 --2- 172.21.15.71:0/2245331929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72a80ccf90 0x7f72a80ae410 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009f20 tx=0x7f72a0009840 comp rx=0 tx=0).stop 2023-10-09T07:01:32.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.510+0000 7f72ad5ff700 1 -- 172.21.15.71:0/2245331929 shutdown_connections 2023-10-09T07:01:32.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.510+0000 7f72ad5ff700 1 --2- 172.21.15.71:0/2245331929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72a80ccf90 0x7f72a80ae410 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:32.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.510+0000 7f72ad5ff700 1 -- 172.21.15.71:0/2245331929 >> 172.21.15.71:0/2245331929 conn(0x7f72a806a320 msgr2=0x7f72a80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:32.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.511+0000 7f72ad5ff700 1 -- 172.21.15.71:0/2245331929 shutdown_connections 2023-10-09T07:01:32.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.511+0000 7f72ad5ff700 1 -- 172.21.15.71:0/2245331929 wait complete. 2023-10-09T07:01:32.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.512+0000 7f72ad5ff700 1 Processor -- start 2023-10-09T07:01:32.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.512+0000 7f72ad5ff700 1 -- start start 2023-10-09T07:01:32.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.513+0000 7f72ad5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72a80b1420 0x7f72a80a6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:32.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.513+0000 7f72ad5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72a80cbf30 0x7f72a8155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:32.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.513+0000 7f72ad5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72a80ccf90 0x7f72a8158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:32.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.513+0000 7f72ad5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a8157d00 con 0x7f72a80b1420 2023-10-09T07:01:32.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.513+0000 7f72ad5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a8157fc0 con 0x7f72a80ccf90 2023-10-09T07:01:32.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.513+0000 7f72ad5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a81582a0 con 0x7f72a80cbf30 2023-10-09T07:01:32.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.513+0000 7f72a6ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72a80b1420 0x7f72a80a6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:32.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.513+0000 7f72a6ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72a80b1420 0x7f72a80a6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40180/0 (socket says 172.21.15.71:40180) 2023-10-09T07:01:32.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.513+0000 7f72a6ffd700 1 -- 172.21.15.71:0/816096414 learned_addr learned my addr 172.21.15.71:0/816096414 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:32.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.514+0000 7f72a77fe700 1 --2- 172.21.15.71:0/816096414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72a80ccf90 0x7f72a8158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:32.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.514+0000 7f729ffff700 1 --2- 172.21.15.71:0/816096414 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72a80cbf30 0x7f72a8155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:32.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.514+0000 7f72a6ffd700 1 -- 172.21.15.71:0/816096414 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72a80cbf30 msgr2=0x7f72a8155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:32.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.514+0000 7f72a6ffd700 1 --2- 172.21.15.71:0/816096414 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72a80cbf30 0x7f72a8155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:32.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.514+0000 7f72a6ffd700 1 -- 172.21.15.71:0/816096414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72a80ccf90 msgr2=0x7f72a8158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:32.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.514+0000 7f72a6ffd700 1 --2- 172.21.15.71:0/816096414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72a80ccf90 0x7f72a8158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:32.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.514+0000 7f72a6ffd700 1 -- 172.21.15.71:0/816096414 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a0009ae0 con 0x7f72a80b1420 2023-10-09T07:01:32.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.514+0000 7f72a6ffd700 1 --2- 172.21.15.71:0/816096414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72a80b1420 0x7f72a80a6b90 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f729800c5d0 tx=0x7f7298007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:32.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.514+0000 7f729effd700 1 -- 172.21.15.71:0/816096414 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7298011590 con 0x7f72a80b1420 2023-10-09T07:01:32.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.514+0000 7f729effd700 1 -- 172.21.15.71:0/816096414 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7298011710 con 0x7f72a80b1420 2023-10-09T07:01:32.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.514+0000 7f72ad5ff700 1 -- 172.21.15.71:0/816096414 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a8158580 con 0x7f72a80b1420 2023-10-09T07:01:32.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.515+0000 7f729effd700 1 -- 172.21.15.71:0/816096414 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7298011ad0 con 0x7f72a80b1420 2023-10-09T07:01:32.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.515+0000 7f72ad5ff700 1 -- 172.21.15.71:0/816096414 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a80a70d0 con 0x7f72a80b1420 2023-10-09T07:01:32.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.516+0000 7f72ad5ff700 1 -- 172.21.15.71:0/816096414 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a804c3c0 con 0x7f72a80b1420 2023-10-09T07:01:32.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.517+0000 7f729effd700 1 -- 172.21.15.71:0/816096414 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f729801c460 con 0x7f72a80b1420 2023-10-09T07:01:32.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.517+0000 7f729effd700 1 --2- 172.21.15.71:0/816096414 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7288066f30 0x7f72880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:32.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.517+0000 7f729effd700 1 -- 172.21.15.71:0/816096414 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f7298084350 con 0x7f72a80b1420 2023-10-09T07:01:32.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.518+0000 7f729ffff700 1 --2- 172.21.15.71:0/816096414 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7288066f30 0x7f72880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:32.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.518+0000 7f729ffff700 1 --2- 172.21.15.71:0/816096414 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7288066f30 0x7f72880693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f72a806f750 tx=0x7f7290007eb0 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:32.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.521+0000 7f729effd700 1 -- 172.21.15.71:0/816096414 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7298051420 con 0x7f72a80b1420 2023-10-09T07:01:32.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.707+0000 7f72ad5ff700 1 -- 172.21.15.71:0/816096414 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f72a806c1c0 con 0x7f7288066f30 2023-10-09T07:01:32.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.716+0000 7f729effd700 1 -- 172.21.15.71:0/816096414 <== mgr.7627 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289382 (secure 0 0 0) 0x7f72a806c1c0 con 0x7f7288066f30 2023-10-09T07:01:32.721 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:01:32.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.720+0000 7f72ad5ff700 1 -- 172.21.15.71:0/816096414 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7288066f30 msgr2=0x7f72880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:32.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.720+0000 7f72ad5ff700 1 --2- 172.21.15.71:0/816096414 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7288066f30 0x7f72880693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f72a806f750 tx=0x7f7290007eb0 comp rx=0 tx=0).stop 2023-10-09T07:01:32.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.720+0000 7f72ad5ff700 1 -- 172.21.15.71:0/816096414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72a80b1420 msgr2=0x7f72a80a6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:32.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.720+0000 7f72ad5ff700 1 --2- 172.21.15.71:0/816096414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72a80b1420 0x7f72a80a6b90 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f729800c5d0 tx=0x7f7298007f60 comp rx=0 tx=0).stop 2023-10-09T07:01:32.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.720+0000 7f72ad5ff700 1 -- 172.21.15.71:0/816096414 shutdown_connections 2023-10-09T07:01:32.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.720+0000 7f72ad5ff700 1 --2- 172.21.15.71:0/816096414 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7288066f30 0x7f72880693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:32.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.720+0000 7f72ad5ff700 1 --2- 172.21.15.71:0/816096414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72a80ccf90 0x7f72a8158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:32.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.720+0000 7f72ad5ff700 1 --2- 172.21.15.71:0/816096414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72a80b1420 0x7f72a80a6b90 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:32.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.720+0000 7f72ad5ff700 1 --2- 172.21.15.71:0/816096414 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72a80cbf30 0x7f72a8155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:32.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.720+0000 7f72ad5ff700 1 -- 172.21.15.71:0/816096414 >> 172.21.15.71:0/816096414 conn(0x7f72a806a320 msgr2=0x7f72a80caf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:32.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.720+0000 7f72ad5ff700 1 -- 172.21.15.71:0/816096414 shutdown_connections 2023-10-09T07:01:32.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.720+0000 7f72ad5ff700 1 -- 172.21.15.71:0/816096414 wait complete. 2023-10-09T07:01:32.724 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T07:01:32.739 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-09T07:01:32.077846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":444,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":288,"ondisk_log_size":288,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2446056,"kb_used_data":14504,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752528664,"statfs":{"total":773094113280,"available":770589351936,"internally_reserved":0,"allocated":14852096,"data_stored":7876844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.943846"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169399+0000","last_change":"2023-10-09T07:01:23.164925+0000","last_active":"2023-10-09T07:01:23.169399+0000","last_peered":"2023-10-09T07:01:23.169399+0000","last_clean":"2023-10-09T07:01:23.169399+0000","last_became_active":"2023-10-09T07:01:23.164650+0000","last_became_peered":"2023-10-09T07:01:23.164650+0000","last_unstale":"2023-10-09T07:01:23.169399+0000","last_undegraded":"2023-10-09T07:01:23.169399+0000","last_fullsized":"2023-10-09T07:01:23.169399+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:56:55.723335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160903+0000","last_change":"2023-10-09T07:01:23.152371+0000","last_active":"2023-10-09T07:01:23.160903+0000","last_peered":"2023-10-09T07:01:23.160903+0000","last_clean":"2023-10-09T07:01:23.160903+0000","last_became_active":"2023-10-09T07:01:23.149932+0000","last_became_peered":"2023-10-09T07:01:23.149932+0000","last_unstale":"2023-10-09T07:01:23.160903+0000","last_undegraded":"2023-10-09T07:01:23.160903+0000","last_fullsized":"2023-10-09T07:01:23.160903+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:28.489315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168628+0000","last_change":"2023-10-09T07:01:23.164403+0000","last_active":"2023-10-09T07:01:23.168628+0000","last_peered":"2023-10-09T07:01:23.168628+0000","last_clean":"2023-10-09T07:01:23.168628+0000","last_became_active":"2023-10-09T07:01:23.164108+0000","last_became_peered":"2023-10-09T07:01:23.164108+0000","last_unstale":"2023-10-09T07:01:23.168628+0000","last_undegraded":"2023-10-09T07:01:23.168628+0000","last_fullsized":"2023-10-09T07:01:23.168628+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:04:18.098519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169476+0000","last_change":"2023-10-09T07:01:23.162588+0000","last_active":"2023-10-09T07:01:23.169476+0000","last_peered":"2023-10-09T07:01:23.169476+0000","last_clean":"2023-10-09T07:01:23.169476+0000","last_became_active":"2023-10-09T07:01:23.162344+0000","last_became_peered":"2023-10-09T07:01:23.162344+0000","last_unstale":"2023-10-09T07:01:23.169476+0000","last_undegraded":"2023-10-09T07:01:23.169476+0000","last_fullsized":"2023-10-09T07:01:23.169476+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:51:21.311880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.155043+0000","last_change":"2023-10-09T07:01:23.151380+0000","last_active":"2023-10-09T07:01:23.155043+0000","last_peered":"2023-10-09T07:01:23.155043+0000","last_clean":"2023-10-09T07:01:23.155043+0000","last_became_active":"2023-10-09T07:01:23.151124+0000","last_became_peered":"2023-10-09T07:01:23.151124+0000","last_unstale":"2023-10-09T07:01:23.155043+0000","last_undegraded":"2023-10-09T07:01:23.155043+0000","last_fullsized":"2023-10-09T07:01:23.155043+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:42:28.704095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.150895+0000","last_change":"2023-10-09T07:01:23.147303+0000","last_active":"2023-10-09T07:01:23.150895+0000","last_peered":"2023-10-09T07:01:23.150895+0000","last_clean":"2023-10-09T07:01:23.150895+0000","last_became_active":"2023-10-09T07:01:23.147024+0000","last_became_peered":"2023-10-09T07:01:23.147024+0000","last_unstale":"2023-10-09T07:01:23.150895+0000","last_undegraded":"2023-10-09T07:01:23.150895+0000","last_fullsized":"2023-10-09T07:01:23.150895+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:09.967603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.156058+0000","last_change":"2023-10-09T07:01:23.152423+0000","last_active":"2023-10-09T07:01:23.156058+0000","last_peered":"2023-10-09T07:01:23.156058+0000","last_clean":"2023-10-09T07:01:23.156058+0000","last_became_active":"2023-10-09T07:01:23.151931+0000","last_became_peered":"2023-10-09T07:01:23.151931+0000","last_unstale":"2023-10-09T07:01:23.156058+0000","last_undegraded":"2023-10-09T07:01:23.156058+0000","last_fullsized":"2023-10-09T07:01:23.156058+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:44:26.423025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166540+0000","last_change":"2023-10-09T07:01:23.160836+0000","last_active":"2023-10-09T07:01:23.166540+0000","last_peered":"2023-10-09T07:01:23.166540+0000","last_clean":"2023-10-09T07:01:23.166540+0000","last_became_active":"2023-10-09T07:01:23.159642+0000","last_became_peered":"2023-10-09T07:01:23.159642+0000","last_unstale":"2023-10-09T07:01:23.166540+0000","last_undegraded":"2023-10-09T07:01:23.166540+0000","last_fullsized":"2023-10-09T07:01:23.166540+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:27:10.847597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169381+0000","last_change":"2023-10-09T07:01:23.162853+0000","last_active":"2023-10-09T07:01:23.169381+0000","last_peered":"2023-10-09T07:01:23.169381+0000","last_clean":"2023-10-09T07:01:23.169381+0000","last_became_active":"2023-10-09T07:01:23.162608+0000","last_became_peered":"2023-10-09T07:01:23.162608+0000","last_unstale":"2023-10-09T07:01:23.169381+0000","last_undegraded":"2023-10-09T07:01:23.169381+0000","last_fullsized":"2023-10-09T07:01:23.169381+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:14.698455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169349+0000","last_change":"2023-10-09T07:01:23.159296+0000","last_active":"2023-10-09T07:01:23.169349+0000","last_peered":"2023-10-09T07:01:23.169349+0000","last_clean":"2023-10-09T07:01:23.169349+0000","last_became_active":"2023-10-09T07:01:23.158849+0000","last_became_peered":"2023-10-09T07:01:23.158849+0000","last_unstale":"2023-10-09T07:01:23.169349+0000","last_undegraded":"2023-10-09T07:01:23.169349+0000","last_fullsized":"2023-10-09T07:01:23.169349+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:41:09.303760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160748+0000","last_change":"2023-10-09T07:01:23.153489+0000","last_active":"2023-10-09T07:01:23.160748+0000","last_peered":"2023-10-09T07:01:23.160748+0000","last_clean":"2023-10-09T07:01:23.160748+0000","last_became_active":"2023-10-09T07:01:23.153209+0000","last_became_peered":"2023-10-09T07:01:23.153209+0000","last_unstale":"2023-10-09T07:01:23.160748+0000","last_undegraded":"2023-10-09T07:01:23.160748+0000","last_fullsized":"2023-10-09T07:01:23.160748+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:11:02.068844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169360+0000","last_change":"2023-10-09T07:01:23.160349+0000","last_active":"2023-10-09T07:01:23.169360+0000","last_peered":"2023-10-09T07:01:23.169360+0000","last_clean":"2023-10-09T07:01:23.169360+0000","last_became_active":"2023-10-09T07:01:23.159129+0000","last_became_peered":"2023-10-09T07:01:23.159129+0000","last_unstale":"2023-10-09T07:01:23.169360+0000","last_undegraded":"2023-10-09T07:01:23.169360+0000","last_fullsized":"2023-10-09T07:01:23.169360+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:03.948952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.165795+0000","last_change":"2023-10-09T07:01:23.155784+0000","last_active":"2023-10-09T07:01:23.165795+0000","last_peered":"2023-10-09T07:01:23.165795+0000","last_clean":"2023-10-09T07:01:23.165795+0000","last_became_active":"2023-10-09T07:01:23.155491+0000","last_became_peered":"2023-10-09T07:01:23.155491+0000","last_unstale":"2023-10-09T07:01:23.165795+0000","last_undegraded":"2023-10-09T07:01:23.165795+0000","last_fullsized":"2023-10-09T07:01:23.165795+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:27:25.463240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166474+0000","last_change":"2023-10-09T07:01:23.159353+0000","last_active":"2023-10-09T07:01:23.166474+0000","last_peered":"2023-10-09T07:01:23.166474+0000","last_clean":"2023-10-09T07:01:23.166474+0000","last_became_active":"2023-10-09T07:01:23.158889+0000","last_became_peered":"2023-10-09T07:01:23.158889+0000","last_unstale":"2023-10-09T07:01:23.166474+0000","last_undegraded":"2023-10-09T07:01:23.166474+0000","last_fullsized":"2023-10-09T07:01:23.166474+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:51:05.796099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.155504+0000","last_change":"2023-10-09T07:01:23.149230+0000","last_active":"2023-10-09T07:01:23.155504+0000","last_peered":"2023-10-09T07:01:23.155504+0000","last_clean":"2023-10-09T07:01:23.155504+0000","last_became_active":"2023-10-09T07:01:23.148921+0000","last_became_peered":"2023-10-09T07:01:23.148921+0000","last_unstale":"2023-10-09T07:01:23.155504+0000","last_undegraded":"2023-10-09T07:01:23.155504+0000","last_fullsized":"2023-10-09T07:01:23.155504+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:01:52.583166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169227+0000","last_change":"2023-10-09T07:01:23.156333+0000","last_active":"2023-10-09T07:01:23.169227+0000","last_peered":"2023-10-09T07:01:23.169227+0000","last_clean":"2023-10-09T07:01:23.169227+0000","last_became_active":"2023-10-09T07:01:23.155976+0000","last_became_peered":"2023-10-09T07:01:23.155976+0000","last_unstale":"2023-10-09T07:01:23.169227+0000","last_undegraded":"2023-10-09T07:01:23.169227+0000","last_fullsized":"2023-10-09T07:01:23.169227+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:35.524873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160721+0000","last_change":"2023-10-09T07:01:23.153583+0000","last_active":"2023-10-09T07:01:23.160721+0000","last_peered":"2023-10-09T07:01:23.160721+0000","last_clean":"2023-10-09T07:01:23.160721+0000","last_became_active":"2023-10-09T07:01:23.153316+0000","last_became_peered":"2023-10-09T07:01:23.153316+0000","last_unstale":"2023-10-09T07:01:23.160721+0000","last_undegraded":"2023-10-09T07:01:23.160721+0000","last_fullsized":"2023-10-09T07:01:23.160721+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:39.937569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.163633+0000","last_change":"2023-10-09T07:01:23.160341+0000","last_active":"2023-10-09T07:01:23.163633+0000","last_peered":"2023-10-09T07:01:23.163633+0000","last_clean":"2023-10-09T07:01:23.163633+0000","last_became_active":"2023-10-09T07:01:23.160072+0000","last_became_peered":"2023-10-09T07:01:23.160072+0000","last_unstale":"2023-10-09T07:01:23.163633+0000","last_undegraded":"2023-10-09T07:01:23.163633+0000","last_fullsized":"2023-10-09T07:01:23.163633+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:11:02.068844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.165999+0000","last_change":"2023-10-09T07:01:23.156268+0000","last_active":"2023-10-09T07:01:23.165999+0000","last_peered":"2023-10-09T07:01:23.165999+0000","last_clean":"2023-10-09T07:01:23.165999+0000","last_became_active":"2023-10-09T07:01:23.155579+0000","last_became_peered":"2023-10-09T07:01:23.155579+0000","last_unstale":"2023-10-09T07:01:23.165999+0000","last_undegraded":"2023-10-09T07:01:23.165999+0000","last_fullsized":"2023-10-09T07:01:23.165999+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:29.980004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160306+0000","last_change":"2023-10-09T07:01:23.152079+0000","last_active":"2023-10-09T07:01:23.160306+0000","last_peered":"2023-10-09T07:01:23.160306+0000","last_clean":"2023-10-09T07:01:23.160306+0000","last_became_active":"2023-10-09T07:01:23.151814+0000","last_became_peered":"2023-10-09T07:01:23.151814+0000","last_unstale":"2023-10-09T07:01:23.160306+0000","last_undegraded":"2023-10-09T07:01:23.160306+0000","last_fullsized":"2023-10-09T07:01:23.160306+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:29.980004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.161043+0000","last_change":"2023-10-09T07:01:23.153002+0000","last_active":"2023-10-09T07:01:23.161043+0000","last_peered":"2023-10-09T07:01:23.161043+0000","last_clean":"2023-10-09T07:01:23.161043+0000","last_became_active":"2023-10-09T07:01:23.150740+0000","last_became_peered":"2023-10-09T07:01:23.150740+0000","last_unstale":"2023-10-09T07:01:23.161043+0000","last_undegraded":"2023-10-09T07:01:23.161043+0000","last_fullsized":"2023-10-09T07:01:23.161043+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:59.520657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.155518+0000","last_change":"2023-10-09T07:01:23.151375+0000","last_active":"2023-10-09T07:01:23.155518+0000","last_peered":"2023-10-09T07:01:23.155518+0000","last_clean":"2023-10-09T07:01:23.155518+0000","last_became_active":"2023-10-09T07:01:23.151112+0000","last_became_peered":"2023-10-09T07:01:23.151112+0000","last_unstale":"2023-10-09T07:01:23.155518+0000","last_undegraded":"2023-10-09T07:01:23.155518+0000","last_fullsized":"2023-10-09T07:01:23.155518+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:04.781425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160660+0000","last_change":"2023-10-09T07:01:23.152659+0000","last_active":"2023-10-09T07:01:23.160660+0000","last_peered":"2023-10-09T07:01:23.160660+0000","last_clean":"2023-10-09T07:01:23.160660+0000","last_became_active":"2023-10-09T07:01:23.150490+0000","last_became_peered":"2023-10-09T07:01:23.150490+0000","last_unstale":"2023-10-09T07:01:23.160660+0000","last_undegraded":"2023-10-09T07:01:23.160660+0000","last_fullsized":"2023-10-09T07:01:23.160660+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:04:18.098519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168542+0000","last_change":"2023-10-09T07:01:23.164581+0000","last_active":"2023-10-09T07:01:23.168542+0000","last_peered":"2023-10-09T07:01:23.168542+0000","last_clean":"2023-10-09T07:01:23.168542+0000","last_became_active":"2023-10-09T07:01:23.164337+0000","last_became_peered":"2023-10-09T07:01:23.164337+0000","last_unstale":"2023-10-09T07:01:23.168542+0000","last_undegraded":"2023-10-09T07:01:23.168542+0000","last_fullsized":"2023-10-09T07:01:23.168542+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:16.117929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160742+0000","last_change":"2023-10-09T07:01:23.154153+0000","last_active":"2023-10-09T07:01:23.160742+0000","last_peered":"2023-10-09T07:01:23.160742+0000","last_clean":"2023-10-09T07:01:23.160742+0000","last_became_active":"2023-10-09T07:01:23.153907+0000","last_became_peered":"2023-10-09T07:01:23.153907+0000","last_unstale":"2023-10-09T07:01:23.160742+0000","last_undegraded":"2023-10-09T07:01:23.160742+0000","last_fullsized":"2023-10-09T07:01:23.160742+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:13:13.307044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169370+0000","last_change":"2023-10-09T07:01:23.159971+0000","last_active":"2023-10-09T07:01:23.169370+0000","last_peered":"2023-10-09T07:01:23.169370+0000","last_clean":"2023-10-09T07:01:23.169370+0000","last_became_active":"2023-10-09T07:01:23.159558+0000","last_became_peered":"2023-10-09T07:01:23.159558+0000","last_unstale":"2023-10-09T07:01:23.169370+0000","last_undegraded":"2023-10-09T07:01:23.169370+0000","last_fullsized":"2023-10-09T07:01:23.169370+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:32:11.820612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169474+0000","last_change":"2023-10-09T07:01:23.163463+0000","last_active":"2023-10-09T07:01:23.169474+0000","last_peered":"2023-10-09T07:01:23.169474+0000","last_clean":"2023-10-09T07:01:23.169474+0000","last_became_active":"2023-10-09T07:01:23.163220+0000","last_became_peered":"2023-10-09T07:01:23.163220+0000","last_unstale":"2023-10-09T07:01:23.169474+0000","last_undegraded":"2023-10-09T07:01:23.169474+0000","last_fullsized":"2023-10-09T07:01:23.169474+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:54:03.877112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.167499+0000","last_change":"2023-10-09T07:01:23.163460+0000","last_active":"2023-10-09T07:01:23.167499+0000","last_peered":"2023-10-09T07:01:23.167499+0000","last_clean":"2023-10-09T07:01:23.167499+0000","last_became_active":"2023-10-09T07:01:23.163219+0000","last_became_peered":"2023-10-09T07:01:23.163219+0000","last_unstale":"2023-10-09T07:01:23.167499+0000","last_undegraded":"2023-10-09T07:01:23.167499+0000","last_fullsized":"2023-10-09T07:01:23.167499+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:27:35.224469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.161882+0000","last_change":"2023-10-09T07:01:23.157877+0000","last_active":"2023-10-09T07:01:23.161882+0000","last_peered":"2023-10-09T07:01:23.161882+0000","last_clean":"2023-10-09T07:01:23.161882+0000","last_became_active":"2023-10-09T07:01:23.156649+0000","last_became_peered":"2023-10-09T07:01:23.156649+0000","last_unstale":"2023-10-09T07:01:23.161882+0000","last_undegraded":"2023-10-09T07:01:23.161882+0000","last_fullsized":"2023-10-09T07:01:23.161882+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:03:43.822136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.155355+0000","last_change":"2023-10-09T07:01:23.147390+0000","last_active":"2023-10-09T07:01:23.155355+0000","last_peered":"2023-10-09T07:01:23.155355+0000","last_clean":"2023-10-09T07:01:23.155355+0000","last_became_active":"2023-10-09T07:01:23.147147+0000","last_became_peered":"2023-10-09T07:01:23.147147+0000","last_unstale":"2023-10-09T07:01:23.155355+0000","last_undegraded":"2023-10-09T07:01:23.155355+0000","last_fullsized":"2023-10-09T07:01:23.155355+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:12:47.806691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169117+0000","last_change":"2023-10-09T07:01:23.159774+0000","last_active":"2023-10-09T07:01:23.169117+0000","last_peered":"2023-10-09T07:01:23.169117+0000","last_clean":"2023-10-09T07:01:23.169117+0000","last_became_active":"2023-10-09T07:01:23.159430+0000","last_became_peered":"2023-10-09T07:01:23.159430+0000","last_unstale":"2023-10-09T07:01:23.169117+0000","last_undegraded":"2023-10-09T07:01:23.169117+0000","last_fullsized":"2023-10-09T07:01:23.169117+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:21:26.011332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.150788+0000","last_change":"2023-10-09T07:01:23.147125+0000","last_active":"2023-10-09T07:01:23.150788+0000","last_peered":"2023-10-09T07:01:23.150788+0000","last_clean":"2023-10-09T07:01:23.150788+0000","last_became_active":"2023-10-09T07:01:23.146875+0000","last_became_peered":"2023-10-09T07:01:23.146875+0000","last_unstale":"2023-10-09T07:01:23.150788+0000","last_undegraded":"2023-10-09T07:01:23.150788+0000","last_fullsized":"2023-10-09T07:01:23.150788+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:11:53.155142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.150752+0000","last_change":"2023-10-09T07:01:23.146731+0000","last_active":"2023-10-09T07:01:23.150752+0000","last_peered":"2023-10-09T07:01:23.150752+0000","last_clean":"2023-10-09T07:01:23.150752+0000","last_became_active":"2023-10-09T07:01:23.146485+0000","last_became_peered":"2023-10-09T07:01:23.146485+0000","last_unstale":"2023-10-09T07:01:23.150752+0000","last_undegraded":"2023-10-09T07:01:23.150752+0000","last_fullsized":"2023-10-09T07:01:23.150752+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:21:18.396544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"136'4","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166568+0000","last_change":"2023-10-09T07:01:22.147497+0000","last_active":"2023-10-09T07:01:23.166568+0000","last_peered":"2023-10-09T07:01:23.166568+0000","last_clean":"2023-10-09T07:01:23.166568+0000","last_became_active":"2023-10-09T07:01:22.147198+0000","last_became_peered":"2023-10-09T07:01:22.147198+0000","last_unstale":"2023-10-09T07:01:23.166568+0000","last_undegraded":"2023-10-09T07:01:23.166568+0000","last_fullsized":"2023-10-09T07:01:23.166568+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:13:32.149032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.155058+0000","last_change":"2023-10-09T07:01:23.152637+0000","last_active":"2023-10-09T07:01:23.155058+0000","last_peered":"2023-10-09T07:01:23.155058+0000","last_clean":"2023-10-09T07:01:23.155058+0000","last_became_active":"2023-10-09T07:01:23.152355+0000","last_became_peered":"2023-10-09T07:01:23.152355+0000","last_unstale":"2023-10-09T07:01:23.155058+0000","last_undegraded":"2023-10-09T07:01:23.155058+0000","last_fullsized":"2023-10-09T07:01:23.155058+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:39.937569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.165896+0000","last_change":"2023-10-09T07:01:22.147277+0000","last_active":"2023-10-09T07:01:23.165896+0000","last_peered":"2023-10-09T07:01:23.165896+0000","last_clean":"2023-10-09T07:01:23.165896+0000","last_became_active":"2023-10-09T07:01:22.146986+0000","last_became_peered":"2023-10-09T07:01:22.146986+0000","last_unstale":"2023-10-09T07:01:23.165896+0000","last_undegraded":"2023-10-09T07:01:23.165896+0000","last_fullsized":"2023-10-09T07:01:23.165896+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:06.347884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.145447+0000","last_change":"2023-10-09T07:01:23.143668+0000","last_active":"2023-10-09T07:01:23.145447+0000","last_peered":"2023-10-09T07:01:23.145447+0000","last_clean":"2023-10-09T07:01:23.145447+0000","last_became_active":"2023-10-09T07:01:23.143420+0000","last_became_peered":"2023-10-09T07:01:23.143420+0000","last_unstale":"2023-10-09T07:01:23.145447+0000","last_undegraded":"2023-10-09T07:01:23.145447+0000","last_fullsized":"2023-10-09T07:01:23.145447+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:48:55.565960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160700+0000","last_change":"2023-10-09T07:01:22.146764+0000","last_active":"2023-10-09T07:01:23.160700+0000","last_peered":"2023-10-09T07:01:23.160700+0000","last_clean":"2023-10-09T07:01:23.160700+0000","last_became_active":"2023-10-09T07:01:22.146458+0000","last_became_peered":"2023-10-09T07:01:22.146458+0000","last_unstale":"2023-10-09T07:01:23.160700+0000","last_undegraded":"2023-10-09T07:01:23.160700+0000","last_fullsized":"2023-10-09T07:01:23.160700+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:20:50.395740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166018+0000","last_change":"2023-10-09T07:01:23.156445+0000","last_active":"2023-10-09T07:01:23.166018+0000","last_peered":"2023-10-09T07:01:23.166018+0000","last_clean":"2023-10-09T07:01:23.166018+0000","last_became_active":"2023-10-09T07:01:23.155944+0000","last_became_peered":"2023-10-09T07:01:23.155944+0000","last_unstale":"2023-10-09T07:01:23.166018+0000","last_undegraded":"2023-10-09T07:01:23.166018+0000","last_fullsized":"2023-10-09T07:01:23.166018+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:11:02.068844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.167923+0000","last_change":"2023-10-09T07:01:22.147417+0000","last_active":"2023-10-09T07:01:23.167923+0000","last_peered":"2023-10-09T07:01:23.167923+0000","last_clean":"2023-10-09T07:01:23.167923+0000","last_became_active":"2023-10-09T07:01:22.147144+0000","last_became_peered":"2023-10-09T07:01:22.147144+0000","last_unstale":"2023-10-09T07:01:23.167923+0000","last_undegraded":"2023-10-09T07:01:23.167923+0000","last_fullsized":"2023-10-09T07:01:23.167923+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:36:25.395738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168942+0000","last_change":"2023-10-09T07:01:23.156307+0000","last_active":"2023-10-09T07:01:23.168942+0000","last_peered":"2023-10-09T07:01:23.168942+0000","last_clean":"2023-10-09T07:01:23.168942+0000","last_became_active":"2023-10-09T07:01:23.155881+0000","last_became_peered":"2023-10-09T07:01:23.155881+0000","last_unstale":"2023-10-09T07:01:23.168942+0000","last_undegraded":"2023-10-09T07:01:23.168942+0000","last_fullsized":"2023-10-09T07:01:23.168942+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:14:56.203090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160289+0000","last_change":"2023-10-09T07:01:22.147059+0000","last_active":"2023-10-09T07:01:23.160289+0000","last_peered":"2023-10-09T07:01:23.160289+0000","last_clean":"2023-10-09T07:01:23.160289+0000","last_became_active":"2023-10-09T07:01:22.146706+0000","last_became_peered":"2023-10-09T07:01:22.146706+0000","last_unstale":"2023-10-09T07:01:23.160289+0000","last_undegraded":"2023-10-09T07:01:23.160289+0000","last_fullsized":"2023-10-09T07:01:23.160289+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:55:52.026263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160279+0000","last_change":"2023-10-09T07:01:23.149840+0000","last_active":"2023-10-09T07:01:23.160279+0000","last_peered":"2023-10-09T07:01:23.160279+0000","last_clean":"2023-10-09T07:01:23.160279+0000","last_became_active":"2023-10-09T07:01:23.149547+0000","last_became_peered":"2023-10-09T07:01:23.149547+0000","last_unstale":"2023-10-09T07:01:23.160279+0000","last_undegraded":"2023-10-09T07:01:23.160279+0000","last_fullsized":"2023-10-09T07:01:23.160279+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:51:05.796099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.162203+0000","last_change":"2023-10-09T07:01:22.146261+0000","last_active":"2023-10-09T07:01:23.162203+0000","last_peered":"2023-10-09T07:01:23.162203+0000","last_clean":"2023-10-09T07:01:23.162203+0000","last_became_active":"2023-10-09T07:01:22.146020+0000","last_became_peered":"2023-10-09T07:01:22.146020+0000","last_unstale":"2023-10-09T07:01:23.162203+0000","last_undegraded":"2023-10-09T07:01:23.162203+0000","last_fullsized":"2023-10-09T07:01:23.162203+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:03:31.346374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169244+0000","last_change":"2023-10-09T07:01:23.161416+0000","last_active":"2023-10-09T07:01:23.169244+0000","last_peered":"2023-10-09T07:01:23.169244+0000","last_clean":"2023-10-09T07:01:23.169244+0000","last_became_active":"2023-10-09T07:01:23.156621+0000","last_became_peered":"2023-10-09T07:01:23.156621+0000","last_unstale":"2023-10-09T07:01:23.169244+0000","last_undegraded":"2023-10-09T07:01:23.169244+0000","last_fullsized":"2023-10-09T07:01:23.169244+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:17.826502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.138141+0000","last_change":"2023-10-09T07:01:22.152028+0000","last_active":"2023-10-09T07:01:23.138141+0000","last_peered":"2023-10-09T07:01:23.138141+0000","last_clean":"2023-10-09T07:01:23.138141+0000","last_became_active":"2023-10-09T07:01:22.151258+0000","last_became_peered":"2023-10-09T07:01:22.151258+0000","last_unstale":"2023-10-09T07:01:23.138141+0000","last_undegraded":"2023-10-09T07:01:23.138141+0000","last_fullsized":"2023-10-09T07:01:23.138141+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:51.157963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.156078+0000","last_change":"2023-10-09T07:01:23.152218+0000","last_active":"2023-10-09T07:01:23.156078+0000","last_peered":"2023-10-09T07:01:23.156078+0000","last_clean":"2023-10-09T07:01:23.156078+0000","last_became_active":"2023-10-09T07:01:23.151644+0000","last_became_peered":"2023-10-09T07:01:23.151644+0000","last_unstale":"2023-10-09T07:01:23.156078+0000","last_undegraded":"2023-10-09T07:01:23.156078+0000","last_fullsized":"2023-10-09T07:01:23.156078+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:35:21.844756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.149847+0000","last_change":"2023-10-09T07:01:22.147190+0000","last_active":"2023-10-09T07:01:23.149847+0000","last_peered":"2023-10-09T07:01:23.149847+0000","last_clean":"2023-10-09T07:01:23.149847+0000","last_became_active":"2023-10-09T07:01:22.145191+0000","last_became_peered":"2023-10-09T07:01:22.145191+0000","last_unstale":"2023-10-09T07:01:23.149847+0000","last_undegraded":"2023-10-09T07:01:23.149847+0000","last_fullsized":"2023-10-09T07:01:23.149847+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:57.874883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.155109+0000","last_change":"2023-10-09T07:01:23.146148+0000","last_active":"2023-10-09T07:01:23.155109+0000","last_peered":"2023-10-09T07:01:23.155109+0000","last_clean":"2023-10-09T07:01:23.155109+0000","last_became_active":"2023-10-09T07:01:23.145892+0000","last_became_peered":"2023-10-09T07:01:23.145892+0000","last_unstale":"2023-10-09T07:01:23.155109+0000","last_undegraded":"2023-10-09T07:01:23.155109+0000","last_fullsized":"2023-10-09T07:01:23.155109+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:28.309332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.139944+0000","last_change":"2023-10-09T07:01:22.150785+0000","last_active":"2023-10-09T07:01:23.139944+0000","last_peered":"2023-10-09T07:01:23.139944+0000","last_clean":"2023-10-09T07:01:23.139944+0000","last_became_active":"2023-10-09T07:01:22.150522+0000","last_became_peered":"2023-10-09T07:01:22.150522+0000","last_unstale":"2023-10-09T07:01:23.139944+0000","last_undegraded":"2023-10-09T07:01:23.139944+0000","last_fullsized":"2023-10-09T07:01:23.139944+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:05.488682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.165772+0000","last_change":"2023-10-09T07:01:23.162843+0000","last_active":"2023-10-09T07:01:23.165772+0000","last_peered":"2023-10-09T07:01:23.165772+0000","last_clean":"2023-10-09T07:01:23.165772+0000","last_became_active":"2023-10-09T07:01:23.162334+0000","last_became_peered":"2023-10-09T07:01:23.162334+0000","last_unstale":"2023-10-09T07:01:23.165772+0000","last_undegraded":"2023-10-09T07:01:23.165772+0000","last_fullsized":"2023-10-09T07:01:23.165772+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:13:13.307044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.141723+0000","last_change":"2023-10-09T07:01:22.146917+0000","last_active":"2023-10-09T07:01:23.141723+0000","last_peered":"2023-10-09T07:01:23.141723+0000","last_clean":"2023-10-09T07:01:23.141723+0000","last_became_active":"2023-10-09T07:01:22.146680+0000","last_became_peered":"2023-10-09T07:01:22.146680+0000","last_unstale":"2023-10-09T07:01:23.141723+0000","last_undegraded":"2023-10-09T07:01:23.141723+0000","last_fullsized":"2023-10-09T07:01:23.141723+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:38:27.481750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.161105+0000","last_change":"2023-10-09T07:01:23.159690+0000","last_active":"2023-10-09T07:01:23.161105+0000","last_peered":"2023-10-09T07:01:23.161105+0000","last_clean":"2023-10-09T07:01:23.161105+0000","last_became_active":"2023-10-09T07:01:23.159405+0000","last_became_peered":"2023-10-09T07:01:23.159405+0000","last_unstale":"2023-10-09T07:01:23.161105+0000","last_undegraded":"2023-10-09T07:01:23.161105+0000","last_fullsized":"2023-10-09T07:01:23.161105+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:44.249505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"136'3","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169834+0000","last_change":"2023-10-09T07:01:22.150732+0000","last_active":"2023-10-09T07:01:23.169834+0000","last_peered":"2023-10-09T07:01:23.169834+0000","last_clean":"2023-10-09T07:01:23.169834+0000","last_became_active":"2023-10-09T07:01:22.150345+0000","last_became_peered":"2023-10-09T07:01:22.150345+0000","last_unstale":"2023-10-09T07:01:23.169834+0000","last_undegraded":"2023-10-09T07:01:23.169834+0000","last_fullsized":"2023-10-09T07:01:23.169834+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:35.306975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.161241+0000","last_change":"2023-10-09T07:01:23.157619+0000","last_active":"2023-10-09T07:01:23.161241+0000","last_peered":"2023-10-09T07:01:23.161241+0000","last_clean":"2023-10-09T07:01:23.161241+0000","last_became_active":"2023-10-09T07:01:23.157323+0000","last_became_peered":"2023-10-09T07:01:23.157323+0000","last_unstale":"2023-10-09T07:01:23.161241+0000","last_undegraded":"2023-10-09T07:01:23.161241+0000","last_fullsized":"2023-10-09T07:01:23.161241+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:07.355448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"136'6","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.173102+0000","last_change":"2023-10-09T07:01:22.144728+0000","last_active":"2023-10-09T07:01:23.173102+0000","last_peered":"2023-10-09T07:01:23.173102+0000","last_clean":"2023-10-09T07:01:23.173102+0000","last_became_active":"2023-10-09T07:01:22.144438+0000","last_became_peered":"2023-10-09T07:01:22.144438+0000","last_unstale":"2023-10-09T07:01:23.173102+0000","last_undegraded":"2023-10-09T07:01:23.173102+0000","last_fullsized":"2023-10-09T07:01:23.173102+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:55:46.704780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.157869+0000","last_change":"2023-10-09T07:01:23.153614+0000","last_active":"2023-10-09T07:01:23.157869+0000","last_peered":"2023-10-09T07:01:23.157869+0000","last_clean":"2023-10-09T07:01:23.157869+0000","last_became_active":"2023-10-09T07:01:23.153365+0000","last_became_peered":"2023-10-09T07:01:23.153365+0000","last_unstale":"2023-10-09T07:01:23.157869+0000","last_undegraded":"2023-10-09T07:01:23.157869+0000","last_fullsized":"2023-10-09T07:01:23.157869+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:50.435038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.167247+0000","last_change":"2023-10-09T07:01:22.145791+0000","last_active":"2023-10-09T07:01:23.167247+0000","last_peered":"2023-10-09T07:01:23.167247+0000","last_clean":"2023-10-09T07:01:23.167247+0000","last_became_active":"2023-10-09T07:01:22.145535+0000","last_became_peered":"2023-10-09T07:01:22.145535+0000","last_unstale":"2023-10-09T07:01:23.167247+0000","last_undegraded":"2023-10-09T07:01:23.167247+0000","last_fullsized":"2023-10-09T07:01:23.167247+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:15.629974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168371+0000","last_change":"2023-10-09T07:01:23.164674+0000","last_active":"2023-10-09T07:01:23.168371+0000","last_peered":"2023-10-09T07:01:23.168371+0000","last_clean":"2023-10-09T07:01:23.168371+0000","last_became_active":"2023-10-09T07:01:23.164428+0000","last_became_peered":"2023-10-09T07:01:23.164428+0000","last_unstale":"2023-10-09T07:01:23.168371+0000","last_undegraded":"2023-10-09T07:01:23.168371+0000","last_fullsized":"2023-10-09T07:01:23.168371+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:01:34.945426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.139798+0000","last_change":"2023-10-09T07:01:22.154902+0000","last_active":"2023-10-09T07:01:23.139798+0000","last_peered":"2023-10-09T07:01:23.139798+0000","last_clean":"2023-10-09T07:01:23.139798+0000","last_became_active":"2023-10-09T07:01:22.154688+0000","last_became_peered":"2023-10-09T07:01:22.154688+0000","last_unstale":"2023-10-09T07:01:23.139798+0000","last_undegraded":"2023-10-09T07:01:23.139798+0000","last_fullsized":"2023-10-09T07:01:23.139798+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:57:10.805767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.162854+0000","last_change":"2023-10-09T07:01:23.161420+0000","last_active":"2023-10-09T07:01:23.162854+0000","last_peered":"2023-10-09T07:01:23.162854+0000","last_clean":"2023-10-09T07:01:23.162854+0000","last_became_active":"2023-10-09T07:01:23.161160+0000","last_became_peered":"2023-10-09T07:01:23.161160+0000","last_unstale":"2023-10-09T07:01:23.162854+0000","last_undegraded":"2023-10-09T07:01:23.162854+0000","last_fullsized":"2023-10-09T07:01:23.162854+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:33:26.130071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"136'8","reported_seq":18,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.172132+0000","last_change":"2023-10-09T07:01:22.146719+0000","last_active":"2023-10-09T07:01:23.172132+0000","last_peered":"2023-10-09T07:01:23.172132+0000","last_clean":"2023-10-09T07:01:23.172132+0000","last_became_active":"2023-10-09T07:01:22.146438+0000","last_became_peered":"2023-10-09T07:01:22.146438+0000","last_unstale":"2023-10-09T07:01:23.172132+0000","last_undegraded":"2023-10-09T07:01:23.172132+0000","last_fullsized":"2023-10-09T07:01:23.172132+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:59.902976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166403+0000","last_change":"2023-10-09T07:01:23.163188+0000","last_active":"2023-10-09T07:01:23.166403+0000","last_peered":"2023-10-09T07:01:23.166403+0000","last_clean":"2023-10-09T07:01:23.166403+0000","last_became_active":"2023-10-09T07:01:23.162774+0000","last_became_peered":"2023-10-09T07:01:23.162774+0000","last_unstale":"2023-10-09T07:01:23.166403+0000","last_undegraded":"2023-10-09T07:01:23.166403+0000","last_fullsized":"2023-10-09T07:01:23.166403+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:26:58.267604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169335+0000","last_change":"2023-10-09T07:01:22.157874+0000","last_active":"2023-10-09T07:01:23.169335+0000","last_peered":"2023-10-09T07:01:23.169335+0000","last_clean":"2023-10-09T07:01:23.169335+0000","last_became_active":"2023-10-09T07:01:22.157571+0000","last_became_peered":"2023-10-09T07:01:22.157571+0000","last_unstale":"2023-10-09T07:01:23.169335+0000","last_undegraded":"2023-10-09T07:01:23.169335+0000","last_fullsized":"2023-10-09T07:01:23.169335+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:48:35.226607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.170263+0000","last_change":"2023-10-09T07:01:23.167765+0000","last_active":"2023-10-09T07:01:23.170263+0000","last_peered":"2023-10-09T07:01:23.170263+0000","last_clean":"2023-10-09T07:01:23.170263+0000","last_became_active":"2023-10-09T07:01:23.167467+0000","last_became_peered":"2023-10-09T07:01:23.167467+0000","last_unstale":"2023-10-09T07:01:23.170263+0000","last_undegraded":"2023-10-09T07:01:23.170263+0000","last_fullsized":"2023-10-09T07:01:23.170263+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:48.754324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.164502+0000","last_change":"2023-10-09T07:01:22.147563+0000","last_active":"2023-10-09T07:01:23.164502+0000","last_peered":"2023-10-09T07:01:23.164502+0000","last_clean":"2023-10-09T07:01:23.164502+0000","last_became_active":"2023-10-09T07:01:22.147281+0000","last_became_peered":"2023-10-09T07:01:22.147281+0000","last_unstale":"2023-10-09T07:01:23.164502+0000","last_undegraded":"2023-10-09T07:01:23.164502+0000","last_fullsized":"2023-10-09T07:01:23.164502+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:29.107018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166568+0000","last_change":"2023-10-09T07:01:23.162598+0000","last_active":"2023-10-09T07:01:23.166568+0000","last_peered":"2023-10-09T07:01:23.166568+0000","last_clean":"2023-10-09T07:01:23.166568+0000","last_became_active":"2023-10-09T07:01:23.161029+0000","last_became_peered":"2023-10-09T07:01:23.161029+0000","last_unstale":"2023-10-09T07:01:23.166568+0000","last_undegraded":"2023-10-09T07:01:23.166568+0000","last_fullsized":"2023-10-09T07:01:23.166568+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:54.854933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.157717+0000","last_change":"2023-10-09T07:01:22.152443+0000","last_active":"2023-10-09T07:01:23.157717+0000","last_peered":"2023-10-09T07:01:23.157717+0000","last_clean":"2023-10-09T07:01:23.157717+0000","last_became_active":"2023-10-09T07:01:22.152193+0000","last_became_peered":"2023-10-09T07:01:22.152193+0000","last_unstale":"2023-10-09T07:01:23.157717+0000","last_undegraded":"2023-10-09T07:01:23.157717+0000","last_fullsized":"2023-10-09T07:01:23.157717+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:25:49.369604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166499+0000","last_change":"2023-10-09T07:01:23.158846+0000","last_active":"2023-10-09T07:01:23.166499+0000","last_peered":"2023-10-09T07:01:23.166499+0000","last_clean":"2023-10-09T07:01:23.166499+0000","last_became_active":"2023-10-09T07:01:23.158275+0000","last_became_peered":"2023-10-09T07:01:23.158275+0000","last_unstale":"2023-10-09T07:01:23.166499+0000","last_undegraded":"2023-10-09T07:01:23.166499+0000","last_fullsized":"2023-10-09T07:01:23.166499+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:39.937569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.139428+0000","last_change":"2023-10-09T07:01:22.157243+0000","last_active":"2023-10-09T07:01:23.139428+0000","last_peered":"2023-10-09T07:01:23.139428+0000","last_clean":"2023-10-09T07:01:23.139428+0000","last_became_active":"2023-10-09T07:01:22.156871+0000","last_became_peered":"2023-10-09T07:01:22.156871+0000","last_unstale":"2023-10-09T07:01:23.139428+0000","last_undegraded":"2023-10-09T07:01:23.139428+0000","last_fullsized":"2023-10-09T07:01:23.139428+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:47.746760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168705+0000","last_change":"2023-10-09T07:01:23.164436+0000","last_active":"2023-10-09T07:01:23.168705+0000","last_peered":"2023-10-09T07:01:23.168705+0000","last_clean":"2023-10-09T07:01:23.168705+0000","last_became_active":"2023-10-09T07:01:23.164159+0000","last_became_peered":"2023-10-09T07:01:23.164159+0000","last_unstale":"2023-10-09T07:01:23.168705+0000","last_undegraded":"2023-10-09T07:01:23.168705+0000","last_fullsized":"2023-10-09T07:01:23.168705+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:03:43.822136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.159404+0000","last_change":"2023-10-09T07:01:22.144527+0000","last_active":"2023-10-09T07:01:23.159404+0000","last_peered":"2023-10-09T07:01:23.159404+0000","last_clean":"2023-10-09T07:01:23.159404+0000","last_became_active":"2023-10-09T07:01:22.144279+0000","last_became_peered":"2023-10-09T07:01:22.144279+0000","last_unstale":"2023-10-09T07:01:23.159404+0000","last_undegraded":"2023-10-09T07:01:23.159404+0000","last_fullsized":"2023-10-09T07:01:23.159404+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:40.183812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169064+0000","last_change":"2023-10-09T07:01:23.156844+0000","last_active":"2023-10-09T07:01:23.169064+0000","last_peered":"2023-10-09T07:01:23.169064+0000","last_clean":"2023-10-09T07:01:23.169064+0000","last_became_active":"2023-10-09T07:01:23.156449+0000","last_became_peered":"2023-10-09T07:01:23.156449+0000","last_unstale":"2023-10-09T07:01:23.169064+0000","last_undegraded":"2023-10-09T07:01:23.169064+0000","last_fullsized":"2023-10-09T07:01:23.169064+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:07:46.684290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.141899+0000","last_change":"2023-10-09T07:01:22.150874+0000","last_active":"2023-10-09T07:01:23.141899+0000","last_peered":"2023-10-09T07:01:23.141899+0000","last_clean":"2023-10-09T07:01:23.141899+0000","last_became_active":"2023-10-09T07:01:22.150612+0000","last_became_peered":"2023-10-09T07:01:22.150612+0000","last_unstale":"2023-10-09T07:01:23.141899+0000","last_undegraded":"2023-10-09T07:01:23.141899+0000","last_fullsized":"2023-10-09T07:01:23.141899+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:44:39.274431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.165836+0000","last_change":"2023-10-09T07:01:23.156003+0000","last_active":"2023-10-09T07:01:23.165836+0000","last_peered":"2023-10-09T07:01:23.165836+0000","last_clean":"2023-10-09T07:01:23.165836+0000","last_became_active":"2023-10-09T07:01:23.155723+0000","last_became_peered":"2023-10-09T07:01:23.155723+0000","last_unstale":"2023-10-09T07:01:23.165836+0000","last_undegraded":"2023-10-09T07:01:23.165836+0000","last_fullsized":"2023-10-09T07:01:23.165836+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:13:13.307044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.136670+0000","last_change":"2023-10-09T07:01:22.144323+0000","last_active":"2023-10-09T07:01:23.136670+0000","last_peered":"2023-10-09T07:01:23.136670+0000","last_clean":"2023-10-09T07:01:23.136670+0000","last_became_active":"2023-10-09T07:01:22.143811+0000","last_became_peered":"2023-10-09T07:01:22.143811+0000","last_unstale":"2023-10-09T07:01:23.136670+0000","last_undegraded":"2023-10-09T07:01:23.136670+0000","last_fullsized":"2023-10-09T07:01:23.136670+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:36:01.146721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.167911+0000","last_change":"2023-10-09T07:01:23.162779+0000","last_active":"2023-10-09T07:01:23.167911+0000","last_peered":"2023-10-09T07:01:23.167911+0000","last_clean":"2023-10-09T07:01:23.167911+0000","last_became_active":"2023-10-09T07:01:23.162539+0000","last_became_peered":"2023-10-09T07:01:23.162539+0000","last_unstale":"2023-10-09T07:01:23.167911+0000","last_undegraded":"2023-10-09T07:01:23.167911+0000","last_fullsized":"2023-10-09T07:01:23.167911+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:11:24.045926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.149942+0000","last_change":"2023-10-09T07:01:22.148368+0000","last_active":"2023-10-09T07:01:23.149942+0000","last_peered":"2023-10-09T07:01:23.149942+0000","last_clean":"2023-10-09T07:01:23.149942+0000","last_became_active":"2023-10-09T07:01:22.148096+0000","last_became_peered":"2023-10-09T07:01:22.148096+0000","last_unstale":"2023-10-09T07:01:23.149942+0000","last_undegraded":"2023-10-09T07:01:23.149942+0000","last_fullsized":"2023-10-09T07:01:23.149942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:34:41.942673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168531+0000","last_change":"2023-10-09T07:01:23.163304+0000","last_active":"2023-10-09T07:01:23.168531+0000","last_peered":"2023-10-09T07:01:23.168531+0000","last_clean":"2023-10-09T07:01:23.168531+0000","last_became_active":"2023-10-09T07:01:23.162871+0000","last_became_peered":"2023-10-09T07:01:23.162871+0000","last_unstale":"2023-10-09T07:01:23.168531+0000","last_undegraded":"2023-10-09T07:01:23.168531+0000","last_fullsized":"2023-10-09T07:01:23.168531+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:29.980004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169665+0000","last_change":"2023-10-09T07:01:22.149834+0000","last_active":"2023-10-09T07:01:23.169665+0000","last_peered":"2023-10-09T07:01:23.169665+0000","last_clean":"2023-10-09T07:01:23.169665+0000","last_became_active":"2023-10-09T07:01:22.149582+0000","last_became_peered":"2023-10-09T07:01:22.149582+0000","last_unstale":"2023-10-09T07:01:23.169665+0000","last_undegraded":"2023-10-09T07:01:23.169665+0000","last_fullsized":"2023-10-09T07:01:23.169665+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:27:24.455676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.170551+0000","last_change":"2023-10-09T07:01:23.168344+0000","last_active":"2023-10-09T07:01:23.170551+0000","last_peered":"2023-10-09T07:01:23.170551+0000","last_clean":"2023-10-09T07:01:23.170551+0000","last_became_active":"2023-10-09T07:01:23.168036+0000","last_became_peered":"2023-10-09T07:01:23.168036+0000","last_unstale":"2023-10-09T07:01:23.170551+0000","last_undegraded":"2023-10-09T07:01:23.170551+0000","last_fullsized":"2023-10-09T07:01:23.170551+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:29.891585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"137'1","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T07:01:25.383150+0000","last_change":"2023-10-09T07:01:22.152913+0000","last_active":"2023-10-09T07:01:25.383150+0000","last_peered":"2023-10-09T07:01:25.383150+0000","last_clean":"2023-10-09T07:01:25.383150+0000","last_became_active":"2023-10-09T07:01:22.152361+0000","last_became_peered":"2023-10-09T07:01:22.152361+0000","last_unstale":"2023-10-09T07:01:25.383150+0000","last_undegraded":"2023-10-09T07:01:25.383150+0000","last_fullsized":"2023-10-09T07:01:25.383150+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:40:57.966780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169457+0000","last_change":"2023-10-09T07:01:23.161191+0000","last_active":"2023-10-09T07:01:23.169457+0000","last_peered":"2023-10-09T07:01:23.169457+0000","last_clean":"2023-10-09T07:01:23.169457+0000","last_became_active":"2023-10-09T07:01:23.160427+0000","last_became_peered":"2023-10-09T07:01:23.160427+0000","last_unstale":"2023-10-09T07:01:23.169457+0000","last_undegraded":"2023-10-09T07:01:23.169457+0000","last_fullsized":"2023-10-09T07:01:23.169457+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:05:27.389579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.153320+0000","last_change":"2023-10-09T07:01:22.150585+0000","last_active":"2023-10-09T07:01:23.153320+0000","last_peered":"2023-10-09T07:01:23.153320+0000","last_clean":"2023-10-09T07:01:23.153320+0000","last_became_active":"2023-10-09T07:01:22.150008+0000","last_became_peered":"2023-10-09T07:01:22.150008+0000","last_unstale":"2023-10-09T07:01:23.153320+0000","last_undegraded":"2023-10-09T07:01:23.153320+0000","last_fullsized":"2023-10-09T07:01:23.153320+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:24.996488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.168558+0000","last_change":"2023-10-09T07:01:23.163530+0000","last_active":"2023-10-09T07:01:23.168558+0000","last_peered":"2023-10-09T07:01:23.168558+0000","last_clean":"2023-10-09T07:01:23.168558+0000","last_became_active":"2023-10-09T07:01:23.162882+0000","last_became_peered":"2023-10-09T07:01:23.162882+0000","last_unstale":"2023-10-09T07:01:23.168558+0000","last_undegraded":"2023-10-09T07:01:23.168558+0000","last_fullsized":"2023-10-09T07:01:23.168558+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:59.520657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.141130+0000","last_change":"2023-10-09T07:01:22.150757+0000","last_active":"2023-10-09T07:01:23.141130+0000","last_peered":"2023-10-09T07:01:23.141130+0000","last_clean":"2023-10-09T07:01:23.141130+0000","last_became_active":"2023-10-09T07:01:22.150082+0000","last_became_peered":"2023-10-09T07:01:22.150082+0000","last_unstale":"2023-10-09T07:01:23.141130+0000","last_undegraded":"2023-10-09T07:01:23.141130+0000","last_fullsized":"2023-10-09T07:01:23.141130+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:12:37.048446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160378+0000","last_change":"2023-10-09T07:01:23.152270+0000","last_active":"2023-10-09T07:01:23.160378+0000","last_peered":"2023-10-09T07:01:23.160378+0000","last_clean":"2023-10-09T07:01:23.160378+0000","last_became_active":"2023-10-09T07:01:23.151999+0000","last_became_peered":"2023-10-09T07:01:23.151999+0000","last_unstale":"2023-10-09T07:01:23.160378+0000","last_undegraded":"2023-10-09T07:01:23.160378+0000","last_fullsized":"2023-10-09T07:01:23.160378+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:03:32.353939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.138009+0000","last_change":"2023-10-09T07:01:22.148907+0000","last_active":"2023-10-09T07:01:23.138009+0000","last_peered":"2023-10-09T07:01:23.138009+0000","last_clean":"2023-10-09T07:01:23.138009+0000","last_became_active":"2023-10-09T07:01:22.148649+0000","last_became_peered":"2023-10-09T07:01:22.148649+0000","last_unstale":"2023-10-09T07:01:23.138009+0000","last_undegraded":"2023-10-09T07:01:23.138009+0000","last_fullsized":"2023-10-09T07:01:23.138009+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:16:09.234730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.160259+0000","last_change":"2023-10-09T07:01:23.146843+0000","last_active":"2023-10-09T07:01:23.160259+0000","last_peered":"2023-10-09T07:01:23.160259+0000","last_clean":"2023-10-09T07:01:23.160259+0000","last_became_active":"2023-10-09T07:01:23.146568+0000","last_became_peered":"2023-10-09T07:01:23.146568+0000","last_unstale":"2023-10-09T07:01:23.160259+0000","last_undegraded":"2023-10-09T07:01:23.160259+0000","last_fullsized":"2023-10-09T07:01:23.160259+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:27:25.463240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.139262+0000","last_change":"2023-10-09T07:01:22.145215+0000","last_active":"2023-10-09T07:01:23.139262+0000","last_peered":"2023-10-09T07:01:23.139262+0000","last_clean":"2023-10-09T07:01:23.139262+0000","last_became_active":"2023-10-09T07:01:22.144932+0000","last_became_peered":"2023-10-09T07:01:22.144932+0000","last_unstale":"2023-10-09T07:01:23.139262+0000","last_undegraded":"2023-10-09T07:01:23.139262+0000","last_fullsized":"2023-10-09T07:01:23.139262+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:07:59.767588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.166405+0000","last_change":"2023-10-09T07:01:23.158441+0000","last_active":"2023-10-09T07:01:23.166405+0000","last_peered":"2023-10-09T07:01:23.166405+0000","last_clean":"2023-10-09T07:01:23.166405+0000","last_became_active":"2023-10-09T07:01:23.158187+0000","last_became_peered":"2023-10-09T07:01:23.158187+0000","last_unstale":"2023-10-09T07:01:23.166405+0000","last_undegraded":"2023-10-09T07:01:23.166405+0000","last_fullsized":"2023-10-09T07:01:23.166405+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:59.520657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.141795+0000","last_change":"2023-10-09T07:01:22.148410+0000","last_active":"2023-10-09T07:01:23.141795+0000","last_peered":"2023-10-09T07:01:23.141795+0000","last_clean":"2023-10-09T07:01:23.141795+0000","last_became_active":"2023-10-09T07:01:22.148163+0000","last_became_peered":"2023-10-09T07:01:22.148163+0000","last_unstale":"2023-10-09T07:01:23.141795+0000","last_undegraded":"2023-10-09T07:01:23.141795+0000","last_fullsized":"2023-10-09T07:01:23.141795+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:38.775384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.169093+0000","last_change":"2023-10-09T07:01:23.156342+0000","last_active":"2023-10-09T07:01:23.169093+0000","last_peered":"2023-10-09T07:01:23.169093+0000","last_clean":"2023-10-09T07:01:23.169093+0000","last_became_active":"2023-10-09T07:01:23.156058+0000","last_became_peered":"2023-10-09T07:01:23.156058+0000","last_unstale":"2023-10-09T07:01:23.169093+0000","last_undegraded":"2023-10-09T07:01:23.169093+0000","last_fullsized":"2023-10-09T07:01:23.169093+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:04:54.280984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.150006+0000","last_change":"2023-10-09T07:01:22.148215+0000","last_active":"2023-10-09T07:01:23.150006+0000","last_peered":"2023-10-09T07:01:23.150006+0000","last_clean":"2023-10-09T07:01:23.150006+0000","last_became_active":"2023-10-09T07:01:22.147957+0000","last_became_peered":"2023-10-09T07:01:22.147957+0000","last_unstale":"2023-10-09T07:01:23.150006+0000","last_undegraded":"2023-10-09T07:01:23.150006+0000","last_fullsized":"2023-10-09T07:01:23.150006+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T07:50:30.155260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.157844+0000","last_change":"2023-10-09T07:01:23.155358+0000","last_active":"2023-10-09T07:01:23.157844+0000","last_peered":"2023-10-09T07:01:23.157844+0000","last_clean":"2023-10-09T07:01:23.157844+0000","last_became_active":"2023-10-09T07:01:23.155054+0000","last_became_peered":"2023-10-09T07:01:23.155054+0000","last_unstale":"2023-10-09T07:01:23.157844+0000","last_undegraded":"2023-10-09T07:01:23.157844+0000","last_fullsized":"2023-10-09T07:01:23.157844+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:22.123799+0000","last_clean_scrub_stamp":"2023-10-09T07:01:22.123799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:27:50.013074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.140699+0000","last_change":"2023-10-09T07:01:22.156704+0000","last_active":"2023-10-09T07:01:23.140699+0000","last_peered":"2023-10-09T07:01:23.140699+0000","last_clean":"2023-10-09T07:01:23.140699+0000","last_became_active":"2023-10-09T07:01:22.156398+0000","last_became_peered":"2023-10-09T07:01:22.156398+0000","last_unstale":"2023-10-09T07:01:23.140699+0000","last_undegraded":"2023-10-09T07:01:23.140699+0000","last_fullsized":"2023-10-09T07:01:23.140699+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:01:21.116235+0000","last_clean_scrub_stamp":"2023-10-09T07:01:21.116235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:54:02.869547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"127'249","reported_seq":731,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-09T07:01:23.150032+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T07:01:23.150032+0000","last_peered":"2023-10-09T07:01:23.150032+0000","last_clean":"2023-10-09T07:01:23.150032+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T07:01:23.150032+0000","last_undegraded":"2023-10-09T07:01:23.150032+0000","last_fullsized":"2023-10-09T07:01:23.150032+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575071,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303632,"kb_used_data":2248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068208,"statfs":{"total":96636764160,"available":96325844992,"internally_reserved":0,"allocated":2301952,"data_stored":1427393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68200000000000005,"15min":0.70399999999999996},"min":{"1min":0.46800000000000003,"5min":0.44700000000000001,"15min":0.316},"max":{"1min":0.91100000000000003,"5min":1.0960000000000001,"15min":1.732},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69399999999999995,"15min":0.71699999999999997},"min":{"1min":0.443,"5min":0.44,"15min":0.29999999999999999},"max":{"1min":0.94299999999999995,"5min":1.22,"15min":1.22},"last":0.60199999999999998}]},{"osd":1,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.67100000000000004,"15min":0.70599999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.379},"max":{"1min":1.004,"5min":1.004,"15min":2.3559999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69199999999999995,"15min":0.71999999999999997},"min":{"1min":0.52400000000000002,"5min":0.45700000000000002,"15min":0.40200000000000002},"max":{"1min":0.875,"5min":0.998,"15min":1.7869999999999999},"last":0.625}]},{"osd":2,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69999999999999996,"15min":0.72899999999999998},"min":{"1min":0.48899999999999999,"5min":0.46300000000000002,"15min":0.44900000000000001},"max":{"1min":0.85599999999999998,"5min":0.98399999999999999,"15min":1.9430000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69999999999999996,"15min":0.73999999999999999},"min":{"1min":0.50600000000000001,"5min":0.48199999999999998,"15min":0.44900000000000001},"max":{"1min":0.98299999999999998,"5min":1.262,"15min":2.6629999999999998},"last":0.63400000000000001}]},{"osd":3,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69099999999999995,"15min":0.71299999999999997},"min":{"1min":0.53500000000000003,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.749},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.88300000000000001,"5min":1.0569999999999999,"15min":1.827},"last":0.66400000000000003}]},{"osd":4,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.622,"15min":0.60099999999999998},"min":{"1min":0.44400000000000001,"5min":0.35299999999999998,"15min":0.35099999999999998},"max":{"1min":0.93999999999999995,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.42399999999999999,"5min":0.40300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79600000000000004,"5min":1.1850000000000001,"15min":2.577},"last":0.56299999999999994}]},{"osd":5,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66500000000000004,"15min":0.66600000000000004},"min":{"1min":0.48199999999999998,"5min":0.40699999999999997,"15min":0.40100000000000002},"max":{"1min":0.92900000000000005,"5min":1.0960000000000001,"15min":2.5169999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68500000000000005,"15min":0.69799999999999995},"min":{"1min":0.495,"5min":0.46500000000000002,"15min":0.45200000000000001},"max":{"1min":0.83899999999999997,"5min":1.141,"15min":2.9590000000000001},"last":0.69599999999999995}]},{"osd":6,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.748},"min":{"1min":0.54000000000000004,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89100000000000001,"5min":1.1000000000000001,"15min":3.0019999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.498,"5min":0.374,"15min":0.374},"max":{"1min":0.94199999999999995,"5min":1.0740000000000001,"15min":2.4039999999999999},"last":0.65200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575070,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303048,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068792,"statfs":{"total":96636764160,"available":96326443008,"internally_reserved":0,"allocated":1703936,"data_stored":836507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.69199999999999995,"15min":0.71199999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86799999999999999,"5min":1.238,"15min":1.238},"last":0.62},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66000000000000003,"15min":0.69999999999999996},"min":{"1min":0.439,"5min":0.41899999999999998,"15min":0.36599999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.079},"last":0.64300000000000002}]},{"osd":1,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68000000000000005,"15min":0.71699999999999997},"min":{"1min":0.45100000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.83299999999999996,"5min":0.97199999999999998,"15min":1.135},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.016,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.66100000000000003}]},{"osd":2,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.73299999999999998},"min":{"1min":0.51100000000000001,"5min":0.438,"15min":0.42599999999999999},"max":{"1min":0.96799999999999997,"5min":1.0109999999999999,"15min":1.391},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69799999999999995,"15min":0.73099999999999998},"min":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.109,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.73699999999999999}]},{"osd":3,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.68500000000000005,"15min":0.70399999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.40600000000000003},"max":{"1min":0.86599999999999999,"5min":0.98099999999999998,"15min":1.0069999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.70699999999999996,"15min":0.75},"min":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.497},"max":{"1min":0.86299999999999999,"5min":1.0169999999999999,"15min":1.4750000000000001},"last":0.60199999999999998}]},{"osd":4,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60799999999999998,"15min":0.61899999999999999},"min":{"1min":0.45200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.871,"5min":1.329,"15min":1.768},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63,"15min":0.623},"min":{"1min":0.44900000000000001,"5min":0.39100000000000001,"15min":0.36199999999999999},"max":{"1min":0.84599999999999997,"5min":0.98399999999999999,"15min":1.601},"last":0.72299999999999998}]},{"osd":5,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.40200000000000002},"max":{"1min":0.82299999999999995,"5min":1.0149999999999999,"15min":1.7609999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.69199999999999995,"15min":0.69399999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91100000000000003,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.71299999999999997}]},{"osd":7,"last update":"Mon Oct 9 07:01:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67800000000000005,"15min":0.67900000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91400000000000003,"5min":1.046,"15min":1.2949999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.72699999999999998},"min":{"1min":0.52300000000000002,"5min":0.45300000000000001,"15min":0.42399999999999999},"max":{"1min":0.997,"5min":1.054,"15min":1.8320000000000001},"last":0.70099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575071,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303052,"kb_used_data":1668,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068788,"statfs":{"total":96636764160,"available":96326438912,"internally_reserved":0,"allocated":1708032,"data_stored":836561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45000000000000001,"15min":0.45700000000000002},"min":{"1min":0.33800000000000002,"5min":0.26600000000000001,"15min":0.25900000000000001},"max":{"1min":0.67700000000000005,"5min":2.153,"15min":2.153},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.36299999999999999,"5min":0.29399999999999998,"15min":0.26300000000000001},"max":{"1min":0.77300000000000002,"5min":1.1879999999999999,"15min":1.23},"last":0.56200000000000006}]},{"osd":2,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.68999999999999995,"5min":0.72199999999999998,"15min":1.169},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56399999999999995,"15min":0.57699999999999996},"min":{"1min":0.441,"5min":0.38300000000000001,"15min":0.34100000000000003},"max":{"1min":0.73499999999999999,"5min":1.3500000000000001,"15min":3.077},"last":0.53300000000000003}]},{"osd":3,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59799999999999998,"15min":0.60999999999999999},"min":{"1min":0.47799999999999998,"5min":0.40000000000000002,"15min":0.376},"max":{"1min":0.77900000000000003,"5min":1.6839999999999999,"15min":1.7709999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":0.79000000000000004,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.51300000000000001}]},{"osd":4,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.748,"15min":0.755},"min":{"1min":0.56499999999999995,"5min":0.46700000000000003,"15min":0.38700000000000001},"max":{"1min":1.069,"5min":1.069,"15min":1.6739999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.58099999999999996,"5min":0.51200000000000001,"15min":0.48599999999999999},"max":{"1min":0.98999999999999999,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.78900000000000003}]},{"osd":5,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.54000000000000004,"5min":0.53400000000000003,"15min":0.48099999999999998},"max":{"1min":1.016,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.749,"15min":0.77000000000000002},"min":{"1min":0.56499999999999995,"5min":0.52100000000000002,"15min":0.47999999999999998},"max":{"1min":0.98399999999999999,"5min":1.1040000000000001,"15min":1.637},"last":0.80400000000000005}]},{"osd":6,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79300000000000004,"15min":0.79800000000000004},"min":{"1min":0.626,"5min":0.54600000000000004,"15min":0.48399999999999999},"max":{"1min":1.2769999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.626,"5min":0.504,"15min":0.504},"max":{"1min":0.96399999999999997,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.73399999999999999}]},{"osd":7,"last update":"Mon Oct 9 07:00:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82599999999999996,"15min":0.82899999999999996},"min":{"1min":0.621,"5min":0.54400000000000004,"15min":0.51700000000000002},"max":{"1min":1.2949999999999999,"5min":3.4350000000000001,"15min":3.4350000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78900000000000003,"15min":0.81399999999999995},"min":{"1min":0.56499999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.179},"last":0.83699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575070,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303644,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068196,"statfs":{"total":96636764160,"available":96325832704,"internally_reserved":0,"allocated":2314240,"data_stored":1428453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47599999999999998,"15min":0.46899999999999997},"min":{"1min":0.31900000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.73499999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51200000000000001,"15min":0.53800000000000003},"min":{"1min":0.32100000000000001,"5min":0.315,"15min":0.28899999999999998},"max":{"1min":0.78000000000000003,"5min":2.1379999999999999,"15min":4.5819999999999999},"last":0.5}]},{"osd":2,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.52800000000000002,"15min":0.55600000000000005},"min":{"1min":0.38400000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.69799999999999995,"5min":2.1720000000000002,"15min":4.6980000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48599999999999999,"15min":0.499},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.626,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.47499999999999998}]},{"osd":3,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.53300000000000003,"15min":0.53200000000000003},"min":{"1min":0.38500000000000001,"5min":0.34300000000000003,"15min":0.33200000000000002},"max":{"1min":0.75600000000000001,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.374},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58599999999999997,"15min":0.61199999999999999},"min":{"1min":0.46000000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71199999999999997,"5min":2.1989999999999998,"15min":4.734},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.42799999999999999},"max":{"1min":0.94999999999999996,"5min":2.339,"15min":2.339},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75,"15min":0.79000000000000004},"min":{"1min":0.55400000000000005,"5min":0.50700000000000001,"15min":0.39500000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":4.6619999999999999},"last":0.92000000000000004}]},{"osd":5,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.746,"15min":0.76800000000000002},"min":{"1min":0.52600000000000002,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":0.89300000000000002,"5min":1.0349999999999999,"15min":1.1890000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78100000000000003,"15min":0.79100000000000004},"min":{"1min":0.50600000000000001,"5min":0.5,"15min":0.45600000000000002},"max":{"1min":0.96399999999999997,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":0.86299999999999999}]},{"osd":6,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76300000000000001,"15min":0.80300000000000005},"min":{"1min":0.60199999999999998,"5min":0.5,"15min":0.48599999999999999},"max":{"1min":0.98199999999999998,"5min":1.05,"15min":4.6239999999999997},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.55900000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.034,"5min":1.0640000000000001,"15min":1.2689999999999999},"last":0.72599999999999998}]},{"osd":7,"last update":"Mon Oct 9 07:01:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80000000000000004,"15min":0.82299999999999995},"min":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.46400000000000002},"max":{"1min":0.96699999999999997,"5min":1.0760000000000001,"15min":1.256},"last":0.873},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.83599999999999997,"15min":0.84599999999999997},"min":{"1min":0.59399999999999997,"5min":0.57599999999999996,"15min":0.51800000000000002},"max":{"1min":0.995,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.88900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575070,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311236,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060604,"statfs":{"total":96636764160,"available":96318058496,"internally_reserved":0,"allocated":1699840,"data_stored":836437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.42999999999999999,"15min":0.45400000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.25900000000000001},"max":{"1min":0.54600000000000004,"5min":0.79800000000000004,"15min":1.8149999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.47199999999999998,"15min":0.49199999999999999},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28000000000000003},"max":{"1min":0.63100000000000001,"5min":0.68100000000000005,"15min":1.633},"last":0.44700000000000001}]},{"osd":1,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44900000000000001,"15min":0.46999999999999997},"min":{"1min":0.316,"5min":0.29499999999999998,"15min":0.28999999999999998},"max":{"1min":0.66700000000000004,"5min":0.71599999999999997,"15min":1.097},"last":0.375},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.49099999999999999,"15min":0.50800000000000001},"min":{"1min":0.35099999999999998,"5min":0.32900000000000001,"15min":0.309},"max":{"1min":0.65700000000000003,"5min":0.79700000000000004,"15min":1.2689999999999999},"last":0.39600000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55700000000000005,"15min":0.58299999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69999999999999996,"5min":0.82599999999999996,"15min":0.87},"last":0.435},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.59199999999999997,"15min":0.60899999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.35699999999999998},"max":{"1min":0.64700000000000002,"5min":0.83899999999999997,"15min":1.1890000000000001},"last":0.57999999999999996}]},{"osd":4,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.74299999999999999,"15min":0.76400000000000001},"min":{"1min":0.55100000000000005,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":0.84299999999999997,"5min":1.1379999999999999,"15min":1.256},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72499999999999998,"15min":0.75600000000000001},"min":{"1min":0.501,"5min":0.48799999999999999,"15min":0.44800000000000001},"max":{"1min":0.88500000000000001,"5min":1.171,"15min":1.696},"last":0.63100000000000001}]},{"osd":5,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73699999999999999,"15min":0.76800000000000002},"min":{"1min":0.60399999999999998,"5min":0.505,"15min":0.42399999999999999},"max":{"1min":0.95399999999999996,"5min":1.143,"15min":1.3049999999999999},"last":0.622},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.748,"15min":0.77600000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.503},"max":{"1min":1.038,"5min":1.0629999999999999,"15min":1.3440000000000001},"last":0.73399999999999999}]},{"osd":6,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.76300000000000001,"15min":0.77900000000000003},"min":{"1min":0.53900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91100000000000003,"5min":1.115,"15min":1.768},"last":0.752},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.78200000000000003},"min":{"1min":0.53500000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.98899999999999999,"5min":1.101,"15min":1.5309999999999999},"last":0.68100000000000005}]},{"osd":7,"last update":"Mon Oct 9 07:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.77100000000000002,"15min":0.80100000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.54600000000000004},"max":{"1min":0.93700000000000006,"5min":1.0389999999999999,"15min":1.7370000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.82099999999999995},"min":{"1min":0.64500000000000002,"5min":0.57099999999999995,"15min":0.50900000000000001},"max":{"1min":0.97899999999999998,"5min":1.0409999999999999,"15min":1.3939999999999999},"last":0.71799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575071,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307156,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064684,"statfs":{"total":96636764160,"available":96322236416,"internally_reserved":0,"allocated":1716224,"data_stored":838043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45300000000000001,"15min":0.46800000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.60099999999999998,"5min":0.86299999999999999,"15min":0.94299999999999995},"last":0.443},{"interface":"front","average":{"1min":0.436,"5min":0.47099999999999997,"15min":0.49099999999999999},"min":{"1min":0.32900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55500000000000005,"5min":0.81799999999999995,"15min":1.228},"last":0.33100000000000002}]},{"osd":1,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46899999999999997,"15min":0.47999999999999998},"min":{"1min":0.34599999999999997,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.65800000000000003,"5min":0.81899999999999995,"15min":2.0800000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.55000000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.247},"max":{"1min":0.68500000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.40200000000000002}]},{"osd":2,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55600000000000005,"15min":0.57899999999999996},"min":{"1min":0.39000000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73199999999999998,"5min":0.94099999999999995,"15min":2.3959999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.61699999999999999,"15min":0.63200000000000001},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.309},"max":{"1min":0.75,"5min":0.97699999999999998,"15min":3.8900000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.71699999999999997,"15min":0.73699999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40799999999999997},"max":{"1min":1.014,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.501},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79600000000000004,"15min":0.81999999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.55300000000000005},"max":{"1min":0.96099999999999997,"5min":1.22,"15min":1.22},"last":0.61099999999999999}]},{"osd":5,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94799999999999995,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.76600000000000001,"15min":0.79600000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.98799999999999999,"5min":1.1519999999999999,"15min":1.1830000000000001},"last":0.48799999999999999}]},{"osd":6,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.753,"15min":0.77400000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.51700000000000002},"max":{"1min":0.93999999999999995,"5min":1.304,"15min":1.304},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.73899999999999999,"15min":0.77400000000000002},"min":{"1min":0.53100000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.016,"5min":1.1579999999999999,"15min":1.7769999999999999},"last":0.67900000000000005}]},{"osd":7,"last update":"Mon Oct 9 07:01:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78200000000000003,"15min":0.81299999999999994},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1,"5min":1.2629999999999999,"15min":1.8180000000000001},"last":0.629},{"interface":"front","average":{"1min":0.752,"5min":0.78000000000000003,"15min":0.81599999999999995},"min":{"1min":0.58199999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.056,"5min":1.1919999999999999,"15min":1.486},"last":0.55200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575070,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311236,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060604,"statfs":{"total":96636764160,"available":96318058496,"internally_reserved":0,"allocated":1699840,"data_stored":836437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69899999999999995,"15min":0.70999999999999996},"min":{"1min":0.45000000000000001,"5min":0.35899999999999999,"15min":0.29799999999999999},"max":{"1min":1.109,"5min":1.5609999999999999,"15min":3.1139999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.71499999999999997,"15min":0.72299999999999998},"min":{"1min":0.47399999999999998,"5min":0.39900000000000002,"15min":0.39300000000000002},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.8130000000000002},"last":0.877}]},{"osd":1,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68799999999999994,"15min":0.71599999999999997},"min":{"1min":0.47199999999999998,"5min":0.39500000000000002,"15min":0.373},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.9279999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71299999999999997,"15min":0.73799999999999999},"min":{"1min":0.54000000000000004,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3129999999999999,"5min":1.4339999999999999,"15min":3.4359999999999999},"last":0.71899999999999997}]},{"osd":2,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.72799999999999998,"15min":0.755},"min":{"1min":0.52900000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74199999999999999,"15min":0.77400000000000002},"min":{"1min":0.54900000000000004,"5min":0.48299999999999998,"15min":0.47599999999999998},"max":{"1min":0.98999999999999999,"5min":1.0129999999999999,"15min":2.427},"last":0.85799999999999998}]},{"osd":3,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.72899999999999998,"15min":0.74399999999999999},"min":{"1min":0.46999999999999997,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.8239999999999998,"5min":2.8239999999999998,"15min":2.8239999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.749},"min":{"1min":0.56499999999999995,"5min":0.443,"15min":0.43099999999999999},"max":{"1min":1.077,"5min":1.077,"15min":3.6899999999999999},"last":0.76800000000000002}]},{"osd":5,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.32700000000000001,"15min":0.317},"max":{"1min":2.234,"5min":2.234,"15min":3.3860000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.65200000000000002,"15min":0.65000000000000002},"min":{"1min":0.436,"5min":0.40999999999999998,"15min":0.34999999999999998},"max":{"1min":2.8690000000000002,"5min":2.8690000000000002,"15min":3.9300000000000002},"last":0.74399999999999999}]},{"osd":6,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.45800000000000002,"5min":0.42299999999999999,"15min":0.36499999999999999},"max":{"1min":1.262,"5min":1.262,"15min":3.5270000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68500000000000005,"15min":0.68000000000000005},"min":{"1min":0.48899999999999999,"5min":0.42499999999999999,"15min":0.374},"max":{"1min":1.369,"5min":1.587,"15min":3.4740000000000002},"last":0.82499999999999996}]},{"osd":7,"last update":"Mon Oct 9 07:01:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.73299999999999998,"15min":0.72599999999999998},"min":{"1min":0.59399999999999997,"5min":0.44,"15min":0.34699999999999998},"max":{"1min":2.9049999999999998,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.439},"max":{"1min":1.133,"5min":1.1899999999999999,"15min":3.7280000000000002},"last":0.89000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575071,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303052,"kb_used_data":1668,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068788,"statfs":{"total":96636764160,"available":96326438912,"internally_reserved":0,"allocated":1708032,"data_stored":837013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66300000000000003,"15min":0.68799999999999994},"min":{"1min":0.45400000000000001,"5min":0.32800000000000001,"15min":0.30599999999999999},"max":{"1min":0.85299999999999998,"5min":0.93600000000000005,"15min":0.96999999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65500000000000003,"15min":0.67800000000000005},"min":{"1min":0.47099999999999997,"5min":0.379,"15min":0.32900000000000001},"max":{"1min":1.024,"5min":1.119,"15min":1.119},"last":0.63200000000000001}]},{"osd":1,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66000000000000003,"15min":0.67900000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39700000000000002},"max":{"1min":0.84599999999999997,"5min":1.0029999999999999,"15min":1.034},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.69899999999999995,"15min":0.71499999999999997},"min":{"1min":0.52200000000000002,"5min":0.45400000000000001,"15min":0.40400000000000003},"max":{"1min":0.79500000000000004,"5min":0.95099999999999996,"15min":1.0229999999999999},"last":0.71799999999999997}]},{"osd":2,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68999999999999995,"15min":0.71699999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.47299999999999998},"max":{"1min":0.81000000000000005,"5min":0.997,"15min":1.0580000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.68100000000000005,"15min":0.70299999999999996},"min":{"1min":0.48099999999999998,"5min":0.46200000000000002,"15min":0.442},"max":{"1min":0.88100000000000001,"5min":0.97799999999999998,"15min":1.0720000000000001},"last":0.64900000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70099999999999996,"15min":0.71199999999999997},"min":{"1min":0.51300000000000001,"5min":0.46300000000000002,"15min":0.435},"max":{"1min":0.96299999999999997,"5min":1.1499999999999999,"15min":1.302},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.54000000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93600000000000005,"5min":1.03,"15min":1.399},"last":0.69999999999999996}]},{"osd":4,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.621,"15min":0.60199999999999998},"min":{"1min":0.44900000000000001,"5min":0.377,"15min":0.36099999999999999},"max":{"1min":0.89000000000000001,"5min":0.96099999999999997,"15min":0.96799999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.42099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.002,"5min":1.075,"15min":1.075},"last":0.501}]},{"osd":6,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63300000000000001,"15min":0.628},"min":{"1min":0.439,"5min":0.41099999999999998,"15min":0.36599999999999999},"max":{"1min":0.94299999999999995,"5min":1.0049999999999999,"15min":1.018},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68700000000000006,"15min":0.67100000000000004},"min":{"1min":0.48499999999999999,"5min":0.41199999999999998,"15min":0.38900000000000001},"max":{"1min":0.95299999999999996,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Mon Oct 9 07:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68799999999999994,"15min":0.68300000000000005},"min":{"1min":0.499,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.048,"5min":1.48,"15min":1.48},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76700000000000002,"15min":0.76400000000000001},"min":{"1min":0.59499999999999997,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0189999999999999,"5min":1.466,"15min":1.466},"last":0.52500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T07:01:32.745 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T07:01:32.745 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T07:01:32.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.968+0000 7f1c197ff700 1 Processor -- start 2023-10-09T07:01:32.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.969+0000 7f1c197ff700 1 -- start start 2023-10-09T07:01:32.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.970+0000 7f1c197ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1c14157630 0x7f1c14158a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:32.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.970+0000 7f1c197ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c14068390 0x7f1c140687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:32.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.970+0000 7f1c197ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c14068d30 con 0x7f1c14157a00 2023-10-09T07:01:32.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.970+0000 7f1c197ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c14158590 con 0x7f1c14157630 2023-10-09T07:01:32.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.970+0000 7f1c197ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c14157f80 con 0x7f1c14068390 2023-10-09T07:01:32.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.970+0000 7f1c0bfff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f1c14157a00 0x7f1c140abd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57654/0 (socket says 172.21.15.71:57654) 2023-10-09T07:01:32.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.970+0000 7f1c0bfff700 1 -- 172.21.15.71:0/34260053 learned_addr learned my addr 172.21.15.71:0/34260053 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:01:32.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.970+0000 7f1c137fe700 1 --2- 172.21.15.71:0/34260053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c14068390 0x7f1c140687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:32.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.970+0000 7f1c12ffd700 1 --2- 172.21.15.71:0/34260053 >> v2:172.21.15.179:3300/0 conn(0x7f1c14157630 0x7f1c14158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:32.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.970+0000 7f1c127fc700 1 -- 172.21.15.71:0/34260053 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2767123970 0 0) 0x7f1bfc001110 con 0x7f1c14157a00 2023-10-09T07:01:32.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.971+0000 7f1c127fc700 1 -- 172.21.15.71:0/34260053 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c00003570 con 0x7f1c14157a00 2023-10-09T07:01:32.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.971+0000 7f1c127fc700 1 -- 172.21.15.71:0/34260053 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2905565326 0 0) 0x7f1c00003570 con 0x7f1c14157a00 2023-10-09T07:01:32.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.971+0000 7f1c127fc700 1 -- 172.21.15.71:0/34260053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c14068390 msgr2=0x7f1c140687f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:32.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.971+0000 7f1c127fc700 1 --2- 172.21.15.71:0/34260053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c14068390 0x7f1c140687f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:32.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.971+0000 7f1c127fc700 1 -- 172.21.15.71:0/34260053 >> v2:172.21.15.179:3300/0 conn(0x7f1c14157630 msgr2=0x7f1c14158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:32.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.971+0000 7f1c127fc700 1 --2- 172.21.15.71:0/34260053 >> v2:172.21.15.179:3300/0 conn(0x7f1c14157630 0x7f1c14158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:32.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.971+0000 7f1c127fc700 1 -- 172.21.15.71:0/34260053 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c140ac7a0 con 0x7f1c14157a00 2023-10-09T07:01:32.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.971+0000 7f1c127fc700 1 -- 172.21.15.71:0/34260053 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f1bfc001600 con 0x7f1c14157a00 2023-10-09T07:01:32.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.971+0000 7f1c127fc700 1 -- 172.21.15.71:0/34260053 >> v1:172.21.15.71:6789/0 conn(0x7f1c14157a00 legacy=0x7f1c140abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:32.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.971+0000 7f1c127fc700 1 --2- 172.21.15.71:0/34260053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c00003a60 0x7f1c00003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:32.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.971+0000 7f1c127fc700 1 --2- 172.21.15.71:0/34260053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c00004810 0x7f1c00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:32.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.971+0000 7f1c127fc700 1 --2- 172.21.15.71:0/34260053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c000051c0 0x7f1c0000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:32.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.971+0000 7f1c127fc700 1 -- 172.21.15.71:0/34260053 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c14158590 con 0x7f1c00004810 2023-10-09T07:01:32.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.971+0000 7f1c127fc700 1 -- 172.21.15.71:0/34260053 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c14157f80 con 0x7f1c000051c0 2023-10-09T07:01:32.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.971+0000 7f1c127fc700 1 -- 172.21.15.71:0/34260053 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0000bfa0 con 0x7f1c00003a60 2023-10-09T07:01:32.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.971+0000 7f1c12ffd700 1 --2- 172.21.15.71:0/34260053 >> v2:172.21.15.179:3300/0 conn(0x7f1c14157630 0x7f1c14158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:01:32.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.971+0000 7f1c137fe700 1 --2- 172.21.15.71:0/34260053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c14068390 0x7f1c140687f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:01:32.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.971+0000 7f1c0bfff700 1 --2- 172.21.15.71:0/34260053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c00004810 0x7f1c00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:32.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.971+0000 7f1c12ffd700 1 --2- 172.21.15.71:0/34260053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c00003a60 0x7f1c00003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:32.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.972+0000 7f1c137fe700 1 --2- 172.21.15.71:0/34260053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c000051c0 0x7f1c0000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:32.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.972+0000 7f1c0bfff700 1 -- 172.21.15.71:0/34260053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c00003a60 msgr2=0x7f1c00003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:32.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.972+0000 7f1c0bfff700 1 --2- 172.21.15.71:0/34260053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c00003a60 0x7f1c00003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:32.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.972+0000 7f1c0bfff700 1 -- 172.21.15.71:0/34260053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c000051c0 msgr2=0x7f1c0000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:32.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.972+0000 7f1c0bfff700 1 --2- 172.21.15.71:0/34260053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c000051c0 0x7f1c0000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:32.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.972+0000 7f1c0bfff700 1 -- 172.21.15.71:0/34260053 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c00003570 con 0x7f1c00004810 2023-10-09T07:01:32.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.972+0000 7f1c12ffd700 1 --2- 172.21.15.71:0/34260053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c00003a60 0x7f1c00003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:01:32.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.972+0000 7f1c0bfff700 1 --2- 172.21.15.71:0/34260053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c00004810 0x7f1c00004c80 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc00c5f0 tx=0x7f1bfc007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4ee2d722e2eafe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:32.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.972+0000 7f1c127fc700 1 -- 172.21.15.71:0/34260053 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc00cdf0 con 0x7f1c00004810 2023-10-09T07:01:32.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.972+0000 7f1c127fc700 1 -- 172.21.15.71:0/34260053 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bfc005920 con 0x7f1c00004810 2023-10-09T07:01:32.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.972+0000 7f1c127fc700 1 -- 172.21.15.71:0/34260053 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc005ce0 con 0x7f1c00004810 2023-10-09T07:01:32.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.973+0000 7f1c197ff700 1 -- 172.21.15.71:0/34260053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c00004810 msgr2=0x7f1c00004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:32.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.973+0000 7f1c197ff700 1 --2- 172.21.15.71:0/34260053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c00004810 0x7f1c00004c80 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc00c5f0 tx=0x7f1bfc007a80 comp rx=0 tx=0).stop 2023-10-09T07:01:32.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.973+0000 7f1c137fe700 1 -- 172.21.15.71:0/34260053 reap_dead start 2023-10-09T07:01:32.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.973+0000 7f1c197ff700 1 -- 172.21.15.71:0/34260053 shutdown_connections 2023-10-09T07:01:32.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.973+0000 7f1c197ff700 1 -- 172.21.15.71:0/34260053 >> 172.21.15.71:0/34260053 conn(0x7f1c140cc540 msgr2=0x7f1c140cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:32.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.973+0000 7f1c197ff700 1 -- 172.21.15.71:0/34260053 shutdown_connections 2023-10-09T07:01:32.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.973+0000 7f1c197ff700 1 -- 172.21.15.71:0/34260053 wait complete. 2023-10-09T07:01:32.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.974+0000 7f1c197ff700 1 Processor -- start 2023-10-09T07:01:32.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.974+0000 7f1c197ff700 1 -- start start 2023-10-09T07:01:32.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.975+0000 7f1c197ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c00004810 0x7f1c14156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:32.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.975+0000 7f1c197ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c1415a000 0x7f1c140c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:32.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.975+0000 7f1c197ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c140c4450 0x7f1c140b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:32.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.975+0000 7f1c197ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c140c02f0 con 0x7f1c00004810 2023-10-09T07:01:32.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.975+0000 7f1c197ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c140c5170 con 0x7f1c140c4450 2023-10-09T07:01:32.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.975+0000 7f1c197ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c140c48d0 con 0x7f1c1415a000 2023-10-09T07:01:32.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.976+0000 7f1c12ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c00004810 0x7f1c14156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:32.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.976+0000 7f1c12ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c00004810 0x7f1c14156b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40194/0 (socket says 172.21.15.71:40194) 2023-10-09T07:01:32.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.976+0000 7f1c12ffd700 1 -- 172.21.15.71:0/3403838930 learned_addr learned my addr 172.21.15.71:0/3403838930 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:32.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.976+0000 7f1c0bfff700 1 --2- 172.21.15.71:0/3403838930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c1415a000 0x7f1c140c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:32.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.976+0000 7f1c137fe700 1 --2- 172.21.15.71:0/3403838930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c140c4450 0x7f1c140b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:32.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.976+0000 7f1c12ffd700 1 -- 172.21.15.71:0/3403838930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c1415a000 msgr2=0x7f1c140c3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:32.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.976+0000 7f1c12ffd700 1 --2- 172.21.15.71:0/3403838930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c1415a000 0x7f1c140c3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:32.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.976+0000 7f1c12ffd700 1 -- 172.21.15.71:0/3403838930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c140c4450 msgr2=0x7f1c140b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:32.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.976+0000 7f1c12ffd700 1 --2- 172.21.15.71:0/3403838930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c140c4450 0x7f1c140b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:32.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.976+0000 7f1c12ffd700 1 -- 172.21.15.71:0/3403838930 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c140c4bb0 con 0x7f1c00004810 2023-10-09T07:01:32.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.976+0000 7f1c0bfff700 1 --2- 172.21.15.71:0/3403838930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c1415a000 0x7f1c140c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:01:32.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.976+0000 7f1c137fe700 1 --2- 172.21.15.71:0/3403838930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c140c4450 0x7f1c140b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:01:32.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.976+0000 7f1c12ffd700 1 --2- 172.21.15.71:0/3403838930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c00004810 0x7f1c14156b10 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f1c04009fd0 tx=0x7f1c04008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:32.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.976+0000 7f1c0affd700 1 -- 172.21.15.71:0/3403838930 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0400f9b0 con 0x7f1c00004810 2023-10-09T07:01:32.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.977+0000 7f1c0affd700 1 -- 172.21.15.71:0/3403838930 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0400fb10 con 0x7f1c00004810 2023-10-09T07:01:32.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.977+0000 7f1c197ff700 1 -- 172.21.15.71:0/3403838930 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c140c4e90 con 0x7f1c00004810 2023-10-09T07:01:32.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.977+0000 7f1c0affd700 1 -- 172.21.15.71:0/3403838930 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0400fe90 con 0x7f1c00004810 2023-10-09T07:01:32.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.977+0000 7f1c197ff700 1 -- 172.21.15.71:0/3403838930 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c140b0800 con 0x7f1c00004810 2023-10-09T07:01:32.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.978+0000 7f1c197ff700 1 -- 172.21.15.71:0/3403838930 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c140c00c0 con 0x7f1c00004810 2023-10-09T07:01:32.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.979+0000 7f1c0affd700 1 -- 172.21.15.71:0/3403838930 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c04015670 con 0x7f1c00004810 2023-10-09T07:01:32.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.979+0000 7f1c0affd700 1 --2- 172.21.15.71:0/3403838930 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1bf4066f30 0x7f1bf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:32.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.979+0000 7f1c0affd700 1 -- 172.21.15.71:0/3403838930 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f1c04085110 con 0x7f1c00004810 2023-10-09T07:01:32.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.980+0000 7f1c0bfff700 1 --2- 172.21.15.71:0/3403838930 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1bf4066f30 0x7f1bf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:32.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.981+0000 7f1c0bfff700 1 --2- 172.21.15.71:0/3403838930 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1bf4066f30 0x7f1bf40693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc008fd0 tx=0x7f1bfc015000 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:32.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:32.984+0000 7f1c0affd700 1 -- 172.21.15.71:0/3403838930 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c140c00c0 con 0x7f1c00004810 2023-10-09T07:01:33.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.248+0000 7f1c197ff700 1 -- 172.21.15.71:0/3403838930 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f1c140c00c0 con 0x7f1c00004810 2023-10-09T07:01:33.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.252+0000 7f1c0affd700 1 -- 172.21.15.71:0/3403838930 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f1c140c00c0 con 0x7f1c00004810 2023-10-09T07:01:33.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.254+0000 7f1c197ff700 1 -- 172.21.15.71:0/3403838930 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1bf4066f30 msgr2=0x7f1bf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:33.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.254+0000 7f1c197ff700 1 --2- 172.21.15.71:0/3403838930 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1bf4066f30 0x7f1bf40693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc008fd0 tx=0x7f1bfc015000 comp rx=0 tx=0).stop 2023-10-09T07:01:33.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.254+0000 7f1c197ff700 1 -- 172.21.15.71:0/3403838930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c00004810 msgr2=0x7f1c14156b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:33.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.254+0000 7f1c197ff700 1 --2- 172.21.15.71:0/3403838930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c00004810 0x7f1c14156b10 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f1c04009fd0 tx=0x7f1c04008040 comp rx=0 tx=0).stop 2023-10-09T07:01:33.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.254+0000 7f1c197ff700 1 -- 172.21.15.71:0/3403838930 shutdown_connections 2023-10-09T07:01:33.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.255+0000 7f1c197ff700 1 --2- 172.21.15.71:0/3403838930 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1bf4066f30 0x7f1bf40693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:33.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.255+0000 7f1c197ff700 1 --2- 172.21.15.71:0/3403838930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c140c4450 0x7f1c140b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:33.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.255+0000 7f1c197ff700 1 --2- 172.21.15.71:0/3403838930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c00004810 0x7f1c14156b10 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:33.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.255+0000 7f1c197ff700 1 --2- 172.21.15.71:0/3403838930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c1415a000 0x7f1c140c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:33.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.255+0000 7f1c197ff700 1 -- 172.21.15.71:0/3403838930 >> 172.21.15.71:0/3403838930 conn(0x7f1c140cc540 msgr2=0x7f1c140c6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:33.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.255+0000 7f1c197ff700 1 -- 172.21.15.71:0/3403838930 shutdown_connections 2023-10-09T07:01:33.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.255+0000 7f1c197ff700 1 -- 172.21.15.71:0/3403838930 wait complete. 2023-10-09T07:01:33.257 INFO:teuthology.orchestra.run.smithi071.stderr:updated caps for client.0 2023-10-09T07:01:33.274 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:01:33.282 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:01:33.323 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:01:33.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.473+0000 7faf6bfff700 1 Processor -- start 2023-10-09T07:01:33.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.473+0000 7faf6bfff700 1 -- start start 2023-10-09T07:01:33.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.474+0000 7faf6bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faf64155c10 0x7faf64155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:33.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.474+0000 7faf6bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7faf640ac230 0x7faf640ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:33.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.474+0000 7faf6bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf641568a0 0x7faf64156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:33.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.474+0000 7faf6bfff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf640ad930 con 0x7faf64155c10 2023-10-09T07:01:33.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.474+0000 7faf6bfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf640acd20 con 0x7faf640ac230 2023-10-09T07:01:33.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.474+0000 7faf6bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf640ad000 con 0x7faf641568a0 2023-10-09T07:01:33.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.474+0000 7faf69d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faf64155c10 0x7faf64155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:33.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.475+0000 7faf69d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faf64155c10 0x7faf64155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40204/0 (socket says 172.21.15.71:40204) 2023-10-09T07:01:33.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.475+0000 7faf69d9b700 1 -- 172.21.15.71:0/3557475010 learned_addr learned my addr 172.21.15.71:0/3557475010 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:33.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.475+0000 7faf6959a700 1 --2- 172.21.15.71:0/3557475010 >> v2:172.21.15.179:3300/0 conn(0x7faf640ac230 0x7faf640ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:33.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.475+0000 7faf6a59c700 1 --2- 172.21.15.71:0/3557475010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf641568a0 0x7faf64156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:33.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.475+0000 7faf69d9b700 1 -- 172.21.15.71:0/3557475010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf641568a0 msgr2=0x7faf64156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:33.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.475+0000 7faf69d9b700 1 --2- 172.21.15.71:0/3557475010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf641568a0 0x7faf64156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:33.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.475+0000 7faf69d9b700 1 -- 172.21.15.71:0/3557475010 >> v2:172.21.15.179:3300/0 conn(0x7faf640ac230 msgr2=0x7faf640ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:33.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.475+0000 7faf69d9b700 1 --2- 172.21.15.71:0/3557475010 >> v2:172.21.15.179:3300/0 conn(0x7faf640ac230 0x7faf640ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:33.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.475+0000 7faf69d9b700 1 -- 172.21.15.71:0/3557475010 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf640ad2e0 con 0x7faf64155c10 2023-10-09T07:01:33.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.475+0000 7faf6959a700 1 --2- 172.21.15.71:0/3557475010 >> v2:172.21.15.179:3300/0 conn(0x7faf640ac230 0x7faf640ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:01:33.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.475+0000 7faf6a59c700 1 --2- 172.21.15.71:0/3557475010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf641568a0 0x7faf64156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:01:33.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.475+0000 7faf69d9b700 1 --2- 172.21.15.71:0/3557475010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf64155c10 0x7faf64155fe0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7faf64065bb0 tx=0x7faf60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1932afa53888d1d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:33.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.475+0000 7faf68d99700 1 -- 172.21.15.71:0/3557475010 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6000b860 con 0x7faf64155c10 2023-10-09T07:01:33.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.475+0000 7faf68d99700 1 -- 172.21.15.71:0/3557475010 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6000b9c0 con 0x7faf64155c10 2023-10-09T07:01:33.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.475+0000 7faf68d99700 1 -- 172.21.15.71:0/3557475010 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6000bd60 con 0x7faf64155c10 2023-10-09T07:01:33.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.476+0000 7faf6bfff700 1 -- 172.21.15.71:0/3557475010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf64155c10 msgr2=0x7faf64155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:33.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.476+0000 7faf6bfff700 1 --2- 172.21.15.71:0/3557475010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf64155c10 0x7faf64155fe0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7faf64065bb0 tx=0x7faf60009250 comp rx=0 tx=0).stop 2023-10-09T07:01:33.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.476+0000 7faf6bfff700 1 -- 172.21.15.71:0/3557475010 shutdown_connections 2023-10-09T07:01:33.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.476+0000 7faf6bfff700 1 --2- 172.21.15.71:0/3557475010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf641568a0 0x7faf64156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:33.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.476+0000 7faf6bfff700 1 --2- 172.21.15.71:0/3557475010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf64155c10 0x7faf64155fe0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:33.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.476+0000 7faf6bfff700 1 --2- 172.21.15.71:0/3557475010 >> v2:172.21.15.179:3300/0 conn(0x7faf640ac230 0x7faf640ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:33.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.476+0000 7faf6bfff700 1 -- 172.21.15.71:0/3557475010 >> 172.21.15.71:0/3557475010 conn(0x7faf6406a320 msgr2=0x7faf640cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:33.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.476+0000 7faf6bfff700 1 -- 172.21.15.71:0/3557475010 shutdown_connections 2023-10-09T07:01:33.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.476+0000 7faf6bfff700 1 -- 172.21.15.71:0/3557475010 wait complete. 2023-10-09T07:01:33.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.478+0000 7faf6bfff700 1 Processor -- start 2023-10-09T07:01:33.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.478+0000 7faf6bfff700 1 -- start start 2023-10-09T07:01:33.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.479+0000 7faf6bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf640ac230 0x7faf640ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:33.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.479+0000 7faf6bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf64155c10 0x7faf640cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:33.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.479+0000 7faf6bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf641568a0 0x7faf64146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:33.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.479+0000 7faf6bfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf640cc580 con 0x7faf641568a0 2023-10-09T07:01:33.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.479+0000 7faf6bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf640ca7a0 con 0x7faf64155c10 2023-10-09T07:01:33.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.479+0000 7faf6bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf640caa80 con 0x7faf640ac230 2023-10-09T07:01:33.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.479+0000 7faf6a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf641568a0 0x7faf64146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:33.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.479+0000 7faf6a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf641568a0 0x7faf64146f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40220/0 (socket says 172.21.15.71:40220) 2023-10-09T07:01:33.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.479+0000 7faf6a59c700 1 -- 172.21.15.71:0/1857601469 learned_addr learned my addr 172.21.15.71:0/1857601469 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:33.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.479+0000 7faf69d9b700 1 --2- 172.21.15.71:0/1857601469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf640ac230 0x7faf640ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:33.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.479+0000 7faf6959a700 1 --2- 172.21.15.71:0/1857601469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf64155c10 0x7faf640cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:33.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.479+0000 7faf6a59c700 1 -- 172.21.15.71:0/1857601469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf640ac230 msgr2=0x7faf640ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:33.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.479+0000 7faf6a59c700 1 --2- 172.21.15.71:0/1857601469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf640ac230 0x7faf640ca0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:33.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.479+0000 7faf6a59c700 1 -- 172.21.15.71:0/1857601469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf64155c10 msgr2=0x7faf640cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:33.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.479+0000 7faf6a59c700 1 --2- 172.21.15.71:0/1857601469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf64155c10 0x7faf640cc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:33.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.479+0000 7faf6a59c700 1 -- 172.21.15.71:0/1857601469 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf600094f0 con 0x7faf641568a0 2023-10-09T07:01:33.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.480+0000 7faf6a59c700 1 --2- 172.21.15.71:0/1857601469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf641568a0 0x7faf64146f90 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7faf5c007f30 tx=0x7faf5c009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:33.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.480+0000 7faf59ffb700 1 -- 172.21.15.71:0/1857601469 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c00db80 con 0x7faf641568a0 2023-10-09T07:01:33.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.480+0000 7faf59ffb700 1 -- 172.21.15.71:0/1857601469 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c00f040 con 0x7faf641568a0 2023-10-09T07:01:33.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.480+0000 7faf6bfff700 1 -- 172.21.15.71:0/1857601469 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf640cad60 con 0x7faf641568a0 2023-10-09T07:01:33.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.480+0000 7faf59ffb700 1 -- 172.21.15.71:0/1857601469 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c015440 con 0x7faf641568a0 2023-10-09T07:01:33.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.480+0000 7faf6bfff700 1 -- 172.21.15.71:0/1857601469 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf640cb320 con 0x7faf641568a0 2023-10-09T07:01:33.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.481+0000 7faf6bfff700 1 -- 172.21.15.71:0/1857601469 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf64147940 con 0x7faf641568a0 2023-10-09T07:01:33.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.482+0000 7faf59ffb700 1 -- 172.21.15.71:0/1857601469 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf5c01e3b0 con 0x7faf641568a0 2023-10-09T07:01:33.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.483+0000 7faf59ffb700 1 --2- 172.21.15.71:0/1857601469 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7faf48066f30 0x7faf480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:33.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.483+0000 7faf59ffb700 1 -- 172.21.15.71:0/1857601469 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6125+0+0 (secure 0 0 0) 0x7faf5c084a40 con 0x7faf641568a0 2023-10-09T07:01:33.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.483+0000 7faf69d9b700 1 --2- 172.21.15.71:0/1857601469 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7faf48066f30 0x7faf480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:33.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.484+0000 7faf69d9b700 1 --2- 172.21.15.71:0/1857601469 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7faf48066f30 0x7faf480693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faf64065bb0 tx=0x7faf60017000 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:33.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.487+0000 7faf59ffb700 1 -- 172.21.15.71:0/1857601469 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf64147940 con 0x7faf641568a0 2023-10-09T07:01:33.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.722+0000 7faf6bfff700 1 -- 172.21.15.71:0/1857601469 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf64147940 con 0x7faf641568a0 2023-10-09T07:01:33.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.723+0000 7faf59ffb700 1 -- 172.21.15.71:0/1857601469 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4599 (secure 0 0 0) 0x7faf64147940 con 0x7faf641568a0 2023-10-09T07:01:33.724 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:01:33.724 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/4239197200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":4239197200},{"type":"v1","addr":"172.21.15.179:6836","nonce":4239197200}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":8094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/645124077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":645124077},{"type":"v1","addr":"172.21.15.71:6833","nonce":645124077}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":8097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/542229353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":542229353},{"type":"v1","addr":"172.21.15.71:6835","nonce":542229353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:01:22.605100+0000","modified":"2023-10-09T07:01:26.163625+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/2229698291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2229698291},{"type":"v1","addr":"172.21.15.179:6834","nonce":2229698291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T07:01:33.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.725+0000 7faf6bfff700 1 -- 172.21.15.71:0/1857601469 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7faf48066f30 msgr2=0x7faf480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:33.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.725+0000 7faf6bfff700 1 --2- 172.21.15.71:0/1857601469 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7faf48066f30 0x7faf480693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faf64065bb0 tx=0x7faf60017000 comp rx=0 tx=0).stop 2023-10-09T07:01:33.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.725+0000 7faf6bfff700 1 -- 172.21.15.71:0/1857601469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf641568a0 msgr2=0x7faf64146f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:33.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.725+0000 7faf6bfff700 1 --2- 172.21.15.71:0/1857601469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf641568a0 0x7faf64146f90 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7faf5c007f30 tx=0x7faf5c009930 comp rx=0 tx=0).stop 2023-10-09T07:01:33.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.725+0000 7faf6bfff700 1 -- 172.21.15.71:0/1857601469 shutdown_connections 2023-10-09T07:01:33.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.725+0000 7faf6bfff700 1 --2- 172.21.15.71:0/1857601469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf641568a0 0x7faf64146f90 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:33.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.725+0000 7faf6bfff700 1 --2- 172.21.15.71:0/1857601469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf640ac230 0x7faf640ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:33.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.725+0000 7faf6bfff700 1 --2- 172.21.15.71:0/1857601469 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7faf48066f30 0x7faf480693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:33.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.725+0000 7faf6bfff700 1 --2- 172.21.15.71:0/1857601469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf64155c10 0x7faf640cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:33.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.726+0000 7faf6bfff700 1 -- 172.21.15.71:0/1857601469 >> 172.21.15.71:0/1857601469 conn(0x7faf6406a320 msgr2=0x7faf64153f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:33.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.726+0000 7faf6bfff700 1 -- 172.21.15.71:0/1857601469 shutdown_connections 2023-10-09T07:01:33.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:33.726+0000 7faf6bfff700 1 -- 172.21.15.71:0/1857601469 wait complete. 2023-10-09T07:01:33.728 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 66 2023-10-09T07:01:34.147 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T07:01:22.605100+0000', 'modified': '2023-10-09T07:01:26.163625+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8109}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8109': {'gid': 8109, 'name': 'b', 'rank': 0, 'incarnation': 63, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6834/2229698291', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6832', 'nonce': 2229698291}, {'type': 'v1', 'addr': '172.21.15.179:6834', 'nonce': 2229698291}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T07:01:34.147 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T07:01:34.147 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-09T07:01:34.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.328+0000 7ff9ef9ff700 1 Processor -- start 2023-10-09T07:01:34.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.328+0000 7ff9ef9ff700 1 -- start start 2023-10-09T07:01:34.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.330+0000 7ff9ef9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9e8155c10 0x7ff9e8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.330+0000 7ff9ef9ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff9e80ac230 0x7ff9e80ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.330+0000 7ff9ef9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff9e81568a0 0x7ff9e8156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.330+0000 7ff9ef9ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e80ad930 con 0x7ff9e80ac230 2023-10-09T07:01:34.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.330+0000 7ff9ef9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e80acd20 con 0x7ff9e81568a0 2023-10-09T07:01:34.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.330+0000 7ff9ef9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e80ad000 con 0x7ff9e8155c10 2023-10-09T07:01:34.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.330+0000 7ff9ecf9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff9e80ac230 0x7ff9e80ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:34.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.330+0000 7ff9ecf9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff9e80ac230 0x7ff9e80ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40236/0 (socket says 172.21.15.71:40236) 2023-10-09T07:01:34.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.330+0000 7ff9ecf9a700 1 -- 172.21.15.71:0/3715017830 learned_addr learned my addr 172.21.15.71:0/3715017830 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:34.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.330+0000 7ff9ed79b700 1 --2- 172.21.15.71:0/3715017830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9e8155c10 0x7ff9e8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:34.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.330+0000 7ff9edf9c700 1 --2- 172.21.15.71:0/3715017830 >> v2:172.21.15.179:3300/0 conn(0x7ff9e81568a0 0x7ff9e8156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:34.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.330+0000 7ff9ecf9a700 1 -- 172.21.15.71:0/3715017830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9e8155c10 msgr2=0x7ff9e8155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:34.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.330+0000 7ff9ecf9a700 1 --2- 172.21.15.71:0/3715017830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9e8155c10 0x7ff9e8155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.330+0000 7ff9ecf9a700 1 -- 172.21.15.71:0/3715017830 >> v2:172.21.15.179:3300/0 conn(0x7ff9e81568a0 msgr2=0x7ff9e8156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:34.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.330+0000 7ff9ecf9a700 1 --2- 172.21.15.71:0/3715017830 >> v2:172.21.15.179:3300/0 conn(0x7ff9e81568a0 0x7ff9e8156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.330+0000 7ff9ecf9a700 1 -- 172.21.15.71:0/3715017830 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e80ad2e0 con 0x7ff9e80ac230 2023-10-09T07:01:34.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.331+0000 7ff9ecf9a700 1 --2- 172.21.15.71:0/3715017830 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9e80ac230 0x7ff9e80ac6a0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80c8c60 tx=0x7ff9d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1e03b97298924 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:34.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.331+0000 7ff9dffff700 1 -- 172.21.15.71:0/3715017830 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d800b860 con 0x7ff9e80ac230 2023-10-09T07:01:34.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.331+0000 7ff9dffff700 1 -- 172.21.15.71:0/3715017830 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d800b9c0 con 0x7ff9e80ac230 2023-10-09T07:01:34.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.331+0000 7ff9dffff700 1 -- 172.21.15.71:0/3715017830 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d800bd60 con 0x7ff9e80ac230 2023-10-09T07:01:34.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.331+0000 7ff9ef9ff700 1 -- 172.21.15.71:0/3715017830 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9e80ac230 msgr2=0x7ff9e80ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:34.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.331+0000 7ff9ef9ff700 1 --2- 172.21.15.71:0/3715017830 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9e80ac230 0x7ff9e80ac6a0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80c8c60 tx=0x7ff9d8009250 comp rx=0 tx=0).stop 2023-10-09T07:01:34.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.332+0000 7ff9ef9ff700 1 -- 172.21.15.71:0/3715017830 shutdown_connections 2023-10-09T07:01:34.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.332+0000 7ff9ef9ff700 1 --2- 172.21.15.71:0/3715017830 >> v2:172.21.15.179:3300/0 conn(0x7ff9e81568a0 0x7ff9e8156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.332+0000 7ff9ef9ff700 1 --2- 172.21.15.71:0/3715017830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9e8155c10 0x7ff9e8155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.332+0000 7ff9ef9ff700 1 --2- 172.21.15.71:0/3715017830 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9e80ac230 0x7ff9e80ac6a0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.332+0000 7ff9ef9ff700 1 -- 172.21.15.71:0/3715017830 >> 172.21.15.71:0/3715017830 conn(0x7ff9e806a320 msgr2=0x7ff9e80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:34.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.332+0000 7ff9ef9ff700 1 -- 172.21.15.71:0/3715017830 shutdown_connections 2023-10-09T07:01:34.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.332+0000 7ff9ef9ff700 1 -- 172.21.15.71:0/3715017830 wait complete. 2023-10-09T07:01:34.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.333+0000 7ff9ef9ff700 1 Processor -- start 2023-10-09T07:01:34.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.333+0000 7ff9ef9ff700 1 -- start start 2023-10-09T07:01:34.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.334+0000 7ff9ef9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9e80ac230 0x7ff9e80cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.334+0000 7ff9ef9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9e8155c10 0x7ff9e81457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.334+0000 7ff9ef9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9e81568a0 0x7ff9e816b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.334+0000 7ff9ef9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e814d710 con 0x7ff9e81568a0 2023-10-09T07:01:34.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.334+0000 7ff9ef9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e80ccdf0 con 0x7ff9e80ac230 2023-10-09T07:01:34.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.334+0000 7ff9ef9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e814cde0 con 0x7ff9e8155c10 2023-10-09T07:01:34.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.334+0000 7ff9edf9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9e81568a0 0x7ff9e816b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:34.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.334+0000 7ff9edf9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9e81568a0 0x7ff9e816b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40246/0 (socket says 172.21.15.71:40246) 2023-10-09T07:01:34.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.334+0000 7ff9edf9c700 1 -- 172.21.15.71:0/2283555394 learned_addr learned my addr 172.21.15.71:0/2283555394 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:34.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.334+0000 7ff9ed79b700 1 --2- 172.21.15.71:0/2283555394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9e80ac230 0x7ff9e80cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:34.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.334+0000 7ff9ecf9a700 1 --2- 172.21.15.71:0/2283555394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9e8155c10 0x7ff9e81457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:34.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.335+0000 7ff9edf9c700 1 -- 172.21.15.71:0/2283555394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9e8155c10 msgr2=0x7ff9e81457c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:34.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.335+0000 7ff9edf9c700 1 --2- 172.21.15.71:0/2283555394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9e8155c10 0x7ff9e81457c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.335+0000 7ff9edf9c700 1 -- 172.21.15.71:0/2283555394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9e80ac230 msgr2=0x7ff9e80cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:34.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.335+0000 7ff9edf9c700 1 --2- 172.21.15.71:0/2283555394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9e80ac230 0x7ff9e80cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.335+0000 7ff9edf9c700 1 -- 172.21.15.71:0/2283555394 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d80094f0 con 0x7ff9e81568a0 2023-10-09T07:01:34.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.335+0000 7ff9edf9c700 1 --2- 172.21.15.71:0/2283555394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9e81568a0 0x7ff9e816b060 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0007f20 tx=0x7ff9e0009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:34.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.335+0000 7ff9dd7fa700 1 -- 172.21.15.71:0/2283555394 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e000eb90 con 0x7ff9e81568a0 2023-10-09T07:01:34.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.335+0000 7ff9dd7fa700 1 -- 172.21.15.71:0/2283555394 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e000ed10 con 0x7ff9e81568a0 2023-10-09T07:01:34.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.335+0000 7ff9ef9ff700 1 -- 172.21.15.71:0/2283555394 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e814d0c0 con 0x7ff9e81568a0 2023-10-09T07:01:34.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.335+0000 7ff9dd7fa700 1 -- 172.21.15.71:0/2283555394 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0014670 con 0x7ff9e81568a0 2023-10-09T07:01:34.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.336+0000 7ff9ef9ff700 1 -- 172.21.15.71:0/2283555394 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e814dba0 con 0x7ff9e81568a0 2023-10-09T07:01:34.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.337+0000 7ff9dd7fa700 1 -- 172.21.15.71:0/2283555394 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff9e00149e0 con 0x7ff9e81568a0 2023-10-09T07:01:34.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.338+0000 7ff9dd7fa700 1 --2- 172.21.15.71:0/2283555394 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff9cc066f30 0x7ff9cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.338+0000 7ff9dd7fa700 1 -- 172.21.15.71:0/2283555394 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6125+0+0 (secure 0 0 0) 0x7ff9e0084d70 con 0x7ff9e81568a0 2023-10-09T07:01:34.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.339+0000 7ff9ed79b700 1 --2- 172.21.15.71:0/2283555394 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff9cc066f30 0x7ff9cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:34.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.340+0000 7ff9ed79b700 1 --2- 172.21.15.71:0/2283555394 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff9cc066f30 0x7ff9cc0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4006fd0 tx=0x7ff9e4008040 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:34.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.340+0000 7ff9fe184b80 1 Processor -- start 2023-10-09T07:01:34.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.340+0000 7ff9fe184b80 1 -- start start 2023-10-09T07:01:34.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.341+0000 7ff9fe184b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f4ec9c0a50 0x55f4ec9c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.341+0000 7ff9fe184b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4eca0ad00 0x55f4ec9e9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.341+0000 7ff9fe184b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4ec9e9f60 0x55f4ec9bccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.341+0000 7ff9fe184b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ec917a70 con 0x55f4eca0ad00 2023-10-09T07:01:34.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.341+0000 7ff9fe184b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ec915270 con 0x55f4ec9e9f60 2023-10-09T07:01:34.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.341+0000 7ff9fe184b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4ec911060 con 0x55f4ec9c0a50 2023-10-09T07:01:34.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.341+0000 7ff9ecf9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4eca0ad00 0x55f4ec9e9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:34.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.341+0000 7ff9ecf9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4eca0ad00 0x55f4ec9e9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40254/0 (socket says 172.21.15.71:40254) 2023-10-09T07:01:34.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.341+0000 7ff9ecf9a700 1 -- 172.21.15.71:0/296039108 learned_addr learned my addr 172.21.15.71:0/296039108 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:34.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.342+0000 7ff9edf9c700 1 --2- 172.21.15.71:0/296039108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4ec9e9f60 0x55f4ec9bccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:34.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.342+0000 7ff9ed79b700 1 --2- 172.21.15.71:0/296039108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f4ec9c0a50 0x55f4ec9c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:34.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.342+0000 7ff9ecf9a700 1 -- 172.21.15.71:0/296039108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f4ec9c0a50 msgr2=0x55f4ec9c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:34.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.342+0000 7ff9ecf9a700 1 --2- 172.21.15.71:0/296039108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f4ec9c0a50 0x55f4ec9c0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.342+0000 7ff9ecf9a700 1 -- 172.21.15.71:0/296039108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4ec9e9f60 msgr2=0x55f4ec9bccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:34.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.342+0000 7ff9ecf9a700 1 --2- 172.21.15.71:0/296039108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4ec9e9f60 0x55f4ec9bccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.342+0000 7ff9ecf9a700 1 -- 172.21.15.71:0/296039108 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4ec7ab270 con 0x55f4eca0ad00 2023-10-09T07:01:34.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.342+0000 7ff9ed79b700 1 --2- 172.21.15.71:0/296039108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f4ec9c0a50 0x55f4ec9c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:01:34.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.342+0000 7ff9ecf9a700 1 --2- 172.21.15.71:0/296039108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4eca0ad00 0x55f4ec9e9a20 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800b3c0 tx=0x7ff9d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d153826a3de3997e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:34.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.342+0000 7ff9d27fc700 1 -- 172.21.15.71:0/296039108 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8021070 con 0x55f4eca0ad00 2023-10-09T07:01:34.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.342+0000 7ff9d27fc700 1 -- 172.21.15.71:0/296039108 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d8000c90 con 0x55f4eca0ad00 2023-10-09T07:01:34.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.342+0000 7ff9d27fc700 1 -- 172.21.15.71:0/296039108 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d800bd60 con 0x55f4eca0ad00 2023-10-09T07:01:34.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.343+0000 7ff9fe184b80 1 -- 172.21.15.71:0/296039108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4eca0ad00 msgr2=0x55f4ec9e9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:34.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.343+0000 7ff9fe184b80 1 --2- 172.21.15.71:0/296039108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4eca0ad00 0x55f4ec9e9a20 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800b3c0 tx=0x7ff9d8017000 comp rx=0 tx=0).stop 2023-10-09T07:01:34.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.343+0000 7ff9fe184b80 1 -- 172.21.15.71:0/296039108 shutdown_connections 2023-10-09T07:01:34.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.343+0000 7ff9fe184b80 1 --2- 172.21.15.71:0/296039108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4ec9e9f60 0x55f4ec9bccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.343+0000 7ff9fe184b80 1 --2- 172.21.15.71:0/296039108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f4ec9c0a50 0x55f4ec9c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.343+0000 7ff9fe184b80 1 --2- 172.21.15.71:0/296039108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4eca0ad00 0x55f4ec9e9a20 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.343+0000 7ff9fe184b80 1 -- 172.21.15.71:0/296039108 >> 172.21.15.71:0/296039108 conn(0x55f4ec9c2370 msgr2=0x55f4ec9c2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:34.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.343+0000 7ff9fe184b80 1 -- 172.21.15.71:0/296039108 shutdown_connections 2023-10-09T07:01:34.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.343+0000 7ff9fe184b80 1 -- 172.21.15.71:0/296039108 wait complete. 2023-10-09T07:01:34.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.344+0000 7ff9fe184b80 1 -- start start 2023-10-09T07:01:34.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.344+0000 7ff9fe184b80 1 Processor -- start 2023-10-09T07:01:34.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.345+0000 7ff9fe184b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4ec9c0a50 0x55f4eca07a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.345+0000 7ff9fe184b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4ec9e9f60 0x55f4ec9bbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.345+0000 7ff9fe184b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f4eca0ad00 0x55f4ec9bc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.345+0000 7ff9fe184b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ec8bc890 con 0x55f4ec9e9f60 2023-10-09T07:01:34.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.345+0000 7ff9fe184b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ec8d7ea0 con 0x55f4ec9c0a50 2023-10-09T07:01:34.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.345+0000 7ff9fe184b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4ec793e30 con 0x55f4eca0ad00 2023-10-09T07:01:34.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.345+0000 7ff9fe184b80 10 client.0 _ll_register_callbacks cb 0x55f4ec984110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T07:01:34.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.345+0000 7ff9ecf9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4ec9e9f60 0x55f4ec9bbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:34.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.345+0000 7ff9ecf9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4ec9e9f60 0x55f4ec9bbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40260/0 (socket says 172.21.15.71:40260) 2023-10-09T07:01:34.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.345+0000 7ff9ecf9a700 1 -- 172.21.15.71:0/105308961 learned_addr learned my addr 172.21.15.71:0/105308961 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:34.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.345+0000 7ff9edf9c700 1 --2- 172.21.15.71:0/105308961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f4eca0ad00 0x55f4ec9bc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:34.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.346+0000 7ff9ecf9a700 1 -- 172.21.15.71:0/105308961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f4eca0ad00 msgr2=0x55f4ec9bc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:34.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.346+0000 7ff9ecf9a700 1 --2- 172.21.15.71:0/105308961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f4eca0ad00 0x55f4ec9bc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.346+0000 7ff9ecf9a700 1 -- 172.21.15.71:0/105308961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4ec9c0a50 msgr2=0x55f4eca07a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:34.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.346+0000 7ff9ecf9a700 1 --2- 172.21.15.71:0/105308961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4ec9c0a50 0x55f4eca07a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.346+0000 7ff9ecf9a700 1 -- 172.21.15.71:0/105308961 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e80ad2e0 con 0x55f4ec9e9f60 2023-10-09T07:01:34.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.346+0000 7ff9ecf9a700 1 --2- 172.21.15.71:0/105308961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4ec9e9f60 0x55f4ec9bbc20 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8006e80 tx=0x7ff9d8021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c35457749f7ebe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:34.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.346+0000 7ff9c77fe700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T07:01:34.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.346+0000 7ff9c77fe700 1 -- 172.21.15.71:0/105308961 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d800beb0 con 0x55f4ec9e9f60 2023-10-09T07:01:34.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.346+0000 7ff9fe184b80 1 -- 172.21.15.71:0/105308961 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f4ec9b5b70 con 0x55f4ec9e9f60 2023-10-09T07:01:34.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.346+0000 7ff9c77fe700 1 -- 172.21.15.71:0/105308961 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 6125+0+0 (secure 0 0 0) 0x7ff9d8011a50 con 0x55f4ec9e9f60 2023-10-09T07:01:34.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.346+0000 7ff9c77fe700 1 -- 172.21.15.71:0/105308961 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9d8011e20 con 0x55f4ec9e9f60 2023-10-09T07:01:34.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.347+0000 7ff9fe184b80 10 client.8268 fetch_fsmap learned FSMap version 66 2023-10-09T07:01:34.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.347+0000 7ff9fe184b80 1 -- 172.21.15.71:0/105308961 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x55f4ec74dfe0 con 0x55f4ec9e9f60 2023-10-09T07:01:34.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.347+0000 7ff9c77fe700 1 -- 172.21.15.71:0/105308961 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f4ec9b5b70 con 0x55f4ec9e9f60 2023-10-09T07:01:34.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.347+0000 7ff9c77fe700 1 -- 172.21.15.71:0/105308961 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 66) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff9d801a420 con 0x55f4ec9e9f60 2023-10-09T07:01:34.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.347+0000 7ff9fe184b80 10 client.8268 fetch_fsmap finished waiting for FSMap version 66 2023-10-09T07:01:34.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.347+0000 7ff9fe184b80 10 client.8268 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T07:01:34.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.347+0000 7ff9fe184b80 20 client.8268 populate_metadata read hostname 'smithi071' 2023-10-09T07:01:34.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.347+0000 7ff9fe184b80 1 --2- 172.21.15.71:0/105308961 >> [v2:172.21.15.179:6832/2229698291,v1:172.21.15.179:6834/2229698291] conn(0x55f4ec9ef690 0x55f4ec9efa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.347+0000 7ff9fe184b80 4 client.8268 mds_command: new command op to 8109 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T07:01:34.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.347+0000 7ff9fe184b80 1 -- 172.21.15.71:0/105308961 --> [v2:172.21.15.179:6832/2229698291,v1:172.21.15.179:6834/2229698291] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f4ec992aa0 con 0x55f4ec9ef690 2023-10-09T07:01:34.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.347+0000 7ff9ed79b700 1 --2- 172.21.15.71:0/105308961 >> [v2:172.21.15.179:6832/2229698291,v1:172.21.15.179:6834/2229698291] conn(0x55f4ec9ef690 0x55f4ec9efa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:34.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.348+0000 7ff9c77fe700 10 client.8268 ms_handle_connect on v2:172.21.15.179:6832/2229698291 2023-10-09T07:01:34.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.348+0000 7ff9ed79b700 1 --2- 172.21.15.71:0/105308961 >> [v2:172.21.15.179:6832/2229698291,v1:172.21.15.179:6834/2229698291] conn(0x55f4ec9ef690 0x55f4ec9efa60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99682cd8a7126aa1 server_cookie=e8aee66642788c4b in_seq=0 out_seq=0 2023-10-09T07:01:34.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.349+0000 7ff9c77fe700 1 -- 172.21.15.71:0/105308961 <== mds.0 v2:172.21.15.179:6832/2229698291 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f4ec992aa0 con 0x55f4ec9ef690 2023-10-09T07:01:34.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.349+0000 7ff9c77fe700 10 client.8268 handle_command_reply: tid=0 2023-10-09T07:01:34.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.349+0000 7ff9fe184b80 1 client.8268 shutdown 2023-10-09T07:01:34.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.349+0000 7ff9fe184b80 1 -- 172.21.15.71:0/105308961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4ec9e9f60 msgr2=0x55f4ec9bbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:34.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.349+0000 7ff9fe184b80 1 --2- 172.21.15.71:0/105308961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4ec9e9f60 0x55f4ec9bbc20 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8006e80 tx=0x7ff9d8021000 comp rx=0 tx=0).stop 2023-10-09T07:01:34.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.349+0000 7ff9fe184b80 1 -- 172.21.15.71:0/105308961 shutdown_connections 2023-10-09T07:01:34.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.349+0000 7ff9fe184b80 1 --2- 172.21.15.71:0/105308961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f4eca0ad00 0x55f4ec9bc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.349+0000 7ff9fe184b80 1 --2- 172.21.15.71:0/105308961 >> [v2:172.21.15.179:6832/2229698291,v1:172.21.15.179:6834/2229698291] conn(0x55f4ec9ef690 0x55f4ec9efa60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.349+0000 7ff9fe184b80 1 --2- 172.21.15.71:0/105308961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4ec9c0a50 0x55f4eca07a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.349+0000 7ff9fe184b80 1 --2- 172.21.15.71:0/105308961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4ec9e9f60 0x55f4ec9bbc20 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.349+0000 7ff9c77fe700 0 client.8268 ms_handle_reset on v2:172.21.15.179:6832/2229698291 2023-10-09T07:01:34.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.349+0000 7ff9fe184b80 1 -- 172.21.15.71:0/105308961 >> 172.21.15.71:0/105308961 conn(0x55f4ec9c2370 msgr2=0x55f4eca06550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:34.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.349+0000 7ff9fe184b80 1 -- 172.21.15.71:0/105308961 shutdown_connections 2023-10-09T07:01:34.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.349+0000 7ff9fe184b80 1 -- 172.21.15.71:0/105308961 wait complete. 2023-10-09T07:01:34.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.349+0000 7ff9fe184b80 20 client.8268 trim_cache size 0 max 16384 2023-10-09T07:01:34.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.367+0000 7ff9fe184b80 1 Processor -- start 2023-10-09T07:01:34.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.367+0000 7ff9fe184b80 1 -- start start 2023-10-09T07:01:34.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.368+0000 7ff9fe184b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4ec9c0a50 0x55f4ec9bd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.368+0000 7ff9fe184b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f4ec9e9f60 0x55f4eca00c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.368+0000 7ff9fe184b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4eca0ad00 0x55f4eca6b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.368+0000 7ff9fe184b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ec9c3ba0 con 0x55f4ec9c0a50 2023-10-09T07:01:34.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.368+0000 7ff9fe184b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ec9c3190 con 0x55f4eca0ad00 2023-10-09T07:01:34.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.368+0000 7ff9fe184b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4eca07d90 con 0x55f4ec9e9f60 2023-10-09T07:01:34.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.368+0000 7ff9ed79b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4ec9c0a50 0x55f4ec9bd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:34.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.368+0000 7ff9ed79b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4ec9c0a50 0x55f4ec9bd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40274/0 (socket says 172.21.15.71:40274) 2023-10-09T07:01:34.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.368+0000 7ff9ed79b700 1 -- 172.21.15.71:0/4069950838 learned_addr learned my addr 172.21.15.71:0/4069950838 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:34.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.368+0000 7ff9ecf9a700 1 --2- 172.21.15.71:0/4069950838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f4ec9e9f60 0x55f4eca00c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:34.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.368+0000 7ff9ed79b700 1 -- 172.21.15.71:0/4069950838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f4ec9e9f60 msgr2=0x55f4eca00c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:34.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.368+0000 7ff9edf9c700 1 --2- 172.21.15.71:0/4069950838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4eca0ad00 0x55f4eca6b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:34.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.368+0000 7ff9ed79b700 1 --2- 172.21.15.71:0/4069950838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f4ec9e9f60 0x55f4eca00c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.368+0000 7ff9ed79b700 1 -- 172.21.15.71:0/4069950838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4eca0ad00 msgr2=0x55f4eca6b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:34.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.368+0000 7ff9ed79b700 1 --2- 172.21.15.71:0/4069950838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4eca0ad00 0x55f4eca6b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.368+0000 7ff9ed79b700 1 -- 172.21.15.71:0/4069950838 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4ec8df780 con 0x55f4ec9c0a50 2023-10-09T07:01:34.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.368+0000 7ff9ecf9a700 1 --2- 172.21.15.71:0/4069950838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f4ec9e9f60 0x55f4eca00c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:01:34.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.368+0000 7ff9edf9c700 1 --2- 172.21.15.71:0/4069950838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4eca0ad00 0x55f4eca6b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:01:34.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.369+0000 7ff9ed79b700 1 --2- 172.21.15.71:0/4069950838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4ec9c0a50 0x55f4ec9bd9c0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4007a60 tx=0x7ff9e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c58d228a539202d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:34.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.369+0000 7ff9d2ffd700 1 -- 172.21.15.71:0/4069950838 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4026aa0 con 0x55f4ec9c0a50 2023-10-09T07:01:34.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.369+0000 7ff9d2ffd700 1 -- 172.21.15.71:0/4069950838 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e401d040 con 0x55f4ec9c0a50 2023-10-09T07:01:34.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.369+0000 7ff9d2ffd700 1 -- 172.21.15.71:0/4069950838 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4026e50 con 0x55f4ec9c0a50 2023-10-09T07:01:34.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.369+0000 7ff9fe184b80 1 -- 172.21.15.71:0/4069950838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4ec9c0a50 msgr2=0x55f4ec9bd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:34.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.369+0000 7ff9fe184b80 1 --2- 172.21.15.71:0/4069950838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4ec9c0a50 0x55f4ec9bd9c0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4007a60 tx=0x7ff9e4017000 comp rx=0 tx=0).stop 2023-10-09T07:01:34.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.369+0000 7ff9fe184b80 1 -- 172.21.15.71:0/4069950838 shutdown_connections 2023-10-09T07:01:34.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.369+0000 7ff9fe184b80 1 --2- 172.21.15.71:0/4069950838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4eca0ad00 0x55f4eca6b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.369+0000 7ff9fe184b80 1 --2- 172.21.15.71:0/4069950838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4ec9c0a50 0x55f4ec9bd9c0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.369+0000 7ff9fe184b80 1 --2- 172.21.15.71:0/4069950838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f4ec9e9f60 0x55f4eca00c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.370+0000 7ff9fe184b80 1 -- 172.21.15.71:0/4069950838 >> 172.21.15.71:0/4069950838 conn(0x55f4ec9c2370 msgr2=0x55f4ec9bbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:34.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.370+0000 7ff9fe184b80 1 -- 172.21.15.71:0/4069950838 shutdown_connections 2023-10-09T07:01:34.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.370+0000 7ff9fe184b80 1 -- 172.21.15.71:0/4069950838 wait complete. 2023-10-09T07:01:34.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.370+0000 7ff9fe184b80 1 -- start start 2023-10-09T07:01:34.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.370+0000 7ff9fe184b80 1 Processor -- start 2023-10-09T07:01:34.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.371+0000 7ff9fe184b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4ec9c0a50 0x55f4ec9c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.371+0000 7ff9fe184b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4ec9e9f60 0x55f4ec9c1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.371+0000 7ff9fe184b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f4eca0ad00 0x55f4ec9bbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.371+0000 7ff9fe184b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4eca23f20 con 0x55f4ec9c0a50 2023-10-09T07:01:34.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.371+0000 7ff9fe184b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4eca72030 con 0x55f4ec9e9f60 2023-10-09T07:01:34.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.371+0000 7ff9fe184b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4eca72a90 con 0x55f4eca0ad00 2023-10-09T07:01:34.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.371+0000 7ff9fe184b80 10 client.0 _ll_register_callbacks cb 0x55f4ec984110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T07:01:34.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.371+0000 7ff9ed79b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4ec9c0a50 0x55f4ec9c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:34.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.372+0000 7ff9ed79b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4ec9c0a50 0x55f4ec9c0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40286/0 (socket says 172.21.15.71:40286) 2023-10-09T07:01:34.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.372+0000 7ff9ed79b700 1 -- 172.21.15.71:0/2095295990 learned_addr learned my addr 172.21.15.71:0/2095295990 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:34.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.372+0000 7ff9ed79b700 1 -- 172.21.15.71:0/2095295990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f4eca0ad00 msgr2=0x55f4ec9bbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:34.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.372+0000 7ff9ed79b700 1 --2- 172.21.15.71:0/2095295990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f4eca0ad00 0x55f4ec9bbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.372+0000 7ff9ed79b700 1 -- 172.21.15.71:0/2095295990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4ec9e9f60 msgr2=0x55f4ec9c1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:34.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.372+0000 7ff9ed79b700 1 --2- 172.21.15.71:0/2095295990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4ec9e9f60 0x55f4ec9c1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.372+0000 7ff9ed79b700 1 -- 172.21.15.71:0/2095295990 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e400e040 con 0x55f4ec9c0a50 2023-10-09T07:01:34.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.372+0000 7ff9ed79b700 1 --2- 172.21.15.71:0/2095295990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4ec9c0a50 0x55f4ec9c0e20 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4006b00 tx=0x7ff9e401a030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70abf4f990123870 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:34.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.372+0000 7ff9c77fe700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T07:01:34.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.372+0000 7ff9c77fe700 1 -- 172.21.15.71:0/2095295990 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4005e60 con 0x55f4ec9c0a50 2023-10-09T07:01:34.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.372+0000 7ff9c77fe700 1 -- 172.21.15.71:0/2095295990 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 6125+0+0 (secure 0 0 0) 0x7ff9e4026c30 con 0x55f4ec9c0a50 2023-10-09T07:01:34.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.372+0000 7ff9fe184b80 1 -- 172.21.15.71:0/2095295990 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff9e8147ce0 con 0x55f4ec9c0a50 2023-10-09T07:01:34.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.373+0000 7ff9c77fe700 1 -- 172.21.15.71:0/2095295990 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9e4016690 con 0x55f4ec9c0a50 2023-10-09T07:01:34.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.373+0000 7ff9fe184b80 10 client.8274 fetch_fsmap learned FSMap version 66 2023-10-09T07:01:34.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.373+0000 7ff9fe184b80 1 -- 172.21.15.71:0/2095295990 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x55f4ec8c6470 con 0x55f4ec9c0a50 2023-10-09T07:01:34.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.373+0000 7ff9c77fe700 1 -- 172.21.15.71:0/2095295990 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e8147ce0 con 0x55f4ec9c0a50 2023-10-09T07:01:34.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.373+0000 7ff9c77fe700 1 -- 172.21.15.71:0/2095295990 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 66) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff9e40167f0 con 0x55f4ec9c0a50 2023-10-09T07:01:34.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.373+0000 7ff9fe184b80 10 client.8274 fetch_fsmap finished waiting for FSMap version 66 2023-10-09T07:01:34.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.373+0000 7ff9fe184b80 10 client.8274 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T07:01:34.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.373+0000 7ff9fe184b80 20 client.8274 populate_metadata read hostname 'smithi071' 2023-10-09T07:01:34.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.373+0000 7ff9fe184b80 1 --2- 172.21.15.71:0/2095295990 >> [v2:172.21.15.179:6832/2229698291,v1:172.21.15.179:6834/2229698291] conn(0x55f4ec9bc160 0x55f4ec9bc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.373+0000 7ff9fe184b80 4 client.8274 mds_command: new command op to 8109 tid=0[{"prefix": "status"}] 2023-10-09T07:01:34.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.373+0000 7ff9fe184b80 1 -- 172.21.15.71:0/2095295990 --> [v2:172.21.15.179:6832/2229698291,v1:172.21.15.179:6834/2229698291] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7ff9d8000c90 con 0x55f4ec9bc160 2023-10-09T07:01:34.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.373+0000 7ff9ecf9a700 1 --2- 172.21.15.71:0/2095295990 >> [v2:172.21.15.179:6832/2229698291,v1:172.21.15.179:6834/2229698291] conn(0x55f4ec9bc160 0x55f4ec9bc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:34.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.374+0000 7ff9c77fe700 10 client.8274 ms_handle_connect on v2:172.21.15.179:6832/2229698291 2023-10-09T07:01:34.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.374+0000 7ff9ecf9a700 1 --2- 172.21.15.71:0/2095295990 >> [v2:172.21.15.179:6832/2229698291,v1:172.21.15.179:6834/2229698291] conn(0x55f4ec9bc160 0x55f4ec9bc530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70d5e9231424091a server_cookie=b5bb1c2ec784fa30 in_seq=0 out_seq=0 2023-10-09T07:01:34.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.374+0000 7ff9c77fe700 1 -- 172.21.15.71:0/2095295990 <== mds.0 v2:172.21.15.179:6832/2229698291 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x7ff9d8000c90 con 0x55f4ec9bc160 2023-10-09T07:01:34.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.374+0000 7ff9c77fe700 10 client.8274 handle_command_reply: tid=0 2023-10-09T07:01:34.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.374+0000 7ff9fe184b80 1 client.8274 shutdown 2023-10-09T07:01:34.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.375+0000 7ff9fe184b80 1 -- 172.21.15.71:0/2095295990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4ec9c0a50 msgr2=0x55f4ec9c0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:34.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.375+0000 7ff9fe184b80 1 --2- 172.21.15.71:0/2095295990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4ec9c0a50 0x55f4ec9c0e20 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4006b00 tx=0x7ff9e401a030 comp rx=0 tx=0).stop 2023-10-09T07:01:34.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.375+0000 7ff9fe184b80 1 -- 172.21.15.71:0/2095295990 shutdown_connections 2023-10-09T07:01:34.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.375+0000 7ff9fe184b80 1 --2- 172.21.15.71:0/2095295990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f4eca0ad00 0x55f4ec9bbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.375+0000 7ff9fe184b80 1 --2- 172.21.15.71:0/2095295990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4ec9c0a50 0x55f4ec9c0e20 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.375+0000 7ff9fe184b80 1 --2- 172.21.15.71:0/2095295990 >> [v2:172.21.15.179:6832/2229698291,v1:172.21.15.179:6834/2229698291] conn(0x55f4ec9bc160 0x55f4ec9bc530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.375+0000 7ff9fe184b80 1 --2- 172.21.15.71:0/2095295990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f4ec9e9f60 0x55f4ec9c1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.375+0000 7ff9fe184b80 1 -- 172.21.15.71:0/2095295990 >> 172.21.15.71:0/2095295990 conn(0x55f4ec9c2370 msgr2=0x55f4ec9c2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:34.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.375+0000 7ff9c77fe700 0 client.8274 ms_handle_reset on v2:172.21.15.179:6832/2229698291 2023-10-09T07:01:34.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.375+0000 7ff9fe184b80 1 -- 172.21.15.71:0/2095295990 shutdown_connections 2023-10-09T07:01:34.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.375+0000 7ff9fe184b80 1 -- 172.21.15.71:0/2095295990 wait complete. 2023-10-09T07:01:34.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.375+0000 7ff9fe184b80 20 client.8274 trim_cache size 0 max 16384 2023-10-09T07:01:34.382 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T07:01:34.382 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "604c5619-653a-4ab6-912c-ab2e5464fe4a", 2023-10-09T07:01:34.382 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2023-10-09T07:01:34.382 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 8109, 2023-10-09T07:01:34.382 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2023-10-09T07:01:34.383 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2023-10-09T07:01:34.383 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2023-10-09T07:01:34.383 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 11.24304935, 2023-10-09T07:01:34.383 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 66, 2023-10-09T07:01:34.383 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 137, 2023-10-09T07:01:34.383 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 137, 2023-10-09T07:01:34.383 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 17.023770336999998 2023-10-09T07:01:34.383 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T07:01:34.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.375+0000 7ff9ef9ff700 1 -- 172.21.15.71:0/2283555394 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff9cc066f30 msgr2=0x7ff9cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:34.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.375+0000 7ff9ef9ff700 1 --2- 172.21.15.71:0/2283555394 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff9cc066f30 0x7ff9cc0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4006fd0 tx=0x7ff9e4008040 comp rx=0 tx=0).stop 2023-10-09T07:01:34.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.375+0000 7ff9ef9ff700 1 -- 172.21.15.71:0/2283555394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9e81568a0 msgr2=0x7ff9e816b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:34.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.375+0000 7ff9ef9ff700 1 --2- 172.21.15.71:0/2283555394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9e81568a0 0x7ff9e816b060 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0007f20 tx=0x7ff9e0009860 comp rx=0 tx=0).stop 2023-10-09T07:01:34.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.375+0000 7ff9ef9ff700 1 -- 172.21.15.71:0/2283555394 shutdown_connections 2023-10-09T07:01:34.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.375+0000 7ff9ef9ff700 1 --2- 172.21.15.71:0/2283555394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9e81568a0 0x7ff9e816b060 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.375+0000 7ff9ef9ff700 1 --2- 172.21.15.71:0/2283555394 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff9cc066f30 0x7ff9cc0693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.375+0000 7ff9ef9ff700 1 --2- 172.21.15.71:0/2283555394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9e80ac230 0x7ff9e80cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.375+0000 7ff9ef9ff700 1 --2- 172.21.15.71:0/2283555394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9e8155c10 0x7ff9e81457c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.376+0000 7ff9ef9ff700 1 -- 172.21.15.71:0/2283555394 >> 172.21.15.71:0/2283555394 conn(0x7ff9e806a320 msgr2=0x7ff9e80ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:34.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.376+0000 7ff9ef9ff700 1 -- 172.21.15.71:0/2283555394 shutdown_connections 2023-10-09T07:01:34.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.376+0000 7ff9ef9ff700 1 -- 172.21.15.71:0/2283555394 wait complete. 2023-10-09T07:01:34.394 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T07:01:34.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.573+0000 7efc193ff700 1 Processor -- start 2023-10-09T07:01:34.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.573+0000 7efc193ff700 1 -- start start 2023-10-09T07:01:34.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.574+0000 7efc193ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7efc141578b0 0x7efc14155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.574+0000 7efc193ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc140ad930 con 0x7efc140af2f0 2023-10-09T07:01:34.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.574+0000 7efc193ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc140acd20 con 0x7efc14155c10 2023-10-09T07:01:34.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.574+0000 7efc193ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc140ad000 con 0x7efc141578b0 2023-10-09T07:01:34.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.575+0000 7efc127fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7efc141578b0 0x7efc14155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:34.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.575+0000 7efc137fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7efc140af2f0 0x7efc140af730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57662/0 (socket says 172.21.15.71:57662) 2023-10-09T07:01:34.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.575+0000 7efc137fe700 1 -- 172.21.15.71:0/2875332076 learned_addr learned my addr 172.21.15.71:0/2875332076 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:01:34.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.575+0000 7efc127fc700 1 -- 172.21.15.71:0/2875332076 >> v1:172.21.15.179:6789/0 conn(0x7efc14155c10 legacy=0x7efc140ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:34.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.575+0000 7efc127fc700 1 -- 172.21.15.71:0/2875332076 >> v1:172.21.15.71:6789/0 conn(0x7efc140af2f0 legacy=0x7efc140af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:34.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.575+0000 7efc127fc700 1 -- 172.21.15.71:0/2875332076 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc140ad2e0 con 0x7efc141578b0 2023-10-09T07:01:34.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.575+0000 7efc11ffb700 1 -- 172.21.15.71:0/2875332076 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717608861 0 0) 0x7efc140ad930 con 0x7efc140af2f0 2023-10-09T07:01:34.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.575+0000 7efc127fc700 1 --2- 172.21.15.71:0/2875332076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc141578b0 0x7efc14155fe0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7efc080098e0 tx=0x7efc080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f89770315d7f44 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:34.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.576+0000 7efc11ffb700 1 -- 172.21.15.71:0/2875332076 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc08009e80 con 0x7efc141578b0 2023-10-09T07:01:34.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.576+0000 7efc11ffb700 1 -- 172.21.15.71:0/2875332076 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0800c970 con 0x7efc141578b0 2023-10-09T07:01:34.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.576+0000 7efc11ffb700 1 -- 172.21.15.71:0/2875332076 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0800ccf0 con 0x7efc141578b0 2023-10-09T07:01:34.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.576+0000 7efc193ff700 1 -- 172.21.15.71:0/2875332076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc141578b0 msgr2=0x7efc14155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:34.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.576+0000 7efc193ff700 1 --2- 172.21.15.71:0/2875332076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc141578b0 0x7efc14155fe0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7efc080098e0 tx=0x7efc080091a0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.576+0000 7efc193ff700 1 -- 172.21.15.71:0/2875332076 shutdown_connections 2023-10-09T07:01:34.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.576+0000 7efc193ff700 1 --2- 172.21.15.71:0/2875332076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc141578b0 0x7efc14155fe0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.576+0000 7efc193ff700 1 -- 172.21.15.71:0/2875332076 >> 172.21.15.71:0/2875332076 conn(0x7efc1406a320 msgr2=0x7efc140cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:34.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.576+0000 7efc193ff700 1 -- 172.21.15.71:0/2875332076 shutdown_connections 2023-10-09T07:01:34.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.576+0000 7efc193ff700 1 -- 172.21.15.71:0/2875332076 wait complete. 2023-10-09T07:01:34.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.578+0000 7efc193ff700 1 Processor -- start 2023-10-09T07:01:34.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.578+0000 7efc193ff700 1 -- start start 2023-10-09T07:01:34.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.579+0000 7efc193ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc140af2f0 0x7efc14152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.579+0000 7efc193ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc14155c10 0x7efc140aa290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.579+0000 7efc193ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc141578b0 0x7efc140aa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.579+0000 7efc193ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1406e590 con 0x7efc141578b0 2023-10-09T07:01:34.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.579+0000 7efc193ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc14152f80 con 0x7efc14155c10 2023-10-09T07:01:34.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.579+0000 7efc193ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1415b840 con 0x7efc140af2f0 2023-10-09T07:01:34.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.579+0000 7efc137fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc141578b0 0x7efc140aa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:34.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.579+0000 7efc137fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc141578b0 0x7efc140aa7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40298/0 (socket says 172.21.15.71:40298) 2023-10-09T07:01:34.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.579+0000 7efc137fe700 1 -- 172.21.15.71:0/3085671585 learned_addr learned my addr 172.21.15.71:0/3085671585 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:34.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.579+0000 7efc127fc700 1 --2- 172.21.15.71:0/3085671585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc14155c10 0x7efc140aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:34.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.579+0000 7efc12ffd700 1 --2- 172.21.15.71:0/3085671585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc140af2f0 0x7efc14152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:34.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.579+0000 7efc137fe700 1 -- 172.21.15.71:0/3085671585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc140af2f0 msgr2=0x7efc14152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:34.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.579+0000 7efc137fe700 1 --2- 172.21.15.71:0/3085671585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc140af2f0 0x7efc14152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.579+0000 7efc137fe700 1 -- 172.21.15.71:0/3085671585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc14155c10 msgr2=0x7efc140aa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:34.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.579+0000 7efc137fe700 1 --2- 172.21.15.71:0/3085671585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc14155c10 0x7efc140aa290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.579+0000 7efc137fe700 1 -- 172.21.15.71:0/3085671585 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc08009420 con 0x7efc141578b0 2023-10-09T07:01:34.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.580+0000 7efc137fe700 1 --2- 172.21.15.71:0/3085671585 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc141578b0 0x7efc140aa7d0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00ccc0 tx=0x7efc0c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:34.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.580+0000 7efbfaffd700 1 -- 172.21.15.71:0/3085671585 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c00a910 con 0x7efc141578b0 2023-10-09T07:01:34.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.580+0000 7efbfaffd700 1 -- 172.21.15.71:0/3085671585 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0c00aa70 con 0x7efc141578b0 2023-10-09T07:01:34.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.580+0000 7efbfaffd700 1 -- 172.21.15.71:0/3085671585 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c00ae30 con 0x7efc141578b0 2023-10-09T07:01:34.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.580+0000 7efc193ff700 1 -- 172.21.15.71:0/3085671585 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc140aae30 con 0x7efc141578b0 2023-10-09T07:01:34.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.580+0000 7efc193ff700 1 -- 172.21.15.71:0/3085671585 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1406df40 con 0x7efc141578b0 2023-10-09T07:01:34.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.581+0000 7efc193ff700 1 -- 172.21.15.71:0/3085671585 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc1404c3c0 con 0x7efc141578b0 2023-10-09T07:01:34.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.582+0000 7efbfaffd700 1 -- 172.21.15.71:0/3085671585 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc0c007300 con 0x7efc141578b0 2023-10-09T07:01:34.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.583+0000 7efbfaffd700 1 --2- 172.21.15.71:0/3085671585 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efc00066f30 0x7efc000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:34.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.583+0000 7efbfaffd700 1 -- 172.21.15.71:0/3085671585 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6125+0+0 (secure 0 0 0) 0x7efc0c084b20 con 0x7efc141578b0 2023-10-09T07:01:34.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.583+0000 7efc12ffd700 1 --2- 172.21.15.71:0/3085671585 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efc00066f30 0x7efc000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:34.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.584+0000 7efc12ffd700 1 --2- 172.21.15.71:0/3085671585 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efc00066f30 0x7efc000693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efc04003860 tx=0x7efc04009040 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:34.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.587+0000 7efbfaffd700 1 -- 172.21.15.71:0/3085671585 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc0c051be0 con 0x7efc141578b0 2023-10-09T07:01:34.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.821+0000 7efc193ff700 1 -- 172.21.15.71:0/3085671585 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efc1406e6d0 con 0x7efc141578b0 2023-10-09T07:01:34.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.822+0000 7efbfaffd700 1 -- 172.21.15.71:0/3085671585 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) v1 ==== 53+0+73 (secure 0 0 0) 0x7efc0c055200 con 0x7efc141578b0 2023-10-09T07:01:34.823 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T07:01:34.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.824+0000 7efc193ff700 1 -- 172.21.15.71:0/3085671585 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efc00066f30 msgr2=0x7efc000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:34.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.824+0000 7efc193ff700 1 --2- 172.21.15.71:0/3085671585 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efc00066f30 0x7efc000693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efc04003860 tx=0x7efc04009040 comp rx=0 tx=0).stop 2023-10-09T07:01:34.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.824+0000 7efc193ff700 1 -- 172.21.15.71:0/3085671585 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc141578b0 msgr2=0x7efc140aa7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:34.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.824+0000 7efc193ff700 1 --2- 172.21.15.71:0/3085671585 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc141578b0 0x7efc140aa7d0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00ccc0 tx=0x7efc0c001a20 comp rx=0 tx=0).stop 2023-10-09T07:01:34.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.824+0000 7efc193ff700 1 -- 172.21.15.71:0/3085671585 shutdown_connections 2023-10-09T07:01:34.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.824+0000 7efc193ff700 1 --2- 172.21.15.71:0/3085671585 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc141578b0 0x7efc140aa7d0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.824+0000 7efc193ff700 1 --2- 172.21.15.71:0/3085671585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc140af2f0 0x7efc14152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.824+0000 7efc193ff700 1 --2- 172.21.15.71:0/3085671585 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efc00066f30 0x7efc000693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.824+0000 7efc193ff700 1 --2- 172.21.15.71:0/3085671585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc14155c10 0x7efc140aa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:34.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.824+0000 7efc193ff700 1 -- 172.21.15.71:0/3085671585 >> 172.21.15.71:0/3085671585 conn(0x7efc1406a320 msgr2=0x7efc14068c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:34.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.824+0000 7efc193ff700 1 -- 172.21.15.71:0/3085671585 shutdown_connections 2023-10-09T07:01:34.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:34.824+0000 7efc193ff700 1 -- 172.21.15.71:0/3085671585 wait complete. 2023-10-09T07:01:34.843 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T07:01:34.843 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T07:01:34.843 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2023-10-09T07:01:34.843 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T07:01:34.843 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T07:01:34.843 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T07:01:34.843 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T07:01:34.843 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T07:01:34.844 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T07:01:34.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:01:34.844 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2023-10-09T07:01:34.881 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T07:01:34.881 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T07:01:34.881 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T07:01:34.881 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:01:34.881 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-10-09T07:01:34.881 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:01:34.881 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T07:01:34.882 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2023-10-09T07:01:34.882 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2023-10-09T07:01:34.882 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T07:01:34.882 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2023-10-09T07:01:34.882 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2023-10-09T07:01:34.882 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T07:01:34.882 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2023-10-09T07:01:34.882 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T07:01:34.882 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2023-10-09T07:01:34.882 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T07:01:34.882 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 41141sec preferred_lft 41141sec 2023-10-09T07:01:34.882 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2023-10-09T07:01:34.883 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:01:34.883 INFO:teuthology.orchestra.run.smithi071.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T07:01:34.883 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5a:a1:ec:c7:41:8f brd ff:ff:ff:ff:ff:ff 2023-10-09T07:01:34.883 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T07:01:34.883 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:01:34.883 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::8052:a9ff:fe85:8756/64 scope link 2023-10-09T07:01:34.883 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:01:34.883 INFO:teuthology.orchestra.run.smithi071.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T07:01:34.883 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether ae:1f:c9:59:0c:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T07:01:34.883 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ac1f:c9ff:fe59:c1b/64 scope link 2023-10-09T07:01:34.883 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:01:34.884 INFO:teuthology.orchestra.run.smithi071.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T07:01:34.884 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5a:a1:ec:c7:41:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T07:01:34.884 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::58a1:ecff:fec7:418f/64 scope link 2023-10-09T07:01:34.884 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:01:34.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:01:34.884 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T07:01:34.979 INFO:teuthology.orchestra.run.smithi071.stdout:1 2023-10-09T07:01:34.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:01:34.982 DEBUG:teuthology.orchestra.run.smithi071:> route 2023-10-09T07:01:35.020 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2023-10-09T07:01:35.020 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T07:01:35.020 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T07:01:35.020 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T07:01:35.020 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T07:01:35.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:01:35.021 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-09T07:01:35.021 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-09T07:01:35.022 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T07:01:35.022 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T07:01:35.022 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T07:01:35.022 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-09T07:01:35.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:01:35.216 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-09T07:01:35.253 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T07:01:35.253 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T07:01:35.253 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T07:01:35.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:01:35.254 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2023-10-09T07:01:35.354 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T07:01:35.354 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T07:01:35.390 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T07:01:35.390 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T07:01:35.391 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T07:01:35.466 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T07:01:35.466 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T07:01:35.466 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T07:01:35.596 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T07:01:35.596 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T07:01:35.623 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T07:01:35.624 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T07:01:35.624 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.71:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-09T07:01:35.624 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with new device syntax: 0@604c5619-653a-4ab6-912c-ab2e5464fe4a.cephfs=/ 2023-10-09T07:01:35.624 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.71:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-10-09T07:01:35.629 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T07:01:35.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:01:35.629 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T07:01:35.692 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T07:01:35.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.876+0000 7f6ebe19d700 1 Processor -- start 2023-10-09T07:01:35.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.877+0000 7f6ebe19d700 1 -- start start 2023-10-09T07:01:35.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.878+0000 7f6ebe19d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6eb815d230 0x7f6eb815d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:35.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.878+0000 7f6ebe19d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb80b2980 con 0x7f6eb8159420 2023-10-09T07:01:35.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.878+0000 7f6ebe19d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb815db70 con 0x7f6eb81597f0 2023-10-09T07:01:35.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.878+0000 7f6ebe19d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb80b11d0 con 0x7f6eb815d230 2023-10-09T07:01:35.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.878+0000 7f6ebd19b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6eb8159420 0x7f6eb80b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:38866/0 (socket says 172.21.15.71:38866) 2023-10-09T07:01:35.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.878+0000 7f6ebd19b700 1 -- 172.21.15.71:0/998547193 learned_addr learned my addr 172.21.15.71:0/998547193 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:01:35.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.878+0000 7f6ebd99c700 1 --2- 172.21.15.71:0/998547193 >> v2:172.21.15.71:3300/0 conn(0x7f6eb815d230 0x7f6eb815d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:35.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.879+0000 7f6eaffff700 1 -- 172.21.15.71:0/998547193 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000409500 0 0) 0x7f6eb80b2980 con 0x7f6eb8159420 2023-10-09T07:01:35.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.879+0000 7f6eaffff700 1 -- 172.21.15.71:0/998547193 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ea4003570 con 0x7f6eb8159420 2023-10-09T07:01:35.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.879+0000 7f6ebd99c700 1 -- 172.21.15.71:0/998547193 >> v1:172.21.15.179:6789/0 conn(0x7f6eb81597f0 legacy=0x7f6eb80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:35.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.879+0000 7f6eaffff700 1 -- 172.21.15.71:0/998547193 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2788528865 0 0) 0x7f6eb815db70 con 0x7f6eb81597f0 2023-10-09T07:01:35.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.879+0000 7f6ebd99c700 1 -- 172.21.15.71:0/998547193 >> v1:172.21.15.71:6789/0 conn(0x7f6eb8159420 legacy=0x7f6eb80b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:35.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.879+0000 7f6ebd99c700 1 -- 172.21.15.71:0/998547193 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb80b14b0 con 0x7f6eb815d230 2023-10-09T07:01:35.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.879+0000 7f6ebd99c700 1 --2- 172.21.15.71:0/998547193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6eb815d230 0x7f6eb815d630 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009e60 tx=0x7f6eb0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332bbffaade365b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:35.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.879+0000 7f6eaffff700 1 -- 172.21.15.71:0/998547193 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb000e070 con 0x7f6eb815d230 2023-10-09T07:01:35.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.880+0000 7f6eaffff700 1 -- 172.21.15.71:0/998547193 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb000bb60 con 0x7f6eb815d230 2023-10-09T07:01:35.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.880+0000 7f6eaffff700 1 -- 172.21.15.71:0/998547193 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb0012430 con 0x7f6eb815d230 2023-10-09T07:01:35.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.880+0000 7f6ebe19d700 1 -- 172.21.15.71:0/998547193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6eb815d230 msgr2=0x7f6eb815d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:35.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.880+0000 7f6ebe19d700 1 --2- 172.21.15.71:0/998547193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6eb815d230 0x7f6eb815d630 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009e60 tx=0x7f6eb0009780 comp rx=0 tx=0).stop 2023-10-09T07:01:35.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.880+0000 7f6ebe19d700 1 -- 172.21.15.71:0/998547193 shutdown_connections 2023-10-09T07:01:35.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.880+0000 7f6ebe19d700 1 --2- 172.21.15.71:0/998547193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6eb815d230 0x7f6eb815d630 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:35.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.880+0000 7f6ebe19d700 1 -- 172.21.15.71:0/998547193 >> 172.21.15.71:0/998547193 conn(0x7f6eb80d0660 msgr2=0x7f6eb80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:35.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.880+0000 7f6ebe19d700 1 -- 172.21.15.71:0/998547193 shutdown_connections 2023-10-09T07:01:35.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.880+0000 7f6ebe19d700 1 -- 172.21.15.71:0/998547193 wait complete. 2023-10-09T07:01:35.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.882+0000 7f6ebe19d700 1 Processor -- start 2023-10-09T07:01:35.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.883+0000 7f6ebe19d700 1 -- start start 2023-10-09T07:01:35.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.884+0000 7f6ebe19d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6eb8159420 0x7f6eb80b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:35.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.884+0000 7f6ebe19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb81597f0 0x7f6eb815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:35.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.884+0000 7f6ebe19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6eb815d230 0x7f6eb81548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:35.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.884+0000 7f6ebe19d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb816c770 con 0x7f6eb8159420 2023-10-09T07:01:35.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.884+0000 7f6ebe19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb816a350 con 0x7f6eb815d230 2023-10-09T07:01:35.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.884+0000 7f6ebe19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb8169760 con 0x7f6eb81597f0 2023-10-09T07:01:35.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.884+0000 7f6ebd19b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6eb8159420 0x7f6eb80b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:35.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.884+0000 7f6ebd19b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6eb8159420 0x7f6eb80b5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38584/0 (socket says 172.21.15.71:38584) 2023-10-09T07:01:35.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.884+0000 7f6ebd19b700 1 -- 172.21.15.71:0/963742567 learned_addr learned my addr 172.21.15.71:0/963742567 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:35.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.885+0000 7f6ebd99c700 1 --2- 172.21.15.71:0/963742567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6eb815d230 0x7f6eb81548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:35.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.885+0000 7f6ebc99a700 1 --2- 172.21.15.71:0/963742567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb81597f0 0x7f6eb815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:35.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.885+0000 7f6ebd19b700 1 -- 172.21.15.71:0/963742567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb81597f0 msgr2=0x7f6eb815c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:35.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.885+0000 7f6ebd19b700 1 --2- 172.21.15.71:0/963742567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb81597f0 0x7f6eb815c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:35.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.885+0000 7f6ebd19b700 1 -- 172.21.15.71:0/963742567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6eb815d230 msgr2=0x7f6eb81548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:35.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.885+0000 7f6ebd19b700 1 --2- 172.21.15.71:0/963742567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6eb815d230 0x7f6eb81548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:35.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.885+0000 7f6ebd19b700 1 -- 172.21.15.71:0/963742567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb0009a20 con 0x7f6eb8159420 2023-10-09T07:01:35.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.885+0000 7f6ebd99c700 1 --2- 172.21.15.71:0/963742567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6eb815d230 0x7f6eb81548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:01:35.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.885+0000 7f6ebd19b700 1 --2- 172.21.15.71:0/963742567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6eb8159420 0x7f6eb80b5070 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f6eb40011e0 tx=0x7f6eb4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:35.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.885+0000 7f6ead7fa700 1 -- 172.21.15.71:0/963742567 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4005b30 con 0x7f6eb8159420 2023-10-09T07:01:35.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.885+0000 7f6ead7fa700 1 -- 172.21.15.71:0/963742567 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb4005c90 con 0x7f6eb8159420 2023-10-09T07:01:35.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.885+0000 7f6ebe19d700 1 -- 172.21.15.71:0/963742567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb8169a20 con 0x7f6eb8159420 2023-10-09T07:01:35.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.885+0000 7f6ead7fa700 1 -- 172.21.15.71:0/963742567 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb40072e0 con 0x7f6eb8159420 2023-10-09T07:01:35.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.885+0000 7f6ebe19d700 1 -- 172.21.15.71:0/963742567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb8169fe0 con 0x7f6eb8159420 2023-10-09T07:01:35.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.886+0000 7f6ebe19d700 1 -- 172.21.15.71:0/963742567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb804c3c0 con 0x7f6eb8159420 2023-10-09T07:01:35.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.887+0000 7f6ead7fa700 1 -- 172.21.15.71:0/963742567 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6eb4007650 con 0x7f6eb8159420 2023-10-09T07:01:35.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.888+0000 7f6ead7fa700 1 --2- 172.21.15.71:0/963742567 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6e9c066f30 0x7f6e9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:35.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.888+0000 7f6ead7fa700 1 -- 172.21.15.71:0/963742567 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f6eb4083b80 con 0x7f6eb8159420 2023-10-09T07:01:35.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.889+0000 7f6ebc99a700 1 --2- 172.21.15.71:0/963742567 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6e9c066f30 0x7f6e9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:35.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.889+0000 7f6ebc99a700 1 --2- 172.21.15.71:0/963742567 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6e9c066f30 0x7f6e9c0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80642e0 tx=0x7f6ea8009040 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:35.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:35.892+0000 7f6ead7fa700 1 -- 172.21.15.71:0/963742567 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6eb404b5a0 con 0x7f6eb8159420 2023-10-09T07:01:36.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.111+0000 7f6ebe19d700 1 -- 172.21.15.71:0/963742567 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f6eb80b17e0 con 0x7f6e9c066f30 2023-10-09T07:01:36.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.113+0000 7f6ead7fa700 1 -- 172.21.15.71:0/963742567 <== mgr.7627 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f6eb80b17e0 con 0x7f6e9c066f30 2023-10-09T07:01:36.114 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-09T07:01:36.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:01:36.114 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cephfs" 2023-10-09T07:01:36.114 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:01:36.114 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-09T07:01:36.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.115+0000 7f6ebe19d700 1 -- 172.21.15.71:0/963742567 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6e9c066f30 msgr2=0x7f6e9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:36.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.115+0000 7f6ebe19d700 1 --2- 172.21.15.71:0/963742567 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6e9c066f30 0x7f6e9c0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80642e0 tx=0x7f6ea8009040 comp rx=0 tx=0).stop 2023-10-09T07:01:36.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.115+0000 7f6ebe19d700 1 -- 172.21.15.71:0/963742567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6eb8159420 msgr2=0x7f6eb80b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:36.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.115+0000 7f6ebe19d700 1 --2- 172.21.15.71:0/963742567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6eb8159420 0x7f6eb80b5070 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f6eb40011e0 tx=0x7f6eb4007df0 comp rx=0 tx=0).stop 2023-10-09T07:01:36.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.115+0000 7f6ebe19d700 1 -- 172.21.15.71:0/963742567 shutdown_connections 2023-10-09T07:01:36.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.115+0000 7f6ebe19d700 1 --2- 172.21.15.71:0/963742567 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6e9c066f30 0x7f6e9c0693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:36.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.115+0000 7f6ebe19d700 1 --2- 172.21.15.71:0/963742567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6eb815d230 0x7f6eb81548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:36.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.115+0000 7f6ebe19d700 1 --2- 172.21.15.71:0/963742567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6eb8159420 0x7f6eb80b5070 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:36.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.115+0000 7f6ebe19d700 1 --2- 172.21.15.71:0/963742567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6eb81597f0 0x7f6eb815c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:36.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.115+0000 7f6ebe19d700 1 -- 172.21.15.71:0/963742567 >> 172.21.15.71:0/963742567 conn(0x7f6eb80d0660 msgr2=0x7f6eb8069540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:36.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.115+0000 7f6ebe19d700 1 -- 172.21.15.71:0/963742567 shutdown_connections 2023-10-09T07:01:36.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.115+0000 7f6ebe19d700 1 -- 172.21.15.71:0/963742567 wait complete. 2023-10-09T07:01:36.135 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-09T07:01:36.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.316+0000 7f93927ff700 1 Processor -- start 2023-10-09T07:01:36.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.317+0000 7f93927ff700 1 -- start start 2023-10-09T07:01:36.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.318+0000 7f93927ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f938c155eb0 0x7f938c06e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:36.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.318+0000 7f93927ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f938c0c70b0 0x7f938c069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:36.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.318+0000 7f93927ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938c06eb90 con 0x7f938c069cb0 2023-10-09T07:01:36.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.318+0000 7f93927ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938c06a130 con 0x7f938c0c70b0 2023-10-09T07:01:36.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.318+0000 7f93927ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938c06ee70 con 0x7f938c155eb0 2023-10-09T07:01:36.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.318+0000 7f9383fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f938c0c70b0 0x7f938c069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:36.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.318+0000 7f9390d9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f938c069cb0 0x7f938c159a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:38876/0 (socket says 172.21.15.71:38876) 2023-10-09T07:01:36.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.318+0000 7f9390d9c700 1 -- 172.21.15.71:0/1914973992 learned_addr learned my addr 172.21.15.71:0/1914973992 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:01:36.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.319+0000 7f938bfff700 1 --2- 172.21.15.71:0/1914973992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f938c155eb0 0x7f938c06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:36.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.319+0000 7f9383fff700 1 -- 172.21.15.71:0/1914973992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f938c155eb0 msgr2=0x7f938c06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:36.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.319+0000 7f9383fff700 1 --2- 172.21.15.71:0/1914973992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f938c155eb0 0x7f938c06e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:36.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.319+0000 7f9383fff700 1 -- 172.21.15.71:0/1914973992 >> v1:172.21.15.71:6789/0 conn(0x7f938c069cb0 legacy=0x7f938c159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:36.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.319+0000 7f9383fff700 1 -- 172.21.15.71:0/1914973992 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c06f150 con 0x7f938c0c70b0 2023-10-09T07:01:36.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.319+0000 7f938b7fe700 1 -- 172.21.15.71:0/1914973992 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593186326 0 0) 0x7f938c06eb90 con 0x7f938c069cb0 2023-10-09T07:01:36.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.319+0000 7f9383fff700 1 --2- 172.21.15.71:0/1914973992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f938c0c70b0 0x7f938c069770 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f93740098e0 tx=0x7f93740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b9caba1c737547 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:36.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.319+0000 7f938b7fe700 1 -- 172.21.15.71:0/1914973992 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9374009e80 con 0x7f938c0c70b0 2023-10-09T07:01:36.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.319+0000 7f938b7fe700 1 -- 172.21.15.71:0/1914973992 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937400b860 con 0x7f938c0c70b0 2023-10-09T07:01:36.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.319+0000 7f938b7fe700 1 -- 172.21.15.71:0/1914973992 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937400bbe0 con 0x7f938c0c70b0 2023-10-09T07:01:36.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.320+0000 7f93927ff700 1 -- 172.21.15.71:0/1914973992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f938c0c70b0 msgr2=0x7f938c069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:36.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.320+0000 7f93927ff700 1 --2- 172.21.15.71:0/1914973992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f938c0c70b0 0x7f938c069770 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f93740098e0 tx=0x7f93740091a0 comp rx=0 tx=0).stop 2023-10-09T07:01:36.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.320+0000 7f93927ff700 1 -- 172.21.15.71:0/1914973992 shutdown_connections 2023-10-09T07:01:36.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.320+0000 7f93927ff700 1 --2- 172.21.15.71:0/1914973992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f938c155eb0 0x7f938c06e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:36.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.320+0000 7f93927ff700 1 --2- 172.21.15.71:0/1914973992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f938c0c70b0 0x7f938c069770 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:36.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.320+0000 7f93927ff700 1 -- 172.21.15.71:0/1914973992 >> 172.21.15.71:0/1914973992 conn(0x7f938c068e10 msgr2=0x7f938c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:36.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.320+0000 7f93927ff700 1 -- 172.21.15.71:0/1914973992 shutdown_connections 2023-10-09T07:01:36.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.320+0000 7f93927ff700 1 -- 172.21.15.71:0/1914973992 wait complete. 2023-10-09T07:01:36.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.321+0000 7f93927ff700 1 Processor -- start 2023-10-09T07:01:36.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.322+0000 7f93927ff700 1 -- start start 2023-10-09T07:01:36.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.322+0000 7f93927ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f938c069cb0 0x7f938c148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:36.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.322+0000 7f93927ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f938c0c70b0 0x7f938c0c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:36.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.322+0000 7f93927ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f938c155eb0 0x7f938c0c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:36.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.322+0000 7f93927ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c0b0060 con 0x7f938c155eb0 2023-10-09T07:01:36.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.322+0000 7f93927ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c0c5800 con 0x7f938c0c70b0 2023-10-09T07:01:36.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.322+0000 7f93927ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938c0af450 con 0x7f938c069cb0 2023-10-09T07:01:36.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.323+0000 7f9390d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f938c155eb0 0x7f938c0c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:36.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.323+0000 7f9390d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f938c155eb0 0x7f938c0c52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38604/0 (socket says 172.21.15.71:38604) 2023-10-09T07:01:36.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.323+0000 7f9390d9c700 1 -- 172.21.15.71:0/3525726784 learned_addr learned my addr 172.21.15.71:0/3525726784 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:36.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.323+0000 7f9383fff700 1 --2- 172.21.15.71:0/3525726784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f938c0c70b0 0x7f938c0c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:36.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.323+0000 7f938bfff700 1 --2- 172.21.15.71:0/3525726784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f938c069cb0 0x7f938c148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:36.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.323+0000 7f9390d9c700 1 -- 172.21.15.71:0/3525726784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f938c069cb0 msgr2=0x7f938c148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:36.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.323+0000 7f9390d9c700 1 --2- 172.21.15.71:0/3525726784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f938c069cb0 0x7f938c148210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:36.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.323+0000 7f9390d9c700 1 -- 172.21.15.71:0/3525726784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f938c0c70b0 msgr2=0x7f938c0c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:36.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.323+0000 7f9390d9c700 1 --2- 172.21.15.71:0/3525726784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f938c0c70b0 0x7f938c0c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:36.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.323+0000 7f9390d9c700 1 -- 172.21.15.71:0/3525726784 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9374009420 con 0x7f938c155eb0 2023-10-09T07:01:36.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.323+0000 7f9383fff700 1 --2- 172.21.15.71:0/3525726784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f938c0c70b0 0x7f938c0c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:01:36.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.323+0000 7f9390d9c700 1 --2- 172.21.15.71:0/3525726784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f938c155eb0 0x7f938c0c52c0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f938400cc90 tx=0x7f9384001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:36.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.323+0000 7f9388ff9700 1 -- 172.21.15.71:0/3525726784 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938400cea0 con 0x7f938c155eb0 2023-10-09T07:01:36.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.324+0000 7f9388ff9700 1 -- 172.21.15.71:0/3525726784 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938400ab70 con 0x7f938c155eb0 2023-10-09T07:01:36.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.324+0000 7f93927ff700 1 -- 172.21.15.71:0/3525726784 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938c0af730 con 0x7f938c155eb0 2023-10-09T07:01:36.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.324+0000 7f9388ff9700 1 -- 172.21.15.71:0/3525726784 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93840070f0 con 0x7f938c155eb0 2023-10-09T07:01:36.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.324+0000 7f93927ff700 1 -- 172.21.15.71:0/3525726784 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938c0afcf0 con 0x7f938c155eb0 2023-10-09T07:01:36.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.325+0000 7f93927ff700 1 -- 172.21.15.71:0/3525726784 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938c0b01d0 con 0x7f938c155eb0 2023-10-09T07:01:36.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.325+0000 7f9388ff9700 1 -- 172.21.15.71:0/3525726784 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 58) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f93840074a0 con 0x7f938c155eb0 2023-10-09T07:01:36.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.326+0000 7f9388ff9700 1 --2- 172.21.15.71:0/3525726784 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f936c066f30 0x7f936c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:36.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.327+0000 7f9388ff9700 1 -- 172.21.15.71:0/3525726784 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f9384084bf0 con 0x7f938c155eb0 2023-10-09T07:01:36.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.327+0000 7f938bfff700 1 --2- 172.21.15.71:0/3525726784 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f936c066f30 0x7f936c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:36.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.328+0000 7f938bfff700 1 --2- 172.21.15.71:0/3525726784 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f936c066f30 0x7f936c0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f937c006fd0 tx=0x7f937c008040 comp rx=0 tx=0).ready entity=mgr.7627 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:36.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.330+0000 7f9388ff9700 1 -- 172.21.15.71:0/3525726784 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9384051ca0 con 0x7f938c155eb0 2023-10-09T07:01:36.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.576+0000 7f93927ff700 1 -- 172.21.15.71:0/3525726784 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f938c04c3c0 con 0x7f938c155eb0 2023-10-09T07:01:36.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.842+0000 7f9388ff9700 1 -- 172.21.15.71:0/3525726784 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 59) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f9384052070 con 0x7f938c155eb0 2023-10-09T07:01:36.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.843+0000 7f9388ff9700 1 -- 172.21.15.71:0/3525726784 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v59) v1 ==== 92+0+0 (secure 0 0 0) 0x7f9384051ca0 con 0x7f938c155eb0 2023-10-09T07:01:36.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.845+0000 7f93927ff700 1 -- 172.21.15.71:0/3525726784 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f936c066f30 msgr2=0x7f936c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:36.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.845+0000 7f93927ff700 1 --2- 172.21.15.71:0/3525726784 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f936c066f30 0x7f936c0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f937c006fd0 tx=0x7f937c008040 comp rx=0 tx=0).stop 2023-10-09T07:01:36.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.845+0000 7f93927ff700 1 -- 172.21.15.71:0/3525726784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f938c155eb0 msgr2=0x7f938c0c52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:36.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.845+0000 7f93927ff700 1 --2- 172.21.15.71:0/3525726784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f938c155eb0 0x7f938c0c52c0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f938400cc90 tx=0x7f9384001a80 comp rx=0 tx=0).stop 2023-10-09T07:01:36.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.846+0000 7f93927ff700 1 -- 172.21.15.71:0/3525726784 shutdown_connections 2023-10-09T07:01:36.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.846+0000 7f93927ff700 1 --2- 172.21.15.71:0/3525726784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f938c155eb0 0x7f938c0c52c0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:36.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.846+0000 7f93927ff700 1 --2- 172.21.15.71:0/3525726784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f938c069cb0 0x7f938c148210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:36.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.846+0000 7f93927ff700 1 --2- 172.21.15.71:0/3525726784 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f936c066f30 0x7f936c0693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:36.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.846+0000 7f93927ff700 1 --2- 172.21.15.71:0/3525726784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f938c0c70b0 0x7f938c0c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:36.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.846+0000 7f93927ff700 1 -- 172.21.15.71:0/3525726784 >> 172.21.15.71:0/3525726784 conn(0x7f938c068e10 msgr2=0x7f938c14cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:36.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.846+0000 7f93927ff700 1 -- 172.21.15.71:0/3525726784 shutdown_connections 2023-10-09T07:01:36.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:36.846+0000 7f93927ff700 1 -- 172.21.15.71:0/3525726784 wait complete. 2023-10-09T07:01:36.866 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-09T07:01:37.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.056+0000 7f61c599d700 1 Processor -- start 2023-10-09T07:01:37.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.057+0000 7f61c599d700 1 -- start start 2023-10-09T07:01:37.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.058+0000 7f61c599d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61c00ccc00 0x7f61c0069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:37.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.058+0000 7f61c599d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f61c006a020 0x7f61c00cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:37.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.058+0000 7f61c599d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c00c9f30 con 0x7f61c0159a60 2023-10-09T07:01:37.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.058+0000 7f61c599d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c006dfc0 con 0x7f61c006a020 2023-10-09T07:01:37.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.058+0000 7f61c599d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c00ca470 con 0x7f61c00ccc00 2023-10-09T07:01:37.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.058+0000 7f61c519c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f61c006a020 0x7f61c00cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:37.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.058+0000 7f61bffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61c00ccc00 0x7f61c0069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:37.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.058+0000 7f61c499b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f61c0159a60 0x7f61c00c9770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:55366/0 (socket says 172.21.15.71:55366) 2023-10-09T07:01:37.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.058+0000 7f61c499b700 1 -- 172.21.15.71:0/2331689365 learned_addr learned my addr 172.21.15.71:0/2331689365 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:01:37.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.059+0000 7f61bf7fe700 1 -- 172.21.15.71:0/2331689365 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456186001 0 0) 0x7f61c00c9f30 con 0x7f61c0159a60 2023-10-09T07:01:37.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.059+0000 7f61bf7fe700 1 -- 172.21.15.71:0/2331689365 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61b0003570 con 0x7f61c0159a60 2023-10-09T07:01:37.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.059+0000 7f61c519c700 1 -- 172.21.15.71:0/2331689365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61c00ccc00 msgr2=0x7f61c0069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:37.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.059+0000 7f61c519c700 1 --2- 172.21.15.71:0/2331689365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61c00ccc00 0x7f61c0069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:37.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.059+0000 7f61c519c700 1 -- 172.21.15.71:0/2331689365 >> v1:172.21.15.179:6789/0 conn(0x7f61c0159a60 legacy=0x7f61c00c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:37.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.059+0000 7f61c519c700 1 -- 172.21.15.71:0/2331689365 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c00ca750 con 0x7f61c006a020 2023-10-09T07:01:37.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.059+0000 7f61bffff700 1 --2- 172.21.15.71:0/2331689365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61c00ccc00 0x7f61c0069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:01:37.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.059+0000 7f61c519c700 1 --2- 172.21.15.71:0/2331689365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61c006a020 0x7f61c00cb230 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f61b8009e60 tx=0x7f61b8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6498c8234295728c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:37.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.059+0000 7f61bf7fe700 1 -- 172.21.15.71:0/2331689365 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b800e070 con 0x7f61c006a020 2023-10-09T07:01:37.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.059+0000 7f61bf7fe700 1 -- 172.21.15.71:0/2331689365 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b800bb40 con 0x7f61c006a020 2023-10-09T07:01:37.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.059+0000 7f61bf7fe700 1 -- 172.21.15.71:0/2331689365 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8012430 con 0x7f61c006a020 2023-10-09T07:01:37.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.060+0000 7f61c599d700 1 -- 172.21.15.71:0/2331689365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61c006a020 msgr2=0x7f61c00cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:37.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.060+0000 7f61c599d700 1 --2- 172.21.15.71:0/2331689365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61c006a020 0x7f61c00cb230 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f61b8009e60 tx=0x7f61b8009780 comp rx=0 tx=0).stop 2023-10-09T07:01:37.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.060+0000 7f61c599d700 1 -- 172.21.15.71:0/2331689365 shutdown_connections 2023-10-09T07:01:37.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.060+0000 7f61c599d700 1 --2- 172.21.15.71:0/2331689365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61c006a020 0x7f61c00cb230 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:37.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.060+0000 7f61c599d700 1 --2- 172.21.15.71:0/2331689365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61c00ccc00 0x7f61c0069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:37.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.060+0000 7f61c599d700 1 -- 172.21.15.71:0/2331689365 >> 172.21.15.71:0/2331689365 conn(0x7f61c006baa0 msgr2=0x7f61c006bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:37.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.060+0000 7f61c599d700 1 -- 172.21.15.71:0/2331689365 shutdown_connections 2023-10-09T07:01:37.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.060+0000 7f61c599d700 1 -- 172.21.15.71:0/2331689365 wait complete. 2023-10-09T07:01:37.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.061+0000 7f61c599d700 1 Processor -- start 2023-10-09T07:01:37.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.062+0000 7f61c599d700 1 -- start start 2023-10-09T07:01:37.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.062+0000 7f61c599d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61c006a020 0x7f61c0151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:37.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.062+0000 7f61c599d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61c00ccc00 0x7f61c00c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:37.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.063+0000 7f61c599d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61c0159a60 0x7f61c014c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:37.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.063+0000 7f61c599d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c00b2890 con 0x7f61c0159a60 2023-10-09T07:01:37.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.063+0000 7f61c599d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c00c89f0 con 0x7f61c006a020 2023-10-09T07:01:37.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.063+0000 7f61c599d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c00c8710 con 0x7f61c00ccc00 2023-10-09T07:01:37.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.063+0000 7f61c519c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61c0159a60 0x7f61c014c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:37.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.063+0000 7f61c519c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61c0159a60 0x7f61c014c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38626/0 (socket says 172.21.15.71:38626) 2023-10-09T07:01:37.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.063+0000 7f61c519c700 1 -- 172.21.15.71:0/3227402788 learned_addr learned my addr 172.21.15.71:0/3227402788 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:37.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.063+0000 7f61c499b700 1 --2- 172.21.15.71:0/3227402788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61c006a020 0x7f61c0151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:37.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.063+0000 7f61bffff700 1 --2- 172.21.15.71:0/3227402788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61c00ccc00 0x7f61c00c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:37.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.063+0000 7f61c519c700 1 -- 172.21.15.71:0/3227402788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61c00ccc00 msgr2=0x7f61c00c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:37.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.063+0000 7f61c519c700 1 --2- 172.21.15.71:0/3227402788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61c00ccc00 0x7f61c00c7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:37.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.063+0000 7f61c519c700 1 -- 172.21.15.71:0/3227402788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61c006a020 msgr2=0x7f61c0151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:37.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.063+0000 7f61c519c700 1 --2- 172.21.15.71:0/3227402788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61c006a020 0x7f61c0151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:37.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.063+0000 7f61c519c700 1 -- 172.21.15.71:0/3227402788 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac009420 con 0x7f61c0159a60 2023-10-09T07:01:37.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.063+0000 7f61c499b700 1 --2- 172.21.15.71:0/3227402788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61c006a020 0x7f61c0151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:01:37.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.064+0000 7f61c519c700 1 --2- 172.21.15.71:0/3227402788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61c0159a60 0x7f61c014c220 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f61c006cdc0 tx=0x7f61b8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:37.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.064+0000 7f61bcff9700 1 -- 172.21.15.71:0/3227402788 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8012ea0 con 0x7f61c0159a60 2023-10-09T07:01:37.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.064+0000 7f61bcff9700 1 -- 172.21.15.71:0/3227402788 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b8027470 con 0x7f61c0159a60 2023-10-09T07:01:37.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.064+0000 7f61c599d700 1 -- 172.21.15.71:0/3227402788 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b8009a20 con 0x7f61c0159a60 2023-10-09T07:01:37.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.064+0000 7f61bcff9700 1 -- 172.21.15.71:0/3227402788 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8027850 con 0x7f61c0159a60 2023-10-09T07:01:37.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.064+0000 7f61c599d700 1 -- 172.21.15.71:0/3227402788 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c00b2520 con 0x7f61c0159a60 2023-10-09T07:01:37.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.065+0000 7f61c599d700 1 -- 172.21.15.71:0/3227402788 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c006eba0 con 0x7f61c0159a60 2023-10-09T07:01:37.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.066+0000 7f61bcff9700 1 -- 172.21.15.71:0/3227402788 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 59) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f61b8024070 con 0x7f61c0159a60 2023-10-09T07:01:37.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.067+0000 7f61bcff9700 1 --2- 172.21.15.71:0/3227402788 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f61a4066f80 0x7f61a4069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:37.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.067+0000 7f61bcff9700 1 -- 172.21.15.71:0/3227402788 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f61b8087210 con 0x7f61c0159a60 2023-10-09T07:01:37.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.067+0000 7f61c499b700 1 -- 172.21.15.71:0/3227402788 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f61a4066f80 msgr2=0x7f61a4069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:37.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.067+0000 7f61c499b700 1 --2- 172.21.15.71:0/3227402788 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f61a4066f80 0x7f61a4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:01:37.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.075+0000 7f61bcff9700 1 -- 172.21.15.71:0/3227402788 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61b80542e0 con 0x7f61c0159a60 2023-10-09T07:01:37.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.268+0000 7f61c499b700 1 -- 172.21.15.71:0/3227402788 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f61a4066f80 msgr2=0x7f61a4069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:37.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.268+0000 7f61c499b700 1 --2- 172.21.15.71:0/3227402788 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f61a4066f80 0x7f61a4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:01:37.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.274+0000 7f61c599d700 1 -- 172.21.15.71:0/3227402788 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f61c00caa30 con 0x7f61c0159a60 2023-10-09T07:01:37.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.278+0000 7f61bcff9700 1 -- 172.21.15.71:0/3227402788 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v47)=0 v47) v1 ==== 138+0+0 (secure 0 0 0) 0x7f61b8057900 con 0x7f61c0159a60 2023-10-09T07:01:37.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.281+0000 7f61c599d700 1 -- 172.21.15.71:0/3227402788 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f61a4066f80 msgr2=0x7f61a4069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:01:37.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.281+0000 7f61c599d700 1 --2- 172.21.15.71:0/3227402788 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f61a4066f80 0x7f61a4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:37.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.281+0000 7f61c599d700 1 -- 172.21.15.71:0/3227402788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61c0159a60 msgr2=0x7f61c014c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:37.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.281+0000 7f61c599d700 1 --2- 172.21.15.71:0/3227402788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61c0159a60 0x7f61c014c220 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f61c006cdc0 tx=0x7f61b8019000 comp rx=0 tx=0).stop 2023-10-09T07:01:37.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.281+0000 7f61c599d700 1 -- 172.21.15.71:0/3227402788 shutdown_connections 2023-10-09T07:01:37.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.281+0000 7f61c599d700 1 --2- 172.21.15.71:0/3227402788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61c0159a60 0x7f61c014c220 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:37.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.281+0000 7f61c599d700 1 --2- 172.21.15.71:0/3227402788 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f61a4066f80 0x7f61a4069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:37.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.281+0000 7f61c599d700 1 --2- 172.21.15.71:0/3227402788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61c006a020 0x7f61c0151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:37.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.281+0000 7f61c599d700 1 --2- 172.21.15.71:0/3227402788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61c00ccc00 0x7f61c00c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:37.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.281+0000 7f61c599d700 1 -- 172.21.15.71:0/3227402788 >> 172.21.15.71:0/3227402788 conn(0x7f61c006baa0 msgr2=0x7f61c006ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:37.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.281+0000 7f61c599d700 1 -- 172.21.15.71:0/3227402788 shutdown_connections 2023-10-09T07:01:37.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.281+0000 7f61c599d700 1 -- 172.21.15.71:0/3227402788 wait complete. 2023-10-09T07:01:37.336 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-09T07:01:37.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.526+0000 7fe2e179d700 1 Processor -- start 2023-10-09T07:01:37.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.526+0000 7fe2e179d700 1 -- start start 2023-10-09T07:01:37.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.527+0000 7fe2e179d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2dc159a60 0x7fe2dc0c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:37.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.527+0000 7fe2e179d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2dc0c9cb0 con 0x7fe2dc0cb230 2023-10-09T07:01:37.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.527+0000 7fe2e179d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2dc0c9f30 con 0x7fe2dc0ccc00 2023-10-09T07:01:37.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.527+0000 7fe2e179d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc06dfc0 con 0x7fe2dc159a60 2023-10-09T07:01:37.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.528+0000 7fe2e0f9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe2dc0cb230 0x7fe2dc06d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:38886/0 (socket says 172.21.15.71:38886) 2023-10-09T07:01:37.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.528+0000 7fe2e0f9c700 1 -- 172.21.15.71:0/2523630748 learned_addr learned my addr 172.21.15.71:0/2523630748 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:01:37.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.528+0000 7fe2dbfff700 1 --2- 172.21.15.71:0/2523630748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2dc159a60 0x7fe2dc0c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.528+0000 7fe2daffd700 1 -- 172.21.15.71:0/2523630748 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814264753 0 0) 0x7fe2dc0c9f30 con 0x7fe2dc0ccc00 2023-10-09T07:01:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.528+0000 7fe2daffd700 1 -- 172.21.15.71:0/2523630748 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2c4003570 con 0x7fe2dc0ccc00 2023-10-09T07:01:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.528+0000 7fe2daffd700 1 -- 172.21.15.71:0/2523630748 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 945250159 0 0) 0x7fe2dc0c9cb0 con 0x7fe2dc0cb230 2023-10-09T07:01:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.528+0000 7fe2daffd700 1 -- 172.21.15.71:0/2523630748 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2dc0c9f30 con 0x7fe2dc0cb230 2023-10-09T07:01:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.528+0000 7fe2dbfff700 1 -- 172.21.15.71:0/2523630748 >> v1:172.21.15.179:6789/0 conn(0x7fe2dc0ccc00 legacy=0x7fe2dc069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.528+0000 7fe2dbfff700 1 -- 172.21.15.71:0/2523630748 >> v1:172.21.15.71:6789/0 conn(0x7fe2dc0cb230 legacy=0x7fe2dc06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.528+0000 7fe2dbfff700 1 -- 172.21.15.71:0/2523630748 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc0ca470 con 0x7fe2dc159a60 2023-10-09T07:01:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.528+0000 7fe2dbfff700 1 --2- 172.21.15.71:0/2523630748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2dc159a60 0x7fe2dc0c9770 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009910 tx=0x7fe2cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=536020d24a985c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.529+0000 7fe2daffd700 1 -- 172.21.15.71:0/2523630748 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc00b690 con 0x7fe2dc159a60 2023-10-09T07:01:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.529+0000 7fe2daffd700 1 -- 172.21.15.71:0/2523630748 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc00b7f0 con 0x7fe2dc159a60 2023-10-09T07:01:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.529+0000 7fe2daffd700 1 -- 172.21.15.71:0/2523630748 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc00bb90 con 0x7fe2dc159a60 2023-10-09T07:01:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.529+0000 7fe2e179d700 1 -- 172.21.15.71:0/2523630748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2dc159a60 msgr2=0x7fe2dc0c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.529+0000 7fe2e179d700 1 --2- 172.21.15.71:0/2523630748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2dc159a60 0x7fe2dc0c9770 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009910 tx=0x7fe2cc0091a0 comp rx=0 tx=0).stop 2023-10-09T07:01:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.529+0000 7fe2e179d700 1 -- 172.21.15.71:0/2523630748 shutdown_connections 2023-10-09T07:01:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.529+0000 7fe2e179d700 1 --2- 172.21.15.71:0/2523630748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2dc159a60 0x7fe2dc0c9770 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.529+0000 7fe2e179d700 1 -- 172.21.15.71:0/2523630748 >> 172.21.15.71:0/2523630748 conn(0x7fe2dc06baa0 msgr2=0x7fe2dc06bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.529+0000 7fe2e179d700 1 -- 172.21.15.71:0/2523630748 shutdown_connections 2023-10-09T07:01:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.529+0000 7fe2e179d700 1 -- 172.21.15.71:0/2523630748 wait complete. 2023-10-09T07:01:37.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.531+0000 7fe2e179d700 1 Processor -- start 2023-10-09T07:01:37.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.531+0000 7fe2e179d700 1 -- start start 2023-10-09T07:01:37.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.532+0000 7fe2e179d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2dc0cb230 0x7fe2dc150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:37.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.532+0000 7fe2e179d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2dc0ccc00 0x7fe2dc0c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:37.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.532+0000 7fe2e179d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2dc159a60 0x7fe2dc156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:37.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.532+0000 7fe2e179d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc16a010 con 0x7fe2dc0cb230 2023-10-09T07:01:37.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.532+0000 7fe2e179d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc151090 con 0x7fe2dc159a60 2023-10-09T07:01:37.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.532+0000 7fe2e179d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc0c8820 con 0x7fe2dc0ccc00 2023-10-09T07:01:37.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.532+0000 7fe2dbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2dc0cb230 0x7fe2dc150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:37.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.532+0000 7fe2dbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2dc0cb230 0x7fe2dc150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38640/0 (socket says 172.21.15.71:38640) 2023-10-09T07:01:37.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.532+0000 7fe2dbfff700 1 -- 172.21.15.71:0/2383176151 learned_addr learned my addr 172.21.15.71:0/2383176151 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:37.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.532+0000 7fe2db7fe700 1 --2- 172.21.15.71:0/2383176151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2dc0ccc00 0x7fe2dc0c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:37.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.532+0000 7fe2e0f9c700 1 --2- 172.21.15.71:0/2383176151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2dc159a60 0x7fe2dc156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:37.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.532+0000 7fe2dbfff700 1 -- 172.21.15.71:0/2383176151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2dc0ccc00 msgr2=0x7fe2dc0c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:37.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.532+0000 7fe2dbfff700 1 --2- 172.21.15.71:0/2383176151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2dc0ccc00 0x7fe2dc0c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.532+0000 7fe2dbfff700 1 -- 172.21.15.71:0/2383176151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2dc159a60 msgr2=0x7fe2dc156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.532+0000 7fe2dbfff700 1 --2- 172.21.15.71:0/2383176151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2dc159a60 0x7fe2dc156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.532+0000 7fe2dbfff700 1 -- 172.21.15.71:0/2383176151 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc009420 con 0x7fe2dc0cb230 2023-10-09T07:01:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.532+0000 7fe2db7fe700 1 --2- 172.21.15.71:0/2383176151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2dc0ccc00 0x7fe2dc0c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:01:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.532+0000 7fe2e0f9c700 1 --2- 172.21.15.71:0/2383176151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2dc159a60 0x7fe2dc156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:01:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.533+0000 7fe2dbfff700 1 --2- 172.21.15.71:0/2383176151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2dc0cb230 0x7fe2dc150b50 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc06cdc0 tx=0x7fe2cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.533+0000 7fe2c3fff700 1 -- 172.21.15.71:0/2383176151 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc01f070 con 0x7fe2dc0cb230 2023-10-09T07:01:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.533+0000 7fe2c3fff700 1 -- 172.21.15.71:0/2383176151 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc000bc0 con 0x7fe2dc0cb230 2023-10-09T07:01:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.533+0000 7fe2c3fff700 1 -- 172.21.15.71:0/2383176151 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc025420 con 0x7fe2dc0cb230 2023-10-09T07:01:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.533+0000 7fe2e179d700 1 -- 172.21.15.71:0/2383176151 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2dc16a250 con 0x7fe2dc0cb230 2023-10-09T07:01:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.533+0000 7fe2e179d700 1 -- 172.21.15.71:0/2383176151 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2dc16a810 con 0x7fe2dc0cb230 2023-10-09T07:01:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.534+0000 7fe2e179d700 1 -- 172.21.15.71:0/2383176151 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2dc16aa00 con 0x7fe2dc0cb230 2023-10-09T07:01:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.535+0000 7fe2c3fff700 1 -- 172.21.15.71:0/2383176151 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 59) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fe2cc023070 con 0x7fe2dc0cb230 2023-10-09T07:01:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.536+0000 7fe2c3fff700 1 --2- 172.21.15.71:0/2383176151 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe2c8066f80 0x7fe2c8069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.536+0000 7fe2c3fff700 1 -- 172.21.15.71:0/2383176151 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6125+0+0 (secure 0 0 0) 0x7fe2cc085b00 con 0x7fe2dc0cb230 2023-10-09T07:01:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.536+0000 7fe2db7fe700 1 -- 172.21.15.71:0/2383176151 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe2c8066f80 msgr2=0x7fe2c8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.536+0000 7fe2db7fe700 1 --2- 172.21.15.71:0/2383176151 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe2c8066f80 0x7fe2c8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:01:37.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.540+0000 7fe2c3fff700 1 -- 172.21.15.71:0/2383176151 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2cc052bd0 con 0x7fe2dc0cb230 2023-10-09T07:01:37.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.737+0000 7fe2db7fe700 1 -- 172.21.15.71:0/2383176151 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe2c8066f80 msgr2=0x7fe2c8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:37.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.737+0000 7fe2db7fe700 1 --2- 172.21.15.71:0/2383176151 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe2c8066f80 0x7fe2c8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:01:37.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.738+0000 7fe2e179d700 1 -- 172.21.15.71:0/2383176151 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fe2dc0ca750 con 0x7fe2dc0cb230 2023-10-09T07:01:37.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.742+0000 7fe2c3fff700 1 -- 172.21.15.71:0/2383176151 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v48)=0 v48) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe2cc0150c0 con 0x7fe2dc0cb230 2023-10-09T07:01:37.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.744+0000 7fe2e179d700 1 -- 172.21.15.71:0/2383176151 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe2c8066f80 msgr2=0x7fe2c8069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:01:37.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.744+0000 7fe2e179d700 1 --2- 172.21.15.71:0/2383176151 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe2c8066f80 0x7fe2c8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:37.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.744+0000 7fe2e179d700 1 -- 172.21.15.71:0/2383176151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2dc0cb230 msgr2=0x7fe2dc150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:37.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.744+0000 7fe2e179d700 1 --2- 172.21.15.71:0/2383176151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2dc0cb230 0x7fe2dc150b50 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc06cdc0 tx=0x7fe2cc017000 comp rx=0 tx=0).stop 2023-10-09T07:01:37.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.745+0000 7fe2e179d700 1 -- 172.21.15.71:0/2383176151 shutdown_connections 2023-10-09T07:01:37.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.745+0000 7fe2e179d700 1 --2- 172.21.15.71:0/2383176151 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe2c8066f80 0x7fe2c8069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:37.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.745+0000 7fe2e179d700 1 --2- 172.21.15.71:0/2383176151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2dc159a60 0x7fe2dc156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:37.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.745+0000 7fe2e179d700 1 --2- 172.21.15.71:0/2383176151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2dc0cb230 0x7fe2dc150b50 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:37.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.745+0000 7fe2e179d700 1 --2- 172.21.15.71:0/2383176151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2dc0ccc00 0x7fe2dc0c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:37.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.745+0000 7fe2e179d700 1 -- 172.21.15.71:0/2383176151 >> 172.21.15.71:0/2383176151 conn(0x7fe2dc06baa0 msgr2=0x7fe2dc06a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:37.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.745+0000 7fe2e179d700 1 -- 172.21.15.71:0/2383176151 shutdown_connections 2023-10-09T07:01:37.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:37.745+0000 7fe2e179d700 1 -- 172.21.15.71:0/2383176151 wait complete. 2023-10-09T07:01:37.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:01:37.764 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-09T07:01:37.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1 1M 2023-10-09T07:01:38.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.035+0000 7f1236b9d700 1 Processor -- start 2023-10-09T07:01:38.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.035+0000 7f1236b9d700 1 -- start start 2023-10-09T07:01:38.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.036+0000 7f1236b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f12300b0790 0x7f12300cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:38.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.036+0000 7f1236b9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12300cfa00 con 0x7f12301591e0 2023-10-09T07:01:38.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.036+0000 7f1236b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12300cb580 con 0x7f12300b03c0 2023-10-09T07:01:38.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.036+0000 7f1236b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12300cf160 con 0x7f12300b0790 2023-10-09T07:01:38.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.037+0000 7f123639c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f12301591e0 0x7f1230159600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:38892/0 (socket says 172.21.15.71:38892) 2023-10-09T07:01:38.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.037+0000 7f123639c700 1 -- 172.21.15.71:0/3823258394 learned_addr learned my addr 172.21.15.71:0/3823258394 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:01:38.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.037+0000 7f123539a700 1 --2- 172.21.15.71:0/3823258394 >> v2:172.21.15.179:3300/0 conn(0x7f12300b0790 0x7f12300cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:38.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.037+0000 7f1234b99700 1 -- 172.21.15.71:0/3823258394 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562720923 0 0) 0x7f12300cfa00 con 0x7f12301591e0 2023-10-09T07:01:38.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.037+0000 7f1234b99700 1 -- 172.21.15.71:0/3823258394 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f121c003570 con 0x7f12301591e0 2023-10-09T07:01:38.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.037+0000 7f1234b99700 1 -- 172.21.15.71:0/3823258394 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519139663 0 0) 0x7f12300cb580 con 0x7f12300b03c0 2023-10-09T07:01:38.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.037+0000 7f1234b99700 1 -- 172.21.15.71:0/3823258394 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12300cfa00 con 0x7f12300b03c0 2023-10-09T07:01:38.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.037+0000 7f123539a700 1 -- 172.21.15.71:0/3823258394 >> v1:172.21.15.179:6789/0 conn(0x7f12300b03c0 legacy=0x7f12300b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:38.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.037+0000 7f123539a700 1 -- 172.21.15.71:0/3823258394 >> v1:172.21.15.71:6789/0 conn(0x7f12301591e0 legacy=0x7f1230159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:38.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.037+0000 7f123539a700 1 -- 172.21.15.71:0/3823258394 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12300cf440 con 0x7f12300b0790 2023-10-09T07:01:38.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.038+0000 7f123539a700 1 --2- 172.21.15.71:0/3823258394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12300b0790 0x7f12300cea70 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1220009910 tx=0x7f12200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38b7843b4db7692d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:38.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.038+0000 7f1234b99700 1 -- 172.21.15.71:0/3823258394 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1220011630 con 0x7f12300b0790 2023-10-09T07:01:38.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.038+0000 7f1234b99700 1 -- 172.21.15.71:0/3823258394 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1220011790 con 0x7f12300b0790 2023-10-09T07:01:38.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.038+0000 7f1234b99700 1 -- 172.21.15.71:0/3823258394 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1220011b10 con 0x7f12300b0790 2023-10-09T07:01:38.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.039+0000 7f1236b9d700 1 -- 172.21.15.71:0/3823258394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12300b0790 msgr2=0x7f12300cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:38.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.039+0000 7f1236b9d700 1 --2- 172.21.15.71:0/3823258394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12300b0790 0x7f12300cea70 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1220009910 tx=0x7f12200091a0 comp rx=0 tx=0).stop 2023-10-09T07:01:38.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.039+0000 7f1236b9d700 1 -- 172.21.15.71:0/3823258394 shutdown_connections 2023-10-09T07:01:38.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.039+0000 7f1236b9d700 1 --2- 172.21.15.71:0/3823258394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12300b0790 0x7f12300cea70 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:38.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.039+0000 7f1236b9d700 1 -- 172.21.15.71:0/3823258394 >> 172.21.15.71:0/3823258394 conn(0x7f1230063230 msgr2=0x7f1230063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:38.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.039+0000 7f1236b9d700 1 -- 172.21.15.71:0/3823258394 shutdown_connections 2023-10-09T07:01:38.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.039+0000 7f1236b9d700 1 -- 172.21.15.71:0/3823258394 wait complete. 2023-10-09T07:01:38.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.040+0000 7f1236b9d700 1 Processor -- start 2023-10-09T07:01:38.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.040+0000 7f1236b9d700 1 -- start start 2023-10-09T07:01:38.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.041+0000 7f1236b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12300b03c0 0x7f123015a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:38.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.041+0000 7f1236b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12300b0790 0x7f123016da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:38.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.041+0000 7f1236b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12301591e0 0x7f1230157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:38.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.041+0000 7f1236b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123016dfa0 con 0x7f12301591e0 2023-10-09T07:01:38.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.041+0000 7f1236b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1230158280 con 0x7f12300b0790 2023-10-09T07:01:38.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.041+0000 7f1236b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123015b380 con 0x7f12300b03c0 2023-10-09T07:01:38.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.041+0000 7f123639c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12301591e0 0x7f1230157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:38.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.042+0000 7f123639c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12301591e0 0x7f1230157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38654/0 (socket says 172.21.15.71:38654) 2023-10-09T07:01:38.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.042+0000 7f123639c700 1 -- 172.21.15.71:0/2934363170 learned_addr learned my addr 172.21.15.71:0/2934363170 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:38.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.041+0000 7f1235b9b700 1 --2- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12300b03c0 0x7f123015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:38.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.042+0000 7f123539a700 1 --2- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12300b0790 0x7f123016da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:38.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.042+0000 7f123639c700 1 -- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12300b03c0 msgr2=0x7f123015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:38.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.042+0000 7f123639c700 1 --2- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12300b03c0 0x7f123015a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:38.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.042+0000 7f123639c700 1 -- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12300b0790 msgr2=0x7f123016da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:38.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.042+0000 7f123639c700 1 --2- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12300b0790 0x7f123016da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:38.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.042+0000 7f123639c700 1 -- 172.21.15.71:0/2934363170 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1220009420 con 0x7f12301591e0 2023-10-09T07:01:38.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.042+0000 7f123639c700 1 --2- 172.21.15.71:0/2934363170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12301591e0 0x7f1230157d40 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f122800cbf0 tx=0x7f1228001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:38.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.042+0000 7f1225ffb700 1 -- 172.21.15.71:0/2934363170 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122800a870 con 0x7f12301591e0 2023-10-09T07:01:38.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.042+0000 7f1225ffb700 1 -- 172.21.15.71:0/2934363170 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122800a9d0 con 0x7f12301591e0 2023-10-09T07:01:38.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.042+0000 7f1236b9d700 1 -- 172.21.15.71:0/2934363170 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123015aae0 con 0x7f12301591e0 2023-10-09T07:01:38.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.042+0000 7f1225ffb700 1 -- 172.21.15.71:0/2934363170 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122800ad90 con 0x7f12301591e0 2023-10-09T07:01:38.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.043+0000 7f1236b9d700 1 -- 172.21.15.71:0/2934363170 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123015b0a0 con 0x7f12301591e0 2023-10-09T07:01:38.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.044+0000 7f1236b9d700 1 -- 172.21.15.71:0/2934363170 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123015cfb0 con 0x7f12301591e0 2023-10-09T07:01:38.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.044+0000 7f1225ffb700 1 -- 172.21.15.71:0/2934363170 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 59) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f1228007300 con 0x7f12301591e0 2023-10-09T07:01:38.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.045+0000 7f1225ffb700 1 --2- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1214066f80 0x7f1214069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:38.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.045+0000 7f1225ffb700 1 -- 172.21.15.71:0/2934363170 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f1228084990 con 0x7f12301591e0 2023-10-09T07:01:38.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.049+0000 7f1235b9b700 1 -- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1214066f80 msgr2=0x7f1214069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:38.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.049+0000 7f1235b9b700 1 --2- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1214066f80 0x7f1214069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:01:38.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.053+0000 7f1225ffb700 1 -- 172.21.15.71:0/2934363170 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f123015cfb0 con 0x7f12301591e0 2023-10-09T07:01:38.130 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:38.130+0000 7fd7c6e67180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T07:01:38.187 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:38.186+0000 7f3385a67180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T07:01:38.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.250+0000 7f1235b9b700 1 -- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1214066f80 msgr2=0x7f1214069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:38.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.250+0000 7f1235b9b700 1 --2- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1214066f80 0x7f1214069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:01:38.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.285+0000 7f1236b9d700 1 -- 172.21.15.71:0/2934363170 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f123004c3c0 con 0x7f1214066f80 2023-10-09T07:01:38.296 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:38.295+0000 7fd7c6e67180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T07:01:38.355 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:38.354+0000 7f3385a67180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T07:01:38.382 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:38.382+0000 7fd7c6e67180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T07:01:38.439 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:38.438+0000 7f3385a67180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T07:01:38.607 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:38.607+0000 7fd7c6e67180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:01:38.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.651+0000 7f1235b9b700 1 -- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1214066f80 msgr2=0x7f1214069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:38.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:38.651+0000 7f1235b9b700 1 --2- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1214066f80 0x7f1214069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T07:01:38.663 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:38.662+0000 7f3385a67180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:01:38.784 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:38.784+0000 7fd7c6e67180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T07:01:38.842 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:38.841+0000 7f3385a67180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T07:01:38.879 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:38.878+0000 7fd7c6e67180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T07:01:38.935 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:38.934+0000 7f3385a67180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T07:01:39.041 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:39.041+0000 7fd7c6e67180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T07:01:39.096 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:39.095+0000 7f3385a67180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T07:01:39.142 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:39.141+0000 7fd7c6e67180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T07:01:39.202 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:39.201+0000 7f3385a67180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T07:01:39.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:39.452+0000 7f1235b9b700 1 -- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1214066f80 msgr2=0x7f1214069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:39.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:39.452+0000 7f1235b9b700 1 --2- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1214066f80 0x7f1214069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T07:01:39.632 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:39.631+0000 7fd7c6e67180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T07:01:39.687 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:39.686+0000 7f3385a67180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T07:01:39.725 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:39.725+0000 7fd7c6e67180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T07:01:39.781 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:39.781+0000 7f3385a67180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T07:01:39.814 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:39.814+0000 7fd7c6e67180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T07:01:39.871 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:39.870+0000 7f3385a67180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T07:01:40.436 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:40.436+0000 7fd7c6e67180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T07:01:40.495 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:40.494+0000 7f3385a67180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T07:01:40.610 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:40.609+0000 7fd7c6e67180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:01:40.669 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:40.668+0000 7f3385a67180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:01:40.707 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:40.707+0000 7fd7c6e67180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T07:01:40.764 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:40.763+0000 7f3385a67180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T07:01:41.002 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:41.001+0000 7fd7c6e67180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T07:01:41.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:41.054+0000 7f1235b9b700 1 -- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1214066f80 msgr2=0x7f1214069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:01:41.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:41.054+0000 7f1235b9b700 1 --2- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1214066f80 0x7f1214069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-09T07:01:41.059 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:41.058+0000 7f3385a67180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T07:01:41.096 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:41.096+0000 7fd7c6e67180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T07:01:41.154 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:41.153+0000 7f3385a67180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T07:01:41.795 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:41.795+0000 7fd7c6e67180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T07:01:41.857 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:41.856+0000 7f3385a67180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T07:01:42.081 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:42.081+0000 7fd7c6e67180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T07:01:42.142 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:42.141+0000 7f3385a67180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T07:01:42.173 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:42.173+0000 7fd7c6e67180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T07:01:42.237 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:42.236+0000 7f3385a67180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T07:01:42.327 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:42.326+0000 7fd7c6e67180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T07:01:42.391 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:42.390+0000 7f3385a67180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T07:01:42.433 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:42.432+0000 7fd7c6e67180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T07:01:42.496 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:42.495+0000 7f3385a67180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T07:01:42.621 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:42.621+0000 7fd7c6e67180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T07:01:42.688 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:42.687+0000 7f3385a67180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T07:01:42.713 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:42.712+0000 7fd7c6e67180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T07:01:42.782 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:42.782+0000 7f3385a67180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T07:01:42.805 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:42.805+0000 7fd7c6e67180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T07:01:42.875 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:42.874+0000 7f3385a67180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T07:01:42.897 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:42.897+0000 7fd7c6e67180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T07:01:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:42.908+0000 7f1225ffb700 1 -- 172.21.15.71:0/2934363170 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 60) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f1228051eb0 con 0x7f12301591e0 2023-10-09T07:01:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:42.908+0000 7f1225ffb700 1 -- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1214066f80 msgr2=0x7f1214069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:01:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:42.908+0000 7f1225ffb700 1 --2- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1214066f80 0x7f1214069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:42.980 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:01:42.979+0000 7f3385a67180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T07:01:43.037 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:43.037+0000 7fd739131700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:43.038 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:43.037+0000 7fd739131700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:43.038 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:43.037+0000 7fd739131700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:43.038 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:43.037+0000 7fd739131700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:43.038 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:43.037+0000 7fd739131700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:43.038 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:43.037+0000 7fd73c137700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:43.038 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:43.037+0000 7fd73c137700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:43.038 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:43.037+0000 7fd73c137700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:43.038 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:43.037+0000 7fd73c137700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:43.038 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:01:43.037+0000 7fd73c137700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:01:43.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:43.914+0000 7f1225ffb700 1 -- 172.21.15.71:0/2934363170 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mgrmap(e 61) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f1228082a70 con 0x7f12301591e0 2023-10-09T07:01:43.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:43.915+0000 7f1225ffb700 1 --2- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1214066f80 0x7f12140693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:43.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:43.915+0000 7f1225ffb700 1 -- 172.21.15.71:0/2934363170 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f123004c3c0 con 0x7f1214066f80 2023-10-09T07:01:43.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:43.915+0000 7f1235b9b700 1 --2- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1214066f80 0x7f12140693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:43.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:43.919+0000 7f1235b9b700 1 --2- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1214066f80 0x7f12140693b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f122c007fd0 tx=0x7f122c009040 comp rx=0 tx=0).ready entity=mgr.7960 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:43.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:43.981+0000 7f1225ffb700 1 -- 172.21.15.71:0/2934363170 <== mgr.7960 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f123004c3c0 con 0x7f1214066f80 2023-10-09T07:01:43.982 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule set for path /snap_test_dir1 2023-10-09T07:01:43.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:43.984+0000 7f1236b9d700 1 -- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1214066f80 msgr2=0x7f12140693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:43.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:43.984+0000 7f1236b9d700 1 --2- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1214066f80 0x7f12140693b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f122c007fd0 tx=0x7f122c009040 comp rx=0 tx=0).stop 2023-10-09T07:01:43.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:43.984+0000 7f1236b9d700 1 -- 172.21.15.71:0/2934363170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12301591e0 msgr2=0x7f1230157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:43.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:43.984+0000 7f1236b9d700 1 --2- 172.21.15.71:0/2934363170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12301591e0 0x7f1230157d40 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f122800cbf0 tx=0x7f1228001a20 comp rx=0 tx=0).stop 2023-10-09T07:01:43.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:43.984+0000 7f1236b9d700 1 -- 172.21.15.71:0/2934363170 shutdown_connections 2023-10-09T07:01:43.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:43.984+0000 7f1236b9d700 1 --2- 172.21.15.71:0/2934363170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12301591e0 0x7f1230157d40 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:43.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:43.984+0000 7f1236b9d700 1 --2- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12300b03c0 0x7f123015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:43.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:43.984+0000 7f1236b9d700 1 --2- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1214066f80 0x7f12140693b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:43.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:43.984+0000 7f1236b9d700 1 --2- 172.21.15.71:0/2934363170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12300b0790 0x7f123016da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:43.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:43.985+0000 7f1236b9d700 1 -- 172.21.15.71:0/2934363170 >> 172.21.15.71:0/2934363170 conn(0x7f1230063230 msgr2=0x7f12300cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:43.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:43.985+0000 7f1236b9d700 1 -- 172.21.15.71:0/2934363170 shutdown_connections 2023-10-09T07:01:43.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:43.985+0000 7f1236b9d700 1 -- 172.21.15.71:0/2934363170 wait complete. 2023-10-09T07:01:44.005 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1 2023-10-09T07:01:44.005 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs /snap_test_dir1 55n 2023-10-09T07:01:44.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.193+0000 7fd4899ff700 1 Processor -- start 2023-10-09T07:01:44.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.193+0000 7fd4899ff700 1 -- start start 2023-10-09T07:01:44.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.194+0000 7fd4899ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd4840cce20 0x7fd4840caab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:44.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.194+0000 7fd4899ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd48415df40 0x7fd48415e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:44.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.194+0000 7fd4899ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd484157c50 con 0x7fd4840cca50 2023-10-09T07:01:44.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.194+0000 7fd4899ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48415d7d0 con 0x7fd4840cce20 2023-10-09T07:01:44.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.194+0000 7fd4899ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48415aa20 con 0x7fd48415df40 2023-10-09T07:01:44.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.195+0000 7fd4827fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd4840cce20 0x7fd4840caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:44.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.195+0000 7fd4827fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd4840cce20 0x7fd4840caab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38656/0 (socket says 172.21.15.71:38656) 2023-10-09T07:01:44.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.195+0000 7fd4827fc700 1 -- 172.21.15.71:0/3042117318 learned_addr learned my addr 172.21.15.71:0/3042117318 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:44.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.195+0000 7fd4827fc700 1 -- 172.21.15.71:0/3042117318 >> v2:172.21.15.179:3300/0 conn(0x7fd48415df40 msgr2=0x7fd48415e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:44.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.195+0000 7fd4827fc700 1 --2- 172.21.15.71:0/3042117318 >> v2:172.21.15.179:3300/0 conn(0x7fd48415df40 0x7fd48415e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:44.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.195+0000 7fd4827fc700 1 -- 172.21.15.71:0/3042117318 >> v1:172.21.15.179:6789/0 conn(0x7fd4840cca50 legacy=0x7fd48415a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:44.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.195+0000 7fd4827fc700 1 -- 172.21.15.71:0/3042117318 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48415ad00 con 0x7fd4840cce20 2023-10-09T07:01:44.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.195+0000 7fd4827fc700 1 --2- 172.21.15.71:0/3042117318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4840cce20 0x7fd4840caab0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fd4840ca130 tx=0x7fd478009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12743c1450583002 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:44.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.196+0000 7fd481ffb700 1 -- 172.21.15.71:0/3042117318 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47800b820 con 0x7fd4840cce20 2023-10-09T07:01:44.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.196+0000 7fd481ffb700 1 -- 172.21.15.71:0/3042117318 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47800b980 con 0x7fd4840cce20 2023-10-09T07:01:44.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.196+0000 7fd481ffb700 1 -- 172.21.15.71:0/3042117318 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47800bd20 con 0x7fd4840cce20 2023-10-09T07:01:44.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.196+0000 7fd4899ff700 1 -- 172.21.15.71:0/3042117318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4840cce20 msgr2=0x7fd4840caab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:44.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.196+0000 7fd4899ff700 1 --2- 172.21.15.71:0/3042117318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4840cce20 0x7fd4840caab0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fd4840ca130 tx=0x7fd478009250 comp rx=0 tx=0).stop 2023-10-09T07:01:44.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.196+0000 7fd4899ff700 1 -- 172.21.15.71:0/3042117318 shutdown_connections 2023-10-09T07:01:44.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.196+0000 7fd4899ff700 1 --2- 172.21.15.71:0/3042117318 >> v2:172.21.15.179:3300/0 conn(0x7fd48415df40 0x7fd48415e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:44.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.196+0000 7fd4899ff700 1 --2- 172.21.15.71:0/3042117318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4840cce20 0x7fd4840caab0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:44.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.196+0000 7fd4899ff700 1 -- 172.21.15.71:0/3042117318 >> 172.21.15.71:0/3042117318 conn(0x7fd4840ce5c0 msgr2=0x7fd4840ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:44.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.196+0000 7fd4899ff700 1 -- 172.21.15.71:0/3042117318 shutdown_connections 2023-10-09T07:01:44.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.196+0000 7fd4899ff700 1 -- 172.21.15.71:0/3042117318 wait complete. 2023-10-09T07:01:44.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.198+0000 7fd4899ff700 1 Processor -- start 2023-10-09T07:01:44.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.198+0000 7fd4899ff700 1 -- start start 2023-10-09T07:01:44.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.199+0000 7fd4899ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4840cca50 0x7fd4840b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:44.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.199+0000 7fd4899ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4840cce20 0x7fd4841563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:44.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.199+0000 7fd4899ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd48415df40 0x7fd484156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:44.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.199+0000 7fd4899ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48416d890 con 0x7fd48415df40 2023-10-09T07:01:44.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.199+0000 7fd4899ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48416e410 con 0x7fd4840cca50 2023-10-09T07:01:44.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.199+0000 7fd4899ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48416dae0 con 0x7fd4840cce20 2023-10-09T07:01:44.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.199+0000 7fd4837fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd48415df40 0x7fd484156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:44.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.199+0000 7fd4837fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd48415df40 0x7fd484156930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38672/0 (socket says 172.21.15.71:38672) 2023-10-09T07:01:44.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.199+0000 7fd4837fe700 1 -- 172.21.15.71:0/4151607943 learned_addr learned my addr 172.21.15.71:0/4151607943 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:44.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.199+0000 7fd482ffd700 1 --2- 172.21.15.71:0/4151607943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4840cca50 0x7fd4840b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:44.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.199+0000 7fd4827fc700 1 --2- 172.21.15.71:0/4151607943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4840cce20 0x7fd4841563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:44.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.199+0000 7fd4837fe700 1 -- 172.21.15.71:0/4151607943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4840cce20 msgr2=0x7fd4841563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:44.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.199+0000 7fd4837fe700 1 --2- 172.21.15.71:0/4151607943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4840cce20 0x7fd4841563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:44.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.199+0000 7fd4837fe700 1 -- 172.21.15.71:0/4151607943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4840cca50 msgr2=0x7fd4840b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:44.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.199+0000 7fd4837fe700 1 --2- 172.21.15.71:0/4151607943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4840cca50 0x7fd4840b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:44.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.199+0000 7fd4837fe700 1 -- 172.21.15.71:0/4151607943 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4780094f0 con 0x7fd48415df40 2023-10-09T07:01:44.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.200+0000 7fd4837fe700 1 --2- 172.21.15.71:0/4151607943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd48415df40 0x7fd484156930 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00bb90 tx=0x7fd47c009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:44.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.200+0000 7fd46affd700 1 -- 172.21.15.71:0/4151607943 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c00c7e0 con 0x7fd48415df40 2023-10-09T07:01:44.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.200+0000 7fd46affd700 1 -- 172.21.15.71:0/4151607943 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c00c940 con 0x7fd48415df40 2023-10-09T07:01:44.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.200+0000 7fd4899ff700 1 -- 172.21.15.71:0/4151607943 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd48416ddc0 con 0x7fd48415df40 2023-10-09T07:01:44.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.200+0000 7fd46affd700 1 -- 172.21.15.71:0/4151607943 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c00cd00 con 0x7fd48415df40 2023-10-09T07:01:44.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.200+0000 7fd4899ff700 1 -- 172.21.15.71:0/4151607943 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4840b41a0 con 0x7fd48415df40 2023-10-09T07:01:44.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.201+0000 7fd4899ff700 1 -- 172.21.15.71:0/4151607943 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4840718b0 con 0x7fd48415df40 2023-10-09T07:01:44.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.202+0000 7fd46affd700 1 -- 172.21.15.71:0/4151607943 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 61) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fd47c014620 con 0x7fd48415df40 2023-10-09T07:01:44.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.203+0000 7fd46affd700 1 --2- 172.21.15.71:0/4151607943 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd470066dd0 0x7fd470069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:44.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.203+0000 7fd46affd700 1 -- 172.21.15.71:0/4151607943 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6383+0+0 (secure 0 0 0) 0x7fd47c084420 con 0x7fd48415df40 2023-10-09T07:01:44.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.203+0000 7fd482ffd700 1 --2- 172.21.15.71:0/4151607943 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd470066dd0 0x7fd470069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:44.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.204+0000 7fd482ffd700 1 --2- 172.21.15.71:0/4151607943 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd470066dd0 0x7fd470069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd474009ab0 tx=0x7fd474009060 comp rx=0 tx=0).ready entity=mgr.7960 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:44.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.207+0000 7fd46affd700 1 -- 172.21.15.71:0/4151607943 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd47c04c5a0 con 0x7fd48415df40 2023-10-09T07:01:44.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.420+0000 7fd4899ff700 1 -- 172.21.15.71:0/4151607943 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/snap_test_dir1", "retention_spec_or_period": "55n", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4840b43f0 con 0x7fd470066dd0 2023-10-09T07:01:44.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.477+0000 7fd46affd700 1 -- 172.21.15.71:0/4151607943 <== mgr.7960 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+40 (secure 0 0 0) 0x7fd4840b43f0 con 0x7fd470066dd0 2023-10-09T07:01:44.478 INFO:teuthology.orchestra.run.smithi071.stdout:Retention added to path /snap_test_dir1 2023-10-09T07:01:44.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.479+0000 7fd4899ff700 1 -- 172.21.15.71:0/4151607943 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd470066dd0 msgr2=0x7fd470069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:44.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.479+0000 7fd4899ff700 1 --2- 172.21.15.71:0/4151607943 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd470066dd0 0x7fd470069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd474009ab0 tx=0x7fd474009060 comp rx=0 tx=0).stop 2023-10-09T07:01:44.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.479+0000 7fd4899ff700 1 -- 172.21.15.71:0/4151607943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd48415df40 msgr2=0x7fd484156930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:44.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.479+0000 7fd4899ff700 1 --2- 172.21.15.71:0/4151607943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd48415df40 0x7fd484156930 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00bb90 tx=0x7fd47c009810 comp rx=0 tx=0).stop 2023-10-09T07:01:44.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.480+0000 7fd4899ff700 1 -- 172.21.15.71:0/4151607943 shutdown_connections 2023-10-09T07:01:44.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.480+0000 7fd4899ff700 1 --2- 172.21.15.71:0/4151607943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd48415df40 0x7fd484156930 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:44.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.480+0000 7fd4899ff700 1 --2- 172.21.15.71:0/4151607943 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd470066dd0 0x7fd470069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:44.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.480+0000 7fd4899ff700 1 --2- 172.21.15.71:0/4151607943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4840cca50 0x7fd4840b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:44.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.480+0000 7fd4899ff700 1 --2- 172.21.15.71:0/4151607943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4840cce20 0x7fd4841563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:44.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.480+0000 7fd4899ff700 1 -- 172.21.15.71:0/4151607943 >> 172.21.15.71:0/4151607943 conn(0x7fd4840ce5c0 msgr2=0x7fd4841571a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:44.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.480+0000 7fd4899ff700 1 -- 172.21.15.71:0/4151607943 shutdown_connections 2023-10-09T07:01:44.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.480+0000 7fd4899ff700 1 -- 172.21.15.71:0/4151607943 wait complete. 2023-10-09T07:01:44.498 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path /snap_test_dir1 2023-10-09T07:01:44.499 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-10-09T07:01:44.499 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json /snap_test_dir1 2023-10-09T07:01:44.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.681+0000 7f0c485ff700 1 Processor -- start 2023-10-09T07:01:44.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.681+0000 7f0c485ff700 1 -- start start 2023-10-09T07:01:44.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.683+0000 7f0c485ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0c4015a440 0x7f0c400acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:44.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.683+0000 7f0c485ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4015a9b0 con 0x7f0c401563b0 2023-10-09T07:01:44.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.683+0000 7f0c485ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4015ac90 con 0x7f0c40068890 2023-10-09T07:01:44.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.683+0000 7f0c485ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c4015af70 con 0x7f0c4015a440 2023-10-09T07:01:44.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.683+0000 7f0c4639b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f0c401563b0 0x7f0c40156780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:38894/0 (socket says 172.21.15.71:38894) 2023-10-09T07:01:44.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.683+0000 7f0c4639b700 1 -- 172.21.15.71:0/1058096501 learned_addr learned my addr 172.21.15.71:0/1058096501 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:01:44.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.683+0000 7f0c45b9a700 1 --2- 172.21.15.71:0/1058096501 >> v2:172.21.15.179:3300/0 conn(0x7f0c4015a440 0x7f0c400acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:44.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.683+0000 7f0c45399700 1 -- 172.21.15.71:0/1058096501 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776083985 0 0) 0x7f0c4015a9b0 con 0x7f0c401563b0 2023-10-09T07:01:44.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.683+0000 7f0c45399700 1 -- 172.21.15.71:0/1058096501 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c2c003570 con 0x7f0c401563b0 2023-10-09T07:01:44.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.684+0000 7f0c45399700 1 -- 172.21.15.71:0/1058096501 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 643051107 0 0) 0x7f0c2c003570 con 0x7f0c401563b0 2023-10-09T07:01:44.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.684+0000 7f0c45399700 1 -- 172.21.15.71:0/1058096501 >> v2:172.21.15.179:3300/0 conn(0x7f0c4015a440 msgr2=0x7f0c400acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:44.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.684+0000 7f0c45399700 1 --2- 172.21.15.71:0/1058096501 >> v2:172.21.15.179:3300/0 conn(0x7f0c4015a440 0x7f0c400acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:44.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.684+0000 7f0c45399700 1 -- 172.21.15.71:0/1058096501 >> v1:172.21.15.179:6789/0 conn(0x7f0c40068890 legacy=0x7f0c400c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:44.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.684+0000 7f0c45399700 1 -- 172.21.15.71:0/1058096501 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4015b250 con 0x7f0c401563b0 2023-10-09T07:01:44.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.684+0000 7f0c45399700 1 -- 172.21.15.71:0/1058096501 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f0c3c001470 con 0x7f0c401563b0 2023-10-09T07:01:44.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.684+0000 7f0c45399700 1 -- 172.21.15.71:0/1058096501 >> v1:172.21.15.71:6789/0 conn(0x7f0c401563b0 legacy=0x7f0c40156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:44.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.684+0000 7f0c45399700 1 --2- 172.21.15.71:0/1058096501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c2c003a60 0x7f0c2c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:44.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.684+0000 7f0c45399700 1 --2- 172.21.15.71:0/1058096501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c2c004810 0x7f0c2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:44.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.684+0000 7f0c45399700 1 --2- 172.21.15.71:0/1058096501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c2c0051c0 0x7f0c2c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:44.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.684+0000 7f0c45399700 1 -- 172.21.15.71:0/1058096501 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4015af70 con 0x7f0c2c004810 2023-10-09T07:01:44.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.684+0000 7f0c45399700 1 -- 172.21.15.71:0/1058096501 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c00c050 con 0x7f0c2c003a60 2023-10-09T07:01:44.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.684+0000 7f0c45399700 1 -- 172.21.15.71:0/1058096501 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c00e420 con 0x7f0c2c0051c0 2023-10-09T07:01:44.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.684+0000 7f0c45b9a700 1 --2- 172.21.15.71:0/1058096501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c2c004810 0x7f0c2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:44.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.684+0000 7f0c4639b700 1 --2- 172.21.15.71:0/1058096501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c2c003a60 0x7f0c2c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:44.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.684+0000 7f0c46b9c700 1 --2- 172.21.15.71:0/1058096501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c2c0051c0 0x7f0c2c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:44.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.684+0000 7f0c45b9a700 1 -- 172.21.15.71:0/1058096501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c2c0051c0 msgr2=0x7f0c2c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:44.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.684+0000 7f0c45b9a700 1 --2- 172.21.15.71:0/1058096501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c2c0051c0 0x7f0c2c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:44.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.684+0000 7f0c45b9a700 1 -- 172.21.15.71:0/1058096501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c2c003a60 msgr2=0x7f0c2c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:01:44.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.684+0000 7f0c45b9a700 1 --2- 172.21.15.71:0/1058096501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c2c003a60 0x7f0c2c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:44.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.684+0000 7f0c45b9a700 1 -- 172.21.15.71:0/1058096501 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2c003570 con 0x7f0c2c004810 2023-10-09T07:01:44.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.685+0000 7f0c46b9c700 1 --2- 172.21.15.71:0/1058096501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c2c0051c0 0x7f0c2c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:01:44.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.685+0000 7f0c46b9c700 1 -- 172.21.15.71:0/1058096501 reap_dead start 2023-10-09T07:01:44.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.685+0000 7f0c45b9a700 1 --2- 172.21.15.71:0/1058096501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c2c004810 0x7f0c2c004c80 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f0c30009c00 tx=0x7f0c300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb7f1584bae7c75 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:44.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.685+0000 7f0c45399700 1 -- 172.21.15.71:0/1058096501 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3000e710 con 0x7f0c2c004810 2023-10-09T07:01:44.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.685+0000 7f0c45399700 1 -- 172.21.15.71:0/1058096501 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3000e870 con 0x7f0c2c004810 2023-10-09T07:01:44.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.685+0000 7f0c45399700 1 -- 172.21.15.71:0/1058096501 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3000ec30 con 0x7f0c2c004810 2023-10-09T07:01:44.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.685+0000 7f0c485ff700 1 -- 172.21.15.71:0/1058096501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c2c004810 msgr2=0x7f0c2c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:44.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.685+0000 7f0c485ff700 1 --2- 172.21.15.71:0/1058096501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c2c004810 0x7f0c2c004c80 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f0c30009c00 tx=0x7f0c300091a0 comp rx=0 tx=0).stop 2023-10-09T07:01:44.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.686+0000 7f0c485ff700 1 -- 172.21.15.71:0/1058096501 shutdown_connections 2023-10-09T07:01:44.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.686+0000 7f0c485ff700 1 --2- 172.21.15.71:0/1058096501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c2c004810 0x7f0c2c004c80 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:44.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.686+0000 7f0c485ff700 1 -- 172.21.15.71:0/1058096501 >> 172.21.15.71:0/1058096501 conn(0x7f0c400c8f90 msgr2=0x7f0c400c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:44.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.686+0000 7f0c485ff700 1 -- 172.21.15.71:0/1058096501 shutdown_connections 2023-10-09T07:01:44.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.686+0000 7f0c485ff700 1 -- 172.21.15.71:0/1058096501 wait complete. 2023-10-09T07:01:44.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.687+0000 7f0c485ff700 1 Processor -- start 2023-10-09T07:01:44.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.687+0000 7f0c485ff700 1 -- start start 2023-10-09T07:01:44.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.688+0000 7f0c485ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c2c004810 0x7f0c40165ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:44.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.688+0000 7f0c485ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c40168a50 0x7f0c40164d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:44.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.688+0000 7f0c485ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c40153030 0x7f0c401534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:44.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.688+0000 7f0c485ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c400ad960 con 0x7f0c40168a50 2023-10-09T07:01:44.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.688+0000 7f0c485ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c40153a10 con 0x7f0c40153030 2023-10-09T07:01:44.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.688+0000 7f0c485ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c40166620 con 0x7f0c2c004810 2023-10-09T07:01:44.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.688+0000 7f0c45b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c40168a50 0x7f0c40164d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:44.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.688+0000 7f0c45b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c40168a50 0x7f0c40164d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38704/0 (socket says 172.21.15.71:38704) 2023-10-09T07:01:44.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.688+0000 7f0c45b9a700 1 -- 172.21.15.71:0/913926476 learned_addr learned my addr 172.21.15.71:0/913926476 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:01:44.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.689+0000 7f0c45b9a700 1 -- 172.21.15.71:0/913926476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c2c004810 msgr2=0x7f0c40165ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:44.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.689+0000 7f0c45b9a700 1 --2- 172.21.15.71:0/913926476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c2c004810 0x7f0c40165ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:44.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.689+0000 7f0c45b9a700 1 -- 172.21.15.71:0/913926476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c40153030 msgr2=0x7f0c401534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:44.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.689+0000 7f0c45b9a700 1 --2- 172.21.15.71:0/913926476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c40153030 0x7f0c401534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:44.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.689+0000 7f0c45b9a700 1 -- 172.21.15.71:0/913926476 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c401663e0 con 0x7f0c40168a50 2023-10-09T07:01:44.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.689+0000 7f0c45b9a700 1 --2- 172.21.15.71:0/913926476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c40168a50 0x7f0c40164d80 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f0c30013ef0 tx=0x7f0c3001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:44.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.689+0000 7f0c367fc700 1 -- 172.21.15.71:0/913926476 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c30022070 con 0x7f0c40168a50 2023-10-09T07:01:44.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.689+0000 7f0c367fc700 1 -- 172.21.15.71:0/913926476 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3000ebf0 con 0x7f0c40168a50 2023-10-09T07:01:44.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.689+0000 7f0c367fc700 1 -- 172.21.15.71:0/913926476 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3001c6a0 con 0x7f0c40168a50 2023-10-09T07:01:44.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.689+0000 7f0c485ff700 1 -- 172.21.15.71:0/913926476 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c401652c0 con 0x7f0c40168a50 2023-10-09T07:01:44.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.689+0000 7f0c485ff700 1 -- 172.21.15.71:0/913926476 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c40169230 con 0x7f0c40168a50 2023-10-09T07:01:44.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.690+0000 7f0c485ff700 1 -- 172.21.15.71:0/913926476 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c400718b0 con 0x7f0c40168a50 2023-10-09T07:01:44.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.691+0000 7f0c367fc700 1 -- 172.21.15.71:0/913926476 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 61) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f0c3001ca50 con 0x7f0c40168a50 2023-10-09T07:01:44.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.692+0000 7f0c367fc700 1 --2- 172.21.15.71:0/913926476 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0c24066dd0 0x7f0c24069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:01:44.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.692+0000 7f0c367fc700 1 -- 172.21.15.71:0/913926476 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6383+0+0 (secure 0 0 0) 0x7f0c30085db0 con 0x7f0c40168a50 2023-10-09T07:01:44.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.692+0000 7f0c4639b700 1 --2- 172.21.15.71:0/913926476 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0c24066dd0 0x7f0c24069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:01:44.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.693+0000 7f0c4639b700 1 --2- 172.21.15.71:0/913926476 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0c24066dd0 0x7f0c24069280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c000e10 tx=0x7f0c3c001e70 comp rx=0 tx=0).ready entity=mgr.7960 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:01:44.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.696+0000 7f0c367fc700 1 -- 172.21.15.71:0/913926476 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c30053030 con 0x7f0c40168a50 2023-10-09T07:01:44.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.909+0000 7f0c485ff700 1 -- 172.21.15.71:0/913926476 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0c4006d6a0 con 0x7f0c24066dd0 2023-10-09T07:01:44.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.919+0000 7f0c367fc700 1 -- 172.21.15.71:0/913926476 <== mgr.7960 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+74 (secure 0 0 0) 0x7f0c4006d6a0 con 0x7f0c24066dd0 2023-10-09T07:01:44.921 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:01:44.921 INFO:teuthology.orchestra.run.smithi071.stdout:{"path": "/snap_test_dir1", "schedule": ["1M"], "retention": [{"n": 55}]} 2023-10-09T07:01:44.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.921+0000 7f0c485ff700 1 -- 172.21.15.71:0/913926476 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0c24066dd0 msgr2=0x7f0c24069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:44.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.921+0000 7f0c485ff700 1 --2- 172.21.15.71:0/913926476 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0c24066dd0 0x7f0c24069280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c000e10 tx=0x7f0c3c001e70 comp rx=0 tx=0).stop 2023-10-09T07:01:44.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.921+0000 7f0c485ff700 1 -- 172.21.15.71:0/913926476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c40168a50 msgr2=0x7f0c40164d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:01:44.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.921+0000 7f0c485ff700 1 --2- 172.21.15.71:0/913926476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c40168a50 0x7f0c40164d80 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f0c30013ef0 tx=0x7f0c3001a000 comp rx=0 tx=0).stop 2023-10-09T07:01:44.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.921+0000 7f0c485ff700 1 -- 172.21.15.71:0/913926476 shutdown_connections 2023-10-09T07:01:44.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.921+0000 7f0c485ff700 1 --2- 172.21.15.71:0/913926476 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0c24066dd0 0x7f0c24069280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:44.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.921+0000 7f0c485ff700 1 --2- 172.21.15.71:0/913926476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c40153030 0x7f0c401534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:44.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.921+0000 7f0c485ff700 1 --2- 172.21.15.71:0/913926476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c2c004810 0x7f0c40165ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:44.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.921+0000 7f0c485ff700 1 --2- 172.21.15.71:0/913926476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c40168a50 0x7f0c40164d80 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:01:44.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.921+0000 7f0c485ff700 1 -- 172.21.15.71:0/913926476 >> 172.21.15.71:0/913926476 conn(0x7f0c400c8f90 msgr2=0x7f0c4006dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:01:44.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.921+0000 7f0c485ff700 1 -- 172.21.15.71:0/913926476 shutdown_connections 2023-10-09T07:01:44.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:01:44.921+0000 7f0c485ff700 1 -- 172.21.15.71:0/913926476 wait complete. 2023-10-09T07:01:44.940 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "/snap_test_dir1", "schedule": ["1M"], "retention": [{"n": 55}]} 2023-10-09T07:01:44.940 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': '/snap_test_dir1', 'schedule': ['1M'], 'retention': [{'n': 55}]} 2023-10-09T07:02:00.489 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:02:00.489+0000 7fd72b115700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:02:00.490 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:02:00.489+0000 7fd72b115700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:02:00.490 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:02:00.489+0000 7fd72b115700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:02:00.490 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:02:00.489+0000 7fd72b115700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:02:00.490 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:02:00.489+0000 7fd72b115700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:02:03.454 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:02:03.459 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:02:33.575 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:02:33.581 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:03:03.734 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:03:03.739 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:03:33.847 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:03:33.852 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:04:03.977 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:04:03.983 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:04:34.083 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:04:34.088 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:05:04.188 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:05:04.194 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:05:34.302 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:05:34.307 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:06:04.424 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:06:04.430 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:06:34.538 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:06:34.543 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:07:04.696 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:07:04.701 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:07:34.838 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:07:34.843 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:08:04.953 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:08:04.960 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:08:35.063 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:08:35.069 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:09:05.190 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:09:05.196 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:09:35.371 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:09:35.376 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:10:05.567 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:10:05.573 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:10:35.711 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:10:35.717 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:11:05.878 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:11:05.884 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:11:36.077 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:11:36.082 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:12:06.199 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:12:06.205 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:12:36.404 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:12:36.409 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:13:06.594 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:13:06.600 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:13:36.765 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:13:36.771 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:14:06.946 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:14:06.952 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:14:37.051 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:14:37.057 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:15:07.224 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:15:07.230 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:15:37.412 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:15:37.418 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:16:07.512 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:16:07.517 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:16:37.689 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:16:37.695 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:17:07.837 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:17:07.843 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:17:38.010 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:17:38.015 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:18:08.199 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:18:08.204 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:18:38.334 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:18:38.339 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:19:08.517 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:19:08.522 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:19:38.698 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:19:38.703 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:20:08.811 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:20:08.817 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:20:39.026 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:20:39.032 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:21:09.131 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:21:09.136 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:21:39.237 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:21:39.244 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:22:09.426 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:22:09.434 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:22:39.528 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:22:39.533 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:23:09.705 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:23:09.711 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:23:39.877 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:23:39.883 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:24:10.057 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:24:10.063 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:24:40.230 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:24:40.235 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:25:10.335 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:25:10.341 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:25:40.499 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:25:40.504 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:26:10.604 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:26:10.610 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:26:40.802 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:26:40.807 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:27:10.940 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:27:10.946 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:27:41.122 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:27:41.128 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:28:11.304 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:28:11.310 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:28:41.399 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:28:41.405 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:29:11.564 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:29:11.569 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:29:41.744 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:29:41.749 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:30:11.899 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:30:11.905 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:30:42.011 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:30:42.017 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:31:12.122 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:31:12.128 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:31:42.300 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:31:42.306 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:32:12.421 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:32:12.427 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:32:42.586 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:32:42.592 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:33:12.757 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:33:12.763 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:33:42.930 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:33:42.936 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:34:13.103 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:34:13.108 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:34:43.215 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:34:43.220 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:35:13.328 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:35:13.333 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:35:43.460 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:35:43.465 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:36:13.623 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:36:13.629 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:36:43.796 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:36:43.802 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:37:13.924 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:37:13.929 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:37:44.082 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:37:44.088 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:38:14.263 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:38:14.271 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:38:44.468 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:38:44.474 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:39:14.598 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:39:14.603 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:39:44.770 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:39:44.776 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:40:14.943 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:40:14.949 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:40:45.124 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:40:45.129 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:41:15.305 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:41:15.310 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:41:45.468 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:41:45.474 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:42:15.676 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:42:15.681 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:42:45.847 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:42:45.853 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:43:16.028 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:43:16.033 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:43:46.213 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:43:46.218 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:44:16.408 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:44:16.413 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:44:46.597 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:44:46.602 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:45:16.776 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:45:16.781 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:45:46.971 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:45:46.976 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:46:17.177 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:46:17.182 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:46:47.340 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:46:47.345 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:47:17.532 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:47:17.538 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:47:47.696 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:47:47.701 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:48:17.860 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:48:17.866 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:48:48.046 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:48:48.051 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:49:18.241 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:49:18.246 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:49:48.410 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:49:48.416 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:50:18.573 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:50:18.579 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:50:48.677 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:50:48.682 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:51:18.869 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:51:18.874 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:51:48.983 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:51:48.989 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:52:19.096 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:52:19.102 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:52:49.266 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:52:49.559 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:53:19.695 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:53:19.701 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:53:49.849 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:53:49.854 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:54:20.037 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:54:20.043 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:54:50.205 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:54:50.211 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:55:20.368 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:55:20.373 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:55:50.561 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:55:50.567 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:56:20.693 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:56:20.699 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:56:50.873 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:56:50.879 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:57:15.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:15.942 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T07:57:15.989 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_03_00_UTC 2023-10-09T07:57:15.990 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_04_00_UTC 2023-10-09T07:57:15.990 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_05_00_UTC 2023-10-09T07:57:15.990 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_06_00_UTC 2023-10-09T07:57:15.990 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_07_00_UTC 2023-10-09T07:57:15.990 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_08_00_UTC 2023-10-09T07:57:15.991 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_09_00_UTC 2023-10-09T07:57:15.991 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_10_00_UTC 2023-10-09T07:57:15.991 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_11_00_UTC 2023-10-09T07:57:15.991 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_12_00_UTC 2023-10-09T07:57:15.991 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_13_00_UTC 2023-10-09T07:57:15.991 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_14_00_UTC 2023-10-09T07:57:15.991 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_15_00_UTC 2023-10-09T07:57:15.991 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_16_00_UTC 2023-10-09T07:57:15.991 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_17_00_UTC 2023-10-09T07:57:15.991 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_18_00_UTC 2023-10-09T07:57:15.991 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_19_00_UTC 2023-10-09T07:57:15.991 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_20_00_UTC 2023-10-09T07:57:15.992 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_21_00_UTC 2023-10-09T07:57:15.992 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_22_00_UTC 2023-10-09T07:57:15.992 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_23_00_UTC 2023-10-09T07:57:15.992 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_24_00_UTC 2023-10-09T07:57:15.992 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_25_00_UTC 2023-10-09T07:57:15.992 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_26_00_UTC 2023-10-09T07:57:15.992 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_27_00_UTC 2023-10-09T07:57:15.992 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_28_00_UTC 2023-10-09T07:57:15.992 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_29_00_UTC 2023-10-09T07:57:15.992 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_30_00_UTC 2023-10-09T07:57:15.992 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_31_00_UTC 2023-10-09T07:57:15.993 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_32_00_UTC 2023-10-09T07:57:15.993 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_33_00_UTC 2023-10-09T07:57:15.993 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_34_00_UTC 2023-10-09T07:57:15.993 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_35_00_UTC 2023-10-09T07:57:15.993 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_36_00_UTC 2023-10-09T07:57:15.993 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_37_00_UTC 2023-10-09T07:57:15.993 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_38_00_UTC 2023-10-09T07:57:15.993 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_39_00_UTC 2023-10-09T07:57:15.993 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_40_00_UTC 2023-10-09T07:57:15.993 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_41_00_UTC 2023-10-09T07:57:15.993 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_42_00_UTC 2023-10-09T07:57:15.994 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_43_00_UTC 2023-10-09T07:57:15.994 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_44_00_UTC 2023-10-09T07:57:15.994 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_45_00_UTC 2023-10-09T07:57:15.994 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_46_00_UTC 2023-10-09T07:57:15.994 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_47_00_UTC 2023-10-09T07:57:15.994 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_48_00_UTC 2023-10-09T07:57:15.994 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_49_00_UTC 2023-10-09T07:57:15.995 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_50_00_UTC 2023-10-09T07:57:15.995 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_51_00_UTC 2023-10-09T07:57:15.995 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_52_01_UTC 2023-10-09T07:57:15.995 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_53_00_UTC 2023-10-09T07:57:15.995 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_54_00_UTC 2023-10-09T07:57:15.995 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_55_00_UTC 2023-10-09T07:57:15.995 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_56_00_UTC 2023-10-09T07:57:15.995 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_57_00_UTC 2023-10-09T07:57:15.997 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-07_03_00_UTC', 'scheduled-2023-10-09-07_04_00_UTC', 'scheduled-2023-10-09-07_05_00_UTC', 'scheduled-2023-10-09-07_06_00_UTC', 'scheduled-2023-10-09-07_07_00_UTC', 'scheduled-2023-10-09-07_08_00_UTC', 'scheduled-2023-10-09-07_09_00_UTC', 'scheduled-2023-10-09-07_10_00_UTC', 'scheduled-2023-10-09-07_11_00_UTC', 'scheduled-2023-10-09-07_12_00_UTC', 'scheduled-2023-10-09-07_13_00_UTC', 'scheduled-2023-10-09-07_14_00_UTC', 'scheduled-2023-10-09-07_15_00_UTC', 'scheduled-2023-10-09-07_16_00_UTC', 'scheduled-2023-10-09-07_17_00_UTC', 'scheduled-2023-10-09-07_18_00_UTC', 'scheduled-2023-10-09-07_19_00_UTC', 'scheduled-2023-10-09-07_20_00_UTC', 'scheduled-2023-10-09-07_21_00_UTC', 'scheduled-2023-10-09-07_22_00_UTC', 'scheduled-2023-10-09-07_23_00_UTC', 'scheduled-2023-10-09-07_24_00_UTC', 'scheduled-2023-10-09-07_25_00_UTC', 'scheduled-2023-10-09-07_26_00_UTC', 'scheduled-2023-10-09-07_27_00_UTC', 'scheduled-2023-10-09-07_28_00_UTC', 'scheduled-2023-10-09-07_29_00_UTC', 'scheduled-2023-10-09-07_30_00_UTC', 'scheduled-2023-10-09-07_31_00_UTC', 'scheduled-2023-10-09-07_32_00_UTC', 'scheduled-2023-10-09-07_33_00_UTC', 'scheduled-2023-10-09-07_34_00_UTC', 'scheduled-2023-10-09-07_35_00_UTC', 'scheduled-2023-10-09-07_36_00_UTC', 'scheduled-2023-10-09-07_37_00_UTC', 'scheduled-2023-10-09-07_38_00_UTC', 'scheduled-2023-10-09-07_39_00_UTC', 'scheduled-2023-10-09-07_40_00_UTC', 'scheduled-2023-10-09-07_41_00_UTC', 'scheduled-2023-10-09-07_42_00_UTC', 'scheduled-2023-10-09-07_43_00_UTC', 'scheduled-2023-10-09-07_44_00_UTC', 'scheduled-2023-10-09-07_45_00_UTC', 'scheduled-2023-10-09-07_46_00_UTC', 'scheduled-2023-10-09-07_47_00_UTC', 'scheduled-2023-10-09-07_48_00_UTC', 'scheduled-2023-10-09-07_49_00_UTC', 'scheduled-2023-10-09-07_50_00_UTC', 'scheduled-2023-10-09-07_51_00_UTC', 'scheduled-2023-10-09-07_52_01_UTC', 'scheduled-2023-10-09-07_53_00_UTC', 'scheduled-2023-10-09-07_54_00_UTC', 'scheduled-2023-10-09-07_55_00_UTC', 'scheduled-2023-10-09-07_56_00_UTC', 'scheduled-2023-10-09-07_57_00_UTC'] 2023-10-09T07:57:15.997 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1 2023-10-09T07:57:16.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.187+0000 7f80a11ff700 1 Processor -- start 2023-10-09T07:57:16.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.187+0000 7f80a11ff700 1 -- start start 2023-10-09T07:57:16.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.189+0000 7f80a11ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f809c1563b0 0x7f809c156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:16.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.189+0000 7f80a11ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f809c15a440 0x7f809c0acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:16.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.189+0000 7f80a11ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f809c15a9b0 con 0x7f809c068890 2023-10-09T07:57:16.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.189+0000 7f80a11ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f809c15ac90 con 0x7f809c1563b0 2023-10-09T07:57:16.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.189+0000 7f80a11ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809c15af70 con 0x7f809c15a440 2023-10-09T07:57:16.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.189+0000 7f809a59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f809c15a440 0x7f809c0acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:16.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.189+0000 7f809ad9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f809c1563b0 0x7f809c156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:16.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.189+0000 7f809a59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f809c15a440 0x7f809c0acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:35462/0 (socket says 172.21.15.71:35462) 2023-10-09T07:57:16.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.189+0000 7f809ad9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f809c1563b0 0x7f809c156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:47926/0 (socket says 172.21.15.71:47926) 2023-10-09T07:57:16.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.189+0000 7f809a59c700 1 -- 172.21.15.71:0/4246623353 learned_addr learned my addr 172.21.15.71:0/4246623353 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:16.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.189+0000 7f809b59e700 1 --1- 172.21.15.71:0/4246623353 >> v1:172.21.15.179:6789/0 conn(0x7f809c068890 0x7f809c0c8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:34958/0 (socket says 172.21.15.71:34958) 2023-10-09T07:57:16.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.190+0000 7f809a59c700 1 -- 172.21.15.71:0/4246623353 >> v2:172.21.15.179:3300/0 conn(0x7f809c1563b0 msgr2=0x7f809c156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:16.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.190+0000 7f809a59c700 1 --2- 172.21.15.71:0/4246623353 >> v2:172.21.15.179:3300/0 conn(0x7f809c1563b0 0x7f809c156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:16.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.190+0000 7f809a59c700 1 -- 172.21.15.71:0/4246623353 >> v1:172.21.15.179:6789/0 conn(0x7f809c068890 legacy=0x7f809c0c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:16.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.190+0000 7f809a59c700 1 -- 172.21.15.71:0/4246623353 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c15b250 con 0x7f809c15a440 2023-10-09T07:57:16.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.190+0000 7f809ad9d700 1 --2- 172.21.15.71:0/4246623353 >> v2:172.21.15.179:3300/0 conn(0x7f809c1563b0 0x7f809c156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:57:16.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.190+0000 7f8099d9b700 1 -- 172.21.15.71:0/4246623353 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401160523 0 0) 0x7f809c15a9b0 con 0x7f809c068890 2023-10-09T07:57:16.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.190+0000 7f809a59c700 1 --2- 172.21.15.71:0/4246623353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f809c15a440 0x7f809c0acf30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f80900099b0 tx=0x7f8090009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d8159a3d8448dfa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:16.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.190+0000 7f8099d9b700 1 -- 172.21.15.71:0/4246623353 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090009ea0 con 0x7f809c15a440 2023-10-09T07:57:16.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.190+0000 7f8099d9b700 1 -- 172.21.15.71:0/4246623353 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809000b860 con 0x7f809c15a440 2023-10-09T07:57:16.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.190+0000 7f8099d9b700 1 -- 172.21.15.71:0/4246623353 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809000bc00 con 0x7f809c15a440 2023-10-09T07:57:16.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.191+0000 7f80a11ff700 1 -- 172.21.15.71:0/4246623353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f809c15a440 msgr2=0x7f809c0acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:16.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.191+0000 7f80a11ff700 1 --2- 172.21.15.71:0/4246623353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f809c15a440 0x7f809c0acf30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f80900099b0 tx=0x7f8090009250 comp rx=0 tx=0).stop 2023-10-09T07:57:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.191+0000 7f80a11ff700 1 -- 172.21.15.71:0/4246623353 shutdown_connections 2023-10-09T07:57:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.191+0000 7f80a11ff700 1 --2- 172.21.15.71:0/4246623353 >> v2:172.21.15.179:3300/0 conn(0x7f809c1563b0 0x7f809c156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.191+0000 7f80a11ff700 1 --2- 172.21.15.71:0/4246623353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f809c15a440 0x7f809c0acf30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.191+0000 7f80a11ff700 1 -- 172.21.15.71:0/4246623353 >> 172.21.15.71:0/4246623353 conn(0x7f809c0c8f90 msgr2=0x7f809c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.191+0000 7f80a11ff700 1 -- 172.21.15.71:0/4246623353 shutdown_connections 2023-10-09T07:57:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.191+0000 7f80a11ff700 1 -- 172.21.15.71:0/4246623353 wait complete. 2023-10-09T07:57:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.193+0000 7f80a11ff700 1 Processor -- start 2023-10-09T07:57:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.193+0000 7f80a11ff700 1 -- start start 2023-10-09T07:57:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.194+0000 7f80a11ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f809c068890 0x7f809c14e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.194+0000 7f80a11ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f809c1563b0 0x7f809c16af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.194+0000 7f80a11ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f809c15a440 0x7f809c16b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.194+0000 7f80a11ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c14eda0 con 0x7f809c068890 2023-10-09T07:57:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.194+0000 7f80a11ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c168c90 con 0x7f809c1563b0 2023-10-09T07:57:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.194+0000 7f80a11ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809c14d340 con 0x7f809c15a440 2023-10-09T07:57:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.194+0000 7f809ad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f809c068890 0x7f809c14e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.194+0000 7f809ad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f809c068890 0x7f809c14e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:32928/0 (socket says 172.21.15.71:32928) 2023-10-09T07:57:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.194+0000 7f809ad9d700 1 -- 172.21.15.71:0/1182055510 learned_addr learned my addr 172.21.15.71:0/1182055510 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.194+0000 7f809b59e700 1 --2- 172.21.15.71:0/1182055510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f809c15a440 0x7f809c16b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.194+0000 7f809a59c700 1 --2- 172.21.15.71:0/1182055510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f809c1563b0 0x7f809c16af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.194+0000 7f809ad9d700 1 -- 172.21.15.71:0/1182055510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f809c15a440 msgr2=0x7f809c16b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.194+0000 7f809ad9d700 1 --2- 172.21.15.71:0/1182055510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f809c15a440 0x7f809c16b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.194+0000 7f809ad9d700 1 -- 172.21.15.71:0/1182055510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f809c1563b0 msgr2=0x7f809c16af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.194+0000 7f809ad9d700 1 --2- 172.21.15.71:0/1182055510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f809c1563b0 0x7f809c16af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.194+0000 7f809ad9d700 1 -- 172.21.15.71:0/1182055510 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c009420 con 0x7f809c068890 2023-10-09T07:57:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.194+0000 7f809b59e700 1 --2- 172.21.15.71:0/1182055510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f809c15a440 0x7f809c16b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:57:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.194+0000 7f809a59c700 1 --2- 172.21.15.71:0/1182055510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f809c1563b0 0x7f809c16af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:57:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.194+0000 7f809ad9d700 1 --2- 172.21.15.71:0/1182055510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f809c068890 0x7f809c14e860 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f808c00ec80 tx=0x7f808c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.195+0000 7f8082ffd700 1 -- 172.21.15.71:0/1182055510 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c00c9d0 con 0x7f809c068890 2023-10-09T07:57:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.195+0000 7f8082ffd700 1 -- 172.21.15.71:0/1182055510 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c00cb30 con 0x7f809c068890 2023-10-09T07:57:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.195+0000 7f80a11ff700 1 -- 172.21.15.71:0/1182055510 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80900094f0 con 0x7f809c068890 2023-10-09T07:57:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.195+0000 7f8082ffd700 1 -- 172.21.15.71:0/1182055510 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c00ceb0 con 0x7f809c068890 2023-10-09T07:57:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.195+0000 7f80a11ff700 1 -- 172.21.15.71:0/1182055510 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809c14cd80 con 0x7f809c068890 2023-10-09T07:57:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.196+0000 7f80a11ff700 1 -- 172.21.15.71:0/1182055510 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f809c0718b0 con 0x7f809c068890 2023-10-09T07:57:16.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.197+0000 7f8082ffd700 1 -- 172.21.15.71:0/1182055510 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 64) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f808c013680 con 0x7f809c068890 2023-10-09T07:57:16.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.198+0000 7f8082ffd700 1 --2- 172.21.15.71:0/1182055510 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f80880670a0 0x7f8088069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:16.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.198+0000 7f8082ffd700 1 -- 172.21.15.71:0/1182055510 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6485+0+0 (secure 0 0 0) 0x7f808c084ec0 con 0x7f809c068890 2023-10-09T07:57:16.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.198+0000 7f809a59c700 1 --2- 172.21.15.71:0/1182055510 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f80880670a0 0x7f8088069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:16.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.199+0000 7f809a59c700 1 --2- 172.21.15.71:0/1182055510 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f80880670a0 0x7f8088069550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f80900099b0 tx=0x7f8090017000 comp rx=0 tx=0).ready entity=mgr.7960 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:16.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.202+0000 7f8082ffd700 1 -- 172.21.15.71:0/1182055510 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f808c051c70 con 0x7f809c068890 2023-10-09T07:57:16.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.414+0000 7f80a11ff700 1 -- 172.21.15.71:0/1182055510 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f809c14d120 con 0x7f80880670a0 2023-10-09T07:57:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.424+0000 7f8082ffd700 1 -- 172.21.15.71:0/1182055510 <== mgr.7960 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f809c14d120 con 0x7f80880670a0 2023-10-09T07:57:16.425 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:57:16.425 INFO:teuthology.orchestra.run.smithi071.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1", "rel_path": "/snap_test_dir1", "schedule": "1M", "retention": {"n": 55}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T07:01:43", "first": "2023-10-09T07:02:00", "last": "2023-10-09T07:57:00", "last_pruned": "2023-10-09T07:57:00", "created_count": 56, "pruned_count": 1, "active": true}] 2023-10-09T07:57:16.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.427+0000 7f80a11ff700 1 -- 172.21.15.71:0/1182055510 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f80880670a0 msgr2=0x7f8088069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:16.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.427+0000 7f80a11ff700 1 --2- 172.21.15.71:0/1182055510 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f80880670a0 0x7f8088069550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f80900099b0 tx=0x7f8090017000 comp rx=0 tx=0).stop 2023-10-09T07:57:16.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.427+0000 7f80a11ff700 1 -- 172.21.15.71:0/1182055510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f809c068890 msgr2=0x7f809c14e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:16.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.427+0000 7f80a11ff700 1 --2- 172.21.15.71:0/1182055510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f809c068890 0x7f809c14e860 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f808c00ec80 tx=0x7f808c0091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:16.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.427+0000 7f80a11ff700 1 -- 172.21.15.71:0/1182055510 shutdown_connections 2023-10-09T07:57:16.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.427+0000 7f80a11ff700 1 --2- 172.21.15.71:0/1182055510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f809c15a440 0x7f809c16b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:16.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.427+0000 7f80a11ff700 1 --2- 172.21.15.71:0/1182055510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f809c068890 0x7f809c14e860 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:16.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.427+0000 7f80a11ff700 1 --2- 172.21.15.71:0/1182055510 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f80880670a0 0x7f8088069550 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:16.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.427+0000 7f80a11ff700 1 --2- 172.21.15.71:0/1182055510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f809c1563b0 0x7f809c16af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:16.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.427+0000 7f80a11ff700 1 -- 172.21.15.71:0/1182055510 >> 172.21.15.71:0/1182055510 conn(0x7f809c0c8f90 msgr2=0x7f809c158b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:16.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.427+0000 7f80a11ff700 1 -- 172.21.15.71:0/1182055510 shutdown_connections 2023-10-09T07:57:16.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.427+0000 7f80a11ff700 1 -- 172.21.15.71:0/1182055510 wait complete. 2023-10-09T07:57:16.445 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1", "rel_path": "/snap_test_dir1", "schedule": "1M", "retention": {"n": 55}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T07:01:43", "first": "2023-10-09T07:02:00", "last": "2023-10-09T07:57:00", "last_pruned": "2023-10-09T07:57:00", "created_count": 56, "pruned_count": 1, "active": true}] 2023-10-09T07:57:16.445 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1', 'rel_path': '/snap_test_dir1', 'schedule': '1M', 'retention': {'n': 55}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T07:01:43', 'first': '2023-10-09T07:02:00', 'last': '2023-10-09T07:57:00', 'last_pruned': '2023-10-09T07:57:00', 'created_count': 56, 'pruned_count': 1, 'active': True} 2023-10-09T07:57:16.445 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 55 2023-10-09T07:57:16.445 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 56 2023-10-09T07:57:16.446 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1 2023-10-09T07:57:16.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.629+0000 7fc0c45ff700 1 Processor -- start 2023-10-09T07:57:16.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.629+0000 7fc0c45ff700 1 -- start start 2023-10-09T07:57:16.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.630+0000 7fc0c45ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0bc06ab40 0x7fc0bc0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:16.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.630+0000 7fc0c45ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc0bc0af8c0 0x7fc0bc159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:16.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.630+0000 7fc0c45ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0bc068900 con 0x7fc0bc068390 2023-10-09T07:57:16.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.630+0000 7fc0c45ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0bc068be0 con 0x7fc0bc0af8c0 2023-10-09T07:57:16.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.630+0000 7fc0c45ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc068ec0 con 0x7fc0bc06ab40 2023-10-09T07:57:16.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.631+0000 7fc0c2b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc0bc0af8c0 0x7fc0bc159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:16.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.631+0000 7fc0c2b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc0bc0af8c0 0x7fc0bc159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:32940/0 (socket says 172.21.15.71:32940) 2023-10-09T07:57:16.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.631+0000 7fc0c1b9a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc0bc068390 0x7fc0bc0c10c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51002/0 (socket says 172.21.15.71:51002) 2023-10-09T07:57:16.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.631+0000 7fc0c2b9c700 1 -- 172.21.15.71:0/2471348206 learned_addr learned my addr 172.21.15.71:0/2471348206 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:16.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.631+0000 7fc0c239b700 1 --2- 172.21.15.71:0/2471348206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0bc06ab40 0x7fc0bc0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:16.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.631+0000 7fc0c2b9c700 1 -- 172.21.15.71:0/2471348206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0bc06ab40 msgr2=0x7fc0bc0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:16.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.631+0000 7fc0c2b9c700 1 --2- 172.21.15.71:0/2471348206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0bc06ab40 0x7fc0bc0699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:16.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.631+0000 7fc0c2b9c700 1 -- 172.21.15.71:0/2471348206 >> v1:172.21.15.71:6789/0 conn(0x7fc0bc068390 legacy=0x7fc0bc0c10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:16.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.631+0000 7fc0c2b9c700 1 -- 172.21.15.71:0/2471348206 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0bc0691a0 con 0x7fc0bc0af8c0 2023-10-09T07:57:16.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.631+0000 7fc0c1399700 1 -- 172.21.15.71:0/2471348206 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911517939 0 0) 0x7fc0bc068900 con 0x7fc0bc068390 2023-10-09T07:57:16.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.632+0000 7fc0c2b9c700 1 --2- 172.21.15.71:0/2471348206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0bc0af8c0 0x7fc0bc159620 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009f20 tx=0x7fc0b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad9e76dc46c9a2e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:16.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.632+0000 7fc0c1399700 1 -- 172.21.15.71:0/2471348206 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b400e070 con 0x7fc0bc0af8c0 2023-10-09T07:57:16.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.632+0000 7fc0c1399700 1 -- 172.21.15.71:0/2471348206 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b400b9d0 con 0x7fc0bc0af8c0 2023-10-09T07:57:16.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.632+0000 7fc0c1399700 1 -- 172.21.15.71:0/2471348206 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b40092e0 con 0x7fc0bc0af8c0 2023-10-09T07:57:16.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.632+0000 7fc0c45ff700 1 -- 172.21.15.71:0/2471348206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0bc0af8c0 msgr2=0x7fc0bc159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:16.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.632+0000 7fc0c45ff700 1 --2- 172.21.15.71:0/2471348206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0bc0af8c0 0x7fc0bc159620 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009f20 tx=0x7fc0b4009840 comp rx=0 tx=0).stop 2023-10-09T07:57:16.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.632+0000 7fc0c45ff700 1 -- 172.21.15.71:0/2471348206 shutdown_connections 2023-10-09T07:57:16.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.632+0000 7fc0c45ff700 1 --2- 172.21.15.71:0/2471348206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0bc0af8c0 0x7fc0bc159620 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:16.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.632+0000 7fc0c45ff700 1 --2- 172.21.15.71:0/2471348206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0bc06ab40 0x7fc0bc0699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:16.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.632+0000 7fc0c45ff700 1 -- 172.21.15.71:0/2471348206 >> 172.21.15.71:0/2471348206 conn(0x7fc0bc0cd640 msgr2=0x7fc0bc0cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:16.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.632+0000 7fc0c45ff700 1 -- 172.21.15.71:0/2471348206 shutdown_connections 2023-10-09T07:57:16.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.632+0000 7fc0c45ff700 1 -- 172.21.15.71:0/2471348206 wait complete. 2023-10-09T07:57:16.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.634+0000 7fc0c45ff700 1 Processor -- start 2023-10-09T07:57:16.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.634+0000 7fc0c45ff700 1 -- start start 2023-10-09T07:57:16.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.635+0000 7fc0c45ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0bc068390 0x7fc0bc0c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:16.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.635+0000 7fc0c45ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0bc06ab40 0x7fc0bc15f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:16.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.635+0000 7fc0c45ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0bc0af8c0 0x7fc0bc156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:16.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.635+0000 7fc0c45ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc15e670 con 0x7fc0bc0af8c0 2023-10-09T07:57:16.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.635+0000 7fc0c45ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc15f4d0 con 0x7fc0bc068390 2023-10-09T07:57:16.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.635+0000 7fc0c45ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc152ff0 con 0x7fc0bc06ab40 2023-10-09T07:57:16.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.635+0000 7fc0c2b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0bc0af8c0 0x7fc0bc156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:16.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.635+0000 7fc0c2b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0bc0af8c0 0x7fc0bc156120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:32944/0 (socket says 172.21.15.71:32944) 2023-10-09T07:57:16.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.635+0000 7fc0c2b9c700 1 -- 172.21.15.71:0/2446174594 learned_addr learned my addr 172.21.15.71:0/2446174594 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:16.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.635+0000 7fc0c239b700 1 --2- 172.21.15.71:0/2446174594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0bc068390 0x7fc0bc0c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:16.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.635+0000 7fc0c1b9a700 1 --2- 172.21.15.71:0/2446174594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0bc06ab40 0x7fc0bc15f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:16.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.635+0000 7fc0c2b9c700 1 -- 172.21.15.71:0/2446174594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0bc06ab40 msgr2=0x7fc0bc15f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:16.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.635+0000 7fc0c2b9c700 1 --2- 172.21.15.71:0/2446174594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0bc06ab40 0x7fc0bc15f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:16.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.635+0000 7fc0c2b9c700 1 -- 172.21.15.71:0/2446174594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0bc068390 msgr2=0x7fc0bc0c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:16.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.635+0000 7fc0c2b9c700 1 --2- 172.21.15.71:0/2446174594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0bc068390 0x7fc0bc0c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:16.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.635+0000 7fc0c2b9c700 1 -- 172.21.15.71:0/2446174594 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b4009ae0 con 0x7fc0bc0af8c0 2023-10-09T07:57:16.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.636+0000 7fc0c239b700 1 --2- 172.21.15.71:0/2446174594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0bc068390 0x7fc0bc0c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:57:16.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.636+0000 7fc0c2b9c700 1 --2- 172.21.15.71:0/2446174594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0bc0af8c0 0x7fc0bc156120 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc071430 tx=0x7fc0b4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:16.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.636+0000 7fc0b27fc700 1 -- 172.21.15.71:0/2446174594 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4007c60 con 0x7fc0bc0af8c0 2023-10-09T07:57:16.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.636+0000 7fc0b27fc700 1 -- 172.21.15.71:0/2446174594 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b4007de0 con 0x7fc0bc0af8c0 2023-10-09T07:57:16.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.636+0000 7fc0b27fc700 1 -- 172.21.15.71:0/2446174594 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b401d670 con 0x7fc0bc0af8c0 2023-10-09T07:57:16.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.636+0000 7fc0c45ff700 1 -- 172.21.15.71:0/2446174594 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0bc0c7780 con 0x7fc0bc0af8c0 2023-10-09T07:57:16.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.636+0000 7fc0c45ff700 1 -- 172.21.15.71:0/2446174594 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0bc15eba0 con 0x7fc0bc0af8c0 2023-10-09T07:57:16.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.637+0000 7fc0c45ff700 1 -- 172.21.15.71:0/2446174594 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0bc15f640 con 0x7fc0bc0af8c0 2023-10-09T07:57:16.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.638+0000 7fc0b27fc700 1 -- 172.21.15.71:0/2446174594 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 64) v1 ==== 84871+0+0 (secure 0 0 0) 0x7fc0b4003040 con 0x7fc0bc0af8c0 2023-10-09T07:57:16.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.639+0000 7fc0b27fc700 1 --2- 172.21.15.71:0/2446174594 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc0a00670a0 0x7fc0a0069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:16.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.639+0000 7fc0b27fc700 1 -- 172.21.15.71:0/2446174594 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6485+0+0 (secure 0 0 0) 0x7fc0b40863e0 con 0x7fc0bc0af8c0 2023-10-09T07:57:16.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.639+0000 7fc0c239b700 1 --2- 172.21.15.71:0/2446174594 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc0a00670a0 0x7fc0a0069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:16.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.640+0000 7fc0c239b700 1 --2- 172.21.15.71:0/2446174594 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc0a00670a0 0x7fc0a0069550 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8009d80 tx=0x7fc0b8008040 comp rx=0 tx=0).ready entity=mgr.7960 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:16.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.643+0000 7fc0b27fc700 1 -- 172.21.15.71:0/2446174594 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0b4053130 con 0x7fc0bc0af8c0 2023-10-09T07:57:16.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.864+0000 7fc0c45ff700 1 -- 172.21.15.71:0/2446174594 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0bc0718b0 con 0x7fc0a00670a0 2023-10-09T07:57:16.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.939+0000 7fc0b27fc700 1 -- 172.21.15.71:0/2446174594 <== mgr.7960 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+42 (secure 0 0 0) 0x7fc0bc0718b0 con 0x7fc0a00670a0 2023-10-09T07:57:16.940 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule removed for path /snap_test_dir1 2023-10-09T07:57:16.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.941+0000 7fc0c45ff700 1 -- 172.21.15.71:0/2446174594 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc0a00670a0 msgr2=0x7fc0a0069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:16.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.941+0000 7fc0c45ff700 1 --2- 172.21.15.71:0/2446174594 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc0a00670a0 0x7fc0a0069550 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8009d80 tx=0x7fc0b8008040 comp rx=0 tx=0).stop 2023-10-09T07:57:16.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.941+0000 7fc0c45ff700 1 -- 172.21.15.71:0/2446174594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0bc0af8c0 msgr2=0x7fc0bc156120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:16.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.941+0000 7fc0c45ff700 1 --2- 172.21.15.71:0/2446174594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0bc0af8c0 0x7fc0bc156120 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc071430 tx=0x7fc0b4018000 comp rx=0 tx=0).stop 2023-10-09T07:57:16.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.942+0000 7fc0c45ff700 1 -- 172.21.15.71:0/2446174594 shutdown_connections 2023-10-09T07:57:16.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.942+0000 7fc0c45ff700 1 --2- 172.21.15.71:0/2446174594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0bc0af8c0 0x7fc0bc156120 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:16.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.942+0000 7fc0c45ff700 1 --2- 172.21.15.71:0/2446174594 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc0a00670a0 0x7fc0a0069550 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:16.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.942+0000 7fc0c45ff700 1 --2- 172.21.15.71:0/2446174594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0bc068390 0x7fc0bc0c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:16.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.942+0000 7fc0c45ff700 1 --2- 172.21.15.71:0/2446174594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0bc06ab40 0x7fc0bc15f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:16.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.942+0000 7fc0c45ff700 1 -- 172.21.15.71:0/2446174594 >> 172.21.15.71:0/2446174594 conn(0x7fc0bc0cd640 msgr2=0x7fc0bc0b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:16.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.942+0000 7fc0c45ff700 1 -- 172.21.15.71:0/2446174594 shutdown_connections 2023-10-09T07:57:16.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:16.942+0000 7fc0c45ff700 1 -- 172.21.15.71:0/2446174594 wait complete. 2023-10-09T07:57:16.960 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1 2023-10-09T07:57:16.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:16.960 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T07:57:16.999 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_03_00_UTC 2023-10-09T07:57:17.000 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_04_00_UTC 2023-10-09T07:57:17.000 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_05_00_UTC 2023-10-09T07:57:17.000 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_06_00_UTC 2023-10-09T07:57:17.000 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_07_00_UTC 2023-10-09T07:57:17.000 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_08_00_UTC 2023-10-09T07:57:17.000 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_09_00_UTC 2023-10-09T07:57:17.000 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_10_00_UTC 2023-10-09T07:57:17.000 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_11_00_UTC 2023-10-09T07:57:17.000 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_12_00_UTC 2023-10-09T07:57:17.000 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_13_00_UTC 2023-10-09T07:57:17.000 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_14_00_UTC 2023-10-09T07:57:17.001 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_15_00_UTC 2023-10-09T07:57:17.001 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_16_00_UTC 2023-10-09T07:57:17.001 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_17_00_UTC 2023-10-09T07:57:17.001 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_18_00_UTC 2023-10-09T07:57:17.001 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_19_00_UTC 2023-10-09T07:57:17.001 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_20_00_UTC 2023-10-09T07:57:17.001 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_21_00_UTC 2023-10-09T07:57:17.001 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_22_00_UTC 2023-10-09T07:57:17.001 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_23_00_UTC 2023-10-09T07:57:17.001 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_24_00_UTC 2023-10-09T07:57:17.001 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_25_00_UTC 2023-10-09T07:57:17.001 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_26_00_UTC 2023-10-09T07:57:17.002 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_27_00_UTC 2023-10-09T07:57:17.002 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_28_00_UTC 2023-10-09T07:57:17.002 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_29_00_UTC 2023-10-09T07:57:17.002 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_30_00_UTC 2023-10-09T07:57:17.002 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_31_00_UTC 2023-10-09T07:57:17.002 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_32_00_UTC 2023-10-09T07:57:17.002 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_33_00_UTC 2023-10-09T07:57:17.002 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_34_00_UTC 2023-10-09T07:57:17.002 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_35_00_UTC 2023-10-09T07:57:17.002 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_36_00_UTC 2023-10-09T07:57:17.002 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_37_00_UTC 2023-10-09T07:57:17.002 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_38_00_UTC 2023-10-09T07:57:17.003 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_39_00_UTC 2023-10-09T07:57:17.003 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_40_00_UTC 2023-10-09T07:57:17.003 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_41_00_UTC 2023-10-09T07:57:17.003 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_42_00_UTC 2023-10-09T07:57:17.003 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_43_00_UTC 2023-10-09T07:57:17.003 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_44_00_UTC 2023-10-09T07:57:17.003 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_45_00_UTC 2023-10-09T07:57:17.003 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_46_00_UTC 2023-10-09T07:57:17.003 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_47_00_UTC 2023-10-09T07:57:17.003 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_48_00_UTC 2023-10-09T07:57:17.003 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_49_00_UTC 2023-10-09T07:57:17.004 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_50_00_UTC 2023-10-09T07:57:17.004 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_51_00_UTC 2023-10-09T07:57:17.004 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_52_01_UTC 2023-10-09T07:57:17.004 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_53_00_UTC 2023-10-09T07:57:17.004 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_54_00_UTC 2023-10-09T07:57:17.004 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_55_00_UTC 2023-10-09T07:57:17.004 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_56_00_UTC 2023-10-09T07:57:17.004 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_57_00_UTC 2023-10-09T07:57:17.005 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_03_00_UTC 2023-10-09T07:57:17.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:17.005 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_03_00_UTC) 2023-10-09T07:57:17.088 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_04_00_UTC 2023-10-09T07:57:17.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:17.089 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_04_00_UTC) 2023-10-09T07:57:17.172 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_05_00_UTC 2023-10-09T07:57:17.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:17.172 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_05_00_UTC) 2023-10-09T07:57:17.255 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_06_00_UTC 2023-10-09T07:57:17.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:17.255 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_06_00_UTC) 2023-10-09T07:57:17.338 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_07_00_UTC 2023-10-09T07:57:17.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:17.339 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_07_00_UTC) 2023-10-09T07:57:17.421 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_08_00_UTC 2023-10-09T07:57:17.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:17.422 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_08_00_UTC) 2023-10-09T07:57:17.504 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_09_00_UTC 2023-10-09T07:57:17.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:17.504 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_09_00_UTC) 2023-10-09T07:57:17.588 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_10_00_UTC 2023-10-09T07:57:17.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:17.588 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_10_00_UTC) 2023-10-09T07:57:17.672 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_11_00_UTC 2023-10-09T07:57:17.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:17.673 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_11_00_UTC) 2023-10-09T07:57:17.755 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_12_00_UTC 2023-10-09T07:57:17.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:17.756 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_12_00_UTC) 2023-10-09T07:57:17.839 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_13_00_UTC 2023-10-09T07:57:17.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:17.839 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_13_00_UTC) 2023-10-09T07:57:17.936 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_14_00_UTC 2023-10-09T07:57:17.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:17.937 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_14_00_UTC) 2023-10-09T07:57:17.980 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_15_00_UTC 2023-10-09T07:57:17.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:17.980 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_15_00_UTC) 2023-10-09T07:57:18.068 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_16_00_UTC 2023-10-09T07:57:18.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:18.068 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_16_00_UTC) 2023-10-09T07:57:18.150 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_17_00_UTC 2023-10-09T07:57:18.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:18.151 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_17_00_UTC) 2023-10-09T07:57:18.234 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_18_00_UTC 2023-10-09T07:57:18.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:18.235 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_18_00_UTC) 2023-10-09T07:57:18.318 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_19_00_UTC 2023-10-09T07:57:18.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:18.318 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_19_00_UTC) 2023-10-09T07:57:18.401 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_20_00_UTC 2023-10-09T07:57:18.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:18.402 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_20_00_UTC) 2023-10-09T07:57:18.484 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_21_00_UTC 2023-10-09T07:57:18.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:18.485 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_21_00_UTC) 2023-10-09T07:57:18.567 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_22_00_UTC 2023-10-09T07:57:18.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:18.567 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_22_00_UTC) 2023-10-09T07:57:18.651 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_23_00_UTC 2023-10-09T07:57:18.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:18.651 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_23_00_UTC) 2023-10-09T07:57:18.734 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_24_00_UTC 2023-10-09T07:57:18.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:18.734 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_24_00_UTC) 2023-10-09T07:57:18.816 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_25_00_UTC 2023-10-09T07:57:18.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:18.817 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_25_00_UTC) 2023-10-09T07:57:18.920 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_26_00_UTC 2023-10-09T07:57:18.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:18.920 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_26_00_UTC) 2023-10-09T07:57:18.970 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_27_00_UTC 2023-10-09T07:57:18.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:18.970 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_27_00_UTC) 2023-10-09T07:57:19.013 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_28_00_UTC 2023-10-09T07:57:19.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:19.013 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_28_00_UTC) 2023-10-09T07:57:19.096 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_29_00_UTC 2023-10-09T07:57:19.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:19.097 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_29_00_UTC) 2023-10-09T07:57:19.180 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_30_00_UTC 2023-10-09T07:57:19.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:19.181 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_30_00_UTC) 2023-10-09T07:57:19.263 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_31_00_UTC 2023-10-09T07:57:19.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:19.264 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_31_00_UTC) 2023-10-09T07:57:19.346 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_32_00_UTC 2023-10-09T07:57:19.346 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:19.346 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_32_00_UTC) 2023-10-09T07:57:19.429 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_33_00_UTC 2023-10-09T07:57:19.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:19.430 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_33_00_UTC) 2023-10-09T07:57:19.512 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_34_00_UTC 2023-10-09T07:57:19.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:19.512 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_34_00_UTC) 2023-10-09T07:57:19.595 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_35_00_UTC 2023-10-09T07:57:19.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:19.595 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_35_00_UTC) 2023-10-09T07:57:19.679 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_36_00_UTC 2023-10-09T07:57:19.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:19.679 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_36_00_UTC) 2023-10-09T07:57:19.762 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_37_00_UTC 2023-10-09T07:57:19.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:19.763 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_37_00_UTC) 2023-10-09T07:57:19.845 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_38_00_UTC 2023-10-09T07:57:19.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:19.845 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_38_00_UTC) 2023-10-09T07:57:19.964 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_39_00_UTC 2023-10-09T07:57:19.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:19.964 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_39_00_UTC) 2023-10-09T07:57:20.025 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_40_00_UTC 2023-10-09T07:57:20.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:20.025 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_40_00_UTC) 2023-10-09T07:57:20.068 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_41_00_UTC 2023-10-09T07:57:20.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:20.068 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_41_00_UTC) 2023-10-09T07:57:20.151 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_42_00_UTC 2023-10-09T07:57:20.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:20.152 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_42_00_UTC) 2023-10-09T07:57:20.239 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_43_00_UTC 2023-10-09T07:57:20.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:20.239 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_43_00_UTC) 2023-10-09T07:57:20.281 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_44_00_UTC 2023-10-09T07:57:20.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:20.282 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_44_00_UTC) 2023-10-09T07:57:20.364 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_45_00_UTC 2023-10-09T07:57:20.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:20.364 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_45_00_UTC) 2023-10-09T07:57:20.447 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_46_00_UTC 2023-10-09T07:57:20.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:20.447 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_46_00_UTC) 2023-10-09T07:57:20.529 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_47_00_UTC 2023-10-09T07:57:20.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:20.529 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_47_00_UTC) 2023-10-09T07:57:20.613 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_48_00_UTC 2023-10-09T07:57:20.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:20.613 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_48_00_UTC) 2023-10-09T07:57:20.695 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_49_00_UTC 2023-10-09T07:57:20.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:20.696 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_49_00_UTC) 2023-10-09T07:57:20.778 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_50_00_UTC 2023-10-09T07:57:20.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:20.779 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_50_00_UTC) 2023-10-09T07:57:20.860 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_51_00_UTC 2023-10-09T07:57:20.860 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:20.860 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_51_00_UTC) 2023-10-09T07:57:20.983 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_52_01_UTC 2023-10-09T07:57:20.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:20.983 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_52_01_UTC) 2023-10-09T07:57:21.043 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_53_00_UTC 2023-10-09T07:57:21.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:21.044 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_53_00_UTC) 2023-10-09T07:57:21.086 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_54_00_UTC 2023-10-09T07:57:21.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:21.086 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_54_00_UTC) 2023-10-09T07:57:21.104 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:57:21.134 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:57:21.169 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_55_00_UTC 2023-10-09T07:57:21.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:21.169 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_55_00_UTC) 2023-10-09T07:57:21.250 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_56_00_UTC 2023-10-09T07:57:21.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:21.250 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_56_00_UTC) 2023-10-09T07:57:21.332 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-07_57_00_UTC 2023-10-09T07:57:21.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:21.332 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-07_57_00_UTC) 2023-10-09T07:57:21.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:21.415 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-09T07:57:21.494 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-09T07:57:21.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.715+0000 7f910a5ff700 1 Processor -- start 2023-10-09T07:57:21.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.715+0000 7f910a5ff700 1 -- start start 2023-10-09T07:57:21.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.717+0000 7f910a5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f91040c70b0 0x7f9104069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:21.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.717+0000 7f910a5ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f910406e950 con 0x7f9104155eb0 2023-10-09T07:57:21.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.717+0000 7f910a5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f910406eb90 con 0x7f9104069cb0 2023-10-09T07:57:21.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.717+0000 7f910a5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910406a130 con 0x7f91040c70b0 2023-10-09T07:57:21.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.717+0000 7f9103fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9104155eb0 0x7f910406e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51018/0 (socket says 172.21.15.71:51018) 2023-10-09T07:57:21.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.717+0000 7f9103fff700 1 -- 172.21.15.71:0/3494955283 learned_addr learned my addr 172.21.15.71:0/3494955283 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:21.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.717+0000 7f90fbfff700 1 --2- 172.21.15.71:0/3494955283 >> v2:172.21.15.179:3300/0 conn(0x7f91040c70b0 0x7f9104069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:21.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.717+0000 7f91037fe700 1 -- 172.21.15.71:0/3494955283 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3270164302 0 0) 0x7f90f4001110 con 0x7f9104155eb0 2023-10-09T07:57:21.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.718+0000 7f91037fe700 1 -- 172.21.15.71:0/3494955283 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90f0003570 con 0x7f9104155eb0 2023-10-09T07:57:21.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.718+0000 7f91037fe700 1 -- 172.21.15.71:0/3494955283 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435068774 0 0) 0x7f910406eb90 con 0x7f9104069cb0 2023-10-09T07:57:21.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.718+0000 7f91037fe700 1 -- 172.21.15.71:0/3494955283 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90f4001110 con 0x7f9104069cb0 2023-10-09T07:57:21.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.718+0000 7f90fbfff700 1 -- 172.21.15.71:0/3494955283 >> v1:172.21.15.179:6789/0 conn(0x7f9104069cb0 legacy=0x7f91040ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:21.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.718+0000 7f90fbfff700 1 -- 172.21.15.71:0/3494955283 >> v1:172.21.15.71:6789/0 conn(0x7f9104155eb0 legacy=0x7f910406e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:21.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.718+0000 7f91037fe700 1 -- 172.21.15.71:0/3494955283 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4186823669 0 0) 0x7f90f0003570 con 0x7f9104155eb0 2023-10-09T07:57:21.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.718+0000 7f90fbfff700 1 -- 172.21.15.71:0/3494955283 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910406ee70 con 0x7f91040c70b0 2023-10-09T07:57:21.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.718+0000 7f90fbfff700 1 --2- 172.21.15.71:0/3494955283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91040c70b0 0x7f9104069770 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f90ec00aa90 tx=0x7f90ec00a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88c443fef7897c8b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:21.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.718+0000 7f91037fe700 1 -- 172.21.15.71:0/3494955283 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f4001600 con 0x7f91040c70b0 2023-10-09T07:57:21.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.718+0000 7f91037fe700 1 -- 172.21.15.71:0/3494955283 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ec00aed0 con 0x7f91040c70b0 2023-10-09T07:57:21.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.718+0000 7f91037fe700 1 -- 172.21.15.71:0/3494955283 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec00c890 con 0x7f91040c70b0 2023-10-09T07:57:21.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.719+0000 7f910a5ff700 1 -- 172.21.15.71:0/3494955283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91040c70b0 msgr2=0x7f9104069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:21.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.719+0000 7f910a5ff700 1 --2- 172.21.15.71:0/3494955283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91040c70b0 0x7f9104069770 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f90ec00aa90 tx=0x7f90ec00a330 comp rx=0 tx=0).stop 2023-10-09T07:57:21.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.719+0000 7f910a5ff700 1 -- 172.21.15.71:0/3494955283 shutdown_connections 2023-10-09T07:57:21.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.719+0000 7f910a5ff700 1 --2- 172.21.15.71:0/3494955283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91040c70b0 0x7f9104069770 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:21.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.719+0000 7f910a5ff700 1 -- 172.21.15.71:0/3494955283 >> 172.21.15.71:0/3494955283 conn(0x7f9104068e10 msgr2=0x7f91040cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:21.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.719+0000 7f910a5ff700 1 -- 172.21.15.71:0/3494955283 shutdown_connections 2023-10-09T07:57:21.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.719+0000 7f910a5ff700 1 -- 172.21.15.71:0/3494955283 wait complete. 2023-10-09T07:57:21.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.720+0000 7f910a5ff700 1 Processor -- start 2023-10-09T07:57:21.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.721+0000 7f910a5ff700 1 -- start start 2023-10-09T07:57:21.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.721+0000 7f910a5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9104069cb0 0x7f9104153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:21.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.721+0000 7f910a5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91040c70b0 0x7f910415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:21.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.722+0000 7f910a5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9104155eb0 0x7f91040c29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:21.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.722+0000 7f910a5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910415d2d0 con 0x7f9104155eb0 2023-10-09T07:57:21.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.722+0000 7f910a5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910415c6c0 con 0x7f9104069cb0 2023-10-09T07:57:21.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.722+0000 7f910a5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910415c9a0 con 0x7f91040c70b0 2023-10-09T07:57:21.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.722+0000 7f9108b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9104155eb0 0x7f91040c29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:21.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.722+0000 7f9108b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9104155eb0 0x7f91040c29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:32946/0 (socket says 172.21.15.71:32946) 2023-10-09T07:57:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.722+0000 7f9108b9c700 1 -- 172.21.15.71:0/1590937857 learned_addr learned my addr 172.21.15.71:0/1590937857 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.722+0000 7f9103fff700 1 --2- 172.21.15.71:0/1590937857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9104069cb0 0x7f9104153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.722+0000 7f90fbfff700 1 --2- 172.21.15.71:0/1590937857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91040c70b0 0x7f910415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.722+0000 7f9108b9c700 1 -- 172.21.15.71:0/1590937857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91040c70b0 msgr2=0x7f910415e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.722+0000 7f9108b9c700 1 --2- 172.21.15.71:0/1590937857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91040c70b0 0x7f910415e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.722+0000 7f9108b9c700 1 -- 172.21.15.71:0/1590937857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9104069cb0 msgr2=0x7f9104153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.722+0000 7f9108b9c700 1 --2- 172.21.15.71:0/1590937857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9104069cb0 0x7f9104153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.722+0000 7f9108b9c700 1 -- 172.21.15.71:0/1590937857 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec00a5d0 con 0x7f9104155eb0 2023-10-09T07:57:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.722+0000 7f90fbfff700 1 --2- 172.21.15.71:0/1590937857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91040c70b0 0x7f910415e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:57:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.722+0000 7f9108b9c700 1 --2- 172.21.15.71:0/1590937857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9104155eb0 0x7f91040c29f0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00c910 tx=0x7f90fc0027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.723+0000 7f9100ff9700 1 -- 172.21.15.71:0/1590937857 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc012630 con 0x7f9104155eb0 2023-10-09T07:57:21.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.723+0000 7f9100ff9700 1 -- 172.21.15.71:0/1590937857 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90fc0127b0 con 0x7f9104155eb0 2023-10-09T07:57:21.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.723+0000 7f9100ff9700 1 -- 172.21.15.71:0/1590937857 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc012b70 con 0x7f9104155eb0 2023-10-09T07:57:21.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.723+0000 7f910a5ff700 1 -- 172.21.15.71:0/1590937857 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f910415cc80 con 0x7f9104155eb0 2023-10-09T07:57:21.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.723+0000 7f910a5ff700 1 -- 172.21.15.71:0/1590937857 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9104154130 con 0x7f9104155eb0 2023-10-09T07:57:21.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.724+0000 7f910a5ff700 1 -- 172.21.15.71:0/1590937857 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f910406a6e0 con 0x7f9104155eb0 2023-10-09T07:57:21.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.725+0000 7f9100ff9700 1 -- 172.21.15.71:0/1590937857 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 64) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f90fc01b400 con 0x7f9104155eb0 2023-10-09T07:57:21.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.726+0000 7f9100ff9700 1 --2- 172.21.15.71:0/1590937857 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f90e40670a0 0x7f90e4069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:21.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.726+0000 7f9100ff9700 1 -- 172.21.15.71:0/1590937857 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6529+0+0 (secure 0 0 0) 0x7f90fc084e30 con 0x7f9104155eb0 2023-10-09T07:57:21.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.726+0000 7f9103fff700 1 --2- 172.21.15.71:0/1590937857 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f90e40670a0 0x7f90e4069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:21.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.727+0000 7f9103fff700 1 --2- 172.21.15.71:0/1590937857 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f90e40670a0 0x7f90e4069550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f90f4001ed0 tx=0x7f90f4000bc0 comp rx=0 tx=0).ready entity=mgr.7960 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:21.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.731+0000 7f9100ff9700 1 -- 172.21.15.71:0/1590937857 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90fc051ce0 con 0x7f9104155eb0 2023-10-09T07:57:21.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:21.998+0000 7f910a5ff700 1 -- 172.21.15.71:0/1590937857 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f910404c3c0 con 0x7f9104155eb0 2023-10-09T07:57:22.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:22.926+0000 7f9100ff9700 1 -- 172.21.15.71:0/1590937857 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 65) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f90fc0520b0 con 0x7f9104155eb0 2023-10-09T07:57:22.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:22.926+0000 7f9100ff9700 1 -- 172.21.15.71:0/1590937857 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v65) v1 ==== 93+0+0 (secure 0 0 0) 0x7f90fc04c370 con 0x7f9104155eb0 2023-10-09T07:57:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:22.929+0000 7f910a5ff700 1 -- 172.21.15.71:0/1590937857 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f90e40670a0 msgr2=0x7f90e4069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:22.929+0000 7f910a5ff700 1 --2- 172.21.15.71:0/1590937857 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f90e40670a0 0x7f90e4069550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f90f4001ed0 tx=0x7f90f4000bc0 comp rx=0 tx=0).stop 2023-10-09T07:57:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:22.929+0000 7f910a5ff700 1 -- 172.21.15.71:0/1590937857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9104155eb0 msgr2=0x7f91040c29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:22.929+0000 7f910a5ff700 1 --2- 172.21.15.71:0/1590937857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9104155eb0 0x7f91040c29f0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00c910 tx=0x7f90fc0027a0 comp rx=0 tx=0).stop 2023-10-09T07:57:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:22.929+0000 7f910a5ff700 1 -- 172.21.15.71:0/1590937857 shutdown_connections 2023-10-09T07:57:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:22.929+0000 7f910a5ff700 1 --2- 172.21.15.71:0/1590937857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9104155eb0 0x7f91040c29f0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:22.930+0000 7f910a5ff700 1 --2- 172.21.15.71:0/1590937857 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f90e40670a0 0x7f90e4069550 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:22.930+0000 7f910a5ff700 1 --2- 172.21.15.71:0/1590937857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9104069cb0 0x7f9104153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:22.930+0000 7f910a5ff700 1 --2- 172.21.15.71:0/1590937857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91040c70b0 0x7f910415e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:22.930+0000 7f910a5ff700 1 -- 172.21.15.71:0/1590937857 >> 172.21.15.71:0/1590937857 conn(0x7f9104068e10 msgr2=0x7f91040c9880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:22.930+0000 7f910a5ff700 1 -- 172.21.15.71:0/1590937857 shutdown_connections 2023-10-09T07:57:22.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:22.930+0000 7f910a5ff700 1 -- 172.21.15.71:0/1590937857 wait complete. 2023-10-09T07:57:22.952 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T07:57:22.952 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T07:57:23.054 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T07:57:23.155 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T07:57:23.156 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T07:57:23.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:23.156 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T07:57:23.242 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T07:57:23.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:57:23.242 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T07:57:23.280 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:57:23.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.524+0000 7f41b6f9d700 1 Processor -- start 2023-10-09T07:57:23.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.524+0000 7f41b6f9d700 1 -- start start 2023-10-09T07:57:23.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.525+0000 7f41b6f9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f41b0159420 0x7f41b00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:23.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.525+0000 7f41b6f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41b015d230 0x7f41b015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:23.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.525+0000 7f41b6f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b00b2980 con 0x7f41b01597f0 2023-10-09T07:57:23.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.525+0000 7f41b6f9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b015dbb0 con 0x7f41b0159420 2023-10-09T07:57:23.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.525+0000 7f41b6f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b00b11d0 con 0x7f41b015d230 2023-10-09T07:57:23.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.525+0000 7f41b5f9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f41b0159420 0x7f41b00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:23.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.526+0000 7f41b5f9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f41b0159420 0x7f41b00b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:32952/0 (socket says 172.21.15.71:32952) 2023-10-09T07:57:23.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.526+0000 7f41b5f9b700 1 -- 172.21.15.71:0/3912424623 learned_addr learned my addr 172.21.15.71:0/3912424623 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:23.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.526+0000 7f41b679c700 1 --2- 172.21.15.71:0/3912424623 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41b015d230 0x7f41b015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:23.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.526+0000 7f41b5f9b700 1 -- 172.21.15.71:0/3912424623 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41b015d230 msgr2=0x7f41b015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:23.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.526+0000 7f41b5f9b700 1 --2- 172.21.15.71:0/3912424623 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41b015d230 0x7f41b015d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:23.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.526+0000 7f41b5f9b700 1 -- 172.21.15.71:0/3912424623 >> v1:172.21.15.179:6789/0 conn(0x7f41b01597f0 legacy=0x7f41b00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:23.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.526+0000 7f41b5f9b700 1 -- 172.21.15.71:0/3912424623 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b00b14b0 con 0x7f41b0159420 2023-10-09T07:57:23.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.526+0000 7f41b5f9b700 1 --2- 172.21.15.71:0/3912424623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41b0159420 0x7f41b00b5f40 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0099b0 tx=0x7f41ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b7bd9ebb26344c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:23.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.526+0000 7f41b4f99700 1 -- 172.21.15.71:0/3912424623 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac009ea0 con 0x7f41b0159420 2023-10-09T07:57:23.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.527+0000 7f41b4f99700 1 -- 172.21.15.71:0/3912424623 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ac00b860 con 0x7f41b0159420 2023-10-09T07:57:23.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.527+0000 7f41b4f99700 1 -- 172.21.15.71:0/3912424623 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac00bc00 con 0x7f41b0159420 2023-10-09T07:57:23.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.527+0000 7f41b6f9d700 1 -- 172.21.15.71:0/3912424623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41b0159420 msgr2=0x7f41b00b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:23.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.527+0000 7f41b6f9d700 1 --2- 172.21.15.71:0/3912424623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41b0159420 0x7f41b00b5f40 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0099b0 tx=0x7f41ac009250 comp rx=0 tx=0).stop 2023-10-09T07:57:23.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.527+0000 7f41b6f9d700 1 -- 172.21.15.71:0/3912424623 shutdown_connections 2023-10-09T07:57:23.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.527+0000 7f41b6f9d700 1 --2- 172.21.15.71:0/3912424623 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41b015d230 0x7f41b015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:23.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.527+0000 7f41b6f9d700 1 --2- 172.21.15.71:0/3912424623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41b0159420 0x7f41b00b5f40 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:23.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.527+0000 7f41b6f9d700 1 -- 172.21.15.71:0/3912424623 >> 172.21.15.71:0/3912424623 conn(0x7f41b00d0660 msgr2=0x7f41b00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:23.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.527+0000 7f41b6f9d700 1 -- 172.21.15.71:0/3912424623 shutdown_connections 2023-10-09T07:57:23.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.527+0000 7f41b6f9d700 1 -- 172.21.15.71:0/3912424623 wait complete. 2023-10-09T07:57:23.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.529+0000 7f41b6f9d700 1 Processor -- start 2023-10-09T07:57:23.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.529+0000 7f41b6f9d700 1 -- start start 2023-10-09T07:57:23.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.530+0000 7f41b6f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41b0159420 0x7f41b01541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:23.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.530+0000 7f41b6f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41b01597f0 0x7f41b01697c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:23.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.530+0000 7f41b6f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41b015d230 0x7f41b015bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:23.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.530+0000 7f41b6f9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b0068390 con 0x7f41b01597f0 2023-10-09T07:57:23.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.530+0000 7f41b6f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b00b57b0 con 0x7f41b0159420 2023-10-09T07:57:23.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.530+0000 7f41b6f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b00685e0 con 0x7f41b015d230 2023-10-09T07:57:23.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.530+0000 7f41b579a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41b01597f0 0x7f41b01697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:23.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.530+0000 7f41b579a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41b01597f0 0x7f41b01697c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:32956/0 (socket says 172.21.15.71:32956) 2023-10-09T07:57:23.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.530+0000 7f41b579a700 1 -- 172.21.15.71:0/1103887909 learned_addr learned my addr 172.21.15.71:0/1103887909 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:23.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.530+0000 7f41b5f9b700 1 --2- 172.21.15.71:0/1103887909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41b0159420 0x7f41b01541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:23.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.530+0000 7f41b679c700 1 --2- 172.21.15.71:0/1103887909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41b015d230 0x7f41b015bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:23.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.530+0000 7f41b579a700 1 -- 172.21.15.71:0/1103887909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41b015d230 msgr2=0x7f41b015bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:23.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.530+0000 7f41b579a700 1 --2- 172.21.15.71:0/1103887909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41b015d230 0x7f41b015bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:23.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.530+0000 7f41b579a700 1 -- 172.21.15.71:0/1103887909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41b0159420 msgr2=0x7f41b01541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:23.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.530+0000 7f41b579a700 1 --2- 172.21.15.71:0/1103887909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41b0159420 0x7f41b01541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:23.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.530+0000 7f41b579a700 1 -- 172.21.15.71:0/1103887909 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac0094f0 con 0x7f41b01597f0 2023-10-09T07:57:23.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.531+0000 7f41b579a700 1 --2- 172.21.15.71:0/1103887909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41b01597f0 0x7f41b01697c0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f41a000c7c0 tx=0x7f41a0007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:23.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.531+0000 7f41a5ffb700 1 -- 172.21.15.71:0/1103887909 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a0011590 con 0x7f41b01597f0 2023-10-09T07:57:23.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.531+0000 7f41a5ffb700 1 -- 172.21.15.71:0/1103887909 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a00116f0 con 0x7f41b01597f0 2023-10-09T07:57:23.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.531+0000 7f41a5ffb700 1 -- 172.21.15.71:0/1103887909 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a0011ab0 con 0x7f41b01597f0 2023-10-09T07:57:23.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.531+0000 7f41b6f9d700 1 -- 172.21.15.71:0/1103887909 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b00688c0 con 0x7f41b01597f0 2023-10-09T07:57:23.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.531+0000 7f41b6f9d700 1 -- 172.21.15.71:0/1103887909 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b0154700 con 0x7f41b01597f0 2023-10-09T07:57:23.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.532+0000 7f41b6f9d700 1 -- 172.21.15.71:0/1103887909 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b004c3c0 con 0x7f41b01597f0 2023-10-09T07:57:23.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.533+0000 7f41a5ffb700 1 -- 172.21.15.71:0/1103887909 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 65) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f41a001b3b0 con 0x7f41b01597f0 2023-10-09T07:57:23.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.534+0000 7f41a5ffb700 1 --2- 172.21.15.71:0/1103887909 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4194067050 0x7f4194069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:23.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.534+0000 7f41a5ffb700 1 -- 172.21.15.71:0/1103887909 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6529+0+0 (secure 0 0 0) 0x7f41a0083e40 con 0x7f41b01597f0 2023-10-09T07:57:23.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.534+0000 7f41b5f9b700 1 -- 172.21.15.71:0/1103887909 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4194067050 msgr2=0x7f4194069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:23.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.534+0000 7f41b5f9b700 1 --2- 172.21.15.71:0/1103887909 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4194067050 0x7f4194069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:57:23.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.538+0000 7f41a5ffb700 1 -- 172.21.15.71:0/1103887909 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41a0050bc0 con 0x7f41b01597f0 2023-10-09T07:57:23.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.735+0000 7f41b5f9b700 1 -- 172.21.15.71:0/1103887909 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4194067050 msgr2=0x7f4194069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:23.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.735+0000 7f41b5f9b700 1 --2- 172.21.15.71:0/1103887909 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4194067050 0x7f4194069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:57:23.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.782+0000 7f41b6f9d700 1 -- 172.21.15.71:0/1103887909 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41b00b1790 con 0x7f41b01597f0 2023-10-09T07:57:23.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.783+0000 7f41a5ffb700 1 -- 172.21.15.71:0/1103887909 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f41a0017070 con 0x7f41b01597f0 2023-10-09T07:57:23.784 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:57:23.784 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/4239197200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":4239197200},{"type":"v1","addr":"172.21.15.179:6836","nonce":4239197200}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":8094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/645124077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":645124077},{"type":"v1","addr":"172.21.15.71:6833","nonce":645124077}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":8097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/542229353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":542229353},{"type":"v1","addr":"172.21.15.71:6835","nonce":542229353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:01:22.605100+0000","modified":"2023-10-09T07:01:26.163625+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/2229698291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2229698291},{"type":"v1","addr":"172.21.15.179:6834","nonce":2229698291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T07:57:23.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.785+0000 7f41b6f9d700 1 -- 172.21.15.71:0/1103887909 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4194067050 msgr2=0x7f4194069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:57:23.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.786+0000 7f41b6f9d700 1 --2- 172.21.15.71:0/1103887909 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4194067050 0x7f4194069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:23.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.786+0000 7f41b6f9d700 1 -- 172.21.15.71:0/1103887909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41b01597f0 msgr2=0x7f41b01697c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:23.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.786+0000 7f41b6f9d700 1 --2- 172.21.15.71:0/1103887909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41b01597f0 0x7f41b01697c0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f41a000c7c0 tx=0x7f41a0007f50 comp rx=0 tx=0).stop 2023-10-09T07:57:23.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.786+0000 7f41b6f9d700 1 -- 172.21.15.71:0/1103887909 shutdown_connections 2023-10-09T07:57:23.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.786+0000 7f41b6f9d700 1 --2- 172.21.15.71:0/1103887909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41b015d230 0x7f41b015bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:23.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.786+0000 7f41b6f9d700 1 --2- 172.21.15.71:0/1103887909 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4194067050 0x7f4194069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:23.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.786+0000 7f41b6f9d700 1 --2- 172.21.15.71:0/1103887909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41b0159420 0x7f41b01541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:23.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.786+0000 7f41b6f9d700 1 --2- 172.21.15.71:0/1103887909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41b01597f0 0x7f41b01697c0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:23.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.786+0000 7f41b6f9d700 1 -- 172.21.15.71:0/1103887909 >> 172.21.15.71:0/1103887909 conn(0x7f41b00d0660 msgr2=0x7f41b00b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:23.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.786+0000 7f41b6f9d700 1 -- 172.21.15.71:0/1103887909 shutdown_connections 2023-10-09T07:57:23.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.786+0000 7f41b6f9d700 1 -- 172.21.15.71:0/1103887909 wait complete. 2023-10-09T07:57:23.788 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 66 2023-10-09T07:57:23.806 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:57:23.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.997+0000 7fafa759e700 1 Processor -- start 2023-10-09T07:57:23.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.997+0000 7fafa759e700 1 -- start start 2023-10-09T07:57:24.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.999+0000 7fafa759e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fafa81597f0 0x7fafa80b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:24.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.999+0000 7fafa759e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fafa815d230 0x7fafa815d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:24.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.999+0000 7fafa759e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa815db70 con 0x7fafa8159420 2023-10-09T07:57:24.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.999+0000 7fafa759e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa80b11d0 con 0x7fafa81597f0 2023-10-09T07:57:24.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.999+0000 7fafa759e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa80b14b0 con 0x7fafa815d230 2023-10-09T07:57:24.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.999+0000 7fafa5d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fafa81597f0 0x7fafa80b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:24.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.999+0000 7fafa5d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fafa81597f0 0x7fafa80b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:32960/0 (socket says 172.21.15.71:32960) 2023-10-09T07:57:24.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.999+0000 7fafa5d9b700 1 -- 172.21.15.71:0/2896333616 learned_addr learned my addr 172.21.15.71:0/2896333616 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:24.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.999+0000 7fafa659c700 1 --1- 172.21.15.71:0/2896333616 >> v1:172.21.15.71:6789/0 conn(0x7fafa8159420 0x7fafa80b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51024/0 (socket says 172.21.15.71:51024) 2023-10-09T07:57:24.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:23.999+0000 7fafa6d9d700 1 --2- 172.21.15.71:0/2896333616 >> v2:172.21.15.179:3300/0 conn(0x7fafa815d230 0x7fafa815d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:24.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.000+0000 7fafa5d9b700 1 -- 172.21.15.71:0/2896333616 >> v2:172.21.15.179:3300/0 conn(0x7fafa815d230 msgr2=0x7fafa815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:24.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.000+0000 7fafa5d9b700 1 --2- 172.21.15.71:0/2896333616 >> v2:172.21.15.179:3300/0 conn(0x7fafa815d230 0x7fafa815d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.000+0000 7fafa5d9b700 1 -- 172.21.15.71:0/2896333616 >> v1:172.21.15.71:6789/0 conn(0x7fafa8159420 legacy=0x7fafa80b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:24.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.000+0000 7fafa5d9b700 1 -- 172.21.15.71:0/2896333616 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa80b1790 con 0x7fafa81597f0 2023-10-09T07:57:24.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.000+0000 7fafa559a700 1 -- 172.21.15.71:0/2896333616 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261064082 0 0) 0x7fafa815db70 con 0x7fafa8159420 2023-10-09T07:57:24.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.000+0000 7fafa5d9b700 1 --2- 172.21.15.71:0/2896333616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa81597f0 0x7fafa80b2270 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fafa815d170 tx=0x7faf9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3284e9aaa0445f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:24.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.000+0000 7fafa559a700 1 -- 172.21.15.71:0/2896333616 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c009e70 con 0x7fafa81597f0 2023-10-09T07:57:24.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.000+0000 7fafa559a700 1 -- 172.21.15.71:0/2896333616 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c00b860 con 0x7fafa81597f0 2023-10-09T07:57:24.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.000+0000 7fafa559a700 1 -- 172.21.15.71:0/2896333616 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c00bc00 con 0x7fafa81597f0 2023-10-09T07:57:24.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.001+0000 7fafa759e700 1 -- 172.21.15.71:0/2896333616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa81597f0 msgr2=0x7fafa80b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:24.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.001+0000 7fafa759e700 1 --2- 172.21.15.71:0/2896333616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa81597f0 0x7fafa80b2270 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fafa815d170 tx=0x7faf9c009250 comp rx=0 tx=0).stop 2023-10-09T07:57:24.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.001+0000 7fafa759e700 1 -- 172.21.15.71:0/2896333616 shutdown_connections 2023-10-09T07:57:24.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.001+0000 7fafa759e700 1 --2- 172.21.15.71:0/2896333616 >> v2:172.21.15.179:3300/0 conn(0x7fafa815d230 0x7fafa815d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.001+0000 7fafa759e700 1 --2- 172.21.15.71:0/2896333616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa81597f0 0x7fafa80b2270 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.001+0000 7fafa759e700 1 -- 172.21.15.71:0/2896333616 >> 172.21.15.71:0/2896333616 conn(0x7fafa80d0660 msgr2=0x7fafa80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:24.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.001+0000 7fafa759e700 1 -- 172.21.15.71:0/2896333616 shutdown_connections 2023-10-09T07:57:24.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.001+0000 7fafa759e700 1 -- 172.21.15.71:0/2896333616 wait complete. 2023-10-09T07:57:24.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.002+0000 7fafa759e700 1 Processor -- start 2023-10-09T07:57:24.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.003+0000 7fafa759e700 1 -- start start 2023-10-09T07:57:24.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.003+0000 7fafa759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fafa8159420 0x7fafa8147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:24.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.003+0000 7fafa759e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafa81597f0 0x7fafa80c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:24.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.003+0000 7fafa759e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa815d230 0x7fafa8169cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:24.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.003+0000 7fafa759e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa815bf90 con 0x7fafa815d230 2023-10-09T07:57:24.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.003+0000 7fafa759e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa81476a0 con 0x7fafa81597f0 2023-10-09T07:57:24.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.003+0000 7fafa759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa80c5940 con 0x7fafa8159420 2023-10-09T07:57:24.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.004+0000 7fafa6d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa815d230 0x7fafa8169cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:24.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.004+0000 7fafa6d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa815d230 0x7fafa8169cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:32964/0 (socket says 172.21.15.71:32964) 2023-10-09T07:57:24.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.004+0000 7fafa5d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafa81597f0 0x7fafa80c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:24.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.004+0000 7fafa6d9d700 1 -- 172.21.15.71:0/3940996880 learned_addr learned my addr 172.21.15.71:0/3940996880 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:24.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.004+0000 7fafa659c700 1 --2- 172.21.15.71:0/3940996880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fafa8159420 0x7fafa8147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:24.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.004+0000 7fafa5d9b700 1 -- 172.21.15.71:0/3940996880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fafa8159420 msgr2=0x7fafa8147160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:24.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.004+0000 7fafa5d9b700 1 --2- 172.21.15.71:0/3940996880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fafa8159420 0x7fafa8147160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.004+0000 7fafa5d9b700 1 -- 172.21.15.71:0/3940996880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa815d230 msgr2=0x7fafa8169cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:24.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.004+0000 7fafa5d9b700 1 --2- 172.21.15.71:0/3940996880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa815d230 0x7fafa8169cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.004+0000 7fafa5d9b700 1 -- 172.21.15.71:0/3940996880 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c0094f0 con 0x7fafa81597f0 2023-10-09T07:57:24.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.004+0000 7fafa6d9d700 1 --2- 172.21.15.71:0/3940996880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa815d230 0x7fafa8169cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:57:24.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.005+0000 7fafa5d9b700 1 --2- 172.21.15.71:0/3940996880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafa81597f0 0x7fafa80c5400 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7faf9c013000 tx=0x7faf9c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:24.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.005+0000 7faf967fc700 1 -- 172.21.15.71:0/3940996880 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c000c90 con 0x7fafa81597f0 2023-10-09T07:57:24.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.005+0000 7faf967fc700 1 -- 172.21.15.71:0/3940996880 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c00b9d0 con 0x7fafa81597f0 2023-10-09T07:57:24.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.005+0000 7faf967fc700 1 -- 172.21.15.71:0/3940996880 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c025420 con 0x7fafa81597f0 2023-10-09T07:57:24.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.005+0000 7fafa759e700 1 -- 172.21.15.71:0/3940996880 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa815bb00 con 0x7fafa81597f0 2023-10-09T07:57:24.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.005+0000 7fafa759e700 1 -- 172.21.15.71:0/3940996880 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa815b1d0 con 0x7fafa81597f0 2023-10-09T07:57:24.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.006+0000 7fafa759e700 1 -- 172.21.15.71:0/3940996880 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa804c3c0 con 0x7fafa81597f0 2023-10-09T07:57:24.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.007+0000 7faf967fc700 1 -- 172.21.15.71:0/3940996880 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 65) v1 ==== 84854+0+0 (secure 0 0 0) 0x7faf9c023070 con 0x7fafa81597f0 2023-10-09T07:57:24.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.008+0000 7faf967fc700 1 --2- 172.21.15.71:0/3940996880 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7faf88067050 0x7faf88069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:24.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.008+0000 7faf967fc700 1 -- 172.21.15.71:0/3940996880 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6529+0+0 (secure 0 0 0) 0x7faf9c085ed0 con 0x7fafa81597f0 2023-10-09T07:57:24.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.008+0000 7fafa659c700 1 -- 172.21.15.71:0/3940996880 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7faf88067050 msgr2=0x7faf88069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:24.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.008+0000 7fafa659c700 1 --2- 172.21.15.71:0/3940996880 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7faf88067050 0x7faf88069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:57:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.012+0000 7faf967fc700 1 -- 172.21.15.71:0/3940996880 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf9c052c50 con 0x7fafa81597f0 2023-10-09T07:57:24.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.209+0000 7fafa659c700 1 -- 172.21.15.71:0/3940996880 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7faf88067050 msgr2=0x7faf88069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:24.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.209+0000 7fafa659c700 1 --2- 172.21.15.71:0/3940996880 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7faf88067050 0x7faf88069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:57:24.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.213+0000 7fafa759e700 1 -- 172.21.15.71:0/3940996880 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafa80b1b00 con 0x7fafa81597f0 2023-10-09T07:57:24.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.214+0000 7faf967fc700 1 -- 172.21.15.71:0/3940996880 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+16638 (secure 0 0 0) 0x7faf9c015090 con 0x7fafa81597f0 2023-10-09T07:57:24.216 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:57:24.216 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":149,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:57:23.918585+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:01:20.274329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T07:01:21.592220+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":149,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.7","mappings":[{"from":0,"to":2}]},{"pgid":"17.18","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6837/85452":"2023-10-10T07:01:42.900662+0000","172.21.15.179:0/3101119155":"2023-10-10T07:01:42.900662+0000","172.21.15.179:0/2925808610":"2023-10-10T07:01:42.900662+0000","172.21.15.179:6835/85452":"2023-10-10T07:01:42.900662+0000","172.21.15.179:0/573738858":"2023-10-10T07:01:42.900662+0000","172.21.15.179:0/1903715929":"2023-10-10T07:01:42.900662+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":57,"length":1},{"begin":113,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:57:24.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.217+0000 7fafa759e700 1 -- 172.21.15.71:0/3940996880 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7faf88067050 msgr2=0x7faf88069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:57:24.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.217+0000 7fafa759e700 1 --2- 172.21.15.71:0/3940996880 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7faf88067050 0x7faf88069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.217+0000 7fafa759e700 1 -- 172.21.15.71:0/3940996880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafa81597f0 msgr2=0x7fafa80c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:24.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.217+0000 7fafa759e700 1 --2- 172.21.15.71:0/3940996880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafa81597f0 0x7fafa80c5400 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7faf9c013000 tx=0x7faf9c017000 comp rx=0 tx=0).stop 2023-10-09T07:57:24.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.217+0000 7fafa759e700 1 -- 172.21.15.71:0/3940996880 shutdown_connections 2023-10-09T07:57:24.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.217+0000 7fafa759e700 1 --2- 172.21.15.71:0/3940996880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafa815d230 0x7fafa8169cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.217+0000 7fafa759e700 1 --2- 172.21.15.71:0/3940996880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fafa8159420 0x7fafa8147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.217+0000 7fafa759e700 1 --2- 172.21.15.71:0/3940996880 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7faf88067050 0x7faf88069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.217+0000 7fafa759e700 1 --2- 172.21.15.71:0/3940996880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafa81597f0 0x7fafa80c5400 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.217+0000 7fafa759e700 1 -- 172.21.15.71:0/3940996880 >> 172.21.15.71:0/3940996880 conn(0x7fafa80d0660 msgr2=0x7fafa8157ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:24.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.217+0000 7fafa759e700 1 -- 172.21.15.71:0/3940996880 shutdown_connections 2023-10-09T07:57:24.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.217+0000 7fafa759e700 1 -- 172.21.15.71:0/3940996880 wait complete. 2023-10-09T07:57:24.236 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T07:01:20.274329+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '136', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T07:01:21.592220+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '149', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 113, 'snap_epoch': 149, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T07:57:24.237 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T07:57:24.268 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:24.268+0000 7fc37e124180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T07:57:24.305 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:24.304+0000 7f94d5995180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T07:57:24.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.426+0000 7f8bee59d700 1 Processor -- start 2023-10-09T07:57:24.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.426+0000 7f8bee59d700 1 -- start start 2023-10-09T07:57:24.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.427+0000 7f8bee59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be80b4e70 0x7f8be80ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:24.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.427+0000 7f8bee59d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8be80b16d0 0x7f8be80b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:24.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.427+0000 7f8bee59d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be80b2080 con 0x7f8be815d240 2023-10-09T07:57:24.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.427+0000 7f8bee59d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be80cfb00 con 0x7f8be80b16d0 2023-10-09T07:57:24.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.427+0000 7f8bee59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be80b5c40 con 0x7f8be80b4e70 2023-10-09T07:57:24.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.428+0000 7f8bed59b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be80b4e70 0x7f8be80ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:24.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.428+0000 7f8bed59b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be80b4e70 0x7f8be80ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:35558/0 (socket says 172.21.15.71:35558) 2023-10-09T07:57:24.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.428+0000 7f8bed59b700 1 -- 172.21.15.71:0/2902641793 learned_addr learned my addr 172.21.15.71:0/2902641793 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:24.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.428+0000 7f8bedd9c700 1 --1- 172.21.15.71:0/2902641793 >> v1:172.21.15.179:6789/0 conn(0x7f8be815d240 0x7f8be815d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:35008/0 (socket says 172.21.15.71:35008) 2023-10-09T07:57:24.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.428+0000 7f8becd9a700 1 --2- 172.21.15.71:0/2902641793 >> v2:172.21.15.179:3300/0 conn(0x7f8be80b16d0 0x7f8be80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:24.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.428+0000 7f8bdffff700 1 -- 172.21.15.71:0/2902641793 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226958038 0 0) 0x7f8be80b2080 con 0x7f8be815d240 2023-10-09T07:57:24.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.428+0000 7f8bdffff700 1 -- 172.21.15.71:0/2902641793 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bd4003570 con 0x7f8be815d240 2023-10-09T07:57:24.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.428+0000 7f8bed59b700 1 -- 172.21.15.71:0/2902641793 >> v2:172.21.15.179:3300/0 conn(0x7f8be80b16d0 msgr2=0x7f8be80b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:24.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.428+0000 7f8bed59b700 1 --2- 172.21.15.71:0/2902641793 >> v2:172.21.15.179:3300/0 conn(0x7f8be80b16d0 0x7f8be80b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.428+0000 7f8bed59b700 1 -- 172.21.15.71:0/2902641793 >> v1:172.21.15.179:6789/0 conn(0x7f8be815d240 legacy=0x7f8be815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:24.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.428+0000 7f8bed59b700 1 -- 172.21.15.71:0/2902641793 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be80b5f20 con 0x7f8be80b4e70 2023-10-09T07:57:24.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.428+0000 7f8becd9a700 1 --2- 172.21.15.71:0/2902641793 >> v2:172.21.15.179:3300/0 conn(0x7f8be80b16d0 0x7f8be80b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:57:24.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.429+0000 7f8bed59b700 1 --2- 172.21.15.71:0/2902641793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be80b4e70 0x7f8be80ccff0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8be40099b0 tx=0x7f8be4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdf3fd2943174120 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:24.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.429+0000 7f8bdffff700 1 -- 172.21.15.71:0/2902641793 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be400b680 con 0x7f8be80b4e70 2023-10-09T07:57:24.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.429+0000 7f8bdffff700 1 -- 172.21.15.71:0/2902641793 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be400b7e0 con 0x7f8be80b4e70 2023-10-09T07:57:24.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.429+0000 7f8bdffff700 1 -- 172.21.15.71:0/2902641793 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be400bb80 con 0x7f8be80b4e70 2023-10-09T07:57:24.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.429+0000 7f8bee59d700 1 -- 172.21.15.71:0/2902641793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be80b4e70 msgr2=0x7f8be80ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:24.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.430+0000 7f8bee59d700 1 --2- 172.21.15.71:0/2902641793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be80b4e70 0x7f8be80ccff0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8be40099b0 tx=0x7f8be4009250 comp rx=0 tx=0).stop 2023-10-09T07:57:24.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.430+0000 7f8bee59d700 1 -- 172.21.15.71:0/2902641793 shutdown_connections 2023-10-09T07:57:24.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.430+0000 7f8bee59d700 1 --2- 172.21.15.71:0/2902641793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be80b4e70 0x7f8be80ccff0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.430+0000 7f8bee59d700 1 --2- 172.21.15.71:0/2902641793 >> v2:172.21.15.179:3300/0 conn(0x7f8be80b16d0 0x7f8be80b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.430+0000 7f8bee59d700 1 -- 172.21.15.71:0/2902641793 >> 172.21.15.71:0/2902641793 conn(0x7f8be80d10c0 msgr2=0x7f8be80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:24.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.430+0000 7f8bee59d700 1 -- 172.21.15.71:0/2902641793 shutdown_connections 2023-10-09T07:57:24.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.430+0000 7f8bee59d700 1 -- 172.21.15.71:0/2902641793 wait complete. 2023-10-09T07:57:24.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.431+0000 7f8bee59d700 1 Processor -- start 2023-10-09T07:57:24.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.431+0000 7f8bee59d700 1 -- start start 2023-10-09T07:57:24.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.432+0000 7f8bee59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8be80b16d0 0x7f8be81527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:24.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.432+0000 7f8bee59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be80b4e70 0x7f8be815b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:24.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.432+0000 7f8bee59d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8be815d240 0x7f8be815a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:24.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.432+0000 7f8bee59d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be8152dd0 con 0x7f8be815d240 2023-10-09T07:57:24.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.432+0000 7f8bee59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be81530b0 con 0x7f8be80b16d0 2023-10-09T07:57:24.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.432+0000 7f8bee59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be8153390 con 0x7f8be80b4e70 2023-10-09T07:57:24.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.432+0000 7f8bedd9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8be815d240 0x7f8be815a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:24.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.432+0000 7f8bed59b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8be80b16d0 0x7f8be81527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:24.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.433+0000 7f8bedd9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8be815d240 0x7f8be815a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:32968/0 (socket says 172.21.15.71:32968) 2023-10-09T07:57:24.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.433+0000 7f8bed59b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8be80b16d0 0x7f8be81527e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:48024/0 (socket says 172.21.15.71:48024) 2023-10-09T07:57:24.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.433+0000 7f8bedd9c700 1 -- 172.21.15.71:0/2039503829 learned_addr learned my addr 172.21.15.71:0/2039503829 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:24.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.433+0000 7f8becd9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be80b4e70 0x7f8be815b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:24.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.433+0000 7f8bedd9c700 1 -- 172.21.15.71:0/2039503829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be80b4e70 msgr2=0x7f8be815b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:24.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.433+0000 7f8bedd9c700 1 --2- 172.21.15.71:0/2039503829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be80b4e70 0x7f8be815b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.433+0000 7f8bedd9c700 1 -- 172.21.15.71:0/2039503829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8be80b16d0 msgr2=0x7f8be81527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:24.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.433+0000 7f8bedd9c700 1 --2- 172.21.15.71:0/2039503829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8be80b16d0 0x7f8be81527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.433+0000 7f8bedd9c700 1 -- 172.21.15.71:0/2039503829 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd8009420 con 0x7f8be815d240 2023-10-09T07:57:24.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.433+0000 7f8bedd9c700 1 --2- 172.21.15.71:0/2039503829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8be815d240 0x7f8be815a300 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f8be000cd30 tx=0x7f8be0001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:24.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.433+0000 7f8bdd7fa700 1 -- 172.21.15.71:0/2039503829 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be000ce30 con 0x7f8be815d240 2023-10-09T07:57:24.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.433+0000 7f8bdd7fa700 1 -- 172.21.15.71:0/2039503829 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be0005df0 con 0x7f8be815d240 2023-10-09T07:57:24.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.433+0000 7f8bee59d700 1 -- 172.21.15.71:0/2039503829 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be40094f0 con 0x7f8be815d240 2023-10-09T07:57:24.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.434+0000 7f8bdd7fa700 1 -- 172.21.15.71:0/2039503829 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be000aac0 con 0x7f8be815d240 2023-10-09T07:57:24.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.434+0000 7f8bee59d700 1 -- 172.21.15.71:0/2039503829 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be8153950 con 0x7f8be815d240 2023-10-09T07:57:24.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.435+0000 7f8bee59d700 1 -- 172.21.15.71:0/2039503829 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be8088990 con 0x7f8be815d240 2023-10-09T07:57:24.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.436+0000 7f8bdd7fa700 1 -- 172.21.15.71:0/2039503829 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 65) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f8be00070f0 con 0x7f8be815d240 2023-10-09T07:57:24.440 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:24.435+0000 7fc37e124180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T07:57:24.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.437+0000 7f8bdd7fa700 1 --2- 172.21.15.71:0/2039503829 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8bcc067050 0x7f8bcc069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:24.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.437+0000 7f8bdd7fa700 1 -- 172.21.15.71:0/2039503829 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6529+0+0 (secure 0 0 0) 0x7f8be0084b70 con 0x7f8be815d240 2023-10-09T07:57:24.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.437+0000 7f8bed59b700 1 -- 172.21.15.71:0/2039503829 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8bcc067050 msgr2=0x7f8bcc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:24.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.437+0000 7f8bed59b700 1 --2- 172.21.15.71:0/2039503829 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8bcc067050 0x7f8bcc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:57:24.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.441+0000 7f8bdd7fa700 1 -- 172.21.15.71:0/2039503829 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8be0051860 con 0x7f8be815d240 2023-10-09T07:57:24.477 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:24.477+0000 7f94d5995180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T07:57:24.525 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:24.525+0000 7fc37e124180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T07:57:24.570 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:24.569+0000 7f94d5995180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T07:57:24.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.638+0000 7f8bed59b700 1 -- 172.21.15.71:0/2039503829 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8bcc067050 msgr2=0x7f8bcc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:24.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.638+0000 7f8bed59b700 1 --2- 172.21.15.71:0/2039503829 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8bcc067050 0x7f8bcc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:57:24.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.642+0000 7f8bee59d700 1 -- 172.21.15.71:0/2039503829 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8be804bb80 con 0x7f8be815d240 2023-10-09T07:57:24.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.647+0000 7f8bdd7fa700 1 -- 172.21.15.71:0/2039503829 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v150) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8be0054e80 con 0x7f8be815d240 2023-10-09T07:57:24.648 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T07:57:24.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.650+0000 7f8bee59d700 1 -- 172.21.15.71:0/2039503829 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8bcc067050 msgr2=0x7f8bcc069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:57:24.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.650+0000 7f8bee59d700 1 --2- 172.21.15.71:0/2039503829 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8bcc067050 0x7f8bcc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.650+0000 7f8bee59d700 1 -- 172.21.15.71:0/2039503829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8be815d240 msgr2=0x7f8be815a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:24.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.650+0000 7f8bee59d700 1 --2- 172.21.15.71:0/2039503829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8be815d240 0x7f8be815a300 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f8be000cd30 tx=0x7f8be0001ac0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.651+0000 7f8bee59d700 1 -- 172.21.15.71:0/2039503829 shutdown_connections 2023-10-09T07:57:24.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.651+0000 7f8bee59d700 1 --2- 172.21.15.71:0/2039503829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8be815d240 0x7f8be815a300 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.651+0000 7f8bee59d700 1 --2- 172.21.15.71:0/2039503829 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8bcc067050 0x7f8bcc069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.651+0000 7f8bee59d700 1 --2- 172.21.15.71:0/2039503829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8be80b16d0 0x7f8be81527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.651+0000 7f8bee59d700 1 --2- 172.21.15.71:0/2039503829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be80b4e70 0x7f8be815b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.651+0000 7f8bee59d700 1 -- 172.21.15.71:0/2039503829 >> 172.21.15.71:0/2039503829 conn(0x7f8be80d10c0 msgr2=0x7f8be80cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:24.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.651+0000 7f8bee59d700 1 -- 172.21.15.71:0/2039503829 shutdown_connections 2023-10-09T07:57:24.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.651+0000 7f8bee59d700 1 -- 172.21.15.71:0/2039503829 wait complete. 2023-10-09T07:57:24.670 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T07:57:24.754 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:24.754+0000 7fc37e124180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:57:24.806 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:24.805+0000 7f94d5995180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:57:24.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.858+0000 7f6d9699d700 1 Processor -- start 2023-10-09T07:57:24.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.858+0000 7f6d9699d700 1 -- start start 2023-10-09T07:57:24.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.859+0000 7f6d9699d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6d900b4e70 0x7f6d900ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:24.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.860+0000 7f6d9699d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d900cfb00 con 0x7f6d900b1b40 2023-10-09T07:57:24.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.860+0000 7f6d9699d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9015e060 con 0x7f6d900b16d0 2023-10-09T07:57:24.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.860+0000 7f6d9699d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d900b5c40 con 0x7f6d900b4e70 2023-10-09T07:57:24.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.860+0000 7f6d9619c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6d900b1b40 0x7f6d9015d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:51040/0 (socket says 172.21.15.71:51040) 2023-10-09T07:57:24.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.860+0000 7f6d9619c700 1 -- 172.21.15.71:0/2129356209 learned_addr learned my addr 172.21.15.71:0/2129356209 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:24.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.860+0000 7f6d9599b700 1 --2- 172.21.15.71:0/2129356209 >> v2:172.21.15.179:3300/0 conn(0x7f6d900b4e70 0x7f6d900ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:24.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.860+0000 7f6d94999700 1 -- 172.21.15.71:0/2129356209 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 77156253 0 0) 0x7f6d900cfb00 con 0x7f6d900b1b40 2023-10-09T07:57:24.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.860+0000 7f6d94999700 1 -- 172.21.15.71:0/2129356209 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d7c003570 con 0x7f6d900b1b40 2023-10-09T07:57:24.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.860+0000 7f6d94999700 1 -- 172.21.15.71:0/2129356209 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730045046 0 0) 0x7f6d9015e060 con 0x7f6d900b16d0 2023-10-09T07:57:24.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.861+0000 7f6d94999700 1 -- 172.21.15.71:0/2129356209 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d900cfb00 con 0x7f6d900b16d0 2023-10-09T07:57:24.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.861+0000 7f6d9599b700 1 -- 172.21.15.71:0/2129356209 >> v1:172.21.15.179:6789/0 conn(0x7f6d900b16d0 legacy=0x7f6d9015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:24.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.861+0000 7f6d9599b700 1 -- 172.21.15.71:0/2129356209 >> v1:172.21.15.71:6789/0 conn(0x7f6d900b1b40 legacy=0x7f6d9015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:24.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.861+0000 7f6d9599b700 1 -- 172.21.15.71:0/2129356209 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d900b5f20 con 0x7f6d900b4e70 2023-10-09T07:57:24.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.861+0000 7f6d9599b700 1 --2- 172.21.15.71:0/2129356209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d900b4e70 0x7f6d900ccff0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0098e0 tx=0x7f6d8c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35be596070c2f1d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:24.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.861+0000 7f6d94999700 1 -- 172.21.15.71:0/2129356209 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c011630 con 0x7f6d900b4e70 2023-10-09T07:57:24.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.861+0000 7f6d94999700 1 -- 172.21.15.71:0/2129356209 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c011790 con 0x7f6d900b4e70 2023-10-09T07:57:24.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.861+0000 7f6d94999700 1 -- 172.21.15.71:0/2129356209 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c011b30 con 0x7f6d900b4e70 2023-10-09T07:57:24.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.862+0000 7f6d9699d700 1 -- 172.21.15.71:0/2129356209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d900b4e70 msgr2=0x7f6d900ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:24.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.862+0000 7f6d9699d700 1 --2- 172.21.15.71:0/2129356209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d900b4e70 0x7f6d900ccff0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0098e0 tx=0x7f6d8c0091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.862+0000 7f6d9699d700 1 -- 172.21.15.71:0/2129356209 shutdown_connections 2023-10-09T07:57:24.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.862+0000 7f6d9699d700 1 --2- 172.21.15.71:0/2129356209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d900b4e70 0x7f6d900ccff0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.862+0000 7f6d9699d700 1 -- 172.21.15.71:0/2129356209 >> 172.21.15.71:0/2129356209 conn(0x7f6d900d10c0 msgr2=0x7f6d900affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:24.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.862+0000 7f6d9699d700 1 -- 172.21.15.71:0/2129356209 shutdown_connections 2023-10-09T07:57:24.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.862+0000 7f6d9699d700 1 -- 172.21.15.71:0/2129356209 wait complete. 2023-10-09T07:57:24.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.863+0000 7f6d9699d700 1 Processor -- start 2023-10-09T07:57:24.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.863+0000 7f6d9699d700 1 -- start start 2023-10-09T07:57:24.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.864+0000 7f6d9699d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d900b16d0 0x7f6d900af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:24.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.864+0000 7f6d9699d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d900b1b40 0x7f6d900c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:24.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.864+0000 7f6d9699d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d900b4e70 0x7f6d900c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:24.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.864+0000 7f6d9699d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d900c7830 con 0x7f6d900b1b40 2023-10-09T07:57:24.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.864+0000 7f6d9699d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d900c7b10 con 0x7f6d900b4e70 2023-10-09T07:57:24.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.864+0000 7f6d9699d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d900c9140 con 0x7f6d900b16d0 2023-10-09T07:57:24.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.865+0000 7f6d9519a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d900b1b40 0x7f6d900c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:24.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.865+0000 7f6d9599b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d900b16d0 0x7f6d900af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:24.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.865+0000 7f6d9519a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d900b1b40 0x7f6d900c6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:32972/0 (socket says 172.21.15.71:32972) 2023-10-09T07:57:24.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.865+0000 7f6d9519a700 1 -- 172.21.15.71:0/2806816536 learned_addr learned my addr 172.21.15.71:0/2806816536 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:24.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.865+0000 7f6d9619c700 1 --2- 172.21.15.71:0/2806816536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d900b4e70 0x7f6d900c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:24.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.865+0000 7f6d9519a700 1 -- 172.21.15.71:0/2806816536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d900b16d0 msgr2=0x7f6d900af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:24.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.865+0000 7f6d9519a700 1 --2- 172.21.15.71:0/2806816536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d900b16d0 0x7f6d900af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.865+0000 7f6d9519a700 1 -- 172.21.15.71:0/2806816536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d900b4e70 msgr2=0x7f6d900c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:24.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.865+0000 7f6d9519a700 1 --2- 172.21.15.71:0/2806816536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d900b4e70 0x7f6d900c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:24.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.865+0000 7f6d9519a700 1 -- 172.21.15.71:0/2806816536 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c009420 con 0x7f6d900b1b40 2023-10-09T07:57:24.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.865+0000 7f6d9519a700 1 --2- 172.21.15.71:0/2806816536 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d900b1b40 0x7f6d900c6d10 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000c790 tx=0x7f6d80007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:24.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.866+0000 7f6d85ffb700 1 -- 172.21.15.71:0/2806816536 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80010510 con 0x7f6d900b1b40 2023-10-09T07:57:24.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.866+0000 7f6d85ffb700 1 -- 172.21.15.71:0/2806816536 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d80010670 con 0x7f6d900b1b40 2023-10-09T07:57:24.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.866+0000 7f6d9699d700 1 -- 172.21.15.71:0/2806816536 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d900c9420 con 0x7f6d900b1b40 2023-10-09T07:57:24.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.866+0000 7f6d85ffb700 1 -- 172.21.15.71:0/2806816536 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80010a10 con 0x7f6d900b1b40 2023-10-09T07:57:24.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.866+0000 7f6d9699d700 1 -- 172.21.15.71:0/2806816536 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d90157e80 con 0x7f6d900b1b40 2023-10-09T07:57:24.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.867+0000 7f6d9699d700 1 -- 172.21.15.71:0/2806816536 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d900c9660 con 0x7f6d900b1b40 2023-10-09T07:57:24.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.868+0000 7f6d85ffb700 1 -- 172.21.15.71:0/2806816536 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 65) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f6d8001b3b0 con 0x7f6d900b1b40 2023-10-09T07:57:24.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.868+0000 7f6d85ffb700 1 --2- 172.21.15.71:0/2806816536 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6d74067050 0x7f6d74069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:24.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.869+0000 7f6d85ffb700 1 -- 172.21.15.71:0/2806816536 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6529+0+0 (secure 0 0 0) 0x7f6d80084250 con 0x7f6d900b1b40 2023-10-09T07:57:24.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.869+0000 7f6d9599b700 1 -- 172.21.15.71:0/2806816536 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6d74067050 msgr2=0x7f6d74069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:24.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.869+0000 7f6d9599b700 1 --2- 172.21.15.71:0/2806816536 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6d74067050 0x7f6d74069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:57:24.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:24.873+0000 7f6d85ffb700 1 -- 172.21.15.71:0/2806816536 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d900c9660 con 0x7f6d900b1b40 2023-10-09T07:57:24.932 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:24.932+0000 7fc37e124180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T07:57:24.991 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:24.990+0000 7f94d5995180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T07:57:25.024 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:25.024+0000 7fc37e124180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T07:57:25.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.069+0000 7f6d9699d700 1 -- 172.21.15.71:0/2806816536 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6d900c9660 con 0x7f6d900b1b40 2023-10-09T07:57:25.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.070+0000 7f6d9599b700 1 -- 172.21.15.71:0/2806816536 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6d74067050 msgr2=0x7f6d74069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:25.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.070+0000 7f6d9599b700 1 --2- 172.21.15.71:0/2806816536 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6d74067050 0x7f6d74069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:57:25.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.070+0000 7f6d85ffb700 1 -- 172.21.15.71:0/2806816536 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v150) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6d900c9660 con 0x7f6d900b1b40 2023-10-09T07:57:25.071 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-09T07:57:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.072+0000 7f6d9699d700 1 -- 172.21.15.71:0/2806816536 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6d74067050 msgr2=0x7f6d74069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:57:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.072+0000 7f6d9699d700 1 --2- 172.21.15.71:0/2806816536 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6d74067050 0x7f6d74069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.072+0000 7f6d9699d700 1 -- 172.21.15.71:0/2806816536 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d900b1b40 msgr2=0x7f6d900c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.072+0000 7f6d9699d700 1 --2- 172.21.15.71:0/2806816536 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d900b1b40 0x7f6d900c6d10 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000c790 tx=0x7f6d80007e10 comp rx=0 tx=0).stop 2023-10-09T07:57:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.072+0000 7f6d9699d700 1 -- 172.21.15.71:0/2806816536 shutdown_connections 2023-10-09T07:57:25.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.072+0000 7f6d9699d700 1 --2- 172.21.15.71:0/2806816536 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6d74067050 0x7f6d74069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.072+0000 7f6d9699d700 1 --2- 172.21.15.71:0/2806816536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d900b4e70 0x7f6d900c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.072+0000 7f6d9699d700 1 --2- 172.21.15.71:0/2806816536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d900b16d0 0x7f6d900af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.072+0000 7f6d9699d700 1 --2- 172.21.15.71:0/2806816536 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d900b1b40 0x7f6d900c6d10 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.072+0000 7f6d9699d700 1 -- 172.21.15.71:0/2806816536 >> 172.21.15.71:0/2806816536 conn(0x7f6d900d10c0 msgr2=0x7f6d90159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:25.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.072+0000 7f6d9699d700 1 -- 172.21.15.71:0/2806816536 shutdown_connections 2023-10-09T07:57:25.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.072+0000 7f6d9699d700 1 -- 172.21.15.71:0/2806816536 wait complete. 2023-10-09T07:57:25.085 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:25.084+0000 7f94d5995180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T07:57:25.090 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T07:57:25.187 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:25.187+0000 7fc37e124180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T07:57:25.255 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:25.254+0000 7f94d5995180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T07:57:25.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.280+0000 7f97f1d9d700 1 Processor -- start 2023-10-09T07:57:25.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.280+0000 7f97f1d9d700 1 -- start start 2023-10-09T07:57:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.282+0000 7f97f1d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ec15a3b0 0x7f97ec15a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.282+0000 7f97f1d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f97ec0aef00 0x7f97ec15d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.282+0000 7f97f1d9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ec0aea70 con 0x7f97ec06e470 2023-10-09T07:57:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.282+0000 7f97f1d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ec0ae480 con 0x7f97ec0aef00 2023-10-09T07:57:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.282+0000 7f97f1d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec15acc0 con 0x7f97ec15a3b0 2023-10-09T07:57:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.282+0000 7f97f159c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f97ec06e470 0x7f97ec0c7280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54014/0 (socket says 172.21.15.71:54014) 2023-10-09T07:57:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.282+0000 7f97f159c700 1 -- 172.21.15.71:0/2300023057 learned_addr learned my addr 172.21.15.71:0/2300023057 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.282+0000 7f97ebfff700 1 --2- 172.21.15.71:0/2300023057 >> v2:172.21.15.179:3300/0 conn(0x7f97ec0aef00 0x7f97ec15d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:25.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.282+0000 7f97f0d9b700 1 --2- 172.21.15.71:0/2300023057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ec15a3b0 0x7f97ec15a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.282+0000 7f97eb7fe700 1 -- 172.21.15.71:0/2300023057 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657022048 0 0) 0x7f97ec0aea70 con 0x7f97ec06e470 2023-10-09T07:57:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.282+0000 7f97eb7fe700 1 -- 172.21.15.71:0/2300023057 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97dc003570 con 0x7f97ec06e470 2023-10-09T07:57:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.283+0000 7f97f0d9b700 1 -- 172.21.15.71:0/2300023057 >> v2:172.21.15.179:3300/0 conn(0x7f97ec0aef00 msgr2=0x7f97ec15d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.283+0000 7f97f0d9b700 1 --2- 172.21.15.71:0/2300023057 >> v2:172.21.15.179:3300/0 conn(0x7f97ec0aef00 0x7f97ec15d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.283+0000 7f97f0d9b700 1 -- 172.21.15.71:0/2300023057 >> v1:172.21.15.71:6789/0 conn(0x7f97ec06e470 legacy=0x7f97ec0c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.283+0000 7f97f0d9b700 1 -- 172.21.15.71:0/2300023057 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec15dd30 con 0x7f97ec15a3b0 2023-10-09T07:57:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.283+0000 7f97ebfff700 1 --2- 172.21.15.71:0/2300023057 >> v2:172.21.15.179:3300/0 conn(0x7f97ec0aef00 0x7f97ec15d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:57:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.283+0000 7f97f0d9b700 1 --2- 172.21.15.71:0/2300023057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ec15a3b0 0x7f97ec15a780 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f97e00098e0 tx=0x7f97e00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b864b8bbd7a864ad server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.283+0000 7f97eb7fe700 1 -- 172.21.15.71:0/2300023057 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e0011630 con 0x7f97ec15a3b0 2023-10-09T07:57:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.283+0000 7f97eb7fe700 1 -- 172.21.15.71:0/2300023057 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e0011790 con 0x7f97ec15a3b0 2023-10-09T07:57:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.283+0000 7f97eb7fe700 1 -- 172.21.15.71:0/2300023057 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e0011b30 con 0x7f97ec15a3b0 2023-10-09T07:57:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.284+0000 7f97f1d9d700 1 -- 172.21.15.71:0/2300023057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ec15a3b0 msgr2=0x7f97ec15a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.284+0000 7f97f1d9d700 1 --2- 172.21.15.71:0/2300023057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ec15a3b0 0x7f97ec15a780 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f97e00098e0 tx=0x7f97e00091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.284+0000 7f97f1d9d700 1 -- 172.21.15.71:0/2300023057 shutdown_connections 2023-10-09T07:57:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.284+0000 7f97f1d9d700 1 --2- 172.21.15.71:0/2300023057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ec15a3b0 0x7f97ec15a780 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.284+0000 7f97f1d9d700 1 --2- 172.21.15.71:0/2300023057 >> v2:172.21.15.179:3300/0 conn(0x7f97ec0aef00 0x7f97ec15d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.284+0000 7f97f1d9d700 1 -- 172.21.15.71:0/2300023057 >> 172.21.15.71:0/2300023057 conn(0x7f97ec0c9f70 msgr2=0x7f97ec06dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.284+0000 7f97f1d9d700 1 -- 172.21.15.71:0/2300023057 shutdown_connections 2023-10-09T07:57:25.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.284+0000 7f97f1d9d700 1 -- 172.21.15.71:0/2300023057 wait complete. 2023-10-09T07:57:25.287 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:25.286+0000 7fc37e124180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T07:57:25.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.285+0000 7f97f1d9d700 1 Processor -- start 2023-10-09T07:57:25.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.285+0000 7f97f1d9d700 1 -- start start 2023-10-09T07:57:25.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.286+0000 7f97f1d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97ec06e470 0x7f97ec0b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:25.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.286+0000 7f97f1d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97ec0aef00 0x7f97ec169b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:25.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.286+0000 7f97f1d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ec15a3b0 0x7f97ec16a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:25.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.286+0000 7f97f1d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec153c00 con 0x7f97ec0aef00 2023-10-09T07:57:25.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.286+0000 7f97f1d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec0c3f80 con 0x7f97ec06e470 2023-10-09T07:57:25.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.286+0000 7f97f1d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec0b1950 con 0x7f97ec15a3b0 2023-10-09T07:57:25.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.287+0000 7f97ebfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97ec0aef00 0x7f97ec169b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:25.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.287+0000 7f97f0d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97ec06e470 0x7f97ec0b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:25.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.287+0000 7f97ebfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97ec0aef00 0x7f97ec169b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48470/0 (socket says 172.21.15.71:48470) 2023-10-09T07:57:25.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.287+0000 7f97ebfff700 1 -- 172.21.15.71:0/714707392 learned_addr learned my addr 172.21.15.71:0/714707392 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:25.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.287+0000 7f97f159c700 1 --2- 172.21.15.71:0/714707392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ec15a3b0 0x7f97ec16a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:25.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.287+0000 7f97ebfff700 1 -- 172.21.15.71:0/714707392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ec15a3b0 msgr2=0x7f97ec16a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:25.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.287+0000 7f97ebfff700 1 --2- 172.21.15.71:0/714707392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ec15a3b0 0x7f97ec16a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.287+0000 7f97ebfff700 1 -- 172.21.15.71:0/714707392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97ec06e470 msgr2=0x7f97ec0b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:25.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.287+0000 7f97ebfff700 1 --2- 172.21.15.71:0/714707392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97ec06e470 0x7f97ec0b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.287+0000 7f97ebfff700 1 -- 172.21.15.71:0/714707392 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d8009420 con 0x7f97ec0aef00 2023-10-09T07:57:25.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.287+0000 7f97f0d9b700 1 --2- 172.21.15.71:0/714707392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97ec06e470 0x7f97ec0b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:57:25.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.287+0000 7f97ebfff700 1 --2- 172.21.15.71:0/714707392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97ec0aef00 0x7f97ec169b40 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f97d800ec80 tx=0x7f97d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:25.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.288+0000 7f97e8ff9700 1 -- 172.21.15.71:0/714707392 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d800c920 con 0x7f97ec0aef00 2023-10-09T07:57:25.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.288+0000 7f97e8ff9700 1 -- 172.21.15.71:0/714707392 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d800ca80 con 0x7f97ec0aef00 2023-10-09T07:57:25.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.288+0000 7f97e8ff9700 1 -- 172.21.15.71:0/714707392 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d800ce00 con 0x7f97ec0aef00 2023-10-09T07:57:25.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.288+0000 7f97f1d9d700 1 -- 172.21.15.71:0/714707392 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e0009420 con 0x7f97ec0aef00 2023-10-09T07:57:25.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.288+0000 7f97f1d9d700 1 -- 172.21.15.71:0/714707392 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ec0b1f10 con 0x7f97ec0aef00 2023-10-09T07:57:25.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.289+0000 7f97f1d9d700 1 -- 172.21.15.71:0/714707392 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ec06cfa0 con 0x7f97ec0aef00 2023-10-09T07:57:25.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.290+0000 7f97e8ff9700 1 -- 172.21.15.71:0/714707392 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 65) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f97d8013680 con 0x7f97ec0aef00 2023-10-09T07:57:25.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.291+0000 7f97e8ff9700 1 --2- 172.21.15.71:0/714707392 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f97d0067050 0x7f97d0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:25.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.291+0000 7f97e8ff9700 1 -- 172.21.15.71:0/714707392 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6529+0+0 (secure 0 0 0) 0x7f97d8084e70 con 0x7f97ec0aef00 2023-10-09T07:57:25.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.291+0000 7f97f0d9b700 1 -- 172.21.15.71:0/714707392 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f97d0067050 msgr2=0x7f97d0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:25.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.291+0000 7f97f0d9b700 1 --2- 172.21.15.71:0/714707392 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f97d0067050 0x7f97d0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:57:25.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.296+0000 7f97e8ff9700 1 -- 172.21.15.71:0/714707392 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97d8051bf0 con 0x7f97ec0aef00 2023-10-09T07:57:25.363 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:25.362+0000 7f94d5995180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T07:57:25.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.492+0000 7f97f0d9b700 1 -- 172.21.15.71:0/714707392 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f97d0067050 msgr2=0x7f97d0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:25.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.492+0000 7f97f0d9b700 1 --2- 172.21.15.71:0/714707392 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f97d0067050 0x7f97d0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:57:25.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.498+0000 7f97f1d9d700 1 -- 172.21.15.71:0/714707392 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f97ec15e010 con 0x7f97ec0aef00 2023-10-09T07:57:25.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.499+0000 7f97e8ff9700 1 -- 172.21.15.71:0/714707392 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v150) v1 ==== 100+0+11 (secure 0 0 0) 0x7f97d8055210 con 0x7f97ec0aef00 2023-10-09T07:57:25.500 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-09T07:57:25.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.501+0000 7f97f1d9d700 1 -- 172.21.15.71:0/714707392 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f97d0067050 msgr2=0x7f97d0069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:57:25.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.501+0000 7f97f1d9d700 1 --2- 172.21.15.71:0/714707392 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f97d0067050 0x7f97d0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.501+0000 7f97f1d9d700 1 -- 172.21.15.71:0/714707392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97ec0aef00 msgr2=0x7f97ec169b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:25.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.501+0000 7f97f1d9d700 1 --2- 172.21.15.71:0/714707392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97ec0aef00 0x7f97ec169b40 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f97d800ec80 tx=0x7f97d80091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.501+0000 7f97f1d9d700 1 -- 172.21.15.71:0/714707392 shutdown_connections 2023-10-09T07:57:25.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.501+0000 7f97f1d9d700 1 --2- 172.21.15.71:0/714707392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97ec15a3b0 0x7f97ec16a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.501+0000 7f97f1d9d700 1 --2- 172.21.15.71:0/714707392 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f97d0067050 0x7f97d0069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.501+0000 7f97f1d9d700 1 --2- 172.21.15.71:0/714707392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97ec06e470 0x7f97ec0b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.501+0000 7f97f1d9d700 1 --2- 172.21.15.71:0/714707392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97ec0aef00 0x7f97ec169b40 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.501+0000 7f97f1d9d700 1 -- 172.21.15.71:0/714707392 >> 172.21.15.71:0/714707392 conn(0x7f97ec0c9f70 msgr2=0x7f97ec15d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:25.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.502+0000 7f97f1d9d700 1 -- 172.21.15.71:0/714707392 shutdown_connections 2023-10-09T07:57:25.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.502+0000 7f97f1d9d700 1 -- 172.21.15.71:0/714707392 wait complete. 2023-10-09T07:57:25.520 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:57:25.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.711+0000 7fabe759e700 1 Processor -- start 2023-10-09T07:57:25.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.711+0000 7fabe759e700 1 -- start start 2023-10-09T07:57:25.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.712+0000 7fabe759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe8159420 0x7fabe80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:25.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.713+0000 7fabe759e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe80b2980 con 0x7fabe815d230 2023-10-09T07:57:25.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.713+0000 7fabe759e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe80b11d0 con 0x7fabe81597f0 2023-10-09T07:57:25.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.713+0000 7fabe759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80b14b0 con 0x7fabe8159420 2023-10-09T07:57:25.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.713+0000 7fabe6d9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fabe815d230 0x7fabe80b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54020/0 (socket says 172.21.15.71:54020) 2023-10-09T07:57:25.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.713+0000 7fabe6d9d700 1 -- 172.21.15.71:0/2401871430 learned_addr learned my addr 172.21.15.71:0/2401871430 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:25.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.713+0000 7fabe659c700 1 --2- 172.21.15.71:0/2401871430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe8159420 0x7fabe80b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:25.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.713+0000 7fabe559a700 1 -- 172.21.15.71:0/2401871430 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4146759134 0 0) 0x7fabe80b2980 con 0x7fabe815d230 2023-10-09T07:57:25.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.713+0000 7fabe559a700 1 -- 172.21.15.71:0/2401871430 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabd0003570 con 0x7fabe815d230 2023-10-09T07:57:25.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.713+0000 7fabe559a700 1 -- 172.21.15.71:0/2401871430 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792090384 0 0) 0x7fabe80b11d0 con 0x7fabe81597f0 2023-10-09T07:57:25.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.713+0000 7fabe559a700 1 -- 172.21.15.71:0/2401871430 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabe80b2980 con 0x7fabe81597f0 2023-10-09T07:57:25.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.713+0000 7fabe659c700 1 -- 172.21.15.71:0/2401871430 >> v1:172.21.15.179:6789/0 conn(0x7fabe81597f0 legacy=0x7fabe80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:25.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.713+0000 7fabe659c700 1 -- 172.21.15.71:0/2401871430 >> v1:172.21.15.71:6789/0 conn(0x7fabe815d230 legacy=0x7fabe80b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:25.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.714+0000 7fabe659c700 1 -- 172.21.15.71:0/2401871430 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe80b1790 con 0x7fabe8159420 2023-10-09T07:57:25.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.714+0000 7fabe659c700 1 --2- 172.21.15.71:0/2401871430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe8159420 0x7fabe80b5f40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009910 tx=0x7fabd80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f287cd1c993aaaa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:25.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.714+0000 7fabe559a700 1 -- 172.21.15.71:0/2401871430 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd8011630 con 0x7fabe8159420 2023-10-09T07:57:25.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.714+0000 7fabe559a700 1 -- 172.21.15.71:0/2401871430 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd8011790 con 0x7fabe8159420 2023-10-09T07:57:25.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.714+0000 7fabe559a700 1 -- 172.21.15.71:0/2401871430 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd8011b30 con 0x7fabe8159420 2023-10-09T07:57:25.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.715+0000 7fabe759e700 1 -- 172.21.15.71:0/2401871430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe8159420 msgr2=0x7fabe80b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:25.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.715+0000 7fabe759e700 1 --2- 172.21.15.71:0/2401871430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe8159420 0x7fabe80b5f40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009910 tx=0x7fabd80091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.715+0000 7fabe759e700 1 -- 172.21.15.71:0/2401871430 shutdown_connections 2023-10-09T07:57:25.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.715+0000 7fabe759e700 1 --2- 172.21.15.71:0/2401871430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe8159420 0x7fabe80b5f40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.715+0000 7fabe759e700 1 -- 172.21.15.71:0/2401871430 >> 172.21.15.71:0/2401871430 conn(0x7fabe80d0660 msgr2=0x7fabe80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:25.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.715+0000 7fabe759e700 1 -- 172.21.15.71:0/2401871430 shutdown_connections 2023-10-09T07:57:25.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.715+0000 7fabe759e700 1 -- 172.21.15.71:0/2401871430 wait complete. 2023-10-09T07:57:25.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.717+0000 7fabe759e700 1 Processor -- start 2023-10-09T07:57:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.717+0000 7fabe759e700 1 -- start start 2023-10-09T07:57:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.718+0000 7fabe759e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabe8159420 0x7fabe815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.718+0000 7fabe759e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabe81597f0 0x7fabe80c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.718+0000 7fabe759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe815d230 0x7fabe815e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.718+0000 7fabe759e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80c5ad0 con 0x7fabe8159420 2023-10-09T07:57:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.718+0000 7fabe759e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe815aa70 con 0x7fabe81597f0 2023-10-09T07:57:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.718+0000 7fabe759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe815ad50 con 0x7fabe815d230 2023-10-09T07:57:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.718+0000 7fabe659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabe8159420 0x7fabe815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.718+0000 7fabe659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabe8159420 0x7fabe815a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48478/0 (socket says 172.21.15.71:48478) 2023-10-09T07:57:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.718+0000 7fabe659c700 1 -- 172.21.15.71:0/3011019825 learned_addr learned my addr 172.21.15.71:0/3011019825 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.718+0000 7fabe5d9b700 1 --2- 172.21.15.71:0/3011019825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabe81597f0 0x7fabe80c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.718+0000 7fabe6d9d700 1 --2- 172.21.15.71:0/3011019825 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe815d230 0x7fabe815e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.718+0000 7fabe659c700 1 -- 172.21.15.71:0/3011019825 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe815d230 msgr2=0x7fabe815e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.718+0000 7fabe659c700 1 --2- 172.21.15.71:0/3011019825 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe815d230 0x7fabe815e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.718+0000 7fabe659c700 1 -- 172.21.15.71:0/3011019825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabe81597f0 msgr2=0x7fabe80c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.718+0000 7fabe659c700 1 --2- 172.21.15.71:0/3011019825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabe81597f0 0x7fabe80c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.718+0000 7fabe659c700 1 -- 172.21.15.71:0/3011019825 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd8009420 con 0x7fabe8159420 2023-10-09T07:57:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.719+0000 7fabe659c700 1 --2- 172.21.15.71:0/3011019825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabe8159420 0x7fabe815a3e0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009f00 tx=0x7fabd8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.719+0000 7fabd67fc700 1 -- 172.21.15.71:0/3011019825 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd801f070 con 0x7fabe8159420 2023-10-09T07:57:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.719+0000 7fabd67fc700 1 -- 172.21.15.71:0/3011019825 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd8000bc0 con 0x7fabe8159420 2023-10-09T07:57:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.719+0000 7fabe759e700 1 -- 172.21.15.71:0/3011019825 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe815b030 con 0x7fabe8159420 2023-10-09T07:57:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.719+0000 7fabd67fc700 1 -- 172.21.15.71:0/3011019825 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd8025420 con 0x7fabe8159420 2023-10-09T07:57:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.719+0000 7fabe759e700 1 -- 172.21.15.71:0/3011019825 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe815b5f0 con 0x7fabe8159420 2023-10-09T07:57:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.720+0000 7fabe759e700 1 -- 172.21.15.71:0/3011019825 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe804c3c0 con 0x7fabe8159420 2023-10-09T07:57:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.721+0000 7fabd67fc700 1 -- 172.21.15.71:0/3011019825 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 65) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fabd8023070 con 0x7fabe8159420 2023-10-09T07:57:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.723+0000 7fabd67fc700 1 --2- 172.21.15.71:0/3011019825 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fabc8067050 0x7fabc8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.723+0000 7fabd67fc700 1 -- 172.21.15.71:0/3011019825 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6529+0+0 (secure 0 0 0) 0x7fabd8085dc0 con 0x7fabe8159420 2023-10-09T07:57:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.723+0000 7fabe5d9b700 1 -- 172.21.15.71:0/3011019825 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fabc8067050 msgr2=0x7fabc8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.723+0000 7fabe5d9b700 1 --2- 172.21.15.71:0/3011019825 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fabc8067050 0x7fabc8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:57:25.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.726+0000 7fabd67fc700 1 -- 172.21.15.71:0/3011019825 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fabd8052b40 con 0x7fabe8159420 2023-10-09T07:57:25.779 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:25.779+0000 7fc37e124180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T07:57:25.873 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:25.872+0000 7f94d5995180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T07:57:25.873 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:25.873+0000 7fc37e124180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T07:57:25.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.924+0000 7fabe5d9b700 1 -- 172.21.15.71:0/3011019825 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fabc8067050 msgr2=0x7fabc8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:25.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.924+0000 7fabe5d9b700 1 --2- 172.21.15.71:0/3011019825 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fabc8067050 0x7fabc8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:57:25.967 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:25.967+0000 7fc37e124180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T07:57:25.972 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:25.971+0000 7f94d5995180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T07:57:25.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.972+0000 7fabe759e700 1 -- 172.21.15.71:0/3011019825 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fabe80b1a70 con 0x7fabe8159420 2023-10-09T07:57:25.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.972+0000 7fabd67fc700 1 -- 172.21.15.71:0/3011019825 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fabd802a090 con 0x7fabe8159420 2023-10-09T07:57:25.973 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:57:25.973 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/4239197200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":4239197200},{"type":"v1","addr":"172.21.15.179:6836","nonce":4239197200}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":8094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/645124077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":645124077},{"type":"v1","addr":"172.21.15.71:6833","nonce":645124077}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":8097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/542229353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":542229353},{"type":"v1","addr":"172.21.15.71:6835","nonce":542229353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:01:22.605100+0000","modified":"2023-10-09T07:01:26.163625+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/2229698291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2229698291},{"type":"v1","addr":"172.21.15.179:6834","nonce":2229698291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T07:57:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.975+0000 7fabe759e700 1 -- 172.21.15.71:0/3011019825 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fabc8067050 msgr2=0x7fabc8069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:57:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.975+0000 7fabe759e700 1 --2- 172.21.15.71:0/3011019825 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fabc8067050 0x7fabc8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.975+0000 7fabe759e700 1 -- 172.21.15.71:0/3011019825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabe8159420 msgr2=0x7fabe815a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.975+0000 7fabe759e700 1 --2- 172.21.15.71:0/3011019825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabe8159420 0x7fabe815a3e0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009f00 tx=0x7fabd8017000 comp rx=0 tx=0).stop 2023-10-09T07:57:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.975+0000 7fabe759e700 1 -- 172.21.15.71:0/3011019825 shutdown_connections 2023-10-09T07:57:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.975+0000 7fabe759e700 1 --2- 172.21.15.71:0/3011019825 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe815d230 0x7fabe815e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.975+0000 7fabe759e700 1 --2- 172.21.15.71:0/3011019825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabe8159420 0x7fabe815a3e0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.975+0000 7fabe759e700 1 --2- 172.21.15.71:0/3011019825 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fabc8067050 0x7fabc8069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.975+0000 7fabe759e700 1 --2- 172.21.15.71:0/3011019825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabe81597f0 0x7fabe80c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:25.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.975+0000 7fabe759e700 1 -- 172.21.15.71:0/3011019825 >> 172.21.15.71:0/3011019825 conn(0x7fabe80d0660 msgr2=0x7fabe80b06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:25.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.975+0000 7fabe759e700 1 -- 172.21.15.71:0/3011019825 shutdown_connections 2023-10-09T07:57:25.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:25.975+0000 7fabe759e700 1 -- 172.21.15.71:0/3011019825 wait complete. 2023-10-09T07:57:25.977 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 66 2023-10-09T07:57:25.994 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:57:26.070 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:26.069+0000 7f94d5995180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T07:57:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.178+0000 7fbb9119d700 1 Processor -- start 2023-10-09T07:57:26.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.179+0000 7fbb9119d700 1 -- start start 2023-10-09T07:57:26.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.180+0000 7fbb9119d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbb8c1597f0 0x7fbb8c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:26.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.180+0000 7fbb9119d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbb8c15d230 0x7fbb8c15d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:26.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.180+0000 7fbb9119d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb8c15db70 con 0x7fbb8c159420 2023-10-09T07:57:26.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.180+0000 7fbb9119d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb8c0b11d0 con 0x7fbb8c1597f0 2023-10-09T07:57:26.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.180+0000 7fbb9119d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb8c0b14b0 con 0x7fbb8c15d230 2023-10-09T07:57:26.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.180+0000 7fbb8b7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbb8c1597f0 0x7fbb8c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:26.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.180+0000 7fbb8b7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbb8c1597f0 0x7fbb8c0b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48494/0 (socket says 172.21.15.71:48494) 2023-10-09T07:57:26.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.180+0000 7fbb8b7fe700 1 -- 172.21.15.71:0/329349268 learned_addr learned my addr 172.21.15.71:0/329349268 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:26.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.180+0000 7fbb9099c700 1 --2- 172.21.15.71:0/329349268 >> v2:172.21.15.179:3300/0 conn(0x7fbb8c15d230 0x7fbb8c15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:26.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.181+0000 7fbb8b7fe700 1 -- 172.21.15.71:0/329349268 >> v2:172.21.15.179:3300/0 conn(0x7fbb8c15d230 msgr2=0x7fbb8c15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:26.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.181+0000 7fbb8b7fe700 1 --2- 172.21.15.71:0/329349268 >> v2:172.21.15.179:3300/0 conn(0x7fbb8c15d230 0x7fbb8c15d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:26.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.181+0000 7fbb8b7fe700 1 -- 172.21.15.71:0/329349268 >> v1:172.21.15.179:6789/0 conn(0x7fbb8c159420 legacy=0x7fbb8c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:26.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.181+0000 7fbb8b7fe700 1 -- 172.21.15.71:0/329349268 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8c0b1790 con 0x7fbb8c1597f0 2023-10-09T07:57:26.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.181+0000 7fbb8b7fe700 1 --2- 172.21.15.71:0/329349268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb8c1597f0 0x7fbb8c0b2270 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c15d170 tx=0x7fbb80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26577097d41096d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:26.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.181+0000 7fbb8affd700 1 -- 172.21.15.71:0/329349268 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb80009e70 con 0x7fbb8c1597f0 2023-10-09T07:57:26.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.181+0000 7fbb8affd700 1 -- 172.21.15.71:0/329349268 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8000b860 con 0x7fbb8c1597f0 2023-10-09T07:57:26.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.181+0000 7fbb8affd700 1 -- 172.21.15.71:0/329349268 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8000bc00 con 0x7fbb8c1597f0 2023-10-09T07:57:26.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.182+0000 7fbb9119d700 1 -- 172.21.15.71:0/329349268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb8c1597f0 msgr2=0x7fbb8c0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:26.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.182+0000 7fbb9119d700 1 --2- 172.21.15.71:0/329349268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb8c1597f0 0x7fbb8c0b2270 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c15d170 tx=0x7fbb80009250 comp rx=0 tx=0).stop 2023-10-09T07:57:26.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.182+0000 7fbb9119d700 1 -- 172.21.15.71:0/329349268 shutdown_connections 2023-10-09T07:57:26.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.182+0000 7fbb9119d700 1 --2- 172.21.15.71:0/329349268 >> v2:172.21.15.179:3300/0 conn(0x7fbb8c15d230 0x7fbb8c15d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:26.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.182+0000 7fbb9119d700 1 --2- 172.21.15.71:0/329349268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb8c1597f0 0x7fbb8c0b2270 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:26.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.182+0000 7fbb9119d700 1 -- 172.21.15.71:0/329349268 >> 172.21.15.71:0/329349268 conn(0x7fbb8c0d0660 msgr2=0x7fbb8c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:26.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.182+0000 7fbb9119d700 1 -- 172.21.15.71:0/329349268 shutdown_connections 2023-10-09T07:57:26.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.182+0000 7fbb9119d700 1 -- 172.21.15.71:0/329349268 wait complete. 2023-10-09T07:57:26.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.183+0000 7fbb9119d700 1 Processor -- start 2023-10-09T07:57:26.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.183+0000 7fbb9119d700 1 -- start start 2023-10-09T07:57:26.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.184+0000 7fbb9119d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb8c159420 0x7fbb8c154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:26.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.184+0000 7fbb9119d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb8c1597f0 0x7fbb8c0c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:26.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.184+0000 7fbb9119d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb8c15d230 0x7fbb8c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:26.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.184+0000 7fbb9119d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c0c66f0 con 0x7fbb8c1597f0 2023-10-09T07:57:26.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.184+0000 7fbb9119d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c0c6f00 con 0x7fbb8c159420 2023-10-09T07:57:26.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.184+0000 7fbb9119d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c154940 con 0x7fbb8c15d230 2023-10-09T07:57:26.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.184+0000 7fbb8b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb8c1597f0 0x7fbb8c0c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:26.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.185+0000 7fbb8b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb8c1597f0 0x7fbb8c0c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48500/0 (socket says 172.21.15.71:48500) 2023-10-09T07:57:26.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.185+0000 7fbb8b7fe700 1 -- 172.21.15.71:0/3066088076 learned_addr learned my addr 172.21.15.71:0/3066088076 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:26.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.185+0000 7fbb9099c700 1 --2- 172.21.15.71:0/3066088076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb8c15d230 0x7fbb8c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:26.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.185+0000 7fbb8bfff700 1 --2- 172.21.15.71:0/3066088076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb8c159420 0x7fbb8c154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:26.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.185+0000 7fbb8b7fe700 1 -- 172.21.15.71:0/3066088076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb8c15d230 msgr2=0x7fbb8c0b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:26.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.185+0000 7fbb8b7fe700 1 --2- 172.21.15.71:0/3066088076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb8c15d230 0x7fbb8c0b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:26.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.185+0000 7fbb8b7fe700 1 -- 172.21.15.71:0/3066088076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb8c159420 msgr2=0x7fbb8c154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:26.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.185+0000 7fbb8b7fe700 1 --2- 172.21.15.71:0/3066088076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb8c159420 0x7fbb8c154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:26.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.185+0000 7fbb8b7fe700 1 -- 172.21.15.71:0/3066088076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb800094f0 con 0x7fbb8c1597f0 2023-10-09T07:57:26.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.185+0000 7fbb9099c700 1 --2- 172.21.15.71:0/3066088076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb8c15d230 0x7fbb8c0b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:57:26.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.185+0000 7fbb8b7fe700 1 --2- 172.21.15.71:0/3066088076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb8c1597f0 0x7fbb8c0c5400 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fbb80006fd0 tx=0x7fbb80017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:26.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.185+0000 7fbb73fff700 1 -- 172.21.15.71:0/3066088076 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb80011420 con 0x7fbb8c1597f0 2023-10-09T07:57:26.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.185+0000 7fbb73fff700 1 -- 172.21.15.71:0/3066088076 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb800115a0 con 0x7fbb8c1597f0 2023-10-09T07:57:26.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.185+0000 7fbb9119d700 1 -- 172.21.15.71:0/3066088076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8c0c5e50 con 0x7fbb8c1597f0 2023-10-09T07:57:26.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.186+0000 7fbb73fff700 1 -- 172.21.15.71:0/3066088076 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb80011960 con 0x7fbb8c1597f0 2023-10-09T07:57:26.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.186+0000 7fbb9119d700 1 -- 172.21.15.71:0/3066088076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8c0c6410 con 0x7fbb8c1597f0 2023-10-09T07:57:26.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.187+0000 7fbb9119d700 1 -- 172.21.15.71:0/3066088076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8c0c70b0 con 0x7fbb8c1597f0 2023-10-09T07:57:26.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.187+0000 7fbb73fff700 1 -- 172.21.15.71:0/3066088076 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 65) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fbb800253f0 con 0x7fbb8c1597f0 2023-10-09T07:57:26.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.188+0000 7fbb73fff700 1 --2- 172.21.15.71:0/3066088076 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fbb78067050 0x7fbb78069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:26.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.188+0000 7fbb73fff700 1 -- 172.21.15.71:0/3066088076 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6529+0+0 (secure 0 0 0) 0x7fbb800863d0 con 0x7fbb8c1597f0 2023-10-09T07:57:26.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.188+0000 7fbb8bfff700 1 -- 172.21.15.71:0/3066088076 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fbb78067050 msgr2=0x7fbb78069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:26.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.188+0000 7fbb8bfff700 1 --2- 172.21.15.71:0/3066088076 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fbb78067050 0x7fbb78069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:57:26.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.192+0000 7fbb73fff700 1 -- 172.21.15.71:0/3066088076 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb8c0c70b0 con 0x7fbb8c1597f0 2023-10-09T07:57:26.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.389+0000 7fbb8bfff700 1 -- 172.21.15.71:0/3066088076 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fbb78067050 msgr2=0x7fbb78069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:26.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.389+0000 7fbb8bfff700 1 --2- 172.21.15.71:0/3066088076 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fbb78067050 0x7fbb78069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:57:26.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.391+0000 7fbb9119d700 1 -- 172.21.15.71:0/3066088076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb8c0c7070 con 0x7fbb8c1597f0 2023-10-09T07:57:26.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.392+0000 7fbb73fff700 1 -- 172.21.15.71:0/3066088076 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+16636 (secure 0 0 0) 0x7fbb80053150 con 0x7fbb8c1597f0 2023-10-09T07:57:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:57:26.393 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":150,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:57:24.641267+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:01:20.274329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T07:01:21.592220+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":149,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.7","mappings":[{"from":0,"to":2}]},{"pgid":"17.18","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6837/85452":"2023-10-10T07:01:42.900662+0000","172.21.15.179:0/3101119155":"2023-10-10T07:01:42.900662+0000","172.21.15.179:0/2925808610":"2023-10-10T07:01:42.900662+0000","172.21.15.179:6835/85452":"2023-10-10T07:01:42.900662+0000","172.21.15.179:0/573738858":"2023-10-10T07:01:42.900662+0000","172.21.15.179:0/1903715929":"2023-10-10T07:01:42.900662+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":17,"snaps":[{"begin":3,"length":4},{"begin":59,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:57:26.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.394+0000 7fbb9119d700 1 -- 172.21.15.71:0/3066088076 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fbb78067050 msgr2=0x7fbb78069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:57:26.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.394+0000 7fbb9119d700 1 --2- 172.21.15.71:0/3066088076 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fbb78067050 0x7fbb78069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:26.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.394+0000 7fbb9119d700 1 -- 172.21.15.71:0/3066088076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb8c1597f0 msgr2=0x7fbb8c0c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:26.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.394+0000 7fbb9119d700 1 --2- 172.21.15.71:0/3066088076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb8c1597f0 0x7fbb8c0c5400 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fbb80006fd0 tx=0x7fbb80017000 comp rx=0 tx=0).stop 2023-10-09T07:57:26.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.394+0000 7fbb9119d700 1 -- 172.21.15.71:0/3066088076 shutdown_connections 2023-10-09T07:57:26.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.394+0000 7fbb9119d700 1 --2- 172.21.15.71:0/3066088076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb8c15d230 0x7fbb8c0b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:26.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.394+0000 7fbb9119d700 1 --2- 172.21.15.71:0/3066088076 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fbb78067050 0x7fbb78069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:26.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.394+0000 7fbb9119d700 1 --2- 172.21.15.71:0/3066088076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb8c159420 0x7fbb8c154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:26.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.394+0000 7fbb9119d700 1 --2- 172.21.15.71:0/3066088076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb8c1597f0 0x7fbb8c0c5400 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:26.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.394+0000 7fbb9119d700 1 -- 172.21.15.71:0/3066088076 >> 172.21.15.71:0/3066088076 conn(0x7fbb8c0d0660 msgr2=0x7fbb8c0b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:26.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.394+0000 7fbb9119d700 1 -- 172.21.15.71:0/3066088076 shutdown_connections 2023-10-09T07:57:26.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.394+0000 7fbb9119d700 1 -- 172.21.15.71:0/3066088076 wait complete. 2023-10-09T07:57:26.413 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T07:57:26.414 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:57:26.589 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:26.589+0000 7fc37e124180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T07:57:26.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.607+0000 7f380739d700 1 Processor -- start 2023-10-09T07:57:26.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.608+0000 7f380739d700 1 -- start start 2023-10-09T07:57:26.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.610+0000 7f380739d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3800166530 0x7f38000c7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:26.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.610+0000 7f380739d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3800069cd0 con 0x7f38000caad0 2023-10-09T07:57:26.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.610+0000 7f380739d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3800166900 con 0x7f3800087a00 2023-10-09T07:57:26.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.610+0000 7f380739d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38000696c0 con 0x7f3800166530 2023-10-09T07:57:26.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.610+0000 7f3806b9c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f3800087a00 0x7f3800170040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:38338/0 (socket says 172.21.15.71:38338) 2023-10-09T07:57:26.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.610+0000 7f3806b9c700 1 -- 172.21.15.71:0/318147305 learned_addr learned my addr 172.21.15.71:0/318147305 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:26.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.610+0000 7f380639b700 1 --2- 172.21.15.71:0/318147305 >> v2:172.21.15.71:3300/0 conn(0x7f3800166530 0x7f38000c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:26.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.611+0000 7f3805399700 1 -- 172.21.15.71:0/318147305 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 93616663 0 0) 0x7f3800166900 con 0x7f3800087a00 2023-10-09T07:57:26.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.611+0000 7f3805399700 1 -- 172.21.15.71:0/318147305 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37ec003570 con 0x7f3800087a00 2023-10-09T07:57:26.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.611+0000 7f3805399700 1 -- 172.21.15.71:0/318147305 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3612306967 0 0) 0x7f37ec003570 con 0x7f3800087a00 2023-10-09T07:57:26.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.611+0000 7f3805399700 1 -- 172.21.15.71:0/318147305 >> v2:172.21.15.71:3300/0 conn(0x7f3800166530 msgr2=0x7f38000c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:26.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.611+0000 7f3805399700 1 --2- 172.21.15.71:0/318147305 >> v2:172.21.15.71:3300/0 conn(0x7f3800166530 0x7f38000c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:26.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.611+0000 7f3805399700 1 -- 172.21.15.71:0/318147305 >> v1:172.21.15.71:6789/0 conn(0x7f38000caad0 legacy=0x7f38000872f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:26.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.611+0000 7f3805399700 1 -- 172.21.15.71:0/318147305 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380006b170 con 0x7f3800087a00 2023-10-09T07:57:26.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.611+0000 7f3805399700 1 -- 172.21.15.71:0/318147305 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f37f8001490 con 0x7f3800087a00 2023-10-09T07:57:26.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.611+0000 7f3805399700 1 -- 172.21.15.71:0/318147305 >> v1:172.21.15.179:6789/0 conn(0x7f3800087a00 legacy=0x7f3800170040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.611+0000 7f3805399700 1 --2- 172.21.15.71:0/318147305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37ec003a60 0x7f37ec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.612+0000 7f3805399700 1 --2- 172.21.15.71:0/318147305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37ec004810 0x7f37ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.612+0000 7f3805399700 1 --2- 172.21.15.71:0/318147305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37ec0051c0 0x7f37ec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.612+0000 7f3805399700 1 -- 172.21.15.71:0/318147305 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38000696c0 con 0x7f37ec003a60 2023-10-09T07:57:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.612+0000 7f3805399700 1 -- 172.21.15.71:0/318147305 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec00c160 con 0x7f37ec004810 2023-10-09T07:57:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.612+0000 7f3805399700 1 -- 172.21.15.71:0/318147305 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec00c320 con 0x7f37ec0051c0 2023-10-09T07:57:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.612+0000 7f380639b700 1 --2- 172.21.15.71:0/318147305 >> v2:172.21.15.71:3300/0 conn(0x7f3800166530 0x7f38000c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:57:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.612+0000 7f3806b9c700 1 --2- 172.21.15.71:0/318147305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37ec0051c0 0x7f37ec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.612+0000 7f3805b9a700 1 --2- 172.21.15.71:0/318147305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37ec004810 0x7f37ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.612+0000 7f3806b9c700 1 -- 172.21.15.71:0/318147305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37ec004810 msgr2=0x7f37ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.612+0000 7f3806b9c700 1 --2- 172.21.15.71:0/318147305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37ec004810 0x7f37ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.612+0000 7f3806b9c700 1 -- 172.21.15.71:0/318147305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37ec003a60 msgr2=0x7f37ec003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.612+0000 7f3806b9c700 1 --2- 172.21.15.71:0/318147305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37ec003a60 0x7f37ec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.613+0000 7f3806b9c700 1 -- 172.21.15.71:0/318147305 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ec003570 con 0x7f37ec0051c0 2023-10-09T07:57:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.613+0000 7f3806b9c700 1 -- 172.21.15.71:0/318147305 reap_dead start 2023-10-09T07:57:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.613+0000 7f3806b9c700 1 --2- 172.21.15.71:0/318147305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37ec0051c0 0x7f37ec00ba60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f37f8015ef0 tx=0x7f38000c6ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23439d4c4b0a0370 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.613+0000 7f3805399700 1 -- 172.21.15.71:0/318147305 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f800a070 con 0x7f37ec0051c0 2023-10-09T07:57:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.613+0000 7f3805399700 1 -- 172.21.15.71:0/318147305 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f800b920 con 0x7f37ec0051c0 2023-10-09T07:57:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.613+0000 7f3805399700 1 -- 172.21.15.71:0/318147305 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f800bce0 con 0x7f37ec0051c0 2023-10-09T07:57:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.614+0000 7f380739d700 1 -- 172.21.15.71:0/318147305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37ec0051c0 msgr2=0x7f37ec00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.614+0000 7f380739d700 1 --2- 172.21.15.71:0/318147305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37ec0051c0 0x7f37ec00ba60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f37f8015ef0 tx=0x7f38000c6ee0 comp rx=0 tx=0).stop 2023-10-09T07:57:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.614+0000 7f380739d700 1 -- 172.21.15.71:0/318147305 shutdown_connections 2023-10-09T07:57:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.614+0000 7f380739d700 1 --2- 172.21.15.71:0/318147305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37ec0051c0 0x7f37ec00ba60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.614+0000 7f380739d700 1 -- 172.21.15.71:0/318147305 >> 172.21.15.71:0/318147305 conn(0x7f38000cc1f0 msgr2=0x7f38000cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:26.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.614+0000 7f380739d700 1 -- 172.21.15.71:0/318147305 shutdown_connections 2023-10-09T07:57:26.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.614+0000 7f380739d700 1 -- 172.21.15.71:0/318147305 wait complete. 2023-10-09T07:57:26.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.616+0000 7f380739d700 1 Processor -- start 2023-10-09T07:57:26.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.617+0000 7f380739d700 1 -- start start 2023-10-09T07:57:26.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.618+0000 7f380739d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37ec0051c0 0x7f380015d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:26.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.618+0000 7f380739d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38001798e0 0x7f38000ae460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:26.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.618+0000 7f380739d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3800163ca0 0x7f3800164110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:26.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.618+0000 7f380739d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3800179d50 con 0x7f37ec0051c0 2023-10-09T07:57:26.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.618+0000 7f380739d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380017a7f0 con 0x7f3800163ca0 2023-10-09T07:57:26.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.618+0000 7f380739d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3800176480 con 0x7f38001798e0 2023-10-09T07:57:26.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.618+0000 7f3805b9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38001798e0 0x7f38000ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:26.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.618+0000 7f3805b9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38001798e0 0x7f38000ae460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:58912/0 (socket says 172.21.15.71:58912) 2023-10-09T07:57:26.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.618+0000 7f3805b9a700 1 -- 172.21.15.71:0/213800491 learned_addr learned my addr 172.21.15.71:0/213800491 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:26.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.619+0000 7f380639b700 1 --2- 172.21.15.71:0/213800491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37ec0051c0 0x7f380015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:26.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.619+0000 7f3806b9c700 1 --2- 172.21.15.71:0/213800491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3800163ca0 0x7f3800164110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:26.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.619+0000 7f3805b9a700 1 -- 172.21.15.71:0/213800491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3800163ca0 msgr2=0x7f3800164110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:26.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.619+0000 7f3805b9a700 1 --2- 172.21.15.71:0/213800491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3800163ca0 0x7f3800164110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:26.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.619+0000 7f3805b9a700 1 -- 172.21.15.71:0/213800491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37ec0051c0 msgr2=0x7f380015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:26.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.619+0000 7f3805b9a700 1 --2- 172.21.15.71:0/213800491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37ec0051c0 0x7f380015d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:26.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.619+0000 7f3805b9a700 1 -- 172.21.15.71:0/213800491 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3800179f50 con 0x7f38001798e0 2023-10-09T07:57:26.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.619+0000 7f3805b9a700 1 --2- 172.21.15.71:0/213800491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38001798e0 0x7f38000ae460 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f37f00029b0 tx=0x7f37f0007d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:26.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.619+0000 7f37f67fc700 1 -- 172.21.15.71:0/213800491 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0002e40 con 0x7f38001798e0 2023-10-09T07:57:26.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.620+0000 7f37f67fc700 1 -- 172.21.15.71:0/213800491 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f000f8d0 con 0x7f38001798e0 2023-10-09T07:57:26.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.620+0000 7f37f67fc700 1 -- 172.21.15.71:0/213800491 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f000fc70 con 0x7f38001798e0 2023-10-09T07:57:26.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.620+0000 7f380739d700 1 -- 172.21.15.71:0/213800491 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380017a230 con 0x7f38001798e0 2023-10-09T07:57:26.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.620+0000 7f380739d700 1 -- 172.21.15.71:0/213800491 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380006d590 con 0x7f38001798e0 2023-10-09T07:57:26.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.623+0000 7f37f67fc700 1 -- 172.21.15.71:0/213800491 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 65) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f37f0006820 con 0x7f38001798e0 2023-10-09T07:57:26.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.623+0000 7f380739d700 1 -- 172.21.15.71:0/213800491 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3800176610 con 0x7f38001798e0 2023-10-09T07:57:26.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.624+0000 7f37f67fc700 1 --2- 172.21.15.71:0/213800491 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f37e4067050 0x7f37e4069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.624+0000 7f37f67fc700 1 -- 172.21.15.71:0/213800491 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6529+0+0 (secure 0 0 0) 0x7f37f0084a50 con 0x7f38001798e0 2023-10-09T07:57:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.625+0000 7f380639b700 1 -- 172.21.15.71:0/213800491 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f37e4067050 msgr2=0x7f37e4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.625+0000 7f380639b700 1 --2- 172.21.15.71:0/213800491 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f37e4067050 0x7f37e4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:57:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.629+0000 7f37f67fc700 1 -- 172.21.15.71:0/213800491 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37f0051870 con 0x7f38001798e0 2023-10-09T07:57:26.720 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:26.719+0000 7f94d5995180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T07:57:26.764 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:26.764+0000 7fc37e124180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:57:26.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.826+0000 7f380639b700 1 -- 172.21.15.71:0/213800491 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f37e4067050 msgr2=0x7f37e4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:26.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.826+0000 7f380639b700 1 --2- 172.21.15.71:0/213800491 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f37e4067050 0x7f37e4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:57:26.860 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:26.860+0000 7fc37e124180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T07:57:26.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.886+0000 7f380739d700 1 -- 172.21.15.71:0/213800491 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f380004c3c0 con 0x7f38001798e0 2023-10-09T07:57:26.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.886+0000 7f37f67fc700 1 -- 172.21.15.71:0/213800491 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f37f0054e90 con 0x7f38001798e0 2023-10-09T07:57:26.887 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:57:26.887 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/4239197200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":4239197200},{"type":"v1","addr":"172.21.15.179:6836","nonce":4239197200}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":8094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/645124077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":645124077},{"type":"v1","addr":"172.21.15.71:6833","nonce":645124077}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":8097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/542229353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":542229353},{"type":"v1","addr":"172.21.15.71:6835","nonce":542229353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:01:22.605100+0000","modified":"2023-10-09T07:01:26.163625+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/2229698291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2229698291},{"type":"v1","addr":"172.21.15.179:6834","nonce":2229698291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T07:57:26.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.889+0000 7f380739d700 1 -- 172.21.15.71:0/213800491 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f37e4067050 msgr2=0x7f37e4069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:57:26.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.889+0000 7f380739d700 1 --2- 172.21.15.71:0/213800491 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f37e4067050 0x7f37e4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:26.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.889+0000 7f380739d700 1 -- 172.21.15.71:0/213800491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38001798e0 msgr2=0x7f38000ae460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:26.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.889+0000 7f380739d700 1 --2- 172.21.15.71:0/213800491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38001798e0 0x7f38000ae460 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f37f00029b0 tx=0x7f37f0007d30 comp rx=0 tx=0).stop 2023-10-09T07:57:26.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.889+0000 7f380739d700 1 -- 172.21.15.71:0/213800491 shutdown_connections 2023-10-09T07:57:26.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.889+0000 7f380739d700 1 --2- 172.21.15.71:0/213800491 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f37e4067050 0x7f37e4069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:26.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.889+0000 7f380739d700 1 --2- 172.21.15.71:0/213800491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3800163ca0 0x7f3800164110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.889+0000 7f380739d700 1 --2- 172.21.15.71:0/213800491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37ec0051c0 0x7f380015d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.889+0000 7f380739d700 1 --2- 172.21.15.71:0/213800491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38001798e0 0x7f38000ae460 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.889+0000 7f380739d700 1 -- 172.21.15.71:0/213800491 >> 172.21.15.71:0/213800491 conn(0x7f38000cc1f0 msgr2=0x7f3800161fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.889+0000 7f380739d700 1 -- 172.21.15.71:0/213800491 shutdown_connections 2023-10-09T07:57:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:26.889+0000 7f380739d700 1 -- 172.21.15.71:0/213800491 wait complete. 2023-10-09T07:57:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 66 2023-10-09T07:57:26.896 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:26.895+0000 7f94d5995180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:57:26.907 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:57:26.998 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:26.998+0000 7f94d5995180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T07:57:27.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.093+0000 7fe8f199d700 1 Processor -- start 2023-10-09T07:57:27.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.093+0000 7fe8f199d700 1 -- start start 2023-10-09T07:57:27.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.095+0000 7fe8f199d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe8ec159420 0x7fe8ec0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:27.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.095+0000 7fe8f199d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ec0b2980 con 0x7fe8ec15d230 2023-10-09T07:57:27.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.095+0000 7fe8f199d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ec0b11d0 con 0x7fe8ec1597f0 2023-10-09T07:57:27.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.095+0000 7fe8f199d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8ec0b14b0 con 0x7fe8ec159420 2023-10-09T07:57:27.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.095+0000 7fe8f119c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe8ec15d230 0x7fe8ec15d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54042/0 (socket says 172.21.15.71:54042) 2023-10-09T07:57:27.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.095+0000 7fe8f119c700 1 -- 172.21.15.71:0/1347435350 learned_addr learned my addr 172.21.15.71:0/1347435350 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:27.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.095+0000 7fe8f099b700 1 --2- 172.21.15.71:0/1347435350 >> v2:172.21.15.179:3300/0 conn(0x7fe8ec159420 0x7fe8ec0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:27.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.095+0000 7fe8eb7fe700 1 -- 172.21.15.71:0/1347435350 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164467235 0 0) 0x7fe8ec0b2980 con 0x7fe8ec15d230 2023-10-09T07:57:27.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.095+0000 7fe8eb7fe700 1 -- 172.21.15.71:0/1347435350 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8dc003570 con 0x7fe8ec15d230 2023-10-09T07:57:27.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.096+0000 7fe8eb7fe700 1 -- 172.21.15.71:0/1347435350 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775343718 0 0) 0x7fe8ec0b11d0 con 0x7fe8ec1597f0 2023-10-09T07:57:27.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.096+0000 7fe8eb7fe700 1 -- 172.21.15.71:0/1347435350 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8ec0b2980 con 0x7fe8ec1597f0 2023-10-09T07:57:27.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.096+0000 7fe8f099b700 1 -- 172.21.15.71:0/1347435350 >> v1:172.21.15.179:6789/0 conn(0x7fe8ec1597f0 legacy=0x7fe8ec0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:27.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.096+0000 7fe8eb7fe700 1 -- 172.21.15.71:0/1347435350 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1117460127 0 0) 0x7fe8dc003570 con 0x7fe8ec15d230 2023-10-09T07:57:27.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.096+0000 7fe8f099b700 1 -- 172.21.15.71:0/1347435350 >> v1:172.21.15.71:6789/0 conn(0x7fe8ec15d230 legacy=0x7fe8ec15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:27.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.096+0000 7fe8f099b700 1 -- 172.21.15.71:0/1347435350 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ec0b1790 con 0x7fe8ec159420 2023-10-09T07:57:27.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.096+0000 7fe8f099b700 1 --2- 172.21.15.71:0/1347435350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8ec159420 0x7fe8ec0b5f40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00098e0 tx=0x7fe8e00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3de5eb5c8c1484d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:27.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.096+0000 7fe8eb7fe700 1 -- 172.21.15.71:0/1347435350 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e40017f0 con 0x7fe8ec159420 2023-10-09T07:57:27.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.096+0000 7fe8eb7fe700 1 -- 172.21.15.71:0/1347435350 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e0011420 con 0x7fe8ec159420 2023-10-09T07:57:27.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.096+0000 7fe8eb7fe700 1 -- 172.21.15.71:0/1347435350 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e00117c0 con 0x7fe8ec159420 2023-10-09T07:57:27.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.097+0000 7fe8f199d700 1 -- 172.21.15.71:0/1347435350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8ec159420 msgr2=0x7fe8ec0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:27.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.097+0000 7fe8f199d700 1 --2- 172.21.15.71:0/1347435350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8ec159420 0x7fe8ec0b5f40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00098e0 tx=0x7fe8e00091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:27.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.097+0000 7fe8f199d700 1 -- 172.21.15.71:0/1347435350 shutdown_connections 2023-10-09T07:57:27.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.097+0000 7fe8f199d700 1 --2- 172.21.15.71:0/1347435350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8ec159420 0x7fe8ec0b5f40 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:27.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.097+0000 7fe8f199d700 1 -- 172.21.15.71:0/1347435350 >> 172.21.15.71:0/1347435350 conn(0x7fe8ec0d0660 msgr2=0x7fe8ec0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:27.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.097+0000 7fe8f199d700 1 -- 172.21.15.71:0/1347435350 shutdown_connections 2023-10-09T07:57:27.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.097+0000 7fe8f199d700 1 -- 172.21.15.71:0/1347435350 wait complete. 2023-10-09T07:57:27.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.098+0000 7fe8f199d700 1 Processor -- start 2023-10-09T07:57:27.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.099+0000 7fe8f199d700 1 -- start start 2023-10-09T07:57:27.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.099+0000 7fe8f199d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8ec159420 0x7fe8ec068cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:27.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.099+0000 7fe8f199d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8ec1597f0 0x7fe8ec0cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:27.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.099+0000 7fe8f199d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8ec15d230 0x7fe8ec1698d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:27.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.099+0000 7fe8f199d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec0cbdc0 con 0x7fe8ec159420 2023-10-09T07:57:27.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.099+0000 7fe8f199d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec0cc060 con 0x7fe8ec15d230 2023-10-09T07:57:27.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.099+0000 7fe8f199d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec0c54a0 con 0x7fe8ec1597f0 2023-10-09T07:57:27.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.100+0000 7fe8f099b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8ec159420 0x7fe8ec068cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:27.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.100+0000 7fe8f099b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8ec159420 0x7fe8ec068cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48546/0 (socket says 172.21.15.71:48546) 2023-10-09T07:57:27.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.100+0000 7fe8f099b700 1 -- 172.21.15.71:0/419302324 learned_addr learned my addr 172.21.15.71:0/419302324 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:27.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.100+0000 7fe8f119c700 1 --2- 172.21.15.71:0/419302324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8ec15d230 0x7fe8ec1698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:27.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.100+0000 7fe8ebfff700 1 --2- 172.21.15.71:0/419302324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8ec1597f0 0x7fe8ec0cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:27.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.100+0000 7fe8f099b700 1 -- 172.21.15.71:0/419302324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8ec1597f0 msgr2=0x7fe8ec0cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:27.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.100+0000 7fe8f099b700 1 --2- 172.21.15.71:0/419302324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8ec1597f0 0x7fe8ec0cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:27.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.100+0000 7fe8f099b700 1 -- 172.21.15.71:0/419302324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8ec15d230 msgr2=0x7fe8ec1698d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:27.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.100+0000 7fe8f099b700 1 --2- 172.21.15.71:0/419302324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8ec15d230 0x7fe8ec1698d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:27.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.100+0000 7fe8f099b700 1 -- 172.21.15.71:0/419302324 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e0009420 con 0x7fe8ec159420 2023-10-09T07:57:27.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.101+0000 7fe8f099b700 1 --2- 172.21.15.71:0/419302324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8ec159420 0x7fe8ec068cd0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec089340 tx=0x7fe8e0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:27.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.101+0000 7fe8e8ff9700 1 -- 172.21.15.71:0/419302324 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e001cb30 con 0x7fe8ec159420 2023-10-09T07:57:27.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.101+0000 7fe8e8ff9700 1 -- 172.21.15.71:0/419302324 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e001cc90 con 0x7fe8ec159420 2023-10-09T07:57:27.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.101+0000 7fe8e8ff9700 1 -- 172.21.15.71:0/419302324 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e001a6a0 con 0x7fe8ec159420 2023-10-09T07:57:27.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.101+0000 7fe8f199d700 1 -- 172.21.15.71:0/419302324 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ec0c5780 con 0x7fe8ec159420 2023-10-09T07:57:27.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.101+0000 7fe8f199d700 1 -- 172.21.15.71:0/419302324 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ec0cc340 con 0x7fe8ec159420 2023-10-09T07:57:27.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.102+0000 7fe8f199d700 1 -- 172.21.15.71:0/419302324 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ec0c5ca0 con 0x7fe8ec159420 2023-10-09T07:57:27.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.103+0000 7fe8e8ff9700 1 -- 172.21.15.71:0/419302324 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 65) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fe8e001aa90 con 0x7fe8ec159420 2023-10-09T07:57:27.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.104+0000 7fe8e8ff9700 1 --2- 172.21.15.71:0/419302324 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe8d0067020 0x7fe8d00694d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:27.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.104+0000 7fe8e8ff9700 1 -- 172.21.15.71:0/419302324 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6529+0+0 (secure 0 0 0) 0x7fe8e0086330 con 0x7fe8ec159420 2023-10-09T07:57:27.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.104+0000 7fe8ebfff700 1 -- 172.21.15.71:0/419302324 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe8d0067020 msgr2=0x7fe8d00694d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:27.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.104+0000 7fe8ebfff700 1 --2- 172.21.15.71:0/419302324 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe8d0067020 0x7fe8d00694d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:57:27.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.108+0000 7fe8e8ff9700 1 -- 172.21.15.71:0/419302324 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8e00530b0 con 0x7fe8ec159420 2023-10-09T07:57:27.159 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:27.159+0000 7fc37e124180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T07:57:27.255 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:27.255+0000 7fc37e124180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T07:57:27.303 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:27.303+0000 7f94d5995180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T07:57:27.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.305+0000 7fe8ebfff700 1 -- 172.21.15.71:0/419302324 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe8d0067020 msgr2=0x7fe8d00694d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:27.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.305+0000 7fe8ebfff700 1 --2- 172.21.15.71:0/419302324 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe8d0067020 0x7fe8d00694d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:57:27.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.352+0000 7fe8f199d700 1 -- 172.21.15.71:0/419302324 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8ec04c3c0 con 0x7fe8ec159420 2023-10-09T07:57:27.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.353+0000 7fe8e8ff9700 1 -- 172.21.15.71:0/419302324 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fe8e00566d0 con 0x7fe8ec159420 2023-10-09T07:57:27.354 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:57:27.354 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/4239197200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":4239197200},{"type":"v1","addr":"172.21.15.179:6836","nonce":4239197200}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":8094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/645124077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":645124077},{"type":"v1","addr":"172.21.15.71:6833","nonce":645124077}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":8097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/542229353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":542229353},{"type":"v1","addr":"172.21.15.71:6835","nonce":542229353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:01:22.605100+0000","modified":"2023-10-09T07:01:26.163625+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/2229698291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2229698291},{"type":"v1","addr":"172.21.15.179:6834","nonce":2229698291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T07:57:27.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.355+0000 7fe8f199d700 1 -- 172.21.15.71:0/419302324 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe8d0067020 msgr2=0x7fe8d00694d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:57:27.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.355+0000 7fe8f199d700 1 --2- 172.21.15.71:0/419302324 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe8d0067020 0x7fe8d00694d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:27.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.356+0000 7fe8f199d700 1 -- 172.21.15.71:0/419302324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8ec159420 msgr2=0x7fe8ec068cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:27.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.356+0000 7fe8f199d700 1 --2- 172.21.15.71:0/419302324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8ec159420 0x7fe8ec068cd0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec089340 tx=0x7fe8e0016000 comp rx=0 tx=0).stop 2023-10-09T07:57:27.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.356+0000 7fe8f199d700 1 -- 172.21.15.71:0/419302324 shutdown_connections 2023-10-09T07:57:27.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.356+0000 7fe8f199d700 1 --2- 172.21.15.71:0/419302324 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe8d0067020 0x7fe8d00694d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:27.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.356+0000 7fe8f199d700 1 --2- 172.21.15.71:0/419302324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8ec15d230 0x7fe8ec1698d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:27.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.356+0000 7fe8f199d700 1 --2- 172.21.15.71:0/419302324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8ec159420 0x7fe8ec068cd0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:27.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.356+0000 7fe8f199d700 1 --2- 172.21.15.71:0/419302324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8ec1597f0 0x7fe8ec0cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:27.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.356+0000 7fe8f199d700 1 -- 172.21.15.71:0/419302324 >> 172.21.15.71:0/419302324 conn(0x7fe8ec0d0660 msgr2=0x7fe8ec158580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:27.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.356+0000 7fe8f199d700 1 -- 172.21.15.71:0/419302324 shutdown_connections 2023-10-09T07:57:27.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.356+0000 7fe8f199d700 1 -- 172.21.15.71:0/419302324 wait complete. 2023-10-09T07:57:27.358 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 66 2023-10-09T07:57:27.375 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:57:27.405 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:27.404+0000 7f94d5995180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T07:57:27.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.561+0000 7f80c7fff700 1 Processor -- start 2023-10-09T07:57:27.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.561+0000 7f80c7fff700 1 -- start start 2023-10-09T07:57:27.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.562+0000 7f80c7fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f80c8159cc0 0x7f80c80b5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:27.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.562+0000 7f80c7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c80cf6c0 0x7f80c8163280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:27.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.562+0000 7f80c7fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c80b5b40 con 0x7f80c80b2920 2023-10-09T07:57:27.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.562+0000 7f80c7fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c80ce260 con 0x7f80c8159cc0 2023-10-09T07:57:27.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.562+0000 7f80c7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c80b5e20 con 0x7f80c80cf6c0 2023-10-09T07:57:27.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.562+0000 7f80c67fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f80c80b2920 0x7f80c815a090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54050/0 (socket says 172.21.15.71:54050) 2023-10-09T07:57:27.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.562+0000 7f80c67fc700 1 -- 172.21.15.71:0/1083210286 learned_addr learned my addr 172.21.15.71:0/1083210286 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:27.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.563+0000 7f80c77fe700 1 --2- 172.21.15.71:0/1083210286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c80cf6c0 0x7f80c8163280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:27.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.563+0000 7f80c6ffd700 1 --2- 172.21.15.71:0/1083210286 >> v2:172.21.15.179:3300/0 conn(0x7f80c8159cc0 0x7f80c80b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:27.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.563+0000 7f80c5ffb700 1 -- 172.21.15.71:0/1083210286 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 175920226 0 0) 0x7f80c80b5b40 con 0x7f80c80b2920 2023-10-09T07:57:27.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.563+0000 7f80c5ffb700 1 -- 172.21.15.71:0/1083210286 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80b0003570 con 0x7f80c80b2920 2023-10-09T07:57:27.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.563+0000 7f80c77fe700 1 -- 172.21.15.71:0/1083210286 >> v2:172.21.15.179:3300/0 conn(0x7f80c8159cc0 msgr2=0x7f80c80b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:27.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.563+0000 7f80c77fe700 1 --2- 172.21.15.71:0/1083210286 >> v2:172.21.15.179:3300/0 conn(0x7f80c8159cc0 0x7f80c80b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:27.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.563+0000 7f80c77fe700 1 -- 172.21.15.71:0/1083210286 >> v1:172.21.15.71:6789/0 conn(0x7f80c80b2920 legacy=0x7f80c815a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:27.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.563+0000 7f80c77fe700 1 -- 172.21.15.71:0/1083210286 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c80b6100 con 0x7f80c80cf6c0 2023-10-09T07:57:27.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.563+0000 7f80c77fe700 1 --2- 172.21.15.71:0/1083210286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c80cf6c0 0x7f80c8163280 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009e60 tx=0x7f80c0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fdb5bd21565b517 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:27.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.564+0000 7f80c5ffb700 1 -- 172.21.15.71:0/1083210286 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c000e070 con 0x7f80c80cf6c0 2023-10-09T07:57:27.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.564+0000 7f80c5ffb700 1 -- 172.21.15.71:0/1083210286 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c000bab0 con 0x7f80c80cf6c0 2023-10-09T07:57:27.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.564+0000 7f80c5ffb700 1 -- 172.21.15.71:0/1083210286 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c000be70 con 0x7f80c80cf6c0 2023-10-09T07:57:27.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.564+0000 7f80c7fff700 1 -- 172.21.15.71:0/1083210286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c80cf6c0 msgr2=0x7f80c8163280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:27.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.564+0000 7f80c7fff700 1 --2- 172.21.15.71:0/1083210286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c80cf6c0 0x7f80c8163280 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009e60 tx=0x7f80c0009780 comp rx=0 tx=0).stop 2023-10-09T07:57:27.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.564+0000 7f80c7fff700 1 -- 172.21.15.71:0/1083210286 shutdown_connections 2023-10-09T07:57:27.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.564+0000 7f80c7fff700 1 --2- 172.21.15.71:0/1083210286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c80cf6c0 0x7f80c8163280 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:27.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.564+0000 7f80c7fff700 1 --2- 172.21.15.71:0/1083210286 >> v2:172.21.15.179:3300/0 conn(0x7f80c8159cc0 0x7f80c80b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:27.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.564+0000 7f80c7fff700 1 -- 172.21.15.71:0/1083210286 >> 172.21.15.71:0/1083210286 conn(0x7f80c80d0560 msgr2=0x7f80c80d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:27.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.564+0000 7f80c7fff700 1 -- 172.21.15.71:0/1083210286 shutdown_connections 2023-10-09T07:57:27.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.564+0000 7f80c7fff700 1 -- 172.21.15.71:0/1083210286 wait complete. 2023-10-09T07:57:27.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.566+0000 7f80c7fff700 1 Processor -- start 2023-10-09T07:57:27.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.566+0000 7f80c7fff700 1 -- start start 2023-10-09T07:57:27.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.567+0000 7f80c7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80c80b2920 0x7f80c814c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:27.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.567+0000 7f80c7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c80cf6c0 0x7f80c815f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:27.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.567+0000 7f80c7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80c8159cc0 0x7f80c815fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:27.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.567+0000 7f80c7fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c814c920 con 0x7f80c80b2920 2023-10-09T07:57:27.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.567+0000 7f80c7fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c81535c0 con 0x7f80c8159cc0 2023-10-09T07:57:27.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.567+0000 7f80c7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c81538a0 con 0x7f80c80cf6c0 2023-10-09T07:57:27.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.567+0000 7f80c6ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80c80b2920 0x7f80c814c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:27.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.567+0000 7f80c6ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80c80b2920 0x7f80c814c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48558/0 (socket says 172.21.15.71:48558) 2023-10-09T07:57:27.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.567+0000 7f80c6ffd700 1 -- 172.21.15.71:0/1913811927 learned_addr learned my addr 172.21.15.71:0/1913811927 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:27.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.567+0000 7f80c67fc700 1 --2- 172.21.15.71:0/1913811927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c80cf6c0 0x7f80c815f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:27.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.567+0000 7f80c77fe700 1 --2- 172.21.15.71:0/1913811927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80c8159cc0 0x7f80c815fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:27.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.568+0000 7f80c6ffd700 1 -- 172.21.15.71:0/1913811927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c80cf6c0 msgr2=0x7f80c815f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:27.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.568+0000 7f80c6ffd700 1 --2- 172.21.15.71:0/1913811927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c80cf6c0 0x7f80c815f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:27.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.568+0000 7f80c6ffd700 1 -- 172.21.15.71:0/1913811927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80c8159cc0 msgr2=0x7f80c815fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:27.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.568+0000 7f80c6ffd700 1 --2- 172.21.15.71:0/1913811927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80c8159cc0 0x7f80c815fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:27.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.568+0000 7f80c6ffd700 1 -- 172.21.15.71:0/1913811927 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c0009a20 con 0x7f80c80b2920 2023-10-09T07:57:27.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.568+0000 7f80c77fe700 1 --2- 172.21.15.71:0/1913811927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80c8159cc0 0x7f80c815fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:57:27.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.568+0000 7f80c6ffd700 1 --2- 172.21.15.71:0/1913811927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80c80b2920 0x7f80c814c3e0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f80b800ea00 tx=0x7f80b8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:27.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.568+0000 7f80aeffd700 1 -- 172.21.15.71:0/1913811927 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b800c850 con 0x7f80c80b2920 2023-10-09T07:57:27.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.568+0000 7f80aeffd700 1 -- 172.21.15.71:0/1913811927 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b800c9b0 con 0x7f80c80b2920 2023-10-09T07:57:27.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.568+0000 7f80aeffd700 1 -- 172.21.15.71:0/1913811927 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b800cd30 con 0x7f80c80b2920 2023-10-09T07:57:27.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.568+0000 7f80c7fff700 1 -- 172.21.15.71:0/1913811927 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c8153b80 con 0x7f80c80b2920 2023-10-09T07:57:27.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.568+0000 7f80c7fff700 1 -- 172.21.15.71:0/1913811927 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c8154140 con 0x7f80c80b2920 2023-10-09T07:57:27.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.570+0000 7f80c7fff700 1 -- 172.21.15.71:0/1913811927 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c804c3c0 con 0x7f80c80b2920 2023-10-09T07:57:27.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.570+0000 7f80aeffd700 1 -- 172.21.15.71:0/1913811927 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 65) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f80b8013680 con 0x7f80c80b2920 2023-10-09T07:57:27.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.571+0000 7f80aeffd700 1 --2- 172.21.15.71:0/1913811927 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f80b4067050 0x7f80b4069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:27.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.571+0000 7f80aeffd700 1 -- 172.21.15.71:0/1913811927 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6529+0+0 (secure 0 0 0) 0x7f80b8084ff0 con 0x7f80c80b2920 2023-10-09T07:57:27.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.571+0000 7f80c67fc700 1 -- 172.21.15.71:0/1913811927 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f80b4067050 msgr2=0x7f80b4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:27.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.571+0000 7f80c67fc700 1 --2- 172.21.15.71:0/1913811927 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f80b4067050 0x7f80b4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:57:27.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.575+0000 7f80aeffd700 1 -- 172.21.15.71:0/1913811927 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80b8051d70 con 0x7f80c80b2920 2023-10-09T07:57:27.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.772+0000 7f80c67fc700 1 -- 172.21.15.71:0/1913811927 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f80b4067050 msgr2=0x7f80b4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:27.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.772+0000 7f80c67fc700 1 --2- 172.21.15.71:0/1913811927 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f80b4067050 0x7f80b4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:57:27.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.848+0000 7f80c7fff700 1 -- 172.21.15.71:0/1913811927 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80c80b63e0 con 0x7f80c80b2920 2023-10-09T07:57:27.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.849+0000 7f80aeffd700 1 -- 172.21.15.71:0/1913811927 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+16636 (secure 0 0 0) 0x7f80b8021090 con 0x7f80c80b2920 2023-10-09T07:57:27.850 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:57:27.850 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":150,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:57:24.641267+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:01:20.274329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T07:01:21.592220+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":149,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.7","mappings":[{"from":0,"to":2}]},{"pgid":"17.18","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6837/85452":"2023-10-10T07:01:42.900662+0000","172.21.15.179:0/3101119155":"2023-10-10T07:01:42.900662+0000","172.21.15.179:0/2925808610":"2023-10-10T07:01:42.900662+0000","172.21.15.179:6835/85452":"2023-10-10T07:01:42.900662+0000","172.21.15.179:0/573738858":"2023-10-10T07:01:42.900662+0000","172.21.15.179:0/1903715929":"2023-10-10T07:01:42.900662+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":17,"snaps":[{"begin":3,"length":4},{"begin":59,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:57:27.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.851+0000 7f80c7fff700 1 -- 172.21.15.71:0/1913811927 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f80b4067050 msgr2=0x7f80b4069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:57:27.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.851+0000 7f80c7fff700 1 --2- 172.21.15.71:0/1913811927 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f80b4067050 0x7f80b4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:27.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.851+0000 7f80c7fff700 1 -- 172.21.15.71:0/1913811927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80c80b2920 msgr2=0x7f80c814c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:27.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.851+0000 7f80c7fff700 1 --2- 172.21.15.71:0/1913811927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80c80b2920 0x7f80c814c3e0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f80b800ea00 tx=0x7f80b8009120 comp rx=0 tx=0).stop 2023-10-09T07:57:27.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.851+0000 7f80c7fff700 1 -- 172.21.15.71:0/1913811927 shutdown_connections 2023-10-09T07:57:27.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.851+0000 7f80c7fff700 1 --2- 172.21.15.71:0/1913811927 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f80b4067050 0x7f80b4069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:27.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.851+0000 7f80c7fff700 1 --2- 172.21.15.71:0/1913811927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80c8159cc0 0x7f80c815fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:27.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.851+0000 7f80c7fff700 1 --2- 172.21.15.71:0/1913811927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80c80b2920 0x7f80c814c3e0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:27.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.851+0000 7f80c7fff700 1 --2- 172.21.15.71:0/1913811927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c80cf6c0 0x7f80c815f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:27.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.851+0000 7f80c7fff700 1 -- 172.21.15.71:0/1913811927 >> 172.21.15.71:0/1913811927 conn(0x7f80c80d0560 msgr2=0x7f80c8156b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:27.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.851+0000 7f80c7fff700 1 -- 172.21.15.71:0/1913811927 shutdown_connections 2023-10-09T07:57:27.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:27.851+0000 7f80c7fff700 1 -- 172.21.15.71:0/1913811927 wait complete. 2023-10-09T07:57:27.870 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T07:57:27.960 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:27.960+0000 7fc37e124180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T07:57:28.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.102+0000 7fca6bfff700 1 Processor -- start 2023-10-09T07:57:28.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.102+0000 7fca6bfff700 1 -- start start 2023-10-09T07:57:28.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.103+0000 7fca6bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fca6c0b1e50 0x7fca6c159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:28.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.103+0000 7fca6bfff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca6c0cfe20 con 0x7fca6c1593b0 2023-10-09T07:57:28.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.104+0000 7fca6bfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca6c0cf210 con 0x7fca6c0ceaa0 2023-10-09T07:57:28.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.104+0000 7fca6bfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca6c0cf4f0 con 0x7fca6c0b1e50 2023-10-09T07:57:28.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.104+0000 7fca6affd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fca6c1593b0 0x7fca6c0b1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54056/0 (socket says 172.21.15.71:54056) 2023-10-09T07:57:28.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.104+0000 7fca6affd700 1 -- 172.21.15.71:0/4276361735 learned_addr learned my addr 172.21.15.71:0/4276361735 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:28.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.104+0000 7fca6a7fc700 1 --2- 172.21.15.71:0/4276361735 >> v2:172.21.15.179:3300/0 conn(0x7fca6c0b1e50 0x7fca6c159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:28.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.104+0000 7fca69ffb700 1 -- 172.21.15.71:0/4276361735 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460872623 0 0) 0x7fca6c0cfe20 con 0x7fca6c1593b0 2023-10-09T07:57:28.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.104+0000 7fca69ffb700 1 -- 172.21.15.71:0/4276361735 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca54003570 con 0x7fca6c1593b0 2023-10-09T07:57:28.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.104+0000 7fca6a7fc700 1 -- 172.21.15.71:0/4276361735 >> v1:172.21.15.179:6789/0 conn(0x7fca6c0ceaa0 legacy=0x7fca6c0b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:28.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.104+0000 7fca6a7fc700 1 -- 172.21.15.71:0/4276361735 >> v1:172.21.15.71:6789/0 conn(0x7fca6c1593b0 legacy=0x7fca6c0b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:28.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.104+0000 7fca6a7fc700 1 -- 172.21.15.71:0/4276361735 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6c0cf7d0 con 0x7fca6c0b1e50 2023-10-09T07:57:28.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.105+0000 7fca6a7fc700 1 --2- 172.21.15.71:0/4276361735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca6c0b1e50 0x7fca6c159780 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fca600098e0 tx=0x7fca600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1cb3a81c3b2e7ad server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:28.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.105+0000 7fca69ffb700 1 -- 172.21.15.71:0/4276361735 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6000b640 con 0x7fca6c0b1e50 2023-10-09T07:57:28.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.105+0000 7fca69ffb700 1 -- 172.21.15.71:0/4276361735 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6000b7a0 con 0x7fca6c0b1e50 2023-10-09T07:57:28.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.105+0000 7fca69ffb700 1 -- 172.21.15.71:0/4276361735 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6000bb40 con 0x7fca6c0b1e50 2023-10-09T07:57:28.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.105+0000 7fca6bfff700 1 -- 172.21.15.71:0/4276361735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca6c0b1e50 msgr2=0x7fca6c159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:28.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.105+0000 7fca6bfff700 1 --2- 172.21.15.71:0/4276361735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca6c0b1e50 0x7fca6c159780 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fca600098e0 tx=0x7fca600091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:28.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.106+0000 7fca6bfff700 1 -- 172.21.15.71:0/4276361735 shutdown_connections 2023-10-09T07:57:28.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.106+0000 7fca6bfff700 1 --2- 172.21.15.71:0/4276361735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca6c0b1e50 0x7fca6c159780 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:28.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.106+0000 7fca6bfff700 1 -- 172.21.15.71:0/4276361735 >> 172.21.15.71:0/4276361735 conn(0x7fca6c0d1130 msgr2=0x7fca6c0b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:28.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.106+0000 7fca6bfff700 1 -- 172.21.15.71:0/4276361735 shutdown_connections 2023-10-09T07:57:28.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.106+0000 7fca6bfff700 1 -- 172.21.15.71:0/4276361735 wait complete. 2023-10-09T07:57:28.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.107+0000 7fca6bfff700 1 Processor -- start 2023-10-09T07:57:28.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.107+0000 7fca6bfff700 1 -- start start 2023-10-09T07:57:28.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.108+0000 7fca6bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca6c0b1e50 0x7fca6c1697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:28.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.108+0000 7fca6bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca6c0ceaa0 0x7fca6c16c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:28.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.108+0000 7fca6bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca6c1593b0 0x7fca6c15b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:28.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.108+0000 7fca6bfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c15a700 con 0x7fca6c0b1e50 2023-10-09T07:57:28.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.108+0000 7fca6bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c0c55a0 con 0x7fca6c0ceaa0 2023-10-09T07:57:28.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.108+0000 7fca6bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c0c5880 con 0x7fca6c1593b0 2023-10-09T07:57:28.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.108+0000 7fca6affd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca6c0b1e50 0x7fca6c1697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:28.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.108+0000 7fca6affd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca6c0b1e50 0x7fca6c1697e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48568/0 (socket says 172.21.15.71:48568) 2023-10-09T07:57:28.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.108+0000 7fca6affd700 1 -- 172.21.15.71:0/2808799194 learned_addr learned my addr 172.21.15.71:0/2808799194 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:28.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.109+0000 7fca6a7fc700 1 --2- 172.21.15.71:0/2808799194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca6c0ceaa0 0x7fca6c16c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:28.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.109+0000 7fca6b7fe700 1 --2- 172.21.15.71:0/2808799194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca6c1593b0 0x7fca6c15b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:28.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.109+0000 7fca6affd700 1 -- 172.21.15.71:0/2808799194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca6c1593b0 msgr2=0x7fca6c15b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:28.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.109+0000 7fca6affd700 1 --2- 172.21.15.71:0/2808799194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca6c1593b0 0x7fca6c15b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:28.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.109+0000 7fca6affd700 1 -- 172.21.15.71:0/2808799194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca6c0ceaa0 msgr2=0x7fca6c16c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:28.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.109+0000 7fca6affd700 1 --2- 172.21.15.71:0/2808799194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca6c0ceaa0 0x7fca6c16c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:28.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.109+0000 7fca6affd700 1 -- 172.21.15.71:0/2808799194 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca60009420 con 0x7fca6c0b1e50 2023-10-09T07:57:28.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.109+0000 7fca6a7fc700 1 --2- 172.21.15.71:0/2808799194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca6c0ceaa0 0x7fca6c16c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:57:28.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.109+0000 7fca6b7fe700 1 --2- 172.21.15.71:0/2808799194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca6c1593b0 0x7fca6c15b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:57:28.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.109+0000 7fca6affd700 1 --2- 172.21.15.71:0/2808799194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca6c0b1e50 0x7fca6c1697e0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00c590 tx=0x7fca5c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:28.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.109+0000 7fca52ffd700 1 -- 172.21.15.71:0/2808799194 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c005b30 con 0x7fca6c0b1e50 2023-10-09T07:57:28.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.109+0000 7fca52ffd700 1 -- 172.21.15.71:0/2808799194 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5c005cb0 con 0x7fca6c0b1e50 2023-10-09T07:57:28.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.109+0000 7fca52ffd700 1 -- 172.21.15.71:0/2808799194 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c007320 con 0x7fca6c0b1e50 2023-10-09T07:57:28.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.109+0000 7fca6bfff700 1 -- 172.21.15.71:0/2808799194 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6c0c5b60 con 0x7fca6c0b1e50 2023-10-09T07:57:28.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.109+0000 7fca6bfff700 1 -- 172.21.15.71:0/2808799194 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6c16caa0 con 0x7fca6c0b1e50 2023-10-09T07:57:28.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.111+0000 7fca6bfff700 1 -- 172.21.15.71:0/2808799194 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca6c04c3c0 con 0x7fca6c0b1e50 2023-10-09T07:57:28.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.111+0000 7fca52ffd700 1 -- 172.21.15.71:0/2808799194 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 65) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fca5c01b3b0 con 0x7fca6c0b1e50 2023-10-09T07:57:28.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.112+0000 7fca52ffd700 1 --2- 172.21.15.71:0/2808799194 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fca58067050 0x7fca58069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:28.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.112+0000 7fca52ffd700 1 -- 172.21.15.71:0/2808799194 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6529+0+0 (secure 0 0 0) 0x7fca5c083ff0 con 0x7fca6c0b1e50 2023-10-09T07:57:28.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.113+0000 7fca6a7fc700 1 -- 172.21.15.71:0/2808799194 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fca58067050 msgr2=0x7fca58069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:28.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.113+0000 7fca6a7fc700 1 --2- 172.21.15.71:0/2808799194 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fca58067050 0x7fca58069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:57:28.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.120+0000 7fca52ffd700 1 -- 172.21.15.71:0/2808799194 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca5c050dd0 con 0x7fca6c0b1e50 2023-10-09T07:57:28.212 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:28.212+0000 7f94d5995180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T07:57:28.247 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:28.247+0000 7fc37e124180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T07:57:28.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.314+0000 7fca6a7fc700 1 -- 172.21.15.71:0/2808799194 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fca58067050 msgr2=0x7fca58069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:28.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.314+0000 7fca6a7fc700 1 --2- 172.21.15.71:0/2808799194 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fca58067050 0x7fca58069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:57:28.341 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:28.341+0000 7fc37e124180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T07:57:28.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.365+0000 7fca6bfff700 1 -- 172.21.15.71:0/2808799194 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fca6c0cfab0 con 0x7fca6c0b1e50 2023-10-09T07:57:28.367 INFO:tasks.ceph.mon.a.smithi071.stderr:2023-10-09T07:57:28.366+0000 7fdb445f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T07:57:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.370+0000 7fca52ffd700 1 -- 172.21.15.71:0/2808799194 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v67) v1 ==== 161+0+0 (secure 0 0 0) 0x7fca5c017090 con 0x7fca6c0b1e50 2023-10-09T07:57:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.373+0000 7fca6bfff700 1 -- 172.21.15.71:0/2808799194 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fca58067050 msgr2=0x7fca58069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:57:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.373+0000 7fca6bfff700 1 --2- 172.21.15.71:0/2808799194 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fca58067050 0x7fca58069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.373+0000 7fca6bfff700 1 -- 172.21.15.71:0/2808799194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca6c0b1e50 msgr2=0x7fca6c1697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.373+0000 7fca6bfff700 1 --2- 172.21.15.71:0/2808799194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca6c0b1e50 0x7fca6c1697e0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00c590 tx=0x7fca5c007e00 comp rx=0 tx=0).stop 2023-10-09T07:57:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.373+0000 7fca6bfff700 1 -- 172.21.15.71:0/2808799194 shutdown_connections 2023-10-09T07:57:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.373+0000 7fca6bfff700 1 --2- 172.21.15.71:0/2808799194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca6c1593b0 0x7fca6c15b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.373+0000 7fca6bfff700 1 --2- 172.21.15.71:0/2808799194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca6c0b1e50 0x7fca6c1697e0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.373+0000 7fca6bfff700 1 --2- 172.21.15.71:0/2808799194 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fca58067050 0x7fca58069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:28.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.373+0000 7fca6bfff700 1 --2- 172.21.15.71:0/2808799194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca6c0ceaa0 0x7fca6c16c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:28.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.373+0000 7fca6bfff700 1 -- 172.21.15.71:0/2808799194 >> 172.21.15.71:0/2808799194 conn(0x7fca6c0d1130 msgr2=0x7fca6c157e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:28.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.373+0000 7fca6bfff700 1 -- 172.21.15.71:0/2808799194 shutdown_connections 2023-10-09T07:57:28.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.373+0000 7fca6bfff700 1 -- 172.21.15.71:0/2808799194 wait complete. 2023-10-09T07:57:28.376 INFO:teuthology.orchestra.run.smithi071.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T07:57:28.392 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T07:57:28.431 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-09T07:57:28.506 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:28.506+0000 7fc37e124180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T07:57:28.512 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:28.512+0000 7f94d5995180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T07:57:28.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.580+0000 7f6d99b9d700 1 Processor -- start 2023-10-09T07:57:28.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.580+0000 7f6d99b9d700 1 -- start start 2023-10-09T07:57:28.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.581+0000 7f6d99b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d940b4e70 0x7f6d940ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.581+0000 7f6d99b9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d940cfb00 con 0x7f6d940b16d0 2023-10-09T07:57:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.581+0000 7f6d99b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9415e060 con 0x7f6d940b1b40 2023-10-09T07:57:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.581+0000 7f6d99b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d940b5c40 con 0x7f6d940b4e70 2023-10-09T07:57:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.582+0000 7f6d93fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6d940b16d0 0x7f6d9415d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54064/0 (socket says 172.21.15.71:54064) 2023-10-09T07:57:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.582+0000 7f6d93fff700 1 -- 172.21.15.71:0/2052655190 learned_addr learned my addr 172.21.15.71:0/2052655190 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.582+0000 7f6d98b9b700 1 --2- 172.21.15.71:0/2052655190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d940b4e70 0x7f6d940ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.582+0000 7f6d937fe700 1 -- 172.21.15.71:0/2052655190 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448306364 0 0) 0x7f6d940cfb00 con 0x7f6d940b16d0 2023-10-09T07:57:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.582+0000 7f6d937fe700 1 -- 172.21.15.71:0/2052655190 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d84003570 con 0x7f6d940b16d0 2023-10-09T07:57:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.582+0000 7f6d937fe700 1 -- 172.21.15.71:0/2052655190 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879506631 0 0) 0x7f6d9415e060 con 0x7f6d940b1b40 2023-10-09T07:57:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.582+0000 7f6d937fe700 1 -- 172.21.15.71:0/2052655190 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d940cfb00 con 0x7f6d940b1b40 2023-10-09T07:57:28.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.582+0000 7f6d98b9b700 1 -- 172.21.15.71:0/2052655190 >> v1:172.21.15.179:6789/0 conn(0x7f6d940b1b40 legacy=0x7f6d9415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:28.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.582+0000 7f6d98b9b700 1 -- 172.21.15.71:0/2052655190 >> v1:172.21.15.71:6789/0 conn(0x7f6d940b16d0 legacy=0x7f6d9415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:28.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.582+0000 7f6d98b9b700 1 -- 172.21.15.71:0/2052655190 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d940b5f20 con 0x7f6d940b4e70 2023-10-09T07:57:28.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.583+0000 7f6d98b9b700 1 --2- 172.21.15.71:0/2052655190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d940b4e70 0x7f6d940ccff0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6d88009e90 tx=0x7f6d88009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d58c79ea1d01672d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:28.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.583+0000 7f6d937fe700 1 -- 172.21.15.71:0/2052655190 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8800e070 con 0x7f6d940b4e70 2023-10-09T07:57:28.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.583+0000 7f6d937fe700 1 -- 172.21.15.71:0/2052655190 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8800bb80 con 0x7f6d940b4e70 2023-10-09T07:57:28.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.583+0000 7f6d937fe700 1 -- 172.21.15.71:0/2052655190 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d88012430 con 0x7f6d940b4e70 2023-10-09T07:57:28.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.584+0000 7f6d99b9d700 1 -- 172.21.15.71:0/2052655190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d940b4e70 msgr2=0x7f6d940ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:28.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.584+0000 7f6d99b9d700 1 --2- 172.21.15.71:0/2052655190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d940b4e70 0x7f6d940ccff0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6d88009e90 tx=0x7f6d88009780 comp rx=0 tx=0).stop 2023-10-09T07:57:28.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.584+0000 7f6d99b9d700 1 -- 172.21.15.71:0/2052655190 shutdown_connections 2023-10-09T07:57:28.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.584+0000 7f6d99b9d700 1 --2- 172.21.15.71:0/2052655190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d940b4e70 0x7f6d940ccff0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:28.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.584+0000 7f6d99b9d700 1 -- 172.21.15.71:0/2052655190 >> 172.21.15.71:0/2052655190 conn(0x7f6d940d10c0 msgr2=0x7f6d940affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:28.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.584+0000 7f6d99b9d700 1 -- 172.21.15.71:0/2052655190 shutdown_connections 2023-10-09T07:57:28.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.584+0000 7f6d99b9d700 1 -- 172.21.15.71:0/2052655190 wait complete. 2023-10-09T07:57:28.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.585+0000 7f6d99b9d700 1 Processor -- start 2023-10-09T07:57:28.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.585+0000 7f6d99b9d700 1 -- start start 2023-10-09T07:57:28.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.586+0000 7f6d99b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d940b16d0 0x7f6d94157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:28.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.586+0000 7f6d99b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d940b1b40 0x7f6d94149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:28.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.586+0000 7f6d99b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d940b4e70 0x7f6d9416a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:28.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.586+0000 7f6d99b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d940c8600 con 0x7f6d940b1b40 2023-10-09T07:57:28.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.586+0000 7f6d99b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d940c70a0 con 0x7f6d940b16d0 2023-10-09T07:57:28.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.586+0000 7f6d99b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d940c6490 con 0x7f6d940b4e70 2023-10-09T07:57:28.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.586+0000 7f6d93fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d940b1b40 0x7f6d94149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:28.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.586+0000 7f6d93fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d940b1b40 0x7f6d94149240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48570/0 (socket says 172.21.15.71:48570) 2023-10-09T07:57:28.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.586+0000 7f6d93fff700 1 -- 172.21.15.71:0/1945662905 learned_addr learned my addr 172.21.15.71:0/1945662905 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:28.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.587+0000 7f6d9939c700 1 --2- 172.21.15.71:0/1945662905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d940b4e70 0x7f6d9416a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:28.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.587+0000 7f6d98b9b700 1 --2- 172.21.15.71:0/1945662905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d940b16d0 0x7f6d94157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:28.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.587+0000 7f6d93fff700 1 -- 172.21.15.71:0/1945662905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d940b4e70 msgr2=0x7f6d9416a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:28.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.587+0000 7f6d93fff700 1 --2- 172.21.15.71:0/1945662905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d940b4e70 0x7f6d9416a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:28.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.587+0000 7f6d93fff700 1 -- 172.21.15.71:0/1945662905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d940b16d0 msgr2=0x7f6d94157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:28.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.587+0000 7f6d93fff700 1 --2- 172.21.15.71:0/1945662905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d940b16d0 0x7f6d94157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:28.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.587+0000 7f6d93fff700 1 -- 172.21.15.71:0/1945662905 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d88009a20 con 0x7f6d940b1b40 2023-10-09T07:57:28.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.587+0000 7f6d93fff700 1 --2- 172.21.15.71:0/1945662905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d940b1b40 0x7f6d94149240 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000c790 tx=0x7f6d80007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:28.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.587+0000 7f6d90ff9700 1 -- 172.21.15.71:0/1945662905 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80005b30 con 0x7f6d940b1b40 2023-10-09T07:57:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.587+0000 7f6d90ff9700 1 -- 172.21.15.71:0/1945662905 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d80005c90 con 0x7f6d940b1b40 2023-10-09T07:57:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.587+0000 7f6d99b9d700 1 -- 172.21.15.71:0/1945662905 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d940c6770 con 0x7f6d940b1b40 2023-10-09T07:57:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.588+0000 7f6d90ff9700 1 -- 172.21.15.71:0/1945662905 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80007300 con 0x7f6d940b1b40 2023-10-09T07:57:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.588+0000 7f6d99b9d700 1 -- 172.21.15.71:0/1945662905 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d940c6d30 con 0x7f6d940b1b40 2023-10-09T07:57:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.589+0000 7f6d99b9d700 1 -- 172.21.15.71:0/1945662905 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d940c7250 con 0x7f6d940b1b40 2023-10-09T07:57:28.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.589+0000 7f6d90ff9700 1 -- 172.21.15.71:0/1945662905 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 65) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f6d8001b3b0 con 0x7f6d940b1b40 2023-10-09T07:57:28.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.590+0000 7f6d90ff9700 1 --2- 172.21.15.71:0/1945662905 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6d78067050 0x7f6d78069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:28.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.590+0000 7f6d90ff9700 1 -- 172.21.15.71:0/1945662905 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6571+0+0 (secure 0 0 0) 0x7f6d80083fd0 con 0x7f6d940b1b40 2023-10-09T07:57:28.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.590+0000 7f6d98b9b700 1 -- 172.21.15.71:0/1945662905 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6d78067050 msgr2=0x7f6d78069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:28.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.590+0000 7f6d98b9b700 1 --2- 172.21.15.71:0/1945662905 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6d78067050 0x7f6d78069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:57:28.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.594+0000 7f6d90ff9700 1 -- 172.21.15.71:0/1945662905 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d940c7250 con 0x7f6d940b1b40 2023-10-09T07:57:28.610 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:28.610+0000 7f94d5995180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T07:57:28.611 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:28.611+0000 7fc37e124180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T07:57:28.769 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:28.768+0000 7f94d5995180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T07:57:28.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.791+0000 7f6d98b9b700 1 -- 172.21.15.71:0/1945662905 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6d78067050 msgr2=0x7f6d78069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:28.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.791+0000 7f6d98b9b700 1 --2- 172.21.15.71:0/1945662905 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6d78067050 0x7f6d78069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:57:28.800 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:28.800+0000 7fc37e124180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T07:57:28.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:28.837+0000 7f6d99b9d700 1 -- 172.21.15.71:0/1945662905 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6d940c7210 con 0x7f6d940b1b40 2023-10-09T07:57:28.874 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:28.873+0000 7f94d5995180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T07:57:28.893 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:28.893+0000 7fc37e124180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T07:57:28.986 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:28.986+0000 7fc37e124180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T07:57:29.065 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:29.064+0000 7f94d5995180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T07:57:29.080 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:29.080+0000 7fc37e124180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T07:57:29.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.090+0000 7f6d90ff9700 1 -- 172.21.15.71:0/1945662905 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 66) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f6d80051100 con 0x7f6d940b1b40 2023-10-09T07:57:29.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.090+0000 7f6d90ff9700 1 -- 172.21.15.71:0/1945662905 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6d78067050 msgr2=0x7f6d78069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:57:29.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.090+0000 7f6d90ff9700 1 --2- 172.21.15.71:0/1945662905 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6d78067050 0x7f6d78069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:29.163 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:29.162+0000 7fc2fbd08700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:57:29.164 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:29.162+0000 7fc2fbd08700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:57:29.164 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:29.162+0000 7fc2fbd08700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:57:29.164 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:29.162+0000 7fc2fbd08700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:57:29.164 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:29.162+0000 7fc2fbd08700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:57:29.164 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:29.163+0000 7fc2f7d00700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:57:29.164 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:29.163+0000 7fc2f7d00700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:57:29.165 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:29.163+0000 7fc2f7d00700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:57:29.165 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:29.163+0000 7fc2f7d00700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:57:29.165 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:29.163+0000 7fc2f7d00700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:57:29.166 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:29.165+0000 7f94d5995180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T07:57:29.257 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:29.256+0000 7f94d5995180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T07:57:29.351 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:29.350+0000 7f94d5995180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T07:57:29.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.371+0000 7f6d90ff9700 1 -- 172.21.15.71:0/1945662905 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v68) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6d8006eb40 con 0x7f6d940b1b40 2023-10-09T07:57:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.374+0000 7f6d99b9d700 1 -- 172.21.15.71:0/1945662905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d940b1b40 msgr2=0x7f6d94149240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.374+0000 7f6d99b9d700 1 --2- 172.21.15.71:0/1945662905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d940b1b40 0x7f6d94149240 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000c790 tx=0x7f6d80007ea0 comp rx=0 tx=0).stop 2023-10-09T07:57:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.374+0000 7f6d99b9d700 1 -- 172.21.15.71:0/1945662905 shutdown_connections 2023-10-09T07:57:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.374+0000 7f6d99b9d700 1 --2- 172.21.15.71:0/1945662905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d940b4e70 0x7f6d9416a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.374+0000 7f6d99b9d700 1 --2- 172.21.15.71:0/1945662905 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6d78067050 0x7f6d78069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.374+0000 7f6d99b9d700 1 --2- 172.21.15.71:0/1945662905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d940b16d0 0x7f6d94157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.374+0000 7f6d99b9d700 1 --2- 172.21.15.71:0/1945662905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d940b1b40 0x7f6d94149240 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.374+0000 7f6d99b9d700 1 -- 172.21.15.71:0/1945662905 >> 172.21.15.71:0/1945662905 conn(0x7f6d940d10c0 msgr2=0x7f6d940b5480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.374+0000 7f6d99b9d700 1 -- 172.21.15.71:0/1945662905 shutdown_connections 2023-10-09T07:57:29.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.374+0000 7f6d99b9d700 1 -- 172.21.15.71:0/1945662905 wait complete. 2023-10-09T07:57:29.392 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T07:57:29.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.576+0000 7f3cb71ff700 1 Processor -- start 2023-10-09T07:57:29.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.576+0000 7f3cb71ff700 1 -- start start 2023-10-09T07:57:29.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.578+0000 7f3cb71ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3cb0157740 0x7f3cb00adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:29.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.578+0000 7f3cb71ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3cb00b2100 0x7f3cb0068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:29.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.578+0000 7f3cb71ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb0068d30 con 0x7f3cb00688d0 2023-10-09T07:57:29.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.578+0000 7f3cb71ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb00acc00 con 0x7f3cb0157740 2023-10-09T07:57:29.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.578+0000 7f3cb71ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb006d6a0 con 0x7f3cb00b2100 2023-10-09T07:57:29.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.578+0000 7f3cb4f9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3cb0157740 0x7f3cb00adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:29.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.578+0000 7f3cb4f9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3cb0157740 0x7f3cb00adfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48586/0 (socket says 172.21.15.71:48586) 2023-10-09T07:57:29.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.578+0000 7f3cb4f9b700 1 -- 172.21.15.71:0/1770520589 learned_addr learned my addr 172.21.15.71:0/1770520589 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:29.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.578+0000 7f3cb4f9b700 1 -- 172.21.15.71:0/1770520589 >> v2:172.21.15.179:3300/0 conn(0x7f3cb00b2100 msgr2=0x7f3cb0068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:29.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.578+0000 7f3caffff700 1 --2- 172.21.15.71:0/1770520589 >> v2:172.21.15.179:3300/0 conn(0x7f3cb00b2100 0x7f3cb0068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:29.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.578+0000 7f3cb4f9b700 1 --2- 172.21.15.71:0/1770520589 >> v2:172.21.15.179:3300/0 conn(0x7f3cb00b2100 0x7f3cb0068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:29.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.578+0000 7f3cb4f9b700 1 -- 172.21.15.71:0/1770520589 >> v1:172.21.15.179:6789/0 conn(0x7f3cb00688d0 legacy=0x7f3cb0069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:29.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.578+0000 7f3cb4f9b700 1 -- 172.21.15.71:0/1770520589 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb006dc20 con 0x7f3cb0157740 2023-10-09T07:57:29.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.578+0000 7f3caffff700 1 --2- 172.21.15.71:0/1770520589 >> v2:172.21.15.179:3300/0 conn(0x7f3cb00b2100 0x7f3cb0068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:57:29.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.579+0000 7f3cb4f9b700 1 --2- 172.21.15.71:0/1770520589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb0157740 0x7f3cb00adfc0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f3cb006a9c0 tx=0x7f3ca4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9f5517589b6865 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:29.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.579+0000 7f3caf7fe700 1 -- 172.21.15.71:0/1770520589 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca400b860 con 0x7f3cb0157740 2023-10-09T07:57:29.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.579+0000 7f3caf7fe700 1 -- 172.21.15.71:0/1770520589 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca400b9c0 con 0x7f3cb0157740 2023-10-09T07:57:29.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.579+0000 7f3caf7fe700 1 -- 172.21.15.71:0/1770520589 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca400bd60 con 0x7f3cb0157740 2023-10-09T07:57:29.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.579+0000 7f3cb71ff700 1 -- 172.21.15.71:0/1770520589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb0157740 msgr2=0x7f3cb00adfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.579+0000 7f3cb71ff700 1 --2- 172.21.15.71:0/1770520589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb0157740 0x7f3cb00adfc0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f3cb006a9c0 tx=0x7f3ca4009250 comp rx=0 tx=0).stop 2023-10-09T07:57:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.579+0000 7f3cb71ff700 1 -- 172.21.15.71:0/1770520589 shutdown_connections 2023-10-09T07:57:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.579+0000 7f3cb71ff700 1 --2- 172.21.15.71:0/1770520589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb0157740 0x7f3cb00adfc0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.579+0000 7f3cb71ff700 1 --2- 172.21.15.71:0/1770520589 >> v2:172.21.15.179:3300/0 conn(0x7f3cb00b2100 0x7f3cb0068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.579+0000 7f3cb71ff700 1 -- 172.21.15.71:0/1770520589 >> 172.21.15.71:0/1770520589 conn(0x7f3cb00c8f90 msgr2=0x7f3cb00c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.580+0000 7f3cb71ff700 1 -- 172.21.15.71:0/1770520589 shutdown_connections 2023-10-09T07:57:29.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.580+0000 7f3cb71ff700 1 -- 172.21.15.71:0/1770520589 wait complete. 2023-10-09T07:57:29.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.581+0000 7f3cb71ff700 1 Processor -- start 2023-10-09T07:57:29.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.581+0000 7f3cb71ff700 1 -- start start 2023-10-09T07:57:29.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.582+0000 7f3cb71ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb00688d0 0x7f3cb0153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:29.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.582+0000 7f3cb71ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cb00b2100 0x7f3cb00c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:29.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.582+0000 7f3cb71ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cb0157740 0x7f3cb00c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.582+0000 7f3cb71ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb00c7fd0 con 0x7f3cb00688d0 2023-10-09T07:57:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.582+0000 7f3cb71ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb0153bb0 con 0x7f3cb0157740 2023-10-09T07:57:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.582+0000 7f3cb71ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb00c73c0 con 0x7f3cb00b2100 2023-10-09T07:57:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.582+0000 7f3cb4f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb00688d0 0x7f3cb0153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.582+0000 7f3cb4f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb00688d0 0x7f3cb0153670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48592/0 (socket says 172.21.15.71:48592) 2023-10-09T07:57:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.582+0000 7f3cb4f9b700 1 -- 172.21.15.71:0/3372951789 learned_addr learned my addr 172.21.15.71:0/3372951789 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.583+0000 7f3caffff700 1 --2- 172.21.15.71:0/3372951789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cb00b2100 0x7f3cb00c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.583+0000 7f3cb579c700 1 --2- 172.21.15.71:0/3372951789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cb0157740 0x7f3cb00c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.583+0000 7f3cb4f9b700 1 -- 172.21.15.71:0/3372951789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cb00b2100 msgr2=0x7f3cb00c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.583+0000 7f3cb4f9b700 1 --2- 172.21.15.71:0/3372951789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cb00b2100 0x7f3cb00c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.583+0000 7f3cb4f9b700 1 -- 172.21.15.71:0/3372951789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cb0157740 msgr2=0x7f3cb00c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.583+0000 7f3cb4f9b700 1 --2- 172.21.15.71:0/3372951789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cb0157740 0x7f3cb00c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:29.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.583+0000 7f3cb4f9b700 1 -- 172.21.15.71:0/3372951789 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca40094f0 con 0x7f3cb00688d0 2023-10-09T07:57:29.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.583+0000 7f3caffff700 1 --2- 172.21.15.71:0/3372951789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cb00b2100 0x7f3cb00c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:57:29.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.583+0000 7f3cb579c700 1 --2- 172.21.15.71:0/3372951789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cb0157740 0x7f3cb00c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:57:29.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.583+0000 7f3cb4f9b700 1 --2- 172.21.15.71:0/3372951789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb00688d0 0x7f3cb0153670 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4009290 tx=0x7f3ca4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:29.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.583+0000 7f3cacff9700 1 -- 172.21.15.71:0/3372951789 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4011e60 con 0x7f3cb00688d0 2023-10-09T07:57:29.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.583+0000 7f3cacff9700 1 -- 172.21.15.71:0/3372951789 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca401a630 con 0x7f3cb00688d0 2023-10-09T07:57:29.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.583+0000 7f3cacff9700 1 -- 172.21.15.71:0/3372951789 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca401a9f0 con 0x7f3cb00688d0 2023-10-09T07:57:29.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.583+0000 7f3cb71ff700 1 -- 172.21.15.71:0/3372951789 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb00c76a0 con 0x7f3cb00688d0 2023-10-09T07:57:29.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.583+0000 7f3cb71ff700 1 -- 172.21.15.71:0/3372951789 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb00c7c60 con 0x7f3cb00688d0 2023-10-09T07:57:29.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.584+0000 7f3cb71ff700 1 -- 172.21.15.71:0/3372951789 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb00718b0 con 0x7f3cb00688d0 2023-10-09T07:57:29.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.585+0000 7f3cacff9700 1 -- 172.21.15.71:0/3372951789 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 66) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f3ca402d440 con 0x7f3cb00688d0 2023-10-09T07:57:29.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.586+0000 7f3cacff9700 1 -- 172.21.15.71:0/3372951789 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6829+0+0 (secure 0 0 0) 0x7f3ca4086010 con 0x7f3cb00688d0 2023-10-09T07:57:29.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.591+0000 7f3cacff9700 1 -- 172.21.15.71:0/3372951789 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ca4053260 con 0x7f3cb00688d0 2023-10-09T07:57:29.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:29.785+0000 7f3cb71ff700 1 -- 172.21.15.71:0/3372951789 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3cb00ae910 con 0x7f3cb00688d0 2023-10-09T07:57:30.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.092+0000 7f3cacff9700 1 -- 172.21.15.71:0/3372951789 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 67) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f3ca4052d10 con 0x7f3cb00688d0 2023-10-09T07:57:30.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.093+0000 7f3cacff9700 1 --2- 172.21.15.71:0/3372951789 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c9406cb60 0x7f3c9406ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:30.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.095+0000 7f3caffff700 1 --2- 172.21.15.71:0/3372951789 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c9406cb60 0x7f3c9406ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:30.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.100+0000 7f3caffff700 1 --2- 172.21.15.71:0/3372951789 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c9406cb60 0x7f3c9406ef40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3cb00c6a20 tx=0x7f3c9c008040 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:30.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.648+0000 7f3cacff9700 1 -- 172.21.15.71:0/3372951789 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v153) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3ca406b250 con 0x7f3cb00688d0 2023-10-09T07:57:30.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.651+0000 7f3cb71ff700 1 -- 172.21.15.71:0/3372951789 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c9406cb60 msgr2=0x7f3c9406ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:30.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.651+0000 7f3cb71ff700 1 --2- 172.21.15.71:0/3372951789 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c9406cb60 0x7f3c9406ef40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3cb00c6a20 tx=0x7f3c9c008040 comp rx=0 tx=0).stop 2023-10-09T07:57:30.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.651+0000 7f3cb71ff700 1 -- 172.21.15.71:0/3372951789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb00688d0 msgr2=0x7f3cb0153670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:30.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.651+0000 7f3cb71ff700 1 --2- 172.21.15.71:0/3372951789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb00688d0 0x7f3cb0153670 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4009290 tx=0x7f3ca4017000 comp rx=0 tx=0).stop 2023-10-09T07:57:30.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.651+0000 7f3cb71ff700 1 -- 172.21.15.71:0/3372951789 shutdown_connections 2023-10-09T07:57:30.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.652+0000 7f3cb71ff700 1 --2- 172.21.15.71:0/3372951789 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c9406cb60 0x7f3c9406ef40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:30.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.652+0000 7f3cb71ff700 1 --2- 172.21.15.71:0/3372951789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cb0157740 0x7f3cb00c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:30.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.652+0000 7f3cb71ff700 1 --2- 172.21.15.71:0/3372951789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb00688d0 0x7f3cb0153670 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:30.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.652+0000 7f3cb71ff700 1 --2- 172.21.15.71:0/3372951789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cb00b2100 0x7f3cb00c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:30.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.652+0000 7f3cb71ff700 1 -- 172.21.15.71:0/3372951789 >> 172.21.15.71:0/3372951789 conn(0x7f3cb00c8f90 msgr2=0x7f3cb00cab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:30.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.652+0000 7f3cb71ff700 1 -- 172.21.15.71:0/3372951789 shutdown_connections 2023-10-09T07:57:30.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.652+0000 7f3cb71ff700 1 -- 172.21.15.71:0/3372951789 wait complete. 2023-10-09T07:57:30.654 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' removed 2023-10-09T07:57:30.673 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T07:57:30.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.856+0000 7f3fe97ff700 1 Processor -- start 2023-10-09T07:57:30.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.856+0000 7f3fe97ff700 1 -- start start 2023-10-09T07:57:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.857+0000 7f3fe97ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3fe41563b0 0x7f3fe4156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.857+0000 7f3fe97ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe4068890 0x7f3fe40c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.857+0000 7f3fe97ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe415a9b0 con 0x7f3fe415a440 2023-10-09T07:57:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.857+0000 7f3fe97ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe415ac90 con 0x7f3fe41563b0 2023-10-09T07:57:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.857+0000 7f3fe97ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe415af70 con 0x7f3fe4068890 2023-10-09T07:57:30.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.857+0000 7f3fe2ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3fe41563b0 0x7f3fe4156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:30.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.857+0000 7f3fe27fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3fe415a440 0x7f3fe40acf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54066/0 (socket says 172.21.15.71:54066) 2023-10-09T07:57:30.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.858+0000 7f3fe27fc700 1 -- 172.21.15.71:0/1339241601 learned_addr learned my addr 172.21.15.71:0/1339241601 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:30.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.858+0000 7f3fe37fe700 1 --2- 172.21.15.71:0/1339241601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe4068890 0x7f3fe40c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:30.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.858+0000 7f3fe2ffd700 1 -- 172.21.15.71:0/1339241601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe4068890 msgr2=0x7f3fe40c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.858+0000 7f3fe2ffd700 1 --2- 172.21.15.71:0/1339241601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe4068890 0x7f3fe40c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.858+0000 7f3fe2ffd700 1 -- 172.21.15.71:0/1339241601 >> v1:172.21.15.71:6789/0 conn(0x7f3fe415a440 legacy=0x7f3fe40acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.858+0000 7f3fe2ffd700 1 -- 172.21.15.71:0/1339241601 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe415b250 con 0x7f3fe41563b0 2023-10-09T07:57:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.858+0000 7f3fe1ffb700 1 -- 172.21.15.71:0/1339241601 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989693186 0 0) 0x7f3fe415a9b0 con 0x7f3fe415a440 2023-10-09T07:57:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.858+0000 7f3fe37fe700 1 --2- 172.21.15.71:0/1339241601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe4068890 0x7f3fe40c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:57:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.858+0000 7f3fe2ffd700 1 --2- 172.21.15.71:0/1339241601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe41563b0 0x7f3fe4156780 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40098e0 tx=0x7f3fd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410177378a6f25d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.858+0000 7f3fe1ffb700 1 -- 172.21.15.71:0/1339241601 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4009e80 con 0x7f3fe41563b0 2023-10-09T07:57:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.858+0000 7f3fe1ffb700 1 -- 172.21.15.71:0/1339241601 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd400b860 con 0x7f3fe41563b0 2023-10-09T07:57:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.858+0000 7f3fe1ffb700 1 -- 172.21.15.71:0/1339241601 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd400bbe0 con 0x7f3fe41563b0 2023-10-09T07:57:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.859+0000 7f3fe97ff700 1 -- 172.21.15.71:0/1339241601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe41563b0 msgr2=0x7f3fe4156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.859+0000 7f3fe97ff700 1 --2- 172.21.15.71:0/1339241601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe41563b0 0x7f3fe4156780 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40098e0 tx=0x7f3fd40091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.859+0000 7f3fe97ff700 1 -- 172.21.15.71:0/1339241601 shutdown_connections 2023-10-09T07:57:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.859+0000 7f3fe97ff700 1 --2- 172.21.15.71:0/1339241601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe4068890 0x7f3fe40c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.859+0000 7f3fe97ff700 1 --2- 172.21.15.71:0/1339241601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe41563b0 0x7f3fe4156780 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.859+0000 7f3fe97ff700 1 -- 172.21.15.71:0/1339241601 >> 172.21.15.71:0/1339241601 conn(0x7f3fe40c8f90 msgr2=0x7f3fe40c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.859+0000 7f3fe97ff700 1 -- 172.21.15.71:0/1339241601 shutdown_connections 2023-10-09T07:57:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.859+0000 7f3fe97ff700 1 -- 172.21.15.71:0/1339241601 wait complete. 2023-10-09T07:57:30.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.860+0000 7f3fe97ff700 1 Processor -- start 2023-10-09T07:57:30.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.861+0000 7f3fe97ff700 1 -- start start 2023-10-09T07:57:30.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.861+0000 7f3fe97ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe4068890 0x7f3fe4167c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.861+0000 7f3fe97ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe41563b0 0x7f3fe4155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.862+0000 7f3fe97ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fe415a440 0x7f3fe40b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.862+0000 7f3fe97ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40b08e0 con 0x7f3fe41563b0 2023-10-09T07:57:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.862+0000 7f3fe97ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40b0bc0 con 0x7f3fe415a440 2023-10-09T07:57:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.862+0000 7f3fe97ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40b0ea0 con 0x7f3fe4068890 2023-10-09T07:57:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.862+0000 7f3fe27fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe41563b0 0x7f3fe4155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.862+0000 7f3fe27fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe41563b0 0x7f3fe4155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48614/0 (socket says 172.21.15.71:48614) 2023-10-09T07:57:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.862+0000 7f3fe27fc700 1 -- 172.21.15.71:0/1856593925 learned_addr learned my addr 172.21.15.71:0/1856593925 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.862+0000 7f3fe2ffd700 1 --2- 172.21.15.71:0/1856593925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe4068890 0x7f3fe4167c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.862+0000 7f3fe37fe700 1 --2- 172.21.15.71:0/1856593925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fe415a440 0x7f3fe40b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.862+0000 7f3fe27fc700 1 -- 172.21.15.71:0/1856593925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe4068890 msgr2=0x7f3fe4167c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.862+0000 7f3fe27fc700 1 --2- 172.21.15.71:0/1856593925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe4068890 0x7f3fe4167c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.862+0000 7f3fe27fc700 1 -- 172.21.15.71:0/1856593925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fe415a440 msgr2=0x7f3fe40b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.862+0000 7f3fe27fc700 1 --2- 172.21.15.71:0/1856593925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fe415a440 0x7f3fe40b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.862+0000 7f3fe27fc700 1 -- 172.21.15.71:0/1856593925 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd4009420 con 0x7f3fe41563b0 2023-10-09T07:57:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.862+0000 7f3fe37fe700 1 --2- 172.21.15.71:0/1856593925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fe415a440 0x7f3fe40b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:57:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.862+0000 7f3fe27fc700 1 --2- 172.21.15.71:0/1856593925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe41563b0 0x7f3fe4155ac0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800c7e0 tx=0x7f3fd8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.863+0000 7f3fcaffd700 1 -- 172.21.15.71:0/1856593925 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8005b30 con 0x7f3fe41563b0 2023-10-09T07:57:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.863+0000 7f3fcaffd700 1 -- 172.21.15.71:0/1856593925 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd8005c90 con 0x7f3fe41563b0 2023-10-09T07:57:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.863+0000 7f3fe97ff700 1 -- 172.21.15.71:0/1856593925 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe40b1180 con 0x7f3fe41563b0 2023-10-09T07:57:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.863+0000 7f3fcaffd700 1 -- 172.21.15.71:0/1856593925 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8007300 con 0x7f3fe41563b0 2023-10-09T07:57:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.863+0000 7f3fe97ff700 1 -- 172.21.15.71:0/1856593925 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe40b1fe0 con 0x7f3fe41563b0 2023-10-09T07:57:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.864+0000 7f3fe97ff700 1 -- 172.21.15.71:0/1856593925 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe415baa0 con 0x7f3fe41563b0 2023-10-09T07:57:30.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.864+0000 7f3fcaffd700 1 -- 172.21.15.71:0/1856593925 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 67) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f3fd801b400 con 0x7f3fe41563b0 2023-10-09T07:57:30.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.865+0000 7f3fcaffd700 1 --2- 172.21.15.71:0/1856593925 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3fd0066d80 0x7f3fd0069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:30.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.865+0000 7f3fcaffd700 1 -- 172.21.15.71:0/1856593925 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6391+0+0 (secure 0 0 0) 0x7f3fd8084130 con 0x7f3fe41563b0 2023-10-09T07:57:30.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.866+0000 7f3fe2ffd700 1 --2- 172.21.15.71:0/1856593925 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3fd0066d80 0x7f3fd0069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:30.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.866+0000 7f3fe2ffd700 1 --2- 172.21.15.71:0/1856593925 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3fd0066d80 0x7f3fd0069230 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40091e0 tx=0x7f3fd4017000 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:30.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:30.870+0000 7f3fcaffd700 1 -- 172.21.15.71:0/1856593925 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fe415baa0 con 0x7f3fe41563b0 2023-10-09T07:57:31.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.058+0000 7f3fe97ff700 1 -- 172.21.15.71:0/1856593925 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3fe415baa0 con 0x7f3fe41563b0 2023-10-09T07:57:31.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.651+0000 7f3fcaffd700 1 -- 172.21.15.71:0/1856593925 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3fd80516a0 con 0x7f3fe41563b0 2023-10-09T07:57:31.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.658+0000 7f3fcaffd700 1 -- 172.21.15.71:0/1856593925 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v154) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3fd8054d60 con 0x7f3fe41563b0 2023-10-09T07:57:31.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.662+0000 7f3fe97ff700 1 -- 172.21.15.71:0/1856593925 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3fd0066d80 msgr2=0x7f3fd0069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:31.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.662+0000 7f3fe97ff700 1 --2- 172.21.15.71:0/1856593925 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3fd0066d80 0x7f3fd0069230 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40091e0 tx=0x7f3fd4017000 comp rx=0 tx=0).stop 2023-10-09T07:57:31.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.662+0000 7f3fe97ff700 1 -- 172.21.15.71:0/1856593925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe41563b0 msgr2=0x7f3fe4155ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:31.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.662+0000 7f3fe97ff700 1 --2- 172.21.15.71:0/1856593925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe41563b0 0x7f3fe4155ac0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800c7e0 tx=0x7f3fd8007df0 comp rx=0 tx=0).stop 2023-10-09T07:57:31.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.662+0000 7f3fe97ff700 1 -- 172.21.15.71:0/1856593925 shutdown_connections 2023-10-09T07:57:31.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.662+0000 7f3fe97ff700 1 --2- 172.21.15.71:0/1856593925 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3fd0066d80 0x7f3fd0069230 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:31.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.663+0000 7f3fe97ff700 1 --2- 172.21.15.71:0/1856593925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fe415a440 0x7f3fe40b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:31.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.663+0000 7f3fe97ff700 1 --2- 172.21.15.71:0/1856593925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe4068890 0x7f3fe4167c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:31.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.663+0000 7f3fe97ff700 1 --2- 172.21.15.71:0/1856593925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3fe41563b0 0x7f3fe4155ac0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:31.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.663+0000 7f3fe97ff700 1 -- 172.21.15.71:0/1856593925 >> 172.21.15.71:0/1856593925 conn(0x7f3fe40c8f90 msgr2=0x7f3fe40ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:31.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.663+0000 7f3fe97ff700 1 -- 172.21.15.71:0/1856593925 shutdown_connections 2023-10-09T07:57:31.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.663+0000 7f3fe97ff700 1 -- 172.21.15.71:0/1856593925 wait complete. 2023-10-09T07:57:31.665 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' removed 2023-10-09T07:57:31.682 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T07:57:31.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.871+0000 7fd799d9d700 1 Processor -- start 2023-10-09T07:57:31.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.871+0000 7fd799d9d700 1 -- start start 2023-10-09T07:57:31.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.872+0000 7fd799d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7940cb1a0 0x7fd79415a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:31.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.873+0000 7fd799d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd79415a8a0 0x7fd79406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:31.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.873+0000 7fd799d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd79406f5a0 0x7fd7940ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:31.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.873+0000 7fd799d9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79415b2e0 con 0x7fd79415a8a0 2023-10-09T07:57:31.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.873+0000 7fd799d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79406ebd0 con 0x7fd79406f5a0 2023-10-09T07:57:31.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.873+0000 7fd799d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79415ad20 con 0x7fd7940cb1a0 2023-10-09T07:57:31.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.873+0000 7fd793fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd79415a8a0 0x7fd79406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:31.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.873+0000 7fd793fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd79415a8a0 0x7fd79406f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48624/0 (socket says 172.21.15.71:48624) 2023-10-09T07:57:31.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.873+0000 7fd793fff700 1 -- 172.21.15.71:0/544747002 learned_addr learned my addr 172.21.15.71:0/544747002 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:31.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.873+0000 7fd79959c700 1 --2- 172.21.15.71:0/544747002 >> v2:172.21.15.179:3300/0 conn(0x7fd79406f5a0 0x7fd7940ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:31.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.873+0000 7fd798d9b700 1 --2- 172.21.15.71:0/544747002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7940cb1a0 0x7fd79415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:31.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.873+0000 7fd793fff700 1 -- 172.21.15.71:0/544747002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7940cb1a0 msgr2=0x7fd79415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:31.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.873+0000 7fd793fff700 1 --2- 172.21.15.71:0/544747002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7940cb1a0 0x7fd79415a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:31.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.873+0000 7fd793fff700 1 -- 172.21.15.71:0/544747002 >> v2:172.21.15.179:3300/0 conn(0x7fd79406f5a0 msgr2=0x7fd7940ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:31.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.873+0000 7fd793fff700 1 --2- 172.21.15.71:0/544747002 >> v2:172.21.15.179:3300/0 conn(0x7fd79406f5a0 0x7fd7940ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:31.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.873+0000 7fd793fff700 1 -- 172.21.15.71:0/544747002 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79415b000 con 0x7fd79415a8a0 2023-10-09T07:57:31.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.874+0000 7fd793fff700 1 --2- 172.21.15.71:0/544747002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd79415a8a0 0x7fd79406f060 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fd79406d580 tx=0x7fd780009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa3f971ee0cc93e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:31.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.874+0000 7fd7937fe700 1 -- 172.21.15.71:0/544747002 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78000b8f0 con 0x7fd79415a8a0 2023-10-09T07:57:31.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.874+0000 7fd7937fe700 1 -- 172.21.15.71:0/544747002 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78000ba50 con 0x7fd79415a8a0 2023-10-09T07:57:31.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.874+0000 7fd7937fe700 1 -- 172.21.15.71:0/544747002 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78000bdf0 con 0x7fd79415a8a0 2023-10-09T07:57:31.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.874+0000 7fd799d9d700 1 -- 172.21.15.71:0/544747002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd79415a8a0 msgr2=0x7fd79406f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:31.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.874+0000 7fd799d9d700 1 --2- 172.21.15.71:0/544747002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd79415a8a0 0x7fd79406f060 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fd79406d580 tx=0x7fd780009250 comp rx=0 tx=0).stop 2023-10-09T07:57:31.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.874+0000 7fd799d9d700 1 -- 172.21.15.71:0/544747002 shutdown_connections 2023-10-09T07:57:31.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.874+0000 7fd799d9d700 1 --2- 172.21.15.71:0/544747002 >> v2:172.21.15.179:3300/0 conn(0x7fd79406f5a0 0x7fd7940ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:31.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.874+0000 7fd799d9d700 1 --2- 172.21.15.71:0/544747002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7940cb1a0 0x7fd79415a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:31.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.874+0000 7fd799d9d700 1 --2- 172.21.15.71:0/544747002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd79415a8a0 0x7fd79406f060 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:31.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.874+0000 7fd799d9d700 1 -- 172.21.15.71:0/544747002 >> 172.21.15.71:0/544747002 conn(0x7fd7940cc1e0 msgr2=0x7fd7940cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:31.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.874+0000 7fd799d9d700 1 -- 172.21.15.71:0/544747002 shutdown_connections 2023-10-09T07:57:31.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.875+0000 7fd799d9d700 1 -- 172.21.15.71:0/544747002 wait complete. 2023-10-09T07:57:31.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.876+0000 7fd799d9d700 1 Processor -- start 2023-10-09T07:57:31.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.876+0000 7fd799d9d700 1 -- start start 2023-10-09T07:57:31.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.877+0000 7fd799d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd79406f5a0 0x7fd794153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:31.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.877+0000 7fd799d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7940cb1a0 0x7fd79415be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:31.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.877+0000 7fd799d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd79415c3a0 0x7fd794169e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:31.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.877+0000 7fd799d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7940aef80 con 0x7fd7940cb1a0 2023-10-09T07:57:31.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.877+0000 7fd799d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7940afb00 con 0x7fd79406f5a0 2023-10-09T07:57:31.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.877+0000 7fd799d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7940af1d0 con 0x7fd79415c3a0 2023-10-09T07:57:31.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.877+0000 7fd793fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7940cb1a0 0x7fd79415be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:31.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.877+0000 7fd793fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7940cb1a0 0x7fd79415be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48640/0 (socket says 172.21.15.71:48640) 2023-10-09T07:57:31.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.877+0000 7fd793fff700 1 -- 172.21.15.71:0/296608770 learned_addr learned my addr 172.21.15.71:0/296608770 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:31.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.877+0000 7fd798d9b700 1 --2- 172.21.15.71:0/296608770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd79406f5a0 0x7fd794153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:31.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.877+0000 7fd79959c700 1 --2- 172.21.15.71:0/296608770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd79415c3a0 0x7fd794169e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:31.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.878+0000 7fd793fff700 1 -- 172.21.15.71:0/296608770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd79415c3a0 msgr2=0x7fd794169e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:31.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.878+0000 7fd793fff700 1 --2- 172.21.15.71:0/296608770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd79415c3a0 0x7fd794169e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:31.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.878+0000 7fd793fff700 1 -- 172.21.15.71:0/296608770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd79406f5a0 msgr2=0x7fd794153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:31.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.878+0000 7fd793fff700 1 --2- 172.21.15.71:0/296608770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd79406f5a0 0x7fd794153ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:31.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.878+0000 7fd793fff700 1 -- 172.21.15.71:0/296608770 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7800094f0 con 0x7fd7940cb1a0 2023-10-09T07:57:31.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.878+0000 7fd793fff700 1 --2- 172.21.15.71:0/296608770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7940cb1a0 0x7fd79415be60 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fd79406ce80 tx=0x7fd780017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:31.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.878+0000 7fd790ff9700 1 -- 172.21.15.71:0/296608770 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd780011e60 con 0x7fd7940cb1a0 2023-10-09T07:57:31.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.878+0000 7fd790ff9700 1 -- 172.21.15.71:0/296608770 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78001a630 con 0x7fd7940cb1a0 2023-10-09T07:57:31.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.878+0000 7fd790ff9700 1 -- 172.21.15.71:0/296608770 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78001a9f0 con 0x7fd7940cb1a0 2023-10-09T07:57:31.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.878+0000 7fd799d9d700 1 -- 172.21.15.71:0/296608770 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7940af4b0 con 0x7fd7940cb1a0 2023-10-09T07:57:31.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.878+0000 7fd799d9d700 1 -- 172.21.15.71:0/296608770 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd794153ff0 con 0x7fd7940cb1a0 2023-10-09T07:57:31.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.879+0000 7fd799d9d700 1 -- 172.21.15.71:0/296608770 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7940afc70 con 0x7fd7940cb1a0 2023-10-09T07:57:31.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.880+0000 7fd790ff9700 1 -- 172.21.15.71:0/296608770 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd7800233e0 con 0x7fd7940cb1a0 2023-10-09T07:57:31.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.881+0000 7fd790ff9700 1 --2- 172.21.15.71:0/296608770 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd778066f30 0x7fd7780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:31.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.881+0000 7fd790ff9700 1 -- 172.21.15.71:0/296608770 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5919+0+0 (secure 0 0 0) 0x7fd780085c80 con 0x7fd7940cb1a0 2023-10-09T07:57:31.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.881+0000 7fd798d9b700 1 --2- 172.21.15.71:0/296608770 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd778066f30 0x7fd7780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:31.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.882+0000 7fd798d9b700 1 --2- 172.21.15.71:0/296608770 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd778066f30 0x7fd7780693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd788006fd0 tx=0x7fd788008040 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:31.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:31.885+0000 7fd790ff9700 1 -- 172.21.15.71:0/296608770 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd780052e20 con 0x7fd7940cb1a0 2023-10-09T07:57:32.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.077+0000 7fd799d9d700 1 -- 172.21.15.71:0/296608770 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd79406e860 con 0x7fd7940cb1a0 2023-10-09T07:57:32.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.082+0000 7fd790ff9700 1 -- 172.21.15.71:0/296608770 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v49) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd780056440 con 0x7fd7940cb1a0 2023-10-09T07:57:32.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.084+0000 7fd799d9d700 1 -- 172.21.15.71:0/296608770 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd778066f30 msgr2=0x7fd7780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:32.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.084+0000 7fd799d9d700 1 --2- 172.21.15.71:0/296608770 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd778066f30 0x7fd7780693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd788006fd0 tx=0x7fd788008040 comp rx=0 tx=0).stop 2023-10-09T07:57:32.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.084+0000 7fd799d9d700 1 -- 172.21.15.71:0/296608770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7940cb1a0 msgr2=0x7fd79415be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:32.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.084+0000 7fd799d9d700 1 --2- 172.21.15.71:0/296608770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7940cb1a0 0x7fd79415be60 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fd79406ce80 tx=0x7fd780017000 comp rx=0 tx=0).stop 2023-10-09T07:57:32.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.084+0000 7fd799d9d700 1 -- 172.21.15.71:0/296608770 shutdown_connections 2023-10-09T07:57:32.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.084+0000 7fd799d9d700 1 --2- 172.21.15.71:0/296608770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd79415c3a0 0x7fd794169e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.084+0000 7fd799d9d700 1 --2- 172.21.15.71:0/296608770 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd778066f30 0x7fd7780693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.084+0000 7fd799d9d700 1 --2- 172.21.15.71:0/296608770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd79406f5a0 0x7fd794153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.084+0000 7fd799d9d700 1 --2- 172.21.15.71:0/296608770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7940cb1a0 0x7fd79415be60 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.084+0000 7fd799d9d700 1 -- 172.21.15.71:0/296608770 >> 172.21.15.71:0/296608770 conn(0x7fd7940cc1e0 msgr2=0x7fd7940c0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:32.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.084+0000 7fd799d9d700 1 -- 172.21.15.71:0/296608770 shutdown_connections 2023-10-09T07:57:32.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.084+0000 7fd799d9d700 1 -- 172.21.15.71:0/296608770 wait complete. 2023-10-09T07:57:32.103 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-09T07:57:32.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.285+0000 7f3d571ff700 1 Processor -- start 2023-10-09T07:57:32.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.285+0000 7f3d571ff700 1 -- start start 2023-10-09T07:57:32.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.286+0000 7f3d571ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3d50069d60 0x7f3d500c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:32.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.286+0000 7f3d571ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3d500c81f0 0x7f3d500cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:32.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.286+0000 7f3d571ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5006bdb0 con 0x7f3d500aca80 2023-10-09T07:57:32.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.286+0000 7f3d571ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d500cb370 con 0x7f3d50069d60 2023-10-09T07:57:32.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.286+0000 7f3d571ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d50159f60 con 0x7f3d500c81f0 2023-10-09T07:57:32.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.287+0000 7f3d4ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3d50069d60 0x7f3d500c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:32.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.287+0000 7f3d54f9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3d500aca80 0x7f3d5006aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54078/0 (socket says 172.21.15.71:54078) 2023-10-09T07:57:32.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.287+0000 7f3d4ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3d50069d60 0x7f3d500c7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48650/0 (socket says 172.21.15.71:48650) 2023-10-09T07:57:32.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.287+0000 7f3d54f9b700 1 -- 172.21.15.71:0/2730044711 learned_addr learned my addr 172.21.15.71:0/2730044711 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:32.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.287+0000 7f3d4ffff700 1 -- 172.21.15.71:0/2730044711 >> v2:172.21.15.179:3300/0 conn(0x7f3d500c81f0 msgr2=0x7f3d500cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:32.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.287+0000 7f3d4ffff700 1 --2- 172.21.15.71:0/2730044711 >> v2:172.21.15.179:3300/0 conn(0x7f3d500c81f0 0x7f3d500cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.287+0000 7f3d4ffff700 1 -- 172.21.15.71:0/2730044711 >> v1:172.21.15.71:6789/0 conn(0x7f3d500aca80 legacy=0x7f3d5006aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:32.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.287+0000 7f3d4ffff700 1 -- 172.21.15.71:0/2730044711 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5006b2b0 con 0x7f3d50069d60 2023-10-09T07:57:32.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.287+0000 7f3d4f7fe700 1 -- 172.21.15.71:0/2730044711 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131370532 0 0) 0x7f3d5006bdb0 con 0x7f3d500aca80 2023-10-09T07:57:32.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.287+0000 7f3d4ffff700 1 --2- 172.21.15.71:0/2730044711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d50069d60 0x7f3d500c7cb0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f3d500b0190 tx=0x7f3d3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5da6279f1aeb80 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:32.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.287+0000 7f3d4f7fe700 1 -- 172.21.15.71:0/2730044711 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c00b6b0 con 0x7f3d50069d60 2023-10-09T07:57:32.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.288+0000 7f3d4f7fe700 1 -- 172.21.15.71:0/2730044711 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3c00b810 con 0x7f3d50069d60 2023-10-09T07:57:32.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.288+0000 7f3d4f7fe700 1 -- 172.21.15.71:0/2730044711 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c00bbb0 con 0x7f3d50069d60 2023-10-09T07:57:32.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.288+0000 7f3d571ff700 1 -- 172.21.15.71:0/2730044711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d50069d60 msgr2=0x7f3d500c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:32.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.288+0000 7f3d571ff700 1 --2- 172.21.15.71:0/2730044711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d50069d60 0x7f3d500c7cb0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f3d500b0190 tx=0x7f3d3c0091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.288+0000 7f3d571ff700 1 -- 172.21.15.71:0/2730044711 shutdown_connections 2023-10-09T07:57:32.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.288+0000 7f3d571ff700 1 --2- 172.21.15.71:0/2730044711 >> v2:172.21.15.179:3300/0 conn(0x7f3d500c81f0 0x7f3d500cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.288+0000 7f3d571ff700 1 --2- 172.21.15.71:0/2730044711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d50069d60 0x7f3d500c7cb0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.288+0000 7f3d571ff700 1 -- 172.21.15.71:0/2730044711 >> 172.21.15.71:0/2730044711 conn(0x7f3d500cd670 msgr2=0x7f3d500cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:32.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.288+0000 7f3d571ff700 1 -- 172.21.15.71:0/2730044711 shutdown_connections 2023-10-09T07:57:32.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.288+0000 7f3d571ff700 1 -- 172.21.15.71:0/2730044711 wait complete. 2023-10-09T07:57:32.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.290+0000 7f3d571ff700 1 Processor -- start 2023-10-09T07:57:32.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.290+0000 7f3d571ff700 1 -- start start 2023-10-09T07:57:32.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.291+0000 7f3d571ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d50069d60 0x7f3d500b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:32.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.291+0000 7f3d571ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d500aca80 0x7f3d50157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:32.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.291+0000 7f3d571ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d500c81f0 0x7f3d5015aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:32.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.291+0000 7f3d571ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d500ad0b0 con 0x7f3d500aca80 2023-10-09T07:57:32.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.291+0000 7f3d571ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d500ad390 con 0x7f3d500c81f0 2023-10-09T07:57:32.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.291+0000 7f3d571ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d500ad670 con 0x7f3d50069d60 2023-10-09T07:57:32.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.291+0000 7f3d4ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d500aca80 0x7f3d50157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:32.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.291+0000 7f3d4ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d500aca80 0x7f3d50157f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48652/0 (socket says 172.21.15.71:48652) 2023-10-09T07:57:32.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.291+0000 7f3d4ffff700 1 -- 172.21.15.71:0/2470342419 learned_addr learned my addr 172.21.15.71:0/2470342419 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:32.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.291+0000 7f3d4ffff700 1 -- 172.21.15.71:0/2470342419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d50069d60 msgr2=0x7f3d500b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:32.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.291+0000 7f3d4ffff700 1 --2- 172.21.15.71:0/2470342419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d50069d60 0x7f3d500b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.291+0000 7f3d4ffff700 1 -- 172.21.15.71:0/2470342419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d500c81f0 msgr2=0x7f3d5015aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:32.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.291+0000 7f3d5579c700 1 --2- 172.21.15.71:0/2470342419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d500c81f0 0x7f3d5015aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:32.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.291+0000 7f3d4ffff700 1 --2- 172.21.15.71:0/2470342419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d500c81f0 0x7f3d5015aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.291+0000 7f3d4ffff700 1 -- 172.21.15.71:0/2470342419 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3c009420 con 0x7f3d500aca80 2023-10-09T07:57:32.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.291+0000 7f3d5579c700 1 --2- 172.21.15.71:0/2470342419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d500c81f0 0x7f3d5015aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:57:32.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.292+0000 7f3d4ffff700 1 --2- 172.21.15.71:0/2470342419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d500aca80 0x7f3d50157f70 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c0093f0 tx=0x7f3d3c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:32.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.292+0000 7f3d4cff9700 1 -- 172.21.15.71:0/2470342419 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c011420 con 0x7f3d500aca80 2023-10-09T07:57:32.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.292+0000 7f3d4cff9700 1 -- 172.21.15.71:0/2470342419 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3c011580 con 0x7f3d500aca80 2023-10-09T07:57:32.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.292+0000 7f3d4cff9700 1 -- 172.21.15.71:0/2470342419 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c011940 con 0x7f3d500aca80 2023-10-09T07:57:32.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.292+0000 7f3d571ff700 1 -- 172.21.15.71:0/2470342419 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d500ad950 con 0x7f3d500aca80 2023-10-09T07:57:32.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.292+0000 7f3d571ff700 1 -- 172.21.15.71:0/2470342419 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d500b1360 con 0x7f3d500aca80 2023-10-09T07:57:32.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.293+0000 7f3d571ff700 1 -- 172.21.15.71:0/2470342419 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d5004c3c0 con 0x7f3d500aca80 2023-10-09T07:57:32.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.294+0000 7f3d4cff9700 1 -- 172.21.15.71:0/2470342419 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d3c011cf0 con 0x7f3d500aca80 2023-10-09T07:57:32.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.295+0000 7f3d4cff9700 1 --2- 172.21.15.71:0/2470342419 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3d34066f30 0x7f3d340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:32.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.295+0000 7f3d4cff9700 1 -- 172.21.15.71:0/2470342419 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5919+0+0 (secure 0 0 0) 0x7f3d3c086080 con 0x7f3d500aca80 2023-10-09T07:57:32.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.295+0000 7f3d54f9b700 1 --2- 172.21.15.71:0/2470342419 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3d34066f30 0x7f3d340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:32.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.296+0000 7f3d54f9b700 1 --2- 172.21.15.71:0/2470342419 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3d34066f30 0x7f3d340693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3d440016a0 tx=0x7f3d44007810 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:32.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.299+0000 7f3d4cff9700 1 -- 172.21.15.71:0/2470342419 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d3c0b75a0 con 0x7f3d500aca80 2023-10-09T07:57:32.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.491+0000 7f3d571ff700 1 -- 172.21.15.71:0/2470342419 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f3d500678d0 con 0x7f3d500aca80 2023-10-09T07:57:32.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.497+0000 7f3d4cff9700 1 -- 172.21.15.71:0/2470342419 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v50) v1 ==== 115+0+0 (secure 0 0 0) 0x7f3d3c053180 con 0x7f3d500aca80 2023-10-09T07:57:32.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.499+0000 7f3d571ff700 1 -- 172.21.15.71:0/2470342419 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3d34066f30 msgr2=0x7f3d340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:32.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.499+0000 7f3d571ff700 1 --2- 172.21.15.71:0/2470342419 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3d34066f30 0x7f3d340693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3d440016a0 tx=0x7f3d44007810 comp rx=0 tx=0).stop 2023-10-09T07:57:32.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.499+0000 7f3d571ff700 1 -- 172.21.15.71:0/2470342419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d500aca80 msgr2=0x7f3d50157f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:32.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.499+0000 7f3d571ff700 1 --2- 172.21.15.71:0/2470342419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d500aca80 0x7f3d50157f70 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c0093f0 tx=0x7f3d3c017000 comp rx=0 tx=0).stop 2023-10-09T07:57:32.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.499+0000 7f3d571ff700 1 -- 172.21.15.71:0/2470342419 shutdown_connections 2023-10-09T07:57:32.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.499+0000 7f3d571ff700 1 --2- 172.21.15.71:0/2470342419 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3d34066f30 0x7f3d340693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.499+0000 7f3d571ff700 1 --2- 172.21.15.71:0/2470342419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d500c81f0 0x7f3d5015aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.499+0000 7f3d571ff700 1 --2- 172.21.15.71:0/2470342419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d50069d60 0x7f3d500b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.499+0000 7f3d571ff700 1 --2- 172.21.15.71:0/2470342419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d500aca80 0x7f3d50157f70 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.499+0000 7f3d571ff700 1 -- 172.21.15.71:0/2470342419 >> 172.21.15.71:0/2470342419 conn(0x7f3d500cd670 msgr2=0x7f3d50068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:32.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.500+0000 7f3d571ff700 1 -- 172.21.15.71:0/2470342419 shutdown_connections 2023-10-09T07:57:32.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.500+0000 7f3d571ff700 1 -- 172.21.15.71:0/2470342419 wait complete. 2023-10-09T07:57:32.518 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-09T07:57:32.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.700+0000 7efe445ff700 1 Processor -- start 2023-10-09T07:57:32.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.700+0000 7efe445ff700 1 -- start start 2023-10-09T07:57:32.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.702+0000 7efe445ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efe3c159c60 0x7efe3c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:32.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.702+0000 7efe445ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe3c15db10 0x7efe3c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:32.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.702+0000 7efe445ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3c15a160 con 0x7efe3c159890 2023-10-09T07:57:32.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.702+0000 7efe445ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe3c15df50 con 0x7efe3c159c60 2023-10-09T07:57:32.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.702+0000 7efe445ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c0d13a0 con 0x7efe3c15db10 2023-10-09T07:57:32.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.702+0000 7efe4239b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7efe3c159890 0x7efe3c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54086/0 (socket says 172.21.15.71:54086) 2023-10-09T07:57:32.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.702+0000 7efe4239b700 1 -- 172.21.15.71:0/1241836855 learned_addr learned my addr 172.21.15.71:0/1241836855 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:32.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.702+0000 7efe41b9a700 1 --2- 172.21.15.71:0/1241836855 >> v2:172.21.15.179:3300/0 conn(0x7efe3c159c60 0x7efe3c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:32.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.702+0000 7efe42b9c700 1 --2- 172.21.15.71:0/1241836855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe3c15db10 0x7efe3c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:32.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.702+0000 7efe41399700 1 -- 172.21.15.71:0/1241836855 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 180685916 0 0) 0x7efe3c15a160 con 0x7efe3c159890 2023-10-09T07:57:32.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.702+0000 7efe41399700 1 -- 172.21.15.71:0/1241836855 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe28003570 con 0x7efe3c159890 2023-10-09T07:57:32.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.703+0000 7efe41399700 1 -- 172.21.15.71:0/1241836855 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4238507090 0 0) 0x7efe28003570 con 0x7efe3c159890 2023-10-09T07:57:32.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.703+0000 7efe41b9a700 1 -- 172.21.15.71:0/1241836855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe3c15db10 msgr2=0x7efe3c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:32.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.703+0000 7efe41b9a700 1 --2- 172.21.15.71:0/1241836855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe3c15db10 0x7efe3c069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.703+0000 7efe41b9a700 1 -- 172.21.15.71:0/1241836855 >> v1:172.21.15.71:6789/0 conn(0x7efe3c159890 legacy=0x7efe3c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:32.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.703+0000 7efe41b9a700 1 -- 172.21.15.71:0/1241836855 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c15e140 con 0x7efe3c159c60 2023-10-09T07:57:32.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.703+0000 7efe42b9c700 1 --2- 172.21.15.71:0/1241836855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe3c15db10 0x7efe3c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:57:32.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.703+0000 7efe41b9a700 1 --2- 172.21.15.71:0/1241836855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe3c159c60 0x7efe3c15d5d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0098e0 tx=0x7efe2c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93f2c920011be68d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:32.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.703+0000 7efe41399700 1 -- 172.21.15.71:0/1241836855 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe38001470 con 0x7efe3c159c60 2023-10-09T07:57:32.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.703+0000 7efe41399700 1 -- 172.21.15.71:0/1241836855 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c011420 con 0x7efe3c159c60 2023-10-09T07:57:32.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.703+0000 7efe41399700 1 -- 172.21.15.71:0/1241836855 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c0117c0 con 0x7efe3c159c60 2023-10-09T07:57:32.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.704+0000 7efe445ff700 1 -- 172.21.15.71:0/1241836855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe3c159c60 msgr2=0x7efe3c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:32.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.704+0000 7efe445ff700 1 --2- 172.21.15.71:0/1241836855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe3c159c60 0x7efe3c15d5d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0098e0 tx=0x7efe2c0091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.704+0000 7efe445ff700 1 -- 172.21.15.71:0/1241836855 shutdown_connections 2023-10-09T07:57:32.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.704+0000 7efe445ff700 1 --2- 172.21.15.71:0/1241836855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe3c15db10 0x7efe3c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.704+0000 7efe445ff700 1 --2- 172.21.15.71:0/1241836855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe3c159c60 0x7efe3c15d5d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.704+0000 7efe445ff700 1 -- 172.21.15.71:0/1241836855 >> 172.21.15.71:0/1241836855 conn(0x7efe3c068e20 msgr2=0x7efe3c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:32.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.704+0000 7efe445ff700 1 -- 172.21.15.71:0/1241836855 shutdown_connections 2023-10-09T07:57:32.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.704+0000 7efe445ff700 1 -- 172.21.15.71:0/1241836855 wait complete. 2023-10-09T07:57:32.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.705+0000 7efe445ff700 1 Processor -- start 2023-10-09T07:57:32.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.706+0000 7efe445ff700 1 -- start start 2023-10-09T07:57:32.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.706+0000 7efe445ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe3c159890 0x7efe3c14c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:32.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.706+0000 7efe445ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe3c159c60 0x7efe3c0cf790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:32.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.706+0000 7efe445ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe3c15db10 0x7efe3c0b0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:32.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.706+0000 7efe445ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c151ff0 con 0x7efe3c15db10 2023-10-09T07:57:32.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.706+0000 7efe445ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c14ca30 con 0x7efe3c159c60 2023-10-09T07:57:32.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.706+0000 7efe445ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c151400 con 0x7efe3c159890 2023-10-09T07:57:32.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.707+0000 7efe42b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe3c15db10 0x7efe3c0b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:32.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.707+0000 7efe42b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe3c15db10 0x7efe3c0b0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48658/0 (socket says 172.21.15.71:48658) 2023-10-09T07:57:32.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.707+0000 7efe42b9c700 1 -- 172.21.15.71:0/4213817675 learned_addr learned my addr 172.21.15.71:0/4213817675 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:32.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.707+0000 7efe4239b700 1 --2- 172.21.15.71:0/4213817675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe3c159890 0x7efe3c14c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:32.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.707+0000 7efe41b9a700 1 --2- 172.21.15.71:0/4213817675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe3c159c60 0x7efe3c0cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:32.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.707+0000 7efe42b9c700 1 -- 172.21.15.71:0/4213817675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe3c159890 msgr2=0x7efe3c14c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:32.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.707+0000 7efe42b9c700 1 --2- 172.21.15.71:0/4213817675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe3c159890 0x7efe3c14c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.707+0000 7efe42b9c700 1 -- 172.21.15.71:0/4213817675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe3c159c60 msgr2=0x7efe3c0cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:32.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.707+0000 7efe42b9c700 1 --2- 172.21.15.71:0/4213817675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe3c159c60 0x7efe3c0cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.707+0000 7efe42b9c700 1 -- 172.21.15.71:0/4213817675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe34009a20 con 0x7efe3c15db10 2023-10-09T07:57:32.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.707+0000 7efe42b9c700 1 --2- 172.21.15.71:0/4213817675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe3c15db10 0x7efe3c0b0660 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7efe34009f20 tx=0x7efe3400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:32.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.707+0000 7efe327fc700 1 -- 172.21.15.71:0/4213817675 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3400cc80 con 0x7efe3c15db10 2023-10-09T07:57:32.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.708+0000 7efe327fc700 1 -- 172.21.15.71:0/4213817675 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3400f040 con 0x7efe3c15db10 2023-10-09T07:57:32.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.708+0000 7efe327fc700 1 -- 172.21.15.71:0/4213817675 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34014480 con 0x7efe3c15db10 2023-10-09T07:57:32.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.708+0000 7efe445ff700 1 -- 172.21.15.71:0/4213817675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2c009420 con 0x7efe3c15db10 2023-10-09T07:57:32.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.708+0000 7efe445ff700 1 -- 172.21.15.71:0/4213817675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c1519a0 con 0x7efe3c15db10 2023-10-09T07:57:32.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.709+0000 7efe445ff700 1 -- 172.21.15.71:0/4213817675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3c04c3c0 con 0x7efe3c15db10 2023-10-09T07:57:32.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.709+0000 7efe327fc700 1 -- 172.21.15.71:0/4213817675 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe34003020 con 0x7efe3c15db10 2023-10-09T07:57:32.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.710+0000 7efe327fc700 1 --2- 172.21.15.71:0/4213817675 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efe20066f30 0x7efe200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:32.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.710+0000 7efe327fc700 1 -- 172.21.15.71:0/4213817675 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5919+0+0 (secure 0 0 0) 0x7efe340850a0 con 0x7efe3c15db10 2023-10-09T07:57:32.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.711+0000 7efe4239b700 1 --2- 172.21.15.71:0/4213817675 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efe20066f30 0x7efe200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:32.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.711+0000 7efe4239b700 1 --2- 172.21.15.71:0/4213817675 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efe20066f30 0x7efe200693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efe380011e0 tx=0x7efe38001490 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:32.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.714+0000 7efe327fc700 1 -- 172.21.15.71:0/4213817675 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe340521a0 con 0x7efe3c15db10 2023-10-09T07:57:32.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.903+0000 7efe445ff700 1 -- 172.21.15.71:0/4213817675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7efe3c0caba0 con 0x7efe3c15db10 2023-10-09T07:57:32.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.908+0000 7efe327fc700 1 -- 172.21.15.71:0/4213817675 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v51) v1 ==== 120+0+0 (secure 0 0 0) 0x7efe340557c0 con 0x7efe3c15db10 2023-10-09T07:57:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.911+0000 7efe445ff700 1 -- 172.21.15.71:0/4213817675 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efe20066f30 msgr2=0x7efe200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.911+0000 7efe445ff700 1 --2- 172.21.15.71:0/4213817675 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efe20066f30 0x7efe200693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efe380011e0 tx=0x7efe38001490 comp rx=0 tx=0).stop 2023-10-09T07:57:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.911+0000 7efe445ff700 1 -- 172.21.15.71:0/4213817675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe3c15db10 msgr2=0x7efe3c0b0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.911+0000 7efe445ff700 1 --2- 172.21.15.71:0/4213817675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe3c15db10 0x7efe3c0b0660 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7efe34009f20 tx=0x7efe3400b040 comp rx=0 tx=0).stop 2023-10-09T07:57:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.911+0000 7efe445ff700 1 -- 172.21.15.71:0/4213817675 shutdown_connections 2023-10-09T07:57:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.911+0000 7efe445ff700 1 --2- 172.21.15.71:0/4213817675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe3c15db10 0x7efe3c0b0660 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.911+0000 7efe445ff700 1 --2- 172.21.15.71:0/4213817675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe3c159890 0x7efe3c14c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.911+0000 7efe445ff700 1 --2- 172.21.15.71:0/4213817675 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efe20066f30 0x7efe200693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.911+0000 7efe445ff700 1 --2- 172.21.15.71:0/4213817675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe3c159c60 0x7efe3c0cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.911+0000 7efe445ff700 1 -- 172.21.15.71:0/4213817675 >> 172.21.15.71:0/4213817675 conn(0x7efe3c068e20 msgr2=0x7efe3c154180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.911+0000 7efe445ff700 1 -- 172.21.15.71:0/4213817675 shutdown_connections 2023-10-09T07:57:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:32.911+0000 7efe445ff700 1 -- 172.21.15.71:0/4213817675 wait complete. 2023-10-09T07:57:32.929 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention' 2023-10-09T07:57:33.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.109+0000 7f965b3ff700 1 Processor -- start 2023-10-09T07:57:33.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.109+0000 7f965b3ff700 1 -- start start 2023-10-09T07:57:33.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.111+0000 7f965b3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9654155c10 0x7f9654155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:33.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.111+0000 7f965b3ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f96540ac230 0x7f96540ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:33.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.111+0000 7f965b3ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96540ad930 con 0x7f96541568a0 2023-10-09T07:57:33.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.111+0000 7f965b3ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96540acd20 con 0x7f96540ac230 2023-10-09T07:57:33.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.111+0000 7f965b3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96540ad000 con 0x7f9654155c10 2023-10-09T07:57:33.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.111+0000 7f965899a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f96540ac230 0x7f96540ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:33.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.111+0000 7f965999c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f96541568a0 0x7f9654156cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54102/0 (socket says 172.21.15.71:54102) 2023-10-09T07:57:33.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.111+0000 7f965999c700 1 -- 172.21.15.71:0/807708137 learned_addr learned my addr 172.21.15.71:0/807708137 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:33.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.111+0000 7f965919b700 1 --2- 172.21.15.71:0/807708137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9654155c10 0x7f9654155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:33.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.111+0000 7f965899a700 1 -- 172.21.15.71:0/807708137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9654155c10 msgr2=0x7f9654155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:33.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.111+0000 7f965899a700 1 --2- 172.21.15.71:0/807708137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9654155c10 0x7f9654155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:33.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.111+0000 7f965899a700 1 -- 172.21.15.71:0/807708137 >> v1:172.21.15.71:6789/0 conn(0x7f96541568a0 legacy=0x7f9654156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:33.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.111+0000 7f965899a700 1 -- 172.21.15.71:0/807708137 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96540ad2e0 con 0x7f96540ac230 2023-10-09T07:57:33.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.112+0000 7f965899a700 1 --2- 172.21.15.71:0/807708137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96540ac230 0x7f96540ac6a0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f964400bbc0 tx=0x7f964400b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1ecb39dce592d7e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:33.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.112+0000 7f964bfff700 1 -- 172.21.15.71:0/807708137 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964400db90 con 0x7f96540ac230 2023-10-09T07:57:33.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.112+0000 7f964bfff700 1 -- 172.21.15.71:0/807708137 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964400dcf0 con 0x7f96540ac230 2023-10-09T07:57:33.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.112+0000 7f964bfff700 1 -- 172.21.15.71:0/807708137 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96440196b0 con 0x7f96540ac230 2023-10-09T07:57:33.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.112+0000 7f965b3ff700 1 -- 172.21.15.71:0/807708137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96540ac230 msgr2=0x7f96540ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:33.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.112+0000 7f965b3ff700 1 --2- 172.21.15.71:0/807708137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96540ac230 0x7f96540ac6a0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f964400bbc0 tx=0x7f964400b430 comp rx=0 tx=0).stop 2023-10-09T07:57:33.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.113+0000 7f965b3ff700 1 -- 172.21.15.71:0/807708137 shutdown_connections 2023-10-09T07:57:33.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.113+0000 7f965b3ff700 1 --2- 172.21.15.71:0/807708137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9654155c10 0x7f9654155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:33.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.113+0000 7f965b3ff700 1 --2- 172.21.15.71:0/807708137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96540ac230 0x7f96540ac6a0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:33.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.113+0000 7f965b3ff700 1 -- 172.21.15.71:0/807708137 >> 172.21.15.71:0/807708137 conn(0x7f965406a320 msgr2=0x7f96540cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:33.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.113+0000 7f965b3ff700 1 -- 172.21.15.71:0/807708137 shutdown_connections 2023-10-09T07:57:33.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.113+0000 7f965b3ff700 1 -- 172.21.15.71:0/807708137 wait complete. 2023-10-09T07:57:33.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.114+0000 7f965b3ff700 1 Processor -- start 2023-10-09T07:57:33.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.114+0000 7f965b3ff700 1 -- start start 2023-10-09T07:57:33.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.115+0000 7f965b3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96540ac230 0x7f965414b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:33.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.115+0000 7f965b3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9654155c10 0x7f96540b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:33.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.115+0000 7f965b3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96541568a0 0x7f96540b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:33.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.115+0000 7f965b3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96540c4a40 con 0x7f96541568a0 2023-10-09T07:57:33.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.115+0000 7f965b3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96540c2480 con 0x7f9654155c10 2023-10-09T07:57:33.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.115+0000 7f965b3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96540aa830 con 0x7f96540ac230 2023-10-09T07:57:33.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.115+0000 7f965999c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96541568a0 0x7f96540b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:33.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.115+0000 7f965999c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96541568a0 0x7f96540b0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48670/0 (socket says 172.21.15.71:48670) 2023-10-09T07:57:33.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.115+0000 7f965999c700 1 -- 172.21.15.71:0/3786776470 learned_addr learned my addr 172.21.15.71:0/3786776470 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:33.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.115+0000 7f965919b700 1 --2- 172.21.15.71:0/3786776470 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96540ac230 0x7f965414b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:33.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.115+0000 7f965899a700 1 --2- 172.21.15.71:0/3786776470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9654155c10 0x7f96540b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:33.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.116+0000 7f965999c700 1 -- 172.21.15.71:0/3786776470 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96540ac230 msgr2=0x7f965414b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:33.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.116+0000 7f965999c700 1 --2- 172.21.15.71:0/3786776470 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96540ac230 0x7f965414b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:33.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.116+0000 7f965999c700 1 -- 172.21.15.71:0/3786776470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9654155c10 msgr2=0x7f96540b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:33.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.116+0000 7f965999c700 1 --2- 172.21.15.71:0/3786776470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9654155c10 0x7f96540b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:33.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.116+0000 7f965999c700 1 -- 172.21.15.71:0/3786776470 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964400b6d0 con 0x7f96541568a0 2023-10-09T07:57:33.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.116+0000 7f965999c700 1 --2- 172.21.15.71:0/3786776470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96541568a0 0x7f96540b0820 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f964c00cbc0 tx=0x7f964c0019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:33.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.116+0000 7f96497fa700 1 -- 172.21.15.71:0/3786776470 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c00a940 con 0x7f96541568a0 2023-10-09T07:57:33.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.116+0000 7f96497fa700 1 -- 172.21.15.71:0/3786776470 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964c00aaa0 con 0x7f96541568a0 2023-10-09T07:57:33.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.116+0000 7f965b3ff700 1 -- 172.21.15.71:0/3786776470 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96540c1e30 con 0x7f96541568a0 2023-10-09T07:57:33.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.116+0000 7f96497fa700 1 -- 172.21.15.71:0/3786776470 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c00ae20 con 0x7f96541568a0 2023-10-09T07:57:33.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.116+0000 7f965b3ff700 1 -- 172.21.15.71:0/3786776470 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96540a9b00 con 0x7f96541568a0 2023-10-09T07:57:33.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.117+0000 7f965b3ff700 1 -- 172.21.15.71:0/3786776470 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96540c1c90 con 0x7f96541568a0 2023-10-09T07:57:33.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.118+0000 7f96497fa700 1 -- 172.21.15.71:0/3786776470 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f964c007300 con 0x7f96541568a0 2023-10-09T07:57:33.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.119+0000 7f96497fa700 1 --2- 172.21.15.71:0/3786776470 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9638066f30 0x7f96380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:33.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.119+0000 7f96497fa700 1 -- 172.21.15.71:0/3786776470 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5919+0+0 (secure 0 0 0) 0x7f964c084950 con 0x7f96541568a0 2023-10-09T07:57:33.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.119+0000 7f965919b700 1 --2- 172.21.15.71:0/3786776470 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9638066f30 0x7f96380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:33.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.120+0000 7f965919b700 1 --2- 172.21.15.71:0/3786776470 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9638066f30 0x7f96380693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9650006fd0 tx=0x7f9650008040 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:33.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.123+0000 7f96497fa700 1 -- 172.21.15.71:0/3786776470 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96540c1c90 con 0x7f96541568a0 2023-10-09T07:57:33.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.387+0000 7f965b3ff700 1 -- 172.21.15.71:0/3786776470 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]} v 0) v1 -- 0x7f96540c1c90 con 0x7f96541568a0 2023-10-09T07:57:33.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.657+0000 7f96497fa700 1 -- 172.21.15.71:0/3786776470 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]}]=0 v2416) v1 ==== 178+0+0 (secure 0 0 0) 0x7f96540c1c90 con 0x7f96541568a0 2023-10-09T07:57:33.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.660+0000 7f965b3ff700 1 -- 172.21.15.71:0/3786776470 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9638066f30 msgr2=0x7f96380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:33.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.660+0000 7f965b3ff700 1 --2- 172.21.15.71:0/3786776470 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9638066f30 0x7f96380693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9650006fd0 tx=0x7f9650008040 comp rx=0 tx=0).stop 2023-10-09T07:57:33.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.660+0000 7f965b3ff700 1 -- 172.21.15.71:0/3786776470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96541568a0 msgr2=0x7f96540b0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:33.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.660+0000 7f965b3ff700 1 --2- 172.21.15.71:0/3786776470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96541568a0 0x7f96540b0820 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f964c00cbc0 tx=0x7f964c0019c0 comp rx=0 tx=0).stop 2023-10-09T07:57:33.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.660+0000 7f965b3ff700 1 -- 172.21.15.71:0/3786776470 shutdown_connections 2023-10-09T07:57:33.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.660+0000 7f965b3ff700 1 --2- 172.21.15.71:0/3786776470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96541568a0 0x7f96540b0820 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:33.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.660+0000 7f965b3ff700 1 --2- 172.21.15.71:0/3786776470 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96540ac230 0x7f965414b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:33.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.660+0000 7f965b3ff700 1 --2- 172.21.15.71:0/3786776470 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9638066f30 0x7f96380693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:33.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.660+0000 7f965b3ff700 1 --2- 172.21.15.71:0/3786776470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9654155c10 0x7f96540b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:33.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.660+0000 7f965b3ff700 1 -- 172.21.15.71:0/3786776470 >> 172.21.15.71:0/3786776470 conn(0x7f965406a320 msgr2=0x7f96540ab940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:33.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.660+0000 7f965b3ff700 1 -- 172.21.15.71:0/3786776470 shutdown_connections 2023-10-09T07:57:33.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.660+0000 7f965b3ff700 1 -- 172.21.15.71:0/3786776470 wait complete. 2023-10-09T07:57:33.678 INFO:tasks.cephfs_test_runner:Test that number of snaps retained are as per user spec. ... ok 2023-10-09T07:57:33.678 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules post removal of a schedule 2023-10-09T07:57:33.678 INFO:tasks.cephfs_test_runner:test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-09T07:57:33.679 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-10-09T07:57:33.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.859+0000 7f4e953ff700 1 Processor -- start 2023-10-09T07:57:33.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.859+0000 7f4e953ff700 1 -- start start 2023-10-09T07:57:33.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.861+0000 7f4e953ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4e901578b0 0x7f4e90155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:33.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.861+0000 7f4e953ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4e900af2f0 0x7f4e900af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:33.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.861+0000 7f4e953ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e900ad930 con 0x7f4e90155c10 2023-10-09T07:57:33.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.861+0000 7f4e953ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e900b0c80 con 0x7f4e900af2f0 2023-10-09T07:57:33.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.861+0000 7f4e953ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e900acd20 con 0x7f4e901578b0 2023-10-09T07:57:33.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.861+0000 7f4e8effd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f4e90155c10 0x7f4e900ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54112/0 (socket says 172.21.15.71:54112) 2023-10-09T07:57:33.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.861+0000 7f4e8effd700 1 -- 172.21.15.71:0/1292245558 learned_addr learned my addr 172.21.15.71:0/1292245558 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:33.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.861+0000 7f4e8f7fe700 1 --2- 172.21.15.71:0/1292245558 >> v2:172.21.15.71:3300/0 conn(0x7f4e900af2f0 0x7f4e900af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:33.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.861+0000 7f4e87fff700 1 --2- 172.21.15.71:0/1292245558 >> v2:172.21.15.179:3300/0 conn(0x7f4e901578b0 0x7f4e90155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:33.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.861+0000 7f4e8f7fe700 1 -- 172.21.15.71:0/1292245558 >> v2:172.21.15.179:3300/0 conn(0x7f4e901578b0 msgr2=0x7f4e90155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:33.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.861+0000 7f4e8f7fe700 1 --2- 172.21.15.71:0/1292245558 >> v2:172.21.15.179:3300/0 conn(0x7f4e901578b0 0x7f4e90155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:33.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.861+0000 7f4e8f7fe700 1 -- 172.21.15.71:0/1292245558 >> v1:172.21.15.71:6789/0 conn(0x7f4e90155c10 legacy=0x7f4e900ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:33.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.861+0000 7f4e8f7fe700 1 -- 172.21.15.71:0/1292245558 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e900ad000 con 0x7f4e900af2f0 2023-10-09T07:57:33.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.861+0000 7f4e8e7fc700 1 -- 172.21.15.71:0/1292245558 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223075085 0 0) 0x7f4e900ad930 con 0x7f4e90155c10 2023-10-09T07:57:33.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.861+0000 7f4e87fff700 1 --2- 172.21.15.71:0/1292245558 >> v2:172.21.15.179:3300/0 conn(0x7f4e901578b0 0x7f4e90155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:57:33.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.862+0000 7f4e8f7fe700 1 --2- 172.21.15.71:0/1292245558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e900af2f0 0x7f4e900af730 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f4e900c8c60 tx=0x7f4e88009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78694e20b16d3c4c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:33.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.862+0000 7f4e8e7fc700 1 -- 172.21.15.71:0/1292245558 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8800e070 con 0x7f4e900af2f0 2023-10-09T07:57:33.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.862+0000 7f4e8e7fc700 1 -- 172.21.15.71:0/1292245558 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8800bc30 con 0x7f4e900af2f0 2023-10-09T07:57:33.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.862+0000 7f4e8e7fc700 1 -- 172.21.15.71:0/1292245558 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e88012430 con 0x7f4e900af2f0 2023-10-09T07:57:33.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.862+0000 7f4e953ff700 1 -- 172.21.15.71:0/1292245558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e900af2f0 msgr2=0x7f4e900af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:33.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.862+0000 7f4e953ff700 1 --2- 172.21.15.71:0/1292245558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e900af2f0 0x7f4e900af730 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f4e900c8c60 tx=0x7f4e88009780 comp rx=0 tx=0).stop 2023-10-09T07:57:33.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.863+0000 7f4e953ff700 1 -- 172.21.15.71:0/1292245558 shutdown_connections 2023-10-09T07:57:33.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.863+0000 7f4e953ff700 1 --2- 172.21.15.71:0/1292245558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e900af2f0 0x7f4e900af730 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:33.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.863+0000 7f4e953ff700 1 --2- 172.21.15.71:0/1292245558 >> v2:172.21.15.179:3300/0 conn(0x7f4e901578b0 0x7f4e90155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:33.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.863+0000 7f4e953ff700 1 -- 172.21.15.71:0/1292245558 >> 172.21.15.71:0/1292245558 conn(0x7f4e9006a320 msgr2=0x7f4e900cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:33.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.863+0000 7f4e953ff700 1 -- 172.21.15.71:0/1292245558 shutdown_connections 2023-10-09T07:57:33.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.863+0000 7f4e953ff700 1 -- 172.21.15.71:0/1292245558 wait complete. 2023-10-09T07:57:33.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.864+0000 7f4e953ff700 1 Processor -- start 2023-10-09T07:57:33.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.864+0000 7f4e953ff700 1 -- start start 2023-10-09T07:57:33.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.865+0000 7f4e953ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e900af2f0 0x7f4e90159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:33.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.865+0000 7f4e953ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e90155c10 0x7f4e900a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:33.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.865+0000 7f4e953ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e901578b0 0x7f4e900cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:33.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.865+0000 7f4e953ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e900aacf0 con 0x7f4e901578b0 2023-10-09T07:57:33.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.865+0000 7f4e953ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e900a9e10 con 0x7f4e900af2f0 2023-10-09T07:57:33.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.865+0000 7f4e953ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e900aa0e0 con 0x7f4e90155c10 2023-10-09T07:57:33.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.865+0000 7f4e8f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e901578b0 0x7f4e900cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:33.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.865+0000 7f4e8f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e901578b0 0x7f4e900cc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48688/0 (socket says 172.21.15.71:48688) 2023-10-09T07:57:33.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.865+0000 7f4e8f7fe700 1 -- 172.21.15.71:0/104618478 learned_addr learned my addr 172.21.15.71:0/104618478 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:33.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.866+0000 7f4e8effd700 1 --2- 172.21.15.71:0/104618478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e900af2f0 0x7f4e90159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:33.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.866+0000 7f4e87fff700 1 --2- 172.21.15.71:0/104618478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e90155c10 0x7f4e900a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:33.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.866+0000 7f4e8f7fe700 1 -- 172.21.15.71:0/104618478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e90155c10 msgr2=0x7f4e900a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:33.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.866+0000 7f4e8f7fe700 1 --2- 172.21.15.71:0/104618478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e90155c10 0x7f4e900a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:33.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.866+0000 7f4e8f7fe700 1 -- 172.21.15.71:0/104618478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e900af2f0 msgr2=0x7f4e90159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:33.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.866+0000 7f4e8f7fe700 1 --2- 172.21.15.71:0/104618478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e900af2f0 0x7f4e90159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:33.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.866+0000 7f4e8f7fe700 1 -- 172.21.15.71:0/104618478 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e88009a20 con 0x7f4e901578b0 2023-10-09T07:57:33.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.866+0000 7f4e8effd700 1 --2- 172.21.15.71:0/104618478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e900af2f0 0x7f4e90159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:57:33.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.866+0000 7f4e8f7fe700 1 --2- 172.21.15.71:0/104618478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e901578b0 0x7f4e900cc750 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f4e90064290 tx=0x7f4e88019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:33.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.866+0000 7f4e86ffd700 1 -- 172.21.15.71:0/104618478 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e88012e60 con 0x7f4e901578b0 2023-10-09T07:57:33.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.866+0000 7f4e86ffd700 1 -- 172.21.15.71:0/104618478 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8801d630 con 0x7f4e901578b0 2023-10-09T07:57:33.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.866+0000 7f4e953ff700 1 -- 172.21.15.71:0/104618478 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e900aa3c0 con 0x7f4e901578b0 2023-10-09T07:57:33.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.866+0000 7f4e86ffd700 1 -- 172.21.15.71:0/104618478 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8801d9f0 con 0x7f4e901578b0 2023-10-09T07:57:33.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.866+0000 7f4e953ff700 1 -- 172.21.15.71:0/104618478 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e900aa980 con 0x7f4e901578b0 2023-10-09T07:57:33.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.868+0000 7f4e953ff700 1 -- 172.21.15.71:0/104618478 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e9004c3c0 con 0x7f4e901578b0 2023-10-09T07:57:33.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.868+0000 7f4e86ffd700 1 -- 172.21.15.71:0/104618478 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e88024070 con 0x7f4e901578b0 2023-10-09T07:57:33.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.869+0000 7f4e86ffd700 1 --2- 172.21.15.71:0/104618478 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4e70066f30 0x7f4e700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:33.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.869+0000 7f4e86ffd700 1 -- 172.21.15.71:0/104618478 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5919+0+0 (secure 0 0 0) 0x7f4e88086e50 con 0x7f4e901578b0 2023-10-09T07:57:33.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.870+0000 7f4e8effd700 1 --2- 172.21.15.71:0/104618478 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4e70066f30 0x7f4e700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:33.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.870+0000 7f4e8effd700 1 --2- 172.21.15.71:0/104618478 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4e70066f30 0x7f4e700693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4e90068a90 tx=0x7f4e80009040 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:33.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:33.873+0000 7f4e86ffd700 1 -- 172.21.15.71:0/104618478 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e880540a0 con 0x7f4e901578b0 2023-10-09T07:57:34.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.140+0000 7f4e953ff700 1 -- 172.21.15.71:0/104618478 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f4e900ad2e0 con 0x7f4e901578b0 2023-10-09T07:57:34.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.660+0000 7f4e86ffd700 1 -- 172.21.15.71:0/104618478 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v2417) v1 ==== 177+0+0 (secure 0 0 0) 0x7f4e880576c0 con 0x7f4e901578b0 2023-10-09T07:57:34.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.663+0000 7f4e953ff700 1 -- 172.21.15.71:0/104618478 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4e70066f30 msgr2=0x7f4e700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:34.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.663+0000 7f4e953ff700 1 --2- 172.21.15.71:0/104618478 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4e70066f30 0x7f4e700693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4e90068a90 tx=0x7f4e80009040 comp rx=0 tx=0).stop 2023-10-09T07:57:34.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.663+0000 7f4e953ff700 1 -- 172.21.15.71:0/104618478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e901578b0 msgr2=0x7f4e900cc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:34.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.663+0000 7f4e953ff700 1 --2- 172.21.15.71:0/104618478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e901578b0 0x7f4e900cc750 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f4e90064290 tx=0x7f4e88019000 comp rx=0 tx=0).stop 2023-10-09T07:57:34.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.663+0000 7f4e953ff700 1 -- 172.21.15.71:0/104618478 shutdown_connections 2023-10-09T07:57:34.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.663+0000 7f4e953ff700 1 --2- 172.21.15.71:0/104618478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e901578b0 0x7f4e900cc750 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:34.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.663+0000 7f4e953ff700 1 --2- 172.21.15.71:0/104618478 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4e70066f30 0x7f4e700693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:34.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.663+0000 7f4e953ff700 1 --2- 172.21.15.71:0/104618478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e900af2f0 0x7f4e90159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:34.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.663+0000 7f4e953ff700 1 --2- 172.21.15.71:0/104618478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e90155c10 0x7f4e900a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:34.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.663+0000 7f4e953ff700 1 -- 172.21.15.71:0/104618478 >> 172.21.15.71:0/104618478 conn(0x7f4e9006a320 msgr2=0x7f4e90159f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:34.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.663+0000 7f4e953ff700 1 -- 172.21.15.71:0/104618478 shutdown_connections 2023-10-09T07:57:34.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.663+0000 7f4e953ff700 1 -- 172.21.15.71:0/104618478 wait complete. 2023-10-09T07:57:34.683 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T07:57:34.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.867+0000 7fd158fff700 1 Processor -- start 2023-10-09T07:57:34.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.867+0000 7fd158fff700 1 -- start start 2023-10-09T07:57:34.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.868+0000 7fd158fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd1540c83f0 0x7fd1540c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:34.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.868+0000 7fd158fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd1540ccee0 0x7fd1541561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:34.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.869+0000 7fd158fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1540c87c0 0x7fd154156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:34.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.869+0000 7fd158fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd154156c50 con 0x7fd1540c83f0 2023-10-09T07:57:34.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.869+0000 7fd158fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd15415b0d0 con 0x7fd1540ccee0 2023-10-09T07:57:34.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.869+0000 7fd158fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1540c7a60 con 0x7fd1540c87c0 2023-10-09T07:57:34.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.869+0000 7fd15259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd1540c83f0 0x7fd1540c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:34.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.869+0000 7fd15259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd1540c83f0 0x7fd1540c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48694/0 (socket says 172.21.15.71:48694) 2023-10-09T07:57:34.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.869+0000 7fd15259c700 1 -- 172.21.15.71:0/1477753588 learned_addr learned my addr 172.21.15.71:0/1477753588 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:34.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.869+0000 7fd14bfff700 1 --2- 172.21.15.71:0/1477753588 >> v2:172.21.15.179:3300/0 conn(0x7fd1540ccee0 0x7fd1541561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:34.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.869+0000 7fd152d9d700 1 --2- 172.21.15.71:0/1477753588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1540c87c0 0x7fd154156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:34.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.869+0000 7fd15259c700 1 -- 172.21.15.71:0/1477753588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1540c87c0 msgr2=0x7fd154156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:34.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.869+0000 7fd15259c700 1 --2- 172.21.15.71:0/1477753588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1540c87c0 0x7fd154156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:34.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.869+0000 7fd15259c700 1 -- 172.21.15.71:0/1477753588 >> v2:172.21.15.179:3300/0 conn(0x7fd1540ccee0 msgr2=0x7fd1541561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:34.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.869+0000 7fd15259c700 1 --2- 172.21.15.71:0/1477753588 >> v2:172.21.15.179:3300/0 conn(0x7fd1540ccee0 0x7fd1541561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:34.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.869+0000 7fd15259c700 1 -- 172.21.15.71:0/1477753588 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15415a4c0 con 0x7fd1540c83f0 2023-10-09T07:57:34.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.869+0000 7fd14bfff700 1 --2- 172.21.15.71:0/1477753588 >> v2:172.21.15.179:3300/0 conn(0x7fd1540ccee0 0x7fd1541561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:57:34.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.869+0000 7fd152d9d700 1 --2- 172.21.15.71:0/1477753588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1540c87c0 0x7fd154156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:57:34.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.870+0000 7fd15259c700 1 --2- 172.21.15.71:0/1477753588 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1540c83f0 0x7fd1540c7520 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fd1540c7eb0 tx=0x7fd144009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b2a78d9163257e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:34.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.870+0000 7fd151d9b700 1 -- 172.21.15.71:0/1477753588 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14400b860 con 0x7fd1540c83f0 2023-10-09T07:57:34.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.870+0000 7fd151d9b700 1 -- 172.21.15.71:0/1477753588 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14400b9c0 con 0x7fd1540c83f0 2023-10-09T07:57:34.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.870+0000 7fd151d9b700 1 -- 172.21.15.71:0/1477753588 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14400bd60 con 0x7fd1540c83f0 2023-10-09T07:57:34.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.870+0000 7fd158fff700 1 -- 172.21.15.71:0/1477753588 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1540c83f0 msgr2=0x7fd1540c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:34.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.870+0000 7fd158fff700 1 --2- 172.21.15.71:0/1477753588 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1540c83f0 0x7fd1540c7520 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fd1540c7eb0 tx=0x7fd144009250 comp rx=0 tx=0).stop 2023-10-09T07:57:34.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.870+0000 7fd158fff700 1 -- 172.21.15.71:0/1477753588 shutdown_connections 2023-10-09T07:57:34.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.870+0000 7fd158fff700 1 --2- 172.21.15.71:0/1477753588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1540c87c0 0x7fd154156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:34.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.870+0000 7fd158fff700 1 --2- 172.21.15.71:0/1477753588 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1540c83f0 0x7fd1540c7520 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:34.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.870+0000 7fd158fff700 1 --2- 172.21.15.71:0/1477753588 >> v2:172.21.15.179:3300/0 conn(0x7fd1540ccee0 0x7fd1541561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:34.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.870+0000 7fd158fff700 1 -- 172.21.15.71:0/1477753588 >> 172.21.15.71:0/1477753588 conn(0x7fd154068e10 msgr2=0x7fd1540cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:34.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.870+0000 7fd158fff700 1 -- 172.21.15.71:0/1477753588 shutdown_connections 2023-10-09T07:57:34.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.871+0000 7fd158fff700 1 -- 172.21.15.71:0/1477753588 wait complete. 2023-10-09T07:57:34.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.872+0000 7fd158fff700 1 Processor -- start 2023-10-09T07:57:34.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.872+0000 7fd158fff700 1 -- start start 2023-10-09T07:57:34.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.873+0000 7fd158fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1540c83f0 0x7fd1541596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:34.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.873+0000 7fd158fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1540c87c0 0x7fd1540c2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:34.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.873+0000 7fd158fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1540ccee0 0x7fd154153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:34.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.873+0000 7fd158fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1541576c0 con 0x7fd1540c83f0 2023-10-09T07:57:34.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.873+0000 7fd158fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1541592c0 con 0x7fd1540c87c0 2023-10-09T07:57:34.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.873+0000 7fd158fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd154156d90 con 0x7fd1540ccee0 2023-10-09T07:57:34.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.873+0000 7fd15259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1540c83f0 0x7fd1541596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:34.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.873+0000 7fd15259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1540c83f0 0x7fd1541596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48706/0 (socket says 172.21.15.71:48706) 2023-10-09T07:57:34.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.873+0000 7fd15259c700 1 -- 172.21.15.71:0/3594775621 learned_addr learned my addr 172.21.15.71:0/3594775621 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:34.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.873+0000 7fd152d9d700 1 --2- 172.21.15.71:0/3594775621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1540ccee0 0x7fd154153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:34.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.873+0000 7fd14bfff700 1 --2- 172.21.15.71:0/3594775621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1540c87c0 0x7fd1540c2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:34.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.874+0000 7fd15259c700 1 -- 172.21.15.71:0/3594775621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1540ccee0 msgr2=0x7fd154153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:34.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.874+0000 7fd15259c700 1 --2- 172.21.15.71:0/3594775621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1540ccee0 0x7fd154153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:34.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.874+0000 7fd15259c700 1 -- 172.21.15.71:0/3594775621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1540c87c0 msgr2=0x7fd1540c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:34.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.874+0000 7fd15259c700 1 --2- 172.21.15.71:0/3594775621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1540c87c0 0x7fd1540c2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:34.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.874+0000 7fd15259c700 1 -- 172.21.15.71:0/3594775621 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1440094f0 con 0x7fd1540c83f0 2023-10-09T07:57:34.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.874+0000 7fd15259c700 1 --2- 172.21.15.71:0/3594775621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1540c83f0 0x7fd1541596c0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fd154063d40 tx=0x7fd144017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:34.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.874+0000 7fd14a7fc700 1 -- 172.21.15.71:0/3594775621 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144024440 con 0x7fd1540c83f0 2023-10-09T07:57:34.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.874+0000 7fd14a7fc700 1 -- 172.21.15.71:0/3594775621 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1440245a0 con 0x7fd1540c83f0 2023-10-09T07:57:34.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.874+0000 7fd158fff700 1 -- 172.21.15.71:0/3594775621 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd154157070 con 0x7fd1540c83f0 2023-10-09T07:57:34.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.874+0000 7fd14a7fc700 1 -- 172.21.15.71:0/3594775621 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144024960 con 0x7fd1540c83f0 2023-10-09T07:57:34.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.874+0000 7fd158fff700 1 -- 172.21.15.71:0/3594775621 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd154159c00 con 0x7fd1540c83f0 2023-10-09T07:57:34.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.875+0000 7fd158fff700 1 -- 172.21.15.71:0/3594775621 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd15404c3c0 con 0x7fd1540c83f0 2023-10-09T07:57:34.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.876+0000 7fd14a7fc700 1 -- 172.21.15.71:0/3594775621 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd14401a420 con 0x7fd1540c83f0 2023-10-09T07:57:34.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.877+0000 7fd14a7fc700 1 --2- 172.21.15.71:0/3594775621 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd134066f30 0x7fd1340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:34.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.877+0000 7fd14a7fc700 1 -- 172.21.15.71:0/3594775621 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5919+0+0 (secure 0 0 0) 0x7fd144086510 con 0x7fd1540c83f0 2023-10-09T07:57:34.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.877+0000 7fd14bfff700 1 --2- 172.21.15.71:0/3594775621 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd134066f30 0x7fd1340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:34.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.878+0000 7fd14bfff700 1 --2- 172.21.15.71:0/3594775621 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd134066f30 0x7fd1340693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd15416d350 tx=0x7fd13c008040 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:34.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:34.881+0000 7fd14a7fc700 1 -- 172.21.15.71:0/3594775621 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1440536b0 con 0x7fd1540c83f0 2023-10-09T07:57:35.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.070+0000 7fd158fff700 1 -- 172.21.15.71:0/3594775621 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd15415a7a0 con 0x7fd1540c83f0 2023-10-09T07:57:35.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.076+0000 7fd14a7fc700 1 -- 172.21.15.71:0/3594775621 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v52)=0 v52) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd144056cd0 con 0x7fd1540c83f0 2023-10-09T07:57:35.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.078+0000 7fd158fff700 1 -- 172.21.15.71:0/3594775621 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd134066f30 msgr2=0x7fd1340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:35.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.078+0000 7fd158fff700 1 --2- 172.21.15.71:0/3594775621 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd134066f30 0x7fd1340693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd15416d350 tx=0x7fd13c008040 comp rx=0 tx=0).stop 2023-10-09T07:57:35.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.078+0000 7fd158fff700 1 -- 172.21.15.71:0/3594775621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1540c83f0 msgr2=0x7fd1541596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:35.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.078+0000 7fd158fff700 1 --2- 172.21.15.71:0/3594775621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1540c83f0 0x7fd1541596c0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fd154063d40 tx=0x7fd144017000 comp rx=0 tx=0).stop 2023-10-09T07:57:35.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.078+0000 7fd158fff700 1 -- 172.21.15.71:0/3594775621 shutdown_connections 2023-10-09T07:57:35.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.078+0000 7fd158fff700 1 --2- 172.21.15.71:0/3594775621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1540ccee0 0x7fd154153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:35.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.078+0000 7fd158fff700 1 --2- 172.21.15.71:0/3594775621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1540c83f0 0x7fd1541596c0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:35.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.078+0000 7fd158fff700 1 --2- 172.21.15.71:0/3594775621 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd134066f30 0x7fd1340693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:35.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.078+0000 7fd158fff700 1 --2- 172.21.15.71:0/3594775621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1540c87c0 0x7fd1540c2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:35.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.078+0000 7fd158fff700 1 -- 172.21.15.71:0/3594775621 >> 172.21.15.71:0/3594775621 conn(0x7fd154068e10 msgr2=0x7fd1540cb570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:35.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.078+0000 7fd158fff700 1 -- 172.21.15.71:0/3594775621 shutdown_connections 2023-10-09T07:57:35.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.079+0000 7fd158fff700 1 -- 172.21.15.71:0/3594775621 wait complete. 2023-10-09T07:57:35.096 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T07:57:35.096 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T07:57:35.176 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T07:57:35.261 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T07:57:35.261 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T07:57:35.261 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:57:35.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.443+0000 7f14d2d9d700 1 Processor -- start 2023-10-09T07:57:35.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.443+0000 7f14d2d9d700 1 -- start start 2023-10-09T07:57:35.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.444+0000 7f14d2d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14cc150180 0x7f14cc157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:35.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.444+0000 7f14d2d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f14cc150550 0x7f14cc0c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:35.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.444+0000 7f14d2d9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14cc06e2a0 con 0x7f14cc0c7240 2023-10-09T07:57:35.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.444+0000 7f14d2d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14cc0c76e0 con 0x7f14cc150550 2023-10-09T07:57:35.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.444+0000 7f14d2d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc06b2e0 con 0x7f14cc150180 2023-10-09T07:57:35.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.444+0000 7f14d259c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f14cc0c7240 0x7f14cc069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54946/0 (socket says 172.21.15.71:54946) 2023-10-09T07:57:35.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.444+0000 7f14d259c700 1 -- 172.21.15.71:0/3839170182 learned_addr learned my addr 172.21.15.71:0/3839170182 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:35.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.444+0000 7f14d1d9b700 1 --2- 172.21.15.71:0/3839170182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14cc150180 0x7f14cc157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:35.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.444+0000 7f14d159a700 1 --2- 172.21.15.71:0/3839170182 >> v2:172.21.15.179:3300/0 conn(0x7f14cc150550 0x7f14cc0c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:35.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.445+0000 7f14d0d99700 1 -- 172.21.15.71:0/3839170182 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643970306 0 0) 0x7f14cc06e2a0 con 0x7f14cc0c7240 2023-10-09T07:57:35.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.445+0000 7f14d0d99700 1 -- 172.21.15.71:0/3839170182 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14b8003570 con 0x7f14cc0c7240 2023-10-09T07:57:35.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.445+0000 7f14d159a700 1 -- 172.21.15.71:0/3839170182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14cc150180 msgr2=0x7f14cc157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:35.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.445+0000 7f14d159a700 1 --2- 172.21.15.71:0/3839170182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14cc150180 0x7f14cc157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:35.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.445+0000 7f14d159a700 1 -- 172.21.15.71:0/3839170182 >> v1:172.21.15.71:6789/0 conn(0x7f14cc0c7240 legacy=0x7f14cc069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:35.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.445+0000 7f14d159a700 1 -- 172.21.15.71:0/3839170182 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14cc0c78e0 con 0x7f14cc150550 2023-10-09T07:57:35.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.445+0000 7f14d159a700 1 --2- 172.21.15.71:0/3839170182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc150550 0x7f14cc0c6d00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f14bc0098e0 tx=0x7f14bc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a43fe3922c0aec8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:35.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.446+0000 7f14d0d99700 1 -- 172.21.15.71:0/3839170182 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc011630 con 0x7f14cc150550 2023-10-09T07:57:35.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.446+0000 7f14d0d99700 1 -- 172.21.15.71:0/3839170182 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14bc011790 con 0x7f14cc150550 2023-10-09T07:57:35.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.446+0000 7f14d0d99700 1 -- 172.21.15.71:0/3839170182 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc011b30 con 0x7f14cc150550 2023-10-09T07:57:35.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.446+0000 7f14d2d9d700 1 -- 172.21.15.71:0/3839170182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc150550 msgr2=0x7f14cc0c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:35.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.446+0000 7f14d2d9d700 1 --2- 172.21.15.71:0/3839170182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc150550 0x7f14cc0c6d00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f14bc0098e0 tx=0x7f14bc0091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:35.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.446+0000 7f14d2d9d700 1 -- 172.21.15.71:0/3839170182 shutdown_connections 2023-10-09T07:57:35.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.446+0000 7f14d2d9d700 1 --2- 172.21.15.71:0/3839170182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14cc150180 0x7f14cc157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:35.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.446+0000 7f14d2d9d700 1 --2- 172.21.15.71:0/3839170182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc150550 0x7f14cc0c6d00 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:35.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.446+0000 7f14d2d9d700 1 -- 172.21.15.71:0/3839170182 >> 172.21.15.71:0/3839170182 conn(0x7f14cc0cc1f0 msgr2=0x7f14cc0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:35.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.446+0000 7f14d2d9d700 1 -- 172.21.15.71:0/3839170182 shutdown_connections 2023-10-09T07:57:35.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.446+0000 7f14d2d9d700 1 -- 172.21.15.71:0/3839170182 wait complete. 2023-10-09T07:57:35.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.448+0000 7f14d2d9d700 1 Processor -- start 2023-10-09T07:57:35.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.448+0000 7f14d2d9d700 1 -- start start 2023-10-09T07:57:35.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.449+0000 7f14d2d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14cc0c7240 0x7f14cc159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:35.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.449+0000 7f14d2d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14cc150180 0x7f14cc0cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:35.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.449+0000 7f14d2d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc150550 0x7f14cc13f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:35.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.449+0000 7f14d2d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc15aff0 con 0x7f14cc0c7240 2023-10-09T07:57:35.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.449+0000 7f14d2d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc15a140 con 0x7f14cc150550 2023-10-09T07:57:35.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.449+0000 7f14d2d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc15a3e0 con 0x7f14cc150180 2023-10-09T07:57:35.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.449+0000 7f14d1d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14cc0c7240 0x7f14cc159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:35.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.449+0000 7f14d1d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14cc0c7240 0x7f14cc159c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33870/0 (socket says 172.21.15.71:33870) 2023-10-09T07:57:35.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.449+0000 7f14d1d9b700 1 -- 172.21.15.71:0/1713783059 learned_addr learned my addr 172.21.15.71:0/1713783059 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:35.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.449+0000 7f14d259c700 1 --2- 172.21.15.71:0/1713783059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc150550 0x7f14cc13f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:35.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.449+0000 7f14d159a700 1 --2- 172.21.15.71:0/1713783059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14cc150180 0x7f14cc0cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:35.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.449+0000 7f14d1d9b700 1 -- 172.21.15.71:0/1713783059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14cc150180 msgr2=0x7f14cc0cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:35.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.449+0000 7f14d1d9b700 1 --2- 172.21.15.71:0/1713783059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14cc150180 0x7f14cc0cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:35.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.449+0000 7f14d1d9b700 1 -- 172.21.15.71:0/1713783059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc150550 msgr2=0x7f14cc13f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:35.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.449+0000 7f14d1d9b700 1 --2- 172.21.15.71:0/1713783059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc150550 0x7f14cc13f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:35.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.449+0000 7f14d1d9b700 1 -- 172.21.15.71:0/1713783059 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc009420 con 0x7f14cc0c7240 2023-10-09T07:57:35.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.450+0000 7f14d1d9b700 1 --2- 172.21.15.71:0/1713783059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14cc0c7240 0x7f14cc159c00 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f14c800ec80 tx=0x7f14c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:35.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.450+0000 7f14c1ffb700 1 -- 172.21.15.71:0/1713783059 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c800c9d0 con 0x7f14cc0c7240 2023-10-09T07:57:35.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.450+0000 7f14c1ffb700 1 -- 172.21.15.71:0/1713783059 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c800cb30 con 0x7f14cc0c7240 2023-10-09T07:57:35.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.450+0000 7f14d2d9d700 1 -- 172.21.15.71:0/1713783059 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14cc15a6c0 con 0x7f14cc0c7240 2023-10-09T07:57:35.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.450+0000 7f14c1ffb700 1 -- 172.21.15.71:0/1713783059 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8013470 con 0x7f14cc0c7240 2023-10-09T07:57:35.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.450+0000 7f14d2d9d700 1 -- 172.21.15.71:0/1713783059 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14cc15ac80 con 0x7f14cc0c7240 2023-10-09T07:57:35.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.451+0000 7f14d2d9d700 1 -- 172.21.15.71:0/1713783059 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14cc04c3c0 con 0x7f14cc0c7240 2023-10-09T07:57:35.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.452+0000 7f14c1ffb700 1 -- 172.21.15.71:0/1713783059 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14c8013820 con 0x7f14cc0c7240 2023-10-09T07:57:35.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.453+0000 7f14c1ffb700 1 --2- 172.21.15.71:0/1713783059 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f14b0066f30 0x7f14b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:35.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.453+0000 7f14c1ffb700 1 -- 172.21.15.71:0/1713783059 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5919+0+0 (secure 0 0 0) 0x7f14c8084a30 con 0x7f14cc0c7240 2023-10-09T07:57:35.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.454+0000 7f14d159a700 1 --2- 172.21.15.71:0/1713783059 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f14b0066f30 0x7f14b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:35.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.454+0000 7f14d159a700 1 --2- 172.21.15.71:0/1713783059 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f14b0066f30 0x7f14b00693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f14bc0091e0 tx=0x7f14bc017000 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:35.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.457+0000 7f14c1ffb700 1 -- 172.21.15.71:0/1713783059 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14c8051b30 con 0x7f14cc0c7240 2023-10-09T07:57:35.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.689+0000 7f14d2d9d700 1 -- 172.21.15.71:0/1713783059 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14cc06ada0 con 0x7f14cc0c7240 2023-10-09T07:57:35.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.689+0000 7f14c1ffb700 1 -- 172.21.15.71:0/1713783059 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f14c8017de0 con 0x7f14cc0c7240 2023-10-09T07:57:35.690 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:57:35.690 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":68,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7100,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2408023076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2408023076},{"type":"v1","addr":"172.21.15.179:6834","nonce":2408023076}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":7825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/4239197200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":4239197200},{"type":"v1","addr":"172.21.15.179:6836","nonce":4239197200}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":8094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/645124077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":645124077},{"type":"v1","addr":"172.21.15.71:6833","nonce":645124077}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":8097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/542229353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":542229353},{"type":"v1","addr":"172.21.15.71:6835","nonce":542229353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[]} 2023-10-09T07:57:35.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.692+0000 7f14d2d9d700 1 -- 172.21.15.71:0/1713783059 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f14b0066f30 msgr2=0x7f14b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:35.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.692+0000 7f14d2d9d700 1 --2- 172.21.15.71:0/1713783059 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f14b0066f30 0x7f14b00693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f14bc0091e0 tx=0x7f14bc017000 comp rx=0 tx=0).stop 2023-10-09T07:57:35.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.692+0000 7f14d2d9d700 1 -- 172.21.15.71:0/1713783059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14cc0c7240 msgr2=0x7f14cc159c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:35.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.692+0000 7f14d2d9d700 1 --2- 172.21.15.71:0/1713783059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14cc0c7240 0x7f14cc159c00 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f14c800ec80 tx=0x7f14c80091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:35.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.692+0000 7f14d2d9d700 1 -- 172.21.15.71:0/1713783059 shutdown_connections 2023-10-09T07:57:35.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.692+0000 7f14d2d9d700 1 --2- 172.21.15.71:0/1713783059 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f14b0066f30 0x7f14b00693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:35.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.692+0000 7f14d2d9d700 1 --2- 172.21.15.71:0/1713783059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc150550 0x7f14cc13f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:35.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.692+0000 7f14d2d9d700 1 --2- 172.21.15.71:0/1713783059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14cc0c7240 0x7f14cc159c00 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:35.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.692+0000 7f14d2d9d700 1 --2- 172.21.15.71:0/1713783059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14cc150180 0x7f14cc0cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:35.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.692+0000 7f14d2d9d700 1 -- 172.21.15.71:0/1713783059 >> 172.21.15.71:0/1713783059 conn(0x7f14cc0cc1f0 msgr2=0x7f14cc0b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:35.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.692+0000 7f14d2d9d700 1 -- 172.21.15.71:0/1713783059 shutdown_connections 2023-10-09T07:57:35.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.692+0000 7f14d2d9d700 1 -- 172.21.15.71:0/1713783059 wait complete. 2023-10-09T07:57:35.694 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 68 2023-10-09T07:57:35.710 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T07:57:35.710 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T07:57:35.710 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T07:57:35.711 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T07:57:35.711 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T07:57:35.711 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T07:57:35.711 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T07:57:35.711 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T07:57:35.711 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T07:57:35.711 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T07:57:35.712 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T07:57:35.712 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T07:57:35.712 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T07:57:35.712 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T07:57:35.712 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T07:57:35.712 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T07:57:35.725 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T07:57:35.725 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T07:57:35.726 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T07:57:35.726 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T07:57:35.728 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T07:57:35.728 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T07:57:35.730 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T07:57:35.731 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T07:57:35.770 INFO:tasks.ceph.mds.a:Started 2023-10-09T07:57:35.770 DEBUG:teuthology.parallel:result is None 2023-10-09T07:57:35.773 INFO:tasks.ceph.mds.c:Started 2023-10-09T07:57:35.773 DEBUG:teuthology.parallel:result is None 2023-10-09T07:57:35.775 INFO:tasks.ceph.mds.b:Started 2023-10-09T07:57:35.775 DEBUG:teuthology.parallel:result is None 2023-10-09T07:57:35.778 INFO:tasks.ceph.mds.d:Started 2023-10-09T07:57:35.778 DEBUG:teuthology.parallel:result is None 2023-10-09T07:57:35.779 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T07:57:35.903 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-10-09T07:57:35.903 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2023-10-09T07:57:35.916 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-09T07:57:35.916 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-09T07:57:35.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.969+0000 7f9736bff700 1 Processor -- start 2023-10-09T07:57:35.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.969+0000 7f9736bff700 1 -- start start 2023-10-09T07:57:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.970+0000 7f9736bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9730159c60 0x7f973015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.970+0000 7f9736bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f973015db10 0x7f9730069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.971+0000 7f9736bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973015a160 con 0x7f9730159890 2023-10-09T07:57:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.971+0000 7f9736bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973015df50 con 0x7f9730159c60 2023-10-09T07:57:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.971+0000 7f9736bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97300d13a0 con 0x7f973015db10 2023-10-09T07:57:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.971+0000 7f972ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9730159c60 0x7f973015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.971+0000 7f972ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9730159c60 0x7f973015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33900/0 (socket says 172.21.15.71:33900) 2023-10-09T07:57:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.971+0000 7f972ffff700 1 -- 172.21.15.71:0/763623959 learned_addr learned my addr 172.21.15.71:0/763623959 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.971+0000 7f973519c700 1 --2- 172.21.15.71:0/763623959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f973015db10 0x7f9730069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.971+0000 7f972ffff700 1 -- 172.21.15.71:0/763623959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f973015db10 msgr2=0x7f9730069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.971+0000 7f972ffff700 1 --2- 172.21.15.71:0/763623959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f973015db10 0x7f9730069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.971+0000 7f972ffff700 1 -- 172.21.15.71:0/763623959 >> v1:172.21.15.179:6789/0 conn(0x7f9730159890 legacy=0x7f973015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.971+0000 7f972ffff700 1 -- 172.21.15.71:0/763623959 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973015e140 con 0x7f9730159c60 2023-10-09T07:57:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.971+0000 7f972f7fe700 1 -- 172.21.15.71:0/763623959 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410110711 0 0) 0x7f973015a160 con 0x7f9730159890 2023-10-09T07:57:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.972+0000 7f972ffff700 1 --2- 172.21.15.71:0/763623959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9730159c60 0x7f973015d5d0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f971c0099b0 tx=0x7f971c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cfae04de14d71fc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:35.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.972+0000 7f972f7fe700 1 -- 172.21.15.71:0/763623959 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971c009ea0 con 0x7f9730159c60 2023-10-09T07:57:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.972+0000 7f972f7fe700 1 -- 172.21.15.71:0/763623959 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971c00b860 con 0x7f9730159c60 2023-10-09T07:57:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.972+0000 7f972f7fe700 1 -- 172.21.15.71:0/763623959 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971c00bc00 con 0x7f9730159c60 2023-10-09T07:57:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.972+0000 7f9736bff700 1 -- 172.21.15.71:0/763623959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9730159c60 msgr2=0x7f973015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.972+0000 7f9736bff700 1 --2- 172.21.15.71:0/763623959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9730159c60 0x7f973015d5d0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f971c0099b0 tx=0x7f971c009250 comp rx=0 tx=0).stop 2023-10-09T07:57:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.972+0000 7f9736bff700 1 -- 172.21.15.71:0/763623959 shutdown_connections 2023-10-09T07:57:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.972+0000 7f9736bff700 1 --2- 172.21.15.71:0/763623959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f973015db10 0x7f9730069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.972+0000 7f9736bff700 1 --2- 172.21.15.71:0/763623959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9730159c60 0x7f973015d5d0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.972+0000 7f9736bff700 1 -- 172.21.15.71:0/763623959 >> 172.21.15.71:0/763623959 conn(0x7f9730068e20 msgr2=0x7f97300d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.972+0000 7f9736bff700 1 -- 172.21.15.71:0/763623959 shutdown_connections 2023-10-09T07:57:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.972+0000 7f9736bff700 1 -- 172.21.15.71:0/763623959 wait complete. 2023-10-09T07:57:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.974+0000 7f9736bff700 1 Processor -- start 2023-10-09T07:57:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.974+0000 7f9736bff700 1 -- start start 2023-10-09T07:57:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.975+0000 7f9736bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9730159890 0x7f97300c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.975+0000 7f9736bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9730159c60 0x7f97300cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.975+0000 7f9736bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f973015db10 0x7f9730154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.975+0000 7f9736bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97301537e0 con 0x7f9730159890 2023-10-09T07:57:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.975+0000 7f9736bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9730154080 con 0x7f973015db10 2023-10-09T07:57:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.975+0000 7f9736bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97300cfd90 con 0x7f9730159c60 2023-10-09T07:57:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.975+0000 7f973499b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9730159890 0x7f97300c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.975+0000 7f973499b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9730159890 0x7f97300c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33912/0 (socket says 172.21.15.71:33912) 2023-10-09T07:57:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.975+0000 7f973499b700 1 -- 172.21.15.71:0/3909357666 learned_addr learned my addr 172.21.15.71:0/3909357666 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.975+0000 7f973519c700 1 --2- 172.21.15.71:0/3909357666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f973015db10 0x7f9730154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.975+0000 7f972ffff700 1 --2- 172.21.15.71:0/3909357666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9730159c60 0x7f97300cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.975+0000 7f973499b700 1 -- 172.21.15.71:0/3909357666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9730159c60 msgr2=0x7f97300cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.975+0000 7f973499b700 1 --2- 172.21.15.71:0/3909357666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9730159c60 0x7f97300cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.975+0000 7f973499b700 1 -- 172.21.15.71:0/3909357666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f973015db10 msgr2=0x7f9730154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.976+0000 7f973499b700 1 --2- 172.21.15.71:0/3909357666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f973015db10 0x7f9730154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.976+0000 7f973499b700 1 -- 172.21.15.71:0/3909357666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c0094f0 con 0x7f9730159890 2023-10-09T07:57:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.976+0000 7f973499b700 1 --2- 172.21.15.71:0/3909357666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9730159890 0x7f97300c78a0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f972400c7e0 tx=0x7f9724007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.976+0000 7f972cff9700 1 -- 172.21.15.71:0/3909357666 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9724011590 con 0x7f9730159890 2023-10-09T07:57:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.976+0000 7f972cff9700 1 -- 172.21.15.71:0/3909357666 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9724011710 con 0x7f9730159890 2023-10-09T07:57:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.976+0000 7f9736bff700 1 -- 172.21.15.71:0/3909357666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9730153a30 con 0x7f9730159890 2023-10-09T07:57:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.976+0000 7f972cff9700 1 -- 172.21.15.71:0/3909357666 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9724011ad0 con 0x7f9730159890 2023-10-09T07:57:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.976+0000 7f9736bff700 1 -- 172.21.15.71:0/3909357666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97300b27d0 con 0x7f9730159890 2023-10-09T07:57:35.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.977+0000 7f9736bff700 1 -- 172.21.15.71:0/3909357666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973004c3c0 con 0x7f9730159890 2023-10-09T07:57:35.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.978+0000 7f972cff9700 1 -- 172.21.15.71:0/3909357666 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f972401b3b0 con 0x7f9730159890 2023-10-09T07:57:35.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.979+0000 7f972cff9700 1 --2- 172.21.15.71:0/3909357666 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9714066f30 0x7f97140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:35.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.979+0000 7f972cff9700 1 -- 172.21.15.71:0/3909357666 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5919+0+0 (secure 0 0 0) 0x7f9724083c20 con 0x7f9730159890 2023-10-09T07:57:35.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.979+0000 7f972ffff700 1 --2- 172.21.15.71:0/3909357666 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9714066f30 0x7f97140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:35.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.980+0000 7f972ffff700 1 --2- 172.21.15.71:0/3909357666 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9714066f30 0x7f97140693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f971c0099b0 tx=0x7f971c017000 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:35.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:35.983+0000 7f972cff9700 1 -- 172.21.15.71:0/3909357666 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9724050d20 con 0x7f9730159890 2023-10-09T07:57:36.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:36.193+0000 7f9736bff700 1 -- 172.21.15.71:0/3909357666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f97301516f0 con 0x7f9730159890 2023-10-09T07:57:37.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.103+0000 7f972cff9700 1 -- 172.21.15.71:0/3909357666 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v159) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9724017070 con 0x7f9730159890 2023-10-09T07:57:37.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.107+0000 7f9736bff700 1 -- 172.21.15.71:0/3909357666 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9714066f30 msgr2=0x7f97140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:37.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.107+0000 7f9736bff700 1 --2- 172.21.15.71:0/3909357666 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9714066f30 0x7f97140693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f971c0099b0 tx=0x7f971c017000 comp rx=0 tx=0).stop 2023-10-09T07:57:37.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.107+0000 7f9736bff700 1 -- 172.21.15.71:0/3909357666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9730159890 msgr2=0x7f97300c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:37.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.107+0000 7f9736bff700 1 --2- 172.21.15.71:0/3909357666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9730159890 0x7f97300c78a0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f972400c7e0 tx=0x7f9724007df0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.107+0000 7f9736bff700 1 -- 172.21.15.71:0/3909357666 shutdown_connections 2023-10-09T07:57:37.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.107+0000 7f9736bff700 1 --2- 172.21.15.71:0/3909357666 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9714066f30 0x7f97140693e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.107+0000 7f9736bff700 1 --2- 172.21.15.71:0/3909357666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f973015db10 0x7f9730154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.107+0000 7f9736bff700 1 --2- 172.21.15.71:0/3909357666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9730159890 0x7f97300c78a0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.107+0000 7f9736bff700 1 --2- 172.21.15.71:0/3909357666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9730159c60 0x7f97300cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.107+0000 7f9736bff700 1 -- 172.21.15.71:0/3909357666 >> 172.21.15.71:0/3909357666 conn(0x7f9730068e20 msgr2=0x7f9730152f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:37.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.107+0000 7f9736bff700 1 -- 172.21.15.71:0/3909357666 shutdown_connections 2023-10-09T07:57:37.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.107+0000 7f9736bff700 1 -- 172.21.15.71:0/3909357666 wait complete. 2023-10-09T07:57:37.109 INFO:teuthology.orchestra.run.smithi071.stderr: removed all blocklist entries 2023-10-09T07:57:37.128 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T07:57:37.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.311+0000 7fd0e759e700 1 Processor -- start 2023-10-09T07:57:37.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.311+0000 7fd0e759e700 1 -- start start 2023-10-09T07:57:37.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.312+0000 7fd0e759e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd0e8159420 0x7fd0e80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:37.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.312+0000 7fd0e759e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd0e81597f0 0x7fd0e80b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:37.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.312+0000 7fd0e759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0e815d230 0x7fd0e815d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:37.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.312+0000 7fd0e759e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e815dbb0 con 0x7fd0e81597f0 2023-10-09T07:57:37.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.312+0000 7fd0e759e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e80b11d0 con 0x7fd0e8159420 2023-10-09T07:57:37.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.312+0000 7fd0e759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e80b14b0 con 0x7fd0e815d230 2023-10-09T07:57:37.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.312+0000 7fd0e5d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd0e81597f0 0x7fd0e80b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:37.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.312+0000 7fd0e5d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd0e81597f0 0x7fd0e80b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33922/0 (socket says 172.21.15.71:33922) 2023-10-09T07:57:37.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.312+0000 7fd0e5d9b700 1 -- 172.21.15.71:0/437309872 learned_addr learned my addr 172.21.15.71:0/437309872 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:37.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.313+0000 7fd0e6d9d700 1 --2- 172.21.15.71:0/437309872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0e815d230 0x7fd0e815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:37.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.313+0000 7fd0e659c700 1 --2- 172.21.15.71:0/437309872 >> v2:172.21.15.179:3300/0 conn(0x7fd0e8159420 0x7fd0e80b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:37.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.313+0000 7fd0e5d9b700 1 -- 172.21.15.71:0/437309872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0e815d230 msgr2=0x7fd0e815d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:37.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.313+0000 7fd0e5d9b700 1 --2- 172.21.15.71:0/437309872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0e815d230 0x7fd0e815d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.313+0000 7fd0e5d9b700 1 -- 172.21.15.71:0/437309872 >> v2:172.21.15.179:3300/0 conn(0x7fd0e8159420 msgr2=0x7fd0e80b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:37.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.313+0000 7fd0e5d9b700 1 --2- 172.21.15.71:0/437309872 >> v2:172.21.15.179:3300/0 conn(0x7fd0e8159420 0x7fd0e80b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.313+0000 7fd0e5d9b700 1 -- 172.21.15.71:0/437309872 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e80b1790 con 0x7fd0e81597f0 2023-10-09T07:57:37.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.313+0000 7fd0e5d9b700 1 --2- 172.21.15.71:0/437309872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e81597f0 0x7fd0e80b2270 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80b2f20 tx=0x7fd0dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4a58254c9b1940 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:37.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.313+0000 7fd0e559a700 1 -- 172.21.15.71:0/437309872 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc00b860 con 0x7fd0e81597f0 2023-10-09T07:57:37.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.313+0000 7fd0e559a700 1 -- 172.21.15.71:0/437309872 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0dc00b9c0 con 0x7fd0e81597f0 2023-10-09T07:57:37.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.313+0000 7fd0e559a700 1 -- 172.21.15.71:0/437309872 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc00bd60 con 0x7fd0e81597f0 2023-10-09T07:57:37.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.314+0000 7fd0e759e700 1 -- 172.21.15.71:0/437309872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e81597f0 msgr2=0x7fd0e80b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:37.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.314+0000 7fd0e759e700 1 --2- 172.21.15.71:0/437309872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e81597f0 0x7fd0e80b2270 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80b2f20 tx=0x7fd0dc009250 comp rx=0 tx=0).stop 2023-10-09T07:57:37.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.314+0000 7fd0e759e700 1 -- 172.21.15.71:0/437309872 shutdown_connections 2023-10-09T07:57:37.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.314+0000 7fd0e759e700 1 --2- 172.21.15.71:0/437309872 >> v2:172.21.15.179:3300/0 conn(0x7fd0e8159420 0x7fd0e80b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.314+0000 7fd0e759e700 1 --2- 172.21.15.71:0/437309872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0e815d230 0x7fd0e815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.314+0000 7fd0e759e700 1 --2- 172.21.15.71:0/437309872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e81597f0 0x7fd0e80b2270 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.314+0000 7fd0e759e700 1 -- 172.21.15.71:0/437309872 >> 172.21.15.71:0/437309872 conn(0x7fd0e80d0660 msgr2=0x7fd0e80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:37.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.314+0000 7fd0e759e700 1 -- 172.21.15.71:0/437309872 shutdown_connections 2023-10-09T07:57:37.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.314+0000 7fd0e759e700 1 -- 172.21.15.71:0/437309872 wait complete. 2023-10-09T07:57:37.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.316+0000 7fd0e759e700 1 Processor -- start 2023-10-09T07:57:37.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.316+0000 7fd0e759e700 1 -- start start 2023-10-09T07:57:37.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.316+0000 7fd0e759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0e8159420 0x7fd0e813dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:37.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.317+0000 7fd0e759e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0e81597f0 0x7fd0e816a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:37.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.317+0000 7fd0e759e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e815d230 0x7fd0e816cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:37.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.317+0000 7fd0e759e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e816de10 con 0x7fd0e815d230 2023-10-09T07:57:37.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.317+0000 7fd0e759e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e8151e80 con 0x7fd0e81597f0 2023-10-09T07:57:37.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.317+0000 7fd0e759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e8151b70 con 0x7fd0e8159420 2023-10-09T07:57:37.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.317+0000 7fd0e6d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e815d230 0x7fd0e816cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:37.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.317+0000 7fd0e6d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e815d230 0x7fd0e816cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33932/0 (socket says 172.21.15.71:33932) 2023-10-09T07:57:37.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.317+0000 7fd0e6d9d700 1 -- 172.21.15.71:0/328896216 learned_addr learned my addr 172.21.15.71:0/328896216 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:37.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.317+0000 7fd0e659c700 1 --2- 172.21.15.71:0/328896216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0e8159420 0x7fd0e813dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:37.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.317+0000 7fd0e5d9b700 1 --2- 172.21.15.71:0/328896216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0e81597f0 0x7fd0e816a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:37.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.317+0000 7fd0e6d9d700 1 -- 172.21.15.71:0/328896216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0e8159420 msgr2=0x7fd0e813dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:37.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.317+0000 7fd0e6d9d700 1 --2- 172.21.15.71:0/328896216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0e8159420 0x7fd0e813dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.317+0000 7fd0e6d9d700 1 -- 172.21.15.71:0/328896216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0e81597f0 msgr2=0x7fd0e816a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:37.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.317+0000 7fd0e6d9d700 1 --2- 172.21.15.71:0/328896216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0e81597f0 0x7fd0e816a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.317+0000 7fd0e6d9d700 1 -- 172.21.15.71:0/328896216 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc0094f0 con 0x7fd0e815d230 2023-10-09T07:57:37.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.317+0000 7fd0e6d9d700 1 --2- 172.21.15.71:0/328896216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e815d230 0x7fd0e816cee0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0007f20 tx=0x7fd0e0009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:37.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.318+0000 7fd0d67fc700 1 -- 172.21.15.71:0/328896216 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e000eb90 con 0x7fd0e815d230 2023-10-09T07:57:37.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.318+0000 7fd0d67fc700 1 -- 172.21.15.71:0/328896216 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e000ed10 con 0x7fd0e815d230 2023-10-09T07:57:37.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.318+0000 7fd0e759e700 1 -- 172.21.15.71:0/328896216 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e816d570 con 0x7fd0e815d230 2023-10-09T07:57:37.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.318+0000 7fd0d67fc700 1 -- 172.21.15.71:0/328896216 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0014670 con 0x7fd0e815d230 2023-10-09T07:57:37.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.318+0000 7fd0e759e700 1 -- 172.21.15.71:0/328896216 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e816db30 con 0x7fd0e815d230 2023-10-09T07:57:37.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.319+0000 7fd0e759e700 1 -- 172.21.15.71:0/328896216 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e8152030 con 0x7fd0e815d230 2023-10-09T07:57:37.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.320+0000 7fd0d67fc700 1 -- 172.21.15.71:0/328896216 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd0e00149e0 con 0x7fd0e815d230 2023-10-09T07:57:37.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.321+0000 7fd0d67fc700 1 --2- 172.21.15.71:0/328896216 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd0c8066f30 0x7fd0c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:37.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.321+0000 7fd0d67fc700 1 -- 172.21.15.71:0/328896216 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5317+0+0 (secure 0 0 0) 0x7fd0e00849d0 con 0x7fd0e815d230 2023-10-09T07:57:37.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.321+0000 7fd0e659c700 1 --2- 172.21.15.71:0/328896216 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd0c8066f30 0x7fd0c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:37.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.322+0000 7fd0e659c700 1 --2- 172.21.15.71:0/328896216 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd0c8066f30 0x7fd0c80693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8006fd0 tx=0x7fd0d8008040 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:37.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.325+0000 7fd0d67fc700 1 -- 172.21.15.71:0/328896216 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0e8152030 con 0x7fd0e815d230 2023-10-09T07:57:37.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.584+0000 7fd0e759e700 1 -- 172.21.15.71:0/328896216 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd0e8152030 con 0x7fd0e815d230 2023-10-09T07:57:37.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.585+0000 7fd0d67fc700 1 -- 172.21.15.71:0/328896216 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v39) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd0e8152030 con 0x7fd0e815d230 2023-10-09T07:57:37.586 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:57:37.586 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T07:57:37.586 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_dump": [ 2023-10-09T07:57:37.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:57:37.586 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.a", 2023-10-09T07:57:37.586 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlpI5JCRAAGBgrs6g+6KZFXv1eq0fkwQ==", 2023-10-09T07:57:37.586 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:57:37.586 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:57:37.586 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T07:57:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T07:57:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:57:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:57:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:57:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:57:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.b", 2023-10-09T07:57:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlDZQYHhAA2LGKHPLrBVKlGMK0TKup7A==", 2023-10-09T07:57:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:57:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:57:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T07:57:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T07:57:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:57:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:57:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:57:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:57:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.c", 2023-10-09T07:57:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlLKKfExAA65+KIyYd16iQ2L5topDPkg==", 2023-10-09T07:57:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:57:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:57:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T07:57:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T07:57:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:57:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:57:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:57:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:57:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.d", 2023-10-09T07:57:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlpQKTKBAAP59h/znElthIdqbK9tKJww==", 2023-10-09T07:57:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:57:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:57:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T07:57:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T07:57:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:57:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:57:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:57:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:57:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.0", 2023-10-09T07:57:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCgoCNll7hBIBAAtZ8mBx+MPAwEou48boP4Hw==", 2023-10-09T07:57:37.590 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:57:37.590 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:57:37.590 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:57:37.590 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:57:37.590 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:57:37.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:57:37.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:57:37.590 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.1", 2023-10-09T07:57:37.590 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCjoCNl7uRMIxAAztQi4ZsulyN2FHcMRzZ82Q==", 2023-10-09T07:57:37.590 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:57:37.590 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:57:37.590 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:57:37.591 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:57:37.591 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:57:37.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:57:37.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:57:37.591 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.2", 2023-10-09T07:57:37.591 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCmoCNlW/cNJhAAfFdnRC95YJwpCngJS956cA==", 2023-10-09T07:57:37.591 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:57:37.591 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:57:37.591 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:57:37.591 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:57:37.591 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:57:37.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:57:37.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:57:37.592 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.3", 2023-10-09T07:57:37.592 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCpoCNlAIlYKRAAD5IGHWZ14ckpQAU4wBifbg==", 2023-10-09T07:57:37.592 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:57:37.592 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:57:37.592 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:57:37.592 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:57:37.592 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:57:37.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:57:37.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:57:37.592 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.4", 2023-10-09T07:57:37.592 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCvoCNltrA4ORAAtifmL9hr1xKd+jsMf5Nf+Q==", 2023-10-09T07:57:37.592 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:57:37.593 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:57:37.593 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:57:37.593 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:57:37.593 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:57:37.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:57:37.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:57:37.593 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.5", 2023-10-09T07:57:37.593 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCyoCNlA/IOOxAAQWRPQ+00o9xrpScAvY/87w==", 2023-10-09T07:57:37.593 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:57:37.593 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:57:37.593 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:57:37.593 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:57:37.594 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:57:37.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:57:37.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:57:37.594 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.6", 2023-10-09T07:57:37.594 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQC2oCNlvRusARAAcRaGyCROIRVTHeKhrncN8g==", 2023-10-09T07:57:37.594 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:57:37.594 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:57:37.594 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:57:37.594 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:57:37.594 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:57:37.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:57:37.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:57:37.595 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.7", 2023-10-09T07:57:37.595 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQC5oCNli/3NAxAAIMYuED41ZSx1xF384N6y1A==", 2023-10-09T07:57:37.595 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:57:37.595 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:57:37.595 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:57:37.595 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:57:37.595 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:57:37.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:57:37.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:57:37.595 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.0", 2023-10-09T07:57:37.595 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlHrKWMRAAyIfmryGSgqIFwWEJyixprw==", 2023-10-09T07:57:37.595 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:57:37.595 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:57:37.596 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow r", 2023-10-09T07:57:37.596 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T07:57:37.596 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:57:37.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:57:37.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:57:37.596 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.1", 2023-10-09T07:57:37.596 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCdoCNldq1xAxAAxCpmelS0qDEY187u19JkcQ==", 2023-10-09T07:57:37.596 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:57:37.596 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:57:37.596 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T07:57:37.596 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T07:57:37.596 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T07:57:37.597 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:57:37.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:57:37.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:57:37.597 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.2", 2023-10-09T07:57:37.597 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlM3JHOBAA8fszREXH+WnYb+3vIaakcA==", 2023-10-09T07:57:37.597 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:57:37.597 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:57:37.597 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T07:57:37.597 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T07:57:37.597 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T07:57:37.597 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:57:37.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:57:37.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:57:37.598 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.3", 2023-10-09T07:57:37.598 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCdoCNlgkEqChAAwntdv9UOo30x40pVa70yag==", 2023-10-09T07:57:37.598 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:57:37.598 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:57:37.598 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T07:57:37.598 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T07:57:37.598 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T07:57:37.598 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:57:37.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:57:37.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:57:37.598 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.admin", 2023-10-09T07:57:37.599 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCboCNlj2W4EhAAUnfX6NBeDyMj2nY/G2ciEg==", 2023-10-09T07:57:37.599 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:57:37.599 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T07:57:37.599 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T07:57:37.599 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T07:57:37.599 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:57:37.599 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:57:37.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:57:37.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:57:37.599 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.x", 2023-10-09T07:57:37.599 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlwwJ/AhAAjHMhAX1/yWgh9no7yQqP6Q==", 2023-10-09T07:57:37.599 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:57:37.599 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T07:57:37.600 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-09T07:57:37.600 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:57:37.600 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:57:37.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:57:37.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:57:37.600 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.y", 2023-10-09T07:57:37.600 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCboCNly/XVNRAAlKr9arCbsDbzZ9bpIU5dng==", 2023-10-09T07:57:37.600 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:57:37.600 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T07:57:37.600 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-09T07:57:37.600 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:57:37.600 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:57:37.601 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:57:37.601 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2023-10-09T07:57:37.601 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T07:57:37.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.587+0000 7fd0e759e700 1 -- 172.21.15.71:0/328896216 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd0c8066f30 msgr2=0x7fd0c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:37.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.587+0000 7fd0e759e700 1 --2- 172.21.15.71:0/328896216 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd0c8066f30 0x7fd0c80693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8006fd0 tx=0x7fd0d8008040 comp rx=0 tx=0).stop 2023-10-09T07:57:37.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.587+0000 7fd0e759e700 1 -- 172.21.15.71:0/328896216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e815d230 msgr2=0x7fd0e816cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:37.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.587+0000 7fd0e759e700 1 --2- 172.21.15.71:0/328896216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e815d230 0x7fd0e816cee0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0007f20 tx=0x7fd0e0009860 comp rx=0 tx=0).stop 2023-10-09T07:57:37.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.587+0000 7fd0e759e700 1 -- 172.21.15.71:0/328896216 shutdown_connections 2023-10-09T07:57:37.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.587+0000 7fd0e759e700 1 --2- 172.21.15.71:0/328896216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e815d230 0x7fd0e816cee0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.587+0000 7fd0e759e700 1 --2- 172.21.15.71:0/328896216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0e8159420 0x7fd0e813dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.587+0000 7fd0e759e700 1 --2- 172.21.15.71:0/328896216 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd0c8066f30 0x7fd0c80693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.587+0000 7fd0e759e700 1 --2- 172.21.15.71:0/328896216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0e81597f0 0x7fd0e816a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.587+0000 7fd0e759e700 1 -- 172.21.15.71:0/328896216 >> 172.21.15.71:0/328896216 conn(0x7fd0e80d0660 msgr2=0x7fd0e80ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:37.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.587+0000 7fd0e759e700 1 -- 172.21.15.71:0/328896216 shutdown_connections 2023-10-09T07:57:37.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.587+0000 7fd0e759e700 1 -- 172.21.15.71:0/328896216 wait complete. 2023-10-09T07:57:37.606 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:57:37.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.787+0000 7f5440b9d700 1 Processor -- start 2023-10-09T07:57:37.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.787+0000 7f5440b9d700 1 -- start start 2023-10-09T07:57:37.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.788+0000 7f5440b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f543c156310 0x7f543c0c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:37.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.788+0000 7f5440b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f543c1566e0 0x7f543c0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:37.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.788+0000 7f5440b9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543c0ca860 con 0x7f543c0ca300 2023-10-09T07:57:37.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.788+0000 7f5440b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f543c0cab40 con 0x7f543c156310 2023-10-09T07:57:37.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.788+0000 7f5440b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543c0cae20 con 0x7f543c1566e0 2023-10-09T07:57:37.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.788+0000 7f543bfff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f543c0ca300 0x7f543c0c6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54960/0 (socket says 172.21.15.71:54960) 2023-10-09T07:57:37.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.788+0000 7f543bfff700 1 -- 172.21.15.71:0/1620662806 learned_addr learned my addr 172.21.15.71:0/1620662806 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:37.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.789+0000 7f5433fff700 1 --2- 172.21.15.71:0/1620662806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f543c1566e0 0x7f543c0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:37.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.789+0000 7f543b7fe700 1 --2- 172.21.15.71:0/1620662806 >> v2:172.21.15.179:3300/0 conn(0x7f543c156310 0x7f543c0c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:37.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.789+0000 7f543affd700 1 -- 172.21.15.71:0/1620662806 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333548593 0 0) 0x7f543c0ca860 con 0x7f543c0ca300 2023-10-09T07:57:37.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.789+0000 7f543affd700 1 -- 172.21.15.71:0/1620662806 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5428003570 con 0x7f543c0ca300 2023-10-09T07:57:37.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.789+0000 7f543b7fe700 1 -- 172.21.15.71:0/1620662806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f543c1566e0 msgr2=0x7f543c0ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:37.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.789+0000 7f543b7fe700 1 --2- 172.21.15.71:0/1620662806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f543c1566e0 0x7f543c0ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.789+0000 7f543b7fe700 1 -- 172.21.15.71:0/1620662806 >> v1:172.21.15.71:6789/0 conn(0x7f543c0ca300 legacy=0x7f543c0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:37.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.789+0000 7f543b7fe700 1 -- 172.21.15.71:0/1620662806 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c0cb100 con 0x7f543c156310 2023-10-09T07:57:37.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.789+0000 7f543b7fe700 1 --2- 172.21.15.71:0/1620662806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f543c156310 0x7f543c0c9dc0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f542c0098e0 tx=0x7f542c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fe6e3f4df65acca server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:37.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.790+0000 7f543affd700 1 -- 172.21.15.71:0/1620662806 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c011630 con 0x7f543c156310 2023-10-09T07:57:37.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.790+0000 7f543affd700 1 -- 172.21.15.71:0/1620662806 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542c011790 con 0x7f543c156310 2023-10-09T07:57:37.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.790+0000 7f543affd700 1 -- 172.21.15.71:0/1620662806 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c011b30 con 0x7f543c156310 2023-10-09T07:57:37.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.790+0000 7f5440b9d700 1 -- 172.21.15.71:0/1620662806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f543c156310 msgr2=0x7f543c0c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:37.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.790+0000 7f5440b9d700 1 --2- 172.21.15.71:0/1620662806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f543c156310 0x7f543c0c9dc0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f542c0098e0 tx=0x7f542c0091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.790+0000 7f5440b9d700 1 -- 172.21.15.71:0/1620662806 shutdown_connections 2023-10-09T07:57:37.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.790+0000 7f5440b9d700 1 --2- 172.21.15.71:0/1620662806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f543c156310 0x7f543c0c9dc0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.790+0000 7f5440b9d700 1 --2- 172.21.15.71:0/1620662806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f543c1566e0 0x7f543c0ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.790+0000 7f5440b9d700 1 -- 172.21.15.71:0/1620662806 >> 172.21.15.71:0/1620662806 conn(0x7f543c0cc1f0 msgr2=0x7f543c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:37.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.790+0000 7f5440b9d700 1 -- 172.21.15.71:0/1620662806 shutdown_connections 2023-10-09T07:57:37.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.790+0000 7f5440b9d700 1 -- 172.21.15.71:0/1620662806 wait complete. 2023-10-09T07:57:37.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.792+0000 7f5440b9d700 1 Processor -- start 2023-10-09T07:57:37.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.792+0000 7f5440b9d700 1 -- start start 2023-10-09T07:57:37.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.793+0000 7f5440b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f543c0ca300 0x7f543c1698c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:37.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.793+0000 7f5440b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f543c156310 0x7f543c0c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:37.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.793+0000 7f5440b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f543c1566e0 0x7f543c15aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:37.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.793+0000 7f5440b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c1663f0 con 0x7f543c156310 2023-10-09T07:57:37.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.793+0000 7f5440b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c1657e0 con 0x7f543c0ca300 2023-10-09T07:57:37.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.793+0000 7f5440b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543c165ac0 con 0x7f543c1566e0 2023-10-09T07:57:37.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.793+0000 7f5433fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f543c156310 0x7f543c0c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:37.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.793+0000 7f5433fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f543c156310 0x7f543c0c32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33944/0 (socket says 172.21.15.71:33944) 2023-10-09T07:57:37.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.793+0000 7f5433fff700 1 -- 172.21.15.71:0/1877475047 learned_addr learned my addr 172.21.15.71:0/1877475047 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:37.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.793+0000 7f543b7fe700 1 --2- 172.21.15.71:0/1877475047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f543c0ca300 0x7f543c1698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:37.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.793+0000 7f543bfff700 1 --2- 172.21.15.71:0/1877475047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f543c1566e0 0x7f543c15aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:37.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.793+0000 7f5433fff700 1 -- 172.21.15.71:0/1877475047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f543c1566e0 msgr2=0x7f543c15aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:37.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.793+0000 7f5433fff700 1 --2- 172.21.15.71:0/1877475047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f543c1566e0 0x7f543c15aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.793+0000 7f5433fff700 1 -- 172.21.15.71:0/1877475047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f543c0ca300 msgr2=0x7f543c1698c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:37.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.793+0000 7f5433fff700 1 --2- 172.21.15.71:0/1877475047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f543c0ca300 0x7f543c1698c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.794+0000 7f5433fff700 1 -- 172.21.15.71:0/1877475047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c009420 con 0x7f543c156310 2023-10-09T07:57:37.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.794+0000 7f543b7fe700 1 --2- 172.21.15.71:0/1877475047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f543c0ca300 0x7f543c1698c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:57:37.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.794+0000 7f5433fff700 1 --2- 172.21.15.71:0/1877475047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f543c156310 0x7f543c0c32a0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f542400ec50 tx=0x7f54240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:37.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.794+0000 7f54337fe700 1 -- 172.21.15.71:0/1877475047 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542400c9d0 con 0x7f543c156310 2023-10-09T07:57:37.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.794+0000 7f54337fe700 1 -- 172.21.15.71:0/1877475047 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542400cb30 con 0x7f543c156310 2023-10-09T07:57:37.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.794+0000 7f5440b9d700 1 -- 172.21.15.71:0/1877475047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543c165da0 con 0x7f543c156310 2023-10-09T07:57:37.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.794+0000 7f54337fe700 1 -- 172.21.15.71:0/1877475047 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5424013470 con 0x7f543c156310 2023-10-09T07:57:37.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.794+0000 7f5440b9d700 1 -- 172.21.15.71:0/1877475047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543c0c37e0 con 0x7f543c156310 2023-10-09T07:57:37.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.795+0000 7f5440b9d700 1 -- 172.21.15.71:0/1877475047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f543c1665a0 con 0x7f543c156310 2023-10-09T07:57:37.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.796+0000 7f54337fe700 1 -- 172.21.15.71:0/1877475047 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5424013820 con 0x7f543c156310 2023-10-09T07:57:37.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.797+0000 7f54337fe700 1 --2- 172.21.15.71:0/1877475047 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f541c066f30 0x7f541c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:37.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.797+0000 7f54337fe700 1 -- 172.21.15.71:0/1877475047 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5317+0+0 (secure 0 0 0) 0x7f5424084430 con 0x7f543c156310 2023-10-09T07:57:37.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.797+0000 7f543b7fe700 1 --2- 172.21.15.71:0/1877475047 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f541c066f30 0x7f541c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:37.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.798+0000 7f543b7fe700 1 --2- 172.21.15.71:0/1877475047 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f541c066f30 0x7f541c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f542c0091e0 tx=0x7f542c017000 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:37.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.801+0000 7f54337fe700 1 -- 172.21.15.71:0/1877475047 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f543c1665a0 con 0x7f543c156310 2023-10-09T07:57:37.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.990+0000 7f5440b9d700 1 -- 172.21.15.71:0/1877475047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f543c04c3c0 con 0x7f543c156310 2023-10-09T07:57:37.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.991+0000 7f54337fe700 1 -- 172.21.15.71:0/1877475047 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+12854 (secure 0 0 0) 0x7f5424051820 con 0x7f543c156310 2023-10-09T07:57:37.992 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:57:37.992 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":159,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:57:37.097006+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:57:37.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.993+0000 7f5440b9d700 1 -- 172.21.15.71:0/1877475047 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f541c066f30 msgr2=0x7f541c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:37.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.993+0000 7f5440b9d700 1 --2- 172.21.15.71:0/1877475047 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f541c066f30 0x7f541c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f542c0091e0 tx=0x7f542c017000 comp rx=0 tx=0).stop 2023-10-09T07:57:37.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.993+0000 7f5440b9d700 1 -- 172.21.15.71:0/1877475047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f543c156310 msgr2=0x7f543c0c32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:37.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.993+0000 7f5440b9d700 1 --2- 172.21.15.71:0/1877475047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f543c156310 0x7f543c0c32a0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f542400ec50 tx=0x7f54240091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.993+0000 7f5440b9d700 1 -- 172.21.15.71:0/1877475047 shutdown_connections 2023-10-09T07:57:37.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.993+0000 7f5440b9d700 1 --2- 172.21.15.71:0/1877475047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f543c1566e0 0x7f543c15aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.993+0000 7f5440b9d700 1 --2- 172.21.15.71:0/1877475047 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f541c066f30 0x7f541c0693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.993+0000 7f5440b9d700 1 --2- 172.21.15.71:0/1877475047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f543c0ca300 0x7f543c1698c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.993+0000 7f5440b9d700 1 --2- 172.21.15.71:0/1877475047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f543c156310 0x7f543c0c32a0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:37.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.993+0000 7f5440b9d700 1 -- 172.21.15.71:0/1877475047 >> 172.21.15.71:0/1877475047 conn(0x7f543c0cc1f0 msgr2=0x7f543c0c0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:37.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.993+0000 7f5440b9d700 1 -- 172.21.15.71:0/1877475047 shutdown_connections 2023-10-09T07:57:37.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:37.993+0000 7f5440b9d700 1 -- 172.21.15.71:0/1877475047 wait complete. 2023-10-09T07:57:38.012 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T07:57:38.013 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T07:57:38.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.196+0000 7f71297ff700 1 Processor -- start 2023-10-09T07:57:38.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.196+0000 7f71297ff700 1 -- start start 2023-10-09T07:57:38.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.198+0000 7f71297ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71240c83f0 0x7f71240c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:38.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.198+0000 7f71297ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f71241568e0 0x7f71240ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:38.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.198+0000 7f71297ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712415b0d0 con 0x7f71240ccee0 2023-10-09T07:57:38.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.198+0000 7f71297ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71240c7a60 con 0x7f71241568e0 2023-10-09T07:57:38.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.198+0000 7f71297ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712415a4c0 con 0x7f71240c83f0 2023-10-09T07:57:38.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.198+0000 7f711bfff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f71240ccee0 0x7f71241561d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54964/0 (socket says 172.21.15.71:54964) 2023-10-09T07:57:38.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.198+0000 7f711bfff700 1 -- 172.21.15.71:0/439027978 learned_addr learned my addr 172.21.15.71:0/439027978 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:38.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.198+0000 7f7122ffd700 1 --2- 172.21.15.71:0/439027978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71240c83f0 0x7f71240c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:38.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.198+0000 7f71237fe700 1 --2- 172.21.15.71:0/439027978 >> v2:172.21.15.179:3300/0 conn(0x7f71241568e0 0x7f71240ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:38.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.198+0000 7f71227fc700 1 -- 172.21.15.71:0/439027978 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1648566 0 0) 0x7f712415b0d0 con 0x7f71240ccee0 2023-10-09T07:57:38.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.198+0000 7f71227fc700 1 -- 172.21.15.71:0/439027978 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7110003570 con 0x7f71240ccee0 2023-10-09T07:57:38.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.199+0000 7f71227fc700 1 -- 172.21.15.71:0/439027978 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 428883211 0 0) 0x7f7110003570 con 0x7f71240ccee0 2023-10-09T07:57:38.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.199+0000 7f71237fe700 1 -- 172.21.15.71:0/439027978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71240c83f0 msgr2=0x7f71240c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:38.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.199+0000 7f71237fe700 1 --2- 172.21.15.71:0/439027978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71240c83f0 0x7f71240c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:38.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.199+0000 7f71237fe700 1 -- 172.21.15.71:0/439027978 >> v1:172.21.15.71:6789/0 conn(0x7f71240ccee0 legacy=0x7f71241561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:38.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.199+0000 7f71237fe700 1 -- 172.21.15.71:0/439027978 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712415a7a0 con 0x7f71241568e0 2023-10-09T07:57:38.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.199+0000 7f71237fe700 1 --2- 172.21.15.71:0/439027978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71241568e0 0x7f71240ca1e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f711c009e50 tx=0x7f711c009740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d65c919b554dfbc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:38.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.199+0000 7f71227fc700 1 -- 172.21.15.71:0/439027978 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c001470 con 0x7f71241568e0 2023-10-09T07:57:38.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.199+0000 7f71227fc700 1 -- 172.21.15.71:0/439027978 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c00e880 con 0x7f71241568e0 2023-10-09T07:57:38.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.199+0000 7f71227fc700 1 -- 172.21.15.71:0/439027978 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c00f040 con 0x7f71241568e0 2023-10-09T07:57:38.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.200+0000 7f71297ff700 1 -- 172.21.15.71:0/439027978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71241568e0 msgr2=0x7f71240ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:38.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.200+0000 7f71297ff700 1 --2- 172.21.15.71:0/439027978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71241568e0 0x7f71240ca1e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f711c009e50 tx=0x7f711c009740 comp rx=0 tx=0).stop 2023-10-09T07:57:38.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.200+0000 7f71297ff700 1 -- 172.21.15.71:0/439027978 shutdown_connections 2023-10-09T07:57:38.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.200+0000 7f71297ff700 1 --2- 172.21.15.71:0/439027978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71241568e0 0x7f71240ca1e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:38.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.200+0000 7f71297ff700 1 --2- 172.21.15.71:0/439027978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71240c83f0 0x7f71240c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:38.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.200+0000 7f71297ff700 1 -- 172.21.15.71:0/439027978 >> 172.21.15.71:0/439027978 conn(0x7f7124068e10 msgr2=0x7f71240cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:38.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.200+0000 7f71297ff700 1 -- 172.21.15.71:0/439027978 shutdown_connections 2023-10-09T07:57:38.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.200+0000 7f71297ff700 1 -- 172.21.15.71:0/439027978 wait complete. 2023-10-09T07:57:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.201+0000 7f71297ff700 1 Processor -- start 2023-10-09T07:57:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.202+0000 7f71297ff700 1 -- start start 2023-10-09T07:57:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.202+0000 7f71297ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71240c83f0 0x7f71240c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.202+0000 7f71297ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71240ccee0 0x7f7124164810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.202+0000 7f71297ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71241568e0 0x7f71240ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.202+0000 7f71297ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71240c5d10 con 0x7f71240ccee0 2023-10-09T07:57:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.202+0000 7f71297ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712414f710 con 0x7f71240c83f0 2023-10-09T07:57:38.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.202+0000 7f71297ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712414f9f0 con 0x7f71241568e0 2023-10-09T07:57:38.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.203+0000 7f711bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71240ccee0 0x7f7124164810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:38.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.203+0000 7f711bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71240ccee0 0x7f7124164810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33946/0 (socket says 172.21.15.71:33946) 2023-10-09T07:57:38.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.203+0000 7f711bfff700 1 -- 172.21.15.71:0/506144781 learned_addr learned my addr 172.21.15.71:0/506144781 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:38.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.203+0000 7f7122ffd700 1 --2- 172.21.15.71:0/506144781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71240c83f0 0x7f71240c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:38.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.203+0000 7f71237fe700 1 --2- 172.21.15.71:0/506144781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71241568e0 0x7f71240ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:38.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.203+0000 7f711bfff700 1 -- 172.21.15.71:0/506144781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71241568e0 msgr2=0x7f71240ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:38.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.203+0000 7f711bfff700 1 --2- 172.21.15.71:0/506144781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71241568e0 0x7f71240ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:38.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.203+0000 7f711bfff700 1 -- 172.21.15.71:0/506144781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71240c83f0 msgr2=0x7f71240c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:38.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.203+0000 7f711bfff700 1 --2- 172.21.15.71:0/506144781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71240c83f0 0x7f71240c5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:38.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.203+0000 7f711bfff700 1 -- 172.21.15.71:0/506144781 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c0099e0 con 0x7f71240ccee0 2023-10-09T07:57:38.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.203+0000 7f711bfff700 1 --2- 172.21.15.71:0/506144781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71240ccee0 0x7f7124164810 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f710c00cb90 tx=0x7f710c001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:38.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.204+0000 7f711affd700 1 -- 172.21.15.71:0/506144781 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c007e90 con 0x7f71240ccee0 2023-10-09T07:57:38.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.204+0000 7f711affd700 1 -- 172.21.15.71:0/506144781 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710c007360 con 0x7f71240ccee0 2023-10-09T07:57:38.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.204+0000 7f71297ff700 1 -- 172.21.15.71:0/506144781 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712414fcd0 con 0x7f71240ccee0 2023-10-09T07:57:38.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.204+0000 7f711affd700 1 -- 172.21.15.71:0/506144781 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c007700 con 0x7f71240ccee0 2023-10-09T07:57:38.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.204+0000 7f71297ff700 1 -- 172.21.15.71:0/506144781 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71240c5950 con 0x7f71240ccee0 2023-10-09T07:57:38.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.205+0000 7f71297ff700 1 -- 172.21.15.71:0/506144781 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7124150170 con 0x7f71240ccee0 2023-10-09T07:57:38.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.206+0000 7f711affd700 1 -- 172.21.15.71:0/506144781 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f710c004a40 con 0x7f71240ccee0 2023-10-09T07:57:38.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.206+0000 7f711affd700 1 --2- 172.21.15.71:0/506144781 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7104066f30 0x7f71040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:38.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.206+0000 7f711affd700 1 -- 172.21.15.71:0/506144781 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5317+0+0 (secure 0 0 0) 0x7f710c083c50 con 0x7f71240ccee0 2023-10-09T07:57:38.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.207+0000 7f7122ffd700 1 --2- 172.21.15.71:0/506144781 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7104066f30 0x7f71040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:38.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.207+0000 7f7122ffd700 1 --2- 172.21.15.71:0/506144781 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7104066f30 0x7f71040693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7114009d40 tx=0x7f7114008040 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:38.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.210+0000 7f711affd700 1 -- 172.21.15.71:0/506144781 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f710c089020 con 0x7f71240ccee0 2023-10-09T07:57:38.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.400+0000 7f71297ff700 1 -- 172.21.15.71:0/506144781 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f712404c3c0 con 0x7f71240ccee0 2023-10-09T07:57:38.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.401+0000 7f711affd700 1 -- 172.21.15.71:0/506144781 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v159) v1 ==== 93+0+10 (secure 0 0 0) 0x7f710c018020 con 0x7f71240ccee0 2023-10-09T07:57:38.402 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T07:57:38.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.403+0000 7f71297ff700 1 -- 172.21.15.71:0/506144781 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7104066f30 msgr2=0x7f71040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:38.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.403+0000 7f71297ff700 1 --2- 172.21.15.71:0/506144781 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7104066f30 0x7f71040693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7114009d40 tx=0x7f7114008040 comp rx=0 tx=0).stop 2023-10-09T07:57:38.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.403+0000 7f71297ff700 1 -- 172.21.15.71:0/506144781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71240ccee0 msgr2=0x7f7124164810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:38.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.403+0000 7f71297ff700 1 --2- 172.21.15.71:0/506144781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71240ccee0 0x7f7124164810 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f710c00cb90 tx=0x7f710c001b50 comp rx=0 tx=0).stop 2023-10-09T07:57:38.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.403+0000 7f71297ff700 1 -- 172.21.15.71:0/506144781 shutdown_connections 2023-10-09T07:57:38.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.403+0000 7f71297ff700 1 --2- 172.21.15.71:0/506144781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71241568e0 0x7f71240ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:38.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.403+0000 7f71297ff700 1 --2- 172.21.15.71:0/506144781 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7104066f30 0x7f71040693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:38.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.403+0000 7f71297ff700 1 --2- 172.21.15.71:0/506144781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71240c83f0 0x7f71240c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:38.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.403+0000 7f71297ff700 1 --2- 172.21.15.71:0/506144781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71240ccee0 0x7f7124164810 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:38.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.403+0000 7f71297ff700 1 -- 172.21.15.71:0/506144781 >> 172.21.15.71:0/506144781 conn(0x7f7124068e10 msgr2=0x7f7124069770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:38.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.403+0000 7f71297ff700 1 -- 172.21.15.71:0/506144781 shutdown_connections 2023-10-09T07:57:38.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.403+0000 7f71297ff700 1 -- 172.21.15.71:0/506144781 wait complete. 2023-10-09T07:57:38.422 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T07:57:38.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.601+0000 7f76477ff700 1 Processor -- start 2023-10-09T07:57:38.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.601+0000 7f76477ff700 1 -- start start 2023-10-09T07:57:38.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.603+0000 7f76477ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76400cbf30 0x7f76400ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:38.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.603+0000 7f76477ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f76400b1420 0x7f76400c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:38.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.603+0000 7f76477ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76400cc300 con 0x7f76400ccf90 2023-10-09T07:57:38.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.603+0000 7f76477ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7640156bf0 con 0x7f76400b1420 2023-10-09T07:57:38.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.603+0000 7f76477ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76400ae950 con 0x7f76400cbf30 2023-10-09T07:57:38.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.603+0000 7f764559b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76400cbf30 0x7f76400ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:38.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.603+0000 7f7645d9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f76400b1420 0x7f76400c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:38.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.603+0000 7f7645d9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f76400b1420 0x7f76400c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:50102/0 (socket says 172.21.15.71:50102) 2023-10-09T07:57:38.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.603+0000 7f7644d9a700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f76400ccf90 0x7f76400b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:35474/0 (socket says 172.21.15.71:35474) 2023-10-09T07:57:38.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.603+0000 7f7645d9c700 1 -- 172.21.15.71:0/1904183285 learned_addr learned my addr 172.21.15.71:0/1904183285 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:38.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.603+0000 7f764559b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76400cbf30 0x7f76400ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:44882/0 (socket says 172.21.15.71:44882) 2023-10-09T07:57:38.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.604+0000 7f7645d9c700 1 -- 172.21.15.71:0/1904183285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76400cbf30 msgr2=0x7f76400ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:38.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.604+0000 7f7645d9c700 1 --2- 172.21.15.71:0/1904183285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76400cbf30 0x7f76400ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:38.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.604+0000 7f7645d9c700 1 -- 172.21.15.71:0/1904183285 >> v1:172.21.15.179:6789/0 conn(0x7f76400ccf90 legacy=0x7f76400b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:38.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.604+0000 7f7645d9c700 1 -- 172.21.15.71:0/1904183285 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76400ad370 con 0x7f76400b1420 2023-10-09T07:57:38.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.604+0000 7f7645d9c700 1 --2- 172.21.15.71:0/1904183285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76400b1420 0x7f76400c9740 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f7638009f50 tx=0x7f7638009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b5e62baf5d001d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:38.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.604+0000 7f7637fff700 1 -- 172.21.15.71:0/1904183285 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763800e070 con 0x7f76400b1420 2023-10-09T07:57:38.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.605+0000 7f7637fff700 1 -- 172.21.15.71:0/1904183285 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763800b9c0 con 0x7f76400b1420 2023-10-09T07:57:38.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.605+0000 7f7637fff700 1 -- 172.21.15.71:0/1904183285 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76380092e0 con 0x7f76400b1420 2023-10-09T07:57:38.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.605+0000 7f76477ff700 1 -- 172.21.15.71:0/1904183285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76400b1420 msgr2=0x7f76400c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:38.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.605+0000 7f76477ff700 1 --2- 172.21.15.71:0/1904183285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76400b1420 0x7f76400c9740 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f7638009f50 tx=0x7f7638009840 comp rx=0 tx=0).stop 2023-10-09T07:57:38.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.605+0000 7f76477ff700 1 -- 172.21.15.71:0/1904183285 shutdown_connections 2023-10-09T07:57:38.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.605+0000 7f76477ff700 1 --2- 172.21.15.71:0/1904183285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76400b1420 0x7f76400c9740 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:38.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.605+0000 7f76477ff700 1 --2- 172.21.15.71:0/1904183285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76400cbf30 0x7f76400ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:38.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.605+0000 7f76477ff700 1 -- 172.21.15.71:0/1904183285 >> 172.21.15.71:0/1904183285 conn(0x7f764006a320 msgr2=0x7f76400cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:38.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.605+0000 7f76477ff700 1 -- 172.21.15.71:0/1904183285 shutdown_connections 2023-10-09T07:57:38.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.605+0000 7f76477ff700 1 -- 172.21.15.71:0/1904183285 wait complete. 2023-10-09T07:57:38.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.607+0000 7f76477ff700 1 Processor -- start 2023-10-09T07:57:38.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.607+0000 7f76477ff700 1 -- start start 2023-10-09T07:57:38.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.608+0000 7f76477ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76400b1420 0x7f76400c2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:38.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.608+0000 7f76477ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76400cbf30 0x7f7640152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:38.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.608+0000 7f76477ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76400ccf90 0x7f76401550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:38.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.608+0000 7f76477ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76401533b0 con 0x7f76400cbf30 2023-10-09T07:57:38.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.608+0000 7f76477ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764016ac80 con 0x7f76400ccf90 2023-10-09T07:57:38.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.608+0000 7f76477ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764016a100 con 0x7f76400b1420 2023-10-09T07:57:38.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.608+0000 7f7644d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76400cbf30 0x7f7640152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:38.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.608+0000 7f7644d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76400cbf30 0x7f7640152e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33954/0 (socket says 172.21.15.71:33954) 2023-10-09T07:57:38.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.608+0000 7f7644d9a700 1 -- 172.21.15.71:0/2725507299 learned_addr learned my addr 172.21.15.71:0/2725507299 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:38.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.608+0000 7f764559b700 1 --2- 172.21.15.71:0/2725507299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76400b1420 0x7f76400c2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:38.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.608+0000 7f7645d9c700 1 --2- 172.21.15.71:0/2725507299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76400ccf90 0x7f76401550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:38.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.609+0000 7f7644d9a700 1 -- 172.21.15.71:0/2725507299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76400b1420 msgr2=0x7f76400c2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:38.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.609+0000 7f7644d9a700 1 --2- 172.21.15.71:0/2725507299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76400b1420 0x7f76400c2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:38.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.609+0000 7f7644d9a700 1 -- 172.21.15.71:0/2725507299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76400ccf90 msgr2=0x7f76401550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:38.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.609+0000 7f7644d9a700 1 --2- 172.21.15.71:0/2725507299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76400ccf90 0x7f76401550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:38.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.609+0000 7f7644d9a700 1 -- 172.21.15.71:0/2725507299 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7638009ae0 con 0x7f76400cbf30 2023-10-09T07:57:38.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.609+0000 7f7644d9a700 1 --2- 172.21.15.71:0/2725507299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76400cbf30 0x7f7640152e70 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f763000c560 tx=0x7f7630007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:38.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.609+0000 7f76357fa700 1 -- 172.21.15.71:0/2725507299 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7630005a70 con 0x7f76400cbf30 2023-10-09T07:57:38.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.609+0000 7f76357fa700 1 -- 172.21.15.71:0/2725507299 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7630005bd0 con 0x7f76400cbf30 2023-10-09T07:57:38.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.609+0000 7f76477ff700 1 -- 172.21.15.71:0/2725507299 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764016a3e0 con 0x7f76400cbf30 2023-10-09T07:57:38.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.609+0000 7f76357fa700 1 -- 172.21.15.71:0/2725507299 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76300070d0 con 0x7f76400cbf30 2023-10-09T07:57:38.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.609+0000 7f76477ff700 1 -- 172.21.15.71:0/2725507299 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764016a9a0 con 0x7f76400cbf30 2023-10-09T07:57:38.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.610+0000 7f76477ff700 1 -- 172.21.15.71:0/2725507299 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76400c32a0 con 0x7f76400cbf30 2023-10-09T07:57:38.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.611+0000 7f76357fa700 1 -- 172.21.15.71:0/2725507299 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7630007480 con 0x7f76400cbf30 2023-10-09T07:57:38.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.612+0000 7f76357fa700 1 --2- 172.21.15.71:0/2725507299 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7624066f30 0x7f76240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:38.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.612+0000 7f76357fa700 1 -- 172.21.15.71:0/2725507299 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5317+0+0 (secure 0 0 0) 0x7f7630083720 con 0x7f76400cbf30 2023-10-09T07:57:38.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.612+0000 7f764559b700 1 --2- 172.21.15.71:0/2725507299 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7624066f30 0x7f76240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:38.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.613+0000 7f764559b700 1 --2- 172.21.15.71:0/2725507299 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7624066f30 0x7f76240693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7640155d40 tx=0x7f763c00b430 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:38.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.616+0000 7f76357fa700 1 -- 172.21.15.71:0/2725507299 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76400c32a0 con 0x7f76400cbf30 2023-10-09T07:57:38.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.809+0000 7f76477ff700 1 -- 172.21.15.71:0/2725507299 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f76400c32a0 con 0x7f76400cbf30 2023-10-09T07:57:38.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.809+0000 7f76357fa700 1 -- 172.21.15.71:0/2725507299 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v159) v1 ==== 84+0+65 (secure 0 0 0) 0x7f76400c32a0 con 0x7f76400cbf30 2023-10-09T07:57:38.811 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:57:38.811 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-09T07:57:38.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:57:38.811 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 1, 2023-10-09T07:57:38.811 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": ".mgr" 2023-10-09T07:57:38.811 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:57:38.811 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-09T07:57:38.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.812+0000 7f76477ff700 1 -- 172.21.15.71:0/2725507299 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7624066f30 msgr2=0x7f76240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:38.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.812+0000 7f76477ff700 1 --2- 172.21.15.71:0/2725507299 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7624066f30 0x7f76240693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7640155d40 tx=0x7f763c00b430 comp rx=0 tx=0).stop 2023-10-09T07:57:38.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.812+0000 7f76477ff700 1 -- 172.21.15.71:0/2725507299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76400cbf30 msgr2=0x7f7640152e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:38.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.812+0000 7f76477ff700 1 --2- 172.21.15.71:0/2725507299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76400cbf30 0x7f7640152e70 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f763000c560 tx=0x7f7630007f70 comp rx=0 tx=0).stop 2023-10-09T07:57:38.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.812+0000 7f76477ff700 1 -- 172.21.15.71:0/2725507299 shutdown_connections 2023-10-09T07:57:38.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.812+0000 7f76477ff700 1 --2- 172.21.15.71:0/2725507299 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7624066f30 0x7f76240693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:38.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.812+0000 7f76477ff700 1 --2- 172.21.15.71:0/2725507299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76400ccf90 0x7f76401550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:38.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.812+0000 7f76477ff700 1 --2- 172.21.15.71:0/2725507299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76400b1420 0x7f76400c2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:38.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.812+0000 7f76477ff700 1 --2- 172.21.15.71:0/2725507299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76400cbf30 0x7f7640152e70 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:38.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.812+0000 7f76477ff700 1 -- 172.21.15.71:0/2725507299 >> 172.21.15.71:0/2725507299 conn(0x7f764006a320 msgr2=0x7f76400ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:38.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.812+0000 7f76477ff700 1 -- 172.21.15.71:0/2725507299 shutdown_connections 2023-10-09T07:57:38.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:38.812+0000 7f76477ff700 1 -- 172.21.15.71:0/2725507299 wait complete. 2023-10-09T07:57:38.830 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T07:57:38.831 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T07:57:39.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.016+0000 7ff2a51ff700 1 Processor -- start 2023-10-09T07:57:39.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.016+0000 7ff2a51ff700 1 -- start start 2023-10-09T07:57:39.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.018+0000 7ff2a51ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a00c8490 0x7ff2a00c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:39.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.018+0000 7ff2a51ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff2a0069e20 0x7ff2a01569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:39.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.018+0000 7ff2a51ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a00ac030 con 0x7ff2a0069a50 2023-10-09T07:57:39.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.018+0000 7ff2a51ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a00ab820 con 0x7ff2a0069e20 2023-10-09T07:57:39.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.018+0000 7ff2a51ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a006dbb0 con 0x7ff2a00c8490 2023-10-09T07:57:39.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.018+0000 7ff29f59e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff2a0069e20 0x7ff2a01569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:39.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.018+0000 7ff29f59e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff2a0069e20 0x7ff2a01569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33970/0 (socket says 172.21.15.71:33970) 2023-10-09T07:57:39.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.018+0000 7ff29f59e700 1 -- 172.21.15.71:0/3858424130 learned_addr learned my addr 172.21.15.71:0/3858424130 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:39.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.018+0000 7ff29e59c700 1 --2- 172.21.15.71:0/3858424130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a00c8490 0x7ff2a00c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:39.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.018+0000 7ff29f59e700 1 -- 172.21.15.71:0/3858424130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a00c8490 msgr2=0x7ff2a00c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:39.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.018+0000 7ff29f59e700 1 --2- 172.21.15.71:0/3858424130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a00c8490 0x7ff2a00c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:39.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.018+0000 7ff29f59e700 1 -- 172.21.15.71:0/3858424130 >> v1:172.21.15.179:6789/0 conn(0x7ff2a0069a50 legacy=0x7ff2a015a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:39.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.018+0000 7ff29f59e700 1 -- 172.21.15.71:0/3858424130 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a00aba70 con 0x7ff2a0069e20 2023-10-09T07:57:39.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.018+0000 7ff29e59c700 1 --2- 172.21.15.71:0/3858424130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a00c8490 0x7ff2a00c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:57:39.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.019+0000 7ff29f59e700 1 --2- 172.21.15.71:0/3858424130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2a0069e20 0x7ff2a01569b0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7ff298009f50 tx=0x7ff298009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97968e36dc4da7ef server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:39.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.019+0000 7ff29dd9b700 1 -- 172.21.15.71:0/3858424130 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29800e070 con 0x7ff2a0069e20 2023-10-09T07:57:39.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.019+0000 7ff29dd9b700 1 -- 172.21.15.71:0/3858424130 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29800ba30 con 0x7ff2a0069e20 2023-10-09T07:57:39.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.019+0000 7ff29dd9b700 1 -- 172.21.15.71:0/3858424130 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2980092e0 con 0x7ff2a0069e20 2023-10-09T07:57:39.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.019+0000 7ff2a51ff700 1 -- 172.21.15.71:0/3858424130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2a0069e20 msgr2=0x7ff2a01569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:39.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.019+0000 7ff2a51ff700 1 --2- 172.21.15.71:0/3858424130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2a0069e20 0x7ff2a01569b0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7ff298009f50 tx=0x7ff298009840 comp rx=0 tx=0).stop 2023-10-09T07:57:39.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.019+0000 7ff2a51ff700 1 -- 172.21.15.71:0/3858424130 shutdown_connections 2023-10-09T07:57:39.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.019+0000 7ff2a51ff700 1 --2- 172.21.15.71:0/3858424130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2a0069e20 0x7ff2a01569b0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:39.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.019+0000 7ff2a51ff700 1 --2- 172.21.15.71:0/3858424130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a00c8490 0x7ff2a00c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:39.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.020+0000 7ff2a51ff700 1 -- 172.21.15.71:0/3858424130 >> 172.21.15.71:0/3858424130 conn(0x7ff2a00c8f90 msgr2=0x7ff2a00c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:39.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.020+0000 7ff2a51ff700 1 -- 172.21.15.71:0/3858424130 shutdown_connections 2023-10-09T07:57:39.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.020+0000 7ff2a51ff700 1 -- 172.21.15.71:0/3858424130 wait complete. 2023-10-09T07:57:39.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.021+0000 7ff2a51ff700 1 Processor -- start 2023-10-09T07:57:39.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.021+0000 7ff2a51ff700 1 -- start start 2023-10-09T07:57:39.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.022+0000 7ff2a51ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a0069a50 0x7ff2a014b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:39.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.022+0000 7ff2a51ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2a0069e20 0x7ff2a00aa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:39.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.022+0000 7ff2a51ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2a00c8490 0x7ff2a00aa800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:39.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.022+0000 7ff2a51ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a0153370 con 0x7ff2a00c8490 2023-10-09T07:57:39.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.022+0000 7ff2a51ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a00aae60 con 0x7ff2a0069e20 2023-10-09T07:57:39.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.022+0000 7ff2a51ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a00ab140 con 0x7ff2a0069a50 2023-10-09T07:57:39.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.022+0000 7ff29f59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2a00c8490 0x7ff2a00aa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:39.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.022+0000 7ff29f59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2a00c8490 0x7ff2a00aa800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33980/0 (socket says 172.21.15.71:33980) 2023-10-09T07:57:39.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.022+0000 7ff29f59e700 1 -- 172.21.15.71:0/1914094017 learned_addr learned my addr 172.21.15.71:0/1914094017 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:39.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.023+0000 7ff29e59c700 1 --2- 172.21.15.71:0/1914094017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2a0069e20 0x7ff2a00aa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:39.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.023+0000 7ff29ed9d700 1 --2- 172.21.15.71:0/1914094017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a0069a50 0x7ff2a014b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:39.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.023+0000 7ff29f59e700 1 -- 172.21.15.71:0/1914094017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a0069a50 msgr2=0x7ff2a014b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:39.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.023+0000 7ff29f59e700 1 --2- 172.21.15.71:0/1914094017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a0069a50 0x7ff2a014b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:39.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.023+0000 7ff29f59e700 1 -- 172.21.15.71:0/1914094017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2a0069e20 msgr2=0x7ff2a00aa2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:39.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.023+0000 7ff29f59e700 1 --2- 172.21.15.71:0/1914094017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2a0069e20 0x7ff2a00aa2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:39.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.023+0000 7ff29f59e700 1 -- 172.21.15.71:0/1914094017 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff298009ae0 con 0x7ff2a00c8490 2023-10-09T07:57:39.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.023+0000 7ff29f59e700 1 --2- 172.21.15.71:0/1914094017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2a00c8490 0x7ff2a00aa800 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7ff298009880 tx=0x7ff298017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:39.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.023+0000 7ff286ffd700 1 -- 172.21.15.71:0/1914094017 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff298012d40 con 0x7ff2a00c8490 2023-10-09T07:57:39.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.023+0000 7ff286ffd700 1 -- 172.21.15.71:0/1914094017 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29801d420 con 0x7ff2a00c8490 2023-10-09T07:57:39.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.023+0000 7ff286ffd700 1 -- 172.21.15.71:0/1914094017 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff298012ea0 con 0x7ff2a00c8490 2023-10-09T07:57:39.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.023+0000 7ff2a51ff700 1 -- 172.21.15.71:0/1914094017 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a00ac680 con 0x7ff2a00c8490 2023-10-09T07:57:39.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.024+0000 7ff2a51ff700 1 -- 172.21.15.71:0/1914094017 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a00acc40 con 0x7ff2a00c8490 2023-10-09T07:57:39.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.025+0000 7ff2a51ff700 1 -- 172.21.15.71:0/1914094017 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a00718b0 con 0x7ff2a00c8490 2023-10-09T07:57:39.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.025+0000 7ff286ffd700 1 -- 172.21.15.71:0/1914094017 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff29801da70 con 0x7ff2a00c8490 2023-10-09T07:57:39.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.027+0000 7ff286ffd700 1 --2- 172.21.15.71:0/1914094017 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff28c066f30 0x7ff28c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:39.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.027+0000 7ff286ffd700 1 -- 172.21.15.71:0/1914094017 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5317+0+0 (secure 0 0 0) 0x7ff298085960 con 0x7ff2a00c8490 2023-10-09T07:57:39.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.028+0000 7ff29ed9d700 1 --2- 172.21.15.71:0/1914094017 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff28c066f30 0x7ff28c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:39.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.028+0000 7ff29ed9d700 1 --2- 172.21.15.71:0/1914094017 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff28c066f30 0x7ff28c0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff290003a30 tx=0x7ff290007ea0 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:39.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.031+0000 7ff286ffd700 1 -- 172.21.15.71:0/1914094017 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff298052d50 con 0x7ff2a00c8490 2023-10-09T07:57:39.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.221+0000 7ff2a51ff700 1 -- 172.21.15.71:0/1914094017 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff2a00ac030 con 0x7ff2a00c8490 2023-10-09T07:57:39.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.681+0000 7ff286ffd700 1 -- 172.21.15.71:0/1914094017 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v160) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff2a00ac030 con 0x7ff2a00c8490 2023-10-09T07:57:39.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.686+0000 7ff2a51ff700 1 -- 172.21.15.71:0/1914094017 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff28c066f30 msgr2=0x7ff28c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:39.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.686+0000 7ff2a51ff700 1 --2- 172.21.15.71:0/1914094017 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff28c066f30 0x7ff28c0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff290003a30 tx=0x7ff290007ea0 comp rx=0 tx=0).stop 2023-10-09T07:57:39.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.686+0000 7ff2a51ff700 1 -- 172.21.15.71:0/1914094017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2a00c8490 msgr2=0x7ff2a00aa800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:39.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.686+0000 7ff2a51ff700 1 --2- 172.21.15.71:0/1914094017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2a00c8490 0x7ff2a00aa800 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7ff298009880 tx=0x7ff298017000 comp rx=0 tx=0).stop 2023-10-09T07:57:39.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.686+0000 7ff2a51ff700 1 -- 172.21.15.71:0/1914094017 shutdown_connections 2023-10-09T07:57:39.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.686+0000 7ff2a51ff700 1 --2- 172.21.15.71:0/1914094017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2a00c8490 0x7ff2a00aa800 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:39.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.686+0000 7ff2a51ff700 1 --2- 172.21.15.71:0/1914094017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a0069a50 0x7ff2a014b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:39.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.686+0000 7ff2a51ff700 1 --2- 172.21.15.71:0/1914094017 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff28c066f30 0x7ff28c0693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:39.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.686+0000 7ff2a51ff700 1 --2- 172.21.15.71:0/1914094017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2a0069e20 0x7ff2a00aa2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:39.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.686+0000 7ff2a51ff700 1 -- 172.21.15.71:0/1914094017 >> 172.21.15.71:0/1914094017 conn(0x7ff2a00c8f90 msgr2=0x7ff2a0068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:39.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.688+0000 7ff2a51ff700 1 -- 172.21.15.71:0/1914094017 shutdown_connections 2023-10-09T07:57:39.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.689+0000 7ff2a51ff700 1 -- 172.21.15.71:0/1914094017 wait complete. 2023-10-09T07:57:39.691 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' created 2023-10-09T07:57:39.708 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T07:57:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.895+0000 7fdbd83ff700 1 Processor -- start 2023-10-09T07:57:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.895+0000 7fdbd83ff700 1 -- start start 2023-10-09T07:57:39.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.896+0000 7fdbd83ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdbd00cca50 0x7fdbd00caab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:39.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.896+0000 7fdbd83ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdbd015df40 0x7fdbd015e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:39.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.896+0000 7fdbd83ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd0157c50 con 0x7fdbd00cce20 2023-10-09T07:57:39.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.896+0000 7fdbd83ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd015d7d0 con 0x7fdbd015df40 2023-10-09T07:57:39.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.896+0000 7fdbd83ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd015aa20 con 0x7fdbd00cca50 2023-10-09T07:57:39.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.897+0000 7fdbd599a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fdbd00cce20 0x7fdbd015a1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54970/0 (socket says 172.21.15.71:54970) 2023-10-09T07:57:39.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.897+0000 7fdbd599a700 1 -- 172.21.15.71:0/46174328 learned_addr learned my addr 172.21.15.71:0/46174328 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:39.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.897+0000 7fdbd699c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdbd015df40 0x7fdbd015e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:39.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.897+0000 7fdbd619b700 1 --2- 172.21.15.71:0/46174328 >> v2:172.21.15.179:3300/0 conn(0x7fdbd00cca50 0x7fdbd00caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:39.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.897+0000 7fdbd5199700 1 -- 172.21.15.71:0/46174328 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1109410052 0 0) 0x7fdbc0001110 con 0x7fdbd00cce20 2023-10-09T07:57:39.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.897+0000 7fdbd5199700 1 -- 172.21.15.71:0/46174328 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbbc003570 con 0x7fdbd00cce20 2023-10-09T07:57:39.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.897+0000 7fdbd699c700 1 -- 172.21.15.71:0/46174328 >> v2:172.21.15.179:3300/0 conn(0x7fdbd00cca50 msgr2=0x7fdbd00caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:39.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.897+0000 7fdbd699c700 1 --2- 172.21.15.71:0/46174328 >> v2:172.21.15.179:3300/0 conn(0x7fdbd00cca50 0x7fdbd00caab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:39.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.897+0000 7fdbd699c700 1 -- 172.21.15.71:0/46174328 >> v1:172.21.15.71:6789/0 conn(0x7fdbd00cce20 legacy=0x7fdbd015a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:39.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.897+0000 7fdbd699c700 1 -- 172.21.15.71:0/46174328 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd015ad00 con 0x7fdbd015df40 2023-10-09T07:57:39.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.897+0000 7fdbd699c700 1 --2- 172.21.15.71:0/46174328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbd015df40 0x7fdbd015e3c0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fdbd00691a0 tx=0x7fdbc8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b6f6c9b52e2e9b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:39.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.898+0000 7fdbd5199700 1 -- 172.21.15.71:0/46174328 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc800e070 con 0x7fdbd015df40 2023-10-09T07:57:39.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.898+0000 7fdbd5199700 1 -- 172.21.15.71:0/46174328 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc800bab0 con 0x7fdbd015df40 2023-10-09T07:57:39.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.898+0000 7fdbd5199700 1 -- 172.21.15.71:0/46174328 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc800be30 con 0x7fdbd015df40 2023-10-09T07:57:39.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.898+0000 7fdbd83ff700 1 -- 172.21.15.71:0/46174328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbd015df40 msgr2=0x7fdbd015e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:39.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.898+0000 7fdbd83ff700 1 --2- 172.21.15.71:0/46174328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbd015df40 0x7fdbd015e3c0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fdbd00691a0 tx=0x7fdbc8009780 comp rx=0 tx=0).stop 2023-10-09T07:57:39.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.898+0000 7fdbd83ff700 1 -- 172.21.15.71:0/46174328 shutdown_connections 2023-10-09T07:57:39.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.898+0000 7fdbd83ff700 1 --2- 172.21.15.71:0/46174328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbd015df40 0x7fdbd015e3c0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:39.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.898+0000 7fdbd83ff700 1 --2- 172.21.15.71:0/46174328 >> v2:172.21.15.179:3300/0 conn(0x7fdbd00cca50 0x7fdbd00caab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:39.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.898+0000 7fdbd83ff700 1 -- 172.21.15.71:0/46174328 >> 172.21.15.71:0/46174328 conn(0x7fdbd00ce5c0 msgr2=0x7fdbd00ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:39.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.898+0000 7fdbd83ff700 1 -- 172.21.15.71:0/46174328 shutdown_connections 2023-10-09T07:57:39.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.898+0000 7fdbd83ff700 1 -- 172.21.15.71:0/46174328 wait complete. 2023-10-09T07:57:39.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.900+0000 7fdbd83ff700 1 Processor -- start 2023-10-09T07:57:39.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.900+0000 7fdbd83ff700 1 -- start start 2023-10-09T07:57:39.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.901+0000 7fdbd83ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbd00cca50 0x7fdbd0157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:39.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.901+0000 7fdbd83ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbd00cce20 0x7fdbd00b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:39.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.901+0000 7fdbd83ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbd015df40 0x7fdbd0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:39.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.901+0000 7fdbd83ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd0159a30 con 0x7fdbd015df40 2023-10-09T07:57:39.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.901+0000 7fdbd83ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd0158e60 con 0x7fdbd00cca50 2023-10-09T07:57:39.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.901+0000 7fdbd83ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd0159100 con 0x7fdbd00cce20 2023-10-09T07:57:39.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.901+0000 7fdbd699c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbd015df40 0x7fdbd0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:39.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.901+0000 7fdbd699c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbd015df40 0x7fdbd0159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34002/0 (socket says 172.21.15.71:34002) 2023-10-09T07:57:39.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.901+0000 7fdbd699c700 1 -- 172.21.15.71:0/1543532176 learned_addr learned my addr 172.21.15.71:0/1543532176 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:39.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.901+0000 7fdbd619b700 1 --2- 172.21.15.71:0/1543532176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbd00cca50 0x7fdbd0157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:39.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.901+0000 7fdbd599a700 1 --2- 172.21.15.71:0/1543532176 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbd00cce20 0x7fdbd00b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:39.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.901+0000 7fdbd699c700 1 -- 172.21.15.71:0/1543532176 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbd00cce20 msgr2=0x7fdbd00b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:39.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.901+0000 7fdbd699c700 1 --2- 172.21.15.71:0/1543532176 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbd00cce20 0x7fdbd00b2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:39.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.901+0000 7fdbd699c700 1 -- 172.21.15.71:0/1543532176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbd00cca50 msgr2=0x7fdbd0157260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:39.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.901+0000 7fdbd699c700 1 --2- 172.21.15.71:0/1543532176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbd00cca50 0x7fdbd0157260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:39.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.901+0000 7fdbd699c700 1 -- 172.21.15.71:0/1543532176 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc8009a20 con 0x7fdbd015df40 2023-10-09T07:57:39.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.902+0000 7fdbd699c700 1 --2- 172.21.15.71:0/1543532176 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbd015df40 0x7fdbd0159ec0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80099f0 tx=0x7fdbc8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:39.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.902+0000 7fdbc67fc700 1 -- 172.21.15.71:0/1543532176 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8012e60 con 0x7fdbd015df40 2023-10-09T07:57:39.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.902+0000 7fdbc67fc700 1 -- 172.21.15.71:0/1543532176 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc8027470 con 0x7fdbd015df40 2023-10-09T07:57:39.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.902+0000 7fdbd83ff700 1 -- 172.21.15.71:0/1543532176 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd01593e0 con 0x7fdbd015df40 2023-10-09T07:57:39.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.902+0000 7fdbc67fc700 1 -- 172.21.15.71:0/1543532176 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8027810 con 0x7fdbd015df40 2023-10-09T07:57:39.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.902+0000 7fdbd83ff700 1 -- 172.21.15.71:0/1543532176 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd01577a0 con 0x7fdbd015df40 2023-10-09T07:57:39.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.903+0000 7fdbd83ff700 1 -- 172.21.15.71:0/1543532176 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd0157990 con 0x7fdbd015df40 2023-10-09T07:57:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.904+0000 7fdbc67fc700 1 -- 172.21.15.71:0/1543532176 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdbc8024070 con 0x7fdbd015df40 2023-10-09T07:57:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.905+0000 7fdbc67fc700 1 --2- 172.21.15.71:0/1543532176 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdbb4066f30 0x7fdbb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.905+0000 7fdbc67fc700 1 -- 172.21.15.71:0/1543532176 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5687+0+0 (secure 0 0 0) 0x7fdbc8086fe0 con 0x7fdbd015df40 2023-10-09T07:57:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.905+0000 7fdbd619b700 1 --2- 172.21.15.71:0/1543532176 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdbb4066f30 0x7fdbb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.906+0000 7fdbd619b700 1 --2- 172.21.15.71:0/1543532176 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdbb4066f30 0x7fdbb40693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009ca0 tx=0x7fdbcc008040 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:39.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:39.910+0000 7fdbc67fc700 1 -- 172.21.15.71:0/1543532176 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdbc8054200 con 0x7fdbd015df40 2023-10-09T07:57:40.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.107+0000 7fdbd83ff700 1 -- 172.21.15.71:0/1543532176 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdbd00718b0 con 0x7fdbd015df40 2023-10-09T07:57:40.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.689+0000 7fdbc67fc700 1 -- 172.21.15.71:0/1543532176 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v161) v1 ==== 170+0+0 (secure 0 0 0) 0x7fdbc8057820 con 0x7fdbd015df40 2023-10-09T07:57:40.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.708+0000 7fdbd83ff700 1 -- 172.21.15.71:0/1543532176 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdbb4066f30 msgr2=0x7fdbb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:40.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.708+0000 7fdbd83ff700 1 --2- 172.21.15.71:0/1543532176 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdbb4066f30 0x7fdbb40693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009ca0 tx=0x7fdbcc008040 comp rx=0 tx=0).stop 2023-10-09T07:57:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.708+0000 7fdbd83ff700 1 -- 172.21.15.71:0/1543532176 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbd015df40 msgr2=0x7fdbd0159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.708+0000 7fdbd83ff700 1 --2- 172.21.15.71:0/1543532176 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbd015df40 0x7fdbd0159ec0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80099f0 tx=0x7fdbc8019000 comp rx=0 tx=0).stop 2023-10-09T07:57:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.708+0000 7fdbd83ff700 1 -- 172.21.15.71:0/1543532176 shutdown_connections 2023-10-09T07:57:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.708+0000 7fdbd83ff700 1 --2- 172.21.15.71:0/1543532176 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbd015df40 0x7fdbd0159ec0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.708+0000 7fdbd83ff700 1 --2- 172.21.15.71:0/1543532176 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdbb4066f30 0x7fdbb40693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.708+0000 7fdbd83ff700 1 --2- 172.21.15.71:0/1543532176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbd00cca50 0x7fdbd0157260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.708+0000 7fdbd83ff700 1 --2- 172.21.15.71:0/1543532176 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbd00cce20 0x7fdbd00b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.708+0000 7fdbd83ff700 1 -- 172.21.15.71:0/1543532176 >> 172.21.15.71:0/1543532176 conn(0x7fdbd00ce5c0 msgr2=0x7fdbd00cb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.709+0000 7fdbd83ff700 1 -- 172.21.15.71:0/1543532176 shutdown_connections 2023-10-09T07:57:40.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.709+0000 7fdbd83ff700 1 -- 172.21.15.71:0/1543532176 wait complete. 2023-10-09T07:57:40.712 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' created 2023-10-09T07:57:40.729 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T07:57:40.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.911+0000 7fd66ffff700 1 Processor -- start 2023-10-09T07:57:40.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.911+0000 7fd66ffff700 1 -- start start 2023-10-09T07:57:40.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.912+0000 7fd66ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd6700b4e70 0x7fd6700ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:40.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.912+0000 7fd66ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6700b16d0 0x7fd6700b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:40.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.912+0000 7fd66ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd67015d240 0x7fd67015d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:40.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.912+0000 7fd66ffff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6700b2080 con 0x7fd6700b4e70 2023-10-09T07:57:40.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.912+0000 7fd66ffff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6700cfb00 con 0x7fd67015d240 2023-10-09T07:57:40.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.912+0000 7fd66ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6700b5c40 con 0x7fd6700b16d0 2023-10-09T07:57:40.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.912+0000 7fd66effd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd6700b4e70 0x7fd6700ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:40.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.913+0000 7fd66effd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd6700b4e70 0x7fd6700ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34016/0 (socket says 172.21.15.71:34016) 2023-10-09T07:57:40.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.913+0000 7fd66effd700 1 -- 172.21.15.71:0/2218612204 learned_addr learned my addr 172.21.15.71:0/2218612204 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:40.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.913+0000 7fd66f7fe700 1 --2- 172.21.15.71:0/2218612204 >> v2:172.21.15.179:3300/0 conn(0x7fd67015d240 0x7fd67015d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:40.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.913+0000 7fd66e7fc700 1 --2- 172.21.15.71:0/2218612204 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6700b16d0 0x7fd6700b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:40.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.913+0000 7fd66effd700 1 -- 172.21.15.71:0/2218612204 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6700b16d0 msgr2=0x7fd6700b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:40.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.913+0000 7fd66effd700 1 --2- 172.21.15.71:0/2218612204 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6700b16d0 0x7fd6700b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:40.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.913+0000 7fd66effd700 1 -- 172.21.15.71:0/2218612204 >> v2:172.21.15.179:3300/0 conn(0x7fd67015d240 msgr2=0x7fd67015d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:40.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.913+0000 7fd66effd700 1 --2- 172.21.15.71:0/2218612204 >> v2:172.21.15.179:3300/0 conn(0x7fd67015d240 0x7fd67015d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:40.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.913+0000 7fd66effd700 1 -- 172.21.15.71:0/2218612204 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6700b5f20 con 0x7fd6700b4e70 2023-10-09T07:57:40.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.913+0000 7fd66f7fe700 1 --2- 172.21.15.71:0/2218612204 >> v2:172.21.15.179:3300/0 conn(0x7fd67015d240 0x7fd67015d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:57:40.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.913+0000 7fd66effd700 1 --2- 172.21.15.71:0/2218612204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6700b4e70 0x7fd6700ccff0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fd67015d180 tx=0x7fd660009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0214227eea3613 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:40.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.913+0000 7fd66dffb700 1 -- 172.21.15.71:0/2218612204 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66000b860 con 0x7fd6700b4e70 2023-10-09T07:57:40.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.914+0000 7fd66dffb700 1 -- 172.21.15.71:0/2218612204 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66000b9c0 con 0x7fd6700b4e70 2023-10-09T07:57:40.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.914+0000 7fd66dffb700 1 -- 172.21.15.71:0/2218612204 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66000bd60 con 0x7fd6700b4e70 2023-10-09T07:57:40.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.914+0000 7fd66ffff700 1 -- 172.21.15.71:0/2218612204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6700b4e70 msgr2=0x7fd6700ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:40.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.914+0000 7fd66ffff700 1 --2- 172.21.15.71:0/2218612204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6700b4e70 0x7fd6700ccff0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fd67015d180 tx=0x7fd660009250 comp rx=0 tx=0).stop 2023-10-09T07:57:40.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.914+0000 7fd66ffff700 1 -- 172.21.15.71:0/2218612204 shutdown_connections 2023-10-09T07:57:40.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.914+0000 7fd66ffff700 1 --2- 172.21.15.71:0/2218612204 >> v2:172.21.15.179:3300/0 conn(0x7fd67015d240 0x7fd67015d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:40.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.914+0000 7fd66ffff700 1 --2- 172.21.15.71:0/2218612204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6700b4e70 0x7fd6700ccff0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:40.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.914+0000 7fd66ffff700 1 --2- 172.21.15.71:0/2218612204 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6700b16d0 0x7fd6700b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:40.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.914+0000 7fd66ffff700 1 -- 172.21.15.71:0/2218612204 >> 172.21.15.71:0/2218612204 conn(0x7fd6700d10c0 msgr2=0x7fd6700affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:40.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.914+0000 7fd66ffff700 1 -- 172.21.15.71:0/2218612204 shutdown_connections 2023-10-09T07:57:40.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.914+0000 7fd66ffff700 1 -- 172.21.15.71:0/2218612204 wait complete. 2023-10-09T07:57:40.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.916+0000 7fd66ffff700 1 Processor -- start 2023-10-09T07:57:40.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.916+0000 7fd66ffff700 1 -- start start 2023-10-09T07:57:40.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.916+0000 7fd66ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6700b16d0 0x7fd670149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:40.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.916+0000 7fd66ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6700b4e70 0x7fd67015c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:40.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.917+0000 7fd66ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd67015d240 0x7fd67015cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:40.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.917+0000 7fd66ffff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd670160550 con 0x7fd6700b4e70 2023-10-09T07:57:40.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.917+0000 7fd66ffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67015f790 con 0x7fd67015d240 2023-10-09T07:57:40.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.917+0000 7fd66ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67015fa70 con 0x7fd6700b16d0 2023-10-09T07:57:40.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.917+0000 7fd66e7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6700b4e70 0x7fd67015c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:40.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.917+0000 7fd66e7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6700b4e70 0x7fd67015c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34030/0 (socket says 172.21.15.71:34030) 2023-10-09T07:57:40.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.917+0000 7fd66e7fc700 1 -- 172.21.15.71:0/1970518632 learned_addr learned my addr 172.21.15.71:0/1970518632 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:40.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.917+0000 7fd66e7fc700 1 -- 172.21.15.71:0/1970518632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6700b16d0 msgr2=0x7fd670149110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:40.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.917+0000 7fd66effd700 1 --2- 172.21.15.71:0/1970518632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6700b16d0 0x7fd670149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:40.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.917+0000 7fd66e7fc700 1 --2- 172.21.15.71:0/1970518632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6700b16d0 0x7fd670149110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:40.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.917+0000 7fd66e7fc700 1 -- 172.21.15.71:0/1970518632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd67015d240 msgr2=0x7fd67015cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:40.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.917+0000 7fd66e7fc700 1 --2- 172.21.15.71:0/1970518632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd67015d240 0x7fd67015cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:40.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.917+0000 7fd66e7fc700 1 -- 172.21.15.71:0/1970518632 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6600094f0 con 0x7fd6700b4e70 2023-10-09T07:57:40.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.917+0000 7fd66effd700 1 --2- 172.21.15.71:0/1970518632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6700b16d0 0x7fd670149110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:57:40.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.917+0000 7fd66e7fc700 1 --2- 172.21.15.71:0/1970518632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6700b4e70 0x7fd67015c610 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fd66400d890 tx=0x7fd664008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:40.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.918+0000 7fd656ffd700 1 -- 172.21.15.71:0/1970518632 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66400b600 con 0x7fd6700b4e70 2023-10-09T07:57:40.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.918+0000 7fd656ffd700 1 -- 172.21.15.71:0/1970518632 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66400b760 con 0x7fd6700b4e70 2023-10-09T07:57:40.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.918+0000 7fd66ffff700 1 -- 172.21.15.71:0/1970518632 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67015fd50 con 0x7fd6700b4e70 2023-10-09T07:57:40.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.918+0000 7fd656ffd700 1 -- 172.21.15.71:0/1970518632 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66400bae0 con 0x7fd6700b4e70 2023-10-09T07:57:40.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.918+0000 7fd66ffff700 1 -- 172.21.15.71:0/1970518632 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd670149650 con 0x7fd6700b4e70 2023-10-09T07:57:40.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.919+0000 7fd66ffff700 1 -- 172.21.15.71:0/1970518632 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6701601f0 con 0x7fd6700b4e70 2023-10-09T07:57:40.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.920+0000 7fd656ffd700 1 -- 172.21.15.71:0/1970518632 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd66401e460 con 0x7fd6700b4e70 2023-10-09T07:57:40.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.921+0000 7fd656ffd700 1 --2- 172.21.15.71:0/1970518632 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd65c066f30 0x7fd65c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:40.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.921+0000 7fd656ffd700 1 -- 172.21.15.71:0/1970518632 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd664085910 con 0x7fd6700b4e70 2023-10-09T07:57:40.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.921+0000 7fd66effd700 1 --2- 172.21.15.71:0/1970518632 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd65c066f30 0x7fd65c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:40.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.922+0000 7fd66effd700 1 --2- 172.21.15.71:0/1970518632 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd65c066f30 0x7fd65c0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd67015d180 tx=0x7fd660017000 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:40.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:40.925+0000 7fd656ffd700 1 -- 172.21.15.71:0/1970518632 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6640529f0 con 0x7fd6700b4e70 2023-10-09T07:57:41.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.157+0000 7fd66ffff700 1 -- 172.21.15.71:0/1970518632 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd6700cc860 con 0x7fd6700b4e70 2023-10-09T07:57:41.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.704+0000 7fd656ffd700 1 -- 172.21.15.71:0/1970518632 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v70) v1 ==== 174+0+0 (secure 0 0 0) 0x7fd664056010 con 0x7fd6700b4e70 2023-10-09T07:57:41.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.709+0000 7fd66ffff700 1 -- 172.21.15.71:0/1970518632 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd65c066f30 msgr2=0x7fd65c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:41.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.710+0000 7fd66ffff700 1 --2- 172.21.15.71:0/1970518632 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd65c066f30 0x7fd65c0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd67015d180 tx=0x7fd660017000 comp rx=0 tx=0).stop 2023-10-09T07:57:41.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.710+0000 7fd66ffff700 1 -- 172.21.15.71:0/1970518632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6700b4e70 msgr2=0x7fd67015c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:41.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.710+0000 7fd66ffff700 1 --2- 172.21.15.71:0/1970518632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6700b4e70 0x7fd67015c610 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fd66400d890 tx=0x7fd664008040 comp rx=0 tx=0).stop 2023-10-09T07:57:41.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.711+0000 7fd66ffff700 1 -- 172.21.15.71:0/1970518632 shutdown_connections 2023-10-09T07:57:41.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.711+0000 7fd66ffff700 1 --2- 172.21.15.71:0/1970518632 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd65c066f30 0x7fd65c0693e0 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd67015d180 tx=0x7fd660017000 comp rx=0 tx=0).stop 2023-10-09T07:57:41.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.711+0000 7fd66ffff700 1 --2- 172.21.15.71:0/1970518632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd67015d240 0x7fd67015cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:41.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.711+0000 7fd66ffff700 1 --2- 172.21.15.71:0/1970518632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6700b16d0 0x7fd670149110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:41.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.711+0000 7fd66ffff700 1 --2- 172.21.15.71:0/1970518632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6700b4e70 0x7fd67015c610 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:41.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.711+0000 7fd66ffff700 1 -- 172.21.15.71:0/1970518632 >> 172.21.15.71:0/1970518632 conn(0x7fd6700d10c0 msgr2=0x7fd6701590d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:41.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.713+0000 7fd66ffff700 1 -- 172.21.15.71:0/1970518632 shutdown_connections 2023-10-09T07:57:41.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.713+0000 7fd66ffff700 1 -- 172.21.15.71:0/1970518632 wait complete. 2023-10-09T07:57:41.718 INFO:teuthology.orchestra.run.smithi071.stderr:new fs with metadata pool 18 and data pool 19 2023-10-09T07:57:41.743 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:57:41.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.923+0000 7efed3fff700 1 Processor -- start 2023-10-09T07:57:41.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.923+0000 7efed3fff700 1 -- start start 2023-10-09T07:57:41.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.924+0000 7efed3fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efecc159720 0x7efecc159af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:41.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.925+0000 7efed3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efecc0ab4e0 0x7efecc0a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:41.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.925+0000 7efed3fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efecc0ab950 con 0x7efecc0a9e10 2023-10-09T07:57:41.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.925+0000 7efed3fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efecc0ac020 con 0x7efecc159720 2023-10-09T07:57:41.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.925+0000 7efed3fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efecc0aa440 con 0x7efecc0ab4e0 2023-10-09T07:57:41.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.925+0000 7efed159a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efecc0ab4e0 0x7efecc0a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:41.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.925+0000 7efed159a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efecc0ab4e0 0x7efecc0a98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:44960/0 (socket says 172.21.15.71:44960) 2023-10-09T07:57:41.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.925+0000 7efed159a700 1 -- 172.21.15.71:0/641909048 learned_addr learned my addr 172.21.15.71:0/641909048 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:41.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.925+0000 7efed1d9b700 1 --2- 172.21.15.71:0/641909048 >> v2:172.21.15.179:3300/0 conn(0x7efecc159720 0x7efecc159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:41.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.926+0000 7efed159a700 1 -- 172.21.15.71:0/641909048 >> v2:172.21.15.179:3300/0 conn(0x7efecc159720 msgr2=0x7efecc159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:41.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.926+0000 7efed159a700 1 --2- 172.21.15.71:0/641909048 >> v2:172.21.15.179:3300/0 conn(0x7efecc159720 0x7efecc159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:41.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.926+0000 7efed159a700 1 -- 172.21.15.71:0/641909048 >> v1:172.21.15.179:6789/0 conn(0x7efecc0a9e10 legacy=0x7efecc0ad250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:41.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.926+0000 7efed159a700 1 -- 172.21.15.71:0/641909048 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc0aa720 con 0x7efecc0ab4e0 2023-10-09T07:57:41.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.926+0000 7efed159a700 1 --2- 172.21.15.71:0/641909048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efecc0ab4e0 0x7efecc0a98d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efebc0099b0 tx=0x7efebc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c680e61ed7077c6b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:41.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.926+0000 7efed0d99700 1 -- 172.21.15.71:0/641909048 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc009ea0 con 0x7efecc0ab4e0 2023-10-09T07:57:41.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.926+0000 7efed0d99700 1 -- 172.21.15.71:0/641909048 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc00b860 con 0x7efecc0ab4e0 2023-10-09T07:57:41.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.926+0000 7efed0d99700 1 -- 172.21.15.71:0/641909048 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc00bc00 con 0x7efecc0ab4e0 2023-10-09T07:57:41.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.927+0000 7efed3fff700 1 -- 172.21.15.71:0/641909048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efecc0ab4e0 msgr2=0x7efecc0a98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:41.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.927+0000 7efed3fff700 1 --2- 172.21.15.71:0/641909048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efecc0ab4e0 0x7efecc0a98d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efebc0099b0 tx=0x7efebc009250 comp rx=0 tx=0).stop 2023-10-09T07:57:41.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.927+0000 7efed3fff700 1 -- 172.21.15.71:0/641909048 shutdown_connections 2023-10-09T07:57:41.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.927+0000 7efed3fff700 1 --2- 172.21.15.71:0/641909048 >> v2:172.21.15.179:3300/0 conn(0x7efecc159720 0x7efecc159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:41.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.927+0000 7efed3fff700 1 --2- 172.21.15.71:0/641909048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efecc0ab4e0 0x7efecc0a98d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:41.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.927+0000 7efed3fff700 1 -- 172.21.15.71:0/641909048 >> 172.21.15.71:0/641909048 conn(0x7efecc06a320 msgr2=0x7efecc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:41.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.927+0000 7efed3fff700 1 -- 172.21.15.71:0/641909048 shutdown_connections 2023-10-09T07:57:41.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.927+0000 7efed3fff700 1 -- 172.21.15.71:0/641909048 wait complete. 2023-10-09T07:57:41.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.928+0000 7efed3fff700 1 Processor -- start 2023-10-09T07:57:41.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.928+0000 7efed3fff700 1 -- start start 2023-10-09T07:57:41.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.929+0000 7efed3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efecc0a9e10 0x7efecc1446f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:41.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.929+0000 7efed3fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efecc0ab4e0 0x7efecc14d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:41.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.929+0000 7efed3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efecc159720 0x7efecc14d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:41.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.929+0000 7efed3fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc151b00 con 0x7efecc159720 2023-10-09T07:57:41.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.929+0000 7efed3fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc150ef0 con 0x7efecc0ab4e0 2023-10-09T07:57:41.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.929+0000 7efed3fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efecc1511d0 con 0x7efecc0a9e10 2023-10-09T07:57:41.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.930+0000 7efed259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efecc159720 0x7efecc14d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:41.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.930+0000 7efed259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efecc159720 0x7efecc14d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34040/0 (socket says 172.21.15.71:34040) 2023-10-09T07:57:41.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.930+0000 7efed259c700 1 -- 172.21.15.71:0/3125603489 learned_addr learned my addr 172.21.15.71:0/3125603489 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:41.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.930+0000 7efed1d9b700 1 --2- 172.21.15.71:0/3125603489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efecc0a9e10 0x7efecc1446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:41.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.930+0000 7efed159a700 1 --2- 172.21.15.71:0/3125603489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efecc0ab4e0 0x7efecc14d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:41.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.930+0000 7efed259c700 1 -- 172.21.15.71:0/3125603489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efecc0a9e10 msgr2=0x7efecc1446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:41.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.930+0000 7efed259c700 1 --2- 172.21.15.71:0/3125603489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efecc0a9e10 0x7efecc1446f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:41.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.930+0000 7efed259c700 1 -- 172.21.15.71:0/3125603489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efecc0ab4e0 msgr2=0x7efecc14d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:41.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.930+0000 7efed259c700 1 --2- 172.21.15.71:0/3125603489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efecc0ab4e0 0x7efecc14d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:41.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.930+0000 7efed259c700 1 -- 172.21.15.71:0/3125603489 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc0094f0 con 0x7efecc159720 2023-10-09T07:57:41.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.930+0000 7efed259c700 1 --2- 172.21.15.71:0/3125603489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efecc159720 0x7efecc14d700 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7efec400c8e0 tx=0x7efec4001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:41.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.930+0000 7efec1ffb700 1 -- 172.21.15.71:0/3125603489 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec4012630 con 0x7efecc159720 2023-10-09T07:57:41.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.931+0000 7efec1ffb700 1 -- 172.21.15.71:0/3125603489 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec4012790 con 0x7efecc159720 2023-10-09T07:57:41.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.931+0000 7efed3fff700 1 -- 172.21.15.71:0/3125603489 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efecc1514b0 con 0x7efecc159720 2023-10-09T07:57:41.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.931+0000 7efec1ffb700 1 -- 172.21.15.71:0/3125603489 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec4012b50 con 0x7efecc159720 2023-10-09T07:57:41.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.931+0000 7efed3fff700 1 -- 172.21.15.71:0/3125603489 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efecc150bc0 con 0x7efecc159720 2023-10-09T07:57:41.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.932+0000 7efed3fff700 1 -- 172.21.15.71:0/3125603489 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efecc04c3c0 con 0x7efecc159720 2023-10-09T07:57:41.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.932+0000 7efec1ffb700 1 -- 172.21.15.71:0/3125603489 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efec401a3a0 con 0x7efecc159720 2023-10-09T07:57:41.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.933+0000 7efec1ffb700 1 --2- 172.21.15.71:0/3125603489 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efeb0066f30 0x7efeb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:41.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.933+0000 7efec1ffb700 1 -- 172.21.15.71:0/3125603489 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6169+0+0 (secure 0 0 0) 0x7efec40849b0 con 0x7efecc159720 2023-10-09T07:57:41.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.934+0000 7efed1d9b700 1 --2- 172.21.15.71:0/3125603489 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efeb0066f30 0x7efeb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:41.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.934+0000 7efed1d9b700 1 --2- 172.21.15.71:0/3125603489 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efeb0066f30 0x7efeb00693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efec8009d10 tx=0x7efec80091a0 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:41.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:41.937+0000 7efec1ffb700 1 -- 172.21.15.71:0/3125603489 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efec40519b0 con 0x7efecc159720 2023-10-09T07:57:42.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.128+0000 7efed3fff700 1 -- 172.21.15.71:0/3125603489 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efecc151c40 con 0x7efecc159720 2023-10-09T07:57:42.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.129+0000 7efec1ffb700 1 -- 172.21.15.71:0/3125603489 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+16087 (secure 0 0 0) 0x7efec4054fd0 con 0x7efecc159720 2023-10-09T07:57:42.130 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:57:42.130 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":162,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:57:41.159099+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:57:39.262671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T07:57:40.149000+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:57:42.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.132+0000 7efed3fff700 1 -- 172.21.15.71:0/3125603489 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efeb0066f30 msgr2=0x7efeb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:42.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.132+0000 7efed3fff700 1 --2- 172.21.15.71:0/3125603489 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efeb0066f30 0x7efeb00693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efec8009d10 tx=0x7efec80091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:42.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.132+0000 7efed3fff700 1 -- 172.21.15.71:0/3125603489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efecc159720 msgr2=0x7efecc14d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:42.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.132+0000 7efed3fff700 1 --2- 172.21.15.71:0/3125603489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efecc159720 0x7efecc14d700 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7efec400c8e0 tx=0x7efec4001710 comp rx=0 tx=0).stop 2023-10-09T07:57:42.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.132+0000 7efed3fff700 1 -- 172.21.15.71:0/3125603489 shutdown_connections 2023-10-09T07:57:42.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.132+0000 7efed3fff700 1 --2- 172.21.15.71:0/3125603489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efecc159720 0x7efecc14d700 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:42.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.132+0000 7efed3fff700 1 --2- 172.21.15.71:0/3125603489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efecc0a9e10 0x7efecc1446f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:42.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.132+0000 7efed3fff700 1 --2- 172.21.15.71:0/3125603489 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7efeb0066f30 0x7efeb00693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:42.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.132+0000 7efed3fff700 1 --2- 172.21.15.71:0/3125603489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efecc0ab4e0 0x7efecc14d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:42.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.132+0000 7efed3fff700 1 -- 172.21.15.71:0/3125603489 >> 172.21.15.71:0/3125603489 conn(0x7efecc06a320 msgr2=0x7efecc158120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:42.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.132+0000 7efed3fff700 1 -- 172.21.15.71:0/3125603489 shutdown_connections 2023-10-09T07:57:42.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.132+0000 7efed3fff700 1 -- 172.21.15.71:0/3125603489 wait complete. 2023-10-09T07:57:42.151 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:57:42.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.331+0000 7f79785ff700 1 Processor -- start 2023-10-09T07:57:42.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.331+0000 7f79785ff700 1 -- start start 2023-10-09T07:57:42.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.332+0000 7f79785ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79700cbf30 0x7f79700ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:42.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.332+0000 7f79785ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f79700b1420 0x7f79700c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:42.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.332+0000 7f79785ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79700cc300 con 0x7f79700ccf90 2023-10-09T07:57:42.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.333+0000 7f79785ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7970156bf0 con 0x7f79700b1420 2023-10-09T07:57:42.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.333+0000 7f79785ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79700ae950 con 0x7f79700cbf30 2023-10-09T07:57:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.333+0000 7f797639b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79700cbf30 0x7f79700ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.333+0000 7f7976b9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f79700b1420 0x7f79700c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.333+0000 7f7975b9a700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f79700ccf90 0x7f79700b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:35506/0 (socket says 172.21.15.71:35506) 2023-10-09T07:57:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.333+0000 7f7975b9a700 1 -- 172.21.15.71:0/2833701826 learned_addr learned my addr 172.21.15.71:0/2833701826 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.333+0000 7f7975399700 1 -- 172.21.15.71:0/2833701826 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914175634 0 0) 0x7f79700cc300 con 0x7f79700ccf90 2023-10-09T07:57:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.334+0000 7f7975399700 1 -- 172.21.15.71:0/2833701826 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f795c003570 con 0x7f79700ccf90 2023-10-09T07:57:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.334+0000 7f7976b9c700 1 -- 172.21.15.71:0/2833701826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79700cbf30 msgr2=0x7f79700ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.334+0000 7f7976b9c700 1 --2- 172.21.15.71:0/2833701826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79700cbf30 0x7f79700ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.334+0000 7f7976b9c700 1 -- 172.21.15.71:0/2833701826 >> v1:172.21.15.179:6789/0 conn(0x7f79700ccf90 legacy=0x7f79700b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.334+0000 7f7976b9c700 1 -- 172.21.15.71:0/2833701826 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79700ad370 con 0x7f79700b1420 2023-10-09T07:57:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.334+0000 7f7976b9c700 1 --2- 172.21.15.71:0/2833701826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79700b1420 0x7f79700c9740 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7968009e90 tx=0x7f7968009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=757debcc66118f60 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.334+0000 7f7975399700 1 -- 172.21.15.71:0/2833701826 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796800e070 con 0x7f79700b1420 2023-10-09T07:57:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.334+0000 7f7975399700 1 -- 172.21.15.71:0/2833701826 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796800bb40 con 0x7f79700b1420 2023-10-09T07:57:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.334+0000 7f7975399700 1 -- 172.21.15.71:0/2833701826 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7968012430 con 0x7f79700b1420 2023-10-09T07:57:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.335+0000 7f79785ff700 1 -- 172.21.15.71:0/2833701826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79700b1420 msgr2=0x7f79700c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.335+0000 7f79785ff700 1 --2- 172.21.15.71:0/2833701826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79700b1420 0x7f79700c9740 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7968009e90 tx=0x7f7968009780 comp rx=0 tx=0).stop 2023-10-09T07:57:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.335+0000 7f79785ff700 1 -- 172.21.15.71:0/2833701826 shutdown_connections 2023-10-09T07:57:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.335+0000 7f79785ff700 1 --2- 172.21.15.71:0/2833701826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79700b1420 0x7f79700c9740 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.335+0000 7f79785ff700 1 --2- 172.21.15.71:0/2833701826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79700cbf30 0x7f79700ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.335+0000 7f79785ff700 1 -- 172.21.15.71:0/2833701826 >> 172.21.15.71:0/2833701826 conn(0x7f797006a320 msgr2=0x7f79700cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:42.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.335+0000 7f79785ff700 1 -- 172.21.15.71:0/2833701826 shutdown_connections 2023-10-09T07:57:42.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.335+0000 7f79785ff700 1 -- 172.21.15.71:0/2833701826 wait complete. 2023-10-09T07:57:42.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.336+0000 7f79785ff700 1 Processor -- start 2023-10-09T07:57:42.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.336+0000 7f79785ff700 1 -- start start 2023-10-09T07:57:42.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.337+0000 7f79785ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79700b1420 0x7f797016cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:42.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.337+0000 7f79785ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79700cbf30 0x7f79700c15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:42.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.337+0000 7f79785ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79700ccf90 0x7f79700c1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:42.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.337+0000 7f79785ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79701570e0 con 0x7f79700b1420 2023-10-09T07:57:42.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.337+0000 7f79785ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79700ab490 con 0x7f79700cbf30 2023-10-09T07:57:42.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.337+0000 7f79785ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797016d0e0 con 0x7f79700ccf90 2023-10-09T07:57:42.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.338+0000 7f797639b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79700b1420 0x7f797016cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:42.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.338+0000 7f797639b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79700b1420 0x7f797016cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34056/0 (socket says 172.21.15.71:34056) 2023-10-09T07:57:42.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.338+0000 7f797639b700 1 -- 172.21.15.71:0/2040424573 learned_addr learned my addr 172.21.15.71:0/2040424573 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.338+0000 7f7976b9c700 1 --2- 172.21.15.71:0/2040424573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79700ccf90 0x7f79700c1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.338+0000 7f7975b9a700 1 --2- 172.21.15.71:0/2040424573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79700cbf30 0x7f79700c15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.338+0000 7f797639b700 1 -- 172.21.15.71:0/2040424573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79700ccf90 msgr2=0x7f79700c1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.338+0000 7f797639b700 1 --2- 172.21.15.71:0/2040424573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79700ccf90 0x7f79700c1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.338+0000 7f797639b700 1 -- 172.21.15.71:0/2040424573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79700cbf30 msgr2=0x7f79700c15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.338+0000 7f797639b700 1 --2- 172.21.15.71:0/2040424573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79700cbf30 0x7f79700c15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.338+0000 7f797639b700 1 -- 172.21.15.71:0/2040424573 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7968009a20 con 0x7f79700b1420 2023-10-09T07:57:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.338+0000 7f797639b700 1 --2- 172.21.15.71:0/2040424573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79700b1420 0x7f797016cba0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f796c00ecb0 tx=0x7f796c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.339+0000 7f79667fc700 1 -- 172.21.15.71:0/2040424573 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c00c850 con 0x7f79700b1420 2023-10-09T07:57:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.339+0000 7f79667fc700 1 -- 172.21.15.71:0/2040424573 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c00c9b0 con 0x7f79700b1420 2023-10-09T07:57:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.339+0000 7f79785ff700 1 -- 172.21.15.71:0/2040424573 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79700aa8a0 con 0x7f79700b1420 2023-10-09T07:57:42.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.339+0000 7f79667fc700 1 -- 172.21.15.71:0/2040424573 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c00cd50 con 0x7f79700b1420 2023-10-09T07:57:42.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.339+0000 7f79785ff700 1 -- 172.21.15.71:0/2040424573 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79700aae40 con 0x7f79700b1420 2023-10-09T07:57:42.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.340+0000 7f79785ff700 1 -- 172.21.15.71:0/2040424573 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79700ab770 con 0x7f79700b1420 2023-10-09T07:57:42.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.341+0000 7f79667fc700 1 -- 172.21.15.71:0/2040424573 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f796c013680 con 0x7f79700b1420 2023-10-09T07:57:42.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.341+0000 7f79667fc700 1 --2- 172.21.15.71:0/2040424573 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7954066f30 0x7f79540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:42.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.341+0000 7f79667fc700 1 -- 172.21.15.71:0/2040424573 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f796c084960 con 0x7f79700b1420 2023-10-09T07:57:42.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.342+0000 7f7975b9a700 1 --2- 172.21.15.71:0/2040424573 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7954066f30 0x7f79540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:42.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.342+0000 7f7975b9a700 1 --2- 172.21.15.71:0/2040424573 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7954066f30 0x7f79540693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f79700c1560 tx=0x7f7960009040 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:42.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.345+0000 7f79667fc700 1 -- 172.21.15.71:0/2040424573 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f796c051a00 con 0x7f79700b1420 2023-10-09T07:57:42.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.538+0000 7f79785ff700 1 -- 172.21.15.71:0/2040424573 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f797006bb90 con 0x7f79700b1420 2023-10-09T07:57:42.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.539+0000 7f79667fc700 1 -- 172.21.15.71:0/2040424573 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+16087 (secure 0 0 0) 0x7f796c055020 con 0x7f79700b1420 2023-10-09T07:57:42.540 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:57:42.541 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":162,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:57:41.159099+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:57:39.262671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T07:57:40.149000+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:57:42.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.542+0000 7f79785ff700 1 -- 172.21.15.71:0/2040424573 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7954066f30 msgr2=0x7f79540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:42.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.542+0000 7f79785ff700 1 --2- 172.21.15.71:0/2040424573 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7954066f30 0x7f79540693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f79700c1560 tx=0x7f7960009040 comp rx=0 tx=0).stop 2023-10-09T07:57:42.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.542+0000 7f79785ff700 1 -- 172.21.15.71:0/2040424573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79700b1420 msgr2=0x7f797016cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:42.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.542+0000 7f79785ff700 1 --2- 172.21.15.71:0/2040424573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79700b1420 0x7f797016cba0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f796c00ecb0 tx=0x7f796c0091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:42.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.542+0000 7f79785ff700 1 -- 172.21.15.71:0/2040424573 shutdown_connections 2023-10-09T07:57:42.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.542+0000 7f79785ff700 1 --2- 172.21.15.71:0/2040424573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79700ccf90 0x7f79700c1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:42.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.542+0000 7f79785ff700 1 --2- 172.21.15.71:0/2040424573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79700b1420 0x7f797016cba0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:42.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.542+0000 7f79785ff700 1 --2- 172.21.15.71:0/2040424573 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7954066f30 0x7f79540693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:42.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.542+0000 7f79785ff700 1 --2- 172.21.15.71:0/2040424573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79700cbf30 0x7f79700c15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:42.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.542+0000 7f79785ff700 1 -- 172.21.15.71:0/2040424573 >> 172.21.15.71:0/2040424573 conn(0x7f797006a320 msgr2=0x7f797006e240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:42.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.542+0000 7f79785ff700 1 -- 172.21.15.71:0/2040424573 shutdown_connections 2023-10-09T07:57:42.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.542+0000 7f79785ff700 1 -- 172.21.15.71:0/2040424573 wait complete. 2023-10-09T07:57:42.561 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T07:57:42.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.747+0000 7f0dfb59e700 1 Processor -- start 2023-10-09T07:57:42.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.747+0000 7f0dfb59e700 1 -- start start 2023-10-09T07:57:42.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.748+0000 7f0dfb59e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0dfc0b16d0 0x7f0dfc0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:42.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.748+0000 7f0dfb59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0dfc0b33b0 0x7f0dfc0b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:42.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.748+0000 7f0dfb59e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dfc0b2080 con 0x7f0dfc0b4e70 2023-10-09T07:57:42.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.748+0000 7f0dfb59e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dfc0cfb00 con 0x7f0dfc0b16d0 2023-10-09T07:57:42.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.748+0000 7f0dfb59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dfc0b5c40 con 0x7f0dfc0b33b0 2023-10-09T07:57:42.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.748+0000 7f0df9d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0dfc0b16d0 0x7f0dfc0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:42.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.748+0000 7f0dfa59c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f0dfc0b4e70 0x7f0dfc0ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54986/0 (socket says 172.21.15.71:54986) 2023-10-09T07:57:42.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.748+0000 7f0dfa59c700 1 -- 172.21.15.71:0/1320164901 learned_addr learned my addr 172.21.15.71:0/1320164901 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:42.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.748+0000 7f0dfad9d700 1 --2- 172.21.15.71:0/1320164901 >> v2:172.21.15.179:3300/0 conn(0x7f0dfc0b33b0 0x7f0dfc0b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:42.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.749+0000 7f0df9d9b700 1 -- 172.21.15.71:0/1320164901 >> v2:172.21.15.179:3300/0 conn(0x7f0dfc0b33b0 msgr2=0x7f0dfc0b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:42.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.749+0000 7f0df959a700 1 -- 172.21.15.71:0/1320164901 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410301162 0 0) 0x7f0dfc0b2080 con 0x7f0dfc0b4e70 2023-10-09T07:57:42.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.749+0000 7f0df9d9b700 1 --2- 172.21.15.71:0/1320164901 >> v2:172.21.15.179:3300/0 conn(0x7f0dfc0b33b0 0x7f0dfc0b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:42.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.749+0000 7f0df9d9b700 1 -- 172.21.15.71:0/1320164901 >> v1:172.21.15.71:6789/0 conn(0x7f0dfc0b4e70 legacy=0x7f0dfc0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:42.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.749+0000 7f0df9d9b700 1 -- 172.21.15.71:0/1320164901 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc0b5f20 con 0x7f0dfc0b16d0 2023-10-09T07:57:42.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.749+0000 7f0df9d9b700 1 --2- 172.21.15.71:0/1320164901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dfc0b16d0 0x7f0dfc0b1b40 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc071380 tx=0x7f0df00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2cd47ebbb2752d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:42.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.749+0000 7f0df959a700 1 -- 172.21.15.71:0/1320164901 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df000b6b0 con 0x7f0dfc0b16d0 2023-10-09T07:57:42.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.749+0000 7f0df959a700 1 -- 172.21.15.71:0/1320164901 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df000b810 con 0x7f0dfc0b16d0 2023-10-09T07:57:42.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.749+0000 7f0df959a700 1 -- 172.21.15.71:0/1320164901 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df000bbb0 con 0x7f0dfc0b16d0 2023-10-09T07:57:42.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.750+0000 7f0dfb59e700 1 -- 172.21.15.71:0/1320164901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dfc0b16d0 msgr2=0x7f0dfc0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:42.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.750+0000 7f0dfb59e700 1 --2- 172.21.15.71:0/1320164901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dfc0b16d0 0x7f0dfc0b1b40 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc071380 tx=0x7f0df00091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:42.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.750+0000 7f0dfb59e700 1 -- 172.21.15.71:0/1320164901 shutdown_connections 2023-10-09T07:57:42.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.750+0000 7f0dfb59e700 1 --2- 172.21.15.71:0/1320164901 >> v2:172.21.15.179:3300/0 conn(0x7f0dfc0b33b0 0x7f0dfc0b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:42.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.750+0000 7f0dfb59e700 1 --2- 172.21.15.71:0/1320164901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dfc0b16d0 0x7f0dfc0b1b40 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:42.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.750+0000 7f0dfb59e700 1 -- 172.21.15.71:0/1320164901 >> 172.21.15.71:0/1320164901 conn(0x7f0dfc0d10c0 msgr2=0x7f0dfc0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:42.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.750+0000 7f0dfb59e700 1 -- 172.21.15.71:0/1320164901 shutdown_connections 2023-10-09T07:57:42.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.750+0000 7f0dfb59e700 1 -- 172.21.15.71:0/1320164901 wait complete. 2023-10-09T07:57:42.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.751+0000 7f0dfb59e700 1 Processor -- start 2023-10-09T07:57:42.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.751+0000 7f0dfb59e700 1 -- start start 2023-10-09T07:57:42.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.752+0000 7f0dfb59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dfc0b16d0 0x7f0dfc16d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:42.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.752+0000 7f0dfb59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dfc0b33b0 0x7f0dfc1699c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:42.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.752+0000 7f0dfb59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0dfc0b4e70 0x7f0dfc0cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:42.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.752+0000 7f0dfb59e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc0c7020 con 0x7f0dfc0b33b0 2023-10-09T07:57:42.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.752+0000 7f0dfb59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc0c7270 con 0x7f0dfc0b16d0 2023-10-09T07:57:42.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.752+0000 7f0dfb59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc0c7550 con 0x7f0dfc0b4e70 2023-10-09T07:57:42.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.752+0000 7f0df9d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dfc0b33b0 0x7f0dfc1699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:42.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.753+0000 7f0df9d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dfc0b33b0 0x7f0dfc1699c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34086/0 (socket says 172.21.15.71:34086) 2023-10-09T07:57:42.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.753+0000 7f0df9d9b700 1 -- 172.21.15.71:0/3945028858 learned_addr learned my addr 172.21.15.71:0/3945028858 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:42.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.753+0000 7f0dfa59c700 1 --2- 172.21.15.71:0/3945028858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dfc0b16d0 0x7f0dfc16d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:42.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.753+0000 7f0dfad9d700 1 --2- 172.21.15.71:0/3945028858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0dfc0b4e70 0x7f0dfc0cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:42.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.753+0000 7f0df9d9b700 1 -- 172.21.15.71:0/3945028858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0dfc0b4e70 msgr2=0x7f0dfc0cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:42.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.753+0000 7f0df9d9b700 1 --2- 172.21.15.71:0/3945028858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0dfc0b4e70 0x7f0dfc0cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:42.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.753+0000 7f0df9d9b700 1 -- 172.21.15.71:0/3945028858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dfc0b16d0 msgr2=0x7f0dfc16d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:42.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.753+0000 7f0df9d9b700 1 --2- 172.21.15.71:0/3945028858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dfc0b16d0 0x7f0dfc16d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:42.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.753+0000 7f0df9d9b700 1 -- 172.21.15.71:0/3945028858 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df0009420 con 0x7f0dfc0b33b0 2023-10-09T07:57:42.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.753+0000 7f0dfa59c700 1 --2- 172.21.15.71:0/3945028858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dfc0b16d0 0x7f0dfc16d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:57:42.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.753+0000 7f0df9d9b700 1 --2- 172.21.15.71:0/3945028858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dfc0b33b0 0x7f0dfc1699c0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc070dd0 tx=0x7f0df0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:42.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.753+0000 7f0dea7fc700 1 -- 172.21.15.71:0/3945028858 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df000bb90 con 0x7f0dfc0b33b0 2023-10-09T07:57:42.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.753+0000 7f0dea7fc700 1 -- 172.21.15.71:0/3945028858 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df0000cc0 con 0x7f0dfc0b33b0 2023-10-09T07:57:42.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.753+0000 7f0dfb59e700 1 -- 172.21.15.71:0/3945028858 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dfc0c7830 con 0x7f0dfc0b33b0 2023-10-09T07:57:42.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.753+0000 7f0dea7fc700 1 -- 172.21.15.71:0/3945028858 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df0011670 con 0x7f0dfc0b33b0 2023-10-09T07:57:42.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.754+0000 7f0dfb59e700 1 -- 172.21.15.71:0/3945028858 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dfc0c7e70 con 0x7f0dfc0b33b0 2023-10-09T07:57:42.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.754+0000 7f0dfb59e700 1 -- 172.21.15.71:0/3945028858 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dfc0c8000 con 0x7f0dfc0b33b0 2023-10-09T07:57:42.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.755+0000 7f0dea7fc700 1 -- 172.21.15.71:0/3945028858 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0df0011aa0 con 0x7f0dfc0b33b0 2023-10-09T07:57:42.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.756+0000 7f0dea7fc700 1 --2- 172.21.15.71:0/3945028858 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0ddc066f30 0x7f0ddc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:42.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.757+0000 7f0dea7fc700 1 -- 172.21.15.71:0/3945028858 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f0df0085fd0 con 0x7f0dfc0b33b0 2023-10-09T07:57:42.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.757+0000 7f0dfa59c700 1 --2- 172.21.15.71:0/3945028858 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0ddc066f30 0x7f0ddc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:42.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.758+0000 7f0dfa59c700 1 --2- 172.21.15.71:0/3945028858 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0ddc066f30 0x7f0ddc0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0dec0011e0 tx=0x7f0dec009040 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:42.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.760+0000 7f0dea7fc700 1 -- 172.21.15.71:0/3945028858 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0df0052fd0 con 0x7f0dfc0b33b0 2023-10-09T07:57:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:42.997+0000 7f0dfb59e700 1 -- 172.21.15.71:0/3945028858 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0dfc04bb80 con 0x7f0dfc0b33b0 2023-10-09T07:57:43.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.719+0000 7f0dea7fc700 1 -- 172.21.15.71:0/3945028858 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v73) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0df00565f0 con 0x7f0dfc0b33b0 2023-10-09T07:57:43.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.721+0000 7f0dfb59e700 1 -- 172.21.15.71:0/3945028858 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0ddc066f30 msgr2=0x7f0ddc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:43.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.721+0000 7f0dfb59e700 1 --2- 172.21.15.71:0/3945028858 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0ddc066f30 0x7f0ddc0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0dec0011e0 tx=0x7f0dec009040 comp rx=0 tx=0).stop 2023-10-09T07:57:43.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.721+0000 7f0dfb59e700 1 -- 172.21.15.71:0/3945028858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dfc0b33b0 msgr2=0x7f0dfc1699c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:43.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.721+0000 7f0dfb59e700 1 --2- 172.21.15.71:0/3945028858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dfc0b33b0 0x7f0dfc1699c0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc070dd0 tx=0x7f0df0017000 comp rx=0 tx=0).stop 2023-10-09T07:57:43.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.721+0000 7f0dfb59e700 1 -- 172.21.15.71:0/3945028858 shutdown_connections 2023-10-09T07:57:43.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.721+0000 7f0dfb59e700 1 --2- 172.21.15.71:0/3945028858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0dfc0b4e70 0x7f0dfc0cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:43.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.721+0000 7f0dfb59e700 1 --2- 172.21.15.71:0/3945028858 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0ddc066f30 0x7f0ddc0693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:43.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.721+0000 7f0dfb59e700 1 --2- 172.21.15.71:0/3945028858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dfc0b16d0 0x7f0dfc16d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:43.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.721+0000 7f0dfb59e700 1 --2- 172.21.15.71:0/3945028858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dfc0b33b0 0x7f0dfc1699c0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:43.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.721+0000 7f0dfb59e700 1 -- 172.21.15.71:0/3945028858 >> 172.21.15.71:0/3945028858 conn(0x7f0dfc0d10c0 msgr2=0x7f0dfc069710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:43.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.722+0000 7f0dfb59e700 1 -- 172.21.15.71:0/3945028858 shutdown_connections 2023-10-09T07:57:43.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.722+0000 7f0dfb59e700 1 -- 172.21.15.71:0/3945028858 wait complete. 2023-10-09T07:57:43.743 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T07:57:43.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.930+0000 7f1981b9d700 1 Processor -- start 2023-10-09T07:57:43.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.930+0000 7f1981b9d700 1 -- start start 2023-10-09T07:57:43.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.932+0000 7f1981b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f197c140bb0 0x7f197c06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:43.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.932+0000 7f1981b9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f197c06da30 0x7f197c0c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:43.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.932+0000 7f1981b9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f197c0c6820 con 0x7f197c1407e0 2023-10-09T07:57:43.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.932+0000 7f1981b9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f197c0c6de0 con 0x7f197c06da30 2023-10-09T07:57:43.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.932+0000 7f1981b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197c06de60 con 0x7f197c140bb0 2023-10-09T07:57:43.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.932+0000 7f1980b9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f197c1407e0 0x7f197c06a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54998/0 (socket says 172.21.15.71:54998) 2023-10-09T07:57:43.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.932+0000 7f1980b9b700 1 -- 172.21.15.71:0/290808124 learned_addr learned my addr 172.21.15.71:0/290808124 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:43.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.932+0000 7f198139c700 1 --2- 172.21.15.71:0/290808124 >> v2:172.21.15.71:3300/0 conn(0x7f197c06da30 0x7f197c0c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:43.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.932+0000 7f197b7fe700 1 -- 172.21.15.71:0/290808124 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802488023 0 0) 0x7f197c0c6820 con 0x7f197c1407e0 2023-10-09T07:57:43.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.932+0000 7f197b7fe700 1 -- 172.21.15.71:0/290808124 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f196c003570 con 0x7f197c1407e0 2023-10-09T07:57:43.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.932+0000 7f197bfff700 1 --2- 172.21.15.71:0/290808124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f197c140bb0 0x7f197c06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:43.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.932+0000 7f198139c700 1 -- 172.21.15.71:0/290808124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f197c140bb0 msgr2=0x7f197c06d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:43.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.932+0000 7f198139c700 1 --2- 172.21.15.71:0/290808124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f197c140bb0 0x7f197c06d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:43.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.932+0000 7f198139c700 1 -- 172.21.15.71:0/290808124 >> v1:172.21.15.71:6789/0 conn(0x7f197c1407e0 legacy=0x7f197c06a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:43.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.932+0000 7f198139c700 1 -- 172.21.15.71:0/290808124 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c141270 con 0x7f197c06da30 2023-10-09T07:57:43.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.932+0000 7f197bfff700 1 --2- 172.21.15.71:0/290808124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f197c140bb0 0x7f197c06d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:57:43.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.933+0000 7f198139c700 1 --2- 172.21.15.71:0/290808124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f197c06da30 0x7f197c0c7270 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f1974009e60 tx=0x7f1974009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2b9a118a74de73 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:43.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.933+0000 7f197b7fe700 1 -- 172.21.15.71:0/290808124 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197400e070 con 0x7f197c06da30 2023-10-09T07:57:43.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.933+0000 7f197b7fe700 1 -- 172.21.15.71:0/290808124 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197400bb60 con 0x7f197c06da30 2023-10-09T07:57:43.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.933+0000 7f197b7fe700 1 -- 172.21.15.71:0/290808124 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1974012430 con 0x7f197c06da30 2023-10-09T07:57:43.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.933+0000 7f1981b9d700 1 -- 172.21.15.71:0/290808124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f197c06da30 msgr2=0x7f197c0c7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:43.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.933+0000 7f1981b9d700 1 --2- 172.21.15.71:0/290808124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f197c06da30 0x7f197c0c7270 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f1974009e60 tx=0x7f1974009780 comp rx=0 tx=0).stop 2023-10-09T07:57:43.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.933+0000 7f1981b9d700 1 -- 172.21.15.71:0/290808124 shutdown_connections 2023-10-09T07:57:43.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.933+0000 7f1981b9d700 1 --2- 172.21.15.71:0/290808124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f197c06da30 0x7f197c0c7270 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:43.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.933+0000 7f1981b9d700 1 --2- 172.21.15.71:0/290808124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f197c140bb0 0x7f197c06d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:43.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.933+0000 7f1981b9d700 1 -- 172.21.15.71:0/290808124 >> 172.21.15.71:0/290808124 conn(0x7f197c0cc1e0 msgr2=0x7f197c0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:43.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.933+0000 7f1981b9d700 1 -- 172.21.15.71:0/290808124 shutdown_connections 2023-10-09T07:57:43.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.934+0000 7f1981b9d700 1 -- 172.21.15.71:0/290808124 wait complete. 2023-10-09T07:57:43.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.935+0000 7f1981b9d700 1 Processor -- start 2023-10-09T07:57:43.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.935+0000 7f1981b9d700 1 -- start start 2023-10-09T07:57:43.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.936+0000 7f1981b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f197c06da30 0x7f197c13f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:43.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.936+0000 7f1981b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f197c1407e0 0x7f197c0c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:43.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.936+0000 7f1981b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f197c140bb0 0x7f197c0a9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:43.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.936+0000 7f1981b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c0b1a90 con 0x7f197c140bb0 2023-10-09T07:57:43.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.936+0000 7f1981b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c0b0e80 con 0x7f197c06da30 2023-10-09T07:57:43.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.936+0000 7f1981b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197c0b1160 con 0x7f197c1407e0 2023-10-09T07:57:43.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.936+0000 7f198139c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f197c140bb0 0x7f197c0a9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:43.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.936+0000 7f198139c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f197c140bb0 0x7f197c0a9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34106/0 (socket says 172.21.15.71:34106) 2023-10-09T07:57:43.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.936+0000 7f198139c700 1 -- 172.21.15.71:0/3598967751 learned_addr learned my addr 172.21.15.71:0/3598967751 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:43.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.936+0000 7f198139c700 1 -- 172.21.15.71:0/3598967751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f197c1407e0 msgr2=0x7f197c0c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:43.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.936+0000 7f198139c700 1 --2- 172.21.15.71:0/3598967751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f197c1407e0 0x7f197c0c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:43.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.936+0000 7f198139c700 1 -- 172.21.15.71:0/3598967751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f197c06da30 msgr2=0x7f197c13f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:43.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.936+0000 7f198139c700 1 --2- 172.21.15.71:0/3598967751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f197c06da30 0x7f197c13f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:43.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.936+0000 7f198139c700 1 -- 172.21.15.71:0/3598967751 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1974009a20 con 0x7f197c140bb0 2023-10-09T07:57:43.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.937+0000 7f198139c700 1 --2- 172.21.15.71:0/3598967751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f197c140bb0 0x7f197c0a9ae0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f197c06cd50 tx=0x7f1974019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:43.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.937+0000 7f1978ff9700 1 -- 172.21.15.71:0/3598967751 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1974027470 con 0x7f197c140bb0 2023-10-09T07:57:43.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.937+0000 7f1978ff9700 1 -- 172.21.15.71:0/3598967751 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19740275f0 con 0x7f197c140bb0 2023-10-09T07:57:43.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.937+0000 7f1978ff9700 1 -- 172.21.15.71:0/3598967751 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19740279b0 con 0x7f197c140bb0 2023-10-09T07:57:43.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.937+0000 7f1981b9d700 1 -- 172.21.15.71:0/3598967751 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197c0b1440 con 0x7f197c140bb0 2023-10-09T07:57:43.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.937+0000 7f1981b9d700 1 -- 172.21.15.71:0/3598967751 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197c0c4840 con 0x7f197c140bb0 2023-10-09T07:57:43.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.938+0000 7f1981b9d700 1 -- 172.21.15.71:0/3598967751 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197c0b1e20 con 0x7f197c140bb0 2023-10-09T07:57:43.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.939+0000 7f1978ff9700 1 -- 172.21.15.71:0/3598967751 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1974024070 con 0x7f197c140bb0 2023-10-09T07:57:43.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.940+0000 7f1978ff9700 1 --2- 172.21.15.71:0/3598967751 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1960066f30 0x7f19600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:43.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.940+0000 7f1978ff9700 1 -- 172.21.15.71:0/3598967751 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f19740871d0 con 0x7f197c140bb0 2023-10-09T07:57:43.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.940+0000 7f1980b9b700 1 --2- 172.21.15.71:0/3598967751 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1960066f30 0x7f19600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:43.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.941+0000 7f1980b9b700 1 --2- 172.21.15.71:0/3598967751 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1960066f30 0x7f19600693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f19700058d0 tx=0x7f19700079d0 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:43.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:43.944+0000 7f1978ff9700 1 -- 172.21.15.71:0/3598967751 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f197c0b1e20 con 0x7f197c140bb0 2023-10-09T07:57:44.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.179+0000 7f1981b9d700 1 -- 172.21.15.71:0/3598967751 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f197c0b1e20 con 0x7f197c140bb0 2023-10-09T07:57:44.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.726+0000 7f1978ff9700 1 -- 172.21.15.71:0/3598967751 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v74) v1 ==== 122+0+0 (secure 0 0 0) 0x7f197c0b1e20 con 0x7f197c140bb0 2023-10-09T07:57:44.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.729+0000 7f1981b9d700 1 -- 172.21.15.71:0/3598967751 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1960066f30 msgr2=0x7f19600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:44.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.729+0000 7f1981b9d700 1 --2- 172.21.15.71:0/3598967751 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1960066f30 0x7f19600693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f19700058d0 tx=0x7f19700079d0 comp rx=0 tx=0).stop 2023-10-09T07:57:44.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.729+0000 7f1981b9d700 1 -- 172.21.15.71:0/3598967751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f197c140bb0 msgr2=0x7f197c0a9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:44.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.729+0000 7f1981b9d700 1 --2- 172.21.15.71:0/3598967751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f197c140bb0 0x7f197c0a9ae0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f197c06cd50 tx=0x7f1974019000 comp rx=0 tx=0).stop 2023-10-09T07:57:44.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.729+0000 7f1981b9d700 1 -- 172.21.15.71:0/3598967751 shutdown_connections 2023-10-09T07:57:44.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.729+0000 7f1981b9d700 1 --2- 172.21.15.71:0/3598967751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f197c140bb0 0x7f197c0a9ae0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:44.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.729+0000 7f1981b9d700 1 --2- 172.21.15.71:0/3598967751 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1960066f30 0x7f19600693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:44.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.729+0000 7f1981b9d700 1 --2- 172.21.15.71:0/3598967751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f197c06da30 0x7f197c13f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:44.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.729+0000 7f1981b9d700 1 --2- 172.21.15.71:0/3598967751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f197c1407e0 0x7f197c0c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:44.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.729+0000 7f1981b9d700 1 -- 172.21.15.71:0/3598967751 >> 172.21.15.71:0/3598967751 conn(0x7f197c0cc1e0 msgr2=0x7f197c0c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:44.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.730+0000 7f1981b9d700 1 -- 172.21.15.71:0/3598967751 shutdown_connections 2023-10-09T07:57:44.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.730+0000 7f1981b9d700 1 -- 172.21.15.71:0/3598967751 wait complete. 2023-10-09T07:57:44.749 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:57:44.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.933+0000 7fb85edff700 1 Processor -- start 2023-10-09T07:57:44.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.933+0000 7fb85edff700 1 -- start start 2023-10-09T07:57:44.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.934+0000 7fb85edff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb858155c10 0x7fb858155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:44.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.934+0000 7fb85edff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb8580ac6a0 0x7fb8580b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:44.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.934+0000 7fb85edff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8580acac0 con 0x7fb8580ac230 2023-10-09T07:57:44.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.934+0000 7fb85edff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8580ad930 con 0x7fb8580ac6a0 2023-10-09T07:57:44.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.934+0000 7fb85edff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8580acd20 con 0x7fb858155c10 2023-10-09T07:57:44.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.935+0000 7fb85d39c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb8580ac6a0 0x7fb8580b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:44.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.935+0000 7fb857fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb8580ac230 0x7fb8581568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55000/0 (socket says 172.21.15.71:55000) 2023-10-09T07:57:44.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.935+0000 7fb857fff700 1 -- 172.21.15.71:0/577417198 learned_addr learned my addr 172.21.15.71:0/577417198 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:44.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.935+0000 7fb85cb9b700 1 --2- 172.21.15.71:0/577417198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb858155c10 0x7fb858155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:44.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.935+0000 7fb85d39c700 1 -- 172.21.15.71:0/577417198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb858155c10 msgr2=0x7fb858155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:44.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.935+0000 7fb85d39c700 1 --2- 172.21.15.71:0/577417198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb858155c10 0x7fb858155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:44.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.935+0000 7fb85d39c700 1 -- 172.21.15.71:0/577417198 >> v1:172.21.15.71:6789/0 conn(0x7fb8580ac230 legacy=0x7fb8581568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:44.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.935+0000 7fb85d39c700 1 -- 172.21.15.71:0/577417198 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8580ad000 con 0x7fb8580ac6a0 2023-10-09T07:57:44.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.935+0000 7fb85d39c700 1 --2- 172.21.15.71:0/577417198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8580ac6a0 0x7fb8580b0300 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fb85000af70 tx=0x7fb85000a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ee19d4b60e948b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:44.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.936+0000 7fb8577fe700 1 -- 172.21.15.71:0/577417198 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85000f070 con 0x7fb8580ac6a0 2023-10-09T07:57:44.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.936+0000 7fb8577fe700 1 -- 172.21.15.71:0/577417198 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85000a2e0 con 0x7fb8580ac6a0 2023-10-09T07:57:44.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.936+0000 7fb8577fe700 1 -- 172.21.15.71:0/577417198 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85000cd20 con 0x7fb8580ac6a0 2023-10-09T07:57:44.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.936+0000 7fb85edff700 1 -- 172.21.15.71:0/577417198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8580ac6a0 msgr2=0x7fb8580b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:44.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.936+0000 7fb85edff700 1 --2- 172.21.15.71:0/577417198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8580ac6a0 0x7fb8580b0300 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fb85000af70 tx=0x7fb85000a890 comp rx=0 tx=0).stop 2023-10-09T07:57:44.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.936+0000 7fb85edff700 1 -- 172.21.15.71:0/577417198 shutdown_connections 2023-10-09T07:57:44.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.936+0000 7fb85edff700 1 --2- 172.21.15.71:0/577417198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8580ac6a0 0x7fb8580b0300 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:44.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.936+0000 7fb85edff700 1 --2- 172.21.15.71:0/577417198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb858155c10 0x7fb858155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:44.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.936+0000 7fb85edff700 1 -- 172.21.15.71:0/577417198 >> 172.21.15.71:0/577417198 conn(0x7fb85806a320 msgr2=0x7fb8580cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:44.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.936+0000 7fb85edff700 1 -- 172.21.15.71:0/577417198 shutdown_connections 2023-10-09T07:57:44.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.936+0000 7fb85edff700 1 -- 172.21.15.71:0/577417198 wait complete. 2023-10-09T07:57:44.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.938+0000 7fb85edff700 1 Processor -- start 2023-10-09T07:57:44.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.938+0000 7fb85edff700 1 -- start start 2023-10-09T07:57:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.939+0000 7fb85edff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8580ac230 0x7fb85815bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.939+0000 7fb85edff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8580ac6a0 0x7fb858157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.939+0000 7fb85edff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb858155c10 0x7fb85814a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.939+0000 7fb85edff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85815b150 con 0x7fb858155c10 2023-10-09T07:57:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.939+0000 7fb85edff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85815c1f0 con 0x7fb8580ac230 2023-10-09T07:57:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.939+0000 7fb85edff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb858158210 con 0x7fb8580ac6a0 2023-10-09T07:57:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.939+0000 7fb85d39c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb858155c10 0x7fb85814a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.939+0000 7fb85d39c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb858155c10 0x7fb85814a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34130/0 (socket says 172.21.15.71:34130) 2023-10-09T07:57:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.939+0000 7fb85d39c700 1 -- 172.21.15.71:0/3439546106 learned_addr learned my addr 172.21.15.71:0/3439546106 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.939+0000 7fb85cb9b700 1 --2- 172.21.15.71:0/3439546106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8580ac230 0x7fb85815bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.939+0000 7fb857fff700 1 --2- 172.21.15.71:0/3439546106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8580ac6a0 0x7fb858157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.940+0000 7fb85d39c700 1 -- 172.21.15.71:0/3439546106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8580ac6a0 msgr2=0x7fb858157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.940+0000 7fb85d39c700 1 --2- 172.21.15.71:0/3439546106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8580ac6a0 0x7fb858157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.940+0000 7fb85d39c700 1 -- 172.21.15.71:0/3439546106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8580ac230 msgr2=0x7fb85815bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.940+0000 7fb85d39c700 1 --2- 172.21.15.71:0/3439546106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8580ac230 0x7fb85815bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.940+0000 7fb85d39c700 1 -- 172.21.15.71:0/3439546106 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85000ab30 con 0x7fb858155c10 2023-10-09T07:57:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.940+0000 7fb85cb9b700 1 --2- 172.21.15.71:0/3439546106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8580ac230 0x7fb85815bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:57:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.940+0000 7fb857fff700 1 --2- 172.21.15.71:0/3439546106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8580ac6a0 0x7fb858157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:57:44.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.940+0000 7fb85d39c700 1 --2- 172.21.15.71:0/3439546106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb858155c10 0x7fb85814a760 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fb8580acc50 tx=0x7fb850019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:44.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.940+0000 7fb854ff9700 1 -- 172.21.15.71:0/3439546106 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85000ce50 con 0x7fb858155c10 2023-10-09T07:57:44.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.940+0000 7fb854ff9700 1 -- 172.21.15.71:0/3439546106 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb850027410 con 0x7fb858155c10 2023-10-09T07:57:44.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.940+0000 7fb854ff9700 1 -- 172.21.15.71:0/3439546106 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8500277d0 con 0x7fb858155c10 2023-10-09T07:57:44.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.940+0000 7fb85edff700 1 -- 172.21.15.71:0/3439546106 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85814aca0 con 0x7fb858155c10 2023-10-09T07:57:44.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.940+0000 7fb85edff700 1 -- 172.21.15.71:0/3439546106 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8581571f0 con 0x7fb858155c10 2023-10-09T07:57:44.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.941+0000 7fb85edff700 1 -- 172.21.15.71:0/3439546106 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85804c3c0 con 0x7fb858155c10 2023-10-09T07:57:44.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.942+0000 7fb854ff9700 1 -- 172.21.15.71:0/3439546106 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb85001d410 con 0x7fb858155c10 2023-10-09T07:57:44.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.943+0000 7fb854ff9700 1 --2- 172.21.15.71:0/3439546106 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb83c066f30 0x7fb83c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:44.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.944+0000 7fb854ff9700 1 -- 172.21.15.71:0/3439546106 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fb8500863d0 con 0x7fb858155c10 2023-10-09T07:57:44.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.944+0000 7fb85cb9b700 1 --2- 172.21.15.71:0/3439546106 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb83c066f30 0x7fb83c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:44.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.945+0000 7fb85cb9b700 1 --2- 172.21.15.71:0/3439546106 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb83c066f30 0x7fb83c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb84c006fd0 tx=0x7fb84c008040 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:44.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:44.948+0000 7fb854ff9700 1 -- 172.21.15.71:0/3439546106 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb850053470 con 0x7fb858155c10 2023-10-09T07:57:45.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.188+0000 7fb85edff700 1 -- 172.21.15.71:0/3439546106 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8580ad2e0 con 0x7fb858155c10 2023-10-09T07:57:45.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.189+0000 7fb854ff9700 1 -- 172.21.15.71:0/3439546106 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fb850056a90 con 0x7fb858155c10 2023-10-09T07:57:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:57:45.190 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1228129559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1228129559},{"type":"v1","addr":"172.21.15.179:6836","nonce":1228129559}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8254,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3640887500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3640887500},{"type":"v1","addr":"172.21.15.179:6834","nonce":3640887500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8586,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/4266132184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":4266132184},{"type":"v1","addr":"172.21.15.71:6834","nonce":4266132184}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:57:41.159434+0000","modified":"2023-10-09T07:57:44.718117+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8589":{"gid":8589,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/889811309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":889811309},{"type":"v1","addr":"172.21.15.71:6835","nonce":889811309}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T07:57:45.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.191+0000 7fb85edff700 1 -- 172.21.15.71:0/3439546106 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb83c066f30 msgr2=0x7fb83c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.191+0000 7fb85edff700 1 --2- 172.21.15.71:0/3439546106 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb83c066f30 0x7fb83c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb84c006fd0 tx=0x7fb84c008040 comp rx=0 tx=0).stop 2023-10-09T07:57:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.191+0000 7fb85edff700 1 -- 172.21.15.71:0/3439546106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb858155c10 msgr2=0x7fb85814a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.191+0000 7fb85edff700 1 --2- 172.21.15.71:0/3439546106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb858155c10 0x7fb85814a760 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fb8580acc50 tx=0x7fb850019000 comp rx=0 tx=0).stop 2023-10-09T07:57:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.191+0000 7fb85edff700 1 -- 172.21.15.71:0/3439546106 shutdown_connections 2023-10-09T07:57:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.191+0000 7fb85edff700 1 --2- 172.21.15.71:0/3439546106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb858155c10 0x7fb85814a760 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.191+0000 7fb85edff700 1 --2- 172.21.15.71:0/3439546106 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb83c066f30 0x7fb83c0693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.191+0000 7fb85edff700 1 --2- 172.21.15.71:0/3439546106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8580ac230 0x7fb85815bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.191+0000 7fb85edff700 1 --2- 172.21.15.71:0/3439546106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8580ac6a0 0x7fb858157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.191+0000 7fb85edff700 1 -- 172.21.15.71:0/3439546106 >> 172.21.15.71:0/3439546106 conn(0x7fb85806a320 msgr2=0x7fb8580c9030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.191+0000 7fb85edff700 1 -- 172.21.15.71:0/3439546106 shutdown_connections 2023-10-09T07:57:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.191+0000 7fb85edff700 1 -- 172.21.15.71:0/3439546106 wait complete. 2023-10-09T07:57:45.194 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 74 2023-10-09T07:57:45.210 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:57:45.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.391+0000 7fb0bfdff700 1 Processor -- start 2023-10-09T07:57:45.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.392+0000 7fb0bfdff700 1 -- start start 2023-10-09T07:57:45.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.393+0000 7fb0bfdff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb0b8159720 0x7fb0b8159af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:45.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.393+0000 7fb0bfdff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb0b80ad250 0x7fb0b80ad670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:45.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.393+0000 7fb0bfdff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b80adbb0 con 0x7fb0b80ab4e0 2023-10-09T07:57:45.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.393+0000 7fb0bfdff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b80ab980 con 0x7fb0b80ad250 2023-10-09T07:57:45.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.393+0000 7fb0bfdff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b80ac020 con 0x7fb0b8159720 2023-10-09T07:57:45.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.393+0000 7fb0be39c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb0b80ad250 0x7fb0b80ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:45.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.393+0000 7fb0be39c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb0b80ad250 0x7fb0b80ad670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35476/0 (socket says 172.21.15.71:35476) 2023-10-09T07:57:45.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.393+0000 7fb0be39c700 1 -- 172.21.15.71:0/345201038 learned_addr learned my addr 172.21.15.71:0/345201038 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:45.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.393+0000 7fb0bdb9b700 1 --2- 172.21.15.71:0/345201038 >> v2:172.21.15.179:3300/0 conn(0x7fb0b8159720 0x7fb0b8159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:45.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.393+0000 7fb0be39c700 1 -- 172.21.15.71:0/345201038 >> v2:172.21.15.179:3300/0 conn(0x7fb0b8159720 msgr2=0x7fb0b8159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:45.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.393+0000 7fb0be39c700 1 --2- 172.21.15.71:0/345201038 >> v2:172.21.15.179:3300/0 conn(0x7fb0b8159720 0x7fb0b8159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:45.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.394+0000 7fb0be39c700 1 -- 172.21.15.71:0/345201038 >> v1:172.21.15.179:6789/0 conn(0x7fb0b80ab4e0 legacy=0x7fb0b80a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:45.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.394+0000 7fb0be39c700 1 -- 172.21.15.71:0/345201038 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b80aa440 con 0x7fb0b80ad250 2023-10-09T07:57:45.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.394+0000 7fb0be39c700 1 --2- 172.21.15.71:0/345201038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0b80ad250 0x7fb0b80ad670 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8063d40 tx=0x7fb0b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec494947cdc583b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:45.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.394+0000 7fb0bcb99700 1 -- 172.21.15.71:0/345201038 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b000e070 con 0x7fb0b80ad250 2023-10-09T07:57:45.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.394+0000 7fb0bcb99700 1 -- 172.21.15.71:0/345201038 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b000ba20 con 0x7fb0b80ad250 2023-10-09T07:57:45.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.394+0000 7fb0bcb99700 1 -- 172.21.15.71:0/345201038 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b00092e0 con 0x7fb0b80ad250 2023-10-09T07:57:45.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.394+0000 7fb0bfdff700 1 -- 172.21.15.71:0/345201038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0b80ad250 msgr2=0x7fb0b80ad670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:45.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.394+0000 7fb0bfdff700 1 --2- 172.21.15.71:0/345201038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0b80ad250 0x7fb0b80ad670 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8063d40 tx=0x7fb0b0009840 comp rx=0 tx=0).stop 2023-10-09T07:57:45.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.395+0000 7fb0bfdff700 1 -- 172.21.15.71:0/345201038 shutdown_connections 2023-10-09T07:57:45.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.395+0000 7fb0bfdff700 1 --2- 172.21.15.71:0/345201038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0b80ad250 0x7fb0b80ad670 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:45.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.395+0000 7fb0bfdff700 1 --2- 172.21.15.71:0/345201038 >> v2:172.21.15.179:3300/0 conn(0x7fb0b8159720 0x7fb0b8159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:45.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.395+0000 7fb0bfdff700 1 -- 172.21.15.71:0/345201038 >> 172.21.15.71:0/345201038 conn(0x7fb0b806a320 msgr2=0x7fb0b80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:45.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.395+0000 7fb0bfdff700 1 -- 172.21.15.71:0/345201038 shutdown_connections 2023-10-09T07:57:45.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.395+0000 7fb0bfdff700 1 -- 172.21.15.71:0/345201038 wait complete. 2023-10-09T07:57:45.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.396+0000 7fb0bfdff700 1 Processor -- start 2023-10-09T07:57:45.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.396+0000 7fb0bfdff700 1 -- start start 2023-10-09T07:57:45.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.397+0000 7fb0bfdff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0b80ab4e0 0x7fb0b814c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:45.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.397+0000 7fb0bfdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0b80ad250 0x7fb0b8155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:45.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.397+0000 7fb0bfdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b8159720 0x7fb0b80ac220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:45.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.397+0000 7fb0bfdff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b8156aa0 con 0x7fb0b80ab4e0 2023-10-09T07:57:45.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.397+0000 7fb0bfdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b8155e90 con 0x7fb0b80ad250 2023-10-09T07:57:45.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.397+0000 7fb0bfdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b8156170 con 0x7fb0b8159720 2023-10-09T07:57:45.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.397+0000 7fb0bdb9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0b80ab4e0 0x7fb0b814c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:45.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.397+0000 7fb0bdb9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0b80ab4e0 0x7fb0b814c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35490/0 (socket says 172.21.15.71:35490) 2023-10-09T07:57:45.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.397+0000 7fb0bdb9b700 1 -- 172.21.15.71:0/2064967449 learned_addr learned my addr 172.21.15.71:0/2064967449 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:45.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.397+0000 7fb0bd39a700 1 --2- 172.21.15.71:0/2064967449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0b80ad250 0x7fb0b8155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:45.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.398+0000 7fb0be39c700 1 --2- 172.21.15.71:0/2064967449 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b8159720 0x7fb0b80ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:45.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.398+0000 7fb0bdb9b700 1 -- 172.21.15.71:0/2064967449 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b8159720 msgr2=0x7fb0b80ac220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:45.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.398+0000 7fb0bdb9b700 1 --2- 172.21.15.71:0/2064967449 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b8159720 0x7fb0b80ac220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:45.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.398+0000 7fb0bdb9b700 1 -- 172.21.15.71:0/2064967449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0b80ad250 msgr2=0x7fb0b8155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:45.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.398+0000 7fb0bdb9b700 1 --2- 172.21.15.71:0/2064967449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0b80ad250 0x7fb0b8155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:45.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.398+0000 7fb0bdb9b700 1 -- 172.21.15.71:0/2064967449 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b0009ae0 con 0x7fb0b80ab4e0 2023-10-09T07:57:45.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.398+0000 7fb0bdb9b700 1 --2- 172.21.15.71:0/2064967449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0b80ab4e0 0x7fb0b814c290 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fb0b400e930 tx=0x7fb0b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:45.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.398+0000 7fb0adffb700 1 -- 172.21.15.71:0/2064967449 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b400eed0 con 0x7fb0b80ab4e0 2023-10-09T07:57:45.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.398+0000 7fb0adffb700 1 -- 172.21.15.71:0/2064967449 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b400c850 con 0x7fb0b80ab4e0 2023-10-09T07:57:45.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.398+0000 7fb0bfdff700 1 -- 172.21.15.71:0/2064967449 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b8156450 con 0x7fb0b80ab4e0 2023-10-09T07:57:45.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.398+0000 7fb0adffb700 1 -- 172.21.15.71:0/2064967449 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b400cbf0 con 0x7fb0b80ab4e0 2023-10-09T07:57:45.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.398+0000 7fb0bfdff700 1 -- 172.21.15.71:0/2064967449 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b814c7d0 con 0x7fb0b80ab4e0 2023-10-09T07:57:45.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.399+0000 7fb0bfdff700 1 -- 172.21.15.71:0/2064967449 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b80addd0 con 0x7fb0b80ab4e0 2023-10-09T07:57:45.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.400+0000 7fb0adffb700 1 -- 172.21.15.71:0/2064967449 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb0b4013470 con 0x7fb0b80ab4e0 2023-10-09T07:57:45.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.401+0000 7fb0adffb700 1 --2- 172.21.15.71:0/2064967449 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb09c066f30 0x7fb09c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:45.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.401+0000 7fb0adffb700 1 -- 172.21.15.71:0/2064967449 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fb0b4084a10 con 0x7fb0b80ab4e0 2023-10-09T07:57:45.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.401+0000 7fb0bd39a700 1 --2- 172.21.15.71:0/2064967449 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb09c066f30 0x7fb09c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:45.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.402+0000 7fb0bd39a700 1 --2- 172.21.15.71:0/2064967449 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb09c066f30 0x7fb09c0693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8152b50 tx=0x7fb0a8009040 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:45.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.405+0000 7fb0adffb700 1 -- 172.21.15.71:0/2064967449 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0b4051a10 con 0x7fb0b80ab4e0 2023-10-09T07:57:45.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.596+0000 7fb0bfdff700 1 -- 172.21.15.71:0/2064967449 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0b804c3c0 con 0x7fb0b80ab4e0 2023-10-09T07:57:45.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.597+0000 7fb0adffb700 1 -- 172.21.15.71:0/2064967449 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+16074 (secure 0 0 0) 0x7fb0b4055030 con 0x7fb0b80ab4e0 2023-10-09T07:57:45.598 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:57:45.598 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":163,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:57:42.699705+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:57:39.262671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T07:57:40.149000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:57:45.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.599+0000 7fb0bfdff700 1 -- 172.21.15.71:0/2064967449 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb09c066f30 msgr2=0x7fb09c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:45.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.599+0000 7fb0bfdff700 1 --2- 172.21.15.71:0/2064967449 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb09c066f30 0x7fb09c0693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8152b50 tx=0x7fb0a8009040 comp rx=0 tx=0).stop 2023-10-09T07:57:45.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.599+0000 7fb0bfdff700 1 -- 172.21.15.71:0/2064967449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0b80ab4e0 msgr2=0x7fb0b814c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:45.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.599+0000 7fb0bfdff700 1 --2- 172.21.15.71:0/2064967449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0b80ab4e0 0x7fb0b814c290 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fb0b400e930 tx=0x7fb0b40091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:45.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.599+0000 7fb0bfdff700 1 -- 172.21.15.71:0/2064967449 shutdown_connections 2023-10-09T07:57:45.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.599+0000 7fb0bfdff700 1 --2- 172.21.15.71:0/2064967449 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b8159720 0x7fb0b80ac220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:45.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.599+0000 7fb0bfdff700 1 --2- 172.21.15.71:0/2064967449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0b80ab4e0 0x7fb0b814c290 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:45.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.599+0000 7fb0bfdff700 1 --2- 172.21.15.71:0/2064967449 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb09c066f30 0x7fb09c0693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:45.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.599+0000 7fb0bfdff700 1 --2- 172.21.15.71:0/2064967449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0b80ad250 0x7fb0b8155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:45.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.599+0000 7fb0bfdff700 1 -- 172.21.15.71:0/2064967449 >> 172.21.15.71:0/2064967449 conn(0x7fb0b806a320 msgr2=0x7fb0b80cc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:45.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.599+0000 7fb0bfdff700 1 -- 172.21.15.71:0/2064967449 shutdown_connections 2023-10-09T07:57:45.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.599+0000 7fb0bfdff700 1 -- 172.21.15.71:0/2064967449 wait complete. 2023-10-09T07:57:45.618 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T07:57:45.618 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T07:57:45.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.800+0000 7f475dbff700 1 Processor -- start 2023-10-09T07:57:45.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.801+0000 7f475dbff700 1 -- start start 2023-10-09T07:57:45.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.802+0000 7f475dbff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4758159720 0x7f4758159af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:45.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.802+0000 7f475dbff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47580ab980 con 0x7f47580ad250 2023-10-09T07:57:45.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.802+0000 7f475dbff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47580ac020 con 0x7f47580ab4e0 2023-10-09T07:57:45.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.802+0000 7f475dbff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47580aa440 con 0x7f4758159720 2023-10-09T07:57:45.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.802+0000 7f47577fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4758159720 0x7f4758159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:45.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.802+0000 7f4757fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f47580ad250 0x7f47580ad670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52018/0 (socket says 172.21.15.71:52018) 2023-10-09T07:57:45.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.802+0000 7f4757fff700 1 -- 172.21.15.71:0/307081169 learned_addr learned my addr 172.21.15.71:0/307081169 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:45.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.803+0000 7f47577fe700 1 -- 172.21.15.71:0/307081169 >> v1:172.21.15.179:6789/0 conn(0x7f47580ab4e0 legacy=0x7f47580a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:45.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.803+0000 7f47577fe700 1 -- 172.21.15.71:0/307081169 >> v1:172.21.15.71:6789/0 conn(0x7f47580ad250 legacy=0x7f47580ad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:45.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.803+0000 7f47577fe700 1 -- 172.21.15.71:0/307081169 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47580aa720 con 0x7f4758159720 2023-10-09T07:57:45.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.803+0000 7f47577fe700 1 --2- 172.21.15.71:0/307081169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4758159720 0x7f4758159af0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f47480098e0 tx=0x7f47480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e7ff114695ae704 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:45.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.803+0000 7f4756ffd700 1 -- 172.21.15.71:0/307081169 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4748009e80 con 0x7f4758159720 2023-10-09T07:57:45.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.803+0000 7f4756ffd700 1 -- 172.21.15.71:0/307081169 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474800b820 con 0x7f4758159720 2023-10-09T07:57:45.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.803+0000 7f4756ffd700 1 -- 172.21.15.71:0/307081169 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474800bba0 con 0x7f4758159720 2023-10-09T07:57:45.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.804+0000 7f475dbff700 1 -- 172.21.15.71:0/307081169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4758159720 msgr2=0x7f4758159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:45.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.804+0000 7f475dbff700 1 --2- 172.21.15.71:0/307081169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4758159720 0x7f4758159af0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f47480098e0 tx=0x7f47480091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:45.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.804+0000 7f475dbff700 1 -- 172.21.15.71:0/307081169 shutdown_connections 2023-10-09T07:57:45.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.804+0000 7f475dbff700 1 --2- 172.21.15.71:0/307081169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4758159720 0x7f4758159af0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:45.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.804+0000 7f475dbff700 1 -- 172.21.15.71:0/307081169 >> 172.21.15.71:0/307081169 conn(0x7f475806a320 msgr2=0x7f47580cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:45.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.804+0000 7f475dbff700 1 -- 172.21.15.71:0/307081169 shutdown_connections 2023-10-09T07:57:45.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.804+0000 7f475dbff700 1 -- 172.21.15.71:0/307081169 wait complete. 2023-10-09T07:57:45.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.805+0000 7f475dbff700 1 Processor -- start 2023-10-09T07:57:45.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.805+0000 7f475dbff700 1 -- start start 2023-10-09T07:57:45.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.806+0000 7f475dbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47580ab4e0 0x7f475813c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:45.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.806+0000 7f475dbff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47580ad250 0x7f47580b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:45.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.806+0000 7f475dbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4758159720 0x7f47580b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:45.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.806+0000 7f475dbff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4758153260 con 0x7f47580ad250 2023-10-09T07:57:45.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.806+0000 7f475dbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4758153540 con 0x7f47580ab4e0 2023-10-09T07:57:45.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.806+0000 7f475dbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4758153820 con 0x7f4758159720 2023-10-09T07:57:45.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.806+0000 7f474ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47580ad250 0x7f47580b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:45.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.807+0000 7f474ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47580ad250 0x7f47580b0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35504/0 (socket says 172.21.15.71:35504) 2023-10-09T07:57:45.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.807+0000 7f474ffff700 1 -- 172.21.15.71:0/3907138761 learned_addr learned my addr 172.21.15.71:0/3907138761 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:45.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.807+0000 7f4757fff700 1 --2- 172.21.15.71:0/3907138761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4758159720 0x7f47580b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:45.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.807+0000 7f47577fe700 1 --2- 172.21.15.71:0/3907138761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47580ab4e0 0x7f475813c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:45.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.807+0000 7f474ffff700 1 -- 172.21.15.71:0/3907138761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4758159720 msgr2=0x7f47580b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:45.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.807+0000 7f474ffff700 1 --2- 172.21.15.71:0/3907138761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4758159720 0x7f47580b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:45.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.807+0000 7f474ffff700 1 -- 172.21.15.71:0/3907138761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47580ab4e0 msgr2=0x7f475813c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:45.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.807+0000 7f474ffff700 1 --2- 172.21.15.71:0/3907138761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47580ab4e0 0x7f475813c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:45.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.807+0000 7f474ffff700 1 -- 172.21.15.71:0/3907138761 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4748009420 con 0x7f47580ad250 2023-10-09T07:57:45.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.807+0000 7f47577fe700 1 --2- 172.21.15.71:0/3907138761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47580ab4e0 0x7f475813c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:57:45.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.807+0000 7f474ffff700 1 --2- 172.21.15.71:0/3907138761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47580ad250 0x7f47580b0bb0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f474000c5d0 tx=0x7f4740007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:45.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.807+0000 7f474f7fe700 1 -- 172.21.15.71:0/3907138761 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4740011590 con 0x7f47580ad250 2023-10-09T07:57:45.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.807+0000 7f474f7fe700 1 -- 172.21.15.71:0/3907138761 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4740011710 con 0x7f47580ad250 2023-10-09T07:57:45.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.807+0000 7f475dbff700 1 -- 172.21.15.71:0/3907138761 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4758153b00 con 0x7f47580ad250 2023-10-09T07:57:45.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.807+0000 7f474f7fe700 1 -- 172.21.15.71:0/3907138761 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4740011ad0 con 0x7f47580ad250 2023-10-09T07:57:45.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.808+0000 7f475dbff700 1 -- 172.21.15.71:0/3907138761 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4758154300 con 0x7f47580ad250 2023-10-09T07:57:45.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.808+0000 7f475dbff700 1 -- 172.21.15.71:0/3907138761 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4758154020 con 0x7f47580ad250 2023-10-09T07:57:45.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.809+0000 7f474f7fe700 1 -- 172.21.15.71:0/3907138761 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f474001c460 con 0x7f47580ad250 2023-10-09T07:57:45.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.811+0000 7f474f7fe700 1 --2- 172.21.15.71:0/3907138761 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4738066f30 0x7f47380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:45.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.811+0000 7f474f7fe700 1 -- 172.21.15.71:0/3907138761 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f47400845a0 con 0x7f47580ad250 2023-10-09T07:57:45.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.811+0000 7f47577fe700 1 --2- 172.21.15.71:0/3907138761 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4738066f30 0x7f47380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:45.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.812+0000 7f47577fe700 1 --2- 172.21.15.71:0/3907138761 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4738066f30 0x7f47380693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f47480030c0 tx=0x7f4748016000 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:45.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:45.815+0000 7f474f7fe700 1 -- 172.21.15.71:0/3907138761 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4758154020 con 0x7f47580ad250 2023-10-09T07:57:46.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.000+0000 7f475dbff700 1 -- 172.21.15.71:0/3907138761 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4758154020 con 0x7f4738066f30 2023-10-09T07:57:46.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.011+0000 7f474f7fe700 1 -- 172.21.15.71:0/3907138761 <== mgr.8071 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282677 (secure 0 0 0) 0x7f4758154020 con 0x7f4738066f30 2023-10-09T07:57:46.016 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:57:46.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.015+0000 7f475dbff700 1 -- 172.21.15.71:0/3907138761 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4738066f30 msgr2=0x7f47380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:46.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.015+0000 7f475dbff700 1 --2- 172.21.15.71:0/3907138761 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4738066f30 0x7f47380693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f47480030c0 tx=0x7f4748016000 comp rx=0 tx=0).stop 2023-10-09T07:57:46.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.015+0000 7f475dbff700 1 -- 172.21.15.71:0/3907138761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47580ad250 msgr2=0x7f47580b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:46.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.015+0000 7f475dbff700 1 --2- 172.21.15.71:0/3907138761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47580ad250 0x7f47580b0bb0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f474000c5d0 tx=0x7f4740007f60 comp rx=0 tx=0).stop 2023-10-09T07:57:46.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.015+0000 7f475dbff700 1 -- 172.21.15.71:0/3907138761 shutdown_connections 2023-10-09T07:57:46.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.015+0000 7f475dbff700 1 --2- 172.21.15.71:0/3907138761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4758159720 0x7f47580b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:46.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.015+0000 7f475dbff700 1 --2- 172.21.15.71:0/3907138761 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4738066f30 0x7f47380693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:46.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.015+0000 7f475dbff700 1 --2- 172.21.15.71:0/3907138761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47580ab4e0 0x7f475813c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:46.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.015+0000 7f475dbff700 1 --2- 172.21.15.71:0/3907138761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47580ad250 0x7f47580b0bb0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:46.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.015+0000 7f475dbff700 1 -- 172.21.15.71:0/3907138761 >> 172.21.15.71:0/3907138761 conn(0x7f475806a320 msgr2=0x7f475814e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:46.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.016+0000 7f475dbff700 1 -- 172.21.15.71:0/3907138761 shutdown_connections 2023-10-09T07:57:46.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.016+0000 7f475dbff700 1 -- 172.21.15.71:0/3907138761 wait complete. 2023-10-09T07:57:46.019 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T07:57:46.034 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T07:57:45.106001+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":448,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2477012,"kb_used_data":16788,"kb_used_omap":0,"kb_used_meta":2460160,"kb_avail":752497708,"statfs":{"total":773094113280,"available":770557652992,"internally_reserved":0,"allocated":17190912,"data_stored":9153454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2519203840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.422453"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.717854+0000","last_change":"2023-10-09T07:57:41.709955+0000","last_active":"2023-10-09T07:57:41.717854+0000","last_peered":"2023-10-09T07:57:41.717854+0000","last_clean":"2023-10-09T07:57:41.717854+0000","last_became_active":"2023-10-09T07:57:41.709619+0000","last_became_peered":"2023-10-09T07:57:41.709619+0000","last_unstale":"2023-10-09T07:57:41.717854+0000","last_undegraded":"2023-10-09T07:57:41.717854+0000","last_fullsized":"2023-10-09T07:57:41.717854+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:31:27.885208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.725286+0000","last_change":"2023-10-09T07:57:41.720928+0000","last_active":"2023-10-09T07:57:41.725286+0000","last_peered":"2023-10-09T07:57:41.725286+0000","last_clean":"2023-10-09T07:57:41.725286+0000","last_became_active":"2023-10-09T07:57:41.720641+0000","last_became_peered":"2023-10-09T07:57:41.720641+0000","last_unstale":"2023-10-09T07:57:41.725286+0000","last_undegraded":"2023-10-09T07:57:41.725286+0000","last_fullsized":"2023-10-09T07:57:41.725286+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:35:10.760013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.705230+0000","last_change":"2023-10-09T07:57:41.704409+0000","last_active":"2023-10-09T07:57:41.705230+0000","last_peered":"2023-10-09T07:57:41.705230+0000","last_clean":"2023-10-09T07:57:41.705230+0000","last_became_active":"2023-10-09T07:57:41.704155+0000","last_became_peered":"2023-10-09T07:57:41.704155+0000","last_unstale":"2023-10-09T07:57:41.705230+0000","last_undegraded":"2023-10-09T07:57:41.705230+0000","last_fullsized":"2023-10-09T07:57:41.705230+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:34.109204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.709880+0000","last_change":"2023-10-09T07:57:41.706009+0000","last_active":"2023-10-09T07:57:41.709880+0000","last_peered":"2023-10-09T07:57:41.709880+0000","last_clean":"2023-10-09T07:57:41.709880+0000","last_became_active":"2023-10-09T07:57:41.705743+0000","last_became_peered":"2023-10-09T07:57:41.705743+0000","last_unstale":"2023-10-09T07:57:41.709880+0000","last_undegraded":"2023-10-09T07:57:41.709880+0000","last_fullsized":"2023-10-09T07:57:41.709880+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:51.895142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.723923+0000","last_change":"2023-10-09T07:57:41.714888+0000","last_active":"2023-10-09T07:57:41.723923+0000","last_peered":"2023-10-09T07:57:41.723923+0000","last_clean":"2023-10-09T07:57:41.723923+0000","last_became_active":"2023-10-09T07:57:41.712340+0000","last_became_peered":"2023-10-09T07:57:41.712340+0000","last_unstale":"2023-10-09T07:57:41.723923+0000","last_undegraded":"2023-10-09T07:57:41.723923+0000","last_fullsized":"2023-10-09T07:57:41.723923+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:35:04.276802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.726276+0000","last_change":"2023-10-09T07:57:41.725182+0000","last_active":"2023-10-09T07:57:41.726276+0000","last_peered":"2023-10-09T07:57:41.726276+0000","last_clean":"2023-10-09T07:57:41.726276+0000","last_became_active":"2023-10-09T07:57:41.724923+0000","last_became_peered":"2023-10-09T07:57:41.724923+0000","last_unstale":"2023-10-09T07:57:41.726276+0000","last_undegraded":"2023-10-09T07:57:41.726276+0000","last_fullsized":"2023-10-09T07:57:41.726276+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:56.824398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.724211+0000","last_change":"2023-10-09T07:57:41.722257+0000","last_active":"2023-10-09T07:57:41.724211+0000","last_peered":"2023-10-09T07:57:41.724211+0000","last_clean":"2023-10-09T07:57:41.724211+0000","last_became_active":"2023-10-09T07:57:41.721999+0000","last_became_peered":"2023-10-09T07:57:41.721999+0000","last_unstale":"2023-10-09T07:57:41.724211+0000","last_undegraded":"2023-10-09T07:57:41.724211+0000","last_fullsized":"2023-10-09T07:57:41.724211+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:04:15.160860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.708262+0000","last_change":"2023-10-09T07:57:41.705106+0000","last_active":"2023-10-09T07:57:41.708262+0000","last_peered":"2023-10-09T07:57:41.708262+0000","last_clean":"2023-10-09T07:57:41.708262+0000","last_became_active":"2023-10-09T07:57:41.704766+0000","last_became_peered":"2023-10-09T07:57:41.704766+0000","last_unstale":"2023-10-09T07:57:41.708262+0000","last_undegraded":"2023-10-09T07:57:41.708262+0000","last_fullsized":"2023-10-09T07:57:41.708262+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:16.242855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.721978+0000","last_change":"2023-10-09T07:57:41.718833+0000","last_active":"2023-10-09T07:57:41.721978+0000","last_peered":"2023-10-09T07:57:41.721978+0000","last_clean":"2023-10-09T07:57:41.721978+0000","last_became_active":"2023-10-09T07:57:41.718121+0000","last_became_peered":"2023-10-09T07:57:41.718121+0000","last_unstale":"2023-10-09T07:57:41.721978+0000","last_undegraded":"2023-10-09T07:57:41.721978+0000","last_fullsized":"2023-10-09T07:57:41.721978+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:34.255144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.710306+0000","last_change":"2023-10-09T07:57:41.708926+0000","last_active":"2023-10-09T07:57:41.710306+0000","last_peered":"2023-10-09T07:57:41.710306+0000","last_clean":"2023-10-09T07:57:41.710306+0000","last_became_active":"2023-10-09T07:57:41.708647+0000","last_became_peered":"2023-10-09T07:57:41.708647+0000","last_unstale":"2023-10-09T07:57:41.710306+0000","last_undegraded":"2023-10-09T07:57:41.710306+0000","last_fullsized":"2023-10-09T07:57:41.710306+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:02.361772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.703711+0000","last_change":"2023-10-09T07:57:41.701332+0000","last_active":"2023-10-09T07:57:41.703711+0000","last_peered":"2023-10-09T07:57:41.703711+0000","last_clean":"2023-10-09T07:57:41.703711+0000","last_became_active":"2023-10-09T07:57:41.701055+0000","last_became_peered":"2023-10-09T07:57:41.701055+0000","last_unstale":"2023-10-09T07:57:41.703711+0000","last_undegraded":"2023-10-09T07:57:41.703711+0000","last_fullsized":"2023-10-09T07:57:41.703711+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:33.150152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.732229+0000","last_change":"2023-10-09T07:57:41.730658+0000","last_active":"2023-10-09T07:57:41.732229+0000","last_peered":"2023-10-09T07:57:41.732229+0000","last_clean":"2023-10-09T07:57:41.732229+0000","last_became_active":"2023-10-09T07:57:41.730407+0000","last_became_peered":"2023-10-09T07:57:41.730407+0000","last_unstale":"2023-10-09T07:57:41.732229+0000","last_undegraded":"2023-10-09T07:57:41.732229+0000","last_fullsized":"2023-10-09T07:57:41.732229+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:14.993912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.709916+0000","last_change":"2023-10-09T07:57:41.705282+0000","last_active":"2023-10-09T07:57:41.709916+0000","last_peered":"2023-10-09T07:57:41.709916+0000","last_clean":"2023-10-09T07:57:41.709916+0000","last_became_active":"2023-10-09T07:57:41.704997+0000","last_became_peered":"2023-10-09T07:57:41.704997+0000","last_unstale":"2023-10-09T07:57:41.709916+0000","last_undegraded":"2023-10-09T07:57:41.709916+0000","last_fullsized":"2023-10-09T07:57:41.709916+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:27.117499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.723953+0000","last_change":"2023-10-09T07:57:41.716182+0000","last_active":"2023-10-09T07:57:41.723953+0000","last_peered":"2023-10-09T07:57:41.723953+0000","last_clean":"2023-10-09T07:57:41.723953+0000","last_became_active":"2023-10-09T07:57:41.715924+0000","last_became_peered":"2023-10-09T07:57:41.715924+0000","last_unstale":"2023-10-09T07:57:41.723953+0000","last_undegraded":"2023-10-09T07:57:41.723953+0000","last_fullsized":"2023-10-09T07:57:41.723953+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:03:21.703878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.723894+0000","last_change":"2023-10-09T07:57:41.715422+0000","last_active":"2023-10-09T07:57:41.723894+0000","last_peered":"2023-10-09T07:57:41.723894+0000","last_clean":"2023-10-09T07:57:41.723894+0000","last_became_active":"2023-10-09T07:57:41.715162+0000","last_became_peered":"2023-10-09T07:57:41.715162+0000","last_unstale":"2023-10-09T07:57:41.723894+0000","last_undegraded":"2023-10-09T07:57:41.723894+0000","last_fullsized":"2023-10-09T07:57:41.723894+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:25:46.680708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.718752+0000","last_change":"2023-10-09T07:57:41.714598+0000","last_active":"2023-10-09T07:57:41.718752+0000","last_peered":"2023-10-09T07:57:41.718752+0000","last_clean":"2023-10-09T07:57:41.718752+0000","last_became_active":"2023-10-09T07:57:41.714352+0000","last_became_peered":"2023-10-09T07:57:41.714352+0000","last_unstale":"2023-10-09T07:57:41.718752+0000","last_undegraded":"2023-10-09T07:57:41.718752+0000","last_fullsized":"2023-10-09T07:57:41.718752+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:20.867454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.690610+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:16.698996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686328+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:53.914995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.725489+0000","last_change":"2023-10-09T07:57:40.702915+0000","last_active":"2023-10-09T07:57:41.725489+0000","last_peered":"2023-10-09T07:57:41.725489+0000","last_clean":"2023-10-09T07:57:41.725489+0000","last_became_active":"2023-10-09T07:57:40.702648+0000","last_became_peered":"2023-10-09T07:57:40.702648+0000","last_unstale":"2023-10-09T07:57:41.725489+0000","last_undegraded":"2023-10-09T07:57:41.725489+0000","last_fullsized":"2023-10-09T07:57:41.725489+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:38:00.181866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686216+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:00.330127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.718830+0000","last_change":"2023-10-09T07:57:41.713825+0000","last_active":"2023-10-09T07:57:41.718830+0000","last_peered":"2023-10-09T07:57:41.718830+0000","last_clean":"2023-10-09T07:57:41.718830+0000","last_became_active":"2023-10-09T07:57:41.713562+0000","last_became_peered":"2023-10-09T07:57:41.713562+0000","last_unstale":"2023-10-09T07:57:41.718830+0000","last_undegraded":"2023-10-09T07:57:41.718830+0000","last_fullsized":"2023-10-09T07:57:41.718830+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:40.405926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686239+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:42:59.410622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"162'1","reported_seq":11,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.730466+0000","last_change":"2023-10-09T07:57:40.699052+0000","last_active":"2023-10-09T07:57:41.730466+0000","last_peered":"2023-10-09T07:57:41.730466+0000","last_clean":"2023-10-09T07:57:41.730466+0000","last_became_active":"2023-10-09T07:57:40.698810+0000","last_became_peered":"2023-10-09T07:57:40.698810+0000","last_unstale":"2023-10-09T07:57:41.730466+0000","last_undegraded":"2023-10-09T07:57:41.730466+0000","last_fullsized":"2023-10-09T07:57:41.730466+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:42.240311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686488+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:51:23.776295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.685650+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:50:36.386674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.725099+0000","last_change":"2023-10-09T07:57:41.719951+0000","last_active":"2023-10-09T07:57:41.725099+0000","last_peered":"2023-10-09T07:57:41.725099+0000","last_clean":"2023-10-09T07:57:41.725099+0000","last_became_active":"2023-10-09T07:57:41.719693+0000","last_became_peered":"2023-10-09T07:57:41.719693+0000","last_unstale":"2023-10-09T07:57:41.725099+0000","last_undegraded":"2023-10-09T07:57:41.725099+0000","last_fullsized":"2023-10-09T07:57:41.725099+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:22:57.702842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.687332+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:45:51.888713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.710875+0000","last_change":"2023-10-09T07:57:40.709018+0000","last_active":"2023-10-09T07:57:41.710875+0000","last_peered":"2023-10-09T07:57:41.710875+0000","last_clean":"2023-10-09T07:57:41.710875+0000","last_became_active":"2023-10-09T07:57:40.708730+0000","last_became_peered":"2023-10-09T07:57:40.708730+0000","last_unstale":"2023-10-09T07:57:41.710875+0000","last_undegraded":"2023-10-09T07:57:41.710875+0000","last_fullsized":"2023-10-09T07:57:41.710875+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:26:00.505124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686086+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:28.657592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.688021+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:42.240311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.725434+0000","last_change":"2023-10-09T07:57:41.723182+0000","last_active":"2023-10-09T07:57:41.725434+0000","last_peered":"2023-10-09T07:57:41.725434+0000","last_clean":"2023-10-09T07:57:41.725434+0000","last_became_active":"2023-10-09T07:57:41.722923+0000","last_became_peered":"2023-10-09T07:57:41.722923+0000","last_unstale":"2023-10-09T07:57:41.725434+0000","last_undegraded":"2023-10-09T07:57:41.725434+0000","last_fullsized":"2023-10-09T07:57:41.725434+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:14.840671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.700480+0000","last_change":"2023-10-09T07:57:40.703377+0000","last_active":"2023-10-09T07:57:41.700480+0000","last_peered":"2023-10-09T07:57:41.700480+0000","last_clean":"2023-10-09T07:57:41.700480+0000","last_became_active":"2023-10-09T07:57:40.703117+0000","last_became_peered":"2023-10-09T07:57:40.703117+0000","last_unstale":"2023-10-09T07:57:41.700480+0000","last_undegraded":"2023-10-09T07:57:41.700480+0000","last_fullsized":"2023-10-09T07:57:41.700480+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:02:40.132873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.685623+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:15:18.393682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.688474+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:04.363976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686847+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:30.282993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.723040+0000","last_change":"2023-10-09T07:57:40.708690+0000","last_active":"2023-10-09T07:57:41.723040+0000","last_peered":"2023-10-09T07:57:41.723040+0000","last_clean":"2023-10-09T07:57:41.723040+0000","last_became_active":"2023-10-09T07:57:40.708436+0000","last_became_peered":"2023-10-09T07:57:40.708436+0000","last_unstale":"2023-10-09T07:57:41.723040+0000","last_undegraded":"2023-10-09T07:57:41.723040+0000","last_fullsized":"2023-10-09T07:57:41.723040+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:13:40.202625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.722860+0000","last_change":"2023-10-09T07:57:41.720822+0000","last_active":"2023-10-09T07:57:41.722860+0000","last_peered":"2023-10-09T07:57:41.722860+0000","last_clean":"2023-10-09T07:57:41.722860+0000","last_became_active":"2023-10-09T07:57:41.720549+0000","last_became_peered":"2023-10-09T07:57:41.720549+0000","last_unstale":"2023-10-09T07:57:41.722860+0000","last_undegraded":"2023-10-09T07:57:41.722860+0000","last_fullsized":"2023-10-09T07:57:41.722860+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:57:29.926980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686340+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:49.504100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686407+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:07:00.477516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.710062+0000","last_change":"2023-10-09T07:57:41.706326+0000","last_active":"2023-10-09T07:57:41.710062+0000","last_peered":"2023-10-09T07:57:41.710062+0000","last_clean":"2023-10-09T07:57:41.710062+0000","last_became_active":"2023-10-09T07:57:41.705955+0000","last_became_peered":"2023-10-09T07:57:41.705955+0000","last_unstale":"2023-10-09T07:57:41.710062+0000","last_undegraded":"2023-10-09T07:57:41.710062+0000","last_fullsized":"2023-10-09T07:57:41.710062+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:03:01.850852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686955+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:31:28.083757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.704271+0000","last_change":"2023-10-09T07:57:40.702948+0000","last_active":"2023-10-09T07:57:41.704271+0000","last_peered":"2023-10-09T07:57:41.704271+0000","last_clean":"2023-10-09T07:57:41.704271+0000","last_became_active":"2023-10-09T07:57:40.702709+0000","last_became_peered":"2023-10-09T07:57:40.702709+0000","last_unstale":"2023-10-09T07:57:41.704271+0000","last_undegraded":"2023-10-09T07:57:41.704271+0000","last_fullsized":"2023-10-09T07:57:41.704271+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:55:27.158449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.702743+0000","last_change":"2023-10-09T07:57:40.701038+0000","last_active":"2023-10-09T07:57:41.702743+0000","last_peered":"2023-10-09T07:57:41.702743+0000","last_clean":"2023-10-09T07:57:41.702743+0000","last_became_active":"2023-10-09T07:57:40.700766+0000","last_became_peered":"2023-10-09T07:57:40.700766+0000","last_unstale":"2023-10-09T07:57:41.702743+0000","last_undegraded":"2023-10-09T07:57:41.702743+0000","last_fullsized":"2023-10-09T07:57:41.702743+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:04.363976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.694520+0000","last_change":"2023-10-09T07:57:40.706333+0000","last_active":"2023-10-09T07:57:41.694520+0000","last_peered":"2023-10-09T07:57:41.694520+0000","last_clean":"2023-10-09T07:57:41.694520+0000","last_became_active":"2023-10-09T07:57:40.706065+0000","last_became_peered":"2023-10-09T07:57:40.706065+0000","last_unstale":"2023-10-09T07:57:41.694520+0000","last_undegraded":"2023-10-09T07:57:41.694520+0000","last_fullsized":"2023-10-09T07:57:41.694520+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:30:08.439237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.731563+0000","last_change":"2023-10-09T07:57:40.708157+0000","last_active":"2023-10-09T07:57:41.731563+0000","last_peered":"2023-10-09T07:57:41.731563+0000","last_clean":"2023-10-09T07:57:41.731563+0000","last_became_active":"2023-10-09T07:57:40.707886+0000","last_became_peered":"2023-10-09T07:57:40.707886+0000","last_unstale":"2023-10-09T07:57:41.731563+0000","last_undegraded":"2023-10-09T07:57:41.731563+0000","last_fullsized":"2023-10-09T07:57:41.731563+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:26.982485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.724509+0000","last_change":"2023-10-09T07:57:41.717479+0000","last_active":"2023-10-09T07:57:41.724509+0000","last_peered":"2023-10-09T07:57:41.724509+0000","last_clean":"2023-10-09T07:57:41.724509+0000","last_became_active":"2023-10-09T07:57:41.716849+0000","last_became_peered":"2023-10-09T07:57:41.716849+0000","last_unstale":"2023-10-09T07:57:41.724509+0000","last_undegraded":"2023-10-09T07:57:41.724509+0000","last_fullsized":"2023-10-09T07:57:41.724509+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:35.354061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.690567+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:08:08.948333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.685651+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:47:25.243183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.694719+0000","last_change":"2023-10-09T07:57:40.703859+0000","last_active":"2023-10-09T07:57:41.694719+0000","last_peered":"2023-10-09T07:57:41.694719+0000","last_clean":"2023-10-09T07:57:41.694719+0000","last_became_active":"2023-10-09T07:57:40.703554+0000","last_became_peered":"2023-10-09T07:57:40.703554+0000","last_unstale":"2023-10-09T07:57:41.694719+0000","last_undegraded":"2023-10-09T07:57:41.694719+0000","last_fullsized":"2023-10-09T07:57:41.694719+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:58.084800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.685687+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:52:43.023892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.691014+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:57:28.916749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.720069+0000","last_change":"2023-10-09T07:57:41.717075+0000","last_active":"2023-10-09T07:57:41.720069+0000","last_peered":"2023-10-09T07:57:41.720069+0000","last_clean":"2023-10-09T07:57:41.720069+0000","last_became_active":"2023-10-09T07:57:41.716822+0000","last_became_peered":"2023-10-09T07:57:41.716822+0000","last_unstale":"2023-10-09T07:57:41.720069+0000","last_undegraded":"2023-10-09T07:57:41.720069+0000","last_fullsized":"2023-10-09T07:57:41.720069+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:37:41.304881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.702813+0000","last_change":"2023-10-09T07:57:40.703705+0000","last_active":"2023-10-09T07:57:41.702813+0000","last_peered":"2023-10-09T07:57:41.702813+0000","last_clean":"2023-10-09T07:57:41.702813+0000","last_became_active":"2023-10-09T07:57:40.703459+0000","last_became_peered":"2023-10-09T07:57:40.703459+0000","last_unstale":"2023-10-09T07:57:41.702813+0000","last_undegraded":"2023-10-09T07:57:41.702813+0000","last_fullsized":"2023-10-09T07:57:41.702813+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:20:20.044507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.694634+0000","last_change":"2023-10-09T07:57:40.701414+0000","last_active":"2023-10-09T07:57:41.694634+0000","last_peered":"2023-10-09T07:57:41.694634+0000","last_clean":"2023-10-09T07:57:41.694634+0000","last_became_active":"2023-10-09T07:57:40.701089+0000","last_became_peered":"2023-10-09T07:57:40.701089+0000","last_unstale":"2023-10-09T07:57:41.694634+0000","last_undegraded":"2023-10-09T07:57:41.694634+0000","last_fullsized":"2023-10-09T07:57:41.694634+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:58:10.965338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.690942+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:33.244913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"152'271","reported_seq":829,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-09T07:57:38.217624+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T07:57:38.217624+0000","last_peered":"2023-10-09T07:57:38.217624+0000","last_clean":"2023-10-09T07:57:38.217624+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T07:57:38.217624+0000","last_undegraded":"2023-10-09T07:57:38.217624+0000","last_fullsized":"2023-10-09T07:57:38.217624+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":3},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575743,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307992,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063848,"statfs":{"total":96636764160,"available":96321380352,"internally_reserved":0,"allocated":2572288,"data_stored":1575965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.751,"15min":0.755},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1,"5min":1.016,"15min":1.127},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.47399999999999998},"max":{"1min":1.0029999999999999,"5min":1.026,"15min":1.1319999999999999},"last":0.63600000000000001}]},{"osd":1,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.74099999999999999,"15min":0.73799999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.46000000000000002},"max":{"1min":0.94199999999999995,"5min":1.002,"15min":1.077},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75,"15min":0.752},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.47399999999999998},"max":{"1min":0.95099999999999996,"5min":0.997,"15min":1.038},"last":0.748}]},{"osd":2,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.50600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.94899999999999995,"5min":1.016,"15min":1.0269999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.76600000000000001,"15min":0.76800000000000002},"min":{"1min":0.59699999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96599999999999997,"5min":0.98299999999999998,"15min":1.1899999999999999},"last":0.72299999999999998}]},{"osd":3,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.52700000000000002,"5min":0.49399999999999999,"15min":0.42099999999999999},"max":{"1min":0.995,"5min":0.995,"15min":1.04},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78900000000000003,"15min":0.79400000000000004},"min":{"1min":0.66100000000000003,"5min":0.55900000000000005,"15min":0.54400000000000004},"max":{"1min":1.0249999999999999,"5min":1.0529999999999999,"15min":1.0920000000000001},"last":0.80800000000000005}]},{"osd":4,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63400000000000001,"15min":0.62},"min":{"1min":0.433,"5min":0.42199999999999999,"15min":0.36299999999999999},"max":{"1min":0.85299999999999998,"5min":0.97099999999999997,"15min":1.248},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92500000000000004,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.434,"5min":0.41299999999999998,"15min":0.38700000000000001},"max":{"1min":0.874,"5min":0.98299999999999998,"15min":1.0600000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68600000000000005,"15min":0.69099999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92400000000000004,"5min":1.0009999999999999,"15min":1.304},"last":0.86899999999999999}]},{"osd":6,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.746,"15min":0.748},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89900000000000002,"5min":1.069,"15min":1.405},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.43099999999999999},"max":{"1min":0.96799999999999997,"5min":1.075,"15min":1.377},"last":0.85699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575742,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311508,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060332,"statfs":{"total":96636764160,"available":96317779968,"internally_reserved":0,"allocated":1978368,"data_stored":985597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77300000000000002,"15min":0.754},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.33600000000000002},"max":{"1min":0.88100000000000001,"5min":0.98399999999999999,"15min":1.012},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.55500000000000005,"5min":0.53900000000000003,"15min":0.49399999999999999},"max":{"1min":1.0049999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.75600000000000001}]},{"osd":1,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77700000000000002,"15min":0.77000000000000002},"min":{"1min":0.69099999999999995,"5min":0.53300000000000003,"15min":0.48199999999999998},"max":{"1min":0.93500000000000005,"5min":1.113,"15min":1.2769999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.78800000000000003,"15min":0.77000000000000002},"min":{"1min":0.59899999999999998,"5min":0.55400000000000005,"15min":0.501},"max":{"1min":0.98899999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.73199999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.77800000000000002,"15min":0.76000000000000001},"min":{"1min":0.57199999999999995,"5min":0.46100000000000002,"15min":0.432},"max":{"1min":0.88400000000000001,"5min":1.075,"15min":1.075},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80300000000000005,"15min":0.78100000000000003},"min":{"1min":0.63200000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95699999999999996,"5min":1.151,"15min":1.151},"last":0.67100000000000004}]},{"osd":3,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76800000000000002,"15min":0.75800000000000001},"min":{"1min":0.56100000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.877,"5min":1.423,"15min":1.423},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79400000000000004,"15min":0.78500000000000003},"min":{"1min":0.624,"5min":0.55500000000000005,"15min":0.54100000000000004},"max":{"1min":1.0269999999999999,"5min":1.335,"15min":1.335},"last":0.71099999999999997}]},{"osd":4,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.45800000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88900000000000001,"5min":0.98099999999999998,"15min":1.1279999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65500000000000003,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.89700000000000002,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97199999999999998,"5min":1.306,"15min":1.306},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70899999999999996,"15min":0.69899999999999995},"min":{"1min":0.55500000000000005,"5min":0.45400000000000001,"15min":0.42699999999999999},"max":{"1min":0.95199999999999996,"5min":1.054,"15min":1.085},"last":0.57799999999999996}]},{"osd":7,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.47699999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.80800000000000005,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.54400000000000004,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97399999999999998,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.60499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575743,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303328,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068512,"statfs":{"total":96636764160,"available":96326156288,"internally_reserved":0,"allocated":1990656,"data_stored":991866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48499999999999999,"15min":0.46800000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.308},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.52400000000000002,"15min":0.50700000000000001},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.313},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.41499999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.54800000000000004,"15min":0.51700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32900000000000001},"max":{"1min":5.1159999999999997,"5min":5.1159999999999997,"15min":5.1159999999999997},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.63600000000000001,"15min":0.59599999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.375},"max":{"1min":5.399,"5min":5.399,"15min":5.399},"last":0.443}]},{"osd":3,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.63900000000000001,"15min":0.63600000000000001},"min":{"1min":0.42999999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.41699999999999998,"5min":0.39900000000000002,"15min":0.37},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.499}]},{"osd":4,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.83899999999999997,"15min":0.80800000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.42699999999999999},"max":{"1min":5.2409999999999997,"5min":5.2409999999999997,"15min":5.2409999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.86599999999999999,"15min":0.82699999999999996},"min":{"1min":0.65700000000000003,"5min":0.622,"15min":0.56699999999999995},"max":{"1min":5.4409999999999998,"5min":5.4409999999999998,"15min":5.4409999999999998},"last":0.754}]},{"osd":5,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.81499999999999995,"15min":0.81100000000000005},"min":{"1min":0.64000000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.85499999999999998,"15min":0.82499999999999996},"min":{"1min":0.60299999999999998,"5min":0.57999999999999996,"15min":0.442},"max":{"1min":5.1630000000000003,"5min":5.1630000000000003,"15min":5.1630000000000003},"last":0.69799999999999995}]},{"osd":6,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.89300000000000002,"15min":0.84499999999999997},"min":{"1min":0.65300000000000002,"5min":0.63900000000000001,"15min":0.55100000000000005},"max":{"1min":5.4749999999999996,"5min":5.4749999999999996,"15min":5.4749999999999996},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83499999999999996,"15min":0.82999999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.60999999999999999}]},{"osd":7,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.56000000000000005},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.081,"5min":0.92800000000000005,"15min":0.88500000000000001},"min":{"1min":0.66500000000000004,"5min":0.63,"15min":0.55300000000000005},"max":{"1min":5.2009999999999996,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":0.74099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575743,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303944,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067896,"statfs":{"total":96636764160,"available":96325525504,"internally_reserved":0,"allocated":2621440,"data_stored":1602940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.49399999999999999,"15min":0.47799999999999998},"min":{"1min":0.37,"5min":0.29999999999999999,"15min":0.28799999999999998},"max":{"1min":0.69599999999999995,"5min":0.72099999999999997,"15min":0.86499999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32000000000000001},"max":{"1min":0.70599999999999996,"5min":0.82999999999999996,"15min":0.88200000000000001},"last":0.68899999999999995}]},{"osd":2,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.39800000000000002,"5min":0.38200000000000001,"15min":0.36799999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.91800000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.374,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66800000000000004,"5min":0.78700000000000003,"15min":0.82399999999999995},"last":0.52400000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.373},"max":{"1min":0.73199999999999998,"5min":0.84299999999999997,"15min":0.98599999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.61799999999999999,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86899999999999999,"5min":0.89600000000000002,"15min":0.94699999999999995},"last":0.64700000000000002}]},{"osd":4,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.64800000000000002,"5min":0.57799999999999996,"15min":0.52200000000000002},"max":{"1min":0.98499999999999999,"5min":1.1699999999999999,"15min":1.532},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82799999999999996,"15min":0.81899999999999995},"min":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.54200000000000004},"max":{"1min":1.0920000000000001,"5min":1.1339999999999999,"15min":1.2470000000000001},"last":0.76800000000000002}]},{"osd":5,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.80200000000000005,"15min":0.79700000000000004},"min":{"1min":0.59799999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0349999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.67200000000000004,"5min":0.59699999999999998,"15min":0.55500000000000005},"max":{"1min":1.1100000000000001,"5min":1.296,"15min":1.3009999999999999},"last":0.73299999999999998}]},{"osd":6,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.85699999999999998,"15min":0.83999999999999997},"min":{"1min":0.67100000000000004,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.048,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.81999999999999995,"15min":0.81899999999999995},"min":{"1min":0.59499999999999997,"5min":0.57699999999999996,"15min":0.51400000000000001},"max":{"1min":1.131,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.72399999999999998}]},{"osd":7,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.84699999999999998,"15min":0.85499999999999998},"min":{"1min":0.626,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":1.1020000000000001,"5min":1.246,"15min":1.3380000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.88800000000000001,"15min":0.86899999999999999},"min":{"1min":0.70199999999999996,"5min":0.61899999999999999,"15min":0.54400000000000004},"max":{"1min":1.1559999999999999,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.84899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575743,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311564,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060276,"statfs":{"total":96636764160,"available":96317722624,"internally_reserved":0,"allocated":2035712,"data_stored":1013160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.46899999999999997},"min":{"1min":0.33800000000000002,"5min":0.309,"15min":0.30199999999999999},"max":{"1min":0.71299999999999997,"5min":0.72099999999999997,"15min":0.84999999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.36499999999999999,"5min":0.35599999999999998,"15min":0.316},"max":{"1min":0.65700000000000003,"5min":0.76100000000000001,"15min":0.85599999999999998},"last":0.432}]},{"osd":1,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.35799999999999998,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.65000000000000002,"5min":0.68000000000000005,"15min":0.85399999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53600000000000003},"min":{"1min":0.41099999999999998,"5min":0.39400000000000002,"15min":0.34599999999999997},"max":{"1min":0.71799999999999997,"5min":0.78200000000000003,"15min":0.98699999999999999},"last":0.39600000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.47899999999999998,"5min":0.46600000000000003,"15min":0.41399999999999998},"max":{"1min":0.77600000000000002,"5min":0.79900000000000004,"15min":0.95199999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.49399999999999999,"5min":0.44500000000000001,"15min":0.40999999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.95099999999999996},"last":0.56100000000000005}]},{"osd":4,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79900000000000004,"15min":0.79600000000000004},"min":{"1min":0.58599999999999997,"5min":0.56299999999999994,"15min":0.54500000000000004},"max":{"1min":1.147,"5min":1.196,"15min":1.202},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.78600000000000003,"15min":0.78100000000000003},"min":{"1min":0.56200000000000006,"5min":0.54000000000000004,"15min":0.47799999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.141},"last":0.96099999999999997}]},{"osd":5,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81999999999999995,"15min":0.79200000000000004},"min":{"1min":0.63200000000000001,"5min":0.60799999999999998,"15min":0.57199999999999995},"max":{"1min":1.0489999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.82399999999999995,"15min":0.81499999999999995},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0640000000000001,"5min":1.254,"15min":1.254},"last":0.82599999999999996}]},{"osd":6,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82499999999999996,"15min":0.81000000000000005},"min":{"1min":0.63,"5min":0.56999999999999995,"15min":0.48099999999999998},"max":{"1min":1.0980000000000001,"5min":1.1639999999999999,"15min":1.296},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83399999999999996,"15min":0.81999999999999995},"min":{"1min":0.60399999999999998,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1000000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.84499999999999997,"15min":0.83499999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.53600000000000003},"max":{"1min":1.1719999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89700000000000002,"15min":0.874},"min":{"1min":0.73799999999999999,"5min":0.66500000000000004,"15min":0.65300000000000002},"max":{"1min":1.157,"5min":1.298,"15min":1.298},"last":0.78300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575744,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311564,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060276,"statfs":{"total":96636764160,"available":96317722624,"internally_reserved":0,"allocated":2035712,"data_stored":1012732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48799999999999999,"15min":0.48699999999999999},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.29599999999999999},"max":{"1min":0.624,"5min":0.77100000000000002,"15min":0.81899999999999995},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.35399999999999998,"5min":0.33500000000000002,"15min":0.32300000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.91700000000000004},"last":0.45100000000000001}]},{"osd":1,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.33700000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.84699999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.46100000000000002,"5min":0.38300000000000001,"15min":0.35599999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.47299999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.46600000000000003,"5min":0.42099999999999999,"15min":0.34999999999999998},"max":{"1min":0.75800000000000001,"5min":0.76000000000000001,"15min":0.90900000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65000000000000002,"15min":0.65200000000000002},"min":{"1min":0.53600000000000003,"5min":0.48399999999999999,"15min":0.40899999999999997},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.95799999999999996},"last":0.52900000000000003}]},{"osd":4,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78300000000000003,"15min":0.77200000000000002},"min":{"1min":0.58799999999999997,"5min":0.55000000000000004,"15min":0.47499999999999998},"max":{"1min":1.121,"5min":1.246,"15min":1.246},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.86399999999999999,"15min":0.85399999999999998},"min":{"1min":0.71899999999999997,"5min":0.629,"15min":0.57799999999999996},"max":{"1min":1.1419999999999999,"5min":1.157,"15min":1.157},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77400000000000002,"15min":0.76500000000000001},"min":{"1min":0.57399999999999995,"5min":0.52700000000000002,"15min":0.48499999999999999},"max":{"1min":1.0920000000000001,"5min":1.1140000000000001,"15min":1.1910000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.83199999999999996,"15min":0.82899999999999996},"min":{"1min":0.66900000000000004,"5min":0.63800000000000001,"15min":0.48899999999999999},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.81100000000000005,"15min":0.79600000000000004},"min":{"1min":0.623,"5min":0.57799999999999996,"15min":0.495},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82099999999999995,"15min":0.81499999999999995},"min":{"1min":0.65900000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.024,"5min":1.105,"15min":1.2230000000000001},"last":0.59299999999999997}]},{"osd":7,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.85899999999999999,"15min":0.84999999999999998},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.53100000000000003},"max":{"1min":1.1599999999999999,"5min":1.21,"15min":1.2430000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.85699999999999998,"15min":0.84799999999999998},"min":{"1min":0.72699999999999998,"5min":0.627,"15min":0.56699999999999995},"max":{"1min":1.179,"5min":1.179,"15min":1.1850000000000001},"last":0.77900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575742,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315604,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056236,"statfs":{"total":96636764160,"available":96313585664,"internally_reserved":0,"allocated":1978368,"data_stored":985597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73399999999999999,"15min":0.72399999999999998},"min":{"1min":0.54100000000000004,"5min":0.48799999999999999,"15min":0.41199999999999998},"max":{"1min":0.93600000000000005,"5min":1.052,"15min":1.0700000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.76600000000000001,"15min":0.76200000000000001},"min":{"1min":0.52700000000000002,"5min":0.501,"15min":0.49199999999999999},"max":{"1min":0.89000000000000001,"5min":1.0680000000000001,"15min":1.3320000000000001},"last":0.67000000000000004}]},{"osd":1,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.75,"15min":0.73499999999999999},"min":{"1min":0.59299999999999997,"5min":0.504,"15min":0.47499999999999998},"max":{"1min":0.90000000000000002,"5min":1.038,"15min":1.0640000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.752,"15min":0.747},"min":{"1min":0.57199999999999995,"5min":0.54400000000000004,"15min":0.48999999999999999},"max":{"1min":0.91400000000000003,"5min":1.028,"15min":1.242},"last":0.63400000000000001}]},{"osd":2,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.80500000000000005,"15min":0.79300000000000004},"min":{"1min":0.63500000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.97899999999999998,"5min":0.999,"15min":1.228},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.65300000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.99299999999999999,"5min":1.069,"15min":1.069},"last":0.94099999999999995}]},{"osd":3,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77700000000000002,"15min":0.76300000000000001},"min":{"1min":0.628,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.94699999999999995,"5min":1.131,"15min":1.151},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.56399999999999995,"5min":0.53800000000000003,"15min":0.53500000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.2110000000000001},"last":0.68799999999999994}]},{"osd":5,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.60699999999999998,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.372,"15min":0.36299999999999999},"max":{"1min":0.872,"5min":1.27,"15min":1.27},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.62,"15min":0.623},"min":{"1min":0.45600000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.79400000000000004,"5min":1.014,"15min":1.014},"last":0.45000000000000001}]},{"osd":6,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.5,"5min":0.46899999999999997,"15min":0.41699999999999998},"max":{"1min":0.95199999999999996,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.67800000000000005,"15min":0.67000000000000004},"min":{"1min":0.47999999999999998,"5min":0.45500000000000002,"15min":0.39000000000000001},"max":{"1min":0.92500000000000004,"5min":1.425,"15min":1.425},"last":0.72599999999999998}]},{"osd":7,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70399999999999996,"15min":0.72099999999999997},"min":{"1min":0.53500000000000003,"5min":0.48699999999999999,"15min":0.47999999999999998},"max":{"1min":0.81799999999999995,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76600000000000001,"15min":0.76300000000000001},"min":{"1min":0.57499999999999996,"5min":0.51200000000000001,"15min":0.46600000000000003},"max":{"1min":0.94299999999999995,"5min":1.0529999999999999,"15min":1.165},"last":0.89100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575743,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311508,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060332,"statfs":{"total":96636764160,"available":96317779968,"internally_reserved":0,"allocated":1978368,"data_stored":985597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.745,"15min":0.73199999999999998},"min":{"1min":0.55600000000000005,"5min":0.46200000000000002,"15min":0.39100000000000001},"max":{"1min":0.97199999999999998,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.621},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74199999999999999,"15min":0.72499999999999998},"min":{"1min":0.51100000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.0820000000000001},"last":0.60499999999999998}]},{"osd":1,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73399999999999999,"15min":0.73299999999999998},"min":{"1min":0.56899999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":0.97499999999999998,"15min":1.0129999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76300000000000001,"15min":0.75600000000000001},"min":{"1min":0.56599999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.0289999999999999},"last":0.70199999999999996}]},{"osd":2,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77100000000000002,"15min":0.75800000000000001},"min":{"1min":0.63400000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95399999999999996,"5min":0.95699999999999996,"15min":0.98599999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.5,"5min":0.5,"15min":0.44500000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":1.026},"last":0.54800000000000004}]},{"osd":3,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77800000000000002,"15min":0.76600000000000001},"min":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.47499999999999998},"max":{"1min":0.92200000000000004,"5min":0.97799999999999998,"15min":1.107},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79700000000000004,"15min":0.78500000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.96699999999999997,"5min":0.99099999999999999,"15min":1.0249999999999999},"last":0.58699999999999997}]},{"osd":4,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.61099999999999999,"15min":0.60599999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.82099999999999995,"5min":1.002,"15min":1.0189999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.625,"15min":0.61699999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.379},"max":{"1min":0.89200000000000002,"5min":0.96199999999999997,"15min":1.0289999999999999},"last":0.53100000000000003}]},{"osd":6,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64000000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.91400000000000003,"5min":0.95899999999999996,"15min":0.998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68700000000000006,"15min":0.67800000000000005},"min":{"1min":0.51200000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.054},"last":0.50600000000000001}]},{"osd":7,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.69499999999999995},"min":{"1min":0.47199999999999998,"5min":0.45000000000000001,"15min":0.433},"max":{"1min":0.93400000000000005,"5min":1.0449999999999999,"15min":1.073},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.79200000000000004,"15min":0.78500000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.5},"max":{"1min":1.0069999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.72199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T07:57:46.040 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T07:57:46.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.255+0000 7f612c5ff700 1 Processor -- start 2023-10-09T07:57:46.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.255+0000 7f612c5ff700 1 -- start start 2023-10-09T07:57:46.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.256+0000 7f612c5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f61241578b0 0x7f6124155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:46.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.256+0000 7f612c5ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61240ad930 con 0x7f61240af2f0 2023-10-09T07:57:46.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.256+0000 7f612c5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61240acd20 con 0x7f6124155c10 2023-10-09T07:57:46.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.256+0000 7f612c5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61240ad000 con 0x7f61241578b0 2023-10-09T07:57:46.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.257+0000 7f612ab9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f61240af2f0 0x7f61240af730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52028/0 (socket says 172.21.15.71:52028) 2023-10-09T07:57:46.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.257+0000 7f612ab9c700 1 -- 172.21.15.71:0/3866803371 learned_addr learned my addr 172.21.15.71:0/3866803371 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:46.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.257+0000 7f6129b9a700 1 --2- 172.21.15.71:0/3866803371 >> v2:172.21.15.179:3300/0 conn(0x7f61241578b0 0x7f6124155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:46.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.257+0000 7f6129399700 1 -- 172.21.15.71:0/3866803371 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4090949348 0 0) 0x7f61240ad930 con 0x7f61240af2f0 2023-10-09T07:57:46.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.257+0000 7f6129399700 1 -- 172.21.15.71:0/3866803371 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6110003570 con 0x7f61240af2f0 2023-10-09T07:57:46.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.257+0000 7f6129399700 1 -- 172.21.15.71:0/3866803371 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705670242 0 0) 0x7f61240acd20 con 0x7f6124155c10 2023-10-09T07:57:46.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.257+0000 7f6129399700 1 -- 172.21.15.71:0/3866803371 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61240ad930 con 0x7f6124155c10 2023-10-09T07:57:46.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.257+0000 7f6129b9a700 1 -- 172.21.15.71:0/3866803371 >> v1:172.21.15.179:6789/0 conn(0x7f6124155c10 legacy=0x7f61240ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:46.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.257+0000 7f6129b9a700 1 -- 172.21.15.71:0/3866803371 >> v1:172.21.15.71:6789/0 conn(0x7f61240af2f0 legacy=0x7f61240af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:46.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.257+0000 7f6129399700 1 -- 172.21.15.71:0/3866803371 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2091097890 0 0) 0x7f6110003570 con 0x7f61240af2f0 2023-10-09T07:57:46.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.257+0000 7f6129b9a700 1 -- 172.21.15.71:0/3866803371 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61240ad2e0 con 0x7f61241578b0 2023-10-09T07:57:46.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.258+0000 7f6129b9a700 1 --2- 172.21.15.71:0/3866803371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61241578b0 0x7f6124155fe0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f611400aa90 tx=0x7f611400a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62e3bcf61f882eca server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:46.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.258+0000 7f6129399700 1 -- 172.21.15.71:0/3866803371 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c0017f0 con 0x7f61241578b0 2023-10-09T07:57:46.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.258+0000 7f6129399700 1 -- 172.21.15.71:0/3866803371 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611400aed0 con 0x7f61241578b0 2023-10-09T07:57:46.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.258+0000 7f6129399700 1 -- 172.21.15.71:0/3866803371 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611400c870 con 0x7f61241578b0 2023-10-09T07:57:46.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.259+0000 7f612c5ff700 1 -- 172.21.15.71:0/3866803371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61241578b0 msgr2=0x7f6124155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:46.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.259+0000 7f612c5ff700 1 --2- 172.21.15.71:0/3866803371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61241578b0 0x7f6124155fe0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f611400aa90 tx=0x7f611400a330 comp rx=0 tx=0).stop 2023-10-09T07:57:46.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.259+0000 7f612c5ff700 1 -- 172.21.15.71:0/3866803371 shutdown_connections 2023-10-09T07:57:46.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.259+0000 7f612c5ff700 1 --2- 172.21.15.71:0/3866803371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61241578b0 0x7f6124155fe0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:46.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.259+0000 7f612c5ff700 1 -- 172.21.15.71:0/3866803371 >> 172.21.15.71:0/3866803371 conn(0x7f612406a320 msgr2=0x7f61240cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:46.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.259+0000 7f612c5ff700 1 -- 172.21.15.71:0/3866803371 shutdown_connections 2023-10-09T07:57:46.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.259+0000 7f612c5ff700 1 -- 172.21.15.71:0/3866803371 wait complete. 2023-10-09T07:57:46.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.260+0000 7f612c5ff700 1 Processor -- start 2023-10-09T07:57:46.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.260+0000 7f612c5ff700 1 -- start start 2023-10-09T07:57:46.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.261+0000 7f612c5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61240af2f0 0x7f612416e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:46.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.261+0000 7f612c5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6124155c10 0x7f612413de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:46.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.261+0000 7f612c5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61241578b0 0x7f6124152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:46.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.261+0000 7f612c5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6124152890 con 0x7f61240af2f0 2023-10-09T07:57:46.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.261+0000 7f612c5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6124159990 con 0x7f61241578b0 2023-10-09T07:57:46.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.261+0000 7f612c5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6124159c70 con 0x7f6124155c10 2023-10-09T07:57:46.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.261+0000 7f612a39b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61240af2f0 0x7f612416e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:46.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.262+0000 7f612a39b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61240af2f0 0x7f612416e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35514/0 (socket says 172.21.15.71:35514) 2023-10-09T07:57:46.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.262+0000 7f612a39b700 1 -- 172.21.15.71:0/1498164181 learned_addr learned my addr 172.21.15.71:0/1498164181 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:46.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.262+0000 7f612ab9c700 1 --2- 172.21.15.71:0/1498164181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61241578b0 0x7f6124152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:46.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.262+0000 7f6129b9a700 1 --2- 172.21.15.71:0/1498164181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6124155c10 0x7f612413de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:46.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.262+0000 7f612a39b700 1 -- 172.21.15.71:0/1498164181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6124155c10 msgr2=0x7f612413de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:46.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.262+0000 7f612a39b700 1 --2- 172.21.15.71:0/1498164181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6124155c10 0x7f612413de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:46.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.262+0000 7f612a39b700 1 -- 172.21.15.71:0/1498164181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61241578b0 msgr2=0x7f6124152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:46.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.262+0000 7f612a39b700 1 --2- 172.21.15.71:0/1498164181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61241578b0 0x7f6124152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:46.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.262+0000 7f612a39b700 1 -- 172.21.15.71:0/1498164181 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611400a5d0 con 0x7f61240af2f0 2023-10-09T07:57:46.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.262+0000 7f612a39b700 1 --2- 172.21.15.71:0/1498164181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61240af2f0 0x7f612416e0c0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f612000c7c0 tx=0x7f6120007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:46.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.262+0000 7f611a7fc700 1 -- 172.21.15.71:0/1498164181 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6120010510 con 0x7f61240af2f0 2023-10-09T07:57:46.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.262+0000 7f611a7fc700 1 -- 172.21.15.71:0/1498164181 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6120010690 con 0x7f61240af2f0 2023-10-09T07:57:46.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.262+0000 7f612c5ff700 1 -- 172.21.15.71:0/1498164181 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6124159f50 con 0x7f61240af2f0 2023-10-09T07:57:46.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.262+0000 7f611a7fc700 1 -- 172.21.15.71:0/1498164181 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6120010a50 con 0x7f61240af2f0 2023-10-09T07:57:46.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.263+0000 7f612c5ff700 1 -- 172.21.15.71:0/1498164181 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612415a510 con 0x7f61240af2f0 2023-10-09T07:57:46.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.264+0000 7f612c5ff700 1 -- 172.21.15.71:0/1498164181 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612415f350 con 0x7f61240af2f0 2023-10-09T07:57:46.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.265+0000 7f611a7fc700 1 -- 172.21.15.71:0/1498164181 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f612001b400 con 0x7f61240af2f0 2023-10-09T07:57:46.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.265+0000 7f611a7fc700 1 --2- 172.21.15.71:0/1498164181 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6108066f30 0x7f61080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:46.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.265+0000 7f611a7fc700 1 -- 172.21.15.71:0/1498164181 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f61200842f0 con 0x7f61240af2f0 2023-10-09T07:57:46.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.266+0000 7f6129b9a700 1 --2- 172.21.15.71:0/1498164181 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6108066f30 0x7f61080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:46.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.267+0000 7f6129b9a700 1 --2- 172.21.15.71:0/1498164181 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6108066f30 0x7f61080693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f611400a5a0 tx=0x7f6114019000 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:46.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.269+0000 7f611a7fc700 1 -- 172.21.15.71:0/1498164181 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6120051390 con 0x7f61240af2f0 2023-10-09T07:57:46.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.455+0000 7f612c5ff700 1 -- 172.21.15.71:0/1498164181 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f612404c3c0 con 0x7f6108066f30 2023-10-09T07:57:46.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.464+0000 7f611a7fc700 1 -- 172.21.15.71:0/1498164181 <== mgr.8071 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282677 (secure 0 0 0) 0x7f612404c3c0 con 0x7f6108066f30 2023-10-09T07:57:46.469 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:57:46.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.468+0000 7f612c5ff700 1 -- 172.21.15.71:0/1498164181 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6108066f30 msgr2=0x7f61080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:46.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.468+0000 7f612c5ff700 1 --2- 172.21.15.71:0/1498164181 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6108066f30 0x7f61080693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f611400a5a0 tx=0x7f6114019000 comp rx=0 tx=0).stop 2023-10-09T07:57:46.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.468+0000 7f612c5ff700 1 -- 172.21.15.71:0/1498164181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61240af2f0 msgr2=0x7f612416e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:46.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.468+0000 7f612c5ff700 1 --2- 172.21.15.71:0/1498164181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61240af2f0 0x7f612416e0c0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f612000c7c0 tx=0x7f6120007dc0 comp rx=0 tx=0).stop 2023-10-09T07:57:46.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.469+0000 7f612c5ff700 1 -- 172.21.15.71:0/1498164181 shutdown_connections 2023-10-09T07:57:46.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.469+0000 7f612c5ff700 1 --2- 172.21.15.71:0/1498164181 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6108066f30 0x7f61080693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:46.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.469+0000 7f612c5ff700 1 --2- 172.21.15.71:0/1498164181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61241578b0 0x7f6124152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:46.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.469+0000 7f612c5ff700 1 --2- 172.21.15.71:0/1498164181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61240af2f0 0x7f612416e0c0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:46.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.469+0000 7f612c5ff700 1 --2- 172.21.15.71:0/1498164181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6124155c10 0x7f612413de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:46.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.469+0000 7f612c5ff700 1 -- 172.21.15.71:0/1498164181 >> 172.21.15.71:0/1498164181 conn(0x7f612406a320 msgr2=0x7f61240b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:46.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.469+0000 7f612c5ff700 1 -- 172.21.15.71:0/1498164181 shutdown_connections 2023-10-09T07:57:46.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.469+0000 7f612c5ff700 1 -- 172.21.15.71:0/1498164181 wait complete. 2023-10-09T07:57:46.472 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T07:57:46.487 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T07:57:45.106001+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":448,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2477012,"kb_used_data":16788,"kb_used_omap":0,"kb_used_meta":2460160,"kb_avail":752497708,"statfs":{"total":773094113280,"available":770557652992,"internally_reserved":0,"allocated":17190912,"data_stored":9153454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2519203840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.422453"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.717854+0000","last_change":"2023-10-09T07:57:41.709955+0000","last_active":"2023-10-09T07:57:41.717854+0000","last_peered":"2023-10-09T07:57:41.717854+0000","last_clean":"2023-10-09T07:57:41.717854+0000","last_became_active":"2023-10-09T07:57:41.709619+0000","last_became_peered":"2023-10-09T07:57:41.709619+0000","last_unstale":"2023-10-09T07:57:41.717854+0000","last_undegraded":"2023-10-09T07:57:41.717854+0000","last_fullsized":"2023-10-09T07:57:41.717854+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:31:27.885208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.725286+0000","last_change":"2023-10-09T07:57:41.720928+0000","last_active":"2023-10-09T07:57:41.725286+0000","last_peered":"2023-10-09T07:57:41.725286+0000","last_clean":"2023-10-09T07:57:41.725286+0000","last_became_active":"2023-10-09T07:57:41.720641+0000","last_became_peered":"2023-10-09T07:57:41.720641+0000","last_unstale":"2023-10-09T07:57:41.725286+0000","last_undegraded":"2023-10-09T07:57:41.725286+0000","last_fullsized":"2023-10-09T07:57:41.725286+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:35:10.760013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.705230+0000","last_change":"2023-10-09T07:57:41.704409+0000","last_active":"2023-10-09T07:57:41.705230+0000","last_peered":"2023-10-09T07:57:41.705230+0000","last_clean":"2023-10-09T07:57:41.705230+0000","last_became_active":"2023-10-09T07:57:41.704155+0000","last_became_peered":"2023-10-09T07:57:41.704155+0000","last_unstale":"2023-10-09T07:57:41.705230+0000","last_undegraded":"2023-10-09T07:57:41.705230+0000","last_fullsized":"2023-10-09T07:57:41.705230+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:34.109204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.709880+0000","last_change":"2023-10-09T07:57:41.706009+0000","last_active":"2023-10-09T07:57:41.709880+0000","last_peered":"2023-10-09T07:57:41.709880+0000","last_clean":"2023-10-09T07:57:41.709880+0000","last_became_active":"2023-10-09T07:57:41.705743+0000","last_became_peered":"2023-10-09T07:57:41.705743+0000","last_unstale":"2023-10-09T07:57:41.709880+0000","last_undegraded":"2023-10-09T07:57:41.709880+0000","last_fullsized":"2023-10-09T07:57:41.709880+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:51.895142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.723923+0000","last_change":"2023-10-09T07:57:41.714888+0000","last_active":"2023-10-09T07:57:41.723923+0000","last_peered":"2023-10-09T07:57:41.723923+0000","last_clean":"2023-10-09T07:57:41.723923+0000","last_became_active":"2023-10-09T07:57:41.712340+0000","last_became_peered":"2023-10-09T07:57:41.712340+0000","last_unstale":"2023-10-09T07:57:41.723923+0000","last_undegraded":"2023-10-09T07:57:41.723923+0000","last_fullsized":"2023-10-09T07:57:41.723923+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:35:04.276802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.726276+0000","last_change":"2023-10-09T07:57:41.725182+0000","last_active":"2023-10-09T07:57:41.726276+0000","last_peered":"2023-10-09T07:57:41.726276+0000","last_clean":"2023-10-09T07:57:41.726276+0000","last_became_active":"2023-10-09T07:57:41.724923+0000","last_became_peered":"2023-10-09T07:57:41.724923+0000","last_unstale":"2023-10-09T07:57:41.726276+0000","last_undegraded":"2023-10-09T07:57:41.726276+0000","last_fullsized":"2023-10-09T07:57:41.726276+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:56.824398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.724211+0000","last_change":"2023-10-09T07:57:41.722257+0000","last_active":"2023-10-09T07:57:41.724211+0000","last_peered":"2023-10-09T07:57:41.724211+0000","last_clean":"2023-10-09T07:57:41.724211+0000","last_became_active":"2023-10-09T07:57:41.721999+0000","last_became_peered":"2023-10-09T07:57:41.721999+0000","last_unstale":"2023-10-09T07:57:41.724211+0000","last_undegraded":"2023-10-09T07:57:41.724211+0000","last_fullsized":"2023-10-09T07:57:41.724211+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:04:15.160860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.708262+0000","last_change":"2023-10-09T07:57:41.705106+0000","last_active":"2023-10-09T07:57:41.708262+0000","last_peered":"2023-10-09T07:57:41.708262+0000","last_clean":"2023-10-09T07:57:41.708262+0000","last_became_active":"2023-10-09T07:57:41.704766+0000","last_became_peered":"2023-10-09T07:57:41.704766+0000","last_unstale":"2023-10-09T07:57:41.708262+0000","last_undegraded":"2023-10-09T07:57:41.708262+0000","last_fullsized":"2023-10-09T07:57:41.708262+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:16.242855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.721978+0000","last_change":"2023-10-09T07:57:41.718833+0000","last_active":"2023-10-09T07:57:41.721978+0000","last_peered":"2023-10-09T07:57:41.721978+0000","last_clean":"2023-10-09T07:57:41.721978+0000","last_became_active":"2023-10-09T07:57:41.718121+0000","last_became_peered":"2023-10-09T07:57:41.718121+0000","last_unstale":"2023-10-09T07:57:41.721978+0000","last_undegraded":"2023-10-09T07:57:41.721978+0000","last_fullsized":"2023-10-09T07:57:41.721978+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:34.255144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.710306+0000","last_change":"2023-10-09T07:57:41.708926+0000","last_active":"2023-10-09T07:57:41.710306+0000","last_peered":"2023-10-09T07:57:41.710306+0000","last_clean":"2023-10-09T07:57:41.710306+0000","last_became_active":"2023-10-09T07:57:41.708647+0000","last_became_peered":"2023-10-09T07:57:41.708647+0000","last_unstale":"2023-10-09T07:57:41.710306+0000","last_undegraded":"2023-10-09T07:57:41.710306+0000","last_fullsized":"2023-10-09T07:57:41.710306+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:02.361772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.703711+0000","last_change":"2023-10-09T07:57:41.701332+0000","last_active":"2023-10-09T07:57:41.703711+0000","last_peered":"2023-10-09T07:57:41.703711+0000","last_clean":"2023-10-09T07:57:41.703711+0000","last_became_active":"2023-10-09T07:57:41.701055+0000","last_became_peered":"2023-10-09T07:57:41.701055+0000","last_unstale":"2023-10-09T07:57:41.703711+0000","last_undegraded":"2023-10-09T07:57:41.703711+0000","last_fullsized":"2023-10-09T07:57:41.703711+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:33.150152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.732229+0000","last_change":"2023-10-09T07:57:41.730658+0000","last_active":"2023-10-09T07:57:41.732229+0000","last_peered":"2023-10-09T07:57:41.732229+0000","last_clean":"2023-10-09T07:57:41.732229+0000","last_became_active":"2023-10-09T07:57:41.730407+0000","last_became_peered":"2023-10-09T07:57:41.730407+0000","last_unstale":"2023-10-09T07:57:41.732229+0000","last_undegraded":"2023-10-09T07:57:41.732229+0000","last_fullsized":"2023-10-09T07:57:41.732229+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:14.993912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.709916+0000","last_change":"2023-10-09T07:57:41.705282+0000","last_active":"2023-10-09T07:57:41.709916+0000","last_peered":"2023-10-09T07:57:41.709916+0000","last_clean":"2023-10-09T07:57:41.709916+0000","last_became_active":"2023-10-09T07:57:41.704997+0000","last_became_peered":"2023-10-09T07:57:41.704997+0000","last_unstale":"2023-10-09T07:57:41.709916+0000","last_undegraded":"2023-10-09T07:57:41.709916+0000","last_fullsized":"2023-10-09T07:57:41.709916+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:27.117499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.723953+0000","last_change":"2023-10-09T07:57:41.716182+0000","last_active":"2023-10-09T07:57:41.723953+0000","last_peered":"2023-10-09T07:57:41.723953+0000","last_clean":"2023-10-09T07:57:41.723953+0000","last_became_active":"2023-10-09T07:57:41.715924+0000","last_became_peered":"2023-10-09T07:57:41.715924+0000","last_unstale":"2023-10-09T07:57:41.723953+0000","last_undegraded":"2023-10-09T07:57:41.723953+0000","last_fullsized":"2023-10-09T07:57:41.723953+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:03:21.703878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.723894+0000","last_change":"2023-10-09T07:57:41.715422+0000","last_active":"2023-10-09T07:57:41.723894+0000","last_peered":"2023-10-09T07:57:41.723894+0000","last_clean":"2023-10-09T07:57:41.723894+0000","last_became_active":"2023-10-09T07:57:41.715162+0000","last_became_peered":"2023-10-09T07:57:41.715162+0000","last_unstale":"2023-10-09T07:57:41.723894+0000","last_undegraded":"2023-10-09T07:57:41.723894+0000","last_fullsized":"2023-10-09T07:57:41.723894+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:25:46.680708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.718752+0000","last_change":"2023-10-09T07:57:41.714598+0000","last_active":"2023-10-09T07:57:41.718752+0000","last_peered":"2023-10-09T07:57:41.718752+0000","last_clean":"2023-10-09T07:57:41.718752+0000","last_became_active":"2023-10-09T07:57:41.714352+0000","last_became_peered":"2023-10-09T07:57:41.714352+0000","last_unstale":"2023-10-09T07:57:41.718752+0000","last_undegraded":"2023-10-09T07:57:41.718752+0000","last_fullsized":"2023-10-09T07:57:41.718752+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:20.867454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.690610+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:16.698996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686328+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:53.914995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.725489+0000","last_change":"2023-10-09T07:57:40.702915+0000","last_active":"2023-10-09T07:57:41.725489+0000","last_peered":"2023-10-09T07:57:41.725489+0000","last_clean":"2023-10-09T07:57:41.725489+0000","last_became_active":"2023-10-09T07:57:40.702648+0000","last_became_peered":"2023-10-09T07:57:40.702648+0000","last_unstale":"2023-10-09T07:57:41.725489+0000","last_undegraded":"2023-10-09T07:57:41.725489+0000","last_fullsized":"2023-10-09T07:57:41.725489+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:38:00.181866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686216+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:00.330127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.718830+0000","last_change":"2023-10-09T07:57:41.713825+0000","last_active":"2023-10-09T07:57:41.718830+0000","last_peered":"2023-10-09T07:57:41.718830+0000","last_clean":"2023-10-09T07:57:41.718830+0000","last_became_active":"2023-10-09T07:57:41.713562+0000","last_became_peered":"2023-10-09T07:57:41.713562+0000","last_unstale":"2023-10-09T07:57:41.718830+0000","last_undegraded":"2023-10-09T07:57:41.718830+0000","last_fullsized":"2023-10-09T07:57:41.718830+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:40.405926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686239+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:42:59.410622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"162'1","reported_seq":11,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.730466+0000","last_change":"2023-10-09T07:57:40.699052+0000","last_active":"2023-10-09T07:57:41.730466+0000","last_peered":"2023-10-09T07:57:41.730466+0000","last_clean":"2023-10-09T07:57:41.730466+0000","last_became_active":"2023-10-09T07:57:40.698810+0000","last_became_peered":"2023-10-09T07:57:40.698810+0000","last_unstale":"2023-10-09T07:57:41.730466+0000","last_undegraded":"2023-10-09T07:57:41.730466+0000","last_fullsized":"2023-10-09T07:57:41.730466+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:42.240311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686488+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:51:23.776295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.685650+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:50:36.386674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.725099+0000","last_change":"2023-10-09T07:57:41.719951+0000","last_active":"2023-10-09T07:57:41.725099+0000","last_peered":"2023-10-09T07:57:41.725099+0000","last_clean":"2023-10-09T07:57:41.725099+0000","last_became_active":"2023-10-09T07:57:41.719693+0000","last_became_peered":"2023-10-09T07:57:41.719693+0000","last_unstale":"2023-10-09T07:57:41.725099+0000","last_undegraded":"2023-10-09T07:57:41.725099+0000","last_fullsized":"2023-10-09T07:57:41.725099+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:22:57.702842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.687332+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:45:51.888713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.710875+0000","last_change":"2023-10-09T07:57:40.709018+0000","last_active":"2023-10-09T07:57:41.710875+0000","last_peered":"2023-10-09T07:57:41.710875+0000","last_clean":"2023-10-09T07:57:41.710875+0000","last_became_active":"2023-10-09T07:57:40.708730+0000","last_became_peered":"2023-10-09T07:57:40.708730+0000","last_unstale":"2023-10-09T07:57:41.710875+0000","last_undegraded":"2023-10-09T07:57:41.710875+0000","last_fullsized":"2023-10-09T07:57:41.710875+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:26:00.505124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686086+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:28.657592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.688021+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:42.240311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.725434+0000","last_change":"2023-10-09T07:57:41.723182+0000","last_active":"2023-10-09T07:57:41.725434+0000","last_peered":"2023-10-09T07:57:41.725434+0000","last_clean":"2023-10-09T07:57:41.725434+0000","last_became_active":"2023-10-09T07:57:41.722923+0000","last_became_peered":"2023-10-09T07:57:41.722923+0000","last_unstale":"2023-10-09T07:57:41.725434+0000","last_undegraded":"2023-10-09T07:57:41.725434+0000","last_fullsized":"2023-10-09T07:57:41.725434+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:14.840671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.700480+0000","last_change":"2023-10-09T07:57:40.703377+0000","last_active":"2023-10-09T07:57:41.700480+0000","last_peered":"2023-10-09T07:57:41.700480+0000","last_clean":"2023-10-09T07:57:41.700480+0000","last_became_active":"2023-10-09T07:57:40.703117+0000","last_became_peered":"2023-10-09T07:57:40.703117+0000","last_unstale":"2023-10-09T07:57:41.700480+0000","last_undegraded":"2023-10-09T07:57:41.700480+0000","last_fullsized":"2023-10-09T07:57:41.700480+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:02:40.132873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.685623+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:15:18.393682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.688474+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:04.363976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686847+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:30.282993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.723040+0000","last_change":"2023-10-09T07:57:40.708690+0000","last_active":"2023-10-09T07:57:41.723040+0000","last_peered":"2023-10-09T07:57:41.723040+0000","last_clean":"2023-10-09T07:57:41.723040+0000","last_became_active":"2023-10-09T07:57:40.708436+0000","last_became_peered":"2023-10-09T07:57:40.708436+0000","last_unstale":"2023-10-09T07:57:41.723040+0000","last_undegraded":"2023-10-09T07:57:41.723040+0000","last_fullsized":"2023-10-09T07:57:41.723040+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:13:40.202625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.722860+0000","last_change":"2023-10-09T07:57:41.720822+0000","last_active":"2023-10-09T07:57:41.722860+0000","last_peered":"2023-10-09T07:57:41.722860+0000","last_clean":"2023-10-09T07:57:41.722860+0000","last_became_active":"2023-10-09T07:57:41.720549+0000","last_became_peered":"2023-10-09T07:57:41.720549+0000","last_unstale":"2023-10-09T07:57:41.722860+0000","last_undegraded":"2023-10-09T07:57:41.722860+0000","last_fullsized":"2023-10-09T07:57:41.722860+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:57:29.926980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686340+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:49.504100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686407+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:07:00.477516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.710062+0000","last_change":"2023-10-09T07:57:41.706326+0000","last_active":"2023-10-09T07:57:41.710062+0000","last_peered":"2023-10-09T07:57:41.710062+0000","last_clean":"2023-10-09T07:57:41.710062+0000","last_became_active":"2023-10-09T07:57:41.705955+0000","last_became_peered":"2023-10-09T07:57:41.705955+0000","last_unstale":"2023-10-09T07:57:41.710062+0000","last_undegraded":"2023-10-09T07:57:41.710062+0000","last_fullsized":"2023-10-09T07:57:41.710062+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:03:01.850852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686955+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:31:28.083757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.704271+0000","last_change":"2023-10-09T07:57:40.702948+0000","last_active":"2023-10-09T07:57:41.704271+0000","last_peered":"2023-10-09T07:57:41.704271+0000","last_clean":"2023-10-09T07:57:41.704271+0000","last_became_active":"2023-10-09T07:57:40.702709+0000","last_became_peered":"2023-10-09T07:57:40.702709+0000","last_unstale":"2023-10-09T07:57:41.704271+0000","last_undegraded":"2023-10-09T07:57:41.704271+0000","last_fullsized":"2023-10-09T07:57:41.704271+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:55:27.158449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.702743+0000","last_change":"2023-10-09T07:57:40.701038+0000","last_active":"2023-10-09T07:57:41.702743+0000","last_peered":"2023-10-09T07:57:41.702743+0000","last_clean":"2023-10-09T07:57:41.702743+0000","last_became_active":"2023-10-09T07:57:40.700766+0000","last_became_peered":"2023-10-09T07:57:40.700766+0000","last_unstale":"2023-10-09T07:57:41.702743+0000","last_undegraded":"2023-10-09T07:57:41.702743+0000","last_fullsized":"2023-10-09T07:57:41.702743+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:04.363976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.694520+0000","last_change":"2023-10-09T07:57:40.706333+0000","last_active":"2023-10-09T07:57:41.694520+0000","last_peered":"2023-10-09T07:57:41.694520+0000","last_clean":"2023-10-09T07:57:41.694520+0000","last_became_active":"2023-10-09T07:57:40.706065+0000","last_became_peered":"2023-10-09T07:57:40.706065+0000","last_unstale":"2023-10-09T07:57:41.694520+0000","last_undegraded":"2023-10-09T07:57:41.694520+0000","last_fullsized":"2023-10-09T07:57:41.694520+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:30:08.439237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.731563+0000","last_change":"2023-10-09T07:57:40.708157+0000","last_active":"2023-10-09T07:57:41.731563+0000","last_peered":"2023-10-09T07:57:41.731563+0000","last_clean":"2023-10-09T07:57:41.731563+0000","last_became_active":"2023-10-09T07:57:40.707886+0000","last_became_peered":"2023-10-09T07:57:40.707886+0000","last_unstale":"2023-10-09T07:57:41.731563+0000","last_undegraded":"2023-10-09T07:57:41.731563+0000","last_fullsized":"2023-10-09T07:57:41.731563+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:26.982485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.724509+0000","last_change":"2023-10-09T07:57:41.717479+0000","last_active":"2023-10-09T07:57:41.724509+0000","last_peered":"2023-10-09T07:57:41.724509+0000","last_clean":"2023-10-09T07:57:41.724509+0000","last_became_active":"2023-10-09T07:57:41.716849+0000","last_became_peered":"2023-10-09T07:57:41.716849+0000","last_unstale":"2023-10-09T07:57:41.724509+0000","last_undegraded":"2023-10-09T07:57:41.724509+0000","last_fullsized":"2023-10-09T07:57:41.724509+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:35.354061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.690567+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:08:08.948333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.685651+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:47:25.243183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.694719+0000","last_change":"2023-10-09T07:57:40.703859+0000","last_active":"2023-10-09T07:57:41.694719+0000","last_peered":"2023-10-09T07:57:41.694719+0000","last_clean":"2023-10-09T07:57:41.694719+0000","last_became_active":"2023-10-09T07:57:40.703554+0000","last_became_peered":"2023-10-09T07:57:40.703554+0000","last_unstale":"2023-10-09T07:57:41.694719+0000","last_undegraded":"2023-10-09T07:57:41.694719+0000","last_fullsized":"2023-10-09T07:57:41.694719+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:58.084800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.685687+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:52:43.023892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.691014+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:57:28.916749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.720069+0000","last_change":"2023-10-09T07:57:41.717075+0000","last_active":"2023-10-09T07:57:41.720069+0000","last_peered":"2023-10-09T07:57:41.720069+0000","last_clean":"2023-10-09T07:57:41.720069+0000","last_became_active":"2023-10-09T07:57:41.716822+0000","last_became_peered":"2023-10-09T07:57:41.716822+0000","last_unstale":"2023-10-09T07:57:41.720069+0000","last_undegraded":"2023-10-09T07:57:41.720069+0000","last_fullsized":"2023-10-09T07:57:41.720069+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:37:41.304881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.702813+0000","last_change":"2023-10-09T07:57:40.703705+0000","last_active":"2023-10-09T07:57:41.702813+0000","last_peered":"2023-10-09T07:57:41.702813+0000","last_clean":"2023-10-09T07:57:41.702813+0000","last_became_active":"2023-10-09T07:57:40.703459+0000","last_became_peered":"2023-10-09T07:57:40.703459+0000","last_unstale":"2023-10-09T07:57:41.702813+0000","last_undegraded":"2023-10-09T07:57:41.702813+0000","last_fullsized":"2023-10-09T07:57:41.702813+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:20:20.044507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.694634+0000","last_change":"2023-10-09T07:57:40.701414+0000","last_active":"2023-10-09T07:57:41.694634+0000","last_peered":"2023-10-09T07:57:41.694634+0000","last_clean":"2023-10-09T07:57:41.694634+0000","last_became_active":"2023-10-09T07:57:40.701089+0000","last_became_peered":"2023-10-09T07:57:40.701089+0000","last_unstale":"2023-10-09T07:57:41.694634+0000","last_undegraded":"2023-10-09T07:57:41.694634+0000","last_fullsized":"2023-10-09T07:57:41.694634+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:58:10.965338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.690942+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:33.244913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"152'271","reported_seq":829,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-09T07:57:38.217624+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T07:57:38.217624+0000","last_peered":"2023-10-09T07:57:38.217624+0000","last_clean":"2023-10-09T07:57:38.217624+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T07:57:38.217624+0000","last_undegraded":"2023-10-09T07:57:38.217624+0000","last_fullsized":"2023-10-09T07:57:38.217624+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":3},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575743,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307992,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063848,"statfs":{"total":96636764160,"available":96321380352,"internally_reserved":0,"allocated":2572288,"data_stored":1575965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.751,"15min":0.755},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1,"5min":1.016,"15min":1.127},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.47399999999999998},"max":{"1min":1.0029999999999999,"5min":1.026,"15min":1.1319999999999999},"last":0.63600000000000001}]},{"osd":1,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.74099999999999999,"15min":0.73799999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.46000000000000002},"max":{"1min":0.94199999999999995,"5min":1.002,"15min":1.077},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75,"15min":0.752},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.47399999999999998},"max":{"1min":0.95099999999999996,"5min":0.997,"15min":1.038},"last":0.748}]},{"osd":2,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.50600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.94899999999999995,"5min":1.016,"15min":1.0269999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.76600000000000001,"15min":0.76800000000000002},"min":{"1min":0.59699999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96599999999999997,"5min":0.98299999999999998,"15min":1.1899999999999999},"last":0.72299999999999998}]},{"osd":3,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.52700000000000002,"5min":0.49399999999999999,"15min":0.42099999999999999},"max":{"1min":0.995,"5min":0.995,"15min":1.04},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78900000000000003,"15min":0.79400000000000004},"min":{"1min":0.66100000000000003,"5min":0.55900000000000005,"15min":0.54400000000000004},"max":{"1min":1.0249999999999999,"5min":1.0529999999999999,"15min":1.0920000000000001},"last":0.80800000000000005}]},{"osd":4,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63400000000000001,"15min":0.62},"min":{"1min":0.433,"5min":0.42199999999999999,"15min":0.36299999999999999},"max":{"1min":0.85299999999999998,"5min":0.97099999999999997,"15min":1.248},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92500000000000004,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.434,"5min":0.41299999999999998,"15min":0.38700000000000001},"max":{"1min":0.874,"5min":0.98299999999999998,"15min":1.0600000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68600000000000005,"15min":0.69099999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92400000000000004,"5min":1.0009999999999999,"15min":1.304},"last":0.86899999999999999}]},{"osd":6,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.746,"15min":0.748},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89900000000000002,"5min":1.069,"15min":1.405},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.43099999999999999},"max":{"1min":0.96799999999999997,"5min":1.075,"15min":1.377},"last":0.85699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575742,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311508,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060332,"statfs":{"total":96636764160,"available":96317779968,"internally_reserved":0,"allocated":1978368,"data_stored":985597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77300000000000002,"15min":0.754},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.33600000000000002},"max":{"1min":0.88100000000000001,"5min":0.98399999999999999,"15min":1.012},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.55500000000000005,"5min":0.53900000000000003,"15min":0.49399999999999999},"max":{"1min":1.0049999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.75600000000000001}]},{"osd":1,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77700000000000002,"15min":0.77000000000000002},"min":{"1min":0.69099999999999995,"5min":0.53300000000000003,"15min":0.48199999999999998},"max":{"1min":0.93500000000000005,"5min":1.113,"15min":1.2769999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.78800000000000003,"15min":0.77000000000000002},"min":{"1min":0.59899999999999998,"5min":0.55400000000000005,"15min":0.501},"max":{"1min":0.98899999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.73199999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.77800000000000002,"15min":0.76000000000000001},"min":{"1min":0.57199999999999995,"5min":0.46100000000000002,"15min":0.432},"max":{"1min":0.88400000000000001,"5min":1.075,"15min":1.075},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80300000000000005,"15min":0.78100000000000003},"min":{"1min":0.63200000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95699999999999996,"5min":1.151,"15min":1.151},"last":0.67100000000000004}]},{"osd":3,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76800000000000002,"15min":0.75800000000000001},"min":{"1min":0.56100000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.877,"5min":1.423,"15min":1.423},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79400000000000004,"15min":0.78500000000000003},"min":{"1min":0.624,"5min":0.55500000000000005,"15min":0.54100000000000004},"max":{"1min":1.0269999999999999,"5min":1.335,"15min":1.335},"last":0.71099999999999997}]},{"osd":4,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.45800000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88900000000000001,"5min":0.98099999999999998,"15min":1.1279999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65500000000000003,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.89700000000000002,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97199999999999998,"5min":1.306,"15min":1.306},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70899999999999996,"15min":0.69899999999999995},"min":{"1min":0.55500000000000005,"5min":0.45400000000000001,"15min":0.42699999999999999},"max":{"1min":0.95199999999999996,"5min":1.054,"15min":1.085},"last":0.57799999999999996}]},{"osd":7,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.47699999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.80800000000000005,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.54400000000000004,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97399999999999998,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.60499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575743,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303328,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068512,"statfs":{"total":96636764160,"available":96326156288,"internally_reserved":0,"allocated":1990656,"data_stored":991866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48499999999999999,"15min":0.46800000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.308},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.52400000000000002,"15min":0.50700000000000001},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.313},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.41499999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.54800000000000004,"15min":0.51700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32900000000000001},"max":{"1min":5.1159999999999997,"5min":5.1159999999999997,"15min":5.1159999999999997},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.63600000000000001,"15min":0.59599999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.375},"max":{"1min":5.399,"5min":5.399,"15min":5.399},"last":0.443}]},{"osd":3,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.63900000000000001,"15min":0.63600000000000001},"min":{"1min":0.42999999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.41699999999999998,"5min":0.39900000000000002,"15min":0.37},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.499}]},{"osd":4,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.83899999999999997,"15min":0.80800000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.42699999999999999},"max":{"1min":5.2409999999999997,"5min":5.2409999999999997,"15min":5.2409999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.86599999999999999,"15min":0.82699999999999996},"min":{"1min":0.65700000000000003,"5min":0.622,"15min":0.56699999999999995},"max":{"1min":5.4409999999999998,"5min":5.4409999999999998,"15min":5.4409999999999998},"last":0.754}]},{"osd":5,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.81499999999999995,"15min":0.81100000000000005},"min":{"1min":0.64000000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.85499999999999998,"15min":0.82499999999999996},"min":{"1min":0.60299999999999998,"5min":0.57999999999999996,"15min":0.442},"max":{"1min":5.1630000000000003,"5min":5.1630000000000003,"15min":5.1630000000000003},"last":0.69799999999999995}]},{"osd":6,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.89300000000000002,"15min":0.84499999999999997},"min":{"1min":0.65300000000000002,"5min":0.63900000000000001,"15min":0.55100000000000005},"max":{"1min":5.4749999999999996,"5min":5.4749999999999996,"15min":5.4749999999999996},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83499999999999996,"15min":0.82999999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.60999999999999999}]},{"osd":7,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.56000000000000005},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.081,"5min":0.92800000000000005,"15min":0.88500000000000001},"min":{"1min":0.66500000000000004,"5min":0.63,"15min":0.55300000000000005},"max":{"1min":5.2009999999999996,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":0.74099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575743,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303944,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067896,"statfs":{"total":96636764160,"available":96325525504,"internally_reserved":0,"allocated":2621440,"data_stored":1602940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.49399999999999999,"15min":0.47799999999999998},"min":{"1min":0.37,"5min":0.29999999999999999,"15min":0.28799999999999998},"max":{"1min":0.69599999999999995,"5min":0.72099999999999997,"15min":0.86499999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32000000000000001},"max":{"1min":0.70599999999999996,"5min":0.82999999999999996,"15min":0.88200000000000001},"last":0.68899999999999995}]},{"osd":2,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.39800000000000002,"5min":0.38200000000000001,"15min":0.36799999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.91800000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.374,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66800000000000004,"5min":0.78700000000000003,"15min":0.82399999999999995},"last":0.52400000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.373},"max":{"1min":0.73199999999999998,"5min":0.84299999999999997,"15min":0.98599999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.61799999999999999,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86899999999999999,"5min":0.89600000000000002,"15min":0.94699999999999995},"last":0.64700000000000002}]},{"osd":4,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.64800000000000002,"5min":0.57799999999999996,"15min":0.52200000000000002},"max":{"1min":0.98499999999999999,"5min":1.1699999999999999,"15min":1.532},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82799999999999996,"15min":0.81899999999999995},"min":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.54200000000000004},"max":{"1min":1.0920000000000001,"5min":1.1339999999999999,"15min":1.2470000000000001},"last":0.76800000000000002}]},{"osd":5,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.80200000000000005,"15min":0.79700000000000004},"min":{"1min":0.59799999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0349999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.67200000000000004,"5min":0.59699999999999998,"15min":0.55500000000000005},"max":{"1min":1.1100000000000001,"5min":1.296,"15min":1.3009999999999999},"last":0.73299999999999998}]},{"osd":6,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.85699999999999998,"15min":0.83999999999999997},"min":{"1min":0.67100000000000004,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.048,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.81999999999999995,"15min":0.81899999999999995},"min":{"1min":0.59499999999999997,"5min":0.57699999999999996,"15min":0.51400000000000001},"max":{"1min":1.131,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.72399999999999998}]},{"osd":7,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.84699999999999998,"15min":0.85499999999999998},"min":{"1min":0.626,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":1.1020000000000001,"5min":1.246,"15min":1.3380000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.88800000000000001,"15min":0.86899999999999999},"min":{"1min":0.70199999999999996,"5min":0.61899999999999999,"15min":0.54400000000000004},"max":{"1min":1.1559999999999999,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.84899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575743,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311564,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060276,"statfs":{"total":96636764160,"available":96317722624,"internally_reserved":0,"allocated":2035712,"data_stored":1013160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.46899999999999997},"min":{"1min":0.33800000000000002,"5min":0.309,"15min":0.30199999999999999},"max":{"1min":0.71299999999999997,"5min":0.72099999999999997,"15min":0.84999999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.36499999999999999,"5min":0.35599999999999998,"15min":0.316},"max":{"1min":0.65700000000000003,"5min":0.76100000000000001,"15min":0.85599999999999998},"last":0.432}]},{"osd":1,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.35799999999999998,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.65000000000000002,"5min":0.68000000000000005,"15min":0.85399999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53600000000000003},"min":{"1min":0.41099999999999998,"5min":0.39400000000000002,"15min":0.34599999999999997},"max":{"1min":0.71799999999999997,"5min":0.78200000000000003,"15min":0.98699999999999999},"last":0.39600000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.47899999999999998,"5min":0.46600000000000003,"15min":0.41399999999999998},"max":{"1min":0.77600000000000002,"5min":0.79900000000000004,"15min":0.95199999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.49399999999999999,"5min":0.44500000000000001,"15min":0.40999999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.95099999999999996},"last":0.56100000000000005}]},{"osd":4,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79900000000000004,"15min":0.79600000000000004},"min":{"1min":0.58599999999999997,"5min":0.56299999999999994,"15min":0.54500000000000004},"max":{"1min":1.147,"5min":1.196,"15min":1.202},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.78600000000000003,"15min":0.78100000000000003},"min":{"1min":0.56200000000000006,"5min":0.54000000000000004,"15min":0.47799999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.141},"last":0.96099999999999997}]},{"osd":5,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81999999999999995,"15min":0.79200000000000004},"min":{"1min":0.63200000000000001,"5min":0.60799999999999998,"15min":0.57199999999999995},"max":{"1min":1.0489999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.82399999999999995,"15min":0.81499999999999995},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0640000000000001,"5min":1.254,"15min":1.254},"last":0.82599999999999996}]},{"osd":6,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82499999999999996,"15min":0.81000000000000005},"min":{"1min":0.63,"5min":0.56999999999999995,"15min":0.48099999999999998},"max":{"1min":1.0980000000000001,"5min":1.1639999999999999,"15min":1.296},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83399999999999996,"15min":0.81999999999999995},"min":{"1min":0.60399999999999998,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1000000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.84499999999999997,"15min":0.83499999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.53600000000000003},"max":{"1min":1.1719999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89700000000000002,"15min":0.874},"min":{"1min":0.73799999999999999,"5min":0.66500000000000004,"15min":0.65300000000000002},"max":{"1min":1.157,"5min":1.298,"15min":1.298},"last":0.78300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575744,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311564,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060276,"statfs":{"total":96636764160,"available":96317722624,"internally_reserved":0,"allocated":2035712,"data_stored":1012732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48799999999999999,"15min":0.48699999999999999},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.29599999999999999},"max":{"1min":0.624,"5min":0.77100000000000002,"15min":0.81899999999999995},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.35399999999999998,"5min":0.33500000000000002,"15min":0.32300000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.91700000000000004},"last":0.45100000000000001}]},{"osd":1,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.33700000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.84699999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.46100000000000002,"5min":0.38300000000000001,"15min":0.35599999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.47299999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.46600000000000003,"5min":0.42099999999999999,"15min":0.34999999999999998},"max":{"1min":0.75800000000000001,"5min":0.76000000000000001,"15min":0.90900000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65000000000000002,"15min":0.65200000000000002},"min":{"1min":0.53600000000000003,"5min":0.48399999999999999,"15min":0.40899999999999997},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.95799999999999996},"last":0.52900000000000003}]},{"osd":4,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78300000000000003,"15min":0.77200000000000002},"min":{"1min":0.58799999999999997,"5min":0.55000000000000004,"15min":0.47499999999999998},"max":{"1min":1.121,"5min":1.246,"15min":1.246},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.86399999999999999,"15min":0.85399999999999998},"min":{"1min":0.71899999999999997,"5min":0.629,"15min":0.57799999999999996},"max":{"1min":1.1419999999999999,"5min":1.157,"15min":1.157},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77400000000000002,"15min":0.76500000000000001},"min":{"1min":0.57399999999999995,"5min":0.52700000000000002,"15min":0.48499999999999999},"max":{"1min":1.0920000000000001,"5min":1.1140000000000001,"15min":1.1910000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.83199999999999996,"15min":0.82899999999999996},"min":{"1min":0.66900000000000004,"5min":0.63800000000000001,"15min":0.48899999999999999},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.81100000000000005,"15min":0.79600000000000004},"min":{"1min":0.623,"5min":0.57799999999999996,"15min":0.495},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82099999999999995,"15min":0.81499999999999995},"min":{"1min":0.65900000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.024,"5min":1.105,"15min":1.2230000000000001},"last":0.59299999999999997}]},{"osd":7,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.85899999999999999,"15min":0.84999999999999998},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.53100000000000003},"max":{"1min":1.1599999999999999,"5min":1.21,"15min":1.2430000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.85699999999999998,"15min":0.84799999999999998},"min":{"1min":0.72699999999999998,"5min":0.627,"15min":0.56699999999999995},"max":{"1min":1.179,"5min":1.179,"15min":1.1850000000000001},"last":0.77900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575742,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315604,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056236,"statfs":{"total":96636764160,"available":96313585664,"internally_reserved":0,"allocated":1978368,"data_stored":985597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73399999999999999,"15min":0.72399999999999998},"min":{"1min":0.54100000000000004,"5min":0.48799999999999999,"15min":0.41199999999999998},"max":{"1min":0.93600000000000005,"5min":1.052,"15min":1.0700000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.76600000000000001,"15min":0.76200000000000001},"min":{"1min":0.52700000000000002,"5min":0.501,"15min":0.49199999999999999},"max":{"1min":0.89000000000000001,"5min":1.0680000000000001,"15min":1.3320000000000001},"last":0.67000000000000004}]},{"osd":1,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.75,"15min":0.73499999999999999},"min":{"1min":0.59299999999999997,"5min":0.504,"15min":0.47499999999999998},"max":{"1min":0.90000000000000002,"5min":1.038,"15min":1.0640000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.752,"15min":0.747},"min":{"1min":0.57199999999999995,"5min":0.54400000000000004,"15min":0.48999999999999999},"max":{"1min":0.91400000000000003,"5min":1.028,"15min":1.242},"last":0.63400000000000001}]},{"osd":2,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.80500000000000005,"15min":0.79300000000000004},"min":{"1min":0.63500000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.97899999999999998,"5min":0.999,"15min":1.228},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.65300000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.99299999999999999,"5min":1.069,"15min":1.069},"last":0.94099999999999995}]},{"osd":3,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77700000000000002,"15min":0.76300000000000001},"min":{"1min":0.628,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.94699999999999995,"5min":1.131,"15min":1.151},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.56399999999999995,"5min":0.53800000000000003,"15min":0.53500000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.2110000000000001},"last":0.68799999999999994}]},{"osd":5,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.60699999999999998,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.372,"15min":0.36299999999999999},"max":{"1min":0.872,"5min":1.27,"15min":1.27},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.62,"15min":0.623},"min":{"1min":0.45600000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.79400000000000004,"5min":1.014,"15min":1.014},"last":0.45000000000000001}]},{"osd":6,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.5,"5min":0.46899999999999997,"15min":0.41699999999999998},"max":{"1min":0.95199999999999996,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.67800000000000005,"15min":0.67000000000000004},"min":{"1min":0.47999999999999998,"5min":0.45500000000000002,"15min":0.39000000000000001},"max":{"1min":0.92500000000000004,"5min":1.425,"15min":1.425},"last":0.72599999999999998}]},{"osd":7,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70399999999999996,"15min":0.72099999999999997},"min":{"1min":0.53500000000000003,"5min":0.48699999999999999,"15min":0.47999999999999998},"max":{"1min":0.81799999999999995,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76600000000000001,"15min":0.76300000000000001},"min":{"1min":0.57499999999999996,"5min":0.51200000000000001,"15min":0.46600000000000003},"max":{"1min":0.94299999999999995,"5min":1.0529999999999999,"15min":1.165},"last":0.89100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575743,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311508,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060332,"statfs":{"total":96636764160,"available":96317779968,"internally_reserved":0,"allocated":1978368,"data_stored":985597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.745,"15min":0.73199999999999998},"min":{"1min":0.55600000000000005,"5min":0.46200000000000002,"15min":0.39100000000000001},"max":{"1min":0.97199999999999998,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.621},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74199999999999999,"15min":0.72499999999999998},"min":{"1min":0.51100000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.0820000000000001},"last":0.60499999999999998}]},{"osd":1,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73399999999999999,"15min":0.73299999999999998},"min":{"1min":0.56899999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":0.97499999999999998,"15min":1.0129999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76300000000000001,"15min":0.75600000000000001},"min":{"1min":0.56599999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.0289999999999999},"last":0.70199999999999996}]},{"osd":2,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77100000000000002,"15min":0.75800000000000001},"min":{"1min":0.63400000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95399999999999996,"5min":0.95699999999999996,"15min":0.98599999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.5,"5min":0.5,"15min":0.44500000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":1.026},"last":0.54800000000000004}]},{"osd":3,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77800000000000002,"15min":0.76600000000000001},"min":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.47499999999999998},"max":{"1min":0.92200000000000004,"5min":0.97799999999999998,"15min":1.107},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79700000000000004,"15min":0.78500000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.96699999999999997,"5min":0.99099999999999999,"15min":1.0249999999999999},"last":0.58699999999999997}]},{"osd":4,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.61099999999999999,"15min":0.60599999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.82099999999999995,"5min":1.002,"15min":1.0189999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.625,"15min":0.61699999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.379},"max":{"1min":0.89200000000000002,"5min":0.96199999999999997,"15min":1.0289999999999999},"last":0.53100000000000003}]},{"osd":6,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64000000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.91400000000000003,"5min":0.95899999999999996,"15min":0.998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68700000000000006,"15min":0.67800000000000005},"min":{"1min":0.51200000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.054},"last":0.50600000000000001}]},{"osd":7,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.69499999999999995},"min":{"1min":0.47199999999999998,"5min":0.45000000000000001,"15min":0.433},"max":{"1min":0.93400000000000005,"5min":1.0449999999999999,"15min":1.073},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.79200000000000004,"15min":0.78500000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.5},"max":{"1min":1.0069999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.72199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T07:57:46.493 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T07:57:46.674 INFO:tasks.ceph.mds.a.smithi071.stderr:2023-10-09T07:57:46.673+0000 7f9e609f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T07:57:46.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.707+0000 7f5f951ff700 1 Processor -- start 2023-10-09T07:57:46.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.707+0000 7f5f951ff700 1 -- start start 2023-10-09T07:57:46.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.708+0000 7f5f951ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5f900b1850 0x7f5f900b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:46.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.708+0000 7f5f951ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5f900ae680 0x7f5f901572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:46.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.708+0000 7f5f951ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f900aeb00 0x7f5f90157820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:46.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.708+0000 7f5f951ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f9006fc30 con 0x7f5f900b1850 2023-10-09T07:57:46.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.708+0000 7f5f951ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f900cc260 con 0x7f5f900ae680 2023-10-09T07:57:46.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.708+0000 7f5f951ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f900cb300 con 0x7f5f900aeb00 2023-10-09T07:57:46.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.709+0000 7f5f8ed9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5f900b1850 0x7f5f900b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:46.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.709+0000 7f5f8ed9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5f900b1850 0x7f5f900b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35530/0 (socket says 172.21.15.71:35530) 2023-10-09T07:57:46.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.709+0000 7f5f8ed9d700 1 -- 172.21.15.71:0/3419953205 learned_addr learned my addr 172.21.15.71:0/3419953205 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:46.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.709+0000 7f5f8e59c700 1 --2- 172.21.15.71:0/3419953205 >> v2:172.21.15.179:3300/0 conn(0x7f5f900ae680 0x7f5f901572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:46.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.709+0000 7f5f8f59e700 1 --2- 172.21.15.71:0/3419953205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f900aeb00 0x7f5f90157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:46.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.709+0000 7f5f8ed9d700 1 -- 172.21.15.71:0/3419953205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f900aeb00 msgr2=0x7f5f90157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:46.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.709+0000 7f5f8ed9d700 1 --2- 172.21.15.71:0/3419953205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f900aeb00 0x7f5f90157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:46.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.709+0000 7f5f8ed9d700 1 -- 172.21.15.71:0/3419953205 >> v2:172.21.15.179:3300/0 conn(0x7f5f900ae680 msgr2=0x7f5f901572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:46.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.709+0000 7f5f8ed9d700 1 --2- 172.21.15.71:0/3419953205 >> v2:172.21.15.179:3300/0 conn(0x7f5f900ae680 0x7f5f901572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:46.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.709+0000 7f5f8ed9d700 1 -- 172.21.15.71:0/3419953205 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f900cb5e0 con 0x7f5f900b1850 2023-10-09T07:57:46.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.709+0000 7f5f8f59e700 1 --2- 172.21.15.71:0/3419953205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f900aeb00 0x7f5f90157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:57:46.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.709+0000 7f5f8ed9d700 1 --2- 172.21.15.71:0/3419953205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f900b1850 0x7f5f900b1c20 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f5f9006d340 tx=0x7f5f80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39e7fd2673d2451 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:46.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.710+0000 7f5f8dd9b700 1 -- 172.21.15.71:0/3419953205 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8000b820 con 0x7f5f900b1850 2023-10-09T07:57:46.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.710+0000 7f5f8dd9b700 1 -- 172.21.15.71:0/3419953205 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8000b980 con 0x7f5f900b1850 2023-10-09T07:57:46.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.710+0000 7f5f8dd9b700 1 -- 172.21.15.71:0/3419953205 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8000bd20 con 0x7f5f900b1850 2023-10-09T07:57:46.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.710+0000 7f5f951ff700 1 -- 172.21.15.71:0/3419953205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f900b1850 msgr2=0x7f5f900b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:46.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.710+0000 7f5f951ff700 1 --2- 172.21.15.71:0/3419953205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f900b1850 0x7f5f900b1c20 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f5f9006d340 tx=0x7f5f80009250 comp rx=0 tx=0).stop 2023-10-09T07:57:46.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.710+0000 7f5f951ff700 1 -- 172.21.15.71:0/3419953205 shutdown_connections 2023-10-09T07:57:46.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.710+0000 7f5f951ff700 1 --2- 172.21.15.71:0/3419953205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f900aeb00 0x7f5f90157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:46.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.710+0000 7f5f951ff700 1 --2- 172.21.15.71:0/3419953205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f900b1850 0x7f5f900b1c20 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:46.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.710+0000 7f5f951ff700 1 --2- 172.21.15.71:0/3419953205 >> v2:172.21.15.179:3300/0 conn(0x7f5f900ae680 0x7f5f901572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:46.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.710+0000 7f5f951ff700 1 -- 172.21.15.71:0/3419953205 >> 172.21.15.71:0/3419953205 conn(0x7f5f9006a320 msgr2=0x7f5f900cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:46.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.710+0000 7f5f951ff700 1 -- 172.21.15.71:0/3419953205 shutdown_connections 2023-10-09T07:57:46.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.710+0000 7f5f951ff700 1 -- 172.21.15.71:0/3419953205 wait complete. 2023-10-09T07:57:46.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.712+0000 7f5f951ff700 1 Processor -- start 2023-10-09T07:57:46.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.712+0000 7f5f951ff700 1 -- start start 2023-10-09T07:57:46.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.713+0000 7f5f951ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f900ae680 0x7f5f9014dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:46.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.713+0000 7f5f951ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f900aeb00 0x7f5f900b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:46.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.713+0000 7f5f951ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f900b1850 0x7f5f9015ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:46.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.713+0000 7f5f951ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f90154b30 con 0x7f5f900aeb00 2023-10-09T07:57:46.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.713+0000 7f5f951ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9015f180 con 0x7f5f900ae680 2023-10-09T07:57:46.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.713+0000 7f5f951ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f900b0940 con 0x7f5f900b1850 2023-10-09T07:57:46.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.713+0000 7f5f8e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f900aeb00 0x7f5f900b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:46.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.713+0000 7f5f8e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f900aeb00 0x7f5f900b0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35540/0 (socket says 172.21.15.71:35540) 2023-10-09T07:57:46.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.713+0000 7f5f8e59c700 1 -- 172.21.15.71:0/619973501 learned_addr learned my addr 172.21.15.71:0/619973501 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:46.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.713+0000 7f5f8ed9d700 1 --2- 172.21.15.71:0/619973501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f900ae680 0x7f5f9014dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:46.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.713+0000 7f5f8f59e700 1 --2- 172.21.15.71:0/619973501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f900b1850 0x7f5f9015ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:46.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.713+0000 7f5f8e59c700 1 -- 172.21.15.71:0/619973501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f900b1850 msgr2=0x7f5f9015ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:46.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.713+0000 7f5f8e59c700 1 --2- 172.21.15.71:0/619973501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f900b1850 0x7f5f9015ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:46.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.714+0000 7f5f8e59c700 1 -- 172.21.15.71:0/619973501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f900ae680 msgr2=0x7f5f9014dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:46.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.714+0000 7f5f8e59c700 1 --2- 172.21.15.71:0/619973501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f900ae680 0x7f5f9014dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:46.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.714+0000 7f5f8e59c700 1 -- 172.21.15.71:0/619973501 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f800094f0 con 0x7f5f900aeb00 2023-10-09T07:57:46.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.714+0000 7f5f8ed9d700 1 --2- 172.21.15.71:0/619973501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f900ae680 0x7f5f9014dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:57:46.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.714+0000 7f5f8f59e700 1 --2- 172.21.15.71:0/619973501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f900b1850 0x7f5f9015ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:57:46.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.714+0000 7f5f8e59c700 1 --2- 172.21.15.71:0/619973501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f900aeb00 0x7f5f900b0290 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f5f8400d860 tx=0x7f5f84008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:46.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.714+0000 7f5f76ffd700 1 -- 172.21.15.71:0/619973501 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f84009610 con 0x7f5f900aeb00 2023-10-09T07:57:46.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.714+0000 7f5f76ffd700 1 -- 172.21.15.71:0/619973501 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f84009770 con 0x7f5f900aeb00 2023-10-09T07:57:46.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.714+0000 7f5f76ffd700 1 -- 172.21.15.71:0/619973501 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f84009b30 con 0x7f5f900aeb00 2023-10-09T07:57:46.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.714+0000 7f5f951ff700 1 -- 172.21.15.71:0/619973501 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f900b0c20 con 0x7f5f900aeb00 2023-10-09T07:57:46.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.714+0000 7f5f951ff700 1 -- 172.21.15.71:0/619973501 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f900b11e0 con 0x7f5f900aeb00 2023-10-09T07:57:46.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.715+0000 7f5f951ff700 1 -- 172.21.15.71:0/619973501 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f90154ce0 con 0x7f5f900aeb00 2023-10-09T07:57:46.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.716+0000 7f5f76ffd700 1 -- 172.21.15.71:0/619973501 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f8401e460 con 0x7f5f900aeb00 2023-10-09T07:57:46.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.718+0000 7f5f76ffd700 1 --2- 172.21.15.71:0/619973501 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5f7c066f30 0x7f5f7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:46.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.718+0000 7f5f76ffd700 1 -- 172.21.15.71:0/619973501 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f5f84084dc0 con 0x7f5f900aeb00 2023-10-09T07:57:46.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.718+0000 7f5f8ed9d700 1 --2- 172.21.15.71:0/619973501 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5f7c066f30 0x7f5f7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:46.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.719+0000 7f5f8ed9d700 1 --2- 172.21.15.71:0/619973501 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5f7c066f30 0x7f5f7c0693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5f9006d340 tx=0x7f5f80017000 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:46.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.722+0000 7f5f76ffd700 1 -- 172.21.15.71:0/619973501 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f90154ce0 con 0x7f5f900aeb00 2023-10-09T07:57:46.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.908+0000 7f5f951ff700 1 -- 172.21.15.71:0/619973501 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5f900b1370 con 0x7f5f7c066f30 2023-10-09T07:57:46.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.917+0000 7f5f76ffd700 1 -- 172.21.15.71:0/619973501 <== mgr.8071 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282677 (secure 0 0 0) 0x7f5f900b1370 con 0x7f5f7c066f30 2023-10-09T07:57:46.921 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:57:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.922+0000 7f5f951ff700 1 -- 172.21.15.71:0/619973501 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5f7c066f30 msgr2=0x7f5f7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.922+0000 7f5f951ff700 1 --2- 172.21.15.71:0/619973501 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5f7c066f30 0x7f5f7c0693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5f9006d340 tx=0x7f5f80017000 comp rx=0 tx=0).stop 2023-10-09T07:57:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.922+0000 7f5f951ff700 1 -- 172.21.15.71:0/619973501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f900aeb00 msgr2=0x7f5f900b0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.922+0000 7f5f951ff700 1 --2- 172.21.15.71:0/619973501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f900aeb00 0x7f5f900b0290 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f5f8400d860 tx=0x7f5f84008040 comp rx=0 tx=0).stop 2023-10-09T07:57:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.922+0000 7f5f951ff700 1 -- 172.21.15.71:0/619973501 shutdown_connections 2023-10-09T07:57:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.922+0000 7f5f951ff700 1 --2- 172.21.15.71:0/619973501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f900b1850 0x7f5f9015ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.922+0000 7f5f951ff700 1 --2- 172.21.15.71:0/619973501 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5f7c066f30 0x7f5f7c0693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:46.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.922+0000 7f5f951ff700 1 --2- 172.21.15.71:0/619973501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f900ae680 0x7f5f9014dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:46.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.922+0000 7f5f951ff700 1 --2- 172.21.15.71:0/619973501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f900aeb00 0x7f5f900b0290 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:46.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.922+0000 7f5f951ff700 1 -- 172.21.15.71:0/619973501 >> 172.21.15.71:0/619973501 conn(0x7f5f9006a320 msgr2=0x7f5f9015fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:46.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.922+0000 7f5f951ff700 1 -- 172.21.15.71:0/619973501 shutdown_connections 2023-10-09T07:57:46.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:46.922+0000 7f5f951ff700 1 -- 172.21.15.71:0/619973501 wait complete. 2023-10-09T07:57:46.925 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T07:57:46.940 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T07:57:45.106001+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":448,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2477012,"kb_used_data":16788,"kb_used_omap":0,"kb_used_meta":2460160,"kb_avail":752497708,"statfs":{"total":773094113280,"available":770557652992,"internally_reserved":0,"allocated":17190912,"data_stored":9153454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2519203840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.422453"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.717854+0000","last_change":"2023-10-09T07:57:41.709955+0000","last_active":"2023-10-09T07:57:41.717854+0000","last_peered":"2023-10-09T07:57:41.717854+0000","last_clean":"2023-10-09T07:57:41.717854+0000","last_became_active":"2023-10-09T07:57:41.709619+0000","last_became_peered":"2023-10-09T07:57:41.709619+0000","last_unstale":"2023-10-09T07:57:41.717854+0000","last_undegraded":"2023-10-09T07:57:41.717854+0000","last_fullsized":"2023-10-09T07:57:41.717854+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:31:27.885208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.725286+0000","last_change":"2023-10-09T07:57:41.720928+0000","last_active":"2023-10-09T07:57:41.725286+0000","last_peered":"2023-10-09T07:57:41.725286+0000","last_clean":"2023-10-09T07:57:41.725286+0000","last_became_active":"2023-10-09T07:57:41.720641+0000","last_became_peered":"2023-10-09T07:57:41.720641+0000","last_unstale":"2023-10-09T07:57:41.725286+0000","last_undegraded":"2023-10-09T07:57:41.725286+0000","last_fullsized":"2023-10-09T07:57:41.725286+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:35:10.760013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.705230+0000","last_change":"2023-10-09T07:57:41.704409+0000","last_active":"2023-10-09T07:57:41.705230+0000","last_peered":"2023-10-09T07:57:41.705230+0000","last_clean":"2023-10-09T07:57:41.705230+0000","last_became_active":"2023-10-09T07:57:41.704155+0000","last_became_peered":"2023-10-09T07:57:41.704155+0000","last_unstale":"2023-10-09T07:57:41.705230+0000","last_undegraded":"2023-10-09T07:57:41.705230+0000","last_fullsized":"2023-10-09T07:57:41.705230+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:34.109204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.709880+0000","last_change":"2023-10-09T07:57:41.706009+0000","last_active":"2023-10-09T07:57:41.709880+0000","last_peered":"2023-10-09T07:57:41.709880+0000","last_clean":"2023-10-09T07:57:41.709880+0000","last_became_active":"2023-10-09T07:57:41.705743+0000","last_became_peered":"2023-10-09T07:57:41.705743+0000","last_unstale":"2023-10-09T07:57:41.709880+0000","last_undegraded":"2023-10-09T07:57:41.709880+0000","last_fullsized":"2023-10-09T07:57:41.709880+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:51.895142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.723923+0000","last_change":"2023-10-09T07:57:41.714888+0000","last_active":"2023-10-09T07:57:41.723923+0000","last_peered":"2023-10-09T07:57:41.723923+0000","last_clean":"2023-10-09T07:57:41.723923+0000","last_became_active":"2023-10-09T07:57:41.712340+0000","last_became_peered":"2023-10-09T07:57:41.712340+0000","last_unstale":"2023-10-09T07:57:41.723923+0000","last_undegraded":"2023-10-09T07:57:41.723923+0000","last_fullsized":"2023-10-09T07:57:41.723923+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:35:04.276802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.726276+0000","last_change":"2023-10-09T07:57:41.725182+0000","last_active":"2023-10-09T07:57:41.726276+0000","last_peered":"2023-10-09T07:57:41.726276+0000","last_clean":"2023-10-09T07:57:41.726276+0000","last_became_active":"2023-10-09T07:57:41.724923+0000","last_became_peered":"2023-10-09T07:57:41.724923+0000","last_unstale":"2023-10-09T07:57:41.726276+0000","last_undegraded":"2023-10-09T07:57:41.726276+0000","last_fullsized":"2023-10-09T07:57:41.726276+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:56.824398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.724211+0000","last_change":"2023-10-09T07:57:41.722257+0000","last_active":"2023-10-09T07:57:41.724211+0000","last_peered":"2023-10-09T07:57:41.724211+0000","last_clean":"2023-10-09T07:57:41.724211+0000","last_became_active":"2023-10-09T07:57:41.721999+0000","last_became_peered":"2023-10-09T07:57:41.721999+0000","last_unstale":"2023-10-09T07:57:41.724211+0000","last_undegraded":"2023-10-09T07:57:41.724211+0000","last_fullsized":"2023-10-09T07:57:41.724211+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:04:15.160860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.708262+0000","last_change":"2023-10-09T07:57:41.705106+0000","last_active":"2023-10-09T07:57:41.708262+0000","last_peered":"2023-10-09T07:57:41.708262+0000","last_clean":"2023-10-09T07:57:41.708262+0000","last_became_active":"2023-10-09T07:57:41.704766+0000","last_became_peered":"2023-10-09T07:57:41.704766+0000","last_unstale":"2023-10-09T07:57:41.708262+0000","last_undegraded":"2023-10-09T07:57:41.708262+0000","last_fullsized":"2023-10-09T07:57:41.708262+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:16.242855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.721978+0000","last_change":"2023-10-09T07:57:41.718833+0000","last_active":"2023-10-09T07:57:41.721978+0000","last_peered":"2023-10-09T07:57:41.721978+0000","last_clean":"2023-10-09T07:57:41.721978+0000","last_became_active":"2023-10-09T07:57:41.718121+0000","last_became_peered":"2023-10-09T07:57:41.718121+0000","last_unstale":"2023-10-09T07:57:41.721978+0000","last_undegraded":"2023-10-09T07:57:41.721978+0000","last_fullsized":"2023-10-09T07:57:41.721978+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:34.255144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.710306+0000","last_change":"2023-10-09T07:57:41.708926+0000","last_active":"2023-10-09T07:57:41.710306+0000","last_peered":"2023-10-09T07:57:41.710306+0000","last_clean":"2023-10-09T07:57:41.710306+0000","last_became_active":"2023-10-09T07:57:41.708647+0000","last_became_peered":"2023-10-09T07:57:41.708647+0000","last_unstale":"2023-10-09T07:57:41.710306+0000","last_undegraded":"2023-10-09T07:57:41.710306+0000","last_fullsized":"2023-10-09T07:57:41.710306+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:02.361772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.703711+0000","last_change":"2023-10-09T07:57:41.701332+0000","last_active":"2023-10-09T07:57:41.703711+0000","last_peered":"2023-10-09T07:57:41.703711+0000","last_clean":"2023-10-09T07:57:41.703711+0000","last_became_active":"2023-10-09T07:57:41.701055+0000","last_became_peered":"2023-10-09T07:57:41.701055+0000","last_unstale":"2023-10-09T07:57:41.703711+0000","last_undegraded":"2023-10-09T07:57:41.703711+0000","last_fullsized":"2023-10-09T07:57:41.703711+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:33.150152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.732229+0000","last_change":"2023-10-09T07:57:41.730658+0000","last_active":"2023-10-09T07:57:41.732229+0000","last_peered":"2023-10-09T07:57:41.732229+0000","last_clean":"2023-10-09T07:57:41.732229+0000","last_became_active":"2023-10-09T07:57:41.730407+0000","last_became_peered":"2023-10-09T07:57:41.730407+0000","last_unstale":"2023-10-09T07:57:41.732229+0000","last_undegraded":"2023-10-09T07:57:41.732229+0000","last_fullsized":"2023-10-09T07:57:41.732229+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:14.993912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.709916+0000","last_change":"2023-10-09T07:57:41.705282+0000","last_active":"2023-10-09T07:57:41.709916+0000","last_peered":"2023-10-09T07:57:41.709916+0000","last_clean":"2023-10-09T07:57:41.709916+0000","last_became_active":"2023-10-09T07:57:41.704997+0000","last_became_peered":"2023-10-09T07:57:41.704997+0000","last_unstale":"2023-10-09T07:57:41.709916+0000","last_undegraded":"2023-10-09T07:57:41.709916+0000","last_fullsized":"2023-10-09T07:57:41.709916+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:27.117499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.723953+0000","last_change":"2023-10-09T07:57:41.716182+0000","last_active":"2023-10-09T07:57:41.723953+0000","last_peered":"2023-10-09T07:57:41.723953+0000","last_clean":"2023-10-09T07:57:41.723953+0000","last_became_active":"2023-10-09T07:57:41.715924+0000","last_became_peered":"2023-10-09T07:57:41.715924+0000","last_unstale":"2023-10-09T07:57:41.723953+0000","last_undegraded":"2023-10-09T07:57:41.723953+0000","last_fullsized":"2023-10-09T07:57:41.723953+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:03:21.703878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.723894+0000","last_change":"2023-10-09T07:57:41.715422+0000","last_active":"2023-10-09T07:57:41.723894+0000","last_peered":"2023-10-09T07:57:41.723894+0000","last_clean":"2023-10-09T07:57:41.723894+0000","last_became_active":"2023-10-09T07:57:41.715162+0000","last_became_peered":"2023-10-09T07:57:41.715162+0000","last_unstale":"2023-10-09T07:57:41.723894+0000","last_undegraded":"2023-10-09T07:57:41.723894+0000","last_fullsized":"2023-10-09T07:57:41.723894+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:25:46.680708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.718752+0000","last_change":"2023-10-09T07:57:41.714598+0000","last_active":"2023-10-09T07:57:41.718752+0000","last_peered":"2023-10-09T07:57:41.718752+0000","last_clean":"2023-10-09T07:57:41.718752+0000","last_became_active":"2023-10-09T07:57:41.714352+0000","last_became_peered":"2023-10-09T07:57:41.714352+0000","last_unstale":"2023-10-09T07:57:41.718752+0000","last_undegraded":"2023-10-09T07:57:41.718752+0000","last_fullsized":"2023-10-09T07:57:41.718752+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:20.867454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.690610+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:16.698996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686328+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:53.914995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.725489+0000","last_change":"2023-10-09T07:57:40.702915+0000","last_active":"2023-10-09T07:57:41.725489+0000","last_peered":"2023-10-09T07:57:41.725489+0000","last_clean":"2023-10-09T07:57:41.725489+0000","last_became_active":"2023-10-09T07:57:40.702648+0000","last_became_peered":"2023-10-09T07:57:40.702648+0000","last_unstale":"2023-10-09T07:57:41.725489+0000","last_undegraded":"2023-10-09T07:57:41.725489+0000","last_fullsized":"2023-10-09T07:57:41.725489+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:38:00.181866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686216+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:00.330127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.718830+0000","last_change":"2023-10-09T07:57:41.713825+0000","last_active":"2023-10-09T07:57:41.718830+0000","last_peered":"2023-10-09T07:57:41.718830+0000","last_clean":"2023-10-09T07:57:41.718830+0000","last_became_active":"2023-10-09T07:57:41.713562+0000","last_became_peered":"2023-10-09T07:57:41.713562+0000","last_unstale":"2023-10-09T07:57:41.718830+0000","last_undegraded":"2023-10-09T07:57:41.718830+0000","last_fullsized":"2023-10-09T07:57:41.718830+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:40.405926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686239+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:42:59.410622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"162'1","reported_seq":11,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.730466+0000","last_change":"2023-10-09T07:57:40.699052+0000","last_active":"2023-10-09T07:57:41.730466+0000","last_peered":"2023-10-09T07:57:41.730466+0000","last_clean":"2023-10-09T07:57:41.730466+0000","last_became_active":"2023-10-09T07:57:40.698810+0000","last_became_peered":"2023-10-09T07:57:40.698810+0000","last_unstale":"2023-10-09T07:57:41.730466+0000","last_undegraded":"2023-10-09T07:57:41.730466+0000","last_fullsized":"2023-10-09T07:57:41.730466+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:42.240311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686488+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:51:23.776295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.685650+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:50:36.386674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.725099+0000","last_change":"2023-10-09T07:57:41.719951+0000","last_active":"2023-10-09T07:57:41.725099+0000","last_peered":"2023-10-09T07:57:41.725099+0000","last_clean":"2023-10-09T07:57:41.725099+0000","last_became_active":"2023-10-09T07:57:41.719693+0000","last_became_peered":"2023-10-09T07:57:41.719693+0000","last_unstale":"2023-10-09T07:57:41.725099+0000","last_undegraded":"2023-10-09T07:57:41.725099+0000","last_fullsized":"2023-10-09T07:57:41.725099+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:22:57.702842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.687332+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:45:51.888713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.710875+0000","last_change":"2023-10-09T07:57:40.709018+0000","last_active":"2023-10-09T07:57:41.710875+0000","last_peered":"2023-10-09T07:57:41.710875+0000","last_clean":"2023-10-09T07:57:41.710875+0000","last_became_active":"2023-10-09T07:57:40.708730+0000","last_became_peered":"2023-10-09T07:57:40.708730+0000","last_unstale":"2023-10-09T07:57:41.710875+0000","last_undegraded":"2023-10-09T07:57:41.710875+0000","last_fullsized":"2023-10-09T07:57:41.710875+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:26:00.505124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686086+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:28.657592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.688021+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:42.240311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.725434+0000","last_change":"2023-10-09T07:57:41.723182+0000","last_active":"2023-10-09T07:57:41.725434+0000","last_peered":"2023-10-09T07:57:41.725434+0000","last_clean":"2023-10-09T07:57:41.725434+0000","last_became_active":"2023-10-09T07:57:41.722923+0000","last_became_peered":"2023-10-09T07:57:41.722923+0000","last_unstale":"2023-10-09T07:57:41.725434+0000","last_undegraded":"2023-10-09T07:57:41.725434+0000","last_fullsized":"2023-10-09T07:57:41.725434+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:14.840671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.700480+0000","last_change":"2023-10-09T07:57:40.703377+0000","last_active":"2023-10-09T07:57:41.700480+0000","last_peered":"2023-10-09T07:57:41.700480+0000","last_clean":"2023-10-09T07:57:41.700480+0000","last_became_active":"2023-10-09T07:57:40.703117+0000","last_became_peered":"2023-10-09T07:57:40.703117+0000","last_unstale":"2023-10-09T07:57:41.700480+0000","last_undegraded":"2023-10-09T07:57:41.700480+0000","last_fullsized":"2023-10-09T07:57:41.700480+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:02:40.132873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.685623+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:15:18.393682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.688474+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:04.363976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686847+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:30.282993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.723040+0000","last_change":"2023-10-09T07:57:40.708690+0000","last_active":"2023-10-09T07:57:41.723040+0000","last_peered":"2023-10-09T07:57:41.723040+0000","last_clean":"2023-10-09T07:57:41.723040+0000","last_became_active":"2023-10-09T07:57:40.708436+0000","last_became_peered":"2023-10-09T07:57:40.708436+0000","last_unstale":"2023-10-09T07:57:41.723040+0000","last_undegraded":"2023-10-09T07:57:41.723040+0000","last_fullsized":"2023-10-09T07:57:41.723040+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:13:40.202625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.722860+0000","last_change":"2023-10-09T07:57:41.720822+0000","last_active":"2023-10-09T07:57:41.722860+0000","last_peered":"2023-10-09T07:57:41.722860+0000","last_clean":"2023-10-09T07:57:41.722860+0000","last_became_active":"2023-10-09T07:57:41.720549+0000","last_became_peered":"2023-10-09T07:57:41.720549+0000","last_unstale":"2023-10-09T07:57:41.722860+0000","last_undegraded":"2023-10-09T07:57:41.722860+0000","last_fullsized":"2023-10-09T07:57:41.722860+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:57:29.926980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686340+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:49.504100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686407+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:07:00.477516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.710062+0000","last_change":"2023-10-09T07:57:41.706326+0000","last_active":"2023-10-09T07:57:41.710062+0000","last_peered":"2023-10-09T07:57:41.710062+0000","last_clean":"2023-10-09T07:57:41.710062+0000","last_became_active":"2023-10-09T07:57:41.705955+0000","last_became_peered":"2023-10-09T07:57:41.705955+0000","last_unstale":"2023-10-09T07:57:41.710062+0000","last_undegraded":"2023-10-09T07:57:41.710062+0000","last_fullsized":"2023-10-09T07:57:41.710062+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:03:01.850852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.686955+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:31:28.083757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.704271+0000","last_change":"2023-10-09T07:57:40.702948+0000","last_active":"2023-10-09T07:57:41.704271+0000","last_peered":"2023-10-09T07:57:41.704271+0000","last_clean":"2023-10-09T07:57:41.704271+0000","last_became_active":"2023-10-09T07:57:40.702709+0000","last_became_peered":"2023-10-09T07:57:40.702709+0000","last_unstale":"2023-10-09T07:57:41.704271+0000","last_undegraded":"2023-10-09T07:57:41.704271+0000","last_fullsized":"2023-10-09T07:57:41.704271+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:55:27.158449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.702743+0000","last_change":"2023-10-09T07:57:40.701038+0000","last_active":"2023-10-09T07:57:41.702743+0000","last_peered":"2023-10-09T07:57:41.702743+0000","last_clean":"2023-10-09T07:57:41.702743+0000","last_became_active":"2023-10-09T07:57:40.700766+0000","last_became_peered":"2023-10-09T07:57:40.700766+0000","last_unstale":"2023-10-09T07:57:41.702743+0000","last_undegraded":"2023-10-09T07:57:41.702743+0000","last_fullsized":"2023-10-09T07:57:41.702743+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:04.363976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.694520+0000","last_change":"2023-10-09T07:57:40.706333+0000","last_active":"2023-10-09T07:57:41.694520+0000","last_peered":"2023-10-09T07:57:41.694520+0000","last_clean":"2023-10-09T07:57:41.694520+0000","last_became_active":"2023-10-09T07:57:40.706065+0000","last_became_peered":"2023-10-09T07:57:40.706065+0000","last_unstale":"2023-10-09T07:57:41.694520+0000","last_undegraded":"2023-10-09T07:57:41.694520+0000","last_fullsized":"2023-10-09T07:57:41.694520+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:30:08.439237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.731563+0000","last_change":"2023-10-09T07:57:40.708157+0000","last_active":"2023-10-09T07:57:41.731563+0000","last_peered":"2023-10-09T07:57:41.731563+0000","last_clean":"2023-10-09T07:57:41.731563+0000","last_became_active":"2023-10-09T07:57:40.707886+0000","last_became_peered":"2023-10-09T07:57:40.707886+0000","last_unstale":"2023-10-09T07:57:41.731563+0000","last_undegraded":"2023-10-09T07:57:41.731563+0000","last_fullsized":"2023-10-09T07:57:41.731563+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:26.982485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.724509+0000","last_change":"2023-10-09T07:57:41.717479+0000","last_active":"2023-10-09T07:57:41.724509+0000","last_peered":"2023-10-09T07:57:41.724509+0000","last_clean":"2023-10-09T07:57:41.724509+0000","last_became_active":"2023-10-09T07:57:41.716849+0000","last_became_peered":"2023-10-09T07:57:41.716849+0000","last_unstale":"2023-10-09T07:57:41.724509+0000","last_undegraded":"2023-10-09T07:57:41.724509+0000","last_fullsized":"2023-10-09T07:57:41.724509+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:35.354061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.690567+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:08:08.948333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.685651+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:47:25.243183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.694719+0000","last_change":"2023-10-09T07:57:40.703859+0000","last_active":"2023-10-09T07:57:41.694719+0000","last_peered":"2023-10-09T07:57:41.694719+0000","last_clean":"2023-10-09T07:57:41.694719+0000","last_became_active":"2023-10-09T07:57:40.703554+0000","last_became_peered":"2023-10-09T07:57:40.703554+0000","last_unstale":"2023-10-09T07:57:41.694719+0000","last_undegraded":"2023-10-09T07:57:41.694719+0000","last_fullsized":"2023-10-09T07:57:41.694719+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:58.084800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.685687+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:52:43.023892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.691014+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:57:28.916749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.720069+0000","last_change":"2023-10-09T07:57:41.717075+0000","last_active":"2023-10-09T07:57:41.720069+0000","last_peered":"2023-10-09T07:57:41.720069+0000","last_clean":"2023-10-09T07:57:41.720069+0000","last_became_active":"2023-10-09T07:57:41.716822+0000","last_became_peered":"2023-10-09T07:57:41.716822+0000","last_unstale":"2023-10-09T07:57:41.720069+0000","last_undegraded":"2023-10-09T07:57:41.720069+0000","last_fullsized":"2023-10-09T07:57:41.720069+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:37:41.304881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.702813+0000","last_change":"2023-10-09T07:57:40.703705+0000","last_active":"2023-10-09T07:57:41.702813+0000","last_peered":"2023-10-09T07:57:41.702813+0000","last_clean":"2023-10-09T07:57:41.702813+0000","last_became_active":"2023-10-09T07:57:40.703459+0000","last_became_peered":"2023-10-09T07:57:40.703459+0000","last_unstale":"2023-10-09T07:57:41.702813+0000","last_undegraded":"2023-10-09T07:57:41.702813+0000","last_fullsized":"2023-10-09T07:57:41.702813+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:20:20.044507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.694634+0000","last_change":"2023-10-09T07:57:40.701414+0000","last_active":"2023-10-09T07:57:41.694634+0000","last_peered":"2023-10-09T07:57:41.694634+0000","last_clean":"2023-10-09T07:57:41.694634+0000","last_became_active":"2023-10-09T07:57:40.701089+0000","last_became_peered":"2023-10-09T07:57:40.701089+0000","last_unstale":"2023-10-09T07:57:41.694634+0000","last_undegraded":"2023-10-09T07:57:41.694634+0000","last_fullsized":"2023-10-09T07:57:41.694634+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:58:10.965338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:57:40.681192+0000","last_change":"2023-10-09T07:57:40.681192+0000","last_active":"2023-10-09T07:57:40.681192+0000","last_peered":"2023-10-09T07:57:40.681192+0000","last_clean":"2023-10-09T07:57:40.681192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:40.681192+0000","last_undegraded":"2023-10-09T07:57:40.681192+0000","last_fullsized":"2023-10-09T07:57:40.681192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T07:57:39.670961+0000","last_change":"2023-10-09T07:57:39.690942+0000","last_active":"2023-10-09T07:57:39.670961+0000","last_peered":"2023-10-09T07:57:39.670961+0000","last_clean":"2023-10-09T07:57:39.670961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:57:39.670961+0000","last_undegraded":"2023-10-09T07:57:39.670961+0000","last_fullsized":"2023-10-09T07:57:39.670961+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:33.244913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"152'271","reported_seq":829,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-09T07:57:38.217624+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T07:57:38.217624+0000","last_peered":"2023-10-09T07:57:38.217624+0000","last_clean":"2023-10-09T07:57:38.217624+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T07:57:38.217624+0000","last_undegraded":"2023-10-09T07:57:38.217624+0000","last_fullsized":"2023-10-09T07:57:38.217624+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":3},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575743,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307992,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063848,"statfs":{"total":96636764160,"available":96321380352,"internally_reserved":0,"allocated":2572288,"data_stored":1575965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.751,"15min":0.755},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1,"5min":1.016,"15min":1.127},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.47399999999999998},"max":{"1min":1.0029999999999999,"5min":1.026,"15min":1.1319999999999999},"last":0.63600000000000001}]},{"osd":1,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.74099999999999999,"15min":0.73799999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.46000000000000002},"max":{"1min":0.94199999999999995,"5min":1.002,"15min":1.077},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75,"15min":0.752},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.47399999999999998},"max":{"1min":0.95099999999999996,"5min":0.997,"15min":1.038},"last":0.748}]},{"osd":2,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.50600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.94899999999999995,"5min":1.016,"15min":1.0269999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.76600000000000001,"15min":0.76800000000000002},"min":{"1min":0.59699999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96599999999999997,"5min":0.98299999999999998,"15min":1.1899999999999999},"last":0.72299999999999998}]},{"osd":3,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.52700000000000002,"5min":0.49399999999999999,"15min":0.42099999999999999},"max":{"1min":0.995,"5min":0.995,"15min":1.04},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78900000000000003,"15min":0.79400000000000004},"min":{"1min":0.66100000000000003,"5min":0.55900000000000005,"15min":0.54400000000000004},"max":{"1min":1.0249999999999999,"5min":1.0529999999999999,"15min":1.0920000000000001},"last":0.80800000000000005}]},{"osd":4,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63400000000000001,"15min":0.62},"min":{"1min":0.433,"5min":0.42199999999999999,"15min":0.36299999999999999},"max":{"1min":0.85299999999999998,"5min":0.97099999999999997,"15min":1.248},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92500000000000004,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.434,"5min":0.41299999999999998,"15min":0.38700000000000001},"max":{"1min":0.874,"5min":0.98299999999999998,"15min":1.0600000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68600000000000005,"15min":0.69099999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92400000000000004,"5min":1.0009999999999999,"15min":1.304},"last":0.86899999999999999}]},{"osd":6,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.746,"15min":0.748},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89900000000000002,"5min":1.069,"15min":1.405},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.43099999999999999},"max":{"1min":0.96799999999999997,"5min":1.075,"15min":1.377},"last":0.85699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575742,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311508,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060332,"statfs":{"total":96636764160,"available":96317779968,"internally_reserved":0,"allocated":1978368,"data_stored":985597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77300000000000002,"15min":0.754},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.33600000000000002},"max":{"1min":0.88100000000000001,"5min":0.98399999999999999,"15min":1.012},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.55500000000000005,"5min":0.53900000000000003,"15min":0.49399999999999999},"max":{"1min":1.0049999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.75600000000000001}]},{"osd":1,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77700000000000002,"15min":0.77000000000000002},"min":{"1min":0.69099999999999995,"5min":0.53300000000000003,"15min":0.48199999999999998},"max":{"1min":0.93500000000000005,"5min":1.113,"15min":1.2769999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.78800000000000003,"15min":0.77000000000000002},"min":{"1min":0.59899999999999998,"5min":0.55400000000000005,"15min":0.501},"max":{"1min":0.98899999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.73199999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.77800000000000002,"15min":0.76000000000000001},"min":{"1min":0.57199999999999995,"5min":0.46100000000000002,"15min":0.432},"max":{"1min":0.88400000000000001,"5min":1.075,"15min":1.075},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80300000000000005,"15min":0.78100000000000003},"min":{"1min":0.63200000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95699999999999996,"5min":1.151,"15min":1.151},"last":0.67100000000000004}]},{"osd":3,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76800000000000002,"15min":0.75800000000000001},"min":{"1min":0.56100000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.877,"5min":1.423,"15min":1.423},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79400000000000004,"15min":0.78500000000000003},"min":{"1min":0.624,"5min":0.55500000000000005,"15min":0.54100000000000004},"max":{"1min":1.0269999999999999,"5min":1.335,"15min":1.335},"last":0.71099999999999997}]},{"osd":4,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.45800000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88900000000000001,"5min":0.98099999999999998,"15min":1.1279999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65500000000000003,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.89700000000000002,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97199999999999998,"5min":1.306,"15min":1.306},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70899999999999996,"15min":0.69899999999999995},"min":{"1min":0.55500000000000005,"5min":0.45400000000000001,"15min":0.42699999999999999},"max":{"1min":0.95199999999999996,"5min":1.054,"15min":1.085},"last":0.57799999999999996}]},{"osd":7,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.47699999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.80800000000000005,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.54400000000000004,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97399999999999998,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.60499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575743,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303328,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068512,"statfs":{"total":96636764160,"available":96326156288,"internally_reserved":0,"allocated":1990656,"data_stored":991866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48499999999999999,"15min":0.46800000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.308},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.52400000000000002,"15min":0.50700000000000001},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.313},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.41499999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.54800000000000004,"15min":0.51700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32900000000000001},"max":{"1min":5.1159999999999997,"5min":5.1159999999999997,"15min":5.1159999999999997},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.63600000000000001,"15min":0.59599999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.375},"max":{"1min":5.399,"5min":5.399,"15min":5.399},"last":0.443}]},{"osd":3,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.63900000000000001,"15min":0.63600000000000001},"min":{"1min":0.42999999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.41699999999999998,"5min":0.39900000000000002,"15min":0.37},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.499}]},{"osd":4,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.83899999999999997,"15min":0.80800000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.42699999999999999},"max":{"1min":5.2409999999999997,"5min":5.2409999999999997,"15min":5.2409999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.86599999999999999,"15min":0.82699999999999996},"min":{"1min":0.65700000000000003,"5min":0.622,"15min":0.56699999999999995},"max":{"1min":5.4409999999999998,"5min":5.4409999999999998,"15min":5.4409999999999998},"last":0.754}]},{"osd":5,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.81499999999999995,"15min":0.81100000000000005},"min":{"1min":0.64000000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.85499999999999998,"15min":0.82499999999999996},"min":{"1min":0.60299999999999998,"5min":0.57999999999999996,"15min":0.442},"max":{"1min":5.1630000000000003,"5min":5.1630000000000003,"15min":5.1630000000000003},"last":0.69799999999999995}]},{"osd":6,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.89300000000000002,"15min":0.84499999999999997},"min":{"1min":0.65300000000000002,"5min":0.63900000000000001,"15min":0.55100000000000005},"max":{"1min":5.4749999999999996,"5min":5.4749999999999996,"15min":5.4749999999999996},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83499999999999996,"15min":0.82999999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.60999999999999999}]},{"osd":7,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.56000000000000005},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.081,"5min":0.92800000000000005,"15min":0.88500000000000001},"min":{"1min":0.66500000000000004,"5min":0.63,"15min":0.55300000000000005},"max":{"1min":5.2009999999999996,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":0.74099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575743,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303944,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067896,"statfs":{"total":96636764160,"available":96325525504,"internally_reserved":0,"allocated":2621440,"data_stored":1602940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.49399999999999999,"15min":0.47799999999999998},"min":{"1min":0.37,"5min":0.29999999999999999,"15min":0.28799999999999998},"max":{"1min":0.69599999999999995,"5min":0.72099999999999997,"15min":0.86499999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32000000000000001},"max":{"1min":0.70599999999999996,"5min":0.82999999999999996,"15min":0.88200000000000001},"last":0.68899999999999995}]},{"osd":2,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.39800000000000002,"5min":0.38200000000000001,"15min":0.36799999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.91800000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.374,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66800000000000004,"5min":0.78700000000000003,"15min":0.82399999999999995},"last":0.52400000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.373},"max":{"1min":0.73199999999999998,"5min":0.84299999999999997,"15min":0.98599999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.61799999999999999,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86899999999999999,"5min":0.89600000000000002,"15min":0.94699999999999995},"last":0.64700000000000002}]},{"osd":4,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.64800000000000002,"5min":0.57799999999999996,"15min":0.52200000000000002},"max":{"1min":0.98499999999999999,"5min":1.1699999999999999,"15min":1.532},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82799999999999996,"15min":0.81899999999999995},"min":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.54200000000000004},"max":{"1min":1.0920000000000001,"5min":1.1339999999999999,"15min":1.2470000000000001},"last":0.76800000000000002}]},{"osd":5,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.80200000000000005,"15min":0.79700000000000004},"min":{"1min":0.59799999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0349999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.67200000000000004,"5min":0.59699999999999998,"15min":0.55500000000000005},"max":{"1min":1.1100000000000001,"5min":1.296,"15min":1.3009999999999999},"last":0.73299999999999998}]},{"osd":6,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.85699999999999998,"15min":0.83999999999999997},"min":{"1min":0.67100000000000004,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.048,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.81999999999999995,"15min":0.81899999999999995},"min":{"1min":0.59499999999999997,"5min":0.57699999999999996,"15min":0.51400000000000001},"max":{"1min":1.131,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.72399999999999998}]},{"osd":7,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.84699999999999998,"15min":0.85499999999999998},"min":{"1min":0.626,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":1.1020000000000001,"5min":1.246,"15min":1.3380000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.88800000000000001,"15min":0.86899999999999999},"min":{"1min":0.70199999999999996,"5min":0.61899999999999999,"15min":0.54400000000000004},"max":{"1min":1.1559999999999999,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.84899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575743,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311564,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060276,"statfs":{"total":96636764160,"available":96317722624,"internally_reserved":0,"allocated":2035712,"data_stored":1013160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.46899999999999997},"min":{"1min":0.33800000000000002,"5min":0.309,"15min":0.30199999999999999},"max":{"1min":0.71299999999999997,"5min":0.72099999999999997,"15min":0.84999999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.36499999999999999,"5min":0.35599999999999998,"15min":0.316},"max":{"1min":0.65700000000000003,"5min":0.76100000000000001,"15min":0.85599999999999998},"last":0.432}]},{"osd":1,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.35799999999999998,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.65000000000000002,"5min":0.68000000000000005,"15min":0.85399999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53600000000000003},"min":{"1min":0.41099999999999998,"5min":0.39400000000000002,"15min":0.34599999999999997},"max":{"1min":0.71799999999999997,"5min":0.78200000000000003,"15min":0.98699999999999999},"last":0.39600000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.47899999999999998,"5min":0.46600000000000003,"15min":0.41399999999999998},"max":{"1min":0.77600000000000002,"5min":0.79900000000000004,"15min":0.95199999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.49399999999999999,"5min":0.44500000000000001,"15min":0.40999999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.95099999999999996},"last":0.56100000000000005}]},{"osd":4,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79900000000000004,"15min":0.79600000000000004},"min":{"1min":0.58599999999999997,"5min":0.56299999999999994,"15min":0.54500000000000004},"max":{"1min":1.147,"5min":1.196,"15min":1.202},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.78600000000000003,"15min":0.78100000000000003},"min":{"1min":0.56200000000000006,"5min":0.54000000000000004,"15min":0.47799999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.141},"last":0.96099999999999997}]},{"osd":5,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81999999999999995,"15min":0.79200000000000004},"min":{"1min":0.63200000000000001,"5min":0.60799999999999998,"15min":0.57199999999999995},"max":{"1min":1.0489999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.82399999999999995,"15min":0.81499999999999995},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0640000000000001,"5min":1.254,"15min":1.254},"last":0.82599999999999996}]},{"osd":6,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82499999999999996,"15min":0.81000000000000005},"min":{"1min":0.63,"5min":0.56999999999999995,"15min":0.48099999999999998},"max":{"1min":1.0980000000000001,"5min":1.1639999999999999,"15min":1.296},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83399999999999996,"15min":0.81999999999999995},"min":{"1min":0.60399999999999998,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1000000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.84499999999999997,"15min":0.83499999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.53600000000000003},"max":{"1min":1.1719999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89700000000000002,"15min":0.874},"min":{"1min":0.73799999999999999,"5min":0.66500000000000004,"15min":0.65300000000000002},"max":{"1min":1.157,"5min":1.298,"15min":1.298},"last":0.78300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575744,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311564,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060276,"statfs":{"total":96636764160,"available":96317722624,"internally_reserved":0,"allocated":2035712,"data_stored":1012732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48799999999999999,"15min":0.48699999999999999},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.29599999999999999},"max":{"1min":0.624,"5min":0.77100000000000002,"15min":0.81899999999999995},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.35399999999999998,"5min":0.33500000000000002,"15min":0.32300000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.91700000000000004},"last":0.45100000000000001}]},{"osd":1,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.33700000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.84699999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.46100000000000002,"5min":0.38300000000000001,"15min":0.35599999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.47299999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.46600000000000003,"5min":0.42099999999999999,"15min":0.34999999999999998},"max":{"1min":0.75800000000000001,"5min":0.76000000000000001,"15min":0.90900000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65000000000000002,"15min":0.65200000000000002},"min":{"1min":0.53600000000000003,"5min":0.48399999999999999,"15min":0.40899999999999997},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.95799999999999996},"last":0.52900000000000003}]},{"osd":4,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78300000000000003,"15min":0.77200000000000002},"min":{"1min":0.58799999999999997,"5min":0.55000000000000004,"15min":0.47499999999999998},"max":{"1min":1.121,"5min":1.246,"15min":1.246},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.86399999999999999,"15min":0.85399999999999998},"min":{"1min":0.71899999999999997,"5min":0.629,"15min":0.57799999999999996},"max":{"1min":1.1419999999999999,"5min":1.157,"15min":1.157},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77400000000000002,"15min":0.76500000000000001},"min":{"1min":0.57399999999999995,"5min":0.52700000000000002,"15min":0.48499999999999999},"max":{"1min":1.0920000000000001,"5min":1.1140000000000001,"15min":1.1910000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.83199999999999996,"15min":0.82899999999999996},"min":{"1min":0.66900000000000004,"5min":0.63800000000000001,"15min":0.48899999999999999},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.81100000000000005,"15min":0.79600000000000004},"min":{"1min":0.623,"5min":0.57799999999999996,"15min":0.495},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82099999999999995,"15min":0.81499999999999995},"min":{"1min":0.65900000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.024,"5min":1.105,"15min":1.2230000000000001},"last":0.59299999999999997}]},{"osd":7,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.85899999999999999,"15min":0.84999999999999998},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.53100000000000003},"max":{"1min":1.1599999999999999,"5min":1.21,"15min":1.2430000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.85699999999999998,"15min":0.84799999999999998},"min":{"1min":0.72699999999999998,"5min":0.627,"15min":0.56699999999999995},"max":{"1min":1.179,"5min":1.179,"15min":1.1850000000000001},"last":0.77900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575742,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315604,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056236,"statfs":{"total":96636764160,"available":96313585664,"internally_reserved":0,"allocated":1978368,"data_stored":985597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73399999999999999,"15min":0.72399999999999998},"min":{"1min":0.54100000000000004,"5min":0.48799999999999999,"15min":0.41199999999999998},"max":{"1min":0.93600000000000005,"5min":1.052,"15min":1.0700000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.76600000000000001,"15min":0.76200000000000001},"min":{"1min":0.52700000000000002,"5min":0.501,"15min":0.49199999999999999},"max":{"1min":0.89000000000000001,"5min":1.0680000000000001,"15min":1.3320000000000001},"last":0.67000000000000004}]},{"osd":1,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.75,"15min":0.73499999999999999},"min":{"1min":0.59299999999999997,"5min":0.504,"15min":0.47499999999999998},"max":{"1min":0.90000000000000002,"5min":1.038,"15min":1.0640000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.752,"15min":0.747},"min":{"1min":0.57199999999999995,"5min":0.54400000000000004,"15min":0.48999999999999999},"max":{"1min":0.91400000000000003,"5min":1.028,"15min":1.242},"last":0.63400000000000001}]},{"osd":2,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.80500000000000005,"15min":0.79300000000000004},"min":{"1min":0.63500000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.97899999999999998,"5min":0.999,"15min":1.228},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.65300000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.99299999999999999,"5min":1.069,"15min":1.069},"last":0.94099999999999995}]},{"osd":3,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77700000000000002,"15min":0.76300000000000001},"min":{"1min":0.628,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.94699999999999995,"5min":1.131,"15min":1.151},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.56399999999999995,"5min":0.53800000000000003,"15min":0.53500000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.2110000000000001},"last":0.68799999999999994}]},{"osd":5,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.60699999999999998,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.372,"15min":0.36299999999999999},"max":{"1min":0.872,"5min":1.27,"15min":1.27},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.62,"15min":0.623},"min":{"1min":0.45600000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.79400000000000004,"5min":1.014,"15min":1.014},"last":0.45000000000000001}]},{"osd":6,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.5,"5min":0.46899999999999997,"15min":0.41699999999999998},"max":{"1min":0.95199999999999996,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.67800000000000005,"15min":0.67000000000000004},"min":{"1min":0.47999999999999998,"5min":0.45500000000000002,"15min":0.39000000000000001},"max":{"1min":0.92500000000000004,"5min":1.425,"15min":1.425},"last":0.72599999999999998}]},{"osd":7,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70399999999999996,"15min":0.72099999999999997},"min":{"1min":0.53500000000000003,"5min":0.48699999999999999,"15min":0.47999999999999998},"max":{"1min":0.81799999999999995,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76600000000000001,"15min":0.76300000000000001},"min":{"1min":0.57499999999999996,"5min":0.51200000000000001,"15min":0.46600000000000003},"max":{"1min":0.94299999999999995,"5min":1.0529999999999999,"15min":1.165},"last":0.89100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575743,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311508,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060332,"statfs":{"total":96636764160,"available":96317779968,"internally_reserved":0,"allocated":1978368,"data_stored":985597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.745,"15min":0.73199999999999998},"min":{"1min":0.55600000000000005,"5min":0.46200000000000002,"15min":0.39100000000000001},"max":{"1min":0.97199999999999998,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.621},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74199999999999999,"15min":0.72499999999999998},"min":{"1min":0.51100000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.0820000000000001},"last":0.60499999999999998}]},{"osd":1,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73399999999999999,"15min":0.73299999999999998},"min":{"1min":0.56899999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":0.97499999999999998,"15min":1.0129999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76300000000000001,"15min":0.75600000000000001},"min":{"1min":0.56599999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.0289999999999999},"last":0.70199999999999996}]},{"osd":2,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77100000000000002,"15min":0.75800000000000001},"min":{"1min":0.63400000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95399999999999996,"5min":0.95699999999999996,"15min":0.98599999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.5,"5min":0.5,"15min":0.44500000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":1.026},"last":0.54800000000000004}]},{"osd":3,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77800000000000002,"15min":0.76600000000000001},"min":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.47499999999999998},"max":{"1min":0.92200000000000004,"5min":0.97799999999999998,"15min":1.107},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79700000000000004,"15min":0.78500000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.96699999999999997,"5min":0.99099999999999999,"15min":1.0249999999999999},"last":0.58699999999999997}]},{"osd":4,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.61099999999999999,"15min":0.60599999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.82099999999999995,"5min":1.002,"15min":1.0189999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.625,"15min":0.61699999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.379},"max":{"1min":0.89200000000000002,"5min":0.96199999999999997,"15min":1.0289999999999999},"last":0.53100000000000003}]},{"osd":6,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64000000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.91400000000000003,"5min":0.95899999999999996,"15min":0.998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68700000000000006,"15min":0.67800000000000005},"min":{"1min":0.51200000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.054},"last":0.50600000000000001}]},{"osd":7,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.69499999999999995},"min":{"1min":0.47199999999999998,"5min":0.45000000000000001,"15min":0.433},"max":{"1min":0.93400000000000005,"5min":1.0449999999999999,"15min":1.073},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.79200000000000004,"15min":0.78500000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.5},"max":{"1min":1.0069999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.72199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T07:57:46.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3e is not active+clean 2023-10-09T07:57:46.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3d is not active+clean 2023-10-09T07:57:46.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3b is not active+clean 2023-10-09T07:57:46.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3a is not active+clean 2023-10-09T07:57:46.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.39 is not active+clean 2023-10-09T07:57:46.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.38 is not active+clean 2023-10-09T07:57:46.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.37 is not active+clean 2023-10-09T07:57:46.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.36 is not active+clean 2023-10-09T07:57:46.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.34 is not active+clean 2023-10-09T07:57:46.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.32 is not active+clean 2023-10-09T07:57:46.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2f is not active+clean 2023-10-09T07:57:46.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2b is not active+clean 2023-10-09T07:57:46.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.29 is not active+clean 2023-10-09T07:57:46.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.27 is not active+clean 2023-10-09T07:57:46.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.24 is not active+clean 2023-10-09T07:57:46.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.21 is not active+clean 2023-10-09T07:57:46.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.20 is not active+clean 2023-10-09T07:57:46.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1f is not active+clean 2023-10-09T07:57:46.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T07:57:39.670961+0000', 'last_change': '2023-10-09T07:57:39.690610+0000', 'last_active': '2023-10-09T07:57:39.670961+0000', 'last_peered': '2023-10-09T07:57:39.670961+0000', 'last_clean': '2023-10-09T07:57:39.670961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:39.670961+0000', 'last_undegraded': '2023-10-09T07:57:39.670961+0000', 'last_fullsized': '2023-10-09T07:57:39.670961+0000', 'mapping_epoch': 160, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 160, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:09:16.698996+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T07:57:46.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1f is not active+clean 2023-10-09T07:57:46.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1e is not active+clean 2023-10-09T07:57:46.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T07:57:39.670961+0000', 'last_change': '2023-10-09T07:57:39.686328+0000', 'last_active': '2023-10-09T07:57:39.670961+0000', 'last_peered': '2023-10-09T07:57:39.670961+0000', 'last_clean': '2023-10-09T07:57:39.670961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:39.670961+0000', 'last_undegraded': '2023-10-09T07:57:39.670961+0000', 'last_fullsized': '2023-10-09T07:57:39.670961+0000', 'mapping_epoch': 160, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 160, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T08:21:53.914995+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T07:57:46.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1c is not active+clean 2023-10-09T07:57:46.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1d is not active+clean 2023-10-09T07:57:46.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1c is not active+clean 2023-10-09T07:57:46.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T07:57:39.670961+0000', 'last_change': '2023-10-09T07:57:39.686216+0000', 'last_active': '2023-10-09T07:57:39.670961+0000', 'last_peered': '2023-10-09T07:57:39.670961+0000', 'last_clean': '2023-10-09T07:57:39.670961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:39.670961+0000', 'last_undegraded': '2023-10-09T07:57:39.670961+0000', 'last_fullsized': '2023-10-09T07:57:39.670961+0000', 'mapping_epoch': 160, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 160, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:50:00.330127+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T07:57:46.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1b is not active+clean 2023-10-09T07:57:46.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T07:57:39.670961+0000', 'last_change': '2023-10-09T07:57:39.686239+0000', 'last_active': '2023-10-09T07:57:39.670961+0000', 'last_peered': '2023-10-09T07:57:39.670961+0000', 'last_clean': '2023-10-09T07:57:39.670961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:39.670961+0000', 'last_undegraded': '2023-10-09T07:57:39.670961+0000', 'last_fullsized': '2023-10-09T07:57:39.670961+0000', 'mapping_epoch': 160, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 160, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T10:42:59.410622+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T07:57:46.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1b is not active+clean 2023-10-09T07:57:46.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.18 is not active+clean 2023-10-09T07:57:46.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.19 is not active+clean 2023-10-09T07:57:46.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T07:57:39.670961+0000', 'last_change': '2023-10-09T07:57:39.686488+0000', 'last_active': '2023-10-09T07:57:39.670961+0000', 'last_peered': '2023-10-09T07:57:39.670961+0000', 'last_clean': '2023-10-09T07:57:39.670961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:39.670961+0000', 'last_undegraded': '2023-10-09T07:57:39.670961+0000', 'last_fullsized': '2023-10-09T07:57:39.670961+0000', 'mapping_epoch': 160, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 160, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T09:51:23.776295+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T07:57:46.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.19 is not active+clean 2023-10-09T07:57:46.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.18 is not active+clean 2023-10-09T07:57:46.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T07:57:39.670961+0000', 'last_change': '2023-10-09T07:57:39.685650+0000', 'last_active': '2023-10-09T07:57:39.670961+0000', 'last_peered': '2023-10-09T07:57:39.670961+0000', 'last_clean': '2023-10-09T07:57:39.670961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:39.670961+0000', 'last_undegraded': '2023-10-09T07:57:39.670961+0000', 'last_fullsized': '2023-10-09T07:57:39.670961+0000', 'mapping_epoch': 160, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 160, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:50:36.386674+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T07:57:46.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.17 is not active+clean 2023-10-09T07:57:46.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T07:57:39.670961+0000', 'last_change': '2023-10-09T07:57:39.687332+0000', 'last_active': '2023-10-09T07:57:39.670961+0000', 'last_peered': '2023-10-09T07:57:39.670961+0000', 'last_clean': '2023-10-09T07:57:39.670961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:39.670961+0000', 'last_undegraded': '2023-10-09T07:57:39.670961+0000', 'last_fullsized': '2023-10-09T07:57:39.670961+0000', 'mapping_epoch': 160, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 160, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:45:51.888713+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T07:57:46.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.17 is not active+clean 2023-10-09T07:57:46.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.14 is not active+clean 2023-10-09T07:57:46.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.15 is not active+clean 2023-10-09T07:57:46.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T07:57:39.670961+0000', 'last_change': '2023-10-09T07:57:39.686086+0000', 'last_active': '2023-10-09T07:57:39.670961+0000', 'last_peered': '2023-10-09T07:57:39.670961+0000', 'last_clean': '2023-10-09T07:57:39.670961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:39.670961+0000', 'last_undegraded': '2023-10-09T07:57:39.670961+0000', 'last_fullsized': '2023-10-09T07:57:39.670961+0000', 'mapping_epoch': 160, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 160, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:32:28.657592+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T07:57:46.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.15 is not active+clean 2023-10-09T07:57:46.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.14 is not active+clean 2023-10-09T07:57:46.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T07:57:39.670961+0000', 'last_change': '2023-10-09T07:57:39.688021+0000', 'last_active': '2023-10-09T07:57:39.670961+0000', 'last_peered': '2023-10-09T07:57:39.670961+0000', 'last_clean': '2023-10-09T07:57:39.670961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:39.670961+0000', 'last_undegraded': '2023-10-09T07:57:39.670961+0000', 'last_fullsized': '2023-10-09T07:57:39.670961+0000', 'mapping_epoch': 160, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 160, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:39:42.240311+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T07:57:46.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.10 is not active+clean 2023-10-09T07:57:46.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.11 is not active+clean 2023-10-09T07:57:46.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T07:57:39.670961+0000', 'last_change': '2023-10-09T07:57:39.685623+0000', 'last_active': '2023-10-09T07:57:39.670961+0000', 'last_peered': '2023-10-09T07:57:39.670961+0000', 'last_clean': '2023-10-09T07:57:39.670961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:39.670961+0000', 'last_undegraded': '2023-10-09T07:57:39.670961+0000', 'last_fullsized': '2023-10-09T07:57:39.670961+0000', 'mapping_epoch': 160, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 160, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:15:18.393682+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T07:57:46.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.11 is not active+clean 2023-10-09T07:57:46.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.10 is not active+clean 2023-10-09T07:57:46.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T07:57:39.670961+0000', 'last_change': '2023-10-09T07:57:39.688474+0000', 'last_active': '2023-10-09T07:57:39.670961+0000', 'last_peered': '2023-10-09T07:57:39.670961+0000', 'last_clean': '2023-10-09T07:57:39.670961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:39.670961+0000', 'last_undegraded': '2023-10-09T07:57:39.670961+0000', 'last_fullsized': '2023-10-09T07:57:39.670961+0000', 'mapping_epoch': 160, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 160, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:53:04.363976+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T07:57:46.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.e is not active+clean 2023-10-09T07:57:46.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.f is not active+clean 2023-10-09T07:57:46.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T07:57:39.670961+0000', 'last_change': '2023-10-09T07:57:39.686847+0000', 'last_active': '2023-10-09T07:57:39.670961+0000', 'last_peered': '2023-10-09T07:57:39.670961+0000', 'last_clean': '2023-10-09T07:57:39.670961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:39.670961+0000', 'last_undegraded': '2023-10-09T07:57:39.670961+0000', 'last_fullsized': '2023-10-09T07:57:39.670961+0000', 'mapping_epoch': 160, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 160, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:36:30.282993+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T07:57:46.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.f is not active+clean 2023-10-09T07:57:46.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.d is not active+clean 2023-10-09T07:57:46.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T07:57:39.670961+0000', 'last_change': '2023-10-09T07:57:39.686340+0000', 'last_active': '2023-10-09T07:57:39.670961+0000', 'last_peered': '2023-10-09T07:57:39.670961+0000', 'last_clean': '2023-10-09T07:57:39.670961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:39.670961+0000', 'last_undegraded': '2023-10-09T07:57:39.670961+0000', 'last_fullsized': '2023-10-09T07:57:39.670961+0000', 'mapping_epoch': 160, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 160, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:46:49.504100+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T07:57:46.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.d is not active+clean 2023-10-09T07:57:46.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.c is not active+clean 2023-10-09T07:57:46.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T07:57:39.670961+0000', 'last_change': '2023-10-09T07:57:39.686407+0000', 'last_active': '2023-10-09T07:57:39.670961+0000', 'last_peered': '2023-10-09T07:57:39.670961+0000', 'last_clean': '2023-10-09T07:57:39.670961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:39.670961+0000', 'last_undegraded': '2023-10-09T07:57:39.670961+0000', 'last_fullsized': '2023-10-09T07:57:39.670961+0000', 'mapping_epoch': 160, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 160, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:07:00.477516+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T07:57:46.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.b is not active+clean 2023-10-09T07:57:46.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T07:57:39.670961+0000', 'last_change': '2023-10-09T07:57:39.686955+0000', 'last_active': '2023-10-09T07:57:39.670961+0000', 'last_peered': '2023-10-09T07:57:39.670961+0000', 'last_clean': '2023-10-09T07:57:39.670961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:39.670961+0000', 'last_undegraded': '2023-10-09T07:57:39.670961+0000', 'last_fullsized': '2023-10-09T07:57:39.670961+0000', 'mapping_epoch': 160, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 160, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T08:31:28.083757+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T07:57:46.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.b is not active+clean 2023-10-09T07:57:46.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.8 is not active+clean 2023-10-09T07:57:46.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.9 is not active+clean 2023-10-09T07:57:46.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.6 is not active+clean 2023-10-09T07:57:46.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.6 is not active+clean 2023-10-09T07:57:46.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T07:57:39.670961+0000', 'last_change': '2023-10-09T07:57:39.690567+0000', 'last_active': '2023-10-09T07:57:39.670961+0000', 'last_peered': '2023-10-09T07:57:39.670961+0000', 'last_clean': '2023-10-09T07:57:39.670961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:39.670961+0000', 'last_undegraded': '2023-10-09T07:57:39.670961+0000', 'last_fullsized': '2023-10-09T07:57:39.670961+0000', 'mapping_epoch': 160, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 160, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T10:08:08.948333+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T07:57:46.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.4 is not active+clean 2023-10-09T07:57:46.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.5 is not active+clean 2023-10-09T07:57:46.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T07:57:39.670961+0000', 'last_change': '2023-10-09T07:57:39.685651+0000', 'last_active': '2023-10-09T07:57:39.670961+0000', 'last_peered': '2023-10-09T07:57:39.670961+0000', 'last_clean': '2023-10-09T07:57:39.670961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:39.670961+0000', 'last_undegraded': '2023-10-09T07:57:39.670961+0000', 'last_fullsized': '2023-10-09T07:57:39.670961+0000', 'mapping_epoch': 160, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 160, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:47:25.243183+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T07:57:46.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.5 is not active+clean 2023-10-09T07:57:46.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2 is not active+clean 2023-10-09T07:57:46.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3 is not active+clean 2023-10-09T07:57:46.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T07:57:39.670961+0000', 'last_change': '2023-10-09T07:57:39.685687+0000', 'last_active': '2023-10-09T07:57:39.670961+0000', 'last_peered': '2023-10-09T07:57:39.670961+0000', 'last_clean': '2023-10-09T07:57:39.670961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:39.670961+0000', 'last_undegraded': '2023-10-09T07:57:39.670961+0000', 'last_fullsized': '2023-10-09T07:57:39.670961+0000', 'mapping_epoch': 160, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 160, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T10:52:43.023892+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T07:57:46.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3 is not active+clean 2023-10-09T07:57:46.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2 is not active+clean 2023-10-09T07:57:46.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T07:57:39.670961+0000', 'last_change': '2023-10-09T07:57:39.691014+0000', 'last_active': '2023-10-09T07:57:39.670961+0000', 'last_peered': '2023-10-09T07:57:39.670961+0000', 'last_clean': '2023-10-09T07:57:39.670961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:39.670961+0000', 'last_undegraded': '2023-10-09T07:57:39.670961+0000', 'last_fullsized': '2023-10-09T07:57:39.670961+0000', 'mapping_epoch': 160, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 160, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T10:57:28.916749+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T07:57:46.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1 is not active+clean 2023-10-09T07:57:46.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.12 is not active+clean 2023-10-09T07:57:46.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T07:57:40.681192+0000', 'last_change': '2023-10-09T07:57:40.681192+0000', 'last_active': '2023-10-09T07:57:40.681192+0000', 'last_peered': '2023-10-09T07:57:40.681192+0000', 'last_clean': '2023-10-09T07:57:40.681192+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:40.681192+0000', 'last_undegraded': '2023-10-09T07:57:40.681192+0000', 'last_fullsized': '2023-10-09T07:57:40.681192+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:40.681192+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T07:57:46.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.13 is not active+clean 2023-10-09T07:57:46.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T07:57:39.670961+0000', 'last_change': '2023-10-09T07:57:39.690942+0000', 'last_active': '2023-10-09T07:57:39.670961+0000', 'last_peered': '2023-10-09T07:57:39.670961+0000', 'last_clean': '2023-10-09T07:57:39.670961+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T07:57:39.670961+0000', 'last_undegraded': '2023-10-09T07:57:39.670961+0000', 'last_fullsized': '2023-10-09T07:57:39.670961+0000', 'mapping_epoch': 160, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 160, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'last_clean_scrub_stamp': '2023-10-09T07:57:39.670961+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:02:33.244913+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T07:57:46.960 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T07:57:47.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.158+0000 7f886e3ff700 1 Processor -- start 2023-10-09T07:57:47.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.158+0000 7f886e3ff700 1 -- start start 2023-10-09T07:57:47.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.159+0000 7f886e3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8868156510 0x7f88680ac800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.159+0000 7f886e3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f88680acd40 0x7f88681568e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.159+0000 7f886e3ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8868156e20 0x7f88680afc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.159+0000 7f886e3ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88680ad9d0 con 0x7f8868156e20 2023-10-09T07:57:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.160+0000 7f886e3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88680aed00 con 0x7f88680acd40 2023-10-09T07:57:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.160+0000 7f886e3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8868153f10 con 0x7f8868156510 2023-10-09T07:57:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.160+0000 7f886c99c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8868156e20 0x7f88680afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.160+0000 7f886c99c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8868156e20 0x7f88680afc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35550/0 (socket says 172.21.15.71:35550) 2023-10-09T07:57:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.160+0000 7f886c99c700 1 -- 172.21.15.71:0/2050107986 learned_addr learned my addr 172.21.15.71:0/2050107986 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.160+0000 7f8867fff700 1 --2- 172.21.15.71:0/2050107986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8868156510 0x7f88680ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.160+0000 7f88677fe700 1 --2- 172.21.15.71:0/2050107986 >> v2:172.21.15.179:3300/0 conn(0x7f88680acd40 0x7f88681568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.160+0000 7f886c99c700 1 -- 172.21.15.71:0/2050107986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8868156510 msgr2=0x7f88680ac800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.160+0000 7f886c99c700 1 --2- 172.21.15.71:0/2050107986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8868156510 0x7f88680ac800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.160+0000 7f886c99c700 1 -- 172.21.15.71:0/2050107986 >> v2:172.21.15.179:3300/0 conn(0x7f88680acd40 msgr2=0x7f88681568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.160+0000 7f886c99c700 1 --2- 172.21.15.71:0/2050107986 >> v2:172.21.15.179:3300/0 conn(0x7f88680acd40 0x7f88681568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.160+0000 7f886c99c700 1 -- 172.21.15.71:0/2050107986 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88680af800 con 0x7f8868156e20 2023-10-09T07:57:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.160+0000 7f88677fe700 1 --2- 172.21.15.71:0/2050107986 >> v2:172.21.15.179:3300/0 conn(0x7f88680acd40 0x7f88681568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:57:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.161+0000 7f886c99c700 1 --2- 172.21.15.71:0/2050107986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8868156e20 0x7f88680afc90 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f886806aab0 tx=0x7f8860009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a889b7ce30e0459d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.161+0000 7f8866ffd700 1 -- 172.21.15.71:0/2050107986 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886000e070 con 0x7f8868156e20 2023-10-09T07:57:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.161+0000 7f8866ffd700 1 -- 172.21.15.71:0/2050107986 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886000ba20 con 0x7f8868156e20 2023-10-09T07:57:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.161+0000 7f8866ffd700 1 -- 172.21.15.71:0/2050107986 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88600092e0 con 0x7f8868156e20 2023-10-09T07:57:47.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.161+0000 7f886e3ff700 1 -- 172.21.15.71:0/2050107986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8868156e20 msgr2=0x7f88680afc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:47.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.161+0000 7f886e3ff700 1 --2- 172.21.15.71:0/2050107986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8868156e20 0x7f88680afc90 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f886806aab0 tx=0x7f8860009840 comp rx=0 tx=0).stop 2023-10-09T07:57:47.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.161+0000 7f886e3ff700 1 -- 172.21.15.71:0/2050107986 shutdown_connections 2023-10-09T07:57:47.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.161+0000 7f886e3ff700 1 --2- 172.21.15.71:0/2050107986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8868156e20 0x7f88680afc90 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:47.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.161+0000 7f886e3ff700 1 --2- 172.21.15.71:0/2050107986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8868156510 0x7f88680ac800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:47.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.161+0000 7f886e3ff700 1 --2- 172.21.15.71:0/2050107986 >> v2:172.21.15.179:3300/0 conn(0x7f88680acd40 0x7f88681568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:47.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.161+0000 7f886e3ff700 1 -- 172.21.15.71:0/2050107986 >> 172.21.15.71:0/2050107986 conn(0x7f886806a310 msgr2=0x7f88680cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:47.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.162+0000 7f886e3ff700 1 -- 172.21.15.71:0/2050107986 shutdown_connections 2023-10-09T07:57:47.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.162+0000 7f886e3ff700 1 -- 172.21.15.71:0/2050107986 wait complete. 2023-10-09T07:57:47.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.163+0000 7f886e3ff700 1 Processor -- start 2023-10-09T07:57:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.163+0000 7f886e3ff700 1 -- start start 2023-10-09T07:57:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.164+0000 7f886e3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88680acd40 0x7f886816a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.164+0000 7f886e3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8868156510 0x7f886814a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.164+0000 7f886e3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8868156e20 0x7f886814a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.164+0000 7f886e3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886814dbd0 con 0x7f88680acd40 2023-10-09T07:57:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.164+0000 7f886e3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88680ab270 con 0x7f8868156e20 2023-10-09T07:57:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.164+0000 7f886e3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886816a720 con 0x7f8868156510 2023-10-09T07:57:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.164+0000 7f8867fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88680acd40 0x7f886816a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.164+0000 7f8867fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88680acd40 0x7f886816a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35562/0 (socket says 172.21.15.71:35562) 2023-10-09T07:57:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.164+0000 7f8867fff700 1 -- 172.21.15.71:0/1637475054 learned_addr learned my addr 172.21.15.71:0/1637475054 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.164+0000 7f8867fff700 1 -- 172.21.15.71:0/1637475054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8868156510 msgr2=0x7f886814a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:47.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.164+0000 7f8867fff700 1 --2- 172.21.15.71:0/1637475054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8868156510 0x7f886814a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:47.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.164+0000 7f8867fff700 1 -- 172.21.15.71:0/1637475054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8868156e20 msgr2=0x7f886814a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:47.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.164+0000 7f8867fff700 1 --2- 172.21.15.71:0/1637475054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8868156e20 0x7f886814a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:47.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.164+0000 7f8867fff700 1 -- 172.21.15.71:0/1637475054 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8860009ae0 con 0x7f88680acd40 2023-10-09T07:57:47.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.165+0000 7f8867fff700 1 --2- 172.21.15.71:0/1637475054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88680acd40 0x7f886816a1e0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f885800ec80 tx=0x7f88580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:47.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.165+0000 7f884ffff700 1 -- 172.21.15.71:0/1637475054 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885800c9d0 con 0x7f88680acd40 2023-10-09T07:57:47.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.165+0000 7f884ffff700 1 -- 172.21.15.71:0/1637475054 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885800cb50 con 0x7f88680acd40 2023-10-09T07:57:47.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.165+0000 7f884ffff700 1 -- 172.21.15.71:0/1637475054 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8858013470 con 0x7f88680acd40 2023-10-09T07:57:47.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.165+0000 7f886e3ff700 1 -- 172.21.15.71:0/1637475054 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f886814a5b0 con 0x7f88680acd40 2023-10-09T07:57:47.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.165+0000 7f886e3ff700 1 -- 172.21.15.71:0/1637475054 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886814d330 con 0x7f88680acd40 2023-10-09T07:57:47.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.166+0000 7f886e3ff700 1 -- 172.21.15.71:0/1637475054 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88680ca6e0 con 0x7f88680acd40 2023-10-09T07:57:47.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.167+0000 7f884ffff700 1 -- 172.21.15.71:0/1637475054 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8858013860 con 0x7f88680acd40 2023-10-09T07:57:47.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.168+0000 7f884ffff700 1 --2- 172.21.15.71:0/1637475054 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8854066f30 0x7f88540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:47.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.168+0000 7f884ffff700 1 -- 172.21.15.71:0/1637475054 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f8858084b80 con 0x7f88680acd40 2023-10-09T07:57:47.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.168+0000 7f88677fe700 1 --2- 172.21.15.71:0/1637475054 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8854066f30 0x7f88540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:47.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.169+0000 7f88677fe700 1 --2- 172.21.15.71:0/1637475054 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8854066f30 0x7f88540693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f885c006fd0 tx=0x7f885c008040 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:47.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.172+0000 7f884ffff700 1 -- 172.21.15.71:0/1637475054 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8858051b80 con 0x7f88680acd40 2023-10-09T07:57:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.438+0000 7f886e3ff700 1 -- 172.21.15.71:0/1637475054 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f886804c3c0 con 0x7f88680acd40 2023-10-09T07:57:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.439+0000 7f884ffff700 1 -- 172.21.15.71:0/1637475054 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1176 (secure 0 0 0) 0x7f88580551a0 con 0x7f88680acd40 2023-10-09T07:57:47.440 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:57:47.440 INFO:teuthology.orchestra.run.smithi071.stdout:{"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":4533,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":163,"num_osds":8,"num_up_osds":8,"osd_up_since":1696833745,"num_in_osds":8,"osd_in_since":1696833737,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":41},{"state_name":"active+clean","count":36},{"state_name":"creating+peering","count":20}],"num_pgs":97,"num_pools":3,"num_objects":5,"data_bytes":590368,"bytes_used":2536460288,"bytes_avail":770557652992,"bytes_total":773094113280,"unknown_pgs_ratio":0.42268040776252747,"inactive_pgs_ratio":0.20618556439876556,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":74,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8589}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2023-10-09T07:47:45.657186+0000","services":{}},"progress_events":{}} 2023-10-09T07:57:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.441+0000 7f886e3ff700 1 -- 172.21.15.71:0/1637475054 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8854066f30 msgr2=0x7f88540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.441+0000 7f886e3ff700 1 --2- 172.21.15.71:0/1637475054 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8854066f30 0x7f88540693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f885c006fd0 tx=0x7f885c008040 comp rx=0 tx=0).stop 2023-10-09T07:57:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.441+0000 7f886e3ff700 1 -- 172.21.15.71:0/1637475054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88680acd40 msgr2=0x7f886816a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.441+0000 7f886e3ff700 1 --2- 172.21.15.71:0/1637475054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88680acd40 0x7f886816a1e0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f885800ec80 tx=0x7f88580091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.441+0000 7f886e3ff700 1 -- 172.21.15.71:0/1637475054 shutdown_connections 2023-10-09T07:57:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.441+0000 7f886e3ff700 1 --2- 172.21.15.71:0/1637475054 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8854066f30 0x7f88540693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.441+0000 7f886e3ff700 1 --2- 172.21.15.71:0/1637475054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8868156e20 0x7f886814a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.441+0000 7f886e3ff700 1 --2- 172.21.15.71:0/1637475054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88680acd40 0x7f886816a1e0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.441+0000 7f886e3ff700 1 --2- 172.21.15.71:0/1637475054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8868156510 0x7f886814a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.441+0000 7f886e3ff700 1 -- 172.21.15.71:0/1637475054 >> 172.21.15.71:0/1637475054 conn(0x7f886806a310 msgr2=0x7f88681549b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.441+0000 7f886e3ff700 1 -- 172.21.15.71:0/1637475054 shutdown_connections 2023-10-09T07:57:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.441+0000 7f886e3ff700 1 -- 172.21.15.71:0/1637475054 wait complete. 2023-10-09T07:57:47.459 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T07:57:47.459 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T07:57:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.640+0000 7f1412bff700 1 Processor -- start 2023-10-09T07:57:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.640+0000 7f1412bff700 1 -- start start 2023-10-09T07:57:47.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.642+0000 7f1412bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140c155c10 0x7f140c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:47.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.642+0000 7f1412bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140c0acac0 con 0x7f140c0ac6a0 2023-10-09T07:57:47.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.642+0000 7f1412bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140c0ad930 con 0x7f140c0ac230 2023-10-09T07:57:47.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.642+0000 7f1412bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c0acd20 con 0x7f140c155c10 2023-10-09T07:57:47.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.642+0000 7f141119c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f140c0ac6a0 0x7f140c0b0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52042/0 (socket says 172.21.15.71:52042) 2023-10-09T07:57:47.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.642+0000 7f141119c700 1 -- 172.21.15.71:0/2771743572 learned_addr learned my addr 172.21.15.71:0/2771743572 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:47.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.642+0000 7f141099b700 1 --2- 172.21.15.71:0/2771743572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140c155c10 0x7f140c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:47.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.642+0000 7f140b7fe700 1 -- 172.21.15.71:0/2771743572 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1863169603 0 0) 0x7f140c0acac0 con 0x7f140c0ac6a0 2023-10-09T07:57:47.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.642+0000 7f140b7fe700 1 -- 172.21.15.71:0/2771743572 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13fc004680 con 0x7f140c0ac6a0 2023-10-09T07:57:47.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.643+0000 7f140b7fe700 1 -- 172.21.15.71:0/2771743572 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827771244 0 0) 0x7f140c0ad930 con 0x7f140c0ac230 2023-10-09T07:57:47.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.643+0000 7f140b7fe700 1 -- 172.21.15.71:0/2771743572 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f140c0acac0 con 0x7f140c0ac230 2023-10-09T07:57:47.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.643+0000 7f141099b700 1 -- 172.21.15.71:0/2771743572 >> v1:172.21.15.179:6789/0 conn(0x7f140c0ac230 legacy=0x7f140c1568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:47.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.643+0000 7f140b7fe700 1 -- 172.21.15.71:0/2771743572 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2668433150 0 0) 0x7f13fc004680 con 0x7f140c0ac6a0 2023-10-09T07:57:47.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.643+0000 7f141099b700 1 -- 172.21.15.71:0/2771743572 >> v1:172.21.15.71:6789/0 conn(0x7f140c0ac6a0 legacy=0x7f140c0b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.643+0000 7f141099b700 1 -- 172.21.15.71:0/2771743572 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c0ad000 con 0x7f140c155c10 2023-10-09T07:57:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.643+0000 7f141099b700 1 --2- 172.21.15.71:0/2771743572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140c155c10 0x7f140c155fe0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1400009910 tx=0x7f14000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaefb528130198af server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.643+0000 7f140b7fe700 1 -- 172.21.15.71:0/2771743572 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14040017f0 con 0x7f140c155c10 2023-10-09T07:57:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.643+0000 7f140b7fe700 1 -- 172.21.15.71:0/2771743572 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1400011420 con 0x7f140c155c10 2023-10-09T07:57:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.643+0000 7f140b7fe700 1 -- 172.21.15.71:0/2771743572 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14000117a0 con 0x7f140c155c10 2023-10-09T07:57:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.644+0000 7f1412bff700 1 -- 172.21.15.71:0/2771743572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140c155c10 msgr2=0x7f140c155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.644+0000 7f1412bff700 1 --2- 172.21.15.71:0/2771743572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140c155c10 0x7f140c155fe0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1400009910 tx=0x7f14000091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.644+0000 7f1412bff700 1 -- 172.21.15.71:0/2771743572 shutdown_connections 2023-10-09T07:57:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.644+0000 7f1412bff700 1 --2- 172.21.15.71:0/2771743572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140c155c10 0x7f140c155fe0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.644+0000 7f1412bff700 1 -- 172.21.15.71:0/2771743572 >> 172.21.15.71:0/2771743572 conn(0x7f140c06a320 msgr2=0x7f140c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.644+0000 7f1412bff700 1 -- 172.21.15.71:0/2771743572 shutdown_connections 2023-10-09T07:57:47.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.644+0000 7f1412bff700 1 -- 172.21.15.71:0/2771743572 wait complete. 2023-10-09T07:57:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.645+0000 7f1412bff700 1 Processor -- start 2023-10-09T07:57:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.646+0000 7f1412bff700 1 -- start start 2023-10-09T07:57:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.646+0000 7f1412bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140c0ac230 0x7f140c06dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.646+0000 7f1412bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f140c0ac6a0 0x7f140c146d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.646+0000 7f1412bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f140c155c10 0x7f140c147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.646+0000 7f1412bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c0aa310 con 0x7f140c155c10 2023-10-09T07:57:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.646+0000 7f1412bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c0a9700 con 0x7f140c0ac6a0 2023-10-09T07:57:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.646+0000 7f1412bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c0a99e0 con 0x7f140c0ac230 2023-10-09T07:57:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.647+0000 7f141119c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f140c155c10 0x7f140c147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.647+0000 7f141119c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f140c155c10 0x7f140c147260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35570/0 (socket says 172.21.15.71:35570) 2023-10-09T07:57:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.647+0000 7f141119c700 1 -- 172.21.15.71:0/3603197093 learned_addr learned my addr 172.21.15.71:0/3603197093 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.647+0000 7f141099b700 1 --2- 172.21.15.71:0/3603197093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140c0ac230 0x7f140c06dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.647+0000 7f140bfff700 1 --2- 172.21.15.71:0/3603197093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f140c0ac6a0 0x7f140c146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.647+0000 7f141119c700 1 -- 172.21.15.71:0/3603197093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140c0ac230 msgr2=0x7f140c06dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.647+0000 7f141119c700 1 --2- 172.21.15.71:0/3603197093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140c0ac230 0x7f140c06dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.647+0000 7f141119c700 1 -- 172.21.15.71:0/3603197093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f140c0ac6a0 msgr2=0x7f140c146d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.647+0000 7f141119c700 1 --2- 172.21.15.71:0/3603197093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f140c0ac6a0 0x7f140c146d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.647+0000 7f141119c700 1 -- 172.21.15.71:0/3603197093 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1400009420 con 0x7f140c155c10 2023-10-09T07:57:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.647+0000 7f141119c700 1 --2- 172.21.15.71:0/3603197093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f140c155c10 0x7f140c147260 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f140400cc10 tx=0x7f1404007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.648+0000 7f1408ff9700 1 -- 172.21.15.71:0/3603197093 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404004dc0 con 0x7f140c155c10 2023-10-09T07:57:47.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.648+0000 7f1408ff9700 1 -- 172.21.15.71:0/3603197093 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140400a720 con 0x7f140c155c10 2023-10-09T07:57:47.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.648+0000 7f1408ff9700 1 -- 172.21.15.71:0/3603197093 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140400aae0 con 0x7f140c155c10 2023-10-09T07:57:47.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.648+0000 7f1412bff700 1 -- 172.21.15.71:0/3603197093 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140c0a9cc0 con 0x7f140c155c10 2023-10-09T07:57:47.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.648+0000 7f1412bff700 1 -- 172.21.15.71:0/3603197093 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140c06e020 con 0x7f140c155c10 2023-10-09T07:57:47.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.649+0000 7f1412bff700 1 -- 172.21.15.71:0/3603197093 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140c04c3c0 con 0x7f140c155c10 2023-10-09T07:57:47.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.650+0000 7f1408ff9700 1 -- 172.21.15.71:0/3603197093 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1404007150 con 0x7f140c155c10 2023-10-09T07:57:47.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.650+0000 7f1408ff9700 1 --2- 172.21.15.71:0/3603197093 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f13f0066f30 0x7f13f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:47.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.651+0000 7f1408ff9700 1 -- 172.21.15.71:0/3603197093 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f1404083f10 con 0x7f140c155c10 2023-10-09T07:57:47.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.651+0000 7f141099b700 1 --2- 172.21.15.71:0/3603197093 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f13f0066f30 0x7f13f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:47.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.652+0000 7f141099b700 1 --2- 172.21.15.71:0/3603197093 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f13f0066f30 0x7f13f00693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1400009860 tx=0x7f1400016000 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:47.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.654+0000 7f1408ff9700 1 -- 172.21.15.71:0/3603197093 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1404050f90 con 0x7f140c155c10 2023-10-09T07:57:47.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.843+0000 7f1412bff700 1 -- 172.21.15.71:0/3603197093 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f140c0ad2e0 con 0x7f13f0066f30 2023-10-09T07:57:47.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.853+0000 7f1408ff9700 1 -- 172.21.15.71:0/3603197093 <== mgr.8071 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289639 (secure 0 0 0) 0x7f140c0ad2e0 con 0x7f13f0066f30 2023-10-09T07:57:47.857 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:57:47.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.857+0000 7f1412bff700 1 -- 172.21.15.71:0/3603197093 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f13f0066f30 msgr2=0x7f13f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:47.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.857+0000 7f1412bff700 1 --2- 172.21.15.71:0/3603197093 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f13f0066f30 0x7f13f00693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1400009860 tx=0x7f1400016000 comp rx=0 tx=0).stop 2023-10-09T07:57:47.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.857+0000 7f1412bff700 1 -- 172.21.15.71:0/3603197093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f140c155c10 msgr2=0x7f140c147260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:47.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.857+0000 7f1412bff700 1 --2- 172.21.15.71:0/3603197093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f140c155c10 0x7f140c147260 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f140400cc10 tx=0x7f1404007c70 comp rx=0 tx=0).stop 2023-10-09T07:57:47.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.857+0000 7f1412bff700 1 -- 172.21.15.71:0/3603197093 shutdown_connections 2023-10-09T07:57:47.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.857+0000 7f1412bff700 1 --2- 172.21.15.71:0/3603197093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f140c155c10 0x7f140c147260 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:47.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.857+0000 7f1412bff700 1 --2- 172.21.15.71:0/3603197093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140c0ac230 0x7f140c06dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:47.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.857+0000 7f1412bff700 1 --2- 172.21.15.71:0/3603197093 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f13f0066f30 0x7f13f00693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:47.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.857+0000 7f1412bff700 1 --2- 172.21.15.71:0/3603197093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f140c0ac6a0 0x7f140c146d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:47.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.857+0000 7f1412bff700 1 -- 172.21.15.71:0/3603197093 >> 172.21.15.71:0/3603197093 conn(0x7f140c06a320 msgr2=0x7f140c0afd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:47.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.857+0000 7f1412bff700 1 -- 172.21.15.71:0/3603197093 shutdown_connections 2023-10-09T07:57:47.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:47.857+0000 7f1412bff700 1 -- 172.21.15.71:0/3603197093 wait complete. 2023-10-09T07:57:47.861 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T07:57:47.875 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-09T07:57:47.106559+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":483,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":309,"ondisk_log_size":309,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2477288,"kb_used_data":17064,"kb_used_omap":0,"kb_used_meta":2460160,"kb_avail":752497432,"statfs":{"total":773094113280,"available":770557370368,"internally_reserved":0,"allocated":17473536,"data_stored":9285924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2519203840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.415691"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.717854+0000","last_change":"2023-10-09T07:57:41.709955+0000","last_active":"2023-10-09T07:57:41.717854+0000","last_peered":"2023-10-09T07:57:41.717854+0000","last_clean":"2023-10-09T07:57:41.717854+0000","last_became_active":"2023-10-09T07:57:41.709619+0000","last_became_peered":"2023-10-09T07:57:41.709619+0000","last_unstale":"2023-10-09T07:57:41.717854+0000","last_undegraded":"2023-10-09T07:57:41.717854+0000","last_fullsized":"2023-10-09T07:57:41.717854+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:31:27.885208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.711447+0000","last_change":"2023-10-09T07:57:41.709646+0000","last_active":"2023-10-09T07:57:41.711447+0000","last_peered":"2023-10-09T07:57:41.711447+0000","last_clean":"2023-10-09T07:57:41.711447+0000","last_became_active":"2023-10-09T07:57:41.707403+0000","last_became_peered":"2023-10-09T07:57:41.707403+0000","last_unstale":"2023-10-09T07:57:41.711447+0000","last_undegraded":"2023-10-09T07:57:41.711447+0000","last_fullsized":"2023-10-09T07:57:41.711447+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:45:52.898945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.714518+0000","last_change":"2023-10-09T07:57:41.711022+0000","last_active":"2023-10-09T07:57:41.714518+0000","last_peered":"2023-10-09T07:57:41.714518+0000","last_clean":"2023-10-09T07:57:41.714518+0000","last_became_active":"2023-10-09T07:57:41.710757+0000","last_became_peered":"2023-10-09T07:57:41.710757+0000","last_unstale":"2023-10-09T07:57:41.714518+0000","last_undegraded":"2023-10-09T07:57:41.714518+0000","last_fullsized":"2023-10-09T07:57:41.714518+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:14.993912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.725286+0000","last_change":"2023-10-09T07:57:41.720928+0000","last_active":"2023-10-09T07:57:41.725286+0000","last_peered":"2023-10-09T07:57:41.725286+0000","last_clean":"2023-10-09T07:57:41.725286+0000","last_became_active":"2023-10-09T07:57:41.720641+0000","last_became_peered":"2023-10-09T07:57:41.720641+0000","last_unstale":"2023-10-09T07:57:41.725286+0000","last_undegraded":"2023-10-09T07:57:41.725286+0000","last_fullsized":"2023-10-09T07:57:41.725286+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:35:10.760013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.716270+0000","last_change":"2023-10-09T07:57:41.712457+0000","last_active":"2023-10-09T07:57:41.716270+0000","last_peered":"2023-10-09T07:57:41.716270+0000","last_clean":"2023-10-09T07:57:41.716270+0000","last_became_active":"2023-10-09T07:57:41.712025+0000","last_became_peered":"2023-10-09T07:57:41.712025+0000","last_unstale":"2023-10-09T07:57:41.716270+0000","last_undegraded":"2023-10-09T07:57:41.716270+0000","last_fullsized":"2023-10-09T07:57:41.716270+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:57:09.984331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.714557+0000","last_change":"2023-10-09T07:57:41.708841+0000","last_active":"2023-10-09T07:57:41.714557+0000","last_peered":"2023-10-09T07:57:41.714557+0000","last_clean":"2023-10-09T07:57:41.714557+0000","last_became_active":"2023-10-09T07:57:41.708225+0000","last_became_peered":"2023-10-09T07:57:41.708225+0000","last_unstale":"2023-10-09T07:57:41.714557+0000","last_undegraded":"2023-10-09T07:57:41.714557+0000","last_fullsized":"2023-10-09T07:57:41.714557+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:45:52.898945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.718904+0000","last_change":"2023-10-09T07:57:41.716061+0000","last_active":"2023-10-09T07:57:41.718904+0000","last_peered":"2023-10-09T07:57:41.718904+0000","last_clean":"2023-10-09T07:57:41.718904+0000","last_became_active":"2023-10-09T07:57:41.715786+0000","last_became_peered":"2023-10-09T07:57:41.715786+0000","last_unstale":"2023-10-09T07:57:41.718904+0000","last_undegraded":"2023-10-09T07:57:41.718904+0000","last_fullsized":"2023-10-09T07:57:41.718904+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:03:31.621686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.721688+0000","last_change":"2023-10-09T07:57:41.720171+0000","last_active":"2023-10-09T07:57:41.721688+0000","last_peered":"2023-10-09T07:57:41.721688+0000","last_clean":"2023-10-09T07:57:41.721688+0000","last_became_active":"2023-10-09T07:57:41.719916+0000","last_became_peered":"2023-10-09T07:57:41.719916+0000","last_unstale":"2023-10-09T07:57:41.721688+0000","last_undegraded":"2023-10-09T07:57:41.721688+0000","last_fullsized":"2023-10-09T07:57:41.721688+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:08:09.958564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.715226+0000","last_change":"2023-10-09T07:57:41.712418+0000","last_active":"2023-10-09T07:57:41.715226+0000","last_peered":"2023-10-09T07:57:41.715226+0000","last_clean":"2023-10-09T07:57:41.715226+0000","last_became_active":"2023-10-09T07:57:41.712132+0000","last_became_peered":"2023-10-09T07:57:41.712132+0000","last_unstale":"2023-10-09T07:57:41.715226+0000","last_undegraded":"2023-10-09T07:57:41.715226+0000","last_fullsized":"2023-10-09T07:57:41.715226+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:04:15.160860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.711429+0000","last_change":"2023-10-09T07:57:41.709454+0000","last_active":"2023-10-09T07:57:41.711429+0000","last_peered":"2023-10-09T07:57:41.711429+0000","last_clean":"2023-10-09T07:57:41.711429+0000","last_became_active":"2023-10-09T07:57:41.707048+0000","last_became_peered":"2023-10-09T07:57:41.707048+0000","last_unstale":"2023-10-09T07:57:41.711429+0000","last_undegraded":"2023-10-09T07:57:41.711429+0000","last_fullsized":"2023-10-09T07:57:41.711429+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:54.925226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.705230+0000","last_change":"2023-10-09T07:57:41.704409+0000","last_active":"2023-10-09T07:57:41.705230+0000","last_peered":"2023-10-09T07:57:41.705230+0000","last_clean":"2023-10-09T07:57:41.705230+0000","last_became_active":"2023-10-09T07:57:41.704155+0000","last_became_peered":"2023-10-09T07:57:41.704155+0000","last_unstale":"2023-10-09T07:57:41.705230+0000","last_undegraded":"2023-10-09T07:57:41.705230+0000","last_fullsized":"2023-10-09T07:57:41.705230+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:34.109204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.714550+0000","last_change":"2023-10-09T07:57:41.710632+0000","last_active":"2023-10-09T07:57:41.714550+0000","last_peered":"2023-10-09T07:57:41.714550+0000","last_clean":"2023-10-09T07:57:41.714550+0000","last_became_active":"2023-10-09T07:57:41.710297+0000","last_became_peered":"2023-10-09T07:57:41.710297+0000","last_unstale":"2023-10-09T07:57:41.714550+0000","last_undegraded":"2023-10-09T07:57:41.714550+0000","last_fullsized":"2023-10-09T07:57:41.714550+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:37:41.304881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.709880+0000","last_change":"2023-10-09T07:57:41.706009+0000","last_active":"2023-10-09T07:57:41.709880+0000","last_peered":"2023-10-09T07:57:41.709880+0000","last_clean":"2023-10-09T07:57:41.709880+0000","last_became_active":"2023-10-09T07:57:41.705743+0000","last_became_peered":"2023-10-09T07:57:41.705743+0000","last_unstale":"2023-10-09T07:57:41.709880+0000","last_undegraded":"2023-10-09T07:57:41.709880+0000","last_fullsized":"2023-10-09T07:57:41.709880+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:51.895142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.707300+0000","last_change":"2023-10-09T07:57:41.705718+0000","last_active":"2023-10-09T07:57:41.707300+0000","last_peered":"2023-10-09T07:57:41.707300+0000","last_clean":"2023-10-09T07:57:41.707300+0000","last_became_active":"2023-10-09T07:57:41.705435+0000","last_became_peered":"2023-10-09T07:57:41.705435+0000","last_unstale":"2023-10-09T07:57:41.707300+0000","last_undegraded":"2023-10-09T07:57:41.707300+0000","last_fullsized":"2023-10-09T07:57:41.707300+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:31:29.093989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.723923+0000","last_change":"2023-10-09T07:57:41.714888+0000","last_active":"2023-10-09T07:57:41.723923+0000","last_peered":"2023-10-09T07:57:41.723923+0000","last_clean":"2023-10-09T07:57:41.723923+0000","last_became_active":"2023-10-09T07:57:41.712340+0000","last_became_peered":"2023-10-09T07:57:41.712340+0000","last_unstale":"2023-10-09T07:57:41.723923+0000","last_undegraded":"2023-10-09T07:57:41.723923+0000","last_fullsized":"2023-10-09T07:57:41.723923+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:35:04.276802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.726276+0000","last_change":"2023-10-09T07:57:41.725182+0000","last_active":"2023-10-09T07:57:41.726276+0000","last_peered":"2023-10-09T07:57:41.726276+0000","last_clean":"2023-10-09T07:57:41.726276+0000","last_became_active":"2023-10-09T07:57:41.724923+0000","last_became_peered":"2023-10-09T07:57:41.724923+0000","last_unstale":"2023-10-09T07:57:41.726276+0000","last_undegraded":"2023-10-09T07:57:41.726276+0000","last_fullsized":"2023-10-09T07:57:41.726276+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:56.824398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.704884+0000","last_change":"2023-10-09T07:57:41.703321+0000","last_active":"2023-10-09T07:57:41.704884+0000","last_peered":"2023-10-09T07:57:41.704884+0000","last_clean":"2023-10-09T07:57:41.704884+0000","last_became_active":"2023-10-09T07:57:41.701963+0000","last_became_peered":"2023-10-09T07:57:41.701963+0000","last_unstale":"2023-10-09T07:57:41.704884+0000","last_undegraded":"2023-10-09T07:57:41.704884+0000","last_fullsized":"2023-10-09T07:57:41.704884+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:31.293225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.724211+0000","last_change":"2023-10-09T07:57:41.722257+0000","last_active":"2023-10-09T07:57:41.724211+0000","last_peered":"2023-10-09T07:57:41.724211+0000","last_clean":"2023-10-09T07:57:41.724211+0000","last_became_active":"2023-10-09T07:57:41.721999+0000","last_became_peered":"2023-10-09T07:57:41.721999+0000","last_unstale":"2023-10-09T07:57:41.724211+0000","last_undegraded":"2023-10-09T07:57:41.724211+0000","last_fullsized":"2023-10-09T07:57:41.724211+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:04:15.160860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.708262+0000","last_change":"2023-10-09T07:57:41.705106+0000","last_active":"2023-10-09T07:57:41.708262+0000","last_peered":"2023-10-09T07:57:41.708262+0000","last_clean":"2023-10-09T07:57:41.708262+0000","last_became_active":"2023-10-09T07:57:41.704766+0000","last_became_peered":"2023-10-09T07:57:41.704766+0000","last_unstale":"2023-10-09T07:57:41.708262+0000","last_undegraded":"2023-10-09T07:57:41.708262+0000","last_fullsized":"2023-10-09T07:57:41.708262+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:16.242855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.721978+0000","last_change":"2023-10-09T07:57:41.718833+0000","last_active":"2023-10-09T07:57:41.721978+0000","last_peered":"2023-10-09T07:57:41.721978+0000","last_clean":"2023-10-09T07:57:41.721978+0000","last_became_active":"2023-10-09T07:57:41.718121+0000","last_became_peered":"2023-10-09T07:57:41.718121+0000","last_unstale":"2023-10-09T07:57:41.721978+0000","last_undegraded":"2023-10-09T07:57:41.721978+0000","last_fullsized":"2023-10-09T07:57:41.721978+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:34.255144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.716294+0000","last_change":"2023-10-09T07:57:41.713317+0000","last_active":"2023-10-09T07:57:41.716294+0000","last_peered":"2023-10-09T07:57:41.716294+0000","last_clean":"2023-10-09T07:57:41.716294+0000","last_became_active":"2023-10-09T07:57:41.712923+0000","last_became_peered":"2023-10-09T07:57:41.712923+0000","last_unstale":"2023-10-09T07:57:41.716294+0000","last_undegraded":"2023-10-09T07:57:41.716294+0000","last_fullsized":"2023-10-09T07:57:41.716294+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:36:51.629750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.710306+0000","last_change":"2023-10-09T07:57:41.708926+0000","last_active":"2023-10-09T07:57:41.710306+0000","last_peered":"2023-10-09T07:57:41.710306+0000","last_clean":"2023-10-09T07:57:41.710306+0000","last_became_active":"2023-10-09T07:57:41.708647+0000","last_became_peered":"2023-10-09T07:57:41.708647+0000","last_unstale":"2023-10-09T07:57:41.710306+0000","last_undegraded":"2023-10-09T07:57:41.710306+0000","last_fullsized":"2023-10-09T07:57:41.710306+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:02.361772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.714660+0000","last_change":"2023-10-09T07:57:41.709854+0000","last_active":"2023-10-09T07:57:41.714660+0000","last_peered":"2023-10-09T07:57:41.714660+0000","last_clean":"2023-10-09T07:57:41.714660+0000","last_became_active":"2023-10-09T07:57:41.709580+0000","last_became_peered":"2023-10-09T07:57:41.709580+0000","last_unstale":"2023-10-09T07:57:41.714660+0000","last_undegraded":"2023-10-09T07:57:41.714660+0000","last_fullsized":"2023-10-09T07:57:41.714660+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:40.405926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.703711+0000","last_change":"2023-10-09T07:57:41.701332+0000","last_active":"2023-10-09T07:57:41.703711+0000","last_peered":"2023-10-09T07:57:41.703711+0000","last_clean":"2023-10-09T07:57:41.703711+0000","last_became_active":"2023-10-09T07:57:41.701055+0000","last_became_peered":"2023-10-09T07:57:41.701055+0000","last_unstale":"2023-10-09T07:57:41.703711+0000","last_undegraded":"2023-10-09T07:57:41.703711+0000","last_fullsized":"2023-10-09T07:57:41.703711+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:33.150152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.711924+0000","last_change":"2023-10-09T07:57:41.710325+0000","last_active":"2023-10-09T07:57:41.711924+0000","last_peered":"2023-10-09T07:57:41.711924+0000","last_clean":"2023-10-09T07:57:41.711924+0000","last_became_active":"2023-10-09T07:57:41.710034+0000","last_became_peered":"2023-10-09T07:57:41.710034+0000","last_unstale":"2023-10-09T07:57:41.711924+0000","last_undegraded":"2023-10-09T07:57:41.711924+0000","last_fullsized":"2023-10-09T07:57:41.711924+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:03:31.621686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.732229+0000","last_change":"2023-10-09T07:57:41.730658+0000","last_active":"2023-10-09T07:57:41.732229+0000","last_peered":"2023-10-09T07:57:41.732229+0000","last_clean":"2023-10-09T07:57:41.732229+0000","last_became_active":"2023-10-09T07:57:41.730407+0000","last_became_peered":"2023-10-09T07:57:41.730407+0000","last_unstale":"2023-10-09T07:57:41.732229+0000","last_undegraded":"2023-10-09T07:57:41.732229+0000","last_fullsized":"2023-10-09T07:57:41.732229+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:14.993912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.709916+0000","last_change":"2023-10-09T07:57:41.705282+0000","last_active":"2023-10-09T07:57:41.709916+0000","last_peered":"2023-10-09T07:57:41.709916+0000","last_clean":"2023-10-09T07:57:41.709916+0000","last_became_active":"2023-10-09T07:57:41.704997+0000","last_became_peered":"2023-10-09T07:57:41.704997+0000","last_unstale":"2023-10-09T07:57:41.709916+0000","last_undegraded":"2023-10-09T07:57:41.709916+0000","last_fullsized":"2023-10-09T07:57:41.709916+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:27.117499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.717627+0000","last_change":"2023-10-09T07:57:41.715809+0000","last_active":"2023-10-09T07:57:41.717627+0000","last_peered":"2023-10-09T07:57:41.717627+0000","last_clean":"2023-10-09T07:57:41.717627+0000","last_became_active":"2023-10-09T07:57:41.715543+0000","last_became_peered":"2023-10-09T07:57:41.715543+0000","last_unstale":"2023-10-09T07:57:41.717627+0000","last_undegraded":"2023-10-09T07:57:41.717627+0000","last_fullsized":"2023-10-09T07:57:41.717627+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:41:01.313910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.723953+0000","last_change":"2023-10-09T07:57:41.716182+0000","last_active":"2023-10-09T07:57:41.723953+0000","last_peered":"2023-10-09T07:57:41.723953+0000","last_clean":"2023-10-09T07:57:41.723953+0000","last_became_active":"2023-10-09T07:57:41.715924+0000","last_became_peered":"2023-10-09T07:57:41.715924+0000","last_unstale":"2023-10-09T07:57:41.723953+0000","last_undegraded":"2023-10-09T07:57:41.723953+0000","last_fullsized":"2023-10-09T07:57:41.723953+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:03:21.703878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.723894+0000","last_change":"2023-10-09T07:57:41.715422+0000","last_active":"2023-10-09T07:57:41.723894+0000","last_peered":"2023-10-09T07:57:41.723894+0000","last_clean":"2023-10-09T07:57:41.723894+0000","last_became_active":"2023-10-09T07:57:41.715162+0000","last_became_peered":"2023-10-09T07:57:41.715162+0000","last_unstale":"2023-10-09T07:57:41.723894+0000","last_undegraded":"2023-10-09T07:57:41.723894+0000","last_fullsized":"2023-10-09T07:57:41.723894+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:25:46.680708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.732003+0000","last_change":"2023-10-09T07:57:41.729873+0000","last_active":"2023-10-09T07:57:41.732003+0000","last_peered":"2023-10-09T07:57:41.732003+0000","last_clean":"2023-10-09T07:57:41.732003+0000","last_became_active":"2023-10-09T07:57:41.729316+0000","last_became_peered":"2023-10-09T07:57:41.729316+0000","last_unstale":"2023-10-09T07:57:41.732003+0000","last_undegraded":"2023-10-09T07:57:41.732003+0000","last_fullsized":"2023-10-09T07:57:41.732003+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:28:41.640243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.718941+0000","last_change":"2023-10-09T07:57:41.716851+0000","last_active":"2023-10-09T07:57:41.718941+0000","last_peered":"2023-10-09T07:57:41.718941+0000","last_clean":"2023-10-09T07:57:41.718941+0000","last_became_active":"2023-10-09T07:57:41.716572+0000","last_became_peered":"2023-10-09T07:57:41.716572+0000","last_unstale":"2023-10-09T07:57:41.718941+0000","last_undegraded":"2023-10-09T07:57:41.718941+0000","last_fullsized":"2023-10-09T07:57:41.718941+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:07:01.487748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.718752+0000","last_change":"2023-10-09T07:57:41.714598+0000","last_active":"2023-10-09T07:57:41.718752+0000","last_peered":"2023-10-09T07:57:41.718752+0000","last_clean":"2023-10-09T07:57:41.718752+0000","last_became_active":"2023-10-09T07:57:41.714352+0000","last_became_peered":"2023-10-09T07:57:41.714352+0000","last_unstale":"2023-10-09T07:57:41.718752+0000","last_undegraded":"2023-10-09T07:57:41.718752+0000","last_fullsized":"2023-10-09T07:57:41.718752+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:20.867454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"162'4","reported_seq":14,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.731690+0000","last_change":"2023-10-09T07:57:40.714069+0000","last_active":"2023-10-09T07:57:41.731690+0000","last_peered":"2023-10-09T07:57:41.731690+0000","last_clean":"2023-10-09T07:57:41.731690+0000","last_became_active":"2023-10-09T07:57:40.713756+0000","last_became_peered":"2023-10-09T07:57:40.713756+0000","last_unstale":"2023-10-09T07:57:41.731690+0000","last_undegraded":"2023-10-09T07:57:41.731690+0000","last_fullsized":"2023-10-09T07:57:41.731690+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:19.857223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.715206+0000","last_change":"2023-10-09T07:57:41.712269+0000","last_active":"2023-10-09T07:57:41.715206+0000","last_peered":"2023-10-09T07:57:41.715206+0000","last_clean":"2023-10-09T07:57:41.715206+0000","last_became_active":"2023-10-09T07:57:41.711874+0000","last_became_peered":"2023-10-09T07:57:41.711874+0000","last_unstale":"2023-10-09T07:57:41.715206+0000","last_undegraded":"2023-10-09T07:57:41.715206+0000","last_fullsized":"2023-10-09T07:57:41.715206+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:34.255144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"162'1","reported_seq":11,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.729746+0000","last_change":"2023-10-09T07:57:40.708745+0000","last_active":"2023-10-09T07:57:41.729746+0000","last_peered":"2023-10-09T07:57:41.729746+0000","last_clean":"2023-10-09T07:57:41.729746+0000","last_became_active":"2023-10-09T07:57:40.708462+0000","last_became_peered":"2023-10-09T07:57:40.708462+0000","last_unstale":"2023-10-09T07:57:41.729746+0000","last_undegraded":"2023-10-09T07:57:41.729746+0000","last_fullsized":"2023-10-09T07:57:41.729746+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:20:20.409728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.713950+0000","last_change":"2023-10-09T07:57:41.707057+0000","last_active":"2023-10-09T07:57:41.713950+0000","last_peered":"2023-10-09T07:57:41.713950+0000","last_clean":"2023-10-09T07:57:41.713950+0000","last_became_active":"2023-10-09T07:57:41.706500+0000","last_became_peered":"2023-10-09T07:57:41.706500+0000","last_unstale":"2023-10-09T07:57:41.713950+0000","last_undegraded":"2023-10-09T07:57:41.713950+0000","last_fullsized":"2023-10-09T07:57:41.713950+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:10:46.275278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.725489+0000","last_change":"2023-10-09T07:57:40.702915+0000","last_active":"2023-10-09T07:57:41.725489+0000","last_peered":"2023-10-09T07:57:41.725489+0000","last_clean":"2023-10-09T07:57:41.725489+0000","last_became_active":"2023-10-09T07:57:40.702648+0000","last_became_peered":"2023-10-09T07:57:40.702648+0000","last_unstale":"2023-10-09T07:57:41.725489+0000","last_undegraded":"2023-10-09T07:57:41.725489+0000","last_fullsized":"2023-10-09T07:57:41.725489+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:38:00.181866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.714028+0000","last_change":"2023-10-09T07:57:41.711016+0000","last_active":"2023-10-09T07:57:41.714028+0000","last_peered":"2023-10-09T07:57:41.714028+0000","last_clean":"2023-10-09T07:57:41.714028+0000","last_became_active":"2023-10-09T07:57:41.710691+0000","last_became_peered":"2023-10-09T07:57:41.710691+0000","last_unstale":"2023-10-09T07:57:41.714028+0000","last_undegraded":"2023-10-09T07:57:41.714028+0000","last_fullsized":"2023-10-09T07:57:41.714028+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:00:42.357072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.728527+0000","last_change":"2023-10-09T07:57:40.705265+0000","last_active":"2023-10-09T07:57:41.728527+0000","last_peered":"2023-10-09T07:57:41.728527+0000","last_clean":"2023-10-09T07:57:41.728527+0000","last_became_active":"2023-10-09T07:57:40.705011+0000","last_became_peered":"2023-10-09T07:57:40.705011+0000","last_unstale":"2023-10-09T07:57:41.728527+0000","last_undegraded":"2023-10-09T07:57:41.728527+0000","last_fullsized":"2023-10-09T07:57:41.728527+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:13.582684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.718830+0000","last_change":"2023-10-09T07:57:41.713825+0000","last_active":"2023-10-09T07:57:41.718830+0000","last_peered":"2023-10-09T07:57:41.718830+0000","last_clean":"2023-10-09T07:57:41.718830+0000","last_became_active":"2023-10-09T07:57:41.713562+0000","last_became_peered":"2023-10-09T07:57:41.713562+0000","last_unstale":"2023-10-09T07:57:41.718830+0000","last_undegraded":"2023-10-09T07:57:41.718830+0000","last_fullsized":"2023-10-09T07:57:41.718830+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:40.405926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"162'1","reported_seq":11,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.730492+0000","last_change":"2023-10-09T07:57:40.702506+0000","last_active":"2023-10-09T07:57:41.730492+0000","last_peered":"2023-10-09T07:57:41.730492+0000","last_clean":"2023-10-09T07:57:41.730492+0000","last_became_active":"2023-10-09T07:57:40.702250+0000","last_became_peered":"2023-10-09T07:57:40.702250+0000","last_unstale":"2023-10-09T07:57:41.730492+0000","last_undegraded":"2023-10-09T07:57:41.730492+0000","last_fullsized":"2023-10-09T07:57:41.730492+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:48.793176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.706860+0000","last_change":"2023-10-09T07:57:41.703926+0000","last_active":"2023-10-09T07:57:41.706860+0000","last_peered":"2023-10-09T07:57:41.706860+0000","last_clean":"2023-10-09T07:57:41.706860+0000","last_became_active":"2023-10-09T07:57:41.703649+0000","last_became_peered":"2023-10-09T07:57:41.703649+0000","last_unstale":"2023-10-09T07:57:41.706860+0000","last_undegraded":"2023-10-09T07:57:41.706860+0000","last_fullsized":"2023-10-09T07:57:41.706860+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:31:29.093989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"162'1","reported_seq":11,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.730466+0000","last_change":"2023-10-09T07:57:40.699052+0000","last_active":"2023-10-09T07:57:41.730466+0000","last_peered":"2023-10-09T07:57:41.730466+0000","last_clean":"2023-10-09T07:57:41.730466+0000","last_became_active":"2023-10-09T07:57:40.698810+0000","last_became_peered":"2023-10-09T07:57:40.698810+0000","last_unstale":"2023-10-09T07:57:41.730466+0000","last_undegraded":"2023-10-09T07:57:41.730466+0000","last_fullsized":"2023-10-09T07:57:41.730466+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:42.240311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.721705+0000","last_change":"2023-10-09T07:57:41.720326+0000","last_active":"2023-10-09T07:57:41.721705+0000","last_peered":"2023-10-09T07:57:41.721705+0000","last_clean":"2023-10-09T07:57:41.721705+0000","last_became_active":"2023-10-09T07:57:41.720047+0000","last_became_peered":"2023-10-09T07:57:41.720047+0000","last_unstale":"2023-10-09T07:57:41.721705+0000","last_undegraded":"2023-10-09T07:57:41.721705+0000","last_fullsized":"2023-10-09T07:57:41.721705+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:56.824398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.695456+0000","last_change":"2023-10-09T07:57:40.705766+0000","last_active":"2023-10-09T07:57:41.695456+0000","last_peered":"2023-10-09T07:57:41.695456+0000","last_clean":"2023-10-09T07:57:41.695456+0000","last_became_active":"2023-10-09T07:57:40.705410+0000","last_became_peered":"2023-10-09T07:57:40.705410+0000","last_unstale":"2023-10-09T07:57:41.695456+0000","last_undegraded":"2023-10-09T07:57:41.695456+0000","last_fullsized":"2023-10-09T07:57:41.695456+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:12:06.525751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.722615+0000","last_change":"2023-10-09T07:57:41.720905+0000","last_active":"2023-10-09T07:57:41.722615+0000","last_peered":"2023-10-09T07:57:41.722615+0000","last_clean":"2023-10-09T07:57:41.722615+0000","last_became_active":"2023-10-09T07:57:41.720653+0000","last_became_peered":"2023-10-09T07:57:41.720653+0000","last_unstale":"2023-10-09T07:57:41.722615+0000","last_undegraded":"2023-10-09T07:57:41.722615+0000","last_fullsized":"2023-10-09T07:57:41.722615+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:20:21.419959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.699560+0000","last_change":"2023-10-09T07:57:40.709867+0000","last_active":"2023-10-09T07:57:41.699560+0000","last_peered":"2023-10-09T07:57:41.699560+0000","last_clean":"2023-10-09T07:57:41.699560+0000","last_became_active":"2023-10-09T07:57:40.709372+0000","last_became_peered":"2023-10-09T07:57:40.709372+0000","last_unstale":"2023-10-09T07:57:41.699560+0000","last_undegraded":"2023-10-09T07:57:41.699560+0000","last_fullsized":"2023-10-09T07:57:41.699560+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:38:54.719335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.725099+0000","last_change":"2023-10-09T07:57:41.719951+0000","last_active":"2023-10-09T07:57:41.725099+0000","last_peered":"2023-10-09T07:57:41.725099+0000","last_clean":"2023-10-09T07:57:41.725099+0000","last_became_active":"2023-10-09T07:57:41.719693+0000","last_became_peered":"2023-10-09T07:57:41.719693+0000","last_unstale":"2023-10-09T07:57:41.725099+0000","last_undegraded":"2023-10-09T07:57:41.725099+0000","last_fullsized":"2023-10-09T07:57:41.725099+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:22:57.702842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.696240+0000","last_change":"2023-10-09T07:57:40.703087+0000","last_active":"2023-10-09T07:57:41.696240+0000","last_peered":"2023-10-09T07:57:41.696240+0000","last_clean":"2023-10-09T07:57:41.696240+0000","last_became_active":"2023-10-09T07:57:40.702790+0000","last_became_peered":"2023-10-09T07:57:40.702790+0000","last_unstale":"2023-10-09T07:57:41.696240+0000","last_undegraded":"2023-10-09T07:57:41.696240+0000","last_fullsized":"2023-10-09T07:57:41.696240+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:10:05.981950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.718812+0000","last_change":"2023-10-09T07:57:41.716804+0000","last_active":"2023-10-09T07:57:41.718812+0000","last_peered":"2023-10-09T07:57:41.718812+0000","last_clean":"2023-10-09T07:57:41.718812+0000","last_became_active":"2023-10-09T07:57:41.716395+0000","last_became_peered":"2023-10-09T07:57:41.716395+0000","last_unstale":"2023-10-09T07:57:41.718812+0000","last_undegraded":"2023-10-09T07:57:41.718812+0000","last_fullsized":"2023-10-09T07:57:41.718812+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:43.250542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.710875+0000","last_change":"2023-10-09T07:57:40.709018+0000","last_active":"2023-10-09T07:57:41.710875+0000","last_peered":"2023-10-09T07:57:41.710875+0000","last_clean":"2023-10-09T07:57:41.710875+0000","last_became_active":"2023-10-09T07:57:40.708730+0000","last_became_peered":"2023-10-09T07:57:40.708730+0000","last_unstale":"2023-10-09T07:57:41.710875+0000","last_undegraded":"2023-10-09T07:57:41.710875+0000","last_fullsized":"2023-10-09T07:57:41.710875+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:26:00.505124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.720888+0000","last_change":"2023-10-09T07:57:41.720372+0000","last_active":"2023-10-09T07:57:41.720888+0000","last_peered":"2023-10-09T07:57:41.720888+0000","last_clean":"2023-10-09T07:57:41.720888+0000","last_became_active":"2023-10-09T07:57:41.719647+0000","last_became_peered":"2023-10-09T07:57:41.719647+0000","last_unstale":"2023-10-09T07:57:41.720888+0000","last_undegraded":"2023-10-09T07:57:41.720888+0000","last_fullsized":"2023-10-09T07:57:41.720888+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:30:00.712668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"162'3","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.732374+0000","last_change":"2023-10-09T07:57:40.705048+0000","last_active":"2023-10-09T07:57:41.732374+0000","last_peered":"2023-10-09T07:57:41.732374+0000","last_clean":"2023-10-09T07:57:41.732374+0000","last_became_active":"2023-10-09T07:57:40.704768+0000","last_became_peered":"2023-10-09T07:57:40.704768+0000","last_unstale":"2023-10-09T07:57:41.732374+0000","last_undegraded":"2023-10-09T07:57:41.732374+0000","last_fullsized":"2023-10-09T07:57:41.732374+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:24:26.536775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.716294+0000","last_change":"2023-10-09T07:57:41.712384+0000","last_active":"2023-10-09T07:57:41.716294+0000","last_peered":"2023-10-09T07:57:41.716294+0000","last_clean":"2023-10-09T07:57:41.716294+0000","last_became_active":"2023-10-09T07:57:41.711982+0000","last_became_peered":"2023-10-09T07:57:41.711982+0000","last_unstale":"2023-10-09T07:57:41.716294+0000","last_undegraded":"2023-10-09T07:57:41.716294+0000","last_fullsized":"2023-10-09T07:57:41.716294+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:26.135612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"162'6","reported_seq":16,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.733307+0000","last_change":"2023-10-09T07:57:40.710455+0000","last_active":"2023-10-09T07:57:41.733307+0000","last_peered":"2023-10-09T07:57:41.733307+0000","last_clean":"2023-10-09T07:57:41.733307+0000","last_became_active":"2023-10-09T07:57:40.710109+0000","last_became_peered":"2023-10-09T07:57:40.710109+0000","last_unstale":"2023-10-09T07:57:41.733307+0000","last_undegraded":"2023-10-09T07:57:41.733307+0000","last_fullsized":"2023-10-09T07:57:41.733307+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:55:27.158449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.725434+0000","last_change":"2023-10-09T07:57:41.723182+0000","last_active":"2023-10-09T07:57:41.725434+0000","last_peered":"2023-10-09T07:57:41.725434+0000","last_clean":"2023-10-09T07:57:41.725434+0000","last_became_active":"2023-10-09T07:57:41.722923+0000","last_became_peered":"2023-10-09T07:57:41.722923+0000","last_unstale":"2023-10-09T07:57:41.725434+0000","last_undegraded":"2023-10-09T07:57:41.725434+0000","last_fullsized":"2023-10-09T07:57:41.725434+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:14.840671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.700480+0000","last_change":"2023-10-09T07:57:40.703377+0000","last_active":"2023-10-09T07:57:41.700480+0000","last_peered":"2023-10-09T07:57:41.700480+0000","last_clean":"2023-10-09T07:57:41.700480+0000","last_became_active":"2023-10-09T07:57:40.703117+0000","last_became_peered":"2023-10-09T07:57:40.703117+0000","last_unstale":"2023-10-09T07:57:41.700480+0000","last_undegraded":"2023-10-09T07:57:41.700480+0000","last_fullsized":"2023-10-09T07:57:41.700480+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:02:40.132873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.714819+0000","last_change":"2023-10-09T07:57:41.713189+0000","last_active":"2023-10-09T07:57:41.714819+0000","last_peered":"2023-10-09T07:57:41.714819+0000","last_clean":"2023-10-09T07:57:41.714819+0000","last_became_active":"2023-10-09T07:57:41.712930+0000","last_became_peered":"2023-10-09T07:57:41.712930+0000","last_unstale":"2023-10-09T07:57:41.714819+0000","last_undegraded":"2023-10-09T07:57:41.714819+0000","last_fullsized":"2023-10-09T07:57:41.714819+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:24:27.547006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.699242+0000","last_change":"2023-10-09T07:57:40.712512+0000","last_active":"2023-10-09T07:57:41.699242+0000","last_peered":"2023-10-09T07:57:41.699242+0000","last_clean":"2023-10-09T07:57:41.699242+0000","last_became_active":"2023-10-09T07:57:40.712236+0000","last_became_peered":"2023-10-09T07:57:40.712236+0000","last_unstale":"2023-10-09T07:57:41.699242+0000","last_undegraded":"2023-10-09T07:57:41.699242+0000","last_fullsized":"2023-10-09T07:57:41.699242+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:40:16.530524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.715146+0000","last_change":"2023-10-09T07:57:41.711349+0000","last_active":"2023-10-09T07:57:41.715146+0000","last_peered":"2023-10-09T07:57:41.715146+0000","last_clean":"2023-10-09T07:57:41.715146+0000","last_became_active":"2023-10-09T07:57:41.711099+0000","last_became_peered":"2023-10-09T07:57:41.711099+0000","last_unstale":"2023-10-09T07:57:41.715146+0000","last_undegraded":"2023-10-09T07:57:41.715146+0000","last_fullsized":"2023-10-09T07:57:41.715146+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:20.867454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"162'8","reported_seq":18,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.732753+0000","last_change":"2023-10-09T07:57:40.706796+0000","last_active":"2023-10-09T07:57:41.732753+0000","last_peered":"2023-10-09T07:57:41.732753+0000","last_clean":"2023-10-09T07:57:41.732753+0000","last_became_active":"2023-10-09T07:57:40.706269+0000","last_became_peered":"2023-10-09T07:57:40.706269+0000","last_unstale":"2023-10-09T07:57:41.732753+0000","last_undegraded":"2023-10-09T07:57:41.732753+0000","last_fullsized":"2023-10-09T07:57:41.732753+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:26:00.505124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.714588+0000","last_change":"2023-10-09T07:57:41.711858+0000","last_active":"2023-10-09T07:57:41.714588+0000","last_peered":"2023-10-09T07:57:41.714588+0000","last_clean":"2023-10-09T07:57:41.714588+0000","last_became_active":"2023-10-09T07:57:41.711499+0000","last_became_peered":"2023-10-09T07:57:41.711499+0000","last_unstale":"2023-10-09T07:57:41.714588+0000","last_undegraded":"2023-10-09T07:57:41.714588+0000","last_fullsized":"2023-10-09T07:57:41.714588+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:57:29.926980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"162'1","reported_seq":11,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.728717+0000","last_change":"2023-10-09T07:57:40.710158+0000","last_active":"2023-10-09T07:57:41.728717+0000","last_peered":"2023-10-09T07:57:41.728717+0000","last_clean":"2023-10-09T07:57:41.728717+0000","last_became_active":"2023-10-09T07:57:40.709881+0000","last_became_peered":"2023-10-09T07:57:40.709881+0000","last_unstale":"2023-10-09T07:57:41.728717+0000","last_undegraded":"2023-10-09T07:57:41.728717+0000","last_fullsized":"2023-10-09T07:57:41.728717+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:33.964366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.705933+0000","last_change":"2023-10-09T07:57:41.705326+0000","last_active":"2023-10-09T07:57:41.705933+0000","last_peered":"2023-10-09T07:57:41.705933+0000","last_clean":"2023-10-09T07:57:41.705933+0000","last_became_active":"2023-10-09T07:57:41.705063+0000","last_became_peered":"2023-10-09T07:57:41.705063+0000","last_unstale":"2023-10-09T07:57:41.705933+0000","last_undegraded":"2023-10-09T07:57:41.705933+0000","last_fullsized":"2023-10-09T07:57:41.705933+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:53:55.693173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.723040+0000","last_change":"2023-10-09T07:57:40.708690+0000","last_active":"2023-10-09T07:57:41.723040+0000","last_peered":"2023-10-09T07:57:41.723040+0000","last_clean":"2023-10-09T07:57:41.723040+0000","last_became_active":"2023-10-09T07:57:40.708436+0000","last_became_peered":"2023-10-09T07:57:40.708436+0000","last_unstale":"2023-10-09T07:57:41.723040+0000","last_undegraded":"2023-10-09T07:57:41.723040+0000","last_fullsized":"2023-10-09T07:57:41.723040+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:13:40.202625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.722860+0000","last_change":"2023-10-09T07:57:41.720822+0000","last_active":"2023-10-09T07:57:41.722860+0000","last_peered":"2023-10-09T07:57:41.722860+0000","last_clean":"2023-10-09T07:57:41.722860+0000","last_became_active":"2023-10-09T07:57:41.720549+0000","last_became_peered":"2023-10-09T07:57:41.720549+0000","last_unstale":"2023-10-09T07:57:41.722860+0000","last_undegraded":"2023-10-09T07:57:41.722860+0000","last_fullsized":"2023-10-09T07:57:41.722860+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:57:29.926980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"162'1","reported_seq":11,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.732428+0000","last_change":"2023-10-09T07:57:40.703767+0000","last_active":"2023-10-09T07:57:41.732428+0000","last_peered":"2023-10-09T07:57:41.732428+0000","last_clean":"2023-10-09T07:57:41.732428+0000","last_became_active":"2023-10-09T07:57:40.703456+0000","last_became_peered":"2023-10-09T07:57:40.703456+0000","last_unstale":"2023-10-09T07:57:41.732428+0000","last_undegraded":"2023-10-09T07:57:41.732428+0000","last_fullsized":"2023-10-09T07:57:41.732428+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:56:49.351995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.724918+0000","last_change":"2023-10-09T07:57:41.721465+0000","last_active":"2023-10-09T07:57:41.724918+0000","last_peered":"2023-10-09T07:57:41.724918+0000","last_clean":"2023-10-09T07:57:41.724918+0000","last_became_active":"2023-10-09T07:57:41.721219+0000","last_became_peered":"2023-10-09T07:57:41.721219+0000","last_unstale":"2023-10-09T07:57:41.724918+0000","last_undegraded":"2023-10-09T07:57:41.724918+0000","last_fullsized":"2023-10-09T07:57:41.724918+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:31.293225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.695703+0000","last_change":"2023-10-09T07:57:40.706429+0000","last_active":"2023-10-09T07:57:41.695703+0000","last_peered":"2023-10-09T07:57:41.695703+0000","last_clean":"2023-10-09T07:57:41.695703+0000","last_became_active":"2023-10-09T07:57:40.706190+0000","last_became_peered":"2023-10-09T07:57:40.706190+0000","last_unstale":"2023-10-09T07:57:41.695703+0000","last_undegraded":"2023-10-09T07:57:41.695703+0000","last_fullsized":"2023-10-09T07:57:41.695703+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:03:30.611455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.710062+0000","last_change":"2023-10-09T07:57:41.706326+0000","last_active":"2023-10-09T07:57:41.710062+0000","last_peered":"2023-10-09T07:57:41.710062+0000","last_clean":"2023-10-09T07:57:41.710062+0000","last_became_active":"2023-10-09T07:57:41.705955+0000","last_became_peered":"2023-10-09T07:57:41.705955+0000","last_unstale":"2023-10-09T07:57:41.710062+0000","last_undegraded":"2023-10-09T07:57:41.710062+0000","last_fullsized":"2023-10-09T07:57:41.710062+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:03:01.850852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.731576+0000","last_change":"2023-10-09T07:57:40.703372+0000","last_active":"2023-10-09T07:57:41.731576+0000","last_peered":"2023-10-09T07:57:41.731576+0000","last_clean":"2023-10-09T07:57:41.731576+0000","last_became_active":"2023-10-09T07:57:40.702699+0000","last_became_peered":"2023-10-09T07:57:40.702699+0000","last_unstale":"2023-10-09T07:57:41.731576+0000","last_undegraded":"2023-10-09T07:57:41.731576+0000","last_fullsized":"2023-10-09T07:57:41.731576+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:17:23.252488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.717692+0000","last_change":"2023-10-09T07:57:41.715402+0000","last_active":"2023-10-09T07:57:41.717692+0000","last_peered":"2023-10-09T07:57:41.717692+0000","last_clean":"2023-10-09T07:57:41.717692+0000","last_became_active":"2023-10-09T07:57:41.715141+0000","last_became_peered":"2023-10-09T07:57:41.715141+0000","last_unstale":"2023-10-09T07:57:41.717692+0000","last_undegraded":"2023-10-09T07:57:41.717692+0000","last_fullsized":"2023-10-09T07:57:41.717692+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:20:21.419959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.704271+0000","last_change":"2023-10-09T07:57:40.702948+0000","last_active":"2023-10-09T07:57:41.704271+0000","last_peered":"2023-10-09T07:57:41.704271+0000","last_clean":"2023-10-09T07:57:41.704271+0000","last_became_active":"2023-10-09T07:57:40.702709+0000","last_became_peered":"2023-10-09T07:57:40.702709+0000","last_unstale":"2023-10-09T07:57:41.704271+0000","last_undegraded":"2023-10-09T07:57:41.704271+0000","last_fullsized":"2023-10-09T07:57:41.704271+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:55:27.158449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.716324+0000","last_change":"2023-10-09T07:57:41.713694+0000","last_active":"2023-10-09T07:57:41.716324+0000","last_peered":"2023-10-09T07:57:41.716324+0000","last_clean":"2023-10-09T07:57:41.716324+0000","last_became_active":"2023-10-09T07:57:41.713360+0000","last_became_peered":"2023-10-09T07:57:41.713360+0000","last_unstale":"2023-10-09T07:57:41.716324+0000","last_undegraded":"2023-10-09T07:57:41.716324+0000","last_fullsized":"2023-10-09T07:57:41.716324+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:07:01.487748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.702743+0000","last_change":"2023-10-09T07:57:40.701038+0000","last_active":"2023-10-09T07:57:41.702743+0000","last_peered":"2023-10-09T07:57:41.702743+0000","last_clean":"2023-10-09T07:57:41.702743+0000","last_became_active":"2023-10-09T07:57:40.700766+0000","last_became_peered":"2023-10-09T07:57:40.700766+0000","last_unstale":"2023-10-09T07:57:41.702743+0000","last_undegraded":"2023-10-09T07:57:41.702743+0000","last_fullsized":"2023-10-09T07:57:41.702743+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:04.363976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.731980+0000","last_change":"2023-10-09T07:57:41.729500+0000","last_active":"2023-10-09T07:57:41.731980+0000","last_peered":"2023-10-09T07:57:41.731980+0000","last_clean":"2023-10-09T07:57:41.731980+0000","last_became_active":"2023-10-09T07:57:41.729182+0000","last_became_peered":"2023-10-09T07:57:41.729182+0000","last_unstale":"2023-10-09T07:57:41.731980+0000","last_undegraded":"2023-10-09T07:57:41.731980+0000","last_fullsized":"2023-10-09T07:57:41.731980+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:34:42.877540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.694520+0000","last_change":"2023-10-09T07:57:40.706333+0000","last_active":"2023-10-09T07:57:41.694520+0000","last_peered":"2023-10-09T07:57:41.694520+0000","last_clean":"2023-10-09T07:57:41.694520+0000","last_became_active":"2023-10-09T07:57:40.706065+0000","last_became_peered":"2023-10-09T07:57:40.706065+0000","last_unstale":"2023-10-09T07:57:41.694520+0000","last_undegraded":"2023-10-09T07:57:41.694520+0000","last_fullsized":"2023-10-09T07:57:41.694520+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:30:08.439237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.706771+0000","last_change":"2023-10-09T07:57:41.704870+0000","last_active":"2023-10-09T07:57:41.706771+0000","last_peered":"2023-10-09T07:57:41.706771+0000","last_clean":"2023-10-09T07:57:41.706771+0000","last_became_active":"2023-10-09T07:57:41.702234+0000","last_became_peered":"2023-10-09T07:57:41.702234+0000","last_unstale":"2023-10-09T07:57:41.706771+0000","last_undegraded":"2023-10-09T07:57:41.706771+0000","last_fullsized":"2023-10-09T07:57:41.706771+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:54.925226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.731563+0000","last_change":"2023-10-09T07:57:40.708157+0000","last_active":"2023-10-09T07:57:41.731563+0000","last_peered":"2023-10-09T07:57:41.731563+0000","last_clean":"2023-10-09T07:57:41.731563+0000","last_became_active":"2023-10-09T07:57:40.707886+0000","last_became_peered":"2023-10-09T07:57:40.707886+0000","last_unstale":"2023-10-09T07:57:41.731563+0000","last_undegraded":"2023-10-09T07:57:41.731563+0000","last_fullsized":"2023-10-09T07:57:41.731563+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:26.982485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.724509+0000","last_change":"2023-10-09T07:57:41.717479+0000","last_active":"2023-10-09T07:57:41.724509+0000","last_peered":"2023-10-09T07:57:41.724509+0000","last_clean":"2023-10-09T07:57:41.724509+0000","last_became_active":"2023-10-09T07:57:41.716849+0000","last_became_peered":"2023-10-09T07:57:41.716849+0000","last_unstale":"2023-10-09T07:57:41.724509+0000","last_undegraded":"2023-10-09T07:57:41.724509+0000","last_fullsized":"2023-10-09T07:57:41.724509+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:35.354061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.699907+0000","last_change":"2023-10-09T07:57:40.713610+0000","last_active":"2023-10-09T07:57:41.699907+0000","last_peered":"2023-10-09T07:57:41.699907+0000","last_clean":"2023-10-09T07:57:41.699907+0000","last_became_active":"2023-10-09T07:57:40.713277+0000","last_became_peered":"2023-10-09T07:57:40.713277+0000","last_unstale":"2023-10-09T07:57:41.699907+0000","last_undegraded":"2023-10-09T07:57:41.699907+0000","last_fullsized":"2023-10-09T07:57:41.699907+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:55.814167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.713737+0000","last_change":"2023-10-09T07:57:41.712630+0000","last_active":"2023-10-09T07:57:41.713737+0000","last_peered":"2023-10-09T07:57:41.713737+0000","last_clean":"2023-10-09T07:57:41.713737+0000","last_became_active":"2023-10-09T07:57:41.712342+0000","last_became_peered":"2023-10-09T07:57:41.712342+0000","last_unstale":"2023-10-09T07:57:41.713737+0000","last_undegraded":"2023-10-09T07:57:41.713737+0000","last_fullsized":"2023-10-09T07:57:41.713737+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:17:24.262719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.700711+0000","last_change":"2023-10-09T07:57:40.708979+0000","last_active":"2023-10-09T07:57:41.700711+0000","last_peered":"2023-10-09T07:57:41.700711+0000","last_clean":"2023-10-09T07:57:41.700711+0000","last_became_active":"2023-10-09T07:57:40.708744+0000","last_became_peered":"2023-10-09T07:57:40.708744+0000","last_unstale":"2023-10-09T07:57:41.700711+0000","last_undegraded":"2023-10-09T07:57:41.700711+0000","last_fullsized":"2023-10-09T07:57:41.700711+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:54:04.419888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.714595+0000","last_change":"2023-10-09T07:57:41.709721+0000","last_active":"2023-10-09T07:57:41.714595+0000","last_peered":"2023-10-09T07:57:41.714595+0000","last_clean":"2023-10-09T07:57:41.714595+0000","last_became_active":"2023-10-09T07:57:41.709137+0000","last_became_peered":"2023-10-09T07:57:41.709137+0000","last_unstale":"2023-10-09T07:57:41.714595+0000","last_undegraded":"2023-10-09T07:57:41.714595+0000","last_fullsized":"2023-10-09T07:57:41.714595+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:24:27.547006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.694719+0000","last_change":"2023-10-09T07:57:40.703859+0000","last_active":"2023-10-09T07:57:41.694719+0000","last_peered":"2023-10-09T07:57:41.694719+0000","last_clean":"2023-10-09T07:57:41.694719+0000","last_became_active":"2023-10-09T07:57:40.703554+0000","last_became_peered":"2023-10-09T07:57:40.703554+0000","last_unstale":"2023-10-09T07:57:41.694719+0000","last_undegraded":"2023-10-09T07:57:41.694719+0000","last_fullsized":"2023-10-09T07:57:41.694719+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:58.084800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.713995+0000","last_change":"2023-10-09T07:57:41.709242+0000","last_active":"2023-10-09T07:57:41.713995+0000","last_peered":"2023-10-09T07:57:41.713995+0000","last_clean":"2023-10-09T07:57:41.713995+0000","last_became_active":"2023-10-09T07:57:41.706942+0000","last_became_peered":"2023-10-09T07:57:41.706942+0000","last_unstale":"2023-10-09T07:57:41.713995+0000","last_undegraded":"2023-10-09T07:57:41.713995+0000","last_fullsized":"2023-10-09T07:57:41.713995+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:10:00.444011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.697912+0000","last_change":"2023-10-09T07:57:40.712458+0000","last_active":"2023-10-09T07:57:41.697912+0000","last_peered":"2023-10-09T07:57:41.697912+0000","last_clean":"2023-10-09T07:57:41.697912+0000","last_became_active":"2023-10-09T07:57:40.712180+0000","last_became_peered":"2023-10-09T07:57:40.712180+0000","last_unstale":"2023-10-09T07:57:41.697912+0000","last_undegraded":"2023-10-09T07:57:41.697912+0000","last_fullsized":"2023-10-09T07:57:41.697912+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:49.504100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.709101+0000","last_change":"2023-10-09T07:57:41.707947+0000","last_active":"2023-10-09T07:57:41.709101+0000","last_peered":"2023-10-09T07:57:41.709101+0000","last_clean":"2023-10-09T07:57:41.709101+0000","last_became_active":"2023-10-09T07:57:41.707062+0000","last_became_peered":"2023-10-09T07:57:41.707062+0000","last_unstale":"2023-10-09T07:57:41.709101+0000","last_undegraded":"2023-10-09T07:57:41.709101+0000","last_fullsized":"2023-10-09T07:57:41.709101+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:59.145208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.703882+0000","last_change":"2023-10-09T07:57:40.712238+0000","last_active":"2023-10-09T07:57:41.703882+0000","last_peered":"2023-10-09T07:57:41.703882+0000","last_clean":"2023-10-09T07:57:41.703882+0000","last_became_active":"2023-10-09T07:57:40.711950+0000","last_became_peered":"2023-10-09T07:57:40.711950+0000","last_unstale":"2023-10-09T07:57:41.703882+0000","last_undegraded":"2023-10-09T07:57:41.703882+0000","last_fullsized":"2023-10-09T07:57:41.703882+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:13.983681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.720069+0000","last_change":"2023-10-09T07:57:41.717075+0000","last_active":"2023-10-09T07:57:41.720069+0000","last_peered":"2023-10-09T07:57:41.720069+0000","last_clean":"2023-10-09T07:57:41.720069+0000","last_became_active":"2023-10-09T07:57:41.716822+0000","last_became_peered":"2023-10-09T07:57:41.716822+0000","last_unstale":"2023-10-09T07:57:41.720069+0000","last_undegraded":"2023-10-09T07:57:41.720069+0000","last_fullsized":"2023-10-09T07:57:41.720069+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:37:41.304881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.702813+0000","last_change":"2023-10-09T07:57:40.703705+0000","last_active":"2023-10-09T07:57:41.702813+0000","last_peered":"2023-10-09T07:57:41.702813+0000","last_clean":"2023-10-09T07:57:41.702813+0000","last_became_active":"2023-10-09T07:57:40.703459+0000","last_became_peered":"2023-10-09T07:57:40.703459+0000","last_unstale":"2023-10-09T07:57:41.702813+0000","last_undegraded":"2023-10-09T07:57:41.702813+0000","last_fullsized":"2023-10-09T07:57:41.702813+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:20:20.044507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.724731+0000","last_change":"2023-10-09T07:57:41.721873+0000","last_active":"2023-10-09T07:57:41.724731+0000","last_peered":"2023-10-09T07:57:41.724731+0000","last_clean":"2023-10-09T07:57:41.724731+0000","last_became_active":"2023-10-09T07:57:41.721618+0000","last_became_peered":"2023-10-09T07:57:41.721618+0000","last_unstale":"2023-10-09T07:57:41.724731+0000","last_undegraded":"2023-10-09T07:57:41.724731+0000","last_fullsized":"2023-10-09T07:57:41.724731+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:10:06.992181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.694634+0000","last_change":"2023-10-09T07:57:40.701414+0000","last_active":"2023-10-09T07:57:41.694634+0000","last_peered":"2023-10-09T07:57:41.694634+0000","last_clean":"2023-10-09T07:57:41.694634+0000","last_became_active":"2023-10-09T07:57:40.701089+0000","last_became_peered":"2023-10-09T07:57:40.701089+0000","last_unstale":"2023-10-09T07:57:41.694634+0000","last_undegraded":"2023-10-09T07:57:41.694634+0000","last_fullsized":"2023-10-09T07:57:41.694634+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:58:10.965338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.731983+0000","last_change":"2023-10-09T07:57:41.729655+0000","last_active":"2023-10-09T07:57:41.731983+0000","last_peered":"2023-10-09T07:57:41.731983+0000","last_clean":"2023-10-09T07:57:41.731983+0000","last_became_active":"2023-10-09T07:57:41.729138+0000","last_became_peered":"2023-10-09T07:57:41.729138+0000","last_unstale":"2023-10-09T07:57:41.731983+0000","last_undegraded":"2023-10-09T07:57:41.731983+0000","last_fullsized":"2023-10-09T07:57:41.731983+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:25:31.318971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.729351+0000","last_change":"2023-10-09T07:57:40.711713+0000","last_active":"2023-10-09T07:57:41.729351+0000","last_peered":"2023-10-09T07:57:41.729351+0000","last_clean":"2023-10-09T07:57:41.729351+0000","last_became_active":"2023-10-09T07:57:40.711394+0000","last_became_peered":"2023-10-09T07:57:40.711394+0000","last_unstale":"2023-10-09T07:57:41.729351+0000","last_undegraded":"2023-10-09T07:57:41.729351+0000","last_fullsized":"2023-10-09T07:57:41.729351+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:39.395694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"152'271","reported_seq":832,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.701037+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T07:57:41.701037+0000","last_peered":"2023-10-09T07:57:41.701037+0000","last_clean":"2023-10-09T07:57:41.701037+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T07:57:41.701037+0000","last_undegraded":"2023-10-09T07:57:41.701037+0000","last_fullsized":"2023-10-09T07:57:41.701037+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575744,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308064,"kb_used_data":2584,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063776,"statfs":{"total":96636764160,"available":96321306624,"internally_reserved":0,"allocated":2646016,"data_stored":1605086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.751,"15min":0.755},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1,"5min":1.016,"15min":1.127},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.47399999999999998},"max":{"1min":1.0029999999999999,"5min":1.026,"15min":1.1319999999999999},"last":0.67500000000000004}]},{"osd":1,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.74099999999999999,"15min":0.73799999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.46000000000000002},"max":{"1min":0.94199999999999995,"5min":1.002,"15min":1.077},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75,"15min":0.752},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.47399999999999998},"max":{"1min":0.95099999999999996,"5min":0.997,"15min":1.038},"last":0.60699999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.50600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.94899999999999995,"5min":1.016,"15min":1.0269999999999999},"last":0.501},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.76600000000000001,"15min":0.76800000000000002},"min":{"1min":0.59699999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96599999999999997,"5min":0.98299999999999998,"15min":1.1899999999999999},"last":0.61399999999999999}]},{"osd":3,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.52700000000000002,"5min":0.49399999999999999,"15min":0.42099999999999999},"max":{"1min":0.995,"5min":0.995,"15min":1.04},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78900000000000003,"15min":0.79400000000000004},"min":{"1min":0.66100000000000003,"5min":0.55900000000000005,"15min":0.54400000000000004},"max":{"1min":1.0249999999999999,"5min":1.0529999999999999,"15min":1.0920000000000001},"last":0.56000000000000005}]},{"osd":4,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63400000000000001,"15min":0.62},"min":{"1min":0.433,"5min":0.42199999999999999,"15min":0.36299999999999999},"max":{"1min":0.85299999999999998,"5min":0.97099999999999997,"15min":1.248},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92500000000000004,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.47499999999999998}]},{"osd":5,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.434,"5min":0.41299999999999998,"15min":0.38700000000000001},"max":{"1min":0.874,"5min":0.98299999999999998,"15min":1.0600000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68600000000000005,"15min":0.69099999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92400000000000004,"5min":1.0009999999999999,"15min":1.304},"last":0.64900000000000002}]},{"osd":6,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.746,"15min":0.748},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89900000000000002,"5min":1.069,"15min":1.405},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.43099999999999999},"max":{"1min":0.96799999999999997,"5min":1.075,"15min":1.377},"last":0.626}]}]},{"osd":6,"up_from":13,"seq":55834575743,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311568,"kb_used_data":1992,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060272,"statfs":{"total":96636764160,"available":96317718528,"internally_reserved":0,"allocated":2039808,"data_stored":1014108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77300000000000002,"15min":0.754},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.33600000000000002},"max":{"1min":0.88100000000000001,"5min":0.98399999999999999,"15min":1.012},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.55500000000000005,"5min":0.53900000000000003,"15min":0.49399999999999999},"max":{"1min":1.0049999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.75600000000000001}]},{"osd":1,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77700000000000002,"15min":0.77000000000000002},"min":{"1min":0.69099999999999995,"5min":0.53300000000000003,"15min":0.48199999999999998},"max":{"1min":0.93500000000000005,"5min":1.113,"15min":1.2769999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.78800000000000003,"15min":0.77000000000000002},"min":{"1min":0.59899999999999998,"5min":0.55400000000000005,"15min":0.501},"max":{"1min":0.98899999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.73199999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.77800000000000002,"15min":0.76000000000000001},"min":{"1min":0.57199999999999995,"5min":0.46100000000000002,"15min":0.432},"max":{"1min":0.88400000000000001,"5min":1.075,"15min":1.075},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80300000000000005,"15min":0.78100000000000003},"min":{"1min":0.63200000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95699999999999996,"5min":1.151,"15min":1.151},"last":0.67100000000000004}]},{"osd":3,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76800000000000002,"15min":0.75800000000000001},"min":{"1min":0.56100000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.877,"5min":1.423,"15min":1.423},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79400000000000004,"15min":0.78500000000000003},"min":{"1min":0.624,"5min":0.55500000000000005,"15min":0.54100000000000004},"max":{"1min":1.0269999999999999,"5min":1.335,"15min":1.335},"last":0.71099999999999997}]},{"osd":4,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.45800000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88900000000000001,"5min":0.98099999999999998,"15min":1.1279999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65500000000000003,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.89700000000000002,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97199999999999998,"5min":1.306,"15min":1.306},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70899999999999996,"15min":0.69899999999999995},"min":{"1min":0.55500000000000005,"5min":0.45400000000000001,"15min":0.42699999999999999},"max":{"1min":0.95199999999999996,"5min":1.054,"15min":1.085},"last":0.57799999999999996}]},{"osd":7,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.47699999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.80800000000000005,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.54400000000000004,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97399999999999998,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.60499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575744,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303364,"kb_used_data":1980,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068476,"statfs":{"total":96636764160,"available":96326119424,"internally_reserved":0,"allocated":2027520,"data_stored":1012572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48499999999999999,"15min":0.46800000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.308},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.52400000000000002,"15min":0.50700000000000001},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.313},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.47399999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.54800000000000004,"15min":0.51700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32900000000000001},"max":{"1min":5.1159999999999997,"5min":5.1159999999999997,"15min":5.1159999999999997},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.63600000000000001,"15min":0.59599999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.375},"max":{"1min":5.399,"5min":5.399,"15min":5.399},"last":0.495}]},{"osd":3,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.63900000000000001,"15min":0.63600000000000001},"min":{"1min":0.42999999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.41699999999999998,"5min":0.39900000000000002,"15min":0.37},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.68500000000000005}]},{"osd":4,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.83899999999999997,"15min":0.80800000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.42699999999999999},"max":{"1min":5.2409999999999997,"5min":5.2409999999999997,"15min":5.2409999999999997},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.86599999999999999,"15min":0.82699999999999996},"min":{"1min":0.65700000000000003,"5min":0.622,"15min":0.56699999999999995},"max":{"1min":5.4409999999999998,"5min":5.4409999999999998,"15min":5.4409999999999998},"last":0.70799999999999996}]},{"osd":5,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.81499999999999995,"15min":0.81100000000000005},"min":{"1min":0.64000000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.754},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.85499999999999998,"15min":0.82499999999999996},"min":{"1min":0.60299999999999998,"5min":0.57999999999999996,"15min":0.442},"max":{"1min":5.1630000000000003,"5min":5.1630000000000003,"15min":5.1630000000000003},"last":0.60099999999999998}]},{"osd":6,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.89300000000000002,"15min":0.84499999999999997},"min":{"1min":0.65300000000000002,"5min":0.63900000000000001,"15min":0.55100000000000005},"max":{"1min":5.4749999999999996,"5min":5.4749999999999996,"15min":5.4749999999999996},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83499999999999996,"15min":0.82999999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.84399999999999997}]},{"osd":7,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.56000000000000005},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.081,"5min":0.92800000000000005,"15min":0.88500000000000001},"min":{"1min":0.66500000000000004,"5min":0.63,"15min":0.55300000000000005},"max":{"1min":5.2009999999999996,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":0.77600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575743,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303944,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067896,"statfs":{"total":96636764160,"available":96325525504,"internally_reserved":0,"allocated":2621440,"data_stored":1602940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.49399999999999999,"15min":0.47799999999999998},"min":{"1min":0.37,"5min":0.29999999999999999,"15min":0.28799999999999998},"max":{"1min":0.69599999999999995,"5min":0.72099999999999997,"15min":0.86499999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32000000000000001},"max":{"1min":0.70599999999999996,"5min":0.82999999999999996,"15min":0.88200000000000001},"last":0.68899999999999995}]},{"osd":2,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.39800000000000002,"5min":0.38200000000000001,"15min":0.36799999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.91800000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.374,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66800000000000004,"5min":0.78700000000000003,"15min":0.82399999999999995},"last":0.52400000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.373},"max":{"1min":0.73199999999999998,"5min":0.84299999999999997,"15min":0.98599999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.61799999999999999,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86899999999999999,"5min":0.89600000000000002,"15min":0.94699999999999995},"last":0.64700000000000002}]},{"osd":4,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.64800000000000002,"5min":0.57799999999999996,"15min":0.52200000000000002},"max":{"1min":0.98499999999999999,"5min":1.1699999999999999,"15min":1.532},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82799999999999996,"15min":0.81899999999999995},"min":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.54200000000000004},"max":{"1min":1.0920000000000001,"5min":1.1339999999999999,"15min":1.2470000000000001},"last":0.76800000000000002}]},{"osd":5,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.80200000000000005,"15min":0.79700000000000004},"min":{"1min":0.59799999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0349999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.67200000000000004,"5min":0.59699999999999998,"15min":0.55500000000000005},"max":{"1min":1.1100000000000001,"5min":1.296,"15min":1.3009999999999999},"last":0.73299999999999998}]},{"osd":6,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.85699999999999998,"15min":0.83999999999999997},"min":{"1min":0.67100000000000004,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.048,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.81999999999999995,"15min":0.81899999999999995},"min":{"1min":0.59499999999999997,"5min":0.57699999999999996,"15min":0.51400000000000001},"max":{"1min":1.131,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.72399999999999998}]},{"osd":7,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.84699999999999998,"15min":0.85499999999999998},"min":{"1min":0.626,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":1.1020000000000001,"5min":1.246,"15min":1.3380000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.88800000000000001,"15min":0.86899999999999999},"min":{"1min":0.70199999999999996,"5min":0.61899999999999999,"15min":0.54400000000000004},"max":{"1min":1.1559999999999999,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.84899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575743,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311564,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060276,"statfs":{"total":96636764160,"available":96317722624,"internally_reserved":0,"allocated":2035712,"data_stored":1013160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.46899999999999997},"min":{"1min":0.33800000000000002,"5min":0.309,"15min":0.30199999999999999},"max":{"1min":0.71299999999999997,"5min":0.72099999999999997,"15min":0.84999999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.36499999999999999,"5min":0.35599999999999998,"15min":0.316},"max":{"1min":0.65700000000000003,"5min":0.76100000000000001,"15min":0.85599999999999998},"last":0.432}]},{"osd":1,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.35799999999999998,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.65000000000000002,"5min":0.68000000000000005,"15min":0.85399999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53600000000000003},"min":{"1min":0.41099999999999998,"5min":0.39400000000000002,"15min":0.34599999999999997},"max":{"1min":0.71799999999999997,"5min":0.78200000000000003,"15min":0.98699999999999999},"last":0.39600000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.47899999999999998,"5min":0.46600000000000003,"15min":0.41399999999999998},"max":{"1min":0.77600000000000002,"5min":0.79900000000000004,"15min":0.95199999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.49399999999999999,"5min":0.44500000000000001,"15min":0.40999999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.95099999999999996},"last":0.56100000000000005}]},{"osd":4,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79900000000000004,"15min":0.79600000000000004},"min":{"1min":0.58599999999999997,"5min":0.56299999999999994,"15min":0.54500000000000004},"max":{"1min":1.147,"5min":1.196,"15min":1.202},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.78600000000000003,"15min":0.78100000000000003},"min":{"1min":0.56200000000000006,"5min":0.54000000000000004,"15min":0.47799999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.141},"last":0.96099999999999997}]},{"osd":5,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81999999999999995,"15min":0.79200000000000004},"min":{"1min":0.63200000000000001,"5min":0.60799999999999998,"15min":0.57199999999999995},"max":{"1min":1.0489999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.82399999999999995,"15min":0.81499999999999995},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0640000000000001,"5min":1.254,"15min":1.254},"last":0.82599999999999996}]},{"osd":6,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82499999999999996,"15min":0.81000000000000005},"min":{"1min":0.63,"5min":0.56999999999999995,"15min":0.48099999999999998},"max":{"1min":1.0980000000000001,"5min":1.1639999999999999,"15min":1.296},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83399999999999996,"15min":0.81999999999999995},"min":{"1min":0.60399999999999998,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1000000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.84499999999999997,"15min":0.83499999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.53600000000000003},"max":{"1min":1.1719999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89700000000000002,"15min":0.874},"min":{"1min":0.73799999999999999,"5min":0.66500000000000004,"15min":0.65300000000000002},"max":{"1min":1.157,"5min":1.298,"15min":1.298},"last":0.78300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575744,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311564,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060276,"statfs":{"total":96636764160,"available":96317722624,"internally_reserved":0,"allocated":2035712,"data_stored":1012732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48799999999999999,"15min":0.48699999999999999},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.29599999999999999},"max":{"1min":0.624,"5min":0.77100000000000002,"15min":0.81899999999999995},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.35399999999999998,"5min":0.33500000000000002,"15min":0.32300000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.91700000000000004},"last":0.45100000000000001}]},{"osd":1,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.33700000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.84699999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.46100000000000002,"5min":0.38300000000000001,"15min":0.35599999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.47299999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.46600000000000003,"5min":0.42099999999999999,"15min":0.34999999999999998},"max":{"1min":0.75800000000000001,"5min":0.76000000000000001,"15min":0.90900000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65000000000000002,"15min":0.65200000000000002},"min":{"1min":0.53600000000000003,"5min":0.48399999999999999,"15min":0.40899999999999997},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.95799999999999996},"last":0.52900000000000003}]},{"osd":4,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78300000000000003,"15min":0.77200000000000002},"min":{"1min":0.58799999999999997,"5min":0.55000000000000004,"15min":0.47499999999999998},"max":{"1min":1.121,"5min":1.246,"15min":1.246},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.86399999999999999,"15min":0.85399999999999998},"min":{"1min":0.71899999999999997,"5min":0.629,"15min":0.57799999999999996},"max":{"1min":1.1419999999999999,"5min":1.157,"15min":1.157},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77400000000000002,"15min":0.76500000000000001},"min":{"1min":0.57399999999999995,"5min":0.52700000000000002,"15min":0.48499999999999999},"max":{"1min":1.0920000000000001,"5min":1.1140000000000001,"15min":1.1910000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.83199999999999996,"15min":0.82899999999999996},"min":{"1min":0.66900000000000004,"5min":0.63800000000000001,"15min":0.48899999999999999},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.81100000000000005,"15min":0.79600000000000004},"min":{"1min":0.623,"5min":0.57799999999999996,"15min":0.495},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82099999999999995,"15min":0.81499999999999995},"min":{"1min":0.65900000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.024,"5min":1.105,"15min":1.2230000000000001},"last":0.59299999999999997}]},{"osd":7,"last update":"Mon Oct 9 07:56:48 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.85899999999999999,"15min":0.84999999999999998},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.53100000000000003},"max":{"1min":1.1599999999999999,"5min":1.21,"15min":1.2430000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.85699999999999998,"15min":0.84799999999999998},"min":{"1min":0.72699999999999998,"5min":0.627,"15min":0.56699999999999995},"max":{"1min":1.179,"5min":1.179,"15min":1.1850000000000001},"last":0.77900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575743,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315656,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056184,"statfs":{"total":96636764160,"available":96313532416,"internally_reserved":0,"allocated":2031616,"data_stored":1012642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73399999999999999,"15min":0.72399999999999998},"min":{"1min":0.54100000000000004,"5min":0.48799999999999999,"15min":0.41199999999999998},"max":{"1min":0.93600000000000005,"5min":1.052,"15min":1.0700000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.76600000000000001,"15min":0.76200000000000001},"min":{"1min":0.52700000000000002,"5min":0.501,"15min":0.49199999999999999},"max":{"1min":0.89000000000000001,"5min":1.0680000000000001,"15min":1.3320000000000001},"last":0.59499999999999997}]},{"osd":1,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.75,"15min":0.73499999999999999},"min":{"1min":0.59299999999999997,"5min":0.504,"15min":0.47499999999999998},"max":{"1min":0.90000000000000002,"5min":1.038,"15min":1.0640000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.752,"15min":0.747},"min":{"1min":0.57199999999999995,"5min":0.54400000000000004,"15min":0.48999999999999999},"max":{"1min":0.91400000000000003,"5min":1.028,"15min":1.242},"last":0.75900000000000001}]},{"osd":2,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.80500000000000005,"15min":0.79300000000000004},"min":{"1min":0.63500000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.97899999999999998,"5min":0.999,"15min":1.228},"last":0.746},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.65300000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.99299999999999999,"5min":1.069,"15min":1.069},"last":0.65500000000000003}]},{"osd":3,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77700000000000002,"15min":0.76300000000000001},"min":{"1min":0.628,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.94699999999999995,"5min":1.131,"15min":1.151},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.56399999999999995,"5min":0.53800000000000003,"15min":0.53500000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.2110000000000001},"last":0.61299999999999999}]},{"osd":5,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.60699999999999998,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.372,"15min":0.36299999999999999},"max":{"1min":0.872,"5min":1.27,"15min":1.27},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.62,"15min":0.623},"min":{"1min":0.45600000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.79400000000000004,"5min":1.014,"15min":1.014},"last":0.77600000000000002}]},{"osd":6,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.5,"5min":0.46899999999999997,"15min":0.41699999999999998},"max":{"1min":0.95199999999999996,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.67800000000000005,"15min":0.67000000000000004},"min":{"1min":0.47999999999999998,"5min":0.45500000000000002,"15min":0.39000000000000001},"max":{"1min":0.92500000000000004,"5min":1.425,"15min":1.425},"last":0.69999999999999996}]},{"osd":7,"last update":"Mon Oct 9 07:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70399999999999996,"15min":0.72099999999999997},"min":{"1min":0.53500000000000003,"5min":0.48699999999999999,"15min":0.47999999999999998},"max":{"1min":0.81799999999999995,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76600000000000001,"15min":0.76300000000000001},"min":{"1min":0.57499999999999996,"5min":0.51200000000000001,"15min":0.46600000000000003},"max":{"1min":0.94299999999999995,"5min":1.0529999999999999,"15min":1.165},"last":0.72899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575744,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311564,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060276,"statfs":{"total":96636764160,"available":96317722624,"internally_reserved":0,"allocated":2035712,"data_stored":1012684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.745,"15min":0.73199999999999998},"min":{"1min":0.55600000000000005,"5min":0.46200000000000002,"15min":0.39100000000000001},"max":{"1min":0.97199999999999998,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74199999999999999,"15min":0.72499999999999998},"min":{"1min":0.51100000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.0820000000000001},"last":0.88200000000000001}]},{"osd":1,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73399999999999999,"15min":0.73299999999999998},"min":{"1min":0.56899999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":0.97499999999999998,"15min":1.0129999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76300000000000001,"15min":0.75600000000000001},"min":{"1min":0.56599999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.0289999999999999},"last":0.78800000000000003}]},{"osd":2,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77100000000000002,"15min":0.75800000000000001},"min":{"1min":0.63400000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95399999999999996,"5min":0.95699999999999996,"15min":0.98599999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.5,"5min":0.5,"15min":0.44500000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":1.026},"last":0.745}]},{"osd":3,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77800000000000002,"15min":0.76600000000000001},"min":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.47499999999999998},"max":{"1min":0.92200000000000004,"5min":0.97799999999999998,"15min":1.107},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79700000000000004,"15min":0.78500000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.96699999999999997,"5min":0.99099999999999999,"15min":1.0249999999999999},"last":0.80600000000000005}]},{"osd":4,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.61099999999999999,"15min":0.60599999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.82099999999999995,"5min":1.002,"15min":1.0189999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.625,"15min":0.61699999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.379},"max":{"1min":0.89200000000000002,"5min":0.96199999999999997,"15min":1.0289999999999999},"last":0.69699999999999995}]},{"osd":6,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64000000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.91400000000000003,"5min":0.95899999999999996,"15min":0.998},"last":0.622},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68700000000000006,"15min":0.67800000000000005},"min":{"1min":0.51200000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.054},"last":0.81999999999999995}]},{"osd":7,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.69499999999999995},"min":{"1min":0.47199999999999998,"5min":0.45000000000000001,"15min":0.433},"max":{"1min":0.93400000000000005,"5min":1.0449999999999999,"15min":1.073},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.79200000000000004,"15min":0.78500000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.5},"max":{"1min":1.0069999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.85799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T07:57:50.883 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T07:57:51.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.072+0000 7f18287ff700 1 Processor -- start 2023-10-09T07:57:51.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.072+0000 7f18287ff700 1 -- start start 2023-10-09T07:57:51.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.073+0000 7f18287ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f18200b0300 0x7f18200b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:51.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.073+0000 7f18287ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18200b0c80 con 0x7f18200ccc40 2023-10-09T07:57:51.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.073+0000 7f18287ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18200ad930 con 0x7f18200cd010 2023-10-09T07:57:51.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.073+0000 7f18287ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18200acd20 con 0x7f18200b0300 2023-10-09T07:57:51.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.074+0000 7f1826d9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f18200b0300 0x7f18200b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:51.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.074+0000 7f182659b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f18200ccc40 0x7f1820155c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52050/0 (socket says 172.21.15.71:52050) 2023-10-09T07:57:51.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.074+0000 7f182659b700 1 -- 172.21.15.71:0/203226714 learned_addr learned my addr 172.21.15.71:0/203226714 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:51.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.074+0000 7f1826d9c700 1 --2- 172.21.15.71:0/203226714 >> v2:172.21.15.71:3300/0 conn(0x7f18200b0300 0x7f18200b0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35580/0 (socket says 172.21.15.71:35580) 2023-10-09T07:57:51.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.074+0000 7f1826d9c700 1 -- 172.21.15.71:0/203226714 >> v1:172.21.15.179:6789/0 conn(0x7f18200cd010 legacy=0x7f18200ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:51.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.074+0000 7f1826d9c700 1 -- 172.21.15.71:0/203226714 >> v1:172.21.15.71:6789/0 conn(0x7f18200ccc40 legacy=0x7f1820155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:51.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.074+0000 7f1826d9c700 1 -- 172.21.15.71:0/203226714 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18200ad000 con 0x7f18200b0300 2023-10-09T07:57:51.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.074+0000 7f1826d9c700 1 --2- 172.21.15.71:0/203226714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18200b0300 0x7f18200b0740 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f1818009e60 tx=0x7f1818009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77734dce0826aa51 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:51.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.075+0000 7f1825599700 1 -- 172.21.15.71:0/203226714 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181800e070 con 0x7f18200b0300 2023-10-09T07:57:51.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.075+0000 7f1825599700 1 -- 172.21.15.71:0/203226714 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181800bbf0 con 0x7f18200b0300 2023-10-09T07:57:51.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.075+0000 7f1825599700 1 -- 172.21.15.71:0/203226714 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1818012430 con 0x7f18200b0300 2023-10-09T07:57:51.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.075+0000 7f18287ff700 1 -- 172.21.15.71:0/203226714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18200b0300 msgr2=0x7f18200b0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:51.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.075+0000 7f18287ff700 1 --2- 172.21.15.71:0/203226714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18200b0300 0x7f18200b0740 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f1818009e60 tx=0x7f1818009780 comp rx=0 tx=0).stop 2023-10-09T07:57:51.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.075+0000 7f18287ff700 1 -- 172.21.15.71:0/203226714 shutdown_connections 2023-10-09T07:57:51.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.075+0000 7f18287ff700 1 --2- 172.21.15.71:0/203226714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18200b0300 0x7f18200b0740 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:51.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.075+0000 7f18287ff700 1 -- 172.21.15.71:0/203226714 >> 172.21.15.71:0/203226714 conn(0x7f182006a320 msgr2=0x7f18200cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:51.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.075+0000 7f18287ff700 1 -- 172.21.15.71:0/203226714 shutdown_connections 2023-10-09T07:57:51.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.075+0000 7f18287ff700 1 -- 172.21.15.71:0/203226714 wait complete. 2023-10-09T07:57:51.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.077+0000 7f18287ff700 1 Processor -- start 2023-10-09T07:57:51.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.077+0000 7f18287ff700 1 -- start start 2023-10-09T07:57:51.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.078+0000 7f18287ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18200b0300 0x7f182016d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:51.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.078+0000 7f18287ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18200ccc40 0x7f18200cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:51.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.078+0000 7f18287ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18200cd010 0x7f18200c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:51.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.078+0000 7f18287ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18200c5780 con 0x7f18200cd010 2023-10-09T07:57:51.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.078+0000 7f18287ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18200c5a60 con 0x7f18200b0300 2023-10-09T07:57:51.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.078+0000 7f18287ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182016cf20 con 0x7f18200ccc40 2023-10-09T07:57:51.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.078+0000 7f1826d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18200cd010 0x7f18200c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:51.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.078+0000 7f1826d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18200cd010 0x7f18200c4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35590/0 (socket says 172.21.15.71:35590) 2023-10-09T07:57:51.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.078+0000 7f1826d9c700 1 -- 172.21.15.71:0/3183415672 learned_addr learned my addr 172.21.15.71:0/3183415672 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:51.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.078+0000 7f182659b700 1 --2- 172.21.15.71:0/3183415672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18200b0300 0x7f182016d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:51.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.078+0000 7f1825d9a700 1 --2- 172.21.15.71:0/3183415672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18200ccc40 0x7f18200cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:51.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.078+0000 7f1826d9c700 1 -- 172.21.15.71:0/3183415672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18200ccc40 msgr2=0x7f18200cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:51.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.078+0000 7f1826d9c700 1 --2- 172.21.15.71:0/3183415672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18200ccc40 0x7f18200cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:51.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.078+0000 7f1826d9c700 1 -- 172.21.15.71:0/3183415672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18200b0300 msgr2=0x7f182016d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:51.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.078+0000 7f1826d9c700 1 --2- 172.21.15.71:0/3183415672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18200b0300 0x7f182016d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:51.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.078+0000 7f1826d9c700 1 -- 172.21.15.71:0/3183415672 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1818009a20 con 0x7f18200cd010 2023-10-09T07:57:51.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.078+0000 7f182659b700 1 --2- 172.21.15.71:0/3183415672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18200b0300 0x7f182016d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:57:51.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.079+0000 7f1826d9c700 1 --2- 172.21.15.71:0/3183415672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18200cd010 0x7f18200c4da0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f18200b0e10 tx=0x7f1818018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:51.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.079+0000 7f18167fc700 1 -- 172.21.15.71:0/3183415672 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181801e640 con 0x7f18200cd010 2023-10-09T07:57:51.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.079+0000 7f18167fc700 1 -- 172.21.15.71:0/3183415672 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181801e7a0 con 0x7f18200cd010 2023-10-09T07:57:51.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.079+0000 7f18167fc700 1 -- 172.21.15.71:0/3183415672 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181801eb60 con 0x7f18200cd010 2023-10-09T07:57:51.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.079+0000 7f18287ff700 1 -- 172.21.15.71:0/3183415672 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182016d200 con 0x7f18200cd010 2023-10-09T07:57:51.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.079+0000 7f18287ff700 1 -- 172.21.15.71:0/3183415672 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18200c2940 con 0x7f18200cd010 2023-10-09T07:57:51.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.080+0000 7f18287ff700 1 -- 172.21.15.71:0/3183415672 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182004c3c0 con 0x7f18200cd010 2023-10-09T07:57:51.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.081+0000 7f18167fc700 1 -- 172.21.15.71:0/3183415672 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1818024070 con 0x7f18200cd010 2023-10-09T07:57:51.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.082+0000 7f18167fc700 1 --2- 172.21.15.71:0/3183415672 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1804066f30 0x7f18040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:51.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.082+0000 7f18167fc700 1 -- 172.21.15.71:0/3183415672 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f18180872b0 con 0x7f18200cd010 2023-10-09T07:57:51.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.082+0000 7f182659b700 1 --2- 172.21.15.71:0/3183415672 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1804066f30 0x7f18040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:51.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.083+0000 7f182659b700 1 --2- 172.21.15.71:0/3183415672 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1804066f30 0x7f18040693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f181c0018c0 tx=0x7f181c009040 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:51.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.086+0000 7f18167fc700 1 -- 172.21.15.71:0/3183415672 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18180542b0 con 0x7f18200cd010 2023-10-09T07:57:51.226 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:57:51.231 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:57:51.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.281+0000 7f18287ff700 1 -- 172.21.15.71:0/3183415672 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f182016cda0 con 0x7f1804066f30 2023-10-09T07:57:51.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.294+0000 7f18167fc700 1 -- 172.21.15.71:0/3183415672 <== mgr.8071 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289510 (secure 0 0 0) 0x7f181c001d30 con 0x7f1804066f30 2023-10-09T07:57:51.298 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:57:51.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.298+0000 7f18287ff700 1 -- 172.21.15.71:0/3183415672 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1804066f30 msgr2=0x7f18040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:51.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.298+0000 7f18287ff700 1 --2- 172.21.15.71:0/3183415672 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1804066f30 0x7f18040693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f181c0018c0 tx=0x7f181c009040 comp rx=0 tx=0).stop 2023-10-09T07:57:51.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.298+0000 7f18287ff700 1 -- 172.21.15.71:0/3183415672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18200cd010 msgr2=0x7f18200c4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:51.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.298+0000 7f18287ff700 1 --2- 172.21.15.71:0/3183415672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18200cd010 0x7f18200c4da0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f18200b0e10 tx=0x7f1818018000 comp rx=0 tx=0).stop 2023-10-09T07:57:51.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.298+0000 7f18287ff700 1 -- 172.21.15.71:0/3183415672 shutdown_connections 2023-10-09T07:57:51.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.298+0000 7f18287ff700 1 --2- 172.21.15.71:0/3183415672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18200cd010 0x7f18200c4da0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:51.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.298+0000 7f18287ff700 1 --2- 172.21.15.71:0/3183415672 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1804066f30 0x7f18040693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:51.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.298+0000 7f18287ff700 1 --2- 172.21.15.71:0/3183415672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18200b0300 0x7f182016d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:51.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.298+0000 7f18287ff700 1 --2- 172.21.15.71:0/3183415672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18200ccc40 0x7f18200cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:51.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.298+0000 7f18287ff700 1 -- 172.21.15.71:0/3183415672 >> 172.21.15.71:0/3183415672 conn(0x7f182006a320 msgr2=0x7f1820154cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:51.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.299+0000 7f18287ff700 1 -- 172.21.15.71:0/3183415672 shutdown_connections 2023-10-09T07:57:51.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.299+0000 7f18287ff700 1 -- 172.21.15.71:0/3183415672 wait complete. 2023-10-09T07:57:51.302 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T07:57:51.316 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-09T07:57:51.107546+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":484,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":310,"ondisk_log_size":310,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2477288,"kb_used_data":17064,"kb_used_omap":0,"kb_used_meta":2460160,"kb_avail":752497432,"statfs":{"total":773094113280,"available":770557370368,"internally_reserved":0,"allocated":17473536,"data_stored":9285924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2519203840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.415494"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.717854+0000","last_change":"2023-10-09T07:57:41.709955+0000","last_active":"2023-10-09T07:57:41.717854+0000","last_peered":"2023-10-09T07:57:41.717854+0000","last_clean":"2023-10-09T07:57:41.717854+0000","last_became_active":"2023-10-09T07:57:41.709619+0000","last_became_peered":"2023-10-09T07:57:41.709619+0000","last_unstale":"2023-10-09T07:57:41.717854+0000","last_undegraded":"2023-10-09T07:57:41.717854+0000","last_fullsized":"2023-10-09T07:57:41.717854+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:31:27.885208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.711447+0000","last_change":"2023-10-09T07:57:41.709646+0000","last_active":"2023-10-09T07:57:41.711447+0000","last_peered":"2023-10-09T07:57:41.711447+0000","last_clean":"2023-10-09T07:57:41.711447+0000","last_became_active":"2023-10-09T07:57:41.707403+0000","last_became_peered":"2023-10-09T07:57:41.707403+0000","last_unstale":"2023-10-09T07:57:41.711447+0000","last_undegraded":"2023-10-09T07:57:41.711447+0000","last_fullsized":"2023-10-09T07:57:41.711447+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:45:52.898945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.714518+0000","last_change":"2023-10-09T07:57:41.711022+0000","last_active":"2023-10-09T07:57:41.714518+0000","last_peered":"2023-10-09T07:57:41.714518+0000","last_clean":"2023-10-09T07:57:41.714518+0000","last_became_active":"2023-10-09T07:57:41.710757+0000","last_became_peered":"2023-10-09T07:57:41.710757+0000","last_unstale":"2023-10-09T07:57:41.714518+0000","last_undegraded":"2023-10-09T07:57:41.714518+0000","last_fullsized":"2023-10-09T07:57:41.714518+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:14.993912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.725286+0000","last_change":"2023-10-09T07:57:41.720928+0000","last_active":"2023-10-09T07:57:41.725286+0000","last_peered":"2023-10-09T07:57:41.725286+0000","last_clean":"2023-10-09T07:57:41.725286+0000","last_became_active":"2023-10-09T07:57:41.720641+0000","last_became_peered":"2023-10-09T07:57:41.720641+0000","last_unstale":"2023-10-09T07:57:41.725286+0000","last_undegraded":"2023-10-09T07:57:41.725286+0000","last_fullsized":"2023-10-09T07:57:41.725286+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:35:10.760013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.716270+0000","last_change":"2023-10-09T07:57:41.712457+0000","last_active":"2023-10-09T07:57:41.716270+0000","last_peered":"2023-10-09T07:57:41.716270+0000","last_clean":"2023-10-09T07:57:41.716270+0000","last_became_active":"2023-10-09T07:57:41.712025+0000","last_became_peered":"2023-10-09T07:57:41.712025+0000","last_unstale":"2023-10-09T07:57:41.716270+0000","last_undegraded":"2023-10-09T07:57:41.716270+0000","last_fullsized":"2023-10-09T07:57:41.716270+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:57:09.984331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.714557+0000","last_change":"2023-10-09T07:57:41.708841+0000","last_active":"2023-10-09T07:57:41.714557+0000","last_peered":"2023-10-09T07:57:41.714557+0000","last_clean":"2023-10-09T07:57:41.714557+0000","last_became_active":"2023-10-09T07:57:41.708225+0000","last_became_peered":"2023-10-09T07:57:41.708225+0000","last_unstale":"2023-10-09T07:57:41.714557+0000","last_undegraded":"2023-10-09T07:57:41.714557+0000","last_fullsized":"2023-10-09T07:57:41.714557+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:45:52.898945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.718904+0000","last_change":"2023-10-09T07:57:41.716061+0000","last_active":"2023-10-09T07:57:41.718904+0000","last_peered":"2023-10-09T07:57:41.718904+0000","last_clean":"2023-10-09T07:57:41.718904+0000","last_became_active":"2023-10-09T07:57:41.715786+0000","last_became_peered":"2023-10-09T07:57:41.715786+0000","last_unstale":"2023-10-09T07:57:41.718904+0000","last_undegraded":"2023-10-09T07:57:41.718904+0000","last_fullsized":"2023-10-09T07:57:41.718904+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:03:31.621686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.721688+0000","last_change":"2023-10-09T07:57:41.720171+0000","last_active":"2023-10-09T07:57:41.721688+0000","last_peered":"2023-10-09T07:57:41.721688+0000","last_clean":"2023-10-09T07:57:41.721688+0000","last_became_active":"2023-10-09T07:57:41.719916+0000","last_became_peered":"2023-10-09T07:57:41.719916+0000","last_unstale":"2023-10-09T07:57:41.721688+0000","last_undegraded":"2023-10-09T07:57:41.721688+0000","last_fullsized":"2023-10-09T07:57:41.721688+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:08:09.958564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.715226+0000","last_change":"2023-10-09T07:57:41.712418+0000","last_active":"2023-10-09T07:57:41.715226+0000","last_peered":"2023-10-09T07:57:41.715226+0000","last_clean":"2023-10-09T07:57:41.715226+0000","last_became_active":"2023-10-09T07:57:41.712132+0000","last_became_peered":"2023-10-09T07:57:41.712132+0000","last_unstale":"2023-10-09T07:57:41.715226+0000","last_undegraded":"2023-10-09T07:57:41.715226+0000","last_fullsized":"2023-10-09T07:57:41.715226+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:04:15.160860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.711429+0000","last_change":"2023-10-09T07:57:41.709454+0000","last_active":"2023-10-09T07:57:41.711429+0000","last_peered":"2023-10-09T07:57:41.711429+0000","last_clean":"2023-10-09T07:57:41.711429+0000","last_became_active":"2023-10-09T07:57:41.707048+0000","last_became_peered":"2023-10-09T07:57:41.707048+0000","last_unstale":"2023-10-09T07:57:41.711429+0000","last_undegraded":"2023-10-09T07:57:41.711429+0000","last_fullsized":"2023-10-09T07:57:41.711429+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:54.925226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.705230+0000","last_change":"2023-10-09T07:57:41.704409+0000","last_active":"2023-10-09T07:57:41.705230+0000","last_peered":"2023-10-09T07:57:41.705230+0000","last_clean":"2023-10-09T07:57:41.705230+0000","last_became_active":"2023-10-09T07:57:41.704155+0000","last_became_peered":"2023-10-09T07:57:41.704155+0000","last_unstale":"2023-10-09T07:57:41.705230+0000","last_undegraded":"2023-10-09T07:57:41.705230+0000","last_fullsized":"2023-10-09T07:57:41.705230+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:34.109204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.714550+0000","last_change":"2023-10-09T07:57:41.710632+0000","last_active":"2023-10-09T07:57:41.714550+0000","last_peered":"2023-10-09T07:57:41.714550+0000","last_clean":"2023-10-09T07:57:41.714550+0000","last_became_active":"2023-10-09T07:57:41.710297+0000","last_became_peered":"2023-10-09T07:57:41.710297+0000","last_unstale":"2023-10-09T07:57:41.714550+0000","last_undegraded":"2023-10-09T07:57:41.714550+0000","last_fullsized":"2023-10-09T07:57:41.714550+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:37:41.304881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.709880+0000","last_change":"2023-10-09T07:57:41.706009+0000","last_active":"2023-10-09T07:57:41.709880+0000","last_peered":"2023-10-09T07:57:41.709880+0000","last_clean":"2023-10-09T07:57:41.709880+0000","last_became_active":"2023-10-09T07:57:41.705743+0000","last_became_peered":"2023-10-09T07:57:41.705743+0000","last_unstale":"2023-10-09T07:57:41.709880+0000","last_undegraded":"2023-10-09T07:57:41.709880+0000","last_fullsized":"2023-10-09T07:57:41.709880+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:51.895142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.707300+0000","last_change":"2023-10-09T07:57:41.705718+0000","last_active":"2023-10-09T07:57:41.707300+0000","last_peered":"2023-10-09T07:57:41.707300+0000","last_clean":"2023-10-09T07:57:41.707300+0000","last_became_active":"2023-10-09T07:57:41.705435+0000","last_became_peered":"2023-10-09T07:57:41.705435+0000","last_unstale":"2023-10-09T07:57:41.707300+0000","last_undegraded":"2023-10-09T07:57:41.707300+0000","last_fullsized":"2023-10-09T07:57:41.707300+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:31:29.093989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.723923+0000","last_change":"2023-10-09T07:57:41.714888+0000","last_active":"2023-10-09T07:57:41.723923+0000","last_peered":"2023-10-09T07:57:41.723923+0000","last_clean":"2023-10-09T07:57:41.723923+0000","last_became_active":"2023-10-09T07:57:41.712340+0000","last_became_peered":"2023-10-09T07:57:41.712340+0000","last_unstale":"2023-10-09T07:57:41.723923+0000","last_undegraded":"2023-10-09T07:57:41.723923+0000","last_fullsized":"2023-10-09T07:57:41.723923+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:35:04.276802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.726276+0000","last_change":"2023-10-09T07:57:41.725182+0000","last_active":"2023-10-09T07:57:41.726276+0000","last_peered":"2023-10-09T07:57:41.726276+0000","last_clean":"2023-10-09T07:57:41.726276+0000","last_became_active":"2023-10-09T07:57:41.724923+0000","last_became_peered":"2023-10-09T07:57:41.724923+0000","last_unstale":"2023-10-09T07:57:41.726276+0000","last_undegraded":"2023-10-09T07:57:41.726276+0000","last_fullsized":"2023-10-09T07:57:41.726276+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:56.824398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.704884+0000","last_change":"2023-10-09T07:57:41.703321+0000","last_active":"2023-10-09T07:57:41.704884+0000","last_peered":"2023-10-09T07:57:41.704884+0000","last_clean":"2023-10-09T07:57:41.704884+0000","last_became_active":"2023-10-09T07:57:41.701963+0000","last_became_peered":"2023-10-09T07:57:41.701963+0000","last_unstale":"2023-10-09T07:57:41.704884+0000","last_undegraded":"2023-10-09T07:57:41.704884+0000","last_fullsized":"2023-10-09T07:57:41.704884+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:31.293225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.724211+0000","last_change":"2023-10-09T07:57:41.722257+0000","last_active":"2023-10-09T07:57:41.724211+0000","last_peered":"2023-10-09T07:57:41.724211+0000","last_clean":"2023-10-09T07:57:41.724211+0000","last_became_active":"2023-10-09T07:57:41.721999+0000","last_became_peered":"2023-10-09T07:57:41.721999+0000","last_unstale":"2023-10-09T07:57:41.724211+0000","last_undegraded":"2023-10-09T07:57:41.724211+0000","last_fullsized":"2023-10-09T07:57:41.724211+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:04:15.160860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.708262+0000","last_change":"2023-10-09T07:57:41.705106+0000","last_active":"2023-10-09T07:57:41.708262+0000","last_peered":"2023-10-09T07:57:41.708262+0000","last_clean":"2023-10-09T07:57:41.708262+0000","last_became_active":"2023-10-09T07:57:41.704766+0000","last_became_peered":"2023-10-09T07:57:41.704766+0000","last_unstale":"2023-10-09T07:57:41.708262+0000","last_undegraded":"2023-10-09T07:57:41.708262+0000","last_fullsized":"2023-10-09T07:57:41.708262+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:16.242855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.721978+0000","last_change":"2023-10-09T07:57:41.718833+0000","last_active":"2023-10-09T07:57:41.721978+0000","last_peered":"2023-10-09T07:57:41.721978+0000","last_clean":"2023-10-09T07:57:41.721978+0000","last_became_active":"2023-10-09T07:57:41.718121+0000","last_became_peered":"2023-10-09T07:57:41.718121+0000","last_unstale":"2023-10-09T07:57:41.721978+0000","last_undegraded":"2023-10-09T07:57:41.721978+0000","last_fullsized":"2023-10-09T07:57:41.721978+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:34.255144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.716294+0000","last_change":"2023-10-09T07:57:41.713317+0000","last_active":"2023-10-09T07:57:41.716294+0000","last_peered":"2023-10-09T07:57:41.716294+0000","last_clean":"2023-10-09T07:57:41.716294+0000","last_became_active":"2023-10-09T07:57:41.712923+0000","last_became_peered":"2023-10-09T07:57:41.712923+0000","last_unstale":"2023-10-09T07:57:41.716294+0000","last_undegraded":"2023-10-09T07:57:41.716294+0000","last_fullsized":"2023-10-09T07:57:41.716294+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:36:51.629750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.710306+0000","last_change":"2023-10-09T07:57:41.708926+0000","last_active":"2023-10-09T07:57:41.710306+0000","last_peered":"2023-10-09T07:57:41.710306+0000","last_clean":"2023-10-09T07:57:41.710306+0000","last_became_active":"2023-10-09T07:57:41.708647+0000","last_became_peered":"2023-10-09T07:57:41.708647+0000","last_unstale":"2023-10-09T07:57:41.710306+0000","last_undegraded":"2023-10-09T07:57:41.710306+0000","last_fullsized":"2023-10-09T07:57:41.710306+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:02.361772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.714660+0000","last_change":"2023-10-09T07:57:41.709854+0000","last_active":"2023-10-09T07:57:41.714660+0000","last_peered":"2023-10-09T07:57:41.714660+0000","last_clean":"2023-10-09T07:57:41.714660+0000","last_became_active":"2023-10-09T07:57:41.709580+0000","last_became_peered":"2023-10-09T07:57:41.709580+0000","last_unstale":"2023-10-09T07:57:41.714660+0000","last_undegraded":"2023-10-09T07:57:41.714660+0000","last_fullsized":"2023-10-09T07:57:41.714660+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:40.405926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.703711+0000","last_change":"2023-10-09T07:57:41.701332+0000","last_active":"2023-10-09T07:57:41.703711+0000","last_peered":"2023-10-09T07:57:41.703711+0000","last_clean":"2023-10-09T07:57:41.703711+0000","last_became_active":"2023-10-09T07:57:41.701055+0000","last_became_peered":"2023-10-09T07:57:41.701055+0000","last_unstale":"2023-10-09T07:57:41.703711+0000","last_undegraded":"2023-10-09T07:57:41.703711+0000","last_fullsized":"2023-10-09T07:57:41.703711+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:33.150152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.711924+0000","last_change":"2023-10-09T07:57:41.710325+0000","last_active":"2023-10-09T07:57:41.711924+0000","last_peered":"2023-10-09T07:57:41.711924+0000","last_clean":"2023-10-09T07:57:41.711924+0000","last_became_active":"2023-10-09T07:57:41.710034+0000","last_became_peered":"2023-10-09T07:57:41.710034+0000","last_unstale":"2023-10-09T07:57:41.711924+0000","last_undegraded":"2023-10-09T07:57:41.711924+0000","last_fullsized":"2023-10-09T07:57:41.711924+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:03:31.621686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.732229+0000","last_change":"2023-10-09T07:57:41.730658+0000","last_active":"2023-10-09T07:57:41.732229+0000","last_peered":"2023-10-09T07:57:41.732229+0000","last_clean":"2023-10-09T07:57:41.732229+0000","last_became_active":"2023-10-09T07:57:41.730407+0000","last_became_peered":"2023-10-09T07:57:41.730407+0000","last_unstale":"2023-10-09T07:57:41.732229+0000","last_undegraded":"2023-10-09T07:57:41.732229+0000","last_fullsized":"2023-10-09T07:57:41.732229+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:14.993912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.709916+0000","last_change":"2023-10-09T07:57:41.705282+0000","last_active":"2023-10-09T07:57:41.709916+0000","last_peered":"2023-10-09T07:57:41.709916+0000","last_clean":"2023-10-09T07:57:41.709916+0000","last_became_active":"2023-10-09T07:57:41.704997+0000","last_became_peered":"2023-10-09T07:57:41.704997+0000","last_unstale":"2023-10-09T07:57:41.709916+0000","last_undegraded":"2023-10-09T07:57:41.709916+0000","last_fullsized":"2023-10-09T07:57:41.709916+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:27.117499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.717627+0000","last_change":"2023-10-09T07:57:41.715809+0000","last_active":"2023-10-09T07:57:41.717627+0000","last_peered":"2023-10-09T07:57:41.717627+0000","last_clean":"2023-10-09T07:57:41.717627+0000","last_became_active":"2023-10-09T07:57:41.715543+0000","last_became_peered":"2023-10-09T07:57:41.715543+0000","last_unstale":"2023-10-09T07:57:41.717627+0000","last_undegraded":"2023-10-09T07:57:41.717627+0000","last_fullsized":"2023-10-09T07:57:41.717627+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:41:01.313910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.723953+0000","last_change":"2023-10-09T07:57:41.716182+0000","last_active":"2023-10-09T07:57:41.723953+0000","last_peered":"2023-10-09T07:57:41.723953+0000","last_clean":"2023-10-09T07:57:41.723953+0000","last_became_active":"2023-10-09T07:57:41.715924+0000","last_became_peered":"2023-10-09T07:57:41.715924+0000","last_unstale":"2023-10-09T07:57:41.723953+0000","last_undegraded":"2023-10-09T07:57:41.723953+0000","last_fullsized":"2023-10-09T07:57:41.723953+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:03:21.703878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.723894+0000","last_change":"2023-10-09T07:57:41.715422+0000","last_active":"2023-10-09T07:57:41.723894+0000","last_peered":"2023-10-09T07:57:41.723894+0000","last_clean":"2023-10-09T07:57:41.723894+0000","last_became_active":"2023-10-09T07:57:41.715162+0000","last_became_peered":"2023-10-09T07:57:41.715162+0000","last_unstale":"2023-10-09T07:57:41.723894+0000","last_undegraded":"2023-10-09T07:57:41.723894+0000","last_fullsized":"2023-10-09T07:57:41.723894+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:25:46.680708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.732003+0000","last_change":"2023-10-09T07:57:41.729873+0000","last_active":"2023-10-09T07:57:41.732003+0000","last_peered":"2023-10-09T07:57:41.732003+0000","last_clean":"2023-10-09T07:57:41.732003+0000","last_became_active":"2023-10-09T07:57:41.729316+0000","last_became_peered":"2023-10-09T07:57:41.729316+0000","last_unstale":"2023-10-09T07:57:41.732003+0000","last_undegraded":"2023-10-09T07:57:41.732003+0000","last_fullsized":"2023-10-09T07:57:41.732003+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:28:41.640243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.718941+0000","last_change":"2023-10-09T07:57:41.716851+0000","last_active":"2023-10-09T07:57:41.718941+0000","last_peered":"2023-10-09T07:57:41.718941+0000","last_clean":"2023-10-09T07:57:41.718941+0000","last_became_active":"2023-10-09T07:57:41.716572+0000","last_became_peered":"2023-10-09T07:57:41.716572+0000","last_unstale":"2023-10-09T07:57:41.718941+0000","last_undegraded":"2023-10-09T07:57:41.718941+0000","last_fullsized":"2023-10-09T07:57:41.718941+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:07:01.487748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.718752+0000","last_change":"2023-10-09T07:57:41.714598+0000","last_active":"2023-10-09T07:57:41.718752+0000","last_peered":"2023-10-09T07:57:41.718752+0000","last_clean":"2023-10-09T07:57:41.718752+0000","last_became_active":"2023-10-09T07:57:41.714352+0000","last_became_peered":"2023-10-09T07:57:41.714352+0000","last_unstale":"2023-10-09T07:57:41.718752+0000","last_undegraded":"2023-10-09T07:57:41.718752+0000","last_fullsized":"2023-10-09T07:57:41.718752+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:20.867454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"162'4","reported_seq":14,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.731690+0000","last_change":"2023-10-09T07:57:40.714069+0000","last_active":"2023-10-09T07:57:41.731690+0000","last_peered":"2023-10-09T07:57:41.731690+0000","last_clean":"2023-10-09T07:57:41.731690+0000","last_became_active":"2023-10-09T07:57:40.713756+0000","last_became_peered":"2023-10-09T07:57:40.713756+0000","last_unstale":"2023-10-09T07:57:41.731690+0000","last_undegraded":"2023-10-09T07:57:41.731690+0000","last_fullsized":"2023-10-09T07:57:41.731690+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:19.857223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.715206+0000","last_change":"2023-10-09T07:57:41.712269+0000","last_active":"2023-10-09T07:57:41.715206+0000","last_peered":"2023-10-09T07:57:41.715206+0000","last_clean":"2023-10-09T07:57:41.715206+0000","last_became_active":"2023-10-09T07:57:41.711874+0000","last_became_peered":"2023-10-09T07:57:41.711874+0000","last_unstale":"2023-10-09T07:57:41.715206+0000","last_undegraded":"2023-10-09T07:57:41.715206+0000","last_fullsized":"2023-10-09T07:57:41.715206+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:34.255144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"162'1","reported_seq":11,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.729746+0000","last_change":"2023-10-09T07:57:40.708745+0000","last_active":"2023-10-09T07:57:41.729746+0000","last_peered":"2023-10-09T07:57:41.729746+0000","last_clean":"2023-10-09T07:57:41.729746+0000","last_became_active":"2023-10-09T07:57:40.708462+0000","last_became_peered":"2023-10-09T07:57:40.708462+0000","last_unstale":"2023-10-09T07:57:41.729746+0000","last_undegraded":"2023-10-09T07:57:41.729746+0000","last_fullsized":"2023-10-09T07:57:41.729746+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:20:20.409728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.713950+0000","last_change":"2023-10-09T07:57:41.707057+0000","last_active":"2023-10-09T07:57:41.713950+0000","last_peered":"2023-10-09T07:57:41.713950+0000","last_clean":"2023-10-09T07:57:41.713950+0000","last_became_active":"2023-10-09T07:57:41.706500+0000","last_became_peered":"2023-10-09T07:57:41.706500+0000","last_unstale":"2023-10-09T07:57:41.713950+0000","last_undegraded":"2023-10-09T07:57:41.713950+0000","last_fullsized":"2023-10-09T07:57:41.713950+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:10:46.275278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.725489+0000","last_change":"2023-10-09T07:57:40.702915+0000","last_active":"2023-10-09T07:57:41.725489+0000","last_peered":"2023-10-09T07:57:41.725489+0000","last_clean":"2023-10-09T07:57:41.725489+0000","last_became_active":"2023-10-09T07:57:40.702648+0000","last_became_peered":"2023-10-09T07:57:40.702648+0000","last_unstale":"2023-10-09T07:57:41.725489+0000","last_undegraded":"2023-10-09T07:57:41.725489+0000","last_fullsized":"2023-10-09T07:57:41.725489+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:38:00.181866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.714028+0000","last_change":"2023-10-09T07:57:41.711016+0000","last_active":"2023-10-09T07:57:41.714028+0000","last_peered":"2023-10-09T07:57:41.714028+0000","last_clean":"2023-10-09T07:57:41.714028+0000","last_became_active":"2023-10-09T07:57:41.710691+0000","last_became_peered":"2023-10-09T07:57:41.710691+0000","last_unstale":"2023-10-09T07:57:41.714028+0000","last_undegraded":"2023-10-09T07:57:41.714028+0000","last_fullsized":"2023-10-09T07:57:41.714028+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:00:42.357072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.728527+0000","last_change":"2023-10-09T07:57:40.705265+0000","last_active":"2023-10-09T07:57:41.728527+0000","last_peered":"2023-10-09T07:57:41.728527+0000","last_clean":"2023-10-09T07:57:41.728527+0000","last_became_active":"2023-10-09T07:57:40.705011+0000","last_became_peered":"2023-10-09T07:57:40.705011+0000","last_unstale":"2023-10-09T07:57:41.728527+0000","last_undegraded":"2023-10-09T07:57:41.728527+0000","last_fullsized":"2023-10-09T07:57:41.728527+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:13.582684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.718830+0000","last_change":"2023-10-09T07:57:41.713825+0000","last_active":"2023-10-09T07:57:41.718830+0000","last_peered":"2023-10-09T07:57:41.718830+0000","last_clean":"2023-10-09T07:57:41.718830+0000","last_became_active":"2023-10-09T07:57:41.713562+0000","last_became_peered":"2023-10-09T07:57:41.713562+0000","last_unstale":"2023-10-09T07:57:41.718830+0000","last_undegraded":"2023-10-09T07:57:41.718830+0000","last_fullsized":"2023-10-09T07:57:41.718830+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:40.405926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"162'1","reported_seq":11,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.730492+0000","last_change":"2023-10-09T07:57:40.702506+0000","last_active":"2023-10-09T07:57:41.730492+0000","last_peered":"2023-10-09T07:57:41.730492+0000","last_clean":"2023-10-09T07:57:41.730492+0000","last_became_active":"2023-10-09T07:57:40.702250+0000","last_became_peered":"2023-10-09T07:57:40.702250+0000","last_unstale":"2023-10-09T07:57:41.730492+0000","last_undegraded":"2023-10-09T07:57:41.730492+0000","last_fullsized":"2023-10-09T07:57:41.730492+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:48.793176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.706860+0000","last_change":"2023-10-09T07:57:41.703926+0000","last_active":"2023-10-09T07:57:41.706860+0000","last_peered":"2023-10-09T07:57:41.706860+0000","last_clean":"2023-10-09T07:57:41.706860+0000","last_became_active":"2023-10-09T07:57:41.703649+0000","last_became_peered":"2023-10-09T07:57:41.703649+0000","last_unstale":"2023-10-09T07:57:41.706860+0000","last_undegraded":"2023-10-09T07:57:41.706860+0000","last_fullsized":"2023-10-09T07:57:41.706860+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:31:29.093989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"162'1","reported_seq":11,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.730466+0000","last_change":"2023-10-09T07:57:40.699052+0000","last_active":"2023-10-09T07:57:41.730466+0000","last_peered":"2023-10-09T07:57:41.730466+0000","last_clean":"2023-10-09T07:57:41.730466+0000","last_became_active":"2023-10-09T07:57:40.698810+0000","last_became_peered":"2023-10-09T07:57:40.698810+0000","last_unstale":"2023-10-09T07:57:41.730466+0000","last_undegraded":"2023-10-09T07:57:41.730466+0000","last_fullsized":"2023-10-09T07:57:41.730466+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:42.240311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.721705+0000","last_change":"2023-10-09T07:57:41.720326+0000","last_active":"2023-10-09T07:57:41.721705+0000","last_peered":"2023-10-09T07:57:41.721705+0000","last_clean":"2023-10-09T07:57:41.721705+0000","last_became_active":"2023-10-09T07:57:41.720047+0000","last_became_peered":"2023-10-09T07:57:41.720047+0000","last_unstale":"2023-10-09T07:57:41.721705+0000","last_undegraded":"2023-10-09T07:57:41.721705+0000","last_fullsized":"2023-10-09T07:57:41.721705+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:56.824398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.695456+0000","last_change":"2023-10-09T07:57:40.705766+0000","last_active":"2023-10-09T07:57:41.695456+0000","last_peered":"2023-10-09T07:57:41.695456+0000","last_clean":"2023-10-09T07:57:41.695456+0000","last_became_active":"2023-10-09T07:57:40.705410+0000","last_became_peered":"2023-10-09T07:57:40.705410+0000","last_unstale":"2023-10-09T07:57:41.695456+0000","last_undegraded":"2023-10-09T07:57:41.695456+0000","last_fullsized":"2023-10-09T07:57:41.695456+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:12:06.525751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.722615+0000","last_change":"2023-10-09T07:57:41.720905+0000","last_active":"2023-10-09T07:57:41.722615+0000","last_peered":"2023-10-09T07:57:41.722615+0000","last_clean":"2023-10-09T07:57:41.722615+0000","last_became_active":"2023-10-09T07:57:41.720653+0000","last_became_peered":"2023-10-09T07:57:41.720653+0000","last_unstale":"2023-10-09T07:57:41.722615+0000","last_undegraded":"2023-10-09T07:57:41.722615+0000","last_fullsized":"2023-10-09T07:57:41.722615+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:20:21.419959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.699560+0000","last_change":"2023-10-09T07:57:40.709867+0000","last_active":"2023-10-09T07:57:41.699560+0000","last_peered":"2023-10-09T07:57:41.699560+0000","last_clean":"2023-10-09T07:57:41.699560+0000","last_became_active":"2023-10-09T07:57:40.709372+0000","last_became_peered":"2023-10-09T07:57:40.709372+0000","last_unstale":"2023-10-09T07:57:41.699560+0000","last_undegraded":"2023-10-09T07:57:41.699560+0000","last_fullsized":"2023-10-09T07:57:41.699560+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:38:54.719335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.725099+0000","last_change":"2023-10-09T07:57:41.719951+0000","last_active":"2023-10-09T07:57:41.725099+0000","last_peered":"2023-10-09T07:57:41.725099+0000","last_clean":"2023-10-09T07:57:41.725099+0000","last_became_active":"2023-10-09T07:57:41.719693+0000","last_became_peered":"2023-10-09T07:57:41.719693+0000","last_unstale":"2023-10-09T07:57:41.725099+0000","last_undegraded":"2023-10-09T07:57:41.725099+0000","last_fullsized":"2023-10-09T07:57:41.725099+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:22:57.702842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.696240+0000","last_change":"2023-10-09T07:57:40.703087+0000","last_active":"2023-10-09T07:57:41.696240+0000","last_peered":"2023-10-09T07:57:41.696240+0000","last_clean":"2023-10-09T07:57:41.696240+0000","last_became_active":"2023-10-09T07:57:40.702790+0000","last_became_peered":"2023-10-09T07:57:40.702790+0000","last_unstale":"2023-10-09T07:57:41.696240+0000","last_undegraded":"2023-10-09T07:57:41.696240+0000","last_fullsized":"2023-10-09T07:57:41.696240+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:10:05.981950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.718812+0000","last_change":"2023-10-09T07:57:41.716804+0000","last_active":"2023-10-09T07:57:41.718812+0000","last_peered":"2023-10-09T07:57:41.718812+0000","last_clean":"2023-10-09T07:57:41.718812+0000","last_became_active":"2023-10-09T07:57:41.716395+0000","last_became_peered":"2023-10-09T07:57:41.716395+0000","last_unstale":"2023-10-09T07:57:41.718812+0000","last_undegraded":"2023-10-09T07:57:41.718812+0000","last_fullsized":"2023-10-09T07:57:41.718812+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:43.250542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.710875+0000","last_change":"2023-10-09T07:57:40.709018+0000","last_active":"2023-10-09T07:57:41.710875+0000","last_peered":"2023-10-09T07:57:41.710875+0000","last_clean":"2023-10-09T07:57:41.710875+0000","last_became_active":"2023-10-09T07:57:40.708730+0000","last_became_peered":"2023-10-09T07:57:40.708730+0000","last_unstale":"2023-10-09T07:57:41.710875+0000","last_undegraded":"2023-10-09T07:57:41.710875+0000","last_fullsized":"2023-10-09T07:57:41.710875+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:26:00.505124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.720888+0000","last_change":"2023-10-09T07:57:41.720372+0000","last_active":"2023-10-09T07:57:41.720888+0000","last_peered":"2023-10-09T07:57:41.720888+0000","last_clean":"2023-10-09T07:57:41.720888+0000","last_became_active":"2023-10-09T07:57:41.719647+0000","last_became_peered":"2023-10-09T07:57:41.719647+0000","last_unstale":"2023-10-09T07:57:41.720888+0000","last_undegraded":"2023-10-09T07:57:41.720888+0000","last_fullsized":"2023-10-09T07:57:41.720888+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:30:00.712668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"162'3","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.732374+0000","last_change":"2023-10-09T07:57:40.705048+0000","last_active":"2023-10-09T07:57:41.732374+0000","last_peered":"2023-10-09T07:57:41.732374+0000","last_clean":"2023-10-09T07:57:41.732374+0000","last_became_active":"2023-10-09T07:57:40.704768+0000","last_became_peered":"2023-10-09T07:57:40.704768+0000","last_unstale":"2023-10-09T07:57:41.732374+0000","last_undegraded":"2023-10-09T07:57:41.732374+0000","last_fullsized":"2023-10-09T07:57:41.732374+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:24:26.536775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.716294+0000","last_change":"2023-10-09T07:57:41.712384+0000","last_active":"2023-10-09T07:57:41.716294+0000","last_peered":"2023-10-09T07:57:41.716294+0000","last_clean":"2023-10-09T07:57:41.716294+0000","last_became_active":"2023-10-09T07:57:41.711982+0000","last_became_peered":"2023-10-09T07:57:41.711982+0000","last_unstale":"2023-10-09T07:57:41.716294+0000","last_undegraded":"2023-10-09T07:57:41.716294+0000","last_fullsized":"2023-10-09T07:57:41.716294+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:26.135612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"162'6","reported_seq":16,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.733307+0000","last_change":"2023-10-09T07:57:40.710455+0000","last_active":"2023-10-09T07:57:41.733307+0000","last_peered":"2023-10-09T07:57:41.733307+0000","last_clean":"2023-10-09T07:57:41.733307+0000","last_became_active":"2023-10-09T07:57:40.710109+0000","last_became_peered":"2023-10-09T07:57:40.710109+0000","last_unstale":"2023-10-09T07:57:41.733307+0000","last_undegraded":"2023-10-09T07:57:41.733307+0000","last_fullsized":"2023-10-09T07:57:41.733307+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:55:27.158449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.725434+0000","last_change":"2023-10-09T07:57:41.723182+0000","last_active":"2023-10-09T07:57:41.725434+0000","last_peered":"2023-10-09T07:57:41.725434+0000","last_clean":"2023-10-09T07:57:41.725434+0000","last_became_active":"2023-10-09T07:57:41.722923+0000","last_became_peered":"2023-10-09T07:57:41.722923+0000","last_unstale":"2023-10-09T07:57:41.725434+0000","last_undegraded":"2023-10-09T07:57:41.725434+0000","last_fullsized":"2023-10-09T07:57:41.725434+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:14.840671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.700480+0000","last_change":"2023-10-09T07:57:40.703377+0000","last_active":"2023-10-09T07:57:41.700480+0000","last_peered":"2023-10-09T07:57:41.700480+0000","last_clean":"2023-10-09T07:57:41.700480+0000","last_became_active":"2023-10-09T07:57:40.703117+0000","last_became_peered":"2023-10-09T07:57:40.703117+0000","last_unstale":"2023-10-09T07:57:41.700480+0000","last_undegraded":"2023-10-09T07:57:41.700480+0000","last_fullsized":"2023-10-09T07:57:41.700480+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:02:40.132873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.714819+0000","last_change":"2023-10-09T07:57:41.713189+0000","last_active":"2023-10-09T07:57:41.714819+0000","last_peered":"2023-10-09T07:57:41.714819+0000","last_clean":"2023-10-09T07:57:41.714819+0000","last_became_active":"2023-10-09T07:57:41.712930+0000","last_became_peered":"2023-10-09T07:57:41.712930+0000","last_unstale":"2023-10-09T07:57:41.714819+0000","last_undegraded":"2023-10-09T07:57:41.714819+0000","last_fullsized":"2023-10-09T07:57:41.714819+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:24:27.547006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.699242+0000","last_change":"2023-10-09T07:57:40.712512+0000","last_active":"2023-10-09T07:57:41.699242+0000","last_peered":"2023-10-09T07:57:41.699242+0000","last_clean":"2023-10-09T07:57:41.699242+0000","last_became_active":"2023-10-09T07:57:40.712236+0000","last_became_peered":"2023-10-09T07:57:40.712236+0000","last_unstale":"2023-10-09T07:57:41.699242+0000","last_undegraded":"2023-10-09T07:57:41.699242+0000","last_fullsized":"2023-10-09T07:57:41.699242+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:40:16.530524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.715146+0000","last_change":"2023-10-09T07:57:41.711349+0000","last_active":"2023-10-09T07:57:41.715146+0000","last_peered":"2023-10-09T07:57:41.715146+0000","last_clean":"2023-10-09T07:57:41.715146+0000","last_became_active":"2023-10-09T07:57:41.711099+0000","last_became_peered":"2023-10-09T07:57:41.711099+0000","last_unstale":"2023-10-09T07:57:41.715146+0000","last_undegraded":"2023-10-09T07:57:41.715146+0000","last_fullsized":"2023-10-09T07:57:41.715146+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:03:20.867454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"162'8","reported_seq":18,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.732753+0000","last_change":"2023-10-09T07:57:40.706796+0000","last_active":"2023-10-09T07:57:41.732753+0000","last_peered":"2023-10-09T07:57:41.732753+0000","last_clean":"2023-10-09T07:57:41.732753+0000","last_became_active":"2023-10-09T07:57:40.706269+0000","last_became_peered":"2023-10-09T07:57:40.706269+0000","last_unstale":"2023-10-09T07:57:41.732753+0000","last_undegraded":"2023-10-09T07:57:41.732753+0000","last_fullsized":"2023-10-09T07:57:41.732753+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:26:00.505124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.714588+0000","last_change":"2023-10-09T07:57:41.711858+0000","last_active":"2023-10-09T07:57:41.714588+0000","last_peered":"2023-10-09T07:57:41.714588+0000","last_clean":"2023-10-09T07:57:41.714588+0000","last_became_active":"2023-10-09T07:57:41.711499+0000","last_became_peered":"2023-10-09T07:57:41.711499+0000","last_unstale":"2023-10-09T07:57:41.714588+0000","last_undegraded":"2023-10-09T07:57:41.714588+0000","last_fullsized":"2023-10-09T07:57:41.714588+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:57:29.926980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"162'1","reported_seq":11,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.728717+0000","last_change":"2023-10-09T07:57:40.710158+0000","last_active":"2023-10-09T07:57:41.728717+0000","last_peered":"2023-10-09T07:57:41.728717+0000","last_clean":"2023-10-09T07:57:41.728717+0000","last_became_active":"2023-10-09T07:57:40.709881+0000","last_became_peered":"2023-10-09T07:57:40.709881+0000","last_unstale":"2023-10-09T07:57:41.728717+0000","last_undegraded":"2023-10-09T07:57:41.728717+0000","last_fullsized":"2023-10-09T07:57:41.728717+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:33.964366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.705933+0000","last_change":"2023-10-09T07:57:41.705326+0000","last_active":"2023-10-09T07:57:41.705933+0000","last_peered":"2023-10-09T07:57:41.705933+0000","last_clean":"2023-10-09T07:57:41.705933+0000","last_became_active":"2023-10-09T07:57:41.705063+0000","last_became_peered":"2023-10-09T07:57:41.705063+0000","last_unstale":"2023-10-09T07:57:41.705933+0000","last_undegraded":"2023-10-09T07:57:41.705933+0000","last_fullsized":"2023-10-09T07:57:41.705933+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:53:55.693173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.723040+0000","last_change":"2023-10-09T07:57:40.708690+0000","last_active":"2023-10-09T07:57:41.723040+0000","last_peered":"2023-10-09T07:57:41.723040+0000","last_clean":"2023-10-09T07:57:41.723040+0000","last_became_active":"2023-10-09T07:57:40.708436+0000","last_became_peered":"2023-10-09T07:57:40.708436+0000","last_unstale":"2023-10-09T07:57:41.723040+0000","last_undegraded":"2023-10-09T07:57:41.723040+0000","last_fullsized":"2023-10-09T07:57:41.723040+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:13:40.202625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.722860+0000","last_change":"2023-10-09T07:57:41.720822+0000","last_active":"2023-10-09T07:57:41.722860+0000","last_peered":"2023-10-09T07:57:41.722860+0000","last_clean":"2023-10-09T07:57:41.722860+0000","last_became_active":"2023-10-09T07:57:41.720549+0000","last_became_peered":"2023-10-09T07:57:41.720549+0000","last_unstale":"2023-10-09T07:57:41.722860+0000","last_undegraded":"2023-10-09T07:57:41.722860+0000","last_fullsized":"2023-10-09T07:57:41.722860+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:57:29.926980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"162'1","reported_seq":11,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.732428+0000","last_change":"2023-10-09T07:57:40.703767+0000","last_active":"2023-10-09T07:57:41.732428+0000","last_peered":"2023-10-09T07:57:41.732428+0000","last_clean":"2023-10-09T07:57:41.732428+0000","last_became_active":"2023-10-09T07:57:40.703456+0000","last_became_peered":"2023-10-09T07:57:40.703456+0000","last_unstale":"2023-10-09T07:57:41.732428+0000","last_undegraded":"2023-10-09T07:57:41.732428+0000","last_fullsized":"2023-10-09T07:57:41.732428+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:56:49.351995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.724918+0000","last_change":"2023-10-09T07:57:41.721465+0000","last_active":"2023-10-09T07:57:41.724918+0000","last_peered":"2023-10-09T07:57:41.724918+0000","last_clean":"2023-10-09T07:57:41.724918+0000","last_became_active":"2023-10-09T07:57:41.721219+0000","last_became_peered":"2023-10-09T07:57:41.721219+0000","last_unstale":"2023-10-09T07:57:41.724918+0000","last_undegraded":"2023-10-09T07:57:41.724918+0000","last_fullsized":"2023-10-09T07:57:41.724918+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:31.293225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.695703+0000","last_change":"2023-10-09T07:57:40.706429+0000","last_active":"2023-10-09T07:57:41.695703+0000","last_peered":"2023-10-09T07:57:41.695703+0000","last_clean":"2023-10-09T07:57:41.695703+0000","last_became_active":"2023-10-09T07:57:40.706190+0000","last_became_peered":"2023-10-09T07:57:40.706190+0000","last_unstale":"2023-10-09T07:57:41.695703+0000","last_undegraded":"2023-10-09T07:57:41.695703+0000","last_fullsized":"2023-10-09T07:57:41.695703+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:03:30.611455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.710062+0000","last_change":"2023-10-09T07:57:41.706326+0000","last_active":"2023-10-09T07:57:41.710062+0000","last_peered":"2023-10-09T07:57:41.710062+0000","last_clean":"2023-10-09T07:57:41.710062+0000","last_became_active":"2023-10-09T07:57:41.705955+0000","last_became_peered":"2023-10-09T07:57:41.705955+0000","last_unstale":"2023-10-09T07:57:41.710062+0000","last_undegraded":"2023-10-09T07:57:41.710062+0000","last_fullsized":"2023-10-09T07:57:41.710062+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:03:01.850852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.731576+0000","last_change":"2023-10-09T07:57:40.703372+0000","last_active":"2023-10-09T07:57:41.731576+0000","last_peered":"2023-10-09T07:57:41.731576+0000","last_clean":"2023-10-09T07:57:41.731576+0000","last_became_active":"2023-10-09T07:57:40.702699+0000","last_became_peered":"2023-10-09T07:57:40.702699+0000","last_unstale":"2023-10-09T07:57:41.731576+0000","last_undegraded":"2023-10-09T07:57:41.731576+0000","last_fullsized":"2023-10-09T07:57:41.731576+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:17:23.252488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.717692+0000","last_change":"2023-10-09T07:57:41.715402+0000","last_active":"2023-10-09T07:57:41.717692+0000","last_peered":"2023-10-09T07:57:41.717692+0000","last_clean":"2023-10-09T07:57:41.717692+0000","last_became_active":"2023-10-09T07:57:41.715141+0000","last_became_peered":"2023-10-09T07:57:41.715141+0000","last_unstale":"2023-10-09T07:57:41.717692+0000","last_undegraded":"2023-10-09T07:57:41.717692+0000","last_fullsized":"2023-10-09T07:57:41.717692+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:20:21.419959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.704271+0000","last_change":"2023-10-09T07:57:40.702948+0000","last_active":"2023-10-09T07:57:41.704271+0000","last_peered":"2023-10-09T07:57:41.704271+0000","last_clean":"2023-10-09T07:57:41.704271+0000","last_became_active":"2023-10-09T07:57:40.702709+0000","last_became_peered":"2023-10-09T07:57:40.702709+0000","last_unstale":"2023-10-09T07:57:41.704271+0000","last_undegraded":"2023-10-09T07:57:41.704271+0000","last_fullsized":"2023-10-09T07:57:41.704271+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:55:27.158449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.716324+0000","last_change":"2023-10-09T07:57:41.713694+0000","last_active":"2023-10-09T07:57:41.716324+0000","last_peered":"2023-10-09T07:57:41.716324+0000","last_clean":"2023-10-09T07:57:41.716324+0000","last_became_active":"2023-10-09T07:57:41.713360+0000","last_became_peered":"2023-10-09T07:57:41.713360+0000","last_unstale":"2023-10-09T07:57:41.716324+0000","last_undegraded":"2023-10-09T07:57:41.716324+0000","last_fullsized":"2023-10-09T07:57:41.716324+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:07:01.487748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.702743+0000","last_change":"2023-10-09T07:57:40.701038+0000","last_active":"2023-10-09T07:57:41.702743+0000","last_peered":"2023-10-09T07:57:41.702743+0000","last_clean":"2023-10-09T07:57:41.702743+0000","last_became_active":"2023-10-09T07:57:40.700766+0000","last_became_peered":"2023-10-09T07:57:40.700766+0000","last_unstale":"2023-10-09T07:57:41.702743+0000","last_undegraded":"2023-10-09T07:57:41.702743+0000","last_fullsized":"2023-10-09T07:57:41.702743+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:04.363976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.731980+0000","last_change":"2023-10-09T07:57:41.729500+0000","last_active":"2023-10-09T07:57:41.731980+0000","last_peered":"2023-10-09T07:57:41.731980+0000","last_clean":"2023-10-09T07:57:41.731980+0000","last_became_active":"2023-10-09T07:57:41.729182+0000","last_became_peered":"2023-10-09T07:57:41.729182+0000","last_unstale":"2023-10-09T07:57:41.731980+0000","last_undegraded":"2023-10-09T07:57:41.731980+0000","last_fullsized":"2023-10-09T07:57:41.731980+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:34:42.877540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.694520+0000","last_change":"2023-10-09T07:57:40.706333+0000","last_active":"2023-10-09T07:57:41.694520+0000","last_peered":"2023-10-09T07:57:41.694520+0000","last_clean":"2023-10-09T07:57:41.694520+0000","last_became_active":"2023-10-09T07:57:40.706065+0000","last_became_peered":"2023-10-09T07:57:40.706065+0000","last_unstale":"2023-10-09T07:57:41.694520+0000","last_undegraded":"2023-10-09T07:57:41.694520+0000","last_fullsized":"2023-10-09T07:57:41.694520+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:30:08.439237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.706771+0000","last_change":"2023-10-09T07:57:41.704870+0000","last_active":"2023-10-09T07:57:41.706771+0000","last_peered":"2023-10-09T07:57:41.706771+0000","last_clean":"2023-10-09T07:57:41.706771+0000","last_became_active":"2023-10-09T07:57:41.702234+0000","last_became_peered":"2023-10-09T07:57:41.702234+0000","last_unstale":"2023-10-09T07:57:41.706771+0000","last_undegraded":"2023-10-09T07:57:41.706771+0000","last_fullsized":"2023-10-09T07:57:41.706771+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:21:54.925226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.731563+0000","last_change":"2023-10-09T07:57:40.708157+0000","last_active":"2023-10-09T07:57:41.731563+0000","last_peered":"2023-10-09T07:57:41.731563+0000","last_clean":"2023-10-09T07:57:41.731563+0000","last_became_active":"2023-10-09T07:57:40.707886+0000","last_became_peered":"2023-10-09T07:57:40.707886+0000","last_unstale":"2023-10-09T07:57:41.731563+0000","last_undegraded":"2023-10-09T07:57:41.731563+0000","last_fullsized":"2023-10-09T07:57:41.731563+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:26.982485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.724509+0000","last_change":"2023-10-09T07:57:41.717479+0000","last_active":"2023-10-09T07:57:41.724509+0000","last_peered":"2023-10-09T07:57:41.724509+0000","last_clean":"2023-10-09T07:57:41.724509+0000","last_became_active":"2023-10-09T07:57:41.716849+0000","last_became_peered":"2023-10-09T07:57:41.716849+0000","last_unstale":"2023-10-09T07:57:41.724509+0000","last_undegraded":"2023-10-09T07:57:41.724509+0000","last_fullsized":"2023-10-09T07:57:41.724509+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:35.354061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"163'1","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T07:57:42.834428+0000","last_change":"2023-10-09T07:57:40.713610+0000","last_active":"2023-10-09T07:57:42.834428+0000","last_peered":"2023-10-09T07:57:42.834428+0000","last_clean":"2023-10-09T07:57:42.834428+0000","last_became_active":"2023-10-09T07:57:40.713277+0000","last_became_peered":"2023-10-09T07:57:40.713277+0000","last_unstale":"2023-10-09T07:57:42.834428+0000","last_undegraded":"2023-10-09T07:57:42.834428+0000","last_fullsized":"2023-10-09T07:57:42.834428+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:34:55.814167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.713737+0000","last_change":"2023-10-09T07:57:41.712630+0000","last_active":"2023-10-09T07:57:41.713737+0000","last_peered":"2023-10-09T07:57:41.713737+0000","last_clean":"2023-10-09T07:57:41.713737+0000","last_became_active":"2023-10-09T07:57:41.712342+0000","last_became_peered":"2023-10-09T07:57:41.712342+0000","last_unstale":"2023-10-09T07:57:41.713737+0000","last_undegraded":"2023-10-09T07:57:41.713737+0000","last_fullsized":"2023-10-09T07:57:41.713737+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:17:24.262719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.700711+0000","last_change":"2023-10-09T07:57:40.708979+0000","last_active":"2023-10-09T07:57:41.700711+0000","last_peered":"2023-10-09T07:57:41.700711+0000","last_clean":"2023-10-09T07:57:41.700711+0000","last_became_active":"2023-10-09T07:57:40.708744+0000","last_became_peered":"2023-10-09T07:57:40.708744+0000","last_unstale":"2023-10-09T07:57:41.700711+0000","last_undegraded":"2023-10-09T07:57:41.700711+0000","last_fullsized":"2023-10-09T07:57:41.700711+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:54:04.419888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.714595+0000","last_change":"2023-10-09T07:57:41.709721+0000","last_active":"2023-10-09T07:57:41.714595+0000","last_peered":"2023-10-09T07:57:41.714595+0000","last_clean":"2023-10-09T07:57:41.714595+0000","last_became_active":"2023-10-09T07:57:41.709137+0000","last_became_peered":"2023-10-09T07:57:41.709137+0000","last_unstale":"2023-10-09T07:57:41.714595+0000","last_undegraded":"2023-10-09T07:57:41.714595+0000","last_fullsized":"2023-10-09T07:57:41.714595+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:24:27.547006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.694719+0000","last_change":"2023-10-09T07:57:40.703859+0000","last_active":"2023-10-09T07:57:41.694719+0000","last_peered":"2023-10-09T07:57:41.694719+0000","last_clean":"2023-10-09T07:57:41.694719+0000","last_became_active":"2023-10-09T07:57:40.703554+0000","last_became_peered":"2023-10-09T07:57:40.703554+0000","last_unstale":"2023-10-09T07:57:41.694719+0000","last_undegraded":"2023-10-09T07:57:41.694719+0000","last_fullsized":"2023-10-09T07:57:41.694719+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:58.084800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.713995+0000","last_change":"2023-10-09T07:57:41.709242+0000","last_active":"2023-10-09T07:57:41.713995+0000","last_peered":"2023-10-09T07:57:41.713995+0000","last_clean":"2023-10-09T07:57:41.713995+0000","last_became_active":"2023-10-09T07:57:41.706942+0000","last_became_peered":"2023-10-09T07:57:41.706942+0000","last_unstale":"2023-10-09T07:57:41.713995+0000","last_undegraded":"2023-10-09T07:57:41.713995+0000","last_fullsized":"2023-10-09T07:57:41.713995+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:10:00.444011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.697912+0000","last_change":"2023-10-09T07:57:40.712458+0000","last_active":"2023-10-09T07:57:41.697912+0000","last_peered":"2023-10-09T07:57:41.697912+0000","last_clean":"2023-10-09T07:57:41.697912+0000","last_became_active":"2023-10-09T07:57:40.712180+0000","last_became_peered":"2023-10-09T07:57:40.712180+0000","last_unstale":"2023-10-09T07:57:41.697912+0000","last_undegraded":"2023-10-09T07:57:41.697912+0000","last_fullsized":"2023-10-09T07:57:41.697912+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:49.504100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.709101+0000","last_change":"2023-10-09T07:57:41.707947+0000","last_active":"2023-10-09T07:57:41.709101+0000","last_peered":"2023-10-09T07:57:41.709101+0000","last_clean":"2023-10-09T07:57:41.709101+0000","last_became_active":"2023-10-09T07:57:41.707062+0000","last_became_peered":"2023-10-09T07:57:41.707062+0000","last_unstale":"2023-10-09T07:57:41.709101+0000","last_undegraded":"2023-10-09T07:57:41.709101+0000","last_fullsized":"2023-10-09T07:57:41.709101+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:59.145208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.703882+0000","last_change":"2023-10-09T07:57:40.712238+0000","last_active":"2023-10-09T07:57:41.703882+0000","last_peered":"2023-10-09T07:57:41.703882+0000","last_clean":"2023-10-09T07:57:41.703882+0000","last_became_active":"2023-10-09T07:57:40.711950+0000","last_became_peered":"2023-10-09T07:57:40.711950+0000","last_unstale":"2023-10-09T07:57:41.703882+0000","last_undegraded":"2023-10-09T07:57:41.703882+0000","last_fullsized":"2023-10-09T07:57:41.703882+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:13.983681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.720069+0000","last_change":"2023-10-09T07:57:41.717075+0000","last_active":"2023-10-09T07:57:41.720069+0000","last_peered":"2023-10-09T07:57:41.720069+0000","last_clean":"2023-10-09T07:57:41.720069+0000","last_became_active":"2023-10-09T07:57:41.716822+0000","last_became_peered":"2023-10-09T07:57:41.716822+0000","last_unstale":"2023-10-09T07:57:41.720069+0000","last_undegraded":"2023-10-09T07:57:41.720069+0000","last_fullsized":"2023-10-09T07:57:41.720069+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:37:41.304881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.702813+0000","last_change":"2023-10-09T07:57:40.703705+0000","last_active":"2023-10-09T07:57:41.702813+0000","last_peered":"2023-10-09T07:57:41.702813+0000","last_clean":"2023-10-09T07:57:41.702813+0000","last_became_active":"2023-10-09T07:57:40.703459+0000","last_became_peered":"2023-10-09T07:57:40.703459+0000","last_unstale":"2023-10-09T07:57:41.702813+0000","last_undegraded":"2023-10-09T07:57:41.702813+0000","last_fullsized":"2023-10-09T07:57:41.702813+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:20:20.044507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.724731+0000","last_change":"2023-10-09T07:57:41.721873+0000","last_active":"2023-10-09T07:57:41.724731+0000","last_peered":"2023-10-09T07:57:41.724731+0000","last_clean":"2023-10-09T07:57:41.724731+0000","last_became_active":"2023-10-09T07:57:41.721618+0000","last_became_peered":"2023-10-09T07:57:41.721618+0000","last_unstale":"2023-10-09T07:57:41.724731+0000","last_undegraded":"2023-10-09T07:57:41.724731+0000","last_fullsized":"2023-10-09T07:57:41.724731+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:10:06.992181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.694634+0000","last_change":"2023-10-09T07:57:40.701414+0000","last_active":"2023-10-09T07:57:41.694634+0000","last_peered":"2023-10-09T07:57:41.694634+0000","last_clean":"2023-10-09T07:57:41.694634+0000","last_became_active":"2023-10-09T07:57:40.701089+0000","last_became_peered":"2023-10-09T07:57:40.701089+0000","last_unstale":"2023-10-09T07:57:41.694634+0000","last_undegraded":"2023-10-09T07:57:41.694634+0000","last_fullsized":"2023-10-09T07:57:41.694634+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:58:10.965338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.731983+0000","last_change":"2023-10-09T07:57:41.729655+0000","last_active":"2023-10-09T07:57:41.731983+0000","last_peered":"2023-10-09T07:57:41.731983+0000","last_clean":"2023-10-09T07:57:41.731983+0000","last_became_active":"2023-10-09T07:57:41.729138+0000","last_became_peered":"2023-10-09T07:57:41.729138+0000","last_unstale":"2023-10-09T07:57:41.731983+0000","last_undegraded":"2023-10-09T07:57:41.731983+0000","last_fullsized":"2023-10-09T07:57:41.731983+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:40.681192+0000","last_clean_scrub_stamp":"2023-10-09T07:57:40.681192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:25:31.318971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.729351+0000","last_change":"2023-10-09T07:57:40.711713+0000","last_active":"2023-10-09T07:57:41.729351+0000","last_peered":"2023-10-09T07:57:41.729351+0000","last_clean":"2023-10-09T07:57:41.729351+0000","last_became_active":"2023-10-09T07:57:40.711394+0000","last_became_peered":"2023-10-09T07:57:40.711394+0000","last_unstale":"2023-10-09T07:57:41.729351+0000","last_undegraded":"2023-10-09T07:57:41.729351+0000","last_fullsized":"2023-10-09T07:57:41.729351+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:57:39.670961+0000","last_clean_scrub_stamp":"2023-10-09T07:57:39.670961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:39.395694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"152'271","reported_seq":832,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-09T07:57:41.701037+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T07:57:41.701037+0000","last_peered":"2023-10-09T07:57:41.701037+0000","last_clean":"2023-10-09T07:57:41.701037+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T07:57:41.701037+0000","last_undegraded":"2023-10-09T07:57:41.701037+0000","last_fullsized":"2023-10-09T07:57:41.701037+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575745,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308064,"kb_used_data":2584,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063776,"statfs":{"total":96636764160,"available":96321306624,"internally_reserved":0,"allocated":2646016,"data_stored":1605086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.751,"15min":0.755},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1,"5min":1.016,"15min":1.127},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.47399999999999998},"max":{"1min":1.0029999999999999,"5min":1.026,"15min":1.1319999999999999},"last":0.98099999999999998}]},{"osd":1,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.74099999999999999,"15min":0.73799999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.46000000000000002},"max":{"1min":0.94199999999999995,"5min":1.002,"15min":1.077},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75,"15min":0.752},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.47399999999999998},"max":{"1min":0.95099999999999996,"5min":0.997,"15min":1.038},"last":0.82999999999999996}]},{"osd":2,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.50600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.94899999999999995,"5min":1.016,"15min":1.0269999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.76600000000000001,"15min":0.76800000000000002},"min":{"1min":0.59699999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96599999999999997,"5min":0.98299999999999998,"15min":1.1899999999999999},"last":0.81000000000000005}]},{"osd":3,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.52700000000000002,"5min":0.49399999999999999,"15min":0.42099999999999999},"max":{"1min":0.995,"5min":0.995,"15min":1.04},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78900000000000003,"15min":0.79400000000000004},"min":{"1min":0.66100000000000003,"5min":0.55900000000000005,"15min":0.54400000000000004},"max":{"1min":1.0249999999999999,"5min":1.0529999999999999,"15min":1.0920000000000001},"last":1.0169999999999999}]},{"osd":4,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63400000000000001,"15min":0.62},"min":{"1min":0.433,"5min":0.42199999999999999,"15min":0.36299999999999999},"max":{"1min":0.85299999999999998,"5min":0.97099999999999997,"15min":1.248},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92500000000000004,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.93700000000000006}]},{"osd":5,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.434,"5min":0.41299999999999998,"15min":0.38700000000000001},"max":{"1min":0.874,"5min":0.98299999999999998,"15min":1.0600000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68600000000000005,"15min":0.69099999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92400000000000004,"5min":1.0009999999999999,"15min":1.304},"last":1.038}]},{"osd":6,"last update":"Mon Oct 9 07:57:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.746,"15min":0.748},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89900000000000002,"5min":1.069,"15min":1.405},"last":1.103},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.43099999999999999},"max":{"1min":0.96799999999999997,"5min":1.075,"15min":1.377},"last":1.0880000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575744,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311568,"kb_used_data":1992,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060272,"statfs":{"total":96636764160,"available":96317718528,"internally_reserved":0,"allocated":2039808,"data_stored":1014108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77300000000000002,"15min":0.754},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.33600000000000002},"max":{"1min":0.88100000000000001,"5min":0.98399999999999999,"15min":1.012},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.55500000000000005,"5min":0.53900000000000003,"15min":0.49399999999999999},"max":{"1min":1.0049999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.79000000000000004}]},{"osd":1,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77700000000000002,"15min":0.77000000000000002},"min":{"1min":0.69099999999999995,"5min":0.53300000000000003,"15min":0.48199999999999998},"max":{"1min":0.93500000000000005,"5min":1.113,"15min":1.2769999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.78800000000000003,"15min":0.77000000000000002},"min":{"1min":0.59899999999999998,"5min":0.55400000000000005,"15min":0.501},"max":{"1min":0.98899999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.81499999999999995}]},{"osd":2,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.77800000000000002,"15min":0.76000000000000001},"min":{"1min":0.57199999999999995,"5min":0.46100000000000002,"15min":0.432},"max":{"1min":0.88400000000000001,"5min":1.075,"15min":1.075},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80300000000000005,"15min":0.78100000000000003},"min":{"1min":0.63200000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95699999999999996,"5min":1.151,"15min":1.151},"last":0.69499999999999995}]},{"osd":3,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76800000000000002,"15min":0.75800000000000001},"min":{"1min":0.56100000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.877,"5min":1.423,"15min":1.423},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79400000000000004,"15min":0.78500000000000003},"min":{"1min":0.624,"5min":0.55500000000000005,"15min":0.54100000000000004},"max":{"1min":1.0269999999999999,"5min":1.335,"15min":1.335},"last":0.95099999999999996}]},{"osd":4,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.45800000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88900000000000001,"5min":0.98099999999999998,"15min":1.1279999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65500000000000003,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.89700000000000002,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.91500000000000004}]},{"osd":5,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97199999999999998,"5min":1.306,"15min":1.306},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70899999999999996,"15min":0.69899999999999995},"min":{"1min":0.55500000000000005,"5min":0.45400000000000001,"15min":0.42699999999999999},"max":{"1min":0.95199999999999996,"5min":1.054,"15min":1.085},"last":0.85899999999999999}]},{"osd":7,"last update":"Mon Oct 9 07:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.47699999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.80800000000000005,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.54400000000000004,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97399999999999998,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.0980000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575745,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303364,"kb_used_data":1980,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068476,"statfs":{"total":96636764160,"available":96326119424,"internally_reserved":0,"allocated":2027520,"data_stored":1012572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48499999999999999,"15min":0.46800000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.308},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.52400000000000002,"15min":0.50700000000000001},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.313},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.57199999999999995}]},{"osd":2,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.54800000000000004,"15min":0.51700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32900000000000001},"max":{"1min":5.1159999999999997,"5min":5.1159999999999997,"15min":5.1159999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.63600000000000001,"15min":0.59599999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.375},"max":{"1min":5.399,"5min":5.399,"15min":5.399},"last":0.55200000000000005}]},{"osd":3,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.63900000000000001,"15min":0.63600000000000001},"min":{"1min":0.42999999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.41699999999999998,"5min":0.39900000000000002,"15min":0.37},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.51400000000000001}]},{"osd":4,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.83899999999999997,"15min":0.80800000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.42699999999999999},"max":{"1min":5.2409999999999997,"5min":5.2409999999999997,"15min":5.2409999999999997},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.86599999999999999,"15min":0.82699999999999996},"min":{"1min":0.65700000000000003,"5min":0.622,"15min":0.56699999999999995},"max":{"1min":5.4409999999999998,"5min":5.4409999999999998,"15min":5.4409999999999998},"last":0.76700000000000002}]},{"osd":5,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.81499999999999995,"15min":0.81100000000000005},"min":{"1min":0.64000000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.85499999999999998,"15min":0.82499999999999996},"min":{"1min":0.60299999999999998,"5min":0.57999999999999996,"15min":0.442},"max":{"1min":5.1630000000000003,"5min":5.1630000000000003,"15min":5.1630000000000003},"last":0.87}]},{"osd":6,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.89300000000000002,"15min":0.84499999999999997},"min":{"1min":0.65300000000000002,"5min":0.63900000000000001,"15min":0.55100000000000005},"max":{"1min":5.4749999999999996,"5min":5.4749999999999996,"15min":5.4749999999999996},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83499999999999996,"15min":0.82999999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.95399999999999996}]},{"osd":7,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.56000000000000005},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.046},{"interface":"front","average":{"1min":1.081,"5min":0.92800000000000005,"15min":0.88500000000000001},"min":{"1min":0.66500000000000004,"5min":0.63,"15min":0.55300000000000005},"max":{"1min":5.2009999999999996,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":0.96799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575744,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303944,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067896,"statfs":{"total":96636764160,"available":96325525504,"internally_reserved":0,"allocated":2621440,"data_stored":1602940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.49399999999999999,"15min":0.47799999999999998},"min":{"1min":0.37,"5min":0.29999999999999999,"15min":0.28799999999999998},"max":{"1min":0.69599999999999995,"5min":0.72099999999999997,"15min":0.86499999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32000000000000001},"max":{"1min":0.70599999999999996,"5min":0.82999999999999996,"15min":0.88200000000000001},"last":0.35299999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.39800000000000002,"5min":0.38200000000000001,"15min":0.36799999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.91800000000000004},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.374,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66800000000000004,"5min":0.78700000000000003,"15min":0.82399999999999995},"last":0.42299999999999999}]},{"osd":3,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.373},"max":{"1min":0.73199999999999998,"5min":0.84299999999999997,"15min":0.98599999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.61799999999999999,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86899999999999999,"5min":0.89600000000000002,"15min":0.94699999999999995},"last":0.441}]},{"osd":4,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.64800000000000002,"5min":0.57799999999999996,"15min":0.52200000000000002},"max":{"1min":0.98499999999999999,"5min":1.1699999999999999,"15min":1.532},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82799999999999996,"15min":0.81899999999999995},"min":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.54200000000000004},"max":{"1min":1.0920000000000001,"5min":1.1339999999999999,"15min":1.2470000000000001},"last":0.84899999999999998}]},{"osd":5,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.80200000000000005,"15min":0.79700000000000004},"min":{"1min":0.59799999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0349999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.67200000000000004,"5min":0.59699999999999998,"15min":0.55500000000000005},"max":{"1min":1.1100000000000001,"5min":1.296,"15min":1.3009999999999999},"last":0.73799999999999999}]},{"osd":6,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.85699999999999998,"15min":0.83999999999999997},"min":{"1min":0.67100000000000004,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.048,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.81999999999999995,"15min":0.81899999999999995},"min":{"1min":0.59499999999999997,"5min":0.57699999999999996,"15min":0.51400000000000001},"max":{"1min":1.131,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.748}]},{"osd":7,"last update":"Mon Oct 9 07:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.84699999999999998,"15min":0.85499999999999998},"min":{"1min":0.626,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":1.1020000000000001,"5min":1.246,"15min":1.3380000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.88800000000000001,"15min":0.86899999999999999},"min":{"1min":0.70199999999999996,"5min":0.61899999999999999,"15min":0.54400000000000004},"max":{"1min":1.1559999999999999,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.873}]}]},{"osd":2,"up_from":13,"seq":55834575744,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311564,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060276,"statfs":{"total":96636764160,"available":96317722624,"internally_reserved":0,"allocated":2035712,"data_stored":1013160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.46899999999999997},"min":{"1min":0.33800000000000002,"5min":0.309,"15min":0.30199999999999999},"max":{"1min":0.71299999999999997,"5min":0.72099999999999997,"15min":0.84999999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.36499999999999999,"5min":0.35599999999999998,"15min":0.316},"max":{"1min":0.65700000000000003,"5min":0.76100000000000001,"15min":0.85599999999999998},"last":0.622}]},{"osd":1,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.35799999999999998,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.65000000000000002,"5min":0.68000000000000005,"15min":0.85399999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53600000000000003},"min":{"1min":0.41099999999999998,"5min":0.39400000000000002,"15min":0.34599999999999997},"max":{"1min":0.71799999999999997,"5min":0.78200000000000003,"15min":0.98699999999999999},"last":0.42399999999999999}]},{"osd":3,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.47899999999999998,"5min":0.46600000000000003,"15min":0.41399999999999998},"max":{"1min":0.77600000000000002,"5min":0.79900000000000004,"15min":0.95199999999999996},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.49399999999999999,"5min":0.44500000000000001,"15min":0.40999999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.95099999999999996},"last":0.51000000000000001}]},{"osd":4,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79900000000000004,"15min":0.79600000000000004},"min":{"1min":0.58599999999999997,"5min":0.56299999999999994,"15min":0.54500000000000004},"max":{"1min":1.147,"5min":1.196,"15min":1.202},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.78600000000000003,"15min":0.78100000000000003},"min":{"1min":0.56200000000000006,"5min":0.54000000000000004,"15min":0.47799999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.141},"last":0.79100000000000004}]},{"osd":5,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81999999999999995,"15min":0.79200000000000004},"min":{"1min":0.63200000000000001,"5min":0.60799999999999998,"15min":0.57199999999999995},"max":{"1min":1.0489999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.82399999999999995,"15min":0.81499999999999995},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0640000000000001,"5min":1.254,"15min":1.254},"last":0.77200000000000002}]},{"osd":6,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82499999999999996,"15min":0.81000000000000005},"min":{"1min":0.63,"5min":0.56999999999999995,"15min":0.48099999999999998},"max":{"1min":1.0980000000000001,"5min":1.1639999999999999,"15min":1.296},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83399999999999996,"15min":0.81999999999999995},"min":{"1min":0.60399999999999998,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1000000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.754}]},{"osd":7,"last update":"Mon Oct 9 07:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.84499999999999997,"15min":0.83499999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.53600000000000003},"max":{"1min":1.1719999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":1.004},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89700000000000002,"15min":0.874},"min":{"1min":0.73799999999999999,"5min":0.66500000000000004,"15min":0.65300000000000002},"max":{"1min":1.157,"5min":1.298,"15min":1.298},"last":1.0189999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575745,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311564,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060276,"statfs":{"total":96636764160,"available":96317722624,"internally_reserved":0,"allocated":2035712,"data_stored":1012732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.47399999999999998,"15min":0.48499999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63700000000000001,"5min":0.77100000000000002,"15min":0.80700000000000005},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.32300000000000001},"max":{"1min":0.76400000000000001,"5min":0.85399999999999998,"15min":0.91700000000000004},"last":0.50700000000000001}]},{"osd":1,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48299999999999998,"15min":0.498},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.84699999999999998},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80100000000000005,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.57499999999999996}]},{"osd":2,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57699999999999996,"15min":0.58999999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.34999999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.90900000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.40899999999999997},"max":{"1min":0.81299999999999994,"5min":0.83799999999999997,"15min":0.95799999999999996},"last":0.66900000000000004}]},{"osd":4,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.77100000000000002,"15min":0.77400000000000002},"min":{"1min":0.55500000000000005,"5min":0.55000000000000004,"15min":0.47499999999999998},"max":{"1min":1.03,"5min":1.121,"15min":1.246},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.85099999999999998,"15min":0.85299999999999998},"min":{"1min":0.63800000000000001,"5min":0.629,"15min":0.57799999999999996},"max":{"1min":1.0780000000000001,"5min":1.1419999999999999,"15min":1.157},"last":0.749}]},{"osd":5,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.76200000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.48499999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.1910000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.48899999999999999},"max":{"1min":1.073,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.85799999999999998}]},{"osd":6,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80200000000000005,"15min":0.79700000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.495},"max":{"1min":1.05,"5min":1.149,"15min":1.149},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.80900000000000005,"15min":0.81299999999999994},"min":{"1min":0.59299999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.099,"5min":1.103,"15min":1.2230000000000001},"last":0.71099999999999997}]},{"osd":7,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84499999999999997,"15min":0.84799999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.53100000000000003},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.2430000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.85199999999999998,"15min":0.85099999999999998},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.56699999999999995},"max":{"1min":1.181,"5min":1.181,"15min":1.1850000000000001},"last":0.90500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575744,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315656,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056184,"statfs":{"total":96636764160,"available":96313532416,"internally_reserved":0,"allocated":2031616,"data_stored":1012642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90300000000000002,"5min":0.97499999999999998,"15min":1.0700000000000001},"last":0.754},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.73999999999999999,"15min":0.754},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77500000000000002,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.65200000000000002}]},{"osd":1,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.73599999999999999,"15min":0.73099999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97799999999999998,"5min":1.038,"15min":1.0640000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.73799999999999999,"15min":0.74099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.81299999999999994,"5min":1.028,"15min":1.038},"last":0.69799999999999995}]},{"osd":2,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.79400000000000004,"15min":0.78700000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88200000000000001,"5min":0.999,"15min":1.0509999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79500000000000004,"15min":0.79700000000000004},"min":{"1min":0.60399999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.94099999999999995,"5min":1.069,"15min":1.069},"last":0.71599999999999997}]},{"osd":3,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.76000000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91800000000000004,"5min":1.131,"15min":1.131},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.014,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.61499999999999999}]},{"osd":5,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61599999999999999,"15min":0.59399999999999997},"min":{"1min":0.438,"5min":0.372,"15min":0.36299999999999999},"max":{"1min":1.0009999999999999,"5min":1.27,"15min":1.27},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.626,"15min":0.61699999999999999},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95299999999999996,"5min":1.014,"15min":1.014},"last":0.58099999999999996}]},{"osd":6,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65700000000000003,"15min":0.63700000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.41699999999999998},"max":{"1min":1.0449999999999999,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67900000000000005,"15min":0.66300000000000003},"min":{"1min":0.47599999999999998,"5min":0.45500000000000002,"15min":0.39000000000000001},"max":{"1min":0.89400000000000002,"5min":1.425,"15min":1.425},"last":0.55900000000000005}]},{"osd":7,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.58699999999999997,"5min":0.48699999999999999,"15min":0.47999999999999998},"max":{"1min":0.92300000000000004,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.78300000000000003,"15min":0.76200000000000001},"min":{"1min":0.63900000000000001,"5min":0.51200000000000001,"15min":0.46600000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.79300000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575745,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311564,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060276,"statfs":{"total":96636764160,"available":96317722624,"internally_reserved":0,"allocated":2035712,"data_stored":1012684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.745,"15min":0.73199999999999998},"min":{"1min":0.55600000000000005,"5min":0.46200000000000002,"15min":0.39100000000000001},"max":{"1min":0.97199999999999998,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74199999999999999,"15min":0.72499999999999998},"min":{"1min":0.51100000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.0820000000000001},"last":0.67300000000000004}]},{"osd":1,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73399999999999999,"15min":0.73299999999999998},"min":{"1min":0.56899999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":0.97499999999999998,"15min":1.0129999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76300000000000001,"15min":0.75600000000000001},"min":{"1min":0.56599999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.0289999999999999},"last":0.66000000000000003}]},{"osd":2,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77100000000000002,"15min":0.75800000000000001},"min":{"1min":0.63400000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95399999999999996,"5min":0.95699999999999996,"15min":0.98599999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.5,"5min":0.5,"15min":0.44500000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":1.026},"last":0.69199999999999995}]},{"osd":3,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77800000000000002,"15min":0.76600000000000001},"min":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.47499999999999998},"max":{"1min":0.92200000000000004,"5min":0.97799999999999998,"15min":1.107},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79700000000000004,"15min":0.78500000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.96699999999999997,"5min":0.99099999999999999,"15min":1.0249999999999999},"last":0.753}]},{"osd":4,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.61099999999999999,"15min":0.60599999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.82099999999999995,"5min":1.002,"15min":1.0189999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.625,"15min":0.61699999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.379},"max":{"1min":0.89200000000000002,"5min":0.96199999999999997,"15min":1.0289999999999999},"last":0.57799999999999996}]},{"osd":6,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64000000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.91400000000000003,"5min":0.95899999999999996,"15min":0.998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68700000000000006,"15min":0.67800000000000005},"min":{"1min":0.51200000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.054},"last":0.76700000000000002}]},{"osd":7,"last update":"Mon Oct 9 07:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.69499999999999995},"min":{"1min":0.47199999999999998,"5min":0.45000000000000001,"15min":0.433},"max":{"1min":0.93400000000000005,"5min":1.0449999999999999,"15min":1.073},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.79200000000000004,"15min":0.78500000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.5},"max":{"1min":1.0069999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.79100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T07:57:51.323 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T07:57:51.323 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T07:57:51.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.560+0000 7f7c257ff700 1 Processor -- start 2023-10-09T07:57:51.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.560+0000 7f7c257ff700 1 -- start start 2023-10-09T07:57:51.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.562+0000 7f7c257ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7c201569f0 0x7f7c200c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:51.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.562+0000 7f7c257ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c20068390 0x7f7c20068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:51.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.562+0000 7f7c257ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2015a6f0 con 0x7f7c20156620 2023-10-09T07:57:51.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.562+0000 7f7c257ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c200c8d30 con 0x7f7c201569f0 2023-10-09T07:57:51.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.562+0000 7f7c257ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20068d70 con 0x7f7c20068390 2023-10-09T07:57:51.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.562+0000 7f7c1effd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f7c20156620 0x7f7c200ace70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52056/0 (socket says 172.21.15.71:52056) 2023-10-09T07:57:51.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.562+0000 7f7c1effd700 1 -- 172.21.15.71:0/3575097061 learned_addr learned my addr 172.21.15.71:0/3575097061 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:51.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.562+0000 7f7c1f7fe700 1 --2- 172.21.15.71:0/3575097061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c20068390 0x7f7c20068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:51.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.562+0000 7f7c1e7fc700 1 --2- 172.21.15.71:0/3575097061 >> v2:172.21.15.179:3300/0 conn(0x7f7c201569f0 0x7f7c200c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:51.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.562+0000 7f7c1dffb700 1 -- 172.21.15.71:0/3575097061 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1327528982 0 0) 0x7f7c2015a6f0 con 0x7f7c20156620 2023-10-09T07:57:51.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.562+0000 7f7c1dffb700 1 -- 172.21.15.71:0/3575097061 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c08003570 con 0x7f7c20156620 2023-10-09T07:57:51.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.563+0000 7f7c1dffb700 1 -- 172.21.15.71:0/3575097061 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4264780245 0 0) 0x7f7c08003570 con 0x7f7c20156620 2023-10-09T07:57:51.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.563+0000 7f7c1dffb700 1 -- 172.21.15.71:0/3575097061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c20068390 msgr2=0x7f7c20068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:51.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.563+0000 7f7c1dffb700 1 --2- 172.21.15.71:0/3575097061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c20068390 0x7f7c20068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:51.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.563+0000 7f7c1dffb700 1 -- 172.21.15.71:0/3575097061 >> v2:172.21.15.179:3300/0 conn(0x7f7c201569f0 msgr2=0x7f7c200c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:51.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.563+0000 7f7c1dffb700 1 --2- 172.21.15.71:0/3575097061 >> v2:172.21.15.179:3300/0 conn(0x7f7c201569f0 0x7f7c200c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:51.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.563+0000 7f7c1dffb700 1 -- 172.21.15.71:0/3575097061 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2015a9d0 con 0x7f7c20156620 2023-10-09T07:57:51.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.563+0000 7f7c1dffb700 1 -- 172.21.15.71:0/3575097061 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f7c10001470 con 0x7f7c20156620 2023-10-09T07:57:51.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.563+0000 7f7c1dffb700 1 -- 172.21.15.71:0/3575097061 >> v1:172.21.15.71:6789/0 conn(0x7f7c20156620 legacy=0x7f7c200ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:51.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.563+0000 7f7c1dffb700 1 --2- 172.21.15.71:0/3575097061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c20068390 0x7f7c08003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:51.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.563+0000 7f7c1dffb700 1 --2- 172.21.15.71:0/3575097061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c08003fe0 0x7f7c08004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:51.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.563+0000 7f7c1dffb700 1 --2- 172.21.15.71:0/3575097061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c08004d50 0x7f7c080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:51.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.563+0000 7f7c1dffb700 1 -- 172.21.15.71:0/3575097061 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200c8d30 con 0x7f7c08004d50 2023-10-09T07:57:51.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.563+0000 7f7c1dffb700 1 -- 172.21.15.71:0/3575097061 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20068d70 con 0x7f7c08003fe0 2023-10-09T07:57:51.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.563+0000 7f7c1dffb700 1 -- 172.21.15.71:0/3575097061 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0800dca0 con 0x7f7c20068390 2023-10-09T07:57:51.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.563+0000 7f7c1f7fe700 1 --2- 172.21.15.71:0/3575097061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c08004d50 0x7f7c080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:51.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.563+0000 7f7c1effd700 1 --2- 172.21.15.71:0/3575097061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c20068390 0x7f7c08003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:51.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.563+0000 7f7c1e7fc700 1 --2- 172.21.15.71:0/3575097061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c08003fe0 0x7f7c08004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:51.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.563+0000 7f7c1f7fe700 1 -- 172.21.15.71:0/3575097061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c20068390 msgr2=0x7f7c08003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:51.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.563+0000 7f7c1f7fe700 1 --2- 172.21.15.71:0/3575097061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c20068390 0x7f7c08003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:51.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.563+0000 7f7c1f7fe700 1 -- 172.21.15.71:0/3575097061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c08003fe0 msgr2=0x7f7c08004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:51.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.563+0000 7f7c1f7fe700 1 --2- 172.21.15.71:0/3575097061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c08003fe0 0x7f7c08004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:51.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.563+0000 7f7c1f7fe700 1 -- 172.21.15.71:0/3575097061 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c08003570 con 0x7f7c08004d50 2023-10-09T07:57:51.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.564+0000 7f7c1f7fe700 1 --2- 172.21.15.71:0/3575097061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c08004d50 0x7f7c080051c0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800e210 tx=0x7f7c1800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c429849572dc2d6b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:51.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.564+0000 7f7c1dffb700 1 -- 172.21.15.71:0/3575097061 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1800ea60 con 0x7f7c08004d50 2023-10-09T07:57:51.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.564+0000 7f7c1dffb700 1 -- 172.21.15.71:0/3575097061 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1800f040 con 0x7f7c08004d50 2023-10-09T07:57:51.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.564+0000 7f7c1dffb700 1 -- 172.21.15.71:0/3575097061 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1800ee10 con 0x7f7c08004d50 2023-10-09T07:57:51.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.564+0000 7f7c257ff700 1 -- 172.21.15.71:0/3575097061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c08004d50 msgr2=0x7f7c080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:51.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.564+0000 7f7c257ff700 1 --2- 172.21.15.71:0/3575097061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c08004d50 0x7f7c080051c0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800e210 tx=0x7f7c1800b040 comp rx=0 tx=0).stop 2023-10-09T07:57:51.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.564+0000 7f7c1f7fe700 1 -- 172.21.15.71:0/3575097061 reap_dead start 2023-10-09T07:57:51.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.564+0000 7f7c257ff700 1 -- 172.21.15.71:0/3575097061 shutdown_connections 2023-10-09T07:57:51.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.564+0000 7f7c257ff700 1 -- 172.21.15.71:0/3575097061 >> 172.21.15.71:0/3575097061 conn(0x7f7c200cc540 msgr2=0x7f7c200cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:51.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.565+0000 7f7c257ff700 1 -- 172.21.15.71:0/3575097061 shutdown_connections 2023-10-09T07:57:51.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.565+0000 7f7c257ff700 1 -- 172.21.15.71:0/3575097061 wait complete. 2023-10-09T07:57:51.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.566+0000 7f7c257ff700 1 Processor -- start 2023-10-09T07:57:51.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.566+0000 7f7c257ff700 1 -- start start 2023-10-09T07:57:51.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.567+0000 7f7c257ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c08004d50 0x7f7c201523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:51.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.567+0000 7f7c257ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c20154bd0 0x7f7c200c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:51.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.567+0000 7f7c257ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c200c5b10 0x7f7c200c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:51.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.567+0000 7f7c257ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c201528f0 con 0x7f7c20154bd0 2023-10-09T07:57:51.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.567+0000 7f7c257ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200b02c0 con 0x7f7c200c5b10 2023-10-09T07:57:51.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.567+0000 7f7c257ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200b1120 con 0x7f7c08004d50 2023-10-09T07:57:51.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.567+0000 7f7c1e7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c20154bd0 0x7f7c200c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:51.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.567+0000 7f7c1e7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c20154bd0 0x7f7c200c3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35612/0 (socket says 172.21.15.71:35612) 2023-10-09T07:57:51.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.567+0000 7f7c1e7fc700 1 -- 172.21.15.71:0/1263058605 learned_addr learned my addr 172.21.15.71:0/1263058605 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:51.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.567+0000 7f7c1effd700 1 --2- 172.21.15.71:0/1263058605 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c08004d50 0x7f7c201523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:51.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.568+0000 7f7c1f7fe700 1 --2- 172.21.15.71:0/1263058605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c200c5b10 0x7f7c200c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:51.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.568+0000 7f7c1e7fc700 1 -- 172.21.15.71:0/1263058605 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c08004d50 msgr2=0x7f7c201523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:51.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.568+0000 7f7c1e7fc700 1 --2- 172.21.15.71:0/1263058605 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c08004d50 0x7f7c201523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:51.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.568+0000 7f7c1e7fc700 1 -- 172.21.15.71:0/1263058605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c200c5b10 msgr2=0x7f7c200c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:51.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.568+0000 7f7c1e7fc700 1 --2- 172.21.15.71:0/1263058605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c200c5b10 0x7f7c200c5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:51.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.568+0000 7f7c1e7fc700 1 -- 172.21.15.71:0/1263058605 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c200c64f0 con 0x7f7c20154bd0 2023-10-09T07:57:51.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.568+0000 7f7c1f7fe700 1 --2- 172.21.15.71:0/1263058605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c200c5b10 0x7f7c200c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:57:51.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.568+0000 7f7c1e7fc700 1 --2- 172.21.15.71:0/1263058605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c20154bd0 0x7f7c200c3b10 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f7c14011b10 tx=0x7f7c140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:51.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.568+0000 7f7c06ffd700 1 -- 172.21.15.71:0/1263058605 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1400f8e0 con 0x7f7c20154bd0 2023-10-09T07:57:51.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.568+0000 7f7c06ffd700 1 -- 172.21.15.71:0/1263058605 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1400fa40 con 0x7f7c20154bd0 2023-10-09T07:57:51.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.568+0000 7f7c257ff700 1 -- 172.21.15.71:0/1263058605 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c200b0510 con 0x7f7c20154bd0 2023-10-09T07:57:51.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.568+0000 7f7c06ffd700 1 -- 172.21.15.71:0/1263058605 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1400fdc0 con 0x7f7c20154bd0 2023-10-09T07:57:51.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.568+0000 7f7c257ff700 1 -- 172.21.15.71:0/1263058605 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c200b0ad0 con 0x7f7c20154bd0 2023-10-09T07:57:51.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.569+0000 7f7c257ff700 1 -- 172.21.15.71:0/1263058605 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c200b24b0 con 0x7f7c20154bd0 2023-10-09T07:57:51.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.570+0000 7f7c06ffd700 1 -- 172.21.15.71:0/1263058605 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c14014650 con 0x7f7c20154bd0 2023-10-09T07:57:51.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.571+0000 7f7c06ffd700 1 --2- 172.21.15.71:0/1263058605 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7c0c066f30 0x7f7c0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:51.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.571+0000 7f7c06ffd700 1 -- 172.21.15.71:0/1263058605 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f7c14018030 con 0x7f7c20154bd0 2023-10-09T07:57:51.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.571+0000 7f7c1effd700 1 --2- 172.21.15.71:0/1263058605 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7c0c066f30 0x7f7c0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:51.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.572+0000 7f7c1effd700 1 --2- 172.21.15.71:0/1263058605 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7c0c066f30 0x7f7c0c0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7c100079e0 tx=0x7f7c10001e90 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:51.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.575+0000 7f7c06ffd700 1 -- 172.21.15.71:0/1263058605 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c140520f0 con 0x7f7c20154bd0 2023-10-09T07:57:51.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.843+0000 7f7c257ff700 1 -- 172.21.15.71:0/1263058605 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7c200718b0 con 0x7f7c20154bd0 2023-10-09T07:57:51.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.847+0000 7f7c06ffd700 1 -- 172.21.15.71:0/1263058605 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v40) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7c140220e0 con 0x7f7c20154bd0 2023-10-09T07:57:51.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.850+0000 7f7c257ff700 1 -- 172.21.15.71:0/1263058605 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7c0c066f30 msgr2=0x7f7c0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:51.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.850+0000 7f7c257ff700 1 --2- 172.21.15.71:0/1263058605 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7c0c066f30 0x7f7c0c0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7c100079e0 tx=0x7f7c10001e90 comp rx=0 tx=0).stop 2023-10-09T07:57:51.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.850+0000 7f7c257ff700 1 -- 172.21.15.71:0/1263058605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c20154bd0 msgr2=0x7f7c200c3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:51.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.850+0000 7f7c257ff700 1 --2- 172.21.15.71:0/1263058605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c20154bd0 0x7f7c200c3b10 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f7c14011b10 tx=0x7f7c140091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:51.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.850+0000 7f7c257ff700 1 -- 172.21.15.71:0/1263058605 shutdown_connections 2023-10-09T07:57:51.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.850+0000 7f7c257ff700 1 --2- 172.21.15.71:0/1263058605 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7c0c066f30 0x7f7c0c0693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:51.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.850+0000 7f7c257ff700 1 --2- 172.21.15.71:0/1263058605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c200c5b10 0x7f7c200c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:51.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.850+0000 7f7c257ff700 1 --2- 172.21.15.71:0/1263058605 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c08004d50 0x7f7c201523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:51.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.850+0000 7f7c257ff700 1 --2- 172.21.15.71:0/1263058605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c20154bd0 0x7f7c200c3b10 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:51.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.850+0000 7f7c257ff700 1 -- 172.21.15.71:0/1263058605 >> 172.21.15.71:0/1263058605 conn(0x7f7c200cc540 msgr2=0x7f7c20069f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:51.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.850+0000 7f7c257ff700 1 -- 172.21.15.71:0/1263058605 shutdown_connections 2023-10-09T07:57:51.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:51.850+0000 7f7c257ff700 1 -- 172.21.15.71:0/1263058605 wait complete. 2023-10-09T07:57:51.852 INFO:teuthology.orchestra.run.smithi071.stderr:updated caps for client.0 2023-10-09T07:57:51.868 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:57:52.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.048+0000 7fd7505ff700 1 Processor -- start 2023-10-09T07:57:52.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.048+0000 7fd7505ff700 1 -- start start 2023-10-09T07:57:52.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.049+0000 7fd7505ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd748159890 0x7fd74815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.049+0000 7fd7505ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd748159c60 0x7fd74815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.049+0000 7fd7505ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd74815a160 con 0x7fd74815db10 2023-10-09T07:57:52.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.049+0000 7fd7505ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd74815df50 con 0x7fd748159c60 2023-10-09T07:57:52.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.049+0000 7fd7505ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7480d13a0 con 0x7fd748159890 2023-10-09T07:57:52.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.050+0000 7fd74db9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd748159c60 0x7fd74815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:52.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.050+0000 7fd74eb9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd74815db10 0x7fd748069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52058/0 (socket says 172.21.15.71:52058) 2023-10-09T07:57:52.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.050+0000 7fd74eb9c700 1 -- 172.21.15.71:0/423782407 learned_addr learned my addr 172.21.15.71:0/423782407 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:52.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.050+0000 7fd74e39b700 1 --2- 172.21.15.71:0/423782407 >> v2:172.21.15.179:3300/0 conn(0x7fd748159890 0x7fd74815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:52.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.050+0000 7fd74d399700 1 -- 172.21.15.71:0/423782407 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130712860 0 0) 0x7fd74815a160 con 0x7fd74815db10 2023-10-09T07:57:52.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.050+0000 7fd74d399700 1 -- 172.21.15.71:0/423782407 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd734003570 con 0x7fd74815db10 2023-10-09T07:57:52.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.050+0000 7fd74db9a700 1 -- 172.21.15.71:0/423782407 >> v2:172.21.15.179:3300/0 conn(0x7fd748159890 msgr2=0x7fd74815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:52.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.050+0000 7fd74db9a700 1 --2- 172.21.15.71:0/423782407 >> v2:172.21.15.179:3300/0 conn(0x7fd748159890 0x7fd74815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.050+0000 7fd74db9a700 1 -- 172.21.15.71:0/423782407 >> v1:172.21.15.71:6789/0 conn(0x7fd74815db10 legacy=0x7fd748069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:52.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.050+0000 7fd74db9a700 1 -- 172.21.15.71:0/423782407 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74815e140 con 0x7fd748159c60 2023-10-09T07:57:52.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.050+0000 7fd74e39b700 1 --2- 172.21.15.71:0/423782407 >> v2:172.21.15.179:3300/0 conn(0x7fd748159890 0x7fd74815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:57:52.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.050+0000 7fd74db9a700 1 --2- 172.21.15.71:0/423782407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd748159c60 0x7fd74815d5d0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fd7480d1090 tx=0x7fd7380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c04c29f08f903f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:52.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.051+0000 7fd74d399700 1 -- 172.21.15.71:0/423782407 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd738011630 con 0x7fd748159c60 2023-10-09T07:57:52.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.051+0000 7fd74d399700 1 -- 172.21.15.71:0/423782407 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd738011790 con 0x7fd748159c60 2023-10-09T07:57:52.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.051+0000 7fd74d399700 1 -- 172.21.15.71:0/423782407 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd738011b10 con 0x7fd748159c60 2023-10-09T07:57:52.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.051+0000 7fd7505ff700 1 -- 172.21.15.71:0/423782407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd748159c60 msgr2=0x7fd74815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:52.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.051+0000 7fd7505ff700 1 --2- 172.21.15.71:0/423782407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd748159c60 0x7fd74815d5d0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fd7480d1090 tx=0x7fd7380091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.051+0000 7fd7505ff700 1 -- 172.21.15.71:0/423782407 shutdown_connections 2023-10-09T07:57:52.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.051+0000 7fd7505ff700 1 --2- 172.21.15.71:0/423782407 >> v2:172.21.15.179:3300/0 conn(0x7fd748159890 0x7fd74815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.051+0000 7fd7505ff700 1 --2- 172.21.15.71:0/423782407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd748159c60 0x7fd74815d5d0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.051+0000 7fd7505ff700 1 -- 172.21.15.71:0/423782407 >> 172.21.15.71:0/423782407 conn(0x7fd748068e20 msgr2=0x7fd7480d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:52.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.051+0000 7fd7505ff700 1 -- 172.21.15.71:0/423782407 shutdown_connections 2023-10-09T07:57:52.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.051+0000 7fd7505ff700 1 -- 172.21.15.71:0/423782407 wait complete. 2023-10-09T07:57:52.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.053+0000 7fd7505ff700 1 Processor -- start 2023-10-09T07:57:52.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.053+0000 7fd7505ff700 1 -- start start 2023-10-09T07:57:52.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.054+0000 7fd7505ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd748159890 0x7fd74816a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.054+0000 7fd7505ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd748159c60 0x7fd7480cee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.054+0000 7fd7505ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd74815db10 0x7fd7480b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.054+0000 7fd7505ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74816ab40 con 0x7fd748159890 2023-10-09T07:57:52.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.054+0000 7fd7505ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7480cd640 con 0x7fd74815db10 2023-10-09T07:57:52.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.054+0000 7fd7505ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7480cd920 con 0x7fd748159c60 2023-10-09T07:57:52.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.054+0000 7fd74e39b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd748159890 0x7fd74816a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:52.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.054+0000 7fd74eb9c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd74815db10 0x7fd7480b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:52.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.054+0000 7fd74e39b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd748159890 0x7fd74816a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35634/0 (socket says 172.21.15.71:35634) 2023-10-09T07:57:52.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.054+0000 7fd74e39b700 1 -- 172.21.15.71:0/3587609939 learned_addr learned my addr 172.21.15.71:0/3587609939 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:52.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.054+0000 7fd74db9a700 1 --2- 172.21.15.71:0/3587609939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd748159c60 0x7fd7480cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:52.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.055+0000 7fd74e39b700 1 -- 172.21.15.71:0/3587609939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd748159c60 msgr2=0x7fd7480cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:52.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.055+0000 7fd74e39b700 1 --2- 172.21.15.71:0/3587609939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd748159c60 0x7fd7480cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.055+0000 7fd74e39b700 1 -- 172.21.15.71:0/3587609939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd74815db10 msgr2=0x7fd7480b5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:52.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.055+0000 7fd74e39b700 1 --2- 172.21.15.71:0/3587609939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd74815db10 0x7fd7480b5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.055+0000 7fd74e39b700 1 -- 172.21.15.71:0/3587609939 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd738009420 con 0x7fd748159890 2023-10-09T07:57:52.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.055+0000 7fd74e39b700 1 --2- 172.21.15.71:0/3587609939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd748159890 0x7fd74816a600 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fd74400c830 tx=0x7fd744008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:52.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.055+0000 7fd73e7fc700 1 -- 172.21.15.71:0/3587609939 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd744011600 con 0x7fd748159890 2023-10-09T07:57:52.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.055+0000 7fd73e7fc700 1 -- 172.21.15.71:0/3587609939 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd744011760 con 0x7fd748159890 2023-10-09T07:57:52.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.055+0000 7fd73e7fc700 1 -- 172.21.15.71:0/3587609939 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd744011b20 con 0x7fd748159890 2023-10-09T07:57:52.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.055+0000 7fd7505ff700 1 -- 172.21.15.71:0/3587609939 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7480b5570 con 0x7fd748159890 2023-10-09T07:57:52.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.055+0000 7fd7505ff700 1 -- 172.21.15.71:0/3587609939 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7480cf380 con 0x7fd748159890 2023-10-09T07:57:52.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.056+0000 7fd7505ff700 1 -- 172.21.15.71:0/3587609939 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7480b5a70 con 0x7fd748159890 2023-10-09T07:57:52.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.057+0000 7fd73e7fc700 1 -- 172.21.15.71:0/3587609939 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd744018360 con 0x7fd748159890 2023-10-09T07:57:52.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.058+0000 7fd73e7fc700 1 --2- 172.21.15.71:0/3587609939 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd72c066f30 0x7fd72c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.058+0000 7fd73e7fc700 1 -- 172.21.15.71:0/3587609939 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fd7440847a0 con 0x7fd748159890 2023-10-09T07:57:52.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.058+0000 7fd74db9a700 1 --2- 172.21.15.71:0/3587609939 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd72c066f30 0x7fd72c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:52.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.059+0000 7fd74db9a700 1 --2- 172.21.15.71:0/3587609939 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd72c066f30 0x7fd72c0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd7380093f0 tx=0x7fd738017000 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:52.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.062+0000 7fd73e7fc700 1 -- 172.21.15.71:0/3587609939 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd7440517a0 con 0x7fd748159890 2023-10-09T07:57:52.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.291+0000 7fd7505ff700 1 -- 172.21.15.71:0/3587609939 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd74804c3c0 con 0x7fd748159890 2023-10-09T07:57:52.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.292+0000 7fd73e7fc700 1 -- 172.21.15.71:0/3587609939 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fd744054dc0 con 0x7fd748159890 2023-10-09T07:57:52.293 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:57:52.293 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1228129559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1228129559},{"type":"v1","addr":"172.21.15.179:6836","nonce":1228129559}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8254,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3640887500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3640887500},{"type":"v1","addr":"172.21.15.179:6834","nonce":3640887500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8586,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/4266132184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":4266132184},{"type":"v1","addr":"172.21.15.71:6834","nonce":4266132184}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:57:41.159434+0000","modified":"2023-10-09T07:57:44.718117+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8589":{"gid":8589,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/889811309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":889811309},{"type":"v1","addr":"172.21.15.71:6835","nonce":889811309}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T07:57:52.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.294+0000 7fd7505ff700 1 -- 172.21.15.71:0/3587609939 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd72c066f30 msgr2=0x7fd72c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:52.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.294+0000 7fd7505ff700 1 --2- 172.21.15.71:0/3587609939 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd72c066f30 0x7fd72c0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd7380093f0 tx=0x7fd738017000 comp rx=0 tx=0).stop 2023-10-09T07:57:52.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.294+0000 7fd7505ff700 1 -- 172.21.15.71:0/3587609939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd748159890 msgr2=0x7fd74816a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:52.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.294+0000 7fd7505ff700 1 --2- 172.21.15.71:0/3587609939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd748159890 0x7fd74816a600 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fd74400c830 tx=0x7fd744008040 comp rx=0 tx=0).stop 2023-10-09T07:57:52.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.294+0000 7fd7505ff700 1 -- 172.21.15.71:0/3587609939 shutdown_connections 2023-10-09T07:57:52.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.294+0000 7fd7505ff700 1 --2- 172.21.15.71:0/3587609939 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd72c066f30 0x7fd72c0693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.294+0000 7fd7505ff700 1 --2- 172.21.15.71:0/3587609939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd74815db10 0x7fd7480b5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.294+0000 7fd7505ff700 1 --2- 172.21.15.71:0/3587609939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd748159890 0x7fd74816a600 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.294+0000 7fd7505ff700 1 --2- 172.21.15.71:0/3587609939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd748159c60 0x7fd7480cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.294+0000 7fd7505ff700 1 -- 172.21.15.71:0/3587609939 >> 172.21.15.71:0/3587609939 conn(0x7fd748068e20 msgr2=0x7fd7481572e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:52.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.294+0000 7fd7505ff700 1 -- 172.21.15.71:0/3587609939 shutdown_connections 2023-10-09T07:57:52.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.294+0000 7fd7505ff700 1 -- 172.21.15.71:0/3587609939 wait complete. 2023-10-09T07:57:52.296 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 74 2023-10-09T07:57:52.715 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T07:57:41.159434+0000', 'modified': '2023-10-09T07:57:44.718117+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8589}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8589': {'gid': 8589, 'name': 'a', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.71:6835/889811309', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6833', 'nonce': 889811309}, {'type': 'v1', 'addr': '172.21.15.71:6835', 'nonce': 889811309}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T07:57:52.715 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T07:57:52.715 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-09T07:57:52.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.900+0000 7f8a50dff700 1 Processor -- start 2023-10-09T07:57:52.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.900+0000 7f8a50dff700 1 -- start start 2023-10-09T07:57:52.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.901+0000 7f8a50dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8a4c0cbf30 0x7f8a4c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.901+0000 7f8a50dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8a4c0ccf90 0x7f8a4c0b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.901+0000 7f8a50dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4c0cc300 con 0x7f8a4c15a270 2023-10-09T07:57:52.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.901+0000 7f8a50dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4c156bf0 con 0x7f8a4c0ccf90 2023-10-09T07:57:52.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.901+0000 7f8a50dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4c0ae950 con 0x7f8a4c0cbf30 2023-10-09T07:57:52.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.902+0000 7f8a43fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8a4c0ccf90 0x7f8a4c0b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:52.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.902+0000 7f8a43fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8a4c0ccf90 0x7f8a4c0b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35638/0 (socket says 172.21.15.71:35638) 2023-10-09T07:57:52.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.902+0000 7f8a43fff700 1 -- 172.21.15.71:0/4228362695 learned_addr learned my addr 172.21.15.71:0/4228362695 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:52.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.902+0000 7f8a4ad9d700 1 --1- 172.21.15.71:0/4228362695 >> v1:172.21.15.71:6789/0 conn(0x7f8a4c15a270 0x7f8a4c0c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52066/0 (socket says 172.21.15.71:52066) 2023-10-09T07:57:52.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.902+0000 7f8a4a59c700 1 --2- 172.21.15.71:0/4228362695 >> v2:172.21.15.179:3300/0 conn(0x7f8a4c0cbf30 0x7f8a4c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:52.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.902+0000 7f8a43fff700 1 -- 172.21.15.71:0/4228362695 >> v2:172.21.15.179:3300/0 conn(0x7f8a4c0cbf30 msgr2=0x7f8a4c0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:52.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.902+0000 7f8a43fff700 1 --2- 172.21.15.71:0/4228362695 >> v2:172.21.15.179:3300/0 conn(0x7f8a4c0cbf30 0x7f8a4c0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.902+0000 7f8a43fff700 1 -- 172.21.15.71:0/4228362695 >> v1:172.21.15.71:6789/0 conn(0x7f8a4c15a270 legacy=0x7f8a4c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:52.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.902+0000 7f8a43fff700 1 -- 172.21.15.71:0/4228362695 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c0ad370 con 0x7f8a4c0ccf90 2023-10-09T07:57:52.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.902+0000 7f8a49d9b700 1 -- 172.21.15.71:0/4228362695 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495990274 0 0) 0x7f8a4c0cc300 con 0x7f8a4c15a270 2023-10-09T07:57:52.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.903+0000 7f8a43fff700 1 --2- 172.21.15.71:0/4228362695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a4c0ccf90 0x7f8a4c0b0d10 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c063d40 tx=0x7f8a34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310de7304b535b23 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:52.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.903+0000 7f8a49d9b700 1 -- 172.21.15.71:0/4228362695 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a34009ea0 con 0x7f8a4c0ccf90 2023-10-09T07:57:52.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.903+0000 7f8a49d9b700 1 -- 172.21.15.71:0/4228362695 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3400b820 con 0x7f8a4c0ccf90 2023-10-09T07:57:52.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.903+0000 7f8a49d9b700 1 -- 172.21.15.71:0/4228362695 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3400bbc0 con 0x7f8a4c0ccf90 2023-10-09T07:57:52.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.903+0000 7f8a50dff700 1 -- 172.21.15.71:0/4228362695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a4c0ccf90 msgr2=0x7f8a4c0b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:52.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.903+0000 7f8a50dff700 1 --2- 172.21.15.71:0/4228362695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a4c0ccf90 0x7f8a4c0b0d10 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c063d40 tx=0x7f8a34009250 comp rx=0 tx=0).stop 2023-10-09T07:57:52.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.903+0000 7f8a50dff700 1 -- 172.21.15.71:0/4228362695 shutdown_connections 2023-10-09T07:57:52.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.903+0000 7f8a50dff700 1 --2- 172.21.15.71:0/4228362695 >> v2:172.21.15.179:3300/0 conn(0x7f8a4c0cbf30 0x7f8a4c0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.903+0000 7f8a50dff700 1 --2- 172.21.15.71:0/4228362695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a4c0ccf90 0x7f8a4c0b0d10 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.903+0000 7f8a50dff700 1 -- 172.21.15.71:0/4228362695 >> 172.21.15.71:0/4228362695 conn(0x7f8a4c06a320 msgr2=0x7f8a4c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:52.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.903+0000 7f8a50dff700 1 -- 172.21.15.71:0/4228362695 shutdown_connections 2023-10-09T07:57:52.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.903+0000 7f8a50dff700 1 -- 172.21.15.71:0/4228362695 wait complete. 2023-10-09T07:57:52.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.905+0000 7f8a50dff700 1 Processor -- start 2023-10-09T07:57:52.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.905+0000 7f8a50dff700 1 -- start start 2023-10-09T07:57:52.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.906+0000 7f8a50dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a4c0cbf30 0x7f8a4c157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.906+0000 7f8a50dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a4c0ccf90 0x7f8a4c1510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.906+0000 7f8a50dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a4c15a270 0x7f8a4c06e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.906+0000 7f8a50dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c156d70 con 0x7f8a4c0ccf90 2023-10-09T07:57:52.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.906+0000 7f8a50dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c157610 con 0x7f8a4c15a270 2023-10-09T07:57:52.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.906+0000 7f8a50dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c166b60 con 0x7f8a4c0cbf30 2023-10-09T07:57:52.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.906+0000 7f8a43fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a4c0ccf90 0x7f8a4c1510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:52.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.906+0000 7f8a43fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a4c0ccf90 0x7f8a4c1510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35646/0 (socket says 172.21.15.71:35646) 2023-10-09T07:57:52.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.906+0000 7f8a43fff700 1 -- 172.21.15.71:0/384086431 learned_addr learned my addr 172.21.15.71:0/384086431 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:52.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.906+0000 7f8a43fff700 1 -- 172.21.15.71:0/384086431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a4c0cbf30 msgr2=0x7f8a4c157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:52.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.906+0000 7f8a43fff700 1 --2- 172.21.15.71:0/384086431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a4c0cbf30 0x7f8a4c157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.906+0000 7f8a43fff700 1 -- 172.21.15.71:0/384086431 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a4c15a270 msgr2=0x7f8a4c06e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:52.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.906+0000 7f8a4ad9d700 1 --2- 172.21.15.71:0/384086431 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a4c15a270 0x7f8a4c06e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:52.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.906+0000 7f8a43fff700 1 --2- 172.21.15.71:0/384086431 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a4c15a270 0x7f8a4c06e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.906+0000 7f8a43fff700 1 -- 172.21.15.71:0/384086431 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a340094f0 con 0x7f8a4c0ccf90 2023-10-09T07:57:52.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.907+0000 7f8a43fff700 1 --2- 172.21.15.71:0/384086431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a4c0ccf90 0x7f8a4c1510a0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c064290 tx=0x7f8a34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:52.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.907+0000 7f8a427fc700 1 -- 172.21.15.71:0/384086431 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3400bba0 con 0x7f8a4c0ccf90 2023-10-09T07:57:52.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.907+0000 7f8a427fc700 1 -- 172.21.15.71:0/384086431 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a34026450 con 0x7f8a4c0ccf90 2023-10-09T07:57:52.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.907+0000 7f8a50dff700 1 -- 172.21.15.71:0/384086431 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4c156fc0 con 0x7f8a4c0ccf90 2023-10-09T07:57:52.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.907+0000 7f8a427fc700 1 -- 172.21.15.71:0/384086431 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a340267f0 con 0x7f8a4c0ccf90 2023-10-09T07:57:52.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.907+0000 7f8a50dff700 1 -- 172.21.15.71:0/384086431 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4c1515e0 con 0x7f8a4c0ccf90 2023-10-09T07:57:52.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.909+0000 7f8a427fc700 1 -- 172.21.15.71:0/384086431 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a34011420 con 0x7f8a4c0ccf90 2023-10-09T07:57:52.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.910+0000 7f8a427fc700 1 --2- 172.21.15.71:0/384086431 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8a2c066f30 0x7f8a2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.910+0000 7f8a427fc700 1 -- 172.21.15.71:0/384086431 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f8a340863b0 con 0x7f8a4c0ccf90 2023-10-09T07:57:52.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.911+0000 7f8a4a59c700 1 --2- 172.21.15.71:0/384086431 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8a2c066f30 0x7f8a2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:52.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.911+0000 7f8a4a59c700 1 --2- 172.21.15.71:0/384086431 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8a2c066f30 0x7f8a2c0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009b10 tx=0x7f8a3c0091a0 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:52.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.912+0000 7f8a5f4e3b80 1 Processor -- start 2023-10-09T07:57:52.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.912+0000 7f8a5f4e3b80 1 -- start start 2023-10-09T07:57:52.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.913+0000 7f8a5f4e3b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd66050 0x5609dcd66420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.913+0000 7f8a5f4e3b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609dcd3df80 0x5609dcd3c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.913+0000 7f8a5f4e3b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5609dcd3cdc0 0x5609dcd3d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.913+0000 7f8a5f4e3b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609dcc93a70 con 0x5609dcd66050 2023-10-09T07:57:52.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.913+0000 7f8a5f4e3b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609dcc91270 con 0x5609dcd3df80 2023-10-09T07:57:52.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.913+0000 7f8a5f4e3b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5609dcc8d060 con 0x5609dcd3cdc0 2023-10-09T07:57:52.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.913+0000 7f8a4a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd66050 0x5609dcd66420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:52.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.913+0000 7f8a4a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd66050 0x5609dcd66420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35660/0 (socket says 172.21.15.71:35660) 2023-10-09T07:57:52.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.913+0000 7f8a4a59c700 1 -- 172.21.15.71:0/1262699145 learned_addr learned my addr 172.21.15.71:0/1262699145 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:52.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.913+0000 7f8a4ad9d700 1 --2- 172.21.15.71:0/1262699145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5609dcd3cdc0 0x5609dcd3d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:52.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.913+0000 7f8a43fff700 1 --2- 172.21.15.71:0/1262699145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609dcd3df80 0x5609dcd3c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:52.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.913+0000 7f8a4a59c700 1 -- 172.21.15.71:0/1262699145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5609dcd3cdc0 msgr2=0x5609dcd3d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:52.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.913+0000 7f8a4a59c700 1 --2- 172.21.15.71:0/1262699145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5609dcd3cdc0 0x5609dcd3d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.913+0000 7f8a4a59c700 1 -- 172.21.15.71:0/1262699145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609dcd3df80 msgr2=0x5609dcd3c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:52.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.913+0000 7f8a4a59c700 1 --2- 172.21.15.71:0/1262699145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609dcd3df80 0x5609dcd3c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.913+0000 7f8a4a59c700 1 -- 172.21.15.71:0/1262699145 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609dcb27270 con 0x5609dcd66050 2023-10-09T07:57:52.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.913+0000 7f8a4ad9d700 1 --2- 172.21.15.71:0/1262699145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5609dcd3cdc0 0x5609dcd3d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:57:52.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.913+0000 7f8a43fff700 1 --2- 172.21.15.71:0/1262699145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609dcd3df80 0x5609dcd3c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:57:52.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.914+0000 7f8a4a59c700 1 --2- 172.21.15.71:0/1262699145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd66050 0x5609dcd66420 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00eb70 tx=0x7f8a3c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de09be5cab3e1221 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:52.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.914+0000 7f8a2b7fe700 1 -- 172.21.15.71:0/1262699145 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c015600 con 0x5609dcd66050 2023-10-09T07:57:52.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.914+0000 7f8a2b7fe700 1 -- 172.21.15.71:0/1262699145 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c015760 con 0x5609dcd66050 2023-10-09T07:57:52.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.914+0000 7f8a2b7fe700 1 -- 172.21.15.71:0/1262699145 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c015b20 con 0x5609dcd66050 2023-10-09T07:57:52.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.914+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/1262699145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd66050 msgr2=0x5609dcd66420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:52.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.914+0000 7f8a5f4e3b80 1 --2- 172.21.15.71:0/1262699145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd66050 0x5609dcd66420 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00eb70 tx=0x7f8a3c016000 comp rx=0 tx=0).stop 2023-10-09T07:57:52.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.915+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/1262699145 shutdown_connections 2023-10-09T07:57:52.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.915+0000 7f8a5f4e3b80 1 --2- 172.21.15.71:0/1262699145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5609dcd3cdc0 0x5609dcd3d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.915+0000 7f8a5f4e3b80 1 --2- 172.21.15.71:0/1262699145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd66050 0x5609dcd66420 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.915+0000 7f8a5f4e3b80 1 --2- 172.21.15.71:0/1262699145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609dcd3df80 0x5609dcd3c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.915+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/1262699145 >> 172.21.15.71:0/1262699145 conn(0x5609dcd3e370 msgr2=0x5609dcd3e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:52.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.915+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/1262699145 shutdown_connections 2023-10-09T07:57:52.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.915+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/1262699145 wait complete. 2023-10-09T07:57:52.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.915+0000 7f8a5f4e3b80 1 -- start start 2023-10-09T07:57:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.916+0000 7f8a5f4e3b80 1 Processor -- start 2023-10-09T07:57:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.917+0000 7f8a5f4e3b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609dcd3cdc0 0x5609dcd64df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.917+0000 7f8a5f4e3b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5609dcd3df80 0x5609dcd68b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.917+0000 7f8a5f4e3b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd66050 0x5609dcd669f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.917+0000 7f8a5f4e3b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609dcc38890 con 0x5609dcd66050 2023-10-09T07:57:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.917+0000 7f8a5f4e3b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609dcc53ea0 con 0x5609dcd3cdc0 2023-10-09T07:57:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.917+0000 7f8a5f4e3b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5609dcb0fe30 con 0x5609dcd3df80 2023-10-09T07:57:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.917+0000 7f8a5f4e3b80 10 client.0 _ll_register_callbacks cb 0x5609dcd00110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T07:57:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.917+0000 7f8a4ad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd66050 0x5609dcd669f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.917+0000 7f8a4ad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd66050 0x5609dcd669f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35666/0 (socket says 172.21.15.71:35666) 2023-10-09T07:57:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.917+0000 7f8a4ad9d700 1 -- 172.21.15.71:0/1630983878 learned_addr learned my addr 172.21.15.71:0/1630983878 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.917+0000 7f8a4a59c700 1 --2- 172.21.15.71:0/1630983878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609dcd3cdc0 0x5609dcd64df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.917+0000 7f8a43fff700 1 --2- 172.21.15.71:0/1630983878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5609dcd3df80 0x5609dcd68b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.917+0000 7f8a4ad9d700 1 -- 172.21.15.71:0/1630983878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5609dcd3df80 msgr2=0x5609dcd68b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.917+0000 7f8a4ad9d700 1 --2- 172.21.15.71:0/1630983878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5609dcd3df80 0x5609dcd68b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.917+0000 7f8a4ad9d700 1 -- 172.21.15.71:0/1630983878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609dcd3cdc0 msgr2=0x5609dcd64df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.917+0000 7f8a4ad9d700 1 --2- 172.21.15.71:0/1630983878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609dcd3cdc0 0x5609dcd64df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.917+0000 7f8a4ad9d700 1 -- 172.21.15.71:0/1630983878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3c00e7a0 con 0x5609dcd66050 2023-10-09T07:57:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.918+0000 7f8a4ad9d700 1 --2- 172.21.15.71:0/1630983878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd66050 0x5609dcd669f0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f8a44006500 tx=0x7f8a4400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40689266a1260dcb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.918+0000 7f8a28ff9700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T07:57:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.918+0000 7f8a28ff9700 1 -- 172.21.15.71:0/1630983878 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a44009380 con 0x5609dcd66050 2023-10-09T07:57:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.918+0000 7f8a28ff9700 1 -- 172.21.15.71:0/1630983878 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f8a440094e0 con 0x5609dcd66050 2023-10-09T07:57:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.918+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/1630983878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5609dcd31b70 con 0x5609dcd66050 2023-10-09T07:57:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.918+0000 7f8a28ff9700 1 -- 172.21.15.71:0/1630983878 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a440019a0 con 0x5609dcd66050 2023-10-09T07:57:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.918+0000 7f8a5f4e3b80 10 client.8763 fetch_fsmap learned FSMap version 74 2023-10-09T07:57:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.918+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/1630983878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x5609dcac9fe0 con 0x5609dcd66050 2023-10-09T07:57:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.918+0000 7f8a28ff9700 1 -- 172.21.15.71:0/1630983878 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5609dcd31b70 con 0x5609dcd66050 2023-10-09T07:57:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.918+0000 7f8a28ff9700 1 -- 172.21.15.71:0/1630983878 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8a440098b0 con 0x5609dcd66050 2023-10-09T07:57:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.918+0000 7f8a5f4e3b80 10 client.8763 fetch_fsmap finished waiting for FSMap version 74 2023-10-09T07:57:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.918+0000 7f8a5f4e3b80 10 client.8763 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T07:57:52.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.918+0000 7f8a5f4e3b80 20 client.8763 populate_metadata read hostname 'smithi071' 2023-10-09T07:57:52.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.918+0000 7f8a5f4e3b80 1 --2- 172.21.15.71:0/1630983878 >> [v2:172.21.15.71:6833/889811309,v1:172.21.15.71:6835/889811309] conn(0x5609dcd67420 0x5609dcd6b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.919+0000 7f8a5f4e3b80 4 client.8763 mds_command: new command op to 8589 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T07:57:52.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.919+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/1630983878 --> [v2:172.21.15.71:6833/889811309,v1:172.21.15.71:6835/889811309] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5609dcd0eaa0 con 0x5609dcd67420 2023-10-09T07:57:52.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.919+0000 7f8a4a59c700 1 --2- 172.21.15.71:0/1630983878 >> [v2:172.21.15.71:6833/889811309,v1:172.21.15.71:6835/889811309] conn(0x5609dcd67420 0x5609dcd6b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:52.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.919+0000 7f8a28ff9700 10 client.8763 ms_handle_connect on v2:172.21.15.71:6833/889811309 2023-10-09T07:57:52.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.919+0000 7f8a4a59c700 1 --2- 172.21.15.71:0/1630983878 >> [v2:172.21.15.71:6833/889811309,v1:172.21.15.71:6835/889811309] conn(0x5609dcd67420 0x5609dcd6b050 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8200259c274c03fc server_cookie=8c7e1b9824951d97 in_seq=0 out_seq=0 2023-10-09T07:57:52.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.920+0000 7f8a28ff9700 1 -- 172.21.15.71:0/1630983878 <== mds.0 v2:172.21.15.71:6833/889811309 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5609dcd0eaa0 con 0x5609dcd67420 2023-10-09T07:57:52.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.920+0000 7f8a28ff9700 10 client.8763 handle_command_reply: tid=0 2023-10-09T07:57:52.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.920+0000 7f8a5f4e3b80 1 client.8763 shutdown 2023-10-09T07:57:52.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.920+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/1630983878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd66050 msgr2=0x5609dcd669f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:52.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.920+0000 7f8a5f4e3b80 1 --2- 172.21.15.71:0/1630983878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd66050 0x5609dcd669f0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f8a44006500 tx=0x7f8a4400b040 comp rx=0 tx=0).stop 2023-10-09T07:57:52.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.920+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/1630983878 shutdown_connections 2023-10-09T07:57:52.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.920+0000 7f8a5f4e3b80 1 --2- 172.21.15.71:0/1630983878 >> [v2:172.21.15.71:6833/889811309,v1:172.21.15.71:6835/889811309] conn(0x5609dcd67420 0x5609dcd6b050 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.920+0000 7f8a5f4e3b80 1 --2- 172.21.15.71:0/1630983878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd66050 0x5609dcd669f0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.920+0000 7f8a5f4e3b80 1 --2- 172.21.15.71:0/1630983878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609dcd3cdc0 0x5609dcd64df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.920+0000 7f8a5f4e3b80 1 --2- 172.21.15.71:0/1630983878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5609dcd3df80 0x5609dcd68b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.920+0000 7f8a28ff9700 0 client.8763 ms_handle_reset on v2:172.21.15.71:6833/889811309 2023-10-09T07:57:52.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.920+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/1630983878 >> 172.21.15.71:0/1630983878 conn(0x5609dcd3e370 msgr2=0x5609dcd635a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:52.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.920+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/1630983878 shutdown_connections 2023-10-09T07:57:52.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.921+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/1630983878 wait complete. 2023-10-09T07:57:52.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.921+0000 7f8a5f4e3b80 20 client.8763 trim_cache size 0 max 16384 2023-10-09T07:57:52.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.938+0000 7f8a5f4e3b80 1 Processor -- start 2023-10-09T07:57:52.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.938+0000 7f8a5f4e3b80 1 -- start start 2023-10-09T07:57:52.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.938+0000 7f8a5f4e3b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd3cdc0 0x5609dcd7d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.939+0000 7f8a5f4e3b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609dcd3df80 0x5609dcd67a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.939+0000 7f8a5f4e3b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5609dcd66050 0x5609dcd67f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.939+0000 7f8a5f4e3b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609dcd68bb0 con 0x5609dcd3cdc0 2023-10-09T07:57:52.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.939+0000 7f8a5f4e3b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609dcd3b9a0 con 0x5609dcd3df80 2023-10-09T07:57:52.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.939+0000 7f8a5f4e3b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5609dcda9ea0 con 0x5609dcd66050 2023-10-09T07:57:52.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.939+0000 7f8a4a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd3cdc0 0x5609dcd7d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:52.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.939+0000 7f8a4a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd3cdc0 0x5609dcd7d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35676/0 (socket says 172.21.15.71:35676) 2023-10-09T07:57:52.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.939+0000 7f8a4a59c700 1 -- 172.21.15.71:0/113001145 learned_addr learned my addr 172.21.15.71:0/113001145 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:52.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.939+0000 7f8a4ad9d700 1 --2- 172.21.15.71:0/113001145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5609dcd66050 0x5609dcd67f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:52.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.939+0000 7f8a43fff700 1 --2- 172.21.15.71:0/113001145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609dcd3df80 0x5609dcd67a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:52.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.939+0000 7f8a4a59c700 1 -- 172.21.15.71:0/113001145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5609dcd66050 msgr2=0x5609dcd67f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:52.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.939+0000 7f8a4a59c700 1 --2- 172.21.15.71:0/113001145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5609dcd66050 0x5609dcd67f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.939+0000 7f8a4a59c700 1 -- 172.21.15.71:0/113001145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609dcd3df80 msgr2=0x5609dcd67a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:52.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.939+0000 7f8a4a59c700 1 --2- 172.21.15.71:0/113001145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609dcd3df80 0x5609dcd67a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.939+0000 7f8a4a59c700 1 -- 172.21.15.71:0/113001145 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609dcc5b780 con 0x5609dcd3cdc0 2023-10-09T07:57:52.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.939+0000 7f8a4ad9d700 1 --2- 172.21.15.71:0/113001145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5609dcd66050 0x5609dcd67f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:57:52.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.939+0000 7f8a4a59c700 1 --2- 172.21.15.71:0/113001145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd3cdc0 0x5609dcd7d2f0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c021000 tx=0x7f8a3c02a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1266277197b6cfd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:52.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.940+0000 7f8a2bfff700 1 -- 172.21.15.71:0/113001145 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c02e040 con 0x5609dcd3cdc0 2023-10-09T07:57:52.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.940+0000 7f8a2bfff700 1 -- 172.21.15.71:0/113001145 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c030040 con 0x5609dcd3cdc0 2023-10-09T07:57:52.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.940+0000 7f8a2bfff700 1 -- 172.21.15.71:0/113001145 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c015c30 con 0x5609dcd3cdc0 2023-10-09T07:57:52.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.940+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/113001145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd3cdc0 msgr2=0x5609dcd7d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:52.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.940+0000 7f8a5f4e3b80 1 --2- 172.21.15.71:0/113001145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd3cdc0 0x5609dcd7d2f0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c021000 tx=0x7f8a3c02a040 comp rx=0 tx=0).stop 2023-10-09T07:57:52.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.940+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/113001145 shutdown_connections 2023-10-09T07:57:52.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.940+0000 7f8a5f4e3b80 1 --2- 172.21.15.71:0/113001145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5609dcd66050 0x5609dcd67f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.940+0000 7f8a5f4e3b80 1 --2- 172.21.15.71:0/113001145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd3cdc0 0x5609dcd7d2f0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.940+0000 7f8a5f4e3b80 1 --2- 172.21.15.71:0/113001145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609dcd3df80 0x5609dcd67a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.940+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/113001145 >> 172.21.15.71:0/113001145 conn(0x5609dcd3e370 msgr2=0x5609dcd354b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:52.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.940+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/113001145 shutdown_connections 2023-10-09T07:57:52.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.940+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/113001145 wait complete. 2023-10-09T07:57:52.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.941+0000 7f8a5f4e3b80 1 -- start start 2023-10-09T07:57:52.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.941+0000 7f8a5f4e3b80 1 Processor -- start 2023-10-09T07:57:52.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.942+0000 7f8a5f4e3b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd3cdc0 0x5609dcd678d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.942+0000 7f8a5f4e3b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5609dcd3df80 0x5609dcd67e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.942+0000 7f8a5f4e3b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609dcd66050 0x5609dcdf0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.942+0000 7f8a5f4e3b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609dcd3adb0 con 0x5609dcd3cdc0 2023-10-09T07:57:52.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.942+0000 7f8a5f4e3b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609dcdf04b0 con 0x5609dcd66050 2023-10-09T07:57:52.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.942+0000 7f8a5f4e3b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5609dcded570 con 0x5609dcd3df80 2023-10-09T07:57:52.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.942+0000 7f8a5f4e3b80 10 client.0 _ll_register_callbacks cb 0x5609dcd00110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T07:57:52.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.942+0000 7f8a4a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd3cdc0 0x5609dcd678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:52.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.942+0000 7f8a4a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd3cdc0 0x5609dcd678d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35678/0 (socket says 172.21.15.71:35678) 2023-10-09T07:57:52.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.942+0000 7f8a4a59c700 1 -- 172.21.15.71:0/109858452 learned_addr learned my addr 172.21.15.71:0/109858452 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:52.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.943+0000 7f8a4a59c700 1 -- 172.21.15.71:0/109858452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5609dcd3df80 msgr2=0x5609dcd67e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:52.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.943+0000 7f8a4a59c700 1 --2- 172.21.15.71:0/109858452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5609dcd3df80 0x5609dcd67e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.943+0000 7f8a4a59c700 1 -- 172.21.15.71:0/109858452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609dcd66050 msgr2=0x5609dcdf0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:52.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.943+0000 7f8a4a59c700 1 --2- 172.21.15.71:0/109858452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609dcd66050 0x5609dcdf0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.943+0000 7f8a4a59c700 1 -- 172.21.15.71:0/109858452 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609dcb27270 con 0x5609dcd3cdc0 2023-10-09T07:57:52.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.943+0000 7f8a4a59c700 1 --2- 172.21.15.71:0/109858452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd3cdc0 0x5609dcd678d0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00f010 tx=0x7f8a3c031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba35b3c94e88e0f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:52.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.943+0000 7f8a28ff9700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T07:57:52.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.943+0000 7f8a28ff9700 1 -- 172.21.15.71:0/109858452 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c02e040 con 0x5609dcd3cdc0 2023-10-09T07:57:52.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.943+0000 7f8a28ff9700 1 -- 172.21.15.71:0/109858452 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f8a3c044020 con 0x5609dcd3cdc0 2023-10-09T07:57:52.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.943+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/109858452 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a4c0c12d0 con 0x5609dcd3cdc0 2023-10-09T07:57:52.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.943+0000 7f8a28ff9700 1 -- 172.21.15.71:0/109858452 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a3c005a00 con 0x5609dcd3cdc0 2023-10-09T07:57:52.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.943+0000 7f8a5f4e3b80 10 client.8769 fetch_fsmap learned FSMap version 74 2023-10-09T07:57:52.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.943+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/109858452 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x5609dcc42470 con 0x5609dcd3cdc0 2023-10-09T07:57:52.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.944+0000 7f8a28ff9700 1 -- 172.21.15.71:0/109858452 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c04d030 con 0x5609dcd3cdc0 2023-10-09T07:57:52.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.944+0000 7f8a28ff9700 1 -- 172.21.15.71:0/109858452 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8a3c033070 con 0x5609dcd3cdc0 2023-10-09T07:57:52.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.944+0000 7f8a5f4e3b80 10 client.8769 fetch_fsmap finished waiting for FSMap version 74 2023-10-09T07:57:52.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.944+0000 7f8a5f4e3b80 10 client.8769 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T07:57:52.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.944+0000 7f8a5f4e3b80 20 client.8769 populate_metadata read hostname 'smithi071' 2023-10-09T07:57:52.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.944+0000 7f8a5f4e3b80 1 --2- 172.21.15.71:0/109858452 >> [v2:172.21.15.71:6833/889811309,v1:172.21.15.71:6835/889811309] conn(0x5609dcdec900 0x5609dcdeccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:52.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.944+0000 7f8a5f4e3b80 4 client.8769 mds_command: new command op to 8589 tid=0[{"prefix": "status"}] 2023-10-09T07:57:52.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.944+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/109858452 --> [v2:172.21.15.71:6833/889811309,v1:172.21.15.71:6835/889811309] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f8a3c015760 con 0x5609dcdec900 2023-10-09T07:57:52.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.944+0000 7f8a43fff700 1 --2- 172.21.15.71:0/109858452 >> [v2:172.21.15.71:6833/889811309,v1:172.21.15.71:6835/889811309] conn(0x5609dcdec900 0x5609dcdeccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:52.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.944+0000 7f8a43fff700 1 --2- 172.21.15.71:0/109858452 >> [v2:172.21.15.71:6833/889811309,v1:172.21.15.71:6835/889811309] conn(0x5609dcdec900 0x5609dcdeccf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84db184584c2e869 server_cookie=f35d0f2df7aeb910 in_seq=0 out_seq=0 2023-10-09T07:57:52.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.944+0000 7f8a28ff9700 10 client.8769 ms_handle_connect on v2:172.21.15.71:6833/889811309 2023-10-09T07:57:52.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.945+0000 7f8a28ff9700 1 -- 172.21.15.71:0/109858452 <== mds.0 v2:172.21.15.71:6833/889811309 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7f8a34006e90 con 0x5609dcdec900 2023-10-09T07:57:52.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.945+0000 7f8a28ff9700 10 client.8769 handle_command_reply: tid=0 2023-10-09T07:57:52.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.945+0000 7f8a5f4e3b80 1 client.8769 shutdown 2023-10-09T07:57:52.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.945+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/109858452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd3cdc0 msgr2=0x5609dcd678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:52.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.945+0000 7f8a5f4e3b80 1 --2- 172.21.15.71:0/109858452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd3cdc0 0x5609dcd678d0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00f010 tx=0x7f8a3c031000 comp rx=0 tx=0).stop 2023-10-09T07:57:52.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.945+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/109858452 shutdown_connections 2023-10-09T07:57:52.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.945+0000 7f8a5f4e3b80 1 --2- 172.21.15.71:0/109858452 >> [v2:172.21.15.71:6833/889811309,v1:172.21.15.71:6835/889811309] conn(0x5609dcdec900 0x5609dcdeccf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.945+0000 7f8a5f4e3b80 1 --2- 172.21.15.71:0/109858452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5609dcd66050 0x5609dcdf0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.945+0000 7f8a5f4e3b80 1 --2- 172.21.15.71:0/109858452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609dcd3cdc0 0x5609dcd678d0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.945+0000 7f8a28ff9700 0 client.8769 ms_handle_reset on v2:172.21.15.71:6833/889811309 2023-10-09T07:57:52.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.945+0000 7f8a5f4e3b80 1 --2- 172.21.15.71:0/109858452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5609dcd3df80 0x5609dcd67e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.945+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/109858452 >> 172.21.15.71:0/109858452 conn(0x5609dcd3e370 msgr2=0x5609dcd69e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:52.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.945+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/109858452 shutdown_connections 2023-10-09T07:57:52.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.945+0000 7f8a5f4e3b80 1 -- 172.21.15.71:0/109858452 wait complete. 2023-10-09T07:57:52.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.945+0000 7f8a5f4e3b80 20 client.8769 trim_cache size 0 max 16384 2023-10-09T07:57:52.954 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T07:57:52.954 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "604c5619-653a-4ab6-912c-ab2e5464fe4a", 2023-10-09T07:57:52.955 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2023-10-09T07:57:52.955 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 8589, 2023-10-09T07:57:52.955 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2023-10-09T07:57:52.955 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2023-10-09T07:57:52.955 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2023-10-09T07:57:52.955 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 11.245010152000001, 2023-10-09T07:57:52.955 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 74, 2023-10-09T07:57:52.955 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 163, 2023-10-09T07:57:52.955 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 163, 2023-10-09T07:57:52.955 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 17.036849173 2023-10-09T07:57:52.955 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T07:57:52.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.946+0000 7f8a50dff700 1 -- 172.21.15.71:0/384086431 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8a2c066f30 msgr2=0x7f8a2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:52.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.946+0000 7f8a50dff700 1 --2- 172.21.15.71:0/384086431 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8a2c066f30 0x7f8a2c0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009b10 tx=0x7f8a3c0091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.946+0000 7f8a50dff700 1 -- 172.21.15.71:0/384086431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a4c0ccf90 msgr2=0x7f8a4c1510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:52.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.946+0000 7f8a50dff700 1 --2- 172.21.15.71:0/384086431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a4c0ccf90 0x7f8a4c1510a0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c064290 tx=0x7f8a34017000 comp rx=0 tx=0).stop 2023-10-09T07:57:52.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.946+0000 7f8a50dff700 1 -- 172.21.15.71:0/384086431 shutdown_connections 2023-10-09T07:57:52.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.946+0000 7f8a50dff700 1 --2- 172.21.15.71:0/384086431 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8a2c066f30 0x7f8a2c0693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.946+0000 7f8a50dff700 1 --2- 172.21.15.71:0/384086431 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a4c15a270 0x7f8a4c06e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.946+0000 7f8a50dff700 1 --2- 172.21.15.71:0/384086431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a4c0cbf30 0x7f8a4c157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.946+0000 7f8a50dff700 1 --2- 172.21.15.71:0/384086431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a4c0ccf90 0x7f8a4c1510a0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:52.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.946+0000 7f8a50dff700 1 -- 172.21.15.71:0/384086431 >> 172.21.15.71:0/384086431 conn(0x7f8a4c06a320 msgr2=0x7f8a4c152f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:52.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.946+0000 7f8a50dff700 1 -- 172.21.15.71:0/384086431 shutdown_connections 2023-10-09T07:57:52.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:52.946+0000 7f8a50dff700 1 -- 172.21.15.71:0/384086431 wait complete. 2023-10-09T07:57:52.963 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T07:57:53.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.144+0000 7fd10b5ff700 1 Processor -- start 2023-10-09T07:57:53.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.144+0000 7fd10b5ff700 1 -- start start 2023-10-09T07:57:53.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.145+0000 7fd10b5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1040b1420 0x7fd1040ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:53.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.145+0000 7fd10b5ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd1040ccf90 0x7fd1040c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:53.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.146+0000 7fd10b5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1040cc300 con 0x7fd1040cbf30 2023-10-09T07:57:53.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.146+0000 7fd10b5ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd104156bf0 con 0x7fd1040ccf90 2023-10-09T07:57:53.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.146+0000 7fd10b5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1040ae950 con 0x7fd1040b1420 2023-10-09T07:57:53.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.146+0000 7fd109b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd1040ccf90 0x7fd1040c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:53.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.146+0000 7fd109b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd1040ccf90 0x7fd1040c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35694/0 (socket says 172.21.15.71:35694) 2023-10-09T07:57:53.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.146+0000 7fd109b9c700 1 -- 172.21.15.71:0/3328772305 learned_addr learned my addr 172.21.15.71:0/3328772305 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:53.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.146+0000 7fd108b9a700 1 --2- 172.21.15.71:0/3328772305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1040b1420 0x7fd1040ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:53.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.146+0000 7fd109b9c700 1 -- 172.21.15.71:0/3328772305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1040b1420 msgr2=0x7fd1040ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:53.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.146+0000 7fd109b9c700 1 --2- 172.21.15.71:0/3328772305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1040b1420 0x7fd1040ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:53.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.146+0000 7fd109b9c700 1 -- 172.21.15.71:0/3328772305 >> v1:172.21.15.179:6789/0 conn(0x7fd1040cbf30 legacy=0x7fd1040b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:53.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.146+0000 7fd109b9c700 1 -- 172.21.15.71:0/3328772305 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1040ad370 con 0x7fd1040ccf90 2023-10-09T07:57:53.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.146+0000 7fd108b9a700 1 --2- 172.21.15.71:0/3328772305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1040b1420 0x7fd1040ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:57:53.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.147+0000 7fd109b9c700 1 --2- 172.21.15.71:0/3328772305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1040ccf90 0x7fd1040c9740 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc009f50 tx=0x7fd0fc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7c6f13bcd32ef5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:53.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.147+0000 7fd0fbfff700 1 -- 172.21.15.71:0/3328772305 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc00e070 con 0x7fd1040ccf90 2023-10-09T07:57:53.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.147+0000 7fd0fbfff700 1 -- 172.21.15.71:0/3328772305 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0fc00ba70 con 0x7fd1040ccf90 2023-10-09T07:57:53.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.147+0000 7fd0fbfff700 1 -- 172.21.15.71:0/3328772305 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc0092e0 con 0x7fd1040ccf90 2023-10-09T07:57:53.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.147+0000 7fd10b5ff700 1 -- 172.21.15.71:0/3328772305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1040ccf90 msgr2=0x7fd1040c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:53.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.147+0000 7fd10b5ff700 1 --2- 172.21.15.71:0/3328772305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1040ccf90 0x7fd1040c9740 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc009f50 tx=0x7fd0fc009840 comp rx=0 tx=0).stop 2023-10-09T07:57:53.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.148+0000 7fd10b5ff700 1 -- 172.21.15.71:0/3328772305 shutdown_connections 2023-10-09T07:57:53.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.148+0000 7fd10b5ff700 1 --2- 172.21.15.71:0/3328772305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1040ccf90 0x7fd1040c9740 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:53.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.148+0000 7fd10b5ff700 1 --2- 172.21.15.71:0/3328772305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1040b1420 0x7fd1040ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:53.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.148+0000 7fd10b5ff700 1 -- 172.21.15.71:0/3328772305 >> 172.21.15.71:0/3328772305 conn(0x7fd10406a320 msgr2=0x7fd1040cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:53.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.148+0000 7fd10b5ff700 1 -- 172.21.15.71:0/3328772305 shutdown_connections 2023-10-09T07:57:53.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.148+0000 7fd10b5ff700 1 -- 172.21.15.71:0/3328772305 wait complete. 2023-10-09T07:57:53.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.149+0000 7fd10b5ff700 1 Processor -- start 2023-10-09T07:57:53.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.149+0000 7fd10b5ff700 1 -- start start 2023-10-09T07:57:53.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.150+0000 7fd10b5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1040b1420 0x7fd10416a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:53.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.150+0000 7fd10b5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1040cbf30 0x7fd1040aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:53.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.150+0000 7fd10b5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1040ccf90 0x7fd1040c32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:53.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.150+0000 7fd10b5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1040abff0 con 0x7fd1040b1420 2023-10-09T07:57:53.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.150+0000 7fd10b5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1040c2450 con 0x7fd1040ccf90 2023-10-09T07:57:53.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.150+0000 7fd10b5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10416aaf0 con 0x7fd1040cbf30 2023-10-09T07:57:53.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.150+0000 7fd10939b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1040b1420 0x7fd10416a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:53.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.150+0000 7fd10939b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1040b1420 0x7fd10416a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35706/0 (socket says 172.21.15.71:35706) 2023-10-09T07:57:53.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.150+0000 7fd10939b700 1 -- 172.21.15.71:0/2122971935 learned_addr learned my addr 172.21.15.71:0/2122971935 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:53.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.150+0000 7fd108b9a700 1 --2- 172.21.15.71:0/2122971935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1040cbf30 0x7fd1040aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:53.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.150+0000 7fd109b9c700 1 --2- 172.21.15.71:0/2122971935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1040ccf90 0x7fd1040c32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:53.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.151+0000 7fd10939b700 1 -- 172.21.15.71:0/2122971935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1040cbf30 msgr2=0x7fd1040aafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:53.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.151+0000 7fd10939b700 1 --2- 172.21.15.71:0/2122971935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1040cbf30 0x7fd1040aafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:53.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.151+0000 7fd10939b700 1 -- 172.21.15.71:0/2122971935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1040ccf90 msgr2=0x7fd1040c32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:53.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.151+0000 7fd10939b700 1 --2- 172.21.15.71:0/2122971935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1040ccf90 0x7fd1040c32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:53.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.151+0000 7fd10939b700 1 -- 172.21.15.71:0/2122971935 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc009ae0 con 0x7fd1040b1420 2023-10-09T07:57:53.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.151+0000 7fd109b9c700 1 --2- 172.21.15.71:0/2122971935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1040ccf90 0x7fd1040c32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:57:53.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.151+0000 7fd10939b700 1 --2- 172.21.15.71:0/2122971935 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1040b1420 0x7fd10416a5b0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fd10000c590 tx=0x7fd10000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:53.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.151+0000 7fd0f97fa700 1 -- 172.21.15.71:0/2122971935 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd100011590 con 0x7fd1040b1420 2023-10-09T07:57:53.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.151+0000 7fd0f97fa700 1 -- 172.21.15.71:0/2122971935 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd100011710 con 0x7fd1040b1420 2023-10-09T07:57:53.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.151+0000 7fd10b5ff700 1 -- 172.21.15.71:0/2122971935 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1040c1840 con 0x7fd1040b1420 2023-10-09T07:57:53.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.151+0000 7fd0f97fa700 1 -- 172.21.15.71:0/2122971935 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd100011ad0 con 0x7fd1040b1420 2023-10-09T07:57:53.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.151+0000 7fd10b5ff700 1 -- 172.21.15.71:0/2122971935 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1040c1e80 con 0x7fd1040b1420 2023-10-09T07:57:53.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.152+0000 7fd10b5ff700 1 -- 172.21.15.71:0/2122971935 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10404c3c0 con 0x7fd1040b1420 2023-10-09T07:57:53.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.153+0000 7fd0f97fa700 1 -- 172.21.15.71:0/2122971935 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd10001b3b0 con 0x7fd1040b1420 2023-10-09T07:57:53.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.154+0000 7fd0f97fa700 1 --2- 172.21.15.71:0/2122971935 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd0e8066f30 0x7fd0e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:53.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.154+0000 7fd0f97fa700 1 -- 172.21.15.71:0/2122971935 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fd100083c30 con 0x7fd1040b1420 2023-10-09T07:57:53.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.154+0000 7fd108b9a700 1 --2- 172.21.15.71:0/2122971935 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd0e8066f30 0x7fd0e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:53.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.155+0000 7fd108b9a700 1 --2- 172.21.15.71:0/2122971935 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd0e8066f30 0x7fd0e80693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4006f00 tx=0x7fd0f4008040 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:53.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.158+0000 7fd0f97fa700 1 -- 172.21.15.71:0/2122971935 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd100050cd0 con 0x7fd1040b1420 2023-10-09T07:57:53.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.393+0000 7fd10b5ff700 1 -- 172.21.15.71:0/2122971935 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd1040ad650 con 0x7fd1040b1420 2023-10-09T07:57:53.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.393+0000 7fd0f97fa700 1 -- 172.21.15.71:0/2122971935 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd100017070 con 0x7fd1040b1420 2023-10-09T07:57:53.395 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T07:57:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.396+0000 7fd10b5ff700 1 -- 172.21.15.71:0/2122971935 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd0e8066f30 msgr2=0x7fd0e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.396+0000 7fd10b5ff700 1 --2- 172.21.15.71:0/2122971935 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd0e8066f30 0x7fd0e80693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4006f00 tx=0x7fd0f4008040 comp rx=0 tx=0).stop 2023-10-09T07:57:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.396+0000 7fd10b5ff700 1 -- 172.21.15.71:0/2122971935 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1040b1420 msgr2=0x7fd10416a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.396+0000 7fd10b5ff700 1 --2- 172.21.15.71:0/2122971935 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1040b1420 0x7fd10416a5b0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fd10000c590 tx=0x7fd10000c8a0 comp rx=0 tx=0).stop 2023-10-09T07:57:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.396+0000 7fd10b5ff700 1 -- 172.21.15.71:0/2122971935 shutdown_connections 2023-10-09T07:57:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.396+0000 7fd10b5ff700 1 --2- 172.21.15.71:0/2122971935 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd0e8066f30 0x7fd0e80693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.396+0000 7fd10b5ff700 1 --2- 172.21.15.71:0/2122971935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1040ccf90 0x7fd1040c32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.396+0000 7fd10b5ff700 1 --2- 172.21.15.71:0/2122971935 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1040b1420 0x7fd10416a5b0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.396+0000 7fd10b5ff700 1 --2- 172.21.15.71:0/2122971935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1040cbf30 0x7fd1040aafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.396+0000 7fd10b5ff700 1 -- 172.21.15.71:0/2122971935 >> 172.21.15.71:0/2122971935 conn(0x7fd10406a320 msgr2=0x7fd10415a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.396+0000 7fd10b5ff700 1 -- 172.21.15.71:0/2122971935 shutdown_connections 2023-10-09T07:57:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:53.396+0000 7fd10b5ff700 1 -- 172.21.15.71:0/2122971935 wait complete. 2023-10-09T07:57:53.414 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T07:57:53.414 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T07:57:53.414 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2023-10-09T07:57:53.414 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T07:57:53.415 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T07:57:53.415 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T07:57:53.415 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T07:57:53.415 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T07:57:53.415 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T07:57:53.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:57:53.416 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2023-10-09T07:57:53.453 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T07:57:53.453 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T07:57:53.453 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T07:57:53.453 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:57:53.453 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-10-09T07:57:53.453 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:57:53.454 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T07:57:53.454 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2023-10-09T07:57:53.454 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2023-10-09T07:57:53.454 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T07:57:53.454 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2023-10-09T07:57:53.454 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2023-10-09T07:57:53.454 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T07:57:53.455 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2023-10-09T07:57:53.455 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T07:57:53.455 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2023-10-09T07:57:53.455 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T07:57:53.455 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 37762sec preferred_lft 37762sec 2023-10-09T07:57:53.455 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2023-10-09T07:57:53.456 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:57:53.456 INFO:teuthology.orchestra.run.smithi071.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T07:57:53.456 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5a:a1:ec:c7:41:8f brd ff:ff:ff:ff:ff:ff 2023-10-09T07:57:53.456 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T07:57:53.456 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:57:53.456 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::8052:a9ff:fe85:8756/64 scope link 2023-10-09T07:57:53.457 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:57:53.457 INFO:teuthology.orchestra.run.smithi071.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T07:57:53.457 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether ae:1f:c9:59:0c:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T07:57:53.457 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ac1f:c9ff:fe59:c1b/64 scope link 2023-10-09T07:57:53.457 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:57:53.457 INFO:teuthology.orchestra.run.smithi071.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T07:57:53.457 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5a:a1:ec:c7:41:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T07:57:53.458 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::58a1:ecff:fec7:418f/64 scope link 2023-10-09T07:57:53.458 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:57:53.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:57:53.458 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T07:57:53.552 INFO:teuthology.orchestra.run.smithi071.stdout:1 2023-10-09T07:57:53.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:57:53.555 DEBUG:teuthology.orchestra.run.smithi071:> route 2023-10-09T07:57:53.593 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2023-10-09T07:57:53.593 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T07:57:53.593 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T07:57:53.593 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T07:57:53.593 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T07:57:53.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:57:53.595 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-09T07:57:53.595 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-09T07:57:53.595 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T07:57:53.595 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T07:57:53.595 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T07:57:53.595 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-09T07:57:53.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:57:53.789 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-09T07:57:53.826 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T07:57:53.826 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T07:57:53.826 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T07:57:53.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:57:53.826 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2023-10-09T07:57:53.927 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T07:57:53.928 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T07:57:53.963 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T07:57:53.964 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T07:57:53.964 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T07:57:54.039 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T07:57:54.039 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T07:57:54.039 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T07:57:54.168 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T07:57:54.168 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T07:57:54.198 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T07:57:54.198 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T07:57:54.198 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.71:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-09T07:57:54.198 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with new device syntax: 0@604c5619-653a-4ab6-912c-ab2e5464fe4a.cephfs=/ 2023-10-09T07:57:54.198 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.71:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-10-09T07:57:54.202 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T07:57:54.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:57:54.203 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T07:57:54.264 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T07:57:54.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.443+0000 7f406f59d700 1 Processor -- start 2023-10-09T07:57:54.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.443+0000 7f406f59d700 1 -- start start 2023-10-09T07:57:54.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.444+0000 7f406f59d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f406806a0a0 0x7f406815b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:54.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.444+0000 7f406f59d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f406806ae70 con 0x7f406806dd20 2023-10-09T07:57:54.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.444+0000 7f406f59d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40680c8a60 con 0x7f406806d950 2023-10-09T07:57:54.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.444+0000 7f406f59d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f406806a540 con 0x7f406806a0a0 2023-10-09T07:57:54.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.444+0000 7f406dd9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f406806a0a0 0x7f406815b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:54.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.444+0000 7f406ed9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f406806dd20 0x7f406815b950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52072/0 (socket says 172.21.15.71:52072) 2023-10-09T07:57:54.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.444+0000 7f406ed9c700 1 -- 172.21.15.71:0/2985802652 learned_addr learned my addr 172.21.15.71:0/2985802652 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:54.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.445+0000 7f406dd9a700 1 -- 172.21.15.71:0/2985802652 >> v1:172.21.15.179:6789/0 conn(0x7f406806d950 legacy=0x7f40680c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:54.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.445+0000 7f406dd9a700 1 -- 172.21.15.71:0/2985802652 >> v1:172.21.15.71:6789/0 conn(0x7f406806dd20 legacy=0x7f406815b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:54.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.445+0000 7f406dd9a700 1 -- 172.21.15.71:0/2985802652 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406806a820 con 0x7f406806a0a0 2023-10-09T07:57:54.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.445+0000 7f406d599700 1 -- 172.21.15.71:0/2985802652 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524482679 0 0) 0x7f406806ae70 con 0x7f406806dd20 2023-10-09T07:57:54.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.445+0000 7f406dd9a700 1 --2- 172.21.15.71:0/2985802652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406806a0a0 0x7f406815b410 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f40580098e0 tx=0x7f40580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82d1ff174672e21 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:54.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.445+0000 7f406d599700 1 -- 172.21.15.71:0/2985802652 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4058009e80 con 0x7f406806a0a0 2023-10-09T07:57:54.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.445+0000 7f406d599700 1 -- 172.21.15.71:0/2985802652 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405800b860 con 0x7f406806a0a0 2023-10-09T07:57:54.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.445+0000 7f406d599700 1 -- 172.21.15.71:0/2985802652 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405800bbe0 con 0x7f406806a0a0 2023-10-09T07:57:54.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.446+0000 7f406f59d700 1 -- 172.21.15.71:0/2985802652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406806a0a0 msgr2=0x7f406815b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:54.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.446+0000 7f406f59d700 1 --2- 172.21.15.71:0/2985802652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406806a0a0 0x7f406815b410 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f40580098e0 tx=0x7f40580091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:54.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.446+0000 7f406f59d700 1 -- 172.21.15.71:0/2985802652 shutdown_connections 2023-10-09T07:57:54.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.446+0000 7f406f59d700 1 --2- 172.21.15.71:0/2985802652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406806a0a0 0x7f406815b410 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:54.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.446+0000 7f406f59d700 1 -- 172.21.15.71:0/2985802652 >> 172.21.15.71:0/2985802652 conn(0x7f40680cc1f0 msgr2=0x7f40680cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:54.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.446+0000 7f406f59d700 1 -- 172.21.15.71:0/2985802652 shutdown_connections 2023-10-09T07:57:54.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.446+0000 7f406f59d700 1 -- 172.21.15.71:0/2985802652 wait complete. 2023-10-09T07:57:54.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.447+0000 7f406f59d700 1 Processor -- start 2023-10-09T07:57:54.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.448+0000 7f406f59d700 1 -- start start 2023-10-09T07:57:54.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.448+0000 7f406f59d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406806a0a0 0x7f4068146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:54.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.449+0000 7f406f59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f406806d950 0x7f406815c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:54.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.449+0000 7f406f59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f406806dd20 0x7f406815c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:54.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.449+0000 7f406f59d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4068159d40 con 0x7f406806a0a0 2023-10-09T07:57:54.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.449+0000 7f406f59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4068158ca0 con 0x7f406806d950 2023-10-09T07:57:54.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.449+0000 7f406f59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4068158f80 con 0x7f406806dd20 2023-10-09T07:57:54.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.449+0000 7f406e59b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406806a0a0 0x7f4068146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:54.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.449+0000 7f406e59b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406806a0a0 0x7f4068146fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35738/0 (socket says 172.21.15.71:35738) 2023-10-09T07:57:54.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.449+0000 7f406e59b700 1 -- 172.21.15.71:0/2929240777 learned_addr learned my addr 172.21.15.71:0/2929240777 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.449+0000 7f406dd9a700 1 --2- 172.21.15.71:0/2929240777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f406806d950 0x7f406815c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.449+0000 7f406ed9c700 1 --2- 172.21.15.71:0/2929240777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f406806dd20 0x7f406815c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.449+0000 7f406e59b700 1 -- 172.21.15.71:0/2929240777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f406806dd20 msgr2=0x7f406815c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.449+0000 7f406e59b700 1 --2- 172.21.15.71:0/2929240777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f406806dd20 0x7f406815c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.449+0000 7f406e59b700 1 -- 172.21.15.71:0/2929240777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f406806d950 msgr2=0x7f406815c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.449+0000 7f406e59b700 1 --2- 172.21.15.71:0/2929240777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f406806d950 0x7f406815c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.449+0000 7f406e59b700 1 -- 172.21.15.71:0/2929240777 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4058009420 con 0x7f406806a0a0 2023-10-09T07:57:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.449+0000 7f406ed9c700 1 --2- 172.21.15.71:0/2929240777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f406806dd20 0x7f406815c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:57:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.449+0000 7f406e59b700 1 --2- 172.21.15.71:0/2929240777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406806a0a0 0x7f4068146fb0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f406400c590 tx=0x7f406400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.450+0000 7f405e7fc700 1 -- 172.21.15.71:0/2929240777 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064011590 con 0x7f406806a0a0 2023-10-09T07:57:54.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.450+0000 7f405e7fc700 1 -- 172.21.15.71:0/2929240777 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40640116f0 con 0x7f406806a0a0 2023-10-09T07:57:54.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.450+0000 7f405e7fc700 1 -- 172.21.15.71:0/2929240777 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064011ab0 con 0x7f406806a0a0 2023-10-09T07:57:54.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.450+0000 7f406f59d700 1 -- 172.21.15.71:0/2929240777 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4068159260 con 0x7f406806a0a0 2023-10-09T07:57:54.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.450+0000 7f406f59d700 1 -- 172.21.15.71:0/2929240777 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4068159820 con 0x7f406806a0a0 2023-10-09T07:57:54.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.451+0000 7f406f59d700 1 -- 172.21.15.71:0/2929240777 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4068159a40 con 0x7f406806a0a0 2023-10-09T07:57:54.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.452+0000 7f405e7fc700 1 -- 172.21.15.71:0/2929240777 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f406401b3b0 con 0x7f406806a0a0 2023-10-09T07:57:54.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.453+0000 7f405e7fc700 1 --2- 172.21.15.71:0/2929240777 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f404c066f30 0x7f404c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:54.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.453+0000 7f405e7fc700 1 -- 172.21.15.71:0/2929240777 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f4064083d50 con 0x7f406806a0a0 2023-10-09T07:57:54.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.453+0000 7f406dd9a700 1 --2- 172.21.15.71:0/2929240777 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f404c066f30 0x7f404c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:54.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.454+0000 7f406dd9a700 1 --2- 172.21.15.71:0/2929240777 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f404c066f30 0x7f404c0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f40580093f0 tx=0x7f4058017000 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:54.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.457+0000 7f405e7fc700 1 -- 172.21.15.71:0/2929240777 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4064050d50 con 0x7f406806a0a0 2023-10-09T07:57:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.675+0000 7f406f59d700 1 -- 172.21.15.71:0/2929240777 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f406804c3c0 con 0x7f404c066f30 2023-10-09T07:57:54.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.678+0000 7f405e7fc700 1 -- 172.21.15.71:0/2929240777 <== mgr.8071 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f406804c3c0 con 0x7f404c066f30 2023-10-09T07:57:54.678 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-09T07:57:54.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:57:54.678 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cephfs" 2023-10-09T07:57:54.678 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:57:54.678 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-09T07:57:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.680+0000 7f406f59d700 1 -- 172.21.15.71:0/2929240777 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f404c066f30 msgr2=0x7f404c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.680+0000 7f406f59d700 1 --2- 172.21.15.71:0/2929240777 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f404c066f30 0x7f404c0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f40580093f0 tx=0x7f4058017000 comp rx=0 tx=0).stop 2023-10-09T07:57:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.680+0000 7f406f59d700 1 -- 172.21.15.71:0/2929240777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406806a0a0 msgr2=0x7f4068146fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.680+0000 7f406f59d700 1 --2- 172.21.15.71:0/2929240777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406806a0a0 0x7f4068146fb0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f406400c590 tx=0x7f406400c950 comp rx=0 tx=0).stop 2023-10-09T07:57:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.680+0000 7f406f59d700 1 -- 172.21.15.71:0/2929240777 shutdown_connections 2023-10-09T07:57:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.680+0000 7f406f59d700 1 --2- 172.21.15.71:0/2929240777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f406806dd20 0x7f406815c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.680+0000 7f406f59d700 1 --2- 172.21.15.71:0/2929240777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f406806a0a0 0x7f4068146fb0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.680+0000 7f406f59d700 1 --2- 172.21.15.71:0/2929240777 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f404c066f30 0x7f404c0693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:54.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.680+0000 7f406f59d700 1 --2- 172.21.15.71:0/2929240777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f406806d950 0x7f406815c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:54.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.680+0000 7f406f59d700 1 -- 172.21.15.71:0/2929240777 >> 172.21.15.71:0/2929240777 conn(0x7f40680cc1f0 msgr2=0x7f4068157120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:54.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.680+0000 7f406f59d700 1 -- 172.21.15.71:0/2929240777 shutdown_connections 2023-10-09T07:57:54.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.680+0000 7f406f59d700 1 -- 172.21.15.71:0/2929240777 wait complete. 2023-10-09T07:57:54.698 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-09T07:57:54.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.885+0000 7ff93659d700 1 Processor -- start 2023-10-09T07:57:54.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.885+0000 7ff93659d700 1 -- start start 2023-10-09T07:57:54.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.886+0000 7ff93659d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9300cb1a0 0x7ff93015a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:54.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.886+0000 7ff93659d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff93015a8a0 0x7ff93006f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:54.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.887+0000 7ff93659d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93006ebd0 con 0x7ff93006f5a0 2023-10-09T07:57:54.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.887+0000 7ff93659d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93015b2e0 con 0x7ff93015a8a0 2023-10-09T07:57:54.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.887+0000 7ff93659d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93015ad20 con 0x7ff9300cb1a0 2023-10-09T07:57:54.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.887+0000 7ff934d9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff93015a8a0 0x7ff93006f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:54.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.887+0000 7ff934d9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff93015a8a0 0x7ff93006f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35748/0 (socket says 172.21.15.71:35748) 2023-10-09T07:57:54.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.887+0000 7ff934d9a700 1 -- 172.21.15.71:0/1093566624 learned_addr learned my addr 172.21.15.71:0/1093566624 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:54.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.887+0000 7ff93559b700 1 --2- 172.21.15.71:0/1093566624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9300cb1a0 0x7ff93015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:54.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.887+0000 7ff934d9a700 1 -- 172.21.15.71:0/1093566624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9300cb1a0 msgr2=0x7ff93015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:54.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.887+0000 7ff934d9a700 1 --2- 172.21.15.71:0/1093566624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9300cb1a0 0x7ff93015a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:54.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.887+0000 7ff934d9a700 1 -- 172.21.15.71:0/1093566624 >> v1:172.21.15.179:6789/0 conn(0x7ff93006f5a0 legacy=0x7ff9300ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:54.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.887+0000 7ff934d9a700 1 -- 172.21.15.71:0/1093566624 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93015b000 con 0x7ff93015a8a0 2023-10-09T07:57:54.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.888+0000 7ff934d9a700 1 --2- 172.21.15.71:0/1093566624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff93015a8a0 0x7ff93006f060 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7ff9200099b0 tx=0x7ff920009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285ed17630989ad1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:54.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.888+0000 7ff927fff700 1 -- 172.21.15.71:0/1093566624 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92000b8b0 con 0x7ff93015a8a0 2023-10-09T07:57:54.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.888+0000 7ff927fff700 1 -- 172.21.15.71:0/1093566624 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92000ba10 con 0x7ff93015a8a0 2023-10-09T07:57:54.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.888+0000 7ff927fff700 1 -- 172.21.15.71:0/1093566624 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92000bdb0 con 0x7ff93015a8a0 2023-10-09T07:57:54.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.888+0000 7ff93659d700 1 -- 172.21.15.71:0/1093566624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff93015a8a0 msgr2=0x7ff93006f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:54.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.888+0000 7ff93659d700 1 --2- 172.21.15.71:0/1093566624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff93015a8a0 0x7ff93006f060 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7ff9200099b0 tx=0x7ff920009250 comp rx=0 tx=0).stop 2023-10-09T07:57:54.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.888+0000 7ff93659d700 1 -- 172.21.15.71:0/1093566624 shutdown_connections 2023-10-09T07:57:54.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.888+0000 7ff93659d700 1 --2- 172.21.15.71:0/1093566624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9300cb1a0 0x7ff93015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:54.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.888+0000 7ff93659d700 1 --2- 172.21.15.71:0/1093566624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff93015a8a0 0x7ff93006f060 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:54.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.888+0000 7ff93659d700 1 -- 172.21.15.71:0/1093566624 >> 172.21.15.71:0/1093566624 conn(0x7ff9300cc1e0 msgr2=0x7ff9300cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:54.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.889+0000 7ff93659d700 1 -- 172.21.15.71:0/1093566624 shutdown_connections 2023-10-09T07:57:54.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.889+0000 7ff93659d700 1 -- 172.21.15.71:0/1093566624 wait complete. 2023-10-09T07:57:54.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.890+0000 7ff93659d700 1 Processor -- start 2023-10-09T07:57:54.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.890+0000 7ff93659d700 1 -- start start 2023-10-09T07:57:54.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.891+0000 7ff93659d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff93006f5a0 0x7ff930151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:54.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.891+0000 7ff93659d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9300cb1a0 0x7ff93014f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:54.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.891+0000 7ff93659d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9301591f0 0x7ff930153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:54.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.891+0000 7ff93659d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff930152d70 con 0x7ff9300cb1a0 2023-10-09T07:57:54.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.891+0000 7ff93659d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93014f7b0 con 0x7ff9301591f0 2023-10-09T07:57:54.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.891+0000 7ff93659d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff930152160 con 0x7ff93006f5a0 2023-10-09T07:57:54.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.891+0000 7ff934d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9300cb1a0 0x7ff93014f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:54.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.891+0000 7ff934d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9300cb1a0 0x7ff93014f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35750/0 (socket says 172.21.15.71:35750) 2023-10-09T07:57:54.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.891+0000 7ff934d9a700 1 -- 172.21.15.71:0/1483439294 learned_addr learned my addr 172.21.15.71:0/1483439294 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:54.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.891+0000 7ff93559b700 1 --2- 172.21.15.71:0/1483439294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff93006f5a0 0x7ff930151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:54.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.891+0000 7ff935d9c700 1 --2- 172.21.15.71:0/1483439294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9301591f0 0x7ff930153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:54.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.892+0000 7ff934d9a700 1 -- 172.21.15.71:0/1483439294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff93006f5a0 msgr2=0x7ff930151b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:54.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.892+0000 7ff934d9a700 1 --2- 172.21.15.71:0/1483439294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff93006f5a0 0x7ff930151b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:54.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.892+0000 7ff934d9a700 1 -- 172.21.15.71:0/1483439294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9301591f0 msgr2=0x7ff930153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:54.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.892+0000 7ff934d9a700 1 --2- 172.21.15.71:0/1483439294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9301591f0 0x7ff930153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:54.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.892+0000 7ff934d9a700 1 -- 172.21.15.71:0/1483439294 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9200094f0 con 0x7ff9300cb1a0 2023-10-09T07:57:54.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.892+0000 7ff935d9c700 1 --2- 172.21.15.71:0/1483439294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9301591f0 0x7ff930153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:57:54.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.892+0000 7ff934d9a700 1 --2- 172.21.15.71:0/1483439294 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9300cb1a0 0x7ff93014f270 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7ff9200094c0 tx=0x7ff920016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:54.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.892+0000 7ff9257fa700 1 -- 172.21.15.71:0/1483439294 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920011c60 con 0x7ff9300cb1a0 2023-10-09T07:57:54.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.892+0000 7ff9257fa700 1 -- 172.21.15.71:0/1483439294 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff920020070 con 0x7ff9300cb1a0 2023-10-09T07:57:54.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.892+0000 7ff93659d700 1 -- 172.21.15.71:0/1483439294 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff930152440 con 0x7ff9300cb1a0 2023-10-09T07:57:54.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.892+0000 7ff9257fa700 1 -- 172.21.15.71:0/1483439294 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92001b450 con 0x7ff9300cb1a0 2023-10-09T07:57:54.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.892+0000 7ff93659d700 1 -- 172.21.15.71:0/1483439294 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff930152a00 con 0x7ff9300cb1a0 2023-10-09T07:57:54.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.893+0000 7ff93659d700 1 -- 172.21.15.71:0/1483439294 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff930152f20 con 0x7ff9300cb1a0 2023-10-09T07:57:54.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.894+0000 7ff9257fa700 1 -- 172.21.15.71:0/1483439294 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 68) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff920022030 con 0x7ff9300cb1a0 2023-10-09T07:57:54.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.895+0000 7ff9257fa700 1 --2- 172.21.15.71:0/1483439294 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff914066f30 0x7ff9140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:54.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.895+0000 7ff9257fa700 1 -- 172.21.15.71:0/1483439294 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6169+0+0 (secure 0 0 0) 0x7ff920086080 con 0x7ff9300cb1a0 2023-10-09T07:57:54.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.895+0000 7ff93559b700 1 --2- 172.21.15.71:0/1483439294 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff914066f30 0x7ff9140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:54.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.896+0000 7ff93559b700 1 --2- 172.21.15.71:0/1483439294 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff914066f30 0x7ff9140693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff92c006fd0 tx=0x7ff92c008040 comp rx=0 tx=0).ready entity=mgr.8071 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:54.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:54.900+0000 7ff9257fa700 1 -- 172.21.15.71:0/1483439294 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff930152f20 con 0x7ff9300cb1a0 2023-10-09T07:57:55.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:55.148+0000 7ff93659d700 1 -- 172.21.15.71:0/1483439294 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7ff930152f20 con 0x7ff9300cb1a0 2023-10-09T07:57:55.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:55.771+0000 7ff9257fa700 1 -- 172.21.15.71:0/1483439294 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 69) v1 ==== 84757+0+0 (secure 0 0 0) 0x7ff9200534f0 con 0x7ff9300cb1a0 2023-10-09T07:57:55.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:55.772+0000 7ff9257fa700 1 -- 172.21.15.71:0/1483439294 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v69) v1 ==== 92+0+0 (secure 0 0 0) 0x7ff920053120 con 0x7ff9300cb1a0 2023-10-09T07:57:55.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:55.775+0000 7ff93659d700 1 -- 172.21.15.71:0/1483439294 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff914066f30 msgr2=0x7ff9140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:55.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:55.775+0000 7ff93659d700 1 --2- 172.21.15.71:0/1483439294 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff914066f30 0x7ff9140693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff92c006fd0 tx=0x7ff92c008040 comp rx=0 tx=0).stop 2023-10-09T07:57:55.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:55.775+0000 7ff93659d700 1 -- 172.21.15.71:0/1483439294 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9300cb1a0 msgr2=0x7ff93014f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:55.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:55.775+0000 7ff93659d700 1 --2- 172.21.15.71:0/1483439294 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9300cb1a0 0x7ff93014f270 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7ff9200094c0 tx=0x7ff920016000 comp rx=0 tx=0).stop 2023-10-09T07:57:55.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:55.775+0000 7ff93659d700 1 -- 172.21.15.71:0/1483439294 shutdown_connections 2023-10-09T07:57:55.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:55.775+0000 7ff93659d700 1 --2- 172.21.15.71:0/1483439294 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff914066f30 0x7ff9140693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:55.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:55.775+0000 7ff93659d700 1 --2- 172.21.15.71:0/1483439294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9301591f0 0x7ff930153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:55.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:55.775+0000 7ff93659d700 1 --2- 172.21.15.71:0/1483439294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff93006f5a0 0x7ff930151b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:55.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:55.775+0000 7ff93659d700 1 --2- 172.21.15.71:0/1483439294 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9300cb1a0 0x7ff93014f270 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:55.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:55.775+0000 7ff93659d700 1 -- 172.21.15.71:0/1483439294 >> 172.21.15.71:0/1483439294 conn(0x7ff9300cc1e0 msgr2=0x7ff9300c1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:55.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:55.776+0000 7ff93659d700 1 -- 172.21.15.71:0/1483439294 shutdown_connections 2023-10-09T07:57:55.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:55.776+0000 7ff93659d700 1 -- 172.21.15.71:0/1483439294 wait complete. 2023-10-09T07:57:55.798 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-09T07:57:56.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.007+0000 7fdfd139d700 1 Processor -- start 2023-10-09T07:57:56.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.007+0000 7fdfd139d700 1 -- start start 2023-10-09T07:57:56.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.008+0000 7fdfd139d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdfcc0b4e70 0x7fdfcc0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:56.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.009+0000 7fdfd139d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfcc0b1b40 0x7fdfcc15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:56.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.009+0000 7fdfd139d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfcc0cfb00 con 0x7fdfcc0b16d0 2023-10-09T07:57:56.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.009+0000 7fdfd139d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfcc0b5c40 con 0x7fdfcc0b4e70 2023-10-09T07:57:56.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.009+0000 7fdfd139d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc0b5f20 con 0x7fdfcc0b1b40 2023-10-09T07:57:56.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.009+0000 7fdfcbfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdfcc0b4e70 0x7fdfcc0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:56.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.009+0000 7fdfcbfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdfcc0b4e70 0x7fdfcc0ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59942/0 (socket says 172.21.15.71:59942) 2023-10-09T07:57:56.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.009+0000 7fdfcbfff700 1 -- 172.21.15.71:0/458560140 learned_addr learned my addr 172.21.15.71:0/458560140 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:56.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.009+0000 7fdfd0b9c700 1 --2- 172.21.15.71:0/458560140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfcc0b1b40 0x7fdfcc15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:56.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.009+0000 7fdfcbfff700 1 -- 172.21.15.71:0/458560140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfcc0b1b40 msgr2=0x7fdfcc15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:56.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.009+0000 7fdfcbfff700 1 --2- 172.21.15.71:0/458560140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfcc0b1b40 0x7fdfcc15d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:56.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.009+0000 7fdfcbfff700 1 -- 172.21.15.71:0/458560140 >> v1:172.21.15.179:6789/0 conn(0x7fdfcc0b16d0 legacy=0x7fdfcc15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:56.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.009+0000 7fdfcbfff700 1 -- 172.21.15.71:0/458560140 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc0b6200 con 0x7fdfcc0b4e70 2023-10-09T07:57:56.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.010+0000 7fdfcbfff700 1 --2- 172.21.15.71:0/458560140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfcc0b4e70 0x7fdfcc0ccff0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0099b0 tx=0x7fdfbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7051cf7654fbe8e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:56.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.010+0000 7fdfcaffd700 1 -- 172.21.15.71:0/458560140 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc00b860 con 0x7fdfcc0b4e70 2023-10-09T07:57:56.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.010+0000 7fdfcaffd700 1 -- 172.21.15.71:0/458560140 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc00b9c0 con 0x7fdfcc0b4e70 2023-10-09T07:57:56.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.010+0000 7fdfcaffd700 1 -- 172.21.15.71:0/458560140 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc00bd60 con 0x7fdfcc0b4e70 2023-10-09T07:57:56.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.011+0000 7fdfd139d700 1 -- 172.21.15.71:0/458560140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfcc0b4e70 msgr2=0x7fdfcc0ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:56.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.011+0000 7fdfd139d700 1 --2- 172.21.15.71:0/458560140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfcc0b4e70 0x7fdfcc0ccff0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0099b0 tx=0x7fdfbc009250 comp rx=0 tx=0).stop 2023-10-09T07:57:56.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.011+0000 7fdfd139d700 1 -- 172.21.15.71:0/458560140 shutdown_connections 2023-10-09T07:57:56.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.011+0000 7fdfd139d700 1 --2- 172.21.15.71:0/458560140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfcc0b1b40 0x7fdfcc15d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:56.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.011+0000 7fdfd139d700 1 --2- 172.21.15.71:0/458560140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfcc0b4e70 0x7fdfcc0ccff0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:56.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.011+0000 7fdfd139d700 1 -- 172.21.15.71:0/458560140 >> 172.21.15.71:0/458560140 conn(0x7fdfcc0d10c0 msgr2=0x7fdfcc0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:56.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.011+0000 7fdfd139d700 1 -- 172.21.15.71:0/458560140 shutdown_connections 2023-10-09T07:57:56.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.011+0000 7fdfd139d700 1 -- 172.21.15.71:0/458560140 wait complete. 2023-10-09T07:57:56.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.012+0000 7fdfd139d700 1 Processor -- start 2023-10-09T07:57:56.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.012+0000 7fdfd139d700 1 -- start start 2023-10-09T07:57:56.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.013+0000 7fdfd139d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfcc0b16d0 0x7fdfcc157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:56.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.013+0000 7fdfd139d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfcc0b1b40 0x7fdfcc0c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:56.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.013+0000 7fdfd139d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfcc0b4e70 0x7fdfcc068390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:56.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.013+0000 7fdfd139d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc157c40 con 0x7fdfcc0b1b40 2023-10-09T07:57:56.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.013+0000 7fdfd139d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc16a240 con 0x7fdfcc0b4e70 2023-10-09T07:57:56.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.013+0000 7fdfd139d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc0ca620 con 0x7fdfcc0b16d0 2023-10-09T07:57:56.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.014+0000 7fdfcb7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfcc0b1b40 0x7fdfcc0c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:56.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.014+0000 7fdfcb7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfcc0b1b40 0x7fdfcc0c9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59948/0 (socket says 172.21.15.71:59948) 2023-10-09T07:57:56.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.014+0000 7fdfcbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfcc0b16d0 0x7fdfcc157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:56.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.014+0000 7fdfcb7fe700 1 -- 172.21.15.71:0/3333910243 learned_addr learned my addr 172.21.15.71:0/3333910243 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:56.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.014+0000 7fdfd0b9c700 1 --2- 172.21.15.71:0/3333910243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfcc0b4e70 0x7fdfcc068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:56.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.014+0000 7fdfcb7fe700 1 -- 172.21.15.71:0/3333910243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfcc0b16d0 msgr2=0x7fdfcc157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:56.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.014+0000 7fdfcb7fe700 1 --2- 172.21.15.71:0/3333910243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfcc0b16d0 0x7fdfcc157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:56.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.014+0000 7fdfcb7fe700 1 -- 172.21.15.71:0/3333910243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfcc0b4e70 msgr2=0x7fdfcc068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:56.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.014+0000 7fdfcb7fe700 1 --2- 172.21.15.71:0/3333910243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfcc0b4e70 0x7fdfcc068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:56.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.014+0000 7fdfcb7fe700 1 -- 172.21.15.71:0/3333910243 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc0094f0 con 0x7fdfcc0b1b40 2023-10-09T07:57:56.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.014+0000 7fdfcb7fe700 1 --2- 172.21.15.71:0/3333910243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfcc0b1b40 0x7fdfcc0c9dd0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fdfc000c4e0 tx=0x7fdfc000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:56.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.015+0000 7fdfb3fff700 1 -- 172.21.15.71:0/3333910243 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0011590 con 0x7fdfcc0b1b40 2023-10-09T07:57:56.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.015+0000 7fdfb3fff700 1 -- 172.21.15.71:0/3333910243 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc0011710 con 0x7fdfcc0b1b40 2023-10-09T07:57:56.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.015+0000 7fdfb3fff700 1 -- 172.21.15.71:0/3333910243 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0011ad0 con 0x7fdfcc0b1b40 2023-10-09T07:57:56.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.015+0000 7fdfd139d700 1 -- 172.21.15.71:0/3333910243 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfcc0ca900 con 0x7fdfcc0b1b40 2023-10-09T07:57:56.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.015+0000 7fdfd139d700 1 -- 172.21.15.71:0/3333910243 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfcc169ed0 con 0x7fdfcc0b1b40 2023-10-09T07:57:56.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.016+0000 7fdfd139d700 1 -- 172.21.15.71:0/3333910243 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfcc088990 con 0x7fdfcc0b1b40 2023-10-09T07:57:56.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.017+0000 7fdfb3fff700 1 -- 172.21.15.71:0/3333910243 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 69) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fdfc001b3b0 con 0x7fdfcc0b1b40 2023-10-09T07:57:56.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.019+0000 7fdfb3fff700 1 --2- 172.21.15.71:0/3333910243 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdfb8066f80 0x7fdfb8069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:56.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.019+0000 7fdfb3fff700 1 -- 172.21.15.71:0/3333910243 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fdfc0083bc0 con 0x7fdfcc0b1b40 2023-10-09T07:57:56.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.019+0000 7fdfcbfff700 1 -- 172.21.15.71:0/3333910243 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdfb8066f80 msgr2=0x7fdfb8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:56.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.019+0000 7fdfcbfff700 1 --2- 172.21.15.71:0/3333910243 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdfb8066f80 0x7fdfb8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:57:56.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.023+0000 7fdfb3fff700 1 -- 172.21.15.71:0/3333910243 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfc0050bc0 con 0x7fdfcc0b1b40 2023-10-09T07:57:56.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.220+0000 7fdfcbfff700 1 -- 172.21.15.71:0/3333910243 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdfb8066f80 msgr2=0x7fdfb8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:56.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.220+0000 7fdfcbfff700 1 --2- 172.21.15.71:0/3333910243 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdfb8066f80 0x7fdfb8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:57:56.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.246+0000 7fdfd139d700 1 -- 172.21.15.71:0/3333910243 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fdfcc16a380 con 0x7fdfcc0b1b40 2023-10-09T07:57:56.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.252+0000 7fdfb3fff700 1 -- 172.21.15.71:0/3333910243 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v53)=0 v53) v1 ==== 138+0+0 (secure 0 0 0) 0x7fdfc0017070 con 0x7fdfcc0b1b40 2023-10-09T07:57:56.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.254+0000 7fdfd139d700 1 -- 172.21.15.71:0/3333910243 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdfb8066f80 msgr2=0x7fdfb8069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:57:56.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.254+0000 7fdfd139d700 1 --2- 172.21.15.71:0/3333910243 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdfb8066f80 0x7fdfb8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:56.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.254+0000 7fdfd139d700 1 -- 172.21.15.71:0/3333910243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfcc0b1b40 msgr2=0x7fdfcc0c9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:56.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.254+0000 7fdfd139d700 1 --2- 172.21.15.71:0/3333910243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfcc0b1b40 0x7fdfcc0c9dd0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fdfc000c4e0 tx=0x7fdfc000c7f0 comp rx=0 tx=0).stop 2023-10-09T07:57:56.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.254+0000 7fdfd139d700 1 -- 172.21.15.71:0/3333910243 shutdown_connections 2023-10-09T07:57:56.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.254+0000 7fdfd139d700 1 --2- 172.21.15.71:0/3333910243 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fdfb8066f80 0x7fdfb8069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:56.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.254+0000 7fdfd139d700 1 --2- 172.21.15.71:0/3333910243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfcc0b4e70 0x7fdfcc068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:56.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.254+0000 7fdfd139d700 1 --2- 172.21.15.71:0/3333910243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfcc0b16d0 0x7fdfcc157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:56.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.254+0000 7fdfd139d700 1 --2- 172.21.15.71:0/3333910243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfcc0b1b40 0x7fdfcc0c9dd0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:56.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.254+0000 7fdfd139d700 1 -- 172.21.15.71:0/3333910243 >> 172.21.15.71:0/3333910243 conn(0x7fdfcc0d10c0 msgr2=0x7fdfcc15ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:56.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.254+0000 7fdfd139d700 1 -- 172.21.15.71:0/3333910243 shutdown_connections 2023-10-09T07:57:56.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.254+0000 7fdfd139d700 1 -- 172.21.15.71:0/3333910243 wait complete. 2023-10-09T07:57:56.275 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-09T07:57:56.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.466+0000 7fbdd17ff700 1 Processor -- start 2023-10-09T07:57:56.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.466+0000 7fbdd17ff700 1 -- start start 2023-10-09T07:57:56.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.467+0000 7fbdd17ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbdcc06bcd0 0x7fbdcc140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:56.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.467+0000 7fbdd17ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbdcc0c9510 0x7fbdcc141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:56.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.467+0000 7fbdd17ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdcc15c2a0 con 0x7fbdcc06c0a0 2023-10-09T07:57:56.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.467+0000 7fbdd17ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdcc0c9900 con 0x7fbdcc0c9510 2023-10-09T07:57:56.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.467+0000 7fbdd17ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdcc15b690 con 0x7fbdcc06bcd0 2023-10-09T07:57:56.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.468+0000 7fbdcb7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbdcc0c9510 0x7fbdcc141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:56.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.468+0000 7fbdcaffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbdcc06bcd0 0x7fbdcc140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:56.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.468+0000 7fbdcaffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbdcc06bcd0 0x7fbdcc140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:57214/0 (socket says 172.21.15.71:57214) 2023-10-09T07:57:56.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.468+0000 7fbdcb7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbdcc0c9510 0x7fbdcc141330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59958/0 (socket says 172.21.15.71:59958) 2023-10-09T07:57:56.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.468+0000 7fbdcaffd700 1 -- 172.21.15.71:0/2321297632 learned_addr learned my addr 172.21.15.71:0/2321297632 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:56.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.468+0000 7fbdca7fc700 1 --1- 172.21.15.71:0/2321297632 >> v1:172.21.15.179:6789/0 conn(0x7fbdcc06c0a0 0x7fbdcc0c8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:40864/0 (socket says 172.21.15.71:40864) 2023-10-09T07:57:56.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.468+0000 7fbdcb7fe700 1 -- 172.21.15.71:0/2321297632 >> v2:172.21.15.179:3300/0 conn(0x7fbdcc06bcd0 msgr2=0x7fbdcc140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:56.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.468+0000 7fbdcb7fe700 1 --2- 172.21.15.71:0/2321297632 >> v2:172.21.15.179:3300/0 conn(0x7fbdcc06bcd0 0x7fbdcc140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:56.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.468+0000 7fbdcb7fe700 1 -- 172.21.15.71:0/2321297632 >> v1:172.21.15.179:6789/0 conn(0x7fbdcc06c0a0 legacy=0x7fbdcc0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:56.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.468+0000 7fbdcb7fe700 1 -- 172.21.15.71:0/2321297632 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdcc15b970 con 0x7fbdcc0c9510 2023-10-09T07:57:56.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.469+0000 7fbdcb7fe700 1 --2- 172.21.15.71:0/2321297632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdcc0c9510 0x7fbdcc141330 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0cafd0 tx=0x7fbdc4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d7d790b9b383c80 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:56.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.469+0000 7fbdc9ffb700 1 -- 172.21.15.71:0/2321297632 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc400e070 con 0x7fbdcc0c9510 2023-10-09T07:57:56.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.469+0000 7fbdc9ffb700 1 -- 172.21.15.71:0/2321297632 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc400bb60 con 0x7fbdcc0c9510 2023-10-09T07:57:56.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.469+0000 7fbdc9ffb700 1 -- 172.21.15.71:0/2321297632 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4012430 con 0x7fbdcc0c9510 2023-10-09T07:57:56.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.470+0000 7fbdd17ff700 1 -- 172.21.15.71:0/2321297632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdcc0c9510 msgr2=0x7fbdcc141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:56.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.470+0000 7fbdd17ff700 1 --2- 172.21.15.71:0/2321297632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdcc0c9510 0x7fbdcc141330 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0cafd0 tx=0x7fbdc4009780 comp rx=0 tx=0).stop 2023-10-09T07:57:56.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.470+0000 7fbdd17ff700 1 -- 172.21.15.71:0/2321297632 shutdown_connections 2023-10-09T07:57:56.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.470+0000 7fbdd17ff700 1 --2- 172.21.15.71:0/2321297632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdcc0c9510 0x7fbdcc141330 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:56.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.470+0000 7fbdd17ff700 1 --2- 172.21.15.71:0/2321297632 >> v2:172.21.15.179:3300/0 conn(0x7fbdcc06bcd0 0x7fbdcc140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:56.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.470+0000 7fbdd17ff700 1 -- 172.21.15.71:0/2321297632 >> 172.21.15.71:0/2321297632 conn(0x7fbdcc0ce600 msgr2=0x7fbdcc0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:56.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.470+0000 7fbdd17ff700 1 -- 172.21.15.71:0/2321297632 shutdown_connections 2023-10-09T07:57:56.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.470+0000 7fbdd17ff700 1 -- 172.21.15.71:0/2321297632 wait complete. 2023-10-09T07:57:56.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.471+0000 7fbdd17ff700 1 Processor -- start 2023-10-09T07:57:56.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.472+0000 7fbdd17ff700 1 -- start start 2023-10-09T07:57:56.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.472+0000 7fbdd17ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdcc06bcd0 0x7fbdcc16ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:56.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.472+0000 7fbdd17ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdcc06c0a0 0x7fbdcc13f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:56.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.472+0000 7fbdd17ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdcc0c9510 0x7fbdcc0b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:56.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.472+0000 7fbdd17ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc16b220 con 0x7fbdcc06c0a0 2023-10-09T07:57:56.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.472+0000 7fbdd17ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc0c6360 con 0x7fbdcc06bcd0 2023-10-09T07:57:56.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.472+0000 7fbdd17ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc0c5750 con 0x7fbdcc0c9510 2023-10-09T07:57:56.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.473+0000 7fbdcaffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdcc06bcd0 0x7fbdcc16ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:56.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.473+0000 7fbdca7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdcc06c0a0 0x7fbdcc13f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:56.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.473+0000 7fbdcaffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdcc06bcd0 0x7fbdcc16ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:57226/0 (socket says 172.21.15.71:57226) 2023-10-09T07:57:56.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.473+0000 7fbdcaffd700 1 -- 172.21.15.71:0/3873733740 learned_addr learned my addr 172.21.15.71:0/3873733740 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:56.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.473+0000 7fbdcb7fe700 1 --2- 172.21.15.71:0/3873733740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdcc0c9510 0x7fbdcc0b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:56.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.473+0000 7fbdcaffd700 1 -- 172.21.15.71:0/3873733740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdcc0c9510 msgr2=0x7fbdcc0b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:56.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.473+0000 7fbdcaffd700 1 --2- 172.21.15.71:0/3873733740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdcc0c9510 0x7fbdcc0b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:56.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.473+0000 7fbdcaffd700 1 -- 172.21.15.71:0/3873733740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdcc06c0a0 msgr2=0x7fbdcc13f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:56.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.473+0000 7fbdcaffd700 1 --2- 172.21.15.71:0/3873733740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdcc06c0a0 0x7fbdcc13f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:56.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.473+0000 7fbdcaffd700 1 -- 172.21.15.71:0/3873733740 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc4009a20 con 0x7fbdcc06bcd0 2023-10-09T07:57:56.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.474+0000 7fbdcaffd700 1 --2- 172.21.15.71:0/3873733740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdcc06bcd0 0x7fbdcc16ace0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00ea80 tx=0x7fbdbc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:56.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.474+0000 7fbdb2ffd700 1 -- 172.21.15.71:0/3873733740 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc00ee60 con 0x7fbdcc06bcd0 2023-10-09T07:57:56.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.474+0000 7fbdb2ffd700 1 -- 172.21.15.71:0/3873733740 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdbc00c850 con 0x7fbdcc06bcd0 2023-10-09T07:57:56.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.474+0000 7fbdb2ffd700 1 -- 172.21.15.71:0/3873733740 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc00cbd0 con 0x7fbdcc06bcd0 2023-10-09T07:57:56.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.474+0000 7fbdd17ff700 1 -- 172.21.15.71:0/3873733740 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdcc0c5a30 con 0x7fbdcc06bcd0 2023-10-09T07:57:56.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.474+0000 7fbdd17ff700 1 -- 172.21.15.71:0/3873733740 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdcc0c5ff0 con 0x7fbdcc06bcd0 2023-10-09T07:57:56.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.475+0000 7fbdd17ff700 1 -- 172.21.15.71:0/3873733740 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdcc0c6640 con 0x7fbdcc06bcd0 2023-10-09T07:57:56.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.477+0000 7fbdb2ffd700 1 -- 172.21.15.71:0/3873733740 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 69) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fbdbc013470 con 0x7fbdcc06bcd0 2023-10-09T07:57:56.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.478+0000 7fbdb2ffd700 1 --2- 172.21.15.71:0/3873733740 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fbdb8066f80 0x7fbdb8069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:56.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.478+0000 7fbdb2ffd700 1 -- 172.21.15.71:0/3873733740 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fbdbc084850 con 0x7fbdcc06bcd0 2023-10-09T07:57:56.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.478+0000 7fbdca7fc700 1 -- 172.21.15.71:0/3873733740 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fbdb8066f80 msgr2=0x7fbdb8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:56.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.478+0000 7fbdca7fc700 1 --2- 172.21.15.71:0/3873733740 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fbdb8066f80 0x7fbdb8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:57:56.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.482+0000 7fbdb2ffd700 1 -- 172.21.15.71:0/3873733740 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbdbc0518f0 con 0x7fbdcc06bcd0 2023-10-09T07:57:56.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.679+0000 7fbdca7fc700 1 -- 172.21.15.71:0/3873733740 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fbdb8066f80 msgr2=0x7fbdb8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:56.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.679+0000 7fbdca7fc700 1 --2- 172.21.15.71:0/3873733740 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fbdb8066f80 0x7fbdb8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:57:56.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.686+0000 7fbdd17ff700 1 -- 172.21.15.71:0/3873733740 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fbdcc04c3c0 con 0x7fbdcc06bcd0 2023-10-09T07:57:56.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.692+0000 7fbdb2ffd700 1 -- 172.21.15.71:0/3873733740 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v54)=0 v54) v1 ==== 133+0+0 (secure 0 0 0) 0x7fbdbc054f10 con 0x7fbdcc06bcd0 2023-10-09T07:57:56.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.694+0000 7fbdd17ff700 1 -- 172.21.15.71:0/3873733740 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fbdb8066f80 msgr2=0x7fbdb8069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:57:56.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.694+0000 7fbdd17ff700 1 --2- 172.21.15.71:0/3873733740 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fbdb8066f80 0x7fbdb8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:56.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.694+0000 7fbdd17ff700 1 -- 172.21.15.71:0/3873733740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdcc06bcd0 msgr2=0x7fbdcc16ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:56.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.694+0000 7fbdd17ff700 1 --2- 172.21.15.71:0/3873733740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdcc06bcd0 0x7fbdcc16ace0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00ea80 tx=0x7fbdbc009250 comp rx=0 tx=0).stop 2023-10-09T07:57:56.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.695+0000 7fbdd17ff700 1 -- 172.21.15.71:0/3873733740 shutdown_connections 2023-10-09T07:57:56.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.695+0000 7fbdd17ff700 1 --2- 172.21.15.71:0/3873733740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdcc0c9510 0x7fbdcc0b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:56.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.695+0000 7fbdd17ff700 1 --2- 172.21.15.71:0/3873733740 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fbdb8066f80 0x7fbdb8069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:56.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.695+0000 7fbdd17ff700 1 --2- 172.21.15.71:0/3873733740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdcc06bcd0 0x7fbdcc16ace0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:56.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.695+0000 7fbdd17ff700 1 --2- 172.21.15.71:0/3873733740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdcc06c0a0 0x7fbdcc13f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:56.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.695+0000 7fbdd17ff700 1 -- 172.21.15.71:0/3873733740 >> 172.21.15.71:0/3873733740 conn(0x7fbdcc0ce600 msgr2=0x7fbdcc159180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:56.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.695+0000 7fbdd17ff700 1 -- 172.21.15.71:0/3873733740 shutdown_connections 2023-10-09T07:57:56.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.695+0000 7fbdd17ff700 1 -- 172.21.15.71:0/3873733740 wait complete. 2023-10-09T07:57:56.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:57:56.715 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-09T07:57:56.763 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1h 2023-10-09T07:57:57.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.999+0000 7f3c1e5ff700 1 Processor -- start 2023-10-09T07:57:57.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:56.999+0000 7f3c1e5ff700 1 -- start start 2023-10-09T07:57:57.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.000+0000 7f3c1e5ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3c18157740 0x7f3c180adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:57.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.000+0000 7f3c1e5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c180b2100 0x7f3c18068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:57.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.000+0000 7f3c1e5ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c1806dc20 con 0x7f3c180688d0 2023-10-09T07:57:57.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.000+0000 7f3c1e5ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c180acc00 con 0x7f3c18157740 2023-10-09T07:57:57.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.000+0000 7f3c1e5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1806d6a0 con 0x7f3c180b2100 2023-10-09T07:57:57.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.000+0000 7f3c1cb9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3c180688d0 0x7f3c18069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60964/0 (socket says 172.21.15.71:60964) 2023-10-09T07:57:57.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.001+0000 7f3c1cb9c700 1 -- 172.21.15.71:0/1228613247 learned_addr learned my addr 172.21.15.71:0/1228613247 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:57:57.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.001+0000 7f3c17fff700 1 --2- 172.21.15.71:0/1228613247 >> v2:172.21.15.71:3300/0 conn(0x7f3c18157740 0x7f3c180adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:57.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.001+0000 7f3c177fe700 1 --2- 172.21.15.71:0/1228613247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c180b2100 0x7f3c18068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:57.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.001+0000 7f3c16ffd700 1 -- 172.21.15.71:0/1228613247 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149441802 0 0) 0x7f3c1806dc20 con 0x7f3c180688d0 2023-10-09T07:57:57.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.001+0000 7f3c16ffd700 1 -- 172.21.15.71:0/1228613247 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c00003570 con 0x7f3c180688d0 2023-10-09T07:57:57.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.001+0000 7f3c17fff700 1 -- 172.21.15.71:0/1228613247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c180b2100 msgr2=0x7f3c18068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:57:57.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.001+0000 7f3c17fff700 1 --2- 172.21.15.71:0/1228613247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c180b2100 0x7f3c18068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:57.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.001+0000 7f3c17fff700 1 -- 172.21.15.71:0/1228613247 >> v1:172.21.15.71:6789/0 conn(0x7f3c180688d0 legacy=0x7f3c18069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:57.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.001+0000 7f3c17fff700 1 -- 172.21.15.71:0/1228613247 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c180ae910 con 0x7f3c18157740 2023-10-09T07:57:57.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.002+0000 7f3c17fff700 1 --2- 172.21.15.71:0/1228613247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c18157740 0x7f3c180adfc0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f3c080098e0 tx=0x7f3c080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22a068e6184492b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:57.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.002+0000 7f3c16ffd700 1 -- 172.21.15.71:0/1228613247 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08011630 con 0x7f3c18157740 2023-10-09T07:57:57.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.002+0000 7f3c16ffd700 1 -- 172.21.15.71:0/1228613247 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c08011790 con 0x7f3c18157740 2023-10-09T07:57:57.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.002+0000 7f3c16ffd700 1 -- 172.21.15.71:0/1228613247 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08011b30 con 0x7f3c18157740 2023-10-09T07:57:57.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.003+0000 7f3c1e5ff700 1 -- 172.21.15.71:0/1228613247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c18157740 msgr2=0x7f3c180adfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:57.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.003+0000 7f3c1e5ff700 1 --2- 172.21.15.71:0/1228613247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c18157740 0x7f3c180adfc0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f3c080098e0 tx=0x7f3c080091a0 comp rx=0 tx=0).stop 2023-10-09T07:57:57.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.003+0000 7f3c1e5ff700 1 -- 172.21.15.71:0/1228613247 shutdown_connections 2023-10-09T07:57:57.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.003+0000 7f3c1e5ff700 1 --2- 172.21.15.71:0/1228613247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c18157740 0x7f3c180adfc0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:57.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.003+0000 7f3c1e5ff700 1 --2- 172.21.15.71:0/1228613247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c180b2100 0x7f3c18068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:57.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.003+0000 7f3c1e5ff700 1 -- 172.21.15.71:0/1228613247 >> 172.21.15.71:0/1228613247 conn(0x7f3c180c8f90 msgr2=0x7f3c180c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:57:57.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.003+0000 7f3c1e5ff700 1 -- 172.21.15.71:0/1228613247 shutdown_connections 2023-10-09T07:57:57.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.003+0000 7f3c1e5ff700 1 -- 172.21.15.71:0/1228613247 wait complete. 2023-10-09T07:57:57.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.005+0000 7f3c1e5ff700 1 Processor -- start 2023-10-09T07:57:57.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.005+0000 7f3c1e5ff700 1 -- start start 2023-10-09T07:57:57.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.007+0000 7f3c1e5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c180688d0 0x7f3c180aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:57.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.007+0000 7f3c1e5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c180b2100 0x7f3c1815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:57.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.007+0000 7f3c1e5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c18157740 0x7f3c1815a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:57.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.007+0000 7f3c1e5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c180c6ac0 con 0x7f3c18157740 2023-10-09T07:57:57.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.007+0000 7f3c1e5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1815c420 con 0x7f3c180b2100 2023-10-09T07:57:57.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.007+0000 7f3c1e5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1815c6e0 con 0x7f3c180688d0 2023-10-09T07:57:57.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.007+0000 7f3c1cb9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c18157740 0x7f3c1815a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:57.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.007+0000 7f3c1cb9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c18157740 0x7f3c1815a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59988/0 (socket says 172.21.15.71:59988) 2023-10-09T07:57:57.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.007+0000 7f3c1cb9c700 1 -- 172.21.15.71:0/1758550759 learned_addr learned my addr 172.21.15.71:0/1758550759 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:57:57.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.007+0000 7f3c17fff700 1 --2- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c180688d0 0x7f3c180aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:57.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.007+0000 7f3c177fe700 1 --2- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c180b2100 0x7f3c1815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:57:57.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.008+0000 7f3c177fe700 1 -- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c180688d0 msgr2=0x7f3c180aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:57.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.008+0000 7f3c177fe700 1 --2- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c180688d0 0x7f3c180aae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:57.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.008+0000 7f3c177fe700 1 -- 172.21.15.71:0/1758550759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c18157740 msgr2=0x7f3c1815a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:57:57.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.008+0000 7f3c177fe700 1 --2- 172.21.15.71:0/1758550759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c18157740 0x7f3c1815a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:57:57.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.008+0000 7f3c177fe700 1 -- 172.21.15.71:0/1758550759 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c08009420 con 0x7f3c180b2100 2023-10-09T07:57:57.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.008+0000 7f3c1cb9c700 1 --2- 172.21.15.71:0/1758550759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c18157740 0x7f3c1815a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:57:57.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.008+0000 7f3c177fe700 1 --2- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c180b2100 0x7f3c1815bee0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00ea50 tx=0x7f3c0c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:57:57.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.008+0000 7f3bfffff700 1 -- 172.21.15.71:0/1758550759 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c00ee90 con 0x7f3c180b2100 2023-10-09T07:57:57.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.008+0000 7f3bfffff700 1 -- 172.21.15.71:0/1758550759 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0c00c7f0 con 0x7f3c180b2100 2023-10-09T07:57:57.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.008+0000 7f3bfffff700 1 -- 172.21.15.71:0/1758550759 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c00cb90 con 0x7f3c180b2100 2023-10-09T07:57:57.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.008+0000 7f3c1e5ff700 1 -- 172.21.15.71:0/1758550759 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c1815c9c0 con 0x7f3c180b2100 2023-10-09T07:57:57.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.009+0000 7f3c1e5ff700 1 -- 172.21.15.71:0/1758550759 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c1815cf80 con 0x7f3c180b2100 2023-10-09T07:57:57.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.010+0000 7f3c1e5ff700 1 -- 172.21.15.71:0/1758550759 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c180718b0 con 0x7f3c180b2100 2023-10-09T07:57:57.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.011+0000 7f3bfffff700 1 -- 172.21.15.71:0/1758550759 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 69) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f3c0c005a00 con 0x7f3c180b2100 2023-10-09T07:57:57.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.012+0000 7f3bfffff700 1 --2- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c04066fb0 0x7f3c04069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:57:57.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.012+0000 7f3bfffff700 1 -- 172.21.15.71:0/1758550759 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f3c0c084a70 con 0x7f3c180b2100 2023-10-09T07:57:57.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.012+0000 7f3c17fff700 1 -- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c04066fb0 msgr2=0x7f3c04069460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:57.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.012+0000 7f3c17fff700 1 --2- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c04066fb0 0x7f3c04069460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:57:57.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.015+0000 7f3bfffff700 1 -- 172.21.15.71:0/1758550759 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c0c051af0 con 0x7f3c180b2100 2023-10-09T07:57:57.053 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:57.053+0000 7f8456456180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T07:57:57.161 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:57.160+0000 7f0d56646180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T07:57:57.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.213+0000 7f3c17fff700 1 -- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c04066fb0 msgr2=0x7f3c04069460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:57.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.213+0000 7f3c17fff700 1 --2- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c04066fb0 0x7f3c04069460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:57:57.214 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:57.214+0000 7f8456456180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T07:57:57.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.249+0000 7f3c1e5ff700 1 -- 172.21.15.71:0/1758550759 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c180678d0 con 0x7f3c04066fb0 2023-10-09T07:57:57.300 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:57.300+0000 7f8456456180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T07:57:57.325 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:57.325+0000 7f0d56646180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T07:57:57.409 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:57.409+0000 7f0d56646180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T07:57:57.522 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:57.522+0000 7f8456456180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:57:57.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.614+0000 7f3c17fff700 1 -- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c04066fb0 msgr2=0x7f3c04069460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:57.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:57.614+0000 7f3c17fff700 1 --2- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c04066fb0 0x7f3c04069460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T07:57:57.633 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:57.633+0000 7f0d56646180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:57:57.699 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:57.699+0000 7f8456456180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T07:57:57.794 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:57.794+0000 7f8456456180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T07:57:57.814 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:57.813+0000 7f0d56646180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T07:57:57.904 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:57.903+0000 7f0d56646180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T07:57:57.955 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:57.955+0000 7f8456456180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T07:57:58.055 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:58.055+0000 7f8456456180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T07:57:58.065 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:58.064+0000 7f0d56646180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T07:57:58.165 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:58.164+0000 7f0d56646180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T07:57:58.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:58.415+0000 7f3c17fff700 1 -- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c04066fb0 msgr2=0x7f3c04069460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:57:58.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:57:58.415+0000 7f3c17fff700 1 --2- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c04066fb0 0x7f3c04069460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T07:57:58.534 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:58.534+0000 7f8456456180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T07:57:58.629 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:58.629+0000 7f8456456180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T07:57:58.644 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:58.645+0000 7f0d56646180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T07:57:58.718 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:58.718+0000 7f8456456180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T07:57:58.738 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:58.739+0000 7f0d56646180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T07:57:58.828 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:58.828+0000 7f0d56646180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T07:57:59.338 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:59.338+0000 7f8456456180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T07:57:59.445 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:59.445+0000 7f0d56646180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T07:57:59.509 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:59.508+0000 7f8456456180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:57:59.603 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:59.603+0000 7f8456456180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T07:57:59.616 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:59.616+0000 7f0d56646180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:57:59.712 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:57:59.713+0000 7f0d56646180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T07:57:59.895 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:59.895+0000 7f8456456180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T07:57:59.990 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:57:59.990+0000 7f8456456180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T07:58:00.005 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:00.005+0000 7f0d56646180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T07:58:00.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:00.018+0000 7f3c17fff700 1 -- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c04066fb0 msgr2=0x7f3c04069460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:00.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:00.018+0000 7f3c17fff700 1 --2- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c04066fb0 0x7f3c04069460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-09T07:58:00.100 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:00.100+0000 7f0d56646180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T07:58:00.686 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:00.686+0000 7f8456456180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T07:58:00.798 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:00.798+0000 7f0d56646180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T07:58:00.971 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:00.971+0000 7f8456456180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T07:58:01.063 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:01.063+0000 7f8456456180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T07:58:01.081 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:01.082+0000 7f0d56646180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T07:58:01.174 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:01.175+0000 7f0d56646180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T07:58:01.216 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:01.216+0000 7f8456456180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T07:58:01.321 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:01.321+0000 7f8456456180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T07:58:01.327 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:01.328+0000 7f0d56646180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T07:58:01.432 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:01.432+0000 7f0d56646180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T07:58:01.509 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:01.509+0000 7f8456456180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T07:58:01.601 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:01.601+0000 7f8456456180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T07:58:01.618 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:01.619+0000 7f0d56646180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T07:58:01.693 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:01.693+0000 7f8456456180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T07:58:01.710 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:01.710+0000 7f0d56646180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T07:58:01.786 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:01.786+0000 7f8456456180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T07:58:01.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:01.797+0000 7f3bfffff700 1 -- 172.21.15.71:0/1758550759 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mgrmap(e 70) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f3c0c051ec0 con 0x7f3c180b2100 2023-10-09T07:58:01.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:01.798+0000 7f3bfffff700 1 -- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c04066fb0 msgr2=0x7f3c04069460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:58:01.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:01.798+0000 7f3bfffff700 1 --2- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c04066fb0 0x7f3c04069460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:01.804 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:01.804+0000 7f0d56646180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T07:58:01.906 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:01.906+0000 7f0d56646180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T07:58:01.927 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:01.927+0000 7f83cb7b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:01.927 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:01.927+0000 7f83cb7b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:01.927 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:01.927+0000 7f83cb7b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:01.927 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:01.927+0000 7f83cb7b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:01.927 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:01.927+0000 7f83cb7b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:01.928 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:01.928+0000 7f83c77af700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:01.928 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:01.928+0000 7f83c77af700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:01.928 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:01.928+0000 7f83c77af700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:01.928 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:01.928+0000 7f83c77af700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:01.928 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:01.928+0000 7f83c77af700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:02.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:02.808+0000 7f3bfffff700 1 -- 172.21.15.71:0/1758550759 <== mon.1 v2:172.21.15.179:3300/0 8 ==== mgrmap(e 71) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f3c0c053560 con 0x7f3c180b2100 2023-10-09T07:58:02.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:02.808+0000 7f3bfffff700 1 --2- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c04066fb0 0x7f3c040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:02.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:02.808+0000 7f3bfffff700 1 -- 172.21.15.71:0/1758550759 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c180678d0 con 0x7f3c04066fb0 2023-10-09T07:58:02.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:02.811+0000 7f3c17fff700 1 --2- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c04066fb0 0x7f3c040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:02.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:02.814+0000 7f3c17fff700 1 --2- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c04066fb0 0x7f3c040693e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3c080091e0 tx=0x7f3c08017000 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:02.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:02.875+0000 7f3bfffff700 1 -- 172.21.15.71:0/1758550759 <== mgr.7307 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3c180678d0 con 0x7f3c04066fb0 2023-10-09T07:58:02.878 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule set for path snap_test_dir1 2023-10-09T07:58:02.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:02.878+0000 7f3c1e5ff700 1 -- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c04066fb0 msgr2=0x7f3c040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:02.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:02.878+0000 7f3c1e5ff700 1 --2- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c04066fb0 0x7f3c040693e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3c080091e0 tx=0x7f3c08017000 comp rx=0 tx=0).stop 2023-10-09T07:58:02.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:02.878+0000 7f3c1e5ff700 1 -- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c180b2100 msgr2=0x7f3c1815bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:02.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:02.878+0000 7f3c1e5ff700 1 --2- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c180b2100 0x7f3c1815bee0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00ea50 tx=0x7f3c0c0091a0 comp rx=0 tx=0).stop 2023-10-09T07:58:02.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:02.878+0000 7f3c1e5ff700 1 -- 172.21.15.71:0/1758550759 shutdown_connections 2023-10-09T07:58:02.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:02.878+0000 7f3c1e5ff700 1 --2- 172.21.15.71:0/1758550759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c18157740 0x7f3c1815a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:02.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:02.878+0000 7f3c1e5ff700 1 --2- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c180688d0 0x7f3c180aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:02.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:02.878+0000 7f3c1e5ff700 1 --2- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3c04066fb0 0x7f3c040693e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:02.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:02.878+0000 7f3c1e5ff700 1 --2- 172.21.15.71:0/1758550759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c180b2100 0x7f3c1815bee0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:02.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:02.878+0000 7f3c1e5ff700 1 -- 172.21.15.71:0/1758550759 >> 172.21.15.71:0/1758550759 conn(0x7f3c180c8f90 msgr2=0x7f3c180ca050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:02.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:02.878+0000 7f3c1e5ff700 1 -- 172.21.15.71:0/1758550759 shutdown_connections 2023-10-09T07:58:02.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:02.878+0000 7f3c1e5ff700 1 -- 172.21.15.71:0/1758550759 wait complete. 2023-10-09T07:58:02.898 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-09T07:58:02.898 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-09T07:58:03.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.086+0000 7fca6b9ff700 1 Processor -- start 2023-10-09T07:58:03.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.086+0000 7fca6b9ff700 1 -- start start 2023-10-09T07:58:03.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.087+0000 7fca6b9ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fca640c8490 0x7fca640c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:03.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.087+0000 7fca6b9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca64069e20 0x7fca641569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:03.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.087+0000 7fca6b9ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca640ac030 con 0x7fca64069a50 2023-10-09T07:58:03.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.087+0000 7fca6b9ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca640ab820 con 0x7fca640c8490 2023-10-09T07:58:03.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.087+0000 7fca6b9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6406dbb0 con 0x7fca64069e20 2023-10-09T07:58:03.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.088+0000 7fca6979b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fca64069a50 0x7fca6415a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60970/0 (socket says 172.21.15.71:60970) 2023-10-09T07:58:03.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.088+0000 7fca6979b700 1 -- 172.21.15.71:0/3213344139 learned_addr learned my addr 172.21.15.71:0/3213344139 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:03.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.088+0000 7fca68f9a700 1 --2- 172.21.15.71:0/3213344139 >> v2:172.21.15.71:3300/0 conn(0x7fca640c8490 0x7fca640c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:03.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.088+0000 7fca5bfff700 1 -- 172.21.15.71:0/3213344139 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3786829518 0 0) 0x7fca60001110 con 0x7fca64069a50 2023-10-09T07:58:03.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.088+0000 7fca69f9c700 1 --2- 172.21.15.71:0/3213344139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca64069e20 0x7fca641569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:03.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.088+0000 7fca5bfff700 1 -- 172.21.15.71:0/3213344139 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca50004680 con 0x7fca64069a50 2023-10-09T07:58:03.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.088+0000 7fca68f9a700 1 -- 172.21.15.71:0/3213344139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca64069e20 msgr2=0x7fca641569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:03.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.088+0000 7fca68f9a700 1 --2- 172.21.15.71:0/3213344139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca64069e20 0x7fca641569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:03.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.088+0000 7fca68f9a700 1 -- 172.21.15.71:0/3213344139 >> v1:172.21.15.71:6789/0 conn(0x7fca64069a50 legacy=0x7fca6415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:03.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.088+0000 7fca68f9a700 1 -- 172.21.15.71:0/3213344139 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca640aba70 con 0x7fca640c8490 2023-10-09T07:58:03.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.089+0000 7fca68f9a700 1 --2- 172.21.15.71:0/3213344139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca640c8490 0x7fca640c6ac0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fca540098e0 tx=0x7fca540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96ce00cf022c9dc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:03.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.089+0000 7fca5bfff700 1 -- 172.21.15.71:0/3213344139 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5400b640 con 0x7fca640c8490 2023-10-09T07:58:03.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.089+0000 7fca5bfff700 1 -- 172.21.15.71:0/3213344139 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5400b7a0 con 0x7fca640c8490 2023-10-09T07:58:03.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.089+0000 7fca5bfff700 1 -- 172.21.15.71:0/3213344139 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5400bb40 con 0x7fca640c8490 2023-10-09T07:58:03.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.089+0000 7fca6b9ff700 1 -- 172.21.15.71:0/3213344139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca640c8490 msgr2=0x7fca640c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:03.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.089+0000 7fca6b9ff700 1 --2- 172.21.15.71:0/3213344139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca640c8490 0x7fca640c6ac0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fca540098e0 tx=0x7fca540091a0 comp rx=0 tx=0).stop 2023-10-09T07:58:03.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.089+0000 7fca6b9ff700 1 -- 172.21.15.71:0/3213344139 shutdown_connections 2023-10-09T07:58:03.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.089+0000 7fca6b9ff700 1 --2- 172.21.15.71:0/3213344139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca64069e20 0x7fca641569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:03.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.089+0000 7fca6b9ff700 1 --2- 172.21.15.71:0/3213344139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca640c8490 0x7fca640c6ac0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:03.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.089+0000 7fca6b9ff700 1 -- 172.21.15.71:0/3213344139 >> 172.21.15.71:0/3213344139 conn(0x7fca640c8f90 msgr2=0x7fca640c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:03.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.089+0000 7fca6b9ff700 1 -- 172.21.15.71:0/3213344139 shutdown_connections 2023-10-09T07:58:03.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.089+0000 7fca6b9ff700 1 -- 172.21.15.71:0/3213344139 wait complete. 2023-10-09T07:58:03.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.091+0000 7fca6b9ff700 1 Processor -- start 2023-10-09T07:58:03.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.091+0000 7fca6b9ff700 1 -- start start 2023-10-09T07:58:03.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.092+0000 7fca6b9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca64069a50 0x7fca640afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:03.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.092+0000 7fca6b9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca64069e20 0x7fca6416e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:03.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.092+0000 7fca6b9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca640c8490 0x7fca64154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:03.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.092+0000 7fca6b9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca64161bc0 con 0x7fca64069e20 2023-10-09T07:58:03.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.092+0000 7fca6b9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca640b00b0 con 0x7fca640c8490 2023-10-09T07:58:03.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.092+0000 7fca6b9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6416e790 con 0x7fca64069a50 2023-10-09T07:58:03.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.092+0000 7fca68f9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca64069e20 0x7fca6416e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:03.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.092+0000 7fca68f9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca64069e20 0x7fca6416e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60008/0 (socket says 172.21.15.71:60008) 2023-10-09T07:58:03.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.092+0000 7fca68f9a700 1 -- 172.21.15.71:0/297505523 learned_addr learned my addr 172.21.15.71:0/297505523 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:03.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.092+0000 7fca6979b700 1 --2- 172.21.15.71:0/297505523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca64069a50 0x7fca640afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:03.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.092+0000 7fca69f9c700 1 --2- 172.21.15.71:0/297505523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca640c8490 0x7fca64154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:03.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.093+0000 7fca68f9a700 1 -- 172.21.15.71:0/297505523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca64069a50 msgr2=0x7fca640afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:03.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.093+0000 7fca68f9a700 1 --2- 172.21.15.71:0/297505523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca64069a50 0x7fca640afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:03.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.093+0000 7fca68f9a700 1 -- 172.21.15.71:0/297505523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca640c8490 msgr2=0x7fca64154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:03.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.093+0000 7fca68f9a700 1 --2- 172.21.15.71:0/297505523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca640c8490 0x7fca64154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:03.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.093+0000 7fca68f9a700 1 -- 172.21.15.71:0/297505523 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca54009420 con 0x7fca64069e20 2023-10-09T07:58:03.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.093+0000 7fca69f9c700 1 --2- 172.21.15.71:0/297505523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca640c8490 0x7fca64154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:58:03.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.093+0000 7fca68f9a700 1 --2- 172.21.15.71:0/297505523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca64069e20 0x7fca6416e250 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fca5400a010 tx=0x7fca54017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:03.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.093+0000 7fca597fa700 1 -- 172.21.15.71:0/297505523 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5401be20 con 0x7fca64069e20 2023-10-09T07:58:03.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.093+0000 7fca597fa700 1 -- 172.21.15.71:0/297505523 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca54011420 con 0x7fca64069e20 2023-10-09T07:58:03.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.093+0000 7fca6b9ff700 1 -- 172.21.15.71:0/297505523 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca640acb10 con 0x7fca64069e20 2023-10-09T07:58:03.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.093+0000 7fca597fa700 1 -- 172.21.15.71:0/297505523 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca540117e0 con 0x7fca64069e20 2023-10-09T07:58:03.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.093+0000 7fca6b9ff700 1 -- 172.21.15.71:0/297505523 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca640ad0d0 con 0x7fca64069e20 2023-10-09T07:58:03.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.094+0000 7fca6b9ff700 1 -- 172.21.15.71:0/297505523 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca640718b0 con 0x7fca64069e20 2023-10-09T07:58:03.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.095+0000 7fca597fa700 1 -- 172.21.15.71:0/297505523 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 71) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fca54011bd0 con 0x7fca64069e20 2023-10-09T07:58:03.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.096+0000 7fca597fa700 1 --2- 172.21.15.71:0/297505523 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fca48066dd0 0x7fca48069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:03.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.096+0000 7fca597fa700 1 -- 172.21.15.71:0/297505523 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fca54085ae0 con 0x7fca64069e20 2023-10-09T07:58:03.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.096+0000 7fca6979b700 1 --2- 172.21.15.71:0/297505523 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fca48066dd0 0x7fca48069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:03.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.097+0000 7fca6979b700 1 --2- 172.21.15.71:0/297505523 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fca48066dd0 0x7fca48069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fca60001270 tx=0x7fca60009040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:03.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.101+0000 7fca597fa700 1 -- 172.21.15.71:0/297505523 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca54052ce0 con 0x7fca64069e20 2023-10-09T07:58:03.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.319+0000 7fca6b9ff700 1 -- 172.21.15.71:0/297505523 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fca6406d830 con 0x7fca48066dd0 2023-10-09T07:58:03.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.385+0000 7fca597fa700 1 -- 172.21.15.71:0/297505523 <== mgr.7307 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fca6406d830 con 0x7fca48066dd0 2023-10-09T07:58:03.385 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule removed for path snap_test_dir1 2023-10-09T07:58:03.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.388+0000 7fca6b9ff700 1 -- 172.21.15.71:0/297505523 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fca48066dd0 msgr2=0x7fca48069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:03.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.388+0000 7fca6b9ff700 1 --2- 172.21.15.71:0/297505523 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fca48066dd0 0x7fca48069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fca60001270 tx=0x7fca60009040 comp rx=0 tx=0).stop 2023-10-09T07:58:03.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.388+0000 7fca6b9ff700 1 -- 172.21.15.71:0/297505523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca64069e20 msgr2=0x7fca6416e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:03.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.388+0000 7fca6b9ff700 1 --2- 172.21.15.71:0/297505523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca64069e20 0x7fca6416e250 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fca5400a010 tx=0x7fca54017000 comp rx=0 tx=0).stop 2023-10-09T07:58:03.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.388+0000 7fca6b9ff700 1 -- 172.21.15.71:0/297505523 shutdown_connections 2023-10-09T07:58:03.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.388+0000 7fca6b9ff700 1 --2- 172.21.15.71:0/297505523 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fca48066dd0 0x7fca48069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:03.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.388+0000 7fca6b9ff700 1 --2- 172.21.15.71:0/297505523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca640c8490 0x7fca64154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:03.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.388+0000 7fca6b9ff700 1 --2- 172.21.15.71:0/297505523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca64069a50 0x7fca640afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:03.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.388+0000 7fca6b9ff700 1 --2- 172.21.15.71:0/297505523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca64069e20 0x7fca6416e250 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:03.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.388+0000 7fca6b9ff700 1 -- 172.21.15.71:0/297505523 >> 172.21.15.71:0/297505523 conn(0x7fca640c8f90 msgr2=0x7fca6406e040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:03.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.388+0000 7fca6b9ff700 1 -- 172.21.15.71:0/297505523 shutdown_connections 2023-10-09T07:58:03.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.388+0000 7fca6b9ff700 1 -- 172.21.15.71:0/297505523 wait complete. 2023-10-09T07:58:03.405 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-09T07:58:03.405 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-10-09T07:58:03.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.592+0000 7f39e0bff700 1 Processor -- start 2023-10-09T07:58:03.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.592+0000 7f39e0bff700 1 -- start start 2023-10-09T07:58:03.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.593+0000 7f39e0bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f39dc0c6ac0 0x7f39dc068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:03.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.593+0000 7f39e0bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39dc069a50 0x7f39dc156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:03.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.593+0000 7f39e0bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39dc0ac030 con 0x7f39dc0c8490 2023-10-09T07:58:03.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.593+0000 7f39e0bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39dc0ab820 con 0x7f39dc0c6ac0 2023-10-09T07:58:03.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.593+0000 7f39e0bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc06dbb0 con 0x7f39dc069a50 2023-10-09T07:58:03.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.594+0000 7f39d9d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f39dc0c6ac0 0x7f39dc068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:03.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.594+0000 7f39d9d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f39dc0c6ac0 0x7f39dc068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60016/0 (socket says 172.21.15.71:60016) 2023-10-09T07:58:03.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.594+0000 7f39d9d9b700 1 -- 172.21.15.71:0/2761995292 learned_addr learned my addr 172.21.15.71:0/2761995292 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:03.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.594+0000 7f39dad9d700 1 --2- 172.21.15.71:0/2761995292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39dc069a50 0x7f39dc156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:03.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.594+0000 7f39d9d9b700 1 -- 172.21.15.71:0/2761995292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39dc069a50 msgr2=0x7f39dc156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:03.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.594+0000 7f39d9d9b700 1 --2- 172.21.15.71:0/2761995292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39dc069a50 0x7f39dc156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:03.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.594+0000 7f39d9d9b700 1 -- 172.21.15.71:0/2761995292 >> v1:172.21.15.179:6789/0 conn(0x7f39dc0c8490 legacy=0x7f39dc15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:03.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.594+0000 7f39d9d9b700 1 -- 172.21.15.71:0/2761995292 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39dc0c6f10 con 0x7f39dc0c6ac0 2023-10-09T07:58:03.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.594+0000 7f39d9d9b700 1 --2- 172.21.15.71:0/2761995292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39dc0c6ac0 0x7f39dc068390 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f39d000bc50 tx=0x7f39d000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218603d544b3c041 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:03.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.595+0000 7f39d959a700 1 -- 172.21.15.71:0/2761995292 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d000be60 con 0x7f39dc0c6ac0 2023-10-09T07:58:03.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.595+0000 7f39d959a700 1 -- 172.21.15.71:0/2761995292 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d000de00 con 0x7f39dc0c6ac0 2023-10-09T07:58:03.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.595+0000 7f39d959a700 1 -- 172.21.15.71:0/2761995292 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d00196b0 con 0x7f39dc0c6ac0 2023-10-09T07:58:03.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.595+0000 7f39e0bff700 1 -- 172.21.15.71:0/2761995292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39dc0c6ac0 msgr2=0x7f39dc068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:03.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.595+0000 7f39e0bff700 1 --2- 172.21.15.71:0/2761995292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39dc0c6ac0 0x7f39dc068390 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f39d000bc50 tx=0x7f39d000b4f0 comp rx=0 tx=0).stop 2023-10-09T07:58:03.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.595+0000 7f39e0bff700 1 -- 172.21.15.71:0/2761995292 shutdown_connections 2023-10-09T07:58:03.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.595+0000 7f39e0bff700 1 --2- 172.21.15.71:0/2761995292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39dc069a50 0x7f39dc156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:03.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.595+0000 7f39e0bff700 1 --2- 172.21.15.71:0/2761995292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39dc0c6ac0 0x7f39dc068390 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:03.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.595+0000 7f39e0bff700 1 -- 172.21.15.71:0/2761995292 >> 172.21.15.71:0/2761995292 conn(0x7f39dc0c8f90 msgr2=0x7f39dc0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:03.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.595+0000 7f39e0bff700 1 -- 172.21.15.71:0/2761995292 shutdown_connections 2023-10-09T07:58:03.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.595+0000 7f39e0bff700 1 -- 172.21.15.71:0/2761995292 wait complete. 2023-10-09T07:58:03.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.597+0000 7f39e0bff700 1 Processor -- start 2023-10-09T07:58:03.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.597+0000 7f39e0bff700 1 -- start start 2023-10-09T07:58:03.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.598+0000 7f39e0bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39dc069a50 0x7f39dc0b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:03.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.598+0000 7f39e0bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39dc0c6ac0 0x7f39dc0ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:03.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.598+0000 7f39e0bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39dc0c8490 0x7f39dc0acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:03.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.598+0000 7f39e0bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc0b2240 con 0x7f39dc069a50 2023-10-09T07:58:03.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.598+0000 7f39e0bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc0b0f30 con 0x7f39dc0c8490 2023-10-09T07:58:03.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.598+0000 7f39e0bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc0c6390 con 0x7f39dc0c6ac0 2023-10-09T07:58:03.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.598+0000 7f39da59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39dc069a50 0x7f39dc0b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:03.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.598+0000 7f39da59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39dc069a50 0x7f39dc0b1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60024/0 (socket says 172.21.15.71:60024) 2023-10-09T07:58:03.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.598+0000 7f39da59c700 1 -- 172.21.15.71:0/4250284493 learned_addr learned my addr 172.21.15.71:0/4250284493 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:03.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.598+0000 7f39da59c700 1 -- 172.21.15.71:0/4250284493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39dc0c6ac0 msgr2=0x7f39dc0ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:03.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.598+0000 7f39d9d9b700 1 --2- 172.21.15.71:0/4250284493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39dc0c6ac0 0x7f39dc0ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:03.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.598+0000 7f39dad9d700 1 --2- 172.21.15.71:0/4250284493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39dc0c8490 0x7f39dc0acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:03.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.598+0000 7f39da59c700 1 --2- 172.21.15.71:0/4250284493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39dc0c6ac0 0x7f39dc0ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:03.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.598+0000 7f39da59c700 1 -- 172.21.15.71:0/4250284493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39dc0c8490 msgr2=0x7f39dc0acbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:03.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.598+0000 7f39da59c700 1 --2- 172.21.15.71:0/4250284493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39dc0c8490 0x7f39dc0acbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:03.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.598+0000 7f39da59c700 1 -- 172.21.15.71:0/4250284493 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d000b790 con 0x7f39dc069a50 2023-10-09T07:58:03.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.598+0000 7f39dad9d700 1 --2- 172.21.15.71:0/4250284493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39dc0c8490 0x7f39dc0acbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:03.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.599+0000 7f39d9d9b700 1 --2- 172.21.15.71:0/4250284493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39dc0c6ac0 0x7f39dc0ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:03.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.599+0000 7f39da59c700 1 --2- 172.21.15.71:0/4250284493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39dc069a50 0x7f39dc0b1d00 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00c4e0 tx=0x7f39cc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:03.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.599+0000 7f39ca7fc700 1 -- 172.21.15.71:0/4250284493 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc011590 con 0x7f39dc069a50 2023-10-09T07:58:03.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.599+0000 7f39ca7fc700 1 -- 172.21.15.71:0/4250284493 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39cc011710 con 0x7f39dc069a50 2023-10-09T07:58:03.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.599+0000 7f39ca7fc700 1 -- 172.21.15.71:0/4250284493 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc011ad0 con 0x7f39dc069a50 2023-10-09T07:58:03.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.599+0000 7f39e0bff700 1 -- 172.21.15.71:0/4250284493 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39dc0c5a60 con 0x7f39dc069a50 2023-10-09T07:58:03.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.599+0000 7f39e0bff700 1 -- 172.21.15.71:0/4250284493 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39dc0c6020 con 0x7f39dc069a50 2023-10-09T07:58:03.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.600+0000 7f39e0bff700 1 -- 172.21.15.71:0/4250284493 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39dc0718b0 con 0x7f39dc069a50 2023-10-09T07:58:03.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.601+0000 7f39ca7fc700 1 -- 172.21.15.71:0/4250284493 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 71) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f39cc01b3b0 con 0x7f39dc069a50 2023-10-09T07:58:03.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.603+0000 7f39ca7fc700 1 --2- 172.21.15.71:0/4250284493 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f39bc066dd0 0x7f39bc069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:03.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.603+0000 7f39ca7fc700 1 -- 172.21.15.71:0/4250284493 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f39cc083810 con 0x7f39dc069a50 2023-10-09T07:58:03.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.603+0000 7f39d9d9b700 1 --2- 172.21.15.71:0/4250284493 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f39bc066dd0 0x7f39bc069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:03.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.604+0000 7f39d9d9b700 1 --2- 172.21.15.71:0/4250284493 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f39bc066dd0 0x7f39bc069280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f39d000bc50 tx=0x7f39d001b000 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:03.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.607+0000 7f39ca7fc700 1 -- 172.21.15.71:0/4250284493 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39cc050a60 con 0x7f39dc069a50 2023-10-09T07:58:03.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.823+0000 7f39e0bff700 1 -- 172.21.15.71:0/4250284493 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f39dc0ac030 con 0x7f39bc066dd0 2023-10-09T07:58:03.830 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:03.830+0000 7f83d27c5700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-10-09T07:58:03.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:03.831+0000 7f39ca7fc700 1 -- 172.21.15.71:0/4250284493 <== mgr.7307 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f39dc0ac030 con 0x7f39bc066dd0 2023-10-09T07:58:03.832 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-10-09T07:58:03.840 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-09T07:58:03.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:58:03.841 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-09T07:58:03.881 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-09T07:58:04.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.103+0000 7f1dcbfff700 1 Processor -- start 2023-10-09T07:58:04.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.104+0000 7f1dcbfff700 1 -- start start 2023-10-09T07:58:04.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.105+0000 7f1dcbfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1dcc153900 0x7f1dcc0c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:04.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.105+0000 7f1dcbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dcc06a710 0x7f1dcc06e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:04.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.105+0000 7f1dcbfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dcc06e150 con 0x7f1dcc0c9db0 2023-10-09T07:58:04.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.105+0000 7f1dcbfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dcc0c7800 con 0x7f1dcc153900 2023-10-09T07:58:04.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.105+0000 7f1dcbfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0c7ae0 con 0x7f1dcc06a710 2023-10-09T07:58:04.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.105+0000 7f1dcaffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1dcc153900 0x7f1dcc0c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:04.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.105+0000 7f1dcb7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dcc06a710 0x7f1dcc06e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:04.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.105+0000 7f1dca7fc700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f1dcc0c9db0 0x7f1dcc06a000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:40884/0 (socket says 172.21.15.71:40884) 2023-10-09T07:58:04.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.105+0000 7f1dca7fc700 1 -- 172.21.15.71:0/64303842 learned_addr learned my addr 172.21.15.71:0/64303842 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:04.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.106+0000 7f1dc9ffb700 1 -- 172.21.15.71:0/64303842 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227297446 0 0) 0x7f1dcc06e150 con 0x7f1dcc0c9db0 2023-10-09T07:58:04.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.106+0000 7f1dc9ffb700 1 -- 172.21.15.71:0/64303842 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1db4003570 con 0x7f1dcc0c9db0 2023-10-09T07:58:04.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.106+0000 7f1dcb7fe700 1 -- 172.21.15.71:0/64303842 >> v2:172.21.15.179:3300/0 conn(0x7f1dcc153900 msgr2=0x7f1dcc0c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:04.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.106+0000 7f1dcb7fe700 1 --2- 172.21.15.71:0/64303842 >> v2:172.21.15.179:3300/0 conn(0x7f1dcc153900 0x7f1dcc0c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:04.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.106+0000 7f1dcb7fe700 1 -- 172.21.15.71:0/64303842 >> v1:172.21.15.179:6789/0 conn(0x7f1dcc0c9db0 legacy=0x7f1dcc06a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:04.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.106+0000 7f1dcb7fe700 1 -- 172.21.15.71:0/64303842 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc0c7dc0 con 0x7f1dcc06a710 2023-10-09T07:58:04.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.106+0000 7f1dcaffd700 1 --2- 172.21.15.71:0/64303842 >> v2:172.21.15.179:3300/0 conn(0x7f1dcc153900 0x7f1dcc0c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:58:04.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.106+0000 7f1dcb7fe700 1 --2- 172.21.15.71:0/64303842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dcc06a710 0x7f1dcc06e5e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009e60 tx=0x7f1dc4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0ba4dca6bace519 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:04.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.107+0000 7f1dc9ffb700 1 -- 172.21.15.71:0/64303842 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc400e070 con 0x7f1dcc06a710 2023-10-09T07:58:04.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.107+0000 7f1dc9ffb700 1 -- 172.21.15.71:0/64303842 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc400bab0 con 0x7f1dcc06a710 2023-10-09T07:58:04.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.107+0000 7f1dc9ffb700 1 -- 172.21.15.71:0/64303842 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc400be70 con 0x7f1dcc06a710 2023-10-09T07:58:04.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.107+0000 7f1dcbfff700 1 -- 172.21.15.71:0/64303842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dcc06a710 msgr2=0x7f1dcc06e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:04.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.107+0000 7f1dcbfff700 1 --2- 172.21.15.71:0/64303842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dcc06a710 0x7f1dcc06e5e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009e60 tx=0x7f1dc4009780 comp rx=0 tx=0).stop 2023-10-09T07:58:04.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.107+0000 7f1dcbfff700 1 -- 172.21.15.71:0/64303842 shutdown_connections 2023-10-09T07:58:04.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.107+0000 7f1dcbfff700 1 --2- 172.21.15.71:0/64303842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dcc06a710 0x7f1dcc06e5e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:04.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.107+0000 7f1dcbfff700 1 --2- 172.21.15.71:0/64303842 >> v2:172.21.15.179:3300/0 conn(0x7f1dcc153900 0x7f1dcc0c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:04.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.107+0000 7f1dcbfff700 1 -- 172.21.15.71:0/64303842 >> 172.21.15.71:0/64303842 conn(0x7f1dcc0cc1e0 msgr2=0x7f1dcc0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:04.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.107+0000 7f1dcbfff700 1 -- 172.21.15.71:0/64303842 shutdown_connections 2023-10-09T07:58:04.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.107+0000 7f1dcbfff700 1 -- 172.21.15.71:0/64303842 wait complete. 2023-10-09T07:58:04.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.109+0000 7f1dcbfff700 1 Processor -- start 2023-10-09T07:58:04.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.109+0000 7f1dcbfff700 1 -- start start 2023-10-09T07:58:04.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.110+0000 7f1dcbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1dcc06a710 0x7f1dcc142210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:04.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.110+0000 7f1dcbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dcc0c9db0 0x7f1dcc157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:04.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.110+0000 7f1dcbfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dcc153900 0x7f1dcc158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:04.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.110+0000 7f1dcbfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc14a530 con 0x7f1dcc06a710 2023-10-09T07:58:04.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.110+0000 7f1dcbfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc149520 con 0x7f1dcc153900 2023-10-09T07:58:04.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.110+0000 7f1dcbfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc14a0a0 con 0x7f1dcc0c9db0 2023-10-09T07:58:04.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.110+0000 7f1dcaffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1dcc06a710 0x7f1dcc142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:04.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.110+0000 7f1dcaffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1dcc06a710 0x7f1dcc142210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60028/0 (socket says 172.21.15.71:60028) 2023-10-09T07:58:04.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.110+0000 7f1dcaffd700 1 -- 172.21.15.71:0/1496227643 learned_addr learned my addr 172.21.15.71:0/1496227643 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:04.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.110+0000 7f1dcb7fe700 1 --2- 172.21.15.71:0/1496227643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dcc153900 0x7f1dcc158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:04.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.110+0000 7f1dca7fc700 1 --2- 172.21.15.71:0/1496227643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dcc0c9db0 0x7f1dcc157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:04.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.110+0000 7f1dcaffd700 1 -- 172.21.15.71:0/1496227643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dcc0c9db0 msgr2=0x7f1dcc157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:04.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.110+0000 7f1dcaffd700 1 --2- 172.21.15.71:0/1496227643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dcc0c9db0 0x7f1dcc157ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:04.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.110+0000 7f1dcaffd700 1 -- 172.21.15.71:0/1496227643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dcc153900 msgr2=0x7f1dcc158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:04.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.110+0000 7f1dcaffd700 1 --2- 172.21.15.71:0/1496227643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dcc153900 0x7f1dcc158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:04.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.110+0000 7f1dcaffd700 1 -- 172.21.15.71:0/1496227643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dbc009420 con 0x7f1dcc06a710 2023-10-09T07:58:04.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.111+0000 7f1dcaffd700 1 --2- 172.21.15.71:0/1496227643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1dcc06a710 0x7f1dcc142210 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc00ec80 tx=0x7f1dbc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:04.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.111+0000 7f1db2ffd700 1 -- 172.21.15.71:0/1496227643 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc00c8f0 con 0x7f1dcc06a710 2023-10-09T07:58:04.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.111+0000 7f1db2ffd700 1 -- 172.21.15.71:0/1496227643 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc00ca50 con 0x7f1dcc06a710 2023-10-09T07:58:04.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.111+0000 7f1dcbfff700 1 -- 172.21.15.71:0/1496227643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc4009a20 con 0x7f1dcc06a710 2023-10-09T07:58:04.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.111+0000 7f1db2ffd700 1 -- 172.21.15.71:0/1496227643 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc00cdd0 con 0x7f1dcc06a710 2023-10-09T07:58:04.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.111+0000 7f1dcbfff700 1 -- 172.21.15.71:0/1496227643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dcc149770 con 0x7f1dcc06a710 2023-10-09T07:58:04.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.112+0000 7f1dcbfff700 1 -- 172.21.15.71:0/1496227643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dcc06c450 con 0x7f1dcc06a710 2023-10-09T07:58:04.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.113+0000 7f1db2ffd700 1 -- 172.21.15.71:0/1496227643 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 72) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f1dbc013680 con 0x7f1dcc06a710 2023-10-09T07:58:04.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.114+0000 7f1db2ffd700 1 --2- 172.21.15.71:0/1496227643 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1db8067130 0x7f1db80695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:04.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.114+0000 7f1db2ffd700 1 -- 172.21.15.71:0/1496227643 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f1dbc084f50 con 0x7f1dcc06a710 2023-10-09T07:58:04.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.114+0000 7f1dca7fc700 1 --2- 172.21.15.71:0/1496227643 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1db8067130 0x7f1db80695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:04.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.115+0000 7f1dca7fc700 1 --2- 172.21.15.71:0/1496227643 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1db8067130 0x7f1db80695e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc156040 tx=0x7f1dc0009040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:04.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.118+0000 7f1db2ffd700 1 -- 172.21.15.71:0/1496227643 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1dbc051bd0 con 0x7f1dcc06a710 2023-10-09T07:58:04.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.361+0000 7f1dcbfff700 1 -- 172.21.15.71:0/1496227643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f1dcc06dd20 con 0x7f1dcc06a710 2023-10-09T07:58:04.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.863+0000 7f1db2ffd700 1 -- 172.21.15.71:0/1496227643 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 73) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f1dbc051fa0 con 0x7f1dcc06a710 2023-10-09T07:58:04.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.864+0000 7f1db2ffd700 1 -- 172.21.15.71:0/1496227643 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v73) v1 ==== 93+0+0 (secure 0 0 0) 0x7f1dbc051bd0 con 0x7f1dcc06a710 2023-10-09T07:58:04.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.867+0000 7f1dcbfff700 1 -- 172.21.15.71:0/1496227643 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1db8067130 msgr2=0x7f1db80695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:04.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.867+0000 7f1dcbfff700 1 --2- 172.21.15.71:0/1496227643 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1db8067130 0x7f1db80695e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc156040 tx=0x7f1dc0009040 comp rx=0 tx=0).stop 2023-10-09T07:58:04.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.867+0000 7f1dcbfff700 1 -- 172.21.15.71:0/1496227643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1dcc06a710 msgr2=0x7f1dcc142210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:04.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.867+0000 7f1dcbfff700 1 --2- 172.21.15.71:0/1496227643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1dcc06a710 0x7f1dcc142210 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc00ec80 tx=0x7f1dbc0091a0 comp rx=0 tx=0).stop 2023-10-09T07:58:04.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.867+0000 7f1dcbfff700 1 -- 172.21.15.71:0/1496227643 shutdown_connections 2023-10-09T07:58:04.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.867+0000 7f1dcbfff700 1 --2- 172.21.15.71:0/1496227643 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1db8067130 0x7f1db80695e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:04.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.867+0000 7f1dcbfff700 1 --2- 172.21.15.71:0/1496227643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dcc153900 0x7f1dcc158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:04.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.867+0000 7f1dcbfff700 1 --2- 172.21.15.71:0/1496227643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1dcc06a710 0x7f1dcc142210 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:04.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.867+0000 7f1dcbfff700 1 --2- 172.21.15.71:0/1496227643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dcc0c9db0 0x7f1dcc157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:04.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.867+0000 7f1dcbfff700 1 -- 172.21.15.71:0/1496227643 >> 172.21.15.71:0/1496227643 conn(0x7f1dcc0cc1e0 msgr2=0x7f1dcc158fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:04.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.867+0000 7f1dcbfff700 1 -- 172.21.15.71:0/1496227643 shutdown_connections 2023-10-09T07:58:04.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:04.867+0000 7f1dcbfff700 1 -- 172.21.15.71:0/1496227643 wait complete. 2023-10-09T07:58:04.886 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T07:58:04.886 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T07:58:04.970 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T07:58:05.056 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T07:58:05.056 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T07:58:05.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:58:05.056 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T07:58:05.138 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T07:58:05.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:58:05.139 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T07:58:05.175 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:58:05.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.401+0000 7f9eb1f9d700 1 Processor -- start 2023-10-09T07:58:05.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.401+0000 7f9eb1f9d700 1 -- start start 2023-10-09T07:58:05.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.403+0000 7f9eb1f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac06d950 0x7f9eac0c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:05.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.403+0000 7f9eb1f9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9eac06a0a0 0x7f9eac0c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:05.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.403+0000 7f9eb1f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9eac06dd20 0x7f9eac0c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:05.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.403+0000 7f9eb1f9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eac06ae70 con 0x7f9eac06a0a0 2023-10-09T07:58:05.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.403+0000 7f9eb1f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eac06a540 con 0x7f9eac06dd20 2023-10-09T07:58:05.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.403+0000 7f9eb1f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac06a820 con 0x7f9eac06d950 2023-10-09T07:58:05.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.403+0000 7f9eabfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9eac06a0a0 0x7f9eac0c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:05.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.403+0000 7f9eabfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9eac06a0a0 0x7f9eac0c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37570/0 (socket says 172.21.15.71:37570) 2023-10-09T07:58:05.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.403+0000 7f9eabfff700 1 -- 172.21.15.71:0/3457942858 learned_addr learned my addr 172.21.15.71:0/3457942858 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:05.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.403+0000 7f9eb179c700 1 --2- 172.21.15.71:0/3457942858 >> v2:172.21.15.179:3300/0 conn(0x7f9eac06dd20 0x7f9eac0c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:05.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.403+0000 7f9eb0f9b700 1 --2- 172.21.15.71:0/3457942858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac06d950 0x7f9eac0c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:05.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.403+0000 7f9eabfff700 1 -- 172.21.15.71:0/3457942858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac06d950 msgr2=0x7f9eac0c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:05.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.403+0000 7f9eabfff700 1 --2- 172.21.15.71:0/3457942858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac06d950 0x7f9eac0c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:05.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.403+0000 7f9eabfff700 1 -- 172.21.15.71:0/3457942858 >> v2:172.21.15.179:3300/0 conn(0x7f9eac06dd20 msgr2=0x7f9eac0c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:05.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.403+0000 7f9eabfff700 1 --2- 172.21.15.71:0/3457942858 >> v2:172.21.15.179:3300/0 conn(0x7f9eac06dd20 0x7f9eac0c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:05.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.403+0000 7f9eabfff700 1 -- 172.21.15.71:0/3457942858 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac06ab00 con 0x7f9eac06a0a0 2023-10-09T07:58:05.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.403+0000 7f9eb179c700 1 --2- 172.21.15.71:0/3457942858 >> v2:172.21.15.179:3300/0 conn(0x7f9eac06dd20 0x7f9eac0c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:58:05.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.403+0000 7f9eb0f9b700 1 --2- 172.21.15.71:0/3457942858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac06d950 0x7f9eac0c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:58:05.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.404+0000 7f9eabfff700 1 --2- 172.21.15.71:0/3457942858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9eac06a0a0 0x7f9eac0c6c10 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f9eac06ade0 tx=0x7f9e98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e0855caf258849 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:05.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.404+0000 7f9eab7fe700 1 -- 172.21.15.71:0/3457942858 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9800b7e0 con 0x7f9eac06a0a0 2023-10-09T07:58:05.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.404+0000 7f9eab7fe700 1 -- 172.21.15.71:0/3457942858 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9800b940 con 0x7f9eac06a0a0 2023-10-09T07:58:05.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.404+0000 7f9eab7fe700 1 -- 172.21.15.71:0/3457942858 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9800bd00 con 0x7f9eac06a0a0 2023-10-09T07:58:05.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.404+0000 7f9eb1f9d700 1 -- 172.21.15.71:0/3457942858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9eac06a0a0 msgr2=0x7f9eac0c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:05.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.405+0000 7f9eb1f9d700 1 --2- 172.21.15.71:0/3457942858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9eac06a0a0 0x7f9eac0c6c10 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f9eac06ade0 tx=0x7f9e98009250 comp rx=0 tx=0).stop 2023-10-09T07:58:05.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.405+0000 7f9eb1f9d700 1 -- 172.21.15.71:0/3457942858 shutdown_connections 2023-10-09T07:58:05.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.405+0000 7f9eb1f9d700 1 --2- 172.21.15.71:0/3457942858 >> v2:172.21.15.179:3300/0 conn(0x7f9eac06dd20 0x7f9eac0c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:05.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.405+0000 7f9eb1f9d700 1 --2- 172.21.15.71:0/3457942858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac06d950 0x7f9eac0c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:05.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.405+0000 7f9eb1f9d700 1 --2- 172.21.15.71:0/3457942858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9eac06a0a0 0x7f9eac0c6c10 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:05.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.405+0000 7f9eb1f9d700 1 -- 172.21.15.71:0/3457942858 >> 172.21.15.71:0/3457942858 conn(0x7f9eac0cc1f0 msgr2=0x7f9eac0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:05.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.405+0000 7f9eb1f9d700 1 -- 172.21.15.71:0/3457942858 shutdown_connections 2023-10-09T07:58:05.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.405+0000 7f9eb1f9d700 1 -- 172.21.15.71:0/3457942858 wait complete. 2023-10-09T07:58:05.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.406+0000 7f9eb1f9d700 1 Processor -- start 2023-10-09T07:58:05.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.406+0000 7f9eb1f9d700 1 -- start start 2023-10-09T07:58:05.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.407+0000 7f9eb1f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac06a0a0 0x7f9eac166910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:05.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.407+0000 7f9eb1f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eac06d950 0x7f9eac1685a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:05.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.407+0000 7f9eb1f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9eac06dd20 0x7f9eac0c5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:05.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.407+0000 7f9eb1f9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0c9590 con 0x7f9eac06dd20 2023-10-09T07:58:05.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.407+0000 7f9eb1f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac168ae0 con 0x7f9eac06d950 2023-10-09T07:58:05.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.407+0000 7f9eb1f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0c5bb0 con 0x7f9eac06a0a0 2023-10-09T07:58:05.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.408+0000 7f9eb179c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9eac06dd20 0x7f9eac0c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:05.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.408+0000 7f9eb0f9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac06a0a0 0x7f9eac166910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:05.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.408+0000 7f9eb179c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9eac06dd20 0x7f9eac0c5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37578/0 (socket says 172.21.15.71:37578) 2023-10-09T07:58:05.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.408+0000 7f9eb179c700 1 -- 172.21.15.71:0/132857903 learned_addr learned my addr 172.21.15.71:0/132857903 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:05.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.408+0000 7f9eabfff700 1 --2- 172.21.15.71:0/132857903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eac06d950 0x7f9eac1685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:05.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.408+0000 7f9eb179c700 1 -- 172.21.15.71:0/132857903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac06a0a0 msgr2=0x7f9eac166910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:05.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.408+0000 7f9eb179c700 1 --2- 172.21.15.71:0/132857903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac06a0a0 0x7f9eac166910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:05.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.408+0000 7f9eb179c700 1 -- 172.21.15.71:0/132857903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eac06d950 msgr2=0x7f9eac1685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:05.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.408+0000 7f9eb179c700 1 --2- 172.21.15.71:0/132857903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eac06d950 0x7f9eac1685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:05.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.408+0000 7f9eb179c700 1 -- 172.21.15.71:0/132857903 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e980094f0 con 0x7f9eac06dd20 2023-10-09T07:58:05.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.408+0000 7f9eb179c700 1 --2- 172.21.15.71:0/132857903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9eac06dd20 0x7f9eac0c5180 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4007f30 tx=0x7f9ea4009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:05.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.409+0000 7f9ea8ff9700 1 -- 172.21.15.71:0/132857903 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea400db80 con 0x7f9eac06dd20 2023-10-09T07:58:05.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.409+0000 7f9ea8ff9700 1 -- 172.21.15.71:0/132857903 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea400f040 con 0x7f9eac06dd20 2023-10-09T07:58:05.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.409+0000 7f9ea8ff9700 1 -- 172.21.15.71:0/132857903 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4015440 con 0x7f9eac06dd20 2023-10-09T07:58:05.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.409+0000 7f9eb1f9d700 1 -- 172.21.15.71:0/132857903 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eac0c8c60 con 0x7f9eac06dd20 2023-10-09T07:58:05.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.409+0000 7f9eb1f9d700 1 -- 172.21.15.71:0/132857903 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eac0c9220 con 0x7f9eac06dd20 2023-10-09T07:58:05.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.410+0000 7f9eb1f9d700 1 -- 172.21.15.71:0/132857903 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eac154410 con 0x7f9eac06dd20 2023-10-09T07:58:05.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.411+0000 7f9ea8ff9700 1 -- 172.21.15.71:0/132857903 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 73) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f9ea401e3b0 con 0x7f9eac06dd20 2023-10-09T07:58:05.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.412+0000 7f9ea8ff9700 1 --2- 172.21.15.71:0/132857903 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9e900670e0 0x7f9e90069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:05.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.412+0000 7f9ea8ff9700 1 -- 172.21.15.71:0/132857903 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f9ea4084fa0 con 0x7f9eac06dd20 2023-10-09T07:58:05.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.412+0000 7f9eb0f9b700 1 -- 172.21.15.71:0/132857903 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9e900670e0 msgr2=0x7f9e90069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:05.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.412+0000 7f9eb0f9b700 1 --2- 172.21.15.71:0/132857903 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9e900670e0 0x7f9e90069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:58:05.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.416+0000 7f9ea8ff9700 1 -- 172.21.15.71:0/132857903 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ea4051bb0 con 0x7f9eac06dd20 2023-10-09T07:58:05.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.613+0000 7f9eb0f9b700 1 -- 172.21.15.71:0/132857903 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9e900670e0 msgr2=0x7f9e90069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:05.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.613+0000 7f9eb0f9b700 1 --2- 172.21.15.71:0/132857903 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9e900670e0 0x7f9e90069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:58:05.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.659+0000 7f9eb1f9d700 1 -- 172.21.15.71:0/132857903 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9eac04c3c0 con 0x7f9eac06dd20 2023-10-09T07:58:05.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.660+0000 7f9ea8ff9700 1 -- 172.21.15.71:0/132857903 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f9ea401a090 con 0x7f9eac06dd20 2023-10-09T07:58:05.660 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:58:05.660 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1228129559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1228129559},{"type":"v1","addr":"172.21.15.179:6836","nonce":1228129559}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8254,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3640887500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3640887500},{"type":"v1","addr":"172.21.15.179:6834","nonce":3640887500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8586,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/4266132184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":4266132184},{"type":"v1","addr":"172.21.15.71:6834","nonce":4266132184}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:57:41.159434+0000","modified":"2023-10-09T07:57:44.718117+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8589":{"gid":8589,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/889811309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":889811309},{"type":"v1","addr":"172.21.15.71:6835","nonce":889811309}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T07:58:05.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.662+0000 7f9eb1f9d700 1 -- 172.21.15.71:0/132857903 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9e900670e0 msgr2=0x7f9e90069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:58:05.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.662+0000 7f9eb1f9d700 1 --2- 172.21.15.71:0/132857903 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9e900670e0 0x7f9e90069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:05.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.662+0000 7f9eb1f9d700 1 -- 172.21.15.71:0/132857903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9eac06dd20 msgr2=0x7f9eac0c5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:05.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.662+0000 7f9eb1f9d700 1 --2- 172.21.15.71:0/132857903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9eac06dd20 0x7f9eac0c5180 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4007f30 tx=0x7f9ea4009930 comp rx=0 tx=0).stop 2023-10-09T07:58:05.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.662+0000 7f9eb1f9d700 1 -- 172.21.15.71:0/132857903 shutdown_connections 2023-10-09T07:58:05.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.662+0000 7f9eb1f9d700 1 --2- 172.21.15.71:0/132857903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9eac06dd20 0x7f9eac0c5180 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:05.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.662+0000 7f9eb1f9d700 1 --2- 172.21.15.71:0/132857903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac06a0a0 0x7f9eac166910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:05.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.662+0000 7f9eb1f9d700 1 --2- 172.21.15.71:0/132857903 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9e900670e0 0x7f9e90069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:05.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.662+0000 7f9eb1f9d700 1 --2- 172.21.15.71:0/132857903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eac06d950 0x7f9eac1685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:05.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.662+0000 7f9eb1f9d700 1 -- 172.21.15.71:0/132857903 >> 172.21.15.71:0/132857903 conn(0x7f9eac0cc1f0 msgr2=0x7f9eac0c0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:05.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.663+0000 7f9eb1f9d700 1 -- 172.21.15.71:0/132857903 shutdown_connections 2023-10-09T07:58:05.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.663+0000 7f9eb1f9d700 1 -- 172.21.15.71:0/132857903 wait complete. 2023-10-09T07:58:05.664 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 74 2023-10-09T07:58:05.681 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:58:05.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.874+0000 7f5a7d99d700 1 Processor -- start 2023-10-09T07:58:05.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.874+0000 7f5a7d99d700 1 -- start start 2023-10-09T07:58:05.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.875+0000 7f5a7d99d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5a781593b0 0x7f5a78159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:05.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.875+0000 7f5a7d99d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a780cfe20 con 0x7f5a780b1e50 2023-10-09T07:58:05.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.875+0000 7f5a7d99d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a780cf210 con 0x7f5a780ceaa0 2023-10-09T07:58:05.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.875+0000 7f5a7d99d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a780cf4f0 con 0x7f5a781593b0 2023-10-09T07:58:05.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.876+0000 7f5a7d19c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f5a780b1e50 0x7f5a780b3420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47290/0 (socket says 172.21.15.71:47290) 2023-10-09T07:58:05.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.876+0000 7f5a7d19c700 1 -- 172.21.15.71:0/3876517402 learned_addr learned my addr 172.21.15.71:0/3876517402 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:05.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.876+0000 7f5a7c99b700 1 --2- 172.21.15.71:0/3876517402 >> v2:172.21.15.179:3300/0 conn(0x7f5a781593b0 0x7f5a78159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:05.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.876+0000 7f5a777fe700 1 -- 172.21.15.71:0/3876517402 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674371981 0 0) 0x7f5a780cf210 con 0x7f5a780ceaa0 2023-10-09T07:58:05.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.876+0000 7f5a777fe700 1 -- 172.21.15.71:0/3876517402 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a68003570 con 0x7f5a780ceaa0 2023-10-09T07:58:05.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.876+0000 7f5a777fe700 1 -- 172.21.15.71:0/3876517402 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936458434 0 0) 0x7f5a780cfe20 con 0x7f5a780b1e50 2023-10-09T07:58:05.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.876+0000 7f5a777fe700 1 -- 172.21.15.71:0/3876517402 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a780cf210 con 0x7f5a780b1e50 2023-10-09T07:58:05.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.876+0000 7f5a7c99b700 1 -- 172.21.15.71:0/3876517402 >> v1:172.21.15.179:6789/0 conn(0x7f5a780ceaa0 legacy=0x7f5a780b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:05.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.876+0000 7f5a7c99b700 1 -- 172.21.15.71:0/3876517402 >> v1:172.21.15.71:6789/0 conn(0x7f5a780b1e50 legacy=0x7f5a780b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:05.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.876+0000 7f5a7c99b700 1 -- 172.21.15.71:0/3876517402 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a780cf7d0 con 0x7f5a781593b0 2023-10-09T07:58:05.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.877+0000 7f5a7c99b700 1 --2- 172.21.15.71:0/3876517402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a781593b0 0x7f5a78159780 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0098e0 tx=0x7f5a6c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd65cf6fd89715d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:05.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.877+0000 7f5a777fe700 1 -- 172.21.15.71:0/3876517402 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c011630 con 0x7f5a781593b0 2023-10-09T07:58:05.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.877+0000 7f5a777fe700 1 -- 172.21.15.71:0/3876517402 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c011790 con 0x7f5a781593b0 2023-10-09T07:58:05.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.877+0000 7f5a777fe700 1 -- 172.21.15.71:0/3876517402 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c011b30 con 0x7f5a781593b0 2023-10-09T07:58:05.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.877+0000 7f5a7d99d700 1 -- 172.21.15.71:0/3876517402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a781593b0 msgr2=0x7f5a78159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:05.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.877+0000 7f5a7d99d700 1 --2- 172.21.15.71:0/3876517402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a781593b0 0x7f5a78159780 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0098e0 tx=0x7f5a6c0091a0 comp rx=0 tx=0).stop 2023-10-09T07:58:05.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.877+0000 7f5a7d99d700 1 -- 172.21.15.71:0/3876517402 shutdown_connections 2023-10-09T07:58:05.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.877+0000 7f5a7d99d700 1 --2- 172.21.15.71:0/3876517402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a781593b0 0x7f5a78159780 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:05.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.877+0000 7f5a7d99d700 1 -- 172.21.15.71:0/3876517402 >> 172.21.15.71:0/3876517402 conn(0x7f5a780d1130 msgr2=0x7f5a780b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:05.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.878+0000 7f5a7d99d700 1 -- 172.21.15.71:0/3876517402 shutdown_connections 2023-10-09T07:58:05.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.878+0000 7f5a7d99d700 1 -- 172.21.15.71:0/3876517402 wait complete. 2023-10-09T07:58:05.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.879+0000 7f5a7d99d700 1 Processor -- start 2023-10-09T07:58:05.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.879+0000 7f5a7d99d700 1 -- start start 2023-10-09T07:58:05.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.880+0000 7f5a7d99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a780b1e50 0x7f5a780c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:05.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.880+0000 7f5a7d99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a780ceaa0 0x7f5a78169a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:05.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.880+0000 7f5a7d99d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a781593b0 0x7f5a7816d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:05.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.880+0000 7f5a7d99d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7816d3f0 con 0x7f5a781593b0 2023-10-09T07:58:05.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.880+0000 7f5a7d99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7816a380 con 0x7f5a780b1e50 2023-10-09T07:58:05.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.880+0000 7f5a7d99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7816a660 con 0x7f5a780ceaa0 2023-10-09T07:58:05.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.880+0000 7f5a7c99b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a780b1e50 0x7f5a780c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:05.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.880+0000 7f5a7c99b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a780b1e50 0x7f5a780c70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:46710/0 (socket says 172.21.15.71:46710) 2023-10-09T07:58:05.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.880+0000 7f5a7c99b700 1 -- 172.21.15.71:0/475033261 learned_addr learned my addr 172.21.15.71:0/475033261 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:05.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.880+0000 7f5a7d19c700 1 --2- 172.21.15.71:0/475033261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a781593b0 0x7f5a7816d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:05.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.880+0000 7f5a77fff700 1 --2- 172.21.15.71:0/475033261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a780ceaa0 0x7f5a78169a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:05.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.881+0000 7f5a7c99b700 1 -- 172.21.15.71:0/475033261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a780ceaa0 msgr2=0x7f5a78169a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:05.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.881+0000 7f5a7c99b700 1 --2- 172.21.15.71:0/475033261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a780ceaa0 0x7f5a78169a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:05.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.881+0000 7f5a7c99b700 1 -- 172.21.15.71:0/475033261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a781593b0 msgr2=0x7f5a7816d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:05.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.881+0000 7f5a7c99b700 1 --2- 172.21.15.71:0/475033261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a781593b0 0x7f5a7816d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:05.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.881+0000 7f5a7c99b700 1 -- 172.21.15.71:0/475033261 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c009420 con 0x7f5a780b1e50 2023-10-09T07:58:05.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.881+0000 7f5a7c99b700 1 --2- 172.21.15.71:0/475033261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a780b1e50 0x7f5a780c70a0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f5a7806fe00 tx=0x7f5a6c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:05.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.881+0000 7f5a74ff9700 1 -- 172.21.15.71:0/475033261 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c01f070 con 0x7f5a780b1e50 2023-10-09T07:58:05.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.881+0000 7f5a74ff9700 1 -- 172.21.15.71:0/475033261 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c011900 con 0x7f5a780b1e50 2023-10-09T07:58:05.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.881+0000 7f5a7d99d700 1 -- 172.21.15.71:0/475033261 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a7816a940 con 0x7f5a780b1e50 2023-10-09T07:58:05.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.881+0000 7f5a74ff9700 1 -- 172.21.15.71:0/475033261 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c023410 con 0x7f5a780b1e50 2023-10-09T07:58:05.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.881+0000 7f5a7d99d700 1 -- 172.21.15.71:0/475033261 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a780c75e0 con 0x7f5a780b1e50 2023-10-09T07:58:05.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.882+0000 7f5a7d99d700 1 -- 172.21.15.71:0/475033261 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a7816d6d0 con 0x7f5a780b1e50 2023-10-09T07:58:05.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.883+0000 7f5a74ff9700 1 -- 172.21.15.71:0/475033261 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 73) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f5a6c02c3b0 con 0x7f5a780b1e50 2023-10-09T07:58:05.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.884+0000 7f5a74ff9700 1 --2- 172.21.15.71:0/475033261 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5a5c0670e0 0x7f5a5c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:05.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.884+0000 7f5a74ff9700 1 -- 172.21.15.71:0/475033261 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f5a6c085d10 con 0x7f5a780b1e50 2023-10-09T07:58:05.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.884+0000 7f5a77fff700 1 -- 172.21.15.71:0/475033261 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5a5c0670e0 msgr2=0x7f5a5c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:05.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.884+0000 7f5a77fff700 1 --2- 172.21.15.71:0/475033261 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5a5c0670e0 0x7f5a5c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:58:05.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:05.889+0000 7f5a74ff9700 1 -- 172.21.15.71:0/475033261 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a6c08b020 con 0x7f5a780b1e50 2023-10-09T07:58:06.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.085+0000 7f5a77fff700 1 -- 172.21.15.71:0/475033261 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5a5c0670e0 msgr2=0x7f5a5c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:06.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.085+0000 7f5a77fff700 1 --2- 172.21.15.71:0/475033261 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5a5c0670e0 0x7f5a5c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:58:06.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.089+0000 7f5a7d99d700 1 -- 172.21.15.71:0/475033261 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a7816a4c0 con 0x7f5a780b1e50 2023-10-09T07:58:06.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.090+0000 7f5a74ff9700 1 -- 172.21.15.71:0/475033261 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+16447 (secure 0 0 0) 0x7f5a7816a4c0 con 0x7f5a780b1e50 2023-10-09T07:58:06.091 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:58:06.091 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":164,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:58:01.789247+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:57:39.262671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T07:57:40.149000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6837/85452":"2023-10-10T07:58:01.789216+0000","172.21.15.179:0/3833946352":"2023-10-10T07:58:01.789216+0000","172.21.15.179:6835/85452":"2023-10-10T07:58:01.789216+0000","172.21.15.179:0/4153201756":"2023-10-10T07:58:01.789216+0000","172.21.15.179:0/2153051455":"2023-10-10T07:58:01.789216+0000","172.21.15.179:0/4288328453":"2023-10-10T07:58:01.789216+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:58:06.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.093+0000 7f5a7d99d700 1 -- 172.21.15.71:0/475033261 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5a5c0670e0 msgr2=0x7f5a5c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:58:06.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.093+0000 7f5a7d99d700 1 --2- 172.21.15.71:0/475033261 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5a5c0670e0 0x7f5a5c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.093+0000 7f5a7d99d700 1 -- 172.21.15.71:0/475033261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a780b1e50 msgr2=0x7f5a780c70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:06.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.093+0000 7f5a7d99d700 1 --2- 172.21.15.71:0/475033261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a780b1e50 0x7f5a780c70a0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f5a7806fe00 tx=0x7f5a6c017000 comp rx=0 tx=0).stop 2023-10-09T07:58:06.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.093+0000 7f5a7d99d700 1 -- 172.21.15.71:0/475033261 shutdown_connections 2023-10-09T07:58:06.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.093+0000 7f5a7d99d700 1 --2- 172.21.15.71:0/475033261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a781593b0 0x7f5a7816d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.093+0000 7f5a7d99d700 1 --2- 172.21.15.71:0/475033261 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5a5c0670e0 0x7f5a5c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.093+0000 7f5a7d99d700 1 --2- 172.21.15.71:0/475033261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a780b1e50 0x7f5a780c70a0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.093+0000 7f5a7d99d700 1 --2- 172.21.15.71:0/475033261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a780ceaa0 0x7f5a78169a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.093+0000 7f5a7d99d700 1 -- 172.21.15.71:0/475033261 >> 172.21.15.71:0/475033261 conn(0x7f5a780d1130 msgr2=0x7f5a78156e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:06.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.093+0000 7f5a7d99d700 1 -- 172.21.15.71:0/475033261 shutdown_connections 2023-10-09T07:58:06.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.093+0000 7f5a7d99d700 1 -- 172.21.15.71:0/475033261 wait complete. 2023-10-09T07:58:06.111 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T07:57:39.262671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '162', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T07:57:40.149000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '163', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T07:58:06.111 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T07:58:06.154 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:06.154+0000 7f3023350180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T07:58:06.199 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:06.200+0000 7f305965e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T07:58:06.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.301+0000 7fae3bfff700 1 Processor -- start 2023-10-09T07:58:06.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.301+0000 7fae3bfff700 1 -- start start 2023-10-09T07:58:06.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.302+0000 7fae3bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae3c0ccc00 0x7fae3c069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:06.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.303+0000 7fae3bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fae3c06a020 0x7fae3c0cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:06.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.303+0000 7fae3bfff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3c0c9f30 con 0x7fae3c159a60 2023-10-09T07:58:06.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.303+0000 7fae3bfff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3c06dfc0 con 0x7fae3c06a020 2023-10-09T07:58:06.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.303+0000 7fae3bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c0ca470 con 0x7fae3c0ccc00 2023-10-09T07:58:06.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.303+0000 7fae3affd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fae3c159a60 0x7fae3c0c9770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47296/0 (socket says 172.21.15.71:47296) 2023-10-09T07:58:06.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.303+0000 7fae3affd700 1 -- 172.21.15.71:0/1629218109 learned_addr learned my addr 172.21.15.71:0/1629218109 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:06.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.303+0000 7fae3b7fe700 1 --2- 172.21.15.71:0/1629218109 >> v2:172.21.15.71:3300/0 conn(0x7fae3c06a020 0x7fae3c0cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:06.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.303+0000 7fae3a7fc700 1 --2- 172.21.15.71:0/1629218109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae3c0ccc00 0x7fae3c069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:06.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.303+0000 7fae3b7fe700 1 -- 172.21.15.71:0/1629218109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae3c0ccc00 msgr2=0x7fae3c069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:06.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.303+0000 7fae3b7fe700 1 --2- 172.21.15.71:0/1629218109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae3c0ccc00 0x7fae3c069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.303+0000 7fae3b7fe700 1 -- 172.21.15.71:0/1629218109 >> v1:172.21.15.71:6789/0 conn(0x7fae3c159a60 legacy=0x7fae3c0c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:06.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.303+0000 7fae3b7fe700 1 -- 172.21.15.71:0/1629218109 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c0ca750 con 0x7fae3c06a020 2023-10-09T07:58:06.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.303+0000 7fae39ffb700 1 -- 172.21.15.71:0/1629218109 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2066768248 0 0) 0x7fae3c0c9f30 con 0x7fae3c159a60 2023-10-09T07:58:06.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.304+0000 7fae3b7fe700 1 --2- 172.21.15.71:0/1629218109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3c06a020 0x7fae3c0cb230 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fae34009e60 tx=0x7fae34009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689eb71ff59802cf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:06.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.304+0000 7fae39ffb700 1 -- 172.21.15.71:0/1629218109 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3400e070 con 0x7fae3c06a020 2023-10-09T07:58:06.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.304+0000 7fae39ffb700 1 -- 172.21.15.71:0/1629218109 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3400bbf0 con 0x7fae3c06a020 2023-10-09T07:58:06.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.304+0000 7fae39ffb700 1 -- 172.21.15.71:0/1629218109 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34012430 con 0x7fae3c06a020 2023-10-09T07:58:06.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.305+0000 7fae3bfff700 1 -- 172.21.15.71:0/1629218109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3c06a020 msgr2=0x7fae3c0cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:06.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.305+0000 7fae3bfff700 1 --2- 172.21.15.71:0/1629218109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3c06a020 0x7fae3c0cb230 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fae34009e60 tx=0x7fae34009780 comp rx=0 tx=0).stop 2023-10-09T07:58:06.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.305+0000 7fae3bfff700 1 -- 172.21.15.71:0/1629218109 shutdown_connections 2023-10-09T07:58:06.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.305+0000 7fae3bfff700 1 --2- 172.21.15.71:0/1629218109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3c06a020 0x7fae3c0cb230 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.305+0000 7fae3bfff700 1 --2- 172.21.15.71:0/1629218109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae3c0ccc00 0x7fae3c069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.305+0000 7fae3bfff700 1 -- 172.21.15.71:0/1629218109 >> 172.21.15.71:0/1629218109 conn(0x7fae3c06baa0 msgr2=0x7fae3c06bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:06.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.305+0000 7fae3bfff700 1 -- 172.21.15.71:0/1629218109 shutdown_connections 2023-10-09T07:58:06.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.305+0000 7fae3bfff700 1 -- 172.21.15.71:0/1629218109 wait complete. 2023-10-09T07:58:06.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.306+0000 7fae3bfff700 1 Processor -- start 2023-10-09T07:58:06.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.306+0000 7fae3bfff700 1 -- start start 2023-10-09T07:58:06.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.307+0000 7fae3bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3c06a020 0x7fae3c0c5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:06.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.307+0000 7fae3bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae3c0ccc00 0x7fae3c151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:06.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.307+0000 7fae3bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae3c159a60 0x7fae3c0c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:06.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.307+0000 7fae3bfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c0b19f0 con 0x7fae3c06a020 2023-10-09T07:58:06.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.307+0000 7fae3bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c1522d0 con 0x7fae3c0ccc00 2023-10-09T07:58:06.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.307+0000 7fae3bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c0c5e20 con 0x7fae3c159a60 2023-10-09T07:58:06.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.307+0000 7fae3affd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3c06a020 0x7fae3c0c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:06.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.308+0000 7fae3affd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3c06a020 0x7fae3c0c5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37592/0 (socket says 172.21.15.71:37592) 2023-10-09T07:58:06.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.308+0000 7fae3affd700 1 -- 172.21.15.71:0/1429616634 learned_addr learned my addr 172.21.15.71:0/1429616634 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:06.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.308+0000 7fae3a7fc700 1 --2- 172.21.15.71:0/1429616634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae3c0ccc00 0x7fae3c151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:06.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.308+0000 7fae3b7fe700 1 --2- 172.21.15.71:0/1429616634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae3c159a60 0x7fae3c0c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:06.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.308+0000 7fae3affd700 1 -- 172.21.15.71:0/1429616634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae3c159a60 msgr2=0x7fae3c0c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:06.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.308+0000 7fae3affd700 1 --2- 172.21.15.71:0/1429616634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae3c159a60 0x7fae3c0c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.308+0000 7fae3affd700 1 -- 172.21.15.71:0/1429616634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae3c0ccc00 msgr2=0x7fae3c151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:06.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.308+0000 7fae3affd700 1 --2- 172.21.15.71:0/1429616634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae3c0ccc00 0x7fae3c151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.308+0000 7fae3affd700 1 -- 172.21.15.71:0/1429616634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae34009a20 con 0x7fae3c06a020 2023-10-09T07:58:06.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.308+0000 7fae3affd700 1 --2- 172.21.15.71:0/1429616634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3c06a020 0x7fae3c0c5740 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fae2c00c5b0 tx=0x7fae2c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:06.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.308+0000 7fae22ffd700 1 -- 172.21.15.71:0/1429616634 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c005b30 con 0x7fae3c06a020 2023-10-09T07:58:06.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.308+0000 7fae22ffd700 1 -- 172.21.15.71:0/1429616634 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c005c90 con 0x7fae3c06a020 2023-10-09T07:58:06.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.308+0000 7fae3bfff700 1 -- 172.21.15.71:0/1429616634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3c0b1c90 con 0x7fae3c06a020 2023-10-09T07:58:06.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.308+0000 7fae22ffd700 1 -- 172.21.15.71:0/1429616634 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c007300 con 0x7fae3c06a020 2023-10-09T07:58:06.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.309+0000 7fae3bfff700 1 -- 172.21.15.71:0/1429616634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3c0c89b0 con 0x7fae3c06a020 2023-10-09T07:58:06.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.310+0000 7fae3bfff700 1 -- 172.21.15.71:0/1429616634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3c0b21b0 con 0x7fae3c06a020 2023-10-09T07:58:06.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.310+0000 7fae22ffd700 1 -- 172.21.15.71:0/1429616634 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 73) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fae2c01b3b0 con 0x7fae3c06a020 2023-10-09T07:58:06.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.312+0000 7fae22ffd700 1 --2- 172.21.15.71:0/1429616634 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fae280670e0 0x7fae28069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:06.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.312+0000 7fae22ffd700 1 -- 172.21.15.71:0/1429616634 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fae2c084060 con 0x7fae3c06a020 2023-10-09T07:58:06.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.312+0000 7fae3a7fc700 1 -- 172.21.15.71:0/1429616634 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fae280670e0 msgr2=0x7fae28069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:06.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.312+0000 7fae3a7fc700 1 --2- 172.21.15.71:0/1429616634 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fae280670e0 0x7fae28069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:58:06.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.316+0000 7fae22ffd700 1 -- 172.21.15.71:0/1429616634 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae3c0b21b0 con 0x7fae3c06a020 2023-10-09T07:58:06.317 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:06.317+0000 7f3023350180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T07:58:06.372 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:06.372+0000 7f305965e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T07:58:06.403 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:06.403+0000 7f3023350180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T07:58:06.460 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:06.461+0000 7f305965e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T07:58:06.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.513+0000 7fae3a7fc700 1 -- 172.21.15.71:0/1429616634 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fae280670e0 msgr2=0x7fae28069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:06.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.513+0000 7fae3a7fc700 1 --2- 172.21.15.71:0/1429616634 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fae280670e0 0x7fae28069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:58:06.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.514+0000 7fae3bfff700 1 -- 172.21.15.71:0/1429616634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fae3c0b21b0 con 0x7fae3c06a020 2023-10-09T07:58:06.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.514+0000 7fae22ffd700 1 -- 172.21.15.71:0/1429616634 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v164) v1 ==== 93+0+10 (secure 0 0 0) 0x7fae3c0b21b0 con 0x7fae3c06a020 2023-10-09T07:58:06.514 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T07:58:06.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.517+0000 7fae3bfff700 1 -- 172.21.15.71:0/1429616634 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fae280670e0 msgr2=0x7fae28069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:58:06.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.517+0000 7fae3bfff700 1 --2- 172.21.15.71:0/1429616634 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fae280670e0 0x7fae28069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.517+0000 7fae3bfff700 1 -- 172.21.15.71:0/1429616634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3c06a020 msgr2=0x7fae3c0c5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:06.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.517+0000 7fae3bfff700 1 --2- 172.21.15.71:0/1429616634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3c06a020 0x7fae3c0c5740 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fae2c00c5b0 tx=0x7fae2c001070 comp rx=0 tx=0).stop 2023-10-09T07:58:06.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.517+0000 7fae3bfff700 1 -- 172.21.15.71:0/1429616634 shutdown_connections 2023-10-09T07:58:06.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.517+0000 7fae3bfff700 1 --2- 172.21.15.71:0/1429616634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae3c159a60 0x7fae3c0c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.517+0000 7fae3bfff700 1 --2- 172.21.15.71:0/1429616634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3c06a020 0x7fae3c0c5740 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.517+0000 7fae3bfff700 1 --2- 172.21.15.71:0/1429616634 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fae280670e0 0x7fae28069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.517+0000 7fae3bfff700 1 --2- 172.21.15.71:0/1429616634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae3c0ccc00 0x7fae3c151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.517+0000 7fae3bfff700 1 -- 172.21.15.71:0/1429616634 >> 172.21.15.71:0/1429616634 conn(0x7fae3c06baa0 msgr2=0x7fae3c154030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:06.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.517+0000 7fae3bfff700 1 -- 172.21.15.71:0/1429616634 shutdown_connections 2023-10-09T07:58:06.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.517+0000 7fae3bfff700 1 -- 172.21.15.71:0/1429616634 wait complete. 2023-10-09T07:58:06.536 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T07:58:06.626 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:06.626+0000 7f3023350180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:58:06.696 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:06.696+0000 7f305965e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:58:06.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.726+0000 7fec29b9d700 1 Processor -- start 2023-10-09T07:58:06.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.726+0000 7fec29b9d700 1 -- start start 2023-10-09T07:58:06.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.727+0000 7fec29b9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fec240b16d0 0x7fec240b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:06.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.727+0000 7fec29b9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec240b2080 con 0x7fec240b4e70 2023-10-09T07:58:06.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.727+0000 7fec29b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec240cfb00 con 0x7fec240b33b0 2023-10-09T07:58:06.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.727+0000 7fec29b9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec240b5c40 con 0x7fec240b16d0 2023-10-09T07:58:06.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.727+0000 7fec28b9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fec240b4e70 0x7fec240ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47310/0 (socket says 172.21.15.71:47310) 2023-10-09T07:58:06.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.727+0000 7fec28b9b700 1 -- 172.21.15.71:0/3894332899 learned_addr learned my addr 172.21.15.71:0/3894332899 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:06.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.727+0000 7fec23fff700 1 --2- 172.21.15.71:0/3894332899 >> v2:172.21.15.71:3300/0 conn(0x7fec240b16d0 0x7fec240b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:06.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.728+0000 7fec237fe700 1 -- 172.21.15.71:0/3894332899 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164900660 0 0) 0x7fec240b2080 con 0x7fec240b4e70 2023-10-09T07:58:06.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.728+0000 7fec237fe700 1 -- 172.21.15.71:0/3894332899 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec14003570 con 0x7fec240b4e70 2023-10-09T07:58:06.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.728+0000 7fec237fe700 1 -- 172.21.15.71:0/3894332899 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3267457616 0 0) 0x7fec240cfb00 con 0x7fec240b33b0 2023-10-09T07:58:06.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.728+0000 7fec237fe700 1 -- 172.21.15.71:0/3894332899 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec240b2080 con 0x7fec240b33b0 2023-10-09T07:58:06.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.728+0000 7fec23fff700 1 -- 172.21.15.71:0/3894332899 >> v1:172.21.15.179:6789/0 conn(0x7fec240b33b0 legacy=0x7fec240b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:06.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.728+0000 7fec23fff700 1 -- 172.21.15.71:0/3894332899 >> v1:172.21.15.71:6789/0 conn(0x7fec240b4e70 legacy=0x7fec240ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:06.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.728+0000 7fec23fff700 1 -- 172.21.15.71:0/3894332899 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec240b5f20 con 0x7fec240b16d0 2023-10-09T07:58:06.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.728+0000 7fec23fff700 1 --2- 172.21.15.71:0/3894332899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec240b16d0 0x7fec240b1b40 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fec100098e0 tx=0x7fec100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47833114ce0afd60 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:06.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.729+0000 7fec237fe700 1 -- 172.21.15.71:0/3894332899 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec10011630 con 0x7fec240b16d0 2023-10-09T07:58:06.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.729+0000 7fec237fe700 1 -- 172.21.15.71:0/3894332899 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec10011790 con 0x7fec240b16d0 2023-10-09T07:58:06.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.729+0000 7fec237fe700 1 -- 172.21.15.71:0/3894332899 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec10011b30 con 0x7fec240b16d0 2023-10-09T07:58:06.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.729+0000 7fec29b9d700 1 -- 172.21.15.71:0/3894332899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec240b16d0 msgr2=0x7fec240b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:06.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.729+0000 7fec29b9d700 1 --2- 172.21.15.71:0/3894332899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec240b16d0 0x7fec240b1b40 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fec100098e0 tx=0x7fec100091a0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.729+0000 7fec29b9d700 1 -- 172.21.15.71:0/3894332899 shutdown_connections 2023-10-09T07:58:06.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.729+0000 7fec29b9d700 1 --2- 172.21.15.71:0/3894332899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec240b16d0 0x7fec240b1b40 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.729+0000 7fec29b9d700 1 -- 172.21.15.71:0/3894332899 >> 172.21.15.71:0/3894332899 conn(0x7fec240d10c0 msgr2=0x7fec240affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:06.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.729+0000 7fec29b9d700 1 -- 172.21.15.71:0/3894332899 shutdown_connections 2023-10-09T07:58:06.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.729+0000 7fec29b9d700 1 -- 172.21.15.71:0/3894332899 wait complete. 2023-10-09T07:58:06.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.731+0000 7fec29b9d700 1 Processor -- start 2023-10-09T07:58:06.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.731+0000 7fec29b9d700 1 -- start start 2023-10-09T07:58:06.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.732+0000 7fec29b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec240b16d0 0x7fec2416aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:06.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.732+0000 7fec29b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec240b33b0 0x7fec240a6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:06.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.732+0000 7fec29b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec240b4e70 0x7fec240a7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:06.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.732+0000 7fec29b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec240c8fe0 con 0x7fec240b16d0 2023-10-09T07:58:06.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.732+0000 7fec29b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec240c8360 con 0x7fec240b33b0 2023-10-09T07:58:06.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.732+0000 7fec29b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec240c8640 con 0x7fec240b4e70 2023-10-09T07:58:06.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.732+0000 7fec28b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec240b16d0 0x7fec2416aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:06.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.732+0000 7fec28b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec240b16d0 0x7fec2416aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37620/0 (socket says 172.21.15.71:37620) 2023-10-09T07:58:06.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.732+0000 7fec28b9b700 1 -- 172.21.15.71:0/1228262397 learned_addr learned my addr 172.21.15.71:0/1228262397 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:06.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.732+0000 7fec23fff700 1 --2- 172.21.15.71:0/1228262397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec240b33b0 0x7fec240a6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:06.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.732+0000 7fec2939c700 1 --2- 172.21.15.71:0/1228262397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec240b4e70 0x7fec240a7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:06.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.732+0000 7fec28b9b700 1 -- 172.21.15.71:0/1228262397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec240b4e70 msgr2=0x7fec240a7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:06.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.732+0000 7fec28b9b700 1 --2- 172.21.15.71:0/1228262397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec240b4e70 0x7fec240a7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.732+0000 7fec28b9b700 1 -- 172.21.15.71:0/1228262397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec240b33b0 msgr2=0x7fec240a6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:06.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.732+0000 7fec28b9b700 1 --2- 172.21.15.71:0/1228262397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec240b33b0 0x7fec240a6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.732+0000 7fec28b9b700 1 -- 172.21.15.71:0/1228262397 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec10009420 con 0x7fec240b16d0 2023-10-09T07:58:06.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.733+0000 7fec28b9b700 1 --2- 172.21.15.71:0/1228262397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec240b16d0 0x7fec2416aa80 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fec1800c590 tx=0x7fec18007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:06.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.733+0000 7fec20ff9700 1 -- 172.21.15.71:0/1228262397 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec18005cd0 con 0x7fec240b16d0 2023-10-09T07:58:06.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.733+0000 7fec20ff9700 1 -- 172.21.15.71:0/1228262397 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec18005e50 con 0x7fec240b16d0 2023-10-09T07:58:06.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.733+0000 7fec20ff9700 1 -- 172.21.15.71:0/1228262397 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec18007320 con 0x7fec240b16d0 2023-10-09T07:58:06.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.733+0000 7fec29b9d700 1 -- 172.21.15.71:0/1228262397 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec240c8920 con 0x7fec240b16d0 2023-10-09T07:58:06.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.733+0000 7fec29b9d700 1 -- 172.21.15.71:0/1228262397 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2416afc0 con 0x7fec240b16d0 2023-10-09T07:58:06.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.734+0000 7fec29b9d700 1 -- 172.21.15.71:0/1228262397 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec24088990 con 0x7fec240b16d0 2023-10-09T07:58:06.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.736+0000 7fec20ff9700 1 -- 172.21.15.71:0/1228262397 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 73) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fec1801b3b0 con 0x7fec240b16d0 2023-10-09T07:58:06.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.737+0000 7fec20ff9700 1 --2- 172.21.15.71:0/1228262397 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fec080670e0 0x7fec08069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:06.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.737+0000 7fec20ff9700 1 -- 172.21.15.71:0/1228262397 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fec180842b0 con 0x7fec240b16d0 2023-10-09T07:58:06.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.737+0000 7fec23fff700 1 -- 172.21.15.71:0/1228262397 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fec080670e0 msgr2=0x7fec08069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:06.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.737+0000 7fec23fff700 1 --2- 172.21.15.71:0/1228262397 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fec080670e0 0x7fec08069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:58:06.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.741+0000 7fec20ff9700 1 -- 172.21.15.71:0/1228262397 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec18050f30 con 0x7fec240b16d0 2023-10-09T07:58:06.802 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:06.802+0000 7f3023350180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T07:58:06.883 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:06.883+0000 7f305965e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T07:58:06.894 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:06.894+0000 7f3023350180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T07:58:06.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.938+0000 7fec23fff700 1 -- 172.21.15.71:0/1228262397 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fec080670e0 msgr2=0x7fec08069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:06.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.938+0000 7fec23fff700 1 --2- 172.21.15.71:0/1228262397 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fec080670e0 0x7fec08069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:58:06.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.942+0000 7fec29b9d700 1 -- 172.21.15.71:0/1228262397 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fec2404bb80 con 0x7fec240b16d0 2023-10-09T07:58:06.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.942+0000 7fec20ff9700 1 -- 172.21.15.71:0/1228262397 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v164) v1 ==== 104+0+11 (secure 0 0 0) 0x7fec18054550 con 0x7fec240b16d0 2023-10-09T07:58:06.942 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-09T07:58:06.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.945+0000 7fec29b9d700 1 -- 172.21.15.71:0/1228262397 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fec080670e0 msgr2=0x7fec08069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:58:06.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.945+0000 7fec29b9d700 1 --2- 172.21.15.71:0/1228262397 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fec080670e0 0x7fec08069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.945+0000 7fec29b9d700 1 -- 172.21.15.71:0/1228262397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec240b16d0 msgr2=0x7fec2416aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:06.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.945+0000 7fec29b9d700 1 --2- 172.21.15.71:0/1228262397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec240b16d0 0x7fec2416aa80 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fec1800c590 tx=0x7fec18007e00 comp rx=0 tx=0).stop 2023-10-09T07:58:06.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.945+0000 7fec29b9d700 1 -- 172.21.15.71:0/1228262397 shutdown_connections 2023-10-09T07:58:06.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.945+0000 7fec29b9d700 1 --2- 172.21.15.71:0/1228262397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec240b4e70 0x7fec240a7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.945+0000 7fec29b9d700 1 --2- 172.21.15.71:0/1228262397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec240b16d0 0x7fec2416aa80 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.945+0000 7fec29b9d700 1 --2- 172.21.15.71:0/1228262397 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fec080670e0 0x7fec08069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.945+0000 7fec29b9d700 1 --2- 172.21.15.71:0/1228262397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec240b33b0 0x7fec240a6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:06.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.945+0000 7fec29b9d700 1 -- 172.21.15.71:0/1228262397 >> 172.21.15.71:0/1228262397 conn(0x7fec240d10c0 msgr2=0x7fec24159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:06.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.945+0000 7fec29b9d700 1 -- 172.21.15.71:0/1228262397 shutdown_connections 2023-10-09T07:58:06.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:06.945+0000 7fec29b9d700 1 -- 172.21.15.71:0/1228262397 wait complete. 2023-10-09T07:58:06.963 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T07:58:06.980 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:06.980+0000 7f305965e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T07:58:07.056 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:07.056+0000 7f3023350180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T07:58:07.149 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:07.150+0000 7f305965e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T07:58:07.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.154+0000 7f17e279d700 1 Processor -- start 2023-10-09T07:58:07.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.154+0000 7f17e279d700 1 -- start start 2023-10-09T07:58:07.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.155+0000 7f17e279d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f17dc0b16d0 0x7f17dc0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:07.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.155+0000 7f17e279d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17dc0b2080 con 0x7f17dc0b4e70 2023-10-09T07:58:07.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.155+0000 7f17e279d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17dc0cfb00 con 0x7f17dc0b33b0 2023-10-09T07:58:07.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.155+0000 7f17e279d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17dc0b5c40 con 0x7f17dc0b16d0 2023-10-09T07:58:07.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.156+0000 7f17e0f9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f17dc0b16d0 0x7f17dc0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:07.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.156+0000 7f17e1f9c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f17dc0b33b0 0x7f17dc0b37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:59056/0 (socket says 172.21.15.71:59056) 2023-10-09T07:58:07.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.156+0000 7f17e1f9c700 1 -- 172.21.15.71:0/3667675341 learned_addr learned my addr 172.21.15.71:0/3667675341 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:07.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.156+0000 7f17e179b700 1 --1- 172.21.15.71:0/3667675341 >> v1:172.21.15.71:6789/0 conn(0x7f17dc0b4e70 0x7f17dc0ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47322/0 (socket says 172.21.15.71:47322) 2023-10-09T07:58:07.156 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:07.155+0000 7f3023350180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T07:58:07.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.156+0000 7f17d3fff700 1 -- 172.21.15.71:0/3667675341 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936343512 0 0) 0x7f17dc0b2080 con 0x7f17dc0b4e70 2023-10-09T07:58:07.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.156+0000 7f17d3fff700 1 -- 172.21.15.71:0/3667675341 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17c8003570 con 0x7f17dc0b4e70 2023-10-09T07:58:07.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.156+0000 7f17e0f9a700 1 -- 172.21.15.71:0/3667675341 >> v1:172.21.15.179:6789/0 conn(0x7f17dc0b33b0 legacy=0x7f17dc0b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:07.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.156+0000 7f17d3fff700 1 -- 172.21.15.71:0/3667675341 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919225000 0 0) 0x7f17dc0cfb00 con 0x7f17dc0b33b0 2023-10-09T07:58:07.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.156+0000 7f17e0f9a700 1 -- 172.21.15.71:0/3667675341 >> v1:172.21.15.71:6789/0 conn(0x7f17dc0b4e70 legacy=0x7f17dc0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:07.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.156+0000 7f17e0f9a700 1 -- 172.21.15.71:0/3667675341 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17dc0b5f20 con 0x7f17dc0b16d0 2023-10-09T07:58:07.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.157+0000 7f17e0f9a700 1 --2- 172.21.15.71:0/3667675341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17dc0b16d0 0x7f17dc0b1b40 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f17cc0098e0 tx=0x7f17cc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b54f6284087fa06 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:07.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.157+0000 7f17d3fff700 1 -- 172.21.15.71:0/3667675341 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc00b640 con 0x7f17dc0b16d0 2023-10-09T07:58:07.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.157+0000 7f17d3fff700 1 -- 172.21.15.71:0/3667675341 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17cc00b7a0 con 0x7f17dc0b16d0 2023-10-09T07:58:07.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.157+0000 7f17d3fff700 1 -- 172.21.15.71:0/3667675341 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc00bb40 con 0x7f17dc0b16d0 2023-10-09T07:58:07.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.157+0000 7f17e279d700 1 -- 172.21.15.71:0/3667675341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17dc0b16d0 msgr2=0x7f17dc0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:07.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.157+0000 7f17e279d700 1 --2- 172.21.15.71:0/3667675341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17dc0b16d0 0x7f17dc0b1b40 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f17cc0098e0 tx=0x7f17cc0091a0 comp rx=0 tx=0).stop 2023-10-09T07:58:07.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.158+0000 7f17e279d700 1 -- 172.21.15.71:0/3667675341 shutdown_connections 2023-10-09T07:58:07.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.158+0000 7f17e279d700 1 --2- 172.21.15.71:0/3667675341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17dc0b16d0 0x7f17dc0b1b40 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:07.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.158+0000 7f17e279d700 1 -- 172.21.15.71:0/3667675341 >> 172.21.15.71:0/3667675341 conn(0x7f17dc0d10c0 msgr2=0x7f17dc0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:07.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.158+0000 7f17e279d700 1 -- 172.21.15.71:0/3667675341 shutdown_connections 2023-10-09T07:58:07.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.158+0000 7f17e279d700 1 -- 172.21.15.71:0/3667675341 wait complete. 2023-10-09T07:58:07.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.159+0000 7f17e279d700 1 Processor -- start 2023-10-09T07:58:07.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.159+0000 7f17e279d700 1 -- start start 2023-10-09T07:58:07.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.160+0000 7f17e279d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17dc0b16d0 0x7f17dc1459c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:07.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.160+0000 7f17e279d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17dc0b33b0 0x7f17dc15e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:07.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.160+0000 7f17e279d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17dc0b4e70 0x7f17dc15e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:07.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.160+0000 7f17e279d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc0c7370 con 0x7f17dc0b16d0 2023-10-09T07:58:07.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.160+0000 7f17e279d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc0c8130 con 0x7f17dc0b4e70 2023-10-09T07:58:07.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.160+0000 7f17e279d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc0c7090 con 0x7f17dc0b33b0 2023-10-09T07:58:07.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.160+0000 7f17e179b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17dc0b16d0 0x7f17dc1459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:07.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.160+0000 7f17e179b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17dc0b16d0 0x7f17dc1459c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37632/0 (socket says 172.21.15.71:37632) 2023-10-09T07:58:07.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.160+0000 7f17e179b700 1 -- 172.21.15.71:0/3550645617 learned_addr learned my addr 172.21.15.71:0/3550645617 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:07.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.161+0000 7f17e0f9a700 1 --2- 172.21.15.71:0/3550645617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17dc0b33b0 0x7f17dc15e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:07.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.161+0000 7f17e1f9c700 1 --2- 172.21.15.71:0/3550645617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17dc0b4e70 0x7f17dc15e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:07.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.161+0000 7f17e179b700 1 -- 172.21.15.71:0/3550645617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17dc0b33b0 msgr2=0x7f17dc15e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:07.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.161+0000 7f17e179b700 1 --2- 172.21.15.71:0/3550645617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17dc0b33b0 0x7f17dc15e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:07.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.161+0000 7f17e179b700 1 -- 172.21.15.71:0/3550645617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17dc0b4e70 msgr2=0x7f17dc15e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:07.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.161+0000 7f17e179b700 1 --2- 172.21.15.71:0/3550645617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17dc0b4e70 0x7f17dc15e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:07.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.161+0000 7f17e179b700 1 -- 172.21.15.71:0/3550645617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc009420 con 0x7f17dc0b16d0 2023-10-09T07:58:07.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.161+0000 7f17e179b700 1 --2- 172.21.15.71:0/3550645617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17dc0b16d0 0x7f17dc1459c0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f17d800c5c0 tx=0x7f17d8007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:07.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.161+0000 7f17d17fa700 1 -- 172.21.15.71:0/3550645617 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d8005a70 con 0x7f17dc0b16d0 2023-10-09T07:58:07.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.161+0000 7f17d17fa700 1 -- 172.21.15.71:0/3550645617 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d8005bd0 con 0x7f17dc0b16d0 2023-10-09T07:58:07.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.161+0000 7f17d17fa700 1 -- 172.21.15.71:0/3550645617 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d80070d0 con 0x7f17dc0b16d0 2023-10-09T07:58:07.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.161+0000 7f17e279d700 1 -- 172.21.15.71:0/3550645617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17dc0c7ae0 con 0x7f17dc0b16d0 2023-10-09T07:58:07.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.162+0000 7f17e279d700 1 -- 172.21.15.71:0/3550645617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17dc145f00 con 0x7f17dc0b16d0 2023-10-09T07:58:07.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.163+0000 7f17e279d700 1 -- 172.21.15.71:0/3550645617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17dc088990 con 0x7f17dc0b16d0 2023-10-09T07:58:07.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.163+0000 7f17d17fa700 1 -- 172.21.15.71:0/3550645617 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 73) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f17d80074c0 con 0x7f17dc0b16d0 2023-10-09T07:58:07.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.164+0000 7f17d17fa700 1 --2- 172.21.15.71:0/3550645617 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f17c00670e0 0x7f17c0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:07.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.164+0000 7f17d17fa700 1 -- 172.21.15.71:0/3550645617 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f17d8083e80 con 0x7f17dc0b16d0 2023-10-09T07:58:07.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.165+0000 7f17e0f9a700 1 -- 172.21.15.71:0/3550645617 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f17c00670e0 msgr2=0x7f17c0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:07.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.165+0000 7f17e0f9a700 1 --2- 172.21.15.71:0/3550645617 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f17c00670e0 0x7f17c0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:58:07.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.168+0000 7f17d17fa700 1 -- 172.21.15.71:0/3550645617 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17d8050ba0 con 0x7f17dc0b16d0 2023-10-09T07:58:07.265 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:07.264+0000 7f305965e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T07:58:07.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.365+0000 7f17e0f9a700 1 -- 172.21.15.71:0/3550645617 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f17c00670e0 msgr2=0x7f17c0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:07.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.365+0000 7f17e0f9a700 1 --2- 172.21.15.71:0/3550645617 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f17c00670e0 0x7f17c0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:58:07.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.366+0000 7f17e279d700 1 -- 172.21.15.71:0/3550645617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f17dc15f3a0 con 0x7f17dc0b16d0 2023-10-09T07:58:07.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.366+0000 7f17d17fa700 1 -- 172.21.15.71:0/3550645617 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v164) v1 ==== 100+0+11 (secure 0 0 0) 0x7f17d8017020 con 0x7f17dc0b16d0 2023-10-09T07:58:07.367 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-09T07:58:07.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.369+0000 7f17e279d700 1 -- 172.21.15.71:0/3550645617 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f17c00670e0 msgr2=0x7f17c0069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:58:07.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.369+0000 7f17e279d700 1 --2- 172.21.15.71:0/3550645617 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f17c00670e0 0x7f17c0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:07.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.369+0000 7f17e279d700 1 -- 172.21.15.71:0/3550645617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17dc0b16d0 msgr2=0x7f17dc1459c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:07.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.369+0000 7f17e279d700 1 --2- 172.21.15.71:0/3550645617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17dc0b16d0 0x7f17dc1459c0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f17d800c5c0 tx=0x7f17d8007dc0 comp rx=0 tx=0).stop 2023-10-09T07:58:07.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.369+0000 7f17e279d700 1 -- 172.21.15.71:0/3550645617 shutdown_connections 2023-10-09T07:58:07.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.369+0000 7f17e279d700 1 --2- 172.21.15.71:0/3550645617 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f17c00670e0 0x7f17c0069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:07.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.369+0000 7f17e279d700 1 --2- 172.21.15.71:0/3550645617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17dc0b4e70 0x7f17dc15e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:07.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.369+0000 7f17e279d700 1 --2- 172.21.15.71:0/3550645617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17dc0b16d0 0x7f17dc1459c0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:07.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.369+0000 7f17e279d700 1 --2- 172.21.15.71:0/3550645617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17dc0b33b0 0x7f17dc15e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:07.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.369+0000 7f17e279d700 1 -- 172.21.15.71:0/3550645617 >> 172.21.15.71:0/3550645617 conn(0x7f17dc0d10c0 msgr2=0x7f17dc15c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:07.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.369+0000 7f17e279d700 1 -- 172.21.15.71:0/3550645617 shutdown_connections 2023-10-09T07:58:07.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.369+0000 7f17e279d700 1 -- 172.21.15.71:0/3550645617 wait complete. 2023-10-09T07:58:07.388 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:58:07.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.615+0000 7f4266d9d700 1 Processor -- start 2023-10-09T07:58:07.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.615+0000 7f4266d9d700 1 -- start start 2023-10-09T07:58:07.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.616+0000 7f4266d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42601597f0 0x7f42600b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:07.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.616+0000 7f4266d9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42600b11d0 con 0x7f426015d230 2023-10-09T07:58:07.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.617+0000 7f4266d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42600b14b0 con 0x7f4260159420 2023-10-09T07:58:07.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.617+0000 7f4266d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42600b1790 con 0x7f42601597f0 2023-10-09T07:58:07.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.617+0000 7f426659c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f426015d230 0x7f42600b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47338/0 (socket says 172.21.15.71:47338) 2023-10-09T07:58:07.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.617+0000 7f426659c700 1 -- 172.21.15.71:0/152300283 learned_addr learned my addr 172.21.15.71:0/152300283 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:07.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.617+0000 7f426559a700 1 --2- 172.21.15.71:0/152300283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42601597f0 0x7f42600b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:07.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.617+0000 7f4264d99700 1 -- 172.21.15.71:0/152300283 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172353148 0 0) 0x7f42600b11d0 con 0x7f426015d230 2023-10-09T07:58:07.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.617+0000 7f4264d99700 1 -- 172.21.15.71:0/152300283 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f424c003570 con 0x7f426015d230 2023-10-09T07:58:07.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.617+0000 7f4264d99700 1 -- 172.21.15.71:0/152300283 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 705426376 0 0) 0x7f42600b14b0 con 0x7f4260159420 2023-10-09T07:58:07.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.617+0000 7f4264d99700 1 -- 172.21.15.71:0/152300283 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42600b11d0 con 0x7f4260159420 2023-10-09T07:58:07.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.618+0000 7f4264d99700 1 -- 172.21.15.71:0/152300283 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4023936379 0 0) 0x7f424c003570 con 0x7f426015d230 2023-10-09T07:58:07.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.618+0000 7f4264d99700 1 -- 172.21.15.71:0/152300283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42601597f0 msgr2=0x7f42600b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:07.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.618+0000 7f4264d99700 1 --2- 172.21.15.71:0/152300283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42601597f0 0x7f42600b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:07.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.618+0000 7f4264d99700 1 -- 172.21.15.71:0/152300283 >> v1:172.21.15.179:6789/0 conn(0x7f4260159420 legacy=0x7f42600b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:07.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.618+0000 7f4264d99700 1 -- 172.21.15.71:0/152300283 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42600b1a70 con 0x7f426015d230 2023-10-09T07:58:07.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.618+0000 7f4264d99700 1 -- 172.21.15.71:0/152300283 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f4258001470 con 0x7f426015d230 2023-10-09T07:58:07.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.618+0000 7f4264d99700 1 -- 172.21.15.71:0/152300283 >> v1:172.21.15.71:6789/0 conn(0x7f426015d230 legacy=0x7f42600b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:07.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.618+0000 7f4264d99700 1 --2- 172.21.15.71:0/152300283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f424c003c20 0x7f424c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:07.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.618+0000 7f4264d99700 1 --2- 172.21.15.71:0/152300283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42601597f0 0x7f424c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:07.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.618+0000 7f4264d99700 1 --2- 172.21.15.71:0/152300283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f424c004d50 0x7f424c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:07.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.618+0000 7f4264d99700 1 -- 172.21.15.71:0/152300283 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42600b1790 con 0x7f424c004d50 2023-10-09T07:58:07.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.618+0000 7f4264d99700 1 -- 172.21.15.71:0/152300283 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424c00bb40 con 0x7f424c003c20 2023-10-09T07:58:07.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.618+0000 7f4264d99700 1 -- 172.21.15.71:0/152300283 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f424c00bd00 con 0x7f42601597f0 2023-10-09T07:58:07.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.618+0000 7f4265d9b700 1 --2- 172.21.15.71:0/152300283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f424c003c20 0x7f424c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:07.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.618+0000 7f426659c700 1 --2- 172.21.15.71:0/152300283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f424c004d50 0x7f424c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:07.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.618+0000 7f426559a700 1 --2- 172.21.15.71:0/152300283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42601597f0 0x7f424c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:07.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.618+0000 7f426659c700 1 -- 172.21.15.71:0/152300283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42601597f0 msgr2=0x7f424c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:07.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.619+0000 7f426659c700 1 --2- 172.21.15.71:0/152300283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42601597f0 0x7f424c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:07.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.619+0000 7f426659c700 1 -- 172.21.15.71:0/152300283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f424c003c20 msgr2=0x7f424c004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:07.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.619+0000 7f426659c700 1 --2- 172.21.15.71:0/152300283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f424c003c20 0x7f424c004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:07.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.619+0000 7f426659c700 1 -- 172.21.15.71:0/152300283 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424c003570 con 0x7f424c004d50 2023-10-09T07:58:07.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.619+0000 7f4265d9b700 1 --2- 172.21.15.71:0/152300283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f424c003c20 0x7f424c004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:58:07.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.619+0000 7f426659c700 1 --2- 172.21.15.71:0/152300283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f424c004d50 0x7f424c0051c0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f425800c2d0 tx=0x7f4258001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b71abe8fa090d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:07.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.619+0000 7f4264d99700 1 -- 172.21.15.71:0/152300283 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425800cbc0 con 0x7f424c004d50 2023-10-09T07:58:07.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.619+0000 7f4264d99700 1 -- 172.21.15.71:0/152300283 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425800cd20 con 0x7f424c004d50 2023-10-09T07:58:07.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.619+0000 7f4264d99700 1 -- 172.21.15.71:0/152300283 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4258005b50 con 0x7f424c004d50 2023-10-09T07:58:07.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.620+0000 7f4266d9d700 1 -- 172.21.15.71:0/152300283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f424c004d50 msgr2=0x7f424c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:07.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.620+0000 7f4266d9d700 1 --2- 172.21.15.71:0/152300283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f424c004d50 0x7f424c0051c0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f425800c2d0 tx=0x7f4258001df0 comp rx=0 tx=0).stop 2023-10-09T07:58:07.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.620+0000 7f426659c700 1 -- 172.21.15.71:0/152300283 reap_dead start 2023-10-09T07:58:07.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.620+0000 7f4266d9d700 1 -- 172.21.15.71:0/152300283 shutdown_connections 2023-10-09T07:58:07.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.620+0000 7f4266d9d700 1 -- 172.21.15.71:0/152300283 >> 172.21.15.71:0/152300283 conn(0x7f42600d0660 msgr2=0x7f42600d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:07.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.620+0000 7f4266d9d700 1 -- 172.21.15.71:0/152300283 shutdown_connections 2023-10-09T07:58:07.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.620+0000 7f4266d9d700 1 -- 172.21.15.71:0/152300283 wait complete. 2023-10-09T07:58:07.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.621+0000 7f4266d9d700 1 Processor -- start 2023-10-09T07:58:07.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.621+0000 7f4266d9d700 1 -- start start 2023-10-09T07:58:07.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.622+0000 7f4266d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f424c004d50 0x7f42600cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:07.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.622+0000 7f4266d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4260153c00 0x7f4260144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:07.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.622+0000 7f4266d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4260068e70 0x7f42600692f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:07.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.622+0000 7f4266d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4260069830 con 0x7f4260068e70 2023-10-09T07:58:07.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.622+0000 7f4266d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4260144990 con 0x7f424c004d50 2023-10-09T07:58:07.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.622+0000 7f4266d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42600cc1e0 con 0x7f4260153c00 2023-10-09T07:58:07.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.622+0000 7f426659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4260068e70 0x7f42600692f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:07.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.623+0000 7f426659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4260068e70 0x7f42600692f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37648/0 (socket says 172.21.15.71:37648) 2023-10-09T07:58:07.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.623+0000 7f426659c700 1 -- 172.21.15.71:0/1922854933 learned_addr learned my addr 172.21.15.71:0/1922854933 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:07.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.623+0000 7f4265d9b700 1 --2- 172.21.15.71:0/1922854933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f424c004d50 0x7f42600cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:07.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.623+0000 7f426559a700 1 --2- 172.21.15.71:0/1922854933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4260153c00 0x7f4260144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:07.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.623+0000 7f426659c700 1 -- 172.21.15.71:0/1922854933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4260153c00 msgr2=0x7f4260144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:07.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.623+0000 7f426659c700 1 --2- 172.21.15.71:0/1922854933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4260153c00 0x7f4260144ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:07.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.623+0000 7f426659c700 1 -- 172.21.15.71:0/1922854933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f424c004d50 msgr2=0x7f42600cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:07.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.623+0000 7f426659c700 1 --2- 172.21.15.71:0/1922854933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f424c004d50 0x7f42600cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:07.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.623+0000 7f426659c700 1 -- 172.21.15.71:0/1922854933 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4260145860 con 0x7f4260068e70 2023-10-09T07:58:07.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.623+0000 7f426659c700 1 --2- 172.21.15.71:0/1922854933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4260068e70 0x7f42600692f0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f4258011000 tx=0x7f4258015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:07.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.623+0000 7f4255ffb700 1 -- 172.21.15.71:0/1922854933 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42580070d0 con 0x7f4260068e70 2023-10-09T07:58:07.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.623+0000 7f4255ffb700 1 -- 172.21.15.71:0/1922854933 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4258007290 con 0x7f4260068e70 2023-10-09T07:58:07.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.623+0000 7f4266d9d700 1 -- 172.21.15.71:0/1922854933 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4260145b40 con 0x7f4260068e70 2023-10-09T07:58:07.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.624+0000 7f4255ffb700 1 -- 172.21.15.71:0/1922854933 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4258007650 con 0x7f4260068e70 2023-10-09T07:58:07.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.624+0000 7f4266d9d700 1 -- 172.21.15.71:0/1922854933 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4260146100 con 0x7f4260068e70 2023-10-09T07:58:07.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.625+0000 7f4266d9d700 1 -- 172.21.15.71:0/1922854933 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f426004c3c0 con 0x7f4260068e70 2023-10-09T07:58:07.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.626+0000 7f4255ffb700 1 -- 172.21.15.71:0/1922854933 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 73) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f4258019070 con 0x7f4260068e70 2023-10-09T07:58:07.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.626+0000 7f4255ffb700 1 --2- 172.21.15.71:0/1922854933 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f42440670e0 0x7f4244069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:07.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.626+0000 7f4255ffb700 1 -- 172.21.15.71:0/1922854933 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f42580858d0 con 0x7f4260068e70 2023-10-09T07:58:07.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.627+0000 7f4265d9b700 1 -- 172.21.15.71:0/1922854933 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f42440670e0 msgr2=0x7f4244069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:07.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.627+0000 7f4265d9b700 1 --2- 172.21.15.71:0/1922854933 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f42440670e0 0x7f4244069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:58:07.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.630+0000 7f4255ffb700 1 -- 172.21.15.71:0/1922854933 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42580525f0 con 0x7f4260068e70 2023-10-09T07:58:07.637 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:07.637+0000 7f3023350180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T07:58:07.731 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:07.731+0000 7f3023350180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T07:58:07.769 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:07.768+0000 7f305965e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T07:58:07.820 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:07.820+0000 7f3023350180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T07:58:07.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.828+0000 7f4265d9b700 1 -- 172.21.15.71:0/1922854933 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f42440670e0 msgr2=0x7f4244069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:07.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.828+0000 7f4265d9b700 1 --2- 172.21.15.71:0/1922854933 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f42440670e0 0x7f4244069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:58:07.864 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:07.864+0000 7f305965e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T07:58:07.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.878+0000 7f4266d9d700 1 -- 172.21.15.71:0/1922854933 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42600b1d50 con 0x7f4260068e70 2023-10-09T07:58:07.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.878+0000 7f4255ffb700 1 -- 172.21.15.71:0/1922854933 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f4258017020 con 0x7f4260068e70 2023-10-09T07:58:07.879 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:58:07.880 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1228129559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1228129559},{"type":"v1","addr":"172.21.15.179:6836","nonce":1228129559}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8254,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3640887500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3640887500},{"type":"v1","addr":"172.21.15.179:6834","nonce":3640887500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8586,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/4266132184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":4266132184},{"type":"v1","addr":"172.21.15.71:6834","nonce":4266132184}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:57:41.159434+0000","modified":"2023-10-09T07:57:44.718117+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8589":{"gid":8589,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/889811309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":889811309},{"type":"v1","addr":"172.21.15.71:6835","nonce":889811309}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T07:58:07.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.881+0000 7f4266d9d700 1 -- 172.21.15.71:0/1922854933 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f42440670e0 msgr2=0x7f4244069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:58:07.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.881+0000 7f4266d9d700 1 --2- 172.21.15.71:0/1922854933 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f42440670e0 0x7f4244069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:07.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.881+0000 7f4266d9d700 1 -- 172.21.15.71:0/1922854933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4260068e70 msgr2=0x7f42600692f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:07.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.881+0000 7f4266d9d700 1 --2- 172.21.15.71:0/1922854933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4260068e70 0x7f42600692f0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f4258011000 tx=0x7f4258015000 comp rx=0 tx=0).stop 2023-10-09T07:58:07.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.881+0000 7f4266d9d700 1 -- 172.21.15.71:0/1922854933 shutdown_connections 2023-10-09T07:58:07.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.881+0000 7f4266d9d700 1 --2- 172.21.15.71:0/1922854933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4260068e70 0x7f42600692f0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:07.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.881+0000 7f4266d9d700 1 --2- 172.21.15.71:0/1922854933 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f42440670e0 0x7f4244069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:07.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.881+0000 7f4266d9d700 1 --2- 172.21.15.71:0/1922854933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f424c004d50 0x7f42600cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:07.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.881+0000 7f4266d9d700 1 --2- 172.21.15.71:0/1922854933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4260153c00 0x7f4260144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:07.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.881+0000 7f4266d9d700 1 -- 172.21.15.71:0/1922854933 >> 172.21.15.71:0/1922854933 conn(0x7f42600d0660 msgr2=0x7f42600ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:07.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.881+0000 7f4266d9d700 1 -- 172.21.15.71:0/1922854933 shutdown_connections 2023-10-09T07:58:07.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:07.881+0000 7f4266d9d700 1 -- 172.21.15.71:0/1922854933 wait complete. 2023-10-09T07:58:07.884 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 74 2023-10-09T07:58:07.900 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:58:07.968 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:07.968+0000 7f305965e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T07:58:08.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.094+0000 7f275939d700 1 Processor -- start 2023-10-09T07:58:08.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.094+0000 7f275939d700 1 -- start start 2023-10-09T07:58:08.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.096+0000 7f275939d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2754159420 0x7f27540b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:08.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.096+0000 7f275939d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f275415d230 0x7f275415d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:08.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.096+0000 7f275939d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27540b2980 con 0x7f27541597f0 2023-10-09T07:58:08.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.096+0000 7f275939d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f275415dbb0 con 0x7f2754159420 2023-10-09T07:58:08.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.096+0000 7f275939d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27540b11d0 con 0x7f275415d230 2023-10-09T07:58:08.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.096+0000 7f27537fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f27541597f0 0x7f27540b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47342/0 (socket says 172.21.15.71:47342) 2023-10-09T07:58:08.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.097+0000 7f27537fe700 1 -- 172.21.15.71:0/3442429407 learned_addr learned my addr 172.21.15.71:0/3442429407 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:08.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.097+0000 7f2758b9c700 1 --2- 172.21.15.71:0/3442429407 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f275415d230 0x7f275415d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:08.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.097+0000 7f2753fff700 1 --2- 172.21.15.71:0/3442429407 >> v2:172.21.15.179:3300/0 conn(0x7f2754159420 0x7f27540b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:08.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.097+0000 7f2752ffd700 1 -- 172.21.15.71:0/3442429407 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965301982 0 0) 0x7f27540b2980 con 0x7f27541597f0 2023-10-09T07:58:08.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.097+0000 7f2752ffd700 1 -- 172.21.15.71:0/3442429407 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f273c003570 con 0x7f27541597f0 2023-10-09T07:58:08.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.097+0000 7f2753fff700 1 -- 172.21.15.71:0/3442429407 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f275415d230 msgr2=0x7f275415d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:08.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.097+0000 7f2753fff700 1 --2- 172.21.15.71:0/3442429407 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f275415d230 0x7f275415d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:08.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.097+0000 7f2753fff700 1 -- 172.21.15.71:0/3442429407 >> v1:172.21.15.71:6789/0 conn(0x7f27541597f0 legacy=0x7f27540b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:08.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.097+0000 7f2753fff700 1 -- 172.21.15.71:0/3442429407 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27540b14b0 con 0x7f2754159420 2023-10-09T07:58:08.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.097+0000 7f2753fff700 1 --2- 172.21.15.71:0/3442429407 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2754159420 0x7f27540b5f40 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f27440098e0 tx=0x7f27440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58372474b799c9e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:08.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.098+0000 7f2752ffd700 1 -- 172.21.15.71:0/3442429407 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744011630 con 0x7f2754159420 2023-10-09T07:58:08.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.098+0000 7f2752ffd700 1 -- 172.21.15.71:0/3442429407 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2744011790 con 0x7f2754159420 2023-10-09T07:58:08.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.098+0000 7f2752ffd700 1 -- 172.21.15.71:0/3442429407 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744011b30 con 0x7f2754159420 2023-10-09T07:58:08.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.098+0000 7f275939d700 1 -- 172.21.15.71:0/3442429407 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2754159420 msgr2=0x7f27540b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:08.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.098+0000 7f275939d700 1 --2- 172.21.15.71:0/3442429407 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2754159420 0x7f27540b5f40 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f27440098e0 tx=0x7f27440091a0 comp rx=0 tx=0).stop 2023-10-09T07:58:08.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.098+0000 7f275939d700 1 -- 172.21.15.71:0/3442429407 shutdown_connections 2023-10-09T07:58:08.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.098+0000 7f275939d700 1 --2- 172.21.15.71:0/3442429407 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f275415d230 0x7f275415d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:08.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.098+0000 7f275939d700 1 --2- 172.21.15.71:0/3442429407 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2754159420 0x7f27540b5f40 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:08.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.098+0000 7f275939d700 1 -- 172.21.15.71:0/3442429407 >> 172.21.15.71:0/3442429407 conn(0x7f27540d0660 msgr2=0x7f27540d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:08.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.099+0000 7f275939d700 1 -- 172.21.15.71:0/3442429407 shutdown_connections 2023-10-09T07:58:08.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.099+0000 7f275939d700 1 -- 172.21.15.71:0/3442429407 wait complete. 2023-10-09T07:58:08.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.100+0000 7f275939d700 1 Processor -- start 2023-10-09T07:58:08.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.100+0000 7f275939d700 1 -- start start 2023-10-09T07:58:08.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.101+0000 7f275939d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2754159420 0x7f27540c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:08.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.101+0000 7f275939d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27541597f0 0x7f275415ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:08.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.101+0000 7f275939d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f275415d230 0x7f275415b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:08.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.101+0000 7f275939d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27540ca6b0 con 0x7f2754159420 2023-10-09T07:58:08.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.101+0000 7f275939d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27540c58e0 con 0x7f275415d230 2023-10-09T07:58:08.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.101+0000 7f275939d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27540c5bc0 con 0x7f27541597f0 2023-10-09T07:58:08.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.101+0000 7f2753fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2754159420 0x7f27540c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:08.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.101+0000 7f2753fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2754159420 0x7f27540c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37650/0 (socket says 172.21.15.71:37650) 2023-10-09T07:58:08.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.101+0000 7f2753fff700 1 -- 172.21.15.71:0/4028276328 learned_addr learned my addr 172.21.15.71:0/4028276328 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:08.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.101+0000 7f27537fe700 1 --2- 172.21.15.71:0/4028276328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27541597f0 0x7f275415ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:08.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.101+0000 7f2758b9c700 1 --2- 172.21.15.71:0/4028276328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f275415d230 0x7f275415b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:08.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.102+0000 7f2753fff700 1 -- 172.21.15.71:0/4028276328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27541597f0 msgr2=0x7f275415ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:08.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.102+0000 7f2753fff700 1 --2- 172.21.15.71:0/4028276328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27541597f0 0x7f275415ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:08.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.102+0000 7f2753fff700 1 -- 172.21.15.71:0/4028276328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f275415d230 msgr2=0x7f275415b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:08.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.102+0000 7f2753fff700 1 --2- 172.21.15.71:0/4028276328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f275415d230 0x7f275415b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:08.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.102+0000 7f2753fff700 1 -- 172.21.15.71:0/4028276328 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2744009420 con 0x7f2754159420 2023-10-09T07:58:08.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.102+0000 7f2753fff700 1 --2- 172.21.15.71:0/4028276328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2754159420 0x7f27540c8450 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f2754089340 tx=0x7f2744017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:08.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.102+0000 7f273bfff700 1 -- 172.21.15.71:0/4028276328 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744000d10 con 0x7f2754159420 2023-10-09T07:58:08.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.102+0000 7f273bfff700 1 -- 172.21.15.71:0/4028276328 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2744011b10 con 0x7f2754159420 2023-10-09T07:58:08.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.102+0000 7f275939d700 1 -- 172.21.15.71:0/4028276328 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27540ca060 con 0x7f2754159420 2023-10-09T07:58:08.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.102+0000 7f273bfff700 1 -- 172.21.15.71:0/4028276328 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744025660 con 0x7f2754159420 2023-10-09T07:58:08.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.102+0000 7f275939d700 1 -- 172.21.15.71:0/4028276328 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27540c8990 con 0x7f2754159420 2023-10-09T07:58:08.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.103+0000 7f275939d700 1 -- 172.21.15.71:0/4028276328 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27540c9ec0 con 0x7f2754159420 2023-10-09T07:58:08.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.104+0000 7f273bfff700 1 -- 172.21.15.71:0/4028276328 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 73) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f2744025a50 con 0x7f2754159420 2023-10-09T07:58:08.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.105+0000 7f273bfff700 1 --2- 172.21.15.71:0/4028276328 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27400670e0 0x7f2740069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:08.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.106+0000 7f273bfff700 1 -- 172.21.15.71:0/4028276328 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f27440862e0 con 0x7f2754159420 2023-10-09T07:58:08.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.106+0000 7f27537fe700 1 -- 172.21.15.71:0/4028276328 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27400670e0 msgr2=0x7f2740069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:08.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.106+0000 7f27537fe700 1 --2- 172.21.15.71:0/4028276328 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27400670e0 0x7f2740069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:58:08.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.110+0000 7f273bfff700 1 -- 172.21.15.71:0/4028276328 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27540c9ec0 con 0x7f2754159420 2023-10-09T07:58:08.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.307+0000 7f27537fe700 1 -- 172.21.15.71:0/4028276328 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27400670e0 msgr2=0x7f2740069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:08.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.307+0000 7f27537fe700 1 --2- 172.21.15.71:0/4028276328 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27400670e0 0x7f2740069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:58:08.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.311+0000 7f275939d700 1 -- 172.21.15.71:0/4028276328 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27540c9ec0 con 0x7f2754159420 2023-10-09T07:58:08.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.312+0000 7f273bfff700 1 -- 172.21.15.71:0/4028276328 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+16447 (secure 0 0 0) 0x7f27540c9ec0 con 0x7f2754159420 2023-10-09T07:58:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:58:08.314 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":164,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:58:01.789247+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:57:39.262671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T07:57:40.149000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6837/85452":"2023-10-10T07:58:01.789216+0000","172.21.15.179:0/3833946352":"2023-10-10T07:58:01.789216+0000","172.21.15.179:6835/85452":"2023-10-10T07:58:01.789216+0000","172.21.15.179:0/4153201756":"2023-10-10T07:58:01.789216+0000","172.21.15.179:0/2153051455":"2023-10-10T07:58:01.789216+0000","172.21.15.179:0/4288328453":"2023-10-10T07:58:01.789216+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:58:08.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.315+0000 7f275939d700 1 -- 172.21.15.71:0/4028276328 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27400670e0 msgr2=0x7f2740069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:58:08.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.315+0000 7f275939d700 1 --2- 172.21.15.71:0/4028276328 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27400670e0 0x7f2740069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:08.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.315+0000 7f275939d700 1 -- 172.21.15.71:0/4028276328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2754159420 msgr2=0x7f27540c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:08.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.315+0000 7f275939d700 1 --2- 172.21.15.71:0/4028276328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2754159420 0x7f27540c8450 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f2754089340 tx=0x7f2744017000 comp rx=0 tx=0).stop 2023-10-09T07:58:08.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.315+0000 7f275939d700 1 -- 172.21.15.71:0/4028276328 shutdown_connections 2023-10-09T07:58:08.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.315+0000 7f275939d700 1 --2- 172.21.15.71:0/4028276328 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f27400670e0 0x7f2740069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:08.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.315+0000 7f275939d700 1 --2- 172.21.15.71:0/4028276328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f275415d230 0x7f275415b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:08.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.315+0000 7f275939d700 1 --2- 172.21.15.71:0/4028276328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2754159420 0x7f27540c8450 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:08.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.315+0000 7f275939d700 1 --2- 172.21.15.71:0/4028276328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27541597f0 0x7f275415ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:08.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.315+0000 7f275939d700 1 -- 172.21.15.71:0/4028276328 >> 172.21.15.71:0/4028276328 conn(0x7f27540d0660 msgr2=0x7f2754068a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:08.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.315+0000 7f275939d700 1 -- 172.21.15.71:0/4028276328 shutdown_connections 2023-10-09T07:58:08.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.315+0000 7f275939d700 1 -- 172.21.15.71:0/4028276328 wait complete. 2023-10-09T07:58:08.335 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T07:58:08.335 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:58:08.445 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:08.445+0000 7f3023350180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T07:58:08.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.542+0000 7f3b03fff700 1 Processor -- start 2023-10-09T07:58:08.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.543+0000 7f3b03fff700 1 -- start start 2023-10-09T07:58:08.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.545+0000 7f3b03fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3b0415daa0 0x7f3b0406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:08.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.545+0000 7f3b03fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b0415de70 0x7f3b040c7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:08.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.545+0000 7f3b03fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3b040696c0 0x7f3b0406ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:08.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.545+0000 7f3b03fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0406e8c0 con 0x7f3b040696c0 2023-10-09T07:58:08.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.545+0000 7f3b03fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b040ca740 con 0x7f3b0415daa0 2023-10-09T07:58:08.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.545+0000 7f3b03fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0406e5e0 con 0x7f3b0415de70 2023-10-09T07:58:08.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.545+0000 7f3b02ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3b0415daa0 0x7f3b0406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:08.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.545+0000 7f3b02ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3b0415daa0 0x7f3b0406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:46812/0 (socket says 172.21.15.71:46812) 2023-10-09T07:58:08.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.545+0000 7f3b02ffd700 1 -- 172.21.15.71:0/3133856564 learned_addr learned my addr 172.21.15.71:0/3133856564 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:08.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.545+0000 7f3b037fe700 1 --2- 172.21.15.71:0/3133856564 >> v2:172.21.15.71:3300/0 conn(0x7f3b040696c0 0x7f3b0406ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:08.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.545+0000 7f3b027fc700 1 --2- 172.21.15.71:0/3133856564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b0415de70 0x7f3b040c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:08.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.546+0000 7f3b02ffd700 1 -- 172.21.15.71:0/3133856564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b0415de70 msgr2=0x7f3b040c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:08.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.546+0000 7f3b02ffd700 1 --2- 172.21.15.71:0/3133856564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b0415de70 0x7f3b040c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:08.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.546+0000 7f3b02ffd700 1 -- 172.21.15.71:0/3133856564 >> v2:172.21.15.71:3300/0 conn(0x7f3b040696c0 msgr2=0x7f3b0406ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:08.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.546+0000 7f3b02ffd700 1 --2- 172.21.15.71:0/3133856564 >> v2:172.21.15.71:3300/0 conn(0x7f3b040696c0 0x7f3b0406ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:08.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.546+0000 7f3b02ffd700 1 -- 172.21.15.71:0/3133856564 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b040ca0f0 con 0x7f3b0415daa0 2023-10-09T07:58:08.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.546+0000 7f3b02ffd700 1 --2- 172.21.15.71:0/3133856564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b0415daa0 0x7f3b0406e000 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f3b04071370 tx=0x7f3afc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33030632cb0c9b5e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:08.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.546+0000 7f3b01ffb700 1 -- 172.21.15.71:0/3133856564 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc00b640 con 0x7f3b0415daa0 2023-10-09T07:58:08.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.547+0000 7f3b01ffb700 1 -- 172.21.15.71:0/3133856564 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3afc00b7a0 con 0x7f3b0415daa0 2023-10-09T07:58:08.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.547+0000 7f3b01ffb700 1 -- 172.21.15.71:0/3133856564 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc00bb20 con 0x7f3b0415daa0 2023-10-09T07:58:08.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.547+0000 7f3b03fff700 1 -- 172.21.15.71:0/3133856564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b0415daa0 msgr2=0x7f3b0406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:08.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.547+0000 7f3b03fff700 1 --2- 172.21.15.71:0/3133856564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b0415daa0 0x7f3b0406e000 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f3b04071370 tx=0x7f3afc009250 comp rx=0 tx=0).stop 2023-10-09T07:58:08.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.548+0000 7f3b03fff700 1 -- 172.21.15.71:0/3133856564 shutdown_connections 2023-10-09T07:58:08.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.548+0000 7f3b03fff700 1 --2- 172.21.15.71:0/3133856564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b0415daa0 0x7f3b0406e000 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:08.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.548+0000 7f3b03fff700 1 --2- 172.21.15.71:0/3133856564 >> v2:172.21.15.71:3300/0 conn(0x7f3b040696c0 0x7f3b0406ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:08.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.548+0000 7f3b03fff700 1 --2- 172.21.15.71:0/3133856564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b0415de70 0x7f3b040c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:08.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.548+0000 7f3b03fff700 1 -- 172.21.15.71:0/3133856564 >> 172.21.15.71:0/3133856564 conn(0x7f3b040cc1f0 msgr2=0x7f3b040cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:08.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.548+0000 7f3b03fff700 1 -- 172.21.15.71:0/3133856564 shutdown_connections 2023-10-09T07:58:08.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.548+0000 7f3b03fff700 1 -- 172.21.15.71:0/3133856564 wait complete. 2023-10-09T07:58:08.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.550+0000 7f3b03fff700 1 Processor -- start 2023-10-09T07:58:08.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.551+0000 7f3b03fff700 1 -- start start 2023-10-09T07:58:08.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.552+0000 7f3b03fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b040696c0 0x7f3b0418b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:08.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.552+0000 7f3b03fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b0415daa0 0x7f3b0415bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:08.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.553+0000 7f3b02ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b040696c0 0x7f3b0418b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:08.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.553+0000 7f3b027fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b0415daa0 0x7f3b0415bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:08.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.553+0000 7f3b027fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b0415daa0 0x7f3b0415bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:46824/0 (socket says 172.21.15.71:46824) 2023-10-09T07:58:08.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.553+0000 7f3b02ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b040696c0 0x7f3b0418b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:49746/0 (socket says 172.21.15.71:49746) 2023-10-09T07:58:08.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.553+0000 7f3b027fc700 1 -- 172.21.15.71:0/3574603813 learned_addr learned my addr 172.21.15.71:0/3574603813 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:08.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.553+0000 7f3b03fff700 1 --2- 172.21.15.71:0/3574603813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b0415de70 0x7f3b040b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:08.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.553+0000 7f3b03fff700 1 -- 172.21.15.71:0/3574603813 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0418b840 con 0x7f3b0415de70 2023-10-09T07:58:08.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.553+0000 7f3b03fff700 1 -- 172.21.15.71:0/3574603813 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0415cd80 con 0x7f3b0415daa0 2023-10-09T07:58:08.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.553+0000 7f3b03fff700 1 -- 172.21.15.71:0/3574603813 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b04161140 con 0x7f3b040696c0 2023-10-09T07:58:08.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.553+0000 7f3b027fc700 1 -- 172.21.15.71:0/3574603813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b040696c0 msgr2=0x7f3b0418b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:08.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.553+0000 7f3b027fc700 1 --2- 172.21.15.71:0/3574603813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b040696c0 0x7f3b0418b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:08.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.553+0000 7f3b027fc700 1 -- 172.21.15.71:0/3574603813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b0415de70 msgr2=0x7f3b040b0570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:58:08.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.553+0000 7f3b027fc700 1 --2- 172.21.15.71:0/3574603813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b0415de70 0x7f3b040b0570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:08.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.554+0000 7f3b027fc700 1 -- 172.21.15.71:0/3574603813 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc0094f0 con 0x7f3b0415daa0 2023-10-09T07:58:08.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.554+0000 7f3b02ffd700 1 --2- 172.21.15.71:0/3574603813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b040696c0 0x7f3b0418b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:58:08.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.554+0000 7f3b027fc700 1 --2- 172.21.15.71:0/3574603813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b0415daa0 0x7f3b0415bc90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3aec009eb0 tx=0x7f3aec00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:08.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.554+0000 7f3afaffd700 1 -- 172.21.15.71:0/3574603813 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec00cc20 con 0x7f3b0415daa0 2023-10-09T07:58:08.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.554+0000 7f3afaffd700 1 -- 172.21.15.71:0/3574603813 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aec00f040 con 0x7f3b0415daa0 2023-10-09T07:58:08.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.554+0000 7f3afaffd700 1 -- 172.21.15.71:0/3574603813 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec014480 con 0x7f3b0415daa0 2023-10-09T07:58:08.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.554+0000 7f3b03fff700 1 -- 172.21.15.71:0/3574603813 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b04161420 con 0x7f3b0415daa0 2023-10-09T07:58:08.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.555+0000 7f3b03fff700 1 -- 172.21.15.71:0/3574603813 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b041619e0 con 0x7f3b0415daa0 2023-10-09T07:58:08.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.558+0000 7f3afaffd700 1 -- 172.21.15.71:0/3574603813 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 73) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f3aec0147f0 con 0x7f3b0415daa0 2023-10-09T07:58:08.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.560+0000 7f3afaffd700 1 --2- 172.21.15.71:0/3574603813 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3ae4067160 0x7f3ae4069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:08.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.560+0000 7f3afaffd700 1 -- 172.21.15.71:0/3574603813 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f3aec085960 con 0x7f3b0415daa0 2023-10-09T07:58:08.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.560+0000 7f3b02ffd700 1 -- 172.21.15.71:0/3574603813 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3ae4067160 msgr2=0x7f3ae4069610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:08.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.560+0000 7f3b02ffd700 1 --2- 172.21.15.71:0/3574603813 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3ae4067160 0x7f3ae4069610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:58:08.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.560+0000 7f3af8ff9700 1 -- 172.21.15.71:0/3574603813 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3adc0052b0 con 0x7f3b0415daa0 2023-10-09T07:58:08.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.566+0000 7f3afaffd700 1 -- 172.21.15.71:0/3574603813 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3aec0524d0 con 0x7f3b0415daa0 2023-10-09T07:58:08.619 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:08.619+0000 7f3023350180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:58:08.623 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:08.622+0000 7f305965e180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T07:58:08.715 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:08.715+0000 7f3023350180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T07:58:08.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.761+0000 7f3b02ffd700 1 -- 172.21.15.71:0/3574603813 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3ae4067160 msgr2=0x7f3ae4069610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:08.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.761+0000 7f3b02ffd700 1 --2- 172.21.15.71:0/3574603813 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3ae4067160 0x7f3ae4069610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:58:08.802 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:08.801+0000 7f305965e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:58:08.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.811+0000 7f3af8ff9700 1 -- 172.21.15.71:0/3574603813 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3adc005560 con 0x7f3b0415daa0 2023-10-09T07:58:08.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.812+0000 7f3afaffd700 1 -- 172.21.15.71:0/3574603813 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f3aec055af0 con 0x7f3b0415daa0 2023-10-09T07:58:08.812 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:58:08.813 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1228129559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1228129559},{"type":"v1","addr":"172.21.15.179:6836","nonce":1228129559}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8254,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3640887500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3640887500},{"type":"v1","addr":"172.21.15.179:6834","nonce":3640887500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8586,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/4266132184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":4266132184},{"type":"v1","addr":"172.21.15.71:6834","nonce":4266132184}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:57:41.159434+0000","modified":"2023-10-09T07:57:44.718117+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8589":{"gid":8589,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/889811309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":889811309},{"type":"v1","addr":"172.21.15.71:6835","nonce":889811309}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T07:58:08.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.815+0000 7f3af8ff9700 1 -- 172.21.15.71:0/3574603813 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3ae4067160 msgr2=0x7f3ae4069610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:58:08.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.815+0000 7f3af8ff9700 1 --2- 172.21.15.71:0/3574603813 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3ae4067160 0x7f3ae4069610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:08.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.815+0000 7f3af8ff9700 1 -- 172.21.15.71:0/3574603813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b0415daa0 msgr2=0x7f3b0415bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:08.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.815+0000 7f3af8ff9700 1 --2- 172.21.15.71:0/3574603813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b0415daa0 0x7f3b0415bc90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3aec009eb0 tx=0x7f3aec00b040 comp rx=0 tx=0).stop 2023-10-09T07:58:08.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.815+0000 7f3af8ff9700 1 -- 172.21.15.71:0/3574603813 shutdown_connections 2023-10-09T07:58:08.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.815+0000 7f3af8ff9700 1 --2- 172.21.15.71:0/3574603813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b0415de70 0x7f3b040b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:08.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.815+0000 7f3af8ff9700 1 --2- 172.21.15.71:0/3574603813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b040696c0 0x7f3b0418b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:08.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.815+0000 7f3af8ff9700 1 --2- 172.21.15.71:0/3574603813 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3ae4067160 0x7f3ae4069610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:08.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.815+0000 7f3af8ff9700 1 --2- 172.21.15.71:0/3574603813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b0415daa0 0x7f3b0415bc90 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:08.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.815+0000 7f3af8ff9700 1 -- 172.21.15.71:0/3574603813 >> 172.21.15.71:0/3574603813 conn(0x7f3b040cc1f0 msgr2=0x7f3b040c6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:08.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.815+0000 7f3af8ff9700 1 -- 172.21.15.71:0/3574603813 shutdown_connections 2023-10-09T07:58:08.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:08.815+0000 7f3af8ff9700 1 -- 172.21.15.71:0/3574603813 wait complete. 2023-10-09T07:58:08.818 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 74 2023-10-09T07:58:08.841 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:58:08.915 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:08.914+0000 7f305965e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T07:58:09.011 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:09.011+0000 7f3023350180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T07:58:09.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.029+0000 7f0b733ff700 1 Processor -- start 2023-10-09T07:58:09.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.029+0000 7f0b733ff700 1 -- start start 2023-10-09T07:58:09.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.030+0000 7f0b733ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b6c06bcd0 0x7f0b6c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:09.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.030+0000 7f0b733ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6c15d7e0 con 0x7f0b6c15df50 2023-10-09T07:58:09.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.030+0000 7f0b733ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6c15dac0 con 0x7f0b6c06c0a0 2023-10-09T07:58:09.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.030+0000 7f0b733ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c15aa30 con 0x7f0b6c06bcd0 2023-10-09T07:58:09.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.031+0000 7f0b7199c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f0b6c15df50 0x7f0b6c0c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47346/0 (socket says 172.21.15.71:47346) 2023-10-09T07:58:09.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.031+0000 7f0b7199c700 1 -- 172.21.15.71:0/4071301973 learned_addr learned my addr 172.21.15.71:0/4071301973 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:09.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.031+0000 7f0b7119b700 1 --2- 172.21.15.71:0/4071301973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b6c06bcd0 0x7f0b6c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:09.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.031+0000 7f0b63fff700 1 -- 172.21.15.71:0/4071301973 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413896111 0 0) 0x7f0b6c15d7e0 con 0x7f0b6c15df50 2023-10-09T07:58:09.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.031+0000 7f0b63fff700 1 -- 172.21.15.71:0/4071301973 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b58003570 con 0x7f0b6c15df50 2023-10-09T07:58:09.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.031+0000 7f0b63fff700 1 -- 172.21.15.71:0/4071301973 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 76601095 0 0) 0x7f0b6c15dac0 con 0x7f0b6c06c0a0 2023-10-09T07:58:09.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.031+0000 7f0b63fff700 1 -- 172.21.15.71:0/4071301973 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b6c15d7e0 con 0x7f0b6c06c0a0 2023-10-09T07:58:09.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.031+0000 7f0b7119b700 1 -- 172.21.15.71:0/4071301973 >> v1:172.21.15.179:6789/0 conn(0x7f0b6c06c0a0 legacy=0x7f0b6c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:09.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.031+0000 7f0b7119b700 1 -- 172.21.15.71:0/4071301973 >> v1:172.21.15.71:6789/0 conn(0x7f0b6c15df50 legacy=0x7f0b6c0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:09.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.031+0000 7f0b7119b700 1 -- 172.21.15.71:0/4071301973 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c15ad10 con 0x7f0b6c06bcd0 2023-10-09T07:58:09.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.032+0000 7f0b7119b700 1 --2- 172.21.15.71:0/4071301973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b6c06bcd0 0x7f0b6c0caa90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009910 tx=0x7f0b680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a549668e56d9f33 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:09.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.032+0000 7f0b63fff700 1 -- 172.21.15.71:0/4071301973 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b68011630 con 0x7f0b6c06bcd0 2023-10-09T07:58:09.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.032+0000 7f0b63fff700 1 -- 172.21.15.71:0/4071301973 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b68011790 con 0x7f0b6c06bcd0 2023-10-09T07:58:09.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.032+0000 7f0b63fff700 1 -- 172.21.15.71:0/4071301973 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b68011b30 con 0x7f0b6c06bcd0 2023-10-09T07:58:09.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.033+0000 7f0b733ff700 1 -- 172.21.15.71:0/4071301973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b6c06bcd0 msgr2=0x7f0b6c0caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:09.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.033+0000 7f0b733ff700 1 --2- 172.21.15.71:0/4071301973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b6c06bcd0 0x7f0b6c0caa90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009910 tx=0x7f0b680091a0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.033+0000 7f0b733ff700 1 -- 172.21.15.71:0/4071301973 shutdown_connections 2023-10-09T07:58:09.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.033+0000 7f0b733ff700 1 --2- 172.21.15.71:0/4071301973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b6c06bcd0 0x7f0b6c0caa90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.033+0000 7f0b733ff700 1 -- 172.21.15.71:0/4071301973 >> 172.21.15.71:0/4071301973 conn(0x7f0b6c0ce600 msgr2=0x7f0b6c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:09.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.033+0000 7f0b733ff700 1 -- 172.21.15.71:0/4071301973 shutdown_connections 2023-10-09T07:58:09.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.033+0000 7f0b733ff700 1 -- 172.21.15.71:0/4071301973 wait complete. 2023-10-09T07:58:09.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.034+0000 7f0b733ff700 1 Processor -- start 2023-10-09T07:58:09.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.034+0000 7f0b733ff700 1 -- start start 2023-10-09T07:58:09.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.035+0000 7f0b733ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b6c06bcd0 0x7f0b6c143be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:09.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.035+0000 7f0b733ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b6c06c0a0 0x7f0b6c0c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:09.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.035+0000 7f0b733ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b6c15df50 0x7f0b6c0c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:09.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.035+0000 7f0b733ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0c8bb0 con 0x7f0b6c06bcd0 2023-10-09T07:58:09.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.035+0000 7f0b733ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0c85f0 con 0x7f0b6c06c0a0 2023-10-09T07:58:09.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.035+0000 7f0b733ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0c88d0 con 0x7f0b6c15df50 2023-10-09T07:58:09.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.036+0000 7f0b7119b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b6c06bcd0 0x7f0b6c143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:09.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.036+0000 7f0b7119b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b6c06bcd0 0x7f0b6c143be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37668/0 (socket says 172.21.15.71:37668) 2023-10-09T07:58:09.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.036+0000 7f0b7119b700 1 -- 172.21.15.71:0/1659365370 learned_addr learned my addr 172.21.15.71:0/1659365370 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:09.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.036+0000 7f0b7099a700 1 --2- 172.21.15.71:0/1659365370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b6c06c0a0 0x7f0b6c0c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:09.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.036+0000 7f0b7199c700 1 --2- 172.21.15.71:0/1659365370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b6c15df50 0x7f0b6c0c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:09.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.036+0000 7f0b7119b700 1 -- 172.21.15.71:0/1659365370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b6c15df50 msgr2=0x7f0b6c0c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:09.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.036+0000 7f0b7119b700 1 --2- 172.21.15.71:0/1659365370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b6c15df50 0x7f0b6c0c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.036+0000 7f0b7119b700 1 -- 172.21.15.71:0/1659365370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b6c06c0a0 msgr2=0x7f0b6c0c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:09.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.036+0000 7f0b7119b700 1 --2- 172.21.15.71:0/1659365370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b6c06c0a0 0x7f0b6c0c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.036+0000 7f0b7119b700 1 -- 172.21.15.71:0/1659365370 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b68009420 con 0x7f0b6c06bcd0 2023-10-09T07:58:09.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.036+0000 7f0b7099a700 1 --2- 172.21.15.71:0/1659365370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b6c06c0a0 0x7f0b6c0c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:58:09.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.036+0000 7f0b7119b700 1 --2- 172.21.15.71:0/1659365370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b6c06bcd0 0x7f0b6c143be0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009f00 tx=0x7f0b68017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:09.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.037+0000 7f0b617fa700 1 -- 172.21.15.71:0/1659365370 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6801f070 con 0x7f0b6c06bcd0 2023-10-09T07:58:09.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.037+0000 7f0b617fa700 1 -- 172.21.15.71:0/1659365370 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b68002f70 con 0x7f0b6c06bcd0 2023-10-09T07:58:09.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.037+0000 7f0b617fa700 1 -- 172.21.15.71:0/1659365370 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b68006af0 con 0x7f0b6c06bcd0 2023-10-09T07:58:09.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.037+0000 7f0b733ff700 1 -- 172.21.15.71:0/1659365370 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6c157f80 con 0x7f0b6c06bcd0 2023-10-09T07:58:09.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.037+0000 7f0b733ff700 1 -- 172.21.15.71:0/1659365370 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6c16b080 con 0x7f0b6c06bcd0 2023-10-09T07:58:09.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.038+0000 7f0b733ff700 1 -- 172.21.15.71:0/1659365370 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6c1584a0 con 0x7f0b6c06bcd0 2023-10-09T07:58:09.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.039+0000 7f0b617fa700 1 -- 172.21.15.71:0/1659365370 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 73) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f0b68023070 con 0x7f0b6c06bcd0 2023-10-09T07:58:09.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.040+0000 7f0b617fa700 1 --2- 172.21.15.71:0/1659365370 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0b500670e0 0x7f0b50069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:09.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.040+0000 7f0b617fa700 1 -- 172.21.15.71:0/1659365370 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f0b68085b80 con 0x7f0b6c06bcd0 2023-10-09T07:58:09.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.040+0000 7f0b7099a700 1 -- 172.21.15.71:0/1659365370 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0b500670e0 msgr2=0x7f0b50069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:09.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.040+0000 7f0b7099a700 1 --2- 172.21.15.71:0/1659365370 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0b500670e0 0x7f0b50069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:58:09.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.044+0000 7f0b617fa700 1 -- 172.21.15.71:0/1659365370 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0b6c1584a0 con 0x7f0b6c06bcd0 2023-10-09T07:58:09.107 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:09.107+0000 7f3023350180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T07:58:09.221 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:09.220+0000 7f305965e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T07:58:09.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.241+0000 7f0b7099a700 1 -- 172.21.15.71:0/1659365370 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0b500670e0 msgr2=0x7f0b50069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:09.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.241+0000 7f0b7099a700 1 --2- 172.21.15.71:0/1659365370 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0b500670e0 0x7f0b50069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:58:09.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.286+0000 7f0b733ff700 1 -- 172.21.15.71:0/1659365370 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b6c1584a0 con 0x7f0b6c06bcd0 2023-10-09T07:58:09.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.287+0000 7f0b617fa700 1 -- 172.21.15.71:0/1659365370 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f0b6c1584a0 con 0x7f0b6c06bcd0 2023-10-09T07:58:09.288 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:58:09.288 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1228129559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1228129559},{"type":"v1","addr":"172.21.15.179:6836","nonce":1228129559}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8254,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3640887500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3640887500},{"type":"v1","addr":"172.21.15.179:6834","nonce":3640887500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8586,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/4266132184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":4266132184},{"type":"v1","addr":"172.21.15.71:6834","nonce":4266132184}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:57:41.159434+0000","modified":"2023-10-09T07:57:44.718117+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8589":{"gid":8589,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/889811309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":889811309},{"type":"v1","addr":"172.21.15.71:6835","nonce":889811309}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T07:58:09.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.289+0000 7f0b733ff700 1 -- 172.21.15.71:0/1659365370 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0b500670e0 msgr2=0x7f0b50069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:58:09.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.289+0000 7f0b733ff700 1 --2- 172.21.15.71:0/1659365370 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0b500670e0 0x7f0b50069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.289+0000 7f0b733ff700 1 -- 172.21.15.71:0/1659365370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b6c06bcd0 msgr2=0x7f0b6c143be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:09.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.289+0000 7f0b733ff700 1 --2- 172.21.15.71:0/1659365370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b6c06bcd0 0x7f0b6c143be0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009f00 tx=0x7f0b68017000 comp rx=0 tx=0).stop 2023-10-09T07:58:09.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.289+0000 7f0b733ff700 1 -- 172.21.15.71:0/1659365370 shutdown_connections 2023-10-09T07:58:09.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.289+0000 7f0b733ff700 1 --2- 172.21.15.71:0/1659365370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b6c15df50 0x7f0b6c0c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.289+0000 7f0b733ff700 1 --2- 172.21.15.71:0/1659365370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b6c06bcd0 0x7f0b6c143be0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.289+0000 7f0b733ff700 1 --2- 172.21.15.71:0/1659365370 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f0b500670e0 0x7f0b50069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.289+0000 7f0b733ff700 1 --2- 172.21.15.71:0/1659365370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b6c06c0a0 0x7f0b6c0c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.289+0000 7f0b733ff700 1 -- 172.21.15.71:0/1659365370 >> 172.21.15.71:0/1659365370 conn(0x7f0b6c0ce600 msgr2=0x7f0b6c1574a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:09.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.289+0000 7f0b733ff700 1 -- 172.21.15.71:0/1659365370 shutdown_connections 2023-10-09T07:58:09.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.289+0000 7f0b733ff700 1 -- 172.21.15.71:0/1659365370 wait complete. 2023-10-09T07:58:09.292 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 74 2023-10-09T07:58:09.308 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:58:09.322 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:09.321+0000 7f305965e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T07:58:09.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.495+0000 7fd09339d700 1 Processor -- start 2023-10-09T07:58:09.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.495+0000 7fd09339d700 1 -- start start 2023-10-09T07:58:09.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.497+0000 7fd09339d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd08c0ad870 0x7fd08c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:09.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.497+0000 7fd09339d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd08c06bf20 0x7fd08c06a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:09.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.497+0000 7fd09339d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd08c0b40f0 con 0x7fd08c142ea0 2023-10-09T07:58:09.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.497+0000 7fd09339d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08c06c3a0 con 0x7fd08c0ad870 2023-10-09T07:58:09.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.497+0000 7fd09339d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08c069640 con 0x7fd08c06bf20 2023-10-09T07:58:09.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.497+0000 7fd09239b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd08c142ea0 0x7fd08c0b3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47350/0 (socket says 172.21.15.71:47350) 2023-10-09T07:58:09.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.497+0000 7fd09239b700 1 -- 172.21.15.71:0/895209089 learned_addr learned my addr 172.21.15.71:0/895209089 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:09.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.497+0000 7fd091b9a700 1 --2- 172.21.15.71:0/895209089 >> v2:172.21.15.71:3300/0 conn(0x7fd08c0ad870 0x7fd08c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:09.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.497+0000 7fd092b9c700 1 --2- 172.21.15.71:0/895209089 >> v2:172.21.15.179:3300/0 conn(0x7fd08c06bf20 0x7fd08c06a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:09.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.498+0000 7fd091399700 1 -- 172.21.15.71:0/895209089 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863575994 0 0) 0x7fd08c0b40f0 con 0x7fd08c142ea0 2023-10-09T07:58:09.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.498+0000 7fd091399700 1 -- 172.21.15.71:0/895209089 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd078003570 con 0x7fd08c142ea0 2023-10-09T07:58:09.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.498+0000 7fd091b9a700 1 -- 172.21.15.71:0/895209089 >> v2:172.21.15.179:3300/0 conn(0x7fd08c06bf20 msgr2=0x7fd08c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:09.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.498+0000 7fd091b9a700 1 --2- 172.21.15.71:0/895209089 >> v2:172.21.15.179:3300/0 conn(0x7fd08c06bf20 0x7fd08c06a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.498+0000 7fd091b9a700 1 -- 172.21.15.71:0/895209089 >> v1:172.21.15.71:6789/0 conn(0x7fd08c142ea0 legacy=0x7fd08c0b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:09.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.498+0000 7fd091b9a700 1 -- 172.21.15.71:0/895209089 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c069920 con 0x7fd08c0ad870 2023-10-09T07:58:09.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.498+0000 7fd092b9c700 1 --2- 172.21.15.71:0/895209089 >> v2:172.21.15.179:3300/0 conn(0x7fd08c06bf20 0x7fd08c06a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:58:09.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.498+0000 7fd091b9a700 1 --2- 172.21.15.71:0/895209089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd08c0ad870 0x7fd08c06b9e0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fd08c071330 tx=0x7fd07c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef5061e14f937fa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:09.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.498+0000 7fd091399700 1 -- 172.21.15.71:0/895209089 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c011630 con 0x7fd08c0ad870 2023-10-09T07:58:09.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.498+0000 7fd091399700 1 -- 172.21.15.71:0/895209089 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07c0117b0 con 0x7fd08c0ad870 2023-10-09T07:58:09.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.498+0000 7fd091399700 1 -- 172.21.15.71:0/895209089 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c011b70 con 0x7fd08c0ad870 2023-10-09T07:58:09.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.499+0000 7fd09339d700 1 -- 172.21.15.71:0/895209089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd08c0ad870 msgr2=0x7fd08c06b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:09.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.499+0000 7fd09339d700 1 --2- 172.21.15.71:0/895209089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd08c0ad870 0x7fd08c06b9e0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fd08c071330 tx=0x7fd07c0091a0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.499+0000 7fd09339d700 1 -- 172.21.15.71:0/895209089 shutdown_connections 2023-10-09T07:58:09.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.499+0000 7fd09339d700 1 --2- 172.21.15.71:0/895209089 >> v2:172.21.15.179:3300/0 conn(0x7fd08c06bf20 0x7fd08c06a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.499+0000 7fd09339d700 1 --2- 172.21.15.71:0/895209089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd08c0ad870 0x7fd08c06b9e0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.499+0000 7fd09339d700 1 -- 172.21.15.71:0/895209089 >> 172.21.15.71:0/895209089 conn(0x7fd08c0ce430 msgr2=0x7fd08c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:09.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.499+0000 7fd09339d700 1 -- 172.21.15.71:0/895209089 shutdown_connections 2023-10-09T07:58:09.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.499+0000 7fd09339d700 1 -- 172.21.15.71:0/895209089 wait complete. 2023-10-09T07:58:09.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.501+0000 7fd09339d700 1 Processor -- start 2023-10-09T07:58:09.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.501+0000 7fd09339d700 1 -- start start 2023-10-09T07:58:09.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.502+0000 7fd09339d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd08c06bf20 0x7fd08c15aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:09.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.502+0000 7fd09339d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd08c142ea0 0x7fd08c0af8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:09.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.502+0000 7fd09339d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd08c13f180 0x7fd08c169be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:09.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.502+0000 7fd09339d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c0b01c0 con 0x7fd08c06bf20 2023-10-09T07:58:09.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.502+0000 7fd09339d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c0b04a0 con 0x7fd08c142ea0 2023-10-09T07:58:09.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.502+0000 7fd09339d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c0b0780 con 0x7fd08c13f180 2023-10-09T07:58:09.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.502+0000 7fd09239b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd08c06bf20 0x7fd08c15aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:09.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.502+0000 7fd09239b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd08c06bf20 0x7fd08c15aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37678/0 (socket says 172.21.15.71:37678) 2023-10-09T07:58:09.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.502+0000 7fd09239b700 1 -- 172.21.15.71:0/3335640390 learned_addr learned my addr 172.21.15.71:0/3335640390 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:09.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.502+0000 7fd091b9a700 1 --2- 172.21.15.71:0/3335640390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd08c142ea0 0x7fd08c0af8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:09.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.502+0000 7fd092b9c700 1 --2- 172.21.15.71:0/3335640390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd08c13f180 0x7fd08c169be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:09.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.502+0000 7fd09239b700 1 -- 172.21.15.71:0/3335640390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd08c13f180 msgr2=0x7fd08c169be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:09.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.502+0000 7fd09239b700 1 --2- 172.21.15.71:0/3335640390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd08c13f180 0x7fd08c169be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.502+0000 7fd09239b700 1 -- 172.21.15.71:0/3335640390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd08c142ea0 msgr2=0x7fd08c0af8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:09.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.502+0000 7fd09239b700 1 --2- 172.21.15.71:0/3335640390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd08c142ea0 0x7fd08c0af8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.502+0000 7fd09239b700 1 -- 172.21.15.71:0/3335640390 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd084009420 con 0x7fd08c06bf20 2023-10-09T07:58:09.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.502+0000 7fd091b9a700 1 --2- 172.21.15.71:0/3335640390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd08c142ea0 0x7fd08c0af8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:58:09.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.503+0000 7fd09239b700 1 --2- 172.21.15.71:0/3335640390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd08c06bf20 0x7fd08c15aba0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fd08800cc40 tx=0x7fd088001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:09.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.503+0000 7fd0827fc700 1 -- 172.21.15.71:0/3335640390 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08800a910 con 0x7fd08c06bf20 2023-10-09T07:58:09.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.503+0000 7fd0827fc700 1 -- 172.21.15.71:0/3335640390 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08800aa90 con 0x7fd08c06bf20 2023-10-09T07:58:09.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.503+0000 7fd09339d700 1 -- 172.21.15.71:0/3335640390 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd07c009420 con 0x7fd08c06bf20 2023-10-09T07:58:09.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.503+0000 7fd0827fc700 1 -- 172.21.15.71:0/3335640390 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08800ae50 con 0x7fd08c06bf20 2023-10-09T07:58:09.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.503+0000 7fd09339d700 1 -- 172.21.15.71:0/3335640390 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd08c0c8750 con 0x7fd08c06bf20 2023-10-09T07:58:09.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.504+0000 7fd09339d700 1 -- 172.21.15.71:0/3335640390 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd08c04c3c0 con 0x7fd08c06bf20 2023-10-09T07:58:09.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.505+0000 7fd0827fc700 1 -- 172.21.15.71:0/3335640390 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 73) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fd088007300 con 0x7fd08c06bf20 2023-10-09T07:58:09.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.506+0000 7fd0827fc700 1 --2- 172.21.15.71:0/3335640390 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd0700670e0 0x7fd070069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:09.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.506+0000 7fd0827fc700 1 -- 172.21.15.71:0/3335640390 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fd088084f80 con 0x7fd08c06bf20 2023-10-09T07:58:09.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.506+0000 7fd091b9a700 1 -- 172.21.15.71:0/3335640390 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd0700670e0 msgr2=0x7fd070069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:09.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.506+0000 7fd091b9a700 1 --2- 172.21.15.71:0/3335640390 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd0700670e0 0x7fd070069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:58:09.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.510+0000 7fd0827fc700 1 -- 172.21.15.71:0/3335640390 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd088051cc0 con 0x7fd08c06bf20 2023-10-09T07:58:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.707+0000 7fd091b9a700 1 -- 172.21.15.71:0/3335640390 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd0700670e0 msgr2=0x7fd070069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.707+0000 7fd091b9a700 1 --2- 172.21.15.71:0/3335640390 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd0700670e0 0x7fd070069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:58:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.709+0000 7fd09339d700 1 -- 172.21.15.71:0/3335640390 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd08c069c00 con 0x7fd08c06bf20 2023-10-09T07:58:09.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.710+0000 7fd0827fc700 1 -- 172.21.15.71:0/3335640390 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+16447 (secure 0 0 0) 0x7fd0880552e0 con 0x7fd08c06bf20 2023-10-09T07:58:09.711 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:58:09.711 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":164,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:58:01.789247+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:57:39.262671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T07:57:40.149000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6837/85452":"2023-10-10T07:58:01.789216+0000","172.21.15.179:0/3833946352":"2023-10-10T07:58:01.789216+0000","172.21.15.179:6835/85452":"2023-10-10T07:58:01.789216+0000","172.21.15.179:0/4153201756":"2023-10-10T07:58:01.789216+0000","172.21.15.179:0/2153051455":"2023-10-10T07:58:01.789216+0000","172.21.15.179:0/4288328453":"2023-10-10T07:58:01.789216+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:58:09.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.712+0000 7fd09339d700 1 -- 172.21.15.71:0/3335640390 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd0700670e0 msgr2=0x7fd070069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:58:09.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.712+0000 7fd09339d700 1 --2- 172.21.15.71:0/3335640390 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd0700670e0 0x7fd070069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.712+0000 7fd09339d700 1 -- 172.21.15.71:0/3335640390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd08c06bf20 msgr2=0x7fd08c15aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.712+0000 7fd09339d700 1 --2- 172.21.15.71:0/3335640390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd08c06bf20 0x7fd08c15aba0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fd08800cc40 tx=0x7fd088001a70 comp rx=0 tx=0).stop 2023-10-09T07:58:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.712+0000 7fd09339d700 1 -- 172.21.15.71:0/3335640390 shutdown_connections 2023-10-09T07:58:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.712+0000 7fd09339d700 1 --2- 172.21.15.71:0/3335640390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd08c13f180 0x7fd08c169be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.712+0000 7fd09339d700 1 --2- 172.21.15.71:0/3335640390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd08c06bf20 0x7fd08c15aba0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.712+0000 7fd09339d700 1 --2- 172.21.15.71:0/3335640390 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd0700670e0 0x7fd070069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.712+0000 7fd09339d700 1 --2- 172.21.15.71:0/3335640390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd08c142ea0 0x7fd08c0af8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.712+0000 7fd09339d700 1 -- 172.21.15.71:0/3335640390 >> 172.21.15.71:0/3335640390 conn(0x7fd08c0ce430 msgr2=0x7fd08c141f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.712+0000 7fd09339d700 1 -- 172.21.15.71:0/3335640390 shutdown_connections 2023-10-09T07:58:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.712+0000 7fd09339d700 1 -- 172.21.15.71:0/3335640390 wait complete. 2023-10-09T07:58:09.731 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T07:58:09.810 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:09.810+0000 7f3023350180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T07:58:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.960+0000 7fc7be19d700 1 Processor -- start 2023-10-09T07:58:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.960+0000 7fc7be19d700 1 -- start start 2023-10-09T07:58:09.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.961+0000 7fc7be19d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc7b8159420 0x7fc7b80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.961+0000 7fc7be19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7b81597f0 0x7fc7b80b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.962+0000 7fc7be19d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b80b11d0 con 0x7fc7b815d230 2023-10-09T07:58:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.962+0000 7fc7be19d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b80b14b0 con 0x7fc7b8159420 2023-10-09T07:58:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.962+0000 7fc7be19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b80b1790 con 0x7fc7b81597f0 2023-10-09T07:58:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.962+0000 7fc7bd19b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc7b8159420 0x7fc7b80b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.962+0000 7fc7bd19b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc7b8159420 0x7fc7b80b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37688/0 (socket says 172.21.15.71:37688) 2023-10-09T07:58:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.962+0000 7fc7bd19b700 1 -- 172.21.15.71:0/2917785925 learned_addr learned my addr 172.21.15.71:0/2917785925 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.962+0000 7fc7bc99a700 1 --2- 172.21.15.71:0/2917785925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7b81597f0 0x7fc7b80b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.962+0000 7fc7bd19b700 1 -- 172.21.15.71:0/2917785925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7b81597f0 msgr2=0x7fc7b80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.962+0000 7fc7bd19b700 1 --2- 172.21.15.71:0/2917785925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7b81597f0 0x7fc7b80b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.962+0000 7fc7bd19b700 1 -- 172.21.15.71:0/2917785925 >> v1:172.21.15.179:6789/0 conn(0x7fc7b815d230 legacy=0x7fc7b80b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:09.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.962+0000 7fc7bd19b700 1 -- 172.21.15.71:0/2917785925 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b80b1a70 con 0x7fc7b8159420 2023-10-09T07:58:09.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.963+0000 7fc7bd19b700 1 --2- 172.21.15.71:0/2917785925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7b8159420 0x7fc7b80b5f40 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009f20 tx=0x7fc7b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7207cc37f3c36d66 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:09.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.963+0000 7fc7affff700 1 -- 172.21.15.71:0/2917785925 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b400e070 con 0x7fc7b8159420 2023-10-09T07:58:09.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.963+0000 7fc7affff700 1 -- 172.21.15.71:0/2917785925 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b400b9d0 con 0x7fc7b8159420 2023-10-09T07:58:09.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.963+0000 7fc7affff700 1 -- 172.21.15.71:0/2917785925 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b40092e0 con 0x7fc7b8159420 2023-10-09T07:58:09.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.963+0000 7fc7be19d700 1 -- 172.21.15.71:0/2917785925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7b8159420 msgr2=0x7fc7b80b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:09.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.963+0000 7fc7be19d700 1 --2- 172.21.15.71:0/2917785925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7b8159420 0x7fc7b80b5f40 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009f20 tx=0x7fc7b4009840 comp rx=0 tx=0).stop 2023-10-09T07:58:09.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.963+0000 7fc7be19d700 1 -- 172.21.15.71:0/2917785925 shutdown_connections 2023-10-09T07:58:09.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.963+0000 7fc7be19d700 1 --2- 172.21.15.71:0/2917785925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7b8159420 0x7fc7b80b5f40 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.963+0000 7fc7be19d700 1 --2- 172.21.15.71:0/2917785925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7b81597f0 0x7fc7b80b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.963+0000 7fc7be19d700 1 -- 172.21.15.71:0/2917785925 >> 172.21.15.71:0/2917785925 conn(0x7fc7b80d0660 msgr2=0x7fc7b80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:09.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.964+0000 7fc7be19d700 1 -- 172.21.15.71:0/2917785925 shutdown_connections 2023-10-09T07:58:09.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.964+0000 7fc7be19d700 1 -- 172.21.15.71:0/2917785925 wait complete. 2023-10-09T07:58:09.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.965+0000 7fc7be19d700 1 Processor -- start 2023-10-09T07:58:09.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.965+0000 7fc7be19d700 1 -- start start 2023-10-09T07:58:09.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.966+0000 7fc7be19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7b8159420 0x7fc7b8154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:09.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.966+0000 7fc7be19d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7b81597f0 0x7fc7b8169750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:09.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.966+0000 7fc7be19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7b815d230 0x7fc7b815b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:09.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.966+0000 7fc7be19d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b8154770 con 0x7fc7b81597f0 2023-10-09T07:58:09.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.966+0000 7fc7be19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b8068e40 con 0x7fc7b815d230 2023-10-09T07:58:09.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.966+0000 7fc7be19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b8068510 con 0x7fc7b8159420 2023-10-09T07:58:09.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.966+0000 7fc7bc99a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7b81597f0 0x7fc7b8169750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:09.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.966+0000 7fc7bc99a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7b81597f0 0x7fc7b8169750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37694/0 (socket says 172.21.15.71:37694) 2023-10-09T07:58:09.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.966+0000 7fc7bc99a700 1 -- 172.21.15.71:0/3482527470 learned_addr learned my addr 172.21.15.71:0/3482527470 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.966+0000 7fc7bd19b700 1 --2- 172.21.15.71:0/3482527470 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7b8159420 0x7fc7b8154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.966+0000 7fc7bd99c700 1 --2- 172.21.15.71:0/3482527470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7b815d230 0x7fc7b815b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.967+0000 7fc7bc99a700 1 -- 172.21.15.71:0/3482527470 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7b8159420 msgr2=0x7fc7b8154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.967+0000 7fc7bc99a700 1 --2- 172.21.15.71:0/3482527470 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7b8159420 0x7fc7b8154230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.967+0000 7fc7bc99a700 1 -- 172.21.15.71:0/3482527470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7b815d230 msgr2=0x7fc7b815b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.967+0000 7fc7bc99a700 1 --2- 172.21.15.71:0/3482527470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7b815d230 0x7fc7b815b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.967+0000 7fc7bc99a700 1 -- 172.21.15.71:0/3482527470 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b4009ae0 con 0x7fc7b81597f0 2023-10-09T07:58:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.967+0000 7fc7bc99a700 1 --2- 172.21.15.71:0/3482527470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7b81597f0 0x7fc7b8169750 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800ec80 tx=0x7fc7a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.967+0000 7fc7ad7fa700 1 -- 172.21.15.71:0/3482527470 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a800c850 con 0x7fc7b81597f0 2023-10-09T07:58:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.967+0000 7fc7ad7fa700 1 -- 172.21.15.71:0/3482527470 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a800c9d0 con 0x7fc7b81597f0 2023-10-09T07:58:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.967+0000 7fc7ad7fa700 1 -- 172.21.15.71:0/3482527470 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a800cd90 con 0x7fc7b81597f0 2023-10-09T07:58:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.967+0000 7fc7be19d700 1 -- 172.21.15.71:0/3482527470 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b80687f0 con 0x7fc7b81597f0 2023-10-09T07:58:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.968+0000 7fc7be19d700 1 -- 172.21.15.71:0/3482527470 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b815aa90 con 0x7fc7b81597f0 2023-10-09T07:58:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.969+0000 7fc7be19d700 1 -- 172.21.15.71:0/3482527470 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b8068ff0 con 0x7fc7b81597f0 2023-10-09T07:58:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.969+0000 7fc7ad7fa700 1 -- 172.21.15.71:0/3482527470 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 73) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fc7a8013680 con 0x7fc7b81597f0 2023-10-09T07:58:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.970+0000 7fc7ad7fa700 1 --2- 172.21.15.71:0/3482527470 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc79c0670e0 0x7fc79c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.970+0000 7fc7ad7fa700 1 -- 172.21.15.71:0/3482527470 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fc7a8084d50 con 0x7fc7b81597f0 2023-10-09T07:58:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.971+0000 7fc7bd19b700 1 -- 172.21.15.71:0/3482527470 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc79c0670e0 msgr2=0x7fc79c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.971+0000 7fc7bd19b700 1 --2- 172.21.15.71:0/3482527470 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc79c0670e0 0x7fc79c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:58:09.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:09.975+0000 7fc7ad7fa700 1 -- 172.21.15.71:0/3482527470 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7b8068ff0 con 0x7fc7b81597f0 2023-10-09T07:58:10.069 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:10.068+0000 7f305965e180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T07:58:10.099 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:10.099+0000 7f3023350180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T07:58:10.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.172+0000 7fc7bd19b700 1 -- 172.21.15.71:0/3482527470 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc79c0670e0 msgr2=0x7fc79c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:10.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.172+0000 7fc7bd19b700 1 --2- 172.21.15.71:0/3482527470 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc79c0670e0 0x7fc79c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:58:10.191 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:10.191+0000 7f3023350180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T07:58:10.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.218+0000 7fc7be19d700 1 -- 172.21.15.71:0/3482527470 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc7b8068fb0 con 0x7fc7b81597f0 2023-10-09T07:58:10.219 INFO:tasks.ceph.mon.a.smithi071.stderr:2023-10-09T07:58:10.218+0000 7fdb445f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T07:58:10.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.225+0000 7fc7ad7fa700 1 -- 172.21.15.71:0/3482527470 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v75) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc7a8088030 con 0x7fc7b81597f0 2023-10-09T07:58:10.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.228+0000 7fc7be19d700 1 -- 172.21.15.71:0/3482527470 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc79c0670e0 msgr2=0x7fc79c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:58:10.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.228+0000 7fc7be19d700 1 --2- 172.21.15.71:0/3482527470 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc79c0670e0 0x7fc79c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:10.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.228+0000 7fc7be19d700 1 -- 172.21.15.71:0/3482527470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7b81597f0 msgr2=0x7fc7b8169750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.228+0000 7fc7be19d700 1 --2- 172.21.15.71:0/3482527470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7b81597f0 0x7fc7b8169750 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800ec80 tx=0x7fc7a80091a0 comp rx=0 tx=0).stop 2023-10-09T07:58:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.228+0000 7fc7be19d700 1 -- 172.21.15.71:0/3482527470 shutdown_connections 2023-10-09T07:58:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.228+0000 7fc7be19d700 1 --2- 172.21.15.71:0/3482527470 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc79c0670e0 0x7fc79c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.228+0000 7fc7be19d700 1 --2- 172.21.15.71:0/3482527470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7b815d230 0x7fc7b815b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.228+0000 7fc7be19d700 1 --2- 172.21.15.71:0/3482527470 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7b8159420 0x7fc7b8154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.228+0000 7fc7be19d700 1 --2- 172.21.15.71:0/3482527470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7b81597f0 0x7fc7b8169750 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.228+0000 7fc7be19d700 1 -- 172.21.15.71:0/3482527470 >> 172.21.15.71:0/3482527470 conn(0x7fc7b80d0660 msgr2=0x7fc7b80b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.228+0000 7fc7be19d700 1 -- 172.21.15.71:0/3482527470 shutdown_connections 2023-10-09T07:58:10.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.228+0000 7fc7be19d700 1 -- 172.21.15.71:0/3482527470 wait complete. 2023-10-09T07:58:10.231 INFO:teuthology.orchestra.run.smithi071.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T07:58:10.232 INFO:tasks.ceph.mds.a.smithi071.stderr: -2302> 2023-10-09T07:57:46.673+0000 7f9e609f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T07:58:10.249 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T07:58:10.273 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2023-10-09T07:58:10.349 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:10.349+0000 7f3023350180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T07:58:10.368 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:10.367+0000 7f305965e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T07:58:10.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.439+0000 7fd196d9d700 1 Processor -- start 2023-10-09T07:58:10.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.439+0000 7fd196d9d700 1 -- start start 2023-10-09T07:58:10.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.440+0000 7fd196d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd1900b4e70 0x7fd1900ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:10.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.440+0000 7fd196d9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1900cfb00 con 0x7fd1900b1b40 2023-10-09T07:58:10.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.440+0000 7fd196d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd19015e060 con 0x7fd1900b16d0 2023-10-09T07:58:10.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.440+0000 7fd196d9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1900b5c40 con 0x7fd1900b4e70 2023-10-09T07:58:10.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.441+0000 7fd195d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd1900b4e70 0x7fd1900ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:10.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.441+0000 7fd19659c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd1900b1b40 0x7fd19015d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47376/0 (socket says 172.21.15.71:47376) 2023-10-09T07:58:10.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.441+0000 7fd19659c700 1 -- 172.21.15.71:0/1320820286 learned_addr learned my addr 172.21.15.71:0/1320820286 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:10.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.441+0000 7fd194d99700 1 -- 172.21.15.71:0/1320820286 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967060483 0 0) 0x7fd1900cfb00 con 0x7fd1900b1b40 2023-10-09T07:58:10.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.441+0000 7fd195d9b700 1 -- 172.21.15.71:0/1320820286 >> v1:172.21.15.179:6789/0 conn(0x7fd1900b16d0 legacy=0x7fd19015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.441+0000 7fd195d9b700 1 -- 172.21.15.71:0/1320820286 >> v1:172.21.15.71:6789/0 conn(0x7fd1900b1b40 legacy=0x7fd19015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.441+0000 7fd195d9b700 1 -- 172.21.15.71:0/1320820286 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1900b5f20 con 0x7fd1900b4e70 2023-10-09T07:58:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.442+0000 7fd195d9b700 1 --2- 172.21.15.71:0/1320820286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1900b4e70 0x7fd1900ccff0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0098e0 tx=0x7fd18c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=816e2bf7ca5aac59 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.442+0000 7fd194d99700 1 -- 172.21.15.71:0/1320820286 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c009e80 con 0x7fd1900b4e70 2023-10-09T07:58:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.442+0000 7fd194d99700 1 -- 172.21.15.71:0/1320820286 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c00b860 con 0x7fd1900b4e70 2023-10-09T07:58:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.442+0000 7fd194d99700 1 -- 172.21.15.71:0/1320820286 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c00bbe0 con 0x7fd1900b4e70 2023-10-09T07:58:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.442+0000 7fd196d9d700 1 -- 172.21.15.71:0/1320820286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1900b4e70 msgr2=0x7fd1900ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.442+0000 7fd196d9d700 1 --2- 172.21.15.71:0/1320820286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1900b4e70 0x7fd1900ccff0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0098e0 tx=0x7fd18c0091a0 comp rx=0 tx=0).stop 2023-10-09T07:58:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.443+0000 7fd196d9d700 1 -- 172.21.15.71:0/1320820286 shutdown_connections 2023-10-09T07:58:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.443+0000 7fd196d9d700 1 --2- 172.21.15.71:0/1320820286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1900b4e70 0x7fd1900ccff0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.443+0000 7fd196d9d700 1 -- 172.21.15.71:0/1320820286 >> 172.21.15.71:0/1320820286 conn(0x7fd1900d10c0 msgr2=0x7fd1900affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.443+0000 7fd196d9d700 1 -- 172.21.15.71:0/1320820286 shutdown_connections 2023-10-09T07:58:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.443+0000 7fd196d9d700 1 -- 172.21.15.71:0/1320820286 wait complete. 2023-10-09T07:58:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.444+0000 7fd196d9d700 1 Processor -- start 2023-10-09T07:58:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.444+0000 7fd196d9d700 1 -- start start 2023-10-09T07:58:10.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.445+0000 7fd196d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1900b16d0 0x7fd19016aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:10.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.445+0000 7fd196d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1900b1b40 0x7fd1900caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:10.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.445+0000 7fd196d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1900b4e70 0x7fd1900cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:10.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.445+0000 7fd196d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1900c6d40 con 0x7fd1900b1b40 2023-10-09T07:58:10.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.445+0000 7fd196d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1900c6130 con 0x7fd1900b4e70 2023-10-09T07:58:10.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.445+0000 7fd196d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1900c6410 con 0x7fd1900b16d0 2023-10-09T07:58:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.445+0000 7fd19559a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1900b1b40 0x7fd1900caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.445+0000 7fd19559a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1900b1b40 0x7fd1900caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37738/0 (socket says 172.21.15.71:37738) 2023-10-09T07:58:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.445+0000 7fd19559a700 1 -- 172.21.15.71:0/2691989494 learned_addr learned my addr 172.21.15.71:0/2691989494 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.446+0000 7fd195d9b700 1 --2- 172.21.15.71:0/2691989494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1900b16d0 0x7fd19016aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.446+0000 7fd19659c700 1 --2- 172.21.15.71:0/2691989494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1900b4e70 0x7fd1900cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.446+0000 7fd19559a700 1 -- 172.21.15.71:0/2691989494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1900b16d0 msgr2=0x7fd19016aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.446+0000 7fd19559a700 1 --2- 172.21.15.71:0/2691989494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1900b16d0 0x7fd19016aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.446+0000 7fd19559a700 1 -- 172.21.15.71:0/2691989494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1900b4e70 msgr2=0x7fd1900cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.446+0000 7fd19559a700 1 --2- 172.21.15.71:0/2691989494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1900b4e70 0x7fd1900cb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.446+0000 7fd19559a700 1 -- 172.21.15.71:0/2691989494 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c009420 con 0x7fd1900b1b40 2023-10-09T07:58:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.446+0000 7fd19559a700 1 --2- 172.21.15.71:0/2691989494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1900b1b40 0x7fd1900caaf0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fd18000c590 tx=0x7fd18000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:10.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.446+0000 7fd185ffb700 1 -- 172.21.15.71:0/2691989494 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd180011590 con 0x7fd1900b1b40 2023-10-09T07:58:10.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.446+0000 7fd185ffb700 1 -- 172.21.15.71:0/2691989494 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd180011710 con 0x7fd1900b1b40 2023-10-09T07:58:10.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.446+0000 7fd196d9d700 1 -- 172.21.15.71:0/2691989494 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1900c66f0 con 0x7fd1900b1b40 2023-10-09T07:58:10.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.446+0000 7fd185ffb700 1 -- 172.21.15.71:0/2691989494 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd180011ad0 con 0x7fd1900b1b40 2023-10-09T07:58:10.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.446+0000 7fd196d9d700 1 -- 172.21.15.71:0/2691989494 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1900c5400 con 0x7fd1900b1b40 2023-10-09T07:58:10.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.448+0000 7fd196d9d700 1 -- 172.21.15.71:0/2691989494 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd190088990 con 0x7fd1900b1b40 2023-10-09T07:58:10.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.449+0000 7fd185ffb700 1 -- 172.21.15.71:0/2691989494 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 73) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fd18001b3b0 con 0x7fd1900b1b40 2023-10-09T07:58:10.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.450+0000 7fd185ffb700 1 --2- 172.21.15.71:0/2691989494 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd1740670e0 0x7fd174069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:10.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.450+0000 7fd185ffb700 1 -- 172.21.15.71:0/2691989494 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6513+0+0 (secure 0 0 0) 0x7fd1800840b0 con 0x7fd1900b1b40 2023-10-09T07:58:10.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.450+0000 7fd195d9b700 1 -- 172.21.15.71:0/2691989494 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd1740670e0 msgr2=0x7fd174069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:10.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.450+0000 7fd195d9b700 1 --2- 172.21.15.71:0/2691989494 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd1740670e0 0x7fd174069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:58:10.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.454+0000 7fd185ffb700 1 -- 172.21.15.71:0/2691989494 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd180050cd0 con 0x7fd1900b1b40 2023-10-09T07:58:10.455 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:10.455+0000 7f3023350180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T07:58:10.468 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:10.467+0000 7f305965e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T07:58:10.626 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:10.625+0000 7f305965e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T07:58:10.648 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:10.648+0000 7f3023350180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T07:58:10.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.651+0000 7fd195d9b700 1 -- 172.21.15.71:0/2691989494 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd1740670e0 msgr2=0x7fd174069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:10.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.651+0000 7fd195d9b700 1 --2- 172.21.15.71:0/2691989494 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd1740670e0 0x7fd174069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:58:10.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.694+0000 7fd196d9d700 1 -- 172.21.15.71:0/2691989494 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd1900b5440 con 0x7fd1900b1b40 2023-10-09T07:58:10.734 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:10.733+0000 7f305965e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T07:58:10.741 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:10.741+0000 7f3023350180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T07:58:10.838 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:10.838+0000 7f3023350180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T07:58:10.932 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:10.931+0000 7f305965e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T07:58:10.936 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:10.936+0000 7f3023350180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T07:58:10.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.945+0000 7fd185ffb700 1 -- 172.21.15.71:0/2691989494 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 74) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fd1800510a0 con 0x7fd1900b1b40 2023-10-09T07:58:10.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.946+0000 7fd185ffb700 1 -- 172.21.15.71:0/2691989494 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd1740670e0 msgr2=0x7fd174069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:58:10.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:10.946+0000 7fd185ffb700 1 --2- 172.21.15.71:0/2691989494 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd1740670e0 0x7fd174069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:11.013 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:11.013+0000 7f2fa1709700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:11.013 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:11.013+0000 7f2fa1709700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:11.013 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:11.013+0000 7f2fa1709700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:11.014 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:11.013+0000 7f2fa1709700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:11.014 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:11.013+0000 7f2fa1709700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:11.016 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:11.016+0000 7f2f9e703700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:11.016 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:11.016+0000 7f2f9e703700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:11.016 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:11.016+0000 7f2f9e703700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:11.016 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:11.016+0000 7f2f9e703700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:11.016 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:11.016+0000 7f2f9e703700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:11.034 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:11.033+0000 7f305965e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T07:58:11.127 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:11.127+0000 7f305965e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T07:58:11.222 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:11.221+0000 7f305965e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T07:58:11.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.224+0000 7fd185ffb700 1 -- 172.21.15.71:0/2691989494 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v76) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd18006e020 con 0x7fd1900b1b40 2023-10-09T07:58:11.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.227+0000 7fd196d9d700 1 -- 172.21.15.71:0/2691989494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1900b1b40 msgr2=0x7fd1900caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:11.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.227+0000 7fd196d9d700 1 --2- 172.21.15.71:0/2691989494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1900b1b40 0x7fd1900caaf0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fd18000c590 tx=0x7fd18000c8a0 comp rx=0 tx=0).stop 2023-10-09T07:58:11.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.227+0000 7fd196d9d700 1 -- 172.21.15.71:0/2691989494 shutdown_connections 2023-10-09T07:58:11.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.227+0000 7fd196d9d700 1 --2- 172.21.15.71:0/2691989494 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd1740670e0 0x7fd174069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:11.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.227+0000 7fd196d9d700 1 --2- 172.21.15.71:0/2691989494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1900b4e70 0x7fd1900cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:11.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.227+0000 7fd196d9d700 1 --2- 172.21.15.71:0/2691989494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1900b16d0 0x7fd19016aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:11.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.227+0000 7fd196d9d700 1 --2- 172.21.15.71:0/2691989494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1900b1b40 0x7fd1900caaf0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:11.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.227+0000 7fd196d9d700 1 -- 172.21.15.71:0/2691989494 >> 172.21.15.71:0/2691989494 conn(0x7fd1900d10c0 msgr2=0x7fd190068e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:11.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.227+0000 7fd196d9d700 1 -- 172.21.15.71:0/2691989494 shutdown_connections 2023-10-09T07:58:11.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.227+0000 7fd196d9d700 1 -- 172.21.15.71:0/2691989494 wait complete. 2023-10-09T07:58:11.246 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T07:58:11.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.471+0000 7f7fd359d700 1 Processor -- start 2023-10-09T07:58:11.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.472+0000 7f7fd359d700 1 -- start start 2023-10-09T07:58:11.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.473+0000 7f7fd359d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7fcc156350 0x7f7fcc157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:11.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.473+0000 7f7fd359d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7fcc0b0760 0x7f7fcc0b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:11.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.473+0000 7f7fd359d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fcc0b0570 con 0x7f7fcc159f20 2023-10-09T07:58:11.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.473+0000 7f7fd359d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fcc0b1140 con 0x7f7fcc0b0760 2023-10-09T07:58:11.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.473+0000 7f7fd359d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fcc1578b0 con 0x7f7fcc156350 2023-10-09T07:58:11.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.473+0000 7f7fd1d9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7fcc0b0760 0x7f7fcc0b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:11.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.473+0000 7f7fd1d9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7fcc0b0760 0x7f7fcc0b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37754/0 (socket says 172.21.15.71:37754) 2023-10-09T07:58:11.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.473+0000 7f7fd1d9a700 1 -- 172.21.15.71:0/3181102033 learned_addr learned my addr 172.21.15.71:0/3181102033 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:11.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.473+0000 7f7fd259b700 1 --2- 172.21.15.71:0/3181102033 >> v2:172.21.15.179:3300/0 conn(0x7f7fcc156350 0x7f7fcc157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:11.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.474+0000 7f7fd1d9a700 1 -- 172.21.15.71:0/3181102033 >> v2:172.21.15.179:3300/0 conn(0x7f7fcc156350 msgr2=0x7f7fcc157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:11.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.474+0000 7f7fd1d9a700 1 --2- 172.21.15.71:0/3181102033 >> v2:172.21.15.179:3300/0 conn(0x7f7fcc156350 0x7f7fcc157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:11.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.474+0000 7f7fd1d9a700 1 -- 172.21.15.71:0/3181102033 >> v1:172.21.15.71:6789/0 conn(0x7f7fcc159f20 legacy=0x7f7fcc15a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:11.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.474+0000 7f7fd1d9a700 1 -- 172.21.15.71:0/3181102033 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc0af4d0 con 0x7f7fcc0b0760 2023-10-09T07:58:11.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.474+0000 7f7fd259b700 1 --2- 172.21.15.71:0/3181102033 >> v2:172.21.15.179:3300/0 conn(0x7f7fcc156350 0x7f7fcc157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:11.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.474+0000 7f7fd1d9a700 1 --2- 172.21.15.71:0/3181102033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fcc0b0760 0x7f7fcc0b0c00 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc065950 tx=0x7f7fbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5526bc976ff021c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:11.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.474+0000 7f7fd1599700 1 -- 172.21.15.71:0/3181102033 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc00b860 con 0x7f7fcc0b0760 2023-10-09T07:58:11.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.474+0000 7f7fd1599700 1 -- 172.21.15.71:0/3181102033 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc00b9c0 con 0x7f7fcc0b0760 2023-10-09T07:58:11.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.474+0000 7f7fd1599700 1 -- 172.21.15.71:0/3181102033 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc00bd60 con 0x7f7fcc0b0760 2023-10-09T07:58:11.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.475+0000 7f7fd359d700 1 -- 172.21.15.71:0/3181102033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fcc0b0760 msgr2=0x7f7fcc0b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:11.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.475+0000 7f7fd359d700 1 --2- 172.21.15.71:0/3181102033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fcc0b0760 0x7f7fcc0b0c00 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc065950 tx=0x7f7fbc009250 comp rx=0 tx=0).stop 2023-10-09T07:58:11.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.475+0000 7f7fd359d700 1 -- 172.21.15.71:0/3181102033 shutdown_connections 2023-10-09T07:58:11.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.475+0000 7f7fd359d700 1 --2- 172.21.15.71:0/3181102033 >> v2:172.21.15.179:3300/0 conn(0x7f7fcc156350 0x7f7fcc157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:11.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.475+0000 7f7fd359d700 1 --2- 172.21.15.71:0/3181102033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fcc0b0760 0x7f7fcc0b0c00 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:11.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.475+0000 7f7fd359d700 1 -- 172.21.15.71:0/3181102033 >> 172.21.15.71:0/3181102033 conn(0x7f7fcc068e20 msgr2=0x7f7fcc0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:11.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.475+0000 7f7fd359d700 1 -- 172.21.15.71:0/3181102033 shutdown_connections 2023-10-09T07:58:11.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.475+0000 7f7fd359d700 1 -- 172.21.15.71:0/3181102033 wait complete. 2023-10-09T07:58:11.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.476+0000 7f7fd359d700 1 Processor -- start 2023-10-09T07:58:11.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.476+0000 7f7fd359d700 1 -- start start 2023-10-09T07:58:11.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.477+0000 7f7fd359d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fcc0b0760 0x7f7fcc151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:11.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.477+0000 7f7fd359d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fcc156350 0x7f7fcc0aaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:11.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.477+0000 7f7fd359d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fcc159f20 0x7f7fcc0aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:11.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.477+0000 7f7fd359d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc1691d0 con 0x7f7fcc0b0760 2023-10-09T07:58:11.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.477+0000 7f7fd359d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc1515b0 con 0x7f7fcc159f20 2023-10-09T07:58:11.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.477+0000 7f7fd359d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc1685c0 con 0x7f7fcc156350 2023-10-09T07:58:11.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.478+0000 7f7fd259b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fcc0b0760 0x7f7fcc151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:11.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.478+0000 7f7fd259b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fcc0b0760 0x7f7fcc151070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37758/0 (socket says 172.21.15.71:37758) 2023-10-09T07:58:11.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.478+0000 7f7fd259b700 1 -- 172.21.15.71:0/1197907049 learned_addr learned my addr 172.21.15.71:0/1197907049 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:11.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.478+0000 7f7fd1d9a700 1 --2- 172.21.15.71:0/1197907049 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fcc156350 0x7f7fcc0aaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:11.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.478+0000 7f7fd2d9c700 1 --2- 172.21.15.71:0/1197907049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fcc159f20 0x7f7fcc0aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:11.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.478+0000 7f7fd259b700 1 -- 172.21.15.71:0/1197907049 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fcc156350 msgr2=0x7f7fcc0aaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:11.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.478+0000 7f7fd259b700 1 --2- 172.21.15.71:0/1197907049 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fcc156350 0x7f7fcc0aaa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:11.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.478+0000 7f7fd259b700 1 -- 172.21.15.71:0/1197907049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fcc159f20 msgr2=0x7f7fcc0aaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:11.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.478+0000 7f7fd259b700 1 --2- 172.21.15.71:0/1197907049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fcc159f20 0x7f7fcc0aaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:11.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.478+0000 7f7fd259b700 1 -- 172.21.15.71:0/1197907049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc0094f0 con 0x7f7fcc0b0760 2023-10-09T07:58:11.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.478+0000 7f7fd1d9a700 1 --2- 172.21.15.71:0/1197907049 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fcc156350 0x7f7fcc0aaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:11.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.478+0000 7f7fd2d9c700 1 --2- 172.21.15.71:0/1197907049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fcc159f20 0x7f7fcc0aaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:11.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.478+0000 7f7fd259b700 1 --2- 172.21.15.71:0/1197907049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fcc0b0760 0x7f7fcc151070 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800c850 tx=0x7f7fc8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:11.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.479+0000 7f7fc27fc700 1 -- 172.21.15.71:0/1197907049 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8011600 con 0x7f7fcc0b0760 2023-10-09T07:58:11.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.479+0000 7f7fd359d700 1 -- 172.21.15.71:0/1197907049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fcc1688a0 con 0x7f7fcc0b0760 2023-10-09T07:58:11.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.479+0000 7f7fc27fc700 1 -- 172.21.15.71:0/1197907049 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc8011760 con 0x7f7fcc0b0760 2023-10-09T07:58:11.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.479+0000 7f7fc27fc700 1 -- 172.21.15.71:0/1197907049 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8011b00 con 0x7f7fcc0b0760 2023-10-09T07:58:11.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.479+0000 7f7fd359d700 1 -- 172.21.15.71:0/1197907049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fcc168e60 con 0x7f7fcc0b0760 2023-10-09T07:58:11.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.480+0000 7f7fd359d700 1 -- 172.21.15.71:0/1197907049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fcc0a6110 con 0x7f7fcc0b0760 2023-10-09T07:58:11.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.481+0000 7f7fc27fc700 1 -- 172.21.15.71:0/1197907049 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 74) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f7fc80073b0 con 0x7f7fcc0b0760 2023-10-09T07:58:11.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.481+0000 7f7fc27fc700 1 -- 172.21.15.71:0/1197907049 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6814+0+0 (secure 0 0 0) 0x7f7fc8084520 con 0x7f7fcc0b0760 2023-10-09T07:58:11.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.486+0000 7f7fc27fc700 1 -- 172.21.15.71:0/1197907049 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7fc8051530 con 0x7f7fcc0b0760 2023-10-09T07:58:11.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.677+0000 7f7fd359d700 1 -- 172.21.15.71:0/1197907049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7fcc04c3c0 con 0x7f7fcc0b0760 2023-10-09T07:58:11.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.950+0000 7f7fc27fc700 1 -- 172.21.15.71:0/1197907049 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 75) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f7fc80511b0 con 0x7f7fcc0b0760 2023-10-09T07:58:11.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.950+0000 7f7fc27fc700 1 --2- 172.21.15.71:0/1197907049 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7fb006ca50 0x7f7fb006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:11.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.955+0000 7f7fd1d9a700 1 --2- 172.21.15.71:0/1197907049 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7fb006ca50 0x7f7fb006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:11.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:11.957+0000 7f7fd1d9a700 1 --2- 172.21.15.71:0/1197907049 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7fb006ca50 0x7f7fb006ee30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc065950 tx=0x7f7fbc017000 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:12.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.227+0000 7f7fc27fc700 1 -- 172.21.15.71:0/1197907049 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v167) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7fc807f2e0 con 0x7f7fcc0b0760 2023-10-09T07:58:12.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.231+0000 7f7fd359d700 1 -- 172.21.15.71:0/1197907049 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7fb006ca50 msgr2=0x7f7fb006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:12.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.231+0000 7f7fd359d700 1 --2- 172.21.15.71:0/1197907049 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7fb006ca50 0x7f7fb006ee30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc065950 tx=0x7f7fbc017000 comp rx=0 tx=0).stop 2023-10-09T07:58:12.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.231+0000 7f7fd359d700 1 -- 172.21.15.71:0/1197907049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fcc0b0760 msgr2=0x7f7fcc151070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:12.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.231+0000 7f7fd359d700 1 --2- 172.21.15.71:0/1197907049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fcc0b0760 0x7f7fcc151070 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800c850 tx=0x7f7fc8008040 comp rx=0 tx=0).stop 2023-10-09T07:58:12.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.232+0000 7f7fd359d700 1 -- 172.21.15.71:0/1197907049 shutdown_connections 2023-10-09T07:58:12.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.232+0000 7f7fd359d700 1 --2- 172.21.15.71:0/1197907049 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7fb006ca50 0x7f7fb006ee30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:12.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.232+0000 7f7fd359d700 1 --2- 172.21.15.71:0/1197907049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fcc159f20 0x7f7fcc0aaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:12.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.232+0000 7f7fd359d700 1 --2- 172.21.15.71:0/1197907049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fcc0b0760 0x7f7fcc151070 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:12.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.232+0000 7f7fd359d700 1 --2- 172.21.15.71:0/1197907049 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fcc156350 0x7f7fcc0aaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:12.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.232+0000 7f7fd359d700 1 -- 172.21.15.71:0/1197907049 >> 172.21.15.71:0/1197907049 conn(0x7f7fcc068e20 msgr2=0x7f7fcc151e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:12.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.232+0000 7f7fd359d700 1 -- 172.21.15.71:0/1197907049 shutdown_connections 2023-10-09T07:58:12.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.232+0000 7f7fd359d700 1 -- 172.21.15.71:0/1197907049 wait complete. 2023-10-09T07:58:12.234 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' removed 2023-10-09T07:58:12.251 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T07:58:12.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.435+0000 7f53b919d700 1 Processor -- start 2023-10-09T07:58:12.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.435+0000 7f53b919d700 1 -- start start 2023-10-09T07:58:12.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.437+0000 7f53b919d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f53b415b050 0x7f53b40ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:12.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.437+0000 7f53b919d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53b40cc8d0 0x7f53b415b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:12.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.437+0000 7f53b919d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f53b415b960 0x7f53b4157f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:12.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.437+0000 7f53b919d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b4157a50 con 0x7f53b415b960 2023-10-09T07:58:12.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.437+0000 7f53b919d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b41591b0 con 0x7f53b415b050 2023-10-09T07:58:12.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.437+0000 7f53b919d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b40ca9e0 con 0x7f53b40cc8d0 2023-10-09T07:58:12.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.437+0000 7f53b899c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f53b415b960 0x7f53b4157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:12.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.437+0000 7f53b899c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f53b415b960 0x7f53b4157f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37764/0 (socket says 172.21.15.71:37764) 2023-10-09T07:58:12.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.437+0000 7f53b899c700 1 -- 172.21.15.71:0/1859744682 learned_addr learned my addr 172.21.15.71:0/1859744682 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:12.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.438+0000 7f53b3fff700 1 --2- 172.21.15.71:0/1859744682 >> v2:172.21.15.179:3300/0 conn(0x7f53b415b050 0x7f53b40ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:12.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.438+0000 7f53b899c700 1 -- 172.21.15.71:0/1859744682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53b40cc8d0 msgr2=0x7f53b415b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:12.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.438+0000 7f53b899c700 1 --2- 172.21.15.71:0/1859744682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53b40cc8d0 0x7f53b415b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:12.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.438+0000 7f53b899c700 1 -- 172.21.15.71:0/1859744682 >> v2:172.21.15.179:3300/0 conn(0x7f53b415b050 msgr2=0x7f53b40ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:12.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.438+0000 7f53b899c700 1 --2- 172.21.15.71:0/1859744682 >> v2:172.21.15.179:3300/0 conn(0x7f53b415b050 0x7f53b40ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:12.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.438+0000 7f53b899c700 1 -- 172.21.15.71:0/1859744682 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b40cacc0 con 0x7f53b415b960 2023-10-09T07:58:12.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.439+0000 7f53b899c700 1 --2- 172.21.15.71:0/1859744682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53b415b960 0x7f53b4157f00 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f53b4064f60 tx=0x7f53ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2540bbc564ccbf74 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:12.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.442+0000 7f53b2ffd700 1 -- 172.21.15.71:0/1859744682 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac00e070 con 0x7f53b415b960 2023-10-09T07:58:12.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.443+0000 7f53b2ffd700 1 -- 172.21.15.71:0/1859744682 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ac00ba50 con 0x7f53b415b960 2023-10-09T07:58:12.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.443+0000 7f53b2ffd700 1 -- 172.21.15.71:0/1859744682 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac0092e0 con 0x7f53b415b960 2023-10-09T07:58:12.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.444+0000 7f53b919d700 1 -- 172.21.15.71:0/1859744682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53b415b960 msgr2=0x7f53b4157f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:12.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.444+0000 7f53b919d700 1 --2- 172.21.15.71:0/1859744682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53b415b960 0x7f53b4157f00 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f53b4064f60 tx=0x7f53ac009840 comp rx=0 tx=0).stop 2023-10-09T07:58:12.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.444+0000 7f53b919d700 1 -- 172.21.15.71:0/1859744682 shutdown_connections 2023-10-09T07:58:12.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.444+0000 7f53b919d700 1 --2- 172.21.15.71:0/1859744682 >> v2:172.21.15.179:3300/0 conn(0x7f53b415b050 0x7f53b40ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:12.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.444+0000 7f53b919d700 1 --2- 172.21.15.71:0/1859744682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53b415b960 0x7f53b4157f00 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:12.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.444+0000 7f53b919d700 1 --2- 172.21.15.71:0/1859744682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53b40cc8d0 0x7f53b415b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:12.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.444+0000 7f53b919d700 1 -- 172.21.15.71:0/1859744682 >> 172.21.15.71:0/1859744682 conn(0x7f53b4068e20 msgr2=0x7f53b40cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:12.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.444+0000 7f53b919d700 1 -- 172.21.15.71:0/1859744682 shutdown_connections 2023-10-09T07:58:12.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.444+0000 7f53b919d700 1 -- 172.21.15.71:0/1859744682 wait complete. 2023-10-09T07:58:12.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.447+0000 7f53b919d700 1 Processor -- start 2023-10-09T07:58:12.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.447+0000 7f53b919d700 1 -- start start 2023-10-09T07:58:12.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.448+0000 7f53b919d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53b40cc8d0 0x7f53b4153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:12.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.448+0000 7f53b919d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53b415b050 0x7f53b40c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:12.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.448+0000 7f53b919d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53b415b960 0x7f53b40c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:12.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.448+0000 7f53b919d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b40c27c0 con 0x7f53b415b050 2023-10-09T07:58:12.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.448+0000 7f53b919d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b40c1bb0 con 0x7f53b415b960 2023-10-09T07:58:12.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.448+0000 7f53b919d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b40c1e90 con 0x7f53b40cc8d0 2023-10-09T07:58:12.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.449+0000 7f53b37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53b415b050 0x7f53b40c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:12.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.449+0000 7f53b37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53b415b050 0x7f53b40c2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37768/0 (socket says 172.21.15.71:37768) 2023-10-09T07:58:12.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.449+0000 7f53b37fe700 1 -- 172.21.15.71:0/235101537 learned_addr learned my addr 172.21.15.71:0/235101537 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:12.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.449+0000 7f53b899c700 1 --2- 172.21.15.71:0/235101537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53b415b960 0x7f53b40c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:12.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.449+0000 7f53b3fff700 1 --2- 172.21.15.71:0/235101537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53b40cc8d0 0x7f53b4153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:12.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.449+0000 7f53b37fe700 1 -- 172.21.15.71:0/235101537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53b40cc8d0 msgr2=0x7f53b4153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:12.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.449+0000 7f53b37fe700 1 --2- 172.21.15.71:0/235101537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53b40cc8d0 0x7f53b4153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:12.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.449+0000 7f53b37fe700 1 -- 172.21.15.71:0/235101537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53b415b960 msgr2=0x7f53b40c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:12.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.449+0000 7f53b37fe700 1 --2- 172.21.15.71:0/235101537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53b415b960 0x7f53b40c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:12.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.449+0000 7f53b37fe700 1 -- 172.21.15.71:0/235101537 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac009ae0 con 0x7f53b415b050 2023-10-09T07:58:12.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.449+0000 7f53b37fe700 1 --2- 172.21.15.71:0/235101537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53b415b050 0x7f53b40c2fb0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f53a800b810 tx=0x7f53a80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:12.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.450+0000 7f539bfff700 1 -- 172.21.15.71:0/235101537 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a800f510 con 0x7f53b415b050 2023-10-09T07:58:12.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.450+0000 7f539bfff700 1 -- 172.21.15.71:0/235101537 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a800f690 con 0x7f53b415b050 2023-10-09T07:58:12.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.450+0000 7f53b919d700 1 -- 172.21.15.71:0/235101537 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b40c2170 con 0x7f53b415b050 2023-10-09T07:58:12.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.450+0000 7f539bfff700 1 -- 172.21.15.71:0/235101537 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a800fa50 con 0x7f53b415b050 2023-10-09T07:58:12.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.450+0000 7f53b919d700 1 -- 172.21.15.71:0/235101537 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b4154060 con 0x7f53b415b050 2023-10-09T07:58:12.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.451+0000 7f53b919d700 1 -- 172.21.15.71:0/235101537 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b40c2930 con 0x7f53b415b050 2023-10-09T07:58:12.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.452+0000 7f539bfff700 1 -- 172.21.15.71:0/235101537 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 75) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f53a801a400 con 0x7f53b415b050 2023-10-09T07:58:12.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.453+0000 7f539bfff700 1 --2- 172.21.15.71:0/235101537 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f53a0066e50 0x7f53a0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:12.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.453+0000 7f539bfff700 1 -- 172.21.15.71:0/235101537 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6376+0+0 (secure 0 0 0) 0x7f53a8083fe0 con 0x7f53b415b050 2023-10-09T07:58:12.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.453+0000 7f53b3fff700 1 --2- 172.21.15.71:0/235101537 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f53a0066e50 0x7f53a0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:12.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.454+0000 7f53b3fff700 1 --2- 172.21.15.71:0/235101537 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f53a0066e50 0x7f53a0069300 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f53a4006fd0 tx=0x7f53a4008040 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:12.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.457+0000 7f539bfff700 1 -- 172.21.15.71:0/235101537 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53a8051290 con 0x7f53b415b050 2023-10-09T07:58:12.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:12.648+0000 7f53b919d700 1 -- 172.21.15.71:0/235101537 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f53b40c2b50 con 0x7f53b415b050 2023-10-09T07:58:13.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.231+0000 7f539bfff700 1 -- 172.21.15.71:0/235101537 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f53a800fdc0 con 0x7f53b415b050 2023-10-09T07:58:13.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.238+0000 7f539bfff700 1 -- 172.21.15.71:0/235101537 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v168) v1 ==== 169+0+0 (secure 0 0 0) 0x7f53a8082220 con 0x7f53b415b050 2023-10-09T07:58:13.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.242+0000 7f53b919d700 1 -- 172.21.15.71:0/235101537 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f53a0066e50 msgr2=0x7f53a0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:13.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.242+0000 7f53b919d700 1 --2- 172.21.15.71:0/235101537 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f53a0066e50 0x7f53a0069300 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f53a4006fd0 tx=0x7f53a4008040 comp rx=0 tx=0).stop 2023-10-09T07:58:13.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.242+0000 7f53b919d700 1 -- 172.21.15.71:0/235101537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53b415b050 msgr2=0x7f53b40c2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:13.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.242+0000 7f53b919d700 1 --2- 172.21.15.71:0/235101537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53b415b050 0x7f53b40c2fb0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f53a800b810 tx=0x7f53a80091d0 comp rx=0 tx=0).stop 2023-10-09T07:58:13.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.243+0000 7f53b919d700 1 -- 172.21.15.71:0/235101537 shutdown_connections 2023-10-09T07:58:13.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.243+0000 7f53b919d700 1 --2- 172.21.15.71:0/235101537 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f53a0066e50 0x7f53a0069300 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:13.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.243+0000 7f53b919d700 1 --2- 172.21.15.71:0/235101537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53b415b960 0x7f53b40c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:13.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.243+0000 7f53b919d700 1 --2- 172.21.15.71:0/235101537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53b40cc8d0 0x7f53b4153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:13.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.243+0000 7f53b919d700 1 --2- 172.21.15.71:0/235101537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53b415b050 0x7f53b40c2fb0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:13.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.243+0000 7f53b919d700 1 -- 172.21.15.71:0/235101537 >> 172.21.15.71:0/235101537 conn(0x7f53b4068e20 msgr2=0x7f53b406e120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:13.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.243+0000 7f53b919d700 1 -- 172.21.15.71:0/235101537 shutdown_connections 2023-10-09T07:58:13.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.243+0000 7f53b919d700 1 -- 172.21.15.71:0/235101537 wait complete. 2023-10-09T07:58:13.245 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' removed 2023-10-09T07:58:13.264 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T07:58:13.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.445+0000 7fd0009fe700 1 Processor -- start 2023-10-09T07:58:13.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.445+0000 7fd0009fe700 1 -- start start 2023-10-09T07:58:13.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.446+0000 7fd0009fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcffc1407e0 0x7fcffc06a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:13.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.446+0000 7fd0009fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcffc140bb0 0x7fcffc06a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:13.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.446+0000 7fd0009fe700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcffc0c6820 con 0x7fcffc06d4f0 2023-10-09T07:58:13.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.446+0000 7fd0009fe700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcffc0c6de0 con 0x7fcffc1407e0 2023-10-09T07:58:13.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.446+0000 7fd0009fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc141270 con 0x7fcffc140bb0 2023-10-09T07:58:13.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.447+0000 7fcffa59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcffc140bb0 0x7fcffc06a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:13.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.447+0000 7fcffad9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcffc1407e0 0x7fcffc06a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:13.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.447+0000 7fcffad9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcffc1407e0 0x7fcffc06a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:46938/0 (socket says 172.21.15.71:46938) 2023-10-09T07:58:13.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.447+0000 7fcffa59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcffc140bb0 0x7fcffc06a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:49868/0 (socket says 172.21.15.71:49868) 2023-10-09T07:58:13.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.447+0000 7fcffad9d700 1 -- 172.21.15.71:0/3202838737 learned_addr learned my addr 172.21.15.71:0/3202838737 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:13.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.448+0000 7fcffad9d700 1 -- 172.21.15.71:0/3202838737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcffc140bb0 msgr2=0x7fcffc06a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:13.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.448+0000 7fcffad9d700 1 --2- 172.21.15.71:0/3202838737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcffc140bb0 0x7fcffc06a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:13.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.448+0000 7fcffad9d700 1 -- 172.21.15.71:0/3202838737 >> v1:172.21.15.179:6789/0 conn(0x7fcffc06d4f0 legacy=0x7fcffc15b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:13.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.448+0000 7fcffad9d700 1 -- 172.21.15.71:0/3202838737 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc06acf0 con 0x7fcffc1407e0 2023-10-09T07:58:13.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.448+0000 7fcff9d9b700 1 -- 172.21.15.71:0/3202838737 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137926051 0 0) 0x7fcffc0c6820 con 0x7fcffc06d4f0 2023-10-09T07:58:13.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.448+0000 7fcffad9d700 1 --2- 172.21.15.71:0/3202838737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcffc1407e0 0x7fcffc06a180 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0099b0 tx=0x7fcfec009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=875d7fbef968009b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:13.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.448+0000 7fcff9d9b700 1 -- 172.21.15.71:0/3202838737 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec009ea0 con 0x7fcffc1407e0 2023-10-09T07:58:13.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.448+0000 7fcff9d9b700 1 -- 172.21.15.71:0/3202838737 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfec00b860 con 0x7fcffc1407e0 2023-10-09T07:58:13.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.448+0000 7fcff9d9b700 1 -- 172.21.15.71:0/3202838737 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec00bc00 con 0x7fcffc1407e0 2023-10-09T07:58:13.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.449+0000 7fd0009fe700 1 -- 172.21.15.71:0/3202838737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcffc1407e0 msgr2=0x7fcffc06a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:13.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.449+0000 7fd0009fe700 1 --2- 172.21.15.71:0/3202838737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcffc1407e0 0x7fcffc06a180 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0099b0 tx=0x7fcfec009250 comp rx=0 tx=0).stop 2023-10-09T07:58:13.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.449+0000 7fd0009fe700 1 -- 172.21.15.71:0/3202838737 shutdown_connections 2023-10-09T07:58:13.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.449+0000 7fd0009fe700 1 --2- 172.21.15.71:0/3202838737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcffc1407e0 0x7fcffc06a180 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:13.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.449+0000 7fd0009fe700 1 --2- 172.21.15.71:0/3202838737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcffc140bb0 0x7fcffc06a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:13.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.449+0000 7fd0009fe700 1 -- 172.21.15.71:0/3202838737 >> 172.21.15.71:0/3202838737 conn(0x7fcffc0cc1e0 msgr2=0x7fcffc0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:13.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.449+0000 7fd0009fe700 1 -- 172.21.15.71:0/3202838737 shutdown_connections 2023-10-09T07:58:13.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.449+0000 7fd0009fe700 1 -- 172.21.15.71:0/3202838737 wait complete. 2023-10-09T07:58:13.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.450+0000 7fd0009fe700 1 Processor -- start 2023-10-09T07:58:13.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.450+0000 7fd0009fe700 1 -- start start 2023-10-09T07:58:13.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.451+0000 7fd0009fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcffc06d4f0 0x7fcffc0b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:13.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.451+0000 7fd0009fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcffc1407e0 0x7fcffc157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:13.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.451+0000 7fd0009fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcffc140bb0 0x7fcffc13f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:13.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.451+0000 7fd0009fe700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc0afda0 con 0x7fcffc1407e0 2023-10-09T07:58:13.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.451+0000 7fd0009fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc0b0080 con 0x7fcffc06d4f0 2023-10-09T07:58:13.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.451+0000 7fd0009fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc158750 con 0x7fcffc140bb0 2023-10-09T07:58:13.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.451+0000 7fcffa59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcffc1407e0 0x7fcffc157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:13.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.451+0000 7fcffa59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcffc1407e0 0x7fcffc157010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37774/0 (socket says 172.21.15.71:37774) 2023-10-09T07:58:13.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.451+0000 7fcffa59c700 1 -- 172.21.15.71:0/3264993422 learned_addr learned my addr 172.21.15.71:0/3264993422 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:13.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.452+0000 7fcffad9d700 1 --2- 172.21.15.71:0/3264993422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcffc06d4f0 0x7fcffc0b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:13.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.452+0000 7fcffb59e700 1 --2- 172.21.15.71:0/3264993422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcffc140bb0 0x7fcffc13f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:13.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.452+0000 7fcffa59c700 1 -- 172.21.15.71:0/3264993422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcffc140bb0 msgr2=0x7fcffc13f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:13.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.452+0000 7fcffa59c700 1 --2- 172.21.15.71:0/3264993422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcffc140bb0 0x7fcffc13f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:13.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.452+0000 7fcffa59c700 1 -- 172.21.15.71:0/3264993422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcffc06d4f0 msgr2=0x7fcffc0b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:13.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.452+0000 7fcffa59c700 1 --2- 172.21.15.71:0/3264993422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcffc06d4f0 0x7fcffc0b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:13.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.452+0000 7fcffa59c700 1 -- 172.21.15.71:0/3264993422 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec0094f0 con 0x7fcffc1407e0 2023-10-09T07:58:13.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.452+0000 7fcffa59c700 1 --2- 172.21.15.71:0/3264993422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcffc1407e0 0x7fcffc157010 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fcff0012d30 tx=0x7fcff000f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:13.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.452+0000 7fcfe2ffd700 1 -- 172.21.15.71:0/3264993422 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff000d0d0 con 0x7fcffc1407e0 2023-10-09T07:58:13.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.452+0000 7fcfe2ffd700 1 -- 172.21.15.71:0/3264993422 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff0013040 con 0x7fcffc1407e0 2023-10-09T07:58:13.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.452+0000 7fd0009fe700 1 -- 172.21.15.71:0/3264993422 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcffc158a30 con 0x7fcffc1407e0 2023-10-09T07:58:13.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.452+0000 7fcfe2ffd700 1 -- 172.21.15.71:0/3264993422 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff0010940 con 0x7fcffc1407e0 2023-10-09T07:58:13.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.453+0000 7fd0009fe700 1 -- 172.21.15.71:0/3264993422 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcffc157550 con 0x7fcffc1407e0 2023-10-09T07:58:13.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.454+0000 7fd0009fe700 1 -- 172.21.15.71:0/3264993422 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcffc0afee0 con 0x7fcffc1407e0 2023-10-09T07:58:13.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.454+0000 7fcfe2ffd700 1 -- 172.21.15.71:0/3264993422 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcff0010d10 con 0x7fcffc1407e0 2023-10-09T07:58:13.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.455+0000 7fcfe2ffd700 1 --2- 172.21.15.71:0/3264993422 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcfe8066f30 0x7fcfe80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:13.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.455+0000 7fcfe2ffd700 1 -- 172.21.15.71:0/3264993422 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fcff00884d0 con 0x7fcffc1407e0 2023-10-09T07:58:13.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.456+0000 7fcffad9d700 1 --2- 172.21.15.71:0/3264993422 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcfe8066f30 0x7fcfe80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:13.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.457+0000 7fcffad9d700 1 --2- 172.21.15.71:0/3264993422 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcfe8066f30 0x7fcfe80693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0099b0 tx=0x7fcfec017000 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:13.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.460+0000 7fcfe2ffd700 1 -- 172.21.15.71:0/3264993422 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcffc0afee0 con 0x7fcffc1407e0 2023-10-09T07:58:13.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.652+0000 7fd0009fe700 1 -- 172.21.15.71:0/3264993422 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fcffc0afee0 con 0x7fcffc1407e0 2023-10-09T07:58:13.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.657+0000 7fcfe2ffd700 1 -- 172.21.15.71:0/3264993422 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v55) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcffc0afee0 con 0x7fcffc1407e0 2023-10-09T07:58:13.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.659+0000 7fd0009fe700 1 -- 172.21.15.71:0/3264993422 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcfe8066f30 msgr2=0x7fcfe80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:13.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.659+0000 7fd0009fe700 1 --2- 172.21.15.71:0/3264993422 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcfe8066f30 0x7fcfe80693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0099b0 tx=0x7fcfec017000 comp rx=0 tx=0).stop 2023-10-09T07:58:13.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.659+0000 7fd0009fe700 1 -- 172.21.15.71:0/3264993422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcffc1407e0 msgr2=0x7fcffc157010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:13.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.659+0000 7fd0009fe700 1 --2- 172.21.15.71:0/3264993422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcffc1407e0 0x7fcffc157010 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fcff0012d30 tx=0x7fcff000f040 comp rx=0 tx=0).stop 2023-10-09T07:58:13.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.659+0000 7fd0009fe700 1 -- 172.21.15.71:0/3264993422 shutdown_connections 2023-10-09T07:58:13.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.659+0000 7fd0009fe700 1 --2- 172.21.15.71:0/3264993422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcffc140bb0 0x7fcffc13f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:13.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.659+0000 7fd0009fe700 1 --2- 172.21.15.71:0/3264993422 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fcfe8066f30 0x7fcfe80693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:13.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.659+0000 7fd0009fe700 1 --2- 172.21.15.71:0/3264993422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcffc06d4f0 0x7fcffc0b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:13.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.659+0000 7fd0009fe700 1 --2- 172.21.15.71:0/3264993422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcffc1407e0 0x7fcffc157010 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:13.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.659+0000 7fd0009fe700 1 -- 172.21.15.71:0/3264993422 >> 172.21.15.71:0/3264993422 conn(0x7fcffc0cc1e0 msgr2=0x7fcffc13c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:13.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.659+0000 7fd0009fe700 1 -- 172.21.15.71:0/3264993422 shutdown_connections 2023-10-09T07:58:13.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.659+0000 7fd0009fe700 1 -- 172.21.15.71:0/3264993422 wait complete. 2023-10-09T07:58:13.677 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-09T07:58:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.861+0000 7f62cefff700 1 Processor -- start 2023-10-09T07:58:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.862+0000 7f62cefff700 1 -- start start 2023-10-09T07:58:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.863+0000 7f62cefff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f62c8155eb0 0x7f62c806e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.863+0000 7f62cefff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62c80c70b0 0x7f62c8069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.863+0000 7f62cefff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f62c8069cb0 0x7f62c8159a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.863+0000 7f62cefff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c806a130 con 0x7f62c8069cb0 2023-10-09T07:58:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.863+0000 7f62cefff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c806eb90 con 0x7f62c8155eb0 2023-10-09T07:58:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.863+0000 7f62cefff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c806ee70 con 0x7f62c80c70b0 2023-10-09T07:58:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.863+0000 7f62cd59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f62c8069cb0 0x7f62c8159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.863+0000 7f62cd59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f62c8069cb0 0x7f62c8159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37784/0 (socket says 172.21.15.71:37784) 2023-10-09T07:58:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.863+0000 7f62cd59c700 1 -- 172.21.15.71:0/3729949772 learned_addr learned my addr 172.21.15.71:0/3729949772 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.863+0000 7f62c7fff700 1 --2- 172.21.15.71:0/3729949772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62c80c70b0 0x7f62c8069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.863+0000 7f62ccd9b700 1 --2- 172.21.15.71:0/3729949772 >> v2:172.21.15.179:3300/0 conn(0x7f62c8155eb0 0x7f62c806e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:13.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.864+0000 7f62cd59c700 1 -- 172.21.15.71:0/3729949772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62c80c70b0 msgr2=0x7f62c8069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:13.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.864+0000 7f62cd59c700 1 --2- 172.21.15.71:0/3729949772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62c80c70b0 0x7f62c8069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:13.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.864+0000 7f62cd59c700 1 -- 172.21.15.71:0/3729949772 >> v2:172.21.15.179:3300/0 conn(0x7f62c8155eb0 msgr2=0x7f62c806e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.864+0000 7f62cd59c700 1 --2- 172.21.15.71:0/3729949772 >> v2:172.21.15.179:3300/0 conn(0x7f62c8155eb0 0x7f62c806e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.864+0000 7f62cd59c700 1 -- 172.21.15.71:0/3729949772 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c806f150 con 0x7f62c8069cb0 2023-10-09T07:58:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.864+0000 7f62cd59c700 1 --2- 172.21.15.71:0/3729949772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62c8069cb0 0x7f62c8159a60 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f62c8065160 tx=0x7f62c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5358c7a905d68df1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.864+0000 7f62c77fe700 1 -- 172.21.15.71:0/3729949772 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c000e070 con 0x7f62c8069cb0 2023-10-09T07:58:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.864+0000 7f62c77fe700 1 -- 172.21.15.71:0/3729949772 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c000b930 con 0x7f62c8069cb0 2023-10-09T07:58:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.864+0000 7f62c77fe700 1 -- 172.21.15.71:0/3729949772 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c00092e0 con 0x7f62c8069cb0 2023-10-09T07:58:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.865+0000 7f62cefff700 1 -- 172.21.15.71:0/3729949772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62c8069cb0 msgr2=0x7f62c8159a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.865+0000 7f62cefff700 1 --2- 172.21.15.71:0/3729949772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62c8069cb0 0x7f62c8159a60 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f62c8065160 tx=0x7f62c0009840 comp rx=0 tx=0).stop 2023-10-09T07:58:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.865+0000 7f62cefff700 1 -- 172.21.15.71:0/3729949772 shutdown_connections 2023-10-09T07:58:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.865+0000 7f62cefff700 1 --2- 172.21.15.71:0/3729949772 >> v2:172.21.15.179:3300/0 conn(0x7f62c8155eb0 0x7f62c806e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.865+0000 7f62cefff700 1 --2- 172.21.15.71:0/3729949772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62c8069cb0 0x7f62c8159a60 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:13.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.865+0000 7f62cefff700 1 --2- 172.21.15.71:0/3729949772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62c80c70b0 0x7f62c8069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:13.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.865+0000 7f62cefff700 1 -- 172.21.15.71:0/3729949772 >> 172.21.15.71:0/3729949772 conn(0x7f62c8068e10 msgr2=0x7f62c80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:13.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.865+0000 7f62cefff700 1 -- 172.21.15.71:0/3729949772 shutdown_connections 2023-10-09T07:58:13.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.865+0000 7f62cefff700 1 -- 172.21.15.71:0/3729949772 wait complete. 2023-10-09T07:58:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.866+0000 7f62cefff700 1 Processor -- start 2023-10-09T07:58:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.866+0000 7f62cefff700 1 -- start start 2023-10-09T07:58:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.867+0000 7f62cefff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62c8069cb0 0x7f62c814b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.867+0000 7f62cefff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62c80c70b0 0x7f62c80b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.867+0000 7f62cefff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62c8155eb0 0x7f62c80b1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.867+0000 7f62cefff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c80c3950 con 0x7f62c80c70b0 2023-10-09T07:58:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.867+0000 7f62cefff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c80accf0 con 0x7f62c8069cb0 2023-10-09T07:58:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.867+0000 7f62cefff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c80c3de0 con 0x7f62c8155eb0 2023-10-09T07:58:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.868+0000 7f62c7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62c80c70b0 0x7f62c80b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.868+0000 7f62c7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62c80c70b0 0x7f62c80b1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37788/0 (socket says 172.21.15.71:37788) 2023-10-09T07:58:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.868+0000 7f62c7fff700 1 -- 172.21.15.71:0/426293007 learned_addr learned my addr 172.21.15.71:0/426293007 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.868+0000 7f62cd59c700 1 --2- 172.21.15.71:0/426293007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62c8155eb0 0x7f62c80b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.868+0000 7f62ccd9b700 1 --2- 172.21.15.71:0/426293007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62c8069cb0 0x7f62c814b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.868+0000 7f62c7fff700 1 -- 172.21.15.71:0/426293007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62c8155eb0 msgr2=0x7f62c80b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.868+0000 7f62c7fff700 1 --2- 172.21.15.71:0/426293007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62c8155eb0 0x7f62c80b1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.868+0000 7f62c7fff700 1 -- 172.21.15.71:0/426293007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62c8069cb0 msgr2=0x7f62c814b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.868+0000 7f62c7fff700 1 --2- 172.21.15.71:0/426293007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62c8069cb0 0x7f62c814b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.868+0000 7f62c7fff700 1 -- 172.21.15.71:0/426293007 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c0009ae0 con 0x7f62c80c70b0 2023-10-09T07:58:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.868+0000 7f62ccd9b700 1 --2- 172.21.15.71:0/426293007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62c8069cb0 0x7f62c814b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.868+0000 7f62c7fff700 1 --2- 172.21.15.71:0/426293007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62c80c70b0 0x7f62c80b1420 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f62b400ecb0 tx=0x7f62b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.868+0000 7f62c4ff9700 1 -- 172.21.15.71:0/426293007 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b400c9d0 con 0x7f62c80c70b0 2023-10-09T07:58:13.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.868+0000 7f62c4ff9700 1 -- 172.21.15.71:0/426293007 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b400cb50 con 0x7f62c80c70b0 2023-10-09T07:58:13.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.868+0000 7f62cefff700 1 -- 172.21.15.71:0/426293007 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c80cb510 con 0x7f62c80c70b0 2023-10-09T07:58:13.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.868+0000 7f62c4ff9700 1 -- 172.21.15.71:0/426293007 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4013470 con 0x7f62c80c70b0 2023-10-09T07:58:13.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.869+0000 7f62cefff700 1 -- 172.21.15.71:0/426293007 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c80c35e0 con 0x7f62c80c70b0 2023-10-09T07:58:13.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.870+0000 7f62cefff700 1 -- 172.21.15.71:0/426293007 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c80c3b00 con 0x7f62c80c70b0 2023-10-09T07:58:13.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.871+0000 7f62c4ff9700 1 -- 172.21.15.71:0/426293007 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f62b4013860 con 0x7f62c80c70b0 2023-10-09T07:58:13.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.871+0000 7f62c4ff9700 1 --2- 172.21.15.71:0/426293007 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f62ac066f30 0x7f62ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:13.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.871+0000 7f62c4ff9700 1 -- 172.21.15.71:0/426293007 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f62b40849c0 con 0x7f62c80c70b0 2023-10-09T07:58:13.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.872+0000 7f62ccd9b700 1 --2- 172.21.15.71:0/426293007 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f62ac066f30 0x7f62ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:13.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.873+0000 7f62ccd9b700 1 --2- 172.21.15.71:0/426293007 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f62ac066f30 0x7f62ac0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f62bc006f00 tx=0x7f62bc008040 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:13.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:13.875+0000 7f62c4ff9700 1 -- 172.21.15.71:0/426293007 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62c80c3b00 con 0x7f62c80c70b0 2023-10-09T07:58:14.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.066+0000 7f62cefff700 1 -- 172.21.15.71:0/426293007 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f62c80c3b00 con 0x7f62c80c70b0 2023-10-09T07:58:14.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.072+0000 7f62c4ff9700 1 -- 172.21.15.71:0/426293007 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v56) v1 ==== 115+0+0 (secure 0 0 0) 0x7f62c80c3b00 con 0x7f62c80c70b0 2023-10-09T07:58:14.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.074+0000 7f62cefff700 1 -- 172.21.15.71:0/426293007 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f62ac066f30 msgr2=0x7f62ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:14.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.074+0000 7f62cefff700 1 --2- 172.21.15.71:0/426293007 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f62ac066f30 0x7f62ac0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f62bc006f00 tx=0x7f62bc008040 comp rx=0 tx=0).stop 2023-10-09T07:58:14.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.074+0000 7f62cefff700 1 -- 172.21.15.71:0/426293007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62c80c70b0 msgr2=0x7f62c80b1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:14.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.074+0000 7f62cefff700 1 --2- 172.21.15.71:0/426293007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62c80c70b0 0x7f62c80b1420 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f62b400ecb0 tx=0x7f62b40091a0 comp rx=0 tx=0).stop 2023-10-09T07:58:14.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.074+0000 7f62cefff700 1 -- 172.21.15.71:0/426293007 shutdown_connections 2023-10-09T07:58:14.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.074+0000 7f62cefff700 1 --2- 172.21.15.71:0/426293007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62c8155eb0 0x7f62c80b1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:14.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.074+0000 7f62cefff700 1 --2- 172.21.15.71:0/426293007 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f62ac066f30 0x7f62ac0693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:14.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.074+0000 7f62cefff700 1 --2- 172.21.15.71:0/426293007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62c8069cb0 0x7f62c814b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:14.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.074+0000 7f62cefff700 1 --2- 172.21.15.71:0/426293007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62c80c70b0 0x7f62c80b1420 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:14.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.075+0000 7f62cefff700 1 -- 172.21.15.71:0/426293007 >> 172.21.15.71:0/426293007 conn(0x7f62c8068e10 msgr2=0x7f62c814fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:14.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.075+0000 7f62cefff700 1 -- 172.21.15.71:0/426293007 shutdown_connections 2023-10-09T07:58:14.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.075+0000 7f62cefff700 1 -- 172.21.15.71:0/426293007 wait complete. 2023-10-09T07:58:14.092 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-09T07:58:14.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.280+0000 7fef2ad9d700 1 Processor -- start 2023-10-09T07:58:14.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.280+0000 7fef2ad9d700 1 -- start start 2023-10-09T07:58:14.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.281+0000 7fef2ad9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fef240b4e70 0x7fef240ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:14.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.281+0000 7fef2ad9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef240cfb00 con 0x7fef240b1b40 2023-10-09T07:58:14.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.281+0000 7fef2ad9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef2415e060 con 0x7fef240b16d0 2023-10-09T07:58:14.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.281+0000 7fef2ad9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef240b5c40 con 0x7fef240b4e70 2023-10-09T07:58:14.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.281+0000 7fef29d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fef240b4e70 0x7fef240ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:14.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.282+0000 7fef29d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fef240b4e70 0x7fef240ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37792/0 (socket says 172.21.15.71:37792) 2023-10-09T07:58:14.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.282+0000 7fef29d9b700 1 -- 172.21.15.71:0/1532777494 learned_addr learned my addr 172.21.15.71:0/1532777494 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:14.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.282+0000 7fef29d9b700 1 -- 172.21.15.71:0/1532777494 >> v1:172.21.15.179:6789/0 conn(0x7fef240b16d0 legacy=0x7fef2415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:14.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.282+0000 7fef29d9b700 1 -- 172.21.15.71:0/1532777494 >> v1:172.21.15.71:6789/0 conn(0x7fef240b1b40 legacy=0x7fef2415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:14.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.282+0000 7fef29d9b700 1 -- 172.21.15.71:0/1532777494 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef240b5f20 con 0x7fef240b4e70 2023-10-09T07:58:14.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.282+0000 7fef29d9b700 1 --2- 172.21.15.71:0/1532777494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef240b4e70 0x7fef240ccff0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fef200099b0 tx=0x7fef20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74998b7646c1b39a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:14.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.282+0000 7fef28d99700 1 -- 172.21.15.71:0/1532777494 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2000b860 con 0x7fef240b4e70 2023-10-09T07:58:14.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.282+0000 7fef28d99700 1 -- 172.21.15.71:0/1532777494 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2000b9c0 con 0x7fef240b4e70 2023-10-09T07:58:14.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.282+0000 7fef28d99700 1 -- 172.21.15.71:0/1532777494 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2000bd60 con 0x7fef240b4e70 2023-10-09T07:58:14.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.283+0000 7fef2ad9d700 1 -- 172.21.15.71:0/1532777494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef240b4e70 msgr2=0x7fef240ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:14.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.283+0000 7fef2ad9d700 1 --2- 172.21.15.71:0/1532777494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef240b4e70 0x7fef240ccff0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fef200099b0 tx=0x7fef20009250 comp rx=0 tx=0).stop 2023-10-09T07:58:14.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.283+0000 7fef2ad9d700 1 -- 172.21.15.71:0/1532777494 shutdown_connections 2023-10-09T07:58:14.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.283+0000 7fef2ad9d700 1 --2- 172.21.15.71:0/1532777494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef240b4e70 0x7fef240ccff0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:14.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.283+0000 7fef2ad9d700 1 -- 172.21.15.71:0/1532777494 >> 172.21.15.71:0/1532777494 conn(0x7fef240d10c0 msgr2=0x7fef240affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:14.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.283+0000 7fef2ad9d700 1 -- 172.21.15.71:0/1532777494 shutdown_connections 2023-10-09T07:58:14.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.283+0000 7fef2ad9d700 1 -- 172.21.15.71:0/1532777494 wait complete. 2023-10-09T07:58:14.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.284+0000 7fef2ad9d700 1 Processor -- start 2023-10-09T07:58:14.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.285+0000 7fef2ad9d700 1 -- start start 2023-10-09T07:58:14.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.285+0000 7fef2ad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef240b16d0 0x7fef24156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:14.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.285+0000 7fef2ad9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef240b1b40 0x7fef24169d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:14.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.285+0000 7fef2ad9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef240b4e70 0x7fef240c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:14.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.285+0000 7fef2ad9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef240cc130 con 0x7fef240b16d0 2023-10-09T07:58:14.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.285+0000 7fef2ad9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef240c5fa0 con 0x7fef240b4e70 2023-10-09T07:58:14.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.285+0000 7fef2ad9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef240c5390 con 0x7fef240b1b40 2023-10-09T07:58:14.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.286+0000 7fef29d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef240b16d0 0x7fef24156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:14.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.286+0000 7fef29d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef240b16d0 0x7fef24156d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37806/0 (socket says 172.21.15.71:37806) 2023-10-09T07:58:14.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.286+0000 7fef29d9b700 1 -- 172.21.15.71:0/1350103859 learned_addr learned my addr 172.21.15.71:0/1350103859 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:14.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.286+0000 7fef2959a700 1 --2- 172.21.15.71:0/1350103859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef240b1b40 0x7fef24169d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:14.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.286+0000 7fef2a59c700 1 --2- 172.21.15.71:0/1350103859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef240b4e70 0x7fef240c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:14.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.286+0000 7fef29d9b700 1 -- 172.21.15.71:0/1350103859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef240b1b40 msgr2=0x7fef24169d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:14.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.286+0000 7fef29d9b700 1 --2- 172.21.15.71:0/1350103859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef240b1b40 0x7fef24169d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:14.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.286+0000 7fef29d9b700 1 -- 172.21.15.71:0/1350103859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef240b4e70 msgr2=0x7fef240c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:14.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.286+0000 7fef29d9b700 1 --2- 172.21.15.71:0/1350103859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef240b4e70 0x7fef240c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:14.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.286+0000 7fef29d9b700 1 -- 172.21.15.71:0/1350103859 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef200094f0 con 0x7fef240b16d0 2023-10-09T07:58:14.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.286+0000 7fef2a59c700 1 --2- 172.21.15.71:0/1350103859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef240b4e70 0x7fef240c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:14.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.286+0000 7fef29d9b700 1 --2- 172.21.15.71:0/1350103859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef240b16d0 0x7fef24156d20 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fef24070dd0 tx=0x7fef20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:14.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.286+0000 7fef19ffb700 1 -- 172.21.15.71:0/1350103859 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef20011ea0 con 0x7fef240b16d0 2023-10-09T07:58:14.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.287+0000 7fef19ffb700 1 -- 172.21.15.71:0/1350103859 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2001a630 con 0x7fef240b16d0 2023-10-09T07:58:14.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.287+0000 7fef2ad9d700 1 -- 172.21.15.71:0/1350103859 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef240c5670 con 0x7fef240b16d0 2023-10-09T07:58:14.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.287+0000 7fef19ffb700 1 -- 172.21.15.71:0/1350103859 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2001a9d0 con 0x7fef240b16d0 2023-10-09T07:58:14.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.287+0000 7fef2ad9d700 1 -- 172.21.15.71:0/1350103859 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef240c5c30 con 0x7fef240b16d0 2023-10-09T07:58:14.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.288+0000 7fef2ad9d700 1 -- 172.21.15.71:0/1350103859 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef24088990 con 0x7fef240b16d0 2023-10-09T07:58:14.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.289+0000 7fef19ffb700 1 -- 172.21.15.71:0/1350103859 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef2002d440 con 0x7fef240b16d0 2023-10-09T07:58:14.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.290+0000 7fef19ffb700 1 --2- 172.21.15.71:0/1350103859 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fef08066f30 0x7fef080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:14.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.290+0000 7fef19ffb700 1 -- 172.21.15.71:0/1350103859 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fef20086140 con 0x7fef240b16d0 2023-10-09T07:58:14.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.290+0000 7fef2959a700 1 --2- 172.21.15.71:0/1350103859 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fef08066f30 0x7fef080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:14.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.291+0000 7fef2959a700 1 --2- 172.21.15.71:0/1350103859 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fef08066f30 0x7fef080693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fef240cc4d0 tx=0x7fef14009040 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:14.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.294+0000 7fef19ffb700 1 -- 172.21.15.71:0/1350103859 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef200532b0 con 0x7fef240b16d0 2023-10-09T07:58:14.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.486+0000 7fef2ad9d700 1 -- 172.21.15.71:0/1350103859 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fef2404bb80 con 0x7fef240b16d0 2023-10-09T07:58:14.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.490+0000 7fef19ffb700 1 -- 172.21.15.71:0/1350103859 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v57) v1 ==== 120+0+0 (secure 0 0 0) 0x7fef200568d0 con 0x7fef240b16d0 2023-10-09T07:58:14.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.493+0000 7fef2ad9d700 1 -- 172.21.15.71:0/1350103859 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fef08066f30 msgr2=0x7fef080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:14.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.493+0000 7fef2ad9d700 1 --2- 172.21.15.71:0/1350103859 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fef08066f30 0x7fef080693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fef240cc4d0 tx=0x7fef14009040 comp rx=0 tx=0).stop 2023-10-09T07:58:14.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.493+0000 7fef2ad9d700 1 -- 172.21.15.71:0/1350103859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef240b16d0 msgr2=0x7fef24156d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.493+0000 7fef2ad9d700 1 --2- 172.21.15.71:0/1350103859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef240b16d0 0x7fef24156d20 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fef24070dd0 tx=0x7fef20017000 comp rx=0 tx=0).stop 2023-10-09T07:58:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.493+0000 7fef2ad9d700 1 -- 172.21.15.71:0/1350103859 shutdown_connections 2023-10-09T07:58:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.493+0000 7fef2ad9d700 1 --2- 172.21.15.71:0/1350103859 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fef08066f30 0x7fef080693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.493+0000 7fef2ad9d700 1 --2- 172.21.15.71:0/1350103859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef240b4e70 0x7fef240c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.493+0000 7fef2ad9d700 1 --2- 172.21.15.71:0/1350103859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef240b16d0 0x7fef24156d20 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.493+0000 7fef2ad9d700 1 --2- 172.21.15.71:0/1350103859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef240b1b40 0x7fef24169d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.493+0000 7fef2ad9d700 1 -- 172.21.15.71:0/1350103859 >> 172.21.15.71:0/1350103859 conn(0x7fef240d10c0 msgr2=0x7fef24157b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.493+0000 7fef2ad9d700 1 -- 172.21.15.71:0/1350103859 shutdown_connections 2023-10-09T07:58:14.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.493+0000 7fef2ad9d700 1 -- 172.21.15.71:0/1350103859 wait complete. 2023-10-09T07:58:14.511 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-10-09T07:58:14.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.695+0000 7fb3f6bff700 1 Processor -- start 2023-10-09T07:58:14.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.695+0000 7fb3f6bff700 1 -- start start 2023-10-09T07:58:14.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.697+0000 7fb3f6bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb3f01579f0 0x7fb3f0162530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:14.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.697+0000 7fb3f6bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f00cb300 con 0x7fb3f00b1c20 2023-10-09T07:58:14.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.697+0000 7fb3f6bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f00cb5e0 con 0x7fb3f00b1850 2023-10-09T07:58:14.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.697+0000 7fb3f6bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f006fc30 con 0x7fb3f01579f0 2023-10-09T07:58:14.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.697+0000 7fb3effff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb3f00b1c20 0x7fb3f01572e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47408/0 (socket says 172.21.15.71:47408) 2023-10-09T07:58:14.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.697+0000 7fb3effff700 1 -- 172.21.15.71:0/4006685132 learned_addr learned my addr 172.21.15.71:0/4006685132 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:14.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.697+0000 7fb3f519c700 1 --2- 172.21.15.71:0/4006685132 >> v2:172.21.15.179:3300/0 conn(0x7fb3f01579f0 0x7fb3f0162530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:14.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.697+0000 7fb3ef7fe700 1 -- 172.21.15.71:0/4006685132 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677156514 0 0) 0x7fb3f00cb300 con 0x7fb3f00b1c20 2023-10-09T07:58:14.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.697+0000 7fb3ef7fe700 1 -- 172.21.15.71:0/4006685132 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3e0003570 con 0x7fb3f00b1c20 2023-10-09T07:58:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.698+0000 7fb3ef7fe700 1 -- 172.21.15.71:0/4006685132 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2829920960 0 0) 0x7fb3f00cb5e0 con 0x7fb3f00b1850 2023-10-09T07:58:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.698+0000 7fb3ef7fe700 1 -- 172.21.15.71:0/4006685132 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3f00cb300 con 0x7fb3f00b1850 2023-10-09T07:58:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.698+0000 7fb3f519c700 1 -- 172.21.15.71:0/4006685132 >> v1:172.21.15.179:6789/0 conn(0x7fb3f00b1850 legacy=0x7fb3f00ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.698+0000 7fb3ef7fe700 1 -- 172.21.15.71:0/4006685132 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4159591150 0 0) 0x7fb3e0003570 con 0x7fb3f00b1c20 2023-10-09T07:58:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.698+0000 7fb3f519c700 1 -- 172.21.15.71:0/4006685132 >> v1:172.21.15.71:6789/0 conn(0x7fb3f00b1c20 legacy=0x7fb3f01572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.698+0000 7fb3f519c700 1 -- 172.21.15.71:0/4006685132 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f00cb8c0 con 0x7fb3f01579f0 2023-10-09T07:58:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.698+0000 7fb3f519c700 1 --2- 172.21.15.71:0/4006685132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3f01579f0 0x7fb3f0162530 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009e60 tx=0x7fb3e8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf07693402fcd62b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.698+0000 7fb3ef7fe700 1 -- 172.21.15.71:0/4006685132 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e800e070 con 0x7fb3f01579f0 2023-10-09T07:58:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.698+0000 7fb3ef7fe700 1 -- 172.21.15.71:0/4006685132 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e800b7a0 con 0x7fb3f01579f0 2023-10-09T07:58:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.698+0000 7fb3ef7fe700 1 -- 172.21.15.71:0/4006685132 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc001470 con 0x7fb3f01579f0 2023-10-09T07:58:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.699+0000 7fb3f6bff700 1 -- 172.21.15.71:0/4006685132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3f01579f0 msgr2=0x7fb3f0162530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.699+0000 7fb3f6bff700 1 --2- 172.21.15.71:0/4006685132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3f01579f0 0x7fb3f0162530 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009e60 tx=0x7fb3e8009780 comp rx=0 tx=0).stop 2023-10-09T07:58:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.699+0000 7fb3f6bff700 1 -- 172.21.15.71:0/4006685132 shutdown_connections 2023-10-09T07:58:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.699+0000 7fb3f6bff700 1 --2- 172.21.15.71:0/4006685132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3f01579f0 0x7fb3f0162530 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.699+0000 7fb3f6bff700 1 -- 172.21.15.71:0/4006685132 >> 172.21.15.71:0/4006685132 conn(0x7fb3f006a320 msgr2=0x7fb3f00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:14.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.699+0000 7fb3f6bff700 1 -- 172.21.15.71:0/4006685132 shutdown_connections 2023-10-09T07:58:14.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.699+0000 7fb3f6bff700 1 -- 172.21.15.71:0/4006685132 wait complete. 2023-10-09T07:58:14.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.700+0000 7fb3f6bff700 1 Processor -- start 2023-10-09T07:58:14.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.701+0000 7fb3f6bff700 1 -- start start 2023-10-09T07:58:14.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.701+0000 7fb3f6bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3f00b1850 0x7fb3f0152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:14.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.701+0000 7fb3f6bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3f00b1c20 0x7fb3f006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:14.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.701+0000 7fb3f6bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f01579f0 0x7fb3f00a99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:14.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.701+0000 7fb3f6bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f00cc260 con 0x7fb3f01579f0 2023-10-09T07:58:14.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.701+0000 7fb3f6bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f00a6e50 con 0x7fb3f00b1850 2023-10-09T07:58:14.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.701+0000 7fb3f6bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f016d650 con 0x7fb3f00b1c20 2023-10-09T07:58:14.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.702+0000 7fb3f519c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f01579f0 0x7fb3f00a99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:14.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.702+0000 7fb3f519c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f01579f0 0x7fb3f00a99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37818/0 (socket says 172.21.15.71:37818) 2023-10-09T07:58:14.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.702+0000 7fb3f519c700 1 -- 172.21.15.71:0/67957915 learned_addr learned my addr 172.21.15.71:0/67957915 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:14.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.702+0000 7fb3f499b700 1 --2- 172.21.15.71:0/67957915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3f00b1850 0x7fb3f0152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:14.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.702+0000 7fb3effff700 1 --2- 172.21.15.71:0/67957915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3f00b1c20 0x7fb3f006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:14.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.702+0000 7fb3f519c700 1 -- 172.21.15.71:0/67957915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3f00b1c20 msgr2=0x7fb3f006dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:14.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.702+0000 7fb3f519c700 1 --2- 172.21.15.71:0/67957915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3f00b1c20 0x7fb3f006dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:14.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.702+0000 7fb3f519c700 1 -- 172.21.15.71:0/67957915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3f00b1850 msgr2=0x7fb3f0152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:14.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.702+0000 7fb3f519c700 1 --2- 172.21.15.71:0/67957915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3f00b1850 0x7fb3f0152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:14.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.702+0000 7fb3f519c700 1 -- 172.21.15.71:0/67957915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e8009a20 con 0x7fb3f01579f0 2023-10-09T07:58:14.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.702+0000 7fb3effff700 1 --2- 172.21.15.71:0/67957915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3f00b1c20 0x7fb3f006dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:58:14.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.702+0000 7fb3f499b700 1 --2- 172.21.15.71:0/67957915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3f00b1850 0x7fb3f0152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:58:14.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.702+0000 7fb3f519c700 1 --2- 172.21.15.71:0/67957915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f01579f0 0x7fb3f00a99e0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0064290 tx=0x7fb3e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:14.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.702+0000 7fb3ecff9700 1 -- 172.21.15.71:0/67957915 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e8012da0 con 0x7fb3f01579f0 2023-10-09T07:58:14.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.703+0000 7fb3ecff9700 1 -- 172.21.15.71:0/67957915 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e801e450 con 0x7fb3f01579f0 2023-10-09T07:58:14.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.703+0000 7fb3f6bff700 1 -- 172.21.15.71:0/67957915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f016d930 con 0x7fb3f01579f0 2023-10-09T07:58:14.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.703+0000 7fb3ecff9700 1 -- 172.21.15.71:0/67957915 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e801e7f0 con 0x7fb3f01579f0 2023-10-09T07:58:14.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.703+0000 7fb3f6bff700 1 -- 172.21.15.71:0/67957915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f016def0 con 0x7fb3f01579f0 2023-10-09T07:58:14.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.704+0000 7fb3f6bff700 1 -- 172.21.15.71:0/67957915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f004c3c0 con 0x7fb3f01579f0 2023-10-09T07:58:14.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.704+0000 7fb3ecff9700 1 -- 172.21.15.71:0/67957915 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3e801eb60 con 0x7fb3f01579f0 2023-10-09T07:58:14.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.705+0000 7fb3ecff9700 1 --2- 172.21.15.71:0/67957915 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb3d4066f30 0x7fb3d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:14.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.705+0000 7fb3ecff9700 1 -- 172.21.15.71:0/67957915 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fb3e80868a0 con 0x7fb3f01579f0 2023-10-09T07:58:14.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.706+0000 7fb3f499b700 1 --2- 172.21.15.71:0/67957915 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb3d4066f30 0x7fb3d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:14.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.706+0000 7fb3f499b700 1 --2- 172.21.15.71:0/67957915 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb3d4066f30 0x7fb3d40693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4003940 tx=0x7fb3e4009040 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:14.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.710+0000 7fb3ecff9700 1 -- 172.21.15.71:0/67957915 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3e8053a10 con 0x7fb3f01579f0 2023-10-09T07:58:14.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:14.976+0000 7fb3f6bff700 1 -- 172.21.15.71:0/67957915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7fb3f00cbba0 con 0x7fb3f01579f0 2023-10-09T07:58:15.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:15.969+0000 7fb3ecff9700 1 -- 172.21.15.71:0/67957915 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v2452) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb3e8057030 con 0x7fb3f01579f0 2023-10-09T07:58:15.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:15.972+0000 7fb3f6bff700 1 -- 172.21.15.71:0/67957915 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb3d4066f30 msgr2=0x7fb3d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:15.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:15.972+0000 7fb3f6bff700 1 --2- 172.21.15.71:0/67957915 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb3d4066f30 0x7fb3d40693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4003940 tx=0x7fb3e4009040 comp rx=0 tx=0).stop 2023-10-09T07:58:15.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:15.972+0000 7fb3f6bff700 1 -- 172.21.15.71:0/67957915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f01579f0 msgr2=0x7fb3f00a99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:15.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:15.972+0000 7fb3f6bff700 1 --2- 172.21.15.71:0/67957915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f01579f0 0x7fb3f00a99e0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0064290 tx=0x7fb3e8017000 comp rx=0 tx=0).stop 2023-10-09T07:58:15.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:15.972+0000 7fb3f6bff700 1 -- 172.21.15.71:0/67957915 shutdown_connections 2023-10-09T07:58:15.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:15.972+0000 7fb3f6bff700 1 --2- 172.21.15.71:0/67957915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f01579f0 0x7fb3f00a99e0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:15.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:15.972+0000 7fb3f6bff700 1 --2- 172.21.15.71:0/67957915 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb3d4066f30 0x7fb3d40693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:15.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:15.972+0000 7fb3f6bff700 1 --2- 172.21.15.71:0/67957915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3f00b1850 0x7fb3f0152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:15.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:15.972+0000 7fb3f6bff700 1 --2- 172.21.15.71:0/67957915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3f00b1c20 0x7fb3f006dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:15.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:15.972+0000 7fb3f6bff700 1 -- 172.21.15.71:0/67957915 >> 172.21.15.71:0/67957915 conn(0x7fb3f006a320 msgr2=0x7fb3f01564f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:15.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:15.972+0000 7fb3f6bff700 1 -- 172.21.15.71:0/67957915 shutdown_connections 2023-10-09T07:58:15.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:15.972+0000 7fb3f6bff700 1 -- 172.21.15.71:0/67957915 wait complete. 2023-10-09T07:58:15.993 INFO:tasks.cephfs_test_runner:Test listing snap schedules post removal of a schedule ... ok 2023-10-09T07:58:15.993 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that snap schedule is resumed after mgr restart 2023-10-09T07:58:15.993 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-09T07:58:15.994 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-10-09T07:58:16.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.177+0000 7f63e21ff700 1 Processor -- start 2023-10-09T07:58:16.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.177+0000 7f63e21ff700 1 -- start start 2023-10-09T07:58:16.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.178+0000 7f63e21ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f63dc0b1c20 0x7f63dc1572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:16.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.179+0000 7f63e21ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f63dc157820 0x7f63dc0abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:16.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.179+0000 7f63e21ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63dc157c60 con 0x7f63dc0b1850 2023-10-09T07:58:16.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.179+0000 7f63e21ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63dc06fc30 con 0x7f63dc157820 2023-10-09T07:58:16.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.179+0000 7f63e21ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63dc0cc260 con 0x7f63dc0b1c20 2023-10-09T07:58:16.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.179+0000 7f63dbfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f63dc157820 0x7f63dc0abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:16.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.179+0000 7f63dbfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f63dc157820 0x7f63dc0abf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33982/0 (socket says 172.21.15.71:33982) 2023-10-09T07:58:16.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.179+0000 7f63dbfff700 1 -- 172.21.15.71:0/2021643885 learned_addr learned my addr 172.21.15.71:0/2021643885 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:16.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.179+0000 7f63daffd700 1 --2- 172.21.15.71:0/2021643885 >> v2:172.21.15.179:3300/0 conn(0x7f63dc0b1c20 0x7f63dc1572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:16.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.179+0000 7f63dbfff700 1 -- 172.21.15.71:0/2021643885 >> v2:172.21.15.179:3300/0 conn(0x7f63dc0b1c20 msgr2=0x7f63dc1572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:16.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.179+0000 7f63dbfff700 1 --2- 172.21.15.71:0/2021643885 >> v2:172.21.15.179:3300/0 conn(0x7f63dc0b1c20 0x7f63dc1572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:16.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.179+0000 7f63dbfff700 1 -- 172.21.15.71:0/2021643885 >> v1:172.21.15.179:6789/0 conn(0x7f63dc0b1850 legacy=0x7f63dc0ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:16.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.179+0000 7f63dbfff700 1 -- 172.21.15.71:0/2021643885 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63dc0cb300 con 0x7f63dc157820 2023-10-09T07:58:16.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.180+0000 7f63dbfff700 1 --2- 172.21.15.71:0/2021643885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63dc157820 0x7f63dc0abf60 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f63dc06d340 tx=0x7f63d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10c70b4ab48482f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:16.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.180+0000 7f63da7fc700 1 -- 172.21.15.71:0/2021643885 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d400e070 con 0x7f63dc157820 2023-10-09T07:58:16.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.180+0000 7f63da7fc700 1 -- 172.21.15.71:0/2021643885 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d400ba50 con 0x7f63dc157820 2023-10-09T07:58:16.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.180+0000 7f63da7fc700 1 -- 172.21.15.71:0/2021643885 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d40092e0 con 0x7f63dc157820 2023-10-09T07:58:16.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.180+0000 7f63e21ff700 1 -- 172.21.15.71:0/2021643885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63dc157820 msgr2=0x7f63dc0abf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:16.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.180+0000 7f63e21ff700 1 --2- 172.21.15.71:0/2021643885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63dc157820 0x7f63dc0abf60 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f63dc06d340 tx=0x7f63d4009840 comp rx=0 tx=0).stop 2023-10-09T07:58:16.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.181+0000 7f63e21ff700 1 -- 172.21.15.71:0/2021643885 shutdown_connections 2023-10-09T07:58:16.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.181+0000 7f63e21ff700 1 --2- 172.21.15.71:0/2021643885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63dc157820 0x7f63dc0abf60 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:16.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.181+0000 7f63e21ff700 1 --2- 172.21.15.71:0/2021643885 >> v2:172.21.15.179:3300/0 conn(0x7f63dc0b1c20 0x7f63dc1572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:16.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.181+0000 7f63e21ff700 1 -- 172.21.15.71:0/2021643885 >> 172.21.15.71:0/2021643885 conn(0x7f63dc06a320 msgr2=0x7f63dc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:16.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.181+0000 7f63e21ff700 1 -- 172.21.15.71:0/2021643885 shutdown_connections 2023-10-09T07:58:16.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.181+0000 7f63e21ff700 1 -- 172.21.15.71:0/2021643885 wait complete. 2023-10-09T07:58:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.182+0000 7f63e21ff700 1 Processor -- start 2023-10-09T07:58:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.182+0000 7f63e21ff700 1 -- start start 2023-10-09T07:58:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.183+0000 7f63e21ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63dc0b1850 0x7f63dc150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.183+0000 7f63e21ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63dc0b1c20 0x7f63dc16a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.183+0000 7f63e21ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63dc157820 0x7f63dc1524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.183+0000 7f63e21ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc151220 con 0x7f63dc0b1c20 2023-10-09T07:58:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.183+0000 7f63e21ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc16ab10 con 0x7f63dc0b1850 2023-10-09T07:58:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.183+0000 7f63e21ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc1529f0 con 0x7f63dc157820 2023-10-09T07:58:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.183+0000 7f63daffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63dc0b1c20 0x7f63dc16a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.183+0000 7f63daffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63dc0b1c20 0x7f63dc16a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33990/0 (socket says 172.21.15.71:33990) 2023-10-09T07:58:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.183+0000 7f63daffd700 1 -- 172.21.15.71:0/1096438989 learned_addr learned my addr 172.21.15.71:0/1096438989 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.184+0000 7f63daffd700 1 -- 172.21.15.71:0/1096438989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63dc157820 msgr2=0x7f63dc1524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.184+0000 7f63dbfff700 1 --2- 172.21.15.71:0/1096438989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63dc157820 0x7f63dc1524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.184+0000 7f63db7fe700 1 --2- 172.21.15.71:0/1096438989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63dc0b1850 0x7f63dc150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.184+0000 7f63daffd700 1 --2- 172.21.15.71:0/1096438989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63dc157820 0x7f63dc1524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.184+0000 7f63daffd700 1 -- 172.21.15.71:0/1096438989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63dc0b1850 msgr2=0x7f63dc150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.184+0000 7f63daffd700 1 --2- 172.21.15.71:0/1096438989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63dc0b1850 0x7f63dc150ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.184+0000 7f63daffd700 1 -- 172.21.15.71:0/1096438989 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d4009ae0 con 0x7f63dc0b1c20 2023-10-09T07:58:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.184+0000 7f63dbfff700 1 --2- 172.21.15.71:0/1096438989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63dc157820 0x7f63dc1524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.184+0000 7f63db7fe700 1 --2- 172.21.15.71:0/1096438989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63dc0b1850 0x7f63dc150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.184+0000 7f63daffd700 1 --2- 172.21.15.71:0/1096438989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63dc0b1c20 0x7f63dc16a5d0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f63d000d890 tx=0x7f63d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.184+0000 7f63c37fe700 1 -- 172.21.15.71:0/1096438989 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d00125f0 con 0x7f63dc0b1c20 2023-10-09T07:58:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.184+0000 7f63c37fe700 1 -- 172.21.15.71:0/1096438989 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d0012770 con 0x7f63dc0b1c20 2023-10-09T07:58:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.184+0000 7f63c37fe700 1 -- 172.21.15.71:0/1096438989 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d0012b30 con 0x7f63dc0b1c20 2023-10-09T07:58:16.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.184+0000 7f63e21ff700 1 -- 172.21.15.71:0/1096438989 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63dc151410 con 0x7f63dc0b1c20 2023-10-09T07:58:16.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.184+0000 7f63e21ff700 1 -- 172.21.15.71:0/1096438989 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63dc151cb0 con 0x7f63dc0b1c20 2023-10-09T07:58:16.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.185+0000 7f63e21ff700 1 -- 172.21.15.71:0/1096438989 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63dc04c3c0 con 0x7f63dc0b1c20 2023-10-09T07:58:16.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.186+0000 7f63c37fe700 1 -- 172.21.15.71:0/1096438989 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f63d001e460 con 0x7f63dc0b1c20 2023-10-09T07:58:16.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.187+0000 7f63c37fe700 1 --2- 172.21.15.71:0/1096438989 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f63c8066f30 0x7f63c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:16.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.187+0000 7f63c37fe700 1 -- 172.21.15.71:0/1096438989 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f63d0084dd0 con 0x7f63dc0b1c20 2023-10-09T07:58:16.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.188+0000 7f63db7fe700 1 --2- 172.21.15.71:0/1096438989 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f63c8066f30 0x7f63c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:16.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.188+0000 7f63db7fe700 1 --2- 172.21.15.71:0/1096438989 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f63c8066f30 0x7f63c80693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f63dc15ce80 tx=0x7f63cc009040 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:16.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.191+0000 7f63c37fe700 1 -- 172.21.15.71:0/1096438989 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63d0051ea0 con 0x7f63dc0b1c20 2023-10-09T07:58:16.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.456+0000 7f63e21ff700 1 -- 172.21.15.71:0/1096438989 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f63dc0678d0 con 0x7f63dc0b1c20 2023-10-09T07:58:16.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.974+0000 7f63c37fe700 1 -- 172.21.15.71:0/1096438989 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v2453) v1 ==== 168+0+0 (secure 0 0 0) 0x7f63d00554c0 con 0x7f63dc0b1c20 2023-10-09T07:58:16.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.976+0000 7f63e21ff700 1 -- 172.21.15.71:0/1096438989 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f63c8066f30 msgr2=0x7f63c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:16.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.976+0000 7f63e21ff700 1 --2- 172.21.15.71:0/1096438989 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f63c8066f30 0x7f63c80693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f63dc15ce80 tx=0x7f63cc009040 comp rx=0 tx=0).stop 2023-10-09T07:58:16.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.976+0000 7f63e21ff700 1 -- 172.21.15.71:0/1096438989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63dc0b1c20 msgr2=0x7f63dc16a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:16.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.976+0000 7f63e21ff700 1 --2- 172.21.15.71:0/1096438989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63dc0b1c20 0x7f63dc16a5d0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f63d000d890 tx=0x7f63d0008040 comp rx=0 tx=0).stop 2023-10-09T07:58:16.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.976+0000 7f63e21ff700 1 -- 172.21.15.71:0/1096438989 shutdown_connections 2023-10-09T07:58:16.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.976+0000 7f63e21ff700 1 --2- 172.21.15.71:0/1096438989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63dc157820 0x7f63dc1524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:16.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.977+0000 7f63e21ff700 1 --2- 172.21.15.71:0/1096438989 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f63c8066f30 0x7f63c80693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:16.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.977+0000 7f63e21ff700 1 --2- 172.21.15.71:0/1096438989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63dc0b1850 0x7f63dc150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:16.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.977+0000 7f63e21ff700 1 --2- 172.21.15.71:0/1096438989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63dc0b1c20 0x7f63dc16a5d0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:16.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.977+0000 7f63e21ff700 1 -- 172.21.15.71:0/1096438989 >> 172.21.15.71:0/1096438989 conn(0x7f63dc06a320 msgr2=0x7f63dc06d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:16.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.977+0000 7f63e21ff700 1 -- 172.21.15.71:0/1096438989 shutdown_connections 2023-10-09T07:58:16.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:16.977+0000 7f63e21ff700 1 -- 172.21.15.71:0/1096438989 wait complete. 2023-10-09T07:58:16.997 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T07:58:17.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.180+0000 7f68f0fff700 1 Processor -- start 2023-10-09T07:58:17.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.180+0000 7f68f0fff700 1 -- start start 2023-10-09T07:58:17.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.181+0000 7f68f0fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f68ec0c83f0 0x7f68ec0c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:17.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.181+0000 7f68f0fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68ec0ccee0 0x7f68ec1561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:17.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.181+0000 7f68f0fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f68ec0c87c0 0x7f68ec156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:17.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.181+0000 7f68f0fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68ec156c50 con 0x7f68ec0c83f0 2023-10-09T07:58:17.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.181+0000 7f68f0fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68ec15b0d0 con 0x7f68ec0c87c0 2023-10-09T07:58:17.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.182+0000 7f68f0fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec0c7a60 con 0x7f68ec0ccee0 2023-10-09T07:58:17.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.182+0000 7f68ea59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f68ec0c83f0 0x7f68ec0c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:17.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.182+0000 7f68ea59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f68ec0c83f0 0x7f68ec0c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34000/0 (socket says 172.21.15.71:34000) 2023-10-09T07:58:17.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.182+0000 7f68ea59c700 1 -- 172.21.15.71:0/206199657 learned_addr learned my addr 172.21.15.71:0/206199657 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:17.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.182+0000 7f68ea59c700 1 -- 172.21.15.71:0/206199657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68ec0ccee0 msgr2=0x7f68ec1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:17.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.182+0000 7f68ea59c700 1 --2- 172.21.15.71:0/206199657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68ec0ccee0 0x7f68ec1561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:17.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.182+0000 7f68ead9d700 1 --2- 172.21.15.71:0/206199657 >> v2:172.21.15.179:3300/0 conn(0x7f68ec0c87c0 0x7f68ec156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:17.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.182+0000 7f68ea59c700 1 -- 172.21.15.71:0/206199657 >> v2:172.21.15.179:3300/0 conn(0x7f68ec0c87c0 msgr2=0x7f68ec156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:17.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.182+0000 7f68ea59c700 1 --2- 172.21.15.71:0/206199657 >> v2:172.21.15.179:3300/0 conn(0x7f68ec0c87c0 0x7f68ec156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:17.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.182+0000 7f68ea59c700 1 -- 172.21.15.71:0/206199657 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ec15a4c0 con 0x7f68ec0c83f0 2023-10-09T07:58:17.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.182+0000 7f68ead9d700 1 --2- 172.21.15.71:0/206199657 >> v2:172.21.15.179:3300/0 conn(0x7f68ec0c87c0 0x7f68ec156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:17.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.183+0000 7f68ea59c700 1 --2- 172.21.15.71:0/206199657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68ec0c83f0 0x7f68ec0c7520 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0cc340 tx=0x7f68dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2160d404327bfab1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:17.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.183+0000 7f68e9d9b700 1 -- 172.21.15.71:0/206199657 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc00b860 con 0x7f68ec0c83f0 2023-10-09T07:58:17.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.183+0000 7f68e9d9b700 1 -- 172.21.15.71:0/206199657 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68dc00b9c0 con 0x7f68ec0c83f0 2023-10-09T07:58:17.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.183+0000 7f68e9d9b700 1 -- 172.21.15.71:0/206199657 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc00bd60 con 0x7f68ec0c83f0 2023-10-09T07:58:17.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.183+0000 7f68f0fff700 1 -- 172.21.15.71:0/206199657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68ec0c83f0 msgr2=0x7f68ec0c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:17.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.183+0000 7f68f0fff700 1 --2- 172.21.15.71:0/206199657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68ec0c83f0 0x7f68ec0c7520 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0cc340 tx=0x7f68dc009250 comp rx=0 tx=0).stop 2023-10-09T07:58:17.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.183+0000 7f68f0fff700 1 -- 172.21.15.71:0/206199657 shutdown_connections 2023-10-09T07:58:17.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.183+0000 7f68f0fff700 1 --2- 172.21.15.71:0/206199657 >> v2:172.21.15.179:3300/0 conn(0x7f68ec0c87c0 0x7f68ec156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:17.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.183+0000 7f68f0fff700 1 --2- 172.21.15.71:0/206199657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68ec0c83f0 0x7f68ec0c7520 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:17.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.183+0000 7f68f0fff700 1 --2- 172.21.15.71:0/206199657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68ec0ccee0 0x7f68ec1561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:17.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.183+0000 7f68f0fff700 1 -- 172.21.15.71:0/206199657 >> 172.21.15.71:0/206199657 conn(0x7f68ec068e10 msgr2=0x7f68ec0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:17.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.184+0000 7f68f0fff700 1 -- 172.21.15.71:0/206199657 shutdown_connections 2023-10-09T07:58:17.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.184+0000 7f68f0fff700 1 -- 172.21.15.71:0/206199657 wait complete. 2023-10-09T07:58:17.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.185+0000 7f68f0fff700 1 Processor -- start 2023-10-09T07:58:17.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.185+0000 7f68f0fff700 1 -- start start 2023-10-09T07:58:17.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.186+0000 7f68f0fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68ec0c83f0 0x7f68ec148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:17.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.186+0000 7f68f0fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68ec0c87c0 0x7f68ec157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:17.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.186+0000 7f68f0fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68ec0ccee0 0x7f68ec169fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:17.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.186+0000 7f68f0fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec149100 con 0x7f68ec0ccee0 2023-10-09T07:58:17.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.186+0000 7f68f0fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec157e50 con 0x7f68ec0c83f0 2023-10-09T07:58:17.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.186+0000 7f68f0fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec16ab60 con 0x7f68ec0c87c0 2023-10-09T07:58:17.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.186+0000 7f68ead9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68ec0ccee0 0x7f68ec169fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:17.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.186+0000 7f68ead9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68ec0ccee0 0x7f68ec169fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34008/0 (socket says 172.21.15.71:34008) 2023-10-09T07:58:17.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.186+0000 7f68ead9d700 1 -- 172.21.15.71:0/3667767032 learned_addr learned my addr 172.21.15.71:0/3667767032 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:17.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.187+0000 7f68ea59c700 1 --2- 172.21.15.71:0/3667767032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68ec0c83f0 0x7f68ec148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:17.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.187+0000 7f68e3fff700 1 --2- 172.21.15.71:0/3667767032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68ec0c87c0 0x7f68ec157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:17.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.187+0000 7f68ead9d700 1 -- 172.21.15.71:0/3667767032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68ec0c87c0 msgr2=0x7f68ec157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:17.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.187+0000 7f68ead9d700 1 --2- 172.21.15.71:0/3667767032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68ec0c87c0 0x7f68ec157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:17.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.187+0000 7f68ead9d700 1 -- 172.21.15.71:0/3667767032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68ec0c83f0 msgr2=0x7f68ec148bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:17.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.187+0000 7f68ead9d700 1 --2- 172.21.15.71:0/3667767032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68ec0c83f0 0x7f68ec148bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:17.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.187+0000 7f68ead9d700 1 -- 172.21.15.71:0/3667767032 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc0094f0 con 0x7f68ec0ccee0 2023-10-09T07:58:17.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.187+0000 7f68ead9d700 1 --2- 172.21.15.71:0/3667767032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68ec0ccee0 0x7f68ec169fc0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f68e400a380 tx=0x7f68e4007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:17.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.187+0000 7f68e27fc700 1 -- 172.21.15.71:0/3667767032 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e4015440 con 0x7f68ec0ccee0 2023-10-09T07:58:17.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.187+0000 7f68e27fc700 1 -- 172.21.15.71:0/3667767032 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e40155a0 con 0x7f68ec0ccee0 2023-10-09T07:58:17.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.187+0000 7f68f0fff700 1 -- 172.21.15.71:0/3667767032 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68ec16ae40 con 0x7f68ec0ccee0 2023-10-09T07:58:17.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.187+0000 7f68e27fc700 1 -- 172.21.15.71:0/3667767032 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e4015960 con 0x7f68ec0ccee0 2023-10-09T07:58:17.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.188+0000 7f68f0fff700 1 -- 172.21.15.71:0/3667767032 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68ec157110 con 0x7f68ec0ccee0 2023-10-09T07:58:17.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.189+0000 7f68f0fff700 1 -- 172.21.15.71:0/3667767032 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68ec0c7c90 con 0x7f68ec0ccee0 2023-10-09T07:58:17.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.189+0000 7f68e27fc700 1 -- 172.21.15.71:0/3667767032 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f68e4015d50 con 0x7f68ec0ccee0 2023-10-09T07:58:17.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.191+0000 7f68e27fc700 1 --2- 172.21.15.71:0/3667767032 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f68cc066f30 0x7f68cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:17.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.191+0000 7f68e27fc700 1 -- 172.21.15.71:0/3667767032 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f68e4084f70 con 0x7f68ec0ccee0 2023-10-09T07:58:17.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.191+0000 7f68ea59c700 1 --2- 172.21.15.71:0/3667767032 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f68cc066f30 0x7f68cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:17.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.192+0000 7f68ea59c700 1 --2- 172.21.15.71:0/3667767032 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f68cc066f30 0x7f68cc0693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0cc340 tx=0x7f68dc017000 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:17.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.195+0000 7f68e27fc700 1 -- 172.21.15.71:0/3667767032 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68e40520e0 con 0x7f68ec0ccee0 2023-10-09T07:58:17.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.385+0000 7f68f0fff700 1 -- 172.21.15.71:0/3667767032 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f68ec04c3c0 con 0x7f68ec0ccee0 2023-10-09T07:58:17.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.390+0000 7f68e27fc700 1 -- 172.21.15.71:0/3667767032 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v58)=0 v58) v1 ==== 122+0+0 (secure 0 0 0) 0x7f68e4055700 con 0x7f68ec0ccee0 2023-10-09T07:58:17.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.392+0000 7f68f0fff700 1 -- 172.21.15.71:0/3667767032 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f68cc066f30 msgr2=0x7f68cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:17.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.392+0000 7f68f0fff700 1 --2- 172.21.15.71:0/3667767032 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f68cc066f30 0x7f68cc0693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0cc340 tx=0x7f68dc017000 comp rx=0 tx=0).stop 2023-10-09T07:58:17.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.392+0000 7f68f0fff700 1 -- 172.21.15.71:0/3667767032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68ec0ccee0 msgr2=0x7f68ec169fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:17.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.392+0000 7f68f0fff700 1 --2- 172.21.15.71:0/3667767032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68ec0ccee0 0x7f68ec169fc0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f68e400a380 tx=0x7f68e4007900 comp rx=0 tx=0).stop 2023-10-09T07:58:17.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.392+0000 7f68f0fff700 1 -- 172.21.15.71:0/3667767032 shutdown_connections 2023-10-09T07:58:17.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.392+0000 7f68f0fff700 1 --2- 172.21.15.71:0/3667767032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68ec0ccee0 0x7f68ec169fc0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:17.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.392+0000 7f68f0fff700 1 --2- 172.21.15.71:0/3667767032 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f68cc066f30 0x7f68cc0693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:17.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.392+0000 7f68f0fff700 1 --2- 172.21.15.71:0/3667767032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68ec0c83f0 0x7f68ec148bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:17.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.392+0000 7f68f0fff700 1 --2- 172.21.15.71:0/3667767032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68ec0c87c0 0x7f68ec157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:17.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.392+0000 7f68f0fff700 1 -- 172.21.15.71:0/3667767032 >> 172.21.15.71:0/3667767032 conn(0x7f68ec068e10 msgr2=0x7f68ec151090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:17.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.392+0000 7f68f0fff700 1 -- 172.21.15.71:0/3667767032 shutdown_connections 2023-10-09T07:58:17.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.392+0000 7f68f0fff700 1 -- 172.21.15.71:0/3667767032 wait complete. 2023-10-09T07:58:17.410 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T07:58:17.411 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T07:58:17.487 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T07:58:17.577 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T07:58:17.578 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T07:58:17.578 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:58:17.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.758+0000 7f05affff700 1 Processor -- start 2023-10-09T07:58:17.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.759+0000 7f05affff700 1 -- start start 2023-10-09T07:58:17.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.760+0000 7f05affff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05b01566e0 0x7f05b00ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:17.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.760+0000 7f05affff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f05b00cb900 0x7f05b00ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:17.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.760+0000 7f05affff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05b00ca860 con 0x7f05b0156310 2023-10-09T07:58:17.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.760+0000 7f05affff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b00cab40 con 0x7f05b00cb900 2023-10-09T07:58:17.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.760+0000 7f05affff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b00cae20 con 0x7f05b01566e0 2023-10-09T07:58:17.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.760+0000 7f05aeffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f05b0156310 0x7f05b00c9dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34394/0 (socket says 172.21.15.71:34394) 2023-10-09T07:58:17.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.760+0000 7f05aeffd700 1 -- 172.21.15.71:0/1474715318 learned_addr learned my addr 172.21.15.71:0/1474715318 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:17.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.760+0000 7f05af7fe700 1 --2- 172.21.15.71:0/1474715318 >> v2:172.21.15.71:3300/0 conn(0x7f05b00cb900 0x7f05b00ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:17.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.760+0000 7f05ae7fc700 1 --2- 172.21.15.71:0/1474715318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05b01566e0 0x7f05b00ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:17.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.761+0000 7f05af7fe700 1 -- 172.21.15.71:0/1474715318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05b01566e0 msgr2=0x7f05b00ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:17.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.761+0000 7f05af7fe700 1 --2- 172.21.15.71:0/1474715318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05b01566e0 0x7f05b00ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:17.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.761+0000 7f05af7fe700 1 -- 172.21.15.71:0/1474715318 >> v1:172.21.15.71:6789/0 conn(0x7f05b0156310 legacy=0x7f05b00c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:17.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.761+0000 7f05af7fe700 1 -- 172.21.15.71:0/1474715318 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b00cb100 con 0x7f05b00cb900 2023-10-09T07:58:17.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.761+0000 7f05ae7fc700 1 --2- 172.21.15.71:0/1474715318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05b01566e0 0x7f05b00ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:58:17.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.761+0000 7f05adffb700 1 -- 172.21.15.71:0/1474715318 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945934218 0 0) 0x7f05b00ca860 con 0x7f05b0156310 2023-10-09T07:58:17.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.761+0000 7f05af7fe700 1 --2- 172.21.15.71:0/1474715318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05b00cb900 0x7f05b00ae540 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f05a8009e60 tx=0x7f05a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99488899ece0b34a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:17.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.761+0000 7f05adffb700 1 -- 172.21.15.71:0/1474715318 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a800e070 con 0x7f05b00cb900 2023-10-09T07:58:17.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.761+0000 7f05adffb700 1 -- 172.21.15.71:0/1474715318 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a800bc30 con 0x7f05b00cb900 2023-10-09T07:58:17.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.761+0000 7f05adffb700 1 -- 172.21.15.71:0/1474715318 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a8012430 con 0x7f05b00cb900 2023-10-09T07:58:17.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.762+0000 7f05affff700 1 -- 172.21.15.71:0/1474715318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05b00cb900 msgr2=0x7f05b00ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:17.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.762+0000 7f05affff700 1 --2- 172.21.15.71:0/1474715318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05b00cb900 0x7f05b00ae540 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f05a8009e60 tx=0x7f05a8009780 comp rx=0 tx=0).stop 2023-10-09T07:58:17.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.762+0000 7f05affff700 1 -- 172.21.15.71:0/1474715318 shutdown_connections 2023-10-09T07:58:17.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.762+0000 7f05affff700 1 --2- 172.21.15.71:0/1474715318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05b00cb900 0x7f05b00ae540 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:17.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.762+0000 7f05affff700 1 --2- 172.21.15.71:0/1474715318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05b01566e0 0x7f05b00ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:17.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.762+0000 7f05affff700 1 -- 172.21.15.71:0/1474715318 >> 172.21.15.71:0/1474715318 conn(0x7f05b00cc1f0 msgr2=0x7f05b00cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:17.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.762+0000 7f05affff700 1 -- 172.21.15.71:0/1474715318 shutdown_connections 2023-10-09T07:58:17.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.762+0000 7f05affff700 1 -- 172.21.15.71:0/1474715318 wait complete. 2023-10-09T07:58:17.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.763+0000 7f05affff700 1 Processor -- start 2023-10-09T07:58:17.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.763+0000 7f05affff700 1 -- start start 2023-10-09T07:58:17.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.764+0000 7f05affff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05b00cb900 0x7f05b015a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:17.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.764+0000 7f05affff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05b0156310 0x7f05b01503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:17.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.764+0000 7f05affff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05b01566e0 0x7f05b00c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:17.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.764+0000 7f05affff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b00c7bc0 con 0x7f05b00cb900 2023-10-09T07:58:17.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.764+0000 7f05affff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b00c7ea0 con 0x7f05b0156310 2023-10-09T07:58:17.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.764+0000 7f05affff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b00c8180 con 0x7f05b01566e0 2023-10-09T07:58:17.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.765+0000 7f05aeffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05b00cb900 0x7f05b015a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:17.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.765+0000 7f05aeffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05b00cb900 0x7f05b015a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34022/0 (socket says 172.21.15.71:34022) 2023-10-09T07:58:17.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.765+0000 7f05aeffd700 1 -- 172.21.15.71:0/452899949 learned_addr learned my addr 172.21.15.71:0/452899949 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:17.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.765+0000 7f05af7fe700 1 --2- 172.21.15.71:0/452899949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05b01566e0 0x7f05b00c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:17.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.765+0000 7f05ae7fc700 1 --2- 172.21.15.71:0/452899949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05b0156310 0x7f05b01503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:17.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.765+0000 7f05aeffd700 1 -- 172.21.15.71:0/452899949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05b01566e0 msgr2=0x7f05b00c24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:17.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.765+0000 7f05aeffd700 1 --2- 172.21.15.71:0/452899949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05b01566e0 0x7f05b00c24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:17.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.765+0000 7f05aeffd700 1 -- 172.21.15.71:0/452899949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05b0156310 msgr2=0x7f05b01503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:17.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.765+0000 7f05aeffd700 1 --2- 172.21.15.71:0/452899949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05b0156310 0x7f05b01503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:17.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.765+0000 7f05aeffd700 1 -- 172.21.15.71:0/452899949 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a8009a20 con 0x7f05b00cb900 2023-10-09T07:58:17.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.765+0000 7f05aeffd700 1 --2- 172.21.15.71:0/452899949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05b00cb900 0x7f05b015a380 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f05a000c7e0 tx=0x7f05a0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:17.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.766+0000 7f0596ffd700 1 -- 172.21.15.71:0/452899949 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a0005b30 con 0x7f05b00cb900 2023-10-09T07:58:17.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.766+0000 7f0596ffd700 1 -- 172.21.15.71:0/452899949 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a0005c90 con 0x7f05b00cb900 2023-10-09T07:58:17.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.766+0000 7f05affff700 1 -- 172.21.15.71:0/452899949 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b00c8460 con 0x7f05b00cb900 2023-10-09T07:58:17.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.766+0000 7f0596ffd700 1 -- 172.21.15.71:0/452899949 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a0007300 con 0x7f05b00cb900 2023-10-09T07:58:17.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.766+0000 7f05affff700 1 -- 172.21.15.71:0/452899949 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b015a8c0 con 0x7f05b00cb900 2023-10-09T07:58:17.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.767+0000 7f05affff700 1 -- 172.21.15.71:0/452899949 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b004c3c0 con 0x7f05b00cb900 2023-10-09T07:58:17.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.768+0000 7f0596ffd700 1 -- 172.21.15.71:0/452899949 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f05a001b400 con 0x7f05b00cb900 2023-10-09T07:58:17.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.769+0000 7f0596ffd700 1 --2- 172.21.15.71:0/452899949 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f059c066f30 0x7f059c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:17.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.769+0000 7f0596ffd700 1 -- 172.21.15.71:0/452899949 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f05a0084250 con 0x7f05b00cb900 2023-10-09T07:58:17.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.769+0000 7f05ae7fc700 1 --2- 172.21.15.71:0/452899949 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f059c066f30 0x7f059c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:17.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.770+0000 7f05ae7fc700 1 --2- 172.21.15.71:0/452899949 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f059c066f30 0x7f059c0693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f05a4006f00 tx=0x7f05a4008040 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:17.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:17.773+0000 7f0596ffd700 1 -- 172.21.15.71:0/452899949 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05a00513a0 con 0x7f05b00cb900 2023-10-09T07:58:18.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.006+0000 7f05affff700 1 -- 172.21.15.71:0/452899949 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05b00cd0b0 con 0x7f05b00cb900 2023-10-09T07:58:18.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.007+0000 7f0596ffd700 1 -- 172.21.15.71:0/452899949 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f05a00549c0 con 0x7f05b00cb900 2023-10-09T07:58:18.008 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:58:18.008 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":76,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1228129559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1228129559},{"type":"v1","addr":"172.21.15.179:6836","nonce":1228129559}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8254,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3640887500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3640887500},{"type":"v1","addr":"172.21.15.179:6834","nonce":3640887500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8586,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/4266132184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":4266132184},{"type":"v1","addr":"172.21.15.71:6834","nonce":4266132184}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8970,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2989073974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":2989073974},{"type":"v1","addr":"172.21.15.71:6835","nonce":2989073974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76}],"filesystems":[]} 2023-10-09T07:58:18.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.009+0000 7f05affff700 1 -- 172.21.15.71:0/452899949 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f059c066f30 msgr2=0x7f059c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:18.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.009+0000 7f05affff700 1 --2- 172.21.15.71:0/452899949 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f059c066f30 0x7f059c0693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f05a4006f00 tx=0x7f05a4008040 comp rx=0 tx=0).stop 2023-10-09T07:58:18.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.009+0000 7f05affff700 1 -- 172.21.15.71:0/452899949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05b00cb900 msgr2=0x7f05b015a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:18.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.009+0000 7f05affff700 1 --2- 172.21.15.71:0/452899949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05b00cb900 0x7f05b015a380 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f05a000c7e0 tx=0x7f05a0007df0 comp rx=0 tx=0).stop 2023-10-09T07:58:18.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.009+0000 7f05affff700 1 -- 172.21.15.71:0/452899949 shutdown_connections 2023-10-09T07:58:18.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.009+0000 7f05affff700 1 --2- 172.21.15.71:0/452899949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05b01566e0 0x7f05b00c24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:18.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.009+0000 7f05affff700 1 --2- 172.21.15.71:0/452899949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05b00cb900 0x7f05b015a380 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:18.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.009+0000 7f05affff700 1 --2- 172.21.15.71:0/452899949 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f059c066f30 0x7f059c0693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:18.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.009+0000 7f05affff700 1 --2- 172.21.15.71:0/452899949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05b0156310 0x7f05b01503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:18.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.009+0000 7f05affff700 1 -- 172.21.15.71:0/452899949 >> 172.21.15.71:0/452899949 conn(0x7f05b00cc1f0 msgr2=0x7f05b00adce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:18.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.009+0000 7f05affff700 1 -- 172.21.15.71:0/452899949 shutdown_connections 2023-10-09T07:58:18.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.010+0000 7f05affff700 1 -- 172.21.15.71:0/452899949 wait complete. 2023-10-09T07:58:18.012 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 76 2023-10-09T07:58:18.028 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T07:58:18.028 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T07:58:18.028 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T07:58:18.028 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T07:58:18.028 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T07:58:18.029 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T07:58:18.029 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T07:58:18.029 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T07:58:18.029 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T07:58:18.029 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T07:58:18.029 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T07:58:18.029 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T07:58:18.030 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T07:58:18.030 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T07:58:18.030 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T07:58:18.030 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T07:58:18.041 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T07:58:18.041 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T07:58:18.042 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T07:58:18.042 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T07:58:18.045 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T07:58:18.046 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T07:58:18.047 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T07:58:18.047 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T07:58:18.086 INFO:tasks.ceph.mds.a:Started 2023-10-09T07:58:18.086 DEBUG:teuthology.parallel:result is None 2023-10-09T07:58:18.089 INFO:tasks.ceph.mds.c:Started 2023-10-09T07:58:18.089 DEBUG:teuthology.parallel:result is None 2023-10-09T07:58:18.091 INFO:tasks.ceph.mds.b:Started 2023-10-09T07:58:18.091 DEBUG:teuthology.parallel:result is None 2023-10-09T07:58:18.094 INFO:tasks.ceph.mds.d:Started 2023-10-09T07:58:18.095 DEBUG:teuthology.parallel:result is None 2023-10-09T07:58:18.095 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T07:58:18.219 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-10-09T07:58:18.221 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2023-10-09T07:58:18.231 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-09T07:58:18.231 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-09T07:58:18.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.285+0000 7fd30ebff700 1 Processor -- start 2023-10-09T07:58:18.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.285+0000 7fd30ebff700 1 -- start start 2023-10-09T07:58:18.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.286+0000 7fd30ebff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd3080cbf30 0x7fd3080ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:18.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.286+0000 7fd30ebff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd3080ccf90 0x7fd3080b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:18.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.286+0000 7fd30ebff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3080cc300 con 0x7fd30815a270 2023-10-09T07:58:18.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.286+0000 7fd30ebff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd308156bf0 con 0x7fd3080cbf30 2023-10-09T07:58:18.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.286+0000 7fd30ebff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3080ae950 con 0x7fd3080ccf90 2023-10-09T07:58:18.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.287+0000 7fd30c99b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd3080cbf30 0x7fd3080ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:18.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.287+0000 7fd30d19c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd30815a270 0x7fd3080c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34410/0 (socket says 172.21.15.71:34410) 2023-10-09T07:58:18.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.287+0000 7fd30d19c700 1 -- 172.21.15.71:0/347981544 learned_addr learned my addr 172.21.15.71:0/347981544 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:18.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.287+0000 7fd307fff700 1 --2- 172.21.15.71:0/347981544 >> v2:172.21.15.179:3300/0 conn(0x7fd3080ccf90 0x7fd3080b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:18.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.287+0000 7fd30c99b700 1 -- 172.21.15.71:0/347981544 >> v2:172.21.15.179:3300/0 conn(0x7fd3080ccf90 msgr2=0x7fd3080b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:18.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.287+0000 7fd30c99b700 1 --2- 172.21.15.71:0/347981544 >> v2:172.21.15.179:3300/0 conn(0x7fd3080ccf90 0x7fd3080b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:18.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.287+0000 7fd30c99b700 1 -- 172.21.15.71:0/347981544 >> v1:172.21.15.71:6789/0 conn(0x7fd30815a270 legacy=0x7fd3080c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:18.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.287+0000 7fd30c99b700 1 -- 172.21.15.71:0/347981544 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3080ad370 con 0x7fd3080cbf30 2023-10-09T07:58:18.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.287+0000 7fd3077fe700 1 -- 172.21.15.71:0/347981544 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2950684910 0 0) 0x7fd3080cc300 con 0x7fd30815a270 2023-10-09T07:58:18.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.287+0000 7fd30c99b700 1 --2- 172.21.15.71:0/347981544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3080cbf30 0x7fd3080ae410 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fd30806d670 tx=0x7fd2fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62000b1859f59c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:18.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.288+0000 7fd3077fe700 1 -- 172.21.15.71:0/347981544 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc011630 con 0x7fd3080cbf30 2023-10-09T07:58:18.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.288+0000 7fd3077fe700 1 -- 172.21.15.71:0/347981544 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2fc011790 con 0x7fd3080cbf30 2023-10-09T07:58:18.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.288+0000 7fd3077fe700 1 -- 172.21.15.71:0/347981544 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc011b30 con 0x7fd3080cbf30 2023-10-09T07:58:18.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.288+0000 7fd30ebff700 1 -- 172.21.15.71:0/347981544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3080cbf30 msgr2=0x7fd3080ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:18.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.288+0000 7fd30ebff700 1 --2- 172.21.15.71:0/347981544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3080cbf30 0x7fd3080ae410 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fd30806d670 tx=0x7fd2fc0091a0 comp rx=0 tx=0).stop 2023-10-09T07:58:18.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.288+0000 7fd30ebff700 1 -- 172.21.15.71:0/347981544 shutdown_connections 2023-10-09T07:58:18.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.288+0000 7fd30ebff700 1 --2- 172.21.15.71:0/347981544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3080cbf30 0x7fd3080ae410 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:18.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.288+0000 7fd30ebff700 1 --2- 172.21.15.71:0/347981544 >> v2:172.21.15.179:3300/0 conn(0x7fd3080ccf90 0x7fd3080b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:18.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.288+0000 7fd30ebff700 1 -- 172.21.15.71:0/347981544 >> 172.21.15.71:0/347981544 conn(0x7fd30806a320 msgr2=0x7fd3080cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:18.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.288+0000 7fd30ebff700 1 -- 172.21.15.71:0/347981544 shutdown_connections 2023-10-09T07:58:18.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.288+0000 7fd30ebff700 1 -- 172.21.15.71:0/347981544 wait complete. 2023-10-09T07:58:18.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.290+0000 7fd30ebff700 1 Processor -- start 2023-10-09T07:58:18.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.290+0000 7fd30ebff700 1 -- start start 2023-10-09T07:58:18.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.291+0000 7fd30ebff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3080cbf30 0x7fd3080cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:18.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.291+0000 7fd30ebff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3080ccf90 0x7fd308156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:18.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.291+0000 7fd30ebff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd30815a270 0x7fd308157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:18.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.291+0000 7fd30ebff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd308152450 con 0x7fd3080cbf30 2023-10-09T07:58:18.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.291+0000 7fd30ebff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd308155ce0 con 0x7fd30815a270 2023-10-09T07:58:18.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.291+0000 7fd30ebff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd308155fc0 con 0x7fd3080ccf90 2023-10-09T07:58:18.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.291+0000 7fd30c99b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3080cbf30 0x7fd3080cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:18.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.291+0000 7fd30c99b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3080cbf30 0x7fd3080cb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34078/0 (socket says 172.21.15.71:34078) 2023-10-09T07:58:18.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.291+0000 7fd30c99b700 1 -- 172.21.15.71:0/249090730 learned_addr learned my addr 172.21.15.71:0/249090730 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:18.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.291+0000 7fd30c99b700 1 -- 172.21.15.71:0/249090730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3080ccf90 msgr2=0x7fd308156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:18.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.291+0000 7fd30c99b700 1 --2- 172.21.15.71:0/249090730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3080ccf90 0x7fd308156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:18.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.291+0000 7fd30c99b700 1 -- 172.21.15.71:0/249090730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd30815a270 msgr2=0x7fd308157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:18.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.291+0000 7fd30c99b700 1 --2- 172.21.15.71:0/249090730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd30815a270 0x7fd308157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:18.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.291+0000 7fd30c99b700 1 -- 172.21.15.71:0/249090730 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc009420 con 0x7fd3080cbf30 2023-10-09T07:58:18.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.291+0000 7fd30c99b700 1 --2- 172.21.15.71:0/249090730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3080cbf30 0x7fd3080cb310 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0091e0 tx=0x7fd2fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:18.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.292+0000 7fd304ff9700 1 -- 172.21.15.71:0/249090730 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc011900 con 0x7fd3080cbf30 2023-10-09T07:58:18.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.292+0000 7fd304ff9700 1 -- 172.21.15.71:0/249090730 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2fc011aa0 con 0x7fd3080cbf30 2023-10-09T07:58:18.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.292+0000 7fd30ebff700 1 -- 172.21.15.71:0/249090730 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3081562a0 con 0x7fd3080cbf30 2023-10-09T07:58:18.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.292+0000 7fd304ff9700 1 -- 172.21.15.71:0/249090730 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc025670 con 0x7fd3080cbf30 2023-10-09T07:58:18.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.292+0000 7fd30ebff700 1 -- 172.21.15.71:0/249090730 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd308155900 con 0x7fd3080cbf30 2023-10-09T07:58:18.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.293+0000 7fd30ebff700 1 -- 172.21.15.71:0/249090730 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd30804c3c0 con 0x7fd3080cbf30 2023-10-09T07:58:18.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.294+0000 7fd304ff9700 1 -- 172.21.15.71:0/249090730 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd2fc023070 con 0x7fd3080cbf30 2023-10-09T07:58:18.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.294+0000 7fd304ff9700 1 --2- 172.21.15.71:0/249090730 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd2ec066f30 0x7fd2ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:18.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.294+0000 7fd304ff9700 1 -- 172.21.15.71:0/249090730 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fd2fc085b70 con 0x7fd3080cbf30 2023-10-09T07:58:18.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.295+0000 7fd307fff700 1 --2- 172.21.15.71:0/249090730 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd2ec066f30 0x7fd2ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:18.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.295+0000 7fd307fff700 1 --2- 172.21.15.71:0/249090730 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd2ec066f30 0x7fd2ec0693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd3080ae000 tx=0x7fd2f40091a0 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:18.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.299+0000 7fd304ff9700 1 -- 172.21.15.71:0/249090730 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2fc052cf0 con 0x7fd3080cbf30 2023-10-09T07:58:18.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.503+0000 7fd30ebff700 1 -- 172.21.15.71:0/249090730 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd3080cc9a0 con 0x7fd3080cbf30 2023-10-09T07:58:18.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.987+0000 7fd304ff9700 1 -- 172.21.15.71:0/249090730 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v170) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd2fc015020 con 0x7fd3080cbf30 2023-10-09T07:58:18.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.990+0000 7fd30ebff700 1 -- 172.21.15.71:0/249090730 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd2ec066f30 msgr2=0x7fd2ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:18.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.990+0000 7fd30ebff700 1 --2- 172.21.15.71:0/249090730 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd2ec066f30 0x7fd2ec0693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd3080ae000 tx=0x7fd2f40091a0 comp rx=0 tx=0).stop 2023-10-09T07:58:18.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.990+0000 7fd30ebff700 1 -- 172.21.15.71:0/249090730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3080cbf30 msgr2=0x7fd3080cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:18.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.990+0000 7fd30ebff700 1 --2- 172.21.15.71:0/249090730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3080cbf30 0x7fd3080cb310 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0091e0 tx=0x7fd2fc017000 comp rx=0 tx=0).stop 2023-10-09T07:58:18.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.990+0000 7fd30ebff700 1 -- 172.21.15.71:0/249090730 shutdown_connections 2023-10-09T07:58:18.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.990+0000 7fd30ebff700 1 --2- 172.21.15.71:0/249090730 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd2ec066f30 0x7fd2ec0693e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:18.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.990+0000 7fd30ebff700 1 --2- 172.21.15.71:0/249090730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd30815a270 0x7fd308157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:18.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.990+0000 7fd30ebff700 1 --2- 172.21.15.71:0/249090730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3080cbf30 0x7fd3080cb310 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:18.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.990+0000 7fd30ebff700 1 --2- 172.21.15.71:0/249090730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3080ccf90 0x7fd308156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:18.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.990+0000 7fd30ebff700 1 -- 172.21.15.71:0/249090730 >> 172.21.15.71:0/249090730 conn(0x7fd30806a320 msgr2=0x7fd3080c9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:18.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.990+0000 7fd30ebff700 1 -- 172.21.15.71:0/249090730 shutdown_connections 2023-10-09T07:58:18.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:18.990+0000 7fd30ebff700 1 -- 172.21.15.71:0/249090730 wait complete. 2023-10-09T07:58:18.992 INFO:teuthology.orchestra.run.smithi071.stderr: removed all blocklist entries 2023-10-09T07:58:19.011 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T07:58:19.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.191+0000 7fde9a3ff700 1 Processor -- start 2023-10-09T07:58:19.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.191+0000 7fde9a3ff700 1 -- start start 2023-10-09T07:58:19.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.192+0000 7fde9a3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fde940cbf30 0x7fde940ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:19.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.192+0000 7fde9a3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde940b1420 0x7fde940c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:19.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.192+0000 7fde9a3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde940cc300 con 0x7fde940ccf90 2023-10-09T07:58:19.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.192+0000 7fde9a3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde94156bf0 con 0x7fde940cbf30 2023-10-09T07:58:19.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.192+0000 7fde9a3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde940ae950 con 0x7fde940b1420 2023-10-09T07:58:19.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.193+0000 7fde9899c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde940b1420 0x7fde940c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:19.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.193+0000 7fde93fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fde940cbf30 0x7fde940ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:19.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.193+0000 7fde9899c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde940b1420 0x7fde940c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:50230/0 (socket says 172.21.15.71:50230) 2023-10-09T07:58:19.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.193+0000 7fde9899c700 1 -- 172.21.15.71:0/1764153707 learned_addr learned my addr 172.21.15.71:0/1764153707 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:19.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.193+0000 7fde937fe700 1 --1- 172.21.15.71:0/1764153707 >> v1:172.21.15.179:6789/0 conn(0x7fde940ccf90 0x7fde940b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:52818/0 (socket says 172.21.15.71:52818) 2023-10-09T07:58:19.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.193+0000 7fde93fff700 1 -- 172.21.15.71:0/1764153707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde940b1420 msgr2=0x7fde940c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:19.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.193+0000 7fde93fff700 1 --2- 172.21.15.71:0/1764153707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde940b1420 0x7fde940c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:19.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.193+0000 7fde93fff700 1 -- 172.21.15.71:0/1764153707 >> v1:172.21.15.179:6789/0 conn(0x7fde940ccf90 legacy=0x7fde940b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:19.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.193+0000 7fde93fff700 1 -- 172.21.15.71:0/1764153707 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde940ad370 con 0x7fde940cbf30 2023-10-09T07:58:19.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.193+0000 7fde92ffd700 1 -- 172.21.15.71:0/1764153707 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283465868 0 0) 0x7fde940cc300 con 0x7fde940ccf90 2023-10-09T07:58:19.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.193+0000 7fde9899c700 1 --2- 172.21.15.71:0/1764153707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde940b1420 0x7fde940c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:58:19.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.194+0000 7fde93fff700 1 --2- 172.21.15.71:0/1764153707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde940cbf30 0x7fde940ae410 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fde84009910 tx=0x7fde840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3a8efb441811b18 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:19.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.194+0000 7fde92ffd700 1 -- 172.21.15.71:0/1764153707 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8400b640 con 0x7fde940cbf30 2023-10-09T07:58:19.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.194+0000 7fde92ffd700 1 -- 172.21.15.71:0/1764153707 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8400b7a0 con 0x7fde940cbf30 2023-10-09T07:58:19.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.194+0000 7fde92ffd700 1 -- 172.21.15.71:0/1764153707 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8400bb60 con 0x7fde940cbf30 2023-10-09T07:58:19.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.194+0000 7fde9a3ff700 1 -- 172.21.15.71:0/1764153707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde940cbf30 msgr2=0x7fde940ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:19.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.194+0000 7fde9a3ff700 1 --2- 172.21.15.71:0/1764153707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde940cbf30 0x7fde940ae410 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fde84009910 tx=0x7fde840091a0 comp rx=0 tx=0).stop 2023-10-09T07:58:19.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.194+0000 7fde9a3ff700 1 -- 172.21.15.71:0/1764153707 shutdown_connections 2023-10-09T07:58:19.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.194+0000 7fde9a3ff700 1 --2- 172.21.15.71:0/1764153707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde940b1420 0x7fde940c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:19.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.194+0000 7fde9a3ff700 1 --2- 172.21.15.71:0/1764153707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde940cbf30 0x7fde940ae410 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:19.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.194+0000 7fde9a3ff700 1 -- 172.21.15.71:0/1764153707 >> 172.21.15.71:0/1764153707 conn(0x7fde9406a320 msgr2=0x7fde940cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:19.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.195+0000 7fde9a3ff700 1 -- 172.21.15.71:0/1764153707 shutdown_connections 2023-10-09T07:58:19.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.195+0000 7fde9a3ff700 1 -- 172.21.15.71:0/1764153707 wait complete. 2023-10-09T07:58:19.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.196+0000 7fde9a3ff700 1 Processor -- start 2023-10-09T07:58:19.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.196+0000 7fde9a3ff700 1 -- start start 2023-10-09T07:58:19.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.197+0000 7fde9a3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde940b1420 0x7fde94146260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:19.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.197+0000 7fde9a3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde940cbf30 0x7fde94145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:19.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.197+0000 7fde9a3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde940ccf90 0x7fde941458c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:19.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.197+0000 7fde9a3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde94142ab0 con 0x7fde940b1420 2023-10-09T07:58:19.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.197+0000 7fde9a3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde94144ef0 con 0x7fde940ccf90 2023-10-09T07:58:19.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.197+0000 7fde9a3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde940a6790 con 0x7fde940cbf30 2023-10-09T07:58:19.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.197+0000 7fde93fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde940b1420 0x7fde94146260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:19.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.197+0000 7fde93fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde940b1420 0x7fde94146260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34092/0 (socket says 172.21.15.71:34092) 2023-10-09T07:58:19.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.197+0000 7fde93fff700 1 -- 172.21.15.71:0/1338406349 learned_addr learned my addr 172.21.15.71:0/1338406349 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:19.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.197+0000 7fde937fe700 1 --2- 172.21.15.71:0/1338406349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde940cbf30 0x7fde94145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:19.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.197+0000 7fde9899c700 1 --2- 172.21.15.71:0/1338406349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde940ccf90 0x7fde941458c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:19.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.198+0000 7fde93fff700 1 -- 172.21.15.71:0/1338406349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde940cbf30 msgr2=0x7fde94145380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:19.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.198+0000 7fde93fff700 1 --2- 172.21.15.71:0/1338406349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde940cbf30 0x7fde94145380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:19.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.198+0000 7fde93fff700 1 -- 172.21.15.71:0/1338406349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde940ccf90 msgr2=0x7fde941458c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:19.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.198+0000 7fde93fff700 1 --2- 172.21.15.71:0/1338406349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde940ccf90 0x7fde941458c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:19.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.198+0000 7fde93fff700 1 -- 172.21.15.71:0/1338406349 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8c009ae0 con 0x7fde940b1420 2023-10-09T07:58:19.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.198+0000 7fde93fff700 1 --2- 172.21.15.71:0/1338406349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde940b1420 0x7fde94146260 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fde84003020 tx=0x7fde84017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:19.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.198+0000 7fde7bfff700 1 -- 172.21.15.71:0/1338406349 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8401f070 con 0x7fde940b1420 2023-10-09T07:58:19.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.198+0000 7fde7bfff700 1 -- 172.21.15.71:0/1338406349 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8400b910 con 0x7fde940b1420 2023-10-09T07:58:19.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.198+0000 7fde9a3ff700 1 -- 172.21.15.71:0/1338406349 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde84009420 con 0x7fde940b1420 2023-10-09T07:58:19.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.198+0000 7fde7bfff700 1 -- 172.21.15.71:0/1338406349 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde84023430 con 0x7fde940b1420 2023-10-09T07:58:19.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.198+0000 7fde9a3ff700 1 -- 172.21.15.71:0/1338406349 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde941445c0 con 0x7fde940b1420 2023-10-09T07:58:19.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.199+0000 7fde9a3ff700 1 -- 172.21.15.71:0/1338406349 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde9404c3c0 con 0x7fde940b1420 2023-10-09T07:58:19.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.200+0000 7fde7bfff700 1 -- 172.21.15.71:0/1338406349 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde84023840 con 0x7fde940b1420 2023-10-09T07:58:19.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.202+0000 7fde7bfff700 1 --2- 172.21.15.71:0/1338406349 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fde80066f30 0x7fde800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:19.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.202+0000 7fde7bfff700 1 -- 172.21.15.71:0/1338406349 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5317+0+0 (secure 0 0 0) 0x7fde840856e0 con 0x7fde940b1420 2023-10-09T07:58:19.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.202+0000 7fde937fe700 1 --2- 172.21.15.71:0/1338406349 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fde80066f30 0x7fde800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:19.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.203+0000 7fde937fe700 1 --2- 172.21.15.71:0/1338406349 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fde80066f30 0x7fde800693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fde940a7170 tx=0x7fde88007ef0 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:19.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.206+0000 7fde7bfff700 1 -- 172.21.15.71:0/1338406349 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde84052a30 con 0x7fde940b1420 2023-10-09T07:58:19.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.470+0000 7fde9a3ff700 1 -- 172.21.15.71:0/1338406349 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fde940ad650 con 0x7fde940b1420 2023-10-09T07:58:19.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.470+0000 7fde7bfff700 1 -- 172.21.15.71:0/1338406349 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v40) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fde84056050 con 0x7fde940b1420 2023-10-09T07:58:19.471 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:58:19.472 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T07:58:19.472 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_dump": [ 2023-10-09T07:58:19.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:58:19.472 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.a", 2023-10-09T07:58:19.472 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlpI5JCRAAGBgrs6g+6KZFXv1eq0fkwQ==", 2023-10-09T07:58:19.472 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:58:19.472 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:58:19.472 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T07:58:19.472 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T07:58:19.472 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:58:19.472 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:58:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:58:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:58:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.b", 2023-10-09T07:58:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlDZQYHhAA2LGKHPLrBVKlGMK0TKup7A==", 2023-10-09T07:58:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:58:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:58:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T07:58:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T07:58:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:58:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:58:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:58:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:58:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.c", 2023-10-09T07:58:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlLKKfExAA65+KIyYd16iQ2L5topDPkg==", 2023-10-09T07:58:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:58:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:58:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T07:58:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T07:58:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:58:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:58:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:58:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:58:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.d", 2023-10-09T07:58:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlpQKTKBAAP59h/znElthIdqbK9tKJww==", 2023-10-09T07:58:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:58:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:58:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T07:58:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T07:58:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:58:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:58:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:58:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:58:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.0", 2023-10-09T07:58:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCgoCNll7hBIBAAtZ8mBx+MPAwEou48boP4Hw==", 2023-10-09T07:58:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:58:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:58:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:58:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:58:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:58:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:58:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:58:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.1", 2023-10-09T07:58:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCjoCNl7uRMIxAAztQi4ZsulyN2FHcMRzZ82Q==", 2023-10-09T07:58:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:58:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:58:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:58:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:58:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:58:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:58:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:58:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.2", 2023-10-09T07:58:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCmoCNlW/cNJhAAfFdnRC95YJwpCngJS956cA==", 2023-10-09T07:58:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:58:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:58:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:58:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:58:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:58:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:58:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:58:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.3", 2023-10-09T07:58:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCpoCNlAIlYKRAAD5IGHWZ14ckpQAU4wBifbg==", 2023-10-09T07:58:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:58:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:58:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:58:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:58:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:58:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:58:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:58:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.4", 2023-10-09T07:58:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCvoCNltrA4ORAAtifmL9hr1xKd+jsMf5Nf+Q==", 2023-10-09T07:58:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:58:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:58:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:58:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:58:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:58:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:58:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:58:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.5", 2023-10-09T07:58:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCyoCNlA/IOOxAAQWRPQ+00o9xrpScAvY/87w==", 2023-10-09T07:58:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:58:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:58:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:58:19.480 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:58:19.480 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:58:19.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:58:19.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:58:19.480 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.6", 2023-10-09T07:58:19.480 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQC2oCNlvRusARAAcRaGyCROIRVTHeKhrncN8g==", 2023-10-09T07:58:19.480 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:58:19.480 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:58:19.480 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:58:19.480 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:58:19.480 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:58:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:58:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:58:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.7", 2023-10-09T07:58:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQC5oCNli/3NAxAAIMYuED41ZSx1xF384N6y1A==", 2023-10-09T07:58:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:58:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T07:58:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T07:58:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:58:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:58:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:58:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:58:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.0", 2023-10-09T07:58:19.482 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlHrKWMRAAyIfmryGSgqIFwWEJyixprw==", 2023-10-09T07:58:19.482 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:58:19.482 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:58:19.482 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow r", 2023-10-09T07:58:19.482 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T07:58:19.482 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:58:19.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:58:19.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:58:19.482 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.1", 2023-10-09T07:58:19.482 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCdoCNldq1xAxAAxCpmelS0qDEY187u19JkcQ==", 2023-10-09T07:58:19.482 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:58:19.483 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:58:19.483 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T07:58:19.483 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T07:58:19.483 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T07:58:19.483 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:58:19.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:58:19.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:58:19.483 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.2", 2023-10-09T07:58:19.483 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlM3JHOBAA8fszREXH+WnYb+3vIaakcA==", 2023-10-09T07:58:19.483 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:58:19.483 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:58:19.483 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T07:58:19.484 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T07:58:19.484 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T07:58:19.484 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:58:19.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:58:19.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:58:19.484 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.3", 2023-10-09T07:58:19.484 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCdoCNlgkEqChAAwntdv9UOo30x40pVa70yag==", 2023-10-09T07:58:19.484 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:58:19.484 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T07:58:19.484 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T07:58:19.484 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T07:58:19.484 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T07:58:19.485 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:58:19.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:58:19.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:58:19.485 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.admin", 2023-10-09T07:58:19.485 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCboCNlj2W4EhAAUnfX6NBeDyMj2nY/G2ciEg==", 2023-10-09T07:58:19.485 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:58:19.485 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T07:58:19.485 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T07:58:19.485 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T07:58:19.485 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:58:19.485 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:58:19.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:58:19.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:58:19.486 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.x", 2023-10-09T07:58:19.486 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlwwJ/AhAAjHMhAX1/yWgh9no7yQqP6Q==", 2023-10-09T07:58:19.486 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:58:19.486 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T07:58:19.486 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-09T07:58:19.486 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:58:19.486 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:58:19.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T07:58:19.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:58:19.486 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.y", 2023-10-09T07:58:19.487 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCboCNly/XVNRAAlKr9arCbsDbzZ9bpIU5dng==", 2023-10-09T07:58:19.487 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T07:58:19.487 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T07:58:19.487 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-09T07:58:19.487 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T07:58:19.487 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:58:19.487 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:58:19.487 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2023-10-09T07:58:19.487 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T07:58:19.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.473+0000 7fde9a3ff700 1 -- 172.21.15.71:0/1338406349 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fde80066f30 msgr2=0x7fde800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:19.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.473+0000 7fde9a3ff700 1 --2- 172.21.15.71:0/1338406349 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fde80066f30 0x7fde800693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fde940a7170 tx=0x7fde88007ef0 comp rx=0 tx=0).stop 2023-10-09T07:58:19.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.473+0000 7fde9a3ff700 1 -- 172.21.15.71:0/1338406349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde940b1420 msgr2=0x7fde94146260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:19.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.473+0000 7fde9a3ff700 1 --2- 172.21.15.71:0/1338406349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde940b1420 0x7fde94146260 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fde84003020 tx=0x7fde84017000 comp rx=0 tx=0).stop 2023-10-09T07:58:19.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.473+0000 7fde9a3ff700 1 -- 172.21.15.71:0/1338406349 shutdown_connections 2023-10-09T07:58:19.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.473+0000 7fde9a3ff700 1 --2- 172.21.15.71:0/1338406349 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fde80066f30 0x7fde800693e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:19.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.473+0000 7fde9a3ff700 1 --2- 172.21.15.71:0/1338406349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde940ccf90 0x7fde941458c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:19.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.473+0000 7fde9a3ff700 1 --2- 172.21.15.71:0/1338406349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde940b1420 0x7fde94146260 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:19.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.473+0000 7fde9a3ff700 1 --2- 172.21.15.71:0/1338406349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde940cbf30 0x7fde94145380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:19.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.473+0000 7fde9a3ff700 1 -- 172.21.15.71:0/1338406349 >> 172.21.15.71:0/1338406349 conn(0x7fde9406a320 msgr2=0x7fde94159020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:19.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.473+0000 7fde9a3ff700 1 -- 172.21.15.71:0/1338406349 shutdown_connections 2023-10-09T07:58:19.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.473+0000 7fde9a3ff700 1 -- 172.21.15.71:0/1338406349 wait complete. 2023-10-09T07:58:19.491 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:58:19.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.673+0000 7feab9dff700 1 Processor -- start 2023-10-09T07:58:19.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.673+0000 7feab9dff700 1 -- start start 2023-10-09T07:58:19.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.675+0000 7feab9dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab40cbf30 0x7feab40ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:19.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.675+0000 7feab9dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7feab40ccf90 0x7feab40b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:19.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.675+0000 7feab9dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feab415a270 0x7feab40b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:19.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.675+0000 7feab9dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab4156bf0 con 0x7feab40ccf90 2023-10-09T07:58:19.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.675+0000 7feab9dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab40ae950 con 0x7feab415a270 2023-10-09T07:58:19.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.675+0000 7feab9dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab40cc300 con 0x7feab40cbf30 2023-10-09T07:58:19.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.675+0000 7feab2ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7feab40ccf90 0x7feab40b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:19.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.675+0000 7feab2ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7feab40ccf90 0x7feab40b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34104/0 (socket says 172.21.15.71:34104) 2023-10-09T07:58:19.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.675+0000 7feab2ffd700 1 -- 172.21.15.71:0/2566742053 learned_addr learned my addr 172.21.15.71:0/2566742053 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:19.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.675+0000 7feab37fe700 1 --2- 172.21.15.71:0/2566742053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab40cbf30 0x7feab40ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:19.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.675+0000 7feab3fff700 1 --2- 172.21.15.71:0/2566742053 >> v2:172.21.15.179:3300/0 conn(0x7feab415a270 0x7feab40b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:19.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.675+0000 7feab2ffd700 1 -- 172.21.15.71:0/2566742053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab40cbf30 msgr2=0x7feab40ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:19.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.675+0000 7feab2ffd700 1 --2- 172.21.15.71:0/2566742053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab40cbf30 0x7feab40ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:19.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.675+0000 7feab2ffd700 1 -- 172.21.15.71:0/2566742053 >> v2:172.21.15.179:3300/0 conn(0x7feab415a270 msgr2=0x7feab40b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:19.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.675+0000 7feab2ffd700 1 --2- 172.21.15.71:0/2566742053 >> v2:172.21.15.179:3300/0 conn(0x7feab415a270 0x7feab40b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:19.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.675+0000 7feab2ffd700 1 -- 172.21.15.71:0/2566742053 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab40ad370 con 0x7feab40ccf90 2023-10-09T07:58:19.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.676+0000 7feab2ffd700 1 --2- 172.21.15.71:0/2566742053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feab40ccf90 0x7feab40b0d10 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7feab40b25e0 tx=0x7feaa8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6e9f33517319ef server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:19.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.676+0000 7feab27fc700 1 -- 172.21.15.71:0/2566742053 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa800b820 con 0x7feab40ccf90 2023-10-09T07:58:19.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.676+0000 7feab27fc700 1 -- 172.21.15.71:0/2566742053 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa800b980 con 0x7feab40ccf90 2023-10-09T07:58:19.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.676+0000 7feab27fc700 1 -- 172.21.15.71:0/2566742053 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa800bd20 con 0x7feab40ccf90 2023-10-09T07:58:19.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.676+0000 7feab9dff700 1 -- 172.21.15.71:0/2566742053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feab40ccf90 msgr2=0x7feab40b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:19.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.676+0000 7feab9dff700 1 --2- 172.21.15.71:0/2566742053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feab40ccf90 0x7feab40b0d10 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7feab40b25e0 tx=0x7feaa8009250 comp rx=0 tx=0).stop 2023-10-09T07:58:19.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.676+0000 7feab9dff700 1 -- 172.21.15.71:0/2566742053 shutdown_connections 2023-10-09T07:58:19.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.676+0000 7feab9dff700 1 --2- 172.21.15.71:0/2566742053 >> v2:172.21.15.179:3300/0 conn(0x7feab415a270 0x7feab40b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:19.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.676+0000 7feab9dff700 1 --2- 172.21.15.71:0/2566742053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab40cbf30 0x7feab40ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:19.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.676+0000 7feab9dff700 1 --2- 172.21.15.71:0/2566742053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feab40ccf90 0x7feab40b0d10 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:19.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.676+0000 7feab9dff700 1 -- 172.21.15.71:0/2566742053 >> 172.21.15.71:0/2566742053 conn(0x7feab406a320 msgr2=0x7feab40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:19.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.677+0000 7feab9dff700 1 -- 172.21.15.71:0/2566742053 shutdown_connections 2023-10-09T07:58:19.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.677+0000 7feab9dff700 1 -- 172.21.15.71:0/2566742053 wait complete. 2023-10-09T07:58:19.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.678+0000 7feab9dff700 1 Processor -- start 2023-10-09T07:58:19.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.678+0000 7feab9dff700 1 -- start start 2023-10-09T07:58:19.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.679+0000 7feab9dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab40cbf30 0x7feab4168b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:19.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.679+0000 7feab9dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feab40ccf90 0x7feab40c2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:19.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.679+0000 7feab9dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feab415a270 0x7feab406eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:19.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.679+0000 7feab9dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab40c6fd0 con 0x7feab415a270 2023-10-09T07:58:19.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.679+0000 7feab9dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab41690c0 con 0x7feab40ccf90 2023-10-09T07:58:19.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.679+0000 7feab9dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab40c6070 con 0x7feab40cbf30 2023-10-09T07:58:19.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.679+0000 7feab3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feab415a270 0x7feab406eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:19.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.679+0000 7feab3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feab415a270 0x7feab406eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34120/0 (socket says 172.21.15.71:34120) 2023-10-09T07:58:19.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.679+0000 7feab3fff700 1 -- 172.21.15.71:0/2990484432 learned_addr learned my addr 172.21.15.71:0/2990484432 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:19.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.679+0000 7feab2ffd700 1 --2- 172.21.15.71:0/2990484432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feab40ccf90 0x7feab40c2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:19.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.679+0000 7feab37fe700 1 --2- 172.21.15.71:0/2990484432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab40cbf30 0x7feab4168b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:19.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.680+0000 7feab3fff700 1 -- 172.21.15.71:0/2990484432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab40cbf30 msgr2=0x7feab4168b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:19.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.680+0000 7feab3fff700 1 --2- 172.21.15.71:0/2990484432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab40cbf30 0x7feab4168b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:19.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.680+0000 7feab3fff700 1 -- 172.21.15.71:0/2990484432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feab40ccf90 msgr2=0x7feab40c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:19.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.680+0000 7feab3fff700 1 --2- 172.21.15.71:0/2990484432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feab40ccf90 0x7feab40c2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:19.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.680+0000 7feab3fff700 1 -- 172.21.15.71:0/2990484432 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa80094f0 con 0x7feab415a270 2023-10-09T07:58:19.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.680+0000 7feab3fff700 1 --2- 172.21.15.71:0/2990484432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feab415a270 0x7feab406eb80 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7feaac009fa0 tx=0x7feaac009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:19.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.680+0000 7fea9b7fe700 1 -- 172.21.15.71:0/2990484432 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac00ebc0 con 0x7feab415a270 2023-10-09T07:58:19.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.680+0000 7fea9b7fe700 1 -- 172.21.15.71:0/2990484432 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac00ed20 con 0x7feab415a270 2023-10-09T07:58:19.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.680+0000 7fea9b7fe700 1 -- 172.21.15.71:0/2990484432 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac014670 con 0x7feab415a270 2023-10-09T07:58:19.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.680+0000 7feab9dff700 1 -- 172.21.15.71:0/2990484432 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab40c6350 con 0x7feab415a270 2023-10-09T07:58:19.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.680+0000 7feab9dff700 1 -- 172.21.15.71:0/2990484432 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab40c6910 con 0x7feab415a270 2023-10-09T07:58:19.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.681+0000 7feab9dff700 1 -- 172.21.15.71:0/2990484432 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab40c7110 con 0x7feab415a270 2023-10-09T07:58:19.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.682+0000 7fea9b7fe700 1 -- 172.21.15.71:0/2990484432 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feaac0149e0 con 0x7feab415a270 2023-10-09T07:58:19.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.683+0000 7fea9b7fe700 1 --2- 172.21.15.71:0/2990484432 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7feaa0066f30 0x7feaa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:19.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.683+0000 7fea9b7fe700 1 -- 172.21.15.71:0/2990484432 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5317+0+0 (secure 0 0 0) 0x7feaac084ab0 con 0x7feab415a270 2023-10-09T07:58:19.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.683+0000 7feab37fe700 1 --2- 172.21.15.71:0/2990484432 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7feaa0066f30 0x7feaa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:19.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.685+0000 7feab37fe700 1 --2- 172.21.15.71:0/2990484432 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7feaa0066f30 0x7feaa00693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feaa4006fd0 tx=0x7feaa4008040 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:19.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.687+0000 7fea9b7fe700 1 -- 172.21.15.71:0/2990484432 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feaac051e00 con 0x7feab415a270 2023-10-09T07:58:19.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.876+0000 7feab9dff700 1 -- 172.21.15.71:0/2990484432 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feab404c3c0 con 0x7feab415a270 2023-10-09T07:58:19.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.877+0000 7fea9b7fe700 1 -- 172.21.15.71:0/2990484432 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+12854 (secure 0 0 0) 0x7feaac055420 con 0x7feab415a270 2023-10-09T07:58:19.878 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:58:19.878 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":172,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:58:18.993424+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:58:19.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.880+0000 7feab9dff700 1 -- 172.21.15.71:0/2990484432 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7feaa0066f30 msgr2=0x7feaa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:19.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.880+0000 7feab9dff700 1 --2- 172.21.15.71:0/2990484432 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7feaa0066f30 0x7feaa00693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feaa4006fd0 tx=0x7feaa4008040 comp rx=0 tx=0).stop 2023-10-09T07:58:19.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.880+0000 7feab9dff700 1 -- 172.21.15.71:0/2990484432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feab415a270 msgr2=0x7feab406eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:19.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.880+0000 7feab9dff700 1 --2- 172.21.15.71:0/2990484432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feab415a270 0x7feab406eb80 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7feaac009fa0 tx=0x7feaac009900 comp rx=0 tx=0).stop 2023-10-09T07:58:19.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.880+0000 7feab9dff700 1 -- 172.21.15.71:0/2990484432 shutdown_connections 2023-10-09T07:58:19.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.880+0000 7feab9dff700 1 --2- 172.21.15.71:0/2990484432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feab415a270 0x7feab406eb80 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:19.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.880+0000 7feab9dff700 1 --2- 172.21.15.71:0/2990484432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab40cbf30 0x7feab4168b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:19.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.880+0000 7feab9dff700 1 --2- 172.21.15.71:0/2990484432 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7feaa0066f30 0x7feaa00693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:19.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.880+0000 7feab9dff700 1 --2- 172.21.15.71:0/2990484432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feab40ccf90 0x7feab40c2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:19.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.880+0000 7feab9dff700 1 -- 172.21.15.71:0/2990484432 >> 172.21.15.71:0/2990484432 conn(0x7feab406a320 msgr2=0x7feab4158d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:19.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.880+0000 7feab9dff700 1 -- 172.21.15.71:0/2990484432 shutdown_connections 2023-10-09T07:58:19.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:19.880+0000 7feab9dff700 1 -- 172.21.15.71:0/2990484432 wait complete. 2023-10-09T07:58:19.898 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T07:58:19.898 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T07:58:20.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.083+0000 7fb0a9d9d700 1 Processor -- start 2023-10-09T07:58:20.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.083+0000 7fb0a9d9d700 1 -- start start 2023-10-09T07:58:20.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.084+0000 7fb0a9d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb0a4153900 0x7fb0a40c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:20.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.084+0000 7fb0a9d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0a40c9db0 0x7fb0a406a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:20.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.084+0000 7fb0a9d9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a406e150 con 0x7fb0a4157130 2023-10-09T07:58:20.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.084+0000 7fb0a9d9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a40c7800 con 0x7fb0a4153900 2023-10-09T07:58:20.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.084+0000 7fb0a9d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40c7ae0 con 0x7fb0a40c9db0 2023-10-09T07:58:20.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.084+0000 7fb0a8d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb0a4153900 0x7fb0a40c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:20.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.085+0000 7fb0a959c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb0a4157130 0x7fb0a4159ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34412/0 (socket says 172.21.15.71:34412) 2023-10-09T07:58:20.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.085+0000 7fb0a959c700 1 -- 172.21.15.71:0/3604112017 learned_addr learned my addr 172.21.15.71:0/3604112017 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:20.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.085+0000 7fb0a3fff700 1 --2- 172.21.15.71:0/3604112017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0a40c9db0 0x7fb0a406a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:20.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.085+0000 7fb0a8d9b700 1 -- 172.21.15.71:0/3604112017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0a40c9db0 msgr2=0x7fb0a406a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:20.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.085+0000 7fb0a8d9b700 1 --2- 172.21.15.71:0/3604112017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0a40c9db0 0x7fb0a406a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.085+0000 7fb0a8d9b700 1 -- 172.21.15.71:0/3604112017 >> v1:172.21.15.71:6789/0 conn(0x7fb0a4157130 legacy=0x7fb0a4159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:20.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.085+0000 7fb0a8d9b700 1 -- 172.21.15.71:0/3604112017 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a40c7dc0 con 0x7fb0a4153900 2023-10-09T07:58:20.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.085+0000 7fb0a37fe700 1 -- 172.21.15.71:0/3604112017 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877566979 0 0) 0x7fb0a406e150 con 0x7fb0a4157130 2023-10-09T07:58:20.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.085+0000 7fb0a8d9b700 1 --2- 172.21.15.71:0/3604112017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0a4153900 0x7fb0a40c6f00 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fb09800aa90 tx=0x7fb09800a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6bb5745afd3db75 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:20.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.085+0000 7fb0a37fe700 1 -- 172.21.15.71:0/3604112017 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09800ca40 con 0x7fb0a4153900 2023-10-09T07:58:20.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.085+0000 7fb0a37fe700 1 -- 172.21.15.71:0/3604112017 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09800cba0 con 0x7fb0a4153900 2023-10-09T07:58:20.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.085+0000 7fb0a37fe700 1 -- 172.21.15.71:0/3604112017 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb098018400 con 0x7fb0a4153900 2023-10-09T07:58:20.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.086+0000 7fb0a9d9d700 1 -- 172.21.15.71:0/3604112017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0a4153900 msgr2=0x7fb0a40c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:20.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.086+0000 7fb0a9d9d700 1 --2- 172.21.15.71:0/3604112017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0a4153900 0x7fb0a40c6f00 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fb09800aa90 tx=0x7fb09800a330 comp rx=0 tx=0).stop 2023-10-09T07:58:20.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.086+0000 7fb0a9d9d700 1 -- 172.21.15.71:0/3604112017 shutdown_connections 2023-10-09T07:58:20.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.086+0000 7fb0a9d9d700 1 --2- 172.21.15.71:0/3604112017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0a4153900 0x7fb0a40c6f00 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.086+0000 7fb0a9d9d700 1 --2- 172.21.15.71:0/3604112017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0a40c9db0 0x7fb0a406a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.086+0000 7fb0a9d9d700 1 -- 172.21.15.71:0/3604112017 >> 172.21.15.71:0/3604112017 conn(0x7fb0a40cc1e0 msgr2=0x7fb0a40cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:20.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.086+0000 7fb0a9d9d700 1 -- 172.21.15.71:0/3604112017 shutdown_connections 2023-10-09T07:58:20.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.086+0000 7fb0a9d9d700 1 -- 172.21.15.71:0/3604112017 wait complete. 2023-10-09T07:58:20.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.087+0000 7fb0a9d9d700 1 Processor -- start 2023-10-09T07:58:20.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.088+0000 7fb0a9d9d700 1 -- start start 2023-10-09T07:58:20.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.088+0000 7fb0a9d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0a40c9db0 0x7fb0a40b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:20.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.088+0000 7fb0a9d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0a4153900 0x7fb0a40b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:20.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.089+0000 7fb0a9d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0a4157130 0x7fb0a40b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:20.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.089+0000 7fb0a9d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40ad5a0 con 0x7fb0a4153900 2023-10-09T07:58:20.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.089+0000 7fb0a9d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a4157600 con 0x7fb0a4157130 2023-10-09T07:58:20.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.089+0000 7fb0a9d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40ad7f0 con 0x7fb0a40c9db0 2023-10-09T07:58:20.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.089+0000 7fb0a3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0a4153900 0x7fb0a40b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:20.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.089+0000 7fb0a3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0a4153900 0x7fb0a40b06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34142/0 (socket says 172.21.15.71:34142) 2023-10-09T07:58:20.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.089+0000 7fb0a3fff700 1 -- 172.21.15.71:0/1691000559 learned_addr learned my addr 172.21.15.71:0/1691000559 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:20.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.089+0000 7fb0a959c700 1 --2- 172.21.15.71:0/1691000559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0a4157130 0x7fb0a40b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:20.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.089+0000 7fb0a8d9b700 1 --2- 172.21.15.71:0/1691000559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0a40c9db0 0x7fb0a40b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:20.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.089+0000 7fb0a3fff700 1 -- 172.21.15.71:0/1691000559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0a40c9db0 msgr2=0x7fb0a40b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:20.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.089+0000 7fb0a3fff700 1 --2- 172.21.15.71:0/1691000559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0a40c9db0 0x7fb0a40b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.089+0000 7fb0a3fff700 1 -- 172.21.15.71:0/1691000559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0a4157130 msgr2=0x7fb0a40b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:20.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.089+0000 7fb0a3fff700 1 --2- 172.21.15.71:0/1691000559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0a4157130 0x7fb0a40b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.089+0000 7fb0a3fff700 1 -- 172.21.15.71:0/1691000559 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09800a5d0 con 0x7fb0a4153900 2023-10-09T07:58:20.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.089+0000 7fb0a3fff700 1 --2- 172.21.15.71:0/1691000559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0a4153900 0x7fb0a40b06a0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fb09000d860 tx=0x7fb090008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:20.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.090+0000 7fb0a0ff9700 1 -- 172.21.15.71:0/1691000559 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb090009610 con 0x7fb0a4153900 2023-10-09T07:58:20.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.090+0000 7fb0a0ff9700 1 -- 172.21.15.71:0/1691000559 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb090009770 con 0x7fb0a4153900 2023-10-09T07:58:20.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.090+0000 7fb0a9d9d700 1 -- 172.21.15.71:0/1691000559 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a40adad0 con 0x7fb0a4153900 2023-10-09T07:58:20.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.090+0000 7fb0a0ff9700 1 -- 172.21.15.71:0/1691000559 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb090009b30 con 0x7fb0a4153900 2023-10-09T07:58:20.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.090+0000 7fb0a9d9d700 1 -- 172.21.15.71:0/1691000559 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a40ae090 con 0x7fb0a4153900 2023-10-09T07:58:20.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.091+0000 7fb0a9d9d700 1 -- 172.21.15.71:0/1691000559 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a4157770 con 0x7fb0a4153900 2023-10-09T07:58:20.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.092+0000 7fb0a0ff9700 1 -- 172.21.15.71:0/1691000559 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb09001e460 con 0x7fb0a4153900 2023-10-09T07:58:20.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.093+0000 7fb0a0ff9700 1 --2- 172.21.15.71:0/1691000559 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb088066f30 0x7fb0880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:20.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.093+0000 7fb0a0ff9700 1 -- 172.21.15.71:0/1691000559 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5317+0+0 (secure 0 0 0) 0x7fb0900849d0 con 0x7fb0a4153900 2023-10-09T07:58:20.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.093+0000 7fb0a8d9b700 1 --2- 172.21.15.71:0/1691000559 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb088066f30 0x7fb0880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:20.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.094+0000 7fb0a8d9b700 1 --2- 172.21.15.71:0/1691000559 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb088066f30 0x7fb0880693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb09800a5a0 tx=0x7fb09801a000 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:20.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.097+0000 7fb0a0ff9700 1 -- 172.21.15.71:0/1691000559 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb090051dc0 con 0x7fb0a4153900 2023-10-09T07:58:20.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.287+0000 7fb0a9d9d700 1 -- 172.21.15.71:0/1691000559 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb0a406dd20 con 0x7fb0a4153900 2023-10-09T07:58:20.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.288+0000 7fb0a0ff9700 1 -- 172.21.15.71:0/1691000559 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v172) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0900553e0 con 0x7fb0a4153900 2023-10-09T07:58:20.289 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T07:58:20.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.291+0000 7fb0a9d9d700 1 -- 172.21.15.71:0/1691000559 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb088066f30 msgr2=0x7fb0880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:20.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.291+0000 7fb0a9d9d700 1 --2- 172.21.15.71:0/1691000559 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb088066f30 0x7fb0880693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb09800a5a0 tx=0x7fb09801a000 comp rx=0 tx=0).stop 2023-10-09T07:58:20.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.291+0000 7fb0a9d9d700 1 -- 172.21.15.71:0/1691000559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0a4153900 msgr2=0x7fb0a40b06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:20.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.291+0000 7fb0a9d9d700 1 --2- 172.21.15.71:0/1691000559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0a4153900 0x7fb0a40b06a0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fb09000d860 tx=0x7fb090008040 comp rx=0 tx=0).stop 2023-10-09T07:58:20.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.291+0000 7fb0a9d9d700 1 -- 172.21.15.71:0/1691000559 shutdown_connections 2023-10-09T07:58:20.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.291+0000 7fb0a9d9d700 1 --2- 172.21.15.71:0/1691000559 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fb088066f30 0x7fb0880693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.291+0000 7fb0a9d9d700 1 --2- 172.21.15.71:0/1691000559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0a4157130 0x7fb0a40b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.291+0000 7fb0a9d9d700 1 --2- 172.21.15.71:0/1691000559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0a40c9db0 0x7fb0a40b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.291+0000 7fb0a9d9d700 1 --2- 172.21.15.71:0/1691000559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0a4153900 0x7fb0a40b06a0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.291+0000 7fb0a9d9d700 1 -- 172.21.15.71:0/1691000559 >> 172.21.15.71:0/1691000559 conn(0x7fb0a40cc1e0 msgr2=0x7fb0a40aa970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:20.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.291+0000 7fb0a9d9d700 1 -- 172.21.15.71:0/1691000559 shutdown_connections 2023-10-09T07:58:20.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.291+0000 7fb0a9d9d700 1 -- 172.21.15.71:0/1691000559 wait complete. 2023-10-09T07:58:20.309 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T07:58:20.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.489+0000 7febc71ff700 1 Processor -- start 2023-10-09T07:58:20.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.489+0000 7febc71ff700 1 -- start start 2023-10-09T07:58:20.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.491+0000 7febc71ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc0155c10 0x7febc0155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:20.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.491+0000 7febc71ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7febc00ac230 0x7febc00ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:20.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.491+0000 7febc71ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc00ad930 con 0x7febc00ccc40 2023-10-09T07:58:20.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.491+0000 7febc71ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc00acd20 con 0x7febc00ac230 2023-10-09T07:58:20.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.491+0000 7febc71ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc00ad000 con 0x7febc0155c10 2023-10-09T07:58:20.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.491+0000 7febbffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7febc00ac230 0x7febc00ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:20.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.491+0000 7febbffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7febc00ac230 0x7febc00ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34156/0 (socket says 172.21.15.71:34156) 2023-10-09T07:58:20.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.491+0000 7febbffff700 1 -- 172.21.15.71:0/3527986437 learned_addr learned my addr 172.21.15.71:0/3527986437 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:20.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.491+0000 7febc4f9b700 1 --2- 172.21.15.71:0/3527986437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc0155c10 0x7febc0155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:20.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.492+0000 7febbffff700 1 -- 172.21.15.71:0/3527986437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc0155c10 msgr2=0x7febc0155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:20.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.492+0000 7febbffff700 1 --2- 172.21.15.71:0/3527986437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc0155c10 0x7febc0155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.492+0000 7febbffff700 1 -- 172.21.15.71:0/3527986437 >> v1:172.21.15.179:6789/0 conn(0x7febc00ccc40 legacy=0x7febc00af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:20.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.492+0000 7febbffff700 1 -- 172.21.15.71:0/3527986437 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc00ad2e0 con 0x7febc00ac230 2023-10-09T07:58:20.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.492+0000 7febbffff700 1 --2- 172.21.15.71:0/3527986437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febc00ac230 0x7febc00ac6a0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7febac0099b0 tx=0x7febac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98133b484ce7a3fe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:20.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.492+0000 7febbf7fe700 1 -- 172.21.15.71:0/3527986437 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac009ea0 con 0x7febc00ac230 2023-10-09T07:58:20.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.492+0000 7febbf7fe700 1 -- 172.21.15.71:0/3527986437 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febac00b860 con 0x7febc00ac230 2023-10-09T07:58:20.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.492+0000 7febbf7fe700 1 -- 172.21.15.71:0/3527986437 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac00bc00 con 0x7febc00ac230 2023-10-09T07:58:20.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.493+0000 7febc71ff700 1 -- 172.21.15.71:0/3527986437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febc00ac230 msgr2=0x7febc00ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:20.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.493+0000 7febc71ff700 1 --2- 172.21.15.71:0/3527986437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febc00ac230 0x7febc00ac6a0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7febac0099b0 tx=0x7febac009250 comp rx=0 tx=0).stop 2023-10-09T07:58:20.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.493+0000 7febc71ff700 1 -- 172.21.15.71:0/3527986437 shutdown_connections 2023-10-09T07:58:20.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.493+0000 7febc71ff700 1 --2- 172.21.15.71:0/3527986437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc0155c10 0x7febc0155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.493+0000 7febc71ff700 1 --2- 172.21.15.71:0/3527986437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febc00ac230 0x7febc00ac6a0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.493+0000 7febc71ff700 1 -- 172.21.15.71:0/3527986437 >> 172.21.15.71:0/3527986437 conn(0x7febc006a320 msgr2=0x7febc00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:20.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.493+0000 7febc71ff700 1 -- 172.21.15.71:0/3527986437 shutdown_connections 2023-10-09T07:58:20.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.493+0000 7febc71ff700 1 -- 172.21.15.71:0/3527986437 wait complete. 2023-10-09T07:58:20.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.494+0000 7febc71ff700 1 Processor -- start 2023-10-09T07:58:20.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.494+0000 7febc71ff700 1 -- start start 2023-10-09T07:58:20.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.495+0000 7febc71ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc00ac230 0x7febc015aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:20.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.495+0000 7febc71ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febc00ccc40 0x7febc01592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:20.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.495+0000 7febc71ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febc0155c10 0x7febc0168f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:20.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.495+0000 7febc71ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc01597e0 con 0x7febc0155c10 2023-10-09T07:58:20.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.495+0000 7febc71ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc0157250 con 0x7febc00ccc40 2023-10-09T07:58:20.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.495+0000 7febc71ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc0157530 con 0x7febc00ac230 2023-10-09T07:58:20.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.496+0000 7febc579c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febc0155c10 0x7febc0168f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:20.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.496+0000 7febc579c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febc0155c10 0x7febc0168f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34170/0 (socket says 172.21.15.71:34170) 2023-10-09T07:58:20.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.496+0000 7febc579c700 1 -- 172.21.15.71:0/2924504291 learned_addr learned my addr 172.21.15.71:0/2924504291 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:20.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.496+0000 7febbffff700 1 --2- 172.21.15.71:0/2924504291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febc00ccc40 0x7febc01592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:20.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.496+0000 7febc4f9b700 1 --2- 172.21.15.71:0/2924504291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc00ac230 0x7febc015aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:20.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.496+0000 7febc579c700 1 -- 172.21.15.71:0/2924504291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc00ac230 msgr2=0x7febc015aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:20.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.496+0000 7febc579c700 1 --2- 172.21.15.71:0/2924504291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc00ac230 0x7febc015aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.496+0000 7febc579c700 1 -- 172.21.15.71:0/2924504291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febc00ccc40 msgr2=0x7febc01592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:20.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.496+0000 7febc579c700 1 --2- 172.21.15.71:0/2924504291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febc00ccc40 0x7febc01592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.496+0000 7febc579c700 1 -- 172.21.15.71:0/2924504291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac0094f0 con 0x7febc0155c10 2023-10-09T07:58:20.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.496+0000 7febbffff700 1 --2- 172.21.15.71:0/2924504291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febc00ccc40 0x7febc01592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:20.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.496+0000 7febc4f9b700 1 --2- 172.21.15.71:0/2924504291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc00ac230 0x7febc015aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:20.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.496+0000 7febc579c700 1 --2- 172.21.15.71:0/2924504291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febc0155c10 0x7febc0168f80 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7febb800c8e0 tx=0x7febb8001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:20.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.497+0000 7febbcff9700 1 -- 172.21.15.71:0/2924504291 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb800ce80 con 0x7febc0155c10 2023-10-09T07:58:20.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.497+0000 7febbcff9700 1 -- 172.21.15.71:0/2924504291 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb800a7e0 con 0x7febc0155c10 2023-10-09T07:58:20.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.497+0000 7febbcff9700 1 -- 172.21.15.71:0/2924504291 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb800ab80 con 0x7febc0155c10 2023-10-09T07:58:20.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.497+0000 7febc71ff700 1 -- 172.21.15.71:0/2924504291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc0157810 con 0x7febc0155c10 2023-10-09T07:58:20.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.497+0000 7febc71ff700 1 -- 172.21.15.71:0/2924504291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc0157dd0 con 0x7febc0155c10 2023-10-09T07:58:20.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.498+0000 7febc71ff700 1 -- 172.21.15.71:0/2924504291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc0157fc0 con 0x7febc0155c10 2023-10-09T07:58:20.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.499+0000 7febbcff9700 1 -- 172.21.15.71:0/2924504291 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7febb8012420 con 0x7febc0155c10 2023-10-09T07:58:20.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.499+0000 7febbcff9700 1 --2- 172.21.15.71:0/2924504291 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7feba4066f30 0x7feba40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:20.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.499+0000 7febbcff9700 1 -- 172.21.15.71:0/2924504291 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5317+0+0 (secure 0 0 0) 0x7febb80846a0 con 0x7febc0155c10 2023-10-09T07:58:20.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.500+0000 7febc4f9b700 1 --2- 172.21.15.71:0/2924504291 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7feba4066f30 0x7feba40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:20.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.501+0000 7febc4f9b700 1 --2- 172.21.15.71:0/2924504291 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7feba4066f30 0x7feba40693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7febb4006f00 tx=0x7febb4008040 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:20.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.503+0000 7febbcff9700 1 -- 172.21.15.71:0/2924504291 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febb8051a90 con 0x7febc0155c10 2023-10-09T07:58:20.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.693+0000 7febc71ff700 1 -- 172.21.15.71:0/2924504291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7febc004c3c0 con 0x7febc0155c10 2023-10-09T07:58:20.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.693+0000 7febbcff9700 1 -- 172.21.15.71:0/2924504291 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v172) v1 ==== 84+0+65 (secure 0 0 0) 0x7febb80550b0 con 0x7febc0155c10 2023-10-09T07:58:20.694 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:58:20.695 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-09T07:58:20.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:58:20.695 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 1, 2023-10-09T07:58:20.695 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": ".mgr" 2023-10-09T07:58:20.695 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:58:20.695 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-09T07:58:20.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.695+0000 7febc71ff700 1 -- 172.21.15.71:0/2924504291 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7feba4066f30 msgr2=0x7feba40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:20.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.696+0000 7febc71ff700 1 --2- 172.21.15.71:0/2924504291 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7feba4066f30 0x7feba40693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7febb4006f00 tx=0x7febb4008040 comp rx=0 tx=0).stop 2023-10-09T07:58:20.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.696+0000 7febc71ff700 1 -- 172.21.15.71:0/2924504291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febc0155c10 msgr2=0x7febc0168f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:20.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.696+0000 7febc71ff700 1 --2- 172.21.15.71:0/2924504291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febc0155c10 0x7febc0168f80 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7febb800c8e0 tx=0x7febb8001710 comp rx=0 tx=0).stop 2023-10-09T07:58:20.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.696+0000 7febc71ff700 1 -- 172.21.15.71:0/2924504291 shutdown_connections 2023-10-09T07:58:20.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.696+0000 7febc71ff700 1 --2- 172.21.15.71:0/2924504291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febc0155c10 0x7febc0168f80 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.696+0000 7febc71ff700 1 --2- 172.21.15.71:0/2924504291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc00ac230 0x7febc015aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.696+0000 7febc71ff700 1 --2- 172.21.15.71:0/2924504291 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7feba4066f30 0x7feba40693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.696+0000 7febc71ff700 1 --2- 172.21.15.71:0/2924504291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febc00ccc40 0x7febc01592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.696+0000 7febc71ff700 1 -- 172.21.15.71:0/2924504291 >> 172.21.15.71:0/2924504291 conn(0x7febc006a320 msgr2=0x7febc00af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:20.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.696+0000 7febc71ff700 1 -- 172.21.15.71:0/2924504291 shutdown_connections 2023-10-09T07:58:20.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.696+0000 7febc71ff700 1 -- 172.21.15.71:0/2924504291 wait complete. 2023-10-09T07:58:20.714 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T07:58:20.714 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T07:58:20.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.897+0000 7f75e9dff700 1 Processor -- start 2023-10-09T07:58:20.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.898+0000 7f75e9dff700 1 -- start start 2023-10-09T07:58:20.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.899+0000 7f75e9dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f75e415a440 0x7f75e40acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:20.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.899+0000 7f75e9dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e4068890 0x7f75e40c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:20.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.899+0000 7f75e9dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e415a9b0 con 0x7f75e41563b0 2023-10-09T07:58:20.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.899+0000 7f75e9dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e415ac90 con 0x7f75e415a440 2023-10-09T07:58:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.899+0000 7f75e9dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e415af70 con 0x7f75e4068890 2023-10-09T07:58:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.899+0000 7f75e2ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f75e415a440 0x7f75e40acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.899+0000 7f75e2ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f75e415a440 0x7f75e40acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34178/0 (socket says 172.21.15.71:34178) 2023-10-09T07:58:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.899+0000 7f75e2ffd700 1 -- 172.21.15.71:0/3190818323 learned_addr learned my addr 172.21.15.71:0/3190818323 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.899+0000 7f75e3fff700 1 --2- 172.21.15.71:0/3190818323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e4068890 0x7f75e40c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.899+0000 7f75e2ffd700 1 -- 172.21.15.71:0/3190818323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e4068890 msgr2=0x7f75e40c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.899+0000 7f75e2ffd700 1 --2- 172.21.15.71:0/3190818323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e4068890 0x7f75e40c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.899+0000 7f75e2ffd700 1 -- 172.21.15.71:0/3190818323 >> v1:172.21.15.179:6789/0 conn(0x7f75e41563b0 legacy=0x7f75e4156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.900+0000 7f75e2ffd700 1 -- 172.21.15.71:0/3190818323 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e415b250 con 0x7f75e415a440 2023-10-09T07:58:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.900+0000 7f75e3fff700 1 --2- 172.21.15.71:0/3190818323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e4068890 0x7f75e40c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:20.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.900+0000 7f75e2ffd700 1 --2- 172.21.15.71:0/3190818323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75e415a440 0x7f75e40acf30 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f75d800bc50 tx=0x7f75d800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b16d06f014377b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:20.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.900+0000 7f75e27fc700 1 -- 172.21.15.71:0/3190818323 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d800be60 con 0x7f75e415a440 2023-10-09T07:58:20.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.900+0000 7f75e27fc700 1 -- 172.21.15.71:0/3190818323 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d800ddc0 con 0x7f75e415a440 2023-10-09T07:58:20.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.900+0000 7f75e27fc700 1 -- 172.21.15.71:0/3190818323 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d80106a0 con 0x7f75e415a440 2023-10-09T07:58:20.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.900+0000 7f75e9dff700 1 -- 172.21.15.71:0/3190818323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75e415a440 msgr2=0x7f75e40acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:20.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.900+0000 7f75e9dff700 1 --2- 172.21.15.71:0/3190818323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75e415a440 0x7f75e40acf30 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f75d800bc50 tx=0x7f75d800b4f0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.901+0000 7f75e9dff700 1 -- 172.21.15.71:0/3190818323 shutdown_connections 2023-10-09T07:58:20.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.901+0000 7f75e9dff700 1 --2- 172.21.15.71:0/3190818323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e4068890 0x7f75e40c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.901+0000 7f75e9dff700 1 --2- 172.21.15.71:0/3190818323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75e415a440 0x7f75e40acf30 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.901+0000 7f75e9dff700 1 -- 172.21.15.71:0/3190818323 >> 172.21.15.71:0/3190818323 conn(0x7f75e40c8f90 msgr2=0x7f75e40c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:20.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.901+0000 7f75e9dff700 1 -- 172.21.15.71:0/3190818323 shutdown_connections 2023-10-09T07:58:20.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.901+0000 7f75e9dff700 1 -- 172.21.15.71:0/3190818323 wait complete. 2023-10-09T07:58:20.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.902+0000 7f75e9dff700 1 Processor -- start 2023-10-09T07:58:20.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.902+0000 7f75e9dff700 1 -- start start 2023-10-09T07:58:20.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.903+0000 7f75e9dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e4068890 0x7f75e406dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:20.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.903+0000 7f75e9dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e41563b0 0x7f75e406e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:20.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.903+0000 7f75e9dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75e415a440 0x7f75e40c1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:20.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.903+0000 7f75e9dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e416a020 con 0x7f75e415a440 2023-10-09T07:58:20.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.903+0000 7f75e9dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e41509b0 con 0x7f75e4068890 2023-10-09T07:58:20.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.903+0000 7f75e9dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e4169410 con 0x7f75e41563b0 2023-10-09T07:58:20.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.903+0000 7f75e3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75e415a440 0x7f75e40c1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:20.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.904+0000 7f75e3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75e415a440 0x7f75e40c1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34192/0 (socket says 172.21.15.71:34192) 2023-10-09T07:58:20.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.904+0000 7f75e3fff700 1 -- 172.21.15.71:0/1464907634 learned_addr learned my addr 172.21.15.71:0/1464907634 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:20.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.904+0000 7f75e37fe700 1 --2- 172.21.15.71:0/1464907634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e4068890 0x7f75e406dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:20.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.904+0000 7f75e2ffd700 1 --2- 172.21.15.71:0/1464907634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e41563b0 0x7f75e406e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:20.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.904+0000 7f75e3fff700 1 -- 172.21.15.71:0/1464907634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e41563b0 msgr2=0x7f75e406e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:20.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.904+0000 7f75e3fff700 1 --2- 172.21.15.71:0/1464907634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e41563b0 0x7f75e406e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.904+0000 7f75e3fff700 1 -- 172.21.15.71:0/1464907634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e4068890 msgr2=0x7f75e406dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:20.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.904+0000 7f75e3fff700 1 --2- 172.21.15.71:0/1464907634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e4068890 0x7f75e406dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:20.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.904+0000 7f75e3fff700 1 -- 172.21.15.71:0/1464907634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d800b790 con 0x7f75e415a440 2023-10-09T07:58:20.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.904+0000 7f75e37fe700 1 --2- 172.21.15.71:0/1464907634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e4068890 0x7f75e406dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:20.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.904+0000 7f75e3fff700 1 --2- 172.21.15.71:0/1464907634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75e415a440 0x7f75e40c1380 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f75dc00cef0 tx=0x7f75dc007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:20.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.904+0000 7f75cb7fe700 1 -- 172.21.15.71:0/1464907634 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc00ae00 con 0x7f75e415a440 2023-10-09T07:58:20.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.904+0000 7f75cb7fe700 1 -- 172.21.15.71:0/1464907634 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75dc016420 con 0x7f75e415a440 2023-10-09T07:58:20.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.904+0000 7f75e9dff700 1 -- 172.21.15.71:0/1464907634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e41696f0 con 0x7f75e415a440 2023-10-09T07:58:20.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.904+0000 7f75cb7fe700 1 -- 172.21.15.71:0/1464907634 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc0167e0 con 0x7f75e415a440 2023-10-09T07:58:20.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.905+0000 7f75e9dff700 1 -- 172.21.15.71:0/1464907634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e4169cb0 con 0x7f75e415a440 2023-10-09T07:58:20.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.906+0000 7f75e9dff700 1 -- 172.21.15.71:0/1464907634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e416a190 con 0x7f75e415a440 2023-10-09T07:58:20.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.906+0000 7f75cb7fe700 1 -- 172.21.15.71:0/1464907634 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f75dc016bd0 con 0x7f75e415a440 2023-10-09T07:58:20.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.907+0000 7f75cb7fe700 1 --2- 172.21.15.71:0/1464907634 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f75d0066f30 0x7f75d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:20.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.907+0000 7f75cb7fe700 1 -- 172.21.15.71:0/1464907634 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5317+0+0 (secure 0 0 0) 0x7f75dc012070 con 0x7f75e415a440 2023-10-09T07:58:20.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.908+0000 7f75e37fe700 1 --2- 172.21.15.71:0/1464907634 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f75d0066f30 0x7f75d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:20.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.908+0000 7f75e37fe700 1 --2- 172.21.15.71:0/1464907634 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f75d0066f30 0x7f75d00693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f75e40685f0 tx=0x7f75d4009040 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:20.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:20.911+0000 7f75cb7fe700 1 -- 172.21.15.71:0/1464907634 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f75dc04e5a0 con 0x7f75e415a440 2023-10-09T07:58:21.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:21.103+0000 7f75e9dff700 1 -- 172.21.15.71:0/1464907634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f75e40718b0 con 0x7f75e415a440 2023-10-09T07:58:21.337 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:58:21.341 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:58:22.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.011+0000 7f75cb7fe700 1 -- 172.21.15.71:0/1464907634 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v173) v1 ==== 138+0+0 (secure 0 0 0) 0x7f75dc052140 con 0x7f75e415a440 2023-10-09T07:58:22.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.016+0000 7f75e9dff700 1 -- 172.21.15.71:0/1464907634 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f75d0066f30 msgr2=0x7f75d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:22.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.016+0000 7f75e9dff700 1 --2- 172.21.15.71:0/1464907634 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f75d0066f30 0x7f75d00693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f75e40685f0 tx=0x7f75d4009040 comp rx=0 tx=0).stop 2023-10-09T07:58:22.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.016+0000 7f75e9dff700 1 -- 172.21.15.71:0/1464907634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75e415a440 msgr2=0x7f75e40c1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:22.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.016+0000 7f75e9dff700 1 --2- 172.21.15.71:0/1464907634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75e415a440 0x7f75e40c1380 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f75dc00cef0 tx=0x7f75dc007860 comp rx=0 tx=0).stop 2023-10-09T07:58:22.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.017+0000 7f75e9dff700 1 -- 172.21.15.71:0/1464907634 shutdown_connections 2023-10-09T07:58:22.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.017+0000 7f75e9dff700 1 --2- 172.21.15.71:0/1464907634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75e415a440 0x7f75e40c1380 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:22.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.017+0000 7f75e9dff700 1 --2- 172.21.15.71:0/1464907634 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f75d0066f30 0x7f75d00693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:22.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.017+0000 7f75e9dff700 1 --2- 172.21.15.71:0/1464907634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e4068890 0x7f75e406dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:22.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.017+0000 7f75e9dff700 1 --2- 172.21.15.71:0/1464907634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e41563b0 0x7f75e406e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:22.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.017+0000 7f75e9dff700 1 -- 172.21.15.71:0/1464907634 >> 172.21.15.71:0/1464907634 conn(0x7f75e40c8f90 msgr2=0x7f75e414ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:22.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.017+0000 7f75e9dff700 1 -- 172.21.15.71:0/1464907634 shutdown_connections 2023-10-09T07:58:22.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.017+0000 7f75e9dff700 1 -- 172.21.15.71:0/1464907634 wait complete. 2023-10-09T07:58:22.020 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' created 2023-10-09T07:58:22.038 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T07:58:22.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.226+0000 7f9b3c1ff700 1 Processor -- start 2023-10-09T07:58:22.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.226+0000 7f9b3c1ff700 1 -- start start 2023-10-09T07:58:22.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.228+0000 7f9b3c1ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9b3406a570 0x7f9b340cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:22.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.228+0000 7f9b3c1ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3415e880 con 0x7f9b34069780 2023-10-09T07:58:22.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.228+0000 7f9b3c1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3415e3f0 con 0x7f9b3406a940 2023-10-09T07:58:22.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.228+0000 7f9b3c1ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b340cba40 con 0x7f9b3406a570 2023-10-09T07:58:22.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.228+0000 7f9b39f9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9b3406a570 0x7f9b340cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:22.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.228+0000 7f9b39f9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9b3406a570 0x7f9b340cb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34208/0 (socket says 172.21.15.71:34208) 2023-10-09T07:58:22.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.228+0000 7f9b3979a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9b34069780 0x7f9b341597a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34418/0 (socket says 172.21.15.71:34418) 2023-10-09T07:58:22.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.228+0000 7f9b39f9b700 1 -- 172.21.15.71:0/3250160873 learned_addr learned my addr 172.21.15.71:0/3250160873 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:22.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.228+0000 7f9b39f9b700 1 -- 172.21.15.71:0/3250160873 >> v1:172.21.15.179:6789/0 conn(0x7f9b3406a940 legacy=0x7f9b340c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:22.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.228+0000 7f9b39f9b700 1 -- 172.21.15.71:0/3250160873 >> v1:172.21.15.71:6789/0 conn(0x7f9b34069780 legacy=0x7f9b341597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:22.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.228+0000 7f9b39f9b700 1 -- 172.21.15.71:0/3250160873 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3415dac0 con 0x7f9b3406a570 2023-10-09T07:58:22.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.228+0000 7f9b38f99700 1 -- 172.21.15.71:0/3250160873 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627930362 0 0) 0x7f9b24001110 con 0x7f9b34069780 2023-10-09T07:58:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.229+0000 7f9b39f9b700 1 --2- 172.21.15.71:0/3250160873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b3406a570 0x7f9b340cb1f0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f9b300099e0 tx=0x7f9b30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ad7f165631a61b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.229+0000 7f9b38f99700 1 -- 172.21.15.71:0/3250160873 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3000b7e0 con 0x7f9b3406a570 2023-10-09T07:58:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.229+0000 7f9b38f99700 1 -- 172.21.15.71:0/3250160873 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3000b940 con 0x7f9b3406a570 2023-10-09T07:58:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.229+0000 7f9b38f99700 1 -- 172.21.15.71:0/3250160873 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3000bce0 con 0x7f9b3406a570 2023-10-09T07:58:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.229+0000 7f9b3c1ff700 1 -- 172.21.15.71:0/3250160873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b3406a570 msgr2=0x7f9b340cb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.229+0000 7f9b3c1ff700 1 --2- 172.21.15.71:0/3250160873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b3406a570 0x7f9b340cb1f0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f9b300099e0 tx=0x7f9b30009250 comp rx=0 tx=0).stop 2023-10-09T07:58:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.229+0000 7f9b3c1ff700 1 -- 172.21.15.71:0/3250160873 shutdown_connections 2023-10-09T07:58:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.230+0000 7f9b3c1ff700 1 --2- 172.21.15.71:0/3250160873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b3406a570 0x7f9b340cb1f0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.230+0000 7f9b3c1ff700 1 -- 172.21.15.71:0/3250160873 >> 172.21.15.71:0/3250160873 conn(0x7f9b340c9870 msgr2=0x7f9b340c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:22.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.230+0000 7f9b3c1ff700 1 -- 172.21.15.71:0/3250160873 shutdown_connections 2023-10-09T07:58:22.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.230+0000 7f9b3c1ff700 1 -- 172.21.15.71:0/3250160873 wait complete. 2023-10-09T07:58:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.231+0000 7f9b3c1ff700 1 Processor -- start 2023-10-09T07:58:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.231+0000 7f9b3c1ff700 1 -- start start 2023-10-09T07:58:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.232+0000 7f9b3c1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b34069780 0x7f9b341543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.232+0000 7f9b3c1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b3406a570 0x7f9b34159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.232+0000 7f9b3c1ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b3406a940 0x7f9b3415baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.232+0000 7f9b3c1ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3415b660 con 0x7f9b3406a940 2023-10-09T07:58:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.232+0000 7f9b3c1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b34154920 con 0x7f9b3406a570 2023-10-09T07:58:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.232+0000 7f9b3c1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3415a4c0 con 0x7f9b34069780 2023-10-09T07:58:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.232+0000 7f9b3a79c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b3406a940 0x7f9b3415baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.232+0000 7f9b3a79c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b3406a940 0x7f9b3415baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34224/0 (socket says 172.21.15.71:34224) 2023-10-09T07:58:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.232+0000 7f9b3a79c700 1 -- 172.21.15.71:0/1294344638 learned_addr learned my addr 172.21.15.71:0/1294344638 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.233+0000 7f9b39f9b700 1 --2- 172.21.15.71:0/1294344638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b34069780 0x7f9b341543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.233+0000 7f9b3979a700 1 --2- 172.21.15.71:0/1294344638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b3406a570 0x7f9b34159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.233+0000 7f9b3a79c700 1 -- 172.21.15.71:0/1294344638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b34069780 msgr2=0x7f9b341543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.233+0000 7f9b3a79c700 1 --2- 172.21.15.71:0/1294344638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b34069780 0x7f9b341543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.233+0000 7f9b3a79c700 1 -- 172.21.15.71:0/1294344638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b3406a570 msgr2=0x7f9b34159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.233+0000 7f9b3a79c700 1 --2- 172.21.15.71:0/1294344638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b3406a570 0x7f9b34159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.233+0000 7f9b3a79c700 1 -- 172.21.15.71:0/1294344638 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b300094f0 con 0x7f9b3406a940 2023-10-09T07:58:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.233+0000 7f9b3979a700 1 --2- 172.21.15.71:0/1294344638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b3406a570 0x7f9b34159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.233+0000 7f9b3a79c700 1 --2- 172.21.15.71:0/1294344638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b3406a940 0x7f9b3415baf0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00bc30 tx=0x7f9b2c009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.233+0000 7f9b29ffb700 1 -- 172.21.15.71:0/1294344638 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c00c9b0 con 0x7f9b3406a940 2023-10-09T07:58:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.233+0000 7f9b29ffb700 1 -- 172.21.15.71:0/1294344638 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c00cb50 con 0x7f9b3406a940 2023-10-09T07:58:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.233+0000 7f9b29ffb700 1 -- 172.21.15.71:0/1294344638 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c014410 con 0x7f9b3406a940 2023-10-09T07:58:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.233+0000 7f9b3c1ff700 1 -- 172.21.15.71:0/1294344638 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b3415ce80 con 0x7f9b3406a940 2023-10-09T07:58:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.233+0000 7f9b3c1ff700 1 -- 172.21.15.71:0/1294344638 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3415d440 con 0x7f9b3406a940 2023-10-09T07:58:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.234+0000 7f9b3c1ff700 1 -- 172.21.15.71:0/1294344638 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3415b810 con 0x7f9b3406a940 2023-10-09T07:58:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.236+0000 7f9b29ffb700 1 -- 172.21.15.71:0/1294344638 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b2c014800 con 0x7f9b3406a940 2023-10-09T07:58:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.237+0000 7f9b29ffb700 1 --2- 172.21.15.71:0/1294344638 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9b18066f30 0x7f9b180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.237+0000 7f9b29ffb700 1 -- 172.21.15.71:0/1294344638 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5687+0+0 (secure 0 0 0) 0x7f9b2c084660 con 0x7f9b3406a940 2023-10-09T07:58:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.237+0000 7f9b39f9b700 1 --2- 172.21.15.71:0/1294344638 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9b18066f30 0x7f9b180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.238+0000 7f9b39f9b700 1 --2- 172.21.15.71:0/1294344638 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9b18066f30 0x7f9b180693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9b300099e0 tx=0x7f9b30016000 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:22.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.242+0000 7f9b29ffb700 1 -- 172.21.15.71:0/1294344638 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b2c04c5a0 con 0x7f9b3406a940 2023-10-09T07:58:22.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:22.431+0000 7f9b3c1ff700 1 -- 172.21.15.71:0/1294344638 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9b340718b0 con 0x7f9b3406a940 2023-10-09T07:58:23.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.020+0000 7f9b29ffb700 1 -- 172.21.15.71:0/1294344638 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v174) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9b3415b810 con 0x7f9b3406a940 2023-10-09T07:58:23.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.033+0000 7f9b3c1ff700 1 -- 172.21.15.71:0/1294344638 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9b18066f30 msgr2=0x7f9b180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:23.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.033+0000 7f9b3c1ff700 1 --2- 172.21.15.71:0/1294344638 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9b18066f30 0x7f9b180693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9b300099e0 tx=0x7f9b30016000 comp rx=0 tx=0).stop 2023-10-09T07:58:23.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.033+0000 7f9b3c1ff700 1 -- 172.21.15.71:0/1294344638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b3406a940 msgr2=0x7f9b3415baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:23.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.033+0000 7f9b3c1ff700 1 --2- 172.21.15.71:0/1294344638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b3406a940 0x7f9b3415baf0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00bc30 tx=0x7f9b2c009820 comp rx=0 tx=0).stop 2023-10-09T07:58:23.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.034+0000 7f9b3c1ff700 1 -- 172.21.15.71:0/1294344638 shutdown_connections 2023-10-09T07:58:23.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.034+0000 7f9b3c1ff700 1 --2- 172.21.15.71:0/1294344638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b3406a940 0x7f9b3415baf0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:23.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.034+0000 7f9b3c1ff700 1 --2- 172.21.15.71:0/1294344638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b34069780 0x7f9b341543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:23.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.034+0000 7f9b3c1ff700 1 --2- 172.21.15.71:0/1294344638 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f9b18066f30 0x7f9b180693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:23.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.034+0000 7f9b3c1ff700 1 --2- 172.21.15.71:0/1294344638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b3406a570 0x7f9b34159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:23.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.035+0000 7f9b3c1ff700 1 -- 172.21.15.71:0/1294344638 >> 172.21.15.71:0/1294344638 conn(0x7f9b340c9870 msgr2=0x7f9b340c29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:23.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.036+0000 7f9b3c1ff700 1 -- 172.21.15.71:0/1294344638 shutdown_connections 2023-10-09T07:58:23.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.036+0000 7f9b3c1ff700 1 -- 172.21.15.71:0/1294344638 wait complete. 2023-10-09T07:58:23.040 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' created 2023-10-09T07:58:23.059 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T07:58:23.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.241+0000 7f63bc9ff700 1 Processor -- start 2023-10-09T07:58:23.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.241+0000 7f63bc9ff700 1 -- start start 2023-10-09T07:58:23.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.242+0000 7f63bc9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b8155eb0 0x7f63b806e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:23.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.242+0000 7f63bc9ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f63b8069e80 0x7f63b80ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:23.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.242+0000 7f63bc9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b806eb90 con 0x7f63b80c70b0 2023-10-09T07:58:23.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.242+0000 7f63bc9ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b806ee70 con 0x7f63b8069e80 2023-10-09T07:58:23.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.242+0000 7f63bc9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b806f150 con 0x7f63b8155eb0 2023-10-09T07:58:23.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.242+0000 7f63b6d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f63b8069e80 0x7f63b80ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:23.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.243+0000 7f63b6d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f63b8069e80 0x7f63b80ca4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34226/0 (socket says 172.21.15.71:34226) 2023-10-09T07:58:23.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.243+0000 7f63b6d9d700 1 -- 172.21.15.71:0/141430808 learned_addr learned my addr 172.21.15.71:0/141430808 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:23.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.243+0000 7f63b659c700 1 --2- 172.21.15.71:0/141430808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b8155eb0 0x7f63b806e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:23.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.243+0000 7f63b6d9d700 1 -- 172.21.15.71:0/141430808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b8155eb0 msgr2=0x7f63b806e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:23.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.243+0000 7f63b6d9d700 1 --2- 172.21.15.71:0/141430808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b8155eb0 0x7f63b806e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:23.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.243+0000 7f63b6d9d700 1 -- 172.21.15.71:0/141430808 >> v1:172.21.15.179:6789/0 conn(0x7f63b80c70b0 legacy=0x7f63b8069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:23.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.243+0000 7f63b6d9d700 1 -- 172.21.15.71:0/141430808 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b806f430 con 0x7f63b8069e80 2023-10-09T07:58:23.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.243+0000 7f63b6d9d700 1 --2- 172.21.15.71:0/141430808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b8069e80 0x7f63b80ca4c0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f63b0009f20 tx=0x7f63b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46743425d47f37f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:23.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.243+0000 7f63b559a700 1 -- 172.21.15.71:0/141430808 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b000e070 con 0x7f63b8069e80 2023-10-09T07:58:23.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.244+0000 7f63b559a700 1 -- 172.21.15.71:0/141430808 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b000b9d0 con 0x7f63b8069e80 2023-10-09T07:58:23.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.244+0000 7f63b559a700 1 -- 172.21.15.71:0/141430808 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b00092e0 con 0x7f63b8069e80 2023-10-09T07:58:23.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.244+0000 7f63bc9ff700 1 -- 172.21.15.71:0/141430808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b8069e80 msgr2=0x7f63b80ca4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:23.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.244+0000 7f63bc9ff700 1 --2- 172.21.15.71:0/141430808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b8069e80 0x7f63b80ca4c0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f63b0009f20 tx=0x7f63b0009840 comp rx=0 tx=0).stop 2023-10-09T07:58:23.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.244+0000 7f63bc9ff700 1 -- 172.21.15.71:0/141430808 shutdown_connections 2023-10-09T07:58:23.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.244+0000 7f63bc9ff700 1 --2- 172.21.15.71:0/141430808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b8069e80 0x7f63b80ca4c0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:23.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.244+0000 7f63bc9ff700 1 --2- 172.21.15.71:0/141430808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b8155eb0 0x7f63b806e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:23.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.244+0000 7f63bc9ff700 1 -- 172.21.15.71:0/141430808 >> 172.21.15.71:0/141430808 conn(0x7f63b8068e10 msgr2=0x7f63b80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:23.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.244+0000 7f63bc9ff700 1 -- 172.21.15.71:0/141430808 shutdown_connections 2023-10-09T07:58:23.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.244+0000 7f63bc9ff700 1 -- 172.21.15.71:0/141430808 wait complete. 2023-10-09T07:58:23.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.246+0000 7f63bc9ff700 1 Processor -- start 2023-10-09T07:58:23.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.246+0000 7f63bc9ff700 1 -- start start 2023-10-09T07:58:23.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.247+0000 7f63bc9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b8069e80 0x7f63b8141140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:23.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.247+0000 7f63bc9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63b80c70b0 0x7f63b80c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:23.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.247+0000 7f63bc9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b8155eb0 0x7f63b815e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:23.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.247+0000 7f63bc9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b80c6dc0 con 0x7f63b8069e80 2023-10-09T07:58:23.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.247+0000 7f63bc9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b80c6140 con 0x7f63b80c70b0 2023-10-09T07:58:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.247+0000 7f63bc9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b80c6420 con 0x7f63b8155eb0 2023-10-09T07:58:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.247+0000 7f63b659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b8069e80 0x7f63b8141140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.247+0000 7f63b659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b8069e80 0x7f63b8141140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34234/0 (socket says 172.21.15.71:34234) 2023-10-09T07:58:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.247+0000 7f63b659c700 1 -- 172.21.15.71:0/3203054676 learned_addr learned my addr 172.21.15.71:0/3203054676 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.247+0000 7f63b5d9b700 1 --2- 172.21.15.71:0/3203054676 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63b80c70b0 0x7f63b80c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.247+0000 7f63b6d9d700 1 --2- 172.21.15.71:0/3203054676 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b8155eb0 0x7f63b815e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.247+0000 7f63b659c700 1 -- 172.21.15.71:0/3203054676 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b8155eb0 msgr2=0x7f63b815e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.247+0000 7f63b659c700 1 --2- 172.21.15.71:0/3203054676 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b8155eb0 0x7f63b815e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.247+0000 7f63b659c700 1 -- 172.21.15.71:0/3203054676 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63b80c70b0 msgr2=0x7f63b80c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.247+0000 7f63b659c700 1 --2- 172.21.15.71:0/3203054676 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63b80c70b0 0x7f63b80c35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:23.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.247+0000 7f63b659c700 1 -- 172.21.15.71:0/3203054676 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b0009ae0 con 0x7f63b8069e80 2023-10-09T07:58:23.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.248+0000 7f63b659c700 1 --2- 172.21.15.71:0/3203054676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b8069e80 0x7f63b8141140 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f63a800e950 tx=0x7f63a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:23.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.248+0000 7f63a67fc700 1 -- 172.21.15.71:0/3203054676 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a800c850 con 0x7f63b8069e80 2023-10-09T07:58:23.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.248+0000 7f63a67fc700 1 -- 172.21.15.71:0/3203054676 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a800c9b0 con 0x7f63b8069e80 2023-10-09T07:58:23.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.248+0000 7f63a67fc700 1 -- 172.21.15.71:0/3203054676 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a800cdb0 con 0x7f63b8069e80 2023-10-09T07:58:23.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.248+0000 7f63bc9ff700 1 -- 172.21.15.71:0/3203054676 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b80c6700 con 0x7f63b8069e80 2023-10-09T07:58:23.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.248+0000 7f63bc9ff700 1 -- 172.21.15.71:0/3203054676 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b8141680 con 0x7f63b8069e80 2023-10-09T07:58:23.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.249+0000 7f63bc9ff700 1 -- 172.21.15.71:0/3203054676 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b804c3c0 con 0x7f63b8069e80 2023-10-09T07:58:23.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.251+0000 7f63a67fc700 1 -- 172.21.15.71:0/3203054676 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f63a8013680 con 0x7f63b8069e80 2023-10-09T07:58:23.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.252+0000 7f63a67fc700 1 --2- 172.21.15.71:0/3203054676 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6398066f30 0x7f63980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:23.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.252+0000 7f63a67fc700 1 -- 172.21.15.71:0/3203054676 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f63a8085130 con 0x7f63b8069e80 2023-10-09T07:58:23.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.252+0000 7f63b5d9b700 1 --2- 172.21.15.71:0/3203054676 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6398066f30 0x7f63980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:23.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.253+0000 7f63b5d9b700 1 --2- 172.21.15.71:0/3203054676 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6398066f30 0x7f63980693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f63b80b23f0 tx=0x7f63ac009040 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:23.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.255+0000 7f63a67fc700 1 -- 172.21.15.71:0/3203054676 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63a8052210 con 0x7f63b8069e80 2023-10-09T07:58:23.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:23.488+0000 7f63bc9ff700 1 -- 172.21.15.71:0/3203054676 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f63b8156280 con 0x7f63b8069e80 2023-10-09T07:58:24.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.021+0000 7f63a67fc700 1 -- 172.21.15.71:0/3203054676 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v79) v1 ==== 174+0+0 (secure 0 0 0) 0x7f63a8059e60 con 0x7f63b8069e80 2023-10-09T07:58:24.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.037+0000 7f63bc9ff700 1 -- 172.21.15.71:0/3203054676 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6398066f30 msgr2=0x7f63980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:24.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.037+0000 7f63bc9ff700 1 --2- 172.21.15.71:0/3203054676 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6398066f30 0x7f63980693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f63b80b23f0 tx=0x7f63ac009040 comp rx=0 tx=0).stop 2023-10-09T07:58:24.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.037+0000 7f63bc9ff700 1 -- 172.21.15.71:0/3203054676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b8069e80 msgr2=0x7f63b8141140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:24.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.037+0000 7f63bc9ff700 1 --2- 172.21.15.71:0/3203054676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b8069e80 0x7f63b8141140 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f63a800e950 tx=0x7f63a80091a0 comp rx=0 tx=0).stop 2023-10-09T07:58:24.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.037+0000 7f63bc9ff700 1 -- 172.21.15.71:0/3203054676 shutdown_connections 2023-10-09T07:58:24.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.037+0000 7f63bc9ff700 1 --2- 172.21.15.71:0/3203054676 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b8155eb0 0x7f63b815e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:24.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.037+0000 7f63bc9ff700 1 --2- 172.21.15.71:0/3203054676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b8069e80 0x7f63b8141140 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:24.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.037+0000 7f63bc9ff700 1 --2- 172.21.15.71:0/3203054676 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6398066f30 0x7f63980693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:24.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.037+0000 7f63bc9ff700 1 --2- 172.21.15.71:0/3203054676 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63b80c70b0 0x7f63b80c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:24.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.037+0000 7f63bc9ff700 1 -- 172.21.15.71:0/3203054676 >> 172.21.15.71:0/3203054676 conn(0x7f63b8068e10 msgr2=0x7f63b80aa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:24.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.038+0000 7f63bc9ff700 1 -- 172.21.15.71:0/3203054676 shutdown_connections 2023-10-09T07:58:24.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.038+0000 7f63bc9ff700 1 -- 172.21.15.71:0/3203054676 wait complete. 2023-10-09T07:58:24.045 INFO:teuthology.orchestra.run.smithi071.stderr:new fs with metadata pool 20 and data pool 21 2023-10-09T07:58:24.069 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:58:24.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.249+0000 7fa4a71ff700 1 Processor -- start 2023-10-09T07:58:24.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.249+0000 7fa4a71ff700 1 -- start start 2023-10-09T07:58:24.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.250+0000 7fa4a71ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa4a00b1420 0x7fa4a00ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:24.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.250+0000 7fa4a71ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a00cc300 con 0x7fa4a00cbf30 2023-10-09T07:58:24.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.250+0000 7fa4a71ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a00ad370 con 0x7fa4a00ccf90 2023-10-09T07:58:24.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.250+0000 7fa4a71ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a0156bf0 con 0x7fa4a00b1420 2023-10-09T07:58:24.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.251+0000 7fa49ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa4a00b1420 0x7fa4a00ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:24.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.251+0000 7fa49ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa4a00b1420 0x7fa4a00ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34250/0 (socket says 172.21.15.71:34250) 2023-10-09T07:58:24.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.251+0000 7fa49ffff700 1 -- 172.21.15.71:0/1565554170 learned_addr learned my addr 172.21.15.71:0/1565554170 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:24.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.251+0000 7fa49ffff700 1 -- 172.21.15.71:0/1565554170 >> v1:172.21.15.179:6789/0 conn(0x7fa4a00ccf90 legacy=0x7fa4a00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:24.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.251+0000 7fa49ffff700 1 -- 172.21.15.71:0/1565554170 >> v1:172.21.15.71:6789/0 conn(0x7fa4a00cbf30 legacy=0x7fa4a00b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:24.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.251+0000 7fa49ffff700 1 -- 172.21.15.71:0/1565554170 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a00ad650 con 0x7fa4a00b1420 2023-10-09T07:58:24.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.251+0000 7fa49f7fe700 1 -- 172.21.15.71:0/1565554170 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 185927581 0 0) 0x7fa4a00cc300 con 0x7fa4a00cbf30 2023-10-09T07:58:24.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.251+0000 7fa49ffff700 1 --2- 172.21.15.71:0/1565554170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4a00b1420 0x7fa4a00ae410 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fa48c0099b0 tx=0x7fa48c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e05280ad0fc9b38 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:24.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.251+0000 7fa49f7fe700 1 -- 172.21.15.71:0/1565554170 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c00b860 con 0x7fa4a00b1420 2023-10-09T07:58:24.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.252+0000 7fa49f7fe700 1 -- 172.21.15.71:0/1565554170 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48c00b9c0 con 0x7fa4a00b1420 2023-10-09T07:58:24.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.252+0000 7fa49f7fe700 1 -- 172.21.15.71:0/1565554170 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c00bd60 con 0x7fa4a00b1420 2023-10-09T07:58:24.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.252+0000 7fa4a71ff700 1 -- 172.21.15.71:0/1565554170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4a00b1420 msgr2=0x7fa4a00ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:24.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.252+0000 7fa4a71ff700 1 --2- 172.21.15.71:0/1565554170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4a00b1420 0x7fa4a00ae410 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fa48c0099b0 tx=0x7fa48c009250 comp rx=0 tx=0).stop 2023-10-09T07:58:24.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.252+0000 7fa4a71ff700 1 -- 172.21.15.71:0/1565554170 shutdown_connections 2023-10-09T07:58:24.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.252+0000 7fa4a71ff700 1 --2- 172.21.15.71:0/1565554170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4a00b1420 0x7fa4a00ae410 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:24.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.252+0000 7fa4a71ff700 1 -- 172.21.15.71:0/1565554170 >> 172.21.15.71:0/1565554170 conn(0x7fa4a006a320 msgr2=0x7fa4a00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:24.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.252+0000 7fa4a71ff700 1 -- 172.21.15.71:0/1565554170 shutdown_connections 2023-10-09T07:58:24.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.252+0000 7fa4a71ff700 1 -- 172.21.15.71:0/1565554170 wait complete. 2023-10-09T07:58:24.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.253+0000 7fa4a71ff700 1 Processor -- start 2023-10-09T07:58:24.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.254+0000 7fa4a71ff700 1 -- start start 2023-10-09T07:58:24.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.254+0000 7fa4a71ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4a00b1420 0x7fa4a00acab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:24.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.254+0000 7fa4a71ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4a00cbf30 0x7fa4a00a81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:24.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.254+0000 7fa4a71ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4a00ccf90 0x7fa4a00a8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:24.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.254+0000 7fa4a71ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a00a5900 con 0x7fa4a00b1420 2023-10-09T07:58:24.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.254+0000 7fa4a71ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a00a5be0 con 0x7fa4a00cbf30 2023-10-09T07:58:24.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.254+0000 7fa4a71ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a00a5ec0 con 0x7fa4a00ccf90 2023-10-09T07:58:24.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.255+0000 7fa4a4f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4a00b1420 0x7fa4a00acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:24.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.255+0000 7fa4a4f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4a00b1420 0x7fa4a00acab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34266/0 (socket says 172.21.15.71:34266) 2023-10-09T07:58:24.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.255+0000 7fa4a4f9b700 1 -- 172.21.15.71:0/4237840180 learned_addr learned my addr 172.21.15.71:0/4237840180 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:24.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.255+0000 7fa4a579c700 1 --2- 172.21.15.71:0/4237840180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4a00ccf90 0x7fa4a00a8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:24.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.255+0000 7fa49ffff700 1 --2- 172.21.15.71:0/4237840180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4a00cbf30 0x7fa4a00a81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:24.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.255+0000 7fa4a4f9b700 1 -- 172.21.15.71:0/4237840180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4a00ccf90 msgr2=0x7fa4a00a8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:24.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.255+0000 7fa4a4f9b700 1 --2- 172.21.15.71:0/4237840180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4a00ccf90 0x7fa4a00a8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:24.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.255+0000 7fa4a4f9b700 1 -- 172.21.15.71:0/4237840180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4a00cbf30 msgr2=0x7fa4a00a81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:24.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.255+0000 7fa4a4f9b700 1 --2- 172.21.15.71:0/4237840180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4a00cbf30 0x7fa4a00a81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:24.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.255+0000 7fa4a4f9b700 1 -- 172.21.15.71:0/4237840180 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48c0094f0 con 0x7fa4a00b1420 2023-10-09T07:58:24.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.255+0000 7fa4a4f9b700 1 --2- 172.21.15.71:0/4237840180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4a00b1420 0x7fa4a00acab0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fa49400c7e0 tx=0x7fa494007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:24.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.256+0000 7fa49cff9700 1 -- 172.21.15.71:0/4237840180 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa494011590 con 0x7fa4a00b1420 2023-10-09T07:58:24.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.256+0000 7fa49cff9700 1 -- 172.21.15.71:0/4237840180 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4940116f0 con 0x7fa4a00b1420 2023-10-09T07:58:24.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.256+0000 7fa49cff9700 1 -- 172.21.15.71:0/4237840180 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa494011ab0 con 0x7fa4a00b1420 2023-10-09T07:58:24.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.256+0000 7fa4a71ff700 1 -- 172.21.15.71:0/4237840180 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a00a61a0 con 0x7fa4a00b1420 2023-10-09T07:58:24.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.256+0000 7fa4a71ff700 1 -- 172.21.15.71:0/4237840180 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a00acff0 con 0x7fa4a00b1420 2023-10-09T07:58:24.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.257+0000 7fa4a71ff700 1 -- 172.21.15.71:0/4237840180 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a004c3c0 con 0x7fa4a00b1420 2023-10-09T07:58:24.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.258+0000 7fa49cff9700 1 -- 172.21.15.71:0/4237840180 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa49401b3b0 con 0x7fa4a00b1420 2023-10-09T07:58:24.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.258+0000 7fa49cff9700 1 --2- 172.21.15.71:0/4237840180 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa484066f30 0x7fa4840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:24.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.259+0000 7fa49cff9700 1 -- 172.21.15.71:0/4237840180 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fa494083d20 con 0x7fa4a00b1420 2023-10-09T07:58:24.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.259+0000 7fa49ffff700 1 --2- 172.21.15.71:0/4237840180 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa484066f30 0x7fa4840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:24.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.260+0000 7fa49ffff700 1 --2- 172.21.15.71:0/4237840180 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa484066f30 0x7fa4840693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa48c0099b0 tx=0x7fa48c017000 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:24.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.263+0000 7fa49cff9700 1 -- 172.21.15.71:0/4237840180 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa494050dc0 con 0x7fa4a00b1420 2023-10-09T07:58:24.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.453+0000 7fa4a71ff700 1 -- 172.21.15.71:0/4237840180 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4a006f8a0 con 0x7fa4a00b1420 2023-10-09T07:58:24.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.454+0000 7fa49cff9700 1 -- 172.21.15.71:0/4237840180 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+16087 (secure 0 0 0) 0x7fa494017070 con 0x7fa4a00b1420 2023-10-09T07:58:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:58:24.455 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":175,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:58:23.490279+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:58:21.144208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T07:58:22.473710+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:58:24.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.457+0000 7fa4a71ff700 1 -- 172.21.15.71:0/4237840180 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa484066f30 msgr2=0x7fa4840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:24.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.457+0000 7fa4a71ff700 1 --2- 172.21.15.71:0/4237840180 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa484066f30 0x7fa4840693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa48c0099b0 tx=0x7fa48c017000 comp rx=0 tx=0).stop 2023-10-09T07:58:24.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.457+0000 7fa4a71ff700 1 -- 172.21.15.71:0/4237840180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4a00b1420 msgr2=0x7fa4a00acab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:24.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.457+0000 7fa4a71ff700 1 --2- 172.21.15.71:0/4237840180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4a00b1420 0x7fa4a00acab0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fa49400c7e0 tx=0x7fa494007da0 comp rx=0 tx=0).stop 2023-10-09T07:58:24.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.457+0000 7fa4a71ff700 1 -- 172.21.15.71:0/4237840180 shutdown_connections 2023-10-09T07:58:24.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.457+0000 7fa4a71ff700 1 --2- 172.21.15.71:0/4237840180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4a00ccf90 0x7fa4a00a8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:24.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.457+0000 7fa4a71ff700 1 --2- 172.21.15.71:0/4237840180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa4a00b1420 0x7fa4a00acab0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:24.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.457+0000 7fa4a71ff700 1 --2- 172.21.15.71:0/4237840180 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fa484066f30 0x7fa4840693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:24.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.457+0000 7fa4a71ff700 1 --2- 172.21.15.71:0/4237840180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4a00cbf30 0x7fa4a00a81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:24.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.457+0000 7fa4a71ff700 1 -- 172.21.15.71:0/4237840180 >> 172.21.15.71:0/4237840180 conn(0x7fa4a006a320 msgr2=0x7fa4a00cb050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:24.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.457+0000 7fa4a71ff700 1 -- 172.21.15.71:0/4237840180 shutdown_connections 2023-10-09T07:58:24.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.457+0000 7fa4a71ff700 1 -- 172.21.15.71:0/4237840180 wait complete. 2023-10-09T07:58:24.476 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:58:24.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.656+0000 7f98e53ff700 1 Processor -- start 2023-10-09T07:58:24.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.656+0000 7f98e53ff700 1 -- start start 2023-10-09T07:58:24.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.657+0000 7f98e53ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f98e00b1850 0x7f98e00b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:24.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.657+0000 7f98e53ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e00cb300 con 0x7f98e00ae680 2023-10-09T07:58:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.657+0000 7f98e53ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e00cb5e0 con 0x7f98e01579f0 2023-10-09T07:58:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.657+0000 7f98e53ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e006fc30 con 0x7f98e00b1850 2023-10-09T07:58:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.658+0000 7f98de7fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f98e00ae680 0x7f98e01572e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34434/0 (socket says 172.21.15.71:34434) 2023-10-09T07:58:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.658+0000 7f98de7fc700 1 -- 172.21.15.71:0/3151455571 learned_addr learned my addr 172.21.15.71:0/3151455571 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.658+0000 7f98deffd700 1 --2- 172.21.15.71:0/3151455571 >> v2:172.21.15.179:3300/0 conn(0x7f98e00b1850 0x7f98e00b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.658+0000 7f98deffd700 1 -- 172.21.15.71:0/3151455571 >> v1:172.21.15.179:6789/0 conn(0x7f98e01579f0 legacy=0x7f98e00abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:24.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.658+0000 7f98deffd700 1 -- 172.21.15.71:0/3151455571 >> v1:172.21.15.71:6789/0 conn(0x7f98e00ae680 legacy=0x7f98e01572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:24.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.658+0000 7f98deffd700 1 -- 172.21.15.71:0/3151455571 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e00cb8c0 con 0x7f98e00b1850 2023-10-09T07:58:24.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.659+0000 7f98deffd700 1 --2- 172.21.15.71:0/3151455571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98e00b1850 0x7f98e00b1c20 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f98d00098e0 tx=0x7f98d00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79cdd3b788d7deba server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:24.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.662+0000 7f98ddffb700 1 -- 172.21.15.71:0/3151455571 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d0009e80 con 0x7f98e00b1850 2023-10-09T07:58:24.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.662+0000 7f98ddffb700 1 -- 172.21.15.71:0/3151455571 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d000b860 con 0x7f98e00b1850 2023-10-09T07:58:24.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.662+0000 7f98ddffb700 1 -- 172.21.15.71:0/3151455571 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d000bbe0 con 0x7f98e00b1850 2023-10-09T07:58:24.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.662+0000 7f98e53ff700 1 -- 172.21.15.71:0/3151455571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98e00b1850 msgr2=0x7f98e00b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:24.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.662+0000 7f98e53ff700 1 --2- 172.21.15.71:0/3151455571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98e00b1850 0x7f98e00b1c20 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f98d00098e0 tx=0x7f98d00091a0 comp rx=0 tx=0).stop 2023-10-09T07:58:24.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.663+0000 7f98e53ff700 1 -- 172.21.15.71:0/3151455571 shutdown_connections 2023-10-09T07:58:24.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.663+0000 7f98e53ff700 1 --2- 172.21.15.71:0/3151455571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98e00b1850 0x7f98e00b1c20 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:24.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.663+0000 7f98e53ff700 1 -- 172.21.15.71:0/3151455571 >> 172.21.15.71:0/3151455571 conn(0x7f98e006a320 msgr2=0x7f98e00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:24.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.663+0000 7f98e53ff700 1 -- 172.21.15.71:0/3151455571 shutdown_connections 2023-10-09T07:58:24.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.663+0000 7f98e53ff700 1 -- 172.21.15.71:0/3151455571 wait complete. 2023-10-09T07:58:24.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.664+0000 7f98e53ff700 1 Processor -- start 2023-10-09T07:58:24.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.664+0000 7f98e53ff700 1 -- start start 2023-10-09T07:58:24.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.665+0000 7f98e53ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98e00ae680 0x7f98e0146170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.665+0000 7f98e53ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98e00b1850 0x7f98e01556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.665+0000 7f98e53ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98e01579f0 0x7f98e0155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.665+0000 7f98e53ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e00cc260 con 0x7f98e00b1850 2023-10-09T07:58:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.665+0000 7f98e53ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e0156250 con 0x7f98e01579f0 2023-10-09T07:58:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.665+0000 7f98e53ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e0153270 con 0x7f98e00ae680 2023-10-09T07:58:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.665+0000 7f98de7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98e00b1850 0x7f98e01556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.665+0000 7f98de7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98e00b1850 0x7f98e01556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34268/0 (socket says 172.21.15.71:34268) 2023-10-09T07:58:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.665+0000 7f98de7fc700 1 -- 172.21.15.71:0/3430769999 learned_addr learned my addr 172.21.15.71:0/3430769999 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.666+0000 7f98deffd700 1 --2- 172.21.15.71:0/3430769999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98e00ae680 0x7f98e0146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.666+0000 7f98df7fe700 1 --2- 172.21.15.71:0/3430769999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98e01579f0 0x7f98e0155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.666+0000 7f98de7fc700 1 -- 172.21.15.71:0/3430769999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98e00ae680 msgr2=0x7f98e0146170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.666+0000 7f98de7fc700 1 --2- 172.21.15.71:0/3430769999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98e00ae680 0x7f98e0146170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.666+0000 7f98de7fc700 1 -- 172.21.15.71:0/3430769999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98e01579f0 msgr2=0x7f98e0155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.666+0000 7f98de7fc700 1 --2- 172.21.15.71:0/3430769999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98e01579f0 0x7f98e0155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.666+0000 7f98de7fc700 1 -- 172.21.15.71:0/3430769999 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d0009420 con 0x7f98e00b1850 2023-10-09T07:58:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.666+0000 7f98de7fc700 1 --2- 172.21.15.71:0/3430769999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98e00b1850 0x7f98e01556b0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f98d400c7c0 tx=0x7f98d4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.666+0000 7f98c6ffd700 1 -- 172.21.15.71:0/3430769999 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d4005b30 con 0x7f98e00b1850 2023-10-09T07:58:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.666+0000 7f98c6ffd700 1 -- 172.21.15.71:0/3430769999 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d4005c90 con 0x7f98e00b1850 2023-10-09T07:58:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.666+0000 7f98e53ff700 1 -- 172.21.15.71:0/3430769999 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e016d770 con 0x7f98e00b1850 2023-10-09T07:58:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.666+0000 7f98c6ffd700 1 -- 172.21.15.71:0/3430769999 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d4004a80 con 0x7f98e00b1850 2023-10-09T07:58:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.667+0000 7f98e53ff700 1 -- 172.21.15.71:0/3430769999 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e016dd30 con 0x7f98e00b1850 2023-10-09T07:58:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.667+0000 7f98e53ff700 1 -- 172.21.15.71:0/3430769999 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e004c3c0 con 0x7f98e00b1850 2023-10-09T07:58:24.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.668+0000 7f98c6ffd700 1 -- 172.21.15.71:0/3430769999 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f98d40070d0 con 0x7f98e00b1850 2023-10-09T07:58:24.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.669+0000 7f98c6ffd700 1 --2- 172.21.15.71:0/3430769999 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f98cc066f30 0x7f98cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:24.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.669+0000 7f98c6ffd700 1 -- 172.21.15.71:0/3430769999 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f98d4083aa0 con 0x7f98e00b1850 2023-10-09T07:58:24.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.670+0000 7f98deffd700 1 --2- 172.21.15.71:0/3430769999 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f98cc066f30 0x7f98cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:24.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.670+0000 7f98deffd700 1 --2- 172.21.15.71:0/3430769999 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f98cc066f30 0x7f98cc0693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f98d00093f0 tx=0x7f98d0017000 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:24.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.673+0000 7f98c6ffd700 1 -- 172.21.15.71:0/3430769999 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98d404b5a0 con 0x7f98e00b1850 2023-10-09T07:58:24.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.865+0000 7f98e53ff700 1 -- 172.21.15.71:0/3430769999 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98e00cbba0 con 0x7f98e00b1850 2023-10-09T07:58:24.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.866+0000 7f98c6ffd700 1 -- 172.21.15.71:0/3430769999 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+16087 (secure 0 0 0) 0x7f98d4083070 con 0x7f98e00b1850 2023-10-09T07:58:24.867 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:58:24.867 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":175,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:58:23.490279+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:58:21.144208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T07:58:22.473710+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:58:24.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.868+0000 7f98e53ff700 1 -- 172.21.15.71:0/3430769999 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f98cc066f30 msgr2=0x7f98cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:24.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.868+0000 7f98e53ff700 1 --2- 172.21.15.71:0/3430769999 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f98cc066f30 0x7f98cc0693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f98d00093f0 tx=0x7f98d0017000 comp rx=0 tx=0).stop 2023-10-09T07:58:24.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.868+0000 7f98e53ff700 1 -- 172.21.15.71:0/3430769999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98e00b1850 msgr2=0x7f98e01556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:24.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.868+0000 7f98e53ff700 1 --2- 172.21.15.71:0/3430769999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98e00b1850 0x7f98e01556b0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f98d400c7c0 tx=0x7f98d4007f70 comp rx=0 tx=0).stop 2023-10-09T07:58:24.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.868+0000 7f98e53ff700 1 -- 172.21.15.71:0/3430769999 shutdown_connections 2023-10-09T07:58:24.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.868+0000 7f98e53ff700 1 --2- 172.21.15.71:0/3430769999 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f98cc066f30 0x7f98cc0693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:24.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.868+0000 7f98e53ff700 1 --2- 172.21.15.71:0/3430769999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98e01579f0 0x7f98e0155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:24.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.868+0000 7f98e53ff700 1 --2- 172.21.15.71:0/3430769999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98e00ae680 0x7f98e0146170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:24.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.868+0000 7f98e53ff700 1 --2- 172.21.15.71:0/3430769999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98e00b1850 0x7f98e01556b0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:24.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.868+0000 7f98e53ff700 1 -- 172.21.15.71:0/3430769999 >> 172.21.15.71:0/3430769999 conn(0x7f98e006a320 msgr2=0x7f98e0068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:24.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.868+0000 7f98e53ff700 1 -- 172.21.15.71:0/3430769999 shutdown_connections 2023-10-09T07:58:24.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:24.868+0000 7f98e53ff700 1 -- 172.21.15.71:0/3430769999 wait complete. 2023-10-09T07:58:24.887 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T07:58:24.996 INFO:tasks.ceph.mds.c.smithi071.stderr:2023-10-09T07:58:24.995+0000 7f40eb1f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T07:58:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.072+0000 7fe3ad9ff700 1 Processor -- start 2023-10-09T07:58:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.073+0000 7fe3ad9ff700 1 -- start start 2023-10-09T07:58:25.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.074+0000 7fe3ad9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe3a80c83f0 0x7fe3a80c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.074+0000 7fe3ad9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a81568e0 0x7fe3a80ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.074+0000 7fe3ad9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a815b0d0 con 0x7fe3a80ccee0 2023-10-09T07:58:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.074+0000 7fe3ad9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a80c7a60 con 0x7fe3a80c83f0 2023-10-09T07:58:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.074+0000 7fe3ad9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a815a4c0 con 0x7fe3a81568e0 2023-10-09T07:58:25.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.074+0000 7fe3a6ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe3a80c83f0 0x7fe3a80c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:25.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.074+0000 7fe3a67fc700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fe3a80ccee0 0x7fe3a81561d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:54704/0 (socket says 172.21.15.71:54704) 2023-10-09T07:58:25.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.074+0000 7fe3a67fc700 1 -- 172.21.15.71:0/3692737932 learned_addr learned my addr 172.21.15.71:0/3692737932 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:25.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.074+0000 7fe3a77fe700 1 --2- 172.21.15.71:0/3692737932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a81568e0 0x7fe3a80ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:25.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.075+0000 7fe3a6ffd700 1 -- 172.21.15.71:0/3692737932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a81568e0 msgr2=0x7fe3a80ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:25.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.075+0000 7fe3a6ffd700 1 --2- 172.21.15.71:0/3692737932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a81568e0 0x7fe3a80ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:25.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.075+0000 7fe3a6ffd700 1 -- 172.21.15.71:0/3692737932 >> v1:172.21.15.179:6789/0 conn(0x7fe3a80ccee0 legacy=0x7fe3a81561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:25.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.075+0000 7fe3a6ffd700 1 -- 172.21.15.71:0/3692737932 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a815a7a0 con 0x7fe3a80c83f0 2023-10-09T07:58:25.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.075+0000 7fe3a77fe700 1 --2- 172.21.15.71:0/3692737932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a81568e0 0x7fe3a80ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:58:25.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.075+0000 7fe3a6ffd700 1 --2- 172.21.15.71:0/3692737932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a80c83f0 0x7fe3a80c7520 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fe3980098e0 tx=0x7fe3980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=542d9f972ddbc397 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:25.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.075+0000 7fe3a5ffb700 1 -- 172.21.15.71:0/3692737932 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe398011630 con 0x7fe3a80c83f0 2023-10-09T07:58:25.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.076+0000 7fe3a5ffb700 1 -- 172.21.15.71:0/3692737932 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe398011790 con 0x7fe3a80c83f0 2023-10-09T07:58:25.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.076+0000 7fe3a5ffb700 1 -- 172.21.15.71:0/3692737932 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe398011b30 con 0x7fe3a80c83f0 2023-10-09T07:58:25.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.076+0000 7fe3ad9ff700 1 -- 172.21.15.71:0/3692737932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a80c83f0 msgr2=0x7fe3a80c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:25.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.076+0000 7fe3ad9ff700 1 --2- 172.21.15.71:0/3692737932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a80c83f0 0x7fe3a80c7520 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fe3980098e0 tx=0x7fe3980091a0 comp rx=0 tx=0).stop 2023-10-09T07:58:25.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.076+0000 7fe3ad9ff700 1 -- 172.21.15.71:0/3692737932 shutdown_connections 2023-10-09T07:58:25.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.076+0000 7fe3ad9ff700 1 --2- 172.21.15.71:0/3692737932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a81568e0 0x7fe3a80ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:25.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.076+0000 7fe3ad9ff700 1 --2- 172.21.15.71:0/3692737932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a80c83f0 0x7fe3a80c7520 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:25.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.076+0000 7fe3ad9ff700 1 -- 172.21.15.71:0/3692737932 >> 172.21.15.71:0/3692737932 conn(0x7fe3a8068e10 msgr2=0x7fe3a80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:25.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.076+0000 7fe3ad9ff700 1 -- 172.21.15.71:0/3692737932 shutdown_connections 2023-10-09T07:58:25.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.076+0000 7fe3ad9ff700 1 -- 172.21.15.71:0/3692737932 wait complete. 2023-10-09T07:58:25.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.078+0000 7fe3ad9ff700 1 Processor -- start 2023-10-09T07:58:25.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.078+0000 7fe3ad9ff700 1 -- start start 2023-10-09T07:58:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.079+0000 7fe3ad9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a80c83f0 0x7fe3a8159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.079+0000 7fe3ad9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a80ccee0 0x7fe3a80c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.079+0000 7fe3ad9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a81568e0 0x7fe3a8156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.079+0000 7fe3ad9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a80c2c60 con 0x7fe3a80c83f0 2023-10-09T07:58:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.079+0000 7fe3ad9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a80c21d0 con 0x7fe3a80ccee0 2023-10-09T07:58:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.079+0000 7fe3ad9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a80b0410 con 0x7fe3a81568e0 2023-10-09T07:58:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.079+0000 7fe3a6ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a80c83f0 0x7fe3a8159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.079+0000 7fe3a6ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a80c83f0 0x7fe3a8159770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42712/0 (socket says 172.21.15.71:42712) 2023-10-09T07:58:25.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.079+0000 7fe3a6ffd700 1 -- 172.21.15.71:0/1339739315 learned_addr learned my addr 172.21.15.71:0/1339739315 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:25.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.079+0000 7fe3a6ffd700 1 -- 172.21.15.71:0/1339739315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a81568e0 msgr2=0x7fe3a8156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:25.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.079+0000 7fe3a6ffd700 1 --2- 172.21.15.71:0/1339739315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a81568e0 0x7fe3a8156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:25.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.079+0000 7fe3a6ffd700 1 -- 172.21.15.71:0/1339739315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a80ccee0 msgr2=0x7fe3a80c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:25.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.079+0000 7fe3a6ffd700 1 --2- 172.21.15.71:0/1339739315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a80ccee0 0x7fe3a80c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:25.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.079+0000 7fe3a6ffd700 1 -- 172.21.15.71:0/1339739315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a0009a20 con 0x7fe3a80c83f0 2023-10-09T07:58:25.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.080+0000 7fe3a6ffd700 1 --2- 172.21.15.71:0/1339739315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a80c83f0 0x7fe3a8159770 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fe3980030c0 tx=0x7fe398016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:25.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.080+0000 7fe38effd700 1 -- 172.21.15.71:0/1339739315 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39801a450 con 0x7fe3a80c83f0 2023-10-09T07:58:25.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.080+0000 7fe38effd700 1 -- 172.21.15.71:0/1339739315 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39801a5b0 con 0x7fe3a80c83f0 2023-10-09T07:58:25.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.080+0000 7fe3ad9ff700 1 -- 172.21.15.71:0/1339739315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe398009420 con 0x7fe3a80c83f0 2023-10-09T07:58:25.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.080+0000 7fe38effd700 1 -- 172.21.15.71:0/1339739315 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39801a970 con 0x7fe3a80c83f0 2023-10-09T07:58:25.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.080+0000 7fe3ad9ff700 1 -- 172.21.15.71:0/1339739315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a80c26a0 con 0x7fe3a80c83f0 2023-10-09T07:58:25.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.081+0000 7fe3ad9ff700 1 -- 172.21.15.71:0/1339739315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a804c3c0 con 0x7fe3a80c83f0 2023-10-09T07:58:25.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.082+0000 7fe38effd700 1 -- 172.21.15.71:0/1339739315 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe39802e440 con 0x7fe3a80c83f0 2023-10-09T07:58:25.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.083+0000 7fe38effd700 1 --2- 172.21.15.71:0/1339739315 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe394066f30 0x7fe3940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:25.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.083+0000 7fe38effd700 1 -- 172.21.15.71:0/1339739315 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fe398086620 con 0x7fe3a80c83f0 2023-10-09T07:58:25.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.083+0000 7fe3a67fc700 1 --2- 172.21.15.71:0/1339739315 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe394066f30 0x7fe3940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:25.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.084+0000 7fe3a67fc700 1 --2- 172.21.15.71:0/1339739315 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe394066f30 0x7fe3940693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe39c007fd0 tx=0x7fe39c007b00 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:25.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.087+0000 7fe38effd700 1 -- 172.21.15.71:0/1339739315 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3980536c0 con 0x7fe3a80c83f0 2023-10-09T07:58:25.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:25.327+0000 7fe3ad9ff700 1 -- 172.21.15.71:0/1339739315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe3a804c3c0 con 0x7fe3a80c83f0 2023-10-09T07:58:26.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.045+0000 7fe38effd700 1 -- 172.21.15.71:0/1339739315 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v81) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe398056ce0 con 0x7fe3a80c83f0 2023-10-09T07:58:26.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.047+0000 7fe3ad9ff700 1 -- 172.21.15.71:0/1339739315 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe394066f30 msgr2=0x7fe3940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:26.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.047+0000 7fe3ad9ff700 1 --2- 172.21.15.71:0/1339739315 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe394066f30 0x7fe3940693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe39c007fd0 tx=0x7fe39c007b00 comp rx=0 tx=0).stop 2023-10-09T07:58:26.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.047+0000 7fe3ad9ff700 1 -- 172.21.15.71:0/1339739315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a80c83f0 msgr2=0x7fe3a8159770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:26.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.047+0000 7fe3ad9ff700 1 --2- 172.21.15.71:0/1339739315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a80c83f0 0x7fe3a8159770 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fe3980030c0 tx=0x7fe398016000 comp rx=0 tx=0).stop 2023-10-09T07:58:26.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.048+0000 7fe3ad9ff700 1 -- 172.21.15.71:0/1339739315 shutdown_connections 2023-10-09T07:58:26.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.048+0000 7fe3ad9ff700 1 --2- 172.21.15.71:0/1339739315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a81568e0 0x7fe3a8156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:26.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.048+0000 7fe3ad9ff700 1 --2- 172.21.15.71:0/1339739315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a80c83f0 0x7fe3a8159770 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:26.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.048+0000 7fe3ad9ff700 1 --2- 172.21.15.71:0/1339739315 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fe394066f30 0x7fe3940693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:26.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.048+0000 7fe3ad9ff700 1 --2- 172.21.15.71:0/1339739315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a80ccee0 0x7fe3a80c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:26.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.048+0000 7fe3ad9ff700 1 -- 172.21.15.71:0/1339739315 >> 172.21.15.71:0/1339739315 conn(0x7fe3a8068e10 msgr2=0x7fe3a80c87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:26.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.048+0000 7fe3ad9ff700 1 -- 172.21.15.71:0/1339739315 shutdown_connections 2023-10-09T07:58:26.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.048+0000 7fe3ad9ff700 1 -- 172.21.15.71:0/1339739315 wait complete. 2023-10-09T07:58:26.068 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T07:58:26.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.252+0000 7f5cf97ff700 1 Processor -- start 2023-10-09T07:58:26.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.252+0000 7f5cf97ff700 1 -- start start 2023-10-09T07:58:26.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.254+0000 7f5cf97ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5cf40c83f0 0x7f5cf40c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:26.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.254+0000 7f5cf97ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf415b0d0 con 0x7f5cf40ccee0 2023-10-09T07:58:26.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.254+0000 7f5cf97ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf40c7a60 con 0x7f5cf41568e0 2023-10-09T07:58:26.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.254+0000 7f5cf97ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf415a4c0 con 0x7f5cf40c83f0 2023-10-09T07:58:26.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.254+0000 7f5cebfff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f5cf40ccee0 0x7f5cf41561d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53484/0 (socket says 172.21.15.71:53484) 2023-10-09T07:58:26.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.254+0000 7f5cebfff700 1 -- 172.21.15.71:0/4185833769 learned_addr learned my addr 172.21.15.71:0/4185833769 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:26.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.254+0000 7f5cf2ffd700 1 --2- 172.21.15.71:0/4185833769 >> v2:172.21.15.179:3300/0 conn(0x7f5cf40c83f0 0x7f5cf40c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:26.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.254+0000 7f5cf27fc700 1 -- 172.21.15.71:0/4185833769 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015339079 0 0) 0x7f5cf415b0d0 con 0x7f5cf40ccee0 2023-10-09T07:58:26.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.254+0000 7f5cf27fc700 1 -- 172.21.15.71:0/4185833769 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ce0003570 con 0x7f5cf40ccee0 2023-10-09T07:58:26.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.255+0000 7f5cf27fc700 1 -- 172.21.15.71:0/4185833769 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 901768687 0 0) 0x7f5ce0003570 con 0x7f5cf40ccee0 2023-10-09T07:58:26.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.255+0000 7f5cf27fc700 1 -- 172.21.15.71:0/4185833769 >> v2:172.21.15.179:3300/0 conn(0x7f5cf40c83f0 msgr2=0x7f5cf40c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:26.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.255+0000 7f5cf27fc700 1 --2- 172.21.15.71:0/4185833769 >> v2:172.21.15.179:3300/0 conn(0x7f5cf40c83f0 0x7f5cf40c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:26.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.255+0000 7f5cf27fc700 1 -- 172.21.15.71:0/4185833769 >> v1:172.21.15.179:6789/0 conn(0x7f5cf41568e0 legacy=0x7f5cf40ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:26.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.255+0000 7f5cf27fc700 1 -- 172.21.15.71:0/4185833769 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf415a7a0 con 0x7f5cf40ccee0 2023-10-09T07:58:26.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.255+0000 7f5cf27fc700 1 -- 172.21.15.71:0/4185833769 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f5cdc001470 con 0x7f5cf40ccee0 2023-10-09T07:58:26.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.255+0000 7f5cf27fc700 1 -- 172.21.15.71:0/4185833769 >> v1:172.21.15.71:6789/0 conn(0x7f5cf40ccee0 legacy=0x7f5cf41561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:26.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.255+0000 7f5cf27fc700 1 --2- 172.21.15.71:0/4185833769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ce0003a60 0x7f5ce0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:26.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.255+0000 7f5cf27fc700 1 --2- 172.21.15.71:0/4185833769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce0004810 0x7f5ce0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:26.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.255+0000 7f5cf27fc700 1 --2- 172.21.15.71:0/4185833769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ce00051c0 0x7f5ce000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:26.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.255+0000 7f5cf27fc700 1 -- 172.21.15.71:0/4185833769 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf415a4c0 con 0x7f5ce0004810 2023-10-09T07:58:26.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.255+0000 7f5cf27fc700 1 -- 172.21.15.71:0/4185833769 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce000c050 con 0x7f5ce00051c0 2023-10-09T07:58:26.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.255+0000 7f5cf27fc700 1 -- 172.21.15.71:0/4185833769 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce000c210 con 0x7f5ce0003a60 2023-10-09T07:58:26.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.255+0000 7f5cebfff700 1 --2- 172.21.15.71:0/4185833769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce0004810 0x7f5ce0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:26.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.255+0000 7f5cf2ffd700 1 --2- 172.21.15.71:0/4185833769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ce0003a60 0x7f5ce0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:26.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.255+0000 7f5cf37fe700 1 --2- 172.21.15.71:0/4185833769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ce00051c0 0x7f5ce000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:26.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.255+0000 7f5cebfff700 1 -- 172.21.15.71:0/4185833769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ce0003a60 msgr2=0x7f5ce0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:26.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.255+0000 7f5cebfff700 1 --2- 172.21.15.71:0/4185833769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ce0003a60 0x7f5ce0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:26.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.255+0000 7f5cebfff700 1 -- 172.21.15.71:0/4185833769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ce00051c0 msgr2=0x7f5ce000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:26.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.255+0000 7f5cebfff700 1 --2- 172.21.15.71:0/4185833769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ce00051c0 0x7f5ce000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.255+0000 7f5cebfff700 1 -- 172.21.15.71:0/4185833769 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce0003570 con 0x7f5ce0004810 2023-10-09T07:58:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.255+0000 7f5cf37fe700 1 -- 172.21.15.71:0/4185833769 reap_dead start 2023-10-09T07:58:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.255+0000 7f5cf2ffd700 1 --2- 172.21.15.71:0/4185833769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ce0003a60 0x7f5ce0003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:58:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.256+0000 7f5cebfff700 1 --2- 172.21.15.71:0/4185833769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce0004810 0x7f5ce0004c80 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc007ce0 tx=0x7f5cdc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7906a5bb62f4033 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.256+0000 7f5cf27fc700 1 -- 172.21.15.71:0/4185833769 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc00cc60 con 0x7f5ce0004810 2023-10-09T07:58:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.256+0000 7f5cf27fc700 1 -- 172.21.15.71:0/4185833769 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cdc00cdc0 con 0x7f5ce0004810 2023-10-09T07:58:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.256+0000 7f5cf27fc700 1 -- 172.21.15.71:0/4185833769 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc005b70 con 0x7f5ce0004810 2023-10-09T07:58:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.256+0000 7f5cf97ff700 1 -- 172.21.15.71:0/4185833769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce0004810 msgr2=0x7f5ce0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.256+0000 7f5cf97ff700 1 --2- 172.21.15.71:0/4185833769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce0004810 0x7f5ce0004c80 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc007ce0 tx=0x7f5cdc001e70 comp rx=0 tx=0).stop 2023-10-09T07:58:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.256+0000 7f5cf97ff700 1 -- 172.21.15.71:0/4185833769 shutdown_connections 2023-10-09T07:58:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.256+0000 7f5cf97ff700 1 --2- 172.21.15.71:0/4185833769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce0004810 0x7f5ce0004c80 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:26.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.256+0000 7f5cf97ff700 1 -- 172.21.15.71:0/4185833769 >> 172.21.15.71:0/4185833769 conn(0x7f5cf4068e10 msgr2=0x7f5cf40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:26.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.256+0000 7f5cf97ff700 1 -- 172.21.15.71:0/4185833769 shutdown_connections 2023-10-09T07:58:26.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.256+0000 7f5cf97ff700 1 -- 172.21.15.71:0/4185833769 wait complete. 2023-10-09T07:58:26.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.258+0000 7f5cf97ff700 1 Processor -- start 2023-10-09T07:58:26.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.258+0000 7f5cf97ff700 1 -- start start 2023-10-09T07:58:26.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.259+0000 7f5cf97ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce0004810 0x7f5cf4169d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:26.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.259+0000 7f5cf97ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cf4147ee0 0x7f5cf40c3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:26.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.259+0000 7f5cf97ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cf4148350 0x7f5cf40b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:26.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.259+0000 7f5cf97ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf415e670 con 0x7f5ce0004810 2023-10-09T07:58:26.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.259+0000 7f5cf97ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf415da60 con 0x7f5cf4147ee0 2023-10-09T07:58:26.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.259+0000 7f5cf97ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf415dd40 con 0x7f5cf4148350 2023-10-09T07:58:26.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.259+0000 7f5cf2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce0004810 0x7f5cf4169d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:26.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.259+0000 7f5cf2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce0004810 0x7f5cf4169d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42732/0 (socket says 172.21.15.71:42732) 2023-10-09T07:58:26.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.259+0000 7f5cf2ffd700 1 -- 172.21.15.71:0/1316045464 learned_addr learned my addr 172.21.15.71:0/1316045464 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:26.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.259+0000 7f5cf37fe700 1 --2- 172.21.15.71:0/1316045464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cf4148350 0x7f5cf40b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:26.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.259+0000 7f5cebfff700 1 --2- 172.21.15.71:0/1316045464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cf4147ee0 0x7f5cf40c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:26.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.259+0000 7f5cf2ffd700 1 -- 172.21.15.71:0/1316045464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cf4148350 msgr2=0x7f5cf40b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:26.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.259+0000 7f5cf2ffd700 1 --2- 172.21.15.71:0/1316045464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cf4148350 0x7f5cf40b1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:26.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.259+0000 7f5cf2ffd700 1 -- 172.21.15.71:0/1316045464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cf4147ee0 msgr2=0x7f5cf40c3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:26.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.259+0000 7f5cf2ffd700 1 --2- 172.21.15.71:0/1316045464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cf4147ee0 0x7f5cf40c3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:26.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.259+0000 7f5cf2ffd700 1 -- 172.21.15.71:0/1316045464 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf415e020 con 0x7f5ce0004810 2023-10-09T07:58:26.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.259+0000 7f5cebfff700 1 --2- 172.21.15.71:0/1316045464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cf4147ee0 0x7f5cf40c3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:58:26.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.260+0000 7f5cf2ffd700 1 --2- 172.21.15.71:0/1316045464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce0004810 0x7f5cf4169d40 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4011700 tx=0x7f5ce4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:26.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.260+0000 7f5ceaffd700 1 -- 172.21.15.71:0/1316045464 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4015670 con 0x7f5ce0004810 2023-10-09T07:58:26.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.260+0000 7f5ceaffd700 1 -- 172.21.15.71:0/1316045464 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce40157d0 con 0x7f5ce0004810 2023-10-09T07:58:26.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.260+0000 7f5cf97ff700 1 -- 172.21.15.71:0/1316045464 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf415e300 con 0x7f5ce0004810 2023-10-09T07:58:26.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.260+0000 7f5ceaffd700 1 -- 172.21.15.71:0/1316045464 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4015b90 con 0x7f5ce0004810 2023-10-09T07:58:26.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.260+0000 7f5cf97ff700 1 -- 172.21.15.71:0/1316045464 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf415d680 con 0x7f5ce0004810 2023-10-09T07:58:26.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.261+0000 7f5cf97ff700 1 -- 172.21.15.71:0/1316045464 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf415e950 con 0x7f5ce0004810 2023-10-09T07:58:26.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.262+0000 7f5ceaffd700 1 -- 172.21.15.71:0/1316045464 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ce4013410 con 0x7f5ce0004810 2023-10-09T07:58:26.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.263+0000 7f5ceaffd700 1 --2- 172.21.15.71:0/1316045464 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5cd4066f30 0x7f5cd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:26.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.263+0000 7f5ceaffd700 1 -- 172.21.15.71:0/1316045464 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f5ce4084f10 con 0x7f5ce0004810 2023-10-09T07:58:26.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.263+0000 7f5cebfff700 1 --2- 172.21.15.71:0/1316045464 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5cd4066f30 0x7f5cd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:26.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.264+0000 7f5cebfff700 1 --2- 172.21.15.71:0/1316045464 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5cd4066f30 0x7f5cd40693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc006fd0 tx=0x7f5cdc017000 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:26.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.267+0000 7f5ceaffd700 1 -- 172.21.15.71:0/1316045464 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ce4051f10 con 0x7f5ce0004810 2023-10-09T07:58:26.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:26.501+0000 7f5cf97ff700 1 -- 172.21.15.71:0/1316045464 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5cf404c3c0 con 0x7f5ce0004810 2023-10-09T07:58:27.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.051+0000 7f5ceaffd700 1 -- 172.21.15.71:0/1316045464 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v82) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5ce4055530 con 0x7f5ce0004810 2023-10-09T07:58:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.054+0000 7f5cf97ff700 1 -- 172.21.15.71:0/1316045464 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5cd4066f30 msgr2=0x7f5cd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.054+0000 7f5cf97ff700 1 --2- 172.21.15.71:0/1316045464 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5cd4066f30 0x7f5cd40693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc006fd0 tx=0x7f5cdc017000 comp rx=0 tx=0).stop 2023-10-09T07:58:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.054+0000 7f5cf97ff700 1 -- 172.21.15.71:0/1316045464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce0004810 msgr2=0x7f5cf4169d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.054+0000 7f5cf97ff700 1 --2- 172.21.15.71:0/1316045464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce0004810 0x7f5cf4169d40 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4011700 tx=0x7f5ce4008040 comp rx=0 tx=0).stop 2023-10-09T07:58:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.054+0000 7f5cf97ff700 1 -- 172.21.15.71:0/1316045464 shutdown_connections 2023-10-09T07:58:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.054+0000 7f5cf97ff700 1 --2- 172.21.15.71:0/1316045464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cf4148350 0x7f5cf40b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.054+0000 7f5cf97ff700 1 --2- 172.21.15.71:0/1316045464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce0004810 0x7f5cf4169d40 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.054+0000 7f5cf97ff700 1 --2- 172.21.15.71:0/1316045464 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f5cd4066f30 0x7f5cd40693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.054+0000 7f5cf97ff700 1 --2- 172.21.15.71:0/1316045464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cf4147ee0 0x7f5cf40c3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:27.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.054+0000 7f5cf97ff700 1 -- 172.21.15.71:0/1316045464 >> 172.21.15.71:0/1316045464 conn(0x7f5cf4068e10 msgr2=0x7f5cf40cb280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:27.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.054+0000 7f5cf97ff700 1 -- 172.21.15.71:0/1316045464 shutdown_connections 2023-10-09T07:58:27.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.054+0000 7f5cf97ff700 1 -- 172.21.15.71:0/1316045464 wait complete. 2023-10-09T07:58:27.073 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:58:27.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.255+0000 7fd9c47ff700 1 Processor -- start 2023-10-09T07:58:27.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.255+0000 7fd9c47ff700 1 -- start start 2023-10-09T07:58:27.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.256+0000 7fd9c47ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd9bc1578b0 0x7fd9bc155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:27.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.256+0000 7fd9c47ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9bc0ad930 con 0x7fd9bc155c10 2023-10-09T07:58:27.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.256+0000 7fd9c47ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9bc0acd20 con 0x7fd9bc0af2f0 2023-10-09T07:58:27.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.256+0000 7fd9c47ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9bc0ad000 con 0x7fd9bc1578b0 2023-10-09T07:58:27.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.257+0000 7fd9c1d9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd9bc1578b0 0x7fd9bc155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:27.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.257+0000 7fd9c1d9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd9bc1578b0 0x7fd9bc155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42734/0 (socket says 172.21.15.71:42734) 2023-10-09T07:58:27.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.257+0000 7fd9c259b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd9bc155c10 0x7fd9bc0ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53494/0 (socket says 172.21.15.71:53494) 2023-10-09T07:58:27.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.257+0000 7fd9c1d9a700 1 -- 172.21.15.71:0/3622635684 learned_addr learned my addr 172.21.15.71:0/3622635684 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:27.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.257+0000 7fd9c1d9a700 1 -- 172.21.15.71:0/3622635684 >> v1:172.21.15.179:6789/0 conn(0x7fd9bc0af2f0 legacy=0x7fd9bc0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:27.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.257+0000 7fd9c1d9a700 1 -- 172.21.15.71:0/3622635684 >> v1:172.21.15.71:6789/0 conn(0x7fd9bc155c10 legacy=0x7fd9bc0ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:27.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.257+0000 7fd9c1d9a700 1 -- 172.21.15.71:0/3622635684 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9bc0ad2e0 con 0x7fd9bc1578b0 2023-10-09T07:58:27.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.257+0000 7fd9c1d9a700 1 --2- 172.21.15.71:0/3622635684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9bc1578b0 0x7fd9bc155fe0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac0099b0 tx=0x7fd9ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b8d23a5b010c58 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:27.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.258+0000 7fd9c1599700 1 -- 172.21.15.71:0/3622635684 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac00b860 con 0x7fd9bc1578b0 2023-10-09T07:58:27.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.258+0000 7fd9c1599700 1 -- 172.21.15.71:0/3622635684 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ac00b9c0 con 0x7fd9bc1578b0 2023-10-09T07:58:27.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.258+0000 7fd9c1599700 1 -- 172.21.15.71:0/3622635684 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac00bd60 con 0x7fd9bc1578b0 2023-10-09T07:58:27.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.258+0000 7fd9c47ff700 1 -- 172.21.15.71:0/3622635684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9bc1578b0 msgr2=0x7fd9bc155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:27.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.258+0000 7fd9c47ff700 1 --2- 172.21.15.71:0/3622635684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9bc1578b0 0x7fd9bc155fe0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac0099b0 tx=0x7fd9ac009250 comp rx=0 tx=0).stop 2023-10-09T07:58:27.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.258+0000 7fd9c47ff700 1 -- 172.21.15.71:0/3622635684 shutdown_connections 2023-10-09T07:58:27.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.258+0000 7fd9c47ff700 1 --2- 172.21.15.71:0/3622635684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9bc1578b0 0x7fd9bc155fe0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:27.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.258+0000 7fd9c47ff700 1 -- 172.21.15.71:0/3622635684 >> 172.21.15.71:0/3622635684 conn(0x7fd9bc06a320 msgr2=0x7fd9bc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:27.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.258+0000 7fd9c47ff700 1 -- 172.21.15.71:0/3622635684 shutdown_connections 2023-10-09T07:58:27.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.258+0000 7fd9c47ff700 1 -- 172.21.15.71:0/3622635684 wait complete. 2023-10-09T07:58:27.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.260+0000 7fd9c47ff700 1 Processor -- start 2023-10-09T07:58:27.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.260+0000 7fd9c47ff700 1 -- start start 2023-10-09T07:58:27.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.261+0000 7fd9c47ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9bc0af2f0 0x7fd9bc13e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:27.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.261+0000 7fd9c47ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9bc155c10 0x7fd9bc0a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:27.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.261+0000 7fd9c47ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9bc1578b0 0x7fd9bc0ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:27.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.261+0000 7fd9c47ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc13e5b0 con 0x7fd9bc0af2f0 2023-10-09T07:58:27.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.261+0000 7fd9c47ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc0cc140 con 0x7fd9bc1578b0 2023-10-09T07:58:27.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.261+0000 7fd9c47ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc0cb320 con 0x7fd9bc155c10 2023-10-09T07:58:27.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.261+0000 7fd9c259b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9bc0af2f0 0x7fd9bc13e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:27.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.261+0000 7fd9c259b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9bc0af2f0 0x7fd9bc13e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42748/0 (socket says 172.21.15.71:42748) 2023-10-09T07:58:27.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.261+0000 7fd9c259b700 1 -- 172.21.15.71:0/3554052000 learned_addr learned my addr 172.21.15.71:0/3554052000 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:27.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.261+0000 7fd9c1d9a700 1 --2- 172.21.15.71:0/3554052000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9bc155c10 0x7fd9bc0a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:27.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.261+0000 7fd9c2d9c700 1 --2- 172.21.15.71:0/3554052000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9bc1578b0 0x7fd9bc0ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:27.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.261+0000 7fd9c259b700 1 -- 172.21.15.71:0/3554052000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9bc155c10 msgr2=0x7fd9bc0a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:27.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.261+0000 7fd9c259b700 1 --2- 172.21.15.71:0/3554052000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9bc155c10 0x7fd9bc0a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:27.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.261+0000 7fd9c259b700 1 -- 172.21.15.71:0/3554052000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9bc1578b0 msgr2=0x7fd9bc0ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:27.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.261+0000 7fd9c259b700 1 --2- 172.21.15.71:0/3554052000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9bc1578b0 0x7fd9bc0ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:27.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.261+0000 7fd9c259b700 1 -- 172.21.15.71:0/3554052000 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac0094f0 con 0x7fd9bc0af2f0 2023-10-09T07:58:27.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.261+0000 7fd9c1d9a700 1 --2- 172.21.15.71:0/3554052000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9bc155c10 0x7fd9bc0a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:27.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.261+0000 7fd9c2d9c700 1 --2- 172.21.15.71:0/3554052000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9bc1578b0 0x7fd9bc0ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:27.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.262+0000 7fd9c259b700 1 --2- 172.21.15.71:0/3554052000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9bc0af2f0 0x7fd9bc13e070 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800c7c0 tx=0x7fd9b8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:27.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.262+0000 7fd9b27fc700 1 -- 172.21.15.71:0/3554052000 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8005a70 con 0x7fd9bc0af2f0 2023-10-09T07:58:27.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.262+0000 7fd9b27fc700 1 -- 172.21.15.71:0/3554052000 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b8005bf0 con 0x7fd9bc0af2f0 2023-10-09T07:58:27.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.262+0000 7fd9c47ff700 1 -- 172.21.15.71:0/3554052000 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9bc0cb850 con 0x7fd9bc0af2f0 2023-10-09T07:58:27.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.262+0000 7fd9b27fc700 1 -- 172.21.15.71:0/3554052000 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80070f0 con 0x7fd9bc0af2f0 2023-10-09T07:58:27.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.262+0000 7fd9c47ff700 1 -- 172.21.15.71:0/3554052000 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9bc0cbdd0 con 0x7fd9bc0af2f0 2023-10-09T07:58:27.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.263+0000 7fd9c47ff700 1 -- 172.21.15.71:0/3554052000 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9bc04c3c0 con 0x7fd9bc0af2f0 2023-10-09T07:58:27.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.264+0000 7fd9b27fc700 1 -- 172.21.15.71:0/3554052000 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd9b8007460 con 0x7fd9bc0af2f0 2023-10-09T07:58:27.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.264+0000 7fd9b27fc700 1 --2- 172.21.15.71:0/3554052000 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd9a0066f30 0x7fd9a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:27.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.265+0000 7fd9b27fc700 1 -- 172.21.15.71:0/3554052000 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fd9b8084200 con 0x7fd9bc0af2f0 2023-10-09T07:58:27.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.265+0000 7fd9c1d9a700 1 --2- 172.21.15.71:0/3554052000 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd9a0066f30 0x7fd9a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:27.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.266+0000 7fd9c1d9a700 1 --2- 172.21.15.71:0/3554052000 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd9a0066f30 0x7fd9a00693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac0099b0 tx=0x7fd9ac017000 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:27.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.269+0000 7fd9b27fc700 1 -- 172.21.15.71:0/3554052000 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9b8051280 con 0x7fd9bc0af2f0 2023-10-09T07:58:27.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.501+0000 7fd9c47ff700 1 -- 172.21.15.71:0/3554052000 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9bc0ad5c0 con 0x7fd9bc0af2f0 2023-10-09T07:58:27.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.502+0000 7fd9b27fc700 1 -- 172.21.15.71:0/3554052000 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4604 (secure 0 0 0) 0x7fd9b80548a0 con 0x7fd9bc0af2f0 2023-10-09T07:58:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:58:27.503 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/845996701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":845996701},{"type":"v1","addr":"172.21.15.179:6834","nonce":845996701}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8683,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2670735121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2670735121},{"type":"v1","addr":"172.21.15.179:6836","nonce":2670735121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":9084,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/2448704931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2448704931},{"type":"v1","addr":"172.21.15.71:6834","nonce":2448704931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:58:23.490596+0000","modified":"2023-10-09T07:58:27.045250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9087},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9087":{"gid":9087,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/1497898467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":1497898467},{"type":"v1","addr":"172.21.15.71:6835","nonce":1497898467}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T07:58:27.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.504+0000 7fd9c47ff700 1 -- 172.21.15.71:0/3554052000 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd9a0066f30 msgr2=0x7fd9a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:27.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.504+0000 7fd9c47ff700 1 --2- 172.21.15.71:0/3554052000 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd9a0066f30 0x7fd9a00693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac0099b0 tx=0x7fd9ac017000 comp rx=0 tx=0).stop 2023-10-09T07:58:27.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.504+0000 7fd9c47ff700 1 -- 172.21.15.71:0/3554052000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9bc0af2f0 msgr2=0x7fd9bc13e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:27.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.504+0000 7fd9c47ff700 1 --2- 172.21.15.71:0/3554052000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9bc0af2f0 0x7fd9bc13e070 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800c7c0 tx=0x7fd9b8007f70 comp rx=0 tx=0).stop 2023-10-09T07:58:27.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.504+0000 7fd9c47ff700 1 -- 172.21.15.71:0/3554052000 shutdown_connections 2023-10-09T07:58:27.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.504+0000 7fd9c47ff700 1 --2- 172.21.15.71:0/3554052000 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd9a0066f30 0x7fd9a00693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:27.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.504+0000 7fd9c47ff700 1 --2- 172.21.15.71:0/3554052000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9bc1578b0 0x7fd9bc0ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:27.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.504+0000 7fd9c47ff700 1 --2- 172.21.15.71:0/3554052000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9bc0af2f0 0x7fd9bc13e070 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:27.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.504+0000 7fd9c47ff700 1 --2- 172.21.15.71:0/3554052000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9bc155c10 0x7fd9bc0a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:27.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.504+0000 7fd9c47ff700 1 -- 172.21.15.71:0/3554052000 >> 172.21.15.71:0/3554052000 conn(0x7fd9bc06a320 msgr2=0x7fd9bc06e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:27.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.504+0000 7fd9c47ff700 1 -- 172.21.15.71:0/3554052000 shutdown_connections 2023-10-09T07:58:27.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.504+0000 7fd9c47ff700 1 -- 172.21.15.71:0/3554052000 wait complete. 2023-10-09T07:58:27.506 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 82 2023-10-09T07:58:27.522 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T07:58:27.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.702+0000 7f63cf7ff700 1 Processor -- start 2023-10-09T07:58:27.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.702+0000 7f63cf7ff700 1 -- start start 2023-10-09T07:58:27.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.703+0000 7f63cf7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f63c80b0a10 0x7f63c8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:27.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.703+0000 7f63cf7ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c80ad930 con 0x7f63c8155c10 2023-10-09T07:58:27.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.703+0000 7f63cf7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c80acd20 con 0x7f63c81578b0 2023-10-09T07:58:27.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.703+0000 7f63cf7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c80ad000 con 0x7f63c80b0a10 2023-10-09T07:58:27.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.704+0000 7f63cd59b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f63c8155c10 0x7f63c80ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53500/0 (socket says 172.21.15.71:53500) 2023-10-09T07:58:27.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.704+0000 7f63cd59b700 1 -- 172.21.15.71:0/73593590 learned_addr learned my addr 172.21.15.71:0/73593590 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:27.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.704+0000 7f63cdd9c700 1 --2- 172.21.15.71:0/73593590 >> v2:172.21.15.179:3300/0 conn(0x7f63c80b0a10 0x7f63c8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:27.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.704+0000 7f63bffff700 1 -- 172.21.15.71:0/73593590 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263907634 0 0) 0x7f63c80ad930 con 0x7f63c8155c10 2023-10-09T07:58:27.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.704+0000 7f63bffff700 1 -- 172.21.15.71:0/73593590 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63b4003570 con 0x7f63c8155c10 2023-10-09T07:58:27.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.704+0000 7f63bffff700 1 -- 172.21.15.71:0/73593590 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1004387100 0 0) 0x7f63b4003570 con 0x7f63c8155c10 2023-10-09T07:58:27.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.704+0000 7f63bffff700 1 -- 172.21.15.71:0/73593590 >> v2:172.21.15.179:3300/0 conn(0x7f63c80b0a10 msgr2=0x7f63c8155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:27.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.704+0000 7f63bffff700 1 --2- 172.21.15.71:0/73593590 >> v2:172.21.15.179:3300/0 conn(0x7f63c80b0a10 0x7f63c8155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:27.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.704+0000 7f63bffff700 1 -- 172.21.15.71:0/73593590 >> v1:172.21.15.179:6789/0 conn(0x7f63c81578b0 legacy=0x7f63c80af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:27.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.704+0000 7f63bffff700 1 -- 172.21.15.71:0/73593590 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c80ad2e0 con 0x7f63c8155c10 2023-10-09T07:58:27.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.704+0000 7f63bffff700 1 -- 172.21.15.71:0/73593590 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f63c4001470 con 0x7f63c8155c10 2023-10-09T07:58:27.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.705+0000 7f63bffff700 1 -- 172.21.15.71:0/73593590 >> v1:172.21.15.71:6789/0 conn(0x7f63c8155c10 legacy=0x7f63c80ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:27.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.705+0000 7f63bffff700 1 --2- 172.21.15.71:0/73593590 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b4003a60 0x7f63b4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:27.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.705+0000 7f63bffff700 1 --2- 172.21.15.71:0/73593590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63b4004810 0x7f63b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:27.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.705+0000 7f63bffff700 1 --2- 172.21.15.71:0/73593590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b40051c0 0x7f63b400cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:27.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.705+0000 7f63bffff700 1 -- 172.21.15.71:0/73593590 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c80ad000 con 0x7f63b40051c0 2023-10-09T07:58:27.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.705+0000 7f63bffff700 1 -- 172.21.15.71:0/73593590 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b400d1e0 con 0x7f63b4004810 2023-10-09T07:58:27.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.705+0000 7f63bffff700 1 -- 172.21.15.71:0/73593590 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b400d3a0 con 0x7f63b4003a60 2023-10-09T07:58:27.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.705+0000 7f63cdd9c700 1 --2- 172.21.15.71:0/73593590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b40051c0 0x7f63b400cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:27.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.705+0000 7f63ccd9a700 1 --2- 172.21.15.71:0/73593590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63b4004810 0x7f63b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:27.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.705+0000 7f63cd59b700 1 --2- 172.21.15.71:0/73593590 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b4003a60 0x7f63b4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:27.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.705+0000 7f63cdd9c700 1 -- 172.21.15.71:0/73593590 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b4003a60 msgr2=0x7f63b4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:27.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.705+0000 7f63cdd9c700 1 --2- 172.21.15.71:0/73593590 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b4003a60 0x7f63b4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:27.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.705+0000 7f63cdd9c700 1 -- 172.21.15.71:0/73593590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63b4004810 msgr2=0x7f63b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:27.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.705+0000 7f63cdd9c700 1 --2- 172.21.15.71:0/73593590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63b4004810 0x7f63b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:27.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.705+0000 7f63cdd9c700 1 -- 172.21.15.71:0/73593590 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b4003570 con 0x7f63b40051c0 2023-10-09T07:58:27.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.705+0000 7f63ccd9a700 1 --2- 172.21.15.71:0/73593590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63b4004810 0x7f63b4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:58:27.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.705+0000 7f63cdd9c700 1 -- 172.21.15.71:0/73593590 reap_dead start 2023-10-09T07:58:27.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.706+0000 7f63cdd9c700 1 --2- 172.21.15.71:0/73593590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b40051c0 0x7f63b400cb70 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f63c80b0e10 tx=0x7f63c000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de55dcbe34cd0e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:27.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.706+0000 7f63bffff700 1 -- 172.21.15.71:0/73593590 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c000ea90 con 0x7f63b40051c0 2023-10-09T07:58:27.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.706+0000 7f63bffff700 1 -- 172.21.15.71:0/73593590 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c000f040 con 0x7f63b40051c0 2023-10-09T07:58:27.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.706+0000 7f63bffff700 1 -- 172.21.15.71:0/73593590 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c000ee40 con 0x7f63b40051c0 2023-10-09T07:58:27.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.706+0000 7f63cf7ff700 1 -- 172.21.15.71:0/73593590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b40051c0 msgr2=0x7f63b400cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:27.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.706+0000 7f63cf7ff700 1 --2- 172.21.15.71:0/73593590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b40051c0 0x7f63b400cb70 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f63c80b0e10 tx=0x7f63c000b040 comp rx=0 tx=0).stop 2023-10-09T07:58:27.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.706+0000 7f63cf7ff700 1 -- 172.21.15.71:0/73593590 shutdown_connections 2023-10-09T07:58:27.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.706+0000 7f63cf7ff700 1 --2- 172.21.15.71:0/73593590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b40051c0 0x7f63b400cb70 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:27.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.706+0000 7f63cf7ff700 1 -- 172.21.15.71:0/73593590 >> 172.21.15.71:0/73593590 conn(0x7f63c806a320 msgr2=0x7f63c80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:27.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.706+0000 7f63cf7ff700 1 -- 172.21.15.71:0/73593590 shutdown_connections 2023-10-09T07:58:27.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.706+0000 7f63cf7ff700 1 -- 172.21.15.71:0/73593590 wait complete. 2023-10-09T07:58:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.708+0000 7f63cf7ff700 1 Processor -- start 2023-10-09T07:58:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.708+0000 7f63cf7ff700 1 -- start start 2023-10-09T07:58:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.709+0000 7f63cf7ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b40051c0 0x7f63c8158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.709+0000 7f63cf7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63c8152e90 0x7f63c815b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.709+0000 7f63cf7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63c80a54c0 0x7f63c80a5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.709+0000 7f63cf7ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c80a5e70 con 0x7f63b40051c0 2023-10-09T07:58:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.709+0000 7f63cf7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c8153300 con 0x7f63c80a54c0 2023-10-09T07:58:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.709+0000 7f63cf7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c815bd90 con 0x7f63c8152e90 2023-10-09T07:58:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.709+0000 7f63cd59b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b40051c0 0x7f63c8158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.709+0000 7f63cd59b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b40051c0 0x7f63c8158c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42762/0 (socket says 172.21.15.71:42762) 2023-10-09T07:58:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.709+0000 7f63cd59b700 1 -- 172.21.15.71:0/1562049454 learned_addr learned my addr 172.21.15.71:0/1562049454 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.709+0000 7f63cd59b700 1 -- 172.21.15.71:0/1562049454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63c8152e90 msgr2=0x7f63c815b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.709+0000 7f63cd59b700 1 --2- 172.21.15.71:0/1562049454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63c8152e90 0x7f63c815b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.709+0000 7f63cd59b700 1 -- 172.21.15.71:0/1562049454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63c80a54c0 msgr2=0x7f63c80a5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.709+0000 7f63cd59b700 1 --2- 172.21.15.71:0/1562049454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63c80a54c0 0x7f63c80a5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.709+0000 7f63cd59b700 1 -- 172.21.15.71:0/1562049454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c8159210 con 0x7f63b40051c0 2023-10-09T07:58:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.710+0000 7f63cd59b700 1 --2- 172.21.15.71:0/1562049454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b40051c0 0x7f63c8158c00 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f63c400e880 tx=0x7f63c4000d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.710+0000 7f63bd7fa700 1 -- 172.21.15.71:0/1562049454 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c400a580 con 0x7f63b40051c0 2023-10-09T07:58:27.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.710+0000 7f63bd7fa700 1 -- 172.21.15.71:0/1562049454 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c4010040 con 0x7f63b40051c0 2023-10-09T07:58:27.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.710+0000 7f63cf7ff700 1 -- 172.21.15.71:0/1562049454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c81594f0 con 0x7f63b40051c0 2023-10-09T07:58:27.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.710+0000 7f63bd7fa700 1 -- 172.21.15.71:0/1562049454 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c400a950 con 0x7f63b40051c0 2023-10-09T07:58:27.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.710+0000 7f63cf7ff700 1 -- 172.21.15.71:0/1562049454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c8159ab0 con 0x7f63b40051c0 2023-10-09T07:58:27.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.711+0000 7f63cf7ff700 1 -- 172.21.15.71:0/1562049454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c804c3c0 con 0x7f63b40051c0 2023-10-09T07:58:27.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.712+0000 7f63bd7fa700 1 -- 172.21.15.71:0/1562049454 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f63c400acc0 con 0x7f63b40051c0 2023-10-09T07:58:27.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.713+0000 7f63bd7fa700 1 --2- 172.21.15.71:0/1562049454 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f63ac066f30 0x7f63ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:27.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.713+0000 7f63bd7fa700 1 -- 172.21.15.71:0/1562049454 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f63c4083ca0 con 0x7f63b40051c0 2023-10-09T07:58:27.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.713+0000 7f63ccd9a700 1 --2- 172.21.15.71:0/1562049454 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f63ac066f30 0x7f63ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:27.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.714+0000 7f63ccd9a700 1 --2- 172.21.15.71:0/1562049454 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f63ac066f30 0x7f63ac0693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f63b8007fd0 tx=0x7f63b8009040 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:27.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.717+0000 7f63bd7fa700 1 -- 172.21.15.71:0/1562049454 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63c4050d40 con 0x7f63b40051c0 2023-10-09T07:58:27.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.906+0000 7f63cf7ff700 1 -- 172.21.15.71:0/1562049454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63c80ad5c0 con 0x7f63b40051c0 2023-10-09T07:58:27.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.907+0000 7f63bd7fa700 1 -- 172.21.15.71:0/1562049454 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) v1 ==== 74+0+16074 (secure 0 0 0) 0x7f63c4019070 con 0x7f63b40051c0 2023-10-09T07:58:27.908 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:58:27.908 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":176,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T07:58:25.019413+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:58:21.144208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T07:58:22.473710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T07:58:27.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.909+0000 7f63cf7ff700 1 -- 172.21.15.71:0/1562049454 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f63ac066f30 msgr2=0x7f63ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:27.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.909+0000 7f63cf7ff700 1 --2- 172.21.15.71:0/1562049454 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f63ac066f30 0x7f63ac0693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f63b8007fd0 tx=0x7f63b8009040 comp rx=0 tx=0).stop 2023-10-09T07:58:27.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.909+0000 7f63cf7ff700 1 -- 172.21.15.71:0/1562049454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b40051c0 msgr2=0x7f63c8158c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:27.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.909+0000 7f63cf7ff700 1 --2- 172.21.15.71:0/1562049454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b40051c0 0x7f63c8158c00 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f63c400e880 tx=0x7f63c4000d70 comp rx=0 tx=0).stop 2023-10-09T07:58:27.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.909+0000 7f63cf7ff700 1 -- 172.21.15.71:0/1562049454 shutdown_connections 2023-10-09T07:58:27.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.909+0000 7f63cf7ff700 1 --2- 172.21.15.71:0/1562049454 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f63ac066f30 0x7f63ac0693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:27.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.909+0000 7f63cf7ff700 1 --2- 172.21.15.71:0/1562049454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63c80a54c0 0x7f63c80a5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:27.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.909+0000 7f63cf7ff700 1 --2- 172.21.15.71:0/1562049454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b40051c0 0x7f63c8158c00 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:27.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.909+0000 7f63cf7ff700 1 --2- 172.21.15.71:0/1562049454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63c8152e90 0x7f63c815b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:27.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.909+0000 7f63cf7ff700 1 -- 172.21.15.71:0/1562049454 >> 172.21.15.71:0/1562049454 conn(0x7f63c806a320 msgr2=0x7f63c8154b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:27.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.909+0000 7f63cf7ff700 1 -- 172.21.15.71:0/1562049454 shutdown_connections 2023-10-09T07:58:27.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:27.909+0000 7f63cf7ff700 1 -- 172.21.15.71:0/1562049454 wait complete. 2023-10-09T07:58:27.928 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T07:58:27.928 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T07:58:28.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.110+0000 7f4177fff700 1 Processor -- start 2023-10-09T07:58:28.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.110+0000 7f4177fff700 1 -- start start 2023-10-09T07:58:28.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.111+0000 7f4177fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f41780ad870 0x7f417806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:28.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.111+0000 7f4177fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41780b40f0 con 0x7f4178142ea0 2023-10-09T07:58:28.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.111+0000 7f4177fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4178069640 con 0x7f417806bf20 2023-10-09T07:58:28.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.111+0000 7f4177fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417806c3a0 con 0x7f41780ad870 2023-10-09T07:58:28.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.111+0000 7f4176ffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f4178142ea0 0x7f41780b3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53516/0 (socket says 172.21.15.71:53516) 2023-10-09T07:58:28.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.111+0000 7f4176ffd700 1 -- 172.21.15.71:0/1782114268 learned_addr learned my addr 172.21.15.71:0/1782114268 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:28.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.111+0000 7f41767fc700 1 --2- 172.21.15.71:0/1782114268 >> v2:172.21.15.71:3300/0 conn(0x7f41780ad870 0x7f417806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:28.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.112+0000 7f4175ffb700 1 -- 172.21.15.71:0/1782114268 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1113682311 0 0) 0x7f41780b40f0 con 0x7f4178142ea0 2023-10-09T07:58:28.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.112+0000 7f41767fc700 1 -- 172.21.15.71:0/1782114268 >> v1:172.21.15.179:6789/0 conn(0x7f417806bf20 legacy=0x7f417806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:28.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.112+0000 7f41767fc700 1 -- 172.21.15.71:0/1782114268 >> v1:172.21.15.71:6789/0 conn(0x7f4178142ea0 legacy=0x7f41780b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:28.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.112+0000 7f41767fc700 1 -- 172.21.15.71:0/1782114268 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4178069920 con 0x7f41780ad870 2023-10-09T07:58:28.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.112+0000 7f41767fc700 1 --2- 172.21.15.71:0/1782114268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41780ad870 0x7f417806b9e0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f416c0098e0 tx=0x7f416c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904b18dd2370a66f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:28.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.112+0000 7f4175ffb700 1 -- 172.21.15.71:0/1782114268 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c009e80 con 0x7f41780ad870 2023-10-09T07:58:28.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.112+0000 7f4175ffb700 1 -- 172.21.15.71:0/1782114268 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c00b860 con 0x7f41780ad870 2023-10-09T07:58:28.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.112+0000 7f4175ffb700 1 -- 172.21.15.71:0/1782114268 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c00bbe0 con 0x7f41780ad870 2023-10-09T07:58:28.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.113+0000 7f4177fff700 1 -- 172.21.15.71:0/1782114268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41780ad870 msgr2=0x7f417806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:28.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.113+0000 7f4177fff700 1 --2- 172.21.15.71:0/1782114268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41780ad870 0x7f417806b9e0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f416c0098e0 tx=0x7f416c0091a0 comp rx=0 tx=0).stop 2023-10-09T07:58:28.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.113+0000 7f4177fff700 1 -- 172.21.15.71:0/1782114268 shutdown_connections 2023-10-09T07:58:28.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.113+0000 7f4177fff700 1 --2- 172.21.15.71:0/1782114268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41780ad870 0x7f417806b9e0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:28.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.113+0000 7f4177fff700 1 -- 172.21.15.71:0/1782114268 >> 172.21.15.71:0/1782114268 conn(0x7f41780ce430 msgr2=0x7f41780ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:28.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.113+0000 7f4177fff700 1 -- 172.21.15.71:0/1782114268 shutdown_connections 2023-10-09T07:58:28.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.113+0000 7f4177fff700 1 -- 172.21.15.71:0/1782114268 wait complete. 2023-10-09T07:58:28.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.114+0000 7f4177fff700 1 Processor -- start 2023-10-09T07:58:28.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.115+0000 7f4177fff700 1 -- start start 2023-10-09T07:58:28.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.115+0000 7f4177fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f417806bf20 0x7f4178158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:28.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.115+0000 7f4177fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4178142ea0 0x7f41780aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:28.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.115+0000 7f4177fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41780af0c0 0x7f41780c9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:28.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.115+0000 7f4177fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417815cc30 con 0x7f4178142ea0 2023-10-09T07:58:28.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.115+0000 7f4177fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41780c75e0 con 0x7f41780af0c0 2023-10-09T07:58:28.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.115+0000 7f4177fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41780c7ba0 con 0x7f417806bf20 2023-10-09T07:58:28.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.116+0000 7f41767fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4178142ea0 0x7f41780aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:28.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.116+0000 7f41767fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4178142ea0 0x7f41780aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42778/0 (socket says 172.21.15.71:42778) 2023-10-09T07:58:28.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.116+0000 7f41767fc700 1 -- 172.21.15.71:0/1846960272 learned_addr learned my addr 172.21.15.71:0/1846960272 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:28.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.116+0000 7f41767fc700 1 -- 172.21.15.71:0/1846960272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f417806bf20 msgr2=0x7f4178158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:28.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.116+0000 7f41767fc700 1 --2- 172.21.15.71:0/1846960272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f417806bf20 0x7f4178158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:28.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.116+0000 7f41767fc700 1 -- 172.21.15.71:0/1846960272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41780af0c0 msgr2=0x7f41780c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:28.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.116+0000 7f41767fc700 1 --2- 172.21.15.71:0/1846960272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41780af0c0 0x7f41780c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:28.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.116+0000 7f41767fc700 1 -- 172.21.15.71:0/1846960272 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c009420 con 0x7f4178142ea0 2023-10-09T07:58:28.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.116+0000 7f41767fc700 1 --2- 172.21.15.71:0/1846960272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4178142ea0 0x7f41780aeb80 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f417806f0d0 tx=0x7f416c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:28.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.116+0000 7f415effd700 1 -- 172.21.15.71:0/1846960272 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c01f070 con 0x7f4178142ea0 2023-10-09T07:58:28.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.116+0000 7f415effd700 1 -- 172.21.15.71:0/1846960272 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c00b9d0 con 0x7f4178142ea0 2023-10-09T07:58:28.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.116+0000 7f415effd700 1 -- 172.21.15.71:0/1846960272 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c025670 con 0x7f4178142ea0 2023-10-09T07:58:28.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.116+0000 7f4177fff700 1 -- 172.21.15.71:0/1846960272 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41780af680 con 0x7f4178142ea0 2023-10-09T07:58:28.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.117+0000 7f4177fff700 1 -- 172.21.15.71:0/1846960272 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41780c7830 con 0x7f4178142ea0 2023-10-09T07:58:28.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.118+0000 7f4177fff700 1 -- 172.21.15.71:0/1846960272 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417804c3c0 con 0x7f4178142ea0 2023-10-09T07:58:28.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.118+0000 7f415effd700 1 -- 172.21.15.71:0/1846960272 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f416c023070 con 0x7f4178142ea0 2023-10-09T07:58:28.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.119+0000 7f415effd700 1 --2- 172.21.15.71:0/1846960272 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4164066f30 0x7f41640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:28.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.120+0000 7f415effd700 1 -- 172.21.15.71:0/1846960272 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f416c085d40 con 0x7f4178142ea0 2023-10-09T07:58:28.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.120+0000 7f4176ffd700 1 --2- 172.21.15.71:0/1846960272 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4164066f30 0x7f41640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:28.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.121+0000 7f4176ffd700 1 --2- 172.21.15.71:0/1846960272 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4164066f30 0x7f41640693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4168007fd0 tx=0x7f4168007bb0 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:28.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.123+0000 7f415effd700 1 -- 172.21.15.71:0/1846960272 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f416c052d40 con 0x7f4178142ea0 2023-10-09T07:58:28.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.311+0000 7f4177fff700 1 -- 172.21.15.71:0/1846960272 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f41780c7ce0 con 0x7f4164066f30 2023-10-09T07:58:28.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.322+0000 7f415effd700 1 -- 172.21.15.71:0/1846960272 <== mgr.8503 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279773 (secure 0 0 0) 0x7f41780c7ce0 con 0x7f4164066f30 2023-10-09T07:58:28.327 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:58:28.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.326+0000 7f4177fff700 1 -- 172.21.15.71:0/1846960272 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4164066f30 msgr2=0x7f41640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:28.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.326+0000 7f4177fff700 1 --2- 172.21.15.71:0/1846960272 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4164066f30 0x7f41640693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4168007fd0 tx=0x7f4168007bb0 comp rx=0 tx=0).stop 2023-10-09T07:58:28.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.326+0000 7f4177fff700 1 -- 172.21.15.71:0/1846960272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4178142ea0 msgr2=0x7f41780aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:28.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.326+0000 7f4177fff700 1 --2- 172.21.15.71:0/1846960272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4178142ea0 0x7f41780aeb80 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f417806f0d0 tx=0x7f416c017000 comp rx=0 tx=0).stop 2023-10-09T07:58:28.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.326+0000 7f4177fff700 1 -- 172.21.15.71:0/1846960272 shutdown_connections 2023-10-09T07:58:28.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.326+0000 7f4177fff700 1 --2- 172.21.15.71:0/1846960272 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f4164066f30 0x7f41640693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:28.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.326+0000 7f4177fff700 1 --2- 172.21.15.71:0/1846960272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41780af0c0 0x7f41780c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:28.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.326+0000 7f4177fff700 1 --2- 172.21.15.71:0/1846960272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f417806bf20 0x7f4178158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:28.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.326+0000 7f4177fff700 1 --2- 172.21.15.71:0/1846960272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4178142ea0 0x7f41780aeb80 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:28.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.326+0000 7f4177fff700 1 -- 172.21.15.71:0/1846960272 >> 172.21.15.71:0/1846960272 conn(0x7f41780ce430 msgr2=0x7f4178141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:28.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.326+0000 7f4177fff700 1 -- 172.21.15.71:0/1846960272 shutdown_connections 2023-10-09T07:58:28.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.326+0000 7f4177fff700 1 -- 172.21.15.71:0/1846960272 wait complete. 2023-10-09T07:58:28.330 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T07:58:28.344 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-09T07:58:26.961246+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591974,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":499,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":311,"ondisk_log_size":311,"up":70,"acting":70,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":2466044,"kb_used_data":18108,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752508676,"statfs":{"total":773094113280,"available":770568884224,"internally_reserved":0,"allocated":18542592,"data_stored":9828823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1606,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.950367"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.051793+0000","last_change":"2023-10-09T07:58:24.050753+0000","last_active":"2023-10-09T07:58:24.051793+0000","last_peered":"2023-10-09T07:58:24.051793+0000","last_clean":"2023-10-09T07:58:24.051793+0000","last_became_active":"2023-10-09T07:58:24.050542+0000","last_became_peered":"2023-10-09T07:58:24.050542+0000","last_unstale":"2023-10-09T07:58:24.051793+0000","last_undegraded":"2023-10-09T07:58:24.051793+0000","last_fullsized":"2023-10-09T07:58:24.051793+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:31.820966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048122+0000","last_change":"2023-10-09T07:58:24.043868+0000","last_active":"2023-10-09T07:58:24.048122+0000","last_peered":"2023-10-09T07:58:24.048122+0000","last_clean":"2023-10-09T07:58:24.048122+0000","last_became_active":"2023-10-09T07:58:24.043622+0000","last_became_peered":"2023-10-09T07:58:24.043622+0000","last_unstale":"2023-10-09T07:58:24.048122+0000","last_undegraded":"2023-10-09T07:58:24.048122+0000","last_fullsized":"2023-10-09T07:58:24.048122+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:45.661437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037247+0000","last_change":"2023-10-09T07:58:24.034026+0000","last_active":"2023-10-09T07:58:24.037247+0000","last_peered":"2023-10-09T07:58:24.037247+0000","last_clean":"2023-10-09T07:58:24.037247+0000","last_became_active":"2023-10-09T07:58:24.033378+0000","last_became_peered":"2023-10-09T07:58:24.033378+0000","last_unstale":"2023-10-09T07:58:24.037247+0000","last_undegraded":"2023-10-09T07:58:24.037247+0000","last_fullsized":"2023-10-09T07:58:24.037247+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:30.633397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.039832+0000","last_change":"2023-10-09T07:58:24.034388+0000","last_active":"2023-10-09T07:58:24.039832+0000","last_peered":"2023-10-09T07:58:24.039832+0000","last_clean":"2023-10-09T07:58:24.039832+0000","last_became_active":"2023-10-09T07:58:24.033937+0000","last_became_peered":"2023-10-09T07:58:24.033937+0000","last_unstale":"2023-10-09T07:58:24.039832+0000","last_undegraded":"2023-10-09T07:58:24.039832+0000","last_fullsized":"2023-10-09T07:58:24.039832+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:44.690645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.039861+0000","last_change":"2023-10-09T07:58:24.035442+0000","last_active":"2023-10-09T07:58:24.039861+0000","last_peered":"2023-10-09T07:58:24.039861+0000","last_clean":"2023-10-09T07:58:24.039861+0000","last_became_active":"2023-10-09T07:58:24.034999+0000","last_became_peered":"2023-10-09T07:58:24.034999+0000","last_unstale":"2023-10-09T07:58:24.039861+0000","last_undegraded":"2023-10-09T07:58:24.039861+0000","last_fullsized":"2023-10-09T07:58:24.039861+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:58.571728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.047182+0000","last_change":"2023-10-09T07:58:24.041213+0000","last_active":"2023-10-09T07:58:24.047182+0000","last_peered":"2023-10-09T07:58:24.047182+0000","last_clean":"2023-10-09T07:58:24.047182+0000","last_became_active":"2023-10-09T07:58:24.040940+0000","last_became_peered":"2023-10-09T07:58:24.040940+0000","last_unstale":"2023-10-09T07:58:24.047182+0000","last_undegraded":"2023-10-09T07:58:24.047182+0000","last_fullsized":"2023-10-09T07:58:24.047182+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:20.139851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048032+0000","last_change":"2023-10-09T07:58:24.042197+0000","last_active":"2023-10-09T07:58:24.048032+0000","last_peered":"2023-10-09T07:58:24.048032+0000","last_clean":"2023-10-09T07:58:24.048032+0000","last_became_active":"2023-10-09T07:58:24.041921+0000","last_became_peered":"2023-10-09T07:58:24.041921+0000","last_unstale":"2023-10-09T07:58:24.048032+0000","last_undegraded":"2023-10-09T07:58:24.048032+0000","last_fullsized":"2023-10-09T07:58:24.048032+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:07.075855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.036601+0000","last_change":"2023-10-09T07:58:24.032315+0000","last_active":"2023-10-09T07:58:24.036601+0000","last_peered":"2023-10-09T07:58:24.036601+0000","last_clean":"2023-10-09T07:58:24.036601+0000","last_became_active":"2023-10-09T07:58:24.032042+0000","last_became_peered":"2023-10-09T07:58:24.032042+0000","last_unstale":"2023-10-09T07:58:24.036601+0000","last_undegraded":"2023-10-09T07:58:24.036601+0000","last_fullsized":"2023-10-09T07:58:24.036601+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:05.127890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048256+0000","last_change":"2023-10-09T07:58:24.041854+0000","last_active":"2023-10-09T07:58:24.048256+0000","last_peered":"2023-10-09T07:58:24.048256+0000","last_clean":"2023-10-09T07:58:24.048256+0000","last_became_active":"2023-10-09T07:58:24.041577+0000","last_became_peered":"2023-10-09T07:58:24.041577+0000","last_unstale":"2023-10-09T07:58:24.048256+0000","last_undegraded":"2023-10-09T07:58:24.048256+0000","last_fullsized":"2023-10-09T07:58:24.048256+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:00:19.369349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048217+0000","last_change":"2023-10-09T07:58:24.042324+0000","last_active":"2023-10-09T07:58:24.048217+0000","last_peered":"2023-10-09T07:58:24.048217+0000","last_clean":"2023-10-09T07:58:24.048217+0000","last_became_active":"2023-10-09T07:58:24.042010+0000","last_became_peered":"2023-10-09T07:58:24.042010+0000","last_unstale":"2023-10-09T07:58:24.048217+0000","last_undegraded":"2023-10-09T07:58:24.048217+0000","last_fullsized":"2023-10-09T07:58:24.048217+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:16.438076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.052659+0000","last_change":"2023-10-09T07:58:24.052200+0000","last_active":"2023-10-09T07:58:24.052659+0000","last_peered":"2023-10-09T07:58:24.052659+0000","last_clean":"2023-10-09T07:58:24.052659+0000","last_became_active":"2023-10-09T07:58:24.051595+0000","last_became_peered":"2023-10-09T07:58:24.051595+0000","last_unstale":"2023-10-09T07:58:24.052659+0000","last_undegraded":"2023-10-09T07:58:24.052659+0000","last_fullsized":"2023-10-09T07:58:24.052659+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:42:21.938720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.045210+0000","last_change":"2023-10-09T07:58:24.042772+0000","last_active":"2023-10-09T07:58:24.045210+0000","last_peered":"2023-10-09T07:58:24.045210+0000","last_clean":"2023-10-09T07:58:24.045210+0000","last_became_active":"2023-10-09T07:58:24.042398+0000","last_became_peered":"2023-10-09T07:58:24.042398+0000","last_unstale":"2023-10-09T07:58:24.045210+0000","last_undegraded":"2023-10-09T07:58:24.045210+0000","last_fullsized":"2023-10-09T07:58:24.045210+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:19.906242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048245+0000","last_change":"2023-10-09T07:58:24.043813+0000","last_active":"2023-10-09T07:58:24.048245+0000","last_peered":"2023-10-09T07:58:24.048245+0000","last_clean":"2023-10-09T07:58:24.048245+0000","last_became_active":"2023-10-09T07:58:24.043558+0000","last_became_peered":"2023-10-09T07:58:24.043558+0000","last_unstale":"2023-10-09T07:58:24.048245+0000","last_undegraded":"2023-10-09T07:58:24.048245+0000","last_fullsized":"2023-10-09T07:58:24.048245+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:36.378974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.040246+0000","last_change":"2023-10-09T07:58:24.035180+0000","last_active":"2023-10-09T07:58:24.040246+0000","last_peered":"2023-10-09T07:58:24.040246+0000","last_clean":"2023-10-09T07:58:24.040246+0000","last_became_active":"2023-10-09T07:58:24.034916+0000","last_became_peered":"2023-10-09T07:58:24.034916+0000","last_unstale":"2023-10-09T07:58:24.040246+0000","last_undegraded":"2023-10-09T07:58:24.040246+0000","last_fullsized":"2023-10-09T07:58:24.040246+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:12:00.905354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.039892+0000","last_change":"2023-10-09T07:58:24.034722+0000","last_active":"2023-10-09T07:58:24.039892+0000","last_peered":"2023-10-09T07:58:24.039892+0000","last_clean":"2023-10-09T07:58:24.039892+0000","last_became_active":"2023-10-09T07:58:24.033015+0000","last_became_peered":"2023-10-09T07:58:24.033015+0000","last_unstale":"2023-10-09T07:58:24.039892+0000","last_undegraded":"2023-10-09T07:58:24.039892+0000","last_fullsized":"2023-10-09T07:58:24.039892+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:48:29.551743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.053251+0000","last_change":"2023-10-09T07:58:23.039908+0000","last_active":"2023-10-09T07:58:24.053251+0000","last_peered":"2023-10-09T07:58:24.053251+0000","last_clean":"2023-10-09T07:58:24.053251+0000","last_became_active":"2023-10-09T07:58:23.039653+0000","last_became_peered":"2023-10-09T07:58:23.039653+0000","last_unstale":"2023-10-09T07:58:24.053251+0000","last_undegraded":"2023-10-09T07:58:24.053251+0000","last_fullsized":"2023-10-09T07:58:24.053251+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:29:27.162187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.027437+0000","last_change":"2023-10-09T07:58:23.036137+0000","last_active":"2023-10-09T07:58:24.027437+0000","last_peered":"2023-10-09T07:58:24.027437+0000","last_clean":"2023-10-09T07:58:24.027437+0000","last_became_active":"2023-10-09T07:58:23.035828+0000","last_became_peered":"2023-10-09T07:58:23.035828+0000","last_unstale":"2023-10-09T07:58:24.027437+0000","last_undegraded":"2023-10-09T07:58:24.027437+0000","last_fullsized":"2023-10-09T07:58:24.027437+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:30:00.666411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.042455+0000","last_change":"2023-10-09T07:58:24.038556+0000","last_active":"2023-10-09T07:58:24.042455+0000","last_peered":"2023-10-09T07:58:24.042455+0000","last_clean":"2023-10-09T07:58:24.042455+0000","last_became_active":"2023-10-09T07:58:24.038266+0000","last_became_peered":"2023-10-09T07:58:24.038266+0000","last_unstale":"2023-10-09T07:58:24.042455+0000","last_undegraded":"2023-10-09T07:58:24.042455+0000","last_fullsized":"2023-10-09T07:58:24.042455+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:20.483964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"175'6","reported_seq":16,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.056822+0000","last_change":"2023-10-09T07:58:23.032317+0000","last_active":"2023-10-09T07:58:24.056822+0000","last_peered":"2023-10-09T07:58:24.056822+0000","last_clean":"2023-10-09T07:58:24.056822+0000","last_became_active":"2023-10-09T07:58:23.032034+0000","last_became_peered":"2023-10-09T07:58:23.032034+0000","last_unstale":"2023-10-09T07:58:24.056822+0000","last_undegraded":"2023-10-09T07:58:24.056822+0000","last_fullsized":"2023-10-09T07:58:24.056822+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:01:27.509478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.025872+0000","last_change":"2023-10-09T07:58:23.027831+0000","last_active":"2023-10-09T07:58:24.025872+0000","last_peered":"2023-10-09T07:58:24.025872+0000","last_clean":"2023-10-09T07:58:24.025872+0000","last_became_active":"2023-10-09T07:58:23.027573+0000","last_became_peered":"2023-10-09T07:58:23.027573+0000","last_unstale":"2023-10-09T07:58:24.025872+0000","last_undegraded":"2023-10-09T07:58:24.025872+0000","last_fullsized":"2023-10-09T07:58:24.025872+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:30.137019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"175'8","reported_seq":18,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.055611+0000","last_change":"2023-10-09T07:58:23.041105+0000","last_active":"2023-10-09T07:58:24.055611+0000","last_peered":"2023-10-09T07:58:24.055611+0000","last_clean":"2023-10-09T07:58:24.055611+0000","last_became_active":"2023-10-09T07:58:23.040899+0000","last_became_peered":"2023-10-09T07:58:23.040899+0000","last_unstale":"2023-10-09T07:58:24.055611+0000","last_undegraded":"2023-10-09T07:58:24.055611+0000","last_fullsized":"2023-10-09T07:58:24.055611+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:08:51.278424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.055105+0000","last_change":"2023-10-09T07:58:24.053157+0000","last_active":"2023-10-09T07:58:24.055105+0000","last_peered":"2023-10-09T07:58:24.055105+0000","last_clean":"2023-10-09T07:58:24.055105+0000","last_became_active":"2023-10-09T07:58:24.052868+0000","last_became_peered":"2023-10-09T07:58:24.052868+0000","last_unstale":"2023-10-09T07:58:24.055105+0000","last_undegraded":"2023-10-09T07:58:24.055105+0000","last_fullsized":"2023-10-09T07:58:24.055105+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:41.116662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.052803+0000","last_change":"2023-10-09T07:58:23.040353+0000","last_active":"2023-10-09T07:58:24.052803+0000","last_peered":"2023-10-09T07:58:24.052803+0000","last_clean":"2023-10-09T07:58:24.052803+0000","last_became_active":"2023-10-09T07:58:23.039961+0000","last_became_peered":"2023-10-09T07:58:23.039961+0000","last_unstale":"2023-10-09T07:58:24.052803+0000","last_undegraded":"2023-10-09T07:58:24.052803+0000","last_fullsized":"2023-10-09T07:58:24.052803+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:59.029087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.049602+0000","last_change":"2023-10-09T07:58:24.047359+0000","last_active":"2023-10-09T07:58:24.049602+0000","last_peered":"2023-10-09T07:58:24.049602+0000","last_clean":"2023-10-09T07:58:24.049602+0000","last_became_active":"2023-10-09T07:58:24.047026+0000","last_became_peered":"2023-10-09T07:58:24.047026+0000","last_unstale":"2023-10-09T07:58:24.049602+0000","last_undegraded":"2023-10-09T07:58:24.049602+0000","last_fullsized":"2023-10-09T07:58:24.049602+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:18.603205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.059199+0000","last_change":"2023-10-09T07:58:23.037844+0000","last_active":"2023-10-09T07:58:24.059199+0000","last_peered":"2023-10-09T07:58:24.059199+0000","last_clean":"2023-10-09T07:58:24.059199+0000","last_became_active":"2023-10-09T07:58:23.037598+0000","last_became_peered":"2023-10-09T07:58:23.037598+0000","last_unstale":"2023-10-09T07:58:24.059199+0000","last_undegraded":"2023-10-09T07:58:24.059199+0000","last_fullsized":"2023-10-09T07:58:24.059199+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:12.869232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037253+0000","last_change":"2023-10-09T07:58:24.033828+0000","last_active":"2023-10-09T07:58:24.037253+0000","last_peered":"2023-10-09T07:58:24.037253+0000","last_clean":"2023-10-09T07:58:24.037253+0000","last_became_active":"2023-10-09T07:58:24.033580+0000","last_became_peered":"2023-10-09T07:58:24.033580+0000","last_unstale":"2023-10-09T07:58:24.037253+0000","last_undegraded":"2023-10-09T07:58:24.037253+0000","last_fullsized":"2023-10-09T07:58:24.037253+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:27:48.279381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037265+0000","last_change":"2023-10-09T07:58:24.034230+0000","last_active":"2023-10-09T07:58:24.037265+0000","last_peered":"2023-10-09T07:58:24.037265+0000","last_clean":"2023-10-09T07:58:24.037265+0000","last_became_active":"2023-10-09T07:58:24.033758+0000","last_became_peered":"2023-10-09T07:58:24.033758+0000","last_unstale":"2023-10-09T07:58:24.037265+0000","last_undegraded":"2023-10-09T07:58:24.037265+0000","last_fullsized":"2023-10-09T07:58:24.037265+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:10:36.736260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.025916+0000","last_change":"2023-10-09T07:58:23.039543+0000","last_active":"2023-10-09T07:58:24.025916+0000","last_peered":"2023-10-09T07:58:24.025916+0000","last_clean":"2023-10-09T07:58:24.025916+0000","last_became_active":"2023-10-09T07:58:23.039245+0000","last_became_peered":"2023-10-09T07:58:23.039245+0000","last_unstale":"2023-10-09T07:58:24.025916+0000","last_undegraded":"2023-10-09T07:58:24.025916+0000","last_fullsized":"2023-10-09T07:58:24.025916+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:04.616687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.026095+0000","last_change":"2023-10-09T07:58:23.033638+0000","last_active":"2023-10-09T07:58:24.026095+0000","last_peered":"2023-10-09T07:58:24.026095+0000","last_clean":"2023-10-09T07:58:24.026095+0000","last_became_active":"2023-10-09T07:58:23.033359+0000","last_became_peered":"2023-10-09T07:58:23.033359+0000","last_unstale":"2023-10-09T07:58:24.026095+0000","last_undegraded":"2023-10-09T07:58:24.026095+0000","last_fullsized":"2023-10-09T07:58:24.026095+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:21:06.621088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037576+0000","last_change":"2023-10-09T07:58:24.033310+0000","last_active":"2023-10-09T07:58:24.037576+0000","last_peered":"2023-10-09T07:58:24.037576+0000","last_clean":"2023-10-09T07:58:24.037576+0000","last_became_active":"2023-10-09T07:58:24.033044+0000","last_became_peered":"2023-10-09T07:58:24.033044+0000","last_unstale":"2023-10-09T07:58:24.037576+0000","last_undegraded":"2023-10-09T07:58:24.037576+0000","last_fullsized":"2023-10-09T07:58:24.037576+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:30.145065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.025758+0000","last_change":"2023-10-09T07:58:23.034259+0000","last_active":"2023-10-09T07:58:24.025758+0000","last_peered":"2023-10-09T07:58:24.025758+0000","last_clean":"2023-10-09T07:58:24.025758+0000","last_became_active":"2023-10-09T07:58:23.033993+0000","last_became_peered":"2023-10-09T07:58:23.033993+0000","last_unstale":"2023-10-09T07:58:24.025758+0000","last_undegraded":"2023-10-09T07:58:24.025758+0000","last_fullsized":"2023-10-09T07:58:24.025758+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:36.449503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.040603+0000","last_change":"2023-10-09T07:58:24.034496+0000","last_active":"2023-10-09T07:58:24.040603+0000","last_peered":"2023-10-09T07:58:24.040603+0000","last_clean":"2023-10-09T07:58:24.040603+0000","last_became_active":"2023-10-09T07:58:24.034246+0000","last_became_peered":"2023-10-09T07:58:24.034246+0000","last_unstale":"2023-10-09T07:58:24.040603+0000","last_undegraded":"2023-10-09T07:58:24.040603+0000","last_fullsized":"2023-10-09T07:58:24.040603+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:09.684425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.022165+0000","last_change":"2023-10-09T07:58:23.035059+0000","last_active":"2023-10-09T07:58:24.022165+0000","last_peered":"2023-10-09T07:58:24.022165+0000","last_clean":"2023-10-09T07:58:24.022165+0000","last_became_active":"2023-10-09T07:58:23.034777+0000","last_became_peered":"2023-10-09T07:58:23.034777+0000","last_unstale":"2023-10-09T07:58:24.022165+0000","last_undegraded":"2023-10-09T07:58:24.022165+0000","last_fullsized":"2023-10-09T07:58:24.022165+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:35:59.356322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037217+0000","last_change":"2023-10-09T07:58:24.033312+0000","last_active":"2023-10-09T07:58:24.037217+0000","last_peered":"2023-10-09T07:58:24.037217+0000","last_clean":"2023-10-09T07:58:24.037217+0000","last_became_active":"2023-10-09T07:58:24.033036+0000","last_became_peered":"2023-10-09T07:58:24.033036+0000","last_unstale":"2023-10-09T07:58:24.037217+0000","last_undegraded":"2023-10-09T07:58:24.037217+0000","last_fullsized":"2023-10-09T07:58:24.037217+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:42.710219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"166'293","reported_seq":916,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-09T07:58:18.995699+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T07:58:18.995699+0000","last_peered":"2023-10-09T07:58:18.995699+0000","last_clean":"2023-10-09T07:58:18.995699+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T07:58:18.995699+0000","last_undegraded":"2023-10-09T07:58:18.995699+0000","last_fullsized":"2023-10-09T07:58:18.995699+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":3},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":1606,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":22,"acting":22,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575750,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308156,"kb_used_data":2676,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063684,"statfs":{"total":96636764160,"available":96321212416,"internally_reserved":0,"allocated":2740224,"data_stored":1660797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.72799999999999998,"15min":0.752},"min":{"1min":0.45300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.127},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.749,"15min":0.76400000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.47399999999999998},"max":{"1min":0.98099999999999998,"5min":1.026,"15min":1.1319999999999999},"last":0.85199999999999998}]},{"osd":1,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.71899999999999997,"15min":0.73399999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.875,"5min":0.96599999999999997,"15min":1.077},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.751},"min":{"1min":0.50900000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92200000000000004,"5min":0.997,"15min":1.038},"last":0.82399999999999995}]},{"osd":2,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.96399999999999997,"5min":0.98999999999999999,"15min":1.0269999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.52800000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91500000000000004,"5min":0.98299999999999998,"15min":1.1899999999999999},"last":0.81100000000000005}]},{"osd":3,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.72199999999999998,"15min":0.73599999999999999},"min":{"1min":0.499,"5min":0.49399999999999999,"15min":0.42099999999999999},"max":{"1min":0.88900000000000001,"5min":0.995,"15min":1.04},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77600000000000002,"15min":0.79200000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.036,"5min":1.0529999999999999,"15min":1.0920000000000001},"last":0.74299999999999999}]},{"osd":4,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63800000000000001,"15min":0.626},"min":{"1min":0.47599999999999998,"5min":0.42199999999999999,"15min":0.36299999999999999},"max":{"1min":0.94099999999999995,"5min":0.97099999999999997,"15min":1.248},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.93700000000000006,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.61499999999999999}]},{"osd":5,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63900000000000001,"15min":0.65400000000000003},"min":{"1min":0.41399999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68799999999999994,"15min":0.69699999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.304},"last":0.63100000000000001}]},{"osd":6,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73899999999999999,"15min":0.75},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.405},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71099999999999997,"15min":0.71899999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.43099999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.377},"last":0.65600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575749,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311672,"kb_used_data":2096,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060168,"statfs":{"total":96636764160,"available":96317612032,"internally_reserved":0,"allocated":2146304,"data_stored":1070429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.33600000000000002},"max":{"1min":0.93600000000000005,"5min":0.98399999999999999,"15min":1.012},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.75600000000000001,"15min":0.75},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84899999999999998,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.77100000000000002}]},{"osd":1,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76800000000000002,"15min":0.76900000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1100000000000001,"5min":1.113,"15min":1.2769999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.78700000000000003,"15min":0.76700000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.02,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.79700000000000004}]},{"osd":2,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.76000000000000001},"min":{"1min":0.55400000000000005,"5min":0.46100000000000002,"15min":0.432},"max":{"1min":1.0369999999999999,"5min":1.0589999999999999,"15min":1.075},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79200000000000004,"15min":0.77700000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.86499999999999999,"5min":1.151,"15min":1.151},"last":0.71299999999999997}]},{"osd":3,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76300000000000001,"15min":0.755},"min":{"1min":0.52700000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95299999999999996,"5min":1.423,"15min":1.423},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80200000000000005,"15min":0.78500000000000003},"min":{"1min":0.59699999999999998,"5min":0.55500000000000005,"15min":0.54100000000000004},"max":{"1min":1.0800000000000001,"5min":1.335,"15min":1.335},"last":0.91700000000000004}]},{"osd":4,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.36199999999999999},"max":{"1min":0.89800000000000002,"5min":0.97399999999999998,"15min":1.0960000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65900000000000003,"15min":0.65300000000000002},"min":{"1min":0.45500000000000002,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.91500000000000004,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.871}]},{"osd":5,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.52400000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.137,"5min":1.306,"15min":1.306},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.48199999999999998,"5min":0.45400000000000001,"15min":0.42699999999999999},"max":{"1min":0.96599999999999997,"5min":1.054,"15min":1.085},"last":1.004}]},{"osd":7,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69799999999999995,"15min":0.69199999999999995},"min":{"1min":0.51700000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.96799999999999997,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.74099999999999999,"15min":0.73799999999999999},"min":{"1min":0.498,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1639999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.04}]}]},{"osd":1,"up_from":13,"seq":55834575751,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303532,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068308,"statfs":{"total":96636764160,"available":96325947392,"internally_reserved":0,"allocated":2199552,"data_stored":1097958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48499999999999999,"15min":0.46800000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.308},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.52400000000000002,"15min":0.50700000000000001},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.313},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.37}]},{"osd":2,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.54800000000000004,"15min":0.51700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32900000000000001},"max":{"1min":5.1159999999999997,"5min":5.1159999999999997,"15min":5.1159999999999997},"last":0.436},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.63600000000000001,"15min":0.59599999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.375},"max":{"1min":5.399,"5min":5.399,"15min":5.399},"last":0.40000000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.63900000000000001,"15min":0.63600000000000001},"min":{"1min":0.42999999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.41699999999999998,"5min":0.39900000000000002,"15min":0.37},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.49299999999999999}]},{"osd":4,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.83899999999999997,"15min":0.80800000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.42699999999999999},"max":{"1min":5.2409999999999997,"5min":5.2409999999999997,"15min":5.2409999999999997},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.86599999999999999,"15min":0.82699999999999996},"min":{"1min":0.65700000000000003,"5min":0.622,"15min":0.56699999999999995},"max":{"1min":5.4409999999999998,"5min":5.4409999999999998,"15min":5.4409999999999998},"last":0.626}]},{"osd":5,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.81499999999999995,"15min":0.81100000000000005},"min":{"1min":0.64000000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.85499999999999998,"15min":0.82499999999999996},"min":{"1min":0.60299999999999998,"5min":0.57999999999999996,"15min":0.442},"max":{"1min":5.1630000000000003,"5min":5.1630000000000003,"15min":5.1630000000000003},"last":0.61699999999999999}]},{"osd":6,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.89300000000000002,"15min":0.84499999999999997},"min":{"1min":0.65300000000000002,"5min":0.63900000000000001,"15min":0.55100000000000005},"max":{"1min":5.4749999999999996,"5min":5.4749999999999996,"15min":5.4749999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83499999999999996,"15min":0.82999999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.56000000000000005},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.081,"5min":0.92800000000000005,"15min":0.88500000000000001},"min":{"1min":0.66500000000000004,"5min":0.63,"15min":0.55300000000000005},"max":{"1min":5.2009999999999996,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":0.79000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575750,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308220,"kb_used_data":2740,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063620,"statfs":{"total":96636764160,"available":96321146880,"internally_reserved":0,"allocated":2805760,"data_stored":1689342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.48699999999999999,"15min":0.47499999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.52800000000000002,"5min":0.72099999999999997,"15min":0.80100000000000005},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53100000000000003,"15min":0.54500000000000004},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.32000000000000001},"max":{"1min":0.71099999999999997,"5min":0.82999999999999996,"15min":0.88200000000000001},"last":0.47599999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56200000000000006,"15min":0.56499999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77800000000000002,"5min":0.83499999999999996,"15min":0.91800000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.60499999999999998,"5min":0.70599999999999996,"15min":0.82399999999999995},"last":0.51200000000000001}]},{"osd":3,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67900000000000005,"5min":0.78400000000000003,"15min":0.98599999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.74299999999999999,"5min":0.89600000000000002,"15min":0.94699999999999995},"last":0.52600000000000002}]},{"osd":4,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.52200000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.532},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81299999999999994,"15min":0.81999999999999995},"min":{"1min":0.626,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.202,"5min":1.202,"15min":1.2470000000000001},"last":0.79200000000000004}]},{"osd":5,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79800000000000004,"15min":0.79900000000000004},"min":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.01,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.80600000000000005,"15min":0.81299999999999994},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.55500000000000005},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.3009999999999999},"last":0.85699999999999998}]},{"osd":6,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.84099999999999997,"15min":0.83799999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0860000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81599999999999995,"15min":0.81999999999999995},"min":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.51400000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.3859999999999999},"last":0.82399999999999995}]},{"osd":7,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.84099999999999997,"15min":0.85399999999999998},"min":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3380000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.877,"15min":0.86799999999999999},"min":{"1min":0.66000000000000003,"5min":0.61899999999999999,"15min":0.54400000000000004},"max":{"1min":1.131,"5min":1.218,"15min":1.3580000000000001},"last":0.89100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575750,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311736,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060104,"statfs":{"total":96636764160,"available":96317546496,"internally_reserved":0,"allocated":2211840,"data_stored":1099010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46000000000000002,"15min":0.47099999999999997},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52500000000000002,"15min":0.51400000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.49199999999999999}]},{"osd":1,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.48999999999999999,"15min":0.48699999999999999},"min":{"1min":0.40699999999999997,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.34599999999999997},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.98699999999999999},"last":0.46700000000000003}]},{"osd":3,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.625,"15min":0.61799999999999999},"min":{"1min":0.48199999999999998,"5min":0.46600000000000003,"15min":0.41399999999999998},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.45500000000000002,"5min":0.44500000000000001,"15min":0.40999999999999998},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.52200000000000002}]},{"osd":4,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81299999999999994,"15min":0.80000000000000004},"min":{"1min":0.56499999999999995,"5min":0.56299999999999994,"15min":0.54500000000000004},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79200000000000004,"15min":0.78300000000000003},"min":{"1min":0.59799999999999998,"5min":0.54000000000000004,"15min":0.47799999999999998},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":0.876}]},{"osd":5,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.81299999999999994,"15min":0.79100000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.296,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.81599999999999995},"min":{"1min":0.63100000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0269999999999999,"5min":1.254,"15min":1.254},"last":0.74099999999999999}]},{"osd":6,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.82299999999999995,"15min":0.80900000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.54100000000000004},"max":{"1min":0.99399999999999999,"5min":1.1639999999999999,"15min":1.296},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82899999999999996,"15min":0.81999999999999995},"min":{"1min":0.629,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2230000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.73199999999999998}]},{"osd":7,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.85299999999999998,"15min":0.84099999999999997},"min":{"1min":0.63200000000000001,"5min":0.56499999999999995,"15min":0.53600000000000003},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.89500000000000002,"15min":0.877},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.69799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575750,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311672,"kb_used_data":2096,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060168,"statfs":{"total":96636764160,"available":96317612032,"internally_reserved":0,"allocated":2146304,"data_stored":1070429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.47399999999999998,"15min":0.48499999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63700000000000001,"5min":0.77100000000000002,"15min":0.80700000000000005},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.32300000000000001},"max":{"1min":0.76400000000000001,"5min":0.85399999999999998,"15min":0.91700000000000004},"last":0.42099999999999999}]},{"osd":1,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48299999999999998,"15min":0.498},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.84699999999999998},"last":0.308},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80100000000000005,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.40699999999999997}]},{"osd":2,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57699999999999996,"15min":0.58999999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.34999999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.90900000000000003},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.40899999999999997},"max":{"1min":0.81299999999999994,"5min":0.83799999999999997,"15min":0.95799999999999996},"last":0.44}]},{"osd":4,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.77100000000000002,"15min":0.77400000000000002},"min":{"1min":0.55500000000000005,"5min":0.55000000000000004,"15min":0.47499999999999998},"max":{"1min":1.03,"5min":1.121,"15min":1.246},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.85099999999999998,"15min":0.85299999999999998},"min":{"1min":0.63800000000000001,"5min":0.629,"15min":0.57799999999999996},"max":{"1min":1.0780000000000001,"5min":1.1419999999999999,"15min":1.157},"last":0.84299999999999997}]},{"osd":5,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.76200000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.48499999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.1910000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.48899999999999999},"max":{"1min":1.073,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.79900000000000004}]},{"osd":6,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80200000000000005,"15min":0.79700000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.495},"max":{"1min":1.05,"5min":1.149,"15min":1.149},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.80900000000000005,"15min":0.81299999999999994},"min":{"1min":0.59299999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.099,"5min":1.103,"15min":1.2230000000000001},"last":0.73799999999999999}]},{"osd":7,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84499999999999997,"15min":0.84799999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.53100000000000003},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.2430000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.85199999999999998,"15min":0.85099999999999998},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.56699999999999995},"max":{"1min":1.181,"5min":1.181,"15min":1.1850000000000001},"last":0.80700000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575749,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299384,"kb_used_data":2096,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072456,"statfs":{"total":96636764160,"available":96330194944,"internally_reserved":0,"allocated":2146304,"data_stored":1070429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90300000000000002,"5min":0.97499999999999998,"15min":1.0700000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.73999999999999999,"15min":0.754},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77500000000000002,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.80800000000000005}]},{"osd":1,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.73599999999999999,"15min":0.73099999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97799999999999998,"5min":1.038,"15min":1.0640000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.73799999999999999,"15min":0.74099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.81299999999999994,"5min":1.028,"15min":1.038},"last":0.51900000000000002}]},{"osd":2,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.79400000000000004,"15min":0.78700000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88200000000000001,"5min":0.999,"15min":1.0509999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79500000000000004,"15min":0.79700000000000004},"min":{"1min":0.60399999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.94099999999999995,"5min":1.069,"15min":1.069},"last":0.85799999999999998}]},{"osd":3,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.76000000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91800000000000004,"5min":1.131,"15min":1.131},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.014,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.65900000000000003}]},{"osd":5,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61599999999999999,"15min":0.59399999999999997},"min":{"1min":0.438,"5min":0.372,"15min":0.36299999999999999},"max":{"1min":1.0009999999999999,"5min":1.27,"15min":1.27},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.626,"15min":0.61699999999999999},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95299999999999996,"5min":1.014,"15min":1.014},"last":0.88}]},{"osd":6,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65700000000000003,"15min":0.63700000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.41699999999999998},"max":{"1min":1.0449999999999999,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67900000000000005,"15min":0.66300000000000003},"min":{"1min":0.47599999999999998,"5min":0.45500000000000002,"15min":0.39000000000000001},"max":{"1min":0.89400000000000002,"5min":1.425,"15min":1.425},"last":0.76200000000000001}]},{"osd":7,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.58699999999999997,"5min":0.48699999999999999,"15min":0.47999999999999998},"max":{"1min":0.92300000000000004,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.78300000000000003,"15min":0.76200000000000001},"min":{"1min":0.63900000000000001,"5min":0.51200000000000001,"15min":0.46600000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.91500000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575750,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311672,"kb_used_data":2096,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060168,"statfs":{"total":96636764160,"available":96317612032,"internally_reserved":0,"allocated":2146304,"data_stored":1070429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73499999999999999,"15min":0.72999999999999998},"min":{"1min":0.46500000000000002,"5min":0.46200000000000002,"15min":0.39100000000000001},"max":{"1min":1.016,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.73099999999999998,"15min":0.72199999999999998},"min":{"1min":0.51000000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97299999999999998,"5min":0.98799999999999999,"15min":1.0820000000000001},"last":0.80100000000000005}]},{"osd":1,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.73499999999999999,"15min":0.72799999999999998},"min":{"1min":0.54600000000000004,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":0.92800000000000005,"5min":0.97499999999999998,"15min":1.0129999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.748,"15min":0.751},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.0289999999999999},"last":0.746}]},{"osd":2,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76500000000000001,"15min":0.75700000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.46800000000000003},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.98599999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73699999999999999,"15min":0.74299999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.44500000000000001},"max":{"1min":0.89300000000000002,"5min":0.96399999999999997,"15min":1.026},"last":0.85099999999999998}]},{"osd":3,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.47499999999999998},"max":{"1min":0.89900000000000002,"5min":0.97399999999999998,"15min":1.107},"last":0.876},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79500000000000004,"15min":0.78600000000000003},"min":{"1min":0.58299999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.77400000000000002}]},{"osd":4,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.84099999999999997,"5min":1.002,"15min":1.0189999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.38800000000000001,"15min":0.379},"max":{"1min":0.90700000000000003,"5min":0.96199999999999997,"15min":1.0289999999999999},"last":0.67300000000000004}]},{"osd":6,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.44900000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69299999999999995,"15min":0.68400000000000005},"min":{"1min":0.48299999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.97799999999999998,"5min":0.99299999999999999,"15min":1.054},"last":0.69599999999999995}]},{"osd":7,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70799999999999996,"15min":0.69899999999999995},"min":{"1min":0.46999999999999997,"5min":0.45000000000000001,"15min":0.433},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.79000000000000004,"15min":0.78700000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.5},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.82099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T07:58:28.352 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T07:58:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.563+0000 7f2f9f9ff700 1 Processor -- start 2023-10-09T07:58:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.563+0000 7f2f9f9ff700 1 -- start start 2023-10-09T07:58:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.564+0000 7f2f9f9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f980b1420 0x7f2f980ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.564+0000 7f2f9f9ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f980cc300 con 0x7f2f980ccf90 2023-10-09T07:58:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.564+0000 7f2f9f9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f980ad370 con 0x7f2f980cbf30 2023-10-09T07:58:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.564+0000 7f2f9f9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f98156bf0 con 0x7f2f980b1420 2023-10-09T07:58:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.565+0000 7f2f9df9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f2f980ccf90 0x7f2f980c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53524/0 (socket says 172.21.15.71:53524) 2023-10-09T07:58:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.565+0000 7f2f9df9c700 1 -- 172.21.15.71:0/1201793901 learned_addr learned my addr 172.21.15.71:0/1201793901 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.565+0000 7f2f9cf9a700 1 --2- 172.21.15.71:0/1201793901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f980b1420 0x7f2f980ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.565+0000 7f2f8ffff700 1 -- 172.21.15.71:0/1201793901 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2939898151 0 0) 0x7f2f980cc300 con 0x7f2f980ccf90 2023-10-09T07:58:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.565+0000 7f2f8ffff700 1 -- 172.21.15.71:0/1201793901 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f84003570 con 0x7f2f980ccf90 2023-10-09T07:58:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.565+0000 7f2f8ffff700 1 -- 172.21.15.71:0/1201793901 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152869435 0 0) 0x7f2f980ad370 con 0x7f2f980cbf30 2023-10-09T07:58:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.565+0000 7f2f8ffff700 1 -- 172.21.15.71:0/1201793901 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f980cc300 con 0x7f2f980cbf30 2023-10-09T07:58:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.565+0000 7f2f8ffff700 1 -- 172.21.15.71:0/1201793901 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2212820522 0 0) 0x7f2f84003570 con 0x7f2f980ccf90 2023-10-09T07:58:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.565+0000 7f2f8ffff700 1 -- 172.21.15.71:0/1201793901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f980b1420 msgr2=0x7f2f980ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.565+0000 7f2f8ffff700 1 --2- 172.21.15.71:0/1201793901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f980b1420 0x7f2f980ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.565+0000 7f2f8ffff700 1 -- 172.21.15.71:0/1201793901 >> v1:172.21.15.179:6789/0 conn(0x7f2f980cbf30 legacy=0x7f2f980b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.565+0000 7f2f8ffff700 1 -- 172.21.15.71:0/1201793901 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f980ad650 con 0x7f2f980ccf90 2023-10-09T07:58:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.565+0000 7f2f8ffff700 1 -- 172.21.15.71:0/1201793901 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f2f900017f0 con 0x7f2f980ccf90 2023-10-09T07:58:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.566+0000 7f2f9cf9a700 1 --2- 172.21.15.71:0/1201793901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f980b1420 0x7f2f980ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:58:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.566+0000 7f2f8ffff700 1 -- 172.21.15.71:0/1201793901 >> v1:172.21.15.71:6789/0 conn(0x7f2f980ccf90 legacy=0x7f2f980c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.566+0000 7f2f8ffff700 1 --2- 172.21.15.71:0/1201793901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f84003c20 0x7f2f84004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.566+0000 7f2f8ffff700 1 --2- 172.21.15.71:0/1201793901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f980b1420 0x7f2f84004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.566+0000 7f2f8ffff700 1 --2- 172.21.15.71:0/1201793901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f84004d50 0x7f2f840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.566+0000 7f2f8ffff700 1 -- 172.21.15.71:0/1201793901 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f98156bf0 con 0x7f2f84003c20 2023-10-09T07:58:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.566+0000 7f2f8ffff700 1 -- 172.21.15.71:0/1201793901 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8400bb10 con 0x7f2f84004d50 2023-10-09T07:58:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.566+0000 7f2f8ffff700 1 -- 172.21.15.71:0/1201793901 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8400bcd0 con 0x7f2f980b1420 2023-10-09T07:58:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.566+0000 7f2f9d79b700 1 --2- 172.21.15.71:0/1201793901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f84003c20 0x7f2f84004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.566+0000 7f2f9d79b700 1 -- 172.21.15.71:0/1201793901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f980b1420 msgr2=0x7f2f84004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.566+0000 7f2f9d79b700 1 --2- 172.21.15.71:0/1201793901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f980b1420 0x7f2f84004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:28.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.566+0000 7f2f9d79b700 1 -- 172.21.15.71:0/1201793901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f84004d50 msgr2=0x7f2f840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:28.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.566+0000 7f2f9d79b700 1 --2- 172.21.15.71:0/1201793901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f84004d50 0x7f2f840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:28.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.566+0000 7f2f9d79b700 1 -- 172.21.15.71:0/1201793901 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f88009420 con 0x7f2f84003c20 2023-10-09T07:58:28.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.566+0000 7f2f9d79b700 1 --2- 172.21.15.71:0/1201793901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f84003c20 0x7f2f84004010 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f2f94001a50 tx=0x7f2f94007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b116dea3e845f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:28.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.567+0000 7f2f8ffff700 1 -- 172.21.15.71:0/1201793901 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9400c5d0 con 0x7f2f84003c20 2023-10-09T07:58:28.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.567+0000 7f2f8ffff700 1 -- 172.21.15.71:0/1201793901 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9400c730 con 0x7f2f84003c20 2023-10-09T07:58:28.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.567+0000 7f2f8ffff700 1 -- 172.21.15.71:0/1201793901 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9400cad0 con 0x7f2f84003c20 2023-10-09T07:58:28.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.567+0000 7f2f9f9ff700 1 -- 172.21.15.71:0/1201793901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f84003c20 msgr2=0x7f2f84004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:28.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.567+0000 7f2f9f9ff700 1 --2- 172.21.15.71:0/1201793901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f84003c20 0x7f2f84004010 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f2f94001a50 tx=0x7f2f94007d30 comp rx=0 tx=0).stop 2023-10-09T07:58:28.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.567+0000 7f2f9df9c700 1 -- 172.21.15.71:0/1201793901 reap_dead start 2023-10-09T07:58:28.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.567+0000 7f2f9f9ff700 1 -- 172.21.15.71:0/1201793901 shutdown_connections 2023-10-09T07:58:28.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.567+0000 7f2f9f9ff700 1 -- 172.21.15.71:0/1201793901 >> 172.21.15.71:0/1201793901 conn(0x7f2f9806a320 msgr2=0x7f2f980cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:28.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.567+0000 7f2f9f9ff700 1 -- 172.21.15.71:0/1201793901 shutdown_connections 2023-10-09T07:58:28.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.567+0000 7f2f9f9ff700 1 -- 172.21.15.71:0/1201793901 wait complete. 2023-10-09T07:58:28.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.569+0000 7f2f9f9ff700 1 Processor -- start 2023-10-09T07:58:28.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.569+0000 7f2f9f9ff700 1 -- start start 2023-10-09T07:58:28.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.570+0000 7f2f9f9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f84003c20 0x7f2f980c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:28.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.570+0000 7f2f9f9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f98156ff0 0x7f2f98154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:28.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.570+0000 7f2f9f9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f98152cc0 0x7f2f98153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:28.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.570+0000 7f2f9f9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980c6bb0 con 0x7f2f98156ff0 2023-10-09T07:58:28.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.570+0000 7f2f9f9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980c5cc0 con 0x7f2f84003c20 2023-10-09T07:58:28.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.570+0000 7f2f9f9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980c5fa0 con 0x7f2f98152cc0 2023-10-09T07:58:28.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.570+0000 7f2f9cf9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f98156ff0 0x7f2f98154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:28.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.570+0000 7f2f9cf9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f98156ff0 0x7f2f98154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42794/0 (socket says 172.21.15.71:42794) 2023-10-09T07:58:28.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.570+0000 7f2f9cf9a700 1 -- 172.21.15.71:0/426611273 learned_addr learned my addr 172.21.15.71:0/426611273 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:28.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.570+0000 7f2f9cf9a700 1 -- 172.21.15.71:0/426611273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f98152cc0 msgr2=0x7f2f98153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:28.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.570+0000 7f2f9cf9a700 1 --2- 172.21.15.71:0/426611273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f98152cc0 0x7f2f98153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:28.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.570+0000 7f2f9cf9a700 1 -- 172.21.15.71:0/426611273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f84003c20 msgr2=0x7f2f980c56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:28.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.570+0000 7f2f9cf9a700 1 --2- 172.21.15.71:0/426611273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f84003c20 0x7f2f980c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:28.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.570+0000 7f2f9cf9a700 1 -- 172.21.15.71:0/426611273 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f980c6280 con 0x7f2f98156ff0 2023-10-09T07:58:28.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.570+0000 7f2f9cf9a700 1 --2- 172.21.15.71:0/426611273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f98156ff0 0x7f2f98154b10 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800ec80 tx=0x7f2f880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:28.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.571+0000 7f2f8d7fa700 1 -- 172.21.15.71:0/426611273 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8800c9d0 con 0x7f2f98156ff0 2023-10-09T07:58:28.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.571+0000 7f2f8d7fa700 1 -- 172.21.15.71:0/426611273 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8800cb30 con 0x7f2f98156ff0 2023-10-09T07:58:28.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.571+0000 7f2f9f9ff700 1 -- 172.21.15.71:0/426611273 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f980c6560 con 0x7f2f98156ff0 2023-10-09T07:58:28.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.571+0000 7f2f8d7fa700 1 -- 172.21.15.71:0/426611273 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88013470 con 0x7f2f98156ff0 2023-10-09T07:58:28.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.571+0000 7f2f9f9ff700 1 -- 172.21.15.71:0/426611273 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f98157460 con 0x7f2f98156ff0 2023-10-09T07:58:28.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.572+0000 7f2f9f9ff700 1 -- 172.21.15.71:0/426611273 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f980c6e90 con 0x7f2f98156ff0 2023-10-09T07:58:28.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.572+0000 7f2f8d7fa700 1 -- 172.21.15.71:0/426611273 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f88013820 con 0x7f2f98156ff0 2023-10-09T07:58:28.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.573+0000 7f2f8d7fa700 1 --2- 172.21.15.71:0/426611273 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2f7c066f30 0x7f2f7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:28.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.573+0000 7f2f8d7fa700 1 -- 172.21.15.71:0/426611273 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f2f88084a00 con 0x7f2f98156ff0 2023-10-09T07:58:28.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.574+0000 7f2f9d79b700 1 --2- 172.21.15.71:0/426611273 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2f7c066f30 0x7f2f7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:28.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.574+0000 7f2f9d79b700 1 --2- 172.21.15.71:0/426611273 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2f7c066f30 0x7f2f7c0693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2f94001ed0 tx=0x7f2f94015000 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:28.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.577+0000 7f2f8d7fa700 1 -- 172.21.15.71:0/426611273 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f88051a00 con 0x7f2f98156ff0 2023-10-09T07:58:28.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.762+0000 7f2f9f9ff700 1 -- 172.21.15.71:0/426611273 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f980c6cf0 con 0x7f2f7c066f30 2023-10-09T07:58:28.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.771+0000 7f2f8d7fa700 1 -- 172.21.15.71:0/426611273 <== mgr.8503 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279773 (secure 0 0 0) 0x7f2f980c6cf0 con 0x7f2f7c066f30 2023-10-09T07:58:28.775 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:58:28.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.775+0000 7f2f9f9ff700 1 -- 172.21.15.71:0/426611273 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2f7c066f30 msgr2=0x7f2f7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:28.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.775+0000 7f2f9f9ff700 1 --2- 172.21.15.71:0/426611273 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2f7c066f30 0x7f2f7c0693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2f94001ed0 tx=0x7f2f94015000 comp rx=0 tx=0).stop 2023-10-09T07:58:28.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.775+0000 7f2f9f9ff700 1 -- 172.21.15.71:0/426611273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f98156ff0 msgr2=0x7f2f98154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:28.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.775+0000 7f2f9f9ff700 1 --2- 172.21.15.71:0/426611273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f98156ff0 0x7f2f98154b10 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800ec80 tx=0x7f2f880091a0 comp rx=0 tx=0).stop 2023-10-09T07:58:28.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.775+0000 7f2f9f9ff700 1 -- 172.21.15.71:0/426611273 shutdown_connections 2023-10-09T07:58:28.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.775+0000 7f2f9f9ff700 1 --2- 172.21.15.71:0/426611273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f98152cc0 0x7f2f98153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:28.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.775+0000 7f2f9f9ff700 1 --2- 172.21.15.71:0/426611273 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2f7c066f30 0x7f2f7c0693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:28.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.775+0000 7f2f9f9ff700 1 --2- 172.21.15.71:0/426611273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f84003c20 0x7f2f980c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:28.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.775+0000 7f2f9f9ff700 1 --2- 172.21.15.71:0/426611273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f98156ff0 0x7f2f98154b10 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:28.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.775+0000 7f2f9f9ff700 1 -- 172.21.15.71:0/426611273 >> 172.21.15.71:0/426611273 conn(0x7f2f9806a320 msgr2=0x7f2f98155fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:28.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.775+0000 7f2f9f9ff700 1 -- 172.21.15.71:0/426611273 shutdown_connections 2023-10-09T07:58:28.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:28.775+0000 7f2f9f9ff700 1 -- 172.21.15.71:0/426611273 wait complete. 2023-10-09T07:58:28.779 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T07:58:28.793 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-09T07:58:26.961246+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591974,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":499,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":311,"ondisk_log_size":311,"up":70,"acting":70,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":2466044,"kb_used_data":18108,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752508676,"statfs":{"total":773094113280,"available":770568884224,"internally_reserved":0,"allocated":18542592,"data_stored":9828823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1606,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.950367"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.051793+0000","last_change":"2023-10-09T07:58:24.050753+0000","last_active":"2023-10-09T07:58:24.051793+0000","last_peered":"2023-10-09T07:58:24.051793+0000","last_clean":"2023-10-09T07:58:24.051793+0000","last_became_active":"2023-10-09T07:58:24.050542+0000","last_became_peered":"2023-10-09T07:58:24.050542+0000","last_unstale":"2023-10-09T07:58:24.051793+0000","last_undegraded":"2023-10-09T07:58:24.051793+0000","last_fullsized":"2023-10-09T07:58:24.051793+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:31.820966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048122+0000","last_change":"2023-10-09T07:58:24.043868+0000","last_active":"2023-10-09T07:58:24.048122+0000","last_peered":"2023-10-09T07:58:24.048122+0000","last_clean":"2023-10-09T07:58:24.048122+0000","last_became_active":"2023-10-09T07:58:24.043622+0000","last_became_peered":"2023-10-09T07:58:24.043622+0000","last_unstale":"2023-10-09T07:58:24.048122+0000","last_undegraded":"2023-10-09T07:58:24.048122+0000","last_fullsized":"2023-10-09T07:58:24.048122+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:45.661437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037247+0000","last_change":"2023-10-09T07:58:24.034026+0000","last_active":"2023-10-09T07:58:24.037247+0000","last_peered":"2023-10-09T07:58:24.037247+0000","last_clean":"2023-10-09T07:58:24.037247+0000","last_became_active":"2023-10-09T07:58:24.033378+0000","last_became_peered":"2023-10-09T07:58:24.033378+0000","last_unstale":"2023-10-09T07:58:24.037247+0000","last_undegraded":"2023-10-09T07:58:24.037247+0000","last_fullsized":"2023-10-09T07:58:24.037247+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:30.633397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.039832+0000","last_change":"2023-10-09T07:58:24.034388+0000","last_active":"2023-10-09T07:58:24.039832+0000","last_peered":"2023-10-09T07:58:24.039832+0000","last_clean":"2023-10-09T07:58:24.039832+0000","last_became_active":"2023-10-09T07:58:24.033937+0000","last_became_peered":"2023-10-09T07:58:24.033937+0000","last_unstale":"2023-10-09T07:58:24.039832+0000","last_undegraded":"2023-10-09T07:58:24.039832+0000","last_fullsized":"2023-10-09T07:58:24.039832+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:44.690645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.039861+0000","last_change":"2023-10-09T07:58:24.035442+0000","last_active":"2023-10-09T07:58:24.039861+0000","last_peered":"2023-10-09T07:58:24.039861+0000","last_clean":"2023-10-09T07:58:24.039861+0000","last_became_active":"2023-10-09T07:58:24.034999+0000","last_became_peered":"2023-10-09T07:58:24.034999+0000","last_unstale":"2023-10-09T07:58:24.039861+0000","last_undegraded":"2023-10-09T07:58:24.039861+0000","last_fullsized":"2023-10-09T07:58:24.039861+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:58.571728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.047182+0000","last_change":"2023-10-09T07:58:24.041213+0000","last_active":"2023-10-09T07:58:24.047182+0000","last_peered":"2023-10-09T07:58:24.047182+0000","last_clean":"2023-10-09T07:58:24.047182+0000","last_became_active":"2023-10-09T07:58:24.040940+0000","last_became_peered":"2023-10-09T07:58:24.040940+0000","last_unstale":"2023-10-09T07:58:24.047182+0000","last_undegraded":"2023-10-09T07:58:24.047182+0000","last_fullsized":"2023-10-09T07:58:24.047182+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:20.139851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048032+0000","last_change":"2023-10-09T07:58:24.042197+0000","last_active":"2023-10-09T07:58:24.048032+0000","last_peered":"2023-10-09T07:58:24.048032+0000","last_clean":"2023-10-09T07:58:24.048032+0000","last_became_active":"2023-10-09T07:58:24.041921+0000","last_became_peered":"2023-10-09T07:58:24.041921+0000","last_unstale":"2023-10-09T07:58:24.048032+0000","last_undegraded":"2023-10-09T07:58:24.048032+0000","last_fullsized":"2023-10-09T07:58:24.048032+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:07.075855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.036601+0000","last_change":"2023-10-09T07:58:24.032315+0000","last_active":"2023-10-09T07:58:24.036601+0000","last_peered":"2023-10-09T07:58:24.036601+0000","last_clean":"2023-10-09T07:58:24.036601+0000","last_became_active":"2023-10-09T07:58:24.032042+0000","last_became_peered":"2023-10-09T07:58:24.032042+0000","last_unstale":"2023-10-09T07:58:24.036601+0000","last_undegraded":"2023-10-09T07:58:24.036601+0000","last_fullsized":"2023-10-09T07:58:24.036601+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:05.127890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048256+0000","last_change":"2023-10-09T07:58:24.041854+0000","last_active":"2023-10-09T07:58:24.048256+0000","last_peered":"2023-10-09T07:58:24.048256+0000","last_clean":"2023-10-09T07:58:24.048256+0000","last_became_active":"2023-10-09T07:58:24.041577+0000","last_became_peered":"2023-10-09T07:58:24.041577+0000","last_unstale":"2023-10-09T07:58:24.048256+0000","last_undegraded":"2023-10-09T07:58:24.048256+0000","last_fullsized":"2023-10-09T07:58:24.048256+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:00:19.369349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048217+0000","last_change":"2023-10-09T07:58:24.042324+0000","last_active":"2023-10-09T07:58:24.048217+0000","last_peered":"2023-10-09T07:58:24.048217+0000","last_clean":"2023-10-09T07:58:24.048217+0000","last_became_active":"2023-10-09T07:58:24.042010+0000","last_became_peered":"2023-10-09T07:58:24.042010+0000","last_unstale":"2023-10-09T07:58:24.048217+0000","last_undegraded":"2023-10-09T07:58:24.048217+0000","last_fullsized":"2023-10-09T07:58:24.048217+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:16.438076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.052659+0000","last_change":"2023-10-09T07:58:24.052200+0000","last_active":"2023-10-09T07:58:24.052659+0000","last_peered":"2023-10-09T07:58:24.052659+0000","last_clean":"2023-10-09T07:58:24.052659+0000","last_became_active":"2023-10-09T07:58:24.051595+0000","last_became_peered":"2023-10-09T07:58:24.051595+0000","last_unstale":"2023-10-09T07:58:24.052659+0000","last_undegraded":"2023-10-09T07:58:24.052659+0000","last_fullsized":"2023-10-09T07:58:24.052659+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:42:21.938720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.045210+0000","last_change":"2023-10-09T07:58:24.042772+0000","last_active":"2023-10-09T07:58:24.045210+0000","last_peered":"2023-10-09T07:58:24.045210+0000","last_clean":"2023-10-09T07:58:24.045210+0000","last_became_active":"2023-10-09T07:58:24.042398+0000","last_became_peered":"2023-10-09T07:58:24.042398+0000","last_unstale":"2023-10-09T07:58:24.045210+0000","last_undegraded":"2023-10-09T07:58:24.045210+0000","last_fullsized":"2023-10-09T07:58:24.045210+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:19.906242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048245+0000","last_change":"2023-10-09T07:58:24.043813+0000","last_active":"2023-10-09T07:58:24.048245+0000","last_peered":"2023-10-09T07:58:24.048245+0000","last_clean":"2023-10-09T07:58:24.048245+0000","last_became_active":"2023-10-09T07:58:24.043558+0000","last_became_peered":"2023-10-09T07:58:24.043558+0000","last_unstale":"2023-10-09T07:58:24.048245+0000","last_undegraded":"2023-10-09T07:58:24.048245+0000","last_fullsized":"2023-10-09T07:58:24.048245+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:36.378974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.040246+0000","last_change":"2023-10-09T07:58:24.035180+0000","last_active":"2023-10-09T07:58:24.040246+0000","last_peered":"2023-10-09T07:58:24.040246+0000","last_clean":"2023-10-09T07:58:24.040246+0000","last_became_active":"2023-10-09T07:58:24.034916+0000","last_became_peered":"2023-10-09T07:58:24.034916+0000","last_unstale":"2023-10-09T07:58:24.040246+0000","last_undegraded":"2023-10-09T07:58:24.040246+0000","last_fullsized":"2023-10-09T07:58:24.040246+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:12:00.905354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.039892+0000","last_change":"2023-10-09T07:58:24.034722+0000","last_active":"2023-10-09T07:58:24.039892+0000","last_peered":"2023-10-09T07:58:24.039892+0000","last_clean":"2023-10-09T07:58:24.039892+0000","last_became_active":"2023-10-09T07:58:24.033015+0000","last_became_peered":"2023-10-09T07:58:24.033015+0000","last_unstale":"2023-10-09T07:58:24.039892+0000","last_undegraded":"2023-10-09T07:58:24.039892+0000","last_fullsized":"2023-10-09T07:58:24.039892+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:48:29.551743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.053251+0000","last_change":"2023-10-09T07:58:23.039908+0000","last_active":"2023-10-09T07:58:24.053251+0000","last_peered":"2023-10-09T07:58:24.053251+0000","last_clean":"2023-10-09T07:58:24.053251+0000","last_became_active":"2023-10-09T07:58:23.039653+0000","last_became_peered":"2023-10-09T07:58:23.039653+0000","last_unstale":"2023-10-09T07:58:24.053251+0000","last_undegraded":"2023-10-09T07:58:24.053251+0000","last_fullsized":"2023-10-09T07:58:24.053251+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:29:27.162187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.027437+0000","last_change":"2023-10-09T07:58:23.036137+0000","last_active":"2023-10-09T07:58:24.027437+0000","last_peered":"2023-10-09T07:58:24.027437+0000","last_clean":"2023-10-09T07:58:24.027437+0000","last_became_active":"2023-10-09T07:58:23.035828+0000","last_became_peered":"2023-10-09T07:58:23.035828+0000","last_unstale":"2023-10-09T07:58:24.027437+0000","last_undegraded":"2023-10-09T07:58:24.027437+0000","last_fullsized":"2023-10-09T07:58:24.027437+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:30:00.666411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.042455+0000","last_change":"2023-10-09T07:58:24.038556+0000","last_active":"2023-10-09T07:58:24.042455+0000","last_peered":"2023-10-09T07:58:24.042455+0000","last_clean":"2023-10-09T07:58:24.042455+0000","last_became_active":"2023-10-09T07:58:24.038266+0000","last_became_peered":"2023-10-09T07:58:24.038266+0000","last_unstale":"2023-10-09T07:58:24.042455+0000","last_undegraded":"2023-10-09T07:58:24.042455+0000","last_fullsized":"2023-10-09T07:58:24.042455+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:20.483964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"175'6","reported_seq":16,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.056822+0000","last_change":"2023-10-09T07:58:23.032317+0000","last_active":"2023-10-09T07:58:24.056822+0000","last_peered":"2023-10-09T07:58:24.056822+0000","last_clean":"2023-10-09T07:58:24.056822+0000","last_became_active":"2023-10-09T07:58:23.032034+0000","last_became_peered":"2023-10-09T07:58:23.032034+0000","last_unstale":"2023-10-09T07:58:24.056822+0000","last_undegraded":"2023-10-09T07:58:24.056822+0000","last_fullsized":"2023-10-09T07:58:24.056822+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:01:27.509478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.025872+0000","last_change":"2023-10-09T07:58:23.027831+0000","last_active":"2023-10-09T07:58:24.025872+0000","last_peered":"2023-10-09T07:58:24.025872+0000","last_clean":"2023-10-09T07:58:24.025872+0000","last_became_active":"2023-10-09T07:58:23.027573+0000","last_became_peered":"2023-10-09T07:58:23.027573+0000","last_unstale":"2023-10-09T07:58:24.025872+0000","last_undegraded":"2023-10-09T07:58:24.025872+0000","last_fullsized":"2023-10-09T07:58:24.025872+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:30.137019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"175'8","reported_seq":18,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.055611+0000","last_change":"2023-10-09T07:58:23.041105+0000","last_active":"2023-10-09T07:58:24.055611+0000","last_peered":"2023-10-09T07:58:24.055611+0000","last_clean":"2023-10-09T07:58:24.055611+0000","last_became_active":"2023-10-09T07:58:23.040899+0000","last_became_peered":"2023-10-09T07:58:23.040899+0000","last_unstale":"2023-10-09T07:58:24.055611+0000","last_undegraded":"2023-10-09T07:58:24.055611+0000","last_fullsized":"2023-10-09T07:58:24.055611+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:08:51.278424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.055105+0000","last_change":"2023-10-09T07:58:24.053157+0000","last_active":"2023-10-09T07:58:24.055105+0000","last_peered":"2023-10-09T07:58:24.055105+0000","last_clean":"2023-10-09T07:58:24.055105+0000","last_became_active":"2023-10-09T07:58:24.052868+0000","last_became_peered":"2023-10-09T07:58:24.052868+0000","last_unstale":"2023-10-09T07:58:24.055105+0000","last_undegraded":"2023-10-09T07:58:24.055105+0000","last_fullsized":"2023-10-09T07:58:24.055105+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:41.116662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.052803+0000","last_change":"2023-10-09T07:58:23.040353+0000","last_active":"2023-10-09T07:58:24.052803+0000","last_peered":"2023-10-09T07:58:24.052803+0000","last_clean":"2023-10-09T07:58:24.052803+0000","last_became_active":"2023-10-09T07:58:23.039961+0000","last_became_peered":"2023-10-09T07:58:23.039961+0000","last_unstale":"2023-10-09T07:58:24.052803+0000","last_undegraded":"2023-10-09T07:58:24.052803+0000","last_fullsized":"2023-10-09T07:58:24.052803+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:59.029087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.049602+0000","last_change":"2023-10-09T07:58:24.047359+0000","last_active":"2023-10-09T07:58:24.049602+0000","last_peered":"2023-10-09T07:58:24.049602+0000","last_clean":"2023-10-09T07:58:24.049602+0000","last_became_active":"2023-10-09T07:58:24.047026+0000","last_became_peered":"2023-10-09T07:58:24.047026+0000","last_unstale":"2023-10-09T07:58:24.049602+0000","last_undegraded":"2023-10-09T07:58:24.049602+0000","last_fullsized":"2023-10-09T07:58:24.049602+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:18.603205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.059199+0000","last_change":"2023-10-09T07:58:23.037844+0000","last_active":"2023-10-09T07:58:24.059199+0000","last_peered":"2023-10-09T07:58:24.059199+0000","last_clean":"2023-10-09T07:58:24.059199+0000","last_became_active":"2023-10-09T07:58:23.037598+0000","last_became_peered":"2023-10-09T07:58:23.037598+0000","last_unstale":"2023-10-09T07:58:24.059199+0000","last_undegraded":"2023-10-09T07:58:24.059199+0000","last_fullsized":"2023-10-09T07:58:24.059199+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:12.869232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037253+0000","last_change":"2023-10-09T07:58:24.033828+0000","last_active":"2023-10-09T07:58:24.037253+0000","last_peered":"2023-10-09T07:58:24.037253+0000","last_clean":"2023-10-09T07:58:24.037253+0000","last_became_active":"2023-10-09T07:58:24.033580+0000","last_became_peered":"2023-10-09T07:58:24.033580+0000","last_unstale":"2023-10-09T07:58:24.037253+0000","last_undegraded":"2023-10-09T07:58:24.037253+0000","last_fullsized":"2023-10-09T07:58:24.037253+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:27:48.279381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037265+0000","last_change":"2023-10-09T07:58:24.034230+0000","last_active":"2023-10-09T07:58:24.037265+0000","last_peered":"2023-10-09T07:58:24.037265+0000","last_clean":"2023-10-09T07:58:24.037265+0000","last_became_active":"2023-10-09T07:58:24.033758+0000","last_became_peered":"2023-10-09T07:58:24.033758+0000","last_unstale":"2023-10-09T07:58:24.037265+0000","last_undegraded":"2023-10-09T07:58:24.037265+0000","last_fullsized":"2023-10-09T07:58:24.037265+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:10:36.736260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.025916+0000","last_change":"2023-10-09T07:58:23.039543+0000","last_active":"2023-10-09T07:58:24.025916+0000","last_peered":"2023-10-09T07:58:24.025916+0000","last_clean":"2023-10-09T07:58:24.025916+0000","last_became_active":"2023-10-09T07:58:23.039245+0000","last_became_peered":"2023-10-09T07:58:23.039245+0000","last_unstale":"2023-10-09T07:58:24.025916+0000","last_undegraded":"2023-10-09T07:58:24.025916+0000","last_fullsized":"2023-10-09T07:58:24.025916+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:04.616687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.026095+0000","last_change":"2023-10-09T07:58:23.033638+0000","last_active":"2023-10-09T07:58:24.026095+0000","last_peered":"2023-10-09T07:58:24.026095+0000","last_clean":"2023-10-09T07:58:24.026095+0000","last_became_active":"2023-10-09T07:58:23.033359+0000","last_became_peered":"2023-10-09T07:58:23.033359+0000","last_unstale":"2023-10-09T07:58:24.026095+0000","last_undegraded":"2023-10-09T07:58:24.026095+0000","last_fullsized":"2023-10-09T07:58:24.026095+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:21:06.621088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037576+0000","last_change":"2023-10-09T07:58:24.033310+0000","last_active":"2023-10-09T07:58:24.037576+0000","last_peered":"2023-10-09T07:58:24.037576+0000","last_clean":"2023-10-09T07:58:24.037576+0000","last_became_active":"2023-10-09T07:58:24.033044+0000","last_became_peered":"2023-10-09T07:58:24.033044+0000","last_unstale":"2023-10-09T07:58:24.037576+0000","last_undegraded":"2023-10-09T07:58:24.037576+0000","last_fullsized":"2023-10-09T07:58:24.037576+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:30.145065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.025758+0000","last_change":"2023-10-09T07:58:23.034259+0000","last_active":"2023-10-09T07:58:24.025758+0000","last_peered":"2023-10-09T07:58:24.025758+0000","last_clean":"2023-10-09T07:58:24.025758+0000","last_became_active":"2023-10-09T07:58:23.033993+0000","last_became_peered":"2023-10-09T07:58:23.033993+0000","last_unstale":"2023-10-09T07:58:24.025758+0000","last_undegraded":"2023-10-09T07:58:24.025758+0000","last_fullsized":"2023-10-09T07:58:24.025758+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:36.449503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.040603+0000","last_change":"2023-10-09T07:58:24.034496+0000","last_active":"2023-10-09T07:58:24.040603+0000","last_peered":"2023-10-09T07:58:24.040603+0000","last_clean":"2023-10-09T07:58:24.040603+0000","last_became_active":"2023-10-09T07:58:24.034246+0000","last_became_peered":"2023-10-09T07:58:24.034246+0000","last_unstale":"2023-10-09T07:58:24.040603+0000","last_undegraded":"2023-10-09T07:58:24.040603+0000","last_fullsized":"2023-10-09T07:58:24.040603+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:09.684425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.022165+0000","last_change":"2023-10-09T07:58:23.035059+0000","last_active":"2023-10-09T07:58:24.022165+0000","last_peered":"2023-10-09T07:58:24.022165+0000","last_clean":"2023-10-09T07:58:24.022165+0000","last_became_active":"2023-10-09T07:58:23.034777+0000","last_became_peered":"2023-10-09T07:58:23.034777+0000","last_unstale":"2023-10-09T07:58:24.022165+0000","last_undegraded":"2023-10-09T07:58:24.022165+0000","last_fullsized":"2023-10-09T07:58:24.022165+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:35:59.356322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:23.010065+0000","last_change":"2023-10-09T07:58:23.010065+0000","last_active":"2023-10-09T07:58:23.010065+0000","last_peered":"2023-10-09T07:58:23.010065+0000","last_clean":"2023-10-09T07:58:23.010065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:23.010065+0000","last_undegraded":"2023-10-09T07:58:23.010065+0000","last_fullsized":"2023-10-09T07:58:23.010065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037217+0000","last_change":"2023-10-09T07:58:24.033312+0000","last_active":"2023-10-09T07:58:24.037217+0000","last_peered":"2023-10-09T07:58:24.037217+0000","last_clean":"2023-10-09T07:58:24.037217+0000","last_became_active":"2023-10-09T07:58:24.033036+0000","last_became_peered":"2023-10-09T07:58:24.033036+0000","last_unstale":"2023-10-09T07:58:24.037217+0000","last_undegraded":"2023-10-09T07:58:24.037217+0000","last_fullsized":"2023-10-09T07:58:24.037217+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:42.710219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T07:58:22.001051+0000","last_change":"2023-10-09T07:58:22.001051+0000","last_active":"2023-10-09T07:58:22.001051+0000","last_peered":"2023-10-09T07:58:22.001051+0000","last_clean":"2023-10-09T07:58:22.001051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T07:58:22.001051+0000","last_undegraded":"2023-10-09T07:58:22.001051+0000","last_fullsized":"2023-10-09T07:58:22.001051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"166'293","reported_seq":916,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-09T07:58:18.995699+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T07:58:18.995699+0000","last_peered":"2023-10-09T07:58:18.995699+0000","last_clean":"2023-10-09T07:58:18.995699+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T07:58:18.995699+0000","last_undegraded":"2023-10-09T07:58:18.995699+0000","last_fullsized":"2023-10-09T07:58:18.995699+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":3},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":1606,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":22,"acting":22,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575750,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308156,"kb_used_data":2676,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063684,"statfs":{"total":96636764160,"available":96321212416,"internally_reserved":0,"allocated":2740224,"data_stored":1660797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.72799999999999998,"15min":0.752},"min":{"1min":0.45300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.127},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.749,"15min":0.76400000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.47399999999999998},"max":{"1min":0.98099999999999998,"5min":1.026,"15min":1.1319999999999999},"last":0.85199999999999998}]},{"osd":1,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.71899999999999997,"15min":0.73399999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.875,"5min":0.96599999999999997,"15min":1.077},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.751},"min":{"1min":0.50900000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92200000000000004,"5min":0.997,"15min":1.038},"last":0.82399999999999995}]},{"osd":2,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.96399999999999997,"5min":0.98999999999999999,"15min":1.0269999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.52800000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91500000000000004,"5min":0.98299999999999998,"15min":1.1899999999999999},"last":0.81100000000000005}]},{"osd":3,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.72199999999999998,"15min":0.73599999999999999},"min":{"1min":0.499,"5min":0.49399999999999999,"15min":0.42099999999999999},"max":{"1min":0.88900000000000001,"5min":0.995,"15min":1.04},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77600000000000002,"15min":0.79200000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.036,"5min":1.0529999999999999,"15min":1.0920000000000001},"last":0.74299999999999999}]},{"osd":4,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63800000000000001,"15min":0.626},"min":{"1min":0.47599999999999998,"5min":0.42199999999999999,"15min":0.36299999999999999},"max":{"1min":0.94099999999999995,"5min":0.97099999999999997,"15min":1.248},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.93700000000000006,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.61499999999999999}]},{"osd":5,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63900000000000001,"15min":0.65400000000000003},"min":{"1min":0.41399999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68799999999999994,"15min":0.69699999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.304},"last":0.63100000000000001}]},{"osd":6,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73899999999999999,"15min":0.75},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.405},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71099999999999997,"15min":0.71899999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.43099999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.377},"last":0.65600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575749,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311672,"kb_used_data":2096,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060168,"statfs":{"total":96636764160,"available":96317612032,"internally_reserved":0,"allocated":2146304,"data_stored":1070429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.33600000000000002},"max":{"1min":0.93600000000000005,"5min":0.98399999999999999,"15min":1.012},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.75600000000000001,"15min":0.75},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84899999999999998,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.77100000000000002}]},{"osd":1,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76800000000000002,"15min":0.76900000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1100000000000001,"5min":1.113,"15min":1.2769999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.78700000000000003,"15min":0.76700000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.02,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.79700000000000004}]},{"osd":2,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.76000000000000001},"min":{"1min":0.55400000000000005,"5min":0.46100000000000002,"15min":0.432},"max":{"1min":1.0369999999999999,"5min":1.0589999999999999,"15min":1.075},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79200000000000004,"15min":0.77700000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.86499999999999999,"5min":1.151,"15min":1.151},"last":0.71299999999999997}]},{"osd":3,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76300000000000001,"15min":0.755},"min":{"1min":0.52700000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95299999999999996,"5min":1.423,"15min":1.423},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80200000000000005,"15min":0.78500000000000003},"min":{"1min":0.59699999999999998,"5min":0.55500000000000005,"15min":0.54100000000000004},"max":{"1min":1.0800000000000001,"5min":1.335,"15min":1.335},"last":0.91700000000000004}]},{"osd":4,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.36199999999999999},"max":{"1min":0.89800000000000002,"5min":0.97399999999999998,"15min":1.0960000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65900000000000003,"15min":0.65300000000000002},"min":{"1min":0.45500000000000002,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.91500000000000004,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.871}]},{"osd":5,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.52400000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.137,"5min":1.306,"15min":1.306},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.48199999999999998,"5min":0.45400000000000001,"15min":0.42699999999999999},"max":{"1min":0.96599999999999997,"5min":1.054,"15min":1.085},"last":1.004}]},{"osd":7,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69799999999999995,"15min":0.69199999999999995},"min":{"1min":0.51700000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.96799999999999997,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.74099999999999999,"15min":0.73799999999999999},"min":{"1min":0.498,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1639999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.04}]}]},{"osd":1,"up_from":13,"seq":55834575751,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303532,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068308,"statfs":{"total":96636764160,"available":96325947392,"internally_reserved":0,"allocated":2199552,"data_stored":1097958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48499999999999999,"15min":0.46800000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.308},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.52400000000000002,"15min":0.50700000000000001},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.313},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.37}]},{"osd":2,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.54800000000000004,"15min":0.51700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32900000000000001},"max":{"1min":5.1159999999999997,"5min":5.1159999999999997,"15min":5.1159999999999997},"last":0.436},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.63600000000000001,"15min":0.59599999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.375},"max":{"1min":5.399,"5min":5.399,"15min":5.399},"last":0.40000000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.63900000000000001,"15min":0.63600000000000001},"min":{"1min":0.42999999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.41699999999999998,"5min":0.39900000000000002,"15min":0.37},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.49299999999999999}]},{"osd":4,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.83899999999999997,"15min":0.80800000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.42699999999999999},"max":{"1min":5.2409999999999997,"5min":5.2409999999999997,"15min":5.2409999999999997},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.86599999999999999,"15min":0.82699999999999996},"min":{"1min":0.65700000000000003,"5min":0.622,"15min":0.56699999999999995},"max":{"1min":5.4409999999999998,"5min":5.4409999999999998,"15min":5.4409999999999998},"last":0.626}]},{"osd":5,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.81499999999999995,"15min":0.81100000000000005},"min":{"1min":0.64000000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.85499999999999998,"15min":0.82499999999999996},"min":{"1min":0.60299999999999998,"5min":0.57999999999999996,"15min":0.442},"max":{"1min":5.1630000000000003,"5min":5.1630000000000003,"15min":5.1630000000000003},"last":0.61699999999999999}]},{"osd":6,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.89300000000000002,"15min":0.84499999999999997},"min":{"1min":0.65300000000000002,"5min":0.63900000000000001,"15min":0.55100000000000005},"max":{"1min":5.4749999999999996,"5min":5.4749999999999996,"15min":5.4749999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83499999999999996,"15min":0.82999999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.56000000000000005},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.081,"5min":0.92800000000000005,"15min":0.88500000000000001},"min":{"1min":0.66500000000000004,"5min":0.63,"15min":0.55300000000000005},"max":{"1min":5.2009999999999996,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":0.79000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575750,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308220,"kb_used_data":2740,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063620,"statfs":{"total":96636764160,"available":96321146880,"internally_reserved":0,"allocated":2805760,"data_stored":1689342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.48699999999999999,"15min":0.47499999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.52800000000000002,"5min":0.72099999999999997,"15min":0.80100000000000005},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53100000000000003,"15min":0.54500000000000004},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.32000000000000001},"max":{"1min":0.71099999999999997,"5min":0.82999999999999996,"15min":0.88200000000000001},"last":0.47599999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56200000000000006,"15min":0.56499999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77800000000000002,"5min":0.83499999999999996,"15min":0.91800000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.60499999999999998,"5min":0.70599999999999996,"15min":0.82399999999999995},"last":0.51200000000000001}]},{"osd":3,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67900000000000005,"5min":0.78400000000000003,"15min":0.98599999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.74299999999999999,"5min":0.89600000000000002,"15min":0.94699999999999995},"last":0.52600000000000002}]},{"osd":4,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.52200000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.532},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81299999999999994,"15min":0.81999999999999995},"min":{"1min":0.626,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.202,"5min":1.202,"15min":1.2470000000000001},"last":0.79200000000000004}]},{"osd":5,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79800000000000004,"15min":0.79900000000000004},"min":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.01,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.80600000000000005,"15min":0.81299999999999994},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.55500000000000005},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.3009999999999999},"last":0.85699999999999998}]},{"osd":6,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.84099999999999997,"15min":0.83799999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0860000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81599999999999995,"15min":0.81999999999999995},"min":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.51400000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.3859999999999999},"last":0.82399999999999995}]},{"osd":7,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.84099999999999997,"15min":0.85399999999999998},"min":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3380000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.877,"15min":0.86799999999999999},"min":{"1min":0.66000000000000003,"5min":0.61899999999999999,"15min":0.54400000000000004},"max":{"1min":1.131,"5min":1.218,"15min":1.3580000000000001},"last":0.89100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575750,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311736,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060104,"statfs":{"total":96636764160,"available":96317546496,"internally_reserved":0,"allocated":2211840,"data_stored":1099010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46000000000000002,"15min":0.47099999999999997},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52500000000000002,"15min":0.51400000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.49199999999999999}]},{"osd":1,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.48999999999999999,"15min":0.48699999999999999},"min":{"1min":0.40699999999999997,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.34599999999999997},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.98699999999999999},"last":0.46700000000000003}]},{"osd":3,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.625,"15min":0.61799999999999999},"min":{"1min":0.48199999999999998,"5min":0.46600000000000003,"15min":0.41399999999999998},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.45500000000000002,"5min":0.44500000000000001,"15min":0.40999999999999998},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.52200000000000002}]},{"osd":4,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81299999999999994,"15min":0.80000000000000004},"min":{"1min":0.56499999999999995,"5min":0.56299999999999994,"15min":0.54500000000000004},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79200000000000004,"15min":0.78300000000000003},"min":{"1min":0.59799999999999998,"5min":0.54000000000000004,"15min":0.47799999999999998},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":0.876}]},{"osd":5,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.81299999999999994,"15min":0.79100000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.296,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.81599999999999995},"min":{"1min":0.63100000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0269999999999999,"5min":1.254,"15min":1.254},"last":0.74099999999999999}]},{"osd":6,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.82299999999999995,"15min":0.80900000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.54100000000000004},"max":{"1min":0.99399999999999999,"5min":1.1639999999999999,"15min":1.296},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82899999999999996,"15min":0.81999999999999995},"min":{"1min":0.629,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2230000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.73199999999999998}]},{"osd":7,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.85299999999999998,"15min":0.84099999999999997},"min":{"1min":0.63200000000000001,"5min":0.56499999999999995,"15min":0.53600000000000003},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.89500000000000002,"15min":0.877},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.69799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575750,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311672,"kb_used_data":2096,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060168,"statfs":{"total":96636764160,"available":96317612032,"internally_reserved":0,"allocated":2146304,"data_stored":1070429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.47399999999999998,"15min":0.48499999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63700000000000001,"5min":0.77100000000000002,"15min":0.80700000000000005},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.32300000000000001},"max":{"1min":0.76400000000000001,"5min":0.85399999999999998,"15min":0.91700000000000004},"last":0.42099999999999999}]},{"osd":1,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48299999999999998,"15min":0.498},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.84699999999999998},"last":0.308},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80100000000000005,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.40699999999999997}]},{"osd":2,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57699999999999996,"15min":0.58999999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.34999999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.90900000000000003},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.40899999999999997},"max":{"1min":0.81299999999999994,"5min":0.83799999999999997,"15min":0.95799999999999996},"last":0.44}]},{"osd":4,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.77100000000000002,"15min":0.77400000000000002},"min":{"1min":0.55500000000000005,"5min":0.55000000000000004,"15min":0.47499999999999998},"max":{"1min":1.03,"5min":1.121,"15min":1.246},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.85099999999999998,"15min":0.85299999999999998},"min":{"1min":0.63800000000000001,"5min":0.629,"15min":0.57799999999999996},"max":{"1min":1.0780000000000001,"5min":1.1419999999999999,"15min":1.157},"last":0.84299999999999997}]},{"osd":5,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.76200000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.48499999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.1910000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.48899999999999999},"max":{"1min":1.073,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.79900000000000004}]},{"osd":6,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80200000000000005,"15min":0.79700000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.495},"max":{"1min":1.05,"5min":1.149,"15min":1.149},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.80900000000000005,"15min":0.81299999999999994},"min":{"1min":0.59299999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.099,"5min":1.103,"15min":1.2230000000000001},"last":0.73799999999999999}]},{"osd":7,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84499999999999997,"15min":0.84799999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.53100000000000003},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.2430000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.85199999999999998,"15min":0.85099999999999998},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.56699999999999995},"max":{"1min":1.181,"5min":1.181,"15min":1.1850000000000001},"last":0.80700000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575749,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299384,"kb_used_data":2096,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072456,"statfs":{"total":96636764160,"available":96330194944,"internally_reserved":0,"allocated":2146304,"data_stored":1070429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90300000000000002,"5min":0.97499999999999998,"15min":1.0700000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.73999999999999999,"15min":0.754},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77500000000000002,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.80800000000000005}]},{"osd":1,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.73599999999999999,"15min":0.73099999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97799999999999998,"5min":1.038,"15min":1.0640000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.73799999999999999,"15min":0.74099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.81299999999999994,"5min":1.028,"15min":1.038},"last":0.51900000000000002}]},{"osd":2,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.79400000000000004,"15min":0.78700000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88200000000000001,"5min":0.999,"15min":1.0509999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79500000000000004,"15min":0.79700000000000004},"min":{"1min":0.60399999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.94099999999999995,"5min":1.069,"15min":1.069},"last":0.85799999999999998}]},{"osd":3,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.76000000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91800000000000004,"5min":1.131,"15min":1.131},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.014,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.65900000000000003}]},{"osd":5,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61599999999999999,"15min":0.59399999999999997},"min":{"1min":0.438,"5min":0.372,"15min":0.36299999999999999},"max":{"1min":1.0009999999999999,"5min":1.27,"15min":1.27},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.626,"15min":0.61699999999999999},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95299999999999996,"5min":1.014,"15min":1.014},"last":0.88}]},{"osd":6,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65700000000000003,"15min":0.63700000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.41699999999999998},"max":{"1min":1.0449999999999999,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67900000000000005,"15min":0.66300000000000003},"min":{"1min":0.47599999999999998,"5min":0.45500000000000002,"15min":0.39000000000000001},"max":{"1min":0.89400000000000002,"5min":1.425,"15min":1.425},"last":0.76200000000000001}]},{"osd":7,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.58699999999999997,"5min":0.48699999999999999,"15min":0.47999999999999998},"max":{"1min":0.92300000000000004,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.78300000000000003,"15min":0.76200000000000001},"min":{"1min":0.63900000000000001,"5min":0.51200000000000001,"15min":0.46600000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.91500000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575750,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311672,"kb_used_data":2096,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060168,"statfs":{"total":96636764160,"available":96317612032,"internally_reserved":0,"allocated":2146304,"data_stored":1070429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73499999999999999,"15min":0.72999999999999998},"min":{"1min":0.46500000000000002,"5min":0.46200000000000002,"15min":0.39100000000000001},"max":{"1min":1.016,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.73099999999999998,"15min":0.72199999999999998},"min":{"1min":0.51000000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97299999999999998,"5min":0.98799999999999999,"15min":1.0820000000000001},"last":0.80100000000000005}]},{"osd":1,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.73499999999999999,"15min":0.72799999999999998},"min":{"1min":0.54600000000000004,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":0.92800000000000005,"5min":0.97499999999999998,"15min":1.0129999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.748,"15min":0.751},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.0289999999999999},"last":0.746}]},{"osd":2,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76500000000000001,"15min":0.75700000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.46800000000000003},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.98599999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73699999999999999,"15min":0.74299999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.44500000000000001},"max":{"1min":0.89300000000000002,"5min":0.96399999999999997,"15min":1.026},"last":0.85099999999999998}]},{"osd":3,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.47499999999999998},"max":{"1min":0.89900000000000002,"5min":0.97399999999999998,"15min":1.107},"last":0.876},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79500000000000004,"15min":0.78600000000000003},"min":{"1min":0.58299999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.77400000000000002}]},{"osd":4,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.84099999999999997,"5min":1.002,"15min":1.0189999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.38800000000000001,"15min":0.379},"max":{"1min":0.90700000000000003,"5min":0.96199999999999997,"15min":1.0289999999999999},"last":0.67300000000000004}]},{"osd":6,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.44900000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69299999999999995,"15min":0.68400000000000005},"min":{"1min":0.48299999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.97799999999999998,"5min":0.99299999999999999,"15min":1.054},"last":0.69599999999999995}]},{"osd":7,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70799999999999996,"15min":0.69899999999999995},"min":{"1min":0.46999999999999997,"5min":0.45000000000000001,"15min":0.433},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.79000000000000004,"15min":0.78700000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.5},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.82099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T07:58:28.799 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T07:58:29.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.013+0000 7f6f19d9d700 1 Processor -- start 2023-10-09T07:58:29.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.014+0000 7f6f19d9d700 1 -- start start 2023-10-09T07:58:29.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.015+0000 7f6f19d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f140c7150 0x7f6f1406ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:29.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.015+0000 7f6f19d9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f1406e2a0 con 0x7f6f14157770 2023-10-09T07:58:29.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.015+0000 7f6f19d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f14157b40 con 0x7f6f140c6d00 2023-10-09T07:58:29.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.015+0000 7f6f19d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1406b2e0 con 0x7f6f140c7150 2023-10-09T07:58:29.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.015+0000 7f6f18d9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6f14157770 0x7f6f14150180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53526/0 (socket says 172.21.15.71:53526) 2023-10-09T07:58:29.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.015+0000 7f6f18d9b700 1 -- 172.21.15.71:0/2772355419 learned_addr learned my addr 172.21.15.71:0/2772355419 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:29.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.015+0000 7f6f1959c700 1 --2- 172.21.15.71:0/2772355419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f140c7150 0x7f6f1406ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:29.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.016+0000 7f6f137fe700 1 -- 172.21.15.71:0/2772355419 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559682699 0 0) 0x7f6f1406e2a0 con 0x7f6f14157770 2023-10-09T07:58:29.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.016+0000 7f6f137fe700 1 -- 172.21.15.71:0/2772355419 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f04003570 con 0x7f6f14157770 2023-10-09T07:58:29.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.016+0000 7f6f137fe700 1 -- 172.21.15.71:0/2772355419 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076179981 0 0) 0x7f6f14157b40 con 0x7f6f140c6d00 2023-10-09T07:58:29.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.016+0000 7f6f137fe700 1 -- 172.21.15.71:0/2772355419 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f1406e2a0 con 0x7f6f140c6d00 2023-10-09T07:58:29.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.016+0000 7f6f137fe700 1 -- 172.21.15.71:0/2772355419 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3400742144 0 0) 0x7f6f04003570 con 0x7f6f14157770 2023-10-09T07:58:29.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.016+0000 7f6f137fe700 1 -- 172.21.15.71:0/2772355419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f140c7150 msgr2=0x7f6f1406ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:29.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.016+0000 7f6f137fe700 1 --2- 172.21.15.71:0/2772355419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f140c7150 0x7f6f1406ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:29.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.016+0000 7f6f137fe700 1 -- 172.21.15.71:0/2772355419 >> v1:172.21.15.179:6789/0 conn(0x7f6f140c6d00 legacy=0x7f6f1406e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:29.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.016+0000 7f6f137fe700 1 -- 172.21.15.71:0/2772355419 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f140c78e0 con 0x7f6f14157770 2023-10-09T07:58:29.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.016+0000 7f6f137fe700 1 -- 172.21.15.71:0/2772355419 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f6f08001470 con 0x7f6f14157770 2023-10-09T07:58:29.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.016+0000 7f6f137fe700 1 -- 172.21.15.71:0/2772355419 >> v1:172.21.15.71:6789/0 conn(0x7f6f14157770 legacy=0x7f6f14150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:29.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.016+0000 7f6f137fe700 1 --2- 172.21.15.71:0/2772355419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f04003c20 0x7f6f04004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:29.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.016+0000 7f6f137fe700 1 --2- 172.21.15.71:0/2772355419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f04004810 0x7f6f04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:29.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.016+0000 7f6f137fe700 1 --2- 172.21.15.71:0/2772355419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f140c7150 0x7f6f040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:29.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.016+0000 7f6f137fe700 1 -- 172.21.15.71:0/2772355419 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1406b2e0 con 0x7f6f04004810 2023-10-09T07:58:29.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.016+0000 7f6f137fe700 1 -- 172.21.15.71:0/2772355419 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0400bb40 con 0x7f6f04003c20 2023-10-09T07:58:29.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.016+0000 7f6f137fe700 1 -- 172.21.15.71:0/2772355419 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0400bd00 con 0x7f6f140c7150 2023-10-09T07:58:29.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.016+0000 7f6f13fff700 1 --2- 172.21.15.71:0/2772355419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f04004810 0x7f6f04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:29.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.016+0000 7f6f18d9b700 1 --2- 172.21.15.71:0/2772355419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f04003c20 0x7f6f04004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:29.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.017+0000 7f6f1959c700 1 --2- 172.21.15.71:0/2772355419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f140c7150 0x7f6f040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:29.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.017+0000 7f6f13fff700 1 -- 172.21.15.71:0/2772355419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f140c7150 msgr2=0x7f6f040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:29.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.017+0000 7f6f13fff700 1 --2- 172.21.15.71:0/2772355419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f140c7150 0x7f6f040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:29.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.017+0000 7f6f13fff700 1 -- 172.21.15.71:0/2772355419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f04003c20 msgr2=0x7f6f04004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:29.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.017+0000 7f6f13fff700 1 --2- 172.21.15.71:0/2772355419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f04003c20 0x7f6f04004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:29.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.017+0000 7f6f13fff700 1 -- 172.21.15.71:0/2772355419 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f04003570 con 0x7f6f04004810 2023-10-09T07:58:29.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.017+0000 7f6f13fff700 1 --2- 172.21.15.71:0/2772355419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f04004810 0x7f6f04004c80 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f6f00001a10 tx=0x7f6f00007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed2503fc7dfca05 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:29.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.017+0000 7f6f137fe700 1 -- 172.21.15.71:0/2772355419 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0000c5d0 con 0x7f6f04004810 2023-10-09T07:58:29.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.017+0000 7f6f137fe700 1 -- 172.21.15.71:0/2772355419 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0000c730 con 0x7f6f04004810 2023-10-09T07:58:29.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.017+0000 7f6f137fe700 1 -- 172.21.15.71:0/2772355419 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0000cad0 con 0x7f6f04004810 2023-10-09T07:58:29.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.018+0000 7f6f19d9d700 1 -- 172.21.15.71:0/2772355419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f04004810 msgr2=0x7f6f04004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:29.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.018+0000 7f6f19d9d700 1 --2- 172.21.15.71:0/2772355419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f04004810 0x7f6f04004c80 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f6f00001a10 tx=0x7f6f00007d30 comp rx=0 tx=0).stop 2023-10-09T07:58:29.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.018+0000 7f6f1959c700 1 -- 172.21.15.71:0/2772355419 reap_dead start 2023-10-09T07:58:29.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.018+0000 7f6f19d9d700 1 -- 172.21.15.71:0/2772355419 shutdown_connections 2023-10-09T07:58:29.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.018+0000 7f6f19d9d700 1 -- 172.21.15.71:0/2772355419 >> 172.21.15.71:0/2772355419 conn(0x7f6f140cc1f0 msgr2=0x7f6f140cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:29.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.018+0000 7f6f19d9d700 1 -- 172.21.15.71:0/2772355419 shutdown_connections 2023-10-09T07:58:29.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.018+0000 7f6f19d9d700 1 -- 172.21.15.71:0/2772355419 wait complete. 2023-10-09T07:58:29.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.020+0000 7f6f19d9d700 1 Processor -- start 2023-10-09T07:58:29.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.020+0000 7f6f19d9d700 1 -- start start 2023-10-09T07:58:29.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.021+0000 7f6f19d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f04004810 0x7f6f141691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:29.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.021+0000 7f6f19d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f140aef90 0x7f6f140c1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:29.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.021+0000 7f6f19d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f14154d30 0x7f6f140c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:29.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.021+0000 7f6f19d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1414aa40 con 0x7f6f140aef90 2023-10-09T07:58:29.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.021+0000 7f6f19d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f140b1650 con 0x7f6f04004810 2023-10-09T07:58:29.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.021+0000 7f6f19d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f140af730 con 0x7f6f14154d30 2023-10-09T07:58:29.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.021+0000 7f6f13fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f140aef90 0x7f6f140c1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:29.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.021+0000 7f6f13fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f140aef90 0x7f6f140c1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42804/0 (socket says 172.21.15.71:42804) 2023-10-09T07:58:29.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.021+0000 7f6f13fff700 1 -- 172.21.15.71:0/1123039862 learned_addr learned my addr 172.21.15.71:0/1123039862 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:29.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.021+0000 7f6f18d9b700 1 --2- 172.21.15.71:0/1123039862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f04004810 0x7f6f141691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:29.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.021+0000 7f6f1959c700 1 --2- 172.21.15.71:0/1123039862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f14154d30 0x7f6f140c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:29.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.021+0000 7f6f13fff700 1 -- 172.21.15.71:0/1123039862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f14154d30 msgr2=0x7f6f140c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:29.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.021+0000 7f6f13fff700 1 --2- 172.21.15.71:0/1123039862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f14154d30 0x7f6f140c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:29.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.021+0000 7f6f13fff700 1 -- 172.21.15.71:0/1123039862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f04004810 msgr2=0x7f6f141691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:29.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.021+0000 7f6f13fff700 1 --2- 172.21.15.71:0/1123039862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f04004810 0x7f6f141691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:29.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.021+0000 7f6f13fff700 1 -- 172.21.15.71:0/1123039862 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f140af450 con 0x7f6f140aef90 2023-10-09T07:58:29.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.021+0000 7f6f13fff700 1 --2- 172.21.15.71:0/1123039862 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f140aef90 0x7f6f140c1f60 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f6f0400bb10 tx=0x7f6f00015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:29.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.022+0000 7f6f10ff9700 1 -- 172.21.15.71:0/1123039862 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f00000fe0 con 0x7f6f140aef90 2023-10-09T07:58:29.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.022+0000 7f6f10ff9700 1 -- 172.21.15.71:0/1123039862 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0000c3f0 con 0x7f6f140aef90 2023-10-09T07:58:29.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.022+0000 7f6f19d9d700 1 -- 172.21.15.71:0/1123039862 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f140b1840 con 0x7f6f140aef90 2023-10-09T07:58:29.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.022+0000 7f6f10ff9700 1 -- 172.21.15.71:0/1123039862 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f00006a50 con 0x7f6f140aef90 2023-10-09T07:58:29.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.022+0000 7f6f19d9d700 1 -- 172.21.15.71:0/1123039862 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f141696e0 con 0x7f6f140aef90 2023-10-09T07:58:29.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.023+0000 7f6f19d9d700 1 -- 172.21.15.71:0/1123039862 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f1404c3c0 con 0x7f6f140aef90 2023-10-09T07:58:29.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.024+0000 7f6f10ff9700 1 -- 172.21.15.71:0/1123039862 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f00019070 con 0x7f6f140aef90 2023-10-09T07:58:29.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.024+0000 7f6f10ff9700 1 --2- 172.21.15.71:0/1123039862 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6ef8066f30 0x7f6ef80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:29.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.025+0000 7f6f10ff9700 1 -- 172.21.15.71:0/1123039862 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f6f00085cf0 con 0x7f6f140aef90 2023-10-09T07:58:29.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.025+0000 7f6f18d9b700 1 --2- 172.21.15.71:0/1123039862 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6ef8066f30 0x7f6ef80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:29.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.025+0000 7f6f18d9b700 1 --2- 172.21.15.71:0/1123039862 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6ef8066f30 0x7f6ef80693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6f08001200 tx=0x7f6f08009040 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:29.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.028+0000 7f6f10ff9700 1 -- 172.21.15.71:0/1123039862 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f00052cf0 con 0x7f6f140aef90 2023-10-09T07:58:29.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.216+0000 7f6f19d9d700 1 -- 172.21.15.71:0/1123039862 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f1406ada0 con 0x7f6ef8066f30 2023-10-09T07:58:29.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.225+0000 7f6f10ff9700 1 -- 172.21.15.71:0/1123039862 <== mgr.8503 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289476 (secure 0 0 0) 0x7f6f1406ada0 con 0x7f6ef8066f30 2023-10-09T07:58:29.230 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:58:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.229+0000 7f6f19d9d700 1 -- 172.21.15.71:0/1123039862 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6ef8066f30 msgr2=0x7f6ef80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.229+0000 7f6f19d9d700 1 --2- 172.21.15.71:0/1123039862 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6ef8066f30 0x7f6ef80693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6f08001200 tx=0x7f6f08009040 comp rx=0 tx=0).stop 2023-10-09T07:58:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.229+0000 7f6f19d9d700 1 -- 172.21.15.71:0/1123039862 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f140aef90 msgr2=0x7f6f140c1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.229+0000 7f6f19d9d700 1 --2- 172.21.15.71:0/1123039862 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f140aef90 0x7f6f140c1f60 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f6f0400bb10 tx=0x7f6f00015000 comp rx=0 tx=0).stop 2023-10-09T07:58:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.229+0000 7f6f19d9d700 1 -- 172.21.15.71:0/1123039862 shutdown_connections 2023-10-09T07:58:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.229+0000 7f6f19d9d700 1 --2- 172.21.15.71:0/1123039862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f14154d30 0x7f6f140c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.229+0000 7f6f19d9d700 1 --2- 172.21.15.71:0/1123039862 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f6ef8066f30 0x7f6ef80693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:29.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.229+0000 7f6f19d9d700 1 --2- 172.21.15.71:0/1123039862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f04004810 0x7f6f141691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:29.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.229+0000 7f6f19d9d700 1 --2- 172.21.15.71:0/1123039862 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f140aef90 0x7f6f140c1f60 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:29.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.229+0000 7f6f19d9d700 1 -- 172.21.15.71:0/1123039862 >> 172.21.15.71:0/1123039862 conn(0x7f6f140cc1f0 msgr2=0x7f6f1406ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:29.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.229+0000 7f6f19d9d700 1 -- 172.21.15.71:0/1123039862 shutdown_connections 2023-10-09T07:58:29.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.229+0000 7f6f19d9d700 1 -- 172.21.15.71:0/1123039862 wait complete. 2023-10-09T07:58:29.233 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T07:58:29.247 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T07:58:28.961697+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":523,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":331,"ondisk_log_size":331,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":160,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2466312,"kb_used_data":18376,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752508408,"statfs":{"total":773094113280,"available":770568609792,"internally_reserved":0,"allocated":18817024,"data_stored":9964580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001401"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.051793+0000","last_change":"2023-10-09T07:58:24.050753+0000","last_active":"2023-10-09T07:58:24.051793+0000","last_peered":"2023-10-09T07:58:24.051793+0000","last_clean":"2023-10-09T07:58:24.051793+0000","last_became_active":"2023-10-09T07:58:24.050542+0000","last_became_peered":"2023-10-09T07:58:24.050542+0000","last_unstale":"2023-10-09T07:58:24.051793+0000","last_undegraded":"2023-10-09T07:58:24.051793+0000","last_fullsized":"2023-10-09T07:58:24.051793+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:31.820966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048921+0000","last_change":"2023-10-09T07:58:24.045776+0000","last_active":"2023-10-09T07:58:24.048921+0000","last_peered":"2023-10-09T07:58:24.048921+0000","last_clean":"2023-10-09T07:58:24.048921+0000","last_became_active":"2023-10-09T07:58:24.045554+0000","last_became_peered":"2023-10-09T07:58:24.045554+0000","last_unstale":"2023-10-09T07:58:24.048921+0000","last_undegraded":"2023-10-09T07:58:24.048921+0000","last_fullsized":"2023-10-09T07:58:24.048921+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:11:57.967753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.058427+0000","last_change":"2023-10-09T07:58:24.053589+0000","last_active":"2023-10-09T07:58:24.058427+0000","last_peered":"2023-10-09T07:58:24.058427+0000","last_clean":"2023-10-09T07:58:24.058427+0000","last_became_active":"2023-10-09T07:58:24.053231+0000","last_became_peered":"2023-10-09T07:58:24.053231+0000","last_unstale":"2023-10-09T07:58:24.058427+0000","last_undegraded":"2023-10-09T07:58:24.058427+0000","last_fullsized":"2023-10-09T07:58:24.058427+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:33:22.406090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.047207+0000","last_change":"2023-10-09T07:58:24.046040+0000","last_active":"2023-10-09T07:58:24.047207+0000","last_peered":"2023-10-09T07:58:24.047207+0000","last_clean":"2023-10-09T07:58:24.047207+0000","last_became_active":"2023-10-09T07:58:24.045353+0000","last_became_peered":"2023-10-09T07:58:24.045353+0000","last_unstale":"2023-10-09T07:58:24.047207+0000","last_undegraded":"2023-10-09T07:58:24.047207+0000","last_fullsized":"2023-10-09T07:58:24.047207+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:44.690645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.058333+0000","last_change":"2023-10-09T07:58:24.055759+0000","last_active":"2023-10-09T07:58:24.058333+0000","last_peered":"2023-10-09T07:58:24.058333+0000","last_clean":"2023-10-09T07:58:24.058333+0000","last_became_active":"2023-10-09T07:58:24.055332+0000","last_became_peered":"2023-10-09T07:58:24.055332+0000","last_unstale":"2023-10-09T07:58:24.058333+0000","last_undegraded":"2023-10-09T07:58:24.058333+0000","last_fullsized":"2023-10-09T07:58:24.058333+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:45.661437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048122+0000","last_change":"2023-10-09T07:58:24.043868+0000","last_active":"2023-10-09T07:58:24.048122+0000","last_peered":"2023-10-09T07:58:24.048122+0000","last_clean":"2023-10-09T07:58:24.048122+0000","last_became_active":"2023-10-09T07:58:24.043622+0000","last_became_peered":"2023-10-09T07:58:24.043622+0000","last_unstale":"2023-10-09T07:58:24.048122+0000","last_undegraded":"2023-10-09T07:58:24.048122+0000","last_fullsized":"2023-10-09T07:58:24.048122+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:45.661437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037247+0000","last_change":"2023-10-09T07:58:24.034026+0000","last_active":"2023-10-09T07:58:24.037247+0000","last_peered":"2023-10-09T07:58:24.037247+0000","last_clean":"2023-10-09T07:58:24.037247+0000","last_became_active":"2023-10-09T07:58:24.033378+0000","last_became_peered":"2023-10-09T07:58:24.033378+0000","last_unstale":"2023-10-09T07:58:24.037247+0000","last_undegraded":"2023-10-09T07:58:24.037247+0000","last_fullsized":"2023-10-09T07:58:24.037247+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:30.633397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.039832+0000","last_change":"2023-10-09T07:58:24.034388+0000","last_active":"2023-10-09T07:58:24.039832+0000","last_peered":"2023-10-09T07:58:24.039832+0000","last_clean":"2023-10-09T07:58:24.039832+0000","last_became_active":"2023-10-09T07:58:24.033937+0000","last_became_peered":"2023-10-09T07:58:24.033937+0000","last_unstale":"2023-10-09T07:58:24.039832+0000","last_undegraded":"2023-10-09T07:58:24.039832+0000","last_fullsized":"2023-10-09T07:58:24.039832+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:44.690645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048899+0000","last_change":"2023-10-09T07:58:24.043286+0000","last_active":"2023-10-09T07:58:24.048899+0000","last_peered":"2023-10-09T07:58:24.048899+0000","last_clean":"2023-10-09T07:58:24.048899+0000","last_became_active":"2023-10-09T07:58:24.043002+0000","last_became_peered":"2023-10-09T07:58:24.043002+0000","last_unstale":"2023-10-09T07:58:24.048899+0000","last_undegraded":"2023-10-09T07:58:24.048899+0000","last_fullsized":"2023-10-09T07:58:24.048899+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:53.560893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.059357+0000","last_change":"2023-10-09T07:58:24.051725+0000","last_active":"2023-10-09T07:58:24.059357+0000","last_peered":"2023-10-09T07:58:24.059357+0000","last_clean":"2023-10-09T07:58:24.059357+0000","last_became_active":"2023-10-09T07:58:24.050619+0000","last_became_peered":"2023-10-09T07:58:24.050619+0000","last_unstale":"2023-10-09T07:58:24.059357+0000","last_undegraded":"2023-10-09T07:58:24.059357+0000","last_fullsized":"2023-10-09T07:58:24.059357+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:11.305736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.039861+0000","last_change":"2023-10-09T07:58:24.035442+0000","last_active":"2023-10-09T07:58:24.039861+0000","last_peered":"2023-10-09T07:58:24.039861+0000","last_clean":"2023-10-09T07:58:24.039861+0000","last_became_active":"2023-10-09T07:58:24.034999+0000","last_became_peered":"2023-10-09T07:58:24.034999+0000","last_unstale":"2023-10-09T07:58:24.039861+0000","last_undegraded":"2023-10-09T07:58:24.039861+0000","last_fullsized":"2023-10-09T07:58:24.039861+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:58.571728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.057589+0000","last_change":"2023-10-09T07:58:24.051157+0000","last_active":"2023-10-09T07:58:24.057589+0000","last_peered":"2023-10-09T07:58:24.057589+0000","last_clean":"2023-10-09T07:58:24.057589+0000","last_became_active":"2023-10-09T07:58:24.050918+0000","last_became_peered":"2023-10-09T07:58:24.050918+0000","last_unstale":"2023-10-09T07:58:24.057589+0000","last_undegraded":"2023-10-09T07:58:24.057589+0000","last_fullsized":"2023-10-09T07:58:24.057589+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:01:28.518491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.058312+0000","last_change":"2023-10-09T07:58:24.055579+0000","last_active":"2023-10-09T07:58:24.058312+0000","last_peered":"2023-10-09T07:58:24.058312+0000","last_clean":"2023-10-09T07:58:24.058312+0000","last_became_active":"2023-10-09T07:58:24.054947+0000","last_became_peered":"2023-10-09T07:58:24.054947+0000","last_unstale":"2023-10-09T07:58:24.058312+0000","last_undegraded":"2023-10-09T07:58:24.058312+0000","last_fullsized":"2023-10-09T07:58:24.058312+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:36.378974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.055427+0000","last_change":"2023-10-09T07:58:24.053220+0000","last_active":"2023-10-09T07:58:24.055427+0000","last_peered":"2023-10-09T07:58:24.055427+0000","last_clean":"2023-10-09T07:58:24.055427+0000","last_became_active":"2023-10-09T07:58:24.052935+0000","last_became_peered":"2023-10-09T07:58:24.052935+0000","last_unstale":"2023-10-09T07:58:24.055427+0000","last_undegraded":"2023-10-09T07:58:24.055427+0000","last_fullsized":"2023-10-09T07:58:24.055427+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:09.884939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.057551+0000","last_change":"2023-10-09T07:58:24.050809+0000","last_active":"2023-10-09T07:58:24.057551+0000","last_peered":"2023-10-09T07:58:24.057551+0000","last_clean":"2023-10-09T07:58:24.057551+0000","last_became_active":"2023-10-09T07:58:24.050521+0000","last_became_peered":"2023-10-09T07:58:24.050521+0000","last_unstale":"2023-10-09T07:58:24.057551+0000","last_undegraded":"2023-10-09T07:58:24.057551+0000","last_fullsized":"2023-10-09T07:58:24.057551+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:48:12.371691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.047182+0000","last_change":"2023-10-09T07:58:24.041213+0000","last_active":"2023-10-09T07:58:24.047182+0000","last_peered":"2023-10-09T07:58:24.047182+0000","last_clean":"2023-10-09T07:58:24.047182+0000","last_became_active":"2023-10-09T07:58:24.040940+0000","last_became_peered":"2023-10-09T07:58:24.040940+0000","last_unstale":"2023-10-09T07:58:24.047182+0000","last_undegraded":"2023-10-09T07:58:24.047182+0000","last_fullsized":"2023-10-09T07:58:24.047182+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:20.139851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.057687+0000","last_change":"2023-10-09T07:58:24.051958+0000","last_active":"2023-10-09T07:58:24.057687+0000","last_peered":"2023-10-09T07:58:24.057687+0000","last_clean":"2023-10-09T07:58:24.057687+0000","last_became_active":"2023-10-09T07:58:24.051177+0000","last_became_peered":"2023-10-09T07:58:24.051177+0000","last_unstale":"2023-10-09T07:58:24.057687+0000","last_undegraded":"2023-10-09T07:58:24.057687+0000","last_fullsized":"2023-10-09T07:58:24.057687+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:13.878245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.058340+0000","last_change":"2023-10-09T07:58:24.053547+0000","last_active":"2023-10-09T07:58:24.058340+0000","last_peered":"2023-10-09T07:58:24.058340+0000","last_clean":"2023-10-09T07:58:24.058340+0000","last_became_active":"2023-10-09T07:58:24.053288+0000","last_became_peered":"2023-10-09T07:58:24.053288+0000","last_unstale":"2023-10-09T07:58:24.058340+0000","last_undegraded":"2023-10-09T07:58:24.058340+0000","last_fullsized":"2023-10-09T07:58:24.058340+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:40:10.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048032+0000","last_change":"2023-10-09T07:58:24.042197+0000","last_active":"2023-10-09T07:58:24.048032+0000","last_peered":"2023-10-09T07:58:24.048032+0000","last_clean":"2023-10-09T07:58:24.048032+0000","last_became_active":"2023-10-09T07:58:24.041921+0000","last_became_peered":"2023-10-09T07:58:24.041921+0000","last_unstale":"2023-10-09T07:58:24.048032+0000","last_undegraded":"2023-10-09T07:58:24.048032+0000","last_fullsized":"2023-10-09T07:58:24.048032+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:07.075855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.036601+0000","last_change":"2023-10-09T07:58:24.032315+0000","last_active":"2023-10-09T07:58:24.036601+0000","last_peered":"2023-10-09T07:58:24.036601+0000","last_clean":"2023-10-09T07:58:24.036601+0000","last_became_active":"2023-10-09T07:58:24.032042+0000","last_became_peered":"2023-10-09T07:58:24.032042+0000","last_unstale":"2023-10-09T07:58:24.036601+0000","last_undegraded":"2023-10-09T07:58:24.036601+0000","last_fullsized":"2023-10-09T07:58:24.036601+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:05.127890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.057790+0000","last_change":"2023-10-09T07:58:24.051023+0000","last_active":"2023-10-09T07:58:24.057790+0000","last_peered":"2023-10-09T07:58:24.057790+0000","last_clean":"2023-10-09T07:58:24.057790+0000","last_became_active":"2023-10-09T07:58:24.050775+0000","last_became_peered":"2023-10-09T07:58:24.050775+0000","last_unstale":"2023-10-09T07:58:24.057790+0000","last_undegraded":"2023-10-09T07:58:24.057790+0000","last_fullsized":"2023-10-09T07:58:24.057790+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:33.520395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.042910+0000","last_change":"2023-10-09T07:58:24.033278+0000","last_active":"2023-10-09T07:58:24.042910+0000","last_peered":"2023-10-09T07:58:24.042910+0000","last_clean":"2023-10-09T07:58:24.042910+0000","last_became_active":"2023-10-09T07:58:24.032933+0000","last_became_peered":"2023-10-09T07:58:24.032933+0000","last_unstale":"2023-10-09T07:58:24.042910+0000","last_undegraded":"2023-10-09T07:58:24.042910+0000","last_fullsized":"2023-10-09T07:58:24.042910+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:15.479025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.046014+0000","last_change":"2023-10-09T07:58:24.044626+0000","last_active":"2023-10-09T07:58:24.046014+0000","last_peered":"2023-10-09T07:58:24.046014+0000","last_clean":"2023-10-09T07:58:24.046014+0000","last_became_active":"2023-10-09T07:58:24.044362+0000","last_became_peered":"2023-10-09T07:58:24.044362+0000","last_unstale":"2023-10-09T07:58:24.046014+0000","last_undegraded":"2023-10-09T07:58:24.046014+0000","last_fullsized":"2023-10-09T07:58:24.046014+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:33:20.671515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.057772+0000","last_change":"2023-10-09T07:58:24.050055+0000","last_active":"2023-10-09T07:58:24.057772+0000","last_peered":"2023-10-09T07:58:24.057772+0000","last_clean":"2023-10-09T07:58:24.057772+0000","last_became_active":"2023-10-09T07:58:24.049429+0000","last_became_peered":"2023-10-09T07:58:24.049429+0000","last_unstale":"2023-10-09T07:58:24.057772+0000","last_undegraded":"2023-10-09T07:58:24.057772+0000","last_fullsized":"2023-10-09T07:58:24.057772+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:13.577193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048256+0000","last_change":"2023-10-09T07:58:24.041854+0000","last_active":"2023-10-09T07:58:24.048256+0000","last_peered":"2023-10-09T07:58:24.048256+0000","last_clean":"2023-10-09T07:58:24.048256+0000","last_became_active":"2023-10-09T07:58:24.041577+0000","last_became_peered":"2023-10-09T07:58:24.041577+0000","last_unstale":"2023-10-09T07:58:24.048256+0000","last_undegraded":"2023-10-09T07:58:24.048256+0000","last_fullsized":"2023-10-09T07:58:24.048256+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:00:19.369349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048217+0000","last_change":"2023-10-09T07:58:24.042324+0000","last_active":"2023-10-09T07:58:24.048217+0000","last_peered":"2023-10-09T07:58:24.048217+0000","last_clean":"2023-10-09T07:58:24.048217+0000","last_became_active":"2023-10-09T07:58:24.042010+0000","last_became_peered":"2023-10-09T07:58:24.042010+0000","last_unstale":"2023-10-09T07:58:24.048217+0000","last_undegraded":"2023-10-09T07:58:24.048217+0000","last_fullsized":"2023-10-09T07:58:24.048217+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:16.438076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.052659+0000","last_change":"2023-10-09T07:58:24.052200+0000","last_active":"2023-10-09T07:58:24.052659+0000","last_peered":"2023-10-09T07:58:24.052659+0000","last_clean":"2023-10-09T07:58:24.052659+0000","last_became_active":"2023-10-09T07:58:24.051595+0000","last_became_peered":"2023-10-09T07:58:24.051595+0000","last_unstale":"2023-10-09T07:58:24.052659+0000","last_undegraded":"2023-10-09T07:58:24.052659+0000","last_fullsized":"2023-10-09T07:58:24.052659+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:42:21.938720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.045210+0000","last_change":"2023-10-09T07:58:24.042772+0000","last_active":"2023-10-09T07:58:24.045210+0000","last_peered":"2023-10-09T07:58:24.045210+0000","last_clean":"2023-10-09T07:58:24.045210+0000","last_became_active":"2023-10-09T07:58:24.042398+0000","last_became_peered":"2023-10-09T07:58:24.042398+0000","last_unstale":"2023-10-09T07:58:24.045210+0000","last_undegraded":"2023-10-09T07:58:24.045210+0000","last_fullsized":"2023-10-09T07:58:24.045210+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:19.906242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048245+0000","last_change":"2023-10-09T07:58:24.043813+0000","last_active":"2023-10-09T07:58:24.048245+0000","last_peered":"2023-10-09T07:58:24.048245+0000","last_clean":"2023-10-09T07:58:24.048245+0000","last_became_active":"2023-10-09T07:58:24.043558+0000","last_became_peered":"2023-10-09T07:58:24.043558+0000","last_unstale":"2023-10-09T07:58:24.048245+0000","last_undegraded":"2023-10-09T07:58:24.048245+0000","last_fullsized":"2023-10-09T07:58:24.048245+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:36.378974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.043072+0000","last_change":"2023-10-09T07:58:24.037838+0000","last_active":"2023-10-09T07:58:24.043072+0000","last_peered":"2023-10-09T07:58:24.043072+0000","last_clean":"2023-10-09T07:58:24.043072+0000","last_became_active":"2023-10-09T07:58:24.037557+0000","last_became_peered":"2023-10-09T07:58:24.037557+0000","last_unstale":"2023-10-09T07:58:24.043072+0000","last_undegraded":"2023-10-09T07:58:24.043072+0000","last_fullsized":"2023-10-09T07:58:24.043072+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:47:42.494317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048866+0000","last_change":"2023-10-09T07:58:24.045013+0000","last_active":"2023-10-09T07:58:24.048866+0000","last_peered":"2023-10-09T07:58:24.048866+0000","last_clean":"2023-10-09T07:58:24.048866+0000","last_became_active":"2023-10-09T07:58:24.044774+0000","last_became_peered":"2023-10-09T07:58:24.044774+0000","last_unstale":"2023-10-09T07:58:24.048866+0000","last_undegraded":"2023-10-09T07:58:24.048866+0000","last_fullsized":"2023-10-09T07:58:24.048866+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:13:00.102552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.040246+0000","last_change":"2023-10-09T07:58:24.035180+0000","last_active":"2023-10-09T07:58:24.040246+0000","last_peered":"2023-10-09T07:58:24.040246+0000","last_clean":"2023-10-09T07:58:24.040246+0000","last_became_active":"2023-10-09T07:58:24.034916+0000","last_became_peered":"2023-10-09T07:58:24.034916+0000","last_unstale":"2023-10-09T07:58:24.040246+0000","last_undegraded":"2023-10-09T07:58:24.040246+0000","last_fullsized":"2023-10-09T07:58:24.040246+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:12:00.905354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.058229+0000","last_change":"2023-10-09T07:58:24.050300+0000","last_active":"2023-10-09T07:58:24.058229+0000","last_peered":"2023-10-09T07:58:24.058229+0000","last_clean":"2023-10-09T07:58:24.058229+0000","last_became_active":"2023-10-09T07:58:24.049485+0000","last_became_peered":"2023-10-09T07:58:24.049485+0000","last_unstale":"2023-10-09T07:58:24.058229+0000","last_undegraded":"2023-10-09T07:58:24.058229+0000","last_fullsized":"2023-10-09T07:58:24.058229+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:07.411847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"175'4","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.052248+0000","last_change":"2023-10-09T07:58:23.042257+0000","last_active":"2023-10-09T07:58:24.052248+0000","last_peered":"2023-10-09T07:58:24.052248+0000","last_clean":"2023-10-09T07:58:24.052248+0000","last_became_active":"2023-10-09T07:58:23.041987+0000","last_became_peered":"2023-10-09T07:58:23.041987+0000","last_unstale":"2023-10-09T07:58:24.052248+0000","last_undegraded":"2023-10-09T07:58:24.052248+0000","last_fullsized":"2023-10-09T07:58:24.052248+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:53.221593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048916+0000","last_change":"2023-10-09T07:58:24.045206+0000","last_active":"2023-10-09T07:58:24.048916+0000","last_peered":"2023-10-09T07:58:24.048916+0000","last_clean":"2023-10-09T07:58:24.048916+0000","last_became_active":"2023-10-09T07:58:24.043198+0000","last_became_peered":"2023-10-09T07:58:24.043198+0000","last_unstale":"2023-10-09T07:58:24.048916+0000","last_undegraded":"2023-10-09T07:58:24.048916+0000","last_fullsized":"2023-10-09T07:58:24.048916+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:39:01.903400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.054826+0000","last_change":"2023-10-09T07:58:23.039895+0000","last_active":"2023-10-09T07:58:24.054826+0000","last_peered":"2023-10-09T07:58:24.054826+0000","last_clean":"2023-10-09T07:58:24.054826+0000","last_became_active":"2023-10-09T07:58:23.038992+0000","last_became_peered":"2023-10-09T07:58:23.038992+0000","last_unstale":"2023-10-09T07:58:24.054826+0000","last_undegraded":"2023-10-09T07:58:24.054826+0000","last_fullsized":"2023-10-09T07:58:24.054826+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:32:21.536459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.039892+0000","last_change":"2023-10-09T07:58:24.034722+0000","last_active":"2023-10-09T07:58:24.039892+0000","last_peered":"2023-10-09T07:58:24.039892+0000","last_clean":"2023-10-09T07:58:24.039892+0000","last_became_active":"2023-10-09T07:58:24.033015+0000","last_became_peered":"2023-10-09T07:58:24.033015+0000","last_unstale":"2023-10-09T07:58:24.039892+0000","last_undegraded":"2023-10-09T07:58:24.039892+0000","last_fullsized":"2023-10-09T07:58:24.039892+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:48:29.551743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048694+0000","last_change":"2023-10-09T07:58:23.033092+0000","last_active":"2023-10-09T07:58:24.048694+0000","last_peered":"2023-10-09T07:58:24.048694+0000","last_clean":"2023-10-09T07:58:24.048694+0000","last_became_active":"2023-10-09T07:58:23.032754+0000","last_became_peered":"2023-10-09T07:58:23.032754+0000","last_unstale":"2023-10-09T07:58:24.048694+0000","last_undegraded":"2023-10-09T07:58:24.048694+0000","last_fullsized":"2023-10-09T07:58:24.048694+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:12:49.950756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.059763+0000","last_change":"2023-10-09T07:58:24.055486+0000","last_active":"2023-10-09T07:58:24.059763+0000","last_peered":"2023-10-09T07:58:24.059763+0000","last_clean":"2023-10-09T07:58:24.059763+0000","last_became_active":"2023-10-09T07:58:24.055219+0000","last_became_peered":"2023-10-09T07:58:24.055219+0000","last_unstale":"2023-10-09T07:58:24.059763+0000","last_undegraded":"2023-10-09T07:58:24.059763+0000","last_fullsized":"2023-10-09T07:58:24.059763+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:49:35.323023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.050729+0000","last_change":"2023-10-09T07:58:23.033476+0000","last_active":"2023-10-09T07:58:24.050729+0000","last_peered":"2023-10-09T07:58:24.050729+0000","last_clean":"2023-10-09T07:58:24.050729+0000","last_became_active":"2023-10-09T07:58:23.033198+0000","last_became_peered":"2023-10-09T07:58:23.033198+0000","last_unstale":"2023-10-09T07:58:24.050729+0000","last_undegraded":"2023-10-09T07:58:24.050729+0000","last_fullsized":"2023-10-09T07:58:24.050729+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:45:36.724769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048760+0000","last_change":"2023-10-09T07:58:24.043979+0000","last_active":"2023-10-09T07:58:24.048760+0000","last_peered":"2023-10-09T07:58:24.048760+0000","last_clean":"2023-10-09T07:58:24.048760+0000","last_became_active":"2023-10-09T07:58:24.043724+0000","last_became_peered":"2023-10-09T07:58:24.043724+0000","last_unstale":"2023-10-09T07:58:24.048760+0000","last_undegraded":"2023-10-09T07:58:24.048760+0000","last_fullsized":"2023-10-09T07:58:24.048760+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:40.861697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.053251+0000","last_change":"2023-10-09T07:58:23.039908+0000","last_active":"2023-10-09T07:58:24.053251+0000","last_peered":"2023-10-09T07:58:24.053251+0000","last_clean":"2023-10-09T07:58:24.053251+0000","last_became_active":"2023-10-09T07:58:23.039653+0000","last_became_peered":"2023-10-09T07:58:23.039653+0000","last_unstale":"2023-10-09T07:58:24.053251+0000","last_undegraded":"2023-10-09T07:58:24.053251+0000","last_fullsized":"2023-10-09T07:58:24.053251+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:29:27.162187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.047174+0000","last_change":"2023-10-09T07:58:24.045784+0000","last_active":"2023-10-09T07:58:24.047174+0000","last_peered":"2023-10-09T07:58:24.047174+0000","last_clean":"2023-10-09T07:58:24.047174+0000","last_became_active":"2023-10-09T07:58:24.045371+0000","last_became_peered":"2023-10-09T07:58:24.045371+0000","last_unstale":"2023-10-09T07:58:24.047174+0000","last_undegraded":"2023-10-09T07:58:24.047174+0000","last_fullsized":"2023-10-09T07:58:24.047174+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:58.571728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.054515+0000","last_change":"2023-10-09T07:58:23.038953+0000","last_active":"2023-10-09T07:58:24.054515+0000","last_peered":"2023-10-09T07:58:24.054515+0000","last_clean":"2023-10-09T07:58:24.054515+0000","last_became_active":"2023-10-09T07:58:23.038700+0000","last_became_peered":"2023-10-09T07:58:23.038700+0000","last_unstale":"2023-10-09T07:58:24.054515+0000","last_undegraded":"2023-10-09T07:58:24.054515+0000","last_fullsized":"2023-10-09T07:58:24.054515+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:33:19.662502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048564+0000","last_change":"2023-10-09T07:58:24.037599+0000","last_active":"2023-10-09T07:58:24.048564+0000","last_peered":"2023-10-09T07:58:24.048564+0000","last_clean":"2023-10-09T07:58:24.048564+0000","last_became_active":"2023-10-09T07:58:24.037325+0000","last_became_peered":"2023-10-09T07:58:24.037325+0000","last_unstale":"2023-10-09T07:58:24.048564+0000","last_undegraded":"2023-10-09T07:58:24.048564+0000","last_fullsized":"2023-10-09T07:58:24.048564+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:56.795926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.027437+0000","last_change":"2023-10-09T07:58:23.036137+0000","last_active":"2023-10-09T07:58:24.027437+0000","last_peered":"2023-10-09T07:58:24.027437+0000","last_clean":"2023-10-09T07:58:24.027437+0000","last_became_active":"2023-10-09T07:58:23.035828+0000","last_became_peered":"2023-10-09T07:58:23.035828+0000","last_unstale":"2023-10-09T07:58:24.027437+0000","last_undegraded":"2023-10-09T07:58:24.027437+0000","last_fullsized":"2023-10-09T07:58:24.027437+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:30:00.666411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.042463+0000","last_change":"2023-10-09T07:58:24.039373+0000","last_active":"2023-10-09T07:58:24.042463+0000","last_peered":"2023-10-09T07:58:24.042463+0000","last_clean":"2023-10-09T07:58:24.042463+0000","last_became_active":"2023-10-09T07:58:24.039115+0000","last_became_peered":"2023-10-09T07:58:24.039115+0000","last_unstale":"2023-10-09T07:58:24.042463+0000","last_undegraded":"2023-10-09T07:58:24.042463+0000","last_fullsized":"2023-10-09T07:58:24.042463+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:31.820966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.028900+0000","last_change":"2023-10-09T07:58:23.038929+0000","last_active":"2023-10-09T07:58:24.028900+0000","last_peered":"2023-10-09T07:58:24.028900+0000","last_clean":"2023-10-09T07:58:24.028900+0000","last_became_active":"2023-10-09T07:58:23.038646+0000","last_became_peered":"2023-10-09T07:58:23.038646+0000","last_unstale":"2023-10-09T07:58:24.028900+0000","last_undegraded":"2023-10-09T07:58:24.028900+0000","last_fullsized":"2023-10-09T07:58:24.028900+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:41:05.997398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.041472+0000","last_change":"2023-10-09T07:58:24.038374+0000","last_active":"2023-10-09T07:58:24.041472+0000","last_peered":"2023-10-09T07:58:24.041472+0000","last_clean":"2023-10-09T07:58:24.041472+0000","last_became_active":"2023-10-09T07:58:24.037501+0000","last_became_peered":"2023-10-09T07:58:24.037501+0000","last_unstale":"2023-10-09T07:58:24.041472+0000","last_undegraded":"2023-10-09T07:58:24.041472+0000","last_fullsized":"2023-10-09T07:58:24.041472+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:07.075855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.030220+0000","last_change":"2023-10-09T07:58:23.034362+0000","last_active":"2023-10-09T07:58:24.030220+0000","last_peered":"2023-10-09T07:58:24.030220+0000","last_clean":"2023-10-09T07:58:24.030220+0000","last_became_active":"2023-10-09T07:58:23.034092+0000","last_became_peered":"2023-10-09T07:58:23.034092+0000","last_unstale":"2023-10-09T07:58:24.030220+0000","last_undegraded":"2023-10-09T07:58:24.030220+0000","last_fullsized":"2023-10-09T07:58:24.030220+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:03.122620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.059673+0000","last_change":"2023-10-09T07:58:24.052110+0000","last_active":"2023-10-09T07:58:24.059673+0000","last_peered":"2023-10-09T07:58:24.059673+0000","last_clean":"2023-10-09T07:58:24.059673+0000","last_became_active":"2023-10-09T07:58:24.051322+0000","last_became_peered":"2023-10-09T07:58:24.051322+0000","last_unstale":"2023-10-09T07:58:24.059673+0000","last_undegraded":"2023-10-09T07:58:24.059673+0000","last_fullsized":"2023-10-09T07:58:24.059673+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:36:00.365335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.032678+0000","last_change":"2023-10-09T07:58:23.041150+0000","last_active":"2023-10-09T07:58:24.032678+0000","last_peered":"2023-10-09T07:58:24.032678+0000","last_clean":"2023-10-09T07:58:24.032678+0000","last_became_active":"2023-10-09T07:58:23.040730+0000","last_became_peered":"2023-10-09T07:58:23.040730+0000","last_unstale":"2023-10-09T07:58:24.032678+0000","last_undegraded":"2023-10-09T07:58:24.032678+0000","last_fullsized":"2023-10-09T07:58:24.032678+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:21.744931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.042455+0000","last_change":"2023-10-09T07:58:24.038556+0000","last_active":"2023-10-09T07:58:24.042455+0000","last_peered":"2023-10-09T07:58:24.042455+0000","last_clean":"2023-10-09T07:58:24.042455+0000","last_became_active":"2023-10-09T07:58:24.038266+0000","last_became_peered":"2023-10-09T07:58:24.038266+0000","last_unstale":"2023-10-09T07:58:24.042455+0000","last_undegraded":"2023-10-09T07:58:24.042455+0000","last_fullsized":"2023-10-09T07:58:24.042455+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:20.483964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"175'6","reported_seq":16,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.056822+0000","last_change":"2023-10-09T07:58:23.032317+0000","last_active":"2023-10-09T07:58:24.056822+0000","last_peered":"2023-10-09T07:58:24.056822+0000","last_clean":"2023-10-09T07:58:24.056822+0000","last_became_active":"2023-10-09T07:58:23.032034+0000","last_became_peered":"2023-10-09T07:58:23.032034+0000","last_unstale":"2023-10-09T07:58:24.056822+0000","last_undegraded":"2023-10-09T07:58:24.056822+0000","last_fullsized":"2023-10-09T07:58:24.056822+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:01:27.509478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.052341+0000","last_change":"2023-10-09T07:58:24.049017+0000","last_active":"2023-10-09T07:58:24.052341+0000","last_peered":"2023-10-09T07:58:24.052341+0000","last_clean":"2023-10-09T07:58:24.052341+0000","last_became_active":"2023-10-09T07:58:24.048756+0000","last_became_peered":"2023-10-09T07:58:24.048756+0000","last_unstale":"2023-10-09T07:58:24.052341+0000","last_undegraded":"2023-10-09T07:58:24.052341+0000","last_fullsized":"2023-10-09T07:58:24.052341+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:40.222840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.059279+0000","last_change":"2023-10-09T07:58:23.041487+0000","last_active":"2023-10-09T07:58:24.059279+0000","last_peered":"2023-10-09T07:58:24.059279+0000","last_clean":"2023-10-09T07:58:24.059279+0000","last_became_active":"2023-10-09T07:58:23.040053+0000","last_became_peered":"2023-10-09T07:58:23.040053+0000","last_unstale":"2023-10-09T07:58:24.059279+0000","last_undegraded":"2023-10-09T07:58:24.059279+0000","last_fullsized":"2023-10-09T07:58:24.059279+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:45.601522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048659+0000","last_change":"2023-10-09T07:58:24.042838+0000","last_active":"2023-10-09T07:58:24.048659+0000","last_peered":"2023-10-09T07:58:24.048659+0000","last_clean":"2023-10-09T07:58:24.048659+0000","last_became_active":"2023-10-09T07:58:24.042573+0000","last_became_peered":"2023-10-09T07:58:24.042573+0000","last_unstale":"2023-10-09T07:58:24.048659+0000","last_undegraded":"2023-10-09T07:58:24.048659+0000","last_fullsized":"2023-10-09T07:58:24.048659+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:41:03.367914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.034055+0000","last_change":"2023-10-09T07:58:23.038603+0000","last_active":"2023-10-09T07:58:24.034055+0000","last_peered":"2023-10-09T07:58:24.034055+0000","last_clean":"2023-10-09T07:58:24.034055+0000","last_became_active":"2023-10-09T07:58:23.038346+0000","last_became_peered":"2023-10-09T07:58:23.038346+0000","last_unstale":"2023-10-09T07:58:24.034055+0000","last_undegraded":"2023-10-09T07:58:24.034055+0000","last_fullsized":"2023-10-09T07:58:24.034055+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:03.122620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.056928+0000","last_change":"2023-10-09T07:58:24.053339+0000","last_active":"2023-10-09T07:58:24.056928+0000","last_peered":"2023-10-09T07:58:24.056928+0000","last_clean":"2023-10-09T07:58:24.056928+0000","last_became_active":"2023-10-09T07:58:24.053023+0000","last_became_peered":"2023-10-09T07:58:24.053023+0000","last_unstale":"2023-10-09T07:58:24.056928+0000","last_undegraded":"2023-10-09T07:58:24.056928+0000","last_fullsized":"2023-10-09T07:58:24.056928+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:43:10.524882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.025872+0000","last_change":"2023-10-09T07:58:23.027831+0000","last_active":"2023-10-09T07:58:24.025872+0000","last_peered":"2023-10-09T07:58:24.025872+0000","last_clean":"2023-10-09T07:58:24.025872+0000","last_became_active":"2023-10-09T07:58:23.027573+0000","last_became_peered":"2023-10-09T07:58:23.027573+0000","last_unstale":"2023-10-09T07:58:24.025872+0000","last_undegraded":"2023-10-09T07:58:24.025872+0000","last_fullsized":"2023-10-09T07:58:24.025872+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:30.137019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.054070+0000","last_change":"2023-10-09T07:58:24.051875+0000","last_active":"2023-10-09T07:58:24.054070+0000","last_peered":"2023-10-09T07:58:24.054070+0000","last_clean":"2023-10-09T07:58:24.054070+0000","last_became_active":"2023-10-09T07:58:24.051460+0000","last_became_peered":"2023-10-09T07:58:24.051460+0000","last_unstale":"2023-10-09T07:58:24.054070+0000","last_undegraded":"2023-10-09T07:58:24.054070+0000","last_fullsized":"2023-10-09T07:58:24.054070+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:39:01.903400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"175'8","reported_seq":18,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.055611+0000","last_change":"2023-10-09T07:58:23.041105+0000","last_active":"2023-10-09T07:58:24.055611+0000","last_peered":"2023-10-09T07:58:24.055611+0000","last_clean":"2023-10-09T07:58:24.055611+0000","last_became_active":"2023-10-09T07:58:23.040899+0000","last_became_peered":"2023-10-09T07:58:23.040899+0000","last_unstale":"2023-10-09T07:58:24.055611+0000","last_undegraded":"2023-10-09T07:58:24.055611+0000","last_fullsized":"2023-10-09T07:58:24.055611+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:08:51.278424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.059030+0000","last_change":"2023-10-09T07:58:24.050364+0000","last_active":"2023-10-09T07:58:24.059030+0000","last_peered":"2023-10-09T07:58:24.059030+0000","last_clean":"2023-10-09T07:58:24.059030+0000","last_became_active":"2023-10-09T07:58:24.050015+0000","last_became_peered":"2023-10-09T07:58:24.050015+0000","last_unstale":"2023-10-09T07:58:24.059030+0000","last_undegraded":"2023-10-09T07:58:24.059030+0000","last_fullsized":"2023-10-09T07:58:24.059030+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:42:47.664106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048844+0000","last_change":"2023-10-09T07:58:23.037143+0000","last_active":"2023-10-09T07:58:24.048844+0000","last_peered":"2023-10-09T07:58:24.048844+0000","last_clean":"2023-10-09T07:58:24.048844+0000","last_became_active":"2023-10-09T07:58:23.036812+0000","last_became_peered":"2023-10-09T07:58:23.036812+0000","last_unstale":"2023-10-09T07:58:24.048844+0000","last_undegraded":"2023-10-09T07:58:24.048844+0000","last_fullsized":"2023-10-09T07:58:24.048844+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:40:38.871261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.055105+0000","last_change":"2023-10-09T07:58:24.053157+0000","last_active":"2023-10-09T07:58:24.055105+0000","last_peered":"2023-10-09T07:58:24.055105+0000","last_clean":"2023-10-09T07:58:24.055105+0000","last_became_active":"2023-10-09T07:58:24.052868+0000","last_became_peered":"2023-10-09T07:58:24.052868+0000","last_unstale":"2023-10-09T07:58:24.055105+0000","last_undegraded":"2023-10-09T07:58:24.055105+0000","last_fullsized":"2023-10-09T07:58:24.055105+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:41.116662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048825+0000","last_change":"2023-10-09T07:58:23.038559+0000","last_active":"2023-10-09T07:58:24.048825+0000","last_peered":"2023-10-09T07:58:24.048825+0000","last_clean":"2023-10-09T07:58:24.048825+0000","last_became_active":"2023-10-09T07:58:23.037968+0000","last_became_peered":"2023-10-09T07:58:23.037968+0000","last_unstale":"2023-10-09T07:58:24.048825+0000","last_undegraded":"2023-10-09T07:58:24.048825+0000","last_fullsized":"2023-10-09T07:58:24.048825+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:22.952454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.050837+0000","last_change":"2023-10-09T07:58:24.046156+0000","last_active":"2023-10-09T07:58:24.050837+0000","last_peered":"2023-10-09T07:58:24.050837+0000","last_clean":"2023-10-09T07:58:24.050837+0000","last_became_active":"2023-10-09T07:58:24.045897+0000","last_became_peered":"2023-10-09T07:58:24.045897+0000","last_unstale":"2023-10-09T07:58:24.050837+0000","last_undegraded":"2023-10-09T07:58:24.050837+0000","last_fullsized":"2023-10-09T07:58:24.050837+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:41:03.367914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.052803+0000","last_change":"2023-10-09T07:58:23.040353+0000","last_active":"2023-10-09T07:58:24.052803+0000","last_peered":"2023-10-09T07:58:24.052803+0000","last_clean":"2023-10-09T07:58:24.052803+0000","last_became_active":"2023-10-09T07:58:23.039961+0000","last_became_peered":"2023-10-09T07:58:23.039961+0000","last_unstale":"2023-10-09T07:58:24.052803+0000","last_undegraded":"2023-10-09T07:58:24.052803+0000","last_fullsized":"2023-10-09T07:58:24.052803+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:59.029087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.049602+0000","last_change":"2023-10-09T07:58:24.047359+0000","last_active":"2023-10-09T07:58:24.049602+0000","last_peered":"2023-10-09T07:58:24.049602+0000","last_clean":"2023-10-09T07:58:24.049602+0000","last_became_active":"2023-10-09T07:58:24.047026+0000","last_became_peered":"2023-10-09T07:58:24.047026+0000","last_unstale":"2023-10-09T07:58:24.049602+0000","last_undegraded":"2023-10-09T07:58:24.049602+0000","last_fullsized":"2023-10-09T07:58:24.049602+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:18.603205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.029490+0000","last_change":"2023-10-09T07:58:23.037621+0000","last_active":"2023-10-09T07:58:24.029490+0000","last_peered":"2023-10-09T07:58:24.029490+0000","last_clean":"2023-10-09T07:58:24.029490+0000","last_became_active":"2023-10-09T07:58:23.033543+0000","last_became_peered":"2023-10-09T07:58:23.033543+0000","last_unstale":"2023-10-09T07:58:24.029490+0000","last_undegraded":"2023-10-09T07:58:24.029490+0000","last_fullsized":"2023-10-09T07:58:24.029490+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:45.601522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.042939+0000","last_change":"2023-10-09T07:58:24.037237+0000","last_active":"2023-10-09T07:58:24.042939+0000","last_peered":"2023-10-09T07:58:24.042939+0000","last_clean":"2023-10-09T07:58:24.042939+0000","last_became_active":"2023-10-09T07:58:24.035826+0000","last_became_peered":"2023-10-09T07:58:24.035826+0000","last_unstale":"2023-10-09T07:58:24.042939+0000","last_undegraded":"2023-10-09T07:58:24.042939+0000","last_fullsized":"2023-10-09T07:58:24.042939+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:24:38.808909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.059199+0000","last_change":"2023-10-09T07:58:23.037844+0000","last_active":"2023-10-09T07:58:24.059199+0000","last_peered":"2023-10-09T07:58:24.059199+0000","last_clean":"2023-10-09T07:58:24.059199+0000","last_became_active":"2023-10-09T07:58:23.037598+0000","last_became_peered":"2023-10-09T07:58:23.037598+0000","last_unstale":"2023-10-09T07:58:24.059199+0000","last_undegraded":"2023-10-09T07:58:24.059199+0000","last_fullsized":"2023-10-09T07:58:24.059199+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:12.869232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037253+0000","last_change":"2023-10-09T07:58:24.033828+0000","last_active":"2023-10-09T07:58:24.037253+0000","last_peered":"2023-10-09T07:58:24.037253+0000","last_clean":"2023-10-09T07:58:24.037253+0000","last_became_active":"2023-10-09T07:58:24.033580+0000","last_became_peered":"2023-10-09T07:58:24.033580+0000","last_unstale":"2023-10-09T07:58:24.037253+0000","last_undegraded":"2023-10-09T07:58:24.037253+0000","last_fullsized":"2023-10-09T07:58:24.037253+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:27:48.279381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.031315+0000","last_change":"2023-10-09T07:58:23.044812+0000","last_active":"2023-10-09T07:58:24.031315+0000","last_peered":"2023-10-09T07:58:24.031315+0000","last_clean":"2023-10-09T07:58:24.031315+0000","last_became_active":"2023-10-09T07:58:23.044164+0000","last_became_peered":"2023-10-09T07:58:23.044164+0000","last_unstale":"2023-10-09T07:58:24.031315+0000","last_undegraded":"2023-10-09T07:58:24.031315+0000","last_fullsized":"2023-10-09T07:58:24.031315+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:36:16.840269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.045906+0000","last_change":"2023-10-09T07:58:24.044914+0000","last_active":"2023-10-09T07:58:24.045906+0000","last_peered":"2023-10-09T07:58:24.045906+0000","last_clean":"2023-10-09T07:58:24.045906+0000","last_became_active":"2023-10-09T07:58:24.043943+0000","last_became_peered":"2023-10-09T07:58:24.043943+0000","last_unstale":"2023-10-09T07:58:24.045906+0000","last_undegraded":"2023-10-09T07:58:24.045906+0000","last_fullsized":"2023-10-09T07:58:24.045906+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:40:39.880274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.034885+0000","last_change":"2023-10-09T07:58:23.041438+0000","last_active":"2023-10-09T07:58:24.034885+0000","last_peered":"2023-10-09T07:58:24.034885+0000","last_clean":"2023-10-09T07:58:24.034885+0000","last_became_active":"2023-10-09T07:58:23.041150+0000","last_became_peered":"2023-10-09T07:58:23.041150+0000","last_unstale":"2023-10-09T07:58:24.034885+0000","last_undegraded":"2023-10-09T07:58:24.034885+0000","last_fullsized":"2023-10-09T07:58:24.034885+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:21:04.355067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037265+0000","last_change":"2023-10-09T07:58:24.034230+0000","last_active":"2023-10-09T07:58:24.037265+0000","last_peered":"2023-10-09T07:58:24.037265+0000","last_clean":"2023-10-09T07:58:24.037265+0000","last_became_active":"2023-10-09T07:58:24.033758+0000","last_became_peered":"2023-10-09T07:58:24.033758+0000","last_unstale":"2023-10-09T07:58:24.037265+0000","last_undegraded":"2023-10-09T07:58:24.037265+0000","last_fullsized":"2023-10-09T07:58:24.037265+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:10:36.736260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.034817+0000","last_change":"2023-10-09T07:58:23.036069+0000","last_active":"2023-10-09T07:58:24.034817+0000","last_peered":"2023-10-09T07:58:24.034817+0000","last_clean":"2023-10-09T07:58:24.034817+0000","last_became_active":"2023-10-09T07:58:23.035817+0000","last_became_peered":"2023-10-09T07:58:23.035817+0000","last_unstale":"2023-10-09T07:58:24.034817+0000","last_undegraded":"2023-10-09T07:58:24.034817+0000","last_fullsized":"2023-10-09T07:58:24.034817+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:22.952454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.056958+0000","last_change":"2023-10-09T07:58:24.053951+0000","last_active":"2023-10-09T07:58:24.056958+0000","last_peered":"2023-10-09T07:58:24.056958+0000","last_clean":"2023-10-09T07:58:24.056958+0000","last_became_active":"2023-10-09T07:58:24.053707+0000","last_became_peered":"2023-10-09T07:58:24.053707+0000","last_unstale":"2023-10-09T07:58:24.056958+0000","last_undegraded":"2023-10-09T07:58:24.056958+0000","last_fullsized":"2023-10-09T07:58:24.056958+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:55.345084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.053699+0000","last_change":"2023-10-09T07:58:23.042969+0000","last_active":"2023-10-09T07:58:24.053699+0000","last_peered":"2023-10-09T07:58:24.053699+0000","last_clean":"2023-10-09T07:58:24.053699+0000","last_became_active":"2023-10-09T07:58:23.042710+0000","last_became_peered":"2023-10-09T07:58:23.042710+0000","last_unstale":"2023-10-09T07:58:24.053699+0000","last_undegraded":"2023-10-09T07:58:24.053699+0000","last_fullsized":"2023-10-09T07:58:24.053699+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:12:59.093538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.050926+0000","last_change":"2023-10-09T07:58:24.046834+0000","last_active":"2023-10-09T07:58:24.050926+0000","last_peered":"2023-10-09T07:58:24.050926+0000","last_clean":"2023-10-09T07:58:24.050926+0000","last_became_active":"2023-10-09T07:58:24.046543+0000","last_became_peered":"2023-10-09T07:58:24.046543+0000","last_unstale":"2023-10-09T07:58:24.050926+0000","last_undegraded":"2023-10-09T07:58:24.050926+0000","last_fullsized":"2023-10-09T07:58:24.050926+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:11:57.967753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.025916+0000","last_change":"2023-10-09T07:58:23.039543+0000","last_active":"2023-10-09T07:58:24.025916+0000","last_peered":"2023-10-09T07:58:24.025916+0000","last_clean":"2023-10-09T07:58:24.025916+0000","last_became_active":"2023-10-09T07:58:23.039245+0000","last_became_peered":"2023-10-09T07:58:23.039245+0000","last_unstale":"2023-10-09T07:58:24.025916+0000","last_undegraded":"2023-10-09T07:58:24.025916+0000","last_fullsized":"2023-10-09T07:58:24.025916+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:04.616687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048679+0000","last_change":"2023-10-09T07:58:24.040483+0000","last_active":"2023-10-09T07:58:24.048679+0000","last_peered":"2023-10-09T07:58:24.048679+0000","last_clean":"2023-10-09T07:58:24.048679+0000","last_became_active":"2023-10-09T07:58:24.040215+0000","last_became_peered":"2023-10-09T07:58:24.040215+0000","last_unstale":"2023-10-09T07:58:24.048679+0000","last_undegraded":"2023-10-09T07:58:24.048679+0000","last_fullsized":"2023-10-09T07:58:24.048679+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:06:09.038401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.026095+0000","last_change":"2023-10-09T07:58:23.033638+0000","last_active":"2023-10-09T07:58:24.026095+0000","last_peered":"2023-10-09T07:58:24.026095+0000","last_clean":"2023-10-09T07:58:24.026095+0000","last_became_active":"2023-10-09T07:58:23.033359+0000","last_became_peered":"2023-10-09T07:58:23.033359+0000","last_unstale":"2023-10-09T07:58:24.026095+0000","last_undegraded":"2023-10-09T07:58:24.026095+0000","last_fullsized":"2023-10-09T07:58:24.026095+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:21:06.621088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037576+0000","last_change":"2023-10-09T07:58:24.033310+0000","last_active":"2023-10-09T07:58:24.037576+0000","last_peered":"2023-10-09T07:58:24.037576+0000","last_clean":"2023-10-09T07:58:24.037576+0000","last_became_active":"2023-10-09T07:58:24.033044+0000","last_became_peered":"2023-10-09T07:58:24.033044+0000","last_unstale":"2023-10-09T07:58:24.037576+0000","last_undegraded":"2023-10-09T07:58:24.037576+0000","last_fullsized":"2023-10-09T07:58:24.037576+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:30.145065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.025758+0000","last_change":"2023-10-09T07:58:23.034259+0000","last_active":"2023-10-09T07:58:24.025758+0000","last_peered":"2023-10-09T07:58:24.025758+0000","last_clean":"2023-10-09T07:58:24.025758+0000","last_became_active":"2023-10-09T07:58:23.033993+0000","last_became_peered":"2023-10-09T07:58:23.033993+0000","last_unstale":"2023-10-09T07:58:24.025758+0000","last_undegraded":"2023-10-09T07:58:24.025758+0000","last_fullsized":"2023-10-09T07:58:24.025758+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:36.449503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.040603+0000","last_change":"2023-10-09T07:58:24.034496+0000","last_active":"2023-10-09T07:58:24.040603+0000","last_peered":"2023-10-09T07:58:24.040603+0000","last_clean":"2023-10-09T07:58:24.040603+0000","last_became_active":"2023-10-09T07:58:24.034246+0000","last_became_peered":"2023-10-09T07:58:24.034246+0000","last_unstale":"2023-10-09T07:58:24.040603+0000","last_undegraded":"2023-10-09T07:58:24.040603+0000","last_fullsized":"2023-10-09T07:58:24.040603+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:09.684425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.022165+0000","last_change":"2023-10-09T07:58:23.035059+0000","last_active":"2023-10-09T07:58:24.022165+0000","last_peered":"2023-10-09T07:58:24.022165+0000","last_clean":"2023-10-09T07:58:24.022165+0000","last_became_active":"2023-10-09T07:58:23.034777+0000","last_became_peered":"2023-10-09T07:58:23.034777+0000","last_unstale":"2023-10-09T07:58:24.022165+0000","last_undegraded":"2023-10-09T07:58:24.022165+0000","last_fullsized":"2023-10-09T07:58:24.022165+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:35:59.356322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.043809+0000","last_change":"2023-10-09T07:58:24.042813+0000","last_active":"2023-10-09T07:58:24.043809+0000","last_peered":"2023-10-09T07:58:24.043809+0000","last_clean":"2023-10-09T07:58:24.043809+0000","last_became_active":"2023-10-09T07:58:24.042502+0000","last_became_peered":"2023-10-09T07:58:24.042502+0000","last_unstale":"2023-10-09T07:58:24.043809+0000","last_undegraded":"2023-10-09T07:58:24.043809+0000","last_fullsized":"2023-10-09T07:58:24.043809+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:34.959485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.031420+0000","last_change":"2023-10-09T07:58:23.043658+0000","last_active":"2023-10-09T07:58:24.031420+0000","last_peered":"2023-10-09T07:58:24.031420+0000","last_clean":"2023-10-09T07:58:24.031420+0000","last_became_active":"2023-10-09T07:58:23.043362+0000","last_became_peered":"2023-10-09T07:58:23.043362+0000","last_unstale":"2023-10-09T07:58:24.031420+0000","last_undegraded":"2023-10-09T07:58:24.031420+0000","last_fullsized":"2023-10-09T07:58:24.031420+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:39.852684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.059701+0000","last_change":"2023-10-09T07:58:24.053423+0000","last_active":"2023-10-09T07:58:24.059701+0000","last_peered":"2023-10-09T07:58:24.059701+0000","last_clean":"2023-10-09T07:58:24.059701+0000","last_became_active":"2023-10-09T07:58:24.052193+0000","last_became_peered":"2023-10-09T07:58:24.052193+0000","last_unstale":"2023-10-09T07:58:24.059701+0000","last_undegraded":"2023-10-09T07:58:24.059701+0000","last_fullsized":"2023-10-09T07:58:24.059701+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:50.645139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.031980+0000","last_change":"2023-10-09T07:58:23.041395+0000","last_active":"2023-10-09T07:58:24.031980+0000","last_peered":"2023-10-09T07:58:24.031980+0000","last_clean":"2023-10-09T07:58:24.031980+0000","last_became_active":"2023-10-09T07:58:23.040979+0000","last_became_peered":"2023-10-09T07:58:23.040979+0000","last_unstale":"2023-10-09T07:58:24.031980+0000","last_undegraded":"2023-10-09T07:58:24.031980+0000","last_fullsized":"2023-10-09T07:58:24.031980+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:56:38.332397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.035496+0000","last_change":"2023-10-09T07:58:24.034044+0000","last_active":"2023-10-09T07:58:24.035496+0000","last_peered":"2023-10-09T07:58:24.035496+0000","last_clean":"2023-10-09T07:58:24.035496+0000","last_became_active":"2023-10-09T07:58:24.033780+0000","last_became_peered":"2023-10-09T07:58:24.033780+0000","last_unstale":"2023-10-09T07:58:24.035496+0000","last_undegraded":"2023-10-09T07:58:24.035496+0000","last_fullsized":"2023-10-09T07:58:24.035496+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:48:29.551743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.030115+0000","last_change":"2023-10-09T07:58:23.041367+0000","last_active":"2023-10-09T07:58:24.030115+0000","last_peered":"2023-10-09T07:58:24.030115+0000","last_clean":"2023-10-09T07:58:24.030115+0000","last_became_active":"2023-10-09T07:58:23.041097+0000","last_became_peered":"2023-10-09T07:58:23.041097+0000","last_unstale":"2023-10-09T07:58:24.030115+0000","last_undegraded":"2023-10-09T07:58:24.030115+0000","last_fullsized":"2023-10-09T07:58:24.030115+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:44:28.217137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037217+0000","last_change":"2023-10-09T07:58:24.033312+0000","last_active":"2023-10-09T07:58:24.037217+0000","last_peered":"2023-10-09T07:58:24.037217+0000","last_clean":"2023-10-09T07:58:24.037217+0000","last_became_active":"2023-10-09T07:58:24.033036+0000","last_became_peered":"2023-10-09T07:58:24.033036+0000","last_unstale":"2023-10-09T07:58:24.037217+0000","last_undegraded":"2023-10-09T07:58:24.037217+0000","last_fullsized":"2023-10-09T07:58:24.037217+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:42.710219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"175'3","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.060642+0000","last_change":"2023-10-09T07:58:23.037183+0000","last_active":"2023-10-09T07:58:24.060642+0000","last_peered":"2023-10-09T07:58:24.060642+0000","last_clean":"2023-10-09T07:58:24.060642+0000","last_became_active":"2023-10-09T07:58:23.036838+0000","last_became_peered":"2023-10-09T07:58:23.036838+0000","last_unstale":"2023-10-09T07:58:24.060642+0000","last_undegraded":"2023-10-09T07:58:24.060642+0000","last_fullsized":"2023-10-09T07:58:24.060642+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:44:28.217137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"166'293","reported_seq":920,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.031991+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T07:58:24.031991+0000","last_peered":"2023-10-09T07:58:24.031991+0000","last_clean":"2023-10-09T07:58:24.031991+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T07:58:24.031991+0000","last_undegraded":"2023-10-09T07:58:24.031991+0000","last_fullsized":"2023-10-09T07:58:24.031991+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575751,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308212,"kb_used_data":2732,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063628,"statfs":{"total":96636764160,"available":96321155072,"internally_reserved":0,"allocated":2797568,"data_stored":1688396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.72799999999999998,"15min":0.752},"min":{"1min":0.45300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.127},"last":0.88},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.749,"15min":0.76400000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.47399999999999998},"max":{"1min":0.98099999999999998,"5min":1.026,"15min":1.1319999999999999},"last":0.60399999999999998}]},{"osd":1,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.71899999999999997,"15min":0.73399999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.875,"5min":0.96599999999999997,"15min":1.077},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.751},"min":{"1min":0.50900000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92200000000000004,"5min":0.997,"15min":1.038},"last":0.81899999999999995}]},{"osd":2,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.96399999999999997,"5min":0.98999999999999999,"15min":1.0269999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.52800000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91500000000000004,"5min":0.98299999999999998,"15min":1.1899999999999999},"last":0.75600000000000001}]},{"osd":3,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.72199999999999998,"15min":0.73599999999999999},"min":{"1min":0.499,"5min":0.49399999999999999,"15min":0.42099999999999999},"max":{"1min":0.88900000000000001,"5min":0.995,"15min":1.04},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77600000000000002,"15min":0.79200000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.036,"5min":1.0529999999999999,"15min":1.0920000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63800000000000001,"15min":0.626},"min":{"1min":0.47599999999999998,"5min":0.42199999999999999,"15min":0.36299999999999999},"max":{"1min":0.94099999999999995,"5min":0.97099999999999997,"15min":1.248},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.93700000000000006,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.92700000000000005}]},{"osd":5,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63900000000000001,"15min":0.65400000000000003},"min":{"1min":0.41399999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68799999999999994,"15min":0.69699999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.304},"last":0.94299999999999995}]},{"osd":6,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73899999999999999,"15min":0.75},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.405},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71099999999999997,"15min":0.71899999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.43099999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.377},"last":0.86299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575750,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311732,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060108,"statfs":{"total":96636764160,"available":96317550592,"internally_reserved":0,"allocated":2207744,"data_stored":1097550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.33600000000000002},"max":{"1min":0.93600000000000005,"5min":0.98399999999999999,"15min":1.012},"last":0.876},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.75600000000000001,"15min":0.75},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84899999999999998,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.64900000000000002}]},{"osd":1,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76800000000000002,"15min":0.76900000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1100000000000001,"5min":1.113,"15min":1.2769999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.78700000000000003,"15min":0.76700000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.02,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.78800000000000003}]},{"osd":2,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.76000000000000001},"min":{"1min":0.55400000000000005,"5min":0.46100000000000002,"15min":0.432},"max":{"1min":1.0369999999999999,"5min":1.0589999999999999,"15min":1.075},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79200000000000004,"15min":0.77700000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.86499999999999999,"5min":1.151,"15min":1.151},"last":0.92400000000000004}]},{"osd":3,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76300000000000001,"15min":0.755},"min":{"1min":0.52700000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95299999999999996,"5min":1.423,"15min":1.423},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80200000000000005,"15min":0.78500000000000003},"min":{"1min":0.59699999999999998,"5min":0.55500000000000005,"15min":0.54100000000000004},"max":{"1min":1.0800000000000001,"5min":1.335,"15min":1.335},"last":0.69699999999999995}]},{"osd":4,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.36199999999999999},"max":{"1min":0.89800000000000002,"5min":0.97399999999999998,"15min":1.0960000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65900000000000003,"15min":0.65300000000000002},"min":{"1min":0.45500000000000002,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.91500000000000004,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.61099999999999999}]},{"osd":5,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.52400000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.137,"5min":1.306,"15min":1.306},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.48199999999999998,"5min":0.45400000000000001,"15min":0.42699999999999999},"max":{"1min":0.96599999999999997,"5min":1.054,"15min":1.085},"last":0.90100000000000002}]},{"osd":7,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69799999999999995,"15min":0.69199999999999995},"min":{"1min":0.51700000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.96799999999999997,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.74099999999999999,"15min":0.73799999999999999},"min":{"1min":0.498,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1639999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.88800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575751,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303532,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068308,"statfs":{"total":96636764160,"available":96325947392,"internally_reserved":0,"allocated":2199552,"data_stored":1097958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48499999999999999,"15min":0.46800000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.308},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.52400000000000002,"15min":0.50700000000000001},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.313},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.37}]},{"osd":2,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.54800000000000004,"15min":0.51700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32900000000000001},"max":{"1min":5.1159999999999997,"5min":5.1159999999999997,"15min":5.1159999999999997},"last":0.436},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.63600000000000001,"15min":0.59599999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.375},"max":{"1min":5.399,"5min":5.399,"15min":5.399},"last":0.40000000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.63900000000000001,"15min":0.63600000000000001},"min":{"1min":0.42999999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.41699999999999998,"5min":0.39900000000000002,"15min":0.37},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.49299999999999999}]},{"osd":4,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.83899999999999997,"15min":0.80800000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.42699999999999999},"max":{"1min":5.2409999999999997,"5min":5.2409999999999997,"15min":5.2409999999999997},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.86599999999999999,"15min":0.82699999999999996},"min":{"1min":0.65700000000000003,"5min":0.622,"15min":0.56699999999999995},"max":{"1min":5.4409999999999998,"5min":5.4409999999999998,"15min":5.4409999999999998},"last":0.626}]},{"osd":5,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.81499999999999995,"15min":0.81100000000000005},"min":{"1min":0.64000000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.85499999999999998,"15min":0.82499999999999996},"min":{"1min":0.60299999999999998,"5min":0.57999999999999996,"15min":0.442},"max":{"1min":5.1630000000000003,"5min":5.1630000000000003,"15min":5.1630000000000003},"last":0.61699999999999999}]},{"osd":6,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.89300000000000002,"15min":0.84499999999999997},"min":{"1min":0.65300000000000002,"5min":0.63900000000000001,"15min":0.55100000000000005},"max":{"1min":5.4749999999999996,"5min":5.4749999999999996,"15min":5.4749999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83499999999999996,"15min":0.82999999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.56000000000000005},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.081,"5min":0.92800000000000005,"15min":0.88500000000000001},"min":{"1min":0.66500000000000004,"5min":0.63,"15min":0.55300000000000005},"max":{"1min":5.2009999999999996,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":0.79000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575750,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308220,"kb_used_data":2740,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063620,"statfs":{"total":96636764160,"available":96321146880,"internally_reserved":0,"allocated":2805760,"data_stored":1689342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.48699999999999999,"15min":0.47499999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.52800000000000002,"5min":0.72099999999999997,"15min":0.80100000000000005},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53100000000000003,"15min":0.54500000000000004},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.32000000000000001},"max":{"1min":0.71099999999999997,"5min":0.82999999999999996,"15min":0.88200000000000001},"last":0.47599999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56200000000000006,"15min":0.56499999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77800000000000002,"5min":0.83499999999999996,"15min":0.91800000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.60499999999999998,"5min":0.70599999999999996,"15min":0.82399999999999995},"last":0.51200000000000001}]},{"osd":3,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67900000000000005,"5min":0.78400000000000003,"15min":0.98599999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.74299999999999999,"5min":0.89600000000000002,"15min":0.94699999999999995},"last":0.52600000000000002}]},{"osd":4,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.52200000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.532},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81299999999999994,"15min":0.81999999999999995},"min":{"1min":0.626,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.202,"5min":1.202,"15min":1.2470000000000001},"last":0.79200000000000004}]},{"osd":5,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79800000000000004,"15min":0.79900000000000004},"min":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.01,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.80600000000000005,"15min":0.81299999999999994},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.55500000000000005},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.3009999999999999},"last":0.85699999999999998}]},{"osd":6,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.84099999999999997,"15min":0.83799999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0860000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81599999999999995,"15min":0.81999999999999995},"min":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.51400000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.3859999999999999},"last":0.82399999999999995}]},{"osd":7,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.84099999999999997,"15min":0.85399999999999998},"min":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3380000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.877,"15min":0.86799999999999999},"min":{"1min":0.66000000000000003,"5min":0.61899999999999999,"15min":0.54400000000000004},"max":{"1min":1.131,"5min":1.218,"15min":1.3580000000000001},"last":0.89100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575750,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311736,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060104,"statfs":{"total":96636764160,"available":96317546496,"internally_reserved":0,"allocated":2211840,"data_stored":1099010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46000000000000002,"15min":0.47099999999999997},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52500000000000002,"15min":0.51400000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.49199999999999999}]},{"osd":1,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.48999999999999999,"15min":0.48699999999999999},"min":{"1min":0.40699999999999997,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.34599999999999997},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.98699999999999999},"last":0.46700000000000003}]},{"osd":3,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.625,"15min":0.61799999999999999},"min":{"1min":0.48199999999999998,"5min":0.46600000000000003,"15min":0.41399999999999998},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.45500000000000002,"5min":0.44500000000000001,"15min":0.40999999999999998},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.52200000000000002}]},{"osd":4,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81299999999999994,"15min":0.80000000000000004},"min":{"1min":0.56499999999999995,"5min":0.56299999999999994,"15min":0.54500000000000004},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79200000000000004,"15min":0.78300000000000003},"min":{"1min":0.59799999999999998,"5min":0.54000000000000004,"15min":0.47799999999999998},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":0.876}]},{"osd":5,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.81299999999999994,"15min":0.79100000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.296,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.81599999999999995},"min":{"1min":0.63100000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0269999999999999,"5min":1.254,"15min":1.254},"last":0.74099999999999999}]},{"osd":6,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.82299999999999995,"15min":0.80900000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.54100000000000004},"max":{"1min":0.99399999999999999,"5min":1.1639999999999999,"15min":1.296},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82899999999999996,"15min":0.81999999999999995},"min":{"1min":0.629,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2230000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.73199999999999998}]},{"osd":7,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.85299999999999998,"15min":0.84099999999999997},"min":{"1min":0.63200000000000001,"5min":0.56499999999999995,"15min":0.53600000000000003},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.89500000000000002,"15min":0.877},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.69799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575751,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311724,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060116,"statfs":{"total":96636764160,"available":96317558784,"internally_reserved":0,"allocated":2199552,"data_stored":1097494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.47399999999999998,"15min":0.48499999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63700000000000001,"5min":0.77100000000000002,"15min":0.80700000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.32300000000000001},"max":{"1min":0.76400000000000001,"5min":0.85399999999999998,"15min":0.91700000000000004},"last":0.56499999999999995}]},{"osd":1,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48299999999999998,"15min":0.498},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.84699999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80100000000000005,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.61099999999999999}]},{"osd":2,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57699999999999996,"15min":0.58999999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.34999999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.90900000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.40899999999999997},"max":{"1min":0.81299999999999994,"5min":0.83799999999999997,"15min":0.95799999999999996},"last":0.58099999999999996}]},{"osd":4,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.77100000000000002,"15min":0.77400000000000002},"min":{"1min":0.55500000000000005,"5min":0.55000000000000004,"15min":0.47499999999999998},"max":{"1min":1.03,"5min":1.121,"15min":1.246},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.85099999999999998,"15min":0.85299999999999998},"min":{"1min":0.63800000000000001,"5min":0.629,"15min":0.57799999999999996},"max":{"1min":1.0780000000000001,"5min":1.1419999999999999,"15min":1.157},"last":0.86499999999999999}]},{"osd":5,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.76200000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.48499999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.1910000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.48899999999999999},"max":{"1min":1.073,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.77600000000000002}]},{"osd":6,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80200000000000005,"15min":0.79700000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.495},"max":{"1min":1.05,"5min":1.149,"15min":1.149},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.80900000000000005,"15min":0.81299999999999994},"min":{"1min":0.59299999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.099,"5min":1.103,"15min":1.2230000000000001},"last":0.80900000000000005}]},{"osd":7,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84499999999999997,"15min":0.84799999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.53100000000000003},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.2430000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.85199999999999998,"15min":0.85099999999999998},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.56699999999999995},"max":{"1min":1.181,"5min":1.181,"15min":1.1850000000000001},"last":0.82899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575750,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299432,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072408,"statfs":{"total":96636764160,"available":96330145792,"internally_reserved":0,"allocated":2195456,"data_stored":1097404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90300000000000002,"5min":0.97499999999999998,"15min":1.0700000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.73999999999999999,"15min":0.754},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77500000000000002,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.40100000000000002}]},{"osd":1,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.73599999999999999,"15min":0.73099999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97799999999999998,"5min":1.038,"15min":1.0640000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.73799999999999999,"15min":0.74099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.81299999999999994,"5min":1.028,"15min":1.038},"last":0.55600000000000005}]},{"osd":2,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.79400000000000004,"15min":0.78700000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88200000000000001,"5min":0.999,"15min":1.0509999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79500000000000004,"15min":0.79700000000000004},"min":{"1min":0.60399999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.94099999999999995,"5min":1.069,"15min":1.069},"last":0.73199999999999998}]},{"osd":3,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.76000000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91800000000000004,"5min":1.131,"15min":1.131},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.014,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.58299999999999996}]},{"osd":5,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61599999999999999,"15min":0.59399999999999997},"min":{"1min":0.438,"5min":0.372,"15min":0.36299999999999999},"max":{"1min":1.0009999999999999,"5min":1.27,"15min":1.27},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.626,"15min":0.61699999999999999},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95299999999999996,"5min":1.014,"15min":1.014},"last":0.626}]},{"osd":6,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65700000000000003,"15min":0.63700000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.41699999999999998},"max":{"1min":1.0449999999999999,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67900000000000005,"15min":0.66300000000000003},"min":{"1min":0.47599999999999998,"5min":0.45500000000000002,"15min":0.39000000000000001},"max":{"1min":0.89400000000000002,"5min":1.425,"15min":1.425},"last":0.78400000000000003}]},{"osd":7,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.58699999999999997,"5min":0.48699999999999999,"15min":0.47999999999999998},"max":{"1min":0.92300000000000004,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.78300000000000003,"15min":0.76200000000000001},"min":{"1min":0.63900000000000001,"5min":0.51200000000000001,"15min":0.46600000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.76900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575751,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311724,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060116,"statfs":{"total":96636764160,"available":96317558784,"internally_reserved":0,"allocated":2199552,"data_stored":1097426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73499999999999999,"15min":0.72999999999999998},"min":{"1min":0.46500000000000002,"5min":0.46200000000000002,"15min":0.39100000000000001},"max":{"1min":1.016,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.73099999999999998,"15min":0.72199999999999998},"min":{"1min":0.51000000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97299999999999998,"5min":0.98799999999999999,"15min":1.0820000000000001},"last":0.55800000000000005}]},{"osd":1,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.73499999999999999,"15min":0.72799999999999998},"min":{"1min":0.54600000000000004,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":0.92800000000000005,"5min":0.97499999999999998,"15min":1.0129999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.748,"15min":0.751},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.0289999999999999},"last":0.60899999999999999}]},{"osd":2,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76500000000000001,"15min":0.75700000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.46800000000000003},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.98599999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73699999999999999,"15min":0.74299999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.44500000000000001},"max":{"1min":0.89300000000000002,"5min":0.96399999999999997,"15min":1.026},"last":0.625}]},{"osd":3,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.47499999999999998},"max":{"1min":0.89900000000000002,"5min":0.97399999999999998,"15min":1.107},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79500000000000004,"15min":0.78600000000000003},"min":{"1min":0.58299999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.66300000000000003}]},{"osd":4,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.84099999999999997,"5min":1.002,"15min":1.0189999999999999},"last":0.502},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.38800000000000001,"15min":0.379},"max":{"1min":0.90700000000000003,"5min":0.96199999999999997,"15min":1.0289999999999999},"last":0.48799999999999999}]},{"osd":6,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.44900000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69299999999999995,"15min":0.68400000000000005},"min":{"1min":0.48299999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.97799999999999998,"5min":0.99299999999999999,"15min":1.054},"last":0.57299999999999995}]},{"osd":7,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70799999999999996,"15min":0.69899999999999995},"min":{"1min":0.46999999999999997,"5min":0.45000000000000001,"15min":0.433},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.79000000000000004,"15min":0.78700000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.5},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.69499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T07:58:29.288 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T07:58:29.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.468+0000 7f43e0dff700 1 Processor -- start 2023-10-09T07:58:29.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.468+0000 7f43e0dff700 1 -- start start 2023-10-09T07:58:29.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.469+0000 7f43e0dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f43dc156510 0x7f43dc0ac800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:29.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.469+0000 7f43e0dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43dc0b0ca0 0x7f43dc15fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:29.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.469+0000 7f43e0dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43dc0ad1e0 con 0x7f43dc0acd40 2023-10-09T07:58:29.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.469+0000 7f43e0dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43dc0ad9d0 con 0x7f43dc156510 2023-10-09T07:58:29.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.469+0000 7f43e0dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc0aed00 con 0x7f43dc0b0ca0 2023-10-09T07:58:29.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.470+0000 7f43da59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f43dc156510 0x7f43dc0ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:29.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.470+0000 7f43da59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f43dc156510 0x7f43dc0ac800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42820/0 (socket says 172.21.15.71:42820) 2023-10-09T07:58:29.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.470+0000 7f43da59c700 1 -- 172.21.15.71:0/3102307412 learned_addr learned my addr 172.21.15.71:0/3102307412 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:29.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.470+0000 7f43dad9d700 1 --2- 172.21.15.71:0/3102307412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43dc0b0ca0 0x7f43dc15fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:29.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.470+0000 7f43da59c700 1 -- 172.21.15.71:0/3102307412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43dc0b0ca0 msgr2=0x7f43dc15fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:29.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.470+0000 7f43da59c700 1 --2- 172.21.15.71:0/3102307412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43dc0b0ca0 0x7f43dc15fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:29.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.470+0000 7f43da59c700 1 -- 172.21.15.71:0/3102307412 >> v1:172.21.15.179:6789/0 conn(0x7f43dc0acd40 legacy=0x7f43dc1568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:29.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.470+0000 7f43da59c700 1 -- 172.21.15.71:0/3102307412 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc153f10 con 0x7f43dc156510 2023-10-09T07:58:29.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.470+0000 7f43dad9d700 1 --2- 172.21.15.71:0/3102307412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43dc0b0ca0 0x7f43dc15fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:29.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.470+0000 7f43da59c700 1 --2- 172.21.15.71:0/3102307412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43dc156510 0x7f43dc0ac800 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0099b0 tx=0x7f43cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737b584effd9b289 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:29.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.470+0000 7f43d959a700 1 -- 172.21.15.71:0/3102307412 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc00b820 con 0x7f43dc156510 2023-10-09T07:58:29.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.471+0000 7f43d959a700 1 -- 172.21.15.71:0/3102307412 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc00b980 con 0x7f43dc156510 2023-10-09T07:58:29.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.471+0000 7f43d959a700 1 -- 172.21.15.71:0/3102307412 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc00bd20 con 0x7f43dc156510 2023-10-09T07:58:29.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.471+0000 7f43e0dff700 1 -- 172.21.15.71:0/3102307412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43dc156510 msgr2=0x7f43dc0ac800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:29.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.471+0000 7f43e0dff700 1 --2- 172.21.15.71:0/3102307412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43dc156510 0x7f43dc0ac800 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0099b0 tx=0x7f43cc009250 comp rx=0 tx=0).stop 2023-10-09T07:58:29.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.471+0000 7f43e0dff700 1 -- 172.21.15.71:0/3102307412 shutdown_connections 2023-10-09T07:58:29.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.471+0000 7f43e0dff700 1 --2- 172.21.15.71:0/3102307412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43dc0b0ca0 0x7f43dc15fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:29.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.471+0000 7f43e0dff700 1 --2- 172.21.15.71:0/3102307412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43dc156510 0x7f43dc0ac800 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:29.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.471+0000 7f43e0dff700 1 -- 172.21.15.71:0/3102307412 >> 172.21.15.71:0/3102307412 conn(0x7f43dc06a310 msgr2=0x7f43dc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:29.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.471+0000 7f43e0dff700 1 -- 172.21.15.71:0/3102307412 shutdown_connections 2023-10-09T07:58:29.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.471+0000 7f43e0dff700 1 -- 172.21.15.71:0/3102307412 wait complete. 2023-10-09T07:58:29.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.473+0000 7f43e0dff700 1 Processor -- start 2023-10-09T07:58:29.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.473+0000 7f43e0dff700 1 -- start start 2023-10-09T07:58:29.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.473+0000 7f43e0dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43dc0acd40 0x7f43dc141e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:29.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.473+0000 7f43e0dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43dc0b0ca0 0x7f43dc159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:29.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.474+0000 7f43e0dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43dc156510 0x7f43dc159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:29.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.474+0000 7f43e0dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc06f200 con 0x7f43dc0acd40 2023-10-09T07:58:29.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.474+0000 7f43e0dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc0c9ca0 con 0x7f43dc156510 2023-10-09T07:58:29.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.474+0000 7f43e0dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc0c9f80 con 0x7f43dc0b0ca0 2023-10-09T07:58:29.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.474+0000 7f43da59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43dc0acd40 0x7f43dc141e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:29.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.474+0000 7f43da59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43dc0acd40 0x7f43dc141e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42828/0 (socket says 172.21.15.71:42828) 2023-10-09T07:58:29.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.474+0000 7f43da59c700 1 -- 172.21.15.71:0/698970984 learned_addr learned my addr 172.21.15.71:0/698970984 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:29.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.474+0000 7f43dad9d700 1 --2- 172.21.15.71:0/698970984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43dc156510 0x7f43dc159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:29.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.474+0000 7f43d9d9b700 1 --2- 172.21.15.71:0/698970984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43dc0b0ca0 0x7f43dc159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:29.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.474+0000 7f43da59c700 1 -- 172.21.15.71:0/698970984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43dc0b0ca0 msgr2=0x7f43dc159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:29.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.474+0000 7f43da59c700 1 --2- 172.21.15.71:0/698970984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43dc0b0ca0 0x7f43dc159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:29.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.474+0000 7f43da59c700 1 -- 172.21.15.71:0/698970984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43dc156510 msgr2=0x7f43dc159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:29.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.474+0000 7f43da59c700 1 --2- 172.21.15.71:0/698970984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43dc156510 0x7f43dc159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:29.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.474+0000 7f43da59c700 1 -- 172.21.15.71:0/698970984 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc0094f0 con 0x7f43dc0acd40 2023-10-09T07:58:29.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.474+0000 7f43dad9d700 1 --2- 172.21.15.71:0/698970984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43dc156510 0x7f43dc159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:29.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.474+0000 7f43d9d9b700 1 --2- 172.21.15.71:0/698970984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43dc0b0ca0 0x7f43dc159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:29.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.474+0000 7f43da59c700 1 --2- 172.21.15.71:0/698970984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43dc0acd40 0x7f43dc141e80 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009290 tx=0x7f43cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:29.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.475+0000 7f43ca7fc700 1 -- 172.21.15.71:0/698970984 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc01d070 con 0x7f43dc0acd40 2023-10-09T07:58:29.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.475+0000 7f43ca7fc700 1 -- 172.21.15.71:0/698970984 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc022470 con 0x7f43dc0acd40 2023-10-09T07:58:29.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.475+0000 7f43e0dff700 1 -- 172.21.15.71:0/698970984 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43dc0ca260 con 0x7f43dc0acd40 2023-10-09T07:58:29.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.475+0000 7f43ca7fc700 1 -- 172.21.15.71:0/698970984 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc022810 con 0x7f43dc0acd40 2023-10-09T07:58:29.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.475+0000 7f43e0dff700 1 -- 172.21.15.71:0/698970984 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43dc1423c0 con 0x7f43dc0acd40 2023-10-09T07:58:29.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.476+0000 7f43e0dff700 1 -- 172.21.15.71:0/698970984 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43dc04c3c0 con 0x7f43dc0acd40 2023-10-09T07:58:29.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.477+0000 7f43ca7fc700 1 -- 172.21.15.71:0/698970984 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43cc0103f0 con 0x7f43dc0acd40 2023-10-09T07:58:29.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.477+0000 7f43ca7fc700 1 --2- 172.21.15.71:0/698970984 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f43bc066f30 0x7f43bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:29.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.478+0000 7f43ca7fc700 1 -- 172.21.15.71:0/698970984 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f43cc086210 con 0x7f43dc0acd40 2023-10-09T07:58:29.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.478+0000 7f43d9d9b700 1 --2- 172.21.15.71:0/698970984 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f43bc066f30 0x7f43bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:29.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.479+0000 7f43d9d9b700 1 --2- 172.21.15.71:0/698970984 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f43bc066f30 0x7f43bc0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f43dc0aade0 tx=0x7f43d0009040 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:29.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.482+0000 7f43ca7fc700 1 -- 172.21.15.71:0/698970984 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43cc053210 con 0x7f43dc0acd40 2023-10-09T07:58:29.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.748+0000 7f43e0dff700 1 -- 172.21.15.71:0/698970984 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f43dc0cc210 con 0x7f43dc0acd40 2023-10-09T07:58:29.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.749+0000 7f43ca7fc700 1 -- 172.21.15.71:0/698970984 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1020 (secure 0 0 0) 0x7f43cc05ae60 con 0x7f43dc0acd40 2023-10-09T07:58:29.750 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:58:29.750 INFO:teuthology.orchestra.run.smithi071.stdout:{"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":4576,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":176,"num_osds":8,"num_up_osds":8,"osd_up_since":1696833745,"num_in_osds":8,"osd_in_since":1696833737,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592674,"bytes_used":2525503488,"bytes_avail":770568609792,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":82,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":9087}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2023-10-09T07:47:45.657186+0000","services":{}},"progress_events":{}} 2023-10-09T07:58:29.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.751+0000 7f43e0dff700 1 -- 172.21.15.71:0/698970984 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f43bc066f30 msgr2=0x7f43bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.751+0000 7f43e0dff700 1 --2- 172.21.15.71:0/698970984 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f43bc066f30 0x7f43bc0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f43dc0aade0 tx=0x7f43d0009040 comp rx=0 tx=0).stop 2023-10-09T07:58:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.751+0000 7f43e0dff700 1 -- 172.21.15.71:0/698970984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43dc0acd40 msgr2=0x7f43dc141e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.751+0000 7f43e0dff700 1 --2- 172.21.15.71:0/698970984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43dc0acd40 0x7f43dc141e80 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009290 tx=0x7f43cc017000 comp rx=0 tx=0).stop 2023-10-09T07:58:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.752+0000 7f43e0dff700 1 -- 172.21.15.71:0/698970984 shutdown_connections 2023-10-09T07:58:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.752+0000 7f43e0dff700 1 --2- 172.21.15.71:0/698970984 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f43bc066f30 0x7f43bc0693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.752+0000 7f43e0dff700 1 --2- 172.21.15.71:0/698970984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43dc156510 0x7f43dc159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.752+0000 7f43e0dff700 1 --2- 172.21.15.71:0/698970984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43dc0acd40 0x7f43dc141e80 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.752+0000 7f43e0dff700 1 --2- 172.21.15.71:0/698970984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43dc0b0ca0 0x7f43dc159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.752+0000 7f43e0dff700 1 -- 172.21.15.71:0/698970984 >> 172.21.15.71:0/698970984 conn(0x7f43dc06a310 msgr2=0x7f43dc154cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.752+0000 7f43e0dff700 1 -- 172.21.15.71:0/698970984 shutdown_connections 2023-10-09T07:58:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.752+0000 7f43e0dff700 1 -- 172.21.15.71:0/698970984 wait complete. 2023-10-09T07:58:29.770 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T07:58:29.770 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T07:58:29.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.950+0000 7f10833ff700 1 Processor -- start 2023-10-09T07:58:29.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.950+0000 7f10833ff700 1 -- start start 2023-10-09T07:58:29.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.951+0000 7f10833ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f107c1599e0 0x7f107c069ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:29.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.951+0000 7f10833ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f107c159db0 0x7f107c069080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:29.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.951+0000 7f10833ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f107c0c96a0 con 0x7f107c06a2b0 2023-10-09T07:58:29.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.951+0000 7f10833ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107c0cb9e0 con 0x7f107c1599e0 2023-10-09T07:58:29.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.951+0000 7f10833ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107c0cab60 con 0x7f107c159db0 2023-10-09T07:58:29.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.952+0000 7f108119b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f107c1599e0 0x7f107c069ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.952+0000 7f108119b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f107c1599e0 0x7f107c069ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42830/0 (socket says 172.21.15.71:42830) 2023-10-09T07:58:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.952+0000 7f108119b700 1 -- 172.21.15.71:0/616832223 learned_addr learned my addr 172.21.15.71:0/616832223 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.952+0000 7f108199c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f107c06a2b0 0x7f107c06a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53538/0 (socket says 172.21.15.71:53538) 2023-10-09T07:58:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.952+0000 7f108099a700 1 --2- 172.21.15.71:0/616832223 >> v2:172.21.15.179:3300/0 conn(0x7f107c159db0 0x7f107c069080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.952+0000 7f108119b700 1 -- 172.21.15.71:0/616832223 >> v2:172.21.15.179:3300/0 conn(0x7f107c159db0 msgr2=0x7f107c069080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.952+0000 7f108119b700 1 --2- 172.21.15.71:0/616832223 >> v2:172.21.15.179:3300/0 conn(0x7f107c159db0 0x7f107c069080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.952+0000 7f108119b700 1 -- 172.21.15.71:0/616832223 >> v1:172.21.15.71:6789/0 conn(0x7f107c06a2b0 legacy=0x7f107c06a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.952+0000 7f108119b700 1 -- 172.21.15.71:0/616832223 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107c0cb420 con 0x7f107c1599e0 2023-10-09T07:58:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.952+0000 7f1073fff700 1 -- 172.21.15.71:0/616832223 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503448977 0 0) 0x7f107c0c96a0 con 0x7f107c06a2b0 2023-10-09T07:58:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.952+0000 7f108119b700 1 --2- 172.21.15.71:0/616832223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f107c1599e0 0x7f107c069ac0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f107c0c73c0 tx=0x7f1078009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=667257b29fef626d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.953+0000 7f1073fff700 1 -- 172.21.15.71:0/616832223 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107800b860 con 0x7f107c1599e0 2023-10-09T07:58:29.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.953+0000 7f1073fff700 1 -- 172.21.15.71:0/616832223 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107800b9c0 con 0x7f107c1599e0 2023-10-09T07:58:29.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.953+0000 7f1073fff700 1 -- 172.21.15.71:0/616832223 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107800bd60 con 0x7f107c1599e0 2023-10-09T07:58:29.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.953+0000 7f10833ff700 1 -- 172.21.15.71:0/616832223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f107c1599e0 msgr2=0x7f107c069ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:29.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.953+0000 7f10833ff700 1 --2- 172.21.15.71:0/616832223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f107c1599e0 0x7f107c069ac0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f107c0c73c0 tx=0x7f1078009250 comp rx=0 tx=0).stop 2023-10-09T07:58:29.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.953+0000 7f10833ff700 1 -- 172.21.15.71:0/616832223 shutdown_connections 2023-10-09T07:58:29.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.953+0000 7f10833ff700 1 --2- 172.21.15.71:0/616832223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f107c1599e0 0x7f107c069ac0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:29.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.953+0000 7f10833ff700 1 --2- 172.21.15.71:0/616832223 >> v2:172.21.15.179:3300/0 conn(0x7f107c159db0 0x7f107c069080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:29.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.953+0000 7f10833ff700 1 -- 172.21.15.71:0/616832223 >> 172.21.15.71:0/616832223 conn(0x7f107c0c9860 msgr2=0x7f107c0c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:29.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.953+0000 7f10833ff700 1 -- 172.21.15.71:0/616832223 shutdown_connections 2023-10-09T07:58:29.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.953+0000 7f10833ff700 1 -- 172.21.15.71:0/616832223 wait complete. 2023-10-09T07:58:29.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.955+0000 7f10833ff700 1 Processor -- start 2023-10-09T07:58:29.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.955+0000 7f10833ff700 1 -- start start 2023-10-09T07:58:29.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.956+0000 7f10833ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f107c06a2b0 0x7f107c0b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:29.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.956+0000 7f10833ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f107c1599e0 0x7f107c0b2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:29.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.956+0000 7f10833ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f107c159db0 0x7f107c15e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:29.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.956+0000 7f10833ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c15a220 con 0x7f107c159db0 2023-10-09T07:58:29.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.956+0000 7f10833ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c15b040 con 0x7f107c1599e0 2023-10-09T07:58:29.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.956+0000 7f10833ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107c15a430 con 0x7f107c06a2b0 2023-10-09T07:58:29.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.956+0000 7f108199c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f107c159db0 0x7f107c15e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:29.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.956+0000 7f108199c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f107c159db0 0x7f107c15e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42840/0 (socket says 172.21.15.71:42840) 2023-10-09T07:58:29.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.956+0000 7f108199c700 1 -- 172.21.15.71:0/1669291441 learned_addr learned my addr 172.21.15.71:0/1669291441 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:29.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.956+0000 7f108119b700 1 --2- 172.21.15.71:0/1669291441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f107c06a2b0 0x7f107c0b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:29.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.956+0000 7f108099a700 1 --2- 172.21.15.71:0/1669291441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f107c1599e0 0x7f107c0b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:29.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.956+0000 7f108199c700 1 -- 172.21.15.71:0/1669291441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f107c06a2b0 msgr2=0x7f107c0b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:29.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.956+0000 7f108199c700 1 --2- 172.21.15.71:0/1669291441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f107c06a2b0 0x7f107c0b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:29.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.956+0000 7f108199c700 1 -- 172.21.15.71:0/1669291441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f107c1599e0 msgr2=0x7f107c0b2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:29.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.956+0000 7f108199c700 1 --2- 172.21.15.71:0/1669291441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f107c1599e0 0x7f107c0b2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:29.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.956+0000 7f108199c700 1 -- 172.21.15.71:0/1669291441 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10780094f0 con 0x7f107c159db0 2023-10-09T07:58:29.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.956+0000 7f108099a700 1 --2- 172.21.15.71:0/1669291441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f107c1599e0 0x7f107c0b2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:58:29.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.957+0000 7f108199c700 1 --2- 172.21.15.71:0/1669291441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f107c159db0 0x7f107c15e4d0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f107400cd50 tx=0x7f1074001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:29.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.957+0000 7f10717fa700 1 -- 172.21.15.71:0/1669291441 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1074005df0 con 0x7f107c159db0 2023-10-09T07:58:29.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.957+0000 7f10717fa700 1 -- 172.21.15.71:0/1669291441 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107400a960 con 0x7f107c159db0 2023-10-09T07:58:29.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.957+0000 7f10717fa700 1 -- 172.21.15.71:0/1669291441 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107400ad20 con 0x7f107c159db0 2023-10-09T07:58:29.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.957+0000 7f10833ff700 1 -- 172.21.15.71:0/1669291441 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f107c15a710 con 0x7f107c159db0 2023-10-09T07:58:29.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.957+0000 7f10833ff700 1 -- 172.21.15.71:0/1669291441 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107c15acd0 con 0x7f107c159db0 2023-10-09T07:58:29.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.958+0000 7f10833ff700 1 -- 172.21.15.71:0/1669291441 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f107c15b1d0 con 0x7f107c159db0 2023-10-09T07:58:29.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.959+0000 7f10717fa700 1 -- 172.21.15.71:0/1669291441 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1074007300 con 0x7f107c159db0 2023-10-09T07:58:29.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.960+0000 7f10717fa700 1 --2- 172.21.15.71:0/1669291441 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1060066f30 0x7f10600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:29.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.960+0000 7f10717fa700 1 -- 172.21.15.71:0/1669291441 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f10740848f0 con 0x7f107c159db0 2023-10-09T07:58:29.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.960+0000 7f108119b700 1 --2- 172.21.15.71:0/1669291441 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1060066f30 0x7f10600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:29.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.961+0000 7f108119b700 1 --2- 172.21.15.71:0/1669291441 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1060066f30 0x7f10600693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f107c0c73c0 tx=0x7f1078017000 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:29.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:29.964+0000 7f10717fa700 1 -- 172.21.15.71:0/1669291441 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1074051970 con 0x7f107c159db0 2023-10-09T07:58:30.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:30.149+0000 7f10833ff700 1 -- 172.21.15.71:0/1669291441 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f107c04c3c0 con 0x7f1060066f30 2023-10-09T07:58:30.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:30.158+0000 7f10717fa700 1 -- 172.21.15.71:0/1669291441 <== mgr.8503 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289476 (secure 0 0 0) 0x7f107c04c3c0 con 0x7f1060066f30 2023-10-09T07:58:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:58:30.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:30.162+0000 7f10833ff700 1 -- 172.21.15.71:0/1669291441 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1060066f30 msgr2=0x7f10600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:30.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:30.162+0000 7f10833ff700 1 --2- 172.21.15.71:0/1669291441 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1060066f30 0x7f10600693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f107c0c73c0 tx=0x7f1078017000 comp rx=0 tx=0).stop 2023-10-09T07:58:30.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:30.162+0000 7f10833ff700 1 -- 172.21.15.71:0/1669291441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f107c159db0 msgr2=0x7f107c15e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:30.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:30.162+0000 7f10833ff700 1 --2- 172.21.15.71:0/1669291441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f107c159db0 0x7f107c15e4d0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f107400cd50 tx=0x7f1074001b10 comp rx=0 tx=0).stop 2023-10-09T07:58:30.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:30.162+0000 7f10833ff700 1 -- 172.21.15.71:0/1669291441 shutdown_connections 2023-10-09T07:58:30.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:30.162+0000 7f10833ff700 1 --2- 172.21.15.71:0/1669291441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f107c159db0 0x7f107c15e4d0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:30.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:30.162+0000 7f10833ff700 1 --2- 172.21.15.71:0/1669291441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f107c06a2b0 0x7f107c0b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:30.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:30.162+0000 7f10833ff700 1 --2- 172.21.15.71:0/1669291441 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f1060066f30 0x7f10600693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:30.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:30.162+0000 7f10833ff700 1 --2- 172.21.15.71:0/1669291441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f107c1599e0 0x7f107c0b2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:30.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:30.162+0000 7f10833ff700 1 -- 172.21.15.71:0/1669291441 >> 172.21.15.71:0/1669291441 conn(0x7f107c0c9860 msgr2=0x7f107c06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:30.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:30.163+0000 7f10833ff700 1 -- 172.21.15.71:0/1669291441 shutdown_connections 2023-10-09T07:58:30.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:30.163+0000 7f10833ff700 1 -- 172.21.15.71:0/1669291441 wait complete. 2023-10-09T07:58:30.166 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T07:58:30.181 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T07:58:28.961697+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":523,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":331,"ondisk_log_size":331,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":160,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2466312,"kb_used_data":18376,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752508408,"statfs":{"total":773094113280,"available":770568609792,"internally_reserved":0,"allocated":18817024,"data_stored":9964580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001401"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.051793+0000","last_change":"2023-10-09T07:58:24.050753+0000","last_active":"2023-10-09T07:58:24.051793+0000","last_peered":"2023-10-09T07:58:24.051793+0000","last_clean":"2023-10-09T07:58:24.051793+0000","last_became_active":"2023-10-09T07:58:24.050542+0000","last_became_peered":"2023-10-09T07:58:24.050542+0000","last_unstale":"2023-10-09T07:58:24.051793+0000","last_undegraded":"2023-10-09T07:58:24.051793+0000","last_fullsized":"2023-10-09T07:58:24.051793+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:31.820966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048921+0000","last_change":"2023-10-09T07:58:24.045776+0000","last_active":"2023-10-09T07:58:24.048921+0000","last_peered":"2023-10-09T07:58:24.048921+0000","last_clean":"2023-10-09T07:58:24.048921+0000","last_became_active":"2023-10-09T07:58:24.045554+0000","last_became_peered":"2023-10-09T07:58:24.045554+0000","last_unstale":"2023-10-09T07:58:24.048921+0000","last_undegraded":"2023-10-09T07:58:24.048921+0000","last_fullsized":"2023-10-09T07:58:24.048921+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:11:57.967753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.058427+0000","last_change":"2023-10-09T07:58:24.053589+0000","last_active":"2023-10-09T07:58:24.058427+0000","last_peered":"2023-10-09T07:58:24.058427+0000","last_clean":"2023-10-09T07:58:24.058427+0000","last_became_active":"2023-10-09T07:58:24.053231+0000","last_became_peered":"2023-10-09T07:58:24.053231+0000","last_unstale":"2023-10-09T07:58:24.058427+0000","last_undegraded":"2023-10-09T07:58:24.058427+0000","last_fullsized":"2023-10-09T07:58:24.058427+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:33:22.406090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.047207+0000","last_change":"2023-10-09T07:58:24.046040+0000","last_active":"2023-10-09T07:58:24.047207+0000","last_peered":"2023-10-09T07:58:24.047207+0000","last_clean":"2023-10-09T07:58:24.047207+0000","last_became_active":"2023-10-09T07:58:24.045353+0000","last_became_peered":"2023-10-09T07:58:24.045353+0000","last_unstale":"2023-10-09T07:58:24.047207+0000","last_undegraded":"2023-10-09T07:58:24.047207+0000","last_fullsized":"2023-10-09T07:58:24.047207+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:44.690645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.058333+0000","last_change":"2023-10-09T07:58:24.055759+0000","last_active":"2023-10-09T07:58:24.058333+0000","last_peered":"2023-10-09T07:58:24.058333+0000","last_clean":"2023-10-09T07:58:24.058333+0000","last_became_active":"2023-10-09T07:58:24.055332+0000","last_became_peered":"2023-10-09T07:58:24.055332+0000","last_unstale":"2023-10-09T07:58:24.058333+0000","last_undegraded":"2023-10-09T07:58:24.058333+0000","last_fullsized":"2023-10-09T07:58:24.058333+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:45.661437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048122+0000","last_change":"2023-10-09T07:58:24.043868+0000","last_active":"2023-10-09T07:58:24.048122+0000","last_peered":"2023-10-09T07:58:24.048122+0000","last_clean":"2023-10-09T07:58:24.048122+0000","last_became_active":"2023-10-09T07:58:24.043622+0000","last_became_peered":"2023-10-09T07:58:24.043622+0000","last_unstale":"2023-10-09T07:58:24.048122+0000","last_undegraded":"2023-10-09T07:58:24.048122+0000","last_fullsized":"2023-10-09T07:58:24.048122+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:45.661437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037247+0000","last_change":"2023-10-09T07:58:24.034026+0000","last_active":"2023-10-09T07:58:24.037247+0000","last_peered":"2023-10-09T07:58:24.037247+0000","last_clean":"2023-10-09T07:58:24.037247+0000","last_became_active":"2023-10-09T07:58:24.033378+0000","last_became_peered":"2023-10-09T07:58:24.033378+0000","last_unstale":"2023-10-09T07:58:24.037247+0000","last_undegraded":"2023-10-09T07:58:24.037247+0000","last_fullsized":"2023-10-09T07:58:24.037247+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:30.633397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.039832+0000","last_change":"2023-10-09T07:58:24.034388+0000","last_active":"2023-10-09T07:58:24.039832+0000","last_peered":"2023-10-09T07:58:24.039832+0000","last_clean":"2023-10-09T07:58:24.039832+0000","last_became_active":"2023-10-09T07:58:24.033937+0000","last_became_peered":"2023-10-09T07:58:24.033937+0000","last_unstale":"2023-10-09T07:58:24.039832+0000","last_undegraded":"2023-10-09T07:58:24.039832+0000","last_fullsized":"2023-10-09T07:58:24.039832+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:44.690645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048899+0000","last_change":"2023-10-09T07:58:24.043286+0000","last_active":"2023-10-09T07:58:24.048899+0000","last_peered":"2023-10-09T07:58:24.048899+0000","last_clean":"2023-10-09T07:58:24.048899+0000","last_became_active":"2023-10-09T07:58:24.043002+0000","last_became_peered":"2023-10-09T07:58:24.043002+0000","last_unstale":"2023-10-09T07:58:24.048899+0000","last_undegraded":"2023-10-09T07:58:24.048899+0000","last_fullsized":"2023-10-09T07:58:24.048899+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:53.560893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.059357+0000","last_change":"2023-10-09T07:58:24.051725+0000","last_active":"2023-10-09T07:58:24.059357+0000","last_peered":"2023-10-09T07:58:24.059357+0000","last_clean":"2023-10-09T07:58:24.059357+0000","last_became_active":"2023-10-09T07:58:24.050619+0000","last_became_peered":"2023-10-09T07:58:24.050619+0000","last_unstale":"2023-10-09T07:58:24.059357+0000","last_undegraded":"2023-10-09T07:58:24.059357+0000","last_fullsized":"2023-10-09T07:58:24.059357+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:11.305736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.039861+0000","last_change":"2023-10-09T07:58:24.035442+0000","last_active":"2023-10-09T07:58:24.039861+0000","last_peered":"2023-10-09T07:58:24.039861+0000","last_clean":"2023-10-09T07:58:24.039861+0000","last_became_active":"2023-10-09T07:58:24.034999+0000","last_became_peered":"2023-10-09T07:58:24.034999+0000","last_unstale":"2023-10-09T07:58:24.039861+0000","last_undegraded":"2023-10-09T07:58:24.039861+0000","last_fullsized":"2023-10-09T07:58:24.039861+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:58.571728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.057589+0000","last_change":"2023-10-09T07:58:24.051157+0000","last_active":"2023-10-09T07:58:24.057589+0000","last_peered":"2023-10-09T07:58:24.057589+0000","last_clean":"2023-10-09T07:58:24.057589+0000","last_became_active":"2023-10-09T07:58:24.050918+0000","last_became_peered":"2023-10-09T07:58:24.050918+0000","last_unstale":"2023-10-09T07:58:24.057589+0000","last_undegraded":"2023-10-09T07:58:24.057589+0000","last_fullsized":"2023-10-09T07:58:24.057589+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:01:28.518491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.058312+0000","last_change":"2023-10-09T07:58:24.055579+0000","last_active":"2023-10-09T07:58:24.058312+0000","last_peered":"2023-10-09T07:58:24.058312+0000","last_clean":"2023-10-09T07:58:24.058312+0000","last_became_active":"2023-10-09T07:58:24.054947+0000","last_became_peered":"2023-10-09T07:58:24.054947+0000","last_unstale":"2023-10-09T07:58:24.058312+0000","last_undegraded":"2023-10-09T07:58:24.058312+0000","last_fullsized":"2023-10-09T07:58:24.058312+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:36.378974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.055427+0000","last_change":"2023-10-09T07:58:24.053220+0000","last_active":"2023-10-09T07:58:24.055427+0000","last_peered":"2023-10-09T07:58:24.055427+0000","last_clean":"2023-10-09T07:58:24.055427+0000","last_became_active":"2023-10-09T07:58:24.052935+0000","last_became_peered":"2023-10-09T07:58:24.052935+0000","last_unstale":"2023-10-09T07:58:24.055427+0000","last_undegraded":"2023-10-09T07:58:24.055427+0000","last_fullsized":"2023-10-09T07:58:24.055427+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:09.884939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.057551+0000","last_change":"2023-10-09T07:58:24.050809+0000","last_active":"2023-10-09T07:58:24.057551+0000","last_peered":"2023-10-09T07:58:24.057551+0000","last_clean":"2023-10-09T07:58:24.057551+0000","last_became_active":"2023-10-09T07:58:24.050521+0000","last_became_peered":"2023-10-09T07:58:24.050521+0000","last_unstale":"2023-10-09T07:58:24.057551+0000","last_undegraded":"2023-10-09T07:58:24.057551+0000","last_fullsized":"2023-10-09T07:58:24.057551+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:48:12.371691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.047182+0000","last_change":"2023-10-09T07:58:24.041213+0000","last_active":"2023-10-09T07:58:24.047182+0000","last_peered":"2023-10-09T07:58:24.047182+0000","last_clean":"2023-10-09T07:58:24.047182+0000","last_became_active":"2023-10-09T07:58:24.040940+0000","last_became_peered":"2023-10-09T07:58:24.040940+0000","last_unstale":"2023-10-09T07:58:24.047182+0000","last_undegraded":"2023-10-09T07:58:24.047182+0000","last_fullsized":"2023-10-09T07:58:24.047182+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:20.139851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.057687+0000","last_change":"2023-10-09T07:58:24.051958+0000","last_active":"2023-10-09T07:58:24.057687+0000","last_peered":"2023-10-09T07:58:24.057687+0000","last_clean":"2023-10-09T07:58:24.057687+0000","last_became_active":"2023-10-09T07:58:24.051177+0000","last_became_peered":"2023-10-09T07:58:24.051177+0000","last_unstale":"2023-10-09T07:58:24.057687+0000","last_undegraded":"2023-10-09T07:58:24.057687+0000","last_fullsized":"2023-10-09T07:58:24.057687+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:13.878245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.058340+0000","last_change":"2023-10-09T07:58:24.053547+0000","last_active":"2023-10-09T07:58:24.058340+0000","last_peered":"2023-10-09T07:58:24.058340+0000","last_clean":"2023-10-09T07:58:24.058340+0000","last_became_active":"2023-10-09T07:58:24.053288+0000","last_became_peered":"2023-10-09T07:58:24.053288+0000","last_unstale":"2023-10-09T07:58:24.058340+0000","last_undegraded":"2023-10-09T07:58:24.058340+0000","last_fullsized":"2023-10-09T07:58:24.058340+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:40:10.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048032+0000","last_change":"2023-10-09T07:58:24.042197+0000","last_active":"2023-10-09T07:58:24.048032+0000","last_peered":"2023-10-09T07:58:24.048032+0000","last_clean":"2023-10-09T07:58:24.048032+0000","last_became_active":"2023-10-09T07:58:24.041921+0000","last_became_peered":"2023-10-09T07:58:24.041921+0000","last_unstale":"2023-10-09T07:58:24.048032+0000","last_undegraded":"2023-10-09T07:58:24.048032+0000","last_fullsized":"2023-10-09T07:58:24.048032+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:07.075855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.036601+0000","last_change":"2023-10-09T07:58:24.032315+0000","last_active":"2023-10-09T07:58:24.036601+0000","last_peered":"2023-10-09T07:58:24.036601+0000","last_clean":"2023-10-09T07:58:24.036601+0000","last_became_active":"2023-10-09T07:58:24.032042+0000","last_became_peered":"2023-10-09T07:58:24.032042+0000","last_unstale":"2023-10-09T07:58:24.036601+0000","last_undegraded":"2023-10-09T07:58:24.036601+0000","last_fullsized":"2023-10-09T07:58:24.036601+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:05.127890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.057790+0000","last_change":"2023-10-09T07:58:24.051023+0000","last_active":"2023-10-09T07:58:24.057790+0000","last_peered":"2023-10-09T07:58:24.057790+0000","last_clean":"2023-10-09T07:58:24.057790+0000","last_became_active":"2023-10-09T07:58:24.050775+0000","last_became_peered":"2023-10-09T07:58:24.050775+0000","last_unstale":"2023-10-09T07:58:24.057790+0000","last_undegraded":"2023-10-09T07:58:24.057790+0000","last_fullsized":"2023-10-09T07:58:24.057790+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:33.520395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.042910+0000","last_change":"2023-10-09T07:58:24.033278+0000","last_active":"2023-10-09T07:58:24.042910+0000","last_peered":"2023-10-09T07:58:24.042910+0000","last_clean":"2023-10-09T07:58:24.042910+0000","last_became_active":"2023-10-09T07:58:24.032933+0000","last_became_peered":"2023-10-09T07:58:24.032933+0000","last_unstale":"2023-10-09T07:58:24.042910+0000","last_undegraded":"2023-10-09T07:58:24.042910+0000","last_fullsized":"2023-10-09T07:58:24.042910+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:15.479025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.046014+0000","last_change":"2023-10-09T07:58:24.044626+0000","last_active":"2023-10-09T07:58:24.046014+0000","last_peered":"2023-10-09T07:58:24.046014+0000","last_clean":"2023-10-09T07:58:24.046014+0000","last_became_active":"2023-10-09T07:58:24.044362+0000","last_became_peered":"2023-10-09T07:58:24.044362+0000","last_unstale":"2023-10-09T07:58:24.046014+0000","last_undegraded":"2023-10-09T07:58:24.046014+0000","last_fullsized":"2023-10-09T07:58:24.046014+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:33:20.671515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.057772+0000","last_change":"2023-10-09T07:58:24.050055+0000","last_active":"2023-10-09T07:58:24.057772+0000","last_peered":"2023-10-09T07:58:24.057772+0000","last_clean":"2023-10-09T07:58:24.057772+0000","last_became_active":"2023-10-09T07:58:24.049429+0000","last_became_peered":"2023-10-09T07:58:24.049429+0000","last_unstale":"2023-10-09T07:58:24.057772+0000","last_undegraded":"2023-10-09T07:58:24.057772+0000","last_fullsized":"2023-10-09T07:58:24.057772+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:13.577193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048256+0000","last_change":"2023-10-09T07:58:24.041854+0000","last_active":"2023-10-09T07:58:24.048256+0000","last_peered":"2023-10-09T07:58:24.048256+0000","last_clean":"2023-10-09T07:58:24.048256+0000","last_became_active":"2023-10-09T07:58:24.041577+0000","last_became_peered":"2023-10-09T07:58:24.041577+0000","last_unstale":"2023-10-09T07:58:24.048256+0000","last_undegraded":"2023-10-09T07:58:24.048256+0000","last_fullsized":"2023-10-09T07:58:24.048256+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:00:19.369349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048217+0000","last_change":"2023-10-09T07:58:24.042324+0000","last_active":"2023-10-09T07:58:24.048217+0000","last_peered":"2023-10-09T07:58:24.048217+0000","last_clean":"2023-10-09T07:58:24.048217+0000","last_became_active":"2023-10-09T07:58:24.042010+0000","last_became_peered":"2023-10-09T07:58:24.042010+0000","last_unstale":"2023-10-09T07:58:24.048217+0000","last_undegraded":"2023-10-09T07:58:24.048217+0000","last_fullsized":"2023-10-09T07:58:24.048217+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:16.438076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.052659+0000","last_change":"2023-10-09T07:58:24.052200+0000","last_active":"2023-10-09T07:58:24.052659+0000","last_peered":"2023-10-09T07:58:24.052659+0000","last_clean":"2023-10-09T07:58:24.052659+0000","last_became_active":"2023-10-09T07:58:24.051595+0000","last_became_peered":"2023-10-09T07:58:24.051595+0000","last_unstale":"2023-10-09T07:58:24.052659+0000","last_undegraded":"2023-10-09T07:58:24.052659+0000","last_fullsized":"2023-10-09T07:58:24.052659+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:42:21.938720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.045210+0000","last_change":"2023-10-09T07:58:24.042772+0000","last_active":"2023-10-09T07:58:24.045210+0000","last_peered":"2023-10-09T07:58:24.045210+0000","last_clean":"2023-10-09T07:58:24.045210+0000","last_became_active":"2023-10-09T07:58:24.042398+0000","last_became_peered":"2023-10-09T07:58:24.042398+0000","last_unstale":"2023-10-09T07:58:24.045210+0000","last_undegraded":"2023-10-09T07:58:24.045210+0000","last_fullsized":"2023-10-09T07:58:24.045210+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:19.906242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048245+0000","last_change":"2023-10-09T07:58:24.043813+0000","last_active":"2023-10-09T07:58:24.048245+0000","last_peered":"2023-10-09T07:58:24.048245+0000","last_clean":"2023-10-09T07:58:24.048245+0000","last_became_active":"2023-10-09T07:58:24.043558+0000","last_became_peered":"2023-10-09T07:58:24.043558+0000","last_unstale":"2023-10-09T07:58:24.048245+0000","last_undegraded":"2023-10-09T07:58:24.048245+0000","last_fullsized":"2023-10-09T07:58:24.048245+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:36.378974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.043072+0000","last_change":"2023-10-09T07:58:24.037838+0000","last_active":"2023-10-09T07:58:24.043072+0000","last_peered":"2023-10-09T07:58:24.043072+0000","last_clean":"2023-10-09T07:58:24.043072+0000","last_became_active":"2023-10-09T07:58:24.037557+0000","last_became_peered":"2023-10-09T07:58:24.037557+0000","last_unstale":"2023-10-09T07:58:24.043072+0000","last_undegraded":"2023-10-09T07:58:24.043072+0000","last_fullsized":"2023-10-09T07:58:24.043072+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:47:42.494317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048866+0000","last_change":"2023-10-09T07:58:24.045013+0000","last_active":"2023-10-09T07:58:24.048866+0000","last_peered":"2023-10-09T07:58:24.048866+0000","last_clean":"2023-10-09T07:58:24.048866+0000","last_became_active":"2023-10-09T07:58:24.044774+0000","last_became_peered":"2023-10-09T07:58:24.044774+0000","last_unstale":"2023-10-09T07:58:24.048866+0000","last_undegraded":"2023-10-09T07:58:24.048866+0000","last_fullsized":"2023-10-09T07:58:24.048866+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:13:00.102552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.040246+0000","last_change":"2023-10-09T07:58:24.035180+0000","last_active":"2023-10-09T07:58:24.040246+0000","last_peered":"2023-10-09T07:58:24.040246+0000","last_clean":"2023-10-09T07:58:24.040246+0000","last_became_active":"2023-10-09T07:58:24.034916+0000","last_became_peered":"2023-10-09T07:58:24.034916+0000","last_unstale":"2023-10-09T07:58:24.040246+0000","last_undegraded":"2023-10-09T07:58:24.040246+0000","last_fullsized":"2023-10-09T07:58:24.040246+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:12:00.905354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.058229+0000","last_change":"2023-10-09T07:58:24.050300+0000","last_active":"2023-10-09T07:58:24.058229+0000","last_peered":"2023-10-09T07:58:24.058229+0000","last_clean":"2023-10-09T07:58:24.058229+0000","last_became_active":"2023-10-09T07:58:24.049485+0000","last_became_peered":"2023-10-09T07:58:24.049485+0000","last_unstale":"2023-10-09T07:58:24.058229+0000","last_undegraded":"2023-10-09T07:58:24.058229+0000","last_fullsized":"2023-10-09T07:58:24.058229+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:07.411847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"175'4","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.052248+0000","last_change":"2023-10-09T07:58:23.042257+0000","last_active":"2023-10-09T07:58:24.052248+0000","last_peered":"2023-10-09T07:58:24.052248+0000","last_clean":"2023-10-09T07:58:24.052248+0000","last_became_active":"2023-10-09T07:58:23.041987+0000","last_became_peered":"2023-10-09T07:58:23.041987+0000","last_unstale":"2023-10-09T07:58:24.052248+0000","last_undegraded":"2023-10-09T07:58:24.052248+0000","last_fullsized":"2023-10-09T07:58:24.052248+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:53.221593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048916+0000","last_change":"2023-10-09T07:58:24.045206+0000","last_active":"2023-10-09T07:58:24.048916+0000","last_peered":"2023-10-09T07:58:24.048916+0000","last_clean":"2023-10-09T07:58:24.048916+0000","last_became_active":"2023-10-09T07:58:24.043198+0000","last_became_peered":"2023-10-09T07:58:24.043198+0000","last_unstale":"2023-10-09T07:58:24.048916+0000","last_undegraded":"2023-10-09T07:58:24.048916+0000","last_fullsized":"2023-10-09T07:58:24.048916+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:39:01.903400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.054826+0000","last_change":"2023-10-09T07:58:23.039895+0000","last_active":"2023-10-09T07:58:24.054826+0000","last_peered":"2023-10-09T07:58:24.054826+0000","last_clean":"2023-10-09T07:58:24.054826+0000","last_became_active":"2023-10-09T07:58:23.038992+0000","last_became_peered":"2023-10-09T07:58:23.038992+0000","last_unstale":"2023-10-09T07:58:24.054826+0000","last_undegraded":"2023-10-09T07:58:24.054826+0000","last_fullsized":"2023-10-09T07:58:24.054826+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:32:21.536459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.039892+0000","last_change":"2023-10-09T07:58:24.034722+0000","last_active":"2023-10-09T07:58:24.039892+0000","last_peered":"2023-10-09T07:58:24.039892+0000","last_clean":"2023-10-09T07:58:24.039892+0000","last_became_active":"2023-10-09T07:58:24.033015+0000","last_became_peered":"2023-10-09T07:58:24.033015+0000","last_unstale":"2023-10-09T07:58:24.039892+0000","last_undegraded":"2023-10-09T07:58:24.039892+0000","last_fullsized":"2023-10-09T07:58:24.039892+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:48:29.551743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048694+0000","last_change":"2023-10-09T07:58:23.033092+0000","last_active":"2023-10-09T07:58:24.048694+0000","last_peered":"2023-10-09T07:58:24.048694+0000","last_clean":"2023-10-09T07:58:24.048694+0000","last_became_active":"2023-10-09T07:58:23.032754+0000","last_became_peered":"2023-10-09T07:58:23.032754+0000","last_unstale":"2023-10-09T07:58:24.048694+0000","last_undegraded":"2023-10-09T07:58:24.048694+0000","last_fullsized":"2023-10-09T07:58:24.048694+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:12:49.950756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.059763+0000","last_change":"2023-10-09T07:58:24.055486+0000","last_active":"2023-10-09T07:58:24.059763+0000","last_peered":"2023-10-09T07:58:24.059763+0000","last_clean":"2023-10-09T07:58:24.059763+0000","last_became_active":"2023-10-09T07:58:24.055219+0000","last_became_peered":"2023-10-09T07:58:24.055219+0000","last_unstale":"2023-10-09T07:58:24.059763+0000","last_undegraded":"2023-10-09T07:58:24.059763+0000","last_fullsized":"2023-10-09T07:58:24.059763+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:49:35.323023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.050729+0000","last_change":"2023-10-09T07:58:23.033476+0000","last_active":"2023-10-09T07:58:24.050729+0000","last_peered":"2023-10-09T07:58:24.050729+0000","last_clean":"2023-10-09T07:58:24.050729+0000","last_became_active":"2023-10-09T07:58:23.033198+0000","last_became_peered":"2023-10-09T07:58:23.033198+0000","last_unstale":"2023-10-09T07:58:24.050729+0000","last_undegraded":"2023-10-09T07:58:24.050729+0000","last_fullsized":"2023-10-09T07:58:24.050729+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:45:36.724769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048760+0000","last_change":"2023-10-09T07:58:24.043979+0000","last_active":"2023-10-09T07:58:24.048760+0000","last_peered":"2023-10-09T07:58:24.048760+0000","last_clean":"2023-10-09T07:58:24.048760+0000","last_became_active":"2023-10-09T07:58:24.043724+0000","last_became_peered":"2023-10-09T07:58:24.043724+0000","last_unstale":"2023-10-09T07:58:24.048760+0000","last_undegraded":"2023-10-09T07:58:24.048760+0000","last_fullsized":"2023-10-09T07:58:24.048760+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:40.861697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.053251+0000","last_change":"2023-10-09T07:58:23.039908+0000","last_active":"2023-10-09T07:58:24.053251+0000","last_peered":"2023-10-09T07:58:24.053251+0000","last_clean":"2023-10-09T07:58:24.053251+0000","last_became_active":"2023-10-09T07:58:23.039653+0000","last_became_peered":"2023-10-09T07:58:23.039653+0000","last_unstale":"2023-10-09T07:58:24.053251+0000","last_undegraded":"2023-10-09T07:58:24.053251+0000","last_fullsized":"2023-10-09T07:58:24.053251+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:29:27.162187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.047174+0000","last_change":"2023-10-09T07:58:24.045784+0000","last_active":"2023-10-09T07:58:24.047174+0000","last_peered":"2023-10-09T07:58:24.047174+0000","last_clean":"2023-10-09T07:58:24.047174+0000","last_became_active":"2023-10-09T07:58:24.045371+0000","last_became_peered":"2023-10-09T07:58:24.045371+0000","last_unstale":"2023-10-09T07:58:24.047174+0000","last_undegraded":"2023-10-09T07:58:24.047174+0000","last_fullsized":"2023-10-09T07:58:24.047174+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:58.571728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.054515+0000","last_change":"2023-10-09T07:58:23.038953+0000","last_active":"2023-10-09T07:58:24.054515+0000","last_peered":"2023-10-09T07:58:24.054515+0000","last_clean":"2023-10-09T07:58:24.054515+0000","last_became_active":"2023-10-09T07:58:23.038700+0000","last_became_peered":"2023-10-09T07:58:23.038700+0000","last_unstale":"2023-10-09T07:58:24.054515+0000","last_undegraded":"2023-10-09T07:58:24.054515+0000","last_fullsized":"2023-10-09T07:58:24.054515+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:33:19.662502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048564+0000","last_change":"2023-10-09T07:58:24.037599+0000","last_active":"2023-10-09T07:58:24.048564+0000","last_peered":"2023-10-09T07:58:24.048564+0000","last_clean":"2023-10-09T07:58:24.048564+0000","last_became_active":"2023-10-09T07:58:24.037325+0000","last_became_peered":"2023-10-09T07:58:24.037325+0000","last_unstale":"2023-10-09T07:58:24.048564+0000","last_undegraded":"2023-10-09T07:58:24.048564+0000","last_fullsized":"2023-10-09T07:58:24.048564+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:56.795926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.027437+0000","last_change":"2023-10-09T07:58:23.036137+0000","last_active":"2023-10-09T07:58:24.027437+0000","last_peered":"2023-10-09T07:58:24.027437+0000","last_clean":"2023-10-09T07:58:24.027437+0000","last_became_active":"2023-10-09T07:58:23.035828+0000","last_became_peered":"2023-10-09T07:58:23.035828+0000","last_unstale":"2023-10-09T07:58:24.027437+0000","last_undegraded":"2023-10-09T07:58:24.027437+0000","last_fullsized":"2023-10-09T07:58:24.027437+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:30:00.666411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.042463+0000","last_change":"2023-10-09T07:58:24.039373+0000","last_active":"2023-10-09T07:58:24.042463+0000","last_peered":"2023-10-09T07:58:24.042463+0000","last_clean":"2023-10-09T07:58:24.042463+0000","last_became_active":"2023-10-09T07:58:24.039115+0000","last_became_peered":"2023-10-09T07:58:24.039115+0000","last_unstale":"2023-10-09T07:58:24.042463+0000","last_undegraded":"2023-10-09T07:58:24.042463+0000","last_fullsized":"2023-10-09T07:58:24.042463+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:31.820966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.028900+0000","last_change":"2023-10-09T07:58:23.038929+0000","last_active":"2023-10-09T07:58:24.028900+0000","last_peered":"2023-10-09T07:58:24.028900+0000","last_clean":"2023-10-09T07:58:24.028900+0000","last_became_active":"2023-10-09T07:58:23.038646+0000","last_became_peered":"2023-10-09T07:58:23.038646+0000","last_unstale":"2023-10-09T07:58:24.028900+0000","last_undegraded":"2023-10-09T07:58:24.028900+0000","last_fullsized":"2023-10-09T07:58:24.028900+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:41:05.997398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.041472+0000","last_change":"2023-10-09T07:58:24.038374+0000","last_active":"2023-10-09T07:58:24.041472+0000","last_peered":"2023-10-09T07:58:24.041472+0000","last_clean":"2023-10-09T07:58:24.041472+0000","last_became_active":"2023-10-09T07:58:24.037501+0000","last_became_peered":"2023-10-09T07:58:24.037501+0000","last_unstale":"2023-10-09T07:58:24.041472+0000","last_undegraded":"2023-10-09T07:58:24.041472+0000","last_fullsized":"2023-10-09T07:58:24.041472+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:07.075855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.030220+0000","last_change":"2023-10-09T07:58:23.034362+0000","last_active":"2023-10-09T07:58:24.030220+0000","last_peered":"2023-10-09T07:58:24.030220+0000","last_clean":"2023-10-09T07:58:24.030220+0000","last_became_active":"2023-10-09T07:58:23.034092+0000","last_became_peered":"2023-10-09T07:58:23.034092+0000","last_unstale":"2023-10-09T07:58:24.030220+0000","last_undegraded":"2023-10-09T07:58:24.030220+0000","last_fullsized":"2023-10-09T07:58:24.030220+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:03.122620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.059673+0000","last_change":"2023-10-09T07:58:24.052110+0000","last_active":"2023-10-09T07:58:24.059673+0000","last_peered":"2023-10-09T07:58:24.059673+0000","last_clean":"2023-10-09T07:58:24.059673+0000","last_became_active":"2023-10-09T07:58:24.051322+0000","last_became_peered":"2023-10-09T07:58:24.051322+0000","last_unstale":"2023-10-09T07:58:24.059673+0000","last_undegraded":"2023-10-09T07:58:24.059673+0000","last_fullsized":"2023-10-09T07:58:24.059673+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:36:00.365335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.032678+0000","last_change":"2023-10-09T07:58:23.041150+0000","last_active":"2023-10-09T07:58:24.032678+0000","last_peered":"2023-10-09T07:58:24.032678+0000","last_clean":"2023-10-09T07:58:24.032678+0000","last_became_active":"2023-10-09T07:58:23.040730+0000","last_became_peered":"2023-10-09T07:58:23.040730+0000","last_unstale":"2023-10-09T07:58:24.032678+0000","last_undegraded":"2023-10-09T07:58:24.032678+0000","last_fullsized":"2023-10-09T07:58:24.032678+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:21.744931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.042455+0000","last_change":"2023-10-09T07:58:24.038556+0000","last_active":"2023-10-09T07:58:24.042455+0000","last_peered":"2023-10-09T07:58:24.042455+0000","last_clean":"2023-10-09T07:58:24.042455+0000","last_became_active":"2023-10-09T07:58:24.038266+0000","last_became_peered":"2023-10-09T07:58:24.038266+0000","last_unstale":"2023-10-09T07:58:24.042455+0000","last_undegraded":"2023-10-09T07:58:24.042455+0000","last_fullsized":"2023-10-09T07:58:24.042455+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:20.483964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"175'6","reported_seq":16,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.056822+0000","last_change":"2023-10-09T07:58:23.032317+0000","last_active":"2023-10-09T07:58:24.056822+0000","last_peered":"2023-10-09T07:58:24.056822+0000","last_clean":"2023-10-09T07:58:24.056822+0000","last_became_active":"2023-10-09T07:58:23.032034+0000","last_became_peered":"2023-10-09T07:58:23.032034+0000","last_unstale":"2023-10-09T07:58:24.056822+0000","last_undegraded":"2023-10-09T07:58:24.056822+0000","last_fullsized":"2023-10-09T07:58:24.056822+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:01:27.509478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.052341+0000","last_change":"2023-10-09T07:58:24.049017+0000","last_active":"2023-10-09T07:58:24.052341+0000","last_peered":"2023-10-09T07:58:24.052341+0000","last_clean":"2023-10-09T07:58:24.052341+0000","last_became_active":"2023-10-09T07:58:24.048756+0000","last_became_peered":"2023-10-09T07:58:24.048756+0000","last_unstale":"2023-10-09T07:58:24.052341+0000","last_undegraded":"2023-10-09T07:58:24.052341+0000","last_fullsized":"2023-10-09T07:58:24.052341+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:40.222840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.059279+0000","last_change":"2023-10-09T07:58:23.041487+0000","last_active":"2023-10-09T07:58:24.059279+0000","last_peered":"2023-10-09T07:58:24.059279+0000","last_clean":"2023-10-09T07:58:24.059279+0000","last_became_active":"2023-10-09T07:58:23.040053+0000","last_became_peered":"2023-10-09T07:58:23.040053+0000","last_unstale":"2023-10-09T07:58:24.059279+0000","last_undegraded":"2023-10-09T07:58:24.059279+0000","last_fullsized":"2023-10-09T07:58:24.059279+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:45.601522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048659+0000","last_change":"2023-10-09T07:58:24.042838+0000","last_active":"2023-10-09T07:58:24.048659+0000","last_peered":"2023-10-09T07:58:24.048659+0000","last_clean":"2023-10-09T07:58:24.048659+0000","last_became_active":"2023-10-09T07:58:24.042573+0000","last_became_peered":"2023-10-09T07:58:24.042573+0000","last_unstale":"2023-10-09T07:58:24.048659+0000","last_undegraded":"2023-10-09T07:58:24.048659+0000","last_fullsized":"2023-10-09T07:58:24.048659+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:41:03.367914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.034055+0000","last_change":"2023-10-09T07:58:23.038603+0000","last_active":"2023-10-09T07:58:24.034055+0000","last_peered":"2023-10-09T07:58:24.034055+0000","last_clean":"2023-10-09T07:58:24.034055+0000","last_became_active":"2023-10-09T07:58:23.038346+0000","last_became_peered":"2023-10-09T07:58:23.038346+0000","last_unstale":"2023-10-09T07:58:24.034055+0000","last_undegraded":"2023-10-09T07:58:24.034055+0000","last_fullsized":"2023-10-09T07:58:24.034055+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:03.122620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.056928+0000","last_change":"2023-10-09T07:58:24.053339+0000","last_active":"2023-10-09T07:58:24.056928+0000","last_peered":"2023-10-09T07:58:24.056928+0000","last_clean":"2023-10-09T07:58:24.056928+0000","last_became_active":"2023-10-09T07:58:24.053023+0000","last_became_peered":"2023-10-09T07:58:24.053023+0000","last_unstale":"2023-10-09T07:58:24.056928+0000","last_undegraded":"2023-10-09T07:58:24.056928+0000","last_fullsized":"2023-10-09T07:58:24.056928+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:43:10.524882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.025872+0000","last_change":"2023-10-09T07:58:23.027831+0000","last_active":"2023-10-09T07:58:24.025872+0000","last_peered":"2023-10-09T07:58:24.025872+0000","last_clean":"2023-10-09T07:58:24.025872+0000","last_became_active":"2023-10-09T07:58:23.027573+0000","last_became_peered":"2023-10-09T07:58:23.027573+0000","last_unstale":"2023-10-09T07:58:24.025872+0000","last_undegraded":"2023-10-09T07:58:24.025872+0000","last_fullsized":"2023-10-09T07:58:24.025872+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:30.137019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.054070+0000","last_change":"2023-10-09T07:58:24.051875+0000","last_active":"2023-10-09T07:58:24.054070+0000","last_peered":"2023-10-09T07:58:24.054070+0000","last_clean":"2023-10-09T07:58:24.054070+0000","last_became_active":"2023-10-09T07:58:24.051460+0000","last_became_peered":"2023-10-09T07:58:24.051460+0000","last_unstale":"2023-10-09T07:58:24.054070+0000","last_undegraded":"2023-10-09T07:58:24.054070+0000","last_fullsized":"2023-10-09T07:58:24.054070+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:39:01.903400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"175'8","reported_seq":18,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.055611+0000","last_change":"2023-10-09T07:58:23.041105+0000","last_active":"2023-10-09T07:58:24.055611+0000","last_peered":"2023-10-09T07:58:24.055611+0000","last_clean":"2023-10-09T07:58:24.055611+0000","last_became_active":"2023-10-09T07:58:23.040899+0000","last_became_peered":"2023-10-09T07:58:23.040899+0000","last_unstale":"2023-10-09T07:58:24.055611+0000","last_undegraded":"2023-10-09T07:58:24.055611+0000","last_fullsized":"2023-10-09T07:58:24.055611+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:08:51.278424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.059030+0000","last_change":"2023-10-09T07:58:24.050364+0000","last_active":"2023-10-09T07:58:24.059030+0000","last_peered":"2023-10-09T07:58:24.059030+0000","last_clean":"2023-10-09T07:58:24.059030+0000","last_became_active":"2023-10-09T07:58:24.050015+0000","last_became_peered":"2023-10-09T07:58:24.050015+0000","last_unstale":"2023-10-09T07:58:24.059030+0000","last_undegraded":"2023-10-09T07:58:24.059030+0000","last_fullsized":"2023-10-09T07:58:24.059030+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:42:47.664106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048844+0000","last_change":"2023-10-09T07:58:23.037143+0000","last_active":"2023-10-09T07:58:24.048844+0000","last_peered":"2023-10-09T07:58:24.048844+0000","last_clean":"2023-10-09T07:58:24.048844+0000","last_became_active":"2023-10-09T07:58:23.036812+0000","last_became_peered":"2023-10-09T07:58:23.036812+0000","last_unstale":"2023-10-09T07:58:24.048844+0000","last_undegraded":"2023-10-09T07:58:24.048844+0000","last_fullsized":"2023-10-09T07:58:24.048844+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:40:38.871261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.055105+0000","last_change":"2023-10-09T07:58:24.053157+0000","last_active":"2023-10-09T07:58:24.055105+0000","last_peered":"2023-10-09T07:58:24.055105+0000","last_clean":"2023-10-09T07:58:24.055105+0000","last_became_active":"2023-10-09T07:58:24.052868+0000","last_became_peered":"2023-10-09T07:58:24.052868+0000","last_unstale":"2023-10-09T07:58:24.055105+0000","last_undegraded":"2023-10-09T07:58:24.055105+0000","last_fullsized":"2023-10-09T07:58:24.055105+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:41.116662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048825+0000","last_change":"2023-10-09T07:58:23.038559+0000","last_active":"2023-10-09T07:58:24.048825+0000","last_peered":"2023-10-09T07:58:24.048825+0000","last_clean":"2023-10-09T07:58:24.048825+0000","last_became_active":"2023-10-09T07:58:23.037968+0000","last_became_peered":"2023-10-09T07:58:23.037968+0000","last_unstale":"2023-10-09T07:58:24.048825+0000","last_undegraded":"2023-10-09T07:58:24.048825+0000","last_fullsized":"2023-10-09T07:58:24.048825+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:22.952454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.050837+0000","last_change":"2023-10-09T07:58:24.046156+0000","last_active":"2023-10-09T07:58:24.050837+0000","last_peered":"2023-10-09T07:58:24.050837+0000","last_clean":"2023-10-09T07:58:24.050837+0000","last_became_active":"2023-10-09T07:58:24.045897+0000","last_became_peered":"2023-10-09T07:58:24.045897+0000","last_unstale":"2023-10-09T07:58:24.050837+0000","last_undegraded":"2023-10-09T07:58:24.050837+0000","last_fullsized":"2023-10-09T07:58:24.050837+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:41:03.367914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.052803+0000","last_change":"2023-10-09T07:58:23.040353+0000","last_active":"2023-10-09T07:58:24.052803+0000","last_peered":"2023-10-09T07:58:24.052803+0000","last_clean":"2023-10-09T07:58:24.052803+0000","last_became_active":"2023-10-09T07:58:23.039961+0000","last_became_peered":"2023-10-09T07:58:23.039961+0000","last_unstale":"2023-10-09T07:58:24.052803+0000","last_undegraded":"2023-10-09T07:58:24.052803+0000","last_fullsized":"2023-10-09T07:58:24.052803+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:59.029087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.049602+0000","last_change":"2023-10-09T07:58:24.047359+0000","last_active":"2023-10-09T07:58:24.049602+0000","last_peered":"2023-10-09T07:58:24.049602+0000","last_clean":"2023-10-09T07:58:24.049602+0000","last_became_active":"2023-10-09T07:58:24.047026+0000","last_became_peered":"2023-10-09T07:58:24.047026+0000","last_unstale":"2023-10-09T07:58:24.049602+0000","last_undegraded":"2023-10-09T07:58:24.049602+0000","last_fullsized":"2023-10-09T07:58:24.049602+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:18.603205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.029490+0000","last_change":"2023-10-09T07:58:23.037621+0000","last_active":"2023-10-09T07:58:24.029490+0000","last_peered":"2023-10-09T07:58:24.029490+0000","last_clean":"2023-10-09T07:58:24.029490+0000","last_became_active":"2023-10-09T07:58:23.033543+0000","last_became_peered":"2023-10-09T07:58:23.033543+0000","last_unstale":"2023-10-09T07:58:24.029490+0000","last_undegraded":"2023-10-09T07:58:24.029490+0000","last_fullsized":"2023-10-09T07:58:24.029490+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:45.601522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.042939+0000","last_change":"2023-10-09T07:58:24.037237+0000","last_active":"2023-10-09T07:58:24.042939+0000","last_peered":"2023-10-09T07:58:24.042939+0000","last_clean":"2023-10-09T07:58:24.042939+0000","last_became_active":"2023-10-09T07:58:24.035826+0000","last_became_peered":"2023-10-09T07:58:24.035826+0000","last_unstale":"2023-10-09T07:58:24.042939+0000","last_undegraded":"2023-10-09T07:58:24.042939+0000","last_fullsized":"2023-10-09T07:58:24.042939+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:24:38.808909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.059199+0000","last_change":"2023-10-09T07:58:23.037844+0000","last_active":"2023-10-09T07:58:24.059199+0000","last_peered":"2023-10-09T07:58:24.059199+0000","last_clean":"2023-10-09T07:58:24.059199+0000","last_became_active":"2023-10-09T07:58:23.037598+0000","last_became_peered":"2023-10-09T07:58:23.037598+0000","last_unstale":"2023-10-09T07:58:24.059199+0000","last_undegraded":"2023-10-09T07:58:24.059199+0000","last_fullsized":"2023-10-09T07:58:24.059199+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:12.869232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037253+0000","last_change":"2023-10-09T07:58:24.033828+0000","last_active":"2023-10-09T07:58:24.037253+0000","last_peered":"2023-10-09T07:58:24.037253+0000","last_clean":"2023-10-09T07:58:24.037253+0000","last_became_active":"2023-10-09T07:58:24.033580+0000","last_became_peered":"2023-10-09T07:58:24.033580+0000","last_unstale":"2023-10-09T07:58:24.037253+0000","last_undegraded":"2023-10-09T07:58:24.037253+0000","last_fullsized":"2023-10-09T07:58:24.037253+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:27:48.279381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.031315+0000","last_change":"2023-10-09T07:58:23.044812+0000","last_active":"2023-10-09T07:58:24.031315+0000","last_peered":"2023-10-09T07:58:24.031315+0000","last_clean":"2023-10-09T07:58:24.031315+0000","last_became_active":"2023-10-09T07:58:23.044164+0000","last_became_peered":"2023-10-09T07:58:23.044164+0000","last_unstale":"2023-10-09T07:58:24.031315+0000","last_undegraded":"2023-10-09T07:58:24.031315+0000","last_fullsized":"2023-10-09T07:58:24.031315+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:36:16.840269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.045906+0000","last_change":"2023-10-09T07:58:24.044914+0000","last_active":"2023-10-09T07:58:24.045906+0000","last_peered":"2023-10-09T07:58:24.045906+0000","last_clean":"2023-10-09T07:58:24.045906+0000","last_became_active":"2023-10-09T07:58:24.043943+0000","last_became_peered":"2023-10-09T07:58:24.043943+0000","last_unstale":"2023-10-09T07:58:24.045906+0000","last_undegraded":"2023-10-09T07:58:24.045906+0000","last_fullsized":"2023-10-09T07:58:24.045906+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:40:39.880274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.034885+0000","last_change":"2023-10-09T07:58:23.041438+0000","last_active":"2023-10-09T07:58:24.034885+0000","last_peered":"2023-10-09T07:58:24.034885+0000","last_clean":"2023-10-09T07:58:24.034885+0000","last_became_active":"2023-10-09T07:58:23.041150+0000","last_became_peered":"2023-10-09T07:58:23.041150+0000","last_unstale":"2023-10-09T07:58:24.034885+0000","last_undegraded":"2023-10-09T07:58:24.034885+0000","last_fullsized":"2023-10-09T07:58:24.034885+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:21:04.355067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037265+0000","last_change":"2023-10-09T07:58:24.034230+0000","last_active":"2023-10-09T07:58:24.037265+0000","last_peered":"2023-10-09T07:58:24.037265+0000","last_clean":"2023-10-09T07:58:24.037265+0000","last_became_active":"2023-10-09T07:58:24.033758+0000","last_became_peered":"2023-10-09T07:58:24.033758+0000","last_unstale":"2023-10-09T07:58:24.037265+0000","last_undegraded":"2023-10-09T07:58:24.037265+0000","last_fullsized":"2023-10-09T07:58:24.037265+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:10:36.736260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.034817+0000","last_change":"2023-10-09T07:58:23.036069+0000","last_active":"2023-10-09T07:58:24.034817+0000","last_peered":"2023-10-09T07:58:24.034817+0000","last_clean":"2023-10-09T07:58:24.034817+0000","last_became_active":"2023-10-09T07:58:23.035817+0000","last_became_peered":"2023-10-09T07:58:23.035817+0000","last_unstale":"2023-10-09T07:58:24.034817+0000","last_undegraded":"2023-10-09T07:58:24.034817+0000","last_fullsized":"2023-10-09T07:58:24.034817+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:22.952454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.056958+0000","last_change":"2023-10-09T07:58:24.053951+0000","last_active":"2023-10-09T07:58:24.056958+0000","last_peered":"2023-10-09T07:58:24.056958+0000","last_clean":"2023-10-09T07:58:24.056958+0000","last_became_active":"2023-10-09T07:58:24.053707+0000","last_became_peered":"2023-10-09T07:58:24.053707+0000","last_unstale":"2023-10-09T07:58:24.056958+0000","last_undegraded":"2023-10-09T07:58:24.056958+0000","last_fullsized":"2023-10-09T07:58:24.056958+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:55.345084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.053699+0000","last_change":"2023-10-09T07:58:23.042969+0000","last_active":"2023-10-09T07:58:24.053699+0000","last_peered":"2023-10-09T07:58:24.053699+0000","last_clean":"2023-10-09T07:58:24.053699+0000","last_became_active":"2023-10-09T07:58:23.042710+0000","last_became_peered":"2023-10-09T07:58:23.042710+0000","last_unstale":"2023-10-09T07:58:24.053699+0000","last_undegraded":"2023-10-09T07:58:24.053699+0000","last_fullsized":"2023-10-09T07:58:24.053699+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:12:59.093538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.050926+0000","last_change":"2023-10-09T07:58:24.046834+0000","last_active":"2023-10-09T07:58:24.050926+0000","last_peered":"2023-10-09T07:58:24.050926+0000","last_clean":"2023-10-09T07:58:24.050926+0000","last_became_active":"2023-10-09T07:58:24.046543+0000","last_became_peered":"2023-10-09T07:58:24.046543+0000","last_unstale":"2023-10-09T07:58:24.050926+0000","last_undegraded":"2023-10-09T07:58:24.050926+0000","last_fullsized":"2023-10-09T07:58:24.050926+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:11:57.967753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.025916+0000","last_change":"2023-10-09T07:58:23.039543+0000","last_active":"2023-10-09T07:58:24.025916+0000","last_peered":"2023-10-09T07:58:24.025916+0000","last_clean":"2023-10-09T07:58:24.025916+0000","last_became_active":"2023-10-09T07:58:23.039245+0000","last_became_peered":"2023-10-09T07:58:23.039245+0000","last_unstale":"2023-10-09T07:58:24.025916+0000","last_undegraded":"2023-10-09T07:58:24.025916+0000","last_fullsized":"2023-10-09T07:58:24.025916+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:04.616687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048679+0000","last_change":"2023-10-09T07:58:24.040483+0000","last_active":"2023-10-09T07:58:24.048679+0000","last_peered":"2023-10-09T07:58:24.048679+0000","last_clean":"2023-10-09T07:58:24.048679+0000","last_became_active":"2023-10-09T07:58:24.040215+0000","last_became_peered":"2023-10-09T07:58:24.040215+0000","last_unstale":"2023-10-09T07:58:24.048679+0000","last_undegraded":"2023-10-09T07:58:24.048679+0000","last_fullsized":"2023-10-09T07:58:24.048679+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:06:09.038401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.026095+0000","last_change":"2023-10-09T07:58:23.033638+0000","last_active":"2023-10-09T07:58:24.026095+0000","last_peered":"2023-10-09T07:58:24.026095+0000","last_clean":"2023-10-09T07:58:24.026095+0000","last_became_active":"2023-10-09T07:58:23.033359+0000","last_became_peered":"2023-10-09T07:58:23.033359+0000","last_unstale":"2023-10-09T07:58:24.026095+0000","last_undegraded":"2023-10-09T07:58:24.026095+0000","last_fullsized":"2023-10-09T07:58:24.026095+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:21:06.621088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037576+0000","last_change":"2023-10-09T07:58:24.033310+0000","last_active":"2023-10-09T07:58:24.037576+0000","last_peered":"2023-10-09T07:58:24.037576+0000","last_clean":"2023-10-09T07:58:24.037576+0000","last_became_active":"2023-10-09T07:58:24.033044+0000","last_became_peered":"2023-10-09T07:58:24.033044+0000","last_unstale":"2023-10-09T07:58:24.037576+0000","last_undegraded":"2023-10-09T07:58:24.037576+0000","last_fullsized":"2023-10-09T07:58:24.037576+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:30.145065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.025758+0000","last_change":"2023-10-09T07:58:23.034259+0000","last_active":"2023-10-09T07:58:24.025758+0000","last_peered":"2023-10-09T07:58:24.025758+0000","last_clean":"2023-10-09T07:58:24.025758+0000","last_became_active":"2023-10-09T07:58:23.033993+0000","last_became_peered":"2023-10-09T07:58:23.033993+0000","last_unstale":"2023-10-09T07:58:24.025758+0000","last_undegraded":"2023-10-09T07:58:24.025758+0000","last_fullsized":"2023-10-09T07:58:24.025758+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:36.449503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.040603+0000","last_change":"2023-10-09T07:58:24.034496+0000","last_active":"2023-10-09T07:58:24.040603+0000","last_peered":"2023-10-09T07:58:24.040603+0000","last_clean":"2023-10-09T07:58:24.040603+0000","last_became_active":"2023-10-09T07:58:24.034246+0000","last_became_peered":"2023-10-09T07:58:24.034246+0000","last_unstale":"2023-10-09T07:58:24.040603+0000","last_undegraded":"2023-10-09T07:58:24.040603+0000","last_fullsized":"2023-10-09T07:58:24.040603+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:09.684425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.022165+0000","last_change":"2023-10-09T07:58:23.035059+0000","last_active":"2023-10-09T07:58:24.022165+0000","last_peered":"2023-10-09T07:58:24.022165+0000","last_clean":"2023-10-09T07:58:24.022165+0000","last_became_active":"2023-10-09T07:58:23.034777+0000","last_became_peered":"2023-10-09T07:58:23.034777+0000","last_unstale":"2023-10-09T07:58:24.022165+0000","last_undegraded":"2023-10-09T07:58:24.022165+0000","last_fullsized":"2023-10-09T07:58:24.022165+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:35:59.356322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.043809+0000","last_change":"2023-10-09T07:58:24.042813+0000","last_active":"2023-10-09T07:58:24.043809+0000","last_peered":"2023-10-09T07:58:24.043809+0000","last_clean":"2023-10-09T07:58:24.043809+0000","last_became_active":"2023-10-09T07:58:24.042502+0000","last_became_peered":"2023-10-09T07:58:24.042502+0000","last_unstale":"2023-10-09T07:58:24.043809+0000","last_undegraded":"2023-10-09T07:58:24.043809+0000","last_fullsized":"2023-10-09T07:58:24.043809+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:34.959485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.031420+0000","last_change":"2023-10-09T07:58:23.043658+0000","last_active":"2023-10-09T07:58:24.031420+0000","last_peered":"2023-10-09T07:58:24.031420+0000","last_clean":"2023-10-09T07:58:24.031420+0000","last_became_active":"2023-10-09T07:58:23.043362+0000","last_became_peered":"2023-10-09T07:58:23.043362+0000","last_unstale":"2023-10-09T07:58:24.031420+0000","last_undegraded":"2023-10-09T07:58:24.031420+0000","last_fullsized":"2023-10-09T07:58:24.031420+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:39.852684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.059701+0000","last_change":"2023-10-09T07:58:24.053423+0000","last_active":"2023-10-09T07:58:24.059701+0000","last_peered":"2023-10-09T07:58:24.059701+0000","last_clean":"2023-10-09T07:58:24.059701+0000","last_became_active":"2023-10-09T07:58:24.052193+0000","last_became_peered":"2023-10-09T07:58:24.052193+0000","last_unstale":"2023-10-09T07:58:24.059701+0000","last_undegraded":"2023-10-09T07:58:24.059701+0000","last_fullsized":"2023-10-09T07:58:24.059701+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:50.645139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.031980+0000","last_change":"2023-10-09T07:58:23.041395+0000","last_active":"2023-10-09T07:58:24.031980+0000","last_peered":"2023-10-09T07:58:24.031980+0000","last_clean":"2023-10-09T07:58:24.031980+0000","last_became_active":"2023-10-09T07:58:23.040979+0000","last_became_peered":"2023-10-09T07:58:23.040979+0000","last_unstale":"2023-10-09T07:58:24.031980+0000","last_undegraded":"2023-10-09T07:58:24.031980+0000","last_fullsized":"2023-10-09T07:58:24.031980+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:56:38.332397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.035496+0000","last_change":"2023-10-09T07:58:24.034044+0000","last_active":"2023-10-09T07:58:24.035496+0000","last_peered":"2023-10-09T07:58:24.035496+0000","last_clean":"2023-10-09T07:58:24.035496+0000","last_became_active":"2023-10-09T07:58:24.033780+0000","last_became_peered":"2023-10-09T07:58:24.033780+0000","last_unstale":"2023-10-09T07:58:24.035496+0000","last_undegraded":"2023-10-09T07:58:24.035496+0000","last_fullsized":"2023-10-09T07:58:24.035496+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:48:29.551743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.030115+0000","last_change":"2023-10-09T07:58:23.041367+0000","last_active":"2023-10-09T07:58:24.030115+0000","last_peered":"2023-10-09T07:58:24.030115+0000","last_clean":"2023-10-09T07:58:24.030115+0000","last_became_active":"2023-10-09T07:58:23.041097+0000","last_became_peered":"2023-10-09T07:58:23.041097+0000","last_unstale":"2023-10-09T07:58:24.030115+0000","last_undegraded":"2023-10-09T07:58:24.030115+0000","last_fullsized":"2023-10-09T07:58:24.030115+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:44:28.217137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037217+0000","last_change":"2023-10-09T07:58:24.033312+0000","last_active":"2023-10-09T07:58:24.037217+0000","last_peered":"2023-10-09T07:58:24.037217+0000","last_clean":"2023-10-09T07:58:24.037217+0000","last_became_active":"2023-10-09T07:58:24.033036+0000","last_became_peered":"2023-10-09T07:58:24.033036+0000","last_unstale":"2023-10-09T07:58:24.037217+0000","last_undegraded":"2023-10-09T07:58:24.037217+0000","last_fullsized":"2023-10-09T07:58:24.037217+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:42.710219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"175'3","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.060642+0000","last_change":"2023-10-09T07:58:23.037183+0000","last_active":"2023-10-09T07:58:24.060642+0000","last_peered":"2023-10-09T07:58:24.060642+0000","last_clean":"2023-10-09T07:58:24.060642+0000","last_became_active":"2023-10-09T07:58:23.036838+0000","last_became_peered":"2023-10-09T07:58:23.036838+0000","last_unstale":"2023-10-09T07:58:24.060642+0000","last_undegraded":"2023-10-09T07:58:24.060642+0000","last_fullsized":"2023-10-09T07:58:24.060642+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:44:28.217137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"166'293","reported_seq":920,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.031991+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T07:58:24.031991+0000","last_peered":"2023-10-09T07:58:24.031991+0000","last_clean":"2023-10-09T07:58:24.031991+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T07:58:24.031991+0000","last_undegraded":"2023-10-09T07:58:24.031991+0000","last_fullsized":"2023-10-09T07:58:24.031991+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575751,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308212,"kb_used_data":2732,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063628,"statfs":{"total":96636764160,"available":96321155072,"internally_reserved":0,"allocated":2797568,"data_stored":1688396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.72799999999999998,"15min":0.752},"min":{"1min":0.45300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.127},"last":0.88},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.749,"15min":0.76400000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.47399999999999998},"max":{"1min":0.98099999999999998,"5min":1.026,"15min":1.1319999999999999},"last":0.60399999999999998}]},{"osd":1,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.71899999999999997,"15min":0.73399999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.875,"5min":0.96599999999999997,"15min":1.077},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.751},"min":{"1min":0.50900000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92200000000000004,"5min":0.997,"15min":1.038},"last":0.81899999999999995}]},{"osd":2,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.96399999999999997,"5min":0.98999999999999999,"15min":1.0269999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.52800000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91500000000000004,"5min":0.98299999999999998,"15min":1.1899999999999999},"last":0.75600000000000001}]},{"osd":3,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.72199999999999998,"15min":0.73599999999999999},"min":{"1min":0.499,"5min":0.49399999999999999,"15min":0.42099999999999999},"max":{"1min":0.88900000000000001,"5min":0.995,"15min":1.04},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77600000000000002,"15min":0.79200000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.036,"5min":1.0529999999999999,"15min":1.0920000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63800000000000001,"15min":0.626},"min":{"1min":0.47599999999999998,"5min":0.42199999999999999,"15min":0.36299999999999999},"max":{"1min":0.94099999999999995,"5min":0.97099999999999997,"15min":1.248},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.93700000000000006,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.92700000000000005}]},{"osd":5,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63900000000000001,"15min":0.65400000000000003},"min":{"1min":0.41399999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68799999999999994,"15min":0.69699999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.304},"last":0.94299999999999995}]},{"osd":6,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73899999999999999,"15min":0.75},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.405},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71099999999999997,"15min":0.71899999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.43099999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.377},"last":0.86299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575750,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311732,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060108,"statfs":{"total":96636764160,"available":96317550592,"internally_reserved":0,"allocated":2207744,"data_stored":1097550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.33600000000000002},"max":{"1min":0.93600000000000005,"5min":0.98399999999999999,"15min":1.012},"last":0.876},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.75600000000000001,"15min":0.75},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84899999999999998,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.64900000000000002}]},{"osd":1,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76800000000000002,"15min":0.76900000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1100000000000001,"5min":1.113,"15min":1.2769999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.78700000000000003,"15min":0.76700000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.02,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.78800000000000003}]},{"osd":2,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.76000000000000001},"min":{"1min":0.55400000000000005,"5min":0.46100000000000002,"15min":0.432},"max":{"1min":1.0369999999999999,"5min":1.0589999999999999,"15min":1.075},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79200000000000004,"15min":0.77700000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.86499999999999999,"5min":1.151,"15min":1.151},"last":0.92400000000000004}]},{"osd":3,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76300000000000001,"15min":0.755},"min":{"1min":0.52700000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95299999999999996,"5min":1.423,"15min":1.423},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80200000000000005,"15min":0.78500000000000003},"min":{"1min":0.59699999999999998,"5min":0.55500000000000005,"15min":0.54100000000000004},"max":{"1min":1.0800000000000001,"5min":1.335,"15min":1.335},"last":0.69699999999999995}]},{"osd":4,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.36199999999999999},"max":{"1min":0.89800000000000002,"5min":0.97399999999999998,"15min":1.0960000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65900000000000003,"15min":0.65300000000000002},"min":{"1min":0.45500000000000002,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.91500000000000004,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.61099999999999999}]},{"osd":5,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.52400000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.137,"5min":1.306,"15min":1.306},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.48199999999999998,"5min":0.45400000000000001,"15min":0.42699999999999999},"max":{"1min":0.96599999999999997,"5min":1.054,"15min":1.085},"last":0.90100000000000002}]},{"osd":7,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69799999999999995,"15min":0.69199999999999995},"min":{"1min":0.51700000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.96799999999999997,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.74099999999999999,"15min":0.73799999999999999},"min":{"1min":0.498,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1639999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.88800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575751,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303532,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068308,"statfs":{"total":96636764160,"available":96325947392,"internally_reserved":0,"allocated":2199552,"data_stored":1097958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48499999999999999,"15min":0.46800000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.308},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.52400000000000002,"15min":0.50700000000000001},"min":{"1min":0.37,"5min":0.33500000000000002,"15min":0.313},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.37}]},{"osd":2,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.54800000000000004,"15min":0.51700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32900000000000001},"max":{"1min":5.1159999999999997,"5min":5.1159999999999997,"15min":5.1159999999999997},"last":0.436},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.63600000000000001,"15min":0.59599999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.375},"max":{"1min":5.399,"5min":5.399,"15min":5.399},"last":0.40000000000000002}]},{"osd":3,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.63900000000000001,"15min":0.63600000000000001},"min":{"1min":0.42999999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.41699999999999998,"5min":0.39900000000000002,"15min":0.37},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.49299999999999999}]},{"osd":4,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.83899999999999997,"15min":0.80800000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.42699999999999999},"max":{"1min":5.2409999999999997,"5min":5.2409999999999997,"15min":5.2409999999999997},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.86599999999999999,"15min":0.82699999999999996},"min":{"1min":0.65700000000000003,"5min":0.622,"15min":0.56699999999999995},"max":{"1min":5.4409999999999998,"5min":5.4409999999999998,"15min":5.4409999999999998},"last":0.626}]},{"osd":5,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.81499999999999995,"15min":0.81100000000000005},"min":{"1min":0.64000000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.85499999999999998,"15min":0.82499999999999996},"min":{"1min":0.60299999999999998,"5min":0.57999999999999996,"15min":0.442},"max":{"1min":5.1630000000000003,"5min":5.1630000000000003,"15min":5.1630000000000003},"last":0.61699999999999999}]},{"osd":6,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.89300000000000002,"15min":0.84499999999999997},"min":{"1min":0.65300000000000002,"5min":0.63900000000000001,"15min":0.55100000000000005},"max":{"1min":5.4749999999999996,"5min":5.4749999999999996,"15min":5.4749999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83499999999999996,"15min":0.82999999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Mon Oct 9 07:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.56000000000000005},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.081,"5min":0.92800000000000005,"15min":0.88500000000000001},"min":{"1min":0.66500000000000004,"5min":0.63,"15min":0.55300000000000005},"max":{"1min":5.2009999999999996,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":0.79000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575750,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308220,"kb_used_data":2740,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063620,"statfs":{"total":96636764160,"available":96321146880,"internally_reserved":0,"allocated":2805760,"data_stored":1689342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.48699999999999999,"15min":0.47499999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.52800000000000002,"5min":0.72099999999999997,"15min":0.80100000000000005},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53100000000000003,"15min":0.54500000000000004},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.32000000000000001},"max":{"1min":0.71099999999999997,"5min":0.82999999999999996,"15min":0.88200000000000001},"last":0.47599999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56200000000000006,"15min":0.56499999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77800000000000002,"5min":0.83499999999999996,"15min":0.91800000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.60499999999999998,"5min":0.70599999999999996,"15min":0.82399999999999995},"last":0.51200000000000001}]},{"osd":3,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67900000000000005,"5min":0.78400000000000003,"15min":0.98599999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.74299999999999999,"5min":0.89600000000000002,"15min":0.94699999999999995},"last":0.52600000000000002}]},{"osd":4,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.52200000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.532},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81299999999999994,"15min":0.81999999999999995},"min":{"1min":0.626,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.202,"5min":1.202,"15min":1.2470000000000001},"last":0.79200000000000004}]},{"osd":5,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79800000000000004,"15min":0.79900000000000004},"min":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.01,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.80600000000000005,"15min":0.81299999999999994},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.55500000000000005},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.3009999999999999},"last":0.85699999999999998}]},{"osd":6,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.84099999999999997,"15min":0.83799999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0860000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81599999999999995,"15min":0.81999999999999995},"min":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.51400000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.3859999999999999},"last":0.82399999999999995}]},{"osd":7,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.84099999999999997,"15min":0.85399999999999998},"min":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3380000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.877,"15min":0.86799999999999999},"min":{"1min":0.66000000000000003,"5min":0.61899999999999999,"15min":0.54400000000000004},"max":{"1min":1.131,"5min":1.218,"15min":1.3580000000000001},"last":0.89100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575750,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311736,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060104,"statfs":{"total":96636764160,"available":96317546496,"internally_reserved":0,"allocated":2211840,"data_stored":1099010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46000000000000002,"15min":0.47099999999999997},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52500000000000002,"15min":0.51400000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.49199999999999999}]},{"osd":1,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.48999999999999999,"15min":0.48699999999999999},"min":{"1min":0.40699999999999997,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.34599999999999997},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.98699999999999999},"last":0.46700000000000003}]},{"osd":3,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.625,"15min":0.61799999999999999},"min":{"1min":0.48199999999999998,"5min":0.46600000000000003,"15min":0.41399999999999998},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.45500000000000002,"5min":0.44500000000000001,"15min":0.40999999999999998},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.52200000000000002}]},{"osd":4,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81299999999999994,"15min":0.80000000000000004},"min":{"1min":0.56499999999999995,"5min":0.56299999999999994,"15min":0.54500000000000004},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79200000000000004,"15min":0.78300000000000003},"min":{"1min":0.59799999999999998,"5min":0.54000000000000004,"15min":0.47799999999999998},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":0.876}]},{"osd":5,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.81299999999999994,"15min":0.79100000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.296,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.81599999999999995},"min":{"1min":0.63100000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0269999999999999,"5min":1.254,"15min":1.254},"last":0.74099999999999999}]},{"osd":6,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.82299999999999995,"15min":0.80900000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.54100000000000004},"max":{"1min":0.99399999999999999,"5min":1.1639999999999999,"15min":1.296},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82899999999999996,"15min":0.81999999999999995},"min":{"1min":0.629,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2230000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.73199999999999998}]},{"osd":7,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.85299999999999998,"15min":0.84099999999999997},"min":{"1min":0.63200000000000001,"5min":0.56499999999999995,"15min":0.53600000000000003},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.89500000000000002,"15min":0.877},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.69799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575751,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311724,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060116,"statfs":{"total":96636764160,"available":96317558784,"internally_reserved":0,"allocated":2199552,"data_stored":1097494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.47399999999999998,"15min":0.48499999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63700000000000001,"5min":0.77100000000000002,"15min":0.80700000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.32300000000000001},"max":{"1min":0.76400000000000001,"5min":0.85399999999999998,"15min":0.91700000000000004},"last":0.56499999999999995}]},{"osd":1,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48299999999999998,"15min":0.498},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.84699999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80100000000000005,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.61099999999999999}]},{"osd":2,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57699999999999996,"15min":0.58999999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.34999999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.90900000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.40899999999999997},"max":{"1min":0.81299999999999994,"5min":0.83799999999999997,"15min":0.95799999999999996},"last":0.58099999999999996}]},{"osd":4,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.77100000000000002,"15min":0.77400000000000002},"min":{"1min":0.55500000000000005,"5min":0.55000000000000004,"15min":0.47499999999999998},"max":{"1min":1.03,"5min":1.121,"15min":1.246},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.85099999999999998,"15min":0.85299999999999998},"min":{"1min":0.63800000000000001,"5min":0.629,"15min":0.57799999999999996},"max":{"1min":1.0780000000000001,"5min":1.1419999999999999,"15min":1.157},"last":0.86499999999999999}]},{"osd":5,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.76200000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.48499999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.1910000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.48899999999999999},"max":{"1min":1.073,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.77600000000000002}]},{"osd":6,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80200000000000005,"15min":0.79700000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.495},"max":{"1min":1.05,"5min":1.149,"15min":1.149},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.80900000000000005,"15min":0.81299999999999994},"min":{"1min":0.59299999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.099,"5min":1.103,"15min":1.2230000000000001},"last":0.80900000000000005}]},{"osd":7,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84499999999999997,"15min":0.84799999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.53100000000000003},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.2430000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.85199999999999998,"15min":0.85099999999999998},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.56699999999999995},"max":{"1min":1.181,"5min":1.181,"15min":1.1850000000000001},"last":0.82899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575750,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299432,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072408,"statfs":{"total":96636764160,"available":96330145792,"internally_reserved":0,"allocated":2195456,"data_stored":1097404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90300000000000002,"5min":0.97499999999999998,"15min":1.0700000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.73999999999999999,"15min":0.754},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77500000000000002,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.40100000000000002}]},{"osd":1,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.73599999999999999,"15min":0.73099999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97799999999999998,"5min":1.038,"15min":1.0640000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.73799999999999999,"15min":0.74099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.81299999999999994,"5min":1.028,"15min":1.038},"last":0.55600000000000005}]},{"osd":2,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.79400000000000004,"15min":0.78700000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88200000000000001,"5min":0.999,"15min":1.0509999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79500000000000004,"15min":0.79700000000000004},"min":{"1min":0.60399999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.94099999999999995,"5min":1.069,"15min":1.069},"last":0.73199999999999998}]},{"osd":3,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.76000000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91800000000000004,"5min":1.131,"15min":1.131},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.014,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.58299999999999996}]},{"osd":5,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61599999999999999,"15min":0.59399999999999997},"min":{"1min":0.438,"5min":0.372,"15min":0.36299999999999999},"max":{"1min":1.0009999999999999,"5min":1.27,"15min":1.27},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.626,"15min":0.61699999999999999},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95299999999999996,"5min":1.014,"15min":1.014},"last":0.626}]},{"osd":6,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65700000000000003,"15min":0.63700000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.41699999999999998},"max":{"1min":1.0449999999999999,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67900000000000005,"15min":0.66300000000000003},"min":{"1min":0.47599999999999998,"5min":0.45500000000000002,"15min":0.39000000000000001},"max":{"1min":0.89400000000000002,"5min":1.425,"15min":1.425},"last":0.78400000000000003}]},{"osd":7,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.58699999999999997,"5min":0.48699999999999999,"15min":0.47999999999999998},"max":{"1min":0.92300000000000004,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.78300000000000003,"15min":0.76200000000000001},"min":{"1min":0.63900000000000001,"5min":0.51200000000000001,"15min":0.46600000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.76900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575751,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311724,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060116,"statfs":{"total":96636764160,"available":96317558784,"internally_reserved":0,"allocated":2199552,"data_stored":1097426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73499999999999999,"15min":0.72999999999999998},"min":{"1min":0.46500000000000002,"5min":0.46200000000000002,"15min":0.39100000000000001},"max":{"1min":1.016,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.73099999999999998,"15min":0.72199999999999998},"min":{"1min":0.51000000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97299999999999998,"5min":0.98799999999999999,"15min":1.0820000000000001},"last":0.55800000000000005}]},{"osd":1,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.73499999999999999,"15min":0.72799999999999998},"min":{"1min":0.54600000000000004,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":0.92800000000000005,"5min":0.97499999999999998,"15min":1.0129999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.748,"15min":0.751},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.0289999999999999},"last":0.60899999999999999}]},{"osd":2,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76500000000000001,"15min":0.75700000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.46800000000000003},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.98599999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73699999999999999,"15min":0.74299999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.44500000000000001},"max":{"1min":0.89300000000000002,"5min":0.96399999999999997,"15min":1.026},"last":0.625}]},{"osd":3,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.47499999999999998},"max":{"1min":0.89900000000000002,"5min":0.97399999999999998,"15min":1.107},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79500000000000004,"15min":0.78600000000000003},"min":{"1min":0.58299999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.66300000000000003}]},{"osd":4,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.84099999999999997,"5min":1.002,"15min":1.0189999999999999},"last":0.502},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.38800000000000001,"15min":0.379},"max":{"1min":0.90700000000000003,"5min":0.96199999999999997,"15min":1.0289999999999999},"last":0.48799999999999999}]},{"osd":6,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.44900000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69299999999999995,"15min":0.68400000000000005},"min":{"1min":0.48299999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.97799999999999998,"5min":0.99299999999999999,"15min":1.054},"last":0.57299999999999995}]},{"osd":7,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70799999999999996,"15min":0.69899999999999995},"min":{"1min":0.46999999999999997,"5min":0.45000000000000001,"15min":0.433},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.79000000000000004,"15min":0.78700000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.5},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.69499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T07:58:33.189 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T07:58:33.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.377+0000 7fc484f9d700 1 Processor -- start 2023-10-09T07:58:33.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.378+0000 7fc484f9d700 1 -- start start 2023-10-09T07:58:33.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.379+0000 7fc484f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc480159420 0x7fc4800b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:33.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.379+0000 7fc484f9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc48015d230 0x7fc48015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:33.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.379+0000 7fc484f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4800b2980 con 0x7fc4801597f0 2023-10-09T07:58:33.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.379+0000 7fc484f9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc48015db70 con 0x7fc48015d230 2023-10-09T07:58:33.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.379+0000 7fc484f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4800b11d0 con 0x7fc480159420 2023-10-09T07:58:33.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.379+0000 7fc47ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc48015d230 0x7fc48015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:33.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.379+0000 7fc47ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc48015d230 0x7fc48015d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42842/0 (socket says 172.21.15.71:42842) 2023-10-09T07:58:33.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.379+0000 7fc47ffff700 1 -- 172.21.15.71:0/1777129770 learned_addr learned my addr 172.21.15.71:0/1777129770 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:33.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.379+0000 7fc47f7fe700 1 --2- 172.21.15.71:0/1777129770 >> v2:172.21.15.179:3300/0 conn(0x7fc480159420 0x7fc4800b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:33.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.380+0000 7fc47ffff700 1 -- 172.21.15.71:0/1777129770 >> v2:172.21.15.179:3300/0 conn(0x7fc480159420 msgr2=0x7fc4800b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:33.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.380+0000 7fc47ffff700 1 --2- 172.21.15.71:0/1777129770 >> v2:172.21.15.179:3300/0 conn(0x7fc480159420 0x7fc4800b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:33.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.380+0000 7fc47ffff700 1 -- 172.21.15.71:0/1777129770 >> v1:172.21.15.179:6789/0 conn(0x7fc4801597f0 legacy=0x7fc4800b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:33.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.380+0000 7fc47ffff700 1 -- 172.21.15.71:0/1777129770 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4800b14b0 con 0x7fc48015d230 2023-10-09T07:58:33.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.380+0000 7fc47f7fe700 1 --2- 172.21.15.71:0/1777129770 >> v2:172.21.15.179:3300/0 conn(0x7fc480159420 0x7fc4800b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:58:33.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.380+0000 7fc47ffff700 1 --2- 172.21.15.71:0/1777129770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc48015d230 0x7fc48015d630 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fc4800b2f20 tx=0x7fc478009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7036fd9895fb6d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:33.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.380+0000 7fc47e7fc700 1 -- 172.21.15.71:0/1777129770 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47800e070 con 0x7fc48015d230 2023-10-09T07:58:33.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.380+0000 7fc47e7fc700 1 -- 172.21.15.71:0/1777129770 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47800ba50 con 0x7fc48015d230 2023-10-09T07:58:33.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.380+0000 7fc47e7fc700 1 -- 172.21.15.71:0/1777129770 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4780092e0 con 0x7fc48015d230 2023-10-09T07:58:33.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.381+0000 7fc484f9d700 1 -- 172.21.15.71:0/1777129770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc48015d230 msgr2=0x7fc48015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:33.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.381+0000 7fc484f9d700 1 --2- 172.21.15.71:0/1777129770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc48015d230 0x7fc48015d630 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fc4800b2f20 tx=0x7fc478009840 comp rx=0 tx=0).stop 2023-10-09T07:58:33.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.381+0000 7fc484f9d700 1 -- 172.21.15.71:0/1777129770 shutdown_connections 2023-10-09T07:58:33.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.381+0000 7fc484f9d700 1 --2- 172.21.15.71:0/1777129770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc48015d230 0x7fc48015d630 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:33.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.381+0000 7fc484f9d700 1 --2- 172.21.15.71:0/1777129770 >> v2:172.21.15.179:3300/0 conn(0x7fc480159420 0x7fc4800b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:33.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.381+0000 7fc484f9d700 1 -- 172.21.15.71:0/1777129770 >> 172.21.15.71:0/1777129770 conn(0x7fc4800d0660 msgr2=0x7fc4800d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:33.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.381+0000 7fc484f9d700 1 -- 172.21.15.71:0/1777129770 shutdown_connections 2023-10-09T07:58:33.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.381+0000 7fc484f9d700 1 -- 172.21.15.71:0/1777129770 wait complete. 2023-10-09T07:58:33.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.382+0000 7fc484f9d700 1 Processor -- start 2023-10-09T07:58:33.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.382+0000 7fc484f9d700 1 -- start start 2023-10-09T07:58:33.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.383+0000 7fc484f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc480159420 0x7fc48015a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:33.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.383+0000 7fc484f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4801597f0 0x7fc480169a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:33.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.383+0000 7fc484f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc48015d230 0x7fc480169f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:33.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.383+0000 7fc484f9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48015b7f0 con 0x7fc4801597f0 2023-10-09T07:58:33.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.383+0000 7fc484f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48015ac70 con 0x7fc48015d230 2023-10-09T07:58:33.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.383+0000 7fc484f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48015af50 con 0x7fc480159420 2023-10-09T07:58:33.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.384+0000 7fc47effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4801597f0 0x7fc480169a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:33.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.384+0000 7fc47effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4801597f0 0x7fc480169a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42854/0 (socket says 172.21.15.71:42854) 2023-10-09T07:58:33.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.384+0000 7fc47effd700 1 -- 172.21.15.71:0/234409574 learned_addr learned my addr 172.21.15.71:0/234409574 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:33.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.384+0000 7fc47effd700 1 -- 172.21.15.71:0/234409574 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc480159420 msgr2=0x7fc48015a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:33.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.384+0000 7fc47effd700 1 --2- 172.21.15.71:0/234409574 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc480159420 0x7fc48015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:33.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.384+0000 7fc47ffff700 1 --2- 172.21.15.71:0/234409574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc48015d230 0x7fc480169f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:33.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.384+0000 7fc47effd700 1 -- 172.21.15.71:0/234409574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc48015d230 msgr2=0x7fc480169f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:33.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.384+0000 7fc47effd700 1 --2- 172.21.15.71:0/234409574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc48015d230 0x7fc480169f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:33.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.384+0000 7fc47effd700 1 -- 172.21.15.71:0/234409574 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc478009ae0 con 0x7fc4801597f0 2023-10-09T07:58:33.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.384+0000 7fc47effd700 1 --2- 172.21.15.71:0/234409574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4801597f0 0x7fc480169a20 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fc47400c7c0 tx=0x7fc474007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:33.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.384+0000 7fc4677fe700 1 -- 172.21.15.71:0/234409574 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474011590 con 0x7fc4801597f0 2023-10-09T07:58:33.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.384+0000 7fc4677fe700 1 -- 172.21.15.71:0/234409574 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4740116f0 con 0x7fc4801597f0 2023-10-09T07:58:33.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.385+0000 7fc484f9d700 1 -- 172.21.15.71:0/234409574 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc48015b230 con 0x7fc4801597f0 2023-10-09T07:58:33.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.385+0000 7fc4677fe700 1 -- 172.21.15.71:0/234409574 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474011ab0 con 0x7fc4801597f0 2023-10-09T07:58:33.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.385+0000 7fc484f9d700 1 -- 172.21.15.71:0/234409574 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4801564b0 con 0x7fc4801597f0 2023-10-09T07:58:33.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.386+0000 7fc484f9d700 1 -- 172.21.15.71:0/234409574 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48004c3c0 con 0x7fc4801597f0 2023-10-09T07:58:33.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.387+0000 7fc4677fe700 1 -- 172.21.15.71:0/234409574 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc47401b3b0 con 0x7fc4801597f0 2023-10-09T07:58:33.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.387+0000 7fc4677fe700 1 --2- 172.21.15.71:0/234409574 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc46c066f30 0x7fc46c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:33.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.388+0000 7fc4677fe700 1 -- 172.21.15.71:0/234409574 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fc474083ba0 con 0x7fc4801597f0 2023-10-09T07:58:33.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.388+0000 7fc47f7fe700 1 --2- 172.21.15.71:0/234409574 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc46c066f30 0x7fc46c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:33.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.389+0000 7fc47f7fe700 1 --2- 172.21.15.71:0/234409574 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc46c066f30 0x7fc46c0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc470006fd0 tx=0x7fc470008040 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:33.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.391+0000 7fc4677fe700 1 -- 172.21.15.71:0/234409574 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc474050c40 con 0x7fc4801597f0 2023-10-09T07:58:33.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.578+0000 7fc484f9d700 1 -- 172.21.15.71:0/234409574 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4800b1790 con 0x7fc46c066f30 2023-10-09T07:58:33.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.588+0000 7fc4677fe700 1 -- 172.21.15.71:0/234409574 <== mgr.8503 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289379 (secure 0 0 0) 0x7fc4800b1790 con 0x7fc46c066f30 2023-10-09T07:58:33.593 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:58:33.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.592+0000 7fc484f9d700 1 -- 172.21.15.71:0/234409574 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc46c066f30 msgr2=0x7fc46c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:33.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.592+0000 7fc484f9d700 1 --2- 172.21.15.71:0/234409574 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc46c066f30 0x7fc46c0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc470006fd0 tx=0x7fc470008040 comp rx=0 tx=0).stop 2023-10-09T07:58:33.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.592+0000 7fc484f9d700 1 -- 172.21.15.71:0/234409574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4801597f0 msgr2=0x7fc480169a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:33.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.592+0000 7fc484f9d700 1 --2- 172.21.15.71:0/234409574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4801597f0 0x7fc480169a20 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fc47400c7c0 tx=0x7fc474007f50 comp rx=0 tx=0).stop 2023-10-09T07:58:33.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.592+0000 7fc484f9d700 1 -- 172.21.15.71:0/234409574 shutdown_connections 2023-10-09T07:58:33.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.592+0000 7fc484f9d700 1 --2- 172.21.15.71:0/234409574 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fc46c066f30 0x7fc46c0693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:33.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.592+0000 7fc484f9d700 1 --2- 172.21.15.71:0/234409574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc48015d230 0x7fc480169f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:33.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.592+0000 7fc484f9d700 1 --2- 172.21.15.71:0/234409574 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc480159420 0x7fc48015a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:33.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.592+0000 7fc484f9d700 1 --2- 172.21.15.71:0/234409574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4801597f0 0x7fc480169a20 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:33.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.592+0000 7fc484f9d700 1 -- 172.21.15.71:0/234409574 >> 172.21.15.71:0/234409574 conn(0x7fc4800d0660 msgr2=0x7fc480156a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:33.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.592+0000 7fc484f9d700 1 -- 172.21.15.71:0/234409574 shutdown_connections 2023-10-09T07:58:33.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.592+0000 7fc484f9d700 1 -- 172.21.15.71:0/234409574 wait complete. 2023-10-09T07:58:33.596 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T07:58:33.610 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-09T07:58:32.962750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":524,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":332,"ondisk_log_size":332,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2466312,"kb_used_data":18376,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752508408,"statfs":{"total":773094113280,"available":770568609792,"internally_reserved":0,"allocated":18817024,"data_stored":9964580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.938882"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.051793+0000","last_change":"2023-10-09T07:58:24.050753+0000","last_active":"2023-10-09T07:58:24.051793+0000","last_peered":"2023-10-09T07:58:24.051793+0000","last_clean":"2023-10-09T07:58:24.051793+0000","last_became_active":"2023-10-09T07:58:24.050542+0000","last_became_peered":"2023-10-09T07:58:24.050542+0000","last_unstale":"2023-10-09T07:58:24.051793+0000","last_undegraded":"2023-10-09T07:58:24.051793+0000","last_fullsized":"2023-10-09T07:58:24.051793+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:31.820966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048921+0000","last_change":"2023-10-09T07:58:24.045776+0000","last_active":"2023-10-09T07:58:24.048921+0000","last_peered":"2023-10-09T07:58:24.048921+0000","last_clean":"2023-10-09T07:58:24.048921+0000","last_became_active":"2023-10-09T07:58:24.045554+0000","last_became_peered":"2023-10-09T07:58:24.045554+0000","last_unstale":"2023-10-09T07:58:24.048921+0000","last_undegraded":"2023-10-09T07:58:24.048921+0000","last_fullsized":"2023-10-09T07:58:24.048921+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:11:57.967753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.058427+0000","last_change":"2023-10-09T07:58:24.053589+0000","last_active":"2023-10-09T07:58:24.058427+0000","last_peered":"2023-10-09T07:58:24.058427+0000","last_clean":"2023-10-09T07:58:24.058427+0000","last_became_active":"2023-10-09T07:58:24.053231+0000","last_became_peered":"2023-10-09T07:58:24.053231+0000","last_unstale":"2023-10-09T07:58:24.058427+0000","last_undegraded":"2023-10-09T07:58:24.058427+0000","last_fullsized":"2023-10-09T07:58:24.058427+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:33:22.406090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.047207+0000","last_change":"2023-10-09T07:58:24.046040+0000","last_active":"2023-10-09T07:58:24.047207+0000","last_peered":"2023-10-09T07:58:24.047207+0000","last_clean":"2023-10-09T07:58:24.047207+0000","last_became_active":"2023-10-09T07:58:24.045353+0000","last_became_peered":"2023-10-09T07:58:24.045353+0000","last_unstale":"2023-10-09T07:58:24.047207+0000","last_undegraded":"2023-10-09T07:58:24.047207+0000","last_fullsized":"2023-10-09T07:58:24.047207+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:44.690645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.058333+0000","last_change":"2023-10-09T07:58:24.055759+0000","last_active":"2023-10-09T07:58:24.058333+0000","last_peered":"2023-10-09T07:58:24.058333+0000","last_clean":"2023-10-09T07:58:24.058333+0000","last_became_active":"2023-10-09T07:58:24.055332+0000","last_became_peered":"2023-10-09T07:58:24.055332+0000","last_unstale":"2023-10-09T07:58:24.058333+0000","last_undegraded":"2023-10-09T07:58:24.058333+0000","last_fullsized":"2023-10-09T07:58:24.058333+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:45.661437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048122+0000","last_change":"2023-10-09T07:58:24.043868+0000","last_active":"2023-10-09T07:58:24.048122+0000","last_peered":"2023-10-09T07:58:24.048122+0000","last_clean":"2023-10-09T07:58:24.048122+0000","last_became_active":"2023-10-09T07:58:24.043622+0000","last_became_peered":"2023-10-09T07:58:24.043622+0000","last_unstale":"2023-10-09T07:58:24.048122+0000","last_undegraded":"2023-10-09T07:58:24.048122+0000","last_fullsized":"2023-10-09T07:58:24.048122+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:58:45.661437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037247+0000","last_change":"2023-10-09T07:58:24.034026+0000","last_active":"2023-10-09T07:58:24.037247+0000","last_peered":"2023-10-09T07:58:24.037247+0000","last_clean":"2023-10-09T07:58:24.037247+0000","last_became_active":"2023-10-09T07:58:24.033378+0000","last_became_peered":"2023-10-09T07:58:24.033378+0000","last_unstale":"2023-10-09T07:58:24.037247+0000","last_undegraded":"2023-10-09T07:58:24.037247+0000","last_fullsized":"2023-10-09T07:58:24.037247+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:30.633397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.039832+0000","last_change":"2023-10-09T07:58:24.034388+0000","last_active":"2023-10-09T07:58:24.039832+0000","last_peered":"2023-10-09T07:58:24.039832+0000","last_clean":"2023-10-09T07:58:24.039832+0000","last_became_active":"2023-10-09T07:58:24.033937+0000","last_became_peered":"2023-10-09T07:58:24.033937+0000","last_unstale":"2023-10-09T07:58:24.039832+0000","last_undegraded":"2023-10-09T07:58:24.039832+0000","last_fullsized":"2023-10-09T07:58:24.039832+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:44.690645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048899+0000","last_change":"2023-10-09T07:58:24.043286+0000","last_active":"2023-10-09T07:58:24.048899+0000","last_peered":"2023-10-09T07:58:24.048899+0000","last_clean":"2023-10-09T07:58:24.048899+0000","last_became_active":"2023-10-09T07:58:24.043002+0000","last_became_peered":"2023-10-09T07:58:24.043002+0000","last_unstale":"2023-10-09T07:58:24.048899+0000","last_undegraded":"2023-10-09T07:58:24.048899+0000","last_fullsized":"2023-10-09T07:58:24.048899+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:53.560893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.059357+0000","last_change":"2023-10-09T07:58:24.051725+0000","last_active":"2023-10-09T07:58:24.059357+0000","last_peered":"2023-10-09T07:58:24.059357+0000","last_clean":"2023-10-09T07:58:24.059357+0000","last_became_active":"2023-10-09T07:58:24.050619+0000","last_became_peered":"2023-10-09T07:58:24.050619+0000","last_unstale":"2023-10-09T07:58:24.059357+0000","last_undegraded":"2023-10-09T07:58:24.059357+0000","last_fullsized":"2023-10-09T07:58:24.059357+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:11.305736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.039861+0000","last_change":"2023-10-09T07:58:24.035442+0000","last_active":"2023-10-09T07:58:24.039861+0000","last_peered":"2023-10-09T07:58:24.039861+0000","last_clean":"2023-10-09T07:58:24.039861+0000","last_became_active":"2023-10-09T07:58:24.034999+0000","last_became_peered":"2023-10-09T07:58:24.034999+0000","last_unstale":"2023-10-09T07:58:24.039861+0000","last_undegraded":"2023-10-09T07:58:24.039861+0000","last_fullsized":"2023-10-09T07:58:24.039861+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:58.571728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.057589+0000","last_change":"2023-10-09T07:58:24.051157+0000","last_active":"2023-10-09T07:58:24.057589+0000","last_peered":"2023-10-09T07:58:24.057589+0000","last_clean":"2023-10-09T07:58:24.057589+0000","last_became_active":"2023-10-09T07:58:24.050918+0000","last_became_peered":"2023-10-09T07:58:24.050918+0000","last_unstale":"2023-10-09T07:58:24.057589+0000","last_undegraded":"2023-10-09T07:58:24.057589+0000","last_fullsized":"2023-10-09T07:58:24.057589+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:01:28.518491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.058312+0000","last_change":"2023-10-09T07:58:24.055579+0000","last_active":"2023-10-09T07:58:24.058312+0000","last_peered":"2023-10-09T07:58:24.058312+0000","last_clean":"2023-10-09T07:58:24.058312+0000","last_became_active":"2023-10-09T07:58:24.054947+0000","last_became_peered":"2023-10-09T07:58:24.054947+0000","last_unstale":"2023-10-09T07:58:24.058312+0000","last_undegraded":"2023-10-09T07:58:24.058312+0000","last_fullsized":"2023-10-09T07:58:24.058312+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:36.378974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.055427+0000","last_change":"2023-10-09T07:58:24.053220+0000","last_active":"2023-10-09T07:58:24.055427+0000","last_peered":"2023-10-09T07:58:24.055427+0000","last_clean":"2023-10-09T07:58:24.055427+0000","last_became_active":"2023-10-09T07:58:24.052935+0000","last_became_peered":"2023-10-09T07:58:24.052935+0000","last_unstale":"2023-10-09T07:58:24.055427+0000","last_undegraded":"2023-10-09T07:58:24.055427+0000","last_fullsized":"2023-10-09T07:58:24.055427+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:09.884939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.057551+0000","last_change":"2023-10-09T07:58:24.050809+0000","last_active":"2023-10-09T07:58:24.057551+0000","last_peered":"2023-10-09T07:58:24.057551+0000","last_clean":"2023-10-09T07:58:24.057551+0000","last_became_active":"2023-10-09T07:58:24.050521+0000","last_became_peered":"2023-10-09T07:58:24.050521+0000","last_unstale":"2023-10-09T07:58:24.057551+0000","last_undegraded":"2023-10-09T07:58:24.057551+0000","last_fullsized":"2023-10-09T07:58:24.057551+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:48:12.371691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.047182+0000","last_change":"2023-10-09T07:58:24.041213+0000","last_active":"2023-10-09T07:58:24.047182+0000","last_peered":"2023-10-09T07:58:24.047182+0000","last_clean":"2023-10-09T07:58:24.047182+0000","last_became_active":"2023-10-09T07:58:24.040940+0000","last_became_peered":"2023-10-09T07:58:24.040940+0000","last_unstale":"2023-10-09T07:58:24.047182+0000","last_undegraded":"2023-10-09T07:58:24.047182+0000","last_fullsized":"2023-10-09T07:58:24.047182+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:17:20.139851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.057687+0000","last_change":"2023-10-09T07:58:24.051958+0000","last_active":"2023-10-09T07:58:24.057687+0000","last_peered":"2023-10-09T07:58:24.057687+0000","last_clean":"2023-10-09T07:58:24.057687+0000","last_became_active":"2023-10-09T07:58:24.051177+0000","last_became_peered":"2023-10-09T07:58:24.051177+0000","last_unstale":"2023-10-09T07:58:24.057687+0000","last_undegraded":"2023-10-09T07:58:24.057687+0000","last_fullsized":"2023-10-09T07:58:24.057687+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:13.878245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.058340+0000","last_change":"2023-10-09T07:58:24.053547+0000","last_active":"2023-10-09T07:58:24.058340+0000","last_peered":"2023-10-09T07:58:24.058340+0000","last_clean":"2023-10-09T07:58:24.058340+0000","last_became_active":"2023-10-09T07:58:24.053288+0000","last_became_peered":"2023-10-09T07:58:24.053288+0000","last_unstale":"2023-10-09T07:58:24.058340+0000","last_undegraded":"2023-10-09T07:58:24.058340+0000","last_fullsized":"2023-10-09T07:58:24.058340+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:40:10.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048032+0000","last_change":"2023-10-09T07:58:24.042197+0000","last_active":"2023-10-09T07:58:24.048032+0000","last_peered":"2023-10-09T07:58:24.048032+0000","last_clean":"2023-10-09T07:58:24.048032+0000","last_became_active":"2023-10-09T07:58:24.041921+0000","last_became_peered":"2023-10-09T07:58:24.041921+0000","last_unstale":"2023-10-09T07:58:24.048032+0000","last_undegraded":"2023-10-09T07:58:24.048032+0000","last_fullsized":"2023-10-09T07:58:24.048032+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:07.075855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.036601+0000","last_change":"2023-10-09T07:58:24.032315+0000","last_active":"2023-10-09T07:58:24.036601+0000","last_peered":"2023-10-09T07:58:24.036601+0000","last_clean":"2023-10-09T07:58:24.036601+0000","last_became_active":"2023-10-09T07:58:24.032042+0000","last_became_peered":"2023-10-09T07:58:24.032042+0000","last_unstale":"2023-10-09T07:58:24.036601+0000","last_undegraded":"2023-10-09T07:58:24.036601+0000","last_fullsized":"2023-10-09T07:58:24.036601+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:05.127890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.057790+0000","last_change":"2023-10-09T07:58:24.051023+0000","last_active":"2023-10-09T07:58:24.057790+0000","last_peered":"2023-10-09T07:58:24.057790+0000","last_clean":"2023-10-09T07:58:24.057790+0000","last_became_active":"2023-10-09T07:58:24.050775+0000","last_became_peered":"2023-10-09T07:58:24.050775+0000","last_unstale":"2023-10-09T07:58:24.057790+0000","last_undegraded":"2023-10-09T07:58:24.057790+0000","last_fullsized":"2023-10-09T07:58:24.057790+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:33.520395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.042910+0000","last_change":"2023-10-09T07:58:24.033278+0000","last_active":"2023-10-09T07:58:24.042910+0000","last_peered":"2023-10-09T07:58:24.042910+0000","last_clean":"2023-10-09T07:58:24.042910+0000","last_became_active":"2023-10-09T07:58:24.032933+0000","last_became_peered":"2023-10-09T07:58:24.032933+0000","last_unstale":"2023-10-09T07:58:24.042910+0000","last_undegraded":"2023-10-09T07:58:24.042910+0000","last_fullsized":"2023-10-09T07:58:24.042910+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:15.479025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.046014+0000","last_change":"2023-10-09T07:58:24.044626+0000","last_active":"2023-10-09T07:58:24.046014+0000","last_peered":"2023-10-09T07:58:24.046014+0000","last_clean":"2023-10-09T07:58:24.046014+0000","last_became_active":"2023-10-09T07:58:24.044362+0000","last_became_peered":"2023-10-09T07:58:24.044362+0000","last_unstale":"2023-10-09T07:58:24.046014+0000","last_undegraded":"2023-10-09T07:58:24.046014+0000","last_fullsized":"2023-10-09T07:58:24.046014+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:33:20.671515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.057772+0000","last_change":"2023-10-09T07:58:24.050055+0000","last_active":"2023-10-09T07:58:24.057772+0000","last_peered":"2023-10-09T07:58:24.057772+0000","last_clean":"2023-10-09T07:58:24.057772+0000","last_became_active":"2023-10-09T07:58:24.049429+0000","last_became_peered":"2023-10-09T07:58:24.049429+0000","last_unstale":"2023-10-09T07:58:24.057772+0000","last_undegraded":"2023-10-09T07:58:24.057772+0000","last_fullsized":"2023-10-09T07:58:24.057772+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:13.577193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048256+0000","last_change":"2023-10-09T07:58:24.041854+0000","last_active":"2023-10-09T07:58:24.048256+0000","last_peered":"2023-10-09T07:58:24.048256+0000","last_clean":"2023-10-09T07:58:24.048256+0000","last_became_active":"2023-10-09T07:58:24.041577+0000","last_became_peered":"2023-10-09T07:58:24.041577+0000","last_unstale":"2023-10-09T07:58:24.048256+0000","last_undegraded":"2023-10-09T07:58:24.048256+0000","last_fullsized":"2023-10-09T07:58:24.048256+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:00:19.369349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048217+0000","last_change":"2023-10-09T07:58:24.042324+0000","last_active":"2023-10-09T07:58:24.048217+0000","last_peered":"2023-10-09T07:58:24.048217+0000","last_clean":"2023-10-09T07:58:24.048217+0000","last_became_active":"2023-10-09T07:58:24.042010+0000","last_became_peered":"2023-10-09T07:58:24.042010+0000","last_unstale":"2023-10-09T07:58:24.048217+0000","last_undegraded":"2023-10-09T07:58:24.048217+0000","last_fullsized":"2023-10-09T07:58:24.048217+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:16.438076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.052659+0000","last_change":"2023-10-09T07:58:24.052200+0000","last_active":"2023-10-09T07:58:24.052659+0000","last_peered":"2023-10-09T07:58:24.052659+0000","last_clean":"2023-10-09T07:58:24.052659+0000","last_became_active":"2023-10-09T07:58:24.051595+0000","last_became_peered":"2023-10-09T07:58:24.051595+0000","last_unstale":"2023-10-09T07:58:24.052659+0000","last_undegraded":"2023-10-09T07:58:24.052659+0000","last_fullsized":"2023-10-09T07:58:24.052659+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:42:21.938720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.045210+0000","last_change":"2023-10-09T07:58:24.042772+0000","last_active":"2023-10-09T07:58:24.045210+0000","last_peered":"2023-10-09T07:58:24.045210+0000","last_clean":"2023-10-09T07:58:24.045210+0000","last_became_active":"2023-10-09T07:58:24.042398+0000","last_became_peered":"2023-10-09T07:58:24.042398+0000","last_unstale":"2023-10-09T07:58:24.045210+0000","last_undegraded":"2023-10-09T07:58:24.045210+0000","last_fullsized":"2023-10-09T07:58:24.045210+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:19.906242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048245+0000","last_change":"2023-10-09T07:58:24.043813+0000","last_active":"2023-10-09T07:58:24.048245+0000","last_peered":"2023-10-09T07:58:24.048245+0000","last_clean":"2023-10-09T07:58:24.048245+0000","last_became_active":"2023-10-09T07:58:24.043558+0000","last_became_peered":"2023-10-09T07:58:24.043558+0000","last_unstale":"2023-10-09T07:58:24.048245+0000","last_undegraded":"2023-10-09T07:58:24.048245+0000","last_fullsized":"2023-10-09T07:58:24.048245+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:36.378974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.043072+0000","last_change":"2023-10-09T07:58:24.037838+0000","last_active":"2023-10-09T07:58:24.043072+0000","last_peered":"2023-10-09T07:58:24.043072+0000","last_clean":"2023-10-09T07:58:24.043072+0000","last_became_active":"2023-10-09T07:58:24.037557+0000","last_became_peered":"2023-10-09T07:58:24.037557+0000","last_unstale":"2023-10-09T07:58:24.043072+0000","last_undegraded":"2023-10-09T07:58:24.043072+0000","last_fullsized":"2023-10-09T07:58:24.043072+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:47:42.494317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048866+0000","last_change":"2023-10-09T07:58:24.045013+0000","last_active":"2023-10-09T07:58:24.048866+0000","last_peered":"2023-10-09T07:58:24.048866+0000","last_clean":"2023-10-09T07:58:24.048866+0000","last_became_active":"2023-10-09T07:58:24.044774+0000","last_became_peered":"2023-10-09T07:58:24.044774+0000","last_unstale":"2023-10-09T07:58:24.048866+0000","last_undegraded":"2023-10-09T07:58:24.048866+0000","last_fullsized":"2023-10-09T07:58:24.048866+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:13:00.102552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.040246+0000","last_change":"2023-10-09T07:58:24.035180+0000","last_active":"2023-10-09T07:58:24.040246+0000","last_peered":"2023-10-09T07:58:24.040246+0000","last_clean":"2023-10-09T07:58:24.040246+0000","last_became_active":"2023-10-09T07:58:24.034916+0000","last_became_peered":"2023-10-09T07:58:24.034916+0000","last_unstale":"2023-10-09T07:58:24.040246+0000","last_undegraded":"2023-10-09T07:58:24.040246+0000","last_fullsized":"2023-10-09T07:58:24.040246+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:12:00.905354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.058229+0000","last_change":"2023-10-09T07:58:24.050300+0000","last_active":"2023-10-09T07:58:24.058229+0000","last_peered":"2023-10-09T07:58:24.058229+0000","last_clean":"2023-10-09T07:58:24.058229+0000","last_became_active":"2023-10-09T07:58:24.049485+0000","last_became_peered":"2023-10-09T07:58:24.049485+0000","last_unstale":"2023-10-09T07:58:24.058229+0000","last_undegraded":"2023-10-09T07:58:24.058229+0000","last_fullsized":"2023-10-09T07:58:24.058229+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:07.411847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"175'4","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.052248+0000","last_change":"2023-10-09T07:58:23.042257+0000","last_active":"2023-10-09T07:58:24.052248+0000","last_peered":"2023-10-09T07:58:24.052248+0000","last_clean":"2023-10-09T07:58:24.052248+0000","last_became_active":"2023-10-09T07:58:23.041987+0000","last_became_peered":"2023-10-09T07:58:23.041987+0000","last_unstale":"2023-10-09T07:58:24.052248+0000","last_undegraded":"2023-10-09T07:58:24.052248+0000","last_fullsized":"2023-10-09T07:58:24.052248+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:11:53.221593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048916+0000","last_change":"2023-10-09T07:58:24.045206+0000","last_active":"2023-10-09T07:58:24.048916+0000","last_peered":"2023-10-09T07:58:24.048916+0000","last_clean":"2023-10-09T07:58:24.048916+0000","last_became_active":"2023-10-09T07:58:24.043198+0000","last_became_peered":"2023-10-09T07:58:24.043198+0000","last_unstale":"2023-10-09T07:58:24.048916+0000","last_undegraded":"2023-10-09T07:58:24.048916+0000","last_fullsized":"2023-10-09T07:58:24.048916+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:39:01.903400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.054826+0000","last_change":"2023-10-09T07:58:23.039895+0000","last_active":"2023-10-09T07:58:24.054826+0000","last_peered":"2023-10-09T07:58:24.054826+0000","last_clean":"2023-10-09T07:58:24.054826+0000","last_became_active":"2023-10-09T07:58:23.038992+0000","last_became_peered":"2023-10-09T07:58:23.038992+0000","last_unstale":"2023-10-09T07:58:24.054826+0000","last_undegraded":"2023-10-09T07:58:24.054826+0000","last_fullsized":"2023-10-09T07:58:24.054826+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:32:21.536459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.039892+0000","last_change":"2023-10-09T07:58:24.034722+0000","last_active":"2023-10-09T07:58:24.039892+0000","last_peered":"2023-10-09T07:58:24.039892+0000","last_clean":"2023-10-09T07:58:24.039892+0000","last_became_active":"2023-10-09T07:58:24.033015+0000","last_became_peered":"2023-10-09T07:58:24.033015+0000","last_unstale":"2023-10-09T07:58:24.039892+0000","last_undegraded":"2023-10-09T07:58:24.039892+0000","last_fullsized":"2023-10-09T07:58:24.039892+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:48:29.551743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048694+0000","last_change":"2023-10-09T07:58:23.033092+0000","last_active":"2023-10-09T07:58:24.048694+0000","last_peered":"2023-10-09T07:58:24.048694+0000","last_clean":"2023-10-09T07:58:24.048694+0000","last_became_active":"2023-10-09T07:58:23.032754+0000","last_became_peered":"2023-10-09T07:58:23.032754+0000","last_unstale":"2023-10-09T07:58:24.048694+0000","last_undegraded":"2023-10-09T07:58:24.048694+0000","last_fullsized":"2023-10-09T07:58:24.048694+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:12:49.950756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.059763+0000","last_change":"2023-10-09T07:58:24.055486+0000","last_active":"2023-10-09T07:58:24.059763+0000","last_peered":"2023-10-09T07:58:24.059763+0000","last_clean":"2023-10-09T07:58:24.059763+0000","last_became_active":"2023-10-09T07:58:24.055219+0000","last_became_peered":"2023-10-09T07:58:24.055219+0000","last_unstale":"2023-10-09T07:58:24.059763+0000","last_undegraded":"2023-10-09T07:58:24.059763+0000","last_fullsized":"2023-10-09T07:58:24.059763+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:49:35.323023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.050729+0000","last_change":"2023-10-09T07:58:23.033476+0000","last_active":"2023-10-09T07:58:24.050729+0000","last_peered":"2023-10-09T07:58:24.050729+0000","last_clean":"2023-10-09T07:58:24.050729+0000","last_became_active":"2023-10-09T07:58:23.033198+0000","last_became_peered":"2023-10-09T07:58:23.033198+0000","last_unstale":"2023-10-09T07:58:24.050729+0000","last_undegraded":"2023-10-09T07:58:24.050729+0000","last_fullsized":"2023-10-09T07:58:24.050729+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:45:36.724769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048760+0000","last_change":"2023-10-09T07:58:24.043979+0000","last_active":"2023-10-09T07:58:24.048760+0000","last_peered":"2023-10-09T07:58:24.048760+0000","last_clean":"2023-10-09T07:58:24.048760+0000","last_became_active":"2023-10-09T07:58:24.043724+0000","last_became_peered":"2023-10-09T07:58:24.043724+0000","last_unstale":"2023-10-09T07:58:24.048760+0000","last_undegraded":"2023-10-09T07:58:24.048760+0000","last_fullsized":"2023-10-09T07:58:24.048760+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:40.861697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.053251+0000","last_change":"2023-10-09T07:58:23.039908+0000","last_active":"2023-10-09T07:58:24.053251+0000","last_peered":"2023-10-09T07:58:24.053251+0000","last_clean":"2023-10-09T07:58:24.053251+0000","last_became_active":"2023-10-09T07:58:23.039653+0000","last_became_peered":"2023-10-09T07:58:23.039653+0000","last_unstale":"2023-10-09T07:58:24.053251+0000","last_undegraded":"2023-10-09T07:58:24.053251+0000","last_fullsized":"2023-10-09T07:58:24.053251+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:29:27.162187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.047174+0000","last_change":"2023-10-09T07:58:24.045784+0000","last_active":"2023-10-09T07:58:24.047174+0000","last_peered":"2023-10-09T07:58:24.047174+0000","last_clean":"2023-10-09T07:58:24.047174+0000","last_became_active":"2023-10-09T07:58:24.045371+0000","last_became_peered":"2023-10-09T07:58:24.045371+0000","last_unstale":"2023-10-09T07:58:24.047174+0000","last_undegraded":"2023-10-09T07:58:24.047174+0000","last_fullsized":"2023-10-09T07:58:24.047174+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:58.571728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.054515+0000","last_change":"2023-10-09T07:58:23.038953+0000","last_active":"2023-10-09T07:58:24.054515+0000","last_peered":"2023-10-09T07:58:24.054515+0000","last_clean":"2023-10-09T07:58:24.054515+0000","last_became_active":"2023-10-09T07:58:23.038700+0000","last_became_peered":"2023-10-09T07:58:23.038700+0000","last_unstale":"2023-10-09T07:58:24.054515+0000","last_undegraded":"2023-10-09T07:58:24.054515+0000","last_fullsized":"2023-10-09T07:58:24.054515+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:33:19.662502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048564+0000","last_change":"2023-10-09T07:58:24.037599+0000","last_active":"2023-10-09T07:58:24.048564+0000","last_peered":"2023-10-09T07:58:24.048564+0000","last_clean":"2023-10-09T07:58:24.048564+0000","last_became_active":"2023-10-09T07:58:24.037325+0000","last_became_peered":"2023-10-09T07:58:24.037325+0000","last_unstale":"2023-10-09T07:58:24.048564+0000","last_undegraded":"2023-10-09T07:58:24.048564+0000","last_fullsized":"2023-10-09T07:58:24.048564+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:56.795926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.027437+0000","last_change":"2023-10-09T07:58:23.036137+0000","last_active":"2023-10-09T07:58:24.027437+0000","last_peered":"2023-10-09T07:58:24.027437+0000","last_clean":"2023-10-09T07:58:24.027437+0000","last_became_active":"2023-10-09T07:58:23.035828+0000","last_became_peered":"2023-10-09T07:58:23.035828+0000","last_unstale":"2023-10-09T07:58:24.027437+0000","last_undegraded":"2023-10-09T07:58:24.027437+0000","last_fullsized":"2023-10-09T07:58:24.027437+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:30:00.666411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.042463+0000","last_change":"2023-10-09T07:58:24.039373+0000","last_active":"2023-10-09T07:58:24.042463+0000","last_peered":"2023-10-09T07:58:24.042463+0000","last_clean":"2023-10-09T07:58:24.042463+0000","last_became_active":"2023-10-09T07:58:24.039115+0000","last_became_peered":"2023-10-09T07:58:24.039115+0000","last_unstale":"2023-10-09T07:58:24.042463+0000","last_undegraded":"2023-10-09T07:58:24.042463+0000","last_fullsized":"2023-10-09T07:58:24.042463+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:31.820966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.028900+0000","last_change":"2023-10-09T07:58:23.038929+0000","last_active":"2023-10-09T07:58:24.028900+0000","last_peered":"2023-10-09T07:58:24.028900+0000","last_clean":"2023-10-09T07:58:24.028900+0000","last_became_active":"2023-10-09T07:58:23.038646+0000","last_became_peered":"2023-10-09T07:58:23.038646+0000","last_unstale":"2023-10-09T07:58:24.028900+0000","last_undegraded":"2023-10-09T07:58:24.028900+0000","last_fullsized":"2023-10-09T07:58:24.028900+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:41:05.997398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.041472+0000","last_change":"2023-10-09T07:58:24.038374+0000","last_active":"2023-10-09T07:58:24.041472+0000","last_peered":"2023-10-09T07:58:24.041472+0000","last_clean":"2023-10-09T07:58:24.041472+0000","last_became_active":"2023-10-09T07:58:24.037501+0000","last_became_peered":"2023-10-09T07:58:24.037501+0000","last_unstale":"2023-10-09T07:58:24.041472+0000","last_undegraded":"2023-10-09T07:58:24.041472+0000","last_fullsized":"2023-10-09T07:58:24.041472+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:07.075855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.030220+0000","last_change":"2023-10-09T07:58:23.034362+0000","last_active":"2023-10-09T07:58:24.030220+0000","last_peered":"2023-10-09T07:58:24.030220+0000","last_clean":"2023-10-09T07:58:24.030220+0000","last_became_active":"2023-10-09T07:58:23.034092+0000","last_became_peered":"2023-10-09T07:58:23.034092+0000","last_unstale":"2023-10-09T07:58:24.030220+0000","last_undegraded":"2023-10-09T07:58:24.030220+0000","last_fullsized":"2023-10-09T07:58:24.030220+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:03.122620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.059673+0000","last_change":"2023-10-09T07:58:24.052110+0000","last_active":"2023-10-09T07:58:24.059673+0000","last_peered":"2023-10-09T07:58:24.059673+0000","last_clean":"2023-10-09T07:58:24.059673+0000","last_became_active":"2023-10-09T07:58:24.051322+0000","last_became_peered":"2023-10-09T07:58:24.051322+0000","last_unstale":"2023-10-09T07:58:24.059673+0000","last_undegraded":"2023-10-09T07:58:24.059673+0000","last_fullsized":"2023-10-09T07:58:24.059673+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:36:00.365335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.032678+0000","last_change":"2023-10-09T07:58:23.041150+0000","last_active":"2023-10-09T07:58:24.032678+0000","last_peered":"2023-10-09T07:58:24.032678+0000","last_clean":"2023-10-09T07:58:24.032678+0000","last_became_active":"2023-10-09T07:58:23.040730+0000","last_became_peered":"2023-10-09T07:58:23.040730+0000","last_unstale":"2023-10-09T07:58:24.032678+0000","last_undegraded":"2023-10-09T07:58:24.032678+0000","last_fullsized":"2023-10-09T07:58:24.032678+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:13:21.744931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.042455+0000","last_change":"2023-10-09T07:58:24.038556+0000","last_active":"2023-10-09T07:58:24.042455+0000","last_peered":"2023-10-09T07:58:24.042455+0000","last_clean":"2023-10-09T07:58:24.042455+0000","last_became_active":"2023-10-09T07:58:24.038266+0000","last_became_peered":"2023-10-09T07:58:24.038266+0000","last_unstale":"2023-10-09T07:58:24.042455+0000","last_undegraded":"2023-10-09T07:58:24.042455+0000","last_fullsized":"2023-10-09T07:58:24.042455+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:20.483964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"175'6","reported_seq":16,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.056822+0000","last_change":"2023-10-09T07:58:23.032317+0000","last_active":"2023-10-09T07:58:24.056822+0000","last_peered":"2023-10-09T07:58:24.056822+0000","last_clean":"2023-10-09T07:58:24.056822+0000","last_became_active":"2023-10-09T07:58:23.032034+0000","last_became_peered":"2023-10-09T07:58:23.032034+0000","last_unstale":"2023-10-09T07:58:24.056822+0000","last_undegraded":"2023-10-09T07:58:24.056822+0000","last_fullsized":"2023-10-09T07:58:24.056822+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:01:27.509478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.052341+0000","last_change":"2023-10-09T07:58:24.049017+0000","last_active":"2023-10-09T07:58:24.052341+0000","last_peered":"2023-10-09T07:58:24.052341+0000","last_clean":"2023-10-09T07:58:24.052341+0000","last_became_active":"2023-10-09T07:58:24.048756+0000","last_became_peered":"2023-10-09T07:58:24.048756+0000","last_unstale":"2023-10-09T07:58:24.052341+0000","last_undegraded":"2023-10-09T07:58:24.052341+0000","last_fullsized":"2023-10-09T07:58:24.052341+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:40.222840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.059279+0000","last_change":"2023-10-09T07:58:23.041487+0000","last_active":"2023-10-09T07:58:24.059279+0000","last_peered":"2023-10-09T07:58:24.059279+0000","last_clean":"2023-10-09T07:58:24.059279+0000","last_became_active":"2023-10-09T07:58:23.040053+0000","last_became_peered":"2023-10-09T07:58:23.040053+0000","last_unstale":"2023-10-09T07:58:24.059279+0000","last_undegraded":"2023-10-09T07:58:24.059279+0000","last_fullsized":"2023-10-09T07:58:24.059279+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:45.601522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048659+0000","last_change":"2023-10-09T07:58:24.042838+0000","last_active":"2023-10-09T07:58:24.048659+0000","last_peered":"2023-10-09T07:58:24.048659+0000","last_clean":"2023-10-09T07:58:24.048659+0000","last_became_active":"2023-10-09T07:58:24.042573+0000","last_became_peered":"2023-10-09T07:58:24.042573+0000","last_unstale":"2023-10-09T07:58:24.048659+0000","last_undegraded":"2023-10-09T07:58:24.048659+0000","last_fullsized":"2023-10-09T07:58:24.048659+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:41:03.367914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.034055+0000","last_change":"2023-10-09T07:58:23.038603+0000","last_active":"2023-10-09T07:58:24.034055+0000","last_peered":"2023-10-09T07:58:24.034055+0000","last_clean":"2023-10-09T07:58:24.034055+0000","last_became_active":"2023-10-09T07:58:23.038346+0000","last_became_peered":"2023-10-09T07:58:23.038346+0000","last_unstale":"2023-10-09T07:58:24.034055+0000","last_undegraded":"2023-10-09T07:58:24.034055+0000","last_fullsized":"2023-10-09T07:58:24.034055+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:03.122620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.056928+0000","last_change":"2023-10-09T07:58:24.053339+0000","last_active":"2023-10-09T07:58:24.056928+0000","last_peered":"2023-10-09T07:58:24.056928+0000","last_clean":"2023-10-09T07:58:24.056928+0000","last_became_active":"2023-10-09T07:58:24.053023+0000","last_became_peered":"2023-10-09T07:58:24.053023+0000","last_unstale":"2023-10-09T07:58:24.056928+0000","last_undegraded":"2023-10-09T07:58:24.056928+0000","last_fullsized":"2023-10-09T07:58:24.056928+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:43:10.524882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.025872+0000","last_change":"2023-10-09T07:58:23.027831+0000","last_active":"2023-10-09T07:58:24.025872+0000","last_peered":"2023-10-09T07:58:24.025872+0000","last_clean":"2023-10-09T07:58:24.025872+0000","last_became_active":"2023-10-09T07:58:23.027573+0000","last_became_peered":"2023-10-09T07:58:23.027573+0000","last_unstale":"2023-10-09T07:58:24.025872+0000","last_undegraded":"2023-10-09T07:58:24.025872+0000","last_fullsized":"2023-10-09T07:58:24.025872+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:30.137019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.054070+0000","last_change":"2023-10-09T07:58:24.051875+0000","last_active":"2023-10-09T07:58:24.054070+0000","last_peered":"2023-10-09T07:58:24.054070+0000","last_clean":"2023-10-09T07:58:24.054070+0000","last_became_active":"2023-10-09T07:58:24.051460+0000","last_became_peered":"2023-10-09T07:58:24.051460+0000","last_unstale":"2023-10-09T07:58:24.054070+0000","last_undegraded":"2023-10-09T07:58:24.054070+0000","last_fullsized":"2023-10-09T07:58:24.054070+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:39:01.903400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"175'8","reported_seq":18,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.055611+0000","last_change":"2023-10-09T07:58:23.041105+0000","last_active":"2023-10-09T07:58:24.055611+0000","last_peered":"2023-10-09T07:58:24.055611+0000","last_clean":"2023-10-09T07:58:24.055611+0000","last_became_active":"2023-10-09T07:58:23.040899+0000","last_became_peered":"2023-10-09T07:58:23.040899+0000","last_unstale":"2023-10-09T07:58:24.055611+0000","last_undegraded":"2023-10-09T07:58:24.055611+0000","last_fullsized":"2023-10-09T07:58:24.055611+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:08:51.278424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.059030+0000","last_change":"2023-10-09T07:58:24.050364+0000","last_active":"2023-10-09T07:58:24.059030+0000","last_peered":"2023-10-09T07:58:24.059030+0000","last_clean":"2023-10-09T07:58:24.059030+0000","last_became_active":"2023-10-09T07:58:24.050015+0000","last_became_peered":"2023-10-09T07:58:24.050015+0000","last_unstale":"2023-10-09T07:58:24.059030+0000","last_undegraded":"2023-10-09T07:58:24.059030+0000","last_fullsized":"2023-10-09T07:58:24.059030+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:42:47.664106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048844+0000","last_change":"2023-10-09T07:58:23.037143+0000","last_active":"2023-10-09T07:58:24.048844+0000","last_peered":"2023-10-09T07:58:24.048844+0000","last_clean":"2023-10-09T07:58:24.048844+0000","last_became_active":"2023-10-09T07:58:23.036812+0000","last_became_peered":"2023-10-09T07:58:23.036812+0000","last_unstale":"2023-10-09T07:58:24.048844+0000","last_undegraded":"2023-10-09T07:58:24.048844+0000","last_fullsized":"2023-10-09T07:58:24.048844+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:40:38.871261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.055105+0000","last_change":"2023-10-09T07:58:24.053157+0000","last_active":"2023-10-09T07:58:24.055105+0000","last_peered":"2023-10-09T07:58:24.055105+0000","last_clean":"2023-10-09T07:58:24.055105+0000","last_became_active":"2023-10-09T07:58:24.052868+0000","last_became_peered":"2023-10-09T07:58:24.052868+0000","last_unstale":"2023-10-09T07:58:24.055105+0000","last_undegraded":"2023-10-09T07:58:24.055105+0000","last_fullsized":"2023-10-09T07:58:24.055105+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:41.116662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048825+0000","last_change":"2023-10-09T07:58:23.038559+0000","last_active":"2023-10-09T07:58:24.048825+0000","last_peered":"2023-10-09T07:58:24.048825+0000","last_clean":"2023-10-09T07:58:24.048825+0000","last_became_active":"2023-10-09T07:58:23.037968+0000","last_became_peered":"2023-10-09T07:58:23.037968+0000","last_unstale":"2023-10-09T07:58:24.048825+0000","last_undegraded":"2023-10-09T07:58:24.048825+0000","last_fullsized":"2023-10-09T07:58:24.048825+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:22.952454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.050837+0000","last_change":"2023-10-09T07:58:24.046156+0000","last_active":"2023-10-09T07:58:24.050837+0000","last_peered":"2023-10-09T07:58:24.050837+0000","last_clean":"2023-10-09T07:58:24.050837+0000","last_became_active":"2023-10-09T07:58:24.045897+0000","last_became_peered":"2023-10-09T07:58:24.045897+0000","last_unstale":"2023-10-09T07:58:24.050837+0000","last_undegraded":"2023-10-09T07:58:24.050837+0000","last_fullsized":"2023-10-09T07:58:24.050837+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:41:03.367914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.052803+0000","last_change":"2023-10-09T07:58:23.040353+0000","last_active":"2023-10-09T07:58:24.052803+0000","last_peered":"2023-10-09T07:58:24.052803+0000","last_clean":"2023-10-09T07:58:24.052803+0000","last_became_active":"2023-10-09T07:58:23.039961+0000","last_became_peered":"2023-10-09T07:58:23.039961+0000","last_unstale":"2023-10-09T07:58:24.052803+0000","last_undegraded":"2023-10-09T07:58:24.052803+0000","last_fullsized":"2023-10-09T07:58:24.052803+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:59.029087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.049602+0000","last_change":"2023-10-09T07:58:24.047359+0000","last_active":"2023-10-09T07:58:24.049602+0000","last_peered":"2023-10-09T07:58:24.049602+0000","last_clean":"2023-10-09T07:58:24.049602+0000","last_became_active":"2023-10-09T07:58:24.047026+0000","last_became_peered":"2023-10-09T07:58:24.047026+0000","last_unstale":"2023-10-09T07:58:24.049602+0000","last_undegraded":"2023-10-09T07:58:24.049602+0000","last_fullsized":"2023-10-09T07:58:24.049602+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:18.603205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.029490+0000","last_change":"2023-10-09T07:58:23.037621+0000","last_active":"2023-10-09T07:58:24.029490+0000","last_peered":"2023-10-09T07:58:24.029490+0000","last_clean":"2023-10-09T07:58:24.029490+0000","last_became_active":"2023-10-09T07:58:23.033543+0000","last_became_peered":"2023-10-09T07:58:23.033543+0000","last_unstale":"2023-10-09T07:58:24.029490+0000","last_undegraded":"2023-10-09T07:58:24.029490+0000","last_fullsized":"2023-10-09T07:58:24.029490+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:45.601522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.042939+0000","last_change":"2023-10-09T07:58:24.037237+0000","last_active":"2023-10-09T07:58:24.042939+0000","last_peered":"2023-10-09T07:58:24.042939+0000","last_clean":"2023-10-09T07:58:24.042939+0000","last_became_active":"2023-10-09T07:58:24.035826+0000","last_became_peered":"2023-10-09T07:58:24.035826+0000","last_unstale":"2023-10-09T07:58:24.042939+0000","last_undegraded":"2023-10-09T07:58:24.042939+0000","last_fullsized":"2023-10-09T07:58:24.042939+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:24:38.808909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.059199+0000","last_change":"2023-10-09T07:58:23.037844+0000","last_active":"2023-10-09T07:58:24.059199+0000","last_peered":"2023-10-09T07:58:24.059199+0000","last_clean":"2023-10-09T07:58:24.059199+0000","last_became_active":"2023-10-09T07:58:23.037598+0000","last_became_peered":"2023-10-09T07:58:23.037598+0000","last_unstale":"2023-10-09T07:58:24.059199+0000","last_undegraded":"2023-10-09T07:58:24.059199+0000","last_fullsized":"2023-10-09T07:58:24.059199+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:12.869232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037253+0000","last_change":"2023-10-09T07:58:24.033828+0000","last_active":"2023-10-09T07:58:24.037253+0000","last_peered":"2023-10-09T07:58:24.037253+0000","last_clean":"2023-10-09T07:58:24.037253+0000","last_became_active":"2023-10-09T07:58:24.033580+0000","last_became_peered":"2023-10-09T07:58:24.033580+0000","last_unstale":"2023-10-09T07:58:24.037253+0000","last_undegraded":"2023-10-09T07:58:24.037253+0000","last_fullsized":"2023-10-09T07:58:24.037253+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:27:48.279381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.031315+0000","last_change":"2023-10-09T07:58:23.044812+0000","last_active":"2023-10-09T07:58:24.031315+0000","last_peered":"2023-10-09T07:58:24.031315+0000","last_clean":"2023-10-09T07:58:24.031315+0000","last_became_active":"2023-10-09T07:58:23.044164+0000","last_became_peered":"2023-10-09T07:58:23.044164+0000","last_unstale":"2023-10-09T07:58:24.031315+0000","last_undegraded":"2023-10-09T07:58:24.031315+0000","last_fullsized":"2023-10-09T07:58:24.031315+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:36:16.840269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.045906+0000","last_change":"2023-10-09T07:58:24.044914+0000","last_active":"2023-10-09T07:58:24.045906+0000","last_peered":"2023-10-09T07:58:24.045906+0000","last_clean":"2023-10-09T07:58:24.045906+0000","last_became_active":"2023-10-09T07:58:24.043943+0000","last_became_peered":"2023-10-09T07:58:24.043943+0000","last_unstale":"2023-10-09T07:58:24.045906+0000","last_undegraded":"2023-10-09T07:58:24.045906+0000","last_fullsized":"2023-10-09T07:58:24.045906+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:40:39.880274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.034885+0000","last_change":"2023-10-09T07:58:23.041438+0000","last_active":"2023-10-09T07:58:24.034885+0000","last_peered":"2023-10-09T07:58:24.034885+0000","last_clean":"2023-10-09T07:58:24.034885+0000","last_became_active":"2023-10-09T07:58:23.041150+0000","last_became_peered":"2023-10-09T07:58:23.041150+0000","last_unstale":"2023-10-09T07:58:24.034885+0000","last_undegraded":"2023-10-09T07:58:24.034885+0000","last_fullsized":"2023-10-09T07:58:24.034885+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:21:04.355067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037265+0000","last_change":"2023-10-09T07:58:24.034230+0000","last_active":"2023-10-09T07:58:24.037265+0000","last_peered":"2023-10-09T07:58:24.037265+0000","last_clean":"2023-10-09T07:58:24.037265+0000","last_became_active":"2023-10-09T07:58:24.033758+0000","last_became_peered":"2023-10-09T07:58:24.033758+0000","last_unstale":"2023-10-09T07:58:24.037265+0000","last_undegraded":"2023-10-09T07:58:24.037265+0000","last_fullsized":"2023-10-09T07:58:24.037265+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:10:36.736260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.034817+0000","last_change":"2023-10-09T07:58:23.036069+0000","last_active":"2023-10-09T07:58:24.034817+0000","last_peered":"2023-10-09T07:58:24.034817+0000","last_clean":"2023-10-09T07:58:24.034817+0000","last_became_active":"2023-10-09T07:58:23.035817+0000","last_became_peered":"2023-10-09T07:58:23.035817+0000","last_unstale":"2023-10-09T07:58:24.034817+0000","last_undegraded":"2023-10-09T07:58:24.034817+0000","last_fullsized":"2023-10-09T07:58:24.034817+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:22.952454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.056958+0000","last_change":"2023-10-09T07:58:24.053951+0000","last_active":"2023-10-09T07:58:24.056958+0000","last_peered":"2023-10-09T07:58:24.056958+0000","last_clean":"2023-10-09T07:58:24.056958+0000","last_became_active":"2023-10-09T07:58:24.053707+0000","last_became_peered":"2023-10-09T07:58:24.053707+0000","last_unstale":"2023-10-09T07:58:24.056958+0000","last_undegraded":"2023-10-09T07:58:24.056958+0000","last_fullsized":"2023-10-09T07:58:24.056958+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:55.345084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.053699+0000","last_change":"2023-10-09T07:58:23.042969+0000","last_active":"2023-10-09T07:58:24.053699+0000","last_peered":"2023-10-09T07:58:24.053699+0000","last_clean":"2023-10-09T07:58:24.053699+0000","last_became_active":"2023-10-09T07:58:23.042710+0000","last_became_peered":"2023-10-09T07:58:23.042710+0000","last_unstale":"2023-10-09T07:58:24.053699+0000","last_undegraded":"2023-10-09T07:58:24.053699+0000","last_fullsized":"2023-10-09T07:58:24.053699+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:12:59.093538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.050926+0000","last_change":"2023-10-09T07:58:24.046834+0000","last_active":"2023-10-09T07:58:24.050926+0000","last_peered":"2023-10-09T07:58:24.050926+0000","last_clean":"2023-10-09T07:58:24.050926+0000","last_became_active":"2023-10-09T07:58:24.046543+0000","last_became_peered":"2023-10-09T07:58:24.046543+0000","last_unstale":"2023-10-09T07:58:24.050926+0000","last_undegraded":"2023-10-09T07:58:24.050926+0000","last_fullsized":"2023-10-09T07:58:24.050926+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:11:57.967753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T07:58:25.023822+0000","last_change":"2023-10-09T07:58:23.039543+0000","last_active":"2023-10-09T07:58:25.023822+0000","last_peered":"2023-10-09T07:58:25.023822+0000","last_clean":"2023-10-09T07:58:25.023822+0000","last_became_active":"2023-10-09T07:58:23.039245+0000","last_became_peered":"2023-10-09T07:58:23.039245+0000","last_unstale":"2023-10-09T07:58:25.023822+0000","last_undegraded":"2023-10-09T07:58:25.023822+0000","last_fullsized":"2023-10-09T07:58:25.023822+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:04.616687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.048679+0000","last_change":"2023-10-09T07:58:24.040483+0000","last_active":"2023-10-09T07:58:24.048679+0000","last_peered":"2023-10-09T07:58:24.048679+0000","last_clean":"2023-10-09T07:58:24.048679+0000","last_became_active":"2023-10-09T07:58:24.040215+0000","last_became_peered":"2023-10-09T07:58:24.040215+0000","last_unstale":"2023-10-09T07:58:24.048679+0000","last_undegraded":"2023-10-09T07:58:24.048679+0000","last_fullsized":"2023-10-09T07:58:24.048679+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:06:09.038401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.026095+0000","last_change":"2023-10-09T07:58:23.033638+0000","last_active":"2023-10-09T07:58:24.026095+0000","last_peered":"2023-10-09T07:58:24.026095+0000","last_clean":"2023-10-09T07:58:24.026095+0000","last_became_active":"2023-10-09T07:58:23.033359+0000","last_became_peered":"2023-10-09T07:58:23.033359+0000","last_unstale":"2023-10-09T07:58:24.026095+0000","last_undegraded":"2023-10-09T07:58:24.026095+0000","last_fullsized":"2023-10-09T07:58:24.026095+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:21:06.621088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037576+0000","last_change":"2023-10-09T07:58:24.033310+0000","last_active":"2023-10-09T07:58:24.037576+0000","last_peered":"2023-10-09T07:58:24.037576+0000","last_clean":"2023-10-09T07:58:24.037576+0000","last_became_active":"2023-10-09T07:58:24.033044+0000","last_became_peered":"2023-10-09T07:58:24.033044+0000","last_unstale":"2023-10-09T07:58:24.037576+0000","last_undegraded":"2023-10-09T07:58:24.037576+0000","last_fullsized":"2023-10-09T07:58:24.037576+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:30.145065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.025758+0000","last_change":"2023-10-09T07:58:23.034259+0000","last_active":"2023-10-09T07:58:24.025758+0000","last_peered":"2023-10-09T07:58:24.025758+0000","last_clean":"2023-10-09T07:58:24.025758+0000","last_became_active":"2023-10-09T07:58:23.033993+0000","last_became_peered":"2023-10-09T07:58:23.033993+0000","last_unstale":"2023-10-09T07:58:24.025758+0000","last_undegraded":"2023-10-09T07:58:24.025758+0000","last_fullsized":"2023-10-09T07:58:24.025758+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:36.449503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.040603+0000","last_change":"2023-10-09T07:58:24.034496+0000","last_active":"2023-10-09T07:58:24.040603+0000","last_peered":"2023-10-09T07:58:24.040603+0000","last_clean":"2023-10-09T07:58:24.040603+0000","last_became_active":"2023-10-09T07:58:24.034246+0000","last_became_peered":"2023-10-09T07:58:24.034246+0000","last_unstale":"2023-10-09T07:58:24.040603+0000","last_undegraded":"2023-10-09T07:58:24.040603+0000","last_fullsized":"2023-10-09T07:58:24.040603+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:09.684425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.022165+0000","last_change":"2023-10-09T07:58:23.035059+0000","last_active":"2023-10-09T07:58:24.022165+0000","last_peered":"2023-10-09T07:58:24.022165+0000","last_clean":"2023-10-09T07:58:24.022165+0000","last_became_active":"2023-10-09T07:58:23.034777+0000","last_became_peered":"2023-10-09T07:58:23.034777+0000","last_unstale":"2023-10-09T07:58:24.022165+0000","last_undegraded":"2023-10-09T07:58:24.022165+0000","last_fullsized":"2023-10-09T07:58:24.022165+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:35:59.356322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.043809+0000","last_change":"2023-10-09T07:58:24.042813+0000","last_active":"2023-10-09T07:58:24.043809+0000","last_peered":"2023-10-09T07:58:24.043809+0000","last_clean":"2023-10-09T07:58:24.043809+0000","last_became_active":"2023-10-09T07:58:24.042502+0000","last_became_peered":"2023-10-09T07:58:24.042502+0000","last_unstale":"2023-10-09T07:58:24.043809+0000","last_undegraded":"2023-10-09T07:58:24.043809+0000","last_fullsized":"2023-10-09T07:58:24.043809+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:34.959485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.031420+0000","last_change":"2023-10-09T07:58:23.043658+0000","last_active":"2023-10-09T07:58:24.031420+0000","last_peered":"2023-10-09T07:58:24.031420+0000","last_clean":"2023-10-09T07:58:24.031420+0000","last_became_active":"2023-10-09T07:58:23.043362+0000","last_became_peered":"2023-10-09T07:58:23.043362+0000","last_unstale":"2023-10-09T07:58:24.031420+0000","last_undegraded":"2023-10-09T07:58:24.031420+0000","last_fullsized":"2023-10-09T07:58:24.031420+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:39.852684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.059701+0000","last_change":"2023-10-09T07:58:24.053423+0000","last_active":"2023-10-09T07:58:24.059701+0000","last_peered":"2023-10-09T07:58:24.059701+0000","last_clean":"2023-10-09T07:58:24.059701+0000","last_became_active":"2023-10-09T07:58:24.052193+0000","last_became_peered":"2023-10-09T07:58:24.052193+0000","last_unstale":"2023-10-09T07:58:24.059701+0000","last_undegraded":"2023-10-09T07:58:24.059701+0000","last_fullsized":"2023-10-09T07:58:24.059701+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:50.645139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.031980+0000","last_change":"2023-10-09T07:58:23.041395+0000","last_active":"2023-10-09T07:58:24.031980+0000","last_peered":"2023-10-09T07:58:24.031980+0000","last_clean":"2023-10-09T07:58:24.031980+0000","last_became_active":"2023-10-09T07:58:23.040979+0000","last_became_peered":"2023-10-09T07:58:23.040979+0000","last_unstale":"2023-10-09T07:58:24.031980+0000","last_undegraded":"2023-10-09T07:58:24.031980+0000","last_fullsized":"2023-10-09T07:58:24.031980+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:56:38.332397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.035496+0000","last_change":"2023-10-09T07:58:24.034044+0000","last_active":"2023-10-09T07:58:24.035496+0000","last_peered":"2023-10-09T07:58:24.035496+0000","last_clean":"2023-10-09T07:58:24.035496+0000","last_became_active":"2023-10-09T07:58:24.033780+0000","last_became_peered":"2023-10-09T07:58:24.033780+0000","last_unstale":"2023-10-09T07:58:24.035496+0000","last_undegraded":"2023-10-09T07:58:24.035496+0000","last_fullsized":"2023-10-09T07:58:24.035496+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:48:29.551743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.030115+0000","last_change":"2023-10-09T07:58:23.041367+0000","last_active":"2023-10-09T07:58:24.030115+0000","last_peered":"2023-10-09T07:58:24.030115+0000","last_clean":"2023-10-09T07:58:24.030115+0000","last_became_active":"2023-10-09T07:58:23.041097+0000","last_became_peered":"2023-10-09T07:58:23.041097+0000","last_unstale":"2023-10-09T07:58:24.030115+0000","last_undegraded":"2023-10-09T07:58:24.030115+0000","last_fullsized":"2023-10-09T07:58:24.030115+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:44:28.217137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.037217+0000","last_change":"2023-10-09T07:58:24.033312+0000","last_active":"2023-10-09T07:58:24.037217+0000","last_peered":"2023-10-09T07:58:24.037217+0000","last_clean":"2023-10-09T07:58:24.037217+0000","last_became_active":"2023-10-09T07:58:24.033036+0000","last_became_peered":"2023-10-09T07:58:24.033036+0000","last_unstale":"2023-10-09T07:58:24.037217+0000","last_undegraded":"2023-10-09T07:58:24.037217+0000","last_fullsized":"2023-10-09T07:58:24.037217+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:23.010065+0000","last_clean_scrub_stamp":"2023-10-09T07:58:23.010065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:42.710219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"175'3","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.060642+0000","last_change":"2023-10-09T07:58:23.037183+0000","last_active":"2023-10-09T07:58:24.060642+0000","last_peered":"2023-10-09T07:58:24.060642+0000","last_clean":"2023-10-09T07:58:24.060642+0000","last_became_active":"2023-10-09T07:58:23.036838+0000","last_became_peered":"2023-10-09T07:58:23.036838+0000","last_unstale":"2023-10-09T07:58:24.060642+0000","last_undegraded":"2023-10-09T07:58:24.060642+0000","last_fullsized":"2023-10-09T07:58:24.060642+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T07:58:22.001051+0000","last_clean_scrub_stamp":"2023-10-09T07:58:22.001051+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:44:28.217137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"166'293","reported_seq":920,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T07:58:24.031991+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T07:58:24.031991+0000","last_peered":"2023-10-09T07:58:24.031991+0000","last_clean":"2023-10-09T07:58:24.031991+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T07:58:24.031991+0000","last_undegraded":"2023-10-09T07:58:24.031991+0000","last_fullsized":"2023-10-09T07:58:24.031991+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575752,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308212,"kb_used_data":2732,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063628,"statfs":{"total":96636764160,"available":96321155072,"internally_reserved":0,"allocated":2797568,"data_stored":1688396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.72799999999999998,"15min":0.752},"min":{"1min":0.45300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.127},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.749,"15min":0.76400000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.47399999999999998},"max":{"1min":0.98099999999999998,"5min":1.026,"15min":1.1319999999999999},"last":0.65800000000000003}]},{"osd":1,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.71899999999999997,"15min":0.73399999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.875,"5min":0.96599999999999997,"15min":1.077},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.751},"min":{"1min":0.50900000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92200000000000004,"5min":0.997,"15min":1.038},"last":0.63400000000000001}]},{"osd":2,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.96399999999999997,"5min":0.98999999999999999,"15min":1.0269999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.52800000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91500000000000004,"5min":0.98299999999999998,"15min":1.1899999999999999},"last":0.53800000000000003}]},{"osd":3,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.72199999999999998,"15min":0.73599999999999999},"min":{"1min":0.499,"5min":0.49399999999999999,"15min":0.42099999999999999},"max":{"1min":0.88900000000000001,"5min":0.995,"15min":1.04},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77600000000000002,"15min":0.79200000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.036,"5min":1.0529999999999999,"15min":1.0920000000000001},"last":0.70299999999999996}]},{"osd":4,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63800000000000001,"15min":0.626},"min":{"1min":0.47599999999999998,"5min":0.42199999999999999,"15min":0.36299999999999999},"max":{"1min":0.94099999999999995,"5min":0.97099999999999997,"15min":1.248},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.93700000000000006,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.68000000000000005}]},{"osd":5,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63900000000000001,"15min":0.65400000000000003},"min":{"1min":0.41399999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68799999999999994,"15min":0.69699999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.304},"last":0.72099999999999997}]},{"osd":6,"last update":"Mon Oct 9 07:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73899999999999999,"15min":0.75},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.405},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71099999999999997,"15min":0.71899999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.43099999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.377},"last":0.86399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575751,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311732,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060108,"statfs":{"total":96636764160,"available":96317550592,"internally_reserved":0,"allocated":2207744,"data_stored":1097550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.33600000000000002},"max":{"1min":0.93600000000000005,"5min":0.98399999999999999,"15min":1.012},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.75600000000000001,"15min":0.75},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84899999999999998,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.70899999999999996}]},{"osd":1,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76800000000000002,"15min":0.76900000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1100000000000001,"5min":1.113,"15min":1.2769999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.78700000000000003,"15min":0.76700000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.02,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.49199999999999999}]},{"osd":2,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.76000000000000001},"min":{"1min":0.55400000000000005,"5min":0.46100000000000002,"15min":0.432},"max":{"1min":1.0369999999999999,"5min":1.0589999999999999,"15min":1.075},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79200000000000004,"15min":0.77700000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.86499999999999999,"5min":1.151,"15min":1.151},"last":0.61699999999999999}]},{"osd":3,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76300000000000001,"15min":0.755},"min":{"1min":0.52700000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95299999999999996,"5min":1.423,"15min":1.423},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80200000000000005,"15min":0.78500000000000003},"min":{"1min":0.59699999999999998,"5min":0.55500000000000005,"15min":0.54100000000000004},"max":{"1min":1.0800000000000001,"5min":1.335,"15min":1.335},"last":0.63900000000000001}]},{"osd":4,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.36199999999999999},"max":{"1min":0.89800000000000002,"5min":0.97399999999999998,"15min":1.0960000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65900000000000003,"15min":0.65300000000000002},"min":{"1min":0.45500000000000002,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.91500000000000004,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.58899999999999997}]},{"osd":5,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.52400000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.137,"5min":1.306,"15min":1.306},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.48199999999999998,"5min":0.45400000000000001,"15min":0.42699999999999999},"max":{"1min":0.96599999999999997,"5min":1.054,"15min":1.085},"last":0.66600000000000004}]},{"osd":7,"last update":"Mon Oct 9 07:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69799999999999995,"15min":0.69199999999999995},"min":{"1min":0.51700000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.96799999999999997,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.755},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.74099999999999999,"15min":0.73799999999999999},"min":{"1min":0.498,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1639999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.78200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575752,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303532,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068308,"statfs":{"total":96636764160,"available":96325947392,"internally_reserved":0,"allocated":2199552,"data_stored":1097958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.47799999999999998,"15min":0.46600000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.71699999999999997,"5min":1.899,"15min":1.899},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.51900000000000002,"15min":0.505},"min":{"1min":0.34200000000000003,"5min":0.33500000000000002,"15min":0.313},"max":{"1min":1.016,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.41299999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.54200000000000004,"15min":0.51500000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64200000000000002,"5min":5.1159999999999997,"15min":5.1159999999999997},"last":0.495},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.628,"15min":0.59399999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.375},"max":{"1min":0.79300000000000004,"5min":5.399,"15min":5.399},"last":0.48599999999999999}]},{"osd":3,"last update":"Mon Oct 9 07:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.432,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84499999999999997,"5min":1.95,"15min":1.95},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58899999999999997,"15min":0.59399999999999997},"min":{"1min":0.40100000000000002,"5min":0.39900000000000002,"15min":0.37},"max":{"1min":1.0449999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.45900000000000002}]},{"osd":4,"last update":"Mon Oct 9 07:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.83399999999999996,"15min":0.80600000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.42699999999999999},"max":{"1min":1.0309999999999999,"5min":5.2409999999999997,"15min":5.2409999999999997},"last":0.877},{"interface":"front","average":{"1min":0.747,"5min":0.85399999999999998,"15min":0.82199999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.56699999999999995},"max":{"1min":0.98799999999999999,"5min":5.4409999999999998,"15min":5.4409999999999998},"last":0.69499999999999995}]},{"osd":5,"last update":"Mon Oct 9 07:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.81799999999999995,"15min":0.81100000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.52800000000000002},"max":{"1min":1.0880000000000001,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.83699999999999997,"15min":0.82199999999999995},"min":{"1min":0.59499999999999997,"5min":0.57999999999999996,"15min":0.442},"max":{"1min":1.016,"5min":5.1630000000000003,"15min":5.1630000000000003},"last":0.82299999999999995}]},{"osd":6,"last update":"Mon Oct 9 07:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.878,"15min":0.84099999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.55100000000000005},"max":{"1min":0.99099999999999999,"5min":5.4749999999999996,"15min":5.4749999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83299999999999996,"15min":0.83199999999999996},"min":{"1min":0.60999999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1319999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Mon Oct 9 07:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.871,"15min":0.875},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.56000000000000005},"max":{"1min":1.131,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.91500000000000004,"15min":0.88400000000000001},"min":{"1min":0.65500000000000003,"5min":0.63,"15min":0.55300000000000005},"max":{"1min":1.073,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":0.85399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575751,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308220,"kb_used_data":2740,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063620,"statfs":{"total":96636764160,"available":96321146880,"internally_reserved":0,"allocated":2805760,"data_stored":1689342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.48699999999999999,"15min":0.47499999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.52800000000000002,"5min":0.72099999999999997,"15min":0.80100000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53100000000000003,"15min":0.54500000000000004},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.32000000000000001},"max":{"1min":0.71099999999999997,"5min":0.82999999999999996,"15min":0.88200000000000001},"last":0.49399999999999999}]},{"osd":2,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56200000000000006,"15min":0.56499999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77800000000000002,"5min":0.83499999999999996,"15min":0.91800000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.60499999999999998,"5min":0.70599999999999996,"15min":0.82399999999999995},"last":0.43099999999999999}]},{"osd":3,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67900000000000005,"5min":0.78400000000000003,"15min":0.98599999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.74299999999999999,"5min":0.89600000000000002,"15min":0.94699999999999995},"last":0.45700000000000002}]},{"osd":4,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.52200000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.532},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81299999999999994,"15min":0.81999999999999995},"min":{"1min":0.626,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.202,"5min":1.202,"15min":1.2470000000000001},"last":0.628}]},{"osd":5,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79800000000000004,"15min":0.79900000000000004},"min":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.01,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.80600000000000005,"15min":0.81299999999999994},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.55500000000000005},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.3009999999999999},"last":0.60399999999999998}]},{"osd":6,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.84099999999999997,"15min":0.83799999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0860000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81599999999999995,"15min":0.81999999999999995},"min":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.51400000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.3859999999999999},"last":0.56200000000000006}]},{"osd":7,"last update":"Mon Oct 9 07:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.84099999999999997,"15min":0.85399999999999998},"min":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3380000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.877,"15min":0.86799999999999999},"min":{"1min":0.66000000000000003,"5min":0.61899999999999999,"15min":0.54400000000000004},"max":{"1min":1.131,"5min":1.218,"15min":1.3580000000000001},"last":0.63500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575751,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311736,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060104,"statfs":{"total":96636764160,"available":96317546496,"internally_reserved":0,"allocated":2211840,"data_stored":1099010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46000000000000002,"15min":0.47099999999999997},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52500000000000002,"15min":0.51400000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.40899999999999997}]},{"osd":1,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.48999999999999999,"15min":0.48699999999999999},"min":{"1min":0.40699999999999997,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.34599999999999997},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.98699999999999999},"last":0.61399999999999999}]},{"osd":3,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.625,"15min":0.61799999999999999},"min":{"1min":0.48199999999999998,"5min":0.46600000000000003,"15min":0.41399999999999998},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.45500000000000002,"5min":0.44500000000000001,"15min":0.40999999999999998},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.71399999999999997}]},{"osd":4,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81299999999999994,"15min":0.80000000000000004},"min":{"1min":0.56499999999999995,"5min":0.56299999999999994,"15min":0.54500000000000004},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79200000000000004,"15min":0.78300000000000003},"min":{"1min":0.59799999999999998,"5min":0.54000000000000004,"15min":0.47799999999999998},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":0.76600000000000001}]},{"osd":5,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.81299999999999994,"15min":0.79100000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.296,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.81599999999999995},"min":{"1min":0.63100000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0269999999999999,"5min":1.254,"15min":1.254},"last":1.0289999999999999}]},{"osd":6,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.82299999999999995,"15min":0.80900000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.54100000000000004},"max":{"1min":0.99399999999999999,"5min":1.1639999999999999,"15min":1.296},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82899999999999996,"15min":0.81999999999999995},"min":{"1min":0.629,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2230000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.0429999999999999}]},{"osd":7,"last update":"Mon Oct 9 07:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.85299999999999998,"15min":0.84099999999999997},"min":{"1min":0.63200000000000001,"5min":0.56499999999999995,"15min":0.53600000000000003},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.89500000000000002,"15min":0.877},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.94399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575752,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311724,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060116,"statfs":{"total":96636764160,"available":96317558784,"internally_reserved":0,"allocated":2199552,"data_stored":1097494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.47399999999999998,"15min":0.48499999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63700000000000001,"5min":0.77100000000000002,"15min":0.80700000000000005},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.32300000000000001},"max":{"1min":0.76400000000000001,"5min":0.85399999999999998,"15min":0.91700000000000004},"last":0.53300000000000003}]},{"osd":1,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48299999999999998,"15min":0.498},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.84699999999999998},"last":0.504},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80100000000000005,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.48299999999999998}]},{"osd":2,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57699999999999996,"15min":0.58999999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.34999999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.90900000000000003},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.40899999999999997},"max":{"1min":0.81299999999999994,"5min":0.83799999999999997,"15min":0.95799999999999996},"last":0.58999999999999997}]},{"osd":4,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.77100000000000002,"15min":0.77400000000000002},"min":{"1min":0.55500000000000005,"5min":0.55000000000000004,"15min":0.47499999999999998},"max":{"1min":1.03,"5min":1.121,"15min":1.246},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.85099999999999998,"15min":0.85299999999999998},"min":{"1min":0.63800000000000001,"5min":0.629,"15min":0.57799999999999996},"max":{"1min":1.0780000000000001,"5min":1.1419999999999999,"15min":1.157},"last":0.92800000000000005}]},{"osd":5,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.76200000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.48499999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.1910000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.48899999999999999},"max":{"1min":1.073,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.96499999999999997}]},{"osd":6,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80200000000000005,"15min":0.79700000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.495},"max":{"1min":1.05,"5min":1.149,"15min":1.149},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.80900000000000005,"15min":0.81299999999999994},"min":{"1min":0.59299999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.099,"5min":1.103,"15min":1.2230000000000001},"last":0.89500000000000002}]},{"osd":7,"last update":"Mon Oct 9 07:57:49 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84499999999999997,"15min":0.84799999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.53100000000000003},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.2430000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.85199999999999998,"15min":0.85099999999999998},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.56699999999999995},"max":{"1min":1.181,"5min":1.181,"15min":1.1850000000000001},"last":0.98399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575751,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299432,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072408,"statfs":{"total":96636764160,"available":96330145792,"internally_reserved":0,"allocated":2195456,"data_stored":1097404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90300000000000002,"5min":0.97499999999999998,"15min":1.0700000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.73999999999999999,"15min":0.754},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77500000000000002,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.97099999999999997}]},{"osd":1,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.73599999999999999,"15min":0.73099999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97799999999999998,"5min":1.038,"15min":1.0640000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.73799999999999999,"15min":0.74099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.81299999999999994,"5min":1.028,"15min":1.038},"last":0.84199999999999997}]},{"osd":2,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.79400000000000004,"15min":0.78700000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88200000000000001,"5min":0.999,"15min":1.0509999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79500000000000004,"15min":0.79700000000000004},"min":{"1min":0.60399999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.94099999999999995,"5min":1.069,"15min":1.069},"last":0.98699999999999999}]},{"osd":3,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.76000000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91800000000000004,"5min":1.131,"15min":1.131},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.014,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.94099999999999995}]},{"osd":5,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61599999999999999,"15min":0.59399999999999997},"min":{"1min":0.438,"5min":0.372,"15min":0.36299999999999999},"max":{"1min":1.0009999999999999,"5min":1.27,"15min":1.27},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.626,"15min":0.61699999999999999},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95299999999999996,"5min":1.014,"15min":1.014},"last":0.67400000000000004}]},{"osd":6,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65700000000000003,"15min":0.63700000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.41699999999999998},"max":{"1min":1.0449999999999999,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67900000000000005,"15min":0.66300000000000003},"min":{"1min":0.47599999999999998,"5min":0.45500000000000002,"15min":0.39000000000000001},"max":{"1min":0.89400000000000002,"5min":1.425,"15min":1.425},"last":0.75800000000000001}]},{"osd":7,"last update":"Mon Oct 9 07:57:48 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.58699999999999997,"5min":0.48699999999999999,"15min":0.47999999999999998},"max":{"1min":0.92300000000000004,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.78300000000000003,"15min":0.76200000000000001},"min":{"1min":0.63900000000000001,"5min":0.51200000000000001,"15min":0.46600000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.872}]}]},{"osd":5,"up_from":13,"seq":55834575752,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311724,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060116,"statfs":{"total":96636764160,"available":96317558784,"internally_reserved":0,"allocated":2199552,"data_stored":1097426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73499999999999999,"15min":0.72999999999999998},"min":{"1min":0.46500000000000002,"5min":0.46200000000000002,"15min":0.39100000000000001},"max":{"1min":1.016,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.73099999999999998,"15min":0.72199999999999998},"min":{"1min":0.51000000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97299999999999998,"5min":0.98799999999999999,"15min":1.0820000000000001},"last":0.84399999999999997}]},{"osd":1,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.73499999999999999,"15min":0.72799999999999998},"min":{"1min":0.54600000000000004,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":0.92800000000000005,"5min":0.97499999999999998,"15min":1.0129999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.748,"15min":0.751},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.0289999999999999},"last":0.73399999999999999}]},{"osd":2,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76500000000000001,"15min":0.75700000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.46800000000000003},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.98599999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73699999999999999,"15min":0.74299999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.44500000000000001},"max":{"1min":0.89300000000000002,"5min":0.96399999999999997,"15min":1.026},"last":0.79700000000000004}]},{"osd":3,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.47499999999999998},"max":{"1min":0.89900000000000002,"5min":0.97399999999999998,"15min":1.107},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79500000000000004,"15min":0.78600000000000003},"min":{"1min":0.58299999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.90500000000000003}]},{"osd":4,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.84099999999999997,"5min":1.002,"15min":1.0189999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.38800000000000001,"15min":0.379},"max":{"1min":0.90700000000000003,"5min":0.96199999999999997,"15min":1.0289999999999999},"last":0.77000000000000002}]},{"osd":6,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.44900000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69299999999999995,"15min":0.68400000000000005},"min":{"1min":0.48299999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.97799999999999998,"5min":0.99299999999999999,"15min":1.054},"last":0.88700000000000001}]},{"osd":7,"last update":"Mon Oct 9 07:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70799999999999996,"15min":0.69899999999999995},"min":{"1min":0.46999999999999997,"5min":0.45000000000000001,"15min":0.433},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.79000000000000004,"15min":0.78700000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.5},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.93100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T07:58:33.617 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T07:58:33.618 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T07:58:33.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.836+0000 7fd8d23ff700 1 Processor -- start 2023-10-09T07:58:33.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.836+0000 7fd8d23ff700 1 -- start start 2023-10-09T07:58:33.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.837+0000 7fd8d23ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd8cc157630 0x7fd8cc158a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:33.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.837+0000 7fd8d23ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd8cc157a00 0x7fd8cc0abd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:33.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.837+0000 7fd8d23ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8cc158590 con 0x7fd8cc0ac290 2023-10-09T07:58:33.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.837+0000 7fd8d23ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8cc157f80 con 0x7fd8cc157a00 2023-10-09T07:58:33.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.837+0000 7fd8d23ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8cc0ac7a0 con 0x7fd8cc157630 2023-10-09T07:58:33.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.838+0000 7fd8c3fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd8cc157a00 0x7fd8cc0abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:33.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.838+0000 7fd8c3fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd8cc157a00 0x7fd8cc0abd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42858/0 (socket says 172.21.15.71:42858) 2023-10-09T07:58:33.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.838+0000 7fd8d099c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd8cc0ac290 0x7fd8cc068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53540/0 (socket says 172.21.15.71:53540) 2023-10-09T07:58:33.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.838+0000 7fd8c3fff700 1 -- 172.21.15.71:0/2116754370 learned_addr learned my addr 172.21.15.71:0/2116754370 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:33.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.838+0000 7fd8cbfff700 1 --2- 172.21.15.71:0/2116754370 >> v2:172.21.15.179:3300/0 conn(0x7fd8cc157630 0x7fd8cc158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:33.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.838+0000 7fd8c3fff700 1 -- 172.21.15.71:0/2116754370 >> v2:172.21.15.179:3300/0 conn(0x7fd8cc157630 msgr2=0x7fd8cc158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:33.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.838+0000 7fd8c3fff700 1 --2- 172.21.15.71:0/2116754370 >> v2:172.21.15.179:3300/0 conn(0x7fd8cc157630 0x7fd8cc158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:33.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.838+0000 7fd8c3fff700 1 -- 172.21.15.71:0/2116754370 >> v1:172.21.15.71:6789/0 conn(0x7fd8cc0ac290 legacy=0x7fd8cc068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:33.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.838+0000 7fd8c3fff700 1 -- 172.21.15.71:0/2116754370 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8cc158220 con 0x7fd8cc157a00 2023-10-09T07:58:33.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.838+0000 7fd8c3fff700 1 --2- 172.21.15.71:0/2116754370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8cc157a00 0x7fd8cc0abd50 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc0cd5b0 tx=0x7fd8b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9121a854ace04656 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:33.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.838+0000 7fd8cb7fe700 1 -- 172.21.15.71:0/2116754370 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b400b860 con 0x7fd8cc157a00 2023-10-09T07:58:33.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.839+0000 7fd8cb7fe700 1 -- 172.21.15.71:0/2116754370 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b400b9c0 con 0x7fd8cc157a00 2023-10-09T07:58:33.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.839+0000 7fd8cb7fe700 1 -- 172.21.15.71:0/2116754370 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b400bd60 con 0x7fd8cc157a00 2023-10-09T07:58:33.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.839+0000 7fd8d23ff700 1 -- 172.21.15.71:0/2116754370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8cc157a00 msgr2=0x7fd8cc0abd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:33.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.839+0000 7fd8d23ff700 1 --2- 172.21.15.71:0/2116754370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8cc157a00 0x7fd8cc0abd50 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc0cd5b0 tx=0x7fd8b4009250 comp rx=0 tx=0).stop 2023-10-09T07:58:33.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.839+0000 7fd8d23ff700 1 -- 172.21.15.71:0/2116754370 shutdown_connections 2023-10-09T07:58:33.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.839+0000 7fd8d23ff700 1 --2- 172.21.15.71:0/2116754370 >> v2:172.21.15.179:3300/0 conn(0x7fd8cc157630 0x7fd8cc158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:33.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.839+0000 7fd8d23ff700 1 --2- 172.21.15.71:0/2116754370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8cc157a00 0x7fd8cc0abd50 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:33.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.839+0000 7fd8d23ff700 1 -- 172.21.15.71:0/2116754370 >> 172.21.15.71:0/2116754370 conn(0x7fd8cc0cc540 msgr2=0x7fd8cc0cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:33.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.839+0000 7fd8d23ff700 1 -- 172.21.15.71:0/2116754370 shutdown_connections 2023-10-09T07:58:33.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.839+0000 7fd8d23ff700 1 -- 172.21.15.71:0/2116754370 wait complete. 2023-10-09T07:58:33.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.841+0000 7fd8d23ff700 1 Processor -- start 2023-10-09T07:58:33.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.841+0000 7fd8d23ff700 1 -- start start 2023-10-09T07:58:33.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.842+0000 7fd8d23ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8cc0ac290 0x7fd8cc154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:33.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.842+0000 7fd8d23ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8cc157630 0x7fd8cc169ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:33.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.842+0000 7fd8d23ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8cc157a00 0x7fd8cc06e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:33.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.842+0000 7fd8d23ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc16d4d0 con 0x7fd8cc157630 2023-10-09T07:58:33.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.842+0000 7fd8d23ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc16da90 con 0x7fd8cc157a00 2023-10-09T07:58:33.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.842+0000 7fd8d23ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc16a9b0 con 0x7fd8cc0ac290 2023-10-09T07:58:33.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.842+0000 7fd8c3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8cc157630 0x7fd8cc169ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:33.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.842+0000 7fd8c3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8cc157630 0x7fd8cc169ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42874/0 (socket says 172.21.15.71:42874) 2023-10-09T07:58:33.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.842+0000 7fd8c3fff700 1 -- 172.21.15.71:0/992904791 learned_addr learned my addr 172.21.15.71:0/992904791 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:33.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.842+0000 7fd8cbfff700 1 --2- 172.21.15.71:0/992904791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8cc0ac290 0x7fd8cc154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:33.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.842+0000 7fd8c3fff700 1 -- 172.21.15.71:0/992904791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8cc0ac290 msgr2=0x7fd8cc154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:33.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.842+0000 7fd8d099c700 1 --2- 172.21.15.71:0/992904791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8cc157a00 0x7fd8cc06e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:33.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.842+0000 7fd8c3fff700 1 --2- 172.21.15.71:0/992904791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8cc0ac290 0x7fd8cc154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:33.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.842+0000 7fd8c3fff700 1 -- 172.21.15.71:0/992904791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8cc157a00 msgr2=0x7fd8cc06e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:33.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.842+0000 7fd8c3fff700 1 --2- 172.21.15.71:0/992904791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8cc157a00 0x7fd8cc06e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:33.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.842+0000 7fd8c3fff700 1 -- 172.21.15.71:0/992904791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b40094f0 con 0x7fd8cc157630 2023-10-09T07:58:33.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.842+0000 7fd8cbfff700 1 --2- 172.21.15.71:0/992904791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8cc0ac290 0x7fd8cc154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:33.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.842+0000 7fd8d099c700 1 --2- 172.21.15.71:0/992904791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8cc157a00 0x7fd8cc06e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:33.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.843+0000 7fd8c3fff700 1 --2- 172.21.15.71:0/992904791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8cc157630 0x7fd8cc169ef0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc06a9e0 tx=0x7fd8b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:33.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.843+0000 7fd8c8ff9700 1 -- 172.21.15.71:0/992904791 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4011e60 con 0x7fd8cc157630 2023-10-09T07:58:33.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.843+0000 7fd8c8ff9700 1 -- 172.21.15.71:0/992904791 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b401a630 con 0x7fd8cc157630 2023-10-09T07:58:33.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.843+0000 7fd8d23ff700 1 -- 172.21.15.71:0/992904791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8cc16ac90 con 0x7fd8cc157630 2023-10-09T07:58:33.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.843+0000 7fd8c8ff9700 1 -- 172.21.15.71:0/992904791 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b401a9f0 con 0x7fd8cc157630 2023-10-09T07:58:33.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.843+0000 7fd8d23ff700 1 -- 172.21.15.71:0/992904791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8cc154bd0 con 0x7fd8cc157630 2023-10-09T07:58:33.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.844+0000 7fd8d23ff700 1 -- 172.21.15.71:0/992904791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8cc0718b0 con 0x7fd8cc157630 2023-10-09T07:58:33.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.845+0000 7fd8c8ff9700 1 -- 172.21.15.71:0/992904791 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8b402d440 con 0x7fd8cc157630 2023-10-09T07:58:33.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.846+0000 7fd8c8ff9700 1 --2- 172.21.15.71:0/992904791 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd8ac066f30 0x7fd8ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:33.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.846+0000 7fd8c8ff9700 1 -- 172.21.15.71:0/992904791 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fd8b40861e0 con 0x7fd8cc157630 2023-10-09T07:58:33.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.846+0000 7fd8cbfff700 1 --2- 172.21.15.71:0/992904791 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd8ac066f30 0x7fd8ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:33.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.847+0000 7fd8cbfff700 1 --2- 172.21.15.71:0/992904791 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd8ac066f30 0x7fd8ac0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc006fd0 tx=0x7fd8bc008040 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:33.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:33.850+0000 7fd8c8ff9700 1 -- 172.21.15.71:0/992904791 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8b4053280 con 0x7fd8cc157630 2023-10-09T07:58:34.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.119+0000 7fd8d23ff700 1 -- 172.21.15.71:0/992904791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd8cc0aca80 con 0x7fd8cc157630 2023-10-09T07:58:34.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.124+0000 7fd8c8ff9700 1 -- 172.21.15.71:0/992904791 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v42) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd8b40568a0 con 0x7fd8cc157630 2023-10-09T07:58:34.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.126+0000 7fd8d23ff700 1 -- 172.21.15.71:0/992904791 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd8ac066f30 msgr2=0x7fd8ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:34.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.126+0000 7fd8d23ff700 1 --2- 172.21.15.71:0/992904791 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd8ac066f30 0x7fd8ac0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc006fd0 tx=0x7fd8bc008040 comp rx=0 tx=0).stop 2023-10-09T07:58:34.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.126+0000 7fd8d23ff700 1 -- 172.21.15.71:0/992904791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8cc157630 msgr2=0x7fd8cc169ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:34.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.126+0000 7fd8d23ff700 1 --2- 172.21.15.71:0/992904791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8cc157630 0x7fd8cc169ef0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc06a9e0 tx=0x7fd8b4017000 comp rx=0 tx=0).stop 2023-10-09T07:58:34.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.126+0000 7fd8d23ff700 1 -- 172.21.15.71:0/992904791 shutdown_connections 2023-10-09T07:58:34.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.126+0000 7fd8d23ff700 1 --2- 172.21.15.71:0/992904791 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7fd8ac066f30 0x7fd8ac0693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:34.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.126+0000 7fd8d23ff700 1 --2- 172.21.15.71:0/992904791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8cc157a00 0x7fd8cc06e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:34.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.126+0000 7fd8d23ff700 1 --2- 172.21.15.71:0/992904791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8cc0ac290 0x7fd8cc154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:34.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.126+0000 7fd8d23ff700 1 --2- 172.21.15.71:0/992904791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8cc157630 0x7fd8cc169ef0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:34.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.126+0000 7fd8d23ff700 1 -- 172.21.15.71:0/992904791 >> 172.21.15.71:0/992904791 conn(0x7fd8cc0cc540 msgr2=0x7fd8cc156b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:34.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.126+0000 7fd8d23ff700 1 -- 172.21.15.71:0/992904791 shutdown_connections 2023-10-09T07:58:34.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.126+0000 7fd8d23ff700 1 -- 172.21.15.71:0/992904791 wait complete. 2023-10-09T07:58:34.130 INFO:teuthology.orchestra.run.smithi071.stderr:updated caps for client.0 2023-10-09T07:58:34.145 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T07:58:34.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.326+0000 7f921fbff700 1 Processor -- start 2023-10-09T07:58:34.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.327+0000 7f921fbff700 1 -- start start 2023-10-09T07:58:34.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.328+0000 7f921fbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9218159720 0x7f9218159af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:34.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.328+0000 7f921fbff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92180ab950 con 0x7f92180ab4e0 2023-10-09T07:58:34.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.328+0000 7f921fbff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92180ac020 con 0x7f92180ad250 2023-10-09T07:58:34.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.328+0000 7f921fbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92180aa440 con 0x7f9218159720 2023-10-09T07:58:34.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.328+0000 7f921d19a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f92180ab4e0 0x7f92180a98d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53548/0 (socket says 172.21.15.71:53548) 2023-10-09T07:58:34.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.328+0000 7f921d19a700 1 -- 172.21.15.71:0/2459712218 learned_addr learned my addr 172.21.15.71:0/2459712218 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:34.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.328+0000 7f921d99b700 1 --2- 172.21.15.71:0/2459712218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9218159720 0x7f9218159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:34.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.329+0000 7f921c999700 1 -- 172.21.15.71:0/2459712218 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4053550377 0 0) 0x7f92180ab950 con 0x7f92180ab4e0 2023-10-09T07:58:34.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.329+0000 7f921c999700 1 -- 172.21.15.71:0/2459712218 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9204003570 con 0x7f92180ab4e0 2023-10-09T07:58:34.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.329+0000 7f921c999700 1 -- 172.21.15.71:0/2459712218 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151528806 0 0) 0x7f92180ac020 con 0x7f92180ad250 2023-10-09T07:58:34.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.329+0000 7f921c999700 1 -- 172.21.15.71:0/2459712218 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92180ab950 con 0x7f92180ad250 2023-10-09T07:58:34.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.329+0000 7f921d99b700 1 -- 172.21.15.71:0/2459712218 >> v1:172.21.15.179:6789/0 conn(0x7f92180ad250 legacy=0x7f92180af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:34.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.329+0000 7f921d99b700 1 -- 172.21.15.71:0/2459712218 >> v1:172.21.15.71:6789/0 conn(0x7f92180ab4e0 legacy=0x7f92180a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:34.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.329+0000 7f921d99b700 1 -- 172.21.15.71:0/2459712218 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92180aa720 con 0x7f9218159720 2023-10-09T07:58:34.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.329+0000 7f921d99b700 1 --2- 172.21.15.71:0/2459712218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9218159720 0x7f9218159af0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9214009910 tx=0x7f92140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63c0e9288d14cdc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:34.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.329+0000 7f921c999700 1 -- 172.21.15.71:0/2459712218 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9214011630 con 0x7f9218159720 2023-10-09T07:58:34.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.329+0000 7f921c999700 1 -- 172.21.15.71:0/2459712218 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9214011790 con 0x7f9218159720 2023-10-09T07:58:34.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.329+0000 7f921c999700 1 -- 172.21.15.71:0/2459712218 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9214011b30 con 0x7f9218159720 2023-10-09T07:58:34.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.330+0000 7f921fbff700 1 -- 172.21.15.71:0/2459712218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9218159720 msgr2=0x7f9218159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:34.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.330+0000 7f921fbff700 1 --2- 172.21.15.71:0/2459712218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9218159720 0x7f9218159af0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9214009910 tx=0x7f92140091a0 comp rx=0 tx=0).stop 2023-10-09T07:58:34.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.330+0000 7f921fbff700 1 -- 172.21.15.71:0/2459712218 shutdown_connections 2023-10-09T07:58:34.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.330+0000 7f921fbff700 1 --2- 172.21.15.71:0/2459712218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9218159720 0x7f9218159af0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:34.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.330+0000 7f921fbff700 1 -- 172.21.15.71:0/2459712218 >> 172.21.15.71:0/2459712218 conn(0x7f921806a320 msgr2=0x7f92180cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:34.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.330+0000 7f921fbff700 1 -- 172.21.15.71:0/2459712218 shutdown_connections 2023-10-09T07:58:34.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.330+0000 7f921fbff700 1 -- 172.21.15.71:0/2459712218 wait complete. 2023-10-09T07:58:34.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.332+0000 7f921fbff700 1 Processor -- start 2023-10-09T07:58:34.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.332+0000 7f921fbff700 1 -- start start 2023-10-09T07:58:34.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.333+0000 7f921fbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92180ab4e0 0x7f92181477a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:34.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.333+0000 7f921fbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92180ad250 0x7f92181483c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:34.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.333+0000 7f921fbff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9218159720 0x7f9218148900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:34.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.333+0000 7f921fbff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92181558d0 con 0x7f9218159720 2023-10-09T07:58:34.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.333+0000 7f921fbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9218155b20 con 0x7f92180ab4e0 2023-10-09T07:58:34.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.333+0000 7f921fbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9218155e00 con 0x7f92180ad250 2023-10-09T07:58:34.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.333+0000 7f921e19c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9218159720 0x7f9218148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:34.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.333+0000 7f921e19c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9218159720 0x7f9218148900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42882/0 (socket says 172.21.15.71:42882) 2023-10-09T07:58:34.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.333+0000 7f921e19c700 1 -- 172.21.15.71:0/1454471915 learned_addr learned my addr 172.21.15.71:0/1454471915 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:34.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.333+0000 7f921d19a700 1 --2- 172.21.15.71:0/1454471915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92180ad250 0x7f92181483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:34.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.333+0000 7f921d99b700 1 --2- 172.21.15.71:0/1454471915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92180ab4e0 0x7f92181477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:34.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.333+0000 7f921e19c700 1 -- 172.21.15.71:0/1454471915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92180ad250 msgr2=0x7f92181483c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:34.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.333+0000 7f921e19c700 1 --2- 172.21.15.71:0/1454471915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92180ad250 0x7f92181483c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:34.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.333+0000 7f921e19c700 1 -- 172.21.15.71:0/1454471915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92180ab4e0 msgr2=0x7f92181477a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:34.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.333+0000 7f921e19c700 1 --2- 172.21.15.71:0/1454471915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92180ab4e0 0x7f92181477a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:34.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.333+0000 7f921e19c700 1 -- 172.21.15.71:0/1454471915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9214009420 con 0x7f9218159720 2023-10-09T07:58:34.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.334+0000 7f921e19c700 1 --2- 172.21.15.71:0/1454471915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9218159720 0x7f9218148900 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f921000c910 tx=0x7f92100027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:34.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.334+0000 7f920dffb700 1 -- 172.21.15.71:0/1454471915 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921000a7e0 con 0x7f9218159720 2023-10-09T07:58:34.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.334+0000 7f920dffb700 1 -- 172.21.15.71:0/1454471915 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921000a960 con 0x7f9218159720 2023-10-09T07:58:34.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.334+0000 7f921fbff700 1 -- 172.21.15.71:0/1454471915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92181560e0 con 0x7f9218159720 2023-10-09T07:58:34.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.334+0000 7f920dffb700 1 -- 172.21.15.71:0/1454471915 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921000ad20 con 0x7f9218159720 2023-10-09T07:58:34.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.334+0000 7f921fbff700 1 -- 172.21.15.71:0/1454471915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92181566a0 con 0x7f9218159720 2023-10-09T07:58:34.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.335+0000 7f921fbff700 1 -- 172.21.15.71:0/1454471915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921804c3c0 con 0x7f9218159720 2023-10-09T07:58:34.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.336+0000 7f920dffb700 1 -- 172.21.15.71:0/1454471915 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9210012630 con 0x7f9218159720 2023-10-09T07:58:34.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.337+0000 7f920dffb700 1 --2- 172.21.15.71:0/1454471915 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f91fc066f30 0x7f91fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:34.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.337+0000 7f920dffb700 1 -- 172.21.15.71:0/1454471915 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f9210084c00 con 0x7f9218159720 2023-10-09T07:58:34.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.337+0000 7f921d99b700 1 --2- 172.21.15.71:0/1454471915 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f91fc066f30 0x7f91fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:34.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.338+0000 7f921d99b700 1 --2- 172.21.15.71:0/1454471915 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f91fc066f30 0x7f91fc0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92140091e0 tx=0x7f9214017000 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:34.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.341+0000 7f920dffb700 1 -- 172.21.15.71:0/1454471915 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9210051c00 con 0x7f9218159720 2023-10-09T07:58:34.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.575+0000 7f921fbff700 1 -- 172.21.15.71:0/1454471915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92180aaa00 con 0x7f9218159720 2023-10-09T07:58:34.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.576+0000 7f920dffb700 1 -- 172.21.15.71:0/1454471915 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f9210055220 con 0x7f9218159720 2023-10-09T07:58:34.577 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T07:58:34.577 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/845996701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":845996701},{"type":"v1","addr":"172.21.15.179:6834","nonce":845996701}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8683,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2670735121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2670735121},{"type":"v1","addr":"172.21.15.179:6836","nonce":2670735121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":9084,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/2448704931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2448704931},{"type":"v1","addr":"172.21.15.71:6834","nonce":2448704931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:58:23.490596+0000","modified":"2023-10-09T07:58:27.045250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9087},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9087":{"gid":9087,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/1497898467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":1497898467},{"type":"v1","addr":"172.21.15.71:6835","nonce":1497898467}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T07:58:34.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.578+0000 7f921fbff700 1 -- 172.21.15.71:0/1454471915 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f91fc066f30 msgr2=0x7f91fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:34.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.578+0000 7f921fbff700 1 --2- 172.21.15.71:0/1454471915 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f91fc066f30 0x7f91fc0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92140091e0 tx=0x7f9214017000 comp rx=0 tx=0).stop 2023-10-09T07:58:34.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.578+0000 7f921fbff700 1 -- 172.21.15.71:0/1454471915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9218159720 msgr2=0x7f9218148900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:34.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.578+0000 7f921fbff700 1 --2- 172.21.15.71:0/1454471915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9218159720 0x7f9218148900 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f921000c910 tx=0x7f92100027a0 comp rx=0 tx=0).stop 2023-10-09T07:58:34.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.578+0000 7f921fbff700 1 -- 172.21.15.71:0/1454471915 shutdown_connections 2023-10-09T07:58:34.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.578+0000 7f921fbff700 1 --2- 172.21.15.71:0/1454471915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9218159720 0x7f9218148900 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:34.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.578+0000 7f921fbff700 1 --2- 172.21.15.71:0/1454471915 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f91fc066f30 0x7f91fc0693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:34.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.578+0000 7f921fbff700 1 --2- 172.21.15.71:0/1454471915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92180ab4e0 0x7f92181477a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:34.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.578+0000 7f921fbff700 1 --2- 172.21.15.71:0/1454471915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92180ad250 0x7f92181483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:34.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.578+0000 7f921fbff700 1 -- 172.21.15.71:0/1454471915 >> 172.21.15.71:0/1454471915 conn(0x7f921806a320 msgr2=0x7f92180a98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:34.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.578+0000 7f921fbff700 1 -- 172.21.15.71:0/1454471915 shutdown_connections 2023-10-09T07:58:34.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:34.578+0000 7f921fbff700 1 -- 172.21.15.71:0/1454471915 wait complete. 2023-10-09T07:58:34.580 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 82 2023-10-09T07:58:35.000 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 82, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T07:58:23.490596+0000', 'modified': '2023-10-09T07:58:27.045250+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9087}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9087': {'gid': 9087, 'name': 'c', 'rank': 0, 'incarnation': 79, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.71:6835/1497898467', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6833', 'nonce': 1497898467}, {'type': 'v1', 'addr': '172.21.15.71:6835', 'nonce': 1497898467}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T07:58:35.000 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T07:58:35.000 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-09T07:58:35.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.182+0000 7f6310d9d700 1 Processor -- start 2023-10-09T07:58:35.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.182+0000 7f6310d9d700 1 -- start start 2023-10-09T07:58:35.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.183+0000 7f6310d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f630c0b2c80 0x7f630c0cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.183+0000 7f6310d9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630c0b1500 con 0x7f630c140cd0 2023-10-09T07:58:35.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.183+0000 7f6310d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630c0cda20 con 0x7f630c06c0f0 2023-10-09T07:58:35.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.183+0000 7f6310d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f630c0cdd00 con 0x7f630c0b2c80 2023-10-09T07:58:35.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.183+0000 7f630b7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f630c140cd0 0x7f630c06b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59906/0 (socket says 172.21.15.71:59906) 2023-10-09T07:58:35.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.184+0000 7f630b7fe700 1 -- 172.21.15.71:0/2423711843 learned_addr learned my addr 172.21.15.71:0/2423711843 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:35.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.184+0000 7f630bfff700 1 --2- 172.21.15.71:0/2423711843 >> v2:172.21.15.179:3300/0 conn(0x7f630c0b2c80 0x7f630c0cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.184+0000 7f630a7fc700 1 -- 172.21.15.71:0/2423711843 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247674316 0 0) 0x7f630c0b1500 con 0x7f630c140cd0 2023-10-09T07:58:35.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.184+0000 7f630a7fc700 1 -- 172.21.15.71:0/2423711843 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62f4003570 con 0x7f630c140cd0 2023-10-09T07:58:35.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.184+0000 7f630a7fc700 1 -- 172.21.15.71:0/2423711843 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2371851451 0 0) 0x7f630c0cda20 con 0x7f630c06c0f0 2023-10-09T07:58:35.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.184+0000 7f630a7fc700 1 -- 172.21.15.71:0/2423711843 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f630c0b1500 con 0x7f630c06c0f0 2023-10-09T07:58:35.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.184+0000 7f630a7fc700 1 -- 172.21.15.71:0/2423711843 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1208290307 0 0) 0x7f62f4003570 con 0x7f630c140cd0 2023-10-09T07:58:35.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.184+0000 7f630a7fc700 1 -- 172.21.15.71:0/2423711843 >> v2:172.21.15.179:3300/0 conn(0x7f630c0b2c80 msgr2=0x7f630c0cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:35.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.184+0000 7f630a7fc700 1 --2- 172.21.15.71:0/2423711843 >> v2:172.21.15.179:3300/0 conn(0x7f630c0b2c80 0x7f630c0cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.184+0000 7f630a7fc700 1 -- 172.21.15.71:0/2423711843 >> v1:172.21.15.179:6789/0 conn(0x7f630c06c0f0 legacy=0x7f630c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.184+0000 7f630a7fc700 1 -- 172.21.15.71:0/2423711843 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630c0cdfe0 con 0x7f630c140cd0 2023-10-09T07:58:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.184+0000 7f630a7fc700 1 -- 172.21.15.71:0/2423711843 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f62fc001470 con 0x7f630c140cd0 2023-10-09T07:58:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.184+0000 7f630a7fc700 1 -- 172.21.15.71:0/2423711843 >> v1:172.21.15.71:6789/0 conn(0x7f630c140cd0 legacy=0x7f630c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.184+0000 7f630a7fc700 1 --2- 172.21.15.71:0/2423711843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62f4003bf0 0x7f62f4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.184+0000 7f630a7fc700 1 --2- 172.21.15.71:0/2423711843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f4004810 0x7f62f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.184+0000 7f630a7fc700 1 --2- 172.21.15.71:0/2423711843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f40051c0 0x7f62f400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.184+0000 7f630a7fc700 1 -- 172.21.15.71:0/2423711843 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c0cdd00 con 0x7f62f40051c0 2023-10-09T07:58:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.184+0000 7f630a7fc700 1 -- 172.21.15.71:0/2423711843 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f400c160 con 0x7f62f4003bf0 2023-10-09T07:58:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.184+0000 7f630a7fc700 1 -- 172.21.15.71:0/2423711843 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f400c320 con 0x7f62f4004810 2023-10-09T07:58:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.185+0000 7f630bfff700 1 --2- 172.21.15.71:0/2423711843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f40051c0 0x7f62f400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.185+0000 7f630b7fe700 1 --2- 172.21.15.71:0/2423711843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62f4003bf0 0x7f62f4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.185+0000 7f630affd700 1 --2- 172.21.15.71:0/2423711843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f4004810 0x7f62f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.185+0000 7f630bfff700 1 -- 172.21.15.71:0/2423711843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f4004810 msgr2=0x7f62f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.185+0000 7f630bfff700 1 --2- 172.21.15.71:0/2423711843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f4004810 0x7f62f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.185+0000 7f630bfff700 1 -- 172.21.15.71:0/2423711843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62f4003bf0 msgr2=0x7f62f4003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.185+0000 7f630bfff700 1 --2- 172.21.15.71:0/2423711843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62f4003bf0 0x7f62f4003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.185+0000 7f630bfff700 1 -- 172.21.15.71:0/2423711843 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f4003570 con 0x7f62f40051c0 2023-10-09T07:58:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.185+0000 7f630bfff700 1 -- 172.21.15.71:0/2423711843 reap_dead start 2023-10-09T07:58:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.185+0000 7f630bfff700 1 --2- 172.21.15.71:0/2423711843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f40051c0 0x7f62f400ba60 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f63040094d0 tx=0x7f630400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab96b9a3ba9310f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.185+0000 7f630a7fc700 1 -- 172.21.15.71:0/2423711843 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630400ea90 con 0x7f62f40051c0 2023-10-09T07:58:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.186+0000 7f630a7fc700 1 -- 172.21.15.71:0/2423711843 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630400f040 con 0x7f62f40051c0 2023-10-09T07:58:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.186+0000 7f630a7fc700 1 -- 172.21.15.71:0/2423711843 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630400ee60 con 0x7f62f40051c0 2023-10-09T07:58:35.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.186+0000 7f6310d9d700 1 -- 172.21.15.71:0/2423711843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f40051c0 msgr2=0x7f62f400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:35.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.186+0000 7f6310d9d700 1 --2- 172.21.15.71:0/2423711843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f40051c0 0x7f62f400ba60 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f63040094d0 tx=0x7f630400b040 comp rx=0 tx=0).stop 2023-10-09T07:58:35.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.186+0000 7f6310d9d700 1 -- 172.21.15.71:0/2423711843 shutdown_connections 2023-10-09T07:58:35.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.186+0000 7f6310d9d700 1 --2- 172.21.15.71:0/2423711843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f40051c0 0x7f62f400ba60 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.186+0000 7f6310d9d700 1 -- 172.21.15.71:0/2423711843 >> 172.21.15.71:0/2423711843 conn(0x7f630c0ce430 msgr2=0x7f630c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:35.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.186+0000 7f6310d9d700 1 -- 172.21.15.71:0/2423711843 shutdown_connections 2023-10-09T07:58:35.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.186+0000 7f6310d9d700 1 -- 172.21.15.71:0/2423711843 wait complete. 2023-10-09T07:58:35.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.188+0000 7f6310d9d700 1 Processor -- start 2023-10-09T07:58:35.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.188+0000 7f6310d9d700 1 -- start start 2023-10-09T07:58:35.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.189+0000 7f6310d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f40051c0 0x7f630c137e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.189+0000 7f6310d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f630c15dc10 0x7f630c15e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.189+0000 7f6310d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f630c069b90 0x7f630c06a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.189+0000 7f6310d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c06a550 con 0x7f630c15dc10 2023-10-09T07:58:35.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.189+0000 7f6310d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c169720 con 0x7f630c069b90 2023-10-09T07:58:35.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.189+0000 7f6310d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630c158220 con 0x7f62f40051c0 2023-10-09T07:58:35.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.189+0000 7f630affd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f630c15dc10 0x7f630c15e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.189+0000 7f630affd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f630c15dc10 0x7f630c15e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35492/0 (socket says 172.21.15.71:35492) 2023-10-09T07:58:35.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.189+0000 7f630affd700 1 -- 172.21.15.71:0/1607811416 learned_addr learned my addr 172.21.15.71:0/1607811416 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:35.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.189+0000 7f630bfff700 1 --2- 172.21.15.71:0/1607811416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f630c069b90 0x7f630c06a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.189+0000 7f630b7fe700 1 --2- 172.21.15.71:0/1607811416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f40051c0 0x7f630c137e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.189+0000 7f630affd700 1 -- 172.21.15.71:0/1607811416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f40051c0 msgr2=0x7f630c137e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:35.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.189+0000 7f630affd700 1 --2- 172.21.15.71:0/1607811416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f40051c0 0x7f630c137e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.189+0000 7f630affd700 1 -- 172.21.15.71:0/1607811416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f630c069b90 msgr2=0x7f630c06a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.189+0000 7f630affd700 1 --2- 172.21.15.71:0/1607811416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f630c069b90 0x7f630c06a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.189+0000 7f630affd700 1 -- 172.21.15.71:0/1607811416 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630c1383a0 con 0x7f630c15dc10 2023-10-09T07:58:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.189+0000 7f630bfff700 1 --2- 172.21.15.71:0/1607811416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f630c069b90 0x7f630c06a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:58:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.190+0000 7f630affd700 1 --2- 172.21.15.71:0/1607811416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f630c15dc10 0x7f630c15e080 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f630000e7b0 tx=0x7f6300009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.190+0000 7f62f37fe700 1 -- 172.21.15.71:0/1607811416 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63000026a0 con 0x7f630c15dc10 2023-10-09T07:58:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.190+0000 7f62f37fe700 1 -- 172.21.15.71:0/1607811416 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6300010040 con 0x7f630c15dc10 2023-10-09T07:58:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.190+0000 7f6310d9d700 1 -- 172.21.15.71:0/1607811416 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630c15e940 con 0x7f630c15dc10 2023-10-09T07:58:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.190+0000 7f62f37fe700 1 -- 172.21.15.71:0/1607811416 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6300002a70 con 0x7f630c15dc10 2023-10-09T07:58:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.190+0000 7f6310d9d700 1 -- 172.21.15.71:0/1607811416 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630c157bd0 con 0x7f630c15dc10 2023-10-09T07:58:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.192+0000 7f62f37fe700 1 -- 172.21.15.71:0/1607811416 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f630001e440 con 0x7f630c15dc10 2023-10-09T07:58:35.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.193+0000 7f62f37fe700 1 --2- 172.21.15.71:0/1607811416 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f62f8066f30 0x7f62f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.193+0000 7f62f37fe700 1 -- 172.21.15.71:0/1607811416 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f6300084270 con 0x7f630c15dc10 2023-10-09T07:58:35.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.193+0000 7f630b7fe700 1 --2- 172.21.15.71:0/1607811416 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f62f8066f30 0x7f62f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.194+0000 7f630b7fe700 1 --2- 172.21.15.71:0/1607811416 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f62f8066f30 0x7f62f80693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f62fc000e10 tx=0x7f62fc009040 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:35.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.195+0000 7f63206d9b80 1 Processor -- start 2023-10-09T07:58:35.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.195+0000 7f63206d9b80 1 -- start start 2023-10-09T07:58:35.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.196+0000 7f63206d9b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652a674d480 0x5652a672c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.196+0000 7f63206d9b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5652a67005f0 0x5652a674d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.196+0000 7f63206d9b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a6702b80 0x5652a6702ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.196+0000 7f63206d9b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652a6659a70 con 0x5652a6702b80 2023-10-09T07:58:35.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.196+0000 7f63206d9b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652a6657270 con 0x5652a674d480 2023-10-09T07:58:35.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.196+0000 7f63206d9b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5652a6653060 con 0x5652a67005f0 2023-10-09T07:58:35.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.196+0000 7f630bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a6702b80 0x5652a6702ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.196+0000 7f630bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a6702b80 0x5652a6702ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35508/0 (socket says 172.21.15.71:35508) 2023-10-09T07:58:35.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.196+0000 7f630bfff700 1 -- 172.21.15.71:0/3579821322 learned_addr learned my addr 172.21.15.71:0/3579821322 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:35.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.196+0000 7f630affd700 1 --2- 172.21.15.71:0/3579821322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5652a67005f0 0x5652a674d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.196+0000 7f630b7fe700 1 --2- 172.21.15.71:0/3579821322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652a674d480 0x5652a672c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.196+0000 7f630bfff700 1 -- 172.21.15.71:0/3579821322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5652a67005f0 msgr2=0x5652a674d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:35.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.196+0000 7f630bfff700 1 --2- 172.21.15.71:0/3579821322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5652a67005f0 0x5652a674d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.196+0000 7f630bfff700 1 -- 172.21.15.71:0/3579821322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652a674d480 msgr2=0x5652a672c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:35.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.196+0000 7f630bfff700 1 --2- 172.21.15.71:0/3579821322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652a674d480 0x5652a672c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.196+0000 7f630bfff700 1 -- 172.21.15.71:0/3579821322 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652a64ed270 con 0x5652a6702b80 2023-10-09T07:58:35.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.196+0000 7f630b7fe700 1 --2- 172.21.15.71:0/3579821322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652a674d480 0x5652a672c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:58:35.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.196+0000 7f630affd700 1 --2- 172.21.15.71:0/3579821322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5652a67005f0 0x5652a674d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:58:35.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.197+0000 7f630bfff700 1 --2- 172.21.15.71:0/3579821322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a6702b80 0x5652a6702ff0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f630c0cbdc0 tx=0x7f6304019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3958d6d1099bc989 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:35.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.197+0000 7f62f0ff9700 1 -- 172.21.15.71:0/3579821322 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6304023070 con 0x5652a6702b80 2023-10-09T07:58:35.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.197+0000 7f62f0ff9700 1 -- 172.21.15.71:0/3579821322 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630400ea90 con 0x5652a6702b80 2023-10-09T07:58:35.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.197+0000 7f62f0ff9700 1 -- 172.21.15.71:0/3579821322 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6304009b00 con 0x5652a6702b80 2023-10-09T07:58:35.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.197+0000 7f63206d9b80 1 -- 172.21.15.71:0/3579821322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a6702b80 msgr2=0x5652a6702ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:35.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.197+0000 7f63206d9b80 1 --2- 172.21.15.71:0/3579821322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a6702b80 0x5652a6702ff0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f630c0cbdc0 tx=0x7f6304019000 comp rx=0 tx=0).stop 2023-10-09T07:58:35.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.198+0000 7f63206d9b80 1 -- 172.21.15.71:0/3579821322 shutdown_connections 2023-10-09T07:58:35.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.198+0000 7f63206d9b80 1 --2- 172.21.15.71:0/3579821322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a6702b80 0x5652a6702ff0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.198+0000 7f63206d9b80 1 --2- 172.21.15.71:0/3579821322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652a674d480 0x5652a672c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.198+0000 7f63206d9b80 1 --2- 172.21.15.71:0/3579821322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5652a67005f0 0x5652a674d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.198+0000 7f63206d9b80 1 -- 172.21.15.71:0/3579821322 >> 172.21.15.71:0/3579821322 conn(0x5652a67040c0 msgr2=0x5652a67048f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:35.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.198+0000 7f63206d9b80 1 -- 172.21.15.71:0/3579821322 shutdown_connections 2023-10-09T07:58:35.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.198+0000 7f63206d9b80 1 -- 172.21.15.71:0/3579821322 wait complete. 2023-10-09T07:58:35.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.198+0000 7f63206d9b80 1 -- start start 2023-10-09T07:58:35.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.199+0000 7f63206d9b80 1 Processor -- start 2023-10-09T07:58:35.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.199+0000 7f63206d9b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652a67005f0 0x5652a6758fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.199+0000 7f63206d9b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a6702b80 0x5652a674a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.199+0000 7f63206d9b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5652a674d480 0x5652a672dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.199+0000 7f63206d9b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652a65fe890 con 0x5652a6702b80 2023-10-09T07:58:35.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.199+0000 7f63206d9b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652a6619ea0 con 0x5652a67005f0 2023-10-09T07:58:35.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.200+0000 7f63206d9b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5652a64d5e30 con 0x5652a674d480 2023-10-09T07:58:35.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.200+0000 7f63206d9b80 10 client.0 _ll_register_callbacks cb 0x5652a66c62c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T07:58:35.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.200+0000 7f630affd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a6702b80 0x5652a674a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.200+0000 7f630affd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a6702b80 0x5652a674a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35520/0 (socket says 172.21.15.71:35520) 2023-10-09T07:58:35.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.200+0000 7f630affd700 1 -- 172.21.15.71:0/342761835 learned_addr learned my addr 172.21.15.71:0/342761835 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:35.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.200+0000 7f630affd700 1 -- 172.21.15.71:0/342761835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5652a674d480 msgr2=0x5652a672dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:35.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.200+0000 7f630affd700 1 --2- 172.21.15.71:0/342761835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5652a674d480 0x5652a672dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.200+0000 7f630affd700 1 -- 172.21.15.71:0/342761835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652a67005f0 msgr2=0x5652a6758fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:35.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.200+0000 7f630affd700 1 --2- 172.21.15.71:0/342761835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652a67005f0 0x5652a6758fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.200+0000 7f630affd700 1 -- 172.21.15.71:0/342761835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f4003570 con 0x5652a6702b80 2023-10-09T07:58:35.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.200+0000 7f630affd700 1 --2- 172.21.15.71:0/342761835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a6702b80 0x5652a674a6f0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f63000825b0 tx=0x7f630000c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d496e265297a8abf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:35.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.200+0000 7f62e9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T07:58:35.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.200+0000 7f62e9ffb700 1 -- 172.21.15.71:0/342761835 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6300058180 con 0x5652a6702b80 2023-10-09T07:58:35.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.201+0000 7f62e9ffb700 1 -- 172.21.15.71:0/342761835 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(176..176 src has 1..176) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f630005bed0 con 0x5652a6702b80 2023-10-09T07:58:35.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.201+0000 7f63206d9b80 1 -- 172.21.15.71:0/342761835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5652a66f7cd0 con 0x5652a6702b80 2023-10-09T07:58:35.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.201+0000 7f62e9ffb700 1 -- 172.21.15.71:0/342761835 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6300002de0 con 0x5652a6702b80 2023-10-09T07:58:35.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.201+0000 7f63206d9b80 10 client.9258 fetch_fsmap learned FSMap version 82 2023-10-09T07:58:35.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.201+0000 7f63206d9b80 1 -- 172.21.15.71:0/342761835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=2+}) v3 -- 0x5652a648ffe0 con 0x5652a6702b80 2023-10-09T07:58:35.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.201+0000 7f62e9ffb700 1 -- 172.21.15.71:0/342761835 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6300080030 con 0x5652a6702b80 2023-10-09T07:58:35.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.201+0000 7f62e9ffb700 1 -- 172.21.15.71:0/342761835 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 82) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f630006b180 con 0x5652a6702b80 2023-10-09T07:58:35.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.201+0000 7f63206d9b80 10 client.9258 fetch_fsmap finished waiting for FSMap version 82 2023-10-09T07:58:35.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.201+0000 7f63206d9b80 10 client.9258 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T07:58:35.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.201+0000 7f63206d9b80 20 client.9258 populate_metadata read hostname 'smithi071' 2023-10-09T07:58:35.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.201+0000 7f63206d9b80 1 --2- 172.21.15.71:0/342761835 >> [v2:172.21.15.71:6833/1497898467,v1:172.21.15.71:6835/1497898467] conn(0x5652a6726b60 0x5652a6726f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.201+0000 7f63206d9b80 4 client.9258 mds_command: new command op to 9087 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T07:58:35.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.201+0000 7f63206d9b80 1 -- 172.21.15.71:0/342761835 --> [v2:172.21.15.71:6833/1497898467,v1:172.21.15.71:6835/1497898467] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5652a66d4aa0 con 0x5652a6726b60 2023-10-09T07:58:35.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.201+0000 7f630b7fe700 1 --2- 172.21.15.71:0/342761835 >> [v2:172.21.15.71:6833/1497898467,v1:172.21.15.71:6835/1497898467] conn(0x5652a6726b60 0x5652a6726f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.202+0000 7f630b7fe700 1 --2- 172.21.15.71:0/342761835 >> [v2:172.21.15.71:6833/1497898467,v1:172.21.15.71:6835/1497898467] conn(0x5652a6726b60 0x5652a6726f30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=135378014c8cde4 server_cookie=7f06ffd6ccf2c3b1 in_seq=0 out_seq=0 2023-10-09T07:58:35.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.202+0000 7f62e9ffb700 10 client.9258 ms_handle_connect on v2:172.21.15.71:6833/1497898467 2023-10-09T07:58:35.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.202+0000 7f62e9ffb700 1 -- 172.21.15.71:0/342761835 <== mds.0 v2:172.21.15.71:6833/1497898467 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5652a66d4aa0 con 0x5652a6726b60 2023-10-09T07:58:35.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.202+0000 7f62e9ffb700 10 client.9258 handle_command_reply: tid=0 2023-10-09T07:58:35.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.203+0000 7f63206d9b80 1 client.9258 shutdown 2023-10-09T07:58:35.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.203+0000 7f63206d9b80 1 -- 172.21.15.71:0/342761835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a6702b80 msgr2=0x5652a674a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:35.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.203+0000 7f63206d9b80 1 --2- 172.21.15.71:0/342761835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a6702b80 0x5652a674a6f0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f63000825b0 tx=0x7f630000c040 comp rx=0 tx=0).stop 2023-10-09T07:58:35.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.203+0000 7f63206d9b80 1 -- 172.21.15.71:0/342761835 shutdown_connections 2023-10-09T07:58:35.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.203+0000 7f63206d9b80 1 --2- 172.21.15.71:0/342761835 >> [v2:172.21.15.71:6833/1497898467,v1:172.21.15.71:6835/1497898467] conn(0x5652a6726b60 0x5652a6726f30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.203+0000 7f63206d9b80 1 --2- 172.21.15.71:0/342761835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5652a674d480 0x5652a672dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.203+0000 7f62e9ffb700 0 client.9258 ms_handle_reset on v2:172.21.15.71:6833/1497898467 2023-10-09T07:58:35.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.203+0000 7f63206d9b80 1 --2- 172.21.15.71:0/342761835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652a67005f0 0x5652a6758fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.203+0000 7f63206d9b80 1 --2- 172.21.15.71:0/342761835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a6702b80 0x5652a674a6f0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.203+0000 7f63206d9b80 1 -- 172.21.15.71:0/342761835 >> 172.21.15.71:0/342761835 conn(0x5652a67040c0 msgr2=0x5652a66fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:35.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.203+0000 7f63206d9b80 1 -- 172.21.15.71:0/342761835 shutdown_connections 2023-10-09T07:58:35.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.203+0000 7f63206d9b80 1 -- 172.21.15.71:0/342761835 wait complete. 2023-10-09T07:58:35.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.203+0000 7f63206d9b80 20 client.9258 trim_cache size 0 max 16384 2023-10-09T07:58:35.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.220+0000 7f63206d9b80 1 Processor -- start 2023-10-09T07:58:35.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.220+0000 7f63206d9b80 1 -- start start 2023-10-09T07:58:35.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.221+0000 7f63206d9b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5652a67005f0 0x5652a6706550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.221+0000 7f63206d9b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a6702b80 0x5652a6759070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.221+0000 7f63206d9b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652a674d480 0x5652a6726140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.221+0000 7f63206d9b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652a66e25b0 con 0x5652a6702b80 2023-10-09T07:58:35.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.221+0000 7f63206d9b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652a67029f0 con 0x5652a674d480 2023-10-09T07:58:35.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.221+0000 7f63206d9b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5652a66fb9e0 con 0x5652a67005f0 2023-10-09T07:58:35.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.221+0000 7f630affd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a6702b80 0x5652a6759070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.221+0000 7f630affd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a6702b80 0x5652a6759070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35534/0 (socket says 172.21.15.71:35534) 2023-10-09T07:58:35.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.221+0000 7f630affd700 1 -- 172.21.15.71:0/2181264630 learned_addr learned my addr 172.21.15.71:0/2181264630 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:35.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.221+0000 7f630bfff700 1 --2- 172.21.15.71:0/2181264630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652a674d480 0x5652a6726140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.222+0000 7f630b7fe700 1 --2- 172.21.15.71:0/2181264630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5652a67005f0 0x5652a6706550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.222+0000 7f630affd700 1 -- 172.21.15.71:0/2181264630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5652a67005f0 msgr2=0x5652a6706550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:35.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.222+0000 7f630affd700 1 --2- 172.21.15.71:0/2181264630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5652a67005f0 0x5652a6706550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.222+0000 7f630affd700 1 -- 172.21.15.71:0/2181264630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652a674d480 msgr2=0x5652a6726140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:35.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.222+0000 7f630affd700 1 --2- 172.21.15.71:0/2181264630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652a674d480 0x5652a6726140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.222+0000 7f630affd700 1 -- 172.21.15.71:0/2181264630 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652a672cb80 con 0x5652a6702b80 2023-10-09T07:58:35.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.222+0000 7f630bfff700 1 --2- 172.21.15.71:0/2181264630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652a674d480 0x5652a6726140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:58:35.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.222+0000 7f630affd700 1 --2- 172.21.15.71:0/2181264630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a6702b80 0x5652a6759070 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f63000557e0 tx=0x7f6300057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b78ac5e7121b46 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:35.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.222+0000 7f62f17fa700 1 -- 172.21.15.71:0/2181264630 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630005bed0 con 0x5652a6702b80 2023-10-09T07:58:35.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.222+0000 7f62f17fa700 1 -- 172.21.15.71:0/2181264630 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6300080070 con 0x5652a6702b80 2023-10-09T07:58:35.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.222+0000 7f62f17fa700 1 -- 172.21.15.71:0/2181264630 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6300058180 con 0x5652a6702b80 2023-10-09T07:58:35.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.223+0000 7f63206d9b80 1 -- 172.21.15.71:0/2181264630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a6702b80 msgr2=0x5652a6759070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:35.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.223+0000 7f63206d9b80 1 --2- 172.21.15.71:0/2181264630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a6702b80 0x5652a6759070 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f63000557e0 tx=0x7f6300057000 comp rx=0 tx=0).stop 2023-10-09T07:58:35.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.223+0000 7f63206d9b80 1 -- 172.21.15.71:0/2181264630 shutdown_connections 2023-10-09T07:58:35.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.223+0000 7f63206d9b80 1 --2- 172.21.15.71:0/2181264630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652a674d480 0x5652a6726140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.223+0000 7f63206d9b80 1 --2- 172.21.15.71:0/2181264630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5652a67005f0 0x5652a6706550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.223+0000 7f63206d9b80 1 --2- 172.21.15.71:0/2181264630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a6702b80 0x5652a6759070 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.223+0000 7f63206d9b80 1 -- 172.21.15.71:0/2181264630 >> 172.21.15.71:0/2181264630 conn(0x5652a67040c0 msgr2=0x5652a66fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:35.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.223+0000 7f63206d9b80 1 -- 172.21.15.71:0/2181264630 shutdown_connections 2023-10-09T07:58:35.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.223+0000 7f63206d9b80 1 -- 172.21.15.71:0/2181264630 wait complete. 2023-10-09T07:58:35.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.223+0000 7f63206d9b80 1 -- start start 2023-10-09T07:58:35.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.224+0000 7f63206d9b80 1 Processor -- start 2023-10-09T07:58:35.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.224+0000 7f63206d9b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a67005f0 0x5652a66ffa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.224+0000 7f63206d9b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652a6702b80 0x5652a66fff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.225+0000 7f63206d9b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5652a674d480 0x5652a67af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.225+0000 7f63206d9b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652a6727280 con 0x5652a67005f0 2023-10-09T07:58:35.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.225+0000 7f63206d9b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652a6727f50 con 0x5652a6702b80 2023-10-09T07:58:35.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.225+0000 7f63206d9b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5652a6758c20 con 0x5652a674d480 2023-10-09T07:58:35.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.225+0000 7f63206d9b80 10 client.0 _ll_register_callbacks cb 0x5652a66c62c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T07:58:35.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.225+0000 7f630b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a67005f0 0x5652a66ffa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.225+0000 7f630b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a67005f0 0x5652a66ffa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35552/0 (socket says 172.21.15.71:35552) 2023-10-09T07:58:35.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.225+0000 7f630b7fe700 1 -- 172.21.15.71:0/841117261 learned_addr learned my addr 172.21.15.71:0/841117261 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:35.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.225+0000 7f630b7fe700 1 -- 172.21.15.71:0/841117261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5652a674d480 msgr2=0x5652a67af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:35.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.225+0000 7f630b7fe700 1 --2- 172.21.15.71:0/841117261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5652a674d480 0x5652a67af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.225+0000 7f630b7fe700 1 -- 172.21.15.71:0/841117261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652a6702b80 msgr2=0x5652a66fff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:35.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.225+0000 7f630b7fe700 1 --2- 172.21.15.71:0/841117261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652a6702b80 0x5652a66fff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.225+0000 7f630b7fe700 1 -- 172.21.15.71:0/841117261 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5652a648ffe0 con 0x5652a67005f0 2023-10-09T07:58:35.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.225+0000 7f630b7fe700 1 --2- 172.21.15.71:0/841117261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a67005f0 0x5652a66ffa40 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0011e0 tx=0x7f62fc006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1d7e104c0c5698 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.225+0000 7f62e9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T07:58:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.226+0000 7f62e9ffb700 1 -- 172.21.15.71:0/841117261 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc02c070 con 0x5652a67005f0 2023-10-09T07:58:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.226+0000 7f62e9ffb700 1 -- 172.21.15.71:0/841117261 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(176..176 src has 1..176) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f62fc01d040 con 0x5652a67005f0 2023-10-09T07:58:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.226+0000 7f63206d9b80 1 -- 172.21.15.71:0/841117261 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f630c0b03a0 con 0x5652a67005f0 2023-10-09T07:58:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.226+0000 7f62e9ffb700 1 -- 172.21.15.71:0/841117261 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62fc015470 con 0x5652a67005f0 2023-10-09T07:58:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.226+0000 7f63206d9b80 10 client.9264 fetch_fsmap learned FSMap version 82 2023-10-09T07:58:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.226+0000 7f63206d9b80 1 -- 172.21.15.71:0/841117261 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=2+}) v3 -- 0x5652a6621780 con 0x5652a67005f0 2023-10-09T07:58:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.226+0000 7f62e9ffb700 1 -- 172.21.15.71:0/841117261 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630c0b03a0 con 0x5652a67005f0 2023-10-09T07:58:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.226+0000 7f62e9ffb700 1 -- 172.21.15.71:0/841117261 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 82) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f62fc0155d0 con 0x5652a67005f0 2023-10-09T07:58:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.226+0000 7f63206d9b80 10 client.9264 fetch_fsmap finished waiting for FSMap version 82 2023-10-09T07:58:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.226+0000 7f63206d9b80 10 client.9264 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T07:58:35.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.226+0000 7f63206d9b80 20 client.9264 populate_metadata read hostname 'smithi071' 2023-10-09T07:58:35.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.226+0000 7f63206d9b80 1 --2- 172.21.15.71:0/841117261 >> [v2:172.21.15.71:6833/1497898467,v1:172.21.15.71:6835/1497898467] conn(0x5652a67afb00 0x5652a67afed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.226+0000 7f63206d9b80 4 client.9264 mds_command: new command op to 9087 tid=0[{"prefix": "status"}] 2023-10-09T07:58:35.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.226+0000 7f63206d9b80 1 -- 172.21.15.71:0/841117261 --> [v2:172.21.15.71:6833/1497898467,v1:172.21.15.71:6835/1497898467] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f630400ea90 con 0x5652a67afb00 2023-10-09T07:58:35.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.227+0000 7f630affd700 1 --2- 172.21.15.71:0/841117261 >> [v2:172.21.15.71:6833/1497898467,v1:172.21.15.71:6835/1497898467] conn(0x5652a67afb00 0x5652a67afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.227+0000 7f630affd700 1 --2- 172.21.15.71:0/841117261 >> [v2:172.21.15.71:6833/1497898467,v1:172.21.15.71:6835/1497898467] conn(0x5652a67afb00 0x5652a67afed0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee15fcc792b8ee85 server_cookie=44c0f5a79d7d060a in_seq=0 out_seq=0 2023-10-09T07:58:35.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.227+0000 7f62e9ffb700 10 client.9264 ms_handle_connect on v2:172.21.15.71:6833/1497898467 2023-10-09T07:58:35.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.227+0000 7f62e9ffb700 1 -- 172.21.15.71:0/841117261 <== mds.0 v2:172.21.15.71:6833/1497898467 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7f630400ea90 con 0x5652a67afb00 2023-10-09T07:58:35.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.227+0000 7f62e9ffb700 10 client.9264 handle_command_reply: tid=0 2023-10-09T07:58:35.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.227+0000 7f63206d9b80 1 client.9264 shutdown 2023-10-09T07:58:35.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.227+0000 7f63206d9b80 1 -- 172.21.15.71:0/841117261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a67005f0 msgr2=0x5652a66ffa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:35.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.227+0000 7f63206d9b80 1 --2- 172.21.15.71:0/841117261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a67005f0 0x5652a66ffa40 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0011e0 tx=0x7f62fc006040 comp rx=0 tx=0).stop 2023-10-09T07:58:35.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.227+0000 7f63206d9b80 1 -- 172.21.15.71:0/841117261 shutdown_connections 2023-10-09T07:58:35.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.227+0000 7f63206d9b80 1 --2- 172.21.15.71:0/841117261 >> [v2:172.21.15.71:6833/1497898467,v1:172.21.15.71:6835/1497898467] conn(0x5652a67afb00 0x5652a67afed0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.227+0000 7f63206d9b80 1 --2- 172.21.15.71:0/841117261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5652a674d480 0x5652a67af5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.227+0000 7f63206d9b80 1 --2- 172.21.15.71:0/841117261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5652a67005f0 0x5652a66ffa40 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.227+0000 7f63206d9b80 1 --2- 172.21.15.71:0/841117261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652a6702b80 0x5652a66fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.227+0000 7f63206d9b80 1 -- 172.21.15.71:0/841117261 >> 172.21.15.71:0/841117261 conn(0x5652a67040c0 msgr2=0x5652a6728270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:35.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.227+0000 7f62e9ffb700 0 client.9264 ms_handle_reset on v2:172.21.15.71:6833/1497898467 2023-10-09T07:58:35.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.228+0000 7f63206d9b80 1 -- 172.21.15.71:0/841117261 shutdown_connections 2023-10-09T07:58:35.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.228+0000 7f63206d9b80 1 -- 172.21.15.71:0/841117261 wait complete. 2023-10-09T07:58:35.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.228+0000 7f63206d9b80 20 client.9264 trim_cache size 0 max 16384 2023-10-09T07:58:35.238 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T07:58:35.238 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "604c5619-653a-4ab6-912c-ab2e5464fe4a", 2023-10-09T07:58:35.238 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2023-10-09T07:58:35.238 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 9087, 2023-10-09T07:58:35.238 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2023-10-09T07:58:35.238 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2023-10-09T07:58:35.238 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2023-10-09T07:58:35.238 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 11.208669043, 2023-10-09T07:58:35.238 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 82, 2023-10-09T07:58:35.239 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 176, 2023-10-09T07:58:35.239 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 176, 2023-10-09T07:58:35.239 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 17.004551247999999 2023-10-09T07:58:35.239 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T07:58:35.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.228+0000 7f6310d9d700 1 -- 172.21.15.71:0/1607811416 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f62f8066f30 msgr2=0x7f62f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:35.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.228+0000 7f6310d9d700 1 --2- 172.21.15.71:0/1607811416 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f62f8066f30 0x7f62f80693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f62fc000e10 tx=0x7f62fc009040 comp rx=0 tx=0).stop 2023-10-09T07:58:35.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.228+0000 7f6310d9d700 1 -- 172.21.15.71:0/1607811416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f630c15dc10 msgr2=0x7f630c15e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:35.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.228+0000 7f6310d9d700 1 --2- 172.21.15.71:0/1607811416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f630c15dc10 0x7f630c15e080 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f630000e7b0 tx=0x7f6300009040 comp rx=0 tx=0).stop 2023-10-09T07:58:35.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.228+0000 7f6310d9d700 1 -- 172.21.15.71:0/1607811416 shutdown_connections 2023-10-09T07:58:35.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.228+0000 7f6310d9d700 1 --2- 172.21.15.71:0/1607811416 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f62f8066f30 0x7f62f80693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.228+0000 7f6310d9d700 1 --2- 172.21.15.71:0/1607811416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f630c069b90 0x7f630c06a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.228+0000 7f6310d9d700 1 --2- 172.21.15.71:0/1607811416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f40051c0 0x7f630c137e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.228+0000 7f6310d9d700 1 --2- 172.21.15.71:0/1607811416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f630c15dc10 0x7f630c15e080 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.228+0000 7f6310d9d700 1 -- 172.21.15.71:0/1607811416 >> 172.21.15.71:0/1607811416 conn(0x7f630c0ce430 msgr2=0x7f630c13cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:35.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.228+0000 7f6310d9d700 1 -- 172.21.15.71:0/1607811416 shutdown_connections 2023-10-09T07:58:35.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.228+0000 7f6310d9d700 1 -- 172.21.15.71:0/1607811416 wait complete. 2023-10-09T07:58:35.246 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T07:58:35.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.425+0000 7f25a35ff700 1 Processor -- start 2023-10-09T07:58:35.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.425+0000 7f25a35ff700 1 -- start start 2023-10-09T07:58:35.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.426+0000 7f25a35ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f259c0cbf30 0x7f259c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.426+0000 7f25a35ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f259c0ccf90 0x7f259c0b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.426+0000 7f25a35ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f259c15a270 0x7f259c0b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.426+0000 7f25a35ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f259c156bf0 con 0x7f259c15a270 2023-10-09T07:58:35.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.427+0000 7f25a35ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f259c0ae950 con 0x7f259c0cbf30 2023-10-09T07:58:35.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.427+0000 7f25a35ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259c0cc300 con 0x7f259c0ccf90 2023-10-09T07:58:35.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.427+0000 7f25a1b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f259c15a270 0x7f259c0b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.427+0000 7f25a1b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f259c15a270 0x7f259c0b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35554/0 (socket says 172.21.15.71:35554) 2023-10-09T07:58:35.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.427+0000 7f25a1b9c700 1 -- 172.21.15.71:0/3195453771 learned_addr learned my addr 172.21.15.71:0/3195453771 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:35.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.427+0000 7f25a0b9a700 1 --2- 172.21.15.71:0/3195453771 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f259c0ccf90 0x7f259c0b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.427+0000 7f25a1b9c700 1 -- 172.21.15.71:0/3195453771 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f259c0ccf90 msgr2=0x7f259c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:35.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.427+0000 7f25a139b700 1 --2- 172.21.15.71:0/3195453771 >> v2:172.21.15.179:3300/0 conn(0x7f259c0cbf30 0x7f259c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.427+0000 7f25a1b9c700 1 --2- 172.21.15.71:0/3195453771 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f259c0ccf90 0x7f259c0b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.427+0000 7f25a1b9c700 1 -- 172.21.15.71:0/3195453771 >> v2:172.21.15.179:3300/0 conn(0x7f259c0cbf30 msgr2=0x7f259c0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:35.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.427+0000 7f25a1b9c700 1 --2- 172.21.15.71:0/3195453771 >> v2:172.21.15.179:3300/0 conn(0x7f259c0cbf30 0x7f259c0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.427+0000 7f25a1b9c700 1 -- 172.21.15.71:0/3195453771 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c0ad370 con 0x7f259c15a270 2023-10-09T07:58:35.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.427+0000 7f25a0b9a700 1 --2- 172.21.15.71:0/3195453771 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f259c0ccf90 0x7f259c0b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:35.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.427+0000 7f25a139b700 1 --2- 172.21.15.71:0/3195453771 >> v2:172.21.15.179:3300/0 conn(0x7f259c0cbf30 0x7f259c0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:35.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.427+0000 7f25a1b9c700 1 --2- 172.21.15.71:0/3195453771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f259c15a270 0x7f259c0b1250 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f259c063d40 tx=0x7f2594009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2129d219fcce7be server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:35.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.428+0000 7f2593fff700 1 -- 172.21.15.71:0/3195453771 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259400e070 con 0x7f259c15a270 2023-10-09T07:58:35.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.428+0000 7f2593fff700 1 -- 172.21.15.71:0/3195453771 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259400ba40 con 0x7f259c15a270 2023-10-09T07:58:35.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.428+0000 7f2593fff700 1 -- 172.21.15.71:0/3195453771 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25940092e0 con 0x7f259c15a270 2023-10-09T07:58:35.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.428+0000 7f25a35ff700 1 -- 172.21.15.71:0/3195453771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f259c15a270 msgr2=0x7f259c0b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:35.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.428+0000 7f25a35ff700 1 --2- 172.21.15.71:0/3195453771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f259c15a270 0x7f259c0b1250 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f259c063d40 tx=0x7f2594009840 comp rx=0 tx=0).stop 2023-10-09T07:58:35.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.428+0000 7f25a35ff700 1 -- 172.21.15.71:0/3195453771 shutdown_connections 2023-10-09T07:58:35.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.428+0000 7f25a35ff700 1 --2- 172.21.15.71:0/3195453771 >> v2:172.21.15.179:3300/0 conn(0x7f259c0cbf30 0x7f259c0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.428+0000 7f25a35ff700 1 --2- 172.21.15.71:0/3195453771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f259c15a270 0x7f259c0b1250 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.428+0000 7f25a35ff700 1 --2- 172.21.15.71:0/3195453771 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f259c0ccf90 0x7f259c0b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.428+0000 7f25a35ff700 1 -- 172.21.15.71:0/3195453771 >> 172.21.15.71:0/3195453771 conn(0x7f259c06a320 msgr2=0x7f259c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:35.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.428+0000 7f25a35ff700 1 -- 172.21.15.71:0/3195453771 shutdown_connections 2023-10-09T07:58:35.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.428+0000 7f25a35ff700 1 -- 172.21.15.71:0/3195453771 wait complete. 2023-10-09T07:58:35.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.430+0000 7f25a35ff700 1 Processor -- start 2023-10-09T07:58:35.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.430+0000 7f25a35ff700 1 -- start start 2023-10-09T07:58:35.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.431+0000 7f25a35ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f259c0cbf30 0x7f259c154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.431+0000 7f25a35ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f259c0ccf90 0x7f259c169d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.431+0000 7f25a35ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f259c15a270 0x7f259c157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.431+0000 7f25a35ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c158cc0 con 0x7f259c0cbf30 2023-10-09T07:58:35.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.431+0000 7f25a35ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c1580b0 con 0x7f259c0ccf90 2023-10-09T07:58:35.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.431+0000 7f25a35ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259c158390 con 0x7f259c15a270 2023-10-09T07:58:35.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.431+0000 7f25a139b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f259c0cbf30 0x7f259c154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.431+0000 7f25a139b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f259c0cbf30 0x7f259c154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35568/0 (socket says 172.21.15.71:35568) 2023-10-09T07:58:35.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.431+0000 7f25a139b700 1 -- 172.21.15.71:0/4094288544 learned_addr learned my addr 172.21.15.71:0/4094288544 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:35.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.431+0000 7f25a0b9a700 1 --2- 172.21.15.71:0/4094288544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f259c0ccf90 0x7f259c169d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.431+0000 7f25a1b9c700 1 --2- 172.21.15.71:0/4094288544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f259c15a270 0x7f259c157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.431+0000 7f25a139b700 1 -- 172.21.15.71:0/4094288544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f259c15a270 msgr2=0x7f259c157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:35.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.431+0000 7f25a139b700 1 --2- 172.21.15.71:0/4094288544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f259c15a270 0x7f259c157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.432+0000 7f25a139b700 1 -- 172.21.15.71:0/4094288544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f259c0ccf90 msgr2=0x7f259c169d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:35.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.432+0000 7f25a139b700 1 --2- 172.21.15.71:0/4094288544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f259c0ccf90 0x7f259c169d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.432+0000 7f25a139b700 1 -- 172.21.15.71:0/4094288544 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2594009ae0 con 0x7f259c0cbf30 2023-10-09T07:58:35.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.432+0000 7f25a1b9c700 1 --2- 172.21.15.71:0/4094288544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f259c15a270 0x7f259c157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:58:35.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.432+0000 7f25a139b700 1 --2- 172.21.15.71:0/4094288544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f259c0cbf30 0x7f259c154c80 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f259800c880 tx=0x7f2598008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:35.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.432+0000 7f25917fa700 1 -- 172.21.15.71:0/4094288544 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2598011600 con 0x7f259c0cbf30 2023-10-09T07:58:35.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.432+0000 7f25917fa700 1 -- 172.21.15.71:0/4094288544 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2598011760 con 0x7f259c0cbf30 2023-10-09T07:58:35.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.432+0000 7f25a35ff700 1 -- 172.21.15.71:0/4094288544 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f259c158670 con 0x7f259c0cbf30 2023-10-09T07:58:35.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.432+0000 7f25917fa700 1 -- 172.21.15.71:0/4094288544 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2598011b20 con 0x7f259c0cbf30 2023-10-09T07:58:35.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.432+0000 7f25a35ff700 1 -- 172.21.15.71:0/4094288544 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f259c1551c0 con 0x7f259c0cbf30 2023-10-09T07:58:35.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.433+0000 7f25a35ff700 1 -- 172.21.15.71:0/4094288544 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f259c04c3c0 con 0x7f259c0cbf30 2023-10-09T07:58:35.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.434+0000 7f25917fa700 1 -- 172.21.15.71:0/4094288544 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f25980193b0 con 0x7f259c0cbf30 2023-10-09T07:58:35.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.435+0000 7f25917fa700 1 --2- 172.21.15.71:0/4094288544 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2580066f30 0x7f25800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:35.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.435+0000 7f25917fa700 1 -- 172.21.15.71:0/4094288544 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f2598084720 con 0x7f259c0cbf30 2023-10-09T07:58:35.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.435+0000 7f25a0b9a700 1 --2- 172.21.15.71:0/4094288544 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2580066f30 0x7f25800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:35.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.436+0000 7f25a0b9a700 1 --2- 172.21.15.71:0/4094288544 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2580066f30 0x7f25800693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f259c156530 tx=0x7f258c006f90 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:35.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.439+0000 7f25917fa700 1 -- 172.21.15.71:0/4094288544 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25980551b0 con 0x7f259c0cbf30 2023-10-09T07:58:35.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.675+0000 7f25a35ff700 1 -- 172.21.15.71:0/4094288544 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f259c06f8a0 con 0x7f259c0cbf30 2023-10-09T07:58:35.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.676+0000 7f25917fa700 1 -- 172.21.15.71:0/4094288544 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v82) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2598054d40 con 0x7f259c0cbf30 2023-10-09T07:58:35.677 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T07:58:35.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.678+0000 7f25a35ff700 1 -- 172.21.15.71:0/4094288544 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2580066f30 msgr2=0x7f25800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:35.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.678+0000 7f25a35ff700 1 --2- 172.21.15.71:0/4094288544 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2580066f30 0x7f25800693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f259c156530 tx=0x7f258c006f90 comp rx=0 tx=0).stop 2023-10-09T07:58:35.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.678+0000 7f25a35ff700 1 -- 172.21.15.71:0/4094288544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f259c0cbf30 msgr2=0x7f259c154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:35.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.678+0000 7f25a35ff700 1 --2- 172.21.15.71:0/4094288544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f259c0cbf30 0x7f259c154c80 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f259800c880 tx=0x7f2598008040 comp rx=0 tx=0).stop 2023-10-09T07:58:35.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.678+0000 7f25a35ff700 1 -- 172.21.15.71:0/4094288544 shutdown_connections 2023-10-09T07:58:35.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.678+0000 7f25a35ff700 1 --2- 172.21.15.71:0/4094288544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f259c15a270 0x7f259c157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.678+0000 7f25a35ff700 1 --2- 172.21.15.71:0/4094288544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f259c0cbf30 0x7f259c154c80 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.678+0000 7f25a35ff700 1 --2- 172.21.15.71:0/4094288544 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2580066f30 0x7f25800693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.678+0000 7f25a35ff700 1 --2- 172.21.15.71:0/4094288544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f259c0ccf90 0x7f259c169d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:35.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.678+0000 7f25a35ff700 1 -- 172.21.15.71:0/4094288544 >> 172.21.15.71:0/4094288544 conn(0x7f259c06a320 msgr2=0x7f259c068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:35.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.678+0000 7f25a35ff700 1 -- 172.21.15.71:0/4094288544 shutdown_connections 2023-10-09T07:58:35.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:35.679+0000 7f25a35ff700 1 -- 172.21.15.71:0/4094288544 wait complete. 2023-10-09T07:58:35.697 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T07:58:35.697 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T07:58:35.697 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2023-10-09T07:58:35.697 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T07:58:35.697 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T07:58:35.697 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T07:58:35.697 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T07:58:35.697 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T07:58:35.697 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T07:58:35.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:58:35.698 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2023-10-09T07:58:35.734 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T07:58:35.734 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T07:58:35.734 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T07:58:35.734 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:58:35.735 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-10-09T07:58:35.735 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:58:35.735 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T07:58:35.735 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2023-10-09T07:58:35.735 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2023-10-09T07:58:35.735 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T07:58:35.735 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2023-10-09T07:58:35.735 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2023-10-09T07:58:35.735 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T07:58:35.735 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2023-10-09T07:58:35.735 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T07:58:35.735 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2023-10-09T07:58:35.736 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T07:58:35.736 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 37720sec preferred_lft 37720sec 2023-10-09T07:58:35.736 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2023-10-09T07:58:35.736 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:58:35.736 INFO:teuthology.orchestra.run.smithi071.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T07:58:35.736 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5a:a1:ec:c7:41:8f brd ff:ff:ff:ff:ff:ff 2023-10-09T07:58:35.736 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T07:58:35.736 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:58:35.736 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::8052:a9ff:fe85:8756/64 scope link 2023-10-09T07:58:35.736 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:58:35.737 INFO:teuthology.orchestra.run.smithi071.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T07:58:35.737 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether ae:1f:c9:59:0c:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T07:58:35.737 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ac1f:c9ff:fe59:c1b/64 scope link 2023-10-09T07:58:35.737 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:58:35.737 INFO:teuthology.orchestra.run.smithi071.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T07:58:35.737 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5a:a1:ec:c7:41:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T07:58:35.737 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::58a1:ecff:fec7:418f/64 scope link 2023-10-09T07:58:35.737 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T07:58:35.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:58:35.738 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T07:58:35.833 INFO:teuthology.orchestra.run.smithi071.stdout:1 2023-10-09T07:58:35.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:58:35.837 DEBUG:teuthology.orchestra.run.smithi071:> route 2023-10-09T07:58:35.876 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2023-10-09T07:58:35.876 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T07:58:35.876 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T07:58:35.876 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T07:58:35.877 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T07:58:35.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:58:35.878 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-09T07:58:35.879 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-09T07:58:35.879 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T07:58:35.879 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T07:58:35.879 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T07:58:35.879 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-09T07:58:36.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:58:36.073 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-09T07:58:36.110 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T07:58:36.110 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T07:58:36.110 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T07:58:36.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:58:36.110 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2023-10-09T07:58:36.211 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T07:58:36.211 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T07:58:36.247 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T07:58:36.247 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T07:58:36.247 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T07:58:36.323 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T07:58:36.323 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T07:58:36.323 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T07:58:36.453 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T07:58:36.453 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T07:58:36.481 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T07:58:36.481 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T07:58:36.482 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.71:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-09T07:58:36.482 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with new device syntax: 0@604c5619-653a-4ab6-912c-ab2e5464fe4a.cephfs=/ 2023-10-09T07:58:36.482 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.71:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-10-09T07:58:36.486 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T07:58:36.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T07:58:36.487 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T07:58:36.548 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T07:58:36.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.733+0000 7f7faef9d700 1 Processor -- start 2023-10-09T07:58:36.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.733+0000 7f7faef9d700 1 -- start start 2023-10-09T07:58:36.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.734+0000 7f7faef9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fa8159420 0x7f7fa80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:36.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.734+0000 7f7faef9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7fa815d230 0x7f7fa815d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:36.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.734+0000 7f7faef9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa815dbd0 con 0x7f7fa81597f0 2023-10-09T07:58:36.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.734+0000 7f7faef9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa80b2980 con 0x7f7fa815d230 2023-10-09T07:58:36.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.734+0000 7f7faef9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80b11d0 con 0x7f7fa8159420 2023-10-09T07:58:36.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.735+0000 7f7fad79a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f7fa81597f0 0x7f7fa80b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59916/0 (socket says 172.21.15.71:59916) 2023-10-09T07:58:36.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.735+0000 7f7fad79a700 1 -- 172.21.15.71:0/2156405496 learned_addr learned my addr 172.21.15.71:0/2156405496 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:36.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.735+0000 7f7fae79c700 1 --2- 172.21.15.71:0/2156405496 >> v2:172.21.15.179:3300/0 conn(0x7f7fa815d230 0x7f7fa815d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:36.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.735+0000 7f7fadf9b700 1 --2- 172.21.15.71:0/2156405496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fa8159420 0x7f7fa80b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:36.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.735+0000 7f7facf99700 1 -- 172.21.15.71:0/2156405496 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036829639 0 0) 0x7f7f98001110 con 0x7f7fa81597f0 2023-10-09T07:58:36.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.735+0000 7f7facf99700 1 -- 172.21.15.71:0/2156405496 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f94003570 con 0x7f7fa81597f0 2023-10-09T07:58:36.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.735+0000 7f7fae79c700 1 -- 172.21.15.71:0/2156405496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fa8159420 msgr2=0x7f7fa80b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:36.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.735+0000 7f7fae79c700 1 --2- 172.21.15.71:0/2156405496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fa8159420 0x7f7fa80b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:36.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.735+0000 7f7fae79c700 1 -- 172.21.15.71:0/2156405496 >> v1:172.21.15.71:6789/0 conn(0x7f7fa81597f0 legacy=0x7f7fa80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:36.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.735+0000 7f7fae79c700 1 -- 172.21.15.71:0/2156405496 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa80b14b0 con 0x7f7fa815d230 2023-10-09T07:58:36.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.735+0000 7f7fadf9b700 1 --2- 172.21.15.71:0/2156405496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fa8159420 0x7f7fa80b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:58:36.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.736+0000 7f7fae79c700 1 --2- 172.21.15.71:0/2156405496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fa815d230 0x7f7fa815d690 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0009e60 tx=0x7f7fa0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b52e63579c4144d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:36.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.736+0000 7f7facf99700 1 -- 172.21.15.71:0/2156405496 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa000e070 con 0x7f7fa815d230 2023-10-09T07:58:36.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.736+0000 7f7facf99700 1 -- 172.21.15.71:0/2156405496 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa000bab0 con 0x7f7fa815d230 2023-10-09T07:58:36.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.736+0000 7f7facf99700 1 -- 172.21.15.71:0/2156405496 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa000be70 con 0x7f7fa815d230 2023-10-09T07:58:36.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.736+0000 7f7faef9d700 1 -- 172.21.15.71:0/2156405496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fa815d230 msgr2=0x7f7fa815d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:36.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.736+0000 7f7faef9d700 1 --2- 172.21.15.71:0/2156405496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fa815d230 0x7f7fa815d690 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0009e60 tx=0x7f7fa0009780 comp rx=0 tx=0).stop 2023-10-09T07:58:36.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.736+0000 7f7faef9d700 1 -- 172.21.15.71:0/2156405496 shutdown_connections 2023-10-09T07:58:36.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.736+0000 7f7faef9d700 1 --2- 172.21.15.71:0/2156405496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fa815d230 0x7f7fa815d690 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:36.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.736+0000 7f7faef9d700 1 --2- 172.21.15.71:0/2156405496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fa8159420 0x7f7fa80b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:36.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.736+0000 7f7faef9d700 1 -- 172.21.15.71:0/2156405496 >> 172.21.15.71:0/2156405496 conn(0x7f7fa80d0660 msgr2=0x7f7fa80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:36.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.737+0000 7f7faef9d700 1 -- 172.21.15.71:0/2156405496 shutdown_connections 2023-10-09T07:58:36.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.737+0000 7f7faef9d700 1 -- 172.21.15.71:0/2156405496 wait complete. 2023-10-09T07:58:36.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.738+0000 7f7faef9d700 1 Processor -- start 2023-10-09T07:58:36.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.738+0000 7f7faef9d700 1 -- start start 2023-10-09T07:58:36.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.739+0000 7f7faef9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fa8159420 0x7f7fa80d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:36.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.739+0000 7f7faef9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fa81597f0 0x7f7fa80c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:36.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.739+0000 7f7faef9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fa815d230 0x7f7fa80c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:36.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.739+0000 7f7faef9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80cbd00 con 0x7f7fa815d230 2023-10-09T07:58:36.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.739+0000 7f7faef9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa815ad60 con 0x7f7fa8159420 2023-10-09T07:58:36.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.739+0000 7f7faef9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa815b000 con 0x7f7fa81597f0 2023-10-09T07:58:36.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.739+0000 7f7fae79c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fa815d230 0x7f7fa80c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:36.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.739+0000 7f7fae79c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fa815d230 0x7f7fa80c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35574/0 (socket says 172.21.15.71:35574) 2023-10-09T07:58:36.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.739+0000 7f7fae79c700 1 -- 172.21.15.71:0/593912149 learned_addr learned my addr 172.21.15.71:0/593912149 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:36.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.740+0000 7f7fae79c700 1 -- 172.21.15.71:0/593912149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fa81597f0 msgr2=0x7f7fa80c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:36.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.739+0000 7f7fadf9b700 1 --2- 172.21.15.71:0/593912149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fa8159420 0x7f7fa80d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:36.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.740+0000 7f7fad79a700 1 --2- 172.21.15.71:0/593912149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fa81597f0 0x7f7fa80c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:36.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.740+0000 7f7fae79c700 1 --2- 172.21.15.71:0/593912149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fa81597f0 0x7f7fa80c7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:36.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.740+0000 7f7fae79c700 1 -- 172.21.15.71:0/593912149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fa8159420 msgr2=0x7f7fa80d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:36.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.740+0000 7f7fae79c700 1 --2- 172.21.15.71:0/593912149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fa8159420 0x7f7fa80d0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:36.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.740+0000 7f7fae79c700 1 -- 172.21.15.71:0/593912149 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa4009420 con 0x7f7fa815d230 2023-10-09T07:58:36.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.740+0000 7f7fadf9b700 1 --2- 172.21.15.71:0/593912149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fa8159420 0x7f7fa80d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:36.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.740+0000 7f7fad79a700 1 --2- 172.21.15.71:0/593912149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fa81597f0 0x7f7fa80c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:36.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.740+0000 7f7fae79c700 1 --2- 172.21.15.71:0/593912149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fa815d230 0x7f7fa80c7550 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8089340 tx=0x7f7fa0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:36.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.740+0000 7f7f9dffb700 1 -- 172.21.15.71:0/593912149 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0027470 con 0x7f7fa815d230 2023-10-09T07:58:36.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.740+0000 7f7f9dffb700 1 -- 172.21.15.71:0/593912149 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa00275f0 con 0x7f7fa815d230 2023-10-09T07:58:36.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.740+0000 7f7faef9d700 1 -- 172.21.15.71:0/593912149 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa0009a20 con 0x7f7fa815d230 2023-10-09T07:58:36.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.740+0000 7f7f9dffb700 1 -- 172.21.15.71:0/593912149 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa00279b0 con 0x7f7fa815d230 2023-10-09T07:58:36.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.740+0000 7f7faef9d700 1 -- 172.21.15.71:0/593912149 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa815b5c0 con 0x7f7fa815d230 2023-10-09T07:58:36.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.741+0000 7f7faef9d700 1 -- 172.21.15.71:0/593912149 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa804c3c0 con 0x7f7fa815d230 2023-10-09T07:58:36.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.742+0000 7f7f9dffb700 1 -- 172.21.15.71:0/593912149 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7fa0024070 con 0x7f7fa815d230 2023-10-09T07:58:36.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.743+0000 7f7f9dffb700 1 --2- 172.21.15.71:0/593912149 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7f8c066f30 0x7f7f8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:36.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.743+0000 7f7f9dffb700 1 -- 172.21.15.71:0/593912149 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f7fa0087080 con 0x7f7fa815d230 2023-10-09T07:58:36.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.744+0000 7f7fadf9b700 1 --2- 172.21.15.71:0/593912149 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7f8c066f30 0x7f7f8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:36.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.744+0000 7f7fadf9b700 1 --2- 172.21.15.71:0/593912149 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7f8c066f30 0x7f7f8c0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40093f0 tx=0x7f7fa4008040 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:36.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.747+0000 7f7f9dffb700 1 -- 172.21.15.71:0/593912149 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7fa0054120 con 0x7f7fa815d230 2023-10-09T07:58:36.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.966+0000 7f7faef9d700 1 -- 172.21.15.71:0/593912149 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fa80b1790 con 0x7f7f8c066f30 2023-10-09T07:58:36.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.968+0000 7f7f9dffb700 1 -- 172.21.15.71:0/593912149 <== mgr.8503 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f7fa80b1790 con 0x7f7f8c066f30 2023-10-09T07:58:36.969 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-09T07:58:36.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T07:58:36.969 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cephfs" 2023-10-09T07:58:36.969 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T07:58:36.969 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-09T07:58:36.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.970+0000 7f7faef9d700 1 -- 172.21.15.71:0/593912149 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7f8c066f30 msgr2=0x7f7f8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:36.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.970+0000 7f7faef9d700 1 --2- 172.21.15.71:0/593912149 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7f8c066f30 0x7f7f8c0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40093f0 tx=0x7f7fa4008040 comp rx=0 tx=0).stop 2023-10-09T07:58:36.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.970+0000 7f7faef9d700 1 -- 172.21.15.71:0/593912149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fa815d230 msgr2=0x7f7fa80c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:36.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.970+0000 7f7faef9d700 1 --2- 172.21.15.71:0/593912149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fa815d230 0x7f7fa80c7550 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8089340 tx=0x7f7fa0019000 comp rx=0 tx=0).stop 2023-10-09T07:58:36.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.970+0000 7f7faef9d700 1 -- 172.21.15.71:0/593912149 shutdown_connections 2023-10-09T07:58:36.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.970+0000 7f7faef9d700 1 --2- 172.21.15.71:0/593912149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fa815d230 0x7f7fa80c7550 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:36.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.970+0000 7f7faef9d700 1 --2- 172.21.15.71:0/593912149 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f7f8c066f30 0x7f7f8c0693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:36.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.970+0000 7f7faef9d700 1 --2- 172.21.15.71:0/593912149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fa8159420 0x7f7fa80d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:36.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.970+0000 7f7faef9d700 1 --2- 172.21.15.71:0/593912149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fa81597f0 0x7f7fa80c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:36.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.970+0000 7f7faef9d700 1 -- 172.21.15.71:0/593912149 >> 172.21.15.71:0/593912149 conn(0x7f7fa80d0660 msgr2=0x7f7fa8155450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:36.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.970+0000 7f7faef9d700 1 -- 172.21.15.71:0/593912149 shutdown_connections 2023-10-09T07:58:36.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:36.970+0000 7f7faef9d700 1 -- 172.21.15.71:0/593912149 wait complete. 2023-10-09T07:58:36.988 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-09T07:58:37.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.171+0000 7f6a14f9d700 1 Processor -- start 2023-10-09T07:58:37.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.171+0000 7f6a14f9d700 1 -- start start 2023-10-09T07:58:37.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.172+0000 7f6a14f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a100b16d0 0x7f6a100b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:37.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.172+0000 7f6a14f9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6a100b33b0 0x7f6a100b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:37.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.172+0000 7f6a14f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a100b2080 con 0x7f6a100b4e70 2023-10-09T07:58:37.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.172+0000 7f6a14f9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a100cfb00 con 0x7f6a100b33b0 2023-10-09T07:58:37.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.172+0000 7f6a14f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a100b5c40 con 0x7f6a100b16d0 2023-10-09T07:58:37.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.172+0000 7f6a0ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6a100b33b0 0x7f6a100b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:37.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.172+0000 7f6a0ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6a100b33b0 0x7f6a100b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35578/0 (socket says 172.21.15.71:35578) 2023-10-09T07:58:37.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.172+0000 7f6a0ffff700 1 -- 172.21.15.71:0/3253910995 learned_addr learned my addr 172.21.15.71:0/3253910995 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:37.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.173+0000 7f6a0effd700 1 --2- 172.21.15.71:0/3253910995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a100b16d0 0x7f6a100b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:37.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.173+0000 7f6a0ffff700 1 -- 172.21.15.71:0/3253910995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a100b16d0 msgr2=0x7f6a100b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:37.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.173+0000 7f6a0ffff700 1 --2- 172.21.15.71:0/3253910995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a100b16d0 0x7f6a100b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:37.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.173+0000 7f6a0ffff700 1 -- 172.21.15.71:0/3253910995 >> v1:172.21.15.179:6789/0 conn(0x7f6a100b4e70 legacy=0x7f6a100ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:37.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.173+0000 7f6a0ffff700 1 -- 172.21.15.71:0/3253910995 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a100b5f20 con 0x7f6a100b33b0 2023-10-09T07:58:37.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.173+0000 7f6a0ffff700 1 --2- 172.21.15.71:0/3253910995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a100b33b0 0x7f6a100b3830 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f6a08009f20 tx=0x7f6a08009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f6471e3396ed9d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:37.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.173+0000 7f6a0e7fc700 1 -- 172.21.15.71:0/3253910995 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0800e070 con 0x7f6a100b33b0 2023-10-09T07:58:37.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.173+0000 7f6a0e7fc700 1 -- 172.21.15.71:0/3253910995 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0800ba40 con 0x7f6a100b33b0 2023-10-09T07:58:37.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.173+0000 7f6a0e7fc700 1 -- 172.21.15.71:0/3253910995 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a080092e0 con 0x7f6a100b33b0 2023-10-09T07:58:37.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.174+0000 7f6a14f9d700 1 -- 172.21.15.71:0/3253910995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a100b33b0 msgr2=0x7f6a100b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:37.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.174+0000 7f6a14f9d700 1 --2- 172.21.15.71:0/3253910995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a100b33b0 0x7f6a100b3830 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f6a08009f20 tx=0x7f6a08009840 comp rx=0 tx=0).stop 2023-10-09T07:58:37.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.174+0000 7f6a14f9d700 1 -- 172.21.15.71:0/3253910995 shutdown_connections 2023-10-09T07:58:37.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.174+0000 7f6a14f9d700 1 --2- 172.21.15.71:0/3253910995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a100b33b0 0x7f6a100b3830 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:37.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.174+0000 7f6a14f9d700 1 --2- 172.21.15.71:0/3253910995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a100b16d0 0x7f6a100b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:37.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.174+0000 7f6a14f9d700 1 -- 172.21.15.71:0/3253910995 >> 172.21.15.71:0/3253910995 conn(0x7f6a100d10c0 msgr2=0x7f6a100affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:37.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.174+0000 7f6a14f9d700 1 -- 172.21.15.71:0/3253910995 shutdown_connections 2023-10-09T07:58:37.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.174+0000 7f6a14f9d700 1 -- 172.21.15.71:0/3253910995 wait complete. 2023-10-09T07:58:37.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.175+0000 7f6a14f9d700 1 Processor -- start 2023-10-09T07:58:37.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.175+0000 7f6a14f9d700 1 -- start start 2023-10-09T07:58:37.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.176+0000 7f6a14f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a100b16d0 0x7f6a100ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:37.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.176+0000 7f6a14f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a100b33b0 0x7f6a10169ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:37.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.176+0000 7f6a14f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a100b4e70 0x7f6a100cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:37.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.176+0000 7f6a14f9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a100ca6b0 con 0x7f6a100b16d0 2023-10-09T07:58:37.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.176+0000 7f6a14f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a100c83c0 con 0x7f6a100b33b0 2023-10-09T07:58:37.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.176+0000 7f6a14f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a100c77b0 con 0x7f6a100b4e70 2023-10-09T07:58:37.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.177+0000 7f6a0f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a100b16d0 0x7f6a100ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:37.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.177+0000 7f6a0f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a100b16d0 0x7f6a100ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35584/0 (socket says 172.21.15.71:35584) 2023-10-09T07:58:37.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.177+0000 7f6a0f7fe700 1 -- 172.21.15.71:0/986291166 learned_addr learned my addr 172.21.15.71:0/986291166 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:37.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.177+0000 7f6a0ffff700 1 --2- 172.21.15.71:0/986291166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a100b4e70 0x7f6a100cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:37.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.177+0000 7f6a0effd700 1 --2- 172.21.15.71:0/986291166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a100b33b0 0x7f6a10169ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:37.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.177+0000 7f6a0f7fe700 1 -- 172.21.15.71:0/986291166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a100b4e70 msgr2=0x7f6a100cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:37.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.177+0000 7f6a0f7fe700 1 --2- 172.21.15.71:0/986291166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a100b4e70 0x7f6a100cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:37.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.177+0000 7f6a0f7fe700 1 -- 172.21.15.71:0/986291166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a100b33b0 msgr2=0x7f6a10169ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:37.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.177+0000 7f6a0f7fe700 1 --2- 172.21.15.71:0/986291166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a100b33b0 0x7f6a10169ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:37.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.177+0000 7f6a0f7fe700 1 -- 172.21.15.71:0/986291166 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a08009ae0 con 0x7f6a100b16d0 2023-10-09T07:58:37.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.177+0000 7f6a0effd700 1 --2- 172.21.15.71:0/986291166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a100b33b0 0x7f6a10169ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:37.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.177+0000 7f6a0ffff700 1 --2- 172.21.15.71:0/986291166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a100b4e70 0x7f6a100cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T07:58:37.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.177+0000 7f6a0f7fe700 1 --2- 172.21.15.71:0/986291166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a100b16d0 0x7f6a100ca170 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f6a0000b5e0 tx=0x7f6a00009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:37.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.177+0000 7f69f77fe700 1 -- 172.21.15.71:0/986291166 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0000f510 con 0x7f6a100b16d0 2023-10-09T07:58:37.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.178+0000 7f69f77fe700 1 -- 172.21.15.71:0/986291166 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0000f670 con 0x7f6a100b16d0 2023-10-09T07:58:37.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.178+0000 7f69f77fe700 1 -- 172.21.15.71:0/986291166 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0000fa30 con 0x7f6a100b16d0 2023-10-09T07:58:37.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.178+0000 7f6a14f9d700 1 -- 172.21.15.71:0/986291166 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a100c7a90 con 0x7f6a100b16d0 2023-10-09T07:58:37.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.178+0000 7f6a14f9d700 1 -- 172.21.15.71:0/986291166 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a100c8050 con 0x7f6a100b16d0 2023-10-09T07:58:37.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.179+0000 7f6a14f9d700 1 -- 172.21.15.71:0/986291166 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a10088990 con 0x7f6a100b16d0 2023-10-09T07:58:37.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.180+0000 7f69f77fe700 1 -- 172.21.15.71:0/986291166 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 76) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a0001a400 con 0x7f6a100b16d0 2023-10-09T07:58:37.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.181+0000 7f69f77fe700 1 --2- 172.21.15.71:0/986291166 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f69fc066f30 0x7f69fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:37.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.181+0000 7f69f77fe700 1 -- 172.21.15.71:0/986291166 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f6a00084290 con 0x7f6a100b16d0 2023-10-09T07:58:37.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.181+0000 7f6a0effd700 1 --2- 172.21.15.71:0/986291166 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f69fc066f30 0x7f69fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:37.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.182+0000 7f6a0effd700 1 --2- 172.21.15.71:0/986291166 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f69fc066f30 0x7f69fc0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6a1015f120 tx=0x7f6a04008040 comp rx=0 tx=0).ready entity=mgr.8503 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:37.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.185+0000 7f69f77fe700 1 -- 172.21.15.71:0/986291166 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a00051310 con 0x7f6a100b16d0 2023-10-09T07:58:37.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.428+0000 7f6a14f9d700 1 -- 172.21.15.71:0/986291166 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f6a1004bb80 con 0x7f6a100b16d0 2023-10-09T07:58:37.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.677+0000 7f69f77fe700 1 -- 172.21.15.71:0/986291166 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 77) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f6a000825d0 con 0x7f6a100b16d0 2023-10-09T07:58:37.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.679+0000 7f69f77fe700 1 -- 172.21.15.71:0/986291166 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v77) v1 ==== 92+0+0 (secure 0 0 0) 0x7f6a00051310 con 0x7f6a100b16d0 2023-10-09T07:58:37.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.682+0000 7f6a14f9d700 1 -- 172.21.15.71:0/986291166 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f69fc066f30 msgr2=0x7f69fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:37.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.682+0000 7f6a14f9d700 1 --2- 172.21.15.71:0/986291166 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f69fc066f30 0x7f69fc0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6a1015f120 tx=0x7f6a04008040 comp rx=0 tx=0).stop 2023-10-09T07:58:37.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.682+0000 7f6a14f9d700 1 -- 172.21.15.71:0/986291166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a100b16d0 msgr2=0x7f6a100ca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:37.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.682+0000 7f6a14f9d700 1 --2- 172.21.15.71:0/986291166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a100b16d0 0x7f6a100ca170 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f6a0000b5e0 tx=0x7f6a00009120 comp rx=0 tx=0).stop 2023-10-09T07:58:37.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.682+0000 7f6a14f9d700 1 -- 172.21.15.71:0/986291166 shutdown_connections 2023-10-09T07:58:37.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.682+0000 7f6a14f9d700 1 --2- 172.21.15.71:0/986291166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a100b4e70 0x7f6a100cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:37.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.682+0000 7f6a14f9d700 1 --2- 172.21.15.71:0/986291166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a100b16d0 0x7f6a100ca170 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:37.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.682+0000 7f6a14f9d700 1 --2- 172.21.15.71:0/986291166 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f69fc066f30 0x7f69fc0693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:37.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.682+0000 7f6a14f9d700 1 --2- 172.21.15.71:0/986291166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a100b33b0 0x7f6a10169ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:37.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.682+0000 7f6a14f9d700 1 -- 172.21.15.71:0/986291166 >> 172.21.15.71:0/986291166 conn(0x7f6a100d10c0 msgr2=0x7f6a10068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:37.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.682+0000 7f6a14f9d700 1 -- 172.21.15.71:0/986291166 shutdown_connections 2023-10-09T07:58:37.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.682+0000 7f6a14f9d700 1 -- 172.21.15.71:0/986291166 wait complete. 2023-10-09T07:58:37.702 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-09T07:58:37.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.892+0000 7f8ede39d700 1 Processor -- start 2023-10-09T07:58:37.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.893+0000 7f8ede39d700 1 -- start start 2023-10-09T07:58:37.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.894+0000 7f8ede39d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8ed80b16d0 0x7f8ed80b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:37.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.894+0000 7f8ede39d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8ed80b33b0 0x7f8ed80b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:37.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.894+0000 7f8ede39d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed80b2080 con 0x7f8ed80b4e70 2023-10-09T07:58:37.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.894+0000 7f8ede39d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed80cfb00 con 0x7f8ed80b33b0 2023-10-09T07:58:37.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.894+0000 7f8ede39d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed80b5c40 con 0x7f8ed80b16d0 2023-10-09T07:58:37.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.894+0000 7f8edd39b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8ed80b4e70 0x7f8ed80ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59938/0 (socket says 172.21.15.71:59938) 2023-10-09T07:58:37.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.894+0000 7f8edd39b700 1 -- 172.21.15.71:0/1243813484 learned_addr learned my addr 172.21.15.71:0/1243813484 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T07:58:37.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.894+0000 7f8eddb9c700 1 --2- 172.21.15.71:0/1243813484 >> v2:172.21.15.71:3300/0 conn(0x7f8ed80b33b0 0x7f8ed80b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:37.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.894+0000 7f8edcb9a700 1 --2- 172.21.15.71:0/1243813484 >> v2:172.21.15.179:3300/0 conn(0x7f8ed80b16d0 0x7f8ed80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:37.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.895+0000 7f8ecffff700 1 -- 172.21.15.71:0/1243813484 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1453416782 0 0) 0x7f8ed80b2080 con 0x7f8ed80b4e70 2023-10-09T07:58:37.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.895+0000 7f8ecffff700 1 -- 172.21.15.71:0/1243813484 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ec4003570 con 0x7f8ed80b4e70 2023-10-09T07:58:37.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.895+0000 7f8eddb9c700 1 -- 172.21.15.71:0/1243813484 >> v2:172.21.15.179:3300/0 conn(0x7f8ed80b16d0 msgr2=0x7f8ed80b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:37.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.895+0000 7f8eddb9c700 1 --2- 172.21.15.71:0/1243813484 >> v2:172.21.15.179:3300/0 conn(0x7f8ed80b16d0 0x7f8ed80b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:37.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.895+0000 7f8eddb9c700 1 -- 172.21.15.71:0/1243813484 >> v1:172.21.15.71:6789/0 conn(0x7f8ed80b4e70 legacy=0x7f8ed80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:37.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.895+0000 7f8eddb9c700 1 -- 172.21.15.71:0/1243813484 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed80b5f20 con 0x7f8ed80b33b0 2023-10-09T07:58:37.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.895+0000 7f8eddb9c700 1 --2- 172.21.15.71:0/1243813484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ed80b33b0 0x7f8ed80b37d0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8089830 tx=0x7f8ed0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0b123231837677 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:37.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.895+0000 7f8ecffff700 1 -- 172.21.15.71:0/1243813484 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed000e070 con 0x7f8ed80b33b0 2023-10-09T07:58:37.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.895+0000 7f8ecffff700 1 -- 172.21.15.71:0/1243813484 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed000bab0 con 0x7f8ed80b33b0 2023-10-09T07:58:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.895+0000 7f8ecffff700 1 -- 172.21.15.71:0/1243813484 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed000be50 con 0x7f8ed80b33b0 2023-10-09T07:58:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.896+0000 7f8ede39d700 1 -- 172.21.15.71:0/1243813484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ed80b33b0 msgr2=0x7f8ed80b37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.896+0000 7f8ede39d700 1 --2- 172.21.15.71:0/1243813484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ed80b33b0 0x7f8ed80b37d0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8089830 tx=0x7f8ed0009780 comp rx=0 tx=0).stop 2023-10-09T07:58:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.896+0000 7f8ede39d700 1 -- 172.21.15.71:0/1243813484 shutdown_connections 2023-10-09T07:58:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.896+0000 7f8ede39d700 1 --2- 172.21.15.71:0/1243813484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ed80b33b0 0x7f8ed80b37d0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.896+0000 7f8ede39d700 1 --2- 172.21.15.71:0/1243813484 >> v2:172.21.15.179:3300/0 conn(0x7f8ed80b16d0 0x7f8ed80b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.896+0000 7f8ede39d700 1 -- 172.21.15.71:0/1243813484 >> 172.21.15.71:0/1243813484 conn(0x7f8ed80d10c0 msgr2=0x7f8ed80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.896+0000 7f8ede39d700 1 -- 172.21.15.71:0/1243813484 shutdown_connections 2023-10-09T07:58:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.896+0000 7f8ede39d700 1 -- 172.21.15.71:0/1243813484 wait complete. 2023-10-09T07:58:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.898+0000 7f8ede39d700 1 Processor -- start 2023-10-09T07:58:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.898+0000 7f8ede39d700 1 -- start start 2023-10-09T07:58:37.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.899+0000 7f8ede39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ed80b16d0 0x7f8ed81459c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:37.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.899+0000 7f8ede39d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ed80b33b0 0x7f8ed80affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:37.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.899+0000 7f8ede39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ed80b4e70 0x7f8ed80b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:37.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.899+0000 7f8ede39d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed8149340 con 0x7f8ed80b33b0 2023-10-09T07:58:37.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.899+0000 7f8ede39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed8148eb0 con 0x7f8ed80b16d0 2023-10-09T07:58:37.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.899+0000 7f8ede39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed81482a0 con 0x7f8ed80b4e70 2023-10-09T07:58:37.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.899+0000 7f8edcb9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ed80b33b0 0x7f8ed80affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:37.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.899+0000 7f8edcb9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ed80b33b0 0x7f8ed80affb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35622/0 (socket says 172.21.15.71:35622) 2023-10-09T07:58:37.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.899+0000 7f8edcb9a700 1 -- 172.21.15.71:0/1229952980 learned_addr learned my addr 172.21.15.71:0/1229952980 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:37.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.899+0000 7f8edd39b700 1 --2- 172.21.15.71:0/1229952980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ed80b16d0 0x7f8ed81459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.899+0000 7f8eddb9c700 1 --2- 172.21.15.71:0/1229952980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ed80b4e70 0x7f8ed80b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.899+0000 7f8edcb9a700 1 -- 172.21.15.71:0/1229952980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ed80b4e70 msgr2=0x7f8ed80b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.899+0000 7f8edcb9a700 1 --2- 172.21.15.71:0/1229952980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ed80b4e70 0x7f8ed80b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.899+0000 7f8edcb9a700 1 -- 172.21.15.71:0/1229952980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ed80b16d0 msgr2=0x7f8ed81459c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.899+0000 7f8edcb9a700 1 --2- 172.21.15.71:0/1229952980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ed80b16d0 0x7f8ed81459c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.899+0000 7f8edcb9a700 1 -- 172.21.15.71:0/1229952980 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed0009a20 con 0x7f8ed80b33b0 2023-10-09T07:58:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.899+0000 7f8edd39b700 1 --2- 172.21.15.71:0/1229952980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ed80b16d0 0x7f8ed81459c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T07:58:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.900+0000 7f8edcb9a700 1 --2- 172.21.15.71:0/1229952980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ed80b33b0 0x7f8ed80affb0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f8ec800e930 tx=0x7f8ec80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.900+0000 7f8ecd7fa700 1 -- 172.21.15.71:0/1229952980 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8013680 con 0x7f8ed80b33b0 2023-10-09T07:58:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.900+0000 7f8ecd7fa700 1 -- 172.21.15.71:0/1229952980 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec80137e0 con 0x7f8ed80b33b0 2023-10-09T07:58:37.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.900+0000 7f8ede39d700 1 -- 172.21.15.71:0/1229952980 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed8148580 con 0x7f8ed80b33b0 2023-10-09T07:58:37.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.900+0000 7f8ecd7fa700 1 -- 172.21.15.71:0/1229952980 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8013b80 con 0x7f8ed80b33b0 2023-10-09T07:58:37.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.900+0000 7f8ede39d700 1 -- 172.21.15.71:0/1229952980 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed8148b40 con 0x7f8ed80b33b0 2023-10-09T07:58:37.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.901+0000 7f8ede39d700 1 -- 172.21.15.71:0/1229952980 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed8149020 con 0x7f8ed80b33b0 2023-10-09T07:58:37.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.902+0000 7f8ecd7fa700 1 -- 172.21.15.71:0/1229952980 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 77) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f8ec800c3e0 con 0x7f8ed80b33b0 2023-10-09T07:58:37.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.903+0000 7f8ecd7fa700 1 --2- 172.21.15.71:0/1229952980 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8ebc066f80 0x7f8ebc069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:37.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.903+0000 7f8ecd7fa700 1 -- 172.21.15.71:0/1229952980 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f8ec8084810 con 0x7f8ed80b33b0 2023-10-09T07:58:37.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.903+0000 7f8edd39b700 1 -- 172.21.15.71:0/1229952980 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8ebc066f80 msgr2=0x7f8ebc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:37.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.903+0000 7f8edd39b700 1 --2- 172.21.15.71:0/1229952980 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8ebc066f80 0x7f8ebc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:58:37.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:37.907+0000 7f8ecd7fa700 1 -- 172.21.15.71:0/1229952980 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ec80518b0 con 0x7f8ed80b33b0 2023-10-09T07:58:38.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.104+0000 7f8edd39b700 1 -- 172.21.15.71:0/1229952980 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8ebc066f80 msgr2=0x7f8ebc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:38.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.104+0000 7f8edd39b700 1 --2- 172.21.15.71:0/1229952980 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8ebc066f80 0x7f8ebc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:58:38.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.152+0000 7f8ede39d700 1 -- 172.21.15.71:0/1229952980 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f8ed804bb80 con 0x7f8ed80b33b0 2023-10-09T07:58:38.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.161+0000 7f8ecd7fa700 1 -- 172.21.15.71:0/1229952980 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v59)=0 v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8ec8054ed0 con 0x7f8ed80b33b0 2023-10-09T07:58:38.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.163+0000 7f8ede39d700 1 -- 172.21.15.71:0/1229952980 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8ebc066f80 msgr2=0x7f8ebc069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:58:38.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.163+0000 7f8ede39d700 1 --2- 172.21.15.71:0/1229952980 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8ebc066f80 0x7f8ebc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.163+0000 7f8ede39d700 1 -- 172.21.15.71:0/1229952980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ed80b33b0 msgr2=0x7f8ed80affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:38.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.163+0000 7f8ede39d700 1 --2- 172.21.15.71:0/1229952980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ed80b33b0 0x7f8ed80affb0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f8ec800e930 tx=0x7f8ec80091a0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.163+0000 7f8ede39d700 1 -- 172.21.15.71:0/1229952980 shutdown_connections 2023-10-09T07:58:38.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.163+0000 7f8ede39d700 1 --2- 172.21.15.71:0/1229952980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ed80b4e70 0x7f8ed80b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.163+0000 7f8ede39d700 1 --2- 172.21.15.71:0/1229952980 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f8ebc066f80 0x7f8ebc069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.163+0000 7f8ede39d700 1 --2- 172.21.15.71:0/1229952980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ed80b16d0 0x7f8ed81459c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.163+0000 7f8ede39d700 1 --2- 172.21.15.71:0/1229952980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ed80b33b0 0x7f8ed80affb0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.163+0000 7f8ede39d700 1 -- 172.21.15.71:0/1229952980 >> 172.21.15.71:0/1229952980 conn(0x7f8ed80d10c0 msgr2=0x7f8ed815c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:38.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.163+0000 7f8ede39d700 1 -- 172.21.15.71:0/1229952980 shutdown_connections 2023-10-09T07:58:38.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.163+0000 7f8ede39d700 1 -- 172.21.15.71:0/1229952980 wait complete. 2023-10-09T07:58:38.182 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-09T07:58:38.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.371+0000 7f288a79d700 1 Processor -- start 2023-10-09T07:58:38.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.371+0000 7f288a79d700 1 -- start start 2023-10-09T07:58:38.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.372+0000 7f288a79d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28841407e0 0x7f288406a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:38.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.373+0000 7f288a79d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2884140bb0 0x7f288406a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:38.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.373+0000 7f288a79d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f288406d4f0 0x7f288406d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:38.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.373+0000 7f288a79d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28840c6820 con 0x7f2884140bb0 2023-10-09T07:58:38.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.373+0000 7f288a79d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28840c6de0 con 0x7f288406d4f0 2023-10-09T07:58:38.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.373+0000 7f288a79d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288406de70 con 0x7f28841407e0 2023-10-09T07:58:38.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.373+0000 7f2888f9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2884140bb0 0x7f288406a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:38.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.373+0000 7f2888f9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2884140bb0 0x7f288406a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35630/0 (socket says 172.21.15.71:35630) 2023-10-09T07:58:38.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.373+0000 7f2888f9a700 1 -- 172.21.15.71:0/2224130887 learned_addr learned my addr 172.21.15.71:0/2224130887 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:38.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.373+0000 7f288979b700 1 --2- 172.21.15.71:0/2224130887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28841407e0 0x7f288406a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:38.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.373+0000 7f2889f9c700 1 --2- 172.21.15.71:0/2224130887 >> v2:172.21.15.179:3300/0 conn(0x7f288406d4f0 0x7f288406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:38.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.373+0000 7f2888f9a700 1 -- 172.21.15.71:0/2224130887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28841407e0 msgr2=0x7f288406a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:38.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.373+0000 7f2888f9a700 1 --2- 172.21.15.71:0/2224130887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28841407e0 0x7f288406a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.373+0000 7f2888f9a700 1 -- 172.21.15.71:0/2224130887 >> v2:172.21.15.179:3300/0 conn(0x7f288406d4f0 msgr2=0x7f288406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:38.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.373+0000 7f2888f9a700 1 --2- 172.21.15.71:0/2224130887 >> v2:172.21.15.179:3300/0 conn(0x7f288406d4f0 0x7f288406d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.373+0000 7f2888f9a700 1 -- 172.21.15.71:0/2224130887 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2884141270 con 0x7f2884140bb0 2023-10-09T07:58:38.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.374+0000 7f2888f9a700 1 --2- 172.21.15.71:0/2224130887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2884140bb0 0x7f288406a6c0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f288406ac00 tx=0x7f2874009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11159599fbcb5fb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:38.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.374+0000 7f287bfff700 1 -- 172.21.15.71:0/2224130887 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287400b640 con 0x7f2884140bb0 2023-10-09T07:58:38.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.374+0000 7f287bfff700 1 -- 172.21.15.71:0/2224130887 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287400b7a0 con 0x7f2884140bb0 2023-10-09T07:58:38.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.374+0000 7f287bfff700 1 -- 172.21.15.71:0/2224130887 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287400bb60 con 0x7f2884140bb0 2023-10-09T07:58:38.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.375+0000 7f288a79d700 1 -- 172.21.15.71:0/2224130887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2884140bb0 msgr2=0x7f288406a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:38.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.375+0000 7f288a79d700 1 --2- 172.21.15.71:0/2224130887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2884140bb0 0x7f288406a6c0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f288406ac00 tx=0x7f2874009250 comp rx=0 tx=0).stop 2023-10-09T07:58:38.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.375+0000 7f288a79d700 1 -- 172.21.15.71:0/2224130887 shutdown_connections 2023-10-09T07:58:38.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.375+0000 7f288a79d700 1 --2- 172.21.15.71:0/2224130887 >> v2:172.21.15.179:3300/0 conn(0x7f288406d4f0 0x7f288406d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.375+0000 7f288a79d700 1 --2- 172.21.15.71:0/2224130887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28841407e0 0x7f288406a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.375+0000 7f288a79d700 1 --2- 172.21.15.71:0/2224130887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2884140bb0 0x7f288406a6c0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.375+0000 7f288a79d700 1 -- 172.21.15.71:0/2224130887 >> 172.21.15.71:0/2224130887 conn(0x7f28840cc1e0 msgr2=0x7f28840cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:38.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.375+0000 7f288a79d700 1 -- 172.21.15.71:0/2224130887 shutdown_connections 2023-10-09T07:58:38.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.375+0000 7f288a79d700 1 -- 172.21.15.71:0/2224130887 wait complete. 2023-10-09T07:58:38.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.376+0000 7f288a79d700 1 Processor -- start 2023-10-09T07:58:38.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.376+0000 7f288a79d700 1 -- start start 2023-10-09T07:58:38.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.377+0000 7f288a79d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f288406d4f0 0x7f2884157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:38.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.377+0000 7f288a79d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28841407e0 0x7f28840c3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:38.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.377+0000 7f288a79d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2884140bb0 0x7f28840c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:38.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.377+0000 7f288a79d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288412ef80 con 0x7f28841407e0 2023-10-09T07:58:38.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.377+0000 7f288a79d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28841575c0 con 0x7f2884140bb0 2023-10-09T07:58:38.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.377+0000 7f288a79d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288413ec10 con 0x7f288406d4f0 2023-10-09T07:58:38.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.377+0000 7f2888f9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28841407e0 0x7f28840c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:38.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.378+0000 7f2888f9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28841407e0 0x7f28840c3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35636/0 (socket says 172.21.15.71:35636) 2023-10-09T07:58:38.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.378+0000 7f2888f9a700 1 -- 172.21.15.71:0/1926476512 learned_addr learned my addr 172.21.15.71:0/1926476512 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:38.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.378+0000 7f2889f9c700 1 --2- 172.21.15.71:0/1926476512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2884140bb0 0x7f28840c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:38.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.378+0000 7f288979b700 1 --2- 172.21.15.71:0/1926476512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f288406d4f0 0x7f2884157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:38.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.378+0000 7f2888f9a700 1 -- 172.21.15.71:0/1926476512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f288406d4f0 msgr2=0x7f2884157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:38.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.378+0000 7f2888f9a700 1 --2- 172.21.15.71:0/1926476512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f288406d4f0 0x7f2884157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.378+0000 7f2888f9a700 1 -- 172.21.15.71:0/1926476512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2884140bb0 msgr2=0x7f28840c37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:38.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.378+0000 7f2888f9a700 1 --2- 172.21.15.71:0/1926476512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2884140bb0 0x7f28840c37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.378+0000 7f2888f9a700 1 -- 172.21.15.71:0/1926476512 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28740094f0 con 0x7f28841407e0 2023-10-09T07:58:38.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.378+0000 7f2888f9a700 1 --2- 172.21.15.71:0/1926476512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28841407e0 0x7f28840c3290 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f288406cd50 tx=0x7f2874017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:38.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.379+0000 7f28797fa700 1 -- 172.21.15.71:0/1926476512 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287400b910 con 0x7f28841407e0 2023-10-09T07:58:38.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.379+0000 7f28797fa700 1 -- 172.21.15.71:0/1926476512 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287400ba70 con 0x7f28841407e0 2023-10-09T07:58:38.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.379+0000 7f28797fa700 1 -- 172.21.15.71:0/1926476512 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287401a680 con 0x7f28841407e0 2023-10-09T07:58:38.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.379+0000 7f288a79d700 1 -- 172.21.15.71:0/1926476512 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28840c3de0 con 0x7f28841407e0 2023-10-09T07:58:38.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.379+0000 7f288a79d700 1 -- 172.21.15.71:0/1926476512 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288412ec10 con 0x7f28841407e0 2023-10-09T07:58:38.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.380+0000 7f288a79d700 1 -- 172.21.15.71:0/1926476512 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288412e790 con 0x7f28841407e0 2023-10-09T07:58:38.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.381+0000 7f28797fa700 1 -- 172.21.15.71:0/1926476512 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 77) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f287401aa70 con 0x7f28841407e0 2023-10-09T07:58:38.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.381+0000 7f28797fa700 1 --2- 172.21.15.71:0/1926476512 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2868066f80 0x7f2868069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:38.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.382+0000 7f28797fa700 1 -- 172.21.15.71:0/1926476512 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f2874085fa0 con 0x7f28841407e0 2023-10-09T07:58:38.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.382+0000 7f288979b700 1 -- 172.21.15.71:0/1926476512 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2868066f80 msgr2=0x7f2868069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:38.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.382+0000 7f288979b700 1 --2- 172.21.15.71:0/1926476512 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2868066f80 0x7f2868069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:58:38.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.386+0000 7f28797fa700 1 -- 172.21.15.71:0/1926476512 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f288412e790 con 0x7f28841407e0 2023-10-09T07:58:38.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.583+0000 7f288979b700 1 -- 172.21.15.71:0/1926476512 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2868066f80 msgr2=0x7f2868069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:38.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.583+0000 7f288979b700 1 --2- 172.21.15.71:0/1926476512 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2868066f80 0x7f2868069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:58:38.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.585+0000 7f288a79d700 1 -- 172.21.15.71:0/1926476512 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f288412e790 con 0x7f28841407e0 2023-10-09T07:58:38.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.590+0000 7f28797fa700 1 -- 172.21.15.71:0/1926476512 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v60)=0 v60) v1 ==== 133+0+0 (secure 0 0 0) 0x7f288412e790 con 0x7f28841407e0 2023-10-09T07:58:38.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.593+0000 7f288a79d700 1 -- 172.21.15.71:0/1926476512 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2868066f80 msgr2=0x7f2868069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:58:38.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.593+0000 7f288a79d700 1 --2- 172.21.15.71:0/1926476512 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2868066f80 0x7f2868069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.593+0000 7f288a79d700 1 -- 172.21.15.71:0/1926476512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28841407e0 msgr2=0x7f28840c3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:38.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.593+0000 7f288a79d700 1 --2- 172.21.15.71:0/1926476512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28841407e0 0x7f28840c3290 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f288406cd50 tx=0x7f2874017000 comp rx=0 tx=0).stop 2023-10-09T07:58:38.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.593+0000 7f288a79d700 1 -- 172.21.15.71:0/1926476512 shutdown_connections 2023-10-09T07:58:38.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.593+0000 7f288a79d700 1 --2- 172.21.15.71:0/1926476512 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f2868066f80 0x7f2868069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.593+0000 7f288a79d700 1 --2- 172.21.15.71:0/1926476512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2884140bb0 0x7f28840c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.593+0000 7f288a79d700 1 --2- 172.21.15.71:0/1926476512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f288406d4f0 0x7f2884157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.593+0000 7f288a79d700 1 --2- 172.21.15.71:0/1926476512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28841407e0 0x7f28840c3290 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.593+0000 7f288a79d700 1 -- 172.21.15.71:0/1926476512 >> 172.21.15.71:0/1926476512 conn(0x7f28840cc1e0 msgr2=0x7f28840af530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:38.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.593+0000 7f288a79d700 1 -- 172.21.15.71:0/1926476512 shutdown_connections 2023-10-09T07:58:38.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.593+0000 7f288a79d700 1 -- 172.21.15.71:0/1926476512 wait complete. 2023-10-09T07:58:38.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:58:38.612 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-09T07:58:38.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T07:58:38.653 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/test_restart) 2023-10-09T07:58:38.731 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/test_restart 1M 2023-10-09T07:58:38.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.960+0000 7ffa85d9d700 1 Processor -- start 2023-10-09T07:58:38.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.960+0000 7ffa85d9d700 1 -- start start 2023-10-09T07:58:38.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.961+0000 7ffa85d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ffa800cb560 0x7ffa800cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:38.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.961+0000 7ffa85d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffa800cc970 0x7ffa800697b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:38.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.961+0000 7ffa85d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa80069cf0 0x7ffa8006d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:38.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.961+0000 7ffa85d9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa8006aa30 con 0x7ffa800cb560 2023-10-09T07:58:38.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.961+0000 7ffa85d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa800cce10 con 0x7ffa800cc970 2023-10-09T07:58:38.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.961+0000 7ffa85d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa80159db0 con 0x7ffa80069cf0 2023-10-09T07:58:38.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.962+0000 7ffa84d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ffa800cb560 0x7ffa800cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:38.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.962+0000 7ffa84d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ffa800cb560 0x7ffa800cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35640/0 (socket says 172.21.15.71:35640) 2023-10-09T07:58:38.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.962+0000 7ffa84d9b700 1 -- 172.21.15.71:0/1923162538 learned_addr learned my addr 172.21.15.71:0/1923162538 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:38.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.962+0000 7ffa8559c700 1 --2- 172.21.15.71:0/1923162538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa80069cf0 0x7ffa8006d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:38.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.962+0000 7ffa7ffff700 1 --2- 172.21.15.71:0/1923162538 >> v2:172.21.15.179:3300/0 conn(0x7ffa800cc970 0x7ffa800697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:38.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.962+0000 7ffa84d9b700 1 -- 172.21.15.71:0/1923162538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa80069cf0 msgr2=0x7ffa8006d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.962+0000 7ffa84d9b700 1 --2- 172.21.15.71:0/1923162538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa80069cf0 0x7ffa8006d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.962+0000 7ffa84d9b700 1 -- 172.21.15.71:0/1923162538 >> v2:172.21.15.179:3300/0 conn(0x7ffa800cc970 msgr2=0x7ffa800697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T07:58:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.962+0000 7ffa84d9b700 1 --2- 172.21.15.71:0/1923162538 >> v2:172.21.15.179:3300/0 conn(0x7ffa800cc970 0x7ffa800697b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.962+0000 7ffa84d9b700 1 -- 172.21.15.71:0/1923162538 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8006a470 con 0x7ffa800cb560 2023-10-09T07:58:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.963+0000 7ffa84d9b700 1 --2- 172.21.15.71:0/1923162538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa800cb560 0x7ffa800cc430 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7ffa740099b0 tx=0x7ffa74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7eed383015e14f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.963+0000 7ffa7f7fe700 1 -- 172.21.15.71:0/1923162538 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7400b640 con 0x7ffa800cb560 2023-10-09T07:58:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.963+0000 7ffa7f7fe700 1 -- 172.21.15.71:0/1923162538 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7400b7a0 con 0x7ffa800cb560 2023-10-09T07:58:38.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.963+0000 7ffa7f7fe700 1 -- 172.21.15.71:0/1923162538 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7400bb40 con 0x7ffa800cb560 2023-10-09T07:58:38.966 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:38.963+0000 7f4a0752a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T07:58:38.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.963+0000 7ffa85d9d700 1 -- 172.21.15.71:0/1923162538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa800cb560 msgr2=0x7ffa800cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:38.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.963+0000 7ffa85d9d700 1 --2- 172.21.15.71:0/1923162538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa800cb560 0x7ffa800cc430 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7ffa740099b0 tx=0x7ffa74009250 comp rx=0 tx=0).stop 2023-10-09T07:58:38.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.964+0000 7ffa85d9d700 1 -- 172.21.15.71:0/1923162538 shutdown_connections 2023-10-09T07:58:38.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.964+0000 7ffa85d9d700 1 --2- 172.21.15.71:0/1923162538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa80069cf0 0x7ffa8006d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.964+0000 7ffa85d9d700 1 --2- 172.21.15.71:0/1923162538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa800cb560 0x7ffa800cc430 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.964+0000 7ffa85d9d700 1 --2- 172.21.15.71:0/1923162538 >> v2:172.21.15.179:3300/0 conn(0x7ffa800cc970 0x7ffa800697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.964+0000 7ffa85d9d700 1 -- 172.21.15.71:0/1923162538 >> 172.21.15.71:0/1923162538 conn(0x7ffa8006baf0 msgr2=0x7ffa8006bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:38.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.964+0000 7ffa85d9d700 1 -- 172.21.15.71:0/1923162538 shutdown_connections 2023-10-09T07:58:38.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.964+0000 7ffa85d9d700 1 -- 172.21.15.71:0/1923162538 wait complete. 2023-10-09T07:58:38.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.965+0000 7ffa85d9d700 1 Processor -- start 2023-10-09T07:58:38.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.965+0000 7ffa85d9d700 1 -- start start 2023-10-09T07:58:38.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.966+0000 7ffa85d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa80069cf0 0x7ffa800abe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:38.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.966+0000 7ffa85d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa800cb560 0x7ffa800ad730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:38.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.966+0000 7ffa85d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa800cc970 0x7ffa800c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:38.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.966+0000 7ffa85d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800adc70 con 0x7ffa800cb560 2023-10-09T07:58:38.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.966+0000 7ffa85d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800c8580 con 0x7ffa80069cf0 2023-10-09T07:58:38.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.966+0000 7ffa85d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800c8820 con 0x7ffa800cc970 2023-10-09T07:58:38.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.966+0000 7ffa7ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa800cb560 0x7ffa800ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:38.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.966+0000 7ffa7ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa800cb560 0x7ffa800ad730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35648/0 (socket says 172.21.15.71:35648) 2023-10-09T07:58:38.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.966+0000 7ffa7ffff700 1 -- 172.21.15.71:0/4015086993 learned_addr learned my addr 172.21.15.71:0/4015086993 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:38.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.966+0000 7ffa8559c700 1 --2- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa800cc970 0x7ffa800c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:38.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.967+0000 7ffa84d9b700 1 --2- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa80069cf0 0x7ffa800abe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:38.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.967+0000 7ffa7ffff700 1 -- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa800cc970 msgr2=0x7ffa800c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:38.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.967+0000 7ffa7ffff700 1 --2- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa800cc970 0x7ffa800c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.967+0000 7ffa7ffff700 1 -- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa80069cf0 msgr2=0x7ffa800abe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:38.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.967+0000 7ffa7ffff700 1 --2- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa80069cf0 0x7ffa800abe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:38.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.967+0000 7ffa7ffff700 1 -- 172.21.15.71:0/4015086993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa740094f0 con 0x7ffa800cb560 2023-10-09T07:58:38.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.967+0000 7ffa84d9b700 1 --2- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa80069cf0 0x7ffa800abe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T07:58:38.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.967+0000 7ffa7ffff700 1 --2- 172.21.15.71:0/4015086993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa800cb560 0x7ffa800ad730 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00e930 tx=0x7ffa6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:38.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.967+0000 7ffa7cff9700 1 -- 172.21.15.71:0/4015086993 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c013680 con 0x7ffa800cb560 2023-10-09T07:58:38.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.967+0000 7ffa7cff9700 1 -- 172.21.15.71:0/4015086993 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6c0137e0 con 0x7ffa800cb560 2023-10-09T07:58:38.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.967+0000 7ffa85d9d700 1 -- 172.21.15.71:0/4015086993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa800c58c0 con 0x7ffa800cb560 2023-10-09T07:58:38.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.967+0000 7ffa7cff9700 1 -- 172.21.15.71:0/4015086993 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c013b80 con 0x7ffa800cb560 2023-10-09T07:58:38.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.967+0000 7ffa85d9d700 1 -- 172.21.15.71:0/4015086993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa800c5e80 con 0x7ffa800cb560 2023-10-09T07:58:38.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.968+0000 7ffa85d9d700 1 -- 172.21.15.71:0/4015086993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa8004c3c0 con 0x7ffa800cb560 2023-10-09T07:58:38.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.969+0000 7ffa7cff9700 1 -- 172.21.15.71:0/4015086993 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 77) v1 ==== 84757+0+0 (secure 0 0 0) 0x7ffa6c00c460 con 0x7ffa800cb560 2023-10-09T07:58:38.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.970+0000 7ffa7cff9700 1 --2- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ffa64066f80 0x7ffa64069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:38.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.970+0000 7ffa7cff9700 1 -- 172.21.15.71:0/4015086993 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6169+0+0 (secure 0 0 0) 0x7ffa6c084990 con 0x7ffa800cb560 2023-10-09T07:58:38.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.970+0000 7ffa84d9b700 1 -- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ffa64066f80 msgr2=0x7ffa64069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:38.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.970+0000 7ffa84d9b700 1 --2- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ffa64066f80 0x7ffa64069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T07:58:38.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:38.974+0000 7ffa7cff9700 1 -- 172.21.15.71:0/4015086993 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa6c051990 con 0x7ffa800cb560 2023-10-09T07:58:39.043 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:39.042+0000 7f2595cc9180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T07:58:39.130 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:39.130+0000 7f4a0752a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T07:58:39.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:39.171+0000 7ffa84d9b700 1 -- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ffa64066f80 msgr2=0x7ffa64069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:39.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:39.171+0000 7ffa84d9b700 1 --2- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ffa64066f80 0x7ffa64069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T07:58:39.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:39.201+0000 7ffa85d9d700 1 -- 172.21.15.71:0/4015086993 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa8006a750 con 0x7ffa64066f80 2023-10-09T07:58:39.212 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:39.211+0000 7f2595cc9180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T07:58:39.216 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:39.215+0000 7f4a0752a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T07:58:39.297 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:39.296+0000 7f2595cc9180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T07:58:39.440 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:39.439+0000 7f4a0752a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:58:39.520 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:39.519+0000 7f2595cc9180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:58:39.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:39.572+0000 7ffa84d9b700 1 -- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ffa64066f80 msgr2=0x7ffa64069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:39.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:39.572+0000 7ffa84d9b700 1 --2- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ffa64066f80 0x7ffa64069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T07:58:39.617 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:39.616+0000 7f4a0752a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T07:58:39.699 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:39.699+0000 7f2595cc9180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T07:58:39.708 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:39.707+0000 7f4a0752a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T07:58:39.791 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:39.790+0000 7f2595cc9180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T07:58:39.870 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:39.869+0000 7f4a0752a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T07:58:39.952 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:39.951+0000 7f2595cc9180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T07:58:39.970 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:39.969+0000 7f4a0752a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T07:58:40.055 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:40.054+0000 7f2595cc9180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T07:58:40.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:40.373+0000 7ffa84d9b700 1 -- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ffa64066f80 msgr2=0x7ffa64069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:40.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:40.373+0000 7ffa84d9b700 1 --2- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ffa64066f80 0x7ffa64069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T07:58:40.457 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:40.456+0000 7f4a0752a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T07:58:40.537 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:40.536+0000 7f2595cc9180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T07:58:40.551 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:40.551+0000 7f4a0752a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T07:58:40.632 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:40.631+0000 7f2595cc9180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T07:58:40.641 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:40.641+0000 7f4a0752a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T07:58:40.722 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:40.722+0000 7f2595cc9180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T07:58:41.263 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:41.263+0000 7f4a0752a180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T07:58:41.341 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:41.341+0000 7f2595cc9180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T07:58:41.436 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:41.436+0000 7f4a0752a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:58:41.513 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:41.513+0000 7f2595cc9180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T07:58:41.533 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:41.532+0000 7f4a0752a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T07:58:41.610 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:41.609+0000 7f2595cc9180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T07:58:41.829 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:41.829+0000 7f4a0752a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T07:58:41.903 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:41.902+0000 7f2595cc9180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T07:58:41.924 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:41.924+0000 7f4a0752a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T07:58:41.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:41.975+0000 7ffa84d9b700 1 -- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ffa64066f80 msgr2=0x7ffa64069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/85452 2023-10-09T07:58:41.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:41.975+0000 7ffa84d9b700 1 --2- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ffa64066f80 0x7ffa64069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-09T07:58:41.998 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:41.998+0000 7f2595cc9180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T07:58:42.623 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:42.623+0000 7f4a0752a180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T07:58:42.702 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:42.701+0000 7f2595cc9180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T07:58:42.911 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:42.911+0000 7f4a0752a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T07:58:42.989 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:42.988+0000 7f2595cc9180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T07:58:43.004 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:43.004+0000 7f4a0752a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T07:58:43.083 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:43.082+0000 7f2595cc9180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T07:58:43.157 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:43.157+0000 7f4a0752a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T07:58:43.237 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:43.236+0000 7f2595cc9180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T07:58:43.260 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:43.260+0000 7f4a0752a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T07:58:43.342 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:43.341+0000 7f2595cc9180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T07:58:43.449 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:43.449+0000 7f4a0752a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T07:58:43.532 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:43.531+0000 7f2595cc9180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T07:58:43.542 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:43.542+0000 7f4a0752a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T07:58:43.625 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:43.624+0000 7f2595cc9180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T07:58:43.634 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:43.633+0000 7f4a0752a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T07:58:43.718 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:43.717+0000 7f2595cc9180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T07:58:43.728 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:43.728+0000 7f4a0752a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T07:58:43.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:43.740+0000 7ffa7cff9700 1 -- 172.21.15.71:0/4015086993 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 78) v1 ==== 84468+0+0 (secure 0 0 0) 0x7ffa6c051d60 con 0x7ffa800cb560 2023-10-09T07:58:43.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:43.740+0000 7ffa7cff9700 1 -- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ffa64066f80 msgr2=0x7ffa64069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T07:58:43.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:43.740+0000 7ffa7cff9700 1 --2- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ffa64066f80 0x7ffa64069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:43.822 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T07:58:43.822+0000 7f2595cc9180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T07:58:43.863 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:43.863+0000 7f497c076700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:43.863 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:43.863+0000 7f497c076700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:43.863 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:43.863+0000 7f497c076700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:43.863 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:43.863+0000 7f497c076700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:43.863 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:43.863+0000 7f497c076700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:43.864 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:43.864+0000 7f4979871700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:43.864 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:43.864+0000 7f4979871700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:43.864 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:43.864+0000 7f4979871700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:43.864 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:43.864+0000 7f4979871700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:43.864 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:58:43.864+0000 7f4979871700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:58:44.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:44.743+0000 7ffa7cff9700 1 -- 172.21.15.71:0/4015086993 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mgrmap(e 79) v1 ==== 84595+0+0 (secure 0 0 0) 0x7ffa6c05c840 con 0x7ffa800cb560 2023-10-09T07:58:44.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:44.743+0000 7ffa7cff9700 1 --2- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ffa64066f80 0x7ffa640693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:44.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:44.743+0000 7ffa7cff9700 1 -- 172.21.15.71:0/4015086993 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa8006a750 con 0x7ffa64066f80 2023-10-09T07:58:44.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:44.745+0000 7ffa84d9b700 1 --2- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ffa64066f80 0x7ffa640693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:44.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:44.753+0000 7ffa84d9b700 1 --2- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ffa64066f80 0x7ffa640693b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ffa740099b0 tx=0x7ffa74017000 comp rx=0 tx=0).ready entity=mgr.7616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:44.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:44.818+0000 7ffa7cff9700 1 -- 172.21.15.71:0/4015086993 <== mgr.7616 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7ffa8006a750 con 0x7ffa64066f80 2023-10-09T07:58:44.819 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule set for path /snap_test_dir1/test_restart 2023-10-09T07:58:44.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:44.820+0000 7ffa85d9d700 1 -- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ffa64066f80 msgr2=0x7ffa640693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:44.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:44.820+0000 7ffa85d9d700 1 --2- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ffa64066f80 0x7ffa640693b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ffa740099b0 tx=0x7ffa74017000 comp rx=0 tx=0).stop 2023-10-09T07:58:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:44.820+0000 7ffa85d9d700 1 -- 172.21.15.71:0/4015086993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa800cb560 msgr2=0x7ffa800ad730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:44.820+0000 7ffa85d9d700 1 --2- 172.21.15.71:0/4015086993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa800cb560 0x7ffa800ad730 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00e930 tx=0x7ffa6c0091a0 comp rx=0 tx=0).stop 2023-10-09T07:58:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:44.820+0000 7ffa85d9d700 1 -- 172.21.15.71:0/4015086993 shutdown_connections 2023-10-09T07:58:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:44.820+0000 7ffa85d9d700 1 --2- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa800cc970 0x7ffa800c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:44.820+0000 7ffa85d9d700 1 --2- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ffa64066f80 0x7ffa640693b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:44.820+0000 7ffa85d9d700 1 --2- 172.21.15.71:0/4015086993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa80069cf0 0x7ffa800abe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:44.820+0000 7ffa85d9d700 1 --2- 172.21.15.71:0/4015086993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa800cb560 0x7ffa800ad730 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:44.820+0000 7ffa85d9d700 1 -- 172.21.15.71:0/4015086993 >> 172.21.15.71:0/4015086993 conn(0x7ffa8006baf0 msgr2=0x7ffa800c4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:44.821+0000 7ffa85d9d700 1 -- 172.21.15.71:0/4015086993 shutdown_connections 2023-10-09T07:58:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:44.821+0000 7ffa85d9d700 1 -- 172.21.15.71:0/4015086993 wait complete. 2023-10-09T07:58:44.840 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/test_restart 2023-10-09T07:58:44.840 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/test_restart 1M 2023-10-09T07:58:45.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.026+0000 7f3f947ff700 1 Processor -- start 2023-10-09T07:58:45.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.026+0000 7f3f947ff700 1 -- start start 2023-10-09T07:58:45.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.027+0000 7f3f947ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3f8c0c6ac0 0x7f3f8c068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:45.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.027+0000 7f3f947ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8c0ac030 con 0x7f3f8c069a50 2023-10-09T07:58:45.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.027+0000 7f3f947ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8c0ab820 con 0x7f3f8c0c8490 2023-10-09T07:58:45.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.027+0000 7f3f947ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f8c06dbb0 con 0x7f3f8c0c6ac0 2023-10-09T07:58:45.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.028+0000 7f3f91d9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3f8c0c6ac0 0x7f3f8c068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:45.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.028+0000 7f3f91d9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3f8c0c6ac0 0x7f3f8c068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37290/0 (socket says 172.21.15.71:37290) 2023-10-09T07:58:45.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.028+0000 7f3f91d9a700 1 -- 172.21.15.71:0/1772867782 learned_addr learned my addr 172.21.15.71:0/1772867782 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:45.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.028+0000 7f3f92d9c700 1 --1- 172.21.15.71:0/1772867782 >> v1:172.21.15.71:6789/0 conn(0x7f3f8c069a50 0x7f3f8c156ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:36114/0 (socket says 172.21.15.71:36114) 2023-10-09T07:58:45.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.028+0000 7f3f91d9a700 1 -- 172.21.15.71:0/1772867782 >> v1:172.21.15.179:6789/0 conn(0x7f3f8c0c8490 legacy=0x7f3f8c15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:45.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.028+0000 7f3f91d9a700 1 -- 172.21.15.71:0/1772867782 >> v1:172.21.15.71:6789/0 conn(0x7f3f8c069a50 legacy=0x7f3f8c156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:45.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.028+0000 7f3f91d9a700 1 -- 172.21.15.71:0/1772867782 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8c0c6f10 con 0x7f3f8c0c6ac0 2023-10-09T07:58:45.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.028+0000 7f3f91599700 1 -- 172.21.15.71:0/1772867782 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085893499 0 0) 0x7f3f84001490 con 0x7f3f8c069a50 2023-10-09T07:58:45.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.029+0000 7f3f91d9a700 1 --2- 172.21.15.71:0/1772867782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f8c0c6ac0 0x7f3f8c068390 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c0099b0 tx=0x7f3f7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=914c9b3433931b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:45.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.029+0000 7f3f91599700 1 -- 172.21.15.71:0/1772867782 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c00b860 con 0x7f3f8c0c6ac0 2023-10-09T07:58:45.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.029+0000 7f3f91599700 1 -- 172.21.15.71:0/1772867782 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7c00b9c0 con 0x7f3f8c0c6ac0 2023-10-09T07:58:45.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.029+0000 7f3f91599700 1 -- 172.21.15.71:0/1772867782 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c00bd60 con 0x7f3f8c0c6ac0 2023-10-09T07:58:45.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.029+0000 7f3f947ff700 1 -- 172.21.15.71:0/1772867782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f8c0c6ac0 msgr2=0x7f3f8c068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:45.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.029+0000 7f3f947ff700 1 --2- 172.21.15.71:0/1772867782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f8c0c6ac0 0x7f3f8c068390 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c0099b0 tx=0x7f3f7c009250 comp rx=0 tx=0).stop 2023-10-09T07:58:45.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.029+0000 7f3f947ff700 1 -- 172.21.15.71:0/1772867782 shutdown_connections 2023-10-09T07:58:45.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.029+0000 7f3f947ff700 1 --2- 172.21.15.71:0/1772867782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f8c0c6ac0 0x7f3f8c068390 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:45.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.029+0000 7f3f947ff700 1 -- 172.21.15.71:0/1772867782 >> 172.21.15.71:0/1772867782 conn(0x7f3f8c0c8f90 msgr2=0x7f3f8c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:45.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.029+0000 7f3f947ff700 1 -- 172.21.15.71:0/1772867782 shutdown_connections 2023-10-09T07:58:45.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.029+0000 7f3f947ff700 1 -- 172.21.15.71:0/1772867782 wait complete. 2023-10-09T07:58:45.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.031+0000 7f3f947ff700 1 Processor -- start 2023-10-09T07:58:45.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.031+0000 7f3f947ff700 1 -- start start 2023-10-09T07:58:45.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.032+0000 7f3f947ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f8c069a50 0x7f3f8c0c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:45.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.032+0000 7f3f947ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f8c0c6ac0 0x7f3f8c0c07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:45.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.032+0000 7f3f947ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f8c0c8490 0x7f3f8c0c2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.032+0000 7f3f947ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c0c5ee0 con 0x7f3f8c0c8490 2023-10-09T07:58:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.032+0000 7f3f947ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c0c5450 con 0x7f3f8c0c6ac0 2023-10-09T07:58:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.032+0000 7f3f947ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c0b02c0 con 0x7f3f8c069a50 2023-10-09T07:58:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.032+0000 7f3f92d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f8c0c8490 0x7f3f8c0c2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.032+0000 7f3f92d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f8c0c8490 0x7f3f8c0c2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37300/0 (socket says 172.21.15.71:37300) 2023-10-09T07:58:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.032+0000 7f3f92d9c700 1 -- 172.21.15.71:0/3874994099 learned_addr learned my addr 172.21.15.71:0/3874994099 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T07:58:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.032+0000 7f3f9259b700 1 --2- 172.21.15.71:0/3874994099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f8c069a50 0x7f3f8c0c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.032+0000 7f3f91d9a700 1 --2- 172.21.15.71:0/3874994099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f8c0c6ac0 0x7f3f8c0c07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.033+0000 7f3f92d9c700 1 -- 172.21.15.71:0/3874994099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f8c069a50 msgr2=0x7f3f8c0c4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.033+0000 7f3f92d9c700 1 --2- 172.21.15.71:0/3874994099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f8c069a50 0x7f3f8c0c4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.033+0000 7f3f92d9c700 1 -- 172.21.15.71:0/3874994099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f8c0c6ac0 msgr2=0x7f3f8c0c07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.033+0000 7f3f92d9c700 1 --2- 172.21.15.71:0/3874994099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f8c0c6ac0 0x7f3f8c0c07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.033+0000 7f3f92d9c700 1 -- 172.21.15.71:0/3874994099 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7c0094f0 con 0x7f3f8c0c8490 2023-10-09T07:58:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.033+0000 7f3f92d9c700 1 --2- 172.21.15.71:0/3874994099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f8c0c8490 0x7f3f8c0c2150 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400cd70 tx=0x7f3f84001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.033+0000 7f3f827fc700 1 -- 172.21.15.71:0/3874994099 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400ce70 con 0x7f3f8c0c8490 2023-10-09T07:58:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.033+0000 7f3f827fc700 1 -- 172.21.15.71:0/3874994099 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f84005df0 con 0x7f3f8c0c8490 2023-10-09T07:58:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.033+0000 7f3f947ff700 1 -- 172.21.15.71:0/3874994099 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f8c0c0d00 con 0x7f3f8c0c8490 2023-10-09T07:58:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.033+0000 7f3f827fc700 1 -- 172.21.15.71:0/3874994099 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400ab00 con 0x7f3f8c0c8490 2023-10-09T07:58:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.033+0000 7f3f947ff700 1 -- 172.21.15.71:0/3874994099 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8c0c5920 con 0x7f3f8c0c8490 2023-10-09T07:58:45.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.034+0000 7f3f947ff700 1 -- 172.21.15.71:0/3874994099 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f8c0b0430 con 0x7f3f8c0c8490 2023-10-09T07:58:45.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.035+0000 7f3f827fc700 1 -- 172.21.15.71:0/3874994099 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 79) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f3f840070f0 con 0x7f3f8c0c8490 2023-10-09T07:58:45.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.037+0000 7f3f827fc700 1 --2- 172.21.15.71:0/3874994099 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3f70066dd0 0x7f3f70069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T07:58:45.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.037+0000 7f3f827fc700 1 -- 172.21.15.71:0/3874994099 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f3f84084440 con 0x7f3f8c0c8490 2023-10-09T07:58:45.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.037+0000 7f3f9259b700 1 --2- 172.21.15.71:0/3874994099 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3f70066dd0 0x7f3f70069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T07:58:45.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.038+0000 7f3f9259b700 1 --2- 172.21.15.71:0/3874994099 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3f70066dd0 0x7f3f70069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3f880039e0 tx=0x7f3f88007ec0 comp rx=0 tx=0).ready entity=mgr.7616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T07:58:45.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.041+0000 7f3f827fc700 1 -- 172.21.15.71:0/3874994099 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f84051710 con 0x7f3f8c0c8490 2023-10-09T07:58:45.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.256+0000 7f3f947ff700 1 -- 172.21.15.71:0/3874994099 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f8c0ac030 con 0x7f3f70066dd0 2023-10-09T07:58:45.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.309+0000 7f3f827fc700 1 -- 172.21.15.71:0/3874994099 <== mgr.7616 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+57 (secure 0 0 0) 0x7f3f8c0ac030 con 0x7f3f70066dd0 2023-10-09T07:58:45.310 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule activated for path /snap_test_dir1/test_restart 2023-10-09T07:58:45.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.311+0000 7f3f947ff700 1 -- 172.21.15.71:0/3874994099 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3f70066dd0 msgr2=0x7f3f70069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:45.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.311+0000 7f3f947ff700 1 --2- 172.21.15.71:0/3874994099 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3f70066dd0 0x7f3f70069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3f880039e0 tx=0x7f3f88007ec0 comp rx=0 tx=0).stop 2023-10-09T07:58:45.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.311+0000 7f3f947ff700 1 -- 172.21.15.71:0/3874994099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f8c0c8490 msgr2=0x7f3f8c0c2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T07:58:45.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.311+0000 7f3f947ff700 1 --2- 172.21.15.71:0/3874994099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f8c0c8490 0x7f3f8c0c2150 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400cd70 tx=0x7f3f84001ad0 comp rx=0 tx=0).stop 2023-10-09T07:58:45.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.311+0000 7f3f947ff700 1 -- 172.21.15.71:0/3874994099 shutdown_connections 2023-10-09T07:58:45.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.311+0000 7f3f947ff700 1 --2- 172.21.15.71:0/3874994099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f8c0c8490 0x7f3f8c0c2150 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:45.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.311+0000 7f3f947ff700 1 --2- 172.21.15.71:0/3874994099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f8c069a50 0x7f3f8c0c4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:45.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.311+0000 7f3f947ff700 1 --2- 172.21.15.71:0/3874994099 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3f70066dd0 0x7f3f70069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:45.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.311+0000 7f3f947ff700 1 --2- 172.21.15.71:0/3874994099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f8c0c6ac0 0x7f3f8c0c07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T07:58:45.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.311+0000 7f3f947ff700 1 -- 172.21.15.71:0/3874994099 >> 172.21.15.71:0/3874994099 conn(0x7f3f8c0c8f90 msgr2=0x7f3f8c0cb620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T07:58:45.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.312+0000 7f3f947ff700 1 -- 172.21.15.71:0/3874994099 shutdown_connections 2023-10-09T07:58:45.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T07:58:45.312+0000 7f3f947ff700 1 -- 172.21.15.71:0/3874994099 wait complete. 2023-10-09T07:58:45.330 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/test_restart 2023-10-09T07:58:51.439 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:58:51.444 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:59:00.323 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:59:00.323+0000 7f496b855700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:59:00.324 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:59:00.323+0000 7f496b855700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:59:00.324 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:59:00.323+0000 7f496b855700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:59:00.324 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:59:00.323+0000 7f496b855700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:59:00.324 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T07:59:00.323+0000 7f496b855700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T07:59:21.621 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:59:21.627 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:59:51.826 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T07:59:51.832 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:00:21.991 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:00:21.997 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:00:52.189 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:00:52.194 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:01:22.387 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:01:22.393 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:01:52.593 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:01:52.599 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:02:22.781 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:02:22.787 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:02:52.965 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:02:52.970 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:03:23.168 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:03:23.175 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:03:53.356 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:03:53.362 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:04:23.531 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:04:23.537 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:04:53.763 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:04:53.769 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:05:23.875 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:05:24.105 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:05:54.198 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:05:54.205 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:06:24.382 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:06:24.387 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:06:54.560 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:06:54.566 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:07:24.738 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:07:24.747 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:07:54.846 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:07:54.852 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:08:24.980 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:08:24.986 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:08:55.167 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:08:55.174 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:09:16.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:09:16.331 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-10-09T08:09:16.374 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_59_00_UTC 2023-10-09T08:09:16.374 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_00_00_UTC 2023-10-09T08:09:16.374 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_01_00_UTC 2023-10-09T08:09:16.374 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_02_00_UTC 2023-10-09T08:09:16.374 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_03_00_UTC 2023-10-09T08:09:16.374 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_04_00_UTC 2023-10-09T08:09:16.374 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_05_00_UTC 2023-10-09T08:09:16.374 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_06_00_UTC 2023-10-09T08:09:16.374 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_07_00_UTC 2023-10-09T08:09:16.375 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_08_00_UTC 2023-10-09T08:09:16.375 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_09_00_UTC 2023-10-09T08:09:16.375 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-07_59_00_UTC', 'scheduled-2023-10-09-08_00_00_UTC', 'scheduled-2023-10-09-08_01_00_UTC', 'scheduled-2023-10-09-08_02_00_UTC', 'scheduled-2023-10-09-08_03_00_UTC', 'scheduled-2023-10-09-08_04_00_UTC', 'scheduled-2023-10-09-08_05_00_UTC', 'scheduled-2023-10-09-08_06_00_UTC', 'scheduled-2023-10-09-08_07_00_UTC', 'scheduled-2023-10-09-08_08_00_UTC', 'scheduled-2023-10-09-08_09_00_UTC'] 2023-10-09T08:09:16.376 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-10-09T08:09:16.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.606+0000 7ff7a8dff700 1 Processor -- start 2023-10-09T08:09:16.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.606+0000 7ff7a8dff700 1 -- start start 2023-10-09T08:09:16.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.607+0000 7ff7a8dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a41597b0 0x7ff7a40af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:09:16.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.607+0000 7ff7a8dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff7a4159b80 0x7ff7a406a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:09:16.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.607+0000 7ff7a8dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a406ac30 con 0x7ff7a406a7f0 2023-10-09T08:09:16.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.607+0000 7ff7a8dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a4068390 con 0x7ff7a4159b80 2023-10-09T08:09:16.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.607+0000 7ff7a8dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a40ac530 con 0x7ff7a41597b0 2023-10-09T08:09:16.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.607+0000 7ff7a1d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff7a4159b80 0x7ff7a406a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:09:16.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.608+0000 7ff7a1d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff7a4159b80 0x7ff7a406a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44624/0 (socket says 172.21.15.71:44624) 2023-10-09T08:09:16.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.608+0000 7ff7a1d9b700 1 -- 172.21.15.71:0/3631540608 learned_addr learned my addr 172.21.15.71:0/3631540608 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:09:16.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.608+0000 7ff7a259c700 1 --2- 172.21.15.71:0/3631540608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a41597b0 0x7ff7a40af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:09:16.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.608+0000 7ff7a1d9b700 1 -- 172.21.15.71:0/3631540608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a41597b0 msgr2=0x7ff7a40af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:09:16.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.608+0000 7ff7a1d9b700 1 --2- 172.21.15.71:0/3631540608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a41597b0 0x7ff7a40af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:09:16.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.608+0000 7ff7a1d9b700 1 -- 172.21.15.71:0/3631540608 >> v1:172.21.15.179:6789/0 conn(0x7ff7a406a7f0 legacy=0x7ff7a4068d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:09:16.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.608+0000 7ff7a1d9b700 1 -- 172.21.15.71:0/3631540608 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a40aa680 con 0x7ff7a4159b80 2023-10-09T08:09:16.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.608+0000 7ff7a1d9b700 1 --2- 172.21.15.71:0/3631540608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a4159b80 0x7ff7a406a2b0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7ff7980099b0 tx=0x7ff798009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267e696050774088 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:09:16.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.608+0000 7ff7a159a700 1 -- 172.21.15.71:0/3631540608 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79800b860 con 0x7ff7a4159b80 2023-10-09T08:09:16.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.609+0000 7ff7a159a700 1 -- 172.21.15.71:0/3631540608 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79800b9c0 con 0x7ff7a4159b80 2023-10-09T08:09:16.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.609+0000 7ff7a159a700 1 -- 172.21.15.71:0/3631540608 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79800bd60 con 0x7ff7a4159b80 2023-10-09T08:09:16.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.609+0000 7ff7a8dff700 1 -- 172.21.15.71:0/3631540608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a4159b80 msgr2=0x7ff7a406a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:09:16.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.609+0000 7ff7a8dff700 1 --2- 172.21.15.71:0/3631540608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a4159b80 0x7ff7a406a2b0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7ff7980099b0 tx=0x7ff798009250 comp rx=0 tx=0).stop 2023-10-09T08:09:16.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.609+0000 7ff7a8dff700 1 -- 172.21.15.71:0/3631540608 shutdown_connections 2023-10-09T08:09:16.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.609+0000 7ff7a8dff700 1 --2- 172.21.15.71:0/3631540608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a41597b0 0x7ff7a40af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:09:16.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.609+0000 7ff7a8dff700 1 --2- 172.21.15.71:0/3631540608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a4159b80 0x7ff7a406a2b0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:09:16.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.609+0000 7ff7a8dff700 1 -- 172.21.15.71:0/3631540608 >> 172.21.15.71:0/3631540608 conn(0x7ff7a40cd880 msgr2=0x7ff7a40ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:09:16.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.609+0000 7ff7a8dff700 1 -- 172.21.15.71:0/3631540608 shutdown_connections 2023-10-09T08:09:16.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.609+0000 7ff7a8dff700 1 -- 172.21.15.71:0/3631540608 wait complete. 2023-10-09T08:09:16.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.611+0000 7ff7a8dff700 1 Processor -- start 2023-10-09T08:09:16.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.611+0000 7ff7a8dff700 1 -- start start 2023-10-09T08:09:16.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.612+0000 7ff7a8dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7a406a7f0 0x7ff7a4155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:09:16.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.612+0000 7ff7a8dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a41597b0 0x7ff7a415b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:09:16.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.612+0000 7ff7a8dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a4159b80 0x7ff7a416aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:09:16.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.612+0000 7ff7a8dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a415aeb0 con 0x7ff7a41597b0 2023-10-09T08:09:16.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.612+0000 7ff7a8dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a415c360 con 0x7ff7a406a7f0 2023-10-09T08:09:16.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.612+0000 7ff7a8dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a415c640 con 0x7ff7a4159b80 2023-10-09T08:09:16.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.612+0000 7ff7a1d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a41597b0 0x7ff7a415b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:09:16.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.612+0000 7ff7a1d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a41597b0 0x7ff7a415b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44630/0 (socket says 172.21.15.71:44630) 2023-10-09T08:09:16.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.612+0000 7ff7a1d9b700 1 -- 172.21.15.71:0/1896119852 learned_addr learned my addr 172.21.15.71:0/1896119852 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:09:16.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.612+0000 7ff7a259c700 1 --2- 172.21.15.71:0/1896119852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7a406a7f0 0x7ff7a4155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:09:16.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.612+0000 7ff7a2d9d700 1 --2- 172.21.15.71:0/1896119852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a4159b80 0x7ff7a416aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:09:16.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.612+0000 7ff7a1d9b700 1 -- 172.21.15.71:0/1896119852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a4159b80 msgr2=0x7ff7a416aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:09:16.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.612+0000 7ff7a1d9b700 1 --2- 172.21.15.71:0/1896119852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a4159b80 0x7ff7a416aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:09:16.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.612+0000 7ff7a1d9b700 1 -- 172.21.15.71:0/1896119852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7a406a7f0 msgr2=0x7ff7a4155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:09:16.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.612+0000 7ff7a1d9b700 1 --2- 172.21.15.71:0/1896119852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7a406a7f0 0x7ff7a4155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:09:16.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.612+0000 7ff7a1d9b700 1 -- 172.21.15.71:0/1896119852 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7980094f0 con 0x7ff7a41597b0 2023-10-09T08:09:16.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.613+0000 7ff7a1d9b700 1 --2- 172.21.15.71:0/1896119852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a41597b0 0x7ff7a415b340 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7ff7a406d940 tx=0x7ff798017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:09:16.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.613+0000 7ff7927fc700 1 -- 172.21.15.71:0/1896119852 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79801a450 con 0x7ff7a41597b0 2023-10-09T08:09:16.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.613+0000 7ff7927fc700 1 -- 172.21.15.71:0/1896119852 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79801a5b0 con 0x7ff7a41597b0 2023-10-09T08:09:16.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.613+0000 7ff7a8dff700 1 -- 172.21.15.71:0/1896119852 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a415c920 con 0x7ff7a41597b0 2023-10-09T08:09:16.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.613+0000 7ff7927fc700 1 -- 172.21.15.71:0/1896119852 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79801a950 con 0x7ff7a41597b0 2023-10-09T08:09:16.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.613+0000 7ff7a8dff700 1 -- 172.21.15.71:0/1896119852 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a416ab10 con 0x7ff7a41597b0 2023-10-09T08:09:16.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.614+0000 7ff7a8dff700 1 -- 172.21.15.71:0/1896119852 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a415b020 con 0x7ff7a41597b0 2023-10-09T08:09:16.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.615+0000 7ff7927fc700 1 -- 172.21.15.71:0/1896119852 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 82) v1 ==== 84871+0+0 (secure 0 0 0) 0x7ff79801ad00 con 0x7ff7a41597b0 2023-10-09T08:09:16.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.616+0000 7ff7927fc700 1 --2- 172.21.15.71:0/1896119852 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff7840670a0 0x7ff784069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:09:16.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.616+0000 7ff7927fc700 1 -- 172.21.15.71:0/1896119852 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6456+0+0 (secure 0 0 0) 0x7ff798086660 con 0x7ff7a41597b0 2023-10-09T08:09:16.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.616+0000 7ff7a259c700 1 --2- 172.21.15.71:0/1896119852 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff7840670a0 0x7ff784069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:09:16.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.617+0000 7ff7a259c700 1 --2- 172.21.15.71:0/1896119852 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff7840670a0 0x7ff784069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff794006fd0 tx=0x7ff794008040 comp rx=0 tx=0).ready entity=mgr.7616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:09:16.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.620+0000 7ff7927fc700 1 -- 172.21.15.71:0/1896119852 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff798053550 con 0x7ff7a41597b0 2023-10-09T08:09:16.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.833+0000 7ff7a8dff700 1 -- 172.21.15.71:0/1896119852 --> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff7a40718b0 con 0x7ff7840670a0 2023-10-09T08:09:16.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.843+0000 7ff7927fc700 1 -- 172.21.15.71:0/1896119852 <== mgr.7616 v2:172.21.15.179:6835/85452 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7ff7a40718b0 con 0x7ff7840670a0 2023-10-09T08:09:16.844 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:09:16.844 INFO:teuthology.orchestra.run.smithi071.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T07:58:44", "first": "2023-10-09T07:59:00", "last": "2023-10-09T08:09:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-10-09T08:09:16.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.846+0000 7ff7a8dff700 1 -- 172.21.15.71:0/1896119852 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff7840670a0 msgr2=0x7ff784069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:09:16.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.846+0000 7ff7a8dff700 1 --2- 172.21.15.71:0/1896119852 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff7840670a0 0x7ff784069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff794006fd0 tx=0x7ff794008040 comp rx=0 tx=0).stop 2023-10-09T08:09:16.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.846+0000 7ff7a8dff700 1 -- 172.21.15.71:0/1896119852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a41597b0 msgr2=0x7ff7a415b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:09:16.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.846+0000 7ff7a8dff700 1 --2- 172.21.15.71:0/1896119852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a41597b0 0x7ff7a415b340 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7ff7a406d940 tx=0x7ff798017000 comp rx=0 tx=0).stop 2023-10-09T08:09:16.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.846+0000 7ff7a8dff700 1 -- 172.21.15.71:0/1896119852 shutdown_connections 2023-10-09T08:09:16.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.846+0000 7ff7a8dff700 1 --2- 172.21.15.71:0/1896119852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a4159b80 0x7ff7a416aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:09:16.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.846+0000 7ff7a8dff700 1 --2- 172.21.15.71:0/1896119852 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7ff7840670a0 0x7ff784069550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:09:16.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.846+0000 7ff7a8dff700 1 --2- 172.21.15.71:0/1896119852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7a406a7f0 0x7ff7a4155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:09:16.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.846+0000 7ff7a8dff700 1 --2- 172.21.15.71:0/1896119852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a41597b0 0x7ff7a415b340 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:09:16.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.846+0000 7ff7a8dff700 1 -- 172.21.15.71:0/1896119852 >> 172.21.15.71:0/1896119852 conn(0x7ff7a40cd880 msgr2=0x7ff7a40b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:09:16.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.846+0000 7ff7a8dff700 1 -- 172.21.15.71:0/1896119852 shutdown_connections 2023-10-09T08:09:16.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:16.846+0000 7ff7a8dff700 1 -- 172.21.15.71:0/1896119852 wait complete. 2023-10-09T08:09:16.865 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T07:58:44", "first": "2023-10-09T07:59:00", "last": "2023-10-09T08:09:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-10-09T08:09:16.865 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T07:58:44', 'first': '2023-10-09T07:59:00', 'last': '2023-10-09T08:09:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': True} 2023-10-09T08:09:16.865 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-09T08:09:16.865 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-09T08:09:16.866 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-09T08:09:17.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.045+0000 7f3f19f9d700 1 Processor -- start 2023-10-09T08:09:17.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.045+0000 7f3f19f9d700 1 -- start start 2023-10-09T08:09:17.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.046+0000 7f3f19f9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3f14150180 0x7f3f14157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:09:17.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.046+0000 7f3f19f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3f140c7410 0x7f3f14069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:09:17.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.046+0000 7f3f19f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f1406e2a0 con 0x7f3f14150550 2023-10-09T08:09:17.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.046+0000 7f3f19f9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f1406b2e0 con 0x7f3f14150180 2023-10-09T08:09:17.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.046+0000 7f3f19f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f140c78e0 con 0x7f3f140c7410 2023-10-09T08:09:17.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.046+0000 7f3f18f9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3f14150180 0x7f3f14157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:09:17.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.046+0000 7f3f18f9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3f14150180 0x7f3f14157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44644/0 (socket says 172.21.15.71:44644) 2023-10-09T08:09:17.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.046+0000 7f3f18f9b700 1 -- 172.21.15.71:0/1645524796 learned_addr learned my addr 172.21.15.71:0/1645524796 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:09:17.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.047+0000 7f3f18f9b700 1 -- 172.21.15.71:0/1645524796 >> v2:172.21.15.179:3300/0 conn(0x7f3f140c7410 msgr2=0x7f3f14069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:09:17.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.047+0000 7f3f1979c700 1 --2- 172.21.15.71:0/1645524796 >> v2:172.21.15.179:3300/0 conn(0x7f3f140c7410 0x7f3f14069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:09:17.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.047+0000 7f3f18f9b700 1 --2- 172.21.15.71:0/1645524796 >> v2:172.21.15.179:3300/0 conn(0x7f3f140c7410 0x7f3f14069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:09:17.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.047+0000 7f3f18f9b700 1 -- 172.21.15.71:0/1645524796 >> v1:172.21.15.179:6789/0 conn(0x7f3f14150550 legacy=0x7f3f140c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:09:17.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.047+0000 7f3f18f9b700 1 -- 172.21.15.71:0/1645524796 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f140c7bc0 con 0x7f3f14150180 2023-10-09T08:09:17.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.047+0000 7f3f1979c700 1 --2- 172.21.15.71:0/1645524796 >> v2:172.21.15.179:3300/0 conn(0x7f3f140c7410 0x7f3f14069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:09:17.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.047+0000 7f3f18f9b700 1 --2- 172.21.15.71:0/1645524796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f14150180 0x7f3f14157770 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f3f14156270 tx=0x7f3f08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716173cea46fe1bc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:09:17.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.047+0000 7f3f137fe700 1 -- 172.21.15.71:0/1645524796 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0800b820 con 0x7f3f14150180 2023-10-09T08:09:17.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.047+0000 7f3f137fe700 1 -- 172.21.15.71:0/1645524796 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0800b980 con 0x7f3f14150180 2023-10-09T08:09:17.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.047+0000 7f3f137fe700 1 -- 172.21.15.71:0/1645524796 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0800bd20 con 0x7f3f14150180 2023-10-09T08:09:17.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.048+0000 7f3f19f9d700 1 -- 172.21.15.71:0/1645524796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f14150180 msgr2=0x7f3f14157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:09:17.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.048+0000 7f3f19f9d700 1 --2- 172.21.15.71:0/1645524796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f14150180 0x7f3f14157770 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f3f14156270 tx=0x7f3f08009250 comp rx=0 tx=0).stop 2023-10-09T08:09:17.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.048+0000 7f3f19f9d700 1 -- 172.21.15.71:0/1645524796 shutdown_connections 2023-10-09T08:09:17.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.048+0000 7f3f19f9d700 1 --2- 172.21.15.71:0/1645524796 >> v2:172.21.15.179:3300/0 conn(0x7f3f140c7410 0x7f3f14069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:09:17.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.048+0000 7f3f19f9d700 1 --2- 172.21.15.71:0/1645524796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f14150180 0x7f3f14157770 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:09:17.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.048+0000 7f3f19f9d700 1 -- 172.21.15.71:0/1645524796 >> 172.21.15.71:0/1645524796 conn(0x7f3f140cc1f0 msgr2=0x7f3f140cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:09:17.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.048+0000 7f3f19f9d700 1 -- 172.21.15.71:0/1645524796 shutdown_connections 2023-10-09T08:09:17.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.048+0000 7f3f19f9d700 1 -- 172.21.15.71:0/1645524796 wait complete. 2023-10-09T08:09:17.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.049+0000 7f3f19f9d700 1 Processor -- start 2023-10-09T08:09:17.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.050+0000 7f3f19f9d700 1 -- start start 2023-10-09T08:09:17.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.050+0000 7f3f19f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f140c7410 0x7f3f14149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:09:17.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.050+0000 7f3f19f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f14150180 0x7f3f14149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:09:17.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.050+0000 7f3f19f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f14150550 0x7f3f14159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:09:17.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.051+0000 7f3f19f9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f140b14e0 con 0x7f3f140c7410 2023-10-09T08:09:17.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.051+0000 7f3f19f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f140ac120 con 0x7f3f14150180 2023-10-09T08:09:17.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.051+0000 7f3f19f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f140ac3c0 con 0x7f3f14150550 2023-10-09T08:09:17.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.051+0000 7f3f18f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f140c7410 0x7f3f14149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:09:17.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.051+0000 7f3f18f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f140c7410 0x7f3f14149a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44654/0 (socket says 172.21.15.71:44654) 2023-10-09T08:09:17.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.051+0000 7f3f18f9b700 1 -- 172.21.15.71:0/274586694 learned_addr learned my addr 172.21.15.71:0/274586694 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:09:17.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.051+0000 7f3f1979c700 1 --2- 172.21.15.71:0/274586694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f14150550 0x7f3f14159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:09:17.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.051+0000 7f3f13fff700 1 --2- 172.21.15.71:0/274586694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f14150180 0x7f3f14149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:09:17.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.051+0000 7f3f18f9b700 1 -- 172.21.15.71:0/274586694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f14150550 msgr2=0x7f3f14159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:09:17.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.051+0000 7f3f18f9b700 1 --2- 172.21.15.71:0/274586694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f14150550 0x7f3f14159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:09:17.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.051+0000 7f3f18f9b700 1 -- 172.21.15.71:0/274586694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f14150180 msgr2=0x7f3f14149f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:09:17.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.051+0000 7f3f18f9b700 1 --2- 172.21.15.71:0/274586694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f14150180 0x7f3f14149f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:09:17.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.051+0000 7f3f18f9b700 1 -- 172.21.15.71:0/274586694 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f080094f0 con 0x7f3f140c7410 2023-10-09T08:09:17.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.051+0000 7f3f13fff700 1 --2- 172.21.15.71:0/274586694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f14150180 0x7f3f14149f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:09:17.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.051+0000 7f3f18f9b700 1 --2- 172.21.15.71:0/274586694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f140c7410 0x7f3f14149a20 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f3f080030c0 tx=0x7f3f08016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:09:17.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.052+0000 7f3f10ff9700 1 -- 172.21.15.71:0/274586694 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f08011e60 con 0x7f3f140c7410 2023-10-09T08:09:17.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.052+0000 7f3f10ff9700 1 -- 172.21.15.71:0/274586694 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f08020070 con 0x7f3f140c7410 2023-10-09T08:09:17.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.052+0000 7f3f10ff9700 1 -- 172.21.15.71:0/274586694 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0801b6a0 con 0x7f3f140c7410 2023-10-09T08:09:17.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.052+0000 7f3f19f9d700 1 -- 172.21.15.71:0/274586694 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f140ac6a0 con 0x7f3f140c7410 2023-10-09T08:09:17.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.052+0000 7f3f19f9d700 1 -- 172.21.15.71:0/274586694 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f140b1870 con 0x7f3f140c7410 2023-10-09T08:09:17.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.053+0000 7f3f19f9d700 1 -- 172.21.15.71:0/274586694 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f140acbc0 con 0x7f3f140c7410 2023-10-09T08:09:17.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.054+0000 7f3f10ff9700 1 -- 172.21.15.71:0/274586694 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 82) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f3f08022030 con 0x7f3f140c7410 2023-10-09T08:09:17.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.054+0000 7f3f10ff9700 1 --2- 172.21.15.71:0/274586694 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3ef80670a0 0x7f3ef8069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:09:17.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.055+0000 7f3f10ff9700 1 -- 172.21.15.71:0/274586694 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f3f080869f0 con 0x7f3f140c7410 2023-10-09T08:09:17.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.055+0000 7f3f13fff700 1 --2- 172.21.15.71:0/274586694 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3ef80670a0 0x7f3ef8069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:09:17.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.056+0000 7f3f13fff700 1 --2- 172.21.15.71:0/274586694 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3ef80670a0 0x7f3ef8069550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3f14168f10 tx=0x7f3f00009040 comp rx=0 tx=0).ready entity=mgr.7616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:09:17.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.059+0000 7f3f10ff9700 1 -- 172.21.15.71:0/274586694 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f140acbc0 con 0x7f3f140c7410 2023-10-09T08:09:17.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.301+0000 7f3f19f9d700 1 -- 172.21.15.71:0/274586694 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f3f140acbc0 con 0x7f3f140c7410 2023-10-09T08:09:17.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.304+0000 7f3f10ff9700 1 -- 172.21.15.71:0/274586694 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v82) v1 ==== 74+0+163914 (secure 0 0 0) 0x7f3f140acbc0 con 0x7f3f140c7410 2023-10-09T08:09:17.307 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:09:17.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.307+0000 7f3f19f9d700 1 -- 172.21.15.71:0/274586694 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3ef80670a0 msgr2=0x7f3ef8069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:09:17.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.308+0000 7f3f19f9d700 1 --2- 172.21.15.71:0/274586694 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3ef80670a0 0x7f3ef8069550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3f14168f10 tx=0x7f3f00009040 comp rx=0 tx=0).stop 2023-10-09T08:09:17.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.308+0000 7f3f19f9d700 1 -- 172.21.15.71:0/274586694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f140c7410 msgr2=0x7f3f14149a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:09:17.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.308+0000 7f3f19f9d700 1 --2- 172.21.15.71:0/274586694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f140c7410 0x7f3f14149a20 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f3f080030c0 tx=0x7f3f08016000 comp rx=0 tx=0).stop 2023-10-09T08:09:17.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.308+0000 7f3f19f9d700 1 -- 172.21.15.71:0/274586694 shutdown_connections 2023-10-09T08:09:17.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.308+0000 7f3f19f9d700 1 --2- 172.21.15.71:0/274586694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f14150550 0x7f3f14159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:09:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.308+0000 7f3f19f9d700 1 --2- 172.21.15.71:0/274586694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f140c7410 0x7f3f14149a20 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:09:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.308+0000 7f3f19f9d700 1 --2- 172.21.15.71:0/274586694 >> [v2:172.21.15.179:6835/85452,v1:172.21.15.179:6837/85452] conn(0x7f3ef80670a0 0x7f3ef8069550 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:09:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.308+0000 7f3f19f9d700 1 --2- 172.21.15.71:0/274586694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f14150180 0x7f3f14149f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:09:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.308+0000 7f3f19f9d700 1 -- 172.21.15.71:0/274586694 >> 172.21.15.71:0/274586694 conn(0x7f3f140cc1f0 msgr2=0x7f3f14158d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:09:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.308+0000 7f3f19f9d700 1 -- 172.21.15.71:0/274586694 shutdown_connections 2023-10-09T08:09:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:09:17.308+0000 7f3f19f9d700 1 -- 172.21.15.71:0/274586694 wait complete. 2023-10-09T08:09:17.326 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":82,"active_gid":7616,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":85452},{"type":"v1","addr":"172.21.15.179:6837","nonce":85452}]},"active_addr":"172.21.15.179:6837/85452","active_change":"2023-10-09T07:58:43.731392+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":7610,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":177,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":3488491397}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":2282437587}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":975761648}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":3234455519}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":1844939615}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":2942596736}]}]} 2023-10-09T08:09:17.332 DEBUG:tasks.cephfs.test_snap_schedules:restarting active mgr: x 2023-10-09T08:09:17.332 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-09T08:09:17.333 INFO:tasks.ceph.mgr.x:Stopping old one... 2023-10-09T08:09:17.333 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-09T08:09:17.333 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:09:17.406 INFO:tasks.ceph.mgr.x:Stopped 2023-10-09T08:09:17.406 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-09T08:09:17.410 INFO:tasks.ceph.mgr.x:Started 2023-10-09T08:09:18.720 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:18.720+0000 7eff56289180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T08:09:18.884 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:18.884+0000 7eff56289180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T08:09:18.969 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:18.968+0000 7eff56289180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T08:09:19.194 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:19.193+0000 7eff56289180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T08:09:19.369 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:19.369+0000 7eff56289180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T08:09:19.461 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:19.461+0000 7eff56289180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T08:09:19.624 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:19.624+0000 7eff56289180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T08:09:19.725 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:19.724+0000 7eff56289180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T08:09:20.212 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:20.212+0000 7eff56289180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T08:09:20.307 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:20.307+0000 7eff56289180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T08:09:20.397 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:20.397+0000 7eff56289180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T08:09:21.021 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:21.019+0000 7eff56289180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T08:09:21.192 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:21.192+0000 7eff56289180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T08:09:21.288 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:21.288+0000 7eff56289180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T08:09:21.582 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:21.581+0000 7eff56289180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T08:09:21.677 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:21.676+0000 7eff56289180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T08:09:22.381 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:22.380+0000 7eff56289180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T08:09:22.667 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:22.665+0000 7eff56289180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T08:09:22.760 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:22.759+0000 7eff56289180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T08:09:22.914 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:22.913+0000 7eff56289180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T08:09:23.019 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:23.018+0000 7eff56289180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T08:09:23.211 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:23.209+0000 7eff56289180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T08:09:23.304 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:23.302+0000 7eff56289180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T08:09:23.397 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:23.396+0000 7eff56289180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T08:09:23.491 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:23.490+0000 7eff56289180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T08:09:23.661 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:23.660+0000 7efec756f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:09:23.662 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:23.660+0000 7efec756f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:09:23.662 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:23.660+0000 7efec756f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:09:23.662 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:23.660+0000 7efec756f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:09:23.662 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:23.660+0000 7efec756f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:09:23.662 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:23.661+0000 7efec9d74700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:09:23.663 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:23.661+0000 7efec9d74700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:09:23.663 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:23.661+0000 7efec9d74700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:09:23.663 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:23.661+0000 7efec9d74700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:09:23.663 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:09:23.661+0000 7efec9d74700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:09:25.347 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:09:25.353 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:09:55.511 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:09:55.517 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:10:00.660 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:10:00.659+0000 7efed2d86700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:10:00.660 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:10:00.659+0000 7efed2d86700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:10:00.660 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:10:00.659+0000 7efed2d86700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:10:00.660 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:10:00.659+0000 7efed2d86700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:10:00.660 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:10:00.659+0000 7efed2d86700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:10:25.618 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:10:25.624 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:10:55.774 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:10:55.780 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:11:25.931 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:11:25.936 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:11:56.035 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:11:56.041 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:12:26.234 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:12:26.239 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:12:56.407 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:12:56.413 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:13:26.579 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:13:26.585 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:13:56.718 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:13:56.724 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:14:17.412 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/test_restart 1M 2023-10-09T08:14:17.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.606+0000 7f9d505ff700 1 Processor -- start 2023-10-09T08:14:17.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.606+0000 7f9d505ff700 1 -- start start 2023-10-09T08:14:17.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.607+0000 7f9d505ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9d481597b0 0x7f9d480af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:17.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.607+0000 7f9d505ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d48159b80 0x7f9d4806a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:17.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.607+0000 7f9d505ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9d4806a7f0 0x7f9d48068d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:17.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.607+0000 7f9d505ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d48068390 con 0x7f9d4806a7f0 2023-10-09T08:14:17.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.607+0000 7f9d505ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d480ac530 con 0x7f9d481597b0 2023-10-09T08:14:17.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.607+0000 7f9d505ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4806ac30 con 0x7f9d48159b80 2023-10-09T08:14:17.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.608+0000 7f9d4eb9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9d4806a7f0 0x7f9d48068d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:17.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.608+0000 7f9d4eb9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9d4806a7f0 0x7f9d48068d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58194/0 (socket says 172.21.15.71:58194) 2023-10-09T08:14:17.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.608+0000 7f9d4eb9c700 1 -- 172.21.15.71:0/3392415852 learned_addr learned my addr 172.21.15.71:0/3392415852 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:17.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.608+0000 7f9d4e39b700 1 --2- 172.21.15.71:0/3392415852 >> v2:172.21.15.179:3300/0 conn(0x7f9d481597b0 0x7f9d480af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:17.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.608+0000 7f9d4db9a700 1 --2- 172.21.15.71:0/3392415852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d48159b80 0x7f9d4806a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:17.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.608+0000 7f9d4eb9c700 1 -- 172.21.15.71:0/3392415852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d48159b80 msgr2=0x7f9d4806a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:17.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.608+0000 7f9d4eb9c700 1 --2- 172.21.15.71:0/3392415852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d48159b80 0x7f9d4806a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:17.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.608+0000 7f9d4eb9c700 1 -- 172.21.15.71:0/3392415852 >> v2:172.21.15.179:3300/0 conn(0x7f9d481597b0 msgr2=0x7f9d480af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:17.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.608+0000 7f9d4eb9c700 1 --2- 172.21.15.71:0/3392415852 >> v2:172.21.15.179:3300/0 conn(0x7f9d481597b0 0x7f9d480af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:17.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.608+0000 7f9d4eb9c700 1 -- 172.21.15.71:0/3392415852 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d480aa680 con 0x7f9d4806a7f0 2023-10-09T08:14:17.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.608+0000 7f9d4e39b700 1 --2- 172.21.15.71:0/3392415852 >> v2:172.21.15.179:3300/0 conn(0x7f9d481597b0 0x7f9d480af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:14:17.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.608+0000 7f9d4eb9c700 1 --2- 172.21.15.71:0/3392415852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d4806a7f0 0x7f9d48068d70 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f9d4806db50 tx=0x7f9d40009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c4025321dae70f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:17.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.609+0000 7f9d4d399700 1 -- 172.21.15.71:0/3392415852 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4000e070 con 0x7f9d4806a7f0 2023-10-09T08:14:17.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.609+0000 7f9d4d399700 1 -- 172.21.15.71:0/3392415852 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4000ba40 con 0x7f9d4806a7f0 2023-10-09T08:14:17.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.609+0000 7f9d4d399700 1 -- 172.21.15.71:0/3392415852 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d400092e0 con 0x7f9d4806a7f0 2023-10-09T08:14:17.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.609+0000 7f9d505ff700 1 -- 172.21.15.71:0/3392415852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d4806a7f0 msgr2=0x7f9d48068d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:17.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.609+0000 7f9d505ff700 1 --2- 172.21.15.71:0/3392415852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d4806a7f0 0x7f9d48068d70 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f9d4806db50 tx=0x7f9d40009840 comp rx=0 tx=0).stop 2023-10-09T08:14:17.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.609+0000 7f9d505ff700 1 -- 172.21.15.71:0/3392415852 shutdown_connections 2023-10-09T08:14:17.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.609+0000 7f9d505ff700 1 --2- 172.21.15.71:0/3392415852 >> v2:172.21.15.179:3300/0 conn(0x7f9d481597b0 0x7f9d480af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:17.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.609+0000 7f9d505ff700 1 --2- 172.21.15.71:0/3392415852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d4806a7f0 0x7f9d48068d70 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:17.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.609+0000 7f9d505ff700 1 --2- 172.21.15.71:0/3392415852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d48159b80 0x7f9d4806a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:17.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.609+0000 7f9d505ff700 1 -- 172.21.15.71:0/3392415852 >> 172.21.15.71:0/3392415852 conn(0x7f9d480cd880 msgr2=0x7f9d480ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:17.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.609+0000 7f9d505ff700 1 -- 172.21.15.71:0/3392415852 shutdown_connections 2023-10-09T08:14:17.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.609+0000 7f9d505ff700 1 -- 172.21.15.71:0/3392415852 wait complete. 2023-10-09T08:14:17.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.611+0000 7f9d505ff700 1 Processor -- start 2023-10-09T08:14:17.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.611+0000 7f9d505ff700 1 -- start start 2023-10-09T08:14:17.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.612+0000 7f9d505ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d4806a7f0 0x7f9d4815a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:17.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.612+0000 7f9d505ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d481597b0 0x7f9d48151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:17.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.612+0000 7f9d505ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d48159b80 0x7f9d4806e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:17.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.612+0000 7f9d505ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4815c8d0 con 0x7f9d481597b0 2023-10-09T08:14:17.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.612+0000 7f9d505ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4815a770 con 0x7f9d4806a7f0 2023-10-09T08:14:17.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.612+0000 7f9d505ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4815cb20 con 0x7f9d48159b80 2023-10-09T08:14:17.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.612+0000 7f9d4db9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d481597b0 0x7f9d48151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:17.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.612+0000 7f9d4db9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d481597b0 0x7f9d48151c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58196/0 (socket says 172.21.15.71:58196) 2023-10-09T08:14:17.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.612+0000 7f9d4db9a700 1 -- 172.21.15.71:0/1675709418 learned_addr learned my addr 172.21.15.71:0/1675709418 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:17.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.612+0000 7f9d4e39b700 1 --2- 172.21.15.71:0/1675709418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d4806a7f0 0x7f9d4815a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:17.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.612+0000 7f9d4eb9c700 1 --2- 172.21.15.71:0/1675709418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d48159b80 0x7f9d4806e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:17.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.613+0000 7f9d4db9a700 1 -- 172.21.15.71:0/1675709418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d48159b80 msgr2=0x7f9d4806e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:17.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.613+0000 7f9d4db9a700 1 --2- 172.21.15.71:0/1675709418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d48159b80 0x7f9d4806e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:17.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.613+0000 7f9d4db9a700 1 -- 172.21.15.71:0/1675709418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d4806a7f0 msgr2=0x7f9d4815a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:17.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.613+0000 7f9d4db9a700 1 --2- 172.21.15.71:0/1675709418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d4806a7f0 0x7f9d4815a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:17.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.613+0000 7f9d4db9a700 1 -- 172.21.15.71:0/1675709418 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d40009ae0 con 0x7f9d481597b0 2023-10-09T08:14:17.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.613+0000 7f9d4db9a700 1 --2- 172.21.15.71:0/1675709418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d481597b0 0x7f9d48151c00 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800d890 tx=0x7f9d38008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:17.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.613+0000 7f9d3e7fc700 1 -- 172.21.15.71:0/1675709418 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d380125f0 con 0x7f9d481597b0 2023-10-09T08:14:17.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.613+0000 7f9d3e7fc700 1 -- 172.21.15.71:0/1675709418 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d38012750 con 0x7f9d481597b0 2023-10-09T08:14:17.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.613+0000 7f9d3e7fc700 1 -- 172.21.15.71:0/1675709418 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d38012b10 con 0x7f9d481597b0 2023-10-09T08:14:17.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.613+0000 7f9d505ff700 1 -- 172.21.15.71:0/1675709418 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d4815ce00 con 0x7f9d481597b0 2023-10-09T08:14:17.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.613+0000 7f9d505ff700 1 -- 172.21.15.71:0/1675709418 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4815d910 con 0x7f9d481597b0 2023-10-09T08:14:17.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.614+0000 7f9d505ff700 1 -- 172.21.15.71:0/1675709418 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d480ae390 con 0x7f9d481597b0 2023-10-09T08:14:17.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.615+0000 7f9d3e7fc700 1 -- 172.21.15.71:0/1675709418 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 87) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f9d3801e460 con 0x7f9d481597b0 2023-10-09T08:14:17.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.616+0000 7f9d3e7fc700 1 --2- 172.21.15.71:0/1675709418 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9d2c0670d0 0x7f9d2c069580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:17.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.616+0000 7f9d3e7fc700 1 -- 172.21.15.71:0/1675709418 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6714+0+0 (secure 0 0 0) 0x7f9d38084fe0 con 0x7f9d481597b0 2023-10-09T08:14:17.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.617+0000 7f9d4e39b700 1 --2- 172.21.15.71:0/1675709418 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9d2c0670d0 0x7f9d2c069580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:17.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.617+0000 7f9d4e39b700 1 --2- 172.21.15.71:0/1675709418 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9d2c0670d0 0x7f9d2c069580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9d44006f00 tx=0x7f9d44008040 comp rx=0 tx=0).ready entity=mgr.8896 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:17.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.621+0000 7f9d3e7fc700 1 -- 172.21.15.71:0/1675709418 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d480ae390 con 0x7f9d481597b0 2023-10-09T08:14:17.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.837+0000 7f9d505ff700 1 -- 172.21.15.71:0/1675709418 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d4806a630 con 0x7f9d2c0670d0 2023-10-09T08:14:17.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.902+0000 7f9d3e7fc700 1 -- 172.21.15.71:0/1675709418 <== mgr.8896 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7f9d4806a630 con 0x7f9d2c0670d0 2023-10-09T08:14:17.903 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule deactivated for path /snap_test_dir1/test_restart 2023-10-09T08:14:17.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.904+0000 7f9d505ff700 1 -- 172.21.15.71:0/1675709418 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9d2c0670d0 msgr2=0x7f9d2c069580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:17.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.904+0000 7f9d505ff700 1 --2- 172.21.15.71:0/1675709418 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9d2c0670d0 0x7f9d2c069580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9d44006f00 tx=0x7f9d44008040 comp rx=0 tx=0).stop 2023-10-09T08:14:17.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.904+0000 7f9d505ff700 1 -- 172.21.15.71:0/1675709418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d481597b0 msgr2=0x7f9d48151c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:17.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.904+0000 7f9d505ff700 1 --2- 172.21.15.71:0/1675709418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d481597b0 0x7f9d48151c00 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800d890 tx=0x7f9d38008040 comp rx=0 tx=0).stop 2023-10-09T08:14:17.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.905+0000 7f9d505ff700 1 -- 172.21.15.71:0/1675709418 shutdown_connections 2023-10-09T08:14:17.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.905+0000 7f9d505ff700 1 --2- 172.21.15.71:0/1675709418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d48159b80 0x7f9d4806e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:17.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.905+0000 7f9d505ff700 1 --2- 172.21.15.71:0/1675709418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d4806a7f0 0x7f9d4815a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:17.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.905+0000 7f9d505ff700 1 --2- 172.21.15.71:0/1675709418 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9d2c0670d0 0x7f9d2c069580 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:17.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.905+0000 7f9d505ff700 1 --2- 172.21.15.71:0/1675709418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d481597b0 0x7f9d48151c00 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:17.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.905+0000 7f9d505ff700 1 -- 172.21.15.71:0/1675709418 >> 172.21.15.71:0/1675709418 conn(0x7f9d480cd880 msgr2=0x7f9d480b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:17.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.905+0000 7f9d505ff700 1 -- 172.21.15.71:0/1675709418 shutdown_connections 2023-10-09T08:14:17.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:17.905+0000 7f9d505ff700 1 -- 172.21.15.71:0/1675709418 wait complete. 2023-10-09T08:14:17.922 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/test_restart 2023-10-09T08:14:17.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:14:17.923 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-10-09T08:14:17.960 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_59_00_UTC 2023-10-09T08:14:17.960 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_00_00_UTC 2023-10-09T08:14:17.961 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_01_00_UTC 2023-10-09T08:14:17.961 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_02_00_UTC 2023-10-09T08:14:17.961 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_03_00_UTC 2023-10-09T08:14:17.961 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_04_00_UTC 2023-10-09T08:14:17.961 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_05_00_UTC 2023-10-09T08:14:17.961 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_06_00_UTC 2023-10-09T08:14:17.961 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_07_00_UTC 2023-10-09T08:14:17.961 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_08_00_UTC 2023-10-09T08:14:17.961 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_09_00_UTC 2023-10-09T08:14:17.961 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_10_00_UTC 2023-10-09T08:14:17.962 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_11_00_UTC 2023-10-09T08:14:17.962 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_12_00_UTC 2023-10-09T08:14:17.962 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_13_00_UTC 2023-10-09T08:14:17.962 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_14_00_UTC 2023-10-09T08:14:17.963 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-07_59_00_UTC', 'scheduled-2023-10-09-08_00_00_UTC', 'scheduled-2023-10-09-08_01_00_UTC', 'scheduled-2023-10-09-08_02_00_UTC', 'scheduled-2023-10-09-08_03_00_UTC', 'scheduled-2023-10-09-08_04_00_UTC', 'scheduled-2023-10-09-08_05_00_UTC', 'scheduled-2023-10-09-08_06_00_UTC', 'scheduled-2023-10-09-08_07_00_UTC', 'scheduled-2023-10-09-08_08_00_UTC', 'scheduled-2023-10-09-08_09_00_UTC', 'scheduled-2023-10-09-08_10_00_UTC', 'scheduled-2023-10-09-08_11_00_UTC', 'scheduled-2023-10-09-08_12_00_UTC', 'scheduled-2023-10-09-08_13_00_UTC', 'scheduled-2023-10-09-08_14_00_UTC'] 2023-10-09T08:14:17.963 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-10-09T08:14:18.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.187+0000 7fbf4979d700 1 Processor -- start 2023-10-09T08:14:18.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.187+0000 7fbf4979d700 1 -- start start 2023-10-09T08:14:18.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.188+0000 7fbf4979d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbf440b0790 0x7fbf440cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:18.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.188+0000 7fbf4979d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbf441591e0 0x7fbf44159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:18.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.188+0000 7fbf4979d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf440cfa00 con 0x7fbf440b03c0 2023-10-09T08:14:18.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.188+0000 7fbf4979d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf440cb580 con 0x7fbf440b0790 2023-10-09T08:14:18.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.188+0000 7fbf4979d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf440cf160 con 0x7fbf441591e0 2023-10-09T08:14:18.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.189+0000 7fbf43fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fbf440b03c0 0x7fbf440b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48582/0 (socket says 172.21.15.71:48582) 2023-10-09T08:14:18.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.189+0000 7fbf3bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbf440b0790 0x7fbf440cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:18.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.189+0000 7fbf43fff700 1 -- 172.21.15.71:0/2155325174 learned_addr learned my addr 172.21.15.71:0/2155325174 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:18.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.189+0000 7fbf48f9c700 1 --2- 172.21.15.71:0/2155325174 >> v2:172.21.15.179:3300/0 conn(0x7fbf441591e0 0x7fbf44159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:18.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.189+0000 7fbf3bfff700 1 -- 172.21.15.71:0/2155325174 >> v2:172.21.15.179:3300/0 conn(0x7fbf441591e0 msgr2=0x7fbf44159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:18.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.189+0000 7fbf3bfff700 1 --2- 172.21.15.71:0/2155325174 >> v2:172.21.15.179:3300/0 conn(0x7fbf441591e0 0x7fbf44159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:18.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.189+0000 7fbf3bfff700 1 -- 172.21.15.71:0/2155325174 >> v1:172.21.15.71:6789/0 conn(0x7fbf440b03c0 legacy=0x7fbf440b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:18.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.189+0000 7fbf3bfff700 1 -- 172.21.15.71:0/2155325174 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf440cf440 con 0x7fbf440b0790 2023-10-09T08:14:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.189+0000 7fbf48f9c700 1 --2- 172.21.15.71:0/2155325174 >> v2:172.21.15.179:3300/0 conn(0x7fbf441591e0 0x7fbf44159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:14:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.189+0000 7fbf437fe700 1 -- 172.21.15.71:0/2155325174 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118128848 0 0) 0x7fbf440cfa00 con 0x7fbf440b03c0 2023-10-09T08:14:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.189+0000 7fbf3bfff700 1 --2- 172.21.15.71:0/2155325174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf440b0790 0x7fbf440cea70 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0098e0 tx=0x7fbf2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d428fde84dedeab server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.189+0000 7fbf437fe700 1 -- 172.21.15.71:0/2155325174 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c009e80 con 0x7fbf440b0790 2023-10-09T08:14:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.190+0000 7fbf437fe700 1 -- 172.21.15.71:0/2155325174 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2c00b820 con 0x7fbf440b0790 2023-10-09T08:14:18.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.190+0000 7fbf437fe700 1 -- 172.21.15.71:0/2155325174 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c00bba0 con 0x7fbf440b0790 2023-10-09T08:14:18.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.190+0000 7fbf4979d700 1 -- 172.21.15.71:0/2155325174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf440b0790 msgr2=0x7fbf440cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:18.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.190+0000 7fbf4979d700 1 --2- 172.21.15.71:0/2155325174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf440b0790 0x7fbf440cea70 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0098e0 tx=0x7fbf2c0091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:18.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.190+0000 7fbf4979d700 1 -- 172.21.15.71:0/2155325174 shutdown_connections 2023-10-09T08:14:18.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.190+0000 7fbf4979d700 1 --2- 172.21.15.71:0/2155325174 >> v2:172.21.15.179:3300/0 conn(0x7fbf441591e0 0x7fbf44159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:18.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.190+0000 7fbf4979d700 1 --2- 172.21.15.71:0/2155325174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf440b0790 0x7fbf440cea70 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:18.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.190+0000 7fbf4979d700 1 -- 172.21.15.71:0/2155325174 >> 172.21.15.71:0/2155325174 conn(0x7fbf44063230 msgr2=0x7fbf44063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:18.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.190+0000 7fbf4979d700 1 -- 172.21.15.71:0/2155325174 shutdown_connections 2023-10-09T08:14:18.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.190+0000 7fbf4979d700 1 -- 172.21.15.71:0/2155325174 wait complete. 2023-10-09T08:14:18.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.192+0000 7fbf4979d700 1 Processor -- start 2023-10-09T08:14:18.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.192+0000 7fbf4979d700 1 -- start start 2023-10-09T08:14:18.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.193+0000 7fbf4979d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf440b03c0 0x7fbf44158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:18.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.193+0000 7fbf4979d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf440b0790 0x7fbf440c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:18.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.193+0000 7fbf4979d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf441591e0 0x7fbf440b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:18.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.193+0000 7fbf4979d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf440c9a20 con 0x7fbf441591e0 2023-10-09T08:14:18.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.193+0000 7fbf4979d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf44159000 con 0x7fbf440b0790 2023-10-09T08:14:18.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.193+0000 7fbf4979d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf440c90f0 con 0x7fbf440b03c0 2023-10-09T08:14:18.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.193+0000 7fbf48f9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf441591e0 0x7fbf440b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:18.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.193+0000 7fbf48f9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf441591e0 0x7fbf440b4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58212/0 (socket says 172.21.15.71:58212) 2023-10-09T08:14:18.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.193+0000 7fbf48f9c700 1 -- 172.21.15.71:0/432194441 learned_addr learned my addr 172.21.15.71:0/432194441 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:18.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.193+0000 7fbf43fff700 1 --2- 172.21.15.71:0/432194441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf440b03c0 0x7fbf44158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:18.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.193+0000 7fbf3bfff700 1 --2- 172.21.15.71:0/432194441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf440b0790 0x7fbf440c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:18.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.193+0000 7fbf48f9c700 1 -- 172.21.15.71:0/432194441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf440b03c0 msgr2=0x7fbf44158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:18.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.193+0000 7fbf48f9c700 1 --2- 172.21.15.71:0/432194441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf440b03c0 0x7fbf44158ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:18.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.193+0000 7fbf48f9c700 1 -- 172.21.15.71:0/432194441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf440b0790 msgr2=0x7fbf440c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:18.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.193+0000 7fbf48f9c700 1 --2- 172.21.15.71:0/432194441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf440b0790 0x7fbf440c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:18.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.193+0000 7fbf48f9c700 1 -- 172.21.15.71:0/432194441 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c009420 con 0x7fbf441591e0 2023-10-09T08:14:18.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.193+0000 7fbf3bfff700 1 --2- 172.21.15.71:0/432194441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf440b0790 0x7fbf440c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:14:18.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.193+0000 7fbf43fff700 1 --2- 172.21.15.71:0/432194441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf440b03c0 0x7fbf44158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:14:18.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.193+0000 7fbf48f9c700 1 --2- 172.21.15.71:0/432194441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf441591e0 0x7fbf440b4060 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00a380 tx=0x7fbf3c007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:18.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.194+0000 7fbf40ff9700 1 -- 172.21.15.71:0/432194441 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c00ae10 con 0x7fbf441591e0 2023-10-09T08:14:18.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.194+0000 7fbf40ff9700 1 -- 172.21.15.71:0/432194441 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3c00d650 con 0x7fbf441591e0 2023-10-09T08:14:18.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.194+0000 7fbf4979d700 1 -- 172.21.15.71:0/432194441 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf440c93d0 con 0x7fbf441591e0 2023-10-09T08:14:18.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.194+0000 7fbf40ff9700 1 -- 172.21.15.71:0/432194441 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c00da10 con 0x7fbf441591e0 2023-10-09T08:14:18.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.194+0000 7fbf4979d700 1 -- 172.21.15.71:0/432194441 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf440ca3f0 con 0x7fbf441591e0 2023-10-09T08:14:18.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.195+0000 7fbf4979d700 1 -- 172.21.15.71:0/432194441 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf440b6140 con 0x7fbf441591e0 2023-10-09T08:14:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.196+0000 7fbf40ff9700 1 -- 172.21.15.71:0/432194441 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 87) v1 ==== 84871+0+0 (secure 0 0 0) 0x7fbf3c01e3b0 con 0x7fbf441591e0 2023-10-09T08:14:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.197+0000 7fbf40ff9700 1 --2- 172.21.15.71:0/432194441 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbf240670a0 0x7fbf24069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.197+0000 7fbf40ff9700 1 -- 172.21.15.71:0/432194441 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6714+0+0 (secure 0 0 0) 0x7fbf3c0855f0 con 0x7fbf441591e0 2023-10-09T08:14:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.197+0000 7fbf43fff700 1 --2- 172.21.15.71:0/432194441 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbf240670a0 0x7fbf24069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.198+0000 7fbf43fff700 1 --2- 172.21.15.71:0/432194441 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbf240670a0 0x7fbf24069550 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbf34001810 tx=0x7fbf34009040 comp rx=0 tx=0).ready entity=mgr.8896 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.200+0000 7fbf40ff9700 1 -- 172.21.15.71:0/432194441 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf3c0522c0 con 0x7fbf441591e0 2023-10-09T08:14:18.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.416+0000 7fbf4979d700 1 -- 172.21.15.71:0/432194441 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf4404c3c0 con 0x7fbf240670a0 2023-10-09T08:14:18.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.425+0000 7fbf40ff9700 1 -- 172.21.15.71:0/432194441 <== mgr.8896 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+361 (secure 0 0 0) 0x7fbf4404c3c0 con 0x7fbf240670a0 2023-10-09T08:14:18.427 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:14:18.427 INFO:teuthology.orchestra.run.smithi071.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T07:58:44", "first": "2023-10-09T07:59:00", "last": "2023-10-09T08:14:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-10-09T08:14:18.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.428+0000 7fbf4979d700 1 -- 172.21.15.71:0/432194441 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbf240670a0 msgr2=0x7fbf24069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:18.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.428+0000 7fbf4979d700 1 --2- 172.21.15.71:0/432194441 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbf240670a0 0x7fbf24069550 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbf34001810 tx=0x7fbf34009040 comp rx=0 tx=0).stop 2023-10-09T08:14:18.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.428+0000 7fbf4979d700 1 -- 172.21.15.71:0/432194441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf441591e0 msgr2=0x7fbf440b4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:18.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.428+0000 7fbf4979d700 1 --2- 172.21.15.71:0/432194441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf441591e0 0x7fbf440b4060 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00a380 tx=0x7fbf3c007900 comp rx=0 tx=0).stop 2023-10-09T08:14:18.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.428+0000 7fbf4979d700 1 -- 172.21.15.71:0/432194441 shutdown_connections 2023-10-09T08:14:18.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.428+0000 7fbf4979d700 1 --2- 172.21.15.71:0/432194441 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbf240670a0 0x7fbf24069550 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:18.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.428+0000 7fbf4979d700 1 --2- 172.21.15.71:0/432194441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf441591e0 0x7fbf440b4060 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:18.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.428+0000 7fbf4979d700 1 --2- 172.21.15.71:0/432194441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf440b03c0 0x7fbf44158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:18.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.428+0000 7fbf4979d700 1 --2- 172.21.15.71:0/432194441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf440b0790 0x7fbf440c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:18.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.428+0000 7fbf4979d700 1 -- 172.21.15.71:0/432194441 >> 172.21.15.71:0/432194441 conn(0x7fbf44063230 msgr2=0x7fbf440d0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:18.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.428+0000 7fbf4979d700 1 -- 172.21.15.71:0/432194441 shutdown_connections 2023-10-09T08:14:18.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.428+0000 7fbf4979d700 1 -- 172.21.15.71:0/432194441 wait complete. 2023-10-09T08:14:18.446 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T07:58:44", "first": "2023-10-09T07:59:00", "last": "2023-10-09T08:14:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-10-09T08:14:18.446 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T07:58:44', 'first': '2023-10-09T07:59:00', 'last': '2023-10-09T08:14:00', 'last_pruned': None, 'created_count': 16, 'pruned_count': 0, 'active': False} 2023-10-09T08:14:18.446 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 16 2023-10-09T08:14:18.446 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 16 2023-10-09T08:14:18.446 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/test_restart 1M 2023-10-09T08:14:18.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.630+0000 7fbc5edff700 1 Processor -- start 2023-10-09T08:14:18.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.630+0000 7fbc5edff700 1 -- start start 2023-10-09T08:14:18.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.631+0000 7fbc5edff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbc581563b0 0x7fbc58156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:18.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.631+0000 7fbc5edff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc5815a440 0x7fbc580acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:18.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.631+0000 7fbc5edff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc5815a9b0 con 0x7fbc58068890 2023-10-09T08:14:18.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.631+0000 7fbc5edff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc5815ac90 con 0x7fbc581563b0 2023-10-09T08:14:18.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.631+0000 7fbc5edff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5815af70 con 0x7fbc5815a440 2023-10-09T08:14:18.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.632+0000 7fbc5cb9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbc581563b0 0x7fbc58156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:18.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.632+0000 7fbc5d39c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fbc58068890 0x7fbc580c8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48584/0 (socket says 172.21.15.71:48584) 2023-10-09T08:14:18.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.632+0000 7fbc5d39c700 1 -- 172.21.15.71:0/1178713271 learned_addr learned my addr 172.21.15.71:0/1178713271 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:18.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.632+0000 7fbc57fff700 1 --2- 172.21.15.71:0/1178713271 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc5815a440 0x7fbc580acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:18.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.632+0000 7fbc5cb9b700 1 -- 172.21.15.71:0/1178713271 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc5815a440 msgr2=0x7fbc580acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:18.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.632+0000 7fbc5cb9b700 1 --2- 172.21.15.71:0/1178713271 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc5815a440 0x7fbc580acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:18.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.632+0000 7fbc5cb9b700 1 -- 172.21.15.71:0/1178713271 >> v1:172.21.15.71:6789/0 conn(0x7fbc58068890 legacy=0x7fbc580c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:18.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.632+0000 7fbc5cb9b700 1 -- 172.21.15.71:0/1178713271 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5815b250 con 0x7fbc581563b0 2023-10-09T08:14:18.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.632+0000 7fbc57fff700 1 --2- 172.21.15.71:0/1178713271 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc5815a440 0x7fbc580acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:14:18.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.632+0000 7fbc5cb9b700 1 --2- 172.21.15.71:0/1178713271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc581563b0 0x7fbc58156780 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0098e0 tx=0x7fbc4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae7784b3978cc2b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:18.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.633+0000 7fbc577fe700 1 -- 172.21.15.71:0/1178713271 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c009e80 con 0x7fbc581563b0 2023-10-09T08:14:18.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.633+0000 7fbc577fe700 1 -- 172.21.15.71:0/1178713271 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4c00b860 con 0x7fbc581563b0 2023-10-09T08:14:18.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.633+0000 7fbc577fe700 1 -- 172.21.15.71:0/1178713271 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c00bbe0 con 0x7fbc581563b0 2023-10-09T08:14:18.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.633+0000 7fbc5edff700 1 -- 172.21.15.71:0/1178713271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc581563b0 msgr2=0x7fbc58156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:18.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.633+0000 7fbc5edff700 1 --2- 172.21.15.71:0/1178713271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc581563b0 0x7fbc58156780 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0098e0 tx=0x7fbc4c0091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:18.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.633+0000 7fbc5edff700 1 -- 172.21.15.71:0/1178713271 shutdown_connections 2023-10-09T08:14:18.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.633+0000 7fbc5edff700 1 --2- 172.21.15.71:0/1178713271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc581563b0 0x7fbc58156780 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:18.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.633+0000 7fbc5edff700 1 --2- 172.21.15.71:0/1178713271 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc5815a440 0x7fbc580acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:18.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.633+0000 7fbc5edff700 1 -- 172.21.15.71:0/1178713271 >> 172.21.15.71:0/1178713271 conn(0x7fbc580c8f90 msgr2=0x7fbc580c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:18.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.633+0000 7fbc5edff700 1 -- 172.21.15.71:0/1178713271 shutdown_connections 2023-10-09T08:14:18.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.633+0000 7fbc5edff700 1 -- 172.21.15.71:0/1178713271 wait complete. 2023-10-09T08:14:18.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.635+0000 7fbc5edff700 1 Processor -- start 2023-10-09T08:14:18.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.635+0000 7fbc5edff700 1 -- start start 2023-10-09T08:14:18.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.636+0000 7fbc5edff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc58068890 0x7fbc580aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:18.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.636+0000 7fbc5edff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc581563b0 0x7fbc5814b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:18.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.636+0000 7fbc5edff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc5815a440 0x7fbc580ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:18.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.636+0000 7fbc5edff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5814ebf0 con 0x7fbc58068890 2023-10-09T08:14:18.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.636+0000 7fbc5edff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc580b0690 con 0x7fbc5815a440 2023-10-09T08:14:18.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.636+0000 7fbc5edff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5814dd40 con 0x7fbc581563b0 2023-10-09T08:14:18.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.636+0000 7fbc5cb9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc58068890 0x7fbc580aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:18.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.636+0000 7fbc5cb9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc58068890 0x7fbc580aaff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58232/0 (socket says 172.21.15.71:58232) 2023-10-09T08:14:18.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.636+0000 7fbc5cb9b700 1 -- 172.21.15.71:0/282372432 learned_addr learned my addr 172.21.15.71:0/282372432 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:18.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.636+0000 7fbc57fff700 1 --2- 172.21.15.71:0/282372432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc581563b0 0x7fbc5814b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:18.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.636+0000 7fbc5d39c700 1 --2- 172.21.15.71:0/282372432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc5815a440 0x7fbc580ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:18.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.636+0000 7fbc5cb9b700 1 -- 172.21.15.71:0/282372432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc581563b0 msgr2=0x7fbc5814b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:18.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.636+0000 7fbc5cb9b700 1 --2- 172.21.15.71:0/282372432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc581563b0 0x7fbc5814b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:18.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.636+0000 7fbc5cb9b700 1 -- 172.21.15.71:0/282372432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc5815a440 msgr2=0x7fbc580ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:18.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.636+0000 7fbc5cb9b700 1 --2- 172.21.15.71:0/282372432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc5815a440 0x7fbc580ad2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:18.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.636+0000 7fbc5cb9b700 1 -- 172.21.15.71:0/282372432 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4c009420 con 0x7fbc58068890 2023-10-09T08:14:18.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.636+0000 7fbc5d39c700 1 --2- 172.21.15.71:0/282372432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc5815a440 0x7fbc580ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:14:18.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.637+0000 7fbc5cb9b700 1 --2- 172.21.15.71:0/282372432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc58068890 0x7fbc580aaff0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fbc5806bbb0 tx=0x7fbc4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:18.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.637+0000 7fbc54ff9700 1 -- 172.21.15.71:0/282372432 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c00bbe0 con 0x7fbc58068890 2023-10-09T08:14:18.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.637+0000 7fbc54ff9700 1 -- 172.21.15.71:0/282372432 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4c011420 con 0x7fbc58068890 2023-10-09T08:14:18.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.637+0000 7fbc5edff700 1 -- 172.21.15.71:0/282372432 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc5814dfe0 con 0x7fbc58068890 2023-10-09T08:14:18.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.637+0000 7fbc54ff9700 1 -- 172.21.15.71:0/282372432 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c0117e0 con 0x7fbc58068890 2023-10-09T08:14:18.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.637+0000 7fbc5edff700 1 -- 172.21.15.71:0/282372432 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5814e5a0 con 0x7fbc58068890 2023-10-09T08:14:18.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.638+0000 7fbc5edff700 1 -- 172.21.15.71:0/282372432 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc580718b0 con 0x7fbc58068890 2023-10-09T08:14:18.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.639+0000 7fbc54ff9700 1 -- 172.21.15.71:0/282372432 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 87) v1 ==== 84871+0+0 (secure 0 0 0) 0x7fbc4c011bd0 con 0x7fbc58068890 2023-10-09T08:14:18.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.640+0000 7fbc54ff9700 1 --2- 172.21.15.71:0/282372432 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbc3c0670a0 0x7fbc3c069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:18.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.640+0000 7fbc54ff9700 1 -- 172.21.15.71:0/282372432 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6714+0+0 (secure 0 0 0) 0x7fbc4c086730 con 0x7fbc58068890 2023-10-09T08:14:18.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.640+0000 7fbc57fff700 1 --2- 172.21.15.71:0/282372432 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbc3c0670a0 0x7fbc3c069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:18.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.641+0000 7fbc57fff700 1 --2- 172.21.15.71:0/282372432 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbc3c0670a0 0x7fbc3c069550 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbc5814dac0 tx=0x7fbc44006f90 comp rx=0 tx=0).ready entity=mgr.8896 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:18.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.644+0000 7fbc54ff9700 1 -- 172.21.15.71:0/282372432 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc4c053400 con 0x7fbc58068890 2023-10-09T08:14:18.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.861+0000 7fbc5edff700 1 -- 172.21.15.71:0/282372432 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc5814ed30 con 0x7fbc3c0670a0 2023-10-09T08:14:18.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.942+0000 7fbc54ff9700 1 -- 172.21.15.71:0/282372432 <== mgr.8896 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+55 (secure 0 0 0) 0x7fbc4400a870 con 0x7fbc3c0670a0 2023-10-09T08:14:18.943 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule removed for path /snap_test_dir1/test_restart 2023-10-09T08:14:18.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.944+0000 7fbc5edff700 1 -- 172.21.15.71:0/282372432 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbc3c0670a0 msgr2=0x7fbc3c069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:18.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.945+0000 7fbc5edff700 1 --2- 172.21.15.71:0/282372432 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbc3c0670a0 0x7fbc3c069550 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbc5814dac0 tx=0x7fbc44006f90 comp rx=0 tx=0).stop 2023-10-09T08:14:18.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.945+0000 7fbc5edff700 1 -- 172.21.15.71:0/282372432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc58068890 msgr2=0x7fbc580aaff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:18.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.945+0000 7fbc5edff700 1 --2- 172.21.15.71:0/282372432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc58068890 0x7fbc580aaff0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fbc5806bbb0 tx=0x7fbc4c017000 comp rx=0 tx=0).stop 2023-10-09T08:14:18.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.945+0000 7fbc5edff700 1 -- 172.21.15.71:0/282372432 shutdown_connections 2023-10-09T08:14:18.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.945+0000 7fbc5edff700 1 --2- 172.21.15.71:0/282372432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc5815a440 0x7fbc580ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:18.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.945+0000 7fbc5edff700 1 --2- 172.21.15.71:0/282372432 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbc3c0670a0 0x7fbc3c069550 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:18.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.945+0000 7fbc5edff700 1 --2- 172.21.15.71:0/282372432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc58068890 0x7fbc580aaff0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:18.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.945+0000 7fbc5edff700 1 --2- 172.21.15.71:0/282372432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc581563b0 0x7fbc5814b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:18.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.945+0000 7fbc5edff700 1 -- 172.21.15.71:0/282372432 >> 172.21.15.71:0/282372432 conn(0x7fbc580c8f90 msgr2=0x7fbc580ae3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:18.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.945+0000 7fbc5edff700 1 -- 172.21.15.71:0/282372432 shutdown_connections 2023-10-09T08:14:18.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:18.945+0000 7fbc5edff700 1 -- 172.21.15.71:0/282372432 wait complete. 2023-10-09T08:14:18.963 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/test_restart 2023-10-09T08:14:18.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:14:18.963 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-10-09T08:14:19.000 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-07_59_00_UTC 2023-10-09T08:14:19.001 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_00_00_UTC 2023-10-09T08:14:19.001 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_01_00_UTC 2023-10-09T08:14:19.001 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_02_00_UTC 2023-10-09T08:14:19.001 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_03_00_UTC 2023-10-09T08:14:19.001 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_04_00_UTC 2023-10-09T08:14:19.001 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_05_00_UTC 2023-10-09T08:14:19.001 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_06_00_UTC 2023-10-09T08:14:19.001 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_07_00_UTC 2023-10-09T08:14:19.001 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_08_00_UTC 2023-10-09T08:14:19.002 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_09_00_UTC 2023-10-09T08:14:19.002 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_10_00_UTC 2023-10-09T08:14:19.002 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_11_00_UTC 2023-10-09T08:14:19.002 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_12_00_UTC 2023-10-09T08:14:19.002 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_13_00_UTC 2023-10-09T08:14:19.002 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_14_00_UTC 2023-10-09T08:14:19.003 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-07_59_00_UTC 2023-10-09T08:14:19.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:14:19.004 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-07_59_00_UTC) 2023-10-09T08:14:19.085 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_00_00_UTC 2023-10-09T08:14:19.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:14:19.086 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_00_00_UTC) 2023-10-09T08:14:19.167 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_01_00_UTC 2023-10-09T08:14:19.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:14:19.168 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_01_00_UTC) 2023-10-09T08:14:19.249 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_02_00_UTC 2023-10-09T08:14:19.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:14:19.249 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_02_00_UTC) 2023-10-09T08:14:19.331 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_03_00_UTC 2023-10-09T08:14:19.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:14:19.331 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_03_00_UTC) 2023-10-09T08:14:19.413 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_04_00_UTC 2023-10-09T08:14:19.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:14:19.414 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_04_00_UTC) 2023-10-09T08:14:19.496 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_05_00_UTC 2023-10-09T08:14:19.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:14:19.496 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_05_00_UTC) 2023-10-09T08:14:19.578 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_06_00_UTC 2023-10-09T08:14:19.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:14:19.579 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_06_00_UTC) 2023-10-09T08:14:19.661 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_07_00_UTC 2023-10-09T08:14:19.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:14:19.662 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_07_00_UTC) 2023-10-09T08:14:19.743 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_08_00_UTC 2023-10-09T08:14:19.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:14:19.744 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_08_00_UTC) 2023-10-09T08:14:19.825 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_09_00_UTC 2023-10-09T08:14:19.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:14:19.826 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_09_00_UTC) 2023-10-09T08:14:19.908 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_10_00_UTC 2023-10-09T08:14:19.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:14:19.908 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_10_00_UTC) 2023-10-09T08:14:19.989 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_11_00_UTC 2023-10-09T08:14:19.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:14:19.990 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_11_00_UTC) 2023-10-09T08:14:20.071 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_12_00_UTC 2023-10-09T08:14:20.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:14:20.072 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_12_00_UTC) 2023-10-09T08:14:20.153 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_13_00_UTC 2023-10-09T08:14:20.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:14:20.153 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_13_00_UTC) 2023-10-09T08:14:20.235 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_14_00_UTC 2023-10-09T08:14:20.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:14:20.235 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-08_14_00_UTC) 2023-10-09T08:14:20.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:14:20.318 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart) 2023-10-09T08:14:20.397 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-09T08:14:20.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.618+0000 7ff981dff700 1 Processor -- start 2023-10-09T08:14:20.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.618+0000 7ff981dff700 1 -- start start 2023-10-09T08:14:20.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.619+0000 7ff981dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff97c155eb0 0x7ff97c06e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:20.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.619+0000 7ff981dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff97c0c70b0 0x7ff97c069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:20.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.619+0000 7ff981dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff97c06eb90 con 0x7ff97c069cb0 2023-10-09T08:14:20.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.619+0000 7ff981dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff97c06a130 con 0x7ff97c0c70b0 2023-10-09T08:14:20.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.619+0000 7ff981dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c06ee70 con 0x7ff97c155eb0 2023-10-09T08:14:20.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.620+0000 7ff97affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff97c0c70b0 0x7ff97c069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:20.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.620+0000 7ff97affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff97c0c70b0 0x7ff97c069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58234/0 (socket says 172.21.15.71:58234) 2023-10-09T08:14:20.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.620+0000 7ff97affd700 1 -- 172.21.15.71:0/1727087906 learned_addr learned my addr 172.21.15.71:0/1727087906 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:20.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.620+0000 7ff97b7fe700 1 --2- 172.21.15.71:0/1727087906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff97c155eb0 0x7ff97c06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:20.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.620+0000 7ff97affd700 1 -- 172.21.15.71:0/1727087906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff97c155eb0 msgr2=0x7ff97c06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:20.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.620+0000 7ff97affd700 1 --2- 172.21.15.71:0/1727087906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff97c155eb0 0x7ff97c06e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:20.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.620+0000 7ff97affd700 1 -- 172.21.15.71:0/1727087906 >> v1:172.21.15.179:6789/0 conn(0x7ff97c069cb0 legacy=0x7ff97c159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:20.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.620+0000 7ff97affd700 1 -- 172.21.15.71:0/1727087906 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c06f150 con 0x7ff97c0c70b0 2023-10-09T08:14:20.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.620+0000 7ff97affd700 1 --2- 172.21.15.71:0/1727087906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff97c0c70b0 0x7ff97c069770 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7ff9700099b0 tx=0x7ff970009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0df5f098e36ab93 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:20.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.620+0000 7ff97a7fc700 1 -- 172.21.15.71:0/1727087906 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97000b820 con 0x7ff97c0c70b0 2023-10-09T08:14:20.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.621+0000 7ff97a7fc700 1 -- 172.21.15.71:0/1727087906 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97000b980 con 0x7ff97c0c70b0 2023-10-09T08:14:20.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.621+0000 7ff97a7fc700 1 -- 172.21.15.71:0/1727087906 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97000bd20 con 0x7ff97c0c70b0 2023-10-09T08:14:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.621+0000 7ff981dff700 1 -- 172.21.15.71:0/1727087906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff97c0c70b0 msgr2=0x7ff97c069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.621+0000 7ff981dff700 1 --2- 172.21.15.71:0/1727087906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff97c0c70b0 0x7ff97c069770 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7ff9700099b0 tx=0x7ff970009250 comp rx=0 tx=0).stop 2023-10-09T08:14:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.621+0000 7ff981dff700 1 -- 172.21.15.71:0/1727087906 shutdown_connections 2023-10-09T08:14:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.621+0000 7ff981dff700 1 --2- 172.21.15.71:0/1727087906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff97c155eb0 0x7ff97c06e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.621+0000 7ff981dff700 1 --2- 172.21.15.71:0/1727087906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff97c0c70b0 0x7ff97c069770 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.621+0000 7ff981dff700 1 -- 172.21.15.71:0/1727087906 >> 172.21.15.71:0/1727087906 conn(0x7ff97c068e10 msgr2=0x7ff97c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.621+0000 7ff981dff700 1 -- 172.21.15.71:0/1727087906 shutdown_connections 2023-10-09T08:14:20.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.621+0000 7ff981dff700 1 -- 172.21.15.71:0/1727087906 wait complete. 2023-10-09T08:14:20.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.623+0000 7ff981dff700 1 Processor -- start 2023-10-09T08:14:20.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.623+0000 7ff981dff700 1 -- start start 2023-10-09T08:14:20.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.624+0000 7ff981dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff97c069cb0 0x7ff97c140bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:20.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.624+0000 7ff981dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff97c0c70b0 0x7ff97c0b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:20.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.624+0000 7ff981dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff97c155eb0 0x7ff97c0b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:20.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.624+0000 7ff981dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c153820 con 0x7ff97c069cb0 2023-10-09T08:14:20.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.624+0000 7ff981dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c0c3710 con 0x7ff97c155eb0 2023-10-09T08:14:20.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.624+0000 7ff981dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c0b1930 con 0x7ff97c0c70b0 2023-10-09T08:14:20.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.624+0000 7ff97b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff97c069cb0 0x7ff97c140bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:20.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.624+0000 7ff97b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff97c069cb0 0x7ff97c140bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58242/0 (socket says 172.21.15.71:58242) 2023-10-09T08:14:20.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.624+0000 7ff97b7fe700 1 -- 172.21.15.71:0/2397068575 learned_addr learned my addr 172.21.15.71:0/2397068575 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:20.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.624+0000 7ff97affd700 1 --2- 172.21.15.71:0/2397068575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff97c0c70b0 0x7ff97c0b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:20.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.624+0000 7ff97bfff700 1 --2- 172.21.15.71:0/2397068575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff97c155eb0 0x7ff97c0b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:20.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.624+0000 7ff97b7fe700 1 -- 172.21.15.71:0/2397068575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff97c0c70b0 msgr2=0x7ff97c0b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:20.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.624+0000 7ff97b7fe700 1 --2- 172.21.15.71:0/2397068575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff97c0c70b0 0x7ff97c0b0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:20.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.624+0000 7ff97b7fe700 1 -- 172.21.15.71:0/2397068575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff97c155eb0 msgr2=0x7ff97c0b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:20.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.624+0000 7ff97b7fe700 1 --2- 172.21.15.71:0/2397068575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff97c155eb0 0x7ff97c0b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:20.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.624+0000 7ff97b7fe700 1 -- 172.21.15.71:0/2397068575 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9700094f0 con 0x7ff97c069cb0 2023-10-09T08:14:20.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.625+0000 7ff97b7fe700 1 --2- 172.21.15.71:0/2397068575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff97c069cb0 0x7ff97c140bf0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00d860 tx=0x7ff96c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:20.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.625+0000 7ff9637fe700 1 -- 172.21.15.71:0/2397068575 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c0125f0 con 0x7ff97c069cb0 2023-10-09T08:14:20.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.625+0000 7ff9637fe700 1 -- 172.21.15.71:0/2397068575 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96c012750 con 0x7ff97c069cb0 2023-10-09T08:14:20.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.625+0000 7ff9637fe700 1 -- 172.21.15.71:0/2397068575 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c012b10 con 0x7ff97c069cb0 2023-10-09T08:14:20.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.625+0000 7ff981dff700 1 -- 172.21.15.71:0/2397068575 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97c0b1c10 con 0x7ff97c069cb0 2023-10-09T08:14:20.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.625+0000 7ff981dff700 1 -- 172.21.15.71:0/2397068575 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff97c0b21d0 con 0x7ff97c069cb0 2023-10-09T08:14:20.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.626+0000 7ff981dff700 1 -- 172.21.15.71:0/2397068575 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97c04c3c0 con 0x7ff97c069cb0 2023-10-09T08:14:20.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.627+0000 7ff9637fe700 1 -- 172.21.15.71:0/2397068575 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 87) v1 ==== 84871+0+0 (secure 0 0 0) 0x7ff96c01e460 con 0x7ff97c069cb0 2023-10-09T08:14:20.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.628+0000 7ff9637fe700 1 --2- 172.21.15.71:0/2397068575 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff9680670a0 0x7ff968069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:20.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.628+0000 7ff9637fe700 1 -- 172.21.15.71:0/2397068575 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6714+0+0 (secure 0 0 0) 0x7ff96c085260 con 0x7ff97c069cb0 2023-10-09T08:14:20.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.628+0000 7ff97affd700 1 --2- 172.21.15.71:0/2397068575 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff9680670a0 0x7ff968069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:20.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.629+0000 7ff97affd700 1 --2- 172.21.15.71:0/2397068575 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff9680670a0 0x7ff968069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff9700099b0 tx=0x7ff970016000 comp rx=0 tx=0).ready entity=mgr.8896 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:20.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.632+0000 7ff9637fe700 1 -- 172.21.15.71:0/2397068575 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff96c0559c0 con 0x7ff97c069cb0 2023-10-09T08:14:20.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.876+0000 7ff981dff700 1 -- 172.21.15.71:0/2397068575 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7ff97c06f430 con 0x7ff97c069cb0 2023-10-09T08:14:20.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.906+0000 7ff9637fe700 1 -- 172.21.15.71:0/2397068575 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 88) v1 ==== 84854+0+0 (secure 0 0 0) 0x7ff96c052300 con 0x7ff97c069cb0 2023-10-09T08:14:20.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.907+0000 7ff9637fe700 1 -- 172.21.15.71:0/2397068575 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v88) v1 ==== 93+0+0 (secure 0 0 0) 0x7ff96c0559c0 con 0x7ff97c069cb0 2023-10-09T08:14:20.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.910+0000 7ff981dff700 1 -- 172.21.15.71:0/2397068575 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff9680670a0 msgr2=0x7ff968069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:20.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.910+0000 7ff981dff700 1 --2- 172.21.15.71:0/2397068575 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff9680670a0 0x7ff968069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff9700099b0 tx=0x7ff970016000 comp rx=0 tx=0).stop 2023-10-09T08:14:20.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.910+0000 7ff981dff700 1 -- 172.21.15.71:0/2397068575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff97c069cb0 msgr2=0x7ff97c140bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:20.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.910+0000 7ff981dff700 1 --2- 172.21.15.71:0/2397068575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff97c069cb0 0x7ff97c140bf0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00d860 tx=0x7ff96c008040 comp rx=0 tx=0).stop 2023-10-09T08:14:20.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.910+0000 7ff981dff700 1 -- 172.21.15.71:0/2397068575 shutdown_connections 2023-10-09T08:14:20.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.910+0000 7ff981dff700 1 --2- 172.21.15.71:0/2397068575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff97c155eb0 0x7ff97c0b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:20.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.910+0000 7ff981dff700 1 --2- 172.21.15.71:0/2397068575 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff9680670a0 0x7ff968069550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:20.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.910+0000 7ff981dff700 1 --2- 172.21.15.71:0/2397068575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff97c069cb0 0x7ff97c140bf0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:20.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.910+0000 7ff981dff700 1 --2- 172.21.15.71:0/2397068575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff97c0c70b0 0x7ff97c0b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:20.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.910+0000 7ff981dff700 1 -- 172.21.15.71:0/2397068575 >> 172.21.15.71:0/2397068575 conn(0x7ff97c068e10 msgr2=0x7ff97c0c9530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:20.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.910+0000 7ff981dff700 1 -- 172.21.15.71:0/2397068575 shutdown_connections 2023-10-09T08:14:20.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:20.910+0000 7ff981dff700 1 -- 172.21.15.71:0/2397068575 wait complete. 2023-10-09T08:14:20.929 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T08:14:20.929 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T08:14:21.015 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T08:14:21.092 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T08:14:21.092 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T08:14:21.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:14:21.092 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T08:14:21.178 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T08:14:21.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:14:21.178 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T08:14:21.218 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T08:14:21.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.445+0000 7ff63099d700 1 Processor -- start 2023-10-09T08:14:21.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.445+0000 7ff63099d700 1 -- start start 2023-10-09T08:14:21.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.446+0000 7ff63099d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff62c0b02a0 0x7ff62c15bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:21.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.446+0000 7ff63099d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff62c06ae70 con 0x7ff62c06d950 2023-10-09T08:14:21.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.446+0000 7ff63099d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff62c0c8a60 con 0x7ff62c06a0a0 2023-10-09T08:14:21.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.446+0000 7ff63099d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff62c06a540 con 0x7ff62c0b02a0 2023-10-09T08:14:21.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.446+0000 7ff62bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff62c0b02a0 0x7ff62c15bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:21.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.446+0000 7ff62b7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff62c06d950 0x7ff62c0c8350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48598/0 (socket says 172.21.15.71:48598) 2023-10-09T08:14:21.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.446+0000 7ff62b7fe700 1 -- 172.21.15.71:0/1619798678 learned_addr learned my addr 172.21.15.71:0/1619798678 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:21.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.447+0000 7ff62a7fc700 1 -- 172.21.15.71:0/1619798678 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1449722984 0 0) 0x7ff62c06ae70 con 0x7ff62c06d950 2023-10-09T08:14:21.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.447+0000 7ff62bfff700 1 -- 172.21.15.71:0/1619798678 >> v1:172.21.15.179:6789/0 conn(0x7ff62c06a0a0 legacy=0x7ff62c15b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:21.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.447+0000 7ff62bfff700 1 -- 172.21.15.71:0/1619798678 >> v1:172.21.15.71:6789/0 conn(0x7ff62c06d950 legacy=0x7ff62c0c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:21.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.447+0000 7ff62bfff700 1 -- 172.21.15.71:0/1619798678 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62c06a820 con 0x7ff62c0b02a0 2023-10-09T08:14:21.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.447+0000 7ff62bfff700 1 --2- 172.21.15.71:0/1619798678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff62c0b02a0 0x7ff62c15bb20 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7ff624009e60 tx=0x7ff624009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1bbc853d7f38b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:21.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.447+0000 7ff62a7fc700 1 -- 172.21.15.71:0/1619798678 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62400e070 con 0x7ff62c0b02a0 2023-10-09T08:14:21.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.447+0000 7ff62a7fc700 1 -- 172.21.15.71:0/1619798678 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62400bc30 con 0x7ff62c0b02a0 2023-10-09T08:14:21.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.447+0000 7ff62a7fc700 1 -- 172.21.15.71:0/1619798678 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff624012430 con 0x7ff62c0b02a0 2023-10-09T08:14:21.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.448+0000 7ff63099d700 1 -- 172.21.15.71:0/1619798678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff62c0b02a0 msgr2=0x7ff62c15bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:21.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.448+0000 7ff63099d700 1 --2- 172.21.15.71:0/1619798678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff62c0b02a0 0x7ff62c15bb20 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7ff624009e60 tx=0x7ff624009780 comp rx=0 tx=0).stop 2023-10-09T08:14:21.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.448+0000 7ff63099d700 1 -- 172.21.15.71:0/1619798678 shutdown_connections 2023-10-09T08:14:21.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.448+0000 7ff63099d700 1 --2- 172.21.15.71:0/1619798678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff62c0b02a0 0x7ff62c15bb20 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:21.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.448+0000 7ff63099d700 1 -- 172.21.15.71:0/1619798678 >> 172.21.15.71:0/1619798678 conn(0x7ff62c0cc1f0 msgr2=0x7ff62c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:21.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.448+0000 7ff63099d700 1 -- 172.21.15.71:0/1619798678 shutdown_connections 2023-10-09T08:14:21.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.448+0000 7ff63099d700 1 -- 172.21.15.71:0/1619798678 wait complete. 2023-10-09T08:14:21.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.450+0000 7ff63099d700 1 Processor -- start 2023-10-09T08:14:21.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.450+0000 7ff63099d700 1 -- start start 2023-10-09T08:14:21.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.451+0000 7ff63099d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff62c06a0a0 0x7ff62c0b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:21.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.451+0000 7ff63099d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff62c06d950 0x7ff62c14bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:21.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.451+0000 7ff63099d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff62c0b02a0 0x7ff62c14c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:21.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.451+0000 7ff63099d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c0c9ff0 con 0x7ff62c06a0a0 2023-10-09T08:14:21.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.451+0000 7ff63099d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c0c5210 con 0x7ff62c06d950 2023-10-09T08:14:21.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.451+0000 7ff63099d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c0c54f0 con 0x7ff62c0b02a0 2023-10-09T08:14:21.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.451+0000 7ff62b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff62c06a0a0 0x7ff62c0b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:21.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.451+0000 7ff62b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff62c06a0a0 0x7ff62c0b16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58278/0 (socket says 172.21.15.71:58278) 2023-10-09T08:14:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.451+0000 7ff62b7fe700 1 -- 172.21.15.71:0/484630276 learned_addr learned my addr 172.21.15.71:0/484630276 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.451+0000 7ff62affd700 1 --2- 172.21.15.71:0/484630276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff62c06d950 0x7ff62c14bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.451+0000 7ff62bfff700 1 --2- 172.21.15.71:0/484630276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff62c0b02a0 0x7ff62c14c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.451+0000 7ff62b7fe700 1 -- 172.21.15.71:0/484630276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff62c0b02a0 msgr2=0x7ff62c14c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.451+0000 7ff62b7fe700 1 --2- 172.21.15.71:0/484630276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff62c0b02a0 0x7ff62c14c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.451+0000 7ff62b7fe700 1 -- 172.21.15.71:0/484630276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff62c06d950 msgr2=0x7ff62c14bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.451+0000 7ff62b7fe700 1 --2- 172.21.15.71:0/484630276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff62c06d950 0x7ff62c14bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.452+0000 7ff62b7fe700 1 -- 172.21.15.71:0/484630276 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff624009a20 con 0x7ff62c06a0a0 2023-10-09T08:14:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.452+0000 7ff62b7fe700 1 --2- 172.21.15.71:0/484630276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff62c06a0a0 0x7ff62c0b16f0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7ff61c00c7e0 tx=0x7ff61c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.452+0000 7ff6137fe700 1 -- 172.21.15.71:0/484630276 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61c005b30 con 0x7ff62c06a0a0 2023-10-09T08:14:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.452+0000 7ff6137fe700 1 -- 172.21.15.71:0/484630276 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61c005c90 con 0x7ff62c06a0a0 2023-10-09T08:14:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.452+0000 7ff63099d700 1 -- 172.21.15.71:0/484630276 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff62c0c57d0 con 0x7ff62c06a0a0 2023-10-09T08:14:21.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.452+0000 7ff6137fe700 1 -- 172.21.15.71:0/484630276 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61c007300 con 0x7ff62c06a0a0 2023-10-09T08:14:21.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.452+0000 7ff63099d700 1 -- 172.21.15.71:0/484630276 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff62c0c44c0 con 0x7ff62c06a0a0 2023-10-09T08:14:21.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.453+0000 7ff63099d700 1 -- 172.21.15.71:0/484630276 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff62c0c9dc0 con 0x7ff62c06a0a0 2023-10-09T08:14:21.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.454+0000 7ff6137fe700 1 -- 172.21.15.71:0/484630276 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 88) v1 ==== 84854+0+0 (secure 0 0 0) 0x7ff61c01b3b0 con 0x7ff62c06a0a0 2023-10-09T08:14:21.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.455+0000 7ff6137fe700 1 --2- 172.21.15.71:0/484630276 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff618067050 0x7ff618069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:21.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.455+0000 7ff6137fe700 1 -- 172.21.15.71:0/484630276 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6714+0+0 (secure 0 0 0) 0x7ff61c0840f0 con 0x7ff62c06a0a0 2023-10-09T08:14:21.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.455+0000 7ff62affd700 1 -- 172.21.15.71:0/484630276 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff618067050 msgr2=0x7ff618069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:21.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.455+0000 7ff62affd700 1 --2- 172.21.15.71:0/484630276 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff618067050 0x7ff618069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:14:21.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.459+0000 7ff6137fe700 1 -- 172.21.15.71:0/484630276 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff62c0c9dc0 con 0x7ff62c06a0a0 2023-10-09T08:14:21.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.656+0000 7ff62affd700 1 -- 172.21.15.71:0/484630276 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff618067050 msgr2=0x7ff618069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:21.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.656+0000 7ff62affd700 1 --2- 172.21.15.71:0/484630276 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff618067050 0x7ff618069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:14:21.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.705+0000 7ff63099d700 1 -- 172.21.15.71:0/484630276 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff62c0c9dc0 con 0x7ff62c06a0a0 2023-10-09T08:14:21.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.705+0000 7ff6137fe700 1 -- 172.21.15.71:0/484630276 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4604 (secure 0 0 0) 0x7ff62c0c9dc0 con 0x7ff62c06a0a0 2023-10-09T08:14:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:14:21.706 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/845996701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":845996701},{"type":"v1","addr":"172.21.15.179:6834","nonce":845996701}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8683,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2670735121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2670735121},{"type":"v1","addr":"172.21.15.179:6836","nonce":2670735121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":9084,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/2448704931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2448704931},{"type":"v1","addr":"172.21.15.71:6834","nonce":2448704931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:58:23.490596+0000","modified":"2023-10-09T07:58:27.045250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9087},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9087":{"gid":9087,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/1497898467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":1497898467},{"type":"v1","addr":"172.21.15.71:6835","nonce":1497898467}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T08:14:21.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.707+0000 7ff63099d700 1 -- 172.21.15.71:0/484630276 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff618067050 msgr2=0x7ff618069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:14:21.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.707+0000 7ff63099d700 1 --2- 172.21.15.71:0/484630276 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff618067050 0x7ff618069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:21.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.707+0000 7ff63099d700 1 -- 172.21.15.71:0/484630276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff62c06a0a0 msgr2=0x7ff62c0b16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:21.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.707+0000 7ff63099d700 1 --2- 172.21.15.71:0/484630276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff62c06a0a0 0x7ff62c0b16f0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7ff61c00c7e0 tx=0x7ff61c007df0 comp rx=0 tx=0).stop 2023-10-09T08:14:21.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.708+0000 7ff63099d700 1 -- 172.21.15.71:0/484630276 shutdown_connections 2023-10-09T08:14:21.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.708+0000 7ff63099d700 1 --2- 172.21.15.71:0/484630276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff62c0b02a0 0x7ff62c14c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:21.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.708+0000 7ff63099d700 1 --2- 172.21.15.71:0/484630276 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff618067050 0x7ff618069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:21.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.708+0000 7ff63099d700 1 --2- 172.21.15.71:0/484630276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff62c06a0a0 0x7ff62c0b16f0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:21.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.708+0000 7ff63099d700 1 --2- 172.21.15.71:0/484630276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff62c06d950 0x7ff62c14bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:21.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.708+0000 7ff63099d700 1 -- 172.21.15.71:0/484630276 >> 172.21.15.71:0/484630276 conn(0x7ff62c0cc1f0 msgr2=0x7ff62c0c7490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:21.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.708+0000 7ff63099d700 1 -- 172.21.15.71:0/484630276 shutdown_connections 2023-10-09T08:14:21.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.708+0000 7ff63099d700 1 -- 172.21.15.71:0/484630276 wait complete. 2023-10-09T08:14:21.710 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 82 2023-10-09T08:14:21.727 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T08:14:21.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.911+0000 7fcb2179d700 1 Processor -- start 2023-10-09T08:14:21.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.911+0000 7fcb2179d700 1 -- start start 2023-10-09T08:14:21.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.912+0000 7fcb2179d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcb1c156310 0x7fcb1c0c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:21.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.912+0000 7fcb2179d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb1c1566e0 0x7fcb1c0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:21.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.912+0000 7fcb2179d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcb1c0ca300 0x7fcb1c0ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:21.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.912+0000 7fcb2179d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb1c0ca860 con 0x7fcb1c156310 2023-10-09T08:14:21.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.912+0000 7fcb2179d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb1c0cab40 con 0x7fcb1c0ca300 2023-10-09T08:14:21.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.912+0000 7fcb2179d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c0cae20 con 0x7fcb1c1566e0 2023-10-09T08:14:21.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.913+0000 7fcb1bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcb1c156310 0x7fcb1c0c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:21.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.913+0000 7fcb1bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcb1c156310 0x7fcb1c0c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58294/0 (socket says 172.21.15.71:58294) 2023-10-09T08:14:21.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.913+0000 7fcb1bfff700 1 -- 172.21.15.71:0/2740095812 learned_addr learned my addr 172.21.15.71:0/2740095812 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:21.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.913+0000 7fcb1b7fe700 1 --2- 172.21.15.71:0/2740095812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb1c1566e0 0x7fcb1c0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:21.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.913+0000 7fcb20f9c700 1 --2- 172.21.15.71:0/2740095812 >> v2:172.21.15.179:3300/0 conn(0x7fcb1c0ca300 0x7fcb1c0ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.913+0000 7fcb1bfff700 1 -- 172.21.15.71:0/2740095812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb1c1566e0 msgr2=0x7fcb1c0ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.913+0000 7fcb1bfff700 1 --2- 172.21.15.71:0/2740095812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb1c1566e0 0x7fcb1c0ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.913+0000 7fcb1bfff700 1 -- 172.21.15.71:0/2740095812 >> v2:172.21.15.179:3300/0 conn(0x7fcb1c0ca300 msgr2=0x7fcb1c0ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.913+0000 7fcb1bfff700 1 --2- 172.21.15.71:0/2740095812 >> v2:172.21.15.179:3300/0 conn(0x7fcb1c0ca300 0x7fcb1c0ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.913+0000 7fcb1bfff700 1 -- 172.21.15.71:0/2740095812 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1c0cb100 con 0x7fcb1c156310 2023-10-09T08:14:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.914+0000 7fcb1bfff700 1 --2- 172.21.15.71:0/2740095812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb1c156310 0x7fcb1c0c9dc0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c06f970 tx=0x7fcb0c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712c866a7fa9169e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.914+0000 7fcb1affd700 1 -- 172.21.15.71:0/2740095812 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c00db40 con 0x7fcb1c156310 2023-10-09T08:14:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.914+0000 7fcb1affd700 1 -- 172.21.15.71:0/2740095812 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0c00dca0 con 0x7fcb1c156310 2023-10-09T08:14:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.914+0000 7fcb1affd700 1 -- 172.21.15.71:0/2740095812 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c0196b0 con 0x7fcb1c156310 2023-10-09T08:14:21.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.914+0000 7fcb2179d700 1 -- 172.21.15.71:0/2740095812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb1c156310 msgr2=0x7fcb1c0c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:21.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.914+0000 7fcb2179d700 1 --2- 172.21.15.71:0/2740095812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb1c156310 0x7fcb1c0c9dc0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c06f970 tx=0x7fcb0c00b4f0 comp rx=0 tx=0).stop 2023-10-09T08:14:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.914+0000 7fcb2179d700 1 -- 172.21.15.71:0/2740095812 shutdown_connections 2023-10-09T08:14:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.914+0000 7fcb2179d700 1 --2- 172.21.15.71:0/2740095812 >> v2:172.21.15.179:3300/0 conn(0x7fcb1c0ca300 0x7fcb1c0ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.914+0000 7fcb2179d700 1 --2- 172.21.15.71:0/2740095812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb1c156310 0x7fcb1c0c9dc0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.914+0000 7fcb2179d700 1 --2- 172.21.15.71:0/2740095812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb1c1566e0 0x7fcb1c0ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.914+0000 7fcb2179d700 1 -- 172.21.15.71:0/2740095812 >> 172.21.15.71:0/2740095812 conn(0x7fcb1c0cc1f0 msgr2=0x7fcb1c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.915+0000 7fcb2179d700 1 -- 172.21.15.71:0/2740095812 shutdown_connections 2023-10-09T08:14:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.915+0000 7fcb2179d700 1 -- 172.21.15.71:0/2740095812 wait complete. 2023-10-09T08:14:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.916+0000 7fcb2179d700 1 Processor -- start 2023-10-09T08:14:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.916+0000 7fcb2179d700 1 -- start start 2023-10-09T08:14:21.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.917+0000 7fcb2179d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb1c0ca300 0x7fcb1c0c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:21.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.917+0000 7fcb2179d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb1c156310 0x7fcb1c166530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:21.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.917+0000 7fcb2179d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb1c1566e0 0x7fcb1c0acc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:21.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.917+0000 7fcb2179d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c166a70 con 0x7fcb1c1566e0 2023-10-09T08:14:21.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.917+0000 7fcb2179d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c166cf0 con 0x7fcb1c156310 2023-10-09T08:14:21.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.917+0000 7fcb2179d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c0c39a0 con 0x7fcb1c0ca300 2023-10-09T08:14:21.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.917+0000 7fcb20f9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb1c1566e0 0x7fcb1c0acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:21.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.917+0000 7fcb1bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb1c0ca300 0x7fcb1c0c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:21.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.917+0000 7fcb20f9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb1c1566e0 0x7fcb1c0acc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58308/0 (socket says 172.21.15.71:58308) 2023-10-09T08:14:21.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.917+0000 7fcb20f9c700 1 -- 172.21.15.71:0/1154146535 learned_addr learned my addr 172.21.15.71:0/1154146535 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:21.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.917+0000 7fcb1b7fe700 1 --2- 172.21.15.71:0/1154146535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb1c156310 0x7fcb1c166530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:21.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.918+0000 7fcb20f9c700 1 -- 172.21.15.71:0/1154146535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb1c0ca300 msgr2=0x7fcb1c0c32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:21.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.918+0000 7fcb20f9c700 1 --2- 172.21.15.71:0/1154146535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb1c0ca300 0x7fcb1c0c32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:21.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.918+0000 7fcb20f9c700 1 -- 172.21.15.71:0/1154146535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb1c156310 msgr2=0x7fcb1c166530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:21.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.918+0000 7fcb20f9c700 1 --2- 172.21.15.71:0/1154146535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb1c156310 0x7fcb1c166530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:21.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.918+0000 7fcb20f9c700 1 -- 172.21.15.71:0/1154146535 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0c00b790 con 0x7fcb1c1566e0 2023-10-09T08:14:21.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.918+0000 7fcb20f9c700 1 --2- 172.21.15.71:0/1154146535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb1c1566e0 0x7fcb1c0acc70 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fcb14009df0 tx=0x7fcb1400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:21.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.918+0000 7fcb03fff700 1 -- 172.21.15.71:0/1154146535 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1400caa0 con 0x7fcb1c1566e0 2023-10-09T08:14:21.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.918+0000 7fcb03fff700 1 -- 172.21.15.71:0/1154146535 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1400f040 con 0x7fcb1c1566e0 2023-10-09T08:14:21.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.918+0000 7fcb2179d700 1 -- 172.21.15.71:0/1154146535 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb1c0c3c80 con 0x7fcb1c1566e0 2023-10-09T08:14:21.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.918+0000 7fcb03fff700 1 -- 172.21.15.71:0/1154146535 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1400ce70 con 0x7fcb1c1566e0 2023-10-09T08:14:21.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.918+0000 7fcb2179d700 1 -- 172.21.15.71:0/1154146535 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb1c0c4240 con 0x7fcb1c1566e0 2023-10-09T08:14:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.919+0000 7fcb2179d700 1 -- 172.21.15.71:0/1154146535 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb1c166e80 con 0x7fcb1c1566e0 2023-10-09T08:14:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.920+0000 7fcb03fff700 1 -- 172.21.15.71:0/1154146535 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 88) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fcb14014690 con 0x7fcb1c1566e0 2023-10-09T08:14:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.921+0000 7fcb03fff700 1 --2- 172.21.15.71:0/1154146535 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fcb08067050 0x7fcb08069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.921+0000 7fcb03fff700 1 -- 172.21.15.71:0/1154146535 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6714+0+0 (secure 0 0 0) 0x7fcb14085460 con 0x7fcb1c1566e0 2023-10-09T08:14:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.921+0000 7fcb1bfff700 1 -- 172.21.15.71:0/1154146535 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fcb08067050 msgr2=0x7fcb08069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.921+0000 7fcb1bfff700 1 --2- 172.21.15.71:0/1154146535 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fcb08067050 0x7fcb08069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:14:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:21.925+0000 7fcb03fff700 1 -- 172.21.15.71:0/1154146535 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb14055ab0 con 0x7fcb1c1566e0 2023-10-09T08:14:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.122+0000 7fcb1bfff700 1 -- 172.21.15.71:0/1154146535 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fcb08067050 msgr2=0x7fcb08069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.122+0000 7fcb1bfff700 1 --2- 172.21.15.71:0/1154146535 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fcb08067050 0x7fcb08069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:14:22.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.127+0000 7fcb2179d700 1 -- 172.21.15.71:0/1154146535 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb1c04c3c0 con 0x7fcb1c1566e0 2023-10-09T08:14:22.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.128+0000 7fcb03fff700 1 -- 172.21.15.71:0/1154146535 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+16873 (secure 0 0 0) 0x7fcb14055640 con 0x7fcb1c1566e0 2023-10-09T08:14:22.129 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:14:22.129 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":180,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T08:09:23.494294+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:58:21.144208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T07:58:22.473710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.12","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:0/975761648":"2023-10-10T08:09:23.494246+0000","172.21.15.179:0/3488491397":"2023-10-10T08:09:23.494246+0000","172.21.15.179:0/1844939615":"2023-10-10T08:09:23.494246+0000","172.21.15.179:0/2466406124":"2023-10-10T07:58:43.731196+0000","172.21.15.179:0/2942596736":"2023-10-10T08:09:23.494246+0000","172.21.15.179:0/566158543":"2023-10-10T07:58:43.731196+0000","172.21.15.179:6837/85452":"2023-10-10T07:58:43.731196+0000","172.21.15.179:0/2282437587":"2023-10-10T08:09:23.494246+0000","172.21.15.179:6835/85452":"2023-10-10T07:58:43.731196+0000","172.21.15.179:0/1809359224":"2023-10-10T07:58:43.731196+0000","172.21.15.179:0/3234455519":"2023-10-10T08:09:23.494246+0000","172.21.15.179:0/2151068476":"2023-10-10T07:58:43.731196+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T08:14:22.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.130+0000 7fcb2179d700 1 -- 172.21.15.71:0/1154146535 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fcb08067050 msgr2=0x7fcb08069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:14:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.130+0000 7fcb2179d700 1 --2- 172.21.15.71:0/1154146535 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fcb08067050 0x7fcb08069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.130+0000 7fcb2179d700 1 -- 172.21.15.71:0/1154146535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb1c1566e0 msgr2=0x7fcb1c0acc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.130+0000 7fcb2179d700 1 --2- 172.21.15.71:0/1154146535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb1c1566e0 0x7fcb1c0acc70 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fcb14009df0 tx=0x7fcb1400b040 comp rx=0 tx=0).stop 2023-10-09T08:14:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.130+0000 7fcb2179d700 1 -- 172.21.15.71:0/1154146535 shutdown_connections 2023-10-09T08:14:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.130+0000 7fcb2179d700 1 --2- 172.21.15.71:0/1154146535 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fcb08067050 0x7fcb08069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.130+0000 7fcb2179d700 1 --2- 172.21.15.71:0/1154146535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb1c1566e0 0x7fcb1c0acc70 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.130+0000 7fcb2179d700 1 --2- 172.21.15.71:0/1154146535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb1c0ca300 0x7fcb1c0c32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.130+0000 7fcb2179d700 1 --2- 172.21.15.71:0/1154146535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb1c156310 0x7fcb1c166530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.130+0000 7fcb2179d700 1 -- 172.21.15.71:0/1154146535 >> 172.21.15.71:0/1154146535 conn(0x7fcb1c0cc1f0 msgr2=0x7fcb1c0c2370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.131+0000 7fcb2179d700 1 -- 172.21.15.71:0/1154146535 shutdown_connections 2023-10-09T08:14:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.131+0000 7fcb2179d700 1 -- 172.21.15.71:0/1154146535 wait complete. 2023-10-09T08:14:22.150 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T07:58:21.144208+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '175', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T07:58:22.473710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '176', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T08:14:22.150 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T08:14:22.195 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:22.195+0000 7ff035a68180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T08:14:22.242 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:22.241+0000 7fbd6bc36180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T08:14:22.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.339+0000 7fb881d9d700 1 Processor -- start 2023-10-09T08:14:22.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.339+0000 7fb881d9d700 1 -- start start 2023-10-09T08:14:22.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.340+0000 7fb881d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb87c0b4e70 0x7fb87c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:22.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.340+0000 7fb881d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb87c0b16d0 0x7fb87c0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:22.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.340+0000 7fb881d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb87c0b2080 con 0x7fb87c15d240 2023-10-09T08:14:22.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.340+0000 7fb881d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87c0cfb00 con 0x7fb87c0b4e70 2023-10-09T08:14:22.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.340+0000 7fb881d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c0b5c40 con 0x7fb87c0b16d0 2023-10-09T08:14:22.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.341+0000 7fb87bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb87c0b16d0 0x7fb87c0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:22.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.341+0000 7fb880d9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb87c0b4e70 0x7fb87c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:22.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.341+0000 7fb88159c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb87c15d240 0x7fb87c15d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:44050/0 (socket says 172.21.15.71:44050) 2023-10-09T08:14:22.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.341+0000 7fb88159c700 1 -- 172.21.15.71:0/2630485226 learned_addr learned my addr 172.21.15.71:0/2630485226 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:22.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.341+0000 7fb87b7fe700 1 -- 172.21.15.71:0/2630485226 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4061240086 0 0) 0x7fb87c0b2080 con 0x7fb87c15d240 2023-10-09T08:14:22.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.341+0000 7fb87b7fe700 1 -- 172.21.15.71:0/2630485226 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb86c003570 con 0x7fb87c15d240 2023-10-09T08:14:22.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.341+0000 7fb87bfff700 1 -- 172.21.15.71:0/2630485226 >> v2:172.21.15.179:3300/0 conn(0x7fb87c0b4e70 msgr2=0x7fb87c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:22.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.341+0000 7fb87bfff700 1 --2- 172.21.15.71:0/2630485226 >> v2:172.21.15.179:3300/0 conn(0x7fb87c0b4e70 0x7fb87c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.341+0000 7fb87bfff700 1 -- 172.21.15.71:0/2630485226 >> v1:172.21.15.179:6789/0 conn(0x7fb87c15d240 legacy=0x7fb87c15d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:22.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.341+0000 7fb87bfff700 1 -- 172.21.15.71:0/2630485226 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87c0b5f20 con 0x7fb87c0b16d0 2023-10-09T08:14:22.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.341+0000 7fb880d9b700 1 --2- 172.21.15.71:0/2630485226 >> v2:172.21.15.179:3300/0 conn(0x7fb87c0b4e70 0x7fb87c0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:14:22.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.342+0000 7fb87bfff700 1 --2- 172.21.15.71:0/2630485226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb87c0b16d0 0x7fb87c0b1b40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb8680098e0 tx=0x7fb8680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff8eae70e28617f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:22.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.342+0000 7fb87b7fe700 1 -- 172.21.15.71:0/2630485226 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb868011630 con 0x7fb87c0b16d0 2023-10-09T08:14:22.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.342+0000 7fb87b7fe700 1 -- 172.21.15.71:0/2630485226 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb868011790 con 0x7fb87c0b16d0 2023-10-09T08:14:22.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.342+0000 7fb87b7fe700 1 -- 172.21.15.71:0/2630485226 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb868011b30 con 0x7fb87c0b16d0 2023-10-09T08:14:22.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.342+0000 7fb881d9d700 1 -- 172.21.15.71:0/2630485226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb87c0b16d0 msgr2=0x7fb87c0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:22.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.342+0000 7fb881d9d700 1 --2- 172.21.15.71:0/2630485226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb87c0b16d0 0x7fb87c0b1b40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb8680098e0 tx=0x7fb8680091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.342+0000 7fb881d9d700 1 -- 172.21.15.71:0/2630485226 shutdown_connections 2023-10-09T08:14:22.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.342+0000 7fb881d9d700 1 --2- 172.21.15.71:0/2630485226 >> v2:172.21.15.179:3300/0 conn(0x7fb87c0b4e70 0x7fb87c0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.342+0000 7fb881d9d700 1 --2- 172.21.15.71:0/2630485226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb87c0b16d0 0x7fb87c0b1b40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.342+0000 7fb881d9d700 1 -- 172.21.15.71:0/2630485226 >> 172.21.15.71:0/2630485226 conn(0x7fb87c0d10c0 msgr2=0x7fb87c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:22.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.342+0000 7fb881d9d700 1 -- 172.21.15.71:0/2630485226 shutdown_connections 2023-10-09T08:14:22.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.342+0000 7fb881d9d700 1 -- 172.21.15.71:0/2630485226 wait complete. 2023-10-09T08:14:22.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.344+0000 7fb881d9d700 1 Processor -- start 2023-10-09T08:14:22.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.344+0000 7fb881d9d700 1 -- start start 2023-10-09T08:14:22.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.345+0000 7fb881d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb87c0b16d0 0x7fb87c150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:22.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.345+0000 7fb881d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb87c0b4e70 0x7fb87c0c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:22.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.345+0000 7fb881d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb87c15d240 0x7fb87c0c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:22.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.345+0000 7fb881d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c0c6ae0 con 0x7fb87c15d240 2023-10-09T08:14:22.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.345+0000 7fb881d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c0c5ed0 con 0x7fb87c0b4e70 2023-10-09T08:14:22.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.345+0000 7fb881d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c0c61b0 con 0x7fb87c0b16d0 2023-10-09T08:14:22.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.345+0000 7fb880d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb87c0b16d0 0x7fb87c150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:22.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.345+0000 7fb88159c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb87c15d240 0x7fb87c0c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:22.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.345+0000 7fb880d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb87c0b16d0 0x7fb87c150540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:42044/0 (socket says 172.21.15.71:42044) 2023-10-09T08:14:22.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.345+0000 7fb880d9b700 1 -- 172.21.15.71:0/1500196661 learned_addr learned my addr 172.21.15.71:0/1500196661 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:22.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.345+0000 7fb87bfff700 1 --2- 172.21.15.71:0/1500196661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb87c0b4e70 0x7fb87c0c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:22.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.346+0000 7fb880d9b700 1 -- 172.21.15.71:0/1500196661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb87c0b4e70 msgr2=0x7fb87c0c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:22.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.346+0000 7fb880d9b700 1 --2- 172.21.15.71:0/1500196661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb87c0b4e70 0x7fb87c0c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.346+0000 7fb880d9b700 1 -- 172.21.15.71:0/1500196661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb87c15d240 msgr2=0x7fb87c0c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:22.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.346+0000 7fb880d9b700 1 --2- 172.21.15.71:0/1500196661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb87c15d240 0x7fb87c0c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.346+0000 7fb880d9b700 1 -- 172.21.15.71:0/1500196661 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb870009420 con 0x7fb87c0b16d0 2023-10-09T08:14:22.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.346+0000 7fb87bfff700 1 --2- 172.21.15.71:0/1500196661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb87c0b4e70 0x7fb87c0c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:14:22.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.346+0000 7fb88159c700 1 --2- 172.21.15.71:0/1500196661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb87c15d240 0x7fb87c0c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:14:22.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.346+0000 7fb880d9b700 1 --2- 172.21.15.71:0/1500196661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb87c0b16d0 0x7fb87c150540 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb87000ec80 tx=0x7fb8700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:22.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.346+0000 7fb878ff9700 1 -- 172.21.15.71:0/1500196661 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87000c920 con 0x7fb87c0b16d0 2023-10-09T08:14:22.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.346+0000 7fb878ff9700 1 -- 172.21.15.71:0/1500196661 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87000ca80 con 0x7fb87c0b16d0 2023-10-09T08:14:22.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.346+0000 7fb881d9d700 1 -- 172.21.15.71:0/1500196661 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb868009420 con 0x7fb87c0b16d0 2023-10-09T08:14:22.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.346+0000 7fb878ff9700 1 -- 172.21.15.71:0/1500196661 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87000ce00 con 0x7fb87c0b16d0 2023-10-09T08:14:22.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.346+0000 7fb881d9d700 1 -- 172.21.15.71:0/1500196661 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87c0c6770 con 0x7fb87c0b16d0 2023-10-09T08:14:22.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.347+0000 7fb881d9d700 1 -- 172.21.15.71:0/1500196661 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb87c088990 con 0x7fb87c0b16d0 2023-10-09T08:14:22.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.349+0000 7fb878ff9700 1 -- 172.21.15.71:0/1500196661 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 88) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fb870005a00 con 0x7fb87c0b16d0 2023-10-09T08:14:22.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.349+0000 7fb878ff9700 1 --2- 172.21.15.71:0/1500196661 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb860067050 0x7fb860069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:22.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.349+0000 7fb878ff9700 1 -- 172.21.15.71:0/1500196661 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6714+0+0 (secure 0 0 0) 0x7fb870084fd0 con 0x7fb87c0b16d0 2023-10-09T08:14:22.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.350+0000 7fb87bfff700 1 -- 172.21.15.71:0/1500196661 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb860067050 msgr2=0x7fb860069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:22.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.350+0000 7fb87bfff700 1 --2- 172.21.15.71:0/1500196661 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb860067050 0x7fb860069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:14:22.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.353+0000 7fb878ff9700 1 -- 172.21.15.71:0/1500196661 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb870051d20 con 0x7fb87c0b16d0 2023-10-09T08:14:22.361 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:22.361+0000 7ff035a68180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T08:14:22.414 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:22.413+0000 7fbd6bc36180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T08:14:22.448 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:22.447+0000 7ff035a68180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T08:14:22.502 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:22.502+0000 7fbd6bc36180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T08:14:22.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.551+0000 7fb87bfff700 1 -- 172.21.15.71:0/1500196661 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb860067050 msgr2=0x7fb860069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:22.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.551+0000 7fb87bfff700 1 --2- 172.21.15.71:0/1500196661 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb860067050 0x7fb860069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:14:22.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.553+0000 7fb881d9d700 1 -- 172.21.15.71:0/1500196661 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb87c0c62f0 con 0x7fb87c0b16d0 2023-10-09T08:14:22.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.554+0000 7fb878ff9700 1 -- 172.21.15.71:0/1500196661 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v180) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb87c0c62f0 con 0x7fb87c0b16d0 2023-10-09T08:14:22.555 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T08:14:22.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.557+0000 7fb881d9d700 1 -- 172.21.15.71:0/1500196661 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb860067050 msgr2=0x7fb860069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:14:22.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.557+0000 7fb881d9d700 1 --2- 172.21.15.71:0/1500196661 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb860067050 0x7fb860069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.557+0000 7fb881d9d700 1 -- 172.21.15.71:0/1500196661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb87c0b16d0 msgr2=0x7fb87c150540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:22.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.557+0000 7fb881d9d700 1 --2- 172.21.15.71:0/1500196661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb87c0b16d0 0x7fb87c150540 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb87000ec80 tx=0x7fb8700091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.557+0000 7fb881d9d700 1 -- 172.21.15.71:0/1500196661 shutdown_connections 2023-10-09T08:14:22.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.557+0000 7fb881d9d700 1 --2- 172.21.15.71:0/1500196661 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb860067050 0x7fb860069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.557+0000 7fb881d9d700 1 --2- 172.21.15.71:0/1500196661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb87c15d240 0x7fb87c0c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.557+0000 7fb881d9d700 1 --2- 172.21.15.71:0/1500196661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb87c0b16d0 0x7fb87c150540 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.557+0000 7fb881d9d700 1 --2- 172.21.15.71:0/1500196661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb87c0b4e70 0x7fb87c0c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.557+0000 7fb881d9d700 1 -- 172.21.15.71:0/1500196661 >> 172.21.15.71:0/1500196661 conn(0x7fb87c0d10c0 msgr2=0x7fb87c0cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:22.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.557+0000 7fb881d9d700 1 -- 172.21.15.71:0/1500196661 shutdown_connections 2023-10-09T08:14:22.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.557+0000 7fb881d9d700 1 -- 172.21.15.71:0/1500196661 wait complete. 2023-10-09T08:14:22.577 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T08:14:22.673 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:22.673+0000 7ff035a68180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T08:14:22.737 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:22.736+0000 7fbd6bc36180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T08:14:22.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.764+0000 7f35a699d700 1 Processor -- start 2023-10-09T08:14:22.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.764+0000 7f35a699d700 1 -- start start 2023-10-09T08:14:22.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.765+0000 7f35a699d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a00b4e70 0x7f35a00ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:22.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.765+0000 7f35a699d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f35a00b16d0 0x7f35a00b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:22.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.765+0000 7f35a699d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f35a015d240 0x7f35a015d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.765+0000 7f35a699d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a00b2080 con 0x7f35a015d240 2023-10-09T08:14:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.765+0000 7f35a699d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a00cfb00 con 0x7f35a00b16d0 2023-10-09T08:14:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.765+0000 7f35a699d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00b5c40 con 0x7f35a00b4e70 2023-10-09T08:14:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.765+0000 7f35a619c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f35a015d240 0x7f35a015d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.765+0000 7f35a619c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f35a015d240 0x7f35a015d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58316/0 (socket says 172.21.15.71:58316) 2023-10-09T08:14:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.765+0000 7f35a619c700 1 -- 172.21.15.71:0/2703461738 learned_addr learned my addr 172.21.15.71:0/2703461738 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.766+0000 7f35a519a700 1 --2- 172.21.15.71:0/2703461738 >> v2:172.21.15.179:3300/0 conn(0x7f35a00b16d0 0x7f35a00b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.766+0000 7f35a599b700 1 --2- 172.21.15.71:0/2703461738 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a00b4e70 0x7f35a00ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.766+0000 7f35a619c700 1 -- 172.21.15.71:0/2703461738 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a00b4e70 msgr2=0x7f35a00ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.766+0000 7f35a619c700 1 --2- 172.21.15.71:0/2703461738 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a00b4e70 0x7f35a00ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.766+0000 7f35a619c700 1 -- 172.21.15.71:0/2703461738 >> v2:172.21.15.179:3300/0 conn(0x7f35a00b16d0 msgr2=0x7f35a00b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:22.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.766+0000 7f35a619c700 1 --2- 172.21.15.71:0/2703461738 >> v2:172.21.15.179:3300/0 conn(0x7f35a00b16d0 0x7f35a00b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.766+0000 7f35a619c700 1 -- 172.21.15.71:0/2703461738 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a00b5f20 con 0x7f35a015d240 2023-10-09T08:14:22.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.766+0000 7f35a619c700 1 --2- 172.21.15.71:0/2703461738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a015d240 0x7f35a015d6c0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f35a0089440 tx=0x7f3598009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd821a5f5b1e5447 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:22.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.766+0000 7f35a4999700 1 -- 172.21.15.71:0/2703461738 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359800e070 con 0x7f35a015d240 2023-10-09T08:14:22.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.766+0000 7f35a4999700 1 -- 172.21.15.71:0/2703461738 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359800b970 con 0x7f35a015d240 2023-10-09T08:14:22.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.766+0000 7f35a4999700 1 -- 172.21.15.71:0/2703461738 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35980092e0 con 0x7f35a015d240 2023-10-09T08:14:22.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.767+0000 7f35a699d700 1 -- 172.21.15.71:0/2703461738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a015d240 msgr2=0x7f35a015d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:22.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.767+0000 7f35a699d700 1 --2- 172.21.15.71:0/2703461738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a015d240 0x7f35a015d6c0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f35a0089440 tx=0x7f3598009840 comp rx=0 tx=0).stop 2023-10-09T08:14:22.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.767+0000 7f35a699d700 1 -- 172.21.15.71:0/2703461738 shutdown_connections 2023-10-09T08:14:22.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.767+0000 7f35a699d700 1 --2- 172.21.15.71:0/2703461738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a015d240 0x7f35a015d6c0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.767+0000 7f35a699d700 1 --2- 172.21.15.71:0/2703461738 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a00b4e70 0x7f35a00ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.767+0000 7f35a699d700 1 --2- 172.21.15.71:0/2703461738 >> v2:172.21.15.179:3300/0 conn(0x7f35a00b16d0 0x7f35a00b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.767+0000 7f35a699d700 1 -- 172.21.15.71:0/2703461738 >> 172.21.15.71:0/2703461738 conn(0x7f35a00d10c0 msgr2=0x7f35a00affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:22.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.767+0000 7f35a699d700 1 -- 172.21.15.71:0/2703461738 shutdown_connections 2023-10-09T08:14:22.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.767+0000 7f35a699d700 1 -- 172.21.15.71:0/2703461738 wait complete. 2023-10-09T08:14:22.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.769+0000 7f35a699d700 1 Processor -- start 2023-10-09T08:14:22.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.769+0000 7f35a699d700 1 -- start start 2023-10-09T08:14:22.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.770+0000 7f35a699d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a00b16d0 0x7f35a0148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:22.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.770+0000 7f35a699d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a00b4e70 0x7f35a0148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:22.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.770+0000 7f35a699d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a015d240 0x7f35a00c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:22.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.770+0000 7f35a699d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00c8340 con 0x7f35a00b16d0 2023-10-09T08:14:22.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.770+0000 7f35a699d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0149160 con 0x7f35a00b4e70 2023-10-09T08:14:22.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.770+0000 7f35a699d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0148640 con 0x7f35a015d240 2023-10-09T08:14:22.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.770+0000 7f35a599b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a00b16d0 0x7f35a0148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:22.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.770+0000 7f35a599b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a00b16d0 0x7f35a0148c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58330/0 (socket says 172.21.15.71:58330) 2023-10-09T08:14:22.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.770+0000 7f35a599b700 1 -- 172.21.15.71:0/2827416792 learned_addr learned my addr 172.21.15.71:0/2827416792 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:22.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.770+0000 7f35a619c700 1 --2- 172.21.15.71:0/2827416792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a015d240 0x7f35a00c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:22.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.770+0000 7f35a519a700 1 --2- 172.21.15.71:0/2827416792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a00b4e70 0x7f35a0148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:22.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.770+0000 7f35a599b700 1 -- 172.21.15.71:0/2827416792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a015d240 msgr2=0x7f35a00c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:22.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.770+0000 7f35a599b700 1 --2- 172.21.15.71:0/2827416792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a015d240 0x7f35a00c6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.770+0000 7f35a599b700 1 -- 172.21.15.71:0/2827416792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a00b4e70 msgr2=0x7f35a0148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:22.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.770+0000 7f35a599b700 1 --2- 172.21.15.71:0/2827416792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a00b4e70 0x7f35a0148100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:22.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.770+0000 7f35a599b700 1 -- 172.21.15.71:0/2827416792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3598009ae0 con 0x7f35a00b16d0 2023-10-09T08:14:22.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.771+0000 7f35a599b700 1 --2- 172.21.15.71:0/2827416792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a00b16d0 0x7f35a0148c20 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f359c00ec80 tx=0x7f359c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:22.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.771+0000 7f3595ffb700 1 -- 172.21.15.71:0/2827416792 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c00c850 con 0x7f35a00b16d0 2023-10-09T08:14:22.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.771+0000 7f3595ffb700 1 -- 172.21.15.71:0/2827416792 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359c00c9b0 con 0x7f35a00b16d0 2023-10-09T08:14:22.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.771+0000 7f3595ffb700 1 -- 172.21.15.71:0/2827416792 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c00cd50 con 0x7f35a00b16d0 2023-10-09T08:14:22.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.771+0000 7f35a699d700 1 -- 172.21.15.71:0/2827416792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a00c7730 con 0x7f35a00b16d0 2023-10-09T08:14:22.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.771+0000 7f35a699d700 1 -- 172.21.15.71:0/2827416792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a00c7cf0 con 0x7f35a00b16d0 2023-10-09T08:14:22.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.772+0000 7f35a699d700 1 -- 172.21.15.71:0/2827416792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a0088990 con 0x7f35a00b16d0 2023-10-09T08:14:22.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.773+0000 7f3595ffb700 1 -- 172.21.15.71:0/2827416792 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 88) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f359c013680 con 0x7f35a00b16d0 2023-10-09T08:14:22.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.774+0000 7f3595ffb700 1 --2- 172.21.15.71:0/2827416792 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3584067050 0x7f3584069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:22.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.774+0000 7f3595ffb700 1 -- 172.21.15.71:0/2827416792 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6714+0+0 (secure 0 0 0) 0x7f359c084dc0 con 0x7f35a00b16d0 2023-10-09T08:14:22.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.774+0000 7f35a519a700 1 -- 172.21.15.71:0/2827416792 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3584067050 msgr2=0x7f3584069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:22.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.774+0000 7f35a519a700 1 --2- 172.21.15.71:0/2827416792 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3584067050 0x7f3584069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:14:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.778+0000 7f3595ffb700 1 -- 172.21.15.71:0/2827416792 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f359c051a90 con 0x7f35a00b16d0 2023-10-09T08:14:22.852 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:22.852+0000 7ff035a68180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T08:14:22.942 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:22.941+0000 7fbd6bc36180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T08:14:22.945 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:22.945+0000 7ff035a68180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T08:14:22.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.975+0000 7f35a519a700 1 -- 172.21.15.71:0/2827416792 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3584067050 msgr2=0x7f3584069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:22.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.975+0000 7f35a519a700 1 --2- 172.21.15.71:0/2827416792 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3584067050 0x7f3584069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:14:23.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.999+0000 7f35a699d700 1 -- 172.21.15.71:0/2827416792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f35a004bb80 con 0x7f35a00b16d0 2023-10-09T08:14:23.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:22.999+0000 7f3595ffb700 1 -- 172.21.15.71:0/2827416792 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v180) v1 ==== 104+0+11 (secure 0 0 0) 0x7f359c0550b0 con 0x7f35a00b16d0 2023-10-09T08:14:23.000 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-09T08:14:23.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.002+0000 7f35a699d700 1 -- 172.21.15.71:0/2827416792 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3584067050 msgr2=0x7f3584069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:14:23.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.002+0000 7f35a699d700 1 --2- 172.21.15.71:0/2827416792 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3584067050 0x7f3584069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.002+0000 7f35a699d700 1 -- 172.21.15.71:0/2827416792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a00b16d0 msgr2=0x7f35a0148c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:23.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.002+0000 7f35a699d700 1 --2- 172.21.15.71:0/2827416792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a00b16d0 0x7f35a0148c20 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f359c00ec80 tx=0x7f359c0091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.002+0000 7f35a699d700 1 -- 172.21.15.71:0/2827416792 shutdown_connections 2023-10-09T08:14:23.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.002+0000 7f35a699d700 1 --2- 172.21.15.71:0/2827416792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a015d240 0x7f35a00c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.002+0000 7f35a699d700 1 --2- 172.21.15.71:0/2827416792 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3584067050 0x7f3584069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.002+0000 7f35a699d700 1 --2- 172.21.15.71:0/2827416792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a00b16d0 0x7f35a0148c20 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.002+0000 7f35a699d700 1 --2- 172.21.15.71:0/2827416792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a00b4e70 0x7f35a0148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.002+0000 7f35a699d700 1 -- 172.21.15.71:0/2827416792 >> 172.21.15.71:0/2827416792 conn(0x7f35a00d10c0 msgr2=0x7f35a00b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:23.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.002+0000 7f35a699d700 1 -- 172.21.15.71:0/2827416792 shutdown_connections 2023-10-09T08:14:23.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.002+0000 7f35a699d700 1 -- 172.21.15.71:0/2827416792 wait complete. 2023-10-09T08:14:23.020 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T08:14:23.038 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:23.038+0000 7fbd6bc36180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T08:14:23.109 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:23.109+0000 7ff035a68180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T08:14:23.208 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:23.208+0000 7fbd6bc36180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T08:14:23.210 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:23.210+0000 7ff035a68180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T08:14:23.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.212+0000 7f34f759e700 1 Processor -- start 2023-10-09T08:14:23.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.212+0000 7f34f759e700 1 -- start start 2023-10-09T08:14:23.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.214+0000 7f34f759e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f34f80b16d0 0x7f34f80b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:23.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.214+0000 7f34f759e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f80b2080 con 0x7f34f80b4e70 2023-10-09T08:14:23.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.214+0000 7f34f759e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f80cfb00 con 0x7f34f80b33b0 2023-10-09T08:14:23.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.214+0000 7f34f759e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f80b5c40 con 0x7f34f80b16d0 2023-10-09T08:14:23.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.214+0000 7f34f659c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f34f80b4e70 0x7f34f80ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48606/0 (socket says 172.21.15.71:48606) 2023-10-09T08:14:23.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.214+0000 7f34f659c700 1 -- 172.21.15.71:0/2926298407 learned_addr learned my addr 172.21.15.71:0/2926298407 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:23.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.214+0000 7f34f5d9b700 1 --2- 172.21.15.71:0/2926298407 >> v2:172.21.15.71:3300/0 conn(0x7f34f80b16d0 0x7f34f80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:23.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.214+0000 7f34f5d9b700 1 -- 172.21.15.71:0/2926298407 >> v1:172.21.15.179:6789/0 conn(0x7f34f80b33b0 legacy=0x7f34f80b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:23.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.214+0000 7f34f5d9b700 1 -- 172.21.15.71:0/2926298407 >> v1:172.21.15.71:6789/0 conn(0x7f34f80b4e70 legacy=0x7f34f80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:23.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.214+0000 7f34f5d9b700 1 -- 172.21.15.71:0/2926298407 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f80b5f20 con 0x7f34f80b16d0 2023-10-09T08:14:23.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.214+0000 7f34f559a700 1 -- 172.21.15.71:0/2926298407 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3934816100 0 0) 0x7f34f80b2080 con 0x7f34f80b4e70 2023-10-09T08:14:23.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.215+0000 7f34f5d9b700 1 --2- 172.21.15.71:0/2926298407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34f80b16d0 0x7f34f80b1b40 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0098e0 tx=0x7f34ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46970d43b374af04 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:23.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.215+0000 7f34f559a700 1 -- 172.21.15.71:0/2926298407 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec009e80 con 0x7f34f80b16d0 2023-10-09T08:14:23.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.215+0000 7f34f559a700 1 -- 172.21.15.71:0/2926298407 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ec00b860 con 0x7f34f80b16d0 2023-10-09T08:14:23.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.215+0000 7f34f559a700 1 -- 172.21.15.71:0/2926298407 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec00bbe0 con 0x7f34f80b16d0 2023-10-09T08:14:23.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.216+0000 7f34f759e700 1 -- 172.21.15.71:0/2926298407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34f80b16d0 msgr2=0x7f34f80b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:23.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.216+0000 7f34f759e700 1 --2- 172.21.15.71:0/2926298407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34f80b16d0 0x7f34f80b1b40 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0098e0 tx=0x7f34ec0091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.216+0000 7f34f759e700 1 -- 172.21.15.71:0/2926298407 shutdown_connections 2023-10-09T08:14:23.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.216+0000 7f34f759e700 1 --2- 172.21.15.71:0/2926298407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34f80b16d0 0x7f34f80b1b40 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.216+0000 7f34f759e700 1 -- 172.21.15.71:0/2926298407 >> 172.21.15.71:0/2926298407 conn(0x7f34f80d10c0 msgr2=0x7f34f80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:23.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.216+0000 7f34f759e700 1 -- 172.21.15.71:0/2926298407 shutdown_connections 2023-10-09T08:14:23.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.216+0000 7f34f759e700 1 -- 172.21.15.71:0/2926298407 wait complete. 2023-10-09T08:14:23.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.217+0000 7f34f759e700 1 Processor -- start 2023-10-09T08:14:23.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.217+0000 7f34f759e700 1 -- start start 2023-10-09T08:14:23.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.218+0000 7f34f759e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34f80b16d0 0x7f34f8158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:23.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.218+0000 7f34f759e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34f80b33b0 0x7f34f80a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:23.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.218+0000 7f34f759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34f80b4e70 0x7f34f80cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:23.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.218+0000 7f34f759e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f80ca8f0 con 0x7f34f80b16d0 2023-10-09T08:14:23.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.218+0000 7f34f759e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f80cabd0 con 0x7f34f80b33b0 2023-10-09T08:14:23.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.218+0000 7f34f759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f80caeb0 con 0x7f34f80b4e70 2023-10-09T08:14:23.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.219+0000 7f34f659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34f80b16d0 0x7f34f8158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:23.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.219+0000 7f34f5d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34f80b33b0 0x7f34f80a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:23.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.219+0000 7f34f659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34f80b16d0 0x7f34f8158330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58350/0 (socket says 172.21.15.71:58350) 2023-10-09T08:14:23.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.219+0000 7f34f659c700 1 -- 172.21.15.71:0/2847493845 learned_addr learned my addr 172.21.15.71:0/2847493845 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:23.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.219+0000 7f34f6d9d700 1 --2- 172.21.15.71:0/2847493845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34f80b4e70 0x7f34f80cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:23.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.219+0000 7f34f5d9b700 1 -- 172.21.15.71:0/2847493845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34f80b4e70 msgr2=0x7f34f80cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:23.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.219+0000 7f34f5d9b700 1 --2- 172.21.15.71:0/2847493845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34f80b4e70 0x7f34f80cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.219+0000 7f34f5d9b700 1 -- 172.21.15.71:0/2847493845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34f80b16d0 msgr2=0x7f34f8158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:23.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.219+0000 7f34f5d9b700 1 --2- 172.21.15.71:0/2847493845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34f80b16d0 0x7f34f8158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.219+0000 7f34f5d9b700 1 -- 172.21.15.71:0/2847493845 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec009420 con 0x7f34f80b33b0 2023-10-09T08:14:23.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.219+0000 7f34f659c700 1 --2- 172.21.15.71:0/2847493845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34f80b16d0 0x7f34f8158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:14:23.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.220+0000 7f34f5d9b700 1 --2- 172.21.15.71:0/2847493845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34f80b33b0 0x7f34f80a9450 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f34ec016000 tx=0x7f34ec017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:23.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.220+0000 7f34e67fc700 1 -- 172.21.15.71:0/2847493845 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec01f070 con 0x7f34f80b33b0 2023-10-09T08:14:23.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.220+0000 7f34e67fc700 1 -- 172.21.15.71:0/2847493845 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ec000bc0 con 0x7f34f80b33b0 2023-10-09T08:14:23.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.220+0000 7f34f759e700 1 -- 172.21.15.71:0/2847493845 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f80cb190 con 0x7f34f80b33b0 2023-10-09T08:14:23.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.220+0000 7f34e67fc700 1 -- 172.21.15.71:0/2847493845 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec006af0 con 0x7f34f80b33b0 2023-10-09T08:14:23.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.220+0000 7f34f759e700 1 -- 172.21.15.71:0/2847493845 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f8158870 con 0x7f34f80b33b0 2023-10-09T08:14:23.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.221+0000 7f34f759e700 1 -- 172.21.15.71:0/2847493845 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f80cb6b0 con 0x7f34f80b33b0 2023-10-09T08:14:23.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.222+0000 7f34e67fc700 1 -- 172.21.15.71:0/2847493845 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 88) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f34ec023070 con 0x7f34f80b33b0 2023-10-09T08:14:23.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.223+0000 7f34e67fc700 1 --2- 172.21.15.71:0/2847493845 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f34d8067050 0x7f34d8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:23.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.223+0000 7f34e67fc700 1 -- 172.21.15.71:0/2847493845 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6714+0+0 (secure 0 0 0) 0x7f34ec085e10 con 0x7f34f80b33b0 2023-10-09T08:14:23.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.223+0000 7f34f659c700 1 -- 172.21.15.71:0/2847493845 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f34d8067050 msgr2=0x7f34d8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:23.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.223+0000 7f34f659c700 1 --2- 172.21.15.71:0/2847493845 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f34d8067050 0x7f34d8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:14:23.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.227+0000 7f34e67fc700 1 -- 172.21.15.71:0/2847493845 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34f80cb6b0 con 0x7f34f80b33b0 2023-10-09T08:14:23.327 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:23.326+0000 7fbd6bc36180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T08:14:23.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.424+0000 7f34f659c700 1 -- 172.21.15.71:0/2847493845 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f34d8067050 msgr2=0x7f34d8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:23.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.424+0000 7f34f659c700 1 --2- 172.21.15.71:0/2847493845 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f34d8067050 0x7f34d8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:14:23.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.443+0000 7f34f759e700 1 -- 172.21.15.71:0/2847493845 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f34f80cb6b0 con 0x7f34f80b33b0 2023-10-09T08:14:23.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.444+0000 7f34e67fc700 1 -- 172.21.15.71:0/2847493845 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v180) v1 ==== 100+0+11 (secure 0 0 0) 0x7f34f80cb6b0 con 0x7f34f80b33b0 2023-10-09T08:14:23.445 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-09T08:14:23.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.447+0000 7f34f759e700 1 -- 172.21.15.71:0/2847493845 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f34d8067050 msgr2=0x7f34d8069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:14:23.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.447+0000 7f34f759e700 1 --2- 172.21.15.71:0/2847493845 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f34d8067050 0x7f34d8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.447+0000 7f34f759e700 1 -- 172.21.15.71:0/2847493845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34f80b33b0 msgr2=0x7f34f80a9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:23.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.447+0000 7f34f759e700 1 --2- 172.21.15.71:0/2847493845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34f80b33b0 0x7f34f80a9450 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f34ec016000 tx=0x7f34ec017000 comp rx=0 tx=0).stop 2023-10-09T08:14:23.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.447+0000 7f34f759e700 1 -- 172.21.15.71:0/2847493845 shutdown_connections 2023-10-09T08:14:23.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.447+0000 7f34f759e700 1 --2- 172.21.15.71:0/2847493845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34f80b4e70 0x7f34f80cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.447+0000 7f34f759e700 1 --2- 172.21.15.71:0/2847493845 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f34d8067050 0x7f34d8069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.447+0000 7f34f759e700 1 --2- 172.21.15.71:0/2847493845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34f80b16d0 0x7f34f8158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.447+0000 7f34f759e700 1 --2- 172.21.15.71:0/2847493845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34f80b33b0 0x7f34f80a9450 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.447+0000 7f34f759e700 1 -- 172.21.15.71:0/2847493845 >> 172.21.15.71:0/2847493845 conn(0x7f34f80d10c0 msgr2=0x7f34f80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:23.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.447+0000 7f34f759e700 1 -- 172.21.15.71:0/2847493845 shutdown_connections 2023-10-09T08:14:23.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.447+0000 7f34f759e700 1 -- 172.21.15.71:0/2847493845 wait complete. 2023-10-09T08:14:23.466 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T08:14:23.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.695+0000 7f209279d700 1 Processor -- start 2023-10-09T08:14:23.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.695+0000 7f209279d700 1 -- start start 2023-10-09T08:14:23.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.696+0000 7f209279d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f208c1595a0 0x7f208c0b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:23.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.696+0000 7f209279d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f208c0c6c60 0x7f208c0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:23.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.696+0000 7f209279d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f208c0b1410 con 0x7f208c0b1de0 2023-10-09T08:14:23.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.696+0000 7f209279d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f208c0b2b90 con 0x7f208c0c6c60 2023-10-09T08:14:23.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.696+0000 7f209279d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208c063230 con 0x7f208c1595a0 2023-10-09T08:14:23.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.697+0000 7f2091f9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f208c0b1de0 0x7f208c15d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48618/0 (socket says 172.21.15.71:48618) 2023-10-09T08:14:23.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.697+0000 7f2091f9c700 1 -- 172.21.15.71:0/442035975 learned_addr learned my addr 172.21.15.71:0/442035975 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:23.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.697+0000 7f209179b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f208c1595a0 0x7f208c0b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:23.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.697+0000 7f2090f9a700 1 --2- 172.21.15.71:0/442035975 >> v2:172.21.15.71:3300/0 conn(0x7f208c0c6c60 0x7f208c0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:23.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.697+0000 7f2083fff700 1 -- 172.21.15.71:0/442035975 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1021789311 0 0) 0x7f208c0b1410 con 0x7f208c0b1de0 2023-10-09T08:14:23.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.697+0000 7f2083fff700 1 -- 172.21.15.71:0/442035975 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2078003570 con 0x7f208c0b1de0 2023-10-09T08:14:23.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.697+0000 7f209179b700 1 -- 172.21.15.71:0/442035975 >> v2:172.21.15.71:3300/0 conn(0x7f208c0c6c60 msgr2=0x7f208c0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:23.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.697+0000 7f209179b700 1 --2- 172.21.15.71:0/442035975 >> v2:172.21.15.71:3300/0 conn(0x7f208c0c6c60 0x7f208c0c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.697+0000 7f209179b700 1 -- 172.21.15.71:0/442035975 >> v1:172.21.15.71:6789/0 conn(0x7f208c0b1de0 legacy=0x7f208c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:23.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.697+0000 7f209179b700 1 -- 172.21.15.71:0/442035975 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208c0634f0 con 0x7f208c1595a0 2023-10-09T08:14:23.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.697+0000 7f2090f9a700 1 --2- 172.21.15.71:0/442035975 >> v2:172.21.15.71:3300/0 conn(0x7f208c0c6c60 0x7f208c0c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:14:23.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.698+0000 7f209179b700 1 --2- 172.21.15.71:0/442035975 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f208c1595a0 0x7f208c0b18a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f20880098e0 tx=0x7f20880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1519646017f0be7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:23.701 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:23.698+0000 7ff035a68180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T08:14:23.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.698+0000 7f2083fff700 1 -- 172.21.15.71:0/442035975 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2088011630 con 0x7f208c1595a0 2023-10-09T08:14:23.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.698+0000 7f2083fff700 1 -- 172.21.15.71:0/442035975 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2088011790 con 0x7f208c1595a0 2023-10-09T08:14:23.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.698+0000 7f2083fff700 1 -- 172.21.15.71:0/442035975 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2088011b30 con 0x7f208c1595a0 2023-10-09T08:14:23.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.698+0000 7f209279d700 1 -- 172.21.15.71:0/442035975 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f208c1595a0 msgr2=0x7f208c0b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:23.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.699+0000 7f209279d700 1 --2- 172.21.15.71:0/442035975 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f208c1595a0 0x7f208c0b18a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f20880098e0 tx=0x7f20880091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.699+0000 7f209279d700 1 -- 172.21.15.71:0/442035975 shutdown_connections 2023-10-09T08:14:23.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.699+0000 7f209279d700 1 --2- 172.21.15.71:0/442035975 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f208c1595a0 0x7f208c0b18a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.699+0000 7f209279d700 1 --2- 172.21.15.71:0/442035975 >> v2:172.21.15.71:3300/0 conn(0x7f208c0c6c60 0x7f208c0c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.699+0000 7f209279d700 1 -- 172.21.15.71:0/442035975 >> 172.21.15.71:0/442035975 conn(0x7f208c06ddb0 msgr2=0x7f208c06e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:23.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.699+0000 7f209279d700 1 -- 172.21.15.71:0/442035975 shutdown_connections 2023-10-09T08:14:23.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.699+0000 7f209279d700 1 -- 172.21.15.71:0/442035975 wait complete. 2023-10-09T08:14:23.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.700+0000 7f209279d700 1 Processor -- start 2023-10-09T08:14:23.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.700+0000 7f209279d700 1 -- start start 2023-10-09T08:14:23.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.701+0000 7f209279d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f208c0b1de0 0x7f208c14b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:23.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.701+0000 7f209279d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f208c0c6c60 0x7f208c13cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:23.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.701+0000 7f209279d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f208c1595a0 0x7f208c150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:23.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.701+0000 7f209279d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208c14d160 con 0x7f208c0c6c60 2023-10-09T08:14:23.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.701+0000 7f209279d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208c14c0c0 con 0x7f208c1595a0 2023-10-09T08:14:23.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.701+0000 7f209279d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208c14c3a0 con 0x7f208c0b1de0 2023-10-09T08:14:23.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.701+0000 7f2090f9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f208c0c6c60 0x7f208c13cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:23.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.701+0000 7f2090f9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f208c0c6c60 0x7f208c13cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58374/0 (socket says 172.21.15.71:58374) 2023-10-09T08:14:23.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.701+0000 7f2090f9a700 1 -- 172.21.15.71:0/1622676078 learned_addr learned my addr 172.21.15.71:0/1622676078 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:23.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.701+0000 7f2091f9c700 1 --2- 172.21.15.71:0/1622676078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f208c1595a0 0x7f208c150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:23.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.701+0000 7f209179b700 1 --2- 172.21.15.71:0/1622676078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f208c0b1de0 0x7f208c14b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:23.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.702+0000 7f2090f9a700 1 -- 172.21.15.71:0/1622676078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f208c0b1de0 msgr2=0x7f208c14b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:23.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.702+0000 7f2090f9a700 1 --2- 172.21.15.71:0/1622676078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f208c0b1de0 0x7f208c14b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.702+0000 7f2090f9a700 1 -- 172.21.15.71:0/1622676078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f208c1595a0 msgr2=0x7f208c150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:23.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.702+0000 7f2090f9a700 1 --2- 172.21.15.71:0/1622676078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f208c1595a0 0x7f208c150690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.702+0000 7f2090f9a700 1 -- 172.21.15.71:0/1622676078 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207c009420 con 0x7f208c0c6c60 2023-10-09T08:14:23.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.702+0000 7f2091f9c700 1 --2- 172.21.15.71:0/1622676078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f208c1595a0 0x7f208c150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:14:23.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.702+0000 7f209179b700 1 --2- 172.21.15.71:0/1622676078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f208c0b1de0 0x7f208c14b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:14:23.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.702+0000 7f2090f9a700 1 --2- 172.21.15.71:0/1622676078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f208c0c6c60 0x7f208c13cf00 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f207c00ec80 tx=0x7f207c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:23.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.702+0000 7f20817fa700 1 -- 172.21.15.71:0/1622676078 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c00c920 con 0x7f208c0c6c60 2023-10-09T08:14:23.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.703+0000 7f20817fa700 1 -- 172.21.15.71:0/1622676078 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207c00ca80 con 0x7f208c0c6c60 2023-10-09T08:14:23.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.703+0000 7f209279d700 1 -- 172.21.15.71:0/1622676078 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2088009420 con 0x7f208c0c6c60 2023-10-09T08:14:23.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.703+0000 7f20817fa700 1 -- 172.21.15.71:0/1622676078 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c00ce00 con 0x7f208c0c6c60 2023-10-09T08:14:23.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.703+0000 7f209279d700 1 -- 172.21.15.71:0/1622676078 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208c14c960 con 0x7f208c0c6c60 2023-10-09T08:14:23.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.704+0000 7f209279d700 1 -- 172.21.15.71:0/1622676078 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f208c04c3c0 con 0x7f208c0c6c60 2023-10-09T08:14:23.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.705+0000 7f20817fa700 1 -- 172.21.15.71:0/1622676078 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 88) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f207c013680 con 0x7f208c0c6c60 2023-10-09T08:14:23.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.706+0000 7f20817fa700 1 --2- 172.21.15.71:0/1622676078 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2070067050 0x7f2070069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:23.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.706+0000 7f20817fa700 1 -- 172.21.15.71:0/1622676078 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6714+0+0 (secure 0 0 0) 0x7f207c084e80 con 0x7f208c0c6c60 2023-10-09T08:14:23.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.706+0000 7f209179b700 1 -- 172.21.15.71:0/1622676078 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2070067050 msgr2=0x7f2070069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:23.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.706+0000 7f209179b700 1 --2- 172.21.15.71:0/1622676078 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2070067050 0x7f2070069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:14:23.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.710+0000 7f20817fa700 1 -- 172.21.15.71:0/1622676078 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f207c051bf0 con 0x7f208c0c6c60 2023-10-09T08:14:23.794 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:23.794+0000 7ff035a68180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T08:14:23.833 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:23.833+0000 7fbd6bc36180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T08:14:23.885 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:23.885+0000 7ff035a68180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T08:14:23.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.907+0000 7f209179b700 1 -- 172.21.15.71:0/1622676078 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2070067050 msgr2=0x7f2070069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:23.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.907+0000 7f209179b700 1 --2- 172.21.15.71:0/1622676078 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2070067050 0x7f2070069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:14:23.946 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:23.945+0000 7fbd6bc36180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T08:14:23.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.975+0000 7f209279d700 1 -- 172.21.15.71:0/1622676078 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f208c0637d0 con 0x7f208c0c6c60 2023-10-09T08:14:23.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.976+0000 7f20817fa700 1 -- 172.21.15.71:0/1622676078 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f207c055210 con 0x7f208c0c6c60 2023-10-09T08:14:23.977 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:14:23.977 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/845996701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":845996701},{"type":"v1","addr":"172.21.15.179:6834","nonce":845996701}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8683,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2670735121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2670735121},{"type":"v1","addr":"172.21.15.179:6836","nonce":2670735121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":9084,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/2448704931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2448704931},{"type":"v1","addr":"172.21.15.71:6834","nonce":2448704931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:58:23.490596+0000","modified":"2023-10-09T07:58:27.045250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9087},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9087":{"gid":9087,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/1497898467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":1497898467},{"type":"v1","addr":"172.21.15.71:6835","nonce":1497898467}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T08:14:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.978+0000 7f209279d700 1 -- 172.21.15.71:0/1622676078 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2070067050 msgr2=0x7f2070069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:14:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.978+0000 7f209279d700 1 --2- 172.21.15.71:0/1622676078 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2070067050 0x7f2070069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.978+0000 7f209279d700 1 -- 172.21.15.71:0/1622676078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f208c0c6c60 msgr2=0x7f208c13cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.978+0000 7f209279d700 1 --2- 172.21.15.71:0/1622676078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f208c0c6c60 0x7f208c13cf00 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f207c00ec80 tx=0x7f207c0091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.979+0000 7f209279d700 1 -- 172.21.15.71:0/1622676078 shutdown_connections 2023-10-09T08:14:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.979+0000 7f209279d700 1 --2- 172.21.15.71:0/1622676078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f208c1595a0 0x7f208c150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.979+0000 7f209279d700 1 --2- 172.21.15.71:0/1622676078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f208c0b1de0 0x7f208c14b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.979+0000 7f209279d700 1 --2- 172.21.15.71:0/1622676078 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2070067050 0x7f2070069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.979+0000 7f209279d700 1 --2- 172.21.15.71:0/1622676078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f208c0c6c60 0x7f208c13cf00 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:23.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.979+0000 7f209279d700 1 -- 172.21.15.71:0/1622676078 >> 172.21.15.71:0/1622676078 conn(0x7f208c06ddb0 msgr2=0x7f208c15ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:23.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.979+0000 7f209279d700 1 -- 172.21.15.71:0/1622676078 shutdown_connections 2023-10-09T08:14:23.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:23.979+0000 7f209279d700 1 -- 172.21.15.71:0/1622676078 wait complete. 2023-10-09T08:14:23.981 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 82 2023-10-09T08:14:23.997 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T08:14:24.047 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:24.047+0000 7fbd6bc36180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T08:14:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.184+0000 7fab5939d700 1 Processor -- start 2023-10-09T08:14:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.184+0000 7fab5939d700 1 -- start start 2023-10-09T08:14:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.186+0000 7fab5939d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab5415d230 0x7fab5415d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.186+0000 7fab5939d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab540b2980 con 0x7fab54159420 2023-10-09T08:14:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.186+0000 7fab5939d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab5415dbb0 con 0x7fab541597f0 2023-10-09T08:14:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.186+0000 7fab5939d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab540b11d0 con 0x7fab5415d230 2023-10-09T08:14:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.186+0000 7fab53fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fab54159420 0x7fab540b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48634/0 (socket says 172.21.15.71:48634) 2023-10-09T08:14:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.186+0000 7fab53fff700 1 -- 172.21.15.71:0/3138795704 learned_addr learned my addr 172.21.15.71:0/3138795704 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.186+0000 7fab58b9c700 1 --2- 172.21.15.71:0/3138795704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab5415d230 0x7fab5415d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.186+0000 7fab52ffd700 1 -- 172.21.15.71:0/3138795704 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137527493 0 0) 0x7fab540b2980 con 0x7fab54159420 2023-10-09T08:14:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.186+0000 7fab52ffd700 1 -- 172.21.15.71:0/3138795704 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab3c003570 con 0x7fab54159420 2023-10-09T08:14:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.187+0000 7fab52ffd700 1 -- 172.21.15.71:0/3138795704 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109707392 0 0) 0x7fab5415dbb0 con 0x7fab541597f0 2023-10-09T08:14:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.187+0000 7fab52ffd700 1 -- 172.21.15.71:0/3138795704 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab540b2980 con 0x7fab541597f0 2023-10-09T08:14:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.187+0000 7fab58b9c700 1 -- 172.21.15.71:0/3138795704 >> v1:172.21.15.179:6789/0 conn(0x7fab541597f0 legacy=0x7fab540b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.187+0000 7fab58b9c700 1 -- 172.21.15.71:0/3138795704 >> v1:172.21.15.71:6789/0 conn(0x7fab54159420 legacy=0x7fab540b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.187+0000 7fab58b9c700 1 -- 172.21.15.71:0/3138795704 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab540b14b0 con 0x7fab5415d230 2023-10-09T08:14:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.187+0000 7fab58b9c700 1 --2- 172.21.15.71:0/3138795704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab5415d230 0x7fab5415d670 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009e90 tx=0x7fab4c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=107f252a54c5d05c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.187+0000 7fab52ffd700 1 -- 172.21.15.71:0/3138795704 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c00e070 con 0x7fab5415d230 2023-10-09T08:14:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.187+0000 7fab52ffd700 1 -- 172.21.15.71:0/3138795704 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c00bb80 con 0x7fab5415d230 2023-10-09T08:14:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.187+0000 7fab52ffd700 1 -- 172.21.15.71:0/3138795704 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c012430 con 0x7fab5415d230 2023-10-09T08:14:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.188+0000 7fab5939d700 1 -- 172.21.15.71:0/3138795704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab5415d230 msgr2=0x7fab5415d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.188+0000 7fab5939d700 1 --2- 172.21.15.71:0/3138795704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab5415d230 0x7fab5415d670 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009e90 tx=0x7fab4c009780 comp rx=0 tx=0).stop 2023-10-09T08:14:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.188+0000 7fab5939d700 1 -- 172.21.15.71:0/3138795704 shutdown_connections 2023-10-09T08:14:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.188+0000 7fab5939d700 1 --2- 172.21.15.71:0/3138795704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab5415d230 0x7fab5415d670 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.188+0000 7fab5939d700 1 -- 172.21.15.71:0/3138795704 >> 172.21.15.71:0/3138795704 conn(0x7fab540d0660 msgr2=0x7fab540d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.188+0000 7fab5939d700 1 -- 172.21.15.71:0/3138795704 shutdown_connections 2023-10-09T08:14:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.188+0000 7fab5939d700 1 -- 172.21.15.71:0/3138795704 wait complete. 2023-10-09T08:14:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.189+0000 7fab5939d700 1 Processor -- start 2023-10-09T08:14:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.190+0000 7fab5939d700 1 -- start start 2023-10-09T08:14:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.190+0000 7fab5939d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab54159420 0x7fab54154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.190+0000 7fab5939d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab541597f0 0x7fab5415c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.190+0000 7fab5939d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab5415d230 0x7fab54158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.190+0000 7fab5939d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab540c6120 con 0x7fab54159420 2023-10-09T08:14:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.190+0000 7fab5939d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5415ca70 con 0x7fab5415d230 2023-10-09T08:14:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.190+0000 7fab5939d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab540c54a0 con 0x7fab541597f0 2023-10-09T08:14:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.191+0000 7fab53fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab54159420 0x7fab54154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.191+0000 7fab53fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab54159420 0x7fab54154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58390/0 (socket says 172.21.15.71:58390) 2023-10-09T08:14:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.191+0000 7fab53fff700 1 -- 172.21.15.71:0/345369521 learned_addr learned my addr 172.21.15.71:0/345369521 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.191+0000 7fab58b9c700 1 --2- 172.21.15.71:0/345369521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab5415d230 0x7fab54158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.191+0000 7fab537fe700 1 --2- 172.21.15.71:0/345369521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab541597f0 0x7fab5415c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.191+0000 7fab53fff700 1 -- 172.21.15.71:0/345369521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab541597f0 msgr2=0x7fab5415c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.191+0000 7fab53fff700 1 --2- 172.21.15.71:0/345369521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab541597f0 0x7fab5415c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.191+0000 7fab53fff700 1 -- 172.21.15.71:0/345369521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab5415d230 msgr2=0x7fab54158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.191+0000 7fab53fff700 1 --2- 172.21.15.71:0/345369521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab5415d230 0x7fab54158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.191+0000 7fab53fff700 1 -- 172.21.15.71:0/345369521 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c009a20 con 0x7fab54159420 2023-10-09T08:14:24.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.191+0000 7fab53fff700 1 --2- 172.21.15.71:0/345369521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab54159420 0x7fab54154ea0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fab4400c790 tx=0x7fab44007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:24.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.191+0000 7fab3bfff700 1 -- 172.21.15.71:0/345369521 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab44005b30 con 0x7fab54159420 2023-10-09T08:14:24.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.192+0000 7fab3bfff700 1 -- 172.21.15.71:0/345369521 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab44005c90 con 0x7fab54159420 2023-10-09T08:14:24.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.192+0000 7fab5939d700 1 -- 172.21.15.71:0/345369521 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab540c5780 con 0x7fab54159420 2023-10-09T08:14:24.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.192+0000 7fab3bfff700 1 -- 172.21.15.71:0/345369521 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab44007340 con 0x7fab54159420 2023-10-09T08:14:24.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.192+0000 7fab5939d700 1 -- 172.21.15.71:0/345369521 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab540c5d40 con 0x7fab54159420 2023-10-09T08:14:24.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.193+0000 7fab5939d700 1 -- 172.21.15.71:0/345369521 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab540c6260 con 0x7fab54159420 2023-10-09T08:14:24.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.194+0000 7fab3bfff700 1 -- 172.21.15.71:0/345369521 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 88) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fab4401b400 con 0x7fab54159420 2023-10-09T08:14:24.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.194+0000 7fab3bfff700 1 --2- 172.21.15.71:0/345369521 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fab40067050 0x7fab40069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:24.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.195+0000 7fab3bfff700 1 -- 172.21.15.71:0/345369521 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6770+0+0 (secure 0 0 0) 0x7fab44084640 con 0x7fab54159420 2023-10-09T08:14:24.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.195+0000 7fab537fe700 1 -- 172.21.15.71:0/345369521 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fab40067050 msgr2=0x7fab40069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:24.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.195+0000 7fab537fe700 1 --2- 172.21.15.71:0/345369521 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fab40067050 0x7fab40069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:14:24.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.198+0000 7fab3bfff700 1 -- 172.21.15.71:0/345369521 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab44051350 con 0x7fab54159420 2023-10-09T08:14:24.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.396+0000 7fab537fe700 1 -- 172.21.15.71:0/345369521 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fab40067050 msgr2=0x7fab40069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:24.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.396+0000 7fab537fe700 1 --2- 172.21.15.71:0/345369521 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fab40067050 0x7fab40069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:14:24.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.414+0000 7fab5939d700 1 -- 172.21.15.71:0/345369521 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab5404c3c0 con 0x7fab54159420 2023-10-09T08:14:24.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.415+0000 7fab3bfff700 1 -- 172.21.15.71:0/345369521 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+16988 (secure 0 0 0) 0x7fab44054970 con 0x7fab54159420 2023-10-09T08:14:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:14:24.417 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":181,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T08:14:23.907292+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:58:21.144208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T07:58:22.473710+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":181,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.12","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:0/975761648":"2023-10-10T08:09:23.494246+0000","172.21.15.179:0/3488491397":"2023-10-10T08:09:23.494246+0000","172.21.15.179:0/1844939615":"2023-10-10T08:09:23.494246+0000","172.21.15.179:0/2466406124":"2023-10-10T07:58:43.731196+0000","172.21.15.179:0/2942596736":"2023-10-10T08:09:23.494246+0000","172.21.15.179:0/566158543":"2023-10-10T07:58:43.731196+0000","172.21.15.179:6837/85452":"2023-10-10T07:58:43.731196+0000","172.21.15.179:0/2282437587":"2023-10-10T08:09:23.494246+0000","172.21.15.179:6835/85452":"2023-10-10T07:58:43.731196+0000","172.21.15.179:0/1809359224":"2023-10-10T07:58:43.731196+0000","172.21.15.179:0/3234455519":"2023-10-10T08:09:23.494246+0000","172.21.15.179:0/2151068476":"2023-10-10T07:58:43.731196+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T08:14:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.418+0000 7fab5939d700 1 -- 172.21.15.71:0/345369521 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fab40067050 msgr2=0x7fab40069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:14:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.418+0000 7fab5939d700 1 --2- 172.21.15.71:0/345369521 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fab40067050 0x7fab40069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.418+0000 7fab5939d700 1 -- 172.21.15.71:0/345369521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab54159420 msgr2=0x7fab54154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.418+0000 7fab5939d700 1 --2- 172.21.15.71:0/345369521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab54159420 0x7fab54154ea0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fab4400c790 tx=0x7fab44007ea0 comp rx=0 tx=0).stop 2023-10-09T08:14:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.418+0000 7fab5939d700 1 -- 172.21.15.71:0/345369521 shutdown_connections 2023-10-09T08:14:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.418+0000 7fab5939d700 1 --2- 172.21.15.71:0/345369521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab5415d230 0x7fab54158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.418+0000 7fab5939d700 1 --2- 172.21.15.71:0/345369521 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fab40067050 0x7fab40069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:24.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.418+0000 7fab5939d700 1 --2- 172.21.15.71:0/345369521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab54159420 0x7fab54154ea0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:24.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.418+0000 7fab5939d700 1 --2- 172.21.15.71:0/345369521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab541597f0 0x7fab5415c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:24.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.418+0000 7fab5939d700 1 -- 172.21.15.71:0/345369521 >> 172.21.15.71:0/345369521 conn(0x7fab540d0660 msgr2=0x7fab540b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:24.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.418+0000 7fab5939d700 1 -- 172.21.15.71:0/345369521 shutdown_connections 2023-10-09T08:14:24.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.418+0000 7fab5939d700 1 -- 172.21.15.71:0/345369521 wait complete. 2023-10-09T08:14:24.436 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T08:14:24.437 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T08:14:24.597 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:24.597+0000 7ff035a68180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T08:14:24.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.670+0000 7fe16fdff700 1 Processor -- start 2023-10-09T08:14:24.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.670+0000 7fe16fdff700 1 -- start start 2023-10-09T08:14:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.672+0000 7fe16fdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe16806f810 0x7fe1681649f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.672+0000 7fe16fdff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16806ec70 con 0x7fe168068550 2023-10-09T08:14:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.672+0000 7fe16fdff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1680b2e70 con 0x7fe168068920 2023-10-09T08:14:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.672+0000 7fe16fdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe168068d90 con 0x7fe16806f810 2023-10-09T08:14:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.672+0000 7fe16db9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe168068550 0x7fe16815e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48646/0 (socket says 172.21.15.71:48646) 2023-10-09T08:14:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.672+0000 7fe16db9b700 1 -- 172.21.15.71:0/467765647 learned_addr learned my addr 172.21.15.71:0/467765647 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.672+0000 7fe16e39c700 1 --2- 172.21.15.71:0/467765647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe16806f810 0x7fe1681649f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:24.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.672+0000 7fe16cb99700 1 -- 172.21.15.71:0/467765647 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994330388 0 0) 0x7fe16806ec70 con 0x7fe168068550 2023-10-09T08:14:24.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.672+0000 7fe16cb99700 1 -- 172.21.15.71:0/467765647 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe154003570 con 0x7fe168068550 2023-10-09T08:14:24.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.672+0000 7fe16cb99700 1 -- 172.21.15.71:0/467765647 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2242065435 0 0) 0x7fe1680b2e70 con 0x7fe168068920 2023-10-09T08:14:24.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.673+0000 7fe16cb99700 1 -- 172.21.15.71:0/467765647 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe16806ec70 con 0x7fe168068920 2023-10-09T08:14:24.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.673+0000 7fe16e39c700 1 -- 172.21.15.71:0/467765647 >> v1:172.21.15.179:6789/0 conn(0x7fe168068920 legacy=0x7fe16806f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:24.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.673+0000 7fe16cb99700 1 -- 172.21.15.71:0/467765647 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3621805793 0 0) 0x7fe154003570 con 0x7fe168068550 2023-10-09T08:14:24.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.673+0000 7fe16e39c700 1 -- 172.21.15.71:0/467765647 >> v1:172.21.15.71:6789/0 conn(0x7fe168068550 legacy=0x7fe16815e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:24.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.673+0000 7fe16e39c700 1 -- 172.21.15.71:0/467765647 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1680b3150 con 0x7fe16806f810 2023-10-09T08:14:24.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.673+0000 7fe16e39c700 1 --2- 172.21.15.71:0/467765647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe16806f810 0x7fe1681649f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe160009e90 tx=0x7fe160009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6384379f6cebdf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:24.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.673+0000 7fe16cb99700 1 -- 172.21.15.71:0/467765647 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16000e070 con 0x7fe16806f810 2023-10-09T08:14:24.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.673+0000 7fe16cb99700 1 -- 172.21.15.71:0/467765647 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16000b870 con 0x7fe16806f810 2023-10-09T08:14:24.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.673+0000 7fe16cb99700 1 -- 172.21.15.71:0/467765647 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164001470 con 0x7fe16806f810 2023-10-09T08:14:24.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.674+0000 7fe16fdff700 1 -- 172.21.15.71:0/467765647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe16806f810 msgr2=0x7fe1681649f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:24.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.674+0000 7fe16fdff700 1 --2- 172.21.15.71:0/467765647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe16806f810 0x7fe1681649f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe160009e90 tx=0x7fe160009780 comp rx=0 tx=0).stop 2023-10-09T08:14:24.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.674+0000 7fe16fdff700 1 -- 172.21.15.71:0/467765647 shutdown_connections 2023-10-09T08:14:24.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.674+0000 7fe16fdff700 1 --2- 172.21.15.71:0/467765647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe16806f810 0x7fe1681649f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:24.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.674+0000 7fe16fdff700 1 -- 172.21.15.71:0/467765647 >> 172.21.15.71:0/467765647 conn(0x7fe1680cd480 msgr2=0x7fe1680cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:24.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.674+0000 7fe16fdff700 1 -- 172.21.15.71:0/467765647 shutdown_connections 2023-10-09T08:14:24.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.674+0000 7fe16fdff700 1 -- 172.21.15.71:0/467765647 wait complete. 2023-10-09T08:14:24.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.675+0000 7fe16fdff700 1 Processor -- start 2023-10-09T08:14:24.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.676+0000 7fe16fdff700 1 -- start start 2023-10-09T08:14:24.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.676+0000 7fe16fdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe168068550 0x7fe1681375b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.677+0000 7fe16fdff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe168068920 0x7fe16814a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.677+0000 7fe16fdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe16806f810 0x7fe16814a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.677+0000 7fe16fdff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1680aa500 con 0x7fe168068920 2023-10-09T08:14:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.677+0000 7fe16fdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1680aa7e0 con 0x7fe16806f810 2023-10-09T08:14:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.677+0000 7fe16fdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1680aaac0 con 0x7fe168068550 2023-10-09T08:14:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.677+0000 7fe16d39a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe168068920 0x7fe16814a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.677+0000 7fe16d39a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe168068920 0x7fe16814a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58396/0 (socket says 172.21.15.71:58396) 2023-10-09T08:14:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.677+0000 7fe16d39a700 1 -- 172.21.15.71:0/3559664299 learned_addr learned my addr 172.21.15.71:0/3559664299 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.677+0000 7fe16db9b700 1 --2- 172.21.15.71:0/3559664299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe168068550 0x7fe1681375b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.677+0000 7fe16e39c700 1 --2- 172.21.15.71:0/3559664299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe16806f810 0x7fe16814a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.677+0000 7fe16d39a700 1 -- 172.21.15.71:0/3559664299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe168068550 msgr2=0x7fe1681375b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.677+0000 7fe16d39a700 1 --2- 172.21.15.71:0/3559664299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe168068550 0x7fe1681375b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.677+0000 7fe16d39a700 1 -- 172.21.15.71:0/3559664299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe16806f810 msgr2=0x7fe16814a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.677+0000 7fe16d39a700 1 --2- 172.21.15.71:0/3559664299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe16806f810 0x7fe16814a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.677+0000 7fe16d39a700 1 -- 172.21.15.71:0/3559664299 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe160009a20 con 0x7fe168068920 2023-10-09T08:14:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.678+0000 7fe16d39a700 1 --2- 172.21.15.71:0/3559664299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe168068920 0x7fe16814a290 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fe15800c790 tx=0x7fe158007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.678+0000 7fe15dffb700 1 -- 172.21.15.71:0/3559664299 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe158010510 con 0x7fe168068920 2023-10-09T08:14:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.678+0000 7fe15dffb700 1 -- 172.21.15.71:0/3559664299 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe158010670 con 0x7fe168068920 2023-10-09T08:14:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.678+0000 7fe15dffb700 1 -- 172.21.15.71:0/3559664299 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe158010a10 con 0x7fe168068920 2023-10-09T08:14:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.678+0000 7fe16fdff700 1 -- 172.21.15.71:0/3559664299 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1680aada0 con 0x7fe168068920 2023-10-09T08:14:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.678+0000 7fe16fdff700 1 -- 172.21.15.71:0/3559664299 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe168137af0 con 0x7fe168068920 2023-10-09T08:14:24.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.679+0000 7fe16fdff700 1 -- 172.21.15.71:0/3559664299 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1680ab2c0 con 0x7fe168068920 2023-10-09T08:14:24.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.680+0000 7fe15dffb700 1 -- 172.21.15.71:0/3559664299 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 88) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fe15801b3b0 con 0x7fe168068920 2023-10-09T08:14:24.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.681+0000 7fe15dffb700 1 --2- 172.21.15.71:0/3559664299 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe14c067050 0x7fe14c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:24.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.681+0000 7fe15dffb700 1 -- 172.21.15.71:0/3559664299 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6770+0+0 (secure 0 0 0) 0x7fe158084420 con 0x7fe168068920 2023-10-09T08:14:24.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.681+0000 7fe16db9b700 1 -- 172.21.15.71:0/3559664299 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe14c067050 msgr2=0x7fe14c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:24.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.681+0000 7fe16db9b700 1 --2- 172.21.15.71:0/3559664299 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe14c067050 0x7fe14c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:14:24.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.685+0000 7fe15dffb700 1 -- 172.21.15.71:0/3559664299 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1680ab2c0 con 0x7fe168068920 2023-10-09T08:14:24.719 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:24.718+0000 7fbd6bc36180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T08:14:24.787 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:24.786+0000 7ff035a68180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T08:14:24.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.882+0000 7fe16db9b700 1 -- 172.21.15.71:0/3559664299 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe14c067050 msgr2=0x7fe14c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:24.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:24.882+0000 7fe16db9b700 1 --2- 172.21.15.71:0/3559664299 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe14c067050 0x7fe14c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:14:24.891 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:24.890+0000 7ff035a68180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T08:14:24.957 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:24.956+0000 7fbd6bc36180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T08:14:25.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.001+0000 7fe16fdff700 1 -- 172.21.15.71:0/3559664299 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1680ab2c0 con 0x7fe168068920 2023-10-09T08:14:25.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.001+0000 7fe15dffb700 1 -- 172.21.15.71:0/3559664299 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4604 (secure 0 0 0) 0x7fe1680ab2c0 con 0x7fe168068920 2023-10-09T08:14:25.002 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:14:25.002 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/845996701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":845996701},{"type":"v1","addr":"172.21.15.179:6834","nonce":845996701}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8683,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2670735121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2670735121},{"type":"v1","addr":"172.21.15.179:6836","nonce":2670735121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":9084,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/2448704931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2448704931},{"type":"v1","addr":"172.21.15.71:6834","nonce":2448704931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:58:23.490596+0000","modified":"2023-10-09T07:58:27.045250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9087},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9087":{"gid":9087,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/1497898467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":1497898467},{"type":"v1","addr":"172.21.15.71:6835","nonce":1497898467}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T08:14:25.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.004+0000 7fe16fdff700 1 -- 172.21.15.71:0/3559664299 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe14c067050 msgr2=0x7fe14c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:14:25.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.004+0000 7fe16fdff700 1 --2- 172.21.15.71:0/3559664299 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe14c067050 0x7fe14c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.004+0000 7fe16fdff700 1 -- 172.21.15.71:0/3559664299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe168068920 msgr2=0x7fe16814a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:25.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.004+0000 7fe16fdff700 1 --2- 172.21.15.71:0/3559664299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe168068920 0x7fe16814a290 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fe15800c790 tx=0x7fe158007e10 comp rx=0 tx=0).stop 2023-10-09T08:14:25.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.004+0000 7fe16fdff700 1 -- 172.21.15.71:0/3559664299 shutdown_connections 2023-10-09T08:14:25.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.004+0000 7fe16fdff700 1 --2- 172.21.15.71:0/3559664299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe16806f810 0x7fe16814a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.004+0000 7fe16fdff700 1 --2- 172.21.15.71:0/3559664299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe168068550 0x7fe1681375b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.004+0000 7fe16fdff700 1 --2- 172.21.15.71:0/3559664299 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe14c067050 0x7fe14c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.004+0000 7fe16fdff700 1 --2- 172.21.15.71:0/3559664299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe168068920 0x7fe16814a290 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.004+0000 7fe16fdff700 1 -- 172.21.15.71:0/3559664299 >> 172.21.15.71:0/3559664299 conn(0x7fe1680cd480 msgr2=0x7fe168154fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:25.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.004+0000 7fe16fdff700 1 -- 172.21.15.71:0/3559664299 shutdown_connections 2023-10-09T08:14:25.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.004+0000 7fe16fdff700 1 -- 172.21.15.71:0/3559664299 wait complete. 2023-10-09T08:14:25.006 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 82 2023-10-09T08:14:25.023 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T08:14:25.062 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:25.061+0000 7fbd6bc36180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T08:14:25.188 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:25.187+0000 7ff035a68180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T08:14:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.212+0000 7f8354bff700 1 Processor -- start 2023-10-09T08:14:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.213+0000 7f8354bff700 1 -- start start 2023-10-09T08:14:25.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.214+0000 7f8354bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8350155c10 0x7f8350155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:25.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.214+0000 7f8354bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83500acac0 con 0x7f83500ac6d0 2023-10-09T08:14:25.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.214+0000 7f8354bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83500ad930 con 0x7f83500ac230 2023-10-09T08:14:25.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.214+0000 7f8354bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83500acd20 con 0x7f8350155c10 2023-10-09T08:14:25.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.214+0000 7f834ed9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f83500ac6d0 0x7f83500b0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48190/0 (socket says 172.21.15.71:48190) 2023-10-09T08:14:25.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.214+0000 7f834ed9d700 1 -- 172.21.15.71:0/472604764 learned_addr learned my addr 172.21.15.71:0/472604764 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:25.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.214+0000 7f834e59c700 1 --2- 172.21.15.71:0/472604764 >> v2:172.21.15.179:3300/0 conn(0x7f8350155c10 0x7f8350155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:25.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.215+0000 7f834d59a700 1 -- 172.21.15.71:0/472604764 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490059531 0 0) 0x7f83500acac0 con 0x7f83500ac6d0 2023-10-09T08:14:25.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.215+0000 7f834d59a700 1 -- 172.21.15.71:0/472604764 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8338003570 con 0x7f83500ac6d0 2023-10-09T08:14:25.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.215+0000 7f834e59c700 1 -- 172.21.15.71:0/472604764 >> v1:172.21.15.179:6789/0 conn(0x7f83500ac230 legacy=0x7f83501568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:25.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.215+0000 7f834d59a700 1 -- 172.21.15.71:0/472604764 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302808568 0 0) 0x7f83500ad930 con 0x7f83500ac230 2023-10-09T08:14:25.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.215+0000 7f834e59c700 1 -- 172.21.15.71:0/472604764 >> v1:172.21.15.71:6789/0 conn(0x7f83500ac6d0 legacy=0x7f83500b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:25.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.215+0000 7f834e59c700 1 -- 172.21.15.71:0/472604764 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83500ad000 con 0x7f8350155c10 2023-10-09T08:14:25.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.215+0000 7f834e59c700 1 --2- 172.21.15.71:0/472604764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8350155c10 0x7f8350155fe0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f83400098e0 tx=0x7f83400091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f20a5156be9ed28f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:25.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.215+0000 7f834d59a700 1 -- 172.21.15.71:0/472604764 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834000b640 con 0x7f8350155c10 2023-10-09T08:14:25.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.215+0000 7f834d59a700 1 -- 172.21.15.71:0/472604764 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834000b7a0 con 0x7f8350155c10 2023-10-09T08:14:25.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.215+0000 7f834d59a700 1 -- 172.21.15.71:0/472604764 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834000bb20 con 0x7f8350155c10 2023-10-09T08:14:25.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.216+0000 7f8354bff700 1 -- 172.21.15.71:0/472604764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8350155c10 msgr2=0x7f8350155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:25.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.216+0000 7f8354bff700 1 --2- 172.21.15.71:0/472604764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8350155c10 0x7f8350155fe0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f83400098e0 tx=0x7f83400091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.216+0000 7f8354bff700 1 -- 172.21.15.71:0/472604764 shutdown_connections 2023-10-09T08:14:25.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.216+0000 7f8354bff700 1 --2- 172.21.15.71:0/472604764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8350155c10 0x7f8350155fe0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.216+0000 7f8354bff700 1 -- 172.21.15.71:0/472604764 >> 172.21.15.71:0/472604764 conn(0x7f835006a320 msgr2=0x7f83500cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:25.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.216+0000 7f8354bff700 1 -- 172.21.15.71:0/472604764 shutdown_connections 2023-10-09T08:14:25.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.216+0000 7f8354bff700 1 -- 172.21.15.71:0/472604764 wait complete. 2023-10-09T08:14:25.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.219+0000 7f8354bff700 1 Processor -- start 2023-10-09T08:14:25.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.219+0000 7f8354bff700 1 -- start start 2023-10-09T08:14:25.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.220+0000 7f8354bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83500ac230 0x7f8350151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:25.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.220+0000 7f8354bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83500ac6d0 0x7f8350158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:25.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.220+0000 7f8354bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8350155c10 0x7f8350158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:25.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.220+0000 7f8354bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8350152190 con 0x7f8350155c10 2023-10-09T08:14:25.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.220+0000 7f8354bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83500aa830 con 0x7f83500ac230 2023-10-09T08:14:25.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.220+0000 7f8354bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83500aab10 con 0x7f83500ac6d0 2023-10-09T08:14:25.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.220+0000 7f834e59c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83500ac230 0x7f8350151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:25.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.220+0000 7f834ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8350155c10 0x7f8350158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:25.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.221+0000 7f834e59c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83500ac230 0x7f8350151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:54046/0 (socket says 172.21.15.71:54046) 2023-10-09T08:14:25.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.221+0000 7f834e59c700 1 -- 172.21.15.71:0/586416859 learned_addr learned my addr 172.21.15.71:0/586416859 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:25.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.221+0000 7f834dd9b700 1 --2- 172.21.15.71:0/586416859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83500ac6d0 0x7f8350158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:25.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.221+0000 7f834e59c700 1 -- 172.21.15.71:0/586416859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83500ac6d0 msgr2=0x7f8350158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:25.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.221+0000 7f834e59c700 1 --2- 172.21.15.71:0/586416859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83500ac6d0 0x7f8350158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.221+0000 7f834e59c700 1 -- 172.21.15.71:0/586416859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8350155c10 msgr2=0x7f8350158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:25.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.221+0000 7f834e59c700 1 --2- 172.21.15.71:0/586416859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8350155c10 0x7f8350158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.221+0000 7f834e59c700 1 -- 172.21.15.71:0/586416859 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8340009420 con 0x7f83500ac230 2023-10-09T08:14:25.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.221+0000 7f834e59c700 1 --2- 172.21.15.71:0/586416859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83500ac230 0x7f8350151c50 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f83500acc50 tx=0x7f8340017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:25.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.222+0000 7f833e7fc700 1 -- 172.21.15.71:0/586416859 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834000bb20 con 0x7f83500ac230 2023-10-09T08:14:25.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.222+0000 7f833e7fc700 1 -- 172.21.15.71:0/586416859 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8340000c90 con 0x7f83500ac230 2023-10-09T08:14:25.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.222+0000 7f833e7fc700 1 -- 172.21.15.71:0/586416859 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834001a680 con 0x7f83500ac230 2023-10-09T08:14:25.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.222+0000 7f8354bff700 1 -- 172.21.15.71:0/586416859 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83500aadf0 con 0x7f83500ac230 2023-10-09T08:14:25.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.222+0000 7f8354bff700 1 -- 172.21.15.71:0/586416859 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f835015a610 con 0x7f83500ac230 2023-10-09T08:14:25.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.223+0000 7f8354bff700 1 -- 172.21.15.71:0/586416859 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f835015a860 con 0x7f83500ac230 2023-10-09T08:14:25.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.224+0000 7f833e7fc700 1 -- 172.21.15.71:0/586416859 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 88) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f834001aa70 con 0x7f83500ac230 2023-10-09T08:14:25.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.224+0000 7f833e7fc700 1 --2- 172.21.15.71:0/586416859 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8330067050 0x7f8330069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:25.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.225+0000 7f833e7fc700 1 -- 172.21.15.71:0/586416859 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6770+0+0 (secure 0 0 0) 0x7f8340086700 con 0x7f83500ac230 2023-10-09T08:14:25.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.225+0000 7f834dd9b700 1 -- 172.21.15.71:0/586416859 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8330067050 msgr2=0x7f8330069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:25.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.225+0000 7f834dd9b700 1 --2- 172.21.15.71:0/586416859 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8330067050 0x7f8330069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:14:25.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.229+0000 7f833e7fc700 1 -- 172.21.15.71:0/586416859 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8340053390 con 0x7f83500ac230 2023-10-09T08:14:25.285 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:25.285+0000 7ff035a68180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T08:14:25.370 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:25.369+0000 7fbd6bc36180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T08:14:25.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.426+0000 7f834dd9b700 1 -- 172.21.15.71:0/586416859 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8330067050 msgr2=0x7f8330069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:25.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.426+0000 7f834dd9b700 1 --2- 172.21.15.71:0/586416859 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8330067050 0x7f8330069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:14:25.468 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:25.468+0000 7fbd6bc36180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T08:14:25.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.472+0000 7f8354bff700 1 -- 172.21.15.71:0/586416859 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f835004c3c0 con 0x7f83500ac230 2023-10-09T08:14:25.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.473+0000 7f833e7fc700 1 -- 172.21.15.71:0/586416859 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f83400569b0 con 0x7f83500ac230 2023-10-09T08:14:25.474 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:14:25.474 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/845996701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":845996701},{"type":"v1","addr":"172.21.15.179:6834","nonce":845996701}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8683,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2670735121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2670735121},{"type":"v1","addr":"172.21.15.179:6836","nonce":2670735121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":9084,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/2448704931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2448704931},{"type":"v1","addr":"172.21.15.71:6834","nonce":2448704931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T07:58:23.490596+0000","modified":"2023-10-09T07:58:27.045250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9087},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9087":{"gid":9087,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/1497898467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":1497898467},{"type":"v1","addr":"172.21.15.71:6835","nonce":1497898467}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T08:14:25.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.475+0000 7f8354bff700 1 -- 172.21.15.71:0/586416859 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8330067050 msgr2=0x7f8330069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:14:25.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.475+0000 7f8354bff700 1 --2- 172.21.15.71:0/586416859 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8330067050 0x7f8330069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.475+0000 7f8354bff700 1 -- 172.21.15.71:0/586416859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83500ac230 msgr2=0x7f8350151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:25.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.475+0000 7f8354bff700 1 --2- 172.21.15.71:0/586416859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83500ac230 0x7f8350151c50 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f83500acc50 tx=0x7f8340017000 comp rx=0 tx=0).stop 2023-10-09T08:14:25.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.475+0000 7f8354bff700 1 -- 172.21.15.71:0/586416859 shutdown_connections 2023-10-09T08:14:25.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.475+0000 7f8354bff700 1 --2- 172.21.15.71:0/586416859 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8330067050 0x7f8330069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.475+0000 7f8354bff700 1 --2- 172.21.15.71:0/586416859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8350155c10 0x7f8350158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.475+0000 7f8354bff700 1 --2- 172.21.15.71:0/586416859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83500ac230 0x7f8350151c50 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.475+0000 7f8354bff700 1 --2- 172.21.15.71:0/586416859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83500ac6d0 0x7f8350158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.475+0000 7f8354bff700 1 -- 172.21.15.71:0/586416859 >> 172.21.15.71:0/586416859 conn(0x7f835006a320 msgr2=0x7f83501549b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:25.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.475+0000 7f8354bff700 1 -- 172.21.15.71:0/586416859 shutdown_connections 2023-10-09T08:14:25.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.476+0000 7f8354bff700 1 -- 172.21.15.71:0/586416859 wait complete. 2023-10-09T08:14:25.478 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 82 2023-10-09T08:14:25.494 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T08:14:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.719+0000 7f711179d700 1 Processor -- start 2023-10-09T08:14:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.719+0000 7f711179d700 1 -- start start 2023-10-09T08:14:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.720+0000 7f711179d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f710c159420 0x7f710c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.720+0000 7f711179d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f710c15d230 0x7f710c15d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.720+0000 7f711179d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710c15dbd0 con 0x7f710c1597f0 2023-10-09T08:14:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.720+0000 7f711179d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f710c0b2980 con 0x7f710c15d230 2023-10-09T08:14:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.720+0000 7f711179d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710c0b11d0 con 0x7f710c159420 2023-10-09T08:14:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.721+0000 7f710b7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f710c1597f0 0x7f710c0b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48204/0 (socket says 172.21.15.71:48204) 2023-10-09T08:14:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.721+0000 7f710b7fe700 1 -- 172.21.15.71:0/1798581060 learned_addr learned my addr 172.21.15.71:0/1798581060 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.721+0000 7f7110f9c700 1 --2- 172.21.15.71:0/1798581060 >> v2:172.21.15.71:3300/0 conn(0x7f710c15d230 0x7f710c15d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.721+0000 7f710bfff700 1 --2- 172.21.15.71:0/1798581060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f710c159420 0x7f710c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.721+0000 7f7110f9c700 1 -- 172.21.15.71:0/1798581060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f710c159420 msgr2=0x7f710c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.721+0000 7f7110f9c700 1 --2- 172.21.15.71:0/1798581060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f710c159420 0x7f710c0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.721+0000 7f7110f9c700 1 -- 172.21.15.71:0/1798581060 >> v1:172.21.15.71:6789/0 conn(0x7f710c1597f0 legacy=0x7f710c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.721+0000 7f7110f9c700 1 -- 172.21.15.71:0/1798581060 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710c0b14b0 con 0x7f710c15d230 2023-10-09T08:14:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.721+0000 7f710affd700 1 -- 172.21.15.71:0/1798581060 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84570785 0 0) 0x7f7100001110 con 0x7f710c1597f0 2023-10-09T08:14:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.722+0000 7f7110f9c700 1 --2- 172.21.15.71:0/1798581060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710c15d230 0x7f710c15d690 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f7104009e60 tx=0x7f7104009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df65bb4aa242fa52 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.722+0000 7f710affd700 1 -- 172.21.15.71:0/1798581060 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710400e070 con 0x7f710c15d230 2023-10-09T08:14:25.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.722+0000 7f710affd700 1 -- 172.21.15.71:0/1798581060 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710400bb60 con 0x7f710c15d230 2023-10-09T08:14:25.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.722+0000 7f710affd700 1 -- 172.21.15.71:0/1798581060 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7104012430 con 0x7f710c15d230 2023-10-09T08:14:25.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.723+0000 7f711179d700 1 -- 172.21.15.71:0/1798581060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710c15d230 msgr2=0x7f710c15d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:25.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.723+0000 7f711179d700 1 --2- 172.21.15.71:0/1798581060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710c15d230 0x7f710c15d690 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f7104009e60 tx=0x7f7104009780 comp rx=0 tx=0).stop 2023-10-09T08:14:25.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.723+0000 7f711179d700 1 -- 172.21.15.71:0/1798581060 shutdown_connections 2023-10-09T08:14:25.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.723+0000 7f711179d700 1 --2- 172.21.15.71:0/1798581060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710c15d230 0x7f710c15d690 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.723+0000 7f711179d700 1 --2- 172.21.15.71:0/1798581060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f710c159420 0x7f710c0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.723+0000 7f711179d700 1 -- 172.21.15.71:0/1798581060 >> 172.21.15.71:0/1798581060 conn(0x7f710c0d0660 msgr2=0x7f710c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:25.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.723+0000 7f711179d700 1 -- 172.21.15.71:0/1798581060 shutdown_connections 2023-10-09T08:14:25.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.723+0000 7f711179d700 1 -- 172.21.15.71:0/1798581060 wait complete. 2023-10-09T08:14:25.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.725+0000 7f711179d700 1 Processor -- start 2023-10-09T08:14:25.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.725+0000 7f711179d700 1 -- start start 2023-10-09T08:14:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.727+0000 7f711179d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f710c159420 0x7f710c15bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.727+0000 7f711179d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710c1597f0 0x7f710c1582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.727+0000 7f711179d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f710c15d230 0x7f710c169940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.727+0000 7f711179d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c159f20 con 0x7f710c1597f0 2023-10-09T08:14:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.727+0000 7f711179d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c158800 con 0x7f710c15d230 2023-10-09T08:14:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.727+0000 7f711179d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710c16a190 con 0x7f710c159420 2023-10-09T08:14:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.727+0000 7f710b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710c1597f0 0x7f710c1582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.727+0000 7f710bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f710c159420 0x7f710c15bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.727+0000 7f710b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710c1597f0 0x7f710c1582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50308/0 (socket says 172.21.15.71:50308) 2023-10-09T08:14:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.727+0000 7f710b7fe700 1 -- 172.21.15.71:0/2294303729 learned_addr learned my addr 172.21.15.71:0/2294303729 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.727+0000 7f7110f9c700 1 --2- 172.21.15.71:0/2294303729 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f710c15d230 0x7f710c169940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.728+0000 7f710bfff700 1 -- 172.21.15.71:0/2294303729 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f710c15d230 msgr2=0x7f710c169940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.728+0000 7f710bfff700 1 --2- 172.21.15.71:0/2294303729 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f710c15d230 0x7f710c169940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.728+0000 7f710bfff700 1 -- 172.21.15.71:0/2294303729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710c1597f0 msgr2=0x7f710c1582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:25.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.728+0000 7f710bfff700 1 --2- 172.21.15.71:0/2294303729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710c1597f0 0x7f710c1582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.728+0000 7f710bfff700 1 -- 172.21.15.71:0/2294303729 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7104009a20 con 0x7f710c159420 2023-10-09T08:14:25.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.728+0000 7f710bfff700 1 --2- 172.21.15.71:0/2294303729 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f710c159420 0x7f710c15bb20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00ea50 tx=0x7f70fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:25.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.728+0000 7f70f3fff700 1 -- 172.21.15.71:0/2294303729 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0095d0 con 0x7f710c159420 2023-10-09T08:14:25.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.728+0000 7f70f3fff700 1 -- 172.21.15.71:0/2294303729 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70fc00c7f0 con 0x7f710c159420 2023-10-09T08:14:25.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.728+0000 7f70f3fff700 1 -- 172.21.15.71:0/2294303729 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc00cbb0 con 0x7f710c159420 2023-10-09T08:14:25.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.728+0000 7f711179d700 1 -- 172.21.15.71:0/2294303729 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710c16a470 con 0x7f710c159420 2023-10-09T08:14:25.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.728+0000 7f711179d700 1 -- 172.21.15.71:0/2294303729 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710c15a170 con 0x7f710c159420 2023-10-09T08:14:25.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.729+0000 7f711179d700 1 -- 172.21.15.71:0/2294303729 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710c15a390 con 0x7f710c159420 2023-10-09T08:14:25.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.730+0000 7f70f3fff700 1 -- 172.21.15.71:0/2294303729 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 88) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f70fc013470 con 0x7f710c159420 2023-10-09T08:14:25.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.731+0000 7f70f3fff700 1 --2- 172.21.15.71:0/2294303729 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f70f8067050 0x7f70f8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:25.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.731+0000 7f70f3fff700 1 -- 172.21.15.71:0/2294303729 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6770+0+0 (secure 0 0 0) 0x7f70fc084b60 con 0x7f710c159420 2023-10-09T08:14:25.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.731+0000 7f710b7fe700 1 -- 172.21.15.71:0/2294303729 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f70f8067050 msgr2=0x7f70f8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:25.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.731+0000 7f710b7fe700 1 --2- 172.21.15.71:0/2294303729 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f70f8067050 0x7f70f8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:14:25.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.735+0000 7f70f3fff700 1 -- 172.21.15.71:0/2294303729 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70fc051890 con 0x7f710c159420 2023-10-09T08:14:25.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.932+0000 7f710b7fe700 1 -- 172.21.15.71:0/2294303729 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f70f8067050 msgr2=0x7f70f8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:25.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.932+0000 7f710b7fe700 1 --2- 172.21.15.71:0/2294303729 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f70f8067050 0x7f70f8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:14:25.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.936+0000 7f711179d700 1 -- 172.21.15.71:0/2294303729 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f710c04c3c0 con 0x7f710c159420 2023-10-09T08:14:25.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.938+0000 7f70f3fff700 1 -- 172.21.15.71:0/2294303729 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+16988 (secure 0 0 0) 0x7f70fc054eb0 con 0x7f710c159420 2023-10-09T08:14:25.939 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:14:25.939 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":181,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T08:14:23.907292+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T07:58:21.144208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T07:58:22.473710+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":181,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.12","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:0/975761648":"2023-10-10T08:09:23.494246+0000","172.21.15.179:0/3488491397":"2023-10-10T08:09:23.494246+0000","172.21.15.179:0/1844939615":"2023-10-10T08:09:23.494246+0000","172.21.15.179:0/2466406124":"2023-10-10T07:58:43.731196+0000","172.21.15.179:0/2942596736":"2023-10-10T08:09:23.494246+0000","172.21.15.179:0/566158543":"2023-10-10T07:58:43.731196+0000","172.21.15.179:6837/85452":"2023-10-10T07:58:43.731196+0000","172.21.15.179:0/2282437587":"2023-10-10T08:09:23.494246+0000","172.21.15.179:6835/85452":"2023-10-10T07:58:43.731196+0000","172.21.15.179:0/1809359224":"2023-10-10T07:58:43.731196+0000","172.21.15.179:0/3234455519":"2023-10-10T08:09:23.494246+0000","172.21.15.179:0/2151068476":"2023-10-10T07:58:43.731196+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T08:14:25.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.940+0000 7f711179d700 1 -- 172.21.15.71:0/2294303729 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f70f8067050 msgr2=0x7f70f8069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:14:25.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.940+0000 7f711179d700 1 --2- 172.21.15.71:0/2294303729 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f70f8067050 0x7f70f8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.940+0000 7f711179d700 1 -- 172.21.15.71:0/2294303729 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f710c159420 msgr2=0x7f710c15bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:25.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.940+0000 7f711179d700 1 --2- 172.21.15.71:0/2294303729 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f710c159420 0x7f710c15bb20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00ea50 tx=0x7f70fc0091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.940+0000 7f711179d700 1 -- 172.21.15.71:0/2294303729 shutdown_connections 2023-10-09T08:14:25.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.940+0000 7f711179d700 1 --2- 172.21.15.71:0/2294303729 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f710c15d230 0x7f710c169940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.940+0000 7f711179d700 1 --2- 172.21.15.71:0/2294303729 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f710c159420 0x7f710c15bb20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.940+0000 7f711179d700 1 --2- 172.21.15.71:0/2294303729 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f70f8067050 0x7f70f8069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.940+0000 7f711179d700 1 --2- 172.21.15.71:0/2294303729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710c1597f0 0x7f710c1582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:25.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.940+0000 7f711179d700 1 -- 172.21.15.71:0/2294303729 >> 172.21.15.71:0/2294303729 conn(0x7f710c0d0660 msgr2=0x7f710c0d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:25.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.940+0000 7f711179d700 1 -- 172.21.15.71:0/2294303729 shutdown_connections 2023-10-09T08:14:25.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:25.940+0000 7f711179d700 1 -- 172.21.15.71:0/2294303729 wait complete. 2023-10-09T08:14:25.959 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T08:14:25.989 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:25.989+0000 7ff035a68180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T08:14:26.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.144+0000 7f934e19d700 1 Processor -- start 2023-10-09T08:14:26.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.144+0000 7f934e19d700 1 -- start start 2023-10-09T08:14:26.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.146+0000 7f934e19d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f93480c6c60 0x7f93480c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:26.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.146+0000 7f934e19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f934806e8c0 0x7f93480c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:26.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.146+0000 7f934e19d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93480b1410 con 0x7f93481595a0 2023-10-09T08:14:26.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.146+0000 7f934e19d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93480b2b90 con 0x7f93480c6c60 2023-10-09T08:14:26.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.146+0000 7f934e19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9348063230 con 0x7f934806e8c0 2023-10-09T08:14:26.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.146+0000 7f934c99a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f93480c6c60 0x7f93480c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:26.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.146+0000 7f934c99a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f93480c6c60 0x7f93480c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50316/0 (socket says 172.21.15.71:50316) 2023-10-09T08:14:26.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.146+0000 7f934c99a700 1 -- 172.21.15.71:0/793205088 learned_addr learned my addr 172.21.15.71:0/793205088 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:26.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.146+0000 7f934d99c700 1 --2- 172.21.15.71:0/793205088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f934806e8c0 0x7f93480c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:26.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.146+0000 7f934c99a700 1 -- 172.21.15.71:0/793205088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f934806e8c0 msgr2=0x7f93480c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:26.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.146+0000 7f934c99a700 1 --2- 172.21.15.71:0/793205088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f934806e8c0 0x7f93480c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:26.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.146+0000 7f934c99a700 1 -- 172.21.15.71:0/793205088 >> v1:172.21.15.179:6789/0 conn(0x7f93481595a0 legacy=0x7f93480b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:26.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.146+0000 7f934c99a700 1 -- 172.21.15.71:0/793205088 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93480634f0 con 0x7f93480c6c60 2023-10-09T08:14:26.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.147+0000 7f934c99a700 1 --2- 172.21.15.71:0/793205088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93480c6c60 0x7f93480c8120 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f93380099b0 tx=0x7f9338009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d013498a043ef0b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:26.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.147+0000 7f933ffff700 1 -- 172.21.15.71:0/793205088 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933800b860 con 0x7f93480c6c60 2023-10-09T08:14:26.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.147+0000 7f933ffff700 1 -- 172.21.15.71:0/793205088 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933800b9c0 con 0x7f93480c6c60 2023-10-09T08:14:26.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.147+0000 7f933ffff700 1 -- 172.21.15.71:0/793205088 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933800bd60 con 0x7f93480c6c60 2023-10-09T08:14:26.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.147+0000 7f934e19d700 1 -- 172.21.15.71:0/793205088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93480c6c60 msgr2=0x7f93480c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:26.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.147+0000 7f934e19d700 1 --2- 172.21.15.71:0/793205088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93480c6c60 0x7f93480c8120 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f93380099b0 tx=0x7f9338009250 comp rx=0 tx=0).stop 2023-10-09T08:14:26.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.148+0000 7f934e19d700 1 -- 172.21.15.71:0/793205088 shutdown_connections 2023-10-09T08:14:26.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.148+0000 7f934e19d700 1 --2- 172.21.15.71:0/793205088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f934806e8c0 0x7f93480c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:26.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.148+0000 7f934e19d700 1 --2- 172.21.15.71:0/793205088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93480c6c60 0x7f93480c8120 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:26.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.148+0000 7f934e19d700 1 -- 172.21.15.71:0/793205088 >> 172.21.15.71:0/793205088 conn(0x7f934806ddb0 msgr2=0x7f934806e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:26.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.148+0000 7f934e19d700 1 -- 172.21.15.71:0/793205088 shutdown_connections 2023-10-09T08:14:26.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.148+0000 7f934e19d700 1 -- 172.21.15.71:0/793205088 wait complete. 2023-10-09T08:14:26.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.149+0000 7f934e19d700 1 Processor -- start 2023-10-09T08:14:26.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.149+0000 7f934e19d700 1 -- start start 2023-10-09T08:14:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.150+0000 7f934e19d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f934806e8c0 0x7f9348143660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.150+0000 7f934e19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93480c6c60 0x7f9348153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.150+0000 7f934e19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93481595a0 0x7f9348157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.150+0000 7f934e19d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934816ad10 con 0x7f934806e8c0 2023-10-09T08:14:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.150+0000 7f934e19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9348169b80 con 0x7f93481595a0 2023-10-09T08:14:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.150+0000 7f934e19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9348169e40 con 0x7f93480c6c60 2023-10-09T08:14:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.150+0000 7f934d19b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f934806e8c0 0x7f9348143660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.151+0000 7f934d19b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f934806e8c0 0x7f9348143660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50332/0 (socket says 172.21.15.71:50332) 2023-10-09T08:14:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.151+0000 7f934d19b700 1 -- 172.21.15.71:0/659176715 learned_addr learned my addr 172.21.15.71:0/659176715 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.151+0000 7f934c99a700 1 --2- 172.21.15.71:0/659176715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93480c6c60 0x7f9348153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.151+0000 7f934d99c700 1 --2- 172.21.15.71:0/659176715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93481595a0 0x7f9348157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.151+0000 7f934d19b700 1 -- 172.21.15.71:0/659176715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93480c6c60 msgr2=0x7f9348153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.151+0000 7f934d19b700 1 --2- 172.21.15.71:0/659176715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93480c6c60 0x7f9348153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.151+0000 7f934d19b700 1 -- 172.21.15.71:0/659176715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93481595a0 msgr2=0x7f9348157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.151+0000 7f934d19b700 1 --2- 172.21.15.71:0/659176715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93481595a0 0x7f9348157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.151+0000 7f934d19b700 1 -- 172.21.15.71:0/659176715 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93380094f0 con 0x7f934806e8c0 2023-10-09T08:14:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.151+0000 7f934d19b700 1 --2- 172.21.15.71:0/659176715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f934806e8c0 0x7f9348143660 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f934400c4e0 tx=0x7f934400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.151+0000 7f933d7fa700 1 -- 172.21.15.71:0/659176715 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9344011590 con 0x7f934806e8c0 2023-10-09T08:14:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.151+0000 7f933d7fa700 1 -- 172.21.15.71:0/659176715 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9344011710 con 0x7f934806e8c0 2023-10-09T08:14:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.152+0000 7f934e19d700 1 -- 172.21.15.71:0/659176715 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934816a120 con 0x7f934806e8c0 2023-10-09T08:14:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.152+0000 7f933d7fa700 1 -- 172.21.15.71:0/659176715 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9344011ad0 con 0x7f934806e8c0 2023-10-09T08:14:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.152+0000 7f934e19d700 1 -- 172.21.15.71:0/659176715 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934816a6e0 con 0x7f934806e8c0 2023-10-09T08:14:26.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.153+0000 7f934e19d700 1 -- 172.21.15.71:0/659176715 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9348152170 con 0x7f934806e8c0 2023-10-09T08:14:26.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.154+0000 7f933d7fa700 1 -- 172.21.15.71:0/659176715 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 88) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f934401b3b0 con 0x7f934806e8c0 2023-10-09T08:14:26.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.154+0000 7f933d7fa700 1 --2- 172.21.15.71:0/659176715 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f932c067050 0x7f932c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:26.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.155+0000 7f933d7fa700 1 -- 172.21.15.71:0/659176715 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6770+0+0 (secure 0 0 0) 0x7f9344083ee0 con 0x7f934806e8c0 2023-10-09T08:14:26.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.155+0000 7f934c99a700 1 -- 172.21.15.71:0/659176715 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f932c067050 msgr2=0x7f932c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:26.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.155+0000 7f934c99a700 1 --2- 172.21.15.71:0/659176715 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f932c067050 0x7f932c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:14:26.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.159+0000 7f933d7fa700 1 -- 172.21.15.71:0/659176715 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9344050c10 con 0x7f934806e8c0 2023-10-09T08:14:26.212 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:26.211+0000 7fbd6bc36180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T08:14:26.277 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:26.277+0000 7ff035a68180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T08:14:26.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.356+0000 7f934c99a700 1 -- 172.21.15.71:0/659176715 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f932c067050 msgr2=0x7f932c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:26.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.356+0000 7f934c99a700 1 --2- 172.21.15.71:0/659176715 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f932c067050 0x7f932c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:14:26.371 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:26.371+0000 7ff035a68180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T08:14:26.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.399+0000 7f934e19d700 1 -- 172.21.15.71:0/659176715 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f934804c3c0 con 0x7f934806e8c0 2023-10-09T08:14:26.400 INFO:tasks.ceph.mon.a.smithi071.stderr:2023-10-09T08:14:26.400+0000 7fdb445f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T08:14:26.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.408+0000 7f933d7fa700 1 -- 172.21.15.71:0/659176715 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v83) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9344017070 con 0x7f934806e8c0 2023-10-09T08:14:26.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.412+0000 7f934e19d700 1 -- 172.21.15.71:0/659176715 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f932c067050 msgr2=0x7f932c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:14:26.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.412+0000 7f934e19d700 1 --2- 172.21.15.71:0/659176715 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f932c067050 0x7f932c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:26.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.412+0000 7f934e19d700 1 -- 172.21.15.71:0/659176715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f934806e8c0 msgr2=0x7f9348143660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:26.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.412+0000 7f934e19d700 1 --2- 172.21.15.71:0/659176715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f934806e8c0 0x7f9348143660 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f934400c4e0 tx=0x7f934400c7f0 comp rx=0 tx=0).stop 2023-10-09T08:14:26.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.412+0000 7f934e19d700 1 -- 172.21.15.71:0/659176715 shutdown_connections 2023-10-09T08:14:26.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.412+0000 7f934e19d700 1 --2- 172.21.15.71:0/659176715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93481595a0 0x7f9348157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:26.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.412+0000 7f934e19d700 1 --2- 172.21.15.71:0/659176715 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f932c067050 0x7f932c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:26.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.412+0000 7f934e19d700 1 --2- 172.21.15.71:0/659176715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f934806e8c0 0x7f9348143660 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:26.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.412+0000 7f934e19d700 1 --2- 172.21.15.71:0/659176715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93480c6c60 0x7f9348153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:26.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.412+0000 7f934e19d700 1 -- 172.21.15.71:0/659176715 >> 172.21.15.71:0/659176715 conn(0x7f934806ddb0 msgr2=0x7f9348151a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:26.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.412+0000 7f934e19d700 1 -- 172.21.15.71:0/659176715 shutdown_connections 2023-10-09T08:14:26.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.412+0000 7f934e19d700 1 -- 172.21.15.71:0/659176715 wait complete. 2023-10-09T08:14:26.414 INFO:teuthology.orchestra.run.smithi071.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T08:14:26.440 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T08:14:26.494 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-10-09T08:14:26.523 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:26.522+0000 7fbd6bc36180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T08:14:26.533 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:26.533+0000 7ff035a68180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T08:14:26.622 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:26.621+0000 7fbd6bc36180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T08:14:26.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.632+0000 7f79ebfff700 1 Processor -- start 2023-10-09T08:14:26.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.633+0000 7f79ebfff700 1 -- start start 2023-10-09T08:14:26.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.634+0000 7f79ebfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f79ec140bb0 0x7f79ec06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:26.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.634+0000 7f79ebfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79ec06da30 0x7f79ec0c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:26.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.634+0000 7f79ebfff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79ec0c6820 con 0x7f79ec1407e0 2023-10-09T08:14:26.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.634+0000 7f79ebfff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79ec06deb0 con 0x7f79ec140bb0 2023-10-09T08:14:26.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.634+0000 7f79ebfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec0c6de0 con 0x7f79ec06da30 2023-10-09T08:14:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.634+0000 7f79eaffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f79ec1407e0 0x7f79ec06a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48218/0 (socket says 172.21.15.71:48218) 2023-10-09T08:14:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.634+0000 7f79eaffd700 1 -- 172.21.15.71:0/1092940327 learned_addr learned my addr 172.21.15.71:0/1092940327 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.634+0000 7f79ea7fc700 1 --2- 172.21.15.71:0/1092940327 >> v2:172.21.15.71:3300/0 conn(0x7f79ec140bb0 0x7f79ec06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.634+0000 7f79eb7fe700 1 --2- 172.21.15.71:0/1092940327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79ec06da30 0x7f79ec0c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:26.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.635+0000 7f79ea7fc700 1 -- 172.21.15.71:0/1092940327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79ec06da30 msgr2=0x7f79ec0c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:26.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.635+0000 7f79ea7fc700 1 --2- 172.21.15.71:0/1092940327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79ec06da30 0x7f79ec0c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:26.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.635+0000 7f79ea7fc700 1 -- 172.21.15.71:0/1092940327 >> v1:172.21.15.71:6789/0 conn(0x7f79ec1407e0 legacy=0x7f79ec06a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:26.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.635+0000 7f79ea7fc700 1 -- 172.21.15.71:0/1092940327 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ec141270 con 0x7f79ec140bb0 2023-10-09T08:14:26.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.635+0000 7f79e9ffb700 1 -- 172.21.15.71:0/1092940327 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127843332 0 0) 0x7f79ec0c6820 con 0x7f79ec1407e0 2023-10-09T08:14:26.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.635+0000 7f79ea7fc700 1 --2- 172.21.15.71:0/1092940327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79ec140bb0 0x7f79ec06d4f0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f79e00098e0 tx=0x7f79e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5512e7ad443dc44 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:26.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.635+0000 7f79e9ffb700 1 -- 172.21.15.71:0/1092940327 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e000b640 con 0x7f79ec140bb0 2023-10-09T08:14:26.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.635+0000 7f79e9ffb700 1 -- 172.21.15.71:0/1092940327 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e000b7a0 con 0x7f79ec140bb0 2023-10-09T08:14:26.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.635+0000 7f79e9ffb700 1 -- 172.21.15.71:0/1092940327 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e000bb40 con 0x7f79ec140bb0 2023-10-09T08:14:26.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.636+0000 7f79ebfff700 1 -- 172.21.15.71:0/1092940327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79ec140bb0 msgr2=0x7f79ec06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:26.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.636+0000 7f79ebfff700 1 --2- 172.21.15.71:0/1092940327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79ec140bb0 0x7f79ec06d4f0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f79e00098e0 tx=0x7f79e00091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:26.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.636+0000 7f79ebfff700 1 -- 172.21.15.71:0/1092940327 shutdown_connections 2023-10-09T08:14:26.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.636+0000 7f79ebfff700 1 --2- 172.21.15.71:0/1092940327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79ec06da30 0x7f79ec0c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:26.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.636+0000 7f79ebfff700 1 --2- 172.21.15.71:0/1092940327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79ec140bb0 0x7f79ec06d4f0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:26.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.636+0000 7f79ebfff700 1 -- 172.21.15.71:0/1092940327 >> 172.21.15.71:0/1092940327 conn(0x7f79ec0cc1e0 msgr2=0x7f79ec0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:26.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.636+0000 7f79ebfff700 1 -- 172.21.15.71:0/1092940327 shutdown_connections 2023-10-09T08:14:26.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.636+0000 7f79ebfff700 1 -- 172.21.15.71:0/1092940327 wait complete. 2023-10-09T08:14:26.640 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:26.637+0000 7ff035a68180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T08:14:26.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.638+0000 7f79ebfff700 1 Processor -- start 2023-10-09T08:14:26.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.638+0000 7f79ebfff700 1 -- start start 2023-10-09T08:14:26.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.639+0000 7f79ebfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79ec06da30 0x7f79ec16df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:26.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.639+0000 7f79ebfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79ec1407e0 0x7f79ec169880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:26.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.639+0000 7f79ebfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79ec140bb0 0x7f79ec0c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:26.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.639+0000 7f79ebfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec16ae50 con 0x7f79ec1407e0 2023-10-09T08:14:26.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.639+0000 7f79ebfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec16e480 con 0x7f79ec140bb0 2023-10-09T08:14:26.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.639+0000 7f79ebfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec16a240 con 0x7f79ec06da30 2023-10-09T08:14:26.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.639+0000 7f79ea7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79ec1407e0 0x7f79ec169880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:26.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.639+0000 7f79eaffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79ec06da30 0x7f79ec16df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:26.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.639+0000 7f79ea7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79ec1407e0 0x7f79ec169880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50374/0 (socket says 172.21.15.71:50374) 2023-10-09T08:14:26.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.639+0000 7f79ea7fc700 1 -- 172.21.15.71:0/787539712 learned_addr learned my addr 172.21.15.71:0/787539712 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:26.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.639+0000 7f79eb7fe700 1 --2- 172.21.15.71:0/787539712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79ec140bb0 0x7f79ec0c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:26.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.639+0000 7f79ea7fc700 1 -- 172.21.15.71:0/787539712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79ec06da30 msgr2=0x7f79ec16df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:26.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.639+0000 7f79ea7fc700 1 --2- 172.21.15.71:0/787539712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79ec06da30 0x7f79ec16df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:26.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.639+0000 7f79ea7fc700 1 -- 172.21.15.71:0/787539712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79ec140bb0 msgr2=0x7f79ec0c1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:26.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.639+0000 7f79ea7fc700 1 --2- 172.21.15.71:0/787539712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79ec140bb0 0x7f79ec0c1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:26.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.639+0000 7f79ea7fc700 1 -- 172.21.15.71:0/787539712 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e0009420 con 0x7f79ec1407e0 2023-10-09T08:14:26.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.639+0000 7f79eaffd700 1 --2- 172.21.15.71:0/787539712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79ec06da30 0x7f79ec16df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:14:26.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.640+0000 7f79ea7fc700 1 --2- 172.21.15.71:0/787539712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79ec1407e0 0x7f79ec169880 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009f80 tx=0x7f79e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:26.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.640+0000 7f79d2ffd700 1 -- 172.21.15.71:0/787539712 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e000b910 con 0x7f79ec1407e0 2023-10-09T08:14:26.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.640+0000 7f79d2ffd700 1 -- 172.21.15.71:0/787539712 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e000ba70 con 0x7f79ec1407e0 2023-10-09T08:14:26.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.640+0000 7f79ebfff700 1 -- 172.21.15.71:0/787539712 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ec16a520 con 0x7f79ec1407e0 2023-10-09T08:14:26.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.640+0000 7f79d2ffd700 1 -- 172.21.15.71:0/787539712 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e0024670 con 0x7f79ec1407e0 2023-10-09T08:14:26.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.640+0000 7f79ebfff700 1 -- 172.21.15.71:0/787539712 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79ec16aae0 con 0x7f79ec1407e0 2023-10-09T08:14:26.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.641+0000 7f79ebfff700 1 -- 172.21.15.71:0/787539712 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79ec06c450 con 0x7f79ec1407e0 2023-10-09T08:14:26.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.642+0000 7f79d2ffd700 1 -- 172.21.15.71:0/787539712 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 88) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f79e0024aa0 con 0x7f79ec1407e0 2023-10-09T08:14:26.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.643+0000 7f79d2ffd700 1 --2- 172.21.15.71:0/787539712 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f79d8067050 0x7f79d8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:26.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.643+0000 7f79d2ffd700 1 -- 172.21.15.71:0/787539712 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f79e00864e0 con 0x7f79ec1407e0 2023-10-09T08:14:26.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.643+0000 7f79eaffd700 1 -- 172.21.15.71:0/787539712 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f79d8067050 msgr2=0x7f79d8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:26.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.643+0000 7f79eaffd700 1 --2- 172.21.15.71:0/787539712 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f79d8067050 0x7f79d8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:14:26.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.651+0000 7f79d2ffd700 1 -- 172.21.15.71:0/787539712 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79e0053140 con 0x7f79ec1407e0 2023-10-09T08:14:26.785 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:26.784+0000 7fbd6bc36180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T08:14:26.829 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:26.829+0000 7ff035a68180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T08:14:26.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.844+0000 7f79eaffd700 1 -- 172.21.15.71:0/787539712 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f79d8067050 msgr2=0x7f79d8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:26.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.844+0000 7f79eaffd700 1 --2- 172.21.15.71:0/787539712 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f79d8067050 0x7f79d8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:14:26.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:26.888+0000 7f79ebfff700 1 -- 172.21.15.71:0/787539712 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f79ec16af90 con 0x7f79ec1407e0 2023-10-09T08:14:26.892 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:26.892+0000 7fbd6bc36180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T08:14:26.898 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:14:26.902 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:14:26.921 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:26.921+0000 7ff035a68180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T08:14:27.020 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:27.020+0000 7ff035a68180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T08:14:27.090 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:27.089+0000 7fbd6bc36180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T08:14:27.114 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:27.114+0000 7ff035a68180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T08:14:27.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.123+0000 7f79d2ffd700 1 -- 172.21.15.71:0/787539712 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 89) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f79e0024d50 con 0x7f79ec1407e0 2023-10-09T08:14:27.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.123+0000 7f79d2ffd700 1 -- 172.21.15.71:0/787539712 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f79d8067050 msgr2=0x7f79d8069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:14:27.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.123+0000 7f79d2ffd700 1 --2- 172.21.15.71:0/787539712 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f79d8067050 0x7f79d8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:27.191 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:27.190+0000 7fefb3dc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:14:27.191 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:27.190+0000 7fefb3dc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:14:27.191 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:27.190+0000 7fefb3dc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:14:27.191 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:27.190+0000 7fefb3dc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:14:27.191 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:27.190+0000 7fefb3dc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:14:27.192 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:27.190+0000 7fefafdc1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:14:27.192 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:27.190+0000 7fefafdc1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:14:27.192 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:27.190+0000 7fefafdc1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:14:27.192 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:27.190+0000 7fefafdc1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:14:27.192 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:27.190+0000 7fefafdc1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:14:27.192 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:27.190+0000 7fbd6bc36180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T08:14:27.284 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:27.283+0000 7fbd6bc36180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T08:14:27.378 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:27.377+0000 7fbd6bc36180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T08:14:27.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.406+0000 7f79d2ffd700 1 -- 172.21.15.71:0/787539712 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v84) v1 ==== 104+0+0 (secure 0 0 0) 0x7f79e0088240 con 0x7f79ec1407e0 2023-10-09T08:14:27.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.409+0000 7f79ebfff700 1 -- 172.21.15.71:0/787539712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79ec1407e0 msgr2=0x7f79ec169880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:27.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.409+0000 7f79ebfff700 1 --2- 172.21.15.71:0/787539712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79ec1407e0 0x7f79ec169880 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009f80 tx=0x7f79e0017000 comp rx=0 tx=0).stop 2023-10-09T08:14:27.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.409+0000 7f79ebfff700 1 -- 172.21.15.71:0/787539712 shutdown_connections 2023-10-09T08:14:27.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.409+0000 7f79ebfff700 1 --2- 172.21.15.71:0/787539712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79ec140bb0 0x7f79ec0c1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:27.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.409+0000 7f79ebfff700 1 --2- 172.21.15.71:0/787539712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79ec06da30 0x7f79ec16df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:27.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.409+0000 7f79ebfff700 1 --2- 172.21.15.71:0/787539712 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f79d8067050 0x7f79d8069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:27.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.409+0000 7f79ebfff700 1 --2- 172.21.15.71:0/787539712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79ec1407e0 0x7f79ec169880 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:27.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.409+0000 7f79ebfff700 1 -- 172.21.15.71:0/787539712 >> 172.21.15.71:0/787539712 conn(0x7f79ec0cc1e0 msgr2=0x7f79ec0b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:27.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.409+0000 7f79ebfff700 1 -- 172.21.15.71:0/787539712 shutdown_connections 2023-10-09T08:14:27.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.409+0000 7f79ebfff700 1 -- 172.21.15.71:0/787539712 wait complete. 2023-10-09T08:14:27.428 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T08:14:27.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.613+0000 7fa3665ff700 1 Processor -- start 2023-10-09T08:14:27.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.613+0000 7fa3665ff700 1 -- start start 2023-10-09T08:14:27.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.614+0000 7fa3665ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa360157740 0x7fa3600adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:27.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.614+0000 7fa3665ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3600b2100 0x7fa360068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:27.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.614+0000 7fa3665ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa3600688d0 0x7fa360069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:27.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.614+0000 7fa3665ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3600acc00 con 0x7fa3600688d0 2023-10-09T08:14:27.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.614+0000 7fa3665ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa36006d6a0 con 0x7fa360157740 2023-10-09T08:14:27.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.614+0000 7fa3665ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa360068d50 con 0x7fa3600b2100 2023-10-09T08:14:27.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.615+0000 7fa364b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa3600688d0 0x7fa360069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:27.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.615+0000 7fa364b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa3600688d0 0x7fa360069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50390/0 (socket says 172.21.15.71:50390) 2023-10-09T08:14:27.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.615+0000 7fa364b9c700 1 -- 172.21.15.71:0/1879549333 learned_addr learned my addr 172.21.15.71:0/1879549333 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:27.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.615+0000 7fa35ffff700 1 --2- 172.21.15.71:0/1879549333 >> v2:172.21.15.179:3300/0 conn(0x7fa360157740 0x7fa3600adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:27.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.615+0000 7fa35f7fe700 1 --2- 172.21.15.71:0/1879549333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3600b2100 0x7fa360068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:27.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.615+0000 7fa364b9c700 1 -- 172.21.15.71:0/1879549333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3600b2100 msgr2=0x7fa360068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:27.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.615+0000 7fa364b9c700 1 --2- 172.21.15.71:0/1879549333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3600b2100 0x7fa360068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:27.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.615+0000 7fa364b9c700 1 -- 172.21.15.71:0/1879549333 >> v2:172.21.15.179:3300/0 conn(0x7fa360157740 msgr2=0x7fa3600adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:27.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.615+0000 7fa364b9c700 1 --2- 172.21.15.71:0/1879549333 >> v2:172.21.15.179:3300/0 conn(0x7fa360157740 0x7fa3600adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:27.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.615+0000 7fa364b9c700 1 -- 172.21.15.71:0/1879549333 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36006dc20 con 0x7fa3600688d0 2023-10-09T08:14:27.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.616+0000 7fa364b9c700 1 --2- 172.21.15.71:0/1879549333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3600688d0 0x7fa360069800 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fa3600abfa0 tx=0x7fa358009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a72cf369d39011aa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:27.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.616+0000 7fa35effd700 1 -- 172.21.15.71:0/1879549333 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35800e070 con 0x7fa3600688d0 2023-10-09T08:14:27.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.616+0000 7fa35effd700 1 -- 172.21.15.71:0/1879549333 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35800b930 con 0x7fa3600688d0 2023-10-09T08:14:27.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.616+0000 7fa35effd700 1 -- 172.21.15.71:0/1879549333 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3580092e0 con 0x7fa3600688d0 2023-10-09T08:14:27.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.616+0000 7fa3665ff700 1 -- 172.21.15.71:0/1879549333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3600688d0 msgr2=0x7fa360069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:27.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.616+0000 7fa3665ff700 1 --2- 172.21.15.71:0/1879549333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3600688d0 0x7fa360069800 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fa3600abfa0 tx=0x7fa358009840 comp rx=0 tx=0).stop 2023-10-09T08:14:27.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.616+0000 7fa3665ff700 1 -- 172.21.15.71:0/1879549333 shutdown_connections 2023-10-09T08:14:27.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.616+0000 7fa3665ff700 1 --2- 172.21.15.71:0/1879549333 >> v2:172.21.15.179:3300/0 conn(0x7fa360157740 0x7fa3600adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:27.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.616+0000 7fa3665ff700 1 --2- 172.21.15.71:0/1879549333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3600688d0 0x7fa360069800 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:27.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.616+0000 7fa3665ff700 1 --2- 172.21.15.71:0/1879549333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3600b2100 0x7fa360068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:27.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.616+0000 7fa3665ff700 1 -- 172.21.15.71:0/1879549333 >> 172.21.15.71:0/1879549333 conn(0x7fa3600c8f90 msgr2=0x7fa3600c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:27.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.616+0000 7fa3665ff700 1 -- 172.21.15.71:0/1879549333 shutdown_connections 2023-10-09T08:14:27.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.617+0000 7fa3665ff700 1 -- 172.21.15.71:0/1879549333 wait complete. 2023-10-09T08:14:27.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.618+0000 7fa3665ff700 1 Processor -- start 2023-10-09T08:14:27.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.618+0000 7fa3665ff700 1 -- start start 2023-10-09T08:14:27.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.619+0000 7fa3665ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3600688d0 0x7fa360167460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:27.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.619+0000 7fa3665ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3600b2100 0x7fa36016a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:27.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.619+0000 7fa3665ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa360157740 0x7fa360159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:27.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.619+0000 7fa3665ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36016a820 con 0x7fa3600b2100 2023-10-09T08:14:27.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.619+0000 7fa3665ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36015a830 con 0x7fa3600688d0 2023-10-09T08:14:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.619+0000 7fa3665ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa360159c60 con 0x7fa360157740 2023-10-09T08:14:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.619+0000 7fa35f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3600b2100 0x7fa36016a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.619+0000 7fa35f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3600b2100 0x7fa36016a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50396/0 (socket says 172.21.15.71:50396) 2023-10-09T08:14:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.619+0000 7fa35f7fe700 1 -- 172.21.15.71:0/67143774 learned_addr learned my addr 172.21.15.71:0/67143774 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.619+0000 7fa364b9c700 1 --2- 172.21.15.71:0/67143774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa360157740 0x7fa360159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.619+0000 7fa35ffff700 1 --2- 172.21.15.71:0/67143774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3600688d0 0x7fa360167460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.619+0000 7fa35f7fe700 1 -- 172.21.15.71:0/67143774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa360157740 msgr2=0x7fa360159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.620+0000 7fa35f7fe700 1 --2- 172.21.15.71:0/67143774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa360157740 0x7fa360159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.620+0000 7fa35f7fe700 1 -- 172.21.15.71:0/67143774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3600688d0 msgr2=0x7fa360167460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.620+0000 7fa35f7fe700 1 --2- 172.21.15.71:0/67143774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3600688d0 0x7fa360167460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.620+0000 7fa35f7fe700 1 -- 172.21.15.71:0/67143774 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa358009ae0 con 0x7fa3600b2100 2023-10-09T08:14:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.620+0000 7fa35f7fe700 1 --2- 172.21.15.71:0/67143774 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3600b2100 0x7fa36016a2e0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fa35400ec80 tx=0x7fa3540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:27.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.620+0000 7fa347fff700 1 -- 172.21.15.71:0/67143774 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35400c8e0 con 0x7fa3600b2100 2023-10-09T08:14:27.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.620+0000 7fa347fff700 1 -- 172.21.15.71:0/67143774 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35400ca60 con 0x7fa3600b2100 2023-10-09T08:14:27.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.620+0000 7fa3665ff700 1 -- 172.21.15.71:0/67143774 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa360159f00 con 0x7fa3600b2100 2023-10-09T08:14:27.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.620+0000 7fa347fff700 1 -- 172.21.15.71:0/67143774 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35400ce20 con 0x7fa3600b2100 2023-10-09T08:14:27.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.620+0000 7fa3665ff700 1 -- 172.21.15.71:0/67143774 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36015a4c0 con 0x7fa3600b2100 2023-10-09T08:14:27.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.621+0000 7fa3665ff700 1 -- 172.21.15.71:0/67143774 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa36015a9c0 con 0x7fa3600b2100 2023-10-09T08:14:27.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.622+0000 7fa347fff700 1 -- 172.21.15.71:0/67143774 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 89) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fa354013680 con 0x7fa3600b2100 2023-10-09T08:14:27.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.623+0000 7fa347fff700 1 -- 172.21.15.71:0/67143774 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 7172+0+0 (secure 0 0 0) 0x7fa354084960 con 0x7fa3600b2100 2023-10-09T08:14:27.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.627+0000 7fa347fff700 1 -- 172.21.15.71:0/67143774 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3540518e0 con 0x7fa3600b2100 2023-10-09T08:14:27.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:27.815+0000 7fa3665ff700 1 -- 172.21.15.71:0/67143774 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa3600718b0 con 0x7fa3600b2100 2023-10-09T08:14:28.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.128+0000 7fa347fff700 1 -- 172.21.15.71:0/67143774 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 90) v1 ==== 84578+0+0 (secure 0 0 0) 0x7fa354051390 con 0x7fa3600b2100 2023-10-09T08:14:28.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.128+0000 7fa347fff700 1 --2- 172.21.15.71:0/67143774 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa34c06ce80 0x7fa34c06f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:28.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.130+0000 7fa35ffff700 1 --2- 172.21.15.71:0/67143774 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa34c06ce80 0x7fa34c06f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:28.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.136+0000 7fa35ffff700 1 --2- 172.21.15.71:0/67143774 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa34c06ce80 0x7fa34c06f260 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa350009d10 tx=0x7fa3500091a0 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:28.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.409+0000 7fa347fff700 1 -- 172.21.15.71:0/67143774 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v184) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa35406fe30 con 0x7fa3600b2100 2023-10-09T08:14:28.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.413+0000 7fa3665ff700 1 -- 172.21.15.71:0/67143774 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa34c06ce80 msgr2=0x7fa34c06f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:28.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.413+0000 7fa3665ff700 1 --2- 172.21.15.71:0/67143774 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa34c06ce80 0x7fa34c06f260 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa350009d10 tx=0x7fa3500091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:28.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.413+0000 7fa3665ff700 1 -- 172.21.15.71:0/67143774 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3600b2100 msgr2=0x7fa36016a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:28.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.413+0000 7fa3665ff700 1 --2- 172.21.15.71:0/67143774 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3600b2100 0x7fa36016a2e0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fa35400ec80 tx=0x7fa3540091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:28.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.413+0000 7fa3665ff700 1 -- 172.21.15.71:0/67143774 shutdown_connections 2023-10-09T08:14:28.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.413+0000 7fa3665ff700 1 --2- 172.21.15.71:0/67143774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa360157740 0x7fa360159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:28.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.413+0000 7fa3665ff700 1 --2- 172.21.15.71:0/67143774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3600688d0 0x7fa360167460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:28.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.413+0000 7fa3665ff700 1 --2- 172.21.15.71:0/67143774 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa34c06ce80 0x7fa34c06f260 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:28.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.413+0000 7fa3665ff700 1 --2- 172.21.15.71:0/67143774 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3600b2100 0x7fa36016a2e0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:28.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.413+0000 7fa3665ff700 1 -- 172.21.15.71:0/67143774 >> 172.21.15.71:0/67143774 conn(0x7fa3600c8f90 msgr2=0x7fa3600cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:28.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.413+0000 7fa3665ff700 1 -- 172.21.15.71:0/67143774 shutdown_connections 2023-10-09T08:14:28.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.413+0000 7fa3665ff700 1 -- 172.21.15.71:0/67143774 wait complete. 2023-10-09T08:14:28.415 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' removed 2023-10-09T08:14:28.432 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T08:14:28.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.617+0000 7f60b0d9d700 1 Processor -- start 2023-10-09T08:14:28.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.617+0000 7f60b0d9d700 1 -- start start 2023-10-09T08:14:28.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.618+0000 7f60b0d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f60ac15b050 0x7f60ac0ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:28.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.618+0000 7f60b0d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f60ac15bb30 0x7f60ac0ada30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:28.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.618+0000 7f60b0d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60ac157a50 con 0x7f60ac0cc8d0 2023-10-09T08:14:28.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.618+0000 7f60b0d9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60ac158f10 con 0x7f60ac15b050 2023-10-09T08:14:28.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.618+0000 7f60b0d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60ac1591b0 con 0x7f60ac15bb30 2023-10-09T08:14:28.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.618+0000 7f60ab7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f60ac15b050 0x7f60ac0ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:28.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.618+0000 7f60ab7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f60ac15b050 0x7f60ac0ca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50410/0 (socket says 172.21.15.71:50410) 2023-10-09T08:14:28.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.618+0000 7f60ab7fe700 1 -- 172.21.15.71:0/2745998729 learned_addr learned my addr 172.21.15.71:0/2745998729 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:28.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.618+0000 7f60abfff700 1 --2- 172.21.15.71:0/2745998729 >> v2:172.21.15.179:3300/0 conn(0x7f60ac15bb30 0x7f60ac0ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:28.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.619+0000 7f60ab7fe700 1 -- 172.21.15.71:0/2745998729 >> v2:172.21.15.179:3300/0 conn(0x7f60ac15bb30 msgr2=0x7f60ac0ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:28.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.619+0000 7f60ab7fe700 1 --2- 172.21.15.71:0/2745998729 >> v2:172.21.15.179:3300/0 conn(0x7f60ac15bb30 0x7f60ac0ada30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:28.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.619+0000 7f60ab7fe700 1 -- 172.21.15.71:0/2745998729 >> v1:172.21.15.179:6789/0 conn(0x7f60ac0cc8d0 legacy=0x7f60ac15b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:28.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.619+0000 7f60ab7fe700 1 -- 172.21.15.71:0/2745998729 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac0ca9e0 con 0x7f60ac15b050 2023-10-09T08:14:28.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.619+0000 7f60ab7fe700 1 --2- 172.21.15.71:0/2745998729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60ac15b050 0x7f60ac0ca100 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0645e0 tx=0x7f609c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554553649fb7e69d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:28.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.619+0000 7f60aa7fc700 1 -- 172.21.15.71:0/2745998729 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c009e70 con 0x7f60ac15b050 2023-10-09T08:14:28.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.619+0000 7f60aa7fc700 1 -- 172.21.15.71:0/2745998729 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c00b860 con 0x7f60ac15b050 2023-10-09T08:14:28.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.619+0000 7f60aa7fc700 1 -- 172.21.15.71:0/2745998729 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c00bc00 con 0x7f60ac15b050 2023-10-09T08:14:28.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.620+0000 7f60b0d9d700 1 -- 172.21.15.71:0/2745998729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60ac15b050 msgr2=0x7f60ac0ca100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:28.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.620+0000 7f60b0d9d700 1 --2- 172.21.15.71:0/2745998729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60ac15b050 0x7f60ac0ca100 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0645e0 tx=0x7f609c009250 comp rx=0 tx=0).stop 2023-10-09T08:14:28.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.620+0000 7f60b0d9d700 1 -- 172.21.15.71:0/2745998729 shutdown_connections 2023-10-09T08:14:28.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.620+0000 7f60b0d9d700 1 --2- 172.21.15.71:0/2745998729 >> v2:172.21.15.179:3300/0 conn(0x7f60ac15bb30 0x7f60ac0ada30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:28.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.620+0000 7f60b0d9d700 1 --2- 172.21.15.71:0/2745998729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60ac15b050 0x7f60ac0ca100 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:28.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.620+0000 7f60b0d9d700 1 -- 172.21.15.71:0/2745998729 >> 172.21.15.71:0/2745998729 conn(0x7f60ac068e20 msgr2=0x7f60ac0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:28.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.620+0000 7f60b0d9d700 1 -- 172.21.15.71:0/2745998729 shutdown_connections 2023-10-09T08:14:28.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.620+0000 7f60b0d9d700 1 -- 172.21.15.71:0/2745998729 wait complete. 2023-10-09T08:14:28.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.621+0000 7f60b0d9d700 1 Processor -- start 2023-10-09T08:14:28.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.621+0000 7f60b0d9d700 1 -- start start 2023-10-09T08:14:28.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.622+0000 7f60b0d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60ac0cc8d0 0x7f60ac0adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:28.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.622+0000 7f60b0d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60ac15b050 0x7f60ac06d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:28.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.622+0000 7f60b0d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60ac15bb30 0x7f60ac06df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:28.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.622+0000 7f60b0d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac16a4a0 con 0x7f60ac15bb30 2023-10-09T08:14:28.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.622+0000 7f60b0d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac169890 con 0x7f60ac15b050 2023-10-09T08:14:28.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.622+0000 7f60b0d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac169b70 con 0x7f60ac0cc8d0 2023-10-09T08:14:28.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.623+0000 7f60abfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60ac15bb30 0x7f60ac06df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:28.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.623+0000 7f60abfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60ac15bb30 0x7f60ac06df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50416/0 (socket says 172.21.15.71:50416) 2023-10-09T08:14:28.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.623+0000 7f60abfff700 1 -- 172.21.15.71:0/3902285979 learned_addr learned my addr 172.21.15.71:0/3902285979 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:28.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.623+0000 7f60ab7fe700 1 --2- 172.21.15.71:0/3902285979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60ac0cc8d0 0x7f60ac0adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:28.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.623+0000 7f60aaffd700 1 --2- 172.21.15.71:0/3902285979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60ac15b050 0x7f60ac06d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:28.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.623+0000 7f60abfff700 1 -- 172.21.15.71:0/3902285979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60ac0cc8d0 msgr2=0x7f60ac0adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:28.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.623+0000 7f60abfff700 1 --2- 172.21.15.71:0/3902285979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60ac0cc8d0 0x7f60ac0adeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:28.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.623+0000 7f60abfff700 1 -- 172.21.15.71:0/3902285979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60ac15b050 msgr2=0x7f60ac06d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:28.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.623+0000 7f60abfff700 1 --2- 172.21.15.71:0/3902285979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60ac15b050 0x7f60ac06d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:28.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.623+0000 7f60abfff700 1 -- 172.21.15.71:0/3902285979 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c0094f0 con 0x7f60ac15bb30 2023-10-09T08:14:28.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.623+0000 7f60aaffd700 1 --2- 172.21.15.71:0/3902285979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60ac15b050 0x7f60ac06d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:14:28.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.623+0000 7f60abfff700 1 --2- 172.21.15.71:0/3902285979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60ac15bb30 0x7f60ac06df30 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009e90 tx=0x7f60a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:28.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.623+0000 7f60937fe700 1 -- 172.21.15.71:0/3902285979 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a400cc20 con 0x7f60ac15bb30 2023-10-09T08:14:28.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.624+0000 7f60937fe700 1 -- 172.21.15.71:0/3902285979 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a400f040 con 0x7f60ac15bb30 2023-10-09T08:14:28.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.624+0000 7f60b0d9d700 1 -- 172.21.15.71:0/3902285979 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60ac169e50 con 0x7f60ac15bb30 2023-10-09T08:14:28.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.624+0000 7f60937fe700 1 -- 172.21.15.71:0/3902285979 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a4014480 con 0x7f60ac15bb30 2023-10-09T08:14:28.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.624+0000 7f60b0d9d700 1 -- 172.21.15.71:0/3902285979 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60ac0ae3f0 con 0x7f60ac15bb30 2023-10-09T08:14:28.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.625+0000 7f60b0d9d700 1 -- 172.21.15.71:0/3902285979 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60ac04c3c0 con 0x7f60ac15bb30 2023-10-09T08:14:28.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.626+0000 7f60937fe700 1 -- 172.21.15.71:0/3902285979 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 90) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f60a4014830 con 0x7f60ac15bb30 2023-10-09T08:14:28.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.626+0000 7f60937fe700 1 --2- 172.21.15.71:0/3902285979 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6098066d80 0x7f6098069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:28.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.627+0000 7f60937fe700 1 -- 172.21.15.71:0/3902285979 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6734+0+0 (secure 0 0 0) 0x7f60a4085090 con 0x7f60ac15bb30 2023-10-09T08:14:28.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.627+0000 7f60ab7fe700 1 --2- 172.21.15.71:0/3902285979 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6098066d80 0x7f6098069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:28.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.628+0000 7f60ab7fe700 1 --2- 172.21.15.71:0/3902285979 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6098066d80 0x7f6098069230 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0645e0 tx=0x7f609c017000 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:28.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.631+0000 7f60937fe700 1 -- 172.21.15.71:0/3902285979 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60a4055c40 con 0x7f60ac15bb30 2023-10-09T08:14:28.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:28.827+0000 7f60b0d9d700 1 -- 172.21.15.71:0/3902285979 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f60ac16a5e0 con 0x7f60ac15bb30 2023-10-09T08:14:29.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.412+0000 7f60937fe700 1 -- 172.21.15.71:0/3902285979 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v185) v1 ==== 169+0+0 (secure 0 0 0) 0x7f60a40557d0 con 0x7f60ac15bb30 2023-10-09T08:14:29.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.417+0000 7f60b0d9d700 1 -- 172.21.15.71:0/3902285979 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6098066d80 msgr2=0x7f6098069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:29.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.417+0000 7f60b0d9d700 1 --2- 172.21.15.71:0/3902285979 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6098066d80 0x7f6098069230 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0645e0 tx=0x7f609c017000 comp rx=0 tx=0).stop 2023-10-09T08:14:29.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.417+0000 7f60b0d9d700 1 -- 172.21.15.71:0/3902285979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60ac15bb30 msgr2=0x7f60ac06df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:29.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.417+0000 7f60b0d9d700 1 --2- 172.21.15.71:0/3902285979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60ac15bb30 0x7f60ac06df30 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009e90 tx=0x7f60a400b040 comp rx=0 tx=0).stop 2023-10-09T08:14:29.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.417+0000 7f60b0d9d700 1 -- 172.21.15.71:0/3902285979 shutdown_connections 2023-10-09T08:14:29.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.417+0000 7f60b0d9d700 1 --2- 172.21.15.71:0/3902285979 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6098066d80 0x7f6098069230 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:29.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.417+0000 7f60b0d9d700 1 --2- 172.21.15.71:0/3902285979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60ac15bb30 0x7f60ac06df30 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:29.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.417+0000 7f60b0d9d700 1 --2- 172.21.15.71:0/3902285979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60ac0cc8d0 0x7f60ac0adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:29.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.417+0000 7f60b0d9d700 1 --2- 172.21.15.71:0/3902285979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60ac15b050 0x7f60ac06d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:29.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.417+0000 7f60b0d9d700 1 -- 172.21.15.71:0/3902285979 >> 172.21.15.71:0/3902285979 conn(0x7f60ac068e20 msgr2=0x7f60ac154760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:29.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.417+0000 7f60b0d9d700 1 -- 172.21.15.71:0/3902285979 shutdown_connections 2023-10-09T08:14:29.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.418+0000 7f60b0d9d700 1 -- 172.21.15.71:0/3902285979 wait complete. 2023-10-09T08:14:29.420 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' removed 2023-10-09T08:14:29.440 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T08:14:29.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.623+0000 7f9ac539d700 1 Processor -- start 2023-10-09T08:14:29.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.623+0000 7f9ac539d700 1 -- start start 2023-10-09T08:14:29.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.624+0000 7f9ac539d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9ac0159a60 0x7f9ac00c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:29.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.624+0000 7f9ac539d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9ac00ccc00 0x7f9ac0069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:29.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.624+0000 7f9ac539d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac00c9cb0 con 0x7f9ac006a020 2023-10-09T08:14:29.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.624+0000 7f9ac539d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac006dfc0 con 0x7f9ac00ccc00 2023-10-09T08:14:29.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.624+0000 7f9ac539d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac00c9f30 con 0x7f9ac0159a60 2023-10-09T08:14:29.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.624+0000 7f9abf7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9ac00ccc00 0x7f9ac0069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:29.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.624+0000 7f9abf7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9ac00ccc00 0x7f9ac0069ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50430/0 (socket says 172.21.15.71:50430) 2023-10-09T08:14:29.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.624+0000 7f9ac4b9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9ac006a020 0x7f9ac00cb230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48230/0 (socket says 172.21.15.71:48230) 2023-10-09T08:14:29.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.624+0000 7f9abf7fe700 1 -- 172.21.15.71:0/3296537852 learned_addr learned my addr 172.21.15.71:0/3296537852 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:29.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.625+0000 7f9abffff700 1 --2- 172.21.15.71:0/3296537852 >> v2:172.21.15.179:3300/0 conn(0x7f9ac0159a60 0x7f9ac00c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:29.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.625+0000 7f9abf7fe700 1 -- 172.21.15.71:0/3296537852 >> v2:172.21.15.179:3300/0 conn(0x7f9ac0159a60 msgr2=0x7f9ac00c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.625+0000 7f9abf7fe700 1 --2- 172.21.15.71:0/3296537852 >> v2:172.21.15.179:3300/0 conn(0x7f9ac0159a60 0x7f9ac00c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.625+0000 7f9abf7fe700 1 -- 172.21.15.71:0/3296537852 >> v1:172.21.15.71:6789/0 conn(0x7f9ac006a020 legacy=0x7f9ac00cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.625+0000 7f9abf7fe700 1 -- 172.21.15.71:0/3296537852 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac00ca470 con 0x7f9ac00ccc00 2023-10-09T08:14:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.625+0000 7f9abeffd700 1 -- 172.21.15.71:0/3296537852 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265219982 0 0) 0x7f9ac00c9cb0 con 0x7f9ac006a020 2023-10-09T08:14:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.625+0000 7f9abf7fe700 1 --2- 172.21.15.71:0/3296537852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ac00ccc00 0x7f9ac0069ae0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f9ac006e510 tx=0x7f9ab4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe91e9b5c0c987df server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.625+0000 7f9abeffd700 1 -- 172.21.15.71:0/3296537852 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4009e70 con 0x7f9ac00ccc00 2023-10-09T08:14:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.625+0000 7f9abeffd700 1 -- 172.21.15.71:0/3296537852 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab400b8f0 con 0x7f9ac00ccc00 2023-10-09T08:14:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.625+0000 7f9abeffd700 1 -- 172.21.15.71:0/3296537852 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab400bc90 con 0x7f9ac00ccc00 2023-10-09T08:14:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.626+0000 7f9ac539d700 1 -- 172.21.15.71:0/3296537852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ac00ccc00 msgr2=0x7f9ac0069ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:29.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.626+0000 7f9ac539d700 1 --2- 172.21.15.71:0/3296537852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ac00ccc00 0x7f9ac0069ae0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f9ac006e510 tx=0x7f9ab4009250 comp rx=0 tx=0).stop 2023-10-09T08:14:29.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.626+0000 7f9ac539d700 1 -- 172.21.15.71:0/3296537852 shutdown_connections 2023-10-09T08:14:29.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.626+0000 7f9ac539d700 1 --2- 172.21.15.71:0/3296537852 >> v2:172.21.15.179:3300/0 conn(0x7f9ac0159a60 0x7f9ac00c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:29.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.626+0000 7f9ac539d700 1 --2- 172.21.15.71:0/3296537852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ac00ccc00 0x7f9ac0069ae0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:29.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.626+0000 7f9ac539d700 1 -- 172.21.15.71:0/3296537852 >> 172.21.15.71:0/3296537852 conn(0x7f9ac006baa0 msgr2=0x7f9ac006bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:29.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.626+0000 7f9ac539d700 1 -- 172.21.15.71:0/3296537852 shutdown_connections 2023-10-09T08:14:29.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.626+0000 7f9ac539d700 1 -- 172.21.15.71:0/3296537852 wait complete. 2023-10-09T08:14:29.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.627+0000 7f9ac539d700 1 Processor -- start 2023-10-09T08:14:29.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.628+0000 7f9ac539d700 1 -- start start 2023-10-09T08:14:29.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.628+0000 7f9ac539d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ac006a020 0x7f9ac0152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:29.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.628+0000 7f9ac539d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ac00ccc00 0x7f9ac00b0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:29.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.628+0000 7f9ac539d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ac0159a60 0x7f9ac00c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:29.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.628+0000 7f9ac539d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac00c7d40 con 0x7f9ac0159a60 2023-10-09T08:14:29.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.628+0000 7f9ac539d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac00c7130 con 0x7f9ac00ccc00 2023-10-09T08:14:29.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.629+0000 7f9ac539d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac00c7410 con 0x7f9ac006a020 2023-10-09T08:14:29.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.629+0000 7f9ac4b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ac0159a60 0x7f9ac00c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:29.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.629+0000 7f9ac4b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ac0159a60 0x7f9ac00c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50444/0 (socket says 172.21.15.71:50444) 2023-10-09T08:14:29.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.629+0000 7f9ac4b9c700 1 -- 172.21.15.71:0/1024186955 learned_addr learned my addr 172.21.15.71:0/1024186955 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:29.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.629+0000 7f9abf7fe700 1 --2- 172.21.15.71:0/1024186955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ac00ccc00 0x7f9ac00b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:29.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.629+0000 7f9ac4b9c700 1 -- 172.21.15.71:0/1024186955 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ac006a020 msgr2=0x7f9ac0152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:29.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.629+0000 7f9ac4b9c700 1 --2- 172.21.15.71:0/1024186955 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ac006a020 0x7f9ac0152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:29.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.629+0000 7f9ac4b9c700 1 -- 172.21.15.71:0/1024186955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ac00ccc00 msgr2=0x7f9ac00b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:29.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.629+0000 7f9ac4b9c700 1 --2- 172.21.15.71:0/1024186955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ac00ccc00 0x7f9ac00b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:29.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.629+0000 7f9ac4b9c700 1 -- 172.21.15.71:0/1024186955 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab40094f0 con 0x7f9ac0159a60 2023-10-09T08:14:29.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.629+0000 7f9abf7fe700 1 --2- 172.21.15.71:0/1024186955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ac00ccc00 0x7f9ac00b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:14:29.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.629+0000 7f9ac4b9c700 1 --2- 172.21.15.71:0/1024186955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ac0159a60 0x7f9ac00c8e50 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800cd50 tx=0x7f9ab8001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:29.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.629+0000 7f9aa7fff700 1 -- 172.21.15.71:0/1024186955 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8005df0 con 0x7f9ac0159a60 2023-10-09T08:14:29.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.630+0000 7f9aa7fff700 1 -- 172.21.15.71:0/1024186955 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab800a960 con 0x7f9ac0159a60 2023-10-09T08:14:29.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.630+0000 7f9aa7fff700 1 -- 172.21.15.71:0/1024186955 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab800ad20 con 0x7f9ac0159a60 2023-10-09T08:14:29.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.630+0000 7f9ac539d700 1 -- 172.21.15.71:0/1024186955 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac00c76f0 con 0x7f9ac0159a60 2023-10-09T08:14:29.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.630+0000 7f9ac539d700 1 -- 172.21.15.71:0/1024186955 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac0153490 con 0x7f9ac0159a60 2023-10-09T08:14:29.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.631+0000 7f9ac539d700 1 -- 172.21.15.71:0/1024186955 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac006eba0 con 0x7f9ac0159a60 2023-10-09T08:14:29.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.631+0000 7f9aa7fff700 1 -- 172.21.15.71:0/1024186955 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ab8007300 con 0x7f9ac0159a60 2023-10-09T08:14:29.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.632+0000 7f9aa7fff700 1 --2- 172.21.15.71:0/1024186955 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9aac066f30 0x7f9aac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:29.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.632+0000 7f9aa7fff700 1 -- 172.21.15.71:0/1024186955 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6291+0+0 (secure 0 0 0) 0x7f9ab8084a30 con 0x7f9ac0159a60 2023-10-09T08:14:29.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.633+0000 7f9abffff700 1 --2- 172.21.15.71:0/1024186955 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9aac066f30 0x7f9aac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.633+0000 7f9abffff700 1 --2- 172.21.15.71:0/1024186955 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9aac066f30 0x7f9aac0693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0009b10 tx=0x7f9ab00091a0 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:29.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.636+0000 7f9aa7fff700 1 -- 172.21.15.71:0/1024186955 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ab8051a30 con 0x7f9ac0159a60 2023-10-09T08:14:29.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.827+0000 7f9ac539d700 1 -- 172.21.15.71:0/1024186955 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9ac00c7e80 con 0x7f9ac0159a60 2023-10-09T08:14:29.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.831+0000 7f9aa7fff700 1 -- 172.21.15.71:0/1024186955 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v61) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9ac00c7e80 con 0x7f9ac0159a60 2023-10-09T08:14:29.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.834+0000 7f9ac539d700 1 -- 172.21.15.71:0/1024186955 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9aac066f30 msgr2=0x7f9aac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:29.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.834+0000 7f9ac539d700 1 --2- 172.21.15.71:0/1024186955 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9aac066f30 0x7f9aac0693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0009b10 tx=0x7f9ab00091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:29.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.834+0000 7f9ac539d700 1 -- 172.21.15.71:0/1024186955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ac0159a60 msgr2=0x7f9ac00c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:29.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.834+0000 7f9ac539d700 1 --2- 172.21.15.71:0/1024186955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ac0159a60 0x7f9ac00c8e50 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800cd50 tx=0x7f9ab8001b10 comp rx=0 tx=0).stop 2023-10-09T08:14:29.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.834+0000 7f9ac539d700 1 -- 172.21.15.71:0/1024186955 shutdown_connections 2023-10-09T08:14:29.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.834+0000 7f9ac539d700 1 --2- 172.21.15.71:0/1024186955 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9aac066f30 0x7f9aac0693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:29.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.834+0000 7f9ac539d700 1 --2- 172.21.15.71:0/1024186955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ac0159a60 0x7f9ac00c8e50 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:29.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.834+0000 7f9ac539d700 1 --2- 172.21.15.71:0/1024186955 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ac006a020 0x7f9ac0152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:29.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.834+0000 7f9ac539d700 1 --2- 172.21.15.71:0/1024186955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ac00ccc00 0x7f9ac00b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:29.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.834+0000 7f9ac539d700 1 -- 172.21.15.71:0/1024186955 >> 172.21.15.71:0/1024186955 conn(0x7f9ac006baa0 msgr2=0x7f9ac006be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:29.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.834+0000 7f9ac539d700 1 -- 172.21.15.71:0/1024186955 shutdown_connections 2023-10-09T08:14:29.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:29.834+0000 7f9ac539d700 1 -- 172.21.15.71:0/1024186955 wait complete. 2023-10-09T08:14:29.852 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-09T08:14:30.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.035+0000 7fc3725ff700 1 Processor -- start 2023-10-09T08:14:30.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.035+0000 7fc3725ff700 1 -- start start 2023-10-09T08:14:30.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.036+0000 7fc3725ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc36c159890 0x7fc36c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:30.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.036+0000 7fc3725ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc36c159c60 0x7fc36c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:30.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.036+0000 7fc3725ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36c15a160 con 0x7fc36c15db10 2023-10-09T08:14:30.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.036+0000 7fc3725ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36c15df50 con 0x7fc36c159c60 2023-10-09T08:14:30.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.036+0000 7fc3725ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36c0d13a0 con 0x7fc36c159890 2023-10-09T08:14:30.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.037+0000 7fc36b7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc36c159c60 0x7fc36c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.037+0000 7fc36b7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc36c159c60 0x7fc36c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50448/0 (socket says 172.21.15.71:50448) 2023-10-09T08:14:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.037+0000 7fc36b7fe700 1 -- 172.21.15.71:0/3502293256 learned_addr learned my addr 172.21.15.71:0/3502293256 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.037+0000 7fc36bfff700 1 --2- 172.21.15.71:0/3502293256 >> v2:172.21.15.179:3300/0 conn(0x7fc36c159890 0x7fc36c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.037+0000 7fc36b7fe700 1 -- 172.21.15.71:0/3502293256 >> v2:172.21.15.179:3300/0 conn(0x7fc36c159890 msgr2=0x7fc36c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.037+0000 7fc36b7fe700 1 --2- 172.21.15.71:0/3502293256 >> v2:172.21.15.179:3300/0 conn(0x7fc36c159890 0x7fc36c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.037+0000 7fc36b7fe700 1 -- 172.21.15.71:0/3502293256 >> v1:172.21.15.179:6789/0 conn(0x7fc36c15db10 legacy=0x7fc36c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.037+0000 7fc36b7fe700 1 -- 172.21.15.71:0/3502293256 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36c15e140 con 0x7fc36c159c60 2023-10-09T08:14:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.037+0000 7fc36b7fe700 1 --2- 172.21.15.71:0/3502293256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc36c159c60 0x7fc36c15d5d0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0d1090 tx=0x7fc360009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1380c66c8ca3a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.037+0000 7fc36affd700 1 -- 172.21.15.71:0/3502293256 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36000b820 con 0x7fc36c159c60 2023-10-09T08:14:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.037+0000 7fc36affd700 1 -- 172.21.15.71:0/3502293256 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36000b980 con 0x7fc36c159c60 2023-10-09T08:14:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.037+0000 7fc36affd700 1 -- 172.21.15.71:0/3502293256 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36000bd20 con 0x7fc36c159c60 2023-10-09T08:14:30.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.038+0000 7fc3725ff700 1 -- 172.21.15.71:0/3502293256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc36c159c60 msgr2=0x7fc36c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:30.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.038+0000 7fc3725ff700 1 --2- 172.21.15.71:0/3502293256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc36c159c60 0x7fc36c15d5d0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0d1090 tx=0x7fc360009250 comp rx=0 tx=0).stop 2023-10-09T08:14:30.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.038+0000 7fc3725ff700 1 -- 172.21.15.71:0/3502293256 shutdown_connections 2023-10-09T08:14:30.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.038+0000 7fc3725ff700 1 --2- 172.21.15.71:0/3502293256 >> v2:172.21.15.179:3300/0 conn(0x7fc36c159890 0x7fc36c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:30.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.038+0000 7fc3725ff700 1 --2- 172.21.15.71:0/3502293256 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc36c159c60 0x7fc36c15d5d0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:30.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.038+0000 7fc3725ff700 1 -- 172.21.15.71:0/3502293256 >> 172.21.15.71:0/3502293256 conn(0x7fc36c068e20 msgr2=0x7fc36c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:30.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.038+0000 7fc3725ff700 1 -- 172.21.15.71:0/3502293256 shutdown_connections 2023-10-09T08:14:30.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.038+0000 7fc3725ff700 1 -- 172.21.15.71:0/3502293256 wait complete. 2023-10-09T08:14:30.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.040+0000 7fc3725ff700 1 Processor -- start 2023-10-09T08:14:30.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.040+0000 7fc3725ff700 1 -- start start 2023-10-09T08:14:30.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.041+0000 7fc3725ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc36c159890 0x7fc36c1526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:30.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.041+0000 7fc3725ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc36c159c60 0x7fc36c155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:30.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.041+0000 7fc3725ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc36c15db10 0x7fc36c1555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:30.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.041+0000 7fc3725ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c16a7b0 con 0x7fc36c15db10 2023-10-09T08:14:30.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.041+0000 7fc3725ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c0b6370 con 0x7fc36c159890 2023-10-09T08:14:30.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.041+0000 7fc3725ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c16a160 con 0x7fc36c159c60 2023-10-09T08:14:30.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.041+0000 7fc370b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc36c15db10 0x7fc36c1555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:30.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.041+0000 7fc370b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc36c15db10 0x7fc36c1555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50456/0 (socket says 172.21.15.71:50456) 2023-10-09T08:14:30.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.041+0000 7fc370b9c700 1 -- 172.21.15.71:0/1690697039 learned_addr learned my addr 172.21.15.71:0/1690697039 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:30.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.041+0000 7fc36b7fe700 1 --2- 172.21.15.71:0/1690697039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc36c159c60 0x7fc36c155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:30.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.041+0000 7fc36bfff700 1 --2- 172.21.15.71:0/1690697039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc36c159890 0x7fc36c1526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:30.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.041+0000 7fc370b9c700 1 -- 172.21.15.71:0/1690697039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc36c159c60 msgr2=0x7fc36c155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:30.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.041+0000 7fc370b9c700 1 --2- 172.21.15.71:0/1690697039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc36c159c60 0x7fc36c155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:30.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.041+0000 7fc370b9c700 1 -- 172.21.15.71:0/1690697039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc36c159890 msgr2=0x7fc36c1526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:30.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.041+0000 7fc370b9c700 1 --2- 172.21.15.71:0/1690697039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc36c159890 0x7fc36c1526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:30.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.041+0000 7fc370b9c700 1 -- 172.21.15.71:0/1690697039 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3600094f0 con 0x7fc36c15db10 2023-10-09T08:14:30.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.041+0000 7fc36bfff700 1 --2- 172.21.15.71:0/1690697039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc36c159890 0x7fc36c1526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:14:30.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.041+0000 7fc36b7fe700 1 --2- 172.21.15.71:0/1690697039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc36c159c60 0x7fc36c155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:14:30.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.042+0000 7fc370b9c700 1 --2- 172.21.15.71:0/1690697039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc36c15db10 0x7fc36c1555d0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fc36400bc30 tx=0x7fc364009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:30.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.042+0000 7fc353fff700 1 -- 172.21.15.71:0/1690697039 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36400c9b0 con 0x7fc36c15db10 2023-10-09T08:14:30.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.042+0000 7fc353fff700 1 -- 172.21.15.71:0/1690697039 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36400cb50 con 0x7fc36c15db10 2023-10-09T08:14:30.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.042+0000 7fc353fff700 1 -- 172.21.15.71:0/1690697039 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc364014410 con 0x7fc36c15db10 2023-10-09T08:14:30.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.042+0000 7fc3725ff700 1 -- 172.21.15.71:0/1690697039 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36c16a440 con 0x7fc36c15db10 2023-10-09T08:14:30.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.042+0000 7fc3725ff700 1 -- 172.21.15.71:0/1690697039 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc36c16ac40 con 0x7fc36c15db10 2023-10-09T08:14:30.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.043+0000 7fc3725ff700 1 -- 172.21.15.71:0/1690697039 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36c16ae30 con 0x7fc36c15db10 2023-10-09T08:14:30.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.044+0000 7fc353fff700 1 -- 172.21.15.71:0/1690697039 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc364014800 con 0x7fc36c15db10 2023-10-09T08:14:30.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.045+0000 7fc353fff700 1 --2- 172.21.15.71:0/1690697039 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc358066f30 0x7fc3580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:30.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.045+0000 7fc353fff700 1 -- 172.21.15.71:0/1690697039 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6291+0+0 (secure 0 0 0) 0x7fc3640848d0 con 0x7fc36c15db10 2023-10-09T08:14:30.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.045+0000 7fc36bfff700 1 --2- 172.21.15.71:0/1690697039 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc358066f30 0x7fc3580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:30.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.046+0000 7fc36bfff700 1 --2- 172.21.15.71:0/1690697039 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc358066f30 0x7fc3580693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc35c006fd0 tx=0x7fc35c008040 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:30.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.049+0000 7fc353fff700 1 -- 172.21.15.71:0/1690697039 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc36404c5a0 con 0x7fc36c15db10 2023-10-09T08:14:30.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.239+0000 7fc3725ff700 1 -- 172.21.15.71:0/1690697039 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fc36c04c3c0 con 0x7fc36c15db10 2023-10-09T08:14:30.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.243+0000 7fc353fff700 1 -- 172.21.15.71:0/1690697039 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v62) v1 ==== 115+0+0 (secure 0 0 0) 0x7fc364051850 con 0x7fc36c15db10 2023-10-09T08:14:30.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.246+0000 7fc3725ff700 1 -- 172.21.15.71:0/1690697039 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc358066f30 msgr2=0x7fc3580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:30.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.246+0000 7fc3725ff700 1 --2- 172.21.15.71:0/1690697039 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc358066f30 0x7fc3580693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc35c006fd0 tx=0x7fc35c008040 comp rx=0 tx=0).stop 2023-10-09T08:14:30.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.246+0000 7fc3725ff700 1 -- 172.21.15.71:0/1690697039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc36c15db10 msgr2=0x7fc36c1555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:30.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.246+0000 7fc3725ff700 1 --2- 172.21.15.71:0/1690697039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc36c15db10 0x7fc36c1555d0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fc36400bc30 tx=0x7fc364009820 comp rx=0 tx=0).stop 2023-10-09T08:14:30.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.246+0000 7fc3725ff700 1 -- 172.21.15.71:0/1690697039 shutdown_connections 2023-10-09T08:14:30.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.246+0000 7fc3725ff700 1 --2- 172.21.15.71:0/1690697039 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc358066f30 0x7fc3580693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:30.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.246+0000 7fc3725ff700 1 --2- 172.21.15.71:0/1690697039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc36c15db10 0x7fc36c1555d0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:30.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.246+0000 7fc3725ff700 1 --2- 172.21.15.71:0/1690697039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc36c159890 0x7fc36c1526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:30.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.246+0000 7fc3725ff700 1 --2- 172.21.15.71:0/1690697039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc36c159c60 0x7fc36c155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:30.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.246+0000 7fc3725ff700 1 -- 172.21.15.71:0/1690697039 >> 172.21.15.71:0/1690697039 conn(0x7fc36c068e20 msgr2=0x7fc36c1539f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:30.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.246+0000 7fc3725ff700 1 -- 172.21.15.71:0/1690697039 shutdown_connections 2023-10-09T08:14:30.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.246+0000 7fc3725ff700 1 -- 172.21.15.71:0/1690697039 wait complete. 2023-10-09T08:14:30.264 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-09T08:14:30.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.446+0000 7fe705dff700 1 Processor -- start 2023-10-09T08:14:30.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.447+0000 7fe705dff700 1 -- start start 2023-10-09T08:14:30.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.448+0000 7fe705dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe7000c70b0 0x7fe700069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:30.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.448+0000 7fe705dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe700069cb0 0x7fe7000ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:30.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.448+0000 7fe705dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70006e950 con 0x7fe700155eb0 2023-10-09T08:14:30.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.448+0000 7fe705dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70006a130 con 0x7fe7000c70b0 2023-10-09T08:14:30.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.448+0000 7fe705dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70006eb90 con 0x7fe700069cb0 2023-10-09T08:14:30.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.448+0000 7fe6f7fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe7000c70b0 0x7fe700069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:30.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.448+0000 7fe6f7fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe7000c70b0 0x7fe700069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50458/0 (socket says 172.21.15.71:50458) 2023-10-09T08:14:30.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.448+0000 7fe6f7fff700 1 -- 172.21.15.71:0/1025446530 learned_addr learned my addr 172.21.15.71:0/1025446530 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:30.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.448+0000 7fe6ff7fe700 1 --1- 172.21.15.71:0/1025446530 >> v1:172.21.15.71:6789/0 conn(0x7fe700155eb0 0x7fe70006e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48232/0 (socket says 172.21.15.71:48232) 2023-10-09T08:14:30.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.448+0000 7fe6fffff700 1 --2- 172.21.15.71:0/1025446530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe700069cb0 0x7fe7000ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:30.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.449+0000 7fe6f7fff700 1 -- 172.21.15.71:0/1025446530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe700069cb0 msgr2=0x7fe7000ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:30.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.449+0000 7fe6f7fff700 1 --2- 172.21.15.71:0/1025446530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe700069cb0 0x7fe7000ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:30.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.449+0000 7fe6f7fff700 1 -- 172.21.15.71:0/1025446530 >> v1:172.21.15.71:6789/0 conn(0x7fe700155eb0 legacy=0x7fe70006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:30.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.449+0000 7fe6f7fff700 1 -- 172.21.15.71:0/1025446530 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70006ee70 con 0x7fe7000c70b0 2023-10-09T08:14:30.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.449+0000 7fe6feffd700 1 -- 172.21.15.71:0/1025446530 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836113565 0 0) 0x7fe6f0001110 con 0x7fe700155eb0 2023-10-09T08:14:30.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.449+0000 7fe6f7fff700 1 --2- 172.21.15.71:0/1025446530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7000c70b0 0x7fe700069770 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80099b0 tx=0x7fe6e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a47eb100614d7e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:30.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.449+0000 7fe6feffd700 1 -- 172.21.15.71:0/1025446530 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e800b860 con 0x7fe7000c70b0 2023-10-09T08:14:30.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.449+0000 7fe6feffd700 1 -- 172.21.15.71:0/1025446530 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e800b9c0 con 0x7fe7000c70b0 2023-10-09T08:14:30.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.449+0000 7fe6feffd700 1 -- 172.21.15.71:0/1025446530 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e800bd60 con 0x7fe7000c70b0 2023-10-09T08:14:30.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.450+0000 7fe705dff700 1 -- 172.21.15.71:0/1025446530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7000c70b0 msgr2=0x7fe700069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:30.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.450+0000 7fe705dff700 1 --2- 172.21.15.71:0/1025446530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7000c70b0 0x7fe700069770 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80099b0 tx=0x7fe6e8009250 comp rx=0 tx=0).stop 2023-10-09T08:14:30.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.450+0000 7fe705dff700 1 -- 172.21.15.71:0/1025446530 shutdown_connections 2023-10-09T08:14:30.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.450+0000 7fe705dff700 1 --2- 172.21.15.71:0/1025446530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe700069cb0 0x7fe7000ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:30.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.450+0000 7fe705dff700 1 --2- 172.21.15.71:0/1025446530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7000c70b0 0x7fe700069770 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:30.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.450+0000 7fe705dff700 1 -- 172.21.15.71:0/1025446530 >> 172.21.15.71:0/1025446530 conn(0x7fe700068e10 msgr2=0x7fe7000cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:30.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.450+0000 7fe705dff700 1 -- 172.21.15.71:0/1025446530 shutdown_connections 2023-10-09T08:14:30.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.450+0000 7fe705dff700 1 -- 172.21.15.71:0/1025446530 wait complete. 2023-10-09T08:14:30.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.451+0000 7fe705dff700 1 Processor -- start 2023-10-09T08:14:30.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.451+0000 7fe705dff700 1 -- start start 2023-10-09T08:14:30.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.452+0000 7fe705dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe700069cb0 0x7fe7000ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:30.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.452+0000 7fe705dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7000c70b0 0x7fe7000cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:30.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.452+0000 7fe705dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe700155eb0 0x7fe700147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:30.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.452+0000 7fe705dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7000b0480 con 0x7fe7000c70b0 2023-10-09T08:14:30.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.452+0000 7fe705dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7000b0760 con 0x7fe700069cb0 2023-10-09T08:14:30.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.452+0000 7fe705dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7000cb6b0 con 0x7fe700155eb0 2023-10-09T08:14:30.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.452+0000 7fe6f7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7000c70b0 0x7fe7000cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:30.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.452+0000 7fe6f7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7000c70b0 0x7fe7000cae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50462/0 (socket says 172.21.15.71:50462) 2023-10-09T08:14:30.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.452+0000 7fe6f7fff700 1 -- 172.21.15.71:0/1967958735 learned_addr learned my addr 172.21.15.71:0/1967958735 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:30.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.453+0000 7fe6fffff700 1 --2- 172.21.15.71:0/1967958735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe700155eb0 0x7fe700147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:30.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.453+0000 7fe6ff7fe700 1 --2- 172.21.15.71:0/1967958735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe700069cb0 0x7fe7000ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:30.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.453+0000 7fe6f7fff700 1 -- 172.21.15.71:0/1967958735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe700155eb0 msgr2=0x7fe700147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:30.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.453+0000 7fe6f7fff700 1 --2- 172.21.15.71:0/1967958735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe700155eb0 0x7fe700147000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:30.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.453+0000 7fe6f7fff700 1 -- 172.21.15.71:0/1967958735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe700069cb0 msgr2=0x7fe7000ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:30.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.453+0000 7fe6f7fff700 1 --2- 172.21.15.71:0/1967958735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe700069cb0 0x7fe7000ae630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:30.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.453+0000 7fe6f7fff700 1 -- 172.21.15.71:0/1967958735 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e80094f0 con 0x7fe7000c70b0 2023-10-09T08:14:30.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.453+0000 7fe6f7fff700 1 --2- 172.21.15.71:0/1967958735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7000c70b0 0x7fe7000cae80 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8006fd0 tx=0x7fe6e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:30.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.453+0000 7fe6f77fe700 1 -- 172.21.15.71:0/1967958735 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8011e90 con 0x7fe7000c70b0 2023-10-09T08:14:30.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.453+0000 7fe6f77fe700 1 -- 172.21.15.71:0/1967958735 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e8024440 con 0x7fe7000c70b0 2023-10-09T08:14:30.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.453+0000 7fe705dff700 1 -- 172.21.15.71:0/1967958735 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7000cb990 con 0x7fe7000c70b0 2023-10-09T08:14:30.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.453+0000 7fe6f77fe700 1 -- 172.21.15.71:0/1967958735 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8024820 con 0x7fe7000c70b0 2023-10-09T08:14:30.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.453+0000 7fe705dff700 1 -- 172.21.15.71:0/1967958735 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7000cb3c0 con 0x7fe7000c70b0 2023-10-09T08:14:30.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.454+0000 7fe705dff700 1 -- 172.21.15.71:0/1967958735 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7000aed50 con 0x7fe7000c70b0 2023-10-09T08:14:30.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.455+0000 7fe6f77fe700 1 -- 172.21.15.71:0/1967958735 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe6e801a420 con 0x7fe7000c70b0 2023-10-09T08:14:30.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.456+0000 7fe6f77fe700 1 --2- 172.21.15.71:0/1967958735 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe6e0066f30 0x7fe6e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:30.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.456+0000 7fe6f77fe700 1 -- 172.21.15.71:0/1967958735 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6291+0+0 (secure 0 0 0) 0x7fe6e8086850 con 0x7fe7000c70b0 2023-10-09T08:14:30.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.456+0000 7fe6ff7fe700 1 --2- 172.21.15.71:0/1967958735 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe6e0066f30 0x7fe6e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:30.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.457+0000 7fe6ff7fe700 1 --2- 172.21.15.71:0/1967958735 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe6e0066f30 0x7fe6e00693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0007fd0 tx=0x7fe6f0007e10 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:30.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.460+0000 7fe6f77fe700 1 -- 172.21.15.71:0/1967958735 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6e80537d0 con 0x7fe7000c70b0 2023-10-09T08:14:30.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.649+0000 7fe705dff700 1 -- 172.21.15.71:0/1967958735 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fe70004c3c0 con 0x7fe7000c70b0 2023-10-09T08:14:30.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.654+0000 7fe6f77fe700 1 -- 172.21.15.71:0/1967958735 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v63) v1 ==== 120+0+0 (secure 0 0 0) 0x7fe6e8056df0 con 0x7fe7000c70b0 2023-10-09T08:14:30.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.656+0000 7fe705dff700 1 -- 172.21.15.71:0/1967958735 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe6e0066f30 msgr2=0x7fe6e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:30.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.656+0000 7fe705dff700 1 --2- 172.21.15.71:0/1967958735 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe6e0066f30 0x7fe6e00693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0007fd0 tx=0x7fe6f0007e10 comp rx=0 tx=0).stop 2023-10-09T08:14:30.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.656+0000 7fe705dff700 1 -- 172.21.15.71:0/1967958735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7000c70b0 msgr2=0x7fe7000cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:30.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.656+0000 7fe705dff700 1 --2- 172.21.15.71:0/1967958735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7000c70b0 0x7fe7000cae80 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8006fd0 tx=0x7fe6e8017000 comp rx=0 tx=0).stop 2023-10-09T08:14:30.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.656+0000 7fe705dff700 1 -- 172.21.15.71:0/1967958735 shutdown_connections 2023-10-09T08:14:30.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.656+0000 7fe705dff700 1 --2- 172.21.15.71:0/1967958735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe700155eb0 0x7fe700147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:30.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.656+0000 7fe705dff700 1 --2- 172.21.15.71:0/1967958735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe700069cb0 0x7fe7000ae630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:30.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.656+0000 7fe705dff700 1 --2- 172.21.15.71:0/1967958735 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe6e0066f30 0x7fe6e00693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:30.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.656+0000 7fe705dff700 1 --2- 172.21.15.71:0/1967958735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7000c70b0 0x7fe7000cae80 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:30.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.656+0000 7fe705dff700 1 -- 172.21.15.71:0/1967958735 >> 172.21.15.71:0/1967958735 conn(0x7fe700068e10 msgr2=0x7fe700154ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:30.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.656+0000 7fe705dff700 1 -- 172.21.15.71:0/1967958735 shutdown_connections 2023-10-09T08:14:30.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.656+0000 7fe705dff700 1 -- 172.21.15.71:0/1967958735 wait complete. 2023-10-09T08:14:30.674 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-10-09T08:14:30.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.856+0000 7ff64f59d700 1 Processor -- start 2023-10-09T08:14:30.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.856+0000 7ff64f59d700 1 -- start start 2023-10-09T08:14:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.857+0000 7ff64f59d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff6481593b0 0x7ff648159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.857+0000 7ff64f59d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6480cfe20 con 0x7ff6480ceaa0 2023-10-09T08:14:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.857+0000 7ff64f59d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6480cf210 con 0x7ff6480b1e50 2023-10-09T08:14:30.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.857+0000 7ff64f59d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6480cf4f0 con 0x7ff6481593b0 2023-10-09T08:14:30.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.858+0000 7ff64dd9a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff6480ceaa0 0x7ff6480b1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48238/0 (socket says 172.21.15.71:48238) 2023-10-09T08:14:30.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.858+0000 7ff64dd9a700 1 -- 172.21.15.71:0/167046730 learned_addr learned my addr 172.21.15.71:0/167046730 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:30.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.858+0000 7ff64e59b700 1 --2- 172.21.15.71:0/167046730 >> v2:172.21.15.179:3300/0 conn(0x7ff6481593b0 0x7ff648159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.858+0000 7ff64d599700 1 -- 172.21.15.71:0/167046730 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 217694700 0 0) 0x7ff6480cfe20 con 0x7ff6480ceaa0 2023-10-09T08:14:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.858+0000 7ff64d599700 1 -- 172.21.15.71:0/167046730 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff634003570 con 0x7ff6480ceaa0 2023-10-09T08:14:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.858+0000 7ff64d599700 1 -- 172.21.15.71:0/167046730 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2900148658 0 0) 0x7ff634003570 con 0x7ff6480ceaa0 2023-10-09T08:14:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.858+0000 7ff64e59b700 1 -- 172.21.15.71:0/167046730 >> v1:172.21.15.179:6789/0 conn(0x7ff6480b1e50 legacy=0x7ff6480b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.858+0000 7ff64e59b700 1 -- 172.21.15.71:0/167046730 >> v1:172.21.15.71:6789/0 conn(0x7ff6480ceaa0 legacy=0x7ff6480b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.858+0000 7ff64e59b700 1 -- 172.21.15.71:0/167046730 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6480cf7d0 con 0x7ff6481593b0 2023-10-09T08:14:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.859+0000 7ff64e59b700 1 --2- 172.21.15.71:0/167046730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6481593b0 0x7ff648159780 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7ff6440098e0 tx=0x7ff6440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf59d1fd666ed0f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.859+0000 7ff64d599700 1 -- 172.21.15.71:0/167046730 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff638001470 con 0x7ff6481593b0 2023-10-09T08:14:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.859+0000 7ff64d599700 1 -- 172.21.15.71:0/167046730 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff644011420 con 0x7ff6481593b0 2023-10-09T08:14:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.859+0000 7ff64d599700 1 -- 172.21.15.71:0/167046730 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6440117c0 con 0x7ff6481593b0 2023-10-09T08:14:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.859+0000 7ff64f59d700 1 -- 172.21.15.71:0/167046730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6481593b0 msgr2=0x7ff648159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.859+0000 7ff64f59d700 1 --2- 172.21.15.71:0/167046730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6481593b0 0x7ff648159780 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7ff6440098e0 tx=0x7ff6440091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:30.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.860+0000 7ff64f59d700 1 -- 172.21.15.71:0/167046730 shutdown_connections 2023-10-09T08:14:30.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.860+0000 7ff64f59d700 1 --2- 172.21.15.71:0/167046730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6481593b0 0x7ff648159780 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:30.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.860+0000 7ff64f59d700 1 -- 172.21.15.71:0/167046730 >> 172.21.15.71:0/167046730 conn(0x7ff6480d1130 msgr2=0x7ff6480b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:30.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.860+0000 7ff64f59d700 1 -- 172.21.15.71:0/167046730 shutdown_connections 2023-10-09T08:14:30.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.860+0000 7ff64f59d700 1 -- 172.21.15.71:0/167046730 wait complete. 2023-10-09T08:14:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.861+0000 7ff64f59d700 1 Processor -- start 2023-10-09T08:14:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.861+0000 7ff64f59d700 1 -- start start 2023-10-09T08:14:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.862+0000 7ff64f59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6480b1e50 0x7ff64815b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.862+0000 7ff64f59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6480ceaa0 0x7ff64816a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.862+0000 7ff64f59d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6481593b0 0x7ff6480c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.862+0000 7ff64f59d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64816abb0 con 0x7ff6481593b0 2023-10-09T08:14:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.862+0000 7ff64f59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64815bdc0 con 0x7ff6480ceaa0 2023-10-09T08:14:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.862+0000 7ff64f59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64816dc10 con 0x7ff6480b1e50 2023-10-09T08:14:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.862+0000 7ff64ed9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6481593b0 0x7ff6480c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.862+0000 7ff64ed9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6481593b0 0x7ff6480c6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50468/0 (socket says 172.21.15.71:50468) 2023-10-09T08:14:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.862+0000 7ff64ed9c700 1 -- 172.21.15.71:0/1572099946 learned_addr learned my addr 172.21.15.71:0/1572099946 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.862+0000 7ff64e59b700 1 --2- 172.21.15.71:0/1572099946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6480b1e50 0x7ff64815b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.863+0000 7ff64dd9a700 1 --2- 172.21.15.71:0/1572099946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6480ceaa0 0x7ff64816a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.863+0000 7ff64ed9c700 1 -- 172.21.15.71:0/1572099946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6480b1e50 msgr2=0x7ff64815b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:30.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.863+0000 7ff64ed9c700 1 --2- 172.21.15.71:0/1572099946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6480b1e50 0x7ff64815b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:30.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.863+0000 7ff64ed9c700 1 -- 172.21.15.71:0/1572099946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6480ceaa0 msgr2=0x7ff64816a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:30.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.863+0000 7ff64ed9c700 1 --2- 172.21.15.71:0/1572099946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6480ceaa0 0x7ff64816a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:30.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.863+0000 7ff64ed9c700 1 -- 172.21.15.71:0/1572099946 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff644009420 con 0x7ff6481593b0 2023-10-09T08:14:30.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.863+0000 7ff64ed9c700 1 --2- 172.21.15.71:0/1572099946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6481593b0 0x7ff6480c6e50 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7ff64000c9b0 tx=0x7ff640001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:30.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.863+0000 7ff63e7fc700 1 -- 172.21.15.71:0/1572099946 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640012630 con 0x7ff6481593b0 2023-10-09T08:14:30.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.863+0000 7ff63e7fc700 1 -- 172.21.15.71:0/1572099946 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6400127b0 con 0x7ff6481593b0 2023-10-09T08:14:30.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.863+0000 7ff64f59d700 1 -- 172.21.15.71:0/1572099946 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64816d2e0 con 0x7ff6481593b0 2023-10-09T08:14:30.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.863+0000 7ff63e7fc700 1 -- 172.21.15.71:0/1572099946 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640012b70 con 0x7ff6481593b0 2023-10-09T08:14:30.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.863+0000 7ff64f59d700 1 -- 172.21.15.71:0/1572099946 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64816d8a0 con 0x7ff6481593b0 2023-10-09T08:14:30.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.864+0000 7ff64f59d700 1 -- 172.21.15.71:0/1572099946 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff64804c3c0 con 0x7ff6481593b0 2023-10-09T08:14:30.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.865+0000 7ff63e7fc700 1 -- 172.21.15.71:0/1572099946 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff640003030 con 0x7ff6481593b0 2023-10-09T08:14:30.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.867+0000 7ff63e7fc700 1 --2- 172.21.15.71:0/1572099946 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff62c066f30 0x7ff62c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:30.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.867+0000 7ff63e7fc700 1 -- 172.21.15.71:0/1572099946 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6291+0+0 (secure 0 0 0) 0x7ff640084830 con 0x7ff6481593b0 2023-10-09T08:14:30.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.867+0000 7ff64e59b700 1 --2- 172.21.15.71:0/1572099946 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff62c066f30 0x7ff62c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:30.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.868+0000 7ff64e59b700 1 --2- 172.21.15.71:0/1572099946 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff62c066f30 0x7ff62c0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff6440030c0 tx=0x7ff644017000 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:30.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:30.871+0000 7ff63e7fc700 1 -- 172.21.15.71:0/1572099946 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6400517b0 con 0x7ff6481593b0 2023-10-09T08:14:31.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.142+0000 7ff64f59d700 1 -- 172.21.15.71:0/1572099946 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7ff64816dd50 con 0x7ff6481593b0 2023-10-09T08:14:31.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.414+0000 7ff63e7fc700 1 -- 172.21.15.71:0/1572099946 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v2959) v1 ==== 165+0+0 (secure 0 0 0) 0x7ff640054dd0 con 0x7ff6481593b0 2023-10-09T08:14:31.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.417+0000 7ff64f59d700 1 -- 172.21.15.71:0/1572099946 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff62c066f30 msgr2=0x7ff62c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:31.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.417+0000 7ff64f59d700 1 --2- 172.21.15.71:0/1572099946 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff62c066f30 0x7ff62c0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff6440030c0 tx=0x7ff644017000 comp rx=0 tx=0).stop 2023-10-09T08:14:31.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.417+0000 7ff64f59d700 1 -- 172.21.15.71:0/1572099946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6481593b0 msgr2=0x7ff6480c6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:31.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.417+0000 7ff64f59d700 1 --2- 172.21.15.71:0/1572099946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6481593b0 0x7ff6480c6e50 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7ff64000c9b0 tx=0x7ff640001770 comp rx=0 tx=0).stop 2023-10-09T08:14:31.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.417+0000 7ff64f59d700 1 -- 172.21.15.71:0/1572099946 shutdown_connections 2023-10-09T08:14:31.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.417+0000 7ff64f59d700 1 --2- 172.21.15.71:0/1572099946 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff62c066f30 0x7ff62c0693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:31.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.417+0000 7ff64f59d700 1 --2- 172.21.15.71:0/1572099946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6481593b0 0x7ff6480c6e50 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:31.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.417+0000 7ff64f59d700 1 --2- 172.21.15.71:0/1572099946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6480b1e50 0x7ff64815b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:31.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.417+0000 7ff64f59d700 1 --2- 172.21.15.71:0/1572099946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6480ceaa0 0x7ff64816a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:31.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.417+0000 7ff64f59d700 1 -- 172.21.15.71:0/1572099946 >> 172.21.15.71:0/1572099946 conn(0x7ff6480d1130 msgr2=0x7ff648156f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:31.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.417+0000 7ff64f59d700 1 -- 172.21.15.71:0/1572099946 shutdown_connections 2023-10-09T08:14:31.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.417+0000 7ff64f59d700 1 -- 172.21.15.71:0/1572099946 wait complete. 2023-10-09T08:14:31.435 INFO:tasks.cephfs_test_runner:Test that snap schedule is resumed after mgr restart ... ok 2023-10-09T08:14:31.436 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test scheduled snapshots along with rentention policy 2023-10-09T08:14:31.436 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-09T08:14:31.436 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-10-09T08:14:31.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.616+0000 7f6047fff700 1 Processor -- start 2023-10-09T08:14:31.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.616+0000 7f6047fff700 1 -- start start 2023-10-09T08:14:31.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.617+0000 7f6047fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f60480cf6c0 0x7f60480b5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:31.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.617+0000 7f6047fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f604815a090 0x7f604815a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:31.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.617+0000 7f6047fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60480b5b40 con 0x7f6048159cc0 2023-10-09T08:14:31.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.617+0000 7f6047fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60480ce260 con 0x7f60480cf6c0 2023-10-09T08:14:31.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.617+0000 7f6047fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60480b5e20 con 0x7f604815a090 2023-10-09T08:14:31.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.618+0000 7f6046ffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6048159cc0 0x7f60480b2920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48240/0 (socket says 172.21.15.71:48240) 2023-10-09T08:14:31.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.618+0000 7f6046ffd700 1 -- 172.21.15.71:0/1037259152 learned_addr learned my addr 172.21.15.71:0/1037259152 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:31.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.618+0000 7f60467fc700 1 --2- 172.21.15.71:0/1037259152 >> v2:172.21.15.179:3300/0 conn(0x7f60480cf6c0 0x7f60480b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:31.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.618+0000 7f60477fe700 1 --2- 172.21.15.71:0/1037259152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f604815a090 0x7f604815a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:31.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.618+0000 7f6045ffb700 1 -- 172.21.15.71:0/1037259152 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653951597 0 0) 0x7f60480b5b40 con 0x7f6048159cc0 2023-10-09T08:14:31.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.618+0000 7f6045ffb700 1 -- 172.21.15.71:0/1037259152 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6030003570 con 0x7f6048159cc0 2023-10-09T08:14:31.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.618+0000 7f6045ffb700 1 -- 172.21.15.71:0/1037259152 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3288370102 0 0) 0x7f6030003570 con 0x7f6048159cc0 2023-10-09T08:14:31.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.618+0000 7f6045ffb700 1 -- 172.21.15.71:0/1037259152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f604815a090 msgr2=0x7f604815a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:31.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.618+0000 7f6045ffb700 1 --2- 172.21.15.71:0/1037259152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f604815a090 0x7f604815a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:31.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.618+0000 7f6045ffb700 1 -- 172.21.15.71:0/1037259152 >> v2:172.21.15.179:3300/0 conn(0x7f60480cf6c0 msgr2=0x7f60480b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:31.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.618+0000 7f6045ffb700 1 --2- 172.21.15.71:0/1037259152 >> v2:172.21.15.179:3300/0 conn(0x7f60480cf6c0 0x7f60480b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:31.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.618+0000 7f6045ffb700 1 -- 172.21.15.71:0/1037259152 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60480b6100 con 0x7f6048159cc0 2023-10-09T08:14:31.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.618+0000 7f6045ffb700 1 -- 172.21.15.71:0/1037259152 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f60380015f0 con 0x7f6048159cc0 2023-10-09T08:14:31.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.619+0000 7f6045ffb700 1 -- 172.21.15.71:0/1037259152 >> v1:172.21.15.71:6789/0 conn(0x7f6048159cc0 legacy=0x7f60480b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:31.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.619+0000 7f6045ffb700 1 --2- 172.21.15.71:0/1037259152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6030003ae0 0x7f6030003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:31.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.619+0000 7f6045ffb700 1 --2- 172.21.15.71:0/1037259152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6030004810 0x7f6030004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:31.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.619+0000 7f6045ffb700 1 --2- 172.21.15.71:0/1037259152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f604815a090 0x7f60300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:31.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.619+0000 7f6045ffb700 1 -- 172.21.15.71:0/1037259152 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60480ce260 con 0x7f6030004810 2023-10-09T08:14:31.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.619+0000 7f6045ffb700 1 -- 172.21.15.71:0/1037259152 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60480b5e20 con 0x7f6030003ae0 2023-10-09T08:14:31.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.619+0000 7f6045ffb700 1 -- 172.21.15.71:0/1037259152 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603000bb10 con 0x7f604815a090 2023-10-09T08:14:31.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.619+0000 7f60467fc700 1 --2- 172.21.15.71:0/1037259152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6030004810 0x7f6030004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:31.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.619+0000 7f6046ffd700 1 --2- 172.21.15.71:0/1037259152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6030003ae0 0x7f6030003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:31.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.619+0000 7f60477fe700 1 --2- 172.21.15.71:0/1037259152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f604815a090 0x7f60300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:31.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.619+0000 7f60467fc700 1 -- 172.21.15.71:0/1037259152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f604815a090 msgr2=0x7f60300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:31.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.619+0000 7f60467fc700 1 --2- 172.21.15.71:0/1037259152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f604815a090 0x7f60300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:31.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.619+0000 7f60467fc700 1 -- 172.21.15.71:0/1037259152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6030003ae0 msgr2=0x7f6030003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:31.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.619+0000 7f60467fc700 1 --2- 172.21.15.71:0/1037259152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6030003ae0 0x7f6030003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:31.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.619+0000 7f60467fc700 1 -- 172.21.15.71:0/1037259152 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6030003570 con 0x7f6030004810 2023-10-09T08:14:31.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.619+0000 7f60477fe700 1 --2- 172.21.15.71:0/1037259152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f604815a090 0x7f60300051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:14:31.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.619+0000 7f60467fc700 1 --2- 172.21.15.71:0/1037259152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6030004810 0x7f6030004c80 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f60480b5a70 tx=0x7f603c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884fd08e3ecd4a69 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:31.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.620+0000 7f6045ffb700 1 -- 172.21.15.71:0/1037259152 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c00e710 con 0x7f6030004810 2023-10-09T08:14:31.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.620+0000 7f6045ffb700 1 -- 172.21.15.71:0/1037259152 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603c00e870 con 0x7f6030004810 2023-10-09T08:14:31.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.620+0000 7f6045ffb700 1 -- 172.21.15.71:0/1037259152 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c00ec30 con 0x7f6030004810 2023-10-09T08:14:31.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.620+0000 7f6047fff700 1 -- 172.21.15.71:0/1037259152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6030004810 msgr2=0x7f6030004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:31.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.620+0000 7f6047fff700 1 --2- 172.21.15.71:0/1037259152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6030004810 0x7f6030004c80 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f60480b5a70 tx=0x7f603c0091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:31.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.620+0000 7f60477fe700 1 -- 172.21.15.71:0/1037259152 reap_dead start 2023-10-09T08:14:31.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.620+0000 7f6047fff700 1 -- 172.21.15.71:0/1037259152 shutdown_connections 2023-10-09T08:14:31.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.620+0000 7f6047fff700 1 -- 172.21.15.71:0/1037259152 >> 172.21.15.71:0/1037259152 conn(0x7f60480d0560 msgr2=0x7f60480d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:31.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.620+0000 7f6047fff700 1 -- 172.21.15.71:0/1037259152 shutdown_connections 2023-10-09T08:14:31.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.620+0000 7f6047fff700 1 -- 172.21.15.71:0/1037259152 wait complete. 2023-10-09T08:14:31.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.622+0000 7f6047fff700 1 Processor -- start 2023-10-09T08:14:31.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.622+0000 7f6047fff700 1 -- start start 2023-10-09T08:14:31.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.623+0000 7f6047fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6030004810 0x7f6048155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:31.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.623+0000 7f6047fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f604816a1a0 0x7f6048143f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:31.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.623+0000 7f6047fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6048152d30 0x7f60481531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:31.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.623+0000 7f6047fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60481536e0 con 0x7f6048152d30 2023-10-09T08:14:31.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.623+0000 7f6047fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604806a0b0 con 0x7f604816a1a0 2023-10-09T08:14:31.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.623+0000 7f6047fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6048069aa0 con 0x7f6030004810 2023-10-09T08:14:31.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.623+0000 7f60477fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6048152d30 0x7f60481531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:31.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.623+0000 7f60477fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6048152d30 0x7f60481531a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50484/0 (socket says 172.21.15.71:50484) 2023-10-09T08:14:31.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.623+0000 7f60477fe700 1 -- 172.21.15.71:0/3129892326 learned_addr learned my addr 172.21.15.71:0/3129892326 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:31.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.623+0000 7f60467fc700 1 --2- 172.21.15.71:0/3129892326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f604816a1a0 0x7f6048143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:31.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.623+0000 7f6046ffd700 1 --2- 172.21.15.71:0/3129892326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6030004810 0x7f6048155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:31.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.623+0000 7f60477fe700 1 -- 172.21.15.71:0/3129892326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6030004810 msgr2=0x7f6048155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:31.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.623+0000 7f60477fe700 1 --2- 172.21.15.71:0/3129892326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6030004810 0x7f6048155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:31.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.623+0000 7f60477fe700 1 -- 172.21.15.71:0/3129892326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f604816a1a0 msgr2=0x7f6048143f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:31.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.624+0000 7f60477fe700 1 --2- 172.21.15.71:0/3129892326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f604816a1a0 0x7f6048143f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:31.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.624+0000 7f60477fe700 1 -- 172.21.15.71:0/3129892326 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60481542e0 con 0x7f6048152d30 2023-10-09T08:14:31.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.624+0000 7f6046ffd700 1 --2- 172.21.15.71:0/3129892326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6030004810 0x7f6048155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:14:31.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.624+0000 7f60467fc700 1 --2- 172.21.15.71:0/3129892326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f604816a1a0 0x7f6048143f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:14:31.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.624+0000 7f60477fe700 1 --2- 172.21.15.71:0/3129892326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6048152d30 0x7f60481531a0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f60480af8b0 tx=0x7f604000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:31.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.624+0000 7f602effd700 1 -- 172.21.15.71:0/3129892326 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604001b070 con 0x7f6048152d30 2023-10-09T08:14:31.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.624+0000 7f602effd700 1 -- 172.21.15.71:0/3129892326 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604000f040 con 0x7f6048152d30 2023-10-09T08:14:31.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.624+0000 7f6047fff700 1 -- 172.21.15.71:0/3129892326 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60481545c0 con 0x7f6048152d30 2023-10-09T08:14:31.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.624+0000 7f602effd700 1 -- 172.21.15.71:0/3129892326 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604000e050 con 0x7f6048152d30 2023-10-09T08:14:31.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.624+0000 7f6047fff700 1 -- 172.21.15.71:0/3129892326 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f604816a610 con 0x7f6048152d30 2023-10-09T08:14:31.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.625+0000 7f6047fff700 1 -- 172.21.15.71:0/3129892326 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f604804c3c0 con 0x7f6048152d30 2023-10-09T08:14:31.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.626+0000 7f602effd700 1 -- 172.21.15.71:0/3129892326 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6040003020 con 0x7f6048152d30 2023-10-09T08:14:31.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.627+0000 7f602effd700 1 --2- 172.21.15.71:0/3129892326 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6034066f30 0x7f60340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:31.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.627+0000 7f602effd700 1 -- 172.21.15.71:0/3129892326 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6291+0+0 (secure 0 0 0) 0x7f6040084c40 con 0x7f6048152d30 2023-10-09T08:14:31.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.627+0000 7f6046ffd700 1 --2- 172.21.15.71:0/3129892326 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6034066f30 0x7f60340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:31.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.628+0000 7f6046ffd700 1 --2- 172.21.15.71:0/3129892326 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6034066f30 0x7f60340693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6048150c50 tx=0x7f6038009040 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:31.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.631+0000 7f602effd700 1 -- 172.21.15.71:0/3129892326 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6040051c60 con 0x7f6048152d30 2023-10-09T08:14:31.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:31.898+0000 7f6047fff700 1 -- 172.21.15.71:0/3129892326 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7f60480b63e0 con 0x7f6048152d30 2023-10-09T08:14:32.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.419+0000 7f602effd700 1 -- 172.21.15.71:0/3129892326 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v2960) v1 ==== 166+0+0 (secure 0 0 0) 0x7f6040010ea0 con 0x7f6048152d30 2023-10-09T08:14:32.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.421+0000 7f6047fff700 1 -- 172.21.15.71:0/3129892326 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6034066f30 msgr2=0x7f60340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:32.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.421+0000 7f6047fff700 1 --2- 172.21.15.71:0/3129892326 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6034066f30 0x7f60340693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6048150c50 tx=0x7f6038009040 comp rx=0 tx=0).stop 2023-10-09T08:14:32.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.421+0000 7f6047fff700 1 -- 172.21.15.71:0/3129892326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6048152d30 msgr2=0x7f60481531a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:32.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.421+0000 7f6047fff700 1 --2- 172.21.15.71:0/3129892326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6048152d30 0x7f60481531a0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f60480af8b0 tx=0x7f604000b040 comp rx=0 tx=0).stop 2023-10-09T08:14:32.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.422+0000 7f6047fff700 1 -- 172.21.15.71:0/3129892326 shutdown_connections 2023-10-09T08:14:32.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.422+0000 7f6047fff700 1 --2- 172.21.15.71:0/3129892326 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6034066f30 0x7f60340693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:32.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.422+0000 7f6047fff700 1 --2- 172.21.15.71:0/3129892326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6048152d30 0x7f60481531a0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:32.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.422+0000 7f6047fff700 1 --2- 172.21.15.71:0/3129892326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6030004810 0x7f6048155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:32.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.422+0000 7f6047fff700 1 --2- 172.21.15.71:0/3129892326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f604816a1a0 0x7f6048143f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:32.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.422+0000 7f6047fff700 1 -- 172.21.15.71:0/3129892326 >> 172.21.15.71:0/3129892326 conn(0x7f60480d0560 msgr2=0x7f6048152320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:32.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.422+0000 7f6047fff700 1 -- 172.21.15.71:0/3129892326 shutdown_connections 2023-10-09T08:14:32.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.422+0000 7f6047fff700 1 -- 172.21.15.71:0/3129892326 wait complete. 2023-10-09T08:14:32.441 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T08:14:32.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.625+0000 7f26b2bff700 1 Processor -- start 2023-10-09T08:14:32.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.625+0000 7f26b2bff700 1 -- start start 2023-10-09T08:14:32.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.626+0000 7f26b2bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f26ac159890 0x7f26ac15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:32.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.626+0000 7f26b2bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26ac069560 0x7f26ac0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:32.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.626+0000 7f26b2bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26ac069ee0 con 0x7f26ac159c60 2023-10-09T08:14:32.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.626+0000 7f26b2bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26ac15a160 con 0x7f26ac159890 2023-10-09T08:14:32.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.626+0000 7f26b2bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0d13a0 con 0x7f26ac069560 2023-10-09T08:14:32.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.627+0000 7f26abfff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f26ac159c60 0x7f26ac15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48246/0 (socket says 172.21.15.71:48246) 2023-10-09T08:14:32.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.627+0000 7f26abfff700 1 -- 172.21.15.71:0/3194513607 learned_addr learned my addr 172.21.15.71:0/3194513607 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:32.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.627+0000 7f26ab7fe700 1 -- 172.21.15.71:0/3194513607 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2058612768 0 0) 0x7f26ac069ee0 con 0x7f26ac159c60 2023-10-09T08:14:32.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.627+0000 7f26ab7fe700 1 -- 172.21.15.71:0/3194513607 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f269c003570 con 0x7f26ac159c60 2023-10-09T08:14:32.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.627+0000 7f26b119c700 1 --2- 172.21.15.71:0/3194513607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26ac069560 0x7f26ac0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:32.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.627+0000 7f26b099b700 1 --2- 172.21.15.71:0/3194513607 >> v2:172.21.15.179:3300/0 conn(0x7f26ac159890 0x7f26ac15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:32.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.627+0000 7f26ab7fe700 1 -- 172.21.15.71:0/3194513607 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 477490278 0 0) 0x7f269c003570 con 0x7f26ac159c60 2023-10-09T08:14:32.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.627+0000 7f26ab7fe700 1 -- 172.21.15.71:0/3194513607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26ac069560 msgr2=0x7f26ac0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:32.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.627+0000 7f26ab7fe700 1 --2- 172.21.15.71:0/3194513607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26ac069560 0x7f26ac0699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:32.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.627+0000 7f26ab7fe700 1 -- 172.21.15.71:0/3194513607 >> v2:172.21.15.179:3300/0 conn(0x7f26ac159890 msgr2=0x7f26ac15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:32.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.627+0000 7f26ab7fe700 1 --2- 172.21.15.71:0/3194513607 >> v2:172.21.15.179:3300/0 conn(0x7f26ac159890 0x7f26ac15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:32.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.627+0000 7f26ab7fe700 1 -- 172.21.15.71:0/3194513607 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ac15e140 con 0x7f26ac159c60 2023-10-09T08:14:32.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.627+0000 7f26ab7fe700 1 -- 172.21.15.71:0/3194513607 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f2698001470 con 0x7f26ac159c60 2023-10-09T08:14:32.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.627+0000 7f26ab7fe700 1 -- 172.21.15.71:0/3194513607 >> v1:172.21.15.71:6789/0 conn(0x7f26ac159c60 legacy=0x7f26ac15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:32.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.627+0000 7f26ab7fe700 1 --2- 172.21.15.71:0/3194513607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f269c003a60 0x7f269c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:32.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.627+0000 7f26ab7fe700 1 --2- 172.21.15.71:0/3194513607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26ac069560 0x7f269c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:32.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.627+0000 7f26ab7fe700 1 --2- 172.21.15.71:0/3194513607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f269c004d50 0x7f269c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:32.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.627+0000 7f26ab7fe700 1 -- 172.21.15.71:0/3194513607 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac15a160 con 0x7f269c003a60 2023-10-09T08:14:32.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.628+0000 7f26ab7fe700 1 -- 172.21.15.71:0/3194513607 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0d13a0 con 0x7f269c004d50 2023-10-09T08:14:32.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.628+0000 7f26ab7fe700 1 -- 172.21.15.71:0/3194513607 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269c00bb10 con 0x7f26ac069560 2023-10-09T08:14:32.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.628+0000 7f26b099b700 1 --2- 172.21.15.71:0/3194513607 >> v2:172.21.15.179:3300/0 conn(0x7f26ac159890 0x7f26ac15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:14:32.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.628+0000 7f26b099b700 1 --2- 172.21.15.71:0/3194513607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f269c003a60 0x7f269c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:32.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.628+0000 7f26abfff700 1 --2- 172.21.15.71:0/3194513607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26ac069560 0x7f269c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:32.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.628+0000 7f26b119c700 1 --2- 172.21.15.71:0/3194513607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f269c004d50 0x7f269c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:32.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.628+0000 7f26b099b700 1 -- 172.21.15.71:0/3194513607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26ac069560 msgr2=0x7f269c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:32.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.628+0000 7f26b099b700 1 --2- 172.21.15.71:0/3194513607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26ac069560 0x7f269c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:32.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.628+0000 7f26b099b700 1 -- 172.21.15.71:0/3194513607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f269c004d50 msgr2=0x7f269c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:32.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.628+0000 7f26b099b700 1 --2- 172.21.15.71:0/3194513607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f269c004d50 0x7f269c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:32.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.628+0000 7f26b099b700 1 -- 172.21.15.71:0/3194513607 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269c003570 con 0x7f269c003a60 2023-10-09T08:14:32.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.629+0000 7f26b099b700 1 --2- 172.21.15.71:0/3194513607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f269c003a60 0x7f269c003e70 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009ba0 tx=0x7f26a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c3ff9ad4754365 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:32.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.629+0000 7f26ab7fe700 1 -- 172.21.15.71:0/3194513607 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a000c070 con 0x7f269c003a60 2023-10-09T08:14:32.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.629+0000 7f26ab7fe700 1 -- 172.21.15.71:0/3194513607 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a000e5e0 con 0x7f269c003a60 2023-10-09T08:14:32.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.629+0000 7f26ab7fe700 1 -- 172.21.15.71:0/3194513607 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a000e790 con 0x7f269c003a60 2023-10-09T08:14:32.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.629+0000 7f26b2bff700 1 -- 172.21.15.71:0/3194513607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f269c003a60 msgr2=0x7f269c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:32.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.629+0000 7f26b2bff700 1 --2- 172.21.15.71:0/3194513607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f269c003a60 0x7f269c003e70 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009ba0 tx=0x7f26a0008040 comp rx=0 tx=0).stop 2023-10-09T08:14:32.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.629+0000 7f26b119c700 1 -- 172.21.15.71:0/3194513607 reap_dead start 2023-10-09T08:14:32.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.629+0000 7f26b2bff700 1 -- 172.21.15.71:0/3194513607 shutdown_connections 2023-10-09T08:14:32.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.629+0000 7f26b2bff700 1 -- 172.21.15.71:0/3194513607 >> 172.21.15.71:0/3194513607 conn(0x7f26ac068e20 msgr2=0x7f26ac0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:32.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.629+0000 7f26b2bff700 1 -- 172.21.15.71:0/3194513607 shutdown_connections 2023-10-09T08:14:32.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.629+0000 7f26b2bff700 1 -- 172.21.15.71:0/3194513607 wait complete. 2023-10-09T08:14:32.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.631+0000 7f26b2bff700 1 Processor -- start 2023-10-09T08:14:32.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.631+0000 7f26b2bff700 1 -- start start 2023-10-09T08:14:32.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.632+0000 7f26b2bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f269c003a60 0x7f26ac0cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:32.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.632+0000 7f26b2bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26ac0ce510 0x7f26ac13c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:32.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.632+0000 7f26b2bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26ac0b4760 0x7f26ac0b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:32.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.632+0000 7f26b2bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0cf690 con 0x7f26ac0b4760 2023-10-09T08:14:32.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.632+0000 7f26b2bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0cea80 con 0x7f269c003a60 2023-10-09T08:14:32.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.632+0000 7f26b2bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0ced60 con 0x7f26ac0ce510 2023-10-09T08:14:32.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.632+0000 7f26b119c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26ac0b4760 0x7f26ac0b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:32.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.632+0000 7f26b099b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f269c003a60 0x7f26ac0cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:32.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.632+0000 7f26b119c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26ac0b4760 0x7f26ac0b1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50512/0 (socket says 172.21.15.71:50512) 2023-10-09T08:14:32.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.632+0000 7f26b119c700 1 -- 172.21.15.71:0/2114016195 learned_addr learned my addr 172.21.15.71:0/2114016195 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:32.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.632+0000 7f26abfff700 1 --2- 172.21.15.71:0/2114016195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26ac0ce510 0x7f26ac13c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:32.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.633+0000 7f26b119c700 1 -- 172.21.15.71:0/2114016195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26ac0ce510 msgr2=0x7f26ac13c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:32.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.633+0000 7f26b119c700 1 --2- 172.21.15.71:0/2114016195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26ac0ce510 0x7f26ac13c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:32.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.633+0000 7f26b119c700 1 -- 172.21.15.71:0/2114016195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f269c003a60 msgr2=0x7f26ac0cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:32.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.633+0000 7f26b119c700 1 --2- 172.21.15.71:0/2114016195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f269c003a60 0x7f26ac0cfb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:32.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.633+0000 7f26b119c700 1 -- 172.21.15.71:0/2114016195 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ac0cf040 con 0x7f26ac0b4760 2023-10-09T08:14:32.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.633+0000 7f26b099b700 1 --2- 172.21.15.71:0/2114016195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f269c003a60 0x7f26ac0cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:14:32.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.633+0000 7f26b119c700 1 --2- 172.21.15.71:0/2114016195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26ac0b4760 0x7f26ac0b1620 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f26ac0d03b0 tx=0x7f26a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:32.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.633+0000 7f26a8ff9700 1 -- 172.21.15.71:0/2114016195 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a400e040 con 0x7f26ac0b4760 2023-10-09T08:14:32.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.633+0000 7f26a8ff9700 1 -- 172.21.15.71:0/2114016195 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a400f040 con 0x7f26ac0b4760 2023-10-09T08:14:32.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.633+0000 7f26b2bff700 1 -- 172.21.15.71:0/2114016195 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26ac0cf320 con 0x7f26ac0b4760 2023-10-09T08:14:32.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.633+0000 7f26a8ff9700 1 -- 172.21.15.71:0/2114016195 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a400fd70 con 0x7f26ac0b4760 2023-10-09T08:14:32.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.633+0000 7f26b2bff700 1 -- 172.21.15.71:0/2114016195 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26ac0b4bd0 con 0x7f26ac0b4760 2023-10-09T08:14:32.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.634+0000 7f26b2bff700 1 -- 172.21.15.71:0/2114016195 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26ac069930 con 0x7f26ac0b4760 2023-10-09T08:14:32.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.635+0000 7f26a8ff9700 1 -- 172.21.15.71:0/2114016195 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26a4015640 con 0x7f26ac0b4760 2023-10-09T08:14:32.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.636+0000 7f26a8ff9700 1 --2- 172.21.15.71:0/2114016195 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2690066f30 0x7f26900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:32.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.636+0000 7f26a8ff9700 1 -- 172.21.15.71:0/2114016195 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6291+0+0 (secure 0 0 0) 0x7f26a4084fc0 con 0x7f26ac0b4760 2023-10-09T08:14:32.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.637+0000 7f26b099b700 1 --2- 172.21.15.71:0/2114016195 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2690066f30 0x7f26900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:32.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.637+0000 7f26b099b700 1 --2- 172.21.15.71:0/2114016195 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2690066f30 0x7f26900693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009640 tx=0x7f26a001a000 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:32.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.640+0000 7f26a8ff9700 1 -- 172.21.15.71:0/2114016195 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26a4051f40 con 0x7f26ac0b4760 2023-10-09T08:14:32.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.838+0000 7f26b2bff700 1 -- 172.21.15.71:0/2114016195 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f26ac0cf4b0 con 0x7f26ac0b4760 2023-10-09T08:14:32.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.842+0000 7f26a8ff9700 1 -- 172.21.15.71:0/2114016195 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v64)=0 v64) v1 ==== 122+0+0 (secure 0 0 0) 0x7f26a4055560 con 0x7f26ac0b4760 2023-10-09T08:14:32.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.844+0000 7f26b2bff700 1 -- 172.21.15.71:0/2114016195 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2690066f30 msgr2=0x7f26900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:32.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.844+0000 7f26b2bff700 1 --2- 172.21.15.71:0/2114016195 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2690066f30 0x7f26900693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009640 tx=0x7f26a001a000 comp rx=0 tx=0).stop 2023-10-09T08:14:32.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.844+0000 7f26b2bff700 1 -- 172.21.15.71:0/2114016195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26ac0b4760 msgr2=0x7f26ac0b1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:32.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.844+0000 7f26b2bff700 1 --2- 172.21.15.71:0/2114016195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26ac0b4760 0x7f26ac0b1620 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f26ac0d03b0 tx=0x7f26a400b040 comp rx=0 tx=0).stop 2023-10-09T08:14:32.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.845+0000 7f26b2bff700 1 -- 172.21.15.71:0/2114016195 shutdown_connections 2023-10-09T08:14:32.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.845+0000 7f26b2bff700 1 --2- 172.21.15.71:0/2114016195 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2690066f30 0x7f26900693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:32.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.845+0000 7f26b2bff700 1 --2- 172.21.15.71:0/2114016195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26ac0b4760 0x7f26ac0b1620 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:32.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.845+0000 7f26b2bff700 1 --2- 172.21.15.71:0/2114016195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f269c003a60 0x7f26ac0cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:32.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.845+0000 7f26b2bff700 1 --2- 172.21.15.71:0/2114016195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26ac0ce510 0x7f26ac13c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:32.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.845+0000 7f26b2bff700 1 -- 172.21.15.71:0/2114016195 >> 172.21.15.71:0/2114016195 conn(0x7f26ac068e20 msgr2=0x7f26ac153450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:32.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.845+0000 7f26b2bff700 1 -- 172.21.15.71:0/2114016195 shutdown_connections 2023-10-09T08:14:32.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:32.845+0000 7f26b2bff700 1 -- 172.21.15.71:0/2114016195 wait complete. 2023-10-09T08:14:32.864 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T08:14:32.864 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T08:14:32.944 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T08:14:33.031 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T08:14:33.031 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T08:14:33.032 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T08:14:33.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.211+0000 7fd4bffff700 1 Processor -- start 2023-10-09T08:14:33.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.211+0000 7fd4bffff700 1 -- start start 2023-10-09T08:14:33.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.213+0000 7fd4bffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd4c01566e0 0x7fd4c00ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:33.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.213+0000 7fd4bffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd4c00cb900 0x7fd4c00ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:33.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.213+0000 7fd4bffff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c00ca860 con 0x7fd4c0156310 2023-10-09T08:14:33.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.213+0000 7fd4bffff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c00cab40 con 0x7fd4c01566e0 2023-10-09T08:14:33.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.213+0000 7fd4bffff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c00cae20 con 0x7fd4c00cb900 2023-10-09T08:14:33.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.213+0000 7fd4b7fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd4c01566e0 0x7fd4c00ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:33.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.213+0000 7fd4b7fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd4c01566e0 0x7fd4c00ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50514/0 (socket says 172.21.15.71:50514) 2023-10-09T08:14:33.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.213+0000 7fd4beffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd4c0156310 0x7fd4c00c9dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48258/0 (socket says 172.21.15.71:48258) 2023-10-09T08:14:33.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.213+0000 7fd4b7fff700 1 -- 172.21.15.71:0/544663224 learned_addr learned my addr 172.21.15.71:0/544663224 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:33.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.213+0000 7fd4bf7fe700 1 --2- 172.21.15.71:0/544663224 >> v2:172.21.15.179:3300/0 conn(0x7fd4c00cb900 0x7fd4c00ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:33.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.213+0000 7fd4b7fff700 1 -- 172.21.15.71:0/544663224 >> v2:172.21.15.179:3300/0 conn(0x7fd4c00cb900 msgr2=0x7fd4c00ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:33.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.213+0000 7fd4b7fff700 1 --2- 172.21.15.71:0/544663224 >> v2:172.21.15.179:3300/0 conn(0x7fd4c00cb900 0x7fd4c00ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:33.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.213+0000 7fd4b7fff700 1 -- 172.21.15.71:0/544663224 >> v1:172.21.15.71:6789/0 conn(0x7fd4c0156310 legacy=0x7fd4c00c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:33.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.213+0000 7fd4b7fff700 1 -- 172.21.15.71:0/544663224 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c00cb100 con 0x7fd4c01566e0 2023-10-09T08:14:33.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.213+0000 7fd4be7fc700 1 -- 172.21.15.71:0/544663224 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382150085 0 0) 0x7fd4c00ca860 con 0x7fd4c0156310 2023-10-09T08:14:33.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.214+0000 7fd4b7fff700 1 --2- 172.21.15.71:0/544663224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4c01566e0 0x7fd4c00ae000 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00addc0 tx=0x7fd4a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2584ee3b5e55b7d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:33.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.214+0000 7fd4be7fc700 1 -- 172.21.15.71:0/544663224 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a800b860 con 0x7fd4c01566e0 2023-10-09T08:14:33.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.214+0000 7fd4be7fc700 1 -- 172.21.15.71:0/544663224 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a800b9c0 con 0x7fd4c01566e0 2023-10-09T08:14:33.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.214+0000 7fd4be7fc700 1 -- 172.21.15.71:0/544663224 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a800bd60 con 0x7fd4c01566e0 2023-10-09T08:14:33.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.214+0000 7fd4bffff700 1 -- 172.21.15.71:0/544663224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4c01566e0 msgr2=0x7fd4c00ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:33.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.214+0000 7fd4bffff700 1 --2- 172.21.15.71:0/544663224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4c01566e0 0x7fd4c00ae000 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00addc0 tx=0x7fd4a8009250 comp rx=0 tx=0).stop 2023-10-09T08:14:33.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.215+0000 7fd4bffff700 1 -- 172.21.15.71:0/544663224 shutdown_connections 2023-10-09T08:14:33.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.215+0000 7fd4bffff700 1 --2- 172.21.15.71:0/544663224 >> v2:172.21.15.179:3300/0 conn(0x7fd4c00cb900 0x7fd4c00ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:33.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.215+0000 7fd4bffff700 1 --2- 172.21.15.71:0/544663224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4c01566e0 0x7fd4c00ae000 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:33.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.215+0000 7fd4bffff700 1 -- 172.21.15.71:0/544663224 >> 172.21.15.71:0/544663224 conn(0x7fd4c00cc1f0 msgr2=0x7fd4c00cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:33.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.215+0000 7fd4bffff700 1 -- 172.21.15.71:0/544663224 shutdown_connections 2023-10-09T08:14:33.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.215+0000 7fd4bffff700 1 -- 172.21.15.71:0/544663224 wait complete. 2023-10-09T08:14:33.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.216+0000 7fd4bffff700 1 Processor -- start 2023-10-09T08:14:33.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.216+0000 7fd4bffff700 1 -- start start 2023-10-09T08:14:33.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.217+0000 7fd4bffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4c00cb900 0x7fd4c0151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:33.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.217+0000 7fd4bffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4c0156310 0x7fd4c014fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:33.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.217+0000 7fd4bffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4c01566e0 0x7fd4c014e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:33.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.217+0000 7fd4bffff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c014f460 con 0x7fd4c00cb900 2023-10-09T08:14:33.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.217+0000 7fd4bffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c0166a60 con 0x7fd4c01566e0 2023-10-09T08:14:33.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.217+0000 7fd4bffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c0152440 con 0x7fd4c0156310 2023-10-09T08:14:33.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.217+0000 7fd4beffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4c00cb900 0x7fd4c0151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:33.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.217+0000 7fd4beffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4c00cb900 0x7fd4c0151f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50522/0 (socket says 172.21.15.71:50522) 2023-10-09T08:14:33.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.217+0000 7fd4beffd700 1 -- 172.21.15.71:0/124248381 learned_addr learned my addr 172.21.15.71:0/124248381 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:33.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.218+0000 7fd4bf7fe700 1 --2- 172.21.15.71:0/124248381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4c01566e0 0x7fd4c014e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:33.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.218+0000 7fd4b7fff700 1 --2- 172.21.15.71:0/124248381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4c0156310 0x7fd4c014fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:33.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.218+0000 7fd4beffd700 1 -- 172.21.15.71:0/124248381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4c0156310 msgr2=0x7fd4c014fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:33.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.218+0000 7fd4beffd700 1 --2- 172.21.15.71:0/124248381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4c0156310 0x7fd4c014fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:33.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.218+0000 7fd4beffd700 1 -- 172.21.15.71:0/124248381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4c01566e0 msgr2=0x7fd4c014e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:33.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.218+0000 7fd4beffd700 1 --2- 172.21.15.71:0/124248381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4c01566e0 0x7fd4c014e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:33.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.218+0000 7fd4beffd700 1 -- 172.21.15.71:0/124248381 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a80094f0 con 0x7fd4c00cb900 2023-10-09T08:14:33.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.218+0000 7fd4b7fff700 1 --2- 172.21.15.71:0/124248381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4c0156310 0x7fd4c014fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:14:33.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.218+0000 7fd4beffd700 1 --2- 172.21.15.71:0/124248381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4c00cb900 0x7fd4c0151f00 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00011e0 tx=0x7fd4b0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:33.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.218+0000 7fd4b6ffd700 1 -- 172.21.15.71:0/124248381 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0005a70 con 0x7fd4c00cb900 2023-10-09T08:14:33.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.218+0000 7fd4b6ffd700 1 -- 172.21.15.71:0/124248381 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b0005bd0 con 0x7fd4c00cb900 2023-10-09T08:14:33.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.218+0000 7fd4bffff700 1 -- 172.21.15.71:0/124248381 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c0165e50 con 0x7fd4c00cb900 2023-10-09T08:14:33.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.218+0000 7fd4b6ffd700 1 -- 172.21.15.71:0/124248381 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b00070d0 con 0x7fd4c00cb900 2023-10-09T08:14:33.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.218+0000 7fd4bffff700 1 -- 172.21.15.71:0/124248381 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c0166410 con 0x7fd4c00cb900 2023-10-09T08:14:33.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.219+0000 7fd4bffff700 1 -- 172.21.15.71:0/124248381 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c004c3c0 con 0x7fd4c00cb900 2023-10-09T08:14:33.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.220+0000 7fd4b6ffd700 1 -- 172.21.15.71:0/124248381 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd4b0007480 con 0x7fd4c00cb900 2023-10-09T08:14:33.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.221+0000 7fd4b6ffd700 1 --2- 172.21.15.71:0/124248381 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fd4a0066f30 0x7fd4a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:33.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.221+0000 7fd4b6ffd700 1 -- 172.21.15.71:0/124248381 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6291+0+0 (secure 0 0 0) 0x7fd4b0083c70 con 0x7fd4c00cb900 2023-10-09T08:14:33.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.222+0000 7fd4b7fff700 1 --2- 172.21.15.71:0/124248381 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fd4a0066f30 0x7fd4a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:33.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.223+0000 7fd4b7fff700 1 --2- 172.21.15.71:0/124248381 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fd4a0066f30 0x7fd4a00693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0156b50 tx=0x7fd4a8017000 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:33.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.225+0000 7fd4b6ffd700 1 -- 172.21.15.71:0/124248381 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4b004b5a0 con 0x7fd4c00cb900 2023-10-09T08:14:33.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.462+0000 7fd4bffff700 1 -- 172.21.15.71:0/124248381 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4c00cd0b0 con 0x7fd4c00cb900 2023-10-09T08:14:33.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.462+0000 7fd4b6ffd700 1 -- 172.21.15.71:0/124248381 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fd4b0017070 con 0x7fd4c00cb900 2023-10-09T08:14:33.464 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:14:33.464 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":84,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7523,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/845996701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":845996701},{"type":"v1","addr":"172.21.15.179:6834","nonce":845996701}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8683,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2670735121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2670735121},{"type":"v1","addr":"172.21.15.179:6836","nonce":2670735121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":9084,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/2448704931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2448704931},{"type":"v1","addr":"172.21.15.71:6834","nonce":2448704931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":9555,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/1702532358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":1702532358},{"type":"v1","addr":"172.21.15.71:6835","nonce":1702532358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84}],"filesystems":[]} 2023-10-09T08:14:33.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.465+0000 7fd4bffff700 1 -- 172.21.15.71:0/124248381 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fd4a0066f30 msgr2=0x7fd4a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:33.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.465+0000 7fd4bffff700 1 --2- 172.21.15.71:0/124248381 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fd4a0066f30 0x7fd4a00693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0156b50 tx=0x7fd4a8017000 comp rx=0 tx=0).stop 2023-10-09T08:14:33.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.465+0000 7fd4bffff700 1 -- 172.21.15.71:0/124248381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4c00cb900 msgr2=0x7fd4c0151f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:33.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.465+0000 7fd4bffff700 1 --2- 172.21.15.71:0/124248381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4c00cb900 0x7fd4c0151f00 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00011e0 tx=0x7fd4b0007e10 comp rx=0 tx=0).stop 2023-10-09T08:14:33.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.465+0000 7fd4bffff700 1 -- 172.21.15.71:0/124248381 shutdown_connections 2023-10-09T08:14:33.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.465+0000 7fd4bffff700 1 --2- 172.21.15.71:0/124248381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4c01566e0 0x7fd4c014e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:33.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.465+0000 7fd4bffff700 1 --2- 172.21.15.71:0/124248381 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fd4a0066f30 0x7fd4a00693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:33.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.465+0000 7fd4bffff700 1 --2- 172.21.15.71:0/124248381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4c00cb900 0x7fd4c0151f00 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:33.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.465+0000 7fd4bffff700 1 --2- 172.21.15.71:0/124248381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4c0156310 0x7fd4c014fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:33.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.465+0000 7fd4bffff700 1 -- 172.21.15.71:0/124248381 >> 172.21.15.71:0/124248381 conn(0x7fd4c00cc1f0 msgr2=0x7fd4c00c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:33.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.465+0000 7fd4bffff700 1 -- 172.21.15.71:0/124248381 shutdown_connections 2023-10-09T08:14:33.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.465+0000 7fd4bffff700 1 -- 172.21.15.71:0/124248381 wait complete. 2023-10-09T08:14:33.468 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 84 2023-10-09T08:14:33.484 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T08:14:33.484 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T08:14:33.484 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T08:14:33.484 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:14:33.485 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T08:14:33.485 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T08:14:33.485 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T08:14:33.485 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:14:33.485 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T08:14:33.485 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T08:14:33.485 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T08:14:33.486 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:14:33.486 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T08:14:33.486 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T08:14:33.486 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T08:14:33.486 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:14:33.499 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T08:14:33.499 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T08:14:33.500 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T08:14:33.500 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T08:14:33.506 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T08:14:33.506 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T08:14:33.507 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T08:14:33.507 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T08:14:33.543 INFO:tasks.ceph.mds.c:Started 2023-10-09T08:14:33.543 DEBUG:teuthology.parallel:result is None 2023-10-09T08:14:33.546 INFO:tasks.ceph.mds.a:Started 2023-10-09T08:14:33.547 DEBUG:teuthology.parallel:result is None 2023-10-09T08:14:33.551 INFO:tasks.ceph.mds.b:Started 2023-10-09T08:14:33.551 DEBUG:teuthology.parallel:result is None 2023-10-09T08:14:33.554 INFO:tasks.ceph.mds.d:Started 2023-10-09T08:14:33.554 DEBUG:teuthology.parallel:result is None 2023-10-09T08:14:33.554 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T08:14:33.676 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-10-09T08:14:33.677 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2023-10-09T08:14:33.690 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-09T08:14:33.690 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-09T08:14:33.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.747+0000 7f3eaf9ff700 1 Processor -- start 2023-10-09T08:14:33.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.747+0000 7f3eaf9ff700 1 -- start start 2023-10-09T08:14:33.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.748+0000 7f3eaf9ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3ea8159c60 0x7f3ea815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:33.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.748+0000 7f3eaf9ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea815a160 con 0x7f3ea815db10 2023-10-09T08:14:33.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.748+0000 7f3eaf9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea80d13a0 con 0x7f3ea8159890 2023-10-09T08:14:33.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.748+0000 7f3eaf9ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea815df50 con 0x7f3ea8159c60 2023-10-09T08:14:33.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.749+0000 7f3eacf9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3ea8159c60 0x7f3ea815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:33.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.749+0000 7f3eadf9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3ea815db10 0x7f3ea8069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48260/0 (socket says 172.21.15.71:48260) 2023-10-09T08:14:33.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.749+0000 7f3eadf9c700 1 -- 172.21.15.71:0/2601564769 learned_addr learned my addr 172.21.15.71:0/2601564769 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:33.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.749+0000 7f3eacf9a700 1 -- 172.21.15.71:0/2601564769 >> v1:172.21.15.179:6789/0 conn(0x7f3ea8159890 legacy=0x7f3ea815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:33.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.749+0000 7f3e9ffff700 1 -- 172.21.15.71:0/2601564769 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1707733153 0 0) 0x7f3ea80d13a0 con 0x7f3ea8159890 2023-10-09T08:14:33.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.749+0000 7f3eacf9a700 1 -- 172.21.15.71:0/2601564769 >> v1:172.21.15.71:6789/0 conn(0x7f3ea815db10 legacy=0x7f3ea8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:33.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.749+0000 7f3eacf9a700 1 -- 172.21.15.71:0/2601564769 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea815e140 con 0x7f3ea8159c60 2023-10-09T08:14:33.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.749+0000 7f3eacf9a700 1 --2- 172.21.15.71:0/2601564769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ea8159c60 0x7f3ea815d5d0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f3e980098e0 tx=0x7f3e980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233a1b566ac9904a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:33.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.750+0000 7f3e9ffff700 1 -- 172.21.15.71:0/2601564769 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e98009e80 con 0x7f3ea8159c60 2023-10-09T08:14:33.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.750+0000 7f3e9ffff700 1 -- 172.21.15.71:0/2601564769 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9800b760 con 0x7f3ea8159c60 2023-10-09T08:14:33.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.750+0000 7f3e9ffff700 1 -- 172.21.15.71:0/2601564769 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9800bae0 con 0x7f3ea8159c60 2023-10-09T08:14:33.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.750+0000 7f3eaf9ff700 1 -- 172.21.15.71:0/2601564769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ea8159c60 msgr2=0x7f3ea815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:33.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.750+0000 7f3eaf9ff700 1 --2- 172.21.15.71:0/2601564769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ea8159c60 0x7f3ea815d5d0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f3e980098e0 tx=0x7f3e980091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:33.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.750+0000 7f3eaf9ff700 1 -- 172.21.15.71:0/2601564769 shutdown_connections 2023-10-09T08:14:33.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.750+0000 7f3eaf9ff700 1 --2- 172.21.15.71:0/2601564769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ea8159c60 0x7f3ea815d5d0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:33.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.750+0000 7f3eaf9ff700 1 -- 172.21.15.71:0/2601564769 >> 172.21.15.71:0/2601564769 conn(0x7f3ea8068e20 msgr2=0x7f3ea80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:33.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.750+0000 7f3eaf9ff700 1 -- 172.21.15.71:0/2601564769 shutdown_connections 2023-10-09T08:14:33.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.750+0000 7f3eaf9ff700 1 -- 172.21.15.71:0/2601564769 wait complete. 2023-10-09T08:14:33.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.752+0000 7f3eaf9ff700 1 Processor -- start 2023-10-09T08:14:33.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.752+0000 7f3eaf9ff700 1 -- start start 2023-10-09T08:14:33.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.753+0000 7f3eaf9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ea8159890 0x7f3ea80b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:33.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.753+0000 7f3eaf9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ea8159c60 0x7f3ea80cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:33.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.753+0000 7f3eaf9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ea815db10 0x7f3ea80ce090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:33.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.753+0000 7f3eaf9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea80cd100 con 0x7f3ea8159890 2023-10-09T08:14:33.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.753+0000 7f3eaf9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea80b1b90 con 0x7f3ea8159c60 2023-10-09T08:14:33.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.753+0000 7f3eaf9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea80b1e70 con 0x7f3ea815db10 2023-10-09T08:14:33.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.753+0000 7f3ead79b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ea8159890 0x7f3ea80b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:33.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.753+0000 7f3ead79b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ea8159890 0x7f3ea80b3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50564/0 (socket says 172.21.15.71:50564) 2023-10-09T08:14:33.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.753+0000 7f3ead79b700 1 -- 172.21.15.71:0/2533673474 learned_addr learned my addr 172.21.15.71:0/2533673474 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:33.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.753+0000 7f3eacf9a700 1 --2- 172.21.15.71:0/2533673474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ea8159c60 0x7f3ea80cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:33.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.753+0000 7f3eadf9c700 1 --2- 172.21.15.71:0/2533673474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ea815db10 0x7f3ea80ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:33.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.754+0000 7f3ead79b700 1 -- 172.21.15.71:0/2533673474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ea815db10 msgr2=0x7f3ea80ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:33.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.754+0000 7f3ead79b700 1 --2- 172.21.15.71:0/2533673474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ea815db10 0x7f3ea80ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:33.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.754+0000 7f3ead79b700 1 -- 172.21.15.71:0/2533673474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ea8159c60 msgr2=0x7f3ea80cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:33.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.754+0000 7f3ead79b700 1 --2- 172.21.15.71:0/2533673474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ea8159c60 0x7f3ea80cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:33.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.754+0000 7f3ead79b700 1 -- 172.21.15.71:0/2533673474 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e98009420 con 0x7f3ea8159890 2023-10-09T08:14:33.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.754+0000 7f3ead79b700 1 --2- 172.21.15.71:0/2533673474 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ea8159890 0x7f3ea80b3f60 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400c5b0 tx=0x7f3ea4007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:33.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.754+0000 7f3e9d7fa700 1 -- 172.21.15.71:0/2533673474 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4011590 con 0x7f3ea8159890 2023-10-09T08:14:33.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.754+0000 7f3e9d7fa700 1 -- 172.21.15.71:0/2533673474 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea4011710 con 0x7f3ea8159890 2023-10-09T08:14:33.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.754+0000 7f3e9d7fa700 1 -- 172.21.15.71:0/2533673474 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4011ad0 con 0x7f3ea8159890 2023-10-09T08:14:33.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.754+0000 7f3eaf9ff700 1 -- 172.21.15.71:0/2533673474 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea80cd350 con 0x7f3ea8159890 2023-10-09T08:14:33.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.754+0000 7f3eaf9ff700 1 -- 172.21.15.71:0/2533673474 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea80b44a0 con 0x7f3ea8159890 2023-10-09T08:14:33.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.755+0000 7f3eaf9ff700 1 -- 172.21.15.71:0/2533673474 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea80cd870 con 0x7f3ea8159890 2023-10-09T08:14:33.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.756+0000 7f3e9d7fa700 1 -- 172.21.15.71:0/2533673474 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ea401b3b0 con 0x7f3ea8159890 2023-10-09T08:14:33.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.757+0000 7f3e9d7fa700 1 --2- 172.21.15.71:0/2533673474 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3e8c066f30 0x7f3e8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:33.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.757+0000 7f3e9d7fa700 1 -- 172.21.15.71:0/2533673474 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6291+0+0 (secure 0 0 0) 0x7f3ea4083bc0 con 0x7f3ea8159890 2023-10-09T08:14:33.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.757+0000 7f3eacf9a700 1 --2- 172.21.15.71:0/2533673474 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3e8c066f30 0x7f3e8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:33.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.758+0000 7f3eacf9a700 1 --2- 172.21.15.71:0/2533673474 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3e8c066f30 0x7f3e8c0693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3e980030c0 tx=0x7f3e98016000 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:33.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.761+0000 7f3e9d7fa700 1 -- 172.21.15.71:0/2533673474 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ea80cd870 con 0x7f3ea8159890 2023-10-09T08:14:33.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:33.969+0000 7f3eaf9ff700 1 -- 172.21.15.71:0/2533673474 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3ea804c3c0 con 0x7f3ea8159890 2023-10-09T08:14:34.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:34.865+0000 7f3e9d7fa700 1 -- 172.21.15.71:0/2533673474 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v190) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3ea4017070 con 0x7f3ea8159890 2023-10-09T08:14:34.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:34.868+0000 7f3eaf9ff700 1 -- 172.21.15.71:0/2533673474 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3e8c066f30 msgr2=0x7f3e8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:34.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:34.868+0000 7f3eaf9ff700 1 --2- 172.21.15.71:0/2533673474 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3e8c066f30 0x7f3e8c0693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3e980030c0 tx=0x7f3e98016000 comp rx=0 tx=0).stop 2023-10-09T08:14:34.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:34.868+0000 7f3eaf9ff700 1 -- 172.21.15.71:0/2533673474 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ea8159890 msgr2=0x7f3ea80b3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:34.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:34.868+0000 7f3eaf9ff700 1 --2- 172.21.15.71:0/2533673474 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ea8159890 0x7f3ea80b3f60 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400c5b0 tx=0x7f3ea4007f60 comp rx=0 tx=0).stop 2023-10-09T08:14:34.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:34.868+0000 7f3eaf9ff700 1 -- 172.21.15.71:0/2533673474 shutdown_connections 2023-10-09T08:14:34.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:34.868+0000 7f3eaf9ff700 1 --2- 172.21.15.71:0/2533673474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ea815db10 0x7f3ea80ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:34.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:34.868+0000 7f3eaf9ff700 1 --2- 172.21.15.71:0/2533673474 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3e8c066f30 0x7f3e8c0693e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:34.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:34.868+0000 7f3eaf9ff700 1 --2- 172.21.15.71:0/2533673474 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ea8159890 0x7f3ea80b3f60 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:34.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:34.868+0000 7f3eaf9ff700 1 --2- 172.21.15.71:0/2533673474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ea8159c60 0x7f3ea80cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:34.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:34.868+0000 7f3eaf9ff700 1 -- 172.21.15.71:0/2533673474 >> 172.21.15.71:0/2533673474 conn(0x7f3ea8068e20 msgr2=0x7f3ea81570a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:34.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:34.868+0000 7f3eaf9ff700 1 -- 172.21.15.71:0/2533673474 shutdown_connections 2023-10-09T08:14:34.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:34.868+0000 7f3eaf9ff700 1 -- 172.21.15.71:0/2533673474 wait complete. 2023-10-09T08:14:34.871 INFO:teuthology.orchestra.run.smithi071.stderr: removed all blocklist entries 2023-10-09T08:14:34.889 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T08:14:35.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.072+0000 7f79f05ff700 1 Processor -- start 2023-10-09T08:14:35.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.072+0000 7f79f05ff700 1 -- start start 2023-10-09T08:14:35.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.074+0000 7f79f05ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f79e80b0010 0x7f79e815d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:35.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.074+0000 7f79f05ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f79e815dd90 0x7f79e80adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:35.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.074+0000 7f79f05ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e80b0750 con 0x7f79e80afc40 2023-10-09T08:14:35.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.074+0000 7f79f05ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e80aca70 con 0x7f79e80b0010 2023-10-09T08:14:35.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.074+0000 7f79f05ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e80acd50 con 0x7f79e815dd90 2023-10-09T08:14:35.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.074+0000 7f79edb9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f79e80b0010 0x7f79e815d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:35.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.074+0000 7f79edb9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f79e80b0010 0x7f79e815d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51140/0 (socket says 172.21.15.71:51140) 2023-10-09T08:14:35.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.074+0000 7f79ee39b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f79e80afc40 0x7f79e80b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56240/0 (socket says 172.21.15.71:56240) 2023-10-09T08:14:35.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.074+0000 7f79edb9a700 1 -- 172.21.15.71:0/1748987043 learned_addr learned my addr 172.21.15.71:0/1748987043 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:35.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.074+0000 7f79eeb9c700 1 --2- 172.21.15.71:0/1748987043 >> v2:172.21.15.179:3300/0 conn(0x7f79e815dd90 0x7f79e80adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:35.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.074+0000 7f79edb9a700 1 -- 172.21.15.71:0/1748987043 >> v2:172.21.15.179:3300/0 conn(0x7f79e815dd90 msgr2=0x7f79e80adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:35.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.074+0000 7f79edb9a700 1 --2- 172.21.15.71:0/1748987043 >> v2:172.21.15.179:3300/0 conn(0x7f79e815dd90 0x7f79e80adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:35.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.074+0000 7f79edb9a700 1 -- 172.21.15.71:0/1748987043 >> v1:172.21.15.71:6789/0 conn(0x7f79e80afc40 legacy=0x7f79e80b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:35.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.074+0000 7f79edb9a700 1 -- 172.21.15.71:0/1748987043 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e80ad030 con 0x7f79e80b0010 2023-10-09T08:14:35.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.074+0000 7f79eeb9c700 1 --2- 172.21.15.71:0/1748987043 >> v2:172.21.15.179:3300/0 conn(0x7f79e815dd90 0x7f79e80adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:14:35.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.075+0000 7f79edb9a700 1 --2- 172.21.15.71:0/1748987043 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79e80b0010 0x7f79e815d850 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f79e80b04b0 tx=0x7f79d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeda7640d5ad38ee server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:35.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.075+0000 7f79ed399700 1 -- 172.21.15.71:0/1748987043 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d800b860 con 0x7f79e80b0010 2023-10-09T08:14:35.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.075+0000 7f79ed399700 1 -- 172.21.15.71:0/1748987043 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d800b9c0 con 0x7f79e80b0010 2023-10-09T08:14:35.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.075+0000 7f79ed399700 1 -- 172.21.15.71:0/1748987043 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d800bd60 con 0x7f79e80b0010 2023-10-09T08:14:35.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.075+0000 7f79f05ff700 1 -- 172.21.15.71:0/1748987043 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79e80b0010 msgr2=0x7f79e815d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:35.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.075+0000 7f79f05ff700 1 --2- 172.21.15.71:0/1748987043 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79e80b0010 0x7f79e815d850 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f79e80b04b0 tx=0x7f79d8009250 comp rx=0 tx=0).stop 2023-10-09T08:14:35.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.076+0000 7f79f05ff700 1 -- 172.21.15.71:0/1748987043 shutdown_connections 2023-10-09T08:14:35.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.076+0000 7f79f05ff700 1 --2- 172.21.15.71:0/1748987043 >> v2:172.21.15.179:3300/0 conn(0x7f79e815dd90 0x7f79e80adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:35.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.076+0000 7f79f05ff700 1 --2- 172.21.15.71:0/1748987043 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79e80b0010 0x7f79e815d850 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:35.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.076+0000 7f79f05ff700 1 -- 172.21.15.71:0/1748987043 >> 172.21.15.71:0/1748987043 conn(0x7f79e806a320 msgr2=0x7f79e80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:35.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.076+0000 7f79f05ff700 1 -- 172.21.15.71:0/1748987043 shutdown_connections 2023-10-09T08:14:35.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.076+0000 7f79f05ff700 1 -- 172.21.15.71:0/1748987043 wait complete. 2023-10-09T08:14:35.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.077+0000 7f79f05ff700 1 Processor -- start 2023-10-09T08:14:35.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.077+0000 7f79f05ff700 1 -- start start 2023-10-09T08:14:35.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.078+0000 7f79f05ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79e80afc40 0x7f79e8156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:35.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.078+0000 7f79f05ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79e80b0010 0x7f79e806eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:35.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.078+0000 7f79f05ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e815dd90 0x7f79e8154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:35.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.078+0000 7f79f05ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e81568d0 con 0x7f79e80b0010 2023-10-09T08:14:35.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.078+0000 7f79f05ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e8155cc0 con 0x7f79e80afc40 2023-10-09T08:14:35.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.078+0000 7f79f05ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e8155fa0 con 0x7f79e815dd90 2023-10-09T08:14:35.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.078+0000 7f79edb9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79e80b0010 0x7f79e806eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:35.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.078+0000 7f79edb9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79e80b0010 0x7f79e806eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51148/0 (socket says 172.21.15.71:51148) 2023-10-09T08:14:35.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.078+0000 7f79edb9a700 1 -- 172.21.15.71:0/1877195916 learned_addr learned my addr 172.21.15.71:0/1877195916 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:35.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.079+0000 7f79edb9a700 1 -- 172.21.15.71:0/1877195916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e815dd90 msgr2=0x7f79e8154f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:35.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.079+0000 7f79eeb9c700 1 --2- 172.21.15.71:0/1877195916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e815dd90 0x7f79e8154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:35.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.079+0000 7f79ee39b700 1 --2- 172.21.15.71:0/1877195916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79e80afc40 0x7f79e8156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:35.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.079+0000 7f79edb9a700 1 --2- 172.21.15.71:0/1877195916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e815dd90 0x7f79e8154f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:35.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.079+0000 7f79edb9a700 1 -- 172.21.15.71:0/1877195916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79e80afc40 msgr2=0x7f79e8156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:35.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.079+0000 7f79edb9a700 1 --2- 172.21.15.71:0/1877195916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79e80afc40 0x7f79e8156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:35.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.079+0000 7f79edb9a700 1 -- 172.21.15.71:0/1877195916 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d80094f0 con 0x7f79e80b0010 2023-10-09T08:14:35.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.079+0000 7f79eeb9c700 1 --2- 172.21.15.71:0/1877195916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e815dd90 0x7f79e8154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:14:35.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.079+0000 7f79ee39b700 1 --2- 172.21.15.71:0/1877195916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79e80afc40 0x7f79e8156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:14:35.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.079+0000 7f79edb9a700 1 --2- 172.21.15.71:0/1877195916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79e80b0010 0x7f79e806eab0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009290 tx=0x7f79d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:35.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.079+0000 7f79de7fc700 1 -- 172.21.15.71:0/1877195916 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d8011e60 con 0x7f79e80b0010 2023-10-09T08:14:35.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.079+0000 7f79de7fc700 1 -- 172.21.15.71:0/1877195916 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d801a630 con 0x7f79e80b0010 2023-10-09T08:14:35.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.079+0000 7f79f05ff700 1 -- 172.21.15.71:0/1877195916 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e8156280 con 0x7f79e80b0010 2023-10-09T08:14:35.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.079+0000 7f79de7fc700 1 -- 172.21.15.71:0/1877195916 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d801a9f0 con 0x7f79e80b0010 2023-10-09T08:14:35.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.080+0000 7f79f05ff700 1 -- 172.21.15.71:0/1877195916 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e81572a0 con 0x7f79e80b0010 2023-10-09T08:14:35.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.080+0000 7f79f05ff700 1 -- 172.21.15.71:0/1877195916 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e8156a40 con 0x7f79e80b0010 2023-10-09T08:14:35.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.081+0000 7f79de7fc700 1 -- 172.21.15.71:0/1877195916 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f79d802d440 con 0x7f79e80b0010 2023-10-09T08:14:35.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.082+0000 7f79de7fc700 1 --2- 172.21.15.71:0/1877195916 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f79cc066f30 0x7f79cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:35.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.082+0000 7f79de7fc700 1 -- 172.21.15.71:0/1877195916 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5345+0+0 (secure 0 0 0) 0x7f79d8086000 con 0x7f79e80b0010 2023-10-09T08:14:35.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.082+0000 7f79ee39b700 1 --2- 172.21.15.71:0/1877195916 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f79cc066f30 0x7f79cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:35.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.083+0000 7f79ee39b700 1 --2- 172.21.15.71:0/1877195916 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f79cc066f30 0x7f79cc0693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f79e4001780 tx=0x7f79e4009040 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:35.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.086+0000 7f79de7fc700 1 -- 172.21.15.71:0/1877195916 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79d8053450 con 0x7f79e80b0010 2023-10-09T08:14:35.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.350+0000 7f79f05ff700 1 -- 172.21.15.71:0/1877195916 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f79e804c3c0 con 0x7f79e80b0010 2023-10-09T08:14:35.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.350+0000 7f79de7fc700 1 -- 172.21.15.71:0/1877195916 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v48) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f79d8056a70 con 0x7f79e80b0010 2023-10-09T08:14:35.351 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:14:35.351 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T08:14:35.351 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_dump": [ 2023-10-09T08:14:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:14:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.a", 2023-10-09T08:14:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlpI5JCRAAGBgrs6g+6KZFXv1eq0fkwQ==", 2023-10-09T08:14:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:14:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T08:14:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T08:14:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T08:14:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:14:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:14:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:14:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:14:35.353 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.b", 2023-10-09T08:14:35.353 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlDZQYHhAA2LGKHPLrBVKlGMK0TKup7A==", 2023-10-09T08:14:35.353 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:14:35.353 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T08:14:35.353 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T08:14:35.353 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T08:14:35.353 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:14:35.353 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:14:35.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:14:35.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:14:35.353 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.c", 2023-10-09T08:14:35.353 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlLKKfExAA65+KIyYd16iQ2L5topDPkg==", 2023-10-09T08:14:35.354 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:14:35.354 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T08:14:35.354 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T08:14:35.354 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T08:14:35.354 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:14:35.354 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:14:35.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:14:35.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:14:35.354 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.d", 2023-10-09T08:14:35.354 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlpQKTKBAAP59h/znElthIdqbK9tKJww==", 2023-10-09T08:14:35.354 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:14:35.355 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T08:14:35.355 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T08:14:35.355 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T08:14:35.355 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:14:35.355 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:14:35.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:14:35.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:14:35.355 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.0", 2023-10-09T08:14:35.355 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCgoCNll7hBIBAAtZ8mBx+MPAwEou48boP4Hw==", 2023-10-09T08:14:35.355 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:14:35.355 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T08:14:35.355 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T08:14:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:14:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:14:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:14:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:14:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.1", 2023-10-09T08:14:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCjoCNl7uRMIxAAztQi4ZsulyN2FHcMRzZ82Q==", 2023-10-09T08:14:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:14:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T08:14:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T08:14:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:14:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:14:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:14:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:14:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.2", 2023-10-09T08:14:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCmoCNlW/cNJhAAfFdnRC95YJwpCngJS956cA==", 2023-10-09T08:14:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:14:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T08:14:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T08:14:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:14:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:14:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:14:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:14:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.3", 2023-10-09T08:14:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCpoCNlAIlYKRAAD5IGHWZ14ckpQAU4wBifbg==", 2023-10-09T08:14:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:14:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T08:14:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T08:14:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:14:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:14:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:14:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:14:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.4", 2023-10-09T08:14:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCvoCNltrA4ORAAtifmL9hr1xKd+jsMf5Nf+Q==", 2023-10-09T08:14:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:14:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T08:14:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T08:14:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:14:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:14:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:14:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:14:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.5", 2023-10-09T08:14:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCyoCNlA/IOOxAAQWRPQ+00o9xrpScAvY/87w==", 2023-10-09T08:14:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:14:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T08:14:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T08:14:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:14:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:14:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:14:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:14:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.6", 2023-10-09T08:14:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQC2oCNlvRusARAAcRaGyCROIRVTHeKhrncN8g==", 2023-10-09T08:14:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:14:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T08:14:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T08:14:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:14:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:14:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:14:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:14:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.7", 2023-10-09T08:14:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQC5oCNli/3NAxAAIMYuED41ZSx1xF384N6y1A==", 2023-10-09T08:14:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:14:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T08:14:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T08:14:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:14:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:14:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:14:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:14:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.0", 2023-10-09T08:14:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlHrKWMRAAyIfmryGSgqIFwWEJyixprw==", 2023-10-09T08:14:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:14:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T08:14:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow r", 2023-10-09T08:14:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T08:14:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:14:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:14:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:14:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.1", 2023-10-09T08:14:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCdoCNldq1xAxAAxCpmelS0qDEY187u19JkcQ==", 2023-10-09T08:14:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:14:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T08:14:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T08:14:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T08:14:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T08:14:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:14:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:14:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:14:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.2", 2023-10-09T08:14:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlM3JHOBAA8fszREXH+WnYb+3vIaakcA==", 2023-10-09T08:14:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:14:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T08:14:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T08:14:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T08:14:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T08:14:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:14:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:14:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:14:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.3", 2023-10-09T08:14:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCdoCNlgkEqChAAwntdv9UOo30x40pVa70yag==", 2023-10-09T08:14:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:14:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T08:14:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T08:14:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T08:14:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T08:14:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:14:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:14:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:14:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.admin", 2023-10-09T08:14:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCboCNlj2W4EhAAUnfX6NBeDyMj2nY/G2ciEg==", 2023-10-09T08:14:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:14:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T08:14:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T08:14:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T08:14:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:14:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:14:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:14:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:14:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.x", 2023-10-09T08:14:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlwwJ/AhAAjHMhAX1/yWgh9no7yQqP6Q==", 2023-10-09T08:14:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:14:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T08:14:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-09T08:14:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:14:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:14:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:14:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:14:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.y", 2023-10-09T08:14:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCboCNly/XVNRAAlKr9arCbsDbzZ9bpIU5dng==", 2023-10-09T08:14:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:14:35.367 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T08:14:35.367 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-09T08:14:35.367 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:14:35.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:14:35.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:14:35.367 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2023-10-09T08:14:35.367 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T08:14:35.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.353+0000 7f79f05ff700 1 -- 172.21.15.71:0/1877195916 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f79cc066f30 msgr2=0x7f79cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:35.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.353+0000 7f79f05ff700 1 --2- 172.21.15.71:0/1877195916 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f79cc066f30 0x7f79cc0693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f79e4001780 tx=0x7f79e4009040 comp rx=0 tx=0).stop 2023-10-09T08:14:35.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.353+0000 7f79f05ff700 1 -- 172.21.15.71:0/1877195916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79e80b0010 msgr2=0x7f79e806eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:35.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.353+0000 7f79f05ff700 1 --2- 172.21.15.71:0/1877195916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79e80b0010 0x7f79e806eab0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009290 tx=0x7f79d8017000 comp rx=0 tx=0).stop 2023-10-09T08:14:35.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.353+0000 7f79f05ff700 1 -- 172.21.15.71:0/1877195916 shutdown_connections 2023-10-09T08:14:35.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.353+0000 7f79f05ff700 1 --2- 172.21.15.71:0/1877195916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79e815dd90 0x7f79e8154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:35.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.353+0000 7f79f05ff700 1 --2- 172.21.15.71:0/1877195916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79e80afc40 0x7f79e8156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:35.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.353+0000 7f79f05ff700 1 --2- 172.21.15.71:0/1877195916 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f79cc066f30 0x7f79cc0693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:35.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.353+0000 7f79f05ff700 1 --2- 172.21.15.71:0/1877195916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79e80b0010 0x7f79e806eab0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:35.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.353+0000 7f79f05ff700 1 -- 172.21.15.71:0/1877195916 >> 172.21.15.71:0/1877195916 conn(0x7f79e806a320 msgr2=0x7f79e815ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:35.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.353+0000 7f79f05ff700 1 -- 172.21.15.71:0/1877195916 shutdown_connections 2023-10-09T08:14:35.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.353+0000 7f79f05ff700 1 -- 172.21.15.71:0/1877195916 wait complete. 2023-10-09T08:14:35.371 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T08:14:35.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.552+0000 7fc20179d700 1 Processor -- start 2023-10-09T08:14:35.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.552+0000 7fc20179d700 1 -- start start 2023-10-09T08:14:35.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.553+0000 7fc20179d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc1fc150180 0x7fc1fc157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:35.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.553+0000 7fc20179d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1fc06e2a0 con 0x7fc1fc0c7410 2023-10-09T08:14:35.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.553+0000 7fc20179d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1fc06b2e0 con 0x7fc1fc150550 2023-10-09T08:14:35.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.553+0000 7fc20179d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1fc0c78e0 con 0x7fc1fc150180 2023-10-09T08:14:35.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.553+0000 7fc200f9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc1fc0c7410 0x7fc1fc069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56250/0 (socket says 172.21.15.71:56250) 2023-10-09T08:14:35.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.553+0000 7fc200f9c700 1 -- 172.21.15.71:0/439896786 learned_addr learned my addr 172.21.15.71:0/439896786 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:35.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.554+0000 7fc1fbfff700 1 --2- 172.21.15.71:0/439896786 >> v2:172.21.15.179:3300/0 conn(0x7fc1fc150180 0x7fc1fc157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:35.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.554+0000 7fc1faffd700 1 -- 172.21.15.71:0/439896786 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1677309750 0 0) 0x7fc1fc06e2a0 con 0x7fc1fc0c7410 2023-10-09T08:14:35.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.554+0000 7fc1faffd700 1 -- 172.21.15.71:0/439896786 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1e4003570 con 0x7fc1fc0c7410 2023-10-09T08:14:35.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.554+0000 7fc1fbfff700 1 -- 172.21.15.71:0/439896786 >> v1:172.21.15.179:6789/0 conn(0x7fc1fc150550 legacy=0x7fc1fc0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:35.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.554+0000 7fc1fbfff700 1 -- 172.21.15.71:0/439896786 >> v1:172.21.15.71:6789/0 conn(0x7fc1fc0c7410 legacy=0x7fc1fc069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:35.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.554+0000 7fc1faffd700 1 -- 172.21.15.71:0/439896786 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3746174307 0 0) 0x7fc1e4003570 con 0x7fc1fc0c7410 2023-10-09T08:14:35.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.554+0000 7fc1fbfff700 1 -- 172.21.15.71:0/439896786 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1fc0c7bc0 con 0x7fc1fc150180 2023-10-09T08:14:35.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.554+0000 7fc1fbfff700 1 --2- 172.21.15.71:0/439896786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1fc150180 0x7fc1fc157770 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0098e0 tx=0x7fc1ec0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87156c1d8286af22 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:35.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.555+0000 7fc1faffd700 1 -- 172.21.15.71:0/439896786 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f40017f0 con 0x7fc1fc150180 2023-10-09T08:14:35.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.555+0000 7fc1faffd700 1 -- 172.21.15.71:0/439896786 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec011420 con 0x7fc1fc150180 2023-10-09T08:14:35.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.555+0000 7fc1faffd700 1 -- 172.21.15.71:0/439896786 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec0117c0 con 0x7fc1fc150180 2023-10-09T08:14:35.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.555+0000 7fc20179d700 1 -- 172.21.15.71:0/439896786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1fc150180 msgr2=0x7fc1fc157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:35.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.555+0000 7fc20179d700 1 --2- 172.21.15.71:0/439896786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1fc150180 0x7fc1fc157770 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0098e0 tx=0x7fc1ec0091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:35.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.555+0000 7fc20179d700 1 -- 172.21.15.71:0/439896786 shutdown_connections 2023-10-09T08:14:35.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.555+0000 7fc20179d700 1 --2- 172.21.15.71:0/439896786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1fc150180 0x7fc1fc157770 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:35.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.555+0000 7fc20179d700 1 -- 172.21.15.71:0/439896786 >> 172.21.15.71:0/439896786 conn(0x7fc1fc0cc1f0 msgr2=0x7fc1fc0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:35.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.555+0000 7fc20179d700 1 -- 172.21.15.71:0/439896786 shutdown_connections 2023-10-09T08:14:35.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.555+0000 7fc20179d700 1 -- 172.21.15.71:0/439896786 wait complete. 2023-10-09T08:14:35.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.557+0000 7fc20179d700 1 Processor -- start 2023-10-09T08:14:35.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.557+0000 7fc20179d700 1 -- start start 2023-10-09T08:14:35.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.558+0000 7fc20179d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1fc0c7410 0x7fc1fc0aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:35.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.558+0000 7fc20179d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1fc150180 0x7fc1fc0c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:35.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.558+0000 7fc20179d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1fc150550 0x7fc1fc0b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:35.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.558+0000 7fc20179d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc16b0e0 con 0x7fc1fc150550 2023-10-09T08:14:35.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.558+0000 7fc20179d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc0afe10 con 0x7fc1fc0c7410 2023-10-09T08:14:35.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.558+0000 7fc20179d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc0af570 con 0x7fc1fc150180 2023-10-09T08:14:35.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.558+0000 7fc200f9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1fc150550 0x7fc1fc0b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:35.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.558+0000 7fc200f9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1fc150550 0x7fc1fc0b0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51154/0 (socket says 172.21.15.71:51154) 2023-10-09T08:14:35.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.558+0000 7fc200f9c700 1 -- 172.21.15.71:0/2543603437 learned_addr learned my addr 172.21.15.71:0/2543603437 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:35.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.558+0000 7fc200f9c700 1 -- 172.21.15.71:0/2543603437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1fc150180 msgr2=0x7fc1fc0c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:35.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.558+0000 7fc200f9c700 1 --2- 172.21.15.71:0/2543603437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1fc150180 0x7fc1fc0c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:35.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.558+0000 7fc200f9c700 1 -- 172.21.15.71:0/2543603437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1fc0c7410 msgr2=0x7fc1fc0aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:35.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.558+0000 7fc200f9c700 1 --2- 172.21.15.71:0/2543603437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1fc0c7410 0x7fc1fc0aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:35.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.558+0000 7fc200f9c700 1 -- 172.21.15.71:0/2543603437 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec009420 con 0x7fc1fc150550 2023-10-09T08:14:35.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.559+0000 7fc200f9c700 1 --2- 172.21.15.71:0/2543603437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1fc150550 0x7fc1fc0b0d20 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fc1f400cb40 tx=0x7fc1f4007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:35.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.559+0000 7fc1e3fff700 1 -- 172.21.15.71:0/2543603437 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4004dc0 con 0x7fc1fc150550 2023-10-09T08:14:35.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.559+0000 7fc1e3fff700 1 -- 172.21.15.71:0/2543603437 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f400a700 con 0x7fc1fc150550 2023-10-09T08:14:35.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.559+0000 7fc20179d700 1 -- 172.21.15.71:0/2543603437 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1fc0af850 con 0x7fc1fc150550 2023-10-09T08:14:35.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.559+0000 7fc1e3fff700 1 -- 172.21.15.71:0/2543603437 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f400aac0 con 0x7fc1fc150550 2023-10-09T08:14:35.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.559+0000 7fc20179d700 1 -- 172.21.15.71:0/2543603437 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1fc0c61f0 con 0x7fc1fc150550 2023-10-09T08:14:35.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.560+0000 7fc20179d700 1 -- 172.21.15.71:0/2543603437 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1fc04c3c0 con 0x7fc1fc150550 2023-10-09T08:14:35.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.561+0000 7fc1e3fff700 1 -- 172.21.15.71:0/2543603437 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc1f4007150 con 0x7fc1fc150550 2023-10-09T08:14:35.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.562+0000 7fc1e3fff700 1 --2- 172.21.15.71:0/2543603437 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc1e8066f30 0x7fc1e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:35.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.562+0000 7fc1e3fff700 1 -- 172.21.15.71:0/2543603437 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5345+0+0 (secure 0 0 0) 0x7fc1f4083fe0 con 0x7fc1fc150550 2023-10-09T08:14:35.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.562+0000 7fc1fbfff700 1 --2- 172.21.15.71:0/2543603437 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc1e8066f30 0x7fc1e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:35.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.563+0000 7fc1fbfff700 1 --2- 172.21.15.71:0/2543603437 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc1e8066f30 0x7fc1e80693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc0b1f90 tx=0x7fc1ec016000 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:35.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.566+0000 7fc1e3fff700 1 -- 172.21.15.71:0/2543603437 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1f4051390 con 0x7fc1fc150550 2023-10-09T08:14:35.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.758+0000 7fc20179d700 1 -- 172.21.15.71:0/2543603437 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1fc0cbfa0 con 0x7fc1fc150550 2023-10-09T08:14:35.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.759+0000 7fc1e3fff700 1 -- 172.21.15.71:0/2543603437 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+12900 (secure 0 0 0) 0x7fc1f4018020 con 0x7fc1fc150550 2023-10-09T08:14:35.760 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:14:35.760 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":190,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T08:14:34.862592+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T08:14:35.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.761+0000 7fc20179d700 1 -- 172.21.15.71:0/2543603437 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc1e8066f30 msgr2=0x7fc1e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:35.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.761+0000 7fc20179d700 1 --2- 172.21.15.71:0/2543603437 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc1e8066f30 0x7fc1e80693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc0b1f90 tx=0x7fc1ec016000 comp rx=0 tx=0).stop 2023-10-09T08:14:35.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.761+0000 7fc20179d700 1 -- 172.21.15.71:0/2543603437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1fc150550 msgr2=0x7fc1fc0b0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:35.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.761+0000 7fc20179d700 1 --2- 172.21.15.71:0/2543603437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1fc150550 0x7fc1fc0b0d20 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fc1f400cb40 tx=0x7fc1f4007c70 comp rx=0 tx=0).stop 2023-10-09T08:14:35.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.762+0000 7fc20179d700 1 -- 172.21.15.71:0/2543603437 shutdown_connections 2023-10-09T08:14:35.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.762+0000 7fc20179d700 1 --2- 172.21.15.71:0/2543603437 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc1e8066f30 0x7fc1e80693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:35.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.762+0000 7fc20179d700 1 --2- 172.21.15.71:0/2543603437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1fc150550 0x7fc1fc0b0d20 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:35.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.762+0000 7fc20179d700 1 --2- 172.21.15.71:0/2543603437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1fc0c7410 0x7fc1fc0aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:35.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.762+0000 7fc20179d700 1 --2- 172.21.15.71:0/2543603437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1fc150180 0x7fc1fc0c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:35.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.762+0000 7fc20179d700 1 -- 172.21.15.71:0/2543603437 >> 172.21.15.71:0/2543603437 conn(0x7fc1fc0cc1f0 msgr2=0x7fc1fc144080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:35.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.762+0000 7fc20179d700 1 -- 172.21.15.71:0/2543603437 shutdown_connections 2023-10-09T08:14:35.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.762+0000 7fc20179d700 1 -- 172.21.15.71:0/2543603437 wait complete. 2023-10-09T08:14:35.780 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T08:14:35.781 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T08:14:35.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.966+0000 7f8b333ff700 1 Processor -- start 2023-10-09T08:14:35.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.966+0000 7f8b333ff700 1 -- start start 2023-10-09T08:14:35.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.967+0000 7f8b333ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8b2c155eb0 0x7f8b2c06e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:35.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.967+0000 7f8b333ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b2c069e80 0x7f8b2c0ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:35.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.967+0000 7f8b333ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2c06eb90 con 0x7f8b2c0c70b0 2023-10-09T08:14:35.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.967+0000 7f8b333ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b2c06ee70 con 0x7f8b2c155eb0 2023-10-09T08:14:35.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.967+0000 7f8b333ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c06f150 con 0x7f8b2c069e80 2023-10-09T08:14:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.968+0000 7f8b3119b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8b2c155eb0 0x7f8b2c06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.968+0000 7f8b3199c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b2c069e80 0x7f8b2c0ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.968+0000 7f8b3099a700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f8b2c0c70b0 0x7f8b2c069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:49150/0 (socket says 172.21.15.71:49150) 2023-10-09T08:14:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.968+0000 7f8b3119b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8b2c155eb0 0x7f8b2c06e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:33744/0 (socket says 172.21.15.71:33744) 2023-10-09T08:14:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.968+0000 7f8b3099a700 1 -- 172.21.15.71:0/588087148 learned_addr learned my addr 172.21.15.71:0/588087148 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.968+0000 7f8b3199c700 1 --2- 172.21.15.71:0/588087148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b2c069e80 0x7f8b2c0ca4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:55136/0 (socket says 172.21.15.71:55136) 2023-10-09T08:14:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.968+0000 7f8b23fff700 1 -- 172.21.15.71:0/588087148 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1971339104 0 0) 0x7f8b2c06eb90 con 0x7f8b2c0c70b0 2023-10-09T08:14:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.968+0000 7f8b23fff700 1 -- 172.21.15.71:0/588087148 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b18003570 con 0x7f8b2c0c70b0 2023-10-09T08:14:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.968+0000 7f8b3199c700 1 -- 172.21.15.71:0/588087148 >> v2:172.21.15.179:3300/0 conn(0x7f8b2c155eb0 msgr2=0x7f8b2c06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.968+0000 7f8b3199c700 1 --2- 172.21.15.71:0/588087148 >> v2:172.21.15.179:3300/0 conn(0x7f8b2c155eb0 0x7f8b2c06e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.968+0000 7f8b3199c700 1 -- 172.21.15.71:0/588087148 >> v1:172.21.15.179:6789/0 conn(0x7f8b2c0c70b0 legacy=0x7f8b2c069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.968+0000 7f8b3199c700 1 -- 172.21.15.71:0/588087148 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2c06f430 con 0x7f8b2c069e80 2023-10-09T08:14:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.968+0000 7f8b3119b700 1 --2- 172.21.15.71:0/588087148 >> v2:172.21.15.179:3300/0 conn(0x7f8b2c155eb0 0x7f8b2c06e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:14:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.969+0000 7f8b3199c700 1 --2- 172.21.15.71:0/588087148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b2c069e80 0x7f8b2c0ca4c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400d0d0 tx=0x7f8b2400b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=934e999bcd559dbd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.969+0000 7f8b23fff700 1 -- 172.21.15.71:0/588087148 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24010070 con 0x7f8b2c069e80 2023-10-09T08:14:35.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.969+0000 7f8b23fff700 1 -- 172.21.15.71:0/588087148 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2400b2e0 con 0x7f8b2c069e80 2023-10-09T08:14:35.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.969+0000 7f8b23fff700 1 -- 172.21.15.71:0/588087148 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2400dcd0 con 0x7f8b2c069e80 2023-10-09T08:14:35.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.970+0000 7f8b333ff700 1 -- 172.21.15.71:0/588087148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b2c069e80 msgr2=0x7f8b2c0ca4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:35.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.970+0000 7f8b333ff700 1 --2- 172.21.15.71:0/588087148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b2c069e80 0x7f8b2c0ca4c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400d0d0 tx=0x7f8b2400b990 comp rx=0 tx=0).stop 2023-10-09T08:14:35.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.970+0000 7f8b333ff700 1 -- 172.21.15.71:0/588087148 shutdown_connections 2023-10-09T08:14:35.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.970+0000 7f8b333ff700 1 --2- 172.21.15.71:0/588087148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b2c069e80 0x7f8b2c0ca4c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:35.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.970+0000 7f8b333ff700 1 --2- 172.21.15.71:0/588087148 >> v2:172.21.15.179:3300/0 conn(0x7f8b2c155eb0 0x7f8b2c06e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:35.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.970+0000 7f8b333ff700 1 -- 172.21.15.71:0/588087148 >> 172.21.15.71:0/588087148 conn(0x7f8b2c068e10 msgr2=0x7f8b2c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:35.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.970+0000 7f8b333ff700 1 -- 172.21.15.71:0/588087148 shutdown_connections 2023-10-09T08:14:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.970+0000 7f8b333ff700 1 -- 172.21.15.71:0/588087148 wait complete. 2023-10-09T08:14:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.971+0000 7f8b333ff700 1 Processor -- start 2023-10-09T08:14:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.971+0000 7f8b333ff700 1 -- start start 2023-10-09T08:14:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.972+0000 7f8b333ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b2c069e80 0x7f8b2c0b1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.972+0000 7f8b333ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b2c0c70b0 0x7f8b2c0b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.972+0000 7f8b333ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b2c155eb0 0x7f8b2c0ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.972+0000 7f8b333ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c0aa9d0 con 0x7f8b2c069e80 2023-10-09T08:14:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.972+0000 7f8b333ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c0b08d0 con 0x7f8b2c0c70b0 2023-10-09T08:14:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.972+0000 7f8b333ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c0b0bb0 con 0x7f8b2c155eb0 2023-10-09T08:14:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.972+0000 7f8b3119b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b2c069e80 0x7f8b2c0b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.972+0000 7f8b3119b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b2c069e80 0x7f8b2c0b1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51162/0 (socket says 172.21.15.71:51162) 2023-10-09T08:14:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.972+0000 7f8b3119b700 1 -- 172.21.15.71:0/2454252325 learned_addr learned my addr 172.21.15.71:0/2454252325 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.973+0000 7f8b3099a700 1 --2- 172.21.15.71:0/2454252325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b2c0c70b0 0x7f8b2c0b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.973+0000 7f8b3199c700 1 --2- 172.21.15.71:0/2454252325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b2c155eb0 0x7f8b2c0ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.973+0000 7f8b3119b700 1 -- 172.21.15.71:0/2454252325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b2c155eb0 msgr2=0x7f8b2c0ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.973+0000 7f8b3119b700 1 --2- 172.21.15.71:0/2454252325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b2c155eb0 0x7f8b2c0ae430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.973+0000 7f8b3119b700 1 -- 172.21.15.71:0/2454252325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b2c0c70b0 msgr2=0x7f8b2c0b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.973+0000 7f8b3119b700 1 --2- 172.21.15.71:0/2454252325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b2c0c70b0 0x7f8b2c0b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.973+0000 7f8b3119b700 1 -- 172.21.15.71:0/2454252325 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b28009420 con 0x7f8b2c069e80 2023-10-09T08:14:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.973+0000 7f8b3119b700 1 --2- 172.21.15.71:0/2454252325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b2c069e80 0x7f8b2c0b1970 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f8b2800ec80 tx=0x7f8b280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.973+0000 7f8b217fa700 1 -- 172.21.15.71:0/2454252325 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2800c9d0 con 0x7f8b2c069e80 2023-10-09T08:14:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.973+0000 7f8b217fa700 1 -- 172.21.15.71:0/2454252325 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2800cb30 con 0x7f8b2c069e80 2023-10-09T08:14:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.973+0000 7f8b217fa700 1 -- 172.21.15.71:0/2454252325 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2800ced0 con 0x7f8b2c069e80 2023-10-09T08:14:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.973+0000 7f8b333ff700 1 -- 172.21.15.71:0/2454252325 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b2400bc30 con 0x7f8b2c069e80 2023-10-09T08:14:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.974+0000 7f8b333ff700 1 -- 172.21.15.71:0/2454252325 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b2c0b1170 con 0x7f8b2c069e80 2023-10-09T08:14:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.974+0000 7f8b333ff700 1 -- 172.21.15.71:0/2454252325 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b2c04c3c0 con 0x7f8b2c069e80 2023-10-09T08:14:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.975+0000 7f8b217fa700 1 -- 172.21.15.71:0/2454252325 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b28013680 con 0x7f8b2c069e80 2023-10-09T08:14:35.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.977+0000 7f8b217fa700 1 --2- 172.21.15.71:0/2454252325 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8b10066f30 0x7f8b100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:35.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.977+0000 7f8b217fa700 1 -- 172.21.15.71:0/2454252325 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5345+0+0 (secure 0 0 0) 0x7f8b28084720 con 0x7f8b2c069e80 2023-10-09T08:14:35.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.977+0000 7f8b3099a700 1 --2- 172.21.15.71:0/2454252325 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8b10066f30 0x7f8b100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:35.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.978+0000 7f8b3099a700 1 --2- 172.21.15.71:0/2454252325 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8b10066f30 0x7f8b100693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c15ce40 tx=0x7f8b1c009040 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:35.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:35.981+0000 7f8b217fa700 1 -- 172.21.15.71:0/2454252325 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b28051af0 con 0x7f8b2c069e80 2023-10-09T08:14:36.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.170+0000 7f8b333ff700 1 -- 172.21.15.71:0/2454252325 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8b2c156280 con 0x7f8b2c069e80 2023-10-09T08:14:36.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.171+0000 7f8b217fa700 1 -- 172.21.15.71:0/2454252325 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v190) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8b28055110 con 0x7f8b2c069e80 2023-10-09T08:14:36.172 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T08:14:36.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.173+0000 7f8b333ff700 1 -- 172.21.15.71:0/2454252325 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8b10066f30 msgr2=0x7f8b100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:36.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.173+0000 7f8b333ff700 1 --2- 172.21.15.71:0/2454252325 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8b10066f30 0x7f8b100693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c15ce40 tx=0x7f8b1c009040 comp rx=0 tx=0).stop 2023-10-09T08:14:36.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.173+0000 7f8b333ff700 1 -- 172.21.15.71:0/2454252325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b2c069e80 msgr2=0x7f8b2c0b1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:36.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.173+0000 7f8b333ff700 1 --2- 172.21.15.71:0/2454252325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b2c069e80 0x7f8b2c0b1970 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f8b2800ec80 tx=0x7f8b280091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:36.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.173+0000 7f8b333ff700 1 -- 172.21.15.71:0/2454252325 shutdown_connections 2023-10-09T08:14:36.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.173+0000 7f8b333ff700 1 --2- 172.21.15.71:0/2454252325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b2c155eb0 0x7f8b2c0ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:36.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.173+0000 7f8b333ff700 1 --2- 172.21.15.71:0/2454252325 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8b10066f30 0x7f8b100693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:36.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.173+0000 7f8b333ff700 1 --2- 172.21.15.71:0/2454252325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b2c069e80 0x7f8b2c0b1970 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:36.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.173+0000 7f8b333ff700 1 --2- 172.21.15.71:0/2454252325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b2c0c70b0 0x7f8b2c0b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:36.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.173+0000 7f8b333ff700 1 -- 172.21.15.71:0/2454252325 >> 172.21.15.71:0/2454252325 conn(0x7f8b2c068e10 msgr2=0x7f8b2c0c2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:36.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.173+0000 7f8b333ff700 1 -- 172.21.15.71:0/2454252325 shutdown_connections 2023-10-09T08:14:36.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.173+0000 7f8b333ff700 1 -- 172.21.15.71:0/2454252325 wait complete. 2023-10-09T08:14:36.192 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T08:14:36.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.371+0000 7f93f8bff700 1 Processor -- start 2023-10-09T08:14:36.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.371+0000 7f93f8bff700 1 -- start start 2023-10-09T08:14:36.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.372+0000 7f93f8bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93f40b1420 0x7f93f40ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:36.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.372+0000 7f93f8bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f93f40ccf90 0x7f93f40c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:36.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.373+0000 7f93f8bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f40cc300 con 0x7f93f40cbf30 2023-10-09T08:14:36.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.373+0000 7f93f8bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f4156bf0 con 0x7f93f40ccf90 2023-10-09T08:14:36.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.373+0000 7f93f8bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f40ae950 con 0x7f93f40b1420 2023-10-09T08:14:36.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.373+0000 7f93f2d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f93f40ccf90 0x7f93f40c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:36.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.373+0000 7f93f2d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f93f40ccf90 0x7f93f40c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51174/0 (socket says 172.21.15.71:51174) 2023-10-09T08:14:36.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.373+0000 7f93f2d9d700 1 -- 172.21.15.71:0/216939843 learned_addr learned my addr 172.21.15.71:0/216939843 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:36.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.373+0000 7f93ebfff700 1 --2- 172.21.15.71:0/216939843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93f40b1420 0x7f93f40ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:36.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.373+0000 7f93f2d9d700 1 -- 172.21.15.71:0/216939843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93f40b1420 msgr2=0x7f93f40ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:36.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.373+0000 7f93f2d9d700 1 --2- 172.21.15.71:0/216939843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93f40b1420 0x7f93f40ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:36.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.373+0000 7f93f2d9d700 1 -- 172.21.15.71:0/216939843 >> v1:172.21.15.179:6789/0 conn(0x7f93f40cbf30 legacy=0x7f93f40b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:36.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.373+0000 7f93f2d9d700 1 -- 172.21.15.71:0/216939843 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f40ad370 con 0x7f93f40ccf90 2023-10-09T08:14:36.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.373+0000 7f93f2d9d700 1 --2- 172.21.15.71:0/216939843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93f40ccf90 0x7f93f40c9740 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f93ec009f50 tx=0x7f93ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e027d785318535 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:36.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.374+0000 7f93f1d9b700 1 -- 172.21.15.71:0/216939843 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ec00e070 con 0x7f93f40ccf90 2023-10-09T08:14:36.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.374+0000 7f93f1d9b700 1 -- 172.21.15.71:0/216939843 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ec00ba70 con 0x7f93f40ccf90 2023-10-09T08:14:36.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.374+0000 7f93f1d9b700 1 -- 172.21.15.71:0/216939843 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ec0092e0 con 0x7f93f40ccf90 2023-10-09T08:14:36.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.374+0000 7f93f8bff700 1 -- 172.21.15.71:0/216939843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93f40ccf90 msgr2=0x7f93f40c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:36.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.374+0000 7f93f8bff700 1 --2- 172.21.15.71:0/216939843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93f40ccf90 0x7f93f40c9740 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f93ec009f50 tx=0x7f93ec009840 comp rx=0 tx=0).stop 2023-10-09T08:14:36.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.374+0000 7f93f8bff700 1 -- 172.21.15.71:0/216939843 shutdown_connections 2023-10-09T08:14:36.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.374+0000 7f93f8bff700 1 --2- 172.21.15.71:0/216939843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93f40ccf90 0x7f93f40c9740 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:36.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.374+0000 7f93f8bff700 1 --2- 172.21.15.71:0/216939843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93f40b1420 0x7f93f40ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:36.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.374+0000 7f93f8bff700 1 -- 172.21.15.71:0/216939843 >> 172.21.15.71:0/216939843 conn(0x7f93f406a320 msgr2=0x7f93f40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:36.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.374+0000 7f93f8bff700 1 -- 172.21.15.71:0/216939843 shutdown_connections 2023-10-09T08:14:36.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.374+0000 7f93f8bff700 1 -- 172.21.15.71:0/216939843 wait complete. 2023-10-09T08:14:36.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.376+0000 7f93f8bff700 1 Processor -- start 2023-10-09T08:14:36.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.376+0000 7f93f8bff700 1 -- start start 2023-10-09T08:14:36.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.377+0000 7f93f8bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93f40b1420 0x7f93f415a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:36.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.377+0000 7f93f8bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93f40cbf30 0x7f93f416b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:36.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.377+0000 7f93f8bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93f40ccf90 0x7f93f416bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:36.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.377+0000 7f93f8bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f414af90 con 0x7f93f40b1420 2023-10-09T08:14:36.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.377+0000 7f93f8bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f414b270 con 0x7f93f40ccf90 2023-10-09T08:14:36.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.377+0000 7f93f8bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f414b550 con 0x7f93f40cbf30 2023-10-09T08:14:36.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.377+0000 7f93f259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93f40b1420 0x7f93f415a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:36.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.377+0000 7f93f259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93f40b1420 0x7f93f415a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51176/0 (socket says 172.21.15.71:51176) 2023-10-09T08:14:36.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.377+0000 7f93f259c700 1 -- 172.21.15.71:0/453869814 learned_addr learned my addr 172.21.15.71:0/453869814 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:36.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.377+0000 7f93f2d9d700 1 --2- 172.21.15.71:0/453869814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93f40ccf90 0x7f93f416bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:36.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.377+0000 7f93ebfff700 1 --2- 172.21.15.71:0/453869814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93f40cbf30 0x7f93f416b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:36.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.377+0000 7f93f259c700 1 -- 172.21.15.71:0/453869814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93f40cbf30 msgr2=0x7f93f416b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:36.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.378+0000 7f93f259c700 1 --2- 172.21.15.71:0/453869814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93f40cbf30 0x7f93f416b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:36.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.378+0000 7f93f259c700 1 -- 172.21.15.71:0/453869814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93f40ccf90 msgr2=0x7f93f416bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:36.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.378+0000 7f93f259c700 1 --2- 172.21.15.71:0/453869814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93f40ccf90 0x7f93f416bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:36.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.378+0000 7f93f259c700 1 -- 172.21.15.71:0/453869814 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ec009ae0 con 0x7f93f40b1420 2023-10-09T08:14:36.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.378+0000 7f93f259c700 1 --2- 172.21.15.71:0/453869814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93f40b1420 0x7f93f415a110 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f93e400c590 tx=0x7f93e400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:36.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.378+0000 7f93ea7fc700 1 -- 172.21.15.71:0/453869814 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e4011590 con 0x7f93f40b1420 2023-10-09T08:14:36.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.378+0000 7f93ea7fc700 1 -- 172.21.15.71:0/453869814 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e4011710 con 0x7f93f40b1420 2023-10-09T08:14:36.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.378+0000 7f93f8bff700 1 -- 172.21.15.71:0/453869814 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f414b830 con 0x7f93f40b1420 2023-10-09T08:14:36.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.378+0000 7f93ea7fc700 1 -- 172.21.15.71:0/453869814 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e4011ad0 con 0x7f93f40b1420 2023-10-09T08:14:36.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.378+0000 7f93f8bff700 1 -- 172.21.15.71:0/453869814 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f414abd0 con 0x7f93f40b1420 2023-10-09T08:14:36.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.379+0000 7f93f8bff700 1 -- 172.21.15.71:0/453869814 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f404c3c0 con 0x7f93f40b1420 2023-10-09T08:14:36.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.380+0000 7f93ea7fc700 1 -- 172.21.15.71:0/453869814 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f93e401b3b0 con 0x7f93f40b1420 2023-10-09T08:14:36.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.381+0000 7f93ea7fc700 1 --2- 172.21.15.71:0/453869814 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f93d4066f30 0x7f93d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:36.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.381+0000 7f93ea7fc700 1 -- 172.21.15.71:0/453869814 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5345+0+0 (secure 0 0 0) 0x7f93e4083860 con 0x7f93f40b1420 2023-10-09T08:14:36.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.381+0000 7f93ebfff700 1 --2- 172.21.15.71:0/453869814 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f93d4066f30 0x7f93d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:36.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.382+0000 7f93ebfff700 1 --2- 172.21.15.71:0/453869814 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f93d4066f30 0x7f93d40693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f93dc006fd0 tx=0x7f93dc008040 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:36.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.385+0000 7f93ea7fc700 1 -- 172.21.15.71:0/453869814 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93e4050c30 con 0x7f93f40b1420 2023-10-09T08:14:36.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.581+0000 7f93f8bff700 1 -- 172.21.15.71:0/453869814 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f93f40ad650 con 0x7f93f40b1420 2023-10-09T08:14:36.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.581+0000 7f93ea7fc700 1 -- 172.21.15.71:0/453869814 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v190) v1 ==== 84+0+65 (secure 0 0 0) 0x7f93e4017070 con 0x7f93f40b1420 2023-10-09T08:14:36.583 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:14:36.583 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-09T08:14:36.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:14:36.583 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 1, 2023-10-09T08:14:36.583 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": ".mgr" 2023-10-09T08:14:36.583 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:14:36.583 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-09T08:14:36.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.584+0000 7f93f8bff700 1 -- 172.21.15.71:0/453869814 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f93d4066f30 msgr2=0x7f93d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:36.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.584+0000 7f93f8bff700 1 --2- 172.21.15.71:0/453869814 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f93d4066f30 0x7f93d40693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f93dc006fd0 tx=0x7f93dc008040 comp rx=0 tx=0).stop 2023-10-09T08:14:36.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.584+0000 7f93f8bff700 1 -- 172.21.15.71:0/453869814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93f40b1420 msgr2=0x7f93f415a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:36.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.584+0000 7f93f8bff700 1 --2- 172.21.15.71:0/453869814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93f40b1420 0x7f93f415a110 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f93e400c590 tx=0x7f93e400c8a0 comp rx=0 tx=0).stop 2023-10-09T08:14:36.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.584+0000 7f93f8bff700 1 -- 172.21.15.71:0/453869814 shutdown_connections 2023-10-09T08:14:36.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.584+0000 7f93f8bff700 1 --2- 172.21.15.71:0/453869814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93f40ccf90 0x7f93f416bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:36.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.584+0000 7f93f8bff700 1 --2- 172.21.15.71:0/453869814 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f93d4066f30 0x7f93d40693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:36.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.584+0000 7f93f8bff700 1 --2- 172.21.15.71:0/453869814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93f40b1420 0x7f93f415a110 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:36.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.584+0000 7f93f8bff700 1 --2- 172.21.15.71:0/453869814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93f40cbf30 0x7f93f416b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:36.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.584+0000 7f93f8bff700 1 -- 172.21.15.71:0/453869814 >> 172.21.15.71:0/453869814 conn(0x7f93f406a320 msgr2=0x7f93f40cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:36.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.584+0000 7f93f8bff700 1 -- 172.21.15.71:0/453869814 shutdown_connections 2023-10-09T08:14:36.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.584+0000 7f93f8bff700 1 -- 172.21.15.71:0/453869814 wait complete. 2023-10-09T08:14:36.602 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T08:14:36.602 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T08:14:36.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.786+0000 7fb75bbff700 1 Processor -- start 2023-10-09T08:14:36.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.786+0000 7fb75bbff700 1 -- start start 2023-10-09T08:14:36.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.787+0000 7fb75bbff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb7541563b0 0x7fb754156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:36.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.787+0000 7fb75bbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb754068890 0x7fb7540c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:36.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.787+0000 7fb75bbff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75415a9b0 con 0x7fb75415a440 2023-10-09T08:14:36.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.787+0000 7fb75bbff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb75415ac90 con 0x7fb7541563b0 2023-10-09T08:14:36.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.787+0000 7fb75bbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75415af70 con 0x7fb754068890 2023-10-09T08:14:36.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.788+0000 7fb75a19c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb754068890 0x7fb7540c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:36.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.788+0000 7fb75999b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb7541563b0 0x7fb754156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:36.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.788+0000 7fb75999b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb7541563b0 0x7fb754156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:33766/0 (socket says 172.21.15.71:33766) 2023-10-09T08:14:36.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.788+0000 7fb75999b700 1 -- 172.21.15.71:0/2070433854 learned_addr learned my addr 172.21.15.71:0/2070433854 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:36.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.788+0000 7fb75999b700 1 -- 172.21.15.71:0/2070433854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb754068890 msgr2=0x7fb7540c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:36.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.788+0000 7fb75999b700 1 --2- 172.21.15.71:0/2070433854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb754068890 0x7fb7540c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:36.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.788+0000 7fb75999b700 1 -- 172.21.15.71:0/2070433854 >> v1:172.21.15.179:6789/0 conn(0x7fb75415a440 legacy=0x7fb7540acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:36.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.788+0000 7fb75999b700 1 -- 172.21.15.71:0/2070433854 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75415b250 con 0x7fb7541563b0 2023-10-09T08:14:36.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.788+0000 7fb75999b700 1 --2- 172.21.15.71:0/2070433854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7541563b0 0x7fb754156780 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb7500099b0 tx=0x7fb750009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b3fef0f77d2635c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:36.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.789+0000 7fb758999700 1 -- 172.21.15.71:0/2070433854 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb750009ea0 con 0x7fb7541563b0 2023-10-09T08:14:36.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.789+0000 7fb758999700 1 -- 172.21.15.71:0/2070433854 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75000b860 con 0x7fb7541563b0 2023-10-09T08:14:36.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.789+0000 7fb758999700 1 -- 172.21.15.71:0/2070433854 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75000bc00 con 0x7fb7541563b0 2023-10-09T08:14:36.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.789+0000 7fb75bbff700 1 -- 172.21.15.71:0/2070433854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7541563b0 msgr2=0x7fb754156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:36.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.789+0000 7fb75bbff700 1 --2- 172.21.15.71:0/2070433854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7541563b0 0x7fb754156780 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb7500099b0 tx=0x7fb750009250 comp rx=0 tx=0).stop 2023-10-09T08:14:36.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.789+0000 7fb75bbff700 1 -- 172.21.15.71:0/2070433854 shutdown_connections 2023-10-09T08:14:36.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.789+0000 7fb75bbff700 1 --2- 172.21.15.71:0/2070433854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb754068890 0x7fb7540c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:36.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.789+0000 7fb75bbff700 1 --2- 172.21.15.71:0/2070433854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7541563b0 0x7fb754156780 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:36.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.789+0000 7fb75bbff700 1 -- 172.21.15.71:0/2070433854 >> 172.21.15.71:0/2070433854 conn(0x7fb7540c8f90 msgr2=0x7fb7540c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:36.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.789+0000 7fb75bbff700 1 -- 172.21.15.71:0/2070433854 shutdown_connections 2023-10-09T08:14:36.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.790+0000 7fb75bbff700 1 -- 172.21.15.71:0/2070433854 wait complete. 2023-10-09T08:14:36.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.791+0000 7fb75bbff700 1 Processor -- start 2023-10-09T08:14:36.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.791+0000 7fb75bbff700 1 -- start start 2023-10-09T08:14:36.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.792+0000 7fb75bbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb754068890 0x7fb754155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:36.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.792+0000 7fb75bbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7541563b0 0x7fb754157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:36.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.792+0000 7fb75bbff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb75415a440 0x7fb754157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:36.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.792+0000 7fb75bbff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7540af620 con 0x7fb75415a440 2023-10-09T08:14:36.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.792+0000 7fb75bbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb754149f30 con 0x7fb754068890 2023-10-09T08:14:36.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.792+0000 7fb75bbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7541462b0 con 0x7fb7541563b0 2023-10-09T08:14:36.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.792+0000 7fb75a19c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb75415a440 0x7fb754157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:36.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.792+0000 7fb75999b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb754068890 0x7fb754155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:36.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.792+0000 7fb75a19c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb75415a440 0x7fb754157db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51180/0 (socket says 172.21.15.71:51180) 2023-10-09T08:14:36.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.792+0000 7fb75a19c700 1 -- 172.21.15.71:0/3820633613 learned_addr learned my addr 172.21.15.71:0/3820633613 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:36.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.792+0000 7fb75919a700 1 --2- 172.21.15.71:0/3820633613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7541563b0 0x7fb754157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:36.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.793+0000 7fb75a19c700 1 -- 172.21.15.71:0/3820633613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7541563b0 msgr2=0x7fb754157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:36.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.793+0000 7fb75a19c700 1 --2- 172.21.15.71:0/3820633613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7541563b0 0x7fb754157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:36.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.793+0000 7fb75a19c700 1 -- 172.21.15.71:0/3820633613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb754068890 msgr2=0x7fb754155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:36.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.793+0000 7fb75a19c700 1 --2- 172.21.15.71:0/3820633613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb754068890 0x7fb754155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:36.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.793+0000 7fb75a19c700 1 -- 172.21.15.71:0/3820633613 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7500094f0 con 0x7fb75415a440 2023-10-09T08:14:36.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.793+0000 7fb75999b700 1 --2- 172.21.15.71:0/3820633613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb754068890 0x7fb754155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:14:36.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.793+0000 7fb75a19c700 1 --2- 172.21.15.71:0/3820633613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb75415a440 0x7fb754157db0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fb74c009df0 tx=0x7fb74c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:36.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.793+0000 7fb749ffb700 1 -- 172.21.15.71:0/3820633613 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c00caa0 con 0x7fb75415a440 2023-10-09T08:14:36.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.793+0000 7fb749ffb700 1 -- 172.21.15.71:0/3820633613 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74c00f040 con 0x7fb75415a440 2023-10-09T08:14:36.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.793+0000 7fb749ffb700 1 -- 172.21.15.71:0/3820633613 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c00ce50 con 0x7fb75415a440 2023-10-09T08:14:36.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.793+0000 7fb75bbff700 1 -- 172.21.15.71:0/3820633613 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb754158450 con 0x7fb75415a440 2023-10-09T08:14:36.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.793+0000 7fb75bbff700 1 -- 172.21.15.71:0/3820633613 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7541498e0 con 0x7fb75415a440 2023-10-09T08:14:36.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.794+0000 7fb75bbff700 1 -- 172.21.15.71:0/3820633613 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb75414a0e0 con 0x7fb75415a440 2023-10-09T08:14:36.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.795+0000 7fb749ffb700 1 -- 172.21.15.71:0/3820633613 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb74c014690 con 0x7fb75415a440 2023-10-09T08:14:36.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.796+0000 7fb749ffb700 1 --2- 172.21.15.71:0/3820633613 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb738066f30 0x7fb7380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:36.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.796+0000 7fb749ffb700 1 -- 172.21.15.71:0/3820633613 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5345+0+0 (secure 0 0 0) 0x7fb74c084e60 con 0x7fb75415a440 2023-10-09T08:14:36.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.796+0000 7fb75999b700 1 --2- 172.21.15.71:0/3820633613 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb738066f30 0x7fb7380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:36.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.797+0000 7fb75999b700 1 --2- 172.21.15.71:0/3820633613 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb738066f30 0x7fb7380693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb7500099b0 tx=0x7fb750017000 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:36.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.800+0000 7fb749ffb700 1 -- 172.21.15.71:0/3820633613 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb75414a0e0 con 0x7fb75415a440 2023-10-09T08:14:36.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:36.991+0000 7fb75bbff700 1 -- 172.21.15.71:0/3820633613 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb75414a0a0 con 0x7fb75415a440 2023-10-09T08:14:37.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.433+0000 7fb749ffb700 1 -- 172.21.15.71:0/3820633613 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v191) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb74c052230 con 0x7fb75415a440 2023-10-09T08:14:37.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.437+0000 7fb75bbff700 1 -- 172.21.15.71:0/3820633613 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb738066f30 msgr2=0x7fb7380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:37.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.437+0000 7fb75bbff700 1 --2- 172.21.15.71:0/3820633613 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb738066f30 0x7fb7380693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb7500099b0 tx=0x7fb750017000 comp rx=0 tx=0).stop 2023-10-09T08:14:37.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.437+0000 7fb75bbff700 1 -- 172.21.15.71:0/3820633613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb75415a440 msgr2=0x7fb754157db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:37.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.437+0000 7fb75bbff700 1 --2- 172.21.15.71:0/3820633613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb75415a440 0x7fb754157db0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fb74c009df0 tx=0x7fb74c00b040 comp rx=0 tx=0).stop 2023-10-09T08:14:37.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.437+0000 7fb75bbff700 1 -- 172.21.15.71:0/3820633613 shutdown_connections 2023-10-09T08:14:37.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.437+0000 7fb75bbff700 1 --2- 172.21.15.71:0/3820633613 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb738066f30 0x7fb7380693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:37.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.437+0000 7fb75bbff700 1 --2- 172.21.15.71:0/3820633613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb75415a440 0x7fb754157db0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:37.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.437+0000 7fb75bbff700 1 --2- 172.21.15.71:0/3820633613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb754068890 0x7fb754155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:37.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.437+0000 7fb75bbff700 1 --2- 172.21.15.71:0/3820633613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7541563b0 0x7fb754157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:37.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.437+0000 7fb75bbff700 1 -- 172.21.15.71:0/3820633613 >> 172.21.15.71:0/3820633613 conn(0x7fb7540c8f90 msgr2=0x7fb7540cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:37.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.437+0000 7fb75bbff700 1 -- 172.21.15.71:0/3820633613 shutdown_connections 2023-10-09T08:14:37.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.437+0000 7fb75bbff700 1 -- 172.21.15.71:0/3820633613 wait complete. 2023-10-09T08:14:37.439 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' created 2023-10-09T08:14:37.459 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T08:14:37.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.646+0000 7f622b3ff700 1 Processor -- start 2023-10-09T08:14:37.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.646+0000 7f622b3ff700 1 -- start start 2023-10-09T08:14:37.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.647+0000 7f622b3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6224156620 0x7f62240c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:37.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.647+0000 7f622b3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62241569f0 0x7f62240ace70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:37.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.647+0000 7f622b3ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62240ad3b0 con 0x7f6224068390 2023-10-09T08:14:37.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.647+0000 7f622b3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62240c8d30 con 0x7f6224156620 2023-10-09T08:14:37.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.647+0000 7f622b3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622415a6f0 con 0x7f62241569f0 2023-10-09T08:14:37.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.648+0000 7f622999c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6224068390 0x7f622406da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56260/0 (socket says 172.21.15.71:56260) 2023-10-09T08:14:37.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.648+0000 7f622999c700 1 -- 172.21.15.71:0/96246848 learned_addr learned my addr 172.21.15.71:0/96246848 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.648+0000 7f622919b700 1 --2- 172.21.15.71:0/96246848 >> v2:172.21.15.179:3300/0 conn(0x7f6224156620 0x7f62240c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.648+0000 7f622899a700 1 --2- 172.21.15.71:0/96246848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62241569f0 0x7f62240ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.648+0000 7f621bfff700 1 -- 172.21.15.71:0/96246848 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653452744 0 0) 0x7f62240ad3b0 con 0x7f6224068390 2023-10-09T08:14:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.648+0000 7f621bfff700 1 -- 172.21.15.71:0/96246848 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6210003570 con 0x7f6224068390 2023-10-09T08:14:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.649+0000 7f622899a700 1 -- 172.21.15.71:0/96246848 >> v2:172.21.15.179:3300/0 conn(0x7f6224156620 msgr2=0x7f62240c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.649+0000 7f621bfff700 1 -- 172.21.15.71:0/96246848 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2712886508 0 0) 0x7f6210003570 con 0x7f6224068390 2023-10-09T08:14:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.649+0000 7f622899a700 1 --2- 172.21.15.71:0/96246848 >> v2:172.21.15.179:3300/0 conn(0x7f6224156620 0x7f62240c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.649+0000 7f622899a700 1 -- 172.21.15.71:0/96246848 >> v1:172.21.15.71:6789/0 conn(0x7f6224068390 legacy=0x7f622406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.649+0000 7f622899a700 1 -- 172.21.15.71:0/96246848 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622415a9d0 con 0x7f62241569f0 2023-10-09T08:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.649+0000 7f622899a700 1 --2- 172.21.15.71:0/96246848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62241569f0 0x7f62240ace70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f62140098e0 tx=0x7f62140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bacaecbdd5d4902 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.649+0000 7f621bfff700 1 -- 172.21.15.71:0/96246848 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c0017f0 con 0x7f62241569f0 2023-10-09T08:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.649+0000 7f621bfff700 1 -- 172.21.15.71:0/96246848 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6214011420 con 0x7f62241569f0 2023-10-09T08:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.649+0000 7f621bfff700 1 -- 172.21.15.71:0/96246848 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62140117a0 con 0x7f62241569f0 2023-10-09T08:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.650+0000 7f622b3ff700 1 -- 172.21.15.71:0/96246848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62241569f0 msgr2=0x7f62240ace70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.650+0000 7f622b3ff700 1 --2- 172.21.15.71:0/96246848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62241569f0 0x7f62240ace70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f62140098e0 tx=0x7f62140091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.650+0000 7f622b3ff700 1 -- 172.21.15.71:0/96246848 shutdown_connections 2023-10-09T08:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.650+0000 7f622b3ff700 1 --2- 172.21.15.71:0/96246848 >> v2:172.21.15.179:3300/0 conn(0x7f6224156620 0x7f62240c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.650+0000 7f622b3ff700 1 --2- 172.21.15.71:0/96246848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62241569f0 0x7f62240ace70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.650+0000 7f622b3ff700 1 -- 172.21.15.71:0/96246848 >> 172.21.15.71:0/96246848 conn(0x7f62240cc540 msgr2=0x7f62240cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:37.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.650+0000 7f622b3ff700 1 -- 172.21.15.71:0/96246848 shutdown_connections 2023-10-09T08:14:37.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.650+0000 7f622b3ff700 1 -- 172.21.15.71:0/96246848 wait complete. 2023-10-09T08:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.651+0000 7f622b3ff700 1 Processor -- start 2023-10-09T08:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.651+0000 7f622b3ff700 1 -- start start 2023-10-09T08:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.652+0000 7f622b3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6224068390 0x7f62240af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.652+0000 7f622b3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6224156620 0x7f622414c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.652+0000 7f622b3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62241569f0 0x7f62240c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.652+0000 7f622b3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62240a98e0 con 0x7f6224156620 2023-10-09T08:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.652+0000 7f622b3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62240a9ba0 con 0x7f6224068390 2023-10-09T08:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.652+0000 7f622b3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62240a9e80 con 0x7f62241569f0 2023-10-09T08:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.653+0000 7f622899a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6224156620 0x7f622414c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.653+0000 7f622899a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6224156620 0x7f622414c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51188/0 (socket says 172.21.15.71:51188) 2023-10-09T08:14:37.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.653+0000 7f622899a700 1 -- 172.21.15.71:0/1846508761 learned_addr learned my addr 172.21.15.71:0/1846508761 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:37.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.653+0000 7f622999c700 1 --2- 172.21.15.71:0/1846508761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62241569f0 0x7f62240c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:37.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.653+0000 7f622919b700 1 --2- 172.21.15.71:0/1846508761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6224068390 0x7f62240af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:37.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.653+0000 7f622899a700 1 -- 172.21.15.71:0/1846508761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62241569f0 msgr2=0x7f62240c5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:37.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.653+0000 7f622899a700 1 --2- 172.21.15.71:0/1846508761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62241569f0 0x7f62240c5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:37.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.653+0000 7f622899a700 1 -- 172.21.15.71:0/1846508761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6224068390 msgr2=0x7f62240af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:37.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.653+0000 7f622899a700 1 --2- 172.21.15.71:0/1846508761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6224068390 0x7f62240af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:37.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.653+0000 7f622899a700 1 -- 172.21.15.71:0/1846508761 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6214009420 con 0x7f6224156620 2023-10-09T08:14:37.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.653+0000 7f622899a700 1 --2- 172.21.15.71:0/1846508761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6224156620 0x7f622414c8e0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f62140091e0 tx=0x7f6214016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:37.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.654+0000 7f62197fa700 1 -- 172.21.15.71:0/1846508761 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621401cc00 con 0x7f6224156620 2023-10-09T08:14:37.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.654+0000 7f62197fa700 1 -- 172.21.15.71:0/1846508761 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621401cda0 con 0x7f6224156620 2023-10-09T08:14:37.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.654+0000 7f62197fa700 1 -- 172.21.15.71:0/1846508761 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6214025680 con 0x7f6224156620 2023-10-09T08:14:37.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.654+0000 7f622b3ff700 1 -- 172.21.15.71:0/1846508761 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62240aa160 con 0x7f6224156620 2023-10-09T08:14:37.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.654+0000 7f622b3ff700 1 -- 172.21.15.71:0/1846508761 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62240c4c90 con 0x7f6224156620 2023-10-09T08:14:37.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.655+0000 7f622b3ff700 1 -- 172.21.15.71:0/1846508761 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62240aa680 con 0x7f6224156620 2023-10-09T08:14:37.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.656+0000 7f62197fa700 1 -- 172.21.15.71:0/1846508761 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f621402f480 con 0x7f6224156620 2023-10-09T08:14:37.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.657+0000 7f62197fa700 1 --2- 172.21.15.71:0/1846508761 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6208066f30 0x7f62080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:37.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.657+0000 7f62197fa700 1 -- 172.21.15.71:0/1846508761 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 5715+0+0 (secure 0 0 0) 0x7f6214085980 con 0x7f6224156620 2023-10-09T08:14:37.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.657+0000 7f622919b700 1 --2- 172.21.15.71:0/1846508761 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6208066f30 0x7f62080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:37.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.658+0000 7f622919b700 1 --2- 172.21.15.71:0/1846508761 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6208066f30 0x7f62080693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6220009db0 tx=0x7f62200091a0 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:37.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.661+0000 7f62197fa700 1 -- 172.21.15.71:0/1846508761 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6214052c40 con 0x7f6224156620 2023-10-09T08:14:37.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:37.853+0000 7f622b3ff700 1 -- 172.21.15.71:0/1846508761 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f62240aa680 con 0x7f6224156620 2023-10-09T08:14:38.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.438+0000 7f62197fa700 1 -- 172.21.15.71:0/1846508761 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v192) v1 ==== 170+0+0 (secure 0 0 0) 0x7f62240aa680 con 0x7f6224156620 2023-10-09T08:14:38.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.446+0000 7f622b3ff700 1 -- 172.21.15.71:0/1846508761 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6208066f30 msgr2=0x7f62080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:38.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.446+0000 7f622b3ff700 1 --2- 172.21.15.71:0/1846508761 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6208066f30 0x7f62080693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6220009db0 tx=0x7f62200091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:38.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.446+0000 7f622b3ff700 1 -- 172.21.15.71:0/1846508761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6224156620 msgr2=0x7f622414c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:38.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.446+0000 7f622b3ff700 1 --2- 172.21.15.71:0/1846508761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6224156620 0x7f622414c8e0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f62140091e0 tx=0x7f6214016000 comp rx=0 tx=0).stop 2023-10-09T08:14:38.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.448+0000 7f622b3ff700 1 -- 172.21.15.71:0/1846508761 shutdown_connections 2023-10-09T08:14:38.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.448+0000 7f622b3ff700 1 --2- 172.21.15.71:0/1846508761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62241569f0 0x7f62240c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:38.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.448+0000 7f622b3ff700 1 --2- 172.21.15.71:0/1846508761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6224068390 0x7f62240af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:38.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.448+0000 7f622b3ff700 1 --2- 172.21.15.71:0/1846508761 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6208066f30 0x7f62080693e0 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6220009db0 tx=0x7f62200091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:38.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.448+0000 7f622b3ff700 1 --2- 172.21.15.71:0/1846508761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6224156620 0x7f622414c8e0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:38.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.448+0000 7f622b3ff700 1 -- 172.21.15.71:0/1846508761 >> 172.21.15.71:0/1846508761 conn(0x7f62240cc540 msgr2=0x7f62240ca070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:38.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.452+0000 7f622b3ff700 1 -- 172.21.15.71:0/1846508761 shutdown_connections 2023-10-09T08:14:38.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.453+0000 7f622b3ff700 1 -- 172.21.15.71:0/1846508761 wait complete. 2023-10-09T08:14:38.457 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' created 2023-10-09T08:14:38.477 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T08:14:38.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.662+0000 7f90b959d700 1 Processor -- start 2023-10-09T08:14:38.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.662+0000 7f90b959d700 1 -- start start 2023-10-09T08:14:38.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.663+0000 7f90b959d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90b40b16d0 0x7f90b40b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:38.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.663+0000 7f90b959d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f90b40b33b0 0x7f90b40b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:38.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.663+0000 7f90b959d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b40b2080 con 0x7f90b40b4e70 2023-10-09T08:14:38.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.663+0000 7f90b959d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b40cfb00 con 0x7f90b40b33b0 2023-10-09T08:14:38.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.663+0000 7f90b959d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b40b5c40 con 0x7f90b40b16d0 2023-10-09T08:14:38.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.664+0000 7f90b37fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90b40b16d0 0x7f90b40b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:38.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.664+0000 7f90b8d9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f90b40b33b0 0x7f90b40b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:38.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.664+0000 7f90b8d9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f90b40b33b0 0x7f90b40b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:33812/0 (socket says 172.21.15.71:33812) 2023-10-09T08:14:38.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.664+0000 7f90b37fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90b40b16d0 0x7f90b40b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:55188/0 (socket says 172.21.15.71:55188) 2023-10-09T08:14:38.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.664+0000 7f90b8d9c700 1 -- 172.21.15.71:0/4070316114 learned_addr learned my addr 172.21.15.71:0/4070316114 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:38.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.664+0000 7f90b8d9c700 1 -- 172.21.15.71:0/4070316114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90b40b16d0 msgr2=0x7f90b40b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:38.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.664+0000 7f90b8d9c700 1 --2- 172.21.15.71:0/4070316114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90b40b16d0 0x7f90b40b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:38.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.664+0000 7f90b8d9c700 1 -- 172.21.15.71:0/4070316114 >> v1:172.21.15.179:6789/0 conn(0x7f90b40b4e70 legacy=0x7f90b40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:38.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.664+0000 7f90b8d9c700 1 -- 172.21.15.71:0/4070316114 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b40b5f20 con 0x7f90b40b33b0 2023-10-09T08:14:38.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.664+0000 7f90b37fe700 1 --2- 172.21.15.71:0/4070316114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90b40b16d0 0x7f90b40b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:14:38.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.664+0000 7f90b2ffd700 1 -- 172.21.15.71:0/4070316114 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 111221854 0 0) 0x7f90b40b2080 con 0x7f90b40b4e70 2023-10-09T08:14:38.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.665+0000 7f90b8d9c700 1 --2- 172.21.15.71:0/4070316114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90b40b33b0 0x7f90b40b3830 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f90ac009f20 tx=0x7f90ac009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0babb42a3d0b03 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:38.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.665+0000 7f90b2ffd700 1 -- 172.21.15.71:0/4070316114 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac00e070 con 0x7f90b40b33b0 2023-10-09T08:14:38.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.665+0000 7f90b2ffd700 1 -- 172.21.15.71:0/4070316114 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ac00b9d0 con 0x7f90b40b33b0 2023-10-09T08:14:38.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.665+0000 7f90b2ffd700 1 -- 172.21.15.71:0/4070316114 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac0092e0 con 0x7f90b40b33b0 2023-10-09T08:14:38.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.665+0000 7f90b959d700 1 -- 172.21.15.71:0/4070316114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90b40b33b0 msgr2=0x7f90b40b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:38.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.665+0000 7f90b959d700 1 --2- 172.21.15.71:0/4070316114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90b40b33b0 0x7f90b40b3830 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f90ac009f20 tx=0x7f90ac009840 comp rx=0 tx=0).stop 2023-10-09T08:14:38.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.665+0000 7f90b959d700 1 -- 172.21.15.71:0/4070316114 shutdown_connections 2023-10-09T08:14:38.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.665+0000 7f90b959d700 1 --2- 172.21.15.71:0/4070316114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90b40b33b0 0x7f90b40b3830 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:38.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.665+0000 7f90b959d700 1 --2- 172.21.15.71:0/4070316114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90b40b16d0 0x7f90b40b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:38.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.665+0000 7f90b959d700 1 -- 172.21.15.71:0/4070316114 >> 172.21.15.71:0/4070316114 conn(0x7f90b40d10c0 msgr2=0x7f90b40affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:38.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.665+0000 7f90b959d700 1 -- 172.21.15.71:0/4070316114 shutdown_connections 2023-10-09T08:14:38.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.665+0000 7f90b959d700 1 -- 172.21.15.71:0/4070316114 wait complete. 2023-10-09T08:14:38.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.667+0000 7f90b959d700 1 Processor -- start 2023-10-09T08:14:38.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.667+0000 7f90b959d700 1 -- start start 2023-10-09T08:14:38.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.668+0000 7f90b959d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90b40b16d0 0x7f90b40ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:38.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.668+0000 7f90b959d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90b40b33b0 0x7f90b4068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:38.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.668+0000 7f90b959d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90b40b4e70 0x7f90b4068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:38.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.668+0000 7f90b959d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b40c6660 con 0x7f90b40b4e70 2023-10-09T08:14:38.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.668+0000 7f90b959d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b416dfa0 con 0x7f90b40b16d0 2023-10-09T08:14:38.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.668+0000 7f90b959d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b40c5d30 con 0x7f90b40b33b0 2023-10-09T08:14:38.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.668+0000 7f90b8d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90b40b4e70 0x7f90b4068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:38.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.668+0000 7f90b8d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90b40b4e70 0x7f90b4068f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51194/0 (socket says 172.21.15.71:51194) 2023-10-09T08:14:38.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.668+0000 7f90b8d9c700 1 -- 172.21.15.71:0/1427905787 learned_addr learned my addr 172.21.15.71:0/1427905787 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:38.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.668+0000 7f90b3fff700 1 --2- 172.21.15.71:0/1427905787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90b40b16d0 0x7f90b40ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:38.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.668+0000 7f90b37fe700 1 --2- 172.21.15.71:0/1427905787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90b40b33b0 0x7f90b4068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:38.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.668+0000 7f90b8d9c700 1 -- 172.21.15.71:0/1427905787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90b40b33b0 msgr2=0x7f90b4068a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:38.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.668+0000 7f90b8d9c700 1 --2- 172.21.15.71:0/1427905787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90b40b33b0 0x7f90b4068a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:38.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.669+0000 7f90b8d9c700 1 -- 172.21.15.71:0/1427905787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90b40b16d0 msgr2=0x7f90b40ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:38.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.669+0000 7f90b8d9c700 1 --2- 172.21.15.71:0/1427905787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90b40b16d0 0x7f90b40ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:38.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.669+0000 7f90b8d9c700 1 -- 172.21.15.71:0/1427905787 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a8009420 con 0x7f90b40b4e70 2023-10-09T08:14:38.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.669+0000 7f90b8d9c700 1 --2- 172.21.15.71:0/1427905787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90b40b4e70 0x7f90b4068f40 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00b610 tx=0x7f90ac018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:38.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.669+0000 7f909bfff700 1 -- 172.21.15.71:0/1427905787 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac0070a0 con 0x7f90b40b4e70 2023-10-09T08:14:38.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.669+0000 7f909bfff700 1 -- 172.21.15.71:0/1427905787 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ac007b40 con 0x7f90b40b4e70 2023-10-09T08:14:38.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.669+0000 7f909bfff700 1 -- 172.21.15.71:0/1427905787 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac01d420 con 0x7f90b40b4e70 2023-10-09T08:14:38.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.669+0000 7f90b959d700 1 -- 172.21.15.71:0/1427905787 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ac009ae0 con 0x7f90b40b4e70 2023-10-09T08:14:38.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.669+0000 7f90b959d700 1 -- 172.21.15.71:0/1427905787 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b40c62f0 con 0x7f90b40b4e70 2023-10-09T08:14:38.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.670+0000 7f90b959d700 1 -- 172.21.15.71:0/1427905787 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b4088990 con 0x7f90b40b4e70 2023-10-09T08:14:38.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.671+0000 7f909bfff700 1 -- 172.21.15.71:0/1427905787 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f90ac003050 con 0x7f90b40b4e70 2023-10-09T08:14:38.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.672+0000 7f909bfff700 1 --2- 172.21.15.71:0/1427905787 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f90a0066f30 0x7f90a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:38.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.672+0000 7f909bfff700 1 -- 172.21.15.71:0/1427905787 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f90ac0863a0 con 0x7f90b40b4e70 2023-10-09T08:14:38.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.673+0000 7f90b3fff700 1 --2- 172.21.15.71:0/1427905787 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f90a0066f30 0x7f90a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:38.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.673+0000 7f90b3fff700 1 --2- 172.21.15.71:0/1427905787 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f90a0066f30 0x7f90a00693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f90a4003a40 tx=0x7f90a4007ec0 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:38.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.676+0000 7f909bfff700 1 -- 172.21.15.71:0/1427905787 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90ac053500 con 0x7f90b40b4e70 2023-10-09T08:14:38.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:38.911+0000 7f90b959d700 1 -- 172.21.15.71:0/1427905787 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f90b40c67a0 con 0x7f90b40b4e70 2023-10-09T08:14:39.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.469+0000 7f909bfff700 1 -- 172.21.15.71:0/1427905787 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v86) v1 ==== 174+0+0 (secure 0 0 0) 0x7f90ac056b20 con 0x7f90b40b4e70 2023-10-09T08:14:39.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.479+0000 7f90b959d700 1 -- 172.21.15.71:0/1427905787 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f90a0066f30 msgr2=0x7f90a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:39.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.479+0000 7f90b959d700 1 --2- 172.21.15.71:0/1427905787 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f90a0066f30 0x7f90a00693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f90a4003a40 tx=0x7f90a4007ec0 comp rx=0 tx=0).stop 2023-10-09T08:14:39.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.479+0000 7f90b959d700 1 -- 172.21.15.71:0/1427905787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90b40b4e70 msgr2=0x7f90b4068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:39.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.479+0000 7f90b959d700 1 --2- 172.21.15.71:0/1427905787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90b40b4e70 0x7f90b4068f40 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00b610 tx=0x7f90ac018000 comp rx=0 tx=0).stop 2023-10-09T08:14:39.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.480+0000 7f90b959d700 1 -- 172.21.15.71:0/1427905787 shutdown_connections 2023-10-09T08:14:39.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.480+0000 7f90b959d700 1 --2- 172.21.15.71:0/1427905787 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f90a0066f30 0x7f90a00693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:39.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.480+0000 7f90b959d700 1 --2- 172.21.15.71:0/1427905787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90b40b4e70 0x7f90b4068f40 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:39.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.480+0000 7f90b959d700 1 --2- 172.21.15.71:0/1427905787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90b40b16d0 0x7f90b40ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:39.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.480+0000 7f90b959d700 1 --2- 172.21.15.71:0/1427905787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90b40b33b0 0x7f90b4068a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:39.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.480+0000 7f90b959d700 1 -- 172.21.15.71:0/1427905787 >> 172.21.15.71:0/1427905787 conn(0x7f90b40d10c0 msgr2=0x7f90b4158ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:39.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.483+0000 7f90b959d700 1 -- 172.21.15.71:0/1427905787 shutdown_connections 2023-10-09T08:14:39.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.483+0000 7f90b959d700 1 -- 172.21.15.71:0/1427905787 wait complete. 2023-10-09T08:14:39.487 INFO:teuthology.orchestra.run.smithi071.stderr:new fs with metadata pool 22 and data pool 23 2023-10-09T08:14:39.506 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T08:14:39.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.686+0000 7f49f83ff700 1 Processor -- start 2023-10-09T08:14:39.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.686+0000 7f49f83ff700 1 -- start start 2023-10-09T08:14:39.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.687+0000 7f49f83ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f49f00ccf90 0x7f49f00ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:39.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.687+0000 7f49f83ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f00cc300 con 0x7f49f00b1420 2023-10-09T08:14:39.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.687+0000 7f49f83ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f00ad370 con 0x7f49f00cbf30 2023-10-09T08:14:39.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.687+0000 7f49f83ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f0156bf0 con 0x7f49f00ccf90 2023-10-09T08:14:39.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.688+0000 7f49f599a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f49f00b1420 0x7f49f00c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56276/0 (socket says 172.21.15.71:56276) 2023-10-09T08:14:39.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.688+0000 7f49f599a700 1 -- 172.21.15.71:0/2096776878 learned_addr learned my addr 172.21.15.71:0/2096776878 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:39.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.688+0000 7f49f699c700 1 --2- 172.21.15.71:0/2096776878 >> v2:172.21.15.71:3300/0 conn(0x7f49f00ccf90 0x7f49f00ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:39.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.688+0000 7f49f5199700 1 -- 172.21.15.71:0/2096776878 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1200324146 0 0) 0x7f49f00cc300 con 0x7f49f00b1420 2023-10-09T08:14:39.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.688+0000 7f49f5199700 1 -- 172.21.15.71:0/2096776878 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49dc003570 con 0x7f49f00b1420 2023-10-09T08:14:39.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.688+0000 7f49f699c700 1 -- 172.21.15.71:0/2096776878 >> v1:172.21.15.179:6789/0 conn(0x7f49f00cbf30 legacy=0x7f49f00b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:39.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.688+0000 7f49f699c700 1 -- 172.21.15.71:0/2096776878 >> v1:172.21.15.71:6789/0 conn(0x7f49f00b1420 legacy=0x7f49f00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:39.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.688+0000 7f49f699c700 1 -- 172.21.15.71:0/2096776878 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f00ad650 con 0x7f49f00ccf90 2023-10-09T08:14:39.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.688+0000 7f49f699c700 1 --2- 172.21.15.71:0/2096776878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49f00ccf90 0x7f49f00ae410 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009e60 tx=0x7f49e8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee06b0e83a79a15a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:39.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.689+0000 7f49f5199700 1 -- 172.21.15.71:0/2096776878 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e800e070 con 0x7f49f00ccf90 2023-10-09T08:14:39.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.689+0000 7f49f5199700 1 -- 172.21.15.71:0/2096776878 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e800bb20 con 0x7f49f00ccf90 2023-10-09T08:14:39.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.689+0000 7f49f5199700 1 -- 172.21.15.71:0/2096776878 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e800bea0 con 0x7f49f00ccf90 2023-10-09T08:14:39.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.689+0000 7f49f83ff700 1 -- 172.21.15.71:0/2096776878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49f00ccf90 msgr2=0x7f49f00ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:39.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.689+0000 7f49f83ff700 1 --2- 172.21.15.71:0/2096776878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49f00ccf90 0x7f49f00ae410 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009e60 tx=0x7f49e8009780 comp rx=0 tx=0).stop 2023-10-09T08:14:39.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.689+0000 7f49f83ff700 1 -- 172.21.15.71:0/2096776878 shutdown_connections 2023-10-09T08:14:39.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.689+0000 7f49f83ff700 1 --2- 172.21.15.71:0/2096776878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49f00ccf90 0x7f49f00ae410 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:39.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.689+0000 7f49f83ff700 1 -- 172.21.15.71:0/2096776878 >> 172.21.15.71:0/2096776878 conn(0x7f49f006a320 msgr2=0x7f49f00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:39.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.689+0000 7f49f83ff700 1 -- 172.21.15.71:0/2096776878 shutdown_connections 2023-10-09T08:14:39.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.689+0000 7f49f83ff700 1 -- 172.21.15.71:0/2096776878 wait complete. 2023-10-09T08:14:39.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.691+0000 7f49f83ff700 1 Processor -- start 2023-10-09T08:14:39.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.691+0000 7f49f83ff700 1 -- start start 2023-10-09T08:14:39.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.692+0000 7f49f83ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49f00b1420 0x7f49f0156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:39.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.692+0000 7f49f83ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49f00cbf30 0x7f49f00c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:39.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.692+0000 7f49f83ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49f00ccf90 0x7f49f00c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:39.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.692+0000 7f49f83ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f016bae0 con 0x7f49f00ccf90 2023-10-09T08:14:39.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.692+0000 7f49f83ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f00a54c0 con 0x7f49f00b1420 2023-10-09T08:14:39.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.692+0000 7f49f83ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f016aed0 con 0x7f49f00cbf30 2023-10-09T08:14:39.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.692+0000 7f49f699c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49f00ccf90 0x7f49f00c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:39.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.692+0000 7f49f699c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49f00ccf90 0x7f49f00c64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51206/0 (socket says 172.21.15.71:51206) 2023-10-09T08:14:39.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.692+0000 7f49f699c700 1 -- 172.21.15.71:0/4285148184 learned_addr learned my addr 172.21.15.71:0/4285148184 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:39.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.692+0000 7f49f619b700 1 --2- 172.21.15.71:0/4285148184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49f00b1420 0x7f49f0156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:39.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.692+0000 7f49f599a700 1 --2- 172.21.15.71:0/4285148184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49f00cbf30 0x7f49f00c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:39.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.693+0000 7f49f699c700 1 -- 172.21.15.71:0/4285148184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49f00cbf30 msgr2=0x7f49f00c5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:39.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.693+0000 7f49f699c700 1 --2- 172.21.15.71:0/4285148184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49f00cbf30 0x7f49f00c5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:39.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.693+0000 7f49f699c700 1 -- 172.21.15.71:0/4285148184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49f00b1420 msgr2=0x7f49f0156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:39.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.693+0000 7f49f699c700 1 --2- 172.21.15.71:0/4285148184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49f00b1420 0x7f49f0156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:39.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.693+0000 7f49f699c700 1 -- 172.21.15.71:0/4285148184 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e8009a20 con 0x7f49f00ccf90 2023-10-09T08:14:39.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.693+0000 7f49f599a700 1 --2- 172.21.15.71:0/4285148184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49f00cbf30 0x7f49f00c5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:14:39.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.693+0000 7f49f699c700 1 --2- 172.21.15.71:0/4285148184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49f00ccf90 0x7f49f00c64d0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f49f0064290 tx=0x7f49e8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:39.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.693+0000 7f49e67fc700 1 -- 172.21.15.71:0/4285148184 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e801e430 con 0x7f49f00ccf90 2023-10-09T08:14:39.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.693+0000 7f49e67fc700 1 -- 172.21.15.71:0/4285148184 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e801e5b0 con 0x7f49f00ccf90 2023-10-09T08:14:39.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.693+0000 7f49e67fc700 1 -- 172.21.15.71:0/4285148184 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e801e970 con 0x7f49f00ccf90 2023-10-09T08:14:39.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.693+0000 7f49f83ff700 1 -- 172.21.15.71:0/4285148184 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f016b1b0 con 0x7f49f00ccf90 2023-10-09T08:14:39.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.693+0000 7f49f83ff700 1 -- 172.21.15.71:0/4285148184 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f016b770 con 0x7f49f00ccf90 2023-10-09T08:14:39.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.694+0000 7f49f83ff700 1 -- 172.21.15.71:0/4285148184 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f00ae8a0 con 0x7f49f00ccf90 2023-10-09T08:14:39.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.695+0000 7f49e67fc700 1 -- 172.21.15.71:0/4285148184 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49e801ece0 con 0x7f49f00ccf90 2023-10-09T08:14:39.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.696+0000 7f49e67fc700 1 --2- 172.21.15.71:0/4285148184 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f49d4066f60 0x7f49d4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:39.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.696+0000 7f49e67fc700 1 -- 172.21.15.71:0/4285148184 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f49e8086c20 con 0x7f49f00ccf90 2023-10-09T08:14:39.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.696+0000 7f49f619b700 1 --2- 172.21.15.71:0/4285148184 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f49d4066f60 0x7f49d4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:39.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.697+0000 7f49f619b700 1 --2- 172.21.15.71:0/4285148184 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f49d4066f60 0x7f49d4069410 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f49ec003aa0 tx=0x7f49ec000bc0 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:39.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.700+0000 7f49e67fc700 1 -- 172.21.15.71:0/4285148184 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49e8053c00 con 0x7f49f00ccf90 2023-10-09T08:14:39.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.891+0000 7f49f83ff700 1 -- 172.21.15.71:0/4285148184 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49f004c3c0 con 0x7f49f00ccf90 2023-10-09T08:14:39.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.892+0000 7f49e67fc700 1 -- 172.21.15.71:0/4285148184 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) v1 ==== 74+0+16133 (secure 0 0 0) 0x7f49e8057220 con 0x7f49f00ccf90 2023-10-09T08:14:39.893 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:14:39.893 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":193,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T08:14:38.912787+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T08:14:37.033384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T08:14:37.895335+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T08:14:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.894+0000 7f49f83ff700 1 -- 172.21.15.71:0/4285148184 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f49d4066f60 msgr2=0x7f49d4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.894+0000 7f49f83ff700 1 --2- 172.21.15.71:0/4285148184 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f49d4066f60 0x7f49d4069410 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f49ec003aa0 tx=0x7f49ec000bc0 comp rx=0 tx=0).stop 2023-10-09T08:14:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.894+0000 7f49f83ff700 1 -- 172.21.15.71:0/4285148184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49f00ccf90 msgr2=0x7f49f00c64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.894+0000 7f49f83ff700 1 --2- 172.21.15.71:0/4285148184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49f00ccf90 0x7f49f00c64d0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f49f0064290 tx=0x7f49e8018000 comp rx=0 tx=0).stop 2023-10-09T08:14:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.895+0000 7f49f83ff700 1 -- 172.21.15.71:0/4285148184 shutdown_connections 2023-10-09T08:14:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.895+0000 7f49f83ff700 1 --2- 172.21.15.71:0/4285148184 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f49d4066f60 0x7f49d4069410 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.895+0000 7f49f83ff700 1 --2- 172.21.15.71:0/4285148184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49f00ccf90 0x7f49f00c64d0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.895+0000 7f49f83ff700 1 --2- 172.21.15.71:0/4285148184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49f00b1420 0x7f49f0156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.895+0000 7f49f83ff700 1 --2- 172.21.15.71:0/4285148184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49f00cbf30 0x7f49f00c5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:39.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.895+0000 7f49f83ff700 1 -- 172.21.15.71:0/4285148184 >> 172.21.15.71:0/4285148184 conn(0x7f49f006a320 msgr2=0x7f49f00c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:39.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.895+0000 7f49f83ff700 1 -- 172.21.15.71:0/4285148184 shutdown_connections 2023-10-09T08:14:39.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:39.895+0000 7f49f83ff700 1 -- 172.21.15.71:0/4285148184 wait complete. 2023-10-09T08:14:39.914 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T08:14:40.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.094+0000 7f27755ff700 1 Processor -- start 2023-10-09T08:14:40.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.094+0000 7f27755ff700 1 -- start start 2023-10-09T08:14:40.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.095+0000 7f27755ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2770155c10 0x7f2770155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:40.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.096+0000 7f27755ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27700ac6d0 0x7f27700b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:40.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.096+0000 7f27755ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27700acac0 con 0x7f27700ac230 2023-10-09T08:14:40.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.096+0000 7f27755ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27700ad930 con 0x7f2770155c10 2023-10-09T08:14:40.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.096+0000 7f27755ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27700acd20 con 0x7f27700ac6d0 2023-10-09T08:14:40.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.096+0000 7f276effd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2770155c10 0x7f2770155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:40.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.096+0000 7f276f7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27700ac6d0 0x7f27700b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:40.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.096+0000 7f276effd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2770155c10 0x7f2770155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:33840/0 (socket says 172.21.15.71:33840) 2023-10-09T08:14:40.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.096+0000 7f276f7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27700ac6d0 0x7f27700b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:55218/0 (socket says 172.21.15.71:55218) 2023-10-09T08:14:40.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.096+0000 7f276effd700 1 -- 172.21.15.71:0/4044358423 learned_addr learned my addr 172.21.15.71:0/4044358423 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:40.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.096+0000 7f2767fff700 1 --1- 172.21.15.71:0/4044358423 >> v1:172.21.15.179:6789/0 conn(0x7f27700ac230 0x7f27701568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:49204/0 (socket says 172.21.15.71:49204) 2023-10-09T08:14:40.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.097+0000 7f276f7fe700 1 -- 172.21.15.71:0/4044358423 >> v2:172.21.15.179:3300/0 conn(0x7f2770155c10 msgr2=0x7f2770155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:40.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.097+0000 7f276f7fe700 1 --2- 172.21.15.71:0/4044358423 >> v2:172.21.15.179:3300/0 conn(0x7f2770155c10 0x7f2770155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:40.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.097+0000 7f276f7fe700 1 -- 172.21.15.71:0/4044358423 >> v1:172.21.15.179:6789/0 conn(0x7f27700ac230 legacy=0x7f27701568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:40.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.097+0000 7f276f7fe700 1 -- 172.21.15.71:0/4044358423 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27700ad000 con 0x7f27700ac6d0 2023-10-09T08:14:40.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.097+0000 7f276effd700 1 --2- 172.21.15.71:0/4044358423 >> v2:172.21.15.179:3300/0 conn(0x7f2770155c10 0x7f2770155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:14:40.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.097+0000 7f276e7fc700 1 -- 172.21.15.71:0/4044358423 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2434055047 0 0) 0x7f27700acac0 con 0x7f27700ac230 2023-10-09T08:14:40.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.097+0000 7f276f7fe700 1 --2- 172.21.15.71:0/4044358423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27700ac6d0 0x7f27700b0300 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f27700acc50 tx=0x7f2768009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50402468052d16fa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:40.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.097+0000 7f276e7fc700 1 -- 172.21.15.71:0/4044358423 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2768016070 con 0x7f27700ac6d0 2023-10-09T08:14:40.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.097+0000 7f276e7fc700 1 -- 172.21.15.71:0/4044358423 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276800bb60 con 0x7f27700ac6d0 2023-10-09T08:14:40.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.097+0000 7f276e7fc700 1 -- 172.21.15.71:0/4044358423 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276800e070 con 0x7f27700ac6d0 2023-10-09T08:14:40.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.098+0000 7f27755ff700 1 -- 172.21.15.71:0/4044358423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27700ac6d0 msgr2=0x7f27700b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:40.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.098+0000 7f27755ff700 1 --2- 172.21.15.71:0/4044358423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27700ac6d0 0x7f27700b0300 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f27700acc50 tx=0x7f2768009780 comp rx=0 tx=0).stop 2023-10-09T08:14:40.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.098+0000 7f27755ff700 1 -- 172.21.15.71:0/4044358423 shutdown_connections 2023-10-09T08:14:40.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.098+0000 7f27755ff700 1 --2- 172.21.15.71:0/4044358423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27700ac6d0 0x7f27700b0300 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:40.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.098+0000 7f27755ff700 1 --2- 172.21.15.71:0/4044358423 >> v2:172.21.15.179:3300/0 conn(0x7f2770155c10 0x7f2770155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:40.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.098+0000 7f27755ff700 1 -- 172.21.15.71:0/4044358423 >> 172.21.15.71:0/4044358423 conn(0x7f277006a320 msgr2=0x7f27700cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:40.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.098+0000 7f27755ff700 1 -- 172.21.15.71:0/4044358423 shutdown_connections 2023-10-09T08:14:40.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.098+0000 7f27755ff700 1 -- 172.21.15.71:0/4044358423 wait complete. 2023-10-09T08:14:40.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.099+0000 7f27755ff700 1 Processor -- start 2023-10-09T08:14:40.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.100+0000 7f27755ff700 1 -- start start 2023-10-09T08:14:40.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.100+0000 7f27755ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27700ac230 0x7f277015a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:40.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.100+0000 7f27755ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27700ac6d0 0x7f27701448d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:40.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.100+0000 7f27755ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2770155c10 0x7f27700cc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:40.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.100+0000 7f27755ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2770145240 con 0x7f27700ac6d0 2023-10-09T08:14:40.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.100+0000 7f27755ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2770147e90 con 0x7f27700ac230 2023-10-09T08:14:40.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.100+0000 7f27755ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2770148130 con 0x7f2770155c10 2023-10-09T08:14:40.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.101+0000 7f2767fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27700ac6d0 0x7f27701448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:40.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.101+0000 7f276effd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27700ac230 0x7f277015a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:40.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.101+0000 7f276f7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2770155c10 0x7f27700cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:40.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.101+0000 7f276effd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27700ac230 0x7f277015a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:33846/0 (socket says 172.21.15.71:33846) 2023-10-09T08:14:40.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.101+0000 7f276effd700 1 -- 172.21.15.71:0/2038029948 learned_addr learned my addr 172.21.15.71:0/2038029948 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:40.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.101+0000 7f276f7fe700 1 -- 172.21.15.71:0/2038029948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27700ac230 msgr2=0x7f277015a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:40.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.101+0000 7f276f7fe700 1 --2- 172.21.15.71:0/2038029948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27700ac230 0x7f277015a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:40.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.101+0000 7f276f7fe700 1 -- 172.21.15.71:0/2038029948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27700ac6d0 msgr2=0x7f27701448d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:40.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.101+0000 7f276f7fe700 1 --2- 172.21.15.71:0/2038029948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27700ac6d0 0x7f27701448d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:40.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.101+0000 7f276f7fe700 1 -- 172.21.15.71:0/2038029948 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27600094f0 con 0x7f2770155c10 2023-10-09T08:14:40.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.101+0000 7f2767fff700 1 --2- 172.21.15.71:0/2038029948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27700ac6d0 0x7f27701448d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:14:40.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.102+0000 7f276f7fe700 1 --2- 172.21.15.71:0/2038029948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2770155c10 0x7f27700cc690 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2768015000 tx=0x7f2768018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:40.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.102+0000 7f2766ffd700 1 -- 172.21.15.71:0/2038029948 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2768012e00 con 0x7f2770155c10 2023-10-09T08:14:40.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.102+0000 7f2766ffd700 1 -- 172.21.15.71:0/2038029948 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2768027470 con 0x7f2770155c10 2023-10-09T08:14:40.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.102+0000 7f27755ff700 1 -- 172.21.15.71:0/2038029948 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2768009a20 con 0x7f2770155c10 2023-10-09T08:14:40.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.102+0000 7f2766ffd700 1 -- 172.21.15.71:0/2038029948 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2768027870 con 0x7f2770155c10 2023-10-09T08:14:40.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.102+0000 7f27755ff700 1 -- 172.21.15.71:0/2038029948 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27701678d0 con 0x7f2770155c10 2023-10-09T08:14:40.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.103+0000 7f27755ff700 1 -- 172.21.15.71:0/2038029948 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f277004c3c0 con 0x7f2770155c10 2023-10-09T08:14:40.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.104+0000 7f2766ffd700 1 -- 172.21.15.71:0/2038029948 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2768024070 con 0x7f2770155c10 2023-10-09T08:14:40.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.105+0000 7f2766ffd700 1 --2- 172.21.15.71:0/2038029948 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2750066f30 0x7f27500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:40.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.105+0000 7f2766ffd700 1 -- 172.21.15.71:0/2038029948 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f2768087380 con 0x7f2770155c10 2023-10-09T08:14:40.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.105+0000 7f276effd700 1 --2- 172.21.15.71:0/2038029948 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2750066f30 0x7f27500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:40.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.106+0000 7f276effd700 1 --2- 172.21.15.71:0/2038029948 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2750066f30 0x7f27500693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2760006e80 tx=0x7f2760009250 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:40.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.108+0000 7f2766ffd700 1 -- 172.21.15.71:0/2038029948 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27680543e0 con 0x7f2770155c10 2023-10-09T08:14:40.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.302+0000 7f27755ff700 1 -- 172.21.15.71:0/2038029948 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27700ad2e0 con 0x7f2770155c10 2023-10-09T08:14:40.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.304+0000 7f2766ffd700 1 -- 172.21.15.71:0/2038029948 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) v1 ==== 74+0+16133 (secure 0 0 0) 0x7f2768057a00 con 0x7f2770155c10 2023-10-09T08:14:40.305 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:14:40.305 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":193,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T08:14:38.912787+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T08:14:37.033384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T08:14:37.895335+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T08:14:40.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.306+0000 7f27755ff700 1 -- 172.21.15.71:0/2038029948 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2750066f30 msgr2=0x7f27500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:40.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.306+0000 7f27755ff700 1 --2- 172.21.15.71:0/2038029948 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2750066f30 0x7f27500693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2760006e80 tx=0x7f2760009250 comp rx=0 tx=0).stop 2023-10-09T08:14:40.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.306+0000 7f27755ff700 1 -- 172.21.15.71:0/2038029948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2770155c10 msgr2=0x7f27700cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:40.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.306+0000 7f27755ff700 1 --2- 172.21.15.71:0/2038029948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2770155c10 0x7f27700cc690 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2768015000 tx=0x7f2768018000 comp rx=0 tx=0).stop 2023-10-09T08:14:40.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.306+0000 7f27755ff700 1 -- 172.21.15.71:0/2038029948 shutdown_connections 2023-10-09T08:14:40.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.306+0000 7f27755ff700 1 --2- 172.21.15.71:0/2038029948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2770155c10 0x7f27700cc690 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:40.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.306+0000 7f27755ff700 1 --2- 172.21.15.71:0/2038029948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27700ac230 0x7f277015a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:40.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.306+0000 7f27755ff700 1 --2- 172.21.15.71:0/2038029948 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2750066f30 0x7f27500693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:40.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.306+0000 7f27755ff700 1 --2- 172.21.15.71:0/2038029948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27700ac6d0 0x7f27701448d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:40.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.306+0000 7f27755ff700 1 -- 172.21.15.71:0/2038029948 >> 172.21.15.71:0/2038029948 conn(0x7f277006a320 msgr2=0x7f27700ae0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:40.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.306+0000 7f27755ff700 1 -- 172.21.15.71:0/2038029948 shutdown_connections 2023-10-09T08:14:40.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.306+0000 7f27755ff700 1 -- 172.21.15.71:0/2038029948 wait complete. 2023-10-09T08:14:40.325 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T08:14:40.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.508+0000 7f865ffff700 1 Processor -- start 2023-10-09T08:14:40.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.508+0000 7f865ffff700 1 -- start start 2023-10-09T08:14:40.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.510+0000 7f865ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f86580ccee0 0x7f86581561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:40.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.510+0000 7f865ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86580c87c0 0x7f8658156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:40.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.510+0000 7f865ffff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f865815b0d0 con 0x7f86580c83f0 2023-10-09T08:14:40.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.510+0000 7f865ffff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8658156c50 con 0x7f86580ccee0 2023-10-09T08:14:40.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.510+0000 7f865ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865815a4c0 con 0x7f86580c87c0 2023-10-09T08:14:40.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.510+0000 7f865dd9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f86580c83f0 0x7f86580c7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56292/0 (socket says 172.21.15.71:56292) 2023-10-09T08:14:40.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.510+0000 7f865dd9b700 1 -- 172.21.15.71:0/1316369421 learned_addr learned my addr 172.21.15.71:0/1316369421 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:40.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.510+0000 7f865d59a700 1 --2- 172.21.15.71:0/1316369421 >> v2:172.21.15.179:3300/0 conn(0x7f86580ccee0 0x7f86581561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:40.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.510+0000 7f865e59c700 1 --2- 172.21.15.71:0/1316369421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86580c87c0 0x7f8658156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:40.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.510+0000 7f865cd99700 1 -- 172.21.15.71:0/1316369421 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2364420007 0 0) 0x7f865815b0d0 con 0x7f86580c83f0 2023-10-09T08:14:40.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.510+0000 7f865cd99700 1 -- 172.21.15.71:0/1316369421 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8644003570 con 0x7f86580c83f0 2023-10-09T08:14:40.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.511+0000 7f865cd99700 1 -- 172.21.15.71:0/1316369421 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4079958557 0 0) 0x7f8644003570 con 0x7f86580c83f0 2023-10-09T08:14:40.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.511+0000 7f865cd99700 1 -- 172.21.15.71:0/1316369421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86580c87c0 msgr2=0x7f8658156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:40.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.511+0000 7f865cd99700 1 --2- 172.21.15.71:0/1316369421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86580c87c0 0x7f8658156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:40.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.511+0000 7f865cd99700 1 -- 172.21.15.71:0/1316369421 >> v2:172.21.15.179:3300/0 conn(0x7f86580ccee0 msgr2=0x7f86581561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:40.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.511+0000 7f865cd99700 1 --2- 172.21.15.71:0/1316369421 >> v2:172.21.15.179:3300/0 conn(0x7f86580ccee0 0x7f86581561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:40.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.511+0000 7f865cd99700 1 -- 172.21.15.71:0/1316369421 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865815a7a0 con 0x7f86580c83f0 2023-10-09T08:14:40.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.511+0000 7f865cd99700 1 -- 172.21.15.71:0/1316369421 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f8654001470 con 0x7f86580c83f0 2023-10-09T08:14:40.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.511+0000 7f865cd99700 1 -- 172.21.15.71:0/1316369421 >> v1:172.21.15.71:6789/0 conn(0x7f86580c83f0 legacy=0x7f86580c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:40.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.511+0000 7f865cd99700 1 --2- 172.21.15.71:0/1316369421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8644003a60 0x7f8644003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:40.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.511+0000 7f865cd99700 1 --2- 172.21.15.71:0/1316369421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86580c87c0 0x7f8644004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:40.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.511+0000 7f865cd99700 1 --2- 172.21.15.71:0/1316369421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8644004d50 0x7f86440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:40.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.511+0000 7f865cd99700 1 -- 172.21.15.71:0/1316369421 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8658156c50 con 0x7f8644003a60 2023-10-09T08:14:40.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.511+0000 7f865cd99700 1 -- 172.21.15.71:0/1316369421 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865815a4c0 con 0x7f8644004d50 2023-10-09T08:14:40.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.511+0000 7f865cd99700 1 -- 172.21.15.71:0/1316369421 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864400ba60 con 0x7f86580c87c0 2023-10-09T08:14:40.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.511+0000 7f865dd9b700 1 --2- 172.21.15.71:0/1316369421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8644003a60 0x7f8644003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:40.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.511+0000 7f865e59c700 1 --2- 172.21.15.71:0/1316369421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8644004d50 0x7f86440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:40.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.511+0000 7f865d59a700 1 --2- 172.21.15.71:0/1316369421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86580c87c0 0x7f8644004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:40.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.511+0000 7f865dd9b700 1 -- 172.21.15.71:0/1316369421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86580c87c0 msgr2=0x7f8644004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:40.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.511+0000 7f865dd9b700 1 --2- 172.21.15.71:0/1316369421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86580c87c0 0x7f8644004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:40.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.511+0000 7f865dd9b700 1 -- 172.21.15.71:0/1316369421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8644004d50 msgr2=0x7f86440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:40.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.511+0000 7f865dd9b700 1 --2- 172.21.15.71:0/1316369421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8644004d50 0x7f86440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:40.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.511+0000 7f865dd9b700 1 -- 172.21.15.71:0/1316369421 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8644003570 con 0x7f8644003a60 2023-10-09T08:14:40.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.511+0000 7f865e59c700 1 --2- 172.21.15.71:0/1316369421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8644004d50 0x7f86440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:14:40.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.512+0000 7f865dd9b700 1 --2- 172.21.15.71:0/1316369421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8644003a60 0x7f8644003e70 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f865400c3c0 tx=0x7f8654001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc974b062f237624 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:40.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.512+0000 7f865cd99700 1 -- 172.21.15.71:0/1316369421 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865400cc30 con 0x7f8644003a60 2023-10-09T08:14:40.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.512+0000 7f865cd99700 1 -- 172.21.15.71:0/1316369421 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865400cdd0 con 0x7f8644003a60 2023-10-09T08:14:40.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.512+0000 7f865cd99700 1 -- 172.21.15.71:0/1316369421 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654005b70 con 0x7f8644003a60 2023-10-09T08:14:40.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.512+0000 7f865ffff700 1 -- 172.21.15.71:0/1316369421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8644003a60 msgr2=0x7f8644003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:40.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.512+0000 7f865ffff700 1 --2- 172.21.15.71:0/1316369421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8644003a60 0x7f8644003e70 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f865400c3c0 tx=0x7f8654001e90 comp rx=0 tx=0).stop 2023-10-09T08:14:40.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.512+0000 7f865e59c700 1 -- 172.21.15.71:0/1316369421 reap_dead start 2023-10-09T08:14:40.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.513+0000 7f865ffff700 1 -- 172.21.15.71:0/1316369421 shutdown_connections 2023-10-09T08:14:40.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.513+0000 7f865ffff700 1 -- 172.21.15.71:0/1316369421 >> 172.21.15.71:0/1316369421 conn(0x7f8658068e10 msgr2=0x7f86580cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:40.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.513+0000 7f865ffff700 1 -- 172.21.15.71:0/1316369421 shutdown_connections 2023-10-09T08:14:40.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.513+0000 7f865ffff700 1 -- 172.21.15.71:0/1316369421 wait complete. 2023-10-09T08:14:40.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.514+0000 7f865ffff700 1 Processor -- start 2023-10-09T08:14:40.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.514+0000 7f865ffff700 1 -- start start 2023-10-09T08:14:40.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.515+0000 7f865ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8644003a60 0x7f8658160ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:40.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.515+0000 7f865ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8658148020 0x7f8658148490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:40.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.515+0000 7f865ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8658156d90 0x7f86581571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:40.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.515+0000 7f865ffff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8658147500 con 0x7f8658156d90 2023-10-09T08:14:40.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.515+0000 7f865ffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865816a120 con 0x7f8658148020 2023-10-09T08:14:40.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.515+0000 7f865ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86581468c0 con 0x7f8644003a60 2023-10-09T08:14:40.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.515+0000 7f865e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8658156d90 0x7f86581571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:40.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.515+0000 7f865e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8658156d90 0x7f86581571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51226/0 (socket says 172.21.15.71:51226) 2023-10-09T08:14:40.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.515+0000 7f865e59c700 1 -- 172.21.15.71:0/318502981 learned_addr learned my addr 172.21.15.71:0/318502981 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:40.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.515+0000 7f865dd9b700 1 --2- 172.21.15.71:0/318502981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8644003a60 0x7f8658160ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:40.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.515+0000 7f865d59a700 1 --2- 172.21.15.71:0/318502981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8658148020 0x7f8658148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:40.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.516+0000 7f865e59c700 1 -- 172.21.15.71:0/318502981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8644003a60 msgr2=0x7f8658160ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:40.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.516+0000 7f865e59c700 1 --2- 172.21.15.71:0/318502981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8644003a60 0x7f8658160ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:40.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.516+0000 7f865e59c700 1 -- 172.21.15.71:0/318502981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8658148020 msgr2=0x7f8658148490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:40.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.516+0000 7f865e59c700 1 --2- 172.21.15.71:0/318502981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8658148020 0x7f8658148490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:40.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.516+0000 7f865e59c700 1 -- 172.21.15.71:0/318502981 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865815f7c0 con 0x7f8658156d90 2023-10-09T08:14:40.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.516+0000 7f865d59a700 1 --2- 172.21.15.71:0/318502981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8658148020 0x7f8658148490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:14:40.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.516+0000 7f865e59c700 1 --2- 172.21.15.71:0/318502981 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8658156d90 0x7f86581571e0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f865806fdc0 tx=0x7f865000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:40.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.516+0000 7f864dffb700 1 -- 172.21.15.71:0/318502981 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865001b070 con 0x7f8658156d90 2023-10-09T08:14:40.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.516+0000 7f864dffb700 1 -- 172.21.15.71:0/318502981 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865000f040 con 0x7f8658156d90 2023-10-09T08:14:40.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.516+0000 7f864dffb700 1 -- 172.21.15.71:0/318502981 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865000e050 con 0x7f8658156d90 2023-10-09T08:14:40.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.516+0000 7f865ffff700 1 -- 172.21.15.71:0/318502981 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8658160620 con 0x7f8658156d90 2023-10-09T08:14:40.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.516+0000 7f865ffff700 1 -- 172.21.15.71:0/318502981 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f865815fcf0 con 0x7f8658156d90 2023-10-09T08:14:40.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.517+0000 7f865ffff700 1 -- 172.21.15.71:0/318502981 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86581607b0 con 0x7f8658156d90 2023-10-09T08:14:40.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.518+0000 7f864dffb700 1 -- 172.21.15.71:0/318502981 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8650003020 con 0x7f8658156d90 2023-10-09T08:14:40.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.519+0000 7f864dffb700 1 --2- 172.21.15.71:0/318502981 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f863c066f30 0x7f863c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:40.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.520+0000 7f864dffb700 1 -- 172.21.15.71:0/318502981 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f8650084bc0 con 0x7f8658156d90 2023-10-09T08:14:40.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.520+0000 7f865dd9b700 1 --2- 172.21.15.71:0/318502981 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f863c066f30 0x7f863c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:40.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.521+0000 7f865dd9b700 1 --2- 172.21.15.71:0/318502981 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f863c066f30 0x7f863c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f865400c3c0 tx=0x7f8654015000 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:40.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.524+0000 7f864dffb700 1 -- 172.21.15.71:0/318502981 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8650051c40 con 0x7f8658156d90 2023-10-09T08:14:40.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:40.756+0000 7f865ffff700 1 -- 172.21.15.71:0/318502981 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f865815aa80 con 0x7f8658156d90 2023-10-09T08:14:41.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.475+0000 7f864dffb700 1 -- 172.21.15.71:0/318502981 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v88) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8650055260 con 0x7f8658156d90 2023-10-09T08:14:41.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.478+0000 7f865ffff700 1 -- 172.21.15.71:0/318502981 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f863c066f30 msgr2=0x7f863c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:41.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.478+0000 7f865ffff700 1 --2- 172.21.15.71:0/318502981 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f863c066f30 0x7f863c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f865400c3c0 tx=0x7f8654015000 comp rx=0 tx=0).stop 2023-10-09T08:14:41.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.478+0000 7f865ffff700 1 -- 172.21.15.71:0/318502981 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8658156d90 msgr2=0x7f86581571e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:41.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.478+0000 7f865ffff700 1 --2- 172.21.15.71:0/318502981 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8658156d90 0x7f86581571e0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f865806fdc0 tx=0x7f865000b040 comp rx=0 tx=0).stop 2023-10-09T08:14:41.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.478+0000 7f865ffff700 1 -- 172.21.15.71:0/318502981 shutdown_connections 2023-10-09T08:14:41.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.478+0000 7f865ffff700 1 --2- 172.21.15.71:0/318502981 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f863c066f30 0x7f863c0693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:41.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.478+0000 7f865ffff700 1 --2- 172.21.15.71:0/318502981 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8658156d90 0x7f86581571e0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:41.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.478+0000 7f865ffff700 1 --2- 172.21.15.71:0/318502981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8644003a60 0x7f8658160ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:41.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.478+0000 7f865ffff700 1 --2- 172.21.15.71:0/318502981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8658148020 0x7f8658148490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:41.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.478+0000 7f865ffff700 1 -- 172.21.15.71:0/318502981 >> 172.21.15.71:0/318502981 conn(0x7f8658068e10 msgr2=0x7f86580c71a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:41.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.478+0000 7f865ffff700 1 -- 172.21.15.71:0/318502981 shutdown_connections 2023-10-09T08:14:41.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.478+0000 7f865ffff700 1 -- 172.21.15.71:0/318502981 wait complete. 2023-10-09T08:14:41.499 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T08:14:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.685+0000 7f8a721ff700 1 Processor -- start 2023-10-09T08:14:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.685+0000 7f8a721ff700 1 -- start start 2023-10-09T08:14:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.687+0000 7f8a721ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8a6c15ac80 0x7f8a6c069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.687+0000 7f8a721ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8a6c15b050 0x7f8a6c069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.687+0000 7f8a721ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a6c0afa60 0x7f8a6c0afee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.687+0000 7f8a721ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6c0af2f0 con 0x7f8a6c15ac80 2023-10-09T08:14:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.687+0000 7f8a721ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6c0af5d0 con 0x7f8a6c15b050 2023-10-09T08:14:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.687+0000 7f8a721ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c0c8660 con 0x7f8a6c0afa60 2023-10-09T08:14:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.687+0000 7f8a6b7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8a6c15ac80 0x7f8a6c069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.687+0000 7f8a6b7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8a6c15ac80 0x7f8a6c069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51232/0 (socket says 172.21.15.71:51232) 2023-10-09T08:14:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.687+0000 7f8a6b7fe700 1 -- 172.21.15.71:0/1731496371 learned_addr learned my addr 172.21.15.71:0/1731496371 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.687+0000 7f8a6bfff700 1 --2- 172.21.15.71:0/1731496371 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a6c0afa60 0x7f8a6c0afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.687+0000 7f8a6affd700 1 --2- 172.21.15.71:0/1731496371 >> v2:172.21.15.179:3300/0 conn(0x7f8a6c15b050 0x7f8a6c069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.687+0000 7f8a6b7fe700 1 -- 172.21.15.71:0/1731496371 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a6c0afa60 msgr2=0x7f8a6c0afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.687+0000 7f8a6b7fe700 1 --2- 172.21.15.71:0/1731496371 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a6c0afa60 0x7f8a6c0afee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.687+0000 7f8a6b7fe700 1 -- 172.21.15.71:0/1731496371 >> v2:172.21.15.179:3300/0 conn(0x7f8a6c15b050 msgr2=0x7f8a6c069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.687+0000 7f8a6b7fe700 1 --2- 172.21.15.71:0/1731496371 >> v2:172.21.15.179:3300/0 conn(0x7f8a6c15b050 0x7f8a6c069cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.687+0000 7f8a6b7fe700 1 -- 172.21.15.71:0/1731496371 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6c0c8940 con 0x7f8a6c15ac80 2023-10-09T08:14:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.687+0000 7f8a6affd700 1 --2- 172.21.15.71:0/1731496371 >> v2:172.21.15.179:3300/0 conn(0x7f8a6c15b050 0x7f8a6c069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:14:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.688+0000 7f8a6b7fe700 1 --2- 172.21.15.71:0/1731496371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a6c15ac80 0x7f8a6c069770 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0c9fd0 tx=0x7f8a5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20815748150db774 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.688+0000 7f8a6a7fc700 1 -- 172.21.15.71:0/1731496371 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c00b860 con 0x7f8a6c15ac80 2023-10-09T08:14:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.688+0000 7f8a6a7fc700 1 -- 172.21.15.71:0/1731496371 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5c00b9c0 con 0x7f8a6c15ac80 2023-10-09T08:14:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.688+0000 7f8a6a7fc700 1 -- 172.21.15.71:0/1731496371 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c00bd60 con 0x7f8a6c15ac80 2023-10-09T08:14:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.688+0000 7f8a721ff700 1 -- 172.21.15.71:0/1731496371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a6c15ac80 msgr2=0x7f8a6c069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.688+0000 7f8a721ff700 1 --2- 172.21.15.71:0/1731496371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a6c15ac80 0x7f8a6c069770 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0c9fd0 tx=0x7f8a5c009250 comp rx=0 tx=0).stop 2023-10-09T08:14:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.688+0000 7f8a721ff700 1 -- 172.21.15.71:0/1731496371 shutdown_connections 2023-10-09T08:14:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.688+0000 7f8a721ff700 1 --2- 172.21.15.71:0/1731496371 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a6c0afa60 0x7f8a6c0afee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.688+0000 7f8a721ff700 1 --2- 172.21.15.71:0/1731496371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a6c15ac80 0x7f8a6c069770 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.688+0000 7f8a721ff700 1 --2- 172.21.15.71:0/1731496371 >> v2:172.21.15.179:3300/0 conn(0x7f8a6c15b050 0x7f8a6c069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.688+0000 7f8a721ff700 1 -- 172.21.15.71:0/1731496371 >> 172.21.15.71:0/1731496371 conn(0x7f8a6c068e10 msgr2=0x7f8a6c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.689+0000 7f8a721ff700 1 -- 172.21.15.71:0/1731496371 shutdown_connections 2023-10-09T08:14:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.689+0000 7f8a721ff700 1 -- 172.21.15.71:0/1731496371 wait complete. 2023-10-09T08:14:41.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.690+0000 7f8a721ff700 1 Processor -- start 2023-10-09T08:14:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.690+0000 7f8a721ff700 1 -- start start 2023-10-09T08:14:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.691+0000 7f8a721ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a6c0afa60 0x7f8a6c14f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.691+0000 7f8a721ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a6c15ac80 0x7f8a6c14fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.691+0000 7f8a721ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a6c15b050 0x7f8a6c14ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.691+0000 7f8a721ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c14f6f0 con 0x7f8a6c15ac80 2023-10-09T08:14:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.691+0000 7f8a721ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c0ab7d0 con 0x7f8a6c15b050 2023-10-09T08:14:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.691+0000 7f8a721ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c151ce0 con 0x7f8a6c0afa60 2023-10-09T08:14:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.691+0000 7f8a6affd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a6c15ac80 0x7f8a6c14fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.691+0000 7f8a6affd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a6c15ac80 0x7f8a6c14fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51248/0 (socket says 172.21.15.71:51248) 2023-10-09T08:14:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.691+0000 7f8a6affd700 1 -- 172.21.15.71:0/1573960703 learned_addr learned my addr 172.21.15.71:0/1573960703 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.691+0000 7f8a6b7fe700 1 --2- 172.21.15.71:0/1573960703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a6c0afa60 0x7f8a6c14f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.692+0000 7f8a6bfff700 1 --2- 172.21.15.71:0/1573960703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a6c15b050 0x7f8a6c14ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.692+0000 7f8a6affd700 1 -- 172.21.15.71:0/1573960703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a6c0afa60 msgr2=0x7f8a6c14f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.692+0000 7f8a6affd700 1 --2- 172.21.15.71:0/1573960703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a6c0afa60 0x7f8a6c14f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.692+0000 7f8a6affd700 1 -- 172.21.15.71:0/1573960703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a6c15b050 msgr2=0x7f8a6c14ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.692+0000 7f8a6affd700 1 --2- 172.21.15.71:0/1573960703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a6c15b050 0x7f8a6c14ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.692+0000 7f8a6affd700 1 -- 172.21.15.71:0/1573960703 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5c0094f0 con 0x7f8a6c15ac80 2023-10-09T08:14:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.692+0000 7f8a6bfff700 1 --2- 172.21.15.71:0/1573960703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a6c15b050 0x7f8a6c14ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:14:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.692+0000 7f8a6affd700 1 --2- 172.21.15.71:0/1573960703 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a6c15ac80 0x7f8a6c14fa50 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f8a6000c880 tx=0x7f8a60008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.692+0000 7f8a537fe700 1 -- 172.21.15.71:0/1573960703 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a60011600 con 0x7f8a6c15ac80 2023-10-09T08:14:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.692+0000 7f8a537fe700 1 -- 172.21.15.71:0/1573960703 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a60011760 con 0x7f8a6c15ac80 2023-10-09T08:14:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.692+0000 7f8a721ff700 1 -- 172.21.15.71:0/1573960703 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6c1505c0 con 0x7f8a6c15ac80 2023-10-09T08:14:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.692+0000 7f8a537fe700 1 -- 172.21.15.71:0/1573960703 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a60011b00 con 0x7f8a6c15ac80 2023-10-09T08:14:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.693+0000 7f8a721ff700 1 -- 172.21.15.71:0/1573960703 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6c0aba20 con 0x7f8a6c15ac80 2023-10-09T08:14:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.694+0000 7f8a721ff700 1 -- 172.21.15.71:0/1573960703 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a6c0ac070 con 0x7f8a6c15ac80 2023-10-09T08:14:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.694+0000 7f8a537fe700 1 -- 172.21.15.71:0/1573960703 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a60018350 con 0x7f8a6c15ac80 2023-10-09T08:14:41.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.695+0000 7f8a537fe700 1 --2- 172.21.15.71:0/1573960703 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8a58066f30 0x7f8a580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:41.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.695+0000 7f8a537fe700 1 -- 172.21.15.71:0/1573960703 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f8a60084750 con 0x7f8a6c15ac80 2023-10-09T08:14:41.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.696+0000 7f8a6b7fe700 1 --2- 172.21.15.71:0/1573960703 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8a58066f30 0x7f8a580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:41.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.696+0000 7f8a6b7fe700 1 --2- 172.21.15.71:0/1573960703 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8a58066f30 0x7f8a580693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0c9fd0 tx=0x7f8a5c017000 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:41.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.699+0000 7f8a537fe700 1 -- 172.21.15.71:0/1573960703 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a600551c0 con 0x7f8a6c15ac80 2023-10-09T08:14:41.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:41.932+0000 7f8a721ff700 1 -- 172.21.15.71:0/1573960703 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8a6c04c3c0 con 0x7f8a6c15ac80 2023-10-09T08:14:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.483+0000 7f8a537fe700 1 -- 172.21.15.71:0/1573960703 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v89) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8a60054d50 con 0x7f8a6c15ac80 2023-10-09T08:14:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.486+0000 7f8a721ff700 1 -- 172.21.15.71:0/1573960703 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8a58066f30 msgr2=0x7f8a580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.486+0000 7f8a721ff700 1 --2- 172.21.15.71:0/1573960703 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8a58066f30 0x7f8a580693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0c9fd0 tx=0x7f8a5c017000 comp rx=0 tx=0).stop 2023-10-09T08:14:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.486+0000 7f8a721ff700 1 -- 172.21.15.71:0/1573960703 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a6c15ac80 msgr2=0x7f8a6c14fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.486+0000 7f8a721ff700 1 --2- 172.21.15.71:0/1573960703 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a6c15ac80 0x7f8a6c14fa50 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f8a6000c880 tx=0x7f8a60008040 comp rx=0 tx=0).stop 2023-10-09T08:14:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.486+0000 7f8a721ff700 1 -- 172.21.15.71:0/1573960703 shutdown_connections 2023-10-09T08:14:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.486+0000 7f8a721ff700 1 --2- 172.21.15.71:0/1573960703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a6c15b050 0x7f8a6c14ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.486+0000 7f8a721ff700 1 --2- 172.21.15.71:0/1573960703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a6c0afa60 0x7f8a6c14f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.486+0000 7f8a721ff700 1 --2- 172.21.15.71:0/1573960703 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8a58066f30 0x7f8a580693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:42.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.486+0000 7f8a721ff700 1 --2- 172.21.15.71:0/1573960703 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a6c15ac80 0x7f8a6c14fa50 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:42.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.486+0000 7f8a721ff700 1 -- 172.21.15.71:0/1573960703 >> 172.21.15.71:0/1573960703 conn(0x7f8a6c068e10 msgr2=0x7f8a6c06e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:42.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.486+0000 7f8a721ff700 1 -- 172.21.15.71:0/1573960703 shutdown_connections 2023-10-09T08:14:42.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.486+0000 7f8a721ff700 1 -- 172.21.15.71:0/1573960703 wait complete. 2023-10-09T08:14:42.505 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T08:14:42.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.685+0000 7f6d851ff700 1 Processor -- start 2023-10-09T08:14:42.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.685+0000 7f6d851ff700 1 -- start start 2023-10-09T08:14:42.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.685+0000 7f6d851ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6d8006f810 0x7f6d801649f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:42.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.685+0000 7f6d851ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d8006ec70 con 0x7f6d80068920 2023-10-09T08:14:42.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.685+0000 7f6d851ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d800b2e70 con 0x7f6d80068550 2023-10-09T08:14:42.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.685+0000 7f6d851ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d80068d90 con 0x7f6d8006f810 2023-10-09T08:14:42.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.685+0000 7f6d7f59e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6d8006f810 0x7f6d801649f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:42.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.686+0000 7f6d7f59e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6d8006f810 0x7f6d801649f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51264/0 (socket says 172.21.15.71:51264) 2023-10-09T08:14:42.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.686+0000 7f6d7f59e700 1 -- 172.21.15.71:0/1884563024 learned_addr learned my addr 172.21.15.71:0/1884563024 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:42.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.686+0000 7f6d7f59e700 1 -- 172.21.15.71:0/1884563024 >> v1:172.21.15.179:6789/0 conn(0x7f6d80068550 legacy=0x7f6d8015e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:42.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.686+0000 7f6d7f59e700 1 -- 172.21.15.71:0/1884563024 >> v1:172.21.15.71:6789/0 conn(0x7f6d80068920 legacy=0x7f6d8006f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:42.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.686+0000 7f6d7f59e700 1 -- 172.21.15.71:0/1884563024 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d800b3150 con 0x7f6d8006f810 2023-10-09T08:14:42.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.686+0000 7f6d7dd9b700 1 -- 172.21.15.71:0/1884563024 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036693747 0 0) 0x7f6d8006ec70 con 0x7f6d80068920 2023-10-09T08:14:42.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.686+0000 7f6d7f59e700 1 --2- 172.21.15.71:0/1884563024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d8006f810 0x7f6d801649f0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f6d78009f20 tx=0x7f6d78009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25eb7584736b15c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:42.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.686+0000 7f6d7dd9b700 1 -- 172.21.15.71:0/1884563024 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7800e070 con 0x7f6d8006f810 2023-10-09T08:14:42.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.686+0000 7f6d7dd9b700 1 -- 172.21.15.71:0/1884563024 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7800ba80 con 0x7f6d8006f810 2023-10-09T08:14:42.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.686+0000 7f6d7dd9b700 1 -- 172.21.15.71:0/1884563024 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d780092e0 con 0x7f6d8006f810 2023-10-09T08:14:42.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.687+0000 7f6d851ff700 1 -- 172.21.15.71:0/1884563024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d8006f810 msgr2=0x7f6d801649f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:42.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.687+0000 7f6d851ff700 1 --2- 172.21.15.71:0/1884563024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d8006f810 0x7f6d801649f0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f6d78009f20 tx=0x7f6d78009840 comp rx=0 tx=0).stop 2023-10-09T08:14:42.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.687+0000 7f6d851ff700 1 -- 172.21.15.71:0/1884563024 shutdown_connections 2023-10-09T08:14:42.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.687+0000 7f6d851ff700 1 --2- 172.21.15.71:0/1884563024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d8006f810 0x7f6d801649f0 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:42.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.687+0000 7f6d851ff700 1 -- 172.21.15.71:0/1884563024 >> 172.21.15.71:0/1884563024 conn(0x7f6d800cd480 msgr2=0x7f6d800cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:42.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.687+0000 7f6d851ff700 1 -- 172.21.15.71:0/1884563024 shutdown_connections 2023-10-09T08:14:42.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.687+0000 7f6d851ff700 1 -- 172.21.15.71:0/1884563024 wait complete. 2023-10-09T08:14:42.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.688+0000 7f6d851ff700 1 Processor -- start 2023-10-09T08:14:42.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.689+0000 7f6d851ff700 1 -- start start 2023-10-09T08:14:42.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.689+0000 7f6d851ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d80068550 0x7f6d80169a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:42.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.689+0000 7f6d851ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d80068920 0x7f6d8014d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:42.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.689+0000 7f6d851ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d8006f810 0x7f6d801488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:42.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.689+0000 7f6d851ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8016ac70 con 0x7f6d8006f810 2023-10-09T08:14:42.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.689+0000 7f6d851ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d80148e20 con 0x7f6d80068550 2023-10-09T08:14:42.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.689+0000 7f6d851ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8016a0c0 con 0x7f6d80068920 2023-10-09T08:14:42.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.690+0000 7f6d7f59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d8006f810 0x7f6d801488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:42.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.690+0000 7f6d7f59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d8006f810 0x7f6d801488e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51278/0 (socket says 172.21.15.71:51278) 2023-10-09T08:14:42.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.690+0000 7f6d7f59e700 1 -- 172.21.15.71:0/2937524909 learned_addr learned my addr 172.21.15.71:0/2937524909 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:42.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.690+0000 7f6d7ed9d700 1 --2- 172.21.15.71:0/2937524909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d80068550 0x7f6d80169a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:42.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.690+0000 7f6d7f59e700 1 -- 172.21.15.71:0/2937524909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d80068920 msgr2=0x7f6d8014d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:42.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.690+0000 7f6d7e59c700 1 --2- 172.21.15.71:0/2937524909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d80068920 0x7f6d8014d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:42.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.690+0000 7f6d7f59e700 1 --2- 172.21.15.71:0/2937524909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d80068920 0x7f6d8014d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:42.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.690+0000 7f6d7f59e700 1 -- 172.21.15.71:0/2937524909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d80068550 msgr2=0x7f6d80169a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:42.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.690+0000 7f6d7f59e700 1 --2- 172.21.15.71:0/2937524909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d80068550 0x7f6d80169a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:42.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.690+0000 7f6d7f59e700 1 -- 172.21.15.71:0/2937524909 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d78009ae0 con 0x7f6d8006f810 2023-10-09T08:14:42.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.690+0000 7f6d7ed9d700 1 --2- 172.21.15.71:0/2937524909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d80068550 0x7f6d80169a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:14:42.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.690+0000 7f6d7e59c700 1 --2- 172.21.15.71:0/2937524909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d80068920 0x7f6d8014d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:14:42.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.690+0000 7f6d7f59e700 1 --2- 172.21.15.71:0/2937524909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d8006f810 0x7f6d801488e0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f6d78009880 tx=0x7f6d78018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:42.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.691+0000 7f6d66ffd700 1 -- 172.21.15.71:0/2937524909 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78008e40 con 0x7f6d8006f810 2023-10-09T08:14:42.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.691+0000 7f6d66ffd700 1 -- 172.21.15.71:0/2937524909 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d78025460 con 0x7f6d8006f810 2023-10-09T08:14:42.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.691+0000 7f6d851ff700 1 -- 172.21.15.71:0/2937524909 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d8016a3a0 con 0x7f6d8006f810 2023-10-09T08:14:42.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.691+0000 7f6d66ffd700 1 -- 172.21.15.71:0/2937524909 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78025820 con 0x7f6d8006f810 2023-10-09T08:14:42.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.691+0000 7f6d851ff700 1 -- 172.21.15.71:0/2937524909 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d8016a960 con 0x7f6d8006f810 2023-10-09T08:14:42.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.692+0000 7f6d851ff700 1 -- 172.21.15.71:0/2937524909 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d8004c3c0 con 0x7f6d8006f810 2023-10-09T08:14:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.693+0000 7f6d66ffd700 1 -- 172.21.15.71:0/2937524909 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d78003040 con 0x7f6d8006f810 2023-10-09T08:14:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.693+0000 7f6d66ffd700 1 --2- 172.21.15.71:0/2937524909 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6d6c066f30 0x7f6d6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.694+0000 7f6d66ffd700 1 -- 172.21.15.71:0/2937524909 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f6d78085fa0 con 0x7f6d8006f810 2023-10-09T08:14:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.694+0000 7f6d7ed9d700 1 --2- 172.21.15.71:0/2937524909 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6d6c066f30 0x7f6d6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.695+0000 7f6d7ed9d700 1 --2- 172.21.15.71:0/2937524909 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6d6c066f30 0x7f6d6c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6d8006a790 tx=0x7f6d70009040 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:42.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.698+0000 7f6d66ffd700 1 -- 172.21.15.71:0/2937524909 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d78052f80 con 0x7f6d8006f810 2023-10-09T08:14:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.929+0000 7f6d851ff700 1 -- 172.21.15.71:0/2937524909 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d8006c990 con 0x7f6d8006f810 2023-10-09T08:14:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.930+0000 7f6d66ffd700 1 -- 172.21.15.71:0/2937524909 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4592 (secure 0 0 0) 0x7f6d780565a0 con 0x7f6d8006f810 2023-10-09T08:14:42.931 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:14:42.931 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":89,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7919,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/567694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":567694},{"type":"v1","addr":"172.21.15.71:6835","nonce":567694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":9151,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/502575967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":502575967},{"type":"v1","addr":"172.21.15.179:6836","nonce":502575967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":9663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/1425921431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":1425921431},{"type":"v1","addr":"172.21.15.71:6834","nonce":1425921431}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T08:14:38.913123+0000","modified":"2023-10-09T08:14:42.474701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9678},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9678":{"gid":9678,"name":"d","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/1735854447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1735854447},{"type":"v1","addr":"172.21.15.179:6834","nonce":1735854447}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T08:14:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.932+0000 7f6d851ff700 1 -- 172.21.15.71:0/2937524909 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6d6c066f30 msgr2=0x7f6d6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.932+0000 7f6d851ff700 1 --2- 172.21.15.71:0/2937524909 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6d6c066f30 0x7f6d6c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6d8006a790 tx=0x7f6d70009040 comp rx=0 tx=0).stop 2023-10-09T08:14:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.932+0000 7f6d851ff700 1 -- 172.21.15.71:0/2937524909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d8006f810 msgr2=0x7f6d801488e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.932+0000 7f6d851ff700 1 --2- 172.21.15.71:0/2937524909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d8006f810 0x7f6d801488e0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f6d78009880 tx=0x7f6d78018000 comp rx=0 tx=0).stop 2023-10-09T08:14:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.932+0000 7f6d851ff700 1 -- 172.21.15.71:0/2937524909 shutdown_connections 2023-10-09T08:14:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.932+0000 7f6d851ff700 1 --2- 172.21.15.71:0/2937524909 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6d6c066f30 0x7f6d6c0693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.932+0000 7f6d851ff700 1 --2- 172.21.15.71:0/2937524909 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d8006f810 0x7f6d801488e0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.932+0000 7f6d851ff700 1 --2- 172.21.15.71:0/2937524909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d80068550 0x7f6d80169a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.932+0000 7f6d851ff700 1 --2- 172.21.15.71:0/2937524909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d80068920 0x7f6d8014d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.932+0000 7f6d851ff700 1 -- 172.21.15.71:0/2937524909 >> 172.21.15.71:0/2937524909 conn(0x7f6d800cd480 msgr2=0x7f6d80158660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.932+0000 7f6d851ff700 1 -- 172.21.15.71:0/2937524909 shutdown_connections 2023-10-09T08:14:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:42.932+0000 7f6d851ff700 1 -- 172.21.15.71:0/2937524909 wait complete. 2023-10-09T08:14:42.935 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 89 2023-10-09T08:14:42.951 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T08:14:43.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.130+0000 7fdde899d700 1 Processor -- start 2023-10-09T08:14:43.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.130+0000 7fdde899d700 1 -- start start 2023-10-09T08:14:43.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.131+0000 7fdde899d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdde4150550 0x7fdde4157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:43.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.131+0000 7fdde899d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde406e2a0 con 0x7fdde40c7410 2023-10-09T08:14:43.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.131+0000 7fdde899d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde406b2e0 con 0x7fdde4150180 2023-10-09T08:14:43.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.131+0000 7fdde899d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40c78e0 con 0x7fdde4150550 2023-10-09T08:14:43.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.132+0000 7fdde3fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fdde40c7410 0x7fdde4069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56312/0 (socket says 172.21.15.71:56312) 2023-10-09T08:14:43.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.132+0000 7fdde3fff700 1 -- 172.21.15.71:0/3377599128 learned_addr learned my addr 172.21.15.71:0/3377599128 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:43.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.132+0000 7fdde2ffd700 1 --2- 172.21.15.71:0/3377599128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdde4150550 0x7fdde4157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:43.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.132+0000 7fdde27fc700 1 -- 172.21.15.71:0/3377599128 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1344504241 0 0) 0x7fdde406e2a0 con 0x7fdde40c7410 2023-10-09T08:14:43.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.132+0000 7fdde27fc700 1 -- 172.21.15.71:0/3377599128 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddcc003570 con 0x7fdde40c7410 2023-10-09T08:14:43.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.132+0000 7fdde27fc700 1 -- 172.21.15.71:0/3377599128 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 739325111 0 0) 0x7fddcc003570 con 0x7fdde40c7410 2023-10-09T08:14:43.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.132+0000 7fdde27fc700 1 -- 172.21.15.71:0/3377599128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdde4150550 msgr2=0x7fdde4157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:43.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.132+0000 7fdde27fc700 1 --2- 172.21.15.71:0/3377599128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdde4150550 0x7fdde4157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:43.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.132+0000 7fdde27fc700 1 -- 172.21.15.71:0/3377599128 >> v1:172.21.15.179:6789/0 conn(0x7fdde4150180 legacy=0x7fdde40c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:43.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.132+0000 7fdde27fc700 1 -- 172.21.15.71:0/3377599128 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde40c7bc0 con 0x7fdde40c7410 2023-10-09T08:14:43.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.132+0000 7fdde27fc700 1 -- 172.21.15.71:0/3377599128 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fdddc0017f0 con 0x7fdde40c7410 2023-10-09T08:14:43.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.133+0000 7fdde27fc700 1 -- 172.21.15.71:0/3377599128 >> v1:172.21.15.71:6789/0 conn(0x7fdde40c7410 legacy=0x7fdde4069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:43.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.133+0000 7fdde27fc700 1 --2- 172.21.15.71:0/3377599128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddcc003a90 0x7fddcc003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:43.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.133+0000 7fdde27fc700 1 --2- 172.21.15.71:0/3377599128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdde4150550 0x7fddcc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:43.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.133+0000 7fdde27fc700 1 --2- 172.21.15.71:0/3377599128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddcc004d50 0x7fddcc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:43.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.133+0000 7fdde27fc700 1 -- 172.21.15.71:0/3377599128 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40c78e0 con 0x7fddcc004d50 2023-10-09T08:14:43.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.133+0000 7fdde27fc700 1 -- 172.21.15.71:0/3377599128 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc00bb10 con 0x7fddcc003a90 2023-10-09T08:14:43.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.133+0000 7fdde27fc700 1 -- 172.21.15.71:0/3377599128 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc00dee0 con 0x7fdde4150550 2023-10-09T08:14:43.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.133+0000 7fdde3fff700 1 --2- 172.21.15.71:0/3377599128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddcc004d50 0x7fddcc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:43.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.133+0000 7fdde2ffd700 1 --2- 172.21.15.71:0/3377599128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdde4150550 0x7fddcc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:43.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.133+0000 7fdde37fe700 1 --2- 172.21.15.71:0/3377599128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddcc003a90 0x7fddcc003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:43.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.133+0000 7fdde3fff700 1 -- 172.21.15.71:0/3377599128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdde4150550 msgr2=0x7fddcc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:43.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.133+0000 7fdde3fff700 1 --2- 172.21.15.71:0/3377599128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdde4150550 0x7fddcc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:43.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.133+0000 7fdde3fff700 1 -- 172.21.15.71:0/3377599128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddcc003a90 msgr2=0x7fddcc003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:43.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.133+0000 7fdde3fff700 1 --2- 172.21.15.71:0/3377599128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddcc003a90 0x7fddcc003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:43.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.133+0000 7fdde3fff700 1 -- 172.21.15.71:0/3377599128 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc003570 con 0x7fddcc004d50 2023-10-09T08:14:43.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.133+0000 7fdde37fe700 1 --2- 172.21.15.71:0/3377599128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddcc003a90 0x7fddcc003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:14:43.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.134+0000 7fdde3fff700 1 --2- 172.21.15.71:0/3377599128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddcc004d50 0x7fddcc0051c0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fdde40c7810 tx=0x7fdddc002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466cf5ff1d61e78c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:43.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.134+0000 7fdde27fc700 1 -- 172.21.15.71:0/3377599128 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc0070d0 con 0x7fddcc004d50 2023-10-09T08:14:43.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.134+0000 7fdde27fc700 1 -- 172.21.15.71:0/3377599128 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdddc007230 con 0x7fddcc004d50 2023-10-09T08:14:43.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.134+0000 7fdde27fc700 1 -- 172.21.15.71:0/3377599128 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc0075d0 con 0x7fddcc004d50 2023-10-09T08:14:43.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.134+0000 7fdde899d700 1 -- 172.21.15.71:0/3377599128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddcc004d50 msgr2=0x7fddcc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:43.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.134+0000 7fdde899d700 1 --2- 172.21.15.71:0/3377599128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddcc004d50 0x7fddcc0051c0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fdde40c7810 tx=0x7fdddc002170 comp rx=0 tx=0).stop 2023-10-09T08:14:43.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.134+0000 7fdde3fff700 1 -- 172.21.15.71:0/3377599128 reap_dead start 2023-10-09T08:14:43.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.134+0000 7fdde899d700 1 -- 172.21.15.71:0/3377599128 shutdown_connections 2023-10-09T08:14:43.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.134+0000 7fdde899d700 1 -- 172.21.15.71:0/3377599128 >> 172.21.15.71:0/3377599128 conn(0x7fdde40cc1f0 msgr2=0x7fdde40cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:43.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.134+0000 7fdde899d700 1 -- 172.21.15.71:0/3377599128 shutdown_connections 2023-10-09T08:14:43.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.134+0000 7fdde899d700 1 -- 172.21.15.71:0/3377599128 wait complete. 2023-10-09T08:14:43.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.136+0000 7fdde899d700 1 Processor -- start 2023-10-09T08:14:43.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.136+0000 7fdde899d700 1 -- start start 2023-10-09T08:14:43.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.137+0000 7fdde899d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddcc004d50 0x7fdde40af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:43.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.137+0000 7fdde899d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdde40c3860 0x7fdde40c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:43.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.137+0000 7fdde899d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde40c4210 0x7fdde40c4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:43.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.137+0000 7fdde899d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40c4bc0 con 0x7fdde40c4210 2023-10-09T08:14:43.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.137+0000 7fdde899d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde414b5d0 con 0x7fddcc004d50 2023-10-09T08:14:43.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.137+0000 7fdde899d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40c33d0 con 0x7fdde40c3860 2023-10-09T08:14:43.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.137+0000 7fdde3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde40c4210 0x7fdde40c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:43.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.137+0000 7fdde3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde40c4210 0x7fdde40c4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51310/0 (socket says 172.21.15.71:51310) 2023-10-09T08:14:43.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.137+0000 7fdde3fff700 1 -- 172.21.15.71:0/720871580 learned_addr learned my addr 172.21.15.71:0/720871580 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:43.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.137+0000 7fdde2ffd700 1 --2- 172.21.15.71:0/720871580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdde40c3860 0x7fdde40c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:43.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.137+0000 7fdde37fe700 1 --2- 172.21.15.71:0/720871580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddcc004d50 0x7fdde40af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:43.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.137+0000 7fdde3fff700 1 -- 172.21.15.71:0/720871580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdde40c3860 msgr2=0x7fdde40c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:43.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.137+0000 7fdde3fff700 1 --2- 172.21.15.71:0/720871580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdde40c3860 0x7fdde40c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:43.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.137+0000 7fdde3fff700 1 -- 172.21.15.71:0/720871580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddcc004d50 msgr2=0x7fdde40af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:43.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.137+0000 7fdde3fff700 1 --2- 172.21.15.71:0/720871580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddcc004d50 0x7fdde40af950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:43.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.138+0000 7fdde3fff700 1 -- 172.21.15.71:0/720871580 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde40afff0 con 0x7fdde40c4210 2023-10-09T08:14:43.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.138+0000 7fdde3fff700 1 --2- 172.21.15.71:0/720871580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde40c4210 0x7fdde40c4680 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fdddc012000 tx=0x7fdddc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:43.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.138+0000 7fddcb7fe700 1 -- 172.21.15.71:0/720871580 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc023070 con 0x7fdde40c4210 2023-10-09T08:14:43.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.138+0000 7fddcb7fe700 1 -- 172.21.15.71:0/720871580 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdddc007b50 con 0x7fdde40c4210 2023-10-09T08:14:43.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.138+0000 7fddcb7fe700 1 -- 172.21.15.71:0/720871580 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc01e430 con 0x7fdde40c4210 2023-10-09T08:14:43.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.138+0000 7fdde899d700 1 -- 172.21.15.71:0/720871580 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde40b02d0 con 0x7fdde40c4210 2023-10-09T08:14:43.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.138+0000 7fdde899d700 1 -- 172.21.15.71:0/720871580 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde40b0890 con 0x7fdde40c4210 2023-10-09T08:14:43.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.139+0000 7fdde899d700 1 -- 172.21.15.71:0/720871580 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde40c3560 con 0x7fdde40c4210 2023-10-09T08:14:43.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.140+0000 7fddcb7fe700 1 -- 172.21.15.71:0/720871580 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdddc01e7a0 con 0x7fdde40c4210 2023-10-09T08:14:43.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.141+0000 7fddcb7fe700 1 --2- 172.21.15.71:0/720871580 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fddd0066f30 0x7fddd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:43.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.141+0000 7fddcb7fe700 1 -- 172.21.15.71:0/720871580 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6197+0+0 (secure 0 0 0) 0x7fdddc085d30 con 0x7fdde40c4210 2023-10-09T08:14:43.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.141+0000 7fdde37fe700 1 --2- 172.21.15.71:0/720871580 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fddd0066f30 0x7fddd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:43.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.142+0000 7fdde37fe700 1 --2- 172.21.15.71:0/720871580 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fddd0066f30 0x7fddd00693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fddd4000c00 tx=0x7fddd400c040 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:43.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.146+0000 7fddcb7fe700 1 -- 172.21.15.71:0/720871580 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdddc052db0 con 0x7fdde40c4210 2023-10-09T08:14:43.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.335+0000 7fdde899d700 1 -- 172.21.15.71:0/720871580 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdde404c3c0 con 0x7fdde40c4210 2023-10-09T08:14:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.336+0000 7fddcb7fe700 1 -- 172.21.15.71:0/720871580 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) v1 ==== 74+0+16120 (secure 0 0 0) 0x7fdddc01cea0 con 0x7fdde40c4210 2023-10-09T08:14:43.336 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:14:43.337 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":194,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T08:14:40.462648+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T08:14:37.033384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T08:14:37.895335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T08:14:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.339+0000 7fdde899d700 1 -- 172.21.15.71:0/720871580 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fddd0066f30 msgr2=0x7fddd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.339+0000 7fdde899d700 1 --2- 172.21.15.71:0/720871580 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fddd0066f30 0x7fddd00693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fddd4000c00 tx=0x7fddd400c040 comp rx=0 tx=0).stop 2023-10-09T08:14:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.339+0000 7fdde899d700 1 -- 172.21.15.71:0/720871580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde40c4210 msgr2=0x7fdde40c4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.339+0000 7fdde899d700 1 --2- 172.21.15.71:0/720871580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde40c4210 0x7fdde40c4680 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fdddc012000 tx=0x7fdddc016000 comp rx=0 tx=0).stop 2023-10-09T08:14:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.339+0000 7fdde899d700 1 -- 172.21.15.71:0/720871580 shutdown_connections 2023-10-09T08:14:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.339+0000 7fdde899d700 1 --2- 172.21.15.71:0/720871580 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fddd0066f30 0x7fddd00693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.339+0000 7fdde899d700 1 --2- 172.21.15.71:0/720871580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde40c4210 0x7fdde40c4680 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.339+0000 7fdde899d700 1 --2- 172.21.15.71:0/720871580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddcc004d50 0x7fdde40af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.339+0000 7fdde899d700 1 --2- 172.21.15.71:0/720871580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdde40c3860 0x7fdde40c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.339+0000 7fdde899d700 1 -- 172.21.15.71:0/720871580 >> 172.21.15.71:0/720871580 conn(0x7fdde40cc1f0 msgr2=0x7fdde40696c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.339+0000 7fdde899d700 1 -- 172.21.15.71:0/720871580 shutdown_connections 2023-10-09T08:14:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.339+0000 7fdde899d700 1 -- 172.21.15.71:0/720871580 wait complete. 2023-10-09T08:14:43.357 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T08:14:43.357 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T08:14:43.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.539+0000 7f7601f9d700 1 Processor -- start 2023-10-09T08:14:43.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.539+0000 7f7601f9d700 1 -- start start 2023-10-09T08:14:43.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.540+0000 7f7601f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75fc1593b0 0x7f75fc159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:43.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.540+0000 7f7601f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f75fc0ceaa0 0x7f75fc0b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:43.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.540+0000 7f7601f9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f75fc0b1740 0x7f75fc0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:43.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.540+0000 7f7601f9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75fc0b2100 con 0x7f75fc0b1740 2023-10-09T08:14:43.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.540+0000 7f7601f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75fc0b6570 con 0x7f75fc0ceaa0 2023-10-09T08:14:43.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.540+0000 7f7601f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc0cfe20 con 0x7f75fc1593b0 2023-10-09T08:14:43.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.540+0000 7f760179c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f75fc0b1740 0x7f75fc0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:43.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.540+0000 7f760179c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f75fc0b1740 0x7f75fc0b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51324/0 (socket says 172.21.15.71:51324) 2023-10-09T08:14:43.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.540+0000 7f760179c700 1 -- 172.21.15.71:0/2560635236 learned_addr learned my addr 172.21.15.71:0/2560635236 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:43.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.541+0000 7f7600f9b700 1 --2- 172.21.15.71:0/2560635236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75fc1593b0 0x7f75fc159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:43.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.541+0000 7f75fbfff700 1 --2- 172.21.15.71:0/2560635236 >> v2:172.21.15.179:3300/0 conn(0x7f75fc0ceaa0 0x7f75fc0b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:43.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.541+0000 7f760179c700 1 -- 172.21.15.71:0/2560635236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75fc1593b0 msgr2=0x7f75fc159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:43.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.541+0000 7f760179c700 1 --2- 172.21.15.71:0/2560635236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75fc1593b0 0x7f75fc159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:43.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.541+0000 7f760179c700 1 -- 172.21.15.71:0/2560635236 >> v2:172.21.15.179:3300/0 conn(0x7f75fc0ceaa0 msgr2=0x7f75fc0b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:43.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.541+0000 7f760179c700 1 --2- 172.21.15.71:0/2560635236 >> v2:172.21.15.179:3300/0 conn(0x7f75fc0ceaa0 0x7f75fc0b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:43.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.541+0000 7f760179c700 1 -- 172.21.15.71:0/2560635236 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc0cf210 con 0x7f75fc0b1740 2023-10-09T08:14:43.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.541+0000 7f760179c700 1 --2- 172.21.15.71:0/2560635236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75fc0b1740 0x7f75fc0b1bc0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f75fc070d90 tx=0x7f75f4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c66a2d7fb3c5d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:43.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.541+0000 7f75fb7fe700 1 -- 172.21.15.71:0/2560635236 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f400e070 con 0x7f75fc0b1740 2023-10-09T08:14:43.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.541+0000 7f75fb7fe700 1 -- 172.21.15.71:0/2560635236 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f400ba50 con 0x7f75fc0b1740 2023-10-09T08:14:43.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.541+0000 7f75fb7fe700 1 -- 172.21.15.71:0/2560635236 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f40092e0 con 0x7f75fc0b1740 2023-10-09T08:14:43.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.542+0000 7f7601f9d700 1 -- 172.21.15.71:0/2560635236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75fc0b1740 msgr2=0x7f75fc0b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:43.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.542+0000 7f7601f9d700 1 --2- 172.21.15.71:0/2560635236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75fc0b1740 0x7f75fc0b1bc0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f75fc070d90 tx=0x7f75f4009840 comp rx=0 tx=0).stop 2023-10-09T08:14:43.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.542+0000 7f7601f9d700 1 -- 172.21.15.71:0/2560635236 shutdown_connections 2023-10-09T08:14:43.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.542+0000 7f7601f9d700 1 --2- 172.21.15.71:0/2560635236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75fc0b1740 0x7f75fc0b1bc0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:43.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.542+0000 7f7601f9d700 1 --2- 172.21.15.71:0/2560635236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75fc1593b0 0x7f75fc159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:43.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.542+0000 7f7601f9d700 1 --2- 172.21.15.71:0/2560635236 >> v2:172.21.15.179:3300/0 conn(0x7f75fc0ceaa0 0x7f75fc0b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:43.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.542+0000 7f7601f9d700 1 -- 172.21.15.71:0/2560635236 >> 172.21.15.71:0/2560635236 conn(0x7f75fc0d1130 msgr2=0x7f75fc0b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:43.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.542+0000 7f7601f9d700 1 -- 172.21.15.71:0/2560635236 shutdown_connections 2023-10-09T08:14:43.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.542+0000 7f7601f9d700 1 -- 172.21.15.71:0/2560635236 wait complete. 2023-10-09T08:14:43.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.543+0000 7f7601f9d700 1 Processor -- start 2023-10-09T08:14:43.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.544+0000 7f7601f9d700 1 -- start start 2023-10-09T08:14:43.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.544+0000 7f7601f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75fc0b1740 0x7f75fc0c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:43.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.545+0000 7f7601f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75fc0ceaa0 0x7f75fc0c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:43.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.545+0000 7f7601f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75fc1593b0 0x7f75fc15f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:43.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.545+0000 7f7601f9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc16aad0 con 0x7f75fc1593b0 2023-10-09T08:14:43.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.545+0000 7f7601f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc16a7f0 con 0x7f75fc0ceaa0 2023-10-09T08:14:43.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.545+0000 7f7601f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc0c5530 con 0x7f75fc0b1740 2023-10-09T08:14:43.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.545+0000 7f760179c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75fc1593b0 0x7f75fc15f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:43.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.545+0000 7f760179c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75fc1593b0 0x7f75fc15f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51340/0 (socket says 172.21.15.71:51340) 2023-10-09T08:14:43.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.545+0000 7f760179c700 1 -- 172.21.15.71:0/4269418715 learned_addr learned my addr 172.21.15.71:0/4269418715 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:43.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.545+0000 7f7600f9b700 1 --2- 172.21.15.71:0/4269418715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75fc0b1740 0x7f75fc0c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:43.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.545+0000 7f75fbfff700 1 --2- 172.21.15.71:0/4269418715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75fc0ceaa0 0x7f75fc0c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:43.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.545+0000 7f760179c700 1 -- 172.21.15.71:0/4269418715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75fc0b1740 msgr2=0x7f75fc0c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:43.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.545+0000 7f760179c700 1 --2- 172.21.15.71:0/4269418715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75fc0b1740 0x7f75fc0c6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:43.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.545+0000 7f760179c700 1 -- 172.21.15.71:0/4269418715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75fc0ceaa0 msgr2=0x7f75fc0c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:43.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.545+0000 7f760179c700 1 --2- 172.21.15.71:0/4269418715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75fc0ceaa0 0x7f75fc0c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:43.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.545+0000 7f760179c700 1 -- 172.21.15.71:0/4269418715 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f4009ae0 con 0x7f75fc1593b0 2023-10-09T08:14:43.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.546+0000 7f760179c700 1 --2- 172.21.15.71:0/4269418715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75fc1593b0 0x7f75fc15f340 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f75fc06fe00 tx=0x7f75f4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:43.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.546+0000 7f75f8ff9700 1 -- 172.21.15.71:0/4269418715 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f40094e0 con 0x7f75fc1593b0 2023-10-09T08:14:43.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.546+0000 7f75f8ff9700 1 -- 172.21.15.71:0/4269418715 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f40032f0 con 0x7f75fc1593b0 2023-10-09T08:14:43.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.546+0000 7f75f8ff9700 1 -- 172.21.15.71:0/4269418715 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f4026690 con 0x7f75fc1593b0 2023-10-09T08:14:43.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.546+0000 7f7601f9d700 1 -- 172.21.15.71:0/4269418715 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75fc0c5810 con 0x7f75fc1593b0 2023-10-09T08:14:43.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.546+0000 7f7601f9d700 1 -- 172.21.15.71:0/4269418715 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75fc15f880 con 0x7f75fc1593b0 2023-10-09T08:14:43.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.547+0000 7f7601f9d700 1 -- 172.21.15.71:0/4269418715 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75fc04c3c0 con 0x7f75fc1593b0 2023-10-09T08:14:43.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.548+0000 7f75f8ff9700 1 -- 172.21.15.71:0/4269418715 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f75f4003040 con 0x7f75fc1593b0 2023-10-09T08:14:43.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.549+0000 7f75f8ff9700 1 --2- 172.21.15.71:0/4269418715 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f75e0066f30 0x7f75e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:43.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.549+0000 7f75f8ff9700 1 -- 172.21.15.71:0/4269418715 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f75f40867d0 con 0x7f75fc1593b0 2023-10-09T08:14:43.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.549+0000 7f7600f9b700 1 --2- 172.21.15.71:0/4269418715 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f75e0066f30 0x7f75e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:43.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.550+0000 7f7600f9b700 1 --2- 172.21.15.71:0/4269418715 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f75e0066f30 0x7f75e00693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0c8e90 tx=0x7f75f0008040 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:43.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.553+0000 7f75f8ff9700 1 -- 172.21.15.71:0/4269418715 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f75f40537b0 con 0x7f75fc1593b0 2023-10-09T08:14:43.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.742+0000 7f7601f9d700 1 -- 172.21.15.71:0/4269418715 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75fc0cf4f0 con 0x7f75e0066f30 2023-10-09T08:14:43.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.753+0000 7f75f8ff9700 1 -- 172.21.15.71:0/4269418715 <== mgr.8965 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283647 (secure 0 0 0) 0x7f75fc0cf4f0 con 0x7f75e0066f30 2023-10-09T08:14:43.757 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:14:43.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.757+0000 7f7601f9d700 1 -- 172.21.15.71:0/4269418715 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f75e0066f30 msgr2=0x7f75e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:43.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.757+0000 7f7601f9d700 1 --2- 172.21.15.71:0/4269418715 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f75e0066f30 0x7f75e00693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0c8e90 tx=0x7f75f0008040 comp rx=0 tx=0).stop 2023-10-09T08:14:43.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.757+0000 7f7601f9d700 1 -- 172.21.15.71:0/4269418715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75fc1593b0 msgr2=0x7f75fc15f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:43.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.757+0000 7f7601f9d700 1 --2- 172.21.15.71:0/4269418715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75fc1593b0 0x7f75fc15f340 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f75fc06fe00 tx=0x7f75f4018000 comp rx=0 tx=0).stop 2023-10-09T08:14:43.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.757+0000 7f7601f9d700 1 -- 172.21.15.71:0/4269418715 shutdown_connections 2023-10-09T08:14:43.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.757+0000 7f7601f9d700 1 --2- 172.21.15.71:0/4269418715 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f75e0066f30 0x7f75e00693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:43.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.757+0000 7f7601f9d700 1 --2- 172.21.15.71:0/4269418715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75fc1593b0 0x7f75fc15f340 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:43.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.757+0000 7f7601f9d700 1 --2- 172.21.15.71:0/4269418715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75fc0b1740 0x7f75fc0c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:43.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.757+0000 7f7601f9d700 1 --2- 172.21.15.71:0/4269418715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75fc0ceaa0 0x7f75fc0c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:43.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.757+0000 7f7601f9d700 1 -- 172.21.15.71:0/4269418715 >> 172.21.15.71:0/4269418715 conn(0x7f75fc0d1130 msgr2=0x7f75fc0b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:43.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.758+0000 7f7601f9d700 1 -- 172.21.15.71:0/4269418715 shutdown_connections 2023-10-09T08:14:43.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.758+0000 7f7601f9d700 1 -- 172.21.15.71:0/4269418715 wait complete. 2023-10-09T08:14:43.761 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T08:14:43.775 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T08:14:43.140714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591082,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":551,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":336,"ondisk_log_size":336,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2484300,"kb_used_data":19980,"kb_used_omap":0,"kb_used_meta":2464256,"kb_avail":752490420,"statfs":{"total":773094113280,"available":770550190080,"internally_reserved":0,"allocated":20459520,"data_stored":10859085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2523398144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":714,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.704517"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.484338+0000","last_change":"2023-10-09T08:14:39.481559+0000","last_active":"2023-10-09T08:14:39.484338+0000","last_peered":"2023-10-09T08:14:39.484338+0000","last_clean":"2023-10-09T08:14:39.484338+0000","last_became_active":"2023-10-09T08:14:39.481257+0000","last_became_peered":"2023-10-09T08:14:39.481257+0000","last_unstale":"2023-10-09T08:14:39.484338+0000","last_undegraded":"2023-10-09T08:14:39.484338+0000","last_fullsized":"2023-10-09T08:14:39.484338+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:47.340414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.483532+0000","last_change":"2023-10-09T08:14:39.479211+0000","last_active":"2023-10-09T08:14:39.483532+0000","last_peered":"2023-10-09T08:14:39.483532+0000","last_clean":"2023-10-09T08:14:39.483532+0000","last_became_active":"2023-10-09T08:14:39.478472+0000","last_became_peered":"2023-10-09T08:14:39.478472+0000","last_unstale":"2023-10-09T08:14:39.483532+0000","last_undegraded":"2023-10-09T08:14:39.483532+0000","last_fullsized":"2023-10-09T08:14:39.483532+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:37:42.156487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.487669+0000","last_change":"2023-10-09T08:14:39.486690+0000","last_active":"2023-10-09T08:14:39.487669+0000","last_peered":"2023-10-09T08:14:39.487669+0000","last_clean":"2023-10-09T08:14:39.487669+0000","last_became_active":"2023-10-09T08:14:39.486410+0000","last_became_peered":"2023-10-09T08:14:39.486410+0000","last_unstale":"2023-10-09T08:14:39.487669+0000","last_undegraded":"2023-10-09T08:14:39.487669+0000","last_fullsized":"2023-10-09T08:14:39.487669+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:30.404764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481865+0000","last_change":"2023-10-09T08:14:39.479153+0000","last_active":"2023-10-09T08:14:39.481865+0000","last_peered":"2023-10-09T08:14:39.481865+0000","last_clean":"2023-10-09T08:14:39.481865+0000","last_became_active":"2023-10-09T08:14:39.478895+0000","last_became_peered":"2023-10-09T08:14:39.478895+0000","last_unstale":"2023-10-09T08:14:39.481865+0000","last_undegraded":"2023-10-09T08:14:39.481865+0000","last_fullsized":"2023-10-09T08:14:39.481865+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:40.161626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481640+0000","last_change":"2023-10-09T08:14:39.477874+0000","last_active":"2023-10-09T08:14:39.481640+0000","last_peered":"2023-10-09T08:14:39.481640+0000","last_clean":"2023-10-09T08:14:39.481640+0000","last_became_active":"2023-10-09T08:14:39.477475+0000","last_became_peered":"2023-10-09T08:14:39.477475+0000","last_unstale":"2023-10-09T08:14:39.481640+0000","last_undegraded":"2023-10-09T08:14:39.481640+0000","last_fullsized":"2023-10-09T08:14:39.481640+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:50:38.316596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.484420+0000","last_change":"2023-10-09T08:14:39.481354+0000","last_active":"2023-10-09T08:14:39.484420+0000","last_peered":"2023-10-09T08:14:39.484420+0000","last_clean":"2023-10-09T08:14:39.484420+0000","last_became_active":"2023-10-09T08:14:39.481092+0000","last_became_peered":"2023-10-09T08:14:39.481092+0000","last_unstale":"2023-10-09T08:14:39.484420+0000","last_undegraded":"2023-10-09T08:14:39.484420+0000","last_fullsized":"2023-10-09T08:14:39.484420+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:50.399165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478600+0000","last_change":"2023-10-09T08:14:39.471598+0000","last_active":"2023-10-09T08:14:39.478600+0000","last_peered":"2023-10-09T08:14:39.478600+0000","last_clean":"2023-10-09T08:14:39.478600+0000","last_became_active":"2023-10-09T08:14:39.471342+0000","last_became_peered":"2023-10-09T08:14:39.471342+0000","last_unstale":"2023-10-09T08:14:39.478600+0000","last_undegraded":"2023-10-09T08:14:39.478600+0000","last_fullsized":"2023-10-09T08:14:39.478600+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:18:14.449986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.488248+0000","last_change":"2023-10-09T08:14:39.487286+0000","last_active":"2023-10-09T08:14:39.488248+0000","last_peered":"2023-10-09T08:14:39.488248+0000","last_clean":"2023-10-09T08:14:39.488248+0000","last_became_active":"2023-10-09T08:14:39.486306+0000","last_became_peered":"2023-10-09T08:14:39.486306+0000","last_unstale":"2023-10-09T08:14:39.488248+0000","last_undegraded":"2023-10-09T08:14:39.488248+0000","last_fullsized":"2023-10-09T08:14:39.488248+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:54.313934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.477409+0000","last_change":"2023-10-09T08:14:39.471677+0000","last_active":"2023-10-09T08:14:39.477409+0000","last_peered":"2023-10-09T08:14:39.477409+0000","last_clean":"2023-10-09T08:14:39.477409+0000","last_became_active":"2023-10-09T08:14:39.471412+0000","last_became_peered":"2023-10-09T08:14:39.471412+0000","last_unstale":"2023-10-09T08:14:39.477409+0000","last_undegraded":"2023-10-09T08:14:39.477409+0000","last_fullsized":"2023-10-09T08:14:39.477409+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:15:48.546235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.483651+0000","last_change":"2023-10-09T08:14:39.480496+0000","last_active":"2023-10-09T08:14:39.483651+0000","last_peered":"2023-10-09T08:14:39.483651+0000","last_clean":"2023-10-09T08:14:39.483651+0000","last_became_active":"2023-10-09T08:14:39.479949+0000","last_became_peered":"2023-10-09T08:14:39.479949+0000","last_unstale":"2023-10-09T08:14:39.483651+0000","last_undegraded":"2023-10-09T08:14:39.483651+0000","last_fullsized":"2023-10-09T08:14:39.483651+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:16.219371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.482772+0000","last_change":"2023-10-09T08:14:39.479390+0000","last_active":"2023-10-09T08:14:39.482772+0000","last_peered":"2023-10-09T08:14:39.482772+0000","last_clean":"2023-10-09T08:14:39.482772+0000","last_became_active":"2023-10-09T08:14:39.479115+0000","last_became_peered":"2023-10-09T08:14:39.479115+0000","last_unstale":"2023-10-09T08:14:39.482772+0000","last_undegraded":"2023-10-09T08:14:39.482772+0000","last_fullsized":"2023-10-09T08:14:39.482772+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:40.161626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.479656+0000","last_change":"2023-10-09T08:14:39.471497+0000","last_active":"2023-10-09T08:14:39.479656+0000","last_peered":"2023-10-09T08:14:39.479656+0000","last_clean":"2023-10-09T08:14:39.479656+0000","last_became_active":"2023-10-09T08:14:39.471197+0000","last_became_peered":"2023-10-09T08:14:39.471197+0000","last_unstale":"2023-10-09T08:14:39.479656+0000","last_undegraded":"2023-10-09T08:14:39.479656+0000","last_fullsized":"2023-10-09T08:14:39.479656+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:36:19.307671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.482753+0000","last_change":"2023-10-09T08:14:39.478983+0000","last_active":"2023-10-09T08:14:39.482753+0000","last_peered":"2023-10-09T08:14:39.482753+0000","last_clean":"2023-10-09T08:14:39.482753+0000","last_became_active":"2023-10-09T08:14:39.478606+0000","last_became_peered":"2023-10-09T08:14:39.478606+0000","last_unstale":"2023-10-09T08:14:39.482753+0000","last_undegraded":"2023-10-09T08:14:39.482753+0000","last_fullsized":"2023-10-09T08:14:39.482753+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:41:47.263574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"193'4","reported_seq":14,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.495194+0000","last_change":"2023-10-09T08:14:38.465359+0000","last_active":"2023-10-09T08:14:39.495194+0000","last_peered":"2023-10-09T08:14:39.495194+0000","last_clean":"2023-10-09T08:14:39.495194+0000","last_became_active":"2023-10-09T08:14:38.465002+0000","last_became_peered":"2023-10-09T08:14:38.465002+0000","last_unstale":"2023-10-09T08:14:39.495194+0000","last_undegraded":"2023-10-09T08:14:39.495194+0000","last_fullsized":"2023-10-09T08:14:39.495194+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:33.507990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.439638+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:33:50.063332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.483599+0000","last_change":"2023-10-09T08:14:39.479813+0000","last_active":"2023-10-09T08:14:39.483599+0000","last_peered":"2023-10-09T08:14:39.483599+0000","last_clean":"2023-10-09T08:14:39.483599+0000","last_became_active":"2023-10-09T08:14:39.479545+0000","last_became_peered":"2023-10-09T08:14:39.479545+0000","last_unstale":"2023-10-09T08:14:39.483599+0000","last_undegraded":"2023-10-09T08:14:39.483599+0000","last_fullsized":"2023-10-09T08:14:39.483599+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:53:08.718144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.443106+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:04.853104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.442885+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:42:18.010272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481665+0000","last_change":"2023-10-09T08:14:39.476822+0000","last_active":"2023-10-09T08:14:39.481665+0000","last_peered":"2023-10-09T08:14:39.481665+0000","last_clean":"2023-10-09T08:14:39.481665+0000","last_became_active":"2023-10-09T08:14:39.476504+0000","last_became_peered":"2023-10-09T08:14:39.476504+0000","last_unstale":"2023-10-09T08:14:39.481665+0000","last_undegraded":"2023-10-09T08:14:39.481665+0000","last_fullsized":"2023-10-09T08:14:39.481665+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:34:27.759607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.438960+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:46:35.474237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.443521+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:53:13.999052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.444162+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:43:56.605169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478136+0000","last_change":"2023-10-09T08:14:39.477068+0000","last_active":"2023-10-09T08:14:39.478136+0000","last_peered":"2023-10-09T08:14:39.478136+0000","last_clean":"2023-10-09T08:14:39.478136+0000","last_became_active":"2023-10-09T08:14:39.476231+0000","last_became_peered":"2023-10-09T08:14:39.476231+0000","last_unstale":"2023-10-09T08:14:39.478136+0000","last_undegraded":"2023-10-09T08:14:39.478136+0000","last_fullsized":"2023-10-09T08:14:39.478136+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:09.352022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.465583+0000","last_change":"2023-10-09T08:14:38.447789+0000","last_active":"2023-10-09T08:14:39.465583+0000","last_peered":"2023-10-09T08:14:39.465583+0000","last_clean":"2023-10-09T08:14:39.465583+0000","last_became_active":"2023-10-09T08:14:38.447539+0000","last_became_peered":"2023-10-09T08:14:38.447539+0000","last_unstale":"2023-10-09T08:14:39.465583+0000","last_undegraded":"2023-10-09T08:14:39.465583+0000","last_fullsized":"2023-10-09T08:14:39.465583+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:32.622711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.475100+0000","last_change":"2023-10-09T08:14:39.469756+0000","last_active":"2023-10-09T08:14:39.475100+0000","last_peered":"2023-10-09T08:14:39.475100+0000","last_clean":"2023-10-09T08:14:39.475100+0000","last_became_active":"2023-10-09T08:14:39.469509+0000","last_became_peered":"2023-10-09T08:14:39.469509+0000","last_unstale":"2023-10-09T08:14:39.475100+0000","last_undegraded":"2023-10-09T08:14:39.475100+0000","last_fullsized":"2023-10-09T08:14:39.475100+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:37.888301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.462786+0000","last_change":"2023-10-09T08:14:38.464801+0000","last_active":"2023-10-09T08:14:39.462786+0000","last_peered":"2023-10-09T08:14:39.462786+0000","last_clean":"2023-10-09T08:14:39.462786+0000","last_became_active":"2023-10-09T08:14:38.464474+0000","last_became_peered":"2023-10-09T08:14:38.464474+0000","last_unstale":"2023-10-09T08:14:39.462786+0000","last_undegraded":"2023-10-09T08:14:39.462786+0000","last_fullsized":"2023-10-09T08:14:39.462786+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:30:52.549825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.475065+0000","last_change":"2023-10-09T08:14:39.470159+0000","last_active":"2023-10-09T08:14:39.475065+0000","last_peered":"2023-10-09T08:14:39.475065+0000","last_clean":"2023-10-09T08:14:39.475065+0000","last_became_active":"2023-10-09T08:14:39.469401+0000","last_became_peered":"2023-10-09T08:14:39.469401+0000","last_unstale":"2023-10-09T08:14:39.475065+0000","last_undegraded":"2023-10-09T08:14:39.475065+0000","last_fullsized":"2023-10-09T08:14:39.475065+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:57.535414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"193'3","reported_seq":13,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.493087+0000","last_change":"2023-10-09T08:14:38.454895+0000","last_active":"2023-10-09T08:14:39.493087+0000","last_peered":"2023-10-09T08:14:39.493087+0000","last_clean":"2023-10-09T08:14:39.493087+0000","last_became_active":"2023-10-09T08:14:38.451818+0000","last_became_peered":"2023-10-09T08:14:38.451818+0000","last_unstale":"2023-10-09T08:14:39.493087+0000","last_undegraded":"2023-10-09T08:14:39.493087+0000","last_fullsized":"2023-10-09T08:14:39.493087+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:48:52.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.438696+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:15:47.540584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.479006+0000","last_change":"2023-10-09T08:14:39.473198+0000","last_active":"2023-10-09T08:14:39.479006+0000","last_peered":"2023-10-09T08:14:39.479006+0000","last_clean":"2023-10-09T08:14:39.479006+0000","last_became_active":"2023-10-09T08:14:39.472951+0000","last_became_peered":"2023-10-09T08:14:39.472951+0000","last_unstale":"2023-10-09T08:14:39.479006+0000","last_undegraded":"2023-10-09T08:14:39.479006+0000","last_fullsized":"2023-10-09T08:14:39.479006+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:00:37.618868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.443568+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:40.728510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.474301+0000","last_change":"2023-10-09T08:14:39.472462+0000","last_active":"2023-10-09T08:14:39.474301+0000","last_peered":"2023-10-09T08:14:39.474301+0000","last_clean":"2023-10-09T08:14:39.474301+0000","last_became_active":"2023-10-09T08:14:39.472162+0000","last_became_peered":"2023-10-09T08:14:39.472162+0000","last_unstale":"2023-10-09T08:14:39.474301+0000","last_undegraded":"2023-10-09T08:14:39.474301+0000","last_fullsized":"2023-10-09T08:14:39.474301+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:56.539162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.460955+0000","last_change":"2023-10-09T08:14:38.454099+0000","last_active":"2023-10-09T08:14:39.460955+0000","last_peered":"2023-10-09T08:14:39.460955+0000","last_clean":"2023-10-09T08:14:39.460955+0000","last_became_active":"2023-10-09T08:14:38.453858+0000","last_became_peered":"2023-10-09T08:14:38.453858+0000","last_unstale":"2023-10-09T08:14:39.460955+0000","last_undegraded":"2023-10-09T08:14:39.460955+0000","last_fullsized":"2023-10-09T08:14:39.460955+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:56:35.959943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.442334+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:46:35.474237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.440947+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:10:08.446919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.438589+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:03.250581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.475117+0000","last_change":"2023-10-09T08:14:39.470353+0000","last_active":"2023-10-09T08:14:39.475117+0000","last_peered":"2023-10-09T08:14:39.475117+0000","last_clean":"2023-10-09T08:14:39.475117+0000","last_became_active":"2023-10-09T08:14:39.470030+0000","last_became_peered":"2023-10-09T08:14:39.470030+0000","last_unstale":"2023-10-09T08:14:39.475117+0000","last_undegraded":"2023-10-09T08:14:39.475117+0000","last_fullsized":"2023-10-09T08:14:39.475117+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:11.741936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.440835+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:42:18.010272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"193'1","reported_seq":11,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.494014+0000","last_change":"2023-10-09T08:14:38.454927+0000","last_active":"2023-10-09T08:14:39.494014+0000","last_peered":"2023-10-09T08:14:39.494014+0000","last_clean":"2023-10-09T08:14:39.494014+0000","last_became_active":"2023-10-09T08:14:38.454658+0000","last_became_peered":"2023-10-09T08:14:38.454658+0000","last_unstale":"2023-10-09T08:14:39.494014+0000","last_undegraded":"2023-10-09T08:14:39.494014+0000","last_fullsized":"2023-10-09T08:14:39.494014+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:33:36.559884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.482797+0000","last_change":"2023-10-09T08:14:39.481020+0000","last_active":"2023-10-09T08:14:39.482797+0000","last_peered":"2023-10-09T08:14:39.482797+0000","last_clean":"2023-10-09T08:14:39.482797+0000","last_became_active":"2023-10-09T08:14:39.480773+0000","last_became_peered":"2023-10-09T08:14:39.480773+0000","last_unstale":"2023-10-09T08:14:39.482797+0000","last_undegraded":"2023-10-09T08:14:39.482797+0000","last_fullsized":"2023-10-09T08:14:39.482797+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:52.883026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.465016+0000","last_change":"2023-10-09T08:14:38.449804+0000","last_active":"2023-10-09T08:14:39.465016+0000","last_peered":"2023-10-09T08:14:39.465016+0000","last_clean":"2023-10-09T08:14:39.465016+0000","last_became_active":"2023-10-09T08:14:38.449525+0000","last_became_peered":"2023-10-09T08:14:38.449525+0000","last_unstale":"2023-10-09T08:14:39.465016+0000","last_undegraded":"2023-10-09T08:14:39.465016+0000","last_fullsized":"2023-10-09T08:14:39.465016+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:42:28.181427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.442793+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:44:04.977933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.482848+0000","last_change":"2023-10-09T08:14:39.477525+0000","last_active":"2023-10-09T08:14:39.482848+0000","last_peered":"2023-10-09T08:14:39.482848+0000","last_clean":"2023-10-09T08:14:39.482848+0000","last_became_active":"2023-10-09T08:14:39.477264+0000","last_became_peered":"2023-10-09T08:14:39.477264+0000","last_unstale":"2023-10-09T08:14:39.482848+0000","last_undegraded":"2023-10-09T08:14:39.482848+0000","last_fullsized":"2023-10-09T08:14:39.482848+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:11.301814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.464301+0000","last_change":"2023-10-09T08:14:38.454293+0000","last_active":"2023-10-09T08:14:39.464301+0000","last_peered":"2023-10-09T08:14:39.464301+0000","last_clean":"2023-10-09T08:14:39.464301+0000","last_became_active":"2023-10-09T08:14:38.453970+0000","last_became_peered":"2023-10-09T08:14:38.453970+0000","last_unstale":"2023-10-09T08:14:39.464301+0000","last_undegraded":"2023-10-09T08:14:39.464301+0000","last_fullsized":"2023-10-09T08:14:39.464301+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:10.748478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481977+0000","last_change":"2023-10-09T08:14:39.480148+0000","last_active":"2023-10-09T08:14:39.481977+0000","last_peered":"2023-10-09T08:14:39.481977+0000","last_clean":"2023-10-09T08:14:39.481977+0000","last_became_active":"2023-10-09T08:14:39.479903+0000","last_became_peered":"2023-10-09T08:14:39.479903+0000","last_unstale":"2023-10-09T08:14:39.481977+0000","last_undegraded":"2023-10-09T08:14:39.481977+0000","last_fullsized":"2023-10-09T08:14:39.481977+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:41:47.263574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.441856+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:03.250581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.483634+0000","last_change":"2023-10-09T08:14:39.480318+0000","last_active":"2023-10-09T08:14:39.483634+0000","last_peered":"2023-10-09T08:14:39.483634+0000","last_clean":"2023-10-09T08:14:39.483634+0000","last_became_active":"2023-10-09T08:14:39.479561+0000","last_became_peered":"2023-10-09T08:14:39.479561+0000","last_unstale":"2023-10-09T08:14:39.483634+0000","last_undegraded":"2023-10-09T08:14:39.483634+0000","last_fullsized":"2023-10-09T08:14:39.483634+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:33.890868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.466046+0000","last_change":"2023-10-09T08:14:38.456540+0000","last_active":"2023-10-09T08:14:39.466046+0000","last_peered":"2023-10-09T08:14:39.466046+0000","last_clean":"2023-10-09T08:14:39.466046+0000","last_became_active":"2023-10-09T08:14:38.456221+0000","last_became_peered":"2023-10-09T08:14:38.456221+0000","last_unstale":"2023-10-09T08:14:39.466046+0000","last_undegraded":"2023-10-09T08:14:39.466046+0000","last_fullsized":"2023-10-09T08:14:39.466046+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:26.714576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478577+0000","last_change":"2023-10-09T08:14:39.471342+0000","last_active":"2023-10-09T08:14:39.478577+0000","last_peered":"2023-10-09T08:14:39.478577+0000","last_clean":"2023-10-09T08:14:39.478577+0000","last_became_active":"2023-10-09T08:14:39.471053+0000","last_became_peered":"2023-10-09T08:14:39.471053+0000","last_unstale":"2023-10-09T08:14:39.478577+0000","last_undegraded":"2023-10-09T08:14:39.478577+0000","last_fullsized":"2023-10-09T08:14:39.478577+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:45.577995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"193'2","reported_seq":12,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.491340+0000","last_change":"2023-10-09T08:14:38.460625+0000","last_active":"2023-10-09T08:14:39.491340+0000","last_peered":"2023-10-09T08:14:39.491340+0000","last_clean":"2023-10-09T08:14:39.491340+0000","last_became_active":"2023-10-09T08:14:38.460321+0000","last_became_peered":"2023-10-09T08:14:38.460321+0000","last_unstale":"2023-10-09T08:14:39.491340+0000","last_undegraded":"2023-10-09T08:14:39.491340+0000","last_fullsized":"2023-10-09T08:14:39.491340+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:16:28.154856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481580+0000","last_change":"2023-10-09T08:14:39.478657+0000","last_active":"2023-10-09T08:14:39.481580+0000","last_peered":"2023-10-09T08:14:39.481580+0000","last_clean":"2023-10-09T08:14:39.481580+0000","last_became_active":"2023-10-09T08:14:39.478402+0000","last_became_peered":"2023-10-09T08:14:39.478402+0000","last_unstale":"2023-10-09T08:14:39.481580+0000","last_undegraded":"2023-10-09T08:14:39.481580+0000","last_fullsized":"2023-10-09T08:14:39.481580+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:34.938944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.439352+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:44:04.977933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.485101+0000","last_change":"2023-10-09T08:14:39.483531+0000","last_active":"2023-10-09T08:14:39.485101+0000","last_peered":"2023-10-09T08:14:39.485101+0000","last_clean":"2023-10-09T08:14:39.485101+0000","last_became_active":"2023-10-09T08:14:39.483236+0000","last_became_peered":"2023-10-09T08:14:39.483236+0000","last_unstale":"2023-10-09T08:14:39.485101+0000","last_undegraded":"2023-10-09T08:14:39.485101+0000","last_fullsized":"2023-10-09T08:14:39.485101+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:54:22.665528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.443544+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:07:03.303746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.472812+0000","last_change":"2023-10-09T08:14:39.468512+0000","last_active":"2023-10-09T08:14:39.472812+0000","last_peered":"2023-10-09T08:14:39.472812+0000","last_clean":"2023-10-09T08:14:39.472812+0000","last_became_active":"2023-10-09T08:14:39.468158+0000","last_became_peered":"2023-10-09T08:14:39.468158+0000","last_unstale":"2023-10-09T08:14:39.472812+0000","last_undegraded":"2023-10-09T08:14:39.472812+0000","last_fullsized":"2023-10-09T08:14:39.472812+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:04.566842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.458202+0000","last_change":"2023-10-09T08:14:38.464753+0000","last_active":"2023-10-09T08:14:39.458202+0000","last_peered":"2023-10-09T08:14:39.458202+0000","last_clean":"2023-10-09T08:14:39.458202+0000","last_became_active":"2023-10-09T08:14:38.464494+0000","last_became_peered":"2023-10-09T08:14:38.464494+0000","last_unstale":"2023-10-09T08:14:39.458202+0000","last_undegraded":"2023-10-09T08:14:39.458202+0000","last_fullsized":"2023-10-09T08:14:39.458202+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:03.238219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.484321+0000","last_change":"2023-10-09T08:14:39.482147+0000","last_active":"2023-10-09T08:14:39.484321+0000","last_peered":"2023-10-09T08:14:39.484321+0000","last_clean":"2023-10-09T08:14:39.484321+0000","last_became_active":"2023-10-09T08:14:39.481901+0000","last_became_peered":"2023-10-09T08:14:39.481901+0000","last_unstale":"2023-10-09T08:14:39.484321+0000","last_undegraded":"2023-10-09T08:14:39.484321+0000","last_fullsized":"2023-10-09T08:14:39.484321+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:30.483504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.438592+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:49.393514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.442937+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:49:23.713246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481621+0000","last_change":"2023-10-09T08:14:39.477716+0000","last_active":"2023-10-09T08:14:39.481621+0000","last_peered":"2023-10-09T08:14:39.481621+0000","last_clean":"2023-10-09T08:14:39.481621+0000","last_became_active":"2023-10-09T08:14:39.477119+0000","last_became_peered":"2023-10-09T08:14:39.477119+0000","last_unstale":"2023-10-09T08:14:39.481621+0000","last_undegraded":"2023-10-09T08:14:39.481621+0000","last_fullsized":"2023-10-09T08:14:39.481621+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:47.340414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.443699+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:26.250981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.439589+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:33.528262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478617+0000","last_change":"2023-10-09T08:14:39.472193+0000","last_active":"2023-10-09T08:14:39.478617+0000","last_peered":"2023-10-09T08:14:39.478617+0000","last_clean":"2023-10-09T08:14:39.478617+0000","last_became_active":"2023-10-09T08:14:39.471886+0000","last_became_peered":"2023-10-09T08:14:39.471886+0000","last_unstale":"2023-10-09T08:14:39.478617+0000","last_undegraded":"2023-10-09T08:14:39.478617+0000","last_fullsized":"2023-10-09T08:14:39.478617+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:02:07.699719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.439194+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:23:34.614137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"183'326","reported_seq":1052,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.466136+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T08:14:39.466136+0000","last_peered":"2023-10-09T08:14:39.466136+0000","last_clean":"2023-10-09T08:14:39.466136+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T08:14:39.466136+0000","last_undegraded":"2023-10-09T08:14:39.466136+0000","last_fullsized":"2023-10-09T08:14:39.466136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":714,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575944,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312548,"kb_used_data":2972,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059292,"statfs":{"total":96636764160,"available":96316715008,"internally_reserved":0,"allocated":3043328,"data_stored":1813297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.748,"15min":0.755},"min":{"1min":0.49199999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97699999999999998,"5min":1.002,"15min":1.1220000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.755,"15min":0.751},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.44500000000000001},"max":{"1min":1.0069999999999999,"5min":1.0129999999999999,"15min":1.0209999999999999},"last":0.91900000000000004}]},{"osd":1,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.746,"15min":0.746},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":1.024},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.747,"15min":0.751},"min":{"1min":0.503,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.01}]},{"osd":2,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.752,"15min":0.753},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.77300000000000002,"15min":0.77400000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.442},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.86499999999999999}]},{"osd":3,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.755,"15min":0.74199999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.47999999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.78200000000000003,"15min":0.78000000000000003},"min":{"1min":0.61499999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.97999999999999998}]},{"osd":4,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.624,"15min":0.60899999999999999},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.38300000000000001},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.45500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.89400000000000002}]},{"osd":5,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.53400000000000003,"5min":0.41699999999999998,"15min":0.40100000000000002},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.75600000000000001,"15min":0.746},"min":{"1min":0.60499999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.72399999999999998,"15min":0.71399999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.70399999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311896,"kb_used_data":2320,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059944,"statfs":{"total":96636764160,"available":96317382656,"internally_reserved":0,"allocated":2375680,"data_stored":1193592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.749,"15min":0.753},"min":{"1min":0.46899999999999997,"5min":0.45900000000000002,"15min":0.40300000000000002},"max":{"1min":0.97799999999999998,"5min":0.99299999999999999,"15min":1.0449999999999999},"last":0.747},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.44400000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94099999999999995,"5min":0.94499999999999995,"15min":0.97399999999999998},"last":0.58299999999999996}]},{"osd":1,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.753,"15min":0.755},"min":{"1min":0.54700000000000004,"5min":0.499,"15min":0.38500000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77000000000000002,"15min":0.76300000000000001},"min":{"1min":0.59499999999999997,"5min":0.52800000000000002,"15min":0.47999999999999998},"max":{"1min":1.018,"5min":1.0269999999999999,"15min":1.097},"last":0.77200000000000002}]},{"osd":2,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.46400000000000002},"max":{"1min":1.004,"5min":1.0109999999999999,"15min":1.0329999999999999},"last":0.505},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77200000000000002,"15min":0.77800000000000002},"min":{"1min":0.52300000000000002,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0660000000000001},"last":0.61399999999999999}]},{"osd":3,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.54300000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.004,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.61599999999999999,"5min":0.51100000000000001,"15min":0.49299999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0680000000000001},"last":0.54100000000000004}]},{"osd":4,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.40600000000000003,"15min":0.40200000000000002},"max":{"1min":0.92000000000000004,"5min":1.032,"15min":1.1339999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.44800000000000001,"5min":0.39700000000000002,"15min":0.32000000000000001},"max":{"1min":0.82699999999999996,"5min":0.91900000000000004,"15min":0.97099999999999997},"last":0.73899999999999999}]},{"osd":5,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.40100000000000002},"max":{"1min":0.90900000000000003,"5min":0.93400000000000005,"15min":0.98899999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.45200000000000001},"max":{"1min":0.97599999999999998,"5min":1.0880000000000001,"15min":1.121},"last":0.71399999999999997}]},{"osd":7,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70199999999999996,"15min":0.69699999999999995},"min":{"1min":0.49399999999999999,"5min":0.45600000000000002,"15min":0.36299999999999999},"max":{"1min":0.93200000000000005,"5min":0.98699999999999999,"15min":1.0309999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.75800000000000001,"15min":0.74299999999999999},"min":{"1min":0.54400000000000004,"5min":0.48699999999999999,"15min":0.442},"max":{"1min":0.95599999999999996,"5min":0.96799999999999997,"15min":1.139},"last":0.60199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575943,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307812,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064028,"statfs":{"total":96636764160,"available":96321564672,"internally_reserved":0,"allocated":2387968,"data_stored":1199889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45300000000000001,"15min":0.46000000000000002},"min":{"1min":0.34200000000000003,"5min":0.29799999999999999,"15min":0.28799999999999998},"max":{"1min":0.621,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.441},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52400000000000002,"15min":0.51500000000000001},"min":{"1min":0.39500000000000002,"5min":0.34899999999999998,"15min":0.32400000000000001},"max":{"1min":0.66300000000000003,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.46100000000000002}]},{"osd":2,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.51200000000000001},"min":{"1min":0.379,"5min":0.34200000000000003,"15min":0.318},"max":{"1min":0.624,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.58999999999999997},"min":{"1min":0.44900000000000001,"5min":0.433,"15min":0.39500000000000002},"max":{"1min":0.69899999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.505}]},{"osd":3,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.505,"5min":0.42699999999999999,"15min":0.41099999999999998},"max":{"1min":0.76800000000000002,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.51200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76100000000000001,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.40300000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.76000000000000001,"15min":0.78500000000000003},"min":{"1min":0.64400000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.125,"5min":1.125,"15min":1.224},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.81200000000000006,"15min":0.80300000000000005},"min":{"1min":0.61199999999999999,"5min":0.55800000000000005,"15min":0.51800000000000002},"max":{"1min":1.071,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.65000000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0940000000000001,"5min":1.77,"15min":1.77},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.79300000000000004,"15min":0.81200000000000006},"min":{"1min":0.65600000000000003,"5min":0.56100000000000005,"15min":0.49299999999999999},"max":{"1min":1.054,"5min":1.0569999999999999,"15min":1.288},"last":0.64600000000000002}]},{"osd":6,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.83399999999999996,"15min":0.82399999999999995},"min":{"1min":0.69499999999999995,"5min":0.57199999999999995,"15min":0.505},"max":{"1min":1.143,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.85699999999999998,"15min":0.84099999999999997},"min":{"1min":0.59999999999999998,"5min":0.57499999999999996,"15min":0.53800000000000003},"max":{"1min":1.105,"5min":1.843,"15min":1.843},"last":0.66300000000000003}]},{"osd":7,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.876,"15min":0.86499999999999999},"min":{"1min":0.748,"5min":0.64000000000000001,"15min":0.58599999999999997},"max":{"1min":1.135,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.85399999999999998,"15min":0.85299999999999998},"min":{"1min":0.65700000000000003,"5min":0.61799999999999999,"15min":0.54300000000000004},"max":{"1min":1.1659999999999999,"5min":1.21,"15min":1.347},"last":0.73399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575943,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308428,"kb_used_data":2948,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063412,"statfs":{"total":96636764160,"available":96320933888,"internally_reserved":0,"allocated":3018752,"data_stored":1811047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48999999999999999,"15min":0.48499999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.29199999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.34899999999999998,"5min":0.34599999999999997,"15min":0.318},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.92300000000000004},"last":0.33500000000000002}]},{"osd":2,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57699999999999996,"15min":0.58399999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.36499999999999999,"5min":0.35999999999999999,"15min":0.34499999999999997},"max":{"1min":0.70499999999999996,"5min":0.77300000000000002,"15min":0.81999999999999995},"last":0.39700000000000002}]},{"osd":3,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.35099999999999998},"max":{"1min":0.78200000000000003,"5min":0.79400000000000004,"15min":0.80500000000000005},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60999999999999999,"15min":0.621},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.93200000000000005},"last":0.51800000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81200000000000006,"15min":0.78800000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.42899999999999999},"max":{"1min":0.98299999999999998,"5min":1.226,"15min":1.232},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57699999999999996,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0649999999999999,"5min":1.196,"15min":1.23},"last":0.61399999999999999}]},{"osd":5,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.82199999999999995,"15min":0.81499999999999995},"min":{"1min":0.60599999999999998,"5min":0.57299999999999995,"15min":0.501},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.262},"last":0.621},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.83099999999999996,"15min":0.82299999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.52100000000000002},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.79600000000000004}]},{"osd":6,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.86099999999999999,"15min":0.85199999999999998},"min":{"1min":0.64600000000000002,"5min":0.59599999999999997,"15min":0.58899999999999997},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.747},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83299999999999996,"15min":0.83099999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0920000000000001,"5min":1.24,"15min":1.3029999999999999},"last":0.58999999999999997}]},{"osd":7,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.86099999999999999,"15min":0.86499999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2370000000000001,"5min":1.2929999999999999,"15min":1.3540000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.88700000000000001,"15min":0.88200000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.58199999999999996},"max":{"1min":1.085,"5min":1.1519999999999999,"15min":1.3380000000000001},"last":0.66200000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575943,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316044,"kb_used_data":2372,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055796,"statfs":{"total":96636764160,"available":96313135104,"internally_reserved":0,"allocated":2428928,"data_stored":1220769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.47199999999999998,"15min":0.46500000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64500000000000002,"5min":0.71099999999999997,"15min":0.752},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.501,"15min":0.504},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64800000000000002,"5min":0.73299999999999998,"15min":0.82899999999999996},"last":0.48099999999999998}]},{"osd":1,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.499,"15min":0.495},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.33700000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55100000000000005,"15min":0.54200000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34699999999999998},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.40699999999999997}]},{"osd":3,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39200000000000002},"max":{"1min":0.89000000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.442},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64000000000000001,"15min":0.63900000000000001},"min":{"1min":0.47899999999999998,"5min":0.43099999999999999,"15min":0.38100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.94199999999999995},"last":0.46899999999999997}]},{"osd":4,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.80800000000000005,"15min":0.80900000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":0.96699999999999997,"5min":1.089,"15min":1.089},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.80200000000000005,"15min":0.79600000000000004},"min":{"1min":0.61699999999999999,"5min":0.54200000000000004,"15min":0.48399999999999999},"max":{"1min":1.107,"5min":1.133,"15min":1.1399999999999999},"last":1.0700000000000001}]},{"osd":5,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82499999999999996,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.51800000000000002},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":1.022},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.82799999999999996,"15min":0.82599999999999996},"min":{"1min":0.60199999999999998,"5min":0.54700000000000004,"15min":0.47799999999999998},"max":{"1min":1.052,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.98699999999999999}]},{"osd":6,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.84099999999999997,"15min":0.82799999999999996},"min":{"1min":0.57999999999999996,"5min":0.56299999999999994,"15min":0.52700000000000002},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.163},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.83899999999999997,"15min":0.83299999999999996},"min":{"1min":0.59399999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1020000000000001,"5min":1.109,"15min":1.224},"last":1.103}]},{"osd":7,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86599999999999999,"15min":0.85899999999999999},"min":{"1min":0.66700000000000004,"5min":0.60199999999999998,"15min":0.47899999999999998},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.198},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":1.157}]}]},{"osd":3,"up_from":13,"seq":55834575944,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2372,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2428928,"data_stored":1220713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47599999999999998,"15min":0.48999999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.30599999999999999},"max":{"1min":0.65800000000000003,"5min":0.68799999999999994,"15min":0.85999999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.5,"15min":0.51000000000000001},"min":{"1min":0.33900000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.79600000000000004},"last":0.53800000000000003}]},{"osd":1,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52100000000000002,"15min":0.51300000000000001},"min":{"1min":0.38300000000000001,"5min":0.34599999999999997,"15min":0.34300000000000003},"max":{"1min":0.70999999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.374},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59299999999999997,"15min":0.58099999999999996},"min":{"1min":0.439,"5min":0.43099999999999999,"15min":0.378},"max":{"1min":0.84999999999999998,"5min":0.85999999999999999,"15min":0.91300000000000003},"last":0.47399999999999998}]},{"osd":2,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.49199999999999999,"5min":0.41599999999999998,"15min":0.40400000000000003},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.97299999999999998},"last":0.443},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66100000000000003,"15min":0.66400000000000003},"min":{"1min":0.54000000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82299999999999995,"5min":0.879,"15min":1.036},"last":0.51500000000000001}]},{"osd":4,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78300000000000003,"15min":0.78100000000000003},"min":{"1min":0.56599999999999995,"5min":0.54100000000000004,"15min":0.46000000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.872,"5min":0.86599999999999999,"15min":0.871},"min":{"1min":0.69999999999999996,"5min":0.69899999999999995,"15min":0.66000000000000003},"max":{"1min":1.0629999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.60499999999999998}]},{"osd":5,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76900000000000002,"15min":0.77500000000000002},"min":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.47399999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.24},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.84199999999999997,"15min":0.83999999999999997},"min":{"1min":0.69099999999999995,"5min":0.66100000000000003,"15min":0.56899999999999995},"max":{"1min":0.996,"5min":1.1719999999999999,"15min":1.1739999999999999},"last":0.57599999999999996}]},{"osd":6,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79500000000000004,"15min":0.80600000000000005},"min":{"1min":0.623,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.099,"5min":1.099,"15min":1.206},"last":0.87},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.81200000000000006,"15min":0.81899999999999995},"min":{"1min":0.66900000000000004,"5min":0.56100000000000005,"15min":0.54800000000000004},"max":{"1min":1.0629999999999999,"5min":1.1339999999999999,"15min":1.1870000000000001},"last":0.73799999999999999}]},{"osd":7,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.85699999999999998,"15min":0.85999999999999999},"min":{"1min":0.70199999999999996,"5min":0.623,"15min":0.53700000000000003},"max":{"1min":1.0800000000000001,"5min":1.1839999999999999,"15min":1.3280000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.85399999999999998,"15min":0.85999999999999999},"min":{"1min":0.64400000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.147,"5min":1.1639999999999999,"15min":1.2869999999999999},"last":0.83399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299620,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072220,"statfs":{"total":96636764160,"available":96329953280,"internally_reserved":0,"allocated":2387968,"data_stored":1199889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73099999999999998,"15min":0.72999999999999998},"min":{"1min":0.60399999999999998,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":0.94799999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.745,"15min":0.74399999999999999},"min":{"1min":0.51300000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.69999999999999996}]},{"osd":1,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.73299999999999998,"15min":0.72699999999999998},"min":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.51000000000000001},"max":{"1min":0.83499999999999996,"5min":1.03,"15min":1.03},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.53100000000000003,"5min":0.442,"15min":0.42799999999999999},"max":{"1min":0.97299999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.78900000000000003}]},{"osd":2,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81200000000000006,"15min":0.79900000000000004},"min":{"1min":0.65300000000000002,"5min":0.51400000000000001,"15min":0.45000000000000001},"max":{"1min":0.99399999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.81399999999999995,"15min":0.81000000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.47999999999999998},"max":{"1min":0.95699999999999996,"5min":1.077,"15min":1.077},"last":0.66400000000000003}]},{"osd":3,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.754,"15min":0.748},"min":{"1min":0.57799999999999996,"5min":0.51500000000000001,"15min":0.45900000000000002},"max":{"1min":0.92000000000000004,"5min":1.016,"15min":1.018},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.76900000000000002,"15min":0.77200000000000002},"min":{"1min":0.57199999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.89700000000000002,"5min":1.036,"15min":1.036},"last":0.80100000000000005}]},{"osd":5,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.38800000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.83599999999999997,"5min":0.94899999999999995,"15min":1.006},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63100000000000001,"15min":0.63200000000000001},"min":{"1min":0.46899999999999997,"5min":0.42099999999999999,"15min":0.40100000000000002},"max":{"1min":0.94199999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.42499999999999999}]},{"osd":6,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64300000000000002,"15min":0.63400000000000001},"min":{"1min":0.47399999999999998,"5min":0.42399999999999999,"15min":0.42299999999999999},"max":{"1min":1.012,"5min":1.022,"15min":1.034},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67400000000000004,"15min":0.68200000000000005},"min":{"1min":0.48899999999999999,"5min":0.437,"15min":0.42999999999999999},"max":{"1min":0.96499999999999997,"5min":0.998,"15min":1.0609999999999999},"last":0.64300000000000002}]},{"osd":7,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.53400000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.0580000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.77700000000000002},"min":{"1min":0.61799999999999999,"5min":0.48499999999999999,"15min":0.443},"max":{"1min":1.056,"5min":1.0629999999999999,"15min":1.079},"last":0.89400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575943,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316004,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055836,"statfs":{"total":96636764160,"available":96313176064,"internally_reserved":0,"allocated":2387968,"data_stored":1199889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96999999999999997,"5min":0.998,"15min":1.0780000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71699999999999997,"15min":0.71799999999999997},"min":{"1min":0.51500000000000001,"5min":0.42999999999999999,"15min":0.40899999999999997},"max":{"1min":0.91100000000000003,"5min":0.97399999999999998,"15min":1.018},"last":0.57899999999999996}]},{"osd":1,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72299999999999998,"15min":0.72399999999999998},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90100000000000002,"5min":1.0129999999999999,"15min":1.1140000000000001},"last":0.628},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.435},"max":{"1min":0.89800000000000002,"5min":1.0029999999999999,"15min":1.0169999999999999},"last":0.72999999999999998}]},{"osd":2,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.754,"15min":0.751},"min":{"1min":0.58799999999999997,"5min":0.499,"15min":0.48699999999999999},"max":{"1min":0.92200000000000004,"5min":1.115,"15min":1.115},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.48299999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99299999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.55200000000000005}]},{"osd":3,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.748},"min":{"1min":0.50900000000000001,"5min":0.49199999999999999,"15min":0.48299999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":1.0409999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.57799999999999996,"5min":0.54600000000000004,"15min":0.51500000000000001},"max":{"1min":0.95299999999999996,"5min":1.0189999999999999,"15min":1.0620000000000001},"last":0.66600000000000004}]},{"osd":4,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.38200000000000001},"max":{"1min":0.75700000000000001,"5min":0.96699999999999997,"15min":0.995},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60599999999999998,"15min":0.61099999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88500000000000001,"5min":0.94399999999999995,"15min":0.96599999999999997},"last":0.499}]},{"osd":6,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93799999999999994,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.749},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.67900000000000005,"15min":0.67400000000000004},"min":{"1min":0.53300000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91500000000000004,"5min":0.97099999999999997,"15min":1.006},"last":0.68200000000000005}]},{"osd":7,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69799999999999995,"15min":0.68899999999999995},"min":{"1min":0.55000000000000004,"5min":0.46999999999999997,"15min":0.44400000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.76700000000000002},"min":{"1min":0.58799999999999997,"5min":0.57299999999999995,"15min":0.48599999999999999},"max":{"1min":0.97099999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T08:14:43.782 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T08:14:43.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.999+0000 7fd5f919d700 1 Processor -- start 2023-10-09T08:14:43.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:43.999+0000 7fd5f919d700 1 -- start start 2023-10-09T08:14:44.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.000+0000 7fd5f919d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd5f415d230 0x7fd5f415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:44.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.000+0000 7fd5f919d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f40b2980 con 0x7fd5f4159420 2023-10-09T08:14:44.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.000+0000 7fd5f919d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f415db70 con 0x7fd5f41597f0 2023-10-09T08:14:44.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.000+0000 7fd5f919d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f40b11d0 con 0x7fd5f415d230 2023-10-09T08:14:44.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.000+0000 7fd5f3fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd5f4159420 0x7fd5f40b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56318/0 (socket says 172.21.15.71:56318) 2023-10-09T08:14:44.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.000+0000 7fd5f3fff700 1 -- 172.21.15.71:0/2338977543 learned_addr learned my addr 172.21.15.71:0/2338977543 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:44.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.001+0000 7fd5f899c700 1 --2- 172.21.15.71:0/2338977543 >> v2:172.21.15.179:3300/0 conn(0x7fd5f415d230 0x7fd5f415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.001+0000 7fd5f2ffd700 1 -- 172.21.15.71:0/2338977543 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834370295 0 0) 0x7fd5f40b2980 con 0x7fd5f4159420 2023-10-09T08:14:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.001+0000 7fd5f2ffd700 1 -- 172.21.15.71:0/2338977543 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5dc003570 con 0x7fd5f4159420 2023-10-09T08:14:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.001+0000 7fd5f2ffd700 1 -- 172.21.15.71:0/2338977543 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 152004073 0 0) 0x7fd5dc003570 con 0x7fd5f4159420 2023-10-09T08:14:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.001+0000 7fd5f2ffd700 1 -- 172.21.15.71:0/2338977543 >> v2:172.21.15.179:3300/0 conn(0x7fd5f415d230 msgr2=0x7fd5f415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.001+0000 7fd5f2ffd700 1 --2- 172.21.15.71:0/2338977543 >> v2:172.21.15.179:3300/0 conn(0x7fd5f415d230 0x7fd5f415d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.001+0000 7fd5f2ffd700 1 -- 172.21.15.71:0/2338977543 >> v1:172.21.15.179:6789/0 conn(0x7fd5f41597f0 legacy=0x7fd5f40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.001+0000 7fd5f2ffd700 1 -- 172.21.15.71:0/2338977543 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f40b14b0 con 0x7fd5f4159420 2023-10-09T08:14:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.001+0000 7fd5f2ffd700 1 -- 172.21.15.71:0/2338977543 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fd5e4001470 con 0x7fd5f4159420 2023-10-09T08:14:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.001+0000 7fd5f2ffd700 1 -- 172.21.15.71:0/2338977543 >> v1:172.21.15.71:6789/0 conn(0x7fd5f4159420 legacy=0x7fd5f40b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.001+0000 7fd5f2ffd700 1 --2- 172.21.15.71:0/2338977543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5dc003a60 0x7fd5dc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.001+0000 7fd5f2ffd700 1 --2- 172.21.15.71:0/2338977543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc004810 0x7fd5dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.001+0000 7fd5f2ffd700 1 --2- 172.21.15.71:0/2338977543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5dc0051c0 0x7fd5dc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.001+0000 7fd5f2ffd700 1 -- 172.21.15.71:0/2338977543 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f40b11d0 con 0x7fd5dc004810 2023-10-09T08:14:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.001+0000 7fd5f2ffd700 1 -- 172.21.15.71:0/2338977543 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc00c0d0 con 0x7fd5dc0051c0 2023-10-09T08:14:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.001+0000 7fd5f2ffd700 1 -- 172.21.15.71:0/2338977543 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc00c290 con 0x7fd5dc003a60 2023-10-09T08:14:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.002+0000 7fd5f37fe700 1 --2- 172.21.15.71:0/2338977543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc004810 0x7fd5dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.002+0000 7fd5f3fff700 1 --2- 172.21.15.71:0/2338977543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5dc003a60 0x7fd5dc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.002+0000 7fd5f899c700 1 --2- 172.21.15.71:0/2338977543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5dc0051c0 0x7fd5dc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.002+0000 7fd5f37fe700 1 -- 172.21.15.71:0/2338977543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5dc003a60 msgr2=0x7fd5dc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.002+0000 7fd5f37fe700 1 --2- 172.21.15.71:0/2338977543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5dc003a60 0x7fd5dc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.002+0000 7fd5f37fe700 1 -- 172.21.15.71:0/2338977543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5dc0051c0 msgr2=0x7fd5dc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:44.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.002+0000 7fd5f37fe700 1 --2- 172.21.15.71:0/2338977543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5dc0051c0 0x7fd5dc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.002+0000 7fd5f37fe700 1 -- 172.21.15.71:0/2338977543 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc003570 con 0x7fd5dc004810 2023-10-09T08:14:44.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.002+0000 7fd5f899c700 1 -- 172.21.15.71:0/2338977543 reap_dead start 2023-10-09T08:14:44.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.002+0000 7fd5f37fe700 1 --2- 172.21.15.71:0/2338977543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc004810 0x7fd5dc004c80 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8001880 tx=0x7fd5e8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee9c2ad4e34e644 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:44.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.002+0000 7fd5f2ffd700 1 -- 172.21.15.71:0/2338977543 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8012420 con 0x7fd5dc004810 2023-10-09T08:14:44.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.002+0000 7fd5f2ffd700 1 -- 172.21.15.71:0/2338977543 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e80125a0 con 0x7fd5dc004810 2023-10-09T08:14:44.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.002+0000 7fd5f2ffd700 1 -- 172.21.15.71:0/2338977543 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8012960 con 0x7fd5dc004810 2023-10-09T08:14:44.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.003+0000 7fd5f919d700 1 -- 172.21.15.71:0/2338977543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc004810 msgr2=0x7fd5dc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:44.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.003+0000 7fd5f919d700 1 --2- 172.21.15.71:0/2338977543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc004810 0x7fd5dc004c80 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8001880 tx=0x7fd5e8007d30 comp rx=0 tx=0).stop 2023-10-09T08:14:44.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.003+0000 7fd5f919d700 1 -- 172.21.15.71:0/2338977543 shutdown_connections 2023-10-09T08:14:44.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.003+0000 7fd5f919d700 1 --2- 172.21.15.71:0/2338977543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc004810 0x7fd5dc004c80 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.003+0000 7fd5f919d700 1 -- 172.21.15.71:0/2338977543 >> 172.21.15.71:0/2338977543 conn(0x7fd5f40d0660 msgr2=0x7fd5f40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.003+0000 7fd5f919d700 1 -- 172.21.15.71:0/2338977543 shutdown_connections 2023-10-09T08:14:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.003+0000 7fd5f919d700 1 -- 172.21.15.71:0/2338977543 wait complete. 2023-10-09T08:14:44.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.004+0000 7fd5f919d700 1 Processor -- start 2023-10-09T08:14:44.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.005+0000 7fd5f919d700 1 -- start start 2023-10-09T08:14:44.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.005+0000 7fd5f919d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc004810 0x7fd5f4149340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:44.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.005+0000 7fd5f919d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5f40c5d80 0x7fd5f416d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:44.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.005+0000 7fd5f919d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5f416d590 0x7fd5f40b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:44.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.005+0000 7fd5f919d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f40c7870 con 0x7fd5dc004810 2023-10-09T08:14:44.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.005+0000 7fd5f919d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f4149880 con 0x7fd5f416d590 2023-10-09T08:14:44.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.005+0000 7fd5f919d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f416da30 con 0x7fd5f40c5d80 2023-10-09T08:14:44.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.006+0000 7fd5f3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc004810 0x7fd5f4149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:44.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.006+0000 7fd5f3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc004810 0x7fd5f4149340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51352/0 (socket says 172.21.15.71:51352) 2023-10-09T08:14:44.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.006+0000 7fd5f3fff700 1 -- 172.21.15.71:0/1495131663 learned_addr learned my addr 172.21.15.71:0/1495131663 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:44.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.006+0000 7fd5f899c700 1 --2- 172.21.15.71:0/1495131663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5f416d590 0x7fd5f40b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:44.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.006+0000 7fd5f37fe700 1 --2- 172.21.15.71:0/1495131663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5f40c5d80 0x7fd5f416d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:44.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.006+0000 7fd5f3fff700 1 -- 172.21.15.71:0/1495131663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5f40c5d80 msgr2=0x7fd5f416d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:44.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.006+0000 7fd5f3fff700 1 --2- 172.21.15.71:0/1495131663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5f40c5d80 0x7fd5f416d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.006+0000 7fd5f3fff700 1 -- 172.21.15.71:0/1495131663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5f416d590 msgr2=0x7fd5f40b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:44.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.006+0000 7fd5f3fff700 1 --2- 172.21.15.71:0/1495131663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5f416d590 0x7fd5f40b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.006+0000 7fd5f3fff700 1 -- 172.21.15.71:0/1495131663 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f416dd10 con 0x7fd5dc004810 2023-10-09T08:14:44.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.006+0000 7fd5f3fff700 1 --2- 172.21.15.71:0/1495131663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc004810 0x7fd5f4149340 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4007390 tx=0x7fd5f415dd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:44.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.006+0000 7fd5dbfff700 1 -- 172.21.15.71:0/1495131663 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4000ce0 con 0x7fd5dc004810 2023-10-09T08:14:44.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.006+0000 7fd5dbfff700 1 -- 172.21.15.71:0/1495131663 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e4007750 con 0x7fd5dc004810 2023-10-09T08:14:44.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.007+0000 7fd5f919d700 1 -- 172.21.15.71:0/1495131663 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f40c5580 con 0x7fd5dc004810 2023-10-09T08:14:44.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.007+0000 7fd5dbfff700 1 -- 172.21.15.71:0/1495131663 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e400faa0 con 0x7fd5dc004810 2023-10-09T08:14:44.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.007+0000 7fd5f919d700 1 -- 172.21.15.71:0/1495131663 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f41545f0 con 0x7fd5dc004810 2023-10-09T08:14:44.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.008+0000 7fd5f919d700 1 -- 172.21.15.71:0/1495131663 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f40c5aa0 con 0x7fd5dc004810 2023-10-09T08:14:44.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.009+0000 7fd5dbfff700 1 -- 172.21.15.71:0/1495131663 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd5e401d460 con 0x7fd5dc004810 2023-10-09T08:14:44.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.009+0000 7fd5dbfff700 1 --2- 172.21.15.71:0/1495131663 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fd5e0066f30 0x7fd5e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:44.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.010+0000 7fd5dbfff700 1 -- 172.21.15.71:0/1495131663 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6197+0+0 (secure 0 0 0) 0x7fd5e4084730 con 0x7fd5dc004810 2023-10-09T08:14:44.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.010+0000 7fd5f37fe700 1 --2- 172.21.15.71:0/1495131663 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fd5e0066f30 0x7fd5e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:44.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.011+0000 7fd5f37fe700 1 --2- 172.21.15.71:0/1495131663 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fd5e0066f30 0x7fd5e00693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd5f416ae20 tx=0x7fd5e8015000 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:44.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.013+0000 7fd5dbfff700 1 -- 172.21.15.71:0/1495131663 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5e40517b0 con 0x7fd5dc004810 2023-10-09T08:14:44.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.200+0000 7fd5f919d700 1 -- 172.21.15.71:0/1495131663 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd5f40c5400 con 0x7fd5e0066f30 2023-10-09T08:14:44.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.209+0000 7fd5dbfff700 1 -- 172.21.15.71:0/1495131663 <== mgr.8965 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283647 (secure 0 0 0) 0x7fd5e8023070 con 0x7fd5e0066f30 2023-10-09T08:14:44.212 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:14:44.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.213+0000 7fd5f919d700 1 -- 172.21.15.71:0/1495131663 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fd5e0066f30 msgr2=0x7fd5e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:44.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.213+0000 7fd5f919d700 1 --2- 172.21.15.71:0/1495131663 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fd5e0066f30 0x7fd5e00693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd5f416ae20 tx=0x7fd5e8015000 comp rx=0 tx=0).stop 2023-10-09T08:14:44.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.213+0000 7fd5f919d700 1 -- 172.21.15.71:0/1495131663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc004810 msgr2=0x7fd5f4149340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:44.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.213+0000 7fd5f919d700 1 --2- 172.21.15.71:0/1495131663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc004810 0x7fd5f4149340 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4007390 tx=0x7fd5f415dd00 comp rx=0 tx=0).stop 2023-10-09T08:14:44.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.213+0000 7fd5f919d700 1 -- 172.21.15.71:0/1495131663 shutdown_connections 2023-10-09T08:14:44.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.213+0000 7fd5f919d700 1 --2- 172.21.15.71:0/1495131663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5f416d590 0x7fd5f40b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.213+0000 7fd5f919d700 1 --2- 172.21.15.71:0/1495131663 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fd5e0066f30 0x7fd5e00693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.213+0000 7fd5f919d700 1 --2- 172.21.15.71:0/1495131663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc004810 0x7fd5f4149340 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.213+0000 7fd5f919d700 1 --2- 172.21.15.71:0/1495131663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5f40c5d80 0x7fd5f416d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.213+0000 7fd5f919d700 1 -- 172.21.15.71:0/1495131663 >> 172.21.15.71:0/1495131663 conn(0x7fd5f40d0660 msgr2=0x7fd5f40af200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:44.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.213+0000 7fd5f919d700 1 -- 172.21.15.71:0/1495131663 shutdown_connections 2023-10-09T08:14:44.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.213+0000 7fd5f919d700 1 -- 172.21.15.71:0/1495131663 wait complete. 2023-10-09T08:14:44.217 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T08:14:44.230 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T08:14:43.140714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591082,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":551,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":336,"ondisk_log_size":336,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2484300,"kb_used_data":19980,"kb_used_omap":0,"kb_used_meta":2464256,"kb_avail":752490420,"statfs":{"total":773094113280,"available":770550190080,"internally_reserved":0,"allocated":20459520,"data_stored":10859085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2523398144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":714,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.704517"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.484338+0000","last_change":"2023-10-09T08:14:39.481559+0000","last_active":"2023-10-09T08:14:39.484338+0000","last_peered":"2023-10-09T08:14:39.484338+0000","last_clean":"2023-10-09T08:14:39.484338+0000","last_became_active":"2023-10-09T08:14:39.481257+0000","last_became_peered":"2023-10-09T08:14:39.481257+0000","last_unstale":"2023-10-09T08:14:39.484338+0000","last_undegraded":"2023-10-09T08:14:39.484338+0000","last_fullsized":"2023-10-09T08:14:39.484338+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:47.340414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.483532+0000","last_change":"2023-10-09T08:14:39.479211+0000","last_active":"2023-10-09T08:14:39.483532+0000","last_peered":"2023-10-09T08:14:39.483532+0000","last_clean":"2023-10-09T08:14:39.483532+0000","last_became_active":"2023-10-09T08:14:39.478472+0000","last_became_peered":"2023-10-09T08:14:39.478472+0000","last_unstale":"2023-10-09T08:14:39.483532+0000","last_undegraded":"2023-10-09T08:14:39.483532+0000","last_fullsized":"2023-10-09T08:14:39.483532+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:37:42.156487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.487669+0000","last_change":"2023-10-09T08:14:39.486690+0000","last_active":"2023-10-09T08:14:39.487669+0000","last_peered":"2023-10-09T08:14:39.487669+0000","last_clean":"2023-10-09T08:14:39.487669+0000","last_became_active":"2023-10-09T08:14:39.486410+0000","last_became_peered":"2023-10-09T08:14:39.486410+0000","last_unstale":"2023-10-09T08:14:39.487669+0000","last_undegraded":"2023-10-09T08:14:39.487669+0000","last_fullsized":"2023-10-09T08:14:39.487669+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:30.404764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481865+0000","last_change":"2023-10-09T08:14:39.479153+0000","last_active":"2023-10-09T08:14:39.481865+0000","last_peered":"2023-10-09T08:14:39.481865+0000","last_clean":"2023-10-09T08:14:39.481865+0000","last_became_active":"2023-10-09T08:14:39.478895+0000","last_became_peered":"2023-10-09T08:14:39.478895+0000","last_unstale":"2023-10-09T08:14:39.481865+0000","last_undegraded":"2023-10-09T08:14:39.481865+0000","last_fullsized":"2023-10-09T08:14:39.481865+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:40.161626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481640+0000","last_change":"2023-10-09T08:14:39.477874+0000","last_active":"2023-10-09T08:14:39.481640+0000","last_peered":"2023-10-09T08:14:39.481640+0000","last_clean":"2023-10-09T08:14:39.481640+0000","last_became_active":"2023-10-09T08:14:39.477475+0000","last_became_peered":"2023-10-09T08:14:39.477475+0000","last_unstale":"2023-10-09T08:14:39.481640+0000","last_undegraded":"2023-10-09T08:14:39.481640+0000","last_fullsized":"2023-10-09T08:14:39.481640+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:50:38.316596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.484420+0000","last_change":"2023-10-09T08:14:39.481354+0000","last_active":"2023-10-09T08:14:39.484420+0000","last_peered":"2023-10-09T08:14:39.484420+0000","last_clean":"2023-10-09T08:14:39.484420+0000","last_became_active":"2023-10-09T08:14:39.481092+0000","last_became_peered":"2023-10-09T08:14:39.481092+0000","last_unstale":"2023-10-09T08:14:39.484420+0000","last_undegraded":"2023-10-09T08:14:39.484420+0000","last_fullsized":"2023-10-09T08:14:39.484420+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:50.399165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478600+0000","last_change":"2023-10-09T08:14:39.471598+0000","last_active":"2023-10-09T08:14:39.478600+0000","last_peered":"2023-10-09T08:14:39.478600+0000","last_clean":"2023-10-09T08:14:39.478600+0000","last_became_active":"2023-10-09T08:14:39.471342+0000","last_became_peered":"2023-10-09T08:14:39.471342+0000","last_unstale":"2023-10-09T08:14:39.478600+0000","last_undegraded":"2023-10-09T08:14:39.478600+0000","last_fullsized":"2023-10-09T08:14:39.478600+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:18:14.449986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.488248+0000","last_change":"2023-10-09T08:14:39.487286+0000","last_active":"2023-10-09T08:14:39.488248+0000","last_peered":"2023-10-09T08:14:39.488248+0000","last_clean":"2023-10-09T08:14:39.488248+0000","last_became_active":"2023-10-09T08:14:39.486306+0000","last_became_peered":"2023-10-09T08:14:39.486306+0000","last_unstale":"2023-10-09T08:14:39.488248+0000","last_undegraded":"2023-10-09T08:14:39.488248+0000","last_fullsized":"2023-10-09T08:14:39.488248+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:54.313934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.477409+0000","last_change":"2023-10-09T08:14:39.471677+0000","last_active":"2023-10-09T08:14:39.477409+0000","last_peered":"2023-10-09T08:14:39.477409+0000","last_clean":"2023-10-09T08:14:39.477409+0000","last_became_active":"2023-10-09T08:14:39.471412+0000","last_became_peered":"2023-10-09T08:14:39.471412+0000","last_unstale":"2023-10-09T08:14:39.477409+0000","last_undegraded":"2023-10-09T08:14:39.477409+0000","last_fullsized":"2023-10-09T08:14:39.477409+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:15:48.546235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.483651+0000","last_change":"2023-10-09T08:14:39.480496+0000","last_active":"2023-10-09T08:14:39.483651+0000","last_peered":"2023-10-09T08:14:39.483651+0000","last_clean":"2023-10-09T08:14:39.483651+0000","last_became_active":"2023-10-09T08:14:39.479949+0000","last_became_peered":"2023-10-09T08:14:39.479949+0000","last_unstale":"2023-10-09T08:14:39.483651+0000","last_undegraded":"2023-10-09T08:14:39.483651+0000","last_fullsized":"2023-10-09T08:14:39.483651+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:16.219371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.482772+0000","last_change":"2023-10-09T08:14:39.479390+0000","last_active":"2023-10-09T08:14:39.482772+0000","last_peered":"2023-10-09T08:14:39.482772+0000","last_clean":"2023-10-09T08:14:39.482772+0000","last_became_active":"2023-10-09T08:14:39.479115+0000","last_became_peered":"2023-10-09T08:14:39.479115+0000","last_unstale":"2023-10-09T08:14:39.482772+0000","last_undegraded":"2023-10-09T08:14:39.482772+0000","last_fullsized":"2023-10-09T08:14:39.482772+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:40.161626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.479656+0000","last_change":"2023-10-09T08:14:39.471497+0000","last_active":"2023-10-09T08:14:39.479656+0000","last_peered":"2023-10-09T08:14:39.479656+0000","last_clean":"2023-10-09T08:14:39.479656+0000","last_became_active":"2023-10-09T08:14:39.471197+0000","last_became_peered":"2023-10-09T08:14:39.471197+0000","last_unstale":"2023-10-09T08:14:39.479656+0000","last_undegraded":"2023-10-09T08:14:39.479656+0000","last_fullsized":"2023-10-09T08:14:39.479656+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:36:19.307671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.482753+0000","last_change":"2023-10-09T08:14:39.478983+0000","last_active":"2023-10-09T08:14:39.482753+0000","last_peered":"2023-10-09T08:14:39.482753+0000","last_clean":"2023-10-09T08:14:39.482753+0000","last_became_active":"2023-10-09T08:14:39.478606+0000","last_became_peered":"2023-10-09T08:14:39.478606+0000","last_unstale":"2023-10-09T08:14:39.482753+0000","last_undegraded":"2023-10-09T08:14:39.482753+0000","last_fullsized":"2023-10-09T08:14:39.482753+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:41:47.263574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"193'4","reported_seq":14,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.495194+0000","last_change":"2023-10-09T08:14:38.465359+0000","last_active":"2023-10-09T08:14:39.495194+0000","last_peered":"2023-10-09T08:14:39.495194+0000","last_clean":"2023-10-09T08:14:39.495194+0000","last_became_active":"2023-10-09T08:14:38.465002+0000","last_became_peered":"2023-10-09T08:14:38.465002+0000","last_unstale":"2023-10-09T08:14:39.495194+0000","last_undegraded":"2023-10-09T08:14:39.495194+0000","last_fullsized":"2023-10-09T08:14:39.495194+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:33.507990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.439638+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:33:50.063332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.483599+0000","last_change":"2023-10-09T08:14:39.479813+0000","last_active":"2023-10-09T08:14:39.483599+0000","last_peered":"2023-10-09T08:14:39.483599+0000","last_clean":"2023-10-09T08:14:39.483599+0000","last_became_active":"2023-10-09T08:14:39.479545+0000","last_became_peered":"2023-10-09T08:14:39.479545+0000","last_unstale":"2023-10-09T08:14:39.483599+0000","last_undegraded":"2023-10-09T08:14:39.483599+0000","last_fullsized":"2023-10-09T08:14:39.483599+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:53:08.718144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.443106+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:04.853104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.442885+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:42:18.010272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481665+0000","last_change":"2023-10-09T08:14:39.476822+0000","last_active":"2023-10-09T08:14:39.481665+0000","last_peered":"2023-10-09T08:14:39.481665+0000","last_clean":"2023-10-09T08:14:39.481665+0000","last_became_active":"2023-10-09T08:14:39.476504+0000","last_became_peered":"2023-10-09T08:14:39.476504+0000","last_unstale":"2023-10-09T08:14:39.481665+0000","last_undegraded":"2023-10-09T08:14:39.481665+0000","last_fullsized":"2023-10-09T08:14:39.481665+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:34:27.759607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.438960+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:46:35.474237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.443521+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:53:13.999052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.444162+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:43:56.605169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478136+0000","last_change":"2023-10-09T08:14:39.477068+0000","last_active":"2023-10-09T08:14:39.478136+0000","last_peered":"2023-10-09T08:14:39.478136+0000","last_clean":"2023-10-09T08:14:39.478136+0000","last_became_active":"2023-10-09T08:14:39.476231+0000","last_became_peered":"2023-10-09T08:14:39.476231+0000","last_unstale":"2023-10-09T08:14:39.478136+0000","last_undegraded":"2023-10-09T08:14:39.478136+0000","last_fullsized":"2023-10-09T08:14:39.478136+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:09.352022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.465583+0000","last_change":"2023-10-09T08:14:38.447789+0000","last_active":"2023-10-09T08:14:39.465583+0000","last_peered":"2023-10-09T08:14:39.465583+0000","last_clean":"2023-10-09T08:14:39.465583+0000","last_became_active":"2023-10-09T08:14:38.447539+0000","last_became_peered":"2023-10-09T08:14:38.447539+0000","last_unstale":"2023-10-09T08:14:39.465583+0000","last_undegraded":"2023-10-09T08:14:39.465583+0000","last_fullsized":"2023-10-09T08:14:39.465583+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:32.622711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.475100+0000","last_change":"2023-10-09T08:14:39.469756+0000","last_active":"2023-10-09T08:14:39.475100+0000","last_peered":"2023-10-09T08:14:39.475100+0000","last_clean":"2023-10-09T08:14:39.475100+0000","last_became_active":"2023-10-09T08:14:39.469509+0000","last_became_peered":"2023-10-09T08:14:39.469509+0000","last_unstale":"2023-10-09T08:14:39.475100+0000","last_undegraded":"2023-10-09T08:14:39.475100+0000","last_fullsized":"2023-10-09T08:14:39.475100+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:37.888301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.462786+0000","last_change":"2023-10-09T08:14:38.464801+0000","last_active":"2023-10-09T08:14:39.462786+0000","last_peered":"2023-10-09T08:14:39.462786+0000","last_clean":"2023-10-09T08:14:39.462786+0000","last_became_active":"2023-10-09T08:14:38.464474+0000","last_became_peered":"2023-10-09T08:14:38.464474+0000","last_unstale":"2023-10-09T08:14:39.462786+0000","last_undegraded":"2023-10-09T08:14:39.462786+0000","last_fullsized":"2023-10-09T08:14:39.462786+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:30:52.549825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.475065+0000","last_change":"2023-10-09T08:14:39.470159+0000","last_active":"2023-10-09T08:14:39.475065+0000","last_peered":"2023-10-09T08:14:39.475065+0000","last_clean":"2023-10-09T08:14:39.475065+0000","last_became_active":"2023-10-09T08:14:39.469401+0000","last_became_peered":"2023-10-09T08:14:39.469401+0000","last_unstale":"2023-10-09T08:14:39.475065+0000","last_undegraded":"2023-10-09T08:14:39.475065+0000","last_fullsized":"2023-10-09T08:14:39.475065+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:57.535414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"193'3","reported_seq":13,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.493087+0000","last_change":"2023-10-09T08:14:38.454895+0000","last_active":"2023-10-09T08:14:39.493087+0000","last_peered":"2023-10-09T08:14:39.493087+0000","last_clean":"2023-10-09T08:14:39.493087+0000","last_became_active":"2023-10-09T08:14:38.451818+0000","last_became_peered":"2023-10-09T08:14:38.451818+0000","last_unstale":"2023-10-09T08:14:39.493087+0000","last_undegraded":"2023-10-09T08:14:39.493087+0000","last_fullsized":"2023-10-09T08:14:39.493087+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:48:52.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.438696+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:15:47.540584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.479006+0000","last_change":"2023-10-09T08:14:39.473198+0000","last_active":"2023-10-09T08:14:39.479006+0000","last_peered":"2023-10-09T08:14:39.479006+0000","last_clean":"2023-10-09T08:14:39.479006+0000","last_became_active":"2023-10-09T08:14:39.472951+0000","last_became_peered":"2023-10-09T08:14:39.472951+0000","last_unstale":"2023-10-09T08:14:39.479006+0000","last_undegraded":"2023-10-09T08:14:39.479006+0000","last_fullsized":"2023-10-09T08:14:39.479006+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:00:37.618868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.443568+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:40.728510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.474301+0000","last_change":"2023-10-09T08:14:39.472462+0000","last_active":"2023-10-09T08:14:39.474301+0000","last_peered":"2023-10-09T08:14:39.474301+0000","last_clean":"2023-10-09T08:14:39.474301+0000","last_became_active":"2023-10-09T08:14:39.472162+0000","last_became_peered":"2023-10-09T08:14:39.472162+0000","last_unstale":"2023-10-09T08:14:39.474301+0000","last_undegraded":"2023-10-09T08:14:39.474301+0000","last_fullsized":"2023-10-09T08:14:39.474301+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:56.539162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.460955+0000","last_change":"2023-10-09T08:14:38.454099+0000","last_active":"2023-10-09T08:14:39.460955+0000","last_peered":"2023-10-09T08:14:39.460955+0000","last_clean":"2023-10-09T08:14:39.460955+0000","last_became_active":"2023-10-09T08:14:38.453858+0000","last_became_peered":"2023-10-09T08:14:38.453858+0000","last_unstale":"2023-10-09T08:14:39.460955+0000","last_undegraded":"2023-10-09T08:14:39.460955+0000","last_fullsized":"2023-10-09T08:14:39.460955+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:56:35.959943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.442334+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:46:35.474237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.440947+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:10:08.446919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.438589+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:03.250581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.475117+0000","last_change":"2023-10-09T08:14:39.470353+0000","last_active":"2023-10-09T08:14:39.475117+0000","last_peered":"2023-10-09T08:14:39.475117+0000","last_clean":"2023-10-09T08:14:39.475117+0000","last_became_active":"2023-10-09T08:14:39.470030+0000","last_became_peered":"2023-10-09T08:14:39.470030+0000","last_unstale":"2023-10-09T08:14:39.475117+0000","last_undegraded":"2023-10-09T08:14:39.475117+0000","last_fullsized":"2023-10-09T08:14:39.475117+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:11.741936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.440835+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:42:18.010272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"193'1","reported_seq":11,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.494014+0000","last_change":"2023-10-09T08:14:38.454927+0000","last_active":"2023-10-09T08:14:39.494014+0000","last_peered":"2023-10-09T08:14:39.494014+0000","last_clean":"2023-10-09T08:14:39.494014+0000","last_became_active":"2023-10-09T08:14:38.454658+0000","last_became_peered":"2023-10-09T08:14:38.454658+0000","last_unstale":"2023-10-09T08:14:39.494014+0000","last_undegraded":"2023-10-09T08:14:39.494014+0000","last_fullsized":"2023-10-09T08:14:39.494014+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:33:36.559884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.482797+0000","last_change":"2023-10-09T08:14:39.481020+0000","last_active":"2023-10-09T08:14:39.482797+0000","last_peered":"2023-10-09T08:14:39.482797+0000","last_clean":"2023-10-09T08:14:39.482797+0000","last_became_active":"2023-10-09T08:14:39.480773+0000","last_became_peered":"2023-10-09T08:14:39.480773+0000","last_unstale":"2023-10-09T08:14:39.482797+0000","last_undegraded":"2023-10-09T08:14:39.482797+0000","last_fullsized":"2023-10-09T08:14:39.482797+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:52.883026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.465016+0000","last_change":"2023-10-09T08:14:38.449804+0000","last_active":"2023-10-09T08:14:39.465016+0000","last_peered":"2023-10-09T08:14:39.465016+0000","last_clean":"2023-10-09T08:14:39.465016+0000","last_became_active":"2023-10-09T08:14:38.449525+0000","last_became_peered":"2023-10-09T08:14:38.449525+0000","last_unstale":"2023-10-09T08:14:39.465016+0000","last_undegraded":"2023-10-09T08:14:39.465016+0000","last_fullsized":"2023-10-09T08:14:39.465016+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:42:28.181427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.442793+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:44:04.977933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.482848+0000","last_change":"2023-10-09T08:14:39.477525+0000","last_active":"2023-10-09T08:14:39.482848+0000","last_peered":"2023-10-09T08:14:39.482848+0000","last_clean":"2023-10-09T08:14:39.482848+0000","last_became_active":"2023-10-09T08:14:39.477264+0000","last_became_peered":"2023-10-09T08:14:39.477264+0000","last_unstale":"2023-10-09T08:14:39.482848+0000","last_undegraded":"2023-10-09T08:14:39.482848+0000","last_fullsized":"2023-10-09T08:14:39.482848+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:11.301814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.464301+0000","last_change":"2023-10-09T08:14:38.454293+0000","last_active":"2023-10-09T08:14:39.464301+0000","last_peered":"2023-10-09T08:14:39.464301+0000","last_clean":"2023-10-09T08:14:39.464301+0000","last_became_active":"2023-10-09T08:14:38.453970+0000","last_became_peered":"2023-10-09T08:14:38.453970+0000","last_unstale":"2023-10-09T08:14:39.464301+0000","last_undegraded":"2023-10-09T08:14:39.464301+0000","last_fullsized":"2023-10-09T08:14:39.464301+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:10.748478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481977+0000","last_change":"2023-10-09T08:14:39.480148+0000","last_active":"2023-10-09T08:14:39.481977+0000","last_peered":"2023-10-09T08:14:39.481977+0000","last_clean":"2023-10-09T08:14:39.481977+0000","last_became_active":"2023-10-09T08:14:39.479903+0000","last_became_peered":"2023-10-09T08:14:39.479903+0000","last_unstale":"2023-10-09T08:14:39.481977+0000","last_undegraded":"2023-10-09T08:14:39.481977+0000","last_fullsized":"2023-10-09T08:14:39.481977+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:41:47.263574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.441856+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:03.250581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.483634+0000","last_change":"2023-10-09T08:14:39.480318+0000","last_active":"2023-10-09T08:14:39.483634+0000","last_peered":"2023-10-09T08:14:39.483634+0000","last_clean":"2023-10-09T08:14:39.483634+0000","last_became_active":"2023-10-09T08:14:39.479561+0000","last_became_peered":"2023-10-09T08:14:39.479561+0000","last_unstale":"2023-10-09T08:14:39.483634+0000","last_undegraded":"2023-10-09T08:14:39.483634+0000","last_fullsized":"2023-10-09T08:14:39.483634+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:33.890868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.466046+0000","last_change":"2023-10-09T08:14:38.456540+0000","last_active":"2023-10-09T08:14:39.466046+0000","last_peered":"2023-10-09T08:14:39.466046+0000","last_clean":"2023-10-09T08:14:39.466046+0000","last_became_active":"2023-10-09T08:14:38.456221+0000","last_became_peered":"2023-10-09T08:14:38.456221+0000","last_unstale":"2023-10-09T08:14:39.466046+0000","last_undegraded":"2023-10-09T08:14:39.466046+0000","last_fullsized":"2023-10-09T08:14:39.466046+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:26.714576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478577+0000","last_change":"2023-10-09T08:14:39.471342+0000","last_active":"2023-10-09T08:14:39.478577+0000","last_peered":"2023-10-09T08:14:39.478577+0000","last_clean":"2023-10-09T08:14:39.478577+0000","last_became_active":"2023-10-09T08:14:39.471053+0000","last_became_peered":"2023-10-09T08:14:39.471053+0000","last_unstale":"2023-10-09T08:14:39.478577+0000","last_undegraded":"2023-10-09T08:14:39.478577+0000","last_fullsized":"2023-10-09T08:14:39.478577+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:45.577995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"193'2","reported_seq":12,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.491340+0000","last_change":"2023-10-09T08:14:38.460625+0000","last_active":"2023-10-09T08:14:39.491340+0000","last_peered":"2023-10-09T08:14:39.491340+0000","last_clean":"2023-10-09T08:14:39.491340+0000","last_became_active":"2023-10-09T08:14:38.460321+0000","last_became_peered":"2023-10-09T08:14:38.460321+0000","last_unstale":"2023-10-09T08:14:39.491340+0000","last_undegraded":"2023-10-09T08:14:39.491340+0000","last_fullsized":"2023-10-09T08:14:39.491340+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:16:28.154856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481580+0000","last_change":"2023-10-09T08:14:39.478657+0000","last_active":"2023-10-09T08:14:39.481580+0000","last_peered":"2023-10-09T08:14:39.481580+0000","last_clean":"2023-10-09T08:14:39.481580+0000","last_became_active":"2023-10-09T08:14:39.478402+0000","last_became_peered":"2023-10-09T08:14:39.478402+0000","last_unstale":"2023-10-09T08:14:39.481580+0000","last_undegraded":"2023-10-09T08:14:39.481580+0000","last_fullsized":"2023-10-09T08:14:39.481580+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:34.938944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.439352+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:44:04.977933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.485101+0000","last_change":"2023-10-09T08:14:39.483531+0000","last_active":"2023-10-09T08:14:39.485101+0000","last_peered":"2023-10-09T08:14:39.485101+0000","last_clean":"2023-10-09T08:14:39.485101+0000","last_became_active":"2023-10-09T08:14:39.483236+0000","last_became_peered":"2023-10-09T08:14:39.483236+0000","last_unstale":"2023-10-09T08:14:39.485101+0000","last_undegraded":"2023-10-09T08:14:39.485101+0000","last_fullsized":"2023-10-09T08:14:39.485101+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:54:22.665528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.443544+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:07:03.303746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.472812+0000","last_change":"2023-10-09T08:14:39.468512+0000","last_active":"2023-10-09T08:14:39.472812+0000","last_peered":"2023-10-09T08:14:39.472812+0000","last_clean":"2023-10-09T08:14:39.472812+0000","last_became_active":"2023-10-09T08:14:39.468158+0000","last_became_peered":"2023-10-09T08:14:39.468158+0000","last_unstale":"2023-10-09T08:14:39.472812+0000","last_undegraded":"2023-10-09T08:14:39.472812+0000","last_fullsized":"2023-10-09T08:14:39.472812+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:04.566842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.458202+0000","last_change":"2023-10-09T08:14:38.464753+0000","last_active":"2023-10-09T08:14:39.458202+0000","last_peered":"2023-10-09T08:14:39.458202+0000","last_clean":"2023-10-09T08:14:39.458202+0000","last_became_active":"2023-10-09T08:14:38.464494+0000","last_became_peered":"2023-10-09T08:14:38.464494+0000","last_unstale":"2023-10-09T08:14:39.458202+0000","last_undegraded":"2023-10-09T08:14:39.458202+0000","last_fullsized":"2023-10-09T08:14:39.458202+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:03.238219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.484321+0000","last_change":"2023-10-09T08:14:39.482147+0000","last_active":"2023-10-09T08:14:39.484321+0000","last_peered":"2023-10-09T08:14:39.484321+0000","last_clean":"2023-10-09T08:14:39.484321+0000","last_became_active":"2023-10-09T08:14:39.481901+0000","last_became_peered":"2023-10-09T08:14:39.481901+0000","last_unstale":"2023-10-09T08:14:39.484321+0000","last_undegraded":"2023-10-09T08:14:39.484321+0000","last_fullsized":"2023-10-09T08:14:39.484321+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:30.483504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.438592+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:49.393514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.442937+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:49:23.713246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481621+0000","last_change":"2023-10-09T08:14:39.477716+0000","last_active":"2023-10-09T08:14:39.481621+0000","last_peered":"2023-10-09T08:14:39.481621+0000","last_clean":"2023-10-09T08:14:39.481621+0000","last_became_active":"2023-10-09T08:14:39.477119+0000","last_became_peered":"2023-10-09T08:14:39.477119+0000","last_unstale":"2023-10-09T08:14:39.481621+0000","last_undegraded":"2023-10-09T08:14:39.481621+0000","last_fullsized":"2023-10-09T08:14:39.481621+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:47.340414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.443699+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:26.250981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.439589+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:33.528262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478617+0000","last_change":"2023-10-09T08:14:39.472193+0000","last_active":"2023-10-09T08:14:39.478617+0000","last_peered":"2023-10-09T08:14:39.478617+0000","last_clean":"2023-10-09T08:14:39.478617+0000","last_became_active":"2023-10-09T08:14:39.471886+0000","last_became_peered":"2023-10-09T08:14:39.471886+0000","last_unstale":"2023-10-09T08:14:39.478617+0000","last_undegraded":"2023-10-09T08:14:39.478617+0000","last_fullsized":"2023-10-09T08:14:39.478617+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:02:07.699719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.439194+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:23:34.614137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"183'326","reported_seq":1052,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.466136+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T08:14:39.466136+0000","last_peered":"2023-10-09T08:14:39.466136+0000","last_clean":"2023-10-09T08:14:39.466136+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T08:14:39.466136+0000","last_undegraded":"2023-10-09T08:14:39.466136+0000","last_fullsized":"2023-10-09T08:14:39.466136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":714,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575944,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312548,"kb_used_data":2972,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059292,"statfs":{"total":96636764160,"available":96316715008,"internally_reserved":0,"allocated":3043328,"data_stored":1813297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.748,"15min":0.755},"min":{"1min":0.49199999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97699999999999998,"5min":1.002,"15min":1.1220000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.755,"15min":0.751},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.44500000000000001},"max":{"1min":1.0069999999999999,"5min":1.0129999999999999,"15min":1.0209999999999999},"last":0.91900000000000004}]},{"osd":1,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.746,"15min":0.746},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":1.024},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.747,"15min":0.751},"min":{"1min":0.503,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.01}]},{"osd":2,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.752,"15min":0.753},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.77300000000000002,"15min":0.77400000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.442},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.86499999999999999}]},{"osd":3,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.755,"15min":0.74199999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.47999999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.78200000000000003,"15min":0.78000000000000003},"min":{"1min":0.61499999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.97999999999999998}]},{"osd":4,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.624,"15min":0.60899999999999999},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.38300000000000001},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.45500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.89400000000000002}]},{"osd":5,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.53400000000000003,"5min":0.41699999999999998,"15min":0.40100000000000002},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.75600000000000001,"15min":0.746},"min":{"1min":0.60499999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.72399999999999998,"15min":0.71399999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.70399999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311896,"kb_used_data":2320,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059944,"statfs":{"total":96636764160,"available":96317382656,"internally_reserved":0,"allocated":2375680,"data_stored":1193592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.749,"15min":0.753},"min":{"1min":0.46899999999999997,"5min":0.45900000000000002,"15min":0.40300000000000002},"max":{"1min":0.97799999999999998,"5min":0.99299999999999999,"15min":1.0449999999999999},"last":0.747},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.44400000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94099999999999995,"5min":0.94499999999999995,"15min":0.97399999999999998},"last":0.58299999999999996}]},{"osd":1,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.753,"15min":0.755},"min":{"1min":0.54700000000000004,"5min":0.499,"15min":0.38500000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77000000000000002,"15min":0.76300000000000001},"min":{"1min":0.59499999999999997,"5min":0.52800000000000002,"15min":0.47999999999999998},"max":{"1min":1.018,"5min":1.0269999999999999,"15min":1.097},"last":0.77200000000000002}]},{"osd":2,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.46400000000000002},"max":{"1min":1.004,"5min":1.0109999999999999,"15min":1.0329999999999999},"last":0.505},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77200000000000002,"15min":0.77800000000000002},"min":{"1min":0.52300000000000002,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0660000000000001},"last":0.61399999999999999}]},{"osd":3,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.54300000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.004,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.61599999999999999,"5min":0.51100000000000001,"15min":0.49299999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0680000000000001},"last":0.54100000000000004}]},{"osd":4,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.40600000000000003,"15min":0.40200000000000002},"max":{"1min":0.92000000000000004,"5min":1.032,"15min":1.1339999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.44800000000000001,"5min":0.39700000000000002,"15min":0.32000000000000001},"max":{"1min":0.82699999999999996,"5min":0.91900000000000004,"15min":0.97099999999999997},"last":0.73899999999999999}]},{"osd":5,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.40100000000000002},"max":{"1min":0.90900000000000003,"5min":0.93400000000000005,"15min":0.98899999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.45200000000000001},"max":{"1min":0.97599999999999998,"5min":1.0880000000000001,"15min":1.121},"last":0.71399999999999997}]},{"osd":7,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70199999999999996,"15min":0.69699999999999995},"min":{"1min":0.49399999999999999,"5min":0.45600000000000002,"15min":0.36299999999999999},"max":{"1min":0.93200000000000005,"5min":0.98699999999999999,"15min":1.0309999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.75800000000000001,"15min":0.74299999999999999},"min":{"1min":0.54400000000000004,"5min":0.48699999999999999,"15min":0.442},"max":{"1min":0.95599999999999996,"5min":0.96799999999999997,"15min":1.139},"last":0.60199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575943,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307812,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064028,"statfs":{"total":96636764160,"available":96321564672,"internally_reserved":0,"allocated":2387968,"data_stored":1199889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45300000000000001,"15min":0.46000000000000002},"min":{"1min":0.34200000000000003,"5min":0.29799999999999999,"15min":0.28799999999999998},"max":{"1min":0.621,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.441},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52400000000000002,"15min":0.51500000000000001},"min":{"1min":0.39500000000000002,"5min":0.34899999999999998,"15min":0.32400000000000001},"max":{"1min":0.66300000000000003,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.46100000000000002}]},{"osd":2,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.51200000000000001},"min":{"1min":0.379,"5min":0.34200000000000003,"15min":0.318},"max":{"1min":0.624,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.58999999999999997},"min":{"1min":0.44900000000000001,"5min":0.433,"15min":0.39500000000000002},"max":{"1min":0.69899999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.505}]},{"osd":3,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.505,"5min":0.42699999999999999,"15min":0.41099999999999998},"max":{"1min":0.76800000000000002,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.51200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76100000000000001,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.40300000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.76000000000000001,"15min":0.78500000000000003},"min":{"1min":0.64400000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.125,"5min":1.125,"15min":1.224},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.81200000000000006,"15min":0.80300000000000005},"min":{"1min":0.61199999999999999,"5min":0.55800000000000005,"15min":0.51800000000000002},"max":{"1min":1.071,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.65000000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0940000000000001,"5min":1.77,"15min":1.77},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.79300000000000004,"15min":0.81200000000000006},"min":{"1min":0.65600000000000003,"5min":0.56100000000000005,"15min":0.49299999999999999},"max":{"1min":1.054,"5min":1.0569999999999999,"15min":1.288},"last":0.64600000000000002}]},{"osd":6,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.83399999999999996,"15min":0.82399999999999995},"min":{"1min":0.69499999999999995,"5min":0.57199999999999995,"15min":0.505},"max":{"1min":1.143,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.85699999999999998,"15min":0.84099999999999997},"min":{"1min":0.59999999999999998,"5min":0.57499999999999996,"15min":0.53800000000000003},"max":{"1min":1.105,"5min":1.843,"15min":1.843},"last":0.66300000000000003}]},{"osd":7,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.876,"15min":0.86499999999999999},"min":{"1min":0.748,"5min":0.64000000000000001,"15min":0.58599999999999997},"max":{"1min":1.135,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.85399999999999998,"15min":0.85299999999999998},"min":{"1min":0.65700000000000003,"5min":0.61799999999999999,"15min":0.54300000000000004},"max":{"1min":1.1659999999999999,"5min":1.21,"15min":1.347},"last":0.73399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575943,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308428,"kb_used_data":2948,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063412,"statfs":{"total":96636764160,"available":96320933888,"internally_reserved":0,"allocated":3018752,"data_stored":1811047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48999999999999999,"15min":0.48499999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.29199999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.34899999999999998,"5min":0.34599999999999997,"15min":0.318},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.92300000000000004},"last":0.33500000000000002}]},{"osd":2,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57699999999999996,"15min":0.58399999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.36499999999999999,"5min":0.35999999999999999,"15min":0.34499999999999997},"max":{"1min":0.70499999999999996,"5min":0.77300000000000002,"15min":0.81999999999999995},"last":0.39700000000000002}]},{"osd":3,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.35099999999999998},"max":{"1min":0.78200000000000003,"5min":0.79400000000000004,"15min":0.80500000000000005},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60999999999999999,"15min":0.621},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.93200000000000005},"last":0.51800000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81200000000000006,"15min":0.78800000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.42899999999999999},"max":{"1min":0.98299999999999998,"5min":1.226,"15min":1.232},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57699999999999996,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0649999999999999,"5min":1.196,"15min":1.23},"last":0.61399999999999999}]},{"osd":5,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.82199999999999995,"15min":0.81499999999999995},"min":{"1min":0.60599999999999998,"5min":0.57299999999999995,"15min":0.501},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.262},"last":0.621},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.83099999999999996,"15min":0.82299999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.52100000000000002},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.79600000000000004}]},{"osd":6,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.86099999999999999,"15min":0.85199999999999998},"min":{"1min":0.64600000000000002,"5min":0.59599999999999997,"15min":0.58899999999999997},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.747},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83299999999999996,"15min":0.83099999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0920000000000001,"5min":1.24,"15min":1.3029999999999999},"last":0.58999999999999997}]},{"osd":7,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.86099999999999999,"15min":0.86499999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2370000000000001,"5min":1.2929999999999999,"15min":1.3540000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.88700000000000001,"15min":0.88200000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.58199999999999996},"max":{"1min":1.085,"5min":1.1519999999999999,"15min":1.3380000000000001},"last":0.66200000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575943,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316044,"kb_used_data":2372,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055796,"statfs":{"total":96636764160,"available":96313135104,"internally_reserved":0,"allocated":2428928,"data_stored":1220769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.47199999999999998,"15min":0.46500000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64500000000000002,"5min":0.71099999999999997,"15min":0.752},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.501,"15min":0.504},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64800000000000002,"5min":0.73299999999999998,"15min":0.82899999999999996},"last":0.48099999999999998}]},{"osd":1,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.499,"15min":0.495},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.33700000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55100000000000005,"15min":0.54200000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34699999999999998},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.40699999999999997}]},{"osd":3,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39200000000000002},"max":{"1min":0.89000000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.442},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64000000000000001,"15min":0.63900000000000001},"min":{"1min":0.47899999999999998,"5min":0.43099999999999999,"15min":0.38100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.94199999999999995},"last":0.46899999999999997}]},{"osd":4,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.80800000000000005,"15min":0.80900000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":0.96699999999999997,"5min":1.089,"15min":1.089},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.80200000000000005,"15min":0.79600000000000004},"min":{"1min":0.61699999999999999,"5min":0.54200000000000004,"15min":0.48399999999999999},"max":{"1min":1.107,"5min":1.133,"15min":1.1399999999999999},"last":1.0700000000000001}]},{"osd":5,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82499999999999996,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.51800000000000002},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":1.022},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.82799999999999996,"15min":0.82599999999999996},"min":{"1min":0.60199999999999998,"5min":0.54700000000000004,"15min":0.47799999999999998},"max":{"1min":1.052,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.98699999999999999}]},{"osd":6,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.84099999999999997,"15min":0.82799999999999996},"min":{"1min":0.57999999999999996,"5min":0.56299999999999994,"15min":0.52700000000000002},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.163},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.83899999999999997,"15min":0.83299999999999996},"min":{"1min":0.59399999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1020000000000001,"5min":1.109,"15min":1.224},"last":1.103}]},{"osd":7,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86599999999999999,"15min":0.85899999999999999},"min":{"1min":0.66700000000000004,"5min":0.60199999999999998,"15min":0.47899999999999998},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.198},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":1.157}]}]},{"osd":3,"up_from":13,"seq":55834575944,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2372,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2428928,"data_stored":1220713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47599999999999998,"15min":0.48999999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.30599999999999999},"max":{"1min":0.65800000000000003,"5min":0.68799999999999994,"15min":0.85999999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.5,"15min":0.51000000000000001},"min":{"1min":0.33900000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.79600000000000004},"last":0.53800000000000003}]},{"osd":1,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52100000000000002,"15min":0.51300000000000001},"min":{"1min":0.38300000000000001,"5min":0.34599999999999997,"15min":0.34300000000000003},"max":{"1min":0.70999999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.374},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59299999999999997,"15min":0.58099999999999996},"min":{"1min":0.439,"5min":0.43099999999999999,"15min":0.378},"max":{"1min":0.84999999999999998,"5min":0.85999999999999999,"15min":0.91300000000000003},"last":0.47399999999999998}]},{"osd":2,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.49199999999999999,"5min":0.41599999999999998,"15min":0.40400000000000003},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.97299999999999998},"last":0.443},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66100000000000003,"15min":0.66400000000000003},"min":{"1min":0.54000000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82299999999999995,"5min":0.879,"15min":1.036},"last":0.51500000000000001}]},{"osd":4,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78300000000000003,"15min":0.78100000000000003},"min":{"1min":0.56599999999999995,"5min":0.54100000000000004,"15min":0.46000000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.872,"5min":0.86599999999999999,"15min":0.871},"min":{"1min":0.69999999999999996,"5min":0.69899999999999995,"15min":0.66000000000000003},"max":{"1min":1.0629999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.60499999999999998}]},{"osd":5,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76900000000000002,"15min":0.77500000000000002},"min":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.47399999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.24},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.84199999999999997,"15min":0.83999999999999997},"min":{"1min":0.69099999999999995,"5min":0.66100000000000003,"15min":0.56899999999999995},"max":{"1min":0.996,"5min":1.1719999999999999,"15min":1.1739999999999999},"last":0.57599999999999996}]},{"osd":6,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79500000000000004,"15min":0.80600000000000005},"min":{"1min":0.623,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.099,"5min":1.099,"15min":1.206},"last":0.87},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.81200000000000006,"15min":0.81899999999999995},"min":{"1min":0.66900000000000004,"5min":0.56100000000000005,"15min":0.54800000000000004},"max":{"1min":1.0629999999999999,"5min":1.1339999999999999,"15min":1.1870000000000001},"last":0.73799999999999999}]},{"osd":7,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.85699999999999998,"15min":0.85999999999999999},"min":{"1min":0.70199999999999996,"5min":0.623,"15min":0.53700000000000003},"max":{"1min":1.0800000000000001,"5min":1.1839999999999999,"15min":1.3280000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.85399999999999998,"15min":0.85999999999999999},"min":{"1min":0.64400000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.147,"5min":1.1639999999999999,"15min":1.2869999999999999},"last":0.83399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299620,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072220,"statfs":{"total":96636764160,"available":96329953280,"internally_reserved":0,"allocated":2387968,"data_stored":1199889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73099999999999998,"15min":0.72999999999999998},"min":{"1min":0.60399999999999998,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":0.94799999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.745,"15min":0.74399999999999999},"min":{"1min":0.51300000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.69999999999999996}]},{"osd":1,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.73299999999999998,"15min":0.72699999999999998},"min":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.51000000000000001},"max":{"1min":0.83499999999999996,"5min":1.03,"15min":1.03},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.53100000000000003,"5min":0.442,"15min":0.42799999999999999},"max":{"1min":0.97299999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.78900000000000003}]},{"osd":2,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81200000000000006,"15min":0.79900000000000004},"min":{"1min":0.65300000000000002,"5min":0.51400000000000001,"15min":0.45000000000000001},"max":{"1min":0.99399999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.81399999999999995,"15min":0.81000000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.47999999999999998},"max":{"1min":0.95699999999999996,"5min":1.077,"15min":1.077},"last":0.66400000000000003}]},{"osd":3,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.754,"15min":0.748},"min":{"1min":0.57799999999999996,"5min":0.51500000000000001,"15min":0.45900000000000002},"max":{"1min":0.92000000000000004,"5min":1.016,"15min":1.018},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.76900000000000002,"15min":0.77200000000000002},"min":{"1min":0.57199999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.89700000000000002,"5min":1.036,"15min":1.036},"last":0.80100000000000005}]},{"osd":5,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.38800000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.83599999999999997,"5min":0.94899999999999995,"15min":1.006},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63100000000000001,"15min":0.63200000000000001},"min":{"1min":0.46899999999999997,"5min":0.42099999999999999,"15min":0.40100000000000002},"max":{"1min":0.94199999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.42499999999999999}]},{"osd":6,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64300000000000002,"15min":0.63400000000000001},"min":{"1min":0.47399999999999998,"5min":0.42399999999999999,"15min":0.42299999999999999},"max":{"1min":1.012,"5min":1.022,"15min":1.034},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67400000000000004,"15min":0.68200000000000005},"min":{"1min":0.48899999999999999,"5min":0.437,"15min":0.42999999999999999},"max":{"1min":0.96499999999999997,"5min":0.998,"15min":1.0609999999999999},"last":0.64300000000000002}]},{"osd":7,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.53400000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.0580000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.77700000000000002},"min":{"1min":0.61799999999999999,"5min":0.48499999999999999,"15min":0.443},"max":{"1min":1.056,"5min":1.0629999999999999,"15min":1.079},"last":0.89400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575943,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316004,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055836,"statfs":{"total":96636764160,"available":96313176064,"internally_reserved":0,"allocated":2387968,"data_stored":1199889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96999999999999997,"5min":0.998,"15min":1.0780000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71699999999999997,"15min":0.71799999999999997},"min":{"1min":0.51500000000000001,"5min":0.42999999999999999,"15min":0.40899999999999997},"max":{"1min":0.91100000000000003,"5min":0.97399999999999998,"15min":1.018},"last":0.57899999999999996}]},{"osd":1,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72299999999999998,"15min":0.72399999999999998},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90100000000000002,"5min":1.0129999999999999,"15min":1.1140000000000001},"last":0.628},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.435},"max":{"1min":0.89800000000000002,"5min":1.0029999999999999,"15min":1.0169999999999999},"last":0.72999999999999998}]},{"osd":2,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.754,"15min":0.751},"min":{"1min":0.58799999999999997,"5min":0.499,"15min":0.48699999999999999},"max":{"1min":0.92200000000000004,"5min":1.115,"15min":1.115},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.48299999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99299999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.55200000000000005}]},{"osd":3,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.748},"min":{"1min":0.50900000000000001,"5min":0.49199999999999999,"15min":0.48299999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":1.0409999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.57799999999999996,"5min":0.54600000000000004,"15min":0.51500000000000001},"max":{"1min":0.95299999999999996,"5min":1.0189999999999999,"15min":1.0620000000000001},"last":0.66600000000000004}]},{"osd":4,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.38200000000000001},"max":{"1min":0.75700000000000001,"5min":0.96699999999999997,"15min":0.995},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60599999999999998,"15min":0.61099999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88500000000000001,"5min":0.94399999999999995,"15min":0.96599999999999997},"last":0.499}]},{"osd":6,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93799999999999994,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.749},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.67900000000000005,"15min":0.67400000000000004},"min":{"1min":0.53300000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91500000000000004,"5min":0.97099999999999997,"15min":1.006},"last":0.68200000000000005}]},{"osd":7,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69799999999999995,"15min":0.68899999999999995},"min":{"1min":0.55000000000000004,"5min":0.46999999999999997,"15min":0.44400000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.76700000000000002},"min":{"1min":0.58799999999999997,"5min":0.57299999999999995,"15min":0.48599999999999999},"max":{"1min":0.97099999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T08:14:44.237 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T08:14:44.430 INFO:tasks.ceph.mds.d.smithi179.stderr:2023-10-09T08:14:44.430+0000 7f8143ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T08:14:44.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.450+0000 7f13aa1ff700 1 Processor -- start 2023-10-09T08:14:44.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.451+0000 7f13aa1ff700 1 -- start start 2023-10-09T08:14:44.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.452+0000 7f13aa1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13a40b1c20 0x7f13a41572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:44.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.452+0000 7f13aa1ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f13a4157820 0x7f13a40abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:44.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.452+0000 7f13aa1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a4157c80 con 0x7f13a40b1850 2023-10-09T08:14:44.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.452+0000 7f13aa1ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a406fc30 con 0x7f13a4157820 2023-10-09T08:14:44.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.452+0000 7f13aa1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a40cc260 con 0x7f13a40b1c20 2023-10-09T08:14:44.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.452+0000 7f13a3fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f13a4157820 0x7f13a40abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:44.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.452+0000 7f13a3fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f13a4157820 0x7f13a40abf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51358/0 (socket says 172.21.15.71:51358) 2023-10-09T08:14:44.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.452+0000 7f13a3fff700 1 -- 172.21.15.71:0/3000637907 learned_addr learned my addr 172.21.15.71:0/3000637907 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:44.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.452+0000 7f13a2ffd700 1 --2- 172.21.15.71:0/3000637907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13a40b1c20 0x7f13a41572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:44.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.453+0000 7f13a3fff700 1 -- 172.21.15.71:0/3000637907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13a40b1c20 msgr2=0x7f13a41572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:44.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.453+0000 7f13a3fff700 1 --2- 172.21.15.71:0/3000637907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13a40b1c20 0x7f13a41572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.453+0000 7f13a3fff700 1 -- 172.21.15.71:0/3000637907 >> v1:172.21.15.179:6789/0 conn(0x7f13a40b1850 legacy=0x7f13a40ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:44.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.453+0000 7f13a3fff700 1 -- 172.21.15.71:0/3000637907 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a40cb300 con 0x7f13a4157820 2023-10-09T08:14:44.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.453+0000 7f13a2ffd700 1 --2- 172.21.15.71:0/3000637907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13a40b1c20 0x7f13a41572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:14:44.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.453+0000 7f13a3fff700 1 --2- 172.21.15.71:0/3000637907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a4157820 0x7f13a40abf60 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f139c009f20 tx=0x7f139c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b54c40446e147f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:44.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.453+0000 7f13a27fc700 1 -- 172.21.15.71:0/3000637907 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c00e070 con 0x7f13a4157820 2023-10-09T08:14:44.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.453+0000 7f13a27fc700 1 -- 172.21.15.71:0/3000637907 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139c00ba80 con 0x7f13a4157820 2023-10-09T08:14:44.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.453+0000 7f13a27fc700 1 -- 172.21.15.71:0/3000637907 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c0092e0 con 0x7f13a4157820 2023-10-09T08:14:44.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.454+0000 7f13aa1ff700 1 -- 172.21.15.71:0/3000637907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a4157820 msgr2=0x7f13a40abf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:44.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.454+0000 7f13aa1ff700 1 --2- 172.21.15.71:0/3000637907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a4157820 0x7f13a40abf60 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f139c009f20 tx=0x7f139c009840 comp rx=0 tx=0).stop 2023-10-09T08:14:44.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.454+0000 7f13aa1ff700 1 -- 172.21.15.71:0/3000637907 shutdown_connections 2023-10-09T08:14:44.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.454+0000 7f13aa1ff700 1 --2- 172.21.15.71:0/3000637907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a4157820 0x7f13a40abf60 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.454+0000 7f13aa1ff700 1 --2- 172.21.15.71:0/3000637907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13a40b1c20 0x7f13a41572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.454+0000 7f13aa1ff700 1 -- 172.21.15.71:0/3000637907 >> 172.21.15.71:0/3000637907 conn(0x7f13a406a320 msgr2=0x7f13a40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:44.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.454+0000 7f13aa1ff700 1 -- 172.21.15.71:0/3000637907 shutdown_connections 2023-10-09T08:14:44.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.454+0000 7f13aa1ff700 1 -- 172.21.15.71:0/3000637907 wait complete. 2023-10-09T08:14:44.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.455+0000 7f13aa1ff700 1 Processor -- start 2023-10-09T08:14:44.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.455+0000 7f13aa1ff700 1 -- start start 2023-10-09T08:14:44.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.456+0000 7f13aa1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13a40b1850 0x7f13a415df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:44.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.456+0000 7f13aa1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13a40b1c20 0x7f13a40ab510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:44.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.456+0000 7f13aa1ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a4157820 0x7f13a406e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:44.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.456+0000 7f13aa1ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a415e4d0 con 0x7f13a4157820 2023-10-09T08:14:44.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.456+0000 7f13aa1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a415c370 con 0x7f13a40b1c20 2023-10-09T08:14:44.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.456+0000 7f13aa1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a415c650 con 0x7f13a40b1850 2023-10-09T08:14:44.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.456+0000 7f13a3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a4157820 0x7f13a406e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:44.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.457+0000 7f13a3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a4157820 0x7f13a406e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51360/0 (socket says 172.21.15.71:51360) 2023-10-09T08:14:44.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.457+0000 7f13a3fff700 1 -- 172.21.15.71:0/472721056 learned_addr learned my addr 172.21.15.71:0/472721056 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:44.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.457+0000 7f13a2ffd700 1 --2- 172.21.15.71:0/472721056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13a40b1c20 0x7f13a40ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:44.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.457+0000 7f13a37fe700 1 --2- 172.21.15.71:0/472721056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13a40b1850 0x7f13a415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:44.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.457+0000 7f13a3fff700 1 -- 172.21.15.71:0/472721056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13a40b1850 msgr2=0x7f13a415df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:44.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.457+0000 7f13a3fff700 1 --2- 172.21.15.71:0/472721056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13a40b1850 0x7f13a415df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.457+0000 7f13a3fff700 1 -- 172.21.15.71:0/472721056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13a40b1c20 msgr2=0x7f13a40ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:44.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.457+0000 7f13a3fff700 1 --2- 172.21.15.71:0/472721056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13a40b1c20 0x7f13a40ab510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.457+0000 7f13a3fff700 1 -- 172.21.15.71:0/472721056 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139c009ae0 con 0x7f13a4157820 2023-10-09T08:14:44.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.457+0000 7f13a3fff700 1 --2- 172.21.15.71:0/472721056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a4157820 0x7f13a406e860 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f139c00b6c0 tx=0x7f139c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:44.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.457+0000 7f138b7fe700 1 -- 172.21.15.71:0/472721056 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c0032f0 con 0x7f13a4157820 2023-10-09T08:14:44.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.457+0000 7f138b7fe700 1 -- 172.21.15.71:0/472721056 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139c01c410 con 0x7f13a4157820 2023-10-09T08:14:44.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.457+0000 7f138b7fe700 1 -- 172.21.15.71:0/472721056 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c01c7b0 con 0x7f13a4157820 2023-10-09T08:14:44.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.457+0000 7f13aa1ff700 1 -- 172.21.15.71:0/472721056 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a415c930 con 0x7f13a4157820 2023-10-09T08:14:44.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.458+0000 7f13aa1ff700 1 -- 172.21.15.71:0/472721056 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a415cef0 con 0x7f13a4157820 2023-10-09T08:14:44.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.458+0000 7f13aa1ff700 1 -- 172.21.15.71:0/472721056 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a4169d00 con 0x7f13a4157820 2023-10-09T08:14:44.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.459+0000 7f138b7fe700 1 -- 172.21.15.71:0/472721056 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f139c003040 con 0x7f13a4157820 2023-10-09T08:14:44.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.460+0000 7f138b7fe700 1 --2- 172.21.15.71:0/472721056 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1390066f30 0x7f13900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:44.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.460+0000 7f138b7fe700 1 -- 172.21.15.71:0/472721056 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f139c085fc0 con 0x7f13a4157820 2023-10-09T08:14:44.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.461+0000 7f13a37fe700 1 --2- 172.21.15.71:0/472721056 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1390066f30 0x7f13900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:44.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.461+0000 7f13a37fe700 1 --2- 172.21.15.71:0/472721056 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1390066f30 0x7f13900693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1394003860 tx=0x7f1394009040 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:44.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.464+0000 7f138b7fe700 1 -- 172.21.15.71:0/472721056 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13a4169d00 con 0x7f13a4157820 2023-10-09T08:14:44.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.651+0000 7f13aa1ff700 1 -- 172.21.15.71:0/472721056 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13a4169d00 con 0x7f1390066f30 2023-10-09T08:14:44.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.661+0000 7f138b7fe700 1 -- 172.21.15.71:0/472721056 <== mgr.8965 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283647 (secure 0 0 0) 0x7f13a4169d00 con 0x7f1390066f30 2023-10-09T08:14:44.665 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:14:44.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.665+0000 7f13aa1ff700 1 -- 172.21.15.71:0/472721056 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1390066f30 msgr2=0x7f13900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:44.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.665+0000 7f13aa1ff700 1 --2- 172.21.15.71:0/472721056 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1390066f30 0x7f13900693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1394003860 tx=0x7f1394009040 comp rx=0 tx=0).stop 2023-10-09T08:14:44.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.665+0000 7f13aa1ff700 1 -- 172.21.15.71:0/472721056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a4157820 msgr2=0x7f13a406e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:44.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.665+0000 7f13aa1ff700 1 --2- 172.21.15.71:0/472721056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a4157820 0x7f13a406e860 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f139c00b6c0 tx=0x7f139c018000 comp rx=0 tx=0).stop 2023-10-09T08:14:44.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.665+0000 7f13aa1ff700 1 -- 172.21.15.71:0/472721056 shutdown_connections 2023-10-09T08:14:44.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.665+0000 7f13aa1ff700 1 --2- 172.21.15.71:0/472721056 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1390066f30 0x7f13900693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.665+0000 7f13aa1ff700 1 --2- 172.21.15.71:0/472721056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a4157820 0x7f13a406e860 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.665+0000 7f13aa1ff700 1 --2- 172.21.15.71:0/472721056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13a40b1850 0x7f13a415df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.665+0000 7f13aa1ff700 1 --2- 172.21.15.71:0/472721056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13a40b1c20 0x7f13a40ab510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.665+0000 7f13aa1ff700 1 -- 172.21.15.71:0/472721056 >> 172.21.15.71:0/472721056 conn(0x7f13a406a320 msgr2=0x7f13a4152ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:44.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.665+0000 7f13aa1ff700 1 -- 172.21.15.71:0/472721056 shutdown_connections 2023-10-09T08:14:44.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.665+0000 7f13aa1ff700 1 -- 172.21.15.71:0/472721056 wait complete. 2023-10-09T08:14:44.669 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T08:14:44.682 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T08:14:43.140714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591082,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":551,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":336,"ondisk_log_size":336,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2484300,"kb_used_data":19980,"kb_used_omap":0,"kb_used_meta":2464256,"kb_avail":752490420,"statfs":{"total":773094113280,"available":770550190080,"internally_reserved":0,"allocated":20459520,"data_stored":10859085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2523398144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":714,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.704517"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.484338+0000","last_change":"2023-10-09T08:14:39.481559+0000","last_active":"2023-10-09T08:14:39.484338+0000","last_peered":"2023-10-09T08:14:39.484338+0000","last_clean":"2023-10-09T08:14:39.484338+0000","last_became_active":"2023-10-09T08:14:39.481257+0000","last_became_peered":"2023-10-09T08:14:39.481257+0000","last_unstale":"2023-10-09T08:14:39.484338+0000","last_undegraded":"2023-10-09T08:14:39.484338+0000","last_fullsized":"2023-10-09T08:14:39.484338+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:47.340414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.483532+0000","last_change":"2023-10-09T08:14:39.479211+0000","last_active":"2023-10-09T08:14:39.483532+0000","last_peered":"2023-10-09T08:14:39.483532+0000","last_clean":"2023-10-09T08:14:39.483532+0000","last_became_active":"2023-10-09T08:14:39.478472+0000","last_became_peered":"2023-10-09T08:14:39.478472+0000","last_unstale":"2023-10-09T08:14:39.483532+0000","last_undegraded":"2023-10-09T08:14:39.483532+0000","last_fullsized":"2023-10-09T08:14:39.483532+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:37:42.156487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.487669+0000","last_change":"2023-10-09T08:14:39.486690+0000","last_active":"2023-10-09T08:14:39.487669+0000","last_peered":"2023-10-09T08:14:39.487669+0000","last_clean":"2023-10-09T08:14:39.487669+0000","last_became_active":"2023-10-09T08:14:39.486410+0000","last_became_peered":"2023-10-09T08:14:39.486410+0000","last_unstale":"2023-10-09T08:14:39.487669+0000","last_undegraded":"2023-10-09T08:14:39.487669+0000","last_fullsized":"2023-10-09T08:14:39.487669+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:30.404764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481865+0000","last_change":"2023-10-09T08:14:39.479153+0000","last_active":"2023-10-09T08:14:39.481865+0000","last_peered":"2023-10-09T08:14:39.481865+0000","last_clean":"2023-10-09T08:14:39.481865+0000","last_became_active":"2023-10-09T08:14:39.478895+0000","last_became_peered":"2023-10-09T08:14:39.478895+0000","last_unstale":"2023-10-09T08:14:39.481865+0000","last_undegraded":"2023-10-09T08:14:39.481865+0000","last_fullsized":"2023-10-09T08:14:39.481865+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:40.161626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481640+0000","last_change":"2023-10-09T08:14:39.477874+0000","last_active":"2023-10-09T08:14:39.481640+0000","last_peered":"2023-10-09T08:14:39.481640+0000","last_clean":"2023-10-09T08:14:39.481640+0000","last_became_active":"2023-10-09T08:14:39.477475+0000","last_became_peered":"2023-10-09T08:14:39.477475+0000","last_unstale":"2023-10-09T08:14:39.481640+0000","last_undegraded":"2023-10-09T08:14:39.481640+0000","last_fullsized":"2023-10-09T08:14:39.481640+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:50:38.316596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.484420+0000","last_change":"2023-10-09T08:14:39.481354+0000","last_active":"2023-10-09T08:14:39.484420+0000","last_peered":"2023-10-09T08:14:39.484420+0000","last_clean":"2023-10-09T08:14:39.484420+0000","last_became_active":"2023-10-09T08:14:39.481092+0000","last_became_peered":"2023-10-09T08:14:39.481092+0000","last_unstale":"2023-10-09T08:14:39.484420+0000","last_undegraded":"2023-10-09T08:14:39.484420+0000","last_fullsized":"2023-10-09T08:14:39.484420+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:50.399165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478600+0000","last_change":"2023-10-09T08:14:39.471598+0000","last_active":"2023-10-09T08:14:39.478600+0000","last_peered":"2023-10-09T08:14:39.478600+0000","last_clean":"2023-10-09T08:14:39.478600+0000","last_became_active":"2023-10-09T08:14:39.471342+0000","last_became_peered":"2023-10-09T08:14:39.471342+0000","last_unstale":"2023-10-09T08:14:39.478600+0000","last_undegraded":"2023-10-09T08:14:39.478600+0000","last_fullsized":"2023-10-09T08:14:39.478600+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:18:14.449986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.488248+0000","last_change":"2023-10-09T08:14:39.487286+0000","last_active":"2023-10-09T08:14:39.488248+0000","last_peered":"2023-10-09T08:14:39.488248+0000","last_clean":"2023-10-09T08:14:39.488248+0000","last_became_active":"2023-10-09T08:14:39.486306+0000","last_became_peered":"2023-10-09T08:14:39.486306+0000","last_unstale":"2023-10-09T08:14:39.488248+0000","last_undegraded":"2023-10-09T08:14:39.488248+0000","last_fullsized":"2023-10-09T08:14:39.488248+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:54.313934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.477409+0000","last_change":"2023-10-09T08:14:39.471677+0000","last_active":"2023-10-09T08:14:39.477409+0000","last_peered":"2023-10-09T08:14:39.477409+0000","last_clean":"2023-10-09T08:14:39.477409+0000","last_became_active":"2023-10-09T08:14:39.471412+0000","last_became_peered":"2023-10-09T08:14:39.471412+0000","last_unstale":"2023-10-09T08:14:39.477409+0000","last_undegraded":"2023-10-09T08:14:39.477409+0000","last_fullsized":"2023-10-09T08:14:39.477409+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:15:48.546235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.483651+0000","last_change":"2023-10-09T08:14:39.480496+0000","last_active":"2023-10-09T08:14:39.483651+0000","last_peered":"2023-10-09T08:14:39.483651+0000","last_clean":"2023-10-09T08:14:39.483651+0000","last_became_active":"2023-10-09T08:14:39.479949+0000","last_became_peered":"2023-10-09T08:14:39.479949+0000","last_unstale":"2023-10-09T08:14:39.483651+0000","last_undegraded":"2023-10-09T08:14:39.483651+0000","last_fullsized":"2023-10-09T08:14:39.483651+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:16.219371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.482772+0000","last_change":"2023-10-09T08:14:39.479390+0000","last_active":"2023-10-09T08:14:39.482772+0000","last_peered":"2023-10-09T08:14:39.482772+0000","last_clean":"2023-10-09T08:14:39.482772+0000","last_became_active":"2023-10-09T08:14:39.479115+0000","last_became_peered":"2023-10-09T08:14:39.479115+0000","last_unstale":"2023-10-09T08:14:39.482772+0000","last_undegraded":"2023-10-09T08:14:39.482772+0000","last_fullsized":"2023-10-09T08:14:39.482772+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:40.161626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.479656+0000","last_change":"2023-10-09T08:14:39.471497+0000","last_active":"2023-10-09T08:14:39.479656+0000","last_peered":"2023-10-09T08:14:39.479656+0000","last_clean":"2023-10-09T08:14:39.479656+0000","last_became_active":"2023-10-09T08:14:39.471197+0000","last_became_peered":"2023-10-09T08:14:39.471197+0000","last_unstale":"2023-10-09T08:14:39.479656+0000","last_undegraded":"2023-10-09T08:14:39.479656+0000","last_fullsized":"2023-10-09T08:14:39.479656+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:36:19.307671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.482753+0000","last_change":"2023-10-09T08:14:39.478983+0000","last_active":"2023-10-09T08:14:39.482753+0000","last_peered":"2023-10-09T08:14:39.482753+0000","last_clean":"2023-10-09T08:14:39.482753+0000","last_became_active":"2023-10-09T08:14:39.478606+0000","last_became_peered":"2023-10-09T08:14:39.478606+0000","last_unstale":"2023-10-09T08:14:39.482753+0000","last_undegraded":"2023-10-09T08:14:39.482753+0000","last_fullsized":"2023-10-09T08:14:39.482753+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:41:47.263574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"193'4","reported_seq":14,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.495194+0000","last_change":"2023-10-09T08:14:38.465359+0000","last_active":"2023-10-09T08:14:39.495194+0000","last_peered":"2023-10-09T08:14:39.495194+0000","last_clean":"2023-10-09T08:14:39.495194+0000","last_became_active":"2023-10-09T08:14:38.465002+0000","last_became_peered":"2023-10-09T08:14:38.465002+0000","last_unstale":"2023-10-09T08:14:39.495194+0000","last_undegraded":"2023-10-09T08:14:39.495194+0000","last_fullsized":"2023-10-09T08:14:39.495194+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:33.507990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.439638+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:33:50.063332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.483599+0000","last_change":"2023-10-09T08:14:39.479813+0000","last_active":"2023-10-09T08:14:39.483599+0000","last_peered":"2023-10-09T08:14:39.483599+0000","last_clean":"2023-10-09T08:14:39.483599+0000","last_became_active":"2023-10-09T08:14:39.479545+0000","last_became_peered":"2023-10-09T08:14:39.479545+0000","last_unstale":"2023-10-09T08:14:39.483599+0000","last_undegraded":"2023-10-09T08:14:39.483599+0000","last_fullsized":"2023-10-09T08:14:39.483599+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:53:08.718144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.443106+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:04.853104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.442885+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:42:18.010272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481665+0000","last_change":"2023-10-09T08:14:39.476822+0000","last_active":"2023-10-09T08:14:39.481665+0000","last_peered":"2023-10-09T08:14:39.481665+0000","last_clean":"2023-10-09T08:14:39.481665+0000","last_became_active":"2023-10-09T08:14:39.476504+0000","last_became_peered":"2023-10-09T08:14:39.476504+0000","last_unstale":"2023-10-09T08:14:39.481665+0000","last_undegraded":"2023-10-09T08:14:39.481665+0000","last_fullsized":"2023-10-09T08:14:39.481665+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:34:27.759607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.438960+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:46:35.474237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.443521+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:53:13.999052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.444162+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:43:56.605169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478136+0000","last_change":"2023-10-09T08:14:39.477068+0000","last_active":"2023-10-09T08:14:39.478136+0000","last_peered":"2023-10-09T08:14:39.478136+0000","last_clean":"2023-10-09T08:14:39.478136+0000","last_became_active":"2023-10-09T08:14:39.476231+0000","last_became_peered":"2023-10-09T08:14:39.476231+0000","last_unstale":"2023-10-09T08:14:39.478136+0000","last_undegraded":"2023-10-09T08:14:39.478136+0000","last_fullsized":"2023-10-09T08:14:39.478136+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:09.352022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.465583+0000","last_change":"2023-10-09T08:14:38.447789+0000","last_active":"2023-10-09T08:14:39.465583+0000","last_peered":"2023-10-09T08:14:39.465583+0000","last_clean":"2023-10-09T08:14:39.465583+0000","last_became_active":"2023-10-09T08:14:38.447539+0000","last_became_peered":"2023-10-09T08:14:38.447539+0000","last_unstale":"2023-10-09T08:14:39.465583+0000","last_undegraded":"2023-10-09T08:14:39.465583+0000","last_fullsized":"2023-10-09T08:14:39.465583+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:32.622711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.475100+0000","last_change":"2023-10-09T08:14:39.469756+0000","last_active":"2023-10-09T08:14:39.475100+0000","last_peered":"2023-10-09T08:14:39.475100+0000","last_clean":"2023-10-09T08:14:39.475100+0000","last_became_active":"2023-10-09T08:14:39.469509+0000","last_became_peered":"2023-10-09T08:14:39.469509+0000","last_unstale":"2023-10-09T08:14:39.475100+0000","last_undegraded":"2023-10-09T08:14:39.475100+0000","last_fullsized":"2023-10-09T08:14:39.475100+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:37.888301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.462786+0000","last_change":"2023-10-09T08:14:38.464801+0000","last_active":"2023-10-09T08:14:39.462786+0000","last_peered":"2023-10-09T08:14:39.462786+0000","last_clean":"2023-10-09T08:14:39.462786+0000","last_became_active":"2023-10-09T08:14:38.464474+0000","last_became_peered":"2023-10-09T08:14:38.464474+0000","last_unstale":"2023-10-09T08:14:39.462786+0000","last_undegraded":"2023-10-09T08:14:39.462786+0000","last_fullsized":"2023-10-09T08:14:39.462786+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:30:52.549825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.475065+0000","last_change":"2023-10-09T08:14:39.470159+0000","last_active":"2023-10-09T08:14:39.475065+0000","last_peered":"2023-10-09T08:14:39.475065+0000","last_clean":"2023-10-09T08:14:39.475065+0000","last_became_active":"2023-10-09T08:14:39.469401+0000","last_became_peered":"2023-10-09T08:14:39.469401+0000","last_unstale":"2023-10-09T08:14:39.475065+0000","last_undegraded":"2023-10-09T08:14:39.475065+0000","last_fullsized":"2023-10-09T08:14:39.475065+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:57.535414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"193'3","reported_seq":13,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.493087+0000","last_change":"2023-10-09T08:14:38.454895+0000","last_active":"2023-10-09T08:14:39.493087+0000","last_peered":"2023-10-09T08:14:39.493087+0000","last_clean":"2023-10-09T08:14:39.493087+0000","last_became_active":"2023-10-09T08:14:38.451818+0000","last_became_peered":"2023-10-09T08:14:38.451818+0000","last_unstale":"2023-10-09T08:14:39.493087+0000","last_undegraded":"2023-10-09T08:14:39.493087+0000","last_fullsized":"2023-10-09T08:14:39.493087+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:48:52.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.438696+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:15:47.540584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.479006+0000","last_change":"2023-10-09T08:14:39.473198+0000","last_active":"2023-10-09T08:14:39.479006+0000","last_peered":"2023-10-09T08:14:39.479006+0000","last_clean":"2023-10-09T08:14:39.479006+0000","last_became_active":"2023-10-09T08:14:39.472951+0000","last_became_peered":"2023-10-09T08:14:39.472951+0000","last_unstale":"2023-10-09T08:14:39.479006+0000","last_undegraded":"2023-10-09T08:14:39.479006+0000","last_fullsized":"2023-10-09T08:14:39.479006+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:00:37.618868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.443568+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:40.728510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.474301+0000","last_change":"2023-10-09T08:14:39.472462+0000","last_active":"2023-10-09T08:14:39.474301+0000","last_peered":"2023-10-09T08:14:39.474301+0000","last_clean":"2023-10-09T08:14:39.474301+0000","last_became_active":"2023-10-09T08:14:39.472162+0000","last_became_peered":"2023-10-09T08:14:39.472162+0000","last_unstale":"2023-10-09T08:14:39.474301+0000","last_undegraded":"2023-10-09T08:14:39.474301+0000","last_fullsized":"2023-10-09T08:14:39.474301+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:56.539162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.460955+0000","last_change":"2023-10-09T08:14:38.454099+0000","last_active":"2023-10-09T08:14:39.460955+0000","last_peered":"2023-10-09T08:14:39.460955+0000","last_clean":"2023-10-09T08:14:39.460955+0000","last_became_active":"2023-10-09T08:14:38.453858+0000","last_became_peered":"2023-10-09T08:14:38.453858+0000","last_unstale":"2023-10-09T08:14:39.460955+0000","last_undegraded":"2023-10-09T08:14:39.460955+0000","last_fullsized":"2023-10-09T08:14:39.460955+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:56:35.959943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.442334+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:46:35.474237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.440947+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:10:08.446919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.438589+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:03.250581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.475117+0000","last_change":"2023-10-09T08:14:39.470353+0000","last_active":"2023-10-09T08:14:39.475117+0000","last_peered":"2023-10-09T08:14:39.475117+0000","last_clean":"2023-10-09T08:14:39.475117+0000","last_became_active":"2023-10-09T08:14:39.470030+0000","last_became_peered":"2023-10-09T08:14:39.470030+0000","last_unstale":"2023-10-09T08:14:39.475117+0000","last_undegraded":"2023-10-09T08:14:39.475117+0000","last_fullsized":"2023-10-09T08:14:39.475117+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:11.741936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.440835+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:42:18.010272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"193'1","reported_seq":11,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.494014+0000","last_change":"2023-10-09T08:14:38.454927+0000","last_active":"2023-10-09T08:14:39.494014+0000","last_peered":"2023-10-09T08:14:39.494014+0000","last_clean":"2023-10-09T08:14:39.494014+0000","last_became_active":"2023-10-09T08:14:38.454658+0000","last_became_peered":"2023-10-09T08:14:38.454658+0000","last_unstale":"2023-10-09T08:14:39.494014+0000","last_undegraded":"2023-10-09T08:14:39.494014+0000","last_fullsized":"2023-10-09T08:14:39.494014+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:33:36.559884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.482797+0000","last_change":"2023-10-09T08:14:39.481020+0000","last_active":"2023-10-09T08:14:39.482797+0000","last_peered":"2023-10-09T08:14:39.482797+0000","last_clean":"2023-10-09T08:14:39.482797+0000","last_became_active":"2023-10-09T08:14:39.480773+0000","last_became_peered":"2023-10-09T08:14:39.480773+0000","last_unstale":"2023-10-09T08:14:39.482797+0000","last_undegraded":"2023-10-09T08:14:39.482797+0000","last_fullsized":"2023-10-09T08:14:39.482797+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:52.883026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.465016+0000","last_change":"2023-10-09T08:14:38.449804+0000","last_active":"2023-10-09T08:14:39.465016+0000","last_peered":"2023-10-09T08:14:39.465016+0000","last_clean":"2023-10-09T08:14:39.465016+0000","last_became_active":"2023-10-09T08:14:38.449525+0000","last_became_peered":"2023-10-09T08:14:38.449525+0000","last_unstale":"2023-10-09T08:14:39.465016+0000","last_undegraded":"2023-10-09T08:14:39.465016+0000","last_fullsized":"2023-10-09T08:14:39.465016+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:42:28.181427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.442793+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:44:04.977933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.482848+0000","last_change":"2023-10-09T08:14:39.477525+0000","last_active":"2023-10-09T08:14:39.482848+0000","last_peered":"2023-10-09T08:14:39.482848+0000","last_clean":"2023-10-09T08:14:39.482848+0000","last_became_active":"2023-10-09T08:14:39.477264+0000","last_became_peered":"2023-10-09T08:14:39.477264+0000","last_unstale":"2023-10-09T08:14:39.482848+0000","last_undegraded":"2023-10-09T08:14:39.482848+0000","last_fullsized":"2023-10-09T08:14:39.482848+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:11.301814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.464301+0000","last_change":"2023-10-09T08:14:38.454293+0000","last_active":"2023-10-09T08:14:39.464301+0000","last_peered":"2023-10-09T08:14:39.464301+0000","last_clean":"2023-10-09T08:14:39.464301+0000","last_became_active":"2023-10-09T08:14:38.453970+0000","last_became_peered":"2023-10-09T08:14:38.453970+0000","last_unstale":"2023-10-09T08:14:39.464301+0000","last_undegraded":"2023-10-09T08:14:39.464301+0000","last_fullsized":"2023-10-09T08:14:39.464301+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:10.748478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481977+0000","last_change":"2023-10-09T08:14:39.480148+0000","last_active":"2023-10-09T08:14:39.481977+0000","last_peered":"2023-10-09T08:14:39.481977+0000","last_clean":"2023-10-09T08:14:39.481977+0000","last_became_active":"2023-10-09T08:14:39.479903+0000","last_became_peered":"2023-10-09T08:14:39.479903+0000","last_unstale":"2023-10-09T08:14:39.481977+0000","last_undegraded":"2023-10-09T08:14:39.481977+0000","last_fullsized":"2023-10-09T08:14:39.481977+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:41:47.263574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.441856+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:03.250581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.483634+0000","last_change":"2023-10-09T08:14:39.480318+0000","last_active":"2023-10-09T08:14:39.483634+0000","last_peered":"2023-10-09T08:14:39.483634+0000","last_clean":"2023-10-09T08:14:39.483634+0000","last_became_active":"2023-10-09T08:14:39.479561+0000","last_became_peered":"2023-10-09T08:14:39.479561+0000","last_unstale":"2023-10-09T08:14:39.483634+0000","last_undegraded":"2023-10-09T08:14:39.483634+0000","last_fullsized":"2023-10-09T08:14:39.483634+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:33.890868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.466046+0000","last_change":"2023-10-09T08:14:38.456540+0000","last_active":"2023-10-09T08:14:39.466046+0000","last_peered":"2023-10-09T08:14:39.466046+0000","last_clean":"2023-10-09T08:14:39.466046+0000","last_became_active":"2023-10-09T08:14:38.456221+0000","last_became_peered":"2023-10-09T08:14:38.456221+0000","last_unstale":"2023-10-09T08:14:39.466046+0000","last_undegraded":"2023-10-09T08:14:39.466046+0000","last_fullsized":"2023-10-09T08:14:39.466046+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:26.714576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478577+0000","last_change":"2023-10-09T08:14:39.471342+0000","last_active":"2023-10-09T08:14:39.478577+0000","last_peered":"2023-10-09T08:14:39.478577+0000","last_clean":"2023-10-09T08:14:39.478577+0000","last_became_active":"2023-10-09T08:14:39.471053+0000","last_became_peered":"2023-10-09T08:14:39.471053+0000","last_unstale":"2023-10-09T08:14:39.478577+0000","last_undegraded":"2023-10-09T08:14:39.478577+0000","last_fullsized":"2023-10-09T08:14:39.478577+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:45.577995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"193'2","reported_seq":12,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.491340+0000","last_change":"2023-10-09T08:14:38.460625+0000","last_active":"2023-10-09T08:14:39.491340+0000","last_peered":"2023-10-09T08:14:39.491340+0000","last_clean":"2023-10-09T08:14:39.491340+0000","last_became_active":"2023-10-09T08:14:38.460321+0000","last_became_peered":"2023-10-09T08:14:38.460321+0000","last_unstale":"2023-10-09T08:14:39.491340+0000","last_undegraded":"2023-10-09T08:14:39.491340+0000","last_fullsized":"2023-10-09T08:14:39.491340+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:16:28.154856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481580+0000","last_change":"2023-10-09T08:14:39.478657+0000","last_active":"2023-10-09T08:14:39.481580+0000","last_peered":"2023-10-09T08:14:39.481580+0000","last_clean":"2023-10-09T08:14:39.481580+0000","last_became_active":"2023-10-09T08:14:39.478402+0000","last_became_peered":"2023-10-09T08:14:39.478402+0000","last_unstale":"2023-10-09T08:14:39.481580+0000","last_undegraded":"2023-10-09T08:14:39.481580+0000","last_fullsized":"2023-10-09T08:14:39.481580+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:34.938944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.439352+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:44:04.977933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.485101+0000","last_change":"2023-10-09T08:14:39.483531+0000","last_active":"2023-10-09T08:14:39.485101+0000","last_peered":"2023-10-09T08:14:39.485101+0000","last_clean":"2023-10-09T08:14:39.485101+0000","last_became_active":"2023-10-09T08:14:39.483236+0000","last_became_peered":"2023-10-09T08:14:39.483236+0000","last_unstale":"2023-10-09T08:14:39.485101+0000","last_undegraded":"2023-10-09T08:14:39.485101+0000","last_fullsized":"2023-10-09T08:14:39.485101+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:54:22.665528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.443544+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:07:03.303746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.472812+0000","last_change":"2023-10-09T08:14:39.468512+0000","last_active":"2023-10-09T08:14:39.472812+0000","last_peered":"2023-10-09T08:14:39.472812+0000","last_clean":"2023-10-09T08:14:39.472812+0000","last_became_active":"2023-10-09T08:14:39.468158+0000","last_became_peered":"2023-10-09T08:14:39.468158+0000","last_unstale":"2023-10-09T08:14:39.472812+0000","last_undegraded":"2023-10-09T08:14:39.472812+0000","last_fullsized":"2023-10-09T08:14:39.472812+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:04.566842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.458202+0000","last_change":"2023-10-09T08:14:38.464753+0000","last_active":"2023-10-09T08:14:39.458202+0000","last_peered":"2023-10-09T08:14:39.458202+0000","last_clean":"2023-10-09T08:14:39.458202+0000","last_became_active":"2023-10-09T08:14:38.464494+0000","last_became_peered":"2023-10-09T08:14:38.464494+0000","last_unstale":"2023-10-09T08:14:39.458202+0000","last_undegraded":"2023-10-09T08:14:39.458202+0000","last_fullsized":"2023-10-09T08:14:39.458202+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:03.238219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.484321+0000","last_change":"2023-10-09T08:14:39.482147+0000","last_active":"2023-10-09T08:14:39.484321+0000","last_peered":"2023-10-09T08:14:39.484321+0000","last_clean":"2023-10-09T08:14:39.484321+0000","last_became_active":"2023-10-09T08:14:39.481901+0000","last_became_peered":"2023-10-09T08:14:39.481901+0000","last_unstale":"2023-10-09T08:14:39.484321+0000","last_undegraded":"2023-10-09T08:14:39.484321+0000","last_fullsized":"2023-10-09T08:14:39.484321+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:30.483504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.438592+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:49.393514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.442937+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:49:23.713246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481621+0000","last_change":"2023-10-09T08:14:39.477716+0000","last_active":"2023-10-09T08:14:39.481621+0000","last_peered":"2023-10-09T08:14:39.481621+0000","last_clean":"2023-10-09T08:14:39.481621+0000","last_became_active":"2023-10-09T08:14:39.477119+0000","last_became_peered":"2023-10-09T08:14:39.477119+0000","last_unstale":"2023-10-09T08:14:39.481621+0000","last_undegraded":"2023-10-09T08:14:39.481621+0000","last_fullsized":"2023-10-09T08:14:39.481621+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:47.340414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.443699+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:26.250981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:14:38.432444+0000","last_change":"2023-10-09T08:14:38.432444+0000","last_active":"2023-10-09T08:14:38.432444+0000","last_peered":"2023-10-09T08:14:38.432444+0000","last_clean":"2023-10-09T08:14:38.432444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:38.432444+0000","last_undegraded":"2023-10-09T08:14:38.432444+0000","last_fullsized":"2023-10-09T08:14:38.432444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.439589+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:33.528262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478617+0000","last_change":"2023-10-09T08:14:39.472193+0000","last_active":"2023-10-09T08:14:39.478617+0000","last_peered":"2023-10-09T08:14:39.478617+0000","last_clean":"2023-10-09T08:14:39.478617+0000","last_became_active":"2023-10-09T08:14:39.471886+0000","last_became_peered":"2023-10-09T08:14:39.471886+0000","last_unstale":"2023-10-09T08:14:39.478617+0000","last_undegraded":"2023-10-09T08:14:39.478617+0000","last_fullsized":"2023-10-09T08:14:39.478617+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:02:07.699719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:14:37.426794+0000","last_change":"2023-10-09T08:14:37.439194+0000","last_active":"2023-10-09T08:14:37.426794+0000","last_peered":"2023-10-09T08:14:37.426794+0000","last_clean":"2023-10-09T08:14:37.426794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:14:37.426794+0000","last_undegraded":"2023-10-09T08:14:37.426794+0000","last_fullsized":"2023-10-09T08:14:37.426794+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:23:34.614137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"183'326","reported_seq":1052,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.466136+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T08:14:39.466136+0000","last_peered":"2023-10-09T08:14:39.466136+0000","last_clean":"2023-10-09T08:14:39.466136+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T08:14:39.466136+0000","last_undegraded":"2023-10-09T08:14:39.466136+0000","last_fullsized":"2023-10-09T08:14:39.466136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":714,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575944,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312548,"kb_used_data":2972,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059292,"statfs":{"total":96636764160,"available":96316715008,"internally_reserved":0,"allocated":3043328,"data_stored":1813297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.748,"15min":0.755},"min":{"1min":0.49199999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97699999999999998,"5min":1.002,"15min":1.1220000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.755,"15min":0.751},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.44500000000000001},"max":{"1min":1.0069999999999999,"5min":1.0129999999999999,"15min":1.0209999999999999},"last":0.91900000000000004}]},{"osd":1,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.746,"15min":0.746},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":1.024},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.747,"15min":0.751},"min":{"1min":0.503,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.01}]},{"osd":2,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.752,"15min":0.753},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.77300000000000002,"15min":0.77400000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.442},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.86499999999999999}]},{"osd":3,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.755,"15min":0.74199999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.47999999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.78200000000000003,"15min":0.78000000000000003},"min":{"1min":0.61499999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.97999999999999998}]},{"osd":4,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.624,"15min":0.60899999999999999},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.38300000000000001},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.45500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.89400000000000002}]},{"osd":5,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.53400000000000003,"5min":0.41699999999999998,"15min":0.40100000000000002},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.75600000000000001,"15min":0.746},"min":{"1min":0.60499999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.72399999999999998,"15min":0.71399999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.70399999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311896,"kb_used_data":2320,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059944,"statfs":{"total":96636764160,"available":96317382656,"internally_reserved":0,"allocated":2375680,"data_stored":1193592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.749,"15min":0.753},"min":{"1min":0.46899999999999997,"5min":0.45900000000000002,"15min":0.40300000000000002},"max":{"1min":0.97799999999999998,"5min":0.99299999999999999,"15min":1.0449999999999999},"last":0.747},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.44400000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94099999999999995,"5min":0.94499999999999995,"15min":0.97399999999999998},"last":0.58299999999999996}]},{"osd":1,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.753,"15min":0.755},"min":{"1min":0.54700000000000004,"5min":0.499,"15min":0.38500000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77000000000000002,"15min":0.76300000000000001},"min":{"1min":0.59499999999999997,"5min":0.52800000000000002,"15min":0.47999999999999998},"max":{"1min":1.018,"5min":1.0269999999999999,"15min":1.097},"last":0.77200000000000002}]},{"osd":2,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.46400000000000002},"max":{"1min":1.004,"5min":1.0109999999999999,"15min":1.0329999999999999},"last":0.505},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77200000000000002,"15min":0.77800000000000002},"min":{"1min":0.52300000000000002,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0660000000000001},"last":0.61399999999999999}]},{"osd":3,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.54300000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.004,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.61599999999999999,"5min":0.51100000000000001,"15min":0.49299999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0680000000000001},"last":0.54100000000000004}]},{"osd":4,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.40600000000000003,"15min":0.40200000000000002},"max":{"1min":0.92000000000000004,"5min":1.032,"15min":1.1339999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.44800000000000001,"5min":0.39700000000000002,"15min":0.32000000000000001},"max":{"1min":0.82699999999999996,"5min":0.91900000000000004,"15min":0.97099999999999997},"last":0.73899999999999999}]},{"osd":5,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.40100000000000002},"max":{"1min":0.90900000000000003,"5min":0.93400000000000005,"15min":0.98899999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.45200000000000001},"max":{"1min":0.97599999999999998,"5min":1.0880000000000001,"15min":1.121},"last":0.71399999999999997}]},{"osd":7,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70199999999999996,"15min":0.69699999999999995},"min":{"1min":0.49399999999999999,"5min":0.45600000000000002,"15min":0.36299999999999999},"max":{"1min":0.93200000000000005,"5min":0.98699999999999999,"15min":1.0309999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.75800000000000001,"15min":0.74299999999999999},"min":{"1min":0.54400000000000004,"5min":0.48699999999999999,"15min":0.442},"max":{"1min":0.95599999999999996,"5min":0.96799999999999997,"15min":1.139},"last":0.60199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575943,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307812,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064028,"statfs":{"total":96636764160,"available":96321564672,"internally_reserved":0,"allocated":2387968,"data_stored":1199889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45300000000000001,"15min":0.46000000000000002},"min":{"1min":0.34200000000000003,"5min":0.29799999999999999,"15min":0.28799999999999998},"max":{"1min":0.621,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.441},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52400000000000002,"15min":0.51500000000000001},"min":{"1min":0.39500000000000002,"5min":0.34899999999999998,"15min":0.32400000000000001},"max":{"1min":0.66300000000000003,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.46100000000000002}]},{"osd":2,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.51200000000000001},"min":{"1min":0.379,"5min":0.34200000000000003,"15min":0.318},"max":{"1min":0.624,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.58999999999999997},"min":{"1min":0.44900000000000001,"5min":0.433,"15min":0.39500000000000002},"max":{"1min":0.69899999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.505}]},{"osd":3,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.505,"5min":0.42699999999999999,"15min":0.41099999999999998},"max":{"1min":0.76800000000000002,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.51200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76100000000000001,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.40300000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.76000000000000001,"15min":0.78500000000000003},"min":{"1min":0.64400000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.125,"5min":1.125,"15min":1.224},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.81200000000000006,"15min":0.80300000000000005},"min":{"1min":0.61199999999999999,"5min":0.55800000000000005,"15min":0.51800000000000002},"max":{"1min":1.071,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.65000000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0940000000000001,"5min":1.77,"15min":1.77},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.79300000000000004,"15min":0.81200000000000006},"min":{"1min":0.65600000000000003,"5min":0.56100000000000005,"15min":0.49299999999999999},"max":{"1min":1.054,"5min":1.0569999999999999,"15min":1.288},"last":0.64600000000000002}]},{"osd":6,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.83399999999999996,"15min":0.82399999999999995},"min":{"1min":0.69499999999999995,"5min":0.57199999999999995,"15min":0.505},"max":{"1min":1.143,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.85699999999999998,"15min":0.84099999999999997},"min":{"1min":0.59999999999999998,"5min":0.57499999999999996,"15min":0.53800000000000003},"max":{"1min":1.105,"5min":1.843,"15min":1.843},"last":0.66300000000000003}]},{"osd":7,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.876,"15min":0.86499999999999999},"min":{"1min":0.748,"5min":0.64000000000000001,"15min":0.58599999999999997},"max":{"1min":1.135,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.85399999999999998,"15min":0.85299999999999998},"min":{"1min":0.65700000000000003,"5min":0.61799999999999999,"15min":0.54300000000000004},"max":{"1min":1.1659999999999999,"5min":1.21,"15min":1.347},"last":0.73399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575943,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308428,"kb_used_data":2948,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063412,"statfs":{"total":96636764160,"available":96320933888,"internally_reserved":0,"allocated":3018752,"data_stored":1811047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48999999999999999,"15min":0.48499999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.29199999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.34899999999999998,"5min":0.34599999999999997,"15min":0.318},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.92300000000000004},"last":0.33500000000000002}]},{"osd":2,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57699999999999996,"15min":0.58399999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.36499999999999999,"5min":0.35999999999999999,"15min":0.34499999999999997},"max":{"1min":0.70499999999999996,"5min":0.77300000000000002,"15min":0.81999999999999995},"last":0.39700000000000002}]},{"osd":3,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.35099999999999998},"max":{"1min":0.78200000000000003,"5min":0.79400000000000004,"15min":0.80500000000000005},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60999999999999999,"15min":0.621},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.93200000000000005},"last":0.51800000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81200000000000006,"15min":0.78800000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.42899999999999999},"max":{"1min":0.98299999999999998,"5min":1.226,"15min":1.232},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57699999999999996,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0649999999999999,"5min":1.196,"15min":1.23},"last":0.61399999999999999}]},{"osd":5,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.82199999999999995,"15min":0.81499999999999995},"min":{"1min":0.60599999999999998,"5min":0.57299999999999995,"15min":0.501},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.262},"last":0.621},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.83099999999999996,"15min":0.82299999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.52100000000000002},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.79600000000000004}]},{"osd":6,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.86099999999999999,"15min":0.85199999999999998},"min":{"1min":0.64600000000000002,"5min":0.59599999999999997,"15min":0.58899999999999997},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.747},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83299999999999996,"15min":0.83099999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0920000000000001,"5min":1.24,"15min":1.3029999999999999},"last":0.58999999999999997}]},{"osd":7,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.86099999999999999,"15min":0.86499999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2370000000000001,"5min":1.2929999999999999,"15min":1.3540000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.88700000000000001,"15min":0.88200000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.58199999999999996},"max":{"1min":1.085,"5min":1.1519999999999999,"15min":1.3380000000000001},"last":0.66200000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575943,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316044,"kb_used_data":2372,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055796,"statfs":{"total":96636764160,"available":96313135104,"internally_reserved":0,"allocated":2428928,"data_stored":1220769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.47199999999999998,"15min":0.46500000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64500000000000002,"5min":0.71099999999999997,"15min":0.752},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.501,"15min":0.504},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64800000000000002,"5min":0.73299999999999998,"15min":0.82899999999999996},"last":0.48099999999999998}]},{"osd":1,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.499,"15min":0.495},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.33700000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55100000000000005,"15min":0.54200000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34699999999999998},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.40699999999999997}]},{"osd":3,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39200000000000002},"max":{"1min":0.89000000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.442},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64000000000000001,"15min":0.63900000000000001},"min":{"1min":0.47899999999999998,"5min":0.43099999999999999,"15min":0.38100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.94199999999999995},"last":0.46899999999999997}]},{"osd":4,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.80800000000000005,"15min":0.80900000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":0.96699999999999997,"5min":1.089,"15min":1.089},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.80200000000000005,"15min":0.79600000000000004},"min":{"1min":0.61699999999999999,"5min":0.54200000000000004,"15min":0.48399999999999999},"max":{"1min":1.107,"5min":1.133,"15min":1.1399999999999999},"last":1.0700000000000001}]},{"osd":5,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82499999999999996,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.51800000000000002},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":1.022},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.82799999999999996,"15min":0.82599999999999996},"min":{"1min":0.60199999999999998,"5min":0.54700000000000004,"15min":0.47799999999999998},"max":{"1min":1.052,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.98699999999999999}]},{"osd":6,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.84099999999999997,"15min":0.82799999999999996},"min":{"1min":0.57999999999999996,"5min":0.56299999999999994,"15min":0.52700000000000002},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.163},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.83899999999999997,"15min":0.83299999999999996},"min":{"1min":0.59399999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1020000000000001,"5min":1.109,"15min":1.224},"last":1.103}]},{"osd":7,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86599999999999999,"15min":0.85899999999999999},"min":{"1min":0.66700000000000004,"5min":0.60199999999999998,"15min":0.47899999999999998},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.198},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":1.157}]}]},{"osd":3,"up_from":13,"seq":55834575944,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2372,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2428928,"data_stored":1220713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47599999999999998,"15min":0.48999999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.30599999999999999},"max":{"1min":0.65800000000000003,"5min":0.68799999999999994,"15min":0.85999999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.5,"15min":0.51000000000000001},"min":{"1min":0.33900000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.79600000000000004},"last":0.53800000000000003}]},{"osd":1,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52100000000000002,"15min":0.51300000000000001},"min":{"1min":0.38300000000000001,"5min":0.34599999999999997,"15min":0.34300000000000003},"max":{"1min":0.70999999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.374},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59299999999999997,"15min":0.58099999999999996},"min":{"1min":0.439,"5min":0.43099999999999999,"15min":0.378},"max":{"1min":0.84999999999999998,"5min":0.85999999999999999,"15min":0.91300000000000003},"last":0.47399999999999998}]},{"osd":2,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.49199999999999999,"5min":0.41599999999999998,"15min":0.40400000000000003},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.97299999999999998},"last":0.443},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66100000000000003,"15min":0.66400000000000003},"min":{"1min":0.54000000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82299999999999995,"5min":0.879,"15min":1.036},"last":0.51500000000000001}]},{"osd":4,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78300000000000003,"15min":0.78100000000000003},"min":{"1min":0.56599999999999995,"5min":0.54100000000000004,"15min":0.46000000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.872,"5min":0.86599999999999999,"15min":0.871},"min":{"1min":0.69999999999999996,"5min":0.69899999999999995,"15min":0.66000000000000003},"max":{"1min":1.0629999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.60499999999999998}]},{"osd":5,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76900000000000002,"15min":0.77500000000000002},"min":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.47399999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.24},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.84199999999999997,"15min":0.83999999999999997},"min":{"1min":0.69099999999999995,"5min":0.66100000000000003,"15min":0.56899999999999995},"max":{"1min":0.996,"5min":1.1719999999999999,"15min":1.1739999999999999},"last":0.57599999999999996}]},{"osd":6,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79500000000000004,"15min":0.80600000000000005},"min":{"1min":0.623,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.099,"5min":1.099,"15min":1.206},"last":0.87},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.81200000000000006,"15min":0.81899999999999995},"min":{"1min":0.66900000000000004,"5min":0.56100000000000005,"15min":0.54800000000000004},"max":{"1min":1.0629999999999999,"5min":1.1339999999999999,"15min":1.1870000000000001},"last":0.73799999999999999}]},{"osd":7,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.85699999999999998,"15min":0.85999999999999999},"min":{"1min":0.70199999999999996,"5min":0.623,"15min":0.53700000000000003},"max":{"1min":1.0800000000000001,"5min":1.1839999999999999,"15min":1.3280000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.85399999999999998,"15min":0.85999999999999999},"min":{"1min":0.64400000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.147,"5min":1.1639999999999999,"15min":1.2869999999999999},"last":0.83399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299620,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072220,"statfs":{"total":96636764160,"available":96329953280,"internally_reserved":0,"allocated":2387968,"data_stored":1199889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73099999999999998,"15min":0.72999999999999998},"min":{"1min":0.60399999999999998,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":0.94799999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.745,"15min":0.74399999999999999},"min":{"1min":0.51300000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.69999999999999996}]},{"osd":1,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.73299999999999998,"15min":0.72699999999999998},"min":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.51000000000000001},"max":{"1min":0.83499999999999996,"5min":1.03,"15min":1.03},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.53100000000000003,"5min":0.442,"15min":0.42799999999999999},"max":{"1min":0.97299999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.78900000000000003}]},{"osd":2,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81200000000000006,"15min":0.79900000000000004},"min":{"1min":0.65300000000000002,"5min":0.51400000000000001,"15min":0.45000000000000001},"max":{"1min":0.99399999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.81399999999999995,"15min":0.81000000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.47999999999999998},"max":{"1min":0.95699999999999996,"5min":1.077,"15min":1.077},"last":0.66400000000000003}]},{"osd":3,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.754,"15min":0.748},"min":{"1min":0.57799999999999996,"5min":0.51500000000000001,"15min":0.45900000000000002},"max":{"1min":0.92000000000000004,"5min":1.016,"15min":1.018},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.76900000000000002,"15min":0.77200000000000002},"min":{"1min":0.57199999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.89700000000000002,"5min":1.036,"15min":1.036},"last":0.80100000000000005}]},{"osd":5,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.38800000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.83599999999999997,"5min":0.94899999999999995,"15min":1.006},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63100000000000001,"15min":0.63200000000000001},"min":{"1min":0.46899999999999997,"5min":0.42099999999999999,"15min":0.40100000000000002},"max":{"1min":0.94199999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.42499999999999999}]},{"osd":6,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64300000000000002,"15min":0.63400000000000001},"min":{"1min":0.47399999999999998,"5min":0.42399999999999999,"15min":0.42299999999999999},"max":{"1min":1.012,"5min":1.022,"15min":1.034},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67400000000000004,"15min":0.68200000000000005},"min":{"1min":0.48899999999999999,"5min":0.437,"15min":0.42999999999999999},"max":{"1min":0.96499999999999997,"5min":0.998,"15min":1.0609999999999999},"last":0.64300000000000002}]},{"osd":7,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.53400000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.0580000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.77700000000000002},"min":{"1min":0.61799999999999999,"5min":0.48499999999999999,"15min":0.443},"max":{"1min":1.056,"5min":1.0629999999999999,"15min":1.079},"last":0.89400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575943,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316004,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055836,"statfs":{"total":96636764160,"available":96313176064,"internally_reserved":0,"allocated":2387968,"data_stored":1199889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96999999999999997,"5min":0.998,"15min":1.0780000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71699999999999997,"15min":0.71799999999999997},"min":{"1min":0.51500000000000001,"5min":0.42999999999999999,"15min":0.40899999999999997},"max":{"1min":0.91100000000000003,"5min":0.97399999999999998,"15min":1.018},"last":0.57899999999999996}]},{"osd":1,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72299999999999998,"15min":0.72399999999999998},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90100000000000002,"5min":1.0129999999999999,"15min":1.1140000000000001},"last":0.628},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.435},"max":{"1min":0.89800000000000002,"5min":1.0029999999999999,"15min":1.0169999999999999},"last":0.72999999999999998}]},{"osd":2,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.754,"15min":0.751},"min":{"1min":0.58799999999999997,"5min":0.499,"15min":0.48699999999999999},"max":{"1min":0.92200000000000004,"5min":1.115,"15min":1.115},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.48299999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99299999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.55200000000000005}]},{"osd":3,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.748},"min":{"1min":0.50900000000000001,"5min":0.49199999999999999,"15min":0.48299999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":1.0409999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.57799999999999996,"5min":0.54600000000000004,"15min":0.51500000000000001},"max":{"1min":0.95299999999999996,"5min":1.0189999999999999,"15min":1.0620000000000001},"last":0.66600000000000004}]},{"osd":4,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.38200000000000001},"max":{"1min":0.75700000000000001,"5min":0.96699999999999997,"15min":0.995},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60599999999999998,"15min":0.61099999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88500000000000001,"5min":0.94399999999999995,"15min":0.96599999999999997},"last":0.499}]},{"osd":6,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93799999999999994,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.749},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.67900000000000005,"15min":0.67400000000000004},"min":{"1min":0.53300000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91500000000000004,"5min":0.97099999999999997,"15min":1.006},"last":0.68200000000000005}]},{"osd":7,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69799999999999995,"15min":0.68899999999999995},"min":{"1min":0.55000000000000004,"5min":0.46999999999999997,"15min":0.44400000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.76700000000000002},"min":{"1min":0.58799999999999997,"5min":0.57299999999999995,"15min":0.48599999999999999},"max":{"1min":0.97099999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T08:14:44.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3e is not active+clean 2023-10-09T08:14:44.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3d is not active+clean 2023-10-09T08:14:44.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3c is not active+clean 2023-10-09T08:14:44.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3b is not active+clean 2023-10-09T08:14:44.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.38 is not active+clean 2023-10-09T08:14:44.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.37 is not active+clean 2023-10-09T08:14:44.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.36 is not active+clean 2023-10-09T08:14:44.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.35 is not active+clean 2023-10-09T08:14:44.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.34 is not active+clean 2023-10-09T08:14:44.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.33 is not active+clean 2023-10-09T08:14:44.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.32 is not active+clean 2023-10-09T08:14:44.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2c is not active+clean 2023-10-09T08:14:44.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2a is not active+clean 2023-10-09T08:14:44.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.28 is not active+clean 2023-10-09T08:14:44.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.27 is not active+clean 2023-10-09T08:14:44.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.25 is not active+clean 2023-10-09T08:14:44.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.24 is not active+clean 2023-10-09T08:14:44.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.23 is not active+clean 2023-10-09T08:14:44.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.22 is not active+clean 2023-10-09T08:14:44.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.21 is not active+clean 2023-10-09T08:14:44.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1f is not active+clean 2023-10-09T08:14:44.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1e is not active+clean 2023-10-09T08:14:44.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:14:37.426794+0000', 'last_change': '2023-10-09T08:14:37.439638+0000', 'last_active': '2023-10-09T08:14:37.426794+0000', 'last_peered': '2023-10-09T08:14:37.426794+0000', 'last_clean': '2023-10-09T08:14:37.426794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:37.426794+0000', 'last_undegraded': '2023-10-09T08:14:37.426794+0000', 'last_fullsized': '2023-10-09T08:14:37.426794+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:33:50.063332+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T08:14:44.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1d is not active+clean 2023-10-09T08:14:44.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:14:37.426794+0000', 'last_change': '2023-10-09T08:14:37.443106+0000', 'last_active': '2023-10-09T08:14:37.426794+0000', 'last_peered': '2023-10-09T08:14:37.426794+0000', 'last_clean': '2023-10-09T08:14:37.426794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:37.426794+0000', 'last_undegraded': '2023-10-09T08:14:37.426794+0000', 'last_fullsized': '2023-10-09T08:14:37.426794+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:39:04.853104+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T08:14:44.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1d is not active+clean 2023-10-09T08:14:44.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1c is not active+clean 2023-10-09T08:14:44.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:14:37.426794+0000', 'last_change': '2023-10-09T08:14:37.442885+0000', 'last_active': '2023-10-09T08:14:37.426794+0000', 'last_peered': '2023-10-09T08:14:37.426794+0000', 'last_clean': '2023-10-09T08:14:37.426794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:37.426794+0000', 'last_undegraded': '2023-10-09T08:14:37.426794+0000', 'last_fullsized': '2023-10-09T08:14:37.426794+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T09:42:18.010272+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T08:14:44.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1b is not active+clean 2023-10-09T08:14:44.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:14:37.426794+0000', 'last_change': '2023-10-09T08:14:37.438960+0000', 'last_active': '2023-10-09T08:14:37.426794+0000', 'last_peered': '2023-10-09T08:14:37.426794+0000', 'last_clean': '2023-10-09T08:14:37.426794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:37.426794+0000', 'last_undegraded': '2023-10-09T08:14:37.426794+0000', 'last_fullsized': '2023-10-09T08:14:37.426794+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:46:35.474237+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T08:14:44.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1b is not active+clean 2023-10-09T08:14:44.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1a is not active+clean 2023-10-09T08:14:44.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:14:37.426794+0000', 'last_change': '2023-10-09T08:14:37.443521+0000', 'last_active': '2023-10-09T08:14:37.426794+0000', 'last_peered': '2023-10-09T08:14:37.426794+0000', 'last_clean': '2023-10-09T08:14:37.426794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:37.426794+0000', 'last_undegraded': '2023-10-09T08:14:37.426794+0000', 'last_fullsized': '2023-10-09T08:14:37.426794+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:53:13.999052+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T08:14:44.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.18 is not active+clean 2023-10-09T08:14:44.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.19 is not active+clean 2023-10-09T08:14:44.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:14:37.426794+0000', 'last_change': '2023-10-09T08:14:37.444162+0000', 'last_active': '2023-10-09T08:14:37.426794+0000', 'last_peered': '2023-10-09T08:14:37.426794+0000', 'last_clean': '2023-10-09T08:14:37.426794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:37.426794+0000', 'last_undegraded': '2023-10-09T08:14:37.426794+0000', 'last_fullsized': '2023-10-09T08:14:37.426794+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:43:56.605169+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T08:14:44.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.15 is not active+clean 2023-10-09T08:14:44.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.14 is not active+clean 2023-10-09T08:14:44.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:14:37.426794+0000', 'last_change': '2023-10-09T08:14:37.438696+0000', 'last_active': '2023-10-09T08:14:37.426794+0000', 'last_peered': '2023-10-09T08:14:37.426794+0000', 'last_clean': '2023-10-09T08:14:37.426794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:37.426794+0000', 'last_undegraded': '2023-10-09T08:14:37.426794+0000', 'last_fullsized': '2023-10-09T08:14:37.426794+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T09:15:47.540584+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T08:14:44.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.13 is not active+clean 2023-10-09T08:14:44.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:14:37.426794+0000', 'last_change': '2023-10-09T08:14:37.443568+0000', 'last_active': '2023-10-09T08:14:37.426794+0000', 'last_peered': '2023-10-09T08:14:37.426794+0000', 'last_clean': '2023-10-09T08:14:37.426794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:37.426794+0000', 'last_undegraded': '2023-10-09T08:14:37.426794+0000', 'last_fullsized': '2023-10-09T08:14:37.426794+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:09:40.728510+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T08:14:44.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.10 is not active+clean 2023-10-09T08:14:44.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.11 is not active+clean 2023-10-09T08:14:44.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:14:37.426794+0000', 'last_change': '2023-10-09T08:14:37.442334+0000', 'last_active': '2023-10-09T08:14:37.426794+0000', 'last_peered': '2023-10-09T08:14:37.426794+0000', 'last_clean': '2023-10-09T08:14:37.426794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:37.426794+0000', 'last_undegraded': '2023-10-09T08:14:37.426794+0000', 'last_fullsized': '2023-10-09T08:14:37.426794+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:46:35.474237+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T08:14:44.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.11 is not active+clean 2023-10-09T08:14:44.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.10 is not active+clean 2023-10-09T08:14:44.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:14:37.426794+0000', 'last_change': '2023-10-09T08:14:37.440947+0000', 'last_active': '2023-10-09T08:14:37.426794+0000', 'last_peered': '2023-10-09T08:14:37.426794+0000', 'last_clean': '2023-10-09T08:14:37.426794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:37.426794+0000', 'last_undegraded': '2023-10-09T08:14:37.426794+0000', 'last_fullsized': '2023-10-09T08:14:37.426794+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:10:08.446919+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T08:14:44.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.e is not active+clean 2023-10-09T08:14:44.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.f is not active+clean 2023-10-09T08:14:44.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:14:37.426794+0000', 'last_change': '2023-10-09T08:14:37.438589+0000', 'last_active': '2023-10-09T08:14:37.426794+0000', 'last_peered': '2023-10-09T08:14:37.426794+0000', 'last_clean': '2023-10-09T08:14:37.426794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:37.426794+0000', 'last_undegraded': '2023-10-09T08:14:37.426794+0000', 'last_fullsized': '2023-10-09T08:14:37.426794+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:08:03.250581+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T08:14:44.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.e is not active+clean 2023-10-09T08:14:44.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:14:37.426794+0000', 'last_change': '2023-10-09T08:14:37.440835+0000', 'last_active': '2023-10-09T08:14:37.426794+0000', 'last_peered': '2023-10-09T08:14:37.426794+0000', 'last_clean': '2023-10-09T08:14:37.426794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:37.426794+0000', 'last_undegraded': '2023-10-09T08:14:37.426794+0000', 'last_fullsized': '2023-10-09T08:14:37.426794+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T09:42:18.010272+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T08:14:44.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.c is not active+clean 2023-10-09T08:14:44.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.a is not active+clean 2023-10-09T08:14:44.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.b is not active+clean 2023-10-09T08:14:44.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:14:37.426794+0000', 'last_change': '2023-10-09T08:14:37.442793+0000', 'last_active': '2023-10-09T08:14:37.426794+0000', 'last_peered': '2023-10-09T08:14:37.426794+0000', 'last_clean': '2023-10-09T08:14:37.426794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:37.426794+0000', 'last_undegraded': '2023-10-09T08:14:37.426794+0000', 'last_fullsized': '2023-10-09T08:14:37.426794+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:44:04.977933+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T08:14:44.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.9 is not active+clean 2023-10-09T08:14:44.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:14:37.426794+0000', 'last_change': '2023-10-09T08:14:37.441856+0000', 'last_active': '2023-10-09T08:14:37.426794+0000', 'last_peered': '2023-10-09T08:14:37.426794+0000', 'last_clean': '2023-10-09T08:14:37.426794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:37.426794+0000', 'last_undegraded': '2023-10-09T08:14:37.426794+0000', 'last_fullsized': '2023-10-09T08:14:37.426794+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:08:03.250581+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T08:14:44.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.6 is not active+clean 2023-10-09T08:14:44.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:14:37.426794+0000', 'last_change': '2023-10-09T08:14:37.439352+0000', 'last_active': '2023-10-09T08:14:37.426794+0000', 'last_peered': '2023-10-09T08:14:37.426794+0000', 'last_clean': '2023-10-09T08:14:37.426794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:37.426794+0000', 'last_undegraded': '2023-10-09T08:14:37.426794+0000', 'last_fullsized': '2023-10-09T08:14:37.426794+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:44:04.977933+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T08:14:44.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.5 is not active+clean 2023-10-09T08:14:44.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:14:37.426794+0000', 'last_change': '2023-10-09T08:14:37.443544+0000', 'last_active': '2023-10-09T08:14:37.426794+0000', 'last_peered': '2023-10-09T08:14:37.426794+0000', 'last_clean': '2023-10-09T08:14:37.426794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:37.426794+0000', 'last_undegraded': '2023-10-09T08:14:37.426794+0000', 'last_fullsized': '2023-10-09T08:14:37.426794+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T10:07:03.303746+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T08:14:44.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3 is not active+clean 2023-10-09T08:14:44.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:14:37.426794+0000', 'last_change': '2023-10-09T08:14:37.438592+0000', 'last_active': '2023-10-09T08:14:37.426794+0000', 'last_peered': '2023-10-09T08:14:37.426794+0000', 'last_clean': '2023-10-09T08:14:37.426794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:37.426794+0000', 'last_undegraded': '2023-10-09T08:14:37.426794+0000', 'last_fullsized': '2023-10-09T08:14:37.426794+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:24:49.393514+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T08:14:44.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3 is not active+clean 2023-10-09T08:14:44.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2 is not active+clean 2023-10-09T08:14:44.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:14:37.426794+0000', 'last_change': '2023-10-09T08:14:37.442937+0000', 'last_active': '2023-10-09T08:14:37.426794+0000', 'last_peered': '2023-10-09T08:14:37.426794+0000', 'last_clean': '2023-10-09T08:14:37.426794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:37.426794+0000', 'last_undegraded': '2023-10-09T08:14:37.426794+0000', 'last_fullsized': '2023-10-09T08:14:37.426794+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T08:49:23.713246+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T08:14:44.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1 is not active+clean 2023-10-09T08:14:44.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:14:37.426794+0000', 'last_change': '2023-10-09T08:14:37.443699+0000', 'last_active': '2023-10-09T08:14:37.426794+0000', 'last_peered': '2023-10-09T08:14:37.426794+0000', 'last_clean': '2023-10-09T08:14:37.426794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:37.426794+0000', 'last_undegraded': '2023-10-09T08:14:37.426794+0000', 'last_fullsized': '2023-10-09T08:14:37.426794+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:40:26.250981+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T08:14:44.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1 is not active+clean 2023-10-09T08:14:44.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:14:38.432444+0000', 'last_change': '2023-10-09T08:14:38.432444+0000', 'last_active': '2023-10-09T08:14:38.432444+0000', 'last_peered': '2023-10-09T08:14:38.432444+0000', 'last_clean': '2023-10-09T08:14:38.432444+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:38.432444+0000', 'last_undegraded': '2023-10-09T08:14:38.432444+0000', 'last_fullsized': '2023-10-09T08:14:38.432444+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:38.432444+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:14:44.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.0 is not active+clean 2023-10-09T08:14:44.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:14:37.426794+0000', 'last_change': '2023-10-09T08:14:37.439589+0000', 'last_active': '2023-10-09T08:14:37.426794+0000', 'last_peered': '2023-10-09T08:14:37.426794+0000', 'last_clean': '2023-10-09T08:14:37.426794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:37.426794+0000', 'last_undegraded': '2023-10-09T08:14:37.426794+0000', 'last_fullsized': '2023-10-09T08:14:37.426794+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:13:33.528262+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T08:14:44.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.17 is not active+clean 2023-10-09T08:14:44.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:14:37.426794+0000', 'last_change': '2023-10-09T08:14:37.439194+0000', 'last_active': '2023-10-09T08:14:37.426794+0000', 'last_peered': '2023-10-09T08:14:37.426794+0000', 'last_clean': '2023-10-09T08:14:37.426794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:14:37.426794+0000', 'last_undegraded': '2023-10-09T08:14:37.426794+0000', 'last_fullsized': '2023-10-09T08:14:37.426794+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'last_clean_scrub_stamp': '2023-10-09T08:14:37.426794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:23:34.614137+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T08:14:44.701 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T08:14:44.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.903+0000 7fc416bff700 1 Processor -- start 2023-10-09T08:14:44.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.903+0000 7fc416bff700 1 -- start start 2023-10-09T08:14:44.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.904+0000 7fc416bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc410157770 0x7fc410157b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:44.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.904+0000 7fc416bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc4100b1600 0x7fc4100b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:44.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.905+0000 7fc416bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4100acdd0 con 0x7fc4100abd30 2023-10-09T08:14:44.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.905+0000 7fc416bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4100b1fb0 con 0x7fc4100b1600 2023-10-09T08:14:44.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.905+0000 7fc416bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4100ac1c0 con 0x7fc410157770 2023-10-09T08:14:44.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.905+0000 7fc41519c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc4100b1600 0x7fc4100b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:44.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.905+0000 7fc41519c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc4100b1600 0x7fc4100b1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51376/0 (socket says 172.21.15.71:51376) 2023-10-09T08:14:44.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.905+0000 7fc41519c700 1 -- 172.21.15.71:0/2403635614 learned_addr learned my addr 172.21.15.71:0/2403635614 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:44.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.905+0000 7fc41499b700 1 --2- 172.21.15.71:0/2403635614 >> v2:172.21.15.179:3300/0 conn(0x7fc410157770 0x7fc410157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:44.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.905+0000 7fc41519c700 1 -- 172.21.15.71:0/2403635614 >> v2:172.21.15.179:3300/0 conn(0x7fc410157770 msgr2=0x7fc410157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:44.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.905+0000 7fc41519c700 1 --2- 172.21.15.71:0/2403635614 >> v2:172.21.15.179:3300/0 conn(0x7fc410157770 0x7fc410157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.905+0000 7fc41519c700 1 -- 172.21.15.71:0/2403635614 >> v1:172.21.15.179:6789/0 conn(0x7fc4100abd30 legacy=0x7fc4100cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:44.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.905+0000 7fc41519c700 1 -- 172.21.15.71:0/2403635614 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4100ac4a0 con 0x7fc4100b1600 2023-10-09T08:14:44.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.906+0000 7fc41519c700 1 --2- 172.21.15.71:0/2403635614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4100b1600 0x7fc4100b1a70 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fc4100695d0 tx=0x7fc408009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f352401a6c97e2e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:44.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.906+0000 7fc40f7fe700 1 -- 172.21.15.71:0/2403635614 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40800e070 con 0x7fc4100b1600 2023-10-09T08:14:44.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.906+0000 7fc40f7fe700 1 -- 172.21.15.71:0/2403635614 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40800ba50 con 0x7fc4100b1600 2023-10-09T08:14:44.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.906+0000 7fc40f7fe700 1 -- 172.21.15.71:0/2403635614 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4080092e0 con 0x7fc4100b1600 2023-10-09T08:14:44.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.906+0000 7fc416bff700 1 -- 172.21.15.71:0/2403635614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4100b1600 msgr2=0x7fc4100b1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:44.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.906+0000 7fc416bff700 1 --2- 172.21.15.71:0/2403635614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4100b1600 0x7fc4100b1a70 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fc4100695d0 tx=0x7fc408009840 comp rx=0 tx=0).stop 2023-10-09T08:14:44.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.906+0000 7fc416bff700 1 -- 172.21.15.71:0/2403635614 shutdown_connections 2023-10-09T08:14:44.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.906+0000 7fc416bff700 1 --2- 172.21.15.71:0/2403635614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4100b1600 0x7fc4100b1a70 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.906+0000 7fc416bff700 1 --2- 172.21.15.71:0/2403635614 >> v2:172.21.15.179:3300/0 conn(0x7fc410157770 0x7fc410157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.906+0000 7fc416bff700 1 -- 172.21.15.71:0/2403635614 >> 172.21.15.71:0/2403635614 conn(0x7fc41006a310 msgr2=0x7fc4100cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:44.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.907+0000 7fc416bff700 1 -- 172.21.15.71:0/2403635614 shutdown_connections 2023-10-09T08:14:44.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.907+0000 7fc416bff700 1 -- 172.21.15.71:0/2403635614 wait complete. 2023-10-09T08:14:44.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.908+0000 7fc416bff700 1 Processor -- start 2023-10-09T08:14:44.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.908+0000 7fc416bff700 1 -- start start 2023-10-09T08:14:44.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.909+0000 7fc416bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4100abd30 0x7fc4101460f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:44.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.909+0000 7fc416bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4100b1600 0x7fc4100aa910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:44.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.909+0000 7fc416bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc410157770 0x7fc4100aae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:44.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.909+0000 7fc416bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41015cd90 con 0x7fc4100b1600 2023-10-09T08:14:44.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.909+0000 7fc416bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc410159820 con 0x7fc410157770 2023-10-09T08:14:44.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.909+0000 7fc416bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc410159b00 con 0x7fc4100abd30 2023-10-09T08:14:44.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.909+0000 7fc40ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4100b1600 0x7fc4100aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:44.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.909+0000 7fc40ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4100b1600 0x7fc4100aa910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51392/0 (socket says 172.21.15.71:51392) 2023-10-09T08:14:44.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.909+0000 7fc40ffff700 1 -- 172.21.15.71:0/2147211561 learned_addr learned my addr 172.21.15.71:0/2147211561 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:44.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.910+0000 7fc41499b700 1 --2- 172.21.15.71:0/2147211561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4100abd30 0x7fc4101460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:44.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.910+0000 7fc41519c700 1 --2- 172.21.15.71:0/2147211561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc410157770 0x7fc4100aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:44.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.910+0000 7fc40ffff700 1 -- 172.21.15.71:0/2147211561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4100abd30 msgr2=0x7fc4101460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:44.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.910+0000 7fc40ffff700 1 --2- 172.21.15.71:0/2147211561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4100abd30 0x7fc4101460f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.910+0000 7fc40ffff700 1 -- 172.21.15.71:0/2147211561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc410157770 msgr2=0x7fc4100aae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:44.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.910+0000 7fc40ffff700 1 --2- 172.21.15.71:0/2147211561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc410157770 0x7fc4100aae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:44.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.910+0000 7fc40ffff700 1 -- 172.21.15.71:0/2147211561 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc408009ae0 con 0x7fc4100b1600 2023-10-09T08:14:44.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.910+0000 7fc40ffff700 1 --2- 172.21.15.71:0/2147211561 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4100b1600 0x7fc4100aa910 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc00c790 tx=0x7fc3fc007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:44.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.910+0000 7fc40cff9700 1 -- 172.21.15.71:0/2147211561 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc011590 con 0x7fc4100b1600 2023-10-09T08:14:44.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.910+0000 7fc40cff9700 1 -- 172.21.15.71:0/2147211561 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc0116f0 con 0x7fc4100b1600 2023-10-09T08:14:44.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.910+0000 7fc40cff9700 1 -- 172.21.15.71:0/2147211561 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc011ab0 con 0x7fc4100b1600 2023-10-09T08:14:44.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.910+0000 7fc416bff700 1 -- 172.21.15.71:0/2147211561 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc410159de0 con 0x7fc4100b1600 2023-10-09T08:14:44.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.910+0000 7fc416bff700 1 -- 172.21.15.71:0/2147211561 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc410158b50 con 0x7fc4100b1600 2023-10-09T08:14:44.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.911+0000 7fc416bff700 1 -- 172.21.15.71:0/2147211561 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc41015cb60 con 0x7fc4100b1600 2023-10-09T08:14:44.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.912+0000 7fc40cff9700 1 -- 172.21.15.71:0/2147211561 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc3fc01a360 con 0x7fc4100b1600 2023-10-09T08:14:44.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.913+0000 7fc40cff9700 1 --2- 172.21.15.71:0/2147211561 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc3f4066f60 0x7fc3f4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:44.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.913+0000 7fc40cff9700 1 -- 172.21.15.71:0/2147211561 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6197+0+0 (secure 0 0 0) 0x7fc3fc083770 con 0x7fc4100b1600 2023-10-09T08:14:44.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.914+0000 7fc41499b700 1 --2- 172.21.15.71:0/2147211561 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc3f4066f60 0x7fc3f4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:44.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.915+0000 7fc41499b700 1 --2- 172.21.15.71:0/2147211561 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc3f4066f60 0x7fc3f4069410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc404006fd0 tx=0x7fc404008040 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:44.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:44.918+0000 7fc40cff9700 1 -- 172.21.15.71:0/2147211561 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc41015cb60 con 0x7fc4100b1600 2023-10-09T08:14:45.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.189+0000 7fc416bff700 1 -- 172.21.15.71:0/2147211561 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc41015cb60 con 0x7fc4100b1600 2023-10-09T08:14:45.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.189+0000 7fc40cff9700 1 -- 172.21.15.71:0/2147211561 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1179 (secure 0 0 0) 0x7fc41015cb60 con 0x7fc4100b1600 2023-10-09T08:14:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:14:45.189 INFO:teuthology.orchestra.run.smithi071.stdout:{"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":5551,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":194,"num_osds":8,"num_up_osds":8,"osd_up_since":1696833745,"num_in_osds":8,"osd_in_since":1696833737,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":44},{"state_name":"unknown","count":32},{"state_name":"creating+peering","count":21}],"num_pgs":97,"num_pools":3,"num_objects":8,"data_bytes":591082,"bytes_used":2543923200,"bytes_avail":770550190080,"bytes_total":773094113280,"unknown_pgs_ratio":0.32989689707756042,"inactive_pgs_ratio":0.2164948433637619,"write_bytes_sec":538,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":89,"id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"d","status":"up:active","gid":9678}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2023-10-09T08:10:25.530925+0000","services":{}},"progress_events":{}} 2023-10-09T08:14:45.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.191+0000 7fc416bff700 1 -- 172.21.15.71:0/2147211561 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc3f4066f60 msgr2=0x7fc3f4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:45.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.191+0000 7fc416bff700 1 --2- 172.21.15.71:0/2147211561 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc3f4066f60 0x7fc3f4069410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc404006fd0 tx=0x7fc404008040 comp rx=0 tx=0).stop 2023-10-09T08:14:45.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.191+0000 7fc416bff700 1 -- 172.21.15.71:0/2147211561 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4100b1600 msgr2=0x7fc4100aa910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:45.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.191+0000 7fc416bff700 1 --2- 172.21.15.71:0/2147211561 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4100b1600 0x7fc4100aa910 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc00c790 tx=0x7fc3fc007f20 comp rx=0 tx=0).stop 2023-10-09T08:14:45.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.191+0000 7fc416bff700 1 -- 172.21.15.71:0/2147211561 shutdown_connections 2023-10-09T08:14:45.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.191+0000 7fc416bff700 1 --2- 172.21.15.71:0/2147211561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc410157770 0x7fc4100aae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:45.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.191+0000 7fc416bff700 1 --2- 172.21.15.71:0/2147211561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4100abd30 0x7fc4101460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:45.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.191+0000 7fc416bff700 1 --2- 172.21.15.71:0/2147211561 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc3f4066f60 0x7fc3f4069410 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.191+0000 7fc416bff700 1 --2- 172.21.15.71:0/2147211561 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4100b1600 0x7fc4100aa910 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.191+0000 7fc416bff700 1 -- 172.21.15.71:0/2147211561 >> 172.21.15.71:0/2147211561 conn(0x7fc41006a310 msgr2=0x7fc4100cc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.192+0000 7fc416bff700 1 -- 172.21.15.71:0/2147211561 shutdown_connections 2023-10-09T08:14:45.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.192+0000 7fc416bff700 1 -- 172.21.15.71:0/2147211561 wait complete. 2023-10-09T08:14:45.209 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T08:14:45.209 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T08:14:45.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.390+0000 7ff4511ff700 1 Processor -- start 2023-10-09T08:14:45.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.390+0000 7ff4511ff700 1 -- start start 2023-10-09T08:14:45.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.391+0000 7ff4511ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff44c155c10 0x7ff44c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:45.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.391+0000 7ff4511ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff44c0ac6d0 0x7ff44c0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:45.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.391+0000 7ff4511ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44c0acac0 con 0x7ff44c0ac230 2023-10-09T08:14:45.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.391+0000 7ff4511ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44c0ad930 con 0x7ff44c155c10 2023-10-09T08:14:45.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.391+0000 7ff4511ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c0acd20 con 0x7ff44c0ac6d0 2023-10-09T08:14:45.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.391+0000 7ff44ad9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff44c155c10 0x7ff44c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:45.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.391+0000 7ff44a59c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff44c0ac230 0x7ff44c1568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44032/0 (socket says 172.21.15.71:44032) 2023-10-09T08:14:45.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.391+0000 7ff44a59c700 1 -- 172.21.15.71:0/1153339229 learned_addr learned my addr 172.21.15.71:0/1153339229 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:45.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.392+0000 7ff44b59e700 1 --2- 172.21.15.71:0/1153339229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff44c0ac6d0 0x7ff44c0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:45.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.392+0000 7ff44ad9d700 1 -- 172.21.15.71:0/1153339229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff44c0ac6d0 msgr2=0x7ff44c0b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:45.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.392+0000 7ff44ad9d700 1 --2- 172.21.15.71:0/1153339229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff44c0ac6d0 0x7ff44c0b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:45.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.392+0000 7ff44ad9d700 1 -- 172.21.15.71:0/1153339229 >> v1:172.21.15.71:6789/0 conn(0x7ff44c0ac230 legacy=0x7ff44c1568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:45.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.392+0000 7ff44ad9d700 1 -- 172.21.15.71:0/1153339229 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c0ad000 con 0x7ff44c155c10 2023-10-09T08:14:45.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.392+0000 7ff44b59e700 1 --2- 172.21.15.71:0/1153339229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff44c0ac6d0 0x7ff44c0b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:14:45.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.392+0000 7ff44ad9d700 1 --2- 172.21.15.71:0/1153339229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff44c155c10 0x7ff44c155fe0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7ff44c0acc50 tx=0x7ff43c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f669457c99009a61 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:45.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.392+0000 7ff449d9b700 1 -- 172.21.15.71:0/1153339229 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c00b6b0 con 0x7ff44c155c10 2023-10-09T08:14:45.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.392+0000 7ff449d9b700 1 -- 172.21.15.71:0/1153339229 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43c00b810 con 0x7ff44c155c10 2023-10-09T08:14:45.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.392+0000 7ff449d9b700 1 -- 172.21.15.71:0/1153339229 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c00bbd0 con 0x7ff44c155c10 2023-10-09T08:14:45.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.393+0000 7ff4511ff700 1 -- 172.21.15.71:0/1153339229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff44c155c10 msgr2=0x7ff44c155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:45.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.393+0000 7ff4511ff700 1 --2- 172.21.15.71:0/1153339229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff44c155c10 0x7ff44c155fe0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7ff44c0acc50 tx=0x7ff43c0091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:45.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.393+0000 7ff4511ff700 1 -- 172.21.15.71:0/1153339229 shutdown_connections 2023-10-09T08:14:45.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.393+0000 7ff4511ff700 1 --2- 172.21.15.71:0/1153339229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff44c0ac6d0 0x7ff44c0b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:45.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.393+0000 7ff4511ff700 1 --2- 172.21.15.71:0/1153339229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff44c155c10 0x7ff44c155fe0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:45.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.393+0000 7ff4511ff700 1 -- 172.21.15.71:0/1153339229 >> 172.21.15.71:0/1153339229 conn(0x7ff44c06a320 msgr2=0x7ff44c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:45.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.393+0000 7ff4511ff700 1 -- 172.21.15.71:0/1153339229 shutdown_connections 2023-10-09T08:14:45.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.393+0000 7ff4511ff700 1 -- 172.21.15.71:0/1153339229 wait complete. 2023-10-09T08:14:45.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.394+0000 7ff4511ff700 1 Processor -- start 2023-10-09T08:14:45.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.395+0000 7ff4511ff700 1 -- start start 2023-10-09T08:14:45.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.395+0000 7ff4511ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff44c0ac230 0x7ff44c165980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:45.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.395+0000 7ff4511ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff44c0ac6d0 0x7ff44c0cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:45.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.395+0000 7ff4511ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff44c155c10 0x7ff44c0aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:45.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.395+0000 7ff4511ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c0c9830 con 0x7ff44c0ac6d0 2023-10-09T08:14:45.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.395+0000 7ff4511ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c0c9b10 con 0x7ff44c0ac230 2023-10-09T08:14:45.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.395+0000 7ff4511ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c0c9df0 con 0x7ff44c155c10 2023-10-09T08:14:45.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.396+0000 7ff44a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff44c0ac6d0 0x7ff44c0cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:45.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.396+0000 7ff44a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff44c0ac6d0 0x7ff44c0cb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40082/0 (socket says 172.21.15.71:40082) 2023-10-09T08:14:45.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.396+0000 7ff44a59c700 1 -- 172.21.15.71:0/2518274604 learned_addr learned my addr 172.21.15.71:0/2518274604 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:45.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.396+0000 7ff44ad9d700 1 --2- 172.21.15.71:0/2518274604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff44c0ac230 0x7ff44c165980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:45.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.396+0000 7ff44b59e700 1 --2- 172.21.15.71:0/2518274604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff44c155c10 0x7ff44c0aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:45.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.396+0000 7ff44a59c700 1 -- 172.21.15.71:0/2518274604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff44c155c10 msgr2=0x7ff44c0aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:45.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.396+0000 7ff44a59c700 1 --2- 172.21.15.71:0/2518274604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff44c155c10 0x7ff44c0aa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:45.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.396+0000 7ff44a59c700 1 -- 172.21.15.71:0/2518274604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff44c0ac230 msgr2=0x7ff44c165980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:45.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.396+0000 7ff44a59c700 1 --2- 172.21.15.71:0/2518274604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff44c0ac230 0x7ff44c165980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:45.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.396+0000 7ff44a59c700 1 -- 172.21.15.71:0/2518274604 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c009420 con 0x7ff44c0ac6d0 2023-10-09T08:14:45.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.396+0000 7ff44b59e700 1 --2- 172.21.15.71:0/2518274604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff44c155c10 0x7ff44c0aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:14:45.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.396+0000 7ff44a59c700 1 --2- 172.21.15.71:0/2518274604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff44c0ac6d0 0x7ff44c0cb480 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7ff44000c7c0 tx=0x7ff440007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:45.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.397+0000 7ff432ffd700 1 -- 172.21.15.71:0/2518274604 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff440005b30 con 0x7ff44c0ac6d0 2023-10-09T08:14:45.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.397+0000 7ff432ffd700 1 -- 172.21.15.71:0/2518274604 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff440005c90 con 0x7ff44c0ac6d0 2023-10-09T08:14:45.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.397+0000 7ff4511ff700 1 -- 172.21.15.71:0/2518274604 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff44c0ca0d0 con 0x7ff44c0ac6d0 2023-10-09T08:14:45.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.397+0000 7ff432ffd700 1 -- 172.21.15.71:0/2518274604 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff440004a80 con 0x7ff44c0ac6d0 2023-10-09T08:14:45.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.397+0000 7ff4511ff700 1 -- 172.21.15.71:0/2518274604 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44c0c94e0 con 0x7ff44c0ac6d0 2023-10-09T08:14:45.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.398+0000 7ff4511ff700 1 -- 172.21.15.71:0/2518274604 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44c0ca570 con 0x7ff44c0ac6d0 2023-10-09T08:14:45.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.399+0000 7ff432ffd700 1 -- 172.21.15.71:0/2518274604 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4400070d0 con 0x7ff44c0ac6d0 2023-10-09T08:14:45.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.399+0000 7ff432ffd700 1 --2- 172.21.15.71:0/2518274604 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff438066f30 0x7ff4380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:45.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.399+0000 7ff432ffd700 1 -- 172.21.15.71:0/2518274604 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6197+0+0 (secure 0 0 0) 0x7ff440083b90 con 0x7ff44c0ac6d0 2023-10-09T08:14:45.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.400+0000 7ff44ad9d700 1 --2- 172.21.15.71:0/2518274604 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff438066f30 0x7ff4380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:45.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.400+0000 7ff44ad9d700 1 --2- 172.21.15.71:0/2518274604 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff438066f30 0x7ff4380693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff43c0091e0 tx=0x7ff43c016000 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:45.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.403+0000 7ff432ffd700 1 -- 172.21.15.71:0/2518274604 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff44004b5a0 con 0x7ff44c0ac6d0 2023-10-09T08:14:45.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.592+0000 7ff4511ff700 1 -- 172.21.15.71:0/2518274604 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff44c04c3c0 con 0x7ff438066f30 2023-10-09T08:14:45.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.601+0000 7ff432ffd700 1 -- 172.21.15.71:0/2518274604 <== mgr.8965 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289364 (secure 0 0 0) 0x7ff44c04c3c0 con 0x7ff438066f30 2023-10-09T08:14:45.604 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:14:45.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.605+0000 7ff4511ff700 1 -- 172.21.15.71:0/2518274604 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff438066f30 msgr2=0x7ff4380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:45.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.605+0000 7ff4511ff700 1 --2- 172.21.15.71:0/2518274604 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff438066f30 0x7ff4380693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff43c0091e0 tx=0x7ff43c016000 comp rx=0 tx=0).stop 2023-10-09T08:14:45.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.605+0000 7ff4511ff700 1 -- 172.21.15.71:0/2518274604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff44c0ac6d0 msgr2=0x7ff44c0cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:45.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.605+0000 7ff4511ff700 1 --2- 172.21.15.71:0/2518274604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff44c0ac6d0 0x7ff44c0cb480 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7ff44000c7c0 tx=0x7ff440007f70 comp rx=0 tx=0).stop 2023-10-09T08:14:45.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.605+0000 7ff4511ff700 1 -- 172.21.15.71:0/2518274604 shutdown_connections 2023-10-09T08:14:45.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.605+0000 7ff4511ff700 1 --2- 172.21.15.71:0/2518274604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff44c155c10 0x7ff44c0aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:45.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.605+0000 7ff4511ff700 1 --2- 172.21.15.71:0/2518274604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff44c0ac230 0x7ff44c165980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:45.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.605+0000 7ff4511ff700 1 --2- 172.21.15.71:0/2518274604 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff438066f30 0x7ff4380693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:45.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.605+0000 7ff4511ff700 1 --2- 172.21.15.71:0/2518274604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff44c0ac6d0 0x7ff44c0cb480 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:45.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.605+0000 7ff4511ff700 1 -- 172.21.15.71:0/2518274604 >> 172.21.15.71:0/2518274604 conn(0x7ff44c06a320 msgr2=0x7ff44c1548a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:45.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.605+0000 7ff4511ff700 1 -- 172.21.15.71:0/2518274604 shutdown_connections 2023-10-09T08:14:45.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:45.605+0000 7ff4511ff700 1 -- 172.21.15.71:0/2518274604 wait complete. 2023-10-09T08:14:45.608 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T08:14:45.622 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-09T08:14:45.141242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":583,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":364,"ondisk_log_size":364,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2488584,"kb_used_data":20168,"kb_used_omap":0,"kb_used_meta":2468352,"kb_avail":752486136,"statfs":{"total":773094113280,"available":770545803264,"internally_reserved":0,"allocated":20652032,"data_stored":10950780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2527592448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.700821"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.484338+0000","last_change":"2023-10-09T08:14:39.481559+0000","last_active":"2023-10-09T08:14:39.484338+0000","last_peered":"2023-10-09T08:14:39.484338+0000","last_clean":"2023-10-09T08:14:39.484338+0000","last_became_active":"2023-10-09T08:14:39.481257+0000","last_became_peered":"2023-10-09T08:14:39.481257+0000","last_unstale":"2023-10-09T08:14:39.484338+0000","last_undegraded":"2023-10-09T08:14:39.484338+0000","last_fullsized":"2023-10-09T08:14:39.484338+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:47.340414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.479731+0000","last_change":"2023-10-09T08:14:39.478053+0000","last_active":"2023-10-09T08:14:39.479731+0000","last_peered":"2023-10-09T08:14:39.479731+0000","last_clean":"2023-10-09T08:14:39.479731+0000","last_became_active":"2023-10-09T08:14:39.477780+0000","last_became_peered":"2023-10-09T08:14:39.477780+0000","last_unstale":"2023-10-09T08:14:39.479731+0000","last_undegraded":"2023-10-09T08:14:39.479731+0000","last_fullsized":"2023-10-09T08:14:39.479731+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:10:02.864400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.465855+0000","last_change":"2023-10-09T08:14:39.462337+0000","last_active":"2023-10-09T08:14:39.465855+0000","last_peered":"2023-10-09T08:14:39.465855+0000","last_clean":"2023-10-09T08:14:39.465855+0000","last_became_active":"2023-10-09T08:14:39.461991+0000","last_became_peered":"2023-10-09T08:14:39.461991+0000","last_unstale":"2023-10-09T08:14:39.465855+0000","last_undegraded":"2023-10-09T08:14:39.465855+0000","last_fullsized":"2023-10-09T08:14:39.465855+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:12:23.337933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478301+0000","last_change":"2023-10-09T08:14:39.473471+0000","last_active":"2023-10-09T08:14:39.478301+0000","last_peered":"2023-10-09T08:14:39.478301+0000","last_clean":"2023-10-09T08:14:39.478301+0000","last_became_active":"2023-10-09T08:14:39.473136+0000","last_became_peered":"2023-10-09T08:14:39.473136+0000","last_unstale":"2023-10-09T08:14:39.478301+0000","last_undegraded":"2023-10-09T08:14:39.478301+0000","last_fullsized":"2023-10-09T08:14:39.478301+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:07:04.309396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.490651+0000","last_change":"2023-10-09T08:14:39.488645+0000","last_active":"2023-10-09T08:14:39.490651+0000","last_peered":"2023-10-09T08:14:39.490651+0000","last_clean":"2023-10-09T08:14:39.490651+0000","last_became_active":"2023-10-09T08:14:39.488320+0000","last_became_peered":"2023-10-09T08:14:39.488320+0000","last_unstale":"2023-10-09T08:14:39.490651+0000","last_undegraded":"2023-10-09T08:14:39.490651+0000","last_fullsized":"2023-10-09T08:14:39.490651+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:34:13.309045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.483532+0000","last_change":"2023-10-09T08:14:39.479211+0000","last_active":"2023-10-09T08:14:39.483532+0000","last_peered":"2023-10-09T08:14:39.483532+0000","last_clean":"2023-10-09T08:14:39.483532+0000","last_became_active":"2023-10-09T08:14:39.478472+0000","last_became_peered":"2023-10-09T08:14:39.478472+0000","last_unstale":"2023-10-09T08:14:39.483532+0000","last_undegraded":"2023-10-09T08:14:39.483532+0000","last_fullsized":"2023-10-09T08:14:39.483532+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:37:42.156487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.487669+0000","last_change":"2023-10-09T08:14:39.486690+0000","last_active":"2023-10-09T08:14:39.487669+0000","last_peered":"2023-10-09T08:14:39.487669+0000","last_clean":"2023-10-09T08:14:39.487669+0000","last_became_active":"2023-10-09T08:14:39.486410+0000","last_became_peered":"2023-10-09T08:14:39.486410+0000","last_unstale":"2023-10-09T08:14:39.487669+0000","last_undegraded":"2023-10-09T08:14:39.487669+0000","last_fullsized":"2023-10-09T08:14:39.487669+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:30.404764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.476279+0000","last_change":"2023-10-09T08:14:39.472830+0000","last_active":"2023-10-09T08:14:39.476279+0000","last_peered":"2023-10-09T08:14:39.476279+0000","last_clean":"2023-10-09T08:14:39.476279+0000","last_became_active":"2023-10-09T08:14:39.472557+0000","last_became_peered":"2023-10-09T08:14:39.472557+0000","last_unstale":"2023-10-09T08:14:39.476279+0000","last_undegraded":"2023-10-09T08:14:39.476279+0000","last_fullsized":"2023-10-09T08:14:39.476279+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:57.535414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.488597+0000","last_change":"2023-10-09T08:14:39.486084+0000","last_active":"2023-10-09T08:14:39.488597+0000","last_peered":"2023-10-09T08:14:39.488597+0000","last_clean":"2023-10-09T08:14:39.488597+0000","last_became_active":"2023-10-09T08:14:39.485791+0000","last_became_peered":"2023-10-09T08:14:39.485791+0000","last_unstale":"2023-10-09T08:14:39.488597+0000","last_undegraded":"2023-10-09T08:14:39.488597+0000","last_fullsized":"2023-10-09T08:14:39.488597+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:51.153845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.480833+0000","last_change":"2023-10-09T08:14:39.479608+0000","last_active":"2023-10-09T08:14:39.480833+0000","last_peered":"2023-10-09T08:14:39.480833+0000","last_clean":"2023-10-09T08:14:39.480833+0000","last_became_active":"2023-10-09T08:14:39.479350+0000","last_became_peered":"2023-10-09T08:14:39.479350+0000","last_unstale":"2023-10-09T08:14:39.480833+0000","last_undegraded":"2023-10-09T08:14:39.480833+0000","last_fullsized":"2023-10-09T08:14:39.480833+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:00:01.549387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.489617+0000","last_change":"2023-10-09T08:14:39.487882+0000","last_active":"2023-10-09T08:14:39.489617+0000","last_peered":"2023-10-09T08:14:39.489617+0000","last_clean":"2023-10-09T08:14:39.489617+0000","last_became_active":"2023-10-09T08:14:39.487552+0000","last_became_peered":"2023-10-09T08:14:39.487552+0000","last_unstale":"2023-10-09T08:14:39.489617+0000","last_undegraded":"2023-10-09T08:14:39.489617+0000","last_fullsized":"2023-10-09T08:14:39.489617+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:04.566842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.487480+0000","last_change":"2023-10-09T08:14:39.485191+0000","last_active":"2023-10-09T08:14:39.487480+0000","last_peered":"2023-10-09T08:14:39.487480+0000","last_clean":"2023-10-09T08:14:39.487480+0000","last_became_active":"2023-10-09T08:14:39.484915+0000","last_became_peered":"2023-10-09T08:14:39.484915+0000","last_unstale":"2023-10-09T08:14:39.487480+0000","last_undegraded":"2023-10-09T08:14:39.487480+0000","last_fullsized":"2023-10-09T08:14:39.487480+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:29:06.229231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.468634+0000","last_change":"2023-10-09T08:14:39.465750+0000","last_active":"2023-10-09T08:14:39.468634+0000","last_peered":"2023-10-09T08:14:39.468634+0000","last_clean":"2023-10-09T08:14:39.468634+0000","last_became_active":"2023-10-09T08:14:39.465439+0000","last_became_peered":"2023-10-09T08:14:39.465439+0000","last_unstale":"2023-10-09T08:14:39.468634+0000","last_undegraded":"2023-10-09T08:14:39.468634+0000","last_fullsized":"2023-10-09T08:14:39.468634+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:50:41.565341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481561+0000","last_change":"2023-10-09T08:14:39.476147+0000","last_active":"2023-10-09T08:14:39.481561+0000","last_peered":"2023-10-09T08:14:39.481561+0000","last_clean":"2023-10-09T08:14:39.481561+0000","last_became_active":"2023-10-09T08:14:39.475869+0000","last_became_peered":"2023-10-09T08:14:39.475869+0000","last_unstale":"2023-10-09T08:14:39.481561+0000","last_undegraded":"2023-10-09T08:14:39.481561+0000","last_fullsized":"2023-10-09T08:14:39.481561+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:45.463893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481865+0000","last_change":"2023-10-09T08:14:39.479153+0000","last_active":"2023-10-09T08:14:39.481865+0000","last_peered":"2023-10-09T08:14:39.481865+0000","last_clean":"2023-10-09T08:14:39.481865+0000","last_became_active":"2023-10-09T08:14:39.478895+0000","last_became_peered":"2023-10-09T08:14:39.478895+0000","last_unstale":"2023-10-09T08:14:39.481865+0000","last_undegraded":"2023-10-09T08:14:39.481865+0000","last_fullsized":"2023-10-09T08:14:39.481865+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:40.161626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481640+0000","last_change":"2023-10-09T08:14:39.477874+0000","last_active":"2023-10-09T08:14:39.481640+0000","last_peered":"2023-10-09T08:14:39.481640+0000","last_clean":"2023-10-09T08:14:39.481640+0000","last_became_active":"2023-10-09T08:14:39.477475+0000","last_became_peered":"2023-10-09T08:14:39.477475+0000","last_unstale":"2023-10-09T08:14:39.481640+0000","last_undegraded":"2023-10-09T08:14:39.481640+0000","last_fullsized":"2023-10-09T08:14:39.481640+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:50:38.316596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.484420+0000","last_change":"2023-10-09T08:14:39.481354+0000","last_active":"2023-10-09T08:14:39.484420+0000","last_peered":"2023-10-09T08:14:39.484420+0000","last_clean":"2023-10-09T08:14:39.484420+0000","last_became_active":"2023-10-09T08:14:39.481092+0000","last_became_peered":"2023-10-09T08:14:39.481092+0000","last_unstale":"2023-10-09T08:14:39.484420+0000","last_undegraded":"2023-10-09T08:14:39.484420+0000","last_fullsized":"2023-10-09T08:14:39.484420+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:50.399165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478600+0000","last_change":"2023-10-09T08:14:39.471598+0000","last_active":"2023-10-09T08:14:39.478600+0000","last_peered":"2023-10-09T08:14:39.478600+0000","last_clean":"2023-10-09T08:14:39.478600+0000","last_became_active":"2023-10-09T08:14:39.471342+0000","last_became_peered":"2023-10-09T08:14:39.471342+0000","last_unstale":"2023-10-09T08:14:39.478600+0000","last_undegraded":"2023-10-09T08:14:39.478600+0000","last_fullsized":"2023-10-09T08:14:39.478600+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:18:14.449986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.488248+0000","last_change":"2023-10-09T08:14:39.487286+0000","last_active":"2023-10-09T08:14:39.488248+0000","last_peered":"2023-10-09T08:14:39.488248+0000","last_clean":"2023-10-09T08:14:39.488248+0000","last_became_active":"2023-10-09T08:14:39.486306+0000","last_became_peered":"2023-10-09T08:14:39.486306+0000","last_unstale":"2023-10-09T08:14:39.488248+0000","last_undegraded":"2023-10-09T08:14:39.488248+0000","last_fullsized":"2023-10-09T08:14:39.488248+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:54.313934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.474774+0000","last_change":"2023-10-09T08:14:39.469442+0000","last_active":"2023-10-09T08:14:39.474774+0000","last_peered":"2023-10-09T08:14:39.474774+0000","last_clean":"2023-10-09T08:14:39.474774+0000","last_became_active":"2023-10-09T08:14:39.469139+0000","last_became_peered":"2023-10-09T08:14:39.469139+0000","last_unstale":"2023-10-09T08:14:39.474774+0000","last_undegraded":"2023-10-09T08:14:39.474774+0000","last_fullsized":"2023-10-09T08:14:39.474774+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:27.256631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.477409+0000","last_change":"2023-10-09T08:14:39.471677+0000","last_active":"2023-10-09T08:14:39.477409+0000","last_peered":"2023-10-09T08:14:39.477409+0000","last_clean":"2023-10-09T08:14:39.477409+0000","last_became_active":"2023-10-09T08:14:39.471412+0000","last_became_peered":"2023-10-09T08:14:39.471412+0000","last_unstale":"2023-10-09T08:14:39.477409+0000","last_undegraded":"2023-10-09T08:14:39.477409+0000","last_fullsized":"2023-10-09T08:14:39.477409+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:15:48.546235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.477941+0000","last_change":"2023-10-09T08:14:39.476263+0000","last_active":"2023-10-09T08:14:39.477941+0000","last_peered":"2023-10-09T08:14:39.477941+0000","last_clean":"2023-10-09T08:14:39.477941+0000","last_became_active":"2023-10-09T08:14:39.475984+0000","last_became_peered":"2023-10-09T08:14:39.475984+0000","last_unstale":"2023-10-09T08:14:39.477941+0000","last_undegraded":"2023-10-09T08:14:39.477941+0000","last_fullsized":"2023-10-09T08:14:39.477941+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:29.408646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.483651+0000","last_change":"2023-10-09T08:14:39.480496+0000","last_active":"2023-10-09T08:14:39.483651+0000","last_peered":"2023-10-09T08:14:39.483651+0000","last_clean":"2023-10-09T08:14:39.483651+0000","last_became_active":"2023-10-09T08:14:39.479949+0000","last_became_peered":"2023-10-09T08:14:39.479949+0000","last_unstale":"2023-10-09T08:14:39.483651+0000","last_undegraded":"2023-10-09T08:14:39.483651+0000","last_fullsized":"2023-10-09T08:14:39.483651+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:16.219371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.476260+0000","last_change":"2023-10-09T08:14:39.471163+0000","last_active":"2023-10-09T08:14:39.476260+0000","last_peered":"2023-10-09T08:14:39.476260+0000","last_clean":"2023-10-09T08:14:39.476260+0000","last_became_active":"2023-10-09T08:14:39.470218+0000","last_became_peered":"2023-10-09T08:14:39.470218+0000","last_unstale":"2023-10-09T08:14:39.476260+0000","last_undegraded":"2023-10-09T08:14:39.476260+0000","last_fullsized":"2023-10-09T08:14:39.476260+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:48:35.054792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.480194+0000","last_change":"2023-10-09T08:14:39.474252+0000","last_active":"2023-10-09T08:14:39.480194+0000","last_peered":"2023-10-09T08:14:39.480194+0000","last_clean":"2023-10-09T08:14:39.480194+0000","last_became_active":"2023-10-09T08:14:39.474012+0000","last_became_peered":"2023-10-09T08:14:39.474012+0000","last_unstale":"2023-10-09T08:14:39.480194+0000","last_undegraded":"2023-10-09T08:14:39.480194+0000","last_fullsized":"2023-10-09T08:14:39.480194+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:30:45.182691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.482772+0000","last_change":"2023-10-09T08:14:39.479390+0000","last_active":"2023-10-09T08:14:39.482772+0000","last_peered":"2023-10-09T08:14:39.482772+0000","last_clean":"2023-10-09T08:14:39.482772+0000","last_became_active":"2023-10-09T08:14:39.479115+0000","last_became_peered":"2023-10-09T08:14:39.479115+0000","last_unstale":"2023-10-09T08:14:39.482772+0000","last_undegraded":"2023-10-09T08:14:39.482772+0000","last_fullsized":"2023-10-09T08:14:39.482772+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:40.161626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481353+0000","last_change":"2023-10-09T08:14:39.476441+0000","last_active":"2023-10-09T08:14:39.481353+0000","last_peered":"2023-10-09T08:14:39.481353+0000","last_clean":"2023-10-09T08:14:39.481353+0000","last_became_active":"2023-10-09T08:14:39.476157+0000","last_became_peered":"2023-10-09T08:14:39.476157+0000","last_unstale":"2023-10-09T08:14:39.481353+0000","last_undegraded":"2023-10-09T08:14:39.481353+0000","last_fullsized":"2023-10-09T08:14:39.481353+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:41.265953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.487700+0000","last_change":"2023-10-09T08:14:39.482489+0000","last_active":"2023-10-09T08:14:39.487700+0000","last_peered":"2023-10-09T08:14:39.487700+0000","last_clean":"2023-10-09T08:14:39.487700+0000","last_became_active":"2023-10-09T08:14:39.482221+0000","last_became_peered":"2023-10-09T08:14:39.482221+0000","last_unstale":"2023-10-09T08:14:39.487700+0000","last_undegraded":"2023-10-09T08:14:39.487700+0000","last_fullsized":"2023-10-09T08:14:39.487700+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:27.256631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481386+0000","last_change":"2023-10-09T08:14:39.476384+0000","last_active":"2023-10-09T08:14:39.481386+0000","last_peered":"2023-10-09T08:14:39.481386+0000","last_clean":"2023-10-09T08:14:39.481386+0000","last_became_active":"2023-10-09T08:14:39.475680+0000","last_became_peered":"2023-10-09T08:14:39.475680+0000","last_unstale":"2023-10-09T08:14:39.481386+0000","last_undegraded":"2023-10-09T08:14:39.481386+0000","last_fullsized":"2023-10-09T08:14:39.481386+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:10.701415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.484467+0000","last_change":"2023-10-09T08:14:39.475274+0000","last_active":"2023-10-09T08:14:39.484467+0000","last_peered":"2023-10-09T08:14:39.484467+0000","last_clean":"2023-10-09T08:14:39.484467+0000","last_became_active":"2023-10-09T08:14:39.475014+0000","last_became_peered":"2023-10-09T08:14:39.475014+0000","last_unstale":"2023-10-09T08:14:39.484467+0000","last_undegraded":"2023-10-09T08:14:39.484467+0000","last_fullsized":"2023-10-09T08:14:39.484467+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:53:15.004702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.484546+0000","last_change":"2023-10-09T08:14:39.479153+0000","last_active":"2023-10-09T08:14:39.484546+0000","last_peered":"2023-10-09T08:14:39.484546+0000","last_clean":"2023-10-09T08:14:39.484546+0000","last_became_active":"2023-10-09T08:14:39.478911+0000","last_became_peered":"2023-10-09T08:14:39.478911+0000","last_unstale":"2023-10-09T08:14:39.484546+0000","last_undegraded":"2023-10-09T08:14:39.484546+0000","last_fullsized":"2023-10-09T08:14:39.484546+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:46.686150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.479656+0000","last_change":"2023-10-09T08:14:39.471497+0000","last_active":"2023-10-09T08:14:39.479656+0000","last_peered":"2023-10-09T08:14:39.479656+0000","last_clean":"2023-10-09T08:14:39.479656+0000","last_became_active":"2023-10-09T08:14:39.471197+0000","last_became_peered":"2023-10-09T08:14:39.471197+0000","last_unstale":"2023-10-09T08:14:39.479656+0000","last_undegraded":"2023-10-09T08:14:39.479656+0000","last_fullsized":"2023-10-09T08:14:39.479656+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:36:19.307671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.482753+0000","last_change":"2023-10-09T08:14:39.478983+0000","last_active":"2023-10-09T08:14:39.482753+0000","last_peered":"2023-10-09T08:14:39.482753+0000","last_clean":"2023-10-09T08:14:39.482753+0000","last_became_active":"2023-10-09T08:14:39.478606+0000","last_became_peered":"2023-10-09T08:14:39.478606+0000","last_unstale":"2023-10-09T08:14:39.482753+0000","last_undegraded":"2023-10-09T08:14:39.482753+0000","last_fullsized":"2023-10-09T08:14:39.482753+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:41:47.263574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"193'4","reported_seq":14,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.495194+0000","last_change":"2023-10-09T08:14:38.465359+0000","last_active":"2023-10-09T08:14:39.495194+0000","last_peered":"2023-10-09T08:14:39.495194+0000","last_clean":"2023-10-09T08:14:39.495194+0000","last_became_active":"2023-10-09T08:14:38.465002+0000","last_became_peered":"2023-10-09T08:14:38.465002+0000","last_unstale":"2023-10-09T08:14:39.495194+0000","last_undegraded":"2023-10-09T08:14:39.495194+0000","last_fullsized":"2023-10-09T08:14:39.495194+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:33.507990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.466598+0000","last_change":"2023-10-09T08:14:39.462902+0000","last_active":"2023-10-09T08:14:39.466598+0000","last_peered":"2023-10-09T08:14:39.466598+0000","last_clean":"2023-10-09T08:14:39.466598+0000","last_became_active":"2023-10-09T08:14:39.462580+0000","last_became_peered":"2023-10-09T08:14:39.462580+0000","last_unstale":"2023-10-09T08:14:39.466598+0000","last_undegraded":"2023-10-09T08:14:39.466598+0000","last_fullsized":"2023-10-09T08:14:39.466598+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:54:35.010687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"193'1","reported_seq":11,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.491481+0000","last_change":"2023-10-09T08:14:38.457221+0000","last_active":"2023-10-09T08:14:39.491481+0000","last_peered":"2023-10-09T08:14:39.491481+0000","last_clean":"2023-10-09T08:14:39.491481+0000","last_became_active":"2023-10-09T08:14:38.456915+0000","last_became_peered":"2023-10-09T08:14:38.456915+0000","last_unstale":"2023-10-09T08:14:39.491481+0000","last_undegraded":"2023-10-09T08:14:39.491481+0000","last_fullsized":"2023-10-09T08:14:39.491481+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:46:35.474237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.483599+0000","last_change":"2023-10-09T08:14:39.479813+0000","last_active":"2023-10-09T08:14:39.483599+0000","last_peered":"2023-10-09T08:14:39.483599+0000","last_clean":"2023-10-09T08:14:39.483599+0000","last_became_active":"2023-10-09T08:14:39.479545+0000","last_became_peered":"2023-10-09T08:14:39.479545+0000","last_unstale":"2023-10-09T08:14:39.483599+0000","last_undegraded":"2023-10-09T08:14:39.483599+0000","last_fullsized":"2023-10-09T08:14:39.483599+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:53:08.718144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"193'2","reported_seq":12,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.488694+0000","last_change":"2023-10-09T08:14:38.461946+0000","last_active":"2023-10-09T08:14:39.488694+0000","last_peered":"2023-10-09T08:14:39.488694+0000","last_clean":"2023-10-09T08:14:39.488694+0000","last_became_active":"2023-10-09T08:14:38.461634+0000","last_became_peered":"2023-10-09T08:14:38.461634+0000","last_unstale":"2023-10-09T08:14:39.488694+0000","last_undegraded":"2023-10-09T08:14:39.488694+0000","last_fullsized":"2023-10-09T08:14:39.488694+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:26:37.033079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.480079+0000","last_change":"2023-10-09T08:14:39.470809+0000","last_active":"2023-10-09T08:14:39.480079+0000","last_peered":"2023-10-09T08:14:39.480079+0000","last_clean":"2023-10-09T08:14:39.480079+0000","last_became_active":"2023-10-09T08:14:39.470507+0000","last_became_peered":"2023-10-09T08:14:39.470507+0000","last_unstale":"2023-10-09T08:14:39.480079+0000","last_undegraded":"2023-10-09T08:14:39.480079+0000","last_fullsized":"2023-10-09T08:14:39.480079+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:07:04.309396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"193'2","reported_seq":12,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.489126+0000","last_change":"2023-10-09T08:14:38.458549+0000","last_active":"2023-10-09T08:14:39.489126+0000","last_peered":"2023-10-09T08:14:39.489126+0000","last_clean":"2023-10-09T08:14:39.489126+0000","last_became_active":"2023-10-09T08:14:38.458275+0000","last_became_peered":"2023-10-09T08:14:38.458275+0000","last_unstale":"2023-10-09T08:14:39.489126+0000","last_undegraded":"2023-10-09T08:14:39.489126+0000","last_fullsized":"2023-10-09T08:14:39.489126+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:48:06.747379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481665+0000","last_change":"2023-10-09T08:14:39.476822+0000","last_active":"2023-10-09T08:14:39.481665+0000","last_peered":"2023-10-09T08:14:39.481665+0000","last_clean":"2023-10-09T08:14:39.481665+0000","last_became_active":"2023-10-09T08:14:39.476504+0000","last_became_peered":"2023-10-09T08:14:39.476504+0000","last_unstale":"2023-10-09T08:14:39.481665+0000","last_undegraded":"2023-10-09T08:14:39.481665+0000","last_fullsized":"2023-10-09T08:14:39.481665+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:34:27.759607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"193'1","reported_seq":11,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.490524+0000","last_change":"2023-10-09T08:14:38.463851+0000","last_active":"2023-10-09T08:14:39.490524+0000","last_peered":"2023-10-09T08:14:39.490524+0000","last_clean":"2023-10-09T08:14:39.490524+0000","last_became_active":"2023-10-09T08:14:38.463506+0000","last_became_peered":"2023-10-09T08:14:38.463506+0000","last_unstale":"2023-10-09T08:14:39.490524+0000","last_undegraded":"2023-10-09T08:14:39.490524+0000","last_fullsized":"2023-10-09T08:14:39.490524+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:04.853104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478263+0000","last_change":"2023-10-09T08:14:39.473884+0000","last_active":"2023-10-09T08:14:39.478263+0000","last_peered":"2023-10-09T08:14:39.478263+0000","last_clean":"2023-10-09T08:14:39.478263+0000","last_became_active":"2023-10-09T08:14:39.473603+0000","last_became_peered":"2023-10-09T08:14:39.473603+0000","last_unstale":"2023-10-09T08:14:39.478263+0000","last_undegraded":"2023-10-09T08:14:39.478263+0000","last_fullsized":"2023-10-09T08:14:39.478263+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:52:12.286059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"193'1","reported_seq":11,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.488113+0000","last_change":"2023-10-09T08:14:38.454227+0000","last_active":"2023-10-09T08:14:39.488113+0000","last_peered":"2023-10-09T08:14:39.488113+0000","last_clean":"2023-10-09T08:14:39.488113+0000","last_became_active":"2023-10-09T08:14:38.453644+0000","last_became_peered":"2023-10-09T08:14:38.453644+0000","last_unstale":"2023-10-09T08:14:39.488113+0000","last_undegraded":"2023-10-09T08:14:39.488113+0000","last_fullsized":"2023-10-09T08:14:39.488113+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:54:34.005037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478228+0000","last_change":"2023-10-09T08:14:39.474425+0000","last_active":"2023-10-09T08:14:39.478228+0000","last_peered":"2023-10-09T08:14:39.478228+0000","last_clean":"2023-10-09T08:14:39.478228+0000","last_became_active":"2023-10-09T08:14:39.474160+0000","last_became_peered":"2023-10-09T08:14:39.474160+0000","last_unstale":"2023-10-09T08:14:39.478228+0000","last_undegraded":"2023-10-09T08:14:39.478228+0000","last_fullsized":"2023-10-09T08:14:39.478228+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:50:41.565341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.466418+0000","last_change":"2023-10-09T08:14:38.457086+0000","last_active":"2023-10-09T08:14:39.466418+0000","last_peered":"2023-10-09T08:14:39.466418+0000","last_clean":"2023-10-09T08:14:39.466418+0000","last_became_active":"2023-10-09T08:14:38.455775+0000","last_became_peered":"2023-10-09T08:14:38.455775+0000","last_unstale":"2023-10-09T08:14:39.466418+0000","last_undegraded":"2023-10-09T08:14:39.466418+0000","last_fullsized":"2023-10-09T08:14:39.466418+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:13:24.156288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478136+0000","last_change":"2023-10-09T08:14:39.477068+0000","last_active":"2023-10-09T08:14:39.478136+0000","last_peered":"2023-10-09T08:14:39.478136+0000","last_clean":"2023-10-09T08:14:39.478136+0000","last_became_active":"2023-10-09T08:14:39.476231+0000","last_became_peered":"2023-10-09T08:14:39.476231+0000","last_unstale":"2023-10-09T08:14:39.478136+0000","last_undegraded":"2023-10-09T08:14:39.478136+0000","last_fullsized":"2023-10-09T08:14:39.478136+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:09.352022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.465583+0000","last_change":"2023-10-09T08:14:38.447789+0000","last_active":"2023-10-09T08:14:39.465583+0000","last_peered":"2023-10-09T08:14:39.465583+0000","last_clean":"2023-10-09T08:14:39.465583+0000","last_became_active":"2023-10-09T08:14:38.447539+0000","last_became_peered":"2023-10-09T08:14:38.447539+0000","last_unstale":"2023-10-09T08:14:39.465583+0000","last_undegraded":"2023-10-09T08:14:39.465583+0000","last_fullsized":"2023-10-09T08:14:39.465583+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:32.622711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.475100+0000","last_change":"2023-10-09T08:14:39.469756+0000","last_active":"2023-10-09T08:14:39.475100+0000","last_peered":"2023-10-09T08:14:39.475100+0000","last_clean":"2023-10-09T08:14:39.475100+0000","last_became_active":"2023-10-09T08:14:39.469509+0000","last_became_peered":"2023-10-09T08:14:39.469509+0000","last_unstale":"2023-10-09T08:14:39.475100+0000","last_undegraded":"2023-10-09T08:14:39.475100+0000","last_fullsized":"2023-10-09T08:14:39.475100+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:37.888301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.462786+0000","last_change":"2023-10-09T08:14:38.464801+0000","last_active":"2023-10-09T08:14:39.462786+0000","last_peered":"2023-10-09T08:14:39.462786+0000","last_clean":"2023-10-09T08:14:39.462786+0000","last_became_active":"2023-10-09T08:14:38.464474+0000","last_became_peered":"2023-10-09T08:14:38.464474+0000","last_unstale":"2023-10-09T08:14:39.462786+0000","last_undegraded":"2023-10-09T08:14:39.462786+0000","last_fullsized":"2023-10-09T08:14:39.462786+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:30:52.549825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.475065+0000","last_change":"2023-10-09T08:14:39.470159+0000","last_active":"2023-10-09T08:14:39.475065+0000","last_peered":"2023-10-09T08:14:39.475065+0000","last_clean":"2023-10-09T08:14:39.475065+0000","last_became_active":"2023-10-09T08:14:39.469401+0000","last_became_peered":"2023-10-09T08:14:39.469401+0000","last_unstale":"2023-10-09T08:14:39.475065+0000","last_undegraded":"2023-10-09T08:14:39.475065+0000","last_fullsized":"2023-10-09T08:14:39.475065+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:57.535414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"193'3","reported_seq":13,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.493087+0000","last_change":"2023-10-09T08:14:38.454895+0000","last_active":"2023-10-09T08:14:39.493087+0000","last_peered":"2023-10-09T08:14:39.493087+0000","last_clean":"2023-10-09T08:14:39.493087+0000","last_became_active":"2023-10-09T08:14:38.451818+0000","last_became_peered":"2023-10-09T08:14:38.451818+0000","last_unstale":"2023-10-09T08:14:39.493087+0000","last_undegraded":"2023-10-09T08:14:39.493087+0000","last_fullsized":"2023-10-09T08:14:39.493087+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:48:52.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.468147+0000","last_change":"2023-10-09T08:14:39.463689+0000","last_active":"2023-10-09T08:14:39.468147+0000","last_peered":"2023-10-09T08:14:39.468147+0000","last_clean":"2023-10-09T08:14:39.468147+0000","last_became_active":"2023-10-09T08:14:39.463306+0000","last_became_peered":"2023-10-09T08:14:39.463306+0000","last_unstale":"2023-10-09T08:14:39.468147+0000","last_undegraded":"2023-10-09T08:14:39.468147+0000","last_fullsized":"2023-10-09T08:14:39.468147+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:48:07.753029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"193'6","reported_seq":16,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.495619+0000","last_change":"2023-10-09T08:14:38.454823+0000","last_active":"2023-10-09T08:14:39.495619+0000","last_peered":"2023-10-09T08:14:39.495619+0000","last_clean":"2023-10-09T08:14:39.495619+0000","last_became_active":"2023-10-09T08:14:38.454501+0000","last_became_peered":"2023-10-09T08:14:38.454501+0000","last_unstale":"2023-10-09T08:14:39.495619+0000","last_undegraded":"2023-10-09T08:14:39.495619+0000","last_fullsized":"2023-10-09T08:14:39.495619+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:29:29.450151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.479006+0000","last_change":"2023-10-09T08:14:39.473198+0000","last_active":"2023-10-09T08:14:39.479006+0000","last_peered":"2023-10-09T08:14:39.479006+0000","last_clean":"2023-10-09T08:14:39.479006+0000","last_became_active":"2023-10-09T08:14:39.472951+0000","last_became_peered":"2023-10-09T08:14:39.472951+0000","last_unstale":"2023-10-09T08:14:39.479006+0000","last_undegraded":"2023-10-09T08:14:39.479006+0000","last_fullsized":"2023-10-09T08:14:39.479006+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:00:37.618868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"193'2","reported_seq":12,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.488187+0000","last_change":"2023-10-09T08:14:38.449788+0000","last_active":"2023-10-09T08:14:39.488187+0000","last_peered":"2023-10-09T08:14:39.488187+0000","last_clean":"2023-10-09T08:14:39.488187+0000","last_became_active":"2023-10-09T08:14:38.449495+0000","last_became_peered":"2023-10-09T08:14:38.449495+0000","last_unstale":"2023-10-09T08:14:39.488187+0000","last_undegraded":"2023-10-09T08:14:39.488187+0000","last_fullsized":"2023-10-09T08:14:39.488187+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:39.412176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.474301+0000","last_change":"2023-10-09T08:14:39.472462+0000","last_active":"2023-10-09T08:14:39.474301+0000","last_peered":"2023-10-09T08:14:39.474301+0000","last_clean":"2023-10-09T08:14:39.474301+0000","last_became_active":"2023-10-09T08:14:39.472162+0000","last_became_peered":"2023-10-09T08:14:39.472162+0000","last_unstale":"2023-10-09T08:14:39.474301+0000","last_undegraded":"2023-10-09T08:14:39.474301+0000","last_fullsized":"2023-10-09T08:14:39.474301+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:56.539162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.460955+0000","last_change":"2023-10-09T08:14:38.454099+0000","last_active":"2023-10-09T08:14:39.460955+0000","last_peered":"2023-10-09T08:14:39.460955+0000","last_clean":"2023-10-09T08:14:39.460955+0000","last_became_active":"2023-10-09T08:14:38.453858+0000","last_became_peered":"2023-10-09T08:14:38.453858+0000","last_unstale":"2023-10-09T08:14:39.460955+0000","last_undegraded":"2023-10-09T08:14:39.460955+0000","last_fullsized":"2023-10-09T08:14:39.460955+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:56:35.959943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.476548+0000","last_change":"2023-10-09T08:14:39.470123+0000","last_active":"2023-10-09T08:14:39.476548+0000","last_peered":"2023-10-09T08:14:39.476548+0000","last_clean":"2023-10-09T08:14:39.476548+0000","last_became_active":"2023-10-09T08:14:39.469871+0000","last_became_peered":"2023-10-09T08:14:39.469871+0000","last_unstale":"2023-10-09T08:14:39.476548+0000","last_undegraded":"2023-10-09T08:14:39.476548+0000","last_fullsized":"2023-10-09T08:14:39.476548+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:43:57.610820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.461966+0000","last_change":"2023-10-09T08:14:38.460637+0000","last_active":"2023-10-09T08:14:39.461966+0000","last_peered":"2023-10-09T08:14:39.461966+0000","last_clean":"2023-10-09T08:14:39.461966+0000","last_became_active":"2023-10-09T08:14:38.460330+0000","last_became_peered":"2023-10-09T08:14:38.460330+0000","last_unstale":"2023-10-09T08:14:39.461966+0000","last_undegraded":"2023-10-09T08:14:39.461966+0000","last_fullsized":"2023-10-09T08:14:39.461966+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:44.429332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481614+0000","last_change":"2023-10-09T08:14:39.477683+0000","last_active":"2023-10-09T08:14:39.481614+0000","last_peered":"2023-10-09T08:14:39.481614+0000","last_clean":"2023-10-09T08:14:39.481614+0000","last_became_active":"2023-10-09T08:14:39.477263+0000","last_became_peered":"2023-10-09T08:14:39.477263+0000","last_unstale":"2023-10-09T08:14:39.481614+0000","last_undegraded":"2023-10-09T08:14:39.481614+0000","last_fullsized":"2023-10-09T08:14:39.481614+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:52:12.286059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"193'8","reported_seq":18,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.493731+0000","last_change":"2023-10-09T08:14:38.450181+0000","last_active":"2023-10-09T08:14:39.493731+0000","last_peered":"2023-10-09T08:14:39.493731+0000","last_clean":"2023-10-09T08:14:39.493731+0000","last_became_active":"2023-10-09T08:14:38.449917+0000","last_became_peered":"2023-10-09T08:14:38.449917+0000","last_unstale":"2023-10-09T08:14:39.493731+0000","last_undegraded":"2023-10-09T08:14:39.493731+0000","last_fullsized":"2023-10-09T08:14:39.493731+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:49.854902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478451+0000","last_change":"2023-10-09T08:14:39.472632+0000","last_active":"2023-10-09T08:14:39.478451+0000","last_peered":"2023-10-09T08:14:39.478451+0000","last_clean":"2023-10-09T08:14:39.478451+0000","last_became_active":"2023-10-09T08:14:39.472371+0000","last_became_peered":"2023-10-09T08:14:39.472371+0000","last_unstale":"2023-10-09T08:14:39.478451+0000","last_undegraded":"2023-10-09T08:14:39.478451+0000","last_fullsized":"2023-10-09T08:14:39.478451+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:30:45.182691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"193'1","reported_seq":11,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.488585+0000","last_change":"2023-10-09T08:14:38.464395+0000","last_active":"2023-10-09T08:14:39.488585+0000","last_peered":"2023-10-09T08:14:39.488585+0000","last_clean":"2023-10-09T08:14:39.488585+0000","last_became_active":"2023-10-09T08:14:38.463853+0000","last_became_peered":"2023-10-09T08:14:38.463853+0000","last_unstale":"2023-10-09T08:14:39.488585+0000","last_undegraded":"2023-10-09T08:14:39.488585+0000","last_fullsized":"2023-10-09T08:14:39.488585+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:53.027373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.475117+0000","last_change":"2023-10-09T08:14:39.470353+0000","last_active":"2023-10-09T08:14:39.475117+0000","last_peered":"2023-10-09T08:14:39.475117+0000","last_clean":"2023-10-09T08:14:39.475117+0000","last_became_active":"2023-10-09T08:14:39.470030+0000","last_became_peered":"2023-10-09T08:14:39.470030+0000","last_unstale":"2023-10-09T08:14:39.475117+0000","last_undegraded":"2023-10-09T08:14:39.475117+0000","last_fullsized":"2023-10-09T08:14:39.475117+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:11.741936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"193'2","reported_seq":12,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.487326+0000","last_change":"2023-10-09T08:14:38.463880+0000","last_active":"2023-10-09T08:14:39.487326+0000","last_peered":"2023-10-09T08:14:39.487326+0000","last_clean":"2023-10-09T08:14:39.487326+0000","last_became_active":"2023-10-09T08:14:38.463564+0000","last_became_peered":"2023-10-09T08:14:38.463564+0000","last_unstale":"2023-10-09T08:14:39.487326+0000","last_undegraded":"2023-10-09T08:14:39.487326+0000","last_fullsized":"2023-10-09T08:14:39.487326+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:49:23.713246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478319+0000","last_change":"2023-10-09T08:14:39.473804+0000","last_active":"2023-10-09T08:14:39.478319+0000","last_peered":"2023-10-09T08:14:39.478319+0000","last_clean":"2023-10-09T08:14:39.478319+0000","last_became_active":"2023-10-09T08:14:39.473537+0000","last_became_peered":"2023-10-09T08:14:39.473537+0000","last_unstale":"2023-10-09T08:14:39.478319+0000","last_undegraded":"2023-10-09T08:14:39.478319+0000","last_fullsized":"2023-10-09T08:14:39.478319+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:12:23.337933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"193'1","reported_seq":11,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.494014+0000","last_change":"2023-10-09T08:14:38.454927+0000","last_active":"2023-10-09T08:14:39.494014+0000","last_peered":"2023-10-09T08:14:39.494014+0000","last_clean":"2023-10-09T08:14:39.494014+0000","last_became_active":"2023-10-09T08:14:38.454658+0000","last_became_peered":"2023-10-09T08:14:38.454658+0000","last_unstale":"2023-10-09T08:14:39.494014+0000","last_undegraded":"2023-10-09T08:14:39.494014+0000","last_fullsized":"2023-10-09T08:14:39.494014+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:33:36.559884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.482797+0000","last_change":"2023-10-09T08:14:39.481020+0000","last_active":"2023-10-09T08:14:39.482797+0000","last_peered":"2023-10-09T08:14:39.482797+0000","last_clean":"2023-10-09T08:14:39.482797+0000","last_became_active":"2023-10-09T08:14:39.480773+0000","last_became_peered":"2023-10-09T08:14:39.480773+0000","last_unstale":"2023-10-09T08:14:39.482797+0000","last_undegraded":"2023-10-09T08:14:39.482797+0000","last_fullsized":"2023-10-09T08:14:39.482797+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:52.883026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.465016+0000","last_change":"2023-10-09T08:14:38.449804+0000","last_active":"2023-10-09T08:14:39.465016+0000","last_peered":"2023-10-09T08:14:39.465016+0000","last_clean":"2023-10-09T08:14:39.465016+0000","last_became_active":"2023-10-09T08:14:38.449525+0000","last_became_peered":"2023-10-09T08:14:38.449525+0000","last_unstale":"2023-10-09T08:14:39.465016+0000","last_undegraded":"2023-10-09T08:14:39.465016+0000","last_fullsized":"2023-10-09T08:14:39.465016+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:42:28.181427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.473936+0000","last_change":"2023-10-09T08:14:39.468531+0000","last_active":"2023-10-09T08:14:39.473936+0000","last_peered":"2023-10-09T08:14:39.473936+0000","last_clean":"2023-10-09T08:14:39.473936+0000","last_became_active":"2023-10-09T08:14:39.468083+0000","last_became_peered":"2023-10-09T08:14:39.468083+0000","last_unstale":"2023-10-09T08:14:39.473936+0000","last_undegraded":"2023-10-09T08:14:39.473936+0000","last_fullsized":"2023-10-09T08:14:39.473936+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:47:44.078610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"193'2","reported_seq":12,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.489089+0000","last_change":"2023-10-09T08:14:38.457238+0000","last_active":"2023-10-09T08:14:39.489089+0000","last_peered":"2023-10-09T08:14:39.489089+0000","last_clean":"2023-10-09T08:14:39.489089+0000","last_became_active":"2023-10-09T08:14:38.456976+0000","last_became_peered":"2023-10-09T08:14:38.456976+0000","last_unstale":"2023-10-09T08:14:39.489089+0000","last_undegraded":"2023-10-09T08:14:39.489089+0000","last_fullsized":"2023-10-09T08:14:39.489089+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:01.561989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.482848+0000","last_change":"2023-10-09T08:14:39.477525+0000","last_active":"2023-10-09T08:14:39.482848+0000","last_peered":"2023-10-09T08:14:39.482848+0000","last_clean":"2023-10-09T08:14:39.482848+0000","last_became_active":"2023-10-09T08:14:39.477264+0000","last_became_peered":"2023-10-09T08:14:39.477264+0000","last_unstale":"2023-10-09T08:14:39.482848+0000","last_undegraded":"2023-10-09T08:14:39.482848+0000","last_fullsized":"2023-10-09T08:14:39.482848+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:11.301814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.464301+0000","last_change":"2023-10-09T08:14:38.454293+0000","last_active":"2023-10-09T08:14:39.464301+0000","last_peered":"2023-10-09T08:14:39.464301+0000","last_clean":"2023-10-09T08:14:39.464301+0000","last_became_active":"2023-10-09T08:14:38.453970+0000","last_became_peered":"2023-10-09T08:14:38.453970+0000","last_unstale":"2023-10-09T08:14:39.464301+0000","last_undegraded":"2023-10-09T08:14:39.464301+0000","last_fullsized":"2023-10-09T08:14:39.464301+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:10.748478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481977+0000","last_change":"2023-10-09T08:14:39.480148+0000","last_active":"2023-10-09T08:14:39.481977+0000","last_peered":"2023-10-09T08:14:39.481977+0000","last_clean":"2023-10-09T08:14:39.481977+0000","last_became_active":"2023-10-09T08:14:39.479903+0000","last_became_peered":"2023-10-09T08:14:39.479903+0000","last_unstale":"2023-10-09T08:14:39.481977+0000","last_undegraded":"2023-10-09T08:14:39.481977+0000","last_fullsized":"2023-10-09T08:14:39.481977+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:41:47.263574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.466709+0000","last_change":"2023-10-09T08:14:38.465408+0000","last_active":"2023-10-09T08:14:39.466709+0000","last_peered":"2023-10-09T08:14:39.466709+0000","last_clean":"2023-10-09T08:14:39.466709+0000","last_became_active":"2023-10-09T08:14:38.465095+0000","last_became_peered":"2023-10-09T08:14:38.465095+0000","last_unstale":"2023-10-09T08:14:39.466709+0000","last_undegraded":"2023-10-09T08:14:39.466709+0000","last_fullsized":"2023-10-09T08:14:39.466709+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:53.027373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.483634+0000","last_change":"2023-10-09T08:14:39.480318+0000","last_active":"2023-10-09T08:14:39.483634+0000","last_peered":"2023-10-09T08:14:39.483634+0000","last_clean":"2023-10-09T08:14:39.483634+0000","last_became_active":"2023-10-09T08:14:39.479561+0000","last_became_peered":"2023-10-09T08:14:39.479561+0000","last_unstale":"2023-10-09T08:14:39.483634+0000","last_undegraded":"2023-10-09T08:14:39.483634+0000","last_fullsized":"2023-10-09T08:14:39.483634+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:33.890868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.466046+0000","last_change":"2023-10-09T08:14:38.456540+0000","last_active":"2023-10-09T08:14:39.466046+0000","last_peered":"2023-10-09T08:14:39.466046+0000","last_clean":"2023-10-09T08:14:39.466046+0000","last_became_active":"2023-10-09T08:14:38.456221+0000","last_became_peered":"2023-10-09T08:14:38.456221+0000","last_unstale":"2023-10-09T08:14:39.466046+0000","last_undegraded":"2023-10-09T08:14:39.466046+0000","last_fullsized":"2023-10-09T08:14:39.466046+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:26.714576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478577+0000","last_change":"2023-10-09T08:14:39.471342+0000","last_active":"2023-10-09T08:14:39.478577+0000","last_peered":"2023-10-09T08:14:39.478577+0000","last_clean":"2023-10-09T08:14:39.478577+0000","last_became_active":"2023-10-09T08:14:39.471053+0000","last_became_peered":"2023-10-09T08:14:39.471053+0000","last_unstale":"2023-10-09T08:14:39.478577+0000","last_undegraded":"2023-10-09T08:14:39.478577+0000","last_fullsized":"2023-10-09T08:14:39.478577+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:45.577995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"193'2","reported_seq":12,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.491340+0000","last_change":"2023-10-09T08:14:38.460625+0000","last_active":"2023-10-09T08:14:39.491340+0000","last_peered":"2023-10-09T08:14:39.491340+0000","last_clean":"2023-10-09T08:14:39.491340+0000","last_became_active":"2023-10-09T08:14:38.460321+0000","last_became_peered":"2023-10-09T08:14:38.460321+0000","last_unstale":"2023-10-09T08:14:39.491340+0000","last_undegraded":"2023-10-09T08:14:39.491340+0000","last_fullsized":"2023-10-09T08:14:39.491340+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:16:28.154856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481580+0000","last_change":"2023-10-09T08:14:39.478657+0000","last_active":"2023-10-09T08:14:39.481580+0000","last_peered":"2023-10-09T08:14:39.481580+0000","last_clean":"2023-10-09T08:14:39.481580+0000","last_became_active":"2023-10-09T08:14:39.478402+0000","last_became_peered":"2023-10-09T08:14:39.478402+0000","last_unstale":"2023-10-09T08:14:39.481580+0000","last_undegraded":"2023-10-09T08:14:39.481580+0000","last_fullsized":"2023-10-09T08:14:39.481580+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:34.938944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.458027+0000","last_change":"2023-10-09T08:14:38.461920+0000","last_active":"2023-10-09T08:14:39.458027+0000","last_peered":"2023-10-09T08:14:39.458027+0000","last_clean":"2023-10-09T08:14:39.458027+0000","last_became_active":"2023-10-09T08:14:38.461619+0000","last_became_peered":"2023-10-09T08:14:38.461619+0000","last_unstale":"2023-10-09T08:14:39.458027+0000","last_undegraded":"2023-10-09T08:14:39.458027+0000","last_fullsized":"2023-10-09T08:14:39.458027+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:40.728510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.485101+0000","last_change":"2023-10-09T08:14:39.483531+0000","last_active":"2023-10-09T08:14:39.485101+0000","last_peered":"2023-10-09T08:14:39.485101+0000","last_clean":"2023-10-09T08:14:39.485101+0000","last_became_active":"2023-10-09T08:14:39.483236+0000","last_became_peered":"2023-10-09T08:14:39.483236+0000","last_unstale":"2023-10-09T08:14:39.485101+0000","last_undegraded":"2023-10-09T08:14:39.485101+0000","last_fullsized":"2023-10-09T08:14:39.485101+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:54:22.665528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.466862+0000","last_change":"2023-10-09T08:14:38.461191+0000","last_active":"2023-10-09T08:14:39.466862+0000","last_peered":"2023-10-09T08:14:39.466862+0000","last_clean":"2023-10-09T08:14:39.466862+0000","last_became_active":"2023-10-09T08:14:38.460271+0000","last_became_peered":"2023-10-09T08:14:38.460271+0000","last_unstale":"2023-10-09T08:14:39.466862+0000","last_undegraded":"2023-10-09T08:14:39.466862+0000","last_fullsized":"2023-10-09T08:14:39.466862+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:33:52.074768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.472812+0000","last_change":"2023-10-09T08:14:39.468512+0000","last_active":"2023-10-09T08:14:39.472812+0000","last_peered":"2023-10-09T08:14:39.472812+0000","last_clean":"2023-10-09T08:14:39.472812+0000","last_became_active":"2023-10-09T08:14:39.468158+0000","last_became_peered":"2023-10-09T08:14:39.468158+0000","last_unstale":"2023-10-09T08:14:39.472812+0000","last_undegraded":"2023-10-09T08:14:39.472812+0000","last_fullsized":"2023-10-09T08:14:39.472812+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:04.566842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.458202+0000","last_change":"2023-10-09T08:14:38.464753+0000","last_active":"2023-10-09T08:14:39.458202+0000","last_peered":"2023-10-09T08:14:39.458202+0000","last_clean":"2023-10-09T08:14:39.458202+0000","last_became_active":"2023-10-09T08:14:38.464494+0000","last_became_peered":"2023-10-09T08:14:38.464494+0000","last_unstale":"2023-10-09T08:14:39.458202+0000","last_undegraded":"2023-10-09T08:14:39.458202+0000","last_fullsized":"2023-10-09T08:14:39.458202+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:03.238219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.484321+0000","last_change":"2023-10-09T08:14:39.482147+0000","last_active":"2023-10-09T08:14:39.484321+0000","last_peered":"2023-10-09T08:14:39.484321+0000","last_clean":"2023-10-09T08:14:39.484321+0000","last_became_active":"2023-10-09T08:14:39.481901+0000","last_became_peered":"2023-10-09T08:14:39.481901+0000","last_unstale":"2023-10-09T08:14:39.484321+0000","last_undegraded":"2023-10-09T08:14:39.484321+0000","last_fullsized":"2023-10-09T08:14:39.484321+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:30.483504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.457626+0000","last_change":"2023-10-09T08:14:38.454239+0000","last_active":"2023-10-09T08:14:39.457626+0000","last_peered":"2023-10-09T08:14:39.457626+0000","last_clean":"2023-10-09T08:14:39.457626+0000","last_became_active":"2023-10-09T08:14:38.453919+0000","last_became_peered":"2023-10-09T08:14:38.453919+0000","last_unstale":"2023-10-09T08:14:39.457626+0000","last_undegraded":"2023-10-09T08:14:39.457626+0000","last_fullsized":"2023-10-09T08:14:39.457626+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:41.345492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.485320+0000","last_change":"2023-10-09T08:14:39.477790+0000","last_active":"2023-10-09T08:14:39.485320+0000","last_peered":"2023-10-09T08:14:39.485320+0000","last_clean":"2023-10-09T08:14:39.485320+0000","last_became_active":"2023-10-09T08:14:39.477478+0000","last_became_peered":"2023-10-09T08:14:39.477478+0000","last_unstale":"2023-10-09T08:14:39.485320+0000","last_undegraded":"2023-10-09T08:14:39.485320+0000","last_fullsized":"2023-10-09T08:14:39.485320+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:40.417826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.466161+0000","last_change":"2023-10-09T08:14:38.454390+0000","last_active":"2023-10-09T08:14:39.466161+0000","last_peered":"2023-10-09T08:14:39.466161+0000","last_clean":"2023-10-09T08:14:39.466161+0000","last_became_active":"2023-10-09T08:14:38.453969+0000","last_became_peered":"2023-10-09T08:14:38.453969+0000","last_unstale":"2023-10-09T08:14:39.466161+0000","last_undegraded":"2023-10-09T08:14:39.466161+0000","last_fullsized":"2023-10-09T08:14:39.466161+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:45.680499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481621+0000","last_change":"2023-10-09T08:14:39.477716+0000","last_active":"2023-10-09T08:14:39.481621+0000","last_peered":"2023-10-09T08:14:39.481621+0000","last_clean":"2023-10-09T08:14:39.481621+0000","last_became_active":"2023-10-09T08:14:39.477119+0000","last_became_peered":"2023-10-09T08:14:39.477119+0000","last_unstale":"2023-10-09T08:14:39.481621+0000","last_undegraded":"2023-10-09T08:14:39.481621+0000","last_fullsized":"2023-10-09T08:14:39.481621+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:47.340414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.466524+0000","last_change":"2023-10-09T08:14:38.459421+0000","last_active":"2023-10-09T08:14:39.466524+0000","last_peered":"2023-10-09T08:14:39.466524+0000","last_clean":"2023-10-09T08:14:39.466524+0000","last_became_active":"2023-10-09T08:14:38.457579+0000","last_became_peered":"2023-10-09T08:14:38.457579+0000","last_unstale":"2023-10-09T08:14:39.466524+0000","last_undegraded":"2023-10-09T08:14:39.466524+0000","last_fullsized":"2023-10-09T08:14:39.466524+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:01.351188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481595+0000","last_change":"2023-10-09T08:14:39.477514+0000","last_active":"2023-10-09T08:14:39.481595+0000","last_peered":"2023-10-09T08:14:39.481595+0000","last_clean":"2023-10-09T08:14:39.481595+0000","last_became_active":"2023-10-09T08:14:39.476723+0000","last_became_peered":"2023-10-09T08:14:39.476723+0000","last_unstale":"2023-10-09T08:14:39.481595+0000","last_undegraded":"2023-10-09T08:14:39.481595+0000","last_fullsized":"2023-10-09T08:14:39.481595+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:43:57.610820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.457984+0000","last_change":"2023-10-09T08:14:38.451833+0000","last_active":"2023-10-09T08:14:39.457984+0000","last_peered":"2023-10-09T08:14:39.457984+0000","last_clean":"2023-10-09T08:14:39.457984+0000","last_became_active":"2023-10-09T08:14:38.451494+0000","last_became_peered":"2023-10-09T08:14:38.451494+0000","last_unstale":"2023-10-09T08:14:39.457984+0000","last_undegraded":"2023-10-09T08:14:39.457984+0000","last_fullsized":"2023-10-09T08:14:39.457984+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:41.044164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478617+0000","last_change":"2023-10-09T08:14:39.472193+0000","last_active":"2023-10-09T08:14:39.478617+0000","last_peered":"2023-10-09T08:14:39.478617+0000","last_clean":"2023-10-09T08:14:39.478617+0000","last_became_active":"2023-10-09T08:14:39.471886+0000","last_became_peered":"2023-10-09T08:14:39.471886+0000","last_unstale":"2023-10-09T08:14:39.478617+0000","last_undegraded":"2023-10-09T08:14:39.478617+0000","last_fullsized":"2023-10-09T08:14:39.478617+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:02:07.699719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.458291+0000","last_change":"2023-10-09T08:14:38.452713+0000","last_active":"2023-10-09T08:14:39.458291+0000","last_peered":"2023-10-09T08:14:39.458291+0000","last_clean":"2023-10-09T08:14:39.458291+0000","last_became_active":"2023-10-09T08:14:38.452366+0000","last_became_peered":"2023-10-09T08:14:38.452366+0000","last_unstale":"2023-10-09T08:14:39.458291+0000","last_undegraded":"2023-10-09T08:14:39.458291+0000","last_fullsized":"2023-10-09T08:14:39.458291+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:03.250581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"183'326","reported_seq":1052,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.466136+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T08:14:39.466136+0000","last_peered":"2023-10-09T08:14:39.466136+0000","last_clean":"2023-10-09T08:14:39.466136+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T08:14:39.466136+0000","last_undegraded":"2023-10-09T08:14:39.466136+0000","last_fullsized":"2023-10-09T08:14:39.466136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575944,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312548,"kb_used_data":2972,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059292,"statfs":{"total":96636764160,"available":96316715008,"internally_reserved":0,"allocated":3043328,"data_stored":1813297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.748,"15min":0.755},"min":{"1min":0.49199999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97699999999999998,"5min":1.002,"15min":1.1220000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.755,"15min":0.751},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.44500000000000001},"max":{"1min":1.0069999999999999,"5min":1.0129999999999999,"15min":1.0209999999999999},"last":0.91900000000000004}]},{"osd":1,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.746,"15min":0.746},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":1.024},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.747,"15min":0.751},"min":{"1min":0.503,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.01}]},{"osd":2,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.752,"15min":0.753},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.77300000000000002,"15min":0.77400000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.442},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.86499999999999999}]},{"osd":3,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.755,"15min":0.74199999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.47999999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.78200000000000003,"15min":0.78000000000000003},"min":{"1min":0.61499999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.97999999999999998}]},{"osd":4,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.624,"15min":0.60899999999999999},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.38300000000000001},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.45500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.89400000000000002}]},{"osd":5,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.53400000000000003,"5min":0.41699999999999998,"15min":0.40100000000000002},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.75600000000000001,"15min":0.746},"min":{"1min":0.60499999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.72399999999999998,"15min":0.71399999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.70399999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575943,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316044,"kb_used_data":2372,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055796,"statfs":{"total":96636764160,"available":96313135104,"internally_reserved":0,"allocated":2428928,"data_stored":1220701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.749,"15min":0.753},"min":{"1min":0.46899999999999997,"5min":0.45900000000000002,"15min":0.40300000000000002},"max":{"1min":0.97799999999999998,"5min":0.99299999999999999,"15min":1.0449999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.44400000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94099999999999995,"5min":0.94499999999999995,"15min":0.97399999999999998},"last":0.623}]},{"osd":1,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.753,"15min":0.755},"min":{"1min":0.54700000000000004,"5min":0.499,"15min":0.38500000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77000000000000002,"15min":0.76300000000000001},"min":{"1min":0.59499999999999997,"5min":0.52800000000000002,"15min":0.47999999999999998},"max":{"1min":1.018,"5min":1.0269999999999999,"15min":1.097},"last":0.58399999999999996}]},{"osd":2,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.46400000000000002},"max":{"1min":1.004,"5min":1.0109999999999999,"15min":1.0329999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77200000000000002,"15min":0.77800000000000002},"min":{"1min":0.52300000000000002,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0660000000000001},"last":0.73999999999999999}]},{"osd":3,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.54300000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.004,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.61599999999999999,"5min":0.51100000000000001,"15min":0.49299999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0680000000000001},"last":0.60399999999999998}]},{"osd":4,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.40600000000000003,"15min":0.40200000000000002},"max":{"1min":0.92000000000000004,"5min":1.032,"15min":1.1339999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.44800000000000001,"5min":0.39700000000000002,"15min":0.32000000000000001},"max":{"1min":0.82699999999999996,"5min":0.91900000000000004,"15min":0.97099999999999997},"last":0.65500000000000003}]},{"osd":5,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.40100000000000002},"max":{"1min":0.90900000000000003,"5min":0.93400000000000005,"15min":0.98899999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.45200000000000001},"max":{"1min":0.97599999999999998,"5min":1.0880000000000001,"15min":1.121},"last":0.66900000000000004}]},{"osd":7,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70199999999999996,"15min":0.69699999999999995},"min":{"1min":0.49399999999999999,"5min":0.45600000000000002,"15min":0.36299999999999999},"max":{"1min":0.93200000000000005,"5min":0.98699999999999999,"15min":1.0309999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.75800000000000001,"15min":0.74299999999999999},"min":{"1min":0.54400000000000004,"5min":0.48699999999999999,"15min":0.442},"max":{"1min":0.95599999999999996,"5min":0.96799999999999997,"15min":1.139},"last":0.72499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575944,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307852,"kb_used_data":2372,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063988,"statfs":{"total":96636764160,"available":96321523712,"internally_reserved":0,"allocated":2428928,"data_stored":1220713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45300000000000001,"15min":0.46000000000000002},"min":{"1min":0.34200000000000003,"5min":0.29799999999999999,"15min":0.28799999999999998},"max":{"1min":0.621,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.5},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52400000000000002,"15min":0.51500000000000001},"min":{"1min":0.39500000000000002,"5min":0.34899999999999998,"15min":0.32400000000000001},"max":{"1min":0.66300000000000003,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.379}]},{"osd":2,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.51200000000000001},"min":{"1min":0.379,"5min":0.34200000000000003,"15min":0.318},"max":{"1min":0.624,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.58999999999999997},"min":{"1min":0.44900000000000001,"5min":0.433,"15min":0.39500000000000002},"max":{"1min":0.69899999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.56399999999999995}]},{"osd":3,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.505,"5min":0.42699999999999999,"15min":0.41099999999999998},"max":{"1min":0.76800000000000002,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.51200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76100000000000001,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.53700000000000003}]},{"osd":4,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.76000000000000001,"15min":0.78500000000000003},"min":{"1min":0.64400000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.125,"5min":1.125,"15min":1.224},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.81200000000000006,"15min":0.80300000000000005},"min":{"1min":0.61199999999999999,"5min":0.55800000000000005,"15min":0.51800000000000002},"max":{"1min":1.071,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.028}]},{"osd":5,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.65000000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0940000000000001,"5min":1.77,"15min":1.77},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.876,"5min":0.79300000000000004,"15min":0.81200000000000006},"min":{"1min":0.65600000000000003,"5min":0.56100000000000005,"15min":0.49299999999999999},"max":{"1min":1.054,"5min":1.0569999999999999,"15min":1.288},"last":1.0089999999999999}]},{"osd":6,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.83399999999999996,"15min":0.82399999999999995},"min":{"1min":0.69499999999999995,"5min":0.57199999999999995,"15min":0.505},"max":{"1min":1.143,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.85699999999999998,"15min":0.84099999999999997},"min":{"1min":0.59999999999999998,"5min":0.57499999999999996,"15min":0.53800000000000003},"max":{"1min":1.105,"5min":1.843,"15min":1.843},"last":0.80600000000000005}]},{"osd":7,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.876,"15min":0.86499999999999999},"min":{"1min":0.748,"5min":0.64000000000000001,"15min":0.58599999999999997},"max":{"1min":1.135,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.874},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.85399999999999998,"15min":0.85299999999999998},"min":{"1min":0.65700000000000003,"5min":0.61799999999999999,"15min":0.54300000000000004},"max":{"1min":1.1659999999999999,"5min":1.21,"15min":1.347},"last":0.96799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575943,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308428,"kb_used_data":2948,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063412,"statfs":{"total":96636764160,"available":96320933888,"internally_reserved":0,"allocated":3018752,"data_stored":1811047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48999999999999999,"15min":0.48499999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.29199999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.34899999999999998,"5min":0.34599999999999997,"15min":0.318},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.92300000000000004},"last":0.33500000000000002}]},{"osd":2,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57699999999999996,"15min":0.58399999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.36499999999999999,"5min":0.35999999999999999,"15min":0.34499999999999997},"max":{"1min":0.70499999999999996,"5min":0.77300000000000002,"15min":0.81999999999999995},"last":0.39700000000000002}]},{"osd":3,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.35099999999999998},"max":{"1min":0.78200000000000003,"5min":0.79400000000000004,"15min":0.80500000000000005},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60999999999999999,"15min":0.621},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.93200000000000005},"last":0.51800000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81200000000000006,"15min":0.78800000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.42899999999999999},"max":{"1min":0.98299999999999998,"5min":1.226,"15min":1.232},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57699999999999996,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0649999999999999,"5min":1.196,"15min":1.23},"last":0.61399999999999999}]},{"osd":5,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.82199999999999995,"15min":0.81499999999999995},"min":{"1min":0.60599999999999998,"5min":0.57299999999999995,"15min":0.501},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.262},"last":0.621},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.83099999999999996,"15min":0.82299999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.52100000000000002},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.79600000000000004}]},{"osd":6,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.86099999999999999,"15min":0.85199999999999998},"min":{"1min":0.64600000000000002,"5min":0.59599999999999997,"15min":0.58899999999999997},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.747},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83299999999999996,"15min":0.83099999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0920000000000001,"5min":1.24,"15min":1.3029999999999999},"last":0.58999999999999997}]},{"osd":7,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.86099999999999999,"15min":0.86499999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2370000000000001,"5min":1.2929999999999999,"15min":1.3540000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.88700000000000001,"15min":0.88200000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.58199999999999996},"max":{"1min":1.085,"5min":1.1519999999999999,"15min":1.3380000000000001},"last":0.66200000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575943,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316044,"kb_used_data":2372,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055796,"statfs":{"total":96636764160,"available":96313135104,"internally_reserved":0,"allocated":2428928,"data_stored":1220769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.47199999999999998,"15min":0.46500000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64500000000000002,"5min":0.71099999999999997,"15min":0.752},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.501,"15min":0.504},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64800000000000002,"5min":0.73299999999999998,"15min":0.82899999999999996},"last":0.48099999999999998}]},{"osd":1,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.499,"15min":0.495},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.33700000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55100000000000005,"15min":0.54200000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34699999999999998},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.40699999999999997}]},{"osd":3,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39200000000000002},"max":{"1min":0.89000000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.442},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64000000000000001,"15min":0.63900000000000001},"min":{"1min":0.47899999999999998,"5min":0.43099999999999999,"15min":0.38100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.94199999999999995},"last":0.46899999999999997}]},{"osd":4,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.80800000000000005,"15min":0.80900000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":0.96699999999999997,"5min":1.089,"15min":1.089},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.80200000000000005,"15min":0.79600000000000004},"min":{"1min":0.61699999999999999,"5min":0.54200000000000004,"15min":0.48399999999999999},"max":{"1min":1.107,"5min":1.133,"15min":1.1399999999999999},"last":1.0700000000000001}]},{"osd":5,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82499999999999996,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.51800000000000002},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":1.022},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.82799999999999996,"15min":0.82599999999999996},"min":{"1min":0.60199999999999998,"5min":0.54700000000000004,"15min":0.47799999999999998},"max":{"1min":1.052,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.98699999999999999}]},{"osd":6,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.84099999999999997,"15min":0.82799999999999996},"min":{"1min":0.57999999999999996,"5min":0.56299999999999994,"15min":0.52700000000000002},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.163},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.83899999999999997,"15min":0.83299999999999996},"min":{"1min":0.59399999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1020000000000001,"5min":1.109,"15min":1.224},"last":1.103}]},{"osd":7,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86599999999999999,"15min":0.85899999999999999},"min":{"1min":0.66700000000000004,"5min":0.60199999999999998,"15min":0.47899999999999998},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.198},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":1.157}]}]},{"osd":3,"up_from":13,"seq":55834575944,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2372,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2428928,"data_stored":1220713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47599999999999998,"15min":0.48999999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.30599999999999999},"max":{"1min":0.65800000000000003,"5min":0.68799999999999994,"15min":0.85999999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.5,"15min":0.51000000000000001},"min":{"1min":0.33900000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.79600000000000004},"last":0.53800000000000003}]},{"osd":1,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52100000000000002,"15min":0.51300000000000001},"min":{"1min":0.38300000000000001,"5min":0.34599999999999997,"15min":0.34300000000000003},"max":{"1min":0.70999999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.374},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59299999999999997,"15min":0.58099999999999996},"min":{"1min":0.439,"5min":0.43099999999999999,"15min":0.378},"max":{"1min":0.84999999999999998,"5min":0.85999999999999999,"15min":0.91300000000000003},"last":0.47399999999999998}]},{"osd":2,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.49199999999999999,"5min":0.41599999999999998,"15min":0.40400000000000003},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.97299999999999998},"last":0.443},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66100000000000003,"15min":0.66400000000000003},"min":{"1min":0.54000000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82299999999999995,"5min":0.879,"15min":1.036},"last":0.51500000000000001}]},{"osd":4,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78300000000000003,"15min":0.78100000000000003},"min":{"1min":0.56599999999999995,"5min":0.54100000000000004,"15min":0.46000000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.872,"5min":0.86599999999999999,"15min":0.871},"min":{"1min":0.69999999999999996,"5min":0.69899999999999995,"15min":0.66000000000000003},"max":{"1min":1.0629999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.60499999999999998}]},{"osd":5,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76900000000000002,"15min":0.77500000000000002},"min":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.47399999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.24},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.84199999999999997,"15min":0.83999999999999997},"min":{"1min":0.69099999999999995,"5min":0.66100000000000003,"15min":0.56899999999999995},"max":{"1min":0.996,"5min":1.1719999999999999,"15min":1.1739999999999999},"last":0.57599999999999996}]},{"osd":6,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79500000000000004,"15min":0.80600000000000005},"min":{"1min":0.623,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.099,"5min":1.099,"15min":1.206},"last":0.87},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.81200000000000006,"15min":0.81899999999999995},"min":{"1min":0.66900000000000004,"5min":0.56100000000000005,"15min":0.54800000000000004},"max":{"1min":1.0629999999999999,"5min":1.1339999999999999,"15min":1.1870000000000001},"last":0.73799999999999999}]},{"osd":7,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.85699999999999998,"15min":0.85999999999999999},"min":{"1min":0.70199999999999996,"5min":0.623,"15min":0.53700000000000003},"max":{"1min":1.0800000000000001,"5min":1.1839999999999999,"15min":1.3280000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.85399999999999998,"15min":0.85999999999999999},"min":{"1min":0.64400000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.147,"5min":1.1639999999999999,"15min":1.2869999999999999},"last":0.83399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575943,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299672,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072168,"statfs":{"total":96636764160,"available":96329900032,"internally_reserved":0,"allocated":2441216,"data_stored":1222285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73099999999999998,"15min":0.72999999999999998},"min":{"1min":0.60399999999999998,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":0.94799999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.745,"15min":0.74399999999999999},"min":{"1min":0.51300000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.755}]},{"osd":1,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.73299999999999998,"15min":0.72699999999999998},"min":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.51000000000000001},"max":{"1min":0.83499999999999996,"5min":1.03,"15min":1.03},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.53100000000000003,"5min":0.442,"15min":0.42799999999999999},"max":{"1min":0.97299999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.95799999999999996}]},{"osd":2,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81200000000000006,"15min":0.79900000000000004},"min":{"1min":0.65300000000000002,"5min":0.51400000000000001,"15min":0.45000000000000001},"max":{"1min":0.99399999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.81399999999999995,"15min":0.81000000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.47999999999999998},"max":{"1min":0.95699999999999996,"5min":1.077,"15min":1.077},"last":0.58299999999999996}]},{"osd":3,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.754,"15min":0.748},"min":{"1min":0.57799999999999996,"5min":0.51500000000000001,"15min":0.45900000000000002},"max":{"1min":0.92000000000000004,"5min":1.016,"15min":1.018},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.76900000000000002,"15min":0.77200000000000002},"min":{"1min":0.57199999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.89700000000000002,"5min":1.036,"15min":1.036},"last":0.64700000000000002}]},{"osd":5,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.38800000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.83599999999999997,"5min":0.94899999999999995,"15min":1.006},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63100000000000001,"15min":0.63200000000000001},"min":{"1min":0.46899999999999997,"5min":0.42099999999999999,"15min":0.40100000000000002},"max":{"1min":0.94199999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.61299999999999999}]},{"osd":6,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64300000000000002,"15min":0.63400000000000001},"min":{"1min":0.47399999999999998,"5min":0.42399999999999999,"15min":0.42299999999999999},"max":{"1min":1.012,"5min":1.022,"15min":1.034},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67400000000000004,"15min":0.68200000000000005},"min":{"1min":0.48899999999999999,"5min":0.437,"15min":0.42999999999999999},"max":{"1min":0.96499999999999997,"5min":0.998,"15min":1.0609999999999999},"last":0.98399999999999999}]},{"osd":7,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.53400000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.0580000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.77700000000000002},"min":{"1min":0.61799999999999999,"5min":0.48499999999999999,"15min":0.443},"max":{"1min":1.056,"5min":1.0629999999999999,"15min":1.079},"last":0.877}]}]},{"osd":5,"up_from":13,"seq":55834575944,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316048,"kb_used_data":2376,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055792,"statfs":{"total":96636764160,"available":96313131008,"internally_reserved":0,"allocated":2433024,"data_stored":1221255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96999999999999997,"5min":0.998,"15min":1.0780000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71699999999999997,"15min":0.71799999999999997},"min":{"1min":0.51500000000000001,"5min":0.42999999999999999,"15min":0.40899999999999997},"max":{"1min":0.91100000000000003,"5min":0.97399999999999998,"15min":1.018},"last":0.69999999999999996}]},{"osd":1,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72299999999999998,"15min":0.72399999999999998},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90100000000000002,"5min":1.0129999999999999,"15min":1.1140000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.435},"max":{"1min":0.89800000000000002,"5min":1.0029999999999999,"15min":1.0169999999999999},"last":0.82599999999999996}]},{"osd":2,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.754,"15min":0.751},"min":{"1min":0.58799999999999997,"5min":0.499,"15min":0.48699999999999999},"max":{"1min":0.92200000000000004,"5min":1.115,"15min":1.115},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.48299999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99299999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.80900000000000005}]},{"osd":3,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.748},"min":{"1min":0.50900000000000001,"5min":0.49199999999999999,"15min":0.48299999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":1.0409999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.57799999999999996,"5min":0.54600000000000004,"15min":0.51500000000000001},"max":{"1min":0.95299999999999996,"5min":1.0189999999999999,"15min":1.0620000000000001},"last":0.73099999999999998}]},{"osd":4,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.38200000000000001},"max":{"1min":0.75700000000000001,"5min":0.96699999999999997,"15min":0.995},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60599999999999998,"15min":0.61099999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88500000000000001,"5min":0.94399999999999995,"15min":0.96599999999999997},"last":0.60599999999999998}]},{"osd":6,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93799999999999994,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.67900000000000005,"15min":0.67400000000000004},"min":{"1min":0.53300000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91500000000000004,"5min":0.97099999999999997,"15min":1.006},"last":0.755}]},{"osd":7,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69799999999999995,"15min":0.68899999999999995},"min":{"1min":0.55000000000000004,"5min":0.46999999999999997,"15min":0.44400000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.76700000000000002},"min":{"1min":0.58799999999999997,"5min":0.57299999999999995,"15min":0.48599999999999999},"max":{"1min":0.97099999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.83999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T08:14:48.629 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T08:14:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.825+0000 7f50707ff700 1 Processor -- start 2023-10-09T08:14:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.825+0000 7f50707ff700 1 -- start start 2023-10-09T08:14:48.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.826+0000 7f50707ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f50680cbf30 0x7f50680ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:48.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.826+0000 7f50707ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f50680ccf90 0x7f50680b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:48.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.826+0000 7f50707ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50680cc300 con 0x7f506815a270 2023-10-09T08:14:48.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.826+0000 7f50707ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5068156bf0 con 0x7f50680ccf90 2023-10-09T08:14:48.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.826+0000 7f50707ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50680ae950 con 0x7f50680cbf30 2023-10-09T08:14:48.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.826+0000 7f506dd9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f50680ccf90 0x7f50680b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.827+0000 7f506dd9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f50680ccf90 0x7f50680b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40096/0 (socket says 172.21.15.71:40096) 2023-10-09T08:14:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.827+0000 7f506dd9a700 1 -- 172.21.15.71:0/3668256744 learned_addr learned my addr 172.21.15.71:0/3668256744 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.827+0000 7f506e59b700 1 --2- 172.21.15.71:0/3668256744 >> v2:172.21.15.179:3300/0 conn(0x7f50680cbf30 0x7f50680ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.827+0000 7f506dd9a700 1 -- 172.21.15.71:0/3668256744 >> v2:172.21.15.179:3300/0 conn(0x7f50680cbf30 msgr2=0x7f50680ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.827+0000 7f506dd9a700 1 --2- 172.21.15.71:0/3668256744 >> v2:172.21.15.179:3300/0 conn(0x7f50680cbf30 0x7f50680ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.827+0000 7f506dd9a700 1 -- 172.21.15.71:0/3668256744 >> v1:172.21.15.179:6789/0 conn(0x7f506815a270 legacy=0x7f50680c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.827+0000 7f506dd9a700 1 -- 172.21.15.71:0/3668256744 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50680ad370 con 0x7f50680ccf90 2023-10-09T08:14:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.827+0000 7f506dd9a700 1 --2- 172.21.15.71:0/3668256744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50680ccf90 0x7f50680b0d10 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f5068063d40 tx=0x7f505800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c440316593d891a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.827+0000 7f506d599700 1 -- 172.21.15.71:0/3668256744 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505800be60 con 0x7f50680ccf90 2023-10-09T08:14:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.828+0000 7f506d599700 1 -- 172.21.15.71:0/3668256744 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505800dd80 con 0x7f50680ccf90 2023-10-09T08:14:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.828+0000 7f506d599700 1 -- 172.21.15.71:0/3668256744 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50580106a0 con 0x7f50680ccf90 2023-10-09T08:14:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.828+0000 7f50707ff700 1 -- 172.21.15.71:0/3668256744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50680ccf90 msgr2=0x7f50680b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.828+0000 7f50707ff700 1 --2- 172.21.15.71:0/3668256744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50680ccf90 0x7f50680b0d10 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f5068063d40 tx=0x7f505800b4f0 comp rx=0 tx=0).stop 2023-10-09T08:14:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.828+0000 7f50707ff700 1 -- 172.21.15.71:0/3668256744 shutdown_connections 2023-10-09T08:14:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.828+0000 7f50707ff700 1 --2- 172.21.15.71:0/3668256744 >> v2:172.21.15.179:3300/0 conn(0x7f50680cbf30 0x7f50680ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.828+0000 7f50707ff700 1 --2- 172.21.15.71:0/3668256744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50680ccf90 0x7f50680b0d10 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.828+0000 7f50707ff700 1 -- 172.21.15.71:0/3668256744 >> 172.21.15.71:0/3668256744 conn(0x7f506806a320 msgr2=0x7f50680cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:48.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.828+0000 7f50707ff700 1 -- 172.21.15.71:0/3668256744 shutdown_connections 2023-10-09T08:14:48.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.828+0000 7f50707ff700 1 -- 172.21.15.71:0/3668256744 wait complete. 2023-10-09T08:14:48.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.830+0000 7f50707ff700 1 Processor -- start 2023-10-09T08:14:48.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.830+0000 7f50707ff700 1 -- start start 2023-10-09T08:14:48.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.831+0000 7f50707ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50680cbf30 0x7f5068157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:48.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.831+0000 7f50707ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50680ccf90 0x7f50680a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:48.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.831+0000 7f50707ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f506815a270 0x7f5068152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:48.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.831+0000 7f50707ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5068158540 con 0x7f50680cbf30 2023-10-09T08:14:48.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.831+0000 7f50707ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5068158820 con 0x7f50680ccf90 2023-10-09T08:14:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.831+0000 7f50707ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5068158b00 con 0x7f506815a270 2023-10-09T08:14:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.831+0000 7f506e59b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50680cbf30 0x7f5068157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.831+0000 7f506e59b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50680cbf30 0x7f5068157eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40102/0 (socket says 172.21.15.71:40102) 2023-10-09T08:14:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.831+0000 7f506e59b700 1 -- 172.21.15.71:0/1348470040 learned_addr learned my addr 172.21.15.71:0/1348470040 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.831+0000 7f506dd9a700 1 --2- 172.21.15.71:0/1348470040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50680ccf90 0x7f50680a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.831+0000 7f506ed9c700 1 --2- 172.21.15.71:0/1348470040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f506815a270 0x7f5068152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.831+0000 7f506e59b700 1 -- 172.21.15.71:0/1348470040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f506815a270 msgr2=0x7f5068152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.831+0000 7f506e59b700 1 --2- 172.21.15.71:0/1348470040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f506815a270 0x7f5068152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.831+0000 7f506e59b700 1 -- 172.21.15.71:0/1348470040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50680ccf90 msgr2=0x7f50680a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.831+0000 7f506e59b700 1 --2- 172.21.15.71:0/1348470040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50680ccf90 0x7f50680a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.831+0000 7f506e59b700 1 -- 172.21.15.71:0/1348470040 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505800b790 con 0x7f50680cbf30 2023-10-09T08:14:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.831+0000 7f506ed9c700 1 --2- 172.21.15.71:0/1348470040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f506815a270 0x7f5068152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:14:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.831+0000 7f506e59b700 1 --2- 172.21.15.71:0/1348470040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50680cbf30 0x7f5068157eb0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f506400d860 tx=0x7f5064008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.832+0000 7f505e7fc700 1 -- 172.21.15.71:0/1348470040 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50640125f0 con 0x7f50680cbf30 2023-10-09T08:14:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.832+0000 7f505e7fc700 1 -- 172.21.15.71:0/1348470040 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5064012750 con 0x7f50680cbf30 2023-10-09T08:14:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.832+0000 7f505e7fc700 1 -- 172.21.15.71:0/1348470040 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064012b10 con 0x7f50680cbf30 2023-10-09T08:14:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.832+0000 7f50707ff700 1 -- 172.21.15.71:0/1348470040 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506816d810 con 0x7f50680cbf30 2023-10-09T08:14:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.832+0000 7f50707ff700 1 -- 172.21.15.71:0/1348470040 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506816dd30 con 0x7f50680cbf30 2023-10-09T08:14:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.833+0000 7f50707ff700 1 -- 172.21.15.71:0/1348470040 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506816d670 con 0x7f50680cbf30 2023-10-09T08:14:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.834+0000 7f505e7fc700 1 -- 172.21.15.71:0/1348470040 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f506401e460 con 0x7f50680cbf30 2023-10-09T08:14:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.834+0000 7f505e7fc700 1 --2- 172.21.15.71:0/1348470040 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f504c066f30 0x7f504c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.834+0000 7f505e7fc700 1 -- 172.21.15.71:0/1348470040 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f5064084e80 con 0x7f50680cbf30 2023-10-09T08:14:48.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.835+0000 7f506dd9a700 1 --2- 172.21.15.71:0/1348470040 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f504c066f30 0x7f504c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:48.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.835+0000 7f506dd9a700 1 --2- 172.21.15.71:0/1348470040 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f504c066f30 0x7f504c0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5068063d40 tx=0x7f505801a000 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:48.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:48.838+0000 7f505e7fc700 1 -- 172.21.15.71:0/1348470040 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f506816d670 con 0x7f50680cbf30 2023-10-09T08:14:49.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.025+0000 7f50707ff700 1 -- 172.21.15.71:0/1348470040 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5068158990 con 0x7f504c066f30 2023-10-09T08:14:49.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.035+0000 7f505e7fc700 1 -- 172.21.15.71:0/1348470040 <== mgr.8965 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289364 (secure 0 0 0) 0x7f5068158990 con 0x7f504c066f30 2023-10-09T08:14:49.038 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:14:49.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.039+0000 7f50707ff700 1 -- 172.21.15.71:0/1348470040 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f504c066f30 msgr2=0x7f504c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:49.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.039+0000 7f50707ff700 1 --2- 172.21.15.71:0/1348470040 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f504c066f30 0x7f504c0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5068063d40 tx=0x7f505801a000 comp rx=0 tx=0).stop 2023-10-09T08:14:49.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.039+0000 7f50707ff700 1 -- 172.21.15.71:0/1348470040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50680cbf30 msgr2=0x7f5068157eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:49.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.039+0000 7f50707ff700 1 --2- 172.21.15.71:0/1348470040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50680cbf30 0x7f5068157eb0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f506400d860 tx=0x7f5064008040 comp rx=0 tx=0).stop 2023-10-09T08:14:49.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.039+0000 7f50707ff700 1 -- 172.21.15.71:0/1348470040 shutdown_connections 2023-10-09T08:14:49.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.039+0000 7f50707ff700 1 --2- 172.21.15.71:0/1348470040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f506815a270 0x7f5068152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:49.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.039+0000 7f50707ff700 1 --2- 172.21.15.71:0/1348470040 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f504c066f30 0x7f504c0693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:49.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.039+0000 7f50707ff700 1 --2- 172.21.15.71:0/1348470040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50680cbf30 0x7f5068157eb0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:49.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.039+0000 7f50707ff700 1 --2- 172.21.15.71:0/1348470040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50680ccf90 0x7f50680a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:49.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.039+0000 7f50707ff700 1 -- 172.21.15.71:0/1348470040 >> 172.21.15.71:0/1348470040 conn(0x7f506806a320 msgr2=0x7f50680cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:49.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.039+0000 7f50707ff700 1 -- 172.21.15.71:0/1348470040 shutdown_connections 2023-10-09T08:14:49.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.039+0000 7f50707ff700 1 -- 172.21.15.71:0/1348470040 wait complete. 2023-10-09T08:14:49.047 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T08:14:49.057 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-09T08:14:47.141787+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":583,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":364,"ondisk_log_size":364,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2488584,"kb_used_data":20168,"kb_used_omap":0,"kb_used_meta":2468352,"kb_avail":752486136,"statfs":{"total":773094113280,"available":770545803264,"internally_reserved":0,"allocated":20652032,"data_stored":10950780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2527592448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001937"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.484338+0000","last_change":"2023-10-09T08:14:39.481559+0000","last_active":"2023-10-09T08:14:39.484338+0000","last_peered":"2023-10-09T08:14:39.484338+0000","last_clean":"2023-10-09T08:14:39.484338+0000","last_became_active":"2023-10-09T08:14:39.481257+0000","last_became_peered":"2023-10-09T08:14:39.481257+0000","last_unstale":"2023-10-09T08:14:39.484338+0000","last_undegraded":"2023-10-09T08:14:39.484338+0000","last_fullsized":"2023-10-09T08:14:39.484338+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:47.340414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.479731+0000","last_change":"2023-10-09T08:14:39.478053+0000","last_active":"2023-10-09T08:14:39.479731+0000","last_peered":"2023-10-09T08:14:39.479731+0000","last_clean":"2023-10-09T08:14:39.479731+0000","last_became_active":"2023-10-09T08:14:39.477780+0000","last_became_peered":"2023-10-09T08:14:39.477780+0000","last_unstale":"2023-10-09T08:14:39.479731+0000","last_undegraded":"2023-10-09T08:14:39.479731+0000","last_fullsized":"2023-10-09T08:14:39.479731+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:10:02.864400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.465855+0000","last_change":"2023-10-09T08:14:39.462337+0000","last_active":"2023-10-09T08:14:39.465855+0000","last_peered":"2023-10-09T08:14:39.465855+0000","last_clean":"2023-10-09T08:14:39.465855+0000","last_became_active":"2023-10-09T08:14:39.461991+0000","last_became_peered":"2023-10-09T08:14:39.461991+0000","last_unstale":"2023-10-09T08:14:39.465855+0000","last_undegraded":"2023-10-09T08:14:39.465855+0000","last_fullsized":"2023-10-09T08:14:39.465855+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:12:23.337933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478301+0000","last_change":"2023-10-09T08:14:39.473471+0000","last_active":"2023-10-09T08:14:39.478301+0000","last_peered":"2023-10-09T08:14:39.478301+0000","last_clean":"2023-10-09T08:14:39.478301+0000","last_became_active":"2023-10-09T08:14:39.473136+0000","last_became_peered":"2023-10-09T08:14:39.473136+0000","last_unstale":"2023-10-09T08:14:39.478301+0000","last_undegraded":"2023-10-09T08:14:39.478301+0000","last_fullsized":"2023-10-09T08:14:39.478301+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:07:04.309396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.490651+0000","last_change":"2023-10-09T08:14:39.488645+0000","last_active":"2023-10-09T08:14:39.490651+0000","last_peered":"2023-10-09T08:14:39.490651+0000","last_clean":"2023-10-09T08:14:39.490651+0000","last_became_active":"2023-10-09T08:14:39.488320+0000","last_became_peered":"2023-10-09T08:14:39.488320+0000","last_unstale":"2023-10-09T08:14:39.490651+0000","last_undegraded":"2023-10-09T08:14:39.490651+0000","last_fullsized":"2023-10-09T08:14:39.490651+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:34:13.309045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.483532+0000","last_change":"2023-10-09T08:14:39.479211+0000","last_active":"2023-10-09T08:14:39.483532+0000","last_peered":"2023-10-09T08:14:39.483532+0000","last_clean":"2023-10-09T08:14:39.483532+0000","last_became_active":"2023-10-09T08:14:39.478472+0000","last_became_peered":"2023-10-09T08:14:39.478472+0000","last_unstale":"2023-10-09T08:14:39.483532+0000","last_undegraded":"2023-10-09T08:14:39.483532+0000","last_fullsized":"2023-10-09T08:14:39.483532+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:37:42.156487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.487669+0000","last_change":"2023-10-09T08:14:39.486690+0000","last_active":"2023-10-09T08:14:39.487669+0000","last_peered":"2023-10-09T08:14:39.487669+0000","last_clean":"2023-10-09T08:14:39.487669+0000","last_became_active":"2023-10-09T08:14:39.486410+0000","last_became_peered":"2023-10-09T08:14:39.486410+0000","last_unstale":"2023-10-09T08:14:39.487669+0000","last_undegraded":"2023-10-09T08:14:39.487669+0000","last_fullsized":"2023-10-09T08:14:39.487669+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:23:30.404764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.476279+0000","last_change":"2023-10-09T08:14:39.472830+0000","last_active":"2023-10-09T08:14:39.476279+0000","last_peered":"2023-10-09T08:14:39.476279+0000","last_clean":"2023-10-09T08:14:39.476279+0000","last_became_active":"2023-10-09T08:14:39.472557+0000","last_became_peered":"2023-10-09T08:14:39.472557+0000","last_unstale":"2023-10-09T08:14:39.476279+0000","last_undegraded":"2023-10-09T08:14:39.476279+0000","last_fullsized":"2023-10-09T08:14:39.476279+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:57.535414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.488597+0000","last_change":"2023-10-09T08:14:39.486084+0000","last_active":"2023-10-09T08:14:39.488597+0000","last_peered":"2023-10-09T08:14:39.488597+0000","last_clean":"2023-10-09T08:14:39.488597+0000","last_became_active":"2023-10-09T08:14:39.485791+0000","last_became_peered":"2023-10-09T08:14:39.485791+0000","last_unstale":"2023-10-09T08:14:39.488597+0000","last_undegraded":"2023-10-09T08:14:39.488597+0000","last_fullsized":"2023-10-09T08:14:39.488597+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:51.153845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.480833+0000","last_change":"2023-10-09T08:14:39.479608+0000","last_active":"2023-10-09T08:14:39.480833+0000","last_peered":"2023-10-09T08:14:39.480833+0000","last_clean":"2023-10-09T08:14:39.480833+0000","last_became_active":"2023-10-09T08:14:39.479350+0000","last_became_peered":"2023-10-09T08:14:39.479350+0000","last_unstale":"2023-10-09T08:14:39.480833+0000","last_undegraded":"2023-10-09T08:14:39.480833+0000","last_fullsized":"2023-10-09T08:14:39.480833+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:00:01.549387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.489617+0000","last_change":"2023-10-09T08:14:39.487882+0000","last_active":"2023-10-09T08:14:39.489617+0000","last_peered":"2023-10-09T08:14:39.489617+0000","last_clean":"2023-10-09T08:14:39.489617+0000","last_became_active":"2023-10-09T08:14:39.487552+0000","last_became_peered":"2023-10-09T08:14:39.487552+0000","last_unstale":"2023-10-09T08:14:39.489617+0000","last_undegraded":"2023-10-09T08:14:39.489617+0000","last_fullsized":"2023-10-09T08:14:39.489617+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:04.566842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.487480+0000","last_change":"2023-10-09T08:14:39.485191+0000","last_active":"2023-10-09T08:14:39.487480+0000","last_peered":"2023-10-09T08:14:39.487480+0000","last_clean":"2023-10-09T08:14:39.487480+0000","last_became_active":"2023-10-09T08:14:39.484915+0000","last_became_peered":"2023-10-09T08:14:39.484915+0000","last_unstale":"2023-10-09T08:14:39.487480+0000","last_undegraded":"2023-10-09T08:14:39.487480+0000","last_fullsized":"2023-10-09T08:14:39.487480+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:29:06.229231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.468634+0000","last_change":"2023-10-09T08:14:39.465750+0000","last_active":"2023-10-09T08:14:39.468634+0000","last_peered":"2023-10-09T08:14:39.468634+0000","last_clean":"2023-10-09T08:14:39.468634+0000","last_became_active":"2023-10-09T08:14:39.465439+0000","last_became_peered":"2023-10-09T08:14:39.465439+0000","last_unstale":"2023-10-09T08:14:39.468634+0000","last_undegraded":"2023-10-09T08:14:39.468634+0000","last_fullsized":"2023-10-09T08:14:39.468634+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:50:41.565341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481561+0000","last_change":"2023-10-09T08:14:39.476147+0000","last_active":"2023-10-09T08:14:39.481561+0000","last_peered":"2023-10-09T08:14:39.481561+0000","last_clean":"2023-10-09T08:14:39.481561+0000","last_became_active":"2023-10-09T08:14:39.475869+0000","last_became_peered":"2023-10-09T08:14:39.475869+0000","last_unstale":"2023-10-09T08:14:39.481561+0000","last_undegraded":"2023-10-09T08:14:39.481561+0000","last_fullsized":"2023-10-09T08:14:39.481561+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:45.463893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481865+0000","last_change":"2023-10-09T08:14:39.479153+0000","last_active":"2023-10-09T08:14:39.481865+0000","last_peered":"2023-10-09T08:14:39.481865+0000","last_clean":"2023-10-09T08:14:39.481865+0000","last_became_active":"2023-10-09T08:14:39.478895+0000","last_became_peered":"2023-10-09T08:14:39.478895+0000","last_unstale":"2023-10-09T08:14:39.481865+0000","last_undegraded":"2023-10-09T08:14:39.481865+0000","last_fullsized":"2023-10-09T08:14:39.481865+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:40.161626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481640+0000","last_change":"2023-10-09T08:14:39.477874+0000","last_active":"2023-10-09T08:14:39.481640+0000","last_peered":"2023-10-09T08:14:39.481640+0000","last_clean":"2023-10-09T08:14:39.481640+0000","last_became_active":"2023-10-09T08:14:39.477475+0000","last_became_peered":"2023-10-09T08:14:39.477475+0000","last_unstale":"2023-10-09T08:14:39.481640+0000","last_undegraded":"2023-10-09T08:14:39.481640+0000","last_fullsized":"2023-10-09T08:14:39.481640+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:50:38.316596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.484420+0000","last_change":"2023-10-09T08:14:39.481354+0000","last_active":"2023-10-09T08:14:39.484420+0000","last_peered":"2023-10-09T08:14:39.484420+0000","last_clean":"2023-10-09T08:14:39.484420+0000","last_became_active":"2023-10-09T08:14:39.481092+0000","last_became_peered":"2023-10-09T08:14:39.481092+0000","last_unstale":"2023-10-09T08:14:39.484420+0000","last_undegraded":"2023-10-09T08:14:39.484420+0000","last_fullsized":"2023-10-09T08:14:39.484420+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:50.399165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478600+0000","last_change":"2023-10-09T08:14:39.471598+0000","last_active":"2023-10-09T08:14:39.478600+0000","last_peered":"2023-10-09T08:14:39.478600+0000","last_clean":"2023-10-09T08:14:39.478600+0000","last_became_active":"2023-10-09T08:14:39.471342+0000","last_became_peered":"2023-10-09T08:14:39.471342+0000","last_unstale":"2023-10-09T08:14:39.478600+0000","last_undegraded":"2023-10-09T08:14:39.478600+0000","last_fullsized":"2023-10-09T08:14:39.478600+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:18:14.449986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.488248+0000","last_change":"2023-10-09T08:14:39.487286+0000","last_active":"2023-10-09T08:14:39.488248+0000","last_peered":"2023-10-09T08:14:39.488248+0000","last_clean":"2023-10-09T08:14:39.488248+0000","last_became_active":"2023-10-09T08:14:39.486306+0000","last_became_peered":"2023-10-09T08:14:39.486306+0000","last_unstale":"2023-10-09T08:14:39.488248+0000","last_undegraded":"2023-10-09T08:14:39.488248+0000","last_fullsized":"2023-10-09T08:14:39.488248+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:54.313934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.474774+0000","last_change":"2023-10-09T08:14:39.469442+0000","last_active":"2023-10-09T08:14:39.474774+0000","last_peered":"2023-10-09T08:14:39.474774+0000","last_clean":"2023-10-09T08:14:39.474774+0000","last_became_active":"2023-10-09T08:14:39.469139+0000","last_became_peered":"2023-10-09T08:14:39.469139+0000","last_unstale":"2023-10-09T08:14:39.474774+0000","last_undegraded":"2023-10-09T08:14:39.474774+0000","last_fullsized":"2023-10-09T08:14:39.474774+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:27.256631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.477409+0000","last_change":"2023-10-09T08:14:39.471677+0000","last_active":"2023-10-09T08:14:39.477409+0000","last_peered":"2023-10-09T08:14:39.477409+0000","last_clean":"2023-10-09T08:14:39.477409+0000","last_became_active":"2023-10-09T08:14:39.471412+0000","last_became_peered":"2023-10-09T08:14:39.471412+0000","last_unstale":"2023-10-09T08:14:39.477409+0000","last_undegraded":"2023-10-09T08:14:39.477409+0000","last_fullsized":"2023-10-09T08:14:39.477409+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:15:48.546235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.477941+0000","last_change":"2023-10-09T08:14:39.476263+0000","last_active":"2023-10-09T08:14:39.477941+0000","last_peered":"2023-10-09T08:14:39.477941+0000","last_clean":"2023-10-09T08:14:39.477941+0000","last_became_active":"2023-10-09T08:14:39.475984+0000","last_became_peered":"2023-10-09T08:14:39.475984+0000","last_unstale":"2023-10-09T08:14:39.477941+0000","last_undegraded":"2023-10-09T08:14:39.477941+0000","last_fullsized":"2023-10-09T08:14:39.477941+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:29.408646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.483651+0000","last_change":"2023-10-09T08:14:39.480496+0000","last_active":"2023-10-09T08:14:39.483651+0000","last_peered":"2023-10-09T08:14:39.483651+0000","last_clean":"2023-10-09T08:14:39.483651+0000","last_became_active":"2023-10-09T08:14:39.479949+0000","last_became_peered":"2023-10-09T08:14:39.479949+0000","last_unstale":"2023-10-09T08:14:39.483651+0000","last_undegraded":"2023-10-09T08:14:39.483651+0000","last_fullsized":"2023-10-09T08:14:39.483651+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:16.219371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.476260+0000","last_change":"2023-10-09T08:14:39.471163+0000","last_active":"2023-10-09T08:14:39.476260+0000","last_peered":"2023-10-09T08:14:39.476260+0000","last_clean":"2023-10-09T08:14:39.476260+0000","last_became_active":"2023-10-09T08:14:39.470218+0000","last_became_peered":"2023-10-09T08:14:39.470218+0000","last_unstale":"2023-10-09T08:14:39.476260+0000","last_undegraded":"2023-10-09T08:14:39.476260+0000","last_fullsized":"2023-10-09T08:14:39.476260+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:48:35.054792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.480194+0000","last_change":"2023-10-09T08:14:39.474252+0000","last_active":"2023-10-09T08:14:39.480194+0000","last_peered":"2023-10-09T08:14:39.480194+0000","last_clean":"2023-10-09T08:14:39.480194+0000","last_became_active":"2023-10-09T08:14:39.474012+0000","last_became_peered":"2023-10-09T08:14:39.474012+0000","last_unstale":"2023-10-09T08:14:39.480194+0000","last_undegraded":"2023-10-09T08:14:39.480194+0000","last_fullsized":"2023-10-09T08:14:39.480194+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:30:45.182691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.482772+0000","last_change":"2023-10-09T08:14:39.479390+0000","last_active":"2023-10-09T08:14:39.482772+0000","last_peered":"2023-10-09T08:14:39.482772+0000","last_clean":"2023-10-09T08:14:39.482772+0000","last_became_active":"2023-10-09T08:14:39.479115+0000","last_became_peered":"2023-10-09T08:14:39.479115+0000","last_unstale":"2023-10-09T08:14:39.482772+0000","last_undegraded":"2023-10-09T08:14:39.482772+0000","last_fullsized":"2023-10-09T08:14:39.482772+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:32:40.161626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481353+0000","last_change":"2023-10-09T08:14:39.476441+0000","last_active":"2023-10-09T08:14:39.481353+0000","last_peered":"2023-10-09T08:14:39.481353+0000","last_clean":"2023-10-09T08:14:39.481353+0000","last_became_active":"2023-10-09T08:14:39.476157+0000","last_became_peered":"2023-10-09T08:14:39.476157+0000","last_unstale":"2023-10-09T08:14:39.481353+0000","last_undegraded":"2023-10-09T08:14:39.481353+0000","last_fullsized":"2023-10-09T08:14:39.481353+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:41.265953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.487700+0000","last_change":"2023-10-09T08:14:39.482489+0000","last_active":"2023-10-09T08:14:39.487700+0000","last_peered":"2023-10-09T08:14:39.487700+0000","last_clean":"2023-10-09T08:14:39.487700+0000","last_became_active":"2023-10-09T08:14:39.482221+0000","last_became_peered":"2023-10-09T08:14:39.482221+0000","last_unstale":"2023-10-09T08:14:39.487700+0000","last_undegraded":"2023-10-09T08:14:39.487700+0000","last_fullsized":"2023-10-09T08:14:39.487700+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:27.256631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481386+0000","last_change":"2023-10-09T08:14:39.476384+0000","last_active":"2023-10-09T08:14:39.481386+0000","last_peered":"2023-10-09T08:14:39.481386+0000","last_clean":"2023-10-09T08:14:39.481386+0000","last_became_active":"2023-10-09T08:14:39.475680+0000","last_became_peered":"2023-10-09T08:14:39.475680+0000","last_unstale":"2023-10-09T08:14:39.481386+0000","last_undegraded":"2023-10-09T08:14:39.481386+0000","last_fullsized":"2023-10-09T08:14:39.481386+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:10.701415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.484467+0000","last_change":"2023-10-09T08:14:39.475274+0000","last_active":"2023-10-09T08:14:39.484467+0000","last_peered":"2023-10-09T08:14:39.484467+0000","last_clean":"2023-10-09T08:14:39.484467+0000","last_became_active":"2023-10-09T08:14:39.475014+0000","last_became_peered":"2023-10-09T08:14:39.475014+0000","last_unstale":"2023-10-09T08:14:39.484467+0000","last_undegraded":"2023-10-09T08:14:39.484467+0000","last_fullsized":"2023-10-09T08:14:39.484467+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:53:15.004702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.484546+0000","last_change":"2023-10-09T08:14:39.479153+0000","last_active":"2023-10-09T08:14:39.484546+0000","last_peered":"2023-10-09T08:14:39.484546+0000","last_clean":"2023-10-09T08:14:39.484546+0000","last_became_active":"2023-10-09T08:14:39.478911+0000","last_became_peered":"2023-10-09T08:14:39.478911+0000","last_unstale":"2023-10-09T08:14:39.484546+0000","last_undegraded":"2023-10-09T08:14:39.484546+0000","last_fullsized":"2023-10-09T08:14:39.484546+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:46.686150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.479656+0000","last_change":"2023-10-09T08:14:39.471497+0000","last_active":"2023-10-09T08:14:39.479656+0000","last_peered":"2023-10-09T08:14:39.479656+0000","last_clean":"2023-10-09T08:14:39.479656+0000","last_became_active":"2023-10-09T08:14:39.471197+0000","last_became_peered":"2023-10-09T08:14:39.471197+0000","last_unstale":"2023-10-09T08:14:39.479656+0000","last_undegraded":"2023-10-09T08:14:39.479656+0000","last_fullsized":"2023-10-09T08:14:39.479656+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:36:19.307671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.482753+0000","last_change":"2023-10-09T08:14:39.478983+0000","last_active":"2023-10-09T08:14:39.482753+0000","last_peered":"2023-10-09T08:14:39.482753+0000","last_clean":"2023-10-09T08:14:39.482753+0000","last_became_active":"2023-10-09T08:14:39.478606+0000","last_became_peered":"2023-10-09T08:14:39.478606+0000","last_unstale":"2023-10-09T08:14:39.482753+0000","last_undegraded":"2023-10-09T08:14:39.482753+0000","last_fullsized":"2023-10-09T08:14:39.482753+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:41:47.263574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"193'4","reported_seq":14,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.495194+0000","last_change":"2023-10-09T08:14:38.465359+0000","last_active":"2023-10-09T08:14:39.495194+0000","last_peered":"2023-10-09T08:14:39.495194+0000","last_clean":"2023-10-09T08:14:39.495194+0000","last_became_active":"2023-10-09T08:14:38.465002+0000","last_became_peered":"2023-10-09T08:14:38.465002+0000","last_unstale":"2023-10-09T08:14:39.495194+0000","last_undegraded":"2023-10-09T08:14:39.495194+0000","last_fullsized":"2023-10-09T08:14:39.495194+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:33.507990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.466598+0000","last_change":"2023-10-09T08:14:39.462902+0000","last_active":"2023-10-09T08:14:39.466598+0000","last_peered":"2023-10-09T08:14:39.466598+0000","last_clean":"2023-10-09T08:14:39.466598+0000","last_became_active":"2023-10-09T08:14:39.462580+0000","last_became_peered":"2023-10-09T08:14:39.462580+0000","last_unstale":"2023-10-09T08:14:39.466598+0000","last_undegraded":"2023-10-09T08:14:39.466598+0000","last_fullsized":"2023-10-09T08:14:39.466598+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:54:35.010687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"193'1","reported_seq":11,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.491481+0000","last_change":"2023-10-09T08:14:38.457221+0000","last_active":"2023-10-09T08:14:39.491481+0000","last_peered":"2023-10-09T08:14:39.491481+0000","last_clean":"2023-10-09T08:14:39.491481+0000","last_became_active":"2023-10-09T08:14:38.456915+0000","last_became_peered":"2023-10-09T08:14:38.456915+0000","last_unstale":"2023-10-09T08:14:39.491481+0000","last_undegraded":"2023-10-09T08:14:39.491481+0000","last_fullsized":"2023-10-09T08:14:39.491481+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:46:35.474237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.483599+0000","last_change":"2023-10-09T08:14:39.479813+0000","last_active":"2023-10-09T08:14:39.483599+0000","last_peered":"2023-10-09T08:14:39.483599+0000","last_clean":"2023-10-09T08:14:39.483599+0000","last_became_active":"2023-10-09T08:14:39.479545+0000","last_became_peered":"2023-10-09T08:14:39.479545+0000","last_unstale":"2023-10-09T08:14:39.483599+0000","last_undegraded":"2023-10-09T08:14:39.483599+0000","last_fullsized":"2023-10-09T08:14:39.483599+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:53:08.718144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"193'2","reported_seq":12,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.488694+0000","last_change":"2023-10-09T08:14:38.461946+0000","last_active":"2023-10-09T08:14:39.488694+0000","last_peered":"2023-10-09T08:14:39.488694+0000","last_clean":"2023-10-09T08:14:39.488694+0000","last_became_active":"2023-10-09T08:14:38.461634+0000","last_became_peered":"2023-10-09T08:14:38.461634+0000","last_unstale":"2023-10-09T08:14:39.488694+0000","last_undegraded":"2023-10-09T08:14:39.488694+0000","last_fullsized":"2023-10-09T08:14:39.488694+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:26:37.033079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.480079+0000","last_change":"2023-10-09T08:14:39.470809+0000","last_active":"2023-10-09T08:14:39.480079+0000","last_peered":"2023-10-09T08:14:39.480079+0000","last_clean":"2023-10-09T08:14:39.480079+0000","last_became_active":"2023-10-09T08:14:39.470507+0000","last_became_peered":"2023-10-09T08:14:39.470507+0000","last_unstale":"2023-10-09T08:14:39.480079+0000","last_undegraded":"2023-10-09T08:14:39.480079+0000","last_fullsized":"2023-10-09T08:14:39.480079+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:07:04.309396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"193'2","reported_seq":12,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.489126+0000","last_change":"2023-10-09T08:14:38.458549+0000","last_active":"2023-10-09T08:14:39.489126+0000","last_peered":"2023-10-09T08:14:39.489126+0000","last_clean":"2023-10-09T08:14:39.489126+0000","last_became_active":"2023-10-09T08:14:38.458275+0000","last_became_peered":"2023-10-09T08:14:38.458275+0000","last_unstale":"2023-10-09T08:14:39.489126+0000","last_undegraded":"2023-10-09T08:14:39.489126+0000","last_fullsized":"2023-10-09T08:14:39.489126+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:48:06.747379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481665+0000","last_change":"2023-10-09T08:14:39.476822+0000","last_active":"2023-10-09T08:14:39.481665+0000","last_peered":"2023-10-09T08:14:39.481665+0000","last_clean":"2023-10-09T08:14:39.481665+0000","last_became_active":"2023-10-09T08:14:39.476504+0000","last_became_peered":"2023-10-09T08:14:39.476504+0000","last_unstale":"2023-10-09T08:14:39.481665+0000","last_undegraded":"2023-10-09T08:14:39.481665+0000","last_fullsized":"2023-10-09T08:14:39.481665+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:34:27.759607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"193'1","reported_seq":11,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.490524+0000","last_change":"2023-10-09T08:14:38.463851+0000","last_active":"2023-10-09T08:14:39.490524+0000","last_peered":"2023-10-09T08:14:39.490524+0000","last_clean":"2023-10-09T08:14:39.490524+0000","last_became_active":"2023-10-09T08:14:38.463506+0000","last_became_peered":"2023-10-09T08:14:38.463506+0000","last_unstale":"2023-10-09T08:14:39.490524+0000","last_undegraded":"2023-10-09T08:14:39.490524+0000","last_fullsized":"2023-10-09T08:14:39.490524+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:04.853104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478263+0000","last_change":"2023-10-09T08:14:39.473884+0000","last_active":"2023-10-09T08:14:39.478263+0000","last_peered":"2023-10-09T08:14:39.478263+0000","last_clean":"2023-10-09T08:14:39.478263+0000","last_became_active":"2023-10-09T08:14:39.473603+0000","last_became_peered":"2023-10-09T08:14:39.473603+0000","last_unstale":"2023-10-09T08:14:39.478263+0000","last_undegraded":"2023-10-09T08:14:39.478263+0000","last_fullsized":"2023-10-09T08:14:39.478263+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:52:12.286059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"193'1","reported_seq":11,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.488113+0000","last_change":"2023-10-09T08:14:38.454227+0000","last_active":"2023-10-09T08:14:39.488113+0000","last_peered":"2023-10-09T08:14:39.488113+0000","last_clean":"2023-10-09T08:14:39.488113+0000","last_became_active":"2023-10-09T08:14:38.453644+0000","last_became_peered":"2023-10-09T08:14:38.453644+0000","last_unstale":"2023-10-09T08:14:39.488113+0000","last_undegraded":"2023-10-09T08:14:39.488113+0000","last_fullsized":"2023-10-09T08:14:39.488113+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:54:34.005037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478228+0000","last_change":"2023-10-09T08:14:39.474425+0000","last_active":"2023-10-09T08:14:39.478228+0000","last_peered":"2023-10-09T08:14:39.478228+0000","last_clean":"2023-10-09T08:14:39.478228+0000","last_became_active":"2023-10-09T08:14:39.474160+0000","last_became_peered":"2023-10-09T08:14:39.474160+0000","last_unstale":"2023-10-09T08:14:39.478228+0000","last_undegraded":"2023-10-09T08:14:39.478228+0000","last_fullsized":"2023-10-09T08:14:39.478228+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:50:41.565341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.466418+0000","last_change":"2023-10-09T08:14:38.457086+0000","last_active":"2023-10-09T08:14:39.466418+0000","last_peered":"2023-10-09T08:14:39.466418+0000","last_clean":"2023-10-09T08:14:39.466418+0000","last_became_active":"2023-10-09T08:14:38.455775+0000","last_became_peered":"2023-10-09T08:14:38.455775+0000","last_unstale":"2023-10-09T08:14:39.466418+0000","last_undegraded":"2023-10-09T08:14:39.466418+0000","last_fullsized":"2023-10-09T08:14:39.466418+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:13:24.156288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478136+0000","last_change":"2023-10-09T08:14:39.477068+0000","last_active":"2023-10-09T08:14:39.478136+0000","last_peered":"2023-10-09T08:14:39.478136+0000","last_clean":"2023-10-09T08:14:39.478136+0000","last_became_active":"2023-10-09T08:14:39.476231+0000","last_became_peered":"2023-10-09T08:14:39.476231+0000","last_unstale":"2023-10-09T08:14:39.478136+0000","last_undegraded":"2023-10-09T08:14:39.478136+0000","last_fullsized":"2023-10-09T08:14:39.478136+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:09.352022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.465583+0000","last_change":"2023-10-09T08:14:38.447789+0000","last_active":"2023-10-09T08:14:39.465583+0000","last_peered":"2023-10-09T08:14:39.465583+0000","last_clean":"2023-10-09T08:14:39.465583+0000","last_became_active":"2023-10-09T08:14:38.447539+0000","last_became_peered":"2023-10-09T08:14:38.447539+0000","last_unstale":"2023-10-09T08:14:39.465583+0000","last_undegraded":"2023-10-09T08:14:39.465583+0000","last_fullsized":"2023-10-09T08:14:39.465583+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:32.622711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.475100+0000","last_change":"2023-10-09T08:14:39.469756+0000","last_active":"2023-10-09T08:14:39.475100+0000","last_peered":"2023-10-09T08:14:39.475100+0000","last_clean":"2023-10-09T08:14:39.475100+0000","last_became_active":"2023-10-09T08:14:39.469509+0000","last_became_peered":"2023-10-09T08:14:39.469509+0000","last_unstale":"2023-10-09T08:14:39.475100+0000","last_undegraded":"2023-10-09T08:14:39.475100+0000","last_fullsized":"2023-10-09T08:14:39.475100+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:37.888301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.462786+0000","last_change":"2023-10-09T08:14:38.464801+0000","last_active":"2023-10-09T08:14:39.462786+0000","last_peered":"2023-10-09T08:14:39.462786+0000","last_clean":"2023-10-09T08:14:39.462786+0000","last_became_active":"2023-10-09T08:14:38.464474+0000","last_became_peered":"2023-10-09T08:14:38.464474+0000","last_unstale":"2023-10-09T08:14:39.462786+0000","last_undegraded":"2023-10-09T08:14:39.462786+0000","last_fullsized":"2023-10-09T08:14:39.462786+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:30:52.549825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.475065+0000","last_change":"2023-10-09T08:14:39.470159+0000","last_active":"2023-10-09T08:14:39.475065+0000","last_peered":"2023-10-09T08:14:39.475065+0000","last_clean":"2023-10-09T08:14:39.475065+0000","last_became_active":"2023-10-09T08:14:39.469401+0000","last_became_peered":"2023-10-09T08:14:39.469401+0000","last_unstale":"2023-10-09T08:14:39.475065+0000","last_undegraded":"2023-10-09T08:14:39.475065+0000","last_fullsized":"2023-10-09T08:14:39.475065+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:57.535414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"193'3","reported_seq":13,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.493087+0000","last_change":"2023-10-09T08:14:38.454895+0000","last_active":"2023-10-09T08:14:39.493087+0000","last_peered":"2023-10-09T08:14:39.493087+0000","last_clean":"2023-10-09T08:14:39.493087+0000","last_became_active":"2023-10-09T08:14:38.451818+0000","last_became_peered":"2023-10-09T08:14:38.451818+0000","last_unstale":"2023-10-09T08:14:39.493087+0000","last_undegraded":"2023-10-09T08:14:39.493087+0000","last_fullsized":"2023-10-09T08:14:39.493087+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:48:52.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.468147+0000","last_change":"2023-10-09T08:14:39.463689+0000","last_active":"2023-10-09T08:14:39.468147+0000","last_peered":"2023-10-09T08:14:39.468147+0000","last_clean":"2023-10-09T08:14:39.468147+0000","last_became_active":"2023-10-09T08:14:39.463306+0000","last_became_peered":"2023-10-09T08:14:39.463306+0000","last_unstale":"2023-10-09T08:14:39.468147+0000","last_undegraded":"2023-10-09T08:14:39.468147+0000","last_fullsized":"2023-10-09T08:14:39.468147+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:48:07.753029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"193'6","reported_seq":16,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.495619+0000","last_change":"2023-10-09T08:14:38.454823+0000","last_active":"2023-10-09T08:14:39.495619+0000","last_peered":"2023-10-09T08:14:39.495619+0000","last_clean":"2023-10-09T08:14:39.495619+0000","last_became_active":"2023-10-09T08:14:38.454501+0000","last_became_peered":"2023-10-09T08:14:38.454501+0000","last_unstale":"2023-10-09T08:14:39.495619+0000","last_undegraded":"2023-10-09T08:14:39.495619+0000","last_fullsized":"2023-10-09T08:14:39.495619+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:29:29.450151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.479006+0000","last_change":"2023-10-09T08:14:39.473198+0000","last_active":"2023-10-09T08:14:39.479006+0000","last_peered":"2023-10-09T08:14:39.479006+0000","last_clean":"2023-10-09T08:14:39.479006+0000","last_became_active":"2023-10-09T08:14:39.472951+0000","last_became_peered":"2023-10-09T08:14:39.472951+0000","last_unstale":"2023-10-09T08:14:39.479006+0000","last_undegraded":"2023-10-09T08:14:39.479006+0000","last_fullsized":"2023-10-09T08:14:39.479006+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:00:37.618868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"193'2","reported_seq":12,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.488187+0000","last_change":"2023-10-09T08:14:38.449788+0000","last_active":"2023-10-09T08:14:39.488187+0000","last_peered":"2023-10-09T08:14:39.488187+0000","last_clean":"2023-10-09T08:14:39.488187+0000","last_became_active":"2023-10-09T08:14:38.449495+0000","last_became_peered":"2023-10-09T08:14:38.449495+0000","last_unstale":"2023-10-09T08:14:39.488187+0000","last_undegraded":"2023-10-09T08:14:39.488187+0000","last_fullsized":"2023-10-09T08:14:39.488187+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:39.412176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.474301+0000","last_change":"2023-10-09T08:14:39.472462+0000","last_active":"2023-10-09T08:14:39.474301+0000","last_peered":"2023-10-09T08:14:39.474301+0000","last_clean":"2023-10-09T08:14:39.474301+0000","last_became_active":"2023-10-09T08:14:39.472162+0000","last_became_peered":"2023-10-09T08:14:39.472162+0000","last_unstale":"2023-10-09T08:14:39.474301+0000","last_undegraded":"2023-10-09T08:14:39.474301+0000","last_fullsized":"2023-10-09T08:14:39.474301+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:56.539162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.460955+0000","last_change":"2023-10-09T08:14:38.454099+0000","last_active":"2023-10-09T08:14:39.460955+0000","last_peered":"2023-10-09T08:14:39.460955+0000","last_clean":"2023-10-09T08:14:39.460955+0000","last_became_active":"2023-10-09T08:14:38.453858+0000","last_became_peered":"2023-10-09T08:14:38.453858+0000","last_unstale":"2023-10-09T08:14:39.460955+0000","last_undegraded":"2023-10-09T08:14:39.460955+0000","last_fullsized":"2023-10-09T08:14:39.460955+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:56:35.959943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.476548+0000","last_change":"2023-10-09T08:14:39.470123+0000","last_active":"2023-10-09T08:14:39.476548+0000","last_peered":"2023-10-09T08:14:39.476548+0000","last_clean":"2023-10-09T08:14:39.476548+0000","last_became_active":"2023-10-09T08:14:39.469871+0000","last_became_peered":"2023-10-09T08:14:39.469871+0000","last_unstale":"2023-10-09T08:14:39.476548+0000","last_undegraded":"2023-10-09T08:14:39.476548+0000","last_fullsized":"2023-10-09T08:14:39.476548+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:43:57.610820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.461966+0000","last_change":"2023-10-09T08:14:38.460637+0000","last_active":"2023-10-09T08:14:39.461966+0000","last_peered":"2023-10-09T08:14:39.461966+0000","last_clean":"2023-10-09T08:14:39.461966+0000","last_became_active":"2023-10-09T08:14:38.460330+0000","last_became_peered":"2023-10-09T08:14:38.460330+0000","last_unstale":"2023-10-09T08:14:39.461966+0000","last_undegraded":"2023-10-09T08:14:39.461966+0000","last_fullsized":"2023-10-09T08:14:39.461966+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:44.429332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481614+0000","last_change":"2023-10-09T08:14:39.477683+0000","last_active":"2023-10-09T08:14:39.481614+0000","last_peered":"2023-10-09T08:14:39.481614+0000","last_clean":"2023-10-09T08:14:39.481614+0000","last_became_active":"2023-10-09T08:14:39.477263+0000","last_became_peered":"2023-10-09T08:14:39.477263+0000","last_unstale":"2023-10-09T08:14:39.481614+0000","last_undegraded":"2023-10-09T08:14:39.481614+0000","last_fullsized":"2023-10-09T08:14:39.481614+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:52:12.286059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"193'8","reported_seq":18,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.493731+0000","last_change":"2023-10-09T08:14:38.450181+0000","last_active":"2023-10-09T08:14:39.493731+0000","last_peered":"2023-10-09T08:14:39.493731+0000","last_clean":"2023-10-09T08:14:39.493731+0000","last_became_active":"2023-10-09T08:14:38.449917+0000","last_became_peered":"2023-10-09T08:14:38.449917+0000","last_unstale":"2023-10-09T08:14:39.493731+0000","last_undegraded":"2023-10-09T08:14:39.493731+0000","last_fullsized":"2023-10-09T08:14:39.493731+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:49.854902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478451+0000","last_change":"2023-10-09T08:14:39.472632+0000","last_active":"2023-10-09T08:14:39.478451+0000","last_peered":"2023-10-09T08:14:39.478451+0000","last_clean":"2023-10-09T08:14:39.478451+0000","last_became_active":"2023-10-09T08:14:39.472371+0000","last_became_peered":"2023-10-09T08:14:39.472371+0000","last_unstale":"2023-10-09T08:14:39.478451+0000","last_undegraded":"2023-10-09T08:14:39.478451+0000","last_fullsized":"2023-10-09T08:14:39.478451+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:30:45.182691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"193'1","reported_seq":11,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.488585+0000","last_change":"2023-10-09T08:14:38.464395+0000","last_active":"2023-10-09T08:14:39.488585+0000","last_peered":"2023-10-09T08:14:39.488585+0000","last_clean":"2023-10-09T08:14:39.488585+0000","last_became_active":"2023-10-09T08:14:38.463853+0000","last_became_peered":"2023-10-09T08:14:38.463853+0000","last_unstale":"2023-10-09T08:14:39.488585+0000","last_undegraded":"2023-10-09T08:14:39.488585+0000","last_fullsized":"2023-10-09T08:14:39.488585+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:53.027373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.475117+0000","last_change":"2023-10-09T08:14:39.470353+0000","last_active":"2023-10-09T08:14:39.475117+0000","last_peered":"2023-10-09T08:14:39.475117+0000","last_clean":"2023-10-09T08:14:39.475117+0000","last_became_active":"2023-10-09T08:14:39.470030+0000","last_became_peered":"2023-10-09T08:14:39.470030+0000","last_unstale":"2023-10-09T08:14:39.475117+0000","last_undegraded":"2023-10-09T08:14:39.475117+0000","last_fullsized":"2023-10-09T08:14:39.475117+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:11.741936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"193'2","reported_seq":12,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.487326+0000","last_change":"2023-10-09T08:14:38.463880+0000","last_active":"2023-10-09T08:14:39.487326+0000","last_peered":"2023-10-09T08:14:39.487326+0000","last_clean":"2023-10-09T08:14:39.487326+0000","last_became_active":"2023-10-09T08:14:38.463564+0000","last_became_peered":"2023-10-09T08:14:38.463564+0000","last_unstale":"2023-10-09T08:14:39.487326+0000","last_undegraded":"2023-10-09T08:14:39.487326+0000","last_fullsized":"2023-10-09T08:14:39.487326+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:49:23.713246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478319+0000","last_change":"2023-10-09T08:14:39.473804+0000","last_active":"2023-10-09T08:14:39.478319+0000","last_peered":"2023-10-09T08:14:39.478319+0000","last_clean":"2023-10-09T08:14:39.478319+0000","last_became_active":"2023-10-09T08:14:39.473537+0000","last_became_peered":"2023-10-09T08:14:39.473537+0000","last_unstale":"2023-10-09T08:14:39.478319+0000","last_undegraded":"2023-10-09T08:14:39.478319+0000","last_fullsized":"2023-10-09T08:14:39.478319+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:12:23.337933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"193'1","reported_seq":11,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.494014+0000","last_change":"2023-10-09T08:14:38.454927+0000","last_active":"2023-10-09T08:14:39.494014+0000","last_peered":"2023-10-09T08:14:39.494014+0000","last_clean":"2023-10-09T08:14:39.494014+0000","last_became_active":"2023-10-09T08:14:38.454658+0000","last_became_peered":"2023-10-09T08:14:38.454658+0000","last_unstale":"2023-10-09T08:14:39.494014+0000","last_undegraded":"2023-10-09T08:14:39.494014+0000","last_fullsized":"2023-10-09T08:14:39.494014+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:33:36.559884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.482797+0000","last_change":"2023-10-09T08:14:39.481020+0000","last_active":"2023-10-09T08:14:39.482797+0000","last_peered":"2023-10-09T08:14:39.482797+0000","last_clean":"2023-10-09T08:14:39.482797+0000","last_became_active":"2023-10-09T08:14:39.480773+0000","last_became_peered":"2023-10-09T08:14:39.480773+0000","last_unstale":"2023-10-09T08:14:39.482797+0000","last_undegraded":"2023-10-09T08:14:39.482797+0000","last_fullsized":"2023-10-09T08:14:39.482797+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:52.883026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.465016+0000","last_change":"2023-10-09T08:14:38.449804+0000","last_active":"2023-10-09T08:14:39.465016+0000","last_peered":"2023-10-09T08:14:39.465016+0000","last_clean":"2023-10-09T08:14:39.465016+0000","last_became_active":"2023-10-09T08:14:38.449525+0000","last_became_peered":"2023-10-09T08:14:38.449525+0000","last_unstale":"2023-10-09T08:14:39.465016+0000","last_undegraded":"2023-10-09T08:14:39.465016+0000","last_fullsized":"2023-10-09T08:14:39.465016+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:42:28.181427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.473936+0000","last_change":"2023-10-09T08:14:39.468531+0000","last_active":"2023-10-09T08:14:39.473936+0000","last_peered":"2023-10-09T08:14:39.473936+0000","last_clean":"2023-10-09T08:14:39.473936+0000","last_became_active":"2023-10-09T08:14:39.468083+0000","last_became_peered":"2023-10-09T08:14:39.468083+0000","last_unstale":"2023-10-09T08:14:39.473936+0000","last_undegraded":"2023-10-09T08:14:39.473936+0000","last_fullsized":"2023-10-09T08:14:39.473936+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:47:44.078610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"193'2","reported_seq":12,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.489089+0000","last_change":"2023-10-09T08:14:38.457238+0000","last_active":"2023-10-09T08:14:39.489089+0000","last_peered":"2023-10-09T08:14:39.489089+0000","last_clean":"2023-10-09T08:14:39.489089+0000","last_became_active":"2023-10-09T08:14:38.456976+0000","last_became_peered":"2023-10-09T08:14:38.456976+0000","last_unstale":"2023-10-09T08:14:39.489089+0000","last_undegraded":"2023-10-09T08:14:39.489089+0000","last_fullsized":"2023-10-09T08:14:39.489089+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:01.561989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.482848+0000","last_change":"2023-10-09T08:14:39.477525+0000","last_active":"2023-10-09T08:14:39.482848+0000","last_peered":"2023-10-09T08:14:39.482848+0000","last_clean":"2023-10-09T08:14:39.482848+0000","last_became_active":"2023-10-09T08:14:39.477264+0000","last_became_peered":"2023-10-09T08:14:39.477264+0000","last_unstale":"2023-10-09T08:14:39.482848+0000","last_undegraded":"2023-10-09T08:14:39.482848+0000","last_fullsized":"2023-10-09T08:14:39.482848+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:11.301814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.464301+0000","last_change":"2023-10-09T08:14:38.454293+0000","last_active":"2023-10-09T08:14:39.464301+0000","last_peered":"2023-10-09T08:14:39.464301+0000","last_clean":"2023-10-09T08:14:39.464301+0000","last_became_active":"2023-10-09T08:14:38.453970+0000","last_became_peered":"2023-10-09T08:14:38.453970+0000","last_unstale":"2023-10-09T08:14:39.464301+0000","last_undegraded":"2023-10-09T08:14:39.464301+0000","last_fullsized":"2023-10-09T08:14:39.464301+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:10.748478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481977+0000","last_change":"2023-10-09T08:14:39.480148+0000","last_active":"2023-10-09T08:14:39.481977+0000","last_peered":"2023-10-09T08:14:39.481977+0000","last_clean":"2023-10-09T08:14:39.481977+0000","last_became_active":"2023-10-09T08:14:39.479903+0000","last_became_peered":"2023-10-09T08:14:39.479903+0000","last_unstale":"2023-10-09T08:14:39.481977+0000","last_undegraded":"2023-10-09T08:14:39.481977+0000","last_fullsized":"2023-10-09T08:14:39.481977+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:41:47.263574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.466709+0000","last_change":"2023-10-09T08:14:38.465408+0000","last_active":"2023-10-09T08:14:39.466709+0000","last_peered":"2023-10-09T08:14:39.466709+0000","last_clean":"2023-10-09T08:14:39.466709+0000","last_became_active":"2023-10-09T08:14:38.465095+0000","last_became_peered":"2023-10-09T08:14:38.465095+0000","last_unstale":"2023-10-09T08:14:39.466709+0000","last_undegraded":"2023-10-09T08:14:39.466709+0000","last_fullsized":"2023-10-09T08:14:39.466709+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:53.027373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.483634+0000","last_change":"2023-10-09T08:14:39.480318+0000","last_active":"2023-10-09T08:14:39.483634+0000","last_peered":"2023-10-09T08:14:39.483634+0000","last_clean":"2023-10-09T08:14:39.483634+0000","last_became_active":"2023-10-09T08:14:39.479561+0000","last_became_peered":"2023-10-09T08:14:39.479561+0000","last_unstale":"2023-10-09T08:14:39.483634+0000","last_undegraded":"2023-10-09T08:14:39.483634+0000","last_fullsized":"2023-10-09T08:14:39.483634+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:33.890868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.466046+0000","last_change":"2023-10-09T08:14:38.456540+0000","last_active":"2023-10-09T08:14:39.466046+0000","last_peered":"2023-10-09T08:14:39.466046+0000","last_clean":"2023-10-09T08:14:39.466046+0000","last_became_active":"2023-10-09T08:14:38.456221+0000","last_became_peered":"2023-10-09T08:14:38.456221+0000","last_unstale":"2023-10-09T08:14:39.466046+0000","last_undegraded":"2023-10-09T08:14:39.466046+0000","last_fullsized":"2023-10-09T08:14:39.466046+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:26.714576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478577+0000","last_change":"2023-10-09T08:14:39.471342+0000","last_active":"2023-10-09T08:14:39.478577+0000","last_peered":"2023-10-09T08:14:39.478577+0000","last_clean":"2023-10-09T08:14:39.478577+0000","last_became_active":"2023-10-09T08:14:39.471053+0000","last_became_peered":"2023-10-09T08:14:39.471053+0000","last_unstale":"2023-10-09T08:14:39.478577+0000","last_undegraded":"2023-10-09T08:14:39.478577+0000","last_fullsized":"2023-10-09T08:14:39.478577+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:45.577995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"193'2","reported_seq":12,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.491340+0000","last_change":"2023-10-09T08:14:38.460625+0000","last_active":"2023-10-09T08:14:39.491340+0000","last_peered":"2023-10-09T08:14:39.491340+0000","last_clean":"2023-10-09T08:14:39.491340+0000","last_became_active":"2023-10-09T08:14:38.460321+0000","last_became_peered":"2023-10-09T08:14:38.460321+0000","last_unstale":"2023-10-09T08:14:39.491340+0000","last_undegraded":"2023-10-09T08:14:39.491340+0000","last_fullsized":"2023-10-09T08:14:39.491340+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:16:28.154856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481580+0000","last_change":"2023-10-09T08:14:39.478657+0000","last_active":"2023-10-09T08:14:39.481580+0000","last_peered":"2023-10-09T08:14:39.481580+0000","last_clean":"2023-10-09T08:14:39.481580+0000","last_became_active":"2023-10-09T08:14:39.478402+0000","last_became_peered":"2023-10-09T08:14:39.478402+0000","last_unstale":"2023-10-09T08:14:39.481580+0000","last_undegraded":"2023-10-09T08:14:39.481580+0000","last_fullsized":"2023-10-09T08:14:39.481580+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:34.938944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.458027+0000","last_change":"2023-10-09T08:14:38.461920+0000","last_active":"2023-10-09T08:14:39.458027+0000","last_peered":"2023-10-09T08:14:39.458027+0000","last_clean":"2023-10-09T08:14:39.458027+0000","last_became_active":"2023-10-09T08:14:38.461619+0000","last_became_peered":"2023-10-09T08:14:38.461619+0000","last_unstale":"2023-10-09T08:14:39.458027+0000","last_undegraded":"2023-10-09T08:14:39.458027+0000","last_fullsized":"2023-10-09T08:14:39.458027+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:40.728510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.485101+0000","last_change":"2023-10-09T08:14:39.483531+0000","last_active":"2023-10-09T08:14:39.485101+0000","last_peered":"2023-10-09T08:14:39.485101+0000","last_clean":"2023-10-09T08:14:39.485101+0000","last_became_active":"2023-10-09T08:14:39.483236+0000","last_became_peered":"2023-10-09T08:14:39.483236+0000","last_unstale":"2023-10-09T08:14:39.485101+0000","last_undegraded":"2023-10-09T08:14:39.485101+0000","last_fullsized":"2023-10-09T08:14:39.485101+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:54:22.665528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.466862+0000","last_change":"2023-10-09T08:14:38.461191+0000","last_active":"2023-10-09T08:14:39.466862+0000","last_peered":"2023-10-09T08:14:39.466862+0000","last_clean":"2023-10-09T08:14:39.466862+0000","last_became_active":"2023-10-09T08:14:38.460271+0000","last_became_peered":"2023-10-09T08:14:38.460271+0000","last_unstale":"2023-10-09T08:14:39.466862+0000","last_undegraded":"2023-10-09T08:14:39.466862+0000","last_fullsized":"2023-10-09T08:14:39.466862+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:33:52.074768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.472812+0000","last_change":"2023-10-09T08:14:39.468512+0000","last_active":"2023-10-09T08:14:39.472812+0000","last_peered":"2023-10-09T08:14:39.472812+0000","last_clean":"2023-10-09T08:14:39.472812+0000","last_became_active":"2023-10-09T08:14:39.468158+0000","last_became_peered":"2023-10-09T08:14:39.468158+0000","last_unstale":"2023-10-09T08:14:39.472812+0000","last_undegraded":"2023-10-09T08:14:39.472812+0000","last_fullsized":"2023-10-09T08:14:39.472812+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:04.566842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.458202+0000","last_change":"2023-10-09T08:14:38.464753+0000","last_active":"2023-10-09T08:14:39.458202+0000","last_peered":"2023-10-09T08:14:39.458202+0000","last_clean":"2023-10-09T08:14:39.458202+0000","last_became_active":"2023-10-09T08:14:38.464494+0000","last_became_peered":"2023-10-09T08:14:38.464494+0000","last_unstale":"2023-10-09T08:14:39.458202+0000","last_undegraded":"2023-10-09T08:14:39.458202+0000","last_fullsized":"2023-10-09T08:14:39.458202+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:03.238219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.484321+0000","last_change":"2023-10-09T08:14:39.482147+0000","last_active":"2023-10-09T08:14:39.484321+0000","last_peered":"2023-10-09T08:14:39.484321+0000","last_clean":"2023-10-09T08:14:39.484321+0000","last_became_active":"2023-10-09T08:14:39.481901+0000","last_became_peered":"2023-10-09T08:14:39.481901+0000","last_unstale":"2023-10-09T08:14:39.484321+0000","last_undegraded":"2023-10-09T08:14:39.484321+0000","last_fullsized":"2023-10-09T08:14:39.484321+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:30.483504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.457626+0000","last_change":"2023-10-09T08:14:38.454239+0000","last_active":"2023-10-09T08:14:39.457626+0000","last_peered":"2023-10-09T08:14:39.457626+0000","last_clean":"2023-10-09T08:14:39.457626+0000","last_became_active":"2023-10-09T08:14:38.453919+0000","last_became_peered":"2023-10-09T08:14:38.453919+0000","last_unstale":"2023-10-09T08:14:39.457626+0000","last_undegraded":"2023-10-09T08:14:39.457626+0000","last_fullsized":"2023-10-09T08:14:39.457626+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:41.345492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.485320+0000","last_change":"2023-10-09T08:14:39.477790+0000","last_active":"2023-10-09T08:14:39.485320+0000","last_peered":"2023-10-09T08:14:39.485320+0000","last_clean":"2023-10-09T08:14:39.485320+0000","last_became_active":"2023-10-09T08:14:39.477478+0000","last_became_peered":"2023-10-09T08:14:39.477478+0000","last_unstale":"2023-10-09T08:14:39.485320+0000","last_undegraded":"2023-10-09T08:14:39.485320+0000","last_fullsized":"2023-10-09T08:14:39.485320+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:40.417826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.466161+0000","last_change":"2023-10-09T08:14:38.454390+0000","last_active":"2023-10-09T08:14:39.466161+0000","last_peered":"2023-10-09T08:14:39.466161+0000","last_clean":"2023-10-09T08:14:39.466161+0000","last_became_active":"2023-10-09T08:14:38.453969+0000","last_became_peered":"2023-10-09T08:14:38.453969+0000","last_unstale":"2023-10-09T08:14:39.466161+0000","last_undegraded":"2023-10-09T08:14:39.466161+0000","last_fullsized":"2023-10-09T08:14:39.466161+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:45.680499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481621+0000","last_change":"2023-10-09T08:14:39.477716+0000","last_active":"2023-10-09T08:14:39.481621+0000","last_peered":"2023-10-09T08:14:39.481621+0000","last_clean":"2023-10-09T08:14:39.481621+0000","last_became_active":"2023-10-09T08:14:39.477119+0000","last_became_peered":"2023-10-09T08:14:39.477119+0000","last_unstale":"2023-10-09T08:14:39.481621+0000","last_undegraded":"2023-10-09T08:14:39.481621+0000","last_fullsized":"2023-10-09T08:14:39.481621+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:47.340414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.466524+0000","last_change":"2023-10-09T08:14:38.459421+0000","last_active":"2023-10-09T08:14:39.466524+0000","last_peered":"2023-10-09T08:14:39.466524+0000","last_clean":"2023-10-09T08:14:39.466524+0000","last_became_active":"2023-10-09T08:14:38.457579+0000","last_became_peered":"2023-10-09T08:14:38.457579+0000","last_unstale":"2023-10-09T08:14:39.466524+0000","last_undegraded":"2023-10-09T08:14:39.466524+0000","last_fullsized":"2023-10-09T08:14:39.466524+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:01.351188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.481595+0000","last_change":"2023-10-09T08:14:39.477514+0000","last_active":"2023-10-09T08:14:39.481595+0000","last_peered":"2023-10-09T08:14:39.481595+0000","last_clean":"2023-10-09T08:14:39.481595+0000","last_became_active":"2023-10-09T08:14:39.476723+0000","last_became_peered":"2023-10-09T08:14:39.476723+0000","last_unstale":"2023-10-09T08:14:39.481595+0000","last_undegraded":"2023-10-09T08:14:39.481595+0000","last_fullsized":"2023-10-09T08:14:39.481595+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:43:57.610820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.457984+0000","last_change":"2023-10-09T08:14:38.451833+0000","last_active":"2023-10-09T08:14:39.457984+0000","last_peered":"2023-10-09T08:14:39.457984+0000","last_clean":"2023-10-09T08:14:39.457984+0000","last_became_active":"2023-10-09T08:14:38.451494+0000","last_became_peered":"2023-10-09T08:14:38.451494+0000","last_unstale":"2023-10-09T08:14:39.457984+0000","last_undegraded":"2023-10-09T08:14:39.457984+0000","last_fullsized":"2023-10-09T08:14:39.457984+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:41.044164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.478617+0000","last_change":"2023-10-09T08:14:39.472193+0000","last_active":"2023-10-09T08:14:39.478617+0000","last_peered":"2023-10-09T08:14:39.478617+0000","last_clean":"2023-10-09T08:14:39.478617+0000","last_became_active":"2023-10-09T08:14:39.471886+0000","last_became_peered":"2023-10-09T08:14:39.471886+0000","last_unstale":"2023-10-09T08:14:39.478617+0000","last_undegraded":"2023-10-09T08:14:39.478617+0000","last_fullsized":"2023-10-09T08:14:39.478617+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:38.432444+0000","last_clean_scrub_stamp":"2023-10-09T08:14:38.432444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:02:07.699719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.458291+0000","last_change":"2023-10-09T08:14:38.452713+0000","last_active":"2023-10-09T08:14:39.458291+0000","last_peered":"2023-10-09T08:14:39.458291+0000","last_clean":"2023-10-09T08:14:39.458291+0000","last_became_active":"2023-10-09T08:14:38.452366+0000","last_became_peered":"2023-10-09T08:14:38.452366+0000","last_unstale":"2023-10-09T08:14:39.458291+0000","last_undegraded":"2023-10-09T08:14:39.458291+0000","last_fullsized":"2023-10-09T08:14:39.458291+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:14:37.426794+0000","last_clean_scrub_stamp":"2023-10-09T08:14:37.426794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:03.250581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"183'326","reported_seq":1052,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-10-09T08:14:39.466136+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T08:14:39.466136+0000","last_peered":"2023-10-09T08:14:39.466136+0000","last_clean":"2023-10-09T08:14:39.466136+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T08:14:39.466136+0000","last_undegraded":"2023-10-09T08:14:39.466136+0000","last_fullsized":"2023-10-09T08:14:39.466136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575944,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312548,"kb_used_data":2972,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059292,"statfs":{"total":96636764160,"available":96316715008,"internally_reserved":0,"allocated":3043328,"data_stored":1813297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.748,"15min":0.755},"min":{"1min":0.49199999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97699999999999998,"5min":1.002,"15min":1.1220000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.755,"15min":0.751},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.44500000000000001},"max":{"1min":1.0069999999999999,"5min":1.0129999999999999,"15min":1.0209999999999999},"last":0.91900000000000004}]},{"osd":1,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.746,"15min":0.746},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":1.024},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.747,"15min":0.751},"min":{"1min":0.503,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.01}]},{"osd":2,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.752,"15min":0.753},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.77300000000000002,"15min":0.77400000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.442},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.86499999999999999}]},{"osd":3,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.755,"15min":0.74199999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.47999999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.78200000000000003,"15min":0.78000000000000003},"min":{"1min":0.61499999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.97999999999999998}]},{"osd":4,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.624,"15min":0.60899999999999999},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.38300000000000001},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.45500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.89400000000000002}]},{"osd":5,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.53400000000000003,"5min":0.41699999999999998,"15min":0.40100000000000002},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Mon Oct 9 08:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.75600000000000001,"15min":0.746},"min":{"1min":0.60499999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.72399999999999998,"15min":0.71399999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.70399999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575943,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316044,"kb_used_data":2372,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055796,"statfs":{"total":96636764160,"available":96313135104,"internally_reserved":0,"allocated":2428928,"data_stored":1220701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.749,"15min":0.753},"min":{"1min":0.46899999999999997,"5min":0.45900000000000002,"15min":0.40300000000000002},"max":{"1min":0.97799999999999998,"5min":0.99299999999999999,"15min":1.0449999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.44400000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94099999999999995,"5min":0.94499999999999995,"15min":0.97399999999999998},"last":0.623}]},{"osd":1,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.753,"15min":0.755},"min":{"1min":0.54700000000000004,"5min":0.499,"15min":0.38500000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77000000000000002,"15min":0.76300000000000001},"min":{"1min":0.59499999999999997,"5min":0.52800000000000002,"15min":0.47999999999999998},"max":{"1min":1.018,"5min":1.0269999999999999,"15min":1.097},"last":0.58399999999999996}]},{"osd":2,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.46400000000000002},"max":{"1min":1.004,"5min":1.0109999999999999,"15min":1.0329999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77200000000000002,"15min":0.77800000000000002},"min":{"1min":0.52300000000000002,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0660000000000001},"last":0.73999999999999999}]},{"osd":3,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.54300000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.004,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.61599999999999999,"5min":0.51100000000000001,"15min":0.49299999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0680000000000001},"last":0.60399999999999998}]},{"osd":4,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.40600000000000003,"15min":0.40200000000000002},"max":{"1min":0.92000000000000004,"5min":1.032,"15min":1.1339999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.44800000000000001,"5min":0.39700000000000002,"15min":0.32000000000000001},"max":{"1min":0.82699999999999996,"5min":0.91900000000000004,"15min":0.97099999999999997},"last":0.65500000000000003}]},{"osd":5,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.40100000000000002},"max":{"1min":0.90900000000000003,"5min":0.93400000000000005,"15min":0.98899999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.45200000000000001},"max":{"1min":0.97599999999999998,"5min":1.0880000000000001,"15min":1.121},"last":0.66900000000000004}]},{"osd":7,"last update":"Mon Oct 9 08:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70199999999999996,"15min":0.69699999999999995},"min":{"1min":0.49399999999999999,"5min":0.45600000000000002,"15min":0.36299999999999999},"max":{"1min":0.93200000000000005,"5min":0.98699999999999999,"15min":1.0309999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.75800000000000001,"15min":0.74299999999999999},"min":{"1min":0.54400000000000004,"5min":0.48699999999999999,"15min":0.442},"max":{"1min":0.95599999999999996,"5min":0.96799999999999997,"15min":1.139},"last":0.72499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575944,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307852,"kb_used_data":2372,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063988,"statfs":{"total":96636764160,"available":96321523712,"internally_reserved":0,"allocated":2428928,"data_stored":1220713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45300000000000001,"15min":0.46000000000000002},"min":{"1min":0.34200000000000003,"5min":0.29799999999999999,"15min":0.28799999999999998},"max":{"1min":0.621,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.5},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52400000000000002,"15min":0.51500000000000001},"min":{"1min":0.39500000000000002,"5min":0.34899999999999998,"15min":0.32400000000000001},"max":{"1min":0.66300000000000003,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.379}]},{"osd":2,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.51200000000000001},"min":{"1min":0.379,"5min":0.34200000000000003,"15min":0.318},"max":{"1min":0.624,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.58999999999999997},"min":{"1min":0.44900000000000001,"5min":0.433,"15min":0.39500000000000002},"max":{"1min":0.69899999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.56399999999999995}]},{"osd":3,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.505,"5min":0.42699999999999999,"15min":0.41099999999999998},"max":{"1min":0.76800000000000002,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.51200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76100000000000001,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.53700000000000003}]},{"osd":4,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.76000000000000001,"15min":0.78500000000000003},"min":{"1min":0.64400000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.125,"5min":1.125,"15min":1.224},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.81200000000000006,"15min":0.80300000000000005},"min":{"1min":0.61199999999999999,"5min":0.55800000000000005,"15min":0.51800000000000002},"max":{"1min":1.071,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.028}]},{"osd":5,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.65000000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0940000000000001,"5min":1.77,"15min":1.77},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.876,"5min":0.79300000000000004,"15min":0.81200000000000006},"min":{"1min":0.65600000000000003,"5min":0.56100000000000005,"15min":0.49299999999999999},"max":{"1min":1.054,"5min":1.0569999999999999,"15min":1.288},"last":1.0089999999999999}]},{"osd":6,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.83399999999999996,"15min":0.82399999999999995},"min":{"1min":0.69499999999999995,"5min":0.57199999999999995,"15min":0.505},"max":{"1min":1.143,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.85699999999999998,"15min":0.84099999999999997},"min":{"1min":0.59999999999999998,"5min":0.57499999999999996,"15min":0.53800000000000003},"max":{"1min":1.105,"5min":1.843,"15min":1.843},"last":0.80600000000000005}]},{"osd":7,"last update":"Mon Oct 9 08:13:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.876,"15min":0.86499999999999999},"min":{"1min":0.748,"5min":0.64000000000000001,"15min":0.58599999999999997},"max":{"1min":1.135,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.874},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.85399999999999998,"15min":0.85299999999999998},"min":{"1min":0.65700000000000003,"5min":0.61799999999999999,"15min":0.54300000000000004},"max":{"1min":1.1659999999999999,"5min":1.21,"15min":1.347},"last":0.96799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575943,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308428,"kb_used_data":2948,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063412,"statfs":{"total":96636764160,"available":96320933888,"internally_reserved":0,"allocated":3018752,"data_stored":1811047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48999999999999999,"15min":0.48499999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.29199999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.34899999999999998,"5min":0.34599999999999997,"15min":0.318},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.92300000000000004},"last":0.33500000000000002}]},{"osd":2,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57699999999999996,"15min":0.58399999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.36499999999999999,"5min":0.35999999999999999,"15min":0.34499999999999997},"max":{"1min":0.70499999999999996,"5min":0.77300000000000002,"15min":0.81999999999999995},"last":0.39700000000000002}]},{"osd":3,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.35099999999999998},"max":{"1min":0.78200000000000003,"5min":0.79400000000000004,"15min":0.80500000000000005},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60999999999999999,"15min":0.621},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.93200000000000005},"last":0.51800000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81200000000000006,"15min":0.78800000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.42899999999999999},"max":{"1min":0.98299999999999998,"5min":1.226,"15min":1.232},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57699999999999996,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0649999999999999,"5min":1.196,"15min":1.23},"last":0.61399999999999999}]},{"osd":5,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.82199999999999995,"15min":0.81499999999999995},"min":{"1min":0.60599999999999998,"5min":0.57299999999999995,"15min":0.501},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.262},"last":0.621},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.83099999999999996,"15min":0.82299999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.52100000000000002},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.79600000000000004}]},{"osd":6,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.86099999999999999,"15min":0.85199999999999998},"min":{"1min":0.64600000000000002,"5min":0.59599999999999997,"15min":0.58899999999999997},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.747},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83299999999999996,"15min":0.83099999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0920000000000001,"5min":1.24,"15min":1.3029999999999999},"last":0.58999999999999997}]},{"osd":7,"last update":"Mon Oct 9 08:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.86099999999999999,"15min":0.86499999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2370000000000001,"5min":1.2929999999999999,"15min":1.3540000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.88700000000000001,"15min":0.88200000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.58199999999999996},"max":{"1min":1.085,"5min":1.1519999999999999,"15min":1.3380000000000001},"last":0.66200000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575943,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316044,"kb_used_data":2372,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055796,"statfs":{"total":96636764160,"available":96313135104,"internally_reserved":0,"allocated":2428928,"data_stored":1220769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.47199999999999998,"15min":0.46500000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64500000000000002,"5min":0.71099999999999997,"15min":0.752},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.501,"15min":0.504},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64800000000000002,"5min":0.73299999999999998,"15min":0.82899999999999996},"last":0.48099999999999998}]},{"osd":1,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.499,"15min":0.495},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.33700000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55100000000000005,"15min":0.54200000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34699999999999998},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.40699999999999997}]},{"osd":3,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39200000000000002},"max":{"1min":0.89000000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.442},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64000000000000001,"15min":0.63900000000000001},"min":{"1min":0.47899999999999998,"5min":0.43099999999999999,"15min":0.38100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.94199999999999995},"last":0.46899999999999997}]},{"osd":4,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.80800000000000005,"15min":0.80900000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":0.96699999999999997,"5min":1.089,"15min":1.089},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.80200000000000005,"15min":0.79600000000000004},"min":{"1min":0.61699999999999999,"5min":0.54200000000000004,"15min":0.48399999999999999},"max":{"1min":1.107,"5min":1.133,"15min":1.1399999999999999},"last":1.0700000000000001}]},{"osd":5,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82499999999999996,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.51800000000000002},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":1.022},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.82799999999999996,"15min":0.82599999999999996},"min":{"1min":0.60199999999999998,"5min":0.54700000000000004,"15min":0.47799999999999998},"max":{"1min":1.052,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.98699999999999999}]},{"osd":6,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.84099999999999997,"15min":0.82799999999999996},"min":{"1min":0.57999999999999996,"5min":0.56299999999999994,"15min":0.52700000000000002},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.163},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.83899999999999997,"15min":0.83299999999999996},"min":{"1min":0.59399999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1020000000000001,"5min":1.109,"15min":1.224},"last":1.103}]},{"osd":7,"last update":"Mon Oct 9 08:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86599999999999999,"15min":0.85899999999999999},"min":{"1min":0.66700000000000004,"5min":0.60199999999999998,"15min":0.47899999999999998},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.198},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":1.157}]}]},{"osd":3,"up_from":13,"seq":55834575944,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2372,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2428928,"data_stored":1220713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47599999999999998,"15min":0.48999999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.30599999999999999},"max":{"1min":0.65800000000000003,"5min":0.68799999999999994,"15min":0.85999999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.5,"15min":0.51000000000000001},"min":{"1min":0.33900000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.79600000000000004},"last":0.53800000000000003}]},{"osd":1,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52100000000000002,"15min":0.51300000000000001},"min":{"1min":0.38300000000000001,"5min":0.34599999999999997,"15min":0.34300000000000003},"max":{"1min":0.70999999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.374},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59299999999999997,"15min":0.58099999999999996},"min":{"1min":0.439,"5min":0.43099999999999999,"15min":0.378},"max":{"1min":0.84999999999999998,"5min":0.85999999999999999,"15min":0.91300000000000003},"last":0.47399999999999998}]},{"osd":2,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.49199999999999999,"5min":0.41599999999999998,"15min":0.40400000000000003},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.97299999999999998},"last":0.443},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66100000000000003,"15min":0.66400000000000003},"min":{"1min":0.54000000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82299999999999995,"5min":0.879,"15min":1.036},"last":0.51500000000000001}]},{"osd":4,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78300000000000003,"15min":0.78100000000000003},"min":{"1min":0.56599999999999995,"5min":0.54100000000000004,"15min":0.46000000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.872,"5min":0.86599999999999999,"15min":0.871},"min":{"1min":0.69999999999999996,"5min":0.69899999999999995,"15min":0.66000000000000003},"max":{"1min":1.0629999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.60499999999999998}]},{"osd":5,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76900000000000002,"15min":0.77500000000000002},"min":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.47399999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.24},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.84199999999999997,"15min":0.83999999999999997},"min":{"1min":0.69099999999999995,"5min":0.66100000000000003,"15min":0.56899999999999995},"max":{"1min":0.996,"5min":1.1719999999999999,"15min":1.1739999999999999},"last":0.57599999999999996}]},{"osd":6,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79500000000000004,"15min":0.80600000000000005},"min":{"1min":0.623,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.099,"5min":1.099,"15min":1.206},"last":0.87},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.81200000000000006,"15min":0.81899999999999995},"min":{"1min":0.66900000000000004,"5min":0.56100000000000005,"15min":0.54800000000000004},"max":{"1min":1.0629999999999999,"5min":1.1339999999999999,"15min":1.1870000000000001},"last":0.73799999999999999}]},{"osd":7,"last update":"Mon Oct 9 08:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.85699999999999998,"15min":0.85999999999999999},"min":{"1min":0.70199999999999996,"5min":0.623,"15min":0.53700000000000003},"max":{"1min":1.0800000000000001,"5min":1.1839999999999999,"15min":1.3280000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.85399999999999998,"15min":0.85999999999999999},"min":{"1min":0.64400000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.147,"5min":1.1639999999999999,"15min":1.2869999999999999},"last":0.83399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575943,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299672,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072168,"statfs":{"total":96636764160,"available":96329900032,"internally_reserved":0,"allocated":2441216,"data_stored":1222285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73099999999999998,"15min":0.72999999999999998},"min":{"1min":0.60399999999999998,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":0.94799999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.745,"15min":0.74399999999999999},"min":{"1min":0.51300000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.755}]},{"osd":1,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.73299999999999998,"15min":0.72699999999999998},"min":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.51000000000000001},"max":{"1min":0.83499999999999996,"5min":1.03,"15min":1.03},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.53100000000000003,"5min":0.442,"15min":0.42799999999999999},"max":{"1min":0.97299999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.95799999999999996}]},{"osd":2,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81200000000000006,"15min":0.79900000000000004},"min":{"1min":0.65300000000000002,"5min":0.51400000000000001,"15min":0.45000000000000001},"max":{"1min":0.99399999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.81399999999999995,"15min":0.81000000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.47999999999999998},"max":{"1min":0.95699999999999996,"5min":1.077,"15min":1.077},"last":0.58299999999999996}]},{"osd":3,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.754,"15min":0.748},"min":{"1min":0.57799999999999996,"5min":0.51500000000000001,"15min":0.45900000000000002},"max":{"1min":0.92000000000000004,"5min":1.016,"15min":1.018},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.76900000000000002,"15min":0.77200000000000002},"min":{"1min":0.57199999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.89700000000000002,"5min":1.036,"15min":1.036},"last":0.64700000000000002}]},{"osd":5,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.38800000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.83599999999999997,"5min":0.94899999999999995,"15min":1.006},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63100000000000001,"15min":0.63200000000000001},"min":{"1min":0.46899999999999997,"5min":0.42099999999999999,"15min":0.40100000000000002},"max":{"1min":0.94199999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.61299999999999999}]},{"osd":6,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64300000000000002,"15min":0.63400000000000001},"min":{"1min":0.47399999999999998,"5min":0.42399999999999999,"15min":0.42299999999999999},"max":{"1min":1.012,"5min":1.022,"15min":1.034},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67400000000000004,"15min":0.68200000000000005},"min":{"1min":0.48899999999999999,"5min":0.437,"15min":0.42999999999999999},"max":{"1min":0.96499999999999997,"5min":0.998,"15min":1.0609999999999999},"last":0.98399999999999999}]},{"osd":7,"last update":"Mon Oct 9 08:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.53400000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.0580000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.77700000000000002},"min":{"1min":0.61799999999999999,"5min":0.48499999999999999,"15min":0.443},"max":{"1min":1.056,"5min":1.0629999999999999,"15min":1.079},"last":0.877}]}]},{"osd":5,"up_from":13,"seq":55834575944,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316048,"kb_used_data":2376,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055792,"statfs":{"total":96636764160,"available":96313131008,"internally_reserved":0,"allocated":2433024,"data_stored":1221255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96999999999999997,"5min":0.998,"15min":1.0780000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71699999999999997,"15min":0.71799999999999997},"min":{"1min":0.51500000000000001,"5min":0.42999999999999999,"15min":0.40899999999999997},"max":{"1min":0.91100000000000003,"5min":0.97399999999999998,"15min":1.018},"last":0.69999999999999996}]},{"osd":1,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72299999999999998,"15min":0.72399999999999998},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90100000000000002,"5min":1.0129999999999999,"15min":1.1140000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.435},"max":{"1min":0.89800000000000002,"5min":1.0029999999999999,"15min":1.0169999999999999},"last":0.82599999999999996}]},{"osd":2,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.754,"15min":0.751},"min":{"1min":0.58799999999999997,"5min":0.499,"15min":0.48699999999999999},"max":{"1min":0.92200000000000004,"5min":1.115,"15min":1.115},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.48299999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99299999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.80900000000000005}]},{"osd":3,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.748},"min":{"1min":0.50900000000000001,"5min":0.49199999999999999,"15min":0.48299999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":1.0409999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.57799999999999996,"5min":0.54600000000000004,"15min":0.51500000000000001},"max":{"1min":0.95299999999999996,"5min":1.0189999999999999,"15min":1.0620000000000001},"last":0.73099999999999998}]},{"osd":4,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.38200000000000001},"max":{"1min":0.75700000000000001,"5min":0.96699999999999997,"15min":0.995},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60599999999999998,"15min":0.61099999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88500000000000001,"5min":0.94399999999999995,"15min":0.96599999999999997},"last":0.60599999999999998}]},{"osd":6,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93799999999999994,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.67900000000000005,"15min":0.67400000000000004},"min":{"1min":0.53300000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91500000000000004,"5min":0.97099999999999997,"15min":1.006},"last":0.755}]},{"osd":7,"last update":"Mon Oct 9 08:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69799999999999995,"15min":0.68899999999999995},"min":{"1min":0.55000000000000004,"5min":0.46999999999999997,"15min":0.44400000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.76700000000000002},"min":{"1min":0.58799999999999997,"5min":0.57299999999999995,"15min":0.48599999999999999},"max":{"1min":0.97099999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.83999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T08:14:49.065 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T08:14:49.065 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T08:14:49.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.287+0000 7ff39e9ff700 1 Processor -- start 2023-10-09T08:14:49.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.287+0000 7ff39e9ff700 1 -- start start 2023-10-09T08:14:49.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.289+0000 7ff39e9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff398156620 0x7ff3980c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:49.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.289+0000 7ff39e9ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff3981569f0 0x7ff3980ace70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:49.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.289+0000 7ff39e9ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3980ad3b0 con 0x7ff398068390 2023-10-09T08:14:49.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.289+0000 7ff39e9ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3980c8d30 con 0x7ff3981569f0 2023-10-09T08:14:49.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.289+0000 7ff39e9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39815a6f0 con 0x7ff398156620 2023-10-09T08:14:49.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.289+0000 7ff38ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff3981569f0 0x7ff3980ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:49.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.289+0000 7ff39cf9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff398068390 0x7ff39806da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44034/0 (socket says 172.21.15.71:44034) 2023-10-09T08:14:49.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.289+0000 7ff39cf9c700 1 -- 172.21.15.71:0/1171085929 learned_addr learned my addr 172.21.15.71:0/1171085929 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:49.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.289+0000 7ff397fff700 1 --2- 172.21.15.71:0/1171085929 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff398156620 0x7ff3980c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:49.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.289+0000 7ff38ffff700 1 -- 172.21.15.71:0/1171085929 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff398156620 msgr2=0x7ff3980c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:49.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.289+0000 7ff38ffff700 1 --2- 172.21.15.71:0/1171085929 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff398156620 0x7ff3980c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:49.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.290+0000 7ff38ffff700 1 -- 172.21.15.71:0/1171085929 >> v1:172.21.15.71:6789/0 conn(0x7ff398068390 legacy=0x7ff39806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:49.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.290+0000 7ff38ffff700 1 -- 172.21.15.71:0/1171085929 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39815a9d0 con 0x7ff3981569f0 2023-10-09T08:14:49.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.290+0000 7ff3977fe700 1 -- 172.21.15.71:0/1171085929 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106383020 0 0) 0x7ff3980ad3b0 con 0x7ff398068390 2023-10-09T08:14:49.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.290+0000 7ff38ffff700 1 --2- 172.21.15.71:0/1171085929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3981569f0 0x7ff3980ace70 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7ff3800098e0 tx=0x7ff3800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0f4987430c5aa0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:49.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.290+0000 7ff3977fe700 1 -- 172.21.15.71:0/1171085929 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38000b640 con 0x7ff3981569f0 2023-10-09T08:14:49.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.290+0000 7ff3977fe700 1 -- 172.21.15.71:0/1171085929 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38000b7a0 con 0x7ff3981569f0 2023-10-09T08:14:49.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.290+0000 7ff3977fe700 1 -- 172.21.15.71:0/1171085929 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38000bb40 con 0x7ff3981569f0 2023-10-09T08:14:49.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.291+0000 7ff39e9ff700 1 -- 172.21.15.71:0/1171085929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3981569f0 msgr2=0x7ff3980ace70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:49.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.291+0000 7ff39e9ff700 1 --2- 172.21.15.71:0/1171085929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3981569f0 0x7ff3980ace70 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7ff3800098e0 tx=0x7ff3800091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:49.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.291+0000 7ff39e9ff700 1 -- 172.21.15.71:0/1171085929 shutdown_connections 2023-10-09T08:14:49.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.291+0000 7ff39e9ff700 1 --2- 172.21.15.71:0/1171085929 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff398156620 0x7ff3980c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:49.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.291+0000 7ff39e9ff700 1 --2- 172.21.15.71:0/1171085929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3981569f0 0x7ff3980ace70 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:49.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.291+0000 7ff39e9ff700 1 -- 172.21.15.71:0/1171085929 >> 172.21.15.71:0/1171085929 conn(0x7ff3980cc540 msgr2=0x7ff3980cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:49.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.291+0000 7ff39e9ff700 1 -- 172.21.15.71:0/1171085929 shutdown_connections 2023-10-09T08:14:49.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.291+0000 7ff39e9ff700 1 -- 172.21.15.71:0/1171085929 wait complete. 2023-10-09T08:14:49.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.292+0000 7ff39e9ff700 1 Processor -- start 2023-10-09T08:14:49.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.292+0000 7ff39e9ff700 1 -- start start 2023-10-09T08:14:49.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.293+0000 7ff39e9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff398068390 0x7ff3980b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:49.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.293+0000 7ff39e9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff398156620 0x7ff39806dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:49.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.293+0000 7ff39e9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3981569f0 0x7ff39814f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:49.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.293+0000 7ff39e9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3981589c0 con 0x7ff3981569f0 2023-10-09T08:14:49.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.293+0000 7ff39e9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff398157d40 con 0x7ff398068390 2023-10-09T08:14:49.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.293+0000 7ff39e9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff398158020 con 0x7ff398156620 2023-10-09T08:14:49.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.293+0000 7ff39cf9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3981569f0 0x7ff39814f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:49.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.294+0000 7ff39cf9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3981569f0 0x7ff39814f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40124/0 (socket says 172.21.15.71:40124) 2023-10-09T08:14:49.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.294+0000 7ff39cf9c700 1 -- 172.21.15.71:0/2553152261 learned_addr learned my addr 172.21.15.71:0/2553152261 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:49.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.294+0000 7ff397fff700 1 --2- 172.21.15.71:0/2553152261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff398068390 0x7ff3980b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:49.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.294+0000 7ff38ffff700 1 --2- 172.21.15.71:0/2553152261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff398156620 0x7ff39806dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:49.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.294+0000 7ff39cf9c700 1 -- 172.21.15.71:0/2553152261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff398156620 msgr2=0x7ff39806dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:49.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.294+0000 7ff39cf9c700 1 --2- 172.21.15.71:0/2553152261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff398156620 0x7ff39806dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:49.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.294+0000 7ff39cf9c700 1 -- 172.21.15.71:0/2553152261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff398068390 msgr2=0x7ff3980b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:49.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.294+0000 7ff39cf9c700 1 --2- 172.21.15.71:0/2553152261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff398068390 0x7ff3980b0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:49.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.294+0000 7ff39cf9c700 1 -- 172.21.15.71:0/2553152261 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff380009420 con 0x7ff3981569f0 2023-10-09T08:14:49.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.294+0000 7ff39cf9c700 1 --2- 172.21.15.71:0/2553152261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3981569f0 0x7ff39814f690 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7ff39000cbf0 tx=0x7ff3900019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.294+0000 7ff394ff9700 1 -- 172.21.15.71:0/2553152261 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39000a8b0 con 0x7ff3981569f0 2023-10-09T08:14:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.295+0000 7ff394ff9700 1 -- 172.21.15.71:0/2553152261 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39000aa10 con 0x7ff3981569f0 2023-10-09T08:14:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.295+0000 7ff394ff9700 1 -- 172.21.15.71:0/2553152261 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39000add0 con 0x7ff3981569f0 2023-10-09T08:14:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.295+0000 7ff39e9ff700 1 -- 172.21.15.71:0/2553152261 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff398158300 con 0x7ff3981569f0 2023-10-09T08:14:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.295+0000 7ff39e9ff700 1 -- 172.21.15.71:0/2553152261 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3980b1530 con 0x7ff3981569f0 2023-10-09T08:14:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.296+0000 7ff39e9ff700 1 -- 172.21.15.71:0/2553152261 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff398158b00 con 0x7ff3981569f0 2023-10-09T08:14:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.296+0000 7ff394ff9700 1 -- 172.21.15.71:0/2553152261 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff390007300 con 0x7ff3981569f0 2023-10-09T08:14:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.297+0000 7ff394ff9700 1 --2- 172.21.15.71:0/2553152261 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff378066f30 0x7ff3780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.297+0000 7ff394ff9700 1 -- 172.21.15.71:0/2553152261 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6197+0+0 (secure 0 0 0) 0x7ff390084990 con 0x7ff3981569f0 2023-10-09T08:14:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.298+0000 7ff397fff700 1 --2- 172.21.15.71:0/2553152261 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff378066f30 0x7ff3780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.298+0000 7ff397fff700 1 --2- 172.21.15.71:0/2553152261 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff378066f30 0x7ff3780693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff388009db0 tx=0x7ff3880091a0 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:49.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.301+0000 7ff394ff9700 1 -- 172.21.15.71:0/2553152261 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff398158b00 con 0x7ff3981569f0 2023-10-09T08:14:49.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.566+0000 7ff39e9ff700 1 -- 172.21.15.71:0/2553152261 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff398158b00 con 0x7ff3981569f0 2023-10-09T08:14:49.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.570+0000 7ff394ff9700 1 -- 172.21.15.71:0/2553152261 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v49) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff398158b00 con 0x7ff3981569f0 2023-10-09T08:14:49.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.573+0000 7ff39e9ff700 1 -- 172.21.15.71:0/2553152261 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff378066f30 msgr2=0x7ff3780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:49.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.573+0000 7ff39e9ff700 1 --2- 172.21.15.71:0/2553152261 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff378066f30 0x7ff3780693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff388009db0 tx=0x7ff3880091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:49.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.573+0000 7ff39e9ff700 1 -- 172.21.15.71:0/2553152261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3981569f0 msgr2=0x7ff39814f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:49.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.573+0000 7ff39e9ff700 1 --2- 172.21.15.71:0/2553152261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3981569f0 0x7ff39814f690 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7ff39000cbf0 tx=0x7ff3900019b0 comp rx=0 tx=0).stop 2023-10-09T08:14:49.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.573+0000 7ff39e9ff700 1 -- 172.21.15.71:0/2553152261 shutdown_connections 2023-10-09T08:14:49.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.573+0000 7ff39e9ff700 1 --2- 172.21.15.71:0/2553152261 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff378066f30 0x7ff3780693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:49.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.573+0000 7ff39e9ff700 1 --2- 172.21.15.71:0/2553152261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3981569f0 0x7ff39814f690 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:49.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.573+0000 7ff39e9ff700 1 --2- 172.21.15.71:0/2553152261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff398068390 0x7ff3980b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:49.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.573+0000 7ff39e9ff700 1 --2- 172.21.15.71:0/2553152261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff398156620 0x7ff39806dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:49.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.573+0000 7ff39e9ff700 1 -- 172.21.15.71:0/2553152261 >> 172.21.15.71:0/2553152261 conn(0x7ff3980cc540 msgr2=0x7ff398068970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:49.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.573+0000 7ff39e9ff700 1 -- 172.21.15.71:0/2553152261 shutdown_connections 2023-10-09T08:14:49.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.573+0000 7ff39e9ff700 1 -- 172.21.15.71:0/2553152261 wait complete. 2023-10-09T08:14:49.577 INFO:teuthology.orchestra.run.smithi071.stderr:updated caps for client.0 2023-10-09T08:14:49.590 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T08:14:49.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.772+0000 7fc7e59ff700 1 Processor -- start 2023-10-09T08:14:49.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.772+0000 7fc7e59ff700 1 -- start start 2023-10-09T08:14:49.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.774+0000 7fc7e59ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc7e00b1850 0x7fc7e00b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:49.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.774+0000 7fc7e59ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc7e01579f0 0x7fc7e00abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:49.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.774+0000 7fc7e59ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e00cb300 con 0x7fc7e00ae680 2023-10-09T08:14:49.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.774+0000 7fc7e59ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e006fc30 con 0x7fc7e01579f0 2023-10-09T08:14:49.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.774+0000 7fc7e59ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e00cc260 con 0x7fc7e00b1850 2023-10-09T08:14:49.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.774+0000 7fc7df7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc7e01579f0 0x7fc7e00abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:49.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.774+0000 7fc7df7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc7e01579f0 0x7fc7e00abf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40134/0 (socket says 172.21.15.71:40134) 2023-10-09T08:14:49.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.774+0000 7fc7df7fe700 1 -- 172.21.15.71:0/1227685904 learned_addr learned my addr 172.21.15.71:0/1227685904 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:49.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.774+0000 7fc7deffd700 1 --2- 172.21.15.71:0/1227685904 >> v2:172.21.15.179:3300/0 conn(0x7fc7e00b1850 0x7fc7e00b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:49.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.774+0000 7fc7df7fe700 1 -- 172.21.15.71:0/1227685904 >> v2:172.21.15.179:3300/0 conn(0x7fc7e00b1850 msgr2=0x7fc7e00b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:49.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.774+0000 7fc7df7fe700 1 --2- 172.21.15.71:0/1227685904 >> v2:172.21.15.179:3300/0 conn(0x7fc7e00b1850 0x7fc7e00b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:49.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.774+0000 7fc7df7fe700 1 -- 172.21.15.71:0/1227685904 >> v1:172.21.15.179:6789/0 conn(0x7fc7e00ae680 legacy=0x7fc7e01572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:49.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.774+0000 7fc7df7fe700 1 -- 172.21.15.71:0/1227685904 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e00cb5e0 con 0x7fc7e01579f0 2023-10-09T08:14:49.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.774+0000 7fc7deffd700 1 --2- 172.21.15.71:0/1227685904 >> v2:172.21.15.179:3300/0 conn(0x7fc7e00b1850 0x7fc7e00b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:14:49.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.775+0000 7fc7df7fe700 1 --2- 172.21.15.71:0/1227685904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7e01579f0 0x7fc7e00abf60 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00641e0 tx=0x7fc7d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e459459bb3b4f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:49.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.775+0000 7fc7ddffb700 1 -- 172.21.15.71:0/1227685904 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d800e070 con 0x7fc7e01579f0 2023-10-09T08:14:49.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.775+0000 7fc7ddffb700 1 -- 172.21.15.71:0/1227685904 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d800ba10 con 0x7fc7e01579f0 2023-10-09T08:14:49.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.775+0000 7fc7ddffb700 1 -- 172.21.15.71:0/1227685904 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d80092e0 con 0x7fc7e01579f0 2023-10-09T08:14:49.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.775+0000 7fc7e59ff700 1 -- 172.21.15.71:0/1227685904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7e01579f0 msgr2=0x7fc7e00abf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:49.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.775+0000 7fc7e59ff700 1 --2- 172.21.15.71:0/1227685904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7e01579f0 0x7fc7e00abf60 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00641e0 tx=0x7fc7d8009840 comp rx=0 tx=0).stop 2023-10-09T08:14:49.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.776+0000 7fc7e59ff700 1 -- 172.21.15.71:0/1227685904 shutdown_connections 2023-10-09T08:14:49.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.776+0000 7fc7e59ff700 1 --2- 172.21.15.71:0/1227685904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7e01579f0 0x7fc7e00abf60 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:49.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.776+0000 7fc7e59ff700 1 --2- 172.21.15.71:0/1227685904 >> v2:172.21.15.179:3300/0 conn(0x7fc7e00b1850 0x7fc7e00b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:49.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.776+0000 7fc7e59ff700 1 -- 172.21.15.71:0/1227685904 >> 172.21.15.71:0/1227685904 conn(0x7fc7e006a320 msgr2=0x7fc7e00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:49.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.776+0000 7fc7e59ff700 1 -- 172.21.15.71:0/1227685904 shutdown_connections 2023-10-09T08:14:49.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.776+0000 7fc7e59ff700 1 -- 172.21.15.71:0/1227685904 wait complete. 2023-10-09T08:14:49.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.777+0000 7fc7e59ff700 1 Processor -- start 2023-10-09T08:14:49.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.777+0000 7fc7e59ff700 1 -- start start 2023-10-09T08:14:49.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.778+0000 7fc7e59ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7e00ae680 0x7fc7e01481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:49.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.778+0000 7fc7e59ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7e00b1850 0x7fc7e014f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:49.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.778+0000 7fc7e59ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7e01579f0 0x7fc7e00af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:49.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.778+0000 7fc7e59ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0150410 con 0x7fc7e00ae680 2023-10-09T08:14:49.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.778+0000 7fc7e59ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e01486f0 con 0x7fc7e01579f0 2023-10-09T08:14:49.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.778+0000 7fc7e59ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e014d260 con 0x7fc7e00b1850 2023-10-09T08:14:49.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.778+0000 7fc7deffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7e00ae680 0x7fc7e01481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:49.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.778+0000 7fc7deffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7e00ae680 0x7fc7e01481b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40136/0 (socket says 172.21.15.71:40136) 2023-10-09T08:14:49.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.778+0000 7fc7deffd700 1 -- 172.21.15.71:0/3724943733 learned_addr learned my addr 172.21.15.71:0/3724943733 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:49.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.779+0000 7fc7df7fe700 1 --2- 172.21.15.71:0/3724943733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7e01579f0 0x7fc7e00af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:49.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.779+0000 7fc7de7fc700 1 --2- 172.21.15.71:0/3724943733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7e00b1850 0x7fc7e014f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:49.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.779+0000 7fc7deffd700 1 -- 172.21.15.71:0/3724943733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7e00b1850 msgr2=0x7fc7e014f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:49.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.779+0000 7fc7deffd700 1 --2- 172.21.15.71:0/3724943733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7e00b1850 0x7fc7e014f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:49.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.779+0000 7fc7deffd700 1 -- 172.21.15.71:0/3724943733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7e01579f0 msgr2=0x7fc7e00af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:49.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.779+0000 7fc7deffd700 1 --2- 172.21.15.71:0/3724943733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7e01579f0 0x7fc7e00af3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:49.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.779+0000 7fc7deffd700 1 -- 172.21.15.71:0/3724943733 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d8009ae0 con 0x7fc7e00ae680 2023-10-09T08:14:49.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.779+0000 7fc7deffd700 1 --2- 172.21.15.71:0/3724943733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7e00ae680 0x7fc7e01481b0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000c830 tx=0x7fc7d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:49.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.779+0000 7fc7c6ffd700 1 -- 172.21.15.71:0/3724943733 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0011600 con 0x7fc7e00ae680 2023-10-09T08:14:49.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.779+0000 7fc7c6ffd700 1 -- 172.21.15.71:0/3724943733 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d0011760 con 0x7fc7e00ae680 2023-10-09T08:14:49.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.779+0000 7fc7c6ffd700 1 -- 172.21.15.71:0/3724943733 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0011b20 con 0x7fc7e00ae680 2023-10-09T08:14:49.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.779+0000 7fc7e59ff700 1 -- 172.21.15.71:0/3724943733 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e014d7e0 con 0x7fc7e00ae680 2023-10-09T08:14:49.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.779+0000 7fc7e59ff700 1 -- 172.21.15.71:0/3724943733 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e0150130 con 0x7fc7e00ae680 2023-10-09T08:14:49.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.780+0000 7fc7e59ff700 1 -- 172.21.15.71:0/3724943733 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e004c3c0 con 0x7fc7e00ae680 2023-10-09T08:14:49.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.781+0000 7fc7c6ffd700 1 -- 172.21.15.71:0/3724943733 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc7d000a3e0 con 0x7fc7e00ae680 2023-10-09T08:14:49.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.782+0000 7fc7c6ffd700 1 --2- 172.21.15.71:0/3724943733 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc7cc066fe0 0x7fc7cc069490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:49.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.782+0000 7fc7c6ffd700 1 -- 172.21.15.71:0/3724943733 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6197+0+0 (secure 0 0 0) 0x7fc7d0084c10 con 0x7fc7e00ae680 2023-10-09T08:14:49.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.783+0000 7fc7de7fc700 1 --2- 172.21.15.71:0/3724943733 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc7cc066fe0 0x7fc7cc069490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:49.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.784+0000 7fc7de7fc700 1 --2- 172.21.15.71:0/3724943733 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc7cc066fe0 0x7fc7cc069490 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc7e014d050 tx=0x7fc7d4009040 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:49.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:49.786+0000 7fc7c6ffd700 1 -- 172.21.15.71:0/3724943733 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7d0051bf0 con 0x7fc7e00ae680 2023-10-09T08:14:50.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.026+0000 7fc7e59ff700 1 -- 172.21.15.71:0/3724943733 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7e00cb8c0 con 0x7fc7e00ae680 2023-10-09T08:14:50.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.026+0000 7fc7c6ffd700 1 -- 172.21.15.71:0/3724943733 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4592 (secure 0 0 0) 0x7fc7d0015090 con 0x7fc7e00ae680 2023-10-09T08:14:50.026 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:14:50.026 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":89,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7919,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/567694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":567694},{"type":"v1","addr":"172.21.15.71:6835","nonce":567694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":9151,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/502575967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":502575967},{"type":"v1","addr":"172.21.15.179:6836","nonce":502575967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":9663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/1425921431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":1425921431},{"type":"v1","addr":"172.21.15.71:6834","nonce":1425921431}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T08:14:38.913123+0000","modified":"2023-10-09T08:14:42.474701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9678},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9678":{"gid":9678,"name":"d","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/1735854447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1735854447},{"type":"v1","addr":"172.21.15.179:6834","nonce":1735854447}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T08:14:50.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.028+0000 7fc7e59ff700 1 -- 172.21.15.71:0/3724943733 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc7cc066fe0 msgr2=0x7fc7cc069490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:50.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.028+0000 7fc7e59ff700 1 --2- 172.21.15.71:0/3724943733 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc7cc066fe0 0x7fc7cc069490 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc7e014d050 tx=0x7fc7d4009040 comp rx=0 tx=0).stop 2023-10-09T08:14:50.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.028+0000 7fc7e59ff700 1 -- 172.21.15.71:0/3724943733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7e00ae680 msgr2=0x7fc7e01481b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:50.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.028+0000 7fc7e59ff700 1 --2- 172.21.15.71:0/3724943733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7e00ae680 0x7fc7e01481b0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000c830 tx=0x7fc7d0008040 comp rx=0 tx=0).stop 2023-10-09T08:14:50.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.029+0000 7fc7e59ff700 1 -- 172.21.15.71:0/3724943733 shutdown_connections 2023-10-09T08:14:50.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.029+0000 7fc7e59ff700 1 --2- 172.21.15.71:0/3724943733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7e01579f0 0x7fc7e00af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.029+0000 7fc7e59ff700 1 --2- 172.21.15.71:0/3724943733 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc7cc066fe0 0x7fc7cc069490 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.029+0000 7fc7e59ff700 1 --2- 172.21.15.71:0/3724943733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7e00ae680 0x7fc7e01481b0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.029+0000 7fc7e59ff700 1 --2- 172.21.15.71:0/3724943733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7e00b1850 0x7fc7e014f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.029+0000 7fc7e59ff700 1 -- 172.21.15.71:0/3724943733 >> 172.21.15.71:0/3724943733 conn(0x7fc7e006a320 msgr2=0x7fc7e00ca880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:50.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.029+0000 7fc7e59ff700 1 -- 172.21.15.71:0/3724943733 shutdown_connections 2023-10-09T08:14:50.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.029+0000 7fc7e59ff700 1 -- 172.21.15.71:0/3724943733 wait complete. 2023-10-09T08:14:50.030 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 89 2023-10-09T08:14:50.449 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 89, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T08:14:38.913123+0000', 'modified': '2023-10-09T08:14:42.474701+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9678}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9678': {'gid': 9678, 'name': 'd', 'rank': 0, 'incarnation': 86, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6834/1735854447', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6832', 'nonce': 1735854447}, {'type': 'v1', 'addr': '172.21.15.179:6834', 'nonce': 1735854447}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T08:14:50.449 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T08:14:50.449 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-09T08:14:50.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.632+0000 7f64579ff700 1 Processor -- start 2023-10-09T08:14:50.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.632+0000 7f64579ff700 1 -- start start 2023-10-09T08:14:50.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.634+0000 7f64579ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f645006a1c0 0x7f64501615b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.634+0000 7f64579ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64500b00b0 con 0x7f64500cb760 2023-10-09T08:14:50.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.634+0000 7f64579ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64500acdb0 con 0x7f64500cbb30 2023-10-09T08:14:50.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.634+0000 7f64579ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64500c8a10 con 0x7f645006a1c0 2023-10-09T08:14:50.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.634+0000 7f645579b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f64500cb760 0x7f64500c8300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44038/0 (socket says 172.21.15.71:44038) 2023-10-09T08:14:50.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.634+0000 7f645579b700 1 -- 172.21.15.71:0/4019099910 learned_addr learned my addr 172.21.15.71:0/4019099910 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:50.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.634+0000 7f6455f9c700 1 --2- 172.21.15.71:0/4019099910 >> v2:172.21.15.71:3300/0 conn(0x7f645006a1c0 0x7f64501615b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:50.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.634+0000 7f6447fff700 1 -- 172.21.15.71:0/4019099910 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271536319 0 0) 0x7f64500b00b0 con 0x7f64500cb760 2023-10-09T08:14:50.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.634+0000 7f6447fff700 1 -- 172.21.15.71:0/4019099910 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f643c003570 con 0x7f64500cb760 2023-10-09T08:14:50.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.634+0000 7f6455f9c700 1 -- 172.21.15.71:0/4019099910 >> v1:172.21.15.179:6789/0 conn(0x7f64500cbb30 legacy=0x7f6450069ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:50.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.634+0000 7f6455f9c700 1 -- 172.21.15.71:0/4019099910 >> v1:172.21.15.71:6789/0 conn(0x7f64500cb760 legacy=0x7f64500c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:50.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.634+0000 7f6455f9c700 1 -- 172.21.15.71:0/4019099910 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64500ad000 con 0x7f645006a1c0 2023-10-09T08:14:50.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.635+0000 7f6455f9c700 1 --2- 172.21.15.71:0/4019099910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f645006a1c0 0x7f64501615b0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f6448009e60 tx=0x7f6448009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41f9d6ddeb5e3d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:50.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.635+0000 7f6447fff700 1 -- 172.21.15.71:0/4019099910 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644800e070 con 0x7f645006a1c0 2023-10-09T08:14:50.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.635+0000 7f6447fff700 1 -- 172.21.15.71:0/4019099910 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644800bb60 con 0x7f645006a1c0 2023-10-09T08:14:50.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.635+0000 7f6447fff700 1 -- 172.21.15.71:0/4019099910 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6448012430 con 0x7f645006a1c0 2023-10-09T08:14:50.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.635+0000 7f64579ff700 1 -- 172.21.15.71:0/4019099910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f645006a1c0 msgr2=0x7f64501615b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:50.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.635+0000 7f64579ff700 1 --2- 172.21.15.71:0/4019099910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f645006a1c0 0x7f64501615b0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f6448009e60 tx=0x7f6448009780 comp rx=0 tx=0).stop 2023-10-09T08:14:50.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.635+0000 7f64579ff700 1 -- 172.21.15.71:0/4019099910 shutdown_connections 2023-10-09T08:14:50.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.635+0000 7f64579ff700 1 --2- 172.21.15.71:0/4019099910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f645006a1c0 0x7f64501615b0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.635+0000 7f64579ff700 1 -- 172.21.15.71:0/4019099910 >> 172.21.15.71:0/4019099910 conn(0x7f645006d5a0 msgr2=0x7f6450068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:50.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.636+0000 7f64579ff700 1 -- 172.21.15.71:0/4019099910 shutdown_connections 2023-10-09T08:14:50.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.636+0000 7f64579ff700 1 -- 172.21.15.71:0/4019099910 wait complete. 2023-10-09T08:14:50.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.637+0000 7f64579ff700 1 Processor -- start 2023-10-09T08:14:50.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.637+0000 7f64579ff700 1 -- start start 2023-10-09T08:14:50.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.638+0000 7f64579ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f645006a1c0 0x7f6450169d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.638+0000 7f64579ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64500cb760 0x7f645006dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.638+0000 7f64579ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64500cbb30 0x7f6450159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.638+0000 7f64579ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64500ab1b0 con 0x7f64500cbb30 2023-10-09T08:14:50.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.638+0000 7f64579ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64500aaed0 con 0x7f64500cb760 2023-10-09T08:14:50.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.638+0000 7f64579ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64500a7db0 con 0x7f645006a1c0 2023-10-09T08:14:50.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.638+0000 7f6455f9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64500cbb30 0x7f6450159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:50.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.638+0000 7f6455f9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64500cbb30 0x7f6450159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40164/0 (socket says 172.21.15.71:40164) 2023-10-09T08:14:50.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.638+0000 7f6455f9c700 1 -- 172.21.15.71:0/2497014708 learned_addr learned my addr 172.21.15.71:0/2497014708 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:50.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.638+0000 7f6454f9a700 1 --2- 172.21.15.71:0/2497014708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64500cb760 0x7f645006dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:50.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.638+0000 7f645579b700 1 --2- 172.21.15.71:0/2497014708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f645006a1c0 0x7f6450169d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:50.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.639+0000 7f6455f9c700 1 -- 172.21.15.71:0/2497014708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f645006a1c0 msgr2=0x7f6450169d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:50.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.639+0000 7f6455f9c700 1 --2- 172.21.15.71:0/2497014708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f645006a1c0 0x7f6450169d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.639+0000 7f6455f9c700 1 -- 172.21.15.71:0/2497014708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64500cb760 msgr2=0x7f645006dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:50.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.639+0000 7f6455f9c700 1 --2- 172.21.15.71:0/2497014708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64500cb760 0x7f645006dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.639+0000 7f6455f9c700 1 -- 172.21.15.71:0/2497014708 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6448009a20 con 0x7f64500cbb30 2023-10-09T08:14:50.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.639+0000 7f6455f9c700 1 --2- 172.21.15.71:0/2497014708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64500cbb30 0x7f6450159730 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f6448013000 tx=0x7f6448019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:50.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.639+0000 7f64457fa700 1 -- 172.21.15.71:0/2497014708 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64480032b0 con 0x7f64500cbb30 2023-10-09T08:14:50.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.639+0000 7f64457fa700 1 -- 172.21.15.71:0/2497014708 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6448007080 con 0x7f64500cbb30 2023-10-09T08:14:50.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.639+0000 7f64579ff700 1 -- 172.21.15.71:0/2497014708 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64500a8090 con 0x7f64500cbb30 2023-10-09T08:14:50.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.639+0000 7f64457fa700 1 -- 172.21.15.71:0/2497014708 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644801b850 con 0x7f64500cbb30 2023-10-09T08:14:50.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.639+0000 7f64579ff700 1 -- 172.21.15.71:0/2497014708 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645016a2c0 con 0x7f64500cbb30 2023-10-09T08:14:50.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.641+0000 7f64457fa700 1 -- 172.21.15.71:0/2497014708 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f644801bc80 con 0x7f64500cbb30 2023-10-09T08:14:50.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.642+0000 7f64457fa700 1 --2- 172.21.15.71:0/2497014708 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6434066f30 0x7f64340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.642+0000 7f64457fa700 1 -- 172.21.15.71:0/2497014708 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f6448086740 con 0x7f64500cbb30 2023-10-09T08:14:50.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.643+0000 7f645579b700 1 --2- 172.21.15.71:0/2497014708 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6434066f30 0x7f64340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:50.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.643+0000 7f645579b700 1 --2- 172.21.15.71:0/2497014708 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6434066f30 0x7f64340693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f644c0058d0 tx=0x7f644c009040 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:50.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.644+0000 7f64660edb80 1 Processor -- start 2023-10-09T08:14:50.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.644+0000 7f64660edb80 1 -- start start 2023-10-09T08:14:50.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.645+0000 7f64660edb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6eea8aa50 0x55b6eea8ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.645+0000 7f64660edb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eead4d00 0x55b6eeab3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.645+0000 7f64660edb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b6eeab3f60 0x55b6eea86cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.645+0000 7f64660edb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6ee9e1a70 con 0x55b6eead4d00 2023-10-09T08:14:50.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.645+0000 7f64660edb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6ee9df270 con 0x55b6eea8aa50 2023-10-09T08:14:50.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.645+0000 7f64660edb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b6ee9db060 con 0x55b6eeab3f60 2023-10-09T08:14:50.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.645+0000 7f6454f9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eead4d00 0x55b6eeab3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:50.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.645+0000 7f6454f9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eead4d00 0x55b6eeab3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40180/0 (socket says 172.21.15.71:40180) 2023-10-09T08:14:50.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.645+0000 7f6454f9a700 1 -- 172.21.15.71:0/1964958714 learned_addr learned my addr 172.21.15.71:0/1964958714 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:50.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.645+0000 7f645579b700 1 --2- 172.21.15.71:0/1964958714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6eea8aa50 0x55b6eea8ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:50.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.645+0000 7f6455f9c700 1 --2- 172.21.15.71:0/1964958714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b6eeab3f60 0x55b6eea86cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:50.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.646+0000 7f6454f9a700 1 -- 172.21.15.71:0/1964958714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b6eeab3f60 msgr2=0x55b6eea86cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:50.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.646+0000 7f6454f9a700 1 --2- 172.21.15.71:0/1964958714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b6eeab3f60 0x55b6eea86cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.646+0000 7f6454f9a700 1 -- 172.21.15.71:0/1964958714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6eea8aa50 msgr2=0x55b6eea8ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:50.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.646+0000 7f6454f9a700 1 --2- 172.21.15.71:0/1964958714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6eea8aa50 0x55b6eea8ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.646+0000 7f6454f9a700 1 -- 172.21.15.71:0/1964958714 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6ee875270 con 0x55b6eead4d00 2023-10-09T08:14:50.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.646+0000 7f645579b700 1 --2- 172.21.15.71:0/1964958714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6eea8aa50 0x55b6eea8ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:14:50.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.646+0000 7f6454f9a700 1 --2- 172.21.15.71:0/1964958714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eead4d00 0x55b6eeab3a20 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f6440003610 tx=0x7f6440009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a876e53d89af7645 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:50.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.646+0000 7f643a7fc700 1 -- 172.21.15.71:0/1964958714 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440006a30 con 0x55b6eead4d00 2023-10-09T08:14:50.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.646+0000 7f643a7fc700 1 -- 172.21.15.71:0/1964958714 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6440006bb0 con 0x55b6eead4d00 2023-10-09T08:14:50.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.646+0000 7f643a7fc700 1 -- 172.21.15.71:0/1964958714 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440007030 con 0x55b6eead4d00 2023-10-09T08:14:50.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.647+0000 7f64660edb80 1 -- 172.21.15.71:0/1964958714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eead4d00 msgr2=0x55b6eeab3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:50.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.647+0000 7f64660edb80 1 --2- 172.21.15.71:0/1964958714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eead4d00 0x55b6eeab3a20 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f6440003610 tx=0x7f6440009040 comp rx=0 tx=0).stop 2023-10-09T08:14:50.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.647+0000 7f64660edb80 1 -- 172.21.15.71:0/1964958714 shutdown_connections 2023-10-09T08:14:50.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.647+0000 7f64660edb80 1 --2- 172.21.15.71:0/1964958714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b6eeab3f60 0x55b6eea86cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.647+0000 7f64660edb80 1 --2- 172.21.15.71:0/1964958714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6eea8aa50 0x55b6eea8ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.647+0000 7f64660edb80 1 --2- 172.21.15.71:0/1964958714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eead4d00 0x55b6eeab3a20 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.647+0000 7f64660edb80 1 -- 172.21.15.71:0/1964958714 >> 172.21.15.71:0/1964958714 conn(0x55b6eea8c370 msgr2=0x55b6eea8c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:50.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.647+0000 7f64660edb80 1 -- 172.21.15.71:0/1964958714 shutdown_connections 2023-10-09T08:14:50.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.647+0000 7f64660edb80 1 -- 172.21.15.71:0/1964958714 wait complete. 2023-10-09T08:14:50.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.648+0000 7f64660edb80 1 -- start start 2023-10-09T08:14:50.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.648+0000 7f64660edb80 1 Processor -- start 2023-10-09T08:14:50.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.649+0000 7f64660edb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eea8aa50 0x55b6eeae3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.649+0000 7f64660edb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6eeab3f60 0x55b6eeae4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.649+0000 7f64660edb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b6eead4d00 0x55b6eeacae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.649+0000 7f64660edb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6ee986890 con 0x55b6eea8aa50 2023-10-09T08:14:50.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.649+0000 7f64660edb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6ee9a1ea0 con 0x55b6eeab3f60 2023-10-09T08:14:50.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.649+0000 7f64660edb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b6ee85de30 con 0x55b6eead4d00 2023-10-09T08:14:50.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.649+0000 7f64660edb80 10 client.0 _ll_register_callbacks cb 0x55b6eea4e110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T08:14:50.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.649+0000 7f645579b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eea8aa50 0x55b6eeae3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:50.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.649+0000 7f645579b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eea8aa50 0x55b6eeae3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40182/0 (socket says 172.21.15.71:40182) 2023-10-09T08:14:50.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.649+0000 7f645579b700 1 -- 172.21.15.71:0/1365488067 learned_addr learned my addr 172.21.15.71:0/1365488067 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:50.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.649+0000 7f645579b700 1 -- 172.21.15.71:0/1365488067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b6eead4d00 msgr2=0x55b6eeacae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:50.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.649+0000 7f645579b700 1 --2- 172.21.15.71:0/1365488067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b6eead4d00 0x55b6eeacae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.649+0000 7f645579b700 1 -- 172.21.15.71:0/1365488067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6eeab3f60 msgr2=0x55b6eeae4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:50.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.649+0000 7f6454f9a700 1 --2- 172.21.15.71:0/1365488067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6eeab3f60 0x55b6eeae4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:50.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.649+0000 7f645579b700 1 --2- 172.21.15.71:0/1365488067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6eeab3f60 0x55b6eeae4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.649+0000 7f645579b700 1 -- 172.21.15.71:0/1365488067 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f644000f040 con 0x55b6eea8aa50 2023-10-09T08:14:50.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.649+0000 7f6454f9a700 1 --2- 172.21.15.71:0/1365488067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6eeab3f60 0x55b6eeae4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:14:50.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.650+0000 7f645579b700 1 --2- 172.21.15.71:0/1365488067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eea8aa50 0x55b6eeae3e90 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f644c0074e0 tx=0x7f644c017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33cc4cd88461b883 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:50.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.650+0000 7f642f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T08:14:50.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.650+0000 7f642f7fe700 1 -- 172.21.15.71:0/1365488067 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c015980 con 0x55b6eea8aa50 2023-10-09T08:14:50.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.650+0000 7f642f7fe700 1 -- 172.21.15.71:0/1365488067 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(194..194 src has 1..194) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f644c022c90 con 0x55b6eea8aa50 2023-10-09T08:14:50.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.650+0000 7f64660edb80 1 -- 172.21.15.71:0/1365488067 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b6eea7fb70 con 0x55b6eea8aa50 2023-10-09T08:14:50.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.650+0000 7f642f7fe700 1 -- 172.21.15.71:0/1365488067 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f644c022e90 con 0x55b6eea8aa50 2023-10-09T08:14:50.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.650+0000 7f64660edb80 10 client.9834 fetch_fsmap learned FSMap version 89 2023-10-09T08:14:50.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.650+0000 7f64660edb80 1 -- 172.21.15.71:0/1365488067 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) v3 -- 0x55b6ee817fe0 con 0x55b6eea8aa50 2023-10-09T08:14:50.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.650+0000 7f642f7fe700 1 -- 172.21.15.71:0/1365488067 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b6eea7fb70 con 0x55b6eea8aa50 2023-10-09T08:14:50.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.651+0000 7f642f7fe700 1 -- 172.21.15.71:0/1365488067 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 89) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f644c015cf0 con 0x55b6eea8aa50 2023-10-09T08:14:50.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.651+0000 7f64660edb80 10 client.9834 fetch_fsmap finished waiting for FSMap version 89 2023-10-09T08:14:50.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.651+0000 7f64660edb80 10 client.9834 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T08:14:50.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.651+0000 7f64660edb80 20 client.9834 populate_metadata read hostname 'smithi071' 2023-10-09T08:14:50.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.651+0000 7f64660edb80 1 --2- 172.21.15.71:0/1365488067 >> [v2:172.21.15.179:6832/1735854447,v1:172.21.15.179:6834/1735854447] conn(0x55b6eead3f20 0x55b6eead42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.651+0000 7f64660edb80 4 client.9834 mds_command: new command op to 9678 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T08:14:50.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.651+0000 7f64660edb80 1 -- 172.21.15.71:0/1365488067 --> [v2:172.21.15.179:6832/1735854447,v1:172.21.15.179:6834/1735854447] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b6eea5caa0 con 0x55b6eead3f20 2023-10-09T08:14:50.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.651+0000 7f6454f9a700 1 --2- 172.21.15.71:0/1365488067 >> [v2:172.21.15.179:6832/1735854447,v1:172.21.15.179:6834/1735854447] conn(0x55b6eead3f20 0x55b6eead42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:50.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.652+0000 7f642f7fe700 10 client.9834 ms_handle_connect on v2:172.21.15.179:6832/1735854447 2023-10-09T08:14:50.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.652+0000 7f6454f9a700 1 --2- 172.21.15.71:0/1365488067 >> [v2:172.21.15.179:6832/1735854447,v1:172.21.15.179:6834/1735854447] conn(0x55b6eead3f20 0x55b6eead42f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fedbfebe3f1adcf server_cookie=5557681ee58d5419 in_seq=0 out_seq=0 2023-10-09T08:14:50.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.653+0000 7f642f7fe700 1 -- 172.21.15.71:0/1365488067 <== mds.0 v2:172.21.15.179:6832/1735854447 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55b6eea5caa0 con 0x55b6eead3f20 2023-10-09T08:14:50.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.653+0000 7f642f7fe700 10 client.9834 handle_command_reply: tid=0 2023-10-09T08:14:50.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.653+0000 7f64660edb80 1 client.9834 shutdown 2023-10-09T08:14:50.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.653+0000 7f64660edb80 1 -- 172.21.15.71:0/1365488067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eea8aa50 msgr2=0x55b6eeae3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:50.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.653+0000 7f64660edb80 1 --2- 172.21.15.71:0/1365488067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eea8aa50 0x55b6eeae3e90 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f644c0074e0 tx=0x7f644c017040 comp rx=0 tx=0).stop 2023-10-09T08:14:50.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.653+0000 7f64660edb80 1 -- 172.21.15.71:0/1365488067 shutdown_connections 2023-10-09T08:14:50.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.653+0000 7f64660edb80 1 --2- 172.21.15.71:0/1365488067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b6eead4d00 0x55b6eeacae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.653+0000 7f64660edb80 1 --2- 172.21.15.71:0/1365488067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eea8aa50 0x55b6eeae3e90 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.653+0000 7f64660edb80 1 --2- 172.21.15.71:0/1365488067 >> [v2:172.21.15.179:6832/1735854447,v1:172.21.15.179:6834/1735854447] conn(0x55b6eead3f20 0x55b6eead42f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.653+0000 7f64660edb80 1 --2- 172.21.15.71:0/1365488067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6eeab3f60 0x55b6eeae4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.653+0000 7f642f7fe700 0 client.9834 ms_handle_reset on v2:172.21.15.179:6832/1735854447 2023-10-09T08:14:50.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.653+0000 7f64660edb80 1 -- 172.21.15.71:0/1365488067 >> 172.21.15.71:0/1365488067 conn(0x55b6eea8c370 msgr2=0x55b6eea87960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:50.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.653+0000 7f64660edb80 1 -- 172.21.15.71:0/1365488067 shutdown_connections 2023-10-09T08:14:50.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.653+0000 7f64660edb80 1 -- 172.21.15.71:0/1365488067 wait complete. 2023-10-09T08:14:50.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.653+0000 7f64660edb80 20 client.9834 trim_cache size 0 max 16384 2023-10-09T08:14:50.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.670+0000 7f64660edb80 1 Processor -- start 2023-10-09T08:14:50.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.670+0000 7f64660edb80 1 -- start start 2023-10-09T08:14:50.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.671+0000 7f64660edb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eea8aa50 0x55b6eead4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.671+0000 7f64660edb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6eeab3f60 0x55b6eeaeb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.671+0000 7f64660edb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b6eead4d00 0x55b6eea8afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.671+0000 7f64660edb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6eea86730 con 0x55b6eea8aa50 2023-10-09T08:14:50.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.671+0000 7f64660edb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6eeacb8a0 con 0x55b6eeab3f60 2023-10-09T08:14:50.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.671+0000 7f64660edb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b6eeacfa90 con 0x55b6eead4d00 2023-10-09T08:14:50.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.671+0000 7f645579b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eea8aa50 0x55b6eead4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:50.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.671+0000 7f645579b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eea8aa50 0x55b6eead4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40198/0 (socket says 172.21.15.71:40198) 2023-10-09T08:14:50.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.671+0000 7f645579b700 1 -- 172.21.15.71:0/4286675720 learned_addr learned my addr 172.21.15.71:0/4286675720 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:50.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.672+0000 7f6454f9a700 1 --2- 172.21.15.71:0/4286675720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6eeab3f60 0x55b6eeaeb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:50.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.672+0000 7f645579b700 1 -- 172.21.15.71:0/4286675720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b6eead4d00 msgr2=0x55b6eea8afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:50.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.672+0000 7f645579b700 1 --2- 172.21.15.71:0/4286675720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b6eead4d00 0x55b6eea8afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.672+0000 7f645579b700 1 -- 172.21.15.71:0/4286675720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6eeab3f60 msgr2=0x55b6eeaeb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:50.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.672+0000 7f645579b700 1 --2- 172.21.15.71:0/4286675720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6eeab3f60 0x55b6eeaeb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.672+0000 7f645579b700 1 -- 172.21.15.71:0/4286675720 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6ee9a9780 con 0x55b6eea8aa50 2023-10-09T08:14:50.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.672+0000 7f6454f9a700 1 --2- 172.21.15.71:0/4286675720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6eeab3f60 0x55b6eeaeb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:14:50.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.672+0000 7f645579b700 1 --2- 172.21.15.71:0/4286675720 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eea8aa50 0x55b6eead4370 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f644c0150e0 tx=0x7f644c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37db7d1776ac07c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:50.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.672+0000 7f643affd700 1 -- 172.21.15.71:0/4286675720 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c000cb0 con 0x55b6eea8aa50 2023-10-09T08:14:50.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.672+0000 7f643affd700 1 -- 172.21.15.71:0/4286675720 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644c015cf0 con 0x55b6eea8aa50 2023-10-09T08:14:50.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.672+0000 7f643affd700 1 -- 172.21.15.71:0/4286675720 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c015e60 con 0x55b6eea8aa50 2023-10-09T08:14:50.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.673+0000 7f64660edb80 1 -- 172.21.15.71:0/4286675720 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eea8aa50 msgr2=0x55b6eead4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:50.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.673+0000 7f64660edb80 1 --2- 172.21.15.71:0/4286675720 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eea8aa50 0x55b6eead4370 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f644c0150e0 tx=0x7f644c014000 comp rx=0 tx=0).stop 2023-10-09T08:14:50.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.673+0000 7f64660edb80 1 -- 172.21.15.71:0/4286675720 shutdown_connections 2023-10-09T08:14:50.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.673+0000 7f64660edb80 1 --2- 172.21.15.71:0/4286675720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b6eead4d00 0x55b6eea8afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.673+0000 7f64660edb80 1 --2- 172.21.15.71:0/4286675720 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eea8aa50 0x55b6eead4370 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.673+0000 7f64660edb80 1 --2- 172.21.15.71:0/4286675720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6eeab3f60 0x55b6eeaeb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.673+0000 7f64660edb80 1 -- 172.21.15.71:0/4286675720 >> 172.21.15.71:0/4286675720 conn(0x55b6eea8c370 msgr2=0x55b6eeaba750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:50.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.673+0000 7f64660edb80 1 -- 172.21.15.71:0/4286675720 shutdown_connections 2023-10-09T08:14:50.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.673+0000 7f64660edb80 1 -- 172.21.15.71:0/4286675720 wait complete. 2023-10-09T08:14:50.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.673+0000 7f64660edb80 1 -- start start 2023-10-09T08:14:50.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.674+0000 7f64660edb80 1 Processor -- start 2023-10-09T08:14:50.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.674+0000 7f64660edb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6eea8aa50 0x55b6eeb36850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.674+0000 7f64660edb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b6eeab3f60 0x55b6eeb3a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.675+0000 7f64660edb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eead4d00 0x55b6eeae4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.675+0000 7f64660edb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6eeb3af30 con 0x55b6eead4d00 2023-10-09T08:14:50.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.675+0000 7f64660edb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6eeae3670 con 0x55b6eea8aa50 2023-10-09T08:14:50.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.675+0000 7f64660edb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b6eeb36d90 con 0x55b6eeab3f60 2023-10-09T08:14:50.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.675+0000 7f64660edb80 10 client.0 _ll_register_callbacks cb 0x55b6eea4e110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T08:14:50.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.675+0000 7f6455f9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eead4d00 0x55b6eeae4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:50.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.675+0000 7f6455f9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eead4d00 0x55b6eeae4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40208/0 (socket says 172.21.15.71:40208) 2023-10-09T08:14:50.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.675+0000 7f6455f9c700 1 -- 172.21.15.71:0/525204702 learned_addr learned my addr 172.21.15.71:0/525204702 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:50.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.675+0000 7f6454f9a700 1 --2- 172.21.15.71:0/525204702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b6eeab3f60 0x55b6eeb3a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:50.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.675+0000 7f645579b700 1 --2- 172.21.15.71:0/525204702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6eea8aa50 0x55b6eeb36850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:50.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.675+0000 7f6455f9c700 1 -- 172.21.15.71:0/525204702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b6eeab3f60 msgr2=0x55b6eeb3a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:50.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.675+0000 7f6455f9c700 1 --2- 172.21.15.71:0/525204702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b6eeab3f60 0x55b6eeb3a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.675+0000 7f6455f9c700 1 -- 172.21.15.71:0/525204702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6eea8aa50 msgr2=0x55b6eeb36850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:50.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.675+0000 7f6455f9c700 1 --2- 172.21.15.71:0/525204702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6eea8aa50 0x55b6eeb36850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.675+0000 7f6455f9c700 1 -- 172.21.15.71:0/525204702 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b6ee817fe0 con 0x55b6eead4d00 2023-10-09T08:14:50.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.675+0000 7f6455f9c700 1 --2- 172.21.15.71:0/525204702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eead4d00 0x55b6eeae4600 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f64480570e0 tx=0x7f6448084930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121794afcbe75f16 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:50.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.675+0000 7f642f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T08:14:50.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.675+0000 7f642f7fe700 1 -- 172.21.15.71:0/525204702 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644800e040 con 0x55b6eead4d00 2023-10-09T08:14:50.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.676+0000 7f642f7fe700 1 -- 172.21.15.71:0/525204702 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(194..194 src has 1..194) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f6448057ae0 con 0x55b6eead4d00 2023-10-09T08:14:50.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.676+0000 7f64660edb80 1 -- 172.21.15.71:0/525204702 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f64500a8a20 con 0x55b6eead4d00 2023-10-09T08:14:50.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.676+0000 7f642f7fe700 1 -- 172.21.15.71:0/525204702 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6448056d40 con 0x55b6eead4d00 2023-10-09T08:14:50.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.676+0000 7f64660edb80 10 client.9840 fetch_fsmap learned FSMap version 89 2023-10-09T08:14:50.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.676+0000 7f64660edb80 1 -- 172.21.15.71:0/525204702 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) v3 -- 0x55b6ee990470 con 0x55b6eead4d00 2023-10-09T08:14:50.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.676+0000 7f642f7fe700 1 -- 172.21.15.71:0/525204702 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64500a8a20 con 0x55b6eead4d00 2023-10-09T08:14:50.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.676+0000 7f642f7fe700 1 -- 172.21.15.71:0/525204702 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 89) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f644805c3e0 con 0x55b6eead4d00 2023-10-09T08:14:50.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.676+0000 7f64660edb80 10 client.9840 fetch_fsmap finished waiting for FSMap version 89 2023-10-09T08:14:50.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.676+0000 7f64660edb80 10 client.9840 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T08:14:50.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.676+0000 7f64660edb80 20 client.9840 populate_metadata read hostname 'smithi071' 2023-10-09T08:14:50.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.676+0000 7f64660edb80 1 --2- 172.21.15.71:0/525204702 >> [v2:172.21.15.179:6832/1735854447,v1:172.21.15.179:6834/1735854447] conn(0x55b6eea8ae20 0x55b6eea8b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.676+0000 7f64660edb80 4 client.9840 mds_command: new command op to 9678 tid=0[{"prefix": "status"}] 2023-10-09T08:14:50.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.676+0000 7f64660edb80 1 -- 172.21.15.71:0/525204702 --> [v2:172.21.15.179:6832/1735854447,v1:172.21.15.179:6834/1735854447] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f6440006bb0 con 0x55b6eea8ae20 2023-10-09T08:14:50.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.676+0000 7f645579b700 1 --2- 172.21.15.71:0/525204702 >> [v2:172.21.15.179:6832/1735854447,v1:172.21.15.179:6834/1735854447] conn(0x55b6eea8ae20 0x55b6eea8b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:50.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.677+0000 7f642f7fe700 10 client.9840 ms_handle_connect on v2:172.21.15.179:6832/1735854447 2023-10-09T08:14:50.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.677+0000 7f645579b700 1 --2- 172.21.15.71:0/525204702 >> [v2:172.21.15.179:6832/1735854447,v1:172.21.15.179:6834/1735854447] conn(0x55b6eea8ae20 0x55b6eea8b1f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=373838073aecc49c server_cookie=212074462ee21383 in_seq=0 out_seq=0 2023-10-09T08:14:50.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.677+0000 7f642f7fe700 1 -- 172.21.15.71:0/525204702 <== mds.0 v2:172.21.15.179:6832/1735854447 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x7f6440006bb0 con 0x55b6eea8ae20 2023-10-09T08:14:50.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.677+0000 7f642f7fe700 10 client.9840 handle_command_reply: tid=0 2023-10-09T08:14:50.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.677+0000 7f64660edb80 1 client.9840 shutdown 2023-10-09T08:14:50.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.678+0000 7f64660edb80 1 -- 172.21.15.71:0/525204702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eead4d00 msgr2=0x55b6eeae4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:50.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.678+0000 7f64660edb80 1 --2- 172.21.15.71:0/525204702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eead4d00 0x55b6eeae4600 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f64480570e0 tx=0x7f6448084930 comp rx=0 tx=0).stop 2023-10-09T08:14:50.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.678+0000 7f64660edb80 1 -- 172.21.15.71:0/525204702 shutdown_connections 2023-10-09T08:14:50.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.678+0000 7f64660edb80 1 --2- 172.21.15.71:0/525204702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6eead4d00 0x55b6eeae4600 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.678+0000 7f64660edb80 1 --2- 172.21.15.71:0/525204702 >> [v2:172.21.15.179:6832/1735854447,v1:172.21.15.179:6834/1735854447] conn(0x55b6eea8ae20 0x55b6eea8b1f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.678+0000 7f64660edb80 1 --2- 172.21.15.71:0/525204702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b6eea8aa50 0x55b6eeb36850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.678+0000 7f64660edb80 1 --2- 172.21.15.71:0/525204702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b6eeab3f60 0x55b6eeb3a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.678+0000 7f642f7fe700 0 client.9840 ms_handle_reset on v2:172.21.15.179:6832/1735854447 2023-10-09T08:14:50.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.678+0000 7f64660edb80 1 -- 172.21.15.71:0/525204702 >> 172.21.15.71:0/525204702 conn(0x55b6eea8c370 msgr2=0x55b6eead1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:50.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.678+0000 7f64660edb80 1 -- 172.21.15.71:0/525204702 shutdown_connections 2023-10-09T08:14:50.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.678+0000 7f64660edb80 1 -- 172.21.15.71:0/525204702 wait complete. 2023-10-09T08:14:50.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.678+0000 7f64660edb80 20 client.9840 trim_cache size 0 max 16384 2023-10-09T08:14:50.684 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T08:14:50.684 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "604c5619-653a-4ab6-912c-ab2e5464fe4a", 2023-10-09T08:14:50.684 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2023-10-09T08:14:50.684 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 9678, 2023-10-09T08:14:50.684 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2023-10-09T08:14:50.684 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2023-10-09T08:14:50.684 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2023-10-09T08:14:50.685 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 11.214021365000001, 2023-10-09T08:14:50.685 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 89, 2023-10-09T08:14:50.685 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 194, 2023-10-09T08:14:50.685 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 194, 2023-10-09T08:14:50.685 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 16.984392206999999 2023-10-09T08:14:50.685 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T08:14:50.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.678+0000 7f64579ff700 1 -- 172.21.15.71:0/2497014708 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6434066f30 msgr2=0x7f64340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:50.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.678+0000 7f64579ff700 1 --2- 172.21.15.71:0/2497014708 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6434066f30 0x7f64340693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f644c0058d0 tx=0x7f644c009040 comp rx=0 tx=0).stop 2023-10-09T08:14:50.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.678+0000 7f64579ff700 1 -- 172.21.15.71:0/2497014708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64500cbb30 msgr2=0x7f6450159730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:50.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.678+0000 7f64579ff700 1 --2- 172.21.15.71:0/2497014708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64500cbb30 0x7f6450159730 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f6448013000 tx=0x7f6448019000 comp rx=0 tx=0).stop 2023-10-09T08:14:50.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.679+0000 7f64579ff700 1 -- 172.21.15.71:0/2497014708 shutdown_connections 2023-10-09T08:14:50.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.679+0000 7f64579ff700 1 --2- 172.21.15.71:0/2497014708 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f6434066f30 0x7f64340693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.679+0000 7f64579ff700 1 --2- 172.21.15.71:0/2497014708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64500cbb30 0x7f6450159730 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.679+0000 7f64579ff700 1 --2- 172.21.15.71:0/2497014708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f645006a1c0 0x7f6450169d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.679+0000 7f64579ff700 1 --2- 172.21.15.71:0/2497014708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64500cb760 0x7f645006dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.679+0000 7f64579ff700 1 -- 172.21.15.71:0/2497014708 >> 172.21.15.71:0/2497014708 conn(0x7f645006d5a0 msgr2=0x7f64500b02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:50.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.679+0000 7f64579ff700 1 -- 172.21.15.71:0/2497014708 shutdown_connections 2023-10-09T08:14:50.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.679+0000 7f64579ff700 1 -- 172.21.15.71:0/2497014708 wait complete. 2023-10-09T08:14:50.695 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T08:14:50.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.874+0000 7f5f44b9d700 1 Processor -- start 2023-10-09T08:14:50.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.874+0000 7f5f44b9d700 1 -- start start 2023-10-09T08:14:50.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.875+0000 7f5f44b9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5f401595a0 0x7f5f400b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.875+0000 7f5f44b9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f400b1410 con 0x7f5f400c8830 2023-10-09T08:14:50.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.875+0000 7f5f44b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f40063230 con 0x7f5f400c6c60 2023-10-09T08:14:50.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.875+0000 7f5f44b9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f400b2b90 con 0x7f5f401595a0 2023-10-09T08:14:50.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.875+0000 7f5f3f7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5f401595a0 0x7f5f400b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:50.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.875+0000 7f5f3ffff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f5f400c8830 0x7f5f40159970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44054/0 (socket says 172.21.15.71:44054) 2023-10-09T08:14:50.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.876+0000 7f5f3ffff700 1 -- 172.21.15.71:0/395905399 learned_addr learned my addr 172.21.15.71:0/395905399 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:50.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.876+0000 7f5f3f7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5f401595a0 0x7f5f400b18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40216/0 (socket says 172.21.15.71:40216) 2023-10-09T08:14:50.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.876+0000 7f5f3f7fe700 1 -- 172.21.15.71:0/395905399 >> v1:172.21.15.179:6789/0 conn(0x7f5f400c6c60 legacy=0x7f5f400c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:50.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.876+0000 7f5f3f7fe700 1 -- 172.21.15.71:0/395905399 >> v1:172.21.15.71:6789/0 conn(0x7f5f400c8830 legacy=0x7f5f40159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:50.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.876+0000 7f5f3f7fe700 1 -- 172.21.15.71:0/395905399 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f400634f0 con 0x7f5f401595a0 2023-10-09T08:14:50.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.876+0000 7f5f3e7fc700 1 -- 172.21.15.71:0/395905399 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290273509 0 0) 0x7f5f400b1410 con 0x7f5f400c8830 2023-10-09T08:14:50.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.876+0000 7f5f3f7fe700 1 --2- 172.21.15.71:0/395905399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f401595a0 0x7f5f400b18a0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f5f300098e0 tx=0x7f5f300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e05ab46347084a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:50.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.876+0000 7f5f3e7fc700 1 -- 172.21.15.71:0/395905399 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30009e80 con 0x7f5f401595a0 2023-10-09T08:14:50.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.876+0000 7f5f3e7fc700 1 -- 172.21.15.71:0/395905399 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3000b860 con 0x7f5f401595a0 2023-10-09T08:14:50.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.876+0000 7f5f3e7fc700 1 -- 172.21.15.71:0/395905399 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3000bbe0 con 0x7f5f401595a0 2023-10-09T08:14:50.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.877+0000 7f5f44b9d700 1 -- 172.21.15.71:0/395905399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f401595a0 msgr2=0x7f5f400b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:50.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.877+0000 7f5f44b9d700 1 --2- 172.21.15.71:0/395905399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f401595a0 0x7f5f400b18a0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f5f300098e0 tx=0x7f5f300091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.877+0000 7f5f44b9d700 1 -- 172.21.15.71:0/395905399 shutdown_connections 2023-10-09T08:14:50.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.877+0000 7f5f44b9d700 1 --2- 172.21.15.71:0/395905399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f401595a0 0x7f5f400b18a0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.877+0000 7f5f44b9d700 1 -- 172.21.15.71:0/395905399 >> 172.21.15.71:0/395905399 conn(0x7f5f4006ddb0 msgr2=0x7f5f4006e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:50.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.877+0000 7f5f44b9d700 1 -- 172.21.15.71:0/395905399 shutdown_connections 2023-10-09T08:14:50.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.877+0000 7f5f44b9d700 1 -- 172.21.15.71:0/395905399 wait complete. 2023-10-09T08:14:50.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.878+0000 7f5f44b9d700 1 Processor -- start 2023-10-09T08:14:50.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.879+0000 7f5f44b9d700 1 -- start start 2023-10-09T08:14:50.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.879+0000 7f5f44b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f400c6c60 0x7f5f40152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.879+0000 7f5f44b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f400c8830 0x7f5f4015bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.880+0000 7f5f44b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f401595a0 0x7f5f400c5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.880+0000 7f5f44b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4016b1a0 con 0x7f5f400c6c60 2023-10-09T08:14:50.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.880+0000 7f5f44b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4016a100 con 0x7f5f400c8830 2023-10-09T08:14:50.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.880+0000 7f5f44b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4016a3e0 con 0x7f5f401595a0 2023-10-09T08:14:50.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.880+0000 7f5f3f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f400c6c60 0x7f5f40152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:50.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.880+0000 7f5f3f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f400c6c60 0x7f5f40152100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40218/0 (socket says 172.21.15.71:40218) 2023-10-09T08:14:50.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.880+0000 7f5f3f7fe700 1 -- 172.21.15.71:0/2274051063 learned_addr learned my addr 172.21.15.71:0/2274051063 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:50.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.880+0000 7f5f3f7fe700 1 -- 172.21.15.71:0/2274051063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f401595a0 msgr2=0x7f5f400c5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:50.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.880+0000 7f5f3f7fe700 1 --2- 172.21.15.71:0/2274051063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f401595a0 0x7f5f400c5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.880+0000 7f5f3f7fe700 1 -- 172.21.15.71:0/2274051063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f400c8830 msgr2=0x7f5f4015bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:50.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.880+0000 7f5f3f7fe700 1 --2- 172.21.15.71:0/2274051063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f400c8830 0x7f5f4015bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:50.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.880+0000 7f5f3f7fe700 1 -- 172.21.15.71:0/2274051063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f30009420 con 0x7f5f400c6c60 2023-10-09T08:14:50.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.880+0000 7f5f3f7fe700 1 --2- 172.21.15.71:0/2274051063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f400c6c60 0x7f5f40152100 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f5f40064340 tx=0x7f5f30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:50.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.881+0000 7f5f277fe700 1 -- 172.21.15.71:0/2274051063 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3001f070 con 0x7f5f400c6c60 2023-10-09T08:14:50.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.881+0000 7f5f277fe700 1 -- 172.21.15.71:0/2274051063 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3000b9d0 con 0x7f5f400c6c60 2023-10-09T08:14:50.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.881+0000 7f5f44b9d700 1 -- 172.21.15.71:0/2274051063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4016a6c0 con 0x7f5f400c6c60 2023-10-09T08:14:50.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.881+0000 7f5f277fe700 1 -- 172.21.15.71:0/2274051063 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30025670 con 0x7f5f400c6c60 2023-10-09T08:14:50.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.881+0000 7f5f44b9d700 1 -- 172.21.15.71:0/2274051063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4016ac80 con 0x7f5f400c6c60 2023-10-09T08:14:50.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.882+0000 7f5f44b9d700 1 -- 172.21.15.71:0/2274051063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f4016ae70 con 0x7f5f400c6c60 2023-10-09T08:14:50.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.883+0000 7f5f277fe700 1 -- 172.21.15.71:0/2274051063 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f30023070 con 0x7f5f400c6c60 2023-10-09T08:14:50.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.883+0000 7f5f277fe700 1 --2- 172.21.15.71:0/2274051063 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5f2c066f30 0x7f5f2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:50.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.884+0000 7f5f277fe700 1 -- 172.21.15.71:0/2274051063 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f5f30085c80 con 0x7f5f400c6c60 2023-10-09T08:14:50.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.884+0000 7f5f3effd700 1 --2- 172.21.15.71:0/2274051063 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5f2c066f30 0x7f5f2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:50.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.885+0000 7f5f3effd700 1 --2- 172.21.15.71:0/2274051063 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5f2c066f30 0x7f5f2c0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5f400c31e0 tx=0x7f5f34007b40 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:50.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:50.888+0000 7f5f277fe700 1 -- 172.21.15.71:0/2274051063 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f30052d00 con 0x7f5f400c6c60 2023-10-09T08:14:51.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:51.121+0000 7f5f44b9d700 1 -- 172.21.15.71:0/2274051063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5f4004c3c0 con 0x7f5f400c6c60 2023-10-09T08:14:51.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:51.122+0000 7f5f277fe700 1 -- 172.21.15.71:0/2274051063 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v89) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5f30015070 con 0x7f5f400c6c60 2023-10-09T08:14:51.122 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T08:14:51.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:51.124+0000 7f5f44b9d700 1 -- 172.21.15.71:0/2274051063 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5f2c066f30 msgr2=0x7f5f2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:51.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:51.124+0000 7f5f44b9d700 1 --2- 172.21.15.71:0/2274051063 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5f2c066f30 0x7f5f2c0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5f400c31e0 tx=0x7f5f34007b40 comp rx=0 tx=0).stop 2023-10-09T08:14:51.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:51.124+0000 7f5f44b9d700 1 -- 172.21.15.71:0/2274051063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f400c6c60 msgr2=0x7f5f40152100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:51.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:51.124+0000 7f5f44b9d700 1 --2- 172.21.15.71:0/2274051063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f400c6c60 0x7f5f40152100 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f5f40064340 tx=0x7f5f30017000 comp rx=0 tx=0).stop 2023-10-09T08:14:51.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:51.124+0000 7f5f44b9d700 1 -- 172.21.15.71:0/2274051063 shutdown_connections 2023-10-09T08:14:51.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:51.124+0000 7f5f44b9d700 1 --2- 172.21.15.71:0/2274051063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f401595a0 0x7f5f400c5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:51.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:51.124+0000 7f5f44b9d700 1 --2- 172.21.15.71:0/2274051063 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5f2c066f30 0x7f5f2c0693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:51.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:51.124+0000 7f5f44b9d700 1 --2- 172.21.15.71:0/2274051063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f400c6c60 0x7f5f40152100 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:51.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:51.124+0000 7f5f44b9d700 1 --2- 172.21.15.71:0/2274051063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f400c8830 0x7f5f4015bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:51.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:51.124+0000 7f5f44b9d700 1 -- 172.21.15.71:0/2274051063 >> 172.21.15.71:0/2274051063 conn(0x7f5f4006ddb0 msgr2=0x7f5f40153dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:51.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:51.124+0000 7f5f44b9d700 1 -- 172.21.15.71:0/2274051063 shutdown_connections 2023-10-09T08:14:51.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:51.124+0000 7f5f44b9d700 1 -- 172.21.15.71:0/2274051063 wait complete. 2023-10-09T08:14:51.141 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T08:14:51.141 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T08:14:51.142 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2023-10-09T08:14:51.142 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T08:14:51.142 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T08:14:51.142 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T08:14:51.142 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T08:14:51.142 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T08:14:51.142 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T08:14:51.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:14:51.143 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2023-10-09T08:14:51.179 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T08:14:51.180 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T08:14:51.180 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T08:14:51.180 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T08:14:51.180 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-10-09T08:14:51.180 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T08:14:51.180 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T08:14:51.180 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2023-10-09T08:14:51.180 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2023-10-09T08:14:51.180 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T08:14:51.181 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2023-10-09T08:14:51.181 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2023-10-09T08:14:51.181 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T08:14:51.181 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2023-10-09T08:14:51.181 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T08:14:51.181 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2023-10-09T08:14:51.181 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T08:14:51.181 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 36745sec preferred_lft 36745sec 2023-10-09T08:14:51.181 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2023-10-09T08:14:51.181 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T08:14:51.182 INFO:teuthology.orchestra.run.smithi071.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T08:14:51.182 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5a:a1:ec:c7:41:8f brd ff:ff:ff:ff:ff:ff 2023-10-09T08:14:51.182 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T08:14:51.182 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T08:14:51.182 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::8052:a9ff:fe85:8756/64 scope link 2023-10-09T08:14:51.182 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T08:14:51.182 INFO:teuthology.orchestra.run.smithi071.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T08:14:51.182 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether ae:1f:c9:59:0c:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T08:14:51.182 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ac1f:c9ff:fe59:c1b/64 scope link 2023-10-09T08:14:51.182 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T08:14:51.182 INFO:teuthology.orchestra.run.smithi071.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T08:14:51.183 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5a:a1:ec:c7:41:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T08:14:51.183 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::58a1:ecff:fec7:418f/64 scope link 2023-10-09T08:14:51.183 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T08:14:51.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:14:51.183 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T08:14:51.279 INFO:teuthology.orchestra.run.smithi071.stdout:1 2023-10-09T08:14:51.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:14:51.282 DEBUG:teuthology.orchestra.run.smithi071:> route 2023-10-09T08:14:51.321 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2023-10-09T08:14:51.321 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T08:14:51.321 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T08:14:51.321 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T08:14:51.321 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T08:14:51.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:14:51.322 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-09T08:14:51.322 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-09T08:14:51.323 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T08:14:51.323 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T08:14:51.323 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T08:14:51.323 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-09T08:14:51.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:14:51.517 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-09T08:14:51.553 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T08:14:51.553 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T08:14:51.554 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T08:14:51.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:14:51.554 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2023-10-09T08:14:51.655 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T08:14:51.655 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T08:14:51.692 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T08:14:51.692 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T08:14:51.692 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T08:14:51.767 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T08:14:51.767 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T08:14:51.767 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T08:14:51.897 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T08:14:51.898 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T08:14:51.926 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T08:14:51.927 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T08:14:51.927 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.71:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-09T08:14:51.927 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with new device syntax: 0@604c5619-653a-4ab6-912c-ab2e5464fe4a.cephfs=/ 2023-10-09T08:14:51.927 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.71:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-10-09T08:14:51.932 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T08:14:51.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:14:51.932 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T08:14:51.995 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T08:14:52.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.176+0000 7fbdffbff700 1 Processor -- start 2023-10-09T08:14:52.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.176+0000 7fbdffbff700 1 -- start start 2023-10-09T08:14:52.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.177+0000 7fbdffbff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbdf80b1420 0x7fbdf80ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:52.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.177+0000 7fbdffbff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbdf80ccf90 0x7fbdf80c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:52.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.177+0000 7fbdffbff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf80cc300 con 0x7fbdf80cbf30 2023-10-09T08:14:52.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.177+0000 7fbdffbff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf8156bf0 con 0x7fbdf80ccf90 2023-10-09T08:14:52.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.177+0000 7fbdffbff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf80ae950 con 0x7fbdf80b1420 2023-10-09T08:14:52.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.178+0000 7fbdfd99b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fbdf80cbf30 0x7fbdf80b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44066/0 (socket says 172.21.15.71:44066) 2023-10-09T08:14:52.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.178+0000 7fbdfd99b700 1 -- 172.21.15.71:0/168270083 learned_addr learned my addr 172.21.15.71:0/168270083 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:52.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.178+0000 7fbdfe19c700 1 --2- 172.21.15.71:0/168270083 >> v2:172.21.15.71:3300/0 conn(0x7fbdf80ccf90 0x7fbdf80c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:52.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.178+0000 7fbdfc999700 1 -- 172.21.15.71:0/168270083 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038920995 0 0) 0x7fbdf80cc300 con 0x7fbdf80cbf30 2023-10-09T08:14:52.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.178+0000 7fbdfd19a700 1 --2- 172.21.15.71:0/168270083 >> v2:172.21.15.179:3300/0 conn(0x7fbdf80b1420 0x7fbdf80ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:52.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.178+0000 7fbdfc999700 1 -- 172.21.15.71:0/168270083 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbde4003570 con 0x7fbdf80cbf30 2023-10-09T08:14:52.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.178+0000 7fbdfe19c700 1 -- 172.21.15.71:0/168270083 >> v2:172.21.15.179:3300/0 conn(0x7fbdf80b1420 msgr2=0x7fbdf80ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:52.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.178+0000 7fbdfe19c700 1 --2- 172.21.15.71:0/168270083 >> v2:172.21.15.179:3300/0 conn(0x7fbdf80b1420 0x7fbdf80ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:52.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.178+0000 7fbdfe19c700 1 -- 172.21.15.71:0/168270083 >> v1:172.21.15.71:6789/0 conn(0x7fbdf80cbf30 legacy=0x7fbdf80b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:52.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.178+0000 7fbdfe19c700 1 -- 172.21.15.71:0/168270083 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf80ad370 con 0x7fbdf80ccf90 2023-10-09T08:14:52.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.178+0000 7fbdfd19a700 1 --2- 172.21.15.71:0/168270083 >> v2:172.21.15.179:3300/0 conn(0x7fbdf80b1420 0x7fbdf80ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:14:52.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.178+0000 7fbdfe19c700 1 --2- 172.21.15.71:0/168270083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdf80ccf90 0x7fbdf80c9740 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fbdf80c9280 tx=0x7fbdf0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a58e506db0ab74 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:52.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.179+0000 7fbdfc999700 1 -- 172.21.15.71:0/168270083 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf000e070 con 0x7fbdf80ccf90 2023-10-09T08:14:52.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.179+0000 7fbdfc999700 1 -- 172.21.15.71:0/168270083 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf000bb20 con 0x7fbdf80ccf90 2023-10-09T08:14:52.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.179+0000 7fbdfc999700 1 -- 172.21.15.71:0/168270083 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0012430 con 0x7fbdf80ccf90 2023-10-09T08:14:52.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.179+0000 7fbdffbff700 1 -- 172.21.15.71:0/168270083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdf80ccf90 msgr2=0x7fbdf80c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:52.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.179+0000 7fbdffbff700 1 --2- 172.21.15.71:0/168270083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdf80ccf90 0x7fbdf80c9740 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fbdf80c9280 tx=0x7fbdf0009780 comp rx=0 tx=0).stop 2023-10-09T08:14:52.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.179+0000 7fbdffbff700 1 -- 172.21.15.71:0/168270083 shutdown_connections 2023-10-09T08:14:52.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.179+0000 7fbdffbff700 1 --2- 172.21.15.71:0/168270083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdf80ccf90 0x7fbdf80c9740 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:52.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.179+0000 7fbdffbff700 1 --2- 172.21.15.71:0/168270083 >> v2:172.21.15.179:3300/0 conn(0x7fbdf80b1420 0x7fbdf80ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:52.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.179+0000 7fbdffbff700 1 -- 172.21.15.71:0/168270083 >> 172.21.15.71:0/168270083 conn(0x7fbdf806a320 msgr2=0x7fbdf80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:52.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.179+0000 7fbdffbff700 1 -- 172.21.15.71:0/168270083 shutdown_connections 2023-10-09T08:14:52.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.179+0000 7fbdffbff700 1 -- 172.21.15.71:0/168270083 wait complete. 2023-10-09T08:14:52.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.181+0000 7fbdffbff700 1 Processor -- start 2023-10-09T08:14:52.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.181+0000 7fbdffbff700 1 -- start start 2023-10-09T08:14:52.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.182+0000 7fbdffbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdf80b1420 0x7fbdf8155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:52.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.182+0000 7fbdffbff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdf80cbf30 0x7fbdf80abc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:52.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.182+0000 7fbdffbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdf80ccf90 0x7fbdf81579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:52.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.182+0000 7fbdffbff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf8156340 con 0x7fbdf80cbf30 2023-10-09T08:14:52.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.182+0000 7fbdffbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf80ac1d0 con 0x7fbdf80ccf90 2023-10-09T08:14:52.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.182+0000 7fbdffbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf8157ef0 con 0x7fbdf80b1420 2023-10-09T08:14:52.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.182+0000 7fbdfd19a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdf80cbf30 0x7fbdf80abc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:52.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.182+0000 7fbdfd19a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdf80cbf30 0x7fbdf80abc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40242/0 (socket says 172.21.15.71:40242) 2023-10-09T08:14:52.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.182+0000 7fbdfd19a700 1 -- 172.21.15.71:0/983828401 learned_addr learned my addr 172.21.15.71:0/983828401 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:52.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.182+0000 7fbdfe19c700 1 --2- 172.21.15.71:0/983828401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdf80ccf90 0x7fbdf81579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:52.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.182+0000 7fbdfd99b700 1 --2- 172.21.15.71:0/983828401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdf80b1420 0x7fbdf8155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:52.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.183+0000 7fbdfd19a700 1 -- 172.21.15.71:0/983828401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdf80b1420 msgr2=0x7fbdf8155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:52.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.183+0000 7fbdfd19a700 1 --2- 172.21.15.71:0/983828401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdf80b1420 0x7fbdf8155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:52.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.183+0000 7fbdfd19a700 1 -- 172.21.15.71:0/983828401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdf80ccf90 msgr2=0x7fbdf81579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:52.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.183+0000 7fbdfd19a700 1 --2- 172.21.15.71:0/983828401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdf80ccf90 0x7fbdf81579b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:52.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.183+0000 7fbdfd19a700 1 -- 172.21.15.71:0/983828401 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf0009a20 con 0x7fbdf80cbf30 2023-10-09T08:14:52.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.183+0000 7fbdfd19a700 1 --2- 172.21.15.71:0/983828401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdf80cbf30 0x7fbdf80abc90 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fbde800c800 tx=0x7fbde8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:52.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.183+0000 7fbdedffb700 1 -- 172.21.15.71:0/983828401 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8011600 con 0x7fbdf80cbf30 2023-10-09T08:14:52.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.183+0000 7fbdedffb700 1 -- 172.21.15.71:0/983828401 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde8011760 con 0x7fbdf80cbf30 2023-10-09T08:14:52.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.183+0000 7fbdedffb700 1 -- 172.21.15.71:0/983828401 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8011b20 con 0x7fbdf80cbf30 2023-10-09T08:14:52.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.183+0000 7fbdffbff700 1 -- 172.21.15.71:0/983828401 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf814fd50 con 0x7fbdf80cbf30 2023-10-09T08:14:52.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.183+0000 7fbdffbff700 1 -- 172.21.15.71:0/983828401 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf81502d0 con 0x7fbdf80cbf30 2023-10-09T08:14:52.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.184+0000 7fbdffbff700 1 -- 172.21.15.71:0/983828401 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf804c3c0 con 0x7fbdf80cbf30 2023-10-09T08:14:52.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.185+0000 7fbdedffb700 1 -- 172.21.15.71:0/983828401 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbde80193b0 con 0x7fbdf80cbf30 2023-10-09T08:14:52.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.186+0000 7fbdedffb700 1 --2- 172.21.15.71:0/983828401 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbddc066f30 0x7fbddc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:52.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.186+0000 7fbdedffb700 1 -- 172.21.15.71:0/983828401 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6197+0+0 (secure 0 0 0) 0x7fbde80846b0 con 0x7fbdf80cbf30 2023-10-09T08:14:52.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.186+0000 7fbdfd99b700 1 --2- 172.21.15.71:0/983828401 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbddc066f30 0x7fbddc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:52.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.187+0000 7fbdfd99b700 1 --2- 172.21.15.71:0/983828401 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbddc066f30 0x7fbddc0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4007fd0 tx=0x7fbdf4009040 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:52.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.190+0000 7fbdedffb700 1 -- 172.21.15.71:0/983828401 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbde8051690 con 0x7fbdf80cbf30 2023-10-09T08:14:52.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.405+0000 7fbdffbff700 1 -- 172.21.15.71:0/983828401 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdf80ad650 con 0x7fbddc066f30 2023-10-09T08:14:52.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.407+0000 7fbdedffb700 1 -- 172.21.15.71:0/983828401 <== mgr.8965 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fbdf80ad650 con 0x7fbddc066f30 2023-10-09T08:14:52.408 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-09T08:14:52.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:14:52.408 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cephfs" 2023-10-09T08:14:52.408 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:14:52.408 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-09T08:14:52.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.409+0000 7fbdffbff700 1 -- 172.21.15.71:0/983828401 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbddc066f30 msgr2=0x7fbddc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:52.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.409+0000 7fbdffbff700 1 --2- 172.21.15.71:0/983828401 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbddc066f30 0x7fbddc0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4007fd0 tx=0x7fbdf4009040 comp rx=0 tx=0).stop 2023-10-09T08:14:52.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.409+0000 7fbdffbff700 1 -- 172.21.15.71:0/983828401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdf80cbf30 msgr2=0x7fbdf80abc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:52.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.409+0000 7fbdffbff700 1 --2- 172.21.15.71:0/983828401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdf80cbf30 0x7fbdf80abc90 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fbde800c800 tx=0x7fbde8008040 comp rx=0 tx=0).stop 2023-10-09T08:14:52.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.409+0000 7fbdffbff700 1 -- 172.21.15.71:0/983828401 shutdown_connections 2023-10-09T08:14:52.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.409+0000 7fbdffbff700 1 --2- 172.21.15.71:0/983828401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdf80ccf90 0x7fbdf81579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:52.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.409+0000 7fbdffbff700 1 --2- 172.21.15.71:0/983828401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdf80b1420 0x7fbdf8155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:52.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.409+0000 7fbdffbff700 1 --2- 172.21.15.71:0/983828401 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbddc066f30 0x7fbddc0693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:52.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.409+0000 7fbdffbff700 1 --2- 172.21.15.71:0/983828401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdf80cbf30 0x7fbdf80abc90 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:52.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.409+0000 7fbdffbff700 1 -- 172.21.15.71:0/983828401 >> 172.21.15.71:0/983828401 conn(0x7fbdf806a320 msgr2=0x7fbdf80b0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:52.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.409+0000 7fbdffbff700 1 -- 172.21.15.71:0/983828401 shutdown_connections 2023-10-09T08:14:52.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.409+0000 7fbdffbff700 1 -- 172.21.15.71:0/983828401 wait complete. 2023-10-09T08:14:52.427 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-09T08:14:52.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.609+0000 7f45c5dff700 1 Processor -- start 2023-10-09T08:14:52.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.609+0000 7f45c5dff700 1 -- start start 2023-10-09T08:14:52.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.610+0000 7f45c5dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f45c0155eb0 0x7f45c006e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:52.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.610+0000 7f45c5dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f45c00c70b0 0x7f45c0069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:52.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.610+0000 7f45c5dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c006eb90 con 0x7f45c0069cb0 2023-10-09T08:14:52.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.610+0000 7f45c5dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c006a130 con 0x7f45c00c70b0 2023-10-09T08:14:52.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.610+0000 7f45c5dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c00cd350 con 0x7f45c0155eb0 2023-10-09T08:14:52.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.611+0000 7f45beffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f45c00c70b0 0x7f45c0069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:52.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.611+0000 7f45beffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f45c00c70b0 0x7f45c0069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40244/0 (socket says 172.21.15.71:40244) 2023-10-09T08:14:52.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.611+0000 7f45beffd700 1 -- 172.21.15.71:0/3529075052 learned_addr learned my addr 172.21.15.71:0/3529075052 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:52.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.611+0000 7f45bf7fe700 1 --2- 172.21.15.71:0/3529075052 >> v2:172.21.15.179:3300/0 conn(0x7f45c0155eb0 0x7f45c006e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:52.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.611+0000 7f45beffd700 1 -- 172.21.15.71:0/3529075052 >> v2:172.21.15.179:3300/0 conn(0x7f45c0155eb0 msgr2=0x7f45c006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:52.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.611+0000 7f45beffd700 1 --2- 172.21.15.71:0/3529075052 >> v2:172.21.15.179:3300/0 conn(0x7f45c0155eb0 0x7f45c006e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:52.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.611+0000 7f45beffd700 1 -- 172.21.15.71:0/3529075052 >> v1:172.21.15.179:6789/0 conn(0x7f45c0069cb0 legacy=0x7f45c00ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:52.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.611+0000 7f45beffd700 1 -- 172.21.15.71:0/3529075052 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c006ee70 con 0x7f45c00c70b0 2023-10-09T08:14:52.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.611+0000 7f45beffd700 1 --2- 172.21.15.71:0/3529075052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c00c70b0 0x7f45c0069770 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f45c0065160 tx=0x7f45b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f6f20aad3e51cf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:52.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.612+0000 7f45be7fc700 1 -- 172.21.15.71:0/3529075052 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b4009e70 con 0x7f45c00c70b0 2023-10-09T08:14:52.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.612+0000 7f45be7fc700 1 -- 172.21.15.71:0/3529075052 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b400b860 con 0x7f45c00c70b0 2023-10-09T08:14:52.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.612+0000 7f45be7fc700 1 -- 172.21.15.71:0/3529075052 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b400bc00 con 0x7f45c00c70b0 2023-10-09T08:14:52.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.612+0000 7f45c5dff700 1 -- 172.21.15.71:0/3529075052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c00c70b0 msgr2=0x7f45c0069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:52.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.612+0000 7f45c5dff700 1 --2- 172.21.15.71:0/3529075052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c00c70b0 0x7f45c0069770 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f45c0065160 tx=0x7f45b4009250 comp rx=0 tx=0).stop 2023-10-09T08:14:52.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.612+0000 7f45c5dff700 1 -- 172.21.15.71:0/3529075052 shutdown_connections 2023-10-09T08:14:52.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.612+0000 7f45c5dff700 1 --2- 172.21.15.71:0/3529075052 >> v2:172.21.15.179:3300/0 conn(0x7f45c0155eb0 0x7f45c006e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:52.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.612+0000 7f45c5dff700 1 --2- 172.21.15.71:0/3529075052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c00c70b0 0x7f45c0069770 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:52.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.612+0000 7f45c5dff700 1 -- 172.21.15.71:0/3529075052 >> 172.21.15.71:0/3529075052 conn(0x7f45c0068e10 msgr2=0x7f45c00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:52.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.612+0000 7f45c5dff700 1 -- 172.21.15.71:0/3529075052 shutdown_connections 2023-10-09T08:14:52.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.613+0000 7f45c5dff700 1 -- 172.21.15.71:0/3529075052 wait complete. 2023-10-09T08:14:52.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.614+0000 7f45c5dff700 1 Processor -- start 2023-10-09T08:14:52.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.614+0000 7f45c5dff700 1 -- start start 2023-10-09T08:14:52.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.615+0000 7f45c5dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c0069cb0 0x7f45c00c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:52.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.615+0000 7f45c5dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45c00c70b0 0x7f45c016d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:52.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.615+0000 7f45c5dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45c0155eb0 0x7f45c016d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:52.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.615+0000 7f45c5dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c00ae400 con 0x7f45c0069cb0 2023-10-09T08:14:52.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.615+0000 7f45c5dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c00ad550 con 0x7f45c00c70b0 2023-10-09T08:14:52.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.615+0000 7f45c5dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c00ad7f0 con 0x7f45c0155eb0 2023-10-09T08:14:52.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.615+0000 7f45bf7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c0069cb0 0x7f45c00c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:52.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.615+0000 7f45bf7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c0069cb0 0x7f45c00c35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40250/0 (socket says 172.21.15.71:40250) 2023-10-09T08:14:52.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.615+0000 7f45bf7fe700 1 -- 172.21.15.71:0/3065911701 learned_addr learned my addr 172.21.15.71:0/3065911701 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:52.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.615+0000 7f45beffd700 1 --2- 172.21.15.71:0/3065911701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45c00c70b0 0x7f45c016d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:52.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.615+0000 7f45bffff700 1 --2- 172.21.15.71:0/3065911701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45c0155eb0 0x7f45c016d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:52.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.615+0000 7f45bf7fe700 1 -- 172.21.15.71:0/3065911701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45c0155eb0 msgr2=0x7f45c016d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:52.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.616+0000 7f45bf7fe700 1 --2- 172.21.15.71:0/3065911701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45c0155eb0 0x7f45c016d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:52.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.616+0000 7f45bf7fe700 1 -- 172.21.15.71:0/3065911701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45c00c70b0 msgr2=0x7f45c016d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:52.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.616+0000 7f45bf7fe700 1 --2- 172.21.15.71:0/3065911701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45c00c70b0 0x7f45c016d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:52.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.616+0000 7f45bf7fe700 1 -- 172.21.15.71:0/3065911701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b40094f0 con 0x7f45c0069cb0 2023-10-09T08:14:52.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.616+0000 7f45bffff700 1 --2- 172.21.15.71:0/3065911701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45c0155eb0 0x7f45c016d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:14:52.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.616+0000 7f45beffd700 1 --2- 172.21.15.71:0/3065911701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45c00c70b0 0x7f45c016d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:14:52.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.616+0000 7f45bf7fe700 1 --2- 172.21.15.71:0/3065911701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c0069cb0 0x7f45c00c35e0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f45b000e950 tx=0x7f45b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:52.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.616+0000 7f45a77fe700 1 -- 172.21.15.71:0/3065911701 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b000c850 con 0x7f45c0069cb0 2023-10-09T08:14:52.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.616+0000 7f45a77fe700 1 -- 172.21.15.71:0/3065911701 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b000c9b0 con 0x7f45c0069cb0 2023-10-09T08:14:52.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.616+0000 7f45c5dff700 1 -- 172.21.15.71:0/3065911701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c00adad0 con 0x7f45c0069cb0 2023-10-09T08:14:52.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.616+0000 7f45a77fe700 1 -- 172.21.15.71:0/3065911701 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b000cdb0 con 0x7f45c0069cb0 2023-10-09T08:14:52.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.616+0000 7f45c5dff700 1 -- 172.21.15.71:0/3065911701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c00ae090 con 0x7f45c0069cb0 2023-10-09T08:14:52.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.617+0000 7f45c5dff700 1 -- 172.21.15.71:0/3065911701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c004c3c0 con 0x7f45c0069cb0 2023-10-09T08:14:52.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.618+0000 7f45a77fe700 1 -- 172.21.15.71:0/3065911701 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 91) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f45b0013680 con 0x7f45c0069cb0 2023-10-09T08:14:52.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.619+0000 7f45a77fe700 1 --2- 172.21.15.71:0/3065911701 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f45ac066f30 0x7f45ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:52.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.619+0000 7f45a77fe700 1 -- 172.21.15.71:0/3065911701 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f45b00849f0 con 0x7f45c0069cb0 2023-10-09T08:14:52.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.619+0000 7f45beffd700 1 --2- 172.21.15.71:0/3065911701 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f45ac066f30 0x7f45ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:52.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.620+0000 7f45beffd700 1 --2- 172.21.15.71:0/3065911701 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f45ac066f30 0x7f45ac0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f45c0065160 tx=0x7f45b4017000 comp rx=0 tx=0).ready entity=mgr.8965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:52.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.623+0000 7f45a77fe700 1 -- 172.21.15.71:0/3065911701 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45b00519d0 con 0x7f45c0069cb0 2023-10-09T08:14:52.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.864+0000 7f45c5dff700 1 -- 172.21.15.71:0/3065911701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f45c006f150 con 0x7f45c0069cb0 2023-10-09T08:14:52.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.938+0000 7f45a77fe700 1 -- 172.21.15.71:0/3065911701 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 92) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f45b0086d50 con 0x7f45c0069cb0 2023-10-09T08:14:52.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.940+0000 7f45a77fe700 1 -- 172.21.15.71:0/3065911701 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v92) v1 ==== 92+0+0 (secure 0 0 0) 0x7f45b00519d0 con 0x7f45c0069cb0 2023-10-09T08:14:52.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.943+0000 7f45c5dff700 1 -- 172.21.15.71:0/3065911701 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f45ac066f30 msgr2=0x7f45ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:52.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.943+0000 7f45c5dff700 1 --2- 172.21.15.71:0/3065911701 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f45ac066f30 0x7f45ac0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f45c0065160 tx=0x7f45b4017000 comp rx=0 tx=0).stop 2023-10-09T08:14:52.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.943+0000 7f45c5dff700 1 -- 172.21.15.71:0/3065911701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c0069cb0 msgr2=0x7f45c00c35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:52.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.943+0000 7f45c5dff700 1 --2- 172.21.15.71:0/3065911701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c0069cb0 0x7f45c00c35e0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f45b000e950 tx=0x7f45b00091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:52.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.943+0000 7f45c5dff700 1 -- 172.21.15.71:0/3065911701 shutdown_connections 2023-10-09T08:14:52.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.943+0000 7f45c5dff700 1 --2- 172.21.15.71:0/3065911701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45c0155eb0 0x7f45c016d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:52.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.943+0000 7f45c5dff700 1 --2- 172.21.15.71:0/3065911701 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f45ac066f30 0x7f45ac0693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:52.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.943+0000 7f45c5dff700 1 --2- 172.21.15.71:0/3065911701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45c0069cb0 0x7f45c00c35e0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:52.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.943+0000 7f45c5dff700 1 --2- 172.21.15.71:0/3065911701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45c00c70b0 0x7f45c016d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:52.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.943+0000 7f45c5dff700 1 -- 172.21.15.71:0/3065911701 >> 172.21.15.71:0/3065911701 conn(0x7f45c0068e10 msgr2=0x7f45c00aa270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:52.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.943+0000 7f45c5dff700 1 -- 172.21.15.71:0/3065911701 shutdown_connections 2023-10-09T08:14:52.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:52.943+0000 7f45c5dff700 1 -- 172.21.15.71:0/3065911701 wait complete. 2023-10-09T08:14:52.963 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-09T08:14:53.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.151+0000 7f06ca79d700 1 Processor -- start 2023-10-09T08:14:53.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.152+0000 7f06ca79d700 1 -- start start 2023-10-09T08:14:53.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.153+0000 7f06ca79d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06c4159a60 0x7f06c40c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:53.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.153+0000 7f06ca79d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f06c40ccc00 0x7f06c4069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:53.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.153+0000 7f06ca79d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f06c406a020 0x7f06c40cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:53.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.153+0000 7f06ca79d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c406dfc0 con 0x7f06c40ccc00 2023-10-09T08:14:53.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.153+0000 7f06ca79d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c40c9cb0 con 0x7f06c406a020 2023-10-09T08:14:53.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.153+0000 7f06ca79d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c40c9f30 con 0x7f06c4159a60 2023-10-09T08:14:53.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.153+0000 7f06c8f9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f06c40ccc00 0x7f06c4069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:53.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.153+0000 7f06c8f9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f06c40ccc00 0x7f06c4069ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40278/0 (socket says 172.21.15.71:40278) 2023-10-09T08:14:53.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.153+0000 7f06c8f9a700 1 -- 172.21.15.71:0/38616818 learned_addr learned my addr 172.21.15.71:0/38616818 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:53.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.153+0000 7f06c979b700 1 --2- 172.21.15.71:0/38616818 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06c4159a60 0x7f06c40c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:53.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.153+0000 7f06c9f9c700 1 --2- 172.21.15.71:0/38616818 >> v2:172.21.15.179:3300/0 conn(0x7f06c406a020 0x7f06c40cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:53.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.154+0000 7f06c8f9a700 1 -- 172.21.15.71:0/38616818 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06c4159a60 msgr2=0x7f06c40c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:53.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.154+0000 7f06c8f9a700 1 --2- 172.21.15.71:0/38616818 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06c4159a60 0x7f06c40c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:53.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.154+0000 7f06c8f9a700 1 -- 172.21.15.71:0/38616818 >> v2:172.21.15.179:3300/0 conn(0x7f06c406a020 msgr2=0x7f06c40cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:53.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.154+0000 7f06c8f9a700 1 --2- 172.21.15.71:0/38616818 >> v2:172.21.15.179:3300/0 conn(0x7f06c406a020 0x7f06c40cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:53.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.154+0000 7f06c8f9a700 1 -- 172.21.15.71:0/38616818 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c40ca470 con 0x7f06c40ccc00 2023-10-09T08:14:53.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.154+0000 7f06c9f9c700 1 --2- 172.21.15.71:0/38616818 >> v2:172.21.15.179:3300/0 conn(0x7f06c406a020 0x7f06c40cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:14:53.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.154+0000 7f06c8f9a700 1 --2- 172.21.15.71:0/38616818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c40ccc00 0x7f06c4069ae0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f06c40cf6a0 tx=0x7f06b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127f97db23974aee server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:53.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.154+0000 7f06bbfff700 1 -- 172.21.15.71:0/38616818 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b4009e70 con 0x7f06c40ccc00 2023-10-09T08:14:53.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.154+0000 7f06bbfff700 1 -- 172.21.15.71:0/38616818 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b400b8f0 con 0x7f06c40ccc00 2023-10-09T08:14:53.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.154+0000 7f06bbfff700 1 -- 172.21.15.71:0/38616818 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b400bc90 con 0x7f06c40ccc00 2023-10-09T08:14:53.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.155+0000 7f06ca79d700 1 -- 172.21.15.71:0/38616818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c40ccc00 msgr2=0x7f06c4069ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:53.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.155+0000 7f06ca79d700 1 --2- 172.21.15.71:0/38616818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c40ccc00 0x7f06c4069ae0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f06c40cf6a0 tx=0x7f06b4009250 comp rx=0 tx=0).stop 2023-10-09T08:14:53.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.155+0000 7f06ca79d700 1 -- 172.21.15.71:0/38616818 shutdown_connections 2023-10-09T08:14:53.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.155+0000 7f06ca79d700 1 --2- 172.21.15.71:0/38616818 >> v2:172.21.15.179:3300/0 conn(0x7f06c406a020 0x7f06c40cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:53.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.155+0000 7f06ca79d700 1 --2- 172.21.15.71:0/38616818 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06c4159a60 0x7f06c40c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:53.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.155+0000 7f06ca79d700 1 --2- 172.21.15.71:0/38616818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c40ccc00 0x7f06c4069ae0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:53.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.155+0000 7f06ca79d700 1 -- 172.21.15.71:0/38616818 >> 172.21.15.71:0/38616818 conn(0x7f06c406baa0 msgr2=0x7f06c406bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:53.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.155+0000 7f06ca79d700 1 -- 172.21.15.71:0/38616818 shutdown_connections 2023-10-09T08:14:53.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.155+0000 7f06ca79d700 1 -- 172.21.15.71:0/38616818 wait complete. 2023-10-09T08:14:53.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.157+0000 7f06ca79d700 1 Processor -- start 2023-10-09T08:14:53.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.157+0000 7f06ca79d700 1 -- start start 2023-10-09T08:14:53.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.158+0000 7f06ca79d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06c406a020 0x7f06c40aae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:53.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.158+0000 7f06ca79d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06c40ccc00 0x7f06c40c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:53.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.158+0000 7f06ca79d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c4159a60 0x7f06c40c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:53.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.158+0000 7f06ca79d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c4155d20 con 0x7f06c4159a60 2023-10-09T08:14:53.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.158+0000 7f06ca79d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c40aa970 con 0x7f06c406a020 2023-10-09T08:14:53.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.158+0000 7f06ca79d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c40a9d60 con 0x7f06c40ccc00 2023-10-09T08:14:53.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.158+0000 7f06c9f9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c4159a60 0x7f06c40c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:53.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.158+0000 7f06c9f9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c4159a60 0x7f06c40c4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40292/0 (socket says 172.21.15.71:40292) 2023-10-09T08:14:53.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.158+0000 7f06c979b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06c406a020 0x7f06c40aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:53.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.158+0000 7f06c9f9c700 1 -- 172.21.15.71:0/2972477666 learned_addr learned my addr 172.21.15.71:0/2972477666 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:53.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.158+0000 7f06c8f9a700 1 --2- 172.21.15.71:0/2972477666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06c40ccc00 0x7f06c40c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:53.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.158+0000 7f06c979b700 1 -- 172.21.15.71:0/2972477666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06c40ccc00 msgr2=0x7f06c40c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:53.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.158+0000 7f06c979b700 1 --2- 172.21.15.71:0/2972477666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06c40ccc00 0x7f06c40c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:53.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.158+0000 7f06c979b700 1 -- 172.21.15.71:0/2972477666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c4159a60 msgr2=0x7f06c40c4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:53.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.158+0000 7f06c979b700 1 --2- 172.21.15.71:0/2972477666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c4159a60 0x7f06c40c4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:53.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.158+0000 7f06c979b700 1 -- 172.21.15.71:0/2972477666 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b40094f0 con 0x7f06c406a020 2023-10-09T08:14:53.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.158+0000 7f06c9f9c700 1 --2- 172.21.15.71:0/2972477666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c4159a60 0x7f06c40c4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:14:53.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.159+0000 7f06c979b700 1 --2- 172.21.15.71:0/2972477666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06c406a020 0x7f06c40aae00 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f06c000e850 tx=0x7f06c00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:53.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.159+0000 7f06b97fa700 1 -- 172.21.15.71:0/2972477666 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c0013680 con 0x7f06c406a020 2023-10-09T08:14:53.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.159+0000 7f06b97fa700 1 -- 172.21.15.71:0/2972477666 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c00137e0 con 0x7f06c406a020 2023-10-09T08:14:53.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.159+0000 7f06ca79d700 1 -- 172.21.15.71:0/2972477666 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c40aa040 con 0x7f06c406a020 2023-10-09T08:14:53.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.159+0000 7f06b97fa700 1 -- 172.21.15.71:0/2972477666 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c0013ba0 con 0x7f06c406a020 2023-10-09T08:14:53.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.159+0000 7f06ca79d700 1 -- 172.21.15.71:0/2972477666 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c40aa600 con 0x7f06c406a020 2023-10-09T08:14:53.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.160+0000 7f06ca79d700 1 -- 172.21.15.71:0/2972477666 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c40aac50 con 0x7f06c406a020 2023-10-09T08:14:53.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.161+0000 7f06b97fa700 1 -- 172.21.15.71:0/2972477666 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 92) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f06c00123d0 con 0x7f06c406a020 2023-10-09T08:14:53.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.162+0000 7f06b97fa700 1 --2- 172.21.15.71:0/2972477666 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f06a8066f80 0x7f06a8069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:53.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.162+0000 7f06b97fa700 1 -- 172.21.15.71:0/2972477666 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f06c00845f0 con 0x7f06c406a020 2023-10-09T08:14:53.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.162+0000 7f06c8f9a700 1 -- 172.21.15.71:0/2972477666 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f06a8066f80 msgr2=0x7f06a8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:53.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.162+0000 7f06c8f9a700 1 --2- 172.21.15.71:0/2972477666 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f06a8066f80 0x7f06a8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:14:53.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.166+0000 7f06b97fa700 1 -- 172.21.15.71:0/2972477666 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06c00515d0 con 0x7f06c406a020 2023-10-09T08:14:53.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.363+0000 7f06c8f9a700 1 -- 172.21.15.71:0/2972477666 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f06a8066f80 msgr2=0x7f06a8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:53.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.363+0000 7f06c8f9a700 1 --2- 172.21.15.71:0/2972477666 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f06a8066f80 0x7f06a8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:14:53.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.367+0000 7f06ca79d700 1 -- 172.21.15.71:0/2972477666 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f06c40ca750 con 0x7f06c406a020 2023-10-09T08:14:53.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.373+0000 7f06b97fa700 1 -- 172.21.15.71:0/2972477666 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v65)=0 v65) v1 ==== 138+0+0 (secure 0 0 0) 0x7f06c0054bf0 con 0x7f06c406a020 2023-10-09T08:14:53.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.375+0000 7f06ca79d700 1 -- 172.21.15.71:0/2972477666 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f06a8066f80 msgr2=0x7f06a8069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:14:53.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.375+0000 7f06ca79d700 1 --2- 172.21.15.71:0/2972477666 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f06a8066f80 0x7f06a8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:53.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.375+0000 7f06ca79d700 1 -- 172.21.15.71:0/2972477666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06c406a020 msgr2=0x7f06c40aae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:53.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.375+0000 7f06ca79d700 1 --2- 172.21.15.71:0/2972477666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06c406a020 0x7f06c40aae00 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f06c000e850 tx=0x7f06c00091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:53.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.375+0000 7f06ca79d700 1 -- 172.21.15.71:0/2972477666 shutdown_connections 2023-10-09T08:14:53.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.375+0000 7f06ca79d700 1 --2- 172.21.15.71:0/2972477666 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f06a8066f80 0x7f06a8069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:53.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.375+0000 7f06ca79d700 1 --2- 172.21.15.71:0/2972477666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c4159a60 0x7f06c40c4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:53.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.375+0000 7f06ca79d700 1 --2- 172.21.15.71:0/2972477666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06c406a020 0x7f06c40aae00 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:53.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.375+0000 7f06ca79d700 1 --2- 172.21.15.71:0/2972477666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06c40ccc00 0x7f06c40c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:53.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.375+0000 7f06ca79d700 1 -- 172.21.15.71:0/2972477666 >> 172.21.15.71:0/2972477666 conn(0x7f06c406baa0 msgr2=0x7f06c41583a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:53.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.375+0000 7f06ca79d700 1 -- 172.21.15.71:0/2972477666 shutdown_connections 2023-10-09T08:14:53.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.375+0000 7f06ca79d700 1 -- 172.21.15.71:0/2972477666 wait complete. 2023-10-09T08:14:53.394 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-09T08:14:53.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.581+0000 7f791299d700 1 Processor -- start 2023-10-09T08:14:53.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.581+0000 7f791299d700 1 -- start start 2023-10-09T08:14:53.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.582+0000 7f791299d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f790c0b4e70 0x7f790c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:53.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.582+0000 7f791299d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f790c0cfb00 con 0x7f790c0b16d0 2023-10-09T08:14:53.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.582+0000 7f791299d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f790c15e060 con 0x7f790c0b1b40 2023-10-09T08:14:53.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.582+0000 7f791299d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f790c0b5c40 con 0x7f790c0b4e70 2023-10-09T08:14:53.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.582+0000 7f791119a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f790c0b16d0 0x7f790c15d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44080/0 (socket says 172.21.15.71:44080) 2023-10-09T08:14:53.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.582+0000 7f791119a700 1 -- 172.21.15.71:0/753112550 learned_addr learned my addr 172.21.15.71:0/753112550 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:14:53.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.582+0000 7f791199b700 1 --2- 172.21.15.71:0/753112550 >> v2:172.21.15.179:3300/0 conn(0x7f790c0b4e70 0x7f790c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:53.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.583+0000 7f7910999700 1 -- 172.21.15.71:0/753112550 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794406580 0 0) 0x7f790c0cfb00 con 0x7f790c0b16d0 2023-10-09T08:14:53.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.583+0000 7f7910999700 1 -- 172.21.15.71:0/753112550 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78f8003570 con 0x7f790c0b16d0 2023-10-09T08:14:53.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.583+0000 7f7910999700 1 -- 172.21.15.71:0/753112550 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097942720 0 0) 0x7f790c15e060 con 0x7f790c0b1b40 2023-10-09T08:14:53.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.583+0000 7f7910999700 1 -- 172.21.15.71:0/753112550 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f790c0cfb00 con 0x7f790c0b1b40 2023-10-09T08:14:53.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.583+0000 7f791199b700 1 -- 172.21.15.71:0/753112550 >> v1:172.21.15.179:6789/0 conn(0x7f790c0b1b40 legacy=0x7f790c15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:53.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.583+0000 7f791199b700 1 -- 172.21.15.71:0/753112550 >> v1:172.21.15.71:6789/0 conn(0x7f790c0b16d0 legacy=0x7f790c15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:53.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.583+0000 7f791199b700 1 -- 172.21.15.71:0/753112550 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c0b5f20 con 0x7f790c0b4e70 2023-10-09T08:14:53.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.583+0000 7f791199b700 1 --2- 172.21.15.71:0/753112550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f790c0b4e70 0x7f790c0ccff0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f79080098e0 tx=0x7f79080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=965f8a89db850fae server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:53.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.583+0000 7f7910999700 1 -- 172.21.15.71:0/753112550 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908011630 con 0x7f790c0b4e70 2023-10-09T08:14:53.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.584+0000 7f7910999700 1 -- 172.21.15.71:0/753112550 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7908011790 con 0x7f790c0b4e70 2023-10-09T08:14:53.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.584+0000 7f7910999700 1 -- 172.21.15.71:0/753112550 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908011b30 con 0x7f790c0b4e70 2023-10-09T08:14:53.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.584+0000 7f791299d700 1 -- 172.21.15.71:0/753112550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f790c0b4e70 msgr2=0x7f790c0ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:53.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.584+0000 7f791299d700 1 --2- 172.21.15.71:0/753112550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f790c0b4e70 0x7f790c0ccff0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f79080098e0 tx=0x7f79080091a0 comp rx=0 tx=0).stop 2023-10-09T08:14:53.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.584+0000 7f791299d700 1 -- 172.21.15.71:0/753112550 shutdown_connections 2023-10-09T08:14:53.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.584+0000 7f791299d700 1 --2- 172.21.15.71:0/753112550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f790c0b4e70 0x7f790c0ccff0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:53.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.584+0000 7f791299d700 1 -- 172.21.15.71:0/753112550 >> 172.21.15.71:0/753112550 conn(0x7f790c0d10c0 msgr2=0x7f790c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:53.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.584+0000 7f791299d700 1 -- 172.21.15.71:0/753112550 shutdown_connections 2023-10-09T08:14:53.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.584+0000 7f791299d700 1 -- 172.21.15.71:0/753112550 wait complete. 2023-10-09T08:14:53.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.586+0000 7f791299d700 1 Processor -- start 2023-10-09T08:14:53.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.586+0000 7f791299d700 1 -- start start 2023-10-09T08:14:53.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.587+0000 7f791299d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f790c0b16d0 0x7f790c16aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:53.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.587+0000 7f791299d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f790c0b1b40 0x7f790c0ae820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:53.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.587+0000 7f791299d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f790c0b4e70 0x7f790c0ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:53.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.587+0000 7f791299d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c16afe0 con 0x7f790c0b1b40 2023-10-09T08:14:53.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.587+0000 7f791299d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0c7ea0 con 0x7f790c0b4e70 2023-10-09T08:14:53.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.587+0000 7f791299d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0aed60 con 0x7f790c0b16d0 2023-10-09T08:14:53.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.587+0000 7f791119a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f790c0b1b40 0x7f790c0ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:53.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.587+0000 7f791119a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f790c0b1b40 0x7f790c0ae820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40300/0 (socket says 172.21.15.71:40300) 2023-10-09T08:14:53.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.587+0000 7f791119a700 1 -- 172.21.15.71:0/3704531934 learned_addr learned my addr 172.21.15.71:0/3704531934 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:53.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.587+0000 7f791199b700 1 --2- 172.21.15.71:0/3704531934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f790c0b16d0 0x7f790c16aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:53.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.587+0000 7f791219c700 1 --2- 172.21.15.71:0/3704531934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f790c0b4e70 0x7f790c0ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:53.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.587+0000 7f791119a700 1 -- 172.21.15.71:0/3704531934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f790c0b16d0 msgr2=0x7f790c16aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:53.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.587+0000 7f791119a700 1 --2- 172.21.15.71:0/3704531934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f790c0b16d0 0x7f790c16aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:53.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.587+0000 7f791119a700 1 -- 172.21.15.71:0/3704531934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f790c0b4e70 msgr2=0x7f790c0ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:53.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.587+0000 7f791119a700 1 --2- 172.21.15.71:0/3704531934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f790c0b4e70 0x7f790c0ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:53.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.587+0000 7f791119a700 1 -- 172.21.15.71:0/3704531934 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7908009420 con 0x7f790c0b1b40 2023-10-09T08:14:53.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.588+0000 7f791119a700 1 --2- 172.21.15.71:0/3704531934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f790c0b1b40 0x7f790c0ae820 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00c790 tx=0x7f78fc007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:53.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.588+0000 7f7901ffb700 1 -- 172.21.15.71:0/3704531934 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc005b30 con 0x7f790c0b1b40 2023-10-09T08:14:53.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.588+0000 7f7901ffb700 1 -- 172.21.15.71:0/3704531934 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78fc005cd0 con 0x7f790c0b1b40 2023-10-09T08:14:53.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.588+0000 7f791299d700 1 -- 172.21.15.71:0/3704531934 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790c0c8a30 con 0x7f790c0b1b40 2023-10-09T08:14:53.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.588+0000 7f7901ffb700 1 -- 172.21.15.71:0/3704531934 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc007320 con 0x7f790c0b1b40 2023-10-09T08:14:53.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.588+0000 7f791299d700 1 -- 172.21.15.71:0/3704531934 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f790c0c8ff0 con 0x7f790c0b1b40 2023-10-09T08:14:53.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.589+0000 7f791299d700 1 -- 172.21.15.71:0/3704531934 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f790c0c5390 con 0x7f790c0b1b40 2023-10-09T08:14:53.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.591+0000 7f7901ffb700 1 -- 172.21.15.71:0/3704531934 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 92) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f78fc012400 con 0x7f790c0b1b40 2023-10-09T08:14:53.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.592+0000 7f7901ffb700 1 --2- 172.21.15.71:0/3704531934 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f78f0066f80 0x7f78f0069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:53.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.592+0000 7f7901ffb700 1 -- 172.21.15.71:0/3704531934 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f78fc083b40 con 0x7f790c0b1b40 2023-10-09T08:14:53.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.592+0000 7f791199b700 1 -- 172.21.15.71:0/3704531934 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f78f0066f80 msgr2=0x7f78f0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:53.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.592+0000 7f791199b700 1 --2- 172.21.15.71:0/3704531934 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f78f0066f80 0x7f78f0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:14:53.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.596+0000 7f7901ffb700 1 -- 172.21.15.71:0/3704531934 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78fc04b5a0 con 0x7f790c0b1b40 2023-10-09T08:14:53.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.793+0000 7f791199b700 1 -- 172.21.15.71:0/3704531934 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f78f0066f80 msgr2=0x7f78f0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:53.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.793+0000 7f791199b700 1 --2- 172.21.15.71:0/3704531934 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f78f0066f80 0x7f78f0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:14:53.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.795+0000 7f791299d700 1 -- 172.21.15.71:0/3704531934 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f790c04bb80 con 0x7f790c0b1b40 2023-10-09T08:14:53.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.800+0000 7f7901ffb700 1 -- 172.21.15.71:0/3704531934 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v66)=0 v66) v1 ==== 133+0+0 (secure 0 0 0) 0x7f78fc0170c0 con 0x7f790c0b1b40 2023-10-09T08:14:53.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.803+0000 7f791299d700 1 -- 172.21.15.71:0/3704531934 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f78f0066f80 msgr2=0x7f78f0069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:14:53.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.803+0000 7f791299d700 1 --2- 172.21.15.71:0/3704531934 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f78f0066f80 0x7f78f0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:53.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.803+0000 7f791299d700 1 -- 172.21.15.71:0/3704531934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f790c0b1b40 msgr2=0x7f790c0ae820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:53.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.803+0000 7f791299d700 1 --2- 172.21.15.71:0/3704531934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f790c0b1b40 0x7f790c0ae820 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00c790 tx=0x7f78fc007e80 comp rx=0 tx=0).stop 2023-10-09T08:14:53.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.803+0000 7f791299d700 1 -- 172.21.15.71:0/3704531934 shutdown_connections 2023-10-09T08:14:53.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.803+0000 7f791299d700 1 --2- 172.21.15.71:0/3704531934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f790c0b4e70 0x7f790c0ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:53.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.803+0000 7f791299d700 1 --2- 172.21.15.71:0/3704531934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f790c0b16d0 0x7f790c16aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:53.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.803+0000 7f791299d700 1 --2- 172.21.15.71:0/3704531934 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f78f0066f80 0x7f78f0069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:53.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.803+0000 7f791299d700 1 --2- 172.21.15.71:0/3704531934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f790c0b1b40 0x7f790c0ae820 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:53.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.803+0000 7f791299d700 1 -- 172.21.15.71:0/3704531934 >> 172.21.15.71:0/3704531934 conn(0x7f790c0d10c0 msgr2=0x7f790c0af190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:53.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.803+0000 7f791299d700 1 -- 172.21.15.71:0/3704531934 shutdown_connections 2023-10-09T08:14:53.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:53.803+0000 7f791299d700 1 -- 172.21.15.71:0/3704531934 wait complete. 2023-10-09T08:14:53.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:14:53.822 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-09T08:14:53.864 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-10-09T08:14:54.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.099+0000 7f3acab9d700 1 Processor -- start 2023-10-09T08:14:54.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.099+0000 7f3acab9d700 1 -- start start 2023-10-09T08:14:54.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.100+0000 7f3acab9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3ac40b03c0 0x7f3ac40cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:54.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.100+0000 7f3acab9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ac40b0790 0x7f3ac40b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:54.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.100+0000 7f3acab9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ac40cfa00 con 0x7f3ac41591e0 2023-10-09T08:14:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.101+0000 7f3acab9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac40cb580 con 0x7f3ac40b03c0 2023-10-09T08:14:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.101+0000 7f3acab9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40b2de0 con 0x7f3ac40b0790 2023-10-09T08:14:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.101+0000 7f3ac9b9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3ac40b03c0 0x7f3ac40cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.101+0000 7f3ac9b9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3ac40b03c0 0x7f3ac40cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40304/0 (socket says 172.21.15.71:40304) 2023-10-09T08:14:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.101+0000 7f3ac9b9b700 1 -- 172.21.15.71:0/1904658274 learned_addr learned my addr 172.21.15.71:0/1904658274 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.101+0000 7f3aca39c700 1 --1- 172.21.15.71:0/1904658274 >> v1:172.21.15.71:6789/0 conn(0x7f3ac41591e0 0x7f3ac4159620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44084/0 (socket says 172.21.15.71:44084) 2023-10-09T08:14:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.101+0000 7f3ac939a700 1 --2- 172.21.15.71:0/1904658274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ac40b0790 0x7f3ac40b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.101+0000 7f3ac9b9b700 1 -- 172.21.15.71:0/1904658274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ac40b0790 msgr2=0x7f3ac40b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:14:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.101+0000 7f3ac9b9b700 1 --2- 172.21.15.71:0/1904658274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ac40b0790 0x7f3ac40b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.101+0000 7f3ac9b9b700 1 -- 172.21.15.71:0/1904658274 >> v1:172.21.15.71:6789/0 conn(0x7f3ac41591e0 legacy=0x7f3ac4159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.101+0000 7f3ac9b9b700 1 -- 172.21.15.71:0/1904658274 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac40cf160 con 0x7f3ac40b03c0 2023-10-09T08:14:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.101+0000 7f3ac8b99700 1 -- 172.21.15.71:0/1904658274 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225008022 0 0) 0x7f3ac40cfa00 con 0x7f3ac41591e0 2023-10-09T08:14:54.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.102+0000 7f3ac9b9b700 1 --2- 172.21.15.71:0/1904658274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ac40b03c0 0x7f3ac40cea70 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00099b0 tx=0x7f3ac0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c379bace4bcac28b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:54.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.102+0000 7f3ac8b99700 1 -- 172.21.15.71:0/1904658274 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0009ea0 con 0x7f3ac40b03c0 2023-10-09T08:14:54.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.102+0000 7f3ac8b99700 1 -- 172.21.15.71:0/1904658274 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac000b860 con 0x7f3ac40b03c0 2023-10-09T08:14:54.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.102+0000 7f3ac8b99700 1 -- 172.21.15.71:0/1904658274 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac000bc00 con 0x7f3ac40b03c0 2023-10-09T08:14:54.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.102+0000 7f3acab9d700 1 -- 172.21.15.71:0/1904658274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ac40b03c0 msgr2=0x7f3ac40cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:54.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.102+0000 7f3acab9d700 1 --2- 172.21.15.71:0/1904658274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ac40b03c0 0x7f3ac40cea70 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00099b0 tx=0x7f3ac0009250 comp rx=0 tx=0).stop 2023-10-09T08:14:54.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.103+0000 7f3acab9d700 1 -- 172.21.15.71:0/1904658274 shutdown_connections 2023-10-09T08:14:54.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.103+0000 7f3acab9d700 1 --2- 172.21.15.71:0/1904658274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ac40b03c0 0x7f3ac40cea70 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:54.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.103+0000 7f3acab9d700 1 --2- 172.21.15.71:0/1904658274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ac40b0790 0x7f3ac40b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:54.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.103+0000 7f3acab9d700 1 -- 172.21.15.71:0/1904658274 >> 172.21.15.71:0/1904658274 conn(0x7f3ac4063230 msgr2=0x7f3ac4063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:14:54.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.103+0000 7f3acab9d700 1 -- 172.21.15.71:0/1904658274 shutdown_connections 2023-10-09T08:14:54.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.103+0000 7f3acab9d700 1 -- 172.21.15.71:0/1904658274 wait complete. 2023-10-09T08:14:54.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.104+0000 7f3acab9d700 1 Processor -- start 2023-10-09T08:14:54.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.104+0000 7f3acab9d700 1 -- start start 2023-10-09T08:14:54.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.105+0000 7f3acab9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac40b03c0 0x7f3ac4152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:54.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.105+0000 7f3acab9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ac40b0790 0x7f3ac4151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:54.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.105+0000 7f3acab9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ac41591e0 0x7f3ac4156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:54.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.105+0000 7f3acab9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac4153830 con 0x7f3ac40b0790 2023-10-09T08:14:54.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.105+0000 7f3acab9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac4155920 con 0x7f3ac40b03c0 2023-10-09T08:14:54.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.105+0000 7f3acab9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40ca660 con 0x7f3ac41591e0 2023-10-09T08:14:54.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.105+0000 7f3ac939a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ac40b0790 0x7f3ac4151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:54.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.105+0000 7f3ac939a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ac40b0790 0x7f3ac4151de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40318/0 (socket says 172.21.15.71:40318) 2023-10-09T08:14:54.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.105+0000 7f3ac939a700 1 -- 172.21.15.71:0/1128584439 learned_addr learned my addr 172.21.15.71:0/1128584439 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:14:54.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.105+0000 7f3ac9b9b700 1 --2- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac40b03c0 0x7f3ac4152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:54.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.106+0000 7f3aca39c700 1 --2- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ac41591e0 0x7f3ac4156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:14:54.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.106+0000 7f3ac939a700 1 -- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ac41591e0 msgr2=0x7f3ac4156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:54.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.106+0000 7f3ac939a700 1 --2- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ac41591e0 0x7f3ac4156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:54.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.106+0000 7f3ac939a700 1 -- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac40b03c0 msgr2=0x7f3ac4152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:14:54.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.106+0000 7f3ac939a700 1 --2- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac40b03c0 0x7f3ac4152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:54.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.106+0000 7f3ac939a700 1 -- 172.21.15.71:0/1128584439 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac00094f0 con 0x7f3ac40b0790 2023-10-09T08:14:54.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.106+0000 7f3ac939a700 1 --2- 172.21.15.71:0/1128584439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ac40b0790 0x7f3ac4151de0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f3ab400ec80 tx=0x7f3ab40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:14:54.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.106+0000 7f3ab9ffb700 1 -- 172.21.15.71:0/1128584439 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab400c850 con 0x7f3ac40b0790 2023-10-09T08:14:54.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.106+0000 7f3ab9ffb700 1 -- 172.21.15.71:0/1128584439 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab400c9b0 con 0x7f3ac40b0790 2023-10-09T08:14:54.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.106+0000 7f3acab9d700 1 -- 172.21.15.71:0/1128584439 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac4154ce0 con 0x7f3ac40b0790 2023-10-09T08:14:54.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.106+0000 7f3ab9ffb700 1 -- 172.21.15.71:0/1128584439 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab400cd50 con 0x7f3ac40b0790 2023-10-09T08:14:54.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.106+0000 7f3acab9d700 1 -- 172.21.15.71:0/1128584439 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac4155260 con 0x7f3ac40b0790 2023-10-09T08:14:54.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.108+0000 7f3acab9d700 1 -- 172.21.15.71:0/1128584439 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac404c3c0 con 0x7f3ac40b0790 2023-10-09T08:14:54.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.108+0000 7f3ab9ffb700 1 -- 172.21.15.71:0/1128584439 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 92) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f3ab4013680 con 0x7f3ac40b0790 2023-10-09T08:14:54.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.110+0000 7f3ab9ffb700 1 --2- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3aa8066f80 0x7f3aa8069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:14:54.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.110+0000 7f3ab9ffb700 1 -- 172.21.15.71:0/1128584439 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f3ab4084d40 con 0x7f3ac40b0790 2023-10-09T08:14:54.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.110+0000 7f3ac9b9b700 1 -- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3aa8066f80 msgr2=0x7f3aa8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:54.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.110+0000 7f3ac9b9b700 1 --2- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3aa8066f80 0x7f3aa8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:14:54.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.114+0000 7f3ab9ffb700 1 -- 172.21.15.71:0/1128584439 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ab4051dc0 con 0x7f3ac40b0790 2023-10-09T08:14:54.233 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:54.232+0000 7f4ad1c32180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T08:14:54.279 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:54.278+0000 7f0a60253180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T08:14:54.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.311+0000 7f3ac9b9b700 1 -- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3aa8066f80 msgr2=0x7f3aa8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:54.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.311+0000 7f3ac9b9b700 1 --2- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3aa8066f80 0x7f3aa8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:14:54.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.335+0000 7f3acab9d700 1 -- 172.21.15.71:0/1128584439 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ac40c8c80 con 0x7f3aa8066f80 2023-10-09T08:14:54.396 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:54.395+0000 7f4ad1c32180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T08:14:54.445 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:54.444+0000 7f0a60253180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T08:14:54.485 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:54.484+0000 7f4ad1c32180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T08:14:54.533 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:54.532+0000 7f0a60253180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T08:14:54.711 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:54.710+0000 7f4ad1c32180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T08:14:54.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.712+0000 7f3ac9b9b700 1 -- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3aa8066f80 msgr2=0x7f3aa8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:54.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:54.712+0000 7f3ac9b9b700 1 --2- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3aa8066f80 0x7f3aa8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T08:14:54.762 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:54.759+0000 7f0a60253180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T08:14:54.888 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:54.887+0000 7f4ad1c32180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T08:14:54.939 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:54.938+0000 7f0a60253180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T08:14:54.982 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:54.980+0000 7f4ad1c32180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T08:14:55.032 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:55.031+0000 7f0a60253180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T08:14:55.144 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:55.143+0000 7f4ad1c32180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T08:14:55.194 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:55.193+0000 7f0a60253180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T08:14:55.245 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:55.244+0000 7f4ad1c32180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T08:14:55.294 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:55.293+0000 7f0a60253180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T08:14:55.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:55.513+0000 7f3ac9b9b700 1 -- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3aa8066f80 msgr2=0x7f3aa8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:55.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:55.513+0000 7f3ac9b9b700 1 --2- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3aa8066f80 0x7f3aa8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T08:14:55.732 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:55.730+0000 7f4ad1c32180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T08:14:55.782 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:55.781+0000 7f0a60253180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T08:14:55.825 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:55.824+0000 7f4ad1c32180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T08:14:55.876 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:55.875+0000 7f0a60253180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T08:14:55.915 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:55.914+0000 7f4ad1c32180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T08:14:55.967 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:55.966+0000 7f0a60253180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T08:14:56.538 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:56.537+0000 7f4ad1c32180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T08:14:56.587 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:56.586+0000 7f0a60253180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T08:14:56.711 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:56.710+0000 7f4ad1c32180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T08:14:56.760 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:56.759+0000 7f0a60253180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T08:14:56.807 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:56.806+0000 7f4ad1c32180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T08:14:56.855 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:56.854+0000 7f0a60253180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T08:14:57.013 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:14:57.018 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:14:57.108 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:57.106+0000 7f4ad1c32180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T08:14:57.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:57.115+0000 7f3ac9b9b700 1 -- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3aa8066f80 msgr2=0x7f3aa8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:14:57.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:57.115+0000 7f3ac9b9b700 1 --2- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3aa8066f80 0x7f3aa8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-09T08:14:57.154 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:57.153+0000 7f0a60253180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T08:14:57.205 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:57.204+0000 7f4ad1c32180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T08:14:57.252 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:57.251+0000 7f0a60253180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T08:14:57.904 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:57.903+0000 7f4ad1c32180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T08:14:57.955 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:57.954+0000 7f0a60253180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T08:14:58.193 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:58.191+0000 7f4ad1c32180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T08:14:58.241 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:58.240+0000 7f0a60253180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T08:14:58.287 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:58.285+0000 7f4ad1c32180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T08:14:58.333 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:58.332+0000 7f0a60253180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T08:14:58.439 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:58.438+0000 7f4ad1c32180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T08:14:58.488 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:58.487+0000 7f0a60253180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T08:14:58.545 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:58.544+0000 7f4ad1c32180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T08:14:58.592 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:58.591+0000 7f0a60253180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T08:14:58.735 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:58.734+0000 7f4ad1c32180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T08:14:58.782 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:58.781+0000 7f0a60253180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T08:14:58.827 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:58.826+0000 7f4ad1c32180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T08:14:58.876 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:58.875+0000 7f0a60253180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T08:14:58.919 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:58.918+0000 7f4ad1c32180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T08:14:58.970 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:58.969+0000 7f0a60253180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T08:14:59.014 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:59.012+0000 7f4ad1c32180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T08:14:59.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:59.024+0000 7f3ab9ffb700 1 -- 172.21.15.71:0/1128584439 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 93) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f3ab4052190 con 0x7f3ac40b0790 2023-10-09T08:14:59.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:59.025+0000 7f3ab9ffb700 1 -- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3aa8066f80 msgr2=0x7f3aa8069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:14:59.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:14:59.025+0000 7f3ab9ffb700 1 --2- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3aa8066f80 0x7f3aa8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:14:59.069 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:14:59.068+0000 7f0a60253180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T08:14:59.147 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:59.145+0000 7f4a471b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:14:59.147 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:59.145+0000 7f4a471b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:14:59.147 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:59.145+0000 7f4a471b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:14:59.147 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:59.145+0000 7f4a471b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:14:59.147 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:59.145+0000 7f4a471b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:14:59.147 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:59.145+0000 7f4a441b1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:14:59.147 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:59.145+0000 7f4a441b1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:14:59.147 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:59.145+0000 7f4a441b1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:14:59.148 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:59.145+0000 7f4a441b1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:14:59.148 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:14:59.145+0000 7f4a441b1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:15:00.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.028+0000 7f3ab9ffb700 1 -- 172.21.15.71:0/1128584439 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mgrmap(e 94) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f3ab40602d0 con 0x7f3ac40b0790 2023-10-09T08:15:00.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.029+0000 7f3ab9ffb700 1 --2- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3aa8066f80 0x7f3aa8069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:15:00.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.029+0000 7f3ab9ffb700 1 -- 172.21.15.71:0/1128584439 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ac40c8c80 con 0x7f3aa8066f80 2023-10-09T08:15:00.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.030+0000 7f3ac9b9b700 1 --2- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3aa8066f80 0x7f3aa8069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:15:00.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.033+0000 7f3ac9b9b700 1 --2- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3aa8066f80 0x7f3aa8069430 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00099b0 tx=0x7f3ac0017000 comp rx=0 tx=0).ready entity=mgr.9316 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:15:00.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.099+0000 7f3ab9ffb700 1 -- 172.21.15.71:0/1128584439 <== mgr.9316 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3ac40c8c80 con 0x7f3aa8066f80 2023-10-09T08:15:00.101 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule set for path snap_test_dir1 2023-10-09T08:15:00.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.103+0000 7f3acab9d700 1 -- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3aa8066f80 msgr2=0x7f3aa8069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:15:00.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.103+0000 7f3acab9d700 1 --2- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3aa8066f80 0x7f3aa8069430 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00099b0 tx=0x7f3ac0017000 comp rx=0 tx=0).stop 2023-10-09T08:15:00.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.103+0000 7f3acab9d700 1 -- 172.21.15.71:0/1128584439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ac40b0790 msgr2=0x7f3ac4151de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:15:00.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.103+0000 7f3acab9d700 1 --2- 172.21.15.71:0/1128584439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ac40b0790 0x7f3ac4151de0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f3ab400ec80 tx=0x7f3ab40091a0 comp rx=0 tx=0).stop 2023-10-09T08:15:00.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.103+0000 7f3acab9d700 1 -- 172.21.15.71:0/1128584439 shutdown_connections 2023-10-09T08:15:00.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.103+0000 7f3acab9d700 1 --2- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ac41591e0 0x7f3ac4156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:15:00.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.103+0000 7f3acab9d700 1 --2- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac40b03c0 0x7f3ac4152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:15:00.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.103+0000 7f3acab9d700 1 --2- 172.21.15.71:0/1128584439 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3aa8066f80 0x7f3aa8069430 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:15:00.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.103+0000 7f3acab9d700 1 --2- 172.21.15.71:0/1128584439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ac40b0790 0x7f3ac4151de0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:15:00.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.103+0000 7f3acab9d700 1 -- 172.21.15.71:0/1128584439 >> 172.21.15.71:0/1128584439 conn(0x7f3ac4063230 msgr2=0x7f3ac40704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:15:00.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.103+0000 7f3acab9d700 1 -- 172.21.15.71:0/1128584439 shutdown_connections 2023-10-09T08:15:00.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.103+0000 7f3acab9d700 1 -- 172.21.15.71:0/1128584439 wait complete. 2023-10-09T08:15:00.124 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-09T08:15:00.124 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-10-09T08:15:00.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.312+0000 7f045cd9d700 1 Processor -- start 2023-10-09T08:15:00.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.313+0000 7f045cd9d700 1 -- start start 2023-10-09T08:15:00.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.314+0000 7f045cd9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f04580c7c10 0x7f045815a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:15:00.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.314+0000 7f045cd9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0458155860 0x7f0458155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:15:00.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.314+0000 7f045cd9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045806e510 con 0x7f04580c7840 2023-10-09T08:15:00.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.314+0000 7f045cd9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04580c7220 con 0x7f0458155860 2023-10-09T08:15:00.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.314+0000 7f045cd9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f045806df20 con 0x7f04580c7c10 2023-10-09T08:15:00.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.314+0000 7f0457fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0458155860 0x7f0458155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:15:00.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.314+0000 7f0457fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0458155860 0x7f0458155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59958/0 (socket says 172.21.15.71:59958) 2023-10-09T08:15:00.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.314+0000 7f0457fff700 1 -- 172.21.15.71:0/2485037476 learned_addr learned my addr 172.21.15.71:0/2485037476 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:15:00.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.314+0000 7f0456ffd700 1 --2- 172.21.15.71:0/2485037476 >> v2:172.21.15.179:3300/0 conn(0x7f04580c7c10 0x7f045815a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:15:00.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.315+0000 7f0457fff700 1 -- 172.21.15.71:0/2485037476 >> v2:172.21.15.179:3300/0 conn(0x7f04580c7c10 msgr2=0x7f045815a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:15:00.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.315+0000 7f0457fff700 1 --2- 172.21.15.71:0/2485037476 >> v2:172.21.15.179:3300/0 conn(0x7f04580c7c10 0x7f045815a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:15:00.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.315+0000 7f0457fff700 1 -- 172.21.15.71:0/2485037476 >> v1:172.21.15.179:6789/0 conn(0x7f04580c7840 legacy=0x7f0458159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:15:00.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.315+0000 7f0457fff700 1 -- 172.21.15.71:0/2485037476 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0458157040 con 0x7f0458155860 2023-10-09T08:15:00.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.315+0000 7f0457fff700 1 --2- 172.21.15.71:0/2485037476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0458155860 0x7f0458155cc0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f04580aeeb0 tx=0x7f045000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986ec6d9bfc970eb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:15:00.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.315+0000 7f04567fc700 1 -- 172.21.15.71:0/2485037476 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0450010070 con 0x7f0458155860 2023-10-09T08:15:00.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.315+0000 7f04567fc700 1 -- 172.21.15.71:0/2485037476 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045000de60 con 0x7f0458155860 2023-10-09T08:15:00.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.315+0000 7f04567fc700 1 -- 172.21.15.71:0/2485037476 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045000b320 con 0x7f0458155860 2023-10-09T08:15:00.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.316+0000 7f045cd9d700 1 -- 172.21.15.71:0/2485037476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0458155860 msgr2=0x7f0458155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:15:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.316+0000 7f045cd9d700 1 --2- 172.21.15.71:0/2485037476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0458155860 0x7f0458155cc0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f04580aeeb0 tx=0x7f045000ba50 comp rx=0 tx=0).stop 2023-10-09T08:15:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.316+0000 7f045cd9d700 1 -- 172.21.15.71:0/2485037476 shutdown_connections 2023-10-09T08:15:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.316+0000 7f045cd9d700 1 --2- 172.21.15.71:0/2485037476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0458155860 0x7f0458155cc0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:15:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.316+0000 7f045cd9d700 1 --2- 172.21.15.71:0/2485037476 >> v2:172.21.15.179:3300/0 conn(0x7f04580c7c10 0x7f045815a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:15:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.316+0000 7f045cd9d700 1 -- 172.21.15.71:0/2485037476 >> 172.21.15.71:0/2485037476 conn(0x7f0458068e20 msgr2=0x7f04580cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:15:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.316+0000 7f045cd9d700 1 -- 172.21.15.71:0/2485037476 shutdown_connections 2023-10-09T08:15:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.316+0000 7f045cd9d700 1 -- 172.21.15.71:0/2485037476 wait complete. 2023-10-09T08:15:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.317+0000 7f045cd9d700 1 Processor -- start 2023-10-09T08:15:00.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.317+0000 7f045cd9d700 1 -- start start 2023-10-09T08:15:00.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.318+0000 7f045cd9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04580c7840 0x7f0458151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:15:00.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.318+0000 7f045cd9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04580c7c10 0x7f04580a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:15:00.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.318+0000 7f045cd9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0458155860 0x7f04580b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:15:00.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.318+0000 7f045cd9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04580aa8e0 con 0x7f04580c7840 2023-10-09T08:15:00.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.318+0000 7f045cd9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0458152350 con 0x7f0458155860 2023-10-09T08:15:00.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.318+0000 7f045cd9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04580b12e0 con 0x7f04580c7c10 2023-10-09T08:15:00.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.319+0000 7f04577fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04580c7840 0x7f0458151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:15:00.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.319+0000 7f04577fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04580c7840 0x7f0458151e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59970/0 (socket says 172.21.15.71:59970) 2023-10-09T08:15:00.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.319+0000 7f04577fe700 1 -- 172.21.15.71:0/924437805 learned_addr learned my addr 172.21.15.71:0/924437805 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:15:00.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.319+0000 7f0456ffd700 1 --2- 172.21.15.71:0/924437805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04580c7c10 0x7f04580a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:15:00.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.319+0000 7f0457fff700 1 --2- 172.21.15.71:0/924437805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0458155860 0x7f04580b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:15:00.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.319+0000 7f04577fe700 1 -- 172.21.15.71:0/924437805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04580c7c10 msgr2=0x7f04580a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:15:00.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.319+0000 7f04577fe700 1 --2- 172.21.15.71:0/924437805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04580c7c10 0x7f04580a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:15:00.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.319+0000 7f04577fe700 1 -- 172.21.15.71:0/924437805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0458155860 msgr2=0x7f04580b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:15:00.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.319+0000 7f04577fe700 1 --2- 172.21.15.71:0/924437805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0458155860 0x7f04580b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:15:00.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.319+0000 7f04577fe700 1 -- 172.21.15.71:0/924437805 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045000bcf0 con 0x7f04580c7840 2023-10-09T08:15:00.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.319+0000 7f04577fe700 1 --2- 172.21.15.71:0/924437805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04580c7840 0x7f0458151e10 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f044800c590 tx=0x7f044800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:15:00.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.319+0000 7f043f7fe700 1 -- 172.21.15.71:0/924437805 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448011590 con 0x7f04580c7840 2023-10-09T08:15:00.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.319+0000 7f043f7fe700 1 -- 172.21.15.71:0/924437805 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04480116f0 con 0x7f04580c7840 2023-10-09T08:15:00.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.319+0000 7f043f7fe700 1 -- 172.21.15.71:0/924437805 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448011ab0 con 0x7f04580c7840 2023-10-09T08:15:00.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.320+0000 7f045cd9d700 1 -- 172.21.15.71:0/924437805 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04580aa320 con 0x7f04580c7840 2023-10-09T08:15:00.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.320+0000 7f045cd9d700 1 -- 172.21.15.71:0/924437805 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04580b0f70 con 0x7f04580c7840 2023-10-09T08:15:00.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.321+0000 7f045cd9d700 1 -- 172.21.15.71:0/924437805 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04580b15c0 con 0x7f04580c7840 2023-10-09T08:15:00.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.322+0000 7f043f7fe700 1 -- 172.21.15.71:0/924437805 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 94) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f044801b3b0 con 0x7f04580c7840 2023-10-09T08:15:00.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.322+0000 7f043f7fe700 1 --2- 172.21.15.71:0/924437805 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0444066dd0 0x7f0444069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:15:00.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.322+0000 7f043f7fe700 1 -- 172.21.15.71:0/924437805 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6455+0+0 (secure 0 0 0) 0x7f0448083a60 con 0x7f04580c7840 2023-10-09T08:15:00.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.323+0000 7f0456ffd700 1 --2- 172.21.15.71:0/924437805 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0444066dd0 0x7f0444069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:15:00.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.323+0000 7f0456ffd700 1 --2- 172.21.15.71:0/924437805 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0444066dd0 0x7f0444069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f04580ab570 tx=0x7f044c008040 comp rx=0 tx=0).ready entity=mgr.9316 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:15:00.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.326+0000 7f043f7fe700 1 -- 172.21.15.71:0/924437805 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0448050c90 con 0x7f04580c7840 2023-10-09T08:15:00.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.543+0000 7f045cd9d700 1 -- 172.21.15.71:0/924437805 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f045804c3c0 con 0x7f0444066dd0 2023-10-09T08:15:00.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.597+0000 7f043f7fe700 1 -- 172.21.15.71:0/924437805 <== mgr.9316 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7f045804c3c0 con 0x7f0444066dd0 2023-10-09T08:15:00.597 INFO:teuthology.orchestra.run.smithi071.stdout:Retention added to path snap_test_dir1 2023-10-09T08:15:00.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.599+0000 7f045cd9d700 1 -- 172.21.15.71:0/924437805 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0444066dd0 msgr2=0x7f0444069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:15:00.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.599+0000 7f045cd9d700 1 --2- 172.21.15.71:0/924437805 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0444066dd0 0x7f0444069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f04580ab570 tx=0x7f044c008040 comp rx=0 tx=0).stop 2023-10-09T08:15:00.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.599+0000 7f045cd9d700 1 -- 172.21.15.71:0/924437805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04580c7840 msgr2=0x7f0458151e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:15:00.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.599+0000 7f045cd9d700 1 --2- 172.21.15.71:0/924437805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04580c7840 0x7f0458151e10 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f044800c590 tx=0x7f044800c950 comp rx=0 tx=0).stop 2023-10-09T08:15:00.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.599+0000 7f045cd9d700 1 -- 172.21.15.71:0/924437805 shutdown_connections 2023-10-09T08:15:00.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.599+0000 7f045cd9d700 1 --2- 172.21.15.71:0/924437805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0458155860 0x7f04580b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:15:00.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.599+0000 7f045cd9d700 1 --2- 172.21.15.71:0/924437805 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0444066dd0 0x7f0444069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:15:00.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.599+0000 7f045cd9d700 1 --2- 172.21.15.71:0/924437805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04580c7840 0x7f0458151e10 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:15:00.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.599+0000 7f045cd9d700 1 --2- 172.21.15.71:0/924437805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04580c7c10 0x7f04580a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:15:00.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.599+0000 7f045cd9d700 1 -- 172.21.15.71:0/924437805 >> 172.21.15.71:0/924437805 conn(0x7f0458068e20 msgr2=0x7f0458153000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:15:00.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.599+0000 7f045cd9d700 1 -- 172.21.15.71:0/924437805 shutdown_connections 2023-10-09T08:15:00.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.599+0000 7f045cd9d700 1 -- 172.21.15.71:0/924437805 wait complete. 2023-10-09T08:15:00.618 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-10-09T08:15:00.618 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-09-08_16_00 in ~60s... 2023-10-09T08:15:00.618 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-10-09T08:15:00.618 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-10-09T08:15:00.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.801+0000 7fa042dff700 1 Processor -- start 2023-10-09T08:15:00.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.801+0000 7fa042dff700 1 -- start start 2023-10-09T08:15:00.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.802+0000 7fa042dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa03c153f50 0x7fa03c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:15:00.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.802+0000 7fa042dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa03c06d840 0x7fa03c069e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:15:00.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.802+0000 7fa042dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03c0b4570 con 0x7fa03c154320 2023-10-09T08:15:00.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.802+0000 7fa042dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa03c15a730 con 0x7fa03c06d840 2023-10-09T08:15:00.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.802+0000 7fa042dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c15aa10 con 0x7fa03c153f50 2023-10-09T08:15:00.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.802+0000 7fa04139c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa03c06d840 0x7fa03c069e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:15:00.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.802+0000 7fa04139c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa03c06d840 0x7fa03c069e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59986/0 (socket says 172.21.15.71:59986) 2023-10-09T08:15:00.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.803+0000 7fa04139c700 1 -- 172.21.15.71:0/1858958490 learned_addr learned my addr 172.21.15.71:0/1858958490 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:15:00.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.803+0000 7fa040b9b700 1 --2- 172.21.15.71:0/1858958490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa03c153f50 0x7fa03c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:15:00.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.803+0000 7fa04139c700 1 -- 172.21.15.71:0/1858958490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa03c153f50 msgr2=0x7fa03c0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:15:00.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.803+0000 7fa04139c700 1 --2- 172.21.15.71:0/1858958490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa03c153f50 0x7fa03c0b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:15:00.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.803+0000 7fa04139c700 1 -- 172.21.15.71:0/1858958490 >> v1:172.21.15.179:6789/0 conn(0x7fa03c154320 legacy=0x7fa03c06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:15:00.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.803+0000 7fa04139c700 1 -- 172.21.15.71:0/1858958490 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c15acf0 con 0x7fa03c06d840 2023-10-09T08:15:00.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.803+0000 7fa04139c700 1 --2- 172.21.15.71:0/1858958490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa03c06d840 0x7fa03c069e30 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fa034009f20 tx=0x7fa034009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce18dd33cc64f0ed server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:15:00.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.803+0000 7fa0337fe700 1 -- 172.21.15.71:0/1858958490 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03400e070 con 0x7fa03c06d840 2023-10-09T08:15:00.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.803+0000 7fa0337fe700 1 -- 172.21.15.71:0/1858958490 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03400ba80 con 0x7fa03c06d840 2023-10-09T08:15:00.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.803+0000 7fa0337fe700 1 -- 172.21.15.71:0/1858958490 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0340092e0 con 0x7fa03c06d840 2023-10-09T08:15:00.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.804+0000 7fa042dff700 1 -- 172.21.15.71:0/1858958490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa03c06d840 msgr2=0x7fa03c069e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:15:00.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.804+0000 7fa042dff700 1 --2- 172.21.15.71:0/1858958490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa03c06d840 0x7fa03c069e30 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fa034009f20 tx=0x7fa034009840 comp rx=0 tx=0).stop 2023-10-09T08:15:00.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.804+0000 7fa042dff700 1 -- 172.21.15.71:0/1858958490 shutdown_connections 2023-10-09T08:15:00.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.804+0000 7fa042dff700 1 --2- 172.21.15.71:0/1858958490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa03c06d840 0x7fa03c069e30 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:15:00.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.804+0000 7fa042dff700 1 --2- 172.21.15.71:0/1858958490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa03c153f50 0x7fa03c0b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:15:00.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.804+0000 7fa042dff700 1 -- 172.21.15.71:0/1858958490 >> 172.21.15.71:0/1858958490 conn(0x7fa03c06baf0 msgr2=0x7fa03c06bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:15:00.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.804+0000 7fa042dff700 1 -- 172.21.15.71:0/1858958490 shutdown_connections 2023-10-09T08:15:00.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.804+0000 7fa042dff700 1 -- 172.21.15.71:0/1858958490 wait complete. 2023-10-09T08:15:00.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.806+0000 7fa042dff700 1 Processor -- start 2023-10-09T08:15:00.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.806+0000 7fa042dff700 1 -- start start 2023-10-09T08:15:00.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.807+0000 7fa042dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa03c06d840 0x7fa03c148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:15:00.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.807+0000 7fa042dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa03c153f50 0x7fa03c0c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:15:00.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.807+0000 7fa042dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa03c154320 0x7fa03c14d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:15:00.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.807+0000 7fa042dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c148a50 con 0x7fa03c06d840 2023-10-09T08:15:00.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.807+0000 7fa042dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0c86c0 con 0x7fa03c154320 2023-10-09T08:15:00.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.807+0000 7fa042dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0c9180 con 0x7fa03c153f50 2023-10-09T08:15:00.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.807+0000 7fa040b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa03c06d840 0x7fa03c148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:15:00.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.807+0000 7fa040b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa03c06d840 0x7fa03c148510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59988/0 (socket says 172.21.15.71:59988) 2023-10-09T08:15:00.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.807+0000 7fa040b9b700 1 -- 172.21.15.71:0/1832931471 learned_addr learned my addr 172.21.15.71:0/1832931471 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:15:00.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.807+0000 7fa033fff700 1 --2- 172.21.15.71:0/1832931471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa03c153f50 0x7fa03c0c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:15:00.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.807+0000 7fa04139c700 1 --2- 172.21.15.71:0/1832931471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa03c154320 0x7fa03c14d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:15:00.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.807+0000 7fa040b9b700 1 -- 172.21.15.71:0/1832931471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa03c153f50 msgr2=0x7fa03c0c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:15:00.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.807+0000 7fa040b9b700 1 --2- 172.21.15.71:0/1832931471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa03c153f50 0x7fa03c0c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:15:00.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.807+0000 7fa040b9b700 1 -- 172.21.15.71:0/1832931471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa03c154320 msgr2=0x7fa03c14d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:15:00.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.807+0000 7fa040b9b700 1 --2- 172.21.15.71:0/1832931471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa03c154320 0x7fa03c14d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:15:00.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.807+0000 7fa040b9b700 1 -- 172.21.15.71:0/1832931471 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa034009ae0 con 0x7fa03c06d840 2023-10-09T08:15:00.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.808+0000 7fa040b9b700 1 --2- 172.21.15.71:0/1832931471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa03c06d840 0x7fa03c148510 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fa03800d890 tx=0x7fa038008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:15:00.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.808+0000 7fa030ff9700 1 -- 172.21.15.71:0/1832931471 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0380125f0 con 0x7fa03c06d840 2023-10-09T08:15:00.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.808+0000 7fa030ff9700 1 -- 172.21.15.71:0/1832931471 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa038012770 con 0x7fa03c06d840 2023-10-09T08:15:00.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.808+0000 7fa042dff700 1 -- 172.21.15.71:0/1832931471 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03c15c570 con 0x7fa03c06d840 2023-10-09T08:15:00.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.808+0000 7fa030ff9700 1 -- 172.21.15.71:0/1832931471 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa038012b30 con 0x7fa03c06d840 2023-10-09T08:15:00.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.808+0000 7fa042dff700 1 -- 172.21.15.71:0/1832931471 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03c0c8960 con 0x7fa03c06d840 2023-10-09T08:15:00.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.809+0000 7fa042dff700 1 -- 172.21.15.71:0/1832931471 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03c0718b0 con 0x7fa03c06d840 2023-10-09T08:15:00.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.810+0000 7fa030ff9700 1 -- 172.21.15.71:0/1832931471 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 94) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fa03801e460 con 0x7fa03c06d840 2023-10-09T08:15:00.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.811+0000 7fa030ff9700 1 --2- 172.21.15.71:0/1832931471 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa028066e50 0x7fa028069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:15:00.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.811+0000 7fa030ff9700 1 -- 172.21.15.71:0/1832931471 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6455+0+0 (secure 0 0 0) 0x7fa038084d80 con 0x7fa03c06d840 2023-10-09T08:15:00.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.811+0000 7fa033fff700 1 --2- 172.21.15.71:0/1832931471 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa028066e50 0x7fa028069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:15:00.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.812+0000 7fa033fff700 1 --2- 172.21.15.71:0/1832931471 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa028066e50 0x7fa028069300 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa03c0ca7a0 tx=0x7fa02c009040 comp rx=0 tx=0).ready entity=mgr.9316 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:15:00.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:00.814+0000 7fa030ff9700 1 -- 172.21.15.71:0/1832931471 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa038051ee0 con 0x7fa03c06d840 2023-10-09T08:15:01.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:01.030+0000 7fa042dff700 1 -- 172.21.15.71:0/1832931471 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa03c15afd0 con 0x7fa028066e50 2023-10-09T08:15:01.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:01.039+0000 7fa030ff9700 1 -- 172.21.15.71:0/1832931471 <== mgr.9316 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7fa03c15afd0 con 0x7fa028066e50 2023-10-09T08:15:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:15:01.040 INFO:teuthology.orchestra.run.smithi071.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-10-09T08:15:01.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:01.041+0000 7fa042dff700 1 -- 172.21.15.71:0/1832931471 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa028066e50 msgr2=0x7fa028069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:15:01.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:01.041+0000 7fa042dff700 1 --2- 172.21.15.71:0/1832931471 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa028066e50 0x7fa028069300 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa03c0ca7a0 tx=0x7fa02c009040 comp rx=0 tx=0).stop 2023-10-09T08:15:01.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:01.041+0000 7fa042dff700 1 -- 172.21.15.71:0/1832931471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa03c06d840 msgr2=0x7fa03c148510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:15:01.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:01.041+0000 7fa042dff700 1 --2- 172.21.15.71:0/1832931471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa03c06d840 0x7fa03c148510 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fa03800d890 tx=0x7fa038008040 comp rx=0 tx=0).stop 2023-10-09T08:15:01.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:01.041+0000 7fa042dff700 1 -- 172.21.15.71:0/1832931471 shutdown_connections 2023-10-09T08:15:01.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:01.041+0000 7fa042dff700 1 --2- 172.21.15.71:0/1832931471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa03c154320 0x7fa03c14d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:15:01.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:01.041+0000 7fa042dff700 1 --2- 172.21.15.71:0/1832931471 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa028066e50 0x7fa028069300 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:15:01.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:01.041+0000 7fa042dff700 1 --2- 172.21.15.71:0/1832931471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa03c06d840 0x7fa03c148510 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:15:01.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:01.041+0000 7fa042dff700 1 --2- 172.21.15.71:0/1832931471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa03c153f50 0x7fa03c0c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:15:01.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:01.041+0000 7fa042dff700 1 -- 172.21.15.71:0/1832931471 >> 172.21.15.71:0/1832931471 conn(0x7fa03c06baf0 msgr2=0x7fa03c1532d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:15:01.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:01.042+0000 7fa042dff700 1 -- 172.21.15.71:0/1832931471 shutdown_connections 2023-10-09T08:15:01.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:15:01.042+0000 7fa042dff700 1 -- 172.21.15.71:0/1832931471 wait complete. 2023-10-09T08:15:01.060 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-10-09T08:15:01.061 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-10-09T08:15:01.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:01.061 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:01.102 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:01.102 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:01.102 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:02.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:02.104 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:02.147 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:02.147 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:02.147 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:03.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:03.148 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:03.192 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:03.192 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:03.192 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:04.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:04.193 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:04.236 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:04.237 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:04.237 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:05.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:05.238 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:05.282 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:05.282 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:05.282 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:06.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:06.283 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:06.327 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:06.327 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:06.327 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:07.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:07.328 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:07.371 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:07.371 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:07.371 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:08.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:08.372 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:08.415 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:08.415 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:08.416 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:09.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:09.416 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:09.459 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:09.459 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:09.459 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:10.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:10.460 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:10.503 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:10.503 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:10.504 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:11.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:11.505 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:11.548 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:11.548 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:11.548 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:12.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:12.550 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:12.592 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:12.592 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:12.593 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:13.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:13.593 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:13.636 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:13.637 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:13.637 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:14.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:14.638 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:14.683 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:14.683 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:14.684 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:15.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:15.685 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:15.728 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:15.728 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:15.729 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:16.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:16.730 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:16.773 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:16.773 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:16.774 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:17.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:17.775 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:17.818 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:17.818 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:17.818 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:18.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:18.819 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:18.862 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:18.862 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:18.862 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:19.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:19.864 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:19.907 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:19.907 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:19.907 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:20.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:20.909 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:20.952 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:20.953 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:20.953 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:21.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:21.954 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:21.997 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:21.997 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:21.997 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:22.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:22.998 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:23.041 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:23.042 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:23.042 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:24.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:24.043 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:24.086 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:24.086 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:24.086 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:25.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:25.088 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:25.131 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:25.131 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:25.131 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:26.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:26.132 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:26.175 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:26.176 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:26.176 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:27.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:27.176 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:27.188 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:15:27.220 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:27.220 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:27.220 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:27.264 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:15:28.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:28.221 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:28.264 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:28.264 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:28.264 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:29.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:29.266 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:29.308 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:29.309 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:29.309 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:30.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:30.310 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:30.353 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:30.353 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:30.353 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:31.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:31.355 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:31.398 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:31.398 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:31.398 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:32.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:32.399 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:32.442 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:32.442 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:32.443 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:33.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:33.444 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:33.487 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:33.487 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:33.487 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:34.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:34.489 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:34.532 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:34.532 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:34.532 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:35.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:35.534 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:35.576 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:35.576 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:35.576 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:36.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:36.577 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:36.620 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:36.620 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:36.620 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:37.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:37.622 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:37.664 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:37.665 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:37.665 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:38.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:38.667 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:38.709 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:38.710 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:38.710 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:39.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:39.711 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:39.754 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:39.755 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:39.755 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:40.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:40.756 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:40.799 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:40.799 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:40.799 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:41.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:41.800 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:41.843 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:41.844 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:41.844 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:42.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:42.845 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:42.888 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:42.888 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:42.888 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:43.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:43.890 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:43.933 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:43.933 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:43.933 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:44.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:44.934 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:44.977 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:44.977 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:44.978 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:45.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:45.979 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:46.022 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:46.022 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:46.023 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:47.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:47.024 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:47.067 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:47.067 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:47.067 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:48.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:48.069 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:48.111 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:48.112 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:48.112 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:49.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:49.113 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:49.156 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:49.157 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:49.157 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:50.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:50.158 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:50.201 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:50.201 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:50.201 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:51.202 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:51.202 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:51.245 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:51.245 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:51.245 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:52.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:52.246 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:52.290 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:52.290 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:52.290 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:53.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:53.292 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:53.335 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:53.335 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:53.335 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:54.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:54.336 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:54.379 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:54.379 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:54.379 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:55.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:55.380 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:55.424 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:55.424 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:55.424 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:56.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:56.426 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:56.469 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:56.469 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:56.469 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:57.435 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:15:57.441 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:15:57.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:57.470 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:57.523 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:57.523 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:57.523 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:58.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:58.524 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:58.567 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:58.567 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:58.567 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:15:59.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:15:59.569 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:15:59.612 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T08:15:59.612 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:15:59.612 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:00.609 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:16:00.609+0000 7f4a36195700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:16:00.609 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:16:00.609+0000 7f4a36195700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:16:00.609 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:16:00.609+0000 7f4a36195700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:16:00.609 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:16:00.609+0000 7f4a36195700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:16:00.609 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:16:00.609+0000 7f4a36195700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:16:00.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:00.613 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:00.655 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:00.656 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:00.656 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:00.656 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:00.656 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-10-09-08_16_00_UTC'] 2023-10-09T08:16:00.656 DEBUG:tasks.cephfs.test_snap_schedules:exec=1696839300.618489, now = 1696839360.656846, timo = 60 2023-10-09T08:16:01.657 DEBUG:tasks.cephfs.test_snap_schedules:expecting removal of snap snap_test_dir1/.snap/scheduled-2023-10-09-08_16_00 in ~120s... 2023-10-09T08:16:01.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:01.657 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:01.699 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:01.700 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:01.700 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:01.700 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:02.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:02.701 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:02.743 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:02.744 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:02.744 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:02.744 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:03.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:03.745 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:03.786 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:03.788 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:03.788 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:03.788 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:04.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:04.788 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:04.830 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:04.831 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:04.831 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:04.832 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:05.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:05.833 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:05.874 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:05.875 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:05.875 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:05.876 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:06.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:06.876 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:06.918 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:06.919 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:06.919 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:06.919 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:07.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:07.920 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:07.961 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:07.962 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:07.962 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:07.963 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:08.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:08.963 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:09.005 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:09.006 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:09.006 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:09.007 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:10.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:10.008 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:10.048 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:10.049 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:10.049 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:10.049 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:11.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:11.050 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:11.090 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:11.091 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:11.091 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:11.091 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:12.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:12.092 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:12.134 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:12.135 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:12.136 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:12.136 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:13.137 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:13.137 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:13.179 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:13.180 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:13.180 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:13.180 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:14.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:14.181 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:14.224 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:14.225 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:14.225 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:14.226 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:15.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:15.227 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:15.269 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:15.270 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:15.270 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:15.270 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:16.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:16.271 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:16.313 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:16.314 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:16.315 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:16.315 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:17.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:17.315 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:17.358 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:17.359 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:17.359 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:17.359 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:18.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:18.361 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:18.403 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:18.404 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:18.404 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:18.404 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:19.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:19.405 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:19.447 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:19.448 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:19.449 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:19.449 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:20.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:20.450 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:20.491 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:20.492 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:20.493 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:20.493 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:21.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:21.791 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:21.833 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:21.834 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:21.834 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:21.835 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:22.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:22.835 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:22.878 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:22.879 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:22.879 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:22.879 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:23.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:23.880 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:23.923 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:23.924 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:23.924 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:23.924 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:24.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:24.925 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:24.967 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:24.968 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:24.968 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:24.968 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:25.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:25.971 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:26.013 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:26.014 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:26.014 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:26.015 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:27.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:27.016 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:27.058 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:27.059 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:27.059 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:27.059 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:27.597 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:16:27.602 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:16:28.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:28.061 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:28.102 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:28.103 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:28.104 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:28.104 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:29.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:29.105 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:29.146 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:29.147 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:29.148 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:29.148 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:30.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:30.149 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:30.191 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:30.192 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:30.192 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:30.192 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:31.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:31.194 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:31.236 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:31.237 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:31.237 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:31.238 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:32.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:32.238 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:32.280 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:32.281 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:32.281 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:32.281 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:33.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:33.282 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:33.327 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:33.327 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:33.328 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:33.328 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:34.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:34.329 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:34.371 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:34.372 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:34.372 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:34.372 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:35.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:35.373 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:35.416 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:35.417 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:35.417 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:35.417 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:36.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:36.418 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:36.459 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:36.460 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:36.461 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:36.461 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:37.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:37.462 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:37.503 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:37.504 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:37.504 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:37.505 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:38.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:38.506 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:38.548 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:38.549 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:38.549 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:38.549 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:39.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:39.550 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:39.592 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:39.593 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:39.593 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:39.593 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:40.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:40.594 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:40.636 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:40.637 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:40.637 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:40.637 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:41.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:41.638 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:41.680 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:41.681 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:41.681 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:41.681 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:42.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:42.682 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:42.724 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:42.725 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:42.725 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:42.725 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:43.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:43.726 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:43.768 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:43.769 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:43.769 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:43.769 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:44.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:44.770 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:44.812 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:44.813 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:44.814 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:44.814 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:45.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:45.815 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:45.857 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:45.858 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:45.858 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:45.858 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:46.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:46.859 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:46.901 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:46.902 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:46.902 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:46.902 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:47.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:47.904 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:47.945 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:47.947 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:47.947 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:47.947 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:48.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:48.948 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:48.991 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:48.992 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:48.992 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:48.992 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:49.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:49.993 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:50.035 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:50.037 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:50.037 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:50.037 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:51.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:51.038 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:51.080 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:51.081 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:51.081 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:51.081 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:52.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:52.083 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:52.124 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:52.125 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:52.125 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:52.126 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:53.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:53.127 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:53.169 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:53.170 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:53.170 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:53.170 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:54.171 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:54.171 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:54.213 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:54.214 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:54.214 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:54.214 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:55.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:55.216 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:55.257 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:55.258 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:55.259 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:55.259 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:56.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:56.260 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:56.302 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:56.303 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:56.303 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:56.304 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:57.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:57.304 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:57.348 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:57.349 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:57.349 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:57.349 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:57.751 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:16:57.759 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:16:58.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:58.351 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:58.393 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:58.394 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:58.394 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:58.394 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:16:59.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:16:59.395 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:16:59.437 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:16:59.438 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:16:59.438 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:16:59.438 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:17:00.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:17:00.440 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:17:00.482 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_16_00_UTC 2023-10-09T08:17:00.483 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:17:00.484 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T08:17:00.484 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T08:17:01.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:17:01.485 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:17:01.527 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_17_00_UTC 2023-10-09T08:17:01.528 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-08_17_00_UTC'} 2023-10-09T08:17:01.528 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-10-09-08_17_00_UTC'} 2023-10-09T08:17:01.528 INFO:tasks.cephfs.test_snap_schedules:removed: {'scheduled-2023-10-09-08_16_00_UTC'} 2023-10-09T08:17:01.528 DEBUG:tasks.cephfs.test_snap_schedules:snapshots removed=['scheduled-2023-10-09-08_16_00_UTC'] 2023-10-09T08:17:01.529 DEBUG:tasks.cephfs.test_snap_schedules:exec=1696839300.618489, now = 1696839421.529098, timo = 120 2023-10-09T08:17:02.530 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-09T08:17:02.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.724+0000 7f17249fe700 1 Processor -- start 2023-10-09T08:17:02.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.724+0000 7f17249fe700 1 -- start start 2023-10-09T08:17:02.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.725+0000 7f17249fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f17200b03c0 0x7f17200cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:02.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.725+0000 7f17249fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f17201591e0 0x7f1720159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:02.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.725+0000 7f17249fe700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17200cfa00 con 0x7f17200b0790 2023-10-09T08:17:02.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.725+0000 7f17249fe700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17200cb580 con 0x7f17201591e0 2023-10-09T08:17:02.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.725+0000 7f17249fe700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17200cf160 con 0x7f17200b03c0 2023-10-09T08:17:02.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.725+0000 7f171f59e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f17201591e0 0x7f1720159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:02.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.725+0000 7f171f59e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f17201591e0 0x7f1720159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57246/0 (socket says 172.21.15.71:57246) 2023-10-09T08:17:02.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.725+0000 7f171f59e700 1 -- 172.21.15.71:0/4187063809 learned_addr learned my addr 172.21.15.71:0/4187063809 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:02.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.726+0000 7f171ed9d700 1 --2- 172.21.15.71:0/4187063809 >> v2:172.21.15.179:3300/0 conn(0x7f17200b03c0 0x7f17200cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:02.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.726+0000 7f171f59e700 1 -- 172.21.15.71:0/4187063809 >> v2:172.21.15.179:3300/0 conn(0x7f17200b03c0 msgr2=0x7f17200cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:02.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.726+0000 7f171f59e700 1 --2- 172.21.15.71:0/4187063809 >> v2:172.21.15.179:3300/0 conn(0x7f17200b03c0 0x7f17200cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:02.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.726+0000 7f171f59e700 1 -- 172.21.15.71:0/4187063809 >> v1:172.21.15.179:6789/0 conn(0x7f17200b0790 legacy=0x7f17200b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:02.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.726+0000 7f171f59e700 1 -- 172.21.15.71:0/4187063809 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17200cf440 con 0x7f17201591e0 2023-10-09T08:17:02.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.726+0000 7f171ed9d700 1 --2- 172.21.15.71:0/4187063809 >> v2:172.21.15.179:3300/0 conn(0x7f17200b03c0 0x7f17200cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:17:02.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.726+0000 7f171f59e700 1 --2- 172.21.15.71:0/4187063809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17201591e0 0x7f1720159600 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f1718009f20 tx=0x7f1718009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125c484807aa114c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:02.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.726+0000 7f171dd9b700 1 -- 172.21.15.71:0/4187063809 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171800e070 con 0x7f17201591e0 2023-10-09T08:17:02.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.726+0000 7f171dd9b700 1 -- 172.21.15.71:0/4187063809 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171800ba40 con 0x7f17201591e0 2023-10-09T08:17:02.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.726+0000 7f171dd9b700 1 -- 172.21.15.71:0/4187063809 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17180092e0 con 0x7f17201591e0 2023-10-09T08:17:02.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.727+0000 7f17249fe700 1 -- 172.21.15.71:0/4187063809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17201591e0 msgr2=0x7f1720159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:02.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.727+0000 7f17249fe700 1 --2- 172.21.15.71:0/4187063809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17201591e0 0x7f1720159600 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f1718009f20 tx=0x7f1718009840 comp rx=0 tx=0).stop 2023-10-09T08:17:02.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.727+0000 7f17249fe700 1 -- 172.21.15.71:0/4187063809 shutdown_connections 2023-10-09T08:17:02.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.727+0000 7f17249fe700 1 --2- 172.21.15.71:0/4187063809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17201591e0 0x7f1720159600 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:02.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.727+0000 7f17249fe700 1 --2- 172.21.15.71:0/4187063809 >> v2:172.21.15.179:3300/0 conn(0x7f17200b03c0 0x7f17200cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:02.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.727+0000 7f17249fe700 1 -- 172.21.15.71:0/4187063809 >> 172.21.15.71:0/4187063809 conn(0x7f1720063230 msgr2=0x7f1720063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:02.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.727+0000 7f17249fe700 1 -- 172.21.15.71:0/4187063809 shutdown_connections 2023-10-09T08:17:02.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.727+0000 7f17249fe700 1 -- 172.21.15.71:0/4187063809 wait complete. 2023-10-09T08:17:02.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.728+0000 7f17249fe700 1 Processor -- start 2023-10-09T08:17:02.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.729+0000 7f17249fe700 1 -- start start 2023-10-09T08:17:02.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.729+0000 7f17249fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17200b03c0 0x7f1720157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:02.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.729+0000 7f17249fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17200b0790 0x7f172015a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:02.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.729+0000 7f17249fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17201591e0 0x7f172015d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:02.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.730+0000 7f17249fe700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17200c9bd0 con 0x7f17201591e0 2023-10-09T08:17:02.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.730+0000 7f17249fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172015b090 con 0x7f17200b0790 2023-10-09T08:17:02.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.730+0000 7f17249fe700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f172015b370 con 0x7f17200b03c0 2023-10-09T08:17:02.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.730+0000 7f171f59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17201591e0 0x7f172015d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:02.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.730+0000 7f171f59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17201591e0 0x7f172015d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57258/0 (socket says 172.21.15.71:57258) 2023-10-09T08:17:02.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.730+0000 7f171f59e700 1 -- 172.21.15.71:0/823225411 learned_addr learned my addr 172.21.15.71:0/823225411 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:02.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.730+0000 7f171e59c700 1 --2- 172.21.15.71:0/823225411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17200b0790 0x7f172015a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:02.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.730+0000 7f171ed9d700 1 --2- 172.21.15.71:0/823225411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17200b03c0 0x7f1720157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:02.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.730+0000 7f171f59e700 1 -- 172.21.15.71:0/823225411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17200b03c0 msgr2=0x7f1720157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:02.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.730+0000 7f171f59e700 1 --2- 172.21.15.71:0/823225411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17200b03c0 0x7f1720157650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:02.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.730+0000 7f171f59e700 1 -- 172.21.15.71:0/823225411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17200b0790 msgr2=0x7f172015a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:02.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.730+0000 7f171f59e700 1 --2- 172.21.15.71:0/823225411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17200b0790 0x7f172015a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:02.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.730+0000 7f171f59e700 1 -- 172.21.15.71:0/823225411 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1718009ae0 con 0x7f17201591e0 2023-10-09T08:17:02.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.730+0000 7f171ed9d700 1 --2- 172.21.15.71:0/823225411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17200b03c0 0x7f1720157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:02.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.730+0000 7f171f59e700 1 --2- 172.21.15.71:0/823225411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17201591e0 0x7f172015d5a0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f171800b6c0 tx=0x7f1718018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:02.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.731+0000 7f1706ffd700 1 -- 172.21.15.71:0/823225411 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718007e60 con 0x7f17201591e0 2023-10-09T08:17:02.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.731+0000 7f1706ffd700 1 -- 172.21.15.71:0/823225411 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171800be70 con 0x7f17201591e0 2023-10-09T08:17:02.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.731+0000 7f1706ffd700 1 -- 172.21.15.71:0/823225411 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718026460 con 0x7f17201591e0 2023-10-09T08:17:02.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.731+0000 7f17249fe700 1 -- 172.21.15.71:0/823225411 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f172015b650 con 0x7f17201591e0 2023-10-09T08:17:02.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.731+0000 7f17249fe700 1 -- 172.21.15.71:0/823225411 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f172015bc10 con 0x7f17201591e0 2023-10-09T08:17:02.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.732+0000 7f17249fe700 1 -- 172.21.15.71:0/823225411 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f172015bdd0 con 0x7f17201591e0 2023-10-09T08:17:02.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.733+0000 7f1706ffd700 1 -- 172.21.15.71:0/823225411 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 97) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f171801d420 con 0x7f17201591e0 2023-10-09T08:17:02.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.733+0000 7f1706ffd700 1 --2- 172.21.15.71:0/823225411 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f170c0670a0 0x7f170c069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:02.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.734+0000 7f1706ffd700 1 -- 172.21.15.71:0/823225411 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6455+0+0 (secure 0 0 0) 0x7f1718086b10 con 0x7f17201591e0 2023-10-09T08:17:02.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.734+0000 7f171ed9d700 1 --2- 172.21.15.71:0/823225411 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f170c0670a0 0x7f170c069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:02.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.735+0000 7f171ed9d700 1 --2- 172.21.15.71:0/823225411 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f170c0670a0 0x7f170c069550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1710006f00 tx=0x7f1710008040 comp rx=0 tx=0).ready entity=mgr.9316 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:02.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.738+0000 7f1706ffd700 1 -- 172.21.15.71:0/823225411 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17180537d0 con 0x7f17201591e0 2023-10-09T08:17:02.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:02.954+0000 7f17249fe700 1 -- 172.21.15.71:0/823225411 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f172015d2f0 con 0x7f170c0670a0 2023-10-09T08:17:03.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.023+0000 7f1706ffd700 1 -- 172.21.15.71:0/823225411 <== mgr.9316 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f172015d2f0 con 0x7f170c0670a0 2023-10-09T08:17:03.024 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule removed for path snap_test_dir1 2023-10-09T08:17:03.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.025+0000 7f17249fe700 1 -- 172.21.15.71:0/823225411 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f170c0670a0 msgr2=0x7f170c069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:03.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.025+0000 7f17249fe700 1 --2- 172.21.15.71:0/823225411 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f170c0670a0 0x7f170c069550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1710006f00 tx=0x7f1710008040 comp rx=0 tx=0).stop 2023-10-09T08:17:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.025+0000 7f17249fe700 1 -- 172.21.15.71:0/823225411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17201591e0 msgr2=0x7f172015d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.025+0000 7f17249fe700 1 --2- 172.21.15.71:0/823225411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17201591e0 0x7f172015d5a0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f171800b6c0 tx=0x7f1718018000 comp rx=0 tx=0).stop 2023-10-09T08:17:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.026+0000 7f17249fe700 1 -- 172.21.15.71:0/823225411 shutdown_connections 2023-10-09T08:17:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.026+0000 7f17249fe700 1 --2- 172.21.15.71:0/823225411 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f170c0670a0 0x7f170c069550 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.026+0000 7f17249fe700 1 --2- 172.21.15.71:0/823225411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17201591e0 0x7f172015d5a0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.026+0000 7f17249fe700 1 --2- 172.21.15.71:0/823225411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17200b03c0 0x7f1720157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.026+0000 7f17249fe700 1 --2- 172.21.15.71:0/823225411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17200b0790 0x7f172015a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.026+0000 7f17249fe700 1 -- 172.21.15.71:0/823225411 >> 172.21.15.71:0/823225411 conn(0x7f1720063230 msgr2=0x7f17200d0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.026+0000 7f17249fe700 1 -- 172.21.15.71:0/823225411 shutdown_connections 2023-10-09T08:17:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.026+0000 7f17249fe700 1 -- 172.21.15.71:0/823225411 wait complete. 2023-10-09T08:17:03.044 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-09T08:17:03.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:17:03.044 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:17:03.081 INFO:teuthology.orchestra.run.smithi071.stdout:scheduled-2023-10-09-08_17_00_UTC 2023-10-09T08:17:03.082 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-08_17_00_UTC 2023-10-09T08:17:03.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:17:03.083 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-08_17_00_UTC) 2023-10-09T08:17:03.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:17:03.165 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-09T08:17:03.244 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-09T08:17:03.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.466+0000 7fa58f1ff700 1 Processor -- start 2023-10-09T08:17:03.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.466+0000 7fa58f1ff700 1 -- start start 2023-10-09T08:17:03.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.467+0000 7fa58f1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa5880b0a70 0x7fa5881625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:03.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.467+0000 7fa58f1ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5880af2f0 con 0x7fa58815ac80 2023-10-09T08:17:03.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.467+0000 7fa58f1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5880af5d0 con 0x7fa588069e80 2023-10-09T08:17:03.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.467+0000 7fa58f1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5880c8660 con 0x7fa5880b0a70 2023-10-09T08:17:03.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.468+0000 7fa58cf9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa58815ac80 0x7fa588069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:49148/0 (socket says 172.21.15.71:49148) 2023-10-09T08:17:03.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.468+0000 7fa58cf9b700 1 -- 172.21.15.71:0/288400084 learned_addr learned my addr 172.21.15.71:0/288400084 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:03.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.468+0000 7fa58d79c700 1 --2- 172.21.15.71:0/288400084 >> v2:172.21.15.179:3300/0 conn(0x7fa5880b0a70 0x7fa5881625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:03.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.468+0000 7fa5877fe700 1 -- 172.21.15.71:0/288400084 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986765034 0 0) 0x7fa5880af2f0 con 0x7fa58815ac80 2023-10-09T08:17:03.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.468+0000 7fa5877fe700 1 -- 172.21.15.71:0/288400084 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa578003570 con 0x7fa58815ac80 2023-10-09T08:17:03.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.468+0000 7fa58d79c700 1 -- 172.21.15.71:0/288400084 >> v1:172.21.15.179:6789/0 conn(0x7fa588069e80 legacy=0x7fa5880c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:03.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.468+0000 7fa5877fe700 1 -- 172.21.15.71:0/288400084 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155588738 0 0) 0x7fa5880af5d0 con 0x7fa588069e80 2023-10-09T08:17:03.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.468+0000 7fa58d79c700 1 -- 172.21.15.71:0/288400084 >> v1:172.21.15.71:6789/0 conn(0x7fa58815ac80 legacy=0x7fa588069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:03.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.468+0000 7fa58d79c700 1 -- 172.21.15.71:0/288400084 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5880c8940 con 0x7fa5880b0a70 2023-10-09T08:17:03.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.469+0000 7fa58d79c700 1 --2- 172.21.15.71:0/288400084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5880b0a70 0x7fa5881625e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fa580009e60 tx=0x7fa580009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d936911fb60cc28c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:03.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.469+0000 7fa5877fe700 1 -- 172.21.15.71:0/288400084 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58000e070 con 0x7fa5880b0a70 2023-10-09T08:17:03.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.469+0000 7fa5877fe700 1 -- 172.21.15.71:0/288400084 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58000b850 con 0x7fa5880b0a70 2023-10-09T08:17:03.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.469+0000 7fa5877fe700 1 -- 172.21.15.71:0/288400084 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c001470 con 0x7fa5880b0a70 2023-10-09T08:17:03.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.469+0000 7fa58f1ff700 1 -- 172.21.15.71:0/288400084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5880b0a70 msgr2=0x7fa5881625e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:03.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.469+0000 7fa58f1ff700 1 --2- 172.21.15.71:0/288400084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5880b0a70 0x7fa5881625e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fa580009e60 tx=0x7fa580009780 comp rx=0 tx=0).stop 2023-10-09T08:17:03.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.470+0000 7fa58f1ff700 1 -- 172.21.15.71:0/288400084 shutdown_connections 2023-10-09T08:17:03.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.470+0000 7fa58f1ff700 1 --2- 172.21.15.71:0/288400084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5880b0a70 0x7fa5881625e0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:03.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.470+0000 7fa58f1ff700 1 -- 172.21.15.71:0/288400084 >> 172.21.15.71:0/288400084 conn(0x7fa588068e10 msgr2=0x7fa5880cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:03.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.470+0000 7fa58f1ff700 1 -- 172.21.15.71:0/288400084 shutdown_connections 2023-10-09T08:17:03.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.470+0000 7fa58f1ff700 1 -- 172.21.15.71:0/288400084 wait complete. 2023-10-09T08:17:03.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.471+0000 7fa58f1ff700 1 Processor -- start 2023-10-09T08:17:03.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.471+0000 7fa58f1ff700 1 -- start start 2023-10-09T08:17:03.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.473+0000 7fa58f1ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa588069e80 0x7fa5880ac820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:03.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.473+0000 7fa58f1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5880b0a70 0x7fa5880a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:03.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.473+0000 7fa58f1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa58815ac80 0x7fa58814d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:03.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.473+0000 7fa58f1ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880ca310 con 0x7fa588069e80 2023-10-09T08:17:03.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.473+0000 7fa58f1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880a9e10 con 0x7fa58815ac80 2023-10-09T08:17:03.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.473+0000 7fa58f1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880aa0e0 con 0x7fa5880b0a70 2023-10-09T08:17:03.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.473+0000 7fa58cf9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa588069e80 0x7fa5880ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:03.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.473+0000 7fa58cf9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa588069e80 0x7fa5880ac820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57266/0 (socket says 172.21.15.71:57266) 2023-10-09T08:17:03.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.473+0000 7fa58cf9b700 1 -- 172.21.15.71:0/1221972882 learned_addr learned my addr 172.21.15.71:0/1221972882 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:03.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.473+0000 7fa58d79c700 1 --2- 172.21.15.71:0/1221972882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa58815ac80 0x7fa58814d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:03.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.473+0000 7fa587fff700 1 --2- 172.21.15.71:0/1221972882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5880b0a70 0x7fa5880a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:03.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.473+0000 7fa58cf9b700 1 -- 172.21.15.71:0/1221972882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5880b0a70 msgr2=0x7fa5880a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:03.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.473+0000 7fa58cf9b700 1 --2- 172.21.15.71:0/1221972882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5880b0a70 0x7fa5880a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:03.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.474+0000 7fa58cf9b700 1 -- 172.21.15.71:0/1221972882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa58815ac80 msgr2=0x7fa58814d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:03.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.474+0000 7fa58cf9b700 1 --2- 172.21.15.71:0/1221972882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa58815ac80 0x7fa58814d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:03.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.474+0000 7fa58cf9b700 1 -- 172.21.15.71:0/1221972882 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa580009a20 con 0x7fa588069e80 2023-10-09T08:17:03.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.474+0000 7fa58d79c700 1 --2- 172.21.15.71:0/1221972882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa58815ac80 0x7fa58814d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:03.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.474+0000 7fa58cf9b700 1 --2- 172.21.15.71:0/1221972882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa588069e80 0x7fa5880ac820 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fa57c0015a0 tx=0x7fa57c001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:03.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.474+0000 7fa584ff9700 1 -- 172.21.15.71:0/1221972882 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c00ce40 con 0x7fa588069e80 2023-10-09T08:17:03.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.474+0000 7fa584ff9700 1 -- 172.21.15.71:0/1221972882 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57c007360 con 0x7fa588069e80 2023-10-09T08:17:03.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.474+0000 7fa584ff9700 1 -- 172.21.15.71:0/1221972882 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c004830 con 0x7fa588069e80 2023-10-09T08:17:03.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.474+0000 7fa58f1ff700 1 -- 172.21.15.71:0/1221972882 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5880aa3c0 con 0x7fa588069e80 2023-10-09T08:17:03.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.475+0000 7fa58f1ff700 1 -- 172.21.15.71:0/1221972882 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58814d630 con 0x7fa588069e80 2023-10-09T08:17:03.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.476+0000 7fa58f1ff700 1 -- 172.21.15.71:0/1221972882 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5880aa8e0 con 0x7fa588069e80 2023-10-09T08:17:03.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.477+0000 7fa584ff9700 1 -- 172.21.15.71:0/1221972882 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 97) v1 ==== 84871+0+0 (secure 0 0 0) 0x7fa57c004ba0 con 0x7fa588069e80 2023-10-09T08:17:03.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.477+0000 7fa584ff9700 1 --2- 172.21.15.71:0/1221972882 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa56c067170 0x7fa56c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:03.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.477+0000 7fa584ff9700 1 -- 172.21.15.71:0/1221972882 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6455+0+0 (secure 0 0 0) 0x7fa57c084270 con 0x7fa588069e80 2023-10-09T08:17:03.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.478+0000 7fa587fff700 1 --2- 172.21.15.71:0/1221972882 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa56c067170 0x7fa56c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:03.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.479+0000 7fa587fff700 1 --2- 172.21.15.71:0/1221972882 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa56c067170 0x7fa56c069620 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa5880aee20 tx=0x7fa574007d30 comp rx=0 tx=0).ready entity=mgr.9316 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:03.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.482+0000 7fa584ff9700 1 -- 172.21.15.71:0/1221972882 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa57c051140 con 0x7fa588069e80 2023-10-09T08:17:03.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:03.728+0000 7fa58f1ff700 1 -- 172.21.15.71:0/1221972882 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fa58806d8c0 con 0x7fa588069e80 2023-10-09T08:17:04.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.039+0000 7fa584ff9700 1 -- 172.21.15.71:0/1221972882 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 98) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fa57c051510 con 0x7fa588069e80 2023-10-09T08:17:04.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.040+0000 7fa584ff9700 1 -- 172.21.15.71:0/1221972882 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v98) v1 ==== 93+0+0 (secure 0 0 0) 0x7fa57c054bd0 con 0x7fa588069e80 2023-10-09T08:17:04.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.043+0000 7fa58f1ff700 1 -- 172.21.15.71:0/1221972882 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa56c067170 msgr2=0x7fa56c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:04.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.043+0000 7fa58f1ff700 1 --2- 172.21.15.71:0/1221972882 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa56c067170 0x7fa56c069620 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa5880aee20 tx=0x7fa574007d30 comp rx=0 tx=0).stop 2023-10-09T08:17:04.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.043+0000 7fa58f1ff700 1 -- 172.21.15.71:0/1221972882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa588069e80 msgr2=0x7fa5880ac820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:04.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.043+0000 7fa58f1ff700 1 --2- 172.21.15.71:0/1221972882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa588069e80 0x7fa5880ac820 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fa57c0015a0 tx=0x7fa57c001b50 comp rx=0 tx=0).stop 2023-10-09T08:17:04.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.043+0000 7fa58f1ff700 1 -- 172.21.15.71:0/1221972882 shutdown_connections 2023-10-09T08:17:04.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.043+0000 7fa58f1ff700 1 --2- 172.21.15.71:0/1221972882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa58815ac80 0x7fa58814d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:04.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.043+0000 7fa58f1ff700 1 --2- 172.21.15.71:0/1221972882 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa56c067170 0x7fa56c069620 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:04.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.043+0000 7fa58f1ff700 1 --2- 172.21.15.71:0/1221972882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa588069e80 0x7fa5880ac820 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:04.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.043+0000 7fa58f1ff700 1 --2- 172.21.15.71:0/1221972882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5880b0a70 0x7fa5880a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:04.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.043+0000 7fa58f1ff700 1 -- 172.21.15.71:0/1221972882 >> 172.21.15.71:0/1221972882 conn(0x7fa588068e10 msgr2=0x7fa5881571f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:04.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.043+0000 7fa58f1ff700 1 -- 172.21.15.71:0/1221972882 shutdown_connections 2023-10-09T08:17:04.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.043+0000 7fa58f1ff700 1 -- 172.21.15.71:0/1221972882 wait complete. 2023-10-09T08:17:04.063 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T08:17:04.063 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T08:17:04.154 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T08:17:04.233 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T08:17:04.233 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T08:17:04.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:17:04.233 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T08:17:04.319 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T08:17:04.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:17:04.319 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T08:17:04.356 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T08:17:04.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.581+0000 7ff3f619d700 1 Processor -- start 2023-10-09T08:17:04.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.581+0000 7ff3f619d700 1 -- start start 2023-10-09T08:17:04.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.582+0000 7ff3f619d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff3f01597f0 0x7ff3f00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:04.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.582+0000 7ff3f619d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3f015d230 0x7ff3f015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:04.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.582+0000 7ff3f619d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f015dbb0 con 0x7ff3f0159420 2023-10-09T08:17:04.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.582+0000 7ff3f619d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f00b11d0 con 0x7ff3f01597f0 2023-10-09T08:17:04.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.582+0000 7ff3f619d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f00b14b0 con 0x7ff3f015d230 2023-10-09T08:17:04.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.583+0000 7ff3f499a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff3f01597f0 0x7ff3f00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:04.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.583+0000 7ff3f599c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3f015d230 0x7ff3f015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:04.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.583+0000 7ff3f499a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff3f01597f0 0x7ff3f00b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:51270/0 (socket says 172.21.15.71:51270) 2023-10-09T08:17:04.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.583+0000 7ff3f599c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3f015d230 0x7ff3f015d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:32968/0 (socket says 172.21.15.71:32968) 2023-10-09T08:17:04.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.583+0000 7ff3f499a700 1 -- 172.21.15.71:0/1888197616 learned_addr learned my addr 172.21.15.71:0/1888197616 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:04.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.583+0000 7ff3f519b700 1 --1- 172.21.15.71:0/1888197616 >> v1:172.21.15.179:6789/0 conn(0x7ff3f0159420 0x7ff3f00b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:39696/0 (socket says 172.21.15.71:39696) 2023-10-09T08:17:04.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.583+0000 7ff3f499a700 1 -- 172.21.15.71:0/1888197616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3f015d230 msgr2=0x7ff3f015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:04.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.583+0000 7ff3f499a700 1 --2- 172.21.15.71:0/1888197616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3f015d230 0x7ff3f015d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:04.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.583+0000 7ff3f499a700 1 -- 172.21.15.71:0/1888197616 >> v1:172.21.15.179:6789/0 conn(0x7ff3f0159420 legacy=0x7ff3f00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:04.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.583+0000 7ff3f499a700 1 -- 172.21.15.71:0/1888197616 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f00b1790 con 0x7ff3f01597f0 2023-10-09T08:17:04.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.583+0000 7ff3f599c700 1 --2- 172.21.15.71:0/1888197616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3f015d230 0x7ff3f015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:04.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.583+0000 7ff3e7fff700 1 -- 172.21.15.71:0/1888197616 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2044294396 0 0) 0x7ff3f015dbb0 con 0x7ff3f0159420 2023-10-09T08:17:04.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.584+0000 7ff3f499a700 1 --2- 172.21.15.71:0/1888197616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3f01597f0 0x7ff3f00b2270 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7ff3e00099b0 tx=0x7ff3e0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=714dfaae27d33cc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:04.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.584+0000 7ff3e7fff700 1 -- 172.21.15.71:0/1888197616 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0009ea0 con 0x7ff3f01597f0 2023-10-09T08:17:04.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.584+0000 7ff3e7fff700 1 -- 172.21.15.71:0/1888197616 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e000b860 con 0x7ff3f01597f0 2023-10-09T08:17:04.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.584+0000 7ff3e7fff700 1 -- 172.21.15.71:0/1888197616 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e000bc00 con 0x7ff3f01597f0 2023-10-09T08:17:04.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.584+0000 7ff3f619d700 1 -- 172.21.15.71:0/1888197616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3f01597f0 msgr2=0x7ff3f00b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:04.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.584+0000 7ff3f619d700 1 --2- 172.21.15.71:0/1888197616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3f01597f0 0x7ff3f00b2270 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7ff3e00099b0 tx=0x7ff3e0009250 comp rx=0 tx=0).stop 2023-10-09T08:17:04.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.584+0000 7ff3f619d700 1 -- 172.21.15.71:0/1888197616 shutdown_connections 2023-10-09T08:17:04.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.584+0000 7ff3f619d700 1 --2- 172.21.15.71:0/1888197616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3f015d230 0x7ff3f015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:04.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.584+0000 7ff3f619d700 1 --2- 172.21.15.71:0/1888197616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3f01597f0 0x7ff3f00b2270 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:04.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.584+0000 7ff3f619d700 1 -- 172.21.15.71:0/1888197616 >> 172.21.15.71:0/1888197616 conn(0x7ff3f00d0660 msgr2=0x7ff3f00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:04.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.585+0000 7ff3f619d700 1 -- 172.21.15.71:0/1888197616 shutdown_connections 2023-10-09T08:17:04.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.585+0000 7ff3f619d700 1 -- 172.21.15.71:0/1888197616 wait complete. 2023-10-09T08:17:04.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.587+0000 7ff3f619d700 1 Processor -- start 2023-10-09T08:17:04.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.587+0000 7ff3f619d700 1 -- start start 2023-10-09T08:17:04.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.588+0000 7ff3f619d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3f0159420 0x7ff3f014dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:04.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.588+0000 7ff3f619d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3f01597f0 0x7ff3f0157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:04.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.588+0000 7ff3f619d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3f015d230 0x7ff3f0157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:04.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.588+0000 7ff3f619d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f0169bb0 con 0x7ff3f015d230 2023-10-09T08:17:04.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.588+0000 7ff3f619d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f0169e20 con 0x7ff3f01597f0 2023-10-09T08:17:04.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.588+0000 7ff3f619d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f016a100 con 0x7ff3f0159420 2023-10-09T08:17:04.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.589+0000 7ff3f599c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3f015d230 0x7ff3f0157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:04.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.589+0000 7ff3f519b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3f0159420 0x7ff3f014dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:04.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.589+0000 7ff3f599c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3f015d230 0x7ff3f0157890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57296/0 (socket says 172.21.15.71:57296) 2023-10-09T08:17:04.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.589+0000 7ff3f599c700 1 -- 172.21.15.71:0/3219141252 learned_addr learned my addr 172.21.15.71:0/3219141252 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:04.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.589+0000 7ff3f499a700 1 --2- 172.21.15.71:0/3219141252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3f01597f0 0x7ff3f0157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:04.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.589+0000 7ff3f599c700 1 -- 172.21.15.71:0/3219141252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3f0159420 msgr2=0x7ff3f014dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:04.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.589+0000 7ff3f599c700 1 --2- 172.21.15.71:0/3219141252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3f0159420 0x7ff3f014dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:04.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.589+0000 7ff3f599c700 1 -- 172.21.15.71:0/3219141252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3f01597f0 msgr2=0x7ff3f0157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:04.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.589+0000 7ff3f599c700 1 --2- 172.21.15.71:0/3219141252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3f01597f0 0x7ff3f0157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:04.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.589+0000 7ff3f599c700 1 -- 172.21.15.71:0/3219141252 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e8009a20 con 0x7ff3f015d230 2023-10-09T08:17:04.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.589+0000 7ff3f599c700 1 --2- 172.21.15.71:0/3219141252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3f015d230 0x7ff3f0157890 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009f20 tx=0x7ff3e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:04.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.590+0000 7ff3e57fa700 1 -- 172.21.15.71:0/3219141252 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8009c80 con 0x7ff3f015d230 2023-10-09T08:17:04.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.590+0000 7ff3e57fa700 1 -- 172.21.15.71:0/3219141252 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e800f040 con 0x7ff3f015d230 2023-10-09T08:17:04.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.590+0000 7ff3e57fa700 1 -- 172.21.15.71:0/3219141252 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e800cdc0 con 0x7ff3f015d230 2023-10-09T08:17:04.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.590+0000 7ff3f619d700 1 -- 172.21.15.71:0/3219141252 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e00094f0 con 0x7ff3f015d230 2023-10-09T08:17:04.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.590+0000 7ff3f619d700 1 -- 172.21.15.71:0/3219141252 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f016a6c0 con 0x7ff3f015d230 2023-10-09T08:17:04.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.591+0000 7ff3f619d700 1 -- 172.21.15.71:0/3219141252 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f004c3c0 con 0x7ff3f015d230 2023-10-09T08:17:04.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.592+0000 7ff3e57fa700 1 -- 172.21.15.71:0/3219141252 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 98) v1 ==== 84854+0+0 (secure 0 0 0) 0x7ff3e8003020 con 0x7ff3f015d230 2023-10-09T08:17:04.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.593+0000 7ff3e57fa700 1 --2- 172.21.15.71:0/3219141252 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff3d4067050 0x7ff3d4069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:04.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.593+0000 7ff3e57fa700 1 -- 172.21.15.71:0/3219141252 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6543+0+0 (secure 0 0 0) 0x7ff3e80853b0 con 0x7ff3f015d230 2023-10-09T08:17:04.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.593+0000 7ff3f519b700 1 -- 172.21.15.71:0/3219141252 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff3d4067050 msgr2=0x7ff3d4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:04.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.593+0000 7ff3f519b700 1 --2- 172.21.15.71:0/3219141252 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff3d4067050 0x7ff3d4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:04.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.597+0000 7ff3e57fa700 1 -- 172.21.15.71:0/3219141252 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3e8052020 con 0x7ff3f015d230 2023-10-09T08:17:04.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.794+0000 7ff3f519b700 1 -- 172.21.15.71:0/3219141252 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff3d4067050 msgr2=0x7ff3d4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:04.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.794+0000 7ff3f519b700 1 --2- 172.21.15.71:0/3219141252 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff3d4067050 0x7ff3d4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:04.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.841+0000 7ff3f619d700 1 -- 172.21.15.71:0/3219141252 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3f00b1a70 con 0x7ff3f015d230 2023-10-09T08:17:04.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.841+0000 7ff3e57fa700 1 -- 172.21.15.71:0/3219141252 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4592 (secure 0 0 0) 0x7ff3e8055640 con 0x7ff3f015d230 2023-10-09T08:17:04.842 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:04.842 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":89,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7919,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/567694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":567694},{"type":"v1","addr":"172.21.15.71:6835","nonce":567694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":9151,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/502575967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":502575967},{"type":"v1","addr":"172.21.15.179:6836","nonce":502575967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":9663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/1425921431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":1425921431},{"type":"v1","addr":"172.21.15.71:6834","nonce":1425921431}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T08:14:38.913123+0000","modified":"2023-10-09T08:14:42.474701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9678},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9678":{"gid":9678,"name":"d","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/1735854447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1735854447},{"type":"v1","addr":"172.21.15.179:6834","nonce":1735854447}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T08:17:04.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.843+0000 7ff3f619d700 1 -- 172.21.15.71:0/3219141252 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff3d4067050 msgr2=0x7ff3d4069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:04.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.843+0000 7ff3f619d700 1 --2- 172.21.15.71:0/3219141252 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff3d4067050 0x7ff3d4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:04.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.843+0000 7ff3f619d700 1 -- 172.21.15.71:0/3219141252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3f015d230 msgr2=0x7ff3f0157890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:04.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.843+0000 7ff3f619d700 1 --2- 172.21.15.71:0/3219141252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3f015d230 0x7ff3f0157890 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009f20 tx=0x7ff3e800b040 comp rx=0 tx=0).stop 2023-10-09T08:17:04.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.843+0000 7ff3f619d700 1 -- 172.21.15.71:0/3219141252 shutdown_connections 2023-10-09T08:17:04.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.843+0000 7ff3f619d700 1 --2- 172.21.15.71:0/3219141252 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff3d4067050 0x7ff3d4069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:04.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.843+0000 7ff3f619d700 1 --2- 172.21.15.71:0/3219141252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3f015d230 0x7ff3f0157890 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:04.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.843+0000 7ff3f619d700 1 --2- 172.21.15.71:0/3219141252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3f0159420 0x7ff3f014dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:04.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.843+0000 7ff3f619d700 1 --2- 172.21.15.71:0/3219141252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3f01597f0 0x7ff3f0157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:04.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.844+0000 7ff3f619d700 1 -- 172.21.15.71:0/3219141252 >> 172.21.15.71:0/3219141252 conn(0x7ff3f00d0660 msgr2=0x7ff3f00afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:04.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.844+0000 7ff3f619d700 1 -- 172.21.15.71:0/3219141252 shutdown_connections 2023-10-09T08:17:04.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:04.844+0000 7ff3f619d700 1 -- 172.21.15.71:0/3219141252 wait complete. 2023-10-09T08:17:04.846 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 89 2023-10-09T08:17:04.870 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T08:17:05.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.065+0000 7f771919d700 1 Processor -- start 2023-10-09T08:17:05.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.066+0000 7f771919d700 1 -- start start 2023-10-09T08:17:05.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.067+0000 7f771919d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f77140ca660 0x7f771406acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:05.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.067+0000 7f771919d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f771406a840 con 0x7f77140696c0 2023-10-09T08:17:05.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.067+0000 7f771919d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7714069c30 con 0x7f77140c6a70 2023-10-09T08:17:05.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.067+0000 7f771919d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f771406b210 con 0x7f77140ca660 2023-10-09T08:17:05.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.067+0000 7f77137fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f77140696c0 0x7f771406d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48458/0 (socket says 172.21.15.71:48458) 2023-10-09T08:17:05.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.067+0000 7f77137fe700 1 -- 172.21.15.71:0/2357062372 learned_addr learned my addr 172.21.15.71:0/2357062372 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:05.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.067+0000 7f771899c700 1 --2- 172.21.15.71:0/2357062372 >> v2:172.21.15.179:3300/0 conn(0x7f77140ca660 0x7f771406acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:05.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.067+0000 7f7712ffd700 1 -- 172.21.15.71:0/2357062372 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205034191 0 0) 0x7f771406a840 con 0x7f77140696c0 2023-10-09T08:17:05.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.068+0000 7f7712ffd700 1 -- 172.21.15.71:0/2357062372 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76fc003570 con 0x7f77140696c0 2023-10-09T08:17:05.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.068+0000 7f771899c700 1 -- 172.21.15.71:0/2357062372 >> v1:172.21.15.179:6789/0 conn(0x7f77140c6a70 legacy=0x7f77140c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:05.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.068+0000 7f7712ffd700 1 -- 172.21.15.71:0/2357062372 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850919409 0 0) 0x7f7714069c30 con 0x7f77140c6a70 2023-10-09T08:17:05.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.068+0000 7f771899c700 1 -- 172.21.15.71:0/2357062372 >> v1:172.21.15.71:6789/0 conn(0x7f77140696c0 legacy=0x7f771406d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:05.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.068+0000 7f771899c700 1 -- 172.21.15.71:0/2357062372 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7714069f10 con 0x7f77140ca660 2023-10-09T08:17:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.068+0000 7f771899c700 1 --2- 172.21.15.71:0/2357062372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77140ca660 0x7f771406acd0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f770c009e60 tx=0x7f770c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=828241c9e1537228 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.068+0000 7f7712ffd700 1 -- 172.21.15.71:0/2357062372 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c00e070 con 0x7f77140ca660 2023-10-09T08:17:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.068+0000 7f7712ffd700 1 -- 172.21.15.71:0/2357062372 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c00bb60 con 0x7f77140ca660 2023-10-09T08:17:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.068+0000 7f7712ffd700 1 -- 172.21.15.71:0/2357062372 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c00bee0 con 0x7f77140ca660 2023-10-09T08:17:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.069+0000 7f771919d700 1 -- 172.21.15.71:0/2357062372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77140ca660 msgr2=0x7f771406acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.069+0000 7f771919d700 1 --2- 172.21.15.71:0/2357062372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77140ca660 0x7f771406acd0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f770c009e60 tx=0x7f770c009780 comp rx=0 tx=0).stop 2023-10-09T08:17:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.069+0000 7f771919d700 1 -- 172.21.15.71:0/2357062372 shutdown_connections 2023-10-09T08:17:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.069+0000 7f771919d700 1 --2- 172.21.15.71:0/2357062372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77140ca660 0x7f771406acd0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.069+0000 7f771919d700 1 -- 172.21.15.71:0/2357062372 >> 172.21.15.71:0/2357062372 conn(0x7f77140cc1f0 msgr2=0x7f77140cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.069+0000 7f771919d700 1 -- 172.21.15.71:0/2357062372 shutdown_connections 2023-10-09T08:17:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.069+0000 7f771919d700 1 -- 172.21.15.71:0/2357062372 wait complete. 2023-10-09T08:17:05.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.071+0000 7f771919d700 1 Processor -- start 2023-10-09T08:17:05.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.071+0000 7f771919d700 1 -- start start 2023-10-09T08:17:05.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.072+0000 7f771919d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77140696c0 0x7f771415bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:05.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.072+0000 7f771919d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77140c6a70 0x7f77140c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:05.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.072+0000 7f771919d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77140ca660 0x7f7714147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:05.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.072+0000 7f771919d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771415bab0 con 0x7f77140ca660 2023-10-09T08:17:05.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.072+0000 7f771919d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7714156bd0 con 0x7f77140696c0 2023-10-09T08:17:05.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.072+0000 7f771919d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7714156eb0 con 0x7f77140c6a70 2023-10-09T08:17:05.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.072+0000 7f771899c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77140ca660 0x7f7714147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.072+0000 7f771899c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77140ca660 0x7f7714147c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56014/0 (socket says 172.21.15.71:56014) 2023-10-09T08:17:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.072+0000 7f771899c700 1 -- 172.21.15.71:0/3735788350 learned_addr learned my addr 172.21.15.71:0/3735788350 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.072+0000 7f77137fe700 1 --2- 172.21.15.71:0/3735788350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77140c6a70 0x7f77140c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.072+0000 7f7713fff700 1 --2- 172.21.15.71:0/3735788350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77140696c0 0x7f771415bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.072+0000 7f771899c700 1 -- 172.21.15.71:0/3735788350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77140c6a70 msgr2=0x7f77140c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.072+0000 7f771899c700 1 --2- 172.21.15.71:0/3735788350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77140c6a70 0x7f77140c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.072+0000 7f771899c700 1 -- 172.21.15.71:0/3735788350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77140696c0 msgr2=0x7f771415bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.072+0000 7f771899c700 1 --2- 172.21.15.71:0/3735788350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77140696c0 0x7f771415bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.072+0000 7f771899c700 1 -- 172.21.15.71:0/3735788350 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c009a20 con 0x7f77140ca660 2023-10-09T08:17:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.073+0000 7f771899c700 1 --2- 172.21.15.71:0/3735788350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77140ca660 0x7f7714147c40 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f771406fe40 tx=0x7f770c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.073+0000 7f76fbfff700 1 -- 172.21.15.71:0/3735788350 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c012e90 con 0x7f77140ca660 2023-10-09T08:17:05.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.073+0000 7f76fbfff700 1 -- 172.21.15.71:0/3735788350 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c027470 con 0x7f77140ca660 2023-10-09T08:17:05.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.073+0000 7f771919d700 1 -- 172.21.15.71:0/3735788350 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f771415b740 con 0x7f77140ca660 2023-10-09T08:17:05.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.073+0000 7f76fbfff700 1 -- 172.21.15.71:0/3735788350 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c0277f0 con 0x7f77140ca660 2023-10-09T08:17:05.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.073+0000 7f771919d700 1 -- 172.21.15.71:0/3735788350 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7714148180 con 0x7f77140ca660 2023-10-09T08:17:05.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.074+0000 7f771919d700 1 -- 172.21.15.71:0/3735788350 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f771415bc20 con 0x7f77140ca660 2023-10-09T08:17:05.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.075+0000 7f76fbfff700 1 -- 172.21.15.71:0/3735788350 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 98) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f770c024070 con 0x7f77140ca660 2023-10-09T08:17:05.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.076+0000 7f76fbfff700 1 --2- 172.21.15.71:0/3735788350 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f7700067050 0x7f7700069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:05.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.077+0000 7f76fbfff700 1 -- 172.21.15.71:0/3735788350 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f770c087080 con 0x7f77140ca660 2023-10-09T08:17:05.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.077+0000 7f7713fff700 1 -- 172.21.15.71:0/3735788350 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f7700067050 msgr2=0x7f7700069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:05.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.077+0000 7f7713fff700 1 --2- 172.21.15.71:0/3735788350 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f7700067050 0x7f7700069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:05.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.081+0000 7f76fbfff700 1 -- 172.21.15.71:0/3735788350 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f770c053eb0 con 0x7f77140ca660 2023-10-09T08:17:05.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.278+0000 7f7713fff700 1 -- 172.21.15.71:0/3735788350 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f7700067050 msgr2=0x7f7700069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:05.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.278+0000 7f7713fff700 1 --2- 172.21.15.71:0/3735788350 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f7700067050 0x7f7700069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:05.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.282+0000 7f771919d700 1 -- 172.21.15.71:0/3735788350 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f771404c3c0 con 0x7f77140ca660 2023-10-09T08:17:05.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.283+0000 7f76fbfff700 1 -- 172.21.15.71:0/3735788350 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+16627 (secure 0 0 0) 0x7f770c0574d0 con 0x7f77140ca660 2023-10-09T08:17:05.284 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:05.284 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":197,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T08:17:05.035359+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T08:14:37.033384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T08:14:37.895335+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":197,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:0/407948890":"2023-10-10T08:14:59.016743+0000","172.21.15.179:0/2620610180":"2023-10-10T08:14:59.016743+0000","172.21.15.179:6837/101206":"2023-10-10T08:14:59.016743+0000","172.21.15.179:0/13097287":"2023-10-10T08:14:59.016743+0000","172.21.15.179:6835/101206":"2023-10-10T08:14:59.016743+0000","172.21.15.179:0/3123444754":"2023-10-10T08:14:59.016743+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":23,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T08:17:05.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.285+0000 7f771919d700 1 -- 172.21.15.71:0/3735788350 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f7700067050 msgr2=0x7f7700069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:05.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.285+0000 7f771919d700 1 --2- 172.21.15.71:0/3735788350 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f7700067050 0x7f7700069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.285+0000 7f771919d700 1 -- 172.21.15.71:0/3735788350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77140ca660 msgr2=0x7f7714147c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:05.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.285+0000 7f771919d700 1 --2- 172.21.15.71:0/3735788350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77140ca660 0x7f7714147c40 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f771406fe40 tx=0x7f770c019000 comp rx=0 tx=0).stop 2023-10-09T08:17:05.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.285+0000 7f771919d700 1 -- 172.21.15.71:0/3735788350 shutdown_connections 2023-10-09T08:17:05.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.285+0000 7f771919d700 1 --2- 172.21.15.71:0/3735788350 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f7700067050 0x7f7700069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.285+0000 7f771919d700 1 --2- 172.21.15.71:0/3735788350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77140ca660 0x7f7714147c40 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.285+0000 7f771919d700 1 --2- 172.21.15.71:0/3735788350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77140696c0 0x7f771415bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.285+0000 7f771919d700 1 --2- 172.21.15.71:0/3735788350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77140c6a70 0x7f77140c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.285+0000 7f771919d700 1 -- 172.21.15.71:0/3735788350 >> 172.21.15.71:0/3735788350 conn(0x7f77140cc1f0 msgr2=0x7f7714157e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:05.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.286+0000 7f771919d700 1 -- 172.21.15.71:0/3735788350 shutdown_connections 2023-10-09T08:17:05.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.286+0000 7f771919d700 1 -- 172.21.15.71:0/3735788350 wait complete. 2023-10-09T08:17:05.305 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T08:14:37.033384+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '193', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T08:14:37.895335+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '197', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 5, 'snap_epoch': 197, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T08:17:05.305 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T08:17:05.355 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:05.355+0000 7f3c588e4180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T08:17:05.398 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:05.397+0000 7f4463186180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T08:17:05.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.500+0000 7f674ffff700 1 Processor -- start 2023-10-09T08:17:05.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.500+0000 7f674ffff700 1 -- start start 2023-10-09T08:17:05.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.501+0000 7f674ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6750156490 0x7f67500ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:05.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.501+0000 7f674ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f675006af00 0x7f6750160320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:05.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.501+0000 7f674ffff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67500afc80 con 0x7f6750156860 2023-10-09T08:17:05.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.501+0000 7f674ffff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67500af090 con 0x7f6750156490 2023-10-09T08:17:05.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.501+0000 7f674ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67500af350 con 0x7f675006af00 2023-10-09T08:17:05.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.502+0000 7f674e7fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6750156860 0x7f675006a7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48466/0 (socket says 172.21.15.71:48466) 2023-10-09T08:17:05.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.502+0000 7f674e7fc700 1 -- 172.21.15.71:0/2066807221 learned_addr learned my addr 172.21.15.71:0/2066807221 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:05.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.502+0000 7f674effd700 1 --2- 172.21.15.71:0/2066807221 >> v2:172.21.15.179:3300/0 conn(0x7f6750156490 0x7f67500ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:05.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.502+0000 7f674f7fe700 1 --2- 172.21.15.71:0/2066807221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f675006af00 0x7f6750160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:05.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.502+0000 7f674dffb700 1 -- 172.21.15.71:0/2066807221 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998840068 0 0) 0x7f67500afc80 con 0x7f6750156860 2023-10-09T08:17:05.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.502+0000 7f674dffb700 1 -- 172.21.15.71:0/2066807221 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6738003570 con 0x7f6750156860 2023-10-09T08:17:05.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.502+0000 7f674effd700 1 -- 172.21.15.71:0/2066807221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f675006af00 msgr2=0x7f6750160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:05.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.502+0000 7f674effd700 1 --2- 172.21.15.71:0/2066807221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f675006af00 0x7f6750160320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.502+0000 7f674effd700 1 -- 172.21.15.71:0/2066807221 >> v1:172.21.15.71:6789/0 conn(0x7f6750156860 legacy=0x7f675006a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:05.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.502+0000 7f674effd700 1 -- 172.21.15.71:0/2066807221 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67500af630 con 0x7f6750156490 2023-10-09T08:17:05.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.502+0000 7f674f7fe700 1 --2- 172.21.15.71:0/2066807221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f675006af00 0x7f6750160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:05.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.503+0000 7f674effd700 1 --2- 172.21.15.71:0/2066807221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6750156490 0x7f67500ad770 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f6740009910 tx=0x7f67400091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=291ad8b49ea7af23 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:05.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.503+0000 7f674dffb700 1 -- 172.21.15.71:0/2066807221 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740011630 con 0x7f6750156490 2023-10-09T08:17:05.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.503+0000 7f674dffb700 1 -- 172.21.15.71:0/2066807221 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6740011790 con 0x7f6750156490 2023-10-09T08:17:05.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.503+0000 7f674dffb700 1 -- 172.21.15.71:0/2066807221 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740011b10 con 0x7f6750156490 2023-10-09T08:17:05.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.503+0000 7f674ffff700 1 -- 172.21.15.71:0/2066807221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6750156490 msgr2=0x7f67500ad770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:05.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.503+0000 7f674ffff700 1 --2- 172.21.15.71:0/2066807221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6750156490 0x7f67500ad770 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f6740009910 tx=0x7f67400091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.503+0000 7f674ffff700 1 -- 172.21.15.71:0/2066807221 shutdown_connections 2023-10-09T08:17:05.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.503+0000 7f674ffff700 1 --2- 172.21.15.71:0/2066807221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f675006af00 0x7f6750160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.503+0000 7f674ffff700 1 --2- 172.21.15.71:0/2066807221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6750156490 0x7f67500ad770 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.503+0000 7f674ffff700 1 -- 172.21.15.71:0/2066807221 >> 172.21.15.71:0/2066807221 conn(0x7f6750068390 msgr2=0x7f6750068790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:05.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.504+0000 7f674ffff700 1 -- 172.21.15.71:0/2066807221 shutdown_connections 2023-10-09T08:17:05.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.504+0000 7f674ffff700 1 -- 172.21.15.71:0/2066807221 wait complete. 2023-10-09T08:17:05.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.505+0000 7f674ffff700 1 Processor -- start 2023-10-09T08:17:05.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.505+0000 7f674ffff700 1 -- start start 2023-10-09T08:17:05.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.506+0000 7f674ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f675006af00 0x7f675013f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:05.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.506+0000 7f674ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6750156490 0x7f6750148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:05.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.506+0000 7f674ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6750156860 0x7f67500c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:05.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.506+0000 7f674ffff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675013fa00 con 0x7f675006af00 2023-10-09T08:17:05.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.506+0000 7f674ffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675013fce0 con 0x7f6750156860 2023-10-09T08:17:05.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.506+0000 7f674ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675013ffc0 con 0x7f6750156490 2023-10-09T08:17:05.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.506+0000 7f674effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f675006af00 0x7f675013f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:05.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.506+0000 7f674effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f675006af00 0x7f675013f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56016/0 (socket says 172.21.15.71:56016) 2023-10-09T08:17:05.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.506+0000 7f674effd700 1 -- 172.21.15.71:0/427540966 learned_addr learned my addr 172.21.15.71:0/427540966 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:05.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.506+0000 7f674f7fe700 1 --2- 172.21.15.71:0/427540966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6750156860 0x7f67500c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:05.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.506+0000 7f674e7fc700 1 --2- 172.21.15.71:0/427540966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6750156490 0x7f6750148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:05.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.507+0000 7f674effd700 1 -- 172.21.15.71:0/427540966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6750156490 msgr2=0x7f6750148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:05.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.507+0000 7f674effd700 1 --2- 172.21.15.71:0/427540966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6750156490 0x7f6750148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.507+0000 7f674effd700 1 -- 172.21.15.71:0/427540966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6750156860 msgr2=0x7f67500c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:05.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.507+0000 7f674effd700 1 --2- 172.21.15.71:0/427540966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6750156860 0x7f67500c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.507+0000 7f674effd700 1 -- 172.21.15.71:0/427540966 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6748009a20 con 0x7f675006af00 2023-10-09T08:17:05.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.507+0000 7f674f7fe700 1 --2- 172.21.15.71:0/427540966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6750156860 0x7f67500c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:17:05.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.507+0000 7f674effd700 1 --2- 172.21.15.71:0/427540966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f675006af00 0x7f675013f0f0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f675006cd90 tx=0x7f6740017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:05.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.507+0000 7f6736ffd700 1 -- 172.21.15.71:0/427540966 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740011630 con 0x7f675006af00 2023-10-09T08:17:05.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.507+0000 7f6736ffd700 1 -- 172.21.15.71:0/427540966 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6740000cc0 con 0x7f675006af00 2023-10-09T08:17:05.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.507+0000 7f674ffff700 1 -- 172.21.15.71:0/427540966 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6740009420 con 0x7f675006af00 2023-10-09T08:17:05.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.507+0000 7f6736ffd700 1 -- 172.21.15.71:0/427540966 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740011b10 con 0x7f675006af00 2023-10-09T08:17:05.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.508+0000 7f674ffff700 1 -- 172.21.15.71:0/427540966 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6750140580 con 0x7f675006af00 2023-10-09T08:17:05.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.509+0000 7f674ffff700 1 -- 172.21.15.71:0/427540966 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6750070750 con 0x7f675006af00 2023-10-09T08:17:05.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.509+0000 7f6736ffd700 1 -- 172.21.15.71:0/427540966 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 98) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f674001a950 con 0x7f675006af00 2023-10-09T08:17:05.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.510+0000 7f6736ffd700 1 --2- 172.21.15.71:0/427540966 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f673c067050 0x7f673c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:05.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.510+0000 7f6736ffd700 1 -- 172.21.15.71:0/427540966 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f67400866d0 con 0x7f675006af00 2023-10-09T08:17:05.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.510+0000 7f674e7fc700 1 -- 172.21.15.71:0/427540966 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f673c067050 msgr2=0x7f673c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:05.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.510+0000 7f674e7fc700 1 --2- 172.21.15.71:0/427540966 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f673c067050 0x7f673c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:05.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.515+0000 7f6736ffd700 1 -- 172.21.15.71:0/427540966 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6740053460 con 0x7f675006af00 2023-10-09T08:17:05.521 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:05.521+0000 7f3c588e4180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T08:17:05.582 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:05.581+0000 7f4463186180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T08:17:05.612 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:05.611+0000 7f3c588e4180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T08:17:05.675 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:05.674+0000 7f4463186180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T08:17:05.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.711+0000 7f674e7fc700 1 -- 172.21.15.71:0/427540966 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f673c067050 msgr2=0x7f673c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:05.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.711+0000 7f674e7fc700 1 --2- 172.21.15.71:0/427540966 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f673c067050 0x7f673c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:05.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.733+0000 7f674ffff700 1 -- 172.21.15.71:0/427540966 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67500af910 con 0x7f675006af00 2023-10-09T08:17:05.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.734+0000 7f6736ffd700 1 -- 172.21.15.71:0/427540966 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v197) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6740056a80 con 0x7f675006af00 2023-10-09T08:17:05.735 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T08:17:05.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.736+0000 7f674ffff700 1 -- 172.21.15.71:0/427540966 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f673c067050 msgr2=0x7f673c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:05.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.736+0000 7f674ffff700 1 --2- 172.21.15.71:0/427540966 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f673c067050 0x7f673c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.736+0000 7f674ffff700 1 -- 172.21.15.71:0/427540966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f675006af00 msgr2=0x7f675013f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:05.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.736+0000 7f674ffff700 1 --2- 172.21.15.71:0/427540966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f675006af00 0x7f675013f0f0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f675006cd90 tx=0x7f6740017000 comp rx=0 tx=0).stop 2023-10-09T08:17:05.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.736+0000 7f674ffff700 1 -- 172.21.15.71:0/427540966 shutdown_connections 2023-10-09T08:17:05.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.736+0000 7f674ffff700 1 --2- 172.21.15.71:0/427540966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6750156860 0x7f67500c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.736+0000 7f674ffff700 1 --2- 172.21.15.71:0/427540966 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f673c067050 0x7f673c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.736+0000 7f674ffff700 1 --2- 172.21.15.71:0/427540966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f675006af00 0x7f675013f0f0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.736+0000 7f674ffff700 1 --2- 172.21.15.71:0/427540966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6750156490 0x7f6750148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.736+0000 7f674ffff700 1 -- 172.21.15.71:0/427540966 >> 172.21.15.71:0/427540966 conn(0x7f6750068390 msgr2=0x7f67500abc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:05.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.736+0000 7f674ffff700 1 -- 172.21.15.71:0/427540966 shutdown_connections 2023-10-09T08:17:05.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.736+0000 7f674ffff700 1 -- 172.21.15.71:0/427540966 wait complete. 2023-10-09T08:17:05.757 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T08:17:05.838 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:05.838+0000 7f3c588e4180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T08:17:05.909 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:05.908+0000 7f4463186180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T08:17:05.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.946+0000 7f314759e700 1 Processor -- start 2023-10-09T08:17:05.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.946+0000 7f314759e700 1 -- start start 2023-10-09T08:17:05.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.947+0000 7f314759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31480cb1a0 0x7f314815a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:05.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.947+0000 7f314759e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f31480ae0d0 0x7f31480ae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:05.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.947+0000 7f314759e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314806ebd0 con 0x7f314815a8a0 2023-10-09T08:17:05.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.947+0000 7f314759e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314815b2e0 con 0x7f31480ae0d0 2023-10-09T08:17:05.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.947+0000 7f314759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31480aea50 con 0x7f31480cb1a0 2023-10-09T08:17:05.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.947+0000 7f3146d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f31480ae0d0 0x7f31480ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:05.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.947+0000 7f3146d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f31480ae0d0 0x7f31480ae510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56030/0 (socket says 172.21.15.71:56030) 2023-10-09T08:17:05.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.947+0000 7f3146d9d700 1 -- 172.21.15.71:0/4217885409 learned_addr learned my addr 172.21.15.71:0/4217885409 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:05.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.948+0000 7f314659c700 1 --2- 172.21.15.71:0/4217885409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31480cb1a0 0x7f314815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:05.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.948+0000 7f3146d9d700 1 -- 172.21.15.71:0/4217885409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31480cb1a0 msgr2=0x7f314815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:05.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.948+0000 7f3146d9d700 1 --2- 172.21.15.71:0/4217885409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31480cb1a0 0x7f314815a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.948+0000 7f3146d9d700 1 -- 172.21.15.71:0/4217885409 >> v1:172.21.15.179:6789/0 conn(0x7f314815a8a0 legacy=0x7f314806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:05.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.948+0000 7f3146d9d700 1 -- 172.21.15.71:0/4217885409 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314815ad20 con 0x7f31480ae0d0 2023-10-09T08:17:05.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.948+0000 7f3146d9d700 1 --2- 172.21.15.71:0/4217885409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31480ae0d0 0x7f31480ae510 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f3140009f20 tx=0x7f3140009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfef93c453e71d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:05.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.948+0000 7f314559a700 1 -- 172.21.15.71:0/4217885409 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314000e070 con 0x7f31480ae0d0 2023-10-09T08:17:05.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.948+0000 7f314559a700 1 -- 172.21.15.71:0/4217885409 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314000ba60 con 0x7f31480ae0d0 2023-10-09T08:17:05.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.948+0000 7f314559a700 1 -- 172.21.15.71:0/4217885409 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31400092e0 con 0x7f31480ae0d0 2023-10-09T08:17:05.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.949+0000 7f314759e700 1 -- 172.21.15.71:0/4217885409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31480ae0d0 msgr2=0x7f31480ae510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:05.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.949+0000 7f314759e700 1 --2- 172.21.15.71:0/4217885409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31480ae0d0 0x7f31480ae510 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f3140009f20 tx=0x7f3140009840 comp rx=0 tx=0).stop 2023-10-09T08:17:05.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.949+0000 7f314759e700 1 -- 172.21.15.71:0/4217885409 shutdown_connections 2023-10-09T08:17:05.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.949+0000 7f314759e700 1 --2- 172.21.15.71:0/4217885409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31480ae0d0 0x7f31480ae510 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.949+0000 7f314759e700 1 --2- 172.21.15.71:0/4217885409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31480cb1a0 0x7f314815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.949+0000 7f314759e700 1 -- 172.21.15.71:0/4217885409 >> 172.21.15.71:0/4217885409 conn(0x7f31480cc1e0 msgr2=0x7f31480cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:05.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.949+0000 7f314759e700 1 -- 172.21.15.71:0/4217885409 shutdown_connections 2023-10-09T08:17:05.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.949+0000 7f314759e700 1 -- 172.21.15.71:0/4217885409 wait complete. 2023-10-09T08:17:05.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.951+0000 7f314759e700 1 Processor -- start 2023-10-09T08:17:05.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.951+0000 7f314759e700 1 -- start start 2023-10-09T08:17:05.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.952+0000 7f314759e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31480ae0d0 0x7f314816ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:05.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.952+0000 7f314759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31480cb1a0 0x7f3148154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:05.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.952+0000 7f314759e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3148155970 0x7f3148155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:05.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.952+0000 7f314759e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31480c6190 con 0x7f31480ae0d0 2023-10-09T08:17:05.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.952+0000 7f314759e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3148156330 con 0x7f3148155970 2023-10-09T08:17:05.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.952+0000 7f314759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3148155120 con 0x7f31480cb1a0 2023-10-09T08:17:05.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.952+0000 7f314659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31480ae0d0 0x7f314816ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:05.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.952+0000 7f314659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31480ae0d0 0x7f314816ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56034/0 (socket says 172.21.15.71:56034) 2023-10-09T08:17:05.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.952+0000 7f314659c700 1 -- 172.21.15.71:0/3328066396 learned_addr learned my addr 172.21.15.71:0/3328066396 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:05.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.952+0000 7f3145d9b700 1 --2- 172.21.15.71:0/3328066396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31480cb1a0 0x7f3148154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:05.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.952+0000 7f3146d9d700 1 --2- 172.21.15.71:0/3328066396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3148155970 0x7f3148155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:05.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.952+0000 7f314659c700 1 -- 172.21.15.71:0/3328066396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31480cb1a0 msgr2=0x7f3148154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:05.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.952+0000 7f314659c700 1 --2- 172.21.15.71:0/3328066396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31480cb1a0 0x7f3148154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.952+0000 7f314659c700 1 -- 172.21.15.71:0/3328066396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3148155970 msgr2=0x7f3148155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:05.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.952+0000 7f314659c700 1 --2- 172.21.15.71:0/3328066396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3148155970 0x7f3148155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:05.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.952+0000 7f314659c700 1 -- 172.21.15.71:0/3328066396 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3140009ae0 con 0x7f31480ae0d0 2023-10-09T08:17:05.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.953+0000 7f314659c700 1 --2- 172.21.15.71:0/3328066396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31480ae0d0 0x7f314816ae70 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f313800ecb0 tx=0x7f31380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:05.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.953+0000 7f31367fc700 1 -- 172.21.15.71:0/3328066396 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313800c850 con 0x7f31480ae0d0 2023-10-09T08:17:05.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.953+0000 7f31367fc700 1 -- 172.21.15.71:0/3328066396 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313800c9b0 con 0x7f31480ae0d0 2023-10-09T08:17:05.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.953+0000 7f314759e700 1 -- 172.21.15.71:0/3328066396 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31480c4eb0 con 0x7f31480ae0d0 2023-10-09T08:17:05.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.953+0000 7f31367fc700 1 -- 172.21.15.71:0/3328066396 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313800cd50 con 0x7f31480ae0d0 2023-10-09T08:17:05.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.953+0000 7f314759e700 1 -- 172.21.15.71:0/3328066396 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3148156d60 con 0x7f31480ae0d0 2023-10-09T08:17:05.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.954+0000 7f314759e700 1 -- 172.21.15.71:0/3328066396 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314806c450 con 0x7f31480ae0d0 2023-10-09T08:17:05.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.955+0000 7f31367fc700 1 -- 172.21.15.71:0/3328066396 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 98) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f3138013680 con 0x7f31480ae0d0 2023-10-09T08:17:05.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.956+0000 7f31367fc700 1 --2- 172.21.15.71:0/3328066396 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3128067050 0x7f3128069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:05.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.956+0000 7f31367fc700 1 -- 172.21.15.71:0/3328066396 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f3138084c70 con 0x7f31480ae0d0 2023-10-09T08:17:05.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.956+0000 7f3145d9b700 1 -- 172.21.15.71:0/3328066396 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3128067050 msgr2=0x7f3128069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:05.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.956+0000 7f3145d9b700 1 --2- 172.21.15.71:0/3328066396 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3128067050 0x7f3128069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:05.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:05.960+0000 7f31367fc700 1 -- 172.21.15.71:0/3328066396 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3138051a00 con 0x7f31480ae0d0 2023-10-09T08:17:06.020 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:06.020+0000 7f3c588e4180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T08:17:06.096 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:06.095+0000 7f4463186180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T08:17:06.116 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:06.115+0000 7f3c588e4180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T08:17:06.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.157+0000 7f3145d9b700 1 -- 172.21.15.71:0/3328066396 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3128067050 msgr2=0x7f3128069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:06.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.157+0000 7f3145d9b700 1 --2- 172.21.15.71:0/3328066396 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3128067050 0x7f3128069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:06.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.160+0000 7f314759e700 1 -- 172.21.15.71:0/3328066396 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f314815b000 con 0x7f31480ae0d0 2023-10-09T08:17:06.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.160+0000 7f31367fc700 1 -- 172.21.15.71:0/3328066396 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v197) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3138055020 con 0x7f31480ae0d0 2023-10-09T08:17:06.161 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-09T08:17:06.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.163+0000 7f314759e700 1 -- 172.21.15.71:0/3328066396 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3128067050 msgr2=0x7f3128069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:06.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.163+0000 7f314759e700 1 --2- 172.21.15.71:0/3328066396 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3128067050 0x7f3128069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:06.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.163+0000 7f314759e700 1 -- 172.21.15.71:0/3328066396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31480ae0d0 msgr2=0x7f314816ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:06.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.163+0000 7f314759e700 1 --2- 172.21.15.71:0/3328066396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31480ae0d0 0x7f314816ae70 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f313800ecb0 tx=0x7f31380091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:06.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.163+0000 7f314759e700 1 -- 172.21.15.71:0/3328066396 shutdown_connections 2023-10-09T08:17:06.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.163+0000 7f314759e700 1 --2- 172.21.15.71:0/3328066396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3148155970 0x7f3148155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:06.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.163+0000 7f314759e700 1 --2- 172.21.15.71:0/3328066396 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3128067050 0x7f3128069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:06.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.163+0000 7f314759e700 1 --2- 172.21.15.71:0/3328066396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31480ae0d0 0x7f314816ae70 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:06.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.163+0000 7f314759e700 1 --2- 172.21.15.71:0/3328066396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31480cb1a0 0x7f3148154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:06.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.163+0000 7f314759e700 1 -- 172.21.15.71:0/3328066396 >> 172.21.15.71:0/3328066396 conn(0x7f31480cc1e0 msgr2=0x7f31480cc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:06.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.163+0000 7f314759e700 1 -- 172.21.15.71:0/3328066396 shutdown_connections 2023-10-09T08:17:06.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.163+0000 7f314759e700 1 -- 172.21.15.71:0/3328066396 wait complete. 2023-10-09T08:17:06.183 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T08:17:06.195 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:06.193+0000 7f4463186180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T08:17:06.279 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:06.279+0000 7f3c588e4180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T08:17:06.361 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:06.360+0000 7f4463186180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T08:17:06.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.370+0000 7f078899d700 1 Processor -- start 2023-10-09T08:17:06.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.370+0000 7f078899d700 1 -- start start 2023-10-09T08:17:06.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.371+0000 7f078899d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f07840b4e70 0x7f07840ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:06.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.371+0000 7f078899d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f07840b1b40 0x7f078415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:06.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.371+0000 7f078899d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07840cfb00 con 0x7f07840b16d0 2023-10-09T08:17:06.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.371+0000 7f078899d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07840b5c40 con 0x7f07840b4e70 2023-10-09T08:17:06.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.371+0000 7f078899d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07840b5f20 con 0x7f07840b1b40 2023-10-09T08:17:06.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.371+0000 7f07837fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f07840b4e70 0x7f07840ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:06.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.371+0000 7f07837fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f07840b4e70 0x7f07840ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56046/0 (socket says 172.21.15.71:56046) 2023-10-09T08:17:06.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.371+0000 7f07837fe700 1 -- 172.21.15.71:0/3808687499 learned_addr learned my addr 172.21.15.71:0/3808687499 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:06.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.371+0000 7f0783fff700 1 --2- 172.21.15.71:0/3808687499 >> v2:172.21.15.179:3300/0 conn(0x7f07840b1b40 0x7f078415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:06.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.372+0000 7f07837fe700 1 -- 172.21.15.71:0/3808687499 >> v2:172.21.15.179:3300/0 conn(0x7f07840b1b40 msgr2=0x7f078415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:06.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.372+0000 7f07837fe700 1 --2- 172.21.15.71:0/3808687499 >> v2:172.21.15.179:3300/0 conn(0x7f07840b1b40 0x7f078415d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:06.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.372+0000 7f07837fe700 1 -- 172.21.15.71:0/3808687499 >> v1:172.21.15.179:6789/0 conn(0x7f07840b16d0 legacy=0x7f078415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:06.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.372+0000 7f07837fe700 1 -- 172.21.15.71:0/3808687499 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07840b6200 con 0x7f07840b4e70 2023-10-09T08:17:06.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.372+0000 7f07837fe700 1 --2- 172.21.15.71:0/3808687499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07840b4e70 0x7f07840ccff0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f0784071380 tx=0x7f0774009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb3cec684c9b6f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:06.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.372+0000 7f07827fc700 1 -- 172.21.15.71:0/3808687499 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0774009e70 con 0x7f07840b4e70 2023-10-09T08:17:06.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.372+0000 7f07827fc700 1 -- 172.21.15.71:0/3808687499 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077400b860 con 0x7f07840b4e70 2023-10-09T08:17:06.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.372+0000 7f07827fc700 1 -- 172.21.15.71:0/3808687499 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077400bc00 con 0x7f07840b4e70 2023-10-09T08:17:06.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.373+0000 7f078899d700 1 -- 172.21.15.71:0/3808687499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07840b4e70 msgr2=0x7f07840ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:06.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.373+0000 7f078899d700 1 --2- 172.21.15.71:0/3808687499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07840b4e70 0x7f07840ccff0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f0784071380 tx=0x7f0774009250 comp rx=0 tx=0).stop 2023-10-09T08:17:06.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.373+0000 7f078899d700 1 -- 172.21.15.71:0/3808687499 shutdown_connections 2023-10-09T08:17:06.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.373+0000 7f078899d700 1 --2- 172.21.15.71:0/3808687499 >> v2:172.21.15.179:3300/0 conn(0x7f07840b1b40 0x7f078415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:06.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.373+0000 7f078899d700 1 --2- 172.21.15.71:0/3808687499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07840b4e70 0x7f07840ccff0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:06.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.373+0000 7f078899d700 1 -- 172.21.15.71:0/3808687499 >> 172.21.15.71:0/3808687499 conn(0x7f07840d10c0 msgr2=0x7f07840affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:06.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.373+0000 7f078899d700 1 -- 172.21.15.71:0/3808687499 shutdown_connections 2023-10-09T08:17:06.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.373+0000 7f078899d700 1 -- 172.21.15.71:0/3808687499 wait complete. 2023-10-09T08:17:06.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.375+0000 7f078899d700 1 Processor -- start 2023-10-09T08:17:06.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.376+0000 7f078899d700 1 -- start start 2023-10-09T08:17:06.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.377+0000 7f078899d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07840b16d0 0x7f078415e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:06.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.377+0000 7f078899d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07840b1b40 0x7f078415a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:06.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.377+0000 7f078899d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07840b4e70 0x7f07840cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.377+0000 7f078899d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078415a2c0 con 0x7f07840b4e70 2023-10-09T08:17:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.377+0000 7f078899d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0784158640 con 0x7f07840b1b40 2023-10-09T08:17:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.377+0000 7f078899d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0784159ce0 con 0x7f07840b16d0 2023-10-09T08:17:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.377+0000 7f0783fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07840b4e70 0x7f07840cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.377+0000 7f0783fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07840b4e70 0x7f07840cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56060/0 (socket says 172.21.15.71:56060) 2023-10-09T08:17:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.377+0000 7f0783fff700 1 -- 172.21.15.71:0/1620977417 learned_addr learned my addr 172.21.15.71:0/1620977417 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.377+0000 7f0782ffd700 1 --2- 172.21.15.71:0/1620977417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07840b1b40 0x7f078415a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.378+0000 7f07837fe700 1 --2- 172.21.15.71:0/1620977417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07840b16d0 0x7f078415e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.378+0000 7f0783fff700 1 -- 172.21.15.71:0/1620977417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07840b16d0 msgr2=0x7f078415e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.378+0000 7f0783fff700 1 --2- 172.21.15.71:0/1620977417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07840b16d0 0x7f078415e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:06.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.378+0000 7f0783fff700 1 -- 172.21.15.71:0/1620977417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07840b1b40 msgr2=0x7f078415a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:06.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.378+0000 7f0783fff700 1 --2- 172.21.15.71:0/1620977417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07840b1b40 0x7f078415a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:06.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.378+0000 7f0783fff700 1 -- 172.21.15.71:0/1620977417 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07740094f0 con 0x7f07840b4e70 2023-10-09T08:17:06.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.378+0000 7f0783fff700 1 --2- 172.21.15.71:0/1620977417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07840b4e70 0x7f07840cb320 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f077c009ec0 tx=0x7f077c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:06.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.378+0000 7f076b7fe700 1 -- 172.21.15.71:0/1620977417 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c00cb70 con 0x7f07840b4e70 2023-10-09T08:17:06.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.378+0000 7f076b7fe700 1 -- 172.21.15.71:0/1620977417 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077c00f040 con 0x7f07840b4e70 2023-10-09T08:17:06.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.378+0000 7f076b7fe700 1 -- 172.21.15.71:0/1620977417 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c014480 con 0x7f07840b4e70 2023-10-09T08:17:06.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.378+0000 7f078899d700 1 -- 172.21.15.71:0/1620977417 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07841608b0 con 0x7f07840b4e70 2023-10-09T08:17:06.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.379+0000 7f078899d700 1 -- 172.21.15.71:0/1620977417 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0784160b90 con 0x7f07840b4e70 2023-10-09T08:17:06.382 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:06.381+0000 7f3c588e4180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T08:17:06.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.380+0000 7f078899d700 1 -- 172.21.15.71:0/1620977417 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078415a470 con 0x7f07840b4e70 2023-10-09T08:17:06.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.380+0000 7f076b7fe700 1 -- 172.21.15.71:0/1620977417 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 98) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f077c014830 con 0x7f07840b4e70 2023-10-09T08:17:06.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.382+0000 7f076b7fe700 1 --2- 172.21.15.71:0/1620977417 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0770067050 0x7f0770069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:06.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.382+0000 7f076b7fe700 1 -- 172.21.15.71:0/1620977417 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f077c085750 con 0x7f07840b4e70 2023-10-09T08:17:06.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.382+0000 7f07837fe700 1 -- 172.21.15.71:0/1620977417 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0770067050 msgr2=0x7f0770069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:06.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.382+0000 7f07837fe700 1 --2- 172.21.15.71:0/1620977417 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0770067050 0x7f0770069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:06.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.385+0000 7f076b7fe700 1 -- 172.21.15.71:0/1620977417 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f077c0523d0 con 0x7f07840b4e70 2023-10-09T08:17:06.469 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:06.467+0000 7f4463186180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T08:17:06.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.580+0000 7f078899d700 1 -- 172.21.15.71:0/1620977417 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f07841596b0 con 0x7f07840b4e70 2023-10-09T08:17:06.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.581+0000 7f076b7fe700 1 -- 172.21.15.71:0/1620977417 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v197) v1 ==== 100+0+11 (secure 0 0 0) 0x7f077c0559f0 con 0x7f07840b4e70 2023-10-09T08:17:06.582 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-09T08:17:06.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.583+0000 7f07837fe700 1 -- 172.21.15.71:0/1620977417 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0770067050 msgr2=0x7f0770069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:06.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.583+0000 7f07837fe700 1 --2- 172.21.15.71:0/1620977417 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0770067050 0x7f0770069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:06.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.584+0000 7f078899d700 1 -- 172.21.15.71:0/1620977417 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0770067050 msgr2=0x7f0770069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:06.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.584+0000 7f078899d700 1 --2- 172.21.15.71:0/1620977417 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0770067050 0x7f0770069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:06.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.584+0000 7f078899d700 1 -- 172.21.15.71:0/1620977417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07840b4e70 msgr2=0x7f07840cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:06.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.584+0000 7f078899d700 1 --2- 172.21.15.71:0/1620977417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07840b4e70 0x7f07840cb320 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f077c009ec0 tx=0x7f077c00b040 comp rx=0 tx=0).stop 2023-10-09T08:17:06.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.584+0000 7f078899d700 1 -- 172.21.15.71:0/1620977417 shutdown_connections 2023-10-09T08:17:06.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.584+0000 7f078899d700 1 --2- 172.21.15.71:0/1620977417 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0770067050 0x7f0770069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:06.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.584+0000 7f078899d700 1 --2- 172.21.15.71:0/1620977417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07840b4e70 0x7f07840cb320 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:06.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.584+0000 7f078899d700 1 --2- 172.21.15.71:0/1620977417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07840b16d0 0x7f078415e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:06.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.584+0000 7f078899d700 1 --2- 172.21.15.71:0/1620977417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07840b1b40 0x7f078415a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:06.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.584+0000 7f078899d700 1 -- 172.21.15.71:0/1620977417 >> 172.21.15.71:0/1620977417 conn(0x7f07840d10c0 msgr2=0x7f07840b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:06.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.584+0000 7f078899d700 1 -- 172.21.15.71:0/1620977417 shutdown_connections 2023-10-09T08:17:06.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.584+0000 7f078899d700 1 -- 172.21.15.71:0/1620977417 wait complete. 2023-10-09T08:17:06.603 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T08:17:06.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.827+0000 7f5fdb59e700 1 Processor -- start 2023-10-09T08:17:06.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.827+0000 7f5fdb59e700 1 -- start start 2023-10-09T08:17:06.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.829+0000 7f5fdb59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fdc15d230 0x7f5fdc15d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:06.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.829+0000 7f5fdb59e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fdc0b2980 con 0x7f5fdc1597f0 2023-10-09T08:17:06.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.829+0000 7f5fdb59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fdc15dbb0 con 0x7f5fdc159420 2023-10-09T08:17:06.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.829+0000 7f5fdb59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc0b11d0 con 0x7f5fdc15d230 2023-10-09T08:17:06.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.829+0000 7f5fd9d9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f5fdc1597f0 0x7f5fdc0b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48472/0 (socket says 172.21.15.71:48472) 2023-10-09T08:17:06.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.829+0000 7f5fd9d9b700 1 -- 172.21.15.71:0/1601189945 learned_addr learned my addr 172.21.15.71:0/1601189945 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:06.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.829+0000 7f5fdad9d700 1 --2- 172.21.15.71:0/1601189945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fdc15d230 0x7f5fdc15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:06.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.829+0000 7f5fd959a700 1 -- 172.21.15.71:0/1601189945 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987519622 0 0) 0x7f5fdc0b2980 con 0x7f5fdc1597f0 2023-10-09T08:17:06.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.830+0000 7f5fd959a700 1 -- 172.21.15.71:0/1601189945 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fc4003570 con 0x7f5fdc1597f0 2023-10-09T08:17:06.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.830+0000 7f5fd959a700 1 -- 172.21.15.71:0/1601189945 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162029228 0 0) 0x7f5fdc15dbb0 con 0x7f5fdc159420 2023-10-09T08:17:06.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.830+0000 7f5fd959a700 1 -- 172.21.15.71:0/1601189945 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fdc0b2980 con 0x7f5fdc159420 2023-10-09T08:17:06.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.830+0000 7f5fdad9d700 1 -- 172.21.15.71:0/1601189945 >> v1:172.21.15.179:6789/0 conn(0x7f5fdc159420 legacy=0x7f5fdc0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:06.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.830+0000 7f5fdad9d700 1 -- 172.21.15.71:0/1601189945 >> v1:172.21.15.71:6789/0 conn(0x7f5fdc1597f0 legacy=0x7f5fdc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:06.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.830+0000 7f5fdad9d700 1 -- 172.21.15.71:0/1601189945 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc0b14b0 con 0x7f5fdc15d230 2023-10-09T08:17:06.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.830+0000 7f5fdad9d700 1 --2- 172.21.15.71:0/1601189945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fdc15d230 0x7f5fdc15d670 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4009e90 tx=0x7f5fd4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7be0be7fd0a8670 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:06.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.830+0000 7f5fd959a700 1 -- 172.21.15.71:0/1601189945 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd400e070 con 0x7f5fdc15d230 2023-10-09T08:17:06.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.830+0000 7f5fd959a700 1 -- 172.21.15.71:0/1601189945 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd400bb80 con 0x7f5fdc15d230 2023-10-09T08:17:06.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.830+0000 7f5fd959a700 1 -- 172.21.15.71:0/1601189945 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd4012430 con 0x7f5fdc15d230 2023-10-09T08:17:06.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.831+0000 7f5fdb59e700 1 -- 172.21.15.71:0/1601189945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fdc15d230 msgr2=0x7f5fdc15d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:06.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.831+0000 7f5fdb59e700 1 --2- 172.21.15.71:0/1601189945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fdc15d230 0x7f5fdc15d670 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4009e90 tx=0x7f5fd4009780 comp rx=0 tx=0).stop 2023-10-09T08:17:06.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.831+0000 7f5fdb59e700 1 -- 172.21.15.71:0/1601189945 shutdown_connections 2023-10-09T08:17:06.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.831+0000 7f5fdb59e700 1 --2- 172.21.15.71:0/1601189945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fdc15d230 0x7f5fdc15d670 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:06.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.831+0000 7f5fdb59e700 1 -- 172.21.15.71:0/1601189945 >> 172.21.15.71:0/1601189945 conn(0x7f5fdc0d0660 msgr2=0x7f5fdc0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:06.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.831+0000 7f5fdb59e700 1 -- 172.21.15.71:0/1601189945 shutdown_connections 2023-10-09T08:17:06.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.831+0000 7f5fdb59e700 1 -- 172.21.15.71:0/1601189945 wait complete. 2023-10-09T08:17:06.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.832+0000 7f5fdb59e700 1 Processor -- start 2023-10-09T08:17:06.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.833+0000 7f5fdb59e700 1 -- start start 2023-10-09T08:17:06.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.833+0000 7f5fdb59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fdc159420 0x7f5fdc14f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:06.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.833+0000 7f5fdb59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fdc1597f0 0x7f5fdc0b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:06.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.834+0000 7f5fdb59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fdc15d230 0x7f5fdc154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:06.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.834+0000 7f5fdb59e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc0b5770 con 0x7f5fdc159420 2023-10-09T08:17:06.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.834+0000 7f5fdb59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc0b4db0 con 0x7f5fdc15d230 2023-10-09T08:17:06.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.834+0000 7f5fdb59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc150250 con 0x7f5fdc1597f0 2023-10-09T08:17:06.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.834+0000 7f5fda59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fdc159420 0x7f5fdc14f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:06.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.834+0000 7f5fda59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fdc159420 0x7f5fdc14f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56068/0 (socket says 172.21.15.71:56068) 2023-10-09T08:17:06.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.834+0000 7f5fda59c700 1 -- 172.21.15.71:0/3389340409 learned_addr learned my addr 172.21.15.71:0/3389340409 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:06.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.834+0000 7f5fdad9d700 1 --2- 172.21.15.71:0/3389340409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fdc15d230 0x7f5fdc154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:06.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.834+0000 7f5fd9d9b700 1 --2- 172.21.15.71:0/3389340409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fdc1597f0 0x7f5fdc0b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:06.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.834+0000 7f5fda59c700 1 -- 172.21.15.71:0/3389340409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fdc1597f0 msgr2=0x7f5fdc0b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:06.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.834+0000 7f5fda59c700 1 --2- 172.21.15.71:0/3389340409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fdc1597f0 0x7f5fdc0b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:06.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.834+0000 7f5fda59c700 1 -- 172.21.15.71:0/3389340409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fdc15d230 msgr2=0x7f5fdc154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:06.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.834+0000 7f5fda59c700 1 --2- 172.21.15.71:0/3389340409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fdc15d230 0x7f5fdc154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:06.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.834+0000 7f5fda59c700 1 -- 172.21.15.71:0/3389340409 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd4009a20 con 0x7f5fdc159420 2023-10-09T08:17:06.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.834+0000 7f5fd9d9b700 1 --2- 172.21.15.71:0/3389340409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fdc1597f0 0x7f5fdc0b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:17:06.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.834+0000 7f5fda59c700 1 --2- 172.21.15.71:0/3389340409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fdc159420 0x7f5fdc14f5a0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00c7c0 tx=0x7f5fcc007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:06.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.835+0000 7f5fca7fc700 1 -- 172.21.15.71:0/3389340409 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc001520 con 0x7f5fdc159420 2023-10-09T08:17:06.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.835+0000 7f5fca7fc700 1 -- 172.21.15.71:0/3389340409 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc0016a0 con 0x7f5fdc159420 2023-10-09T08:17:06.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.835+0000 7f5fdb59e700 1 -- 172.21.15.71:0/3389340409 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fdc0b4230 con 0x7f5fdc159420 2023-10-09T08:17:06.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.835+0000 7f5fca7fc700 1 -- 172.21.15.71:0/3389340409 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc001a60 con 0x7f5fdc159420 2023-10-09T08:17:06.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.835+0000 7f5fdb59e700 1 -- 172.21.15.71:0/3389340409 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fdc0b47f0 con 0x7f5fdc159420 2023-10-09T08:17:06.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.836+0000 7f5fdb59e700 1 -- 172.21.15.71:0/3389340409 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fdc04c3c0 con 0x7f5fdc159420 2023-10-09T08:17:06.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.837+0000 7f5fca7fc700 1 -- 172.21.15.71:0/3389340409 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 98) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f5fcc01b3b0 con 0x7f5fdc159420 2023-10-09T08:17:06.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.838+0000 7f5fca7fc700 1 --2- 172.21.15.71:0/3389340409 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5fbc067050 0x7f5fbc069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:06.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.838+0000 7f5fca7fc700 1 -- 172.21.15.71:0/3389340409 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f5fcc0843c0 con 0x7f5fdc159420 2023-10-09T08:17:06.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.838+0000 7f5fd9d9b700 1 -- 172.21.15.71:0/3389340409 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5fbc067050 msgr2=0x7f5fbc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:06.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.838+0000 7f5fd9d9b700 1 --2- 172.21.15.71:0/3389340409 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5fbc067050 0x7f5fbc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:06.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:06.842+0000 7f5fca7fc700 1 -- 172.21.15.71:0/3389340409 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fcc051150 con 0x7f5fdc159420 2023-10-09T08:17:06.871 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:06.870+0000 7f3c588e4180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T08:17:06.966 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:06.965+0000 7f3c588e4180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T08:17:06.968 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:06.967+0000 7f4463186180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T08:17:07.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.039+0000 7f5fd9d9b700 1 -- 172.21.15.71:0/3389340409 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5fbc067050 msgr2=0x7f5fbc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:07.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.039+0000 7f5fd9d9b700 1 --2- 172.21.15.71:0/3389340409 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5fbc067050 0x7f5fbc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:07.059 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:07.059+0000 7f3c588e4180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T08:17:07.066 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:07.065+0000 7f4463186180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T08:17:07.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.089+0000 7f5fdb59e700 1 -- 172.21.15.71:0/3389340409 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fdc0b1790 con 0x7f5fdc159420 2023-10-09T08:17:07.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.090+0000 7f5fca7fc700 1 -- 172.21.15.71:0/3389340409 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4592 (secure 0 0 0) 0x7f5fcc054770 con 0x7f5fdc159420 2023-10-09T08:17:07.091 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:07.091 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":89,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7919,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/567694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":567694},{"type":"v1","addr":"172.21.15.71:6835","nonce":567694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":9151,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/502575967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":502575967},{"type":"v1","addr":"172.21.15.179:6836","nonce":502575967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":9663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/1425921431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":1425921431},{"type":"v1","addr":"172.21.15.71:6834","nonce":1425921431}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T08:14:38.913123+0000","modified":"2023-10-09T08:14:42.474701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9678},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9678":{"gid":9678,"name":"d","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/1735854447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1735854447},{"type":"v1","addr":"172.21.15.179:6834","nonce":1735854447}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T08:17:07.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.092+0000 7f5fdb59e700 1 -- 172.21.15.71:0/3389340409 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5fbc067050 msgr2=0x7f5fbc069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:07.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.092+0000 7f5fdb59e700 1 --2- 172.21.15.71:0/3389340409 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5fbc067050 0x7f5fbc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:07.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.092+0000 7f5fdb59e700 1 -- 172.21.15.71:0/3389340409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fdc159420 msgr2=0x7f5fdc14f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:07.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.092+0000 7f5fdb59e700 1 --2- 172.21.15.71:0/3389340409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fdc159420 0x7f5fdc14f5a0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00c7c0 tx=0x7f5fcc007dd0 comp rx=0 tx=0).stop 2023-10-09T08:17:07.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.092+0000 7f5fdb59e700 1 -- 172.21.15.71:0/3389340409 shutdown_connections 2023-10-09T08:17:07.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.092+0000 7f5fdb59e700 1 --2- 172.21.15.71:0/3389340409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fdc15d230 0x7f5fdc154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:07.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.092+0000 7f5fdb59e700 1 --2- 172.21.15.71:0/3389340409 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5fbc067050 0x7f5fbc069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:07.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.092+0000 7f5fdb59e700 1 --2- 172.21.15.71:0/3389340409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fdc159420 0x7f5fdc14f5a0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:07.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.092+0000 7f5fdb59e700 1 --2- 172.21.15.71:0/3389340409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fdc1597f0 0x7f5fdc0b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:07.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.092+0000 7f5fdb59e700 1 -- 172.21.15.71:0/3389340409 >> 172.21.15.71:0/3389340409 conn(0x7f5fdc0d0660 msgr2=0x7f5fdc068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:07.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.092+0000 7f5fdb59e700 1 -- 172.21.15.71:0/3389340409 shutdown_connections 2023-10-09T08:17:07.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.092+0000 7f5fdb59e700 1 -- 172.21.15.71:0/3389340409 wait complete. 2023-10-09T08:17:07.095 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 89 2023-10-09T08:17:07.112 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T08:17:07.164 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:07.163+0000 7f4463186180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T08:17:07.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.300+0000 7fa37359e700 1 Processor -- start 2023-10-09T08:17:07.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.300+0000 7fa37359e700 1 -- start start 2023-10-09T08:17:07.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.301+0000 7fa37359e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa374159cc0 0x7fa3740b5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:07.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.301+0000 7fa37359e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa3740cf6c0 0x7fa374163280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:07.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.301+0000 7fa37359e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3740b5b40 con 0x7fa3740b2920 2023-10-09T08:17:07.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.301+0000 7fa37359e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3740ce260 con 0x7fa3740cf6c0 2023-10-09T08:17:07.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.301+0000 7fa37359e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3740b5e20 con 0x7fa374159cc0 2023-10-09T08:17:07.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.302+0000 7fa371d9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa3740b2920 0x7fa37415a090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48484/0 (socket says 172.21.15.71:48484) 2023-10-09T08:17:07.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.302+0000 7fa371d9b700 1 -- 172.21.15.71:0/905708272 learned_addr learned my addr 172.21.15.71:0/905708272 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:07.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.302+0000 7fa372d9d700 1 --2- 172.21.15.71:0/905708272 >> v2:172.21.15.71:3300/0 conn(0x7fa3740cf6c0 0x7fa374163280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:07.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.302+0000 7fa37259c700 1 --2- 172.21.15.71:0/905708272 >> v2:172.21.15.179:3300/0 conn(0x7fa374159cc0 0x7fa3740b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:07.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.302+0000 7fa37159a700 1 -- 172.21.15.71:0/905708272 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753298953 0 0) 0x7fa3740b5b40 con 0x7fa3740b2920 2023-10-09T08:17:07.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.302+0000 7fa37159a700 1 -- 172.21.15.71:0/905708272 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa35c003570 con 0x7fa3740b2920 2023-10-09T08:17:07.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.302+0000 7fa372d9d700 1 -- 172.21.15.71:0/905708272 >> v2:172.21.15.179:3300/0 conn(0x7fa374159cc0 msgr2=0x7fa3740b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:07.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.302+0000 7fa372d9d700 1 --2- 172.21.15.71:0/905708272 >> v2:172.21.15.179:3300/0 conn(0x7fa374159cc0 0x7fa3740b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:07.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.302+0000 7fa372d9d700 1 -- 172.21.15.71:0/905708272 >> v1:172.21.15.71:6789/0 conn(0x7fa3740b2920 legacy=0x7fa37415a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:07.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.302+0000 7fa372d9d700 1 -- 172.21.15.71:0/905708272 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3740b6100 con 0x7fa3740cf6c0 2023-10-09T08:17:07.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.303+0000 7fa372d9d700 1 --2- 172.21.15.71:0/905708272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3740cf6c0 0x7fa374163280 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fa374089670 tx=0x7fa36c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd092e76d78564c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:07.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.303+0000 7fa37159a700 1 -- 172.21.15.71:0/905708272 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c00e070 con 0x7fa3740cf6c0 2023-10-09T08:17:07.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.303+0000 7fa37159a700 1 -- 172.21.15.71:0/905708272 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36c00bab0 con 0x7fa3740cf6c0 2023-10-09T08:17:07.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.303+0000 7fa37159a700 1 -- 172.21.15.71:0/905708272 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c00be70 con 0x7fa3740cf6c0 2023-10-09T08:17:07.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.303+0000 7fa37359e700 1 -- 172.21.15.71:0/905708272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3740cf6c0 msgr2=0x7fa374163280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:07.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.303+0000 7fa37359e700 1 --2- 172.21.15.71:0/905708272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3740cf6c0 0x7fa374163280 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fa374089670 tx=0x7fa36c009780 comp rx=0 tx=0).stop 2023-10-09T08:17:07.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.303+0000 7fa37359e700 1 -- 172.21.15.71:0/905708272 shutdown_connections 2023-10-09T08:17:07.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.303+0000 7fa37359e700 1 --2- 172.21.15.71:0/905708272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3740cf6c0 0x7fa374163280 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:07.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.303+0000 7fa37359e700 1 --2- 172.21.15.71:0/905708272 >> v2:172.21.15.179:3300/0 conn(0x7fa374159cc0 0x7fa3740b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:07.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.303+0000 7fa37359e700 1 -- 172.21.15.71:0/905708272 >> 172.21.15.71:0/905708272 conn(0x7fa3740d0560 msgr2=0x7fa3740d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:07.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.303+0000 7fa37359e700 1 -- 172.21.15.71:0/905708272 shutdown_connections 2023-10-09T08:17:07.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.304+0000 7fa37359e700 1 -- 172.21.15.71:0/905708272 wait complete. 2023-10-09T08:17:07.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.305+0000 7fa37359e700 1 Processor -- start 2023-10-09T08:17:07.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.305+0000 7fa37359e700 1 -- start start 2023-10-09T08:17:07.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.306+0000 7fa37359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3740b2920 0x7fa374155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:07.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.306+0000 7fa37359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3740cf6c0 0x7fa3740cd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:07.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.306+0000 7fa37359e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa374159cc0 0x7fa3740cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:07.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.306+0000 7fa37359e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa374169900 con 0x7fa374159cc0 2023-10-09T08:17:07.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.306+0000 7fa37359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa374158760 con 0x7fa3740b2920 2023-10-09T08:17:07.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.306+0000 7fa37359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa374158a40 con 0x7fa3740cf6c0 2023-10-09T08:17:07.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.306+0000 7fa372d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa374159cc0 0x7fa3740cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:07.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.306+0000 7fa372d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa374159cc0 0x7fa3740cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56090/0 (socket says 172.21.15.71:56090) 2023-10-09T08:17:07.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.306+0000 7fa372d9d700 1 -- 172.21.15.71:0/1389673537 learned_addr learned my addr 172.21.15.71:0/1389673537 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:07.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.306+0000 7fa37259c700 1 --2- 172.21.15.71:0/1389673537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3740b2920 0x7fa374155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:07.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.306+0000 7fa371d9b700 1 --2- 172.21.15.71:0/1389673537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3740cf6c0 0x7fa3740cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:07.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.307+0000 7fa372d9d700 1 -- 172.21.15.71:0/1389673537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3740cf6c0 msgr2=0x7fa3740cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:07.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.307+0000 7fa372d9d700 1 --2- 172.21.15.71:0/1389673537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3740cf6c0 0x7fa3740cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:07.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.307+0000 7fa372d9d700 1 -- 172.21.15.71:0/1389673537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3740b2920 msgr2=0x7fa374155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:07.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.307+0000 7fa372d9d700 1 --2- 172.21.15.71:0/1389673537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3740b2920 0x7fa374155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:07.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.307+0000 7fa372d9d700 1 -- 172.21.15.71:0/1389673537 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36c009a20 con 0x7fa374159cc0 2023-10-09T08:17:07.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.307+0000 7fa372d9d700 1 --2- 172.21.15.71:0/1389673537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa374159cc0 0x7fa3740cd7b0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fa374089180 tx=0x7fa36c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:07.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.307+0000 7fa3627fc700 1 -- 172.21.15.71:0/1389673537 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c012dd0 con 0x7fa374159cc0 2023-10-09T08:17:07.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.307+0000 7fa3627fc700 1 -- 172.21.15.71:0/1389673537 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36c027470 con 0x7fa374159cc0 2023-10-09T08:17:07.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.307+0000 7fa3627fc700 1 -- 172.21.15.71:0/1389673537 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c027830 con 0x7fa374159cc0 2023-10-09T08:17:07.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.307+0000 7fa37359e700 1 -- 172.21.15.71:0/1389673537 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa374158d20 con 0x7fa374159cc0 2023-10-09T08:17:07.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.307+0000 7fa37359e700 1 -- 172.21.15.71:0/1389673537 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3741557b0 con 0x7fa374159cc0 2023-10-09T08:17:07.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.309+0000 7fa37359e700 1 -- 172.21.15.71:0/1389673537 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa37404c3c0 con 0x7fa374159cc0 2023-10-09T08:17:07.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.309+0000 7fa3627fc700 1 -- 172.21.15.71:0/1389673537 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 98) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fa36c024070 con 0x7fa374159cc0 2023-10-09T08:17:07.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.311+0000 7fa3627fc700 1 --2- 172.21.15.71:0/1389673537 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa354067050 0x7fa354069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:07.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.311+0000 7fa3627fc700 1 -- 172.21.15.71:0/1389673537 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6527+0+0 (secure 0 0 0) 0x7fa36c0873e0 con 0x7fa374159cc0 2023-10-09T08:17:07.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.315+0000 7fa37259c700 1 -- 172.21.15.71:0/1389673537 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa354067050 msgr2=0x7fa354069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:07.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.315+0000 7fa37259c700 1 --2- 172.21.15.71:0/1389673537 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa354067050 0x7fa354069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:07.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.315+0000 7fa3627fc700 1 -- 172.21.15.71:0/1389673537 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa36c054210 con 0x7fa374159cc0 2023-10-09T08:17:07.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.515+0000 7fa37359e700 1 -- 172.21.15.71:0/1389673537 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3740b63e0 con 0x7fa374159cc0 2023-10-09T08:17:07.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.516+0000 7fa3627fc700 1 -- 172.21.15.71:0/1389673537 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+16627 (secure 0 0 0) 0x7fa36c05be60 con 0x7fa374159cc0 2023-10-09T08:17:07.517 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:07.517 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":197,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T08:17:05.035359+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T08:14:37.033384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T08:14:37.895335+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":197,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:0/407948890":"2023-10-10T08:14:59.016743+0000","172.21.15.179:0/2620610180":"2023-10-10T08:14:59.016743+0000","172.21.15.179:6837/101206":"2023-10-10T08:14:59.016743+0000","172.21.15.179:0/13097287":"2023-10-10T08:14:59.016743+0000","172.21.15.179:6835/101206":"2023-10-10T08:14:59.016743+0000","172.21.15.179:0/3123444754":"2023-10-10T08:14:59.016743+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":23,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T08:17:07.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.518+0000 7fa37359e700 1 -- 172.21.15.71:0/1389673537 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa354067050 msgr2=0x7fa354069500 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T08:17:07.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.518+0000 7fa37359e700 1 --2- 172.21.15.71:0/1389673537 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa354067050 0x7fa354069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:07.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.518+0000 7fa37359e700 1 -- 172.21.15.71:0/1389673537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa374159cc0 msgr2=0x7fa3740cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:07.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.518+0000 7fa37359e700 1 --2- 172.21.15.71:0/1389673537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa374159cc0 0x7fa3740cd7b0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fa374089180 tx=0x7fa36c019000 comp rx=0 tx=0).stop 2023-10-09T08:17:07.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.519+0000 7fa37359e700 1 -- 172.21.15.71:0/1389673537 shutdown_connections 2023-10-09T08:17:07.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.519+0000 7fa37359e700 1 --2- 172.21.15.71:0/1389673537 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa354067050 0x7fa354069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:07.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.519+0000 7fa37359e700 1 --2- 172.21.15.71:0/1389673537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa374159cc0 0x7fa3740cd7b0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:07.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.519+0000 7fa37359e700 1 --2- 172.21.15.71:0/1389673537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3740b2920 0x7fa374155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:07.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.519+0000 7fa37359e700 1 --2- 172.21.15.71:0/1389673537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3740cf6c0 0x7fa3740cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:07.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.519+0000 7fa37359e700 1 -- 172.21.15.71:0/1389673537 >> 172.21.15.71:0/1389673537 conn(0x7fa3740d0560 msgr2=0x7fa374156b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:07.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.519+0000 7fa37359e700 1 -- 172.21.15.71:0/1389673537 shutdown_connections 2023-10-09T08:17:07.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.519+0000 7fa37359e700 1 -- 172.21.15.71:0/1389673537 wait complete. 2023-10-09T08:17:07.539 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T08:17:07.540 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T08:17:07.683 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:07.683+0000 7f3c588e4180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T08:17:07.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.753+0000 7fe82199d700 1 Processor -- start 2023-10-09T08:17:07.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.754+0000 7fe82199d700 1 -- start start 2023-10-09T08:17:07.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.755+0000 7fe82199d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe81c06e000 0x7fe81c06ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:07.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.755+0000 7fe82199d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c06e8c0 con 0x7fe81c15de70 2023-10-09T08:17:07.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.755+0000 7fe82199d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c0ca740 con 0x7fe81c15daa0 2023-10-09T08:17:07.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.755+0000 7fe82199d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81c06e400 con 0x7fe81c06e000 2023-10-09T08:17:07.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.756+0000 7fe81bfff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe81c15de70 0x7fe81c0696c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48498/0 (socket says 172.21.15.71:48498) 2023-10-09T08:17:07.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.756+0000 7fe81bfff700 1 -- 172.21.15.71:0/2592775755 learned_addr learned my addr 172.21.15.71:0/2592775755 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:07.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.756+0000 7fe82119c700 1 --2- 172.21.15.71:0/2592775755 >> v2:172.21.15.179:3300/0 conn(0x7fe81c06e000 0x7fe81c06ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:07.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.756+0000 7fe81b7fe700 1 -- 172.21.15.71:0/2592775755 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2396650379 0 0) 0x7fe81c06e8c0 con 0x7fe81c15de70 2023-10-09T08:17:07.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.756+0000 7fe81b7fe700 1 -- 172.21.15.71:0/2592775755 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe808003570 con 0x7fe81c15de70 2023-10-09T08:17:07.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.756+0000 7fe82119c700 1 -- 172.21.15.71:0/2592775755 >> v1:172.21.15.179:6789/0 conn(0x7fe81c15daa0 legacy=0x7fe81c0c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:07.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.756+0000 7fe82119c700 1 -- 172.21.15.71:0/2592775755 >> v1:172.21.15.71:6789/0 conn(0x7fe81c15de70 legacy=0x7fe81c0696c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:07.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.756+0000 7fe82119c700 1 -- 172.21.15.71:0/2592775755 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c06e5e0 con 0x7fe81c06e000 2023-10-09T08:17:07.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.757+0000 7fe82119c700 1 --2- 172.21.15.71:0/2592775755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81c06e000 0x7fe81c06ecd0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0098e0 tx=0x7fe80c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ad5f6b5bf19d662 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:07.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.757+0000 7fe81b7fe700 1 -- 172.21.15.71:0/2592775755 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c00b640 con 0x7fe81c06e000 2023-10-09T08:17:07.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.757+0000 7fe81b7fe700 1 -- 172.21.15.71:0/2592775755 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80c00b7a0 con 0x7fe81c06e000 2023-10-09T08:17:07.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.757+0000 7fe81b7fe700 1 -- 172.21.15.71:0/2592775755 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c00bb20 con 0x7fe81c06e000 2023-10-09T08:17:07.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.757+0000 7fe82199d700 1 -- 172.21.15.71:0/2592775755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81c06e000 msgr2=0x7fe81c06ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:07.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.757+0000 7fe82199d700 1 --2- 172.21.15.71:0/2592775755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81c06e000 0x7fe81c06ecd0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0098e0 tx=0x7fe80c0091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:07.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.757+0000 7fe82199d700 1 -- 172.21.15.71:0/2592775755 shutdown_connections 2023-10-09T08:17:07.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.757+0000 7fe82199d700 1 --2- 172.21.15.71:0/2592775755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81c06e000 0x7fe81c06ecd0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:07.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.758+0000 7fe82199d700 1 -- 172.21.15.71:0/2592775755 >> 172.21.15.71:0/2592775755 conn(0x7fe81c0cc1f0 msgr2=0x7fe81c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:07.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.758+0000 7fe82199d700 1 -- 172.21.15.71:0/2592775755 shutdown_connections 2023-10-09T08:17:07.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.758+0000 7fe82199d700 1 -- 172.21.15.71:0/2592775755 wait complete. 2023-10-09T08:17:07.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.759+0000 7fe82199d700 1 Processor -- start 2023-10-09T08:17:07.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.759+0000 7fe82199d700 1 -- start start 2023-10-09T08:17:07.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.760+0000 7fe82199d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe81c06e000 0x7fe81c1582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:07.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.760+0000 7fe82199d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe81c15daa0 0x7fe81c171b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:07.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.760+0000 7fe82199d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81c15de70 0x7fe81c0aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:07.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.760+0000 7fe82199d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c1587e0 con 0x7fe81c06e000 2023-10-09T08:17:07.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.760+0000 7fe82199d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c172050 con 0x7fe81c15de70 2023-10-09T08:17:07.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.760+0000 7fe82199d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c16dfd0 con 0x7fe81c15daa0 2023-10-09T08:17:07.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.760+0000 7fe82099b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe81c06e000 0x7fe81c1582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:07.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.761+0000 7fe82099b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe81c06e000 0x7fe81c1582a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56092/0 (socket says 172.21.15.71:56092) 2023-10-09T08:17:07.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.761+0000 7fe82099b700 1 -- 172.21.15.71:0/435109394 learned_addr learned my addr 172.21.15.71:0/435109394 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:07.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.761+0000 7fe82119c700 1 --2- 172.21.15.71:0/435109394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81c15de70 0x7fe81c0aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:07.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.761+0000 7fe81bfff700 1 --2- 172.21.15.71:0/435109394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe81c15daa0 0x7fe81c171b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:07.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.761+0000 7fe82099b700 1 -- 172.21.15.71:0/435109394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe81c15daa0 msgr2=0x7fe81c171b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:07.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.761+0000 7fe82099b700 1 --2- 172.21.15.71:0/435109394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe81c15daa0 0x7fe81c171b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:07.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.761+0000 7fe82099b700 1 -- 172.21.15.71:0/435109394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81c15de70 msgr2=0x7fe81c0aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:07.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.761+0000 7fe82099b700 1 --2- 172.21.15.71:0/435109394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81c15de70 0x7fe81c0aff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:07.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.761+0000 7fe82099b700 1 -- 172.21.15.71:0/435109394 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c009420 con 0x7fe81c06e000 2023-10-09T08:17:07.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.761+0000 7fe81bfff700 1 --2- 172.21.15.71:0/435109394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe81c15daa0 0x7fe81c171b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:17:07.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.761+0000 7fe82099b700 1 --2- 172.21.15.71:0/435109394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe81c06e000 0x7fe81c1582a0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fe81400c590 tx=0x7fe814007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:07.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.761+0000 7fe818ff9700 1 -- 172.21.15.71:0/435109394 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe814011590 con 0x7fe81c06e000 2023-10-09T08:17:07.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.761+0000 7fe818ff9700 1 -- 172.21.15.71:0/435109394 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe814011730 con 0x7fe81c06e000 2023-10-09T08:17:07.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.761+0000 7fe818ff9700 1 -- 172.21.15.71:0/435109394 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe814011af0 con 0x7fe81c06e000 2023-10-09T08:17:07.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.761+0000 7fe82199d700 1 -- 172.21.15.71:0/435109394 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81c162080 con 0x7fe81c06e000 2023-10-09T08:17:07.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.762+0000 7fe82199d700 1 -- 172.21.15.71:0/435109394 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81c161da0 con 0x7fe81c06e000 2023-10-09T08:17:07.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.763+0000 7fe82199d700 1 -- 172.21.15.71:0/435109394 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81c04c3c0 con 0x7fe81c06e000 2023-10-09T08:17:07.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.764+0000 7fe818ff9700 1 -- 172.21.15.71:0/435109394 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 98) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fe814012420 con 0x7fe81c06e000 2023-10-09T08:17:07.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.764+0000 7fe818ff9700 1 --2- 172.21.15.71:0/435109394 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe7fc067120 0x7fe7fc0695d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:07.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.765+0000 7fe818ff9700 1 -- 172.21.15.71:0/435109394 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6527+0+0 (secure 0 0 0) 0x7fe814083c20 con 0x7fe81c06e000 2023-10-09T08:17:07.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.768+0000 7fe81bfff700 1 -- 172.21.15.71:0/435109394 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe7fc067120 msgr2=0x7fe7fc0695d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:07.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.768+0000 7fe81bfff700 1 --2- 172.21.15.71:0/435109394 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe7fc067120 0x7fe7fc0695d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:07.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.768+0000 7fe818ff9700 1 -- 172.21.15.71:0/435109394 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe81404b5a0 con 0x7fe81c06e000 2023-10-09T08:17:07.816 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:07.815+0000 7f4463186180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T08:17:07.856 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:07.856+0000 7f3c588e4180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T08:17:07.952 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:07.952+0000 7f3c588e4180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T08:17:07.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.969+0000 7fe81bfff700 1 -- 172.21.15.71:0/435109394 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe7fc067120 msgr2=0x7fe7fc0695d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:07.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:07.969+0000 7fe81bfff700 1 --2- 172.21.15.71:0/435109394 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe7fc067120 0x7fe7fc0695d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:07.989 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:07.988+0000 7f4463186180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T08:17:08.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.008+0000 7fe82199d700 1 -- 172.21.15.71:0/435109394 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe81c0ccb90 con 0x7fe81c06e000 2023-10-09T08:17:08.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.008+0000 7fe818ff9700 1 -- 172.21.15.71:0/435109394 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4592 (secure 0 0 0) 0x7fe814017070 con 0x7fe81c06e000 2023-10-09T08:17:08.009 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:08.010 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":89,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7919,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/567694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":567694},{"type":"v1","addr":"172.21.15.71:6835","nonce":567694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":9151,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/502575967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":502575967},{"type":"v1","addr":"172.21.15.179:6836","nonce":502575967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":9663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/1425921431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":1425921431},{"type":"v1","addr":"172.21.15.71:6834","nonce":1425921431}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T08:14:38.913123+0000","modified":"2023-10-09T08:14:42.474701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9678},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9678":{"gid":9678,"name":"d","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/1735854447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1735854447},{"type":"v1","addr":"172.21.15.179:6834","nonce":1735854447}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T08:17:08.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.011+0000 7fe82199d700 1 -- 172.21.15.71:0/435109394 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe7fc067120 msgr2=0x7fe7fc0695d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:08.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.011+0000 7fe82199d700 1 --2- 172.21.15.71:0/435109394 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe7fc067120 0x7fe7fc0695d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.011+0000 7fe82199d700 1 -- 172.21.15.71:0/435109394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe81c06e000 msgr2=0x7fe81c1582a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:08.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.011+0000 7fe82199d700 1 --2- 172.21.15.71:0/435109394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe81c06e000 0x7fe81c1582a0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fe81400c590 tx=0x7fe814007f30 comp rx=0 tx=0).stop 2023-10-09T08:17:08.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.011+0000 7fe82199d700 1 -- 172.21.15.71:0/435109394 shutdown_connections 2023-10-09T08:17:08.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.011+0000 7fe82199d700 1 --2- 172.21.15.71:0/435109394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81c15de70 0x7fe81c0aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.011+0000 7fe82199d700 1 --2- 172.21.15.71:0/435109394 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe7fc067120 0x7fe7fc0695d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.011+0000 7fe82199d700 1 --2- 172.21.15.71:0/435109394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe81c06e000 0x7fe81c1582a0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.011+0000 7fe82199d700 1 --2- 172.21.15.71:0/435109394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe81c15daa0 0x7fe81c171b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.011+0000 7fe82199d700 1 -- 172.21.15.71:0/435109394 >> 172.21.15.71:0/435109394 conn(0x7fe81c0cc1f0 msgr2=0x7fe81c0c19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:08.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.011+0000 7fe82199d700 1 -- 172.21.15.71:0/435109394 shutdown_connections 2023-10-09T08:17:08.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.011+0000 7fe82199d700 1 -- 172.21.15.71:0/435109394 wait complete. 2023-10-09T08:17:08.014 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 89 2023-10-09T08:17:08.031 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T08:17:08.092 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:08.091+0000 7f4463186180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T08:17:08.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.219+0000 7fef715ff700 1 Processor -- start 2023-10-09T08:17:08.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.220+0000 7fef715ff700 1 -- start start 2023-10-09T08:17:08.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.221+0000 7fef715ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef6c159890 0x7fef6c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:08.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.221+0000 7fef715ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fef6c159c60 0x7fef6c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:08.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.221+0000 7fef715ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef6c15a160 con 0x7fef6c15db10 2023-10-09T08:17:08.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.221+0000 7fef715ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6c0d13a0 con 0x7fef6c159c60 2023-10-09T08:17:08.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.221+0000 7fef715ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c15e140 con 0x7fef6c159890 2023-10-09T08:17:08.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.221+0000 7fef6b7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fef6c15db10 0x7fef6c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48500/0 (socket says 172.21.15.71:48500) 2023-10-09T08:17:08.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.221+0000 7fef6b7fe700 1 -- 172.21.15.71:0/299789014 learned_addr learned my addr 172.21.15.71:0/299789014 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:08.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.221+0000 7fef6affd700 1 --2- 172.21.15.71:0/299789014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef6c159890 0x7fef6c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:08.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.221+0000 7fef6a7fc700 1 --2- 172.21.15.71:0/299789014 >> v2:172.21.15.179:3300/0 conn(0x7fef6c159c60 0x7fef6c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:08.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.221+0000 7fef69ffb700 1 -- 172.21.15.71:0/299789014 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404732653 0 0) 0x7fef6c15a160 con 0x7fef6c15db10 2023-10-09T08:17:08.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.222+0000 7fef69ffb700 1 -- 172.21.15.71:0/299789014 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef54003570 con 0x7fef6c15db10 2023-10-09T08:17:08.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.222+0000 7fef6a7fc700 1 -- 172.21.15.71:0/299789014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef6c159890 msgr2=0x7fef6c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:08.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.222+0000 7fef6a7fc700 1 --2- 172.21.15.71:0/299789014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef6c159890 0x7fef6c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.222+0000 7fef6a7fc700 1 -- 172.21.15.71:0/299789014 >> v1:172.21.15.71:6789/0 conn(0x7fef6c15db10 legacy=0x7fef6c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:08.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.222+0000 7fef6a7fc700 1 -- 172.21.15.71:0/299789014 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c15a3d0 con 0x7fef6c159c60 2023-10-09T08:17:08.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.222+0000 7fef6a7fc700 1 --2- 172.21.15.71:0/299789014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef6c159c60 0x7fef6c15d5d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fef600098e0 tx=0x7fef600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6703847493ce1c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:08.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.222+0000 7fef69ffb700 1 -- 172.21.15.71:0/299789014 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60011630 con 0x7fef6c159c60 2023-10-09T08:17:08.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.222+0000 7fef69ffb700 1 -- 172.21.15.71:0/299789014 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef60011790 con 0x7fef6c159c60 2023-10-09T08:17:08.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.222+0000 7fef69ffb700 1 -- 172.21.15.71:0/299789014 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60011b30 con 0x7fef6c159c60 2023-10-09T08:17:08.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.223+0000 7fef715ff700 1 -- 172.21.15.71:0/299789014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef6c159c60 msgr2=0x7fef6c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:08.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.223+0000 7fef715ff700 1 --2- 172.21.15.71:0/299789014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef6c159c60 0x7fef6c15d5d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fef600098e0 tx=0x7fef600091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.223+0000 7fef715ff700 1 -- 172.21.15.71:0/299789014 shutdown_connections 2023-10-09T08:17:08.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.223+0000 7fef715ff700 1 --2- 172.21.15.71:0/299789014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef6c159890 0x7fef6c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.223+0000 7fef715ff700 1 --2- 172.21.15.71:0/299789014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef6c159c60 0x7fef6c15d5d0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.223+0000 7fef715ff700 1 -- 172.21.15.71:0/299789014 >> 172.21.15.71:0/299789014 conn(0x7fef6c068e20 msgr2=0x7fef6c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:08.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.223+0000 7fef715ff700 1 -- 172.21.15.71:0/299789014 shutdown_connections 2023-10-09T08:17:08.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.223+0000 7fef715ff700 1 -- 172.21.15.71:0/299789014 wait complete. 2023-10-09T08:17:08.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.225+0000 7fef715ff700 1 Processor -- start 2023-10-09T08:17:08.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.225+0000 7fef715ff700 1 -- start start 2023-10-09T08:17:08.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.226+0000 7fef715ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef6c159890 0x7fef6c14d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:08.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.226+0000 7fef715ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c159c60 0x7fef6c0cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:08.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.226+0000 7fef715ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef6c15db10 0x7fef6c0b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:08.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.226+0000 7fef715ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c16ac20 con 0x7fef6c159c60 2023-10-09T08:17:08.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.226+0000 7fef715ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c16ba80 con 0x7fef6c159890 2023-10-09T08:17:08.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.226+0000 7fef715ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c14ddf0 con 0x7fef6c15db10 2023-10-09T08:17:08.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.226+0000 7fef6a7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c159c60 0x7fef6c0cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:08.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.226+0000 7fef6a7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c159c60 0x7fef6c0cdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56094/0 (socket says 172.21.15.71:56094) 2023-10-09T08:17:08.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.226+0000 7fef6a7fc700 1 -- 172.21.15.71:0/1532344329 learned_addr learned my addr 172.21.15.71:0/1532344329 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:08.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.226+0000 7fef6b7fe700 1 --2- 172.21.15.71:0/1532344329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef6c15db10 0x7fef6c0b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:08.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.226+0000 7fef6affd700 1 --2- 172.21.15.71:0/1532344329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef6c159890 0x7fef6c14d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:08.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.227+0000 7fef6a7fc700 1 -- 172.21.15.71:0/1532344329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef6c15db10 msgr2=0x7fef6c0b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:08.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.227+0000 7fef6a7fc700 1 --2- 172.21.15.71:0/1532344329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef6c15db10 0x7fef6c0b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.227+0000 7fef6a7fc700 1 -- 172.21.15.71:0/1532344329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef6c159890 msgr2=0x7fef6c14d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:08.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.227+0000 7fef6a7fc700 1 --2- 172.21.15.71:0/1532344329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef6c159890 0x7fef6c14d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.227+0000 7fef6a7fc700 1 -- 172.21.15.71:0/1532344329 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef60009420 con 0x7fef6c159c60 2023-10-09T08:17:08.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.227+0000 7fef6a7fc700 1 --2- 172.21.15.71:0/1532344329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c159c60 0x7fef6c0cdc90 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0899c0 tx=0x7fef60017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:08.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.227+0000 7fef52ffd700 1 -- 172.21.15.71:0/1532344329 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60011b10 con 0x7fef6c159c60 2023-10-09T08:17:08.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.227+0000 7fef52ffd700 1 -- 172.21.15.71:0/1532344329 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef60000c90 con 0x7fef6c159c60 2023-10-09T08:17:08.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.227+0000 7fef715ff700 1 -- 172.21.15.71:0/1532344329 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6c16ae70 con 0x7fef6c159c60 2023-10-09T08:17:08.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.227+0000 7fef52ffd700 1 -- 172.21.15.71:0/1532344329 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60025620 con 0x7fef6c159c60 2023-10-09T08:17:08.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.227+0000 7fef715ff700 1 -- 172.21.15.71:0/1532344329 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6c16b430 con 0x7fef6c159c60 2023-10-09T08:17:08.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.228+0000 7fef715ff700 1 -- 172.21.15.71:0/1532344329 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6c16bc10 con 0x7fef6c159c60 2023-10-09T08:17:08.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.229+0000 7fef52ffd700 1 -- 172.21.15.71:0/1532344329 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 98) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fef60025a10 con 0x7fef6c159c60 2023-10-09T08:17:08.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.230+0000 7fef52ffd700 1 --2- 172.21.15.71:0/1532344329 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fef58067050 0x7fef58069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:08.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.231+0000 7fef52ffd700 1 -- 172.21.15.71:0/1532344329 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6527+0+0 (secure 0 0 0) 0x7fef60086210 con 0x7fef6c159c60 2023-10-09T08:17:08.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.231+0000 7fef6affd700 1 -- 172.21.15.71:0/1532344329 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fef58067050 msgr2=0x7fef58069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:08.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.231+0000 7fef6affd700 1 --2- 172.21.15.71:0/1532344329 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fef58067050 0x7fef58069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:08.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.235+0000 7fef52ffd700 1 -- 172.21.15.71:0/1532344329 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef60052fa0 con 0x7fef6c159c60 2023-10-09T08:17:08.249 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:08.249+0000 7f3c588e4180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T08:17:08.345 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:08.345+0000 7f3c588e4180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T08:17:08.396 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:08.395+0000 7f4463186180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T08:17:08.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.432+0000 7fef6affd700 1 -- 172.21.15.71:0/1532344329 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fef58067050 msgr2=0x7fef58069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:08.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.432+0000 7fef6affd700 1 --2- 172.21.15.71:0/1532344329 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fef58067050 0x7fef58069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:08.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.478+0000 7fef715ff700 1 -- 172.21.15.71:0/1532344329 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef6c04c3c0 con 0x7fef6c159c60 2023-10-09T08:17:08.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.478+0000 7fef52ffd700 1 -- 172.21.15.71:0/1532344329 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4592 (secure 0 0 0) 0x7fef600565c0 con 0x7fef6c159c60 2023-10-09T08:17:08.479 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:08.480 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":89,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7919,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/567694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":567694},{"type":"v1","addr":"172.21.15.71:6835","nonce":567694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":9151,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/502575967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":502575967},{"type":"v1","addr":"172.21.15.179:6836","nonce":502575967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":9663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/1425921431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":1425921431},{"type":"v1","addr":"172.21.15.71:6834","nonce":1425921431}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T08:14:38.913123+0000","modified":"2023-10-09T08:14:42.474701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9678},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9678":{"gid":9678,"name":"d","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/1735854447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1735854447},{"type":"v1","addr":"172.21.15.179:6834","nonce":1735854447}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T08:17:08.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.481+0000 7fef715ff700 1 -- 172.21.15.71:0/1532344329 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fef58067050 msgr2=0x7fef58069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:08.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.481+0000 7fef715ff700 1 --2- 172.21.15.71:0/1532344329 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fef58067050 0x7fef58069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.481+0000 7fef715ff700 1 -- 172.21.15.71:0/1532344329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c159c60 msgr2=0x7fef6c0cdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:08.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.481+0000 7fef715ff700 1 --2- 172.21.15.71:0/1532344329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c159c60 0x7fef6c0cdc90 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0899c0 tx=0x7fef60017000 comp rx=0 tx=0).stop 2023-10-09T08:17:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.481+0000 7fef715ff700 1 -- 172.21.15.71:0/1532344329 shutdown_connections 2023-10-09T08:17:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.481+0000 7fef715ff700 1 --2- 172.21.15.71:0/1532344329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef6c15db10 0x7fef6c0b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.481+0000 7fef715ff700 1 --2- 172.21.15.71:0/1532344329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef6c159890 0x7fef6c14d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.481+0000 7fef715ff700 1 --2- 172.21.15.71:0/1532344329 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fef58067050 0x7fef58069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.481+0000 7fef715ff700 1 --2- 172.21.15.71:0/1532344329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c159c60 0x7fef6c0cdc90 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.481+0000 7fef715ff700 1 -- 172.21.15.71:0/1532344329 >> 172.21.15.71:0/1532344329 conn(0x7fef6c068e20 msgr2=0x7fef6c15cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.481+0000 7fef715ff700 1 -- 172.21.15.71:0/1532344329 shutdown_connections 2023-10-09T08:17:08.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.481+0000 7fef715ff700 1 -- 172.21.15.71:0/1532344329 wait complete. 2023-10-09T08:17:08.484 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 89 2023-10-09T08:17:08.495 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:08.494+0000 7f4463186180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T08:17:08.500 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T08:17:08.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.683+0000 7f8b7679d700 1 Processor -- start 2023-10-09T08:17:08.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.683+0000 7f8b7679d700 1 -- start start 2023-10-09T08:17:08.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.685+0000 7f8b7679d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b70142ea0 0x7f8b700b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:08.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.685+0000 7f8b7679d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8b700ad870 0x7f8b7006b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:08.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.685+0000 7f8b7679d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b700b40f0 con 0x7f8b700b3b70 2023-10-09T08:17:08.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.685+0000 7f8b7679d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b70069640 con 0x7f8b700ad870 2023-10-09T08:17:08.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.685+0000 7f8b7679d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b70069920 con 0x7f8b70142ea0 2023-10-09T08:17:08.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.685+0000 7f8b74f9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8b700ad870 0x7f8b7006b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:08.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.685+0000 7f8b7579b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b70142ea0 0x7f8b700b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:08.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.685+0000 7f8b7579b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b70142ea0 0x7f8b700b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:43548/0 (socket says 172.21.15.71:43548) 2023-10-09T08:17:08.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.685+0000 7f8b7579b700 1 -- 172.21.15.71:0/879328141 learned_addr learned my addr 172.21.15.71:0/879328141 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:08.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.686+0000 7f8b74f9a700 1 -- 172.21.15.71:0/879328141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b70142ea0 msgr2=0x7f8b700b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:08.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.686+0000 7f8b74f9a700 1 --2- 172.21.15.71:0/879328141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b70142ea0 0x7f8b700b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.686+0000 7f8b74f9a700 1 -- 172.21.15.71:0/879328141 >> v1:172.21.15.179:6789/0 conn(0x7f8b700b3b70 legacy=0x7f8b7006cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:08.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.686+0000 7f8b74f9a700 1 -- 172.21.15.71:0/879328141 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b70069c00 con 0x7f8b700ad870 2023-10-09T08:17:08.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.686+0000 7f8b67fff700 1 -- 172.21.15.71:0/879328141 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457508858 0 0) 0x7f8b700b40f0 con 0x7f8b700b3b70 2023-10-09T08:17:08.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.686+0000 7f8b7579b700 1 --2- 172.21.15.71:0/879328141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b70142ea0 0x7f8b700b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:08.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.686+0000 7f8b74f9a700 1 --2- 172.21.15.71:0/879328141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b700ad870 0x7f8b7006b9e0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f8b600098e0 tx=0x7f8b600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a856489ed0417ef server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:08.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.686+0000 7f8b67fff700 1 -- 172.21.15.71:0/879328141 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6000b640 con 0x7f8b700ad870 2023-10-09T08:17:08.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.686+0000 7f8b67fff700 1 -- 172.21.15.71:0/879328141 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6000b7a0 con 0x7f8b700ad870 2023-10-09T08:17:08.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.686+0000 7f8b67fff700 1 -- 172.21.15.71:0/879328141 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6000bb40 con 0x7f8b700ad870 2023-10-09T08:17:08.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.687+0000 7f8b7679d700 1 -- 172.21.15.71:0/879328141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b700ad870 msgr2=0x7f8b7006b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:08.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.687+0000 7f8b7679d700 1 --2- 172.21.15.71:0/879328141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b700ad870 0x7f8b7006b9e0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f8b600098e0 tx=0x7f8b600091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.687+0000 7f8b7679d700 1 -- 172.21.15.71:0/879328141 shutdown_connections 2023-10-09T08:17:08.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.687+0000 7f8b7679d700 1 --2- 172.21.15.71:0/879328141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b70142ea0 0x7f8b700b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.687+0000 7f8b7679d700 1 --2- 172.21.15.71:0/879328141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b700ad870 0x7f8b7006b9e0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.687+0000 7f8b7679d700 1 -- 172.21.15.71:0/879328141 >> 172.21.15.71:0/879328141 conn(0x7f8b700ce430 msgr2=0x7f8b700ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:08.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.687+0000 7f8b7679d700 1 -- 172.21.15.71:0/879328141 shutdown_connections 2023-10-09T08:17:08.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.687+0000 7f8b7679d700 1 -- 172.21.15.71:0/879328141 wait complete. 2023-10-09T08:17:08.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.688+0000 7f8b7679d700 1 Processor -- start 2023-10-09T08:17:08.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.689+0000 7f8b7679d700 1 -- start start 2023-10-09T08:17:08.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.689+0000 7f8b7679d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b700b3b70 0x7f8b70140110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:08.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.689+0000 7f8b7679d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b70142ea0 0x7f8b7015bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:08.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.689+0000 7f8b7679d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b700ace30 0x7f8b7015ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:08.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.689+0000 7f8b7679d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b70169f80 con 0x7f8b700ace30 2023-10-09T08:17:08.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.689+0000 7f8b7679d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7016ada0 con 0x7f8b700b3b70 2023-10-09T08:17:08.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.689+0000 7f8b7679d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b70140650 con 0x7f8b70142ea0 2023-10-09T08:17:08.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.690+0000 7f8b74f9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b70142ea0 0x7f8b7015bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:08.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.690+0000 7f8b7579b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b700b3b70 0x7f8b70140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:08.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.690+0000 7f8b74f9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b70142ea0 0x7f8b7015bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:43554/0 (socket says 172.21.15.71:43554) 2023-10-09T08:17:08.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.690+0000 7f8b74f9a700 1 -- 172.21.15.71:0/1539724513 learned_addr learned my addr 172.21.15.71:0/1539724513 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:08.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.690+0000 7f8b75f9c700 1 --2- 172.21.15.71:0/1539724513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b700ace30 0x7f8b7015ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:08.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.690+0000 7f8b7579b700 1 -- 172.21.15.71:0/1539724513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b70142ea0 msgr2=0x7f8b7015bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:08.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.690+0000 7f8b7579b700 1 --2- 172.21.15.71:0/1539724513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b70142ea0 0x7f8b7015bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.690+0000 7f8b7579b700 1 -- 172.21.15.71:0/1539724513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b700ace30 msgr2=0x7f8b7015ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:08.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.690+0000 7f8b7579b700 1 --2- 172.21.15.71:0/1539724513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b700ace30 0x7f8b7015ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.690+0000 7f8b7579b700 1 -- 172.21.15.71:0/1539724513 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6c0094f0 con 0x7f8b700b3b70 2023-10-09T08:17:08.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.691+0000 7f8b7579b700 1 --2- 172.21.15.71:0/1539724513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b700b3b70 0x7f8b70140110 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c006fd0 tx=0x7f8b6c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:08.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.691+0000 7f8b657fa700 1 -- 172.21.15.71:0/1539724513 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c00c6a0 con 0x7f8b700b3b70 2023-10-09T08:17:08.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.691+0000 7f8b657fa700 1 -- 172.21.15.71:0/1539724513 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6c00c800 con 0x7f8b700b3b70 2023-10-09T08:17:08.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.691+0000 7f8b657fa700 1 -- 172.21.15.71:0/1539724513 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c00cb80 con 0x7f8b700b3b70 2023-10-09T08:17:08.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.691+0000 7f8b7679d700 1 -- 172.21.15.71:0/1539724513 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b60009420 con 0x7f8b700b3b70 2023-10-09T08:17:08.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.691+0000 7f8b7679d700 1 -- 172.21.15.71:0/1539724513 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7016a470 con 0x7f8b700b3b70 2023-10-09T08:17:08.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.692+0000 7f8b7679d700 1 -- 172.21.15.71:0/1539724513 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b7004c3c0 con 0x7f8b700b3b70 2023-10-09T08:17:08.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.693+0000 7f8b657fa700 1 -- 172.21.15.71:0/1539724513 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 98) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f8b6c013470 con 0x7f8b700b3b70 2023-10-09T08:17:08.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.694+0000 7f8b657fa700 1 --2- 172.21.15.71:0/1539724513 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8b54067050 0x7f8b54069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:08.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.694+0000 7f8b657fa700 1 -- 172.21.15.71:0/1539724513 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f8b6c084ae0 con 0x7f8b700b3b70 2023-10-09T08:17:08.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.694+0000 7f8b74f9a700 1 -- 172.21.15.71:0/1539724513 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8b54067050 msgr2=0x7f8b54069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:08.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.694+0000 7f8b74f9a700 1 --2- 172.21.15.71:0/1539724513 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8b54067050 0x7f8b54069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:08.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.698+0000 7f8b657fa700 1 -- 172.21.15.71:0/1539724513 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b6c051870 con 0x7f8b700b3b70 2023-10-09T08:17:08.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.894+0000 7f8b7679d700 1 -- 172.21.15.71:0/1539724513 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b70143270 con 0x7f8b700b3b70 2023-10-09T08:17:08.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.895+0000 7f8b74f9a700 1 -- 172.21.15.71:0/1539724513 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8b54067050 msgr2=0x7f8b54069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:08.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.895+0000 7f8b74f9a700 1 --2- 172.21.15.71:0/1539724513 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8b54067050 0x7f8b54069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:08.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.896+0000 7f8b657fa700 1 -- 172.21.15.71:0/1539724513 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+16627 (secure 0 0 0) 0x7f8b6c020090 con 0x7f8b700b3b70 2023-10-09T08:17:08.897 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:08.897 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":197,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T08:17:05.035359+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T08:14:37.033384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T08:14:37.895335+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":197,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:0/407948890":"2023-10-10T08:14:59.016743+0000","172.21.15.179:0/2620610180":"2023-10-10T08:14:59.016743+0000","172.21.15.179:6837/101206":"2023-10-10T08:14:59.016743+0000","172.21.15.179:0/13097287":"2023-10-10T08:14:59.016743+0000","172.21.15.179:6835/101206":"2023-10-10T08:14:59.016743+0000","172.21.15.179:0/3123444754":"2023-10-10T08:14:59.016743+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":23,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T08:17:08.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.898+0000 7f8b7679d700 1 -- 172.21.15.71:0/1539724513 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8b54067050 msgr2=0x7f8b54069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:08.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.898+0000 7f8b7679d700 1 --2- 172.21.15.71:0/1539724513 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8b54067050 0x7f8b54069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.898+0000 7f8b7679d700 1 -- 172.21.15.71:0/1539724513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b700b3b70 msgr2=0x7f8b70140110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:08.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.898+0000 7f8b7679d700 1 --2- 172.21.15.71:0/1539724513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b700b3b70 0x7f8b70140110 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c006fd0 tx=0x7f8b6c009250 comp rx=0 tx=0).stop 2023-10-09T08:17:08.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.898+0000 7f8b7679d700 1 -- 172.21.15.71:0/1539724513 shutdown_connections 2023-10-09T08:17:08.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.898+0000 7f8b7679d700 1 --2- 172.21.15.71:0/1539724513 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8b54067050 0x7f8b54069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.898+0000 7f8b7679d700 1 --2- 172.21.15.71:0/1539724513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b700ace30 0x7f8b7015ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.898+0000 7f8b7679d700 1 --2- 172.21.15.71:0/1539724513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b700b3b70 0x7f8b70140110 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.898+0000 7f8b7679d700 1 --2- 172.21.15.71:0/1539724513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b70142ea0 0x7f8b7015bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:08.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.898+0000 7f8b7679d700 1 -- 172.21.15.71:0/1539724513 >> 172.21.15.71:0/1539724513 conn(0x7f8b700ce430 msgr2=0x7f8b700cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:08.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.898+0000 7f8b7679d700 1 -- 172.21.15.71:0/1539724513 shutdown_connections 2023-10-09T08:17:08.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:08.898+0000 7f8b7679d700 1 -- 172.21.15.71:0/1539724513 wait complete. 2023-10-09T08:17:08.917 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T08:17:09.054 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:09.054+0000 7f3c588e4180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T08:17:09.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.107+0000 7f89c5d9d700 1 Processor -- start 2023-10-09T08:17:09.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.108+0000 7f89c5d9d700 1 -- start start 2023-10-09T08:17:09.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.109+0000 7f89c5d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89c0159420 0x7f89c00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:09.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.109+0000 7f89c5d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f89c015d230 0x7f89c015d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:09.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.109+0000 7f89c5d9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c015dbd0 con 0x7f89c01597f0 2023-10-09T08:17:09.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.109+0000 7f89c5d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c00b2980 con 0x7f89c015d230 2023-10-09T08:17:09.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.109+0000 7f89c5d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c00b11d0 con 0x7f89c0159420 2023-10-09T08:17:09.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.109+0000 7f89bffff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f89c01597f0 0x7f89c00b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48514/0 (socket says 172.21.15.71:48514) 2023-10-09T08:17:09.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.109+0000 7f89bffff700 1 -- 172.21.15.71:0/1558424597 learned_addr learned my addr 172.21.15.71:0/1558424597 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:09.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.109+0000 7f89c4d9b700 1 --2- 172.21.15.71:0/1558424597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89c0159420 0x7f89c00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:09.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.109+0000 7f89c559c700 1 --2- 172.21.15.71:0/1558424597 >> v2:172.21.15.179:3300/0 conn(0x7f89c015d230 0x7f89c015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:09.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.110+0000 7f89bf7fe700 1 -- 172.21.15.71:0/1558424597 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402632652 0 0) 0x7f89ac001110 con 0x7f89c01597f0 2023-10-09T08:17:09.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.110+0000 7f89bf7fe700 1 -- 172.21.15.71:0/1558424597 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89b0003570 con 0x7f89c01597f0 2023-10-09T08:17:09.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.110+0000 7f89c4d9b700 1 -- 172.21.15.71:0/1558424597 >> v2:172.21.15.179:3300/0 conn(0x7f89c015d230 msgr2=0x7f89c015d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:09.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.110+0000 7f89c4d9b700 1 --2- 172.21.15.71:0/1558424597 >> v2:172.21.15.179:3300/0 conn(0x7f89c015d230 0x7f89c015d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:09.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.110+0000 7f89c4d9b700 1 -- 172.21.15.71:0/1558424597 >> v1:172.21.15.71:6789/0 conn(0x7f89c01597f0 legacy=0x7f89c00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:09.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.110+0000 7f89c4d9b700 1 -- 172.21.15.71:0/1558424597 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c00b14b0 con 0x7f89c0159420 2023-10-09T08:17:09.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.110+0000 7f89c4d9b700 1 --2- 172.21.15.71:0/1558424597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89c0159420 0x7f89c00b5f40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f89b40098e0 tx=0x7f89b40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97cedb11bbe7f077 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:09.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.110+0000 7f89bf7fe700 1 -- 172.21.15.71:0/1558424597 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b4011630 con 0x7f89c0159420 2023-10-09T08:17:09.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.110+0000 7f89bf7fe700 1 -- 172.21.15.71:0/1558424597 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b4011790 con 0x7f89c0159420 2023-10-09T08:17:09.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.110+0000 7f89bf7fe700 1 -- 172.21.15.71:0/1558424597 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b4011b30 con 0x7f89c0159420 2023-10-09T08:17:09.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.111+0000 7f89c5d9d700 1 -- 172.21.15.71:0/1558424597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89c0159420 msgr2=0x7f89c00b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:09.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.111+0000 7f89c5d9d700 1 --2- 172.21.15.71:0/1558424597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89c0159420 0x7f89c00b5f40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f89b40098e0 tx=0x7f89b40091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:09.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.111+0000 7f89c5d9d700 1 -- 172.21.15.71:0/1558424597 shutdown_connections 2023-10-09T08:17:09.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.111+0000 7f89c5d9d700 1 --2- 172.21.15.71:0/1558424597 >> v2:172.21.15.179:3300/0 conn(0x7f89c015d230 0x7f89c015d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:09.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.111+0000 7f89c5d9d700 1 --2- 172.21.15.71:0/1558424597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89c0159420 0x7f89c00b5f40 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:09.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.111+0000 7f89c5d9d700 1 -- 172.21.15.71:0/1558424597 >> 172.21.15.71:0/1558424597 conn(0x7f89c00d0660 msgr2=0x7f89c00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:09.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.111+0000 7f89c5d9d700 1 -- 172.21.15.71:0/1558424597 shutdown_connections 2023-10-09T08:17:09.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.111+0000 7f89c5d9d700 1 -- 172.21.15.71:0/1558424597 wait complete. 2023-10-09T08:17:09.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.113+0000 7f89c5d9d700 1 Processor -- start 2023-10-09T08:17:09.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.113+0000 7f89c5d9d700 1 -- start start 2023-10-09T08:17:09.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.114+0000 7f89c5d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89c0159420 0x7f89c014f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:09.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.114+0000 7f89c5d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89c01597f0 0x7f89c00cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:09.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.114+0000 7f89c5d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89c015d230 0x7f89c00cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:09.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.114+0000 7f89c5d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c016a180 con 0x7f89c0159420 2023-10-09T08:17:09.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.114+0000 7f89c5d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c014ff40 con 0x7f89c01597f0 2023-10-09T08:17:09.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.114+0000 7f89c5d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c0169b30 con 0x7f89c015d230 2023-10-09T08:17:09.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.114+0000 7f89c4d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89c0159420 0x7f89c014f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:09.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.114+0000 7f89c4d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89c0159420 0x7f89c014f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56116/0 (socket says 172.21.15.71:56116) 2023-10-09T08:17:09.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.114+0000 7f89c4d9b700 1 -- 172.21.15.71:0/133701724 learned_addr learned my addr 172.21.15.71:0/133701724 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:09.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.114+0000 7f89bffff700 1 --2- 172.21.15.71:0/133701724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89c01597f0 0x7f89c00cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:09.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.114+0000 7f89c559c700 1 --2- 172.21.15.71:0/133701724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89c015d230 0x7f89c00cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:09.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.114+0000 7f89c4d9b700 1 -- 172.21.15.71:0/133701724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89c015d230 msgr2=0x7f89c00cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:09.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.114+0000 7f89c4d9b700 1 --2- 172.21.15.71:0/133701724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89c015d230 0x7f89c00cffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:09.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.114+0000 7f89c4d9b700 1 -- 172.21.15.71:0/133701724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89c01597f0 msgr2=0x7f89c00cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:09.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.114+0000 7f89c4d9b700 1 --2- 172.21.15.71:0/133701724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89c01597f0 0x7f89c00cfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:09.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.114+0000 7f89c4d9b700 1 -- 172.21.15.71:0/133701724 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b4009420 con 0x7f89c0159420 2023-10-09T08:17:09.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.115+0000 7f89c4d9b700 1 --2- 172.21.15.71:0/133701724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89c0159420 0x7f89c014f580 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f89c00b1310 tx=0x7f89b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:09.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.115+0000 7f89bcff9700 1 -- 172.21.15.71:0/133701724 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b4000d10 con 0x7f89c0159420 2023-10-09T08:17:09.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.115+0000 7f89bcff9700 1 -- 172.21.15.71:0/133701724 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b4011b10 con 0x7f89c0159420 2023-10-09T08:17:09.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.115+0000 7f89c5d9d700 1 -- 172.21.15.71:0/133701724 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c0169e10 con 0x7f89c0159420 2023-10-09T08:17:09.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.115+0000 7f89bcff9700 1 -- 172.21.15.71:0/133701724 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b4025660 con 0x7f89c0159420 2023-10-09T08:17:09.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.115+0000 7f89c5d9d700 1 -- 172.21.15.71:0/133701724 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c016a610 con 0x7f89c0159420 2023-10-09T08:17:09.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.116+0000 7f89c5d9d700 1 -- 172.21.15.71:0/133701724 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c004c3c0 con 0x7f89c0159420 2023-10-09T08:17:09.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.117+0000 7f89bcff9700 1 -- 172.21.15.71:0/133701724 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 98) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f89b4025a50 con 0x7f89c0159420 2023-10-09T08:17:09.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.118+0000 7f89bcff9700 1 --2- 172.21.15.71:0/133701724 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f89a4067050 0x7f89a4069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:09.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.118+0000 7f89bcff9700 1 -- 172.21.15.71:0/133701724 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f89b4086240 con 0x7f89c0159420 2023-10-09T08:17:09.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.118+0000 7f89bffff700 1 -- 172.21.15.71:0/133701724 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f89a4067050 msgr2=0x7f89a4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:09.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.118+0000 7f89bffff700 1 --2- 172.21.15.71:0/133701724 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f89a4067050 0x7f89a4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:09.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.122+0000 7f89bcff9700 1 -- 172.21.15.71:0/133701724 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89b4052fd0 con 0x7f89c0159420 2023-10-09T08:17:09.228 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:09.227+0000 7f4463186180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T08:17:09.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.319+0000 7f89bffff700 1 -- 172.21.15.71:0/133701724 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f89a4067050 msgr2=0x7f89a4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:09.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.319+0000 7f89bffff700 1 --2- 172.21.15.71:0/133701724 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f89a4067050 0x7f89a4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:09.343 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:09.343+0000 7f3c588e4180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T08:17:09.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.366+0000 7f89c5d9d700 1 -- 172.21.15.71:0/133701724 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f89c00b1790 con 0x7f89c0159420 2023-10-09T08:17:09.368 INFO:tasks.ceph.mon.a.smithi071.stderr:2023-10-09T08:17:09.367+0000 7fdb445f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T08:17:09.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.375+0000 7f89bcff9700 1 -- 172.21.15.71:0/133701724 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v90) v1 ==== 161+0+0 (secure 0 0 0) 0x7f89b40565f0 con 0x7f89c0159420 2023-10-09T08:17:09.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.378+0000 7f89c5d9d700 1 -- 172.21.15.71:0/133701724 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f89a4067050 msgr2=0x7f89a4069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:09.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.378+0000 7f89c5d9d700 1 --2- 172.21.15.71:0/133701724 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f89a4067050 0x7f89a4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:09.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.378+0000 7f89c5d9d700 1 -- 172.21.15.71:0/133701724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89c0159420 msgr2=0x7f89c014f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:09.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.378+0000 7f89c5d9d700 1 --2- 172.21.15.71:0/133701724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89c0159420 0x7f89c014f580 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f89c00b1310 tx=0x7f89b4017000 comp rx=0 tx=0).stop 2023-10-09T08:17:09.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.378+0000 7f89c5d9d700 1 -- 172.21.15.71:0/133701724 shutdown_connections 2023-10-09T08:17:09.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.378+0000 7f89c5d9d700 1 --2- 172.21.15.71:0/133701724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89c015d230 0x7f89c00cffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:09.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.378+0000 7f89c5d9d700 1 --2- 172.21.15.71:0/133701724 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f89a4067050 0x7f89a4069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:09.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.378+0000 7f89c5d9d700 1 --2- 172.21.15.71:0/133701724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89c0159420 0x7f89c014f580 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:09.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.378+0000 7f89c5d9d700 1 --2- 172.21.15.71:0/133701724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89c01597f0 0x7f89c00cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:09.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.378+0000 7f89c5d9d700 1 -- 172.21.15.71:0/133701724 >> 172.21.15.71:0/133701724 conn(0x7f89c00d0660 msgr2=0x7f89c0069c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:09.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.378+0000 7f89c5d9d700 1 -- 172.21.15.71:0/133701724 shutdown_connections 2023-10-09T08:17:09.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.378+0000 7f89c5d9d700 1 -- 172.21.15.71:0/133701724 wait complete. 2023-10-09T08:17:09.381 INFO:teuthology.orchestra.run.smithi071.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T08:17:09.399 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T08:17:09.434 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-09T08:17:09.446 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:09.446+0000 7f3c588e4180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T08:17:09.529 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:09.528+0000 7f4463186180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T08:17:09.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.590+0000 7f342bfff700 1 Processor -- start 2023-10-09T08:17:09.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.590+0000 7f342bfff700 1 -- start start 2023-10-09T08:17:09.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.591+0000 7f342bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f342c0cb1a0 0x7f342c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:09.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.591+0000 7f342bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f342c15a8a0 0x7f342c06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:09.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.591+0000 7f342bfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f342c06ebd0 con 0x7f342c06f5a0 2023-10-09T08:17:09.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.591+0000 7f342bfff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f342c15b2e0 con 0x7f342c0cb1a0 2023-10-09T08:17:09.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.591+0000 7f342bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342c15ad20 con 0x7f342c15a8a0 2023-10-09T08:17:09.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.591+0000 7f342affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f342c0cb1a0 0x7f342c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:09.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.591+0000 7f342affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f342c0cb1a0 0x7f342c15a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56122/0 (socket says 172.21.15.71:56122) 2023-10-09T08:17:09.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.591+0000 7f342affd700 1 -- 172.21.15.71:0/1594649160 learned_addr learned my addr 172.21.15.71:0/1594649160 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:09.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.592+0000 7f342a7fc700 1 --2- 172.21.15.71:0/1594649160 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f342c15a8a0 0x7f342c06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:09.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.592+0000 7f3429ffb700 1 -- 172.21.15.71:0/1594649160 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216418803 0 0) 0x7f342c06ebd0 con 0x7f342c06f5a0 2023-10-09T08:17:09.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.592+0000 7f342affd700 1 -- 172.21.15.71:0/1594649160 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f342c15a8a0 msgr2=0x7f342c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:09.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.592+0000 7f342affd700 1 --2- 172.21.15.71:0/1594649160 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f342c15a8a0 0x7f342c06f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:09.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.592+0000 7f342affd700 1 -- 172.21.15.71:0/1594649160 >> v1:172.21.15.179:6789/0 conn(0x7f342c06f5a0 legacy=0x7f342c0ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:09.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.592+0000 7f342affd700 1 -- 172.21.15.71:0/1594649160 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342c15b000 con 0x7f342c0cb1a0 2023-10-09T08:17:09.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.592+0000 7f342affd700 1 --2- 172.21.15.71:0/1594649160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f342c0cb1a0 0x7f342c15a360 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f341c0099b0 tx=0x7f341c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5296ae54fafc1fb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:09.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.593+0000 7f3429ffb700 1 -- 172.21.15.71:0/1594649160 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c009ea0 con 0x7f342c0cb1a0 2023-10-09T08:17:09.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.593+0000 7f3429ffb700 1 -- 172.21.15.71:0/1594649160 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341c00b8f0 con 0x7f342c0cb1a0 2023-10-09T08:17:09.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.593+0000 7f3429ffb700 1 -- 172.21.15.71:0/1594649160 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c00bc90 con 0x7f342c0cb1a0 2023-10-09T08:17:09.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.593+0000 7f342bfff700 1 -- 172.21.15.71:0/1594649160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f342c0cb1a0 msgr2=0x7f342c15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:09.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.593+0000 7f342bfff700 1 --2- 172.21.15.71:0/1594649160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f342c0cb1a0 0x7f342c15a360 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f341c0099b0 tx=0x7f341c009250 comp rx=0 tx=0).stop 2023-10-09T08:17:09.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.593+0000 7f342bfff700 1 -- 172.21.15.71:0/1594649160 shutdown_connections 2023-10-09T08:17:09.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.593+0000 7f342bfff700 1 --2- 172.21.15.71:0/1594649160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f342c0cb1a0 0x7f342c15a360 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:09.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.593+0000 7f342bfff700 1 --2- 172.21.15.71:0/1594649160 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f342c15a8a0 0x7f342c06f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:09.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.593+0000 7f342bfff700 1 -- 172.21.15.71:0/1594649160 >> 172.21.15.71:0/1594649160 conn(0x7f342c0cc1e0 msgr2=0x7f342c0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:09.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.593+0000 7f342bfff700 1 -- 172.21.15.71:0/1594649160 shutdown_connections 2023-10-09T08:17:09.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.593+0000 7f342bfff700 1 -- 172.21.15.71:0/1594649160 wait complete. 2023-10-09T08:17:09.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.595+0000 7f342bfff700 1 Processor -- start 2023-10-09T08:17:09.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.595+0000 7f342bfff700 1 -- start start 2023-10-09T08:17:09.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.596+0000 7f342bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f342c06f5a0 0x7f342c14be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:09.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.596+0000 7f342bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f342c0cb1a0 0x7f342c14fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:09.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.596+0000 7f342bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f342c14a220 0x7f342c155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:09.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.596+0000 7f342bfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342c168230 con 0x7f342c14a220 2023-10-09T08:17:09.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.596+0000 7f342bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342c14b710 con 0x7f342c06f5a0 2023-10-09T08:17:09.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.596+0000 7f342bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342c14cd30 con 0x7f342c0cb1a0 2023-10-09T08:17:09.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.596+0000 7f342affd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f342c06f5a0 0x7f342c14be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:09.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.596+0000 7f342b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f342c14a220 0x7f342c155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:09.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.596+0000 7f342affd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f342c06f5a0 0x7f342c14be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:57526/0 (socket says 172.21.15.71:57526) 2023-10-09T08:17:09.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.596+0000 7f342affd700 1 -- 172.21.15.71:0/2282824780 learned_addr learned my addr 172.21.15.71:0/2282824780 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:09.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.596+0000 7f342a7fc700 1 --2- 172.21.15.71:0/2282824780 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f342c0cb1a0 0x7f342c14fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:09.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.597+0000 7f342affd700 1 -- 172.21.15.71:0/2282824780 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f342c0cb1a0 msgr2=0x7f342c14fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:09.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.597+0000 7f342affd700 1 --2- 172.21.15.71:0/2282824780 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f342c0cb1a0 0x7f342c14fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:09.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.597+0000 7f342affd700 1 -- 172.21.15.71:0/2282824780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f342c14a220 msgr2=0x7f342c155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:09.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.597+0000 7f342affd700 1 --2- 172.21.15.71:0/2282824780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f342c14a220 0x7f342c155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:09.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.597+0000 7f342affd700 1 -- 172.21.15.71:0/2282824780 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c0094f0 con 0x7f342c06f5a0 2023-10-09T08:17:09.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.597+0000 7f342b7fe700 1 --2- 172.21.15.71:0/2282824780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f342c14a220 0x7f342c155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:09.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.597+0000 7f342affd700 1 --2- 172.21.15.71:0/2282824780 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f342c06f5a0 0x7f342c14be00 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f342c06ce80 tx=0x7f341c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:09.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.597+0000 7f3412ffd700 1 -- 172.21.15.71:0/2282824780 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c000d10 con 0x7f342c06f5a0 2023-10-09T08:17:09.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.597+0000 7f3412ffd700 1 -- 172.21.15.71:0/2282824780 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341c00bc70 con 0x7f342c06f5a0 2023-10-09T08:17:09.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.597+0000 7f342bfff700 1 -- 172.21.15.71:0/2282824780 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f342c14c490 con 0x7f342c06f5a0 2023-10-09T08:17:09.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.597+0000 7f3412ffd700 1 -- 172.21.15.71:0/2282824780 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c011670 con 0x7f342c06f5a0 2023-10-09T08:17:09.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.597+0000 7f342bfff700 1 -- 172.21.15.71:0/2282824780 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f342c14ca50 con 0x7f342c06f5a0 2023-10-09T08:17:09.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.598+0000 7f342bfff700 1 -- 172.21.15.71:0/2282824780 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f342c06c450 con 0x7f342c06f5a0 2023-10-09T08:17:09.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.599+0000 7f3412ffd700 1 -- 172.21.15.71:0/2282824780 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 98) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f341c011a20 con 0x7f342c06f5a0 2023-10-09T08:17:09.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.600+0000 7f3412ffd700 1 --2- 172.21.15.71:0/2282824780 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3418067050 0x7f3418069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:09.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.600+0000 7f3412ffd700 1 -- 172.21.15.71:0/2282824780 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6569+0+0 (secure 0 0 0) 0x7f341c086350 con 0x7f342c06f5a0 2023-10-09T08:17:09.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.600+0000 7f342a7fc700 1 -- 172.21.15.71:0/2282824780 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3418067050 msgr2=0x7f3418069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:09.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.600+0000 7f342a7fc700 1 --2- 172.21.15.71:0/2282824780 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3418067050 0x7f3418069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:09.602 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:09.602+0000 7f3c588e4180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T08:17:09.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.605+0000 7f3412ffd700 1 -- 172.21.15.71:0/2282824780 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f341c0530b0 con 0x7f342c06f5a0 2023-10-09T08:17:09.627 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:09.626+0000 7f4463186180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T08:17:09.709 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:09.709+0000 7f3c588e4180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T08:17:09.788 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:09.787+0000 7f4463186180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T08:17:09.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.801+0000 7f342a7fc700 1 -- 172.21.15.71:0/2282824780 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3418067050 msgr2=0x7f3418069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:09.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.801+0000 7f342a7fc700 1 --2- 172.21.15.71:0/2282824780 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3418067050 0x7f3418069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:09.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:09.851+0000 7f342bfff700 1 -- 172.21.15.71:0/2282824780 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f342c06e860 con 0x7f342c06f5a0 2023-10-09T08:17:09.897 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:09.896+0000 7f4463186180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T08:17:09.902 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:09.902+0000 7f3c588e4180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T08:17:09.998 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:09.998+0000 7f3c588e4180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T08:17:10.090 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:10.089+0000 7f4463186180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T08:17:10.094 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:10.094+0000 7f3c588e4180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T08:17:10.183 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:10.182+0000 7f4463186180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T08:17:10.189 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:10.189+0000 7f3c588e4180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T08:17:10.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.199+0000 7f3412ffd700 1 -- 172.21.15.71:0/2282824780 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mgrmap(e 99) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f341c053480 con 0x7f342c06f5a0 2023-10-09T08:17:10.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.199+0000 7f3412ffd700 1 -- 172.21.15.71:0/2282824780 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3418067050 msgr2=0x7f3418069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:10.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.199+0000 7f3412ffd700 1 --2- 172.21.15.71:0/2282824780 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3418067050 0x7f3418069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:10.266 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:10.265+0000 7f3bd34c2700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:10.267 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:10.265+0000 7f3bd34c2700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:10.267 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:10.265+0000 7f3bd34c2700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:10.267 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:10.265+0000 7f3bd34c2700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:10.267 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:10.265+0000 7f3bd34c2700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:10.267 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:10.265+0000 7f3bd5cc7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:10.268 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:10.265+0000 7f3bd5cc7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:10.268 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:10.265+0000 7f3bd5cc7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:10.268 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:10.265+0000 7f3bd5cc7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:10.268 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:10.265+0000 7f3bd5cc7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:10.283 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:10.282+0000 7f4463186180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T08:17:10.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.375+0000 7f3412ffd700 1 -- 172.21.15.71:0/2282824780 <== mon.1 v2:172.21.15.179:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v91) v1 ==== 104+0+0 (secure 0 0 0) 0x7f341c027960 con 0x7f342c06f5a0 2023-10-09T08:17:10.378 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:10.377+0000 7f4463186180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T08:17:10.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.378+0000 7f342bfff700 1 -- 172.21.15.71:0/2282824780 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f342c06f5a0 msgr2=0x7f342c14be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:10.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.378+0000 7f342bfff700 1 --2- 172.21.15.71:0/2282824780 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f342c06f5a0 0x7f342c14be00 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f342c06ce80 tx=0x7f341c017000 comp rx=0 tx=0).stop 2023-10-09T08:17:10.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.378+0000 7f342bfff700 1 -- 172.21.15.71:0/2282824780 shutdown_connections 2023-10-09T08:17:10.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.378+0000 7f342bfff700 1 --2- 172.21.15.71:0/2282824780 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3418067050 0x7f3418069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:10.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.378+0000 7f342bfff700 1 --2- 172.21.15.71:0/2282824780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f342c14a220 0x7f342c155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:10.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.378+0000 7f342bfff700 1 --2- 172.21.15.71:0/2282824780 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f342c06f5a0 0x7f342c14be00 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:10.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.378+0000 7f342bfff700 1 --2- 172.21.15.71:0/2282824780 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f342c0cb1a0 0x7f342c14fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:10.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.378+0000 7f342bfff700 1 -- 172.21.15.71:0/2282824780 >> 172.21.15.71:0/2282824780 conn(0x7f342c0cc1e0 msgr2=0x7f342c06a000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:10.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.378+0000 7f342bfff700 1 -- 172.21.15.71:0/2282824780 shutdown_connections 2023-10-09T08:17:10.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.378+0000 7f342bfff700 1 -- 172.21.15.71:0/2282824780 wait complete. 2023-10-09T08:17:10.397 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T08:17:10.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.583+0000 7f01a13ff700 1 Processor -- start 2023-10-09T08:17:10.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.583+0000 7f01a13ff700 1 -- start start 2023-10-09T08:17:10.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.584+0000 7f01a13ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f019c153f50 0x7f019c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:10.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.584+0000 7f01a13ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f019c154320 0x7f019c06d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:10.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.584+0000 7f01a13ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f019c15a190 0x7f019c06d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:10.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.584+0000 7f01a13ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f019c0b4570 con 0x7f019c153f50 2023-10-09T08:17:10.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.584+0000 7f01a13ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f019c15a730 con 0x7f019c15a190 2023-10-09T08:17:10.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.584+0000 7f01a13ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019c15aa10 con 0x7f019c154320 2023-10-09T08:17:10.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.584+0000 7f019affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f019c153f50 0x7f019c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:10.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.585+0000 7f019affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f019c153f50 0x7f019c0b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56136/0 (socket says 172.21.15.71:56136) 2023-10-09T08:17:10.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.585+0000 7f019affd700 1 -- 172.21.15.71:0/2979673475 learned_addr learned my addr 172.21.15.71:0/2979673475 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:10.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.585+0000 7f019b7fe700 1 --2- 172.21.15.71:0/2979673475 >> v2:172.21.15.179:3300/0 conn(0x7f019c15a190 0x7f019c06d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:10.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.585+0000 7f019a7fc700 1 --2- 172.21.15.71:0/2979673475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f019c154320 0x7f019c06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:10.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.585+0000 7f019affd700 1 -- 172.21.15.71:0/2979673475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f019c154320 msgr2=0x7f019c06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:10.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.585+0000 7f019affd700 1 --2- 172.21.15.71:0/2979673475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f019c154320 0x7f019c06d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:10.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.585+0000 7f019affd700 1 -- 172.21.15.71:0/2979673475 >> v2:172.21.15.179:3300/0 conn(0x7f019c15a190 msgr2=0x7f019c06d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:10.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.585+0000 7f019affd700 1 --2- 172.21.15.71:0/2979673475 >> v2:172.21.15.179:3300/0 conn(0x7f019c15a190 0x7f019c06d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:10.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.585+0000 7f019affd700 1 -- 172.21.15.71:0/2979673475 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019c15acf0 con 0x7f019c153f50 2023-10-09T08:17:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.585+0000 7f019affd700 1 --2- 172.21.15.71:0/2979673475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f019c153f50 0x7f019c0b2000 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f019c0cf1c0 tx=0x7f018c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91b3a9dd0e044ad server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.585+0000 7f0199ffb700 1 -- 172.21.15.71:0/2979673475 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c00b860 con 0x7f019c153f50 2023-10-09T08:17:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.585+0000 7f0199ffb700 1 -- 172.21.15.71:0/2979673475 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018c00b9c0 con 0x7f019c153f50 2023-10-09T08:17:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.585+0000 7f0199ffb700 1 -- 172.21.15.71:0/2979673475 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c00bd60 con 0x7f019c153f50 2023-10-09T08:17:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.586+0000 7f01a13ff700 1 -- 172.21.15.71:0/2979673475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f019c153f50 msgr2=0x7f019c0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.586+0000 7f01a13ff700 1 --2- 172.21.15.71:0/2979673475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f019c153f50 0x7f019c0b2000 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f019c0cf1c0 tx=0x7f018c009250 comp rx=0 tx=0).stop 2023-10-09T08:17:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.586+0000 7f01a13ff700 1 -- 172.21.15.71:0/2979673475 shutdown_connections 2023-10-09T08:17:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.586+0000 7f01a13ff700 1 --2- 172.21.15.71:0/2979673475 >> v2:172.21.15.179:3300/0 conn(0x7f019c15a190 0x7f019c06d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.586+0000 7f01a13ff700 1 --2- 172.21.15.71:0/2979673475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f019c153f50 0x7f019c0b2000 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:10.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.586+0000 7f01a13ff700 1 --2- 172.21.15.71:0/2979673475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f019c154320 0x7f019c06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:10.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.586+0000 7f01a13ff700 1 -- 172.21.15.71:0/2979673475 >> 172.21.15.71:0/2979673475 conn(0x7f019c06baf0 msgr2=0x7f019c06bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:10.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.586+0000 7f01a13ff700 1 -- 172.21.15.71:0/2979673475 shutdown_connections 2023-10-09T08:17:10.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.586+0000 7f01a13ff700 1 -- 172.21.15.71:0/2979673475 wait complete. 2023-10-09T08:17:10.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.587+0000 7f01a13ff700 1 Processor -- start 2023-10-09T08:17:10.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.588+0000 7f01a13ff700 1 -- start start 2023-10-09T08:17:10.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.588+0000 7f01a13ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f019c153f50 0x7f019c145230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:10.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.588+0000 7f01a13ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f019c154320 0x7f019c169fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:10.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.588+0000 7f01a13ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f019c15a190 0x7f019c0b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:10.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.588+0000 7f01a13ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019c0cabd0 con 0x7f019c15a190 2023-10-09T08:17:10.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.588+0000 7f01a13ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019c0b0fc0 con 0x7f019c153f50 2023-10-09T08:17:10.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.588+0000 7f01a13ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019c0b0720 con 0x7f019c154320 2023-10-09T08:17:10.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.589+0000 7f019b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f019c15a190 0x7f019c0b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:10.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.589+0000 7f019b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f019c15a190 0x7f019c0b14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56138/0 (socket says 172.21.15.71:56138) 2023-10-09T08:17:10.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.589+0000 7f019affd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f019c153f50 0x7f019c145230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:10.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.589+0000 7f019b7fe700 1 -- 172.21.15.71:0/2961623995 learned_addr learned my addr 172.21.15.71:0/2961623995 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:10.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.589+0000 7f019a7fc700 1 --2- 172.21.15.71:0/2961623995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f019c154320 0x7f019c169fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:10.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.589+0000 7f019b7fe700 1 -- 172.21.15.71:0/2961623995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f019c154320 msgr2=0x7f019c169fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:10.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.589+0000 7f019b7fe700 1 --2- 172.21.15.71:0/2961623995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f019c154320 0x7f019c169fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:10.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.589+0000 7f019b7fe700 1 -- 172.21.15.71:0/2961623995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f019c153f50 msgr2=0x7f019c145230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:10.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.589+0000 7f019b7fe700 1 --2- 172.21.15.71:0/2961623995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f019c153f50 0x7f019c145230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:10.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.589+0000 7f019b7fe700 1 -- 172.21.15.71:0/2961623995 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018c0094f0 con 0x7f019c15a190 2023-10-09T08:17:10.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.589+0000 7f019b7fe700 1 --2- 172.21.15.71:0/2961623995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f019c15a190 0x7f019c0b14e0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f0194007f20 tx=0x7f0194009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:10.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.590+0000 7f0182ffd700 1 -- 172.21.15.71:0/2961623995 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019400eb90 con 0x7f019c15a190 2023-10-09T08:17:10.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.590+0000 7f0182ffd700 1 -- 172.21.15.71:0/2961623995 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019400ed10 con 0x7f019c15a190 2023-10-09T08:17:10.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.590+0000 7f0182ffd700 1 -- 172.21.15.71:0/2961623995 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194014670 con 0x7f019c15a190 2023-10-09T08:17:10.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.590+0000 7f01a13ff700 1 -- 172.21.15.71:0/2961623995 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f019c0b0a00 con 0x7f019c15a190 2023-10-09T08:17:10.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.590+0000 7f01a13ff700 1 -- 172.21.15.71:0/2961623995 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019c145770 con 0x7f019c15a190 2023-10-09T08:17:10.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.591+0000 7f01a13ff700 1 -- 172.21.15.71:0/2961623995 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f019c0718b0 con 0x7f019c15a190 2023-10-09T08:17:10.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.592+0000 7f0182ffd700 1 -- 172.21.15.71:0/2961623995 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 99) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f01940149e0 con 0x7f019c15a190 2023-10-09T08:17:10.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.593+0000 7f0182ffd700 1 -- 172.21.15.71:0/2961623995 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6827+0+0 (secure 0 0 0) 0x7f0194084b70 con 0x7f019c15a190 2023-10-09T08:17:10.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.597+0000 7f0182ffd700 1 -- 172.21.15.71:0/2961623995 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0194051c50 con 0x7f019c15a190 2023-10-09T08:17:10.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:10.786+0000 7f01a13ff700 1 -- 172.21.15.71:0/2961623995 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f019c069650 con 0x7f019c15a190 2023-10-09T08:17:11.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.202+0000 7f0182ffd700 1 -- 172.21.15.71:0/2961623995 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 100) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f0194051700 con 0x7f019c15a190 2023-10-09T08:17:11.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.203+0000 7f0182ffd700 1 --2- 172.21.15.71:0/2961623995 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f018806cb60 0x7f018806ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:11.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.205+0000 7f019affd700 1 --2- 172.21.15.71:0/2961623995 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f018806cb60 0x7f018806ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:11.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.211+0000 7f019affd700 1 --2- 172.21.15.71:0/2961623995 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f018806cb60 0x7f018806ef40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f019c0cf1c0 tx=0x7f018c017000 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:11.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.376+0000 7f0182ffd700 1 -- 172.21.15.71:0/2961623995 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v200) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0194070b60 con 0x7f019c15a190 2023-10-09T08:17:11.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.379+0000 7f01a13ff700 1 -- 172.21.15.71:0/2961623995 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f018806cb60 msgr2=0x7f018806ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:11.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.379+0000 7f01a13ff700 1 --2- 172.21.15.71:0/2961623995 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f018806cb60 0x7f018806ef40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f019c0cf1c0 tx=0x7f018c017000 comp rx=0 tx=0).stop 2023-10-09T08:17:11.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.380+0000 7f01a13ff700 1 -- 172.21.15.71:0/2961623995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f019c15a190 msgr2=0x7f019c0b14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:11.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.380+0000 7f01a13ff700 1 --2- 172.21.15.71:0/2961623995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f019c15a190 0x7f019c0b14e0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f0194007f20 tx=0x7f0194009860 comp rx=0 tx=0).stop 2023-10-09T08:17:11.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.380+0000 7f01a13ff700 1 -- 172.21.15.71:0/2961623995 shutdown_connections 2023-10-09T08:17:11.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.380+0000 7f01a13ff700 1 --2- 172.21.15.71:0/2961623995 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f018806cb60 0x7f018806ef40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:11.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.380+0000 7f01a13ff700 1 --2- 172.21.15.71:0/2961623995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f019c15a190 0x7f019c0b14e0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:11.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.380+0000 7f01a13ff700 1 --2- 172.21.15.71:0/2961623995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f019c153f50 0x7f019c145230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:11.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.380+0000 7f01a13ff700 1 --2- 172.21.15.71:0/2961623995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f019c154320 0x7f019c169fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:11.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.380+0000 7f01a13ff700 1 -- 172.21.15.71:0/2961623995 >> 172.21.15.71:0/2961623995 conn(0x7f019c06baf0 msgr2=0x7f019c0c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:11.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.380+0000 7f01a13ff700 1 -- 172.21.15.71:0/2961623995 shutdown_connections 2023-10-09T08:17:11.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.380+0000 7f01a13ff700 1 -- 172.21.15.71:0/2961623995 wait complete. 2023-10-09T08:17:11.382 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' removed 2023-10-09T08:17:11.399 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T08:17:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.587+0000 7f53d89ff700 1 Processor -- start 2023-10-09T08:17:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.587+0000 7f53d89ff700 1 -- start start 2023-10-09T08:17:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.588+0000 7f53d89ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f53d4069a50 0x7f53d40c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.588+0000 7f53d89ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d40ac030 con 0x7f53d40c8490 2023-10-09T08:17:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.588+0000 7f53d89ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d40ab820 con 0x7f53d4069e20 2023-10-09T08:17:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.588+0000 7f53d89ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d406dbb0 con 0x7f53d4069a50 2023-10-09T08:17:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.588+0000 7f53d1d9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f53d40c8490 0x7f53d415a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48522/0 (socket says 172.21.15.71:48522) 2023-10-09T08:17:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.589+0000 7f53d1d9b700 1 -- 172.21.15.71:0/1714979019 learned_addr learned my addr 172.21.15.71:0/1714979019 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.589+0000 7f53d259c700 1 --2- 172.21.15.71:0/1714979019 >> v2:172.21.15.179:3300/0 conn(0x7f53d4069a50 0x7f53d40c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.589+0000 7f53d159a700 1 -- 172.21.15.71:0/1714979019 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894622748 0 0) 0x7f53c8001110 con 0x7f53d40c8490 2023-10-09T08:17:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.589+0000 7f53d159a700 1 -- 172.21.15.71:0/1714979019 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53bc003570 con 0x7f53d40c8490 2023-10-09T08:17:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.589+0000 7f53d159a700 1 -- 172.21.15.71:0/1714979019 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1728563250 0 0) 0x7f53bc003570 con 0x7f53d40c8490 2023-10-09T08:17:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.589+0000 7f53d159a700 1 -- 172.21.15.71:0/1714979019 >> v2:172.21.15.179:3300/0 conn(0x7f53d4069a50 msgr2=0x7f53d40c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.589+0000 7f53d159a700 1 --2- 172.21.15.71:0/1714979019 >> v2:172.21.15.179:3300/0 conn(0x7f53d4069a50 0x7f53d40c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.589+0000 7f53d159a700 1 -- 172.21.15.71:0/1714979019 >> v1:172.21.15.179:6789/0 conn(0x7f53d4069e20 legacy=0x7f53d41569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.589+0000 7f53d159a700 1 -- 172.21.15.71:0/1714979019 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d40aba70 con 0x7f53d40c8490 2023-10-09T08:17:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.589+0000 7f53d159a700 1 -- 172.21.15.71:0/1714979019 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f53c8001600 con 0x7f53d40c8490 2023-10-09T08:17:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.589+0000 7f53d159a700 1 -- 172.21.15.71:0/1714979019 >> v1:172.21.15.71:6789/0 conn(0x7f53d40c8490 legacy=0x7f53d415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.589+0000 7f53d159a700 1 --2- 172.21.15.71:0/1714979019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53bc003ab0 0x7f53bc003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.589+0000 7f53d159a700 1 --2- 172.21.15.71:0/1714979019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53bc004810 0x7f53bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.589+0000 7f53d159a700 1 --2- 172.21.15.71:0/1714979019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53bc005210 0x7f53bc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.589+0000 7f53d159a700 1 -- 172.21.15.71:0/1714979019 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d406dbb0 con 0x7f53bc004810 2023-10-09T08:17:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.589+0000 7f53d159a700 1 -- 172.21.15.71:0/1714979019 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc00c1b0 con 0x7f53bc005210 2023-10-09T08:17:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.589+0000 7f53d159a700 1 -- 172.21.15.71:0/1714979019 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc00c370 con 0x7f53bc003ab0 2023-10-09T08:17:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.590+0000 7f53d1d9b700 1 --2- 172.21.15.71:0/1714979019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53bc004810 0x7f53bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.590+0000 7f53d259c700 1 --2- 172.21.15.71:0/1714979019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53bc003ab0 0x7f53bc003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.590+0000 7f53d2d9d700 1 --2- 172.21.15.71:0/1714979019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53bc005210 0x7f53bc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.590+0000 7f53d259c700 1 -- 172.21.15.71:0/1714979019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53bc005210 msgr2=0x7f53bc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.590+0000 7f53d259c700 1 --2- 172.21.15.71:0/1714979019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53bc005210 0x7f53bc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.590+0000 7f53d259c700 1 -- 172.21.15.71:0/1714979019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53bc004810 msgr2=0x7f53bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.590+0000 7f53d259c700 1 --2- 172.21.15.71:0/1714979019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53bc004810 0x7f53bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.590+0000 7f53d259c700 1 -- 172.21.15.71:0/1714979019 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53bc003570 con 0x7f53bc003ab0 2023-10-09T08:17:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.590+0000 7f53d1d9b700 1 --2- 172.21.15.71:0/1714979019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53bc004810 0x7f53bc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.590+0000 7f53d2d9d700 1 -- 172.21.15.71:0/1714979019 reap_dead start 2023-10-09T08:17:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.590+0000 7f53d259c700 1 --2- 172.21.15.71:0/1714979019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53bc003ab0 0x7f53bc003ec0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009c00 tx=0x7f53c40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2698c97857434f93 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.591+0000 7f53d159a700 1 -- 172.21.15.71:0/1714979019 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c400e710 con 0x7f53bc003ab0 2023-10-09T08:17:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.591+0000 7f53d159a700 1 -- 172.21.15.71:0/1714979019 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c400e870 con 0x7f53bc003ab0 2023-10-09T08:17:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.591+0000 7f53d159a700 1 -- 172.21.15.71:0/1714979019 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c400ec30 con 0x7f53bc003ab0 2023-10-09T08:17:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.591+0000 7f53d89ff700 1 -- 172.21.15.71:0/1714979019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53bc003ab0 msgr2=0x7f53bc003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.591+0000 7f53d89ff700 1 --2- 172.21.15.71:0/1714979019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53bc003ab0 0x7f53bc003ec0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009c00 tx=0x7f53c40091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.591+0000 7f53d89ff700 1 -- 172.21.15.71:0/1714979019 shutdown_connections 2023-10-09T08:17:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.591+0000 7f53d89ff700 1 --2- 172.21.15.71:0/1714979019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53bc003ab0 0x7f53bc003ec0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.591+0000 7f53d89ff700 1 -- 172.21.15.71:0/1714979019 >> 172.21.15.71:0/1714979019 conn(0x7f53d40c8f90 msgr2=0x7f53d40c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.591+0000 7f53d89ff700 1 -- 172.21.15.71:0/1714979019 shutdown_connections 2023-10-09T08:17:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.591+0000 7f53d89ff700 1 -- 172.21.15.71:0/1714979019 wait complete. 2023-10-09T08:17:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.593+0000 7f53d89ff700 1 Processor -- start 2023-10-09T08:17:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.593+0000 7f53d89ff700 1 -- start start 2023-10-09T08:17:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.594+0000 7f53d89ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53bc003ab0 0x7f53d4154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.594+0000 7f53d89ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53d40c3f20 0x7f53d40b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.594+0000 7f53d89ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d40c4390 0x7f53d40b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.594+0000 7f53d89ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d40b1b10 con 0x7f53d40c4390 2023-10-09T08:17:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.594+0000 7f53d89ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d41552b0 con 0x7f53bc003ab0 2023-10-09T08:17:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.594+0000 7f53d89ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d4158ab0 con 0x7f53d40c3f20 2023-10-09T08:17:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.594+0000 7f53d2d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d40c4390 0x7f53d40b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.594+0000 7f53d2d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d40c4390 0x7f53d40b0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56158/0 (socket says 172.21.15.71:56158) 2023-10-09T08:17:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.594+0000 7f53d2d9d700 1 -- 172.21.15.71:0/3501992866 learned_addr learned my addr 172.21.15.71:0/3501992866 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.594+0000 7f53d259c700 1 --2- 172.21.15.71:0/3501992866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53bc003ab0 0x7f53d4154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.594+0000 7f53d1d9b700 1 --2- 172.21.15.71:0/3501992866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53d40c3f20 0x7f53d40b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.594+0000 7f53d2d9d700 1 -- 172.21.15.71:0/3501992866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53d40c3f20 msgr2=0x7f53d40b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.594+0000 7f53d2d9d700 1 --2- 172.21.15.71:0/3501992866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53d40c3f20 0x7f53d40b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.594+0000 7f53d2d9d700 1 -- 172.21.15.71:0/3501992866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53bc003ab0 msgr2=0x7f53d4154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.594+0000 7f53d2d9d700 1 --2- 172.21.15.71:0/3501992866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53bc003ab0 0x7f53d4154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.594+0000 7f53d2d9d700 1 -- 172.21.15.71:0/3501992866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d4158d90 con 0x7f53d40c4390 2023-10-09T08:17:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.595+0000 7f53d2d9d700 1 --2- 172.21.15.71:0/3501992866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d40c4390 0x7f53d40b0f50 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f53d40c34c0 tx=0x7f53cc001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.595+0000 7f53c27fc700 1 -- 172.21.15.71:0/3501992866 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc006ba0 con 0x7f53d40c4390 2023-10-09T08:17:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.595+0000 7f53c27fc700 1 -- 172.21.15.71:0/3501992866 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc006d00 con 0x7f53d40c4390 2023-10-09T08:17:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.595+0000 7f53c27fc700 1 -- 172.21.15.71:0/3501992866 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc00c7f0 con 0x7f53d40c4390 2023-10-09T08:17:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.595+0000 7f53d89ff700 1 -- 172.21.15.71:0/3501992866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d40b17a0 con 0x7f53d40c4390 2023-10-09T08:17:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.595+0000 7f53d89ff700 1 -- 172.21.15.71:0/3501992866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d40b1fa0 con 0x7f53d40c4390 2023-10-09T08:17:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.596+0000 7f53d89ff700 1 -- 172.21.15.71:0/3501992866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d40b2190 con 0x7f53d40c4390 2023-10-09T08:17:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.597+0000 7f53c27fc700 1 -- 172.21.15.71:0/3501992866 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 100) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f53cc00cb60 con 0x7f53d40c4390 2023-10-09T08:17:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.598+0000 7f53c27fc700 1 --2- 172.21.15.71:0/3501992866 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f53b4066d80 0x7f53b4069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.598+0000 7f53c27fc700 1 -- 172.21.15.71:0/3501992866 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f53cc084260 con 0x7f53d40c4390 2023-10-09T08:17:11.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.598+0000 7f53d259c700 1 --2- 172.21.15.71:0/3501992866 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f53b4066d80 0x7f53b4069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:11.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.599+0000 7f53d259c700 1 --2- 172.21.15.71:0/3501992866 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f53b4066d80 0x7f53b4069230 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f53c40091e0 tx=0x7f53c401a000 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:11.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.602+0000 7f53c27fc700 1 -- 172.21.15.71:0/3501992866 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53cc051400 con 0x7f53d40c4390 2023-10-09T08:17:11.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:11.797+0000 7f53d89ff700 1 -- 172.21.15.71:0/3501992866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f53d40718b0 con 0x7f53d40c4390 2023-10-09T08:17:12.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.378+0000 7f53c27fc700 1 -- 172.21.15.71:0/3501992866 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v201) v1 ==== 169+0+0 (secure 0 0 0) 0x7f53cc054a20 con 0x7f53d40c4390 2023-10-09T08:17:12.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.382+0000 7f53d89ff700 1 -- 172.21.15.71:0/3501992866 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f53b4066d80 msgr2=0x7f53b4069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:12.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.382+0000 7f53d89ff700 1 --2- 172.21.15.71:0/3501992866 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f53b4066d80 0x7f53b4069230 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f53c40091e0 tx=0x7f53c401a000 comp rx=0 tx=0).stop 2023-10-09T08:17:12.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.382+0000 7f53d89ff700 1 -- 172.21.15.71:0/3501992866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d40c4390 msgr2=0x7f53d40b0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:12.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.382+0000 7f53d89ff700 1 --2- 172.21.15.71:0/3501992866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d40c4390 0x7f53d40b0f50 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f53d40c34c0 tx=0x7f53cc001640 comp rx=0 tx=0).stop 2023-10-09T08:17:12.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.382+0000 7f53d89ff700 1 -- 172.21.15.71:0/3501992866 shutdown_connections 2023-10-09T08:17:12.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.382+0000 7f53d89ff700 1 --2- 172.21.15.71:0/3501992866 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f53b4066d80 0x7f53b4069230 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:12.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.382+0000 7f53d89ff700 1 --2- 172.21.15.71:0/3501992866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d40c4390 0x7f53d40b0f50 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:12.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.382+0000 7f53d89ff700 1 --2- 172.21.15.71:0/3501992866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53bc003ab0 0x7f53d4154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:12.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.382+0000 7f53d89ff700 1 --2- 172.21.15.71:0/3501992866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53d40c3f20 0x7f53d40b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:12.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.382+0000 7f53d89ff700 1 -- 172.21.15.71:0/3501992866 >> 172.21.15.71:0/3501992866 conn(0x7f53d40c8f90 msgr2=0x7f53d4156c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:12.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.382+0000 7f53d89ff700 1 -- 172.21.15.71:0/3501992866 shutdown_connections 2023-10-09T08:17:12.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.382+0000 7f53d89ff700 1 -- 172.21.15.71:0/3501992866 wait complete. 2023-10-09T08:17:12.385 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' removed 2023-10-09T08:17:12.405 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T08:17:12.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.589+0000 7fafd4dff700 1 Processor -- start 2023-10-09T08:17:12.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.589+0000 7fafd4dff700 1 -- start start 2023-10-09T08:17:12.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.590+0000 7fafd4dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fafd00ccee0 0x7fafd01561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:12.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.590+0000 7fafd4dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd015b0d0 con 0x7fafd00c87c0 2023-10-09T08:17:12.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.590+0000 7fafd4dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd015a4c0 con 0x7fafd00c83f0 2023-10-09T08:17:12.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.590+0000 7fafd4dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd015a7a0 con 0x7fafd00ccee0 2023-10-09T08:17:12.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.591+0000 7fafced9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fafd00c87c0 0x7fafd00ca1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48534/0 (socket says 172.21.15.71:48534) 2023-10-09T08:17:12.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.591+0000 7fafced9d700 1 -- 172.21.15.71:0/158513659 learned_addr learned my addr 172.21.15.71:0/158513659 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:12.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.591+0000 7fafcd59a700 1 -- 172.21.15.71:0/158513659 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581576535 0 0) 0x7fafd015b0d0 con 0x7fafd00c87c0 2023-10-09T08:17:12.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.591+0000 7fafcd59a700 1 -- 172.21.15.71:0/158513659 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafb8003570 con 0x7fafd00c87c0 2023-10-09T08:17:12.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.591+0000 7fafcdd9b700 1 --2- 172.21.15.71:0/158513659 >> v2:172.21.15.179:3300/0 conn(0x7fafd00ccee0 0x7fafd01561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:12.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.591+0000 7fafcd59a700 1 -- 172.21.15.71:0/158513659 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 584880137 0 0) 0x7fafb8003570 con 0x7fafd00c87c0 2023-10-09T08:17:12.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.591+0000 7fafcd59a700 1 -- 172.21.15.71:0/158513659 >> v2:172.21.15.179:3300/0 conn(0x7fafd00ccee0 msgr2=0x7fafd01561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:12.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.591+0000 7fafcd59a700 1 --2- 172.21.15.71:0/158513659 >> v2:172.21.15.179:3300/0 conn(0x7fafd00ccee0 0x7fafd01561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:12.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.591+0000 7fafcd59a700 1 -- 172.21.15.71:0/158513659 >> v1:172.21.15.179:6789/0 conn(0x7fafd00c83f0 legacy=0x7fafd00c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:12.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.591+0000 7fafcd59a700 1 -- 172.21.15.71:0/158513659 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd015aa80 con 0x7fafd00c87c0 2023-10-09T08:17:12.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.591+0000 7fafcd59a700 1 -- 172.21.15.71:0/158513659 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fafc80017f0 con 0x7fafd00c87c0 2023-10-09T08:17:12.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.591+0000 7fafcd59a700 1 -- 172.21.15.71:0/158513659 >> v1:172.21.15.71:6789/0 conn(0x7fafd00c87c0 legacy=0x7fafd00ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:12.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.591+0000 7fafcd59a700 1 --2- 172.21.15.71:0/158513659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafb8003a60 0x7fafb8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:12.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.592+0000 7fafcd59a700 1 --2- 172.21.15.71:0/158513659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fafb8004810 0x7fafb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:12.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.592+0000 7fafcd59a700 1 --2- 172.21.15.71:0/158513659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafb80052e0 0x7fafb800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:12.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.592+0000 7fafcd59a700 1 -- 172.21.15.71:0/158513659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd015a7a0 con 0x7fafb80052e0 2023-10-09T08:17:12.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.592+0000 7fafcd59a700 1 -- 172.21.15.71:0/158513659 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb800c190 con 0x7fafb8003a60 2023-10-09T08:17:12.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.592+0000 7fafcd59a700 1 -- 172.21.15.71:0/158513659 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb800c350 con 0x7fafb8004810 2023-10-09T08:17:12.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.592+0000 7fafcdd9b700 1 --2- 172.21.15.71:0/158513659 >> v2:172.21.15.179:3300/0 conn(0x7fafd00ccee0 0x7fafd01561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:17:12.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.592+0000 7fafced9d700 1 --2- 172.21.15.71:0/158513659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafb80052e0 0x7fafb800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:12.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.592+0000 7fafce59c700 1 --2- 172.21.15.71:0/158513659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafb8003a60 0x7fafb8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:12.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.592+0000 7fafcdd9b700 1 --2- 172.21.15.71:0/158513659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fafb8004810 0x7fafb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:12.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.592+0000 7fafced9d700 1 -- 172.21.15.71:0/158513659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fafb8004810 msgr2=0x7fafb8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:12.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.592+0000 7fafced9d700 1 --2- 172.21.15.71:0/158513659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fafb8004810 0x7fafb8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:12.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.592+0000 7fafced9d700 1 -- 172.21.15.71:0/158513659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafb8003a60 msgr2=0x7fafb8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:12.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.592+0000 7fafced9d700 1 --2- 172.21.15.71:0/158513659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafb8003a60 0x7fafb8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:12.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.592+0000 7fafced9d700 1 -- 172.21.15.71:0/158513659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb8003570 con 0x7fafb80052e0 2023-10-09T08:17:12.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.592+0000 7fafce59c700 1 --2- 172.21.15.71:0/158513659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafb8003a60 0x7fafb8003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:17:12.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.592+0000 7fafced9d700 1 -- 172.21.15.71:0/158513659 reap_dead start 2023-10-09T08:17:12.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.592+0000 7fafced9d700 1 --2- 172.21.15.71:0/158513659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafb80052e0 0x7fafb800ba60 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fafc800a930 tx=0x7fafc80021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1389fb734451df server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:12.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.593+0000 7fafcd59a700 1 -- 172.21.15.71:0/158513659 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc80070d0 con 0x7fafb80052e0 2023-10-09T08:17:12.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.593+0000 7fafcd59a700 1 -- 172.21.15.71:0/158513659 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc8007230 con 0x7fafb80052e0 2023-10-09T08:17:12.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.593+0000 7fafcd59a700 1 -- 172.21.15.71:0/158513659 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc80075d0 con 0x7fafb80052e0 2023-10-09T08:17:12.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.593+0000 7fafd4dff700 1 -- 172.21.15.71:0/158513659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafb80052e0 msgr2=0x7fafb800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:12.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.593+0000 7fafd4dff700 1 --2- 172.21.15.71:0/158513659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafb80052e0 0x7fafb800ba60 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fafc800a930 tx=0x7fafc80021d0 comp rx=0 tx=0).stop 2023-10-09T08:17:12.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.593+0000 7fafd4dff700 1 -- 172.21.15.71:0/158513659 shutdown_connections 2023-10-09T08:17:12.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.593+0000 7fafd4dff700 1 --2- 172.21.15.71:0/158513659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafb80052e0 0x7fafb800ba60 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:12.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.593+0000 7fafd4dff700 1 -- 172.21.15.71:0/158513659 >> 172.21.15.71:0/158513659 conn(0x7fafd0068e10 msgr2=0x7fafd00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:12.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.593+0000 7fafd4dff700 1 -- 172.21.15.71:0/158513659 shutdown_connections 2023-10-09T08:17:12.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.593+0000 7fafd4dff700 1 -- 172.21.15.71:0/158513659 wait complete. 2023-10-09T08:17:12.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.595+0000 7fafd4dff700 1 Processor -- start 2023-10-09T08:17:12.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.595+0000 7fafd4dff700 1 -- start start 2023-10-09T08:17:12.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.596+0000 7fafd4dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafb80052e0 0x7fafd0150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:12.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.596+0000 7fafd4dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fafd016c320 0x7fafd00c3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:12.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.596+0000 7fafd4dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafd00c43c0 0x7fafd0154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:12.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.596+0000 7fafd4dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd016be90 con 0x7fafb80052e0 2023-10-09T08:17:12.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.596+0000 7fafd4dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd00c48d0 con 0x7fafd00c43c0 2023-10-09T08:17:12.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.596+0000 7fafd4dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd016b840 con 0x7fafd016c320 2023-10-09T08:17:12.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.596+0000 7fafce59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafb80052e0 0x7fafd0150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:12.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.596+0000 7fafce59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafb80052e0 0x7fafd0150250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56182/0 (socket says 172.21.15.71:56182) 2023-10-09T08:17:12.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.596+0000 7fafce59c700 1 -- 172.21.15.71:0/4015360601 learned_addr learned my addr 172.21.15.71:0/4015360601 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:12.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.596+0000 7fafced9d700 1 --2- 172.21.15.71:0/4015360601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafd00c43c0 0x7fafd0154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:12.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.596+0000 7fafcdd9b700 1 --2- 172.21.15.71:0/4015360601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fafd016c320 0x7fafd00c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:12.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.596+0000 7fafce59c700 1 -- 172.21.15.71:0/4015360601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fafd016c320 msgr2=0x7fafd00c3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:12.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.596+0000 7fafce59c700 1 --2- 172.21.15.71:0/4015360601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fafd016c320 0x7fafd00c3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:12.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.596+0000 7fafce59c700 1 -- 172.21.15.71:0/4015360601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafd00c43c0 msgr2=0x7fafd0154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:12.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.596+0000 7fafce59c700 1 --2- 172.21.15.71:0/4015360601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafd00c43c0 0x7fafd0154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:12.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.596+0000 7fafce59c700 1 -- 172.21.15.71:0/4015360601 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd016bb20 con 0x7fafb80052e0 2023-10-09T08:17:12.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.596+0000 7fafce59c700 1 --2- 172.21.15.71:0/4015360601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafb80052e0 0x7fafd0150250 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fafc000e780 tx=0x7fafc0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:12.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.597+0000 7fafbe7fc700 1 -- 172.21.15.71:0/4015360601 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc0010490 con 0x7fafb80052e0 2023-10-09T08:17:12.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.597+0000 7fafbe7fc700 1 -- 172.21.15.71:0/4015360601 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc0010040 con 0x7fafb80052e0 2023-10-09T08:17:12.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.597+0000 7fafbe7fc700 1 -- 172.21.15.71:0/4015360601 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc0010840 con 0x7fafb80052e0 2023-10-09T08:17:12.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.597+0000 7fafd4dff700 1 -- 172.21.15.71:0/4015360601 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd014ea10 con 0x7fafb80052e0 2023-10-09T08:17:12.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.597+0000 7fafd4dff700 1 -- 172.21.15.71:0/4015360601 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd0150950 con 0x7fafb80052e0 2023-10-09T08:17:12.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.598+0000 7fafd4dff700 1 -- 172.21.15.71:0/4015360601 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd016c170 con 0x7fafb80052e0 2023-10-09T08:17:12.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.599+0000 7fafbe7fc700 1 -- 172.21.15.71:0/4015360601 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fafc0010bb0 con 0x7fafb80052e0 2023-10-09T08:17:12.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.599+0000 7fafbe7fc700 1 --2- 172.21.15.71:0/4015360601 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fafb0066f30 0x7fafb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:12.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.599+0000 7fafbe7fc700 1 -- 172.21.15.71:0/4015360601 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5975+0+0 (secure 0 0 0) 0x7fafc0083a60 con 0x7fafb80052e0 2023-10-09T08:17:12.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.600+0000 7fafcdd9b700 1 --2- 172.21.15.71:0/4015360601 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fafb0066f30 0x7fafb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:12.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.600+0000 7fafcdd9b700 1 --2- 172.21.15.71:0/4015360601 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fafb0066f30 0x7fafb00693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fafd00b0290 tx=0x7fafc400b040 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:12.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.603+0000 7fafbe7fc700 1 -- 172.21.15.71:0/4015360601 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fafc004d5a0 con 0x7fafb80052e0 2023-10-09T08:17:12.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.795+0000 7fafd4dff700 1 -- 172.21.15.71:0/4015360601 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fafd016b6a0 con 0x7fafb80052e0 2023-10-09T08:17:12.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.800+0000 7fafbe7fc700 1 -- 172.21.15.71:0/4015360601 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v67) v1 ==== 104+0+0 (secure 0 0 0) 0x7fafd016b6a0 con 0x7fafb80052e0 2023-10-09T08:17:12.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.802+0000 7fafd4dff700 1 -- 172.21.15.71:0/4015360601 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fafb0066f30 msgr2=0x7fafb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:12.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.802+0000 7fafd4dff700 1 --2- 172.21.15.71:0/4015360601 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fafb0066f30 0x7fafb00693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fafd00b0290 tx=0x7fafc400b040 comp rx=0 tx=0).stop 2023-10-09T08:17:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.802+0000 7fafd4dff700 1 -- 172.21.15.71:0/4015360601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafb80052e0 msgr2=0x7fafd0150250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.802+0000 7fafd4dff700 1 --2- 172.21.15.71:0/4015360601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafb80052e0 0x7fafd0150250 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fafc000e780 tx=0x7fafc0009040 comp rx=0 tx=0).stop 2023-10-09T08:17:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.802+0000 7fafd4dff700 1 -- 172.21.15.71:0/4015360601 shutdown_connections 2023-10-09T08:17:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.802+0000 7fafd4dff700 1 --2- 172.21.15.71:0/4015360601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafd00c43c0 0x7fafd0154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.802+0000 7fafd4dff700 1 --2- 172.21.15.71:0/4015360601 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fafb0066f30 0x7fafb00693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.802+0000 7fafd4dff700 1 --2- 172.21.15.71:0/4015360601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafb80052e0 0x7fafd0150250 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.802+0000 7fafd4dff700 1 --2- 172.21.15.71:0/4015360601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fafd016c320 0x7fafd00c3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.802+0000 7fafd4dff700 1 -- 172.21.15.71:0/4015360601 >> 172.21.15.71:0/4015360601 conn(0x7fafd0068e10 msgr2=0x7fafd0151ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.802+0000 7fafd4dff700 1 -- 172.21.15.71:0/4015360601 shutdown_connections 2023-10-09T08:17:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:12.802+0000 7fafd4dff700 1 -- 172.21.15.71:0/4015360601 wait complete. 2023-10-09T08:17:12.821 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-09T08:17:13.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.010+0000 7f73955ff700 1 Processor -- start 2023-10-09T08:17:13.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.010+0000 7f73955ff700 1 -- start start 2023-10-09T08:17:13.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.011+0000 7f73955ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73900c70b0 0x7f7390069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:13.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.011+0000 7f73955ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7390069cb0 0x7f73900ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:13.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.011+0000 7f73955ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f739006e950 con 0x7f7390155eb0 2023-10-09T08:17:13.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.011+0000 7f73955ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739006a130 con 0x7f7390069cb0 2023-10-09T08:17:13.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.011+0000 7f73955ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739006eb90 con 0x7f73900c70b0 2023-10-09T08:17:13.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.011+0000 7f738effd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f7390155eb0 0x7f739006e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48550/0 (socket says 172.21.15.71:48550) 2023-10-09T08:17:13.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.012+0000 7f738effd700 1 -- 172.21.15.71:0/3851760091 learned_addr learned my addr 172.21.15.71:0/3851760091 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:13.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.012+0000 7f738e7fc700 1 --2- 172.21.15.71:0/3851760091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73900c70b0 0x7f7390069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:13.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.012+0000 7f738f7fe700 1 --2- 172.21.15.71:0/3851760091 >> v2:172.21.15.179:3300/0 conn(0x7f7390069cb0 0x7f73900ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:13.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.012+0000 7f738dffb700 1 -- 172.21.15.71:0/3851760091 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117301881 0 0) 0x7f7380001110 con 0x7f7390155eb0 2023-10-09T08:17:13.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.012+0000 7f738dffb700 1 -- 172.21.15.71:0/3851760091 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7378003570 con 0x7f7390155eb0 2023-10-09T08:17:13.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.012+0000 7f738e7fc700 1 -- 172.21.15.71:0/3851760091 >> v2:172.21.15.179:3300/0 conn(0x7f7390069cb0 msgr2=0x7f73900ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:13.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.012+0000 7f738e7fc700 1 --2- 172.21.15.71:0/3851760091 >> v2:172.21.15.179:3300/0 conn(0x7f7390069cb0 0x7f73900ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.012+0000 7f738e7fc700 1 -- 172.21.15.71:0/3851760091 >> v1:172.21.15.71:6789/0 conn(0x7f7390155eb0 legacy=0x7f739006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:13.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.012+0000 7f738dffb700 1 -- 172.21.15.71:0/3851760091 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1733292253 0 0) 0x7f7378003570 con 0x7f7390155eb0 2023-10-09T08:17:13.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.012+0000 7f738e7fc700 1 -- 172.21.15.71:0/3851760091 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739006ee70 con 0x7f73900c70b0 2023-10-09T08:17:13.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.012+0000 7f738f7fe700 1 --2- 172.21.15.71:0/3851760091 >> v2:172.21.15.179:3300/0 conn(0x7f7390069cb0 0x7f73900ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:13.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.013+0000 7f738e7fc700 1 --2- 172.21.15.71:0/3851760091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73900c70b0 0x7f7390069770 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f73840098e0 tx=0x7f73840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d73cf411e8873079 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:13.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.013+0000 7f738dffb700 1 -- 172.21.15.71:0/3851760091 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7380001600 con 0x7f73900c70b0 2023-10-09T08:17:13.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.013+0000 7f738dffb700 1 -- 172.21.15.71:0/3851760091 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7384011420 con 0x7f73900c70b0 2023-10-09T08:17:13.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.013+0000 7f738dffb700 1 -- 172.21.15.71:0/3851760091 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73840117a0 con 0x7f73900c70b0 2023-10-09T08:17:13.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.013+0000 7f73955ff700 1 -- 172.21.15.71:0/3851760091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73900c70b0 msgr2=0x7f7390069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:13.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.013+0000 7f73955ff700 1 --2- 172.21.15.71:0/3851760091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73900c70b0 0x7f7390069770 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f73840098e0 tx=0x7f73840091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.014+0000 7f73955ff700 1 -- 172.21.15.71:0/3851760091 shutdown_connections 2023-10-09T08:17:13.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.014+0000 7f73955ff700 1 --2- 172.21.15.71:0/3851760091 >> v2:172.21.15.179:3300/0 conn(0x7f7390069cb0 0x7f73900ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.014+0000 7f73955ff700 1 --2- 172.21.15.71:0/3851760091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73900c70b0 0x7f7390069770 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.014+0000 7f73955ff700 1 -- 172.21.15.71:0/3851760091 >> 172.21.15.71:0/3851760091 conn(0x7f7390068e10 msgr2=0x7f73900cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:13.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.014+0000 7f73955ff700 1 -- 172.21.15.71:0/3851760091 shutdown_connections 2023-10-09T08:17:13.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.014+0000 7f73955ff700 1 -- 172.21.15.71:0/3851760091 wait complete. 2023-10-09T08:17:13.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.015+0000 7f73955ff700 1 Processor -- start 2023-10-09T08:17:13.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.015+0000 7f73955ff700 1 -- start start 2023-10-09T08:17:13.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.016+0000 7f73955ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7390069cb0 0x7f73900c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:13.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.016+0000 7f73955ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73900c70b0 0x7f739016e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:13.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.016+0000 7f73955ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7390155eb0 0x7f73900ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:13.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.016+0000 7f73955ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739016ea40 con 0x7f7390069cb0 2023-10-09T08:17:13.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.016+0000 7f73955ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73900c53b0 con 0x7f73900c70b0 2023-10-09T08:17:13.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.016+0000 7f73955ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73900c5690 con 0x7f7390155eb0 2023-10-09T08:17:13.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.016+0000 7f738effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7390069cb0 0x7f73900c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:13.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.016+0000 7f738effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7390069cb0 0x7f73900c4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56196/0 (socket says 172.21.15.71:56196) 2023-10-09T08:17:13.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.016+0000 7f738effd700 1 -- 172.21.15.71:0/620168048 learned_addr learned my addr 172.21.15.71:0/620168048 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:13.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.016+0000 7f738e7fc700 1 --2- 172.21.15.71:0/620168048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73900c70b0 0x7f739016e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:13.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.016+0000 7f738f7fe700 1 --2- 172.21.15.71:0/620168048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7390155eb0 0x7f73900ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:13.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.017+0000 7f738effd700 1 -- 172.21.15.71:0/620168048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7390155eb0 msgr2=0x7f73900ad370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:13.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.017+0000 7f738effd700 1 --2- 172.21.15.71:0/620168048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7390155eb0 0x7f73900ad370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.017+0000 7f738effd700 1 -- 172.21.15.71:0/620168048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73900c70b0 msgr2=0x7f739016e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:13.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.017+0000 7f738effd700 1 --2- 172.21.15.71:0/620168048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73900c70b0 0x7f739016e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.017+0000 7f738effd700 1 -- 172.21.15.71:0/620168048 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7388009a20 con 0x7f7390069cb0 2023-10-09T08:17:13.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.017+0000 7f738effd700 1 --2- 172.21.15.71:0/620168048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7390069cb0 0x7f73900c4340 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f738000cb90 tx=0x7f7380000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:13.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.017+0000 7f7376ffd700 1 -- 172.21.15.71:0/620168048 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7380007e90 con 0x7f7390069cb0 2023-10-09T08:17:13.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.017+0000 7f7376ffd700 1 -- 172.21.15.71:0/620168048 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7380007360 con 0x7f7390069cb0 2023-10-09T08:17:13.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.017+0000 7f7376ffd700 1 -- 172.21.15.71:0/620168048 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7380004830 con 0x7f7390069cb0 2023-10-09T08:17:13.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.017+0000 7f73955ff700 1 -- 172.21.15.71:0/620168048 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7384009420 con 0x7f7390069cb0 2023-10-09T08:17:13.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.017+0000 7f73955ff700 1 -- 172.21.15.71:0/620168048 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73900c5c50 con 0x7f7390069cb0 2023-10-09T08:17:13.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.018+0000 7f73955ff700 1 -- 172.21.15.71:0/620168048 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73900cd310 con 0x7f7390069cb0 2023-10-09T08:17:13.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.019+0000 7f7376ffd700 1 -- 172.21.15.71:0/620168048 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7380004c20 con 0x7f7390069cb0 2023-10-09T08:17:13.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.020+0000 7f7376ffd700 1 --2- 172.21.15.71:0/620168048 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f737c066f30 0x7f737c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:13.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.020+0000 7f7376ffd700 1 -- 172.21.15.71:0/620168048 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5975+0+0 (secure 0 0 0) 0x7f7380083e80 con 0x7f7390069cb0 2023-10-09T08:17:13.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.021+0000 7f738e7fc700 1 --2- 172.21.15.71:0/620168048 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f737c066f30 0x7f737c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:13.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.021+0000 7f738e7fc700 1 --2- 172.21.15.71:0/620168048 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f737c066f30 0x7f737c0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7384003080 tx=0x7f7384016000 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:13.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.024+0000 7f7376ffd700 1 -- 172.21.15.71:0/620168048 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7380050fc0 con 0x7f7390069cb0 2023-10-09T08:17:13.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.216+0000 7f73955ff700 1 -- 172.21.15.71:0/620168048 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f739006e930 con 0x7f7390069cb0 2023-10-09T08:17:13.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.219+0000 7f7376ffd700 1 -- 172.21.15.71:0/620168048 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v68) v1 ==== 115+0+0 (secure 0 0 0) 0x7f7380018020 con 0x7f7390069cb0 2023-10-09T08:17:13.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.222+0000 7f73955ff700 1 -- 172.21.15.71:0/620168048 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f737c066f30 msgr2=0x7f737c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:13.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.222+0000 7f73955ff700 1 --2- 172.21.15.71:0/620168048 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f737c066f30 0x7f737c0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7384003080 tx=0x7f7384016000 comp rx=0 tx=0).stop 2023-10-09T08:17:13.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.222+0000 7f73955ff700 1 -- 172.21.15.71:0/620168048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7390069cb0 msgr2=0x7f73900c4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:13.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.222+0000 7f73955ff700 1 --2- 172.21.15.71:0/620168048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7390069cb0 0x7f73900c4340 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f738000cb90 tx=0x7f7380000ed0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.222+0000 7f73955ff700 1 -- 172.21.15.71:0/620168048 shutdown_connections 2023-10-09T08:17:13.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.222+0000 7f73955ff700 1 --2- 172.21.15.71:0/620168048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7390155eb0 0x7f73900ad370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.222+0000 7f73955ff700 1 --2- 172.21.15.71:0/620168048 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f737c066f30 0x7f737c0693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.222+0000 7f73955ff700 1 --2- 172.21.15.71:0/620168048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7390069cb0 0x7f73900c4340 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.222+0000 7f73955ff700 1 --2- 172.21.15.71:0/620168048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73900c70b0 0x7f739016e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.222+0000 7f73955ff700 1 -- 172.21.15.71:0/620168048 >> 172.21.15.71:0/620168048 conn(0x7f7390068e10 msgr2=0x7f7390154e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:13.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.222+0000 7f73955ff700 1 -- 172.21.15.71:0/620168048 shutdown_connections 2023-10-09T08:17:13.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.222+0000 7f73955ff700 1 -- 172.21.15.71:0/620168048 wait complete. 2023-10-09T08:17:13.242 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-09T08:17:13.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.424+0000 7f54ae1ff700 1 Processor -- start 2023-10-09T08:17:13.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.424+0000 7f54ae1ff700 1 -- start start 2023-10-09T08:17:13.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.426+0000 7f54ae1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f54a80c83f0 0x7f54a80c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:13.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.426+0000 7f54ae1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54a81568e0 0x7f54a80ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:13.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.426+0000 7f54ae1ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a815b0d0 con 0x7f54a80ccee0 2023-10-09T08:17:13.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.426+0000 7f54ae1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a80c7a60 con 0x7f54a80c83f0 2023-10-09T08:17:13.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.426+0000 7f54ae1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a815a4c0 con 0x7f54a81568e0 2023-10-09T08:17:13.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.426+0000 7f549ffff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f54a80ccee0 0x7f54a81561d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48552/0 (socket says 172.21.15.71:48552) 2023-10-09T08:17:13.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.426+0000 7f549ffff700 1 -- 172.21.15.71:0/2484754050 learned_addr learned my addr 172.21.15.71:0/2484754050 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:13.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.426+0000 7f54a77fe700 1 --2- 172.21.15.71:0/2484754050 >> v2:172.21.15.179:3300/0 conn(0x7f54a80c83f0 0x7f54a80c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:13.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.426+0000 7f54a7fff700 1 --2- 172.21.15.71:0/2484754050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54a81568e0 0x7f54a80ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:13.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.426+0000 7f54a6ffd700 1 -- 172.21.15.71:0/2484754050 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060091139 0 0) 0x7f54a815b0d0 con 0x7f54a80ccee0 2023-10-09T08:17:13.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.426+0000 7f54a6ffd700 1 -- 172.21.15.71:0/2484754050 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5494003570 con 0x7f54a80ccee0 2023-10-09T08:17:13.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.427+0000 7f54a6ffd700 1 -- 172.21.15.71:0/2484754050 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1342613675 0 0) 0x7f5494003570 con 0x7f54a80ccee0 2023-10-09T08:17:13.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.427+0000 7f54a6ffd700 1 -- 172.21.15.71:0/2484754050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54a81568e0 msgr2=0x7f54a80ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:13.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.427+0000 7f54a6ffd700 1 --2- 172.21.15.71:0/2484754050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54a81568e0 0x7f54a80ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.427+0000 7f54a6ffd700 1 -- 172.21.15.71:0/2484754050 >> v2:172.21.15.179:3300/0 conn(0x7f54a80c83f0 msgr2=0x7f54a80c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:13.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.427+0000 7f54a6ffd700 1 --2- 172.21.15.71:0/2484754050 >> v2:172.21.15.179:3300/0 conn(0x7f54a80c83f0 0x7f54a80c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.427+0000 7f54a6ffd700 1 -- 172.21.15.71:0/2484754050 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a815a7a0 con 0x7f54a80ccee0 2023-10-09T08:17:13.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.427+0000 7f54a6ffd700 1 -- 172.21.15.71:0/2484754050 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f5490001470 con 0x7f54a80ccee0 2023-10-09T08:17:13.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.427+0000 7f54a6ffd700 1 -- 172.21.15.71:0/2484754050 >> v1:172.21.15.71:6789/0 conn(0x7f54a80ccee0 legacy=0x7f54a81561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:13.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.427+0000 7f54a6ffd700 1 --2- 172.21.15.71:0/2484754050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5494003a60 0x7f5494003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:13.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.427+0000 7f54a6ffd700 1 --2- 172.21.15.71:0/2484754050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5494004810 0x7f5494004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:13.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.427+0000 7f54a6ffd700 1 --2- 172.21.15.71:0/2484754050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54a81568e0 0x7f54940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:13.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.427+0000 7f54a6ffd700 1 -- 172.21.15.71:0/2484754050 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a80c7a60 con 0x7f5494003a60 2023-10-09T08:17:13.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.427+0000 7f54a6ffd700 1 -- 172.21.15.71:0/2484754050 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a815a4c0 con 0x7f5494004810 2023-10-09T08:17:13.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.427+0000 7f54a6ffd700 1 -- 172.21.15.71:0/2484754050 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549400dc70 con 0x7f54a81568e0 2023-10-09T08:17:13.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.427+0000 7f54a77fe700 1 --2- 172.21.15.71:0/2484754050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5494003a60 0x7f5494003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:13.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.427+0000 7f549ffff700 1 --2- 172.21.15.71:0/2484754050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5494004810 0x7f5494004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:13.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.427+0000 7f54a7fff700 1 --2- 172.21.15.71:0/2484754050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54a81568e0 0x7f54940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:13.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.428+0000 7f54a77fe700 1 -- 172.21.15.71:0/2484754050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54a81568e0 msgr2=0x7f54940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:13.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.428+0000 7f54a77fe700 1 --2- 172.21.15.71:0/2484754050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54a81568e0 0x7f54940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.428+0000 7f54a77fe700 1 -- 172.21.15.71:0/2484754050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5494004810 msgr2=0x7f5494004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:13.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.428+0000 7f54a77fe700 1 --2- 172.21.15.71:0/2484754050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5494004810 0x7f5494004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.428+0000 7f54a77fe700 1 -- 172.21.15.71:0/2484754050 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5494003570 con 0x7f5494003a60 2023-10-09T08:17:13.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.428+0000 7f54a77fe700 1 --2- 172.21.15.71:0/2484754050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5494003a60 0x7f5494003e70 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f5498009c30 tx=0x7f54980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a0e78280fc64bd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:13.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.428+0000 7f54a6ffd700 1 -- 172.21.15.71:0/2484754050 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549800e710 con 0x7f5494003a60 2023-10-09T08:17:13.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.428+0000 7f54a6ffd700 1 -- 172.21.15.71:0/2484754050 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549800e870 con 0x7f5494003a60 2023-10-09T08:17:13.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.428+0000 7f54a6ffd700 1 -- 172.21.15.71:0/2484754050 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549800ec30 con 0x7f5494003a60 2023-10-09T08:17:13.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.428+0000 7f54ae1ff700 1 -- 172.21.15.71:0/2484754050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5494003a60 msgr2=0x7f5494003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:13.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.428+0000 7f54ae1ff700 1 --2- 172.21.15.71:0/2484754050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5494003a60 0x7f5494003e70 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f5498009c30 tx=0x7f54980091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.429+0000 7f54a7fff700 1 -- 172.21.15.71:0/2484754050 reap_dead start 2023-10-09T08:17:13.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.429+0000 7f54ae1ff700 1 -- 172.21.15.71:0/2484754050 shutdown_connections 2023-10-09T08:17:13.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.429+0000 7f54ae1ff700 1 -- 172.21.15.71:0/2484754050 >> 172.21.15.71:0/2484754050 conn(0x7f54a8068e10 msgr2=0x7f54a80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:13.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.429+0000 7f54ae1ff700 1 -- 172.21.15.71:0/2484754050 shutdown_connections 2023-10-09T08:17:13.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.429+0000 7f54ae1ff700 1 -- 172.21.15.71:0/2484754050 wait complete. 2023-10-09T08:17:13.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.430+0000 7f54ae1ff700 1 Processor -- start 2023-10-09T08:17:13.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.430+0000 7f54ae1ff700 1 -- start start 2023-10-09T08:17:13.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.431+0000 7f54ae1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5494003a60 0x7f54a80b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:13.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.431+0000 7f54ae1ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54a80c5640 0x7f54a816a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:13.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.431+0000 7f54ae1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54a80c35e0 0x7f54a80c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:13.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.431+0000 7f54ae1ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a814e840 con 0x7f54a80c5640 2023-10-09T08:17:13.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.431+0000 7f54ae1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a80c3fc0 con 0x7f54a80c35e0 2023-10-09T08:17:13.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.431+0000 7f54ae1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a80b1c70 con 0x7f5494003a60 2023-10-09T08:17:13.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.431+0000 7f549ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54a80c5640 0x7f54a816a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:13.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.431+0000 7f549ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54a80c5640 0x7f54a816a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56212/0 (socket says 172.21.15.71:56212) 2023-10-09T08:17:13.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.431+0000 7f549ffff700 1 -- 172.21.15.71:0/2558906875 learned_addr learned my addr 172.21.15.71:0/2558906875 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:13.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.432+0000 7f54a77fe700 1 --2- 172.21.15.71:0/2558906875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5494003a60 0x7f54a80b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:13.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.432+0000 7f54a7fff700 1 --2- 172.21.15.71:0/2558906875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54a80c35e0 0x7f54a80c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:13.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.432+0000 7f549ffff700 1 -- 172.21.15.71:0/2558906875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5494003a60 msgr2=0x7f54a80b1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:13.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.432+0000 7f549ffff700 1 --2- 172.21.15.71:0/2558906875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5494003a60 0x7f54a80b1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.432+0000 7f549ffff700 1 -- 172.21.15.71:0/2558906875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54a80c35e0 msgr2=0x7f54a80c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:13.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.432+0000 7f549ffff700 1 --2- 172.21.15.71:0/2558906875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54a80c35e0 0x7f54a80c3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.432+0000 7f549ffff700 1 -- 172.21.15.71:0/2558906875 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a816acd0 con 0x7f54a80c5640 2023-10-09T08:17:13.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.432+0000 7f549ffff700 1 --2- 172.21.15.71:0/2558906875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54a80c5640 0x7f54a816a790 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f549000e960 tx=0x7f5490001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:13.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.432+0000 7f549f7fe700 1 -- 172.21.15.71:0/2558906875 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549000c700 con 0x7f54a80c5640 2023-10-09T08:17:13.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.432+0000 7f549f7fe700 1 -- 172.21.15.71:0/2558906875 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549000c860 con 0x7f54a80c5640 2023-10-09T08:17:13.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.432+0000 7f54ae1ff700 1 -- 172.21.15.71:0/2558906875 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a81596b0 con 0x7f54a80c5640 2023-10-09T08:17:13.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.432+0000 7f549f7fe700 1 -- 172.21.15.71:0/2558906875 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549000cc20 con 0x7f54a80c5640 2023-10-09T08:17:13.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.432+0000 7f54ae1ff700 1 -- 172.21.15.71:0/2558906875 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a80c61c0 con 0x7f54a80c5640 2023-10-09T08:17:13.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.433+0000 7f54ae1ff700 1 -- 172.21.15.71:0/2558906875 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a804c3c0 con 0x7f54a80c5640 2023-10-09T08:17:13.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.434+0000 7f549f7fe700 1 -- 172.21.15.71:0/2558906875 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5490013630 con 0x7f54a80c5640 2023-10-09T08:17:13.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.435+0000 7f549f7fe700 1 --2- 172.21.15.71:0/2558906875 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5488066f60 0x7f5488069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:13.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.435+0000 7f549f7fe700 1 -- 172.21.15.71:0/2558906875 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5975+0+0 (secure 0 0 0) 0x7f54900846c0 con 0x7f54a80c5640 2023-10-09T08:17:13.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.435+0000 7f54a77fe700 1 --2- 172.21.15.71:0/2558906875 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5488066f60 0x7f5488069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:13.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.436+0000 7f54a77fe700 1 --2- 172.21.15.71:0/2558906875 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5488066f60 0x7f5488069410 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f54a806d2c0 tx=0x7f549801a000 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:13.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.439+0000 7f549f7fe700 1 -- 172.21.15.71:0/2558906875 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5490051780 con 0x7f54a80c5640 2023-10-09T08:17:13.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.628+0000 7f54ae1ff700 1 -- 172.21.15.71:0/2558906875 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f54a815aa80 con 0x7f54a80c5640 2023-10-09T08:17:13.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.632+0000 7f549f7fe700 1 -- 172.21.15.71:0/2558906875 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v69) v1 ==== 120+0+0 (secure 0 0 0) 0x7f5490054da0 con 0x7f54a80c5640 2023-10-09T08:17:13.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.635+0000 7f54ae1ff700 1 -- 172.21.15.71:0/2558906875 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5488066f60 msgr2=0x7f5488069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:13.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.635+0000 7f54ae1ff700 1 --2- 172.21.15.71:0/2558906875 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5488066f60 0x7f5488069410 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f54a806d2c0 tx=0x7f549801a000 comp rx=0 tx=0).stop 2023-10-09T08:17:13.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.635+0000 7f54ae1ff700 1 -- 172.21.15.71:0/2558906875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54a80c5640 msgr2=0x7f54a816a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:13.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.635+0000 7f54ae1ff700 1 --2- 172.21.15.71:0/2558906875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54a80c5640 0x7f54a816a790 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f549000e960 tx=0x7f5490001df0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.635+0000 7f54ae1ff700 1 -- 172.21.15.71:0/2558906875 shutdown_connections 2023-10-09T08:17:13.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.635+0000 7f54ae1ff700 1 --2- 172.21.15.71:0/2558906875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54a80c35e0 0x7f54a80c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.635+0000 7f54ae1ff700 1 --2- 172.21.15.71:0/2558906875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5494003a60 0x7f54a80b1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.635+0000 7f54ae1ff700 1 --2- 172.21.15.71:0/2558906875 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5488066f60 0x7f5488069410 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.635+0000 7f54ae1ff700 1 --2- 172.21.15.71:0/2558906875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54a80c5640 0x7f54a816a790 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.635+0000 7f54ae1ff700 1 -- 172.21.15.71:0/2558906875 >> 172.21.15.71:0/2558906875 conn(0x7f54a8068e10 msgr2=0x7f54a814ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:13.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.635+0000 7f54ae1ff700 1 -- 172.21.15.71:0/2558906875 shutdown_connections 2023-10-09T08:17:13.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.635+0000 7f54ae1ff700 1 -- 172.21.15.71:0/2558906875 wait complete. 2023-10-09T08:17:13.654 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-10-09T08:17:13.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.834+0000 7fced0f9d700 1 Processor -- start 2023-10-09T08:17:13.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.834+0000 7fced0f9d700 1 -- start start 2023-10-09T08:17:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.835+0000 7fced0f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcecc0c6d00 0x7fcecc0c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.835+0000 7fced0f9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcecc06e730 0x7fcecc06ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.835+0000 7fced0f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcecc06e2a0 con 0x7fcecc157770 2023-10-09T08:17:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.835+0000 7fced0f9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcecc157b40 con 0x7fcecc06e730 2023-10-09T08:17:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.835+0000 7fced0f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc0c7690 con 0x7fcecc0c6d00 2023-10-09T08:17:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.835+0000 7fcecbfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcecc06e730 0x7fcecc06ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.835+0000 7fcecbfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcecc06e730 0x7fcecc06ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56214/0 (socket says 172.21.15.71:56214) 2023-10-09T08:17:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.835+0000 7fcecbfff700 1 -- 172.21.15.71:0/918991071 learned_addr learned my addr 172.21.15.71:0/918991071 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.836+0000 7fcecaffd700 1 --2- 172.21.15.71:0/918991071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcecc0c6d00 0x7fcecc0c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.836+0000 7fcecbfff700 1 -- 172.21.15.71:0/918991071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcecc0c6d00 msgr2=0x7fcecc0c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.836+0000 7fcecbfff700 1 --2- 172.21.15.71:0/918991071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcecc0c6d00 0x7fcecc0c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.836+0000 7fcecbfff700 1 -- 172.21.15.71:0/918991071 >> v1:172.21.15.179:6789/0 conn(0x7fcecc157770 legacy=0x7fcecc150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.836+0000 7fcecbfff700 1 -- 172.21.15.71:0/918991071 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc06b2e0 con 0x7fcecc06e730 2023-10-09T08:17:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.836+0000 7fcecaffd700 1 --2- 172.21.15.71:0/918991071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcecc0c6d00 0x7fcecc0c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.836+0000 7fcecbfff700 1 --2- 172.21.15.71:0/918991071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcecc06e730 0x7fcecc06ebb0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009f50 tx=0x7fcec4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e1a34cebcbfd77 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.836+0000 7fceca7fc700 1 -- 172.21.15.71:0/918991071 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec400e070 con 0x7fcecc06e730 2023-10-09T08:17:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.836+0000 7fceca7fc700 1 -- 172.21.15.71:0/918991071 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec400ba30 con 0x7fcecc06e730 2023-10-09T08:17:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.836+0000 7fceca7fc700 1 -- 172.21.15.71:0/918991071 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec40092e0 con 0x7fcecc06e730 2023-10-09T08:17:13.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.837+0000 7fced0f9d700 1 -- 172.21.15.71:0/918991071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcecc06e730 msgr2=0x7fcecc06ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.837+0000 7fced0f9d700 1 --2- 172.21.15.71:0/918991071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcecc06e730 0x7fcecc06ebb0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009f50 tx=0x7fcec4009840 comp rx=0 tx=0).stop 2023-10-09T08:17:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.837+0000 7fced0f9d700 1 -- 172.21.15.71:0/918991071 shutdown_connections 2023-10-09T08:17:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.837+0000 7fced0f9d700 1 --2- 172.21.15.71:0/918991071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcecc06e730 0x7fcecc06ebb0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.837+0000 7fced0f9d700 1 --2- 172.21.15.71:0/918991071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcecc0c6d00 0x7fcecc0c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.837+0000 7fced0f9d700 1 -- 172.21.15.71:0/918991071 >> 172.21.15.71:0/918991071 conn(0x7fcecc0cc1f0 msgr2=0x7fcecc0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.837+0000 7fced0f9d700 1 -- 172.21.15.71:0/918991071 shutdown_connections 2023-10-09T08:17:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.837+0000 7fced0f9d700 1 -- 172.21.15.71:0/918991071 wait complete. 2023-10-09T08:17:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.838+0000 7fced0f9d700 1 Processor -- start 2023-10-09T08:17:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.839+0000 7fced0f9d700 1 -- start start 2023-10-09T08:17:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.839+0000 7fced0f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcecc06e730 0x7fcecc1470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.839+0000 7fced0f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcecc0c6d00 0x7fcecc1433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.839+0000 7fced0f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcecc157770 0x7fcecc0b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.839+0000 7fced0f9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc147610 con 0x7fcecc0c6d00 2023-10-09T08:17:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.839+0000 7fced0f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc16b620 con 0x7fcecc06e730 2023-10-09T08:17:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.839+0000 7fced0f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc0ac510 con 0x7fcecc157770 2023-10-09T08:17:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.840+0000 7fcecaffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcecc0c6d00 0x7fcecc1433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.840+0000 7fcecaffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcecc0c6d00 0x7fcecc1433b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56228/0 (socket says 172.21.15.71:56228) 2023-10-09T08:17:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.840+0000 7fcecaffd700 1 -- 172.21.15.71:0/3214494740 learned_addr learned my addr 172.21.15.71:0/3214494740 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.840+0000 7fcecbfff700 1 --2- 172.21.15.71:0/3214494740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcecc157770 0x7fcecc0b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.840+0000 7fcecaffd700 1 -- 172.21.15.71:0/3214494740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcecc157770 msgr2=0x7fcecc0b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.840+0000 7fcecb7fe700 1 --2- 172.21.15.71:0/3214494740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcecc06e730 0x7fcecc1470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.840+0000 7fcecaffd700 1 --2- 172.21.15.71:0/3214494740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcecc157770 0x7fcecc0b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.840+0000 7fcecaffd700 1 -- 172.21.15.71:0/3214494740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcecc06e730 msgr2=0x7fcecc1470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.840+0000 7fcecaffd700 1 --2- 172.21.15.71:0/3214494740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcecc06e730 0x7fcecc1470d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.840+0000 7fcecaffd700 1 -- 172.21.15.71:0/3214494740 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec4009ae0 con 0x7fcecc0c6d00 2023-10-09T08:17:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.840+0000 7fcecbfff700 1 --2- 172.21.15.71:0/3214494740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcecc157770 0x7fcecc0b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.840+0000 7fcecb7fe700 1 --2- 172.21.15.71:0/3214494740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcecc06e730 0x7fcecc1470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.840+0000 7fcecaffd700 1 --2- 172.21.15.71:0/3214494740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcecc0c6d00 0x7fcecc1433b0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fcec000c830 tx=0x7fcec0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.841+0000 7fceb37fe700 1 -- 172.21.15.71:0/3214494740 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec0011600 con 0x7fcecc0c6d00 2023-10-09T08:17:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.841+0000 7fceb37fe700 1 -- 172.21.15.71:0/3214494740 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec0011760 con 0x7fcecc0c6d00 2023-10-09T08:17:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.841+0000 7fceb37fe700 1 -- 172.21.15.71:0/3214494740 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec0011b20 con 0x7fcecc0c6d00 2023-10-09T08:17:13.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.841+0000 7fced0f9d700 1 -- 172.21.15.71:0/3214494740 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcecc0abbe0 con 0x7fcecc0c6d00 2023-10-09T08:17:13.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.841+0000 7fced0f9d700 1 -- 172.21.15.71:0/3214494740 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcecc0ac1a0 con 0x7fcecc0c6d00 2023-10-09T08:17:13.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.842+0000 7fced0f9d700 1 -- 172.21.15.71:0/3214494740 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcecc04c3c0 con 0x7fcecc0c6d00 2023-10-09T08:17:13.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.843+0000 7fceb37fe700 1 -- 172.21.15.71:0/3214494740 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcec000a3e0 con 0x7fcecc0c6d00 2023-10-09T08:17:13.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.843+0000 7fceb37fe700 1 --2- 172.21.15.71:0/3214494740 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fceb8066f30 0x7fceb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:13.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.843+0000 7fceb37fe700 1 -- 172.21.15.71:0/3214494740 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5975+0+0 (secure 0 0 0) 0x7fcec0084b00 con 0x7fcecc0c6d00 2023-10-09T08:17:13.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.844+0000 7fcecb7fe700 1 --2- 172.21.15.71:0/3214494740 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fceb8066f30 0x7fceb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:13.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.845+0000 7fcecb7fe700 1 --2- 172.21.15.71:0/3214494740 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fceb8066f30 0x7fceb80693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcebc002880 tx=0x7fcebc009040 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:13.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:13.847+0000 7fceb37fe700 1 -- 172.21.15.71:0/3214494740 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcec0051c60 con 0x7fcecc0c6d00 2023-10-09T08:17:14.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.113+0000 7fced0f9d700 1 -- 172.21.15.71:0/3214494740 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7fcecc0ac650 con 0x7fcecc0c6d00 2023-10-09T08:17:14.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.384+0000 7fceb37fe700 1 -- 172.21.15.71:0/3214494740 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v3054) v1 ==== 163+0+0 (secure 0 0 0) 0x7fcec00150e0 con 0x7fcecc0c6d00 2023-10-09T08:17:14.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.387+0000 7fced0f9d700 1 -- 172.21.15.71:0/3214494740 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fceb8066f30 msgr2=0x7fceb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:14.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.387+0000 7fced0f9d700 1 --2- 172.21.15.71:0/3214494740 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fceb8066f30 0x7fceb80693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcebc002880 tx=0x7fcebc009040 comp rx=0 tx=0).stop 2023-10-09T08:17:14.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.387+0000 7fced0f9d700 1 -- 172.21.15.71:0/3214494740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcecc0c6d00 msgr2=0x7fcecc1433b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:14.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.387+0000 7fced0f9d700 1 --2- 172.21.15.71:0/3214494740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcecc0c6d00 0x7fcecc1433b0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fcec000c830 tx=0x7fcec0008040 comp rx=0 tx=0).stop 2023-10-09T08:17:14.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.387+0000 7fced0f9d700 1 -- 172.21.15.71:0/3214494740 shutdown_connections 2023-10-09T08:17:14.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.387+0000 7fced0f9d700 1 --2- 172.21.15.71:0/3214494740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcecc157770 0x7fcecc0b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:14.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.387+0000 7fced0f9d700 1 --2- 172.21.15.71:0/3214494740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcecc06e730 0x7fcecc1470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:14.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.387+0000 7fced0f9d700 1 --2- 172.21.15.71:0/3214494740 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fceb8066f30 0x7fceb80693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:14.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.387+0000 7fced0f9d700 1 --2- 172.21.15.71:0/3214494740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcecc0c6d00 0x7fcecc1433b0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:14.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.387+0000 7fced0f9d700 1 -- 172.21.15.71:0/3214494740 >> 172.21.15.71:0/3214494740 conn(0x7fcecc0cc1f0 msgr2=0x7fcecc0cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:14.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.387+0000 7fced0f9d700 1 -- 172.21.15.71:0/3214494740 shutdown_connections 2023-10-09T08:17:14.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.387+0000 7fced0f9d700 1 -- 172.21.15.71:0/3214494740 wait complete. 2023-10-09T08:17:14.406 INFO:tasks.cephfs_test_runner:Test scheduled snapshots along with rentention policy ... ok 2023-10-09T08:17:14.406 INFO:tasks.cephfs_test_runner:Starting test: test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) Test the correctness of snap directory name 2023-10-09T08:17:14.407 INFO:tasks.cephfs_test_runner:test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) 2023-10-09T08:17:14.407 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-10-09T08:17:14.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.587+0000 7f5979b9d700 1 Processor -- start 2023-10-09T08:17:14.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.587+0000 7f5979b9d700 1 -- start start 2023-10-09T08:17:14.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.588+0000 7f5979b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59740c6a70 0x7f597406acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:14.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.588+0000 7f5979b9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f59740696c0 0x7f59740c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:14.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.588+0000 7f5979b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f59740ca660 0x7f59740c7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:14.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.588+0000 7f5979b9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597406b210 con 0x7f59740696c0 2023-10-09T08:17:14.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.588+0000 7f5979b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597406a840 con 0x7f59740ca660 2023-10-09T08:17:14.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.588+0000 7f5979b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59740c78c0 con 0x7f59740c6a70 2023-10-09T08:17:14.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.588+0000 7f5973fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f59740696c0 0x7f59740c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:14.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.588+0000 7f5973fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f59740696c0 0x7f59740c6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56236/0 (socket says 172.21.15.71:56236) 2023-10-09T08:17:14.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.588+0000 7f5973fff700 1 -- 172.21.15.71:0/3688833794 learned_addr learned my addr 172.21.15.71:0/3688833794 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:14.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.589+0000 7f5978b9b700 1 --2- 172.21.15.71:0/3688833794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59740c6a70 0x7f597406acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:14.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.589+0000 7f597939c700 1 --2- 172.21.15.71:0/3688833794 >> v2:172.21.15.179:3300/0 conn(0x7f59740ca660 0x7f59740c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:14.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.589+0000 7f5973fff700 1 -- 172.21.15.71:0/3688833794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59740c6a70 msgr2=0x7f597406acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:14.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.589+0000 7f5973fff700 1 --2- 172.21.15.71:0/3688833794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59740c6a70 0x7f597406acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:14.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.589+0000 7f5973fff700 1 -- 172.21.15.71:0/3688833794 >> v2:172.21.15.179:3300/0 conn(0x7f59740ca660 msgr2=0x7f59740c7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:14.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.589+0000 7f5973fff700 1 --2- 172.21.15.71:0/3688833794 >> v2:172.21.15.179:3300/0 conn(0x7f59740ca660 0x7f59740c7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:14.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.589+0000 7f5973fff700 1 -- 172.21.15.71:0/3688833794 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5974069c30 con 0x7f59740696c0 2023-10-09T08:17:14.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.589+0000 7f5973fff700 1 --2- 172.21.15.71:0/3688833794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59740696c0 0x7f59740c6e40 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f59740cd2e0 tx=0x7f5960009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adee8461d4b329ee server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:14.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.589+0000 7f59737fe700 1 -- 172.21.15.71:0/3688833794 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596000b860 con 0x7f59740696c0 2023-10-09T08:17:14.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.589+0000 7f59737fe700 1 -- 172.21.15.71:0/3688833794 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596000b9c0 con 0x7f59740696c0 2023-10-09T08:17:14.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.589+0000 7f59737fe700 1 -- 172.21.15.71:0/3688833794 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596000bd60 con 0x7f59740696c0 2023-10-09T08:17:14.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.590+0000 7f5979b9d700 1 -- 172.21.15.71:0/3688833794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59740696c0 msgr2=0x7f59740c6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:14.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.590+0000 7f5979b9d700 1 --2- 172.21.15.71:0/3688833794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59740696c0 0x7f59740c6e40 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f59740cd2e0 tx=0x7f5960009250 comp rx=0 tx=0).stop 2023-10-09T08:17:14.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.590+0000 7f5979b9d700 1 -- 172.21.15.71:0/3688833794 shutdown_connections 2023-10-09T08:17:14.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.590+0000 7f5979b9d700 1 --2- 172.21.15.71:0/3688833794 >> v2:172.21.15.179:3300/0 conn(0x7f59740ca660 0x7f59740c7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:14.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.590+0000 7f5979b9d700 1 --2- 172.21.15.71:0/3688833794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59740c6a70 0x7f597406acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:14.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.590+0000 7f5979b9d700 1 --2- 172.21.15.71:0/3688833794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59740696c0 0x7f59740c6e40 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:14.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.590+0000 7f5979b9d700 1 -- 172.21.15.71:0/3688833794 >> 172.21.15.71:0/3688833794 conn(0x7f59740cc1f0 msgr2=0x7f59740cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:14.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.590+0000 7f5979b9d700 1 -- 172.21.15.71:0/3688833794 shutdown_connections 2023-10-09T08:17:14.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.590+0000 7f5979b9d700 1 -- 172.21.15.71:0/3688833794 wait complete. 2023-10-09T08:17:14.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.591+0000 7f5979b9d700 1 Processor -- start 2023-10-09T08:17:14.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.592+0000 7f5979b9d700 1 -- start start 2023-10-09T08:17:14.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.592+0000 7f5979b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59740696c0 0x7f597414da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:14.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.592+0000 7f5979b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59740c6a70 0x7f59740c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:14.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.592+0000 7f5979b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59740ca660 0x7f59740c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:14.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.593+0000 7f5979b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5974157570 con 0x7f59740c6a70 2023-10-09T08:17:14.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.593+0000 7f5979b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597414df40 con 0x7f59740696c0 2023-10-09T08:17:14.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.593+0000 7f5979b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59741569a0 con 0x7f59740ca660 2023-10-09T08:17:14.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.593+0000 7f5973fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59740c6a70 0x7f59740c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:14.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.593+0000 7f5973fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59740c6a70 0x7f59740c32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56244/0 (socket says 172.21.15.71:56244) 2023-10-09T08:17:14.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.593+0000 7f5973fff700 1 -- 172.21.15.71:0/225951776 learned_addr learned my addr 172.21.15.71:0/225951776 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:14.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.593+0000 7f5973fff700 1 -- 172.21.15.71:0/225951776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59740ca660 msgr2=0x7f59740c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:14.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.593+0000 7f5973fff700 1 --2- 172.21.15.71:0/225951776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59740ca660 0x7f59740c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:14.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.593+0000 7f5973fff700 1 -- 172.21.15.71:0/225951776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59740696c0 msgr2=0x7f597414da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:14.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.593+0000 7f5973fff700 1 --2- 172.21.15.71:0/225951776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59740696c0 0x7f597414da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:14.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.593+0000 7f5973fff700 1 -- 172.21.15.71:0/225951776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59600094f0 con 0x7f59740c6a70 2023-10-09T08:17:14.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.593+0000 7f5973fff700 1 --2- 172.21.15.71:0/225951776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59740c6a70 0x7f59740c32a0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f5960006fd0 tx=0x7f5960017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:14.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.594+0000 7f5970ff9700 1 -- 172.21.15.71:0/225951776 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5960024440 con 0x7f59740c6a70 2023-10-09T08:17:14.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.594+0000 7f5970ff9700 1 -- 172.21.15.71:0/225951776 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59600245a0 con 0x7f59740c6a70 2023-10-09T08:17:14.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.594+0000 7f5979b9d700 1 -- 172.21.15.71:0/225951776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5974156c40 con 0x7f59740c6a70 2023-10-09T08:17:14.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.594+0000 7f5970ff9700 1 -- 172.21.15.71:0/225951776 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5960024960 con 0x7f59740c6a70 2023-10-09T08:17:14.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.594+0000 7f5979b9d700 1 -- 172.21.15.71:0/225951776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5974157200 con 0x7f59740c6a70 2023-10-09T08:17:14.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.595+0000 7f5979b9d700 1 -- 172.21.15.71:0/225951776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5974157390 con 0x7f59740c6a70 2023-10-09T08:17:14.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.596+0000 7f5970ff9700 1 -- 172.21.15.71:0/225951776 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f596001a420 con 0x7f59740c6a70 2023-10-09T08:17:14.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.597+0000 7f5970ff9700 1 --2- 172.21.15.71:0/225951776 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5958066f30 0x7f59580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:14.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.597+0000 7f5970ff9700 1 -- 172.21.15.71:0/225951776 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5975+0+0 (secure 0 0 0) 0x7f5960086440 con 0x7f59740c6a70 2023-10-09T08:17:14.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.597+0000 7f5978b9b700 1 --2- 172.21.15.71:0/225951776 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5958066f30 0x7f59580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:14.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.598+0000 7f5978b9b700 1 --2- 172.21.15.71:0/225951776 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5958066f30 0x7f59580693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f597406eae0 tx=0x7f5968008040 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:14.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.601+0000 7f5970ff9700 1 -- 172.21.15.71:0/225951776 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59600535a0 con 0x7f59740c6a70 2023-10-09T08:17:14.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:14.865+0000 7f5979b9d700 1 -- 172.21.15.71:0/225951776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f5974157720 con 0x7f59740c6a70 2023-10-09T08:17:15.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.386+0000 7f5970ff9700 1 -- 172.21.15.71:0/225951776 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v3055) v1 ==== 158+0+0 (secure 0 0 0) 0x7f5974157720 con 0x7f59740c6a70 2023-10-09T08:17:15.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.388+0000 7f5979b9d700 1 -- 172.21.15.71:0/225951776 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5958066f30 msgr2=0x7f59580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:15.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.388+0000 7f5979b9d700 1 --2- 172.21.15.71:0/225951776 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5958066f30 0x7f59580693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f597406eae0 tx=0x7f5968008040 comp rx=0 tx=0).stop 2023-10-09T08:17:15.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.388+0000 7f5979b9d700 1 -- 172.21.15.71:0/225951776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59740c6a70 msgr2=0x7f59740c32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:15.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.388+0000 7f5979b9d700 1 --2- 172.21.15.71:0/225951776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59740c6a70 0x7f59740c32a0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f5960006fd0 tx=0x7f5960017000 comp rx=0 tx=0).stop 2023-10-09T08:17:15.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.388+0000 7f5979b9d700 1 -- 172.21.15.71:0/225951776 shutdown_connections 2023-10-09T08:17:15.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.388+0000 7f5979b9d700 1 --2- 172.21.15.71:0/225951776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59740ca660 0x7f59740c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:15.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.388+0000 7f5979b9d700 1 --2- 172.21.15.71:0/225951776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59740696c0 0x7f597414da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:15.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.388+0000 7f5979b9d700 1 --2- 172.21.15.71:0/225951776 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5958066f30 0x7f59580693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:15.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.388+0000 7f5979b9d700 1 --2- 172.21.15.71:0/225951776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59740c6a70 0x7f59740c32a0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:15.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.388+0000 7f5979b9d700 1 -- 172.21.15.71:0/225951776 >> 172.21.15.71:0/225951776 conn(0x7f59740cc1f0 msgr2=0x7f597414e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:15.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.388+0000 7f5979b9d700 1 -- 172.21.15.71:0/225951776 shutdown_connections 2023-10-09T08:17:15.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.388+0000 7f5979b9d700 1 -- 172.21.15.71:0/225951776 wait complete. 2023-10-09T08:17:15.408 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T08:17:15.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.592+0000 7f630f59e700 1 Processor -- start 2023-10-09T08:17:15.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.592+0000 7f630f59e700 1 -- start start 2023-10-09T08:17:15.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.593+0000 7f630f59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6310153900 0x7f63100c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:15.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.593+0000 7f630f59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f63100c9db0 0x7f631006a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:15.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.593+0000 7f630f59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f631006e150 con 0x7f6310157130 2023-10-09T08:17:15.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.593+0000 7f630f59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63100c7800 con 0x7f63100c9db0 2023-10-09T08:17:15.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.593+0000 7f630f59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63100c7ae0 con 0x7f6310153900 2023-10-09T08:17:15.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.594+0000 7f630e59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6310153900 0x7f63100c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:15.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.594+0000 7f630ed9d700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f6310157130 0x7f6310159ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:48980/0 (socket says 172.21.15.71:48980) 2023-10-09T08:17:15.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.594+0000 7f630ed9d700 1 -- 172.21.15.71:0/2264578591 learned_addr learned my addr 172.21.15.71:0/2264578591 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:15.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.594+0000 7f630dd9b700 1 --2- 172.21.15.71:0/2264578591 >> v2:172.21.15.179:3300/0 conn(0x7f63100c9db0 0x7f631006a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:15.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.594+0000 7f630d59a700 1 -- 172.21.15.71:0/2264578591 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4108081006 0 0) 0x7f631006e150 con 0x7f6310157130 2023-10-09T08:17:15.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.594+0000 7f630d59a700 1 -- 172.21.15.71:0/2264578591 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62f8003570 con 0x7f6310157130 2023-10-09T08:17:15.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.594+0000 7f630e59c700 1 -- 172.21.15.71:0/2264578591 >> v2:172.21.15.179:3300/0 conn(0x7f63100c9db0 msgr2=0x7f631006a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:15.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.594+0000 7f630e59c700 1 --2- 172.21.15.71:0/2264578591 >> v2:172.21.15.179:3300/0 conn(0x7f63100c9db0 0x7f631006a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:15.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.594+0000 7f630e59c700 1 -- 172.21.15.71:0/2264578591 >> v1:172.21.15.179:6789/0 conn(0x7f6310157130 legacy=0x7f6310159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:15.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.594+0000 7f630e59c700 1 -- 172.21.15.71:0/2264578591 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63100c7dc0 con 0x7f6310153900 2023-10-09T08:17:15.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.594+0000 7f630dd9b700 1 --2- 172.21.15.71:0/2264578591 >> v2:172.21.15.179:3300/0 conn(0x7f63100c9db0 0x7f631006a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:15.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.594+0000 7f630e59c700 1 --2- 172.21.15.71:0/2264578591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6310153900 0x7f63100c6f00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f63000098e0 tx=0x7f63000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b498487e212034db server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:15.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.595+0000 7f630d59a700 1 -- 172.21.15.71:0/2264578591 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6300011630 con 0x7f6310153900 2023-10-09T08:17:15.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.595+0000 7f630d59a700 1 -- 172.21.15.71:0/2264578591 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6300011790 con 0x7f6310153900 2023-10-09T08:17:15.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.595+0000 7f630d59a700 1 -- 172.21.15.71:0/2264578591 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6300011b30 con 0x7f6310153900 2023-10-09T08:17:15.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.595+0000 7f630f59e700 1 -- 172.21.15.71:0/2264578591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6310153900 msgr2=0x7f63100c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:15.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.595+0000 7f630f59e700 1 --2- 172.21.15.71:0/2264578591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6310153900 0x7f63100c6f00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f63000098e0 tx=0x7f63000091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:15.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.595+0000 7f630f59e700 1 -- 172.21.15.71:0/2264578591 shutdown_connections 2023-10-09T08:17:15.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.595+0000 7f630f59e700 1 --2- 172.21.15.71:0/2264578591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6310153900 0x7f63100c6f00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:15.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.595+0000 7f630f59e700 1 --2- 172.21.15.71:0/2264578591 >> v2:172.21.15.179:3300/0 conn(0x7f63100c9db0 0x7f631006a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:15.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.595+0000 7f630f59e700 1 -- 172.21.15.71:0/2264578591 >> 172.21.15.71:0/2264578591 conn(0x7f63100cc1e0 msgr2=0x7f63100cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:15.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.595+0000 7f630f59e700 1 -- 172.21.15.71:0/2264578591 shutdown_connections 2023-10-09T08:17:15.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.595+0000 7f630f59e700 1 -- 172.21.15.71:0/2264578591 wait complete. 2023-10-09T08:17:15.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.597+0000 7f630f59e700 1 Processor -- start 2023-10-09T08:17:15.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.597+0000 7f630f59e700 1 -- start start 2023-10-09T08:17:15.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.598+0000 7f630f59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63100c9db0 0x7f63100aab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:15.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.598+0000 7f630f59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6310153900 0x7f63101585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:15.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.598+0000 7f630f59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6310157130 0x7f6310158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:15.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.598+0000 7f630f59e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631016aab0 con 0x7f6310157130 2023-10-09T08:17:15.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.598+0000 7f630f59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63100b0240 con 0x7f6310153900 2023-10-09T08:17:15.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.598+0000 7f630f59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63100af910 con 0x7f63100c9db0 2023-10-09T08:17:15.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.598+0000 7f630ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6310157130 0x7f6310158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:15.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.598+0000 7f630e59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63100c9db0 0x7f63100aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:15.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.598+0000 7f630e59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63100c9db0 0x7f63100aab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:54840/0 (socket says 172.21.15.71:54840) 2023-10-09T08:17:15.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.598+0000 7f630e59c700 1 -- 172.21.15.71:0/713987102 learned_addr learned my addr 172.21.15.71:0/713987102 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:15.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.598+0000 7f630dd9b700 1 --2- 172.21.15.71:0/713987102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6310153900 0x7f63101585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:15.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.599+0000 7f630ed9d700 1 -- 172.21.15.71:0/713987102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63100c9db0 msgr2=0x7f63100aab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:15.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.599+0000 7f630ed9d700 1 --2- 172.21.15.71:0/713987102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63100c9db0 0x7f63100aab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:15.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.599+0000 7f630ed9d700 1 -- 172.21.15.71:0/713987102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6310153900 msgr2=0x7f63101585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:15.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.599+0000 7f630ed9d700 1 --2- 172.21.15.71:0/713987102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6310153900 0x7f63101585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:15.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.599+0000 7f630ed9d700 1 -- 172.21.15.71:0/713987102 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6304009420 con 0x7f6310157130 2023-10-09T08:17:15.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.599+0000 7f630ed9d700 1 --2- 172.21.15.71:0/713987102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6310157130 0x7f6310158b10 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f63101575d0 tx=0x7f6308001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:15.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.599+0000 7f62fe7fc700 1 -- 172.21.15.71:0/713987102 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630800a7e0 con 0x7f6310157130 2023-10-09T08:17:15.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.599+0000 7f62fe7fc700 1 -- 172.21.15.71:0/713987102 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630800a940 con 0x7f6310157130 2023-10-09T08:17:15.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.599+0000 7f630f59e700 1 -- 172.21.15.71:0/713987102 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6300009420 con 0x7f6310157130 2023-10-09T08:17:15.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.599+0000 7f62fe7fc700 1 -- 172.21.15.71:0/713987102 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630800acc0 con 0x7f6310157130 2023-10-09T08:17:15.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.599+0000 7f630f59e700 1 -- 172.21.15.71:0/713987102 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63100afed0 con 0x7f6310157130 2023-10-09T08:17:15.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.600+0000 7f630f59e700 1 -- 172.21.15.71:0/713987102 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63100b03b0 con 0x7f6310157130 2023-10-09T08:17:15.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.601+0000 7f62fe7fc700 1 -- 172.21.15.71:0/713987102 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6308007300 con 0x7f6310157130 2023-10-09T08:17:15.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.602+0000 7f62fe7fc700 1 --2- 172.21.15.71:0/713987102 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f62f0066f30 0x7f62f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:15.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.602+0000 7f62fe7fc700 1 -- 172.21.15.71:0/713987102 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5975+0+0 (secure 0 0 0) 0x7f6308084160 con 0x7f6310157130 2023-10-09T08:17:15.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.603+0000 7f630e59c700 1 --2- 172.21.15.71:0/713987102 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f62f0066f30 0x7f62f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:15.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.603+0000 7f630e59c700 1 --2- 172.21.15.71:0/713987102 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f62f0066f30 0x7f62f00693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6300011fd0 tx=0x7f6300017000 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:15.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.606+0000 7f62fe7fc700 1 -- 172.21.15.71:0/713987102 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f630804b5a0 con 0x7f6310157130 2023-10-09T08:17:15.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.796+0000 7f630f59e700 1 -- 172.21.15.71:0/713987102 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f631006dd20 con 0x7f6310157130 2023-10-09T08:17:15.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.800+0000 7f62fe7fc700 1 -- 172.21.15.71:0/713987102 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v70)=0 v70) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6308054de0 con 0x7f6310157130 2023-10-09T08:17:15.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.803+0000 7f630f59e700 1 -- 172.21.15.71:0/713987102 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f62f0066f30 msgr2=0x7f62f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:15.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.803+0000 7f630f59e700 1 --2- 172.21.15.71:0/713987102 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f62f0066f30 0x7f62f00693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6300011fd0 tx=0x7f6300017000 comp rx=0 tx=0).stop 2023-10-09T08:17:15.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.803+0000 7f630f59e700 1 -- 172.21.15.71:0/713987102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6310157130 msgr2=0x7f6310158b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:15.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.803+0000 7f630f59e700 1 --2- 172.21.15.71:0/713987102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6310157130 0x7f6310158b10 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f63101575d0 tx=0x7f6308001980 comp rx=0 tx=0).stop 2023-10-09T08:17:15.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.803+0000 7f630f59e700 1 -- 172.21.15.71:0/713987102 shutdown_connections 2023-10-09T08:17:15.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.803+0000 7f630f59e700 1 --2- 172.21.15.71:0/713987102 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f62f0066f30 0x7f62f00693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:15.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.803+0000 7f630f59e700 1 --2- 172.21.15.71:0/713987102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6310157130 0x7f6310158b10 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:15.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.803+0000 7f630f59e700 1 --2- 172.21.15.71:0/713987102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63100c9db0 0x7f63100aab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:15.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.803+0000 7f630f59e700 1 --2- 172.21.15.71:0/713987102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6310153900 0x7f63101585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:15.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.803+0000 7f630f59e700 1 -- 172.21.15.71:0/713987102 >> 172.21.15.71:0/713987102 conn(0x7f63100cc1e0 msgr2=0x7f6310152080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:15.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.803+0000 7f630f59e700 1 -- 172.21.15.71:0/713987102 shutdown_connections 2023-10-09T08:17:15.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:15.803+0000 7f630f59e700 1 -- 172.21.15.71:0/713987102 wait complete. 2023-10-09T08:17:15.821 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T08:17:15.821 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T08:17:15.902 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T08:17:15.989 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T08:17:15.989 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T08:17:15.990 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T08:17:16.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.170+0000 7f14827ff700 1 Processor -- start 2023-10-09T08:17:16.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.170+0000 7f14827ff700 1 -- start start 2023-10-09T08:17:16.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.172+0000 7f14827ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f147c06a630 0x7f147c161c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:16.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.172+0000 7f14827ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147c0ac930 con 0x7f147c069ab0 2023-10-09T08:17:16.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.172+0000 7f14827ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147c0b0610 con 0x7f147c0a6ba0 2023-10-09T08:17:16.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.172+0000 7f14827ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c0abd20 con 0x7f147c06a630 2023-10-09T08:17:16.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.172+0000 7f147b7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f147c069ab0 0x7f147c069f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:49742/0 (socket says 172.21.15.71:49742) 2023-10-09T08:17:16.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.172+0000 7f147b7fe700 1 -- 172.21.15.71:0/3685291783 learned_addr learned my addr 172.21.15.71:0/3685291783 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:16.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.172+0000 7f1480d9c700 1 --2- 172.21.15.71:0/3685291783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f147c06a630 0x7f147c161c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:16.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.172+0000 7f147affd700 1 -- 172.21.15.71:0/3685291783 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611590382 0 0) 0x7f147c0ac930 con 0x7f147c069ab0 2023-10-09T08:17:16.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.172+0000 7f147affd700 1 -- 172.21.15.71:0/3685291783 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1464003570 con 0x7f147c069ab0 2023-10-09T08:17:16.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.173+0000 7f147affd700 1 -- 172.21.15.71:0/3685291783 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330459348 0 0) 0x7f147c0b0610 con 0x7f147c0a6ba0 2023-10-09T08:17:16.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.173+0000 7f147affd700 1 -- 172.21.15.71:0/3685291783 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f147c0ac930 con 0x7f147c0a6ba0 2023-10-09T08:17:16.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.173+0000 7f147affd700 1 -- 172.21.15.71:0/3685291783 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1210689502 0 0) 0x7f1464003570 con 0x7f147c069ab0 2023-10-09T08:17:16.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.173+0000 7f1480d9c700 1 -- 172.21.15.71:0/3685291783 >> v1:172.21.15.179:6789/0 conn(0x7f147c0a6ba0 legacy=0x7f147c0aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:16.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.173+0000 7f1480d9c700 1 -- 172.21.15.71:0/3685291783 >> v1:172.21.15.71:6789/0 conn(0x7f147c069ab0 legacy=0x7f147c069f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:16.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.173+0000 7f1480d9c700 1 -- 172.21.15.71:0/3685291783 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c0ac000 con 0x7f147c06a630 2023-10-09T08:17:16.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.173+0000 7f1480d9c700 1 --2- 172.21.15.71:0/3685291783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f147c06a630 0x7f147c161c80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1474009e90 tx=0x7f1474009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d35f12bb4014c601 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:16.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.173+0000 7f147affd700 1 -- 172.21.15.71:0/3685291783 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147400e070 con 0x7f147c06a630 2023-10-09T08:17:16.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.173+0000 7f147affd700 1 -- 172.21.15.71:0/3685291783 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147400b870 con 0x7f147c06a630 2023-10-09T08:17:16.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.173+0000 7f147affd700 1 -- 172.21.15.71:0/3685291783 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470001470 con 0x7f147c06a630 2023-10-09T08:17:16.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.174+0000 7f14827ff700 1 -- 172.21.15.71:0/3685291783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f147c06a630 msgr2=0x7f147c161c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:16.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.174+0000 7f14827ff700 1 --2- 172.21.15.71:0/3685291783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f147c06a630 0x7f147c161c80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1474009e90 tx=0x7f1474009780 comp rx=0 tx=0).stop 2023-10-09T08:17:16.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.174+0000 7f14827ff700 1 -- 172.21.15.71:0/3685291783 shutdown_connections 2023-10-09T08:17:16.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.174+0000 7f14827ff700 1 --2- 172.21.15.71:0/3685291783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f147c06a630 0x7f147c161c80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:16.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.174+0000 7f14827ff700 1 -- 172.21.15.71:0/3685291783 >> 172.21.15.71:0/3685291783 conn(0x7f147c06d5a0 msgr2=0x7f147c068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:16.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.174+0000 7f14827ff700 1 -- 172.21.15.71:0/3685291783 shutdown_connections 2023-10-09T08:17:16.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.174+0000 7f14827ff700 1 -- 172.21.15.71:0/3685291783 wait complete. 2023-10-09T08:17:16.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.175+0000 7f14827ff700 1 Processor -- start 2023-10-09T08:17:16.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.175+0000 7f14827ff700 1 -- start start 2023-10-09T08:17:16.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.176+0000 7f14827ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f147c069ab0 0x7f147c0aa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:16.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.176+0000 7f14827ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f147c06a630 0x7f147c1565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:16.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.176+0000 7f14827ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147c0a6ba0 0x7f147c1539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:16.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.176+0000 7f14827ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c0a7f40 con 0x7f147c069ab0 2023-10-09T08:17:16.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.176+0000 7f14827ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c158a90 con 0x7f147c0a6ba0 2023-10-09T08:17:16.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.176+0000 7f14827ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c158d70 con 0x7f147c06a630 2023-10-09T08:17:16.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.177+0000 7f147bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f147c069ab0 0x7f147c0aa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:16.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.177+0000 7f147bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f147c069ab0 0x7f147c0aa5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39102/0 (socket says 172.21.15.71:39102) 2023-10-09T08:17:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.177+0000 7f147bfff700 1 -- 172.21.15.71:0/2340916070 learned_addr learned my addr 172.21.15.71:0/2340916070 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.177+0000 7f147bfff700 1 -- 172.21.15.71:0/2340916070 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f147c06a630 msgr2=0x7f147c1565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.177+0000 7f147bfff700 1 --2- 172.21.15.71:0/2340916070 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f147c06a630 0x7f147c1565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.177+0000 7f147bfff700 1 -- 172.21.15.71:0/2340916070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147c0a6ba0 msgr2=0x7f147c1539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.177+0000 7f147bfff700 1 --2- 172.21.15.71:0/2340916070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147c0a6ba0 0x7f147c1539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.177+0000 7f147bfff700 1 -- 172.21.15.71:0/2340916070 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1474009a20 con 0x7f147c069ab0 2023-10-09T08:17:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.177+0000 7f147bfff700 1 --2- 172.21.15.71:0/2340916070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f147c069ab0 0x7f147c0aa5d0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f146c00c790 tx=0x7f146c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.177+0000 7f1463fff700 1 -- 172.21.15.71:0/2340916070 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c010510 con 0x7f147c069ab0 2023-10-09T08:17:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.177+0000 7f1463fff700 1 -- 172.21.15.71:0/2340916070 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146c010670 con 0x7f147c069ab0 2023-10-09T08:17:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.177+0000 7f14827ff700 1 -- 172.21.15.71:0/2340916070 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147c0a8190 con 0x7f147c069ab0 2023-10-09T08:17:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.178+0000 7f1463fff700 1 -- 172.21.15.71:0/2340916070 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c010a10 con 0x7f147c069ab0 2023-10-09T08:17:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.178+0000 7f14827ff700 1 -- 172.21.15.71:0/2340916070 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147c165260 con 0x7f147c069ab0 2023-10-09T08:17:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.178+0000 7f14827ff700 1 -- 172.21.15.71:0/2340916070 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f147c04c3c0 con 0x7f147c069ab0 2023-10-09T08:17:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.179+0000 7f1463fff700 1 -- 172.21.15.71:0/2340916070 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f146c01b400 con 0x7f147c069ab0 2023-10-09T08:17:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.180+0000 7f1463fff700 1 --2- 172.21.15.71:0/2340916070 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1468066f30 0x7f14680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.180+0000 7f1463fff700 1 -- 172.21.15.71:0/2340916070 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5975+0+0 (secure 0 0 0) 0x7f146c084490 con 0x7f147c069ab0 2023-10-09T08:17:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.181+0000 7f147b7fe700 1 --2- 172.21.15.71:0/2340916070 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1468066f30 0x7f14680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:16.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.181+0000 7f147b7fe700 1 --2- 172.21.15.71:0/2340916070 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1468066f30 0x7f14680693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f147c157a60 tx=0x7f1470000f10 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:16.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.184+0000 7f1463fff700 1 -- 172.21.15.71:0/2340916070 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f146c051550 con 0x7f147c069ab0 2023-10-09T08:17:16.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.420+0000 7f14827ff700 1 -- 172.21.15.71:0/2340916070 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f147c0ae1c0 con 0x7f147c069ab0 2023-10-09T08:17:16.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.420+0000 7f1463fff700 1 -- 172.21.15.71:0/2340916070 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+3520 (secure 0 0 0) 0x7f146c054b70 con 0x7f147c069ab0 2023-10-09T08:17:16.421 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:16.422 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":91,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7919,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/567694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":567694},{"type":"v1","addr":"172.21.15.71:6835","nonce":567694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":9151,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/502575967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":502575967},{"type":"v1","addr":"172.21.15.179:6836","nonce":502575967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":9517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2723483829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2723483829},{"type":"v1","addr":"172.21.15.179:6834","nonce":2723483829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91},{"gid":9663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/1425921431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":1425921431},{"type":"v1","addr":"172.21.15.71:6834","nonce":1425921431}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[]} 2023-10-09T08:17:16.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.423+0000 7f14827ff700 1 -- 172.21.15.71:0/2340916070 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1468066f30 msgr2=0x7f14680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:16.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.423+0000 7f14827ff700 1 --2- 172.21.15.71:0/2340916070 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1468066f30 0x7f14680693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f147c157a60 tx=0x7f1470000f10 comp rx=0 tx=0).stop 2023-10-09T08:17:16.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.423+0000 7f14827ff700 1 -- 172.21.15.71:0/2340916070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f147c069ab0 msgr2=0x7f147c0aa5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:16.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.423+0000 7f14827ff700 1 --2- 172.21.15.71:0/2340916070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f147c069ab0 0x7f147c0aa5d0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f146c00c790 tx=0x7f146c007e10 comp rx=0 tx=0).stop 2023-10-09T08:17:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.423+0000 7f14827ff700 1 -- 172.21.15.71:0/2340916070 shutdown_connections 2023-10-09T08:17:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.423+0000 7f14827ff700 1 --2- 172.21.15.71:0/2340916070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147c0a6ba0 0x7f147c1539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.423+0000 7f14827ff700 1 --2- 172.21.15.71:0/2340916070 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1468066f30 0x7f14680693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.423+0000 7f14827ff700 1 --2- 172.21.15.71:0/2340916070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f147c069ab0 0x7f147c0aa5d0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.423+0000 7f14827ff700 1 --2- 172.21.15.71:0/2340916070 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f147c06a630 0x7f147c1565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.423+0000 7f14827ff700 1 -- 172.21.15.71:0/2340916070 >> 172.21.15.71:0/2340916070 conn(0x7f147c06d5a0 msgr2=0x7f147c068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.423+0000 7f14827ff700 1 -- 172.21.15.71:0/2340916070 shutdown_connections 2023-10-09T08:17:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.423+0000 7f14827ff700 1 -- 172.21.15.71:0/2340916070 wait complete. 2023-10-09T08:17:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 91 2023-10-09T08:17:16.441 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T08:17:16.442 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T08:17:16.442 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T08:17:16.442 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:17:16.443 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T08:17:16.443 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T08:17:16.443 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T08:17:16.443 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:17:16.444 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T08:17:16.444 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T08:17:16.444 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T08:17:16.445 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:17:16.445 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T08:17:16.445 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T08:17:16.445 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T08:17:16.445 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:17:16.456 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T08:17:16.457 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T08:17:16.457 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T08:17:16.458 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T08:17:16.462 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T08:17:16.462 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T08:17:16.462 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T08:17:16.463 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T08:17:16.501 INFO:tasks.ceph.mds.a:Started 2023-10-09T08:17:16.502 DEBUG:teuthology.parallel:result is None 2023-10-09T08:17:16.504 INFO:tasks.ceph.mds.c:Started 2023-10-09T08:17:16.504 DEBUG:teuthology.parallel:result is None 2023-10-09T08:17:16.507 INFO:tasks.ceph.mds.b:Started 2023-10-09T08:17:16.507 DEBUG:teuthology.parallel:result is None 2023-10-09T08:17:16.510 INFO:tasks.ceph.mds.d:Started 2023-10-09T08:17:16.510 DEBUG:teuthology.parallel:result is None 2023-10-09T08:17:16.510 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T08:17:16.639 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2023-10-09T08:17:16.640 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-10-09T08:17:16.648 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-10-09T08:17:16.648 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-10-09T08:17:16.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.705+0000 7f88833ff700 1 Processor -- start 2023-10-09T08:17:16.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.705+0000 7f88833ff700 1 -- start start 2023-10-09T08:17:16.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.707+0000 7f88833ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f887c0b1850 0x7f887c0b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:16.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.707+0000 7f88833ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f887c0ae680 0x7f887c1572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:16.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.707+0000 7f88833ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887c0cb300 con 0x7f887c0aead0 2023-10-09T08:17:16.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.707+0000 7f88833ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f887c06fc30 con 0x7f887c0b1850 2023-10-09T08:17:16.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.707+0000 7f88833ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887c0cc260 con 0x7f887c0ae680 2023-10-09T08:17:16.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.707+0000 7f888119b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f887c0b1850 0x7f887c0b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:16.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.707+0000 7f888119b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f887c0b1850 0x7f887c0b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39138/0 (socket says 172.21.15.71:39138) 2023-10-09T08:17:16.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.707+0000 7f888119b700 1 -- 172.21.15.71:0/2991445942 learned_addr learned my addr 172.21.15.71:0/2991445942 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:16.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.707+0000 7f888099a700 1 --2- 172.21.15.71:0/2991445942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f887c0ae680 0x7f887c1572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:16.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.707+0000 7f888119b700 1 -- 172.21.15.71:0/2991445942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f887c0ae680 msgr2=0x7f887c1572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:16.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.707+0000 7f888119b700 1 --2- 172.21.15.71:0/2991445942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f887c0ae680 0x7f887c1572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:16.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.707+0000 7f888119b700 1 -- 172.21.15.71:0/2991445942 >> v1:172.21.15.71:6789/0 conn(0x7f887c0aead0 legacy=0x7f887c15b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:16.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.707+0000 7f888119b700 1 -- 172.21.15.71:0/2991445942 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887c0cb5e0 con 0x7f887c0b1850 2023-10-09T08:17:16.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.708+0000 7f888119b700 1 --2- 172.21.15.71:0/2991445942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f887c0b1850 0x7f887c0b1c20 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f88780099b0 tx=0x7f8878009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a39b068da2910f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:16.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.708+0000 7f8873fff700 1 -- 172.21.15.71:0/2991445942 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8878009ea0 con 0x7f887c0b1850 2023-10-09T08:17:16.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.708+0000 7f8873fff700 1 -- 172.21.15.71:0/2991445942 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887800b860 con 0x7f887c0b1850 2023-10-09T08:17:16.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.708+0000 7f8873fff700 1 -- 172.21.15.71:0/2991445942 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887800bc00 con 0x7f887c0b1850 2023-10-09T08:17:16.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.708+0000 7f88833ff700 1 -- 172.21.15.71:0/2991445942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f887c0b1850 msgr2=0x7f887c0b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:16.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.708+0000 7f88833ff700 1 --2- 172.21.15.71:0/2991445942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f887c0b1850 0x7f887c0b1c20 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f88780099b0 tx=0x7f8878009250 comp rx=0 tx=0).stop 2023-10-09T08:17:16.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.708+0000 7f88833ff700 1 -- 172.21.15.71:0/2991445942 shutdown_connections 2023-10-09T08:17:16.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.708+0000 7f88833ff700 1 --2- 172.21.15.71:0/2991445942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f887c0b1850 0x7f887c0b1c20 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:16.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.708+0000 7f88833ff700 1 --2- 172.21.15.71:0/2991445942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f887c0ae680 0x7f887c1572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:16.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.708+0000 7f88833ff700 1 -- 172.21.15.71:0/2991445942 >> 172.21.15.71:0/2991445942 conn(0x7f887c06a320 msgr2=0x7f887c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:16.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.708+0000 7f88833ff700 1 -- 172.21.15.71:0/2991445942 shutdown_connections 2023-10-09T08:17:16.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.709+0000 7f88833ff700 1 -- 172.21.15.71:0/2991445942 wait complete. 2023-10-09T08:17:16.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.710+0000 7f88833ff700 1 Processor -- start 2023-10-09T08:17:16.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.710+0000 7f88833ff700 1 -- start start 2023-10-09T08:17:16.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.711+0000 7f88833ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f887c0ae680 0x7f887c15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:16.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.711+0000 7f88833ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f887c0aead0 0x7f887c1535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:16.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.711+0000 7f88833ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f887c0b1850 0x7f887c15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:16.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.711+0000 7f88833ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c16b6e0 con 0x7f887c0b1850 2023-10-09T08:17:16.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.711+0000 7f88833ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c154690 con 0x7f887c0aead0 2023-10-09T08:17:16.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.711+0000 7f88833ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887c16adb0 con 0x7f887c0ae680 2023-10-09T08:17:16.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.711+0000 7f888199c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f887c0b1850 0x7f887c15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:16.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.711+0000 7f888199c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f887c0b1850 0x7f887c15b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39144/0 (socket says 172.21.15.71:39144) 2023-10-09T08:17:16.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.711+0000 7f888199c700 1 -- 172.21.15.71:0/3745747342 learned_addr learned my addr 172.21.15.71:0/3745747342 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:16.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.711+0000 7f888119b700 1 --2- 172.21.15.71:0/3745747342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f887c0ae680 0x7f887c15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:16.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.711+0000 7f888099a700 1 --2- 172.21.15.71:0/3745747342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f887c0aead0 0x7f887c1535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:16.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.712+0000 7f888199c700 1 -- 172.21.15.71:0/3745747342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f887c0ae680 msgr2=0x7f887c15eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:16.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.712+0000 7f888199c700 1 --2- 172.21.15.71:0/3745747342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f887c0ae680 0x7f887c15eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:16.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.712+0000 7f888199c700 1 -- 172.21.15.71:0/3745747342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f887c0aead0 msgr2=0x7f887c1535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:16.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.712+0000 7f888199c700 1 --2- 172.21.15.71:0/3745747342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f887c0aead0 0x7f887c1535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:16.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.712+0000 7f888199c700 1 -- 172.21.15.71:0/3745747342 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88780094f0 con 0x7f887c0b1850 2023-10-09T08:17:16.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.712+0000 7f888099a700 1 --2- 172.21.15.71:0/3745747342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f887c0aead0 0x7f887c1535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:17:16.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.712+0000 7f888199c700 1 --2- 172.21.15.71:0/3745747342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f887c0b1850 0x7f887c15b3c0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f887400c8e0 tx=0x7f8874001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:16.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.712+0000 7f88717fa700 1 -- 172.21.15.71:0/3745747342 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8874012630 con 0x7f887c0b1850 2023-10-09T08:17:16.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.712+0000 7f88717fa700 1 -- 172.21.15.71:0/3745747342 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8874012790 con 0x7f887c0b1850 2023-10-09T08:17:16.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.712+0000 7f88717fa700 1 -- 172.21.15.71:0/3745747342 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8874012b50 con 0x7f887c0b1850 2023-10-09T08:17:16.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.712+0000 7f88833ff700 1 -- 172.21.15.71:0/3745747342 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f887c16b090 con 0x7f887c0b1850 2023-10-09T08:17:16.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.712+0000 7f88833ff700 1 -- 172.21.15.71:0/3745747342 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887c16aa70 con 0x7f887c0b1850 2023-10-09T08:17:16.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.713+0000 7f88833ff700 1 -- 172.21.15.71:0/3745747342 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887c16b890 con 0x7f887c0b1850 2023-10-09T08:17:16.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.714+0000 7f88717fa700 1 -- 172.21.15.71:0/3745747342 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f887400a3b0 con 0x7f887c0b1850 2023-10-09T08:17:16.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.715+0000 7f88717fa700 1 --2- 172.21.15.71:0/3745747342 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8860066f30 0x7f88600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:16.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.715+0000 7f88717fa700 1 -- 172.21.15.71:0/3745747342 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5975+0+0 (secure 0 0 0) 0x7f8874084960 con 0x7f887c0b1850 2023-10-09T08:17:16.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.715+0000 7f888119b700 1 --2- 172.21.15.71:0/3745747342 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8860066f30 0x7f88600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:16.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.716+0000 7f888119b700 1 --2- 172.21.15.71:0/3745747342 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8860066f30 0x7f88600693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f88780099b0 tx=0x7f8878017000 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:16.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.719+0000 7f88717fa700 1 -- 172.21.15.71:0/3745747342 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f887c16b890 con 0x7f887c0b1850 2023-10-09T08:17:16.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:16.930+0000 7f88833ff700 1 -- 172.21.15.71:0/3745747342 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f887c04c3c0 con 0x7f887c0b1850 2023-10-09T08:17:17.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:17.835+0000 7f88717fa700 1 -- 172.21.15.71:0/3745747342 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v206) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8874051a20 con 0x7f887c0b1850 2023-10-09T08:17:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:17.837+0000 7f88833ff700 1 -- 172.21.15.71:0/3745747342 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8860066f30 msgr2=0x7f88600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:17.837+0000 7f88833ff700 1 --2- 172.21.15.71:0/3745747342 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8860066f30 0x7f88600693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f88780099b0 tx=0x7f8878017000 comp rx=0 tx=0).stop 2023-10-09T08:17:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:17.837+0000 7f88833ff700 1 -- 172.21.15.71:0/3745747342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f887c0b1850 msgr2=0x7f887c15b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:17.837+0000 7f88833ff700 1 --2- 172.21.15.71:0/3745747342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f887c0b1850 0x7f887c15b3c0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f887400c8e0 tx=0x7f8874001710 comp rx=0 tx=0).stop 2023-10-09T08:17:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:17.838+0000 7f88833ff700 1 -- 172.21.15.71:0/3745747342 shutdown_connections 2023-10-09T08:17:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:17.838+0000 7f88833ff700 1 --2- 172.21.15.71:0/3745747342 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8860066f30 0x7f88600693e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:17.838+0000 7f88833ff700 1 --2- 172.21.15.71:0/3745747342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f887c0b1850 0x7f887c15b3c0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:17.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:17.838+0000 7f88833ff700 1 --2- 172.21.15.71:0/3745747342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f887c0ae680 0x7f887c15eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:17.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:17.838+0000 7f88833ff700 1 --2- 172.21.15.71:0/3745747342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f887c0aead0 0x7f887c1535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:17.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:17.838+0000 7f88833ff700 1 -- 172.21.15.71:0/3745747342 >> 172.21.15.71:0/3745747342 conn(0x7f887c06a320 msgr2=0x7f887c0b0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:17.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:17.838+0000 7f88833ff700 1 -- 172.21.15.71:0/3745747342 shutdown_connections 2023-10-09T08:17:17.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:17.838+0000 7f88833ff700 1 -- 172.21.15.71:0/3745747342 wait complete. 2023-10-09T08:17:17.840 INFO:teuthology.orchestra.run.smithi071.stderr: removed all blocklist entries 2023-10-09T08:17:17.858 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T08:17:18.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.041+0000 7fc9de59d700 1 Processor -- start 2023-10-09T08:17:18.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.041+0000 7fc9de59d700 1 -- start start 2023-10-09T08:17:18.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.042+0000 7fc9de59d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc9d80c6a70 0x7fc9d806acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:18.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.042+0000 7fc9de59d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d806a840 con 0x7fc9d80ca660 2023-10-09T08:17:18.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.042+0000 7fc9de59d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d8069c30 con 0x7fc9d80696c0 2023-10-09T08:17:18.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.042+0000 7fc9de59d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d806b210 con 0x7fc9d80c6a70 2023-10-09T08:17:18.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.042+0000 7fc9ddd9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc9d80ca660 0x7fc9d806d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:49770/0 (socket says 172.21.15.71:49770) 2023-10-09T08:17:18.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.042+0000 7fc9ddd9c700 1 -- 172.21.15.71:0/2691450997 learned_addr learned my addr 172.21.15.71:0/2691450997 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:18.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.043+0000 7fc9dd59b700 1 --2- 172.21.15.71:0/2691450997 >> v2:172.21.15.179:3300/0 conn(0x7fc9d80c6a70 0x7fc9d806acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:18.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.043+0000 7fc9cffff700 1 -- 172.21.15.71:0/2691450997 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206535568 0 0) 0x7fc9d806a840 con 0x7fc9d80ca660 2023-10-09T08:17:18.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.043+0000 7fc9cffff700 1 -- 172.21.15.71:0/2691450997 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9c4003570 con 0x7fc9d80ca660 2023-10-09T08:17:18.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.043+0000 7fc9cffff700 1 -- 172.21.15.71:0/2691450997 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3181322989 0 0) 0x7fc9c4003570 con 0x7fc9d80ca660 2023-10-09T08:17:18.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.043+0000 7fc9dd59b700 1 -- 172.21.15.71:0/2691450997 >> v1:172.21.15.179:6789/0 conn(0x7fc9d80696c0 legacy=0x7fc9d80c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:18.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.043+0000 7fc9dd59b700 1 -- 172.21.15.71:0/2691450997 >> v1:172.21.15.71:6789/0 conn(0x7fc9d80ca660 legacy=0x7fc9d806d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:18.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.043+0000 7fc9dd59b700 1 -- 172.21.15.71:0/2691450997 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d8069f10 con 0x7fc9d80c6a70 2023-10-09T08:17:18.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.044+0000 7fc9dd59b700 1 --2- 172.21.15.71:0/2691450997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9d80c6a70 0x7fc9d806acd0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40098e0 tx=0x7fc9d40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c1dd18f62dd6da9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:18.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.044+0000 7fc9cffff700 1 -- 172.21.15.71:0/2691450997 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d00017f0 con 0x7fc9d80c6a70 2023-10-09T08:17:18.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.044+0000 7fc9cffff700 1 -- 172.21.15.71:0/2691450997 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d4011420 con 0x7fc9d80c6a70 2023-10-09T08:17:18.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.044+0000 7fc9cffff700 1 -- 172.21.15.71:0/2691450997 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d40117c0 con 0x7fc9d80c6a70 2023-10-09T08:17:18.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.044+0000 7fc9de59d700 1 -- 172.21.15.71:0/2691450997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9d80c6a70 msgr2=0x7fc9d806acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:18.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.044+0000 7fc9de59d700 1 --2- 172.21.15.71:0/2691450997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9d80c6a70 0x7fc9d806acd0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40098e0 tx=0x7fc9d40091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.044+0000 7fc9de59d700 1 -- 172.21.15.71:0/2691450997 shutdown_connections 2023-10-09T08:17:18.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.044+0000 7fc9de59d700 1 --2- 172.21.15.71:0/2691450997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9d80c6a70 0x7fc9d806acd0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.044+0000 7fc9de59d700 1 -- 172.21.15.71:0/2691450997 >> 172.21.15.71:0/2691450997 conn(0x7fc9d80cc1f0 msgr2=0x7fc9d80cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:18.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.044+0000 7fc9de59d700 1 -- 172.21.15.71:0/2691450997 shutdown_connections 2023-10-09T08:17:18.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.045+0000 7fc9de59d700 1 -- 172.21.15.71:0/2691450997 wait complete. 2023-10-09T08:17:18.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.046+0000 7fc9de59d700 1 Processor -- start 2023-10-09T08:17:18.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.046+0000 7fc9de59d700 1 -- start start 2023-10-09T08:17:18.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.047+0000 7fc9de59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9d80696c0 0x7fc9d8155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:18.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.047+0000 7fc9de59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9d80c6a70 0x7fc9d815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:18.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.047+0000 7fc9de59d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d80ca660 0x7fc9d8159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:18.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.047+0000 7fc9de59d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d8155790 con 0x7fc9d80ca660 2023-10-09T08:17:18.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.047+0000 7fc9de59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d81501c0 con 0x7fc9d80c6a70 2023-10-09T08:17:18.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.047+0000 7fc9de59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d815c420 con 0x7fc9d80696c0 2023-10-09T08:17:18.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.047+0000 7fc9ddd9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d80ca660 0x7fc9d8159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:18.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.047+0000 7fc9ddd9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d80ca660 0x7fc9d8159700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39146/0 (socket says 172.21.15.71:39146) 2023-10-09T08:17:18.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.047+0000 7fc9ddd9c700 1 -- 172.21.15.71:0/3587679077 learned_addr learned my addr 172.21.15.71:0/3587679077 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:18.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.047+0000 7fc9dd59b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9d80696c0 0x7fc9d8155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:18.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.047+0000 7fc9dcd9a700 1 --2- 172.21.15.71:0/3587679077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9d80c6a70 0x7fc9d815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:18.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.048+0000 7fc9ddd9c700 1 -- 172.21.15.71:0/3587679077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9d80696c0 msgr2=0x7fc9d8155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:18.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.048+0000 7fc9ddd9c700 1 --2- 172.21.15.71:0/3587679077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9d80696c0 0x7fc9d8155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.048+0000 7fc9ddd9c700 1 -- 172.21.15.71:0/3587679077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9d80c6a70 msgr2=0x7fc9d815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:18.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.048+0000 7fc9ddd9c700 1 --2- 172.21.15.71:0/3587679077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9d80c6a70 0x7fc9d815bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.048+0000 7fc9ddd9c700 1 -- 172.21.15.71:0/3587679077 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d4009420 con 0x7fc9d80ca660 2023-10-09T08:17:18.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.048+0000 7fc9ddd9c700 1 --2- 172.21.15.71:0/3587679077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d80ca660 0x7fc9d8159700 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000ccc0 tx=0x7fc9d00018e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:18.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.048+0000 7fc9cd7fa700 1 -- 172.21.15.71:0/3587679077 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0004dc0 con 0x7fc9d80ca660 2023-10-09T08:17:18.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.048+0000 7fc9cd7fa700 1 -- 172.21.15.71:0/3587679077 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d000a5f0 con 0x7fc9d80ca660 2023-10-09T08:17:18.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.048+0000 7fc9de59d700 1 -- 172.21.15.71:0/3587679077 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d81541b0 con 0x7fc9d80ca660 2023-10-09T08:17:18.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.048+0000 7fc9cd7fa700 1 -- 172.21.15.71:0/3587679077 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d000a9b0 con 0x7fc9d80ca660 2023-10-09T08:17:18.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.048+0000 7fc9de59d700 1 -- 172.21.15.71:0/3587679077 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d81547f0 con 0x7fc9d80ca660 2023-10-09T08:17:18.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.049+0000 7fc9de59d700 1 -- 172.21.15.71:0/3587679077 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d804c3c0 con 0x7fc9d80ca660 2023-10-09T08:17:18.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.050+0000 7fc9cd7fa700 1 -- 172.21.15.71:0/3587679077 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc9d0007150 con 0x7fc9d80ca660 2023-10-09T08:17:18.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.051+0000 7fc9cd7fa700 1 --2- 172.21.15.71:0/3587679077 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc9bc066f30 0x7fc9bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:18.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.051+0000 7fc9cd7fa700 1 -- 172.21.15.71:0/3587679077 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 5373+0+0 (secure 0 0 0) 0x7fc9d0083a00 con 0x7fc9d80ca660 2023-10-09T08:17:18.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.052+0000 7fc9dd59b700 1 --2- 172.21.15.71:0/3587679077 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc9bc066f30 0x7fc9bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:18.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.052+0000 7fc9dd59b700 1 --2- 172.21.15.71:0/3587679077 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc9bc066f30 0x7fc9bc0693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40030c0 tx=0x7fc9d4017000 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:18.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.055+0000 7fc9cd7fa700 1 -- 172.21.15.71:0/3587679077 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9d0050da0 con 0x7fc9d80ca660 2023-10-09T08:17:18.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.317+0000 7fc9de59d700 1 -- 172.21.15.71:0/3587679077 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc9d80cb2e0 con 0x7fc9d80ca660 2023-10-09T08:17:18.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.318+0000 7fc9cd7fa700 1 -- 172.21.15.71:0/3587679077 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v49) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fc9d0018020 con 0x7fc9d80ca660 2023-10-09T08:17:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:18.319 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T08:17:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_dump": [ 2023-10-09T08:17:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:17:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.a", 2023-10-09T08:17:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlpI5JCRAAGBgrs6g+6KZFXv1eq0fkwQ==", 2023-10-09T08:17:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:17:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T08:17:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T08:17:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T08:17:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:17:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:17:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:17:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:17:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.b", 2023-10-09T08:17:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlDZQYHhAA2LGKHPLrBVKlGMK0TKup7A==", 2023-10-09T08:17:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:17:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T08:17:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T08:17:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T08:17:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:17:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:17:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:17:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:17:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.c", 2023-10-09T08:17:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlLKKfExAA65+KIyYd16iQ2L5topDPkg==", 2023-10-09T08:17:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:17:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T08:17:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T08:17:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T08:17:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:17:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:17:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:17:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:17:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.d", 2023-10-09T08:17:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlpQKTKBAAP59h/znElthIdqbK9tKJww==", 2023-10-09T08:17:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:17:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T08:17:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T08:17:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T08:17:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:17:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:17:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:17:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:17:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.0", 2023-10-09T08:17:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCgoCNll7hBIBAAtZ8mBx+MPAwEou48boP4Hw==", 2023-10-09T08:17:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:17:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T08:17:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T08:17:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:17:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:17:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:17:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:17:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.1", 2023-10-09T08:17:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCjoCNl7uRMIxAAztQi4ZsulyN2FHcMRzZ82Q==", 2023-10-09T08:17:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:17:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T08:17:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T08:17:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:17:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:17:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:17:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:17:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.2", 2023-10-09T08:17:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCmoCNlW/cNJhAAfFdnRC95YJwpCngJS956cA==", 2023-10-09T08:17:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:17:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T08:17:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T08:17:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:17:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:17:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:17:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:17:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.3", 2023-10-09T08:17:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCpoCNlAIlYKRAAD5IGHWZ14ckpQAU4wBifbg==", 2023-10-09T08:17:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:17:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T08:17:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T08:17:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:17:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:17:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:17:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:17:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.4", 2023-10-09T08:17:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCvoCNltrA4ORAAtifmL9hr1xKd+jsMf5Nf+Q==", 2023-10-09T08:17:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:17:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T08:17:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T08:17:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:17:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:17:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:17:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:17:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.5", 2023-10-09T08:17:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCyoCNlA/IOOxAAQWRPQ+00o9xrpScAvY/87w==", 2023-10-09T08:17:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:17:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T08:17:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T08:17:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:17:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:17:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:17:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:17:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.6", 2023-10-09T08:17:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQC2oCNlvRusARAAcRaGyCROIRVTHeKhrncN8g==", 2023-10-09T08:17:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:17:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T08:17:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T08:17:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:17:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:17:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:17:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:17:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.7", 2023-10-09T08:17:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQC5oCNli/3NAxAAIMYuED41ZSx1xF384N6y1A==", 2023-10-09T08:17:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:17:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-09T08:17:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-09T08:17:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:17:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:17:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:17:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:17:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.0", 2023-10-09T08:17:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlHrKWMRAAyIfmryGSgqIFwWEJyixprw==", 2023-10-09T08:17:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:17:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T08:17:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow r", 2023-10-09T08:17:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T08:17:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:17:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:17:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:17:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.1", 2023-10-09T08:17:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCdoCNldq1xAxAAxCpmelS0qDEY187u19JkcQ==", 2023-10-09T08:17:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:17:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T08:17:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T08:17:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T08:17:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T08:17:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:17:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:17:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:17:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.2", 2023-10-09T08:17:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlM3JHOBAA8fszREXH+WnYb+3vIaakcA==", 2023-10-09T08:17:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:17:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T08:17:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T08:17:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T08:17:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T08:17:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:17:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:17:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:17:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.3", 2023-10-09T08:17:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCdoCNlgkEqChAAwntdv9UOo30x40pVa70yag==", 2023-10-09T08:17:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:17:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-09T08:17:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-09T08:17:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-09T08:17:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-09T08:17:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:17:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:17:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:17:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.admin", 2023-10-09T08:17:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCboCNlj2W4EhAAUnfX6NBeDyMj2nY/G2ciEg==", 2023-10-09T08:17:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:17:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T08:17:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-09T08:17:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-09T08:17:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:17:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:17:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:17:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:17:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.x", 2023-10-09T08:17:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCcoCNlwwJ/AhAAjHMhAX1/yWgh9no7yQqP6Q==", 2023-10-09T08:17:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:17:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T08:17:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-09T08:17:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:17:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:17:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-09T08:17:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:17:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.y", 2023-10-09T08:17:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQCboCNly/XVNRAAlKr9arCbsDbzZ9bpIU5dng==", 2023-10-09T08:17:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-09T08:17:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-09T08:17:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-09T08:17:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-09T08:17:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:17:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:17:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2023-10-09T08:17:18.335 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T08:17:18.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.320+0000 7fc9de59d700 1 -- 172.21.15.71:0/3587679077 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc9bc066f30 msgr2=0x7fc9bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:18.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.320+0000 7fc9de59d700 1 --2- 172.21.15.71:0/3587679077 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc9bc066f30 0x7fc9bc0693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40030c0 tx=0x7fc9d4017000 comp rx=0 tx=0).stop 2023-10-09T08:17:18.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.320+0000 7fc9de59d700 1 -- 172.21.15.71:0/3587679077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d80ca660 msgr2=0x7fc9d8159700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:18.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.320+0000 7fc9de59d700 1 --2- 172.21.15.71:0/3587679077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d80ca660 0x7fc9d8159700 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000ccc0 tx=0x7fc9d00018e0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.320+0000 7fc9de59d700 1 -- 172.21.15.71:0/3587679077 shutdown_connections 2023-10-09T08:17:18.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.320+0000 7fc9de59d700 1 --2- 172.21.15.71:0/3587679077 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc9bc066f30 0x7fc9bc0693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.320+0000 7fc9de59d700 1 --2- 172.21.15.71:0/3587679077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d80ca660 0x7fc9d8159700 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.320+0000 7fc9de59d700 1 --2- 172.21.15.71:0/3587679077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9d80696c0 0x7fc9d8155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.320+0000 7fc9de59d700 1 --2- 172.21.15.71:0/3587679077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9d80c6a70 0x7fc9d815bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.320+0000 7fc9de59d700 1 -- 172.21.15.71:0/3587679077 >> 172.21.15.71:0/3587679077 conn(0x7fc9d80cc1f0 msgr2=0x7fc9d80c26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:18.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.320+0000 7fc9de59d700 1 -- 172.21.15.71:0/3587679077 shutdown_connections 2023-10-09T08:17:18.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.320+0000 7fc9de59d700 1 -- 172.21.15.71:0/3587679077 wait complete. 2023-10-09T08:17:18.338 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T08:17:18.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.519+0000 7fb16f7ff700 1 Processor -- start 2023-10-09T08:17:18.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.519+0000 7fb16f7ff700 1 -- start start 2023-10-09T08:17:18.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.520+0000 7fb16f7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb1680cbf30 0x7fb1680ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:18.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.520+0000 7fb16f7ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1680cc300 con 0x7fb1680ccf90 2023-10-09T08:17:18.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.520+0000 7fb16f7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1680ad370 con 0x7fb1680b1420 2023-10-09T08:17:18.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.520+0000 7fb16f7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb168156bf0 con 0x7fb1680cbf30 2023-10-09T08:17:18.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.521+0000 7fb16cd9a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb1680ccf90 0x7fb1680b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:49778/0 (socket says 172.21.15.71:49778) 2023-10-09T08:17:18.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.521+0000 7fb16cd9a700 1 -- 172.21.15.71:0/2677648798 learned_addr learned my addr 172.21.15.71:0/2677648798 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:18.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.521+0000 7fb16d59b700 1 --2- 172.21.15.71:0/2677648798 >> v2:172.21.15.179:3300/0 conn(0x7fb1680cbf30 0x7fb1680ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:18.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.521+0000 7fb15ffff700 1 -- 172.21.15.71:0/2677648798 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496375069 0 0) 0x7fb1680cc300 con 0x7fb1680ccf90 2023-10-09T08:17:18.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.521+0000 7fb15ffff700 1 -- 172.21.15.71:0/2677648798 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb154003570 con 0x7fb1680ccf90 2023-10-09T08:17:18.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.521+0000 7fb15ffff700 1 -- 172.21.15.71:0/2677648798 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2183659203 0 0) 0x7fb154003570 con 0x7fb1680ccf90 2023-10-09T08:17:18.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.521+0000 7fb15ffff700 1 -- 172.21.15.71:0/2677648798 >> v2:172.21.15.179:3300/0 conn(0x7fb1680cbf30 msgr2=0x7fb1680ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:18.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.521+0000 7fb15ffff700 1 --2- 172.21.15.71:0/2677648798 >> v2:172.21.15.179:3300/0 conn(0x7fb1680cbf30 0x7fb1680ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.521+0000 7fb15ffff700 1 -- 172.21.15.71:0/2677648798 >> v1:172.21.15.179:6789/0 conn(0x7fb1680b1420 legacy=0x7fb1680c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:18.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.521+0000 7fb15ffff700 1 -- 172.21.15.71:0/2677648798 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1680ad650 con 0x7fb1680ccf90 2023-10-09T08:17:18.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.521+0000 7fb15ffff700 1 -- 172.21.15.71:0/2677648798 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fb158001470 con 0x7fb1680ccf90 2023-10-09T08:17:18.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.521+0000 7fb15ffff700 1 -- 172.21.15.71:0/2677648798 >> v1:172.21.15.71:6789/0 conn(0x7fb1680ccf90 legacy=0x7fb1680b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:18.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.521+0000 7fb15ffff700 1 --2- 172.21.15.71:0/2677648798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb154003a60 0x7fb154003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:18.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.521+0000 7fb15ffff700 1 --2- 172.21.15.71:0/2677648798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb154004810 0x7fb154004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:18.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.521+0000 7fb15ffff700 1 --2- 172.21.15.71:0/2677648798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1540051c0 0x7fb15400dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:18.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.522+0000 7fb15ffff700 1 -- 172.21.15.71:0/2677648798 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb168156bf0 con 0x7fb1540051c0 2023-10-09T08:17:18.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.522+0000 7fb15ffff700 1 -- 172.21.15.71:0/2677648798 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15400e260 con 0x7fb154004810 2023-10-09T08:17:18.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.522+0000 7fb15ffff700 1 -- 172.21.15.71:0/2677648798 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb15400e420 con 0x7fb154003a60 2023-10-09T08:17:18.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.522+0000 7fb16dd9c700 1 --2- 172.21.15.71:0/2677648798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1540051c0 0x7fb15400dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:18.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.522+0000 7fb16cd9a700 1 --2- 172.21.15.71:0/2677648798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb154004810 0x7fb154004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:18.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.522+0000 7fb16d59b700 1 --2- 172.21.15.71:0/2677648798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb154003a60 0x7fb154003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:18.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.522+0000 7fb16dd9c700 1 -- 172.21.15.71:0/2677648798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb154003a60 msgr2=0x7fb154003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:18.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.522+0000 7fb16dd9c700 1 --2- 172.21.15.71:0/2677648798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb154003a60 0x7fb154003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.522+0000 7fb16dd9c700 1 -- 172.21.15.71:0/2677648798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb154004810 msgr2=0x7fb154004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:18.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.522+0000 7fb16dd9c700 1 --2- 172.21.15.71:0/2677648798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb154004810 0x7fb154004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.522+0000 7fb16dd9c700 1 -- 172.21.15.71:0/2677648798 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb154003570 con 0x7fb1540051c0 2023-10-09T08:17:18.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.522+0000 7fb16dd9c700 1 -- 172.21.15.71:0/2677648798 reap_dead start 2023-10-09T08:17:18.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.522+0000 7fb16dd9c700 1 --2- 172.21.15.71:0/2677648798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1540051c0 0x7fb15400dc70 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fb1600020a0 tx=0x7fb1600016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5930484f7d2c902 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:18.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.523+0000 7fb15ffff700 1 -- 172.21.15.71:0/2677648798 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1600019e0 con 0x7fb1540051c0 2023-10-09T08:17:18.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.523+0000 7fb15ffff700 1 -- 172.21.15.71:0/2677648798 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16000c8b0 con 0x7fb1540051c0 2023-10-09T08:17:18.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.523+0000 7fb15ffff700 1 -- 172.21.15.71:0/2677648798 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16000cc50 con 0x7fb1540051c0 2023-10-09T08:17:18.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.523+0000 7fb16f7ff700 1 -- 172.21.15.71:0/2677648798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1540051c0 msgr2=0x7fb15400dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:18.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.523+0000 7fb16f7ff700 1 --2- 172.21.15.71:0/2677648798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1540051c0 0x7fb15400dc70 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fb1600020a0 tx=0x7fb1600016d0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.523+0000 7fb16f7ff700 1 -- 172.21.15.71:0/2677648798 shutdown_connections 2023-10-09T08:17:18.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.523+0000 7fb16f7ff700 1 --2- 172.21.15.71:0/2677648798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1540051c0 0x7fb15400dc70 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.523+0000 7fb16f7ff700 1 -- 172.21.15.71:0/2677648798 >> 172.21.15.71:0/2677648798 conn(0x7fb16806a320 msgr2=0x7fb1680cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:18.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.523+0000 7fb16f7ff700 1 -- 172.21.15.71:0/2677648798 shutdown_connections 2023-10-09T08:17:18.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.523+0000 7fb16f7ff700 1 -- 172.21.15.71:0/2677648798 wait complete. 2023-10-09T08:17:18.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.525+0000 7fb16f7ff700 1 Processor -- start 2023-10-09T08:17:18.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.525+0000 7fb16f7ff700 1 -- start start 2023-10-09T08:17:18.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.526+0000 7fb16f7ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1540051c0 0x7fb1680c2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:18.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.526+0000 7fb16f7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1680ca7d0 0x7fb1680c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:18.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.526+0000 7fb16f7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1680c8080 0x7fb1680c5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:18.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.526+0000 7fb16f7ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb168169410 con 0x7fb1540051c0 2023-10-09T08:17:18.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.526+0000 7fb16f7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1681696f0 con 0x7fb1680c8080 2023-10-09T08:17:18.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.526+0000 7fb16f7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1681699d0 con 0x7fb1680ca7d0 2023-10-09T08:17:18.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.526+0000 7fb16d59b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1540051c0 0x7fb1680c2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:18.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.526+0000 7fb16d59b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1540051c0 0x7fb1680c2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39160/0 (socket says 172.21.15.71:39160) 2023-10-09T08:17:18.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.526+0000 7fb16d59b700 1 -- 172.21.15.71:0/1536550655 learned_addr learned my addr 172.21.15.71:0/1536550655 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:18.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.526+0000 7fb16cd9a700 1 --2- 172.21.15.71:0/1536550655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1680ca7d0 0x7fb1680c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:18.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.526+0000 7fb16dd9c700 1 --2- 172.21.15.71:0/1536550655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1680c8080 0x7fb1680c5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:18.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.527+0000 7fb16d59b700 1 -- 172.21.15.71:0/1536550655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1680ca7d0 msgr2=0x7fb1680c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:18.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.527+0000 7fb16d59b700 1 --2- 172.21.15.71:0/1536550655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1680ca7d0 0x7fb1680c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.527+0000 7fb16d59b700 1 -- 172.21.15.71:0/1536550655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1680c8080 msgr2=0x7fb1680c5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:18.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.527+0000 7fb16d59b700 1 --2- 172.21.15.71:0/1536550655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1680c8080 0x7fb1680c5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.527+0000 7fb16d59b700 1 -- 172.21.15.71:0/1536550655 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb168169cb0 con 0x7fb1540051c0 2023-10-09T08:17:18.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.527+0000 7fb16d59b700 1 --2- 172.21.15.71:0/1536550655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1540051c0 0x7fb1680c2e90 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fb164006ac0 tx=0x7fb1640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:18.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.527+0000 7fb15d7fa700 1 -- 172.21.15.71:0/1536550655 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb164011ec0 con 0x7fb1540051c0 2023-10-09T08:17:18.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.527+0000 7fb15d7fa700 1 -- 172.21.15.71:0/1536550655 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16400f940 con 0x7fb1540051c0 2023-10-09T08:17:18.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.527+0000 7fb16f7ff700 1 -- 172.21.15.71:0/1536550655 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1681690a0 con 0x7fb1540051c0 2023-10-09T08:17:18.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.527+0000 7fb15d7fa700 1 -- 172.21.15.71:0/1536550655 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16400fcc0 con 0x7fb1540051c0 2023-10-09T08:17:18.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.527+0000 7fb16f7ff700 1 -- 172.21.15.71:0/1536550655 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1680cae00 con 0x7fb1540051c0 2023-10-09T08:17:18.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.528+0000 7fb16f7ff700 1 -- 172.21.15.71:0/1536550655 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb16804c3c0 con 0x7fb1540051c0 2023-10-09T08:17:18.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.529+0000 7fb15d7fa700 1 -- 172.21.15.71:0/1536550655 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb164014650 con 0x7fb1540051c0 2023-10-09T08:17:18.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.530+0000 7fb15d7fa700 1 --2- 172.21.15.71:0/1536550655 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb14c066f30 0x7fb14c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:18.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.530+0000 7fb15d7fa700 1 -- 172.21.15.71:0/1536550655 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 5373+0+0 (secure 0 0 0) 0x7fb164018030 con 0x7fb1540051c0 2023-10-09T08:17:18.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.530+0000 7fb16cd9a700 1 --2- 172.21.15.71:0/1536550655 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb14c066f30 0x7fb14c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:18.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.531+0000 7fb16cd9a700 1 --2- 172.21.15.71:0/1536550655 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb14c066f30 0x7fb14c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb158000e50 tx=0x7fb158001df0 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:18.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.534+0000 7fb15d7fa700 1 -- 172.21.15.71:0/1536550655 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb164052070 con 0x7fb1540051c0 2023-10-09T08:17:18.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.724+0000 7fb16f7ff700 1 -- 172.21.15.71:0/1536550655 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1680c1470 con 0x7fb1540051c0 2023-10-09T08:17:18.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.725+0000 7fb15d7fa700 1 -- 172.21.15.71:0/1536550655 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v206) v1 ==== 74+0+12945 (secure 0 0 0) 0x7fb164022090 con 0x7fb1540051c0 2023-10-09T08:17:18.726 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:18.727 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":206,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T08:17:17.829572+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T08:17:18.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.727+0000 7fb16f7ff700 1 -- 172.21.15.71:0/1536550655 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb14c066f30 msgr2=0x7fb14c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:18.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.727+0000 7fb16f7ff700 1 --2- 172.21.15.71:0/1536550655 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb14c066f30 0x7fb14c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb158000e50 tx=0x7fb158001df0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.728+0000 7fb16f7ff700 1 -- 172.21.15.71:0/1536550655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1540051c0 msgr2=0x7fb1680c2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:18.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.728+0000 7fb16f7ff700 1 --2- 172.21.15.71:0/1536550655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1540051c0 0x7fb1680c2e90 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fb164006ac0 tx=0x7fb1640091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.728+0000 7fb16f7ff700 1 -- 172.21.15.71:0/1536550655 shutdown_connections 2023-10-09T08:17:18.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.728+0000 7fb16f7ff700 1 --2- 172.21.15.71:0/1536550655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1680c8080 0x7fb1680c5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.728+0000 7fb16f7ff700 1 --2- 172.21.15.71:0/1536550655 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb14c066f30 0x7fb14c0693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.728+0000 7fb16f7ff700 1 --2- 172.21.15.71:0/1536550655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1540051c0 0x7fb1680c2e90 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.728+0000 7fb16f7ff700 1 --2- 172.21.15.71:0/1536550655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1680ca7d0 0x7fb1680c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.728+0000 7fb16f7ff700 1 -- 172.21.15.71:0/1536550655 >> 172.21.15.71:0/1536550655 conn(0x7fb16806a320 msgr2=0x7fb1680c9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:18.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.728+0000 7fb16f7ff700 1 -- 172.21.15.71:0/1536550655 shutdown_connections 2023-10-09T08:17:18.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.728+0000 7fb16f7ff700 1 -- 172.21.15.71:0/1536550655 wait complete. 2023-10-09T08:17:18.746 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T08:17:18.747 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T08:17:18.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.930+0000 7f48b45ff700 1 Processor -- start 2023-10-09T08:17:18.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.930+0000 7f48b45ff700 1 -- start start 2023-10-09T08:17:18.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.931+0000 7f48b45ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f48ac069770 0x7f48ac069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:18.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.931+0000 7f48b45ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48ac06e950 con 0x7f48ac155eb0 2023-10-09T08:17:18.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.931+0000 7f48b45ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48ac156320 con 0x7f48ac0c70b0 2023-10-09T08:17:18.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.931+0000 7f48b45ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48ac0cd350 con 0x7f48ac069770 2023-10-09T08:17:18.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.932+0000 7f48b1b9a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f48ac155eb0 0x7f48ac06e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:49782/0 (socket says 172.21.15.71:49782) 2023-10-09T08:17:18.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.932+0000 7f48b1b9a700 1 -- 172.21.15.71:0/3177690317 learned_addr learned my addr 172.21.15.71:0/3177690317 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:18.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.932+0000 7f48b2b9c700 1 --2- 172.21.15.71:0/3177690317 >> v2:172.21.15.179:3300/0 conn(0x7f48ac069770 0x7f48ac069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:18.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.932+0000 7f48b1399700 1 -- 172.21.15.71:0/3177690317 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 222966169 0 0) 0x7f489c001110 con 0x7f48ac155eb0 2023-10-09T08:17:18.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.932+0000 7f48b1399700 1 -- 172.21.15.71:0/3177690317 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4898003570 con 0x7f48ac155eb0 2023-10-09T08:17:18.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.932+0000 7f48b1399700 1 -- 172.21.15.71:0/3177690317 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2122935065 0 0) 0x7f48ac156320 con 0x7f48ac0c70b0 2023-10-09T08:17:18.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.932+0000 7f48b1399700 1 -- 172.21.15.71:0/3177690317 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f489c001110 con 0x7f48ac0c70b0 2023-10-09T08:17:18.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.932+0000 7f48b1399700 1 -- 172.21.15.71:0/3177690317 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 790563759 0 0) 0x7f4898003570 con 0x7f48ac155eb0 2023-10-09T08:17:18.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.932+0000 7f48b1399700 1 -- 172.21.15.71:0/3177690317 >> v2:172.21.15.179:3300/0 conn(0x7f48ac069770 msgr2=0x7f48ac069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:18.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.932+0000 7f48b1399700 1 --2- 172.21.15.71:0/3177690317 >> v2:172.21.15.179:3300/0 conn(0x7f48ac069770 0x7f48ac069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.932+0000 7f48b1399700 1 -- 172.21.15.71:0/3177690317 >> v1:172.21.15.179:6789/0 conn(0x7f48ac0c70b0 legacy=0x7f48ac0ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:18.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.932+0000 7f48b1399700 1 -- 172.21.15.71:0/3177690317 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac06eb90 con 0x7f48ac155eb0 2023-10-09T08:17:18.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.932+0000 7f48b1399700 1 -- 172.21.15.71:0/3177690317 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f489c001600 con 0x7f48ac155eb0 2023-10-09T08:17:18.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.932+0000 7f48b1399700 1 -- 172.21.15.71:0/3177690317 >> v1:172.21.15.71:6789/0 conn(0x7f48ac155eb0 legacy=0x7f48ac06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:18.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.933+0000 7f48b1399700 1 --2- 172.21.15.71:0/3177690317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4898003c40 0x7f4898004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:18.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.933+0000 7f48b1399700 1 --2- 172.21.15.71:0/3177690317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4898004810 0x7f4898004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:18.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.933+0000 7f48b1399700 1 --2- 172.21.15.71:0/3177690317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4898005210 0x7f489800dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:18.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.933+0000 7f48b1399700 1 -- 172.21.15.71:0/3177690317 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac0cd350 con 0x7f4898005210 2023-10-09T08:17:18.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.933+0000 7f48b1399700 1 -- 172.21.15.71:0/3177690317 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489800e340 con 0x7f4898004810 2023-10-09T08:17:18.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.933+0000 7f48b1399700 1 -- 172.21.15.71:0/3177690317 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489800e4d0 con 0x7f4898003c40 2023-10-09T08:17:18.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.933+0000 7f48b2b9c700 1 --2- 172.21.15.71:0/3177690317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4898005210 0x7f489800dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:18.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.933+0000 7f48b1b9a700 1 --2- 172.21.15.71:0/3177690317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4898004810 0x7f4898004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:18.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.933+0000 7f48b239b700 1 --2- 172.21.15.71:0/3177690317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4898003c40 0x7f4898004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:18.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.933+0000 7f48b2b9c700 1 -- 172.21.15.71:0/3177690317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4898003c40 msgr2=0x7f4898004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:18.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.933+0000 7f48b2b9c700 1 --2- 172.21.15.71:0/3177690317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4898003c40 0x7f4898004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.933+0000 7f48b2b9c700 1 -- 172.21.15.71:0/3177690317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4898004810 msgr2=0x7f4898004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:18.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.933+0000 7f48b2b9c700 1 --2- 172.21.15.71:0/3177690317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4898004810 0x7f4898004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.933+0000 7f48b2b9c700 1 -- 172.21.15.71:0/3177690317 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4898003570 con 0x7f4898005210 2023-10-09T08:17:18.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.933+0000 7f48b239b700 1 --2- 172.21.15.71:0/3177690317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4898003c40 0x7f4898004030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:17:18.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.933+0000 7f48b1b9a700 1 --2- 172.21.15.71:0/3177690317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4898004810 0x7f4898004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:17:18.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.933+0000 7f48b2b9c700 1 -- 172.21.15.71:0/3177690317 reap_dead start 2023-10-09T08:17:18.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.933+0000 7f48b2b9c700 1 --2- 172.21.15.71:0/3177690317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4898005210 0x7f489800dc70 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f48a400e240 tx=0x7f48a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ab06b0c5dced88 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:18.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.934+0000 7f48b1399700 1 -- 172.21.15.71:0/3177690317 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a4009ac0 con 0x7f4898005210 2023-10-09T08:17:18.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.934+0000 7f48b1399700 1 -- 172.21.15.71:0/3177690317 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a400f040 con 0x7f4898005210 2023-10-09T08:17:18.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.934+0000 7f48b1399700 1 -- 172.21.15.71:0/3177690317 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a400ed40 con 0x7f4898005210 2023-10-09T08:17:18.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.934+0000 7f48b45ff700 1 -- 172.21.15.71:0/3177690317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4898005210 msgr2=0x7f489800dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:18.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.934+0000 7f48b45ff700 1 --2- 172.21.15.71:0/3177690317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4898005210 0x7f489800dc70 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f48a400e240 tx=0x7f48a400b040 comp rx=0 tx=0).stop 2023-10-09T08:17:18.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.934+0000 7f48b45ff700 1 -- 172.21.15.71:0/3177690317 shutdown_connections 2023-10-09T08:17:18.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.934+0000 7f48b45ff700 1 --2- 172.21.15.71:0/3177690317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4898005210 0x7f489800dc70 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.934+0000 7f48b45ff700 1 -- 172.21.15.71:0/3177690317 >> 172.21.15.71:0/3177690317 conn(0x7f48ac068e10 msgr2=0x7f48ac0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:18.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.934+0000 7f48b45ff700 1 -- 172.21.15.71:0/3177690317 shutdown_connections 2023-10-09T08:17:18.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.934+0000 7f48b45ff700 1 -- 172.21.15.71:0/3177690317 wait complete. 2023-10-09T08:17:18.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.936+0000 7f48b45ff700 1 Processor -- start 2023-10-09T08:17:18.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.936+0000 7f48b45ff700 1 -- start start 2023-10-09T08:17:18.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.937+0000 7f48b45ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4898005210 0x7f48ac1585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:18.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.937+0000 7f48b45ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48ac157a50 0x7f48ac165550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:18.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.937+0000 7f48b45ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48ac165a90 0x7f48ac165f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:18.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.937+0000 7f48b45ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac166450 con 0x7f4898005210 2023-10-09T08:17:18.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.937+0000 7f48b45ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac15ae90 con 0x7f48ac165a90 2023-10-09T08:17:18.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.937+0000 7f48b45ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac158ed0 con 0x7f48ac157a50 2023-10-09T08:17:18.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.937+0000 7f48b239b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4898005210 0x7f48ac1585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:18.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.937+0000 7f48b239b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4898005210 0x7f48ac1585d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39180/0 (socket says 172.21.15.71:39180) 2023-10-09T08:17:18.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.937+0000 7f48b239b700 1 -- 172.21.15.71:0/3887202270 learned_addr learned my addr 172.21.15.71:0/3887202270 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:18.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.937+0000 7f48b2b9c700 1 --2- 172.21.15.71:0/3887202270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48ac165a90 0x7f48ac165f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:18.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.937+0000 7f48b1b9a700 1 --2- 172.21.15.71:0/3887202270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48ac157a50 0x7f48ac165550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:18.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.937+0000 7f48b239b700 1 -- 172.21.15.71:0/3887202270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48ac157a50 msgr2=0x7f48ac165550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:18.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.937+0000 7f48b239b700 1 --2- 172.21.15.71:0/3887202270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48ac157a50 0x7f48ac165550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.937+0000 7f48b239b700 1 -- 172.21.15.71:0/3887202270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48ac165a90 msgr2=0x7f48ac165f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:18.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.937+0000 7f48b239b700 1 --2- 172.21.15.71:0/3887202270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48ac165a90 0x7f48ac165f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:18.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.937+0000 7f48b239b700 1 -- 172.21.15.71:0/3887202270 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac1591b0 con 0x7f4898005210 2023-10-09T08:17:18.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.937+0000 7f48b239b700 1 --2- 172.21.15.71:0/3887202270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4898005210 0x7f48ac1585d0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f48a800e7b0 tx=0x7f48a8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:18.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.938+0000 7f48a27fc700 1 -- 172.21.15.71:0/3887202270 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a80026a0 con 0x7f4898005210 2023-10-09T08:17:18.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.938+0000 7f48a27fc700 1 -- 172.21.15.71:0/3887202270 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a8010040 con 0x7f4898005210 2023-10-09T08:17:18.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.938+0000 7f48b45ff700 1 -- 172.21.15.71:0/3887202270 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ac159490 con 0x7f4898005210 2023-10-09T08:17:18.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.938+0000 7f48a27fc700 1 -- 172.21.15.71:0/3887202270 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a8002a50 con 0x7f4898005210 2023-10-09T08:17:18.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.938+0000 7f48b45ff700 1 -- 172.21.15.71:0/3887202270 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ac1547d0 con 0x7f4898005210 2023-10-09T08:17:18.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.939+0000 7f48b45ff700 1 -- 172.21.15.71:0/3887202270 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48ac04c3c0 con 0x7f4898005210 2023-10-09T08:17:18.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.940+0000 7f48a27fc700 1 -- 172.21.15.71:0/3887202270 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48a80143f0 con 0x7f4898005210 2023-10-09T08:17:18.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.941+0000 7f48a27fc700 1 --2- 172.21.15.71:0/3887202270 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f4890066f30 0x7f48900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:18.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.941+0000 7f48a27fc700 1 -- 172.21.15.71:0/3887202270 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 5373+0+0 (secure 0 0 0) 0x7f48a8083e10 con 0x7f4898005210 2023-10-09T08:17:18.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.941+0000 7f48b1b9a700 1 --2- 172.21.15.71:0/3887202270 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f4890066f30 0x7f48900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:18.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.942+0000 7f48b1b9a700 1 --2- 172.21.15.71:0/3887202270 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f4890066f30 0x7f48900693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f489c000e10 tx=0x7f489c009040 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:18.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:18.945+0000 7f48a27fc700 1 -- 172.21.15.71:0/3887202270 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48a804d5a0 con 0x7f4898005210 2023-10-09T08:17:19.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.135+0000 7f48b45ff700 1 -- 172.21.15.71:0/3887202270 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f48ac0c7790 con 0x7f4898005210 2023-10-09T08:17:19.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.136+0000 7f48a27fc700 1 -- 172.21.15.71:0/3887202270 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v206) v1 ==== 93+0+10 (secure 0 0 0) 0x7f48a8019020 con 0x7f4898005210 2023-10-09T08:17:19.137 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T08:17:19.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.138+0000 7f48b45ff700 1 -- 172.21.15.71:0/3887202270 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f4890066f30 msgr2=0x7f48900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:19.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.138+0000 7f48b45ff700 1 --2- 172.21.15.71:0/3887202270 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f4890066f30 0x7f48900693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f489c000e10 tx=0x7f489c009040 comp rx=0 tx=0).stop 2023-10-09T08:17:19.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.138+0000 7f48b45ff700 1 -- 172.21.15.71:0/3887202270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4898005210 msgr2=0x7f48ac1585d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:19.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.138+0000 7f48b45ff700 1 --2- 172.21.15.71:0/3887202270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4898005210 0x7f48ac1585d0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f48a800e7b0 tx=0x7f48a8009040 comp rx=0 tx=0).stop 2023-10-09T08:17:19.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.138+0000 7f48b45ff700 1 -- 172.21.15.71:0/3887202270 shutdown_connections 2023-10-09T08:17:19.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.138+0000 7f48b45ff700 1 --2- 172.21.15.71:0/3887202270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48ac165a90 0x7f48ac165f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:19.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.138+0000 7f48b45ff700 1 --2- 172.21.15.71:0/3887202270 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f4890066f30 0x7f48900693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:19.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.138+0000 7f48b45ff700 1 --2- 172.21.15.71:0/3887202270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4898005210 0x7f48ac1585d0 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:19.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.138+0000 7f48b45ff700 1 --2- 172.21.15.71:0/3887202270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48ac157a50 0x7f48ac165550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:19.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.138+0000 7f48b45ff700 1 -- 172.21.15.71:0/3887202270 >> 172.21.15.71:0/3887202270 conn(0x7f48ac068e10 msgr2=0x7f48ac0c8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:19.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.138+0000 7f48b45ff700 1 -- 172.21.15.71:0/3887202270 shutdown_connections 2023-10-09T08:17:19.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.138+0000 7f48b45ff700 1 -- 172.21.15.71:0/3887202270 wait complete. 2023-10-09T08:17:19.157 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T08:17:19.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.336+0000 7f095359e700 1 Processor -- start 2023-10-09T08:17:19.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.337+0000 7f095359e700 1 -- start start 2023-10-09T08:17:19.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.338+0000 7f095359e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0954156310 0x7f09540c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:19.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.338+0000 7f095359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09541566e0 0x7f09540ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:19.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.338+0000 7f095359e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09540ca860 con 0x7f09540ca300 2023-10-09T08:17:19.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.338+0000 7f095359e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09540cab40 con 0x7f0954156310 2023-10-09T08:17:19.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.338+0000 7f095359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09540cae20 con 0x7f09541566e0 2023-10-09T08:17:19.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.338+0000 7f095259c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0954156310 0x7f09540c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:19.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.338+0000 7f0951d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09541566e0 0x7f09540ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:19.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.339+0000 7f0951d9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09541566e0 0x7f09540ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:54942/0 (socket says 172.21.15.71:54942) 2023-10-09T08:17:19.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.339+0000 7f0951d9b700 1 -- 172.21.15.71:0/2257571938 learned_addr learned my addr 172.21.15.71:0/2257571938 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:19.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.339+0000 7f095259c700 1 -- 172.21.15.71:0/2257571938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09541566e0 msgr2=0x7f09540ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:19.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.339+0000 7f095259c700 1 --2- 172.21.15.71:0/2257571938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09541566e0 0x7f09540ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:19.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.339+0000 7f095259c700 1 -- 172.21.15.71:0/2257571938 >> v1:172.21.15.179:6789/0 conn(0x7f09540ca300 legacy=0x7f09540c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:19.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.339+0000 7f095259c700 1 -- 172.21.15.71:0/2257571938 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09540cb100 con 0x7f0954156310 2023-10-09T08:17:19.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.339+0000 7f095259c700 1 --2- 172.21.15.71:0/2257571938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0954156310 0x7f09540c9dc0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f09440098e0 tx=0x7f09440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=548cca5e7c423824 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:19.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.340+0000 7f095159a700 1 -- 172.21.15.71:0/2257571938 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094400b640 con 0x7f0954156310 2023-10-09T08:17:19.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.340+0000 7f095159a700 1 -- 172.21.15.71:0/2257571938 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094400b7a0 con 0x7f0954156310 2023-10-09T08:17:19.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.340+0000 7f095159a700 1 -- 172.21.15.71:0/2257571938 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094400bb40 con 0x7f0954156310 2023-10-09T08:17:19.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.340+0000 7f095359e700 1 -- 172.21.15.71:0/2257571938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0954156310 msgr2=0x7f09540c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:19.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.340+0000 7f095359e700 1 --2- 172.21.15.71:0/2257571938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0954156310 0x7f09540c9dc0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f09440098e0 tx=0x7f09440091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:19.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.340+0000 7f095359e700 1 -- 172.21.15.71:0/2257571938 shutdown_connections 2023-10-09T08:17:19.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.340+0000 7f095359e700 1 --2- 172.21.15.71:0/2257571938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0954156310 0x7f09540c9dc0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:19.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.340+0000 7f095359e700 1 --2- 172.21.15.71:0/2257571938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09541566e0 0x7f09540ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:19.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.340+0000 7f095359e700 1 -- 172.21.15.71:0/2257571938 >> 172.21.15.71:0/2257571938 conn(0x7f09540cc1f0 msgr2=0x7f09540cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:19.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.340+0000 7f095359e700 1 -- 172.21.15.71:0/2257571938 shutdown_connections 2023-10-09T08:17:19.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.340+0000 7f095359e700 1 -- 172.21.15.71:0/2257571938 wait complete. 2023-10-09T08:17:19.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.342+0000 7f095359e700 1 Processor -- start 2023-10-09T08:17:19.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.342+0000 7f095359e700 1 -- start start 2023-10-09T08:17:19.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.343+0000 7f095359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09540ca300 0x7f095414fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:19.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.343+0000 7f095359e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0954156310 0x7f0954169ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:19.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.343+0000 7f095359e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09541566e0 0x7f09541548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:19.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.343+0000 7f095359e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0954153810 con 0x7f0954156310 2023-10-09T08:17:19.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.343+0000 7f095359e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0954153af0 con 0x7f09540ca300 2023-10-09T08:17:19.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.343+0000 7f095359e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0954153dd0 con 0x7f09541566e0 2023-10-09T08:17:19.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.343+0000 7f0951d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0954156310 0x7f0954169ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:19.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.343+0000 7f0951d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0954156310 0x7f0954169ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39194/0 (socket says 172.21.15.71:39194) 2023-10-09T08:17:19.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.343+0000 7f0951d9b700 1 -- 172.21.15.71:0/599785824 learned_addr learned my addr 172.21.15.71:0/599785824 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:19.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.343+0000 7f0952d9d700 1 --2- 172.21.15.71:0/599785824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09541566e0 0x7f09541548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:19.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.343+0000 7f0951d9b700 1 -- 172.21.15.71:0/599785824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09541566e0 msgr2=0x7f09541548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:19.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.343+0000 7f095259c700 1 --2- 172.21.15.71:0/599785824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09540ca300 0x7f095414fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:19.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.343+0000 7f0951d9b700 1 --2- 172.21.15.71:0/599785824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09541566e0 0x7f09541548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:19.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.343+0000 7f0951d9b700 1 -- 172.21.15.71:0/599785824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09540ca300 msgr2=0x7f095414fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:19.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.343+0000 7f0951d9b700 1 --2- 172.21.15.71:0/599785824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09540ca300 0x7f095414fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:19.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.343+0000 7f0951d9b700 1 -- 172.21.15.71:0/599785824 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0944009420 con 0x7f0954156310 2023-10-09T08:17:19.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.343+0000 7f0952d9d700 1 --2- 172.21.15.71:0/599785824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09541566e0 0x7f09541548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:19.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.344+0000 7f0951d9b700 1 --2- 172.21.15.71:0/599785824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0954156310 0x7f0954169ad0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f094800ea50 tx=0x7f0948009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:19.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.344+0000 7f09427fc700 1 -- 172.21.15.71:0/599785824 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094800c920 con 0x7f0954156310 2023-10-09T08:17:19.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.344+0000 7f09427fc700 1 -- 172.21.15.71:0/599785824 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094800ca80 con 0x7f0954156310 2023-10-09T08:17:19.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.344+0000 7f095359e700 1 -- 172.21.15.71:0/599785824 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09541540b0 con 0x7f0954156310 2023-10-09T08:17:19.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.344+0000 7f09427fc700 1 -- 172.21.15.71:0/599785824 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094800ce20 con 0x7f0954156310 2023-10-09T08:17:19.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.344+0000 7f095359e700 1 -- 172.21.15.71:0/599785824 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0954150200 con 0x7f0954156310 2023-10-09T08:17:19.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.345+0000 7f095359e700 1 -- 172.21.15.71:0/599785824 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f095404c3c0 con 0x7f0954156310 2023-10-09T08:17:19.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.346+0000 7f09427fc700 1 -- 172.21.15.71:0/599785824 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0948013680 con 0x7f0954156310 2023-10-09T08:17:19.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.347+0000 7f09427fc700 1 --2- 172.21.15.71:0/599785824 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0934066f30 0x7f09340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:19.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.347+0000 7f09427fc700 1 -- 172.21.15.71:0/599785824 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 5373+0+0 (secure 0 0 0) 0x7f0948084860 con 0x7f0954156310 2023-10-09T08:17:19.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.347+0000 7f095259c700 1 --2- 172.21.15.71:0/599785824 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0934066f30 0x7f09340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:19.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.348+0000 7f095259c700 1 --2- 172.21.15.71:0/599785824 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0934066f30 0x7f09340693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0944003080 tx=0x7f0944017000 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:19.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.351+0000 7f09427fc700 1 -- 172.21.15.71:0/599785824 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0948051b80 con 0x7f0954156310 2023-10-09T08:17:19.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.545+0000 7f095359e700 1 -- 172.21.15.71:0/599785824 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f09540cd0b0 con 0x7f0954156310 2023-10-09T08:17:19.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.545+0000 7f09427fc700 1 -- 172.21.15.71:0/599785824 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v206) v1 ==== 84+0+65 (secure 0 0 0) 0x7f09480551a0 con 0x7f0954156310 2023-10-09T08:17:19.546 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:19.546 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-09T08:17:19.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:17:19.547 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 1, 2023-10-09T08:17:19.547 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": ".mgr" 2023-10-09T08:17:19.547 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:17:19.547 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-09T08:17:19.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.547+0000 7f095359e700 1 -- 172.21.15.71:0/599785824 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0934066f30 msgr2=0x7f09340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:19.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.547+0000 7f095359e700 1 --2- 172.21.15.71:0/599785824 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0934066f30 0x7f09340693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0944003080 tx=0x7f0944017000 comp rx=0 tx=0).stop 2023-10-09T08:17:19.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.547+0000 7f095359e700 1 -- 172.21.15.71:0/599785824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0954156310 msgr2=0x7f0954169ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:19.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.547+0000 7f095359e700 1 --2- 172.21.15.71:0/599785824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0954156310 0x7f0954169ad0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f094800ea50 tx=0x7f0948009250 comp rx=0 tx=0).stop 2023-10-09T08:17:19.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.547+0000 7f095359e700 1 -- 172.21.15.71:0/599785824 shutdown_connections 2023-10-09T08:17:19.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.547+0000 7f095359e700 1 --2- 172.21.15.71:0/599785824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09541566e0 0x7f09541548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:19.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.547+0000 7f095359e700 1 --2- 172.21.15.71:0/599785824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09540ca300 0x7f095414fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:19.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.547+0000 7f095359e700 1 --2- 172.21.15.71:0/599785824 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0934066f30 0x7f09340693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:19.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.547+0000 7f095359e700 1 --2- 172.21.15.71:0/599785824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0954156310 0x7f0954169ad0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:19.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.547+0000 7f095359e700 1 -- 172.21.15.71:0/599785824 >> 172.21.15.71:0/599785824 conn(0x7f09540cc1f0 msgr2=0x7f09540af550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:19.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.547+0000 7f095359e700 1 -- 172.21.15.71:0/599785824 shutdown_connections 2023-10-09T08:17:19.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.548+0000 7f095359e700 1 -- 172.21.15.71:0/599785824 wait complete. 2023-10-09T08:17:19.566 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T08:17:19.566 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T08:17:19.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.750+0000 7f22bd9ff700 1 Processor -- start 2023-10-09T08:17:19.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.750+0000 7f22bd9ff700 1 -- start start 2023-10-09T08:17:19.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.751+0000 7f22bd9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f22b81563b0 0x7f22b8156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:19.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.751+0000 7f22bd9ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f22b815a440 0x7f22b80acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:19.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.752+0000 7f22bd9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b815a9b0 con 0x7f22b8068890 2023-10-09T08:17:19.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.752+0000 7f22bd9ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b815ac90 con 0x7f22b815a440 2023-10-09T08:17:19.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.752+0000 7f22bd9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b815af70 con 0x7f22b81563b0 2023-10-09T08:17:19.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.752+0000 7f22b67fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f22b815a440 0x7f22b80acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:19.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.752+0000 7f22b67fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f22b815a440 0x7f22b80acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39200/0 (socket says 172.21.15.71:39200) 2023-10-09T08:17:19.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.752+0000 7f22b67fc700 1 -- 172.21.15.71:0/1389453070 learned_addr learned my addr 172.21.15.71:0/1389453070 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:19.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.752+0000 7f22b6ffd700 1 --2- 172.21.15.71:0/1389453070 >> v2:172.21.15.179:3300/0 conn(0x7f22b81563b0 0x7f22b8156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:19.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.752+0000 7f22b67fc700 1 -- 172.21.15.71:0/1389453070 >> v2:172.21.15.179:3300/0 conn(0x7f22b81563b0 msgr2=0x7f22b8156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:19.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.752+0000 7f22b67fc700 1 --2- 172.21.15.71:0/1389453070 >> v2:172.21.15.179:3300/0 conn(0x7f22b81563b0 0x7f22b8156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:19.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.752+0000 7f22b67fc700 1 -- 172.21.15.71:0/1389453070 >> v1:172.21.15.179:6789/0 conn(0x7f22b8068890 legacy=0x7f22b80c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:19.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.752+0000 7f22b67fc700 1 -- 172.21.15.71:0/1389453070 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b815b250 con 0x7f22b815a440 2023-10-09T08:17:19.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.753+0000 7f22b67fc700 1 --2- 172.21.15.71:0/1389453070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22b815a440 0x7f22b80acf30 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f22b806a9f0 tx=0x7f22ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292abe05c5986b9d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:19.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.753+0000 7f22b5ffb700 1 -- 172.21.15.71:0/1389453070 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac00b820 con 0x7f22b815a440 2023-10-09T08:17:19.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.753+0000 7f22b5ffb700 1 -- 172.21.15.71:0/1389453070 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac00b980 con 0x7f22b815a440 2023-10-09T08:17:19.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.753+0000 7f22b5ffb700 1 -- 172.21.15.71:0/1389453070 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac00bd20 con 0x7f22b815a440 2023-10-09T08:17:19.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.753+0000 7f22bd9ff700 1 -- 172.21.15.71:0/1389453070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22b815a440 msgr2=0x7f22b80acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:19.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.753+0000 7f22bd9ff700 1 --2- 172.21.15.71:0/1389453070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22b815a440 0x7f22b80acf30 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f22b806a9f0 tx=0x7f22ac009250 comp rx=0 tx=0).stop 2023-10-09T08:17:19.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.753+0000 7f22bd9ff700 1 -- 172.21.15.71:0/1389453070 shutdown_connections 2023-10-09T08:17:19.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.753+0000 7f22bd9ff700 1 --2- 172.21.15.71:0/1389453070 >> v2:172.21.15.179:3300/0 conn(0x7f22b81563b0 0x7f22b8156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:19.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.753+0000 7f22bd9ff700 1 --2- 172.21.15.71:0/1389453070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22b815a440 0x7f22b80acf30 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:19.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.753+0000 7f22bd9ff700 1 -- 172.21.15.71:0/1389453070 >> 172.21.15.71:0/1389453070 conn(0x7f22b80c8f90 msgr2=0x7f22b80c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:19.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.753+0000 7f22bd9ff700 1 -- 172.21.15.71:0/1389453070 shutdown_connections 2023-10-09T08:17:19.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.754+0000 7f22bd9ff700 1 -- 172.21.15.71:0/1389453070 wait complete. 2023-10-09T08:17:19.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.755+0000 7f22bd9ff700 1 Processor -- start 2023-10-09T08:17:19.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.755+0000 7f22bd9ff700 1 -- start start 2023-10-09T08:17:19.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.756+0000 7f22bd9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22b8068890 0x7f22b80b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:19.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.756+0000 7f22bd9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22b81563b0 0x7f22b80af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:19.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.756+0000 7f22bd9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22b815a440 0x7f22b8153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:19.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.756+0000 7f22bd9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b80b0270 con 0x7f22b8068890 2023-10-09T08:17:19.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.756+0000 7f22bd9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b80b0f60 con 0x7f22b81563b0 2023-10-09T08:17:19.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.756+0000 7f22bd9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b80c0b20 con 0x7f22b815a440 2023-10-09T08:17:19.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.756+0000 7f22b6ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22b8068890 0x7f22b80b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:19.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.756+0000 7f22b6ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22b8068890 0x7f22b80b13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39202/0 (socket says 172.21.15.71:39202) 2023-10-09T08:17:19.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.756+0000 7f22b6ffd700 1 -- 172.21.15.71:0/115434870 learned_addr learned my addr 172.21.15.71:0/115434870 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:19.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.756+0000 7f22b67fc700 1 --2- 172.21.15.71:0/115434870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22b81563b0 0x7f22b80af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:19.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.756+0000 7f22b77fe700 1 --2- 172.21.15.71:0/115434870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22b815a440 0x7f22b8153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:19.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.756+0000 7f22b6ffd700 1 -- 172.21.15.71:0/115434870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22b815a440 msgr2=0x7f22b8153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:19.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.756+0000 7f22b6ffd700 1 --2- 172.21.15.71:0/115434870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22b815a440 0x7f22b8153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:19.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.756+0000 7f22b6ffd700 1 -- 172.21.15.71:0/115434870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22b81563b0 msgr2=0x7f22b80af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:19.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.756+0000 7f22b6ffd700 1 --2- 172.21.15.71:0/115434870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22b81563b0 0x7f22b80af2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:19.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.756+0000 7f22b6ffd700 1 -- 172.21.15.71:0/115434870 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac0094f0 con 0x7f22b8068890 2023-10-09T08:17:19.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.756+0000 7f22b77fe700 1 --2- 172.21.15.71:0/115434870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22b815a440 0x7f22b8153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:19.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.757+0000 7f22b6ffd700 1 --2- 172.21.15.71:0/115434870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22b8068890 0x7f22b80b13a0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f22a800d890 tx=0x7f22a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:19.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.757+0000 7f229effd700 1 -- 172.21.15.71:0/115434870 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a80125f0 con 0x7f22b8068890 2023-10-09T08:17:19.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.757+0000 7f229effd700 1 -- 172.21.15.71:0/115434870 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a8012770 con 0x7f22b8068890 2023-10-09T08:17:19.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.757+0000 7f22bd9ff700 1 -- 172.21.15.71:0/115434870 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b80c07f0 con 0x7f22b8068890 2023-10-09T08:17:19.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.757+0000 7f229effd700 1 -- 172.21.15.71:0/115434870 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a8012b30 con 0x7f22b8068890 2023-10-09T08:17:19.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.757+0000 7f22bd9ff700 1 -- 172.21.15.71:0/115434870 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b80afcb0 con 0x7f22b8068890 2023-10-09T08:17:19.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.758+0000 7f22bd9ff700 1 -- 172.21.15.71:0/115434870 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b80718b0 con 0x7f22b8068890 2023-10-09T08:17:19.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.759+0000 7f229effd700 1 -- 172.21.15.71:0/115434870 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f22a801e460 con 0x7f22b8068890 2023-10-09T08:17:19.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.760+0000 7f229effd700 1 --2- 172.21.15.71:0/115434870 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f22a4066f30 0x7f22a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:19.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.760+0000 7f229effd700 1 -- 172.21.15.71:0/115434870 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 5373+0+0 (secure 0 0 0) 0x7f22a8084b60 con 0x7f22b8068890 2023-10-09T08:17:19.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.760+0000 7f22b67fc700 1 --2- 172.21.15.71:0/115434870 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f22a4066f30 0x7f22a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:19.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.761+0000 7f22b67fc700 1 --2- 172.21.15.71:0/115434870 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f22a4066f30 0x7f22a40693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f22b806a9f0 tx=0x7f22ac016000 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:19.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.764+0000 7f229effd700 1 -- 172.21.15.71:0/115434870 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22a8051e80 con 0x7f22b8068890 2023-10-09T08:17:19.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:19.958+0000 7f22bd9ff700 1 -- 172.21.15.71:0/115434870 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f22b806d6a0 con 0x7f22b8068890 2023-10-09T08:17:20.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:20.953+0000 7f229effd700 1 -- 172.21.15.71:0/115434870 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v207) v1 ==== 138+0+0 (secure 0 0 0) 0x7f22a80554a0 con 0x7f22b8068890 2023-10-09T08:17:20.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:20.959+0000 7f22bd9ff700 1 -- 172.21.15.71:0/115434870 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f22a4066f30 msgr2=0x7f22a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:20.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:20.959+0000 7f22bd9ff700 1 --2- 172.21.15.71:0/115434870 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f22a4066f30 0x7f22a40693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f22b806a9f0 tx=0x7f22ac016000 comp rx=0 tx=0).stop 2023-10-09T08:17:20.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:20.959+0000 7f22bd9ff700 1 -- 172.21.15.71:0/115434870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22b8068890 msgr2=0x7f22b80b13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:20.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:20.959+0000 7f22bd9ff700 1 --2- 172.21.15.71:0/115434870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22b8068890 0x7f22b80b13a0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f22a800d890 tx=0x7f22a8008040 comp rx=0 tx=0).stop 2023-10-09T08:17:20.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:20.961+0000 7f22bd9ff700 1 -- 172.21.15.71:0/115434870 shutdown_connections 2023-10-09T08:17:20.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:20.961+0000 7f22bd9ff700 1 --2- 172.21.15.71:0/115434870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22b815a440 0x7f22b8153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:20.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:20.961+0000 7f22bd9ff700 1 --2- 172.21.15.71:0/115434870 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f22a4066f30 0x7f22a40693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:20.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:20.961+0000 7f22bd9ff700 1 --2- 172.21.15.71:0/115434870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22b8068890 0x7f22b80b13a0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:20.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:20.961+0000 7f22bd9ff700 1 --2- 172.21.15.71:0/115434870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22b81563b0 0x7f22b80af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:20.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:20.961+0000 7f22bd9ff700 1 -- 172.21.15.71:0/115434870 >> 172.21.15.71:0/115434870 conn(0x7f22b80c8f90 msgr2=0x7f22b8155c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:20.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:20.961+0000 7f22bd9ff700 1 -- 172.21.15.71:0/115434870 shutdown_connections 2023-10-09T08:17:20.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:20.961+0000 7f22bd9ff700 1 -- 172.21.15.71:0/115434870 wait complete. 2023-10-09T08:17:20.964 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' created 2023-10-09T08:17:20.982 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T08:17:21.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.173+0000 7f7a099ff700 1 Processor -- start 2023-10-09T08:17:21.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.173+0000 7f7a099ff700 1 -- start start 2023-10-09T08:17:21.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.174+0000 7f7a099ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7a04157630 0x7f7a04158a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:21.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.174+0000 7f7a099ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a04068390 0x7f7a040687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:21.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.174+0000 7f7a099ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a04068d30 con 0x7f7a04157a00 2023-10-09T08:17:21.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.174+0000 7f7a099ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a04158590 con 0x7f7a04157630 2023-10-09T08:17:21.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.174+0000 7f7a099ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a04157f80 con 0x7f7a04068390 2023-10-09T08:17:21.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.175+0000 7f7a02ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7a04157630 0x7f7a04158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:21.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.175+0000 7f7a037fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a04068390 0x7f7a040687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:21.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.175+0000 7f7a02ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7a04157630 0x7f7a04158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:38932/0 (socket says 172.21.15.71:38932) 2023-10-09T08:17:21.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.175+0000 7f7a037fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a04068390 0x7f7a040687f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:54970/0 (socket says 172.21.15.71:54970) 2023-10-09T08:17:21.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.175+0000 7f7a02ffd700 1 -- 172.21.15.71:0/2957420571 learned_addr learned my addr 172.21.15.71:0/2957420571 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:21.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.175+0000 7f7a037fe700 1 -- 172.21.15.71:0/2957420571 >> v2:172.21.15.179:3300/0 conn(0x7f7a04157630 msgr2=0x7f7a04158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:21.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.175+0000 7f7a037fe700 1 --2- 172.21.15.71:0/2957420571 >> v2:172.21.15.179:3300/0 conn(0x7f7a04157630 0x7f7a04158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:21.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.175+0000 7f7a037fe700 1 -- 172.21.15.71:0/2957420571 >> v1:172.21.15.179:6789/0 conn(0x7f7a04157a00 legacy=0x7f7a040abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:21.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.175+0000 7f7a037fe700 1 -- 172.21.15.71:0/2957420571 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a040ac7a0 con 0x7f7a04068390 2023-10-09T08:17:21.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.175+0000 7f7a02ffd700 1 --2- 172.21.15.71:0/2957420571 >> v2:172.21.15.179:3300/0 conn(0x7f7a04157630 0x7f7a04158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:21.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.176+0000 7f7a037fe700 1 --2- 172.21.15.71:0/2957420571 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a04068390 0x7f7a040687f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f79fc009e60 tx=0x7f79fc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64a12e4c1149f56f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:21.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.176+0000 7f7a01ffb700 1 -- 172.21.15.71:0/2957420571 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc00e070 con 0x7f7a04068390 2023-10-09T08:17:21.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.176+0000 7f7a01ffb700 1 -- 172.21.15.71:0/2957420571 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc00bb60 con 0x7f7a04068390 2023-10-09T08:17:21.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.176+0000 7f7a01ffb700 1 -- 172.21.15.71:0/2957420571 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc012430 con 0x7f7a04068390 2023-10-09T08:17:21.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.176+0000 7f7a099ff700 1 -- 172.21.15.71:0/2957420571 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a04068390 msgr2=0x7f7a040687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:21.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.176+0000 7f7a099ff700 1 --2- 172.21.15.71:0/2957420571 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a04068390 0x7f7a040687f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f79fc009e60 tx=0x7f79fc009780 comp rx=0 tx=0).stop 2023-10-09T08:17:21.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.176+0000 7f7a099ff700 1 -- 172.21.15.71:0/2957420571 shutdown_connections 2023-10-09T08:17:21.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.176+0000 7f7a099ff700 1 --2- 172.21.15.71:0/2957420571 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a04068390 0x7f7a040687f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:21.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.176+0000 7f7a099ff700 1 --2- 172.21.15.71:0/2957420571 >> v2:172.21.15.179:3300/0 conn(0x7f7a04157630 0x7f7a04158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:21.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.177+0000 7f7a099ff700 1 -- 172.21.15.71:0/2957420571 >> 172.21.15.71:0/2957420571 conn(0x7f7a040cc540 msgr2=0x7f7a040cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:21.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.177+0000 7f7a099ff700 1 -- 172.21.15.71:0/2957420571 shutdown_connections 2023-10-09T08:17:21.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.177+0000 7f7a099ff700 1 -- 172.21.15.71:0/2957420571 wait complete. 2023-10-09T08:17:21.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.178+0000 7f7a099ff700 1 Processor -- start 2023-10-09T08:17:21.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.178+0000 7f7a099ff700 1 -- start start 2023-10-09T08:17:21.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.179+0000 7f7a099ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a04068390 0x7f7a040c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:21.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.179+0000 7f7a099ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a04157630 0x7f7a040c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:21.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.179+0000 7f7a099ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a04157a00 0x7f7a04159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:21.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.179+0000 7f7a099ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a040c1990 con 0x7f7a04157630 2023-10-09T08:17:21.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.179+0000 7f7a099ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a040c6440 con 0x7f7a04068390 2023-10-09T08:17:21.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.179+0000 7f7a099ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a040c45b0 con 0x7f7a04157a00 2023-10-09T08:17:21.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.179+0000 7f7a027fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a04157630 0x7f7a040c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:21.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.179+0000 7f7a027fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a04157630 0x7f7a040c5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39206/0 (socket says 172.21.15.71:39206) 2023-10-09T08:17:21.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.179+0000 7f7a027fc700 1 -- 172.21.15.71:0/2373002936 learned_addr learned my addr 172.21.15.71:0/2373002936 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:21.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.179+0000 7f7a037fe700 1 --2- 172.21.15.71:0/2373002936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a04157a00 0x7f7a04159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:21.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.179+0000 7f7a02ffd700 1 --2- 172.21.15.71:0/2373002936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a04068390 0x7f7a040c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:21.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.180+0000 7f7a027fc700 1 -- 172.21.15.71:0/2373002936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a04157a00 msgr2=0x7f7a04159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:21.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.180+0000 7f7a027fc700 1 --2- 172.21.15.71:0/2373002936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a04157a00 0x7f7a04159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:21.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.180+0000 7f7a027fc700 1 -- 172.21.15.71:0/2373002936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a04068390 msgr2=0x7f7a040c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:21.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.180+0000 7f7a027fc700 1 --2- 172.21.15.71:0/2373002936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a04068390 0x7f7a040c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:21.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.180+0000 7f7a027fc700 1 -- 172.21.15.71:0/2373002936 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f40094f0 con 0x7f7a04157630 2023-10-09T08:17:21.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.180+0000 7f7a027fc700 1 --2- 172.21.15.71:0/2373002936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a04157630 0x7f7a040c5f00 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f79f800c4e0 tx=0x7f79f800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:21.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.180+0000 7f79eaffd700 1 -- 172.21.15.71:0/2373002936 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f8011590 con 0x7f7a04157630 2023-10-09T08:17:21.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.180+0000 7f79eaffd700 1 -- 172.21.15.71:0/2373002936 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f8011710 con 0x7f7a04157630 2023-10-09T08:17:21.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.180+0000 7f7a099ff700 1 -- 172.21.15.71:0/2373002936 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79fc009a20 con 0x7f7a04157630 2023-10-09T08:17:21.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.180+0000 7f79eaffd700 1 -- 172.21.15.71:0/2373002936 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f8011ad0 con 0x7f7a04157630 2023-10-09T08:17:21.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.180+0000 7f7a099ff700 1 -- 172.21.15.71:0/2373002936 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a040c1c90 con 0x7f7a04157630 2023-10-09T08:17:21.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.181+0000 7f7a099ff700 1 -- 172.21.15.71:0/2373002936 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a040718b0 con 0x7f7a04157630 2023-10-09T08:17:21.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.182+0000 7f79eaffd700 1 -- 172.21.15.71:0/2373002936 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f79f801b3b0 con 0x7f7a04157630 2023-10-09T08:17:21.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.183+0000 7f79eaffd700 1 --2- 172.21.15.71:0/2373002936 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f79f0066f30 0x7f79f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:21.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.183+0000 7f79eaffd700 1 -- 172.21.15.71:0/2373002936 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5743+0+0 (secure 0 0 0) 0x7f79f80837b0 con 0x7f7a04157630 2023-10-09T08:17:21.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.184+0000 7f7a02ffd700 1 --2- 172.21.15.71:0/2373002936 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f79f0066f30 0x7f79f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:21.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.185+0000 7f7a02ffd700 1 --2- 172.21.15.71:0/2373002936 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f79f0066f30 0x7f79f00693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f79f4006d20 tx=0x7f79f4009250 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:21.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.188+0000 7f79eaffd700 1 -- 172.21.15.71:0/2373002936 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79f8050960 con 0x7f7a04157630 2023-10-09T08:17:21.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.378+0000 7f7a099ff700 1 -- 172.21.15.71:0/2373002936 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7a04068d30 con 0x7f7a04157630 2023-10-09T08:17:21.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.958+0000 7f79eaffd700 1 -- 172.21.15.71:0/2373002936 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v208) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7a04068d30 con 0x7f7a04157630 2023-10-09T08:17:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.969+0000 7f7a099ff700 1 -- 172.21.15.71:0/2373002936 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f79f0066f30 msgr2=0x7f79f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.969+0000 7f7a099ff700 1 --2- 172.21.15.71:0/2373002936 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f79f0066f30 0x7f79f00693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f79f4006d20 tx=0x7f79f4009250 comp rx=0 tx=0).stop 2023-10-09T08:17:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.969+0000 7f7a099ff700 1 -- 172.21.15.71:0/2373002936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a04157630 msgr2=0x7f7a040c5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.969+0000 7f7a099ff700 1 --2- 172.21.15.71:0/2373002936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a04157630 0x7f7a040c5f00 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f79f800c4e0 tx=0x7f79f800c7f0 comp rx=0 tx=0).stop 2023-10-09T08:17:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.972+0000 7f7a099ff700 1 -- 172.21.15.71:0/2373002936 shutdown_connections 2023-10-09T08:17:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.972+0000 7f7a099ff700 1 --2- 172.21.15.71:0/2373002936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a04157a00 0x7f7a04159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.972+0000 7f7a099ff700 1 --2- 172.21.15.71:0/2373002936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a04068390 0x7f7a040c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.972+0000 7f7a099ff700 1 --2- 172.21.15.71:0/2373002936 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f79f0066f30 0x7f79f00693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:21.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.972+0000 7f7a099ff700 1 --2- 172.21.15.71:0/2373002936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a04157630 0x7f7a040c5f00 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:21.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.972+0000 7f7a099ff700 1 -- 172.21.15.71:0/2373002936 >> 172.21.15.71:0/2373002936 conn(0x7f7a040cc540 msgr2=0x7f7a04156ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:21.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.972+0000 7f7a099ff700 1 -- 172.21.15.71:0/2373002936 shutdown_connections 2023-10-09T08:17:21.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:21.972+0000 7f7a099ff700 1 -- 172.21.15.71:0/2373002936 wait complete. 2023-10-09T08:17:21.983 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' created 2023-10-09T08:17:22.000 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T08:17:22.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.183+0000 7ff7859ff700 1 Processor -- start 2023-10-09T08:17:22.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.183+0000 7ff7859ff700 1 -- start start 2023-10-09T08:17:22.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.184+0000 7ff7859ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff7800ccee0 0x7ff7801561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:22.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.184+0000 7ff7859ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78015b0d0 con 0x7ff7800c87c0 2023-10-09T08:17:22.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.184+0000 7ff7859ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78015a4c0 con 0x7ff7800c83f0 2023-10-09T08:17:22.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.184+0000 7ff7859ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78015a7a0 con 0x7ff7800ccee0 2023-10-09T08:17:22.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.185+0000 7ff77f7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff7800c87c0 0x7ff7800ca1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:49786/0 (socket says 172.21.15.71:49786) 2023-10-09T08:17:22.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.185+0000 7ff77f7fe700 1 -- 172.21.15.71:0/3785266095 learned_addr learned my addr 172.21.15.71:0/3785266095 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:22.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.185+0000 7ff777fff700 1 --2- 172.21.15.71:0/3785266095 >> v2:172.21.15.179:3300/0 conn(0x7ff7800ccee0 0x7ff7801561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:22.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.185+0000 7ff77e7fc700 1 -- 172.21.15.71:0/3785266095 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273210635 0 0) 0x7ff78015b0d0 con 0x7ff7800c87c0 2023-10-09T08:17:22.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.185+0000 7ff77e7fc700 1 -- 172.21.15.71:0/3785266095 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff76c003570 con 0x7ff7800c87c0 2023-10-09T08:17:22.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.185+0000 7ff77e7fc700 1 -- 172.21.15.71:0/3785266095 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1176071964 0 0) 0x7ff76c003570 con 0x7ff7800c87c0 2023-10-09T08:17:22.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.186+0000 7ff77e7fc700 1 -- 172.21.15.71:0/3785266095 >> v2:172.21.15.179:3300/0 conn(0x7ff7800ccee0 msgr2=0x7ff7801561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:22.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.186+0000 7ff77e7fc700 1 --2- 172.21.15.71:0/3785266095 >> v2:172.21.15.179:3300/0 conn(0x7ff7800ccee0 0x7ff7801561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:22.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.186+0000 7ff77e7fc700 1 -- 172.21.15.71:0/3785266095 >> v1:172.21.15.179:6789/0 conn(0x7ff7800c83f0 legacy=0x7ff7800c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:22.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.186+0000 7ff77e7fc700 1 -- 172.21.15.71:0/3785266095 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78015aa80 con 0x7ff7800c87c0 2023-10-09T08:17:22.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.186+0000 7ff77e7fc700 1 -- 172.21.15.71:0/3785266095 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7ff7780017f0 con 0x7ff7800c87c0 2023-10-09T08:17:22.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.186+0000 7ff77e7fc700 1 -- 172.21.15.71:0/3785266095 >> v1:172.21.15.71:6789/0 conn(0x7ff7800c87c0 legacy=0x7ff7800ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:22.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.186+0000 7ff77e7fc700 1 --2- 172.21.15.71:0/3785266095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff76c003a60 0x7ff76c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:22.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.186+0000 7ff77e7fc700 1 --2- 172.21.15.71:0/3785266095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff76c004810 0x7ff76c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:22.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.186+0000 7ff77e7fc700 1 --2- 172.21.15.71:0/3785266095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff76c0051c0 0x7ff76c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:22.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.186+0000 7ff77e7fc700 1 -- 172.21.15.71:0/3785266095 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78015a7a0 con 0x7ff76c003a60 2023-10-09T08:17:22.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.186+0000 7ff77e7fc700 1 -- 172.21.15.71:0/3785266095 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c00c050 con 0x7ff76c0051c0 2023-10-09T08:17:22.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.186+0000 7ff77e7fc700 1 -- 172.21.15.71:0/3785266095 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c00c210 con 0x7ff76c004810 2023-10-09T08:17:22.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.186+0000 7ff77effd700 1 --2- 172.21.15.71:0/3785266095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff76c003a60 0x7ff76c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:22.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.186+0000 7ff77f7fe700 1 --2- 172.21.15.71:0/3785266095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff76c0051c0 0x7ff76c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:22.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.186+0000 7ff777fff700 1 --2- 172.21.15.71:0/3785266095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff76c004810 0x7ff76c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:22.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.186+0000 7ff77effd700 1 -- 172.21.15.71:0/3785266095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff76c004810 msgr2=0x7ff76c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:22.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.186+0000 7ff77effd700 1 --2- 172.21.15.71:0/3785266095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff76c004810 0x7ff76c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:22.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.186+0000 7ff77effd700 1 -- 172.21.15.71:0/3785266095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff76c0051c0 msgr2=0x7ff76c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:22.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.186+0000 7ff77effd700 1 --2- 172.21.15.71:0/3785266095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff76c0051c0 0x7ff76c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:22.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.186+0000 7ff77effd700 1 -- 172.21.15.71:0/3785266095 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c003570 con 0x7ff76c003a60 2023-10-09T08:17:22.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.186+0000 7ff77f7fe700 1 --2- 172.21.15.71:0/3785266095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff76c0051c0 0x7ff76c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:17:22.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.186+0000 7ff77f7fe700 1 -- 172.21.15.71:0/3785266095 reap_dead start 2023-10-09T08:17:22.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.187+0000 7ff77effd700 1 --2- 172.21.15.71:0/3785266095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff76c003a60 0x7ff76c003e30 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7ff7700019d0 tx=0x7ff770007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ef3275e7f84778 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:22.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.187+0000 7ff77e7fc700 1 -- 172.21.15.71:0/3785266095 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77000c5d0 con 0x7ff76c003a60 2023-10-09T08:17:22.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.187+0000 7ff77e7fc700 1 -- 172.21.15.71:0/3785266095 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77000c750 con 0x7ff76c003a60 2023-10-09T08:17:22.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.187+0000 7ff77e7fc700 1 -- 172.21.15.71:0/3785266095 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77000cb10 con 0x7ff76c003a60 2023-10-09T08:17:22.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.187+0000 7ff7859ff700 1 -- 172.21.15.71:0/3785266095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff76c003a60 msgr2=0x7ff76c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:22.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.187+0000 7ff7859ff700 1 --2- 172.21.15.71:0/3785266095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff76c003a60 0x7ff76c003e30 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7ff7700019d0 tx=0x7ff770007d30 comp rx=0 tx=0).stop 2023-10-09T08:17:22.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.187+0000 7ff7859ff700 1 -- 172.21.15.71:0/3785266095 shutdown_connections 2023-10-09T08:17:22.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.187+0000 7ff7859ff700 1 --2- 172.21.15.71:0/3785266095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff76c003a60 0x7ff76c003e30 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:22.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.187+0000 7ff7859ff700 1 -- 172.21.15.71:0/3785266095 >> 172.21.15.71:0/3785266095 conn(0x7ff780068e10 msgr2=0x7ff7800cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:22.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.188+0000 7ff7859ff700 1 -- 172.21.15.71:0/3785266095 shutdown_connections 2023-10-09T08:17:22.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.188+0000 7ff7859ff700 1 -- 172.21.15.71:0/3785266095 wait complete. 2023-10-09T08:17:22.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.189+0000 7ff7859ff700 1 Processor -- start 2023-10-09T08:17:22.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.189+0000 7ff7859ff700 1 -- start start 2023-10-09T08:17:22.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.190+0000 7ff7859ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff76c003a60 0x7ff78014d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:22.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.190+0000 7ff7859ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff780151740 0x7ff780151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:22.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.190+0000 7ff7859ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff780153c70 0x7ff7801540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:22.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.190+0000 7ff7859ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff780155660 con 0x7ff76c003a60 2023-10-09T08:17:22.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.190+0000 7ff7859ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7801520f0 con 0x7ff780153c70 2023-10-09T08:17:22.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.190+0000 7ff7859ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7801549e0 con 0x7ff780151740 2023-10-09T08:17:22.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.190+0000 7ff77effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff76c003a60 0x7ff78014d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:22.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.190+0000 7ff77effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff76c003a60 0x7ff78014d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39234/0 (socket says 172.21.15.71:39234) 2023-10-09T08:17:22.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.190+0000 7ff77effd700 1 -- 172.21.15.71:0/609861661 learned_addr learned my addr 172.21.15.71:0/609861661 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:22.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.191+0000 7ff777fff700 1 --2- 172.21.15.71:0/609861661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff780151740 0x7ff780151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:22.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.191+0000 7ff77f7fe700 1 --2- 172.21.15.71:0/609861661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff780153c70 0x7ff7801540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:22.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.191+0000 7ff77effd700 1 -- 172.21.15.71:0/609861661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff780151740 msgr2=0x7ff780151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:22.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.191+0000 7ff77effd700 1 --2- 172.21.15.71:0/609861661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff780151740 0x7ff780151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:22.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.191+0000 7ff77effd700 1 -- 172.21.15.71:0/609861661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff780153c70 msgr2=0x7ff7801540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:22.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.191+0000 7ff77effd700 1 --2- 172.21.15.71:0/609861661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff780153c70 0x7ff7801540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:22.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.191+0000 7ff77effd700 1 -- 172.21.15.71:0/609861661 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff780154cc0 con 0x7ff76c003a60 2023-10-09T08:17:22.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.191+0000 7ff77effd700 1 --2- 172.21.15.71:0/609861661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff76c003a60 0x7ff78014d650 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7ff77000c3c0 tx=0x7ff770015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:22.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.191+0000 7ff776ffd700 1 -- 172.21.15.71:0/609861661 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77000c5d0 con 0x7ff76c003a60 2023-10-09T08:17:22.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.191+0000 7ff776ffd700 1 -- 172.21.15.71:0/609861661 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77000ce80 con 0x7ff76c003a60 2023-10-09T08:17:22.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.191+0000 7ff7859ff700 1 -- 172.21.15.71:0/609861661 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff780154fa0 con 0x7ff76c003a60 2023-10-09T08:17:22.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.191+0000 7ff776ffd700 1 -- 172.21.15.71:0/609861661 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77000cad0 con 0x7ff76c003a60 2023-10-09T08:17:22.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.191+0000 7ff7859ff700 1 -- 172.21.15.71:0/609861661 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78014db90 con 0x7ff76c003a60 2023-10-09T08:17:22.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.192+0000 7ff7859ff700 1 -- 172.21.15.71:0/609861661 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78004c3c0 con 0x7ff76c003a60 2023-10-09T08:17:22.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.194+0000 7ff776ffd700 1 -- 172.21.15.71:0/609861661 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff770019030 con 0x7ff76c003a60 2023-10-09T08:17:22.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.194+0000 7ff776ffd700 1 --2- 172.21.15.71:0/609861661 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff760066f30 0x7ff7600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:22.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.194+0000 7ff776ffd700 1 -- 172.21.15.71:0/609861661 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6125+0+0 (secure 0 0 0) 0x7ff770085f70 con 0x7ff76c003a60 2023-10-09T08:17:22.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.195+0000 7ff777fff700 1 --2- 172.21.15.71:0/609861661 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff760066f30 0x7ff7600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:22.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.195+0000 7ff777fff700 1 --2- 172.21.15.71:0/609861661 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff760066f30 0x7ff7600693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff768006dc0 tx=0x7ff768008040 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:22.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.200+0000 7ff776ffd700 1 -- 172.21.15.71:0/609861661 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff770052fa0 con 0x7ff76c003a60 2023-10-09T08:17:22.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.430+0000 7ff7859ff700 1 -- 172.21.15.71:0/609861661 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff7800cbd90 con 0x7ff76c003a60 2023-10-09T08:17:22.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.978+0000 7ff776ffd700 1 -- 172.21.15.71:0/609861661 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v93) v1 ==== 174+0+0 (secure 0 0 0) 0x7ff7700565c0 con 0x7ff76c003a60 2023-10-09T08:17:22.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.983+0000 7ff7859ff700 1 -- 172.21.15.71:0/609861661 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff760066f30 msgr2=0x7ff7600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:22.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.983+0000 7ff7859ff700 1 --2- 172.21.15.71:0/609861661 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff760066f30 0x7ff7600693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff768006dc0 tx=0x7ff768008040 comp rx=0 tx=0).stop 2023-10-09T08:17:22.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.983+0000 7ff7859ff700 1 -- 172.21.15.71:0/609861661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff76c003a60 msgr2=0x7ff78014d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:22.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.983+0000 7ff7859ff700 1 --2- 172.21.15.71:0/609861661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff76c003a60 0x7ff78014d650 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7ff77000c3c0 tx=0x7ff770015000 comp rx=0 tx=0).stop 2023-10-09T08:17:22.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.984+0000 7ff7859ff700 1 -- 172.21.15.71:0/609861661 shutdown_connections 2023-10-09T08:17:22.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.984+0000 7ff7859ff700 1 --2- 172.21.15.71:0/609861661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff780153c70 0x7ff7801540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:22.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.984+0000 7ff7859ff700 1 --2- 172.21.15.71:0/609861661 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff760066f30 0x7ff7600693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:22.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.984+0000 7ff7859ff700 1 --2- 172.21.15.71:0/609861661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff76c003a60 0x7ff78014d650 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:22.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.984+0000 7ff7859ff700 1 --2- 172.21.15.71:0/609861661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff780151740 0x7ff780151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:22.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.984+0000 7ff7859ff700 1 -- 172.21.15.71:0/609861661 >> 172.21.15.71:0/609861661 conn(0x7ff780068e10 msgr2=0x7ff7800af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:22.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.986+0000 7ff7859ff700 1 -- 172.21.15.71:0/609861661 shutdown_connections 2023-10-09T08:17:22.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:22.987+0000 7ff7859ff700 1 -- 172.21.15.71:0/609861661 wait complete. 2023-10-09T08:17:22.991 INFO:teuthology.orchestra.run.smithi071.stderr:new fs with metadata pool 24 and data pool 25 2023-10-09T08:17:23.010 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T08:17:23.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.191+0000 7ff35dbff700 1 Processor -- start 2023-10-09T08:17:23.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.192+0000 7ff35dbff700 1 -- start start 2023-10-09T08:17:23.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.193+0000 7ff35dbff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff3580ccf90 0x7ff3580ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:23.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.193+0000 7ff35dbff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3580cc300 con 0x7ff3580cbf30 2023-10-09T08:17:23.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.193+0000 7ff35dbff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3580ad370 con 0x7ff3580b1420 2023-10-09T08:17:23.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.193+0000 7ff35dbff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff358156bf0 con 0x7ff3580ccf90 2023-10-09T08:17:23.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.193+0000 7ff3577fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff3580cbf30 0x7ff3580b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:49790/0 (socket says 172.21.15.71:49790) 2023-10-09T08:17:23.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.193+0000 7ff3577fe700 1 -- 172.21.15.71:0/3844619095 learned_addr learned my addr 172.21.15.71:0/3844619095 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:23.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.193+0000 7ff357fff700 1 --2- 172.21.15.71:0/3844619095 >> v2:172.21.15.179:3300/0 conn(0x7ff3580ccf90 0x7ff3580ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:23.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.194+0000 7ff3567fc700 1 -- 172.21.15.71:0/3844619095 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749624158 0 0) 0x7ff3580cc300 con 0x7ff3580cbf30 2023-10-09T08:17:23.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.194+0000 7ff3567fc700 1 -- 172.21.15.71:0/3844619095 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff340003570 con 0x7ff3580cbf30 2023-10-09T08:17:23.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.194+0000 7ff357fff700 1 -- 172.21.15.71:0/3844619095 >> v1:172.21.15.179:6789/0 conn(0x7ff3580b1420 legacy=0x7ff3580c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:23.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.194+0000 7ff357fff700 1 -- 172.21.15.71:0/3844619095 >> v1:172.21.15.71:6789/0 conn(0x7ff3580cbf30 legacy=0x7ff3580b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:23.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.194+0000 7ff357fff700 1 -- 172.21.15.71:0/3844619095 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3580ad650 con 0x7ff3580ccf90 2023-10-09T08:17:23.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.194+0000 7ff357fff700 1 --2- 172.21.15.71:0/3844619095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3580ccf90 0x7ff3580ae410 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7ff3500098e0 tx=0x7ff3500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4636acc6466ff5f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:23.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.194+0000 7ff3567fc700 1 -- 172.21.15.71:0/3844619095 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35000b640 con 0x7ff3580ccf90 2023-10-09T08:17:23.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.194+0000 7ff3567fc700 1 -- 172.21.15.71:0/3844619095 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35000b7a0 con 0x7ff3580ccf90 2023-10-09T08:17:23.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.194+0000 7ff3567fc700 1 -- 172.21.15.71:0/3844619095 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35000bb40 con 0x7ff3580ccf90 2023-10-09T08:17:23.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.195+0000 7ff35dbff700 1 -- 172.21.15.71:0/3844619095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3580ccf90 msgr2=0x7ff3580ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:23.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.195+0000 7ff35dbff700 1 --2- 172.21.15.71:0/3844619095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3580ccf90 0x7ff3580ae410 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7ff3500098e0 tx=0x7ff3500091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:23.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.195+0000 7ff35dbff700 1 -- 172.21.15.71:0/3844619095 shutdown_connections 2023-10-09T08:17:23.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.195+0000 7ff35dbff700 1 --2- 172.21.15.71:0/3844619095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3580ccf90 0x7ff3580ae410 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:23.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.195+0000 7ff35dbff700 1 -- 172.21.15.71:0/3844619095 >> 172.21.15.71:0/3844619095 conn(0x7ff35806a320 msgr2=0x7ff3580cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:23.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.195+0000 7ff35dbff700 1 -- 172.21.15.71:0/3844619095 shutdown_connections 2023-10-09T08:17:23.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.195+0000 7ff35dbff700 1 -- 172.21.15.71:0/3844619095 wait complete. 2023-10-09T08:17:23.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.197+0000 7ff35dbff700 1 Processor -- start 2023-10-09T08:17:23.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.197+0000 7ff35dbff700 1 -- start start 2023-10-09T08:17:23.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.198+0000 7ff35dbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3580b1420 0x7ff35816b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:23.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.198+0000 7ff35dbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3580cbf30 0x7ff358155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:23.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.198+0000 7ff35dbff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3580ccf90 0x7ff358158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:23.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.198+0000 7ff35dbff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff358156d70 con 0x7ff3580ccf90 2023-10-09T08:17:23.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.198+0000 7ff35dbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35816a600 con 0x7ff3580cbf30 2023-10-09T08:17:23.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.198+0000 7ff35dbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35816a8e0 con 0x7ff3580b1420 2023-10-09T08:17:23.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.198+0000 7ff357fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3580ccf90 0x7ff358158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:23.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.198+0000 7ff357fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3580ccf90 0x7ff358158690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39248/0 (socket says 172.21.15.71:39248) 2023-10-09T08:17:23.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.198+0000 7ff357fff700 1 -- 172.21.15.71:0/4187183992 learned_addr learned my addr 172.21.15.71:0/4187183992 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:23.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.198+0000 7ff3577fe700 1 --2- 172.21.15.71:0/4187183992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3580b1420 0x7ff35816b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:23.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.198+0000 7ff356ffd700 1 --2- 172.21.15.71:0/4187183992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3580cbf30 0x7ff358155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:23.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.198+0000 7ff357fff700 1 -- 172.21.15.71:0/4187183992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3580b1420 msgr2=0x7ff35816b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:23.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.198+0000 7ff357fff700 1 --2- 172.21.15.71:0/4187183992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3580b1420 0x7ff35816b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:23.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.198+0000 7ff357fff700 1 -- 172.21.15.71:0/4187183992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3580cbf30 msgr2=0x7ff358155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:23.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.198+0000 7ff357fff700 1 --2- 172.21.15.71:0/4187183992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3580cbf30 0x7ff358155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:23.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.198+0000 7ff357fff700 1 -- 172.21.15.71:0/4187183992 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff350009420 con 0x7ff3580ccf90 2023-10-09T08:17:23.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.198+0000 7ff357fff700 1 --2- 172.21.15.71:0/4187183992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3580ccf90 0x7ff358158690 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7ff358064290 tx=0x7ff350017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:23.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.199+0000 7ff33f7fe700 1 -- 172.21.15.71:0/4187183992 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35000bae0 con 0x7ff3580ccf90 2023-10-09T08:17:23.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.199+0000 7ff33f7fe700 1 -- 172.21.15.71:0/4187183992 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff350011630 con 0x7ff3580ccf90 2023-10-09T08:17:23.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.199+0000 7ff33f7fe700 1 -- 172.21.15.71:0/4187183992 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3500119d0 con 0x7ff3580ccf90 2023-10-09T08:17:23.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.199+0000 7ff35dbff700 1 -- 172.21.15.71:0/4187183992 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35816abc0 con 0x7ff3580ccf90 2023-10-09T08:17:23.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.199+0000 7ff35dbff700 1 -- 172.21.15.71:0/4187183992 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35816b7a0 con 0x7ff3580ccf90 2023-10-09T08:17:23.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.200+0000 7ff35dbff700 1 -- 172.21.15.71:0/4187183992 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff358156ee0 con 0x7ff3580ccf90 2023-10-09T08:17:23.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.201+0000 7ff33f7fe700 1 -- 172.21.15.71:0/4187183992 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff350011d40 con 0x7ff3580ccf90 2023-10-09T08:17:23.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.201+0000 7ff33f7fe700 1 --2- 172.21.15.71:0/4187183992 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff344066f30 0x7ff3440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:23.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.202+0000 7ff33f7fe700 1 -- 172.21.15.71:0/4187183992 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6225+0+0 (secure 0 0 0) 0x7ff3500863a0 con 0x7ff3580ccf90 2023-10-09T08:17:23.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.202+0000 7ff3577fe700 1 --2- 172.21.15.71:0/4187183992 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff344066f30 0x7ff3440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:23.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.202+0000 7ff3577fe700 1 --2- 172.21.15.71:0/4187183992 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff344066f30 0x7ff3440693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff348005c50 tx=0x7ff348009040 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:23.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.206+0000 7ff33f7fe700 1 -- 172.21.15.71:0/4187183992 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff350053360 con 0x7ff3580ccf90 2023-10-09T08:17:23.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.399+0000 7ff35dbff700 1 -- 172.21.15.71:0/4187183992 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff35804c3c0 con 0x7ff3580ccf90 2023-10-09T08:17:23.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.400+0000 7ff33f7fe700 1 -- 172.21.15.71:0/4187183992 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v209) v1 ==== 74+0+16178 (secure 0 0 0) 0x7ff350056980 con 0x7ff3580ccf90 2023-10-09T08:17:23.400 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:23.400 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":209,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T08:17:22.432210+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-09T08:17:20.000097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"209","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-09T08:17:21.419977+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"209","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T08:17:23.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.402+0000 7ff35dbff700 1 -- 172.21.15.71:0/4187183992 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff344066f30 msgr2=0x7ff3440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:23.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.402+0000 7ff35dbff700 1 --2- 172.21.15.71:0/4187183992 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff344066f30 0x7ff3440693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff348005c50 tx=0x7ff348009040 comp rx=0 tx=0).stop 2023-10-09T08:17:23.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.402+0000 7ff35dbff700 1 -- 172.21.15.71:0/4187183992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3580ccf90 msgr2=0x7ff358158690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:23.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.402+0000 7ff35dbff700 1 --2- 172.21.15.71:0/4187183992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3580ccf90 0x7ff358158690 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7ff358064290 tx=0x7ff350017000 comp rx=0 tx=0).stop 2023-10-09T08:17:23.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.402+0000 7ff35dbff700 1 -- 172.21.15.71:0/4187183992 shutdown_connections 2023-10-09T08:17:23.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.402+0000 7ff35dbff700 1 --2- 172.21.15.71:0/4187183992 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff344066f30 0x7ff3440693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:23.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.402+0000 7ff35dbff700 1 --2- 172.21.15.71:0/4187183992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3580ccf90 0x7ff358158690 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:23.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.402+0000 7ff35dbff700 1 --2- 172.21.15.71:0/4187183992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3580b1420 0x7ff35816b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:23.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.402+0000 7ff35dbff700 1 --2- 172.21.15.71:0/4187183992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3580cbf30 0x7ff358155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:23.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.402+0000 7ff35dbff700 1 -- 172.21.15.71:0/4187183992 >> 172.21.15.71:0/4187183992 conn(0x7ff35806a320 msgr2=0x7ff35806e700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:23.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.402+0000 7ff35dbff700 1 -- 172.21.15.71:0/4187183992 shutdown_connections 2023-10-09T08:17:23.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.402+0000 7ff35dbff700 1 -- 172.21.15.71:0/4187183992 wait complete. 2023-10-09T08:17:23.420 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T08:17:23.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.599+0000 7f736af9d700 1 Processor -- start 2023-10-09T08:17:23.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.600+0000 7f736af9d700 1 -- start start 2023-10-09T08:17:23.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.601+0000 7f736af9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7364150180 0x7f7364157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:23.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.601+0000 7f736af9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7364150550 0x7f73640c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:23.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.601+0000 7f736af9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f736406e2a0 con 0x7f73640c7240 2023-10-09T08:17:23.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.601+0000 7f736af9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73640c76c0 con 0x7f7364150180 2023-10-09T08:17:23.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.601+0000 7f736af9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736406b2e0 con 0x7f7364150550 2023-10-09T08:17:23.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.601+0000 7f736979a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7364150550 0x7f73640c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:23.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.602+0000 7f7369f9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7364150180 0x7f7364157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:23.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.602+0000 7f7369f9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7364150180 0x7f7364157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:38978/0 (socket says 172.21.15.71:38978) 2023-10-09T08:17:23.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.602+0000 7f736979a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7364150550 0x7f73640c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:54986/0 (socket says 172.21.15.71:54986) 2023-10-09T08:17:23.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.602+0000 7f7369f9b700 1 -- 172.21.15.71:0/2469131629 learned_addr learned my addr 172.21.15.71:0/2469131629 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.602+0000 7f7368f99700 1 -- 172.21.15.71:0/2469131629 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827581410 0 0) 0x7f736406e2a0 con 0x7f73640c7240 2023-10-09T08:17:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.602+0000 7f7368f99700 1 -- 172.21.15.71:0/2469131629 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7350003570 con 0x7f73640c7240 2023-10-09T08:17:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.602+0000 7f736979a700 1 -- 172.21.15.71:0/2469131629 >> v2:172.21.15.179:3300/0 conn(0x7f7364150180 msgr2=0x7f7364157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.602+0000 7f736979a700 1 --2- 172.21.15.71:0/2469131629 >> v2:172.21.15.179:3300/0 conn(0x7f7364150180 0x7f7364157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.602+0000 7f736979a700 1 -- 172.21.15.71:0/2469131629 >> v1:172.21.15.179:6789/0 conn(0x7f73640c7240 legacy=0x7f7364069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.602+0000 7f736979a700 1 -- 172.21.15.71:0/2469131629 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73640c78e0 con 0x7f7364150550 2023-10-09T08:17:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.602+0000 7f736979a700 1 --2- 172.21.15.71:0/2469131629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7364150550 0x7f73640c6d00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7354009910 tx=0x7f73540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=846e0ded18f2a0e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.603+0000 7f7368f99700 1 -- 172.21.15.71:0/2469131629 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7354011630 con 0x7f7364150550 2023-10-09T08:17:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.603+0000 7f7368f99700 1 -- 172.21.15.71:0/2469131629 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7354011790 con 0x7f7364150550 2023-10-09T08:17:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.603+0000 7f7368f99700 1 -- 172.21.15.71:0/2469131629 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7354011b30 con 0x7f7364150550 2023-10-09T08:17:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.603+0000 7f736af9d700 1 -- 172.21.15.71:0/2469131629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7364150550 msgr2=0x7f73640c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.603+0000 7f736af9d700 1 --2- 172.21.15.71:0/2469131629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7364150550 0x7f73640c6d00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7354009910 tx=0x7f73540091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.603+0000 7f736af9d700 1 -- 172.21.15.71:0/2469131629 shutdown_connections 2023-10-09T08:17:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.603+0000 7f736af9d700 1 --2- 172.21.15.71:0/2469131629 >> v2:172.21.15.179:3300/0 conn(0x7f7364150180 0x7f7364157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.603+0000 7f736af9d700 1 --2- 172.21.15.71:0/2469131629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7364150550 0x7f73640c6d00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.603+0000 7f736af9d700 1 -- 172.21.15.71:0/2469131629 >> 172.21.15.71:0/2469131629 conn(0x7f73640cc1f0 msgr2=0x7f73640cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.603+0000 7f736af9d700 1 -- 172.21.15.71:0/2469131629 shutdown_connections 2023-10-09T08:17:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.603+0000 7f736af9d700 1 -- 172.21.15.71:0/2469131629 wait complete. 2023-10-09T08:17:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.605+0000 7f736af9d700 1 Processor -- start 2023-10-09T08:17:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.605+0000 7f736af9d700 1 -- start start 2023-10-09T08:17:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.606+0000 7f736af9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73640c7240 0x7f7364148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.606+0000 7f736af9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7364150180 0x7f7364154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.606+0000 7f736af9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7364150550 0x7f7364155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.606+0000 7f736af9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736414a360 con 0x7f73640c7240 2023-10-09T08:17:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.606+0000 7f736af9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736414a7f0 con 0x7f7364150550 2023-10-09T08:17:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.606+0000 7f736af9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7364149750 con 0x7f7364150180 2023-10-09T08:17:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.606+0000 7f7369f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73640c7240 0x7f7364148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.606+0000 7f7369f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73640c7240 0x7f7364148d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39258/0 (socket says 172.21.15.71:39258) 2023-10-09T08:17:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.606+0000 7f7369f9b700 1 -- 172.21.15.71:0/2600021411 learned_addr learned my addr 172.21.15.71:0/2600021411 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.606+0000 7f7369f9b700 1 -- 172.21.15.71:0/2600021411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7364150180 msgr2=0x7f7364154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.606+0000 7f7369f9b700 1 --2- 172.21.15.71:0/2600021411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7364150180 0x7f7364154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.606+0000 7f7369f9b700 1 -- 172.21.15.71:0/2600021411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7364150550 msgr2=0x7f7364155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.606+0000 7f7369f9b700 1 --2- 172.21.15.71:0/2600021411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7364150550 0x7f7364155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.606+0000 7f7369f9b700 1 -- 172.21.15.71:0/2600021411 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7354009420 con 0x7f73640c7240 2023-10-09T08:17:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.607+0000 7f7369f9b700 1 --2- 172.21.15.71:0/2600021411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73640c7240 0x7f7364148d60 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f736000dea0 tx=0x7f736000f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.607+0000 7f7359ffb700 1 -- 172.21.15.71:0/2600021411 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360009c00 con 0x7f73640c7240 2023-10-09T08:17:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.607+0000 7f7359ffb700 1 -- 172.21.15.71:0/2600021411 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7360009d60 con 0x7f73640c7240 2023-10-09T08:17:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.607+0000 7f736af9d700 1 -- 172.21.15.71:0/2600021411 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7364149a30 con 0x7f73640c7240 2023-10-09T08:17:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.607+0000 7f7359ffb700 1 -- 172.21.15.71:0/2600021411 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360017600 con 0x7f73640c7240 2023-10-09T08:17:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.607+0000 7f736af9d700 1 -- 172.21.15.71:0/2600021411 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7364149ff0 con 0x7f73640c7240 2023-10-09T08:17:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.608+0000 7f736af9d700 1 -- 172.21.15.71:0/2600021411 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f736414a640 con 0x7f73640c7240 2023-10-09T08:17:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.609+0000 7f7359ffb700 1 -- 172.21.15.71:0/2600021411 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73600179b0 con 0x7f73640c7240 2023-10-09T08:17:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.610+0000 7f7359ffb700 1 --2- 172.21.15.71:0/2600021411 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f7348066f30 0x7f73480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.610+0000 7f7359ffb700 1 -- 172.21.15.71:0/2600021411 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f7360084e10 con 0x7f73640c7240 2023-10-09T08:17:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.610+0000 7f736979a700 1 --2- 172.21.15.71:0/2600021411 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f7348066f30 0x7f73480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.611+0000 7f736979a700 1 --2- 172.21.15.71:0/2600021411 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f7348066f30 0x7f73480693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7364156120 tx=0x7f7354017000 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:23.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.614+0000 7f7359ffb700 1 -- 172.21.15.71:0/2600021411 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7360051e70 con 0x7f73640c7240 2023-10-09T08:17:23.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.805+0000 7f736af9d700 1 -- 172.21.15.71:0/2600021411 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f736404c3c0 con 0x7f73640c7240 2023-10-09T08:17:23.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.806+0000 7f7359ffb700 1 -- 172.21.15.71:0/2600021411 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v209) v1 ==== 74+0+16178 (secure 0 0 0) 0x7f7360055490 con 0x7f73640c7240 2023-10-09T08:17:23.807 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:23.808 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":209,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T08:17:22.432210+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-09T08:17:20.000097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"209","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-09T08:17:21.419977+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"209","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T08:17:23.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.809+0000 7f736af9d700 1 -- 172.21.15.71:0/2600021411 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f7348066f30 msgr2=0x7f73480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:23.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.809+0000 7f736af9d700 1 --2- 172.21.15.71:0/2600021411 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f7348066f30 0x7f73480693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7364156120 tx=0x7f7354017000 comp rx=0 tx=0).stop 2023-10-09T08:17:23.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.809+0000 7f736af9d700 1 -- 172.21.15.71:0/2600021411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73640c7240 msgr2=0x7f7364148d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:23.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.809+0000 7f736af9d700 1 --2- 172.21.15.71:0/2600021411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73640c7240 0x7f7364148d60 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f736000dea0 tx=0x7f736000f040 comp rx=0 tx=0).stop 2023-10-09T08:17:23.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.809+0000 7f736af9d700 1 -- 172.21.15.71:0/2600021411 shutdown_connections 2023-10-09T08:17:23.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.809+0000 7f736af9d700 1 --2- 172.21.15.71:0/2600021411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7364150550 0x7f7364155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:23.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.809+0000 7f736af9d700 1 --2- 172.21.15.71:0/2600021411 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f7348066f30 0x7f73480693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:23.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.809+0000 7f736af9d700 1 --2- 172.21.15.71:0/2600021411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73640c7240 0x7f7364148d60 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:23.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.809+0000 7f736af9d700 1 --2- 172.21.15.71:0/2600021411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7364150180 0x7f7364154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:23.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.809+0000 7f736af9d700 1 -- 172.21.15.71:0/2600021411 >> 172.21.15.71:0/2600021411 conn(0x7f73640cc1f0 msgr2=0x7f73640c8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:23.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.809+0000 7f736af9d700 1 -- 172.21.15.71:0/2600021411 shutdown_connections 2023-10-09T08:17:23.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:23.809+0000 7f736af9d700 1 -- 172.21.15.71:0/2600021411 wait complete. 2023-10-09T08:17:23.828 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T08:17:24.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.016+0000 7f22431ff700 1 Processor -- start 2023-10-09T08:17:24.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.016+0000 7f22431ff700 1 -- start start 2023-10-09T08:17:24.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.017+0000 7f22431ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f223c069560 0x7f223c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:24.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.017+0000 7f22431ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223c069ee0 con 0x7f223c159890 2023-10-09T08:17:24.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.017+0000 7f22431ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223c15a160 con 0x7f223c159c60 2023-10-09T08:17:24.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.017+0000 7f22431ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223c0d13a0 con 0x7f223c069560 2023-10-09T08:17:24.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.017+0000 7f2240f9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f223c159890 0x7f223c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:49806/0 (socket says 172.21.15.71:49806) 2023-10-09T08:17:24.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.017+0000 7f2240f9b700 1 -- 172.21.15.71:0/2942708693 learned_addr learned my addr 172.21.15.71:0/2942708693 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:24.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.018+0000 7f224179c700 1 --2- 172.21.15.71:0/2942708693 >> v2:172.21.15.179:3300/0 conn(0x7f223c069560 0x7f223c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:24.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.018+0000 7f223b7fe700 1 -- 172.21.15.71:0/2942708693 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513137219 0 0) 0x7f223c069ee0 con 0x7f223c159890 2023-10-09T08:17:24.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.018+0000 7f223b7fe700 1 -- 172.21.15.71:0/2942708693 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f222c003570 con 0x7f223c159890 2023-10-09T08:17:24.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.018+0000 7f223b7fe700 1 -- 172.21.15.71:0/2942708693 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3442110639 0 0) 0x7f222c003570 con 0x7f223c159890 2023-10-09T08:17:24.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.018+0000 7f223b7fe700 1 -- 172.21.15.71:0/2942708693 >> v2:172.21.15.179:3300/0 conn(0x7f223c069560 msgr2=0x7f223c0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:24.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.018+0000 7f223b7fe700 1 --2- 172.21.15.71:0/2942708693 >> v2:172.21.15.179:3300/0 conn(0x7f223c069560 0x7f223c0699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:24.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.018+0000 7f223b7fe700 1 -- 172.21.15.71:0/2942708693 >> v1:172.21.15.179:6789/0 conn(0x7f223c159c60 legacy=0x7f223c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:24.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.018+0000 7f223b7fe700 1 -- 172.21.15.71:0/2942708693 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c15e140 con 0x7f223c159890 2023-10-09T08:17:24.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.018+0000 7f223b7fe700 1 -- 172.21.15.71:0/2942708693 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f2230001470 con 0x7f223c159890 2023-10-09T08:17:24.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.018+0000 7f224179c700 1 --2- 172.21.15.71:0/2942708693 >> v2:172.21.15.179:3300/0 conn(0x7f223c069560 0x7f223c0699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:24.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.018+0000 7f223b7fe700 1 -- 172.21.15.71:0/2942708693 >> v1:172.21.15.71:6789/0 conn(0x7f223c159890 legacy=0x7f223c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:24.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.018+0000 7f223b7fe700 1 --2- 172.21.15.71:0/2942708693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f222c003a60 0x7f222c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:24.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.018+0000 7f223b7fe700 1 --2- 172.21.15.71:0/2942708693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f222c004810 0x7f222c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:24.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.018+0000 7f223b7fe700 1 --2- 172.21.15.71:0/2942708693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f222c0051c0 0x7f222c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:24.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.018+0000 7f223b7fe700 1 -- 172.21.15.71:0/2942708693 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c0d13a0 con 0x7f222c003a60 2023-10-09T08:17:24.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.018+0000 7f223b7fe700 1 -- 172.21.15.71:0/2942708693 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c00c0d0 con 0x7f222c004810 2023-10-09T08:17:24.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.018+0000 7f223b7fe700 1 -- 172.21.15.71:0/2942708693 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222c00c290 con 0x7f222c0051c0 2023-10-09T08:17:24.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.019+0000 7f2240f9b700 1 --2- 172.21.15.71:0/2942708693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f222c003a60 0x7f222c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:24.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.019+0000 7f223bfff700 1 --2- 172.21.15.71:0/2942708693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f222c004810 0x7f222c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:24.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.019+0000 7f224179c700 1 --2- 172.21.15.71:0/2942708693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f222c0051c0 0x7f222c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:24.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.019+0000 7f2240f9b700 1 -- 172.21.15.71:0/2942708693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f222c0051c0 msgr2=0x7f222c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:24.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.019+0000 7f2240f9b700 1 --2- 172.21.15.71:0/2942708693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f222c0051c0 0x7f222c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:24.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.019+0000 7f2240f9b700 1 -- 172.21.15.71:0/2942708693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f222c004810 msgr2=0x7f222c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:24.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.019+0000 7f2240f9b700 1 --2- 172.21.15.71:0/2942708693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f222c004810 0x7f222c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:24.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.019+0000 7f2240f9b700 1 -- 172.21.15.71:0/2942708693 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222c003570 con 0x7f222c003a60 2023-10-09T08:17:24.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.019+0000 7f224179c700 1 -- 172.21.15.71:0/2942708693 reap_dead start 2023-10-09T08:17:24.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.019+0000 7f2240f9b700 1 --2- 172.21.15.71:0/2942708693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f222c003a60 0x7f222c003e70 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f223000c3c0 tx=0x7f2230001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4dd11b548047a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:24.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.019+0000 7f223b7fe700 1 -- 172.21.15.71:0/2942708693 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223000cc10 con 0x7f222c003a60 2023-10-09T08:17:24.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.019+0000 7f223b7fe700 1 -- 172.21.15.71:0/2942708693 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223000cd70 con 0x7f222c003a60 2023-10-09T08:17:24.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.019+0000 7f223b7fe700 1 -- 172.21.15.71:0/2942708693 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2230005b50 con 0x7f222c003a60 2023-10-09T08:17:24.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.020+0000 7f22431ff700 1 -- 172.21.15.71:0/2942708693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f222c003a60 msgr2=0x7f222c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:24.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.020+0000 7f22431ff700 1 --2- 172.21.15.71:0/2942708693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f222c003a60 0x7f222c003e70 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f223000c3c0 tx=0x7f2230001e50 comp rx=0 tx=0).stop 2023-10-09T08:17:24.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.020+0000 7f22431ff700 1 -- 172.21.15.71:0/2942708693 shutdown_connections 2023-10-09T08:17:24.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.020+0000 7f22431ff700 1 --2- 172.21.15.71:0/2942708693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f222c003a60 0x7f222c003e70 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:24.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.020+0000 7f22431ff700 1 -- 172.21.15.71:0/2942708693 >> 172.21.15.71:0/2942708693 conn(0x7f223c068e20 msgr2=0x7f223c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:24.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.020+0000 7f22431ff700 1 -- 172.21.15.71:0/2942708693 shutdown_connections 2023-10-09T08:17:24.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.020+0000 7f22431ff700 1 -- 172.21.15.71:0/2942708693 wait complete. 2023-10-09T08:17:24.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.021+0000 7f22431ff700 1 Processor -- start 2023-10-09T08:17:24.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.022+0000 7f22431ff700 1 -- start start 2023-10-09T08:17:24.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.022+0000 7f22431ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f222c003a60 0x7f223c0cf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:24.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.022+0000 7f22431ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f223c0b56d0 0x7f223c0d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:24.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.022+0000 7f22431ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f223c0b5b40 0x7f223c0d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:24.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.022+0000 7f22431ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c0b63e0 con 0x7f223c0b56d0 2023-10-09T08:17:24.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.022+0000 7f22431ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c0b6100 con 0x7f223c0b5b40 2023-10-09T08:17:24.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.022+0000 7f22431ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223c0cd160 con 0x7f222c003a60 2023-10-09T08:17:24.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.023+0000 7f223bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f223c0b56d0 0x7f223c0d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:24.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.023+0000 7f223bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f223c0b56d0 0x7f223c0d05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39286/0 (socket says 172.21.15.71:39286) 2023-10-09T08:17:24.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.023+0000 7f223bfff700 1 -- 172.21.15.71:0/1904553066 learned_addr learned my addr 172.21.15.71:0/1904553066 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:24.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.023+0000 7f2240f9b700 1 --2- 172.21.15.71:0/1904553066 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f222c003a60 0x7f223c0cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:24.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.023+0000 7f224179c700 1 --2- 172.21.15.71:0/1904553066 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f223c0b5b40 0x7f223c0d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:24.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.023+0000 7f223bfff700 1 -- 172.21.15.71:0/1904553066 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f222c003a60 msgr2=0x7f223c0cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:24.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.023+0000 7f223bfff700 1 --2- 172.21.15.71:0/1904553066 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f222c003a60 0x7f223c0cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:24.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.023+0000 7f223bfff700 1 -- 172.21.15.71:0/1904553066 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f223c0b5b40 msgr2=0x7f223c0d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:24.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.023+0000 7f223bfff700 1 --2- 172.21.15.71:0/1904553066 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f223c0b5b40 0x7f223c0d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:24.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.023+0000 7f223bfff700 1 -- 172.21.15.71:0/1904553066 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c0cd440 con 0x7f223c0b56d0 2023-10-09T08:17:24.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.023+0000 7f223bfff700 1 --2- 172.21.15.71:0/1904553066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f223c0b56d0 0x7f223c0d05f0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f2228002950 tx=0x7f2228007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:24.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.024+0000 7f2238ff9700 1 -- 172.21.15.71:0/1904553066 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2228006a30 con 0x7f223c0b56d0 2023-10-09T08:17:24.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.024+0000 7f2238ff9700 1 -- 172.21.15.71:0/1904553066 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2228006b90 con 0x7f223c0b56d0 2023-10-09T08:17:24.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.024+0000 7f22431ff700 1 -- 172.21.15.71:0/1904553066 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223c0cd720 con 0x7f223c0b56d0 2023-10-09T08:17:24.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.024+0000 7f2238ff9700 1 -- 172.21.15.71:0/1904553066 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2228007050 con 0x7f223c0b56d0 2023-10-09T08:17:24.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.024+0000 7f22431ff700 1 -- 172.21.15.71:0/1904553066 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223c156550 con 0x7f223c0b56d0 2023-10-09T08:17:24.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.025+0000 7f22431ff700 1 -- 172.21.15.71:0/1904553066 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223c04c3c0 con 0x7f223c0b56d0 2023-10-09T08:17:24.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.026+0000 7f2238ff9700 1 -- 172.21.15.71:0/1904553066 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2228007440 con 0x7f223c0b56d0 2023-10-09T08:17:24.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.026+0000 7f2238ff9700 1 --2- 172.21.15.71:0/1904553066 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2220066f30 0x7f22200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:24.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.026+0000 7f2238ff9700 1 -- 172.21.15.71:0/1904553066 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f2228084460 con 0x7f223c0b56d0 2023-10-09T08:17:24.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.027+0000 7f2240f9b700 1 --2- 172.21.15.71:0/1904553066 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2220066f30 0x7f22200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:24.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.028+0000 7f2240f9b700 1 --2- 172.21.15.71:0/1904553066 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2220066f30 0x7f22200693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2230007cd0 tx=0x7f2230015000 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:24.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.031+0000 7f2238ff9700 1 -- 172.21.15.71:0/1904553066 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2228054f60 con 0x7f223c0b56d0 2023-10-09T08:17:24.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.265+0000 7f22431ff700 1 -- 172.21.15.71:0/1904553066 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f223c06a5b0 con 0x7f223c0b56d0 2023-10-09T08:17:24.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.989+0000 7f2238ff9700 1 -- 172.21.15.71:0/1904553066 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v96) v1 ==== 118+0+0 (secure 0 0 0) 0x7f222801a0b0 con 0x7f223c0b56d0 2023-10-09T08:17:24.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.992+0000 7f22431ff700 1 -- 172.21.15.71:0/1904553066 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2220066f30 msgr2=0x7f22200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:24.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.992+0000 7f22431ff700 1 --2- 172.21.15.71:0/1904553066 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2220066f30 0x7f22200693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2230007cd0 tx=0x7f2230015000 comp rx=0 tx=0).stop 2023-10-09T08:17:24.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.992+0000 7f22431ff700 1 -- 172.21.15.71:0/1904553066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f223c0b56d0 msgr2=0x7f223c0d05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:24.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.992+0000 7f22431ff700 1 --2- 172.21.15.71:0/1904553066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f223c0b56d0 0x7f223c0d05f0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f2228002950 tx=0x7f2228007d30 comp rx=0 tx=0).stop 2023-10-09T08:17:24.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.992+0000 7f22431ff700 1 -- 172.21.15.71:0/1904553066 shutdown_connections 2023-10-09T08:17:24.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.992+0000 7f22431ff700 1 --2- 172.21.15.71:0/1904553066 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f223c0b5b40 0x7f223c0d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:24.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.992+0000 7f22431ff700 1 --2- 172.21.15.71:0/1904553066 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f222c003a60 0x7f223c0cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:24.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.992+0000 7f22431ff700 1 --2- 172.21.15.71:0/1904553066 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f2220066f30 0x7f22200693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:24.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.992+0000 7f22431ff700 1 --2- 172.21.15.71:0/1904553066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f223c0b56d0 0x7f223c0d05f0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:24.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.992+0000 7f22431ff700 1 -- 172.21.15.71:0/1904553066 >> 172.21.15.71:0/1904553066 conn(0x7f223c068e20 msgr2=0x7f223c069960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:24.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.992+0000 7f22431ff700 1 -- 172.21.15.71:0/1904553066 shutdown_connections 2023-10-09T08:17:24.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:24.992+0000 7f22431ff700 1 -- 172.21.15.71:0/1904553066 wait complete. 2023-10-09T08:17:25.010 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T08:17:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.195+0000 7f5e8759e700 1 Processor -- start 2023-10-09T08:17:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.195+0000 7f5e8759e700 1 -- start start 2023-10-09T08:17:25.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.196+0000 7f5e8759e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5e880cb1a0 0x7f5e8815a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:25.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.196+0000 7f5e8759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e880ae0d0 0x7f5e880ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:25.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.196+0000 7f5e8759e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e8806ebd0 con 0x7f5e8815a8a0 2023-10-09T08:17:25.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.196+0000 7f5e8759e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e8815b2e0 con 0x7f5e880cb1a0 2023-10-09T08:17:25.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.196+0000 7f5e8759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e880aea30 con 0x7f5e880ae0d0 2023-10-09T08:17:25.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.196+0000 7f5e8659c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5e880cb1a0 0x7f5e8815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:25.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.196+0000 7f5e8659c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5e880cb1a0 0x7f5e8815a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48134/0 (socket says 172.21.15.71:48134) 2023-10-09T08:17:25.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.196+0000 7f5e8659c700 1 -- 172.21.15.71:0/3144546636 learned_addr learned my addr 172.21.15.71:0/3144546636 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:25.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.197+0000 7f5e86d9d700 1 --2- 172.21.15.71:0/3144546636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e880ae0d0 0x7f5e880ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:25.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.197+0000 7f5e8659c700 1 -- 172.21.15.71:0/3144546636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e880ae0d0 msgr2=0x7f5e880ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:25.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.197+0000 7f5e8659c700 1 --2- 172.21.15.71:0/3144546636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e880ae0d0 0x7f5e880ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:25.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.197+0000 7f5e8659c700 1 -- 172.21.15.71:0/3144546636 >> v1:172.21.15.71:6789/0 conn(0x7f5e8815a8a0 legacy=0x7f5e8806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:25.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.197+0000 7f5e8659c700 1 -- 172.21.15.71:0/3144546636 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8815ad20 con 0x7f5e880cb1a0 2023-10-09T08:17:25.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.197+0000 7f5e8659c700 1 --2- 172.21.15.71:0/3144546636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e880cb1a0 0x7f5e8815a360 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f5e780099b0 tx=0x7f5e78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98ae11e135a27c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:25.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.197+0000 7f5e8559a700 1 -- 172.21.15.71:0/3144546636 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7800b8f0 con 0x7f5e880cb1a0 2023-10-09T08:17:25.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.197+0000 7f5e8559a700 1 -- 172.21.15.71:0/3144546636 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7800ba50 con 0x7f5e880cb1a0 2023-10-09T08:17:25.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.197+0000 7f5e8559a700 1 -- 172.21.15.71:0/3144546636 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7800bdf0 con 0x7f5e880cb1a0 2023-10-09T08:17:25.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.198+0000 7f5e8759e700 1 -- 172.21.15.71:0/3144546636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e880cb1a0 msgr2=0x7f5e8815a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:25.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.198+0000 7f5e8759e700 1 --2- 172.21.15.71:0/3144546636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e880cb1a0 0x7f5e8815a360 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f5e780099b0 tx=0x7f5e78009250 comp rx=0 tx=0).stop 2023-10-09T08:17:25.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.198+0000 7f5e8759e700 1 -- 172.21.15.71:0/3144546636 shutdown_connections 2023-10-09T08:17:25.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.198+0000 7f5e8759e700 1 --2- 172.21.15.71:0/3144546636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e880ae0d0 0x7f5e880ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:25.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.198+0000 7f5e8759e700 1 --2- 172.21.15.71:0/3144546636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e880cb1a0 0x7f5e8815a360 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:25.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.198+0000 7f5e8759e700 1 -- 172.21.15.71:0/3144546636 >> 172.21.15.71:0/3144546636 conn(0x7f5e880cc1e0 msgr2=0x7f5e880cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:25.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.198+0000 7f5e8759e700 1 -- 172.21.15.71:0/3144546636 shutdown_connections 2023-10-09T08:17:25.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.198+0000 7f5e8759e700 1 -- 172.21.15.71:0/3144546636 wait complete. 2023-10-09T08:17:25.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.199+0000 7f5e8759e700 1 Processor -- start 2023-10-09T08:17:25.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.200+0000 7f5e8759e700 1 -- start start 2023-10-09T08:17:25.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.200+0000 7f5e8759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e880ae0d0 0x7f5e88153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:25.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.200+0000 7f5e8759e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e880cb1a0 0x7f5e88154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:25.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.200+0000 7f5e8759e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e8814af00 0x7f5e880c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:25.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.200+0000 7f5e8759e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e88155570 con 0x7f5e880cb1a0 2023-10-09T08:17:25.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.200+0000 7f5e8759e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e88154d50 con 0x7f5e8814af00 2023-10-09T08:17:25.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.200+0000 7f5e8759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e88154fb0 con 0x7f5e880ae0d0 2023-10-09T08:17:25.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.201+0000 7f5e85d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e880cb1a0 0x7f5e88154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:25.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.201+0000 7f5e85d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e880cb1a0 0x7f5e88154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48150/0 (socket says 172.21.15.71:48150) 2023-10-09T08:17:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.201+0000 7f5e85d9b700 1 -- 172.21.15.71:0/3309008652 learned_addr learned my addr 172.21.15.71:0/3309008652 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.201+0000 7f5e8659c700 1 --2- 172.21.15.71:0/3309008652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e880ae0d0 0x7f5e88153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.201+0000 7f5e86d9d700 1 --2- 172.21.15.71:0/3309008652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e8814af00 0x7f5e880c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.201+0000 7f5e85d9b700 1 -- 172.21.15.71:0/3309008652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e880ae0d0 msgr2=0x7f5e88153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.201+0000 7f5e85d9b700 1 --2- 172.21.15.71:0/3309008652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e880ae0d0 0x7f5e88153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.201+0000 7f5e85d9b700 1 -- 172.21.15.71:0/3309008652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e8814af00 msgr2=0x7f5e880c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.201+0000 7f5e85d9b700 1 --2- 172.21.15.71:0/3309008652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e8814af00 0x7f5e880c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.201+0000 7f5e85d9b700 1 -- 172.21.15.71:0/3309008652 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e780094f0 con 0x7f5e880cb1a0 2023-10-09T08:17:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.201+0000 7f5e8659c700 1 --2- 172.21.15.71:0/3309008652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e880ae0d0 0x7f5e88153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.201+0000 7f5e85d9b700 1 --2- 172.21.15.71:0/3309008652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e880cb1a0 0x7f5e88154810 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00c4e0 tx=0x7f5e7c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.202+0000 7f5e767fc700 1 -- 172.21.15.71:0/3309008652 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c011590 con 0x7f5e880cb1a0 2023-10-09T08:17:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.202+0000 7f5e767fc700 1 -- 172.21.15.71:0/3309008652 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7c011710 con 0x7f5e880cb1a0 2023-10-09T08:17:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.202+0000 7f5e767fc700 1 -- 172.21.15.71:0/3309008652 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c011ad0 con 0x7f5e880cb1a0 2023-10-09T08:17:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.202+0000 7f5e8759e700 1 -- 172.21.15.71:0/3309008652 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e88155290 con 0x7f5e880cb1a0 2023-10-09T08:17:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.202+0000 7f5e8759e700 1 -- 172.21.15.71:0/3309008652 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e880c3710 con 0x7f5e880cb1a0 2023-10-09T08:17:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.203+0000 7f5e8759e700 1 -- 172.21.15.71:0/3309008652 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e880c3270 con 0x7f5e880cb1a0 2023-10-09T08:17:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.204+0000 7f5e767fc700 1 -- 172.21.15.71:0/3309008652 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5e7c01c440 con 0x7f5e880cb1a0 2023-10-09T08:17:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.204+0000 7f5e767fc700 1 --2- 172.21.15.71:0/3309008652 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5e68066f30 0x7f5e680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.204+0000 7f5e767fc700 1 -- 172.21.15.71:0/3309008652 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f5e7c083ca0 con 0x7f5e880cb1a0 2023-10-09T08:17:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.205+0000 7f5e8659c700 1 --2- 172.21.15.71:0/3309008652 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5e68066f30 0x7f5e680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.205+0000 7f5e8659c700 1 --2- 172.21.15.71:0/3309008652 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5e68066f30 0x7f5e680693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5e780099b0 tx=0x7f5e78019000 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.209+0000 7f5e767fc700 1 -- 172.21.15.71:0/3309008652 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e7c050c60 con 0x7f5e880cb1a0 2023-10-09T08:17:25.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.441+0000 7f5e8759e700 1 -- 172.21.15.71:0/3309008652 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5e880c3930 con 0x7f5e880cb1a0 2023-10-09T08:17:25.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.995+0000 7f5e767fc700 1 -- 172.21.15.71:0/3309008652 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v97) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5e7c017020 con 0x7f5e880cb1a0 2023-10-09T08:17:25.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.998+0000 7f5e8759e700 1 -- 172.21.15.71:0/3309008652 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5e68066f30 msgr2=0x7f5e680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:25.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.998+0000 7f5e8759e700 1 --2- 172.21.15.71:0/3309008652 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5e68066f30 0x7f5e680693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5e780099b0 tx=0x7f5e78019000 comp rx=0 tx=0).stop 2023-10-09T08:17:25.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.998+0000 7f5e8759e700 1 -- 172.21.15.71:0/3309008652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e880cb1a0 msgr2=0x7f5e88154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:25.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.998+0000 7f5e8759e700 1 --2- 172.21.15.71:0/3309008652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e880cb1a0 0x7f5e88154810 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00c4e0 tx=0x7f5e7c00c8a0 comp rx=0 tx=0).stop 2023-10-09T08:17:25.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.998+0000 7f5e8759e700 1 -- 172.21.15.71:0/3309008652 shutdown_connections 2023-10-09T08:17:25.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.998+0000 7f5e8759e700 1 --2- 172.21.15.71:0/3309008652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e8814af00 0x7f5e880c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:25.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.998+0000 7f5e8759e700 1 --2- 172.21.15.71:0/3309008652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e880ae0d0 0x7f5e88153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:25.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.998+0000 7f5e8759e700 1 --2- 172.21.15.71:0/3309008652 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5e68066f30 0x7f5e680693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:25.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.998+0000 7f5e8759e700 1 --2- 172.21.15.71:0/3309008652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e880cb1a0 0x7f5e88154810 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:25.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.998+0000 7f5e8759e700 1 -- 172.21.15.71:0/3309008652 >> 172.21.15.71:0/3309008652 conn(0x7f5e880cc1e0 msgr2=0x7f5e881527e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:26.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.998+0000 7f5e8759e700 1 -- 172.21.15.71:0/3309008652 shutdown_connections 2023-10-09T08:17:26.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:25.998+0000 7f5e8759e700 1 -- 172.21.15.71:0/3309008652 wait complete. 2023-10-09T08:17:26.018 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T08:17:26.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.203+0000 7f1b7e19d700 1 Processor -- start 2023-10-09T08:17:26.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.203+0000 7f1b7e19d700 1 -- start start 2023-10-09T08:17:26.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.204+0000 7f1b7e19d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1b78157770 0x7f1b78150180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:26.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.204+0000 7f1b7e19d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b7806e2a0 con 0x7f1b780c7150 2023-10-09T08:17:26.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.204+0000 7f1b7e19d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b78157b40 con 0x7f1b780c6d00 2023-10-09T08:17:26.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.204+0000 7f1b7e19d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b7806b2e0 con 0x7f1b78157770 2023-10-09T08:17:26.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.204+0000 7f1b7d19b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1b78157770 0x7f1b78150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:26.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.204+0000 7f1b7d19b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1b78157770 0x7f1b78150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48164/0 (socket says 172.21.15.71:48164) 2023-10-09T08:17:26.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.204+0000 7f1b7d19b700 1 -- 172.21.15.71:0/1365342199 learned_addr learned my addr 172.21.15.71:0/1365342199 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:26.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.205+0000 7f1b7d19b700 1 -- 172.21.15.71:0/1365342199 >> v1:172.21.15.179:6789/0 conn(0x7f1b780c6d00 legacy=0x7f1b7806e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:26.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.205+0000 7f1b7d19b700 1 -- 172.21.15.71:0/1365342199 >> v1:172.21.15.71:6789/0 conn(0x7f1b780c7150 legacy=0x7f1b7806ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:26.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.205+0000 7f1b7d19b700 1 -- 172.21.15.71:0/1365342199 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b780c78e0 con 0x7f1b78157770 2023-10-09T08:17:26.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.205+0000 7f1b7d19b700 1 --2- 172.21.15.71:0/1365342199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b78157770 0x7f1b78150180 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f1b740099b0 tx=0x7f1b74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be58480cb2664b32 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:26.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.205+0000 7f1b6ffff700 1 -- 172.21.15.71:0/1365342199 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7400b860 con 0x7f1b78157770 2023-10-09T08:17:26.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.205+0000 7f1b6ffff700 1 -- 172.21.15.71:0/1365342199 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7400b9c0 con 0x7f1b78157770 2023-10-09T08:17:26.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.205+0000 7f1b6ffff700 1 -- 172.21.15.71:0/1365342199 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7400bd60 con 0x7f1b78157770 2023-10-09T08:17:26.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.206+0000 7f1b7e19d700 1 -- 172.21.15.71:0/1365342199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b78157770 msgr2=0x7f1b78150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:26.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.206+0000 7f1b7e19d700 1 --2- 172.21.15.71:0/1365342199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b78157770 0x7f1b78150180 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f1b740099b0 tx=0x7f1b74009250 comp rx=0 tx=0).stop 2023-10-09T08:17:26.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.206+0000 7f1b7e19d700 1 -- 172.21.15.71:0/1365342199 shutdown_connections 2023-10-09T08:17:26.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.206+0000 7f1b7e19d700 1 --2- 172.21.15.71:0/1365342199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b78157770 0x7f1b78150180 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:26.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.206+0000 7f1b7e19d700 1 -- 172.21.15.71:0/1365342199 >> 172.21.15.71:0/1365342199 conn(0x7f1b780cc1f0 msgr2=0x7f1b780cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:26.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.206+0000 7f1b7e19d700 1 -- 172.21.15.71:0/1365342199 shutdown_connections 2023-10-09T08:17:26.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.206+0000 7f1b7e19d700 1 -- 172.21.15.71:0/1365342199 wait complete. 2023-10-09T08:17:26.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.207+0000 7f1b7e19d700 1 Processor -- start 2023-10-09T08:17:26.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.208+0000 7f1b7e19d700 1 -- start start 2023-10-09T08:17:26.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.208+0000 7f1b7e19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b780c6d00 0x7f1b78140cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:26.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.208+0000 7f1b7e19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b780c7150 0x7f1b78146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:26.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.209+0000 7f1b7e19d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b78157770 0x7f1b78146ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:26.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.209+0000 7f1b7e19d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b78147cf0 con 0x7f1b78157770 2023-10-09T08:17:26.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.209+0000 7f1b7e19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b780b0e00 con 0x7f1b780c6d00 2023-10-09T08:17:26.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.209+0000 7f1b7e19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b781669b0 con 0x7f1b780c7150 2023-10-09T08:17:26.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.209+0000 7f1b7d99c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b78157770 0x7f1b78146ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:26.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.209+0000 7f1b7d99c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b78157770 0x7f1b78146ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48174/0 (socket says 172.21.15.71:48174) 2023-10-09T08:17:26.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.209+0000 7f1b7d99c700 1 -- 172.21.15.71:0/3062880455 learned_addr learned my addr 172.21.15.71:0/3062880455 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:26.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.209+0000 7f1b7d99c700 1 -- 172.21.15.71:0/3062880455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b780c7150 msgr2=0x7f1b78146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:26.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.209+0000 7f1b7d99c700 1 --2- 172.21.15.71:0/3062880455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b780c7150 0x7f1b78146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:26.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.209+0000 7f1b7d19b700 1 --2- 172.21.15.71:0/3062880455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b780c6d00 0x7f1b78140cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:26.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.209+0000 7f1b7d99c700 1 -- 172.21.15.71:0/3062880455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b780c6d00 msgr2=0x7f1b78140cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:26.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.209+0000 7f1b7d99c700 1 --2- 172.21.15.71:0/3062880455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b780c6d00 0x7f1b78140cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:26.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.209+0000 7f1b7d99c700 1 -- 172.21.15.71:0/3062880455 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b740094f0 con 0x7f1b78157770 2023-10-09T08:17:26.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.209+0000 7f1b7d19b700 1 --2- 172.21.15.71:0/3062880455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b780c6d00 0x7f1b78140cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:26.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.209+0000 7f1b7d99c700 1 --2- 172.21.15.71:0/3062880455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b78157770 0x7f1b78146ba0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000c870 tx=0x7f1b70001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:26.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.210+0000 7f1b6d7fa700 1 -- 172.21.15.71:0/3062880455 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b70012630 con 0x7f1b78157770 2023-10-09T08:17:26.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.210+0000 7f1b6d7fa700 1 -- 172.21.15.71:0/3062880455 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b700127b0 con 0x7f1b78157770 2023-10-09T08:17:26.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.210+0000 7f1b6d7fa700 1 -- 172.21.15.71:0/3062880455 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b70012b70 con 0x7f1b78157770 2023-10-09T08:17:26.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.210+0000 7f1b7e19d700 1 -- 172.21.15.71:0/3062880455 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b781470e0 con 0x7f1b78157770 2023-10-09T08:17:26.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.210+0000 7f1b7e19d700 1 -- 172.21.15.71:0/3062880455 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b78166360 con 0x7f1b78157770 2023-10-09T08:17:26.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.211+0000 7f1b7e19d700 1 -- 172.21.15.71:0/3062880455 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b78166b20 con 0x7f1b78157770 2023-10-09T08:17:26.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.212+0000 7f1b6d7fa700 1 -- 172.21.15.71:0/3062880455 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b70003030 con 0x7f1b78157770 2023-10-09T08:17:26.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.213+0000 7f1b6d7fa700 1 --2- 172.21.15.71:0/3062880455 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1b5c066f30 0x7f1b5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:26.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.213+0000 7f1b6d7fa700 1 -- 172.21.15.71:0/3062880455 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f1b70084ae0 con 0x7f1b78157770 2023-10-09T08:17:26.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.213+0000 7f1b7d19b700 1 --2- 172.21.15.71:0/3062880455 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1b5c066f30 0x7f1b5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:26.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.214+0000 7f1b7d19b700 1 --2- 172.21.15.71:0/3062880455 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1b5c066f30 0x7f1b5c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1b740099b0 tx=0x7f1b74017000 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:26.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.216+0000 7f1b6d7fa700 1 -- 172.21.15.71:0/3062880455 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b70051b20 con 0x7f1b78157770 2023-10-09T08:17:26.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.448+0000 7f1b7e19d700 1 -- 172.21.15.71:0/3062880455 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b7806d030 con 0x7f1b78157770 2023-10-09T08:17:26.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.448+0000 7f1b6d7fa700 1 -- 172.21.15.71:0/3062880455 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4608 (secure 0 0 0) 0x7f1b70084070 con 0x7f1b78157770 2023-10-09T08:17:26.448 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:26.448 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":97,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1242627383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1242627383},{"type":"v1","addr":"172.21.15.179:6836","nonce":1242627383}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":9628,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1306881721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1306881721},{"type":"v1","addr":"172.21.15.179:6834","nonce":1306881721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10143,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/717406174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":717406174},{"type":"v1","addr":"172.21.15.71:6834","nonce":717406174}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T08:17:22.432534+0000","modified":"2023-10-09T08:17:25.988311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10149":{"gid":10149,"name":"c","rank":0,"incarnation":93,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/2477293368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":2477293368},{"type":"v1","addr":"172.21.15.71:6835","nonce":2477293368}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T08:17:26.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.450+0000 7f1b7e19d700 1 -- 172.21.15.71:0/3062880455 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1b5c066f30 msgr2=0x7f1b5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.450+0000 7f1b7e19d700 1 --2- 172.21.15.71:0/3062880455 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1b5c066f30 0x7f1b5c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1b740099b0 tx=0x7f1b74017000 comp rx=0 tx=0).stop 2023-10-09T08:17:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.450+0000 7f1b7e19d700 1 -- 172.21.15.71:0/3062880455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b78157770 msgr2=0x7f1b78146ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.450+0000 7f1b7e19d700 1 --2- 172.21.15.71:0/3062880455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b78157770 0x7f1b78146ba0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000c870 tx=0x7f1b70001670 comp rx=0 tx=0).stop 2023-10-09T08:17:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.450+0000 7f1b7e19d700 1 -- 172.21.15.71:0/3062880455 shutdown_connections 2023-10-09T08:17:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.450+0000 7f1b7e19d700 1 --2- 172.21.15.71:0/3062880455 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1b5c066f30 0x7f1b5c0693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.450+0000 7f1b7e19d700 1 --2- 172.21.15.71:0/3062880455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b78157770 0x7f1b78146ba0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.450+0000 7f1b7e19d700 1 --2- 172.21.15.71:0/3062880455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b780c6d00 0x7f1b78140cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.450+0000 7f1b7e19d700 1 --2- 172.21.15.71:0/3062880455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b780c7150 0x7f1b78146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.450+0000 7f1b7e19d700 1 -- 172.21.15.71:0/3062880455 >> 172.21.15.71:0/3062880455 conn(0x7f1b780cc1f0 msgr2=0x7f1b780cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.451+0000 7f1b7e19d700 1 -- 172.21.15.71:0/3062880455 shutdown_connections 2023-10-09T08:17:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.451+0000 7f1b7e19d700 1 -- 172.21.15.71:0/3062880455 wait complete. 2023-10-09T08:17:26.452 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 97 2023-10-09T08:17:26.468 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T08:17:26.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.648+0000 7f55bc3ff700 1 Processor -- start 2023-10-09T08:17:26.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.648+0000 7f55bc3ff700 1 -- start start 2023-10-09T08:17:26.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.650+0000 7f55bc3ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f55b41579f0 0x7f55b4162530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:26.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.650+0000 7f55bc3ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b40cb300 con 0x7f55b40b1c20 2023-10-09T08:17:26.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.650+0000 7f55bc3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b40cb5e0 con 0x7f55b40b1850 2023-10-09T08:17:26.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.650+0000 7f55bc3ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b406fc30 con 0x7f55b41579f0 2023-10-09T08:17:26.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.650+0000 7f55ba99c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f55b41579f0 0x7f55b4162530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:26.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.650+0000 7f55ba99c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f55b41579f0 0x7f55b4162530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48184/0 (socket says 172.21.15.71:48184) 2023-10-09T08:17:26.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.650+0000 7f55ba99c700 1 -- 172.21.15.71:0/1931366066 learned_addr learned my addr 172.21.15.71:0/1931366066 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:26.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.650+0000 7f55ba99c700 1 -- 172.21.15.71:0/1931366066 >> v1:172.21.15.179:6789/0 conn(0x7f55b40b1850 legacy=0x7f55b40ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:26.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.650+0000 7f55ba99c700 1 -- 172.21.15.71:0/1931366066 >> v1:172.21.15.71:6789/0 conn(0x7f55b40b1c20 legacy=0x7f55b41572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:26.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.650+0000 7f55ba99c700 1 -- 172.21.15.71:0/1931366066 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b40cb8c0 con 0x7f55b41579f0 2023-10-09T08:17:26.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.651+0000 7f55ba99c700 1 --2- 172.21.15.71:0/1931366066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b41579f0 0x7f55b4162530 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f55ac009f20 tx=0x7f55ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad46a7833e32ffa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:26.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.651+0000 7f55b9199700 1 -- 172.21.15.71:0/1931366066 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac00e070 con 0x7f55b41579f0 2023-10-09T08:17:26.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.651+0000 7f55b9199700 1 -- 172.21.15.71:0/1931366066 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ac00ba80 con 0x7f55b41579f0 2023-10-09T08:17:26.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.651+0000 7f55b9199700 1 -- 172.21.15.71:0/1931366066 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac0092e0 con 0x7f55b41579f0 2023-10-09T08:17:26.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.651+0000 7f55bc3ff700 1 -- 172.21.15.71:0/1931366066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b41579f0 msgr2=0x7f55b4162530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:26.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.651+0000 7f55bc3ff700 1 --2- 172.21.15.71:0/1931366066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b41579f0 0x7f55b4162530 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f55ac009f20 tx=0x7f55ac009840 comp rx=0 tx=0).stop 2023-10-09T08:17:26.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.651+0000 7f55bc3ff700 1 -- 172.21.15.71:0/1931366066 shutdown_connections 2023-10-09T08:17:26.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.651+0000 7f55bc3ff700 1 --2- 172.21.15.71:0/1931366066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b41579f0 0x7f55b4162530 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:26.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.651+0000 7f55bc3ff700 1 -- 172.21.15.71:0/1931366066 >> 172.21.15.71:0/1931366066 conn(0x7f55b406a320 msgr2=0x7f55b40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:26.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.652+0000 7f55bc3ff700 1 -- 172.21.15.71:0/1931366066 shutdown_connections 2023-10-09T08:17:26.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.652+0000 7f55bc3ff700 1 -- 172.21.15.71:0/1931366066 wait complete. 2023-10-09T08:17:26.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.653+0000 7f55bc3ff700 1 Processor -- start 2023-10-09T08:17:26.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.653+0000 7f55bc3ff700 1 -- start start 2023-10-09T08:17:26.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.654+0000 7f55bc3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b40b1850 0x7f55b415ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:26.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.654+0000 7f55bc3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55b40b1c20 0x7f55b40afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:26.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.654+0000 7f55bc3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55b41579f0 0x7f55b4147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:26.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.654+0000 7f55bc3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b40cc260 con 0x7f55b40b1850 2023-10-09T08:17:26.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.654+0000 7f55bc3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b40aa150 con 0x7f55b40b1c20 2023-10-09T08:17:26.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.654+0000 7f55bc3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b40b02f0 con 0x7f55b41579f0 2023-10-09T08:17:26.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.654+0000 7f55ba19b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b40b1850 0x7f55b415ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:26.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.654+0000 7f55ba19b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b40b1850 0x7f55b415ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48190/0 (socket says 172.21.15.71:48190) 2023-10-09T08:17:26.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.654+0000 7f55ba19b700 1 -- 172.21.15.71:0/1752620636 learned_addr learned my addr 172.21.15.71:0/1752620636 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:26.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.655+0000 7f55ba99c700 1 --2- 172.21.15.71:0/1752620636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55b41579f0 0x7f55b4147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:26.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.655+0000 7f55ba19b700 1 -- 172.21.15.71:0/1752620636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55b41579f0 msgr2=0x7f55b4147fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:26.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.655+0000 7f55ba19b700 1 --2- 172.21.15.71:0/1752620636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55b41579f0 0x7f55b4147fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:26.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.655+0000 7f55b999a700 1 --2- 172.21.15.71:0/1752620636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55b40b1c20 0x7f55b40afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:26.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.655+0000 7f55ba19b700 1 -- 172.21.15.71:0/1752620636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55b40b1c20 msgr2=0x7f55b40afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:26.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.655+0000 7f55ba19b700 1 --2- 172.21.15.71:0/1752620636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55b40b1c20 0x7f55b40afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:26.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.655+0000 7f55ba19b700 1 -- 172.21.15.71:0/1752620636 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac009ae0 con 0x7f55b40b1850 2023-10-09T08:17:26.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.655+0000 7f55b999a700 1 --2- 172.21.15.71:0/1752620636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55b40b1c20 0x7f55b40afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:26.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.655+0000 7f55ba19b700 1 --2- 172.21.15.71:0/1752620636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b40b1850 0x7f55b415ad90 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f55b000c790 tx=0x7f55b0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:26.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.655+0000 7f55aa7fc700 1 -- 172.21.15.71:0/1752620636 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b0012630 con 0x7f55b40b1850 2023-10-09T08:17:26.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.655+0000 7f55aa7fc700 1 -- 172.21.15.71:0/1752620636 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b00127b0 con 0x7f55b40b1850 2023-10-09T08:17:26.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.655+0000 7f55bc3ff700 1 -- 172.21.15.71:0/1752620636 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b40b0570 con 0x7f55b40b1850 2023-10-09T08:17:26.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.655+0000 7f55aa7fc700 1 -- 172.21.15.71:0/1752620636 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b0012b70 con 0x7f55b40b1850 2023-10-09T08:17:26.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.655+0000 7f55bc3ff700 1 -- 172.21.15.71:0/1752620636 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b40b0b30 con 0x7f55b40b1850 2023-10-09T08:17:26.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.656+0000 7f55bc3ff700 1 -- 172.21.15.71:0/1752620636 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b40a9f20 con 0x7f55b40b1850 2023-10-09T08:17:26.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.657+0000 7f55aa7fc700 1 -- 172.21.15.71:0/1752620636 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f55b001b400 con 0x7f55b40b1850 2023-10-09T08:17:26.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.658+0000 7f55aa7fc700 1 --2- 172.21.15.71:0/1752620636 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5598066f30 0x7f55980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:26.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.658+0000 7f55aa7fc700 1 -- 172.21.15.71:0/1752620636 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f55b0084370 con 0x7f55b40b1850 2023-10-09T08:17:26.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.659+0000 7f55b999a700 1 --2- 172.21.15.71:0/1752620636 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5598066f30 0x7f55980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:26.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.660+0000 7f55b999a700 1 --2- 172.21.15.71:0/1752620636 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5598066f30 0x7f55980693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f55b416d7b0 tx=0x7f55a4009040 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:26.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.662+0000 7f55aa7fc700 1 -- 172.21.15.71:0/1752620636 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55b40a9f20 con 0x7f55b40b1850 2023-10-09T08:17:26.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.868+0000 7f55bc3ff700 1 -- 172.21.15.71:0/1752620636 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55b40a9f20 con 0x7f55b40b1850 2023-10-09T08:17:26.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.869+0000 7f55aa7fc700 1 -- 172.21.15.71:0/1752620636 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v210) v1 ==== 74+0+16165 (secure 0 0 0) 0x7f55b40a9f20 con 0x7f55b40b1850 2023-10-09T08:17:26.869 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:26.869 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":210,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T08:17:23.959261+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-09T08:17:20.000097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"209","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-09T08:17:21.419977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"210","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T08:17:26.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.872+0000 7f55bc3ff700 1 -- 172.21.15.71:0/1752620636 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5598066f30 msgr2=0x7f55980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:26.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.872+0000 7f55bc3ff700 1 --2- 172.21.15.71:0/1752620636 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5598066f30 0x7f55980693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f55b416d7b0 tx=0x7f55a4009040 comp rx=0 tx=0).stop 2023-10-09T08:17:26.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.872+0000 7f55bc3ff700 1 -- 172.21.15.71:0/1752620636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b40b1850 msgr2=0x7f55b415ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:26.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.872+0000 7f55bc3ff700 1 --2- 172.21.15.71:0/1752620636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b40b1850 0x7f55b415ad90 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f55b000c790 tx=0x7f55b0007f60 comp rx=0 tx=0).stop 2023-10-09T08:17:26.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.872+0000 7f55bc3ff700 1 -- 172.21.15.71:0/1752620636 shutdown_connections 2023-10-09T08:17:26.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.872+0000 7f55bc3ff700 1 --2- 172.21.15.71:0/1752620636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55b41579f0 0x7f55b4147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:26.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.872+0000 7f55bc3ff700 1 --2- 172.21.15.71:0/1752620636 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5598066f30 0x7f55980693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:26.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.872+0000 7f55bc3ff700 1 --2- 172.21.15.71:0/1752620636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b40b1850 0x7f55b415ad90 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:26.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.872+0000 7f55bc3ff700 1 --2- 172.21.15.71:0/1752620636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55b40b1c20 0x7f55b40afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:26.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.872+0000 7f55bc3ff700 1 -- 172.21.15.71:0/1752620636 >> 172.21.15.71:0/1752620636 conn(0x7f55b406a320 msgr2=0x7f55b406e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:26.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.872+0000 7f55bc3ff700 1 -- 172.21.15.71:0/1752620636 shutdown_connections 2023-10-09T08:17:26.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:26.872+0000 7f55bc3ff700 1 -- 172.21.15.71:0/1752620636 wait complete. 2023-10-09T08:17:26.889 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T08:17:26.889 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T08:17:27.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.072+0000 7f5b2a39d700 1 Processor -- start 2023-10-09T08:17:27.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.072+0000 7f5b2a39d700 1 -- start start 2023-10-09T08:17:27.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.073+0000 7f5b2a39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b240ad870 0x7f5b2406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:27.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.073+0000 7f5b2a39d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2406c350 con 0x7f5b24142ea0 2023-10-09T08:17:27.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.073+0000 7f5b2a39d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b240b40f0 con 0x7f5b2406bf20 2023-10-09T08:17:27.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.073+0000 7f5b2a39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b24069640 con 0x7f5b240ad870 2023-10-09T08:17:27.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.073+0000 7f5b2939b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f5b24142ea0 0x7f5b240b3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33250/0 (socket says 172.21.15.71:33250) 2023-10-09T08:17:27.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.073+0000 7f5b2939b700 1 -- 172.21.15.71:0/677299480 learned_addr learned my addr 172.21.15.71:0/677299480 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:27.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.074+0000 7f5b28b9a700 1 --2- 172.21.15.71:0/677299480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b240ad870 0x7f5b2406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:27.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.074+0000 7f5b1bfff700 1 -- 172.21.15.71:0/677299480 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1885831273 0 0) 0x7f5b2406c350 con 0x7f5b24142ea0 2023-10-09T08:17:27.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.074+0000 7f5b1bfff700 1 -- 172.21.15.71:0/677299480 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b10003570 con 0x7f5b24142ea0 2023-10-09T08:17:27.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.074+0000 7f5b1bfff700 1 -- 172.21.15.71:0/677299480 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3954769812 0 0) 0x7f5b240b40f0 con 0x7f5b2406bf20 2023-10-09T08:17:27.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.074+0000 7f5b1bfff700 1 -- 172.21.15.71:0/677299480 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b2406c350 con 0x7f5b2406bf20 2023-10-09T08:17:27.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.074+0000 7f5b1bfff700 1 -- 172.21.15.71:0/677299480 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1255112707 0 0) 0x7f5b10003570 con 0x7f5b24142ea0 2023-10-09T08:17:27.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.074+0000 7f5b1bfff700 1 -- 172.21.15.71:0/677299480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b240ad870 msgr2=0x7f5b2406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:27.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.074+0000 7f5b1bfff700 1 --2- 172.21.15.71:0/677299480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b240ad870 0x7f5b2406b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.074+0000 7f5b1bfff700 1 -- 172.21.15.71:0/677299480 >> v1:172.21.15.179:6789/0 conn(0x7f5b2406bf20 legacy=0x7f5b2406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:27.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.074+0000 7f5b1bfff700 1 -- 172.21.15.71:0/677299480 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b24069920 con 0x7f5b24142ea0 2023-10-09T08:17:27.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.074+0000 7f5b1bfff700 1 -- 172.21.15.71:0/677299480 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f5b20001470 con 0x7f5b24142ea0 2023-10-09T08:17:27.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.074+0000 7f5b1bfff700 1 -- 172.21.15.71:0/677299480 >> v1:172.21.15.71:6789/0 conn(0x7f5b24142ea0 legacy=0x7f5b240b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:27.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.074+0000 7f5b1bfff700 1 --2- 172.21.15.71:0/677299480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b10003c20 0x7f5b10003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:27.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.074+0000 7f5b1bfff700 1 --2- 172.21.15.71:0/677299480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b10004810 0x7f5b10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:27.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.074+0000 7f5b1bfff700 1 --2- 172.21.15.71:0/677299480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b100051c0 0x7f5b1000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:27.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.074+0000 7f5b1bfff700 1 -- 172.21.15.71:0/677299480 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b24069640 con 0x7f5b100051c0 2023-10-09T08:17:27.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.074+0000 7f5b1bfff700 1 -- 172.21.15.71:0/677299480 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1000bfd0 con 0x7f5b10004810 2023-10-09T08:17:27.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.074+0000 7f5b1bfff700 1 -- 172.21.15.71:0/677299480 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1000c190 con 0x7f5b10003c20 2023-10-09T08:17:27.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.075+0000 7f5b29b9c700 1 --2- 172.21.15.71:0/677299480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b100051c0 0x7f5b1000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:27.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.075+0000 7f5b2939b700 1 --2- 172.21.15.71:0/677299480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b10003c20 0x7f5b10003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:27.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.075+0000 7f5b28b9a700 1 --2- 172.21.15.71:0/677299480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b10004810 0x7f5b10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:27.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.075+0000 7f5b29b9c700 1 -- 172.21.15.71:0/677299480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b10003c20 msgr2=0x7f5b10003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:27.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.075+0000 7f5b29b9c700 1 --2- 172.21.15.71:0/677299480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b10003c20 0x7f5b10003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.075+0000 7f5b29b9c700 1 -- 172.21.15.71:0/677299480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b10004810 msgr2=0x7f5b10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:27.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.075+0000 7f5b29b9c700 1 --2- 172.21.15.71:0/677299480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b10004810 0x7f5b10004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.075+0000 7f5b29b9c700 1 -- 172.21.15.71:0/677299480 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b10003570 con 0x7f5b100051c0 2023-10-09T08:17:27.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.075+0000 7f5b29b9c700 1 --2- 172.21.15.71:0/677299480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b100051c0 0x7f5b1000ba60 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c002120 tx=0x7f5b1c0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc48fd4d06f5899 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:27.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.076+0000 7f5b1bfff700 1 -- 172.21.15.71:0/677299480 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c001ab0 con 0x7f5b100051c0 2023-10-09T08:17:27.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.076+0000 7f5b1bfff700 1 -- 172.21.15.71:0/677299480 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c00c980 con 0x7f5b100051c0 2023-10-09T08:17:27.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.076+0000 7f5b1bfff700 1 -- 172.21.15.71:0/677299480 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c00cd20 con 0x7f5b100051c0 2023-10-09T08:17:27.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.076+0000 7f5b2a39d700 1 -- 172.21.15.71:0/677299480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b100051c0 msgr2=0x7f5b1000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:27.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.076+0000 7f5b2a39d700 1 --2- 172.21.15.71:0/677299480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b100051c0 0x7f5b1000ba60 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c002120 tx=0x7f5b1c0017a0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.076+0000 7f5b29b9c700 1 -- 172.21.15.71:0/677299480 reap_dead start 2023-10-09T08:17:27.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.076+0000 7f5b2a39d700 1 -- 172.21.15.71:0/677299480 shutdown_connections 2023-10-09T08:17:27.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.076+0000 7f5b2a39d700 1 -- 172.21.15.71:0/677299480 >> 172.21.15.71:0/677299480 conn(0x7f5b240ce430 msgr2=0x7f5b240ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:27.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.076+0000 7f5b2a39d700 1 -- 172.21.15.71:0/677299480 shutdown_connections 2023-10-09T08:17:27.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.076+0000 7f5b2a39d700 1 -- 172.21.15.71:0/677299480 wait complete. 2023-10-09T08:17:27.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.078+0000 7f5b2a39d700 1 Processor -- start 2023-10-09T08:17:27.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.078+0000 7f5b2a39d700 1 -- start start 2023-10-09T08:17:27.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.078+0000 7f5b2a39d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b100051c0 0x7f5b24159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:27.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.078+0000 7f5b2a39d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b2415c140 0x7f5b2415c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:27.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.078+0000 7f5b2a39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b2415caf0 0x7f5b2415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:27.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.078+0000 7f5b2a39d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b240c82b0 con 0x7f5b2415c140 2023-10-09T08:17:27.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.078+0000 7f5b2a39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b240c8500 con 0x7f5b2415caf0 2023-10-09T08:17:27.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.079+0000 7f5b2a39d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b240c87e0 con 0x7f5b100051c0 2023-10-09T08:17:27.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.079+0000 7f5b28b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b2415c140 0x7f5b2415c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:27.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.079+0000 7f5b28b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b2415c140 0x7f5b2415c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48206/0 (socket says 172.21.15.71:48206) 2023-10-09T08:17:27.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.079+0000 7f5b28b9a700 1 -- 172.21.15.71:0/492748624 learned_addr learned my addr 172.21.15.71:0/492748624 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:27.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.079+0000 7f5b29b9c700 1 --2- 172.21.15.71:0/492748624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b2415caf0 0x7f5b2415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:27.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.079+0000 7f5b2939b700 1 --2- 172.21.15.71:0/492748624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b100051c0 0x7f5b24159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:27.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.079+0000 7f5b28b9a700 1 -- 172.21.15.71:0/492748624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b100051c0 msgr2=0x7f5b24159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:27.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.079+0000 7f5b28b9a700 1 --2- 172.21.15.71:0/492748624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b100051c0 0x7f5b24159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.079+0000 7f5b28b9a700 1 -- 172.21.15.71:0/492748624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b2415caf0 msgr2=0x7f5b2415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:27.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.079+0000 7f5b28b9a700 1 --2- 172.21.15.71:0/492748624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b2415caf0 0x7f5b2415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.079+0000 7f5b28b9a700 1 -- 172.21.15.71:0/492748624 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b240c8ac0 con 0x7f5b2415c140 2023-10-09T08:17:27.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.079+0000 7f5b28b9a700 1 --2- 172.21.15.71:0/492748624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b2415c140 0x7f5b2415c5b0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f5b14006ac0 tx=0x7f5b140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:27.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.080+0000 7f5b197fa700 1 -- 172.21.15.71:0/492748624 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1400fa10 con 0x7f5b2415c140 2023-10-09T08:17:27.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.080+0000 7f5b197fa700 1 -- 172.21.15.71:0/492748624 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1400fb70 con 0x7f5b2415c140 2023-10-09T08:17:27.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.080+0000 7f5b2a39d700 1 -- 172.21.15.71:0/492748624 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b240c8da0 con 0x7f5b2415c140 2023-10-09T08:17:27.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.080+0000 7f5b197fa700 1 -- 172.21.15.71:0/492748624 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b14014440 con 0x7f5b2415c140 2023-10-09T08:17:27.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.080+0000 7f5b2a39d700 1 -- 172.21.15.71:0/492748624 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b24140100 con 0x7f5b2415c140 2023-10-09T08:17:27.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.081+0000 7f5b2a39d700 1 -- 172.21.15.71:0/492748624 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2404c3c0 con 0x7f5b2415c140 2023-10-09T08:17:27.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.081+0000 7f5b197fa700 1 -- 172.21.15.71:0/492748624 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b14014870 con 0x7f5b2415c140 2023-10-09T08:17:27.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.082+0000 7f5b197fa700 1 --2- 172.21.15.71:0/492748624 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5b08066f30 0x7f5b080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:27.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.082+0000 7f5b197fa700 1 -- 172.21.15.71:0/492748624 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f5b14018030 con 0x7f5b2415c140 2023-10-09T08:17:27.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.083+0000 7f5b2939b700 1 --2- 172.21.15.71:0/492748624 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5b08066f30 0x7f5b080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:27.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.083+0000 7f5b2939b700 1 --2- 172.21.15.71:0/492748624 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5b08066f30 0x7f5b080693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5b20001bb0 tx=0x7f5b20009040 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:27.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.086+0000 7f5b197fa700 1 -- 172.21.15.71:0/492748624 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b140522b0 con 0x7f5b2415c140 2023-10-09T08:17:27.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.271+0000 7f5b2a39d700 1 -- 172.21.15.71:0/492748624 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b24069c00 con 0x7f5b08066f30 2023-10-09T08:17:27.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.282+0000 7f5b197fa700 1 -- 172.21.15.71:0/492748624 <== mgr.9427 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286936 (secure 0 0 0) 0x7f5b24069c00 con 0x7f5b08066f30 2023-10-09T08:17:27.286 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:27.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.287+0000 7f5b2a39d700 1 -- 172.21.15.71:0/492748624 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5b08066f30 msgr2=0x7f5b080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:27.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.287+0000 7f5b2a39d700 1 --2- 172.21.15.71:0/492748624 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5b08066f30 0x7f5b080693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5b20001bb0 tx=0x7f5b20009040 comp rx=0 tx=0).stop 2023-10-09T08:17:27.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.287+0000 7f5b2a39d700 1 -- 172.21.15.71:0/492748624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b2415c140 msgr2=0x7f5b2415c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:27.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.287+0000 7f5b2a39d700 1 --2- 172.21.15.71:0/492748624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b2415c140 0x7f5b2415c5b0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f5b14006ac0 tx=0x7f5b140091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.287+0000 7f5b2a39d700 1 -- 172.21.15.71:0/492748624 shutdown_connections 2023-10-09T08:17:27.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.287+0000 7f5b2a39d700 1 --2- 172.21.15.71:0/492748624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b2415caf0 0x7f5b2415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.287+0000 7f5b2a39d700 1 --2- 172.21.15.71:0/492748624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b100051c0 0x7f5b24159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.287+0000 7f5b2a39d700 1 --2- 172.21.15.71:0/492748624 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5b08066f30 0x7f5b080693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.287+0000 7f5b2a39d700 1 --2- 172.21.15.71:0/492748624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b2415c140 0x7f5b2415c5b0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.287+0000 7f5b2a39d700 1 -- 172.21.15.71:0/492748624 >> 172.21.15.71:0/492748624 conn(0x7f5b240ce430 msgr2=0x7f5b24141dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:27.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.287+0000 7f5b2a39d700 1 -- 172.21.15.71:0/492748624 shutdown_connections 2023-10-09T08:17:27.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.287+0000 7f5b2a39d700 1 -- 172.21.15.71:0/492748624 wait complete. 2023-10-09T08:17:27.290 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T08:17:27.304 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T08:17:26.214307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":620,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":383,"ondisk_log_size":383,"up":160,"acting":160,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2490100,"kb_used_data":21684,"kb_used_omap":0,"kb_used_meta":2468352,"kb_avail":752484620,"statfs":{"total":773094113280,"available":770544250880,"internally_reserved":0,"allocated":22204416,"data_stored":11758523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2527592448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.262430"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.988806+0000","last_change":"2023-10-09T08:17:22.987349+0000","last_active":"2023-10-09T08:17:22.988806+0000","last_peered":"2023-10-09T08:17:22.988806+0000","last_clean":"2023-10-09T08:17:22.988806+0000","last_became_active":"2023-10-09T08:17:22.987068+0000","last_became_peered":"2023-10-09T08:17:22.987068+0000","last_unstale":"2023-10-09T08:17:22.988806+0000","last_undegraded":"2023-10-09T08:17:22.988806+0000","last_fullsized":"2023-10-09T08:17:22.988806+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:32:31.652330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983385+0000","last_change":"2023-10-09T08:17:22.980482+0000","last_active":"2023-10-09T08:17:22.983385+0000","last_peered":"2023-10-09T08:17:22.983385+0000","last_clean":"2023-10-09T08:17:22.983385+0000","last_became_active":"2023-10-09T08:17:22.980162+0000","last_became_peered":"2023-10-09T08:17:22.980162+0000","last_unstale":"2023-10-09T08:17:22.983385+0000","last_undegraded":"2023-10-09T08:17:22.983385+0000","last_fullsized":"2023-10-09T08:17:22.983385+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:08:19.846565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982856+0000","last_change":"2023-10-09T08:17:22.978532+0000","last_active":"2023-10-09T08:17:22.982856+0000","last_peered":"2023-10-09T08:17:22.982856+0000","last_clean":"2023-10-09T08:17:22.982856+0000","last_became_active":"2023-10-09T08:17:22.978261+0000","last_became_peered":"2023-10-09T08:17:22.978261+0000","last_unstale":"2023-10-09T08:17:22.982856+0000","last_undegraded":"2023-10-09T08:17:22.982856+0000","last_fullsized":"2023-10-09T08:17:22.982856+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:02.562263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.981672+0000","last_change":"2023-10-09T08:17:22.978795+0000","last_active":"2023-10-09T08:17:22.981672+0000","last_peered":"2023-10-09T08:17:22.981672+0000","last_clean":"2023-10-09T08:17:22.981672+0000","last_became_active":"2023-10-09T08:17:22.978557+0000","last_became_peered":"2023-10-09T08:17:22.978557+0000","last_unstale":"2023-10-09T08:17:22.981672+0000","last_undegraded":"2023-10-09T08:17:22.981672+0000","last_fullsized":"2023-10-09T08:17:22.981672+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:19.484500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.984320+0000","last_change":"2023-10-09T08:17:22.981507+0000","last_active":"2023-10-09T08:17:22.984320+0000","last_peered":"2023-10-09T08:17:22.984320+0000","last_clean":"2023-10-09T08:17:22.984320+0000","last_became_active":"2023-10-09T08:17:22.981260+0000","last_became_peered":"2023-10-09T08:17:22.981260+0000","last_unstale":"2023-10-09T08:17:22.984320+0000","last_undegraded":"2023-10-09T08:17:22.984320+0000","last_fullsized":"2023-10-09T08:17:22.984320+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:32.306795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.971000+0000","last_change":"2023-10-09T08:17:22.967502+0000","last_active":"2023-10-09T08:17:22.971000+0000","last_peered":"2023-10-09T08:17:22.971000+0000","last_clean":"2023-10-09T08:17:22.971000+0000","last_became_active":"2023-10-09T08:17:22.967258+0000","last_became_peered":"2023-10-09T08:17:22.967258+0000","last_unstale":"2023-10-09T08:17:22.971000+0000","last_undegraded":"2023-10-09T08:17:22.971000+0000","last_fullsized":"2023-10-09T08:17:22.971000+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:02.453697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.988639+0000","last_change":"2023-10-09T08:17:22.983416+0000","last_active":"2023-10-09T08:17:22.988639+0000","last_peered":"2023-10-09T08:17:22.988639+0000","last_clean":"2023-10-09T08:17:22.988639+0000","last_became_active":"2023-10-09T08:17:22.981717+0000","last_became_peered":"2023-10-09T08:17:22.981717+0000","last_unstale":"2023-10-09T08:17:22.988639+0000","last_undegraded":"2023-10-09T08:17:22.988639+0000","last_fullsized":"2023-10-09T08:17:22.988639+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:51.687684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.984150+0000","last_change":"2023-10-09T08:17:22.979132+0000","last_active":"2023-10-09T08:17:22.984150+0000","last_peered":"2023-10-09T08:17:22.984150+0000","last_clean":"2023-10-09T08:17:22.984150+0000","last_became_active":"2023-10-09T08:17:22.978851+0000","last_became_peered":"2023-10-09T08:17:22.978851+0000","last_unstale":"2023-10-09T08:17:22.984150+0000","last_undegraded":"2023-10-09T08:17:22.984150+0000","last_fullsized":"2023-10-09T08:17:22.984150+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:49.270902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.971747+0000","last_change":"2023-10-09T08:17:22.968330+0000","last_active":"2023-10-09T08:17:22.971747+0000","last_peered":"2023-10-09T08:17:22.971747+0000","last_clean":"2023-10-09T08:17:22.971747+0000","last_became_active":"2023-10-09T08:17:22.968098+0000","last_became_peered":"2023-10-09T08:17:22.968098+0000","last_unstale":"2023-10-09T08:17:22.971747+0000","last_undegraded":"2023-10-09T08:17:22.971747+0000","last_fullsized":"2023-10-09T08:17:22.971747+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:26.390859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.992436+0000","last_change":"2023-10-09T08:17:22.987389+0000","last_active":"2023-10-09T08:17:22.992436+0000","last_peered":"2023-10-09T08:17:22.992436+0000","last_clean":"2023-10-09T08:17:22.992436+0000","last_became_active":"2023-10-09T08:17:22.987114+0000","last_became_peered":"2023-10-09T08:17:22.987114+0000","last_unstale":"2023-10-09T08:17:22.992436+0000","last_undegraded":"2023-10-09T08:17:22.992436+0000","last_fullsized":"2023-10-09T08:17:22.992436+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:50.692531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.986775+0000","last_change":"2023-10-09T08:17:22.983507+0000","last_active":"2023-10-09T08:17:22.986775+0000","last_peered":"2023-10-09T08:17:22.986775+0000","last_clean":"2023-10-09T08:17:22.986775+0000","last_became_active":"2023-10-09T08:17:22.983220+0000","last_became_peered":"2023-10-09T08:17:22.983220+0000","last_unstale":"2023-10-09T08:17:22.986775+0000","last_undegraded":"2023-10-09T08:17:22.986775+0000","last_fullsized":"2023-10-09T08:17:22.986775+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:43:41.322751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.991789+0000","last_change":"2023-10-09T08:17:22.987121+0000","last_active":"2023-10-09T08:17:22.991789+0000","last_peered":"2023-10-09T08:17:22.991789+0000","last_clean":"2023-10-09T08:17:22.991789+0000","last_became_active":"2023-10-09T08:17:22.986832+0000","last_became_peered":"2023-10-09T08:17:22.986832+0000","last_unstale":"2023-10-09T08:17:22.991789+0000","last_undegraded":"2023-10-09T08:17:22.991789+0000","last_fullsized":"2023-10-09T08:17:22.991789+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:42:42.958751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.990448+0000","last_change":"2023-10-09T08:17:22.986695+0000","last_active":"2023-10-09T08:17:22.990448+0000","last_peered":"2023-10-09T08:17:22.990448+0000","last_clean":"2023-10-09T08:17:22.990448+0000","last_became_active":"2023-10-09T08:17:22.986436+0000","last_became_peered":"2023-10-09T08:17:22.986436+0000","last_unstale":"2023-10-09T08:17:22.990448+0000","last_undegraded":"2023-10-09T08:17:22.990448+0000","last_fullsized":"2023-10-09T08:17:22.990448+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:39:24.985715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982837+0000","last_change":"2023-10-09T08:17:22.977788+0000","last_active":"2023-10-09T08:17:22.982837+0000","last_peered":"2023-10-09T08:17:22.982837+0000","last_clean":"2023-10-09T08:17:22.982837+0000","last_became_active":"2023-10-09T08:17:22.977521+0000","last_became_peered":"2023-10-09T08:17:22.977521+0000","last_unstale":"2023-10-09T08:17:22.982837+0000","last_undegraded":"2023-10-09T08:17:22.982837+0000","last_fullsized":"2023-10-09T08:17:22.982837+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:31.629347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.980841+0000","last_change":"2023-10-09T08:17:22.977049+0000","last_active":"2023-10-09T08:17:22.980841+0000","last_peered":"2023-10-09T08:17:22.980841+0000","last_clean":"2023-10-09T08:17:22.980841+0000","last_became_active":"2023-10-09T08:17:22.976779+0000","last_became_peered":"2023-10-09T08:17:22.976779+0000","last_unstale":"2023-10-09T08:17:22.980841+0000","last_undegraded":"2023-10-09T08:17:22.980841+0000","last_fullsized":"2023-10-09T08:17:22.980841+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:41.226637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.985723+0000","last_change":"2023-10-09T08:17:22.984732+0000","last_active":"2023-10-09T08:17:22.985723+0000","last_peered":"2023-10-09T08:17:22.985723+0000","last_clean":"2023-10-09T08:17:22.985723+0000","last_became_active":"2023-10-09T08:17:22.984481+0000","last_became_peered":"2023-10-09T08:17:22.984481+0000","last_unstale":"2023-10-09T08:17:22.985723+0000","last_undegraded":"2023-10-09T08:17:22.985723+0000","last_fullsized":"2023-10-09T08:17:22.985723+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:24:10.514407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983916+0000","last_change":"2023-10-09T08:17:22.974270+0000","last_active":"2023-10-09T08:17:22.983916+0000","last_peered":"2023-10-09T08:17:22.983916+0000","last_clean":"2023-10-09T08:17:22.983916+0000","last_became_active":"2023-10-09T08:17:22.974010+0000","last_became_peered":"2023-10-09T08:17:22.974010+0000","last_unstale":"2023-10-09T08:17:22.983916+0000","last_undegraded":"2023-10-09T08:17:22.983916+0000","last_fullsized":"2023-10-09T08:17:22.983916+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:10:24.260909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.985251+0000","last_change":"2023-10-09T08:17:22.983336+0000","last_active":"2023-10-09T08:17:22.985251+0000","last_peered":"2023-10-09T08:17:22.985251+0000","last_clean":"2023-10-09T08:17:22.985251+0000","last_became_active":"2023-10-09T08:17:22.983072+0000","last_became_peered":"2023-10-09T08:17:22.983072+0000","last_unstale":"2023-10-09T08:17:22.985251+0000","last_undegraded":"2023-10-09T08:17:22.985251+0000","last_fullsized":"2023-10-09T08:17:22.985251+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:04.142683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983367+0000","last_change":"2023-10-09T08:17:22.979452+0000","last_active":"2023-10-09T08:17:22.983367+0000","last_peered":"2023-10-09T08:17:22.983367+0000","last_clean":"2023-10-09T08:17:22.983367+0000","last_became_active":"2023-10-09T08:17:22.979151+0000","last_became_peered":"2023-10-09T08:17:22.979151+0000","last_unstale":"2023-10-09T08:17:22.983367+0000","last_undegraded":"2023-10-09T08:17:22.983367+0000","last_fullsized":"2023-10-09T08:17:22.983367+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:16:27.730608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.975230+0000","last_change":"2023-10-09T08:17:22.973609+0000","last_active":"2023-10-09T08:17:22.975230+0000","last_peered":"2023-10-09T08:17:22.975230+0000","last_clean":"2023-10-09T08:17:22.975230+0000","last_became_active":"2023-10-09T08:17:22.973223+0000","last_became_peered":"2023-10-09T08:17:22.973223+0000","last_unstale":"2023-10-09T08:17:22.975230+0000","last_undegraded":"2023-10-09T08:17:22.975230+0000","last_fullsized":"2023-10-09T08:17:22.975230+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:14.281969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983370+0000","last_change":"2023-10-09T08:17:22.982342+0000","last_active":"2023-10-09T08:17:22.983370+0000","last_peered":"2023-10-09T08:17:22.983370+0000","last_clean":"2023-10-09T08:17:22.983370+0000","last_became_active":"2023-10-09T08:17:22.982076+0000","last_became_peered":"2023-10-09T08:17:22.982076+0000","last_unstale":"2023-10-09T08:17:22.983370+0000","last_undegraded":"2023-10-09T08:17:22.983370+0000","last_fullsized":"2023-10-09T08:17:22.983370+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:17.661906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.973192+0000","last_change":"2023-10-09T08:17:22.969013+0000","last_active":"2023-10-09T08:17:22.973192+0000","last_peered":"2023-10-09T08:17:22.973192+0000","last_clean":"2023-10-09T08:17:22.973192+0000","last_became_active":"2023-10-09T08:17:22.968732+0000","last_became_peered":"2023-10-09T08:17:22.968732+0000","last_unstale":"2023-10-09T08:17:22.973192+0000","last_undegraded":"2023-10-09T08:17:22.973192+0000","last_fullsized":"2023-10-09T08:17:22.973192+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:38:56.087344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.972930+0000","last_change":"2023-10-09T08:17:22.971110+0000","last_active":"2023-10-09T08:17:22.972930+0000","last_peered":"2023-10-09T08:17:22.972930+0000","last_clean":"2023-10-09T08:17:22.972930+0000","last_became_active":"2023-10-09T08:17:22.970864+0000","last_became_peered":"2023-10-09T08:17:22.970864+0000","last_unstale":"2023-10-09T08:17:22.972930+0000","last_undegraded":"2023-10-09T08:17:22.972930+0000","last_fullsized":"2023-10-09T08:17:22.972930+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:35:13.889838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"209'4","reported_seq":14,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997902+0000","last_change":"2023-10-09T08:17:21.981359+0000","last_active":"2023-10-09T08:17:22.997902+0000","last_peered":"2023-10-09T08:17:22.997902+0000","last_clean":"2023-10-09T08:17:22.997902+0000","last_became_active":"2023-10-09T08:17:21.981080+0000","last_became_peered":"2023-10-09T08:17:21.981080+0000","last_unstale":"2023-10-09T08:17:22.997902+0000","last_undegraded":"2023-10-09T08:17:22.997902+0000","last_fullsized":"2023-10-09T08:17:22.997902+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:38.043951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.981880+0000","last_change":"2023-10-09T08:17:22.977736+0000","last_active":"2023-10-09T08:17:22.981880+0000","last_peered":"2023-10-09T08:17:22.981880+0000","last_clean":"2023-10-09T08:17:22.981880+0000","last_became_active":"2023-10-09T08:17:22.976851+0000","last_became_peered":"2023-10-09T08:17:22.976851+0000","last_unstale":"2023-10-09T08:17:22.981880+0000","last_undegraded":"2023-10-09T08:17:22.981880+0000","last_fullsized":"2023-10-09T08:17:22.981880+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:22:35.631994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:17:20.944684+0000","last_change":"2023-10-09T08:17:20.957900+0000","last_active":"2023-10-09T08:17:20.944684+0000","last_peered":"2023-10-09T08:17:20.944684+0000","last_clean":"2023-10-09T08:17:20.944684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:20.944684+0000","last_undegraded":"2023-10-09T08:17:20.944684+0000","last_fullsized":"2023-10-09T08:17:20.944684+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:31.300930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.974564+0000","last_change":"2023-10-09T08:17:22.970652+0000","last_active":"2023-10-09T08:17:22.974564+0000","last_peered":"2023-10-09T08:17:22.974564+0000","last_clean":"2023-10-09T08:17:22.974564+0000","last_became_active":"2023-10-09T08:17:22.970213+0000","last_became_peered":"2023-10-09T08:17:22.970213+0000","last_unstale":"2023-10-09T08:17:22.974564+0000","last_undegraded":"2023-10-09T08:17:22.974564+0000","last_fullsized":"2023-10-09T08:17:22.974564+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:44:06.711747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.995441+0000","last_change":"2023-10-09T08:17:21.973213+0000","last_active":"2023-10-09T08:17:22.995441+0000","last_peered":"2023-10-09T08:17:22.995441+0000","last_clean":"2023-10-09T08:17:22.995441+0000","last_became_active":"2023-10-09T08:17:21.972952+0000","last_became_peered":"2023-10-09T08:17:21.972952+0000","last_unstale":"2023-10-09T08:17:22.995441+0000","last_undegraded":"2023-10-09T08:17:22.995441+0000","last_fullsized":"2023-10-09T08:17:22.995441+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:28.933060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:17:20.944684+0000","last_change":"2023-10-09T08:17:20.958050+0000","last_active":"2023-10-09T08:17:20.944684+0000","last_peered":"2023-10-09T08:17:20.944684+0000","last_clean":"2023-10-09T08:17:20.944684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:20.944684+0000","last_undegraded":"2023-10-09T08:17:20.944684+0000","last_fullsized":"2023-10-09T08:17:20.944684+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:16.656042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.978894+0000","last_change":"2023-10-09T08:17:22.976545+0000","last_active":"2023-10-09T08:17:22.978894+0000","last_peered":"2023-10-09T08:17:22.978894+0000","last_clean":"2023-10-09T08:17:22.978894+0000","last_became_active":"2023-10-09T08:17:22.976305+0000","last_became_peered":"2023-10-09T08:17:22.976305+0000","last_unstale":"2023-10-09T08:17:22.978894+0000","last_undegraded":"2023-10-09T08:17:22.978894+0000","last_fullsized":"2023-10-09T08:17:22.978894+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:39.805879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"209'1","reported_seq":11,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997521+0000","last_change":"2023-10-09T08:17:21.979102+0000","last_active":"2023-10-09T08:17:22.997521+0000","last_peered":"2023-10-09T08:17:22.997521+0000","last_clean":"2023-10-09T08:17:22.997521+0000","last_became_active":"2023-10-09T08:17:21.977114+0000","last_became_peered":"2023-10-09T08:17:21.977114+0000","last_unstale":"2023-10-09T08:17:22.997521+0000","last_undegraded":"2023-10-09T08:17:22.997521+0000","last_fullsized":"2023-10-09T08:17:22.997521+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:59.752920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.972264+0000","last_change":"2023-10-09T08:17:22.968229+0000","last_active":"2023-10-09T08:17:22.972264+0000","last_peered":"2023-10-09T08:17:22.972264+0000","last_clean":"2023-10-09T08:17:22.972264+0000","last_became_active":"2023-10-09T08:17:22.967986+0000","last_became_peered":"2023-10-09T08:17:22.967986+0000","last_unstale":"2023-10-09T08:17:22.972264+0000","last_undegraded":"2023-10-09T08:17:22.972264+0000","last_fullsized":"2023-10-09T08:17:22.972264+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:30.679481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"209'1","reported_seq":11,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997465+0000","last_change":"2023-10-09T08:17:21.974938+0000","last_active":"2023-10-09T08:17:22.997465+0000","last_peered":"2023-10-09T08:17:22.997465+0000","last_clean":"2023-10-09T08:17:22.997465+0000","last_became_active":"2023-10-09T08:17:21.974701+0000","last_became_peered":"2023-10-09T08:17:21.974701+0000","last_unstale":"2023-10-09T08:17:22.997465+0000","last_undegraded":"2023-10-09T08:17:22.997465+0000","last_fullsized":"2023-10-09T08:17:22.997465+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:39:13.667615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.979263+0000","last_change":"2023-10-09T08:17:22.975840+0000","last_active":"2023-10-09T08:17:22.979263+0000","last_peered":"2023-10-09T08:17:22.979263+0000","last_clean":"2023-10-09T08:17:22.979263+0000","last_became_active":"2023-10-09T08:17:22.975564+0000","last_became_peered":"2023-10-09T08:17:22.975564+0000","last_unstale":"2023-10-09T08:17:22.979263+0000","last_undegraded":"2023-10-09T08:17:22.979263+0000","last_fullsized":"2023-10-09T08:17:22.979263+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:57:29.061415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.971606+0000","last_change":"2023-10-09T08:17:21.975736+0000","last_active":"2023-10-09T08:17:22.971606+0000","last_peered":"2023-10-09T08:17:22.971606+0000","last_clean":"2023-10-09T08:17:22.971606+0000","last_became_active":"2023-10-09T08:17:21.975485+0000","last_became_peered":"2023-10-09T08:17:21.975485+0000","last_unstale":"2023-10-09T08:17:22.971606+0000","last_undegraded":"2023-10-09T08:17:22.971606+0000","last_fullsized":"2023-10-09T08:17:22.971606+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:22.558736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.980865+0000","last_change":"2023-10-09T08:17:22.975094+0000","last_active":"2023-10-09T08:17:22.980865+0000","last_peered":"2023-10-09T08:17:22.980865+0000","last_clean":"2023-10-09T08:17:22.980865+0000","last_became_active":"2023-10-09T08:17:22.974826+0000","last_became_peered":"2023-10-09T08:17:22.974826+0000","last_unstale":"2023-10-09T08:17:22.980865+0000","last_undegraded":"2023-10-09T08:17:22.980865+0000","last_fullsized":"2023-10-09T08:17:22.980865+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:21.488090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.964826+0000","last_change":"2023-10-09T08:17:21.970071+0000","last_active":"2023-10-09T08:17:22.964826+0000","last_peered":"2023-10-09T08:17:22.964826+0000","last_clean":"2023-10-09T08:17:22.964826+0000","last_became_active":"2023-10-09T08:17:21.969809+0000","last_became_peered":"2023-10-09T08:17:21.969809+0000","last_unstale":"2023-10-09T08:17:22.964826+0000","last_undegraded":"2023-10-09T08:17:22.964826+0000","last_fullsized":"2023-10-09T08:17:22.964826+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:30.623483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.973746+0000","last_change":"2023-10-09T08:17:22.972774+0000","last_active":"2023-10-09T08:17:22.973746+0000","last_peered":"2023-10-09T08:17:22.973746+0000","last_clean":"2023-10-09T08:17:22.973746+0000","last_became_active":"2023-10-09T08:17:22.972520+0000","last_became_peered":"2023-10-09T08:17:22.972520+0000","last_unstale":"2023-10-09T08:17:22.973746+0000","last_undegraded":"2023-10-09T08:17:22.973746+0000","last_fullsized":"2023-10-09T08:17:22.973746+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:24.899441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.966427+0000","last_change":"2023-10-09T08:17:21.980454+0000","last_active":"2023-10-09T08:17:22.966427+0000","last_peered":"2023-10-09T08:17:22.966427+0000","last_clean":"2023-10-09T08:17:22.966427+0000","last_became_active":"2023-10-09T08:17:21.980212+0000","last_became_peered":"2023-10-09T08:17:21.980212+0000","last_unstale":"2023-10-09T08:17:22.966427+0000","last_undegraded":"2023-10-09T08:17:22.966427+0000","last_fullsized":"2023-10-09T08:17:22.966427+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:19.075882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.974546+0000","last_change":"2023-10-09T08:17:22.970468+0000","last_active":"2023-10-09T08:17:22.974546+0000","last_peered":"2023-10-09T08:17:22.974546+0000","last_clean":"2023-10-09T08:17:22.974546+0000","last_became_active":"2023-10-09T08:17:22.969789+0000","last_became_peered":"2023-10-09T08:17:22.969789+0000","last_unstale":"2023-10-09T08:17:22.974546+0000","last_undegraded":"2023-10-09T08:17:22.974546+0000","last_fullsized":"2023-10-09T08:17:22.974546+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:42.923655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"209'3","reported_seq":13,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.998217+0000","last_change":"2023-10-09T08:17:21.977462+0000","last_active":"2023-10-09T08:17:22.998217+0000","last_peered":"2023-10-09T08:17:22.998217+0000","last_clean":"2023-10-09T08:17:22.998217+0000","last_became_active":"2023-10-09T08:17:21.977059+0000","last_became_peered":"2023-10-09T08:17:21.977059+0000","last_unstale":"2023-10-09T08:17:22.998217+0000","last_undegraded":"2023-10-09T08:17:22.998217+0000","last_fullsized":"2023-10-09T08:17:22.998217+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:28.289402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.980213+0000","last_change":"2023-10-09T08:17:22.975853+0000","last_active":"2023-10-09T08:17:22.980213+0000","last_peered":"2023-10-09T08:17:22.980213+0000","last_clean":"2023-10-09T08:17:22.980213+0000","last_became_active":"2023-10-09T08:17:22.975560+0000","last_became_peered":"2023-10-09T08:17:22.975560+0000","last_unstale":"2023-10-09T08:17:22.980213+0000","last_undegraded":"2023-10-09T08:17:22.980213+0000","last_fullsized":"2023-10-09T08:17:22.980213+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:33:39.216798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"209'6","reported_seq":16,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.999925+0000","last_change":"2023-10-09T08:17:21.971926+0000","last_active":"2023-10-09T08:17:22.999925+0000","last_peered":"2023-10-09T08:17:22.999925+0000","last_clean":"2023-10-09T08:17:22.999925+0000","last_became_active":"2023-10-09T08:17:21.971645+0000","last_became_peered":"2023-10-09T08:17:21.971645+0000","last_unstale":"2023-10-09T08:17:22.999925+0000","last_undegraded":"2023-10-09T08:17:22.999925+0000","last_fullsized":"2023-10-09T08:17:22.999925+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:39:13.866505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.987320+0000","last_change":"2023-10-09T08:17:22.985018+0000","last_active":"2023-10-09T08:17:22.987320+0000","last_peered":"2023-10-09T08:17:22.987320+0000","last_clean":"2023-10-09T08:17:22.987320+0000","last_became_active":"2023-10-09T08:17:22.984647+0000","last_became_peered":"2023-10-09T08:17:22.984647+0000","last_unstale":"2023-10-09T08:17:22.987320+0000","last_undegraded":"2023-10-09T08:17:22.987320+0000","last_fullsized":"2023-10-09T08:17:22.987320+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:40:00.458280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997202+0000","last_change":"2023-10-09T08:17:21.975388+0000","last_active":"2023-10-09T08:17:22.997202+0000","last_peered":"2023-10-09T08:17:22.997202+0000","last_clean":"2023-10-09T08:17:22.997202+0000","last_became_active":"2023-10-09T08:17:21.974540+0000","last_became_peered":"2023-10-09T08:17:21.974540+0000","last_unstale":"2023-10-09T08:17:22.997202+0000","last_undegraded":"2023-10-09T08:17:22.997202+0000","last_fullsized":"2023-10-09T08:17:22.997202+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:39:02.110538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.984496+0000","last_change":"2023-10-09T08:17:22.982417+0000","last_active":"2023-10-09T08:17:22.984496+0000","last_peered":"2023-10-09T08:17:22.984496+0000","last_clean":"2023-10-09T08:17:22.984496+0000","last_became_active":"2023-10-09T08:17:22.982109+0000","last_became_peered":"2023-10-09T08:17:22.982109+0000","last_unstale":"2023-10-09T08:17:22.984496+0000","last_undegraded":"2023-10-09T08:17:22.984496+0000","last_fullsized":"2023-10-09T08:17:22.984496+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:46.160662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.967604+0000","last_change":"2023-10-09T08:17:21.981649+0000","last_active":"2023-10-09T08:17:22.967604+0000","last_peered":"2023-10-09T08:17:22.967604+0000","last_clean":"2023-10-09T08:17:22.967604+0000","last_became_active":"2023-10-09T08:17:21.981362+0000","last_became_peered":"2023-10-09T08:17:21.981362+0000","last_unstale":"2023-10-09T08:17:22.967604+0000","last_undegraded":"2023-10-09T08:17:22.967604+0000","last_fullsized":"2023-10-09T08:17:22.967604+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:03.261223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.961371+0000","last_change":"2023-10-09T08:17:21.976656+0000","last_active":"2023-10-09T08:17:22.961371+0000","last_peered":"2023-10-09T08:17:22.961371+0000","last_clean":"2023-10-09T08:17:22.961371+0000","last_became_active":"2023-10-09T08:17:21.976292+0000","last_became_peered":"2023-10-09T08:17:21.976292+0000","last_unstale":"2023-10-09T08:17:22.961371+0000","last_undegraded":"2023-10-09T08:17:22.961371+0000","last_fullsized":"2023-10-09T08:17:22.961371+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:00:59.557712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983496+0000","last_change":"2023-10-09T08:17:22.979323+0000","last_active":"2023-10-09T08:17:22.983496+0000","last_peered":"2023-10-09T08:17:22.983496+0000","last_clean":"2023-10-09T08:17:22.983496+0000","last_became_active":"2023-10-09T08:17:22.972209+0000","last_became_peered":"2023-10-09T08:17:22.972209+0000","last_unstale":"2023-10-09T08:17:22.983496+0000","last_undegraded":"2023-10-09T08:17:22.983496+0000","last_fullsized":"2023-10-09T08:17:22.983496+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:40.009878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"209'8","reported_seq":18,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.998098+0000","last_change":"2023-10-09T08:17:21.975369+0000","last_active":"2023-10-09T08:17:22.998098+0000","last_peered":"2023-10-09T08:17:22.998098+0000","last_clean":"2023-10-09T08:17:22.998098+0000","last_became_active":"2023-10-09T08:17:21.974853+0000","last_became_peered":"2023-10-09T08:17:21.974853+0000","last_unstale":"2023-10-09T08:17:22.998098+0000","last_undegraded":"2023-10-09T08:17:22.998098+0000","last_fullsized":"2023-10-09T08:17:22.998098+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:50.234694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.991744+0000","last_change":"2023-10-09T08:17:22.988118+0000","last_active":"2023-10-09T08:17:22.991744+0000","last_peered":"2023-10-09T08:17:22.991744+0000","last_clean":"2023-10-09T08:17:22.991744+0000","last_became_active":"2023-10-09T08:17:22.987859+0000","last_became_peered":"2023-10-09T08:17:22.987859+0000","last_unstale":"2023-10-09T08:17:22.991744+0000","last_undegraded":"2023-10-09T08:17:22.991744+0000","last_fullsized":"2023-10-09T08:17:22.991744+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:09:01.740678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"209'1","reported_seq":11,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997761+0000","last_change":"2023-10-09T08:17:21.977355+0000","last_active":"2023-10-09T08:17:22.997761+0000","last_peered":"2023-10-09T08:17:22.997761+0000","last_clean":"2023-10-09T08:17:22.997761+0000","last_became_active":"2023-10-09T08:17:21.977044+0000","last_became_peered":"2023-10-09T08:17:21.977044+0000","last_unstale":"2023-10-09T08:17:22.997761+0000","last_undegraded":"2023-10-09T08:17:22.997761+0000","last_fullsized":"2023-10-09T08:17:22.997761+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:35:04.782620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.996822+0000","last_change":"2023-10-09T08:17:21.974199+0000","last_active":"2023-10-09T08:17:22.996822+0000","last_peered":"2023-10-09T08:17:22.996822+0000","last_clean":"2023-10-09T08:17:22.996822+0000","last_became_active":"2023-10-09T08:17:21.973943+0000","last_became_peered":"2023-10-09T08:17:21.973943+0000","last_unstale":"2023-10-09T08:17:22.996822+0000","last_undegraded":"2023-10-09T08:17:22.996822+0000","last_fullsized":"2023-10-09T08:17:22.996822+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:56.455448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"209'1","reported_seq":11,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997076+0000","last_change":"2023-10-09T08:17:21.975063+0000","last_active":"2023-10-09T08:17:22.997076+0000","last_peered":"2023-10-09T08:17:22.997076+0000","last_clean":"2023-10-09T08:17:22.997076+0000","last_became_active":"2023-10-09T08:17:21.974796+0000","last_became_peered":"2023-10-09T08:17:21.974796+0000","last_unstale":"2023-10-09T08:17:22.997076+0000","last_undegraded":"2023-10-09T08:17:22.997076+0000","last_fullsized":"2023-10-09T08:17:22.997076+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:23.082491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.964704+0000","last_change":"2023-10-09T08:17:21.972751+0000","last_active":"2023-10-09T08:17:22.964704+0000","last_peered":"2023-10-09T08:17:22.964704+0000","last_clean":"2023-10-09T08:17:22.964704+0000","last_became_active":"2023-10-09T08:17:21.972437+0000","last_became_peered":"2023-10-09T08:17:21.972437+0000","last_unstale":"2023-10-09T08:17:22.964704+0000","last_undegraded":"2023-10-09T08:17:22.964704+0000","last_fullsized":"2023-10-09T08:17:22.964704+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:38:55.081479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.980862+0000","last_change":"2023-10-09T08:17:22.977458+0000","last_active":"2023-10-09T08:17:22.980862+0000","last_peered":"2023-10-09T08:17:22.980862+0000","last_clean":"2023-10-09T08:17:22.980862+0000","last_became_active":"2023-10-09T08:17:22.976833+0000","last_became_peered":"2023-10-09T08:17:22.976833+0000","last_unstale":"2023-10-09T08:17:22.980862+0000","last_undegraded":"2023-10-09T08:17:22.980862+0000","last_fullsized":"2023-10-09T08:17:22.980862+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:52.374897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.993473+0000","last_change":"2023-10-09T08:17:21.981403+0000","last_active":"2023-10-09T08:17:22.993473+0000","last_peered":"2023-10-09T08:17:22.993473+0000","last_clean":"2023-10-09T08:17:22.993473+0000","last_became_active":"2023-10-09T08:17:21.981161+0000","last_became_peered":"2023-10-09T08:17:21.981161+0000","last_unstale":"2023-10-09T08:17:22.993473+0000","last_undegraded":"2023-10-09T08:17:22.993473+0000","last_fullsized":"2023-10-09T08:17:22.993473+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:27.699996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.974523+0000","last_change":"2023-10-09T08:17:22.971091+0000","last_active":"2023-10-09T08:17:22.974523+0000","last_peered":"2023-10-09T08:17:22.974523+0000","last_clean":"2023-10-09T08:17:22.974523+0000","last_became_active":"2023-10-09T08:17:22.970841+0000","last_became_peered":"2023-10-09T08:17:22.970841+0000","last_unstale":"2023-10-09T08:17:22.974523+0000","last_undegraded":"2023-10-09T08:17:22.974523+0000","last_fullsized":"2023-10-09T08:17:22.974523+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:03:06.011485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.964325+0000","last_change":"2023-10-09T08:17:21.975152+0000","last_active":"2023-10-09T08:17:22.964325+0000","last_peered":"2023-10-09T08:17:22.964325+0000","last_clean":"2023-10-09T08:17:22.964325+0000","last_became_active":"2023-10-09T08:17:21.974892+0000","last_became_peered":"2023-10-09T08:17:21.974892+0000","last_unstale":"2023-10-09T08:17:22.964325+0000","last_undegraded":"2023-10-09T08:17:22.964325+0000","last_fullsized":"2023-10-09T08:17:22.964325+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:27.291932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.965212+0000","last_change":"2023-10-09T08:17:21.980816+0000","last_active":"2023-10-09T08:17:22.965212+0000","last_peered":"2023-10-09T08:17:22.965212+0000","last_clean":"2023-10-09T08:17:22.965212+0000","last_became_active":"2023-10-09T08:17:21.980578+0000","last_became_peered":"2023-10-09T08:17:21.980578+0000","last_unstale":"2023-10-09T08:17:22.965212+0000","last_undegraded":"2023-10-09T08:17:22.965212+0000","last_fullsized":"2023-10-09T08:17:22.965212+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:47.769934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.992100+0000","last_change":"2023-10-09T08:17:22.987538+0000","last_active":"2023-10-09T08:17:22.992100+0000","last_peered":"2023-10-09T08:17:22.992100+0000","last_clean":"2023-10-09T08:17:22.992100+0000","last_became_active":"2023-10-09T08:17:22.987276+0000","last_became_peered":"2023-10-09T08:17:22.987276+0000","last_unstale":"2023-10-09T08:17:22.992100+0000","last_undegraded":"2023-10-09T08:17:22.992100+0000","last_fullsized":"2023-10-09T08:17:22.992100+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:11.081055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:17:20.944684+0000","last_change":"2023-10-09T08:17:20.957350+0000","last_active":"2023-10-09T08:17:20.944684+0000","last_peered":"2023-10-09T08:17:20.944684+0000","last_clean":"2023-10-09T08:17:20.944684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:20.944684+0000","last_undegraded":"2023-10-09T08:17:20.944684+0000","last_fullsized":"2023-10-09T08:17:20.944684+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:48.265038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.979856+0000","last_change":"2023-10-09T08:17:22.976521+0000","last_active":"2023-10-09T08:17:22.979856+0000","last_peered":"2023-10-09T08:17:22.979856+0000","last_clean":"2023-10-09T08:17:22.979856+0000","last_became_active":"2023-10-09T08:17:22.976267+0000","last_became_peered":"2023-10-09T08:17:22.976267+0000","last_unstale":"2023-10-09T08:17:22.979856+0000","last_undegraded":"2023-10-09T08:17:22.979856+0000","last_fullsized":"2023-10-09T08:17:22.979856+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:51.085786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.995515+0000","last_change":"2023-10-09T08:17:21.978738+0000","last_active":"2023-10-09T08:17:22.995515+0000","last_peered":"2023-10-09T08:17:22.995515+0000","last_clean":"2023-10-09T08:17:22.995515+0000","last_became_active":"2023-10-09T08:17:21.978434+0000","last_became_peered":"2023-10-09T08:17:21.978434+0000","last_unstale":"2023-10-09T08:17:22.995515+0000","last_undegraded":"2023-10-09T08:17:22.995515+0000","last_fullsized":"2023-10-09T08:17:22.995515+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:18:28.973275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.985726+0000","last_change":"2023-10-09T08:17:22.981798+0000","last_active":"2023-10-09T08:17:22.985726+0000","last_peered":"2023-10-09T08:17:22.985726+0000","last_clean":"2023-10-09T08:17:22.985726+0000","last_became_active":"2023-10-09T08:17:22.981558+0000","last_became_peered":"2023-10-09T08:17:22.981558+0000","last_unstale":"2023-10-09T08:17:22.985726+0000","last_undegraded":"2023-10-09T08:17:22.985726+0000","last_fullsized":"2023-10-09T08:17:22.985726+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:56:15.613249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.969647+0000","last_change":"2023-10-09T08:17:21.970119+0000","last_active":"2023-10-09T08:17:22.969647+0000","last_peered":"2023-10-09T08:17:22.969647+0000","last_clean":"2023-10-09T08:17:22.969647+0000","last_became_active":"2023-10-09T08:17:21.969872+0000","last_became_peered":"2023-10-09T08:17:21.969872+0000","last_unstale":"2023-10-09T08:17:22.969647+0000","last_undegraded":"2023-10-09T08:17:22.969647+0000","last_fullsized":"2023-10-09T08:17:22.969647+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:50.234694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983970+0000","last_change":"2023-10-09T08:17:22.974514+0000","last_active":"2023-10-09T08:17:22.983970+0000","last_peered":"2023-10-09T08:17:22.983970+0000","last_clean":"2023-10-09T08:17:22.983970+0000","last_became_active":"2023-10-09T08:17:22.974268+0000","last_became_peered":"2023-10-09T08:17:22.974268+0000","last_unstale":"2023-10-09T08:17:22.983970+0000","last_undegraded":"2023-10-09T08:17:22.983970+0000","last_fullsized":"2023-10-09T08:17:22.983970+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:04.267087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.969883+0000","last_change":"2023-10-09T08:17:21.969312+0000","last_active":"2023-10-09T08:17:22.969883+0000","last_peered":"2023-10-09T08:17:22.969883+0000","last_clean":"2023-10-09T08:17:22.969883+0000","last_became_active":"2023-10-09T08:17:21.969051+0000","last_became_peered":"2023-10-09T08:17:21.969051+0000","last_unstale":"2023-10-09T08:17:22.969883+0000","last_undegraded":"2023-10-09T08:17:22.969883+0000","last_fullsized":"2023-10-09T08:17:22.969883+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:22.558736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.984369+0000","last_change":"2023-10-09T08:17:22.982056+0000","last_active":"2023-10-09T08:17:22.984369+0000","last_peered":"2023-10-09T08:17:22.984369+0000","last_clean":"2023-10-09T08:17:22.984369+0000","last_became_active":"2023-10-09T08:17:22.981764+0000","last_became_peered":"2023-10-09T08:17:22.981764+0000","last_unstale":"2023-10-09T08:17:22.984369+0000","last_undegraded":"2023-10-09T08:17:22.984369+0000","last_fullsized":"2023-10-09T08:17:22.984369+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:47.563936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.961506+0000","last_change":"2023-10-09T08:17:21.973015+0000","last_active":"2023-10-09T08:17:22.961506+0000","last_peered":"2023-10-09T08:17:22.961506+0000","last_clean":"2023-10-09T08:17:22.961506+0000","last_became_active":"2023-10-09T08:17:21.972770+0000","last_became_peered":"2023-10-09T08:17:21.972770+0000","last_unstale":"2023-10-09T08:17:22.961506+0000","last_undegraded":"2023-10-09T08:17:22.961506+0000","last_fullsized":"2023-10-09T08:17:22.961506+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:20.745815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982691+0000","last_change":"2023-10-09T08:17:22.977908+0000","last_active":"2023-10-09T08:17:22.982691+0000","last_peered":"2023-10-09T08:17:22.982691+0000","last_clean":"2023-10-09T08:17:22.982691+0000","last_became_active":"2023-10-09T08:17:22.977612+0000","last_became_peered":"2023-10-09T08:17:22.977612+0000","last_unstale":"2023-10-09T08:17:22.982691+0000","last_undegraded":"2023-10-09T08:17:22.982691+0000","last_fullsized":"2023-10-09T08:17:22.982691+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:23.588826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:17:20.944684+0000","last_change":"2023-10-09T08:17:20.957339+0000","last_active":"2023-10-09T08:17:20.944684+0000","last_peered":"2023-10-09T08:17:20.944684+0000","last_clean":"2023-10-09T08:17:20.944684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:20.944684+0000","last_undegraded":"2023-10-09T08:17:20.944684+0000","last_fullsized":"2023-10-09T08:17:20.944684+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:03.136819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982978+0000","last_change":"2023-10-09T08:17:22.978269+0000","last_active":"2023-10-09T08:17:22.982978+0000","last_peered":"2023-10-09T08:17:22.982978+0000","last_clean":"2023-10-09T08:17:22.982978+0000","last_became_active":"2023-10-09T08:17:22.977903+0000","last_became_peered":"2023-10-09T08:17:22.977903+0000","last_unstale":"2023-10-09T08:17:22.982978+0000","last_undegraded":"2023-10-09T08:17:22.982978+0000","last_fullsized":"2023-10-09T08:17:22.982978+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:44.655055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:17:20.944684+0000","last_change":"2023-10-09T08:17:20.957386+0000","last_active":"2023-10-09T08:17:20.944684+0000","last_peered":"2023-10-09T08:17:20.944684+0000","last_clean":"2023-10-09T08:17:20.944684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:20.944684+0000","last_undegraded":"2023-10-09T08:17:20.944684+0000","last_fullsized":"2023-10-09T08:17:20.944684+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:45.154798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:17:20.944684+0000","last_change":"2023-10-09T08:17:20.958011+0000","last_active":"2023-10-09T08:17:20.944684+0000","last_peered":"2023-10-09T08:17:20.944684+0000","last_clean":"2023-10-09T08:17:20.944684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:20.944684+0000","last_undegraded":"2023-10-09T08:17:20.944684+0000","last_fullsized":"2023-10-09T08:17:20.944684+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:39:59.452415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.979826+0000","last_change":"2023-10-09T08:17:22.975859+0000","last_active":"2023-10-09T08:17:22.979826+0000","last_peered":"2023-10-09T08:17:22.979826+0000","last_clean":"2023-10-09T08:17:22.979826+0000","last_became_active":"2023-10-09T08:17:22.975613+0000","last_became_peered":"2023-10-09T08:17:22.975613+0000","last_unstale":"2023-10-09T08:17:22.979826+0000","last_undegraded":"2023-10-09T08:17:22.979826+0000","last_fullsized":"2023-10-09T08:17:22.979826+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:58.570422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.965128+0000","last_change":"2023-10-09T08:17:21.980259+0000","last_active":"2023-10-09T08:17:22.965128+0000","last_peered":"2023-10-09T08:17:22.965128+0000","last_clean":"2023-10-09T08:17:22.965128+0000","last_became_active":"2023-10-09T08:17:21.980015+0000","last_became_peered":"2023-10-09T08:17:21.980015+0000","last_unstale":"2023-10-09T08:17:22.965128+0000","last_undegraded":"2023-10-09T08:17:22.965128+0000","last_fullsized":"2023-10-09T08:17:22.965128+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:23:19.929532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.988548+0000","last_change":"2023-10-09T08:17:22.983916+0000","last_active":"2023-10-09T08:17:22.988548+0000","last_peered":"2023-10-09T08:17:22.988548+0000","last_clean":"2023-10-09T08:17:22.988548+0000","last_became_active":"2023-10-09T08:17:22.983658+0000","last_became_peered":"2023-10-09T08:17:22.983658+0000","last_unstale":"2023-10-09T08:17:22.988548+0000","last_undegraded":"2023-10-09T08:17:22.988548+0000","last_fullsized":"2023-10-09T08:17:22.988548+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:28.109789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.969899+0000","last_change":"2023-10-09T08:17:21.976803+0000","last_active":"2023-10-09T08:17:22.969899+0000","last_peered":"2023-10-09T08:17:22.969899+0000","last_clean":"2023-10-09T08:17:22.969899+0000","last_became_active":"2023-10-09T08:17:21.976538+0000","last_became_peered":"2023-10-09T08:17:21.976538+0000","last_unstale":"2023-10-09T08:17:22.969899+0000","last_undegraded":"2023-10-09T08:17:22.969899+0000","last_fullsized":"2023-10-09T08:17:22.969899+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:03.261223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"199'348","reported_seq":1143,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.971832+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T08:17:22.971832+0000","last_peered":"2023-10-09T08:17:22.971832+0000","last_clean":"2023-10-09T08:17:22.971832+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T08:17:22.971832+0000","last_undegraded":"2023-10-09T08:17:22.971832+0000","last_fullsized":"2023-10-09T08:17:22.971832+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":94,"acting":94,"num_store_stats":6},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575974,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312732,"kb_used_data":3156,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059108,"statfs":{"total":96636764160,"available":96316526592,"internally_reserved":0,"allocated":3231744,"data_stored":1918128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.57999999999999996,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":0.98599999999999999,"5min":0.98699999999999999,"15min":1.1220000000000001},"last":0.752},{"interface":"front","average":{"1min":0.751,"5min":0.73999999999999999,"15min":0.749},"min":{"1min":0.64200000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86299999999999999,"5min":1.0069999999999999,"15min":1.0209999999999999},"last":0.68000000000000005}]},{"osd":1,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.65400000000000003,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":0.92900000000000005,"5min":1.28,"15min":1.28},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.74099999999999999,"15min":0.75},"min":{"1min":0.55900000000000005,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89100000000000001,"5min":1.298,"15min":1.298},"last":0.70599999999999996}]},{"osd":2,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.747,"15min":0.753},"min":{"1min":0.57699999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94899999999999995,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76500000000000001,"15min":0.77000000000000002},"min":{"1min":0.64500000000000002,"5min":0.49299999999999999,"15min":0.442},"max":{"1min":0.879,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.73499999999999999}]},{"osd":3,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.73899999999999999,"15min":0.73999999999999999},"min":{"1min":0.56100000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92600000000000005,"5min":1.399,"15min":1.399},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78100000000000003,"15min":0.77700000000000002},"min":{"1min":0.61499999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95599999999999996,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.62,"15min":0.60599999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38300000000000001},"max":{"1min":0.83299999999999996,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63900000000000001,"15min":0.628},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.38600000000000001},"max":{"1min":0.78500000000000003,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.498}]},{"osd":5,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65100000000000002,"15min":0.64600000000000002},"min":{"1min":0.46899999999999997,"5min":0.39400000000000002,"15min":0.376},"max":{"1min":0.81899999999999995,"5min":1.413,"15min":1.413},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.51400000000000001,"5min":0.41699999999999998,"15min":0.40100000000000002},"max":{"1min":0.90300000000000002,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.58199999999999996}]},{"osd":6,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74399999999999999,"15min":0.73799999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.48199999999999998},"max":{"1min":0.89400000000000002,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.70999999999999996,"15min":0.70499999999999996},"min":{"1min":0.499,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":0.85099999999999998,"5min":1.595,"15min":1.595},"last":0.59999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316192,"kb_used_data":2520,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055648,"statfs":{"total":96636764160,"available":96312983552,"internally_reserved":0,"allocated":2580480,"data_stored":1300457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76600000000000001,"15min":0.746},"min":{"1min":0.51300000000000001,"5min":0.46899999999999997,"15min":0.40300000000000002},"max":{"1min":0.92600000000000005,"5min":0.99299999999999999,"15min":1.0189999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.73799999999999999,"15min":0.73099999999999998},"min":{"1min":0.67300000000000004,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94099999999999995,"5min":0.96299999999999997,"15min":0.97399999999999998},"last":0.59299999999999997}]},{"osd":1,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.748,"15min":0.751},"min":{"1min":0.50900000000000001,"5min":0.45300000000000001,"15min":0.38500000000000001},"max":{"1min":0.90900000000000003,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78200000000000003,"15min":0.76400000000000001},"min":{"1min":0.56999999999999995,"5min":0.44,"15min":0.44},"max":{"1min":0.95899999999999996,"5min":1.0269999999999999,"15min":1.097},"last":0.56299999999999994}]},{"osd":2,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77000000000000002,"15min":0.75800000000000001},"min":{"1min":0.60799999999999998,"5min":0.495,"15min":0.46400000000000002},"max":{"1min":0.92000000000000004,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.76700000000000002,"15min":0.77300000000000002},"min":{"1min":0.58499999999999996,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":0.97699999999999998,"5min":1.0429999999999999,"15min":1.0660000000000001},"last":0.63300000000000001}]},{"osd":3,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.57999999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.89700000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.79700000000000004,"15min":0.78900000000000003},"min":{"1min":0.64000000000000001,"5min":0.54100000000000004,"15min":0.49299999999999999},"max":{"1min":0.97999999999999998,"5min":1.119,"15min":1.119},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.64700000000000002,"15min":0.63800000000000001},"min":{"1min":0.45800000000000002,"5min":0.44700000000000001,"15min":0.40200000000000002},"max":{"1min":0.82499999999999996,"5min":1.0149999999999999,"15min":1.1339999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.64400000000000002,"15min":0.63700000000000001},"min":{"1min":0.47999999999999998,"5min":0.39700000000000002,"15min":0.32000000000000001},"max":{"1min":0.72299999999999998,"5min":0.91900000000000004,"15min":0.93700000000000006},"last":0.42999999999999999}]},{"osd":5,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.47599999999999998,"5min":0.42399999999999999,"15min":0.40100000000000002},"max":{"1min":0.83999999999999997,"5min":1.232,"15min":1.232},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.72499999999999998,"15min":0.70799999999999996},"min":{"1min":0.52400000000000002,"5min":0.46600000000000003,"15min":0.45200000000000001},"max":{"1min":0.872,"5min":1.0880000000000001,"15min":1.121},"last":0.69099999999999995}]},{"osd":7,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69499999999999995,"15min":0.68899999999999995},"min":{"1min":0.52200000000000002,"5min":0.45600000000000002,"15min":0.36299999999999999},"max":{"1min":0.85499999999999998,"5min":0.98699999999999999,"15min":1.0309999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.74299999999999999},"min":{"1min":0.56399999999999995,"5min":0.48699999999999999,"15min":0.442},"max":{"1min":0.89200000000000002,"5min":1.194,"15min":1.194},"last":0.66900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575974,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308060,"kb_used_data":2580,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063780,"statfs":{"total":96636764160,"available":96321310720,"internally_reserved":0,"allocated":2641920,"data_stored":1329192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45600000000000002,"15min":0.45700000000000002},"min":{"1min":0.34100000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.65000000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.40000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78300000000000003,"5min":0.95499999999999996,"15min":1.2230000000000001},"last":0.38700000000000001}]},{"osd":2,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.39200000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71599999999999997,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42699999999999999,"5min":0.40300000000000002,"15min":0.39500000000000002},"max":{"1min":0.77300000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.51000000000000001}]},{"osd":3,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63,"15min":0.627},"min":{"1min":0.49199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84199999999999997,"5min":1.0049999999999999,"15min":1.2589999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.435,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":1.1519999999999999},"last":0.33500000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78800000000000003,"15min":0.78200000000000003},"min":{"1min":0.58999999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.087,"5min":1.1759999999999999,"15min":1.224},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.80400000000000005,"15min":0.80300000000000005},"min":{"1min":0.66700000000000004,"5min":0.56499999999999995,"15min":0.51800000000000002},"max":{"1min":1.0329999999999999,"5min":1.071,"15min":1.5800000000000001},"last":0.85299999999999998}]},{"osd":5,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.81699999999999995,"15min":0.81399999999999995},"min":{"1min":0.61599999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.77},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.81799999999999995,"15min":0.80700000000000005},"min":{"1min":0.67500000000000004,"5min":0.56100000000000005,"15min":0.49299999999999999},"max":{"1min":1.177,"5min":1.262,"15min":1.288},"last":1.0369999999999999}]},{"osd":6,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.82699999999999996,"15min":0.81999999999999995},"min":{"1min":0.63900000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.071,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.84999999999999998,"15min":0.83799999999999997},"min":{"1min":0.77300000000000002,"5min":0.59999999999999998,"15min":0.56699999999999995},"max":{"1min":1.135,"5min":1.3819999999999999,"15min":1.843},"last":1.004}]},{"osd":7,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.872,"15min":0.86299999999999999},"min":{"1min":0.751,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.103,"5min":1.1739999999999999,"15min":1.9139999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.86299999999999999,"15min":0.85299999999999998},"min":{"1min":0.70699999999999996,"5min":0.61799999999999999,"15min":0.54300000000000004},"max":{"1min":1.1339999999999999,"5min":1.2270000000000001,"15min":1.347},"last":0.97499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575973,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308632,"kb_used_data":3152,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063208,"statfs":{"total":96636764160,"available":96320724992,"internally_reserved":0,"allocated":3227648,"data_stored":1918046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47199999999999998,"15min":0.48499999999999999},"min":{"1min":0.35399999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.78700000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52600000000000002,"15min":0.54200000000000004},"min":{"1min":0.375,"5min":0.251,"15min":0.251},"max":{"1min":0.65600000000000003,"5min":0.82199999999999995,"15min":0.83599999999999997},"last":0.52400000000000002}]},{"osd":2,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.47899999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69399999999999995,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.5,"15min":0.51100000000000001},"min":{"1min":0.41899999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67100000000000004,"5min":0.77300000000000002,"15min":0.81999999999999995},"last":0.46999999999999997}]},{"osd":3,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52000000000000002,"15min":0.53500000000000003},"min":{"1min":0.38700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.628,"5min":0.78200000000000003,"15min":0.80500000000000005},"last":0.501},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60399999999999998,"15min":0.61899999999999999},"min":{"1min":0.47299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82899999999999996,"5min":0.92100000000000004,"15min":0.93200000000000005},"last":0.61699999999999999}]},{"osd":4,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.60799999999999998,"5min":0.46600000000000003,"15min":0.42899999999999999},"max":{"1min":1.0589999999999999,"5min":1.1759999999999999,"15min":1.226},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.66500000000000004,"5min":0.53100000000000003,"15min":0.53000000000000003},"max":{"1min":1.139,"5min":1.216,"15min":1.23},"last":0.88200000000000001}]},{"osd":5,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.79800000000000004,"15min":0.81200000000000006},"min":{"1min":0.59399999999999997,"5min":0.51500000000000001,"15min":0.501},"max":{"1min":1.1799999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.80800000000000005,"15min":0.81799999999999995},"min":{"1min":0.65300000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.02,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.92500000000000004}]},{"osd":6,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.78200000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.141,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.82199999999999995},"min":{"1min":0.624,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.24},"last":0.80200000000000005}]},{"osd":7,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.84599999999999997,"15min":0.85999999999999999},"min":{"1min":0.68100000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2929999999999999},"last":1.163},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.85499999999999998,"15min":0.874},"min":{"1min":0.69499999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.054,"5min":1.2,"15min":1.2110000000000001},"last":1.0880000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575973,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316252,"kb_used_data":2580,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055588,"statfs":{"total":96636764160,"available":96312922112,"internally_reserved":0,"allocated":2641920,"data_stored":1328322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47999999999999998,"15min":0.46800000000000003},"min":{"1min":0.33500000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67900000000000005,"5min":0.69199999999999995,"15min":0.752},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.378,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64100000000000001,"5min":0.73299999999999998,"15min":0.82299999999999995},"last":0.51100000000000001}]},{"osd":1,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.496,"15min":0.495},"min":{"1min":0.35999999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71599999999999997,"5min":1.03,"15min":1.03},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.34699999999999998},"max":{"1min":0.68600000000000005,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.54300000000000004}]},{"osd":3,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60799999999999998,"15min":0.61099999999999999},"min":{"1min":0.47599999999999998,"5min":0.40799999999999997,"15min":0.39200000000000002},"max":{"1min":0.79200000000000004,"5min":0.89000000000000001,"15min":0.96999999999999997},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.53300000000000003,"5min":0.46600000000000003,"15min":0.43099999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61099999999999999}]},{"osd":4,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.68100000000000005,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.80900000000000005,"15min":0.79900000000000004},"min":{"1min":0.63800000000000001,"5min":0.54200000000000004,"15min":0.48399999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":1.0569999999999999}]},{"osd":5,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81000000000000005,"15min":0.80900000000000005},"min":{"1min":0.60799999999999998,"5min":0.54500000000000004,"15min":0.51800000000000002},"max":{"1min":0.96499999999999997,"5min":1.181,"15min":1.181},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.47799999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.83899999999999997}]},{"osd":6,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83899999999999997,"15min":0.82699999999999996},"min":{"1min":0.68700000000000006,"5min":0.56299999999999994,"15min":0.52700000000000002},"max":{"1min":1.1499999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83099999999999996,"15min":0.83499999999999996},"min":{"1min":0.66900000000000004,"5min":0.59399999999999997,"15min":0.57099999999999995},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.224},"last":0.89500000000000002}]},{"osd":7,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.64600000000000002,"5min":0.60199999999999998,"15min":0.47899999999999998},"max":{"1min":1.054,"5min":1.448,"15min":1.448},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.67400000000000004,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.075,"5min":1.518,"15min":1.518},"last":1.042}]}]},{"osd":3,"up_from":13,"seq":55834575974,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312156,"kb_used_data":2580,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059684,"statfs":{"total":96636764160,"available":96317116416,"internally_reserved":0,"allocated":2641920,"data_stored":1327850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47799999999999998,"15min":0.48799999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59199999999999997,"5min":0.78600000000000003,"15min":0.85999999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.503,"15min":0.505},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.63100000000000001,"5min":0.73499999999999999,"15min":0.74299999999999999},"last":0.46100000000000002}]},{"osd":1,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.5,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66900000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78400000000000003,"5min":0.84999999999999998,"15min":0.91300000000000003},"last":0.41499999999999998}]},{"osd":2,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70099999999999996,"5min":0.85699999999999998,"15min":0.97299999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.65000000000000002,"15min":0.65700000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80700000000000005,"5min":0.90200000000000002,"15min":1.036},"last":0.49299999999999999}]},{"osd":4,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52100000000000002,"5min":0.49099999999999999,"15min":0.46000000000000002},"max":{"1min":1.0149999999999999,"5min":1.175,"15min":1.175},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.85899999999999999,"15min":0.86699999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.97699999999999998,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.72699999999999998}]},{"osd":5,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.47399999999999998},"max":{"1min":1.026,"5min":1.1419999999999999,"15min":1.2170000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.83099999999999996,"15min":0.83399999999999996},"min":{"1min":0.64200000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.96599999999999997,"5min":1.1719999999999999,"15min":1.1739999999999999},"last":0.80100000000000005}]},{"osd":6,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97799999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.81200000000000006,"15min":0.81299999999999994},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.54800000000000004},"max":{"1min":1.0620000000000001,"5min":1.1339999999999999,"15min":1.149},"last":0.74399999999999999}]},{"osd":7,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.84799999999999998,"15min":0.85399999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.96199999999999997,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.85999999999999999,"15min":0.85299999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0900000000000001,"5min":1.155,"15min":1.1639999999999999},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575973,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299872,"kb_used_data":2584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071968,"statfs":{"total":96636764160,"available":96329695232,"internally_reserved":0,"allocated":2646016,"data_stored":1329746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71699999999999997,"15min":0.72399999999999998},"min":{"1min":0.498,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89900000000000002,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72399999999999998,"15min":0.73599999999999999},"min":{"1min":0.53800000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.94299999999999995,"5min":0.995,"15min":0.995},"last":0.52800000000000002}]},{"osd":1,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.70699999999999996,"15min":0.71799999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92700000000000005,"5min":0.98399999999999999,"15min":1.03},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72599999999999998,"15min":0.73899999999999999},"min":{"1min":0.52400000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92600000000000005,"5min":0.97299999999999998,"15min":1.0009999999999999},"last":0.60999999999999999}]},{"osd":2,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78700000000000003,"15min":0.79200000000000004},"min":{"1min":0.65300000000000002,"5min":0.51200000000000001,"15min":0.45000000000000001},"max":{"1min":0.93100000000000005,"5min":1.0149999999999999,"15min":1.0569999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.79100000000000004,"15min":0.80200000000000005},"min":{"1min":0.63400000000000001,"5min":0.51000000000000001,"15min":0.47999999999999998},"max":{"1min":0.96499999999999997,"5min":1.077,"15min":1.077},"last":0.72899999999999998}]},{"osd":3,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73199999999999998,"15min":0.74099999999999999},"min":{"1min":0.56299999999999994,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84999999999999998,"5min":0.96999999999999997,"15min":1.016},"last":0.627},{"interface":"front","average":{"1min":0.75,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.53200000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.89600000000000002,"5min":1.036,"15min":1.036},"last":0.76400000000000001}]},{"osd":5,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.434,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.749,"5min":0.94899999999999995,"15min":1.006},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.40100000000000002},"max":{"1min":0.85099999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.70899999999999996}]},{"osd":6,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.63400000000000001},"min":{"1min":0.495,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91100000000000003,"5min":1.022,"15min":1.034},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.68300000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83999999999999997,"5min":0.998,"15min":1.0609999999999999},"last":0.55500000000000005}]},{"osd":7,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.51400000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91900000000000004,"5min":1.036,"15min":1.036},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76000000000000001,"15min":0.77600000000000002},"min":{"1min":0.498,"5min":0.48499999999999999,"15min":0.443},"max":{"1min":0.89600000000000002,"5min":1.0609999999999999,"15min":1.079},"last":0.59699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575973,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316204,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055636,"statfs":{"total":96636764160,"available":96312971264,"internally_reserved":0,"allocated":2592768,"data_stored":1306782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.55900000000000005,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92600000000000005,"5min":1.03,"15min":1.0780000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71199999999999997,"15min":0.71499999999999997},"min":{"1min":0.53900000000000003,"5min":0.42999999999999999,"15min":0.40899999999999997},"max":{"1min":0.89000000000000001,"5min":0.97399999999999998,"15min":1.018},"last":0.79200000000000004}]},{"osd":1,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.70399999999999996,"15min":0.71699999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82499999999999996,"5min":1.0129999999999999,"15min":1.1140000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76100000000000001,"15min":0.748},"min":{"1min":0.61699999999999999,"5min":0.498,"15min":0.435},"max":{"1min":0.97999999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.69199999999999995}]},{"osd":2,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74199999999999999,"15min":0.746},"min":{"1min":0.52300000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90200000000000002,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.745,"15min":0.74399999999999999},"min":{"1min":0.55500000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.95899999999999996,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.81499999999999995}]},{"osd":3,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.56799999999999995,"5min":0.50900000000000001,"15min":0.48299999999999998},"max":{"1min":0.83999999999999997,"5min":0.95999999999999996,"15min":1.0409999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.51500000000000001},"max":{"1min":1.0049999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.871}]},{"osd":4,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.627,"15min":0.61099999999999999},"min":{"1min":0.45300000000000001,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.89000000000000001,"5min":1.093,"15min":1.093},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.624,"15min":0.60799999999999998},"min":{"1min":0.42999999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83899999999999997,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.85099999999999998}]},{"osd":6,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63900000000000001,"15min":0.622},"min":{"1min":0.46100000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82499999999999996,"5min":1,"15min":1},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.69999999999999996,"15min":0.67600000000000005},"min":{"1min":0.47699999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91700000000000004,"5min":1.123,"15min":1.123},"last":0.88600000000000001}]},{"osd":7,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.70599999999999996,"15min":0.68500000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.44400000000000001},"max":{"1min":0.94299999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78300000000000003,"15min":0.76500000000000001},"min":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.48599999999999999},"max":{"1min":0.91300000000000003,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.93100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T08:17:27.313 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T08:17:27.402 INFO:tasks.ceph.mds.c.smithi071.stderr:2023-10-09T08:17:27.402+0000 7f92423f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T08:17:27.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.526+0000 7f43c219d700 1 Processor -- start 2023-10-09T08:17:27.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.526+0000 7f43c219d700 1 -- start start 2023-10-09T08:17:27.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.528+0000 7f43c219d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f43bc150550 0x7f43bc157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:27.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.528+0000 7f43c219d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43bc0c7410 0x7f43bc069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:27.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.528+0000 7f43c219d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43bc06e2a0 con 0x7f43bc150180 2023-10-09T08:17:27.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.528+0000 7f43c219d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43bc06b2e0 con 0x7f43bc150550 2023-10-09T08:17:27.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.528+0000 7f43c219d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc0c78e0 con 0x7f43bc0c7410 2023-10-09T08:17:27.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.528+0000 7f43c099a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f43bc150550 0x7f43bc157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:27.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.528+0000 7f43c099a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f43bc150550 0x7f43bc157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48216/0 (socket says 172.21.15.71:48216) 2023-10-09T08:17:27.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.528+0000 7f43c099a700 1 -- 172.21.15.71:0/3797071419 learned_addr learned my addr 172.21.15.71:0/3797071419 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:27.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.528+0000 7f43c199c700 1 --2- 172.21.15.71:0/3797071419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43bc0c7410 0x7f43bc069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:27.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.528+0000 7f43c099a700 1 -- 172.21.15.71:0/3797071419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43bc0c7410 msgr2=0x7f43bc069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:27.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.528+0000 7f43c099a700 1 --2- 172.21.15.71:0/3797071419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43bc0c7410 0x7f43bc069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.528+0000 7f43c099a700 1 -- 172.21.15.71:0/3797071419 >> v1:172.21.15.179:6789/0 conn(0x7f43bc150180 legacy=0x7f43bc0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:27.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.528+0000 7f43c099a700 1 -- 172.21.15.71:0/3797071419 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc0c7bc0 con 0x7f43bc150550 2023-10-09T08:17:27.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.529+0000 7f43c099a700 1 --2- 172.21.15.71:0/3797071419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43bc150550 0x7f43bc157770 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00bc40 tx=0x7f43ac00b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74fb3bdce043251f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:27.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.529+0000 7f43b3fff700 1 -- 172.21.15.71:0/3797071419 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac00db40 con 0x7f43bc150550 2023-10-09T08:17:27.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.529+0000 7f43b3fff700 1 -- 172.21.15.71:0/3797071419 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac00dca0 con 0x7f43bc150550 2023-10-09T08:17:27.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.529+0000 7f43b3fff700 1 -- 172.21.15.71:0/3797071419 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac017640 con 0x7f43bc150550 2023-10-09T08:17:27.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.529+0000 7f43c219d700 1 -- 172.21.15.71:0/3797071419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43bc150550 msgr2=0x7f43bc157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:27.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.529+0000 7f43c219d700 1 --2- 172.21.15.71:0/3797071419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43bc150550 0x7f43bc157770 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00bc40 tx=0x7f43ac00b4e0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.530+0000 7f43c219d700 1 -- 172.21.15.71:0/3797071419 shutdown_connections 2023-10-09T08:17:27.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.530+0000 7f43c219d700 1 --2- 172.21.15.71:0/3797071419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43bc0c7410 0x7f43bc069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.530+0000 7f43c219d700 1 --2- 172.21.15.71:0/3797071419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43bc150550 0x7f43bc157770 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.530+0000 7f43c219d700 1 -- 172.21.15.71:0/3797071419 >> 172.21.15.71:0/3797071419 conn(0x7f43bc0cc1f0 msgr2=0x7f43bc0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:27.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.530+0000 7f43c219d700 1 -- 172.21.15.71:0/3797071419 shutdown_connections 2023-10-09T08:17:27.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.530+0000 7f43c219d700 1 -- 172.21.15.71:0/3797071419 wait complete. 2023-10-09T08:17:27.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.531+0000 7f43c219d700 1 Processor -- start 2023-10-09T08:17:27.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.531+0000 7f43c219d700 1 -- start start 2023-10-09T08:17:27.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.532+0000 7f43c219d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43bc0c7410 0x7f43bc0aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:27.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.532+0000 7f43c219d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43bc150180 0x7f43bc0c2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:27.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.532+0000 7f43c219d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43bc150550 0x7f43bc0c2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:27.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.532+0000 7f43c219d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc16d940 con 0x7f43bc150180 2023-10-09T08:17:27.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.532+0000 7f43c219d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc0afa50 con 0x7f43bc0c7410 2023-10-09T08:17:27.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.532+0000 7f43c219d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc16d2f0 con 0x7f43bc150550 2023-10-09T08:17:27.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.532+0000 7f43c099a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43bc150180 0x7f43bc0c2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:27.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.532+0000 7f43c099a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43bc150180 0x7f43bc0c2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48220/0 (socket says 172.21.15.71:48220) 2023-10-09T08:17:27.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.532+0000 7f43c099a700 1 -- 172.21.15.71:0/1994208567 learned_addr learned my addr 172.21.15.71:0/1994208567 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:27.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.533+0000 7f43c119b700 1 --2- 172.21.15.71:0/1994208567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43bc0c7410 0x7f43bc0aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:27.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.533+0000 7f43c099a700 1 -- 172.21.15.71:0/1994208567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43bc150550 msgr2=0x7f43bc0c2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:27.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.533+0000 7f43c199c700 1 --2- 172.21.15.71:0/1994208567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43bc150550 0x7f43bc0c2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:27.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.533+0000 7f43c099a700 1 --2- 172.21.15.71:0/1994208567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43bc150550 0x7f43bc0c2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.533+0000 7f43c099a700 1 -- 172.21.15.71:0/1994208567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43bc0c7410 msgr2=0x7f43bc0aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:27.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.533+0000 7f43c099a700 1 --2- 172.21.15.71:0/1994208567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43bc0c7410 0x7f43bc0aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.533+0000 7f43c099a700 1 -- 172.21.15.71:0/1994208567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac00b780 con 0x7f43bc150180 2023-10-09T08:17:27.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.533+0000 7f43c119b700 1 --2- 172.21.15.71:0/1994208567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43bc0c7410 0x7f43bc0aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:27.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.533+0000 7f43c199c700 1 --2- 172.21.15.71:0/1994208567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43bc150550 0x7f43bc0c2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:27.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.533+0000 7f43c099a700 1 --2- 172.21.15.71:0/1994208567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43bc150180 0x7f43bc0c2620 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f43bc06fe40 tx=0x7f43ac019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:27.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.533+0000 7f43b17fa700 1 -- 172.21.15.71:0/1994208567 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac021420 con 0x7f43bc150180 2023-10-09T08:17:27.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.533+0000 7f43b17fa700 1 -- 172.21.15.71:0/1994208567 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac0215c0 con 0x7f43bc150180 2023-10-09T08:17:27.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.533+0000 7f43c219d700 1 -- 172.21.15.71:0/1994208567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43bc16d5d0 con 0x7f43bc150180 2023-10-09T08:17:27.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.533+0000 7f43b17fa700 1 -- 172.21.15.71:0/1994208567 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac021980 con 0x7f43bc150180 2023-10-09T08:17:27.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.533+0000 7f43c219d700 1 -- 172.21.15.71:0/1994208567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43bc0afd30 con 0x7f43bc150180 2023-10-09T08:17:27.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.534+0000 7f43c219d700 1 -- 172.21.15.71:0/1994208567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43bc16dab0 con 0x7f43bc150180 2023-10-09T08:17:27.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.535+0000 7f43b17fa700 1 -- 172.21.15.71:0/1994208567 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43ac015070 con 0x7f43bc150180 2023-10-09T08:17:27.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.536+0000 7f43b17fa700 1 --2- 172.21.15.71:0/1994208567 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f43a0066f30 0x7f43a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:27.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.536+0000 7f43b17fa700 1 -- 172.21.15.71:0/1994208567 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f43ac0866a0 con 0x7f43bc150180 2023-10-09T08:17:27.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.536+0000 7f43c119b700 1 --2- 172.21.15.71:0/1994208567 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f43a0066f30 0x7f43a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:27.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.537+0000 7f43c119b700 1 --2- 172.21.15.71:0/1994208567 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f43a0066f30 0x7f43a00693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f43b8001840 tx=0x7f43b8009040 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.540+0000 7f43b17fa700 1 -- 172.21.15.71:0/1994208567 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43ac053660 con 0x7f43bc150180 2023-10-09T08:17:27.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.726+0000 7f43c219d700 1 -- 172.21.15.71:0/1994208567 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f43bc04c3c0 con 0x7f43a0066f30 2023-10-09T08:17:27.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.735+0000 7f43b17fa700 1 -- 172.21.15.71:0/1994208567 <== mgr.9427 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286936 (secure 0 0 0) 0x7f43bc04c3c0 con 0x7f43a0066f30 2023-10-09T08:17:27.739 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:27.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.739+0000 7f43c219d700 1 -- 172.21.15.71:0/1994208567 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f43a0066f30 msgr2=0x7f43a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:27.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.739+0000 7f43c219d700 1 --2- 172.21.15.71:0/1994208567 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f43a0066f30 0x7f43a00693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f43b8001840 tx=0x7f43b8009040 comp rx=0 tx=0).stop 2023-10-09T08:17:27.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.739+0000 7f43c219d700 1 -- 172.21.15.71:0/1994208567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43bc150180 msgr2=0x7f43bc0c2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:27.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.739+0000 7f43c219d700 1 --2- 172.21.15.71:0/1994208567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43bc150180 0x7f43bc0c2620 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f43bc06fe40 tx=0x7f43ac019000 comp rx=0 tx=0).stop 2023-10-09T08:17:27.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.739+0000 7f43c219d700 1 -- 172.21.15.71:0/1994208567 shutdown_connections 2023-10-09T08:17:27.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.739+0000 7f43c219d700 1 --2- 172.21.15.71:0/1994208567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43bc150550 0x7f43bc0c2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.739+0000 7f43c219d700 1 --2- 172.21.15.71:0/1994208567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43bc0c7410 0x7f43bc0aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.739+0000 7f43c219d700 1 --2- 172.21.15.71:0/1994208567 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f43a0066f30 0x7f43a00693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.739+0000 7f43c219d700 1 --2- 172.21.15.71:0/1994208567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43bc150180 0x7f43bc0c2620 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.739+0000 7f43c219d700 1 -- 172.21.15.71:0/1994208567 >> 172.21.15.71:0/1994208567 conn(0x7f43bc0cc1f0 msgr2=0x7f43bc0ab090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:27.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.739+0000 7f43c219d700 1 -- 172.21.15.71:0/1994208567 shutdown_connections 2023-10-09T08:17:27.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.739+0000 7f43c219d700 1 -- 172.21.15.71:0/1994208567 wait complete. 2023-10-09T08:17:27.745 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T08:17:27.757 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T08:17:26.214307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":620,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":383,"ondisk_log_size":383,"up":160,"acting":160,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2490100,"kb_used_data":21684,"kb_used_omap":0,"kb_used_meta":2468352,"kb_avail":752484620,"statfs":{"total":773094113280,"available":770544250880,"internally_reserved":0,"allocated":22204416,"data_stored":11758523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2527592448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.262430"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.988806+0000","last_change":"2023-10-09T08:17:22.987349+0000","last_active":"2023-10-09T08:17:22.988806+0000","last_peered":"2023-10-09T08:17:22.988806+0000","last_clean":"2023-10-09T08:17:22.988806+0000","last_became_active":"2023-10-09T08:17:22.987068+0000","last_became_peered":"2023-10-09T08:17:22.987068+0000","last_unstale":"2023-10-09T08:17:22.988806+0000","last_undegraded":"2023-10-09T08:17:22.988806+0000","last_fullsized":"2023-10-09T08:17:22.988806+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:32:31.652330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983385+0000","last_change":"2023-10-09T08:17:22.980482+0000","last_active":"2023-10-09T08:17:22.983385+0000","last_peered":"2023-10-09T08:17:22.983385+0000","last_clean":"2023-10-09T08:17:22.983385+0000","last_became_active":"2023-10-09T08:17:22.980162+0000","last_became_peered":"2023-10-09T08:17:22.980162+0000","last_unstale":"2023-10-09T08:17:22.983385+0000","last_undegraded":"2023-10-09T08:17:22.983385+0000","last_fullsized":"2023-10-09T08:17:22.983385+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:08:19.846565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982856+0000","last_change":"2023-10-09T08:17:22.978532+0000","last_active":"2023-10-09T08:17:22.982856+0000","last_peered":"2023-10-09T08:17:22.982856+0000","last_clean":"2023-10-09T08:17:22.982856+0000","last_became_active":"2023-10-09T08:17:22.978261+0000","last_became_peered":"2023-10-09T08:17:22.978261+0000","last_unstale":"2023-10-09T08:17:22.982856+0000","last_undegraded":"2023-10-09T08:17:22.982856+0000","last_fullsized":"2023-10-09T08:17:22.982856+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:02.562263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.981672+0000","last_change":"2023-10-09T08:17:22.978795+0000","last_active":"2023-10-09T08:17:22.981672+0000","last_peered":"2023-10-09T08:17:22.981672+0000","last_clean":"2023-10-09T08:17:22.981672+0000","last_became_active":"2023-10-09T08:17:22.978557+0000","last_became_peered":"2023-10-09T08:17:22.978557+0000","last_unstale":"2023-10-09T08:17:22.981672+0000","last_undegraded":"2023-10-09T08:17:22.981672+0000","last_fullsized":"2023-10-09T08:17:22.981672+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:19.484500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.984320+0000","last_change":"2023-10-09T08:17:22.981507+0000","last_active":"2023-10-09T08:17:22.984320+0000","last_peered":"2023-10-09T08:17:22.984320+0000","last_clean":"2023-10-09T08:17:22.984320+0000","last_became_active":"2023-10-09T08:17:22.981260+0000","last_became_peered":"2023-10-09T08:17:22.981260+0000","last_unstale":"2023-10-09T08:17:22.984320+0000","last_undegraded":"2023-10-09T08:17:22.984320+0000","last_fullsized":"2023-10-09T08:17:22.984320+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:32.306795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.971000+0000","last_change":"2023-10-09T08:17:22.967502+0000","last_active":"2023-10-09T08:17:22.971000+0000","last_peered":"2023-10-09T08:17:22.971000+0000","last_clean":"2023-10-09T08:17:22.971000+0000","last_became_active":"2023-10-09T08:17:22.967258+0000","last_became_peered":"2023-10-09T08:17:22.967258+0000","last_unstale":"2023-10-09T08:17:22.971000+0000","last_undegraded":"2023-10-09T08:17:22.971000+0000","last_fullsized":"2023-10-09T08:17:22.971000+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:02.453697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.988639+0000","last_change":"2023-10-09T08:17:22.983416+0000","last_active":"2023-10-09T08:17:22.988639+0000","last_peered":"2023-10-09T08:17:22.988639+0000","last_clean":"2023-10-09T08:17:22.988639+0000","last_became_active":"2023-10-09T08:17:22.981717+0000","last_became_peered":"2023-10-09T08:17:22.981717+0000","last_unstale":"2023-10-09T08:17:22.988639+0000","last_undegraded":"2023-10-09T08:17:22.988639+0000","last_fullsized":"2023-10-09T08:17:22.988639+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:51.687684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.984150+0000","last_change":"2023-10-09T08:17:22.979132+0000","last_active":"2023-10-09T08:17:22.984150+0000","last_peered":"2023-10-09T08:17:22.984150+0000","last_clean":"2023-10-09T08:17:22.984150+0000","last_became_active":"2023-10-09T08:17:22.978851+0000","last_became_peered":"2023-10-09T08:17:22.978851+0000","last_unstale":"2023-10-09T08:17:22.984150+0000","last_undegraded":"2023-10-09T08:17:22.984150+0000","last_fullsized":"2023-10-09T08:17:22.984150+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:49.270902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.971747+0000","last_change":"2023-10-09T08:17:22.968330+0000","last_active":"2023-10-09T08:17:22.971747+0000","last_peered":"2023-10-09T08:17:22.971747+0000","last_clean":"2023-10-09T08:17:22.971747+0000","last_became_active":"2023-10-09T08:17:22.968098+0000","last_became_peered":"2023-10-09T08:17:22.968098+0000","last_unstale":"2023-10-09T08:17:22.971747+0000","last_undegraded":"2023-10-09T08:17:22.971747+0000","last_fullsized":"2023-10-09T08:17:22.971747+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:26.390859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.992436+0000","last_change":"2023-10-09T08:17:22.987389+0000","last_active":"2023-10-09T08:17:22.992436+0000","last_peered":"2023-10-09T08:17:22.992436+0000","last_clean":"2023-10-09T08:17:22.992436+0000","last_became_active":"2023-10-09T08:17:22.987114+0000","last_became_peered":"2023-10-09T08:17:22.987114+0000","last_unstale":"2023-10-09T08:17:22.992436+0000","last_undegraded":"2023-10-09T08:17:22.992436+0000","last_fullsized":"2023-10-09T08:17:22.992436+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:50.692531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.986775+0000","last_change":"2023-10-09T08:17:22.983507+0000","last_active":"2023-10-09T08:17:22.986775+0000","last_peered":"2023-10-09T08:17:22.986775+0000","last_clean":"2023-10-09T08:17:22.986775+0000","last_became_active":"2023-10-09T08:17:22.983220+0000","last_became_peered":"2023-10-09T08:17:22.983220+0000","last_unstale":"2023-10-09T08:17:22.986775+0000","last_undegraded":"2023-10-09T08:17:22.986775+0000","last_fullsized":"2023-10-09T08:17:22.986775+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:43:41.322751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.991789+0000","last_change":"2023-10-09T08:17:22.987121+0000","last_active":"2023-10-09T08:17:22.991789+0000","last_peered":"2023-10-09T08:17:22.991789+0000","last_clean":"2023-10-09T08:17:22.991789+0000","last_became_active":"2023-10-09T08:17:22.986832+0000","last_became_peered":"2023-10-09T08:17:22.986832+0000","last_unstale":"2023-10-09T08:17:22.991789+0000","last_undegraded":"2023-10-09T08:17:22.991789+0000","last_fullsized":"2023-10-09T08:17:22.991789+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:42:42.958751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.990448+0000","last_change":"2023-10-09T08:17:22.986695+0000","last_active":"2023-10-09T08:17:22.990448+0000","last_peered":"2023-10-09T08:17:22.990448+0000","last_clean":"2023-10-09T08:17:22.990448+0000","last_became_active":"2023-10-09T08:17:22.986436+0000","last_became_peered":"2023-10-09T08:17:22.986436+0000","last_unstale":"2023-10-09T08:17:22.990448+0000","last_undegraded":"2023-10-09T08:17:22.990448+0000","last_fullsized":"2023-10-09T08:17:22.990448+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:39:24.985715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982837+0000","last_change":"2023-10-09T08:17:22.977788+0000","last_active":"2023-10-09T08:17:22.982837+0000","last_peered":"2023-10-09T08:17:22.982837+0000","last_clean":"2023-10-09T08:17:22.982837+0000","last_became_active":"2023-10-09T08:17:22.977521+0000","last_became_peered":"2023-10-09T08:17:22.977521+0000","last_unstale":"2023-10-09T08:17:22.982837+0000","last_undegraded":"2023-10-09T08:17:22.982837+0000","last_fullsized":"2023-10-09T08:17:22.982837+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:31.629347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.980841+0000","last_change":"2023-10-09T08:17:22.977049+0000","last_active":"2023-10-09T08:17:22.980841+0000","last_peered":"2023-10-09T08:17:22.980841+0000","last_clean":"2023-10-09T08:17:22.980841+0000","last_became_active":"2023-10-09T08:17:22.976779+0000","last_became_peered":"2023-10-09T08:17:22.976779+0000","last_unstale":"2023-10-09T08:17:22.980841+0000","last_undegraded":"2023-10-09T08:17:22.980841+0000","last_fullsized":"2023-10-09T08:17:22.980841+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:41.226637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.985723+0000","last_change":"2023-10-09T08:17:22.984732+0000","last_active":"2023-10-09T08:17:22.985723+0000","last_peered":"2023-10-09T08:17:22.985723+0000","last_clean":"2023-10-09T08:17:22.985723+0000","last_became_active":"2023-10-09T08:17:22.984481+0000","last_became_peered":"2023-10-09T08:17:22.984481+0000","last_unstale":"2023-10-09T08:17:22.985723+0000","last_undegraded":"2023-10-09T08:17:22.985723+0000","last_fullsized":"2023-10-09T08:17:22.985723+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:24:10.514407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983916+0000","last_change":"2023-10-09T08:17:22.974270+0000","last_active":"2023-10-09T08:17:22.983916+0000","last_peered":"2023-10-09T08:17:22.983916+0000","last_clean":"2023-10-09T08:17:22.983916+0000","last_became_active":"2023-10-09T08:17:22.974010+0000","last_became_peered":"2023-10-09T08:17:22.974010+0000","last_unstale":"2023-10-09T08:17:22.983916+0000","last_undegraded":"2023-10-09T08:17:22.983916+0000","last_fullsized":"2023-10-09T08:17:22.983916+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:10:24.260909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.985251+0000","last_change":"2023-10-09T08:17:22.983336+0000","last_active":"2023-10-09T08:17:22.985251+0000","last_peered":"2023-10-09T08:17:22.985251+0000","last_clean":"2023-10-09T08:17:22.985251+0000","last_became_active":"2023-10-09T08:17:22.983072+0000","last_became_peered":"2023-10-09T08:17:22.983072+0000","last_unstale":"2023-10-09T08:17:22.985251+0000","last_undegraded":"2023-10-09T08:17:22.985251+0000","last_fullsized":"2023-10-09T08:17:22.985251+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:04.142683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983367+0000","last_change":"2023-10-09T08:17:22.979452+0000","last_active":"2023-10-09T08:17:22.983367+0000","last_peered":"2023-10-09T08:17:22.983367+0000","last_clean":"2023-10-09T08:17:22.983367+0000","last_became_active":"2023-10-09T08:17:22.979151+0000","last_became_peered":"2023-10-09T08:17:22.979151+0000","last_unstale":"2023-10-09T08:17:22.983367+0000","last_undegraded":"2023-10-09T08:17:22.983367+0000","last_fullsized":"2023-10-09T08:17:22.983367+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:16:27.730608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.975230+0000","last_change":"2023-10-09T08:17:22.973609+0000","last_active":"2023-10-09T08:17:22.975230+0000","last_peered":"2023-10-09T08:17:22.975230+0000","last_clean":"2023-10-09T08:17:22.975230+0000","last_became_active":"2023-10-09T08:17:22.973223+0000","last_became_peered":"2023-10-09T08:17:22.973223+0000","last_unstale":"2023-10-09T08:17:22.975230+0000","last_undegraded":"2023-10-09T08:17:22.975230+0000","last_fullsized":"2023-10-09T08:17:22.975230+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:14.281969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983370+0000","last_change":"2023-10-09T08:17:22.982342+0000","last_active":"2023-10-09T08:17:22.983370+0000","last_peered":"2023-10-09T08:17:22.983370+0000","last_clean":"2023-10-09T08:17:22.983370+0000","last_became_active":"2023-10-09T08:17:22.982076+0000","last_became_peered":"2023-10-09T08:17:22.982076+0000","last_unstale":"2023-10-09T08:17:22.983370+0000","last_undegraded":"2023-10-09T08:17:22.983370+0000","last_fullsized":"2023-10-09T08:17:22.983370+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:17.661906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.973192+0000","last_change":"2023-10-09T08:17:22.969013+0000","last_active":"2023-10-09T08:17:22.973192+0000","last_peered":"2023-10-09T08:17:22.973192+0000","last_clean":"2023-10-09T08:17:22.973192+0000","last_became_active":"2023-10-09T08:17:22.968732+0000","last_became_peered":"2023-10-09T08:17:22.968732+0000","last_unstale":"2023-10-09T08:17:22.973192+0000","last_undegraded":"2023-10-09T08:17:22.973192+0000","last_fullsized":"2023-10-09T08:17:22.973192+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:38:56.087344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.972930+0000","last_change":"2023-10-09T08:17:22.971110+0000","last_active":"2023-10-09T08:17:22.972930+0000","last_peered":"2023-10-09T08:17:22.972930+0000","last_clean":"2023-10-09T08:17:22.972930+0000","last_became_active":"2023-10-09T08:17:22.970864+0000","last_became_peered":"2023-10-09T08:17:22.970864+0000","last_unstale":"2023-10-09T08:17:22.972930+0000","last_undegraded":"2023-10-09T08:17:22.972930+0000","last_fullsized":"2023-10-09T08:17:22.972930+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:35:13.889838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"209'4","reported_seq":14,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997902+0000","last_change":"2023-10-09T08:17:21.981359+0000","last_active":"2023-10-09T08:17:22.997902+0000","last_peered":"2023-10-09T08:17:22.997902+0000","last_clean":"2023-10-09T08:17:22.997902+0000","last_became_active":"2023-10-09T08:17:21.981080+0000","last_became_peered":"2023-10-09T08:17:21.981080+0000","last_unstale":"2023-10-09T08:17:22.997902+0000","last_undegraded":"2023-10-09T08:17:22.997902+0000","last_fullsized":"2023-10-09T08:17:22.997902+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:38.043951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.981880+0000","last_change":"2023-10-09T08:17:22.977736+0000","last_active":"2023-10-09T08:17:22.981880+0000","last_peered":"2023-10-09T08:17:22.981880+0000","last_clean":"2023-10-09T08:17:22.981880+0000","last_became_active":"2023-10-09T08:17:22.976851+0000","last_became_peered":"2023-10-09T08:17:22.976851+0000","last_unstale":"2023-10-09T08:17:22.981880+0000","last_undegraded":"2023-10-09T08:17:22.981880+0000","last_fullsized":"2023-10-09T08:17:22.981880+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:22:35.631994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:17:20.944684+0000","last_change":"2023-10-09T08:17:20.957900+0000","last_active":"2023-10-09T08:17:20.944684+0000","last_peered":"2023-10-09T08:17:20.944684+0000","last_clean":"2023-10-09T08:17:20.944684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:20.944684+0000","last_undegraded":"2023-10-09T08:17:20.944684+0000","last_fullsized":"2023-10-09T08:17:20.944684+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:31.300930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.974564+0000","last_change":"2023-10-09T08:17:22.970652+0000","last_active":"2023-10-09T08:17:22.974564+0000","last_peered":"2023-10-09T08:17:22.974564+0000","last_clean":"2023-10-09T08:17:22.974564+0000","last_became_active":"2023-10-09T08:17:22.970213+0000","last_became_peered":"2023-10-09T08:17:22.970213+0000","last_unstale":"2023-10-09T08:17:22.974564+0000","last_undegraded":"2023-10-09T08:17:22.974564+0000","last_fullsized":"2023-10-09T08:17:22.974564+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:44:06.711747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.995441+0000","last_change":"2023-10-09T08:17:21.973213+0000","last_active":"2023-10-09T08:17:22.995441+0000","last_peered":"2023-10-09T08:17:22.995441+0000","last_clean":"2023-10-09T08:17:22.995441+0000","last_became_active":"2023-10-09T08:17:21.972952+0000","last_became_peered":"2023-10-09T08:17:21.972952+0000","last_unstale":"2023-10-09T08:17:22.995441+0000","last_undegraded":"2023-10-09T08:17:22.995441+0000","last_fullsized":"2023-10-09T08:17:22.995441+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:28.933060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:17:20.944684+0000","last_change":"2023-10-09T08:17:20.958050+0000","last_active":"2023-10-09T08:17:20.944684+0000","last_peered":"2023-10-09T08:17:20.944684+0000","last_clean":"2023-10-09T08:17:20.944684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:20.944684+0000","last_undegraded":"2023-10-09T08:17:20.944684+0000","last_fullsized":"2023-10-09T08:17:20.944684+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:16.656042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.978894+0000","last_change":"2023-10-09T08:17:22.976545+0000","last_active":"2023-10-09T08:17:22.978894+0000","last_peered":"2023-10-09T08:17:22.978894+0000","last_clean":"2023-10-09T08:17:22.978894+0000","last_became_active":"2023-10-09T08:17:22.976305+0000","last_became_peered":"2023-10-09T08:17:22.976305+0000","last_unstale":"2023-10-09T08:17:22.978894+0000","last_undegraded":"2023-10-09T08:17:22.978894+0000","last_fullsized":"2023-10-09T08:17:22.978894+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:39.805879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"209'1","reported_seq":11,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997521+0000","last_change":"2023-10-09T08:17:21.979102+0000","last_active":"2023-10-09T08:17:22.997521+0000","last_peered":"2023-10-09T08:17:22.997521+0000","last_clean":"2023-10-09T08:17:22.997521+0000","last_became_active":"2023-10-09T08:17:21.977114+0000","last_became_peered":"2023-10-09T08:17:21.977114+0000","last_unstale":"2023-10-09T08:17:22.997521+0000","last_undegraded":"2023-10-09T08:17:22.997521+0000","last_fullsized":"2023-10-09T08:17:22.997521+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:59.752920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.972264+0000","last_change":"2023-10-09T08:17:22.968229+0000","last_active":"2023-10-09T08:17:22.972264+0000","last_peered":"2023-10-09T08:17:22.972264+0000","last_clean":"2023-10-09T08:17:22.972264+0000","last_became_active":"2023-10-09T08:17:22.967986+0000","last_became_peered":"2023-10-09T08:17:22.967986+0000","last_unstale":"2023-10-09T08:17:22.972264+0000","last_undegraded":"2023-10-09T08:17:22.972264+0000","last_fullsized":"2023-10-09T08:17:22.972264+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:30.679481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"209'1","reported_seq":11,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997465+0000","last_change":"2023-10-09T08:17:21.974938+0000","last_active":"2023-10-09T08:17:22.997465+0000","last_peered":"2023-10-09T08:17:22.997465+0000","last_clean":"2023-10-09T08:17:22.997465+0000","last_became_active":"2023-10-09T08:17:21.974701+0000","last_became_peered":"2023-10-09T08:17:21.974701+0000","last_unstale":"2023-10-09T08:17:22.997465+0000","last_undegraded":"2023-10-09T08:17:22.997465+0000","last_fullsized":"2023-10-09T08:17:22.997465+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:39:13.667615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.979263+0000","last_change":"2023-10-09T08:17:22.975840+0000","last_active":"2023-10-09T08:17:22.979263+0000","last_peered":"2023-10-09T08:17:22.979263+0000","last_clean":"2023-10-09T08:17:22.979263+0000","last_became_active":"2023-10-09T08:17:22.975564+0000","last_became_peered":"2023-10-09T08:17:22.975564+0000","last_unstale":"2023-10-09T08:17:22.979263+0000","last_undegraded":"2023-10-09T08:17:22.979263+0000","last_fullsized":"2023-10-09T08:17:22.979263+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:57:29.061415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.971606+0000","last_change":"2023-10-09T08:17:21.975736+0000","last_active":"2023-10-09T08:17:22.971606+0000","last_peered":"2023-10-09T08:17:22.971606+0000","last_clean":"2023-10-09T08:17:22.971606+0000","last_became_active":"2023-10-09T08:17:21.975485+0000","last_became_peered":"2023-10-09T08:17:21.975485+0000","last_unstale":"2023-10-09T08:17:22.971606+0000","last_undegraded":"2023-10-09T08:17:22.971606+0000","last_fullsized":"2023-10-09T08:17:22.971606+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:22.558736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.980865+0000","last_change":"2023-10-09T08:17:22.975094+0000","last_active":"2023-10-09T08:17:22.980865+0000","last_peered":"2023-10-09T08:17:22.980865+0000","last_clean":"2023-10-09T08:17:22.980865+0000","last_became_active":"2023-10-09T08:17:22.974826+0000","last_became_peered":"2023-10-09T08:17:22.974826+0000","last_unstale":"2023-10-09T08:17:22.980865+0000","last_undegraded":"2023-10-09T08:17:22.980865+0000","last_fullsized":"2023-10-09T08:17:22.980865+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:21.488090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.964826+0000","last_change":"2023-10-09T08:17:21.970071+0000","last_active":"2023-10-09T08:17:22.964826+0000","last_peered":"2023-10-09T08:17:22.964826+0000","last_clean":"2023-10-09T08:17:22.964826+0000","last_became_active":"2023-10-09T08:17:21.969809+0000","last_became_peered":"2023-10-09T08:17:21.969809+0000","last_unstale":"2023-10-09T08:17:22.964826+0000","last_undegraded":"2023-10-09T08:17:22.964826+0000","last_fullsized":"2023-10-09T08:17:22.964826+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:30.623483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.973746+0000","last_change":"2023-10-09T08:17:22.972774+0000","last_active":"2023-10-09T08:17:22.973746+0000","last_peered":"2023-10-09T08:17:22.973746+0000","last_clean":"2023-10-09T08:17:22.973746+0000","last_became_active":"2023-10-09T08:17:22.972520+0000","last_became_peered":"2023-10-09T08:17:22.972520+0000","last_unstale":"2023-10-09T08:17:22.973746+0000","last_undegraded":"2023-10-09T08:17:22.973746+0000","last_fullsized":"2023-10-09T08:17:22.973746+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:24.899441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.966427+0000","last_change":"2023-10-09T08:17:21.980454+0000","last_active":"2023-10-09T08:17:22.966427+0000","last_peered":"2023-10-09T08:17:22.966427+0000","last_clean":"2023-10-09T08:17:22.966427+0000","last_became_active":"2023-10-09T08:17:21.980212+0000","last_became_peered":"2023-10-09T08:17:21.980212+0000","last_unstale":"2023-10-09T08:17:22.966427+0000","last_undegraded":"2023-10-09T08:17:22.966427+0000","last_fullsized":"2023-10-09T08:17:22.966427+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:19.075882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.974546+0000","last_change":"2023-10-09T08:17:22.970468+0000","last_active":"2023-10-09T08:17:22.974546+0000","last_peered":"2023-10-09T08:17:22.974546+0000","last_clean":"2023-10-09T08:17:22.974546+0000","last_became_active":"2023-10-09T08:17:22.969789+0000","last_became_peered":"2023-10-09T08:17:22.969789+0000","last_unstale":"2023-10-09T08:17:22.974546+0000","last_undegraded":"2023-10-09T08:17:22.974546+0000","last_fullsized":"2023-10-09T08:17:22.974546+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:42.923655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"209'3","reported_seq":13,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.998217+0000","last_change":"2023-10-09T08:17:21.977462+0000","last_active":"2023-10-09T08:17:22.998217+0000","last_peered":"2023-10-09T08:17:22.998217+0000","last_clean":"2023-10-09T08:17:22.998217+0000","last_became_active":"2023-10-09T08:17:21.977059+0000","last_became_peered":"2023-10-09T08:17:21.977059+0000","last_unstale":"2023-10-09T08:17:22.998217+0000","last_undegraded":"2023-10-09T08:17:22.998217+0000","last_fullsized":"2023-10-09T08:17:22.998217+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:28.289402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.980213+0000","last_change":"2023-10-09T08:17:22.975853+0000","last_active":"2023-10-09T08:17:22.980213+0000","last_peered":"2023-10-09T08:17:22.980213+0000","last_clean":"2023-10-09T08:17:22.980213+0000","last_became_active":"2023-10-09T08:17:22.975560+0000","last_became_peered":"2023-10-09T08:17:22.975560+0000","last_unstale":"2023-10-09T08:17:22.980213+0000","last_undegraded":"2023-10-09T08:17:22.980213+0000","last_fullsized":"2023-10-09T08:17:22.980213+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:33:39.216798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"209'6","reported_seq":16,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.999925+0000","last_change":"2023-10-09T08:17:21.971926+0000","last_active":"2023-10-09T08:17:22.999925+0000","last_peered":"2023-10-09T08:17:22.999925+0000","last_clean":"2023-10-09T08:17:22.999925+0000","last_became_active":"2023-10-09T08:17:21.971645+0000","last_became_peered":"2023-10-09T08:17:21.971645+0000","last_unstale":"2023-10-09T08:17:22.999925+0000","last_undegraded":"2023-10-09T08:17:22.999925+0000","last_fullsized":"2023-10-09T08:17:22.999925+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:39:13.866505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.987320+0000","last_change":"2023-10-09T08:17:22.985018+0000","last_active":"2023-10-09T08:17:22.987320+0000","last_peered":"2023-10-09T08:17:22.987320+0000","last_clean":"2023-10-09T08:17:22.987320+0000","last_became_active":"2023-10-09T08:17:22.984647+0000","last_became_peered":"2023-10-09T08:17:22.984647+0000","last_unstale":"2023-10-09T08:17:22.987320+0000","last_undegraded":"2023-10-09T08:17:22.987320+0000","last_fullsized":"2023-10-09T08:17:22.987320+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:40:00.458280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997202+0000","last_change":"2023-10-09T08:17:21.975388+0000","last_active":"2023-10-09T08:17:22.997202+0000","last_peered":"2023-10-09T08:17:22.997202+0000","last_clean":"2023-10-09T08:17:22.997202+0000","last_became_active":"2023-10-09T08:17:21.974540+0000","last_became_peered":"2023-10-09T08:17:21.974540+0000","last_unstale":"2023-10-09T08:17:22.997202+0000","last_undegraded":"2023-10-09T08:17:22.997202+0000","last_fullsized":"2023-10-09T08:17:22.997202+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:39:02.110538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.984496+0000","last_change":"2023-10-09T08:17:22.982417+0000","last_active":"2023-10-09T08:17:22.984496+0000","last_peered":"2023-10-09T08:17:22.984496+0000","last_clean":"2023-10-09T08:17:22.984496+0000","last_became_active":"2023-10-09T08:17:22.982109+0000","last_became_peered":"2023-10-09T08:17:22.982109+0000","last_unstale":"2023-10-09T08:17:22.984496+0000","last_undegraded":"2023-10-09T08:17:22.984496+0000","last_fullsized":"2023-10-09T08:17:22.984496+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:46.160662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.967604+0000","last_change":"2023-10-09T08:17:21.981649+0000","last_active":"2023-10-09T08:17:22.967604+0000","last_peered":"2023-10-09T08:17:22.967604+0000","last_clean":"2023-10-09T08:17:22.967604+0000","last_became_active":"2023-10-09T08:17:21.981362+0000","last_became_peered":"2023-10-09T08:17:21.981362+0000","last_unstale":"2023-10-09T08:17:22.967604+0000","last_undegraded":"2023-10-09T08:17:22.967604+0000","last_fullsized":"2023-10-09T08:17:22.967604+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:03.261223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.961371+0000","last_change":"2023-10-09T08:17:21.976656+0000","last_active":"2023-10-09T08:17:22.961371+0000","last_peered":"2023-10-09T08:17:22.961371+0000","last_clean":"2023-10-09T08:17:22.961371+0000","last_became_active":"2023-10-09T08:17:21.976292+0000","last_became_peered":"2023-10-09T08:17:21.976292+0000","last_unstale":"2023-10-09T08:17:22.961371+0000","last_undegraded":"2023-10-09T08:17:22.961371+0000","last_fullsized":"2023-10-09T08:17:22.961371+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:00:59.557712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983496+0000","last_change":"2023-10-09T08:17:22.979323+0000","last_active":"2023-10-09T08:17:22.983496+0000","last_peered":"2023-10-09T08:17:22.983496+0000","last_clean":"2023-10-09T08:17:22.983496+0000","last_became_active":"2023-10-09T08:17:22.972209+0000","last_became_peered":"2023-10-09T08:17:22.972209+0000","last_unstale":"2023-10-09T08:17:22.983496+0000","last_undegraded":"2023-10-09T08:17:22.983496+0000","last_fullsized":"2023-10-09T08:17:22.983496+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:40.009878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"209'8","reported_seq":18,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.998098+0000","last_change":"2023-10-09T08:17:21.975369+0000","last_active":"2023-10-09T08:17:22.998098+0000","last_peered":"2023-10-09T08:17:22.998098+0000","last_clean":"2023-10-09T08:17:22.998098+0000","last_became_active":"2023-10-09T08:17:21.974853+0000","last_became_peered":"2023-10-09T08:17:21.974853+0000","last_unstale":"2023-10-09T08:17:22.998098+0000","last_undegraded":"2023-10-09T08:17:22.998098+0000","last_fullsized":"2023-10-09T08:17:22.998098+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:50.234694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.991744+0000","last_change":"2023-10-09T08:17:22.988118+0000","last_active":"2023-10-09T08:17:22.991744+0000","last_peered":"2023-10-09T08:17:22.991744+0000","last_clean":"2023-10-09T08:17:22.991744+0000","last_became_active":"2023-10-09T08:17:22.987859+0000","last_became_peered":"2023-10-09T08:17:22.987859+0000","last_unstale":"2023-10-09T08:17:22.991744+0000","last_undegraded":"2023-10-09T08:17:22.991744+0000","last_fullsized":"2023-10-09T08:17:22.991744+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:09:01.740678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"209'1","reported_seq":11,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997761+0000","last_change":"2023-10-09T08:17:21.977355+0000","last_active":"2023-10-09T08:17:22.997761+0000","last_peered":"2023-10-09T08:17:22.997761+0000","last_clean":"2023-10-09T08:17:22.997761+0000","last_became_active":"2023-10-09T08:17:21.977044+0000","last_became_peered":"2023-10-09T08:17:21.977044+0000","last_unstale":"2023-10-09T08:17:22.997761+0000","last_undegraded":"2023-10-09T08:17:22.997761+0000","last_fullsized":"2023-10-09T08:17:22.997761+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:35:04.782620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.996822+0000","last_change":"2023-10-09T08:17:21.974199+0000","last_active":"2023-10-09T08:17:22.996822+0000","last_peered":"2023-10-09T08:17:22.996822+0000","last_clean":"2023-10-09T08:17:22.996822+0000","last_became_active":"2023-10-09T08:17:21.973943+0000","last_became_peered":"2023-10-09T08:17:21.973943+0000","last_unstale":"2023-10-09T08:17:22.996822+0000","last_undegraded":"2023-10-09T08:17:22.996822+0000","last_fullsized":"2023-10-09T08:17:22.996822+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:56.455448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"209'1","reported_seq":11,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997076+0000","last_change":"2023-10-09T08:17:21.975063+0000","last_active":"2023-10-09T08:17:22.997076+0000","last_peered":"2023-10-09T08:17:22.997076+0000","last_clean":"2023-10-09T08:17:22.997076+0000","last_became_active":"2023-10-09T08:17:21.974796+0000","last_became_peered":"2023-10-09T08:17:21.974796+0000","last_unstale":"2023-10-09T08:17:22.997076+0000","last_undegraded":"2023-10-09T08:17:22.997076+0000","last_fullsized":"2023-10-09T08:17:22.997076+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:23.082491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.964704+0000","last_change":"2023-10-09T08:17:21.972751+0000","last_active":"2023-10-09T08:17:22.964704+0000","last_peered":"2023-10-09T08:17:22.964704+0000","last_clean":"2023-10-09T08:17:22.964704+0000","last_became_active":"2023-10-09T08:17:21.972437+0000","last_became_peered":"2023-10-09T08:17:21.972437+0000","last_unstale":"2023-10-09T08:17:22.964704+0000","last_undegraded":"2023-10-09T08:17:22.964704+0000","last_fullsized":"2023-10-09T08:17:22.964704+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:38:55.081479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.980862+0000","last_change":"2023-10-09T08:17:22.977458+0000","last_active":"2023-10-09T08:17:22.980862+0000","last_peered":"2023-10-09T08:17:22.980862+0000","last_clean":"2023-10-09T08:17:22.980862+0000","last_became_active":"2023-10-09T08:17:22.976833+0000","last_became_peered":"2023-10-09T08:17:22.976833+0000","last_unstale":"2023-10-09T08:17:22.980862+0000","last_undegraded":"2023-10-09T08:17:22.980862+0000","last_fullsized":"2023-10-09T08:17:22.980862+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:52.374897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.993473+0000","last_change":"2023-10-09T08:17:21.981403+0000","last_active":"2023-10-09T08:17:22.993473+0000","last_peered":"2023-10-09T08:17:22.993473+0000","last_clean":"2023-10-09T08:17:22.993473+0000","last_became_active":"2023-10-09T08:17:21.981161+0000","last_became_peered":"2023-10-09T08:17:21.981161+0000","last_unstale":"2023-10-09T08:17:22.993473+0000","last_undegraded":"2023-10-09T08:17:22.993473+0000","last_fullsized":"2023-10-09T08:17:22.993473+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:27.699996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.974523+0000","last_change":"2023-10-09T08:17:22.971091+0000","last_active":"2023-10-09T08:17:22.974523+0000","last_peered":"2023-10-09T08:17:22.974523+0000","last_clean":"2023-10-09T08:17:22.974523+0000","last_became_active":"2023-10-09T08:17:22.970841+0000","last_became_peered":"2023-10-09T08:17:22.970841+0000","last_unstale":"2023-10-09T08:17:22.974523+0000","last_undegraded":"2023-10-09T08:17:22.974523+0000","last_fullsized":"2023-10-09T08:17:22.974523+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:03:06.011485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.964325+0000","last_change":"2023-10-09T08:17:21.975152+0000","last_active":"2023-10-09T08:17:22.964325+0000","last_peered":"2023-10-09T08:17:22.964325+0000","last_clean":"2023-10-09T08:17:22.964325+0000","last_became_active":"2023-10-09T08:17:21.974892+0000","last_became_peered":"2023-10-09T08:17:21.974892+0000","last_unstale":"2023-10-09T08:17:22.964325+0000","last_undegraded":"2023-10-09T08:17:22.964325+0000","last_fullsized":"2023-10-09T08:17:22.964325+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:27.291932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.965212+0000","last_change":"2023-10-09T08:17:21.980816+0000","last_active":"2023-10-09T08:17:22.965212+0000","last_peered":"2023-10-09T08:17:22.965212+0000","last_clean":"2023-10-09T08:17:22.965212+0000","last_became_active":"2023-10-09T08:17:21.980578+0000","last_became_peered":"2023-10-09T08:17:21.980578+0000","last_unstale":"2023-10-09T08:17:22.965212+0000","last_undegraded":"2023-10-09T08:17:22.965212+0000","last_fullsized":"2023-10-09T08:17:22.965212+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:47.769934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.992100+0000","last_change":"2023-10-09T08:17:22.987538+0000","last_active":"2023-10-09T08:17:22.992100+0000","last_peered":"2023-10-09T08:17:22.992100+0000","last_clean":"2023-10-09T08:17:22.992100+0000","last_became_active":"2023-10-09T08:17:22.987276+0000","last_became_peered":"2023-10-09T08:17:22.987276+0000","last_unstale":"2023-10-09T08:17:22.992100+0000","last_undegraded":"2023-10-09T08:17:22.992100+0000","last_fullsized":"2023-10-09T08:17:22.992100+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:11.081055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:17:20.944684+0000","last_change":"2023-10-09T08:17:20.957350+0000","last_active":"2023-10-09T08:17:20.944684+0000","last_peered":"2023-10-09T08:17:20.944684+0000","last_clean":"2023-10-09T08:17:20.944684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:20.944684+0000","last_undegraded":"2023-10-09T08:17:20.944684+0000","last_fullsized":"2023-10-09T08:17:20.944684+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:48.265038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.979856+0000","last_change":"2023-10-09T08:17:22.976521+0000","last_active":"2023-10-09T08:17:22.979856+0000","last_peered":"2023-10-09T08:17:22.979856+0000","last_clean":"2023-10-09T08:17:22.979856+0000","last_became_active":"2023-10-09T08:17:22.976267+0000","last_became_peered":"2023-10-09T08:17:22.976267+0000","last_unstale":"2023-10-09T08:17:22.979856+0000","last_undegraded":"2023-10-09T08:17:22.979856+0000","last_fullsized":"2023-10-09T08:17:22.979856+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:51.085786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.995515+0000","last_change":"2023-10-09T08:17:21.978738+0000","last_active":"2023-10-09T08:17:22.995515+0000","last_peered":"2023-10-09T08:17:22.995515+0000","last_clean":"2023-10-09T08:17:22.995515+0000","last_became_active":"2023-10-09T08:17:21.978434+0000","last_became_peered":"2023-10-09T08:17:21.978434+0000","last_unstale":"2023-10-09T08:17:22.995515+0000","last_undegraded":"2023-10-09T08:17:22.995515+0000","last_fullsized":"2023-10-09T08:17:22.995515+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:18:28.973275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.985726+0000","last_change":"2023-10-09T08:17:22.981798+0000","last_active":"2023-10-09T08:17:22.985726+0000","last_peered":"2023-10-09T08:17:22.985726+0000","last_clean":"2023-10-09T08:17:22.985726+0000","last_became_active":"2023-10-09T08:17:22.981558+0000","last_became_peered":"2023-10-09T08:17:22.981558+0000","last_unstale":"2023-10-09T08:17:22.985726+0000","last_undegraded":"2023-10-09T08:17:22.985726+0000","last_fullsized":"2023-10-09T08:17:22.985726+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:56:15.613249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.969647+0000","last_change":"2023-10-09T08:17:21.970119+0000","last_active":"2023-10-09T08:17:22.969647+0000","last_peered":"2023-10-09T08:17:22.969647+0000","last_clean":"2023-10-09T08:17:22.969647+0000","last_became_active":"2023-10-09T08:17:21.969872+0000","last_became_peered":"2023-10-09T08:17:21.969872+0000","last_unstale":"2023-10-09T08:17:22.969647+0000","last_undegraded":"2023-10-09T08:17:22.969647+0000","last_fullsized":"2023-10-09T08:17:22.969647+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:50.234694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983970+0000","last_change":"2023-10-09T08:17:22.974514+0000","last_active":"2023-10-09T08:17:22.983970+0000","last_peered":"2023-10-09T08:17:22.983970+0000","last_clean":"2023-10-09T08:17:22.983970+0000","last_became_active":"2023-10-09T08:17:22.974268+0000","last_became_peered":"2023-10-09T08:17:22.974268+0000","last_unstale":"2023-10-09T08:17:22.983970+0000","last_undegraded":"2023-10-09T08:17:22.983970+0000","last_fullsized":"2023-10-09T08:17:22.983970+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:04.267087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.969883+0000","last_change":"2023-10-09T08:17:21.969312+0000","last_active":"2023-10-09T08:17:22.969883+0000","last_peered":"2023-10-09T08:17:22.969883+0000","last_clean":"2023-10-09T08:17:22.969883+0000","last_became_active":"2023-10-09T08:17:21.969051+0000","last_became_peered":"2023-10-09T08:17:21.969051+0000","last_unstale":"2023-10-09T08:17:22.969883+0000","last_undegraded":"2023-10-09T08:17:22.969883+0000","last_fullsized":"2023-10-09T08:17:22.969883+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:22.558736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.984369+0000","last_change":"2023-10-09T08:17:22.982056+0000","last_active":"2023-10-09T08:17:22.984369+0000","last_peered":"2023-10-09T08:17:22.984369+0000","last_clean":"2023-10-09T08:17:22.984369+0000","last_became_active":"2023-10-09T08:17:22.981764+0000","last_became_peered":"2023-10-09T08:17:22.981764+0000","last_unstale":"2023-10-09T08:17:22.984369+0000","last_undegraded":"2023-10-09T08:17:22.984369+0000","last_fullsized":"2023-10-09T08:17:22.984369+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:47.563936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.961506+0000","last_change":"2023-10-09T08:17:21.973015+0000","last_active":"2023-10-09T08:17:22.961506+0000","last_peered":"2023-10-09T08:17:22.961506+0000","last_clean":"2023-10-09T08:17:22.961506+0000","last_became_active":"2023-10-09T08:17:21.972770+0000","last_became_peered":"2023-10-09T08:17:21.972770+0000","last_unstale":"2023-10-09T08:17:22.961506+0000","last_undegraded":"2023-10-09T08:17:22.961506+0000","last_fullsized":"2023-10-09T08:17:22.961506+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:20.745815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982691+0000","last_change":"2023-10-09T08:17:22.977908+0000","last_active":"2023-10-09T08:17:22.982691+0000","last_peered":"2023-10-09T08:17:22.982691+0000","last_clean":"2023-10-09T08:17:22.982691+0000","last_became_active":"2023-10-09T08:17:22.977612+0000","last_became_peered":"2023-10-09T08:17:22.977612+0000","last_unstale":"2023-10-09T08:17:22.982691+0000","last_undegraded":"2023-10-09T08:17:22.982691+0000","last_fullsized":"2023-10-09T08:17:22.982691+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:23.588826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:17:20.944684+0000","last_change":"2023-10-09T08:17:20.957339+0000","last_active":"2023-10-09T08:17:20.944684+0000","last_peered":"2023-10-09T08:17:20.944684+0000","last_clean":"2023-10-09T08:17:20.944684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:20.944684+0000","last_undegraded":"2023-10-09T08:17:20.944684+0000","last_fullsized":"2023-10-09T08:17:20.944684+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:03.136819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982978+0000","last_change":"2023-10-09T08:17:22.978269+0000","last_active":"2023-10-09T08:17:22.982978+0000","last_peered":"2023-10-09T08:17:22.982978+0000","last_clean":"2023-10-09T08:17:22.982978+0000","last_became_active":"2023-10-09T08:17:22.977903+0000","last_became_peered":"2023-10-09T08:17:22.977903+0000","last_unstale":"2023-10-09T08:17:22.982978+0000","last_undegraded":"2023-10-09T08:17:22.982978+0000","last_fullsized":"2023-10-09T08:17:22.982978+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:44.655055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:17:20.944684+0000","last_change":"2023-10-09T08:17:20.957386+0000","last_active":"2023-10-09T08:17:20.944684+0000","last_peered":"2023-10-09T08:17:20.944684+0000","last_clean":"2023-10-09T08:17:20.944684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:20.944684+0000","last_undegraded":"2023-10-09T08:17:20.944684+0000","last_fullsized":"2023-10-09T08:17:20.944684+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:45.154798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:17:20.944684+0000","last_change":"2023-10-09T08:17:20.958011+0000","last_active":"2023-10-09T08:17:20.944684+0000","last_peered":"2023-10-09T08:17:20.944684+0000","last_clean":"2023-10-09T08:17:20.944684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:20.944684+0000","last_undegraded":"2023-10-09T08:17:20.944684+0000","last_fullsized":"2023-10-09T08:17:20.944684+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:39:59.452415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.979826+0000","last_change":"2023-10-09T08:17:22.975859+0000","last_active":"2023-10-09T08:17:22.979826+0000","last_peered":"2023-10-09T08:17:22.979826+0000","last_clean":"2023-10-09T08:17:22.979826+0000","last_became_active":"2023-10-09T08:17:22.975613+0000","last_became_peered":"2023-10-09T08:17:22.975613+0000","last_unstale":"2023-10-09T08:17:22.979826+0000","last_undegraded":"2023-10-09T08:17:22.979826+0000","last_fullsized":"2023-10-09T08:17:22.979826+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:58.570422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.965128+0000","last_change":"2023-10-09T08:17:21.980259+0000","last_active":"2023-10-09T08:17:22.965128+0000","last_peered":"2023-10-09T08:17:22.965128+0000","last_clean":"2023-10-09T08:17:22.965128+0000","last_became_active":"2023-10-09T08:17:21.980015+0000","last_became_peered":"2023-10-09T08:17:21.980015+0000","last_unstale":"2023-10-09T08:17:22.965128+0000","last_undegraded":"2023-10-09T08:17:22.965128+0000","last_fullsized":"2023-10-09T08:17:22.965128+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:23:19.929532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.988548+0000","last_change":"2023-10-09T08:17:22.983916+0000","last_active":"2023-10-09T08:17:22.988548+0000","last_peered":"2023-10-09T08:17:22.988548+0000","last_clean":"2023-10-09T08:17:22.988548+0000","last_became_active":"2023-10-09T08:17:22.983658+0000","last_became_peered":"2023-10-09T08:17:22.983658+0000","last_unstale":"2023-10-09T08:17:22.988548+0000","last_undegraded":"2023-10-09T08:17:22.988548+0000","last_fullsized":"2023-10-09T08:17:22.988548+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:28.109789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.969899+0000","last_change":"2023-10-09T08:17:21.976803+0000","last_active":"2023-10-09T08:17:22.969899+0000","last_peered":"2023-10-09T08:17:22.969899+0000","last_clean":"2023-10-09T08:17:22.969899+0000","last_became_active":"2023-10-09T08:17:21.976538+0000","last_became_peered":"2023-10-09T08:17:21.976538+0000","last_unstale":"2023-10-09T08:17:22.969899+0000","last_undegraded":"2023-10-09T08:17:22.969899+0000","last_fullsized":"2023-10-09T08:17:22.969899+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:03.261223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"199'348","reported_seq":1143,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.971832+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T08:17:22.971832+0000","last_peered":"2023-10-09T08:17:22.971832+0000","last_clean":"2023-10-09T08:17:22.971832+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T08:17:22.971832+0000","last_undegraded":"2023-10-09T08:17:22.971832+0000","last_fullsized":"2023-10-09T08:17:22.971832+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":94,"acting":94,"num_store_stats":6},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575974,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312732,"kb_used_data":3156,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059108,"statfs":{"total":96636764160,"available":96316526592,"internally_reserved":0,"allocated":3231744,"data_stored":1918128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.57999999999999996,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":0.98599999999999999,"5min":0.98699999999999999,"15min":1.1220000000000001},"last":0.752},{"interface":"front","average":{"1min":0.751,"5min":0.73999999999999999,"15min":0.749},"min":{"1min":0.64200000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86299999999999999,"5min":1.0069999999999999,"15min":1.0209999999999999},"last":0.68000000000000005}]},{"osd":1,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.65400000000000003,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":0.92900000000000005,"5min":1.28,"15min":1.28},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.74099999999999999,"15min":0.75},"min":{"1min":0.55900000000000005,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89100000000000001,"5min":1.298,"15min":1.298},"last":0.70599999999999996}]},{"osd":2,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.747,"15min":0.753},"min":{"1min":0.57699999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94899999999999995,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76500000000000001,"15min":0.77000000000000002},"min":{"1min":0.64500000000000002,"5min":0.49299999999999999,"15min":0.442},"max":{"1min":0.879,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.73499999999999999}]},{"osd":3,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.73899999999999999,"15min":0.73999999999999999},"min":{"1min":0.56100000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92600000000000005,"5min":1.399,"15min":1.399},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78100000000000003,"15min":0.77700000000000002},"min":{"1min":0.61499999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95599999999999996,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.62,"15min":0.60599999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38300000000000001},"max":{"1min":0.83299999999999996,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63900000000000001,"15min":0.628},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.38600000000000001},"max":{"1min":0.78500000000000003,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.498}]},{"osd":5,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65100000000000002,"15min":0.64600000000000002},"min":{"1min":0.46899999999999997,"5min":0.39400000000000002,"15min":0.376},"max":{"1min":0.81899999999999995,"5min":1.413,"15min":1.413},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.51400000000000001,"5min":0.41699999999999998,"15min":0.40100000000000002},"max":{"1min":0.90300000000000002,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.58199999999999996}]},{"osd":6,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74399999999999999,"15min":0.73799999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.48199999999999998},"max":{"1min":0.89400000000000002,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.70999999999999996,"15min":0.70499999999999996},"min":{"1min":0.499,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":0.85099999999999998,"5min":1.595,"15min":1.595},"last":0.59999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316192,"kb_used_data":2520,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055648,"statfs":{"total":96636764160,"available":96312983552,"internally_reserved":0,"allocated":2580480,"data_stored":1300457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76600000000000001,"15min":0.746},"min":{"1min":0.51300000000000001,"5min":0.46899999999999997,"15min":0.40300000000000002},"max":{"1min":0.92600000000000005,"5min":0.99299999999999999,"15min":1.0189999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.73799999999999999,"15min":0.73099999999999998},"min":{"1min":0.67300000000000004,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94099999999999995,"5min":0.96299999999999997,"15min":0.97399999999999998},"last":0.59299999999999997}]},{"osd":1,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.748,"15min":0.751},"min":{"1min":0.50900000000000001,"5min":0.45300000000000001,"15min":0.38500000000000001},"max":{"1min":0.90900000000000003,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78200000000000003,"15min":0.76400000000000001},"min":{"1min":0.56999999999999995,"5min":0.44,"15min":0.44},"max":{"1min":0.95899999999999996,"5min":1.0269999999999999,"15min":1.097},"last":0.56299999999999994}]},{"osd":2,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77000000000000002,"15min":0.75800000000000001},"min":{"1min":0.60799999999999998,"5min":0.495,"15min":0.46400000000000002},"max":{"1min":0.92000000000000004,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.76700000000000002,"15min":0.77300000000000002},"min":{"1min":0.58499999999999996,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":0.97699999999999998,"5min":1.0429999999999999,"15min":1.0660000000000001},"last":0.63300000000000001}]},{"osd":3,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.57999999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.89700000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.79700000000000004,"15min":0.78900000000000003},"min":{"1min":0.64000000000000001,"5min":0.54100000000000004,"15min":0.49299999999999999},"max":{"1min":0.97999999999999998,"5min":1.119,"15min":1.119},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.64700000000000002,"15min":0.63800000000000001},"min":{"1min":0.45800000000000002,"5min":0.44700000000000001,"15min":0.40200000000000002},"max":{"1min":0.82499999999999996,"5min":1.0149999999999999,"15min":1.1339999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.64400000000000002,"15min":0.63700000000000001},"min":{"1min":0.47999999999999998,"5min":0.39700000000000002,"15min":0.32000000000000001},"max":{"1min":0.72299999999999998,"5min":0.91900000000000004,"15min":0.93700000000000006},"last":0.42999999999999999}]},{"osd":5,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.47599999999999998,"5min":0.42399999999999999,"15min":0.40100000000000002},"max":{"1min":0.83999999999999997,"5min":1.232,"15min":1.232},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.72499999999999998,"15min":0.70799999999999996},"min":{"1min":0.52400000000000002,"5min":0.46600000000000003,"15min":0.45200000000000001},"max":{"1min":0.872,"5min":1.0880000000000001,"15min":1.121},"last":0.69099999999999995}]},{"osd":7,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69499999999999995,"15min":0.68899999999999995},"min":{"1min":0.52200000000000002,"5min":0.45600000000000002,"15min":0.36299999999999999},"max":{"1min":0.85499999999999998,"5min":0.98699999999999999,"15min":1.0309999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.74299999999999999},"min":{"1min":0.56399999999999995,"5min":0.48699999999999999,"15min":0.442},"max":{"1min":0.89200000000000002,"5min":1.194,"15min":1.194},"last":0.66900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575974,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308060,"kb_used_data":2580,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063780,"statfs":{"total":96636764160,"available":96321310720,"internally_reserved":0,"allocated":2641920,"data_stored":1329192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45600000000000002,"15min":0.45700000000000002},"min":{"1min":0.34100000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.65000000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.40000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78300000000000003,"5min":0.95499999999999996,"15min":1.2230000000000001},"last":0.38700000000000001}]},{"osd":2,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.39200000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71599999999999997,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42699999999999999,"5min":0.40300000000000002,"15min":0.39500000000000002},"max":{"1min":0.77300000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.51000000000000001}]},{"osd":3,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63,"15min":0.627},"min":{"1min":0.49199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84199999999999997,"5min":1.0049999999999999,"15min":1.2589999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.435,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":1.1519999999999999},"last":0.33500000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78800000000000003,"15min":0.78200000000000003},"min":{"1min":0.58999999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.087,"5min":1.1759999999999999,"15min":1.224},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.80400000000000005,"15min":0.80300000000000005},"min":{"1min":0.66700000000000004,"5min":0.56499999999999995,"15min":0.51800000000000002},"max":{"1min":1.0329999999999999,"5min":1.071,"15min":1.5800000000000001},"last":0.85299999999999998}]},{"osd":5,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.81699999999999995,"15min":0.81399999999999995},"min":{"1min":0.61599999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.77},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.81799999999999995,"15min":0.80700000000000005},"min":{"1min":0.67500000000000004,"5min":0.56100000000000005,"15min":0.49299999999999999},"max":{"1min":1.177,"5min":1.262,"15min":1.288},"last":1.0369999999999999}]},{"osd":6,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.82699999999999996,"15min":0.81999999999999995},"min":{"1min":0.63900000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.071,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.84999999999999998,"15min":0.83799999999999997},"min":{"1min":0.77300000000000002,"5min":0.59999999999999998,"15min":0.56699999999999995},"max":{"1min":1.135,"5min":1.3819999999999999,"15min":1.843},"last":1.004}]},{"osd":7,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.872,"15min":0.86299999999999999},"min":{"1min":0.751,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.103,"5min":1.1739999999999999,"15min":1.9139999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.86299999999999999,"15min":0.85299999999999998},"min":{"1min":0.70699999999999996,"5min":0.61799999999999999,"15min":0.54300000000000004},"max":{"1min":1.1339999999999999,"5min":1.2270000000000001,"15min":1.347},"last":0.97499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575973,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308632,"kb_used_data":3152,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063208,"statfs":{"total":96636764160,"available":96320724992,"internally_reserved":0,"allocated":3227648,"data_stored":1918046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47199999999999998,"15min":0.48499999999999999},"min":{"1min":0.35399999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.78700000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52600000000000002,"15min":0.54200000000000004},"min":{"1min":0.375,"5min":0.251,"15min":0.251},"max":{"1min":0.65600000000000003,"5min":0.82199999999999995,"15min":0.83599999999999997},"last":0.52400000000000002}]},{"osd":2,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.47899999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69399999999999995,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.5,"15min":0.51100000000000001},"min":{"1min":0.41899999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67100000000000004,"5min":0.77300000000000002,"15min":0.81999999999999995},"last":0.46999999999999997}]},{"osd":3,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52000000000000002,"15min":0.53500000000000003},"min":{"1min":0.38700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.628,"5min":0.78200000000000003,"15min":0.80500000000000005},"last":0.501},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60399999999999998,"15min":0.61899999999999999},"min":{"1min":0.47299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82899999999999996,"5min":0.92100000000000004,"15min":0.93200000000000005},"last":0.61699999999999999}]},{"osd":4,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.60799999999999998,"5min":0.46600000000000003,"15min":0.42899999999999999},"max":{"1min":1.0589999999999999,"5min":1.1759999999999999,"15min":1.226},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.66500000000000004,"5min":0.53100000000000003,"15min":0.53000000000000003},"max":{"1min":1.139,"5min":1.216,"15min":1.23},"last":0.88200000000000001}]},{"osd":5,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.79800000000000004,"15min":0.81200000000000006},"min":{"1min":0.59399999999999997,"5min":0.51500000000000001,"15min":0.501},"max":{"1min":1.1799999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.80800000000000005,"15min":0.81799999999999995},"min":{"1min":0.65300000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.02,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.92500000000000004}]},{"osd":6,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.78200000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.141,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.82199999999999995},"min":{"1min":0.624,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.24},"last":0.80200000000000005}]},{"osd":7,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.84599999999999997,"15min":0.85999999999999999},"min":{"1min":0.68100000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2929999999999999},"last":1.163},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.85499999999999998,"15min":0.874},"min":{"1min":0.69499999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.054,"5min":1.2,"15min":1.2110000000000001},"last":1.0880000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575973,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316252,"kb_used_data":2580,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055588,"statfs":{"total":96636764160,"available":96312922112,"internally_reserved":0,"allocated":2641920,"data_stored":1328322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47999999999999998,"15min":0.46800000000000003},"min":{"1min":0.33500000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67900000000000005,"5min":0.69199999999999995,"15min":0.752},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.378,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64100000000000001,"5min":0.73299999999999998,"15min":0.82299999999999995},"last":0.51100000000000001}]},{"osd":1,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.496,"15min":0.495},"min":{"1min":0.35999999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71599999999999997,"5min":1.03,"15min":1.03},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.34699999999999998},"max":{"1min":0.68600000000000005,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.54300000000000004}]},{"osd":3,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60799999999999998,"15min":0.61099999999999999},"min":{"1min":0.47599999999999998,"5min":0.40799999999999997,"15min":0.39200000000000002},"max":{"1min":0.79200000000000004,"5min":0.89000000000000001,"15min":0.96999999999999997},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.53300000000000003,"5min":0.46600000000000003,"15min":0.43099999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61099999999999999}]},{"osd":4,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.68100000000000005,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.80900000000000005,"15min":0.79900000000000004},"min":{"1min":0.63800000000000001,"5min":0.54200000000000004,"15min":0.48399999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":1.0569999999999999}]},{"osd":5,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81000000000000005,"15min":0.80900000000000005},"min":{"1min":0.60799999999999998,"5min":0.54500000000000004,"15min":0.51800000000000002},"max":{"1min":0.96499999999999997,"5min":1.181,"15min":1.181},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.47799999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.83899999999999997}]},{"osd":6,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83899999999999997,"15min":0.82699999999999996},"min":{"1min":0.68700000000000006,"5min":0.56299999999999994,"15min":0.52700000000000002},"max":{"1min":1.1499999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83099999999999996,"15min":0.83499999999999996},"min":{"1min":0.66900000000000004,"5min":0.59399999999999997,"15min":0.57099999999999995},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.224},"last":0.89500000000000002}]},{"osd":7,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.64600000000000002,"5min":0.60199999999999998,"15min":0.47899999999999998},"max":{"1min":1.054,"5min":1.448,"15min":1.448},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.67400000000000004,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.075,"5min":1.518,"15min":1.518},"last":1.042}]}]},{"osd":3,"up_from":13,"seq":55834575974,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312156,"kb_used_data":2580,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059684,"statfs":{"total":96636764160,"available":96317116416,"internally_reserved":0,"allocated":2641920,"data_stored":1327850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47799999999999998,"15min":0.48799999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59199999999999997,"5min":0.78600000000000003,"15min":0.85999999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.503,"15min":0.505},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.63100000000000001,"5min":0.73499999999999999,"15min":0.74299999999999999},"last":0.46100000000000002}]},{"osd":1,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.5,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66900000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78400000000000003,"5min":0.84999999999999998,"15min":0.91300000000000003},"last":0.41499999999999998}]},{"osd":2,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70099999999999996,"5min":0.85699999999999998,"15min":0.97299999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.65000000000000002,"15min":0.65700000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80700000000000005,"5min":0.90200000000000002,"15min":1.036},"last":0.49299999999999999}]},{"osd":4,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52100000000000002,"5min":0.49099999999999999,"15min":0.46000000000000002},"max":{"1min":1.0149999999999999,"5min":1.175,"15min":1.175},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.85899999999999999,"15min":0.86699999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.97699999999999998,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.72699999999999998}]},{"osd":5,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.47399999999999998},"max":{"1min":1.026,"5min":1.1419999999999999,"15min":1.2170000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.83099999999999996,"15min":0.83399999999999996},"min":{"1min":0.64200000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.96599999999999997,"5min":1.1719999999999999,"15min":1.1739999999999999},"last":0.80100000000000005}]},{"osd":6,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97799999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.81200000000000006,"15min":0.81299999999999994},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.54800000000000004},"max":{"1min":1.0620000000000001,"5min":1.1339999999999999,"15min":1.149},"last":0.74399999999999999}]},{"osd":7,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.84799999999999998,"15min":0.85399999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.96199999999999997,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.85999999999999999,"15min":0.85299999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0900000000000001,"5min":1.155,"15min":1.1639999999999999},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575973,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299872,"kb_used_data":2584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071968,"statfs":{"total":96636764160,"available":96329695232,"internally_reserved":0,"allocated":2646016,"data_stored":1329746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71699999999999997,"15min":0.72399999999999998},"min":{"1min":0.498,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89900000000000002,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72399999999999998,"15min":0.73599999999999999},"min":{"1min":0.53800000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.94299999999999995,"5min":0.995,"15min":0.995},"last":0.52800000000000002}]},{"osd":1,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.70699999999999996,"15min":0.71799999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92700000000000005,"5min":0.98399999999999999,"15min":1.03},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72599999999999998,"15min":0.73899999999999999},"min":{"1min":0.52400000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92600000000000005,"5min":0.97299999999999998,"15min":1.0009999999999999},"last":0.60999999999999999}]},{"osd":2,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78700000000000003,"15min":0.79200000000000004},"min":{"1min":0.65300000000000002,"5min":0.51200000000000001,"15min":0.45000000000000001},"max":{"1min":0.93100000000000005,"5min":1.0149999999999999,"15min":1.0569999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.79100000000000004,"15min":0.80200000000000005},"min":{"1min":0.63400000000000001,"5min":0.51000000000000001,"15min":0.47999999999999998},"max":{"1min":0.96499999999999997,"5min":1.077,"15min":1.077},"last":0.72899999999999998}]},{"osd":3,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73199999999999998,"15min":0.74099999999999999},"min":{"1min":0.56299999999999994,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84999999999999998,"5min":0.96999999999999997,"15min":1.016},"last":0.627},{"interface":"front","average":{"1min":0.75,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.53200000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.89600000000000002,"5min":1.036,"15min":1.036},"last":0.76400000000000001}]},{"osd":5,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.434,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.749,"5min":0.94899999999999995,"15min":1.006},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.40100000000000002},"max":{"1min":0.85099999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.70899999999999996}]},{"osd":6,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.63400000000000001},"min":{"1min":0.495,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91100000000000003,"5min":1.022,"15min":1.034},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.68300000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83999999999999997,"5min":0.998,"15min":1.0609999999999999},"last":0.55500000000000005}]},{"osd":7,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.51400000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91900000000000004,"5min":1.036,"15min":1.036},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76000000000000001,"15min":0.77600000000000002},"min":{"1min":0.498,"5min":0.48499999999999999,"15min":0.443},"max":{"1min":0.89600000000000002,"5min":1.0609999999999999,"15min":1.079},"last":0.59699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575973,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316204,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055636,"statfs":{"total":96636764160,"available":96312971264,"internally_reserved":0,"allocated":2592768,"data_stored":1306782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.55900000000000005,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92600000000000005,"5min":1.03,"15min":1.0780000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71199999999999997,"15min":0.71499999999999997},"min":{"1min":0.53900000000000003,"5min":0.42999999999999999,"15min":0.40899999999999997},"max":{"1min":0.89000000000000001,"5min":0.97399999999999998,"15min":1.018},"last":0.79200000000000004}]},{"osd":1,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.70399999999999996,"15min":0.71699999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82499999999999996,"5min":1.0129999999999999,"15min":1.1140000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76100000000000001,"15min":0.748},"min":{"1min":0.61699999999999999,"5min":0.498,"15min":0.435},"max":{"1min":0.97999999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.69199999999999995}]},{"osd":2,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74199999999999999,"15min":0.746},"min":{"1min":0.52300000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90200000000000002,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.745,"15min":0.74399999999999999},"min":{"1min":0.55500000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.95899999999999996,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.81499999999999995}]},{"osd":3,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.56799999999999995,"5min":0.50900000000000001,"15min":0.48299999999999998},"max":{"1min":0.83999999999999997,"5min":0.95999999999999996,"15min":1.0409999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.51500000000000001},"max":{"1min":1.0049999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.871}]},{"osd":4,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.627,"15min":0.61099999999999999},"min":{"1min":0.45300000000000001,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.89000000000000001,"5min":1.093,"15min":1.093},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.624,"15min":0.60799999999999998},"min":{"1min":0.42999999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83899999999999997,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.85099999999999998}]},{"osd":6,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63900000000000001,"15min":0.622},"min":{"1min":0.46100000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82499999999999996,"5min":1,"15min":1},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.69999999999999996,"15min":0.67600000000000005},"min":{"1min":0.47699999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91700000000000004,"5min":1.123,"15min":1.123},"last":0.88600000000000001}]},{"osd":7,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.70599999999999996,"15min":0.68500000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.44400000000000001},"max":{"1min":0.94299999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78300000000000003,"15min":0.76500000000000001},"min":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.48599999999999999},"max":{"1min":0.91300000000000003,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.93100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T08:17:27.768 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T08:17:27.876 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:17:27.881 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:17:27.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.981+0000 7fb5e239d700 1 Processor -- start 2023-10-09T08:17:27.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.981+0000 7fb5e239d700 1 -- start start 2023-10-09T08:17:27.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.983+0000 7fb5e239d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5dc150180 0x7fb5dc157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:27.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.983+0000 7fb5e239d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb5dc150550 0x7fb5dc0c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:27.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.983+0000 7fb5e239d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5dc06e2a0 con 0x7fb5dc0c7240 2023-10-09T08:17:27.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.983+0000 7fb5e239d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5dc0c76e0 con 0x7fb5dc150550 2023-10-09T08:17:27.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.983+0000 7fb5e239d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc06b2e0 con 0x7fb5dc150180 2023-10-09T08:17:27.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.983+0000 7fb5e1b9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb5dc0c7240 0x7fb5dc06e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33266/0 (socket says 172.21.15.71:33266) 2023-10-09T08:17:27.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.983+0000 7fb5e1b9c700 1 -- 172.21.15.71:0/3920914070 learned_addr learned my addr 172.21.15.71:0/3920914070 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:27.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.983+0000 7fb5e139b700 1 --2- 172.21.15.71:0/3920914070 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5dc150180 0x7fb5dc157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:27.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.983+0000 7fb5e0b9a700 1 --2- 172.21.15.71:0/3920914070 >> v2:172.21.15.179:3300/0 conn(0x7fb5dc150550 0x7fb5dc0c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:27.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.983+0000 7fb5d3fff700 1 -- 172.21.15.71:0/3920914070 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30181831 0 0) 0x7fb5dc06e2a0 con 0x7fb5dc0c7240 2023-10-09T08:17:27.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.983+0000 7fb5d3fff700 1 -- 172.21.15.71:0/3920914070 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5c8003570 con 0x7fb5dc0c7240 2023-10-09T08:17:27.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.984+0000 7fb5e139b700 1 -- 172.21.15.71:0/3920914070 >> v2:172.21.15.179:3300/0 conn(0x7fb5dc150550 msgr2=0x7fb5dc0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:27.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.984+0000 7fb5e139b700 1 --2- 172.21.15.71:0/3920914070 >> v2:172.21.15.179:3300/0 conn(0x7fb5dc150550 0x7fb5dc0c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.984+0000 7fb5e139b700 1 -- 172.21.15.71:0/3920914070 >> v1:172.21.15.71:6789/0 conn(0x7fb5dc0c7240 legacy=0x7fb5dc06e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:27.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.984+0000 7fb5e139b700 1 -- 172.21.15.71:0/3920914070 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc0c78e0 con 0x7fb5dc150180 2023-10-09T08:17:27.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.984+0000 7fb5e0b9a700 1 --2- 172.21.15.71:0/3920914070 >> v2:172.21.15.179:3300/0 conn(0x7fb5dc150550 0x7fb5dc0c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:27.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.984+0000 7fb5e139b700 1 --2- 172.21.15.71:0/3920914070 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5dc150180 0x7fb5dc157770 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb5d80098e0 tx=0x7fb5d80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6ac72d42c9f098f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:27.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.984+0000 7fb5d3fff700 1 -- 172.21.15.71:0/3920914070 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d800f6b0 con 0x7fb5dc150180 2023-10-09T08:17:27.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.984+0000 7fb5d3fff700 1 -- 172.21.15.71:0/3920914070 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d800f810 con 0x7fb5dc150180 2023-10-09T08:17:27.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.984+0000 7fb5d3fff700 1 -- 172.21.15.71:0/3920914070 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d800fbb0 con 0x7fb5dc150180 2023-10-09T08:17:27.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.985+0000 7fb5e239d700 1 -- 172.21.15.71:0/3920914070 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5dc150180 msgr2=0x7fb5dc157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:27.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.985+0000 7fb5e239d700 1 --2- 172.21.15.71:0/3920914070 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5dc150180 0x7fb5dc157770 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb5d80098e0 tx=0x7fb5d80091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.985+0000 7fb5e239d700 1 -- 172.21.15.71:0/3920914070 shutdown_connections 2023-10-09T08:17:27.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.985+0000 7fb5e239d700 1 --2- 172.21.15.71:0/3920914070 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5dc150180 0x7fb5dc157770 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.985+0000 7fb5e239d700 1 --2- 172.21.15.71:0/3920914070 >> v2:172.21.15.179:3300/0 conn(0x7fb5dc150550 0x7fb5dc0c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.985+0000 7fb5e239d700 1 -- 172.21.15.71:0/3920914070 >> 172.21.15.71:0/3920914070 conn(0x7fb5dc0cc1f0 msgr2=0x7fb5dc0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:27.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.985+0000 7fb5e239d700 1 -- 172.21.15.71:0/3920914070 shutdown_connections 2023-10-09T08:17:27.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.985+0000 7fb5e239d700 1 -- 172.21.15.71:0/3920914070 wait complete. 2023-10-09T08:17:27.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.986+0000 7fb5e239d700 1 Processor -- start 2023-10-09T08:17:27.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.986+0000 7fb5e239d700 1 -- start start 2023-10-09T08:17:27.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.987+0000 7fb5e239d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5dc0c7240 0x7fb5dc0c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:27.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.987+0000 7fb5e239d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5dc150180 0x7fb5dc0c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:27.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.987+0000 7fb5e239d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5dc150550 0x7fb5dc0c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:27.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.987+0000 7fb5e239d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0c57a0 con 0x7fb5dc150180 2023-10-09T08:17:27.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.987+0000 7fb5e239d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0c5a80 con 0x7fb5dc150550 2023-10-09T08:17:27.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.987+0000 7fb5e239d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0c5d60 con 0x7fb5dc0c7240 2023-10-09T08:17:27.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.987+0000 7fb5e0b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5dc150180 0x7fb5dc0c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:27.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.987+0000 7fb5e0b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5dc150180 0x7fb5dc0c8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48228/0 (socket says 172.21.15.71:48228) 2023-10-09T08:17:27.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.987+0000 7fb5e0b9a700 1 -- 172.21.15.71:0/2301466622 learned_addr learned my addr 172.21.15.71:0/2301466622 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:27.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.988+0000 7fb5e1b9c700 1 --2- 172.21.15.71:0/2301466622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5dc150550 0x7fb5dc0c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:27.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.988+0000 7fb5e139b700 1 --2- 172.21.15.71:0/2301466622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5dc0c7240 0x7fb5dc0c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:27.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.988+0000 7fb5e0b9a700 1 -- 172.21.15.71:0/2301466622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5dc0c7240 msgr2=0x7fb5dc0c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:27.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.988+0000 7fb5e0b9a700 1 --2- 172.21.15.71:0/2301466622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5dc0c7240 0x7fb5dc0c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.988+0000 7fb5e0b9a700 1 -- 172.21.15.71:0/2301466622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5dc150550 msgr2=0x7fb5dc0c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:27.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.988+0000 7fb5e0b9a700 1 --2- 172.21.15.71:0/2301466622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5dc150550 0x7fb5dc0c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:27.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.988+0000 7fb5e0b9a700 1 -- 172.21.15.71:0/2301466622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5cc009420 con 0x7fb5dc150180 2023-10-09T08:17:27.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.988+0000 7fb5e139b700 1 --2- 172.21.15.71:0/2301466622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5dc0c7240 0x7fb5dc0c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:27.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.988+0000 7fb5e1b9c700 1 --2- 172.21.15.71:0/2301466622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5dc150550 0x7fb5dc0c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:27.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.988+0000 7fb5e0b9a700 1 --2- 172.21.15.71:0/2301466622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5dc150180 0x7fb5dc0c8c60 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00ec80 tx=0x7fb5cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:27.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.988+0000 7fb5d17fa700 1 -- 172.21.15.71:0/2301466622 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc00c9d0 con 0x7fb5dc150180 2023-10-09T08:17:27.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.988+0000 7fb5d17fa700 1 -- 172.21.15.71:0/2301466622 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5cc00cb30 con 0x7fb5dc150180 2023-10-09T08:17:27.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.988+0000 7fb5e239d700 1 -- 172.21.15.71:0/2301466622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d8009420 con 0x7fb5dc150180 2023-10-09T08:17:27.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.988+0000 7fb5d17fa700 1 -- 172.21.15.71:0/2301466622 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc00ceb0 con 0x7fb5dc150180 2023-10-09T08:17:27.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.989+0000 7fb5e239d700 1 -- 172.21.15.71:0/2301466622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5dc0c6320 con 0x7fb5dc150180 2023-10-09T08:17:27.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.990+0000 7fb5e239d700 1 -- 172.21.15.71:0/2301466622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5dc04c3c0 con 0x7fb5dc150180 2023-10-09T08:17:27.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.990+0000 7fb5d17fa700 1 -- 172.21.15.71:0/2301466622 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb5cc013680 con 0x7fb5dc150180 2023-10-09T08:17:27.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.991+0000 7fb5d17fa700 1 --2- 172.21.15.71:0/2301466622 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb5c0066f30 0x7fb5c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.991+0000 7fb5d17fa700 1 -- 172.21.15.71:0/2301466622 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6225+0+0 (secure 0 0 0) 0x7fb5cc084b80 con 0x7fb5dc150180 2023-10-09T08:17:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.992+0000 7fb5e139b700 1 --2- 172.21.15.71:0/2301466622 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb5c0066f30 0x7fb5c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.992+0000 7fb5e139b700 1 --2- 172.21.15.71:0/2301466622 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb5c0066f30 0x7fb5c00693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb5d80093c0 tx=0x7fb5d8019000 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:27.995+0000 7fb5d17fa700 1 -- 172.21.15.71:0/2301466622 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5cc051b40 con 0x7fb5dc150180 2023-10-09T08:17:28.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.184+0000 7fb5e239d700 1 -- 172.21.15.71:0/2301466622 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5dc14a5c0 con 0x7fb5c0066f30 2023-10-09T08:17:28.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.193+0000 7fb5d17fa700 1 -- 172.21.15.71:0/2301466622 <== mgr.9427 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286936 (secure 0 0 0) 0x7fb5dc14a5c0 con 0x7fb5c0066f30 2023-10-09T08:17:28.197 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:28.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.197+0000 7fb5e239d700 1 -- 172.21.15.71:0/2301466622 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb5c0066f30 msgr2=0x7fb5c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:28.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.197+0000 7fb5e239d700 1 --2- 172.21.15.71:0/2301466622 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb5c0066f30 0x7fb5c00693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb5d80093c0 tx=0x7fb5d8019000 comp rx=0 tx=0).stop 2023-10-09T08:17:28.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.197+0000 7fb5e239d700 1 -- 172.21.15.71:0/2301466622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5dc150180 msgr2=0x7fb5dc0c8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:28.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.197+0000 7fb5e239d700 1 --2- 172.21.15.71:0/2301466622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5dc150180 0x7fb5dc0c8c60 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00ec80 tx=0x7fb5cc0091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.197+0000 7fb5e239d700 1 -- 172.21.15.71:0/2301466622 shutdown_connections 2023-10-09T08:17:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.197+0000 7fb5e239d700 1 --2- 172.21.15.71:0/2301466622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5dc150550 0x7fb5dc0c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.197+0000 7fb5e239d700 1 --2- 172.21.15.71:0/2301466622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5dc0c7240 0x7fb5dc0c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.197+0000 7fb5e239d700 1 --2- 172.21.15.71:0/2301466622 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb5c0066f30 0x7fb5c00693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.198+0000 7fb5e239d700 1 --2- 172.21.15.71:0/2301466622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5dc150180 0x7fb5dc0c8c60 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.198+0000 7fb5e239d700 1 -- 172.21.15.71:0/2301466622 >> 172.21.15.71:0/2301466622 conn(0x7fb5dc0cc1f0 msgr2=0x7fb5dc0c24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.198+0000 7fb5e239d700 1 -- 172.21.15.71:0/2301466622 shutdown_connections 2023-10-09T08:17:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.198+0000 7fb5e239d700 1 -- 172.21.15.71:0/2301466622 wait complete. 2023-10-09T08:17:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T08:17:28.215 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T08:17:26.214307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":620,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":383,"ondisk_log_size":383,"up":160,"acting":160,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2490100,"kb_used_data":21684,"kb_used_omap":0,"kb_used_meta":2468352,"kb_avail":752484620,"statfs":{"total":773094113280,"available":770544250880,"internally_reserved":0,"allocated":22204416,"data_stored":11758523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2527592448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.262430"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.988806+0000","last_change":"2023-10-09T08:17:22.987349+0000","last_active":"2023-10-09T08:17:22.988806+0000","last_peered":"2023-10-09T08:17:22.988806+0000","last_clean":"2023-10-09T08:17:22.988806+0000","last_became_active":"2023-10-09T08:17:22.987068+0000","last_became_peered":"2023-10-09T08:17:22.987068+0000","last_unstale":"2023-10-09T08:17:22.988806+0000","last_undegraded":"2023-10-09T08:17:22.988806+0000","last_fullsized":"2023-10-09T08:17:22.988806+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:32:31.652330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983385+0000","last_change":"2023-10-09T08:17:22.980482+0000","last_active":"2023-10-09T08:17:22.983385+0000","last_peered":"2023-10-09T08:17:22.983385+0000","last_clean":"2023-10-09T08:17:22.983385+0000","last_became_active":"2023-10-09T08:17:22.980162+0000","last_became_peered":"2023-10-09T08:17:22.980162+0000","last_unstale":"2023-10-09T08:17:22.983385+0000","last_undegraded":"2023-10-09T08:17:22.983385+0000","last_fullsized":"2023-10-09T08:17:22.983385+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:08:19.846565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982856+0000","last_change":"2023-10-09T08:17:22.978532+0000","last_active":"2023-10-09T08:17:22.982856+0000","last_peered":"2023-10-09T08:17:22.982856+0000","last_clean":"2023-10-09T08:17:22.982856+0000","last_became_active":"2023-10-09T08:17:22.978261+0000","last_became_peered":"2023-10-09T08:17:22.978261+0000","last_unstale":"2023-10-09T08:17:22.982856+0000","last_undegraded":"2023-10-09T08:17:22.982856+0000","last_fullsized":"2023-10-09T08:17:22.982856+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:02.562263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.981672+0000","last_change":"2023-10-09T08:17:22.978795+0000","last_active":"2023-10-09T08:17:22.981672+0000","last_peered":"2023-10-09T08:17:22.981672+0000","last_clean":"2023-10-09T08:17:22.981672+0000","last_became_active":"2023-10-09T08:17:22.978557+0000","last_became_peered":"2023-10-09T08:17:22.978557+0000","last_unstale":"2023-10-09T08:17:22.981672+0000","last_undegraded":"2023-10-09T08:17:22.981672+0000","last_fullsized":"2023-10-09T08:17:22.981672+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:19.484500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.984320+0000","last_change":"2023-10-09T08:17:22.981507+0000","last_active":"2023-10-09T08:17:22.984320+0000","last_peered":"2023-10-09T08:17:22.984320+0000","last_clean":"2023-10-09T08:17:22.984320+0000","last_became_active":"2023-10-09T08:17:22.981260+0000","last_became_peered":"2023-10-09T08:17:22.981260+0000","last_unstale":"2023-10-09T08:17:22.984320+0000","last_undegraded":"2023-10-09T08:17:22.984320+0000","last_fullsized":"2023-10-09T08:17:22.984320+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:32.306795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.971000+0000","last_change":"2023-10-09T08:17:22.967502+0000","last_active":"2023-10-09T08:17:22.971000+0000","last_peered":"2023-10-09T08:17:22.971000+0000","last_clean":"2023-10-09T08:17:22.971000+0000","last_became_active":"2023-10-09T08:17:22.967258+0000","last_became_peered":"2023-10-09T08:17:22.967258+0000","last_unstale":"2023-10-09T08:17:22.971000+0000","last_undegraded":"2023-10-09T08:17:22.971000+0000","last_fullsized":"2023-10-09T08:17:22.971000+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:02.453697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.988639+0000","last_change":"2023-10-09T08:17:22.983416+0000","last_active":"2023-10-09T08:17:22.988639+0000","last_peered":"2023-10-09T08:17:22.988639+0000","last_clean":"2023-10-09T08:17:22.988639+0000","last_became_active":"2023-10-09T08:17:22.981717+0000","last_became_peered":"2023-10-09T08:17:22.981717+0000","last_unstale":"2023-10-09T08:17:22.988639+0000","last_undegraded":"2023-10-09T08:17:22.988639+0000","last_fullsized":"2023-10-09T08:17:22.988639+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:51.687684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.984150+0000","last_change":"2023-10-09T08:17:22.979132+0000","last_active":"2023-10-09T08:17:22.984150+0000","last_peered":"2023-10-09T08:17:22.984150+0000","last_clean":"2023-10-09T08:17:22.984150+0000","last_became_active":"2023-10-09T08:17:22.978851+0000","last_became_peered":"2023-10-09T08:17:22.978851+0000","last_unstale":"2023-10-09T08:17:22.984150+0000","last_undegraded":"2023-10-09T08:17:22.984150+0000","last_fullsized":"2023-10-09T08:17:22.984150+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:49.270902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.971747+0000","last_change":"2023-10-09T08:17:22.968330+0000","last_active":"2023-10-09T08:17:22.971747+0000","last_peered":"2023-10-09T08:17:22.971747+0000","last_clean":"2023-10-09T08:17:22.971747+0000","last_became_active":"2023-10-09T08:17:22.968098+0000","last_became_peered":"2023-10-09T08:17:22.968098+0000","last_unstale":"2023-10-09T08:17:22.971747+0000","last_undegraded":"2023-10-09T08:17:22.971747+0000","last_fullsized":"2023-10-09T08:17:22.971747+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:26.390859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.992436+0000","last_change":"2023-10-09T08:17:22.987389+0000","last_active":"2023-10-09T08:17:22.992436+0000","last_peered":"2023-10-09T08:17:22.992436+0000","last_clean":"2023-10-09T08:17:22.992436+0000","last_became_active":"2023-10-09T08:17:22.987114+0000","last_became_peered":"2023-10-09T08:17:22.987114+0000","last_unstale":"2023-10-09T08:17:22.992436+0000","last_undegraded":"2023-10-09T08:17:22.992436+0000","last_fullsized":"2023-10-09T08:17:22.992436+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:50.692531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.986775+0000","last_change":"2023-10-09T08:17:22.983507+0000","last_active":"2023-10-09T08:17:22.986775+0000","last_peered":"2023-10-09T08:17:22.986775+0000","last_clean":"2023-10-09T08:17:22.986775+0000","last_became_active":"2023-10-09T08:17:22.983220+0000","last_became_peered":"2023-10-09T08:17:22.983220+0000","last_unstale":"2023-10-09T08:17:22.986775+0000","last_undegraded":"2023-10-09T08:17:22.986775+0000","last_fullsized":"2023-10-09T08:17:22.986775+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:43:41.322751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.991789+0000","last_change":"2023-10-09T08:17:22.987121+0000","last_active":"2023-10-09T08:17:22.991789+0000","last_peered":"2023-10-09T08:17:22.991789+0000","last_clean":"2023-10-09T08:17:22.991789+0000","last_became_active":"2023-10-09T08:17:22.986832+0000","last_became_peered":"2023-10-09T08:17:22.986832+0000","last_unstale":"2023-10-09T08:17:22.991789+0000","last_undegraded":"2023-10-09T08:17:22.991789+0000","last_fullsized":"2023-10-09T08:17:22.991789+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:42:42.958751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.990448+0000","last_change":"2023-10-09T08:17:22.986695+0000","last_active":"2023-10-09T08:17:22.990448+0000","last_peered":"2023-10-09T08:17:22.990448+0000","last_clean":"2023-10-09T08:17:22.990448+0000","last_became_active":"2023-10-09T08:17:22.986436+0000","last_became_peered":"2023-10-09T08:17:22.986436+0000","last_unstale":"2023-10-09T08:17:22.990448+0000","last_undegraded":"2023-10-09T08:17:22.990448+0000","last_fullsized":"2023-10-09T08:17:22.990448+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:39:24.985715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982837+0000","last_change":"2023-10-09T08:17:22.977788+0000","last_active":"2023-10-09T08:17:22.982837+0000","last_peered":"2023-10-09T08:17:22.982837+0000","last_clean":"2023-10-09T08:17:22.982837+0000","last_became_active":"2023-10-09T08:17:22.977521+0000","last_became_peered":"2023-10-09T08:17:22.977521+0000","last_unstale":"2023-10-09T08:17:22.982837+0000","last_undegraded":"2023-10-09T08:17:22.982837+0000","last_fullsized":"2023-10-09T08:17:22.982837+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:31.629347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.980841+0000","last_change":"2023-10-09T08:17:22.977049+0000","last_active":"2023-10-09T08:17:22.980841+0000","last_peered":"2023-10-09T08:17:22.980841+0000","last_clean":"2023-10-09T08:17:22.980841+0000","last_became_active":"2023-10-09T08:17:22.976779+0000","last_became_peered":"2023-10-09T08:17:22.976779+0000","last_unstale":"2023-10-09T08:17:22.980841+0000","last_undegraded":"2023-10-09T08:17:22.980841+0000","last_fullsized":"2023-10-09T08:17:22.980841+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:41.226637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.985723+0000","last_change":"2023-10-09T08:17:22.984732+0000","last_active":"2023-10-09T08:17:22.985723+0000","last_peered":"2023-10-09T08:17:22.985723+0000","last_clean":"2023-10-09T08:17:22.985723+0000","last_became_active":"2023-10-09T08:17:22.984481+0000","last_became_peered":"2023-10-09T08:17:22.984481+0000","last_unstale":"2023-10-09T08:17:22.985723+0000","last_undegraded":"2023-10-09T08:17:22.985723+0000","last_fullsized":"2023-10-09T08:17:22.985723+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:24:10.514407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983916+0000","last_change":"2023-10-09T08:17:22.974270+0000","last_active":"2023-10-09T08:17:22.983916+0000","last_peered":"2023-10-09T08:17:22.983916+0000","last_clean":"2023-10-09T08:17:22.983916+0000","last_became_active":"2023-10-09T08:17:22.974010+0000","last_became_peered":"2023-10-09T08:17:22.974010+0000","last_unstale":"2023-10-09T08:17:22.983916+0000","last_undegraded":"2023-10-09T08:17:22.983916+0000","last_fullsized":"2023-10-09T08:17:22.983916+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:10:24.260909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.985251+0000","last_change":"2023-10-09T08:17:22.983336+0000","last_active":"2023-10-09T08:17:22.985251+0000","last_peered":"2023-10-09T08:17:22.985251+0000","last_clean":"2023-10-09T08:17:22.985251+0000","last_became_active":"2023-10-09T08:17:22.983072+0000","last_became_peered":"2023-10-09T08:17:22.983072+0000","last_unstale":"2023-10-09T08:17:22.985251+0000","last_undegraded":"2023-10-09T08:17:22.985251+0000","last_fullsized":"2023-10-09T08:17:22.985251+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:04.142683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983367+0000","last_change":"2023-10-09T08:17:22.979452+0000","last_active":"2023-10-09T08:17:22.983367+0000","last_peered":"2023-10-09T08:17:22.983367+0000","last_clean":"2023-10-09T08:17:22.983367+0000","last_became_active":"2023-10-09T08:17:22.979151+0000","last_became_peered":"2023-10-09T08:17:22.979151+0000","last_unstale":"2023-10-09T08:17:22.983367+0000","last_undegraded":"2023-10-09T08:17:22.983367+0000","last_fullsized":"2023-10-09T08:17:22.983367+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:16:27.730608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.975230+0000","last_change":"2023-10-09T08:17:22.973609+0000","last_active":"2023-10-09T08:17:22.975230+0000","last_peered":"2023-10-09T08:17:22.975230+0000","last_clean":"2023-10-09T08:17:22.975230+0000","last_became_active":"2023-10-09T08:17:22.973223+0000","last_became_peered":"2023-10-09T08:17:22.973223+0000","last_unstale":"2023-10-09T08:17:22.975230+0000","last_undegraded":"2023-10-09T08:17:22.975230+0000","last_fullsized":"2023-10-09T08:17:22.975230+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:14.281969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983370+0000","last_change":"2023-10-09T08:17:22.982342+0000","last_active":"2023-10-09T08:17:22.983370+0000","last_peered":"2023-10-09T08:17:22.983370+0000","last_clean":"2023-10-09T08:17:22.983370+0000","last_became_active":"2023-10-09T08:17:22.982076+0000","last_became_peered":"2023-10-09T08:17:22.982076+0000","last_unstale":"2023-10-09T08:17:22.983370+0000","last_undegraded":"2023-10-09T08:17:22.983370+0000","last_fullsized":"2023-10-09T08:17:22.983370+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:17.661906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.973192+0000","last_change":"2023-10-09T08:17:22.969013+0000","last_active":"2023-10-09T08:17:22.973192+0000","last_peered":"2023-10-09T08:17:22.973192+0000","last_clean":"2023-10-09T08:17:22.973192+0000","last_became_active":"2023-10-09T08:17:22.968732+0000","last_became_peered":"2023-10-09T08:17:22.968732+0000","last_unstale":"2023-10-09T08:17:22.973192+0000","last_undegraded":"2023-10-09T08:17:22.973192+0000","last_fullsized":"2023-10-09T08:17:22.973192+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:38:56.087344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.972930+0000","last_change":"2023-10-09T08:17:22.971110+0000","last_active":"2023-10-09T08:17:22.972930+0000","last_peered":"2023-10-09T08:17:22.972930+0000","last_clean":"2023-10-09T08:17:22.972930+0000","last_became_active":"2023-10-09T08:17:22.970864+0000","last_became_peered":"2023-10-09T08:17:22.970864+0000","last_unstale":"2023-10-09T08:17:22.972930+0000","last_undegraded":"2023-10-09T08:17:22.972930+0000","last_fullsized":"2023-10-09T08:17:22.972930+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:35:13.889838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"209'4","reported_seq":14,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997902+0000","last_change":"2023-10-09T08:17:21.981359+0000","last_active":"2023-10-09T08:17:22.997902+0000","last_peered":"2023-10-09T08:17:22.997902+0000","last_clean":"2023-10-09T08:17:22.997902+0000","last_became_active":"2023-10-09T08:17:21.981080+0000","last_became_peered":"2023-10-09T08:17:21.981080+0000","last_unstale":"2023-10-09T08:17:22.997902+0000","last_undegraded":"2023-10-09T08:17:22.997902+0000","last_fullsized":"2023-10-09T08:17:22.997902+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:38.043951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.981880+0000","last_change":"2023-10-09T08:17:22.977736+0000","last_active":"2023-10-09T08:17:22.981880+0000","last_peered":"2023-10-09T08:17:22.981880+0000","last_clean":"2023-10-09T08:17:22.981880+0000","last_became_active":"2023-10-09T08:17:22.976851+0000","last_became_peered":"2023-10-09T08:17:22.976851+0000","last_unstale":"2023-10-09T08:17:22.981880+0000","last_undegraded":"2023-10-09T08:17:22.981880+0000","last_fullsized":"2023-10-09T08:17:22.981880+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:22:35.631994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:17:20.944684+0000","last_change":"2023-10-09T08:17:20.957900+0000","last_active":"2023-10-09T08:17:20.944684+0000","last_peered":"2023-10-09T08:17:20.944684+0000","last_clean":"2023-10-09T08:17:20.944684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:20.944684+0000","last_undegraded":"2023-10-09T08:17:20.944684+0000","last_fullsized":"2023-10-09T08:17:20.944684+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:31.300930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.974564+0000","last_change":"2023-10-09T08:17:22.970652+0000","last_active":"2023-10-09T08:17:22.974564+0000","last_peered":"2023-10-09T08:17:22.974564+0000","last_clean":"2023-10-09T08:17:22.974564+0000","last_became_active":"2023-10-09T08:17:22.970213+0000","last_became_peered":"2023-10-09T08:17:22.970213+0000","last_unstale":"2023-10-09T08:17:22.974564+0000","last_undegraded":"2023-10-09T08:17:22.974564+0000","last_fullsized":"2023-10-09T08:17:22.974564+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:44:06.711747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.995441+0000","last_change":"2023-10-09T08:17:21.973213+0000","last_active":"2023-10-09T08:17:22.995441+0000","last_peered":"2023-10-09T08:17:22.995441+0000","last_clean":"2023-10-09T08:17:22.995441+0000","last_became_active":"2023-10-09T08:17:21.972952+0000","last_became_peered":"2023-10-09T08:17:21.972952+0000","last_unstale":"2023-10-09T08:17:22.995441+0000","last_undegraded":"2023-10-09T08:17:22.995441+0000","last_fullsized":"2023-10-09T08:17:22.995441+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:28.933060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:17:20.944684+0000","last_change":"2023-10-09T08:17:20.958050+0000","last_active":"2023-10-09T08:17:20.944684+0000","last_peered":"2023-10-09T08:17:20.944684+0000","last_clean":"2023-10-09T08:17:20.944684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:20.944684+0000","last_undegraded":"2023-10-09T08:17:20.944684+0000","last_fullsized":"2023-10-09T08:17:20.944684+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:16.656042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.978894+0000","last_change":"2023-10-09T08:17:22.976545+0000","last_active":"2023-10-09T08:17:22.978894+0000","last_peered":"2023-10-09T08:17:22.978894+0000","last_clean":"2023-10-09T08:17:22.978894+0000","last_became_active":"2023-10-09T08:17:22.976305+0000","last_became_peered":"2023-10-09T08:17:22.976305+0000","last_unstale":"2023-10-09T08:17:22.978894+0000","last_undegraded":"2023-10-09T08:17:22.978894+0000","last_fullsized":"2023-10-09T08:17:22.978894+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:39.805879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"209'1","reported_seq":11,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997521+0000","last_change":"2023-10-09T08:17:21.979102+0000","last_active":"2023-10-09T08:17:22.997521+0000","last_peered":"2023-10-09T08:17:22.997521+0000","last_clean":"2023-10-09T08:17:22.997521+0000","last_became_active":"2023-10-09T08:17:21.977114+0000","last_became_peered":"2023-10-09T08:17:21.977114+0000","last_unstale":"2023-10-09T08:17:22.997521+0000","last_undegraded":"2023-10-09T08:17:22.997521+0000","last_fullsized":"2023-10-09T08:17:22.997521+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:59.752920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.972264+0000","last_change":"2023-10-09T08:17:22.968229+0000","last_active":"2023-10-09T08:17:22.972264+0000","last_peered":"2023-10-09T08:17:22.972264+0000","last_clean":"2023-10-09T08:17:22.972264+0000","last_became_active":"2023-10-09T08:17:22.967986+0000","last_became_peered":"2023-10-09T08:17:22.967986+0000","last_unstale":"2023-10-09T08:17:22.972264+0000","last_undegraded":"2023-10-09T08:17:22.972264+0000","last_fullsized":"2023-10-09T08:17:22.972264+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:30.679481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"209'1","reported_seq":11,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997465+0000","last_change":"2023-10-09T08:17:21.974938+0000","last_active":"2023-10-09T08:17:22.997465+0000","last_peered":"2023-10-09T08:17:22.997465+0000","last_clean":"2023-10-09T08:17:22.997465+0000","last_became_active":"2023-10-09T08:17:21.974701+0000","last_became_peered":"2023-10-09T08:17:21.974701+0000","last_unstale":"2023-10-09T08:17:22.997465+0000","last_undegraded":"2023-10-09T08:17:22.997465+0000","last_fullsized":"2023-10-09T08:17:22.997465+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:39:13.667615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.979263+0000","last_change":"2023-10-09T08:17:22.975840+0000","last_active":"2023-10-09T08:17:22.979263+0000","last_peered":"2023-10-09T08:17:22.979263+0000","last_clean":"2023-10-09T08:17:22.979263+0000","last_became_active":"2023-10-09T08:17:22.975564+0000","last_became_peered":"2023-10-09T08:17:22.975564+0000","last_unstale":"2023-10-09T08:17:22.979263+0000","last_undegraded":"2023-10-09T08:17:22.979263+0000","last_fullsized":"2023-10-09T08:17:22.979263+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:57:29.061415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.971606+0000","last_change":"2023-10-09T08:17:21.975736+0000","last_active":"2023-10-09T08:17:22.971606+0000","last_peered":"2023-10-09T08:17:22.971606+0000","last_clean":"2023-10-09T08:17:22.971606+0000","last_became_active":"2023-10-09T08:17:21.975485+0000","last_became_peered":"2023-10-09T08:17:21.975485+0000","last_unstale":"2023-10-09T08:17:22.971606+0000","last_undegraded":"2023-10-09T08:17:22.971606+0000","last_fullsized":"2023-10-09T08:17:22.971606+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:22.558736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.980865+0000","last_change":"2023-10-09T08:17:22.975094+0000","last_active":"2023-10-09T08:17:22.980865+0000","last_peered":"2023-10-09T08:17:22.980865+0000","last_clean":"2023-10-09T08:17:22.980865+0000","last_became_active":"2023-10-09T08:17:22.974826+0000","last_became_peered":"2023-10-09T08:17:22.974826+0000","last_unstale":"2023-10-09T08:17:22.980865+0000","last_undegraded":"2023-10-09T08:17:22.980865+0000","last_fullsized":"2023-10-09T08:17:22.980865+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:21.488090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.964826+0000","last_change":"2023-10-09T08:17:21.970071+0000","last_active":"2023-10-09T08:17:22.964826+0000","last_peered":"2023-10-09T08:17:22.964826+0000","last_clean":"2023-10-09T08:17:22.964826+0000","last_became_active":"2023-10-09T08:17:21.969809+0000","last_became_peered":"2023-10-09T08:17:21.969809+0000","last_unstale":"2023-10-09T08:17:22.964826+0000","last_undegraded":"2023-10-09T08:17:22.964826+0000","last_fullsized":"2023-10-09T08:17:22.964826+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:30.623483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.973746+0000","last_change":"2023-10-09T08:17:22.972774+0000","last_active":"2023-10-09T08:17:22.973746+0000","last_peered":"2023-10-09T08:17:22.973746+0000","last_clean":"2023-10-09T08:17:22.973746+0000","last_became_active":"2023-10-09T08:17:22.972520+0000","last_became_peered":"2023-10-09T08:17:22.972520+0000","last_unstale":"2023-10-09T08:17:22.973746+0000","last_undegraded":"2023-10-09T08:17:22.973746+0000","last_fullsized":"2023-10-09T08:17:22.973746+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:24.899441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.966427+0000","last_change":"2023-10-09T08:17:21.980454+0000","last_active":"2023-10-09T08:17:22.966427+0000","last_peered":"2023-10-09T08:17:22.966427+0000","last_clean":"2023-10-09T08:17:22.966427+0000","last_became_active":"2023-10-09T08:17:21.980212+0000","last_became_peered":"2023-10-09T08:17:21.980212+0000","last_unstale":"2023-10-09T08:17:22.966427+0000","last_undegraded":"2023-10-09T08:17:22.966427+0000","last_fullsized":"2023-10-09T08:17:22.966427+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:19.075882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.974546+0000","last_change":"2023-10-09T08:17:22.970468+0000","last_active":"2023-10-09T08:17:22.974546+0000","last_peered":"2023-10-09T08:17:22.974546+0000","last_clean":"2023-10-09T08:17:22.974546+0000","last_became_active":"2023-10-09T08:17:22.969789+0000","last_became_peered":"2023-10-09T08:17:22.969789+0000","last_unstale":"2023-10-09T08:17:22.974546+0000","last_undegraded":"2023-10-09T08:17:22.974546+0000","last_fullsized":"2023-10-09T08:17:22.974546+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:42.923655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"209'3","reported_seq":13,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.998217+0000","last_change":"2023-10-09T08:17:21.977462+0000","last_active":"2023-10-09T08:17:22.998217+0000","last_peered":"2023-10-09T08:17:22.998217+0000","last_clean":"2023-10-09T08:17:22.998217+0000","last_became_active":"2023-10-09T08:17:21.977059+0000","last_became_peered":"2023-10-09T08:17:21.977059+0000","last_unstale":"2023-10-09T08:17:22.998217+0000","last_undegraded":"2023-10-09T08:17:22.998217+0000","last_fullsized":"2023-10-09T08:17:22.998217+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:28.289402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.980213+0000","last_change":"2023-10-09T08:17:22.975853+0000","last_active":"2023-10-09T08:17:22.980213+0000","last_peered":"2023-10-09T08:17:22.980213+0000","last_clean":"2023-10-09T08:17:22.980213+0000","last_became_active":"2023-10-09T08:17:22.975560+0000","last_became_peered":"2023-10-09T08:17:22.975560+0000","last_unstale":"2023-10-09T08:17:22.980213+0000","last_undegraded":"2023-10-09T08:17:22.980213+0000","last_fullsized":"2023-10-09T08:17:22.980213+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:33:39.216798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"209'6","reported_seq":16,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.999925+0000","last_change":"2023-10-09T08:17:21.971926+0000","last_active":"2023-10-09T08:17:22.999925+0000","last_peered":"2023-10-09T08:17:22.999925+0000","last_clean":"2023-10-09T08:17:22.999925+0000","last_became_active":"2023-10-09T08:17:21.971645+0000","last_became_peered":"2023-10-09T08:17:21.971645+0000","last_unstale":"2023-10-09T08:17:22.999925+0000","last_undegraded":"2023-10-09T08:17:22.999925+0000","last_fullsized":"2023-10-09T08:17:22.999925+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:39:13.866505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.987320+0000","last_change":"2023-10-09T08:17:22.985018+0000","last_active":"2023-10-09T08:17:22.987320+0000","last_peered":"2023-10-09T08:17:22.987320+0000","last_clean":"2023-10-09T08:17:22.987320+0000","last_became_active":"2023-10-09T08:17:22.984647+0000","last_became_peered":"2023-10-09T08:17:22.984647+0000","last_unstale":"2023-10-09T08:17:22.987320+0000","last_undegraded":"2023-10-09T08:17:22.987320+0000","last_fullsized":"2023-10-09T08:17:22.987320+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:40:00.458280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997202+0000","last_change":"2023-10-09T08:17:21.975388+0000","last_active":"2023-10-09T08:17:22.997202+0000","last_peered":"2023-10-09T08:17:22.997202+0000","last_clean":"2023-10-09T08:17:22.997202+0000","last_became_active":"2023-10-09T08:17:21.974540+0000","last_became_peered":"2023-10-09T08:17:21.974540+0000","last_unstale":"2023-10-09T08:17:22.997202+0000","last_undegraded":"2023-10-09T08:17:22.997202+0000","last_fullsized":"2023-10-09T08:17:22.997202+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:39:02.110538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.984496+0000","last_change":"2023-10-09T08:17:22.982417+0000","last_active":"2023-10-09T08:17:22.984496+0000","last_peered":"2023-10-09T08:17:22.984496+0000","last_clean":"2023-10-09T08:17:22.984496+0000","last_became_active":"2023-10-09T08:17:22.982109+0000","last_became_peered":"2023-10-09T08:17:22.982109+0000","last_unstale":"2023-10-09T08:17:22.984496+0000","last_undegraded":"2023-10-09T08:17:22.984496+0000","last_fullsized":"2023-10-09T08:17:22.984496+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:46.160662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.967604+0000","last_change":"2023-10-09T08:17:21.981649+0000","last_active":"2023-10-09T08:17:22.967604+0000","last_peered":"2023-10-09T08:17:22.967604+0000","last_clean":"2023-10-09T08:17:22.967604+0000","last_became_active":"2023-10-09T08:17:21.981362+0000","last_became_peered":"2023-10-09T08:17:21.981362+0000","last_unstale":"2023-10-09T08:17:22.967604+0000","last_undegraded":"2023-10-09T08:17:22.967604+0000","last_fullsized":"2023-10-09T08:17:22.967604+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:03.261223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.961371+0000","last_change":"2023-10-09T08:17:21.976656+0000","last_active":"2023-10-09T08:17:22.961371+0000","last_peered":"2023-10-09T08:17:22.961371+0000","last_clean":"2023-10-09T08:17:22.961371+0000","last_became_active":"2023-10-09T08:17:21.976292+0000","last_became_peered":"2023-10-09T08:17:21.976292+0000","last_unstale":"2023-10-09T08:17:22.961371+0000","last_undegraded":"2023-10-09T08:17:22.961371+0000","last_fullsized":"2023-10-09T08:17:22.961371+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:00:59.557712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983496+0000","last_change":"2023-10-09T08:17:22.979323+0000","last_active":"2023-10-09T08:17:22.983496+0000","last_peered":"2023-10-09T08:17:22.983496+0000","last_clean":"2023-10-09T08:17:22.983496+0000","last_became_active":"2023-10-09T08:17:22.972209+0000","last_became_peered":"2023-10-09T08:17:22.972209+0000","last_unstale":"2023-10-09T08:17:22.983496+0000","last_undegraded":"2023-10-09T08:17:22.983496+0000","last_fullsized":"2023-10-09T08:17:22.983496+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:40.009878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"209'8","reported_seq":18,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.998098+0000","last_change":"2023-10-09T08:17:21.975369+0000","last_active":"2023-10-09T08:17:22.998098+0000","last_peered":"2023-10-09T08:17:22.998098+0000","last_clean":"2023-10-09T08:17:22.998098+0000","last_became_active":"2023-10-09T08:17:21.974853+0000","last_became_peered":"2023-10-09T08:17:21.974853+0000","last_unstale":"2023-10-09T08:17:22.998098+0000","last_undegraded":"2023-10-09T08:17:22.998098+0000","last_fullsized":"2023-10-09T08:17:22.998098+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:50.234694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.991744+0000","last_change":"2023-10-09T08:17:22.988118+0000","last_active":"2023-10-09T08:17:22.991744+0000","last_peered":"2023-10-09T08:17:22.991744+0000","last_clean":"2023-10-09T08:17:22.991744+0000","last_became_active":"2023-10-09T08:17:22.987859+0000","last_became_peered":"2023-10-09T08:17:22.987859+0000","last_unstale":"2023-10-09T08:17:22.991744+0000","last_undegraded":"2023-10-09T08:17:22.991744+0000","last_fullsized":"2023-10-09T08:17:22.991744+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:09:01.740678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"209'1","reported_seq":11,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997761+0000","last_change":"2023-10-09T08:17:21.977355+0000","last_active":"2023-10-09T08:17:22.997761+0000","last_peered":"2023-10-09T08:17:22.997761+0000","last_clean":"2023-10-09T08:17:22.997761+0000","last_became_active":"2023-10-09T08:17:21.977044+0000","last_became_peered":"2023-10-09T08:17:21.977044+0000","last_unstale":"2023-10-09T08:17:22.997761+0000","last_undegraded":"2023-10-09T08:17:22.997761+0000","last_fullsized":"2023-10-09T08:17:22.997761+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:35:04.782620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.996822+0000","last_change":"2023-10-09T08:17:21.974199+0000","last_active":"2023-10-09T08:17:22.996822+0000","last_peered":"2023-10-09T08:17:22.996822+0000","last_clean":"2023-10-09T08:17:22.996822+0000","last_became_active":"2023-10-09T08:17:21.973943+0000","last_became_peered":"2023-10-09T08:17:21.973943+0000","last_unstale":"2023-10-09T08:17:22.996822+0000","last_undegraded":"2023-10-09T08:17:22.996822+0000","last_fullsized":"2023-10-09T08:17:22.996822+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:56.455448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"209'1","reported_seq":11,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997076+0000","last_change":"2023-10-09T08:17:21.975063+0000","last_active":"2023-10-09T08:17:22.997076+0000","last_peered":"2023-10-09T08:17:22.997076+0000","last_clean":"2023-10-09T08:17:22.997076+0000","last_became_active":"2023-10-09T08:17:21.974796+0000","last_became_peered":"2023-10-09T08:17:21.974796+0000","last_unstale":"2023-10-09T08:17:22.997076+0000","last_undegraded":"2023-10-09T08:17:22.997076+0000","last_fullsized":"2023-10-09T08:17:22.997076+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:23.082491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.964704+0000","last_change":"2023-10-09T08:17:21.972751+0000","last_active":"2023-10-09T08:17:22.964704+0000","last_peered":"2023-10-09T08:17:22.964704+0000","last_clean":"2023-10-09T08:17:22.964704+0000","last_became_active":"2023-10-09T08:17:21.972437+0000","last_became_peered":"2023-10-09T08:17:21.972437+0000","last_unstale":"2023-10-09T08:17:22.964704+0000","last_undegraded":"2023-10-09T08:17:22.964704+0000","last_fullsized":"2023-10-09T08:17:22.964704+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:38:55.081479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.980862+0000","last_change":"2023-10-09T08:17:22.977458+0000","last_active":"2023-10-09T08:17:22.980862+0000","last_peered":"2023-10-09T08:17:22.980862+0000","last_clean":"2023-10-09T08:17:22.980862+0000","last_became_active":"2023-10-09T08:17:22.976833+0000","last_became_peered":"2023-10-09T08:17:22.976833+0000","last_unstale":"2023-10-09T08:17:22.980862+0000","last_undegraded":"2023-10-09T08:17:22.980862+0000","last_fullsized":"2023-10-09T08:17:22.980862+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:52.374897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.993473+0000","last_change":"2023-10-09T08:17:21.981403+0000","last_active":"2023-10-09T08:17:22.993473+0000","last_peered":"2023-10-09T08:17:22.993473+0000","last_clean":"2023-10-09T08:17:22.993473+0000","last_became_active":"2023-10-09T08:17:21.981161+0000","last_became_peered":"2023-10-09T08:17:21.981161+0000","last_unstale":"2023-10-09T08:17:22.993473+0000","last_undegraded":"2023-10-09T08:17:22.993473+0000","last_fullsized":"2023-10-09T08:17:22.993473+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:27.699996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.974523+0000","last_change":"2023-10-09T08:17:22.971091+0000","last_active":"2023-10-09T08:17:22.974523+0000","last_peered":"2023-10-09T08:17:22.974523+0000","last_clean":"2023-10-09T08:17:22.974523+0000","last_became_active":"2023-10-09T08:17:22.970841+0000","last_became_peered":"2023-10-09T08:17:22.970841+0000","last_unstale":"2023-10-09T08:17:22.974523+0000","last_undegraded":"2023-10-09T08:17:22.974523+0000","last_fullsized":"2023-10-09T08:17:22.974523+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:03:06.011485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.964325+0000","last_change":"2023-10-09T08:17:21.975152+0000","last_active":"2023-10-09T08:17:22.964325+0000","last_peered":"2023-10-09T08:17:22.964325+0000","last_clean":"2023-10-09T08:17:22.964325+0000","last_became_active":"2023-10-09T08:17:21.974892+0000","last_became_peered":"2023-10-09T08:17:21.974892+0000","last_unstale":"2023-10-09T08:17:22.964325+0000","last_undegraded":"2023-10-09T08:17:22.964325+0000","last_fullsized":"2023-10-09T08:17:22.964325+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:27.291932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.965212+0000","last_change":"2023-10-09T08:17:21.980816+0000","last_active":"2023-10-09T08:17:22.965212+0000","last_peered":"2023-10-09T08:17:22.965212+0000","last_clean":"2023-10-09T08:17:22.965212+0000","last_became_active":"2023-10-09T08:17:21.980578+0000","last_became_peered":"2023-10-09T08:17:21.980578+0000","last_unstale":"2023-10-09T08:17:22.965212+0000","last_undegraded":"2023-10-09T08:17:22.965212+0000","last_fullsized":"2023-10-09T08:17:22.965212+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:47.769934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.992100+0000","last_change":"2023-10-09T08:17:22.987538+0000","last_active":"2023-10-09T08:17:22.992100+0000","last_peered":"2023-10-09T08:17:22.992100+0000","last_clean":"2023-10-09T08:17:22.992100+0000","last_became_active":"2023-10-09T08:17:22.987276+0000","last_became_peered":"2023-10-09T08:17:22.987276+0000","last_unstale":"2023-10-09T08:17:22.992100+0000","last_undegraded":"2023-10-09T08:17:22.992100+0000","last_fullsized":"2023-10-09T08:17:22.992100+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:11.081055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:17:20.944684+0000","last_change":"2023-10-09T08:17:20.957350+0000","last_active":"2023-10-09T08:17:20.944684+0000","last_peered":"2023-10-09T08:17:20.944684+0000","last_clean":"2023-10-09T08:17:20.944684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:20.944684+0000","last_undegraded":"2023-10-09T08:17:20.944684+0000","last_fullsized":"2023-10-09T08:17:20.944684+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:48.265038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.979856+0000","last_change":"2023-10-09T08:17:22.976521+0000","last_active":"2023-10-09T08:17:22.979856+0000","last_peered":"2023-10-09T08:17:22.979856+0000","last_clean":"2023-10-09T08:17:22.979856+0000","last_became_active":"2023-10-09T08:17:22.976267+0000","last_became_peered":"2023-10-09T08:17:22.976267+0000","last_unstale":"2023-10-09T08:17:22.979856+0000","last_undegraded":"2023-10-09T08:17:22.979856+0000","last_fullsized":"2023-10-09T08:17:22.979856+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:51.085786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.995515+0000","last_change":"2023-10-09T08:17:21.978738+0000","last_active":"2023-10-09T08:17:22.995515+0000","last_peered":"2023-10-09T08:17:22.995515+0000","last_clean":"2023-10-09T08:17:22.995515+0000","last_became_active":"2023-10-09T08:17:21.978434+0000","last_became_peered":"2023-10-09T08:17:21.978434+0000","last_unstale":"2023-10-09T08:17:22.995515+0000","last_undegraded":"2023-10-09T08:17:22.995515+0000","last_fullsized":"2023-10-09T08:17:22.995515+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:18:28.973275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.985726+0000","last_change":"2023-10-09T08:17:22.981798+0000","last_active":"2023-10-09T08:17:22.985726+0000","last_peered":"2023-10-09T08:17:22.985726+0000","last_clean":"2023-10-09T08:17:22.985726+0000","last_became_active":"2023-10-09T08:17:22.981558+0000","last_became_peered":"2023-10-09T08:17:22.981558+0000","last_unstale":"2023-10-09T08:17:22.985726+0000","last_undegraded":"2023-10-09T08:17:22.985726+0000","last_fullsized":"2023-10-09T08:17:22.985726+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:56:15.613249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.969647+0000","last_change":"2023-10-09T08:17:21.970119+0000","last_active":"2023-10-09T08:17:22.969647+0000","last_peered":"2023-10-09T08:17:22.969647+0000","last_clean":"2023-10-09T08:17:22.969647+0000","last_became_active":"2023-10-09T08:17:21.969872+0000","last_became_peered":"2023-10-09T08:17:21.969872+0000","last_unstale":"2023-10-09T08:17:22.969647+0000","last_undegraded":"2023-10-09T08:17:22.969647+0000","last_fullsized":"2023-10-09T08:17:22.969647+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:50.234694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983970+0000","last_change":"2023-10-09T08:17:22.974514+0000","last_active":"2023-10-09T08:17:22.983970+0000","last_peered":"2023-10-09T08:17:22.983970+0000","last_clean":"2023-10-09T08:17:22.983970+0000","last_became_active":"2023-10-09T08:17:22.974268+0000","last_became_peered":"2023-10-09T08:17:22.974268+0000","last_unstale":"2023-10-09T08:17:22.983970+0000","last_undegraded":"2023-10-09T08:17:22.983970+0000","last_fullsized":"2023-10-09T08:17:22.983970+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:04.267087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.969883+0000","last_change":"2023-10-09T08:17:21.969312+0000","last_active":"2023-10-09T08:17:22.969883+0000","last_peered":"2023-10-09T08:17:22.969883+0000","last_clean":"2023-10-09T08:17:22.969883+0000","last_became_active":"2023-10-09T08:17:21.969051+0000","last_became_peered":"2023-10-09T08:17:21.969051+0000","last_unstale":"2023-10-09T08:17:22.969883+0000","last_undegraded":"2023-10-09T08:17:22.969883+0000","last_fullsized":"2023-10-09T08:17:22.969883+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:22.558736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.984369+0000","last_change":"2023-10-09T08:17:22.982056+0000","last_active":"2023-10-09T08:17:22.984369+0000","last_peered":"2023-10-09T08:17:22.984369+0000","last_clean":"2023-10-09T08:17:22.984369+0000","last_became_active":"2023-10-09T08:17:22.981764+0000","last_became_peered":"2023-10-09T08:17:22.981764+0000","last_unstale":"2023-10-09T08:17:22.984369+0000","last_undegraded":"2023-10-09T08:17:22.984369+0000","last_fullsized":"2023-10-09T08:17:22.984369+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:47.563936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.961506+0000","last_change":"2023-10-09T08:17:21.973015+0000","last_active":"2023-10-09T08:17:22.961506+0000","last_peered":"2023-10-09T08:17:22.961506+0000","last_clean":"2023-10-09T08:17:22.961506+0000","last_became_active":"2023-10-09T08:17:21.972770+0000","last_became_peered":"2023-10-09T08:17:21.972770+0000","last_unstale":"2023-10-09T08:17:22.961506+0000","last_undegraded":"2023-10-09T08:17:22.961506+0000","last_fullsized":"2023-10-09T08:17:22.961506+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:20.745815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982691+0000","last_change":"2023-10-09T08:17:22.977908+0000","last_active":"2023-10-09T08:17:22.982691+0000","last_peered":"2023-10-09T08:17:22.982691+0000","last_clean":"2023-10-09T08:17:22.982691+0000","last_became_active":"2023-10-09T08:17:22.977612+0000","last_became_peered":"2023-10-09T08:17:22.977612+0000","last_unstale":"2023-10-09T08:17:22.982691+0000","last_undegraded":"2023-10-09T08:17:22.982691+0000","last_fullsized":"2023-10-09T08:17:22.982691+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:23.588826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:17:20.944684+0000","last_change":"2023-10-09T08:17:20.957339+0000","last_active":"2023-10-09T08:17:20.944684+0000","last_peered":"2023-10-09T08:17:20.944684+0000","last_clean":"2023-10-09T08:17:20.944684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:20.944684+0000","last_undegraded":"2023-10-09T08:17:20.944684+0000","last_fullsized":"2023-10-09T08:17:20.944684+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:03.136819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982978+0000","last_change":"2023-10-09T08:17:22.978269+0000","last_active":"2023-10-09T08:17:22.982978+0000","last_peered":"2023-10-09T08:17:22.982978+0000","last_clean":"2023-10-09T08:17:22.982978+0000","last_became_active":"2023-10-09T08:17:22.977903+0000","last_became_peered":"2023-10-09T08:17:22.977903+0000","last_unstale":"2023-10-09T08:17:22.982978+0000","last_undegraded":"2023-10-09T08:17:22.982978+0000","last_fullsized":"2023-10-09T08:17:22.982978+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:44.655055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:17:20.944684+0000","last_change":"2023-10-09T08:17:20.957386+0000","last_active":"2023-10-09T08:17:20.944684+0000","last_peered":"2023-10-09T08:17:20.944684+0000","last_clean":"2023-10-09T08:17:20.944684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:20.944684+0000","last_undegraded":"2023-10-09T08:17:20.944684+0000","last_fullsized":"2023-10-09T08:17:20.944684+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:45.154798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T08:17:21.950548+0000","last_change":"2023-10-09T08:17:21.950548+0000","last_active":"2023-10-09T08:17:21.950548+0000","last_peered":"2023-10-09T08:17:21.950548+0000","last_clean":"2023-10-09T08:17:21.950548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:21.950548+0000","last_undegraded":"2023-10-09T08:17:21.950548+0000","last_fullsized":"2023-10-09T08:17:21.950548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T08:17:20.944684+0000","last_change":"2023-10-09T08:17:20.958011+0000","last_active":"2023-10-09T08:17:20.944684+0000","last_peered":"2023-10-09T08:17:20.944684+0000","last_clean":"2023-10-09T08:17:20.944684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T08:17:20.944684+0000","last_undegraded":"2023-10-09T08:17:20.944684+0000","last_fullsized":"2023-10-09T08:17:20.944684+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:39:59.452415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.979826+0000","last_change":"2023-10-09T08:17:22.975859+0000","last_active":"2023-10-09T08:17:22.979826+0000","last_peered":"2023-10-09T08:17:22.979826+0000","last_clean":"2023-10-09T08:17:22.979826+0000","last_became_active":"2023-10-09T08:17:22.975613+0000","last_became_peered":"2023-10-09T08:17:22.975613+0000","last_unstale":"2023-10-09T08:17:22.979826+0000","last_undegraded":"2023-10-09T08:17:22.979826+0000","last_fullsized":"2023-10-09T08:17:22.979826+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:58.570422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.965128+0000","last_change":"2023-10-09T08:17:21.980259+0000","last_active":"2023-10-09T08:17:22.965128+0000","last_peered":"2023-10-09T08:17:22.965128+0000","last_clean":"2023-10-09T08:17:22.965128+0000","last_became_active":"2023-10-09T08:17:21.980015+0000","last_became_peered":"2023-10-09T08:17:21.980015+0000","last_unstale":"2023-10-09T08:17:22.965128+0000","last_undegraded":"2023-10-09T08:17:22.965128+0000","last_fullsized":"2023-10-09T08:17:22.965128+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:23:19.929532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.988548+0000","last_change":"2023-10-09T08:17:22.983916+0000","last_active":"2023-10-09T08:17:22.988548+0000","last_peered":"2023-10-09T08:17:22.988548+0000","last_clean":"2023-10-09T08:17:22.988548+0000","last_became_active":"2023-10-09T08:17:22.983658+0000","last_became_peered":"2023-10-09T08:17:22.983658+0000","last_unstale":"2023-10-09T08:17:22.988548+0000","last_undegraded":"2023-10-09T08:17:22.988548+0000","last_fullsized":"2023-10-09T08:17:22.988548+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:28.109789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.969899+0000","last_change":"2023-10-09T08:17:21.976803+0000","last_active":"2023-10-09T08:17:22.969899+0000","last_peered":"2023-10-09T08:17:22.969899+0000","last_clean":"2023-10-09T08:17:22.969899+0000","last_became_active":"2023-10-09T08:17:21.976538+0000","last_became_peered":"2023-10-09T08:17:21.976538+0000","last_unstale":"2023-10-09T08:17:22.969899+0000","last_undegraded":"2023-10-09T08:17:22.969899+0000","last_fullsized":"2023-10-09T08:17:22.969899+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:03.261223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"199'348","reported_seq":1143,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.971832+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T08:17:22.971832+0000","last_peered":"2023-10-09T08:17:22.971832+0000","last_clean":"2023-10-09T08:17:22.971832+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T08:17:22.971832+0000","last_undegraded":"2023-10-09T08:17:22.971832+0000","last_fullsized":"2023-10-09T08:17:22.971832+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":94,"acting":94,"num_store_stats":6},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575974,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312732,"kb_used_data":3156,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059108,"statfs":{"total":96636764160,"available":96316526592,"internally_reserved":0,"allocated":3231744,"data_stored":1918128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.57999999999999996,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":0.98599999999999999,"5min":0.98699999999999999,"15min":1.1220000000000001},"last":0.752},{"interface":"front","average":{"1min":0.751,"5min":0.73999999999999999,"15min":0.749},"min":{"1min":0.64200000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86299999999999999,"5min":1.0069999999999999,"15min":1.0209999999999999},"last":0.68000000000000005}]},{"osd":1,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.65400000000000003,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":0.92900000000000005,"5min":1.28,"15min":1.28},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.74099999999999999,"15min":0.75},"min":{"1min":0.55900000000000005,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89100000000000001,"5min":1.298,"15min":1.298},"last":0.70599999999999996}]},{"osd":2,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.747,"15min":0.753},"min":{"1min":0.57699999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94899999999999995,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76500000000000001,"15min":0.77000000000000002},"min":{"1min":0.64500000000000002,"5min":0.49299999999999999,"15min":0.442},"max":{"1min":0.879,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.73499999999999999}]},{"osd":3,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.73899999999999999,"15min":0.73999999999999999},"min":{"1min":0.56100000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92600000000000005,"5min":1.399,"15min":1.399},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78100000000000003,"15min":0.77700000000000002},"min":{"1min":0.61499999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95599999999999996,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.62,"15min":0.60599999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38300000000000001},"max":{"1min":0.83299999999999996,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63900000000000001,"15min":0.628},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.38600000000000001},"max":{"1min":0.78500000000000003,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.498}]},{"osd":5,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65100000000000002,"15min":0.64600000000000002},"min":{"1min":0.46899999999999997,"5min":0.39400000000000002,"15min":0.376},"max":{"1min":0.81899999999999995,"5min":1.413,"15min":1.413},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.51400000000000001,"5min":0.41699999999999998,"15min":0.40100000000000002},"max":{"1min":0.90300000000000002,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.58199999999999996}]},{"osd":6,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74399999999999999,"15min":0.73799999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.48199999999999998},"max":{"1min":0.89400000000000002,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.70999999999999996,"15min":0.70499999999999996},"min":{"1min":0.499,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":0.85099999999999998,"5min":1.595,"15min":1.595},"last":0.59999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316192,"kb_used_data":2520,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055648,"statfs":{"total":96636764160,"available":96312983552,"internally_reserved":0,"allocated":2580480,"data_stored":1300457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76600000000000001,"15min":0.746},"min":{"1min":0.51300000000000001,"5min":0.46899999999999997,"15min":0.40300000000000002},"max":{"1min":0.92600000000000005,"5min":0.99299999999999999,"15min":1.0189999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.73799999999999999,"15min":0.73099999999999998},"min":{"1min":0.67300000000000004,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94099999999999995,"5min":0.96299999999999997,"15min":0.97399999999999998},"last":0.59299999999999997}]},{"osd":1,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.748,"15min":0.751},"min":{"1min":0.50900000000000001,"5min":0.45300000000000001,"15min":0.38500000000000001},"max":{"1min":0.90900000000000003,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78200000000000003,"15min":0.76400000000000001},"min":{"1min":0.56999999999999995,"5min":0.44,"15min":0.44},"max":{"1min":0.95899999999999996,"5min":1.0269999999999999,"15min":1.097},"last":0.56299999999999994}]},{"osd":2,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77000000000000002,"15min":0.75800000000000001},"min":{"1min":0.60799999999999998,"5min":0.495,"15min":0.46400000000000002},"max":{"1min":0.92000000000000004,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.76700000000000002,"15min":0.77300000000000002},"min":{"1min":0.58499999999999996,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":0.97699999999999998,"5min":1.0429999999999999,"15min":1.0660000000000001},"last":0.63300000000000001}]},{"osd":3,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.57999999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.89700000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.79700000000000004,"15min":0.78900000000000003},"min":{"1min":0.64000000000000001,"5min":0.54100000000000004,"15min":0.49299999999999999},"max":{"1min":0.97999999999999998,"5min":1.119,"15min":1.119},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.64700000000000002,"15min":0.63800000000000001},"min":{"1min":0.45800000000000002,"5min":0.44700000000000001,"15min":0.40200000000000002},"max":{"1min":0.82499999999999996,"5min":1.0149999999999999,"15min":1.1339999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.64400000000000002,"15min":0.63700000000000001},"min":{"1min":0.47999999999999998,"5min":0.39700000000000002,"15min":0.32000000000000001},"max":{"1min":0.72299999999999998,"5min":0.91900000000000004,"15min":0.93700000000000006},"last":0.42999999999999999}]},{"osd":5,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.47599999999999998,"5min":0.42399999999999999,"15min":0.40100000000000002},"max":{"1min":0.83999999999999997,"5min":1.232,"15min":1.232},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.72499999999999998,"15min":0.70799999999999996},"min":{"1min":0.52400000000000002,"5min":0.46600000000000003,"15min":0.45200000000000001},"max":{"1min":0.872,"5min":1.0880000000000001,"15min":1.121},"last":0.69099999999999995}]},{"osd":7,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69499999999999995,"15min":0.68899999999999995},"min":{"1min":0.52200000000000002,"5min":0.45600000000000002,"15min":0.36299999999999999},"max":{"1min":0.85499999999999998,"5min":0.98699999999999999,"15min":1.0309999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.74299999999999999},"min":{"1min":0.56399999999999995,"5min":0.48699999999999999,"15min":0.442},"max":{"1min":0.89200000000000002,"5min":1.194,"15min":1.194},"last":0.66900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575974,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308060,"kb_used_data":2580,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063780,"statfs":{"total":96636764160,"available":96321310720,"internally_reserved":0,"allocated":2641920,"data_stored":1329192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45600000000000002,"15min":0.45700000000000002},"min":{"1min":0.34100000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.65000000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.40000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78300000000000003,"5min":0.95499999999999996,"15min":1.2230000000000001},"last":0.38700000000000001}]},{"osd":2,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.39200000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71599999999999997,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42699999999999999,"5min":0.40300000000000002,"15min":0.39500000000000002},"max":{"1min":0.77300000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.51000000000000001}]},{"osd":3,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63,"15min":0.627},"min":{"1min":0.49199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84199999999999997,"5min":1.0049999999999999,"15min":1.2589999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.435,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":1.1519999999999999},"last":0.33500000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78800000000000003,"15min":0.78200000000000003},"min":{"1min":0.58999999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.087,"5min":1.1759999999999999,"15min":1.224},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.80400000000000005,"15min":0.80300000000000005},"min":{"1min":0.66700000000000004,"5min":0.56499999999999995,"15min":0.51800000000000002},"max":{"1min":1.0329999999999999,"5min":1.071,"15min":1.5800000000000001},"last":0.85299999999999998}]},{"osd":5,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.81699999999999995,"15min":0.81399999999999995},"min":{"1min":0.61599999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.77},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.81799999999999995,"15min":0.80700000000000005},"min":{"1min":0.67500000000000004,"5min":0.56100000000000005,"15min":0.49299999999999999},"max":{"1min":1.177,"5min":1.262,"15min":1.288},"last":1.0369999999999999}]},{"osd":6,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.82699999999999996,"15min":0.81999999999999995},"min":{"1min":0.63900000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.071,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.84999999999999998,"15min":0.83799999999999997},"min":{"1min":0.77300000000000002,"5min":0.59999999999999998,"15min":0.56699999999999995},"max":{"1min":1.135,"5min":1.3819999999999999,"15min":1.843},"last":1.004}]},{"osd":7,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.872,"15min":0.86299999999999999},"min":{"1min":0.751,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.103,"5min":1.1739999999999999,"15min":1.9139999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.86299999999999999,"15min":0.85299999999999998},"min":{"1min":0.70699999999999996,"5min":0.61799999999999999,"15min":0.54300000000000004},"max":{"1min":1.1339999999999999,"5min":1.2270000000000001,"15min":1.347},"last":0.97499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575973,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308632,"kb_used_data":3152,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063208,"statfs":{"total":96636764160,"available":96320724992,"internally_reserved":0,"allocated":3227648,"data_stored":1918046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47199999999999998,"15min":0.48499999999999999},"min":{"1min":0.35399999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.78700000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52600000000000002,"15min":0.54200000000000004},"min":{"1min":0.375,"5min":0.251,"15min":0.251},"max":{"1min":0.65600000000000003,"5min":0.82199999999999995,"15min":0.83599999999999997},"last":0.52400000000000002}]},{"osd":2,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.47899999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69399999999999995,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.5,"15min":0.51100000000000001},"min":{"1min":0.41899999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67100000000000004,"5min":0.77300000000000002,"15min":0.81999999999999995},"last":0.46999999999999997}]},{"osd":3,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52000000000000002,"15min":0.53500000000000003},"min":{"1min":0.38700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.628,"5min":0.78200000000000003,"15min":0.80500000000000005},"last":0.501},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60399999999999998,"15min":0.61899999999999999},"min":{"1min":0.47299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82899999999999996,"5min":0.92100000000000004,"15min":0.93200000000000005},"last":0.61699999999999999}]},{"osd":4,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.60799999999999998,"5min":0.46600000000000003,"15min":0.42899999999999999},"max":{"1min":1.0589999999999999,"5min":1.1759999999999999,"15min":1.226},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.66500000000000004,"5min":0.53100000000000003,"15min":0.53000000000000003},"max":{"1min":1.139,"5min":1.216,"15min":1.23},"last":0.88200000000000001}]},{"osd":5,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.79800000000000004,"15min":0.81200000000000006},"min":{"1min":0.59399999999999997,"5min":0.51500000000000001,"15min":0.501},"max":{"1min":1.1799999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.80800000000000005,"15min":0.81799999999999995},"min":{"1min":0.65300000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.02,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.92500000000000004}]},{"osd":6,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.78200000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.141,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.82199999999999995},"min":{"1min":0.624,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.24},"last":0.80200000000000005}]},{"osd":7,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.84599999999999997,"15min":0.85999999999999999},"min":{"1min":0.68100000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2929999999999999},"last":1.163},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.85499999999999998,"15min":0.874},"min":{"1min":0.69499999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.054,"5min":1.2,"15min":1.2110000000000001},"last":1.0880000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575973,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316252,"kb_used_data":2580,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055588,"statfs":{"total":96636764160,"available":96312922112,"internally_reserved":0,"allocated":2641920,"data_stored":1328322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47999999999999998,"15min":0.46800000000000003},"min":{"1min":0.33500000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67900000000000005,"5min":0.69199999999999995,"15min":0.752},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.378,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64100000000000001,"5min":0.73299999999999998,"15min":0.82299999999999995},"last":0.51100000000000001}]},{"osd":1,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.496,"15min":0.495},"min":{"1min":0.35999999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71599999999999997,"5min":1.03,"15min":1.03},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.34699999999999998},"max":{"1min":0.68600000000000005,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.54300000000000004}]},{"osd":3,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60799999999999998,"15min":0.61099999999999999},"min":{"1min":0.47599999999999998,"5min":0.40799999999999997,"15min":0.39200000000000002},"max":{"1min":0.79200000000000004,"5min":0.89000000000000001,"15min":0.96999999999999997},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.53300000000000003,"5min":0.46600000000000003,"15min":0.43099999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61099999999999999}]},{"osd":4,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.68100000000000005,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.80900000000000005,"15min":0.79900000000000004},"min":{"1min":0.63800000000000001,"5min":0.54200000000000004,"15min":0.48399999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":1.0569999999999999}]},{"osd":5,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81000000000000005,"15min":0.80900000000000005},"min":{"1min":0.60799999999999998,"5min":0.54500000000000004,"15min":0.51800000000000002},"max":{"1min":0.96499999999999997,"5min":1.181,"15min":1.181},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.47799999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.83899999999999997}]},{"osd":6,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83899999999999997,"15min":0.82699999999999996},"min":{"1min":0.68700000000000006,"5min":0.56299999999999994,"15min":0.52700000000000002},"max":{"1min":1.1499999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83099999999999996,"15min":0.83499999999999996},"min":{"1min":0.66900000000000004,"5min":0.59399999999999997,"15min":0.57099999999999995},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.224},"last":0.89500000000000002}]},{"osd":7,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.64600000000000002,"5min":0.60199999999999998,"15min":0.47899999999999998},"max":{"1min":1.054,"5min":1.448,"15min":1.448},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.67400000000000004,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.075,"5min":1.518,"15min":1.518},"last":1.042}]}]},{"osd":3,"up_from":13,"seq":55834575974,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312156,"kb_used_data":2580,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059684,"statfs":{"total":96636764160,"available":96317116416,"internally_reserved":0,"allocated":2641920,"data_stored":1327850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47799999999999998,"15min":0.48799999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59199999999999997,"5min":0.78600000000000003,"15min":0.85999999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.503,"15min":0.505},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.63100000000000001,"5min":0.73499999999999999,"15min":0.74299999999999999},"last":0.46100000000000002}]},{"osd":1,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.5,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66900000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78400000000000003,"5min":0.84999999999999998,"15min":0.91300000000000003},"last":0.41499999999999998}]},{"osd":2,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70099999999999996,"5min":0.85699999999999998,"15min":0.97299999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.65000000000000002,"15min":0.65700000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80700000000000005,"5min":0.90200000000000002,"15min":1.036},"last":0.49299999999999999}]},{"osd":4,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52100000000000002,"5min":0.49099999999999999,"15min":0.46000000000000002},"max":{"1min":1.0149999999999999,"5min":1.175,"15min":1.175},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.85899999999999999,"15min":0.86699999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.97699999999999998,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.72699999999999998}]},{"osd":5,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.47399999999999998},"max":{"1min":1.026,"5min":1.1419999999999999,"15min":1.2170000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.83099999999999996,"15min":0.83399999999999996},"min":{"1min":0.64200000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.96599999999999997,"5min":1.1719999999999999,"15min":1.1739999999999999},"last":0.80100000000000005}]},{"osd":6,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97799999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.81200000000000006,"15min":0.81299999999999994},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.54800000000000004},"max":{"1min":1.0620000000000001,"5min":1.1339999999999999,"15min":1.149},"last":0.74399999999999999}]},{"osd":7,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.84799999999999998,"15min":0.85399999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.96199999999999997,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.85999999999999999,"15min":0.85299999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0900000000000001,"5min":1.155,"15min":1.1639999999999999},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575973,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299872,"kb_used_data":2584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071968,"statfs":{"total":96636764160,"available":96329695232,"internally_reserved":0,"allocated":2646016,"data_stored":1329746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71699999999999997,"15min":0.72399999999999998},"min":{"1min":0.498,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89900000000000002,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72399999999999998,"15min":0.73599999999999999},"min":{"1min":0.53800000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.94299999999999995,"5min":0.995,"15min":0.995},"last":0.52800000000000002}]},{"osd":1,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.70699999999999996,"15min":0.71799999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92700000000000005,"5min":0.98399999999999999,"15min":1.03},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72599999999999998,"15min":0.73899999999999999},"min":{"1min":0.52400000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92600000000000005,"5min":0.97299999999999998,"15min":1.0009999999999999},"last":0.60999999999999999}]},{"osd":2,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78700000000000003,"15min":0.79200000000000004},"min":{"1min":0.65300000000000002,"5min":0.51200000000000001,"15min":0.45000000000000001},"max":{"1min":0.93100000000000005,"5min":1.0149999999999999,"15min":1.0569999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.79100000000000004,"15min":0.80200000000000005},"min":{"1min":0.63400000000000001,"5min":0.51000000000000001,"15min":0.47999999999999998},"max":{"1min":0.96499999999999997,"5min":1.077,"15min":1.077},"last":0.72899999999999998}]},{"osd":3,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73199999999999998,"15min":0.74099999999999999},"min":{"1min":0.56299999999999994,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84999999999999998,"5min":0.96999999999999997,"15min":1.016},"last":0.627},{"interface":"front","average":{"1min":0.75,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.53200000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.89600000000000002,"5min":1.036,"15min":1.036},"last":0.76400000000000001}]},{"osd":5,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.434,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.749,"5min":0.94899999999999995,"15min":1.006},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.40100000000000002},"max":{"1min":0.85099999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.70899999999999996}]},{"osd":6,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.63400000000000001},"min":{"1min":0.495,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91100000000000003,"5min":1.022,"15min":1.034},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.68300000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83999999999999997,"5min":0.998,"15min":1.0609999999999999},"last":0.55500000000000005}]},{"osd":7,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.51400000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91900000000000004,"5min":1.036,"15min":1.036},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76000000000000001,"15min":0.77600000000000002},"min":{"1min":0.498,"5min":0.48499999999999999,"15min":0.443},"max":{"1min":0.89600000000000002,"5min":1.0609999999999999,"15min":1.079},"last":0.59699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575973,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316204,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055636,"statfs":{"total":96636764160,"available":96312971264,"internally_reserved":0,"allocated":2592768,"data_stored":1306782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.55900000000000005,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92600000000000005,"5min":1.03,"15min":1.0780000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71199999999999997,"15min":0.71499999999999997},"min":{"1min":0.53900000000000003,"5min":0.42999999999999999,"15min":0.40899999999999997},"max":{"1min":0.89000000000000001,"5min":0.97399999999999998,"15min":1.018},"last":0.79200000000000004}]},{"osd":1,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.70399999999999996,"15min":0.71699999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82499999999999996,"5min":1.0129999999999999,"15min":1.1140000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76100000000000001,"15min":0.748},"min":{"1min":0.61699999999999999,"5min":0.498,"15min":0.435},"max":{"1min":0.97999999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.69199999999999995}]},{"osd":2,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74199999999999999,"15min":0.746},"min":{"1min":0.52300000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90200000000000002,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.745,"15min":0.74399999999999999},"min":{"1min":0.55500000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.95899999999999996,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.81499999999999995}]},{"osd":3,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.56799999999999995,"5min":0.50900000000000001,"15min":0.48299999999999998},"max":{"1min":0.83999999999999997,"5min":0.95999999999999996,"15min":1.0409999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.51500000000000001},"max":{"1min":1.0049999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.871}]},{"osd":4,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.627,"15min":0.61099999999999999},"min":{"1min":0.45300000000000001,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.89000000000000001,"5min":1.093,"15min":1.093},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.624,"15min":0.60799999999999998},"min":{"1min":0.42999999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83899999999999997,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.85099999999999998}]},{"osd":6,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63900000000000001,"15min":0.622},"min":{"1min":0.46100000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82499999999999996,"5min":1,"15min":1},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.69999999999999996,"15min":0.67600000000000005},"min":{"1min":0.47699999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91700000000000004,"5min":1.123,"15min":1.123},"last":0.88600000000000001}]},{"osd":7,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.70599999999999996,"15min":0.68500000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.44400000000000001},"max":{"1min":0.94299999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78300000000000003,"15min":0.76500000000000001},"min":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.48599999999999999},"max":{"1min":0.91300000000000003,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.93100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T08:17:28.222 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3e is not active+clean 2023-10-09T08:17:28.222 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:17:21.950548+0000', 'last_change': '2023-10-09T08:17:21.950548+0000', 'last_active': '2023-10-09T08:17:21.950548+0000', 'last_peered': '2023-10-09T08:17:21.950548+0000', 'last_clean': '2023-10-09T08:17:21.950548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:17:21.950548+0000', 'last_undegraded': '2023-10-09T08:17:21.950548+0000', 'last_fullsized': '2023-10-09T08:17:21.950548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_clean_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:17:28.222 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3c is not active+clean 2023-10-09T08:17:28.223 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:17:21.950548+0000', 'last_change': '2023-10-09T08:17:21.950548+0000', 'last_active': '2023-10-09T08:17:21.950548+0000', 'last_peered': '2023-10-09T08:17:21.950548+0000', 'last_clean': '2023-10-09T08:17:21.950548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:17:21.950548+0000', 'last_undegraded': '2023-10-09T08:17:21.950548+0000', 'last_fullsized': '2023-10-09T08:17:21.950548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_clean_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:17:28.223 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.37 is not active+clean 2023-10-09T08:17:28.223 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:17:21.950548+0000', 'last_change': '2023-10-09T08:17:21.950548+0000', 'last_active': '2023-10-09T08:17:21.950548+0000', 'last_peered': '2023-10-09T08:17:21.950548+0000', 'last_clean': '2023-10-09T08:17:21.950548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:17:21.950548+0000', 'last_undegraded': '2023-10-09T08:17:21.950548+0000', 'last_fullsized': '2023-10-09T08:17:21.950548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_clean_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:17:28.223 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.34 is not active+clean 2023-10-09T08:17:28.223 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:17:21.950548+0000', 'last_change': '2023-10-09T08:17:21.950548+0000', 'last_active': '2023-10-09T08:17:21.950548+0000', 'last_peered': '2023-10-09T08:17:21.950548+0000', 'last_clean': '2023-10-09T08:17:21.950548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:17:21.950548+0000', 'last_undegraded': '2023-10-09T08:17:21.950548+0000', 'last_fullsized': '2023-10-09T08:17:21.950548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_clean_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:17:28.223 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.33 is not active+clean 2023-10-09T08:17:28.223 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:17:21.950548+0000', 'last_change': '2023-10-09T08:17:21.950548+0000', 'last_active': '2023-10-09T08:17:21.950548+0000', 'last_peered': '2023-10-09T08:17:21.950548+0000', 'last_clean': '2023-10-09T08:17:21.950548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:17:21.950548+0000', 'last_undegraded': '2023-10-09T08:17:21.950548+0000', 'last_fullsized': '2023-10-09T08:17:21.950548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_clean_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:17:28.223 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.32 is not active+clean 2023-10-09T08:17:28.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:17:21.950548+0000', 'last_change': '2023-10-09T08:17:21.950548+0000', 'last_active': '2023-10-09T08:17:21.950548+0000', 'last_peered': '2023-10-09T08:17:21.950548+0000', 'last_clean': '2023-10-09T08:17:21.950548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:17:21.950548+0000', 'last_undegraded': '2023-10-09T08:17:21.950548+0000', 'last_fullsized': '2023-10-09T08:17:21.950548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_clean_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:17:28.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.31 is not active+clean 2023-10-09T08:17:28.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:17:21.950548+0000', 'last_change': '2023-10-09T08:17:21.950548+0000', 'last_active': '2023-10-09T08:17:21.950548+0000', 'last_peered': '2023-10-09T08:17:21.950548+0000', 'last_clean': '2023-10-09T08:17:21.950548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:17:21.950548+0000', 'last_undegraded': '2023-10-09T08:17:21.950548+0000', 'last_fullsized': '2023-10-09T08:17:21.950548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_clean_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:17:28.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.27 is not active+clean 2023-10-09T08:17:28.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:17:21.950548+0000', 'last_change': '2023-10-09T08:17:21.950548+0000', 'last_active': '2023-10-09T08:17:21.950548+0000', 'last_peered': '2023-10-09T08:17:21.950548+0000', 'last_clean': '2023-10-09T08:17:21.950548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:17:21.950548+0000', 'last_undegraded': '2023-10-09T08:17:21.950548+0000', 'last_fullsized': '2023-10-09T08:17:21.950548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_clean_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:17:28.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.23 is not active+clean 2023-10-09T08:17:28.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:17:21.950548+0000', 'last_change': '2023-10-09T08:17:21.950548+0000', 'last_active': '2023-10-09T08:17:21.950548+0000', 'last_peered': '2023-10-09T08:17:21.950548+0000', 'last_clean': '2023-10-09T08:17:21.950548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:17:21.950548+0000', 'last_undegraded': '2023-10-09T08:17:21.950548+0000', 'last_fullsized': '2023-10-09T08:17:21.950548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_clean_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:17:28.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.22 is not active+clean 2023-10-09T08:17:28.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:17:21.950548+0000', 'last_change': '2023-10-09T08:17:21.950548+0000', 'last_active': '2023-10-09T08:17:21.950548+0000', 'last_peered': '2023-10-09T08:17:21.950548+0000', 'last_clean': '2023-10-09T08:17:21.950548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:17:21.950548+0000', 'last_undegraded': '2023-10-09T08:17:21.950548+0000', 'last_fullsized': '2023-10-09T08:17:21.950548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_clean_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:17:28.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1e is not active+clean 2023-10-09T08:17:28.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:17:20.944684+0000', 'last_change': '2023-10-09T08:17:20.957900+0000', 'last_active': '2023-10-09T08:17:20.944684+0000', 'last_peered': '2023-10-09T08:17:20.944684+0000', 'last_clean': '2023-10-09T08:17:20.944684+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:17:20.944684+0000', 'last_undegraded': '2023-10-09T08:17:20.944684+0000', 'last_fullsized': '2023-10-09T08:17:20.944684+0000', 'mapping_epoch': 207, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 207, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:17:20.944684+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:17:20.944684+0000', 'last_clean_scrub_stamp': '2023-10-09T08:17:20.944684+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:56:31.300930+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T08:17:28.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1d is not active+clean 2023-10-09T08:17:28.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:17:21.950548+0000', 'last_change': '2023-10-09T08:17:21.950548+0000', 'last_active': '2023-10-09T08:17:21.950548+0000', 'last_peered': '2023-10-09T08:17:21.950548+0000', 'last_clean': '2023-10-09T08:17:21.950548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:17:21.950548+0000', 'last_undegraded': '2023-10-09T08:17:21.950548+0000', 'last_fullsized': '2023-10-09T08:17:21.950548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_clean_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:17:28.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1c is not active+clean 2023-10-09T08:17:28.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:17:20.944684+0000', 'last_change': '2023-10-09T08:17:20.958050+0000', 'last_active': '2023-10-09T08:17:20.944684+0000', 'last_peered': '2023-10-09T08:17:20.944684+0000', 'last_clean': '2023-10-09T08:17:20.944684+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:17:20.944684+0000', 'last_undegraded': '2023-10-09T08:17:20.944684+0000', 'last_fullsized': '2023-10-09T08:17:20.944684+0000', 'mapping_epoch': 207, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 207, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:17:20.944684+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:17:20.944684+0000', 'last_clean_scrub_stamp': '2023-10-09T08:17:20.944684+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T10:25:16.656042+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T08:17:28.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.10 is not active+clean 2023-10-09T08:17:28.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:17:21.950548+0000', 'last_change': '2023-10-09T08:17:21.950548+0000', 'last_active': '2023-10-09T08:17:21.950548+0000', 'last_peered': '2023-10-09T08:17:21.950548+0000', 'last_clean': '2023-10-09T08:17:21.950548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:17:21.950548+0000', 'last_undegraded': '2023-10-09T08:17:21.950548+0000', 'last_fullsized': '2023-10-09T08:17:21.950548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_clean_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:17:28.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.f is not active+clean 2023-10-09T08:17:28.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:17:21.950548+0000', 'last_change': '2023-10-09T08:17:21.950548+0000', 'last_active': '2023-10-09T08:17:21.950548+0000', 'last_peered': '2023-10-09T08:17:21.950548+0000', 'last_clean': '2023-10-09T08:17:21.950548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:17:21.950548+0000', 'last_undegraded': '2023-10-09T08:17:21.950548+0000', 'last_fullsized': '2023-10-09T08:17:21.950548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_clean_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:17:28.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.c is not active+clean 2023-10-09T08:17:28.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:17:21.950548+0000', 'last_change': '2023-10-09T08:17:21.950548+0000', 'last_active': '2023-10-09T08:17:21.950548+0000', 'last_peered': '2023-10-09T08:17:21.950548+0000', 'last_clean': '2023-10-09T08:17:21.950548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:17:21.950548+0000', 'last_undegraded': '2023-10-09T08:17:21.950548+0000', 'last_fullsized': '2023-10-09T08:17:21.950548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_clean_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:17:28.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.d is not active+clean 2023-10-09T08:17:28.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:17:21.950548+0000', 'last_change': '2023-10-09T08:17:21.950548+0000', 'last_active': '2023-10-09T08:17:21.950548+0000', 'last_peered': '2023-10-09T08:17:21.950548+0000', 'last_clean': '2023-10-09T08:17:21.950548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:17:21.950548+0000', 'last_undegraded': '2023-10-09T08:17:21.950548+0000', 'last_fullsized': '2023-10-09T08:17:21.950548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_clean_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:17:28.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.8 is not active+clean 2023-10-09T08:17:28.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:17:21.950548+0000', 'last_change': '2023-10-09T08:17:21.950548+0000', 'last_active': '2023-10-09T08:17:21.950548+0000', 'last_peered': '2023-10-09T08:17:21.950548+0000', 'last_clean': '2023-10-09T08:17:21.950548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:17:21.950548+0000', 'last_undegraded': '2023-10-09T08:17:21.950548+0000', 'last_fullsized': '2023-10-09T08:17:21.950548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_clean_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:17:28.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.8 is not active+clean 2023-10-09T08:17:28.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:17:20.944684+0000', 'last_change': '2023-10-09T08:17:20.957350+0000', 'last_active': '2023-10-09T08:17:20.944684+0000', 'last_peered': '2023-10-09T08:17:20.944684+0000', 'last_clean': '2023-10-09T08:17:20.944684+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:17:20.944684+0000', 'last_undegraded': '2023-10-09T08:17:20.944684+0000', 'last_fullsized': '2023-10-09T08:17:20.944684+0000', 'mapping_epoch': 207, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 207, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:17:20.944684+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:17:20.944684+0000', 'last_clean_scrub_stamp': '2023-10-09T08:17:20.944684+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:51:48.265038+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T08:17:28.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3 is not active+clean 2023-10-09T08:17:28.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:17:20.944684+0000', 'last_change': '2023-10-09T08:17:20.957339+0000', 'last_active': '2023-10-09T08:17:20.944684+0000', 'last_peered': '2023-10-09T08:17:20.944684+0000', 'last_clean': '2023-10-09T08:17:20.944684+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:17:20.944684+0000', 'last_undegraded': '2023-10-09T08:17:20.944684+0000', 'last_fullsized': '2023-10-09T08:17:20.944684+0000', 'mapping_epoch': 207, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 207, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:17:20.944684+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:17:20.944684+0000', 'last_clean_scrub_stamp': '2023-10-09T08:17:20.944684+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:30:03.136819+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T08:17:28.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2 is not active+clean 2023-10-09T08:17:28.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:17:20.944684+0000', 'last_change': '2023-10-09T08:17:20.957386+0000', 'last_active': '2023-10-09T08:17:20.944684+0000', 'last_peered': '2023-10-09T08:17:20.944684+0000', 'last_clean': '2023-10-09T08:17:20.944684+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:17:20.944684+0000', 'last_undegraded': '2023-10-09T08:17:20.944684+0000', 'last_fullsized': '2023-10-09T08:17:20.944684+0000', 'mapping_epoch': 207, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 207, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:17:20.944684+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:17:20.944684+0000', 'last_clean_scrub_stamp': '2023-10-09T08:17:20.944684+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:24:45.154798+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T08:17:28.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.0 is not active+clean 2023-10-09T08:17:28.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T08:17:21.950548+0000', 'last_change': '2023-10-09T08:17:21.950548+0000', 'last_active': '2023-10-09T08:17:21.950548+0000', 'last_peered': '2023-10-09T08:17:21.950548+0000', 'last_clean': '2023-10-09T08:17:21.950548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:17:21.950548+0000', 'last_undegraded': '2023-10-09T08:17:21.950548+0000', 'last_fullsized': '2023-10-09T08:17:21.950548+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'last_clean_scrub_stamp': '2023-10-09T08:17:21.950548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T08:17:28.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1 is not active+clean 2023-10-09T08:17:28.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T08:17:20.944684+0000', 'last_change': '2023-10-09T08:17:20.958011+0000', 'last_active': '2023-10-09T08:17:20.944684+0000', 'last_peered': '2023-10-09T08:17:20.944684+0000', 'last_clean': '2023-10-09T08:17:20.944684+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T08:17:20.944684+0000', 'last_undegraded': '2023-10-09T08:17:20.944684+0000', 'last_fullsized': '2023-10-09T08:17:20.944684+0000', 'mapping_epoch': 207, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 207, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T08:17:20.944684+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T08:17:20.944684+0000', 'last_clean_scrub_stamp': '2023-10-09T08:17:20.944684+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:39:59.452415+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T08:17:28.228 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T08:17:28.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.448+0000 7fb77a7ff700 1 Processor -- start 2023-10-09T08:17:28.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.448+0000 7fb77a7ff700 1 -- start start 2023-10-09T08:17:28.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.450+0000 7fb77a7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7740b12e0 0x7fb7740af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:28.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.450+0000 7fb77a7ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb7740cacb0 0x7fb7740af830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:28.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.450+0000 7fb77a7ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7740c9810 con 0x7fb774156770 2023-10-09T08:17:28.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.450+0000 7fb77a7ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7740c9680 con 0x7fb7740cacb0 2023-10-09T08:17:28.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.450+0000 7fb77a7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740adf80 con 0x7fb7740b12e0 2023-10-09T08:17:28.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.450+0000 7fb773fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb774156770 0x7fb7740b0bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33280/0 (socket says 172.21.15.71:33280) 2023-10-09T08:17:28.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.450+0000 7fb773fff700 1 -- 172.21.15.71:0/1197505765 learned_addr learned my addr 172.21.15.71:0/1197505765 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:28.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.450+0000 7fb778d9c700 1 --2- 172.21.15.71:0/1197505765 >> v2:172.21.15.71:3300/0 conn(0x7fb7740cacb0 0x7fb7740af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:28.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.450+0000 7fb7737fe700 1 --2- 172.21.15.71:0/1197505765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7740b12e0 0x7fb7740af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:28.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.450+0000 7fb778d9c700 1 -- 172.21.15.71:0/1197505765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7740b12e0 msgr2=0x7fb7740af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:28.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.450+0000 7fb778d9c700 1 --2- 172.21.15.71:0/1197505765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7740b12e0 0x7fb7740af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:28.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.450+0000 7fb778d9c700 1 -- 172.21.15.71:0/1197505765 >> v1:172.21.15.71:6789/0 conn(0x7fb774156770 legacy=0x7fb7740b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:28.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.450+0000 7fb778d9c700 1 -- 172.21.15.71:0/1197505765 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7740ae260 con 0x7fb7740cacb0 2023-10-09T08:17:28.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.451+0000 7fb778d9c700 1 --2- 172.21.15.71:0/1197505765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7740cacb0 0x7fb7740af830 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fb76c009e60 tx=0x7fb76c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9451be8234203ce8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:28.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.451+0000 7fb772ffd700 1 -- 172.21.15.71:0/1197505765 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c00e070 con 0x7fb7740cacb0 2023-10-09T08:17:28.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.451+0000 7fb772ffd700 1 -- 172.21.15.71:0/1197505765 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c00bc30 con 0x7fb7740cacb0 2023-10-09T08:17:28.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.451+0000 7fb772ffd700 1 -- 172.21.15.71:0/1197505765 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c012430 con 0x7fb7740cacb0 2023-10-09T08:17:28.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.451+0000 7fb77a7ff700 1 -- 172.21.15.71:0/1197505765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7740cacb0 msgr2=0x7fb7740af830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:28.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.451+0000 7fb77a7ff700 1 --2- 172.21.15.71:0/1197505765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7740cacb0 0x7fb7740af830 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fb76c009e60 tx=0x7fb76c009780 comp rx=0 tx=0).stop 2023-10-09T08:17:28.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.451+0000 7fb77a7ff700 1 -- 172.21.15.71:0/1197505765 shutdown_connections 2023-10-09T08:17:28.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.451+0000 7fb77a7ff700 1 --2- 172.21.15.71:0/1197505765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7740cacb0 0x7fb7740af830 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:28.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.451+0000 7fb77a7ff700 1 --2- 172.21.15.71:0/1197505765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7740b12e0 0x7fb7740af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:28.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.452+0000 7fb77a7ff700 1 -- 172.21.15.71:0/1197505765 >> 172.21.15.71:0/1197505765 conn(0x7fb77406a310 msgr2=0x7fb7740cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:28.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.452+0000 7fb77a7ff700 1 -- 172.21.15.71:0/1197505765 shutdown_connections 2023-10-09T08:17:28.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.452+0000 7fb77a7ff700 1 -- 172.21.15.71:0/1197505765 wait complete. 2023-10-09T08:17:28.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.453+0000 7fb77a7ff700 1 Processor -- start 2023-10-09T08:17:28.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.453+0000 7fb77a7ff700 1 -- start start 2023-10-09T08:17:28.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.454+0000 7fb77a7ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7740b12e0 0x7fb77415bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:28.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.454+0000 7fb77a7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7740cacb0 0x7fb774148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:28.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.454+0000 7fb77a7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb774156770 0x7fb77416b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:28.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.454+0000 7fb77a7ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77415cd10 con 0x7fb7740b12e0 2023-10-09T08:17:28.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.454+0000 7fb77a7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77415c100 con 0x7fb774156770 2023-10-09T08:17:28.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.454+0000 7fb77a7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77415c3e0 con 0x7fb7740cacb0 2023-10-09T08:17:28.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.454+0000 7fb773fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7740b12e0 0x7fb77415bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:28.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.454+0000 7fb773fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7740b12e0 0x7fb77415bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48240/0 (socket says 172.21.15.71:48240) 2023-10-09T08:17:28.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.454+0000 7fb773fff700 1 -- 172.21.15.71:0/1600852421 learned_addr learned my addr 172.21.15.71:0/1600852421 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:28.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.455+0000 7fb7737fe700 1 --2- 172.21.15.71:0/1600852421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7740cacb0 0x7fb774148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:28.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.455+0000 7fb778d9c700 1 --2- 172.21.15.71:0/1600852421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb774156770 0x7fb77416b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:28.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.455+0000 7fb773fff700 1 -- 172.21.15.71:0/1600852421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7740cacb0 msgr2=0x7fb774148080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:28.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.455+0000 7fb773fff700 1 --2- 172.21.15.71:0/1600852421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7740cacb0 0x7fb774148080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:28.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.455+0000 7fb773fff700 1 -- 172.21.15.71:0/1600852421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb774156770 msgr2=0x7fb77416b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:28.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.455+0000 7fb773fff700 1 --2- 172.21.15.71:0/1600852421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb774156770 0x7fb77416b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:28.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.455+0000 7fb773fff700 1 -- 172.21.15.71:0/1600852421 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76c009a20 con 0x7fb7740b12e0 2023-10-09T08:17:28.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.455+0000 7fb773fff700 1 --2- 172.21.15.71:0/1600852421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7740b12e0 0x7fb77415bb20 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fb76400c560 tx=0x7fb764001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:28.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.455+0000 7fb75bfff700 1 -- 172.21.15.71:0/1600852421 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb764005b30 con 0x7fb7740b12e0 2023-10-09T08:17:28.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.455+0000 7fb75bfff700 1 -- 172.21.15.71:0/1600852421 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb764005cb0 con 0x7fb7740b12e0 2023-10-09T08:17:28.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.455+0000 7fb77a7ff700 1 -- 172.21.15.71:0/1600852421 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77415c6c0 con 0x7fb7740b12e0 2023-10-09T08:17:28.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.455+0000 7fb75bfff700 1 -- 172.21.15.71:0/1600852421 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb764007320 con 0x7fb7740b12e0 2023-10-09T08:17:28.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.455+0000 7fb77a7ff700 1 -- 172.21.15.71:0/1600852421 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7741485c0 con 0x7fb7740b12e0 2023-10-09T08:17:28.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.456+0000 7fb77a7ff700 1 -- 172.21.15.71:0/1600852421 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77404c3c0 con 0x7fb7740b12e0 2023-10-09T08:17:28.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.457+0000 7fb75bfff700 1 -- 172.21.15.71:0/1600852421 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb76401b3b0 con 0x7fb7740b12e0 2023-10-09T08:17:28.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.458+0000 7fb75bfff700 1 --2- 172.21.15.71:0/1600852421 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb760066f60 0x7fb760069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:28.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.458+0000 7fb75bfff700 1 -- 172.21.15.71:0/1600852421 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6225+0+0 (secure 0 0 0) 0x7fb764083d20 con 0x7fb7740b12e0 2023-10-09T08:17:28.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.458+0000 7fb7737fe700 1 --2- 172.21.15.71:0/1600852421 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb760066f60 0x7fb760069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:28.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.459+0000 7fb7737fe700 1 --2- 172.21.15.71:0/1600852421 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb760066f60 0x7fb760069410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb7741605e0 tx=0x7fb768008040 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:28.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.462+0000 7fb75bfff700 1 -- 172.21.15.71:0/1600852421 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb764050ce0 con 0x7fb7740b12e0 2023-10-09T08:17:28.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.729+0000 7fb77a7ff700 1 -- 172.21.15.71:0/1600852421 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb7740ae540 con 0x7fb7740b12e0 2023-10-09T08:17:28.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.730+0000 7fb75bfff700 1 -- 172.21.15.71:0/1600852421 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1183 (secure 0 0 0) 0x7fb7640174b0 con 0x7fb7740b12e0 2023-10-09T08:17:28.730 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:28.730 INFO:teuthology.orchestra.run.smithi071.stdout:{"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":5715,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":210,"num_osds":8,"num_up_osds":8,"osd_up_since":1696833745,"num_in_osds":8,"osd_in_since":1696833737,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":74},{"state_name":"unknown","count":17},{"state_name":"creating+peering","count":6}],"num_pgs":97,"num_pools":3,"num_objects":22,"data_bytes":592674,"bytes_used":2549862400,"bytes_avail":770544250880,"bytes_total":773094113280,"unknown_pgs_ratio":0.17525772750377655,"inactive_pgs_ratio":0.061855670064687729,"write_bytes_sec":2529,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":97,"id":12,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":12,"rank":0,"name":"c","status":"up:active","gid":10149}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2023-10-09T08:16:01.051921+0000","services":{}},"progress_events":{}} 2023-10-09T08:17:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.732+0000 7fb77a7ff700 1 -- 172.21.15.71:0/1600852421 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb760066f60 msgr2=0x7fb760069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.732+0000 7fb77a7ff700 1 --2- 172.21.15.71:0/1600852421 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb760066f60 0x7fb760069410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb7741605e0 tx=0x7fb768008040 comp rx=0 tx=0).stop 2023-10-09T08:17:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.732+0000 7fb77a7ff700 1 -- 172.21.15.71:0/1600852421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7740b12e0 msgr2=0x7fb77415bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.732+0000 7fb77a7ff700 1 --2- 172.21.15.71:0/1600852421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7740b12e0 0x7fb77415bb20 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fb76400c560 tx=0x7fb764001020 comp rx=0 tx=0).stop 2023-10-09T08:17:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.732+0000 7fb77a7ff700 1 -- 172.21.15.71:0/1600852421 shutdown_connections 2023-10-09T08:17:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.732+0000 7fb77a7ff700 1 --2- 172.21.15.71:0/1600852421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb774156770 0x7fb77416b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:28.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.732+0000 7fb77a7ff700 1 --2- 172.21.15.71:0/1600852421 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb760066f60 0x7fb760069410 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:28.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.732+0000 7fb77a7ff700 1 --2- 172.21.15.71:0/1600852421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7740b12e0 0x7fb77415bb20 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:28.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.732+0000 7fb77a7ff700 1 --2- 172.21.15.71:0/1600852421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7740cacb0 0x7fb774148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:28.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.732+0000 7fb77a7ff700 1 -- 172.21.15.71:0/1600852421 >> 172.21.15.71:0/1600852421 conn(0x7fb77406a310 msgr2=0x7fb7740af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:28.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.732+0000 7fb77a7ff700 1 -- 172.21.15.71:0/1600852421 shutdown_connections 2023-10-09T08:17:28.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.732+0000 7fb77a7ff700 1 -- 172.21.15.71:0/1600852421 wait complete. 2023-10-09T08:17:28.750 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T08:17:28.750 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T08:17:28.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.930+0000 7f42681ff700 1 Processor -- start 2023-10-09T08:17:28.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.930+0000 7f42681ff700 1 -- start start 2023-10-09T08:17:28.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.932+0000 7f42681ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f42600caa90 0x7f42600c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:28.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.932+0000 7f42681ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426015d7e0 con 0x7f426006c0a0 2023-10-09T08:17:28.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.932+0000 7f42681ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426015dac0 con 0x7f426006bcd0 2023-10-09T08:17:28.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.932+0000 7f42681ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42600caef0 con 0x7f42600caa90 2023-10-09T08:17:28.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.932+0000 7f426579a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f426006c0a0 0x7f426015df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33294/0 (socket says 172.21.15.71:33294) 2023-10-09T08:17:28.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.932+0000 7f426579a700 1 -- 172.21.15.71:0/3376224948 learned_addr learned my addr 172.21.15.71:0/3376224948 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:28.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.932+0000 7f426679c700 1 --2- 172.21.15.71:0/3376224948 >> v2:172.21.15.179:3300/0 conn(0x7f42600caa90 0x7f42600c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:28.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.932+0000 7f4264f99700 1 -- 172.21.15.71:0/3376224948 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774112762 0 0) 0x7f426015d7e0 con 0x7f426006c0a0 2023-10-09T08:17:28.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.932+0000 7f4264f99700 1 -- 172.21.15.71:0/3376224948 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f424c003570 con 0x7f426006c0a0 2023-10-09T08:17:28.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.933+0000 7f4264f99700 1 -- 172.21.15.71:0/3376224948 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2241061732 0 0) 0x7f424c003570 con 0x7f426006c0a0 2023-10-09T08:17:28.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.933+0000 7f4264f99700 1 -- 172.21.15.71:0/3376224948 >> v2:172.21.15.179:3300/0 conn(0x7f42600caa90 msgr2=0x7f42600c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:28.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.933+0000 7f4264f99700 1 --2- 172.21.15.71:0/3376224948 >> v2:172.21.15.179:3300/0 conn(0x7f42600caa90 0x7f42600c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:28.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.933+0000 7f4264f99700 1 -- 172.21.15.71:0/3376224948 >> v1:172.21.15.179:6789/0 conn(0x7f426006bcd0 legacy=0x7f426015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:28.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.933+0000 7f4264f99700 1 -- 172.21.15.71:0/3376224948 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426015aa30 con 0x7f426006c0a0 2023-10-09T08:17:28.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.933+0000 7f4264f99700 1 -- 172.21.15.71:0/3376224948 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f4250001470 con 0x7f426006c0a0 2023-10-09T08:17:28.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.933+0000 7f4264f99700 1 -- 172.21.15.71:0/3376224948 >> v1:172.21.15.71:6789/0 conn(0x7f426006c0a0 legacy=0x7f426015df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:28.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.933+0000 7f4264f99700 1 --2- 172.21.15.71:0/3376224948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f424c003a60 0x7f424c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:28.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.933+0000 7f4264f99700 1 --2- 172.21.15.71:0/3376224948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f424c004810 0x7f424c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:28.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.933+0000 7f4264f99700 1 --2- 172.21.15.71:0/3376224948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f424c0052e0 0x7f424c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:28.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.933+0000 7f4264f99700 1 -- 172.21.15.71:0/3376224948 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42600caef0 con 0x7f424c004810 2023-10-09T08:17:28.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.933+0000 7f4264f99700 1 -- 172.21.15.71:0/3376224948 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424c00c2a0 con 0x7f424c0052e0 2023-10-09T08:17:28.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.933+0000 7f4264f99700 1 -- 172.21.15.71:0/3376224948 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f424c00c460 con 0x7f424c003a60 2023-10-09T08:17:28.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.933+0000 7f426579a700 1 --2- 172.21.15.71:0/3376224948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f424c004810 0x7f424c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:28.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.933+0000 7f4265f9b700 1 --2- 172.21.15.71:0/3376224948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f424c003a60 0x7f424c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:28.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.933+0000 7f426679c700 1 --2- 172.21.15.71:0/3376224948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f424c0052e0 0x7f424c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:28.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.933+0000 7f426579a700 1 -- 172.21.15.71:0/3376224948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f424c003a60 msgr2=0x7f424c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:28.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.933+0000 7f426579a700 1 --2- 172.21.15.71:0/3376224948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f424c003a60 0x7f424c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:28.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.933+0000 7f426579a700 1 -- 172.21.15.71:0/3376224948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f424c0052e0 msgr2=0x7f424c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:28.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.933+0000 7f426579a700 1 --2- 172.21.15.71:0/3376224948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f424c0052e0 0x7f424c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:28.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.933+0000 7f426579a700 1 -- 172.21.15.71:0/3376224948 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424c003570 con 0x7f424c004810 2023-10-09T08:17:28.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.933+0000 7f426679c700 1 -- 172.21.15.71:0/3376224948 reap_dead start 2023-10-09T08:17:28.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.934+0000 7f426579a700 1 --2- 172.21.15.71:0/3376224948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f424c004810 0x7f424c004c80 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f425000c390 tx=0x7f426015da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f98f0b4c5649229 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:28.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.934+0000 7f4264f99700 1 -- 172.21.15.71:0/3376224948 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425000cc60 con 0x7f424c004810 2023-10-09T08:17:28.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.934+0000 7f4264f99700 1 -- 172.21.15.71:0/3376224948 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425000cdc0 con 0x7f424c004810 2023-10-09T08:17:28.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.934+0000 7f4264f99700 1 -- 172.21.15.71:0/3376224948 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4250005b70 con 0x7f424c004810 2023-10-09T08:17:28.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.934+0000 7f42681ff700 1 -- 172.21.15.71:0/3376224948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f424c004810 msgr2=0x7f424c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:28.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.934+0000 7f42681ff700 1 --2- 172.21.15.71:0/3376224948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f424c004810 0x7f424c004c80 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f425000c390 tx=0x7f426015da30 comp rx=0 tx=0).stop 2023-10-09T08:17:28.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.934+0000 7f42681ff700 1 -- 172.21.15.71:0/3376224948 shutdown_connections 2023-10-09T08:17:28.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.934+0000 7f42681ff700 1 --2- 172.21.15.71:0/3376224948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f424c004810 0x7f424c004c80 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:28.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.934+0000 7f42681ff700 1 -- 172.21.15.71:0/3376224948 >> 172.21.15.71:0/3376224948 conn(0x7f42600ce600 msgr2=0x7f42600cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:28.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.934+0000 7f42681ff700 1 -- 172.21.15.71:0/3376224948 shutdown_connections 2023-10-09T08:17:28.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.934+0000 7f42681ff700 1 -- 172.21.15.71:0/3376224948 wait complete. 2023-10-09T08:17:28.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.936+0000 7f42681ff700 1 Processor -- start 2023-10-09T08:17:28.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.936+0000 7f42681ff700 1 -- start start 2023-10-09T08:17:28.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.937+0000 7f42681ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f424c004810 0x7f4260154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:28.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.937+0000 7f42681ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42600b2030 0x7f426016a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:28.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.937+0000 7f42681ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f426016a7d0 0x7f426016ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:28.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.937+0000 7f42681ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42601580c0 con 0x7f424c004810 2023-10-09T08:17:28.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.937+0000 7f42681ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42600b2710 con 0x7f426016a7d0 2023-10-09T08:17:28.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.937+0000 7f42681ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42600b2bf0 con 0x7f42600b2030 2023-10-09T08:17:28.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.937+0000 7f4265f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f424c004810 0x7f4260154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:28.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.937+0000 7f4265f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f424c004810 0x7f4260154b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48256/0 (socket says 172.21.15.71:48256) 2023-10-09T08:17:28.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.937+0000 7f4265f9b700 1 -- 172.21.15.71:0/607430246 learned_addr learned my addr 172.21.15.71:0/607430246 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:28.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.937+0000 7f426579a700 1 --2- 172.21.15.71:0/607430246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42600b2030 0x7f426016a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:28.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.937+0000 7f426679c700 1 --2- 172.21.15.71:0/607430246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f426016a7d0 0x7f426016ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:28.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.938+0000 7f4265f9b700 1 -- 172.21.15.71:0/607430246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42600b2030 msgr2=0x7f426016a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:28.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.938+0000 7f4265f9b700 1 --2- 172.21.15.71:0/607430246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42600b2030 0x7f426016a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:28.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.938+0000 7f4265f9b700 1 -- 172.21.15.71:0/607430246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f426016a7d0 msgr2=0x7f426016ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:28.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.938+0000 7f4265f9b700 1 --2- 172.21.15.71:0/607430246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f426016a7d0 0x7f426016ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:28.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.938+0000 7f4265f9b700 1 -- 172.21.15.71:0/607430246 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42600b24a0 con 0x7f424c004810 2023-10-09T08:17:28.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.938+0000 7f4265f9b700 1 --2- 172.21.15.71:0/607430246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f424c004810 0x7f4260154b90 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f425c00e600 tx=0x7f425c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:28.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.938+0000 7f4255ffb700 1 -- 172.21.15.71:0/607430246 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c012590 con 0x7f424c004810 2023-10-09T08:17:28.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.938+0000 7f4255ffb700 1 -- 172.21.15.71:0/607430246 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c0126f0 con 0x7f424c004810 2023-10-09T08:17:28.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.938+0000 7f42681ff700 1 -- 172.21.15.71:0/607430246 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42600c61f0 con 0x7f424c004810 2023-10-09T08:17:28.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.938+0000 7f4255ffb700 1 -- 172.21.15.71:0/607430246 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c012a90 con 0x7f424c004810 2023-10-09T08:17:28.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.938+0000 7f42681ff700 1 -- 172.21.15.71:0/607430246 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426016b1b0 con 0x7f424c004810 2023-10-09T08:17:28.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.939+0000 7f42681ff700 1 -- 172.21.15.71:0/607430246 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42600c6710 con 0x7f424c004810 2023-10-09T08:17:28.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.940+0000 7f4255ffb700 1 -- 172.21.15.71:0/607430246 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f425c01d460 con 0x7f424c004810 2023-10-09T08:17:28.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.941+0000 7f4255ffb700 1 --2- 172.21.15.71:0/607430246 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f4244066f30 0x7f42440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:28.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.941+0000 7f4255ffb700 1 -- 172.21.15.71:0/607430246 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f425c084790 con 0x7f424c004810 2023-10-09T08:17:28.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.941+0000 7f426579a700 1 --2- 172.21.15.71:0/607430246 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f4244066f30 0x7f42440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:28.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.942+0000 7f426579a700 1 --2- 172.21.15.71:0/607430246 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f4244066f30 0x7f42440693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4250007cd0 tx=0x7f4250015000 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:28.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:28.945+0000 7f4255ffb700 1 -- 172.21.15.71:0/607430246 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42600c6710 con 0x7f424c004810 2023-10-09T08:17:29.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:29.132+0000 7f42681ff700 1 -- 172.21.15.71:0/607430246 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f42600b2d30 con 0x7f4244066f30 2023-10-09T08:17:29.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:29.141+0000 7f4255ffb700 1 -- 172.21.15.71:0/607430246 <== mgr.9427 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289669 (secure 0 0 0) 0x7f4250023070 con 0x7f4244066f30 2023-10-09T08:17:29.146 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:29.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:29.145+0000 7f42681ff700 1 -- 172.21.15.71:0/607430246 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f4244066f30 msgr2=0x7f42440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:29.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:29.145+0000 7f42681ff700 1 --2- 172.21.15.71:0/607430246 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f4244066f30 0x7f42440693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4250007cd0 tx=0x7f4250015000 comp rx=0 tx=0).stop 2023-10-09T08:17:29.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:29.145+0000 7f42681ff700 1 -- 172.21.15.71:0/607430246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f424c004810 msgr2=0x7f4260154b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:29.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:29.145+0000 7f42681ff700 1 --2- 172.21.15.71:0/607430246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f424c004810 0x7f4260154b90 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f425c00e600 tx=0x7f425c009040 comp rx=0 tx=0).stop 2023-10-09T08:17:29.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:29.145+0000 7f42681ff700 1 -- 172.21.15.71:0/607430246 shutdown_connections 2023-10-09T08:17:29.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:29.145+0000 7f42681ff700 1 --2- 172.21.15.71:0/607430246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f426016a7d0 0x7f426016ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:29.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:29.145+0000 7f42681ff700 1 --2- 172.21.15.71:0/607430246 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f4244066f30 0x7f42440693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:29.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:29.145+0000 7f42681ff700 1 --2- 172.21.15.71:0/607430246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f424c004810 0x7f4260154b90 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:29.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:29.145+0000 7f42681ff700 1 --2- 172.21.15.71:0/607430246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42600b2030 0x7f426016a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:29.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:29.145+0000 7f42681ff700 1 -- 172.21.15.71:0/607430246 >> 172.21.15.71:0/607430246 conn(0x7f42600ce600 msgr2=0x7f42600c8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:29.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:29.145+0000 7f42681ff700 1 -- 172.21.15.71:0/607430246 shutdown_connections 2023-10-09T08:17:29.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:29.146+0000 7f42681ff700 1 -- 172.21.15.71:0/607430246 wait complete. 2023-10-09T08:17:29.149 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T08:17:29.163 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-09T08:17:28.214849+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":623,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":386,"ondisk_log_size":386,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2473800,"kb_used_data":21768,"kb_used_omap":0,"kb_used_meta":2451968,"kb_avail":752500920,"statfs":{"total":773094113280,"available":770560942080,"internally_reserved":0,"allocated":22290432,"data_stored":11806596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510815232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.255861"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.988806+0000","last_change":"2023-10-09T08:17:22.987349+0000","last_active":"2023-10-09T08:17:22.988806+0000","last_peered":"2023-10-09T08:17:22.988806+0000","last_clean":"2023-10-09T08:17:22.988806+0000","last_became_active":"2023-10-09T08:17:22.987068+0000","last_became_peered":"2023-10-09T08:17:22.987068+0000","last_unstale":"2023-10-09T08:17:22.988806+0000","last_undegraded":"2023-10-09T08:17:22.988806+0000","last_fullsized":"2023-10-09T08:17:22.988806+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:32:31.652330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.988970+0000","last_change":"2023-10-09T08:17:22.986700+0000","last_active":"2023-10-09T08:17:22.988970+0000","last_peered":"2023-10-09T08:17:22.988970+0000","last_clean":"2023-10-09T08:17:22.988970+0000","last_became_active":"2023-10-09T08:17:22.986363+0000","last_became_peered":"2023-10-09T08:17:22.986363+0000","last_unstale":"2023-10-09T08:17:22.988970+0000","last_undegraded":"2023-10-09T08:17:22.988970+0000","last_fullsized":"2023-10-09T08:17:22.988970+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:22.154568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983385+0000","last_change":"2023-10-09T08:17:22.980482+0000","last_active":"2023-10-09T08:17:22.983385+0000","last_peered":"2023-10-09T08:17:22.983385+0000","last_clean":"2023-10-09T08:17:22.983385+0000","last_became_active":"2023-10-09T08:17:22.980162+0000","last_became_peered":"2023-10-09T08:17:22.980162+0000","last_unstale":"2023-10-09T08:17:22.983385+0000","last_undegraded":"2023-10-09T08:17:22.983385+0000","last_fullsized":"2023-10-09T08:17:22.983385+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:08:19.846565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.989126+0000","last_change":"2023-10-09T08:17:22.986866+0000","last_active":"2023-10-09T08:17:22.989126+0000","last_peered":"2023-10-09T08:17:22.989126+0000","last_clean":"2023-10-09T08:17:22.989126+0000","last_became_active":"2023-10-09T08:17:22.986627+0000","last_became_peered":"2023-10-09T08:17:22.986627+0000","last_unstale":"2023-10-09T08:17:22.989126+0000","last_undegraded":"2023-10-09T08:17:22.989126+0000","last_fullsized":"2023-10-09T08:17:22.989126+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:47.563936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982856+0000","last_change":"2023-10-09T08:17:22.978532+0000","last_active":"2023-10-09T08:17:22.982856+0000","last_peered":"2023-10-09T08:17:22.982856+0000","last_clean":"2023-10-09T08:17:22.982856+0000","last_became_active":"2023-10-09T08:17:22.978261+0000","last_became_peered":"2023-10-09T08:17:22.978261+0000","last_unstale":"2023-10-09T08:17:22.982856+0000","last_undegraded":"2023-10-09T08:17:22.982856+0000","last_fullsized":"2023-10-09T08:17:22.982856+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:02.562263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.981672+0000","last_change":"2023-10-09T08:17:22.978795+0000","last_active":"2023-10-09T08:17:22.981672+0000","last_peered":"2023-10-09T08:17:22.981672+0000","last_clean":"2023-10-09T08:17:22.981672+0000","last_became_active":"2023-10-09T08:17:22.978557+0000","last_became_peered":"2023-10-09T08:17:22.978557+0000","last_unstale":"2023-10-09T08:17:22.981672+0000","last_undegraded":"2023-10-09T08:17:22.981672+0000","last_fullsized":"2023-10-09T08:17:22.981672+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:19.484500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.984320+0000","last_change":"2023-10-09T08:17:22.981507+0000","last_active":"2023-10-09T08:17:22.984320+0000","last_peered":"2023-10-09T08:17:22.984320+0000","last_clean":"2023-10-09T08:17:22.984320+0000","last_became_active":"2023-10-09T08:17:22.981260+0000","last_became_peered":"2023-10-09T08:17:22.981260+0000","last_unstale":"2023-10-09T08:17:22.984320+0000","last_undegraded":"2023-10-09T08:17:22.984320+0000","last_fullsized":"2023-10-09T08:17:22.984320+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:32.306795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.971000+0000","last_change":"2023-10-09T08:17:22.967502+0000","last_active":"2023-10-09T08:17:22.971000+0000","last_peered":"2023-10-09T08:17:22.971000+0000","last_clean":"2023-10-09T08:17:22.971000+0000","last_became_active":"2023-10-09T08:17:22.967258+0000","last_became_peered":"2023-10-09T08:17:22.967258+0000","last_unstale":"2023-10-09T08:17:22.971000+0000","last_undegraded":"2023-10-09T08:17:22.971000+0000","last_fullsized":"2023-10-09T08:17:22.971000+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:02.453697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.987859+0000","last_change":"2023-10-09T08:17:22.983766+0000","last_active":"2023-10-09T08:17:22.987859+0000","last_peered":"2023-10-09T08:17:22.987859+0000","last_clean":"2023-10-09T08:17:22.987859+0000","last_became_active":"2023-10-09T08:17:22.983486+0000","last_became_peered":"2023-10-09T08:17:22.983486+0000","last_unstale":"2023-10-09T08:17:22.987859+0000","last_undegraded":"2023-10-09T08:17:22.987859+0000","last_fullsized":"2023-10-09T08:17:22.987859+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:19.484500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.988639+0000","last_change":"2023-10-09T08:17:22.983416+0000","last_active":"2023-10-09T08:17:22.988639+0000","last_peered":"2023-10-09T08:17:22.988639+0000","last_clean":"2023-10-09T08:17:22.988639+0000","last_became_active":"2023-10-09T08:17:22.981717+0000","last_became_peered":"2023-10-09T08:17:22.981717+0000","last_unstale":"2023-10-09T08:17:22.988639+0000","last_undegraded":"2023-10-09T08:17:22.988639+0000","last_fullsized":"2023-10-09T08:17:22.988639+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:51.687684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.984150+0000","last_change":"2023-10-09T08:17:22.979132+0000","last_active":"2023-10-09T08:17:22.984150+0000","last_peered":"2023-10-09T08:17:22.984150+0000","last_clean":"2023-10-09T08:17:22.984150+0000","last_became_active":"2023-10-09T08:17:22.978851+0000","last_became_peered":"2023-10-09T08:17:22.978851+0000","last_unstale":"2023-10-09T08:17:22.984150+0000","last_undegraded":"2023-10-09T08:17:22.984150+0000","last_fullsized":"2023-10-09T08:17:22.984150+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:49.270902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.990217+0000","last_change":"2023-10-09T08:17:22.987682+0000","last_active":"2023-10-09T08:17:22.990217+0000","last_peered":"2023-10-09T08:17:22.990217+0000","last_clean":"2023-10-09T08:17:22.990217+0000","last_became_active":"2023-10-09T08:17:22.987386+0000","last_became_peered":"2023-10-09T08:17:22.987386+0000","last_unstale":"2023-10-09T08:17:22.990217+0000","last_undegraded":"2023-10-09T08:17:22.990217+0000","last_fullsized":"2023-10-09T08:17:22.990217+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:27.388825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.987577+0000","last_change":"2023-10-09T08:17:22.982892+0000","last_active":"2023-10-09T08:17:22.987577+0000","last_peered":"2023-10-09T08:17:22.987577+0000","last_clean":"2023-10-09T08:17:22.987577+0000","last_became_active":"2023-10-09T08:17:22.982606+0000","last_became_peered":"2023-10-09T08:17:22.982606+0000","last_unstale":"2023-10-09T08:17:22.987577+0000","last_undegraded":"2023-10-09T08:17:22.987577+0000","last_fullsized":"2023-10-09T08:17:22.987577+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:39:14.673480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.985960+0000","last_change":"2023-10-09T08:17:22.981482+0000","last_active":"2023-10-09T08:17:22.985960+0000","last_peered":"2023-10-09T08:17:22.985960+0000","last_clean":"2023-10-09T08:17:22.985960+0000","last_became_active":"2023-10-09T08:17:22.981186+0000","last_became_peered":"2023-10-09T08:17:22.981186+0000","last_unstale":"2023-10-09T08:17:22.985960+0000","last_undegraded":"2023-10-09T08:17:22.985960+0000","last_fullsized":"2023-10-09T08:17:22.985960+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:17.661906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982719+0000","last_change":"2023-10-09T08:17:22.979154+0000","last_active":"2023-10-09T08:17:22.982719+0000","last_peered":"2023-10-09T08:17:22.982719+0000","last_clean":"2023-10-09T08:17:22.982719+0000","last_became_active":"2023-10-09T08:17:22.978890+0000","last_became_peered":"2023-10-09T08:17:22.978890+0000","last_unstale":"2023-10-09T08:17:22.982719+0000","last_undegraded":"2023-10-09T08:17:22.982719+0000","last_fullsized":"2023-10-09T08:17:22.982719+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:58:30.104097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.971747+0000","last_change":"2023-10-09T08:17:22.968330+0000","last_active":"2023-10-09T08:17:22.971747+0000","last_peered":"2023-10-09T08:17:22.971747+0000","last_clean":"2023-10-09T08:17:22.971747+0000","last_became_active":"2023-10-09T08:17:22.968098+0000","last_became_peered":"2023-10-09T08:17:22.968098+0000","last_unstale":"2023-10-09T08:17:22.971747+0000","last_undegraded":"2023-10-09T08:17:22.971747+0000","last_fullsized":"2023-10-09T08:17:22.971747+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:26.390859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.992436+0000","last_change":"2023-10-09T08:17:22.987389+0000","last_active":"2023-10-09T08:17:22.992436+0000","last_peered":"2023-10-09T08:17:22.992436+0000","last_clean":"2023-10-09T08:17:22.992436+0000","last_became_active":"2023-10-09T08:17:22.987114+0000","last_became_peered":"2023-10-09T08:17:22.987114+0000","last_unstale":"2023-10-09T08:17:22.992436+0000","last_undegraded":"2023-10-09T08:17:22.992436+0000","last_fullsized":"2023-10-09T08:17:22.992436+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:50.692531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.986775+0000","last_change":"2023-10-09T08:17:22.983507+0000","last_active":"2023-10-09T08:17:22.986775+0000","last_peered":"2023-10-09T08:17:22.986775+0000","last_clean":"2023-10-09T08:17:22.986775+0000","last_became_active":"2023-10-09T08:17:22.983220+0000","last_became_peered":"2023-10-09T08:17:22.983220+0000","last_unstale":"2023-10-09T08:17:22.986775+0000","last_undegraded":"2023-10-09T08:17:22.986775+0000","last_fullsized":"2023-10-09T08:17:22.986775+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:43:41.322751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.991789+0000","last_change":"2023-10-09T08:17:22.987121+0000","last_active":"2023-10-09T08:17:22.991789+0000","last_peered":"2023-10-09T08:17:22.991789+0000","last_clean":"2023-10-09T08:17:22.991789+0000","last_became_active":"2023-10-09T08:17:22.986832+0000","last_became_peered":"2023-10-09T08:17:22.986832+0000","last_unstale":"2023-10-09T08:17:22.991789+0000","last_undegraded":"2023-10-09T08:17:22.991789+0000","last_fullsized":"2023-10-09T08:17:22.991789+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:42:42.958751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.990448+0000","last_change":"2023-10-09T08:17:22.986695+0000","last_active":"2023-10-09T08:17:22.990448+0000","last_peered":"2023-10-09T08:17:22.990448+0000","last_clean":"2023-10-09T08:17:22.990448+0000","last_became_active":"2023-10-09T08:17:22.986436+0000","last_became_peered":"2023-10-09T08:17:22.986436+0000","last_unstale":"2023-10-09T08:17:22.990448+0000","last_undegraded":"2023-10-09T08:17:22.990448+0000","last_fullsized":"2023-10-09T08:17:22.990448+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:39:24.985715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982837+0000","last_change":"2023-10-09T08:17:22.977788+0000","last_active":"2023-10-09T08:17:22.982837+0000","last_peered":"2023-10-09T08:17:22.982837+0000","last_clean":"2023-10-09T08:17:22.982837+0000","last_became_active":"2023-10-09T08:17:22.977521+0000","last_became_peered":"2023-10-09T08:17:22.977521+0000","last_unstale":"2023-10-09T08:17:22.982837+0000","last_undegraded":"2023-10-09T08:17:22.982837+0000","last_fullsized":"2023-10-09T08:17:22.982837+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:31.629347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.980841+0000","last_change":"2023-10-09T08:17:22.977049+0000","last_active":"2023-10-09T08:17:22.980841+0000","last_peered":"2023-10-09T08:17:22.980841+0000","last_clean":"2023-10-09T08:17:22.980841+0000","last_became_active":"2023-10-09T08:17:22.976779+0000","last_became_peered":"2023-10-09T08:17:22.976779+0000","last_unstale":"2023-10-09T08:17:22.980841+0000","last_undegraded":"2023-10-09T08:17:22.980841+0000","last_fullsized":"2023-10-09T08:17:22.980841+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:41.226637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.985723+0000","last_change":"2023-10-09T08:17:22.984732+0000","last_active":"2023-10-09T08:17:22.985723+0000","last_peered":"2023-10-09T08:17:22.985723+0000","last_clean":"2023-10-09T08:17:22.985723+0000","last_became_active":"2023-10-09T08:17:22.984481+0000","last_became_peered":"2023-10-09T08:17:22.984481+0000","last_unstale":"2023-10-09T08:17:22.985723+0000","last_undegraded":"2023-10-09T08:17:22.985723+0000","last_fullsized":"2023-10-09T08:17:22.985723+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:24:10.514407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983916+0000","last_change":"2023-10-09T08:17:22.974270+0000","last_active":"2023-10-09T08:17:22.983916+0000","last_peered":"2023-10-09T08:17:22.983916+0000","last_clean":"2023-10-09T08:17:22.983916+0000","last_became_active":"2023-10-09T08:17:22.974010+0000","last_became_peered":"2023-10-09T08:17:22.974010+0000","last_unstale":"2023-10-09T08:17:22.983916+0000","last_undegraded":"2023-10-09T08:17:22.983916+0000","last_fullsized":"2023-10-09T08:17:22.983916+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:10:24.260909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.993454+0000","last_change":"2023-10-09T08:17:22.990928+0000","last_active":"2023-10-09T08:17:22.993454+0000","last_peered":"2023-10-09T08:17:22.993454+0000","last_clean":"2023-10-09T08:17:22.993454+0000","last_became_active":"2023-10-09T08:17:22.990615+0000","last_became_peered":"2023-10-09T08:17:22.990615+0000","last_unstale":"2023-10-09T08:17:22.993454+0000","last_undegraded":"2023-10-09T08:17:22.993454+0000","last_fullsized":"2023-10-09T08:17:22.993454+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:04.216623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.985251+0000","last_change":"2023-10-09T08:17:22.983336+0000","last_active":"2023-10-09T08:17:22.985251+0000","last_peered":"2023-10-09T08:17:22.985251+0000","last_clean":"2023-10-09T08:17:22.985251+0000","last_became_active":"2023-10-09T08:17:22.983072+0000","last_became_peered":"2023-10-09T08:17:22.983072+0000","last_unstale":"2023-10-09T08:17:22.985251+0000","last_undegraded":"2023-10-09T08:17:22.985251+0000","last_fullsized":"2023-10-09T08:17:22.985251+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:04.142683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983367+0000","last_change":"2023-10-09T08:17:22.979452+0000","last_active":"2023-10-09T08:17:22.983367+0000","last_peered":"2023-10-09T08:17:22.983367+0000","last_clean":"2023-10-09T08:17:22.983367+0000","last_became_active":"2023-10-09T08:17:22.979151+0000","last_became_peered":"2023-10-09T08:17:22.979151+0000","last_unstale":"2023-10-09T08:17:22.983367+0000","last_undegraded":"2023-10-09T08:17:22.983367+0000","last_fullsized":"2023-10-09T08:17:22.983367+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:16:27.730608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.975230+0000","last_change":"2023-10-09T08:17:22.973609+0000","last_active":"2023-10-09T08:17:22.975230+0000","last_peered":"2023-10-09T08:17:22.975230+0000","last_clean":"2023-10-09T08:17:22.975230+0000","last_became_active":"2023-10-09T08:17:22.973223+0000","last_became_peered":"2023-10-09T08:17:22.973223+0000","last_unstale":"2023-10-09T08:17:22.975230+0000","last_undegraded":"2023-10-09T08:17:22.975230+0000","last_fullsized":"2023-10-09T08:17:22.975230+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:14.281969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.987553+0000","last_change":"2023-10-09T08:17:22.982710+0000","last_active":"2023-10-09T08:17:22.987553+0000","last_peered":"2023-10-09T08:17:22.987553+0000","last_clean":"2023-10-09T08:17:22.987553+0000","last_became_active":"2023-10-09T08:17:22.982289+0000","last_became_peered":"2023-10-09T08:17:22.982289+0000","last_unstale":"2023-10-09T08:17:22.987553+0000","last_undegraded":"2023-10-09T08:17:22.987553+0000","last_fullsized":"2023-10-09T08:17:22.987553+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:57.461312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.984152+0000","last_change":"2023-10-09T08:17:22.978840+0000","last_active":"2023-10-09T08:17:22.984152+0000","last_peered":"2023-10-09T08:17:22.984152+0000","last_clean":"2023-10-09T08:17:22.984152+0000","last_became_active":"2023-10-09T08:17:22.978578+0000","last_became_peered":"2023-10-09T08:17:22.978578+0000","last_unstale":"2023-10-09T08:17:22.984152+0000","last_undegraded":"2023-10-09T08:17:22.984152+0000","last_fullsized":"2023-10-09T08:17:22.984152+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:50.742518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983370+0000","last_change":"2023-10-09T08:17:22.982342+0000","last_active":"2023-10-09T08:17:22.983370+0000","last_peered":"2023-10-09T08:17:22.983370+0000","last_clean":"2023-10-09T08:17:22.983370+0000","last_became_active":"2023-10-09T08:17:22.982076+0000","last_became_peered":"2023-10-09T08:17:22.982076+0000","last_unstale":"2023-10-09T08:17:22.983370+0000","last_undegraded":"2023-10-09T08:17:22.983370+0000","last_fullsized":"2023-10-09T08:17:22.983370+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:17.661906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.973192+0000","last_change":"2023-10-09T08:17:22.969013+0000","last_active":"2023-10-09T08:17:22.973192+0000","last_peered":"2023-10-09T08:17:22.973192+0000","last_clean":"2023-10-09T08:17:22.973192+0000","last_became_active":"2023-10-09T08:17:22.968732+0000","last_became_peered":"2023-10-09T08:17:22.968732+0000","last_unstale":"2023-10-09T08:17:22.973192+0000","last_undegraded":"2023-10-09T08:17:22.973192+0000","last_fullsized":"2023-10-09T08:17:22.973192+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:38:56.087344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.972930+0000","last_change":"2023-10-09T08:17:22.971110+0000","last_active":"2023-10-09T08:17:22.972930+0000","last_peered":"2023-10-09T08:17:22.972930+0000","last_clean":"2023-10-09T08:17:22.972930+0000","last_became_active":"2023-10-09T08:17:22.970864+0000","last_became_peered":"2023-10-09T08:17:22.970864+0000","last_unstale":"2023-10-09T08:17:22.972930+0000","last_undegraded":"2023-10-09T08:17:22.972930+0000","last_fullsized":"2023-10-09T08:17:22.972930+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:35:13.889838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"209'4","reported_seq":14,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997902+0000","last_change":"2023-10-09T08:17:21.981359+0000","last_active":"2023-10-09T08:17:22.997902+0000","last_peered":"2023-10-09T08:17:22.997902+0000","last_clean":"2023-10-09T08:17:22.997902+0000","last_became_active":"2023-10-09T08:17:21.981080+0000","last_became_peered":"2023-10-09T08:17:21.981080+0000","last_unstale":"2023-10-09T08:17:22.997902+0000","last_undegraded":"2023-10-09T08:17:22.997902+0000","last_fullsized":"2023-10-09T08:17:22.997902+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:38.043951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.981880+0000","last_change":"2023-10-09T08:17:22.977736+0000","last_active":"2023-10-09T08:17:22.981880+0000","last_peered":"2023-10-09T08:17:22.981880+0000","last_clean":"2023-10-09T08:17:22.981880+0000","last_became_active":"2023-10-09T08:17:22.976851+0000","last_became_peered":"2023-10-09T08:17:22.976851+0000","last_unstale":"2023-10-09T08:17:22.981880+0000","last_undegraded":"2023-10-09T08:17:22.981880+0000","last_fullsized":"2023-10-09T08:17:22.981880+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:22:35.631994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"209'1","reported_seq":11,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.993643+0000","last_change":"2023-10-09T08:17:21.973999+0000","last_active":"2023-10-09T08:17:22.993643+0000","last_peered":"2023-10-09T08:17:22.993643+0000","last_clean":"2023-10-09T08:17:22.993643+0000","last_became_active":"2023-10-09T08:17:21.973711+0000","last_became_peered":"2023-10-09T08:17:21.973711+0000","last_unstale":"2023-10-09T08:17:22.993643+0000","last_undegraded":"2023-10-09T08:17:22.993643+0000","last_fullsized":"2023-10-09T08:17:22.993643+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:39:13.866505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.974564+0000","last_change":"2023-10-09T08:17:22.970652+0000","last_active":"2023-10-09T08:17:22.974564+0000","last_peered":"2023-10-09T08:17:22.974564+0000","last_clean":"2023-10-09T08:17:22.974564+0000","last_became_active":"2023-10-09T08:17:22.970213+0000","last_became_peered":"2023-10-09T08:17:22.970213+0000","last_unstale":"2023-10-09T08:17:22.974564+0000","last_undegraded":"2023-10-09T08:17:22.974564+0000","last_fullsized":"2023-10-09T08:17:22.974564+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:44:06.711747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.995441+0000","last_change":"2023-10-09T08:17:21.973213+0000","last_active":"2023-10-09T08:17:22.995441+0000","last_peered":"2023-10-09T08:17:22.995441+0000","last_clean":"2023-10-09T08:17:22.995441+0000","last_became_active":"2023-10-09T08:17:21.972952+0000","last_became_peered":"2023-10-09T08:17:21.972952+0000","last_unstale":"2023-10-09T08:17:22.995441+0000","last_undegraded":"2023-10-09T08:17:22.995441+0000","last_fullsized":"2023-10-09T08:17:22.995441+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:28.933060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.977359+0000","last_change":"2023-10-09T08:17:22.974337+0000","last_active":"2023-10-09T08:17:22.977359+0000","last_peered":"2023-10-09T08:17:22.977359+0000","last_clean":"2023-10-09T08:17:22.977359+0000","last_became_active":"2023-10-09T08:17:22.974082+0000","last_became_peered":"2023-10-09T08:17:22.974082+0000","last_unstale":"2023-10-09T08:17:22.977359+0000","last_undegraded":"2023-10-09T08:17:22.977359+0000","last_fullsized":"2023-10-09T08:17:22.977359+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:54:24.695442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.993356+0000","last_change":"2023-10-09T08:17:21.975430+0000","last_active":"2023-10-09T08:17:22.993356+0000","last_peered":"2023-10-09T08:17:22.993356+0000","last_clean":"2023-10-09T08:17:22.993356+0000","last_became_active":"2023-10-09T08:17:21.975185+0000","last_became_peered":"2023-10-09T08:17:21.975185+0000","last_unstale":"2023-10-09T08:17:22.993356+0000","last_undegraded":"2023-10-09T08:17:22.993356+0000","last_fullsized":"2023-10-09T08:17:22.993356+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:20.482226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.978894+0000","last_change":"2023-10-09T08:17:22.976545+0000","last_active":"2023-10-09T08:17:22.978894+0000","last_peered":"2023-10-09T08:17:22.978894+0000","last_clean":"2023-10-09T08:17:22.978894+0000","last_became_active":"2023-10-09T08:17:22.976305+0000","last_became_peered":"2023-10-09T08:17:22.976305+0000","last_unstale":"2023-10-09T08:17:22.978894+0000","last_undegraded":"2023-10-09T08:17:22.978894+0000","last_fullsized":"2023-10-09T08:17:22.978894+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:39.805879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"209'1","reported_seq":11,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997521+0000","last_change":"2023-10-09T08:17:21.979102+0000","last_active":"2023-10-09T08:17:22.997521+0000","last_peered":"2023-10-09T08:17:22.997521+0000","last_clean":"2023-10-09T08:17:22.997521+0000","last_became_active":"2023-10-09T08:17:21.977114+0000","last_became_peered":"2023-10-09T08:17:21.977114+0000","last_unstale":"2023-10-09T08:17:22.997521+0000","last_undegraded":"2023-10-09T08:17:22.997521+0000","last_fullsized":"2023-10-09T08:17:22.997521+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:59.752920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.972264+0000","last_change":"2023-10-09T08:17:22.968229+0000","last_active":"2023-10-09T08:17:22.972264+0000","last_peered":"2023-10-09T08:17:22.972264+0000","last_clean":"2023-10-09T08:17:22.972264+0000","last_became_active":"2023-10-09T08:17:22.967986+0000","last_became_peered":"2023-10-09T08:17:22.967986+0000","last_unstale":"2023-10-09T08:17:22.972264+0000","last_undegraded":"2023-10-09T08:17:22.972264+0000","last_fullsized":"2023-10-09T08:17:22.972264+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:30.679481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"209'1","reported_seq":11,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997465+0000","last_change":"2023-10-09T08:17:21.974938+0000","last_active":"2023-10-09T08:17:22.997465+0000","last_peered":"2023-10-09T08:17:22.997465+0000","last_clean":"2023-10-09T08:17:22.997465+0000","last_became_active":"2023-10-09T08:17:21.974701+0000","last_became_peered":"2023-10-09T08:17:21.974701+0000","last_unstale":"2023-10-09T08:17:22.997465+0000","last_undegraded":"2023-10-09T08:17:22.997465+0000","last_fullsized":"2023-10-09T08:17:22.997465+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:39:13.667615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.979263+0000","last_change":"2023-10-09T08:17:22.975840+0000","last_active":"2023-10-09T08:17:22.979263+0000","last_peered":"2023-10-09T08:17:22.979263+0000","last_clean":"2023-10-09T08:17:22.979263+0000","last_became_active":"2023-10-09T08:17:22.975564+0000","last_became_peered":"2023-10-09T08:17:22.975564+0000","last_unstale":"2023-10-09T08:17:22.979263+0000","last_undegraded":"2023-10-09T08:17:22.979263+0000","last_fullsized":"2023-10-09T08:17:22.979263+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:57:29.061415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.971606+0000","last_change":"2023-10-09T08:17:21.975736+0000","last_active":"2023-10-09T08:17:22.971606+0000","last_peered":"2023-10-09T08:17:22.971606+0000","last_clean":"2023-10-09T08:17:22.971606+0000","last_became_active":"2023-10-09T08:17:21.975485+0000","last_became_peered":"2023-10-09T08:17:21.975485+0000","last_unstale":"2023-10-09T08:17:22.971606+0000","last_undegraded":"2023-10-09T08:17:22.971606+0000","last_fullsized":"2023-10-09T08:17:22.971606+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:22.558736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.980865+0000","last_change":"2023-10-09T08:17:22.975094+0000","last_active":"2023-10-09T08:17:22.980865+0000","last_peered":"2023-10-09T08:17:22.980865+0000","last_clean":"2023-10-09T08:17:22.980865+0000","last_became_active":"2023-10-09T08:17:22.974826+0000","last_became_peered":"2023-10-09T08:17:22.974826+0000","last_unstale":"2023-10-09T08:17:22.980865+0000","last_undegraded":"2023-10-09T08:17:22.980865+0000","last_fullsized":"2023-10-09T08:17:22.980865+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:21.488090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.964826+0000","last_change":"2023-10-09T08:17:21.970071+0000","last_active":"2023-10-09T08:17:22.964826+0000","last_peered":"2023-10-09T08:17:22.964826+0000","last_clean":"2023-10-09T08:17:22.964826+0000","last_became_active":"2023-10-09T08:17:21.969809+0000","last_became_peered":"2023-10-09T08:17:21.969809+0000","last_unstale":"2023-10-09T08:17:22.964826+0000","last_undegraded":"2023-10-09T08:17:22.964826+0000","last_fullsized":"2023-10-09T08:17:22.964826+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:30.623483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.973746+0000","last_change":"2023-10-09T08:17:22.972774+0000","last_active":"2023-10-09T08:17:22.973746+0000","last_peered":"2023-10-09T08:17:22.973746+0000","last_clean":"2023-10-09T08:17:22.973746+0000","last_became_active":"2023-10-09T08:17:22.972520+0000","last_became_peered":"2023-10-09T08:17:22.972520+0000","last_unstale":"2023-10-09T08:17:22.973746+0000","last_undegraded":"2023-10-09T08:17:22.973746+0000","last_fullsized":"2023-10-09T08:17:22.973746+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:24.899441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.966427+0000","last_change":"2023-10-09T08:17:21.980454+0000","last_active":"2023-10-09T08:17:22.966427+0000","last_peered":"2023-10-09T08:17:22.966427+0000","last_clean":"2023-10-09T08:17:22.966427+0000","last_became_active":"2023-10-09T08:17:21.980212+0000","last_became_peered":"2023-10-09T08:17:21.980212+0000","last_unstale":"2023-10-09T08:17:22.966427+0000","last_undegraded":"2023-10-09T08:17:22.966427+0000","last_fullsized":"2023-10-09T08:17:22.966427+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:19.075882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.974546+0000","last_change":"2023-10-09T08:17:22.970468+0000","last_active":"2023-10-09T08:17:22.974546+0000","last_peered":"2023-10-09T08:17:22.974546+0000","last_clean":"2023-10-09T08:17:22.974546+0000","last_became_active":"2023-10-09T08:17:22.969789+0000","last_became_peered":"2023-10-09T08:17:22.969789+0000","last_unstale":"2023-10-09T08:17:22.974546+0000","last_undegraded":"2023-10-09T08:17:22.974546+0000","last_fullsized":"2023-10-09T08:17:22.974546+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:42.923655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"209'3","reported_seq":13,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.998217+0000","last_change":"2023-10-09T08:17:21.977462+0000","last_active":"2023-10-09T08:17:22.998217+0000","last_peered":"2023-10-09T08:17:22.998217+0000","last_clean":"2023-10-09T08:17:22.998217+0000","last_became_active":"2023-10-09T08:17:21.977059+0000","last_became_peered":"2023-10-09T08:17:21.977059+0000","last_unstale":"2023-10-09T08:17:22.998217+0000","last_undegraded":"2023-10-09T08:17:22.998217+0000","last_fullsized":"2023-10-09T08:17:22.998217+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:28.289402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.980213+0000","last_change":"2023-10-09T08:17:22.975853+0000","last_active":"2023-10-09T08:17:22.980213+0000","last_peered":"2023-10-09T08:17:22.980213+0000","last_clean":"2023-10-09T08:17:22.980213+0000","last_became_active":"2023-10-09T08:17:22.975560+0000","last_became_peered":"2023-10-09T08:17:22.975560+0000","last_unstale":"2023-10-09T08:17:22.980213+0000","last_undegraded":"2023-10-09T08:17:22.980213+0000","last_fullsized":"2023-10-09T08:17:22.980213+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:33:39.216798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"209'6","reported_seq":16,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.999925+0000","last_change":"2023-10-09T08:17:21.971926+0000","last_active":"2023-10-09T08:17:22.999925+0000","last_peered":"2023-10-09T08:17:22.999925+0000","last_clean":"2023-10-09T08:17:22.999925+0000","last_became_active":"2023-10-09T08:17:21.971645+0000","last_became_peered":"2023-10-09T08:17:21.971645+0000","last_unstale":"2023-10-09T08:17:22.999925+0000","last_undegraded":"2023-10-09T08:17:22.999925+0000","last_fullsized":"2023-10-09T08:17:22.999925+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:39:13.866505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.987320+0000","last_change":"2023-10-09T08:17:22.985018+0000","last_active":"2023-10-09T08:17:22.987320+0000","last_peered":"2023-10-09T08:17:22.987320+0000","last_clean":"2023-10-09T08:17:22.987320+0000","last_became_active":"2023-10-09T08:17:22.984647+0000","last_became_peered":"2023-10-09T08:17:22.984647+0000","last_unstale":"2023-10-09T08:17:22.987320+0000","last_undegraded":"2023-10-09T08:17:22.987320+0000","last_fullsized":"2023-10-09T08:17:22.987320+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:40:00.458280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997202+0000","last_change":"2023-10-09T08:17:21.975388+0000","last_active":"2023-10-09T08:17:22.997202+0000","last_peered":"2023-10-09T08:17:22.997202+0000","last_clean":"2023-10-09T08:17:22.997202+0000","last_became_active":"2023-10-09T08:17:21.974540+0000","last_became_peered":"2023-10-09T08:17:21.974540+0000","last_unstale":"2023-10-09T08:17:22.997202+0000","last_undegraded":"2023-10-09T08:17:22.997202+0000","last_fullsized":"2023-10-09T08:17:22.997202+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:39:02.110538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.984496+0000","last_change":"2023-10-09T08:17:22.982417+0000","last_active":"2023-10-09T08:17:22.984496+0000","last_peered":"2023-10-09T08:17:22.984496+0000","last_clean":"2023-10-09T08:17:22.984496+0000","last_became_active":"2023-10-09T08:17:22.982109+0000","last_became_peered":"2023-10-09T08:17:22.982109+0000","last_unstale":"2023-10-09T08:17:22.984496+0000","last_undegraded":"2023-10-09T08:17:22.984496+0000","last_fullsized":"2023-10-09T08:17:22.984496+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:46.160662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.967604+0000","last_change":"2023-10-09T08:17:21.981649+0000","last_active":"2023-10-09T08:17:22.967604+0000","last_peered":"2023-10-09T08:17:22.967604+0000","last_clean":"2023-10-09T08:17:22.967604+0000","last_became_active":"2023-10-09T08:17:21.981362+0000","last_became_peered":"2023-10-09T08:17:21.981362+0000","last_unstale":"2023-10-09T08:17:22.967604+0000","last_undegraded":"2023-10-09T08:17:22.967604+0000","last_fullsized":"2023-10-09T08:17:22.967604+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:03.261223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.987911+0000","last_change":"2023-10-09T08:17:22.983600+0000","last_active":"2023-10-09T08:17:22.987911+0000","last_peered":"2023-10-09T08:17:22.987911+0000","last_clean":"2023-10-09T08:17:22.987911+0000","last_became_active":"2023-10-09T08:17:22.983276+0000","last_became_peered":"2023-10-09T08:17:22.983276+0000","last_unstale":"2023-10-09T08:17:22.987911+0000","last_undegraded":"2023-10-09T08:17:22.987911+0000","last_fullsized":"2023-10-09T08:17:22.987911+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:16:27.730608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.961371+0000","last_change":"2023-10-09T08:17:21.976656+0000","last_active":"2023-10-09T08:17:22.961371+0000","last_peered":"2023-10-09T08:17:22.961371+0000","last_clean":"2023-10-09T08:17:22.961371+0000","last_became_active":"2023-10-09T08:17:21.976292+0000","last_became_peered":"2023-10-09T08:17:21.976292+0000","last_unstale":"2023-10-09T08:17:22.961371+0000","last_undegraded":"2023-10-09T08:17:22.961371+0000","last_fullsized":"2023-10-09T08:17:22.961371+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:00:59.557712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983496+0000","last_change":"2023-10-09T08:17:22.979323+0000","last_active":"2023-10-09T08:17:22.983496+0000","last_peered":"2023-10-09T08:17:22.983496+0000","last_clean":"2023-10-09T08:17:22.983496+0000","last_became_active":"2023-10-09T08:17:22.972209+0000","last_became_peered":"2023-10-09T08:17:22.972209+0000","last_unstale":"2023-10-09T08:17:22.983496+0000","last_undegraded":"2023-10-09T08:17:22.983496+0000","last_fullsized":"2023-10-09T08:17:22.983496+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:40.009878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"209'8","reported_seq":18,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.998098+0000","last_change":"2023-10-09T08:17:21.975369+0000","last_active":"2023-10-09T08:17:22.998098+0000","last_peered":"2023-10-09T08:17:22.998098+0000","last_clean":"2023-10-09T08:17:22.998098+0000","last_became_active":"2023-10-09T08:17:21.974853+0000","last_became_peered":"2023-10-09T08:17:21.974853+0000","last_unstale":"2023-10-09T08:17:22.998098+0000","last_undegraded":"2023-10-09T08:17:22.998098+0000","last_fullsized":"2023-10-09T08:17:22.998098+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:50.234694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.991744+0000","last_change":"2023-10-09T08:17:22.988118+0000","last_active":"2023-10-09T08:17:22.991744+0000","last_peered":"2023-10-09T08:17:22.991744+0000","last_clean":"2023-10-09T08:17:22.991744+0000","last_became_active":"2023-10-09T08:17:22.987859+0000","last_became_peered":"2023-10-09T08:17:22.987859+0000","last_unstale":"2023-10-09T08:17:22.991744+0000","last_undegraded":"2023-10-09T08:17:22.991744+0000","last_fullsized":"2023-10-09T08:17:22.991744+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:09:01.740678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"209'1","reported_seq":11,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997761+0000","last_change":"2023-10-09T08:17:21.977355+0000","last_active":"2023-10-09T08:17:22.997761+0000","last_peered":"2023-10-09T08:17:22.997761+0000","last_clean":"2023-10-09T08:17:22.997761+0000","last_became_active":"2023-10-09T08:17:21.977044+0000","last_became_peered":"2023-10-09T08:17:21.977044+0000","last_unstale":"2023-10-09T08:17:22.997761+0000","last_undegraded":"2023-10-09T08:17:22.997761+0000","last_fullsized":"2023-10-09T08:17:22.997761+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:35:04.782620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.987881+0000","last_change":"2023-10-09T08:17:22.984364+0000","last_active":"2023-10-09T08:17:22.987881+0000","last_peered":"2023-10-09T08:17:22.987881+0000","last_clean":"2023-10-09T08:17:22.987881+0000","last_became_active":"2023-10-09T08:17:22.984099+0000","last_became_peered":"2023-10-09T08:17:22.984099+0000","last_unstale":"2023-10-09T08:17:22.987881+0000","last_undegraded":"2023-10-09T08:17:22.987881+0000","last_fullsized":"2023-10-09T08:17:22.987881+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:40:00.458280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.996822+0000","last_change":"2023-10-09T08:17:21.974199+0000","last_active":"2023-10-09T08:17:22.996822+0000","last_peered":"2023-10-09T08:17:22.996822+0000","last_clean":"2023-10-09T08:17:22.996822+0000","last_became_active":"2023-10-09T08:17:21.973943+0000","last_became_peered":"2023-10-09T08:17:21.973943+0000","last_unstale":"2023-10-09T08:17:22.996822+0000","last_undegraded":"2023-10-09T08:17:22.996822+0000","last_fullsized":"2023-10-09T08:17:22.996822+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:56.455448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.985903+0000","last_change":"2023-10-09T08:17:22.980631+0000","last_active":"2023-10-09T08:17:22.985903+0000","last_peered":"2023-10-09T08:17:22.985903+0000","last_clean":"2023-10-09T08:17:22.985903+0000","last_became_active":"2023-10-09T08:17:22.980353+0000","last_became_peered":"2023-10-09T08:17:22.980353+0000","last_unstale":"2023-10-09T08:17:22.985903+0000","last_undegraded":"2023-10-09T08:17:22.985903+0000","last_fullsized":"2023-10-09T08:17:22.985903+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:08:19.846565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"209'1","reported_seq":11,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997076+0000","last_change":"2023-10-09T08:17:21.975063+0000","last_active":"2023-10-09T08:17:22.997076+0000","last_peered":"2023-10-09T08:17:22.997076+0000","last_clean":"2023-10-09T08:17:22.997076+0000","last_became_active":"2023-10-09T08:17:21.974796+0000","last_became_peered":"2023-10-09T08:17:21.974796+0000","last_unstale":"2023-10-09T08:17:22.997076+0000","last_undegraded":"2023-10-09T08:17:22.997076+0000","last_fullsized":"2023-10-09T08:17:22.997076+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:23.082491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.988902+0000","last_change":"2023-10-09T08:17:22.986316+0000","last_active":"2023-10-09T08:17:22.988902+0000","last_peered":"2023-10-09T08:17:22.988902+0000","last_clean":"2023-10-09T08:17:22.988902+0000","last_became_active":"2023-10-09T08:17:22.986062+0000","last_became_peered":"2023-10-09T08:17:22.986062+0000","last_unstale":"2023-10-09T08:17:22.988902+0000","last_undegraded":"2023-10-09T08:17:22.988902+0000","last_fullsized":"2023-10-09T08:17:22.988902+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:23:00.102421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.964704+0000","last_change":"2023-10-09T08:17:21.972751+0000","last_active":"2023-10-09T08:17:22.964704+0000","last_peered":"2023-10-09T08:17:22.964704+0000","last_clean":"2023-10-09T08:17:22.964704+0000","last_became_active":"2023-10-09T08:17:21.972437+0000","last_became_peered":"2023-10-09T08:17:21.972437+0000","last_unstale":"2023-10-09T08:17:22.964704+0000","last_undegraded":"2023-10-09T08:17:22.964704+0000","last_fullsized":"2023-10-09T08:17:22.964704+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:38:55.081479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.980862+0000","last_change":"2023-10-09T08:17:22.977458+0000","last_active":"2023-10-09T08:17:22.980862+0000","last_peered":"2023-10-09T08:17:22.980862+0000","last_clean":"2023-10-09T08:17:22.980862+0000","last_became_active":"2023-10-09T08:17:22.976833+0000","last_became_peered":"2023-10-09T08:17:22.976833+0000","last_unstale":"2023-10-09T08:17:22.980862+0000","last_undegraded":"2023-10-09T08:17:22.980862+0000","last_fullsized":"2023-10-09T08:17:22.980862+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:52.374897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.993473+0000","last_change":"2023-10-09T08:17:21.981403+0000","last_active":"2023-10-09T08:17:22.993473+0000","last_peered":"2023-10-09T08:17:22.993473+0000","last_clean":"2023-10-09T08:17:22.993473+0000","last_became_active":"2023-10-09T08:17:21.981161+0000","last_became_peered":"2023-10-09T08:17:21.981161+0000","last_unstale":"2023-10-09T08:17:22.993473+0000","last_undegraded":"2023-10-09T08:17:22.993473+0000","last_fullsized":"2023-10-09T08:17:22.993473+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:27.699996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.974523+0000","last_change":"2023-10-09T08:17:22.971091+0000","last_active":"2023-10-09T08:17:22.974523+0000","last_peered":"2023-10-09T08:17:22.974523+0000","last_clean":"2023-10-09T08:17:22.974523+0000","last_became_active":"2023-10-09T08:17:22.970841+0000","last_became_peered":"2023-10-09T08:17:22.970841+0000","last_unstale":"2023-10-09T08:17:22.974523+0000","last_undegraded":"2023-10-09T08:17:22.974523+0000","last_fullsized":"2023-10-09T08:17:22.974523+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:03:06.011485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.964325+0000","last_change":"2023-10-09T08:17:21.975152+0000","last_active":"2023-10-09T08:17:22.964325+0000","last_peered":"2023-10-09T08:17:22.964325+0000","last_clean":"2023-10-09T08:17:22.964325+0000","last_became_active":"2023-10-09T08:17:21.974892+0000","last_became_peered":"2023-10-09T08:17:21.974892+0000","last_unstale":"2023-10-09T08:17:22.964325+0000","last_undegraded":"2023-10-09T08:17:22.964325+0000","last_fullsized":"2023-10-09T08:17:22.964325+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:27.291932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.986889+0000","last_change":"2023-10-09T08:17:22.981410+0000","last_active":"2023-10-09T08:17:22.986889+0000","last_peered":"2023-10-09T08:17:22.986889+0000","last_clean":"2023-10-09T08:17:22.986889+0000","last_became_active":"2023-10-09T08:17:22.981151+0000","last_became_peered":"2023-10-09T08:17:22.981151+0000","last_unstale":"2023-10-09T08:17:22.986889+0000","last_undegraded":"2023-10-09T08:17:22.986889+0000","last_fullsized":"2023-10-09T08:17:22.986889+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:41:28.365087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.965212+0000","last_change":"2023-10-09T08:17:21.980816+0000","last_active":"2023-10-09T08:17:22.965212+0000","last_peered":"2023-10-09T08:17:22.965212+0000","last_clean":"2023-10-09T08:17:22.965212+0000","last_became_active":"2023-10-09T08:17:21.980578+0000","last_became_peered":"2023-10-09T08:17:21.980578+0000","last_unstale":"2023-10-09T08:17:22.965212+0000","last_undegraded":"2023-10-09T08:17:22.965212+0000","last_fullsized":"2023-10-09T08:17:22.965212+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:47.769934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.992100+0000","last_change":"2023-10-09T08:17:22.987538+0000","last_active":"2023-10-09T08:17:22.992100+0000","last_peered":"2023-10-09T08:17:22.992100+0000","last_clean":"2023-10-09T08:17:22.992100+0000","last_became_active":"2023-10-09T08:17:22.987276+0000","last_became_peered":"2023-10-09T08:17:22.987276+0000","last_unstale":"2023-10-09T08:17:22.992100+0000","last_undegraded":"2023-10-09T08:17:22.992100+0000","last_fullsized":"2023-10-09T08:17:22.992100+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:11.081055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.965489+0000","last_change":"2023-10-09T08:17:21.972751+0000","last_active":"2023-10-09T08:17:22.965489+0000","last_peered":"2023-10-09T08:17:22.965489+0000","last_clean":"2023-10-09T08:17:22.965489+0000","last_became_active":"2023-10-09T08:17:21.972489+0000","last_became_peered":"2023-10-09T08:17:21.972489+0000","last_unstale":"2023-10-09T08:17:22.965489+0000","last_undegraded":"2023-10-09T08:17:22.965489+0000","last_fullsized":"2023-10-09T08:17:22.965489+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:44:05.705883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.979856+0000","last_change":"2023-10-09T08:17:22.976521+0000","last_active":"2023-10-09T08:17:22.979856+0000","last_peered":"2023-10-09T08:17:22.979856+0000","last_clean":"2023-10-09T08:17:22.979856+0000","last_became_active":"2023-10-09T08:17:22.976267+0000","last_became_peered":"2023-10-09T08:17:22.976267+0000","last_unstale":"2023-10-09T08:17:22.979856+0000","last_undegraded":"2023-10-09T08:17:22.979856+0000","last_fullsized":"2023-10-09T08:17:22.979856+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:51.085786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.995515+0000","last_change":"2023-10-09T08:17:21.978738+0000","last_active":"2023-10-09T08:17:22.995515+0000","last_peered":"2023-10-09T08:17:22.995515+0000","last_clean":"2023-10-09T08:17:22.995515+0000","last_became_active":"2023-10-09T08:17:21.978434+0000","last_became_peered":"2023-10-09T08:17:21.978434+0000","last_unstale":"2023-10-09T08:17:22.995515+0000","last_undegraded":"2023-10-09T08:17:22.995515+0000","last_fullsized":"2023-10-09T08:17:22.995515+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:18:28.973275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.985726+0000","last_change":"2023-10-09T08:17:22.981798+0000","last_active":"2023-10-09T08:17:22.985726+0000","last_peered":"2023-10-09T08:17:22.985726+0000","last_clean":"2023-10-09T08:17:22.985726+0000","last_became_active":"2023-10-09T08:17:22.981558+0000","last_became_peered":"2023-10-09T08:17:22.981558+0000","last_unstale":"2023-10-09T08:17:22.985726+0000","last_undegraded":"2023-10-09T08:17:22.985726+0000","last_fullsized":"2023-10-09T08:17:22.985726+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:56:15.613249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.969647+0000","last_change":"2023-10-09T08:17:21.970119+0000","last_active":"2023-10-09T08:17:22.969647+0000","last_peered":"2023-10-09T08:17:22.969647+0000","last_clean":"2023-10-09T08:17:22.969647+0000","last_became_active":"2023-10-09T08:17:21.969872+0000","last_became_peered":"2023-10-09T08:17:21.969872+0000","last_unstale":"2023-10-09T08:17:22.969647+0000","last_undegraded":"2023-10-09T08:17:22.969647+0000","last_fullsized":"2023-10-09T08:17:22.969647+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:50.234694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983970+0000","last_change":"2023-10-09T08:17:22.974514+0000","last_active":"2023-10-09T08:17:22.983970+0000","last_peered":"2023-10-09T08:17:22.983970+0000","last_clean":"2023-10-09T08:17:22.983970+0000","last_became_active":"2023-10-09T08:17:22.974268+0000","last_became_peered":"2023-10-09T08:17:22.974268+0000","last_unstale":"2023-10-09T08:17:22.983970+0000","last_undegraded":"2023-10-09T08:17:22.983970+0000","last_fullsized":"2023-10-09T08:17:22.983970+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:04.267087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.969883+0000","last_change":"2023-10-09T08:17:21.969312+0000","last_active":"2023-10-09T08:17:22.969883+0000","last_peered":"2023-10-09T08:17:22.969883+0000","last_clean":"2023-10-09T08:17:22.969883+0000","last_became_active":"2023-10-09T08:17:21.969051+0000","last_became_peered":"2023-10-09T08:17:21.969051+0000","last_unstale":"2023-10-09T08:17:22.969883+0000","last_undegraded":"2023-10-09T08:17:22.969883+0000","last_fullsized":"2023-10-09T08:17:22.969883+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:22.558736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.984369+0000","last_change":"2023-10-09T08:17:22.982056+0000","last_active":"2023-10-09T08:17:22.984369+0000","last_peered":"2023-10-09T08:17:22.984369+0000","last_clean":"2023-10-09T08:17:22.984369+0000","last_became_active":"2023-10-09T08:17:22.981764+0000","last_became_peered":"2023-10-09T08:17:22.981764+0000","last_unstale":"2023-10-09T08:17:22.984369+0000","last_undegraded":"2023-10-09T08:17:22.984369+0000","last_fullsized":"2023-10-09T08:17:22.984369+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:47.563936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.961506+0000","last_change":"2023-10-09T08:17:21.973015+0000","last_active":"2023-10-09T08:17:22.961506+0000","last_peered":"2023-10-09T08:17:22.961506+0000","last_clean":"2023-10-09T08:17:22.961506+0000","last_became_active":"2023-10-09T08:17:21.972770+0000","last_became_peered":"2023-10-09T08:17:21.972770+0000","last_unstale":"2023-10-09T08:17:22.961506+0000","last_undegraded":"2023-10-09T08:17:22.961506+0000","last_fullsized":"2023-10-09T08:17:22.961506+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:20.745815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982691+0000","last_change":"2023-10-09T08:17:22.977908+0000","last_active":"2023-10-09T08:17:22.982691+0000","last_peered":"2023-10-09T08:17:22.982691+0000","last_clean":"2023-10-09T08:17:22.982691+0000","last_became_active":"2023-10-09T08:17:22.977612+0000","last_became_peered":"2023-10-09T08:17:22.977612+0000","last_unstale":"2023-10-09T08:17:22.982691+0000","last_undegraded":"2023-10-09T08:17:22.982691+0000","last_fullsized":"2023-10-09T08:17:22.982691+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:23.588826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.965133+0000","last_change":"2023-10-09T08:17:21.973898+0000","last_active":"2023-10-09T08:17:22.965133+0000","last_peered":"2023-10-09T08:17:22.965133+0000","last_clean":"2023-10-09T08:17:22.965133+0000","last_became_active":"2023-10-09T08:17:21.973614+0000","last_became_peered":"2023-10-09T08:17:21.973614+0000","last_unstale":"2023-10-09T08:17:22.965133+0000","last_undegraded":"2023-10-09T08:17:22.965133+0000","last_fullsized":"2023-10-09T08:17:22.965133+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:23:19.929532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982978+0000","last_change":"2023-10-09T08:17:22.978269+0000","last_active":"2023-10-09T08:17:22.982978+0000","last_peered":"2023-10-09T08:17:22.982978+0000","last_clean":"2023-10-09T08:17:22.982978+0000","last_became_active":"2023-10-09T08:17:22.977903+0000","last_became_peered":"2023-10-09T08:17:22.977903+0000","last_unstale":"2023-10-09T08:17:22.982978+0000","last_undegraded":"2023-10-09T08:17:22.982978+0000","last_fullsized":"2023-10-09T08:17:22.982978+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:44.655055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.965701+0000","last_change":"2023-10-09T08:17:21.971878+0000","last_active":"2023-10-09T08:17:22.965701+0000","last_peered":"2023-10-09T08:17:22.965701+0000","last_clean":"2023-10-09T08:17:22.965701+0000","last_became_active":"2023-10-09T08:17:21.971614+0000","last_became_peered":"2023-10-09T08:17:21.971614+0000","last_unstale":"2023-10-09T08:17:22.965701+0000","last_undegraded":"2023-10-09T08:17:22.965701+0000","last_fullsized":"2023-10-09T08:17:22.965701+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:28.933060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982394+0000","last_change":"2023-10-09T08:17:22.976618+0000","last_active":"2023-10-09T08:17:22.982394+0000","last_peered":"2023-10-09T08:17:22.982394+0000","last_clean":"2023-10-09T08:17:22.982394+0000","last_became_active":"2023-10-09T08:17:22.976343+0000","last_became_peered":"2023-10-09T08:17:22.976343+0000","last_unstale":"2023-10-09T08:17:22.982394+0000","last_undegraded":"2023-10-09T08:17:22.982394+0000","last_fullsized":"2023-10-09T08:17:22.982394+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:52.908762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.978707+0000","last_change":"2023-10-09T08:17:21.977462+0000","last_active":"2023-10-09T08:17:22.978707+0000","last_peered":"2023-10-09T08:17:22.978707+0000","last_clean":"2023-10-09T08:17:22.978707+0000","last_became_active":"2023-10-09T08:17:21.977050+0000","last_became_peered":"2023-10-09T08:17:21.977050+0000","last_unstale":"2023-10-09T08:17:22.978707+0000","last_undegraded":"2023-10-09T08:17:22.978707+0000","last_fullsized":"2023-10-09T08:17:22.978707+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:24:09.508543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.979826+0000","last_change":"2023-10-09T08:17:22.975859+0000","last_active":"2023-10-09T08:17:22.979826+0000","last_peered":"2023-10-09T08:17:22.979826+0000","last_clean":"2023-10-09T08:17:22.979826+0000","last_became_active":"2023-10-09T08:17:22.975613+0000","last_became_peered":"2023-10-09T08:17:22.975613+0000","last_unstale":"2023-10-09T08:17:22.979826+0000","last_undegraded":"2023-10-09T08:17:22.979826+0000","last_fullsized":"2023-10-09T08:17:22.979826+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:58.570422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.965128+0000","last_change":"2023-10-09T08:17:21.980259+0000","last_active":"2023-10-09T08:17:22.965128+0000","last_peered":"2023-10-09T08:17:22.965128+0000","last_clean":"2023-10-09T08:17:22.965128+0000","last_became_active":"2023-10-09T08:17:21.980015+0000","last_became_peered":"2023-10-09T08:17:21.980015+0000","last_unstale":"2023-10-09T08:17:22.965128+0000","last_undegraded":"2023-10-09T08:17:22.965128+0000","last_fullsized":"2023-10-09T08:17:22.965128+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:23:19.929532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.988548+0000","last_change":"2023-10-09T08:17:22.983916+0000","last_active":"2023-10-09T08:17:22.988548+0000","last_peered":"2023-10-09T08:17:22.988548+0000","last_clean":"2023-10-09T08:17:22.988548+0000","last_became_active":"2023-10-09T08:17:22.983658+0000","last_became_peered":"2023-10-09T08:17:22.983658+0000","last_unstale":"2023-10-09T08:17:22.988548+0000","last_undegraded":"2023-10-09T08:17:22.988548+0000","last_fullsized":"2023-10-09T08:17:22.988548+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:28.109789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.969899+0000","last_change":"2023-10-09T08:17:21.976803+0000","last_active":"2023-10-09T08:17:22.969899+0000","last_peered":"2023-10-09T08:17:22.969899+0000","last_clean":"2023-10-09T08:17:22.969899+0000","last_became_active":"2023-10-09T08:17:21.976538+0000","last_became_peered":"2023-10-09T08:17:21.976538+0000","last_unstale":"2023-10-09T08:17:22.969899+0000","last_undegraded":"2023-10-09T08:17:22.969899+0000","last_fullsized":"2023-10-09T08:17:22.969899+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:03.261223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"199'348","reported_seq":1143,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.971832+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T08:17:22.971832+0000","last_peered":"2023-10-09T08:17:22.971832+0000","last_clean":"2023-10-09T08:17:22.971832+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T08:17:22.971832+0000","last_undegraded":"2023-10-09T08:17:22.971832+0000","last_fullsized":"2023-10-09T08:17:22.971832+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575974,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312732,"kb_used_data":3156,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059108,"statfs":{"total":96636764160,"available":96316526592,"internally_reserved":0,"allocated":3231744,"data_stored":1918128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.57999999999999996,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":0.98599999999999999,"5min":0.98699999999999999,"15min":1.1220000000000001},"last":0.752},{"interface":"front","average":{"1min":0.751,"5min":0.73999999999999999,"15min":0.749},"min":{"1min":0.64200000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86299999999999999,"5min":1.0069999999999999,"15min":1.0209999999999999},"last":0.68000000000000005}]},{"osd":1,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.65400000000000003,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":0.92900000000000005,"5min":1.28,"15min":1.28},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.74099999999999999,"15min":0.75},"min":{"1min":0.55900000000000005,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89100000000000001,"5min":1.298,"15min":1.298},"last":0.70599999999999996}]},{"osd":2,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.747,"15min":0.753},"min":{"1min":0.57699999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94899999999999995,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76500000000000001,"15min":0.77000000000000002},"min":{"1min":0.64500000000000002,"5min":0.49299999999999999,"15min":0.442},"max":{"1min":0.879,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.73499999999999999}]},{"osd":3,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.73899999999999999,"15min":0.73999999999999999},"min":{"1min":0.56100000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92600000000000005,"5min":1.399,"15min":1.399},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78100000000000003,"15min":0.77700000000000002},"min":{"1min":0.61499999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95599999999999996,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.62,"15min":0.60599999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38300000000000001},"max":{"1min":0.83299999999999996,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63900000000000001,"15min":0.628},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.38600000000000001},"max":{"1min":0.78500000000000003,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.498}]},{"osd":5,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65100000000000002,"15min":0.64600000000000002},"min":{"1min":0.46899999999999997,"5min":0.39400000000000002,"15min":0.376},"max":{"1min":0.81899999999999995,"5min":1.413,"15min":1.413},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.51400000000000001,"5min":0.41699999999999998,"15min":0.40100000000000002},"max":{"1min":0.90300000000000002,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.58199999999999996}]},{"osd":6,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74399999999999999,"15min":0.73799999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.48199999999999998},"max":{"1min":0.89400000000000002,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.70999999999999996,"15min":0.70499999999999996},"min":{"1min":0.499,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":0.85099999999999998,"5min":1.595,"15min":1.595},"last":0.59999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575973,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316240,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055600,"statfs":{"total":96636764160,"available":96312934400,"internally_reserved":0,"allocated":2629632,"data_stored":1327656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76600000000000001,"15min":0.746},"min":{"1min":0.51300000000000001,"5min":0.46899999999999997,"15min":0.40300000000000002},"max":{"1min":0.92600000000000005,"5min":0.99299999999999999,"15min":1.0189999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.73799999999999999,"15min":0.73099999999999998},"min":{"1min":0.67300000000000004,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94099999999999995,"5min":0.96299999999999997,"15min":0.97399999999999998},"last":0.55400000000000005}]},{"osd":1,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.748,"15min":0.751},"min":{"1min":0.50900000000000001,"5min":0.45300000000000001,"15min":0.38500000000000001},"max":{"1min":0.90900000000000003,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78200000000000003,"15min":0.76400000000000001},"min":{"1min":0.56999999999999995,"5min":0.44,"15min":0.44},"max":{"1min":0.95899999999999996,"5min":1.0269999999999999,"15min":1.097},"last":0.72599999999999998}]},{"osd":2,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77000000000000002,"15min":0.75800000000000001},"min":{"1min":0.60799999999999998,"5min":0.495,"15min":0.46400000000000002},"max":{"1min":0.92000000000000004,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.76700000000000002,"15min":0.77300000000000002},"min":{"1min":0.58499999999999996,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":0.97699999999999998,"5min":1.0429999999999999,"15min":1.0660000000000001},"last":0.58299999999999996}]},{"osd":3,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.57999999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.89700000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.79700000000000004,"15min":0.78900000000000003},"min":{"1min":0.64000000000000001,"5min":0.54100000000000004,"15min":0.49299999999999999},"max":{"1min":0.97999999999999998,"5min":1.119,"15min":1.119},"last":0.80800000000000005}]},{"osd":4,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.64700000000000002,"15min":0.63800000000000001},"min":{"1min":0.45800000000000002,"5min":0.44700000000000001,"15min":0.40200000000000002},"max":{"1min":0.82499999999999996,"5min":1.0149999999999999,"15min":1.1339999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.64400000000000002,"15min":0.63700000000000001},"min":{"1min":0.47999999999999998,"5min":0.39700000000000002,"15min":0.32000000000000001},"max":{"1min":0.72299999999999998,"5min":0.91900000000000004,"15min":0.93700000000000006},"last":0.68400000000000005}]},{"osd":5,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.47599999999999998,"5min":0.42399999999999999,"15min":0.40100000000000002},"max":{"1min":0.83999999999999997,"5min":1.232,"15min":1.232},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.72499999999999998,"15min":0.70799999999999996},"min":{"1min":0.52400000000000002,"5min":0.46600000000000003,"15min":0.45200000000000001},"max":{"1min":0.872,"5min":1.0880000000000001,"15min":1.121},"last":0.83499999999999996}]},{"osd":7,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69499999999999995,"15min":0.68899999999999995},"min":{"1min":0.52200000000000002,"5min":0.45600000000000002,"15min":0.36299999999999999},"max":{"1min":0.85499999999999998,"5min":0.98699999999999999,"15min":1.0309999999999999},"last":0.752},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.74299999999999999},"min":{"1min":0.56399999999999995,"5min":0.48699999999999999,"15min":0.442},"max":{"1min":0.89200000000000002,"5min":1.194,"15min":1.194},"last":0.89100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575974,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308060,"kb_used_data":2580,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063780,"statfs":{"total":96636764160,"available":96321310720,"internally_reserved":0,"allocated":2641920,"data_stored":1329192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45600000000000002,"15min":0.45700000000000002},"min":{"1min":0.34100000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.65000000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.40000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78300000000000003,"5min":0.95499999999999996,"15min":1.2230000000000001},"last":0.38700000000000001}]},{"osd":2,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.39200000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71599999999999997,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42699999999999999,"5min":0.40300000000000002,"15min":0.39500000000000002},"max":{"1min":0.77300000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.51000000000000001}]},{"osd":3,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63,"15min":0.627},"min":{"1min":0.49199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84199999999999997,"5min":1.0049999999999999,"15min":1.2589999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.435,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":1.1519999999999999},"last":0.33500000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78800000000000003,"15min":0.78200000000000003},"min":{"1min":0.58999999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.087,"5min":1.1759999999999999,"15min":1.224},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.80400000000000005,"15min":0.80300000000000005},"min":{"1min":0.66700000000000004,"5min":0.56499999999999995,"15min":0.51800000000000002},"max":{"1min":1.0329999999999999,"5min":1.071,"15min":1.5800000000000001},"last":0.85299999999999998}]},{"osd":5,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.81699999999999995,"15min":0.81399999999999995},"min":{"1min":0.61599999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.77},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.81799999999999995,"15min":0.80700000000000005},"min":{"1min":0.67500000000000004,"5min":0.56100000000000005,"15min":0.49299999999999999},"max":{"1min":1.177,"5min":1.262,"15min":1.288},"last":1.0369999999999999}]},{"osd":6,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.82699999999999996,"15min":0.81999999999999995},"min":{"1min":0.63900000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.071,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.84999999999999998,"15min":0.83799999999999997},"min":{"1min":0.77300000000000002,"5min":0.59999999999999998,"15min":0.56699999999999995},"max":{"1min":1.135,"5min":1.3819999999999999,"15min":1.843},"last":1.004}]},{"osd":7,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.872,"15min":0.86299999999999999},"min":{"1min":0.751,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.103,"5min":1.1739999999999999,"15min":1.9139999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.86299999999999999,"15min":0.85299999999999998},"min":{"1min":0.70699999999999996,"5min":0.61799999999999999,"15min":0.54300000000000004},"max":{"1min":1.1339999999999999,"5min":1.2270000000000001,"15min":1.347},"last":0.97499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575973,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308632,"kb_used_data":3152,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063208,"statfs":{"total":96636764160,"available":96320724992,"internally_reserved":0,"allocated":3227648,"data_stored":1918046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47199999999999998,"15min":0.48499999999999999},"min":{"1min":0.35399999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.78700000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52600000000000002,"15min":0.54200000000000004},"min":{"1min":0.375,"5min":0.251,"15min":0.251},"max":{"1min":0.65600000000000003,"5min":0.82199999999999995,"15min":0.83599999999999997},"last":0.52400000000000002}]},{"osd":2,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.47899999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69399999999999995,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.5,"15min":0.51100000000000001},"min":{"1min":0.41899999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67100000000000004,"5min":0.77300000000000002,"15min":0.81999999999999995},"last":0.46999999999999997}]},{"osd":3,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52000000000000002,"15min":0.53500000000000003},"min":{"1min":0.38700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.628,"5min":0.78200000000000003,"15min":0.80500000000000005},"last":0.501},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60399999999999998,"15min":0.61899999999999999},"min":{"1min":0.47299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82899999999999996,"5min":0.92100000000000004,"15min":0.93200000000000005},"last":0.61699999999999999}]},{"osd":4,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.60799999999999998,"5min":0.46600000000000003,"15min":0.42899999999999999},"max":{"1min":1.0589999999999999,"5min":1.1759999999999999,"15min":1.226},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.66500000000000004,"5min":0.53100000000000003,"15min":0.53000000000000003},"max":{"1min":1.139,"5min":1.216,"15min":1.23},"last":0.88200000000000001}]},{"osd":5,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.79800000000000004,"15min":0.81200000000000006},"min":{"1min":0.59399999999999997,"5min":0.51500000000000001,"15min":0.501},"max":{"1min":1.1799999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.80800000000000005,"15min":0.81799999999999995},"min":{"1min":0.65300000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.02,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.92500000000000004}]},{"osd":6,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.78200000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.141,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.82199999999999995},"min":{"1min":0.624,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.24},"last":0.80200000000000005}]},{"osd":7,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.84599999999999997,"15min":0.85999999999999999},"min":{"1min":0.68100000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2929999999999999},"last":1.163},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.85499999999999998,"15min":0.874},"min":{"1min":0.69499999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.054,"5min":1.2,"15min":1.2110000000000001},"last":1.0880000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575973,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316252,"kb_used_data":2580,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055588,"statfs":{"total":96636764160,"available":96312922112,"internally_reserved":0,"allocated":2641920,"data_stored":1328322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47999999999999998,"15min":0.46800000000000003},"min":{"1min":0.33500000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67900000000000005,"5min":0.69199999999999995,"15min":0.752},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.378,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64100000000000001,"5min":0.73299999999999998,"15min":0.82299999999999995},"last":0.51100000000000001}]},{"osd":1,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.496,"15min":0.495},"min":{"1min":0.35999999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71599999999999997,"5min":1.03,"15min":1.03},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.34699999999999998},"max":{"1min":0.68600000000000005,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.54300000000000004}]},{"osd":3,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60799999999999998,"15min":0.61099999999999999},"min":{"1min":0.47599999999999998,"5min":0.40799999999999997,"15min":0.39200000000000002},"max":{"1min":0.79200000000000004,"5min":0.89000000000000001,"15min":0.96999999999999997},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.53300000000000003,"5min":0.46600000000000003,"15min":0.43099999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61099999999999999}]},{"osd":4,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.68100000000000005,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.80900000000000005,"15min":0.79900000000000004},"min":{"1min":0.63800000000000001,"5min":0.54200000000000004,"15min":0.48399999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":1.0569999999999999}]},{"osd":5,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81000000000000005,"15min":0.80900000000000005},"min":{"1min":0.60799999999999998,"5min":0.54500000000000004,"15min":0.51800000000000002},"max":{"1min":0.96499999999999997,"5min":1.181,"15min":1.181},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.47799999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.83899999999999997}]},{"osd":6,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83899999999999997,"15min":0.82699999999999996},"min":{"1min":0.68700000000000006,"5min":0.56299999999999994,"15min":0.52700000000000002},"max":{"1min":1.1499999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83099999999999996,"15min":0.83499999999999996},"min":{"1min":0.66900000000000004,"5min":0.59399999999999997,"15min":0.57099999999999995},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.224},"last":0.89500000000000002}]},{"osd":7,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.64600000000000002,"5min":0.60199999999999998,"15min":0.47899999999999998},"max":{"1min":1.054,"5min":1.448,"15min":1.448},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.67400000000000004,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.075,"5min":1.518,"15min":1.518},"last":1.042}]}]},{"osd":3,"up_from":13,"seq":55834575974,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312156,"kb_used_data":2580,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059684,"statfs":{"total":96636764160,"available":96317116416,"internally_reserved":0,"allocated":2641920,"data_stored":1327850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47799999999999998,"15min":0.48799999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59199999999999997,"5min":0.78600000000000003,"15min":0.85999999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.503,"15min":0.505},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.63100000000000001,"5min":0.73499999999999999,"15min":0.74299999999999999},"last":0.46100000000000002}]},{"osd":1,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.5,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66900000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78400000000000003,"5min":0.84999999999999998,"15min":0.91300000000000003},"last":0.41499999999999998}]},{"osd":2,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70099999999999996,"5min":0.85699999999999998,"15min":0.97299999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.65000000000000002,"15min":0.65700000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80700000000000005,"5min":0.90200000000000002,"15min":1.036},"last":0.49299999999999999}]},{"osd":4,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52100000000000002,"5min":0.49099999999999999,"15min":0.46000000000000002},"max":{"1min":1.0149999999999999,"5min":1.175,"15min":1.175},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.85899999999999999,"15min":0.86699999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.97699999999999998,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.72699999999999998}]},{"osd":5,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.47399999999999998},"max":{"1min":1.026,"5min":1.1419999999999999,"15min":1.2170000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.83099999999999996,"15min":0.83399999999999996},"min":{"1min":0.64200000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.96599999999999997,"5min":1.1719999999999999,"15min":1.1739999999999999},"last":0.80100000000000005}]},{"osd":6,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97799999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.81200000000000006,"15min":0.81299999999999994},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.54800000000000004},"max":{"1min":1.0620000000000001,"5min":1.1339999999999999,"15min":1.149},"last":0.74399999999999999}]},{"osd":7,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.84799999999999998,"15min":0.85399999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.96199999999999997,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.85999999999999999,"15min":0.85299999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0900000000000001,"5min":1.155,"15min":1.1639999999999999},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575973,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299872,"kb_used_data":2584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071968,"statfs":{"total":96636764160,"available":96329695232,"internally_reserved":0,"allocated":2646016,"data_stored":1329746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71699999999999997,"15min":0.72399999999999998},"min":{"1min":0.498,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89900000000000002,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72399999999999998,"15min":0.73599999999999999},"min":{"1min":0.53800000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.94299999999999995,"5min":0.995,"15min":0.995},"last":0.52800000000000002}]},{"osd":1,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.70699999999999996,"15min":0.71799999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92700000000000005,"5min":0.98399999999999999,"15min":1.03},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72599999999999998,"15min":0.73899999999999999},"min":{"1min":0.52400000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92600000000000005,"5min":0.97299999999999998,"15min":1.0009999999999999},"last":0.60999999999999999}]},{"osd":2,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78700000000000003,"15min":0.79200000000000004},"min":{"1min":0.65300000000000002,"5min":0.51200000000000001,"15min":0.45000000000000001},"max":{"1min":0.93100000000000005,"5min":1.0149999999999999,"15min":1.0569999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.79100000000000004,"15min":0.80200000000000005},"min":{"1min":0.63400000000000001,"5min":0.51000000000000001,"15min":0.47999999999999998},"max":{"1min":0.96499999999999997,"5min":1.077,"15min":1.077},"last":0.72899999999999998}]},{"osd":3,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73199999999999998,"15min":0.74099999999999999},"min":{"1min":0.56299999999999994,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84999999999999998,"5min":0.96999999999999997,"15min":1.016},"last":0.627},{"interface":"front","average":{"1min":0.75,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.53200000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.89600000000000002,"5min":1.036,"15min":1.036},"last":0.76400000000000001}]},{"osd":5,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.434,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.749,"5min":0.94899999999999995,"15min":1.006},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.40100000000000002},"max":{"1min":0.85099999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.70899999999999996}]},{"osd":6,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.63400000000000001},"min":{"1min":0.495,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91100000000000003,"5min":1.022,"15min":1.034},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.68300000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83999999999999997,"5min":0.998,"15min":1.0609999999999999},"last":0.55500000000000005}]},{"osd":7,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.51400000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91900000000000004,"5min":1.036,"15min":1.036},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76000000000000001,"15min":0.77600000000000002},"min":{"1min":0.498,"5min":0.48499999999999999,"15min":0.443},"max":{"1min":0.89600000000000002,"5min":1.0609999999999999,"15min":1.079},"last":0.59699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575974,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299856,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071984,"statfs":{"total":96636764160,"available":96329711616,"internally_reserved":0,"allocated":2629632,"data_stored":1327656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.55900000000000005,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92600000000000005,"5min":1.03,"15min":1.0780000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71199999999999997,"15min":0.71499999999999997},"min":{"1min":0.53900000000000003,"5min":0.42999999999999999,"15min":0.40899999999999997},"max":{"1min":0.89000000000000001,"5min":0.97399999999999998,"15min":1.018},"last":0.66500000000000004}]},{"osd":1,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.70399999999999996,"15min":0.71699999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82499999999999996,"5min":1.0129999999999999,"15min":1.1140000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76100000000000001,"15min":0.748},"min":{"1min":0.61699999999999999,"5min":0.498,"15min":0.435},"max":{"1min":0.97999999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.68999999999999995}]},{"osd":2,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74199999999999999,"15min":0.746},"min":{"1min":0.52300000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90200000000000002,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.745,"15min":0.74399999999999999},"min":{"1min":0.55500000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.95899999999999996,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.76300000000000001}]},{"osd":3,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.56799999999999995,"5min":0.50900000000000001,"15min":0.48299999999999998},"max":{"1min":0.83999999999999997,"5min":0.95999999999999996,"15min":1.0409999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.51500000000000001},"max":{"1min":1.0049999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.71799999999999997}]},{"osd":4,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.627,"15min":0.61099999999999999},"min":{"1min":0.45300000000000001,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.89000000000000001,"5min":1.093,"15min":1.093},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.624,"15min":0.60799999999999998},"min":{"1min":0.42999999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83899999999999997,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.56399999999999995}]},{"osd":6,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63900000000000001,"15min":0.622},"min":{"1min":0.46100000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82499999999999996,"5min":1,"15min":1},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.69999999999999996,"15min":0.67600000000000005},"min":{"1min":0.47699999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91700000000000004,"5min":1.123,"15min":1.123},"last":0.64100000000000001}]},{"osd":7,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.70599999999999996,"15min":0.68500000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.44400000000000001},"max":{"1min":0.94299999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78300000000000003,"15min":0.76500000000000001},"min":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.48599999999999999},"max":{"1min":0.91300000000000003,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.624}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T08:17:32.169 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T08:17:32.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.360+0000 7f1ae51ff700 1 Processor -- start 2023-10-09T08:17:32.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.360+0000 7f1ae51ff700 1 -- start start 2023-10-09T08:17:32.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.361+0000 7f1ae51ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae00cbf30 0x7f1ae00ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:32.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.361+0000 7f1ae51ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1ae00b1420 0x7f1ae00c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:32.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.362+0000 7f1ae51ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae00cc300 con 0x7f1ae00ccf90 2023-10-09T08:17:32.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.362+0000 7f1ae51ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae0156bf0 con 0x7f1ae00b1420 2023-10-09T08:17:32.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.362+0000 7f1ae51ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae00ae950 con 0x7f1ae00cbf30 2023-10-09T08:17:32.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.362+0000 7f1adf59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1ae00b1420 0x7f1ae00c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:32.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.362+0000 7f1aded9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae00cbf30 0x7f1ae00ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:32.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.362+0000 7f1adf59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1ae00b1420 0x7f1ae00c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:34208/0 (socket says 172.21.15.71:34208) 2023-10-09T08:17:32.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.362+0000 7f1adf59e700 1 -- 172.21.15.71:0/1515887544 learned_addr learned my addr 172.21.15.71:0/1515887544 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:32.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.363+0000 7f1adf59e700 1 -- 172.21.15.71:0/1515887544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae00cbf30 msgr2=0x7f1ae00ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:32.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.363+0000 7f1adf59e700 1 --2- 172.21.15.71:0/1515887544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae00cbf30 0x7f1ae00ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:32.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.363+0000 7f1adf59e700 1 -- 172.21.15.71:0/1515887544 >> v1:172.21.15.179:6789/0 conn(0x7f1ae00ccf90 legacy=0x7f1ae00b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:32.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.363+0000 7f1adf59e700 1 -- 172.21.15.71:0/1515887544 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae00ad370 con 0x7f1ae00b1420 2023-10-09T08:17:32.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.363+0000 7f1aded9d700 1 --2- 172.21.15.71:0/1515887544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae00cbf30 0x7f1ae00ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:32.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.363+0000 7f1adf59e700 1 --2- 172.21.15.71:0/1515887544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae00b1420 0x7f1ae00c9740 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8009f50 tx=0x7f1ad8009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5661dc290c1d892 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:32.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.363+0000 7f1addd9b700 1 -- 172.21.15.71:0/1515887544 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad800e070 con 0x7f1ae00b1420 2023-10-09T08:17:32.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.363+0000 7f1addd9b700 1 -- 172.21.15.71:0/1515887544 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad800b9c0 con 0x7f1ae00b1420 2023-10-09T08:17:32.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.363+0000 7f1addd9b700 1 -- 172.21.15.71:0/1515887544 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad80092e0 con 0x7f1ae00b1420 2023-10-09T08:17:32.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.364+0000 7f1ae51ff700 1 -- 172.21.15.71:0/1515887544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae00b1420 msgr2=0x7f1ae00c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:32.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.364+0000 7f1ae51ff700 1 --2- 172.21.15.71:0/1515887544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae00b1420 0x7f1ae00c9740 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8009f50 tx=0x7f1ad8009840 comp rx=0 tx=0).stop 2023-10-09T08:17:32.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.364+0000 7f1ae51ff700 1 -- 172.21.15.71:0/1515887544 shutdown_connections 2023-10-09T08:17:32.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.364+0000 7f1ae51ff700 1 --2- 172.21.15.71:0/1515887544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae00b1420 0x7f1ae00c9740 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:32.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.364+0000 7f1ae51ff700 1 --2- 172.21.15.71:0/1515887544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae00cbf30 0x7f1ae00ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:32.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.364+0000 7f1ae51ff700 1 -- 172.21.15.71:0/1515887544 >> 172.21.15.71:0/1515887544 conn(0x7f1ae006a320 msgr2=0x7f1ae00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:32.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.364+0000 7f1ae51ff700 1 -- 172.21.15.71:0/1515887544 shutdown_connections 2023-10-09T08:17:32.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.364+0000 7f1ae51ff700 1 -- 172.21.15.71:0/1515887544 wait complete. 2023-10-09T08:17:32.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.365+0000 7f1ae51ff700 1 Processor -- start 2023-10-09T08:17:32.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.366+0000 7f1ae51ff700 1 -- start start 2023-10-09T08:17:32.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.366+0000 7f1ae51ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae00b1420 0x7f1ae01672c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:32.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.366+0000 7f1ae51ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae00cbf30 0x7f1ae0165580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:32.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.366+0000 7f1ae51ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ae00ccf90 0x7f1ae0168370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:32.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.366+0000 7f1ae51ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae0169c70 con 0x7f1ae00ccf90 2023-10-09T08:17:32.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.366+0000 7f1ae51ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae0167800 con 0x7f1ae00b1420 2023-10-09T08:17:32.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.366+0000 7f1ae51ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae0165ac0 con 0x7f1ae00cbf30 2023-10-09T08:17:32.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.367+0000 7f1adf59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ae00ccf90 0x7f1ae0168370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:32.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.367+0000 7f1adf59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ae00ccf90 0x7f1ae0168370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48268/0 (socket says 172.21.15.71:48268) 2023-10-09T08:17:32.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.367+0000 7f1adf59e700 1 -- 172.21.15.71:0/254313675 learned_addr learned my addr 172.21.15.71:0/254313675 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:32.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.367+0000 7f1aded9d700 1 --2- 172.21.15.71:0/254313675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae00b1420 0x7f1ae01672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:32.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.367+0000 7f1ade59c700 1 --2- 172.21.15.71:0/254313675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae00cbf30 0x7f1ae0165580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:32.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.367+0000 7f1adf59e700 1 -- 172.21.15.71:0/254313675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae00cbf30 msgr2=0x7f1ae0165580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:32.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.367+0000 7f1adf59e700 1 --2- 172.21.15.71:0/254313675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae00cbf30 0x7f1ae0165580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:32.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.367+0000 7f1adf59e700 1 -- 172.21.15.71:0/254313675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae00b1420 msgr2=0x7f1ae01672c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:32.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.367+0000 7f1adf59e700 1 --2- 172.21.15.71:0/254313675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae00b1420 0x7f1ae01672c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:32.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.367+0000 7f1adf59e700 1 -- 172.21.15.71:0/254313675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad0009420 con 0x7f1ae00ccf90 2023-10-09T08:17:32.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.367+0000 7f1ade59c700 1 --2- 172.21.15.71:0/254313675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae00cbf30 0x7f1ae0165580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:17:32.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.367+0000 7f1adf59e700 1 --2- 172.21.15.71:0/254313675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ae00ccf90 0x7f1ae0168370 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8009880 tx=0x7f1ad8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:32.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.368+0000 7f1ac6ffd700 1 -- 172.21.15.71:0/254313675 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8008c50 con 0x7f1ae00ccf90 2023-10-09T08:17:32.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.368+0000 7f1ac6ffd700 1 -- 172.21.15.71:0/254313675 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad8008db0 con 0x7f1ae00ccf90 2023-10-09T08:17:32.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.368+0000 7f1ae51ff700 1 -- 172.21.15.71:0/254313675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad8009ae0 con 0x7f1ae00ccf90 2023-10-09T08:17:32.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.368+0000 7f1ac6ffd700 1 -- 172.21.15.71:0/254313675 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8026690 con 0x7f1ae00ccf90 2023-10-09T08:17:32.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.368+0000 7f1ae51ff700 1 -- 172.21.15.71:0/254313675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae0169060 con 0x7f1ae00ccf90 2023-10-09T08:17:32.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.369+0000 7f1ae51ff700 1 -- 172.21.15.71:0/254313675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae004c3c0 con 0x7f1ae00ccf90 2023-10-09T08:17:32.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.370+0000 7f1ac6ffd700 1 -- 172.21.15.71:0/254313675 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ad8003040 con 0x7f1ae00ccf90 2023-10-09T08:17:32.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.371+0000 7f1ac6ffd700 1 --2- 172.21.15.71:0/254313675 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1acc066f30 0x7f1acc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:32.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.371+0000 7f1ac6ffd700 1 -- 172.21.15.71:0/254313675 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f1ad8086680 con 0x7f1ae00ccf90 2023-10-09T08:17:32.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.371+0000 7f1aded9d700 1 --2- 172.21.15.71:0/254313675 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1acc066f30 0x7f1acc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:32.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.372+0000 7f1aded9d700 1 --2- 172.21.15.71:0/254313675 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1acc066f30 0x7f1acc0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0009f40 tx=0x7f1ad00091a0 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:32.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.375+0000 7f1ac6ffd700 1 -- 172.21.15.71:0/254313675 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ad80536e0 con 0x7f1ae00ccf90 2023-10-09T08:17:32.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.564+0000 7f1ae51ff700 1 -- 172.21.15.71:0/254313675 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1ae00ad650 con 0x7f1acc066f30 2023-10-09T08:17:32.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.573+0000 7f1ac6ffd700 1 -- 172.21.15.71:0/254313675 <== mgr.9427 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289548 (secure 0 0 0) 0x7f1ae00ad650 con 0x7f1acc066f30 2023-10-09T08:17:32.578 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:32.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.577+0000 7f1ae51ff700 1 -- 172.21.15.71:0/254313675 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1acc066f30 msgr2=0x7f1acc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:32.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.577+0000 7f1ae51ff700 1 --2- 172.21.15.71:0/254313675 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1acc066f30 0x7f1acc0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0009f40 tx=0x7f1ad00091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:32.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.577+0000 7f1ae51ff700 1 -- 172.21.15.71:0/254313675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ae00ccf90 msgr2=0x7f1ae0168370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:32.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.577+0000 7f1ae51ff700 1 --2- 172.21.15.71:0/254313675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ae00ccf90 0x7f1ae0168370 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8009880 tx=0x7f1ad8018000 comp rx=0 tx=0).stop 2023-10-09T08:17:32.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.577+0000 7f1ae51ff700 1 -- 172.21.15.71:0/254313675 shutdown_connections 2023-10-09T08:17:32.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.577+0000 7f1ae51ff700 1 --2- 172.21.15.71:0/254313675 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1acc066f30 0x7f1acc0693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:32.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.577+0000 7f1ae51ff700 1 --2- 172.21.15.71:0/254313675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ae00ccf90 0x7f1ae0168370 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:32.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.577+0000 7f1ae51ff700 1 --2- 172.21.15.71:0/254313675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae00b1420 0x7f1ae01672c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:32.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.577+0000 7f1ae51ff700 1 --2- 172.21.15.71:0/254313675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae00cbf30 0x7f1ae0165580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:32.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.577+0000 7f1ae51ff700 1 -- 172.21.15.71:0/254313675 >> 172.21.15.71:0/254313675 conn(0x7f1ae006a320 msgr2=0x7f1ae00cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:32.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.577+0000 7f1ae51ff700 1 -- 172.21.15.71:0/254313675 shutdown_connections 2023-10-09T08:17:32.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.577+0000 7f1ae51ff700 1 -- 172.21.15.71:0/254313675 wait complete. 2023-10-09T08:17:32.582 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T08:17:32.595 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-09T08:17:32.215688+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":624,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2473800,"kb_used_data":21768,"kb_used_omap":0,"kb_used_meta":2451968,"kb_avail":752500920,"statfs":{"total":773094113280,"available":770560942080,"internally_reserved":0,"allocated":22290432,"data_stored":11806596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510815232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.254623"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.988806+0000","last_change":"2023-10-09T08:17:22.987349+0000","last_active":"2023-10-09T08:17:22.988806+0000","last_peered":"2023-10-09T08:17:22.988806+0000","last_clean":"2023-10-09T08:17:22.988806+0000","last_became_active":"2023-10-09T08:17:22.987068+0000","last_became_peered":"2023-10-09T08:17:22.987068+0000","last_unstale":"2023-10-09T08:17:22.988806+0000","last_undegraded":"2023-10-09T08:17:22.988806+0000","last_fullsized":"2023-10-09T08:17:22.988806+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:32:31.652330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.988970+0000","last_change":"2023-10-09T08:17:22.986700+0000","last_active":"2023-10-09T08:17:22.988970+0000","last_peered":"2023-10-09T08:17:22.988970+0000","last_clean":"2023-10-09T08:17:22.988970+0000","last_became_active":"2023-10-09T08:17:22.986363+0000","last_became_peered":"2023-10-09T08:17:22.986363+0000","last_unstale":"2023-10-09T08:17:22.988970+0000","last_undegraded":"2023-10-09T08:17:22.988970+0000","last_fullsized":"2023-10-09T08:17:22.988970+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:22.154568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983385+0000","last_change":"2023-10-09T08:17:22.980482+0000","last_active":"2023-10-09T08:17:22.983385+0000","last_peered":"2023-10-09T08:17:22.983385+0000","last_clean":"2023-10-09T08:17:22.983385+0000","last_became_active":"2023-10-09T08:17:22.980162+0000","last_became_peered":"2023-10-09T08:17:22.980162+0000","last_unstale":"2023-10-09T08:17:22.983385+0000","last_undegraded":"2023-10-09T08:17:22.983385+0000","last_fullsized":"2023-10-09T08:17:22.983385+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:08:19.846565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.989126+0000","last_change":"2023-10-09T08:17:22.986866+0000","last_active":"2023-10-09T08:17:22.989126+0000","last_peered":"2023-10-09T08:17:22.989126+0000","last_clean":"2023-10-09T08:17:22.989126+0000","last_became_active":"2023-10-09T08:17:22.986627+0000","last_became_peered":"2023-10-09T08:17:22.986627+0000","last_unstale":"2023-10-09T08:17:22.989126+0000","last_undegraded":"2023-10-09T08:17:22.989126+0000","last_fullsized":"2023-10-09T08:17:22.989126+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:47.563936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982856+0000","last_change":"2023-10-09T08:17:22.978532+0000","last_active":"2023-10-09T08:17:22.982856+0000","last_peered":"2023-10-09T08:17:22.982856+0000","last_clean":"2023-10-09T08:17:22.982856+0000","last_became_active":"2023-10-09T08:17:22.978261+0000","last_became_peered":"2023-10-09T08:17:22.978261+0000","last_unstale":"2023-10-09T08:17:22.982856+0000","last_undegraded":"2023-10-09T08:17:22.982856+0000","last_fullsized":"2023-10-09T08:17:22.982856+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:02.562263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.981672+0000","last_change":"2023-10-09T08:17:22.978795+0000","last_active":"2023-10-09T08:17:22.981672+0000","last_peered":"2023-10-09T08:17:22.981672+0000","last_clean":"2023-10-09T08:17:22.981672+0000","last_became_active":"2023-10-09T08:17:22.978557+0000","last_became_peered":"2023-10-09T08:17:22.978557+0000","last_unstale":"2023-10-09T08:17:22.981672+0000","last_undegraded":"2023-10-09T08:17:22.981672+0000","last_fullsized":"2023-10-09T08:17:22.981672+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:19.484500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.984320+0000","last_change":"2023-10-09T08:17:22.981507+0000","last_active":"2023-10-09T08:17:22.984320+0000","last_peered":"2023-10-09T08:17:22.984320+0000","last_clean":"2023-10-09T08:17:22.984320+0000","last_became_active":"2023-10-09T08:17:22.981260+0000","last_became_peered":"2023-10-09T08:17:22.981260+0000","last_unstale":"2023-10-09T08:17:22.984320+0000","last_undegraded":"2023-10-09T08:17:22.984320+0000","last_fullsized":"2023-10-09T08:17:22.984320+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:32.306795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.971000+0000","last_change":"2023-10-09T08:17:22.967502+0000","last_active":"2023-10-09T08:17:22.971000+0000","last_peered":"2023-10-09T08:17:22.971000+0000","last_clean":"2023-10-09T08:17:22.971000+0000","last_became_active":"2023-10-09T08:17:22.967258+0000","last_became_peered":"2023-10-09T08:17:22.967258+0000","last_unstale":"2023-10-09T08:17:22.971000+0000","last_undegraded":"2023-10-09T08:17:22.971000+0000","last_fullsized":"2023-10-09T08:17:22.971000+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:02.453697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.987859+0000","last_change":"2023-10-09T08:17:22.983766+0000","last_active":"2023-10-09T08:17:22.987859+0000","last_peered":"2023-10-09T08:17:22.987859+0000","last_clean":"2023-10-09T08:17:22.987859+0000","last_became_active":"2023-10-09T08:17:22.983486+0000","last_became_peered":"2023-10-09T08:17:22.983486+0000","last_unstale":"2023-10-09T08:17:22.987859+0000","last_undegraded":"2023-10-09T08:17:22.987859+0000","last_fullsized":"2023-10-09T08:17:22.987859+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:19.484500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.988639+0000","last_change":"2023-10-09T08:17:22.983416+0000","last_active":"2023-10-09T08:17:22.988639+0000","last_peered":"2023-10-09T08:17:22.988639+0000","last_clean":"2023-10-09T08:17:22.988639+0000","last_became_active":"2023-10-09T08:17:22.981717+0000","last_became_peered":"2023-10-09T08:17:22.981717+0000","last_unstale":"2023-10-09T08:17:22.988639+0000","last_undegraded":"2023-10-09T08:17:22.988639+0000","last_fullsized":"2023-10-09T08:17:22.988639+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:51.687684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.984150+0000","last_change":"2023-10-09T08:17:22.979132+0000","last_active":"2023-10-09T08:17:22.984150+0000","last_peered":"2023-10-09T08:17:22.984150+0000","last_clean":"2023-10-09T08:17:22.984150+0000","last_became_active":"2023-10-09T08:17:22.978851+0000","last_became_peered":"2023-10-09T08:17:22.978851+0000","last_unstale":"2023-10-09T08:17:22.984150+0000","last_undegraded":"2023-10-09T08:17:22.984150+0000","last_fullsized":"2023-10-09T08:17:22.984150+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:49.270902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.990217+0000","last_change":"2023-10-09T08:17:22.987682+0000","last_active":"2023-10-09T08:17:22.990217+0000","last_peered":"2023-10-09T08:17:22.990217+0000","last_clean":"2023-10-09T08:17:22.990217+0000","last_became_active":"2023-10-09T08:17:22.987386+0000","last_became_peered":"2023-10-09T08:17:22.987386+0000","last_unstale":"2023-10-09T08:17:22.990217+0000","last_undegraded":"2023-10-09T08:17:22.990217+0000","last_fullsized":"2023-10-09T08:17:22.990217+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:27.388825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.987577+0000","last_change":"2023-10-09T08:17:22.982892+0000","last_active":"2023-10-09T08:17:22.987577+0000","last_peered":"2023-10-09T08:17:22.987577+0000","last_clean":"2023-10-09T08:17:22.987577+0000","last_became_active":"2023-10-09T08:17:22.982606+0000","last_became_peered":"2023-10-09T08:17:22.982606+0000","last_unstale":"2023-10-09T08:17:22.987577+0000","last_undegraded":"2023-10-09T08:17:22.987577+0000","last_fullsized":"2023-10-09T08:17:22.987577+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:39:14.673480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.985960+0000","last_change":"2023-10-09T08:17:22.981482+0000","last_active":"2023-10-09T08:17:22.985960+0000","last_peered":"2023-10-09T08:17:22.985960+0000","last_clean":"2023-10-09T08:17:22.985960+0000","last_became_active":"2023-10-09T08:17:22.981186+0000","last_became_peered":"2023-10-09T08:17:22.981186+0000","last_unstale":"2023-10-09T08:17:22.985960+0000","last_undegraded":"2023-10-09T08:17:22.985960+0000","last_fullsized":"2023-10-09T08:17:22.985960+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:17.661906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982719+0000","last_change":"2023-10-09T08:17:22.979154+0000","last_active":"2023-10-09T08:17:22.982719+0000","last_peered":"2023-10-09T08:17:22.982719+0000","last_clean":"2023-10-09T08:17:22.982719+0000","last_became_active":"2023-10-09T08:17:22.978890+0000","last_became_peered":"2023-10-09T08:17:22.978890+0000","last_unstale":"2023-10-09T08:17:22.982719+0000","last_undegraded":"2023-10-09T08:17:22.982719+0000","last_fullsized":"2023-10-09T08:17:22.982719+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:58:30.104097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.971747+0000","last_change":"2023-10-09T08:17:22.968330+0000","last_active":"2023-10-09T08:17:22.971747+0000","last_peered":"2023-10-09T08:17:22.971747+0000","last_clean":"2023-10-09T08:17:22.971747+0000","last_became_active":"2023-10-09T08:17:22.968098+0000","last_became_peered":"2023-10-09T08:17:22.968098+0000","last_unstale":"2023-10-09T08:17:22.971747+0000","last_undegraded":"2023-10-09T08:17:22.971747+0000","last_fullsized":"2023-10-09T08:17:22.971747+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:26.390859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.992436+0000","last_change":"2023-10-09T08:17:22.987389+0000","last_active":"2023-10-09T08:17:22.992436+0000","last_peered":"2023-10-09T08:17:22.992436+0000","last_clean":"2023-10-09T08:17:22.992436+0000","last_became_active":"2023-10-09T08:17:22.987114+0000","last_became_peered":"2023-10-09T08:17:22.987114+0000","last_unstale":"2023-10-09T08:17:22.992436+0000","last_undegraded":"2023-10-09T08:17:22.992436+0000","last_fullsized":"2023-10-09T08:17:22.992436+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:50.692531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.986775+0000","last_change":"2023-10-09T08:17:22.983507+0000","last_active":"2023-10-09T08:17:22.986775+0000","last_peered":"2023-10-09T08:17:22.986775+0000","last_clean":"2023-10-09T08:17:22.986775+0000","last_became_active":"2023-10-09T08:17:22.983220+0000","last_became_peered":"2023-10-09T08:17:22.983220+0000","last_unstale":"2023-10-09T08:17:22.986775+0000","last_undegraded":"2023-10-09T08:17:22.986775+0000","last_fullsized":"2023-10-09T08:17:22.986775+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:43:41.322751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.991789+0000","last_change":"2023-10-09T08:17:22.987121+0000","last_active":"2023-10-09T08:17:22.991789+0000","last_peered":"2023-10-09T08:17:22.991789+0000","last_clean":"2023-10-09T08:17:22.991789+0000","last_became_active":"2023-10-09T08:17:22.986832+0000","last_became_peered":"2023-10-09T08:17:22.986832+0000","last_unstale":"2023-10-09T08:17:22.991789+0000","last_undegraded":"2023-10-09T08:17:22.991789+0000","last_fullsized":"2023-10-09T08:17:22.991789+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:42:42.958751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.990448+0000","last_change":"2023-10-09T08:17:22.986695+0000","last_active":"2023-10-09T08:17:22.990448+0000","last_peered":"2023-10-09T08:17:22.990448+0000","last_clean":"2023-10-09T08:17:22.990448+0000","last_became_active":"2023-10-09T08:17:22.986436+0000","last_became_peered":"2023-10-09T08:17:22.986436+0000","last_unstale":"2023-10-09T08:17:22.990448+0000","last_undegraded":"2023-10-09T08:17:22.990448+0000","last_fullsized":"2023-10-09T08:17:22.990448+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:39:24.985715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982837+0000","last_change":"2023-10-09T08:17:22.977788+0000","last_active":"2023-10-09T08:17:22.982837+0000","last_peered":"2023-10-09T08:17:22.982837+0000","last_clean":"2023-10-09T08:17:22.982837+0000","last_became_active":"2023-10-09T08:17:22.977521+0000","last_became_peered":"2023-10-09T08:17:22.977521+0000","last_unstale":"2023-10-09T08:17:22.982837+0000","last_undegraded":"2023-10-09T08:17:22.982837+0000","last_fullsized":"2023-10-09T08:17:22.982837+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:31.629347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.980841+0000","last_change":"2023-10-09T08:17:22.977049+0000","last_active":"2023-10-09T08:17:22.980841+0000","last_peered":"2023-10-09T08:17:22.980841+0000","last_clean":"2023-10-09T08:17:22.980841+0000","last_became_active":"2023-10-09T08:17:22.976779+0000","last_became_peered":"2023-10-09T08:17:22.976779+0000","last_unstale":"2023-10-09T08:17:22.980841+0000","last_undegraded":"2023-10-09T08:17:22.980841+0000","last_fullsized":"2023-10-09T08:17:22.980841+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:41.226637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.985723+0000","last_change":"2023-10-09T08:17:22.984732+0000","last_active":"2023-10-09T08:17:22.985723+0000","last_peered":"2023-10-09T08:17:22.985723+0000","last_clean":"2023-10-09T08:17:22.985723+0000","last_became_active":"2023-10-09T08:17:22.984481+0000","last_became_peered":"2023-10-09T08:17:22.984481+0000","last_unstale":"2023-10-09T08:17:22.985723+0000","last_undegraded":"2023-10-09T08:17:22.985723+0000","last_fullsized":"2023-10-09T08:17:22.985723+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:24:10.514407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983916+0000","last_change":"2023-10-09T08:17:22.974270+0000","last_active":"2023-10-09T08:17:22.983916+0000","last_peered":"2023-10-09T08:17:22.983916+0000","last_clean":"2023-10-09T08:17:22.983916+0000","last_became_active":"2023-10-09T08:17:22.974010+0000","last_became_peered":"2023-10-09T08:17:22.974010+0000","last_unstale":"2023-10-09T08:17:22.983916+0000","last_undegraded":"2023-10-09T08:17:22.983916+0000","last_fullsized":"2023-10-09T08:17:22.983916+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:10:24.260909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.993454+0000","last_change":"2023-10-09T08:17:22.990928+0000","last_active":"2023-10-09T08:17:22.993454+0000","last_peered":"2023-10-09T08:17:22.993454+0000","last_clean":"2023-10-09T08:17:22.993454+0000","last_became_active":"2023-10-09T08:17:22.990615+0000","last_became_peered":"2023-10-09T08:17:22.990615+0000","last_unstale":"2023-10-09T08:17:22.993454+0000","last_undegraded":"2023-10-09T08:17:22.993454+0000","last_fullsized":"2023-10-09T08:17:22.993454+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:04.216623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.985251+0000","last_change":"2023-10-09T08:17:22.983336+0000","last_active":"2023-10-09T08:17:22.985251+0000","last_peered":"2023-10-09T08:17:22.985251+0000","last_clean":"2023-10-09T08:17:22.985251+0000","last_became_active":"2023-10-09T08:17:22.983072+0000","last_became_peered":"2023-10-09T08:17:22.983072+0000","last_unstale":"2023-10-09T08:17:22.985251+0000","last_undegraded":"2023-10-09T08:17:22.985251+0000","last_fullsized":"2023-10-09T08:17:22.985251+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:04.142683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983367+0000","last_change":"2023-10-09T08:17:22.979452+0000","last_active":"2023-10-09T08:17:22.983367+0000","last_peered":"2023-10-09T08:17:22.983367+0000","last_clean":"2023-10-09T08:17:22.983367+0000","last_became_active":"2023-10-09T08:17:22.979151+0000","last_became_peered":"2023-10-09T08:17:22.979151+0000","last_unstale":"2023-10-09T08:17:22.983367+0000","last_undegraded":"2023-10-09T08:17:22.983367+0000","last_fullsized":"2023-10-09T08:17:22.983367+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:16:27.730608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.975230+0000","last_change":"2023-10-09T08:17:22.973609+0000","last_active":"2023-10-09T08:17:22.975230+0000","last_peered":"2023-10-09T08:17:22.975230+0000","last_clean":"2023-10-09T08:17:22.975230+0000","last_became_active":"2023-10-09T08:17:22.973223+0000","last_became_peered":"2023-10-09T08:17:22.973223+0000","last_unstale":"2023-10-09T08:17:22.975230+0000","last_undegraded":"2023-10-09T08:17:22.975230+0000","last_fullsized":"2023-10-09T08:17:22.975230+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:14.281969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.987553+0000","last_change":"2023-10-09T08:17:22.982710+0000","last_active":"2023-10-09T08:17:22.987553+0000","last_peered":"2023-10-09T08:17:22.987553+0000","last_clean":"2023-10-09T08:17:22.987553+0000","last_became_active":"2023-10-09T08:17:22.982289+0000","last_became_peered":"2023-10-09T08:17:22.982289+0000","last_unstale":"2023-10-09T08:17:22.987553+0000","last_undegraded":"2023-10-09T08:17:22.987553+0000","last_fullsized":"2023-10-09T08:17:22.987553+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:57.461312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.984152+0000","last_change":"2023-10-09T08:17:22.978840+0000","last_active":"2023-10-09T08:17:22.984152+0000","last_peered":"2023-10-09T08:17:22.984152+0000","last_clean":"2023-10-09T08:17:22.984152+0000","last_became_active":"2023-10-09T08:17:22.978578+0000","last_became_peered":"2023-10-09T08:17:22.978578+0000","last_unstale":"2023-10-09T08:17:22.984152+0000","last_undegraded":"2023-10-09T08:17:22.984152+0000","last_fullsized":"2023-10-09T08:17:22.984152+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:50.742518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983370+0000","last_change":"2023-10-09T08:17:22.982342+0000","last_active":"2023-10-09T08:17:22.983370+0000","last_peered":"2023-10-09T08:17:22.983370+0000","last_clean":"2023-10-09T08:17:22.983370+0000","last_became_active":"2023-10-09T08:17:22.982076+0000","last_became_peered":"2023-10-09T08:17:22.982076+0000","last_unstale":"2023-10-09T08:17:22.983370+0000","last_undegraded":"2023-10-09T08:17:22.983370+0000","last_fullsized":"2023-10-09T08:17:22.983370+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:25:17.661906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.973192+0000","last_change":"2023-10-09T08:17:22.969013+0000","last_active":"2023-10-09T08:17:22.973192+0000","last_peered":"2023-10-09T08:17:22.973192+0000","last_clean":"2023-10-09T08:17:22.973192+0000","last_became_active":"2023-10-09T08:17:22.968732+0000","last_became_peered":"2023-10-09T08:17:22.968732+0000","last_unstale":"2023-10-09T08:17:22.973192+0000","last_undegraded":"2023-10-09T08:17:22.973192+0000","last_fullsized":"2023-10-09T08:17:22.973192+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:38:56.087344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.972930+0000","last_change":"2023-10-09T08:17:22.971110+0000","last_active":"2023-10-09T08:17:22.972930+0000","last_peered":"2023-10-09T08:17:22.972930+0000","last_clean":"2023-10-09T08:17:22.972930+0000","last_became_active":"2023-10-09T08:17:22.970864+0000","last_became_peered":"2023-10-09T08:17:22.970864+0000","last_unstale":"2023-10-09T08:17:22.972930+0000","last_undegraded":"2023-10-09T08:17:22.972930+0000","last_fullsized":"2023-10-09T08:17:22.972930+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:35:13.889838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"209'4","reported_seq":14,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997902+0000","last_change":"2023-10-09T08:17:21.981359+0000","last_active":"2023-10-09T08:17:22.997902+0000","last_peered":"2023-10-09T08:17:22.997902+0000","last_clean":"2023-10-09T08:17:22.997902+0000","last_became_active":"2023-10-09T08:17:21.981080+0000","last_became_peered":"2023-10-09T08:17:21.981080+0000","last_unstale":"2023-10-09T08:17:22.997902+0000","last_undegraded":"2023-10-09T08:17:22.997902+0000","last_fullsized":"2023-10-09T08:17:22.997902+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:38.043951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.981880+0000","last_change":"2023-10-09T08:17:22.977736+0000","last_active":"2023-10-09T08:17:22.981880+0000","last_peered":"2023-10-09T08:17:22.981880+0000","last_clean":"2023-10-09T08:17:22.981880+0000","last_became_active":"2023-10-09T08:17:22.976851+0000","last_became_peered":"2023-10-09T08:17:22.976851+0000","last_unstale":"2023-10-09T08:17:22.981880+0000","last_undegraded":"2023-10-09T08:17:22.981880+0000","last_fullsized":"2023-10-09T08:17:22.981880+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:22:35.631994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"209'1","reported_seq":11,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.993643+0000","last_change":"2023-10-09T08:17:21.973999+0000","last_active":"2023-10-09T08:17:22.993643+0000","last_peered":"2023-10-09T08:17:22.993643+0000","last_clean":"2023-10-09T08:17:22.993643+0000","last_became_active":"2023-10-09T08:17:21.973711+0000","last_became_peered":"2023-10-09T08:17:21.973711+0000","last_unstale":"2023-10-09T08:17:22.993643+0000","last_undegraded":"2023-10-09T08:17:22.993643+0000","last_fullsized":"2023-10-09T08:17:22.993643+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:39:13.866505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.974564+0000","last_change":"2023-10-09T08:17:22.970652+0000","last_active":"2023-10-09T08:17:22.974564+0000","last_peered":"2023-10-09T08:17:22.974564+0000","last_clean":"2023-10-09T08:17:22.974564+0000","last_became_active":"2023-10-09T08:17:22.970213+0000","last_became_peered":"2023-10-09T08:17:22.970213+0000","last_unstale":"2023-10-09T08:17:22.974564+0000","last_undegraded":"2023-10-09T08:17:22.974564+0000","last_fullsized":"2023-10-09T08:17:22.974564+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:44:06.711747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.995441+0000","last_change":"2023-10-09T08:17:21.973213+0000","last_active":"2023-10-09T08:17:22.995441+0000","last_peered":"2023-10-09T08:17:22.995441+0000","last_clean":"2023-10-09T08:17:22.995441+0000","last_became_active":"2023-10-09T08:17:21.972952+0000","last_became_peered":"2023-10-09T08:17:21.972952+0000","last_unstale":"2023-10-09T08:17:22.995441+0000","last_undegraded":"2023-10-09T08:17:22.995441+0000","last_fullsized":"2023-10-09T08:17:22.995441+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:28.933060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.977359+0000","last_change":"2023-10-09T08:17:22.974337+0000","last_active":"2023-10-09T08:17:22.977359+0000","last_peered":"2023-10-09T08:17:22.977359+0000","last_clean":"2023-10-09T08:17:22.977359+0000","last_became_active":"2023-10-09T08:17:22.974082+0000","last_became_peered":"2023-10-09T08:17:22.974082+0000","last_unstale":"2023-10-09T08:17:22.977359+0000","last_undegraded":"2023-10-09T08:17:22.977359+0000","last_fullsized":"2023-10-09T08:17:22.977359+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:54:24.695442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.993356+0000","last_change":"2023-10-09T08:17:21.975430+0000","last_active":"2023-10-09T08:17:22.993356+0000","last_peered":"2023-10-09T08:17:22.993356+0000","last_clean":"2023-10-09T08:17:22.993356+0000","last_became_active":"2023-10-09T08:17:21.975185+0000","last_became_peered":"2023-10-09T08:17:21.975185+0000","last_unstale":"2023-10-09T08:17:22.993356+0000","last_undegraded":"2023-10-09T08:17:22.993356+0000","last_fullsized":"2023-10-09T08:17:22.993356+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:20.482226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.978894+0000","last_change":"2023-10-09T08:17:22.976545+0000","last_active":"2023-10-09T08:17:22.978894+0000","last_peered":"2023-10-09T08:17:22.978894+0000","last_clean":"2023-10-09T08:17:22.978894+0000","last_became_active":"2023-10-09T08:17:22.976305+0000","last_became_peered":"2023-10-09T08:17:22.976305+0000","last_unstale":"2023-10-09T08:17:22.978894+0000","last_undegraded":"2023-10-09T08:17:22.978894+0000","last_fullsized":"2023-10-09T08:17:22.978894+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:39.805879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"209'1","reported_seq":11,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997521+0000","last_change":"2023-10-09T08:17:21.979102+0000","last_active":"2023-10-09T08:17:22.997521+0000","last_peered":"2023-10-09T08:17:22.997521+0000","last_clean":"2023-10-09T08:17:22.997521+0000","last_became_active":"2023-10-09T08:17:21.977114+0000","last_became_peered":"2023-10-09T08:17:21.977114+0000","last_unstale":"2023-10-09T08:17:22.997521+0000","last_undegraded":"2023-10-09T08:17:22.997521+0000","last_fullsized":"2023-10-09T08:17:22.997521+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:59.752920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.972264+0000","last_change":"2023-10-09T08:17:22.968229+0000","last_active":"2023-10-09T08:17:22.972264+0000","last_peered":"2023-10-09T08:17:22.972264+0000","last_clean":"2023-10-09T08:17:22.972264+0000","last_became_active":"2023-10-09T08:17:22.967986+0000","last_became_peered":"2023-10-09T08:17:22.967986+0000","last_unstale":"2023-10-09T08:17:22.972264+0000","last_undegraded":"2023-10-09T08:17:22.972264+0000","last_fullsized":"2023-10-09T08:17:22.972264+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:30.679481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"209'1","reported_seq":11,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997465+0000","last_change":"2023-10-09T08:17:21.974938+0000","last_active":"2023-10-09T08:17:22.997465+0000","last_peered":"2023-10-09T08:17:22.997465+0000","last_clean":"2023-10-09T08:17:22.997465+0000","last_became_active":"2023-10-09T08:17:21.974701+0000","last_became_peered":"2023-10-09T08:17:21.974701+0000","last_unstale":"2023-10-09T08:17:22.997465+0000","last_undegraded":"2023-10-09T08:17:22.997465+0000","last_fullsized":"2023-10-09T08:17:22.997465+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:39:13.667615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.979263+0000","last_change":"2023-10-09T08:17:22.975840+0000","last_active":"2023-10-09T08:17:22.979263+0000","last_peered":"2023-10-09T08:17:22.979263+0000","last_clean":"2023-10-09T08:17:22.979263+0000","last_became_active":"2023-10-09T08:17:22.975564+0000","last_became_peered":"2023-10-09T08:17:22.975564+0000","last_unstale":"2023-10-09T08:17:22.979263+0000","last_undegraded":"2023-10-09T08:17:22.979263+0000","last_fullsized":"2023-10-09T08:17:22.979263+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:57:29.061415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.971606+0000","last_change":"2023-10-09T08:17:21.975736+0000","last_active":"2023-10-09T08:17:22.971606+0000","last_peered":"2023-10-09T08:17:22.971606+0000","last_clean":"2023-10-09T08:17:22.971606+0000","last_became_active":"2023-10-09T08:17:21.975485+0000","last_became_peered":"2023-10-09T08:17:21.975485+0000","last_unstale":"2023-10-09T08:17:22.971606+0000","last_undegraded":"2023-10-09T08:17:22.971606+0000","last_fullsized":"2023-10-09T08:17:22.971606+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:22.558736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.980865+0000","last_change":"2023-10-09T08:17:22.975094+0000","last_active":"2023-10-09T08:17:22.980865+0000","last_peered":"2023-10-09T08:17:22.980865+0000","last_clean":"2023-10-09T08:17:22.980865+0000","last_became_active":"2023-10-09T08:17:22.974826+0000","last_became_peered":"2023-10-09T08:17:22.974826+0000","last_unstale":"2023-10-09T08:17:22.980865+0000","last_undegraded":"2023-10-09T08:17:22.980865+0000","last_fullsized":"2023-10-09T08:17:22.980865+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:21.488090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.964826+0000","last_change":"2023-10-09T08:17:21.970071+0000","last_active":"2023-10-09T08:17:22.964826+0000","last_peered":"2023-10-09T08:17:22.964826+0000","last_clean":"2023-10-09T08:17:22.964826+0000","last_became_active":"2023-10-09T08:17:21.969809+0000","last_became_peered":"2023-10-09T08:17:21.969809+0000","last_unstale":"2023-10-09T08:17:22.964826+0000","last_undegraded":"2023-10-09T08:17:22.964826+0000","last_fullsized":"2023-10-09T08:17:22.964826+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:30.623483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.973746+0000","last_change":"2023-10-09T08:17:22.972774+0000","last_active":"2023-10-09T08:17:22.973746+0000","last_peered":"2023-10-09T08:17:22.973746+0000","last_clean":"2023-10-09T08:17:22.973746+0000","last_became_active":"2023-10-09T08:17:22.972520+0000","last_became_peered":"2023-10-09T08:17:22.972520+0000","last_unstale":"2023-10-09T08:17:22.973746+0000","last_undegraded":"2023-10-09T08:17:22.973746+0000","last_fullsized":"2023-10-09T08:17:22.973746+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:24.899441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.966427+0000","last_change":"2023-10-09T08:17:21.980454+0000","last_active":"2023-10-09T08:17:22.966427+0000","last_peered":"2023-10-09T08:17:22.966427+0000","last_clean":"2023-10-09T08:17:22.966427+0000","last_became_active":"2023-10-09T08:17:21.980212+0000","last_became_peered":"2023-10-09T08:17:21.980212+0000","last_unstale":"2023-10-09T08:17:22.966427+0000","last_undegraded":"2023-10-09T08:17:22.966427+0000","last_fullsized":"2023-10-09T08:17:22.966427+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:19.075882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.974546+0000","last_change":"2023-10-09T08:17:22.970468+0000","last_active":"2023-10-09T08:17:22.974546+0000","last_peered":"2023-10-09T08:17:22.974546+0000","last_clean":"2023-10-09T08:17:22.974546+0000","last_became_active":"2023-10-09T08:17:22.969789+0000","last_became_peered":"2023-10-09T08:17:22.969789+0000","last_unstale":"2023-10-09T08:17:22.974546+0000","last_undegraded":"2023-10-09T08:17:22.974546+0000","last_fullsized":"2023-10-09T08:17:22.974546+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:42.923655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"209'3","reported_seq":13,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.998217+0000","last_change":"2023-10-09T08:17:21.977462+0000","last_active":"2023-10-09T08:17:22.998217+0000","last_peered":"2023-10-09T08:17:22.998217+0000","last_clean":"2023-10-09T08:17:22.998217+0000","last_became_active":"2023-10-09T08:17:21.977059+0000","last_became_peered":"2023-10-09T08:17:21.977059+0000","last_unstale":"2023-10-09T08:17:22.998217+0000","last_undegraded":"2023-10-09T08:17:22.998217+0000","last_fullsized":"2023-10-09T08:17:22.998217+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:28.289402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.980213+0000","last_change":"2023-10-09T08:17:22.975853+0000","last_active":"2023-10-09T08:17:22.980213+0000","last_peered":"2023-10-09T08:17:22.980213+0000","last_clean":"2023-10-09T08:17:22.980213+0000","last_became_active":"2023-10-09T08:17:22.975560+0000","last_became_peered":"2023-10-09T08:17:22.975560+0000","last_unstale":"2023-10-09T08:17:22.980213+0000","last_undegraded":"2023-10-09T08:17:22.980213+0000","last_fullsized":"2023-10-09T08:17:22.980213+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:33:39.216798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"209'6","reported_seq":16,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.999925+0000","last_change":"2023-10-09T08:17:21.971926+0000","last_active":"2023-10-09T08:17:22.999925+0000","last_peered":"2023-10-09T08:17:22.999925+0000","last_clean":"2023-10-09T08:17:22.999925+0000","last_became_active":"2023-10-09T08:17:21.971645+0000","last_became_peered":"2023-10-09T08:17:21.971645+0000","last_unstale":"2023-10-09T08:17:22.999925+0000","last_undegraded":"2023-10-09T08:17:22.999925+0000","last_fullsized":"2023-10-09T08:17:22.999925+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:39:13.866505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.987320+0000","last_change":"2023-10-09T08:17:22.985018+0000","last_active":"2023-10-09T08:17:22.987320+0000","last_peered":"2023-10-09T08:17:22.987320+0000","last_clean":"2023-10-09T08:17:22.987320+0000","last_became_active":"2023-10-09T08:17:22.984647+0000","last_became_peered":"2023-10-09T08:17:22.984647+0000","last_unstale":"2023-10-09T08:17:22.987320+0000","last_undegraded":"2023-10-09T08:17:22.987320+0000","last_fullsized":"2023-10-09T08:17:22.987320+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:40:00.458280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997202+0000","last_change":"2023-10-09T08:17:21.975388+0000","last_active":"2023-10-09T08:17:22.997202+0000","last_peered":"2023-10-09T08:17:22.997202+0000","last_clean":"2023-10-09T08:17:22.997202+0000","last_became_active":"2023-10-09T08:17:21.974540+0000","last_became_peered":"2023-10-09T08:17:21.974540+0000","last_unstale":"2023-10-09T08:17:22.997202+0000","last_undegraded":"2023-10-09T08:17:22.997202+0000","last_fullsized":"2023-10-09T08:17:22.997202+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:39:02.110538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.984496+0000","last_change":"2023-10-09T08:17:22.982417+0000","last_active":"2023-10-09T08:17:22.984496+0000","last_peered":"2023-10-09T08:17:22.984496+0000","last_clean":"2023-10-09T08:17:22.984496+0000","last_became_active":"2023-10-09T08:17:22.982109+0000","last_became_peered":"2023-10-09T08:17:22.982109+0000","last_unstale":"2023-10-09T08:17:22.984496+0000","last_undegraded":"2023-10-09T08:17:22.984496+0000","last_fullsized":"2023-10-09T08:17:22.984496+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:46.160662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.967604+0000","last_change":"2023-10-09T08:17:21.981649+0000","last_active":"2023-10-09T08:17:22.967604+0000","last_peered":"2023-10-09T08:17:22.967604+0000","last_clean":"2023-10-09T08:17:22.967604+0000","last_became_active":"2023-10-09T08:17:21.981362+0000","last_became_peered":"2023-10-09T08:17:21.981362+0000","last_unstale":"2023-10-09T08:17:22.967604+0000","last_undegraded":"2023-10-09T08:17:22.967604+0000","last_fullsized":"2023-10-09T08:17:22.967604+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:03.261223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.987911+0000","last_change":"2023-10-09T08:17:22.983600+0000","last_active":"2023-10-09T08:17:22.987911+0000","last_peered":"2023-10-09T08:17:22.987911+0000","last_clean":"2023-10-09T08:17:22.987911+0000","last_became_active":"2023-10-09T08:17:22.983276+0000","last_became_peered":"2023-10-09T08:17:22.983276+0000","last_unstale":"2023-10-09T08:17:22.987911+0000","last_undegraded":"2023-10-09T08:17:22.987911+0000","last_fullsized":"2023-10-09T08:17:22.987911+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:16:27.730608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.961371+0000","last_change":"2023-10-09T08:17:21.976656+0000","last_active":"2023-10-09T08:17:22.961371+0000","last_peered":"2023-10-09T08:17:22.961371+0000","last_clean":"2023-10-09T08:17:22.961371+0000","last_became_active":"2023-10-09T08:17:21.976292+0000","last_became_peered":"2023-10-09T08:17:21.976292+0000","last_unstale":"2023-10-09T08:17:22.961371+0000","last_undegraded":"2023-10-09T08:17:22.961371+0000","last_fullsized":"2023-10-09T08:17:22.961371+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:00:59.557712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983496+0000","last_change":"2023-10-09T08:17:22.979323+0000","last_active":"2023-10-09T08:17:22.983496+0000","last_peered":"2023-10-09T08:17:22.983496+0000","last_clean":"2023-10-09T08:17:22.983496+0000","last_became_active":"2023-10-09T08:17:22.972209+0000","last_became_peered":"2023-10-09T08:17:22.972209+0000","last_unstale":"2023-10-09T08:17:22.983496+0000","last_undegraded":"2023-10-09T08:17:22.983496+0000","last_fullsized":"2023-10-09T08:17:22.983496+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:40.009878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"209'8","reported_seq":18,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.998098+0000","last_change":"2023-10-09T08:17:21.975369+0000","last_active":"2023-10-09T08:17:22.998098+0000","last_peered":"2023-10-09T08:17:22.998098+0000","last_clean":"2023-10-09T08:17:22.998098+0000","last_became_active":"2023-10-09T08:17:21.974853+0000","last_became_peered":"2023-10-09T08:17:21.974853+0000","last_unstale":"2023-10-09T08:17:22.998098+0000","last_undegraded":"2023-10-09T08:17:22.998098+0000","last_fullsized":"2023-10-09T08:17:22.998098+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:50.234694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.991744+0000","last_change":"2023-10-09T08:17:22.988118+0000","last_active":"2023-10-09T08:17:22.991744+0000","last_peered":"2023-10-09T08:17:22.991744+0000","last_clean":"2023-10-09T08:17:22.991744+0000","last_became_active":"2023-10-09T08:17:22.987859+0000","last_became_peered":"2023-10-09T08:17:22.987859+0000","last_unstale":"2023-10-09T08:17:22.991744+0000","last_undegraded":"2023-10-09T08:17:22.991744+0000","last_fullsized":"2023-10-09T08:17:22.991744+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:09:01.740678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"209'1","reported_seq":11,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997761+0000","last_change":"2023-10-09T08:17:21.977355+0000","last_active":"2023-10-09T08:17:22.997761+0000","last_peered":"2023-10-09T08:17:22.997761+0000","last_clean":"2023-10-09T08:17:22.997761+0000","last_became_active":"2023-10-09T08:17:21.977044+0000","last_became_peered":"2023-10-09T08:17:21.977044+0000","last_unstale":"2023-10-09T08:17:22.997761+0000","last_undegraded":"2023-10-09T08:17:22.997761+0000","last_fullsized":"2023-10-09T08:17:22.997761+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:35:04.782620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.987881+0000","last_change":"2023-10-09T08:17:22.984364+0000","last_active":"2023-10-09T08:17:22.987881+0000","last_peered":"2023-10-09T08:17:22.987881+0000","last_clean":"2023-10-09T08:17:22.987881+0000","last_became_active":"2023-10-09T08:17:22.984099+0000","last_became_peered":"2023-10-09T08:17:22.984099+0000","last_unstale":"2023-10-09T08:17:22.987881+0000","last_undegraded":"2023-10-09T08:17:22.987881+0000","last_fullsized":"2023-10-09T08:17:22.987881+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:40:00.458280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.996822+0000","last_change":"2023-10-09T08:17:21.974199+0000","last_active":"2023-10-09T08:17:22.996822+0000","last_peered":"2023-10-09T08:17:22.996822+0000","last_clean":"2023-10-09T08:17:22.996822+0000","last_became_active":"2023-10-09T08:17:21.973943+0000","last_became_peered":"2023-10-09T08:17:21.973943+0000","last_unstale":"2023-10-09T08:17:22.996822+0000","last_undegraded":"2023-10-09T08:17:22.996822+0000","last_fullsized":"2023-10-09T08:17:22.996822+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:56.455448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.985903+0000","last_change":"2023-10-09T08:17:22.980631+0000","last_active":"2023-10-09T08:17:22.985903+0000","last_peered":"2023-10-09T08:17:22.985903+0000","last_clean":"2023-10-09T08:17:22.985903+0000","last_became_active":"2023-10-09T08:17:22.980353+0000","last_became_peered":"2023-10-09T08:17:22.980353+0000","last_unstale":"2023-10-09T08:17:22.985903+0000","last_undegraded":"2023-10-09T08:17:22.985903+0000","last_fullsized":"2023-10-09T08:17:22.985903+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:08:19.846565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"209'1","reported_seq":11,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.997076+0000","last_change":"2023-10-09T08:17:21.975063+0000","last_active":"2023-10-09T08:17:22.997076+0000","last_peered":"2023-10-09T08:17:22.997076+0000","last_clean":"2023-10-09T08:17:22.997076+0000","last_became_active":"2023-10-09T08:17:21.974796+0000","last_became_peered":"2023-10-09T08:17:21.974796+0000","last_unstale":"2023-10-09T08:17:22.997076+0000","last_undegraded":"2023-10-09T08:17:22.997076+0000","last_fullsized":"2023-10-09T08:17:22.997076+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:23.082491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.988902+0000","last_change":"2023-10-09T08:17:22.986316+0000","last_active":"2023-10-09T08:17:22.988902+0000","last_peered":"2023-10-09T08:17:22.988902+0000","last_clean":"2023-10-09T08:17:22.988902+0000","last_became_active":"2023-10-09T08:17:22.986062+0000","last_became_peered":"2023-10-09T08:17:22.986062+0000","last_unstale":"2023-10-09T08:17:22.988902+0000","last_undegraded":"2023-10-09T08:17:22.988902+0000","last_fullsized":"2023-10-09T08:17:22.988902+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:23:00.102421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.964704+0000","last_change":"2023-10-09T08:17:21.972751+0000","last_active":"2023-10-09T08:17:22.964704+0000","last_peered":"2023-10-09T08:17:22.964704+0000","last_clean":"2023-10-09T08:17:22.964704+0000","last_became_active":"2023-10-09T08:17:21.972437+0000","last_became_peered":"2023-10-09T08:17:21.972437+0000","last_unstale":"2023-10-09T08:17:22.964704+0000","last_undegraded":"2023-10-09T08:17:22.964704+0000","last_fullsized":"2023-10-09T08:17:22.964704+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:38:55.081479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.980862+0000","last_change":"2023-10-09T08:17:22.977458+0000","last_active":"2023-10-09T08:17:22.980862+0000","last_peered":"2023-10-09T08:17:22.980862+0000","last_clean":"2023-10-09T08:17:22.980862+0000","last_became_active":"2023-10-09T08:17:22.976833+0000","last_became_peered":"2023-10-09T08:17:22.976833+0000","last_unstale":"2023-10-09T08:17:22.980862+0000","last_undegraded":"2023-10-09T08:17:22.980862+0000","last_fullsized":"2023-10-09T08:17:22.980862+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:20:52.374897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.993473+0000","last_change":"2023-10-09T08:17:21.981403+0000","last_active":"2023-10-09T08:17:22.993473+0000","last_peered":"2023-10-09T08:17:22.993473+0000","last_clean":"2023-10-09T08:17:22.993473+0000","last_became_active":"2023-10-09T08:17:21.981161+0000","last_became_peered":"2023-10-09T08:17:21.981161+0000","last_unstale":"2023-10-09T08:17:22.993473+0000","last_undegraded":"2023-10-09T08:17:22.993473+0000","last_fullsized":"2023-10-09T08:17:22.993473+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:27.699996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.974523+0000","last_change":"2023-10-09T08:17:22.971091+0000","last_active":"2023-10-09T08:17:22.974523+0000","last_peered":"2023-10-09T08:17:22.974523+0000","last_clean":"2023-10-09T08:17:22.974523+0000","last_became_active":"2023-10-09T08:17:22.970841+0000","last_became_peered":"2023-10-09T08:17:22.970841+0000","last_unstale":"2023-10-09T08:17:22.974523+0000","last_undegraded":"2023-10-09T08:17:22.974523+0000","last_fullsized":"2023-10-09T08:17:22.974523+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:03:06.011485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.964325+0000","last_change":"2023-10-09T08:17:21.975152+0000","last_active":"2023-10-09T08:17:22.964325+0000","last_peered":"2023-10-09T08:17:22.964325+0000","last_clean":"2023-10-09T08:17:22.964325+0000","last_became_active":"2023-10-09T08:17:21.974892+0000","last_became_peered":"2023-10-09T08:17:21.974892+0000","last_unstale":"2023-10-09T08:17:22.964325+0000","last_undegraded":"2023-10-09T08:17:22.964325+0000","last_fullsized":"2023-10-09T08:17:22.964325+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:27.291932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.986889+0000","last_change":"2023-10-09T08:17:22.981410+0000","last_active":"2023-10-09T08:17:22.986889+0000","last_peered":"2023-10-09T08:17:22.986889+0000","last_clean":"2023-10-09T08:17:22.986889+0000","last_became_active":"2023-10-09T08:17:22.981151+0000","last_became_peered":"2023-10-09T08:17:22.981151+0000","last_unstale":"2023-10-09T08:17:22.986889+0000","last_undegraded":"2023-10-09T08:17:22.986889+0000","last_fullsized":"2023-10-09T08:17:22.986889+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:41:28.365087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.965212+0000","last_change":"2023-10-09T08:17:21.980816+0000","last_active":"2023-10-09T08:17:22.965212+0000","last_peered":"2023-10-09T08:17:22.965212+0000","last_clean":"2023-10-09T08:17:22.965212+0000","last_became_active":"2023-10-09T08:17:21.980578+0000","last_became_peered":"2023-10-09T08:17:21.980578+0000","last_unstale":"2023-10-09T08:17:22.965212+0000","last_undegraded":"2023-10-09T08:17:22.965212+0000","last_fullsized":"2023-10-09T08:17:22.965212+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:47.769934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.992100+0000","last_change":"2023-10-09T08:17:22.987538+0000","last_active":"2023-10-09T08:17:22.992100+0000","last_peered":"2023-10-09T08:17:22.992100+0000","last_clean":"2023-10-09T08:17:22.992100+0000","last_became_active":"2023-10-09T08:17:22.987276+0000","last_became_peered":"2023-10-09T08:17:22.987276+0000","last_unstale":"2023-10-09T08:17:22.992100+0000","last_undegraded":"2023-10-09T08:17:22.992100+0000","last_fullsized":"2023-10-09T08:17:22.992100+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:22:11.081055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.965489+0000","last_change":"2023-10-09T08:17:21.972751+0000","last_active":"2023-10-09T08:17:22.965489+0000","last_peered":"2023-10-09T08:17:22.965489+0000","last_clean":"2023-10-09T08:17:22.965489+0000","last_became_active":"2023-10-09T08:17:21.972489+0000","last_became_peered":"2023-10-09T08:17:21.972489+0000","last_unstale":"2023-10-09T08:17:22.965489+0000","last_undegraded":"2023-10-09T08:17:22.965489+0000","last_fullsized":"2023-10-09T08:17:22.965489+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T10:44:05.705883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.979856+0000","last_change":"2023-10-09T08:17:22.976521+0000","last_active":"2023-10-09T08:17:22.979856+0000","last_peered":"2023-10-09T08:17:22.979856+0000","last_clean":"2023-10-09T08:17:22.979856+0000","last_became_active":"2023-10-09T08:17:22.976267+0000","last_became_peered":"2023-10-09T08:17:22.976267+0000","last_unstale":"2023-10-09T08:17:22.979856+0000","last_undegraded":"2023-10-09T08:17:22.979856+0000","last_fullsized":"2023-10-09T08:17:22.979856+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:26:51.085786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"209'2","reported_seq":12,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.995515+0000","last_change":"2023-10-09T08:17:21.978738+0000","last_active":"2023-10-09T08:17:22.995515+0000","last_peered":"2023-10-09T08:17:22.995515+0000","last_clean":"2023-10-09T08:17:22.995515+0000","last_became_active":"2023-10-09T08:17:21.978434+0000","last_became_peered":"2023-10-09T08:17:21.978434+0000","last_unstale":"2023-10-09T08:17:22.995515+0000","last_undegraded":"2023-10-09T08:17:22.995515+0000","last_fullsized":"2023-10-09T08:17:22.995515+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:18:28.973275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.985726+0000","last_change":"2023-10-09T08:17:22.981798+0000","last_active":"2023-10-09T08:17:22.985726+0000","last_peered":"2023-10-09T08:17:22.985726+0000","last_clean":"2023-10-09T08:17:22.985726+0000","last_became_active":"2023-10-09T08:17:22.981558+0000","last_became_peered":"2023-10-09T08:17:22.981558+0000","last_unstale":"2023-10-09T08:17:22.985726+0000","last_undegraded":"2023-10-09T08:17:22.985726+0000","last_fullsized":"2023-10-09T08:17:22.985726+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T08:56:15.613249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"210'1","reported_seq":11,"reported_epoch":210,"state":"active+clean","last_fresh":"2023-10-09T08:17:23.964036+0000","last_change":"2023-10-09T08:17:21.970119+0000","last_active":"2023-10-09T08:17:23.964036+0000","last_peered":"2023-10-09T08:17:23.964036+0000","last_clean":"2023-10-09T08:17:23.964036+0000","last_became_active":"2023-10-09T08:17:21.969872+0000","last_became_peered":"2023-10-09T08:17:21.969872+0000","last_unstale":"2023-10-09T08:17:23.964036+0000","last_undegraded":"2023-10-09T08:17:23.964036+0000","last_fullsized":"2023-10-09T08:17:23.964036+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:50.234694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.983970+0000","last_change":"2023-10-09T08:17:22.974514+0000","last_active":"2023-10-09T08:17:22.983970+0000","last_peered":"2023-10-09T08:17:22.983970+0000","last_clean":"2023-10-09T08:17:22.983970+0000","last_became_active":"2023-10-09T08:17:22.974268+0000","last_became_peered":"2023-10-09T08:17:22.974268+0000","last_unstale":"2023-10-09T08:17:22.983970+0000","last_undegraded":"2023-10-09T08:17:22.983970+0000","last_fullsized":"2023-10-09T08:17:22.983970+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:04.267087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.969883+0000","last_change":"2023-10-09T08:17:21.969312+0000","last_active":"2023-10-09T08:17:22.969883+0000","last_peered":"2023-10-09T08:17:22.969883+0000","last_clean":"2023-10-09T08:17:22.969883+0000","last_became_active":"2023-10-09T08:17:21.969051+0000","last_became_peered":"2023-10-09T08:17:21.969051+0000","last_unstale":"2023-10-09T08:17:22.969883+0000","last_undegraded":"2023-10-09T08:17:22.969883+0000","last_fullsized":"2023-10-09T08:17:22.969883+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:22.558736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.984369+0000","last_change":"2023-10-09T08:17:22.982056+0000","last_active":"2023-10-09T08:17:22.984369+0000","last_peered":"2023-10-09T08:17:22.984369+0000","last_clean":"2023-10-09T08:17:22.984369+0000","last_became_active":"2023-10-09T08:17:22.981764+0000","last_became_peered":"2023-10-09T08:17:22.981764+0000","last_unstale":"2023-10-09T08:17:22.984369+0000","last_undegraded":"2023-10-09T08:17:22.984369+0000","last_fullsized":"2023-10-09T08:17:22.984369+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:47.563936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.961506+0000","last_change":"2023-10-09T08:17:21.973015+0000","last_active":"2023-10-09T08:17:22.961506+0000","last_peered":"2023-10-09T08:17:22.961506+0000","last_clean":"2023-10-09T08:17:22.961506+0000","last_became_active":"2023-10-09T08:17:21.972770+0000","last_became_peered":"2023-10-09T08:17:21.972770+0000","last_unstale":"2023-10-09T08:17:22.961506+0000","last_undegraded":"2023-10-09T08:17:22.961506+0000","last_fullsized":"2023-10-09T08:17:22.961506+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:20.745815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982691+0000","last_change":"2023-10-09T08:17:22.977908+0000","last_active":"2023-10-09T08:17:22.982691+0000","last_peered":"2023-10-09T08:17:22.982691+0000","last_clean":"2023-10-09T08:17:22.982691+0000","last_became_active":"2023-10-09T08:17:22.977612+0000","last_became_peered":"2023-10-09T08:17:22.977612+0000","last_unstale":"2023-10-09T08:17:22.982691+0000","last_undegraded":"2023-10-09T08:17:22.982691+0000","last_fullsized":"2023-10-09T08:17:22.982691+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:23.588826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.965133+0000","last_change":"2023-10-09T08:17:21.973898+0000","last_active":"2023-10-09T08:17:22.965133+0000","last_peered":"2023-10-09T08:17:22.965133+0000","last_clean":"2023-10-09T08:17:22.965133+0000","last_became_active":"2023-10-09T08:17:21.973614+0000","last_became_peered":"2023-10-09T08:17:21.973614+0000","last_unstale":"2023-10-09T08:17:22.965133+0000","last_undegraded":"2023-10-09T08:17:22.965133+0000","last_fullsized":"2023-10-09T08:17:22.965133+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:23:19.929532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982978+0000","last_change":"2023-10-09T08:17:22.978269+0000","last_active":"2023-10-09T08:17:22.982978+0000","last_peered":"2023-10-09T08:17:22.982978+0000","last_clean":"2023-10-09T08:17:22.982978+0000","last_became_active":"2023-10-09T08:17:22.977903+0000","last_became_peered":"2023-10-09T08:17:22.977903+0000","last_unstale":"2023-10-09T08:17:22.982978+0000","last_undegraded":"2023-10-09T08:17:22.982978+0000","last_fullsized":"2023-10-09T08:17:22.982978+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:44.655055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.965701+0000","last_change":"2023-10-09T08:17:21.971878+0000","last_active":"2023-10-09T08:17:22.965701+0000","last_peered":"2023-10-09T08:17:22.965701+0000","last_clean":"2023-10-09T08:17:22.965701+0000","last_became_active":"2023-10-09T08:17:21.971614+0000","last_became_peered":"2023-10-09T08:17:21.971614+0000","last_unstale":"2023-10-09T08:17:22.965701+0000","last_undegraded":"2023-10-09T08:17:22.965701+0000","last_fullsized":"2023-10-09T08:17:22.965701+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T09:29:28.933060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.982394+0000","last_change":"2023-10-09T08:17:22.976618+0000","last_active":"2023-10-09T08:17:22.982394+0000","last_peered":"2023-10-09T08:17:22.982394+0000","last_clean":"2023-10-09T08:17:22.982394+0000","last_became_active":"2023-10-09T08:17:22.976343+0000","last_became_peered":"2023-10-09T08:17:22.976343+0000","last_unstale":"2023-10-09T08:17:22.982394+0000","last_undegraded":"2023-10-09T08:17:22.982394+0000","last_fullsized":"2023-10-09T08:17:22.982394+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:52.908762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.978707+0000","last_change":"2023-10-09T08:17:21.977462+0000","last_active":"2023-10-09T08:17:22.978707+0000","last_peered":"2023-10-09T08:17:22.978707+0000","last_clean":"2023-10-09T08:17:22.978707+0000","last_became_active":"2023-10-09T08:17:21.977050+0000","last_became_peered":"2023-10-09T08:17:21.977050+0000","last_unstale":"2023-10-09T08:17:22.978707+0000","last_undegraded":"2023-10-09T08:17:22.978707+0000","last_fullsized":"2023-10-09T08:17:22.978707+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:24:09.508543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.979826+0000","last_change":"2023-10-09T08:17:22.975859+0000","last_active":"2023-10-09T08:17:22.979826+0000","last_peered":"2023-10-09T08:17:22.979826+0000","last_clean":"2023-10-09T08:17:22.979826+0000","last_became_active":"2023-10-09T08:17:22.975613+0000","last_became_peered":"2023-10-09T08:17:22.975613+0000","last_unstale":"2023-10-09T08:17:22.979826+0000","last_undegraded":"2023-10-09T08:17:22.979826+0000","last_fullsized":"2023-10-09T08:17:22.979826+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:58.570422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.965128+0000","last_change":"2023-10-09T08:17:21.980259+0000","last_active":"2023-10-09T08:17:22.965128+0000","last_peered":"2023-10-09T08:17:22.965128+0000","last_clean":"2023-10-09T08:17:22.965128+0000","last_became_active":"2023-10-09T08:17:21.980015+0000","last_became_peered":"2023-10-09T08:17:21.980015+0000","last_unstale":"2023-10-09T08:17:22.965128+0000","last_undegraded":"2023-10-09T08:17:22.965128+0000","last_fullsized":"2023-10-09T08:17:22.965128+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:23:19.929532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.988548+0000","last_change":"2023-10-09T08:17:22.983916+0000","last_active":"2023-10-09T08:17:22.988548+0000","last_peered":"2023-10-09T08:17:22.988548+0000","last_clean":"2023-10-09T08:17:22.988548+0000","last_became_active":"2023-10-09T08:17:22.983658+0000","last_became_peered":"2023-10-09T08:17:22.983658+0000","last_unstale":"2023-10-09T08:17:22.988548+0000","last_undegraded":"2023-10-09T08:17:22.988548+0000","last_fullsized":"2023-10-09T08:17:22.988548+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:21.950548+0000","last_clean_scrub_stamp":"2023-10-09T08:17:21.950548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:28.109789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.969899+0000","last_change":"2023-10-09T08:17:21.976803+0000","last_active":"2023-10-09T08:17:22.969899+0000","last_peered":"2023-10-09T08:17:22.969899+0000","last_clean":"2023-10-09T08:17:22.969899+0000","last_became_active":"2023-10-09T08:17:21.976538+0000","last_became_peered":"2023-10-09T08:17:21.976538+0000","last_unstale":"2023-10-09T08:17:22.969899+0000","last_undegraded":"2023-10-09T08:17:22.969899+0000","last_fullsized":"2023-10-09T08:17:22.969899+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T08:17:20.944684+0000","last_clean_scrub_stamp":"2023-10-09T08:17:20.944684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:03.261223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"199'348","reported_seq":1143,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-09T08:17:22.971832+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T08:17:22.971832+0000","last_peered":"2023-10-09T08:17:22.971832+0000","last_clean":"2023-10-09T08:17:22.971832+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T08:17:22.971832+0000","last_undegraded":"2023-10-09T08:17:22.971832+0000","last_fullsized":"2023-10-09T08:17:22.971832+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575975,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312732,"kb_used_data":3156,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059108,"statfs":{"total":96636764160,"available":96316526592,"internally_reserved":0,"allocated":3231744,"data_stored":1918128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.57999999999999996,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":0.98599999999999999,"5min":0.98699999999999999,"15min":1.1220000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.73999999999999999,"15min":0.749},"min":{"1min":0.64200000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86299999999999999,"5min":1.0069999999999999,"15min":1.0209999999999999},"last":0.53700000000000003}]},{"osd":1,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.65400000000000003,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":0.92900000000000005,"5min":1.28,"15min":1.28},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.74099999999999999,"15min":0.75},"min":{"1min":0.55900000000000005,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89100000000000001,"5min":1.298,"15min":1.298},"last":0.496}]},{"osd":2,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.747,"15min":0.753},"min":{"1min":0.57699999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94899999999999995,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76500000000000001,"15min":0.77000000000000002},"min":{"1min":0.64500000000000002,"5min":0.49299999999999999,"15min":0.442},"max":{"1min":0.879,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.71899999999999997}]},{"osd":3,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.73899999999999999,"15min":0.73999999999999999},"min":{"1min":0.56100000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92600000000000005,"5min":1.399,"15min":1.399},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78100000000000003,"15min":0.77700000000000002},"min":{"1min":0.61499999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95599999999999996,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.55200000000000005}]},{"osd":4,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.62,"15min":0.60599999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38300000000000001},"max":{"1min":0.83299999999999996,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63900000000000001,"15min":0.628},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.38600000000000001},"max":{"1min":0.78500000000000003,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.75700000000000001}]},{"osd":5,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65100000000000002,"15min":0.64600000000000002},"min":{"1min":0.46899999999999997,"5min":0.39400000000000002,"15min":0.376},"max":{"1min":0.81899999999999995,"5min":1.413,"15min":1.413},"last":0.746},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.51400000000000001,"5min":0.41699999999999998,"15min":0.40100000000000002},"max":{"1min":0.90300000000000002,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.78000000000000003}]},{"osd":6,"last update":"Mon Oct 9 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74399999999999999,"15min":0.73799999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.48199999999999998},"max":{"1min":0.89400000000000002,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.70999999999999996,"15min":0.70499999999999996},"min":{"1min":0.499,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":0.85099999999999998,"5min":1.595,"15min":1.595},"last":0.79500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575974,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316240,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055600,"statfs":{"total":96636764160,"available":96312934400,"internally_reserved":0,"allocated":2629632,"data_stored":1327656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76600000000000001,"15min":0.746},"min":{"1min":0.51300000000000001,"5min":0.46899999999999997,"15min":0.40300000000000002},"max":{"1min":0.92600000000000005,"5min":0.99299999999999999,"15min":1.0189999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.73799999999999999,"15min":0.73099999999999998},"min":{"1min":0.67300000000000004,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94099999999999995,"5min":0.96299999999999997,"15min":0.97399999999999998},"last":0.86699999999999999}]},{"osd":1,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.748,"15min":0.751},"min":{"1min":0.50900000000000001,"5min":0.45300000000000001,"15min":0.38500000000000001},"max":{"1min":0.90900000000000003,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78200000000000003,"15min":0.76400000000000001},"min":{"1min":0.56999999999999995,"5min":0.44,"15min":0.44},"max":{"1min":0.95899999999999996,"5min":1.0269999999999999,"15min":1.097},"last":0.94799999999999995}]},{"osd":2,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77000000000000002,"15min":0.75800000000000001},"min":{"1min":0.60799999999999998,"5min":0.495,"15min":0.46400000000000002},"max":{"1min":0.92000000000000004,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.76700000000000002,"15min":0.77300000000000002},"min":{"1min":0.58499999999999996,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":0.97699999999999998,"5min":1.0429999999999999,"15min":1.0660000000000001},"last":0.81100000000000005}]},{"osd":3,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.57999999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.89700000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.79700000000000004,"15min":0.78900000000000003},"min":{"1min":0.64000000000000001,"5min":0.54100000000000004,"15min":0.49299999999999999},"max":{"1min":0.97999999999999998,"5min":1.119,"15min":1.119},"last":0.88500000000000001}]},{"osd":4,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.64700000000000002,"15min":0.63800000000000001},"min":{"1min":0.45800000000000002,"5min":0.44700000000000001,"15min":0.40200000000000002},"max":{"1min":0.82499999999999996,"5min":1.0149999999999999,"15min":1.1339999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.64400000000000002,"15min":0.63700000000000001},"min":{"1min":0.47999999999999998,"5min":0.39700000000000002,"15min":0.32000000000000001},"max":{"1min":0.72299999999999998,"5min":0.91900000000000004,"15min":0.93700000000000006},"last":0.70899999999999996}]},{"osd":5,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.47599999999999998,"5min":0.42399999999999999,"15min":0.40100000000000002},"max":{"1min":0.83999999999999997,"5min":1.232,"15min":1.232},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.72499999999999998,"15min":0.70799999999999996},"min":{"1min":0.52400000000000002,"5min":0.46600000000000003,"15min":0.45200000000000001},"max":{"1min":0.872,"5min":1.0880000000000001,"15min":1.121},"last":0.65000000000000002}]},{"osd":7,"last update":"Mon Oct 9 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69499999999999995,"15min":0.68899999999999995},"min":{"1min":0.52200000000000002,"5min":0.45600000000000002,"15min":0.36299999999999999},"max":{"1min":0.85499999999999998,"5min":0.98699999999999999,"15min":1.0309999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.74299999999999999},"min":{"1min":0.56399999999999995,"5min":0.48699999999999999,"15min":0.442},"max":{"1min":0.89200000000000002,"5min":1.194,"15min":1.194},"last":0.73699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575975,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308060,"kb_used_data":2580,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063780,"statfs":{"total":96636764160,"available":96321310720,"internally_reserved":0,"allocated":2641920,"data_stored":1329192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45600000000000002,"15min":0.45700000000000002},"min":{"1min":0.34100000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.65000000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.40000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78300000000000003,"5min":0.95499999999999996,"15min":1.2230000000000001},"last":0.44}]},{"osd":2,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.39200000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71599999999999997,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42699999999999999,"5min":0.40300000000000002,"15min":0.39500000000000002},"max":{"1min":0.77300000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.41399999999999998}]},{"osd":3,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63,"15min":0.627},"min":{"1min":0.49199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84199999999999997,"5min":1.0049999999999999,"15min":1.2589999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.435,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":1.1519999999999999},"last":0.52900000000000003}]},{"osd":4,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78800000000000003,"15min":0.78200000000000003},"min":{"1min":0.58999999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.087,"5min":1.1759999999999999,"15min":1.224},"last":0.626},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.80400000000000005,"15min":0.80300000000000005},"min":{"1min":0.66700000000000004,"5min":0.56499999999999995,"15min":0.51800000000000002},"max":{"1min":1.0329999999999999,"5min":1.071,"15min":1.5800000000000001},"last":0.51900000000000002}]},{"osd":5,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.81699999999999995,"15min":0.81399999999999995},"min":{"1min":0.61599999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.77},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.81799999999999995,"15min":0.80700000000000005},"min":{"1min":0.67500000000000004,"5min":0.56100000000000005,"15min":0.49299999999999999},"max":{"1min":1.177,"5min":1.262,"15min":1.288},"last":0.59099999999999997}]},{"osd":6,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.82699999999999996,"15min":0.81999999999999995},"min":{"1min":0.63900000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.071,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.84999999999999998,"15min":0.83799999999999997},"min":{"1min":0.77300000000000002,"5min":0.59999999999999998,"15min":0.56699999999999995},"max":{"1min":1.135,"5min":1.3819999999999999,"15min":1.843},"last":0.78200000000000003}]},{"osd":7,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.872,"15min":0.86299999999999999},"min":{"1min":0.751,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.103,"5min":1.1739999999999999,"15min":1.9139999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.86299999999999999,"15min":0.85299999999999998},"min":{"1min":0.70699999999999996,"5min":0.61799999999999999,"15min":0.54300000000000004},"max":{"1min":1.1339999999999999,"5min":1.2270000000000001,"15min":1.347},"last":0.69699999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575974,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308632,"kb_used_data":3152,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063208,"statfs":{"total":96636764160,"available":96320724992,"internally_reserved":0,"allocated":3227648,"data_stored":1918046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47199999999999998,"15min":0.48499999999999999},"min":{"1min":0.35399999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.78700000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52600000000000002,"15min":0.54200000000000004},"min":{"1min":0.375,"5min":0.251,"15min":0.251},"max":{"1min":0.65600000000000003,"5min":0.82199999999999995,"15min":0.83599999999999997},"last":0.441}]},{"osd":2,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.47899999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69399999999999995,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.496},{"interface":"front","average":{"1min":0.504,"5min":0.5,"15min":0.51100000000000001},"min":{"1min":0.41899999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67100000000000004,"5min":0.77300000000000002,"15min":0.81999999999999995},"last":0.45900000000000002}]},{"osd":3,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52000000000000002,"15min":0.53500000000000003},"min":{"1min":0.38700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.628,"5min":0.78200000000000003,"15min":0.80500000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60399999999999998,"15min":0.61899999999999999},"min":{"1min":0.47299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82899999999999996,"5min":0.92100000000000004,"15min":0.93200000000000005},"last":0.54000000000000004}]},{"osd":4,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.60799999999999998,"5min":0.46600000000000003,"15min":0.42899999999999999},"max":{"1min":1.0589999999999999,"5min":1.1759999999999999,"15min":1.226},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.66500000000000004,"5min":0.53100000000000003,"15min":0.53000000000000003},"max":{"1min":1.139,"5min":1.216,"15min":1.23},"last":0.83199999999999996}]},{"osd":5,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.79800000000000004,"15min":0.81200000000000006},"min":{"1min":0.59399999999999997,"5min":0.51500000000000001,"15min":0.501},"max":{"1min":1.1799999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.80800000000000005,"15min":0.81799999999999995},"min":{"1min":0.65300000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.02,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.86099999999999999}]},{"osd":6,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.78200000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.141,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.751},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.82199999999999995},"min":{"1min":0.624,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.24},"last":0.88300000000000001}]},{"osd":7,"last update":"Mon Oct 9 08:16:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.84599999999999997,"15min":0.85999999999999999},"min":{"1min":0.68100000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2929999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.85499999999999998,"15min":0.874},"min":{"1min":0.69499999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.054,"5min":1.2,"15min":1.2110000000000001},"last":0.92400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575974,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316252,"kb_used_data":2580,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055588,"statfs":{"total":96636764160,"available":96312922112,"internally_reserved":0,"allocated":2641920,"data_stored":1328322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47999999999999998,"15min":0.46800000000000003},"min":{"1min":0.33500000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67900000000000005,"5min":0.69199999999999995,"15min":0.752},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.378,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64100000000000001,"5min":0.73299999999999998,"15min":0.82299999999999995},"last":0.36099999999999999}]},{"osd":1,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.496,"15min":0.495},"min":{"1min":0.35999999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71599999999999997,"5min":1.03,"15min":1.03},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.34699999999999998},"max":{"1min":0.68600000000000005,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.45900000000000002}]},{"osd":3,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60799999999999998,"15min":0.61099999999999999},"min":{"1min":0.47599999999999998,"5min":0.40799999999999997,"15min":0.39200000000000002},"max":{"1min":0.79200000000000004,"5min":0.89000000000000001,"15min":0.96999999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.53300000000000003,"5min":0.46600000000000003,"15min":0.43099999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.52900000000000003}]},{"osd":4,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.68100000000000005,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.80900000000000005,"15min":0.79900000000000004},"min":{"1min":0.63800000000000001,"5min":0.54200000000000004,"15min":0.48399999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81000000000000005,"15min":0.80900000000000005},"min":{"1min":0.60799999999999998,"5min":0.54500000000000004,"15min":0.51800000000000002},"max":{"1min":0.96499999999999997,"5min":1.181,"15min":1.181},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.47799999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.76100000000000001}]},{"osd":6,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83899999999999997,"15min":0.82699999999999996},"min":{"1min":0.68700000000000006,"5min":0.56299999999999994,"15min":0.52700000000000002},"max":{"1min":1.1499999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83099999999999996,"15min":0.83499999999999996},"min":{"1min":0.66900000000000004,"5min":0.59399999999999997,"15min":0.57099999999999995},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.224},"last":0.60499999999999998}]},{"osd":7,"last update":"Mon Oct 9 08:16:37 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.64600000000000002,"5min":0.60199999999999998,"15min":0.47899999999999998},"max":{"1min":1.054,"5min":1.448,"15min":1.448},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.877,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.67400000000000004,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.075,"5min":1.518,"15min":1.518},"last":0.72499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575975,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312156,"kb_used_data":2580,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059684,"statfs":{"total":96636764160,"available":96317116416,"internally_reserved":0,"allocated":2641920,"data_stored":1327850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47799999999999998,"15min":0.48799999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59199999999999997,"5min":0.78600000000000003,"15min":0.85999999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.503,"15min":0.505},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.63100000000000001,"5min":0.73499999999999999,"15min":0.74299999999999999},"last":0.42099999999999999}]},{"osd":1,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.5,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66900000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78400000000000003,"5min":0.84999999999999998,"15min":0.91300000000000003},"last":0.44500000000000001}]},{"osd":2,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70099999999999996,"5min":0.85699999999999998,"15min":0.97299999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.65000000000000002,"15min":0.65700000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80700000000000005,"5min":0.90200000000000002,"15min":1.036},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52100000000000002,"5min":0.49099999999999999,"15min":0.46000000000000002},"max":{"1min":1.0149999999999999,"5min":1.175,"15min":1.175},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.85899999999999999,"15min":0.86699999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.97699999999999998,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.83299999999999996}]},{"osd":5,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.47399999999999998},"max":{"1min":1.026,"5min":1.1419999999999999,"15min":1.2170000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.83099999999999996,"15min":0.83399999999999996},"min":{"1min":0.64200000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.96599999999999997,"5min":1.1719999999999999,"15min":1.1739999999999999},"last":0.70399999999999996}]},{"osd":6,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97799999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.81200000000000006,"15min":0.81299999999999994},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.54800000000000004},"max":{"1min":1.0620000000000001,"5min":1.1339999999999999,"15min":1.149},"last":0.77100000000000002}]},{"osd":7,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.84799999999999998,"15min":0.85399999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.96199999999999997,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.85999999999999999,"15min":0.85299999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0900000000000001,"5min":1.155,"15min":1.1639999999999999},"last":0.84799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575974,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299872,"kb_used_data":2584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071968,"statfs":{"total":96636764160,"available":96329695232,"internally_reserved":0,"allocated":2646016,"data_stored":1329746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71699999999999997,"15min":0.72399999999999998},"min":{"1min":0.498,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89900000000000002,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72399999999999998,"15min":0.73599999999999999},"min":{"1min":0.53800000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.94299999999999995,"5min":0.995,"15min":0.995},"last":0.62}]},{"osd":1,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.70699999999999996,"15min":0.71799999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92700000000000005,"5min":0.98399999999999999,"15min":1.03},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72599999999999998,"15min":0.73899999999999999},"min":{"1min":0.52400000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92600000000000005,"5min":0.97299999999999998,"15min":1.0009999999999999},"last":0.59299999999999997}]},{"osd":2,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78700000000000003,"15min":0.79200000000000004},"min":{"1min":0.65300000000000002,"5min":0.51200000000000001,"15min":0.45000000000000001},"max":{"1min":0.93100000000000005,"5min":1.0149999999999999,"15min":1.0569999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.79100000000000004,"15min":0.80200000000000005},"min":{"1min":0.63400000000000001,"5min":0.51000000000000001,"15min":0.47999999999999998},"max":{"1min":0.96499999999999997,"5min":1.077,"15min":1.077},"last":0.79500000000000004}]},{"osd":3,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73199999999999998,"15min":0.74099999999999999},"min":{"1min":0.56299999999999994,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84999999999999998,"5min":0.96999999999999997,"15min":1.016},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.53200000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.89600000000000002,"5min":1.036,"15min":1.036},"last":0.70199999999999996}]},{"osd":5,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.434,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.749,"5min":0.94899999999999995,"15min":1.006},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.40100000000000002},"max":{"1min":0.85099999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.81399999999999995}]},{"osd":6,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.63400000000000001},"min":{"1min":0.495,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91100000000000003,"5min":1.022,"15min":1.034},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.68300000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83999999999999997,"5min":0.998,"15min":1.0609999999999999},"last":0.68200000000000005}]},{"osd":7,"last update":"Mon Oct 9 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.51400000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91900000000000004,"5min":1.036,"15min":1.036},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76000000000000001,"15min":0.77600000000000002},"min":{"1min":0.498,"5min":0.48499999999999999,"15min":0.443},"max":{"1min":0.89600000000000002,"5min":1.0609999999999999,"15min":1.079},"last":0.753}]}]},{"osd":5,"up_from":13,"seq":55834575975,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299856,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071984,"statfs":{"total":96636764160,"available":96329711616,"internally_reserved":0,"allocated":2629632,"data_stored":1327656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.55900000000000005,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92600000000000005,"5min":1.03,"15min":1.0780000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71199999999999997,"15min":0.71499999999999997},"min":{"1min":0.53900000000000003,"5min":0.42999999999999999,"15min":0.40899999999999997},"max":{"1min":0.89000000000000001,"5min":0.97399999999999998,"15min":1.018},"last":0.59999999999999998}]},{"osd":1,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.70399999999999996,"15min":0.71699999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82499999999999996,"5min":1.0129999999999999,"15min":1.1140000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76100000000000001,"15min":0.748},"min":{"1min":0.61699999999999999,"5min":0.498,"15min":0.435},"max":{"1min":0.97999999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.74299999999999999}]},{"osd":2,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74199999999999999,"15min":0.746},"min":{"1min":0.52300000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90200000000000002,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.62},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.745,"15min":0.74399999999999999},"min":{"1min":0.55500000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.95899999999999996,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.76000000000000001}]},{"osd":3,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.56799999999999995,"5min":0.50900000000000001,"15min":0.48299999999999998},"max":{"1min":0.83999999999999997,"5min":0.95999999999999996,"15min":1.0409999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.51500000000000001},"max":{"1min":1.0049999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.71599999999999997}]},{"osd":4,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.627,"15min":0.61099999999999999},"min":{"1min":0.45300000000000001,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.89000000000000001,"5min":1.093,"15min":1.093},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.624,"15min":0.60799999999999998},"min":{"1min":0.42999999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83899999999999997,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.69399999999999995}]},{"osd":6,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63900000000000001,"15min":0.622},"min":{"1min":0.46100000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82499999999999996,"5min":1,"15min":1},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.69999999999999996,"15min":0.67600000000000005},"min":{"1min":0.47699999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91700000000000004,"5min":1.123,"15min":1.123},"last":0.80900000000000005}]},{"osd":7,"last update":"Mon Oct 9 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.70599999999999996,"15min":0.68500000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.44400000000000001},"max":{"1min":0.94299999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78300000000000003,"15min":0.76500000000000001},"min":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.48599999999999999},"max":{"1min":0.91300000000000003,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.79500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T08:17:32.602 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T08:17:32.603 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T08:17:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.823+0000 7fc1db3ff700 1 Processor -- start 2023-10-09T08:17:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.823+0000 7fc1db3ff700 1 -- start start 2023-10-09T08:17:32.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.824+0000 7fc1db3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1d4157630 0x7fc1d4158a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:32.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.824+0000 7fc1db3ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d4158590 con 0x7fc1d4157a00 2023-10-09T08:17:32.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.824+0000 7fc1db3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d4157f80 con 0x7fc1d4068390 2023-10-09T08:17:32.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.824+0000 7fc1db3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d40ac7a0 con 0x7fc1d4157630 2023-10-09T08:17:32.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.825+0000 7fc1d899a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc1d4157a00 0x7fc1d40abd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33306/0 (socket says 172.21.15.71:33306) 2023-10-09T08:17:32.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.825+0000 7fc1d899a700 1 -- 172.21.15.71:0/658003164 learned_addr learned my addr 172.21.15.71:0/658003164 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:32.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.825+0000 7fc1d919b700 1 --2- 172.21.15.71:0/658003164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1d4157630 0x7fc1d4158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:32.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.825+0000 7fc1cbfff700 1 -- 172.21.15.71:0/658003164 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183528418 0 0) 0x7fc1d4158590 con 0x7fc1d4157a00 2023-10-09T08:17:32.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.825+0000 7fc1cbfff700 1 -- 172.21.15.71:0/658003164 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1c0003570 con 0x7fc1d4157a00 2023-10-09T08:17:32.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.825+0000 7fc1cbfff700 1 -- 172.21.15.71:0/658003164 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 181168159 0 0) 0x7fc1c0003570 con 0x7fc1d4157a00 2023-10-09T08:17:32.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.825+0000 7fc1cbfff700 1 -- 172.21.15.71:0/658003164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1d4157630 msgr2=0x7fc1d4158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:32.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.825+0000 7fc1cbfff700 1 --2- 172.21.15.71:0/658003164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1d4157630 0x7fc1d4158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:32.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.825+0000 7fc1cbfff700 1 -- 172.21.15.71:0/658003164 >> v1:172.21.15.179:6789/0 conn(0x7fc1d4068390 legacy=0x7fc1d415b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:32.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.825+0000 7fc1cbfff700 1 -- 172.21.15.71:0/658003164 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d4158220 con 0x7fc1d4157a00 2023-10-09T08:17:32.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.825+0000 7fc1cbfff700 1 -- 172.21.15.71:0/658003164 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fc1c4001470 con 0x7fc1d4157a00 2023-10-09T08:17:32.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.825+0000 7fc1cbfff700 1 -- 172.21.15.71:0/658003164 >> v1:172.21.15.71:6789/0 conn(0x7fc1d4157a00 legacy=0x7fc1d40abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:32.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.825+0000 7fc1cbfff700 1 --2- 172.21.15.71:0/658003164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1c0003a90 0x7fc1c0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:32.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.825+0000 7fc1cbfff700 1 --2- 172.21.15.71:0/658003164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1d4157630 0x7fc1c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:32.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.826+0000 7fc1cbfff700 1 --2- 172.21.15.71:0/658003164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1c0004d50 0x7fc1c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:32.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.826+0000 7fc1cbfff700 1 -- 172.21.15.71:0/658003164 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d40ac7a0 con 0x7fc1c0003a90 2023-10-09T08:17:32.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.826+0000 7fc1cbfff700 1 -- 172.21.15.71:0/658003164 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c000bb70 con 0x7fc1c0004d50 2023-10-09T08:17:32.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.826+0000 7fc1cbfff700 1 -- 172.21.15.71:0/658003164 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c000bd30 con 0x7fc1d4157630 2023-10-09T08:17:32.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.826+0000 7fc1d919b700 1 --2- 172.21.15.71:0/658003164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1c0003a90 0x7fc1c0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:32.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.826+0000 7fc1d999c700 1 --2- 172.21.15.71:0/658003164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1c0004d50 0x7fc1c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:32.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.826+0000 7fc1d899a700 1 --2- 172.21.15.71:0/658003164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1d4157630 0x7fc1c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:32.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.826+0000 7fc1d919b700 1 -- 172.21.15.71:0/658003164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1d4157630 msgr2=0x7fc1c0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:32.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.826+0000 7fc1d919b700 1 --2- 172.21.15.71:0/658003164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1d4157630 0x7fc1c0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:32.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.826+0000 7fc1d919b700 1 -- 172.21.15.71:0/658003164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1c0004d50 msgr2=0x7fc1c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:32.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.826+0000 7fc1d919b700 1 --2- 172.21.15.71:0/658003164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1c0004d50 0x7fc1c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:32.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.826+0000 7fc1d919b700 1 -- 172.21.15.71:0/658003164 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c0003570 con 0x7fc1c0003a90 2023-10-09T08:17:32.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.826+0000 7fc1d919b700 1 --2- 172.21.15.71:0/658003164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1c0003a90 0x7fc1c0003ea0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009c00 tx=0x7fc1d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d64fce10c9a989e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:32.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.827+0000 7fc1cbfff700 1 -- 172.21.15.71:0/658003164 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d000e710 con 0x7fc1c0003a90 2023-10-09T08:17:32.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.827+0000 7fc1cbfff700 1 -- 172.21.15.71:0/658003164 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d000e870 con 0x7fc1c0003a90 2023-10-09T08:17:32.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.827+0000 7fc1cbfff700 1 -- 172.21.15.71:0/658003164 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d000ec30 con 0x7fc1c0003a90 2023-10-09T08:17:32.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.827+0000 7fc1db3ff700 1 -- 172.21.15.71:0/658003164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1c0003a90 msgr2=0x7fc1c0003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:32.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.827+0000 7fc1db3ff700 1 --2- 172.21.15.71:0/658003164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1c0003a90 0x7fc1c0003ea0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009c00 tx=0x7fc1d00091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:32.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.827+0000 7fc1d999c700 1 -- 172.21.15.71:0/658003164 reap_dead start 2023-10-09T08:17:32.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.827+0000 7fc1db3ff700 1 -- 172.21.15.71:0/658003164 shutdown_connections 2023-10-09T08:17:32.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.827+0000 7fc1db3ff700 1 -- 172.21.15.71:0/658003164 >> 172.21.15.71:0/658003164 conn(0x7fc1d40cc540 msgr2=0x7fc1d40cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:32.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.827+0000 7fc1db3ff700 1 -- 172.21.15.71:0/658003164 shutdown_connections 2023-10-09T08:17:32.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.827+0000 7fc1db3ff700 1 -- 172.21.15.71:0/658003164 wait complete. 2023-10-09T08:17:32.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.829+0000 7fc1db3ff700 1 Processor -- start 2023-10-09T08:17:32.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.829+0000 7fc1db3ff700 1 -- start start 2023-10-09T08:17:32.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.830+0000 7fc1db3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1c0003a90 0x7fc1d40c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:32.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.830+0000 7fc1db3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1d4158eb0 0x7fc1d4148980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.830+0000 7fc1db3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1d415a730 0x7fc1d415ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.830+0000 7fc1db3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d415a2a0 con 0x7fc1d415a730 2023-10-09T08:17:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.830+0000 7fc1db3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d4159690 con 0x7fc1c0003a90 2023-10-09T08:17:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.830+0000 7fc1db3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d4159970 con 0x7fc1d4158eb0 2023-10-09T08:17:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.830+0000 7fc1d999c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1d415a730 0x7fc1d415ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.830+0000 7fc1d999c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1d415a730 0x7fc1d415ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48282/0 (socket says 172.21.15.71:48282) 2023-10-09T08:17:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.830+0000 7fc1d999c700 1 -- 172.21.15.71:0/442251404 learned_addr learned my addr 172.21.15.71:0/442251404 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.830+0000 7fc1d919b700 1 --2- 172.21.15.71:0/442251404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1c0003a90 0x7fc1d40c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.830+0000 7fc1d899a700 1 --2- 172.21.15.71:0/442251404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1d4158eb0 0x7fc1d4148980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.830+0000 7fc1d999c700 1 -- 172.21.15.71:0/442251404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1d4158eb0 msgr2=0x7fc1d4148980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.830+0000 7fc1d999c700 1 --2- 172.21.15.71:0/442251404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1d4158eb0 0x7fc1d4148980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.830+0000 7fc1d999c700 1 -- 172.21.15.71:0/442251404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1c0003a90 msgr2=0x7fc1d40c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.830+0000 7fc1d999c700 1 --2- 172.21.15.71:0/442251404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1c0003a90 0x7fc1d40c5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.830+0000 7fc1d999c700 1 -- 172.21.15.71:0/442251404 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d4159c50 con 0x7fc1d415a730 2023-10-09T08:17:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.830+0000 7fc1d919b700 1 --2- 172.21.15.71:0/442251404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1c0003a90 0x7fc1d40c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:17:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.830+0000 7fc1d999c700 1 --2- 172.21.15.71:0/442251404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1d415a730 0x7fc1d415ab80 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40ab980 tx=0x7fc1cc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.831+0000 7fc1c97fa700 1 -- 172.21.15.71:0/442251404 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc0032e0 con 0x7fc1d415a730 2023-10-09T08:17:32.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.831+0000 7fc1c97fa700 1 -- 172.21.15.71:0/442251404 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1cc001580 con 0x7fc1d415a730 2023-10-09T08:17:32.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.831+0000 7fc1db3ff700 1 -- 172.21.15.71:0/442251404 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d4159f30 con 0x7fc1d415a730 2023-10-09T08:17:32.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.831+0000 7fc1c97fa700 1 -- 172.21.15.71:0/442251404 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc001940 con 0x7fc1d415a730 2023-10-09T08:17:32.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.831+0000 7fc1db3ff700 1 -- 172.21.15.71:0/442251404 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d4148ec0 con 0x7fc1d415a730 2023-10-09T08:17:32.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.832+0000 7fc1db3ff700 1 -- 172.21.15.71:0/442251404 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d415a410 con 0x7fc1d415a730 2023-10-09T08:17:32.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.833+0000 7fc1c97fa700 1 -- 172.21.15.71:0/442251404 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc1cc001d30 con 0x7fc1d415a730 2023-10-09T08:17:32.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.833+0000 7fc1c97fa700 1 --2- 172.21.15.71:0/442251404 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc1b8066f30 0x7fc1b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:32.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.834+0000 7fc1c97fa700 1 -- 172.21.15.71:0/442251404 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6225+0+0 (secure 0 0 0) 0x7fc1cc0845d0 con 0x7fc1d415a730 2023-10-09T08:17:32.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.834+0000 7fc1d919b700 1 --2- 172.21.15.71:0/442251404 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc1b8066f30 0x7fc1b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:32.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.835+0000 7fc1d919b700 1 --2- 172.21.15.71:0/442251404 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc1b8066f30 0x7fc1b80693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00091e0 tx=0x7fc1d001a000 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:32.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:32.837+0000 7fc1c97fa700 1 -- 172.21.15.71:0/442251404 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1cc051590 con 0x7fc1d415a730 2023-10-09T08:17:33.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.103+0000 7fc1db3ff700 1 -- 172.21.15.71:0/442251404 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc1d40718b0 con 0x7fc1d415a730 2023-10-09T08:17:33.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.107+0000 7fc1c97fa700 1 -- 172.21.15.71:0/442251404 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v50) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc1cc054bb0 con 0x7fc1d415a730 2023-10-09T08:17:33.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.110+0000 7fc1db3ff700 1 -- 172.21.15.71:0/442251404 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc1b8066f30 msgr2=0x7fc1b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:33.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.110+0000 7fc1db3ff700 1 --2- 172.21.15.71:0/442251404 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc1b8066f30 0x7fc1b80693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00091e0 tx=0x7fc1d001a000 comp rx=0 tx=0).stop 2023-10-09T08:17:33.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.110+0000 7fc1db3ff700 1 -- 172.21.15.71:0/442251404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1d415a730 msgr2=0x7fc1d415ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:33.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.110+0000 7fc1db3ff700 1 --2- 172.21.15.71:0/442251404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1d415a730 0x7fc1d415ab80 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40ab980 tx=0x7fc1cc009040 comp rx=0 tx=0).stop 2023-10-09T08:17:33.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.110+0000 7fc1db3ff700 1 -- 172.21.15.71:0/442251404 shutdown_connections 2023-10-09T08:17:33.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.110+0000 7fc1db3ff700 1 --2- 172.21.15.71:0/442251404 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc1b8066f30 0x7fc1b80693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:33.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.110+0000 7fc1db3ff700 1 --2- 172.21.15.71:0/442251404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1d415a730 0x7fc1d415ab80 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:33.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.110+0000 7fc1db3ff700 1 --2- 172.21.15.71:0/442251404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1c0003a90 0x7fc1d40c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:33.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.110+0000 7fc1db3ff700 1 --2- 172.21.15.71:0/442251404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1d4158eb0 0x7fc1d4148980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:33.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.110+0000 7fc1db3ff700 1 -- 172.21.15.71:0/442251404 >> 172.21.15.71:0/442251404 conn(0x7fc1d40cc540 msgr2=0x7fc1d41568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:33.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.110+0000 7fc1db3ff700 1 -- 172.21.15.71:0/442251404 shutdown_connections 2023-10-09T08:17:33.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.110+0000 7fc1db3ff700 1 -- 172.21.15.71:0/442251404 wait complete. 2023-10-09T08:17:33.113 INFO:teuthology.orchestra.run.smithi071.stderr:updated caps for client.0 2023-10-09T08:17:33.128 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T08:17:33.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.308+0000 7fe633fff700 1 Processor -- start 2023-10-09T08:17:33.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.308+0000 7fe633fff700 1 -- start start 2023-10-09T08:17:33.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.309+0000 7fe633fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe62c0cbf30 0x7fe62c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:33.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.309+0000 7fe633fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe62c0ccf90 0x7fe62c0b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:33.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.310+0000 7fe633fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe62c0cc300 con 0x7fe62c15a270 2023-10-09T08:17:33.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.310+0000 7fe633fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe62c156bf0 con 0x7fe62c0ccf90 2023-10-09T08:17:33.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.310+0000 7fe633fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c0ae950 con 0x7fe62c0cbf30 2023-10-09T08:17:33.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.310+0000 7fe63159a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe62c0ccf90 0x7fe62c0b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:33.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.310+0000 7fe63159a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe62c0ccf90 0x7fe62c0b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48288/0 (socket says 172.21.15.71:48288) 2023-10-09T08:17:33.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.310+0000 7fe63159a700 1 -- 172.21.15.71:0/732528920 learned_addr learned my addr 172.21.15.71:0/732528920 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:33.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.310+0000 7fe631d9b700 1 --2- 172.21.15.71:0/732528920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe62c0cbf30 0x7fe62c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:33.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.310+0000 7fe63159a700 1 -- 172.21.15.71:0/732528920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe62c0cbf30 msgr2=0x7fe62c0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:33.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.310+0000 7fe63159a700 1 --2- 172.21.15.71:0/732528920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe62c0cbf30 0x7fe62c0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:33.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.310+0000 7fe63159a700 1 -- 172.21.15.71:0/732528920 >> v1:172.21.15.71:6789/0 conn(0x7fe62c15a270 legacy=0x7fe62c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:33.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.310+0000 7fe63159a700 1 -- 172.21.15.71:0/732528920 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62c0ad370 con 0x7fe62c0ccf90 2023-10-09T08:17:33.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.311+0000 7fe63159a700 1 --2- 172.21.15.71:0/732528920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe62c0ccf90 0x7fe62c0b0d10 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fe61c00bc80 tx=0x7fe61c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af74c93efac02a60 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:33.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.311+0000 7fe630d99700 1 -- 172.21.15.71:0/732528920 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c00be90 con 0x7fe62c0ccf90 2023-10-09T08:17:33.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.311+0000 7fe630d99700 1 -- 172.21.15.71:0/732528920 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61c00ddc0 con 0x7fe62c0ccf90 2023-10-09T08:17:33.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.311+0000 7fe630d99700 1 -- 172.21.15.71:0/732528920 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c0196b0 con 0x7fe62c0ccf90 2023-10-09T08:17:33.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.311+0000 7fe633fff700 1 -- 172.21.15.71:0/732528920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe62c0ccf90 msgr2=0x7fe62c0b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:33.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.311+0000 7fe633fff700 1 --2- 172.21.15.71:0/732528920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe62c0ccf90 0x7fe62c0b0d10 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fe61c00bc80 tx=0x7fe61c00b4f0 comp rx=0 tx=0).stop 2023-10-09T08:17:33.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.311+0000 7fe633fff700 1 -- 172.21.15.71:0/732528920 shutdown_connections 2023-10-09T08:17:33.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.311+0000 7fe633fff700 1 --2- 172.21.15.71:0/732528920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe62c0cbf30 0x7fe62c0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:33.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.311+0000 7fe633fff700 1 --2- 172.21.15.71:0/732528920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe62c0ccf90 0x7fe62c0b0d10 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:33.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.311+0000 7fe633fff700 1 -- 172.21.15.71:0/732528920 >> 172.21.15.71:0/732528920 conn(0x7fe62c06a320 msgr2=0x7fe62c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:33.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.312+0000 7fe633fff700 1 -- 172.21.15.71:0/732528920 shutdown_connections 2023-10-09T08:17:33.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.312+0000 7fe633fff700 1 -- 172.21.15.71:0/732528920 wait complete. 2023-10-09T08:17:33.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.313+0000 7fe633fff700 1 Processor -- start 2023-10-09T08:17:33.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.313+0000 7fe633fff700 1 -- start start 2023-10-09T08:17:33.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.314+0000 7fe633fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe62c0cbf30 0x7fe62c166110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:33.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.314+0000 7fe633fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe62c0ccf90 0x7fe62c168e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:33.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.314+0000 7fe633fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe62c15a270 0x7fe62c1586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:33.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.314+0000 7fe633fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c0c1f80 con 0x7fe62c15a270 2023-10-09T08:17:33.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.314+0000 7fe633fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c0c1370 con 0x7fe62c0cbf30 2023-10-09T08:17:33.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.314+0000 7fe633fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c0c1650 con 0x7fe62c0ccf90 2023-10-09T08:17:33.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.314+0000 7fe63259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe62c15a270 0x7fe62c1586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:33.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.314+0000 7fe63259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe62c15a270 0x7fe62c1586c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48304/0 (socket says 172.21.15.71:48304) 2023-10-09T08:17:33.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.314+0000 7fe63259c700 1 -- 172.21.15.71:0/2223301007 learned_addr learned my addr 172.21.15.71:0/2223301007 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:33.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.314+0000 7fe631d9b700 1 --2- 172.21.15.71:0/2223301007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe62c0cbf30 0x7fe62c166110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:33.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.314+0000 7fe63159a700 1 --2- 172.21.15.71:0/2223301007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe62c0ccf90 0x7fe62c168e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:33.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.315+0000 7fe63259c700 1 -- 172.21.15.71:0/2223301007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe62c0ccf90 msgr2=0x7fe62c168e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:33.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.315+0000 7fe63259c700 1 --2- 172.21.15.71:0/2223301007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe62c0ccf90 0x7fe62c168e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:33.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.315+0000 7fe63259c700 1 -- 172.21.15.71:0/2223301007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe62c0cbf30 msgr2=0x7fe62c166110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:33.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.315+0000 7fe63259c700 1 --2- 172.21.15.71:0/2223301007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe62c0cbf30 0x7fe62c166110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:33.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.315+0000 7fe63259c700 1 -- 172.21.15.71:0/2223301007 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61c00b790 con 0x7fe62c15a270 2023-10-09T08:17:33.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.315+0000 7fe63259c700 1 --2- 172.21.15.71:0/2223301007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe62c15a270 0x7fe62c1586c0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fe62400c840 tx=0x7fe624001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:33.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.315+0000 7fe621ffb700 1 -- 172.21.15.71:0/2223301007 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe624012630 con 0x7fe62c15a270 2023-10-09T08:17:33.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.315+0000 7fe621ffb700 1 -- 172.21.15.71:0/2223301007 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6240127b0 con 0x7fe62c15a270 2023-10-09T08:17:33.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.315+0000 7fe621ffb700 1 -- 172.21.15.71:0/2223301007 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe624012b70 con 0x7fe62c15a270 2023-10-09T08:17:33.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.315+0000 7fe633fff700 1 -- 172.21.15.71:0/2223301007 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe62c0c1930 con 0x7fe62c15a270 2023-10-09T08:17:33.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.315+0000 7fe633fff700 1 -- 172.21.15.71:0/2223301007 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe62c169380 con 0x7fe62c15a270 2023-10-09T08:17:33.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.316+0000 7fe633fff700 1 -- 172.21.15.71:0/2223301007 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe62c04c3c0 con 0x7fe62c15a270 2023-10-09T08:17:33.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.317+0000 7fe621ffb700 1 -- 172.21.15.71:0/2223301007 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe62401a3a0 con 0x7fe62c15a270 2023-10-09T08:17:33.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.318+0000 7fe621ffb700 1 --2- 172.21.15.71:0/2223301007 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe610066f30 0x7fe6100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:33.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.318+0000 7fe621ffb700 1 -- 172.21.15.71:0/2223301007 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6225+0+0 (secure 0 0 0) 0x7fe624084940 con 0x7fe62c15a270 2023-10-09T08:17:33.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.318+0000 7fe631d9b700 1 --2- 172.21.15.71:0/2223301007 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe610066f30 0x7fe6100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:33.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.319+0000 7fe631d9b700 1 --2- 172.21.15.71:0/2223301007 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe610066f30 0x7fe6100693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe628006fd0 tx=0x7fe628008040 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:33.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.322+0000 7fe621ffb700 1 -- 172.21.15.71:0/2223301007 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe624051900 con 0x7fe62c15a270 2023-10-09T08:17:33.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.555+0000 7fe633fff700 1 -- 172.21.15.71:0/2223301007 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe62c0c20c0 con 0x7fe62c15a270 2023-10-09T08:17:33.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.556+0000 7fe621ffb700 1 -- 172.21.15.71:0/2223301007 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4608 (secure 0 0 0) 0x7fe624054f20 con 0x7fe62c15a270 2023-10-09T08:17:33.557 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:33.557 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":97,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1242627383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1242627383},{"type":"v1","addr":"172.21.15.179:6836","nonce":1242627383}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":9628,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1306881721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1306881721},{"type":"v1","addr":"172.21.15.179:6834","nonce":1306881721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10143,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/717406174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":717406174},{"type":"v1","addr":"172.21.15.71:6834","nonce":717406174}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T08:17:22.432534+0000","modified":"2023-10-09T08:17:25.988311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10149":{"gid":10149,"name":"c","rank":0,"incarnation":93,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/2477293368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":2477293368},{"type":"v1","addr":"172.21.15.71:6835","nonce":2477293368}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T08:17:33.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.558+0000 7fe633fff700 1 -- 172.21.15.71:0/2223301007 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe610066f30 msgr2=0x7fe6100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:33.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.558+0000 7fe633fff700 1 --2- 172.21.15.71:0/2223301007 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe610066f30 0x7fe6100693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe628006fd0 tx=0x7fe628008040 comp rx=0 tx=0).stop 2023-10-09T08:17:33.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.558+0000 7fe633fff700 1 -- 172.21.15.71:0/2223301007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe62c15a270 msgr2=0x7fe62c1586c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:33.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.558+0000 7fe633fff700 1 --2- 172.21.15.71:0/2223301007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe62c15a270 0x7fe62c1586c0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fe62400c840 tx=0x7fe624001670 comp rx=0 tx=0).stop 2023-10-09T08:17:33.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.558+0000 7fe633fff700 1 -- 172.21.15.71:0/2223301007 shutdown_connections 2023-10-09T08:17:33.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.558+0000 7fe633fff700 1 --2- 172.21.15.71:0/2223301007 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe610066f30 0x7fe6100693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:33.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.558+0000 7fe633fff700 1 --2- 172.21.15.71:0/2223301007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe62c15a270 0x7fe62c1586c0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:33.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.558+0000 7fe633fff700 1 --2- 172.21.15.71:0/2223301007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe62c0cbf30 0x7fe62c166110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:33.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.558+0000 7fe633fff700 1 --2- 172.21.15.71:0/2223301007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe62c0ccf90 0x7fe62c168e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:33.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.558+0000 7fe633fff700 1 -- 172.21.15.71:0/2223301007 >> 172.21.15.71:0/2223301007 conn(0x7fe62c06a320 msgr2=0x7fe62c1554f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:33.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.558+0000 7fe633fff700 1 -- 172.21.15.71:0/2223301007 shutdown_connections 2023-10-09T08:17:33.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:33.558+0000 7fe633fff700 1 -- 172.21.15.71:0/2223301007 wait complete. 2023-10-09T08:17:33.560 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 97 2023-10-09T08:17:33.980 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 97, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T08:17:22.432534+0000', 'modified': '2023-10-09T08:17:25.988311+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10149}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10149': {'gid': 10149, 'name': 'c', 'rank': 0, 'incarnation': 93, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.71:6835/2477293368', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6833', 'nonce': 2477293368}, {'type': 'v1', 'addr': '172.21.15.71:6835', 'nonce': 2477293368}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T08:17:33.980 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T08:17:33.981 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-09T08:17:34.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.168+0000 7fdf803ff700 1 Processor -- start 2023-10-09T08:17:34.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.168+0000 7fdf803ff700 1 -- start start 2023-10-09T08:17:34.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.169+0000 7fdf803ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdf7806bcd0 0x7fdf780caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.169+0000 7fdf803ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf7815df50 0x7fdf7815e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.169+0000 7fdf803ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf7815d7e0 con 0x7fdf7806c0a0 2023-10-09T08:17:34.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.169+0000 7fdf803ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf7815dac0 con 0x7fdf7806bcd0 2023-10-09T08:17:34.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.169+0000 7fdf803ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7815aa30 con 0x7fdf7815df50 2023-10-09T08:17:34.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.169+0000 7fdf7e19b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdf7806bcd0 0x7fdf780caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:34.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.169+0000 7fdf7e19b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdf7806bcd0 0x7fdf780caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48314/0 (socket says 172.21.15.71:48314) 2023-10-09T08:17:34.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.169+0000 7fdf7e19b700 1 -- 172.21.15.71:0/928271553 learned_addr learned my addr 172.21.15.71:0/928271553 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:34.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.170+0000 7fdf7e19b700 1 -- 172.21.15.71:0/928271553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf7815df50 msgr2=0x7fdf7815e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:34.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.170+0000 7fdf7e19b700 1 --2- 172.21.15.71:0/928271553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf7815df50 0x7fdf7815e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.170+0000 7fdf7e19b700 1 -- 172.21.15.71:0/928271553 >> v1:172.21.15.71:6789/0 conn(0x7fdf7806c0a0 legacy=0x7fdf7815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:34.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.170+0000 7fdf7e19b700 1 -- 172.21.15.71:0/928271553 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7815ad10 con 0x7fdf7806bcd0 2023-10-09T08:17:34.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.170+0000 7fdf7e19b700 1 --2- 172.21.15.71:0/928271553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7806bcd0 0x7fdf780caa90 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fdf74009f20 tx=0x7fdf74009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde9b96c3f7592fb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:34.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.170+0000 7fdf7d199700 1 -- 172.21.15.71:0/928271553 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7400e070 con 0x7fdf7806bcd0 2023-10-09T08:17:34.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.170+0000 7fdf7d199700 1 -- 172.21.15.71:0/928271553 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7400ba80 con 0x7fdf7806bcd0 2023-10-09T08:17:34.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.170+0000 7fdf7d199700 1 -- 172.21.15.71:0/928271553 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf740092e0 con 0x7fdf7806bcd0 2023-10-09T08:17:34.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.171+0000 7fdf803ff700 1 -- 172.21.15.71:0/928271553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7806bcd0 msgr2=0x7fdf780caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:34.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.171+0000 7fdf803ff700 1 --2- 172.21.15.71:0/928271553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7806bcd0 0x7fdf780caa90 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fdf74009f20 tx=0x7fdf74009840 comp rx=0 tx=0).stop 2023-10-09T08:17:34.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.171+0000 7fdf803ff700 1 -- 172.21.15.71:0/928271553 shutdown_connections 2023-10-09T08:17:34.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.171+0000 7fdf803ff700 1 --2- 172.21.15.71:0/928271553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf7815df50 0x7fdf7815e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.171+0000 7fdf803ff700 1 --2- 172.21.15.71:0/928271553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7806bcd0 0x7fdf780caa90 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.171+0000 7fdf803ff700 1 -- 172.21.15.71:0/928271553 >> 172.21.15.71:0/928271553 conn(0x7fdf780ce600 msgr2=0x7fdf780cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:34.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.171+0000 7fdf803ff700 1 -- 172.21.15.71:0/928271553 shutdown_connections 2023-10-09T08:17:34.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.171+0000 7fdf803ff700 1 -- 172.21.15.71:0/928271553 wait complete. 2023-10-09T08:17:34.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.172+0000 7fdf803ff700 1 Processor -- start 2023-10-09T08:17:34.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.173+0000 7fdf803ff700 1 -- start start 2023-10-09T08:17:34.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.173+0000 7fdf803ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7806bcd0 0x7fdf780c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.173+0000 7fdf803ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf7806c0a0 0x7fdf780c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.173+0000 7fdf803ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf7815df50 0x7fdf780c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.173+0000 7fdf803ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7816b4e0 con 0x7fdf7806bcd0 2023-10-09T08:17:34.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.173+0000 7fdf803ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7816a8d0 con 0x7fdf7806c0a0 2023-10-09T08:17:34.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.173+0000 7fdf803ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7816abb0 con 0x7fdf7815df50 2023-10-09T08:17:34.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.174+0000 7fdf7e19b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7806bcd0 0x7fdf780c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:34.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.174+0000 7fdf7e19b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7806bcd0 0x7fdf780c83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48318/0 (socket says 172.21.15.71:48318) 2023-10-09T08:17:34.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.174+0000 7fdf7e19b700 1 -- 172.21.15.71:0/142119769 learned_addr learned my addr 172.21.15.71:0/142119769 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:34.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.174+0000 7fdf7e99c700 1 --2- 172.21.15.71:0/142119769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf7815df50 0x7fdf780c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:34.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.174+0000 7fdf7d99a700 1 --2- 172.21.15.71:0/142119769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf7806c0a0 0x7fdf780c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:34.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.174+0000 7fdf7e19b700 1 -- 172.21.15.71:0/142119769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf7815df50 msgr2=0x7fdf780c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:34.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.174+0000 7fdf7e19b700 1 --2- 172.21.15.71:0/142119769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf7815df50 0x7fdf780c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.174+0000 7fdf7e19b700 1 -- 172.21.15.71:0/142119769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf7806c0a0 msgr2=0x7fdf780c5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:34.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.174+0000 7fdf7e19b700 1 --2- 172.21.15.71:0/142119769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf7806c0a0 0x7fdf780c5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.174+0000 7fdf7e19b700 1 -- 172.21.15.71:0/142119769 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf74009ae0 con 0x7fdf7806bcd0 2023-10-09T08:17:34.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.174+0000 7fdf7e19b700 1 --2- 172.21.15.71:0/142119769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7806bcd0 0x7fdf780c83c0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400b6c0 tx=0x7fdf74018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:34.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.174+0000 7fdf6e7fc700 1 -- 172.21.15.71:0/142119769 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf74007000 con 0x7fdf7806bcd0 2023-10-09T08:17:34.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.175+0000 7fdf6e7fc700 1 -- 172.21.15.71:0/142119769 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf74007b90 con 0x7fdf7806bcd0 2023-10-09T08:17:34.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.175+0000 7fdf803ff700 1 -- 172.21.15.71:0/142119769 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf7816ae90 con 0x7fdf7806bcd0 2023-10-09T08:17:34.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.175+0000 7fdf6e7fc700 1 -- 172.21.15.71:0/142119769 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf74025460 con 0x7fdf7806bcd0 2023-10-09T08:17:34.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.175+0000 7fdf803ff700 1 -- 172.21.15.71:0/142119769 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf7816a5b0 con 0x7fdf7806bcd0 2023-10-09T08:17:34.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.177+0000 7fdf6e7fc700 1 -- 172.21.15.71:0/142119769 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf74025890 con 0x7fdf7806bcd0 2023-10-09T08:17:34.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.177+0000 7fdf6e7fc700 1 --2- 172.21.15.71:0/142119769 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdf5c066f30 0x7fdf5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.177+0000 7fdf6e7fc700 1 -- 172.21.15.71:0/142119769 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6225+0+0 (secure 0 0 0) 0x7fdf74086320 con 0x7fdf7806bcd0 2023-10-09T08:17:34.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.178+0000 7fdf7d99a700 1 --2- 172.21.15.71:0/142119769 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdf5c066f30 0x7fdf5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:34.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.179+0000 7fdf7d99a700 1 --2- 172.21.15.71:0/142119769 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdf5c066f30 0x7fdf5c0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdf780cde40 tx=0x7fdf68009040 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:34.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.179+0000 7fdf8eaa6b80 1 Processor -- start 2023-10-09T08:17:34.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.179+0000 7fdf8eaa6b80 1 -- start start 2023-10-09T08:17:34.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.180+0000 7fdf8eaa6b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b85f0a50 0x5581b85f0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.180+0000 7fdf8eaa6b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5581b863ad00 0x5581b8619a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.180+0000 7fdf8eaa6b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5581b8619f60 0x5581b85eccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.180+0000 7fdf8eaa6b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b8547a70 con 0x5581b85f0a50 2023-10-09T08:17:34.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.180+0000 7fdf8eaa6b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b8545270 con 0x5581b863ad00 2023-10-09T08:17:34.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.180+0000 7fdf8eaa6b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5581b8541060 con 0x5581b8619f60 2023-10-09T08:17:34.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.180+0000 7fdf7e19b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b85f0a50 0x5581b85f0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:34.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.180+0000 7fdf7e19b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b85f0a50 0x5581b85f0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48332/0 (socket says 172.21.15.71:48332) 2023-10-09T08:17:34.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.180+0000 7fdf7e19b700 1 -- 172.21.15.71:0/1730772274 learned_addr learned my addr 172.21.15.71:0/1730772274 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:34.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.181+0000 7fdf7d99a700 1 --2- 172.21.15.71:0/1730772274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5581b863ad00 0x5581b8619a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:34.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.181+0000 7fdf7e99c700 1 --2- 172.21.15.71:0/1730772274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5581b8619f60 0x5581b85eccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:34.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.181+0000 7fdf7e19b700 1 -- 172.21.15.71:0/1730772274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5581b8619f60 msgr2=0x5581b85eccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:34.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.181+0000 7fdf7e19b700 1 --2- 172.21.15.71:0/1730772274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5581b8619f60 0x5581b85eccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.181+0000 7fdf7e19b700 1 -- 172.21.15.71:0/1730772274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5581b863ad00 msgr2=0x5581b8619a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:34.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.181+0000 7fdf7e19b700 1 --2- 172.21.15.71:0/1730772274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5581b863ad00 0x5581b8619a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.181+0000 7fdf7e19b700 1 -- 172.21.15.71:0/1730772274 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581b83db270 con 0x5581b85f0a50 2023-10-09T08:17:34.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.181+0000 7fdf7d99a700 1 --2- 172.21.15.71:0/1730772274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5581b863ad00 0x5581b8619a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:17:34.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.181+0000 7fdf7e19b700 1 --2- 172.21.15.71:0/1730772274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b85f0a50 0x5581b85f0e20 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fdf74056ae0 tx=0x7fdf74009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d251ae1a9923c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:34.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.181+0000 7fdf5b7fe700 1 -- 172.21.15.71:0/1730772274 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7400e030 con 0x5581b85f0a50 2023-10-09T08:17:34.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.181+0000 7fdf5b7fe700 1 -- 172.21.15.71:0/1730772274 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf74056fa0 con 0x5581b85f0a50 2023-10-09T08:17:34.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.181+0000 7fdf5b7fe700 1 -- 172.21.15.71:0/1730772274 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7405a1f0 con 0x5581b85f0a50 2023-10-09T08:17:34.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.182+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/1730772274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b85f0a50 msgr2=0x5581b85f0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:34.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.182+0000 7fdf8eaa6b80 1 --2- 172.21.15.71:0/1730772274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b85f0a50 0x5581b85f0e20 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fdf74056ae0 tx=0x7fdf74009040 comp rx=0 tx=0).stop 2023-10-09T08:17:34.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.182+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/1730772274 shutdown_connections 2023-10-09T08:17:34.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.182+0000 7fdf8eaa6b80 1 --2- 172.21.15.71:0/1730772274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5581b8619f60 0x5581b85eccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.182+0000 7fdf8eaa6b80 1 --2- 172.21.15.71:0/1730772274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b85f0a50 0x5581b85f0e20 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.182+0000 7fdf8eaa6b80 1 --2- 172.21.15.71:0/1730772274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5581b863ad00 0x5581b8619a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.182+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/1730772274 >> 172.21.15.71:0/1730772274 conn(0x5581b85f2370 msgr2=0x5581b85f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:34.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.182+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/1730772274 shutdown_connections 2023-10-09T08:17:34.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.182+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/1730772274 wait complete. 2023-10-09T08:17:34.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.183+0000 7fdf8eaa6b80 1 -- start start 2023-10-09T08:17:34.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.183+0000 7fdf8eaa6b80 1 Processor -- start 2023-10-09T08:17:34.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.184+0000 7fdf8eaa6b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b85f0a50 0x5581b85ec2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.184+0000 7fdf8eaa6b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5581b8619f60 0x5581b8632f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.184+0000 7fdf8eaa6b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5581b863ad00 0x5581b8634b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.184+0000 7fdf8eaa6b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b84ec890 con 0x5581b85f0a50 2023-10-09T08:17:34.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.184+0000 7fdf8eaa6b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b8507ea0 con 0x5581b863ad00 2023-10-09T08:17:34.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.184+0000 7fdf8eaa6b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5581b83c3e30 con 0x5581b8619f60 2023-10-09T08:17:34.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.184+0000 7fdf8eaa6b80 10 client.0 _ll_register_callbacks cb 0x5581b85b4110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T08:17:34.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.184+0000 7fdf7e19b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b85f0a50 0x5581b85ec2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:34.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.184+0000 7fdf7e19b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b85f0a50 0x5581b85ec2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48340/0 (socket says 172.21.15.71:48340) 2023-10-09T08:17:34.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.184+0000 7fdf7e19b700 1 -- 172.21.15.71:0/2267079399 learned_addr learned my addr 172.21.15.71:0/2267079399 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:34.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.184+0000 7fdf7d99a700 1 --2- 172.21.15.71:0/2267079399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5581b8619f60 0x5581b8632f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:34.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.184+0000 7fdf7e99c700 1 --2- 172.21.15.71:0/2267079399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5581b863ad00 0x5581b8634b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:34.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.184+0000 7fdf7e19b700 1 -- 172.21.15.71:0/2267079399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5581b8619f60 msgr2=0x5581b8632f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:34.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.184+0000 7fdf7e19b700 1 --2- 172.21.15.71:0/2267079399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5581b8619f60 0x5581b8632f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.184+0000 7fdf7e19b700 1 -- 172.21.15.71:0/2267079399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5581b863ad00 msgr2=0x5581b8634b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:34.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.184+0000 7fdf7e19b700 1 --2- 172.21.15.71:0/2267079399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5581b863ad00 0x5581b8634b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.184+0000 7fdf7e19b700 1 -- 172.21.15.71:0/2267079399 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf7816a5b0 con 0x5581b85f0a50 2023-10-09T08:17:34.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.184+0000 7fdf7e99c700 1 --2- 172.21.15.71:0/2267079399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5581b863ad00 0x5581b8634b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:34.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.185+0000 7fdf7e19b700 1 --2- 172.21.15.71:0/2267079399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b85f0a50 0x5581b85ec2b0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fdf74056ee0 tx=0x7fdf7402a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd95be6c8dbdf43b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:34.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.185+0000 7fdf58ff9700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T08:17:34.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.185+0000 7fdf58ff9700 1 -- 172.21.15.71:0/2267079399 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf740860c0 con 0x5581b85f0a50 2023-10-09T08:17:34.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.185+0000 7fdf58ff9700 1 -- 172.21.15.71:0/2267079399 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(210..210 src has 1..210) v4 ==== 6225+0+0 (secure 0 0 0) 0x7fdf74057200 con 0x5581b85f0a50 2023-10-09T08:17:34.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.185+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/2267079399 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5581b85e5b70 con 0x5581b85f0a50 2023-10-09T08:17:34.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.185+0000 7fdf58ff9700 1 -- 172.21.15.71:0/2267079399 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf7406d1c0 con 0x5581b85f0a50 2023-10-09T08:17:34.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.185+0000 7fdf8eaa6b80 10 client.10311 fetch_fsmap learned FSMap version 97 2023-10-09T08:17:34.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.185+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/2267079399 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=97,monmap=2+}) v3 -- 0x5581b837dfe0 con 0x5581b85f0a50 2023-10-09T08:17:34.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.185+0000 7fdf58ff9700 1 -- 172.21.15.71:0/2267079399 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf74071080 con 0x5581b85f0a50 2023-10-09T08:17:34.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.185+0000 7fdf58ff9700 1 -- 172.21.15.71:0/2267079399 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 97) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdf74056490 con 0x5581b85f0a50 2023-10-09T08:17:34.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.185+0000 7fdf8eaa6b80 10 client.10311 fetch_fsmap finished waiting for FSMap version 97 2023-10-09T08:17:34.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.185+0000 7fdf8eaa6b80 10 client.10311 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T08:17:34.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.185+0000 7fdf8eaa6b80 20 client.10311 populate_metadata read hostname 'smithi071' 2023-10-09T08:17:34.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.185+0000 7fdf8eaa6b80 1 --2- 172.21.15.71:0/2267079399 >> [v2:172.21.15.71:6833/2477293368,v1:172.21.15.71:6835/2477293368] conn(0x5581b864a510 0x5581b864a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.185+0000 7fdf8eaa6b80 4 client.10311 mds_command: new command op to 10149 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T08:17:34.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.185+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/2267079399 --> [v2:172.21.15.71:6833/2477293368,v1:172.21.15.71:6835/2477293368] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5581b85c2aa0 con 0x5581b864a510 2023-10-09T08:17:34.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.186+0000 7fdf7d99a700 1 --2- 172.21.15.71:0/2267079399 >> [v2:172.21.15.71:6833/2477293368,v1:172.21.15.71:6835/2477293368] conn(0x5581b864a510 0x5581b864a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:34.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.186+0000 7fdf58ff9700 10 client.10311 ms_handle_connect on v2:172.21.15.71:6833/2477293368 2023-10-09T08:17:34.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.186+0000 7fdf7d99a700 1 --2- 172.21.15.71:0/2267079399 >> [v2:172.21.15.71:6833/2477293368,v1:172.21.15.71:6835/2477293368] conn(0x5581b864a510 0x5581b864a8e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed19a0c526b10d49 server_cookie=9b9db4d42f216e18 in_seq=0 out_seq=0 2023-10-09T08:17:34.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.187+0000 7fdf58ff9700 1 -- 172.21.15.71:0/2267079399 <== mds.0 v2:172.21.15.71:6833/2477293368 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5581b85c2aa0 con 0x5581b864a510 2023-10-09T08:17:34.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.187+0000 7fdf58ff9700 10 client.10311 handle_command_reply: tid=0 2023-10-09T08:17:34.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.187+0000 7fdf8eaa6b80 1 client.10311 shutdown 2023-10-09T08:17:34.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.187+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/2267079399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b85f0a50 msgr2=0x5581b85ec2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:34.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.187+0000 7fdf8eaa6b80 1 --2- 172.21.15.71:0/2267079399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b85f0a50 0x5581b85ec2b0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fdf74056ee0 tx=0x7fdf7402a000 comp rx=0 tx=0).stop 2023-10-09T08:17:34.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.187+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/2267079399 shutdown_connections 2023-10-09T08:17:34.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.187+0000 7fdf8eaa6b80 1 --2- 172.21.15.71:0/2267079399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5581b863ad00 0x5581b8634b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.187+0000 7fdf8eaa6b80 1 --2- 172.21.15.71:0/2267079399 >> [v2:172.21.15.71:6833/2477293368,v1:172.21.15.71:6835/2477293368] conn(0x5581b864a510 0x5581b864a8e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.187+0000 7fdf8eaa6b80 1 --2- 172.21.15.71:0/2267079399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b85f0a50 0x5581b85ec2b0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.187+0000 7fdf8eaa6b80 1 --2- 172.21.15.71:0/2267079399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5581b8619f60 0x5581b8632f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.187+0000 7fdf58ff9700 0 client.10311 ms_handle_reset on v2:172.21.15.71:6833/2477293368 2023-10-09T08:17:34.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.187+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/2267079399 >> 172.21.15.71:0/2267079399 conn(0x5581b85f2370 msgr2=0x5581b8618d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:34.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.187+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/2267079399 shutdown_connections 2023-10-09T08:17:34.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.187+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/2267079399 wait complete. 2023-10-09T08:17:34.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.187+0000 7fdf8eaa6b80 20 client.10311 trim_cache size 0 max 16384 2023-10-09T08:17:34.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.205+0000 7fdf8eaa6b80 1 Processor -- start 2023-10-09T08:17:34.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.205+0000 7fdf8eaa6b80 1 -- start start 2023-10-09T08:17:34.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.206+0000 7fdf8eaa6b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b85f0a50 0x5581b8632f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.206+0000 7fdf8eaa6b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5581b8619f60 0x5581b8631eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.206+0000 7fdf8eaa6b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5581b863ad00 0x5581b86323f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.206+0000 7fdf8eaa6b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b85ebcc0 con 0x5581b85f0a50 2023-10-09T08:17:34.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.206+0000 7fdf8eaa6b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b8635b40 con 0x5581b8619f60 2023-10-09T08:17:34.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.206+0000 7fdf8eaa6b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5581b85effa0 con 0x5581b863ad00 2023-10-09T08:17:34.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.206+0000 7fdf7e19b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b85f0a50 0x5581b8632f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:34.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.206+0000 7fdf7e19b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b85f0a50 0x5581b8632f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48352/0 (socket says 172.21.15.71:48352) 2023-10-09T08:17:34.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.206+0000 7fdf7e19b700 1 -- 172.21.15.71:0/979899639 learned_addr learned my addr 172.21.15.71:0/979899639 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:34.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.206+0000 7fdf7e99c700 1 --2- 172.21.15.71:0/979899639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5581b863ad00 0x5581b86323f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:34.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.206+0000 7fdf7d99a700 1 --2- 172.21.15.71:0/979899639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5581b8619f60 0x5581b8631eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:34.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.206+0000 7fdf7e19b700 1 -- 172.21.15.71:0/979899639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5581b863ad00 msgr2=0x5581b86323f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:34.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.206+0000 7fdf7e19b700 1 --2- 172.21.15.71:0/979899639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5581b863ad00 0x5581b86323f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.206+0000 7fdf7e19b700 1 -- 172.21.15.71:0/979899639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5581b8619f60 msgr2=0x5581b8631eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:34.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.206+0000 7fdf7e19b700 1 --2- 172.21.15.71:0/979899639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5581b8619f60 0x5581b8631eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.206+0000 7fdf7e19b700 1 -- 172.21.15.71:0/979899639 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581b850f780 con 0x5581b85f0a50 2023-10-09T08:17:34.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.206+0000 7fdf7d99a700 1 --2- 172.21.15.71:0/979899639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5581b8619f60 0x5581b8631eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:34.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.207+0000 7fdf7e19b700 1 --2- 172.21.15.71:0/979899639 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b85f0a50 0x5581b8632f10 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fdf740552f0 tx=0x7fdf74059040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c65cebff63a310ab server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:34.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.207+0000 7fdf5bfff700 1 -- 172.21.15.71:0/979899639 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7400e040 con 0x5581b85f0a50 2023-10-09T08:17:34.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.207+0000 7fdf5bfff700 1 -- 172.21.15.71:0/979899639 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf74071070 con 0x5581b85f0a50 2023-10-09T08:17:34.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.207+0000 7fdf5bfff700 1 -- 172.21.15.71:0/979899639 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf74057200 con 0x5581b85f0a50 2023-10-09T08:17:34.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.207+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/979899639 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b85f0a50 msgr2=0x5581b8632f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:34.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.207+0000 7fdf8eaa6b80 1 --2- 172.21.15.71:0/979899639 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b85f0a50 0x5581b8632f10 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fdf740552f0 tx=0x7fdf74059040 comp rx=0 tx=0).stop 2023-10-09T08:17:34.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.207+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/979899639 shutdown_connections 2023-10-09T08:17:34.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.207+0000 7fdf8eaa6b80 1 --2- 172.21.15.71:0/979899639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5581b863ad00 0x5581b86323f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.207+0000 7fdf8eaa6b80 1 --2- 172.21.15.71:0/979899639 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b85f0a50 0x5581b8632f10 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.207+0000 7fdf8eaa6b80 1 --2- 172.21.15.71:0/979899639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5581b8619f60 0x5581b8631eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.207+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/979899639 >> 172.21.15.71:0/979899639 conn(0x5581b85f2370 msgr2=0x5581b8618d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:34.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.208+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/979899639 shutdown_connections 2023-10-09T08:17:34.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.208+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/979899639 wait complete. 2023-10-09T08:17:34.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.208+0000 7fdf8eaa6b80 1 -- start start 2023-10-09T08:17:34.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.208+0000 7fdf8eaa6b80 1 Processor -- start 2023-10-09T08:17:34.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.209+0000 7fdf8eaa6b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5581b85f0a50 0x5581b869c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.209+0000 7fdf8eaa6b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b8619f60 0x5581b8631eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.209+0000 7fdf8eaa6b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5581b863ad00 0x5581b86323f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.209+0000 7fdf8eaa6b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b8656110 con 0x5581b8619f60 2023-10-09T08:17:34.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.209+0000 7fdf8eaa6b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b8620360 con 0x5581b863ad00 2023-10-09T08:17:34.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.209+0000 7fdf8eaa6b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5581b8650d60 con 0x5581b85f0a50 2023-10-09T08:17:34.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.209+0000 7fdf8eaa6b80 10 client.0 _ll_register_callbacks cb 0x5581b85b4110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T08:17:34.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.210+0000 7fdf7d99a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b8619f60 0x5581b8631eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:34.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.210+0000 7fdf7d99a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b8619f60 0x5581b8631eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48362/0 (socket says 172.21.15.71:48362) 2023-10-09T08:17:34.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.210+0000 7fdf7d99a700 1 -- 172.21.15.71:0/4057323593 learned_addr learned my addr 172.21.15.71:0/4057323593 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:34.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.210+0000 7fdf7d99a700 1 -- 172.21.15.71:0/4057323593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5581b85f0a50 msgr2=0x5581b869c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:34.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.210+0000 7fdf7d99a700 1 --2- 172.21.15.71:0/4057323593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5581b85f0a50 0x5581b869c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.210+0000 7fdf7d99a700 1 -- 172.21.15.71:0/4057323593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5581b863ad00 msgr2=0x5581b86323f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:34.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.210+0000 7fdf7d99a700 1 --2- 172.21.15.71:0/4057323593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5581b863ad00 0x5581b86323f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.210+0000 7fdf7d99a700 1 -- 172.21.15.71:0/4057323593 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5581b837dfe0 con 0x5581b8619f60 2023-10-09T08:17:34.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.210+0000 7fdf7d99a700 1 --2- 172.21.15.71:0/4057323593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b8619f60 0x5581b8631eb0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fdf68007b60 tx=0x7fdf68013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32ea1c908485a45 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:34.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.210+0000 7fdf58ff9700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-09T08:17:34.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.210+0000 7fdf58ff9700 1 -- 172.21.15.71:0/4057323593 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf68026070 con 0x5581b8619f60 2023-10-09T08:17:34.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.210+0000 7fdf58ff9700 1 -- 172.21.15.71:0/4057323593 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(210..210 src has 1..210) v4 ==== 6225+0+0 (secure 0 0 0) 0x7fdf6801b040 con 0x5581b8619f60 2023-10-09T08:17:34.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.210+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/4057323593 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf7816e010 con 0x5581b8619f60 2023-10-09T08:17:34.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.211+0000 7fdf58ff9700 1 -- 172.21.15.71:0/4057323593 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf68021cc0 con 0x5581b8619f60 2023-10-09T08:17:34.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.211+0000 7fdf8eaa6b80 10 client.10317 fetch_fsmap learned FSMap version 97 2023-10-09T08:17:34.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.211+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/4057323593 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=97,monmap=2+}) v3 -- 0x5581b84f6470 con 0x5581b8619f60 2023-10-09T08:17:34.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.211+0000 7fdf58ff9700 1 -- 172.21.15.71:0/4057323593 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7816e010 con 0x5581b8619f60 2023-10-09T08:17:34.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.211+0000 7fdf58ff9700 1 -- 172.21.15.71:0/4057323593 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 97) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdf6802a460 con 0x5581b8619f60 2023-10-09T08:17:34.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.211+0000 7fdf8eaa6b80 10 client.10317 fetch_fsmap finished waiting for FSMap version 97 2023-10-09T08:17:34.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.211+0000 7fdf8eaa6b80 10 client.10317 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T08:17:34.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.211+0000 7fdf8eaa6b80 20 client.10317 populate_metadata read hostname 'smithi071' 2023-10-09T08:17:34.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.211+0000 7fdf8eaa6b80 1 --2- 172.21.15.71:0/4057323593 >> [v2:172.21.15.71:6833/2477293368,v1:172.21.15.71:6835/2477293368] conn(0x5581b8639330 0x5581b8639700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.211+0000 7fdf8eaa6b80 4 client.10317 mds_command: new command op to 10149 tid=0[{"prefix": "status"}] 2023-10-09T08:17:34.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.211+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/4057323593 --> [v2:172.21.15.71:6833/2477293368,v1:172.21.15.71:6835/2477293368] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fdf74056fa0 con 0x5581b8639330 2023-10-09T08:17:34.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.211+0000 7fdf7e19b700 1 --2- 172.21.15.71:0/4057323593 >> [v2:172.21.15.71:6833/2477293368,v1:172.21.15.71:6835/2477293368] conn(0x5581b8639330 0x5581b8639700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:34.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.212+0000 7fdf7e19b700 1 --2- 172.21.15.71:0/4057323593 >> [v2:172.21.15.71:6833/2477293368,v1:172.21.15.71:6835/2477293368] conn(0x5581b8639330 0x5581b8639700 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e01515178fe6d748 server_cookie=129c773b723e3e71 in_seq=0 out_seq=0 2023-10-09T08:17:34.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.212+0000 7fdf58ff9700 10 client.10317 ms_handle_connect on v2:172.21.15.71:6833/2477293368 2023-10-09T08:17:34.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.212+0000 7fdf58ff9700 1 -- 172.21.15.71:0/4057323593 <== mds.0 v2:172.21.15.71:6833/2477293368 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x7fdf74056fa0 con 0x5581b8639330 2023-10-09T08:17:34.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.212+0000 7fdf58ff9700 10 client.10317 handle_command_reply: tid=0 2023-10-09T08:17:34.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.212+0000 7fdf8eaa6b80 1 client.10317 shutdown 2023-10-09T08:17:34.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.212+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/4057323593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b8619f60 msgr2=0x5581b8631eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:34.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.212+0000 7fdf8eaa6b80 1 --2- 172.21.15.71:0/4057323593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b8619f60 0x5581b8631eb0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fdf68007b60 tx=0x7fdf68013000 comp rx=0 tx=0).stop 2023-10-09T08:17:34.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.212+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/4057323593 shutdown_connections 2023-10-09T08:17:34.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.212+0000 7fdf8eaa6b80 1 --2- 172.21.15.71:0/4057323593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5581b863ad00 0x5581b86323f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.212+0000 7fdf8eaa6b80 1 --2- 172.21.15.71:0/4057323593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5581b85f0a50 0x5581b869c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.212+0000 7fdf8eaa6b80 1 --2- 172.21.15.71:0/4057323593 >> [v2:172.21.15.71:6833/2477293368,v1:172.21.15.71:6835/2477293368] conn(0x5581b8639330 0x5581b8639700 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.212+0000 7fdf8eaa6b80 1 --2- 172.21.15.71:0/4057323593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581b8619f60 0x5581b8631eb0 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.212+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/4057323593 >> 172.21.15.71:0/4057323593 conn(0x5581b85f2370 msgr2=0x5581b85edac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:34.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.212+0000 7fdf58ff9700 0 client.10317 ms_handle_reset on v2:172.21.15.71:6833/2477293368 2023-10-09T08:17:34.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.212+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/4057323593 shutdown_connections 2023-10-09T08:17:34.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.212+0000 7fdf8eaa6b80 1 -- 172.21.15.71:0/4057323593 wait complete. 2023-10-09T08:17:34.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.213+0000 7fdf8eaa6b80 20 client.10317 trim_cache size 0 max 16384 2023-10-09T08:17:34.227 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T08:17:34.227 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "604c5619-653a-4ab6-912c-ab2e5464fe4a", 2023-10-09T08:17:34.227 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2023-10-09T08:17:34.227 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 10149, 2023-10-09T08:17:34.227 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2023-10-09T08:17:34.228 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2023-10-09T08:17:34.228 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2023-10-09T08:17:34.228 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 11.242128363000001, 2023-10-09T08:17:34.228 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 97, 2023-10-09T08:17:34.228 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 210, 2023-10-09T08:17:34.228 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 210, 2023-10-09T08:17:34.228 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 17.568167678999998 2023-10-09T08:17:34.228 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T08:17:34.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.213+0000 7fdf803ff700 1 -- 172.21.15.71:0/142119769 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdf5c066f30 msgr2=0x7fdf5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:34.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.213+0000 7fdf803ff700 1 --2- 172.21.15.71:0/142119769 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdf5c066f30 0x7fdf5c0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdf780cde40 tx=0x7fdf68009040 comp rx=0 tx=0).stop 2023-10-09T08:17:34.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.213+0000 7fdf803ff700 1 -- 172.21.15.71:0/142119769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7806bcd0 msgr2=0x7fdf780c83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:34.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.213+0000 7fdf803ff700 1 --2- 172.21.15.71:0/142119769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7806bcd0 0x7fdf780c83c0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400b6c0 tx=0x7fdf74018000 comp rx=0 tx=0).stop 2023-10-09T08:17:34.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.213+0000 7fdf803ff700 1 -- 172.21.15.71:0/142119769 shutdown_connections 2023-10-09T08:17:34.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.213+0000 7fdf803ff700 1 --2- 172.21.15.71:0/142119769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf7815df50 0x7fdf780c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.213+0000 7fdf803ff700 1 --2- 172.21.15.71:0/142119769 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdf5c066f30 0x7fdf5c0693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.213+0000 7fdf803ff700 1 --2- 172.21.15.71:0/142119769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7806bcd0 0x7fdf780c83c0 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.213+0000 7fdf803ff700 1 --2- 172.21.15.71:0/142119769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf7806c0a0 0x7fdf780c5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.213+0000 7fdf803ff700 1 -- 172.21.15.71:0/142119769 >> 172.21.15.71:0/142119769 conn(0x7fdf780ce600 msgr2=0x7fdf780c4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:34.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.213+0000 7fdf803ff700 1 -- 172.21.15.71:0/142119769 shutdown_connections 2023-10-09T08:17:34.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.213+0000 7fdf803ff700 1 -- 172.21.15.71:0/142119769 wait complete. 2023-10-09T08:17:34.232 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T08:17:34.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.416+0000 7f55dc99d700 1 Processor -- start 2023-10-09T08:17:34.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.416+0000 7f55dc99d700 1 -- start start 2023-10-09T08:17:34.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.417+0000 7f55dc99d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f55d8150180 0x7f55d8157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.417+0000 7f55dc99d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f55d8150550 0x7f55d80c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.417+0000 7f55dc99d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d806e2a0 con 0x7f55d80c7240 2023-10-09T08:17:34.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.418+0000 7f55dc99d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d806b2e0 con 0x7f55d8150550 2023-10-09T08:17:34.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.418+0000 7f55dc99d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d80c7680 con 0x7f55d8150180 2023-10-09T08:17:34.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.418+0000 7f55d6ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f55d8150550 0x7f55d80c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:34.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.418+0000 7f55d6ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f55d8150550 0x7f55d80c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48368/0 (socket says 172.21.15.71:48368) 2023-10-09T08:17:34.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.418+0000 7f55d6ffd700 1 -- 172.21.15.71:0/599246584 learned_addr learned my addr 172.21.15.71:0/599246584 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:34.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.418+0000 7f55d77fe700 1 --2- 172.21.15.71:0/599246584 >> v2:172.21.15.179:3300/0 conn(0x7f55d8150180 0x7f55d8157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:34.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.418+0000 7f55d6ffd700 1 -- 172.21.15.71:0/599246584 >> v2:172.21.15.179:3300/0 conn(0x7f55d8150180 msgr2=0x7f55d8157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:34.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.418+0000 7f55d6ffd700 1 --2- 172.21.15.71:0/599246584 >> v2:172.21.15.179:3300/0 conn(0x7f55d8150180 0x7f55d8157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.418+0000 7f55d6ffd700 1 -- 172.21.15.71:0/599246584 >> v1:172.21.15.179:6789/0 conn(0x7f55d80c7240 legacy=0x7f55d8069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:34.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.418+0000 7f55d6ffd700 1 -- 172.21.15.71:0/599246584 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d80c78e0 con 0x7f55d8150550 2023-10-09T08:17:34.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.419+0000 7f55d6ffd700 1 --2- 172.21.15.71:0/599246584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55d8150550 0x7f55d80c6d00 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f55d806fd20 tx=0x7f55cc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54addadaf140b1c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:34.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.419+0000 7f55d67fc700 1 -- 172.21.15.71:0/599246584 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc00dba0 con 0x7f55d8150550 2023-10-09T08:17:34.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.419+0000 7f55d67fc700 1 -- 172.21.15.71:0/599246584 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55cc00dd00 con 0x7f55d8150550 2023-10-09T08:17:34.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.419+0000 7f55d67fc700 1 -- 172.21.15.71:0/599246584 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc0196d0 con 0x7f55d8150550 2023-10-09T08:17:34.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.419+0000 7f55dc99d700 1 -- 172.21.15.71:0/599246584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55d8150550 msgr2=0x7f55d80c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:34.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.419+0000 7f55dc99d700 1 --2- 172.21.15.71:0/599246584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55d8150550 0x7f55d80c6d00 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f55d806fd20 tx=0x7f55cc00b4f0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.419+0000 7f55dc99d700 1 -- 172.21.15.71:0/599246584 shutdown_connections 2023-10-09T08:17:34.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.419+0000 7f55dc99d700 1 --2- 172.21.15.71:0/599246584 >> v2:172.21.15.179:3300/0 conn(0x7f55d8150180 0x7f55d8157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.419+0000 7f55dc99d700 1 --2- 172.21.15.71:0/599246584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55d8150550 0x7f55d80c6d00 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.419+0000 7f55dc99d700 1 -- 172.21.15.71:0/599246584 >> 172.21.15.71:0/599246584 conn(0x7f55d80cc1f0 msgr2=0x7f55d80cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:34.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.420+0000 7f55dc99d700 1 -- 172.21.15.71:0/599246584 shutdown_connections 2023-10-09T08:17:34.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.420+0000 7f55dc99d700 1 -- 172.21.15.71:0/599246584 wait complete. 2023-10-09T08:17:34.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.421+0000 7f55dc99d700 1 Processor -- start 2023-10-09T08:17:34.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.421+0000 7f55dc99d700 1 -- start start 2023-10-09T08:17:34.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.422+0000 7f55dc99d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55d80c7240 0x7f55d80cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.422+0000 7f55dc99d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55d8150180 0x7f55d80aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.422+0000 7f55dc99d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55d8150550 0x7f55d80af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.422+0000 7f55dc99d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d80b0780 con 0x7f55d8150550 2023-10-09T08:17:34.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.422+0000 7f55dc99d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d80ad880 con 0x7f55d80c7240 2023-10-09T08:17:34.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.422+0000 7f55dc99d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d80afb70 con 0x7f55d8150180 2023-10-09T08:17:34.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.422+0000 7f55d7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55d8150550 0x7f55d80af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:34.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.422+0000 7f55d7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55d8150550 0x7f55d80af4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48372/0 (socket says 172.21.15.71:48372) 2023-10-09T08:17:34.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.422+0000 7f55d7fff700 1 -- 172.21.15.71:0/3005546033 learned_addr learned my addr 172.21.15.71:0/3005546033 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:34.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.422+0000 7f55d77fe700 1 --2- 172.21.15.71:0/3005546033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55d80c7240 0x7f55d80cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:34.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.422+0000 7f55d6ffd700 1 --2- 172.21.15.71:0/3005546033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55d8150180 0x7f55d80aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:34.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.423+0000 7f55d7fff700 1 -- 172.21.15.71:0/3005546033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55d8150180 msgr2=0x7f55d80aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:34.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.423+0000 7f55d7fff700 1 --2- 172.21.15.71:0/3005546033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55d8150180 0x7f55d80aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.423+0000 7f55d7fff700 1 -- 172.21.15.71:0/3005546033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55d80c7240 msgr2=0x7f55d80cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:34.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.423+0000 7f55d7fff700 1 --2- 172.21.15.71:0/3005546033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55d80c7240 0x7f55d80cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.423+0000 7f55d7fff700 1 -- 172.21.15.71:0/3005546033 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc00b790 con 0x7f55d8150550 2023-10-09T08:17:34.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.423+0000 7f55d7fff700 1 --2- 172.21.15.71:0/3005546033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55d8150550 0x7f55d80af4d0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f55d000c8e0 tx=0x7f55d0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:34.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.423+0000 7f55bf7fe700 1 -- 172.21.15.71:0/3005546033 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d0012630 con 0x7f55d8150550 2023-10-09T08:17:34.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.423+0000 7f55bf7fe700 1 -- 172.21.15.71:0/3005546033 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d0012790 con 0x7f55d8150550 2023-10-09T08:17:34.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.423+0000 7f55dc99d700 1 -- 172.21.15.71:0/3005546033 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d80afe50 con 0x7f55d8150550 2023-10-09T08:17:34.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.423+0000 7f55bf7fe700 1 -- 172.21.15.71:0/3005546033 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d0012b50 con 0x7f55d8150550 2023-10-09T08:17:34.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.423+0000 7f55dc99d700 1 -- 172.21.15.71:0/3005546033 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d80b0410 con 0x7f55d8150550 2023-10-09T08:17:34.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.424+0000 7f55dc99d700 1 -- 172.21.15.71:0/3005546033 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d80b0930 con 0x7f55d8150550 2023-10-09T08:17:34.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.425+0000 7f55bf7fe700 1 -- 172.21.15.71:0/3005546033 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f55d001a3a0 con 0x7f55d8150550 2023-10-09T08:17:34.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.426+0000 7f55bf7fe700 1 --2- 172.21.15.71:0/3005546033 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f55c4066f30 0x7f55c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:34.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.426+0000 7f55bf7fe700 1 -- 172.21.15.71:0/3005546033 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f55d0084920 con 0x7f55d8150550 2023-10-09T08:17:34.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.426+0000 7f55d77fe700 1 --2- 172.21.15.71:0/3005546033 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f55c4066f30 0x7f55c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:34.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.427+0000 7f55d77fe700 1 --2- 172.21.15.71:0/3005546033 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f55c4066f30 0x7f55c40693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f55d80ab660 tx=0x7f55c80091a0 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:34.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.430+0000 7f55bf7fe700 1 -- 172.21.15.71:0/3005546033 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55d00518e0 con 0x7f55d8150550 2023-10-09T08:17:34.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.661+0000 7f55dc99d700 1 -- 172.21.15.71:0/3005546033 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f55d804c3c0 con 0x7f55d8150550 2023-10-09T08:17:34.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.661+0000 7f55bf7fe700 1 -- 172.21.15.71:0/3005546033 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v97) v1 ==== 53+0+73 (secure 0 0 0) 0x7f55d0054f00 con 0x7f55d8150550 2023-10-09T08:17:34.663 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T08:17:34.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.663+0000 7f55dc99d700 1 -- 172.21.15.71:0/3005546033 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f55c4066f30 msgr2=0x7f55c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:34.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.664+0000 7f55dc99d700 1 --2- 172.21.15.71:0/3005546033 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f55c4066f30 0x7f55c40693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f55d80ab660 tx=0x7f55c80091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.664+0000 7f55dc99d700 1 -- 172.21.15.71:0/3005546033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55d8150550 msgr2=0x7f55d80af4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:34.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.664+0000 7f55dc99d700 1 --2- 172.21.15.71:0/3005546033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55d8150550 0x7f55d80af4d0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f55d000c8e0 tx=0x7f55d0001710 comp rx=0 tx=0).stop 2023-10-09T08:17:34.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.664+0000 7f55dc99d700 1 -- 172.21.15.71:0/3005546033 shutdown_connections 2023-10-09T08:17:34.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.664+0000 7f55dc99d700 1 --2- 172.21.15.71:0/3005546033 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f55c4066f30 0x7f55c40693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.664+0000 7f55dc99d700 1 --2- 172.21.15.71:0/3005546033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55d8150550 0x7f55d80af4d0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.664+0000 7f55dc99d700 1 --2- 172.21.15.71:0/3005546033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55d80c7240 0x7f55d80cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.664+0000 7f55dc99d700 1 --2- 172.21.15.71:0/3005546033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55d8150180 0x7f55d80aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:34.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.664+0000 7f55dc99d700 1 -- 172.21.15.71:0/3005546033 >> 172.21.15.71:0/3005546033 conn(0x7f55d80cc1f0 msgr2=0x7f55d8154d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:34.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.664+0000 7f55dc99d700 1 -- 172.21.15.71:0/3005546033 shutdown_connections 2023-10-09T08:17:34.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:34.664+0000 7f55dc99d700 1 -- 172.21.15.71:0/3005546033 wait complete. 2023-10-09T08:17:34.683 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T08:17:34.685 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T08:17:34.685 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2023-10-09T08:17:34.685 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T08:17:34.685 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T08:17:34.686 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T08:17:34.686 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T08:17:34.686 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T08:17:34.686 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T08:17:34.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:17:34.687 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2023-10-09T08:17:34.727 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T08:17:34.727 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T08:17:34.727 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T08:17:34.727 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T08:17:34.728 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-10-09T08:17:34.728 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T08:17:34.728 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T08:17:34.728 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2023-10-09T08:17:34.728 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2023-10-09T08:17:34.728 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T08:17:34.728 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2023-10-09T08:17:34.728 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2023-10-09T08:17:34.728 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T08:17:34.729 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2023-10-09T08:17:34.729 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T08:17:34.729 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2023-10-09T08:17:34.729 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T08:17:34.729 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 36581sec preferred_lft 36581sec 2023-10-09T08:17:34.729 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2023-10-09T08:17:34.729 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T08:17:34.729 INFO:teuthology.orchestra.run.smithi071.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T08:17:34.729 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5a:a1:ec:c7:41:8f brd ff:ff:ff:ff:ff:ff 2023-10-09T08:17:34.730 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T08:17:34.730 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T08:17:34.730 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::8052:a9ff:fe85:8756/64 scope link 2023-10-09T08:17:34.730 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T08:17:34.730 INFO:teuthology.orchestra.run.smithi071.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T08:17:34.730 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether ae:1f:c9:59:0c:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T08:17:34.730 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ac1f:c9ff:fe59:c1b/64 scope link 2023-10-09T08:17:34.730 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T08:17:34.731 INFO:teuthology.orchestra.run.smithi071.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T08:17:34.731 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 5a:a1:ec:c7:41:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T08:17:34.731 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::58a1:ecff:fec7:418f/64 scope link 2023-10-09T08:17:34.731 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-09T08:17:34.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:17:34.731 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T08:17:34.828 INFO:teuthology.orchestra.run.smithi071.stdout:1 2023-10-09T08:17:34.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:17:34.831 DEBUG:teuthology.orchestra.run.smithi071:> route 2023-10-09T08:17:34.872 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2023-10-09T08:17:34.872 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T08:17:34.872 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T08:17:34.872 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T08:17:34.873 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T08:17:34.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:17:34.873 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-09T08:17:34.873 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-09T08:17:34.873 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T08:17:34.874 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T08:17:34.874 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T08:17:34.874 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-09T08:17:35.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:17:35.070 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-09T08:17:35.105 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T08:17:35.105 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T08:17:35.106 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T08:17:35.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:17:35.106 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2023-10-09T08:17:35.207 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T08:17:35.207 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T08:17:35.243 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T08:17:35.244 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T08:17:35.244 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T08:17:35.319 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T08:17:35.319 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T08:17:35.319 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T08:17:35.448 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T08:17:35.448 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T08:17:35.476 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T08:17:35.477 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T08:17:35.477 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.71:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-10-09T08:17:35.477 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with new device syntax: 0@604c5619-653a-4ab6-912c-ab2e5464fe4a.cephfs=/ 2023-10-09T08:17:35.477 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.71:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-10-09T08:17:35.481 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T08:17:35.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:17:35.481 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T08:17:35.543 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T08:17:35.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.725+0000 7f843319d700 1 Processor -- start 2023-10-09T08:17:35.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.725+0000 7f843319d700 1 -- start start 2023-10-09T08:17:35.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.726+0000 7f843319d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f842c150550 0x7f842c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:35.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.726+0000 7f843319d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f842c06e2a0 con 0x7f842c0c7410 2023-10-09T08:17:35.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.726+0000 7f843319d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f842c06b2e0 con 0x7f842c150180 2023-10-09T08:17:35.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.726+0000 7f843319d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f842c0c78e0 con 0x7f842c150550 2023-10-09T08:17:35.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.726+0000 7f843299c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f842c0c7410 0x7f842c069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60164/0 (socket says 172.21.15.71:60164) 2023-10-09T08:17:35.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.726+0000 7f843299c700 1 -- 172.21.15.71:0/1499840079 learned_addr learned my addr 172.21.15.71:0/1499840079 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:35.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.727+0000 7f843199a700 1 --2- 172.21.15.71:0/1499840079 >> v2:172.21.15.179:3300/0 conn(0x7f842c150550 0x7f842c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:35.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.727+0000 7f8431199700 1 -- 172.21.15.71:0/1499840079 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2123901409 0 0) 0x7f842c06e2a0 con 0x7f842c0c7410 2023-10-09T08:17:35.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.727+0000 7f8431199700 1 -- 172.21.15.71:0/1499840079 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8418003570 con 0x7f842c0c7410 2023-10-09T08:17:35.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.727+0000 7f8431199700 1 -- 172.21.15.71:0/1499840079 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 825278844 0 0) 0x7f8418003570 con 0x7f842c0c7410 2023-10-09T08:17:35.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.727+0000 7f8431199700 1 -- 172.21.15.71:0/1499840079 >> v2:172.21.15.179:3300/0 conn(0x7f842c150550 msgr2=0x7f842c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:35.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.727+0000 7f8431199700 1 --2- 172.21.15.71:0/1499840079 >> v2:172.21.15.179:3300/0 conn(0x7f842c150550 0x7f842c157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:35.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.727+0000 7f8431199700 1 -- 172.21.15.71:0/1499840079 >> v1:172.21.15.179:6789/0 conn(0x7f842c150180 legacy=0x7f842c0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:35.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.727+0000 7f8431199700 1 -- 172.21.15.71:0/1499840079 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c0c7bc0 con 0x7f842c0c7410 2023-10-09T08:17:35.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.727+0000 7f8431199700 1 -- 172.21.15.71:0/1499840079 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f84240017f0 con 0x7f842c0c7410 2023-10-09T08:17:35.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.727+0000 7f8431199700 1 -- 172.21.15.71:0/1499840079 >> v1:172.21.15.71:6789/0 conn(0x7f842c0c7410 legacy=0x7f842c069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:35.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.727+0000 7f8431199700 1 --2- 172.21.15.71:0/1499840079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8418003a60 0x7f8418003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:35.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.727+0000 7f8431199700 1 --2- 172.21.15.71:0/1499840079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8418004810 0x7f8418004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:35.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.727+0000 7f8431199700 1 --2- 172.21.15.71:0/1499840079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84180051c0 0x7f841800cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:35.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.727+0000 7f8431199700 1 -- 172.21.15.71:0/1499840079 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c0c78e0 con 0x7f8418004810 2023-10-09T08:17:35.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.727+0000 7f8431199700 1 -- 172.21.15.71:0/1499840079 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841800d1e0 con 0x7f84180051c0 2023-10-09T08:17:35.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.727+0000 7f8431199700 1 -- 172.21.15.71:0/1499840079 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841800d3a0 con 0x7f8418003a60 2023-10-09T08:17:35.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.727+0000 7f843199a700 1 --2- 172.21.15.71:0/1499840079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8418004810 0x7f8418004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:35.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.728+0000 7f843219b700 1 --2- 172.21.15.71:0/1499840079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8418003a60 0x7f8418003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:35.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.728+0000 7f843299c700 1 --2- 172.21.15.71:0/1499840079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84180051c0 0x7f841800cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:35.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.728+0000 7f843199a700 1 -- 172.21.15.71:0/1499840079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8418003a60 msgr2=0x7f8418003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:35.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.728+0000 7f843199a700 1 --2- 172.21.15.71:0/1499840079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8418003a60 0x7f8418003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:35.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.728+0000 7f843199a700 1 -- 172.21.15.71:0/1499840079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84180051c0 msgr2=0x7f841800cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:35.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.728+0000 7f843199a700 1 --2- 172.21.15.71:0/1499840079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84180051c0 0x7f841800cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:35.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.728+0000 7f843299c700 1 -- 172.21.15.71:0/1499840079 reap_dead start 2023-10-09T08:17:35.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.728+0000 7f843199a700 1 -- 172.21.15.71:0/1499840079 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8418003570 con 0x7f8418004810 2023-10-09T08:17:35.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.728+0000 7f843199a700 1 --2- 172.21.15.71:0/1499840079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8418004810 0x7f8418004c80 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f841c009c00 tx=0x7f841c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8d0c7d842d360f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:35.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.728+0000 7f8431199700 1 -- 172.21.15.71:0/1499840079 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c00e710 con 0x7f8418004810 2023-10-09T08:17:35.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.728+0000 7f8431199700 1 -- 172.21.15.71:0/1499840079 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841c00e870 con 0x7f8418004810 2023-10-09T08:17:35.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.728+0000 7f8431199700 1 -- 172.21.15.71:0/1499840079 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c00ec30 con 0x7f8418004810 2023-10-09T08:17:35.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.729+0000 7f843319d700 1 -- 172.21.15.71:0/1499840079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8418004810 msgr2=0x7f8418004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:35.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.729+0000 7f843319d700 1 --2- 172.21.15.71:0/1499840079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8418004810 0x7f8418004c80 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f841c009c00 tx=0x7f841c0091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:35.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.729+0000 7f843319d700 1 -- 172.21.15.71:0/1499840079 shutdown_connections 2023-10-09T08:17:35.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.729+0000 7f843319d700 1 --2- 172.21.15.71:0/1499840079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8418004810 0x7f8418004c80 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:35.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.729+0000 7f843319d700 1 -- 172.21.15.71:0/1499840079 >> 172.21.15.71:0/1499840079 conn(0x7f842c0cc1f0 msgr2=0x7f842c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:35.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.729+0000 7f843319d700 1 -- 172.21.15.71:0/1499840079 shutdown_connections 2023-10-09T08:17:35.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.729+0000 7f843319d700 1 -- 172.21.15.71:0/1499840079 wait complete. 2023-10-09T08:17:35.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.730+0000 7f843319d700 1 Processor -- start 2023-10-09T08:17:35.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.730+0000 7f843319d700 1 -- start start 2023-10-09T08:17:35.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.731+0000 7f843319d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8418004810 0x7f842c169420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:35.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.731+0000 7f843319d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f842c15a380 0x7f842c1590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:35.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.731+0000 7f843319d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f842c154d30 0x7f842c1551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:35.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.731+0000 7f843319d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c155710 con 0x7f842c154d30 2023-10-09T08:17:35.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.731+0000 7f843319d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c0af9f0 con 0x7f8418004810 2023-10-09T08:17:35.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.731+0000 7f843319d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842c1599c0 con 0x7f842c15a380 2023-10-09T08:17:35.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.731+0000 7f843299c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f842c154d30 0x7f842c1551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:35.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.732+0000 7f843299c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f842c154d30 0x7f842c1551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49604/0 (socket says 172.21.15.71:49604) 2023-10-09T08:17:35.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.732+0000 7f843299c700 1 -- 172.21.15.71:0/1192593410 learned_addr learned my addr 172.21.15.71:0/1192593410 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:35.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.732+0000 7f843199a700 1 --2- 172.21.15.71:0/1192593410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f842c15a380 0x7f842c1590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:35.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.732+0000 7f843219b700 1 --2- 172.21.15.71:0/1192593410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8418004810 0x7f842c169420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:35.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.732+0000 7f843299c700 1 -- 172.21.15.71:0/1192593410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f842c15a380 msgr2=0x7f842c1590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:35.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.732+0000 7f843299c700 1 --2- 172.21.15.71:0/1192593410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f842c15a380 0x7f842c1590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:35.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.732+0000 7f843299c700 1 -- 172.21.15.71:0/1192593410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8418004810 msgr2=0x7f842c169420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:35.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.732+0000 7f843299c700 1 --2- 172.21.15.71:0/1192593410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8418004810 0x7f842c169420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:35.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.732+0000 7f843299c700 1 -- 172.21.15.71:0/1192593410 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c0af0c0 con 0x7f842c154d30 2023-10-09T08:17:35.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.732+0000 7f843199a700 1 --2- 172.21.15.71:0/1192593410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f842c15a380 0x7f842c1590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:35.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.732+0000 7f843299c700 1 --2- 172.21.15.71:0/1192593410 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f842c154d30 0x7f842c1551d0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f842c0c7810 tx=0x7f8424001330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:35.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.732+0000 7f84227fc700 1 -- 172.21.15.71:0/1192593410 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424017070 con 0x7f842c154d30 2023-10-09T08:17:35.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.732+0000 7f84227fc700 1 -- 172.21.15.71:0/1192593410 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8424001fd0 con 0x7f842c154d30 2023-10-09T08:17:35.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.732+0000 7f843319d700 1 -- 172.21.15.71:0/1192593410 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f842c0af3a0 con 0x7f842c154d30 2023-10-09T08:17:35.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.732+0000 7f84227fc700 1 -- 172.21.15.71:0/1192593410 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424013420 con 0x7f842c154d30 2023-10-09T08:17:35.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.733+0000 7f843319d700 1 -- 172.21.15.71:0/1192593410 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842c159620 con 0x7f842c154d30 2023-10-09T08:17:35.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.733+0000 7f843319d700 1 -- 172.21.15.71:0/1192593410 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f842c0afba0 con 0x7f842c154d30 2023-10-09T08:17:35.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.734+0000 7f84227fc700 1 -- 172.21.15.71:0/1192593410 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84240137d0 con 0x7f842c154d30 2023-10-09T08:17:35.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.735+0000 7f84227fc700 1 --2- 172.21.15.71:0/1192593410 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8410066f60 0x7f8410069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:35.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.735+0000 7f84227fc700 1 -- 172.21.15.71:0/1192593410 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f8424084740 con 0x7f842c154d30 2023-10-09T08:17:35.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.736+0000 7f843219b700 1 --2- 172.21.15.71:0/1192593410 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8410066f60 0x7f8410069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:35.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.736+0000 7f843219b700 1 --2- 172.21.15.71:0/1192593410 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8410066f60 0x7f8410069410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8428000c00 tx=0x7f8428009040 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:35.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.739+0000 7f84227fc700 1 -- 172.21.15.71:0/1192593410 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f842c0afba0 con 0x7f842c154d30 2023-10-09T08:17:35.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.956+0000 7f843319d700 1 -- 172.21.15.71:0/1192593410 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f842c0afba0 con 0x7f8410066f60 2023-10-09T08:17:35.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.958+0000 7f84227fc700 1 -- 172.21.15.71:0/1192593410 <== mgr.9427 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f842c0afba0 con 0x7f8410066f60 2023-10-09T08:17:35.959 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-09T08:17:35.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-09T08:17:35.959 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "cephfs" 2023-10-09T08:17:35.959 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-09T08:17:35.959 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-09T08:17:35.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.960+0000 7f843319d700 1 -- 172.21.15.71:0/1192593410 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8410066f60 msgr2=0x7f8410069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:35.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.960+0000 7f843319d700 1 --2- 172.21.15.71:0/1192593410 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8410066f60 0x7f8410069410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8428000c00 tx=0x7f8428009040 comp rx=0 tx=0).stop 2023-10-09T08:17:35.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.960+0000 7f843319d700 1 -- 172.21.15.71:0/1192593410 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f842c154d30 msgr2=0x7f842c1551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:35.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.960+0000 7f843319d700 1 --2- 172.21.15.71:0/1192593410 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f842c154d30 0x7f842c1551d0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f842c0c7810 tx=0x7f8424001330 comp rx=0 tx=0).stop 2023-10-09T08:17:35.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.960+0000 7f843319d700 1 -- 172.21.15.71:0/1192593410 shutdown_connections 2023-10-09T08:17:35.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.960+0000 7f843319d700 1 --2- 172.21.15.71:0/1192593410 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8410066f60 0x7f8410069410 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:35.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.960+0000 7f843319d700 1 --2- 172.21.15.71:0/1192593410 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f842c154d30 0x7f842c1551d0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:35.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.960+0000 7f843319d700 1 --2- 172.21.15.71:0/1192593410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8418004810 0x7f842c169420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:35.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.960+0000 7f843319d700 1 --2- 172.21.15.71:0/1192593410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f842c15a380 0x7f842c1590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:35.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.960+0000 7f843319d700 1 -- 172.21.15.71:0/1192593410 >> 172.21.15.71:0/1192593410 conn(0x7f842c0cc1f0 msgr2=0x7f842c0c1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:35.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.960+0000 7f843319d700 1 -- 172.21.15.71:0/1192593410 shutdown_connections 2023-10-09T08:17:35.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:35.960+0000 7f843319d700 1 -- 172.21.15.71:0/1192593410 wait complete. 2023-10-09T08:17:35.978 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-09T08:17:36.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.162+0000 7fec0a7ff700 1 Processor -- start 2023-10-09T08:17:36.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.162+0000 7fec0a7ff700 1 -- start start 2023-10-09T08:17:36.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.164+0000 7fec0a7ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fec0415ac80 0x7fec04069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:36.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.164+0000 7fec0a7ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec040af2f0 con 0x7fec0415b050 2023-10-09T08:17:36.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.164+0000 7fec0a7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec040af5d0 con 0x7fec04069cb0 2023-10-09T08:17:36.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.164+0000 7fec0a7ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0406a0e0 con 0x7fec0415ac80 2023-10-09T08:17:36.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.164+0000 7fec03fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fec0415ac80 0x7fec04069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:36.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.164+0000 7fec037fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fec0415b050 0x7fec040afa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60178/0 (socket says 172.21.15.71:60178) 2023-10-09T08:17:36.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.164+0000 7fec03fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fec0415ac80 0x7fec04069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49614/0 (socket says 172.21.15.71:49614) 2023-10-09T08:17:36.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.164+0000 7fec037fe700 1 -- 172.21.15.71:0/2920900694 learned_addr learned my addr 172.21.15.71:0/2920900694 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:36.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.164+0000 7fec03fff700 1 -- 172.21.15.71:0/2920900694 >> v1:172.21.15.179:6789/0 conn(0x7fec04069cb0 legacy=0x7fec040c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:36.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.165+0000 7fec03fff700 1 -- 172.21.15.71:0/2920900694 >> v1:172.21.15.71:6789/0 conn(0x7fec0415b050 legacy=0x7fec040afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:36.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.165+0000 7fec03fff700 1 -- 172.21.15.71:0/2920900694 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec040c8660 con 0x7fec0415ac80 2023-10-09T08:17:36.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.165+0000 7fec02ffd700 1 -- 172.21.15.71:0/2920900694 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351275111 0 0) 0x7fec040af2f0 con 0x7fec0415b050 2023-10-09T08:17:36.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.165+0000 7fec03fff700 1 --2- 172.21.15.71:0/2920900694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec0415ac80 0x7fec04069770 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7febf40098e0 tx=0x7febf40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f326a62d1224f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:36.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.165+0000 7fec02ffd700 1 -- 172.21.15.71:0/2920900694 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf4009e80 con 0x7fec0415ac80 2023-10-09T08:17:36.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.165+0000 7fec02ffd700 1 -- 172.21.15.71:0/2920900694 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf400b820 con 0x7fec0415ac80 2023-10-09T08:17:36.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.165+0000 7fec02ffd700 1 -- 172.21.15.71:0/2920900694 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf400bba0 con 0x7fec0415ac80 2023-10-09T08:17:36.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.165+0000 7fec0a7ff700 1 -- 172.21.15.71:0/2920900694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec0415ac80 msgr2=0x7fec04069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:36.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.165+0000 7fec0a7ff700 1 --2- 172.21.15.71:0/2920900694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec0415ac80 0x7fec04069770 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7febf40098e0 tx=0x7febf40091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:36.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.166+0000 7fec0a7ff700 1 -- 172.21.15.71:0/2920900694 shutdown_connections 2023-10-09T08:17:36.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.166+0000 7fec0a7ff700 1 --2- 172.21.15.71:0/2920900694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec0415ac80 0x7fec04069770 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:36.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.166+0000 7fec0a7ff700 1 -- 172.21.15.71:0/2920900694 >> 172.21.15.71:0/2920900694 conn(0x7fec04068e10 msgr2=0x7fec040cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:36.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.166+0000 7fec0a7ff700 1 -- 172.21.15.71:0/2920900694 shutdown_connections 2023-10-09T08:17:36.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.166+0000 7fec0a7ff700 1 -- 172.21.15.71:0/2920900694 wait complete. 2023-10-09T08:17:36.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.167+0000 7fec0a7ff700 1 Processor -- start 2023-10-09T08:17:36.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.167+0000 7fec0a7ff700 1 -- start start 2023-10-09T08:17:36.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.168+0000 7fec0a7ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec04069cb0 0x7fec0416dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:36.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.168+0000 7fec0a7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec0415ac80 0x7fec040a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:36.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.168+0000 7fec0a7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec0415b050 0x7fec040ade90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:36.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.168+0000 7fec0a7ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec040aa790 con 0x7fec04069cb0 2023-10-09T08:17:36.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.168+0000 7fec0a7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec040aa1d0 con 0x7fec0415ac80 2023-10-09T08:17:36.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.168+0000 7fec0a7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec040aa4b0 con 0x7fec0415b050 2023-10-09T08:17:36.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.168+0000 7fec03fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec04069cb0 0x7fec0416dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:36.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.168+0000 7fec03fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec04069cb0 0x7fec0416dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49618/0 (socket says 172.21.15.71:49618) 2023-10-09T08:17:36.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.168+0000 7fec03fff700 1 -- 172.21.15.71:0/979111292 learned_addr learned my addr 172.21.15.71:0/979111292 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:36.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.169+0000 7fec037fe700 1 --2- 172.21.15.71:0/979111292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec0415ac80 0x7fec040a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:36.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.169+0000 7fec08d9c700 1 --2- 172.21.15.71:0/979111292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec0415b050 0x7fec040ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:36.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.169+0000 7fec03fff700 1 -- 172.21.15.71:0/979111292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec0415b050 msgr2=0x7fec040ade90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:36.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.169+0000 7fec03fff700 1 --2- 172.21.15.71:0/979111292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec0415b050 0x7fec040ade90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:36.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.169+0000 7fec03fff700 1 -- 172.21.15.71:0/979111292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec0415ac80 msgr2=0x7fec040a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:36.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.169+0000 7fec03fff700 1 --2- 172.21.15.71:0/979111292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec0415ac80 0x7fec040a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:36.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.169+0000 7fec03fff700 1 -- 172.21.15.71:0/979111292 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf4009420 con 0x7fec04069cb0 2023-10-09T08:17:36.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.169+0000 7fec08d9c700 1 --2- 172.21.15.71:0/979111292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec0415b050 0x7fec040ade90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:36.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.169+0000 7fec03fff700 1 --2- 172.21.15.71:0/979111292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec04069cb0 0x7fec0416dff0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7febf40030c0 tx=0x7febf4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:36.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.169+0000 7febebfff700 1 -- 172.21.15.71:0/979111292 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf401b470 con 0x7fec04069cb0 2023-10-09T08:17:36.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.169+0000 7febebfff700 1 -- 172.21.15.71:0/979111292 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf401b5d0 con 0x7fec04069cb0 2023-10-09T08:17:36.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.169+0000 7febebfff700 1 -- 172.21.15.71:0/979111292 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf401b990 con 0x7fec04069cb0 2023-10-09T08:17:36.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.169+0000 7fec0a7ff700 1 -- 172.21.15.71:0/979111292 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0416d7f0 con 0x7fec04069cb0 2023-10-09T08:17:36.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.169+0000 7fec0a7ff700 1 -- 172.21.15.71:0/979111292 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0416e530 con 0x7fec04069cb0 2023-10-09T08:17:36.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.170+0000 7fec0a7ff700 1 -- 172.21.15.71:0/979111292 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0404c3c0 con 0x7fec04069cb0 2023-10-09T08:17:36.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.171+0000 7febebfff700 1 -- 172.21.15.71:0/979111292 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 101) v1 ==== 84740+0+0 (secure 0 0 0) 0x7febf401c450 con 0x7fec04069cb0 2023-10-09T08:17:36.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.172+0000 7febebfff700 1 --2- 172.21.15.71:0/979111292 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7febf0066f30 0x7febf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:36.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.172+0000 7febebfff700 1 -- 172.21.15.71:0/979111292 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6225+0+0 (secure 0 0 0) 0x7febf40867d0 con 0x7fec04069cb0 2023-10-09T08:17:36.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.172+0000 7fec037fe700 1 --2- 172.21.15.71:0/979111292 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7febf0066f30 0x7febf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:36.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.173+0000 7fec037fe700 1 --2- 172.21.15.71:0/979111292 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7febf0066f30 0x7febf00693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fec040cc2e0 tx=0x7febf8009040 comp rx=0 tx=0).ready entity=mgr.9427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:36.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.176+0000 7febebfff700 1 -- 172.21.15.71:0/979111292 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febf4053790 con 0x7fec04069cb0 2023-10-09T08:17:36.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:36.421+0000 7fec0a7ff700 1 -- 172.21.15.71:0/979111292 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fec040c8940 con 0x7fec04069cb0 2023-10-09T08:17:37.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.033+0000 7febebfff700 1 -- 172.21.15.71:0/979111292 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 102) v1 ==== 84757+0+0 (secure 0 0 0) 0x7febf4053b60 con 0x7fec04069cb0 2023-10-09T08:17:37.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.034+0000 7febebfff700 1 -- 172.21.15.71:0/979111292 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v102) v1 ==== 92+0+0 (secure 0 0 0) 0x7febf4057220 con 0x7fec04069cb0 2023-10-09T08:17:37.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.037+0000 7fec0a7ff700 1 -- 172.21.15.71:0/979111292 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7febf0066f30 msgr2=0x7febf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:37.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.037+0000 7fec0a7ff700 1 --2- 172.21.15.71:0/979111292 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7febf0066f30 0x7febf00693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fec040cc2e0 tx=0x7febf8009040 comp rx=0 tx=0).stop 2023-10-09T08:17:37.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.037+0000 7fec0a7ff700 1 -- 172.21.15.71:0/979111292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec04069cb0 msgr2=0x7fec0416dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:37.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.037+0000 7fec0a7ff700 1 --2- 172.21.15.71:0/979111292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec04069cb0 0x7fec0416dff0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7febf40030c0 tx=0x7febf4016000 comp rx=0 tx=0).stop 2023-10-09T08:17:37.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.037+0000 7fec0a7ff700 1 -- 172.21.15.71:0/979111292 shutdown_connections 2023-10-09T08:17:37.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.037+0000 7fec0a7ff700 1 --2- 172.21.15.71:0/979111292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec0415b050 0x7fec040ade90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.037+0000 7fec0a7ff700 1 --2- 172.21.15.71:0/979111292 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7febf0066f30 0x7febf00693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.037+0000 7fec0a7ff700 1 --2- 172.21.15.71:0/979111292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec04069cb0 0x7fec0416dff0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.037+0000 7fec0a7ff700 1 --2- 172.21.15.71:0/979111292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec0415ac80 0x7fec040a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.037+0000 7fec0a7ff700 1 -- 172.21.15.71:0/979111292 >> 172.21.15.71:0/979111292 conn(0x7fec04068e10 msgr2=0x7fec040c2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:37.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.037+0000 7fec0a7ff700 1 -- 172.21.15.71:0/979111292 shutdown_connections 2023-10-09T08:17:37.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.037+0000 7fec0a7ff700 1 -- 172.21.15.71:0/979111292 wait complete. 2023-10-09T08:17:37.057 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-09T08:17:37.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.250+0000 7efd3cd9d700 1 Processor -- start 2023-10-09T08:17:37.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.250+0000 7efd3cd9d700 1 -- start start 2023-10-09T08:17:37.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.252+0000 7efd3cd9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efd380ccc00 0x7efd38069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:37.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.252+0000 7efd3cd9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd3806a020 0x7efd380cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:37.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.252+0000 7efd3cd9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd380c9f30 con 0x7efd38159a60 2023-10-09T08:17:37.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.252+0000 7efd3cd9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd3806dfc0 con 0x7efd380ccc00 2023-10-09T08:17:37.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.252+0000 7efd3cd9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd380ca470 con 0x7efd3806a020 2023-10-09T08:17:37.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.252+0000 7efd37fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd3806a020 0x7efd380cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:37.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.252+0000 7efd36ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efd380ccc00 0x7efd38069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:37.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.252+0000 7efd37fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd3806a020 0x7efd380cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:39572/0 (socket says 172.21.15.71:39572) 2023-10-09T08:17:37.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.252+0000 7efd37fff700 1 -- 172.21.15.71:0/1801913313 learned_addr learned my addr 172.21.15.71:0/1801913313 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:37.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.252+0000 7efd377fe700 1 --1- 172.21.15.71:0/1801913313 >> v1:172.21.15.179:6789/0 conn(0x7efd38159a60 0x7efd380c9770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:40332/0 (socket says 172.21.15.71:40332) 2023-10-09T08:17:37.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.253+0000 7efd367fc700 1 -- 172.21.15.71:0/1801913313 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 240348098 0 0) 0x7efd380c9f30 con 0x7efd38159a60 2023-10-09T08:17:37.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.253+0000 7efd367fc700 1 -- 172.21.15.71:0/1801913313 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd20003570 con 0x7efd38159a60 2023-10-09T08:17:37.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.253+0000 7efd36ffd700 1 -- 172.21.15.71:0/1801913313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd3806a020 msgr2=0x7efd380cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:37.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.253+0000 7efd36ffd700 1 --2- 172.21.15.71:0/1801913313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd3806a020 0x7efd380cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.253+0000 7efd36ffd700 1 -- 172.21.15.71:0/1801913313 >> v1:172.21.15.179:6789/0 conn(0x7efd38159a60 legacy=0x7efd380c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:37.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.253+0000 7efd36ffd700 1 -- 172.21.15.71:0/1801913313 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd380ca750 con 0x7efd380ccc00 2023-10-09T08:17:37.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.253+0000 7efd37fff700 1 --2- 172.21.15.71:0/1801913313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd3806a020 0x7efd380cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:37.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.253+0000 7efd36ffd700 1 --2- 172.21.15.71:0/1801913313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd380ccc00 0x7efd38069ae0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0098e0 tx=0x7efd2c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c08ee364c7ad7e8e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:37.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.253+0000 7efd367fc700 1 -- 172.21.15.71:0/1801913313 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c011630 con 0x7efd380ccc00 2023-10-09T08:17:37.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.253+0000 7efd367fc700 1 -- 172.21.15.71:0/1801913313 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2c011790 con 0x7efd380ccc00 2023-10-09T08:17:37.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.253+0000 7efd367fc700 1 -- 172.21.15.71:0/1801913313 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c011b30 con 0x7efd380ccc00 2023-10-09T08:17:37.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.254+0000 7efd3cd9d700 1 -- 172.21.15.71:0/1801913313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd380ccc00 msgr2=0x7efd38069ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:37.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.254+0000 7efd3cd9d700 1 --2- 172.21.15.71:0/1801913313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd380ccc00 0x7efd38069ae0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0098e0 tx=0x7efd2c0091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.254+0000 7efd3cd9d700 1 -- 172.21.15.71:0/1801913313 shutdown_connections 2023-10-09T08:17:37.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.254+0000 7efd3cd9d700 1 --2- 172.21.15.71:0/1801913313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd3806a020 0x7efd380cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.254+0000 7efd3cd9d700 1 --2- 172.21.15.71:0/1801913313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd380ccc00 0x7efd38069ae0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.254+0000 7efd3cd9d700 1 -- 172.21.15.71:0/1801913313 >> 172.21.15.71:0/1801913313 conn(0x7efd3806baa0 msgr2=0x7efd3806bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:37.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.254+0000 7efd3cd9d700 1 -- 172.21.15.71:0/1801913313 shutdown_connections 2023-10-09T08:17:37.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.254+0000 7efd3cd9d700 1 -- 172.21.15.71:0/1801913313 wait complete. 2023-10-09T08:17:37.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.255+0000 7efd3cd9d700 1 Processor -- start 2023-10-09T08:17:37.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.256+0000 7efd3cd9d700 1 -- start start 2023-10-09T08:17:37.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.256+0000 7efd3cd9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd3806a020 0x7efd381546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:37.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.256+0000 7efd3cd9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd380ccc00 0x7efd3815db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:37.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.257+0000 7efd3cd9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd38159a60 0x7efd3815e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:37.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.257+0000 7efd3cd9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd38154be0 con 0x7efd3806a020 2023-10-09T08:17:37.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.257+0000 7efd3cd9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd38154210 con 0x7efd38159a60 2023-10-09T08:17:37.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.257+0000 7efd3cd9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd3815f4b0 con 0x7efd380ccc00 2023-10-09T08:17:37.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.257+0000 7efd377fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd3806a020 0x7efd381546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:37.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.257+0000 7efd377fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd3806a020 0x7efd381546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49650/0 (socket says 172.21.15.71:49650) 2023-10-09T08:17:37.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.257+0000 7efd377fe700 1 -- 172.21.15.71:0/365219955 learned_addr learned my addr 172.21.15.71:0/365219955 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:37.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.257+0000 7efd37fff700 1 --2- 172.21.15.71:0/365219955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd38159a60 0x7efd3815e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:37.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.257+0000 7efd36ffd700 1 --2- 172.21.15.71:0/365219955 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd380ccc00 0x7efd3815db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:37.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.257+0000 7efd377fe700 1 -- 172.21.15.71:0/365219955 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd380ccc00 msgr2=0x7efd3815db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:37.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.257+0000 7efd377fe700 1 --2- 172.21.15.71:0/365219955 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd380ccc00 0x7efd3815db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.257+0000 7efd377fe700 1 -- 172.21.15.71:0/365219955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd38159a60 msgr2=0x7efd3815e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:37.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.257+0000 7efd377fe700 1 --2- 172.21.15.71:0/365219955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd38159a60 0x7efd3815e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.257+0000 7efd377fe700 1 -- 172.21.15.71:0/365219955 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd30009ae0 con 0x7efd3806a020 2023-10-09T08:17:37.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.257+0000 7efd37fff700 1 --2- 172.21.15.71:0/365219955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd38159a60 0x7efd3815e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:37.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.258+0000 7efd377fe700 1 --2- 172.21.15.71:0/365219955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd3806a020 0x7efd381546a0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7efd2800c590 tx=0x7efd28007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:37.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.258+0000 7efd1f7fe700 1 -- 172.21.15.71:0/365219955 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd28005a70 con 0x7efd3806a020 2023-10-09T08:17:37.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.258+0000 7efd1f7fe700 1 -- 172.21.15.71:0/365219955 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd28005bf0 con 0x7efd3806a020 2023-10-09T08:17:37.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.258+0000 7efd3cd9d700 1 -- 172.21.15.71:0/365219955 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd2c009420 con 0x7efd3806a020 2023-10-09T08:17:37.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.258+0000 7efd1f7fe700 1 -- 172.21.15.71:0/365219955 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd280070d0 con 0x7efd3806a020 2023-10-09T08:17:37.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.258+0000 7efd3cd9d700 1 -- 172.21.15.71:0/365219955 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd38153bc0 con 0x7efd3806a020 2023-10-09T08:17:37.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.259+0000 7efd3cd9d700 1 -- 172.21.15.71:0/365219955 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd381544f0 con 0x7efd3806a020 2023-10-09T08:17:37.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.261+0000 7efd1f7fe700 1 -- 172.21.15.71:0/365219955 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 102) v1 ==== 84757+0+0 (secure 0 0 0) 0x7efd28007480 con 0x7efd3806a020 2023-10-09T08:17:37.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.261+0000 7efd1f7fe700 1 --2- 172.21.15.71:0/365219955 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7efd24066f80 0x7efd24069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:37.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.262+0000 7efd1f7fe700 1 -- 172.21.15.71:0/365219955 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6225+0+0 (secure 0 0 0) 0x7efd28083bd0 con 0x7efd3806a020 2023-10-09T08:17:37.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.262+0000 7efd36ffd700 1 -- 172.21.15.71:0/365219955 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7efd24066f80 msgr2=0x7efd24069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:37.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.262+0000 7efd36ffd700 1 --2- 172.21.15.71:0/365219955 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7efd24066f80 0x7efd24069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:37.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.266+0000 7efd1f7fe700 1 -- 172.21.15.71:0/365219955 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd28050c30 con 0x7efd3806a020 2023-10-09T08:17:37.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.463+0000 7efd36ffd700 1 -- 172.21.15.71:0/365219955 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7efd24066f80 msgr2=0x7efd24069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:37.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.463+0000 7efd36ffd700 1 --2- 172.21.15.71:0/365219955 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7efd24066f80 0x7efd24069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:37.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.466+0000 7efd3cd9d700 1 -- 172.21.15.71:0/365219955 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7efd380caa30 con 0x7efd3806a020 2023-10-09T08:17:37.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.470+0000 7efd1f7fe700 1 -- 172.21.15.71:0/365219955 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v71)=0 v71) v1 ==== 138+0+0 (secure 0 0 0) 0x7efd28017070 con 0x7efd3806a020 2023-10-09T08:17:37.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.473+0000 7efd3cd9d700 1 -- 172.21.15.71:0/365219955 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7efd24066f80 msgr2=0x7efd24069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:37.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.473+0000 7efd3cd9d700 1 --2- 172.21.15.71:0/365219955 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7efd24066f80 0x7efd24069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.473+0000 7efd3cd9d700 1 -- 172.21.15.71:0/365219955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd3806a020 msgr2=0x7efd381546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:37.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.473+0000 7efd3cd9d700 1 --2- 172.21.15.71:0/365219955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd3806a020 0x7efd381546a0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7efd2800c590 tx=0x7efd28007e00 comp rx=0 tx=0).stop 2023-10-09T08:17:37.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.473+0000 7efd3cd9d700 1 -- 172.21.15.71:0/365219955 shutdown_connections 2023-10-09T08:17:37.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.473+0000 7efd3cd9d700 1 --2- 172.21.15.71:0/365219955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd38159a60 0x7efd3815e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.473+0000 7efd3cd9d700 1 --2- 172.21.15.71:0/365219955 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7efd24066f80 0x7efd24069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.473+0000 7efd3cd9d700 1 --2- 172.21.15.71:0/365219955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd3806a020 0x7efd381546a0 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.473+0000 7efd3cd9d700 1 --2- 172.21.15.71:0/365219955 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd380ccc00 0x7efd3815db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.473+0000 7efd3cd9d700 1 -- 172.21.15.71:0/365219955 >> 172.21.15.71:0/365219955 conn(0x7efd3806baa0 msgr2=0x7efd38156430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:37.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.473+0000 7efd3cd9d700 1 -- 172.21.15.71:0/365219955 shutdown_connections 2023-10-09T08:17:37.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.473+0000 7efd3cd9d700 1 -- 172.21.15.71:0/365219955 wait complete. 2023-10-09T08:17:37.492 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-09T08:17:37.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.679+0000 7fdbc9f9d700 1 Processor -- start 2023-10-09T08:17:37.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.679+0000 7fdbc9f9d700 1 -- start start 2023-10-09T08:17:37.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.680+0000 7fdbc9f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdbc40aef00 0x7fdbc415d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:37.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.680+0000 7fdbc9f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbc406e470 0x7fdbc406e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:37.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.680+0000 7fdbc9f9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc40aea70 con 0x7fdbc415a3b0 2023-10-09T08:17:37.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.680+0000 7fdbc9f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc406ee30 con 0x7fdbc40aef00 2023-10-09T08:17:37.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.680+0000 7fdbc9f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40ae480 con 0x7fdbc406e470 2023-10-09T08:17:37.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.681+0000 7fdbc8f9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fdbc415a3b0 0x7fdbc415a780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60190/0 (socket says 172.21.15.71:60190) 2023-10-09T08:17:37.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.681+0000 7fdbc8f9b700 1 -- 172.21.15.71:0/1041725735 learned_addr learned my addr 172.21.15.71:0/1041725735 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:37.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.681+0000 7fdbc979c700 1 --2- 172.21.15.71:0/1041725735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbc406e470 0x7fdbc406e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:37.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.681+0000 7fdbc3fff700 1 --2- 172.21.15.71:0/1041725735 >> v2:172.21.15.179:3300/0 conn(0x7fdbc40aef00 0x7fdbc415d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:37.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.681+0000 7fdbc37fe700 1 -- 172.21.15.71:0/1041725735 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 930395867 0 0) 0x7fdbc40aea70 con 0x7fdbc415a3b0 2023-10-09T08:17:37.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.681+0000 7fdbc37fe700 1 -- 172.21.15.71:0/1041725735 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbb4003570 con 0x7fdbc415a3b0 2023-10-09T08:17:37.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.681+0000 7fdbc979c700 1 -- 172.21.15.71:0/1041725735 >> v2:172.21.15.179:3300/0 conn(0x7fdbc40aef00 msgr2=0x7fdbc415d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:37.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.681+0000 7fdbc979c700 1 --2- 172.21.15.71:0/1041725735 >> v2:172.21.15.179:3300/0 conn(0x7fdbc40aef00 0x7fdbc415d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.681+0000 7fdbc979c700 1 -- 172.21.15.71:0/1041725735 >> v1:172.21.15.71:6789/0 conn(0x7fdbc415a3b0 legacy=0x7fdbc415a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:37.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.681+0000 7fdbc979c700 1 -- 172.21.15.71:0/1041725735 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc415dd30 con 0x7fdbc406e470 2023-10-09T08:17:37.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.682+0000 7fdbc979c700 1 --2- 172.21.15.71:0/1041725735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbc406e470 0x7fdbc406e8f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc009e60 tx=0x7fdbbc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccab8b3d71da1ab5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:37.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.682+0000 7fdbc37fe700 1 -- 172.21.15.71:0/1041725735 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc00e070 con 0x7fdbc406e470 2023-10-09T08:17:37.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.682+0000 7fdbc37fe700 1 -- 172.21.15.71:0/1041725735 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbbc00bab0 con 0x7fdbc406e470 2023-10-09T08:17:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.682+0000 7fdbc37fe700 1 -- 172.21.15.71:0/1041725735 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc00be70 con 0x7fdbc406e470 2023-10-09T08:17:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.682+0000 7fdbc9f9d700 1 -- 172.21.15.71:0/1041725735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbc406e470 msgr2=0x7fdbc406e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.682+0000 7fdbc9f9d700 1 --2- 172.21.15.71:0/1041725735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbc406e470 0x7fdbc406e8f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc009e60 tx=0x7fdbbc009780 comp rx=0 tx=0).stop 2023-10-09T08:17:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.682+0000 7fdbc9f9d700 1 -- 172.21.15.71:0/1041725735 shutdown_connections 2023-10-09T08:17:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.682+0000 7fdbc9f9d700 1 --2- 172.21.15.71:0/1041725735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbc406e470 0x7fdbc406e8f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.682+0000 7fdbc9f9d700 1 --2- 172.21.15.71:0/1041725735 >> v2:172.21.15.179:3300/0 conn(0x7fdbc40aef00 0x7fdbc415d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.682+0000 7fdbc9f9d700 1 -- 172.21.15.71:0/1041725735 >> 172.21.15.71:0/1041725735 conn(0x7fdbc40c9f70 msgr2=0x7fdbc406dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.683+0000 7fdbc9f9d700 1 -- 172.21.15.71:0/1041725735 shutdown_connections 2023-10-09T08:17:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.683+0000 7fdbc9f9d700 1 -- 172.21.15.71:0/1041725735 wait complete. 2023-10-09T08:17:37.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.684+0000 7fdbc9f9d700 1 Processor -- start 2023-10-09T08:17:37.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.684+0000 7fdbc9f9d700 1 -- start start 2023-10-09T08:17:37.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.685+0000 7fdbc9f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbc406e470 0x7fdbc413f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:37.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.685+0000 7fdbc9f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbc40aef00 0x7fdbc40b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:37.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.685+0000 7fdbc9f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbc415a3b0 0x7fdbc415f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:37.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.685+0000 7fdbc9f9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40c3ae0 con 0x7fdbc415a3b0 2023-10-09T08:17:37.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.685+0000 7fdbc9f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40b1400 con 0x7fdbc40aef00 2023-10-09T08:17:37.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.685+0000 7fdbc9f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40b16e0 con 0x7fdbc406e470 2023-10-09T08:17:37.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.685+0000 7fdbc979c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbc415a3b0 0x7fdbc415f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:37.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.685+0000 7fdbc8f9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbc406e470 0x7fdbc413f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:37.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.685+0000 7fdbc979c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbc415a3b0 0x7fdbc415f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49660/0 (socket says 172.21.15.71:49660) 2023-10-09T08:17:37.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.685+0000 7fdbc979c700 1 -- 172.21.15.71:0/2838703355 learned_addr learned my addr 172.21.15.71:0/2838703355 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:37.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.685+0000 7fdbc3fff700 1 --2- 172.21.15.71:0/2838703355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbc40aef00 0x7fdbc40b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.686+0000 7fdbc8f9b700 1 -- 172.21.15.71:0/2838703355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbc40aef00 msgr2=0x7fdbc40b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.686+0000 7fdbc8f9b700 1 --2- 172.21.15.71:0/2838703355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbc40aef00 0x7fdbc40b0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.686+0000 7fdbc8f9b700 1 -- 172.21.15.71:0/2838703355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbc415a3b0 msgr2=0x7fdbc415f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.686+0000 7fdbc8f9b700 1 --2- 172.21.15.71:0/2838703355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbc415a3b0 0x7fdbc415f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.686+0000 7fdbc8f9b700 1 -- 172.21.15.71:0/2838703355 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc009a20 con 0x7fdbc406e470 2023-10-09T08:17:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.686+0000 7fdbc979c700 1 --2- 172.21.15.71:0/2838703355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbc415a3b0 0x7fdbc415f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.686+0000 7fdbc8f9b700 1 --2- 172.21.15.71:0/2838703355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbc406e470 0x7fdbc413f3f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800c560 tx=0x7fdbb8007d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.686+0000 7fdbc0ff9700 1 -- 172.21.15.71:0/2838703355 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8005b30 con 0x7fdbc406e470 2023-10-09T08:17:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.686+0000 7fdbc0ff9700 1 -- 172.21.15.71:0/2838703355 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb8005cb0 con 0x7fdbc406e470 2023-10-09T08:17:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.686+0000 7fdbc0ff9700 1 -- 172.21.15.71:0/2838703355 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8007320 con 0x7fdbc406e470 2023-10-09T08:17:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.686+0000 7fdbc9f9d700 1 -- 172.21.15.71:0/2838703355 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc40b19c0 con 0x7fdbc406e470 2023-10-09T08:17:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.686+0000 7fdbc9f9d700 1 -- 172.21.15.71:0/2838703355 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc413f930 con 0x7fdbc406e470 2023-10-09T08:17:37.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.687+0000 7fdbc9f9d700 1 -- 172.21.15.71:0/2838703355 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc40c3c20 con 0x7fdbc406e470 2023-10-09T08:17:37.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.688+0000 7fdbc0ff9700 1 -- 172.21.15.71:0/2838703355 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 102) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fdbb801b3b0 con 0x7fdbc406e470 2023-10-09T08:17:37.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.689+0000 7fdbc0ff9700 1 --2- 172.21.15.71:0/2838703355 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdba8066f80 0x7fdba8069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:37.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.689+0000 7fdbc0ff9700 1 -- 172.21.15.71:0/2838703355 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6225+0+0 (secure 0 0 0) 0x7fdbb8083b80 con 0x7fdbc406e470 2023-10-09T08:17:37.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.689+0000 7fdbc3fff700 1 -- 172.21.15.71:0/2838703355 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdba8066f80 msgr2=0x7fdba8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:37.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.689+0000 7fdbc3fff700 1 --2- 172.21.15.71:0/2838703355 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdba8066f80 0x7fdba8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.698+0000 7fdbc0ff9700 1 -- 172.21.15.71:0/2838703355 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdbb8050b40 con 0x7fdbc406e470 2023-10-09T08:17:37.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.890+0000 7fdbc3fff700 1 -- 172.21.15.71:0/2838703355 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdba8066f80 msgr2=0x7fdba8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:37.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.890+0000 7fdbc3fff700 1 --2- 172.21.15.71:0/2838703355 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdba8066f80 0x7fdba8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:37.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.900+0000 7fdbc9f9d700 1 -- 172.21.15.71:0/2838703355 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fdbc40b1e60 con 0x7fdbc406e470 2023-10-09T08:17:37.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.909+0000 7fdbc0ff9700 1 -- 172.21.15.71:0/2838703355 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v72)=0 v72) v1 ==== 133+0+0 (secure 0 0 0) 0x7fdbb8083e60 con 0x7fdbc406e470 2023-10-09T08:17:37.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.911+0000 7fdbc9f9d700 1 -- 172.21.15.71:0/2838703355 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdba8066f80 msgr2=0x7fdba8069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:37.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.911+0000 7fdbc9f9d700 1 --2- 172.21.15.71:0/2838703355 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdba8066f80 0x7fdba8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.911+0000 7fdbc9f9d700 1 -- 172.21.15.71:0/2838703355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbc406e470 msgr2=0x7fdbc413f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:37.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.911+0000 7fdbc9f9d700 1 --2- 172.21.15.71:0/2838703355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbc406e470 0x7fdbc413f3f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800c560 tx=0x7fdbb8007d50 comp rx=0 tx=0).stop 2023-10-09T08:17:37.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.911+0000 7fdbc9f9d700 1 -- 172.21.15.71:0/2838703355 shutdown_connections 2023-10-09T08:17:37.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.911+0000 7fdbc9f9d700 1 --2- 172.21.15.71:0/2838703355 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdba8066f80 0x7fdba8069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.911+0000 7fdbc9f9d700 1 --2- 172.21.15.71:0/2838703355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbc415a3b0 0x7fdbc415f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.911+0000 7fdbc9f9d700 1 --2- 172.21.15.71:0/2838703355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbc406e470 0x7fdbc413f3f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.911+0000 7fdbc9f9d700 1 --2- 172.21.15.71:0/2838703355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbc40aef00 0x7fdbc40b0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:37.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.911+0000 7fdbc9f9d700 1 -- 172.21.15.71:0/2838703355 >> 172.21.15.71:0/2838703355 conn(0x7fdbc40c9f70 msgr2=0x7fdbc40c8650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:37.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.911+0000 7fdbc9f9d700 1 -- 172.21.15.71:0/2838703355 shutdown_connections 2023-10-09T08:17:37.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:37.911+0000 7fdbc9f9d700 1 -- 172.21.15.71:0/2838703355 wait complete. 2023-10-09T08:17:37.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:17:37.931 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-09T08:17:37.972 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-10-09T08:17:38.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.201+0000 7f596cd9d700 1 Processor -- start 2023-10-09T08:17:38.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.202+0000 7f596cd9d700 1 -- start start 2023-10-09T08:17:38.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.203+0000 7f596cd9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f59680ccb40 0x7f59680697b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:38.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.203+0000 7f596cd9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5968159db0 con 0x7f5968069cf0 2023-10-09T08:17:38.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.203+0000 7f596cd9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f596806a470 con 0x7f59680cb560 2023-10-09T08:17:38.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.203+0000 7f596cd9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f596806aa30 con 0x7f59680ccb40 2023-10-09T08:17:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.203+0000 7f5966ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f59680ccb40 0x7f59680697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.203+0000 7f5966ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f59680ccb40 0x7f59680697b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49670/0 (socket says 172.21.15.71:49670) 2023-10-09T08:17:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.203+0000 7f5967fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f5968069cf0 0x7f596815ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60198/0 (socket says 172.21.15.71:60198) 2023-10-09T08:17:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.203+0000 7f5966ffd700 1 -- 172.21.15.71:0/2733635255 learned_addr learned my addr 172.21.15.71:0/2733635255 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:38.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.204+0000 7f5966ffd700 1 -- 172.21.15.71:0/2733635255 >> v1:172.21.15.179:6789/0 conn(0x7f59680cb560 legacy=0x7f59680cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:38.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.204+0000 7f5966ffd700 1 -- 172.21.15.71:0/2733635255 >> v1:172.21.15.71:6789/0 conn(0x7f5968069cf0 legacy=0x7f596815ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:38.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.204+0000 7f5966ffd700 1 -- 172.21.15.71:0/2733635255 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596806a750 con 0x7f59680ccb40 2023-10-09T08:17:38.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.204+0000 7f59667fc700 1 -- 172.21.15.71:0/2733635255 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416056157 0 0) 0x7f596806a470 con 0x7f59680cb560 2023-10-09T08:17:38.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.204+0000 7f5966ffd700 1 --2- 172.21.15.71:0/2733635255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59680ccb40 0x7f59680697b0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f595c0099e0 tx=0x7f595c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=532dc2f5f5ff9907 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:38.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.204+0000 7f59667fc700 1 -- 172.21.15.71:0/2733635255 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c00b760 con 0x7f59680ccb40 2023-10-09T08:17:38.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.204+0000 7f59667fc700 1 -- 172.21.15.71:0/2733635255 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595c00b8c0 con 0x7f59680ccb40 2023-10-09T08:17:38.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.204+0000 7f59667fc700 1 -- 172.21.15.71:0/2733635255 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c00bc80 con 0x7f59680ccb40 2023-10-09T08:17:38.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.205+0000 7f596cd9d700 1 -- 172.21.15.71:0/2733635255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59680ccb40 msgr2=0x7f59680697b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:38.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.205+0000 7f596cd9d700 1 --2- 172.21.15.71:0/2733635255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59680ccb40 0x7f59680697b0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f595c0099e0 tx=0x7f595c009250 comp rx=0 tx=0).stop 2023-10-09T08:17:38.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.205+0000 7f596cd9d700 1 -- 172.21.15.71:0/2733635255 shutdown_connections 2023-10-09T08:17:38.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.205+0000 7f596cd9d700 1 --2- 172.21.15.71:0/2733635255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59680ccb40 0x7f59680697b0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:38.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.205+0000 7f596cd9d700 1 -- 172.21.15.71:0/2733635255 >> 172.21.15.71:0/2733635255 conn(0x7f596806baf0 msgr2=0x7f596806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:38.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.205+0000 7f596cd9d700 1 -- 172.21.15.71:0/2733635255 shutdown_connections 2023-10-09T08:17:38.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.205+0000 7f596cd9d700 1 -- 172.21.15.71:0/2733635255 wait complete. 2023-10-09T08:17:38.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.206+0000 7f596cd9d700 1 Processor -- start 2023-10-09T08:17:38.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.207+0000 7f596cd9d700 1 -- start start 2023-10-09T08:17:38.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.207+0000 7f596cd9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5968069cf0 0x7f5968150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:38.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.207+0000 7f596cd9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59680cb560 0x7f59680c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:38.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.207+0000 7f596cd9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59680ccb40 0x7f59680c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:38.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.208+0000 7f596cd9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59680c86d0 con 0x7f59680ccb40 2023-10-09T08:17:38.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.208+0000 7f596cd9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5968154040 con 0x7f5968069cf0 2023-10-09T08:17:38.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.208+0000 7f596cd9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59680c7ac0 con 0x7f59680cb560 2023-10-09T08:17:38.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.208+0000 7f5967fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59680ccb40 0x7f59680c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:38.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.208+0000 7f5967fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59680ccb40 0x7f59680c7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49684/0 (socket says 172.21.15.71:49684) 2023-10-09T08:17:38.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.208+0000 7f5967fff700 1 -- 172.21.15.71:0/609664129 learned_addr learned my addr 172.21.15.71:0/609664129 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:38.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.208+0000 7f59677fe700 1 --2- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5968069cf0 0x7f5968150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:38.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.208+0000 7f5966ffd700 1 --2- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59680cb560 0x7f59680c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:38.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.208+0000 7f5967fff700 1 -- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59680cb560 msgr2=0x7f59680c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:38.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.208+0000 7f5967fff700 1 --2- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59680cb560 0x7f59680c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:38.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.208+0000 7f5967fff700 1 -- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5968069cf0 msgr2=0x7f5968150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:38.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.208+0000 7f5967fff700 1 --2- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5968069cf0 0x7f5968150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:38.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.208+0000 7f5967fff700 1 -- 172.21.15.71:0/609664129 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c0094f0 con 0x7f59680ccb40 2023-10-09T08:17:38.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.208+0000 7f5967fff700 1 --2- 172.21.15.71:0/609664129 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59680ccb40 0x7f59680c7490 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f596000cca0 tx=0x7f5960001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:38.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.209+0000 7f594f7fe700 1 -- 172.21.15.71:0/609664129 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5960005df0 con 0x7f59680ccb40 2023-10-09T08:17:38.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.209+0000 7f594f7fe700 1 -- 172.21.15.71:0/609664129 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596000a700 con 0x7f59680ccb40 2023-10-09T08:17:38.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.209+0000 7f596cd9d700 1 -- 172.21.15.71:0/609664129 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59680c7da0 con 0x7f59680ccb40 2023-10-09T08:17:38.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.209+0000 7f594f7fe700 1 -- 172.21.15.71:0/609664129 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596000aac0 con 0x7f59680ccb40 2023-10-09T08:17:38.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.209+0000 7f596cd9d700 1 -- 172.21.15.71:0/609664129 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59680c8360 con 0x7f59680ccb40 2023-10-09T08:17:38.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.210+0000 7f596cd9d700 1 -- 172.21.15.71:0/609664129 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596804c3c0 con 0x7f59680ccb40 2023-10-09T08:17:38.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.211+0000 7f594f7fe700 1 -- 172.21.15.71:0/609664129 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 102) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f59600070f0 con 0x7f59680ccb40 2023-10-09T08:17:38.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.212+0000 7f594f7fe700 1 --2- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5954066f80 0x7f5954069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:38.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.212+0000 7f594f7fe700 1 -- 172.21.15.71:0/609664129 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f5960084900 con 0x7f59680ccb40 2023-10-09T08:17:38.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.212+0000 7f59677fe700 1 -- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5954066f80 msgr2=0x7f5954069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:38.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.212+0000 7f59677fe700 1 --2- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5954066f80 0x7f5954069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:38.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.215+0000 7f594f7fe700 1 -- 172.21.15.71:0/609664129 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5960051940 con 0x7f59680ccb40 2023-10-09T08:17:38.315 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:38.315+0000 7f458b929180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T08:17:38.383 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:38.382+0000 7f0c7e032180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T08:17:38.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.413+0000 7f59677fe700 1 -- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5954066f80 msgr2=0x7f5954069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:38.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.413+0000 7f59677fe700 1 --2- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5954066f80 0x7f5954069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:38.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.460+0000 7f596cd9d700 1 -- 172.21.15.71:0/609664129 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f59680c8810 con 0x7f5954066f80 2023-10-09T08:17:38.478 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:38.478+0000 7f458b929180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T08:17:38.550 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:38.549+0000 7f0c7e032180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T08:17:38.563 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:38.563+0000 7f458b929180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T08:17:38.634 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:38.633+0000 7f0c7e032180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T08:17:38.787 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:38.787+0000 7f458b929180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T08:17:38.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.814+0000 7f59677fe700 1 -- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5954066f80 msgr2=0x7f5954069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:38.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:38.814+0000 7f59677fe700 1 --2- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5954066f80 0x7f5954069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T08:17:38.858 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:38.856+0000 7f0c7e032180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T08:17:38.964 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:38.964+0000 7f458b929180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T08:17:39.038 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:39.037+0000 7f0c7e032180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T08:17:39.062 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:39.060+0000 7f458b929180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T08:17:39.129 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:39.128+0000 7f0c7e032180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T08:17:39.223 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:39.222+0000 7f458b929180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T08:17:39.291 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:39.290+0000 7f0c7e032180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T08:17:39.323 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:39.323+0000 7f458b929180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T08:17:39.391 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:39.390+0000 7f0c7e032180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T08:17:39.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:39.615+0000 7f59677fe700 1 -- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5954066f80 msgr2=0x7f5954069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:39.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:39.615+0000 7f59677fe700 1 --2- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5954066f80 0x7f5954069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T08:17:39.809 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:39.808+0000 7f458b929180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T08:17:39.873 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:39.872+0000 7f0c7e032180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T08:17:39.903 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:39.903+0000 7f458b929180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T08:17:39.968 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:39.967+0000 7f0c7e032180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T08:17:39.995 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:39.994+0000 7f458b929180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T08:17:40.059 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:40.058+0000 7f0c7e032180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T08:17:40.615 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:40.615+0000 7f458b929180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T08:17:40.678 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:40.677+0000 7f0c7e032180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T08:17:40.790 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:40.789+0000 7f458b929180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T08:17:40.852 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:40.851+0000 7f0c7e032180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T08:17:40.886 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:40.886+0000 7f458b929180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T08:17:40.947 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:40.946+0000 7f0c7e032180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T08:17:41.179 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:41.179+0000 7f458b929180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T08:17:41.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:41.217+0000 7f59677fe700 1 -- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5954066f80 msgr2=0x7f5954069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:41.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:41.217+0000 7f59677fe700 1 --2- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5954066f80 0x7f5954069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-09T08:17:41.241 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:41.240+0000 7f0c7e032180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T08:17:41.276 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:41.276+0000 7f458b929180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T08:17:41.336 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:41.335+0000 7f0c7e032180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T08:17:41.980 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:41.980+0000 7f458b929180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T08:17:42.041 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:42.040+0000 7f0c7e032180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T08:17:42.266 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:42.266+0000 7f458b929180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T08:17:42.326 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:42.325+0000 7f0c7e032180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T08:17:42.358 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:42.358+0000 7f458b929180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T08:17:42.419 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:42.418+0000 7f0c7e032180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T08:17:42.512 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:42.512+0000 7f458b929180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T08:17:42.574 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:42.573+0000 7f0c7e032180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T08:17:42.618 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:42.617+0000 7f458b929180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T08:17:42.679 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:42.678+0000 7f0c7e032180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T08:17:42.808 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:42.808+0000 7f458b929180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T08:17:42.867 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:42.866+0000 7f0c7e032180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T08:17:42.901 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:42.901+0000 7f458b929180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T08:17:42.959 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:42.958+0000 7f0c7e032180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T08:17:42.996 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:42.996+0000 7f458b929180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T08:17:43.051 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:43.050+0000 7f0c7e032180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T08:17:43.091 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:43.091+0000 7f458b929180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T08:17:43.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:43.104+0000 7f594f7fe700 1 -- 172.21.15.71:0/609664129 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 103) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f5960051d10 con 0x7f59680ccb40 2023-10-09T08:17:43.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:43.104+0000 7f594f7fe700 1 -- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5954066f80 msgr2=0x7f5954069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:43.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:43.104+0000 7f594f7fe700 1 --2- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5954066f80 0x7f5954069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:43.152 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:43.152+0000 7f0c7e032180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T08:17:43.224 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:43.224+0000 7f4500c77700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:43.225 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:43.224+0000 7f4500c77700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:43.225 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:43.224+0000 7f4500c77700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:43.225 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:43.224+0000 7f4500c77700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:43.225 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:43.224+0000 7f4500c77700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:43.225 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:43.224+0000 7f44fd470700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:43.225 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:43.224+0000 7f44fd470700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:43.225 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:43.224+0000 7f44fd470700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:43.225 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:43.224+0000 7f44fd470700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:43.225 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:43.224+0000 7f44fd470700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:44.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.108+0000 7f594f7fe700 1 -- 172.21.15.71:0/609664129 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mgrmap(e 104) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f5960054af0 con 0x7f59680ccb40 2023-10-09T08:17:44.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.109+0000 7f594f7fe700 1 --2- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5954066f80 0x7f59540693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:44.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.109+0000 7f594f7fe700 1 -- 172.21.15.71:0/609664129 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f59680c8810 con 0x7f5954066f80 2023-10-09T08:17:44.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.114+0000 7f59677fe700 1 --2- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5954066f80 0x7f59540693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:44.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.118+0000 7f59677fe700 1 --2- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5954066f80 0x7f59540693b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5958001120 tx=0x7f5958007dc0 comp rx=0 tx=0).ready entity=mgr.9799 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:44.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.186+0000 7f594f7fe700 1 -- 172.21.15.71:0/609664129 <== mgr.9799 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f59680c8810 con 0x7f5954066f80 2023-10-09T08:17:44.187 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule set for path snap_test_dir1 2023-10-09T08:17:44.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.188+0000 7f596cd9d700 1 -- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5954066f80 msgr2=0x7f59540693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:44.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.188+0000 7f596cd9d700 1 --2- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5954066f80 0x7f59540693b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5958001120 tx=0x7f5958007dc0 comp rx=0 tx=0).stop 2023-10-09T08:17:44.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.188+0000 7f596cd9d700 1 -- 172.21.15.71:0/609664129 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59680ccb40 msgr2=0x7f59680c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:44.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.188+0000 7f596cd9d700 1 --2- 172.21.15.71:0/609664129 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59680ccb40 0x7f59680c7490 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f596000cca0 tx=0x7f5960001a60 comp rx=0 tx=0).stop 2023-10-09T08:17:44.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.188+0000 7f596cd9d700 1 -- 172.21.15.71:0/609664129 shutdown_connections 2023-10-09T08:17:44.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.188+0000 7f596cd9d700 1 --2- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5954066f80 0x7f59540693b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:44.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.188+0000 7f596cd9d700 1 --2- 172.21.15.71:0/609664129 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59680ccb40 0x7f59680c7490 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:44.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.188+0000 7f596cd9d700 1 --2- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5968069cf0 0x7f5968150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:44.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.188+0000 7f596cd9d700 1 --2- 172.21.15.71:0/609664129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59680cb560 0x7f59680c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:44.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.188+0000 7f596cd9d700 1 -- 172.21.15.71:0/609664129 >> 172.21.15.71:0/609664129 conn(0x7f596806baf0 msgr2=0x7f59680ca2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:44.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.188+0000 7f596cd9d700 1 -- 172.21.15.71:0/609664129 shutdown_connections 2023-10-09T08:17:44.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.189+0000 7f596cd9d700 1 -- 172.21.15.71:0/609664129 wait complete. 2023-10-09T08:17:44.208 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-09T08:17:44.209 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-10-09T08:17:44.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.395+0000 7f20b65ff700 1 Processor -- start 2023-10-09T08:17:44.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.396+0000 7f20b65ff700 1 -- start start 2023-10-09T08:17:44.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.397+0000 7f20b65ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f20b0156620 0x7f20b00c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:44.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.397+0000 7f20b65ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b015a6f0 con 0x7f20b01569f0 2023-10-09T08:17:44.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.397+0000 7f20b65ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b015a9d0 con 0x7f20b0068390 2023-10-09T08:17:44.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.397+0000 7f20b65ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b00c8d30 con 0x7f20b0156620 2023-10-09T08:17:44.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.397+0000 7f20af7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f20b01569f0 0x7f20b00ace70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60210/0 (socket says 172.21.15.71:60210) 2023-10-09T08:17:44.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.397+0000 7f20af7fe700 1 -- 172.21.15.71:0/334457632 learned_addr learned my addr 172.21.15.71:0/334457632 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:44.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.397+0000 7f20affff700 1 --2- 172.21.15.71:0/334457632 >> v2:172.21.15.179:3300/0 conn(0x7f20b0156620 0x7f20b00c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:44.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.397+0000 7f20aeffd700 1 -- 172.21.15.71:0/334457632 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 999636772 0 0) 0x7f20b015a6f0 con 0x7f20b01569f0 2023-10-09T08:17:44.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.397+0000 7f20aeffd700 1 -- 172.21.15.71:0/334457632 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2098003570 con 0x7f20b01569f0 2023-10-09T08:17:44.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.398+0000 7f20aeffd700 1 -- 172.21.15.71:0/334457632 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3710407728 0 0) 0x7f2098003570 con 0x7f20b01569f0 2023-10-09T08:17:44.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.398+0000 7f20affff700 1 -- 172.21.15.71:0/334457632 >> v1:172.21.15.179:6789/0 conn(0x7f20b0068390 legacy=0x7f20b006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:44.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.398+0000 7f20affff700 1 -- 172.21.15.71:0/334457632 >> v1:172.21.15.71:6789/0 conn(0x7f20b01569f0 legacy=0x7f20b00ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:44.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.398+0000 7f20affff700 1 -- 172.21.15.71:0/334457632 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b015acb0 con 0x7f20b0156620 2023-10-09T08:17:44.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.398+0000 7f20affff700 1 --2- 172.21.15.71:0/334457632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20b0156620 0x7f20b00c87f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f20a00098e0 tx=0x7f20a00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94ec0607d354898 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:44.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.398+0000 7f20aeffd700 1 -- 172.21.15.71:0/334457632 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a4001470 con 0x7f20b0156620 2023-10-09T08:17:44.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.398+0000 7f20aeffd700 1 -- 172.21.15.71:0/334457632 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a0011420 con 0x7f20b0156620 2023-10-09T08:17:44.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.398+0000 7f20aeffd700 1 -- 172.21.15.71:0/334457632 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a00117c0 con 0x7f20b0156620 2023-10-09T08:17:44.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.399+0000 7f20b65ff700 1 -- 172.21.15.71:0/334457632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20b0156620 msgr2=0x7f20b00c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:44.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.399+0000 7f20b65ff700 1 --2- 172.21.15.71:0/334457632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20b0156620 0x7f20b00c87f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f20a00098e0 tx=0x7f20a00091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:44.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.399+0000 7f20b65ff700 1 -- 172.21.15.71:0/334457632 shutdown_connections 2023-10-09T08:17:44.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.399+0000 7f20b65ff700 1 --2- 172.21.15.71:0/334457632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20b0156620 0x7f20b00c87f0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:44.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.399+0000 7f20b65ff700 1 -- 172.21.15.71:0/334457632 >> 172.21.15.71:0/334457632 conn(0x7f20b00cc540 msgr2=0x7f20b00cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:44.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.399+0000 7f20b65ff700 1 -- 172.21.15.71:0/334457632 shutdown_connections 2023-10-09T08:17:44.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.399+0000 7f20b65ff700 1 -- 172.21.15.71:0/334457632 wait complete. 2023-10-09T08:17:44.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.400+0000 7f20b65ff700 1 Processor -- start 2023-10-09T08:17:44.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.401+0000 7f20b65ff700 1 -- start start 2023-10-09T08:17:44.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.401+0000 7f20b65ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20b0068390 0x7f20b00c2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:44.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.401+0000 7f20b65ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20b0156620 0x7f20b0069970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:44.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.401+0000 7f20b65ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20b01569f0 0x7f20b0069eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:44.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.401+0000 7f20b65ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b0149a10 con 0x7f20b01569f0 2023-10-09T08:17:44.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.401+0000 7f20b65ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b00c2570 con 0x7f20b0156620 2023-10-09T08:17:44.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.401+0000 7f20b65ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b00c27a0 con 0x7f20b0068390 2023-10-09T08:17:44.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.402+0000 7f20b4b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20b01569f0 0x7f20b0069eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:44.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.402+0000 7f20b4b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20b01569f0 0x7f20b0069eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49700/0 (socket says 172.21.15.71:49700) 2023-10-09T08:17:44.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.402+0000 7f20b4b9c700 1 -- 172.21.15.71:0/4219974313 learned_addr learned my addr 172.21.15.71:0/4219974313 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:44.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.402+0000 7f20affff700 1 --2- 172.21.15.71:0/4219974313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20b0068390 0x7f20b00c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:44.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.402+0000 7f20af7fe700 1 --2- 172.21.15.71:0/4219974313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20b0156620 0x7f20b0069970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:44.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.402+0000 7f20b4b9c700 1 -- 172.21.15.71:0/4219974313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20b0068390 msgr2=0x7f20b00c2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:44.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.402+0000 7f20b4b9c700 1 --2- 172.21.15.71:0/4219974313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20b0068390 0x7f20b00c2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:44.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.402+0000 7f20b4b9c700 1 -- 172.21.15.71:0/4219974313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20b0156620 msgr2=0x7f20b0069970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:44.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.402+0000 7f20b4b9c700 1 --2- 172.21.15.71:0/4219974313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20b0156620 0x7f20b0069970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:44.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.402+0000 7f20b4b9c700 1 -- 172.21.15.71:0/4219974313 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a0009420 con 0x7f20b01569f0 2023-10-09T08:17:44.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.402+0000 7f20b4b9c700 1 --2- 172.21.15.71:0/4219974313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20b01569f0 0x7f20b0069eb0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f20a800c8e0 tx=0x7f20a80016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:44.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.403+0000 7f2097fff700 1 -- 172.21.15.71:0/4219974313 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a8012630 con 0x7f20b01569f0 2023-10-09T08:17:44.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.403+0000 7f2097fff700 1 -- 172.21.15.71:0/4219974313 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a8012790 con 0x7f20b01569f0 2023-10-09T08:17:44.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.403+0000 7f20b65ff700 1 -- 172.21.15.71:0/4219974313 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b00c2a80 con 0x7f20b01569f0 2023-10-09T08:17:44.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.403+0000 7f2097fff700 1 -- 172.21.15.71:0/4219974313 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a8012b50 con 0x7f20b01569f0 2023-10-09T08:17:44.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.403+0000 7f20b65ff700 1 -- 172.21.15.71:0/4219974313 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b00af390 con 0x7f20b01569f0 2023-10-09T08:17:44.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.404+0000 7f20b65ff700 1 -- 172.21.15.71:0/4219974313 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b00718b0 con 0x7f20b01569f0 2023-10-09T08:17:44.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.405+0000 7f2097fff700 1 -- 172.21.15.71:0/4219974313 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 104) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f20a800a3b0 con 0x7f20b01569f0 2023-10-09T08:17:44.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.405+0000 7f2097fff700 1 --2- 172.21.15.71:0/4219974313 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f209c066dd0 0x7f209c069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:44.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.406+0000 7f2097fff700 1 -- 172.21.15.71:0/4219974313 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f20a8084830 con 0x7f20b01569f0 2023-10-09T08:17:44.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.406+0000 7f20affff700 1 --2- 172.21.15.71:0/4219974313 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f209c066dd0 0x7f209c069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:44.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.406+0000 7f20affff700 1 --2- 172.21.15.71:0/4219974313 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f209c066dd0 0x7f209c069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f20a00030c0 tx=0x7f20a0017000 comp rx=0 tx=0).ready entity=mgr.9799 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:44.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.410+0000 7f2097fff700 1 -- 172.21.15.71:0/4219974313 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20a8051a30 con 0x7f20b01569f0 2023-10-09T08:17:44.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.626+0000 7f20b65ff700 1 -- 172.21.15.71:0/4219974313 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f20b00c7bc0 con 0x7f209c066dd0 2023-10-09T08:17:44.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.688+0000 7f2097fff700 1 -- 172.21.15.71:0/4219974313 <== mgr.9799 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7f20b00c7bc0 con 0x7f209c066dd0 2023-10-09T08:17:44.689 INFO:teuthology.orchestra.run.smithi071.stdout:Retention added to path snap_test_dir1 2023-10-09T08:17:44.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.690+0000 7f20b65ff700 1 -- 172.21.15.71:0/4219974313 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f209c066dd0 msgr2=0x7f209c069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:44.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.690+0000 7f20b65ff700 1 --2- 172.21.15.71:0/4219974313 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f209c066dd0 0x7f209c069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f20a00030c0 tx=0x7f20a0017000 comp rx=0 tx=0).stop 2023-10-09T08:17:44.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.690+0000 7f20b65ff700 1 -- 172.21.15.71:0/4219974313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20b01569f0 msgr2=0x7f20b0069eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:44.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.690+0000 7f20b65ff700 1 --2- 172.21.15.71:0/4219974313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20b01569f0 0x7f20b0069eb0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f20a800c8e0 tx=0x7f20a80016c0 comp rx=0 tx=0).stop 2023-10-09T08:17:44.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.691+0000 7f20b65ff700 1 -- 172.21.15.71:0/4219974313 shutdown_connections 2023-10-09T08:17:44.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.691+0000 7f20b65ff700 1 --2- 172.21.15.71:0/4219974313 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f209c066dd0 0x7f209c069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:44.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.691+0000 7f20b65ff700 1 --2- 172.21.15.71:0/4219974313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20b01569f0 0x7f20b0069eb0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:44.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.691+0000 7f20b65ff700 1 --2- 172.21.15.71:0/4219974313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20b0068390 0x7f20b00c2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:44.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.691+0000 7f20b65ff700 1 --2- 172.21.15.71:0/4219974313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20b0156620 0x7f20b0069970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:44.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.691+0000 7f20b65ff700 1 -- 172.21.15.71:0/4219974313 >> 172.21.15.71:0/4219974313 conn(0x7f20b00cc540 msgr2=0x7f20b006da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:44.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.691+0000 7f20b65ff700 1 -- 172.21.15.71:0/4219974313 shutdown_connections 2023-10-09T08:17:44.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:44.691+0000 7f20b65ff700 1 -- 172.21.15.71:0/4219974313 wait complete. 2023-10-09T08:17:44.709 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-10-09T08:17:44.936 INFO:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-09-08_18_00 in ~16s... 2023-10-09T08:17:44.936 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-10-09T08:17:44.937 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-10-09T08:17:45.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.123+0000 7fd6e119d700 1 Processor -- start 2023-10-09T08:17:45.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.123+0000 7fd6e119d700 1 -- start start 2023-10-09T08:17:45.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.124+0000 7fd6e119d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd6dc15b050 0x7fd6dc0ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:45.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.124+0000 7fd6e119d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6dc0cc8d0 0x7fd6dc15b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:45.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.124+0000 7fd6e119d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd6dc15b960 0x7fd6dc157f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:45.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.124+0000 7fd6e119d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6dc157a50 con 0x7fd6dc15b960 2023-10-09T08:17:45.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.124+0000 7fd6e119d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6dc1591b0 con 0x7fd6dc15b050 2023-10-09T08:17:45.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.124+0000 7fd6e119d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0ca9e0 con 0x7fd6dc0cc8d0 2023-10-09T08:17:45.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.124+0000 7fd6e099c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd6dc15b960 0x7fd6dc157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:45.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.124+0000 7fd6e099c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd6dc15b960 0x7fd6dc157f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36962/0 (socket says 172.21.15.71:36962) 2023-10-09T08:17:45.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.124+0000 7fd6e099c700 1 -- 172.21.15.71:0/3811968936 learned_addr learned my addr 172.21.15.71:0/3811968936 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:45.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.125+0000 7fd6e099c700 1 -- 172.21.15.71:0/3811968936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6dc0cc8d0 msgr2=0x7fd6dc15b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:45.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.125+0000 7fd6e099c700 1 --2- 172.21.15.71:0/3811968936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6dc0cc8d0 0x7fd6dc15b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:45.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.125+0000 7fd6e099c700 1 -- 172.21.15.71:0/3811968936 >> v2:172.21.15.179:3300/0 conn(0x7fd6dc15b050 msgr2=0x7fd6dc0ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:45.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.125+0000 7fd6e099c700 1 --2- 172.21.15.71:0/3811968936 >> v2:172.21.15.179:3300/0 conn(0x7fd6dc15b050 0x7fd6dc0ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:45.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.125+0000 7fd6e099c700 1 -- 172.21.15.71:0/3811968936 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc0cacc0 con 0x7fd6dc15b960 2023-10-09T08:17:45.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.125+0000 7fd6e099c700 1 --2- 172.21.15.71:0/3811968936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6dc15b960 0x7fd6dc157f00 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc064f60 tx=0x7fd6d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d38915724bb927c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:45.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.125+0000 7fd6daffd700 1 -- 172.21.15.71:0/3811968936 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d400e070 con 0x7fd6dc15b960 2023-10-09T08:17:45.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.125+0000 7fd6daffd700 1 -- 172.21.15.71:0/3811968936 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d400ba50 con 0x7fd6dc15b960 2023-10-09T08:17:45.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.125+0000 7fd6daffd700 1 -- 172.21.15.71:0/3811968936 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d40092e0 con 0x7fd6dc15b960 2023-10-09T08:17:45.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.126+0000 7fd6e119d700 1 -- 172.21.15.71:0/3811968936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6dc15b960 msgr2=0x7fd6dc157f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:45.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.126+0000 7fd6e119d700 1 --2- 172.21.15.71:0/3811968936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6dc15b960 0x7fd6dc157f00 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc064f60 tx=0x7fd6d4009840 comp rx=0 tx=0).stop 2023-10-09T08:17:45.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.126+0000 7fd6e119d700 1 -- 172.21.15.71:0/3811968936 shutdown_connections 2023-10-09T08:17:45.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.126+0000 7fd6e119d700 1 --2- 172.21.15.71:0/3811968936 >> v2:172.21.15.179:3300/0 conn(0x7fd6dc15b050 0x7fd6dc0ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:45.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.126+0000 7fd6e119d700 1 --2- 172.21.15.71:0/3811968936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6dc15b960 0x7fd6dc157f00 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:45.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.126+0000 7fd6e119d700 1 --2- 172.21.15.71:0/3811968936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6dc0cc8d0 0x7fd6dc15b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:45.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.126+0000 7fd6e119d700 1 -- 172.21.15.71:0/3811968936 >> 172.21.15.71:0/3811968936 conn(0x7fd6dc068e20 msgr2=0x7fd6dc0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:45.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.126+0000 7fd6e119d700 1 -- 172.21.15.71:0/3811968936 shutdown_connections 2023-10-09T08:17:45.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.126+0000 7fd6e119d700 1 -- 172.21.15.71:0/3811968936 wait complete. 2023-10-09T08:17:45.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.127+0000 7fd6e119d700 1 Processor -- start 2023-10-09T08:17:45.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.127+0000 7fd6e119d700 1 -- start start 2023-10-09T08:17:45.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.128+0000 7fd6e119d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6dc0cc8d0 0x7fd6dc16c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:45.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.128+0000 7fd6e119d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6dc15b050 0x7fd6dc0a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:45.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.128+0000 7fd6e119d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6dc15b960 0x7fd6dc06e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:45.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.128+0000 7fd6e119d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0a5d10 con 0x7fd6dc15b960 2023-10-09T08:17:45.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.128+0000 7fd6e119d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0a5ff0 con 0x7fd6dc15b050 2023-10-09T08:17:45.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.128+0000 7fd6e119d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0a62d0 con 0x7fd6dc0cc8d0 2023-10-09T08:17:45.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.129+0000 7fd6e099c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6dc15b960 0x7fd6dc06e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:45.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.129+0000 7fd6e099c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6dc15b960 0x7fd6dc06e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36968/0 (socket says 172.21.15.71:36968) 2023-10-09T08:17:45.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.129+0000 7fd6e099c700 1 -- 172.21.15.71:0/1609878655 learned_addr learned my addr 172.21.15.71:0/1609878655 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:45.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.129+0000 7fd6db7fe700 1 --2- 172.21.15.71:0/1609878655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6dc15b050 0x7fd6dc0a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:45.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.129+0000 7fd6dbfff700 1 --2- 172.21.15.71:0/1609878655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6dc0cc8d0 0x7fd6dc16c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:45.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.129+0000 7fd6e099c700 1 -- 172.21.15.71:0/1609878655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6dc0cc8d0 msgr2=0x7fd6dc16c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:45.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.129+0000 7fd6e099c700 1 --2- 172.21.15.71:0/1609878655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6dc0cc8d0 0x7fd6dc16c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:45.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.129+0000 7fd6e099c700 1 -- 172.21.15.71:0/1609878655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6dc15b050 msgr2=0x7fd6dc0a54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:45.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.129+0000 7fd6e099c700 1 --2- 172.21.15.71:0/1609878655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6dc15b050 0x7fd6dc0a54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:45.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.129+0000 7fd6e099c700 1 -- 172.21.15.71:0/1609878655 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d4009ae0 con 0x7fd6dc15b960 2023-10-09T08:17:45.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.129+0000 7fd6db7fe700 1 --2- 172.21.15.71:0/1609878655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6dc15b050 0x7fd6dc0a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:17:45.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.129+0000 7fd6e099c700 1 --2- 172.21.15.71:0/1609878655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6dc15b960 0x7fd6dc06e730 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0714a0 tx=0x7fd6d4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:45.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.129+0000 7fd6c3fff700 1 -- 172.21.15.71:0/1609878655 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4008e80 con 0x7fd6dc15b960 2023-10-09T08:17:45.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.130+0000 7fd6c3fff700 1 -- 172.21.15.71:0/1609878655 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d4026460 con 0x7fd6dc15b960 2023-10-09T08:17:45.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.130+0000 7fd6c3fff700 1 -- 172.21.15.71:0/1609878655 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4026820 con 0x7fd6dc15b960 2023-10-09T08:17:45.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.130+0000 7fd6e119d700 1 -- 172.21.15.71:0/1609878655 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6dc0a65b0 con 0x7fd6dc15b960 2023-10-09T08:17:45.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.130+0000 7fd6e119d700 1 -- 172.21.15.71:0/1609878655 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6dc0a5a00 con 0x7fd6dc15b960 2023-10-09T08:17:45.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.131+0000 7fd6e119d700 1 -- 172.21.15.71:0/1609878655 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6dc04c3c0 con 0x7fd6dc15b960 2023-10-09T08:17:45.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.132+0000 7fd6c3fff700 1 -- 172.21.15.71:0/1609878655 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 104) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fd6d4003040 con 0x7fd6dc15b960 2023-10-09T08:17:45.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.132+0000 7fd6c3fff700 1 --2- 172.21.15.71:0/1609878655 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fd6c8066dd0 0x7fd6c8069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:45.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.132+0000 7fd6c3fff700 1 -- 172.21.15.71:0/1609878655 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fd6d4086090 con 0x7fd6dc15b960 2023-10-09T08:17:45.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.133+0000 7fd6dbfff700 1 --2- 172.21.15.71:0/1609878655 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fd6c8066dd0 0x7fd6c8069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:45.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.133+0000 7fd6dbfff700 1 --2- 172.21.15.71:0/1609878655 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fd6c8066dd0 0x7fd6c8069280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0099f0 tx=0x7fd6cc008040 comp rx=0 tx=0).ready entity=mgr.9799 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:45.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.137+0000 7fd6c3fff700 1 -- 172.21.15.71:0/1609878655 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6d40532a0 con 0x7fd6dc15b960 2023-10-09T08:17:45.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.352+0000 7fd6e119d700 1 -- 172.21.15.71:0/1609878655 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd6dc0a6160 con 0x7fd6c8066dd0 2023-10-09T08:17:45.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.362+0000 7fd6c3fff700 1 -- 172.21.15.71:0/1609878655 <== mgr.9799 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7fd6dc0a6160 con 0x7fd6c8066dd0 2023-10-09T08:17:45.363 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:45.363 INFO:teuthology.orchestra.run.smithi071.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-10-09T08:17:45.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.364+0000 7fd6e119d700 1 -- 172.21.15.71:0/1609878655 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fd6c8066dd0 msgr2=0x7fd6c8069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:45.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.364+0000 7fd6e119d700 1 --2- 172.21.15.71:0/1609878655 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fd6c8066dd0 0x7fd6c8069280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0099f0 tx=0x7fd6cc008040 comp rx=0 tx=0).stop 2023-10-09T08:17:45.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.364+0000 7fd6e119d700 1 -- 172.21.15.71:0/1609878655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6dc15b960 msgr2=0x7fd6dc06e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:45.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.364+0000 7fd6e119d700 1 --2- 172.21.15.71:0/1609878655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6dc15b960 0x7fd6dc06e730 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0714a0 tx=0x7fd6d4018000 comp rx=0 tx=0).stop 2023-10-09T08:17:45.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.364+0000 7fd6e119d700 1 -- 172.21.15.71:0/1609878655 shutdown_connections 2023-10-09T08:17:45.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.364+0000 7fd6e119d700 1 --2- 172.21.15.71:0/1609878655 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fd6c8066dd0 0x7fd6c8069280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:45.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.364+0000 7fd6e119d700 1 --2- 172.21.15.71:0/1609878655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6dc15b960 0x7fd6dc06e730 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:45.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.364+0000 7fd6e119d700 1 --2- 172.21.15.71:0/1609878655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6dc0cc8d0 0x7fd6dc16c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:45.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.364+0000 7fd6e119d700 1 --2- 172.21.15.71:0/1609878655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6dc15b050 0x7fd6dc0a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:45.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.364+0000 7fd6e119d700 1 -- 172.21.15.71:0/1609878655 >> 172.21.15.71:0/1609878655 conn(0x7fd6dc068e20 msgr2=0x7fd6dc0b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:45.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.364+0000 7fd6e119d700 1 -- 172.21.15.71:0/1609878655 shutdown_connections 2023-10-09T08:17:45.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.364+0000 7fd6e119d700 1 -- 172.21.15.71:0/1609878655 wait complete. 2023-10-09T08:17:45.382 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-10-09T08:17:45.383 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-10-09T08:17:45.383 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-09T08:17:45.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.567+0000 7f00917ff700 1 Processor -- start 2023-10-09T08:17:45.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.567+0000 7f00917ff700 1 -- start start 2023-10-09T08:17:45.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.568+0000 7f00917ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f008c153f50 0x7f008c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:45.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.568+0000 7f00917ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f008c06d840 0x7f008c069e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:45.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.569+0000 7f00917ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f008c0b4570 con 0x7f008c154320 2023-10-09T08:17:45.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.569+0000 7f00917ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f008c15a730 con 0x7f008c153f50 2023-10-09T08:17:45.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.569+0000 7f00917ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008c15aa10 con 0x7f008c06d840 2023-10-09T08:17:45.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.569+0000 7f008affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f008c153f50 0x7f008c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:45.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.569+0000 7f008affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f008c153f50 0x7f008c0b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36978/0 (socket says 172.21.15.71:36978) 2023-10-09T08:17:45.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.569+0000 7f008affd700 1 -- 172.21.15.71:0/261998143 learned_addr learned my addr 172.21.15.71:0/261998143 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:45.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.569+0000 7f008b7fe700 1 --2- 172.21.15.71:0/261998143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f008c06d840 0x7f008c069e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:45.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.569+0000 7f008affd700 1 -- 172.21.15.71:0/261998143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f008c06d840 msgr2=0x7f008c069e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:45.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.569+0000 7f008affd700 1 --2- 172.21.15.71:0/261998143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f008c06d840 0x7f008c069e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:45.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.569+0000 7f008affd700 1 -- 172.21.15.71:0/261998143 >> v1:172.21.15.71:6789/0 conn(0x7f008c154320 legacy=0x7f008c06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:45.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.569+0000 7f008affd700 1 -- 172.21.15.71:0/261998143 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c15acf0 con 0x7f008c153f50 2023-10-09T08:17:45.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.570+0000 7f008affd700 1 --2- 172.21.15.71:0/261998143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f008c153f50 0x7f008c0b2000 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f007c0099b0 tx=0x7f007c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5621a5f79da8fefd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:45.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.570+0000 7f0089ffb700 1 -- 172.21.15.71:0/261998143 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007c00b760 con 0x7f008c153f50 2023-10-09T08:17:45.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.570+0000 7f0089ffb700 1 -- 172.21.15.71:0/261998143 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007c00b8c0 con 0x7f008c153f50 2023-10-09T08:17:45.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.570+0000 7f0089ffb700 1 -- 172.21.15.71:0/261998143 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007c00bc60 con 0x7f008c153f50 2023-10-09T08:17:45.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.570+0000 7f00917ff700 1 -- 172.21.15.71:0/261998143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f008c153f50 msgr2=0x7f008c0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:45.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.570+0000 7f00917ff700 1 --2- 172.21.15.71:0/261998143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f008c153f50 0x7f008c0b2000 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f007c0099b0 tx=0x7f007c009250 comp rx=0 tx=0).stop 2023-10-09T08:17:45.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.570+0000 7f00917ff700 1 -- 172.21.15.71:0/261998143 shutdown_connections 2023-10-09T08:17:45.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.570+0000 7f00917ff700 1 --2- 172.21.15.71:0/261998143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f008c06d840 0x7f008c069e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:45.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.570+0000 7f00917ff700 1 --2- 172.21.15.71:0/261998143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f008c153f50 0x7f008c0b2000 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:45.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.570+0000 7f00917ff700 1 -- 172.21.15.71:0/261998143 >> 172.21.15.71:0/261998143 conn(0x7f008c06baf0 msgr2=0x7f008c06bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:45.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.570+0000 7f00917ff700 1 -- 172.21.15.71:0/261998143 shutdown_connections 2023-10-09T08:17:45.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.571+0000 7f00917ff700 1 -- 172.21.15.71:0/261998143 wait complete. 2023-10-09T08:17:45.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.572+0000 7f00917ff700 1 Processor -- start 2023-10-09T08:17:45.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.572+0000 7f00917ff700 1 -- start start 2023-10-09T08:17:45.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.573+0000 7f00917ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f008c06d840 0x7f008c1591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.573+0000 7f00917ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f008c153f50 0x7f008c157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.573+0000 7f00917ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f008c154320 0x7f008c0cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.573+0000 7f00917ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c158150 con 0x7f008c153f50 2023-10-09T08:17:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.573+0000 7f00917ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c158430 con 0x7f008c06d840 2023-10-09T08:17:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.573+0000 7f00917ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008c158710 con 0x7f008c154320 2023-10-09T08:17:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.573+0000 7f008a7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f008c153f50 0x7f008c157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.574+0000 7f008a7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f008c153f50 0x7f008c157a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36988/0 (socket says 172.21.15.71:36988) 2023-10-09T08:17:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.574+0000 7f008a7fc700 1 -- 172.21.15.71:0/3698790310 learned_addr learned my addr 172.21.15.71:0/3698790310 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.574+0000 7f008b7fe700 1 --2- 172.21.15.71:0/3698790310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f008c154320 0x7f008c0cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.574+0000 7f008affd700 1 --2- 172.21.15.71:0/3698790310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f008c06d840 0x7f008c1591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.574+0000 7f008a7fc700 1 -- 172.21.15.71:0/3698790310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f008c154320 msgr2=0x7f008c0cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.574+0000 7f008a7fc700 1 --2- 172.21.15.71:0/3698790310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f008c154320 0x7f008c0cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.574+0000 7f008a7fc700 1 -- 172.21.15.71:0/3698790310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f008c06d840 msgr2=0x7f008c1591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.574+0000 7f008a7fc700 1 --2- 172.21.15.71:0/3698790310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f008c06d840 0x7f008c1591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.574+0000 7f008a7fc700 1 -- 172.21.15.71:0/3698790310 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007c0094f0 con 0x7f008c153f50 2023-10-09T08:17:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.574+0000 7f008a7fc700 1 --2- 172.21.15.71:0/3698790310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f008c153f50 0x7f008c157a70 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f008000c810 tx=0x7f0080007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.575+0000 7f0072ffd700 1 -- 172.21.15.71:0/3698790310 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0080011590 con 0x7f008c153f50 2023-10-09T08:17:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.575+0000 7f0072ffd700 1 -- 172.21.15.71:0/3698790310 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0080011730 con 0x7f008c153f50 2023-10-09T08:17:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.575+0000 7f0072ffd700 1 -- 172.21.15.71:0/3698790310 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0080011af0 con 0x7f008c153f50 2023-10-09T08:17:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.575+0000 7f00917ff700 1 -- 172.21.15.71:0/3698790310 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008c1589f0 con 0x7f008c153f50 2023-10-09T08:17:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.575+0000 7f00917ff700 1 -- 172.21.15.71:0/3698790310 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008c0cc2c0 con 0x7f008c153f50 2023-10-09T08:17:45.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.576+0000 7f00917ff700 1 -- 172.21.15.71:0/3698790310 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f008c0cec60 con 0x7f008c153f50 2023-10-09T08:17:45.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.577+0000 7f0072ffd700 1 -- 172.21.15.71:0/3698790310 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 104) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f0080012420 con 0x7f008c153f50 2023-10-09T08:17:45.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.578+0000 7f0072ffd700 1 --2- 172.21.15.71:0/3698790310 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0078066dd0 0x7f0078069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.578+0000 7f0072ffd700 1 -- 172.21.15.71:0/3698790310 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f0080083ae0 con 0x7f008c153f50 2023-10-09T08:17:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.578+0000 7f008affd700 1 --2- 172.21.15.71:0/3698790310 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0078066dd0 0x7f0078069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:45.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.579+0000 7f008affd700 1 --2- 172.21.15.71:0/3698790310 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0078066dd0 0x7f0078069280 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f007c0099b0 tx=0x7f007c016000 comp rx=0 tx=0).ready entity=mgr.9799 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:45.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.582+0000 7f0072ffd700 1 -- 172.21.15.71:0/3698790310 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0080050cd0 con 0x7f008c153f50 2023-10-09T08:17:45.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.795+0000 7f00917ff700 1 -- 172.21.15.71:0/3698790310 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f008c1585a0 con 0x7f0078066dd0 2023-10-09T08:17:45.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.866+0000 7f0072ffd700 1 -- 172.21.15.71:0/3698790310 <== mgr.9799 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f008c1585a0 con 0x7f0078066dd0 2023-10-09T08:17:45.867 INFO:teuthology.orchestra.run.smithi071.stdout:Schedule removed for path snap_test_dir1 2023-10-09T08:17:45.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.868+0000 7f00917ff700 1 -- 172.21.15.71:0/3698790310 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0078066dd0 msgr2=0x7f0078069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:45.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.868+0000 7f00917ff700 1 --2- 172.21.15.71:0/3698790310 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0078066dd0 0x7f0078069280 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f007c0099b0 tx=0x7f007c016000 comp rx=0 tx=0).stop 2023-10-09T08:17:45.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.868+0000 7f00917ff700 1 -- 172.21.15.71:0/3698790310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f008c153f50 msgr2=0x7f008c157a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:45.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.868+0000 7f00917ff700 1 --2- 172.21.15.71:0/3698790310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f008c153f50 0x7f008c157a70 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f008000c810 tx=0x7f0080007f30 comp rx=0 tx=0).stop 2023-10-09T08:17:45.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.868+0000 7f00917ff700 1 -- 172.21.15.71:0/3698790310 shutdown_connections 2023-10-09T08:17:45.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.868+0000 7f00917ff700 1 --2- 172.21.15.71:0/3698790310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f008c154320 0x7f008c0cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:45.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.868+0000 7f00917ff700 1 --2- 172.21.15.71:0/3698790310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f008c06d840 0x7f008c1591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:45.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.868+0000 7f00917ff700 1 --2- 172.21.15.71:0/3698790310 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0078066dd0 0x7f0078069280 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:45.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.868+0000 7f00917ff700 1 --2- 172.21.15.71:0/3698790310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f008c153f50 0x7f008c157a70 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:45.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.868+0000 7f00917ff700 1 -- 172.21.15.71:0/3698790310 >> 172.21.15.71:0/3698790310 conn(0x7f008c06baf0 msgr2=0x7f008c0c8560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:45.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.869+0000 7f00917ff700 1 -- 172.21.15.71:0/3698790310 shutdown_connections 2023-10-09T08:17:45.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:45.869+0000 7f00917ff700 1 -- 172.21.15.71:0/3698790310 wait complete. 2023-10-09T08:17:45.887 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-09T08:17:45.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:17:45.887 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T08:17:45.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:17:45.925 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-09T08:17:46.006 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-09T08:17:46.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.231+0000 7fe0c299d700 1 Processor -- start 2023-10-09T08:17:46.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.231+0000 7fe0c299d700 1 -- start start 2023-10-09T08:17:46.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.233+0000 7fe0c299d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe0bc0c9db0 0x7fe0bc153900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:46.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.233+0000 7fe0c299d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0bc157130 0x7fe0bc0c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:46.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.233+0000 7fe0c299d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0bc06e150 con 0x7fe0bc159ad0 2023-10-09T08:17:46.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.233+0000 7fe0c299d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0bc153e40 con 0x7fe0bc0c9db0 2023-10-09T08:17:46.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.233+0000 7fe0c299d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc0c7800 con 0x7fe0bc157130 2023-10-09T08:17:46.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.233+0000 7fe0c219c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe0bc159ad0 0x7fe0bc159f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48440/0 (socket says 172.21.15.71:48440) 2023-10-09T08:17:46.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.233+0000 7fe0c219c700 1 -- 172.21.15.71:0/1222303041 learned_addr learned my addr 172.21.15.71:0/1222303041 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.233+0000 7fe0c0999700 1 -- 172.21.15.71:0/1222303041 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771468631 0 0) 0x7fe0bc06e150 con 0x7fe0bc159ad0 2023-10-09T08:17:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.233+0000 7fe0c119a700 1 --2- 172.21.15.71:0/1222303041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0bc157130 0x7fe0bc0c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.233+0000 7fe0c199b700 1 --2- 172.21.15.71:0/1222303041 >> v2:172.21.15.179:3300/0 conn(0x7fe0bc0c9db0 0x7fe0bc153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.233+0000 7fe0c0999700 1 -- 172.21.15.71:0/1222303041 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0a8005780 con 0x7fe0bc159ad0 2023-10-09T08:17:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.234+0000 7fe0c0999700 1 -- 172.21.15.71:0/1222303041 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1032137807 0 0) 0x7fe0a8005780 con 0x7fe0bc159ad0 2023-10-09T08:17:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.234+0000 7fe0c0999700 1 -- 172.21.15.71:0/1222303041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0bc157130 msgr2=0x7fe0bc0c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.234+0000 7fe0c0999700 1 --2- 172.21.15.71:0/1222303041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0bc157130 0x7fe0bc0c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.234+0000 7fe0c0999700 1 -- 172.21.15.71:0/1222303041 >> v2:172.21.15.179:3300/0 conn(0x7fe0bc0c9db0 msgr2=0x7fe0bc153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:46.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.234+0000 7fe0c0999700 1 --2- 172.21.15.71:0/1222303041 >> v2:172.21.15.179:3300/0 conn(0x7fe0bc0c9db0 0x7fe0bc153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:46.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.234+0000 7fe0c0999700 1 -- 172.21.15.71:0/1222303041 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc0c7ae0 con 0x7fe0bc159ad0 2023-10-09T08:17:46.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.234+0000 7fe0c0999700 1 -- 172.21.15.71:0/1222303041 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fe0b40017f0 con 0x7fe0bc159ad0 2023-10-09T08:17:46.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.234+0000 7fe0c0999700 1 -- 172.21.15.71:0/1222303041 >> v1:172.21.15.71:6789/0 conn(0x7fe0bc159ad0 legacy=0x7fe0bc159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:46.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.234+0000 7fe0c0999700 1 --2- 172.21.15.71:0/1222303041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0a8005c70 0x7fe0a8006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:46.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.234+0000 7fe0c0999700 1 --2- 172.21.15.71:0/1222303041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0bc157130 0x7fe0a8006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:46.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.234+0000 7fe0c0999700 1 --2- 172.21.15.71:0/1222303041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0a8006f60 0x7fe0a80073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:46.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.234+0000 7fe0c0999700 1 -- 172.21.15.71:0/1222303041 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc153e40 con 0x7fe0a8006f60 2023-10-09T08:17:46.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.234+0000 7fe0c0999700 1 -- 172.21.15.71:0/1222303041 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc0c7800 con 0x7fe0a8005c70 2023-10-09T08:17:46.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.234+0000 7fe0c0999700 1 -- 172.21.15.71:0/1222303041 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a800dc70 con 0x7fe0bc157130 2023-10-09T08:17:46.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.234+0000 7fe0c219c700 1 --2- 172.21.15.71:0/1222303041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0a8006f60 0x7fe0a80073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:46.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.234+0000 7fe0c199b700 1 --2- 172.21.15.71:0/1222303041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0a8005c70 0x7fe0a8006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:46.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.234+0000 7fe0c119a700 1 --2- 172.21.15.71:0/1222303041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0bc157130 0x7fe0a8006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:46.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.235+0000 7fe0c219c700 1 -- 172.21.15.71:0/1222303041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0bc157130 msgr2=0x7fe0a8006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:46.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.235+0000 7fe0c219c700 1 --2- 172.21.15.71:0/1222303041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0bc157130 0x7fe0a8006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:46.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.235+0000 7fe0c219c700 1 -- 172.21.15.71:0/1222303041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0a8005c70 msgr2=0x7fe0a8006040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:46.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.235+0000 7fe0c219c700 1 --2- 172.21.15.71:0/1222303041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0a8005c70 0x7fe0a8006040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:46.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.235+0000 7fe0c219c700 1 -- 172.21.15.71:0/1222303041 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a8005780 con 0x7fe0a8006f60 2023-10-09T08:17:46.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.235+0000 7fe0c219c700 1 --2- 172.21.15.71:0/1222303041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0a8006f60 0x7fe0a80073d0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4005c30 tx=0x7fe0b4005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f4f8e8b22f9a04 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:46.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.235+0000 7fe0c0999700 1 -- 172.21.15.71:0/1222303041 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b40055a0 con 0x7fe0a8006f60 2023-10-09T08:17:46.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.235+0000 7fe0c0999700 1 -- 172.21.15.71:0/1222303041 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b400d900 con 0x7fe0a8006f60 2023-10-09T08:17:46.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.235+0000 7fe0c0999700 1 -- 172.21.15.71:0/1222303041 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b400dca0 con 0x7fe0a8006f60 2023-10-09T08:17:46.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.236+0000 7fe0c299d700 1 -- 172.21.15.71:0/1222303041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0a8006f60 msgr2=0x7fe0a80073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:46.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.236+0000 7fe0c299d700 1 --2- 172.21.15.71:0/1222303041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0a8006f60 0x7fe0a80073d0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4005c30 tx=0x7fe0b4005270 comp rx=0 tx=0).stop 2023-10-09T08:17:46.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.236+0000 7fe0c219c700 1 -- 172.21.15.71:0/1222303041 reap_dead start 2023-10-09T08:17:46.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.236+0000 7fe0c299d700 1 -- 172.21.15.71:0/1222303041 shutdown_connections 2023-10-09T08:17:46.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.236+0000 7fe0c299d700 1 -- 172.21.15.71:0/1222303041 >> 172.21.15.71:0/1222303041 conn(0x7fe0bc0cc1e0 msgr2=0x7fe0bc0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:46.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.236+0000 7fe0c299d700 1 -- 172.21.15.71:0/1222303041 shutdown_connections 2023-10-09T08:17:46.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.236+0000 7fe0c299d700 1 -- 172.21.15.71:0/1222303041 wait complete. 2023-10-09T08:17:46.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.237+0000 7fe0c299d700 1 Processor -- start 2023-10-09T08:17:46.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.237+0000 7fe0c299d700 1 -- start start 2023-10-09T08:17:46.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.238+0000 7fe0c299d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0a8006f60 0x7fe0bc0b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:46.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.238+0000 7fe0c299d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0bc155630 0x7fe0bc0ac060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:46.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.238+0000 7fe0c299d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0bc0ae0b0 0x7fe0bc0ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:46.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.238+0000 7fe0c299d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc165ac0 con 0x7fe0bc155630 2023-10-09T08:17:46.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.238+0000 7fe0c299d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc142740 con 0x7fe0a8006f60 2023-10-09T08:17:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.238+0000 7fe0c299d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc0ae960 con 0x7fe0bc0ae0b0 2023-10-09T08:17:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.238+0000 7fe0c119a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0bc155630 0x7fe0bc0ac060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.239+0000 7fe0c119a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0bc155630 0x7fe0bc0ac060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37000/0 (socket says 172.21.15.71:37000) 2023-10-09T08:17:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.239+0000 7fe0c119a700 1 -- 172.21.15.71:0/1820975816 learned_addr learned my addr 172.21.15.71:0/1820975816 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.239+0000 7fe0c199b700 1 --2- 172.21.15.71:0/1820975816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0a8006f60 0x7fe0bc0b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.239+0000 7fe0c219c700 1 --2- 172.21.15.71:0/1820975816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0bc0ae0b0 0x7fe0bc0ac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.239+0000 7fe0c119a700 1 -- 172.21.15.71:0/1820975816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0bc0ae0b0 msgr2=0x7fe0bc0ac5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.239+0000 7fe0c119a700 1 --2- 172.21.15.71:0/1820975816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0bc0ae0b0 0x7fe0bc0ac5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.239+0000 7fe0c119a700 1 -- 172.21.15.71:0/1820975816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0a8006f60 msgr2=0x7fe0bc0b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.239+0000 7fe0c119a700 1 --2- 172.21.15.71:0/1820975816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0a8006f60 0x7fe0bc0b17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.239+0000 7fe0c119a700 1 -- 172.21.15.71:0/1820975816 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc1551a0 con 0x7fe0bc155630 2023-10-09T08:17:46.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.239+0000 7fe0c219c700 1 --2- 172.21.15.71:0/1820975816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0bc0ae0b0 0x7fe0bc0ac5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:17:46.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.239+0000 7fe0c119a700 1 --2- 172.21.15.71:0/1820975816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0bc155630 0x7fe0bc0ac060 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac006ac0 tx=0x7fe0ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:46.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.239+0000 7fe0b1ffb700 1 -- 172.21.15.71:0/1820975816 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac00f940 con 0x7fe0bc155630 2023-10-09T08:17:46.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.239+0000 7fe0b1ffb700 1 -- 172.21.15.71:0/1820975816 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ac00faa0 con 0x7fe0bc155630 2023-10-09T08:17:46.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.239+0000 7fe0b1ffb700 1 -- 172.21.15.71:0/1820975816 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac00fe20 con 0x7fe0bc155630 2023-10-09T08:17:46.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.239+0000 7fe0c299d700 1 -- 172.21.15.71:0/1820975816 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0bc0ae680 con 0x7fe0bc155630 2023-10-09T08:17:46.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.240+0000 7fe0c299d700 1 -- 172.21.15.71:0/1820975816 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0bc154e30 con 0x7fe0bc155630 2023-10-09T08:17:46.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.241+0000 7fe0c299d700 1 -- 172.21.15.71:0/1820975816 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0bc155330 con 0x7fe0bc155630 2023-10-09T08:17:46.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.241+0000 7fe0b1ffb700 1 -- 172.21.15.71:0/1820975816 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 105) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fe0ac014650 con 0x7fe0bc155630 2023-10-09T08:17:46.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.242+0000 7fe0b1ffb700 1 --2- 172.21.15.71:0/1820975816 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe0a0067130 0x7fe0a00695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:46.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.242+0000 7fe0b1ffb700 1 -- 172.21.15.71:0/1820975816 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fe0ac018030 con 0x7fe0bc155630 2023-10-09T08:17:46.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.243+0000 7fe0c199b700 1 --2- 172.21.15.71:0/1820975816 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe0a0067130 0x7fe0a00695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:46.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.243+0000 7fe0c199b700 1 --2- 172.21.15.71:0/1820975816 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe0a0067130 0x7fe0a00695e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8006f00 tx=0x7fe0b80091a0 comp rx=0 tx=0).ready entity=mgr.9799 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:46.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.246+0000 7fe0b1ffb700 1 -- 172.21.15.71:0/1820975816 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0ac0522e0 con 0x7fe0bc155630 2023-10-09T08:17:46.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:46.490+0000 7fe0c299d700 1 -- 172.21.15.71:0/1820975816 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fe0bc0c7dc0 con 0x7fe0bc155630 2023-10-09T08:17:47.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.127+0000 7fe0b1ffb700 1 -- 172.21.15.71:0/1820975816 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 106) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fe0ac0526b0 con 0x7fe0bc155630 2023-10-09T08:17:47.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.128+0000 7fe0b1ffb700 1 -- 172.21.15.71:0/1820975816 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v106) v1 ==== 93+0+0 (secure 0 0 0) 0x7fe0ac0522e0 con 0x7fe0bc155630 2023-10-09T08:17:47.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.131+0000 7fe0c299d700 1 -- 172.21.15.71:0/1820975816 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe0a0067130 msgr2=0x7fe0a00695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:47.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.132+0000 7fe0c299d700 1 --2- 172.21.15.71:0/1820975816 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe0a0067130 0x7fe0a00695e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8006f00 tx=0x7fe0b80091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:47.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.132+0000 7fe0c299d700 1 -- 172.21.15.71:0/1820975816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0bc155630 msgr2=0x7fe0bc0ac060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:47.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.132+0000 7fe0c299d700 1 --2- 172.21.15.71:0/1820975816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0bc155630 0x7fe0bc0ac060 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac006ac0 tx=0x7fe0ac0091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:47.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.132+0000 7fe0c299d700 1 -- 172.21.15.71:0/1820975816 shutdown_connections 2023-10-09T08:17:47.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.132+0000 7fe0c299d700 1 --2- 172.21.15.71:0/1820975816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0bc0ae0b0 0x7fe0bc0ac5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:47.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.132+0000 7fe0c299d700 1 --2- 172.21.15.71:0/1820975816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0a8006f60 0x7fe0bc0b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:47.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.132+0000 7fe0c299d700 1 --2- 172.21.15.71:0/1820975816 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe0a0067130 0x7fe0a00695e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:47.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.132+0000 7fe0c299d700 1 --2- 172.21.15.71:0/1820975816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0bc155630 0x7fe0bc0ac060 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:47.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.132+0000 7fe0c299d700 1 -- 172.21.15.71:0/1820975816 >> 172.21.15.71:0/1820975816 conn(0x7fe0bc0cc1e0 msgr2=0x7fe0bc0cb440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:47.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.132+0000 7fe0c299d700 1 -- 172.21.15.71:0/1820975816 shutdown_connections 2023-10-09T08:17:47.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.132+0000 7fe0c299d700 1 -- 172.21.15.71:0/1820975816 wait complete. 2023-10-09T08:17:47.152 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T08:17:47.152 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T08:17:47.236 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T08:17:47.325 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T08:17:47.325 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T08:17:47.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T08:17:47.325 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T08:17:47.409 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T08:17:47.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:17:47.409 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T08:17:47.446 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T08:17:47.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.670+0000 7f685a5ff700 1 Processor -- start 2023-10-09T08:17:47.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.670+0000 7f685a5ff700 1 -- start start 2023-10-09T08:17:47.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.671+0000 7f685a5ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6854155c10 0x7f6854155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:47.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.671+0000 7f685a5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f68540ac6d0 0x7f68540b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:47.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.671+0000 7f685a5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68540acac0 con 0x7f68540ac230 2023-10-09T08:17:47.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.671+0000 7f685a5ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68540ad930 con 0x7f6854155c10 2023-10-09T08:17:47.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.671+0000 7f685a5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68540acd20 con 0x7f68540ac6d0 2023-10-09T08:17:47.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.671+0000 7f6853fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6854155c10 0x7f6854155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:47.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.672+0000 7f6853fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6854155c10 0x7f6854155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37014/0 (socket says 172.21.15.71:37014) 2023-10-09T08:17:47.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.672+0000 7f6853fff700 1 -- 172.21.15.71:0/2722957728 learned_addr learned my addr 172.21.15.71:0/2722957728 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:47.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.672+0000 7f6858b9c700 1 --2- 172.21.15.71:0/2722957728 >> v2:172.21.15.179:3300/0 conn(0x7f68540ac6d0 0x7f68540b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:47.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.672+0000 7f6853fff700 1 -- 172.21.15.71:0/2722957728 >> v2:172.21.15.179:3300/0 conn(0x7f68540ac6d0 msgr2=0x7f68540b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:47.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.672+0000 7f6853fff700 1 --2- 172.21.15.71:0/2722957728 >> v2:172.21.15.179:3300/0 conn(0x7f68540ac6d0 0x7f68540b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:47.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.672+0000 7f6853fff700 1 -- 172.21.15.71:0/2722957728 >> v1:172.21.15.179:6789/0 conn(0x7f68540ac230 legacy=0x7f68541568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:47.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.672+0000 7f6853fff700 1 -- 172.21.15.71:0/2722957728 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68540ad000 con 0x7f6854155c10 2023-10-09T08:17:47.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.672+0000 7f6853fff700 1 --2- 172.21.15.71:0/2722957728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6854155c10 0x7f6854155fe0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f68540ae0c0 tx=0x7f6844009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd2994163504575 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:47.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.672+0000 7f6852ffd700 1 -- 172.21.15.71:0/2722957728 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6844009e70 con 0x7f6854155c10 2023-10-09T08:17:47.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.672+0000 7f6852ffd700 1 -- 172.21.15.71:0/2722957728 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684400b860 con 0x7f6854155c10 2023-10-09T08:17:47.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.673+0000 7f6852ffd700 1 -- 172.21.15.71:0/2722957728 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684400bc00 con 0x7f6854155c10 2023-10-09T08:17:47.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.673+0000 7f685a5ff700 1 -- 172.21.15.71:0/2722957728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6854155c10 msgr2=0x7f6854155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:47.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.673+0000 7f685a5ff700 1 --2- 172.21.15.71:0/2722957728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6854155c10 0x7f6854155fe0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f68540ae0c0 tx=0x7f6844009250 comp rx=0 tx=0).stop 2023-10-09T08:17:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.673+0000 7f685a5ff700 1 -- 172.21.15.71:0/2722957728 shutdown_connections 2023-10-09T08:17:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.673+0000 7f685a5ff700 1 --2- 172.21.15.71:0/2722957728 >> v2:172.21.15.179:3300/0 conn(0x7f68540ac6d0 0x7f68540b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.673+0000 7f685a5ff700 1 --2- 172.21.15.71:0/2722957728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6854155c10 0x7f6854155fe0 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.673+0000 7f685a5ff700 1 -- 172.21.15.71:0/2722957728 >> 172.21.15.71:0/2722957728 conn(0x7f685406a320 msgr2=0x7f68540cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.673+0000 7f685a5ff700 1 -- 172.21.15.71:0/2722957728 shutdown_connections 2023-10-09T08:17:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.673+0000 7f685a5ff700 1 -- 172.21.15.71:0/2722957728 wait complete. 2023-10-09T08:17:47.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.675+0000 7f685a5ff700 1 Processor -- start 2023-10-09T08:17:47.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.675+0000 7f685a5ff700 1 -- start start 2023-10-09T08:17:47.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.676+0000 7f685a5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68540ac230 0x7f6854152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:47.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.676+0000 7f685a5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68540ac6d0 0x7f68540c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:47.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.676+0000 7f685a5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6854155c10 0x7f68540c3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:47.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.676+0000 7f685a5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6854153120 con 0x7f6854155c10 2023-10-09T08:17:47.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.676+0000 7f685a5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68540a8b50 con 0x7f68540ac6d0 2023-10-09T08:17:47.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.676+0000 7f685a5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68540a8e30 con 0x7f68540ac230 2023-10-09T08:17:47.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.676+0000 7f6858b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6854155c10 0x7f68540c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:47.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.676+0000 7f68537fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68540ac6d0 0x7f68540c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:47.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.676+0000 7f6858b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6854155c10 0x7f68540c3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37018/0 (socket says 172.21.15.71:37018) 2023-10-09T08:17:47.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.676+0000 7f6853fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68540ac230 0x7f6854152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:47.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.676+0000 7f6858b9c700 1 -- 172.21.15.71:0/2361498429 learned_addr learned my addr 172.21.15.71:0/2361498429 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:47.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.677+0000 7f6858b9c700 1 -- 172.21.15.71:0/2361498429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68540ac230 msgr2=0x7f6854152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:47.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.677+0000 7f6858b9c700 1 --2- 172.21.15.71:0/2361498429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68540ac230 0x7f6854152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:47.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.677+0000 7f6858b9c700 1 -- 172.21.15.71:0/2361498429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68540ac6d0 msgr2=0x7f68540c30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:47.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.677+0000 7f6858b9c700 1 --2- 172.21.15.71:0/2361498429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68540ac6d0 0x7f68540c30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:47.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.677+0000 7f6858b9c700 1 -- 172.21.15.71:0/2361498429 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68440094f0 con 0x7f6854155c10 2023-10-09T08:17:47.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.677+0000 7f68537fe700 1 --2- 172.21.15.71:0/2361498429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68540ac6d0 0x7f68540c30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:47.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.677+0000 7f6858b9c700 1 --2- 172.21.15.71:0/2361498429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6854155c10 0x7f68540c3620 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f684c009e90 tx=0x7f684c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:47.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.677+0000 7f683bfff700 1 -- 172.21.15.71:0/2361498429 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c00cb70 con 0x7f6854155c10 2023-10-09T08:17:47.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.677+0000 7f683bfff700 1 -- 172.21.15.71:0/2361498429 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684c00f040 con 0x7f6854155c10 2023-10-09T08:17:47.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.677+0000 7f683bfff700 1 -- 172.21.15.71:0/2361498429 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c014480 con 0x7f6854155c10 2023-10-09T08:17:47.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.677+0000 7f685a5ff700 1 -- 172.21.15.71:0/2361498429 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68540a9110 con 0x7f6854155c10 2023-10-09T08:17:47.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.677+0000 7f685a5ff700 1 -- 172.21.15.71:0/2361498429 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68540c50f0 con 0x7f6854155c10 2023-10-09T08:17:47.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.678+0000 7f685a5ff700 1 -- 172.21.15.71:0/2361498429 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68540c53a0 con 0x7f6854155c10 2023-10-09T08:17:47.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.680+0000 7f683bfff700 1 -- 172.21.15.71:0/2361498429 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 106) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f684c014830 con 0x7f6854155c10 2023-10-09T08:17:47.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.681+0000 7f683bfff700 1 --2- 172.21.15.71:0/2361498429 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f68400670e0 0x7f6840069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:47.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.682+0000 7f683bfff700 1 -- 172.21.15.71:0/2361498429 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f684c085920 con 0x7f6854155c10 2023-10-09T08:17:47.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.682+0000 7f6853fff700 1 -- 172.21.15.71:0/2361498429 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f68400670e0 msgr2=0x7f6840069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:47.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.682+0000 7f6853fff700 1 --2- 172.21.15.71:0/2361498429 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f68400670e0 0x7f6840069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:47.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.686+0000 7f683bfff700 1 -- 172.21.15.71:0/2361498429 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68540c53a0 con 0x7f6854155c10 2023-10-09T08:17:47.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.883+0000 7f6853fff700 1 -- 172.21.15.71:0/2361498429 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f68400670e0 msgr2=0x7f6840069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:47.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.883+0000 7f6853fff700 1 --2- 172.21.15.71:0/2361498429 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f68400670e0 0x7f6840069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:47.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.922+0000 7f685a5ff700 1 -- 172.21.15.71:0/2361498429 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68540c53a0 con 0x7f6854155c10 2023-10-09T08:17:47.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.923+0000 7f683bfff700 1 -- 172.21.15.71:0/2361498429 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4608 (secure 0 0 0) 0x7f68540c53a0 con 0x7f6854155c10 2023-10-09T08:17:47.924 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:47.924 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":97,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1242627383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1242627383},{"type":"v1","addr":"172.21.15.179:6836","nonce":1242627383}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":9628,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1306881721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1306881721},{"type":"v1","addr":"172.21.15.179:6834","nonce":1306881721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10143,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/717406174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":717406174},{"type":"v1","addr":"172.21.15.71:6834","nonce":717406174}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T08:17:22.432534+0000","modified":"2023-10-09T08:17:25.988311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10149":{"gid":10149,"name":"c","rank":0,"incarnation":93,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/2477293368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":2477293368},{"type":"v1","addr":"172.21.15.71:6835","nonce":2477293368}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T08:17:47.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.925+0000 7f685a5ff700 1 -- 172.21.15.71:0/2361498429 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f68400670e0 msgr2=0x7f6840069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:47.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.925+0000 7f685a5ff700 1 --2- 172.21.15.71:0/2361498429 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f68400670e0 0x7f6840069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:47.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.925+0000 7f685a5ff700 1 -- 172.21.15.71:0/2361498429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6854155c10 msgr2=0x7f68540c3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:47.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.925+0000 7f685a5ff700 1 --2- 172.21.15.71:0/2361498429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6854155c10 0x7f68540c3620 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f684c009e90 tx=0x7f684c00b040 comp rx=0 tx=0).stop 2023-10-09T08:17:47.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.925+0000 7f685a5ff700 1 -- 172.21.15.71:0/2361498429 shutdown_connections 2023-10-09T08:17:47.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.925+0000 7f685a5ff700 1 --2- 172.21.15.71:0/2361498429 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f68400670e0 0x7f6840069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:47.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.925+0000 7f685a5ff700 1 --2- 172.21.15.71:0/2361498429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6854155c10 0x7f68540c3620 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:47.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.925+0000 7f685a5ff700 1 --2- 172.21.15.71:0/2361498429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68540ac230 0x7f6854152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:47.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.925+0000 7f685a5ff700 1 --2- 172.21.15.71:0/2361498429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68540ac6d0 0x7f68540c30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:47.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.925+0000 7f685a5ff700 1 -- 172.21.15.71:0/2361498429 >> 172.21.15.71:0/2361498429 conn(0x7f685406a320 msgr2=0x7f68540c8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:47.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.925+0000 7f685a5ff700 1 -- 172.21.15.71:0/2361498429 shutdown_connections 2023-10-09T08:17:47.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:47.925+0000 7f685a5ff700 1 -- 172.21.15.71:0/2361498429 wait complete. 2023-10-09T08:17:47.928 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 97 2023-10-09T08:17:47.945 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T08:17:48.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.132+0000 7ff40759e700 1 Processor -- start 2023-10-09T08:17:48.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.132+0000 7ff40759e700 1 -- start start 2023-10-09T08:17:48.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.133+0000 7ff40759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff408159420 0x7ff4080b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:48.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.133+0000 7ff40759e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff40815d230 0x7ff40815d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:48.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.133+0000 7ff40759e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff40815dbd0 con 0x7ff4081597f0 2023-10-09T08:17:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.133+0000 7ff40759e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4080b2980 con 0x7ff40815d230 2023-10-09T08:17:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.133+0000 7ff40759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080b11d0 con 0x7ff408159420 2023-10-09T08:17:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.133+0000 7ff406d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff40815d230 0x7ff40815d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.134+0000 7ff406d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff40815d230 0x7ff40815d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37028/0 (socket says 172.21.15.71:37028) 2023-10-09T08:17:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.134+0000 7ff406d9d700 1 -- 172.21.15.71:0/2764444860 learned_addr learned my addr 172.21.15.71:0/2764444860 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.134+0000 7ff40659c700 1 --2- 172.21.15.71:0/2764444860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff408159420 0x7ff4080b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.134+0000 7ff406d9d700 1 -- 172.21.15.71:0/2764444860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff408159420 msgr2=0x7ff4080b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.134+0000 7ff406d9d700 1 --2- 172.21.15.71:0/2764444860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff408159420 0x7ff4080b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.134+0000 7ff40559a700 1 -- 172.21.15.71:0/2764444860 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325437706 0 0) 0x7ff3fc001110 con 0x7ff4081597f0 2023-10-09T08:17:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.134+0000 7ff406d9d700 1 -- 172.21.15.71:0/2764444860 >> v1:172.21.15.179:6789/0 conn(0x7ff4081597f0 legacy=0x7ff4080b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.134+0000 7ff406d9d700 1 -- 172.21.15.71:0/2764444860 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4080b14b0 con 0x7ff40815d230 2023-10-09T08:17:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.134+0000 7ff406d9d700 1 --2- 172.21.15.71:0/2764444860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff40815d230 0x7ff40815d690 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7ff400009f20 tx=0x7ff400009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592ad0a1af2496e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.134+0000 7ff40559a700 1 -- 172.21.15.71:0/2764444860 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40000e070 con 0x7ff40815d230 2023-10-09T08:17:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.135+0000 7ff40559a700 1 -- 172.21.15.71:0/2764444860 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40000b9d0 con 0x7ff40815d230 2023-10-09T08:17:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.135+0000 7ff40559a700 1 -- 172.21.15.71:0/2764444860 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4000092e0 con 0x7ff40815d230 2023-10-09T08:17:48.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.135+0000 7ff40759e700 1 -- 172.21.15.71:0/2764444860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff40815d230 msgr2=0x7ff40815d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:48.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.135+0000 7ff40759e700 1 --2- 172.21.15.71:0/2764444860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff40815d230 0x7ff40815d690 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7ff400009f20 tx=0x7ff400009840 comp rx=0 tx=0).stop 2023-10-09T08:17:48.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.135+0000 7ff40759e700 1 -- 172.21.15.71:0/2764444860 shutdown_connections 2023-10-09T08:17:48.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.135+0000 7ff40759e700 1 --2- 172.21.15.71:0/2764444860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff40815d230 0x7ff40815d690 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.135+0000 7ff40759e700 1 --2- 172.21.15.71:0/2764444860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff408159420 0x7ff4080b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.135+0000 7ff40759e700 1 -- 172.21.15.71:0/2764444860 >> 172.21.15.71:0/2764444860 conn(0x7ff4080d0660 msgr2=0x7ff4080d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:48.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.135+0000 7ff40759e700 1 -- 172.21.15.71:0/2764444860 shutdown_connections 2023-10-09T08:17:48.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.135+0000 7ff40759e700 1 -- 172.21.15.71:0/2764444860 wait complete. 2023-10-09T08:17:48.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.137+0000 7ff40759e700 1 Processor -- start 2023-10-09T08:17:48.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.137+0000 7ff40759e700 1 -- start start 2023-10-09T08:17:48.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.138+0000 7ff40759e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff408159420 0x7ff408153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.138+0000 7ff40759e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4081597f0 0x7ff40815bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.138+0000 7ff40759e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff40815d230 0x7ff408069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.138+0000 7ff40759e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080c8500 con 0x7ff40815d230 2023-10-09T08:17:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.138+0000 7ff40759e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080c60b0 con 0x7ff4081597f0 2023-10-09T08:17:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.138+0000 7ff40759e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080c54a0 con 0x7ff408159420 2023-10-09T08:17:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.138+0000 7ff406d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff40815d230 0x7ff408069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.138+0000 7ff406d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff40815d230 0x7ff408069530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37038/0 (socket says 172.21.15.71:37038) 2023-10-09T08:17:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.138+0000 7ff406d9d700 1 -- 172.21.15.71:0/1330350831 learned_addr learned my addr 172.21.15.71:0/1330350831 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.138+0000 7ff40659c700 1 --2- 172.21.15.71:0/1330350831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff408159420 0x7ff408153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.138+0000 7ff405d9b700 1 --2- 172.21.15.71:0/1330350831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4081597f0 0x7ff40815bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.139+0000 7ff406d9d700 1 -- 172.21.15.71:0/1330350831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff408159420 msgr2=0x7ff408153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.139+0000 7ff406d9d700 1 --2- 172.21.15.71:0/1330350831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff408159420 0x7ff408153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.139+0000 7ff406d9d700 1 -- 172.21.15.71:0/1330350831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4081597f0 msgr2=0x7ff40815bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.139+0000 7ff406d9d700 1 --2- 172.21.15.71:0/1330350831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4081597f0 0x7ff40815bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.139+0000 7ff406d9d700 1 -- 172.21.15.71:0/1330350831 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff400009ae0 con 0x7ff40815d230 2023-10-09T08:17:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.139+0000 7ff406d9d700 1 --2- 172.21.15.71:0/1330350831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff40815d230 0x7ff408069530 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7ff408089340 tx=0x7ff400018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.139+0000 7ff3f67fc700 1 -- 172.21.15.71:0/1330350831 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff400008b10 con 0x7ff40815d230 2023-10-09T08:17:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.139+0000 7ff3f67fc700 1 -- 172.21.15.71:0/1330350831 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff400008c90 con 0x7ff40815d230 2023-10-09T08:17:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.139+0000 7ff3f67fc700 1 -- 172.21.15.71:0/1330350831 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4000256b0 con 0x7ff40815d230 2023-10-09T08:17:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.139+0000 7ff40759e700 1 -- 172.21.15.71:0/1330350831 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4080c5780 con 0x7ff40815d230 2023-10-09T08:17:48.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.139+0000 7ff40759e700 1 -- 172.21.15.71:0/1330350831 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4080c5dc0 con 0x7ff40815d230 2023-10-09T08:17:48.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.140+0000 7ff40759e700 1 -- 172.21.15.71:0/1330350831 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4080c6240 con 0x7ff40815d230 2023-10-09T08:17:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.141+0000 7ff3f67fc700 1 -- 172.21.15.71:0/1330350831 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 106) v1 ==== 84899+0+0 (secure 0 0 0) 0x7ff400003040 con 0x7ff40815d230 2023-10-09T08:17:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.142+0000 7ff3f67fc700 1 --2- 172.21.15.71:0/1330350831 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff3e80670e0 0x7ff3e8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.142+0000 7ff3f67fc700 1 -- 172.21.15.71:0/1330350831 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 6483+0+0 (secure 0 0 0) 0x7ff400086260 con 0x7ff40815d230 2023-10-09T08:17:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.142+0000 7ff40659c700 1 -- 172.21.15.71:0/1330350831 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff3e80670e0 msgr2=0x7ff3e8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.142+0000 7ff40659c700 1 --2- 172.21.15.71:0/1330350831 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff3e80670e0 0x7ff3e8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:48.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.150+0000 7ff3f67fc700 1 -- 172.21.15.71:0/1330350831 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff400052d90 con 0x7ff40815d230 2023-10-09T08:17:48.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.343+0000 7ff40659c700 1 -- 172.21.15.71:0/1330350831 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff3e80670e0 msgr2=0x7ff3e8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:48.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.343+0000 7ff40659c700 1 --2- 172.21.15.71:0/1330350831 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff3e80670e0 0x7ff3e8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:48.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.347+0000 7ff40759e700 1 -- 172.21.15.71:0/1330350831 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff40804c3c0 con 0x7ff40815d230 2023-10-09T08:17:48.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.349+0000 7ff3f67fc700 1 -- 172.21.15.71:0/1330350831 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v211) v1 ==== 74+0+16539 (secure 0 0 0) 0x7ff4000563b0 con 0x7ff40815d230 2023-10-09T08:17:48.350 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:48.350 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":211,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T08:17:43.094484+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-09T08:17:20.000097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"209","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-09T08:17:21.419977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"210","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:0/1351990957":"2023-10-10T08:17:43.094437+0000","172.21.15.179:0/3871404679":"2023-10-10T08:17:43.094437+0000","172.21.15.179:0/4203172728":"2023-10-10T08:17:43.094437+0000","172.21.15.179:0/978747241":"2023-10-10T08:17:43.094437+0000","172.21.15.179:6837/101206":"2023-10-10T08:17:43.094437+0000","172.21.15.179:6835/101206":"2023-10-10T08:17:43.094437+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T08:17:48.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.351+0000 7ff40759e700 1 -- 172.21.15.71:0/1330350831 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff3e80670e0 msgr2=0x7ff3e8069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:48.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.351+0000 7ff40759e700 1 --2- 172.21.15.71:0/1330350831 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff3e80670e0 0x7ff3e8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.351+0000 7ff40759e700 1 -- 172.21.15.71:0/1330350831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff40815d230 msgr2=0x7ff408069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:48.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.351+0000 7ff40759e700 1 --2- 172.21.15.71:0/1330350831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff40815d230 0x7ff408069530 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7ff408089340 tx=0x7ff400018000 comp rx=0 tx=0).stop 2023-10-09T08:17:48.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.351+0000 7ff40759e700 1 -- 172.21.15.71:0/1330350831 shutdown_connections 2023-10-09T08:17:48.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.351+0000 7ff40759e700 1 --2- 172.21.15.71:0/1330350831 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff3e80670e0 0x7ff3e8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.351+0000 7ff40759e700 1 --2- 172.21.15.71:0/1330350831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff40815d230 0x7ff408069530 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.351+0000 7ff40759e700 1 --2- 172.21.15.71:0/1330350831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff408159420 0x7ff408153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.351+0000 7ff40759e700 1 --2- 172.21.15.71:0/1330350831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4081597f0 0x7ff40815bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.351+0000 7ff40759e700 1 -- 172.21.15.71:0/1330350831 >> 172.21.15.71:0/1330350831 conn(0x7ff4080d0660 msgr2=0x7ff4080b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:48.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.352+0000 7ff40759e700 1 -- 172.21.15.71:0/1330350831 shutdown_connections 2023-10-09T08:17:48.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.352+0000 7ff40759e700 1 -- 172.21.15.71:0/1330350831 wait complete. 2023-10-09T08:17:48.371 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T06:42:26.607635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 24, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T08:17:20.000097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '209', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 25, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T08:17:21.419977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '210', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T08:17:48.372 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T08:17:48.408 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:48.408+0000 7fb5b9869180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T08:17:48.465 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:48.464+0000 7f5c5476a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T08:17:48.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.559+0000 7f25dd59d700 1 Processor -- start 2023-10-09T08:17:48.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.559+0000 7f25dd59d700 1 -- start start 2023-10-09T08:17:48.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.560+0000 7f25dd59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25d815a3b0 0x7f25d815a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:48.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.560+0000 7f25dd59d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f25d80aef00 0x7f25d815d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:48.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.560+0000 7f25dd59d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f25d806e470 0x7f25d806e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:48.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.560+0000 7f25dd59d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d806ee30 con 0x7f25d80aef00 2023-10-09T08:17:48.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.560+0000 7f25dd59d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d80aea70 con 0x7f25d806e470 2023-10-09T08:17:48.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.560+0000 7f25dd59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d80ae480 con 0x7f25d815a3b0 2023-10-09T08:17:48.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.561+0000 7f25d77fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f25d80aef00 0x7f25d815d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:48.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.561+0000 7f25d77fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f25d80aef00 0x7f25d815d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37044/0 (socket says 172.21.15.71:37044) 2023-10-09T08:17:48.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.561+0000 7f25dcd9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f25d806e470 0x7f25d806e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:48.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.561+0000 7f25d77fe700 1 -- 172.21.15.71:0/3122294870 learned_addr learned my addr 172.21.15.71:0/3122294870 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:48.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.561+0000 7f25d7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25d815a3b0 0x7f25d815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:48.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.561+0000 7f25d77fe700 1 -- 172.21.15.71:0/3122294870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25d815a3b0 msgr2=0x7f25d815a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:48.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.561+0000 7f25d77fe700 1 --2- 172.21.15.71:0/3122294870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25d815a3b0 0x7f25d815a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.561+0000 7f25d77fe700 1 -- 172.21.15.71:0/3122294870 >> v2:172.21.15.179:3300/0 conn(0x7f25d806e470 msgr2=0x7f25d806e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:48.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.561+0000 7f25d77fe700 1 --2- 172.21.15.71:0/3122294870 >> v2:172.21.15.179:3300/0 conn(0x7f25d806e470 0x7f25d806e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.561+0000 7f25d77fe700 1 -- 172.21.15.71:0/3122294870 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d815acc0 con 0x7f25d80aef00 2023-10-09T08:17:48.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.561+0000 7f25d77fe700 1 --2- 172.21.15.71:0/3122294870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25d80aef00 0x7f25d815d3c0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f25d80c9470 tx=0x7f25cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fac6aa9e26c3548 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:48.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.562+0000 7f25d6ffd700 1 -- 172.21.15.71:0/3122294870 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc00b640 con 0x7f25d80aef00 2023-10-09T08:17:48.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.562+0000 7f25d6ffd700 1 -- 172.21.15.71:0/3122294870 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25cc00b7a0 con 0x7f25d80aef00 2023-10-09T08:17:48.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.562+0000 7f25d6ffd700 1 -- 172.21.15.71:0/3122294870 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc00bb60 con 0x7f25d80aef00 2023-10-09T08:17:48.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.562+0000 7f25dd59d700 1 -- 172.21.15.71:0/3122294870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25d80aef00 msgr2=0x7f25d815d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:48.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.562+0000 7f25dd59d700 1 --2- 172.21.15.71:0/3122294870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25d80aef00 0x7f25d815d3c0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f25d80c9470 tx=0x7f25cc009250 comp rx=0 tx=0).stop 2023-10-09T08:17:48.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.562+0000 7f25dd59d700 1 -- 172.21.15.71:0/3122294870 shutdown_connections 2023-10-09T08:17:48.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.562+0000 7f25dd59d700 1 --2- 172.21.15.71:0/3122294870 >> v2:172.21.15.179:3300/0 conn(0x7f25d806e470 0x7f25d806e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.562+0000 7f25dd59d700 1 --2- 172.21.15.71:0/3122294870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25d815a3b0 0x7f25d815a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.562+0000 7f25dd59d700 1 --2- 172.21.15.71:0/3122294870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25d80aef00 0x7f25d815d3c0 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.562+0000 7f25dd59d700 1 -- 172.21.15.71:0/3122294870 >> 172.21.15.71:0/3122294870 conn(0x7f25d80c9f70 msgr2=0x7f25d806dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:48.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.563+0000 7f25dd59d700 1 -- 172.21.15.71:0/3122294870 shutdown_connections 2023-10-09T08:17:48.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.563+0000 7f25dd59d700 1 -- 172.21.15.71:0/3122294870 wait complete. 2023-10-09T08:17:48.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.564+0000 7f25dd59d700 1 Processor -- start 2023-10-09T08:17:48.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.564+0000 7f25dd59d700 1 -- start start 2023-10-09T08:17:48.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.565+0000 7f25dd59d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25d806e470 0x7f25d8151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:48.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.565+0000 7f25dd59d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25d80aef00 0x7f25d81592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:48.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.565+0000 7f25dd59d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25d815a3b0 0x7f25d80cba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:48.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.565+0000 7f25dd59d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d816aac0 con 0x7f25d806e470 2023-10-09T08:17:48.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.565+0000 7f25dd59d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d8152530 con 0x7f25d80aef00 2023-10-09T08:17:48.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.565+0000 7f25dd59d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d8169eb0 con 0x7f25d815a3b0 2023-10-09T08:17:48.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.565+0000 7f25d7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25d806e470 0x7f25d8151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:48.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.565+0000 7f25d7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25d806e470 0x7f25d8151ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37048/0 (socket says 172.21.15.71:37048) 2023-10-09T08:17:48.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.565+0000 7f25d7fff700 1 -- 172.21.15.71:0/1933099401 learned_addr learned my addr 172.21.15.71:0/1933099401 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:48.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.565+0000 7f25d77fe700 1 --2- 172.21.15.71:0/1933099401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25d80aef00 0x7f25d81592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:48.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.565+0000 7f25dcd9c700 1 --2- 172.21.15.71:0/1933099401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25d815a3b0 0x7f25d80cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:48.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.566+0000 7f25d7fff700 1 -- 172.21.15.71:0/1933099401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25d815a3b0 msgr2=0x7f25d80cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:48.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.566+0000 7f25d7fff700 1 --2- 172.21.15.71:0/1933099401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25d815a3b0 0x7f25d80cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.566+0000 7f25d7fff700 1 -- 172.21.15.71:0/1933099401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25d80aef00 msgr2=0x7f25d81592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:48.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.566+0000 7f25d7fff700 1 --2- 172.21.15.71:0/1933099401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25d80aef00 0x7f25d81592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.566+0000 7f25d7fff700 1 -- 172.21.15.71:0/1933099401 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc0094f0 con 0x7f25d806e470 2023-10-09T08:17:48.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.566+0000 7f25d7fff700 1 --2- 172.21.15.71:0/1933099401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25d806e470 0x7f25d8151ff0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f25c800e950 tx=0x7f25c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:48.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.566+0000 7f25bffff700 1 -- 172.21.15.71:0/1933099401 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8013680 con 0x7f25d806e470 2023-10-09T08:17:48.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.566+0000 7f25bffff700 1 -- 172.21.15.71:0/1933099401 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c80137e0 con 0x7f25d806e470 2023-10-09T08:17:48.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.566+0000 7f25bffff700 1 -- 172.21.15.71:0/1933099401 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8013ba0 con 0x7f25d806e470 2023-10-09T08:17:48.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.566+0000 7f25dd59d700 1 -- 172.21.15.71:0/1933099401 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d816a190 con 0x7f25d806e470 2023-10-09T08:17:48.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.566+0000 7f25dd59d700 1 -- 172.21.15.71:0/1933099401 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d816a750 con 0x7f25d806e470 2023-10-09T08:17:48.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.567+0000 7f25dd59d700 1 -- 172.21.15.71:0/1933099401 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d806cfa0 con 0x7f25d806e470 2023-10-09T08:17:48.571 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:48.569+0000 7fb5b9869180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T08:17:48.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.568+0000 7f25bffff700 1 -- 172.21.15.71:0/1933099401 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 106) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f25c80123d0 con 0x7f25d806e470 2023-10-09T08:17:48.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.570+0000 7f25bffff700 1 --2- 172.21.15.71:0/1933099401 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f25c40670e0 0x7f25c4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:48.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.570+0000 7f25bffff700 1 -- 172.21.15.71:0/1933099401 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f25c8084d00 con 0x7f25d806e470 2023-10-09T08:17:48.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.570+0000 7f25d77fe700 1 -- 172.21.15.71:0/1933099401 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f25c40670e0 msgr2=0x7f25c4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:48.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.570+0000 7f25d77fe700 1 --2- 172.21.15.71:0/1933099401 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f25c40670e0 0x7f25c4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:48.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.574+0000 7f25bffff700 1 -- 172.21.15.71:0/1933099401 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25c8051940 con 0x7f25d806e470 2023-10-09T08:17:48.636 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:48.635+0000 7f5c5476a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T08:17:48.655 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:48.655+0000 7fb5b9869180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T08:17:48.724 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:48.723+0000 7f5c5476a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T08:17:48.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.771+0000 7f25dd59d700 1 -- 172.21.15.71:0/1933099401 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f25d815dd30 con 0x7f25d806e470 2023-10-09T08:17:48.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.771+0000 7f25d77fe700 1 -- 172.21.15.71:0/1933099401 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f25c40670e0 msgr2=0x7f25c4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:48.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.771+0000 7f25d77fe700 1 --2- 172.21.15.71:0/1933099401 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f25c40670e0 0x7f25c4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:48.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.771+0000 7f25bffff700 1 -- 172.21.15.71:0/1933099401 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v211) v1 ==== 93+0+10 (secure 0 0 0) 0x7f25c80170a0 con 0x7f25d806e470 2023-10-09T08:17:48.773 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-09T08:17:48.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.773+0000 7f25dd59d700 1 -- 172.21.15.71:0/1933099401 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f25c40670e0 msgr2=0x7f25c4069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:48.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.773+0000 7f25dd59d700 1 --2- 172.21.15.71:0/1933099401 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f25c40670e0 0x7f25c4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.773+0000 7f25dd59d700 1 -- 172.21.15.71:0/1933099401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25d806e470 msgr2=0x7f25d8151ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:48.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.773+0000 7f25dd59d700 1 --2- 172.21.15.71:0/1933099401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25d806e470 0x7f25d8151ff0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f25c800e950 tx=0x7f25c80091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.774+0000 7f25dd59d700 1 -- 172.21.15.71:0/1933099401 shutdown_connections 2023-10-09T08:17:48.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.774+0000 7f25dd59d700 1 --2- 172.21.15.71:0/1933099401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25d815a3b0 0x7f25d80cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.774+0000 7f25dd59d700 1 --2- 172.21.15.71:0/1933099401 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f25c40670e0 0x7f25c4069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.774+0000 7f25dd59d700 1 --2- 172.21.15.71:0/1933099401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25d806e470 0x7f25d8151ff0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.774+0000 7f25dd59d700 1 --2- 172.21.15.71:0/1933099401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25d80aef00 0x7f25d81592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.774+0000 7f25dd59d700 1 -- 172.21.15.71:0/1933099401 >> 172.21.15.71:0/1933099401 conn(0x7f25d80c9f70 msgr2=0x7f25d81535f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:48.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.774+0000 7f25dd59d700 1 -- 172.21.15.71:0/1933099401 shutdown_connections 2023-10-09T08:17:48.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.774+0000 7f25dd59d700 1 -- 172.21.15.71:0/1933099401 wait complete. 2023-10-09T08:17:48.794 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T08:17:48.878 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:48.877+0000 7fb5b9869180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T08:17:48.957 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:48.956+0000 7f5c5476a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T08:17:48.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.981+0000 7f3dced9d700 1 Processor -- start 2023-10-09T08:17:48.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.981+0000 7f3dced9d700 1 -- start start 2023-10-09T08:17:48.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.982+0000 7f3dced9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3dc8159a60 0x7f3dc80c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:48.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.982+0000 7f3dced9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dc80cb230 0x7f3dc80cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:48.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.982+0000 7f3dced9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc80c9cb0 con 0x7f3dc80ccc00 2023-10-09T08:17:48.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.982+0000 7f3dced9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc80cbbd0 con 0x7f3dc8159a60 2023-10-09T08:17:48.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.982+0000 7f3dced9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc806dfc0 con 0x7f3dc80cb230 2023-10-09T08:17:48.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.982+0000 7f3dce59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dc80cb230 0x7f3dc80cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:48.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.982+0000 7f3dcdd9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3dc8159a60 0x7f3dc80c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:48.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.983+0000 7f3dce59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dc80cb230 0x7f3dc80cb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:54058/0 (socket says 172.21.15.71:54058) 2023-10-09T08:17:48.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.983+0000 7f3dce59c700 1 -- 172.21.15.71:0/3648958208 learned_addr learned my addr 172.21.15.71:0/3648958208 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:48.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.983+0000 7f3dcdd9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3dc8159a60 0x7f3dc80c9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:53928/0 (socket says 172.21.15.71:53928) 2023-10-09T08:17:48.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.983+0000 7f3dce59c700 1 -- 172.21.15.71:0/3648958208 >> v2:172.21.15.179:3300/0 conn(0x7f3dc8159a60 msgr2=0x7f3dc80c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:48.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.983+0000 7f3dce59c700 1 --2- 172.21.15.71:0/3648958208 >> v2:172.21.15.179:3300/0 conn(0x7f3dc8159a60 0x7f3dc80c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.983+0000 7f3dce59c700 1 -- 172.21.15.71:0/3648958208 >> v1:172.21.15.179:6789/0 conn(0x7f3dc80ccc00 legacy=0x7f3dc8069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:48.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.983+0000 7f3dce59c700 1 -- 172.21.15.71:0/3648958208 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc80c9f30 con 0x7f3dc80cb230 2023-10-09T08:17:48.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.983+0000 7f3dcdd9b700 1 --2- 172.21.15.71:0/3648958208 >> v2:172.21.15.179:3300/0 conn(0x7f3dc8159a60 0x7f3dc80c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:48.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.983+0000 7f3dce59c700 1 --2- 172.21.15.71:0/3648958208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dc80cb230 0x7f3dc80cb690 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009f20 tx=0x7f3dc0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54913082bdcc6c36 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:48.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.984+0000 7f3dccd99700 1 -- 172.21.15.71:0/3648958208 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc000e070 con 0x7f3dc80cb230 2023-10-09T08:17:48.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.984+0000 7f3dccd99700 1 -- 172.21.15.71:0/3648958208 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc000ba60 con 0x7f3dc80cb230 2023-10-09T08:17:48.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.984+0000 7f3dccd99700 1 -- 172.21.15.71:0/3648958208 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc00092e0 con 0x7f3dc80cb230 2023-10-09T08:17:48.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.984+0000 7f3dced9d700 1 -- 172.21.15.71:0/3648958208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dc80cb230 msgr2=0x7f3dc80cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:48.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.984+0000 7f3dced9d700 1 --2- 172.21.15.71:0/3648958208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dc80cb230 0x7f3dc80cb690 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009f20 tx=0x7f3dc0009840 comp rx=0 tx=0).stop 2023-10-09T08:17:48.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.984+0000 7f3dced9d700 1 -- 172.21.15.71:0/3648958208 shutdown_connections 2023-10-09T08:17:48.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.984+0000 7f3dced9d700 1 --2- 172.21.15.71:0/3648958208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dc80cb230 0x7f3dc80cb690 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.984+0000 7f3dced9d700 1 --2- 172.21.15.71:0/3648958208 >> v2:172.21.15.179:3300/0 conn(0x7f3dc8159a60 0x7f3dc80c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.984+0000 7f3dced9d700 1 -- 172.21.15.71:0/3648958208 >> 172.21.15.71:0/3648958208 conn(0x7f3dc806baa0 msgr2=0x7f3dc806bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:48.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.984+0000 7f3dced9d700 1 -- 172.21.15.71:0/3648958208 shutdown_connections 2023-10-09T08:17:48.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.984+0000 7f3dced9d700 1 -- 172.21.15.71:0/3648958208 wait complete. 2023-10-09T08:17:48.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.986+0000 7f3dced9d700 1 Processor -- start 2023-10-09T08:17:48.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.986+0000 7f3dced9d700 1 -- start start 2023-10-09T08:17:48.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.987+0000 7f3dced9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dc80cb230 0x7f3dc81511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:48.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.987+0000 7f3dced9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dc80ccc00 0x7f3dc8069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:48.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.987+0000 7f3dced9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3dc8159a60 0x7f3dc80b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:48.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.987+0000 7f3dced9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc8151720 con 0x7f3dc8159a60 2023-10-09T08:17:48.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.987+0000 7f3dced9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc806a530 con 0x7f3dc80ccc00 2023-10-09T08:17:48.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.987+0000 7f3dced9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc806a810 con 0x7f3dc80cb230 2023-10-09T08:17:48.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.987+0000 7f3dce59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3dc8159a60 0x7f3dc80b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:48.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.987+0000 7f3dce59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3dc8159a60 0x7f3dc80b2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37064/0 (socket says 172.21.15.71:37064) 2023-10-09T08:17:48.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.987+0000 7f3dce59c700 1 -- 172.21.15.71:0/825371944 learned_addr learned my addr 172.21.15.71:0/825371944 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:48.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.987+0000 7f3dcdd9b700 1 --2- 172.21.15.71:0/825371944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dc80cb230 0x7f3dc81511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:48.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.987+0000 7f3dcd59a700 1 --2- 172.21.15.71:0/825371944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dc80ccc00 0x7f3dc8069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:48.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.988+0000 7f3dce59c700 1 -- 172.21.15.71:0/825371944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dc80cb230 msgr2=0x7f3dc81511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:48.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.988+0000 7f3dce59c700 1 --2- 172.21.15.71:0/825371944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dc80cb230 0x7f3dc81511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.988+0000 7f3dce59c700 1 -- 172.21.15.71:0/825371944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dc80ccc00 msgr2=0x7f3dc8069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:48.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.988+0000 7f3dce59c700 1 --2- 172.21.15.71:0/825371944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dc80ccc00 0x7f3dc8069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:48.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.988+0000 7f3dce59c700 1 -- 172.21.15.71:0/825371944 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc4009420 con 0x7f3dc8159a60 2023-10-09T08:17:48.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.988+0000 7f3dce59c700 1 --2- 172.21.15.71:0/825371944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3dc8159a60 0x7f3dc80b2a20 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000b610 tx=0x7f3dc0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:48.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.988+0000 7f3dbdffb700 1 -- 172.21.15.71:0/825371944 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc00032f0 con 0x7f3dc8159a60 2023-10-09T08:17:48.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.988+0000 7f3dbdffb700 1 -- 172.21.15.71:0/825371944 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc0008d90 con 0x7f3dc8159a60 2023-10-09T08:17:48.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.988+0000 7f3dced9d700 1 -- 172.21.15.71:0/825371944 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc0009ae0 con 0x7f3dc8159a60 2023-10-09T08:17:48.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.988+0000 7f3dbdffb700 1 -- 172.21.15.71:0/825371944 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc00266b0 con 0x7f3dc8159a60 2023-10-09T08:17:48.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.988+0000 7f3dced9d700 1 -- 172.21.15.71:0/825371944 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc806add0 con 0x7f3dc8159a60 2023-10-09T08:17:48.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.989+0000 7f3dced9d700 1 -- 172.21.15.71:0/825371944 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc806eba0 con 0x7f3dc8159a60 2023-10-09T08:17:48.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.990+0000 7f3dbdffb700 1 -- 172.21.15.71:0/825371944 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 106) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f3dc0003040 con 0x7f3dc8159a60 2023-10-09T08:17:48.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.991+0000 7f3dbdffb700 1 --2- 172.21.15.71:0/825371944 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3dac0670e0 0x7f3dac069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:48.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.991+0000 7f3dbdffb700 1 -- 172.21.15.71:0/825371944 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f3dc0086920 con 0x7f3dc8159a60 2023-10-09T08:17:48.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.991+0000 7f3dcdd9b700 1 -- 172.21.15.71:0/825371944 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3dac0670e0 msgr2=0x7f3dac069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:48.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.991+0000 7f3dcdd9b700 1 --2- 172.21.15.71:0/825371944 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3dac0670e0 0x7f3dac069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:48.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:48.995+0000 7f3dbdffb700 1 -- 172.21.15.71:0/825371944 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3dc0053500 con 0x7f3dc8159a60 2023-10-09T08:17:49.054 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:49.054+0000 7fb5b9869180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T08:17:49.142 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:49.141+0000 7f5c5476a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T08:17:49.145 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:49.145+0000 7fb5b9869180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T08:17:49.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.190+0000 7f3dced9d700 1 -- 172.21.15.71:0/825371944 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3dc80ca470 con 0x7f3dc8159a60 2023-10-09T08:17:49.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.190+0000 7f3dbdffb700 1 -- 172.21.15.71:0/825371944 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v211) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3dc0056b20 con 0x7f3dc8159a60 2023-10-09T08:17:49.191 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-09T08:17:49.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.192+0000 7f3dcdd9b700 1 -- 172.21.15.71:0/825371944 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3dac0670e0 msgr2=0x7f3dac069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:49.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.192+0000 7f3dcdd9b700 1 --2- 172.21.15.71:0/825371944 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3dac0670e0 0x7f3dac069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:49.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.193+0000 7f3dced9d700 1 -- 172.21.15.71:0/825371944 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3dac0670e0 msgr2=0x7f3dac069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:49.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.193+0000 7f3dced9d700 1 --2- 172.21.15.71:0/825371944 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3dac0670e0 0x7f3dac069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:49.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.193+0000 7f3dced9d700 1 -- 172.21.15.71:0/825371944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3dc8159a60 msgr2=0x7f3dc80b2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:49.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.193+0000 7f3dced9d700 1 --2- 172.21.15.71:0/825371944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3dc8159a60 0x7f3dc80b2a20 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000b610 tx=0x7f3dc0018000 comp rx=0 tx=0).stop 2023-10-09T08:17:49.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.193+0000 7f3dced9d700 1 -- 172.21.15.71:0/825371944 shutdown_connections 2023-10-09T08:17:49.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.193+0000 7f3dced9d700 1 --2- 172.21.15.71:0/825371944 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3dac0670e0 0x7f3dac069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:49.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.193+0000 7f3dced9d700 1 --2- 172.21.15.71:0/825371944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3dc8159a60 0x7f3dc80b2a20 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:49.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.193+0000 7f3dced9d700 1 --2- 172.21.15.71:0/825371944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dc80cb230 0x7f3dc81511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:49.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.193+0000 7f3dced9d700 1 --2- 172.21.15.71:0/825371944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dc80ccc00 0x7f3dc8069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:49.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.193+0000 7f3dced9d700 1 -- 172.21.15.71:0/825371944 >> 172.21.15.71:0/825371944 conn(0x7f3dc806baa0 msgr2=0x7f3dc8154030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:49.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.193+0000 7f3dced9d700 1 -- 172.21.15.71:0/825371944 shutdown_connections 2023-10-09T08:17:49.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.193+0000 7f3dced9d700 1 -- 172.21.15.71:0/825371944 wait complete. 2023-10-09T08:17:49.213 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T08:17:49.239 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:49.238+0000 7f5c5476a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T08:17:49.306 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:49.306+0000 7fb5b9869180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T08:17:49.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.402+0000 7f5924d9d700 1 Processor -- start 2023-10-09T08:17:49.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.402+0000 7f5924d9d700 1 -- start start 2023-10-09T08:17:49.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.403+0000 7f5924d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f59200b1b40 0x7f59200b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:49.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.403+0000 7f5924d9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59200cfb00 con 0x7f59200b16d0 2023-10-09T08:17:49.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.403+0000 7f5924d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59200b5c40 con 0x7f59200b4e70 2023-10-09T08:17:49.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.403+0000 7f5924d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59200b5f20 con 0x7f59200b1b40 2023-10-09T08:17:49.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.403+0000 7f591effd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f59200b16d0 0x7f59200b33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48452/0 (socket says 172.21.15.71:48452) 2023-10-09T08:17:49.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.403+0000 7f591effd700 1 -- 172.21.15.71:0/1736449181 learned_addr learned my addr 172.21.15.71:0/1736449181 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:49.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.403+0000 7f591ffff700 1 --2- 172.21.15.71:0/1736449181 >> v2:172.21.15.179:3300/0 conn(0x7f59200b1b40 0x7f59200b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:49.405 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:49.405+0000 7fb5b9869180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T08:17:49.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.404+0000 7f591e7fc700 1 -- 172.21.15.71:0/1736449181 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835173459 0 0) 0x7f59200cfb00 con 0x7f59200b16d0 2023-10-09T08:17:49.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.404+0000 7f591e7fc700 1 -- 172.21.15.71:0/1736449181 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5908003570 con 0x7f59200b16d0 2023-10-09T08:17:49.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.404+0000 7f591e7fc700 1 -- 172.21.15.71:0/1736449181 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875049679 0 0) 0x7f59200b5c40 con 0x7f59200b4e70 2023-10-09T08:17:49.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.404+0000 7f591e7fc700 1 -- 172.21.15.71:0/1736449181 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59200cfb00 con 0x7f59200b4e70 2023-10-09T08:17:49.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.404+0000 7f591ffff700 1 -- 172.21.15.71:0/1736449181 >> v1:172.21.15.179:6789/0 conn(0x7f59200b4e70 legacy=0x7f59200ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:49.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.404+0000 7f591ffff700 1 -- 172.21.15.71:0/1736449181 >> v1:172.21.15.71:6789/0 conn(0x7f59200b16d0 legacy=0x7f59200b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:49.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.404+0000 7f591ffff700 1 -- 172.21.15.71:0/1736449181 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59200b6200 con 0x7f59200b1b40 2023-10-09T08:17:49.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.404+0000 7f591ffff700 1 --2- 172.21.15.71:0/1736449181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59200b1b40 0x7f59200b3ac0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5918009e60 tx=0x7f5918009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d0f76da304b3ea8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:49.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.404+0000 7f591e7fc700 1 -- 172.21.15.71:0/1736449181 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591800e070 con 0x7f59200b1b40 2023-10-09T08:17:49.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.405+0000 7f591e7fc700 1 -- 172.21.15.71:0/1736449181 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591800bab0 con 0x7f59200b1b40 2023-10-09T08:17:49.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.405+0000 7f591e7fc700 1 -- 172.21.15.71:0/1736449181 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591800be50 con 0x7f59200b1b40 2023-10-09T08:17:49.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.405+0000 7f5924d9d700 1 -- 172.21.15.71:0/1736449181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59200b1b40 msgr2=0x7f59200b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:49.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.405+0000 7f5924d9d700 1 --2- 172.21.15.71:0/1736449181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59200b1b40 0x7f59200b3ac0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5918009e60 tx=0x7f5918009780 comp rx=0 tx=0).stop 2023-10-09T08:17:49.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.405+0000 7f5924d9d700 1 -- 172.21.15.71:0/1736449181 shutdown_connections 2023-10-09T08:17:49.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.405+0000 7f5924d9d700 1 --2- 172.21.15.71:0/1736449181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59200b1b40 0x7f59200b3ac0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:49.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.405+0000 7f5924d9d700 1 -- 172.21.15.71:0/1736449181 >> 172.21.15.71:0/1736449181 conn(0x7f59200d10c0 msgr2=0x7f59200affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:49.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.405+0000 7f5924d9d700 1 -- 172.21.15.71:0/1736449181 shutdown_connections 2023-10-09T08:17:49.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.405+0000 7f5924d9d700 1 -- 172.21.15.71:0/1736449181 wait complete. 2023-10-09T08:17:49.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.407+0000 7f5924d9d700 1 Processor -- start 2023-10-09T08:17:49.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.407+0000 7f5924d9d700 1 -- start start 2023-10-09T08:17:49.409 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:49.407+0000 7f5c5476a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T08:17:49.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.408+0000 7f5924d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59200b16d0 0x7f59200cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:49.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.408+0000 7f5924d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59200b1b40 0x7f59200b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:49.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.408+0000 7f5924d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59200b4e70 0x7f59200b5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:49.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.408+0000 7f5924d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59200c87c0 con 0x7f59200b16d0 2023-10-09T08:17:49.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.408+0000 7f5924d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59200c7bb0 con 0x7f59200b4e70 2023-10-09T08:17:49.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.408+0000 7f5924d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59200c7e90 con 0x7f59200b1b40 2023-10-09T08:17:49.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.408+0000 7f591f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59200b16d0 0x7f59200cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:49.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.408+0000 7f591f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59200b16d0 0x7f59200cba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37078/0 (socket says 172.21.15.71:37078) 2023-10-09T08:17:49.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.408+0000 7f591f7fe700 1 -- 172.21.15.71:0/2280493174 learned_addr learned my addr 172.21.15.71:0/2280493174 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:49.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.408+0000 7f591effd700 1 --2- 172.21.15.71:0/2280493174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59200b1b40 0x7f59200b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:49.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.408+0000 7f591ffff700 1 --2- 172.21.15.71:0/2280493174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59200b4e70 0x7f59200b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:49.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.408+0000 7f591f7fe700 1 -- 172.21.15.71:0/2280493174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59200b1b40 msgr2=0x7f59200b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:49.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.408+0000 7f591f7fe700 1 --2- 172.21.15.71:0/2280493174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59200b1b40 0x7f59200b5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:49.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.408+0000 7f591f7fe700 1 -- 172.21.15.71:0/2280493174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59200b4e70 msgr2=0x7f59200b5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:49.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.408+0000 7f591f7fe700 1 --2- 172.21.15.71:0/2280493174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59200b4e70 0x7f59200b5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:49.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.408+0000 7f591f7fe700 1 -- 172.21.15.71:0/2280493174 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5918009a20 con 0x7f59200b16d0 2023-10-09T08:17:49.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.408+0000 7f591effd700 1 --2- 172.21.15.71:0/2280493174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59200b1b40 0x7f59200b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:17:49.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.409+0000 7f591f7fe700 1 --2- 172.21.15.71:0/2280493174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59200b16d0 0x7f59200cba20 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f591000c580 tx=0x7f5910007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:49.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.409+0000 7f59077fe700 1 -- 172.21.15.71:0/2280493174 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5910010510 con 0x7f59200b16d0 2023-10-09T08:17:49.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.409+0000 7f59077fe700 1 -- 172.21.15.71:0/2280493174 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5910010670 con 0x7f59200b16d0 2023-10-09T08:17:49.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.409+0000 7f5924d9d700 1 -- 172.21.15.71:0/2280493174 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59200c8170 con 0x7f59200b16d0 2023-10-09T08:17:49.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.409+0000 7f59077fe700 1 -- 172.21.15.71:0/2280493174 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5910010a30 con 0x7f59200b16d0 2023-10-09T08:17:49.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.409+0000 7f5924d9d700 1 -- 172.21.15.71:0/2280493174 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5920069db0 con 0x7f59200b16d0 2023-10-09T08:17:49.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.410+0000 7f5924d9d700 1 -- 172.21.15.71:0/2280493174 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59200c7900 con 0x7f59200b16d0 2023-10-09T08:17:49.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.411+0000 7f59077fe700 1 -- 172.21.15.71:0/2280493174 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 106) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f591001b400 con 0x7f59200b16d0 2023-10-09T08:17:49.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.412+0000 7f59077fe700 1 --2- 172.21.15.71:0/2280493174 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f590c0670e0 0x7f590c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:49.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.413+0000 7f59077fe700 1 -- 172.21.15.71:0/2280493174 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f5910084700 con 0x7f59200b16d0 2023-10-09T08:17:49.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.413+0000 7f591effd700 1 -- 172.21.15.71:0/2280493174 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f590c0670e0 msgr2=0x7f590c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:49.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.413+0000 7f591effd700 1 --2- 172.21.15.71:0/2280493174 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f590c0670e0 0x7f590c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:49.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.416+0000 7f59077fe700 1 -- 172.21.15.71:0/2280493174 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5910051340 con 0x7f59200b16d0 2023-10-09T08:17:49.515 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:49.514+0000 7f5c5476a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T08:17:49.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.614+0000 7f591effd700 1 -- 172.21.15.71:0/2280493174 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f590c0670e0 msgr2=0x7f590c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:49.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.614+0000 7f591effd700 1 --2- 172.21.15.71:0/2280493174 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f590c0670e0 0x7f590c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:49.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.616+0000 7f5924d9d700 1 -- 172.21.15.71:0/2280493174 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f592004bb80 con 0x7f59200b16d0 2023-10-09T08:17:49.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.616+0000 7f59077fe700 1 -- 172.21.15.71:0/2280493174 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v211) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5910054960 con 0x7f59200b16d0 2023-10-09T08:17:49.617 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-09T08:17:49.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.618+0000 7f5924d9d700 1 -- 172.21.15.71:0/2280493174 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f590c0670e0 msgr2=0x7f590c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:49.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.618+0000 7f5924d9d700 1 --2- 172.21.15.71:0/2280493174 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f590c0670e0 0x7f590c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:49.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.618+0000 7f5924d9d700 1 -- 172.21.15.71:0/2280493174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59200b16d0 msgr2=0x7f59200cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:49.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.618+0000 7f5924d9d700 1 --2- 172.21.15.71:0/2280493174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59200b16d0 0x7f59200cba20 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f591000c580 tx=0x7f5910007e10 comp rx=0 tx=0).stop 2023-10-09T08:17:49.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.619+0000 7f5924d9d700 1 -- 172.21.15.71:0/2280493174 shutdown_connections 2023-10-09T08:17:49.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.619+0000 7f5924d9d700 1 --2- 172.21.15.71:0/2280493174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59200b4e70 0x7f59200b5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:49.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.619+0000 7f5924d9d700 1 --2- 172.21.15.71:0/2280493174 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f590c0670e0 0x7f590c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:49.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.619+0000 7f5924d9d700 1 --2- 172.21.15.71:0/2280493174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59200b16d0 0x7f59200cba20 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:49.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.619+0000 7f5924d9d700 1 --2- 172.21.15.71:0/2280493174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59200b1b40 0x7f59200b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:49.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.619+0000 7f5924d9d700 1 -- 172.21.15.71:0/2280493174 >> 172.21.15.71:0/2280493174 conn(0x7f59200d10c0 msgr2=0x7f59200ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:49.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.619+0000 7f5924d9d700 1 -- 172.21.15.71:0/2280493174 shutdown_connections 2023-10-09T08:17:49.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.619+0000 7f5924d9d700 1 -- 172.21.15.71:0/2280493174 wait complete. 2023-10-09T08:17:49.638 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T08:17:49.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.865+0000 7f736359d700 1 Processor -- start 2023-10-09T08:17:49.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.866+0000 7f736359d700 1 -- start start 2023-10-09T08:17:49.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.867+0000 7f736359d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f735c1597f0 0x7f735c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:49.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.867+0000 7f736359d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f735c15d230 0x7f735c15d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:49.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.867+0000 7f736359d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f735c15db70 con 0x7f735c159420 2023-10-09T08:17:49.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.867+0000 7f736359d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f735c0b11d0 con 0x7f735c15d230 2023-10-09T08:17:49.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.867+0000 7f736359d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f735c0b14b0 con 0x7f735c1597f0 2023-10-09T08:17:49.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.867+0000 7f7362d9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f735c15d230 0x7f735c15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:49.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.867+0000 7f7361d9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f735c1597f0 0x7f735c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:49.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.867+0000 7f7361d9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f735c1597f0 0x7f735c0b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:53962/0 (socket says 172.21.15.71:53962) 2023-10-09T08:17:49.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.868+0000 7f7361d9a700 1 -- 172.21.15.71:0/71553345 learned_addr learned my addr 172.21.15.71:0/71553345 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:49.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.868+0000 7f7361d9a700 1 -- 172.21.15.71:0/71553345 >> v2:172.21.15.71:3300/0 conn(0x7f735c15d230 msgr2=0x7f735c15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:49.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.868+0000 7f7361d9a700 1 --2- 172.21.15.71:0/71553345 >> v2:172.21.15.71:3300/0 conn(0x7f735c15d230 0x7f735c15d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:49.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.868+0000 7f7361d9a700 1 -- 172.21.15.71:0/71553345 >> v1:172.21.15.179:6789/0 conn(0x7f735c159420 legacy=0x7f735c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:49.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.868+0000 7f7361d9a700 1 -- 172.21.15.71:0/71553345 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735c0b1790 con 0x7f735c1597f0 2023-10-09T08:17:49.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.868+0000 7f7362d9c700 1 --2- 172.21.15.71:0/71553345 >> v2:172.21.15.71:3300/0 conn(0x7f735c15d230 0x7f735c15d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:49.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.868+0000 7f7361599700 1 -- 172.21.15.71:0/71553345 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4290370848 0 0) 0x7f735c15db70 con 0x7f735c159420 2023-10-09T08:17:49.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.868+0000 7f7361d9a700 1 --2- 172.21.15.71:0/71553345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f735c1597f0 0x7f735c0b2270 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f735c089750 tx=0x7f734c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34e21b337d47f0ee server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:49.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.868+0000 7f7361599700 1 -- 172.21.15.71:0/71553345 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c009e70 con 0x7f735c1597f0 2023-10-09T08:17:49.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.869+0000 7f7361599700 1 -- 172.21.15.71:0/71553345 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734c00b860 con 0x7f735c1597f0 2023-10-09T08:17:49.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.869+0000 7f7361599700 1 -- 172.21.15.71:0/71553345 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c00bc00 con 0x7f735c1597f0 2023-10-09T08:17:49.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.869+0000 7f736359d700 1 -- 172.21.15.71:0/71553345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f735c1597f0 msgr2=0x7f735c0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:49.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.869+0000 7f736359d700 1 --2- 172.21.15.71:0/71553345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f735c1597f0 0x7f735c0b2270 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f735c089750 tx=0x7f734c009250 comp rx=0 tx=0).stop 2023-10-09T08:17:49.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.869+0000 7f736359d700 1 -- 172.21.15.71:0/71553345 shutdown_connections 2023-10-09T08:17:49.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.869+0000 7f736359d700 1 --2- 172.21.15.71:0/71553345 >> v2:172.21.15.71:3300/0 conn(0x7f735c15d230 0x7f735c15d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:49.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.869+0000 7f736359d700 1 --2- 172.21.15.71:0/71553345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f735c1597f0 0x7f735c0b2270 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:49.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.869+0000 7f736359d700 1 -- 172.21.15.71:0/71553345 >> 172.21.15.71:0/71553345 conn(0x7f735c0d0660 msgr2=0x7f735c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:49.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.869+0000 7f736359d700 1 -- 172.21.15.71:0/71553345 shutdown_connections 2023-10-09T08:17:49.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.869+0000 7f736359d700 1 -- 172.21.15.71:0/71553345 wait complete. 2023-10-09T08:17:49.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.871+0000 7f736359d700 1 Processor -- start 2023-10-09T08:17:49.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.871+0000 7f736359d700 1 -- start start 2023-10-09T08:17:49.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.872+0000 7f736359d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f735c159420 0x7f735c155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:49.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.872+0000 7f736359d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f735c1597f0 0x7f735c157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:49.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.872+0000 7f736359d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f735c15d230 0x7f735c1584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:49.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.872+0000 7f736359d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c0c6540 con 0x7f735c15d230 2023-10-09T08:17:49.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.872+0000 7f736359d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c0c54a0 con 0x7f735c1597f0 2023-10-09T08:17:49.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.872+0000 7f736359d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735c0c5780 con 0x7f735c159420 2023-10-09T08:17:49.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.872+0000 7f7362d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f735c15d230 0x7f735c1584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:49.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.872+0000 7f7362d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f735c15d230 0x7f735c1584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37096/0 (socket says 172.21.15.71:37096) 2023-10-09T08:17:49.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.872+0000 7f7362d9c700 1 -- 172.21.15.71:0/3187957801 learned_addr learned my addr 172.21.15.71:0/3187957801 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:49.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.872+0000 7f7361d9a700 1 --2- 172.21.15.71:0/3187957801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f735c1597f0 0x7f735c157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:49.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.872+0000 7f736259b700 1 --2- 172.21.15.71:0/3187957801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f735c159420 0x7f735c155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:49.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.872+0000 7f7362d9c700 1 -- 172.21.15.71:0/3187957801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f735c159420 msgr2=0x7f735c155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:49.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.872+0000 7f7362d9c700 1 --2- 172.21.15.71:0/3187957801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f735c159420 0x7f735c155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:49.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.872+0000 7f7362d9c700 1 -- 172.21.15.71:0/3187957801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f735c1597f0 msgr2=0x7f735c157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:49.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.872+0000 7f7362d9c700 1 --2- 172.21.15.71:0/3187957801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f735c1597f0 0x7f735c157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:49.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.872+0000 7f7362d9c700 1 -- 172.21.15.71:0/3187957801 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7354009a20 con 0x7f735c15d230 2023-10-09T08:17:49.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.872+0000 7f7361d9a700 1 --2- 172.21.15.71:0/3187957801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f735c1597f0 0x7f735c157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:49.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.873+0000 7f7362d9c700 1 --2- 172.21.15.71:0/3187957801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f735c15d230 0x7f735c1584f0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f7354009f20 tx=0x7f735400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:49.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.873+0000 7f73527fc700 1 -- 172.21.15.71:0/3187957801 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735400cb70 con 0x7f735c15d230 2023-10-09T08:17:49.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.873+0000 7f73527fc700 1 -- 172.21.15.71:0/3187957801 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735400f040 con 0x7f735c15d230 2023-10-09T08:17:49.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.873+0000 7f736359d700 1 -- 172.21.15.71:0/3187957801 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734c0094f0 con 0x7f735c15d230 2023-10-09T08:17:49.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.873+0000 7f73527fc700 1 -- 172.21.15.71:0/3187957801 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7354014480 con 0x7f735c15d230 2023-10-09T08:17:49.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.873+0000 7f736359d700 1 -- 172.21.15.71:0/3187957801 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735c0c5d40 con 0x7f735c15d230 2023-10-09T08:17:49.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.874+0000 7f736359d700 1 -- 172.21.15.71:0/3187957801 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f735c04c3c0 con 0x7f735c15d230 2023-10-09T08:17:49.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.876+0000 7f73527fc700 1 -- 172.21.15.71:0/3187957801 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 106) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f7354003020 con 0x7f735c15d230 2023-10-09T08:17:49.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.877+0000 7f73527fc700 1 --2- 172.21.15.71:0/3187957801 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f73400670e0 0x7f7340069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:49.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.877+0000 7f73527fc700 1 -- 172.21.15.71:0/3187957801 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f73540854d0 con 0x7f735c15d230 2023-10-09T08:17:49.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.877+0000 7f736259b700 1 -- 172.21.15.71:0/3187957801 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f73400670e0 msgr2=0x7f7340069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:49.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.877+0000 7f736259b700 1 --2- 172.21.15.71:0/3187957801 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f73400670e0 0x7f7340069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:49.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:49.881+0000 7f73527fc700 1 -- 172.21.15.71:0/3187957801 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f73540520a0 con 0x7f735c15d230 2023-10-09T08:17:49.885 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:49.885+0000 7fb5b9869180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T08:17:49.980 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:49.980+0000 7fb5b9869180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T08:17:50.025 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:50.024+0000 7f5c5476a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T08:17:50.070 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:50.070+0000 7fb5b9869180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T08:17:50.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.078+0000 7f736259b700 1 -- 172.21.15.71:0/3187957801 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f73400670e0 msgr2=0x7f7340069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:50.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.078+0000 7f736259b700 1 --2- 172.21.15.71:0/3187957801 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f73400670e0 0x7f7340069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:50.120 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:50.119+0000 7f5c5476a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T08:17:50.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.121+0000 7f736359d700 1 -- 172.21.15.71:0/3187957801 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f735c0b1a70 con 0x7f735c15d230 2023-10-09T08:17:50.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.122+0000 7f73527fc700 1 -- 172.21.15.71:0/3187957801 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4608 (secure 0 0 0) 0x7f73540556c0 con 0x7f735c15d230 2023-10-09T08:17:50.123 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:50.123 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":97,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1242627383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1242627383},{"type":"v1","addr":"172.21.15.179:6836","nonce":1242627383}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":9628,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1306881721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1306881721},{"type":"v1","addr":"172.21.15.179:6834","nonce":1306881721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10143,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/717406174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":717406174},{"type":"v1","addr":"172.21.15.71:6834","nonce":717406174}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T08:17:22.432534+0000","modified":"2023-10-09T08:17:25.988311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10149":{"gid":10149,"name":"c","rank":0,"incarnation":93,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/2477293368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":2477293368},{"type":"v1","addr":"172.21.15.71:6835","nonce":2477293368}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T08:17:50.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.124+0000 7f736359d700 1 -- 172.21.15.71:0/3187957801 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f73400670e0 msgr2=0x7f7340069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:50.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.124+0000 7f736359d700 1 --2- 172.21.15.71:0/3187957801 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f73400670e0 0x7f7340069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:50.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.124+0000 7f736359d700 1 -- 172.21.15.71:0/3187957801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f735c15d230 msgr2=0x7f735c1584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:50.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.124+0000 7f736359d700 1 --2- 172.21.15.71:0/3187957801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f735c15d230 0x7f735c1584f0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f7354009f20 tx=0x7f735400b040 comp rx=0 tx=0).stop 2023-10-09T08:17:50.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.124+0000 7f736359d700 1 -- 172.21.15.71:0/3187957801 shutdown_connections 2023-10-09T08:17:50.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.124+0000 7f736359d700 1 --2- 172.21.15.71:0/3187957801 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f73400670e0 0x7f7340069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:50.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.124+0000 7f736359d700 1 --2- 172.21.15.71:0/3187957801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f735c15d230 0x7f735c1584f0 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:50.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.124+0000 7f736359d700 1 --2- 172.21.15.71:0/3187957801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f735c159420 0x7f735c155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:50.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.124+0000 7f736359d700 1 --2- 172.21.15.71:0/3187957801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f735c1597f0 0x7f735c157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:50.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.124+0000 7f736359d700 1 -- 172.21.15.71:0/3187957801 >> 172.21.15.71:0/3187957801 conn(0x7f735c0d0660 msgr2=0x7f735c1572c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:50.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.124+0000 7f736359d700 1 -- 172.21.15.71:0/3187957801 shutdown_connections 2023-10-09T08:17:50.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.124+0000 7f736359d700 1 -- 172.21.15.71:0/3187957801 wait complete. 2023-10-09T08:17:50.129 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 97 2023-10-09T08:17:50.144 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T08:17:50.221 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:50.220+0000 7f5c5476a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T08:17:50.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.331+0000 7fa5d8d9d700 1 Processor -- start 2023-10-09T08:17:50.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.331+0000 7fa5d8d9d700 1 -- start start 2023-10-09T08:17:50.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.332+0000 7fa5d8d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa5d41597f0 0x7fa5d40b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:50.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.332+0000 7fa5d8d9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d40b11d0 con 0x7fa5d4159420 2023-10-09T08:17:50.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.332+0000 7fa5d8d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d40b14b0 con 0x7fa5d415d230 2023-10-09T08:17:50.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.332+0000 7fa5d8d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d40b1790 con 0x7fa5d41597f0 2023-10-09T08:17:50.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.332+0000 7fa5d37fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa5d4159420 0x7fa5d40b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48468/0 (socket says 172.21.15.71:48468) 2023-10-09T08:17:50.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.332+0000 7fa5d37fe700 1 -- 172.21.15.71:0/2703762934 learned_addr learned my addr 172.21.15.71:0/2703762934 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:50.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.333+0000 7fa5d2ffd700 1 --2- 172.21.15.71:0/2703762934 >> v2:172.21.15.179:3300/0 conn(0x7fa5d41597f0 0x7fa5d40b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:50.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.333+0000 7fa5d27fc700 1 -- 172.21.15.71:0/2703762934 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833511088 0 0) 0x7fa5d40b11d0 con 0x7fa5d4159420 2023-10-09T08:17:50.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.333+0000 7fa5d27fc700 1 -- 172.21.15.71:0/2703762934 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5bc003570 con 0x7fa5d4159420 2023-10-09T08:17:50.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.333+0000 7fa5d27fc700 1 -- 172.21.15.71:0/2703762934 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2114552639 0 0) 0x7fa5d40b14b0 con 0x7fa5d415d230 2023-10-09T08:17:50.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.333+0000 7fa5d27fc700 1 -- 172.21.15.71:0/2703762934 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5d40b11d0 con 0x7fa5d415d230 2023-10-09T08:17:50.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.333+0000 7fa5d2ffd700 1 -- 172.21.15.71:0/2703762934 >> v1:172.21.15.179:6789/0 conn(0x7fa5d415d230 legacy=0x7fa5d415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:50.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.333+0000 7fa5d2ffd700 1 -- 172.21.15.71:0/2703762934 >> v1:172.21.15.71:6789/0 conn(0x7fa5d4159420 legacy=0x7fa5d40b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:50.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.333+0000 7fa5d2ffd700 1 -- 172.21.15.71:0/2703762934 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d40b1a70 con 0x7fa5d41597f0 2023-10-09T08:17:50.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.333+0000 7fa5d2ffd700 1 --2- 172.21.15.71:0/2703762934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5d41597f0 0x7fa5d40b2270 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fa5c80098e0 tx=0x7fa5c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6220d0f9286d7fe0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:50.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.334+0000 7fa5d27fc700 1 -- 172.21.15.71:0/2703762934 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8011630 con 0x7fa5d41597f0 2023-10-09T08:17:50.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.334+0000 7fa5d27fc700 1 -- 172.21.15.71:0/2703762934 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c8011790 con 0x7fa5d41597f0 2023-10-09T08:17:50.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.334+0000 7fa5d27fc700 1 -- 172.21.15.71:0/2703762934 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8011b30 con 0x7fa5d41597f0 2023-10-09T08:17:50.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.334+0000 7fa5d8d9d700 1 -- 172.21.15.71:0/2703762934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5d41597f0 msgr2=0x7fa5d40b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:50.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.334+0000 7fa5d8d9d700 1 --2- 172.21.15.71:0/2703762934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5d41597f0 0x7fa5d40b2270 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fa5c80098e0 tx=0x7fa5c80091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:50.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.334+0000 7fa5d8d9d700 1 -- 172.21.15.71:0/2703762934 shutdown_connections 2023-10-09T08:17:50.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.334+0000 7fa5d8d9d700 1 --2- 172.21.15.71:0/2703762934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5d41597f0 0x7fa5d40b2270 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:50.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.334+0000 7fa5d8d9d700 1 -- 172.21.15.71:0/2703762934 >> 172.21.15.71:0/2703762934 conn(0x7fa5d40d0660 msgr2=0x7fa5d40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:50.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.335+0000 7fa5d8d9d700 1 -- 172.21.15.71:0/2703762934 shutdown_connections 2023-10-09T08:17:50.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.335+0000 7fa5d8d9d700 1 -- 172.21.15.71:0/2703762934 wait complete. 2023-10-09T08:17:50.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.336+0000 7fa5d8d9d700 1 Processor -- start 2023-10-09T08:17:50.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.336+0000 7fa5d8d9d700 1 -- start start 2023-10-09T08:17:50.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.337+0000 7fa5d8d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5d4159420 0x7fa5d415c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:50.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.337+0000 7fa5d8d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5d41597f0 0x7fa5d40c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:50.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.337+0000 7fa5d8d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5d415d230 0x7fa5d41542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:50.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.337+0000 7fa5d8d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d41697a0 con 0x7fa5d415d230 2023-10-09T08:17:50.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.337+0000 7fa5d8d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d40c5b00 con 0x7fa5d41597f0 2023-10-09T08:17:50.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.337+0000 7fa5d8d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d40c5de0 con 0x7fa5d4159420 2023-10-09T08:17:50.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.337+0000 7fa5d3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5d415d230 0x7fa5d41542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:50.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.337+0000 7fa5d3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5d415d230 0x7fa5d41542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37106/0 (socket says 172.21.15.71:37106) 2023-10-09T08:17:50.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.337+0000 7fa5d3fff700 1 -- 172.21.15.71:0/1930731138 learned_addr learned my addr 172.21.15.71:0/1930731138 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:50.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.337+0000 7fa5d37fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5d4159420 0x7fa5d415c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:50.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.337+0000 7fa5d2ffd700 1 --2- 172.21.15.71:0/1930731138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5d41597f0 0x7fa5d40c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:50.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.338+0000 7fa5d3fff700 1 -- 172.21.15.71:0/1930731138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5d4159420 msgr2=0x7fa5d415c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:50.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.338+0000 7fa5d3fff700 1 --2- 172.21.15.71:0/1930731138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5d4159420 0x7fa5d415c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:50.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.338+0000 7fa5d3fff700 1 -- 172.21.15.71:0/1930731138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5d41597f0 msgr2=0x7fa5d40c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:50.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.338+0000 7fa5d3fff700 1 --2- 172.21.15.71:0/1930731138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5d41597f0 0x7fa5d40c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:50.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.338+0000 7fa5d3fff700 1 -- 172.21.15.71:0/1930731138 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c8009420 con 0x7fa5d415d230 2023-10-09T08:17:50.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.338+0000 7fa5d3fff700 1 --2- 172.21.15.71:0/1930731138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5d415d230 0x7fa5d41542c0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc00c830 tx=0x7fa5cc007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:50.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.338+0000 7fa5bb7fe700 1 -- 172.21.15.71:0/1930731138 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc012630 con 0x7fa5d415d230 2023-10-09T08:17:50.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.338+0000 7fa5bb7fe700 1 -- 172.21.15.71:0/1930731138 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5cc012790 con 0x7fa5d415d230 2023-10-09T08:17:50.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.338+0000 7fa5bb7fe700 1 -- 172.21.15.71:0/1930731138 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc012b50 con 0x7fa5d415d230 2023-10-09T08:17:50.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.338+0000 7fa5d8d9d700 1 -- 172.21.15.71:0/1930731138 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d40c60c0 con 0x7fa5d415d230 2023-10-09T08:17:50.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.338+0000 7fa5d8d9d700 1 -- 172.21.15.71:0/1930731138 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d4154800 con 0x7fa5d415d230 2023-10-09T08:17:50.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.339+0000 7fa5d8d9d700 1 -- 172.21.15.71:0/1930731138 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d4169910 con 0x7fa5d415d230 2023-10-09T08:17:50.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.340+0000 7fa5bb7fe700 1 -- 172.21.15.71:0/1930731138 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 106) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fa5cc01a3b0 con 0x7fa5d415d230 2023-10-09T08:17:50.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.341+0000 7fa5bb7fe700 1 --2- 172.21.15.71:0/1930731138 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa5c00670e0 0x7fa5c0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:50.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.341+0000 7fa5bb7fe700 1 -- 172.21.15.71:0/1930731138 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fa5cc0847c0 con 0x7fa5d415d230 2023-10-09T08:17:50.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.342+0000 7fa5d37fe700 1 -- 172.21.15.71:0/1930731138 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa5c00670e0 msgr2=0x7fa5c0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:50.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.342+0000 7fa5d37fe700 1 --2- 172.21.15.71:0/1930731138 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa5c00670e0 0x7fa5c0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:50.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.346+0000 7fa5bb7fe700 1 -- 172.21.15.71:0/1930731138 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5cc0514a0 con 0x7fa5d415d230 2023-10-09T08:17:50.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.543+0000 7fa5d37fe700 1 -- 172.21.15.71:0/1930731138 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa5c00670e0 msgr2=0x7fa5c0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:50.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.543+0000 7fa5d37fe700 1 --2- 172.21.15.71:0/1930731138 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa5c00670e0 0x7fa5c0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:50.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.545+0000 7fa5d8d9d700 1 -- 172.21.15.71:0/1930731138 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5d404c3c0 con 0x7fa5d415d230 2023-10-09T08:17:50.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.546+0000 7fa5bb7fe700 1 -- 172.21.15.71:0/1930731138 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v211) v1 ==== 74+0+16539 (secure 0 0 0) 0x7fa5cc054ac0 con 0x7fa5d415d230 2023-10-09T08:17:50.547 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:50.548 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":211,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T08:17:43.094484+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-09T08:17:20.000097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"209","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-09T08:17:21.419977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"210","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:0/1351990957":"2023-10-10T08:17:43.094437+0000","172.21.15.179:0/3871404679":"2023-10-10T08:17:43.094437+0000","172.21.15.179:0/4203172728":"2023-10-10T08:17:43.094437+0000","172.21.15.179:0/978747241":"2023-10-10T08:17:43.094437+0000","172.21.15.179:6837/101206":"2023-10-10T08:17:43.094437+0000","172.21.15.179:6835/101206":"2023-10-10T08:17:43.094437+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T08:17:50.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.549+0000 7fa5d8d9d700 1 -- 172.21.15.71:0/1930731138 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa5c00670e0 msgr2=0x7fa5c0069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:50.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.549+0000 7fa5d8d9d700 1 --2- 172.21.15.71:0/1930731138 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa5c00670e0 0x7fa5c0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:50.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.549+0000 7fa5d8d9d700 1 -- 172.21.15.71:0/1930731138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5d415d230 msgr2=0x7fa5d41542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:50.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.549+0000 7fa5d8d9d700 1 --2- 172.21.15.71:0/1930731138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5d415d230 0x7fa5d41542c0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc00c830 tx=0x7fa5cc007f90 comp rx=0 tx=0).stop 2023-10-09T08:17:50.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.549+0000 7fa5d8d9d700 1 -- 172.21.15.71:0/1930731138 shutdown_connections 2023-10-09T08:17:50.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.549+0000 7fa5d8d9d700 1 --2- 172.21.15.71:0/1930731138 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fa5c00670e0 0x7fa5c0069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:50.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.549+0000 7fa5d8d9d700 1 --2- 172.21.15.71:0/1930731138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5d415d230 0x7fa5d41542c0 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:50.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.549+0000 7fa5d8d9d700 1 --2- 172.21.15.71:0/1930731138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5d4159420 0x7fa5d415c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:50.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.549+0000 7fa5d8d9d700 1 --2- 172.21.15.71:0/1930731138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5d41597f0 0x7fa5d40c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:50.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.549+0000 7fa5d8d9d700 1 -- 172.21.15.71:0/1930731138 >> 172.21.15.71:0/1930731138 conn(0x7fa5d40d0660 msgr2=0x7fa5d40b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:50.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.549+0000 7fa5d8d9d700 1 -- 172.21.15.71:0/1930731138 shutdown_connections 2023-10-09T08:17:50.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.549+0000 7fa5d8d9d700 1 -- 172.21.15.71:0/1930731138 wait complete. 2023-10-09T08:17:50.568 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T08:17:50.569 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T08:17:50.692 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:50.692+0000 7fb5b9869180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T08:17:50.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.765+0000 7fe5e519d700 1 Processor -- start 2023-10-09T08:17:50.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.765+0000 7fe5e519d700 1 -- start start 2023-10-09T08:17:50.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.767+0000 7fe5e519d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe5e00c7260 0x7fe5e00872f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:50.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.767+0000 7fe5e519d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e0069cd0 con 0x7fe5e0087830 2023-10-09T08:17:50.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.767+0000 7fe5e519d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e0166900 con 0x7fe5e0166530 2023-10-09T08:17:50.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.767+0000 7fe5e519d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e00c7700 con 0x7fe5e00c7260 2023-10-09T08:17:50.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.768+0000 7fe5dffff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fe5e0166530 0x7fe5e00caad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:60026/0 (socket says 172.21.15.71:60026) 2023-10-09T08:17:50.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.768+0000 7fe5dffff700 1 -- 172.21.15.71:0/1719108295 learned_addr learned my addr 172.21.15.71:0/1719108295 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:50.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.768+0000 7fe5df7fe700 1 --2- 172.21.15.71:0/1719108295 >> v2:172.21.15.71:3300/0 conn(0x7fe5e00c7260 0x7fe5e00872f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:50.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.768+0000 7fe5deffd700 1 -- 172.21.15.71:0/1719108295 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1592760261 0 0) 0x7fe5e0166900 con 0x7fe5e0166530 2023-10-09T08:17:50.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.768+0000 7fe5deffd700 1 -- 172.21.15.71:0/1719108295 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5c8003570 con 0x7fe5e0166530 2023-10-09T08:17:50.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.769+0000 7fe5deffd700 1 -- 172.21.15.71:0/1719108295 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2305770729 0 0) 0x7fe5e0069cd0 con 0x7fe5e0087830 2023-10-09T08:17:50.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.769+0000 7fe5deffd700 1 -- 172.21.15.71:0/1719108295 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5e0166900 con 0x7fe5e0087830 2023-10-09T08:17:50.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.769+0000 7fe5deffd700 1 -- 172.21.15.71:0/1719108295 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2861735933 0 0) 0x7fe5c8003570 con 0x7fe5e0166530 2023-10-09T08:17:50.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.769+0000 7fe5deffd700 1 -- 172.21.15.71:0/1719108295 >> v2:172.21.15.71:3300/0 conn(0x7fe5e00c7260 msgr2=0x7fe5e00872f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:50.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.769+0000 7fe5deffd700 1 --2- 172.21.15.71:0/1719108295 >> v2:172.21.15.71:3300/0 conn(0x7fe5e00c7260 0x7fe5e00872f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:50.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.769+0000 7fe5deffd700 1 -- 172.21.15.71:0/1719108295 >> v1:172.21.15.71:6789/0 conn(0x7fe5e0087830 legacy=0x7fe5e0170040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:50.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.769+0000 7fe5deffd700 1 -- 172.21.15.71:0/1719108295 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e00696c0 con 0x7fe5e0166530 2023-10-09T08:17:50.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.769+0000 7fe5deffd700 1 -- 172.21.15.71:0/1719108295 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fe5d0001110 con 0x7fe5e0166530 2023-10-09T08:17:50.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.769+0000 7fe5deffd700 1 -- 172.21.15.71:0/1719108295 >> v1:172.21.15.179:6789/0 conn(0x7fe5e0166530 legacy=0x7fe5e00caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:50.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.769+0000 7fe5deffd700 1 --2- 172.21.15.71:0/1719108295 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5c8003bf0 0x7fe5c8004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:50.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.769+0000 7fe5deffd700 1 --2- 172.21.15.71:0/1719108295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5c8004810 0x7fe5c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:50.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.769+0000 7fe5deffd700 1 --2- 172.21.15.71:0/1719108295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5c80052e0 0x7fe5c800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:50.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.769+0000 7fe5deffd700 1 -- 172.21.15.71:0/1719108295 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e00c7700 con 0x7fe5c8003bf0 2023-10-09T08:17:50.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.769+0000 7fe5deffd700 1 -- 172.21.15.71:0/1719108295 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c800c230 con 0x7fe5c8004810 2023-10-09T08:17:50.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.769+0000 7fe5deffd700 1 -- 172.21.15.71:0/1719108295 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c800c3f0 con 0x7fe5c80052e0 2023-10-09T08:17:50.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.769+0000 7fe5e499c700 1 --2- 172.21.15.71:0/1719108295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5c80052e0 0x7fe5c800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:50.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.769+0000 7fe5dffff700 1 --2- 172.21.15.71:0/1719108295 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5c8003bf0 0x7fe5c8004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:50.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.770+0000 7fe5df7fe700 1 --2- 172.21.15.71:0/1719108295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5c8004810 0x7fe5c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:50.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.770+0000 7fe5e499c700 1 -- 172.21.15.71:0/1719108295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5c8004810 msgr2=0x7fe5c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:50.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.770+0000 7fe5e499c700 1 --2- 172.21.15.71:0/1719108295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5c8004810 0x7fe5c8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:50.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.770+0000 7fe5e499c700 1 -- 172.21.15.71:0/1719108295 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5c8003bf0 msgr2=0x7fe5c8004000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:50.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.770+0000 7fe5e499c700 1 --2- 172.21.15.71:0/1719108295 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5c8003bf0 0x7fe5c8004000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:50.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.770+0000 7fe5e499c700 1 -- 172.21.15.71:0/1719108295 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c8003570 con 0x7fe5c80052e0 2023-10-09T08:17:50.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.770+0000 7fe5e499c700 1 -- 172.21.15.71:0/1719108295 reap_dead start 2023-10-09T08:17:50.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.770+0000 7fe5e499c700 1 --2- 172.21.15.71:0/1719108295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5c80052e0 0x7fe5c800ba60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8002120 tx=0x7fe5d80017c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1537a53d9ba493b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:50.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.770+0000 7fe5deffd700 1 -- 172.21.15.71:0/1719108295 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d800c980 con 0x7fe5c80052e0 2023-10-09T08:17:50.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.770+0000 7fe5deffd700 1 -- 172.21.15.71:0/1719108295 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d800cae0 con 0x7fe5c80052e0 2023-10-09T08:17:50.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.770+0000 7fe5deffd700 1 -- 172.21.15.71:0/1719108295 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d800ce80 con 0x7fe5c80052e0 2023-10-09T08:17:50.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.771+0000 7fe5e519d700 1 -- 172.21.15.71:0/1719108295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5c80052e0 msgr2=0x7fe5c800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:50.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.771+0000 7fe5e519d700 1 --2- 172.21.15.71:0/1719108295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5c80052e0 0x7fe5c800ba60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8002120 tx=0x7fe5d80017c0 comp rx=0 tx=0).stop 2023-10-09T08:17:50.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.771+0000 7fe5e519d700 1 -- 172.21.15.71:0/1719108295 shutdown_connections 2023-10-09T08:17:50.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.771+0000 7fe5e519d700 1 --2- 172.21.15.71:0/1719108295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5c80052e0 0x7fe5c800ba60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:50.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.771+0000 7fe5e519d700 1 -- 172.21.15.71:0/1719108295 >> 172.21.15.71:0/1719108295 conn(0x7fe5e00cc1f0 msgr2=0x7fe5e00cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:50.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.772+0000 7fe5e519d700 1 -- 172.21.15.71:0/1719108295 shutdown_connections 2023-10-09T08:17:50.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.772+0000 7fe5e519d700 1 -- 172.21.15.71:0/1719108295 wait complete. 2023-10-09T08:17:50.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.774+0000 7fe5e519d700 1 Processor -- start 2023-10-09T08:17:50.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.774+0000 7fe5e519d700 1 -- start start 2023-10-09T08:17:50.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.776+0000 7fe5e519d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5c80052e0 0x7fe5e015f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:50.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.776+0000 7fe5e519d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5e01764d0 0x7fe5e0160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:50.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.776+0000 7fe5e519d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5e0176940 0x7fe5e0161500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:50.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.776+0000 7fe5e519d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e00b1210 con 0x7fe5c80052e0 2023-10-09T08:17:50.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.776+0000 7fe5e519d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e0179ad0 con 0x7fe5e0176940 2023-10-09T08:17:50.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.776+0000 7fe5e519d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e00b1460 con 0x7fe5e01764d0 2023-10-09T08:17:50.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.776+0000 7fe5dffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5c80052e0 0x7fe5e015f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:50.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.776+0000 7fe5dffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5c80052e0 0x7fe5e015f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37132/0 (socket says 172.21.15.71:37132) 2023-10-09T08:17:50.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.776+0000 7fe5df7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5e01764d0 0x7fe5e0160fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:50.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.776+0000 7fe5dffff700 1 -- 172.21.15.71:0/1284189427 learned_addr learned my addr 172.21.15.71:0/1284189427 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:50.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.776+0000 7fe5e499c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5e0176940 0x7fe5e0161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:50.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.777+0000 7fe5dffff700 1 -- 172.21.15.71:0/1284189427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5e01764d0 msgr2=0x7fe5e0160fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:50.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.777+0000 7fe5dffff700 1 --2- 172.21.15.71:0/1284189427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5e01764d0 0x7fe5e0160fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:50.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.777+0000 7fe5dffff700 1 -- 172.21.15.71:0/1284189427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5e0176940 msgr2=0x7fe5e0161500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:50.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.777+0000 7fe5dffff700 1 --2- 172.21.15.71:0/1284189427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5e0176940 0x7fe5e0161500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:50.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.777+0000 7fe5dffff700 1 -- 172.21.15.71:0/1284189427 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e00b1740 con 0x7fe5c80052e0 2023-10-09T08:17:50.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.777+0000 7fe5e499c700 1 --2- 172.21.15.71:0/1284189427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5e0176940 0x7fe5e0161500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:50.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.777+0000 7fe5dffff700 1 --2- 172.21.15.71:0/1284189427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5c80052e0 0x7fe5e015f7e0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000c110 tx=0x7fe5e0069c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:50.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.777+0000 7fe5c7fff700 1 -- 172.21.15.71:0/1284189427 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d000cbf0 con 0x7fe5c80052e0 2023-10-09T08:17:50.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.777+0000 7fe5c7fff700 1 -- 172.21.15.71:0/1284189427 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d000cd50 con 0x7fe5c80052e0 2023-10-09T08:17:50.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.777+0000 7fe5c7fff700 1 -- 172.21.15.71:0/1284189427 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0006360 con 0x7fe5c80052e0 2023-10-09T08:17:50.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.777+0000 7fe5e519d700 1 -- 172.21.15.71:0/1284189427 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e00b1a20 con 0x7fe5c80052e0 2023-10-09T08:17:50.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.778+0000 7fe5e519d700 1 -- 172.21.15.71:0/1284189427 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e01644c0 con 0x7fe5c80052e0 2023-10-09T08:17:50.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.779+0000 7fe5c67fc700 1 -- 172.21.15.71:0/1284189427 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b80052b0 con 0x7fe5c80052e0 2023-10-09T08:17:50.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.790+0000 7fe5c7fff700 1 -- 172.21.15.71:0/1284189427 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 106) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fe5d0006750 con 0x7fe5c80052e0 2023-10-09T08:17:50.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.792+0000 7fe5c7fff700 1 --2- 172.21.15.71:0/1284189427 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe5cc0671e0 0x7fe5cc069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:50.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.792+0000 7fe5c7fff700 1 -- 172.21.15.71:0/1284189427 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fe5d0085970 con 0x7fe5c80052e0 2023-10-09T08:17:50.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.792+0000 7fe5df7fe700 1 -- 172.21.15.71:0/1284189427 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe5cc0671e0 msgr2=0x7fe5cc069690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:50.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.792+0000 7fe5df7fe700 1 --2- 172.21.15.71:0/1284189427 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe5cc0671e0 0x7fe5cc069690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:50.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.792+0000 7fe5c7fff700 1 -- 172.21.15.71:0/1284189427 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5d00b0640 con 0x7fe5c80052e0 2023-10-09T08:17:50.866 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:50.866+0000 7fb5b9869180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T08:17:50.878 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:50.877+0000 7f5c5476a180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T08:17:50.963 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:50.963+0000 7fb5b9869180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T08:17:50.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.993+0000 7fe5df7fe700 1 -- 172.21.15.71:0/1284189427 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe5cc0671e0 msgr2=0x7fe5cc069690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:50.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:50.993+0000 7fe5df7fe700 1 --2- 172.21.15.71:0/1284189427 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe5cc0671e0 0x7fe5cc069690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:51.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.044+0000 7fe5c67fc700 1 -- 172.21.15.71:0/1284189427 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5b8005830 con 0x7fe5c80052e0 2023-10-09T08:17:51.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.045+0000 7fe5c7fff700 1 -- 172.21.15.71:0/1284189427 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4608 (secure 0 0 0) 0x7fe5d0018090 con 0x7fe5c80052e0 2023-10-09T08:17:51.046 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:51.046 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":97,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1242627383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1242627383},{"type":"v1","addr":"172.21.15.179:6836","nonce":1242627383}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":9628,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1306881721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1306881721},{"type":"v1","addr":"172.21.15.179:6834","nonce":1306881721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10143,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/717406174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":717406174},{"type":"v1","addr":"172.21.15.71:6834","nonce":717406174}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T08:17:22.432534+0000","modified":"2023-10-09T08:17:25.988311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10149":{"gid":10149,"name":"c","rank":0,"incarnation":93,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/2477293368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":2477293368},{"type":"v1","addr":"172.21.15.71:6835","nonce":2477293368}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T08:17:51.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.047+0000 7fe5c67fc700 1 -- 172.21.15.71:0/1284189427 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe5cc0671e0 msgr2=0x7fe5cc069690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:51.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.047+0000 7fe5c67fc700 1 --2- 172.21.15.71:0/1284189427 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe5cc0671e0 0x7fe5cc069690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.047+0000 7fe5c67fc700 1 -- 172.21.15.71:0/1284189427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5c80052e0 msgr2=0x7fe5e015f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:51.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.047+0000 7fe5c67fc700 1 --2- 172.21.15.71:0/1284189427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5c80052e0 0x7fe5e015f7e0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000c110 tx=0x7fe5e0069c40 comp rx=0 tx=0).stop 2023-10-09T08:17:51.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.047+0000 7fe5c67fc700 1 -- 172.21.15.71:0/1284189427 shutdown_connections 2023-10-09T08:17:51.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.047+0000 7fe5c67fc700 1 --2- 172.21.15.71:0/1284189427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5e0176940 0x7fe5e0161500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.047+0000 7fe5c67fc700 1 --2- 172.21.15.71:0/1284189427 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fe5cc0671e0 0x7fe5cc069690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.047+0000 7fe5c67fc700 1 --2- 172.21.15.71:0/1284189427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5c80052e0 0x7fe5e015f7e0 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.047+0000 7fe5c67fc700 1 --2- 172.21.15.71:0/1284189427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5e01764d0 0x7fe5e0160fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.047+0000 7fe5c67fc700 1 -- 172.21.15.71:0/1284189427 >> 172.21.15.71:0/1284189427 conn(0x7fe5e00cc1f0 msgr2=0x7fe5e0161dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:51.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.047+0000 7fe5c67fc700 1 -- 172.21.15.71:0/1284189427 shutdown_connections 2023-10-09T08:17:51.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.048+0000 7fe5c67fc700 1 -- 172.21.15.71:0/1284189427 wait complete. 2023-10-09T08:17:51.050 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 97 2023-10-09T08:17:51.058 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:51.057+0000 7f5c5476a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T08:17:51.066 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T08:17:51.161 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:51.161+0000 7f5c5476a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T08:17:51.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.252+0000 7f9039d9d700 1 Processor -- start 2023-10-09T08:17:51.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.252+0000 7f9039d9d700 1 -- start start 2023-10-09T08:17:51.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.253+0000 7f9039d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9034159420 0x7f90340b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:51.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.253+0000 7f9039d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f903415d230 0x7f903415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:51.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.253+0000 7f9039d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90340b2980 con 0x7f90341597f0 2023-10-09T08:17:51.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.253+0000 7f9039d9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903415db70 con 0x7f9034159420 2023-10-09T08:17:51.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.253+0000 7f9039d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90340b11d0 con 0x7f903415d230 2023-10-09T08:17:51.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.254+0000 7f9038d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9034159420 0x7f90340b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:51.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.254+0000 7f903959c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f903415d230 0x7f903415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:51.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.254+0000 7f9038d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9034159420 0x7f90340b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37144/0 (socket says 172.21.15.71:37144) 2023-10-09T08:17:51.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.254+0000 7f9038d9b700 1 -- 172.21.15.71:0/285271943 learned_addr learned my addr 172.21.15.71:0/285271943 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:51.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.254+0000 7f9038d9b700 1 -- 172.21.15.71:0/285271943 >> v2:172.21.15.179:3300/0 conn(0x7f903415d230 msgr2=0x7f903415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:51.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.254+0000 7f9038d9b700 1 --2- 172.21.15.71:0/285271943 >> v2:172.21.15.179:3300/0 conn(0x7f903415d230 0x7f903415d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.254+0000 7f9038d9b700 1 -- 172.21.15.71:0/285271943 >> v1:172.21.15.179:6789/0 conn(0x7f90341597f0 legacy=0x7f90340b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:51.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.254+0000 7f9038d9b700 1 -- 172.21.15.71:0/285271943 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90340b14b0 con 0x7f9034159420 2023-10-09T08:17:51.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.254+0000 7f903959c700 1 --2- 172.21.15.71:0/285271943 >> v2:172.21.15.179:3300/0 conn(0x7f903415d230 0x7f903415d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:51.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.254+0000 7f90337fe700 1 -- 172.21.15.71:0/285271943 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2266016679 0 0) 0x7f90340b2980 con 0x7f90341597f0 2023-10-09T08:17:51.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.255+0000 7f9038d9b700 1 --2- 172.21.15.71:0/285271943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9034159420 0x7f90340b5f40 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f903415d170 tx=0x7f9028009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99eb864703cd8ef3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:51.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.255+0000 7f90337fe700 1 -- 172.21.15.71:0/285271943 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9028009e70 con 0x7f9034159420 2023-10-09T08:17:51.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.255+0000 7f90337fe700 1 -- 172.21.15.71:0/285271943 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902800b860 con 0x7f9034159420 2023-10-09T08:17:51.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.255+0000 7f90337fe700 1 -- 172.21.15.71:0/285271943 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902800bc00 con 0x7f9034159420 2023-10-09T08:17:51.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.255+0000 7f9039d9d700 1 -- 172.21.15.71:0/285271943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9034159420 msgr2=0x7f90340b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:51.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.255+0000 7f9039d9d700 1 --2- 172.21.15.71:0/285271943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9034159420 0x7f90340b5f40 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f903415d170 tx=0x7f9028009250 comp rx=0 tx=0).stop 2023-10-09T08:17:51.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.256+0000 7f9039d9d700 1 -- 172.21.15.71:0/285271943 shutdown_connections 2023-10-09T08:17:51.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.256+0000 7f9039d9d700 1 --2- 172.21.15.71:0/285271943 >> v2:172.21.15.179:3300/0 conn(0x7f903415d230 0x7f903415d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.256+0000 7f9039d9d700 1 --2- 172.21.15.71:0/285271943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9034159420 0x7f90340b5f40 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.256+0000 7f9039d9d700 1 -- 172.21.15.71:0/285271943 >> 172.21.15.71:0/285271943 conn(0x7f90340d0660 msgr2=0x7f90340d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:51.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.256+0000 7f9039d9d700 1 -- 172.21.15.71:0/285271943 shutdown_connections 2023-10-09T08:17:51.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.256+0000 7f9039d9d700 1 -- 172.21.15.71:0/285271943 wait complete. 2023-10-09T08:17:51.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.257+0000 7f9039d9d700 1 Processor -- start 2023-10-09T08:17:51.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.257+0000 7f9039d9d700 1 -- start start 2023-10-09T08:17:51.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.258+0000 7f9039d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9034159420 0x7f90340c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:51.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.258+0000 7f9039d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90341597f0 0x7f9034156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:51.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.258+0000 7f9039d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f903415d230 0x7f90340b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:51.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.258+0000 7f9039d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90340ca7f0 con 0x7f903415d230 2023-10-09T08:17:51.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.258+0000 7f9039d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90341568b0 con 0x7f90341597f0 2023-10-09T08:17:51.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.258+0000 7f9039d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90340c8da0 con 0x7f9034159420 2023-10-09T08:17:51.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.258+0000 7f903959c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f903415d230 0x7f90340b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:51.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.258+0000 7f903959c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f903415d230 0x7f90340b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37158/0 (socket says 172.21.15.71:37158) 2023-10-09T08:17:51.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.258+0000 7f903959c700 1 -- 172.21.15.71:0/1970911812 learned_addr learned my addr 172.21.15.71:0/1970911812 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:51.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.258+0000 7f9038d9b700 1 --2- 172.21.15.71:0/1970911812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9034159420 0x7f90340c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:51.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.258+0000 7f9033fff700 1 --2- 172.21.15.71:0/1970911812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90341597f0 0x7f9034156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:51.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.259+0000 7f903959c700 1 -- 172.21.15.71:0/1970911812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9034159420 msgr2=0x7f90340c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:51.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.259+0000 7f903959c700 1 --2- 172.21.15.71:0/1970911812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9034159420 0x7f90340c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.259+0000 7f903959c700 1 -- 172.21.15.71:0/1970911812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90341597f0 msgr2=0x7f9034156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:51.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.259+0000 7f903959c700 1 --2- 172.21.15.71:0/1970911812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90341597f0 0x7f9034156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.259+0000 7f903959c700 1 -- 172.21.15.71:0/1970911812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902c009a20 con 0x7f903415d230 2023-10-09T08:17:51.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.259+0000 7f903959c700 1 --2- 172.21.15.71:0/1970911812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f903415d230 0x7f90340b47d0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f902c009f50 tx=0x7f902c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:51.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.259+0000 7f9030ff9700 1 -- 172.21.15.71:0/1970911812 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c00cb50 con 0x7f903415d230 2023-10-09T08:17:51.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.259+0000 7f9030ff9700 1 -- 172.21.15.71:0/1970911812 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c00f040 con 0x7f903415d230 2023-10-09T08:17:51.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.259+0000 7f9030ff9700 1 -- 172.21.15.71:0/1970911812 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c014480 con 0x7f903415d230 2023-10-09T08:17:51.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.259+0000 7f9039d9d700 1 -- 172.21.15.71:0/1970911812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90280094f0 con 0x7f903415d230 2023-10-09T08:17:51.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.259+0000 7f9039d9d700 1 -- 172.21.15.71:0/1970911812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90340cad40 con 0x7f903415d230 2023-10-09T08:17:51.263 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:51.261+0000 7fb5b9869180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T08:17:51.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.261+0000 7f9039d9d700 1 -- 172.21.15.71:0/1970911812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90340b4d70 con 0x7f903415d230 2023-10-09T08:17:51.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.261+0000 7f9030ff9700 1 -- 172.21.15.71:0/1970911812 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 106) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f902c003020 con 0x7f903415d230 2023-10-09T08:17:51.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.263+0000 7f9030ff9700 1 --2- 172.21.15.71:0/1970911812 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f90180670e0 0x7f9018069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:51.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.263+0000 7f9030ff9700 1 -- 172.21.15.71:0/1970911812 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f902c085580 con 0x7f903415d230 2023-10-09T08:17:51.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.263+0000 7f9038d9b700 1 -- 172.21.15.71:0/1970911812 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f90180670e0 msgr2=0x7f9018069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:51.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.263+0000 7f9038d9b700 1 --2- 172.21.15.71:0/1970911812 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f90180670e0 0x7f9018069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:51.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.267+0000 7f9030ff9700 1 -- 172.21.15.71:0/1970911812 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f902c0520b0 con 0x7f903415d230 2023-10-09T08:17:51.357 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:51.356+0000 7fb5b9869180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T08:17:51.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.464+0000 7f9038d9b700 1 -- 172.21.15.71:0/1970911812 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f90180670e0 msgr2=0x7f9018069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:51.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.464+0000 7f9038d9b700 1 --2- 172.21.15.71:0/1970911812 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f90180670e0 0x7f9018069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:51.478 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:51.478+0000 7f5c5476a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T08:17:51.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.523+0000 7f9039d9d700 1 -- 172.21.15.71:0/1970911812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f903404c3f0 con 0x7f903415d230 2023-10-09T08:17:51.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.524+0000 7f9030ff9700 1 -- 172.21.15.71:0/1970911812 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4608 (secure 0 0 0) 0x7f902c0556d0 con 0x7f903415d230 2023-10-09T08:17:51.525 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:51.525 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":97,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1242627383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1242627383},{"type":"v1","addr":"172.21.15.179:6836","nonce":1242627383}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":9628,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1306881721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1306881721},{"type":"v1","addr":"172.21.15.179:6834","nonce":1306881721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10143,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/717406174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":717406174},{"type":"v1","addr":"172.21.15.71:6834","nonce":717406174}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T08:17:22.432534+0000","modified":"2023-10-09T08:17:25.988311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10149":{"gid":10149,"name":"c","rank":0,"incarnation":93,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/2477293368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":2477293368},{"type":"v1","addr":"172.21.15.71:6835","nonce":2477293368}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T08:17:51.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.527+0000 7f9039d9d700 1 -- 172.21.15.71:0/1970911812 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f90180670e0 msgr2=0x7f9018069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:51.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.527+0000 7f9039d9d700 1 --2- 172.21.15.71:0/1970911812 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f90180670e0 0x7f9018069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.527+0000 7f9039d9d700 1 -- 172.21.15.71:0/1970911812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f903415d230 msgr2=0x7f90340b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:51.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.527+0000 7f9039d9d700 1 --2- 172.21.15.71:0/1970911812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f903415d230 0x7f90340b47d0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f902c009f50 tx=0x7f902c00b040 comp rx=0 tx=0).stop 2023-10-09T08:17:51.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.527+0000 7f9039d9d700 1 -- 172.21.15.71:0/1970911812 shutdown_connections 2023-10-09T08:17:51.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.527+0000 7f9039d9d700 1 --2- 172.21.15.71:0/1970911812 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f90180670e0 0x7f9018069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.527+0000 7f9039d9d700 1 --2- 172.21.15.71:0/1970911812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f903415d230 0x7f90340b47d0 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.527+0000 7f9039d9d700 1 --2- 172.21.15.71:0/1970911812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9034159420 0x7f90340c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.527+0000 7f9039d9d700 1 --2- 172.21.15.71:0/1970911812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90341597f0 0x7f9034156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.527+0000 7f9039d9d700 1 -- 172.21.15.71:0/1970911812 >> 172.21.15.71:0/1970911812 conn(0x7f90340d0660 msgr2=0x7f9034158130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:51.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.527+0000 7f9039d9d700 1 -- 172.21.15.71:0/1970911812 shutdown_connections 2023-10-09T08:17:51.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.527+0000 7f9039d9d700 1 -- 172.21.15.71:0/1970911812 wait complete. 2023-10-09T08:17:51.529 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 97 2023-10-09T08:17:51.546 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T08:17:51.581 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:51.580+0000 7f5c5476a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T08:17:51.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.732+0000 7fb373fff700 1 Processor -- start 2023-10-09T08:17:51.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.732+0000 7fb373fff700 1 -- start start 2023-10-09T08:17:51.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.733+0000 7fb373fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb374159420 0x7fb3740b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:51.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.733+0000 7fb373fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb3741597f0 0x7fb3740b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:51.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.733+0000 7fb373fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb37415d230 0x7fb37415d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:51.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.733+0000 7fb373fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb37415dbb0 con 0x7fb3741597f0 2023-10-09T08:17:51.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.733+0000 7fb373fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3740b11d0 con 0x7fb374159420 2023-10-09T08:17:51.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.733+0000 7fb373fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3740b14b0 con 0x7fb37415d230 2023-10-09T08:17:51.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.733+0000 7fb3727fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb3741597f0 0x7fb3740b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:51.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.734+0000 7fb3727fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb3741597f0 0x7fb3740b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37170/0 (socket says 172.21.15.71:37170) 2023-10-09T08:17:51.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.734+0000 7fb3727fc700 1 -- 172.21.15.71:0/3512249773 learned_addr learned my addr 172.21.15.71:0/3512249773 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:51.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.734+0000 7fb3737fe700 1 --2- 172.21.15.71:0/3512249773 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb37415d230 0x7fb37415d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:51.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.734+0000 7fb372ffd700 1 --2- 172.21.15.71:0/3512249773 >> v2:172.21.15.179:3300/0 conn(0x7fb374159420 0x7fb3740b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:51.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.734+0000 7fb3727fc700 1 -- 172.21.15.71:0/3512249773 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb37415d230 msgr2=0x7fb37415d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:51.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.734+0000 7fb3727fc700 1 --2- 172.21.15.71:0/3512249773 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb37415d230 0x7fb37415d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.734+0000 7fb3727fc700 1 -- 172.21.15.71:0/3512249773 >> v2:172.21.15.179:3300/0 conn(0x7fb374159420 msgr2=0x7fb3740b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:51.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.734+0000 7fb3727fc700 1 --2- 172.21.15.71:0/3512249773 >> v2:172.21.15.179:3300/0 conn(0x7fb374159420 0x7fb3740b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.734+0000 7fb3727fc700 1 -- 172.21.15.71:0/3512249773 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3740b1790 con 0x7fb3741597f0 2023-10-09T08:17:51.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.734+0000 7fb3727fc700 1 --2- 172.21.15.71:0/3512249773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3741597f0 0x7fb3740b2270 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7fb3740b2f20 tx=0x7fb368009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95de37e608d93fc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:51.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.735+0000 7fb371ffb700 1 -- 172.21.15.71:0/3512249773 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36800b640 con 0x7fb3741597f0 2023-10-09T08:17:51.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.735+0000 7fb371ffb700 1 -- 172.21.15.71:0/3512249773 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36800b7a0 con 0x7fb3741597f0 2023-10-09T08:17:51.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.735+0000 7fb371ffb700 1 -- 172.21.15.71:0/3512249773 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36800bb60 con 0x7fb3741597f0 2023-10-09T08:17:51.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.735+0000 7fb373fff700 1 -- 172.21.15.71:0/3512249773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3741597f0 msgr2=0x7fb3740b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:51.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.735+0000 7fb373fff700 1 --2- 172.21.15.71:0/3512249773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3741597f0 0x7fb3740b2270 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7fb3740b2f20 tx=0x7fb368009250 comp rx=0 tx=0).stop 2023-10-09T08:17:51.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.735+0000 7fb373fff700 1 -- 172.21.15.71:0/3512249773 shutdown_connections 2023-10-09T08:17:51.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.735+0000 7fb373fff700 1 --2- 172.21.15.71:0/3512249773 >> v2:172.21.15.179:3300/0 conn(0x7fb374159420 0x7fb3740b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.735+0000 7fb373fff700 1 --2- 172.21.15.71:0/3512249773 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb37415d230 0x7fb37415d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.735+0000 7fb373fff700 1 --2- 172.21.15.71:0/3512249773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3741597f0 0x7fb3740b2270 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.735+0000 7fb373fff700 1 -- 172.21.15.71:0/3512249773 >> 172.21.15.71:0/3512249773 conn(0x7fb3740d0660 msgr2=0x7fb3740d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:51.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.735+0000 7fb373fff700 1 -- 172.21.15.71:0/3512249773 shutdown_connections 2023-10-09T08:17:51.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.735+0000 7fb373fff700 1 -- 172.21.15.71:0/3512249773 wait complete. 2023-10-09T08:17:51.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.737+0000 7fb373fff700 1 Processor -- start 2023-10-09T08:17:51.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.737+0000 7fb373fff700 1 -- start start 2023-10-09T08:17:51.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.738+0000 7fb373fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb374159420 0x7fb374154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:51.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.738+0000 7fb373fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3741597f0 0x7fb3740b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:51.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.738+0000 7fb373fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb37415d230 0x7fb3740b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:51.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.738+0000 7fb373fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3741547a0 con 0x7fb3741597f0 2023-10-09T08:17:51.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.738+0000 7fb373fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37415beb0 con 0x7fb374159420 2023-10-09T08:17:51.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.738+0000 7fb373fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37415c190 con 0x7fb37415d230 2023-10-09T08:17:51.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.738+0000 7fb3727fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3741597f0 0x7fb3740b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:51.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.738+0000 7fb3727fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3741597f0 0x7fb3740b2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37186/0 (socket says 172.21.15.71:37186) 2023-10-09T08:17:51.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.738+0000 7fb3727fc700 1 -- 172.21.15.71:0/145728380 learned_addr learned my addr 172.21.15.71:0/145728380 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:51.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.738+0000 7fb372ffd700 1 --2- 172.21.15.71:0/145728380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb374159420 0x7fb374154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:51.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.738+0000 7fb3737fe700 1 --2- 172.21.15.71:0/145728380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb37415d230 0x7fb3740b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:51.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.739+0000 7fb3727fc700 1 -- 172.21.15.71:0/145728380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb37415d230 msgr2=0x7fb3740b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:51.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.739+0000 7fb3727fc700 1 --2- 172.21.15.71:0/145728380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb37415d230 0x7fb3740b26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.739+0000 7fb3727fc700 1 -- 172.21.15.71:0/145728380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb374159420 msgr2=0x7fb374154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:51.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.739+0000 7fb3727fc700 1 --2- 172.21.15.71:0/145728380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb374159420 0x7fb374154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.739+0000 7fb3727fc700 1 -- 172.21.15.71:0/145728380 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3680094f0 con 0x7fb3741597f0 2023-10-09T08:17:51.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.739+0000 7fb3727fc700 1 --2- 172.21.15.71:0/145728380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3741597f0 0x7fb3740b2170 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7fb374089340 tx=0x7fb368017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:51.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.739+0000 7fb35affd700 1 -- 172.21.15.71:0/145728380 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36800b910 con 0x7fb3741597f0 2023-10-09T08:17:51.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.739+0000 7fb35affd700 1 -- 172.21.15.71:0/145728380 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36800ba70 con 0x7fb3741597f0 2023-10-09T08:17:51.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.739+0000 7fb35affd700 1 -- 172.21.15.71:0/145728380 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368011630 con 0x7fb3741597f0 2023-10-09T08:17:51.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.739+0000 7fb373fff700 1 -- 172.21.15.71:0/145728380 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37415c470 con 0x7fb3741597f0 2023-10-09T08:17:51.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.739+0000 7fb373fff700 1 -- 172.21.15.71:0/145728380 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb37415b100 con 0x7fb3741597f0 2023-10-09T08:17:51.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.740+0000 7fb373fff700 1 -- 172.21.15.71:0/145728380 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb37404c3c0 con 0x7fb3741597f0 2023-10-09T08:17:51.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.741+0000 7fb35affd700 1 -- 172.21.15.71:0/145728380 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 106) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fb3680119a0 con 0x7fb3741597f0 2023-10-09T08:17:51.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.743+0000 7fb35affd700 1 --2- 172.21.15.71:0/145728380 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb3600670e0 0x7fb360069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:51.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.743+0000 7fb35affd700 1 -- 172.21.15.71:0/145728380 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fb368086250 con 0x7fb3741597f0 2023-10-09T08:17:51.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.743+0000 7fb372ffd700 1 -- 172.21.15.71:0/145728380 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb3600670e0 msgr2=0x7fb360069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:51.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.743+0000 7fb372ffd700 1 --2- 172.21.15.71:0/145728380 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb3600670e0 0x7fb360069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:51.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.747+0000 7fb35affd700 1 -- 172.21.15.71:0/145728380 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb368052f30 con 0x7fb3741597f0 2023-10-09T08:17:51.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.944+0000 7fb372ffd700 1 -- 172.21.15.71:0/145728380 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb3600670e0 msgr2=0x7fb360069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:51.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.944+0000 7fb372ffd700 1 --2- 172.21.15.71:0/145728380 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb3600670e0 0x7fb360069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:51.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.948+0000 7fb373fff700 1 -- 172.21.15.71:0/145728380 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb37415c910 con 0x7fb3741597f0 2023-10-09T08:17:51.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.949+0000 7fb35affd700 1 -- 172.21.15.71:0/145728380 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v211) v1 ==== 74+0+16539 (secure 0 0 0) 0x7fb368056550 con 0x7fb3741597f0 2023-10-09T08:17:51.950 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:51.950 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":211,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T08:17:43.094484+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-09T08:17:20.000097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"209","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-09T08:17:21.419977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"210","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:0/1351990957":"2023-10-10T08:17:43.094437+0000","172.21.15.179:0/3871404679":"2023-10-10T08:17:43.094437+0000","172.21.15.179:0/4203172728":"2023-10-10T08:17:43.094437+0000","172.21.15.179:0/978747241":"2023-10-10T08:17:43.094437+0000","172.21.15.179:6837/101206":"2023-10-10T08:17:43.094437+0000","172.21.15.179:6835/101206":"2023-10-10T08:17:43.094437+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T08:17:51.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.951+0000 7fb373fff700 1 -- 172.21.15.71:0/145728380 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb3600670e0 msgr2=0x7fb360069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:51.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.951+0000 7fb373fff700 1 --2- 172.21.15.71:0/145728380 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb3600670e0 0x7fb360069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.951+0000 7fb373fff700 1 -- 172.21.15.71:0/145728380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3741597f0 msgr2=0x7fb3740b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:51.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.951+0000 7fb373fff700 1 --2- 172.21.15.71:0/145728380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3741597f0 0x7fb3740b2170 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7fb374089340 tx=0x7fb368017000 comp rx=0 tx=0).stop 2023-10-09T08:17:51.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.951+0000 7fb373fff700 1 -- 172.21.15.71:0/145728380 shutdown_connections 2023-10-09T08:17:51.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.951+0000 7fb373fff700 1 --2- 172.21.15.71:0/145728380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb37415d230 0x7fb3740b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.951+0000 7fb373fff700 1 --2- 172.21.15.71:0/145728380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb374159420 0x7fb374154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.951+0000 7fb373fff700 1 --2- 172.21.15.71:0/145728380 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb3600670e0 0x7fb360069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.951+0000 7fb373fff700 1 --2- 172.21.15.71:0/145728380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3741597f0 0x7fb3740b2170 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:51.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.951+0000 7fb373fff700 1 -- 172.21.15.71:0/145728380 >> 172.21.15.71:0/145728380 conn(0x7fb3740d0660 msgr2=0x7fb374156a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:51.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.951+0000 7fb373fff700 1 -- 172.21.15.71:0/145728380 shutdown_connections 2023-10-09T08:17:51.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:51.951+0000 7fb373fff700 1 -- 172.21.15.71:0/145728380 wait complete. 2023-10-09T08:17:51.971 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T08:17:52.061 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:52.061+0000 7fb5b9869180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T08:17:52.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.196+0000 7f979319d700 1 Processor -- start 2023-10-09T08:17:52.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.196+0000 7f979319d700 1 -- start start 2023-10-09T08:17:52.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.198+0000 7f979319d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f978c06a0a0 0x7f978c15b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:52.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.198+0000 7f979319d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f978c06dd20 0x7f978c15b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:52.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.198+0000 7f979319d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f978c06ae70 con 0x7f978c06d950 2023-10-09T08:17:52.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.198+0000 7f979319d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978c0c8a60 con 0x7f978c06dd20 2023-10-09T08:17:52.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.198+0000 7f979319d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978c06a540 con 0x7f978c06a0a0 2023-10-09T08:17:52.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.198+0000 7f979299c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f978c06dd20 0x7f978c15b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:52.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.198+0000 7f979299c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f978c06dd20 0x7f978c15b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37196/0 (socket says 172.21.15.71:37196) 2023-10-09T08:17:52.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.198+0000 7f979299c700 1 -- 172.21.15.71:0/1671929000 learned_addr learned my addr 172.21.15.71:0/1671929000 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:52.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.198+0000 7f979199a700 1 --2- 172.21.15.71:0/1671929000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f978c06a0a0 0x7f978c15b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:52.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.198+0000 7f979299c700 1 -- 172.21.15.71:0/1671929000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f978c06a0a0 msgr2=0x7f978c15b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:52.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.198+0000 7f979299c700 1 --2- 172.21.15.71:0/1671929000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f978c06a0a0 0x7f978c15b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:52.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.198+0000 7f979299c700 1 -- 172.21.15.71:0/1671929000 >> v1:172.21.15.179:6789/0 conn(0x7f978c06d950 legacy=0x7f978c0c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:52.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.198+0000 7f979299c700 1 -- 172.21.15.71:0/1671929000 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c06a820 con 0x7f978c06dd20 2023-10-09T08:17:52.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.199+0000 7f979299c700 1 --2- 172.21.15.71:0/1671929000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f978c06dd20 0x7f978c15b950 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f9784009f20 tx=0x7f9784009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa07ddaaacb70e62 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:52.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.199+0000 7f9791199700 1 -- 172.21.15.71:0/1671929000 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978400e070 con 0x7f978c06dd20 2023-10-09T08:17:52.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.199+0000 7f9791199700 1 -- 172.21.15.71:0/1671929000 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978400b9d0 con 0x7f978c06dd20 2023-10-09T08:17:52.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.199+0000 7f9791199700 1 -- 172.21.15.71:0/1671929000 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97840092e0 con 0x7f978c06dd20 2023-10-09T08:17:52.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.200+0000 7f979319d700 1 -- 172.21.15.71:0/1671929000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f978c06dd20 msgr2=0x7f978c15b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:52.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.200+0000 7f979319d700 1 --2- 172.21.15.71:0/1671929000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f978c06dd20 0x7f978c15b950 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f9784009f20 tx=0x7f9784009840 comp rx=0 tx=0).stop 2023-10-09T08:17:52.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.200+0000 7f979319d700 1 -- 172.21.15.71:0/1671929000 shutdown_connections 2023-10-09T08:17:52.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.200+0000 7f979319d700 1 --2- 172.21.15.71:0/1671929000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f978c06dd20 0x7f978c15b950 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:52.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.200+0000 7f979319d700 1 --2- 172.21.15.71:0/1671929000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f978c06a0a0 0x7f978c15b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:52.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.200+0000 7f979319d700 1 -- 172.21.15.71:0/1671929000 >> 172.21.15.71:0/1671929000 conn(0x7f978c0cc1f0 msgr2=0x7f978c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:52.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.200+0000 7f979319d700 1 -- 172.21.15.71:0/1671929000 shutdown_connections 2023-10-09T08:17:52.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.200+0000 7f979319d700 1 -- 172.21.15.71:0/1671929000 wait complete. 2023-10-09T08:17:52.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.202+0000 7f979319d700 1 Processor -- start 2023-10-09T08:17:52.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.202+0000 7f979319d700 1 -- start start 2023-10-09T08:17:52.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.203+0000 7f979319d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f978c06a0a0 0x7f978c0adec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:52.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.203+0000 7f979319d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f978c06d950 0x7f978c15bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.203+0000 7f979319d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f978c06dd20 0x7f978c15c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.203+0000 7f979319d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c0af960 con 0x7f978c06dd20 2023-10-09T08:17:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.203+0000 7f979319d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c0b0200 con 0x7f978c06a0a0 2023-10-09T08:17:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.203+0000 7f979319d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978c0cb570 con 0x7f978c06d950 2023-10-09T08:17:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.204+0000 7f979299c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f978c06dd20 0x7f978c15c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.204+0000 7f979299c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f978c06dd20 0x7f978c15c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37202/0 (socket says 172.21.15.71:37202) 2023-10-09T08:17:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.204+0000 7f979299c700 1 -- 172.21.15.71:0/951297579 learned_addr learned my addr 172.21.15.71:0/951297579 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.204+0000 7f979199a700 1 --2- 172.21.15.71:0/951297579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f978c06d950 0x7f978c15bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.204+0000 7f979219b700 1 --2- 172.21.15.71:0/951297579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f978c06a0a0 0x7f978c0adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.204+0000 7f979299c700 1 -- 172.21.15.71:0/951297579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f978c06d950 msgr2=0x7f978c15bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:52.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.204+0000 7f979299c700 1 --2- 172.21.15.71:0/951297579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f978c06d950 0x7f978c15bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:52.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.204+0000 7f979299c700 1 -- 172.21.15.71:0/951297579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f978c06a0a0 msgr2=0x7f978c0adec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:52.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.204+0000 7f979299c700 1 --2- 172.21.15.71:0/951297579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f978c06a0a0 0x7f978c0adec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:52.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.204+0000 7f979299c700 1 -- 172.21.15.71:0/951297579 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9784009ae0 con 0x7f978c06dd20 2023-10-09T08:17:52.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.204+0000 7f979299c700 1 --2- 172.21.15.71:0/951297579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f978c06dd20 0x7f978c15c1f0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f978400b610 tx=0x7f9784018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:52.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.205+0000 7f97827fc700 1 -- 172.21.15.71:0/951297579 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784008ad0 con 0x7f978c06dd20 2023-10-09T08:17:52.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.205+0000 7f97827fc700 1 -- 172.21.15.71:0/951297579 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9784008c30 con 0x7f978c06dd20 2023-10-09T08:17:52.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.205+0000 7f97827fc700 1 -- 172.21.15.71:0/951297579 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784026460 con 0x7f978c06dd20 2023-10-09T08:17:52.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.205+0000 7f979319d700 1 -- 172.21.15.71:0/951297579 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f978c0afbb0 con 0x7f978c06dd20 2023-10-09T08:17:52.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.205+0000 7f979319d700 1 -- 172.21.15.71:0/951297579 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f978c0ae400 con 0x7f978c06dd20 2023-10-09T08:17:52.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.206+0000 7f979319d700 1 -- 172.21.15.71:0/951297579 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f978c04c3c0 con 0x7f978c06dd20 2023-10-09T08:17:52.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.206+0000 7f97827fc700 1 -- 172.21.15.71:0/951297579 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 106) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f9784003040 con 0x7f978c06dd20 2023-10-09T08:17:52.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.207+0000 7f97827fc700 1 --2- 172.21.15.71:0/951297579 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f97700670e0 0x7f9770069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:52.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.208+0000 7f97827fc700 1 -- 172.21.15.71:0/951297579 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f9784086b70 con 0x7f978c06dd20 2023-10-09T08:17:52.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.208+0000 7f979219b700 1 -- 172.21.15.71:0/951297579 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f97700670e0 msgr2=0x7f9770069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:52.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.208+0000 7f979219b700 1 --2- 172.21.15.71:0/951297579 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f97700670e0 0x7f9770069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:52.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.211+0000 7f97827fc700 1 -- 172.21.15.71:0/951297579 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97840536a0 con 0x7f978c06dd20 2023-10-09T08:17:52.323 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:52.322+0000 7f5c5476a180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T08:17:52.352 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:52.351+0000 7fb5b9869180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T08:17:52.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.409+0000 7f979219b700 1 -- 172.21.15.71:0/951297579 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f97700670e0 msgr2=0x7f9770069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:52.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.409+0000 7f979219b700 1 --2- 172.21.15.71:0/951297579 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f97700670e0 0x7f9770069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:52.444 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:52.444+0000 7fb5b9869180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T08:17:52.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.455+0000 7f979319d700 1 -- 172.21.15.71:0/951297579 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f978c1538e0 con 0x7f978c06dd20 2023-10-09T08:17:52.456 INFO:tasks.ceph.mon.a.smithi071.stderr:2023-10-09T08:17:52.456+0000 7fdb445f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T08:17:52.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.461+0000 7f97827fc700 1 -- 172.21.15.71:0/951297579 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v98) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9784056cc0 con 0x7f978c06dd20 2023-10-09T08:17:52.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.463+0000 7f979319d700 1 -- 172.21.15.71:0/951297579 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f97700670e0 msgr2=0x7f9770069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:52.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.463+0000 7f979319d700 1 --2- 172.21.15.71:0/951297579 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f97700670e0 0x7f9770069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:52.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.463+0000 7f979319d700 1 -- 172.21.15.71:0/951297579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f978c06dd20 msgr2=0x7f978c15c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:52.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.463+0000 7f979319d700 1 --2- 172.21.15.71:0/951297579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f978c06dd20 0x7f978c15c1f0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f978400b610 tx=0x7f9784018000 comp rx=0 tx=0).stop 2023-10-09T08:17:52.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.463+0000 7f979319d700 1 -- 172.21.15.71:0/951297579 shutdown_connections 2023-10-09T08:17:52.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.463+0000 7f979319d700 1 --2- 172.21.15.71:0/951297579 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f97700670e0 0x7f9770069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:52.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.463+0000 7f979319d700 1 --2- 172.21.15.71:0/951297579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f978c06dd20 0x7f978c15c1f0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:52.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.463+0000 7f979319d700 1 --2- 172.21.15.71:0/951297579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f978c06a0a0 0x7f978c0adec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:52.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.463+0000 7f979319d700 1 --2- 172.21.15.71:0/951297579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f978c06d950 0x7f978c15bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:52.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.463+0000 7f979319d700 1 -- 172.21.15.71:0/951297579 >> 172.21.15.71:0/951297579 conn(0x7f978c0cc1f0 msgr2=0x7f978c0c1420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:52.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.463+0000 7f979319d700 1 -- 172.21.15.71:0/951297579 shutdown_connections 2023-10-09T08:17:52.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.464+0000 7f979319d700 1 -- 172.21.15.71:0/951297579 wait complete. 2023-10-09T08:17:52.466 INFO:teuthology.orchestra.run.smithi071.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T08:17:52.467 INFO:tasks.ceph.mds.c.smithi071.stderr: -2529> 2023-10-09T08:17:27.402+0000 7f92423f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T08:17:52.489 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T08:17:52.514 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-10-09T08:17:52.605 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:52.604+0000 7fb5b9869180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T08:17:52.624 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:52.623+0000 7f5c5476a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T08:17:52.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.679+0000 7f949f59e700 1 Processor -- start 2023-10-09T08:17:52.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.680+0000 7f949f59e700 1 -- start start 2023-10-09T08:17:52.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.681+0000 7f949f59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f94a00b4e70 0x7f94a00ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:52.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.681+0000 7f949f59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a00b16d0 0x7f94a00b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:52.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.681+0000 7f949f59e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a00b2080 con 0x7f94a015d240 2023-10-09T08:17:52.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.681+0000 7f949f59e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a00cfb00 con 0x7f94a00b4e70 2023-10-09T08:17:52.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.681+0000 7f949f59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a00b5c40 con 0x7f94a00b16d0 2023-10-09T08:17:52.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.681+0000 7f949dd9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a00b16d0 0x7f94a00b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:52.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.681+0000 7f949e59c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f94a00b4e70 0x7f94a00ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:52.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.681+0000 7f949dd9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a00b16d0 0x7f94a00b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:54182/0 (socket says 172.21.15.71:54182) 2023-10-09T08:17:52.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.681+0000 7f949dd9b700 1 -- 172.21.15.71:0/519449902 learned_addr learned my addr 172.21.15.71:0/519449902 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:52.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.681+0000 7f949e59c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f94a00b4e70 0x7f94a00ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:54050/0 (socket says 172.21.15.71:54050) 2023-10-09T08:17:52.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.682+0000 7f949e59c700 1 -- 172.21.15.71:0/519449902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a00b16d0 msgr2=0x7f94a00b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.682+0000 7f949e59c700 1 --2- 172.21.15.71:0/519449902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a00b16d0 0x7f94a00b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.682+0000 7f949e59c700 1 -- 172.21.15.71:0/519449902 >> v1:172.21.15.179:6789/0 conn(0x7f94a015d240 legacy=0x7f94a015d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.682+0000 7f949e59c700 1 -- 172.21.15.71:0/519449902 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a00b5f20 con 0x7f94a00b4e70 2023-10-09T08:17:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.682+0000 7f949dd9b700 1 --2- 172.21.15.71:0/519449902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a00b16d0 0x7f94a00b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.682+0000 7f949e59c700 1 --2- 172.21.15.71:0/519449902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94a00b4e70 0x7f94a00ccff0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f94900098e0 tx=0x7f94900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=784dc3289159e6da server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.682+0000 7f949d59a700 1 -- 172.21.15.71:0/519449902 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949000b640 con 0x7f94a00b4e70 2023-10-09T08:17:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.682+0000 7f949d59a700 1 -- 172.21.15.71:0/519449902 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949000b7a0 con 0x7f94a00b4e70 2023-10-09T08:17:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.682+0000 7f949d59a700 1 -- 172.21.15.71:0/519449902 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949000bb40 con 0x7f94a00b4e70 2023-10-09T08:17:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.683+0000 7f949f59e700 1 -- 172.21.15.71:0/519449902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94a00b4e70 msgr2=0x7f94a00ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:52.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.683+0000 7f949f59e700 1 --2- 172.21.15.71:0/519449902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94a00b4e70 0x7f94a00ccff0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f94900098e0 tx=0x7f94900091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.683+0000 7f949f59e700 1 -- 172.21.15.71:0/519449902 shutdown_connections 2023-10-09T08:17:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.683+0000 7f949f59e700 1 --2- 172.21.15.71:0/519449902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94a00b4e70 0x7f94a00ccff0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.683+0000 7f949f59e700 1 --2- 172.21.15.71:0/519449902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a00b16d0 0x7f94a00b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.683+0000 7f949f59e700 1 -- 172.21.15.71:0/519449902 >> 172.21.15.71:0/519449902 conn(0x7f94a00d10c0 msgr2=0x7f94a00affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.683+0000 7f949f59e700 1 -- 172.21.15.71:0/519449902 shutdown_connections 2023-10-09T08:17:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.683+0000 7f949f59e700 1 -- 172.21.15.71:0/519449902 wait complete. 2023-10-09T08:17:52.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.685+0000 7f949f59e700 1 Processor -- start 2023-10-09T08:17:52.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.685+0000 7f949f59e700 1 -- start start 2023-10-09T08:17:52.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.686+0000 7f949f59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94a00b16d0 0x7f94a014bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:52.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.686+0000 7f949f59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a00b4e70 0x7f94a00ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:52.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.686+0000 7f949f59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94a015d240 0x7f94a00caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:52.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.686+0000 7f949f59e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a00c89a0 con 0x7f94a00b16d0 2023-10-09T08:17:52.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.686+0000 7f949f59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a00c7d90 con 0x7f94a015d240 2023-10-09T08:17:52.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.686+0000 7f949f59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a00c8070 con 0x7f94a00b4e70 2023-10-09T08:17:52.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.686+0000 7f949e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94a00b16d0 0x7f94a014bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:52.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.686+0000 7f949dd9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a00b4e70 0x7f94a00ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:52.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.686+0000 7f949e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94a00b16d0 0x7f94a014bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37240/0 (socket says 172.21.15.71:37240) 2023-10-09T08:17:52.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.686+0000 7f949e59c700 1 -- 172.21.15.71:0/3789107205 learned_addr learned my addr 172.21.15.71:0/3789107205 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:52.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.686+0000 7f949ed9d700 1 --2- 172.21.15.71:0/3789107205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94a015d240 0x7f94a00caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:52.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.686+0000 7f949dd9b700 1 -- 172.21.15.71:0/3789107205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94a015d240 msgr2=0x7f94a00caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:52.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.686+0000 7f949dd9b700 1 --2- 172.21.15.71:0/3789107205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94a015d240 0x7f94a00caae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:52.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.686+0000 7f949dd9b700 1 -- 172.21.15.71:0/3789107205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94a00b16d0 msgr2=0x7f94a014bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:52.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.686+0000 7f949dd9b700 1 --2- 172.21.15.71:0/3789107205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94a00b16d0 0x7f94a014bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:52.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.686+0000 7f949dd9b700 1 -- 172.21.15.71:0/3789107205 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94940094f0 con 0x7f94a00b4e70 2023-10-09T08:17:52.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.687+0000 7f949dd9b700 1 --2- 172.21.15.71:0/3789107205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a00b4e70 0x7f94a00ca5a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9494006fd0 tx=0x7f9494009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:52.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.687+0000 7f948e7fc700 1 -- 172.21.15.71:0/3789107205 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949400c6a0 con 0x7f94a00b4e70 2023-10-09T08:17:52.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.687+0000 7f948e7fc700 1 -- 172.21.15.71:0/3789107205 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949400c800 con 0x7f94a00b4e70 2023-10-09T08:17:52.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.687+0000 7f948e7fc700 1 -- 172.21.15.71:0/3789107205 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949400cb80 con 0x7f94a00b4e70 2023-10-09T08:17:52.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.687+0000 7f949f59e700 1 -- 172.21.15.71:0/3789107205 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9490009420 con 0x7f94a00b4e70 2023-10-09T08:17:52.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.687+0000 7f949f59e700 1 -- 172.21.15.71:0/3789107205 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a00c8630 con 0x7f94a00b4e70 2023-10-09T08:17:52.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.688+0000 7f949f59e700 1 -- 172.21.15.71:0/3789107205 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a00c8b50 con 0x7f94a00b4e70 2023-10-09T08:17:52.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.689+0000 7f948e7fc700 1 -- 172.21.15.71:0/3789107205 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 106) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f9494013470 con 0x7f94a00b4e70 2023-10-09T08:17:52.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.690+0000 7f948e7fc700 1 --2- 172.21.15.71:0/3789107205 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f94800670e0 0x7f9480069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:52.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.690+0000 7f948e7fc700 1 -- 172.21.15.71:0/3789107205 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6569+0+0 (secure 0 0 0) 0x7f9494084d20 con 0x7f94a00b4e70 2023-10-09T08:17:52.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.690+0000 7f949e59c700 1 -- 172.21.15.71:0/3789107205 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f94800670e0 msgr2=0x7f9480069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:52.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.690+0000 7f949e59c700 1 --2- 172.21.15.71:0/3789107205 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f94800670e0 0x7f9480069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T08:17:52.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.699+0000 7f948e7fc700 1 -- 172.21.15.71:0/3789107205 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f94a00c8b50 con 0x7f94a00b4e70 2023-10-09T08:17:52.714 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:52.714+0000 7fb5b9869180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T08:17:52.723 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:52.722+0000 7f5c5476a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T08:17:52.883 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:52.882+0000 7f5c5476a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T08:17:52.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.891+0000 7f949e59c700 1 -- 172.21.15.71:0/3789107205 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f94800670e0 msgr2=0x7f9480069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.179:6835/101206 2023-10-09T08:17:52.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.891+0000 7f949e59c700 1 --2- 172.21.15.71:0/3789107205 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f94800670e0 0x7f9480069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T08:17:52.905 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:52.905+0000 7fb5b9869180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T08:17:52.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:52.943+0000 7f949f59e700 1 -- 172.21.15.71:0/3789107205 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f94a00c8b10 con 0x7f94a00b4e70 2023-10-09T08:17:52.991 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:52.990+0000 7f5c5476a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T08:17:52.999 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:52.999+0000 7fb5b9869180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T08:17:53.094 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:53.094+0000 7fb5b9869180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T08:17:53.184 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:53.183+0000 7f5c5476a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T08:17:53.189 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:53.189+0000 7fb5b9869180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T08:17:53.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.199+0000 7f948e7fc700 1 -- 172.21.15.71:0/3789107205 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mgrmap(e 107) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f9494051ce0 con 0x7f94a00b4e70 2023-10-09T08:17:53.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.199+0000 7f948e7fc700 1 -- 172.21.15.71:0/3789107205 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f94800670e0 msgr2=0x7f9480069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T08:17:53.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.199+0000 7f948e7fc700 1 --2- 172.21.15.71:0/3789107205 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f94800670e0 0x7f9480069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:53.272 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:53.271+0000 7fb534bc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:53.272 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:53.271+0000 7fb534bc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:53.272 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:53.271+0000 7fb534bc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:53.272 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:53.271+0000 7fb534bc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:53.272 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:53.271+0000 7fb534bc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:53.272 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:53.272+0000 7fb537bc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:53.273 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:53.272+0000 7fb537bc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:53.273 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:53.272+0000 7fb537bc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:53.273 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:53.272+0000 7fb537bc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:53.273 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-10-09T08:17:53.272+0000 7fb537bc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T08:17:53.288 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:53.287+0000 7f5c5476a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T08:17:53.381 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:53.380+0000 7f5c5476a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T08:17:53.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.463+0000 7f948e7fc700 1 -- 172.21.15.71:0/3789107205 <== mon.2 v2:172.21.15.179:3301/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v99) v1 ==== 104+0+0 (secure 0 0 0) 0x7f949406f8c0 con 0x7f94a00b4e70 2023-10-09T08:17:53.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.465+0000 7f949f59e700 1 -- 172.21.15.71:0/3789107205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a00b4e70 msgr2=0x7f94a00ca5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:53.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.465+0000 7f949f59e700 1 --2- 172.21.15.71:0/3789107205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a00b4e70 0x7f94a00ca5a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9494006fd0 tx=0x7f9494009250 comp rx=0 tx=0).stop 2023-10-09T08:17:53.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.465+0000 7f949f59e700 1 -- 172.21.15.71:0/3789107205 shutdown_connections 2023-10-09T08:17:53.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.465+0000 7f949f59e700 1 --2- 172.21.15.71:0/3789107205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94a015d240 0x7f94a00caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:53.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.465+0000 7f949f59e700 1 --2- 172.21.15.71:0/3789107205 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f94800670e0 0x7f9480069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:53.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.465+0000 7f949f59e700 1 --2- 172.21.15.71:0/3789107205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94a00b16d0 0x7f94a014bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:53.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.465+0000 7f949f59e700 1 --2- 172.21.15.71:0/3789107205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a00b4e70 0x7f94a00ca5a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:53.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.465+0000 7f949f59e700 1 -- 172.21.15.71:0/3789107205 >> 172.21.15.71:0/3789107205 conn(0x7f94a00d10c0 msgr2=0x7f94a00b54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:53.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.465+0000 7f949f59e700 1 -- 172.21.15.71:0/3789107205 shutdown_connections 2023-10-09T08:17:53.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.465+0000 7f949f59e700 1 -- 172.21.15.71:0/3789107205 wait complete. 2023-10-09T08:17:53.477 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-09T08:17:53.476+0000 7f5c5476a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T08:17:53.484 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T08:17:53.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.709+0000 7fc6a63ff700 1 Processor -- start 2023-10-09T08:17:53.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.709+0000 7fc6a63ff700 1 -- start start 2023-10-09T08:17:53.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.711+0000 7fc6a63ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6a015a440 0x7fc6a00acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:53.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.711+0000 7fc6a63ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a015a9b0 con 0x7fc6a0068890 2023-10-09T08:17:53.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.711+0000 7fc6a63ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a015ac90 con 0x7fc6a01563b0 2023-10-09T08:17:53.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.711+0000 7fc6a63ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a015af70 con 0x7fc6a015a440 2023-10-09T08:17:53.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.711+0000 7fc6a499c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc6a0068890 0x7fc6a00c8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48482/0 (socket says 172.21.15.71:48482) 2023-10-09T08:17:53.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.711+0000 7fc6a499c700 1 -- 172.21.15.71:0/2036048093 learned_addr learned my addr 172.21.15.71:0/2036048093 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:53.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.711+0000 7fc69f7fe700 1 --2- 172.21.15.71:0/2036048093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6a015a440 0x7fc6a00acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:53.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.711+0000 7fc69effd700 1 -- 172.21.15.71:0/2036048093 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3264769441 0 0) 0x7fc6a015a9b0 con 0x7fc6a0068890 2023-10-09T08:17:53.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.711+0000 7fc69effd700 1 -- 172.21.15.71:0/2036048093 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc688003570 con 0x7fc6a0068890 2023-10-09T08:17:53.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.711+0000 7fc69effd700 1 -- 172.21.15.71:0/2036048093 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180198279 0 0) 0x7fc6a015ac90 con 0x7fc6a01563b0 2023-10-09T08:17:53.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.711+0000 7fc69effd700 1 -- 172.21.15.71:0/2036048093 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6a015a9b0 con 0x7fc6a01563b0 2023-10-09T08:17:53.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.711+0000 7fc69f7fe700 1 -- 172.21.15.71:0/2036048093 >> v1:172.21.15.179:6789/0 conn(0x7fc6a01563b0 legacy=0x7fc6a0156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:53.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.711+0000 7fc69f7fe700 1 -- 172.21.15.71:0/2036048093 >> v1:172.21.15.71:6789/0 conn(0x7fc6a0068890 legacy=0x7fc6a00c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:53.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.711+0000 7fc69f7fe700 1 -- 172.21.15.71:0/2036048093 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a015b250 con 0x7fc6a015a440 2023-10-09T08:17:53.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.712+0000 7fc69f7fe700 1 --2- 172.21.15.71:0/2036048093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6a015a440 0x7fc6a00acf30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc694009910 tx=0x7fc6940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=482d4cea0b754a46 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:53.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.712+0000 7fc69effd700 1 -- 172.21.15.71:0/2036048093 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694011630 con 0x7fc6a015a440 2023-10-09T08:17:53.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.712+0000 7fc69effd700 1 -- 172.21.15.71:0/2036048093 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc694011790 con 0x7fc6a015a440 2023-10-09T08:17:53.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.712+0000 7fc69effd700 1 -- 172.21.15.71:0/2036048093 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694011b30 con 0x7fc6a015a440 2023-10-09T08:17:53.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.713+0000 7fc6a63ff700 1 -- 172.21.15.71:0/2036048093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6a015a440 msgr2=0x7fc6a00acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:53.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.713+0000 7fc6a63ff700 1 --2- 172.21.15.71:0/2036048093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6a015a440 0x7fc6a00acf30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc694009910 tx=0x7fc6940091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:53.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.713+0000 7fc6a63ff700 1 -- 172.21.15.71:0/2036048093 shutdown_connections 2023-10-09T08:17:53.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.713+0000 7fc6a63ff700 1 --2- 172.21.15.71:0/2036048093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6a015a440 0x7fc6a00acf30 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:53.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.713+0000 7fc6a63ff700 1 -- 172.21.15.71:0/2036048093 >> 172.21.15.71:0/2036048093 conn(0x7fc6a00c8f90 msgr2=0x7fc6a00c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:53.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.713+0000 7fc6a63ff700 1 -- 172.21.15.71:0/2036048093 shutdown_connections 2023-10-09T08:17:53.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.713+0000 7fc6a63ff700 1 -- 172.21.15.71:0/2036048093 wait complete. 2023-10-09T08:17:53.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.714+0000 7fc6a63ff700 1 Processor -- start 2023-10-09T08:17:53.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.714+0000 7fc6a63ff700 1 -- start start 2023-10-09T08:17:53.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.715+0000 7fc6a63ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6a0068890 0x7fc6a0152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:53.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.715+0000 7fc6a63ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6a01563b0 0x7fc6a00b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:53.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.715+0000 7fc6a63ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6a015a440 0x7fc6a00b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:53.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.715+0000 7fc6a63ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a00aafa0 con 0x7fc6a0068890 2023-10-09T08:17:53.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.715+0000 7fc6a63ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a0153100 con 0x7fc6a015a440 2023-10-09T08:17:53.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.715+0000 7fc6a63ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a00aa390 con 0x7fc6a01563b0 2023-10-09T08:17:53.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.715+0000 7fc69ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6a0068890 0x7fc6a0152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:53.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.715+0000 7fc69ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6a0068890 0x7fc6a0152bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37248/0 (socket says 172.21.15.71:37248) 2023-10-09T08:17:53.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.715+0000 7fc69ffff700 1 -- 172.21.15.71:0/4255814683 learned_addr learned my addr 172.21.15.71:0/4255814683 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:53.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.716+0000 7fc69f7fe700 1 --2- 172.21.15.71:0/4255814683 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6a01563b0 0x7fc6a00b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:53.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.716+0000 7fc6a499c700 1 --2- 172.21.15.71:0/4255814683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6a015a440 0x7fc6a00b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:53.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.716+0000 7fc69ffff700 1 -- 172.21.15.71:0/4255814683 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6a01563b0 msgr2=0x7fc6a00b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:53.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.716+0000 7fc69ffff700 1 --2- 172.21.15.71:0/4255814683 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6a01563b0 0x7fc6a00b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:53.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.716+0000 7fc69ffff700 1 -- 172.21.15.71:0/4255814683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6a015a440 msgr2=0x7fc6a00b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:53.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.716+0000 7fc69ffff700 1 --2- 172.21.15.71:0/4255814683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6a015a440 0x7fc6a00b1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:53.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.716+0000 7fc69ffff700 1 -- 172.21.15.71:0/4255814683 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc694009420 con 0x7fc6a0068890 2023-10-09T08:17:53.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.716+0000 7fc69f7fe700 1 --2- 172.21.15.71:0/4255814683 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6a01563b0 0x7fc6a00b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:53.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.716+0000 7fc6a499c700 1 --2- 172.21.15.71:0/4255814683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6a015a440 0x7fc6a00b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:53.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.716+0000 7fc69ffff700 1 --2- 172.21.15.71:0/4255814683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6a0068890 0x7fc6a0152bc0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fc69000c7c0 tx=0x7fc690007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:53.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.716+0000 7fc687fff700 1 -- 172.21.15.71:0/4255814683 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc690010510 con 0x7fc6a0068890 2023-10-09T08:17:53.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.716+0000 7fc687fff700 1 -- 172.21.15.71:0/4255814683 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc690010690 con 0x7fc6a0068890 2023-10-09T08:17:53.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.716+0000 7fc687fff700 1 -- 172.21.15.71:0/4255814683 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc690010a50 con 0x7fc6a0068890 2023-10-09T08:17:53.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.716+0000 7fc6a63ff700 1 -- 172.21.15.71:0/4255814683 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a00aa670 con 0x7fc6a0068890 2023-10-09T08:17:53.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.716+0000 7fc6a63ff700 1 -- 172.21.15.71:0/4255814683 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a00aac30 con 0x7fc6a0068890 2023-10-09T08:17:53.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.717+0000 7fc6a63ff700 1 -- 172.21.15.71:0/4255814683 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a00718b0 con 0x7fc6a0068890 2023-10-09T08:17:53.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.718+0000 7fc687fff700 1 -- 172.21.15.71:0/4255814683 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 107) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fc69001b400 con 0x7fc6a0068890 2023-10-09T08:17:53.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.719+0000 7fc687fff700 1 -- 172.21.15.71:0/4255814683 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6870+0+0 (secure 0 0 0) 0x7fc690084290 con 0x7fc6a0068890 2023-10-09T08:17:53.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.723+0000 7fc687fff700 1 -- 172.21.15.71:0/4255814683 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc690051340 con 0x7fc6a0068890 2023-10-09T08:17:53.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:53.913+0000 7fc6a63ff700 1 -- 172.21.15.71:0/4255814683 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc6a006d6a0 con 0x7fc6a0068890 2023-10-09T08:17:54.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.203+0000 7fc687fff700 1 -- 172.21.15.71:0/4255814683 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 108) v1 ==== 84578+0+0 (secure 0 0 0) 0x7fc690050df0 con 0x7fc6a0068890 2023-10-09T08:17:54.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.203+0000 7fc687fff700 1 --2- 172.21.15.71:0/4255814683 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc68c06cbb0 0x7fc68c06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:54.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.207+0000 7fc69f7fe700 1 --2- 172.21.15.71:0/4255814683 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc68c06cbb0 0x7fc68c06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:54.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.212+0000 7fc69f7fe700 1 --2- 172.21.15.71:0/4255814683 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc68c06cbb0 0x7fc68c06ef90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc694009860 tx=0x7fc694017000 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:54.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.465+0000 7fc687fff700 1 -- 172.21.15.71:0/4255814683 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v214) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc69006f6c0 con 0x7fc6a0068890 2023-10-09T08:17:54.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.468+0000 7fc6a63ff700 1 -- 172.21.15.71:0/4255814683 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc68c06cbb0 msgr2=0x7fc68c06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:54.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.468+0000 7fc6a63ff700 1 --2- 172.21.15.71:0/4255814683 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc68c06cbb0 0x7fc68c06ef90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc694009860 tx=0x7fc694017000 comp rx=0 tx=0).stop 2023-10-09T08:17:54.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.468+0000 7fc6a63ff700 1 -- 172.21.15.71:0/4255814683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6a0068890 msgr2=0x7fc6a0152bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:54.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.468+0000 7fc6a63ff700 1 --2- 172.21.15.71:0/4255814683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6a0068890 0x7fc6a0152bc0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fc69000c7c0 tx=0x7fc690007e10 comp rx=0 tx=0).stop 2023-10-09T08:17:54.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.468+0000 7fc6a63ff700 1 -- 172.21.15.71:0/4255814683 shutdown_connections 2023-10-09T08:17:54.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.468+0000 7fc6a63ff700 1 --2- 172.21.15.71:0/4255814683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6a015a440 0x7fc6a00b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:54.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.468+0000 7fc6a63ff700 1 --2- 172.21.15.71:0/4255814683 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fc68c06cbb0 0x7fc68c06ef90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:54.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.468+0000 7fc6a63ff700 1 --2- 172.21.15.71:0/4255814683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6a0068890 0x7fc6a0152bc0 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:54.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.468+0000 7fc6a63ff700 1 --2- 172.21.15.71:0/4255814683 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6a01563b0 0x7fc6a00b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:54.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.468+0000 7fc6a63ff700 1 -- 172.21.15.71:0/4255814683 >> 172.21.15.71:0/4255814683 conn(0x7fc6a00c8f90 msgr2=0x7fc6a0155980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:54.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.468+0000 7fc6a63ff700 1 -- 172.21.15.71:0/4255814683 shutdown_connections 2023-10-09T08:17:54.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.469+0000 7fc6a63ff700 1 -- 172.21.15.71:0/4255814683 wait complete. 2023-10-09T08:17:54.472 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' removed 2023-10-09T08:17:54.487 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T08:17:54.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.670+0000 7fb9df9ff700 1 Processor -- start 2023-10-09T08:17:54.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.670+0000 7fb9df9ff700 1 -- start start 2023-10-09T08:17:54.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.671+0000 7fb9df9ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb9d8069a50 0x7fb9d80c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:54.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.671+0000 7fb9df9ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d80ac030 con 0x7fb9d80c8490 2023-10-09T08:17:54.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.671+0000 7fb9df9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d80ab820 con 0x7fb9d8069e20 2023-10-09T08:17:54.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.671+0000 7fb9df9ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9d806dbb0 con 0x7fb9d8069a50 2023-10-09T08:17:54.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.672+0000 7fb9dd79b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb9d8069a50 0x7fb9d80c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:54.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.672+0000 7fb9dcf9a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb9d80c8490 0x7fb9d815a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48488/0 (socket says 172.21.15.71:48488) 2023-10-09T08:17:54.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.672+0000 7fb9dcf9a700 1 -- 172.21.15.71:0/3970167583 learned_addr learned my addr 172.21.15.71:0/3970167583 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:54.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.672+0000 7fb9dd79b700 1 -- 172.21.15.71:0/3970167583 >> v1:172.21.15.179:6789/0 conn(0x7fb9d8069e20 legacy=0x7fb9d81569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:54.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.672+0000 7fb9dd79b700 1 -- 172.21.15.71:0/3970167583 >> v1:172.21.15.71:6789/0 conn(0x7fb9d80c8490 legacy=0x7fb9d815a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:54.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.672+0000 7fb9dd79b700 1 -- 172.21.15.71:0/3970167583 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d80aba70 con 0x7fb9d8069a50 2023-10-09T08:17:54.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.672+0000 7fb9cffff700 1 -- 172.21.15.71:0/3970167583 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886234901 0 0) 0x7fb9c8001110 con 0x7fb9d80c8490 2023-10-09T08:17:54.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.672+0000 7fb9dd79b700 1 --2- 172.21.15.71:0/3970167583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb9d8069a50 0x7fb9d80c6ac0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40098e0 tx=0x7fb9d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ebee269112eff4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:54.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.673+0000 7fb9cffff700 1 -- 172.21.15.71:0/3970167583 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4009e80 con 0x7fb9d8069a50 2023-10-09T08:17:54.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.673+0000 7fb9cffff700 1 -- 172.21.15.71:0/3970167583 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d400b820 con 0x7fb9d8069a50 2023-10-09T08:17:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.673+0000 7fb9cffff700 1 -- 172.21.15.71:0/3970167583 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d400bba0 con 0x7fb9d8069a50 2023-10-09T08:17:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.673+0000 7fb9df9ff700 1 -- 172.21.15.71:0/3970167583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb9d8069a50 msgr2=0x7fb9d80c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.673+0000 7fb9df9ff700 1 --2- 172.21.15.71:0/3970167583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb9d8069a50 0x7fb9d80c6ac0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40098e0 tx=0x7fb9d40091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.673+0000 7fb9df9ff700 1 -- 172.21.15.71:0/3970167583 shutdown_connections 2023-10-09T08:17:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.673+0000 7fb9df9ff700 1 --2- 172.21.15.71:0/3970167583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb9d8069a50 0x7fb9d80c6ac0 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.673+0000 7fb9df9ff700 1 -- 172.21.15.71:0/3970167583 >> 172.21.15.71:0/3970167583 conn(0x7fb9d80c8f90 msgr2=0x7fb9d80c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.673+0000 7fb9df9ff700 1 -- 172.21.15.71:0/3970167583 shutdown_connections 2023-10-09T08:17:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.673+0000 7fb9df9ff700 1 -- 172.21.15.71:0/3970167583 wait complete. 2023-10-09T08:17:54.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.675+0000 7fb9df9ff700 1 Processor -- start 2023-10-09T08:17:54.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.675+0000 7fb9df9ff700 1 -- start start 2023-10-09T08:17:54.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.676+0000 7fb9df9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9d8069a50 0x7fb9d80af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:54.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.676+0000 7fb9df9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb9d8069e20 0x7fb9d80c3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:54.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.676+0000 7fb9df9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9d80c8490 0x7fb9d8159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:54.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.676+0000 7fb9df9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d80c3a70 con 0x7fb9d8069e20 2023-10-09T08:17:54.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.676+0000 7fb9df9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d80af8b0 con 0x7fb9d8069a50 2023-10-09T08:17:54.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.676+0000 7fb9df9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d80afb90 con 0x7fb9d80c8490 2023-10-09T08:17:54.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.676+0000 7fb9dcf9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb9d8069e20 0x7fb9d80c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:54.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.676+0000 7fb9dcf9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb9d8069e20 0x7fb9d80c3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37264/0 (socket says 172.21.15.71:37264) 2023-10-09T08:17:54.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.676+0000 7fb9dcf9a700 1 -- 172.21.15.71:0/3026519101 learned_addr learned my addr 172.21.15.71:0/3026519101 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:54.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.676+0000 7fb9dd79b700 1 --2- 172.21.15.71:0/3026519101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9d8069a50 0x7fb9d80af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:54.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.676+0000 7fb9ddf9c700 1 --2- 172.21.15.71:0/3026519101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9d80c8490 0x7fb9d8159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:54.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.677+0000 7fb9dcf9a700 1 -- 172.21.15.71:0/3026519101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9d80c8490 msgr2=0x7fb9d8159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:54.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.677+0000 7fb9dcf9a700 1 --2- 172.21.15.71:0/3026519101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9d80c8490 0x7fb9d8159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:54.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.677+0000 7fb9dcf9a700 1 -- 172.21.15.71:0/3026519101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9d8069a50 msgr2=0x7fb9d80af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:54.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.677+0000 7fb9dcf9a700 1 --2- 172.21.15.71:0/3026519101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9d8069a50 0x7fb9d80af2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:54.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.677+0000 7fb9dcf9a700 1 -- 172.21.15.71:0/3026519101 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d4009420 con 0x7fb9d8069e20 2023-10-09T08:17:54.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.677+0000 7fb9dcf9a700 1 --2- 172.21.15.71:0/3026519101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb9d8069e20 0x7fb9d80c3530 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800c810 tx=0x7fb9c8007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.677+0000 7fb9cd7fa700 1 -- 172.21.15.71:0/3026519101 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8005b30 con 0x7fb9d8069e20 2023-10-09T08:17:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.677+0000 7fb9cd7fa700 1 -- 172.21.15.71:0/3026519101 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c8005c90 con 0x7fb9d8069e20 2023-10-09T08:17:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.677+0000 7fb9cd7fa700 1 -- 172.21.15.71:0/3026519101 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8007300 con 0x7fb9d8069e20 2023-10-09T08:17:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.677+0000 7fb9df9ff700 1 -- 172.21.15.71:0/3026519101 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d80afe70 con 0x7fb9d8069e20 2023-10-09T08:17:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.677+0000 7fb9df9ff700 1 -- 172.21.15.71:0/3026519101 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d80b0430 con 0x7fb9d8069e20 2023-10-09T08:17:54.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.678+0000 7fb9df9ff700 1 -- 172.21.15.71:0/3026519101 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d80b0650 con 0x7fb9d8069e20 2023-10-09T08:17:54.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.679+0000 7fb9cd7fa700 1 -- 172.21.15.71:0/3026519101 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 108) v1 ==== 84578+0+0 (secure 0 0 0) 0x7fb9c80076f0 con 0x7fb9d8069e20 2023-10-09T08:17:54.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.680+0000 7fb9cd7fa700 1 --2- 172.21.15.71:0/3026519101 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb9bc066d80 0x7fb9bc069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:54.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.680+0000 7fb9cd7fa700 1 -- 172.21.15.71:0/3026519101 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6432+0+0 (secure 0 0 0) 0x7fb9c8083f70 con 0x7fb9d8069e20 2023-10-09T08:17:54.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.680+0000 7fb9dd79b700 1 --2- 172.21.15.71:0/3026519101 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb9bc066d80 0x7fb9bc069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:54.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.681+0000 7fb9dd79b700 1 --2- 172.21.15.71:0/3026519101 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb9bc066d80 0x7fb9bc069230 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40030c0 tx=0x7fb9d4016000 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:54.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.684+0000 7fb9cd7fa700 1 -- 172.21.15.71:0/3026519101 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9c8054ba0 con 0x7fb9d8069e20 2023-10-09T08:17:54.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:54.873+0000 7fb9df9ff700 1 -- 172.21.15.71:0/3026519101 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb9d80ac030 con 0x7fb9d8069e20 2023-10-09T08:17:55.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.466+0000 7fb9cd7fa700 1 -- 172.21.15.71:0/3026519101 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v215) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb9d80ac030 con 0x7fb9d8069e20 2023-10-09T08:17:55.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.469+0000 7fb9df9ff700 1 -- 172.21.15.71:0/3026519101 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb9bc066d80 msgr2=0x7fb9bc069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:55.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.470+0000 7fb9df9ff700 1 --2- 172.21.15.71:0/3026519101 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb9bc066d80 0x7fb9bc069230 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40030c0 tx=0x7fb9d4016000 comp rx=0 tx=0).stop 2023-10-09T08:17:55.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.470+0000 7fb9df9ff700 1 -- 172.21.15.71:0/3026519101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb9d8069e20 msgr2=0x7fb9d80c3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:55.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.470+0000 7fb9df9ff700 1 --2- 172.21.15.71:0/3026519101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb9d8069e20 0x7fb9d80c3530 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800c810 tx=0x7fb9c8007c50 comp rx=0 tx=0).stop 2023-10-09T08:17:55.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.470+0000 7fb9df9ff700 1 -- 172.21.15.71:0/3026519101 shutdown_connections 2023-10-09T08:17:55.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.470+0000 7fb9df9ff700 1 --2- 172.21.15.71:0/3026519101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9d80c8490 0x7fb9d8159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:55.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.470+0000 7fb9df9ff700 1 --2- 172.21.15.71:0/3026519101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9d8069a50 0x7fb9d80af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:55.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.470+0000 7fb9df9ff700 1 --2- 172.21.15.71:0/3026519101 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb9bc066d80 0x7fb9bc069230 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:55.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.470+0000 7fb9df9ff700 1 --2- 172.21.15.71:0/3026519101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb9d8069e20 0x7fb9d80c3530 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:55.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.470+0000 7fb9df9ff700 1 -- 172.21.15.71:0/3026519101 >> 172.21.15.71:0/3026519101 conn(0x7fb9d80c8f90 msgr2=0x7fb9d80cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:55.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.470+0000 7fb9df9ff700 1 -- 172.21.15.71:0/3026519101 shutdown_connections 2023-10-09T08:17:55.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.470+0000 7fb9df9ff700 1 -- 172.21.15.71:0/3026519101 wait complete. 2023-10-09T08:17:55.472 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' removed 2023-10-09T08:17:55.490 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T08:17:55.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.673+0000 7fab54bff700 1 Processor -- start 2023-10-09T08:17:55.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.673+0000 7fab54bff700 1 -- start start 2023-10-09T08:17:55.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.674+0000 7fab54bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab50155eb0 0x7fab5006e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:55.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.674+0000 7fab54bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fab50069e80 0x7fab500ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:55.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.674+0000 7fab54bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab5006eb90 con 0x7fab500c70b0 2023-10-09T08:17:55.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.674+0000 7fab54bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5006ee70 con 0x7fab50069e80 2023-10-09T08:17:55.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.674+0000 7fab54bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5006f150 con 0x7fab50155eb0 2023-10-09T08:17:55.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.675+0000 7fab4ed9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fab50069e80 0x7fab500ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:55.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.675+0000 7fab4ed9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fab50069e80 0x7fab500ca4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40076/0 (socket says 172.21.15.71:40076) 2023-10-09T08:17:55.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.675+0000 7fab4ed9d700 1 -- 172.21.15.71:0/1037459387 learned_addr learned my addr 172.21.15.71:0/1037459387 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:55.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.675+0000 7fab4e59c700 1 --2- 172.21.15.71:0/1037459387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab50155eb0 0x7fab5006e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:55.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.675+0000 7fab4ed9d700 1 -- 172.21.15.71:0/1037459387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab50155eb0 msgr2=0x7fab5006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:55.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.675+0000 7fab4ed9d700 1 --2- 172.21.15.71:0/1037459387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab50155eb0 0x7fab5006e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:55.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.675+0000 7fab4ed9d700 1 -- 172.21.15.71:0/1037459387 >> v1:172.21.15.179:6789/0 conn(0x7fab500c70b0 legacy=0x7fab50069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:55.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.675+0000 7fab4ed9d700 1 -- 172.21.15.71:0/1037459387 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5006f430 con 0x7fab50069e80 2023-10-09T08:17:55.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.675+0000 7fab4ed9d700 1 --2- 172.21.15.71:0/1037459387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab50069e80 0x7fab500ca4c0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fab4800d1a0 tx=0x7fab4800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9fc3f9cb77b3ae2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:55.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.676+0000 7fab4d59a700 1 -- 172.21.15.71:0/1037459387 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab48010070 con 0x7fab50069e80 2023-10-09T08:17:55.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.676+0000 7fab4d59a700 1 -- 172.21.15.71:0/1037459387 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4800de80 con 0x7fab50069e80 2023-10-09T08:17:55.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.676+0000 7fab4d59a700 1 -- 172.21.15.71:0/1037459387 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4800b320 con 0x7fab50069e80 2023-10-09T08:17:55.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.676+0000 7fab54bff700 1 -- 172.21.15.71:0/1037459387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab50069e80 msgr2=0x7fab500ca4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:55.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.676+0000 7fab54bff700 1 --2- 172.21.15.71:0/1037459387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab50069e80 0x7fab500ca4c0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fab4800d1a0 tx=0x7fab4800ba50 comp rx=0 tx=0).stop 2023-10-09T08:17:55.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.676+0000 7fab54bff700 1 -- 172.21.15.71:0/1037459387 shutdown_connections 2023-10-09T08:17:55.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.676+0000 7fab54bff700 1 --2- 172.21.15.71:0/1037459387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab50069e80 0x7fab500ca4c0 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:55.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.676+0000 7fab54bff700 1 --2- 172.21.15.71:0/1037459387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab50155eb0 0x7fab5006e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:55.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.676+0000 7fab54bff700 1 -- 172.21.15.71:0/1037459387 >> 172.21.15.71:0/1037459387 conn(0x7fab50068e10 msgr2=0x7fab500cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:55.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.676+0000 7fab54bff700 1 -- 172.21.15.71:0/1037459387 shutdown_connections 2023-10-09T08:17:55.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.676+0000 7fab54bff700 1 -- 172.21.15.71:0/1037459387 wait complete. 2023-10-09T08:17:55.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.678+0000 7fab54bff700 1 Processor -- start 2023-10-09T08:17:55.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.678+0000 7fab54bff700 1 -- start start 2023-10-09T08:17:55.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.679+0000 7fab54bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab50069e80 0x7fab500ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:55.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.679+0000 7fab54bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab500c70b0 0x7fab501550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:55.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.679+0000 7fab54bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab50155eb0 0x7fab500c3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:55.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.679+0000 7fab54bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab500adac0 con 0x7fab50069e80 2023-10-09T08:17:55.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.679+0000 7fab54bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab500adda0 con 0x7fab500c70b0 2023-10-09T08:17:55.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.679+0000 7fab54bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab500ae080 con 0x7fab50155eb0 2023-10-09T08:17:55.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.679+0000 7fab4e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab50069e80 0x7fab500ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:55.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.679+0000 7fab4e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab50069e80 0x7fab500ad4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40084/0 (socket says 172.21.15.71:40084) 2023-10-09T08:17:55.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.679+0000 7fab4e59c700 1 -- 172.21.15.71:0/1192986188 learned_addr learned my addr 172.21.15.71:0/1192986188 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:55.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.679+0000 7fab4ed9d700 1 --2- 172.21.15.71:0/1192986188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab50155eb0 0x7fab500c3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:55.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.679+0000 7fab4e59c700 1 -- 172.21.15.71:0/1192986188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab50155eb0 msgr2=0x7fab500c3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:55.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.679+0000 7fab4e59c700 1 --2- 172.21.15.71:0/1192986188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab50155eb0 0x7fab500c3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:55.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.679+0000 7fab4e59c700 1 -- 172.21.15.71:0/1192986188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab500c70b0 msgr2=0x7fab501550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:55.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.679+0000 7fab4dd9b700 1 --2- 172.21.15.71:0/1192986188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab500c70b0 0x7fab501550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:55.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.679+0000 7fab4e59c700 1 --2- 172.21.15.71:0/1192986188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab500c70b0 0x7fab501550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:55.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.679+0000 7fab4e59c700 1 -- 172.21.15.71:0/1192986188 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4800bcf0 con 0x7fab50069e80 2023-10-09T08:17:55.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.679+0000 7fab4ed9d700 1 --2- 172.21.15.71:0/1192986188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab50155eb0 0x7fab500c3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:55.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.679+0000 7fab4dd9b700 1 --2- 172.21.15.71:0/1192986188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab500c70b0 0x7fab501550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:55.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.680+0000 7fab4e59c700 1 --2- 172.21.15.71:0/1192986188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab50069e80 0x7fab500ad4b0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fab4000d860 tx=0x7fab40008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:55.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.680+0000 7fab3e7fc700 1 -- 172.21.15.71:0/1192986188 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab400125f0 con 0x7fab50069e80 2023-10-09T08:17:55.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.680+0000 7fab3e7fc700 1 -- 172.21.15.71:0/1192986188 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab40012750 con 0x7fab50069e80 2023-10-09T08:17:55.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.680+0000 7fab3e7fc700 1 -- 172.21.15.71:0/1192986188 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40012b10 con 0x7fab50069e80 2023-10-09T08:17:55.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.680+0000 7fab54bff700 1 -- 172.21.15.71:0/1192986188 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab500ae360 con 0x7fab50069e80 2023-10-09T08:17:55.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.680+0000 7fab54bff700 1 -- 172.21.15.71:0/1192986188 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab500c3ff0 con 0x7fab50069e80 2023-10-09T08:17:55.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.681+0000 7fab54bff700 1 -- 172.21.15.71:0/1192986188 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab5004c3c0 con 0x7fab50069e80 2023-10-09T08:17:55.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.682+0000 7fab3e7fc700 1 -- 172.21.15.71:0/1192986188 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 108) v1 ==== 84578+0+0 (secure 0 0 0) 0x7fab4001e460 con 0x7fab50069e80 2023-10-09T08:17:55.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.683+0000 7fab3e7fc700 1 --2- 172.21.15.71:0/1192986188 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fab30066d80 0x7fab30069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:55.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.684+0000 7fab3e7fc700 1 -- 172.21.15.71:0/1192986188 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7fab40084ab0 con 0x7fab50069e80 2023-10-09T08:17:55.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.684+0000 7fab4dd9b700 1 --2- 172.21.15.71:0/1192986188 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fab30066d80 0x7fab30069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:55.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.685+0000 7fab4dd9b700 1 --2- 172.21.15.71:0/1192986188 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fab30066d80 0x7fab30069230 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fab500ad9f0 tx=0x7fab44009040 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:55.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.688+0000 7fab3e7fc700 1 -- 172.21.15.71:0/1192986188 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab40051dc0 con 0x7fab50069e80 2023-10-09T08:17:55.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.878+0000 7fab54bff700 1 -- 172.21.15.71:0/1192986188 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fab50156280 con 0x7fab50069e80 2023-10-09T08:17:55.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.882+0000 7fab3e7fc700 1 -- 172.21.15.71:0/1192986188 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v73) v1 ==== 104+0+0 (secure 0 0 0) 0x7fab400553e0 con 0x7fab50069e80 2023-10-09T08:17:55.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.884+0000 7fab54bff700 1 -- 172.21.15.71:0/1192986188 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fab30066d80 msgr2=0x7fab30069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:55.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.884+0000 7fab54bff700 1 --2- 172.21.15.71:0/1192986188 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fab30066d80 0x7fab30069230 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fab500ad9f0 tx=0x7fab44009040 comp rx=0 tx=0).stop 2023-10-09T08:17:55.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.884+0000 7fab54bff700 1 -- 172.21.15.71:0/1192986188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab50069e80 msgr2=0x7fab500ad4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:55.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.884+0000 7fab54bff700 1 --2- 172.21.15.71:0/1192986188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab50069e80 0x7fab500ad4b0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fab4000d860 tx=0x7fab40008040 comp rx=0 tx=0).stop 2023-10-09T08:17:55.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.884+0000 7fab54bff700 1 -- 172.21.15.71:0/1192986188 shutdown_connections 2023-10-09T08:17:55.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.884+0000 7fab54bff700 1 --2- 172.21.15.71:0/1192986188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab50155eb0 0x7fab500c3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:55.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.884+0000 7fab54bff700 1 --2- 172.21.15.71:0/1192986188 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fab30066d80 0x7fab30069230 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:55.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.884+0000 7fab54bff700 1 --2- 172.21.15.71:0/1192986188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab50069e80 0x7fab500ad4b0 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:55.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.884+0000 7fab54bff700 1 --2- 172.21.15.71:0/1192986188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab500c70b0 0x7fab501550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:55.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.884+0000 7fab54bff700 1 -- 172.21.15.71:0/1192986188 >> 172.21.15.71:0/1192986188 conn(0x7fab50068e10 msgr2=0x7fab500a98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:55.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.884+0000 7fab54bff700 1 -- 172.21.15.71:0/1192986188 shutdown_connections 2023-10-09T08:17:55.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:55.884+0000 7fab54bff700 1 -- 172.21.15.71:0/1192986188 wait complete. 2023-10-09T08:17:55.903 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-09T08:17:56.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.095+0000 7f9ee7fff700 1 Processor -- start 2023-10-09T08:17:56.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.095+0000 7f9ee7fff700 1 -- start start 2023-10-09T08:17:56.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.096+0000 7f9ee7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ee0069560 0x7f9ee00699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:56.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.096+0000 7f9ee7fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee0069ee0 con 0x7f9ee0159c60 2023-10-09T08:17:56.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.096+0000 7f9ee7fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee015a160 con 0x7f9ee0159890 2023-10-09T08:17:56.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.096+0000 7f9ee7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee00d13a0 con 0x7f9ee0069560 2023-10-09T08:17:56.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.097+0000 7f9ee559a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9ee0159c60 0x7f9ee015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43934/0 (socket says 172.21.15.71:43934) 2023-10-09T08:17:56.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.097+0000 7f9ee559a700 1 -- 172.21.15.71:0/1071219361 learned_addr learned my addr 172.21.15.71:0/1071219361 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:56.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.097+0000 7f9ee659c700 1 --2- 172.21.15.71:0/1071219361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ee0069560 0x7f9ee00699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:56.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.097+0000 7f9ee4d99700 1 -- 172.21.15.71:0/1071219361 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507133922 0 0) 0x7f9ee0069ee0 con 0x7f9ee0159c60 2023-10-09T08:17:56.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.097+0000 7f9ee4d99700 1 -- 172.21.15.71:0/1071219361 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ecc003570 con 0x7f9ee0159c60 2023-10-09T08:17:56.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.097+0000 7f9ee4d99700 1 -- 172.21.15.71:0/1071219361 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541178611 0 0) 0x7f9ee015a160 con 0x7f9ee0159890 2023-10-09T08:17:56.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.097+0000 7f9ee4d99700 1 -- 172.21.15.71:0/1071219361 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ee0069ee0 con 0x7f9ee0159890 2023-10-09T08:17:56.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.097+0000 7f9ee659c700 1 -- 172.21.15.71:0/1071219361 >> v1:172.21.15.179:6789/0 conn(0x7f9ee0159890 legacy=0x7f9ee015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:56.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.097+0000 7f9ee659c700 1 -- 172.21.15.71:0/1071219361 >> v1:172.21.15.71:6789/0 conn(0x7f9ee0159c60 legacy=0x7f9ee015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:56.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.097+0000 7f9ee4d99700 1 -- 172.21.15.71:0/1071219361 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2702194061 0 0) 0x7f9ecc003570 con 0x7f9ee0159c60 2023-10-09T08:17:56.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.097+0000 7f9ee659c700 1 -- 172.21.15.71:0/1071219361 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee015e140 con 0x7f9ee0069560 2023-10-09T08:17:56.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.098+0000 7f9ee659c700 1 --2- 172.21.15.71:0/1071219361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ee0069560 0x7f9ee00699a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8009e90 tx=0x7f9ed8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d643cb58a0b2f3c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:56.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.098+0000 7f9ee4d99700 1 -- 172.21.15.71:0/1071219361 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed800e070 con 0x7f9ee0069560 2023-10-09T08:17:56.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.098+0000 7f9ee4d99700 1 -- 172.21.15.71:0/1071219361 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed800bb80 con 0x7f9ee0069560 2023-10-09T08:17:56.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.098+0000 7f9ee4d99700 1 -- 172.21.15.71:0/1071219361 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8012430 con 0x7f9ee0069560 2023-10-09T08:17:56.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.099+0000 7f9ee7fff700 1 -- 172.21.15.71:0/1071219361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ee0069560 msgr2=0x7f9ee00699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:56.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.099+0000 7f9ee7fff700 1 --2- 172.21.15.71:0/1071219361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ee0069560 0x7f9ee00699a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8009e90 tx=0x7f9ed8009780 comp rx=0 tx=0).stop 2023-10-09T08:17:56.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.099+0000 7f9ee7fff700 1 -- 172.21.15.71:0/1071219361 shutdown_connections 2023-10-09T08:17:56.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.099+0000 7f9ee7fff700 1 --2- 172.21.15.71:0/1071219361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ee0069560 0x7f9ee00699a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:56.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.099+0000 7f9ee7fff700 1 -- 172.21.15.71:0/1071219361 >> 172.21.15.71:0/1071219361 conn(0x7f9ee0068e20 msgr2=0x7f9ee00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:56.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.099+0000 7f9ee7fff700 1 -- 172.21.15.71:0/1071219361 shutdown_connections 2023-10-09T08:17:56.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.099+0000 7f9ee7fff700 1 -- 172.21.15.71:0/1071219361 wait complete. 2023-10-09T08:17:56.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.100+0000 7f9ee7fff700 1 Processor -- start 2023-10-09T08:17:56.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.100+0000 7f9ee7fff700 1 -- start start 2023-10-09T08:17:56.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.101+0000 7f9ee7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ee0069560 0x7f9ee0154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:56.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.101+0000 7f9ee7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ee0159890 0x7f9ee015d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:56.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.101+0000 7f9ee7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ee0159c60 0x7f9ee015f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:56.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.101+0000 7f9ee7fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee01549a0 con 0x7f9ee0069560 2023-10-09T08:17:56.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.101+0000 7f9ee7fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee015b590 con 0x7f9ee0159c60 2023-10-09T08:17:56.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.101+0000 7f9ee7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee00b5b90 con 0x7f9ee0159890 2023-10-09T08:17:56.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.101+0000 7f9ee5d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ee0069560 0x7f9ee0154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:56.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.101+0000 7f9ee5d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ee0069560 0x7f9ee0154460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40090/0 (socket says 172.21.15.71:40090) 2023-10-09T08:17:56.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.101+0000 7f9ee5d9b700 1 -- 172.21.15.71:0/2379824329 learned_addr learned my addr 172.21.15.71:0/2379824329 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:56.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.102+0000 7f9ee659c700 1 --2- 172.21.15.71:0/2379824329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ee0159c60 0x7f9ee015f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:56.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.102+0000 7f9ee559a700 1 --2- 172.21.15.71:0/2379824329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ee0159890 0x7f9ee015d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:56.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.102+0000 7f9ee5d9b700 1 -- 172.21.15.71:0/2379824329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ee0159890 msgr2=0x7f9ee015d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:56.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.102+0000 7f9ee5d9b700 1 --2- 172.21.15.71:0/2379824329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ee0159890 0x7f9ee015d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:56.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.102+0000 7f9ee5d9b700 1 -- 172.21.15.71:0/2379824329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ee0159c60 msgr2=0x7f9ee015f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:56.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.102+0000 7f9ee5d9b700 1 --2- 172.21.15.71:0/2379824329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ee0159c60 0x7f9ee015f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:56.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.102+0000 7f9ee5d9b700 1 -- 172.21.15.71:0/2379824329 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed8009a20 con 0x7f9ee0069560 2023-10-09T08:17:56.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.102+0000 7f9ee659c700 1 --2- 172.21.15.71:0/2379824329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ee0159c60 0x7f9ee015f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:17:56.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.102+0000 7f9ee559a700 1 --2- 172.21.15.71:0/2379824329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ee0159890 0x7f9ee015d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:17:56.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.102+0000 7f9ee5d9b700 1 --2- 172.21.15.71:0/2379824329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ee0069560 0x7f9ee0154460 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00c7c0 tx=0x7f9edc007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:56.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.102+0000 7f9ed5ffb700 1 -- 172.21.15.71:0/2379824329 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc011680 con 0x7f9ee0069560 2023-10-09T08:17:56.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.102+0000 7f9ed5ffb700 1 -- 172.21.15.71:0/2379824329 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc011800 con 0x7f9ee0069560 2023-10-09T08:17:56.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.102+0000 7f9ee7fff700 1 -- 172.21.15.71:0/2379824329 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee00b5e70 con 0x7f9ee0069560 2023-10-09T08:17:56.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.102+0000 7f9ed5ffb700 1 -- 172.21.15.71:0/2379824329 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc011bc0 con 0x7f9ee0069560 2023-10-09T08:17:56.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.102+0000 7f9ee7fff700 1 -- 172.21.15.71:0/2379824329 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee00b6150 con 0x7f9ee0069560 2023-10-09T08:17:56.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.103+0000 7f9ee7fff700 1 -- 172.21.15.71:0/2379824329 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee004c3c0 con 0x7f9ee0069560 2023-10-09T08:17:56.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.104+0000 7f9ed5ffb700 1 -- 172.21.15.71:0/2379824329 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9edc012440 con 0x7f9ee0069560 2023-10-09T08:17:56.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.105+0000 7f9ed5ffb700 1 --2- 172.21.15.71:0/2379824329 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9ec4066f30 0x7f9ec40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:56.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.105+0000 7f9ed5ffb700 1 -- 172.21.15.71:0/2379824329 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f9edc084620 con 0x7f9ee0069560 2023-10-09T08:17:56.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.105+0000 7f9ee559a700 1 --2- 172.21.15.71:0/2379824329 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9ec4066f30 0x7f9ec40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:56.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.106+0000 7f9ee559a700 1 --2- 172.21.15.71:0/2379824329 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9ec4066f30 0x7f9ec40693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00b22a0 tx=0x7f9ed0007a50 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:56.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.109+0000 7f9ed5ffb700 1 -- 172.21.15.71:0/2379824329 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9edc0516b0 con 0x7f9ee0069560 2023-10-09T08:17:56.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.302+0000 7f9ee7fff700 1 -- 172.21.15.71:0/2379824329 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f9ee00c6920 con 0x7f9ee0069560 2023-10-09T08:17:56.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.306+0000 7f9ed5ffb700 1 -- 172.21.15.71:0/2379824329 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v74) v1 ==== 115+0+0 (secure 0 0 0) 0x7f9edc054cd0 con 0x7f9ee0069560 2023-10-09T08:17:56.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.309+0000 7f9ee7fff700 1 -- 172.21.15.71:0/2379824329 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9ec4066f30 msgr2=0x7f9ec40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:56.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.309+0000 7f9ee7fff700 1 --2- 172.21.15.71:0/2379824329 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9ec4066f30 0x7f9ec40693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00b22a0 tx=0x7f9ed0007a50 comp rx=0 tx=0).stop 2023-10-09T08:17:56.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.309+0000 7f9ee7fff700 1 -- 172.21.15.71:0/2379824329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ee0069560 msgr2=0x7f9ee0154460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:56.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.309+0000 7f9ee7fff700 1 --2- 172.21.15.71:0/2379824329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ee0069560 0x7f9ee0154460 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00c7c0 tx=0x7f9edc007de0 comp rx=0 tx=0).stop 2023-10-09T08:17:56.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.309+0000 7f9ee7fff700 1 -- 172.21.15.71:0/2379824329 shutdown_connections 2023-10-09T08:17:56.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.309+0000 7f9ee7fff700 1 --2- 172.21.15.71:0/2379824329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ee0159c60 0x7f9ee015f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:56.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.309+0000 7f9ee7fff700 1 --2- 172.21.15.71:0/2379824329 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9ec4066f30 0x7f9ec40693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:56.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.309+0000 7f9ee7fff700 1 --2- 172.21.15.71:0/2379824329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ee0069560 0x7f9ee0154460 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:56.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.309+0000 7f9ee7fff700 1 --2- 172.21.15.71:0/2379824329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ee0159890 0x7f9ee015d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:56.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.309+0000 7f9ee7fff700 1 -- 172.21.15.71:0/2379824329 >> 172.21.15.71:0/2379824329 conn(0x7f9ee0068e20 msgr2=0x7f9ee00cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:56.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.309+0000 7f9ee7fff700 1 -- 172.21.15.71:0/2379824329 shutdown_connections 2023-10-09T08:17:56.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.309+0000 7f9ee7fff700 1 -- 172.21.15.71:0/2379824329 wait complete. 2023-10-09T08:17:56.327 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-09T08:17:56.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.508+0000 7f92f0dff700 1 Processor -- start 2023-10-09T08:17:56.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.508+0000 7f92f0dff700 1 -- start start 2023-10-09T08:17:56.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.510+0000 7f92f0dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f92ec155eb0 0x7f92ec06e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:56.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.510+0000 7f92f0dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f92ec0c70b0 0x7f92ec069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:56.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.510+0000 7f92f0dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ec06eb90 con 0x7f92ec069cb0 2023-10-09T08:17:56.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.510+0000 7f92f0dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ec06a130 con 0x7f92ec155eb0 2023-10-09T08:17:56.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.510+0000 7f92f0dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ec06ee70 con 0x7f92ec0c70b0 2023-10-09T08:17:56.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.510+0000 7f92ea59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f92ec155eb0 0x7f92ec06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:56.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.510+0000 7f92ea59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f92ec155eb0 0x7f92ec06e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40102/0 (socket says 172.21.15.71:40102) 2023-10-09T08:17:56.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.510+0000 7f92ea59c700 1 -- 172.21.15.71:0/157385419 learned_addr learned my addr 172.21.15.71:0/157385419 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:56.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.510+0000 7f92e9d9b700 1 --2- 172.21.15.71:0/157385419 >> v2:172.21.15.179:3300/0 conn(0x7f92ec0c70b0 0x7f92ec069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:56.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.510+0000 7f92ea59c700 1 -- 172.21.15.71:0/157385419 >> v2:172.21.15.179:3300/0 conn(0x7f92ec0c70b0 msgr2=0x7f92ec069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:56.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.510+0000 7f92ea59c700 1 --2- 172.21.15.71:0/157385419 >> v2:172.21.15.179:3300/0 conn(0x7f92ec0c70b0 0x7f92ec069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:56.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.510+0000 7f92ea59c700 1 -- 172.21.15.71:0/157385419 >> v1:172.21.15.179:6789/0 conn(0x7f92ec069cb0 legacy=0x7f92ec159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:56.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.510+0000 7f92ea59c700 1 -- 172.21.15.71:0/157385419 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec06f150 con 0x7f92ec155eb0 2023-10-09T08:17:56.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.510+0000 7f92e9d9b700 1 --2- 172.21.15.71:0/157385419 >> v2:172.21.15.179:3300/0 conn(0x7f92ec0c70b0 0x7f92ec069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:56.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.511+0000 7f92ea59c700 1 --2- 172.21.15.71:0/157385419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92ec155eb0 0x7f92ec06e240 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f92ec065130 tx=0x7f92dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f78d1830c56d84 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:56.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.511+0000 7f92e959a700 1 -- 172.21.15.71:0/157385419 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc00b820 con 0x7f92ec155eb0 2023-10-09T08:17:56.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.511+0000 7f92e959a700 1 -- 172.21.15.71:0/157385419 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92dc00b980 con 0x7f92ec155eb0 2023-10-09T08:17:56.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.511+0000 7f92e959a700 1 -- 172.21.15.71:0/157385419 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc00bd20 con 0x7f92ec155eb0 2023-10-09T08:17:56.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.511+0000 7f92f0dff700 1 -- 172.21.15.71:0/157385419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92ec155eb0 msgr2=0x7f92ec06e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:56.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.511+0000 7f92f0dff700 1 --2- 172.21.15.71:0/157385419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92ec155eb0 0x7f92ec06e240 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f92ec065130 tx=0x7f92dc009250 comp rx=0 tx=0).stop 2023-10-09T08:17:56.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.511+0000 7f92f0dff700 1 -- 172.21.15.71:0/157385419 shutdown_connections 2023-10-09T08:17:56.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.511+0000 7f92f0dff700 1 --2- 172.21.15.71:0/157385419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92ec155eb0 0x7f92ec06e240 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:56.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.511+0000 7f92f0dff700 1 --2- 172.21.15.71:0/157385419 >> v2:172.21.15.179:3300/0 conn(0x7f92ec0c70b0 0x7f92ec069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:56.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.512+0000 7f92f0dff700 1 -- 172.21.15.71:0/157385419 >> 172.21.15.71:0/157385419 conn(0x7f92ec068e10 msgr2=0x7f92ec0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:56.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.512+0000 7f92f0dff700 1 -- 172.21.15.71:0/157385419 shutdown_connections 2023-10-09T08:17:56.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.512+0000 7f92f0dff700 1 -- 172.21.15.71:0/157385419 wait complete. 2023-10-09T08:17:56.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.513+0000 7f92f0dff700 1 Processor -- start 2023-10-09T08:17:56.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.513+0000 7f92f0dff700 1 -- start start 2023-10-09T08:17:56.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.514+0000 7f92f0dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92ec069cb0 0x7f92ec0c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:56.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.514+0000 7f92f0dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92ec0c70b0 0x7f92ec152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:56.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.514+0000 7f92f0dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92ec155eb0 0x7f92ec0a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:56.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.514+0000 7f92f0dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0a8470 con 0x7f92ec0c70b0 2023-10-09T08:17:56.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.514+0000 7f92f0dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0c4560 con 0x7f92ec155eb0 2023-10-09T08:17:56.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.514+0000 7f92f0dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0a8730 con 0x7f92ec069cb0 2023-10-09T08:17:56.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.514+0000 7f92e9d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92ec0c70b0 0x7f92ec152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:56.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.514+0000 7f92e9d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92ec0c70b0 0x7f92ec152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40104/0 (socket says 172.21.15.71:40104) 2023-10-09T08:17:56.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.514+0000 7f92e9d9b700 1 -- 172.21.15.71:0/3696001173 learned_addr learned my addr 172.21.15.71:0/3696001173 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:56.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.514+0000 7f92ea59c700 1 --2- 172.21.15.71:0/3696001173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92ec069cb0 0x7f92ec0c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:56.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.514+0000 7f92ead9d700 1 --2- 172.21.15.71:0/3696001173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92ec155eb0 0x7f92ec0a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:56.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.515+0000 7f92e9d9b700 1 -- 172.21.15.71:0/3696001173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92ec069cb0 msgr2=0x7f92ec0c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:56.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.515+0000 7f92e9d9b700 1 --2- 172.21.15.71:0/3696001173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92ec069cb0 0x7f92ec0c35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:56.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.515+0000 7f92e9d9b700 1 -- 172.21.15.71:0/3696001173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92ec155eb0 msgr2=0x7f92ec0a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:56.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.515+0000 7f92e9d9b700 1 --2- 172.21.15.71:0/3696001173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92ec155eb0 0x7f92ec0a6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:56.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.515+0000 7f92e9d9b700 1 -- 172.21.15.71:0/3696001173 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92dc0094f0 con 0x7f92ec0c70b0 2023-10-09T08:17:56.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.515+0000 7f92e9d9b700 1 --2- 172.21.15.71:0/3696001173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92ec0c70b0 0x7f92ec152be0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f92e000c860 tx=0x7f92e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:56.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.515+0000 7f92da7fc700 1 -- 172.21.15.71:0/3696001173 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e0011600 con 0x7f92ec0c70b0 2023-10-09T08:17:56.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.515+0000 7f92da7fc700 1 -- 172.21.15.71:0/3696001173 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e0011760 con 0x7f92ec0c70b0 2023-10-09T08:17:56.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.515+0000 7f92da7fc700 1 -- 172.21.15.71:0/3696001173 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e0011b00 con 0x7f92ec0c70b0 2023-10-09T08:17:56.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.515+0000 7f92f0dff700 1 -- 172.21.15.71:0/3696001173 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ec153120 con 0x7f92ec0c70b0 2023-10-09T08:17:56.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.515+0000 7f92f0dff700 1 -- 172.21.15.71:0/3696001173 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ec0c3fa0 con 0x7f92ec0c70b0 2023-10-09T08:17:56.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.516+0000 7f92f0dff700 1 -- 172.21.15.71:0/3696001173 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ec04c3c0 con 0x7f92ec0c70b0 2023-10-09T08:17:56.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.517+0000 7f92da7fc700 1 -- 172.21.15.71:0/3696001173 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f92e000a3e0 con 0x7f92ec0c70b0 2023-10-09T08:17:56.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.518+0000 7f92da7fc700 1 --2- 172.21.15.71:0/3696001173 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f92cc066f30 0x7f92cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:56.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.518+0000 7f92da7fc700 1 -- 172.21.15.71:0/3696001173 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f92e0084740 con 0x7f92ec0c70b0 2023-10-09T08:17:56.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.519+0000 7f92ea59c700 1 --2- 172.21.15.71:0/3696001173 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f92cc066f30 0x7f92cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:56.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.519+0000 7f92ea59c700 1 --2- 172.21.15.71:0/3696001173 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f92cc066f30 0x7f92cc0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f92ec065130 tx=0x7f92dc016000 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:56.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.522+0000 7f92da7fc700 1 -- 172.21.15.71:0/3696001173 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92e0051870 con 0x7f92ec0c70b0 2023-10-09T08:17:56.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.711+0000 7f92f0dff700 1 -- 172.21.15.71:0/3696001173 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f92ec0a8870 con 0x7f92ec0c70b0 2023-10-09T08:17:56.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.716+0000 7f92da7fc700 1 -- 172.21.15.71:0/3696001173 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v75) v1 ==== 120+0+0 (secure 0 0 0) 0x7f92e0054e90 con 0x7f92ec0c70b0 2023-10-09T08:17:56.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.718+0000 7f92f0dff700 1 -- 172.21.15.71:0/3696001173 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f92cc066f30 msgr2=0x7f92cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:56.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.718+0000 7f92f0dff700 1 --2- 172.21.15.71:0/3696001173 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f92cc066f30 0x7f92cc0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f92ec065130 tx=0x7f92dc016000 comp rx=0 tx=0).stop 2023-10-09T08:17:56.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.718+0000 7f92f0dff700 1 -- 172.21.15.71:0/3696001173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92ec0c70b0 msgr2=0x7f92ec152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:56.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.718+0000 7f92f0dff700 1 --2- 172.21.15.71:0/3696001173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92ec0c70b0 0x7f92ec152be0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f92e000c860 tx=0x7f92e0008040 comp rx=0 tx=0).stop 2023-10-09T08:17:56.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.718+0000 7f92f0dff700 1 -- 172.21.15.71:0/3696001173 shutdown_connections 2023-10-09T08:17:56.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.718+0000 7f92f0dff700 1 --2- 172.21.15.71:0/3696001173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92ec155eb0 0x7f92ec0a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:56.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.718+0000 7f92f0dff700 1 --2- 172.21.15.71:0/3696001173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92ec069cb0 0x7f92ec0c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:56.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.718+0000 7f92f0dff700 1 --2- 172.21.15.71:0/3696001173 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f92cc066f30 0x7f92cc0693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:56.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.718+0000 7f92f0dff700 1 --2- 172.21.15.71:0/3696001173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92ec0c70b0 0x7f92ec152be0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:56.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.718+0000 7f92f0dff700 1 -- 172.21.15.71:0/3696001173 >> 172.21.15.71:0/3696001173 conn(0x7f92ec068e10 msgr2=0x7f92ec1549b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:56.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.718+0000 7f92f0dff700 1 -- 172.21.15.71:0/3696001173 shutdown_connections 2023-10-09T08:17:56.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.718+0000 7f92f0dff700 1 -- 172.21.15.71:0/3696001173 wait complete. 2023-10-09T08:17:56.737 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-10-09T08:17:56.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.914+0000 7fb10219d700 1 Processor -- start 2023-10-09T08:17:56.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.914+0000 7fb10219d700 1 -- start start 2023-10-09T08:17:56.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.916+0000 7fb10219d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb0fc150180 0x7fb0fc157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:56.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.916+0000 7fb10219d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0fc0c7410 0x7fb0fc069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:56.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.916+0000 7fb10219d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0fc06e2a0 con 0x7fb0fc150550 2023-10-09T08:17:56.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.916+0000 7fb10219d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0fc06b2e0 con 0x7fb0fc150180 2023-10-09T08:17:56.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.916+0000 7fb10219d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0c78e0 con 0x7fb0fc0c7410 2023-10-09T08:17:56.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.916+0000 7fb10119b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb0fc150180 0x7fb0fc157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:56.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.916+0000 7fb10199c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0fc0c7410 0x7fb0fc069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:56.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.916+0000 7fb10119b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb0fc150180 0x7fb0fc157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:55416/0 (socket says 172.21.15.71:55416) 2023-10-09T08:17:56.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.916+0000 7fb10119b700 1 -- 172.21.15.71:0/3576058357 learned_addr learned my addr 172.21.15.71:0/3576058357 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:56.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.917+0000 7fb0f3fff700 1 -- 172.21.15.71:0/3576058357 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3784011410 0 0) 0x7fb0fc06e2a0 con 0x7fb0fc150550 2023-10-09T08:17:56.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.917+0000 7fb0f3fff700 1 -- 172.21.15.71:0/3576058357 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0e8003570 con 0x7fb0fc150550 2023-10-09T08:17:56.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.917+0000 7fb10199c700 1 -- 172.21.15.71:0/3576058357 >> v2:172.21.15.179:3300/0 conn(0x7fb0fc150180 msgr2=0x7fb0fc157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:56.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.917+0000 7fb10199c700 1 --2- 172.21.15.71:0/3576058357 >> v2:172.21.15.179:3300/0 conn(0x7fb0fc150180 0x7fb0fc157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:56.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.917+0000 7fb10199c700 1 -- 172.21.15.71:0/3576058357 >> v1:172.21.15.179:6789/0 conn(0x7fb0fc150550 legacy=0x7fb0fc0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:56.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.917+0000 7fb10199c700 1 -- 172.21.15.71:0/3576058357 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc0c7bc0 con 0x7fb0fc0c7410 2023-10-09T08:17:56.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.917+0000 7fb10119b700 1 --2- 172.21.15.71:0/3576058357 >> v2:172.21.15.179:3300/0 conn(0x7fb0fc150180 0x7fb0fc157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:56.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.917+0000 7fb10199c700 1 --2- 172.21.15.71:0/3576058357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0fc0c7410 0x7fb0fc069f50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb0f400af70 tx=0x7fb0f400a890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aac120f12fb19501 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:56.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.917+0000 7fb0f3fff700 1 -- 172.21.15.71:0/3576058357 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f400f070 con 0x7fb0fc0c7410 2023-10-09T08:17:56.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.918+0000 7fb0f3fff700 1 -- 172.21.15.71:0/3576058357 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f400a2e0 con 0x7fb0fc0c7410 2023-10-09T08:17:56.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.918+0000 7fb0f3fff700 1 -- 172.21.15.71:0/3576058357 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f400cbc0 con 0x7fb0fc0c7410 2023-10-09T08:17:56.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.918+0000 7fb10219d700 1 -- 172.21.15.71:0/3576058357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0fc0c7410 msgr2=0x7fb0fc069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:56.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.918+0000 7fb10219d700 1 --2- 172.21.15.71:0/3576058357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0fc0c7410 0x7fb0fc069f50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb0f400af70 tx=0x7fb0f400a890 comp rx=0 tx=0).stop 2023-10-09T08:17:56.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.918+0000 7fb10219d700 1 -- 172.21.15.71:0/3576058357 shutdown_connections 2023-10-09T08:17:56.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.918+0000 7fb10219d700 1 --2- 172.21.15.71:0/3576058357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0fc0c7410 0x7fb0fc069f50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:56.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.918+0000 7fb10219d700 1 --2- 172.21.15.71:0/3576058357 >> v2:172.21.15.179:3300/0 conn(0x7fb0fc150180 0x7fb0fc157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:56.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.918+0000 7fb10219d700 1 -- 172.21.15.71:0/3576058357 >> 172.21.15.71:0/3576058357 conn(0x7fb0fc0cc1f0 msgr2=0x7fb0fc0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:56.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.918+0000 7fb10219d700 1 -- 172.21.15.71:0/3576058357 shutdown_connections 2023-10-09T08:17:56.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.918+0000 7fb10219d700 1 -- 172.21.15.71:0/3576058357 wait complete. 2023-10-09T08:17:56.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.920+0000 7fb10219d700 1 Processor -- start 2023-10-09T08:17:56.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.920+0000 7fb10219d700 1 -- start start 2023-10-09T08:17:56.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.921+0000 7fb10219d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0fc0c7410 0x7fb0fc148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:56.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.921+0000 7fb10219d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0fc150180 0x7fb0fc0abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:56.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.921+0000 7fb10219d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0fc150550 0x7fb0fc16da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:56.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.921+0000 7fb10219d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc16d5e0 con 0x7fb0fc0c7410 2023-10-09T08:17:56.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.921+0000 7fb10219d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0ac390 con 0x7fb0fc150180 2023-10-09T08:17:56.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.921+0000 7fb10219d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0ac670 con 0x7fb0fc150550 2023-10-09T08:17:56.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.921+0000 7fb10119b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0fc0c7410 0x7fb0fc148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:56.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.921+0000 7fb10119b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0fc0c7410 0x7fb0fc148cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40120/0 (socket says 172.21.15.71:40120) 2023-10-09T08:17:56.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.921+0000 7fb10119b700 1 -- 172.21.15.71:0/3633718937 learned_addr learned my addr 172.21.15.71:0/3633718937 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:56.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.921+0000 7fb10199c700 1 --2- 172.21.15.71:0/3633718937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0fc150550 0x7fb0fc16da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:56.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.921+0000 7fb10099a700 1 --2- 172.21.15.71:0/3633718937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0fc150180 0x7fb0fc0abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:56.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.921+0000 7fb10119b700 1 -- 172.21.15.71:0/3633718937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0fc150550 msgr2=0x7fb0fc16da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:56.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.921+0000 7fb10119b700 1 --2- 172.21.15.71:0/3633718937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0fc150550 0x7fb0fc16da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:56.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.921+0000 7fb10119b700 1 -- 172.21.15.71:0/3633718937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0fc150180 msgr2=0x7fb0fc0abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:56.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.921+0000 7fb10119b700 1 --2- 172.21.15.71:0/3633718937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0fc150180 0x7fb0fc0abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:56.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.921+0000 7fb10119b700 1 -- 172.21.15.71:0/3633718937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f80094f0 con 0x7fb0fc0c7410 2023-10-09T08:17:56.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.922+0000 7fb10119b700 1 --2- 172.21.15.71:0/3633718937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0fc0c7410 0x7fb0fc148cc0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800ec50 tx=0x7fb0f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:56.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.922+0000 7fb0f17fa700 1 -- 172.21.15.71:0/3633718937 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f800c9d0 con 0x7fb0fc0c7410 2023-10-09T08:17:56.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.922+0000 7fb0f17fa700 1 -- 172.21.15.71:0/3633718937 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f800cb30 con 0x7fb0fc0c7410 2023-10-09T08:17:56.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.922+0000 7fb10219d700 1 -- 172.21.15.71:0/3633718937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f400ab30 con 0x7fb0fc0c7410 2023-10-09T08:17:56.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.922+0000 7fb0f17fa700 1 -- 172.21.15.71:0/3633718937 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8013470 con 0x7fb0fc0c7410 2023-10-09T08:17:56.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.922+0000 7fb10219d700 1 -- 172.21.15.71:0/3633718937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0fc16d270 con 0x7fb0fc0c7410 2023-10-09T08:17:56.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.923+0000 7fb10219d700 1 -- 172.21.15.71:0/3633718937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0fc16d8c0 con 0x7fb0fc0c7410 2023-10-09T08:17:56.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.924+0000 7fb0f17fa700 1 -- 172.21.15.71:0/3633718937 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb0f8013860 con 0x7fb0fc0c7410 2023-10-09T08:17:56.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.925+0000 7fb0f17fa700 1 --2- 172.21.15.71:0/3633718937 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb0e0066f30 0x7fb0e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:56.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.925+0000 7fb0f17fa700 1 -- 172.21.15.71:0/3633718937 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7fb0f8084ea0 con 0x7fb0fc0c7410 2023-10-09T08:17:56.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.925+0000 7fb10099a700 1 --2- 172.21.15.71:0/3633718937 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb0e0066f30 0x7fb0e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:56.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.926+0000 7fb10099a700 1 --2- 172.21.15.71:0/3633718937 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb0e0066f30 0x7fb0e00693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0c2090 tx=0x7fb0ec009040 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:56.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:56.929+0000 7fb0f17fa700 1 -- 172.21.15.71:0/3633718937 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0f8051f30 con 0x7fb0fc0c7410 2023-10-09T08:17:57.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:57.190+0000 7fb10219d700 1 -- 172.21.15.71:0/3633718937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7fb0fc06d020 con 0x7fb0fc0c7410 2023-10-09T08:17:57.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:57.214+0000 7fb0f17fa700 1 -- 172.21.15.71:0/3633718937 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v3089) v1 ==== 155+0+0 (secure 0 0 0) 0x7fb0f8055550 con 0x7fb0fc0c7410 2023-10-09T08:17:57.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:57.216+0000 7fb10219d700 1 -- 172.21.15.71:0/3633718937 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb0e0066f30 msgr2=0x7fb0e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:57.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:57.216+0000 7fb10219d700 1 --2- 172.21.15.71:0/3633718937 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb0e0066f30 0x7fb0e00693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0c2090 tx=0x7fb0ec009040 comp rx=0 tx=0).stop 2023-10-09T08:17:57.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:57.216+0000 7fb10219d700 1 -- 172.21.15.71:0/3633718937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0fc0c7410 msgr2=0x7fb0fc148cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:57.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:57.216+0000 7fb10219d700 1 --2- 172.21.15.71:0/3633718937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0fc0c7410 0x7fb0fc148cc0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800ec50 tx=0x7fb0f8009250 comp rx=0 tx=0).stop 2023-10-09T08:17:57.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:57.216+0000 7fb10219d700 1 -- 172.21.15.71:0/3633718937 shutdown_connections 2023-10-09T08:17:57.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:57.216+0000 7fb10219d700 1 --2- 172.21.15.71:0/3633718937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0fc150550 0x7fb0fc16da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:57.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:57.216+0000 7fb10219d700 1 --2- 172.21.15.71:0/3633718937 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fb0e0066f30 0x7fb0e00693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:57.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:57.216+0000 7fb10219d700 1 --2- 172.21.15.71:0/3633718937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0fc0c7410 0x7fb0fc148cc0 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:57.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:57.216+0000 7fb10219d700 1 --2- 172.21.15.71:0/3633718937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0fc150180 0x7fb0fc0abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:57.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:57.216+0000 7fb10219d700 1 -- 172.21.15.71:0/3633718937 >> 172.21.15.71:0/3633718937 conn(0x7fb0fc0cc1f0 msgr2=0x7fb0fc14bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:57.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:57.217+0000 7fb10219d700 1 -- 172.21.15.71:0/3633718937 shutdown_connections 2023-10-09T08:17:57.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:57.217+0000 7fb10219d700 1 -- 172.21.15.71:0/3633718937 wait complete. 2023-10-09T08:17:57.235 INFO:tasks.cephfs_test_runner:Test the correctness of snap directory name ... ok 2023-10-09T08:17:57.236 INFO:tasks.cephfs_test_runner: 2023-10-09T08:17:57.236 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-09T08:17:57.236 INFO:tasks.cephfs_test_runner:Ran 11 tests in 5684.445s 2023-10-09T08:17:57.236 INFO:tasks.cephfs_test_runner: 2023-10-09T08:17:57.236 INFO:tasks.cephfs_test_runner:OK 2023-10-09T08:17:57.236 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-09T08:17:57.246 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-09T08:17:57.267 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-09T08:17:57.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:17:57.268 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-09T08:17:57.304 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T08:17:57.304 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T08:17:57.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:17:57.305 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T08:17:57.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:17:57.407 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T08:17:57.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:17:57.476 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link delete ceph-brx 2023-10-09T08:17:57.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:17:57.598 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-09T08:17:57.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:17:57.639 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link delete ceph-brx 2023-10-09T08:17:57.746 INFO:teuthology.orchestra.run.smithi071.stderr:Cannot find device "ceph-brx" 2023-10-09T08:17:57.747 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T08:17:57.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:17:57.748 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-10-09T08:17:57.789 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T08:17:57.789 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T08:17:57.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:17:57.790 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T08:17:57.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:17:57.895 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T08:17:57.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:17:57.971 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2023-10-09T08:17:58.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:17:58.083 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-10-09T08:17:58.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T08:17:58.122 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2023-10-09T08:17:58.229 INFO:teuthology.orchestra.run.smithi179.stderr:Cannot find device "ceph-brx" 2023-10-09T08:17:58.230 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:17:58.232 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T08:17:58.232 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-09T08:17:58.242 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-09T08:17:58.242 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T08:17:58.243 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:17:58.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.426+0000 7f995759d700 1 Processor -- start 2023-10-09T08:17:58.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.427+0000 7f995759d700 1 -- start start 2023-10-09T08:17:58.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.428+0000 7f995759d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f995006d950 0x7f99500c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:58.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.428+0000 7f995759d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f995006ae70 con 0x7f995006a0a0 2023-10-09T08:17:58.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.428+0000 7f995759d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99500c7a30 con 0x7f995006dd20 2023-10-09T08:17:58.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.428+0000 7f995759d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995006a540 con 0x7f995006d950 2023-10-09T08:17:58.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.428+0000 7f995659b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f995006d950 0x7f99500c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:58.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.428+0000 7f9955d9a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f995006a0a0 0x7f99500c6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43940/0 (socket says 172.21.15.71:43940) 2023-10-09T08:17:58.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.428+0000 7f9955d9a700 1 -- 172.21.15.71:0/3149964614 learned_addr learned my addr 172.21.15.71:0/3149964614 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:17:58.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.429+0000 7f995659b700 1 -- 172.21.15.71:0/3149964614 >> v1:172.21.15.179:6789/0 conn(0x7f995006dd20 legacy=0x7f99500c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:58.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.429+0000 7f995659b700 1 -- 172.21.15.71:0/3149964614 >> v1:172.21.15.71:6789/0 conn(0x7f995006a0a0 legacy=0x7f99500c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:58.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.429+0000 7f995659b700 1 -- 172.21.15.71:0/3149964614 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995006a820 con 0x7f995006d950 2023-10-09T08:17:58.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.429+0000 7f995659b700 1 --2- 172.21.15.71:0/3149964614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f995006d950 0x7f99500c8350 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f994c0098e0 tx=0x7f994c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=961c92fb837b94b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:58.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.429+0000 7f9955599700 1 -- 172.21.15.71:0/3149964614 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c009e80 con 0x7f995006d950 2023-10-09T08:17:58.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.429+0000 7f9955599700 1 -- 172.21.15.71:0/3149964614 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c00b860 con 0x7f995006d950 2023-10-09T08:17:58.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.429+0000 7f9955599700 1 -- 172.21.15.71:0/3149964614 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c00bbe0 con 0x7f995006d950 2023-10-09T08:17:58.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.430+0000 7f995759d700 1 -- 172.21.15.71:0/3149964614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f995006d950 msgr2=0x7f99500c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:58.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.430+0000 7f995759d700 1 --2- 172.21.15.71:0/3149964614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f995006d950 0x7f99500c8350 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f994c0098e0 tx=0x7f994c0091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:58.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.430+0000 7f995759d700 1 -- 172.21.15.71:0/3149964614 shutdown_connections 2023-10-09T08:17:58.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.430+0000 7f995759d700 1 --2- 172.21.15.71:0/3149964614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f995006d950 0x7f99500c8350 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:58.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.430+0000 7f995759d700 1 -- 172.21.15.71:0/3149964614 >> 172.21.15.71:0/3149964614 conn(0x7f99500cc1f0 msgr2=0x7f99500cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:58.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.430+0000 7f995759d700 1 -- 172.21.15.71:0/3149964614 shutdown_connections 2023-10-09T08:17:58.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.430+0000 7f995759d700 1 -- 172.21.15.71:0/3149964614 wait complete. 2023-10-09T08:17:58.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.431+0000 7f995759d700 1 Processor -- start 2023-10-09T08:17:58.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.432+0000 7f995759d700 1 -- start start 2023-10-09T08:17:58.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.432+0000 7f995759d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f995006a0a0 0x7f99500c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:58.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.432+0000 7f995759d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f995006d950 0x7f99500b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:58.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.432+0000 7f995759d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f995006dd20 0x7f9950151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:58.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.432+0000 7f995759d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99500c59b0 con 0x7f995006d950 2023-10-09T08:17:58.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.432+0000 7f995759d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99500c4b00 con 0x7f995006dd20 2023-10-09T08:17:58.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.432+0000 7f995759d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99500c4da0 con 0x7f995006a0a0 2023-10-09T08:17:58.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.433+0000 7f9955d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f995006d950 0x7f99500b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:58.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.433+0000 7f9955d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f995006d950 0x7f99500b0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40142/0 (socket says 172.21.15.71:40142) 2023-10-09T08:17:58.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.433+0000 7f9955d9a700 1 -- 172.21.15.71:0/1043567454 learned_addr learned my addr 172.21.15.71:0/1043567454 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:58.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.433+0000 7f995659b700 1 --2- 172.21.15.71:0/1043567454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f995006a0a0 0x7f99500c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:58.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.433+0000 7f9956d9c700 1 --2- 172.21.15.71:0/1043567454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f995006dd20 0x7f9950151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:58.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.433+0000 7f9955d9a700 1 -- 172.21.15.71:0/1043567454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f995006a0a0 msgr2=0x7f99500c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:58.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.433+0000 7f9955d9a700 1 --2- 172.21.15.71:0/1043567454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f995006a0a0 0x7f99500c45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:58.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.433+0000 7f9955d9a700 1 -- 172.21.15.71:0/1043567454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f995006dd20 msgr2=0x7f9950151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:58.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.433+0000 7f9955d9a700 1 --2- 172.21.15.71:0/1043567454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f995006dd20 0x7f9950151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:58.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.433+0000 7f9955d9a700 1 -- 172.21.15.71:0/1043567454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c009420 con 0x7f995006d950 2023-10-09T08:17:58.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.433+0000 7f9956d9c700 1 --2- 172.21.15.71:0/1043567454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f995006dd20 0x7f9950151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:17:58.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.433+0000 7f995659b700 1 --2- 172.21.15.71:0/1043567454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f995006a0a0 0x7f99500c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:17:58.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.433+0000 7f9955d9a700 1 --2- 172.21.15.71:0/1043567454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f995006d950 0x7f99500b0db0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f994000c560 tx=0x7f9940001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:58.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.433+0000 7f99467fc700 1 -- 172.21.15.71:0/1043567454 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9940005b30 con 0x7f995006d950 2023-10-09T08:17:58.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.434+0000 7f99467fc700 1 -- 172.21.15.71:0/1043567454 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9940005cb0 con 0x7f995006d950 2023-10-09T08:17:58.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.434+0000 7f995759d700 1 -- 172.21.15.71:0/1043567454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99500c5080 con 0x7f995006d950 2023-10-09T08:17:58.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.434+0000 7f99467fc700 1 -- 172.21.15.71:0/1043567454 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9940007320 con 0x7f995006d950 2023-10-09T08:17:58.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.434+0000 7f995759d700 1 -- 172.21.15.71:0/1043567454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99500c5640 con 0x7f995006d950 2023-10-09T08:17:58.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.435+0000 7f995759d700 1 -- 172.21.15.71:0/1043567454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99500c9dc0 con 0x7f995006d950 2023-10-09T08:17:58.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.435+0000 7f99467fc700 1 -- 172.21.15.71:0/1043567454 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f994001b3b0 con 0x7f995006d950 2023-10-09T08:17:58.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.436+0000 7f99467fc700 1 --2- 172.21.15.71:0/1043567454 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9934066f30 0x7f99340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:58.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.436+0000 7f99467fc700 1 -- 172.21.15.71:0/1043567454 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f9940083c50 con 0x7f995006d950 2023-10-09T08:17:58.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.437+0000 7f995659b700 1 --2- 172.21.15.71:0/1043567454 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9934066f30 0x7f99340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:58.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.437+0000 7f995659b700 1 --2- 172.21.15.71:0/1043567454 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9934066f30 0x7f99340693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f994c0093f0 tx=0x7f994c017000 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:58.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.440+0000 7f99467fc700 1 -- 172.21.15.71:0/1043567454 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99500c9dc0 con 0x7f995006d950 2023-10-09T08:17:58.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.631+0000 7f995759d700 1 -- 172.21.15.71:0/1043567454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99500c9dc0 con 0x7f995006d950 2023-10-09T08:17:58.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.632+0000 7f99467fc700 1 -- 172.21.15.71:0/1043567454 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v215) v1 ==== 74+0+13888 (secure 0 0 0) 0x7f99500c9dc0 con 0x7f995006d950 2023-10-09T08:17:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:58.633 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":215,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T08:17:55.462879+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:0/1181672148":"2023-10-10T08:17:53.192758+0000","172.21.15.179:0/1421907349":"2023-10-10T08:17:53.192758+0000","172.21.15.179:0/4215327123":"2023-10-10T08:17:53.192758+0000","172.21.15.179:0/4162828200":"2023-10-10T08:17:53.192758+0000","172.21.15.179:0/92053320":"2023-10-10T08:17:53.192758+0000","172.21.15.179:0/4091409703":"2023-10-10T08:17:53.192758+0000","172.21.15.179:0/3991250701":"2023-10-10T08:17:53.192758+0000","172.21.15.71:6833/2477293368":"2023-10-10T08:17:52.457247+0000","172.21.15.179:0/1351990957":"2023-10-10T08:17:43.094437+0000","172.21.15.71:6835/2477293368":"2023-10-10T08:17:52.457247+0000","172.21.15.179:0/3871404679":"2023-10-10T08:17:43.094437+0000","172.21.15.179:0/4203172728":"2023-10-10T08:17:43.094437+0000","172.21.15.179:0/978747241":"2023-10-10T08:17:43.094437+0000","172.21.15.179:6837/101206":"2023-10-10T08:17:43.094437+0000","172.21.15.179:6835/101206":"2023-10-10T08:17:43.094437+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T08:17:58.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.634+0000 7f995759d700 1 -- 172.21.15.71:0/1043567454 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9934066f30 msgr2=0x7f99340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:58.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.634+0000 7f995759d700 1 --2- 172.21.15.71:0/1043567454 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9934066f30 0x7f99340693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f994c0093f0 tx=0x7f994c017000 comp rx=0 tx=0).stop 2023-10-09T08:17:58.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.634+0000 7f995759d700 1 -- 172.21.15.71:0/1043567454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f995006d950 msgr2=0x7f99500b0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:58.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.634+0000 7f995759d700 1 --2- 172.21.15.71:0/1043567454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f995006d950 0x7f99500b0db0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f994000c560 tx=0x7f9940001020 comp rx=0 tx=0).stop 2023-10-09T08:17:58.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.634+0000 7f995759d700 1 -- 172.21.15.71:0/1043567454 shutdown_connections 2023-10-09T08:17:58.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.634+0000 7f995759d700 1 --2- 172.21.15.71:0/1043567454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f995006dd20 0x7f9950151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:58.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.634+0000 7f995759d700 1 --2- 172.21.15.71:0/1043567454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f995006a0a0 0x7f99500c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:58.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.634+0000 7f995759d700 1 --2- 172.21.15.71:0/1043567454 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9934066f30 0x7f99340693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:58.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.634+0000 7f995759d700 1 --2- 172.21.15.71:0/1043567454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f995006d950 0x7f99500b0db0 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:58.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.634+0000 7f995759d700 1 -- 172.21.15.71:0/1043567454 >> 172.21.15.71:0/1043567454 conn(0x7f99500cc1f0 msgr2=0x7f99500c13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:58.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.635+0000 7f995759d700 1 -- 172.21.15.71:0/1043567454 shutdown_connections 2023-10-09T08:17:58.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.635+0000 7f995759d700 1 -- 172.21.15.71:0/1043567454 wait complete. 2023-10-09T08:17:58.653 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-09T08:17:58.653 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T08:17:58.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.832+0000 7f1a4e9ff700 1 Processor -- start 2023-10-09T08:17:58.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.832+0000 7f1a4e9ff700 1 -- start start 2023-10-09T08:17:58.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.833+0000 7f1a4e9ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1a480cbf30 0x7f1a480ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.833+0000 7f1a4e9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1a480ccf90 0x7f1a480b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.833+0000 7f1a4e9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a480cc300 con 0x7f1a4815a270 2023-10-09T08:17:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.833+0000 7f1a4e9ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a48156bf0 con 0x7f1a480cbf30 2023-10-09T08:17:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.833+0000 7f1a4e9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a480ae950 con 0x7f1a480ccf90 2023-10-09T08:17:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.834+0000 7f1a47fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1a480cbf30 0x7f1a480ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.834+0000 7f1a477fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1a480ccf90 0x7f1a480b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.834+0000 7f1a47fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1a480cbf30 0x7f1a480ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40156/0 (socket says 172.21.15.71:40156) 2023-10-09T08:17:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.834+0000 7f1a4cf9c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f1a4815a270 0x7f1a480c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:55846/0 (socket says 172.21.15.71:55846) 2023-10-09T08:17:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.834+0000 7f1a47fff700 1 -- 172.21.15.71:0/2218761119 learned_addr learned my addr 172.21.15.71:0/2218761119 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.834+0000 7f1a47fff700 1 -- 172.21.15.71:0/2218761119 >> v2:172.21.15.179:3300/0 conn(0x7f1a480ccf90 msgr2=0x7f1a480b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:58.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.834+0000 7f1a47fff700 1 --2- 172.21.15.71:0/2218761119 >> v2:172.21.15.179:3300/0 conn(0x7f1a480ccf90 0x7f1a480b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:58.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.834+0000 7f1a47fff700 1 -- 172.21.15.71:0/2218761119 >> v1:172.21.15.179:6789/0 conn(0x7f1a4815a270 legacy=0x7f1a480c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:58.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.834+0000 7f1a47fff700 1 -- 172.21.15.71:0/2218761119 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a480ad370 con 0x7f1a480cbf30 2023-10-09T08:17:58.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.834+0000 7f1a477fe700 1 --2- 172.21.15.71:0/2218761119 >> v2:172.21.15.179:3300/0 conn(0x7f1a480ccf90 0x7f1a480b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:58.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.834+0000 7f1a46ffd700 1 -- 172.21.15.71:0/2218761119 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012050678 0 0) 0x7f1a480cc300 con 0x7f1a4815a270 2023-10-09T08:17:58.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.834+0000 7f1a47fff700 1 --2- 172.21.15.71:0/2218761119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a480cbf30 0x7f1a480ae410 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f1a4806d670 tx=0x7f1a38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1950f8eec0ca9db5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:58.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.835+0000 7f1a46ffd700 1 -- 172.21.15.71:0/2218761119 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a38009ea0 con 0x7f1a480cbf30 2023-10-09T08:17:58.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.835+0000 7f1a46ffd700 1 -- 172.21.15.71:0/2218761119 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3800b820 con 0x7f1a480cbf30 2023-10-09T08:17:58.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.835+0000 7f1a46ffd700 1 -- 172.21.15.71:0/2218761119 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3800bbc0 con 0x7f1a480cbf30 2023-10-09T08:17:58.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.835+0000 7f1a4e9ff700 1 -- 172.21.15.71:0/2218761119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a480cbf30 msgr2=0x7f1a480ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:58.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.835+0000 7f1a4e9ff700 1 --2- 172.21.15.71:0/2218761119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a480cbf30 0x7f1a480ae410 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f1a4806d670 tx=0x7f1a38009250 comp rx=0 tx=0).stop 2023-10-09T08:17:58.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.835+0000 7f1a4e9ff700 1 -- 172.21.15.71:0/2218761119 shutdown_connections 2023-10-09T08:17:58.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.835+0000 7f1a4e9ff700 1 --2- 172.21.15.71:0/2218761119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a480cbf30 0x7f1a480ae410 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:58.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.835+0000 7f1a4e9ff700 1 --2- 172.21.15.71:0/2218761119 >> v2:172.21.15.179:3300/0 conn(0x7f1a480ccf90 0x7f1a480b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.835+0000 7f1a4e9ff700 1 -- 172.21.15.71:0/2218761119 >> 172.21.15.71:0/2218761119 conn(0x7f1a4806a320 msgr2=0x7f1a480cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.835+0000 7f1a4e9ff700 1 -- 172.21.15.71:0/2218761119 shutdown_connections 2023-10-09T08:17:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.835+0000 7f1a4e9ff700 1 -- 172.21.15.71:0/2218761119 wait complete. 2023-10-09T08:17:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.837+0000 7f1a4e9ff700 1 Processor -- start 2023-10-09T08:17:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.837+0000 7f1a4e9ff700 1 -- start start 2023-10-09T08:17:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.838+0000 7f1a4e9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a480cbf30 0x7f1a48153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.838+0000 7f1a4e9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a480ccf90 0x7f1a481543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.838+0000 7f1a4e9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a4815a270 0x7f1a4816b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.838+0000 7f1a4e9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4814c140 con 0x7f1a480ccf90 2023-10-09T08:17:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.838+0000 7f1a4e9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a481548f0 con 0x7f1a480cbf30 2023-10-09T08:17:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.838+0000 7f1a4e9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a48156020 con 0x7f1a4815a270 2023-10-09T08:17:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.838+0000 7f1a477fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a480ccf90 0x7f1a481543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.838+0000 7f1a47fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a480cbf30 0x7f1a48153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.838+0000 7f1a47fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a480cbf30 0x7f1a48153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:55460/0 (socket says 172.21.15.71:55460) 2023-10-09T08:17:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.838+0000 7f1a477fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a480ccf90 0x7f1a481543b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40166/0 (socket says 172.21.15.71:40166) 2023-10-09T08:17:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.838+0000 7f1a47fff700 1 -- 172.21.15.71:0/4046178988 learned_addr learned my addr 172.21.15.71:0/4046178988 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.838+0000 7f1a4cf9c700 1 --2- 172.21.15.71:0/4046178988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a4815a270 0x7f1a4816b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.839+0000 7f1a477fe700 1 -- 172.21.15.71:0/4046178988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a4815a270 msgr2=0x7f1a4816b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.839+0000 7f1a477fe700 1 --2- 172.21.15.71:0/4046178988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a4815a270 0x7f1a4816b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.839+0000 7f1a477fe700 1 -- 172.21.15.71:0/4046178988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a480cbf30 msgr2=0x7f1a48153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.839+0000 7f1a477fe700 1 --2- 172.21.15.71:0/4046178988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a480cbf30 0x7f1a48153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.839+0000 7f1a477fe700 1 -- 172.21.15.71:0/4046178988 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3c009420 con 0x7f1a480ccf90 2023-10-09T08:17:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.839+0000 7f1a47fff700 1 --2- 172.21.15.71:0/4046178988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a480cbf30 0x7f1a48153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:58.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.839+0000 7f1a477fe700 1 --2- 172.21.15.71:0/4046178988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a480ccf90 0x7f1a481543b0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00ec80 tx=0x7f1a3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:58.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.839+0000 7f1a2ffff700 1 -- 172.21.15.71:0/4046178988 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c00c850 con 0x7f1a480ccf90 2023-10-09T08:17:58.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.839+0000 7f1a2ffff700 1 -- 172.21.15.71:0/4046178988 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3c00c9b0 con 0x7f1a480ccf90 2023-10-09T08:17:58.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.839+0000 7f1a2ffff700 1 -- 172.21.15.71:0/4046178988 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c00cd70 con 0x7f1a480ccf90 2023-10-09T08:17:58.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.839+0000 7f1a4e9ff700 1 -- 172.21.15.71:0/4046178988 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a380094f0 con 0x7f1a480ccf90 2023-10-09T08:17:58.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.839+0000 7f1a4e9ff700 1 -- 172.21.15.71:0/4046178988 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a481562c0 con 0x7f1a480ccf90 2023-10-09T08:17:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.840+0000 7f1a4e9ff700 1 -- 172.21.15.71:0/4046178988 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a4814c2f0 con 0x7f1a480ccf90 2023-10-09T08:17:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.841+0000 7f1a2ffff700 1 -- 172.21.15.71:0/4046178988 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a3c013680 con 0x7f1a480ccf90 2023-10-09T08:17:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.843+0000 7f1a2ffff700 1 --2- 172.21.15.71:0/4046178988 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1a34066f30 0x7f1a340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.843+0000 7f1a2ffff700 1 -- 172.21.15.71:0/4046178988 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f1a3c084970 con 0x7f1a480ccf90 2023-10-09T08:17:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.843+0000 7f1a47fff700 1 --2- 172.21.15.71:0/4046178988 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1a34066f30 0x7f1a340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.844+0000 7f1a47fff700 1 --2- 172.21.15.71:0/4046178988 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1a34066f30 0x7f1a340693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1a38003080 tx=0x7f1a38017000 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:58.847+0000 7f1a2ffff700 1 -- 172.21.15.71:0/4046178988 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a4814c2f0 con 0x7f1a480ccf90 2023-10-09T08:17:59.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.032+0000 7f1a4e9ff700 1 -- 172.21.15.71:0/4046178988 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a4814c2f0 con 0x7f1a34066f30 2023-10-09T08:17:59.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.034+0000 7f1a2ffff700 1 -- 172.21.15.71:0/4046178988 <== mgr.9898 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50670 (secure 0 0 0) 0x7f1a4814c2f0 con 0x7f1a34066f30 2023-10-09T08:17:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:59.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.037+0000 7f1a4e9ff700 1 -- 172.21.15.71:0/4046178988 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1a34066f30 msgr2=0x7f1a340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:59.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.037+0000 7f1a4e9ff700 1 --2- 172.21.15.71:0/4046178988 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1a34066f30 0x7f1a340693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1a38003080 tx=0x7f1a38017000 comp rx=0 tx=0).stop 2023-10-09T08:17:59.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.037+0000 7f1a4e9ff700 1 -- 172.21.15.71:0/4046178988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a480ccf90 msgr2=0x7f1a481543b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:59.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.037+0000 7f1a4e9ff700 1 --2- 172.21.15.71:0/4046178988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a480ccf90 0x7f1a481543b0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00ec80 tx=0x7f1a3c0091a0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.037+0000 7f1a4e9ff700 1 -- 172.21.15.71:0/4046178988 shutdown_connections 2023-10-09T08:17:59.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.037+0000 7f1a4e9ff700 1 --2- 172.21.15.71:0/4046178988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a4815a270 0x7f1a4816b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.037+0000 7f1a4e9ff700 1 --2- 172.21.15.71:0/4046178988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a480cbf30 0x7f1a48153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.037+0000 7f1a4e9ff700 1 --2- 172.21.15.71:0/4046178988 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1a34066f30 0x7f1a340693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.037+0000 7f1a4e9ff700 1 --2- 172.21.15.71:0/4046178988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a480ccf90 0x7f1a481543b0 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.037+0000 7f1a4e9ff700 1 -- 172.21.15.71:0/4046178988 >> 172.21.15.71:0/4046178988 conn(0x7f1a4806a320 msgr2=0x7f1a480cad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:59.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.037+0000 7f1a4e9ff700 1 -- 172.21.15.71:0/4046178988 shutdown_connections 2023-10-09T08:17:59.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.037+0000 7f1a4e9ff700 1 -- 172.21.15.71:0/4046178988 wait complete. 2023-10-09T08:17:59.040 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T08:17:59.055 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":7,"stamp":"2023-10-09T08:17:57.212541+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2475364,"kb_used_data":23332,"kb_used_omap":0,"kb_used_meta":2451968,"kb_avail":752499356,"statfs":{"total":773094113280,"available":770559340544,"internally_reserved":0,"allocated":23891968,"data_stored":13286979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510815232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-668755,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-317,"num_read_kb":-281,"num_write":-281,"num_write_kb":-2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.995616"},"pg_stats":[{"pgid":"1.0","version":"213'370","reported_seq":1224,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-09T08:17:53.279230+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T08:17:53.279230+0000","last_peered":"2023-10-09T08:17:53.279230+0000","last_clean":"2023-10-09T08:17:53.279230+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T08:17:53.279230+0000","last_undegraded":"2023-10-09T08:17:53.279230+0000","last_fullsized":"2023-10-09T08:17:53.279230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575978,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313092,"kb_used_data":3516,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94058748,"statfs":{"total":96636764160,"available":96316157952,"internally_reserved":0,"allocated":3600384,"data_stored":2267589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72899999999999998,"15min":0.751},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85799999999999998,"5min":0.98699999999999999,"15min":1.1220000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72399999999999998,"15min":0.74099999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.93300000000000005,"5min":1.0069999999999999,"15min":1.0209999999999999},"last":0.64100000000000001}]},{"osd":1,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.879,"5min":1.28,"15min":1.28},"last":0.63},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.71899999999999997,"15min":0.74299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90000000000000002,"5min":1.298,"15min":1.298},"last":0.69099999999999995}]},{"osd":2,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73199999999999998,"15min":0.74399999999999999},"min":{"1min":0.47599999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88700000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.745,"15min":0.76700000000000002},"min":{"1min":0.55700000000000005,"5min":0.49299999999999999,"15min":0.442},"max":{"1min":0.90200000000000002,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.65900000000000003}]},{"osd":3,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73099999999999998,"15min":0.73699999999999999},"min":{"1min":0.50900000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86099999999999999,"5min":1.399,"15min":1.399},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.76400000000000001,"15min":0.77200000000000002},"min":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.91500000000000004,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.64600000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.62,"15min":0.60499999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83999999999999997,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63900000000000001,"15min":0.629},"min":{"1min":0.40699999999999997,"5min":0.39900000000000002,"15min":0.38600000000000001},"max":{"1min":0.96299999999999997,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.45800000000000002}]},{"osd":5,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.376},"max":{"1min":0.85999999999999999,"5min":1.413,"15min":1.413},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.40100000000000002},"max":{"1min":0.96399999999999997,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.501}]},{"osd":6,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74399999999999999,"15min":0.73699999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98899999999999999,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70899999999999996,"15min":0.70599999999999996},"min":{"1min":0.48299999999999998,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":1.016,"5min":1.595,"15min":1.595},"last":0.67200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575977,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316268,"kb_used_data":2596,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055572,"statfs":{"total":96636764160,"available":96312905728,"internally_reserved":0,"allocated":2658304,"data_stored":1341537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.75700000000000001,"15min":0.74399999999999999},"min":{"1min":0.50700000000000001,"5min":0.46899999999999997,"15min":0.40300000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0189999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.73199999999999998,"15min":0.72799999999999998},"min":{"1min":0.46700000000000003,"5min":0.44400000000000001,"15min":0.35399999999999998},"max":{"1min":0.86699999999999999,"5min":0.96299999999999997,"15min":0.97399999999999998},"last":0.51800000000000002}]},{"osd":1,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73599999999999999,"15min":0.74299999999999999},"min":{"1min":0.47499999999999998,"5min":0.45300000000000001,"15min":0.38500000000000001},"max":{"1min":0.83599999999999997,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77400000000000002,"15min":0.76000000000000001},"min":{"1min":0.52700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.96299999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.59599999999999997}]},{"osd":2,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.496,"5min":0.495,"15min":0.47099999999999997},"max":{"1min":0.97099999999999997,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76900000000000002,"15min":0.77100000000000002},"min":{"1min":0.56899999999999995,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.96499999999999997}]},{"osd":3,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.504,"15min":0.45300000000000001},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79800000000000004,"15min":0.78700000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.99099999999999999,"5min":1.119,"15min":1.119},"last":0.58299999999999996}]},{"osd":4,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64200000000000002,"15min":0.63800000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.40200000000000002},"max":{"1min":0.93300000000000005,"5min":1.0149999999999999,"15min":1.032},"last":0.503},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.32000000000000001},"max":{"1min":0.82999999999999996,"5min":0.90300000000000002,"15min":0.93700000000000006},"last":0.56399999999999995}]},{"osd":5,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.67300000000000004,"15min":0.67200000000000004},"min":{"1min":0.53000000000000003,"5min":0.42399999999999999,"15min":0.40100000000000002},"max":{"1min":0.97699999999999998,"5min":1.232,"15min":1.232},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.72099999999999997,"15min":0.70899999999999996},"min":{"1min":0.496,"5min":0.46600000000000003,"15min":0.45200000000000001},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.121},"last":0.54500000000000004}]},{"osd":7,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.69799999999999995,"15min":0.68899999999999995},"min":{"1min":0.54800000000000004,"5min":0.46800000000000003,"15min":0.36299999999999999},"max":{"1min":0.92800000000000005,"5min":0.93200000000000005,"15min":0.98699999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.755,"15min":0.74199999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.442},"max":{"1min":1.008,"5min":1.194,"15min":1.194},"last":0.623}]}]},{"osd":1,"up_from":13,"seq":55834575978,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308412,"kb_used_data":2932,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063428,"statfs":{"total":96636764160,"available":96320950272,"internally_reserved":0,"allocated":3002368,"data_stored":1681088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45600000000000002,"15min":0.45700000000000002},"min":{"1min":0.34100000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.65000000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.443},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.40000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78300000000000003,"5min":0.95499999999999996,"15min":1.2230000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.39200000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71599999999999997,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42699999999999999,"5min":0.40300000000000002,"15min":0.39500000000000002},"max":{"1min":0.77300000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.58599999999999997}]},{"osd":3,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63,"15min":0.627},"min":{"1min":0.49199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84199999999999997,"5min":1.0049999999999999,"15min":1.2589999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.435,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":1.1519999999999999},"last":0.42399999999999999}]},{"osd":4,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78800000000000003,"15min":0.78200000000000003},"min":{"1min":0.58999999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.087,"5min":1.1759999999999999,"15min":1.224},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.80400000000000005,"15min":0.80300000000000005},"min":{"1min":0.66700000000000004,"5min":0.56499999999999995,"15min":0.51800000000000002},"max":{"1min":1.0329999999999999,"5min":1.071,"15min":1.5800000000000001},"last":0.66200000000000003}]},{"osd":5,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.81699999999999995,"15min":0.81399999999999995},"min":{"1min":0.61599999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.77},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.81799999999999995,"15min":0.80700000000000005},"min":{"1min":0.67500000000000004,"5min":0.56100000000000005,"15min":0.49299999999999999},"max":{"1min":1.177,"5min":1.262,"15min":1.288},"last":0.63500000000000001}]},{"osd":6,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.82699999999999996,"15min":0.81999999999999995},"min":{"1min":0.63900000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.071,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.84999999999999998,"15min":0.83799999999999997},"min":{"1min":0.77300000000000002,"5min":0.59999999999999998,"15min":0.56699999999999995},"max":{"1min":1.135,"5min":1.3819999999999999,"15min":1.843},"last":0.56999999999999995}]},{"osd":7,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.872,"15min":0.86299999999999999},"min":{"1min":0.751,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.103,"5min":1.1739999999999999,"15min":1.9139999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.86299999999999999,"15min":0.85299999999999998},"min":{"1min":0.70699999999999996,"5min":0.61799999999999999,"15min":0.54300000000000004},"max":{"1min":1.1339999999999999,"5min":1.2270000000000001,"15min":1.347},"last":0.76500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575977,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308988,"kb_used_data":3508,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94062852,"statfs":{"total":96636764160,"available":96320360448,"internally_reserved":0,"allocated":3592192,"data_stored":2266955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46500000000000002,"15min":0.48099999999999998},"min":{"1min":0.315,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61099999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.51600000000000001,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.64100000000000001,"5min":0.82199999999999995,"15min":0.83599999999999997},"last":0.51000000000000001}]},{"osd":2,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.55100000000000005,"15min":0.57399999999999995},"min":{"1min":0.40699999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.63300000000000001,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48699999999999999,"15min":0.50600000000000001},"min":{"1min":0.33300000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.61399999999999999,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.878}]},{"osd":3,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.50700000000000001,"15min":0.52900000000000003},"min":{"1min":0.38300000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69599999999999995,"5min":0.78200000000000003,"15min":0.80500000000000005},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59399999999999997,"15min":0.61399999999999999},"min":{"1min":0.438,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84299999999999997,"5min":0.92100000000000004,"15min":0.93200000000000005},"last":0.76400000000000001}]},{"osd":4,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77900000000000003,"15min":0.78400000000000003},"min":{"1min":0.48599999999999999,"5min":0.46600000000000003,"15min":0.42899999999999999},"max":{"1min":1.0780000000000001,"5min":1.1759999999999999,"15min":1.226},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.53000000000000003},"max":{"1min":1.0229999999999999,"5min":1.216,"15min":1.23},"last":0.86599999999999999}]},{"osd":5,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79300000000000004,"15min":0.81000000000000005},"min":{"1min":0.63500000000000001,"5min":0.51500000000000001,"15min":0.501},"max":{"1min":1.008,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78900000000000003,"15min":0.81499999999999995},"min":{"1min":0.55100000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97799999999999998,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.77700000000000002}]},{"osd":6,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.83499999999999996,"15min":0.84599999999999997},"min":{"1min":0.621,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0680000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.79100000000000004,"15min":0.81799999999999995},"min":{"1min":0.56999999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94099999999999995,"5min":1.1819999999999999,"15min":1.24},"last":0.69399999999999995}]},{"osd":7,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.85799999999999998},"min":{"1min":0.59699999999999998,"5min":0.497,"15min":0.497},"max":{"1min":1.163,"5min":1.2470000000000001,"15min":1.2929999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.83999999999999997,"15min":0.871},"min":{"1min":0.58399999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0880000000000001,"5min":1.2,"15min":1.2110000000000001},"last":0.72899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575977,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316288,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055552,"statfs":{"total":96636764160,"available":96312885248,"internally_reserved":0,"allocated":2678784,"data_stored":1349551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46300000000000002,"15min":0.46800000000000003},"min":{"1min":0.28499999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57599999999999996,"5min":0.67900000000000005,"15min":0.752},"last":0.443},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.47899999999999998,"15min":0.498},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.59099999999999997,"5min":0.73299999999999998,"15min":0.82299999999999995},"last":0.53500000000000003}]},{"osd":1,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48299999999999998,"15min":0.49299999999999999},"min":{"1min":0.34000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.60199999999999998,"5min":1.03,"15min":1.03},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69799999999999995,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.51500000000000001}]},{"osd":3,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.441,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.73299999999999998,"5min":0.89000000000000001,"15min":0.96999999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.43099999999999999},"max":{"1min":0.73199999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.623}]},{"osd":4,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78700000000000003,"15min":0.80800000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0129999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.79200000000000004,"15min":0.79500000000000004},"min":{"1min":0.56499999999999995,"5min":0.54500000000000004,"15min":0.48399999999999999},"max":{"1min":1.0960000000000001,"5min":1.206,"15min":1.206},"last":0.75}]},{"osd":5,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.78900000000000003,"15min":0.80400000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93100000000000005,"5min":1.181,"15min":1.181},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79700000000000004,"15min":0.81999999999999995},"min":{"1min":0.57599999999999996,"5min":0.56799999999999995,"15min":0.47799999999999998},"max":{"1min":0.96699999999999997,"5min":1.234,"15min":1.234},"last":0.84299999999999997}]},{"osd":6,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.98199999999999998,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.80300000000000005,"15min":0.82799999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0529999999999999,"5min":1.1799999999999999,"15min":1.224},"last":0.89200000000000002}]},{"osd":7,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.84099999999999997,"15min":0.85799999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.47899999999999998},"max":{"1min":1.0329999999999999,"5min":1.448,"15min":1.448},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.86199999999999999,"15min":0.873},"min":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1299999999999999,"5min":1.518,"15min":1.518},"last":0.93700000000000006}]}]},{"osd":3,"up_from":13,"seq":55834575978,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312504,"kb_used_data":2928,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059336,"statfs":{"total":96636764160,"available":96316760064,"internally_reserved":0,"allocated":2998272,"data_stored":1669862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47799999999999998,"15min":0.48799999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59199999999999997,"5min":0.78600000000000003,"15min":0.85999999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.503,"15min":0.505},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.63100000000000001,"5min":0.73499999999999999,"15min":0.74299999999999999},"last":0.438}]},{"osd":1,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.5,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66900000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78400000000000003,"5min":0.84999999999999998,"15min":0.91300000000000003},"last":0.47199999999999998}]},{"osd":2,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70099999999999996,"5min":0.85699999999999998,"15min":0.97299999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.65000000000000002,"15min":0.65700000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80700000000000005,"5min":0.90200000000000002,"15min":1.036},"last":0.81699999999999995}]},{"osd":4,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52100000000000002,"5min":0.49099999999999999,"15min":0.46000000000000002},"max":{"1min":1.0149999999999999,"5min":1.175,"15min":1.175},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.85899999999999999,"15min":0.86699999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.97699999999999998,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.749}]},{"osd":5,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.47399999999999998},"max":{"1min":1.026,"5min":1.1419999999999999,"15min":1.2170000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.83099999999999996,"15min":0.83399999999999996},"min":{"1min":0.64200000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.96599999999999997,"5min":1.1719999999999999,"15min":1.1739999999999999},"last":0.77000000000000002}]},{"osd":6,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97799999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.629},{"interface":"front","average":{"1min":0.749,"5min":0.81200000000000006,"15min":0.81299999999999994},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.54800000000000004},"max":{"1min":1.0620000000000001,"5min":1.1339999999999999,"15min":1.149},"last":0.50800000000000001}]},{"osd":7,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.84799999999999998,"15min":0.85399999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.96199999999999997,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.85999999999999999,"15min":0.85299999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0900000000000001,"5min":1.155,"15min":1.1639999999999999},"last":0.71799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575977,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299916,"kb_used_data":2628,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071924,"statfs":{"total":96636764160,"available":96329650176,"internally_reserved":0,"allocated":2691072,"data_stored":1361411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69999999999999996,"15min":0.71799999999999997},"min":{"1min":0.44800000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90700000000000003,"5min":0.94799999999999995,"15min":1.0029999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71599999999999997,"15min":0.73699999999999999},"min":{"1min":0.48099999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.94199999999999995,"5min":0.995,"15min":0.995},"last":0.59699999999999998}]},{"osd":1,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.71799999999999997},"min":{"1min":0.48099999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84899999999999998,"5min":0.92700000000000005,"15min":1.03},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70599999999999996,"15min":0.73399999999999999},"min":{"1min":0.47699999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94199999999999995,"5min":0.97299999999999998,"15min":1.0009999999999999},"last":0.55400000000000005}]},{"osd":2,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77100000000000002,"15min":0.79200000000000004},"min":{"1min":0.58099999999999996,"5min":0.51200000000000001,"15min":0.45000000000000001},"max":{"1min":0.95999999999999996,"5min":0.99399999999999999,"15min":1.0569999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.80100000000000005},"min":{"1min":0.52900000000000003,"5min":0.51000000000000001,"15min":0.47999999999999998},"max":{"1min":0.95199999999999996,"5min":0.97999999999999998,"15min":1.077},"last":0.72899999999999998}]},{"osd":3,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71499999999999997,"15min":0.73999999999999999},"min":{"1min":0.55200000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.876,"5min":0.96999999999999997,"15min":1.016},"last":0.626},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73799999999999999,"15min":0.76700000000000002},"min":{"1min":0.53200000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90200000000000002,"5min":0.92200000000000004,"15min":1.036},"last":0.63500000000000001}]},{"osd":5,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.36899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77200000000000002,"5min":0.94899999999999995,"15min":1.006},"last":0.376},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.629,"15min":0.63},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84999999999999998,"5min":0.94199999999999995,"15min":1.0580000000000001},"last":0.437}]},{"osd":6,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.439,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.996,"5min":1.022,"15min":1.034},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67000000000000004,"15min":0.67900000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85599999999999998,"5min":0.998,"15min":1.0609999999999999},"last":0.41999999999999998}]},{"osd":7,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71899999999999997,"15min":0.72599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.44700000000000001},"max":{"1min":0.89500000000000002,"5min":1.036,"15min":1.036},"last":0.497},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76400000000000001,"15min":0.77500000000000002},"min":{"1min":0.59299999999999997,"5min":0.498,"15min":0.443},"max":{"1min":1.044,"5min":1.0609999999999999,"15min":1.079},"last":0.52800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575978,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299896,"kb_used_data":2608,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071944,"statfs":{"total":96636764160,"available":96329670656,"internally_reserved":0,"allocated":2670592,"data_stored":1348986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.71299999999999997,"15min":0.72799999999999998},"min":{"1min":0.49399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.69499999999999995,"15min":0.70999999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.40899999999999997},"max":{"1min":0.79200000000000004,"5min":0.96699999999999997,"15min":0.97699999999999998},"last":0.58399999999999996}]},{"osd":1,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68500000000000005,"15min":0.71399999999999997},"min":{"1min":0.46999999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.86099999999999999,"5min":0.90400000000000003,"15min":1.0129999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.752,"15min":0.746},"min":{"1min":0.443,"5min":0.443,"15min":0.435},"max":{"1min":0.98599999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.59999999999999998}]},{"osd":2,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72399999999999998,"15min":0.745},"min":{"1min":0.52200000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88300000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.504},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73399999999999999,"15min":0.74299999999999999},"min":{"1min":0.54500000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.90200000000000002,"5min":0.99299999999999999,"15min":1.1359999999999999},"last":0.69299999999999995}]},{"osd":3,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72999999999999998,"15min":0.745},"min":{"1min":0.52100000000000002,"5min":0.50900000000000001,"15min":0.49199999999999999},"max":{"1min":0.94099999999999995,"5min":0.95999999999999996,"15min":0.98199999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76800000000000002,"15min":0.78600000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":1.0189999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.51200000000000001,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.60999999999999999},"min":{"1min":0.437,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89100000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.66200000000000003}]},{"osd":6,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63100000000000001,"15min":0.625},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.98699999999999999,"5min":1,"15min":1},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.70699999999999996,"15min":0.68300000000000005},"min":{"1min":0.46100000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0840000000000001,"5min":1.123,"15min":1.123},"last":0.63}]},{"osd":7,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69499999999999995,"15min":0.68600000000000005},"min":{"1min":0.48299999999999998,"5min":0.48099999999999998,"15min":0.44400000000000001},"max":{"1min":0.97999999999999998,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.58499999999999996,"5min":0.50600000000000001,"15min":0.48599999999999999},"max":{"1min":1.052,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.73199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T08:17:59.057 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T08:17:59.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.238+0000 7f523139d700 1 Processor -- start 2023-10-09T08:17:59.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.238+0000 7f523139d700 1 -- start start 2023-10-09T08:17:59.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.240+0000 7f523139d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f522c15ca80 0x7f522c0acf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:59.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.240+0000 7f523139d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c0ad4c0 0x7f522c0abde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:59.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.240+0000 7f523139d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f522c0ac320 0x7f522c0ac780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:59.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.240+0000 7f523139d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522c0aa610 con 0x7f522c15ca80 2023-10-09T08:17:59.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.240+0000 7f523139d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522c0a9a00 con 0x7f522c0ac320 2023-10-09T08:17:59.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.240+0000 7f523139d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522c0a9ce0 con 0x7f522c0ad4c0 2023-10-09T08:17:59.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.240+0000 7f522bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f522c15ca80 0x7f522c0acf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:59.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.240+0000 7f522bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f522c15ca80 0x7f522c0acf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40176/0 (socket says 172.21.15.71:40176) 2023-10-09T08:17:59.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.240+0000 7f522bfff700 1 -- 172.21.15.71:0/1795573085 learned_addr learned my addr 172.21.15.71:0/1795573085 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:59.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.240+0000 7f522bfff700 1 -- 172.21.15.71:0/1795573085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c0ad4c0 msgr2=0x7f522c0abde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:59.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.240+0000 7f522b7fe700 1 --2- 172.21.15.71:0/1795573085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c0ad4c0 0x7f522c0abde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:59.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.240+0000 7f5230b9c700 1 --2- 172.21.15.71:0/1795573085 >> v2:172.21.15.179:3300/0 conn(0x7f522c0ac320 0x7f522c0ac780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:59.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.240+0000 7f522bfff700 1 --2- 172.21.15.71:0/1795573085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c0ad4c0 0x7f522c0abde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.240+0000 7f522bfff700 1 -- 172.21.15.71:0/1795573085 >> v2:172.21.15.179:3300/0 conn(0x7f522c0ac320 msgr2=0x7f522c0ac780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:59.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.240+0000 7f522bfff700 1 --2- 172.21.15.71:0/1795573085 >> v2:172.21.15.179:3300/0 conn(0x7f522c0ac320 0x7f522c0ac780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.240+0000 7f522bfff700 1 -- 172.21.15.71:0/1795573085 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c0a9fc0 con 0x7f522c15ca80 2023-10-09T08:17:59.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.240+0000 7f5230b9c700 1 --2- 172.21.15.71:0/1795573085 >> v2:172.21.15.179:3300/0 conn(0x7f522c0ac320 0x7f522c0ac780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:59.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.240+0000 7f522b7fe700 1 --2- 172.21.15.71:0/1795573085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c0ad4c0 0x7f522c0abde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:17:59.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.241+0000 7f522bfff700 1 --2- 172.21.15.71:0/1795573085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f522c15ca80 0x7f522c0acf80 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f522c06ea80 tx=0x7f521c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d3b82934739d8b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:59.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.241+0000 7f522affd700 1 -- 172.21.15.71:0/1795573085 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c00b860 con 0x7f522c15ca80 2023-10-09T08:17:59.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.241+0000 7f522affd700 1 -- 172.21.15.71:0/1795573085 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521c00b9c0 con 0x7f522c15ca80 2023-10-09T08:17:59.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.241+0000 7f522affd700 1 -- 172.21.15.71:0/1795573085 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c00bd80 con 0x7f522c15ca80 2023-10-09T08:17:59.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.241+0000 7f523139d700 1 -- 172.21.15.71:0/1795573085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f522c15ca80 msgr2=0x7f522c0acf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:59.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.241+0000 7f523139d700 1 --2- 172.21.15.71:0/1795573085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f522c15ca80 0x7f522c0acf80 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f522c06ea80 tx=0x7f521c009250 comp rx=0 tx=0).stop 2023-10-09T08:17:59.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.242+0000 7f523139d700 1 -- 172.21.15.71:0/1795573085 shutdown_connections 2023-10-09T08:17:59.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.242+0000 7f523139d700 1 --2- 172.21.15.71:0/1795573085 >> v2:172.21.15.179:3300/0 conn(0x7f522c0ac320 0x7f522c0ac780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.242+0000 7f523139d700 1 --2- 172.21.15.71:0/1795573085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f522c15ca80 0x7f522c0acf80 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.242+0000 7f523139d700 1 --2- 172.21.15.71:0/1795573085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c0ad4c0 0x7f522c0abde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.242+0000 7f523139d700 1 -- 172.21.15.71:0/1795573085 >> 172.21.15.71:0/1795573085 conn(0x7f522c068e20 msgr2=0x7f522c0cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:59.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.242+0000 7f523139d700 1 -- 172.21.15.71:0/1795573085 shutdown_connections 2023-10-09T08:17:59.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.242+0000 7f523139d700 1 -- 172.21.15.71:0/1795573085 wait complete. 2023-10-09T08:17:59.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.243+0000 7f523139d700 1 Processor -- start 2023-10-09T08:17:59.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.243+0000 7f523139d700 1 -- start start 2023-10-09T08:17:59.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.244+0000 7f523139d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f522c0ac320 0x7f522c154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:59.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.244+0000 7f523139d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f522c0ad4c0 0x7f522c15b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:59.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.244+0000 7f523139d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c15ca80 0x7f522c15a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:59.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.244+0000 7f523139d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c159600 con 0x7f522c0ad4c0 2023-10-09T08:17:59.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.244+0000 7f523139d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c1598a0 con 0x7f522c0ac320 2023-10-09T08:17:59.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.244+0000 7f523139d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522c159b80 con 0x7f522c15ca80 2023-10-09T08:17:59.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.244+0000 7f522b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f522c0ad4c0 0x7f522c15b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:59.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.244+0000 7f522b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f522c0ad4c0 0x7f522c15b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40180/0 (socket says 172.21.15.71:40180) 2023-10-09T08:17:59.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.244+0000 7f522b7fe700 1 -- 172.21.15.71:0/2371887623 learned_addr learned my addr 172.21.15.71:0/2371887623 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:59.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.244+0000 7f522bfff700 1 --2- 172.21.15.71:0/2371887623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f522c0ac320 0x7f522c154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:59.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.244+0000 7f5230b9c700 1 --2- 172.21.15.71:0/2371887623 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c15ca80 0x7f522c15a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:59.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.245+0000 7f522b7fe700 1 -- 172.21.15.71:0/2371887623 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c15ca80 msgr2=0x7f522c15a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:59.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.245+0000 7f522b7fe700 1 --2- 172.21.15.71:0/2371887623 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c15ca80 0x7f522c15a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.245+0000 7f522b7fe700 1 -- 172.21.15.71:0/2371887623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f522c0ac320 msgr2=0x7f522c154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:59.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.245+0000 7f522b7fe700 1 --2- 172.21.15.71:0/2371887623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f522c0ac320 0x7f522c154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.245+0000 7f522b7fe700 1 -- 172.21.15.71:0/2371887623 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c0094f0 con 0x7f522c0ad4c0 2023-10-09T08:17:59.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.245+0000 7f522b7fe700 1 --2- 172.21.15.71:0/2371887623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f522c0ad4c0 0x7f522c15b960 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f522000c830 tx=0x7f5220008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:59.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.245+0000 7f5213fff700 1 -- 172.21.15.71:0/2371887623 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220011600 con 0x7f522c0ad4c0 2023-10-09T08:17:59.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.245+0000 7f5213fff700 1 -- 172.21.15.71:0/2371887623 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5220011760 con 0x7f522c0ad4c0 2023-10-09T08:17:59.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.245+0000 7f523139d700 1 -- 172.21.15.71:0/2371887623 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f522c159e60 con 0x7f522c0ad4c0 2023-10-09T08:17:59.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.245+0000 7f5213fff700 1 -- 172.21.15.71:0/2371887623 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220011b20 con 0x7f522c0ad4c0 2023-10-09T08:17:59.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.245+0000 7f523139d700 1 -- 172.21.15.71:0/2371887623 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f522c0c3c20 con 0x7f522c0ad4c0 2023-10-09T08:17:59.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.246+0000 7f523139d700 1 -- 172.21.15.71:0/2371887623 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f522c0ada30 con 0x7f522c0ad4c0 2023-10-09T08:17:59.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.247+0000 7f5213fff700 1 -- 172.21.15.71:0/2371887623 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5220018360 con 0x7f522c0ad4c0 2023-10-09T08:17:59.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.248+0000 7f5213fff700 1 --2- 172.21.15.71:0/2371887623 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5218066f30 0x7f52180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:59.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.248+0000 7f5213fff700 1 -- 172.21.15.71:0/2371887623 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f52200846a0 con 0x7f522c0ad4c0 2023-10-09T08:17:59.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.248+0000 7f522bfff700 1 --2- 172.21.15.71:0/2371887623 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5218066f30 0x7f52180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:59.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.249+0000 7f522bfff700 1 --2- 172.21.15.71:0/2371887623 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5218066f30 0x7f52180693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f522c06ea80 tx=0x7f521c017000 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:59.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.252+0000 7f5213fff700 1 -- 172.21.15.71:0/2371887623 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5220051730 con 0x7f522c0ad4c0 2023-10-09T08:17:59.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.436+0000 7f523139d700 1 -- 172.21.15.71:0/2371887623 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f522c159a10 con 0x7f5218066f30 2023-10-09T08:17:59.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.440+0000 7f5213fff700 1 -- 172.21.15.71:0/2371887623 <== mgr.9898 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50756 (secure 0 0 0) 0x7f522c159a10 con 0x7f5218066f30 2023-10-09T08:17:59.441 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:59.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.442+0000 7f523139d700 1 -- 172.21.15.71:0/2371887623 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5218066f30 msgr2=0x7f52180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:59.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.442+0000 7f523139d700 1 --2- 172.21.15.71:0/2371887623 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5218066f30 0x7f52180693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f522c06ea80 tx=0x7f521c017000 comp rx=0 tx=0).stop 2023-10-09T08:17:59.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.442+0000 7f523139d700 1 -- 172.21.15.71:0/2371887623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f522c0ad4c0 msgr2=0x7f522c15b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:59.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.442+0000 7f523139d700 1 --2- 172.21.15.71:0/2371887623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f522c0ad4c0 0x7f522c15b960 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f522000c830 tx=0x7f5220008040 comp rx=0 tx=0).stop 2023-10-09T08:17:59.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.442+0000 7f523139d700 1 -- 172.21.15.71:0/2371887623 shutdown_connections 2023-10-09T08:17:59.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.442+0000 7f523139d700 1 --2- 172.21.15.71:0/2371887623 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c15ca80 0x7f522c15a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.442+0000 7f523139d700 1 --2- 172.21.15.71:0/2371887623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f522c0ac320 0x7f522c154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.442+0000 7f523139d700 1 --2- 172.21.15.71:0/2371887623 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5218066f30 0x7f52180693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.442+0000 7f523139d700 1 --2- 172.21.15.71:0/2371887623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f522c0ad4c0 0x7f522c15b960 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.442+0000 7f523139d700 1 -- 172.21.15.71:0/2371887623 >> 172.21.15.71:0/2371887623 conn(0x7f522c068e20 msgr2=0x7f522c0b02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:59.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.442+0000 7f523139d700 1 -- 172.21.15.71:0/2371887623 shutdown_connections 2023-10-09T08:17:59.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.442+0000 7f523139d700 1 -- 172.21.15.71:0/2371887623 wait complete. 2023-10-09T08:17:59.444 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T08:17:59.460 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-10-09T08:17:59.212892+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":92,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":2462520,"kb_used_data":22776,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752512200,"statfs":{"total":773094113280,"available":770572492800,"internally_reserved":0,"allocated":23322624,"data_stored":12679916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-668755,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-317,"num_read_kb":-281,"num_write":-281,"num_write_kb":-2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.995966"},"pg_stats":[{"pgid":"1.0","version":"213'370","reported_seq":1224,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-09T08:17:53.279230+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T08:17:53.279230+0000","last_peered":"2023-10-09T08:17:53.279230+0000","last_clean":"2023-10-09T08:17:53.279230+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T08:17:53.279230+0000","last_undegraded":"2023-10-09T08:17:53.279230+0000","last_fullsized":"2023-10-09T08:17:53.279230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575978,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313092,"kb_used_data":3516,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94058748,"statfs":{"total":96636764160,"available":96316157952,"internally_reserved":0,"allocated":3600384,"data_stored":2267589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72899999999999998,"15min":0.751},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85799999999999998,"5min":0.98699999999999999,"15min":1.1220000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72399999999999998,"15min":0.74099999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.93300000000000005,"5min":1.0069999999999999,"15min":1.0209999999999999},"last":0.64100000000000001}]},{"osd":1,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.879,"5min":1.28,"15min":1.28},"last":0.63},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.71899999999999997,"15min":0.74299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90000000000000002,"5min":1.298,"15min":1.298},"last":0.69099999999999995}]},{"osd":2,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73199999999999998,"15min":0.74399999999999999},"min":{"1min":0.47599999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88700000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.745,"15min":0.76700000000000002},"min":{"1min":0.55700000000000005,"5min":0.49299999999999999,"15min":0.442},"max":{"1min":0.90200000000000002,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.65900000000000003}]},{"osd":3,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73099999999999998,"15min":0.73699999999999999},"min":{"1min":0.50900000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86099999999999999,"5min":1.399,"15min":1.399},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.76400000000000001,"15min":0.77200000000000002},"min":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.91500000000000004,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.64600000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.62,"15min":0.60499999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83999999999999997,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63900000000000001,"15min":0.629},"min":{"1min":0.40699999999999997,"5min":0.39900000000000002,"15min":0.38600000000000001},"max":{"1min":0.96299999999999997,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.45800000000000002}]},{"osd":5,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.376},"max":{"1min":0.85999999999999999,"5min":1.413,"15min":1.413},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.40100000000000002},"max":{"1min":0.96399999999999997,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.501}]},{"osd":6,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74399999999999999,"15min":0.73699999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98899999999999999,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70899999999999996,"15min":0.70599999999999996},"min":{"1min":0.48299999999999998,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":1.016,"5min":1.595,"15min":1.595},"last":0.67200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575977,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316268,"kb_used_data":2596,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055572,"statfs":{"total":96636764160,"available":96312905728,"internally_reserved":0,"allocated":2658304,"data_stored":1341537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.75700000000000001,"15min":0.74399999999999999},"min":{"1min":0.50700000000000001,"5min":0.46899999999999997,"15min":0.40300000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0189999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.73199999999999998,"15min":0.72799999999999998},"min":{"1min":0.46700000000000003,"5min":0.44400000000000001,"15min":0.35399999999999998},"max":{"1min":0.86699999999999999,"5min":0.96299999999999997,"15min":0.97399999999999998},"last":0.51800000000000002}]},{"osd":1,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73599999999999999,"15min":0.74299999999999999},"min":{"1min":0.47499999999999998,"5min":0.45300000000000001,"15min":0.38500000000000001},"max":{"1min":0.83599999999999997,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77400000000000002,"15min":0.76000000000000001},"min":{"1min":0.52700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.96299999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.59599999999999997}]},{"osd":2,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.496,"5min":0.495,"15min":0.47099999999999997},"max":{"1min":0.97099999999999997,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76900000000000002,"15min":0.77100000000000002},"min":{"1min":0.56899999999999995,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.96499999999999997}]},{"osd":3,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.504,"15min":0.45300000000000001},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79800000000000004,"15min":0.78700000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.99099999999999999,"5min":1.119,"15min":1.119},"last":0.58299999999999996}]},{"osd":4,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64200000000000002,"15min":0.63800000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.40200000000000002},"max":{"1min":0.93300000000000005,"5min":1.0149999999999999,"15min":1.032},"last":0.503},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.32000000000000001},"max":{"1min":0.82999999999999996,"5min":0.90300000000000002,"15min":0.93700000000000006},"last":0.56399999999999995}]},{"osd":5,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.67300000000000004,"15min":0.67200000000000004},"min":{"1min":0.53000000000000003,"5min":0.42399999999999999,"15min":0.40100000000000002},"max":{"1min":0.97699999999999998,"5min":1.232,"15min":1.232},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.72099999999999997,"15min":0.70899999999999996},"min":{"1min":0.496,"5min":0.46600000000000003,"15min":0.45200000000000001},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.121},"last":0.54500000000000004}]},{"osd":7,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.69799999999999995,"15min":0.68899999999999995},"min":{"1min":0.54800000000000004,"5min":0.46800000000000003,"15min":0.36299999999999999},"max":{"1min":0.92800000000000005,"5min":0.93200000000000005,"15min":0.98699999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.755,"15min":0.74199999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.442},"max":{"1min":1.008,"5min":1.194,"15min":1.194},"last":0.623}]}]},{"osd":1,"up_from":13,"seq":55834575978,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308412,"kb_used_data":2932,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063428,"statfs":{"total":96636764160,"available":96320950272,"internally_reserved":0,"allocated":3002368,"data_stored":1681088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45600000000000002,"15min":0.45700000000000002},"min":{"1min":0.34100000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.65000000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.443},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.40000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78300000000000003,"5min":0.95499999999999996,"15min":1.2230000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.39200000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71599999999999997,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42699999999999999,"5min":0.40300000000000002,"15min":0.39500000000000002},"max":{"1min":0.77300000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.58599999999999997}]},{"osd":3,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63,"15min":0.627},"min":{"1min":0.49199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84199999999999997,"5min":1.0049999999999999,"15min":1.2589999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.435,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":1.1519999999999999},"last":0.42399999999999999}]},{"osd":4,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78800000000000003,"15min":0.78200000000000003},"min":{"1min":0.58999999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.087,"5min":1.1759999999999999,"15min":1.224},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.80400000000000005,"15min":0.80300000000000005},"min":{"1min":0.66700000000000004,"5min":0.56499999999999995,"15min":0.51800000000000002},"max":{"1min":1.0329999999999999,"5min":1.071,"15min":1.5800000000000001},"last":0.66200000000000003}]},{"osd":5,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.81699999999999995,"15min":0.81399999999999995},"min":{"1min":0.61599999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.77},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.81799999999999995,"15min":0.80700000000000005},"min":{"1min":0.67500000000000004,"5min":0.56100000000000005,"15min":0.49299999999999999},"max":{"1min":1.177,"5min":1.262,"15min":1.288},"last":0.63500000000000001}]},{"osd":6,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.82699999999999996,"15min":0.81999999999999995},"min":{"1min":0.63900000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.071,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.84999999999999998,"15min":0.83799999999999997},"min":{"1min":0.77300000000000002,"5min":0.59999999999999998,"15min":0.56699999999999995},"max":{"1min":1.135,"5min":1.3819999999999999,"15min":1.843},"last":0.56999999999999995}]},{"osd":7,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.872,"15min":0.86299999999999999},"min":{"1min":0.751,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.103,"5min":1.1739999999999999,"15min":1.9139999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.86299999999999999,"15min":0.85299999999999998},"min":{"1min":0.70699999999999996,"5min":0.61799999999999999,"15min":0.54300000000000004},"max":{"1min":1.1339999999999999,"5min":1.2270000000000001,"15min":1.347},"last":0.76500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575978,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308696,"kb_used_data":3216,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063144,"statfs":{"total":96636764160,"available":96320659456,"internally_reserved":0,"allocated":3293184,"data_stored":1952955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46500000000000002,"15min":0.48099999999999998},"min":{"1min":0.315,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61099999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.51600000000000001,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.64100000000000001,"5min":0.82199999999999995,"15min":0.83599999999999997},"last":0.45100000000000001}]},{"osd":2,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.55100000000000005,"15min":0.57399999999999995},"min":{"1min":0.40699999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.63300000000000001,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.498},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48699999999999999,"15min":0.50600000000000001},"min":{"1min":0.33300000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.61399999999999999,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.36299999999999999}]},{"osd":3,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.50700000000000001,"15min":0.52900000000000003},"min":{"1min":0.38300000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69599999999999995,"5min":0.78200000000000003,"15min":0.80500000000000005},"last":0.38},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59399999999999997,"15min":0.61399999999999999},"min":{"1min":0.438,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84299999999999997,"5min":0.92100000000000004,"15min":0.93200000000000005},"last":0.54400000000000004}]},{"osd":4,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77900000000000003,"15min":0.78400000000000003},"min":{"1min":0.48599999999999999,"5min":0.46600000000000003,"15min":0.42899999999999999},"max":{"1min":1.0780000000000001,"5min":1.1759999999999999,"15min":1.226},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.53000000000000003},"max":{"1min":1.0229999999999999,"5min":1.216,"15min":1.23},"last":0.93600000000000005}]},{"osd":5,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79300000000000004,"15min":0.81000000000000005},"min":{"1min":0.63500000000000001,"5min":0.51500000000000001,"15min":0.501},"max":{"1min":1.008,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.876},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78900000000000003,"15min":0.81499999999999995},"min":{"1min":0.55100000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97799999999999998,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.77000000000000002}]},{"osd":6,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.83499999999999996,"15min":0.84599999999999997},"min":{"1min":0.621,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0680000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.79100000000000004,"15min":0.81799999999999995},"min":{"1min":0.56999999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94099999999999995,"5min":1.1819999999999999,"15min":1.24},"last":0.91800000000000004}]},{"osd":7,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.85799999999999998},"min":{"1min":0.59699999999999998,"5min":0.497,"15min":0.497},"max":{"1min":1.163,"5min":1.2470000000000001,"15min":1.2929999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.83999999999999997,"15min":0.871},"min":{"1min":0.58399999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0880000000000001,"5min":1.2,"15min":1.2110000000000001},"last":0.90200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299924,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071916,"statfs":{"total":96636764160,"available":96329641984,"internally_reserved":0,"allocated":2699264,"data_stored":1362587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46300000000000002,"15min":0.46800000000000003},"min":{"1min":0.28499999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57599999999999996,"5min":0.67900000000000005,"15min":0.752},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.47899999999999998,"15min":0.498},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.59099999999999997,"5min":0.73299999999999998,"15min":0.82299999999999995},"last":0.40899999999999997}]},{"osd":1,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48299999999999998,"15min":0.49299999999999999},"min":{"1min":0.34000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.60199999999999998,"5min":1.03,"15min":1.03},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69799999999999995,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.38100000000000001}]},{"osd":3,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.441,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.73299999999999998,"5min":0.89000000000000001,"15min":0.96999999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.43099999999999999},"max":{"1min":0.73199999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78700000000000003,"15min":0.80800000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0129999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.79200000000000004,"15min":0.79500000000000004},"min":{"1min":0.56499999999999995,"5min":0.54500000000000004,"15min":0.48399999999999999},"max":{"1min":1.0960000000000001,"5min":1.206,"15min":1.206},"last":0.99399999999999999}]},{"osd":5,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.78900000000000003,"15min":0.80400000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93100000000000005,"5min":1.181,"15min":1.181},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79700000000000004,"15min":0.81999999999999995},"min":{"1min":0.57599999999999996,"5min":0.56799999999999995,"15min":0.47799999999999998},"max":{"1min":0.96699999999999997,"5min":1.234,"15min":1.234},"last":0.85799999999999998}]},{"osd":6,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.98199999999999998,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.80300000000000005,"15min":0.82799999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0529999999999999,"5min":1.1799999999999999,"15min":1.224},"last":0.876}]},{"osd":7,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.84099999999999997,"15min":0.85799999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.47899999999999998},"max":{"1min":1.0329999999999999,"5min":1.448,"15min":1.448},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.86199999999999999,"15min":0.873},"min":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1299999999999999,"5min":1.518,"15min":1.518},"last":0.97099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312212,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059628,"statfs":{"total":96636764160,"available":96317059072,"internally_reserved":0,"allocated":2699264,"data_stored":1362587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47799999999999998,"15min":0.48799999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59199999999999997,"5min":0.78600000000000003,"15min":0.85999999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.503,"15min":0.505},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.63100000000000001,"5min":0.73499999999999999,"15min":0.74299999999999999},"last":0.42099999999999999}]},{"osd":1,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.5,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66900000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78400000000000003,"5min":0.84999999999999998,"15min":0.91300000000000003},"last":0.53600000000000003}]},{"osd":2,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70099999999999996,"5min":0.85699999999999998,"15min":0.97299999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.65000000000000002,"15min":0.65700000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80700000000000005,"5min":0.90200000000000002,"15min":1.036},"last":0.45900000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52100000000000002,"5min":0.49099999999999999,"15min":0.46000000000000002},"max":{"1min":1.0149999999999999,"5min":1.175,"15min":1.175},"last":0.505},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.85899999999999999,"15min":0.86699999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.97699999999999998,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.749}]},{"osd":5,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.47399999999999998},"max":{"1min":1.026,"5min":1.1419999999999999,"15min":1.2170000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.83099999999999996,"15min":0.83399999999999996},"min":{"1min":0.64200000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.96599999999999997,"5min":1.1719999999999999,"15min":1.1739999999999999},"last":0.68100000000000005}]},{"osd":6,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97799999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.81200000000000006,"15min":0.81299999999999994},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.54800000000000004},"max":{"1min":1.0620000000000001,"5min":1.1339999999999999,"15min":1.149},"last":0.83399999999999996}]},{"osd":7,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.84799999999999998,"15min":0.85399999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.96199999999999997,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.85999999999999999,"15min":0.85299999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0900000000000001,"5min":1.155,"15min":1.1639999999999999},"last":0.73399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":304020,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067820,"statfs":{"total":96636764160,"available":96325447680,"internally_reserved":0,"allocated":2699264,"data_stored":1362587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69999999999999996,"15min":0.71799999999999997},"min":{"1min":0.44800000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90700000000000003,"5min":0.94799999999999995,"15min":1.0029999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71599999999999997,"15min":0.73699999999999999},"min":{"1min":0.48099999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.94199999999999995,"5min":0.995,"15min":0.995},"last":0.52700000000000002}]},{"osd":1,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.71799999999999997},"min":{"1min":0.48099999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84899999999999998,"5min":0.92700000000000005,"15min":1.03},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70599999999999996,"15min":0.73399999999999999},"min":{"1min":0.47699999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94199999999999995,"5min":0.97299999999999998,"15min":1.0009999999999999},"last":0.54100000000000004}]},{"osd":2,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77100000000000002,"15min":0.79200000000000004},"min":{"1min":0.58099999999999996,"5min":0.51200000000000001,"15min":0.45000000000000001},"max":{"1min":0.95999999999999996,"5min":0.99399999999999999,"15min":1.0569999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.80100000000000005},"min":{"1min":0.52900000000000003,"5min":0.51000000000000001,"15min":0.47999999999999998},"max":{"1min":0.95199999999999996,"5min":0.97999999999999998,"15min":1.077},"last":0.79000000000000004}]},{"osd":3,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71499999999999997,"15min":0.73999999999999999},"min":{"1min":0.55200000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.876,"5min":0.96999999999999997,"15min":1.016},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73799999999999999,"15min":0.76700000000000002},"min":{"1min":0.53200000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90200000000000002,"5min":0.92200000000000004,"15min":1.036},"last":0.67100000000000004}]},{"osd":5,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.36899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77200000000000002,"5min":0.94899999999999995,"15min":1.006},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.629,"15min":0.63},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84999999999999998,"5min":0.94199999999999995,"15min":1.0580000000000001},"last":0.85299999999999998}]},{"osd":6,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.439,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.996,"5min":1.022,"15min":1.034},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67000000000000004,"15min":0.67900000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85599999999999998,"5min":0.998,"15min":1.0609999999999999},"last":0.90100000000000002}]},{"osd":7,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71899999999999997,"15min":0.72599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.44700000000000001},"max":{"1min":0.89500000000000002,"5min":1.036,"15min":1.036},"last":0.88},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76400000000000001,"15min":0.77500000000000002},"min":{"1min":0.59299999999999997,"5min":0.498,"15min":0.443},"max":{"1min":1.044,"5min":1.0609999999999999,"15min":1.079},"last":0.75800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575978,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299896,"kb_used_data":2608,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071944,"statfs":{"total":96636764160,"available":96329670656,"internally_reserved":0,"allocated":2670592,"data_stored":1348986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.71299999999999997,"15min":0.72799999999999998},"min":{"1min":0.49399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.69499999999999995,"15min":0.70999999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.40899999999999997},"max":{"1min":0.79200000000000004,"5min":0.96699999999999997,"15min":0.97699999999999998},"last":0.58399999999999996}]},{"osd":1,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68500000000000005,"15min":0.71399999999999997},"min":{"1min":0.46999999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.86099999999999999,"5min":0.90400000000000003,"15min":1.0129999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.752,"15min":0.746},"min":{"1min":0.443,"5min":0.443,"15min":0.435},"max":{"1min":0.98599999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.59999999999999998}]},{"osd":2,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72399999999999998,"15min":0.745},"min":{"1min":0.52200000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88300000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.504},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73399999999999999,"15min":0.74299999999999999},"min":{"1min":0.54500000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.90200000000000002,"5min":0.99299999999999999,"15min":1.1359999999999999},"last":0.69299999999999995}]},{"osd":3,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72999999999999998,"15min":0.745},"min":{"1min":0.52100000000000002,"5min":0.50900000000000001,"15min":0.49199999999999999},"max":{"1min":0.94099999999999995,"5min":0.95999999999999996,"15min":0.98199999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76800000000000002,"15min":0.78600000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":1.0189999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.51200000000000001,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.60999999999999999},"min":{"1min":0.437,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89100000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.66200000000000003}]},{"osd":6,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63100000000000001,"15min":0.625},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.98699999999999999,"5min":1,"15min":1},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.70699999999999996,"15min":0.68300000000000005},"min":{"1min":0.46100000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0840000000000001,"5min":1.123,"15min":1.123},"last":0.63}]},{"osd":7,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69499999999999995,"15min":0.68600000000000005},"min":{"1min":0.48299999999999998,"5min":0.48099999999999998,"15min":0.44400000000000001},"max":{"1min":0.97999999999999998,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.58499999999999996,"5min":0.50600000000000001,"15min":0.48599999999999999},"max":{"1min":1.052,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.73199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T08:17:59.462 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-09T08:17:59.462 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T08:17:59.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.643+0000 7f5776b9d700 1 Processor -- start 2023-10-09T08:17:59.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.643+0000 7f5776b9d700 1 -- start start 2023-10-09T08:17:59.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.644+0000 7f5776b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5770068aa0 0x7f57700b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:59.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.644+0000 7f5776b9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f57700b0a00 0x7f577015d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:59.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.644+0000 7f5776b9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f577015a980 con 0x7f5770157270 2023-10-09T08:17:59.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.644+0000 7f5776b9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f577015a050 con 0x7f57700b0a00 2023-10-09T08:17:59.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.644+0000 7f5776b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577015a330 con 0x7f5770068aa0 2023-10-09T08:17:59.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.645+0000 7f577639c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f57700b0a00 0x7f577015d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:59.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.645+0000 7f577539a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5770068aa0 0x7f57700b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:59.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.645+0000 7f577539a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5770068aa0 0x7f57700b04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.71:38346/0 (socket says 172.21.15.71:38346) 2023-10-09T08:17:59.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.645+0000 7f577539a700 1 -- 172.21.15.71:0/1299010299 learned_addr learned my addr 172.21.15.71:0/1299010299 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:59.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.645+0000 7f5775b9b700 1 --1- 172.21.15.71:0/1299010299 >> v1:172.21.15.179:6789/0 conn(0x7f5770157270 0x7f5770068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:55856/0 (socket says 172.21.15.71:55856) 2023-10-09T08:17:59.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.645+0000 7f577639c700 1 -- 172.21.15.71:0/1299010299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5770068aa0 msgr2=0x7f57700b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:17:59.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.645+0000 7f577639c700 1 --2- 172.21.15.71:0/1299010299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5770068aa0 0x7f57700b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.645+0000 7f577639c700 1 -- 172.21.15.71:0/1299010299 >> v1:172.21.15.179:6789/0 conn(0x7f5770157270 legacy=0x7f5770068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:59.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.645+0000 7f577639c700 1 -- 172.21.15.71:0/1299010299 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577015a610 con 0x7f57700b0a00 2023-10-09T08:17:59.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.645+0000 7f5774b99700 1 -- 172.21.15.71:0/1299010299 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3428057454 0 0) 0x7f577015a980 con 0x7f5770157270 2023-10-09T08:17:59.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.645+0000 7f577539a700 1 --2- 172.21.15.71:0/1299010299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5770068aa0 0x7f57700b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:17:59.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.646+0000 7f577639c700 1 --2- 172.21.15.71:0/1299010299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57700b0a00 0x7f577015d300 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f5768009e60 tx=0x7f5768009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89883f3d79c118e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:59.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.646+0000 7f5774b99700 1 -- 172.21.15.71:0/1299010299 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576800e070 con 0x7f57700b0a00 2023-10-09T08:17:59.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.646+0000 7f5774b99700 1 -- 172.21.15.71:0/1299010299 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576800bb60 con 0x7f57700b0a00 2023-10-09T08:17:59.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.646+0000 7f5774b99700 1 -- 172.21.15.71:0/1299010299 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768012430 con 0x7f57700b0a00 2023-10-09T08:17:59.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.646+0000 7f5776b9d700 1 -- 172.21.15.71:0/1299010299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57700b0a00 msgr2=0x7f577015d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:59.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.646+0000 7f5776b9d700 1 --2- 172.21.15.71:0/1299010299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57700b0a00 0x7f577015d300 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f5768009e60 tx=0x7f5768009780 comp rx=0 tx=0).stop 2023-10-09T08:17:59.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.646+0000 7f5776b9d700 1 -- 172.21.15.71:0/1299010299 shutdown_connections 2023-10-09T08:17:59.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.646+0000 7f5776b9d700 1 --2- 172.21.15.71:0/1299010299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57700b0a00 0x7f577015d300 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.646+0000 7f5776b9d700 1 --2- 172.21.15.71:0/1299010299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5770068aa0 0x7f57700b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.646+0000 7f5776b9d700 1 -- 172.21.15.71:0/1299010299 >> 172.21.15.71:0/1299010299 conn(0x7f57700cd310 msgr2=0x7f57700cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:59.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.646+0000 7f5776b9d700 1 -- 172.21.15.71:0/1299010299 shutdown_connections 2023-10-09T08:17:59.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.646+0000 7f5776b9d700 1 -- 172.21.15.71:0/1299010299 wait complete. 2023-10-09T08:17:59.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.648+0000 7f5776b9d700 1 Processor -- start 2023-10-09T08:17:59.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.648+0000 7f5776b9d700 1 -- start start 2023-10-09T08:17:59.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.649+0000 7f5776b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5770068aa0 0x7f577015e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:59.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.649+0000 7f5776b9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57700b0a00 0x7f577015c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:59.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.649+0000 7f5776b9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5770157270 0x7f5770155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:59.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.649+0000 7f5776b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5770155630 con 0x7f5770068aa0 2023-10-09T08:17:59.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.649+0000 7f5776b9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5770151740 con 0x7f57700b0a00 2023-10-09T08:17:59.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.649+0000 7f5776b9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57700ae820 con 0x7f5770157270 2023-10-09T08:17:59.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.649+0000 7f5775b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5770068aa0 0x7f577015e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:59.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.649+0000 7f5775b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5770068aa0 0x7f577015e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40188/0 (socket says 172.21.15.71:40188) 2023-10-09T08:17:59.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.649+0000 7f5775b9b700 1 -- 172.21.15.71:0/3660063206 learned_addr learned my addr 172.21.15.71:0/3660063206 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:17:59.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.649+0000 7f577639c700 1 --2- 172.21.15.71:0/3660063206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5770157270 0x7f5770155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:59.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.649+0000 7f577539a700 1 --2- 172.21.15.71:0/3660063206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57700b0a00 0x7f577015c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:59.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.649+0000 7f5775b9b700 1 -- 172.21.15.71:0/3660063206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5770157270 msgr2=0x7f5770155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:59.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.649+0000 7f5775b9b700 1 --2- 172.21.15.71:0/3660063206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5770157270 0x7f5770155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.649+0000 7f5775b9b700 1 -- 172.21.15.71:0/3660063206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57700b0a00 msgr2=0x7f577015c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:59.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.649+0000 7f5775b9b700 1 --2- 172.21.15.71:0/3660063206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57700b0a00 0x7f577015c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.649+0000 7f5775b9b700 1 -- 172.21.15.71:0/3660063206 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57600094f0 con 0x7f5770068aa0 2023-10-09T08:17:59.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.650+0000 7f5775b9b700 1 --2- 172.21.15.71:0/3660063206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5770068aa0 0x7f577015e970 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f576c00c5b0 tx=0x7f576c001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:59.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.650+0000 7f5765ffb700 1 -- 172.21.15.71:0/3660063206 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c005a70 con 0x7f5770068aa0 2023-10-09T08:17:59.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.650+0000 7f5765ffb700 1 -- 172.21.15.71:0/3660063206 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c005bd0 con 0x7f5770068aa0 2023-10-09T08:17:59.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.650+0000 7f5765ffb700 1 -- 172.21.15.71:0/3660063206 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c0070d0 con 0x7f5770068aa0 2023-10-09T08:17:59.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.650+0000 7f5776b9d700 1 -- 172.21.15.71:0/3660063206 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5768009a20 con 0x7f5770068aa0 2023-10-09T08:17:59.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.650+0000 7f5776b9d700 1 -- 172.21.15.71:0/3660063206 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57700ae1d0 con 0x7f5770068aa0 2023-10-09T08:17:59.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.651+0000 7f5776b9d700 1 -- 172.21.15.71:0/3660063206 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57700ce1b0 con 0x7f5770068aa0 2023-10-09T08:17:59.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.652+0000 7f5765ffb700 1 -- 172.21.15.71:0/3660063206 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f576c007480 con 0x7f5770068aa0 2023-10-09T08:17:59.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.653+0000 7f5765ffb700 1 --2- 172.21.15.71:0/3660063206 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5754066f30 0x7f57540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:17:59.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.653+0000 7f5765ffb700 1 -- 172.21.15.71:0/3660063206 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f576c083a00 con 0x7f5770068aa0 2023-10-09T08:17:59.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.653+0000 7f577539a700 1 --2- 172.21.15.71:0/3660063206 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5754066f30 0x7f57540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:17:59.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.654+0000 7f577539a700 1 --2- 172.21.15.71:0/3660063206 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5754066f30 0x7f57540693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5770156c90 tx=0x7f5760009250 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:17:59.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.657+0000 7f5765ffb700 1 -- 172.21.15.71:0/3660063206 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f576c050b30 con 0x7f5770068aa0 2023-10-09T08:17:59.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.842+0000 7f5776b9d700 1 -- 172.21.15.71:0/3660063206 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f577004c3c0 con 0x7f5754066f30 2023-10-09T08:17:59.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.845+0000 7f5765ffb700 1 -- 172.21.15.71:0/3660063206 <== mgr.9898 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50756 (secure 0 0 0) 0x7f577004c3c0 con 0x7f5754066f30 2023-10-09T08:17:59.846 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:17:59.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.847+0000 7f5776b9d700 1 -- 172.21.15.71:0/3660063206 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5754066f30 msgr2=0x7f57540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:59.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.847+0000 7f5776b9d700 1 --2- 172.21.15.71:0/3660063206 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5754066f30 0x7f57540693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5770156c90 tx=0x7f5760009250 comp rx=0 tx=0).stop 2023-10-09T08:17:59.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.847+0000 7f5776b9d700 1 -- 172.21.15.71:0/3660063206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5770068aa0 msgr2=0x7f577015e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:17:59.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.847+0000 7f5776b9d700 1 --2- 172.21.15.71:0/3660063206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5770068aa0 0x7f577015e970 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f576c00c5b0 tx=0x7f576c001040 comp rx=0 tx=0).stop 2023-10-09T08:17:59.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.847+0000 7f5776b9d700 1 -- 172.21.15.71:0/3660063206 shutdown_connections 2023-10-09T08:17:59.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.847+0000 7f5776b9d700 1 --2- 172.21.15.71:0/3660063206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5770157270 0x7f5770155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.847+0000 7f5776b9d700 1 --2- 172.21.15.71:0/3660063206 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f5754066f30 0x7f57540693e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.847+0000 7f5776b9d700 1 --2- 172.21.15.71:0/3660063206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5770068aa0 0x7f577015e970 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.847+0000 7f5776b9d700 1 --2- 172.21.15.71:0/3660063206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57700b0a00 0x7f577015c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:17:59.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.847+0000 7f5776b9d700 1 -- 172.21.15.71:0/3660063206 >> 172.21.15.71:0/3660063206 conn(0x7f57700cd310 msgr2=0x7f5770158880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:17:59.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.847+0000 7f5776b9d700 1 -- 172.21.15.71:0/3660063206 shutdown_connections 2023-10-09T08:17:59.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:17:59.847+0000 7f5776b9d700 1 -- 172.21.15.71:0/3660063206 wait complete. 2023-10-09T08:17:59.850 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T08:17:59.865 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-10-09T08:17:59.212892+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":92,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":2462520,"kb_used_data":22776,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752512200,"statfs":{"total":773094113280,"available":770572492800,"internally_reserved":0,"allocated":23322624,"data_stored":12679916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-668755,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-317,"num_read_kb":-281,"num_write":-281,"num_write_kb":-2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.995966"},"pg_stats":[{"pgid":"1.0","version":"213'370","reported_seq":1224,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-09T08:17:53.279230+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T08:17:53.279230+0000","last_peered":"2023-10-09T08:17:53.279230+0000","last_clean":"2023-10-09T08:17:53.279230+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T08:17:53.279230+0000","last_undegraded":"2023-10-09T08:17:53.279230+0000","last_fullsized":"2023-10-09T08:17:53.279230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575978,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313092,"kb_used_data":3516,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94058748,"statfs":{"total":96636764160,"available":96316157952,"internally_reserved":0,"allocated":3600384,"data_stored":2267589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72899999999999998,"15min":0.751},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85799999999999998,"5min":0.98699999999999999,"15min":1.1220000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72399999999999998,"15min":0.74099999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.93300000000000005,"5min":1.0069999999999999,"15min":1.0209999999999999},"last":0.64100000000000001}]},{"osd":1,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.879,"5min":1.28,"15min":1.28},"last":0.63},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.71899999999999997,"15min":0.74299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90000000000000002,"5min":1.298,"15min":1.298},"last":0.69099999999999995}]},{"osd":2,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73199999999999998,"15min":0.74399999999999999},"min":{"1min":0.47599999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88700000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.745,"15min":0.76700000000000002},"min":{"1min":0.55700000000000005,"5min":0.49299999999999999,"15min":0.442},"max":{"1min":0.90200000000000002,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.65900000000000003}]},{"osd":3,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73099999999999998,"15min":0.73699999999999999},"min":{"1min":0.50900000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86099999999999999,"5min":1.399,"15min":1.399},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.76400000000000001,"15min":0.77200000000000002},"min":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.91500000000000004,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.64600000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.62,"15min":0.60499999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83999999999999997,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63900000000000001,"15min":0.629},"min":{"1min":0.40699999999999997,"5min":0.39900000000000002,"15min":0.38600000000000001},"max":{"1min":0.96299999999999997,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.45800000000000002}]},{"osd":5,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.376},"max":{"1min":0.85999999999999999,"5min":1.413,"15min":1.413},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.40100000000000002},"max":{"1min":0.96399999999999997,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.501}]},{"osd":6,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74399999999999999,"15min":0.73699999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98899999999999999,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70899999999999996,"15min":0.70599999999999996},"min":{"1min":0.48299999999999998,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":1.016,"5min":1.595,"15min":1.595},"last":0.67200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575977,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316268,"kb_used_data":2596,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055572,"statfs":{"total":96636764160,"available":96312905728,"internally_reserved":0,"allocated":2658304,"data_stored":1341537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.75700000000000001,"15min":0.74399999999999999},"min":{"1min":0.50700000000000001,"5min":0.46899999999999997,"15min":0.40300000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0189999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.73199999999999998,"15min":0.72799999999999998},"min":{"1min":0.46700000000000003,"5min":0.44400000000000001,"15min":0.35399999999999998},"max":{"1min":0.86699999999999999,"5min":0.96299999999999997,"15min":0.97399999999999998},"last":0.51800000000000002}]},{"osd":1,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73599999999999999,"15min":0.74299999999999999},"min":{"1min":0.47499999999999998,"5min":0.45300000000000001,"15min":0.38500000000000001},"max":{"1min":0.83599999999999997,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77400000000000002,"15min":0.76000000000000001},"min":{"1min":0.52700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.96299999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.59599999999999997}]},{"osd":2,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.496,"5min":0.495,"15min":0.47099999999999997},"max":{"1min":0.97099999999999997,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76900000000000002,"15min":0.77100000000000002},"min":{"1min":0.56899999999999995,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.96499999999999997}]},{"osd":3,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.504,"15min":0.45300000000000001},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79800000000000004,"15min":0.78700000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.99099999999999999,"5min":1.119,"15min":1.119},"last":0.58299999999999996}]},{"osd":4,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64200000000000002,"15min":0.63800000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.40200000000000002},"max":{"1min":0.93300000000000005,"5min":1.0149999999999999,"15min":1.032},"last":0.503},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.32000000000000001},"max":{"1min":0.82999999999999996,"5min":0.90300000000000002,"15min":0.93700000000000006},"last":0.56399999999999995}]},{"osd":5,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.67300000000000004,"15min":0.67200000000000004},"min":{"1min":0.53000000000000003,"5min":0.42399999999999999,"15min":0.40100000000000002},"max":{"1min":0.97699999999999998,"5min":1.232,"15min":1.232},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.72099999999999997,"15min":0.70899999999999996},"min":{"1min":0.496,"5min":0.46600000000000003,"15min":0.45200000000000001},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.121},"last":0.54500000000000004}]},{"osd":7,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.69799999999999995,"15min":0.68899999999999995},"min":{"1min":0.54800000000000004,"5min":0.46800000000000003,"15min":0.36299999999999999},"max":{"1min":0.92800000000000005,"5min":0.93200000000000005,"15min":0.98699999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.755,"15min":0.74199999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.442},"max":{"1min":1.008,"5min":1.194,"15min":1.194},"last":0.623}]}]},{"osd":1,"up_from":13,"seq":55834575978,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308412,"kb_used_data":2932,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063428,"statfs":{"total":96636764160,"available":96320950272,"internally_reserved":0,"allocated":3002368,"data_stored":1681088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45600000000000002,"15min":0.45700000000000002},"min":{"1min":0.34100000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.65000000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.443},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.40000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78300000000000003,"5min":0.95499999999999996,"15min":1.2230000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.39200000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71599999999999997,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42699999999999999,"5min":0.40300000000000002,"15min":0.39500000000000002},"max":{"1min":0.77300000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.58599999999999997}]},{"osd":3,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63,"15min":0.627},"min":{"1min":0.49199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84199999999999997,"5min":1.0049999999999999,"15min":1.2589999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.435,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":1.1519999999999999},"last":0.42399999999999999}]},{"osd":4,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78800000000000003,"15min":0.78200000000000003},"min":{"1min":0.58999999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.087,"5min":1.1759999999999999,"15min":1.224},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.80400000000000005,"15min":0.80300000000000005},"min":{"1min":0.66700000000000004,"5min":0.56499999999999995,"15min":0.51800000000000002},"max":{"1min":1.0329999999999999,"5min":1.071,"15min":1.5800000000000001},"last":0.66200000000000003}]},{"osd":5,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.81699999999999995,"15min":0.81399999999999995},"min":{"1min":0.61599999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.77},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.81799999999999995,"15min":0.80700000000000005},"min":{"1min":0.67500000000000004,"5min":0.56100000000000005,"15min":0.49299999999999999},"max":{"1min":1.177,"5min":1.262,"15min":1.288},"last":0.63500000000000001}]},{"osd":6,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.82699999999999996,"15min":0.81999999999999995},"min":{"1min":0.63900000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.071,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.84999999999999998,"15min":0.83799999999999997},"min":{"1min":0.77300000000000002,"5min":0.59999999999999998,"15min":0.56699999999999995},"max":{"1min":1.135,"5min":1.3819999999999999,"15min":1.843},"last":0.56999999999999995}]},{"osd":7,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.872,"15min":0.86299999999999999},"min":{"1min":0.751,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.103,"5min":1.1739999999999999,"15min":1.9139999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.86299999999999999,"15min":0.85299999999999998},"min":{"1min":0.70699999999999996,"5min":0.61799999999999999,"15min":0.54300000000000004},"max":{"1min":1.1339999999999999,"5min":1.2270000000000001,"15min":1.347},"last":0.76500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575978,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308696,"kb_used_data":3216,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063144,"statfs":{"total":96636764160,"available":96320659456,"internally_reserved":0,"allocated":3293184,"data_stored":1952955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46500000000000002,"15min":0.48099999999999998},"min":{"1min":0.315,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61099999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.51600000000000001,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.64100000000000001,"5min":0.82199999999999995,"15min":0.83599999999999997},"last":0.45100000000000001}]},{"osd":2,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.55100000000000005,"15min":0.57399999999999995},"min":{"1min":0.40699999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.63300000000000001,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.498},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48699999999999999,"15min":0.50600000000000001},"min":{"1min":0.33300000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.61399999999999999,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.36299999999999999}]},{"osd":3,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.50700000000000001,"15min":0.52900000000000003},"min":{"1min":0.38300000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69599999999999995,"5min":0.78200000000000003,"15min":0.80500000000000005},"last":0.38},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59399999999999997,"15min":0.61399999999999999},"min":{"1min":0.438,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84299999999999997,"5min":0.92100000000000004,"15min":0.93200000000000005},"last":0.54400000000000004}]},{"osd":4,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77900000000000003,"15min":0.78400000000000003},"min":{"1min":0.48599999999999999,"5min":0.46600000000000003,"15min":0.42899999999999999},"max":{"1min":1.0780000000000001,"5min":1.1759999999999999,"15min":1.226},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.53000000000000003},"max":{"1min":1.0229999999999999,"5min":1.216,"15min":1.23},"last":0.93600000000000005}]},{"osd":5,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79300000000000004,"15min":0.81000000000000005},"min":{"1min":0.63500000000000001,"5min":0.51500000000000001,"15min":0.501},"max":{"1min":1.008,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.876},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78900000000000003,"15min":0.81499999999999995},"min":{"1min":0.55100000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97799999999999998,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.77000000000000002}]},{"osd":6,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.83499999999999996,"15min":0.84599999999999997},"min":{"1min":0.621,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0680000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.79100000000000004,"15min":0.81799999999999995},"min":{"1min":0.56999999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94099999999999995,"5min":1.1819999999999999,"15min":1.24},"last":0.91800000000000004}]},{"osd":7,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.85799999999999998},"min":{"1min":0.59699999999999998,"5min":0.497,"15min":0.497},"max":{"1min":1.163,"5min":1.2470000000000001,"15min":1.2929999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.83999999999999997,"15min":0.871},"min":{"1min":0.58399999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0880000000000001,"5min":1.2,"15min":1.2110000000000001},"last":0.90200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299924,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071916,"statfs":{"total":96636764160,"available":96329641984,"internally_reserved":0,"allocated":2699264,"data_stored":1362587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46300000000000002,"15min":0.46800000000000003},"min":{"1min":0.28499999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57599999999999996,"5min":0.67900000000000005,"15min":0.752},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.47899999999999998,"15min":0.498},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.59099999999999997,"5min":0.73299999999999998,"15min":0.82299999999999995},"last":0.40899999999999997}]},{"osd":1,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48299999999999998,"15min":0.49299999999999999},"min":{"1min":0.34000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.60199999999999998,"5min":1.03,"15min":1.03},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69799999999999995,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.38100000000000001}]},{"osd":3,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.441,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.73299999999999998,"5min":0.89000000000000001,"15min":0.96999999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.43099999999999999},"max":{"1min":0.73199999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78700000000000003,"15min":0.80800000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0129999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.79200000000000004,"15min":0.79500000000000004},"min":{"1min":0.56499999999999995,"5min":0.54500000000000004,"15min":0.48399999999999999},"max":{"1min":1.0960000000000001,"5min":1.206,"15min":1.206},"last":0.99399999999999999}]},{"osd":5,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.78900000000000003,"15min":0.80400000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93100000000000005,"5min":1.181,"15min":1.181},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79700000000000004,"15min":0.81999999999999995},"min":{"1min":0.57599999999999996,"5min":0.56799999999999995,"15min":0.47799999999999998},"max":{"1min":0.96699999999999997,"5min":1.234,"15min":1.234},"last":0.85799999999999998}]},{"osd":6,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.98199999999999998,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.80300000000000005,"15min":0.82799999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0529999999999999,"5min":1.1799999999999999,"15min":1.224},"last":0.876}]},{"osd":7,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.84099999999999997,"15min":0.85799999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.47899999999999998},"max":{"1min":1.0329999999999999,"5min":1.448,"15min":1.448},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.86199999999999999,"15min":0.873},"min":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1299999999999999,"5min":1.518,"15min":1.518},"last":0.97099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312212,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059628,"statfs":{"total":96636764160,"available":96317059072,"internally_reserved":0,"allocated":2699264,"data_stored":1362587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47799999999999998,"15min":0.48799999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59199999999999997,"5min":0.78600000000000003,"15min":0.85999999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.503,"15min":0.505},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.63100000000000001,"5min":0.73499999999999999,"15min":0.74299999999999999},"last":0.42099999999999999}]},{"osd":1,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.5,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66900000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78400000000000003,"5min":0.84999999999999998,"15min":0.91300000000000003},"last":0.53600000000000003}]},{"osd":2,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70099999999999996,"5min":0.85699999999999998,"15min":0.97299999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.65000000000000002,"15min":0.65700000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80700000000000005,"5min":0.90200000000000002,"15min":1.036},"last":0.45900000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52100000000000002,"5min":0.49099999999999999,"15min":0.46000000000000002},"max":{"1min":1.0149999999999999,"5min":1.175,"15min":1.175},"last":0.505},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.85899999999999999,"15min":0.86699999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.97699999999999998,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.749}]},{"osd":5,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.47399999999999998},"max":{"1min":1.026,"5min":1.1419999999999999,"15min":1.2170000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.83099999999999996,"15min":0.83399999999999996},"min":{"1min":0.64200000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.96599999999999997,"5min":1.1719999999999999,"15min":1.1739999999999999},"last":0.68100000000000005}]},{"osd":6,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97799999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.81200000000000006,"15min":0.81299999999999994},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.54800000000000004},"max":{"1min":1.0620000000000001,"5min":1.1339999999999999,"15min":1.149},"last":0.83399999999999996}]},{"osd":7,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.84799999999999998,"15min":0.85399999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.96199999999999997,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.85999999999999999,"15min":0.85299999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0900000000000001,"5min":1.155,"15min":1.1639999999999999},"last":0.73399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":304020,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067820,"statfs":{"total":96636764160,"available":96325447680,"internally_reserved":0,"allocated":2699264,"data_stored":1362587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69999999999999996,"15min":0.71799999999999997},"min":{"1min":0.44800000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90700000000000003,"5min":0.94799999999999995,"15min":1.0029999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71599999999999997,"15min":0.73699999999999999},"min":{"1min":0.48099999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.94199999999999995,"5min":0.995,"15min":0.995},"last":0.52700000000000002}]},{"osd":1,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.71799999999999997},"min":{"1min":0.48099999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84899999999999998,"5min":0.92700000000000005,"15min":1.03},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70599999999999996,"15min":0.73399999999999999},"min":{"1min":0.47699999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94199999999999995,"5min":0.97299999999999998,"15min":1.0009999999999999},"last":0.54100000000000004}]},{"osd":2,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77100000000000002,"15min":0.79200000000000004},"min":{"1min":0.58099999999999996,"5min":0.51200000000000001,"15min":0.45000000000000001},"max":{"1min":0.95999999999999996,"5min":0.99399999999999999,"15min":1.0569999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.80100000000000005},"min":{"1min":0.52900000000000003,"5min":0.51000000000000001,"15min":0.47999999999999998},"max":{"1min":0.95199999999999996,"5min":0.97999999999999998,"15min":1.077},"last":0.79000000000000004}]},{"osd":3,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71499999999999997,"15min":0.73999999999999999},"min":{"1min":0.55200000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.876,"5min":0.96999999999999997,"15min":1.016},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73799999999999999,"15min":0.76700000000000002},"min":{"1min":0.53200000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90200000000000002,"5min":0.92200000000000004,"15min":1.036},"last":0.67100000000000004}]},{"osd":5,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.36899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77200000000000002,"5min":0.94899999999999995,"15min":1.006},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.629,"15min":0.63},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84999999999999998,"5min":0.94199999999999995,"15min":1.0580000000000001},"last":0.85299999999999998}]},{"osd":6,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.439,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.996,"5min":1.022,"15min":1.034},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67000000000000004,"15min":0.67900000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85599999999999998,"5min":0.998,"15min":1.0609999999999999},"last":0.90100000000000002}]},{"osd":7,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71899999999999997,"15min":0.72599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.44700000000000001},"max":{"1min":0.89500000000000002,"5min":1.036,"15min":1.036},"last":0.88},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76400000000000001,"15min":0.77500000000000002},"min":{"1min":0.59299999999999997,"5min":0.498,"15min":0.443},"max":{"1min":1.044,"5min":1.0609999999999999,"15min":1.079},"last":0.75800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575978,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299896,"kb_used_data":2608,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071944,"statfs":{"total":96636764160,"available":96329670656,"internally_reserved":0,"allocated":2670592,"data_stored":1348986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.71299999999999997,"15min":0.72799999999999998},"min":{"1min":0.49399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.69499999999999995,"15min":0.70999999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.40899999999999997},"max":{"1min":0.79200000000000004,"5min":0.96699999999999997,"15min":0.97699999999999998},"last":0.58399999999999996}]},{"osd":1,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68500000000000005,"15min":0.71399999999999997},"min":{"1min":0.46999999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.86099999999999999,"5min":0.90400000000000003,"15min":1.0129999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.752,"15min":0.746},"min":{"1min":0.443,"5min":0.443,"15min":0.435},"max":{"1min":0.98599999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.59999999999999998}]},{"osd":2,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72399999999999998,"15min":0.745},"min":{"1min":0.52200000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88300000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.504},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73399999999999999,"15min":0.74299999999999999},"min":{"1min":0.54500000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.90200000000000002,"5min":0.99299999999999999,"15min":1.1359999999999999},"last":0.69299999999999995}]},{"osd":3,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72999999999999998,"15min":0.745},"min":{"1min":0.52100000000000002,"5min":0.50900000000000001,"15min":0.49199999999999999},"max":{"1min":0.94099999999999995,"5min":0.95999999999999996,"15min":0.98199999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76800000000000002,"15min":0.78600000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":1.0189999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.51200000000000001,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.60999999999999999},"min":{"1min":0.437,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89100000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.66200000000000003}]},{"osd":6,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63100000000000001,"15min":0.625},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.98699999999999999,"5min":1,"15min":1},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.70699999999999996,"15min":0.68300000000000005},"min":{"1min":0.46100000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0840000000000001,"5min":1.123,"15min":1.123},"last":0.63}]},{"osd":7,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69499999999999995,"15min":0.68600000000000005},"min":{"1min":0.48299999999999998,"5min":0.48099999999999998,"15min":0.44400000000000001},"max":{"1min":0.97999999999999998,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.58499999999999996,"5min":0.50600000000000001,"15min":0.48599999999999999},"max":{"1min":1.052,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.73199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T08:17:59.867 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T08:18:00.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.049+0000 7f124b59e700 1 Processor -- start 2023-10-09T08:18:00.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.049+0000 7f124b59e700 1 -- start start 2023-10-09T08:18:00.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.050+0000 7f124b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f124c1566e0 0x7f124c0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:00.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.050+0000 7f124b59e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f124c0cb900 0x7f124c0ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:00.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.050+0000 7f124b59e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f124c0ca860 con 0x7f124c156310 2023-10-09T08:18:00.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.050+0000 7f124b59e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f124c0cab40 con 0x7f124c0cb900 2023-10-09T08:18:00.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.050+0000 7f124b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124c0cae20 con 0x7f124c1566e0 2023-10-09T08:18:00.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.050+0000 7f124ad9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f124c0cb900 0x7f124c0ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:00.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.050+0000 7f124a59c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f124c156310 0x7f124c0c9dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43946/0 (socket says 172.21.15.71:43946) 2023-10-09T08:18:00.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.050+0000 7f124a59c700 1 -- 172.21.15.71:0/2314091351 learned_addr learned my addr 172.21.15.71:0/2314091351 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:18:00.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.050+0000 7f1243fff700 1 --2- 172.21.15.71:0/2314091351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f124c1566e0 0x7f124c0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:00.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.051+0000 7f1249d9b700 1 -- 172.21.15.71:0/2314091351 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307697415 0 0) 0x7f124c0ca860 con 0x7f124c156310 2023-10-09T08:18:00.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.051+0000 7f124ad9d700 1 -- 172.21.15.71:0/2314091351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f124c1566e0 msgr2=0x7f124c0ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:00.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.051+0000 7f124ad9d700 1 --2- 172.21.15.71:0/2314091351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f124c1566e0 0x7f124c0ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:00.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.051+0000 7f124ad9d700 1 -- 172.21.15.71:0/2314091351 >> v1:172.21.15.71:6789/0 conn(0x7f124c156310 legacy=0x7f124c0c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:00.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.051+0000 7f124ad9d700 1 -- 172.21.15.71:0/2314091351 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c0cb100 con 0x7f124c0cb900 2023-10-09T08:18:00.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.051+0000 7f1243fff700 1 --2- 172.21.15.71:0/2314091351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f124c1566e0 0x7f124c0ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:18:00.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.051+0000 7f124ad9d700 1 --2- 172.21.15.71:0/2314091351 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f124c0cb900 0x7f124c0ae540 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f1244009e60 tx=0x7f1244009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777055990247cbfc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:00.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.051+0000 7f1249d9b700 1 -- 172.21.15.71:0/2314091351 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124400e070 con 0x7f124c0cb900 2023-10-09T08:18:00.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.051+0000 7f1249d9b700 1 -- 172.21.15.71:0/2314091351 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124400bc30 con 0x7f124c0cb900 2023-10-09T08:18:00.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.051+0000 7f1249d9b700 1 -- 172.21.15.71:0/2314091351 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244012430 con 0x7f124c0cb900 2023-10-09T08:18:00.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.052+0000 7f124b59e700 1 -- 172.21.15.71:0/2314091351 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f124c0cb900 msgr2=0x7f124c0ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:00.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.052+0000 7f124b59e700 1 --2- 172.21.15.71:0/2314091351 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f124c0cb900 0x7f124c0ae540 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f1244009e60 tx=0x7f1244009780 comp rx=0 tx=0).stop 2023-10-09T08:18:00.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.052+0000 7f124b59e700 1 -- 172.21.15.71:0/2314091351 shutdown_connections 2023-10-09T08:18:00.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.052+0000 7f124b59e700 1 --2- 172.21.15.71:0/2314091351 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f124c0cb900 0x7f124c0ae540 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:00.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.052+0000 7f124b59e700 1 --2- 172.21.15.71:0/2314091351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f124c1566e0 0x7f124c0ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:00.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.052+0000 7f124b59e700 1 -- 172.21.15.71:0/2314091351 >> 172.21.15.71:0/2314091351 conn(0x7f124c0cc1f0 msgr2=0x7f124c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:00.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.052+0000 7f124b59e700 1 -- 172.21.15.71:0/2314091351 shutdown_connections 2023-10-09T08:18:00.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.052+0000 7f124b59e700 1 -- 172.21.15.71:0/2314091351 wait complete. 2023-10-09T08:18:00.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.053+0000 7f124b59e700 1 Processor -- start 2023-10-09T08:18:00.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.054+0000 7f124b59e700 1 -- start start 2023-10-09T08:18:00.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.054+0000 7f124b59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f124c0cb900 0x7f124c0c1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:00.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.054+0000 7f124b59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f124c156310 0x7f124c0b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:00.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.054+0000 7f124b59e700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f124c1566e0 0x7f124c0b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:00.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.054+0000 7f124b59e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c147bf0 con 0x7f124c156310 2023-10-09T08:18:00.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.054+0000 7f124b59e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c147ed0 con 0x7f124c0cb900 2023-10-09T08:18:00.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.054+0000 7f124b59e700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124c146f20 con 0x7f124c1566e0 2023-10-09T08:18:00.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.055+0000 7f1243fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f124c156310 0x7f124c0b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:00.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.055+0000 7f1243fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f124c156310 0x7f124c0b15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40200/0 (socket says 172.21.15.71:40200) 2023-10-09T08:18:00.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.055+0000 7f1243fff700 1 -- 172.21.15.71:0/351638413 learned_addr learned my addr 172.21.15.71:0/351638413 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:00.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.055+0000 7f124a59c700 1 --2- 172.21.15.71:0/351638413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f124c0cb900 0x7f124c0c1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:00.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.055+0000 7f124ad9d700 1 --2- 172.21.15.71:0/351638413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f124c1566e0 0x7f124c0b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:00.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.055+0000 7f1243fff700 1 -- 172.21.15.71:0/351638413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f124c1566e0 msgr2=0x7f124c0b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:00.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.055+0000 7f1243fff700 1 --2- 172.21.15.71:0/351638413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f124c1566e0 0x7f124c0b1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:00.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.055+0000 7f1243fff700 1 -- 172.21.15.71:0/351638413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f124c0cb900 msgr2=0x7f124c0c1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:00.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.055+0000 7f1243fff700 1 --2- 172.21.15.71:0/351638413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f124c0cb900 0x7f124c0c1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:00.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.055+0000 7f1243fff700 1 -- 172.21.15.71:0/351638413 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1244009a20 con 0x7f124c156310 2023-10-09T08:18:00.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.055+0000 7f124a59c700 1 --2- 172.21.15.71:0/351638413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f124c0cb900 0x7f124c0c1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:18:00.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.055+0000 7f1243fff700 1 --2- 172.21.15.71:0/351638413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f124c156310 0x7f124c0b15c0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f123400d7e0 tx=0x7f1234008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:00.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.055+0000 7f12427fc700 1 -- 172.21.15.71:0/351638413 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12340125f0 con 0x7f124c156310 2023-10-09T08:18:00.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.055+0000 7f12427fc700 1 -- 172.21.15.71:0/351638413 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1234012750 con 0x7f124c156310 2023-10-09T08:18:00.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.055+0000 7f124b59e700 1 -- 172.21.15.71:0/351638413 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124c147200 con 0x7f124c156310 2023-10-09T08:18:00.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.056+0000 7f12427fc700 1 -- 172.21.15.71:0/351638413 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1234012af0 con 0x7f124c156310 2023-10-09T08:18:00.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.056+0000 7f124b59e700 1 -- 172.21.15.71:0/351638413 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124c1477c0 con 0x7f124c156310 2023-10-09T08:18:00.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.057+0000 7f124b59e700 1 -- 172.21.15.71:0/351638413 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124c148040 con 0x7f124c156310 2023-10-09T08:18:00.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.057+0000 7f12427fc700 1 -- 172.21.15.71:0/351638413 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f123401e460 con 0x7f124c156310 2023-10-09T08:18:00.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.058+0000 7f12427fc700 1 --2- 172.21.15.71:0/351638413 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f122c066f30 0x7f122c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:00.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.058+0000 7f12427fc700 1 -- 172.21.15.71:0/351638413 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f1234084d20 con 0x7f124c156310 2023-10-09T08:18:00.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.059+0000 7f124a59c700 1 --2- 172.21.15.71:0/351638413 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f122c066f30 0x7f122c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:00.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.059+0000 7f124a59c700 1 --2- 172.21.15.71:0/351638413 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f122c066f30 0x7f122c0693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f123c0018d0 tx=0x7f123c009040 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:00.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.062+0000 7f12427fc700 1 -- 172.21.15.71:0/351638413 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1234051db0 con 0x7f124c156310 2023-10-09T08:18:00.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.254+0000 7f124b59e700 1 -- 172.21.15.71:0/351638413 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f124c04c3c0 con 0x7f124c156310 2023-10-09T08:18:00.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.255+0000 7f12427fc700 1 -- 172.21.15.71:0/351638413 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v215) v1 ==== 74+0+13888 (secure 0 0 0) 0x7f12340553d0 con 0x7f124c156310 2023-10-09T08:18:00.256 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:18:00.257 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":215,"fsid":"604c5619-653a-4ab6-912c-ab2e5464fe4a","created":"2023-10-09T06:42:13.652113+0000","modified":"2023-10-09T08:17:55.462879+0000","last_up_change":"2023-10-09T06:42:25.857782+0000","last_in_change":"2023-10-09T06:42:17.012751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T06:42:26.607635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"19d03ca4-e6df-41aa-96f2-124f6caf3544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":85788},{"type":"v1","addr":"172.21.15.71:6801","nonce":85788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":85788},{"type":"v1","addr":"172.21.15.71:6803","nonce":85788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":85788},{"type":"v1","addr":"172.21.15.71:6807","nonce":85788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":85788},{"type":"v1","addr":"172.21.15.71:6805","nonce":85788}]},"public_addr":"172.21.15.71:6801/85788","cluster_addr":"172.21.15.71:6803/85788","heartbeat_back_addr":"172.21.15.71:6807/85788","heartbeat_front_addr":"172.21.15.71:6805/85788","state":["exists","up"]},{"osd":1,"uuid":"e85eb90c-750f-4d88-a1e6-a6e2d1bf9673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":85792},{"type":"v1","addr":"172.21.15.71:6817","nonce":85792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":85792},{"type":"v1","addr":"172.21.15.71:6819","nonce":85792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":85792},{"type":"v1","addr":"172.21.15.71:6824","nonce":85792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":85792},{"type":"v1","addr":"172.21.15.71:6821","nonce":85792}]},"public_addr":"172.21.15.71:6817/85792","cluster_addr":"172.21.15.71:6819/85792","heartbeat_back_addr":"172.21.15.71:6824/85792","heartbeat_front_addr":"172.21.15.71:6821/85792","state":["exists","up"]},{"osd":2,"uuid":"deab9835-7328-4761-a3fd-13db8c80d559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":85789},{"type":"v1","addr":"172.21.15.71:6809","nonce":85789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":85789},{"type":"v1","addr":"172.21.15.71:6811","nonce":85789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":85789},{"type":"v1","addr":"172.21.15.71:6815","nonce":85789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":85789},{"type":"v1","addr":"172.21.15.71:6813","nonce":85789}]},"public_addr":"172.21.15.71:6809/85789","cluster_addr":"172.21.15.71:6811/85789","heartbeat_back_addr":"172.21.15.71:6815/85789","heartbeat_front_addr":"172.21.15.71:6813/85789","state":["exists","up"]},{"osd":3,"uuid":"7bb54ddc-5fa5-409f-b399-b3f91f31c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":85810},{"type":"v1","addr":"172.21.15.71:6825","nonce":85810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":85810},{"type":"v1","addr":"172.21.15.71:6827","nonce":85810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":85810},{"type":"v1","addr":"172.21.15.71:6831","nonce":85810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":85810},{"type":"v1","addr":"172.21.15.71:6829","nonce":85810}]},"public_addr":"172.21.15.71:6825/85810","cluster_addr":"172.21.15.71:6827/85810","heartbeat_back_addr":"172.21.15.71:6831/85810","heartbeat_front_addr":"172.21.15.71:6829/85810","state":["exists","up"]},{"osd":4,"uuid":"665ff040-e3f7-4797-aabb-4da836fec1b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":86045},{"type":"v1","addr":"172.21.15.179:6824","nonce":86045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":86045},{"type":"v1","addr":"172.21.15.179:6827","nonce":86045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":86045},{"type":"v1","addr":"172.21.15.179:6831","nonce":86045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":86045},{"type":"v1","addr":"172.21.15.179:6829","nonce":86045}]},"public_addr":"172.21.15.179:6824/86045","cluster_addr":"172.21.15.179:6827/86045","heartbeat_back_addr":"172.21.15.179:6831/86045","heartbeat_front_addr":"172.21.15.179:6829/86045","state":["exists","up"]},{"osd":5,"uuid":"2cc5c3c9-78f0-4a52-8f99-5c9917f54e72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":86054},{"type":"v1","addr":"172.21.15.179:6817","nonce":86054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":86054},{"type":"v1","addr":"172.21.15.179:6819","nonce":86054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6823","nonce":86054},{"type":"v1","addr":"172.21.15.179:6825","nonce":86054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":86054},{"type":"v1","addr":"172.21.15.179:6821","nonce":86054}]},"public_addr":"172.21.15.179:6817/86054","cluster_addr":"172.21.15.179:6819/86054","heartbeat_back_addr":"172.21.15.179:6825/86054","heartbeat_front_addr":"172.21.15.179:6821/86054","state":["exists","up"]},{"osd":6,"uuid":"42ca831e-7ec1-41af-b57d-5347b8474863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":86042},{"type":"v1","addr":"172.21.15.179:6801","nonce":86042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":86042},{"type":"v1","addr":"172.21.15.179:6803","nonce":86042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":86042},{"type":"v1","addr":"172.21.15.179:6807","nonce":86042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":86042},{"type":"v1","addr":"172.21.15.179:6805","nonce":86042}]},"public_addr":"172.21.15.179:6801/86042","cluster_addr":"172.21.15.179:6803/86042","heartbeat_back_addr":"172.21.15.179:6807/86042","heartbeat_front_addr":"172.21.15.179:6805/86042","state":["exists","up"]},{"osd":7,"uuid":"05e957b3-1e58-4ffb-9e9d-de3b2eaae636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":86043},{"type":"v1","addr":"172.21.15.179:6809","nonce":86043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":86043},{"type":"v1","addr":"172.21.15.179:6811","nonce":86043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":86043},{"type":"v1","addr":"172.21.15.179:6815","nonce":86043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":86043},{"type":"v1","addr":"172.21.15.179:6813","nonce":86043}]},"public_addr":"172.21.15.179:6809/86043","cluster_addr":"172.21.15.179:6811/86043","heartbeat_back_addr":"172.21.15.179:6815/86043","heartbeat_front_addr":"172.21.15.179:6813/86043","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.259260+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.292456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.294614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.602831+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.324104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.564370+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.502884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T06:42:22.344330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:0/1181672148":"2023-10-10T08:17:53.192758+0000","172.21.15.179:0/1421907349":"2023-10-10T08:17:53.192758+0000","172.21.15.179:0/4215327123":"2023-10-10T08:17:53.192758+0000","172.21.15.179:0/4162828200":"2023-10-10T08:17:53.192758+0000","172.21.15.179:0/92053320":"2023-10-10T08:17:53.192758+0000","172.21.15.179:0/4091409703":"2023-10-10T08:17:53.192758+0000","172.21.15.179:0/3991250701":"2023-10-10T08:17:53.192758+0000","172.21.15.71:6833/2477293368":"2023-10-10T08:17:52.457247+0000","172.21.15.179:0/1351990957":"2023-10-10T08:17:43.094437+0000","172.21.15.71:6835/2477293368":"2023-10-10T08:17:52.457247+0000","172.21.15.179:0/3871404679":"2023-10-10T08:17:43.094437+0000","172.21.15.179:0/4203172728":"2023-10-10T08:17:43.094437+0000","172.21.15.179:0/978747241":"2023-10-10T08:17:43.094437+0000","172.21.15.179:6837/101206":"2023-10-10T08:17:43.094437+0000","172.21.15.179:6835/101206":"2023-10-10T08:17:43.094437+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":55,"length":1},{"begin":59,"length":2},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":76,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":90,"length":1},{"begin":96,"length":2},{"begin":101,"length":1},{"begin":107,"length":2},{"begin":191,"length":27}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":7,"length":51},{"begin":63,"length":51}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T08:18:00.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.258+0000 7f124b59e700 1 -- 172.21.15.71:0/351638413 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f122c066f30 msgr2=0x7f122c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:00.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.258+0000 7f124b59e700 1 --2- 172.21.15.71:0/351638413 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f122c066f30 0x7f122c0693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f123c0018d0 tx=0x7f123c009040 comp rx=0 tx=0).stop 2023-10-09T08:18:00.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.258+0000 7f124b59e700 1 -- 172.21.15.71:0/351638413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f124c156310 msgr2=0x7f124c0b15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:00.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.258+0000 7f124b59e700 1 --2- 172.21.15.71:0/351638413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f124c156310 0x7f124c0b15c0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f123400d7e0 tx=0x7f1234008040 comp rx=0 tx=0).stop 2023-10-09T08:18:00.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.258+0000 7f124b59e700 1 -- 172.21.15.71:0/351638413 shutdown_connections 2023-10-09T08:18:00.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.258+0000 7f124b59e700 1 --2- 172.21.15.71:0/351638413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f124c1566e0 0x7f124c0b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:00.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.258+0000 7f124b59e700 1 --2- 172.21.15.71:0/351638413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f124c0cb900 0x7f124c0c1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:00.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.258+0000 7f124b59e700 1 --2- 172.21.15.71:0/351638413 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f122c066f30 0x7f122c0693e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:00.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.258+0000 7f124b59e700 1 --2- 172.21.15.71:0/351638413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f124c156310 0x7f124c0b15c0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:00.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.258+0000 7f124b59e700 1 -- 172.21.15.71:0/351638413 >> 172.21.15.71:0/351638413 conn(0x7f124c0cc1f0 msgr2=0x7f124c069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:00.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.258+0000 7f124b59e700 1 -- 172.21.15.71:0/351638413 shutdown_connections 2023-10-09T08:18:00.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:00.258+0000 7f124b59e700 1 -- 172.21.15.71:0/351638413 wait complete. 2023-10-09T08:18:01.277 INFO:tasks.ceph:Scrubbing osd.0 2023-10-09T08:18:01.278 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-09T08:18:01.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.472+0000 7fbbcefff700 1 Processor -- start 2023-10-09T08:18:01.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.473+0000 7fbbcefff700 1 -- start start 2023-10-09T08:18:01.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.474+0000 7fbbcefff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbbc81563b0 0x7fbbc8156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:01.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.474+0000 7fbbcefff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbc8068890 0x7fbbc80c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:01.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.474+0000 7fbbcefff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc815a9b0 con 0x7fbbc815a440 2023-10-09T08:18:01.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.474+0000 7fbbcefff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc815ac90 con 0x7fbbc81563b0 2023-10-09T08:18:01.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.474+0000 7fbbcefff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc815af70 con 0x7fbbc8068890 2023-10-09T08:18:01.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.474+0000 7fbbccd9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbbc81563b0 0x7fbbc8156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:01.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.474+0000 7fbbc7fff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fbbc815a440 0x7fbbc80acf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.71:55868/0 (socket says 172.21.15.71:55868) 2023-10-09T08:18:01.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.474+0000 7fbbc7fff700 1 -- 172.21.15.71:0/830708774 learned_addr learned my addr 172.21.15.71:0/830708774 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:18:01.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.474+0000 7fbbcd59c700 1 --2- 172.21.15.71:0/830708774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbc8068890 0x7fbbc80c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:01.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.475+0000 7fbbc77fe700 1 -- 172.21.15.71:0/830708774 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889546522 0 0) 0x7fbbc815a9b0 con 0x7fbbc815a440 2023-10-09T08:18:01.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.475+0000 7fbbc77fe700 1 -- 172.21.15.71:0/830708774 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbb8003570 con 0x7fbbc815a440 2023-10-09T08:18:01.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.475+0000 7fbbcd59c700 1 -- 172.21.15.71:0/830708774 >> v2:172.21.15.179:3300/0 conn(0x7fbbc81563b0 msgr2=0x7fbbc8156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:01.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.475+0000 7fbbcd59c700 1 --2- 172.21.15.71:0/830708774 >> v2:172.21.15.179:3300/0 conn(0x7fbbc81563b0 0x7fbbc8156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:01.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.475+0000 7fbbcd59c700 1 -- 172.21.15.71:0/830708774 >> v1:172.21.15.179:6789/0 conn(0x7fbbc815a440 legacy=0x7fbbc80acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:01.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.475+0000 7fbbcd59c700 1 -- 172.21.15.71:0/830708774 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc815b250 con 0x7fbbc8068890 2023-10-09T08:18:01.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.475+0000 7fbbcd59c700 1 --2- 172.21.15.71:0/830708774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbc8068890 0x7fbbc80c8230 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0009e60 tx=0x7fbbc0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b60660ede17dd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:01.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.475+0000 7fbbc77fe700 1 -- 172.21.15.71:0/830708774 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc000e070 con 0x7fbbc8068890 2023-10-09T08:18:01.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.475+0000 7fbbc77fe700 1 -- 172.21.15.71:0/830708774 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc000bab0 con 0x7fbbc8068890 2023-10-09T08:18:01.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.475+0000 7fbbc77fe700 1 -- 172.21.15.71:0/830708774 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc000be70 con 0x7fbbc8068890 2023-10-09T08:18:01.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.476+0000 7fbbcefff700 1 -- 172.21.15.71:0/830708774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbc8068890 msgr2=0x7fbbc80c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:01.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.476+0000 7fbbcefff700 1 --2- 172.21.15.71:0/830708774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbc8068890 0x7fbbc80c8230 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0009e60 tx=0x7fbbc0009780 comp rx=0 tx=0).stop 2023-10-09T08:18:01.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.476+0000 7fbbcefff700 1 -- 172.21.15.71:0/830708774 shutdown_connections 2023-10-09T08:18:01.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.476+0000 7fbbcefff700 1 --2- 172.21.15.71:0/830708774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbc8068890 0x7fbbc80c8230 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:01.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.476+0000 7fbbcefff700 1 --2- 172.21.15.71:0/830708774 >> v2:172.21.15.179:3300/0 conn(0x7fbbc81563b0 0x7fbbc8156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:01.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.476+0000 7fbbcefff700 1 -- 172.21.15.71:0/830708774 >> 172.21.15.71:0/830708774 conn(0x7fbbc80c8f90 msgr2=0x7fbbc80c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:01.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.476+0000 7fbbcefff700 1 -- 172.21.15.71:0/830708774 shutdown_connections 2023-10-09T08:18:01.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.476+0000 7fbbcefff700 1 -- 172.21.15.71:0/830708774 wait complete. 2023-10-09T08:18:01.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.477+0000 7fbbcefff700 1 Processor -- start 2023-10-09T08:18:01.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.478+0000 7fbbcefff700 1 -- start start 2023-10-09T08:18:01.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.478+0000 7fbbcefff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbc8068890 0x7fbbc8153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:01.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.479+0000 7fbbcefff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbc81563b0 0x7fbbc814e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:01.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.479+0000 7fbbcefff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbc815a440 0x7fbbc80cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:01.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.479+0000 7fbbcefff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc8154500 con 0x7fbbc8068890 2023-10-09T08:18:01.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.479+0000 7fbbcefff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc80c1220 con 0x7fbbc81563b0 2023-10-09T08:18:01.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.479+0000 7fbbcefff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc80c0ef0 con 0x7fbbc815a440 2023-10-09T08:18:01.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.479+0000 7fbbccd9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbc8068890 0x7fbbc8153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:01.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.479+0000 7fbbccd9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbc8068890 0x7fbbc8153410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40202/0 (socket says 172.21.15.71:40202) 2023-10-09T08:18:01.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.479+0000 7fbbccd9b700 1 -- 172.21.15.71:0/183100453 learned_addr learned my addr 172.21.15.71:0/183100453 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:01.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.479+0000 7fbbcd59c700 1 --2- 172.21.15.71:0/183100453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbc815a440 0x7fbbc80cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:01.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.479+0000 7fbbc7fff700 1 --2- 172.21.15.71:0/183100453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbc81563b0 0x7fbbc814e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:01.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.479+0000 7fbbcd59c700 1 -- 172.21.15.71:0/183100453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbc81563b0 msgr2=0x7fbbc814e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:01.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.479+0000 7fbbcd59c700 1 --2- 172.21.15.71:0/183100453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbc81563b0 0x7fbbc814e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:01.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.479+0000 7fbbcd59c700 1 -- 172.21.15.71:0/183100453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbc8068890 msgr2=0x7fbbc8153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:01.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.479+0000 7fbbcd59c700 1 --2- 172.21.15.71:0/183100453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbc8068890 0x7fbbc8153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:01.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.479+0000 7fbbcd59c700 1 -- 172.21.15.71:0/183100453 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc0009a20 con 0x7fbbc815a440 2023-10-09T08:18:01.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.479+0000 7fbbccd9b700 1 --2- 172.21.15.71:0/183100453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbc8068890 0x7fbbc8153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:18:01.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.480+0000 7fbbcd59c700 1 --2- 172.21.15.71:0/183100453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbc815a440 0x7fbbc80cc1b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0016000 tx=0x7fbbc0019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:01.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.480+0000 7fbbc4ff9700 1 -- 172.21.15.71:0/183100453 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0027470 con 0x7fbbc815a440 2023-10-09T08:18:01.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.480+0000 7fbbc4ff9700 1 -- 172.21.15.71:0/183100453 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc00275f0 con 0x7fbbc815a440 2023-10-09T08:18:01.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.480+0000 7fbbc4ff9700 1 -- 172.21.15.71:0/183100453 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc00279b0 con 0x7fbbc815a440 2023-10-09T08:18:01.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.480+0000 7fbbcefff700 1 -- 172.21.15.71:0/183100453 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc8153c60 con 0x7fbbc815a440 2023-10-09T08:18:01.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.480+0000 7fbbcefff700 1 -- 172.21.15.71:0/183100453 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc8154220 con 0x7fbbc815a440 2023-10-09T08:18:01.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.481+0000 7fbbcefff700 1 -- 172.21.15.71:0/183100453 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbbc8153a10 con 0x7fbbc815a440 2023-10-09T08:18:01.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.482+0000 7fbbc4ff9700 1 -- 172.21.15.71:0/183100453 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbbc0024070 con 0x7fbbc815a440 2023-10-09T08:18:01.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.483+0000 7fbbc4ff9700 1 --2- 172.21.15.71:0/183100453 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbbac066f30 0x7fbbac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:01.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.483+0000 7fbbc4ff9700 1 -- 172.21.15.71:0/183100453 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7fbbc0087270 con 0x7fbbc815a440 2023-10-09T08:18:01.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.483+0000 7fbbc4ff9700 1 --2- 172.21.15.71:0/183100453 >> [v2:172.21.15.71:6800/85788,v1:172.21.15.71:6801/85788] conn(0x7fbbac06d6d0 0x7fbbac06fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:01.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.483+0000 7fbbc4ff9700 1 -- 172.21.15.71:0/183100453 --> [v2:172.21.15.71:6800/85788,v1:172.21.15.71:6801/85788] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbbac070170 con 0x7fbbac06d6d0 2023-10-09T08:18:01.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.483+0000 7fbbccd9b700 1 --2- 172.21.15.71:0/183100453 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbbac066f30 0x7fbbac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:01.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.483+0000 7fbbc4ff9700 1 -- 172.21.15.71:0/183100453 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=215) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbc0087560 con 0x7fbbc815a440 2023-10-09T08:18:01.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.483+0000 7fbbc7fff700 1 --2- 172.21.15.71:0/183100453 >> [v2:172.21.15.71:6800/85788,v1:172.21.15.71:6801/85788] conn(0x7fbbac06d6d0 0x7fbbac06fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:01.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.484+0000 7fbbccd9b700 1 --2- 172.21.15.71:0/183100453 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbbac066f30 0x7fbbac0693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc009e40 tx=0x7fbbbc008040 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:01.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.484+0000 7fbbc7fff700 1 --2- 172.21.15.71:0/183100453 >> [v2:172.21.15.71:6800/85788,v1:172.21.15.71:6801/85788] conn(0x7fbbac06d6d0 0x7fbbac06fb40 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:01.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.484+0000 7fbbc4ff9700 1 -- 172.21.15.71:0/183100453 <== osd.0 v2:172.21.15.71:6800/85788 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fbbac070170 con 0x7fbbac06d6d0 2023-10-09T08:18:01.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.499+0000 7fbbcefff700 1 -- 172.21.15.71:0/183100453 --> [v2:172.21.15.71:6800/85788,v1:172.21.15.71:6801/85788] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbbc80718b0 con 0x7fbbac06d6d0 2023-10-09T08:18:01.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.499+0000 7fbbc4ff9700 1 -- 172.21.15.71:0/183100453 <== osd.0 v2:172.21.15.71:6800/85788 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbbc80718b0 con 0x7fbbac06d6d0 2023-10-09T08:18:01.500 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T08:18:01.500 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T08:18:01.500 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T08:18:01.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.499+0000 7fbbcefff700 1 -- 172.21.15.71:0/183100453 >> [v2:172.21.15.71:6800/85788,v1:172.21.15.71:6801/85788] conn(0x7fbbac06d6d0 msgr2=0x7fbbac06fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:01.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.499+0000 7fbbcefff700 1 --2- 172.21.15.71:0/183100453 >> [v2:172.21.15.71:6800/85788,v1:172.21.15.71:6801/85788] conn(0x7fbbac06d6d0 0x7fbbac06fb40 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:01.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.499+0000 7fbbcefff700 1 -- 172.21.15.71:0/183100453 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbbac066f30 msgr2=0x7fbbac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:01.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.499+0000 7fbbcefff700 1 --2- 172.21.15.71:0/183100453 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbbac066f30 0x7fbbac0693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc009e40 tx=0x7fbbbc008040 comp rx=0 tx=0).stop 2023-10-09T08:18:01.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.499+0000 7fbbcefff700 1 -- 172.21.15.71:0/183100453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbc815a440 msgr2=0x7fbbc80cc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:01.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.499+0000 7fbbcefff700 1 --2- 172.21.15.71:0/183100453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbc815a440 0x7fbbc80cc1b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0016000 tx=0x7fbbc0019000 comp rx=0 tx=0).stop 2023-10-09T08:18:01.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.499+0000 7fbbcd59c700 1 -- 172.21.15.71:0/183100453 reap_dead start 2023-10-09T08:18:01.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.499+0000 7fbbcefff700 1 -- 172.21.15.71:0/183100453 shutdown_connections 2023-10-09T08:18:01.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.499+0000 7fbbcefff700 1 -- 172.21.15.71:0/183100453 >> 172.21.15.71:0/183100453 conn(0x7fbbc80c8f90 msgr2=0x7fbbc8069800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:01.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.500+0000 7fbbcefff700 1 -- 172.21.15.71:0/183100453 shutdown_connections 2023-10-09T08:18:01.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.500+0000 7fbbcefff700 1 -- 172.21.15.71:0/183100453 wait complete. 2023-10-09T08:18:01.517 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-09T08:18:01.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.696+0000 7f35a57ff700 1 Processor -- start 2023-10-09T08:18:01.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.696+0000 7f35a57ff700 1 -- start start 2023-10-09T08:18:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.698+0000 7f35a57ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a01578b0 0x7f35a0155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.698+0000 7f35a57ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a00ad930 con 0x7f35a00af2f0 2023-10-09T08:18:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.698+0000 7f35a57ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a00acd20 con 0x7f35a0155c10 2023-10-09T08:18:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.698+0000 7f35a57ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00ad000 con 0x7f35a01578b0 2023-10-09T08:18:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.698+0000 7f359f7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f35a00af2f0 0x7f35a00af710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43950/0 (socket says 172.21.15.71:43950) 2023-10-09T08:18:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.698+0000 7f359f7fe700 1 -- 172.21.15.71:0/1047749216 learned_addr learned my addr 172.21.15.71:0/1047749216 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:18:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.698+0000 7f3597fff700 1 --2- 172.21.15.71:0/1047749216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a01578b0 0x7f35a0155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:01.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.698+0000 7f359e7fc700 1 -- 172.21.15.71:0/1047749216 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 885111236 0 0) 0x7f35a00ad930 con 0x7f35a00af2f0 2023-10-09T08:18:01.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.698+0000 7f359e7fc700 1 -- 172.21.15.71:0/1047749216 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f358c003570 con 0x7f35a00af2f0 2023-10-09T08:18:01.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.699+0000 7f3597fff700 1 -- 172.21.15.71:0/1047749216 >> v1:172.21.15.179:6789/0 conn(0x7f35a0155c10 legacy=0x7f35a00ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:01.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.699+0000 7f3597fff700 1 -- 172.21.15.71:0/1047749216 >> v1:172.21.15.71:6789/0 conn(0x7f35a00af2f0 legacy=0x7f35a00af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:01.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.699+0000 7f3597fff700 1 -- 172.21.15.71:0/1047749216 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a00ad2e0 con 0x7f35a01578b0 2023-10-09T08:18:01.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.699+0000 7f3597fff700 1 --2- 172.21.15.71:0/1047749216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a01578b0 0x7f35a0155fe0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f358800aac0 tx=0x7f358800a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b59dd0e1c184ced0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.699+0000 7f359e7fc700 1 -- 172.21.15.71:0/1047749216 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358800c970 con 0x7f35a01578b0 2023-10-09T08:18:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.699+0000 7f359e7fc700 1 -- 172.21.15.71:0/1047749216 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358800cad0 con 0x7f35a01578b0 2023-10-09T08:18:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.699+0000 7f359e7fc700 1 -- 172.21.15.71:0/1047749216 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358800ce70 con 0x7f35a01578b0 2023-10-09T08:18:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.700+0000 7f35a57ff700 1 -- 172.21.15.71:0/1047749216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a01578b0 msgr2=0x7f35a0155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.700+0000 7f35a57ff700 1 --2- 172.21.15.71:0/1047749216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a01578b0 0x7f35a0155fe0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f358800aac0 tx=0x7f358800a330 comp rx=0 tx=0).stop 2023-10-09T08:18:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.700+0000 7f35a57ff700 1 -- 172.21.15.71:0/1047749216 shutdown_connections 2023-10-09T08:18:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.700+0000 7f35a57ff700 1 --2- 172.21.15.71:0/1047749216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a01578b0 0x7f35a0155fe0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.700+0000 7f35a57ff700 1 -- 172.21.15.71:0/1047749216 >> 172.21.15.71:0/1047749216 conn(0x7f35a006a320 msgr2=0x7f35a00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.700+0000 7f35a57ff700 1 -- 172.21.15.71:0/1047749216 shutdown_connections 2023-10-09T08:18:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.700+0000 7f35a57ff700 1 -- 172.21.15.71:0/1047749216 wait complete. 2023-10-09T08:18:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.701+0000 7f35a57ff700 1 Processor -- start 2023-10-09T08:18:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.701+0000 7f35a57ff700 1 -- start start 2023-10-09T08:18:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.702+0000 7f35a57ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a00af2f0 0x7f35a0149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.702+0000 7f35a57ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a0155c10 0x7f35a00aa290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.702+0000 7f35a57ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a01578b0 0x7f35a00cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.702+0000 7f35a57ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00ab390 con 0x7f35a0155c10 2023-10-09T08:18:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.702+0000 7f35a57ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00ca510 con 0x7f35a00af2f0 2023-10-09T08:18:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.702+0000 7f35a57ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00c9900 con 0x7f35a01578b0 2023-10-09T08:18:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.703+0000 7f3597fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a0155c10 0x7f35a00aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.703+0000 7f3597fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a0155c10 0x7f35a00aa290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40204/0 (socket says 172.21.15.71:40204) 2023-10-09T08:18:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.703+0000 7f3597fff700 1 -- 172.21.15.71:0/862518627 learned_addr learned my addr 172.21.15.71:0/862518627 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.703+0000 7f359f7fe700 1 --2- 172.21.15.71:0/862518627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a01578b0 0x7f35a00cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.703+0000 7f359effd700 1 --2- 172.21.15.71:0/862518627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a00af2f0 0x7f35a0149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.703+0000 7f3597fff700 1 -- 172.21.15.71:0/862518627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a01578b0 msgr2=0x7f35a00cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.703+0000 7f3597fff700 1 --2- 172.21.15.71:0/862518627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a01578b0 0x7f35a00cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.703+0000 7f3597fff700 1 -- 172.21.15.71:0/862518627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a00af2f0 msgr2=0x7f35a0149f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:01.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.703+0000 7f3597fff700 1 --2- 172.21.15.71:0/862518627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a00af2f0 0x7f35a0149f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:01.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.703+0000 7f3597fff700 1 -- 172.21.15.71:0/862518627 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358800a5d0 con 0x7f35a0155c10 2023-10-09T08:18:01.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.703+0000 7f3597fff700 1 --2- 172.21.15.71:0/862518627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a0155c10 0x7f35a00aa290 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f358800a5a0 tx=0x7f3588019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.704+0000 7f3596ffd700 1 -- 172.21.15.71:0/862518627 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358800fe10 con 0x7f35a0155c10 2023-10-09T08:18:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.704+0000 7f3596ffd700 1 -- 172.21.15.71:0/862518627 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3588017420 con 0x7f35a0155c10 2023-10-09T08:18:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.704+0000 7f35a57ff700 1 -- 172.21.15.71:0/862518627 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a00c9be0 con 0x7f35a0155c10 2023-10-09T08:18:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.704+0000 7f3596ffd700 1 -- 172.21.15.71:0/862518627 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35880177e0 con 0x7f35a0155c10 2023-10-09T08:18:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.704+0000 7f35a57ff700 1 -- 172.21.15.71:0/862518627 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a00ca1a0 con 0x7f35a0155c10 2023-10-09T08:18:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.705+0000 7f35a57ff700 1 -- 172.21.15.71:0/862518627 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a00ca6c0 con 0x7f35a0155c10 2023-10-09T08:18:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.706+0000 7f3596ffd700 1 -- 172.21.15.71:0/862518627 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3588017b50 con 0x7f35a0155c10 2023-10-09T08:18:01.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.706+0000 7f3596ffd700 1 --2- 172.21.15.71:0/862518627 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3580066f30 0x7f35800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:01.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.706+0000 7f3596ffd700 1 -- 172.21.15.71:0/862518627 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f3588013070 con 0x7f35a0155c10 2023-10-09T08:18:01.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.707+0000 7f359effd700 1 --2- 172.21.15.71:0/862518627 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3580066f30 0x7f35800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:01.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.707+0000 7f359effd700 1 --2- 172.21.15.71:0/862518627 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3580066f30 0x7f35800693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f35a006e850 tx=0x7f3590009040 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.710+0000 7f3596ffd700 1 -- 172.21.15.71:0/862518627 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35a00ca6c0 con 0x7f35a0155c10 2023-10-09T08:18:01.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.901+0000 7f35a57ff700 1 -- 172.21.15.71:0/862518627 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f35a00ca680 con 0x7f3580066f30 2023-10-09T08:18:01.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.902+0000 7f3596ffd700 1 -- 172.21.15.71:0/862518627 <== mgr.9898 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f35a00ca680 con 0x7f3580066f30 2023-10-09T08:18:01.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.904+0000 7f35a57ff700 1 -- 172.21.15.71:0/862518627 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3580066f30 msgr2=0x7f35800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:01.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.904+0000 7f35a57ff700 1 --2- 172.21.15.71:0/862518627 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3580066f30 0x7f35800693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f35a006e850 tx=0x7f3590009040 comp rx=0 tx=0).stop 2023-10-09T08:18:01.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.904+0000 7f35a57ff700 1 -- 172.21.15.71:0/862518627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a0155c10 msgr2=0x7f35a00aa290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:01.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.904+0000 7f35a57ff700 1 --2- 172.21.15.71:0/862518627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a0155c10 0x7f35a00aa290 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f358800a5a0 tx=0x7f3588019000 comp rx=0 tx=0).stop 2023-10-09T08:18:01.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.904+0000 7f35a57ff700 1 -- 172.21.15.71:0/862518627 shutdown_connections 2023-10-09T08:18:01.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.904+0000 7f35a57ff700 1 --2- 172.21.15.71:0/862518627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a01578b0 0x7f35a00cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:01.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.904+0000 7f35a57ff700 1 --2- 172.21.15.71:0/862518627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a00af2f0 0x7f35a0149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:01.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.904+0000 7f35a57ff700 1 --2- 172.21.15.71:0/862518627 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3580066f30 0x7f35800693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:01.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.904+0000 7f35a57ff700 1 --2- 172.21.15.71:0/862518627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35a0155c10 0x7f35a00aa290 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:01.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.904+0000 7f35a57ff700 1 -- 172.21.15.71:0/862518627 >> 172.21.15.71:0/862518627 conn(0x7f35a006a320 msgr2=0x7f35a006d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:01.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.904+0000 7f35a57ff700 1 -- 172.21.15.71:0/862518627 shutdown_connections 2023-10-09T08:18:01.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:01.904+0000 7f35a57ff700 1 -- 172.21.15.71:0/862518627 wait complete. 2023-10-09T08:18:01.907 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 0 to deep-scrub 2023-10-09T08:18:01.922 INFO:tasks.ceph:Scrubbing osd.1 2023-10-09T08:18:01.923 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-09T08:18:02.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.107+0000 7f82c01ff700 1 Processor -- start 2023-10-09T08:18:02.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.107+0000 7f82c01ff700 1 -- start start 2023-10-09T08:18:02.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.109+0000 7f82c01ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f82b8157740 0x7f82b80adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.109+0000 7f82c01ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f82b80b2100 0x7f82b8068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.109+0000 7f82c01ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b80688d0 0x7f82b8069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.109+0000 7f82c01ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b80acc00 con 0x7f82b80b2100 2023-10-09T08:18:02.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.109+0000 7f82c01ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b806d6a0 con 0x7f82b8157740 2023-10-09T08:18:02.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.109+0000 7f82c01ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b8068d50 con 0x7f82b80688d0 2023-10-09T08:18:02.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.109+0000 7f82bd79a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f82b80b2100 0x7f82b8068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.109+0000 7f82bd79a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f82b80b2100 0x7f82b8068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40218/0 (socket says 172.21.15.71:40218) 2023-10-09T08:18:02.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.109+0000 7f82bd79a700 1 -- 172.21.15.71:0/1644401255 learned_addr learned my addr 172.21.15.71:0/1644401255 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:02.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.109+0000 7f82be79c700 1 --2- 172.21.15.71:0/1644401255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b80688d0 0x7f82b8069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.109+0000 7f82bdf9b700 1 --2- 172.21.15.71:0/1644401255 >> v2:172.21.15.179:3300/0 conn(0x7f82b8157740 0x7f82b80adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.109+0000 7f82bd79a700 1 -- 172.21.15.71:0/1644401255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b80688d0 msgr2=0x7f82b8069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:02.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.109+0000 7f82bd79a700 1 --2- 172.21.15.71:0/1644401255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b80688d0 0x7f82b8069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.109+0000 7f82bd79a700 1 -- 172.21.15.71:0/1644401255 >> v2:172.21.15.179:3300/0 conn(0x7f82b8157740 msgr2=0x7f82b80adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:02.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.109+0000 7f82bd79a700 1 --2- 172.21.15.71:0/1644401255 >> v2:172.21.15.179:3300/0 conn(0x7f82b8157740 0x7f82b80adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.109+0000 7f82bd79a700 1 -- 172.21.15.71:0/1644401255 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b806dc20 con 0x7f82b80b2100 2023-10-09T08:18:02.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.110+0000 7f82bdf9b700 1 --2- 172.21.15.71:0/1644401255 >> v2:172.21.15.179:3300/0 conn(0x7f82b8157740 0x7f82b80adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:18:02.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.110+0000 7f82bd79a700 1 --2- 172.21.15.71:0/1644401255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82b80b2100 0x7f82b8068390 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f82b80abfa0 tx=0x7f82a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1302660db8eaff33 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:02.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.110+0000 7f82bcf99700 1 -- 172.21.15.71:0/1644401255 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8009e70 con 0x7f82b80b2100 2023-10-09T08:18:02.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.110+0000 7f82bcf99700 1 -- 172.21.15.71:0/1644401255 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a800b860 con 0x7f82b80b2100 2023-10-09T08:18:02.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.110+0000 7f82bcf99700 1 -- 172.21.15.71:0/1644401255 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a800bc00 con 0x7f82b80b2100 2023-10-09T08:18:02.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.111+0000 7f82c01ff700 1 -- 172.21.15.71:0/1644401255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82b80b2100 msgr2=0x7f82b8068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.111+0000 7f82c01ff700 1 --2- 172.21.15.71:0/1644401255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82b80b2100 0x7f82b8068390 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f82b80abfa0 tx=0x7f82a8009250 comp rx=0 tx=0).stop 2023-10-09T08:18:02.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.111+0000 7f82c01ff700 1 -- 172.21.15.71:0/1644401255 shutdown_connections 2023-10-09T08:18:02.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.111+0000 7f82c01ff700 1 --2- 172.21.15.71:0/1644401255 >> v2:172.21.15.179:3300/0 conn(0x7f82b8157740 0x7f82b80adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.111+0000 7f82c01ff700 1 --2- 172.21.15.71:0/1644401255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b80688d0 0x7f82b8069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.111+0000 7f82c01ff700 1 --2- 172.21.15.71:0/1644401255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82b80b2100 0x7f82b8068390 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.111+0000 7f82c01ff700 1 -- 172.21.15.71:0/1644401255 >> 172.21.15.71:0/1644401255 conn(0x7f82b80c8f90 msgr2=0x7f82b80c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:02.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.111+0000 7f82c01ff700 1 -- 172.21.15.71:0/1644401255 shutdown_connections 2023-10-09T08:18:02.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.111+0000 7f82c01ff700 1 -- 172.21.15.71:0/1644401255 wait complete. 2023-10-09T08:18:02.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.112+0000 7f82c01ff700 1 Processor -- start 2023-10-09T08:18:02.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.112+0000 7f82c01ff700 1 -- start start 2023-10-09T08:18:02.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.113+0000 7f82c01ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82b80688d0 0x7f82b81544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.113+0000 7f82c01ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82b80b2100 0x7f82b8168040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.113+0000 7f82c01ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b8157740 0x7f82b80c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.113+0000 7f82c01ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b8167610 con 0x7f82b80688d0 2023-10-09T08:18:02.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.113+0000 7f82c01ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b8167860 con 0x7f82b80b2100 2023-10-09T08:18:02.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.113+0000 7f82c01ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b815b290 con 0x7f82b8157740 2023-10-09T08:18:02.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.114+0000 7f82bd79a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82b80b2100 0x7f82b8168040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.114+0000 7f82bdf9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82b80688d0 0x7f82b81544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.114+0000 7f82bd79a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82b80b2100 0x7f82b8168040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:55566/0 (socket says 172.21.15.71:55566) 2023-10-09T08:18:02.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.114+0000 7f82bd79a700 1 -- 172.21.15.71:0/3416606437 learned_addr learned my addr 172.21.15.71:0/3416606437 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:02.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.114+0000 7f82be79c700 1 --2- 172.21.15.71:0/3416606437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b8157740 0x7f82b80c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.114+0000 7f82bdf9b700 1 -- 172.21.15.71:0/3416606437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b8157740 msgr2=0x7f82b80c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.114+0000 7f82bdf9b700 1 --2- 172.21.15.71:0/3416606437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b8157740 0x7f82b80c60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.114+0000 7f82bdf9b700 1 -- 172.21.15.71:0/3416606437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82b80b2100 msgr2=0x7f82b8168040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.114+0000 7f82bdf9b700 1 --2- 172.21.15.71:0/3416606437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82b80b2100 0x7f82b8168040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.114+0000 7f82bdf9b700 1 -- 172.21.15.71:0/3416606437 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a80094f0 con 0x7f82b80688d0 2023-10-09T08:18:02.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.114+0000 7f82bdf9b700 1 --2- 172.21.15.71:0/3416606437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82b80688d0 0x7f82b81544f0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f82b4006fd0 tx=0x7f82b4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:02.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.115+0000 7f82adffb700 1 -- 172.21.15.71:0/3416606437 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b4014070 con 0x7f82b80688d0 2023-10-09T08:18:02.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.115+0000 7f82adffb700 1 -- 172.21.15.71:0/3416606437 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b40095b0 con 0x7f82b80688d0 2023-10-09T08:18:02.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.115+0000 7f82adffb700 1 -- 172.21.15.71:0/3416606437 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b4009970 con 0x7f82b80688d0 2023-10-09T08:18:02.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.115+0000 7f82c01ff700 1 -- 172.21.15.71:0/3416606437 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b815b570 con 0x7f82b80688d0 2023-10-09T08:18:02.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.115+0000 7f82c01ff700 1 -- 172.21.15.71:0/3416606437 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b8168580 con 0x7f82b80688d0 2023-10-09T08:18:02.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.116+0000 7f82c01ff700 1 -- 172.21.15.71:0/3416606437 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f82b80718b0 con 0x7f82b80688d0 2023-10-09T08:18:02.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.117+0000 7f82adffb700 1 -- 172.21.15.71:0/3416606437 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82b4018070 con 0x7f82b80688d0 2023-10-09T08:18:02.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.118+0000 7f82adffb700 1 --2- 172.21.15.71:0/3416606437 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f829c066f30 0x7f829c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.118+0000 7f82adffb700 1 -- 172.21.15.71:0/3416606437 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f82b4087c90 con 0x7f82b80688d0 2023-10-09T08:18:02.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.118+0000 7f82adffb700 1 --2- 172.21.15.71:0/3416606437 >> [v2:172.21.15.71:6816/85792,v1:172.21.15.71:6817/85792] conn(0x7f829c06d6d0 0x7f829c06fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.118+0000 7f82adffb700 1 -- 172.21.15.71:0/3416606437 --> [v2:172.21.15.71:6816/85792,v1:172.21.15.71:6817/85792] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f829c070170 con 0x7f829c06d6d0 2023-10-09T08:18:02.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.118+0000 7f82adffb700 1 -- 172.21.15.71:0/3416606437 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=215) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82b408a270 con 0x7f82b80688d0 2023-10-09T08:18:02.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.118+0000 7f82bd79a700 1 --2- 172.21.15.71:0/3416606437 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f829c066f30 0x7f829c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.118+0000 7f82be79c700 1 --2- 172.21.15.71:0/3416606437 >> [v2:172.21.15.71:6816/85792,v1:172.21.15.71:6817/85792] conn(0x7f829c06d6d0 0x7f829c06fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.119+0000 7f82be79c700 1 --2- 172.21.15.71:0/3416606437 >> [v2:172.21.15.71:6816/85792,v1:172.21.15.71:6817/85792] conn(0x7f829c06d6d0 0x7f829c06fb40 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:02.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.119+0000 7f82bd79a700 1 --2- 172.21.15.71:0/3416606437 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f829c066f30 0x7f829c0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f82b815afb0 tx=0x7f82a8017000 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:02.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.119+0000 7f82adffb700 1 -- 172.21.15.71:0/3416606437 <== osd.1 v2:172.21.15.71:6816/85792 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f829c070170 con 0x7f829c06d6d0 2023-10-09T08:18:02.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.133+0000 7f82c01ff700 1 -- 172.21.15.71:0/3416606437 --> [v2:172.21.15.71:6816/85792,v1:172.21.15.71:6817/85792] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f82b80ae910 con 0x7f829c06d6d0 2023-10-09T08:18:02.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.134+0000 7f82adffb700 1 -- 172.21.15.71:0/3416606437 <== osd.1 v2:172.21.15.71:6816/85792 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f82b80ae910 con 0x7f829c06d6d0 2023-10-09T08:18:02.135 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T08:18:02.135 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T08:18:02.135 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T08:18:02.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.134+0000 7f82c01ff700 1 -- 172.21.15.71:0/3416606437 >> [v2:172.21.15.71:6816/85792,v1:172.21.15.71:6817/85792] conn(0x7f829c06d6d0 msgr2=0x7f829c06fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.134+0000 7f82c01ff700 1 --2- 172.21.15.71:0/3416606437 >> [v2:172.21.15.71:6816/85792,v1:172.21.15.71:6817/85792] conn(0x7f829c06d6d0 0x7f829c06fb40 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.134+0000 7f82c01ff700 1 -- 172.21.15.71:0/3416606437 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f829c066f30 msgr2=0x7f829c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.134+0000 7f82c01ff700 1 --2- 172.21.15.71:0/3416606437 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f829c066f30 0x7f829c0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f82b815afb0 tx=0x7f82a8017000 comp rx=0 tx=0).stop 2023-10-09T08:18:02.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.134+0000 7f82c01ff700 1 -- 172.21.15.71:0/3416606437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82b80688d0 msgr2=0x7f82b81544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.134+0000 7f82c01ff700 1 --2- 172.21.15.71:0/3416606437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82b80688d0 0x7f82b81544f0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f82b4006fd0 tx=0x7f82b4008040 comp rx=0 tx=0).stop 2023-10-09T08:18:02.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.134+0000 7f82be79c700 1 -- 172.21.15.71:0/3416606437 reap_dead start 2023-10-09T08:18:02.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.134+0000 7f82c01ff700 1 -- 172.21.15.71:0/3416606437 shutdown_connections 2023-10-09T08:18:02.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.134+0000 7f82c01ff700 1 -- 172.21.15.71:0/3416606437 >> 172.21.15.71:0/3416606437 conn(0x7f82b80c8f90 msgr2=0x7f82b8156880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:02.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.134+0000 7f82c01ff700 1 -- 172.21.15.71:0/3416606437 shutdown_connections 2023-10-09T08:18:02.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.134+0000 7f82c01ff700 1 -- 172.21.15.71:0/3416606437 wait complete. 2023-10-09T08:18:02.151 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-09T08:18:02.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.333+0000 7f10871ff700 1 Processor -- start 2023-10-09T08:18:02.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.333+0000 7f10871ff700 1 -- start start 2023-10-09T08:18:02.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.334+0000 7f10871ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f10801578b0 0x7f1080155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.334+0000 7f10871ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f10800af2f0 0x7f10800af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.334+0000 7f10871ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10800ad930 con 0x7f1080155c10 2023-10-09T08:18:02.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.334+0000 7f10871ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10800b0c80 con 0x7f10801578b0 2023-10-09T08:18:02.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.335+0000 7f10871ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10800acd20 con 0x7f10800af2f0 2023-10-09T08:18:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.335+0000 7f107ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f10801578b0 0x7f1080155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.335+0000 7f107ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f10801578b0 0x7f1080155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40226/0 (socket says 172.21.15.71:40226) 2023-10-09T08:18:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.335+0000 7f107ffff700 1 -- 172.21.15.71:0/1537685071 learned_addr learned my addr 172.21.15.71:0/1537685071 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.335+0000 7f108579c700 1 --2- 172.21.15.71:0/1537685071 >> v2:172.21.15.179:3300/0 conn(0x7f10800af2f0 0x7f10800af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.335+0000 7f107ffff700 1 -- 172.21.15.71:0/1537685071 >> v2:172.21.15.179:3300/0 conn(0x7f10800af2f0 msgr2=0x7f10800af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.335+0000 7f107ffff700 1 --2- 172.21.15.71:0/1537685071 >> v2:172.21.15.179:3300/0 conn(0x7f10800af2f0 0x7f10800af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.335+0000 7f107ffff700 1 -- 172.21.15.71:0/1537685071 >> v1:172.21.15.179:6789/0 conn(0x7f1080155c10 legacy=0x7f10800ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.335+0000 7f107ffff700 1 -- 172.21.15.71:0/1537685071 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10800ad000 con 0x7f10801578b0 2023-10-09T08:18:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.336+0000 7f107ffff700 1 --2- 172.21.15.71:0/1537685071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10801578b0 0x7f1080155fe0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f1080065be0 tx=0x7f106c00a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2342b1c852416347 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:02.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.336+0000 7f107f7fe700 1 -- 172.21.15.71:0/1537685071 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c00ca40 con 0x7f10801578b0 2023-10-09T08:18:02.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.336+0000 7f107f7fe700 1 -- 172.21.15.71:0/1537685071 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106c00cba0 con 0x7f10801578b0 2023-10-09T08:18:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.336+0000 7f107f7fe700 1 -- 172.21.15.71:0/1537685071 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c018400 con 0x7f10801578b0 2023-10-09T08:18:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.336+0000 7f10871ff700 1 -- 172.21.15.71:0/1537685071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10801578b0 msgr2=0x7f1080155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.336+0000 7f10871ff700 1 --2- 172.21.15.71:0/1537685071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10801578b0 0x7f1080155fe0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f1080065be0 tx=0x7f106c00a3f0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.336+0000 7f10871ff700 1 -- 172.21.15.71:0/1537685071 shutdown_connections 2023-10-09T08:18:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.336+0000 7f10871ff700 1 --2- 172.21.15.71:0/1537685071 >> v2:172.21.15.179:3300/0 conn(0x7f10800af2f0 0x7f10800af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.336+0000 7f10871ff700 1 --2- 172.21.15.71:0/1537685071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10801578b0 0x7f1080155fe0 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.336+0000 7f10871ff700 1 -- 172.21.15.71:0/1537685071 >> 172.21.15.71:0/1537685071 conn(0x7f108006a320 msgr2=0x7f10800cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.336+0000 7f10871ff700 1 -- 172.21.15.71:0/1537685071 shutdown_connections 2023-10-09T08:18:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.337+0000 7f10871ff700 1 -- 172.21.15.71:0/1537685071 wait complete. 2023-10-09T08:18:02.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.338+0000 7f10871ff700 1 Processor -- start 2023-10-09T08:18:02.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.338+0000 7f10871ff700 1 -- start start 2023-10-09T08:18:02.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.339+0000 7f10871ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10800af2f0 0x7f1080157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.339+0000 7f10871ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1080155c10 0x7f108015e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.339+0000 7f10871ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10801578b0 0x7f108014e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.339+0000 7f10871ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108015aed0 con 0x7f1080155c10 2023-10-09T08:18:02.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.339+0000 7f10871ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108015a2c0 con 0x7f10800af2f0 2023-10-09T08:18:02.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.339+0000 7f10871ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108015a5a0 con 0x7f10801578b0 2023-10-09T08:18:02.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.339+0000 7f107ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1080155c10 0x7f108015e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.339+0000 7f107ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1080155c10 0x7f108015e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40240/0 (socket says 172.21.15.71:40240) 2023-10-09T08:18:02.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.339+0000 7f107ffff700 1 -- 172.21.15.71:0/4047175531 learned_addr learned my addr 172.21.15.71:0/4047175531 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:02.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.339+0000 7f1084f9b700 1 --2- 172.21.15.71:0/4047175531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10800af2f0 0x7f1080157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.339+0000 7f108579c700 1 --2- 172.21.15.71:0/4047175531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10801578b0 0x7f108014e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.340+0000 7f107ffff700 1 -- 172.21.15.71:0/4047175531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10801578b0 msgr2=0x7f108014e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.340+0000 7f107ffff700 1 --2- 172.21.15.71:0/4047175531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10801578b0 0x7f108014e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.340+0000 7f107ffff700 1 -- 172.21.15.71:0/4047175531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10800af2f0 msgr2=0x7f1080157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.340+0000 7f107ffff700 1 --2- 172.21.15.71:0/4047175531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10800af2f0 0x7f1080157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.340+0000 7f107ffff700 1 -- 172.21.15.71:0/4047175531 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c00a690 con 0x7f1080155c10 2023-10-09T08:18:02.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.340+0000 7f107ffff700 1 --2- 172.21.15.71:0/4047175531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1080155c10 0x7f108015e7e0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f1080064290 tx=0x7f106c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:02.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.340+0000 7f107cff9700 1 -- 172.21.15.71:0/4047175531 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c00ce60 con 0x7f1080155c10 2023-10-09T08:18:02.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.340+0000 7f107cff9700 1 -- 172.21.15.71:0/4047175531 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106c010600 con 0x7f1080155c10 2023-10-09T08:18:02.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.340+0000 7f10871ff700 1 -- 172.21.15.71:0/4047175531 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108015a880 con 0x7f1080155c10 2023-10-09T08:18:02.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.340+0000 7f107cff9700 1 -- 172.21.15.71:0/4047175531 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c0109c0 con 0x7f1080155c10 2023-10-09T08:18:02.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.340+0000 7f10871ff700 1 -- 172.21.15.71:0/4047175531 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1080158500 con 0x7f1080155c10 2023-10-09T08:18:02.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.341+0000 7f10871ff700 1 -- 172.21.15.71:0/4047175531 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f108015b040 con 0x7f1080155c10 2023-10-09T08:18:02.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.342+0000 7f107cff9700 1 -- 172.21.15.71:0/4047175531 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f106c02a3b0 con 0x7f1080155c10 2023-10-09T08:18:02.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.343+0000 7f107cff9700 1 --2- 172.21.15.71:0/4047175531 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1064066f30 0x7f10640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.343+0000 7f107cff9700 1 -- 172.21.15.71:0/4047175531 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f106c085c20 con 0x7f1080155c10 2023-10-09T08:18:02.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.343+0000 7f1084f9b700 1 --2- 172.21.15.71:0/4047175531 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1064066f30 0x7f10640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.344+0000 7f1084f9b700 1 --2- 172.21.15.71:0/4047175531 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1064066f30 0x7f10640693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1074003a80 tx=0x7f1074007ec0 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:02.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.347+0000 7f107cff9700 1 -- 172.21.15.71:0/4047175531 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f106c052cb0 con 0x7f1080155c10 2023-10-09T08:18:02.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.537+0000 7f10871ff700 1 -- 172.21.15.71:0/4047175531 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f108004c3c0 con 0x7f1064066f30 2023-10-09T08:18:02.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.537+0000 7f107cff9700 1 -- 172.21.15.71:0/4047175531 <== mgr.9898 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f108004c3c0 con 0x7f1064066f30 2023-10-09T08:18:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.540+0000 7f10871ff700 1 -- 172.21.15.71:0/4047175531 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1064066f30 msgr2=0x7f10640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.540+0000 7f10871ff700 1 --2- 172.21.15.71:0/4047175531 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1064066f30 0x7f10640693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1074003a80 tx=0x7f1074007ec0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.540+0000 7f10871ff700 1 -- 172.21.15.71:0/4047175531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1080155c10 msgr2=0x7f108015e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.540+0000 7f10871ff700 1 --2- 172.21.15.71:0/4047175531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1080155c10 0x7f108015e7e0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f1080064290 tx=0x7f106c01a000 comp rx=0 tx=0).stop 2023-10-09T08:18:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.540+0000 7f10871ff700 1 -- 172.21.15.71:0/4047175531 shutdown_connections 2023-10-09T08:18:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.540+0000 7f10871ff700 1 --2- 172.21.15.71:0/4047175531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10801578b0 0x7f108014e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.540+0000 7f10871ff700 1 --2- 172.21.15.71:0/4047175531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10800af2f0 0x7f1080157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.540+0000 7f10871ff700 1 --2- 172.21.15.71:0/4047175531 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f1064066f30 0x7f10640693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.540+0000 7f10871ff700 1 --2- 172.21.15.71:0/4047175531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1080155c10 0x7f108015e7e0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.540+0000 7f10871ff700 1 -- 172.21.15.71:0/4047175531 >> 172.21.15.71:0/4047175531 conn(0x7f108006a320 msgr2=0x7f10800ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.540+0000 7f10871ff700 1 -- 172.21.15.71:0/4047175531 shutdown_connections 2023-10-09T08:18:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.540+0000 7f10871ff700 1 -- 172.21.15.71:0/4047175531 wait complete. 2023-10-09T08:18:02.543 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 1 to deep-scrub 2023-10-09T08:18:02.558 INFO:tasks.ceph:Scrubbing osd.2 2023-10-09T08:18:02.558 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-09T08:18:02.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.742+0000 7f303b3ff700 1 Processor -- start 2023-10-09T08:18:02.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.742+0000 7f303b3ff700 1 -- start start 2023-10-09T08:18:02.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.743+0000 7f303b3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f30340c8490 0x7f30340c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.743+0000 7f303b3ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3034069e20 0x7f30341569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.743+0000 7f303b3ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30340ac030 con 0x7f3034069a50 2023-10-09T08:18:02.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.743+0000 7f303b3ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30340ab820 con 0x7f3034069e20 2023-10-09T08:18:02.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.743+0000 7f303b3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303406dbb0 con 0x7f30340c8490 2023-10-09T08:18:02.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.744+0000 7f303919b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3034069a50 0x7f303415a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43964/0 (socket says 172.21.15.71:43964) 2023-10-09T08:18:02.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.744+0000 7f303919b700 1 -- 172.21.15.71:0/2532189582 learned_addr learned my addr 172.21.15.71:0/2532189582 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:18:02.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.744+0000 7f303999c700 1 --2- 172.21.15.71:0/2532189582 >> v2:172.21.15.71:3300/0 conn(0x7f3034069e20 0x7f30341569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.744+0000 7f302bfff700 1 -- 172.21.15.71:0/2532189582 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4236757245 0 0) 0x7f3030001110 con 0x7f3034069a50 2023-10-09T08:18:02.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.744+0000 7f302bfff700 1 -- 172.21.15.71:0/2532189582 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3020003570 con 0x7f3034069a50 2023-10-09T08:18:02.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.744+0000 7f303999c700 1 -- 172.21.15.71:0/2532189582 >> v2:172.21.15.179:3300/0 conn(0x7f30340c8490 msgr2=0x7f30340c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:02.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.744+0000 7f303999c700 1 --2- 172.21.15.71:0/2532189582 >> v2:172.21.15.179:3300/0 conn(0x7f30340c8490 0x7f30340c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.744+0000 7f303999c700 1 -- 172.21.15.71:0/2532189582 >> v1:172.21.15.71:6789/0 conn(0x7f3034069a50 legacy=0x7f303415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.744+0000 7f303999c700 1 -- 172.21.15.71:0/2532189582 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30340aba70 con 0x7f3034069e20 2023-10-09T08:18:02.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.744+0000 7f303999c700 1 --2- 172.21.15.71:0/2532189582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3034069e20 0x7f30341569b0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f303406b920 tx=0x7f302c00a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb2f88f14eec021 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:02.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.745+0000 7f302bfff700 1 -- 172.21.15.71:0/2532189582 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c00f070 con 0x7f3034069e20 2023-10-09T08:18:02.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.745+0000 7f302bfff700 1 -- 172.21.15.71:0/2532189582 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c00a2e0 con 0x7f3034069e20 2023-10-09T08:18:02.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.745+0000 7f302bfff700 1 -- 172.21.15.71:0/2532189582 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c00cc70 con 0x7f3034069e20 2023-10-09T08:18:02.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.745+0000 7f303b3ff700 1 -- 172.21.15.71:0/2532189582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3034069e20 msgr2=0x7f30341569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.745+0000 7f303b3ff700 1 --2- 172.21.15.71:0/2532189582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3034069e20 0x7f30341569b0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f303406b920 tx=0x7f302c00a890 comp rx=0 tx=0).stop 2023-10-09T08:18:02.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.745+0000 7f303b3ff700 1 -- 172.21.15.71:0/2532189582 shutdown_connections 2023-10-09T08:18:02.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.745+0000 7f303b3ff700 1 --2- 172.21.15.71:0/2532189582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3034069e20 0x7f30341569b0 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.745+0000 7f303b3ff700 1 --2- 172.21.15.71:0/2532189582 >> v2:172.21.15.179:3300/0 conn(0x7f30340c8490 0x7f30340c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.745+0000 7f303b3ff700 1 -- 172.21.15.71:0/2532189582 >> 172.21.15.71:0/2532189582 conn(0x7f30340c8f90 msgr2=0x7f30340c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:02.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.745+0000 7f303b3ff700 1 -- 172.21.15.71:0/2532189582 shutdown_connections 2023-10-09T08:18:02.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.745+0000 7f303b3ff700 1 -- 172.21.15.71:0/2532189582 wait complete. 2023-10-09T08:18:02.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.747+0000 7f303b3ff700 1 Processor -- start 2023-10-09T08:18:02.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.747+0000 7f303b3ff700 1 -- start start 2023-10-09T08:18:02.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.748+0000 7f303b3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3034069a50 0x7f30340c3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.748+0000 7f303b3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3034069e20 0x7f30340c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.748+0000 7f303b3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30340c8490 0x7f30340c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.748+0000 7f303b3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30340c69f0 con 0x7f30340c8490 2023-10-09T08:18:02.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.748+0000 7f303b3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30340b1f00 con 0x7f3034069e20 2023-10-09T08:18:02.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.748+0000 7f303b3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30340c6150 con 0x7f3034069a50 2023-10-09T08:18:02.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.748+0000 7f303999c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30340c8490 0x7f30340c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.748+0000 7f303999c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30340c8490 0x7f30340c5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40244/0 (socket says 172.21.15.71:40244) 2023-10-09T08:18:02.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.748+0000 7f303999c700 1 -- 172.21.15.71:0/3076022463 learned_addr learned my addr 172.21.15.71:0/3076022463 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:02.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.748+0000 7f303899a700 1 --2- 172.21.15.71:0/3076022463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3034069e20 0x7f30340c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.748+0000 7f303919b700 1 --2- 172.21.15.71:0/3076022463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3034069a50 0x7f30340c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.749+0000 7f303999c700 1 -- 172.21.15.71:0/3076022463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3034069a50 msgr2=0x7f30340c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.749+0000 7f303999c700 1 --2- 172.21.15.71:0/3076022463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3034069a50 0x7f30340c3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.749+0000 7f303999c700 1 -- 172.21.15.71:0/3076022463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3034069e20 msgr2=0x7f30340c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.749+0000 7f303999c700 1 --2- 172.21.15.71:0/3076022463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3034069e20 0x7f30340c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.749+0000 7f303999c700 1 -- 172.21.15.71:0/3076022463 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302c00ab30 con 0x7f30340c8490 2023-10-09T08:18:02.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.749+0000 7f303999c700 1 --2- 172.21.15.71:0/3076022463 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30340c8490 0x7f30340c5500 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f302c00ab00 tx=0x7f302c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:02.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.749+0000 7f30297fa700 1 -- 172.21.15.71:0/3076022463 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c009a00 con 0x7f30340c8490 2023-10-09T08:18:02.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.749+0000 7f30297fa700 1 -- 172.21.15.71:0/3076022463 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c009b80 con 0x7f30340c8490 2023-10-09T08:18:02.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.749+0000 7f30297fa700 1 -- 172.21.15.71:0/3076022463 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c027410 con 0x7f30340c8490 2023-10-09T08:18:02.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.749+0000 7f303b3ff700 1 -- 172.21.15.71:0/3076022463 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30340c6430 con 0x7f30340c8490 2023-10-09T08:18:02.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.749+0000 7f303b3ff700 1 -- 172.21.15.71:0/3076022463 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30340a9a80 con 0x7f30340c8490 2023-10-09T08:18:02.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.750+0000 7f303b3ff700 1 -- 172.21.15.71:0/3076022463 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f30340a98e0 con 0x7f30340c8490 2023-10-09T08:18:02.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.751+0000 7f30297fa700 1 -- 172.21.15.71:0/3076022463 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f302c01d410 con 0x7f30340c8490 2023-10-09T08:18:02.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.752+0000 7f30297fa700 1 --2- 172.21.15.71:0/3076022463 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3018066f30 0x7f30180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.752+0000 7f30297fa700 1 -- 172.21.15.71:0/3076022463 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f302c086370 con 0x7f30340c8490 2023-10-09T08:18:02.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.752+0000 7f30297fa700 1 --2- 172.21.15.71:0/3076022463 >> [v2:172.21.15.71:6808/85789,v1:172.21.15.71:6809/85789] conn(0x7f301806d6d0 0x7f301806fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.752+0000 7f30297fa700 1 -- 172.21.15.71:0/3076022463 --> [v2:172.21.15.71:6808/85789,v1:172.21.15.71:6809/85789] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3018070170 con 0x7f301806d6d0 2023-10-09T08:18:02.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.752+0000 7f30297fa700 1 -- 172.21.15.71:0/3076022463 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=215) v2 ==== 24+0+0 (secure 0 0 0) 0x7f302c088870 con 0x7f30340c8490 2023-10-09T08:18:02.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.752+0000 7f303919b700 1 --2- 172.21.15.71:0/3076022463 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3018066f30 0x7f30180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.752+0000 7f303899a700 1 --2- 172.21.15.71:0/3076022463 >> [v2:172.21.15.71:6808/85789,v1:172.21.15.71:6809/85789] conn(0x7f301806d6d0 0x7f301806fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.753+0000 7f303899a700 1 --2- 172.21.15.71:0/3076022463 >> [v2:172.21.15.71:6808/85789,v1:172.21.15.71:6809/85789] conn(0x7f301806d6d0 0x7f301806fb40 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:02.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.753+0000 7f303919b700 1 --2- 172.21.15.71:0/3076022463 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3018066f30 0x7f30180693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3030007fd0 tx=0x7f3030007bf0 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:02.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.754+0000 7f30297fa700 1 -- 172.21.15.71:0/3076022463 <== osd.2 v2:172.21.15.71:6808/85789 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f3018070170 con 0x7f301806d6d0 2023-10-09T08:18:02.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.768+0000 7f303b3ff700 1 -- 172.21.15.71:0/3076022463 --> [v2:172.21.15.71:6808/85789,v1:172.21.15.71:6809/85789] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f30340718b0 con 0x7f301806d6d0 2023-10-09T08:18:02.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.768+0000 7f30297fa700 1 -- 172.21.15.71:0/3076022463 <== osd.2 v2:172.21.15.71:6808/85789 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f30340718b0 con 0x7f301806d6d0 2023-10-09T08:18:02.770 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T08:18:02.770 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T08:18:02.770 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T08:18:02.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.768+0000 7f303b3ff700 1 -- 172.21.15.71:0/3076022463 >> [v2:172.21.15.71:6808/85789,v1:172.21.15.71:6809/85789] conn(0x7f301806d6d0 msgr2=0x7f301806fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.768+0000 7f303b3ff700 1 --2- 172.21.15.71:0/3076022463 >> [v2:172.21.15.71:6808/85789,v1:172.21.15.71:6809/85789] conn(0x7f301806d6d0 0x7f301806fb40 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.769+0000 7f303b3ff700 1 -- 172.21.15.71:0/3076022463 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3018066f30 msgr2=0x7f30180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.769+0000 7f303b3ff700 1 --2- 172.21.15.71:0/3076022463 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f3018066f30 0x7f30180693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3030007fd0 tx=0x7f3030007bf0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.769+0000 7f303b3ff700 1 -- 172.21.15.71:0/3076022463 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30340c8490 msgr2=0x7f30340c5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.769+0000 7f303b3ff700 1 --2- 172.21.15.71:0/3076022463 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30340c8490 0x7f30340c5500 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f302c00ab00 tx=0x7f302c019000 comp rx=0 tx=0).stop 2023-10-09T08:18:02.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.769+0000 7f303999c700 1 -- 172.21.15.71:0/3076022463 reap_dead start 2023-10-09T08:18:02.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.769+0000 7f303b3ff700 1 -- 172.21.15.71:0/3076022463 shutdown_connections 2023-10-09T08:18:02.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.769+0000 7f303b3ff700 1 -- 172.21.15.71:0/3076022463 >> 172.21.15.71:0/3076022463 conn(0x7f30340c8f90 msgr2=0x7f3034156ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:02.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.769+0000 7f303b3ff700 1 -- 172.21.15.71:0/3076022463 shutdown_connections 2023-10-09T08:18:02.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.769+0000 7f303b3ff700 1 -- 172.21.15.71:0/3076022463 wait complete. 2023-10-09T08:18:02.786 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-09T08:18:02.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.966+0000 7fbbed79d700 1 Processor -- start 2023-10-09T08:18:02.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.966+0000 7fbbed79d700 1 -- start start 2023-10-09T08:18:02.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.967+0000 7fbbed79d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbbe8159420 0x7fbbe80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.967+0000 7fbbed79d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe80b2980 con 0x7fbbe81597f0 2023-10-09T08:18:02.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.967+0000 7fbbed79d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe80b11d0 con 0x7fbbe815d230 2023-10-09T08:18:02.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.967+0000 7fbbed79d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe80b14b0 con 0x7fbbe8159420 2023-10-09T08:18:02.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.968+0000 7fbbe77fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fbbe81597f0 0x7fbbe80b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43978/0 (socket says 172.21.15.71:43978) 2023-10-09T08:18:02.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.968+0000 7fbbe77fe700 1 -- 172.21.15.71:0/3054235874 learned_addr learned my addr 172.21.15.71:0/3054235874 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:18:02.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.968+0000 7fbbe7fff700 1 --2- 172.21.15.71:0/3054235874 >> v2:172.21.15.71:3300/0 conn(0x7fbbe8159420 0x7fbbe80b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.968+0000 7fbbe7fff700 1 -- 172.21.15.71:0/3054235874 >> v1:172.21.15.179:6789/0 conn(0x7fbbe815d230 legacy=0x7fbbe815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.968+0000 7fbbe7fff700 1 -- 172.21.15.71:0/3054235874 >> v1:172.21.15.71:6789/0 conn(0x7fbbe81597f0 legacy=0x7fbbe80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.968+0000 7fbbe6ffd700 1 -- 172.21.15.71:0/3054235874 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696726290 0 0) 0x7fbbe80b2980 con 0x7fbbe81597f0 2023-10-09T08:18:02.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.968+0000 7fbbe7fff700 1 -- 172.21.15.71:0/3054235874 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe80b1790 con 0x7fbbe8159420 2023-10-09T08:18:02.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.968+0000 7fbbe7fff700 1 --2- 172.21.15.71:0/3054235874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbe8159420 0x7fbbe80b5f40 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80098e0 tx=0x7fbbd80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33119d0cc69dc5a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:02.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.968+0000 7fbbe6ffd700 1 -- 172.21.15.71:0/3054235874 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8009e80 con 0x7fbbe8159420 2023-10-09T08:18:02.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.969+0000 7fbbe6ffd700 1 -- 172.21.15.71:0/3054235874 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd800b860 con 0x7fbbe8159420 2023-10-09T08:18:02.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.969+0000 7fbbe6ffd700 1 -- 172.21.15.71:0/3054235874 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd800bbe0 con 0x7fbbe8159420 2023-10-09T08:18:02.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.969+0000 7fbbed79d700 1 -- 172.21.15.71:0/3054235874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbe8159420 msgr2=0x7fbbe80b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.969+0000 7fbbed79d700 1 --2- 172.21.15.71:0/3054235874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbe8159420 0x7fbbe80b5f40 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80098e0 tx=0x7fbbd80091a0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.969+0000 7fbbed79d700 1 -- 172.21.15.71:0/3054235874 shutdown_connections 2023-10-09T08:18:02.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.969+0000 7fbbed79d700 1 --2- 172.21.15.71:0/3054235874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbe8159420 0x7fbbe80b5f40 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.969+0000 7fbbed79d700 1 -- 172.21.15.71:0/3054235874 >> 172.21.15.71:0/3054235874 conn(0x7fbbe80d0660 msgr2=0x7fbbe80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:02.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.969+0000 7fbbed79d700 1 -- 172.21.15.71:0/3054235874 shutdown_connections 2023-10-09T08:18:02.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.969+0000 7fbbed79d700 1 -- 172.21.15.71:0/3054235874 wait complete. 2023-10-09T08:18:02.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.971+0000 7fbbed79d700 1 Processor -- start 2023-10-09T08:18:02.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.971+0000 7fbbed79d700 1 -- start start 2023-10-09T08:18:02.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.971+0000 7fbbed79d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbe8159420 0x7fbbe8155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.971+0000 7fbbed79d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbe81597f0 0x7fbbe815b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.972+0000 7fbbed79d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbe815d230 0x7fbbe8156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.972+0000 7fbbed79d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe815c750 con 0x7fbbe8159420 2023-10-09T08:18:02.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.972+0000 7fbbed79d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe81564f0 con 0x7fbbe815d230 2023-10-09T08:18:02.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.972+0000 7fbbed79d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe80c5400 con 0x7fbbe81597f0 2023-10-09T08:18:02.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.972+0000 7fbbe7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbe8159420 0x7fbbe8155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.972+0000 7fbbe7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbe8159420 0x7fbbe8155fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40266/0 (socket says 172.21.15.71:40266) 2023-10-09T08:18:02.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.972+0000 7fbbe7fff700 1 -- 172.21.15.71:0/262397310 learned_addr learned my addr 172.21.15.71:0/262397310 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:02.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.972+0000 7fbbecf9c700 1 --2- 172.21.15.71:0/262397310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbe815d230 0x7fbbe8156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.972+0000 7fbbe77fe700 1 --2- 172.21.15.71:0/262397310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbe81597f0 0x7fbbe815b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.972+0000 7fbbe7fff700 1 -- 172.21.15.71:0/262397310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbe81597f0 msgr2=0x7fbbe815b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.972+0000 7fbbe7fff700 1 --2- 172.21.15.71:0/262397310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbe81597f0 0x7fbbe815b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.972+0000 7fbbe7fff700 1 -- 172.21.15.71:0/262397310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbe815d230 msgr2=0x7fbbe8156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:02.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.972+0000 7fbbe7fff700 1 --2- 172.21.15.71:0/262397310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbe815d230 0x7fbbe8156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:02.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.972+0000 7fbbe7fff700 1 -- 172.21.15.71:0/262397310 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd8009420 con 0x7fbbe8159420 2023-10-09T08:18:02.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.972+0000 7fbbe7fff700 1 --2- 172.21.15.71:0/262397310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbe8159420 0x7fbbe8155fb0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8089340 tx=0x7fbbd8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:02.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.973+0000 7fbbcffff700 1 -- 172.21.15.71:0/262397310 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd801f070 con 0x7fbbe8159420 2023-10-09T08:18:02.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.973+0000 7fbbcffff700 1 -- 172.21.15.71:0/262397310 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd800b9d0 con 0x7fbbe8159420 2023-10-09T08:18:02.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.973+0000 7fbbed79d700 1 -- 172.21.15.71:0/262397310 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe80c9810 con 0x7fbbe8159420 2023-10-09T08:18:02.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.973+0000 7fbbcffff700 1 -- 172.21.15.71:0/262397310 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8025670 con 0x7fbbe8159420 2023-10-09T08:18:02.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.973+0000 7fbbed79d700 1 -- 172.21.15.71:0/262397310 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe80ca0b0 con 0x7fbbe8159420 2023-10-09T08:18:02.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.974+0000 7fbbed79d700 1 -- 172.21.15.71:0/262397310 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe804c3c0 con 0x7fbbe8159420 2023-10-09T08:18:02.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.975+0000 7fbbcffff700 1 -- 172.21.15.71:0/262397310 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbbd8023070 con 0x7fbbe8159420 2023-10-09T08:18:02.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.976+0000 7fbbcffff700 1 --2- 172.21.15.71:0/262397310 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbbd4066f30 0x7fbbd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:02.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.976+0000 7fbbcffff700 1 -- 172.21.15.71:0/262397310 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7fbbd8085d30 con 0x7fbbe8159420 2023-10-09T08:18:02.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.976+0000 7fbbe77fe700 1 --2- 172.21.15.71:0/262397310 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbbd4066f30 0x7fbbd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:02.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.977+0000 7fbbe77fe700 1 --2- 172.21.15.71:0/262397310 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbbd4066f30 0x7fbbd40693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbbe815cf20 tx=0x7fbbdc009040 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:02.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:02.980+0000 7fbbcffff700 1 -- 172.21.15.71:0/262397310 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbbd8052e60 con 0x7fbbe8159420 2023-10-09T08:18:03.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.169+0000 7fbbed79d700 1 -- 172.21.15.71:0/262397310 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbe80b1a70 con 0x7fbbd4066f30 2023-10-09T08:18:03.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.170+0000 7fbbcffff700 1 -- 172.21.15.71:0/262397310 <== mgr.9898 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbbe80b1a70 con 0x7fbbd4066f30 2023-10-09T08:18:03.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.172+0000 7fbbed79d700 1 -- 172.21.15.71:0/262397310 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbbd4066f30 msgr2=0x7fbbd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:03.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.172+0000 7fbbed79d700 1 --2- 172.21.15.71:0/262397310 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbbd4066f30 0x7fbbd40693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbbe815cf20 tx=0x7fbbdc009040 comp rx=0 tx=0).stop 2023-10-09T08:18:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.172+0000 7fbbed79d700 1 -- 172.21.15.71:0/262397310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbe8159420 msgr2=0x7fbbe8155fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.172+0000 7fbbed79d700 1 --2- 172.21.15.71:0/262397310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbe8159420 0x7fbbe8155fb0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8089340 tx=0x7fbbd8017000 comp rx=0 tx=0).stop 2023-10-09T08:18:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.172+0000 7fbbed79d700 1 -- 172.21.15.71:0/262397310 shutdown_connections 2023-10-09T08:18:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.172+0000 7fbbed79d700 1 --2- 172.21.15.71:0/262397310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbe815d230 0x7fbbe8156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.172+0000 7fbbed79d700 1 --2- 172.21.15.71:0/262397310 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fbbd4066f30 0x7fbbd40693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.172+0000 7fbbed79d700 1 --2- 172.21.15.71:0/262397310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbbe8159420 0x7fbbe8155fb0 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.172+0000 7fbbed79d700 1 --2- 172.21.15.71:0/262397310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbe81597f0 0x7fbbe815b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.172+0000 7fbbed79d700 1 -- 172.21.15.71:0/262397310 >> 172.21.15.71:0/262397310 conn(0x7fbbe80d0660 msgr2=0x7fbbe81580b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.172+0000 7fbbed79d700 1 -- 172.21.15.71:0/262397310 shutdown_connections 2023-10-09T08:18:03.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.172+0000 7fbbed79d700 1 -- 172.21.15.71:0/262397310 wait complete. 2023-10-09T08:18:03.175 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 2 to deep-scrub 2023-10-09T08:18:03.190 INFO:tasks.ceph:Scrubbing osd.3 2023-10-09T08:18:03.191 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-09T08:18:03.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.375+0000 7f849a3ff700 1 Processor -- start 2023-10-09T08:18:03.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.375+0000 7f849a3ff700 1 -- start start 2023-10-09T08:18:03.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.377+0000 7f849a3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8494159ec0 0x7f84940b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:03.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.377+0000 7f849a3ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f84940b53d0 0x7f84940cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:03.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.377+0000 7f849a3ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84940b5b00 con 0x7f84940cce40 2023-10-09T08:18:03.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.377+0000 7f849a3ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84940b5850 con 0x7f84940b53d0 2023-10-09T08:18:03.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.377+0000 7f849a3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84940b5da0 con 0x7f8494159ec0 2023-10-09T08:18:03.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.377+0000 7f8493fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8494159ec0 0x7f84940b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:03.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.377+0000 7f849899c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f84940cce40 0x7f84940cd260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43990/0 (socket says 172.21.15.71:43990) 2023-10-09T08:18:03.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.377+0000 7f849899c700 1 -- 172.21.15.71:0/2858905754 learned_addr learned my addr 172.21.15.71:0/2858905754 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:18:03.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.377+0000 7f84937fe700 1 --2- 172.21.15.71:0/2858905754 >> v2:172.21.15.71:3300/0 conn(0x7f84940b53d0 0x7f84940cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:03.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.378+0000 7f84937fe700 1 -- 172.21.15.71:0/2858905754 >> v2:172.21.15.179:3300/0 conn(0x7f8494159ec0 msgr2=0x7f84940b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:03.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.378+0000 7f84937fe700 1 --2- 172.21.15.71:0/2858905754 >> v2:172.21.15.179:3300/0 conn(0x7f8494159ec0 0x7f84940b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:03.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.378+0000 7f84937fe700 1 -- 172.21.15.71:0/2858905754 >> v1:172.21.15.71:6789/0 conn(0x7f84940cce40 legacy=0x7f84940cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:03.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.378+0000 7f8492ffd700 1 -- 172.21.15.71:0/2858905754 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 340628014 0 0) 0x7f84940b5b00 con 0x7f84940cce40 2023-10-09T08:18:03.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.378+0000 7f84937fe700 1 -- 172.21.15.71:0/2858905754 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84940b6080 con 0x7f84940b53d0 2023-10-09T08:18:03.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.378+0000 7f8493fff700 1 --2- 172.21.15.71:0/2858905754 >> v2:172.21.15.179:3300/0 conn(0x7f8494159ec0 0x7f84940b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:18:03.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.378+0000 7f84937fe700 1 --2- 172.21.15.71:0/2858905754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84940b53d0 0x7f84940cc900 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f8494089120 tx=0x7f84880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7bb04fbcfee2b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:03.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.378+0000 7f8492ffd700 1 -- 172.21.15.71:0/2858905754 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488011630 con 0x7f84940b53d0 2023-10-09T08:18:03.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.378+0000 7f8492ffd700 1 -- 172.21.15.71:0/2858905754 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8488011790 con 0x7f84940b53d0 2023-10-09T08:18:03.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.378+0000 7f8492ffd700 1 -- 172.21.15.71:0/2858905754 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488011b30 con 0x7f84940b53d0 2023-10-09T08:18:03.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.378+0000 7f849a3ff700 1 -- 172.21.15.71:0/2858905754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84940b53d0 msgr2=0x7f84940cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:03.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.379+0000 7f849a3ff700 1 --2- 172.21.15.71:0/2858905754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84940b53d0 0x7f84940cc900 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f8494089120 tx=0x7f84880091a0 comp rx=0 tx=0).stop 2023-10-09T08:18:03.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.379+0000 7f849a3ff700 1 -- 172.21.15.71:0/2858905754 shutdown_connections 2023-10-09T08:18:03.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.379+0000 7f849a3ff700 1 --2- 172.21.15.71:0/2858905754 >> v2:172.21.15.179:3300/0 conn(0x7f8494159ec0 0x7f84940b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:03.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.379+0000 7f849a3ff700 1 --2- 172.21.15.71:0/2858905754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84940b53d0 0x7f84940cc900 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:03.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.379+0000 7f849a3ff700 1 -- 172.21.15.71:0/2858905754 >> 172.21.15.71:0/2858905754 conn(0x7f84940999f0 msgr2=0x7f84940b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:03.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.379+0000 7f849a3ff700 1 -- 172.21.15.71:0/2858905754 shutdown_connections 2023-10-09T08:18:03.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.379+0000 7f849a3ff700 1 -- 172.21.15.71:0/2858905754 wait complete. 2023-10-09T08:18:03.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.380+0000 7f849a3ff700 1 Processor -- start 2023-10-09T08:18:03.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.380+0000 7f849a3ff700 1 -- start start 2023-10-09T08:18:03.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.381+0000 7f849a3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84940b53d0 0x7f84941535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:03.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.381+0000 7f849a3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84940cce40 0x7f84941555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:03.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.381+0000 7f849a3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8494159ec0 0x7f84941501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:03.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.381+0000 7f849a3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8494154470 con 0x7f84940cce40 2023-10-09T08:18:03.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.381+0000 7f849a3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8494153bd0 con 0x7f84940b53d0 2023-10-09T08:18:03.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.381+0000 7f849a3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8494153eb0 con 0x7f8494159ec0 2023-10-09T08:18:03.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.381+0000 7f84937fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84940cce40 0x7f84941555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:03.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.382+0000 7f84937fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84940cce40 0x7f84941555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40282/0 (socket says 172.21.15.71:40282) 2023-10-09T08:18:03.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.382+0000 7f84937fe700 1 -- 172.21.15.71:0/1713541399 learned_addr learned my addr 172.21.15.71:0/1713541399 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:03.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.382+0000 7f8493fff700 1 --2- 172.21.15.71:0/1713541399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84940b53d0 0x7f84941535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:03.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.382+0000 7f849899c700 1 --2- 172.21.15.71:0/1713541399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8494159ec0 0x7f84941501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:03.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.382+0000 7f84937fe700 1 -- 172.21.15.71:0/1713541399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8494159ec0 msgr2=0x7f84941501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:03.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.382+0000 7f84937fe700 1 --2- 172.21.15.71:0/1713541399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8494159ec0 0x7f84941501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:03.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.382+0000 7f84937fe700 1 -- 172.21.15.71:0/1713541399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84940b53d0 msgr2=0x7f84941535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:03.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.382+0000 7f84937fe700 1 --2- 172.21.15.71:0/1713541399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84940b53d0 0x7f84941535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:03.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.382+0000 7f84937fe700 1 -- 172.21.15.71:0/1713541399 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8484009a20 con 0x7f84940cce40 2023-10-09T08:18:03.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.382+0000 7f849899c700 1 --2- 172.21.15.71:0/1713541399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8494159ec0 0x7f84941501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:18:03.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.382+0000 7f84937fe700 1 --2- 172.21.15.71:0/1713541399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84940cce40 0x7f84941555a0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f8494089390 tx=0x7f8488017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:03.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.382+0000 7f847bfff700 1 -- 172.21.15.71:0/1713541399 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488011b10 con 0x7f84940cce40 2023-10-09T08:18:03.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.382+0000 7f847bfff700 1 -- 172.21.15.71:0/1713541399 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84880253f0 con 0x7f84940cce40 2023-10-09T08:18:03.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.382+0000 7f849a3ff700 1 -- 172.21.15.71:0/1713541399 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8488009420 con 0x7f84940cce40 2023-10-09T08:18:03.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.383+0000 7f847bfff700 1 -- 172.21.15.71:0/1713541399 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488025790 con 0x7f84940cce40 2023-10-09T08:18:03.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.383+0000 7f849a3ff700 1 -- 172.21.15.71:0/1713541399 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84941572b0 con 0x7f84940cce40 2023-10-09T08:18:03.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.383+0000 7f849a3ff700 1 -- 172.21.15.71:0/1713541399 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f84940b2730 con 0x7f84940cce40 2023-10-09T08:18:03.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.384+0000 7f847bfff700 1 -- 172.21.15.71:0/1713541399 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8488025b80 con 0x7f84940cce40 2023-10-09T08:18:03.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.385+0000 7f847bfff700 1 --2- 172.21.15.71:0/1713541399 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8480066f60 0x7f8480069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:03.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.385+0000 7f847bfff700 1 -- 172.21.15.71:0/1713541399 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f8488085e60 con 0x7f84940cce40 2023-10-09T08:18:03.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.386+0000 7f8493fff700 1 --2- 172.21.15.71:0/1713541399 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8480066f60 0x7f8480069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:03.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.386+0000 7f847bfff700 1 --2- 172.21.15.71:0/1713541399 >> [v2:172.21.15.71:6823/85810,v1:172.21.15.71:6825/85810] conn(0x7f848006d700 0x7f848006fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:03.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.386+0000 7f847bfff700 1 -- 172.21.15.71:0/1713541399 --> [v2:172.21.15.71:6823/85810,v1:172.21.15.71:6825/85810] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f84800701a0 con 0x7f848006d700 2023-10-09T08:18:03.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.386+0000 7f847bfff700 1 -- 172.21.15.71:0/1713541399 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=215) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84880883c0 con 0x7f84940cce40 2023-10-09T08:18:03.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.386+0000 7f849899c700 1 --2- 172.21.15.71:0/1713541399 >> [v2:172.21.15.71:6823/85810,v1:172.21.15.71:6825/85810] conn(0x7f848006d700 0x7f848006fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:03.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.386+0000 7f8493fff700 1 --2- 172.21.15.71:0/1713541399 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8480066f60 0x7f8480069410 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f848400f6c0 tx=0x7f848400b040 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:03.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.386+0000 7f849899c700 1 --2- 172.21.15.71:0/1713541399 >> [v2:172.21.15.71:6823/85810,v1:172.21.15.71:6825/85810] conn(0x7f848006d700 0x7f848006fb70 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:03.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.387+0000 7f847bfff700 1 -- 172.21.15.71:0/1713541399 <== osd.3 v2:172.21.15.71:6823/85810 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f84800701a0 con 0x7f848006d700 2023-10-09T08:18:03.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.401+0000 7f849a3ff700 1 -- 172.21.15.71:0/1713541399 --> [v2:172.21.15.71:6823/85810,v1:172.21.15.71:6825/85810] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8494063c90 con 0x7f848006d700 2023-10-09T08:18:03.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.401+0000 7f847bfff700 1 -- 172.21.15.71:0/1713541399 <== osd.3 v2:172.21.15.71:6823/85810 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8494063c90 con 0x7f848006d700 2023-10-09T08:18:03.403 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T08:18:03.403 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T08:18:03.403 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T08:18:03.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.402+0000 7f849a3ff700 1 -- 172.21.15.71:0/1713541399 >> [v2:172.21.15.71:6823/85810,v1:172.21.15.71:6825/85810] conn(0x7f848006d700 msgr2=0x7f848006fb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:03.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.402+0000 7f849a3ff700 1 --2- 172.21.15.71:0/1713541399 >> [v2:172.21.15.71:6823/85810,v1:172.21.15.71:6825/85810] conn(0x7f848006d700 0x7f848006fb70 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:03.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.402+0000 7f849a3ff700 1 -- 172.21.15.71:0/1713541399 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8480066f60 msgr2=0x7f8480069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:03.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.402+0000 7f849a3ff700 1 --2- 172.21.15.71:0/1713541399 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f8480066f60 0x7f8480069410 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f848400f6c0 tx=0x7f848400b040 comp rx=0 tx=0).stop 2023-10-09T08:18:03.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.402+0000 7f849a3ff700 1 -- 172.21.15.71:0/1713541399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84940cce40 msgr2=0x7f84941555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:03.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.402+0000 7f849a3ff700 1 --2- 172.21.15.71:0/1713541399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84940cce40 0x7f84941555a0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f8494089390 tx=0x7f8488017000 comp rx=0 tx=0).stop 2023-10-09T08:18:03.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.402+0000 7f849899c700 1 -- 172.21.15.71:0/1713541399 reap_dead start 2023-10-09T08:18:03.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.402+0000 7f849a3ff700 1 -- 172.21.15.71:0/1713541399 shutdown_connections 2023-10-09T08:18:03.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.402+0000 7f849a3ff700 1 -- 172.21.15.71:0/1713541399 >> 172.21.15.71:0/1713541399 conn(0x7f84940999f0 msgr2=0x7f84940c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:03.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.402+0000 7f849a3ff700 1 -- 172.21.15.71:0/1713541399 shutdown_connections 2023-10-09T08:18:03.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.402+0000 7f849a3ff700 1 -- 172.21.15.71:0/1713541399 wait complete. 2023-10-09T08:18:03.419 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-09T08:18:03.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.600+0000 7f1454f9d700 1 Processor -- start 2023-10-09T08:18:03.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.600+0000 7f1454f9d700 1 -- start start 2023-10-09T08:18:03.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.601+0000 7f1454f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14500ae710 0x7f14500c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:03.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.601+0000 7f1454f9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14500ca860 con 0x7f1450156310 2023-10-09T08:18:03.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.601+0000 7f1454f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14500cab40 con 0x7f14501566e0 2023-10-09T08:18:03.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.601+0000 7f1454f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14500cae20 con 0x7f14500ae710 2023-10-09T08:18:03.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.601+0000 7f144f7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f1450156310 0x7f14500c9dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44006/0 (socket says 172.21.15.71:44006) 2023-10-09T08:18:03.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.601+0000 7f144f7fe700 1 -- 172.21.15.71:0/3877746026 learned_addr learned my addr 172.21.15.71:0/3877746026 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:18:03.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.602+0000 7f144ffff700 1 --2- 172.21.15.71:0/3877746026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14500ae710 0x7f14500c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:03.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.602+0000 7f144e7fc700 1 -- 172.21.15.71:0/3877746026 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401896748 0 0) 0x7f14500ca860 con 0x7f1450156310 2023-10-09T08:18:03.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.602+0000 7f144e7fc700 1 -- 172.21.15.71:0/3877746026 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1438003570 con 0x7f1450156310 2023-10-09T08:18:03.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.602+0000 7f144e7fc700 1 -- 172.21.15.71:0/3877746026 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127300111 0 0) 0x7f14500cab40 con 0x7f14501566e0 2023-10-09T08:18:03.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.602+0000 7f144e7fc700 1 -- 172.21.15.71:0/3877746026 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14500ca860 con 0x7f14501566e0 2023-10-09T08:18:03.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.602+0000 7f144ffff700 1 -- 172.21.15.71:0/3877746026 >> v1:172.21.15.179:6789/0 conn(0x7f14501566e0 legacy=0x7f14500ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:03.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.602+0000 7f144ffff700 1 -- 172.21.15.71:0/3877746026 >> v1:172.21.15.71:6789/0 conn(0x7f1450156310 legacy=0x7f14500c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:03.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.602+0000 7f144ffff700 1 -- 172.21.15.71:0/3877746026 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14500cb100 con 0x7f14500ae710 2023-10-09T08:18:03.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.602+0000 7f144ffff700 1 --2- 172.21.15.71:0/3877746026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14500ae710 0x7f14500c6830 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1448009e90 tx=0x7f1448009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61858d5207ed7bfb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:03.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.603+0000 7f144e7fc700 1 -- 172.21.15.71:0/3877746026 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144800e070 con 0x7f14500ae710 2023-10-09T08:18:03.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.603+0000 7f144e7fc700 1 -- 172.21.15.71:0/3877746026 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144800bb80 con 0x7f14500ae710 2023-10-09T08:18:03.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.603+0000 7f144e7fc700 1 -- 172.21.15.71:0/3877746026 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1448012430 con 0x7f14500ae710 2023-10-09T08:18:03.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.603+0000 7f1454f9d700 1 -- 172.21.15.71:0/3877746026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14500ae710 msgr2=0x7f14500c6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:03.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.603+0000 7f1454f9d700 1 --2- 172.21.15.71:0/3877746026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14500ae710 0x7f14500c6830 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1448009e90 tx=0x7f1448009780 comp rx=0 tx=0).stop 2023-10-09T08:18:03.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.603+0000 7f1454f9d700 1 -- 172.21.15.71:0/3877746026 shutdown_connections 2023-10-09T08:18:03.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.603+0000 7f1454f9d700 1 --2- 172.21.15.71:0/3877746026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14500ae710 0x7f14500c6830 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:03.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.603+0000 7f1454f9d700 1 -- 172.21.15.71:0/3877746026 >> 172.21.15.71:0/3877746026 conn(0x7f14500cc1f0 msgr2=0x7f14500cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:03.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.603+0000 7f1454f9d700 1 -- 172.21.15.71:0/3877746026 shutdown_connections 2023-10-09T08:18:03.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.603+0000 7f1454f9d700 1 -- 172.21.15.71:0/3877746026 wait complete. 2023-10-09T08:18:03.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.605+0000 7f1454f9d700 1 Processor -- start 2023-10-09T08:18:03.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.605+0000 7f1454f9d700 1 -- start start 2023-10-09T08:18:03.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.606+0000 7f1454f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14500ae710 0x7f1450143d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:03.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.606+0000 7f1454f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1450156310 0x7f145015bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:03.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.606+0000 7f1454f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14501566e0 0x7f145015c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:03.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.606+0000 7f1454f9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145015dfa0 con 0x7f14501566e0 2023-10-09T08:18:03.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.606+0000 7f1454f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145015c700 con 0x7f14500ae710 2023-10-09T08:18:03.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.606+0000 7f1454f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145016ad30 con 0x7f1450156310 2023-10-09T08:18:03.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.606+0000 7f144ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14501566e0 0x7f145015c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:03.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.606+0000 7f144ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14501566e0 0x7f145015c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40286/0 (socket says 172.21.15.71:40286) 2023-10-09T08:18:03.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.606+0000 7f144ffff700 1 -- 172.21.15.71:0/2885828063 learned_addr learned my addr 172.21.15.71:0/2885828063 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:03.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.606+0000 7f144f7fe700 1 --2- 172.21.15.71:0/2885828063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14500ae710 0x7f1450143d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:03.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.606+0000 7f144effd700 1 --2- 172.21.15.71:0/2885828063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1450156310 0x7f145015bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:03.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.607+0000 7f144ffff700 1 -- 172.21.15.71:0/2885828063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1450156310 msgr2=0x7f145015bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:03.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.607+0000 7f144ffff700 1 --2- 172.21.15.71:0/2885828063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1450156310 0x7f145015bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:03.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.607+0000 7f144ffff700 1 -- 172.21.15.71:0/2885828063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14500ae710 msgr2=0x7f1450143d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:03.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.607+0000 7f144ffff700 1 --2- 172.21.15.71:0/2885828063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14500ae710 0x7f1450143d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:03.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.607+0000 7f144ffff700 1 -- 172.21.15.71:0/2885828063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1448009a20 con 0x7f14501566e0 2023-10-09T08:18:03.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.607+0000 7f144ffff700 1 --2- 172.21.15.71:0/2885828063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14501566e0 0x7f145015c1c0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f1448013000 tx=0x7f1448019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:03.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.607+0000 7f14377fe700 1 -- 172.21.15.71:0/2885828063 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144801b420 con 0x7f14501566e0 2023-10-09T08:18:03.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.607+0000 7f14377fe700 1 -- 172.21.15.71:0/2885828063 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144801b5e0 con 0x7f14501566e0 2023-10-09T08:18:03.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.607+0000 7f14377fe700 1 -- 172.21.15.71:0/2885828063 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144801b9a0 con 0x7f14501566e0 2023-10-09T08:18:03.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.607+0000 7f1454f9d700 1 -- 172.21.15.71:0/2885828063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14500c1680 con 0x7f14501566e0 2023-10-09T08:18:03.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.607+0000 7f1454f9d700 1 -- 172.21.15.71:0/2885828063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1450144330 con 0x7f14501566e0 2023-10-09T08:18:03.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.608+0000 7f1454f9d700 1 -- 172.21.15.71:0/2885828063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f145004c3c0 con 0x7f14501566e0 2023-10-09T08:18:03.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.609+0000 7f14377fe700 1 -- 172.21.15.71:0/2885828063 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f144801bd50 con 0x7f14501566e0 2023-10-09T08:18:03.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.610+0000 7f14377fe700 1 --2- 172.21.15.71:0/2885828063 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f143c066f30 0x7f143c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:03.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.610+0000 7f14377fe700 1 -- 172.21.15.71:0/2885828063 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f1448086060 con 0x7f14501566e0 2023-10-09T08:18:03.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.610+0000 7f144f7fe700 1 --2- 172.21.15.71:0/2885828063 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f143c066f30 0x7f143c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:03.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.611+0000 7f144f7fe700 1 --2- 172.21.15.71:0/2885828063 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f143c066f30 0x7f143c0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1440007fd0 tx=0x7f1440009040 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:03.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.614+0000 7f14377fe700 1 -- 172.21.15.71:0/2885828063 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14480b75a0 con 0x7f14501566e0 2023-10-09T08:18:03.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.803+0000 7f1454f9d700 1 -- 172.21.15.71:0/2885828063 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f145015b020 con 0x7f143c066f30 2023-10-09T08:18:03.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.804+0000 7f14377fe700 1 -- 172.21.15.71:0/2885828063 <== mgr.9898 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f145015b020 con 0x7f143c066f30 2023-10-09T08:18:03.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.806+0000 7f1454f9d700 1 -- 172.21.15.71:0/2885828063 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f143c066f30 msgr2=0x7f143c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:03.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.806+0000 7f1454f9d700 1 --2- 172.21.15.71:0/2885828063 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f143c066f30 0x7f143c0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1440007fd0 tx=0x7f1440009040 comp rx=0 tx=0).stop 2023-10-09T08:18:03.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.806+0000 7f1454f9d700 1 -- 172.21.15.71:0/2885828063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14501566e0 msgr2=0x7f145015c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:03.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.806+0000 7f1454f9d700 1 --2- 172.21.15.71:0/2885828063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14501566e0 0x7f145015c1c0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f1448013000 tx=0x7f1448019000 comp rx=0 tx=0).stop 2023-10-09T08:18:03.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.806+0000 7f1454f9d700 1 -- 172.21.15.71:0/2885828063 shutdown_connections 2023-10-09T08:18:03.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.806+0000 7f1454f9d700 1 --2- 172.21.15.71:0/2885828063 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f143c066f30 0x7f143c0693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:03.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.806+0000 7f1454f9d700 1 --2- 172.21.15.71:0/2885828063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14501566e0 0x7f145015c1c0 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:03.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.806+0000 7f1454f9d700 1 --2- 172.21.15.71:0/2885828063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14500ae710 0x7f1450143d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:03.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.806+0000 7f1454f9d700 1 --2- 172.21.15.71:0/2885828063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1450156310 0x7f145015bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:03.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.806+0000 7f1454f9d700 1 -- 172.21.15.71:0/2885828063 >> 172.21.15.71:0/2885828063 conn(0x7f14500cc1f0 msgr2=0x7f1450151c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:03.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.806+0000 7f1454f9d700 1 -- 172.21.15.71:0/2885828063 shutdown_connections 2023-10-09T08:18:03.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:03.806+0000 7f1454f9d700 1 -- 172.21.15.71:0/2885828063 wait complete. 2023-10-09T08:18:03.809 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 3 to deep-scrub 2023-10-09T08:18:03.825 INFO:tasks.ceph:Scrubbing osd.4 2023-10-09T08:18:03.825 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-09T08:18:04.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.009+0000 7f92487ff700 1 Processor -- start 2023-10-09T08:18:04.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.009+0000 7f92487ff700 1 -- start start 2023-10-09T08:18:04.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.010+0000 7f92487ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92401563b0 0x7f9240156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.010+0000 7f92487ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f924015a440 0x7f92400acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.010+0000 7f92487ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f924015a9b0 con 0x7f9240068890 2023-10-09T08:18:04.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.010+0000 7f92487ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f924015ac90 con 0x7f924015a440 2023-10-09T08:18:04.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.010+0000 7f92487ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924015af70 con 0x7f92401563b0 2023-10-09T08:18:04.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.011+0000 7f924659b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92401563b0 0x7f9240156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.011+0000 7f9245d9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f924015a440 0x7f92400acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.011+0000 7f9245d9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f924015a440 0x7f92400acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.71:55652/0 (socket says 172.21.15.71:55652) 2023-10-09T08:18:04.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.011+0000 7f9245d9a700 1 -- 172.21.15.71:0/862135368 learned_addr learned my addr 172.21.15.71:0/862135368 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:04.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.011+0000 7f9245599700 1 -- 172.21.15.71:0/862135368 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625270797 0 0) 0x7f924015a9b0 con 0x7f9240068890 2023-10-09T08:18:04.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.011+0000 7f924659b700 1 -- 172.21.15.71:0/862135368 >> v2:172.21.15.179:3300/0 conn(0x7f924015a440 msgr2=0x7f92400acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:04.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.011+0000 7f924659b700 1 --2- 172.21.15.71:0/862135368 >> v2:172.21.15.179:3300/0 conn(0x7f924015a440 0x7f92400acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.011+0000 7f924659b700 1 -- 172.21.15.71:0/862135368 >> v1:172.21.15.179:6789/0 conn(0x7f9240068890 legacy=0x7f92400c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.011+0000 7f924659b700 1 -- 172.21.15.71:0/862135368 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924015b250 con 0x7f92401563b0 2023-10-09T08:18:04.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.011+0000 7f924659b700 1 --2- 172.21.15.71:0/862135368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92401563b0 0x7f9240156780 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f923c00bb90 tx=0x7f923c00b430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba31f40562522645 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:04.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.012+0000 7f9245599700 1 -- 172.21.15.71:0/862135368 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923c00db40 con 0x7f92401563b0 2023-10-09T08:18:04.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.012+0000 7f9245599700 1 -- 172.21.15.71:0/862135368 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923c00dca0 con 0x7f92401563b0 2023-10-09T08:18:04.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.012+0000 7f9245599700 1 -- 172.21.15.71:0/862135368 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923c0196b0 con 0x7f92401563b0 2023-10-09T08:18:04.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.012+0000 7f92487ff700 1 -- 172.21.15.71:0/862135368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92401563b0 msgr2=0x7f9240156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.012+0000 7f92487ff700 1 --2- 172.21.15.71:0/862135368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92401563b0 0x7f9240156780 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f923c00bb90 tx=0x7f923c00b430 comp rx=0 tx=0).stop 2023-10-09T08:18:04.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.012+0000 7f92487ff700 1 -- 172.21.15.71:0/862135368 shutdown_connections 2023-10-09T08:18:04.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.012+0000 7f92487ff700 1 --2- 172.21.15.71:0/862135368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92401563b0 0x7f9240156780 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.012+0000 7f92487ff700 1 --2- 172.21.15.71:0/862135368 >> v2:172.21.15.179:3300/0 conn(0x7f924015a440 0x7f92400acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.012+0000 7f92487ff700 1 -- 172.21.15.71:0/862135368 >> 172.21.15.71:0/862135368 conn(0x7f92400c8f90 msgr2=0x7f92400c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:04.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.012+0000 7f92487ff700 1 -- 172.21.15.71:0/862135368 shutdown_connections 2023-10-09T08:18:04.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.012+0000 7f92487ff700 1 -- 172.21.15.71:0/862135368 wait complete. 2023-10-09T08:18:04.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.014+0000 7f92487ff700 1 Processor -- start 2023-10-09T08:18:04.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.014+0000 7f92487ff700 1 -- start start 2023-10-09T08:18:04.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.015+0000 7f92487ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9240068890 0x7f924014cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.015+0000 7f92487ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92401563b0 0x7f9240158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.015+0000 7f92487ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f924015a440 0x7f92400c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.015+0000 7f92487ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9240159d40 con 0x7f9240068890 2023-10-09T08:18:04.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.015+0000 7f92487ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92401591c0 con 0x7f924015a440 2023-10-09T08:18:04.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.015+0000 7f92487ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92401594a0 con 0x7f92401563b0 2023-10-09T08:18:04.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.015+0000 7f924659b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9240068890 0x7f924014cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.015+0000 7f924659b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9240068890 0x7f924014cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40302/0 (socket says 172.21.15.71:40302) 2023-10-09T08:18:04.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.015+0000 7f924659b700 1 -- 172.21.15.71:0/529478368 learned_addr learned my addr 172.21.15.71:0/529478368 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:04.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.015+0000 7f9245d9a700 1 --2- 172.21.15.71:0/529478368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92401563b0 0x7f9240158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.015+0000 7f9246d9c700 1 --2- 172.21.15.71:0/529478368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f924015a440 0x7f92400c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.015+0000 7f924659b700 1 -- 172.21.15.71:0/529478368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92401563b0 msgr2=0x7f9240158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.015+0000 7f924659b700 1 --2- 172.21.15.71:0/529478368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92401563b0 0x7f9240158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.015+0000 7f924659b700 1 -- 172.21.15.71:0/529478368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f924015a440 msgr2=0x7f92400c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.015+0000 7f924659b700 1 --2- 172.21.15.71:0/529478368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f924015a440 0x7f92400c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.015+0000 7f924659b700 1 -- 172.21.15.71:0/529478368 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c00b6d0 con 0x7f9240068890 2023-10-09T08:18:04.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.015+0000 7f9246d9c700 1 --2- 172.21.15.71:0/529478368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f924015a440 0x7f92400c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:18:04.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.016+0000 7f924659b700 1 --2- 172.21.15.71:0/529478368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9240068890 0x7f924014cc70 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f923c00bfd0 tx=0x7f923c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:04.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.016+0000 7f92367fc700 1 -- 172.21.15.71:0/529478368 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923c010470 con 0x7f9240068890 2023-10-09T08:18:04.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.016+0000 7f92367fc700 1 -- 172.21.15.71:0/529478368 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923c010610 con 0x7f9240068890 2023-10-09T08:18:04.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.016+0000 7f92487ff700 1 -- 172.21.15.71:0/529478368 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9240159780 con 0x7f9240068890 2023-10-09T08:18:04.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.016+0000 7f92367fc700 1 -- 172.21.15.71:0/529478368 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923c0109d0 con 0x7f9240068890 2023-10-09T08:18:04.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.016+0000 7f92487ff700 1 -- 172.21.15.71:0/529478368 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9240158eb0 con 0x7f9240068890 2023-10-09T08:18:04.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.017+0000 7f92487ff700 1 -- 172.21.15.71:0/529478368 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f92400b0760 con 0x7f9240068890 2023-10-09T08:18:04.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.018+0000 7f92367fc700 1 -- 172.21.15.71:0/529478368 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f923c02d440 con 0x7f9240068890 2023-10-09T08:18:04.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.019+0000 7f92367fc700 1 --2- 172.21.15.71:0/529478368 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9224066f30 0x7f92240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.019+0000 7f92367fc700 1 -- 172.21.15.71:0/529478368 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f923c020070 con 0x7f9240068890 2023-10-09T08:18:04.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.019+0000 7f92367fc700 1 --2- 172.21.15.71:0/529478368 >> [v2:172.21.15.179:6822/86045,v1:172.21.15.179:6824/86045] conn(0x7f922406d6d0 0x7f922406fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.019+0000 7f92367fc700 1 -- 172.21.15.71:0/529478368 --> [v2:172.21.15.179:6822/86045,v1:172.21.15.179:6824/86045] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9224070170 con 0x7f922406d6d0 2023-10-09T08:18:04.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.019+0000 7f92367fc700 1 -- 172.21.15.71:0/529478368 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=215) v2 ==== 24+0+0 (secure 0 0 0) 0x7f923c088b90 con 0x7f9240068890 2023-10-09T08:18:04.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.019+0000 7f9245d9a700 1 --2- 172.21.15.71:0/529478368 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9224066f30 0x7f92240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.020+0000 7f9246d9c700 1 --2- 172.21.15.71:0/529478368 >> [v2:172.21.15.179:6822/86045,v1:172.21.15.179:6824/86045] conn(0x7f922406d6d0 0x7f922406fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.020+0000 7f9246d9c700 1 --2- 172.21.15.71:0/529478368 >> [v2:172.21.15.179:6822/86045,v1:172.21.15.179:6824/86045] conn(0x7f922406d6d0 0x7f922406fb40 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:04.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.020+0000 7f9245d9a700 1 --2- 172.21.15.71:0/529478368 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9224066f30 0x7f92240693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9230006fd0 tx=0x7f9230009250 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:04.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.021+0000 7f92367fc700 1 -- 172.21.15.71:0/529478368 <== osd.4 v2:172.21.15.179:6822/86045 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f9224070170 con 0x7f922406d6d0 2023-10-09T08:18:04.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.035+0000 7f92487ff700 1 -- 172.21.15.71:0/529478368 --> [v2:172.21.15.179:6822/86045,v1:172.21.15.179:6824/86045] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f92400718b0 con 0x7f922406d6d0 2023-10-09T08:18:04.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.036+0000 7f92367fc700 1 -- 172.21.15.71:0/529478368 <== osd.4 v2:172.21.15.179:6822/86045 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f92400718b0 con 0x7f922406d6d0 2023-10-09T08:18:04.037 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T08:18:04.037 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T08:18:04.037 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T08:18:04.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.037+0000 7f92487ff700 1 -- 172.21.15.71:0/529478368 >> [v2:172.21.15.179:6822/86045,v1:172.21.15.179:6824/86045] conn(0x7f922406d6d0 msgr2=0x7f922406fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.037+0000 7f92487ff700 1 --2- 172.21.15.71:0/529478368 >> [v2:172.21.15.179:6822/86045,v1:172.21.15.179:6824/86045] conn(0x7f922406d6d0 0x7f922406fb40 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.037+0000 7f92487ff700 1 -- 172.21.15.71:0/529478368 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9224066f30 msgr2=0x7f92240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.037+0000 7f92487ff700 1 --2- 172.21.15.71:0/529478368 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9224066f30 0x7f92240693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9230006fd0 tx=0x7f9230009250 comp rx=0 tx=0).stop 2023-10-09T08:18:04.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.037+0000 7f92487ff700 1 -- 172.21.15.71:0/529478368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9240068890 msgr2=0x7f924014cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.037+0000 7f92487ff700 1 --2- 172.21.15.71:0/529478368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9240068890 0x7f924014cc70 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f923c00bfd0 tx=0x7f923c01b000 comp rx=0 tx=0).stop 2023-10-09T08:18:04.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.037+0000 7f9246d9c700 1 -- 172.21.15.71:0/529478368 reap_dead start 2023-10-09T08:18:04.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.037+0000 7f92487ff700 1 -- 172.21.15.71:0/529478368 shutdown_connections 2023-10-09T08:18:04.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.037+0000 7f92487ff700 1 -- 172.21.15.71:0/529478368 >> 172.21.15.71:0/529478368 conn(0x7f92400c8f90 msgr2=0x7f92401535d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:04.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.037+0000 7f92487ff700 1 -- 172.21.15.71:0/529478368 shutdown_connections 2023-10-09T08:18:04.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.037+0000 7f92487ff700 1 -- 172.21.15.71:0/529478368 wait complete. 2023-10-09T08:18:04.054 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-09T08:18:04.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.235+0000 7fdedb3ff700 1 Processor -- start 2023-10-09T08:18:04.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.235+0000 7fdedb3ff700 1 -- start start 2023-10-09T08:18:04.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.236+0000 7fdedb3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fded40b1850 0x7fded40b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.236+0000 7fdedb3ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fded40ae680 0x7fded41572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.236+0000 7fdedb3ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded40cb300 con 0x7fded40aead0 2023-10-09T08:18:04.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.236+0000 7fdedb3ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded406fc30 con 0x7fded40ae680 2023-10-09T08:18:04.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.236+0000 7fdedb3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded40cc260 con 0x7fded40b1850 2023-10-09T08:18:04.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.237+0000 7fded999c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fded40aead0 0x7fded415b3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44010/0 (socket says 172.21.15.71:44010) 2023-10-09T08:18:04.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.237+0000 7fded899a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fded40ae680 0x7fded41572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.237+0000 7fded999c700 1 -- 172.21.15.71:0/2099514544 learned_addr learned my addr 172.21.15.71:0/2099514544 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:18:04.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.237+0000 7fded919b700 1 --2- 172.21.15.71:0/2099514544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fded40b1850 0x7fded40b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.237+0000 7fded899a700 1 -- 172.21.15.71:0/2099514544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fded40b1850 msgr2=0x7fded40b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:04.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.237+0000 7fded899a700 1 --2- 172.21.15.71:0/2099514544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fded40b1850 0x7fded40b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.237+0000 7fded899a700 1 -- 172.21.15.71:0/2099514544 >> v1:172.21.15.71:6789/0 conn(0x7fded40aead0 legacy=0x7fded415b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.237+0000 7fded899a700 1 -- 172.21.15.71:0/2099514544 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded40cb5e0 con 0x7fded40ae680 2023-10-09T08:18:04.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.237+0000 7fded899a700 1 --2- 172.21.15.71:0/2099514544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fded40ae680 0x7fded41572e0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fdec40098e0 tx=0x7fdec40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c03ff4d6ccc9df31 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:04.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.239+0000 7fdecbfff700 1 -- 172.21.15.71:0/2099514544 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec4009e80 con 0x7fded40ae680 2023-10-09T08:18:04.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.239+0000 7fdecbfff700 1 -- 172.21.15.71:0/2099514544 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec400b860 con 0x7fded40ae680 2023-10-09T08:18:04.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.239+0000 7fdecbfff700 1 -- 172.21.15.71:0/2099514544 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec400bbe0 con 0x7fded40ae680 2023-10-09T08:18:04.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.240+0000 7fdedb3ff700 1 -- 172.21.15.71:0/2099514544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fded40ae680 msgr2=0x7fded41572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.240+0000 7fdedb3ff700 1 --2- 172.21.15.71:0/2099514544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fded40ae680 0x7fded41572e0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fdec40098e0 tx=0x7fdec40091a0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.240+0000 7fdedb3ff700 1 -- 172.21.15.71:0/2099514544 shutdown_connections 2023-10-09T08:18:04.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.240+0000 7fdedb3ff700 1 --2- 172.21.15.71:0/2099514544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fded40b1850 0x7fded40b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.240+0000 7fdedb3ff700 1 --2- 172.21.15.71:0/2099514544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fded40ae680 0x7fded41572e0 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.240+0000 7fdedb3ff700 1 -- 172.21.15.71:0/2099514544 >> 172.21.15.71:0/2099514544 conn(0x7fded406a320 msgr2=0x7fded40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:04.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.240+0000 7fdedb3ff700 1 -- 172.21.15.71:0/2099514544 shutdown_connections 2023-10-09T08:18:04.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.240+0000 7fdedb3ff700 1 -- 172.21.15.71:0/2099514544 wait complete. 2023-10-09T08:18:04.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.241+0000 7fdedb3ff700 1 Processor -- start 2023-10-09T08:18:04.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.241+0000 7fdedb3ff700 1 -- start start 2023-10-09T08:18:04.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.242+0000 7fdedb3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fded40ae680 0x7fded414d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.242+0000 7fdedb3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fded40aead0 0x7fded414e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.242+0000 7fdedb3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fded40b1850 0x7fded406dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.242+0000 7fdedb3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded414e560 con 0x7fded40ae680 2023-10-09T08:18:04.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.242+0000 7fdedb3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded414d680 con 0x7fded40aead0 2023-10-09T08:18:04.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.242+0000 7fdedb3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded414d970 con 0x7fded40b1850 2023-10-09T08:18:04.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.242+0000 7fded919b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fded40ae680 0x7fded414d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.242+0000 7fded919b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fded40ae680 0x7fded414d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40314/0 (socket says 172.21.15.71:40314) 2023-10-09T08:18:04.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.243+0000 7fded919b700 1 -- 172.21.15.71:0/2492411882 learned_addr learned my addr 172.21.15.71:0/2492411882 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:04.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.243+0000 7fded999c700 1 --2- 172.21.15.71:0/2492411882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fded40b1850 0x7fded406dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.243+0000 7fded899a700 1 --2- 172.21.15.71:0/2492411882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fded40aead0 0x7fded414e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.243+0000 7fded919b700 1 -- 172.21.15.71:0/2492411882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fded40b1850 msgr2=0x7fded406dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.243+0000 7fded919b700 1 --2- 172.21.15.71:0/2492411882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fded40b1850 0x7fded406dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.243+0000 7fded919b700 1 -- 172.21.15.71:0/2492411882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fded40aead0 msgr2=0x7fded414e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.243+0000 7fded919b700 1 --2- 172.21.15.71:0/2492411882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fded40aead0 0x7fded414e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.243+0000 7fded919b700 1 -- 172.21.15.71:0/2492411882 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec4009420 con 0x7fded40ae680 2023-10-09T08:18:04.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.243+0000 7fded919b700 1 --2- 172.21.15.71:0/2492411882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fded40ae680 0x7fded414d140 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fded000d860 tx=0x7fded0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:04.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.243+0000 7fdec97fa700 1 -- 172.21.15.71:0/2492411882 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded00125f0 con 0x7fded40ae680 2023-10-09T08:18:04.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.243+0000 7fdec97fa700 1 -- 172.21.15.71:0/2492411882 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded0012750 con 0x7fded40ae680 2023-10-09T08:18:04.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.243+0000 7fdec97fa700 1 -- 172.21.15.71:0/2492411882 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded0012b10 con 0x7fded40ae680 2023-10-09T08:18:04.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.243+0000 7fdedb3ff700 1 -- 172.21.15.71:0/2492411882 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded414dc30 con 0x7fded40ae680 2023-10-09T08:18:04.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.244+0000 7fdedb3ff700 1 -- 172.21.15.71:0/2492411882 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded414e1f0 con 0x7fded40ae680 2023-10-09T08:18:04.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.245+0000 7fdedb3ff700 1 -- 172.21.15.71:0/2492411882 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded414e840 con 0x7fded40ae680 2023-10-09T08:18:04.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.246+0000 7fdec97fa700 1 -- 172.21.15.71:0/2492411882 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fded001e460 con 0x7fded40ae680 2023-10-09T08:18:04.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.246+0000 7fdec97fa700 1 --2- 172.21.15.71:0/2492411882 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdeb8066f30 0x7fdeb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.246+0000 7fdec97fa700 1 -- 172.21.15.71:0/2492411882 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7fded0084ba0 con 0x7fded40ae680 2023-10-09T08:18:04.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.247+0000 7fded899a700 1 --2- 172.21.15.71:0/2492411882 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdeb8066f30 0x7fdeb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.247+0000 7fded899a700 1 --2- 172.21.15.71:0/2492411882 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdeb8066f30 0x7fdeb80693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdec40091e0 tx=0x7fdec4017000 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:04.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.250+0000 7fdec97fa700 1 -- 172.21.15.71:0/2492411882 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fded0055760 con 0x7fded40ae680 2023-10-09T08:18:04.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.439+0000 7fdedb3ff700 1 -- 172.21.15.71:0/2492411882 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fded414e6a0 con 0x7fdeb8066f30 2023-10-09T08:18:04.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.440+0000 7fdec97fa700 1 -- 172.21.15.71:0/2492411882 <== mgr.9898 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdec400ba60 con 0x7fdeb8066f30 2023-10-09T08:18:04.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.442+0000 7fdedb3ff700 1 -- 172.21.15.71:0/2492411882 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdeb8066f30 msgr2=0x7fdeb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.442+0000 7fdedb3ff700 1 --2- 172.21.15.71:0/2492411882 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdeb8066f30 0x7fdeb80693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdec40091e0 tx=0x7fdec4017000 comp rx=0 tx=0).stop 2023-10-09T08:18:04.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.442+0000 7fdedb3ff700 1 -- 172.21.15.71:0/2492411882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fded40ae680 msgr2=0x7fded414d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.442+0000 7fdedb3ff700 1 --2- 172.21.15.71:0/2492411882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fded40ae680 0x7fded414d140 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fded000d860 tx=0x7fded0008040 comp rx=0 tx=0).stop 2023-10-09T08:18:04.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.442+0000 7fdedb3ff700 1 -- 172.21.15.71:0/2492411882 shutdown_connections 2023-10-09T08:18:04.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.442+0000 7fdedb3ff700 1 --2- 172.21.15.71:0/2492411882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fded40b1850 0x7fded406dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.442+0000 7fdedb3ff700 1 --2- 172.21.15.71:0/2492411882 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdeb8066f30 0x7fdeb80693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.442+0000 7fdedb3ff700 1 --2- 172.21.15.71:0/2492411882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fded40ae680 0x7fded414d140 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.442+0000 7fdedb3ff700 1 --2- 172.21.15.71:0/2492411882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fded40aead0 0x7fded414e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.442+0000 7fdedb3ff700 1 -- 172.21.15.71:0/2492411882 >> 172.21.15.71:0/2492411882 conn(0x7fded406a320 msgr2=0x7fded40abf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:04.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.442+0000 7fdedb3ff700 1 -- 172.21.15.71:0/2492411882 shutdown_connections 2023-10-09T08:18:04.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.442+0000 7fdedb3ff700 1 -- 172.21.15.71:0/2492411882 wait complete. 2023-10-09T08:18:04.444 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 4 to deep-scrub 2023-10-09T08:18:04.460 INFO:tasks.ceph:Scrubbing osd.5 2023-10-09T08:18:04.461 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-09T08:18:04.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.644+0000 7f07cddff700 1 Processor -- start 2023-10-09T08:18:04.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.644+0000 7f07cddff700 1 -- start start 2023-10-09T08:18:04.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.646+0000 7f07cddff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07c81563b0 0x7f07c8156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.646+0000 7f07cddff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f07c815a440 0x7f07c80acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.646+0000 7f07cddff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c815a9b0 con 0x7f07c8068890 2023-10-09T08:18:04.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.646+0000 7f07cddff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c815ac90 con 0x7f07c815a440 2023-10-09T08:18:04.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.646+0000 7f07cddff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c815af70 con 0x7f07c81563b0 2023-10-09T08:18:04.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.646+0000 7f07bffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f07c815a440 0x7f07c80acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.646+0000 7f07bffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f07c815a440 0x7f07c80acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40318/0 (socket says 172.21.15.71:40318) 2023-10-09T08:18:04.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.646+0000 7f07bffff700 1 -- 172.21.15.71:0/3299272601 learned_addr learned my addr 172.21.15.71:0/3299272601 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:04.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.646+0000 7f07c77fe700 1 --2- 172.21.15.71:0/3299272601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07c81563b0 0x7f07c8156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.646+0000 7f07bffff700 1 -- 172.21.15.71:0/3299272601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07c81563b0 msgr2=0x7f07c8156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:04.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.646+0000 7f07bffff700 1 --2- 172.21.15.71:0/3299272601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07c81563b0 0x7f07c8156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.646+0000 7f07bffff700 1 -- 172.21.15.71:0/3299272601 >> v1:172.21.15.179:6789/0 conn(0x7f07c8068890 legacy=0x7f07c80c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:04.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.646+0000 7f07bffff700 1 -- 172.21.15.71:0/3299272601 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c815b250 con 0x7f07c815a440 2023-10-09T08:18:04.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.647+0000 7f07bffff700 1 --2- 172.21.15.71:0/3299272601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c815a440 0x7f07c80acf30 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f07b00099b0 tx=0x7f07b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=173ca14cbe1160bf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:04.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.647+0000 7f07c6ffd700 1 -- 172.21.15.71:0/3299272601 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b000b820 con 0x7f07c815a440 2023-10-09T08:18:04.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.647+0000 7f07c6ffd700 1 -- 172.21.15.71:0/3299272601 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b000b980 con 0x7f07c815a440 2023-10-09T08:18:04.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.647+0000 7f07c6ffd700 1 -- 172.21.15.71:0/3299272601 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b000bd20 con 0x7f07c815a440 2023-10-09T08:18:04.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.647+0000 7f07cddff700 1 -- 172.21.15.71:0/3299272601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c815a440 msgr2=0x7f07c80acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.647+0000 7f07cddff700 1 --2- 172.21.15.71:0/3299272601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c815a440 0x7f07c80acf30 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f07b00099b0 tx=0x7f07b0009250 comp rx=0 tx=0).stop 2023-10-09T08:18:04.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.648+0000 7f07cddff700 1 -- 172.21.15.71:0/3299272601 shutdown_connections 2023-10-09T08:18:04.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.648+0000 7f07cddff700 1 --2- 172.21.15.71:0/3299272601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07c81563b0 0x7f07c8156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.648+0000 7f07cddff700 1 --2- 172.21.15.71:0/3299272601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c815a440 0x7f07c80acf30 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.648+0000 7f07cddff700 1 -- 172.21.15.71:0/3299272601 >> 172.21.15.71:0/3299272601 conn(0x7f07c80c8f90 msgr2=0x7f07c80c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:04.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.648+0000 7f07cddff700 1 -- 172.21.15.71:0/3299272601 shutdown_connections 2023-10-09T08:18:04.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.648+0000 7f07cddff700 1 -- 172.21.15.71:0/3299272601 wait complete. 2023-10-09T08:18:04.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.649+0000 7f07cddff700 1 Processor -- start 2023-10-09T08:18:04.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.649+0000 7f07cddff700 1 -- start start 2023-10-09T08:18:04.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.650+0000 7f07cddff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07c8068890 0x7f07c8149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.650+0000 7f07cddff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c81563b0 0x7f07c8159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.650+0000 7f07cddff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07c815a440 0x7f07c80c1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.650+0000 7f07cddff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c806a410 con 0x7f07c81563b0 2023-10-09T08:18:04.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.650+0000 7f07cddff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c814a050 con 0x7f07c815a440 2023-10-09T08:18:04.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.650+0000 7f07cddff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c8157800 con 0x7f07c8068890 2023-10-09T08:18:04.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.650+0000 7f07bffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c81563b0 0x7f07c8159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.651+0000 7f07bffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c81563b0 0x7f07c8159530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40320/0 (socket says 172.21.15.71:40320) 2023-10-09T08:18:04.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.651+0000 7f07bffff700 1 -- 172.21.15.71:0/2478665093 learned_addr learned my addr 172.21.15.71:0/2478665093 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:04.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.651+0000 7f07c77fe700 1 --2- 172.21.15.71:0/2478665093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07c8068890 0x7f07c8149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.651+0000 7f07c7fff700 1 --2- 172.21.15.71:0/2478665093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07c815a440 0x7f07c80c1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.651+0000 7f07bffff700 1 -- 172.21.15.71:0/2478665093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07c8068890 msgr2=0x7f07c8149b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.651+0000 7f07bffff700 1 --2- 172.21.15.71:0/2478665093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07c8068890 0x7f07c8149b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.651+0000 7f07bffff700 1 -- 172.21.15.71:0/2478665093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07c815a440 msgr2=0x7f07c80c1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.651+0000 7f07bffff700 1 --2- 172.21.15.71:0/2478665093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07c815a440 0x7f07c80c1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.651+0000 7f07bffff700 1 -- 172.21.15.71:0/2478665093 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b00094f0 con 0x7f07c81563b0 2023-10-09T08:18:04.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.651+0000 7f07c7fff700 1 --2- 172.21.15.71:0/2478665093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07c815a440 0x7f07c80c1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:18:04.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.651+0000 7f07bffff700 1 --2- 172.21.15.71:0/2478665093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c81563b0 0x7f07c8159530 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f07c806bbb0 tx=0x7f07b0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:04.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.651+0000 7f07bf7fe700 1 -- 172.21.15.71:0/2478665093 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0011bb0 con 0x7f07c81563b0 2023-10-09T08:18:04.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.651+0000 7f07bf7fe700 1 -- 172.21.15.71:0/2478665093 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b0020070 con 0x7f07c81563b0 2023-10-09T08:18:04.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.651+0000 7f07bf7fe700 1 -- 172.21.15.71:0/2478665093 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b001b450 con 0x7f07c81563b0 2023-10-09T08:18:04.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.651+0000 7f07cddff700 1 -- 172.21.15.71:0/2478665093 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c80cb820 con 0x7f07c81563b0 2023-10-09T08:18:04.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.652+0000 7f07cddff700 1 -- 172.21.15.71:0/2478665093 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c80cbde0 con 0x7f07c81563b0 2023-10-09T08:18:04.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.652+0000 7f07cddff700 1 -- 172.21.15.71:0/2478665093 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f07c80718b0 con 0x7f07c81563b0 2023-10-09T08:18:04.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.653+0000 7f07bf7fe700 1 -- 172.21.15.71:0/2478665093 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f07b0022030 con 0x7f07c81563b0 2023-10-09T08:18:04.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.654+0000 7f07bf7fe700 1 --2- 172.21.15.71:0/2478665093 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f07a8066f30 0x7f07a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.654+0000 7f07bf7fe700 1 -- 172.21.15.71:0/2478665093 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f07b0086330 con 0x7f07c81563b0 2023-10-09T08:18:04.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.654+0000 7f07bf7fe700 1 --2- 172.21.15.71:0/2478665093 >> [v2:172.21.15.179:6816/86054,v1:172.21.15.179:6817/86054] conn(0x7f07a806d6d0 0x7f07a806fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.654+0000 7f07bf7fe700 1 -- 172.21.15.71:0/2478665093 --> [v2:172.21.15.179:6816/86054,v1:172.21.15.179:6817/86054] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f07a8070170 con 0x7f07a806d6d0 2023-10-09T08:18:04.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.654+0000 7f07bf7fe700 1 -- 172.21.15.71:0/2478665093 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=215) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07b0086700 con 0x7f07c81563b0 2023-10-09T08:18:04.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.655+0000 7f07c77fe700 1 --2- 172.21.15.71:0/2478665093 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f07a8066f30 0x7f07a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.655+0000 7f07c7fff700 1 --2- 172.21.15.71:0/2478665093 >> [v2:172.21.15.179:6816/86054,v1:172.21.15.179:6817/86054] conn(0x7f07a806d6d0 0x7f07a806fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.655+0000 7f07c77fe700 1 --2- 172.21.15.71:0/2478665093 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f07a8066f30 0x7f07a80693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f07b8006fd0 tx=0x7f07b8008040 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:04.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.655+0000 7f07c7fff700 1 --2- 172.21.15.71:0/2478665093 >> [v2:172.21.15.179:6816/86054,v1:172.21.15.179:6817/86054] conn(0x7f07a806d6d0 0x7f07a806fb40 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:04.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.656+0000 7f07bf7fe700 1 -- 172.21.15.71:0/2478665093 <== osd.5 v2:172.21.15.179:6816/86054 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f07a8070170 con 0x7f07a806d6d0 2023-10-09T08:18:04.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.670+0000 7f07cddff700 1 -- 172.21.15.71:0/2478665093 --> [v2:172.21.15.179:6816/86054,v1:172.21.15.179:6817/86054] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f07c806d6a0 con 0x7f07a806d6d0 2023-10-09T08:18:04.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.671+0000 7f07bf7fe700 1 -- 172.21.15.71:0/2478665093 <== osd.5 v2:172.21.15.179:6816/86054 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f07c806d6a0 con 0x7f07a806d6d0 2023-10-09T08:18:04.672 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T08:18:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T08:18:04.672 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T08:18:04.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.671+0000 7f07cddff700 1 -- 172.21.15.71:0/2478665093 >> [v2:172.21.15.179:6816/86054,v1:172.21.15.179:6817/86054] conn(0x7f07a806d6d0 msgr2=0x7f07a806fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.671+0000 7f07cddff700 1 --2- 172.21.15.71:0/2478665093 >> [v2:172.21.15.179:6816/86054,v1:172.21.15.179:6817/86054] conn(0x7f07a806d6d0 0x7f07a806fb40 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.672+0000 7f07cddff700 1 -- 172.21.15.71:0/2478665093 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f07a8066f30 msgr2=0x7f07a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.672+0000 7f07cddff700 1 --2- 172.21.15.71:0/2478665093 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f07a8066f30 0x7f07a80693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f07b8006fd0 tx=0x7f07b8008040 comp rx=0 tx=0).stop 2023-10-09T08:18:04.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.672+0000 7f07cddff700 1 -- 172.21.15.71:0/2478665093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c81563b0 msgr2=0x7f07c8159530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.672+0000 7f07cddff700 1 --2- 172.21.15.71:0/2478665093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07c81563b0 0x7f07c8159530 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f07c806bbb0 tx=0x7f07b0016000 comp rx=0 tx=0).stop 2023-10-09T08:18:04.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.672+0000 7f07c7fff700 1 -- 172.21.15.71:0/2478665093 reap_dead start 2023-10-09T08:18:04.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.672+0000 7f07cddff700 1 -- 172.21.15.71:0/2478665093 shutdown_connections 2023-10-09T08:18:04.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.672+0000 7f07cddff700 1 -- 172.21.15.71:0/2478665093 >> 172.21.15.71:0/2478665093 conn(0x7f07c80c8f90 msgr2=0x7f07c8068c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:04.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.672+0000 7f07cddff700 1 -- 172.21.15.71:0/2478665093 shutdown_connections 2023-10-09T08:18:04.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.672+0000 7f07cddff700 1 -- 172.21.15.71:0/2478665093 wait complete. 2023-10-09T08:18:04.689 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-09T08:18:04.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.868+0000 7fdba4f9d700 1 Processor -- start 2023-10-09T08:18:04.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.869+0000 7fdba4f9d700 1 -- start start 2023-10-09T08:18:04.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.870+0000 7fdba4f9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdba0150550 0x7fdba0157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.870+0000 7fdba4f9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba006e2a0 con 0x7fdba00c7410 2023-10-09T08:18:04.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.870+0000 7fdba4f9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba006b2e0 con 0x7fdba0150180 2023-10-09T08:18:04.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.870+0000 7fdba4f9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba00c78e0 con 0x7fdba0150550 2023-10-09T08:18:04.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.870+0000 7fdb9ffff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fdba00c7410 0x7fdba0069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44020/0 (socket says 172.21.15.71:44020) 2023-10-09T08:18:04.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.870+0000 7fdb9ffff700 1 -- 172.21.15.71:0/3086175518 learned_addr learned my addr 172.21.15.71:0/3086175518 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:18:04.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.870+0000 7fdb97fff700 1 --2- 172.21.15.71:0/3086175518 >> v2:172.21.15.179:3300/0 conn(0x7fdba0150550 0x7fdba0157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.871+0000 7fdb9effd700 1 -- 172.21.15.71:0/3086175518 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227366115 0 0) 0x7fdba006e2a0 con 0x7fdba00c7410 2023-10-09T08:18:04.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.871+0000 7fdb9effd700 1 -- 172.21.15.71:0/3086175518 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb8c003570 con 0x7fdba00c7410 2023-10-09T08:18:04.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.871+0000 7fdb9effd700 1 -- 172.21.15.71:0/3086175518 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917649513 0 0) 0x7fdba006b2e0 con 0x7fdba0150180 2023-10-09T08:18:04.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.871+0000 7fdb9effd700 1 -- 172.21.15.71:0/3086175518 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdba006e2a0 con 0x7fdba0150180 2023-10-09T08:18:04.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.871+0000 7fdb9effd700 1 -- 172.21.15.71:0/3086175518 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1372846019 0 0) 0x7fdb8c003570 con 0x7fdba00c7410 2023-10-09T08:18:04.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.871+0000 7fdb9effd700 1 -- 172.21.15.71:0/3086175518 >> v2:172.21.15.179:3300/0 conn(0x7fdba0150550 msgr2=0x7fdba0157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:04.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.871+0000 7fdb9effd700 1 --2- 172.21.15.71:0/3086175518 >> v2:172.21.15.179:3300/0 conn(0x7fdba0150550 0x7fdba0157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.871+0000 7fdb9effd700 1 -- 172.21.15.71:0/3086175518 >> v1:172.21.15.179:6789/0 conn(0x7fdba0150180 legacy=0x7fdba00c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.871+0000 7fdb9effd700 1 -- 172.21.15.71:0/3086175518 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba00c7bc0 con 0x7fdba00c7410 2023-10-09T08:18:04.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.871+0000 7fdb9effd700 1 -- 172.21.15.71:0/3086175518 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7fdb980017f0 con 0x7fdba00c7410 2023-10-09T08:18:04.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.871+0000 7fdb9effd700 1 -- 172.21.15.71:0/3086175518 >> v1:172.21.15.71:6789/0 conn(0x7fdba00c7410 legacy=0x7fdba0069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.871+0000 7fdb9effd700 1 --2- 172.21.15.71:0/3086175518 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb8c003c40 0x7fdb8c004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.871+0000 7fdb9effd700 1 --2- 172.21.15.71:0/3086175518 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb8c004810 0x7fdb8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.871+0000 7fdb9effd700 1 --2- 172.21.15.71:0/3086175518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb8c005210 0x7fdb8c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.871+0000 7fdb9effd700 1 -- 172.21.15.71:0/3086175518 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba00c78e0 con 0x7fdb8c005210 2023-10-09T08:18:04.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.871+0000 7fdb9effd700 1 -- 172.21.15.71:0/3086175518 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c00c130 con 0x7fdb8c003c40 2023-10-09T08:18:04.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.871+0000 7fdb9effd700 1 -- 172.21.15.71:0/3086175518 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c00c2c0 con 0x7fdb8c004810 2023-10-09T08:18:04.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.871+0000 7fdb9ffff700 1 --2- 172.21.15.71:0/3086175518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb8c005210 0x7fdb8c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.872+0000 7fdb97fff700 1 --2- 172.21.15.71:0/3086175518 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb8c004810 0x7fdb8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.872+0000 7fdb9f7fe700 1 --2- 172.21.15.71:0/3086175518 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb8c003c40 0x7fdb8c004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.872+0000 7fdb9ffff700 1 -- 172.21.15.71:0/3086175518 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb8c004810 msgr2=0x7fdb8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:04.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.872+0000 7fdb9ffff700 1 --2- 172.21.15.71:0/3086175518 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb8c004810 0x7fdb8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.872+0000 7fdb9ffff700 1 -- 172.21.15.71:0/3086175518 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb8c003c40 msgr2=0x7fdb8c004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:04.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.872+0000 7fdb9ffff700 1 --2- 172.21.15.71:0/3086175518 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb8c003c40 0x7fdb8c004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.872+0000 7fdb9ffff700 1 -- 172.21.15.71:0/3086175518 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb8c003570 con 0x7fdb8c005210 2023-10-09T08:18:04.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.872+0000 7fdb9ffff700 1 -- 172.21.15.71:0/3086175518 reap_dead start 2023-10-09T08:18:04.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.872+0000 7fdb9ffff700 1 --2- 172.21.15.71:0/3086175518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb8c005210 0x7fdb8c00ba60 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800a800 tx=0x7fdb980020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d73ce78a622ae60 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:04.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.872+0000 7fdb9effd700 1 -- 172.21.15.71:0/3086175518 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb980071a0 con 0x7fdb8c005210 2023-10-09T08:18:04.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.872+0000 7fdb9effd700 1 -- 172.21.15.71:0/3086175518 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb98007300 con 0x7fdb8c005210 2023-10-09T08:18:04.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.872+0000 7fdb9effd700 1 -- 172.21.15.71:0/3086175518 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb980076c0 con 0x7fdb8c005210 2023-10-09T08:18:04.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.873+0000 7fdba4f9d700 1 -- 172.21.15.71:0/3086175518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb8c005210 msgr2=0x7fdb8c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.873+0000 7fdba4f9d700 1 --2- 172.21.15.71:0/3086175518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb8c005210 0x7fdb8c00ba60 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800a800 tx=0x7fdb980020c0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.873+0000 7fdba4f9d700 1 -- 172.21.15.71:0/3086175518 shutdown_connections 2023-10-09T08:18:04.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.873+0000 7fdba4f9d700 1 --2- 172.21.15.71:0/3086175518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb8c005210 0x7fdb8c00ba60 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.873+0000 7fdba4f9d700 1 -- 172.21.15.71:0/3086175518 >> 172.21.15.71:0/3086175518 conn(0x7fdba00cc1f0 msgr2=0x7fdba00cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:04.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.873+0000 7fdba4f9d700 1 -- 172.21.15.71:0/3086175518 shutdown_connections 2023-10-09T08:18:04.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.873+0000 7fdba4f9d700 1 -- 172.21.15.71:0/3086175518 wait complete. 2023-10-09T08:18:04.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.875+0000 7fdba4f9d700 1 Processor -- start 2023-10-09T08:18:04.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.875+0000 7fdba4f9d700 1 -- start start 2023-10-09T08:18:04.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.876+0000 7fdba4f9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb8c005210 0x7fdba013fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.876+0000 7fdba4f9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdba00aa660 0x7fdba00ad120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.876+0000 7fdba4f9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdba00ad660 0x7fdba00abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.876+0000 7fdba4f9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba0159640 con 0x7fdb8c005210 2023-10-09T08:18:04.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.876+0000 7fdba4f9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba015a5f0 con 0x7fdba00ad660 2023-10-09T08:18:04.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.876+0000 7fdba4f9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba00adad0 con 0x7fdba00aa660 2023-10-09T08:18:04.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.876+0000 7fdb9f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb8c005210 0x7fdba013fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.876+0000 7fdb9f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb8c005210 0x7fdba013fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40350/0 (socket says 172.21.15.71:40350) 2023-10-09T08:18:04.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.876+0000 7fdb9f7fe700 1 -- 172.21.15.71:0/2876718226 learned_addr learned my addr 172.21.15.71:0/2876718226 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:04.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.876+0000 7fdb97fff700 1 --2- 172.21.15.71:0/2876718226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdba00aa660 0x7fdba00ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.876+0000 7fdb9ffff700 1 --2- 172.21.15.71:0/2876718226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdba00ad660 0x7fdba00abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.876+0000 7fdb9f7fe700 1 -- 172.21.15.71:0/2876718226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdba00aa660 msgr2=0x7fdba00ad120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.876+0000 7fdb9f7fe700 1 --2- 172.21.15.71:0/2876718226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdba00aa660 0x7fdba00ad120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.876+0000 7fdb9f7fe700 1 -- 172.21.15.71:0/2876718226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdba00ad660 msgr2=0x7fdba00abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:04.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.876+0000 7fdb9f7fe700 1 --2- 172.21.15.71:0/2876718226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdba00ad660 0x7fdba00abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:04.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.876+0000 7fdb9f7fe700 1 -- 172.21.15.71:0/2876718226 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba015a160 con 0x7fdb8c005210 2023-10-09T08:18:04.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.877+0000 7fdb9f7fe700 1 --2- 172.21.15.71:0/2876718226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb8c005210 0x7fdba013fa30 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fdb90002bb0 tx=0x7fdb90007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:04.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.877+0000 7fdb977fe700 1 -- 172.21.15.71:0/2876718226 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9000f9f0 con 0x7fdb8c005210 2023-10-09T08:18:04.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.877+0000 7fdb977fe700 1 -- 172.21.15.71:0/2876718226 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9000fb70 con 0x7fdb8c005210 2023-10-09T08:18:04.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.877+0000 7fdba4f9d700 1 -- 172.21.15.71:0/2876718226 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba0159830 con 0x7fdb8c005210 2023-10-09T08:18:04.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.877+0000 7fdb977fe700 1 -- 172.21.15.71:0/2876718226 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb90006820 con 0x7fdb8c005210 2023-10-09T08:18:04.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.877+0000 7fdba4f9d700 1 -- 172.21.15.71:0/2876718226 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba0159df0 con 0x7fdb8c005210 2023-10-09T08:18:04.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.878+0000 7fdba4f9d700 1 -- 172.21.15.71:0/2876718226 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba004c3c0 con 0x7fdb8c005210 2023-10-09T08:18:04.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.879+0000 7fdb977fe700 1 -- 172.21.15.71:0/2876718226 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb90006bd0 con 0x7fdb8c005210 2023-10-09T08:18:04.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.880+0000 7fdb977fe700 1 --2- 172.21.15.71:0/2876718226 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdb80066f30 0x7fdb800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:04.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.880+0000 7fdb977fe700 1 -- 172.21.15.71:0/2876718226 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7fdb90084b80 con 0x7fdb8c005210 2023-10-09T08:18:04.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.880+0000 7fdb97fff700 1 --2- 172.21.15.71:0/2876718226 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdb80066f30 0x7fdb800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:04.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.881+0000 7fdb97fff700 1 --2- 172.21.15.71:0/2876718226 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdb80066f30 0x7fdb800693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdba006f7e0 tx=0x7fdb88008040 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:04.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:04.884+0000 7fdb977fe700 1 -- 172.21.15.71:0/2876718226 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb90051c10 con 0x7fdb8c005210 2023-10-09T08:18:05.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.076+0000 7fdba4f9d700 1 -- 172.21.15.71:0/2876718226 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fdba006ada0 con 0x7fdb80066f30 2023-10-09T08:18:05.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.077+0000 7fdb977fe700 1 -- 172.21.15.71:0/2876718226 <== mgr.9898 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdba006ada0 con 0x7fdb80066f30 2023-10-09T08:18:05.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.079+0000 7fdba4f9d700 1 -- 172.21.15.71:0/2876718226 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdb80066f30 msgr2=0x7fdb800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:05.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.079+0000 7fdba4f9d700 1 --2- 172.21.15.71:0/2876718226 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdb80066f30 0x7fdb800693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdba006f7e0 tx=0x7fdb88008040 comp rx=0 tx=0).stop 2023-10-09T08:18:05.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.079+0000 7fdba4f9d700 1 -- 172.21.15.71:0/2876718226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb8c005210 msgr2=0x7fdba013fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:05.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.079+0000 7fdba4f9d700 1 --2- 172.21.15.71:0/2876718226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb8c005210 0x7fdba013fa30 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fdb90002bb0 tx=0x7fdb90007d30 comp rx=0 tx=0).stop 2023-10-09T08:18:05.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.079+0000 7fdba4f9d700 1 -- 172.21.15.71:0/2876718226 shutdown_connections 2023-10-09T08:18:05.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.079+0000 7fdba4f9d700 1 --2- 172.21.15.71:0/2876718226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdba00ad660 0x7fdba00abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.079+0000 7fdba4f9d700 1 --2- 172.21.15.71:0/2876718226 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7fdb80066f30 0x7fdb800693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.079+0000 7fdba4f9d700 1 --2- 172.21.15.71:0/2876718226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb8c005210 0x7fdba013fa30 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.079+0000 7fdba4f9d700 1 --2- 172.21.15.71:0/2876718226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdba00aa660 0x7fdba00ad120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.079+0000 7fdba4f9d700 1 -- 172.21.15.71:0/2876718226 >> 172.21.15.71:0/2876718226 conn(0x7fdba00cc1f0 msgr2=0x7fdba014f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:05.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.079+0000 7fdba4f9d700 1 -- 172.21.15.71:0/2876718226 shutdown_connections 2023-10-09T08:18:05.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.079+0000 7fdba4f9d700 1 -- 172.21.15.71:0/2876718226 wait complete. 2023-10-09T08:18:05.083 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 5 to deep-scrub 2023-10-09T08:18:05.097 INFO:tasks.ceph:Scrubbing osd.6 2023-10-09T08:18:05.098 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-09T08:18:05.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.284+0000 7ff54f19d700 1 Processor -- start 2023-10-09T08:18:05.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.284+0000 7ff54f19d700 1 -- start start 2023-10-09T08:18:05.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.285+0000 7ff54f19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5480b0790 0x7ff5480cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:05.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.285+0000 7ff54f19d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff5481591e0 0x7ff548159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:05.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.285+0000 7ff54f19d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5480cfa00 con 0x7ff5480b03c0 2023-10-09T08:18:05.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.285+0000 7ff54f19d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5480cb580 con 0x7ff5481591e0 2023-10-09T08:18:05.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.285+0000 7ff54f19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480cf160 con 0x7ff5480b0790 2023-10-09T08:18:05.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.285+0000 7ff54e99c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff5481591e0 0x7ff548159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:05.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.285+0000 7ff54e19b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff5480b03c0 0x7ff5480b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59880/0 (socket says 172.21.15.71:59880) 2023-10-09T08:18:05.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.285+0000 7ff54e19b700 1 -- 172.21.15.71:0/3328951219 learned_addr learned my addr 172.21.15.71:0/3328951219 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:18:05.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.286+0000 7ff54d99a700 1 --2- 172.21.15.71:0/3328951219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5480b0790 0x7ff5480cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:05.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.286+0000 7ff54e99c700 1 -- 172.21.15.71:0/3328951219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5480b0790 msgr2=0x7ff5480cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:05.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.286+0000 7ff54e99c700 1 --2- 172.21.15.71:0/3328951219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5480b0790 0x7ff5480cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.286+0000 7ff54e99c700 1 -- 172.21.15.71:0/3328951219 >> v1:172.21.15.71:6789/0 conn(0x7ff5480b03c0 legacy=0x7ff5480b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:05.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.286+0000 7ff54e99c700 1 -- 172.21.15.71:0/3328951219 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5480cf440 con 0x7ff5481591e0 2023-10-09T08:18:05.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.286+0000 7ff54d199700 1 -- 172.21.15.71:0/3328951219 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809872485 0 0) 0x7ff5480cfa00 con 0x7ff5480b03c0 2023-10-09T08:18:05.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.286+0000 7ff54e99c700 1 --2- 172.21.15.71:0/3328951219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5481591e0 0x7ff548159620 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7ff540009e60 tx=0x7ff540009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4456f2e83faab3a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:05.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.286+0000 7ff54d199700 1 -- 172.21.15.71:0/3328951219 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54000e070 con 0x7ff5481591e0 2023-10-09T08:18:05.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.286+0000 7ff54d199700 1 -- 172.21.15.71:0/3328951219 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54000bc30 con 0x7ff5481591e0 2023-10-09T08:18:05.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.286+0000 7ff54d199700 1 -- 172.21.15.71:0/3328951219 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff540012430 con 0x7ff5481591e0 2023-10-09T08:18:05.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.287+0000 7ff54f19d700 1 -- 172.21.15.71:0/3328951219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5481591e0 msgr2=0x7ff548159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:05.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.287+0000 7ff54f19d700 1 --2- 172.21.15.71:0/3328951219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5481591e0 0x7ff548159620 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7ff540009e60 tx=0x7ff540009780 comp rx=0 tx=0).stop 2023-10-09T08:18:05.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.287+0000 7ff54f19d700 1 -- 172.21.15.71:0/3328951219 shutdown_connections 2023-10-09T08:18:05.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.287+0000 7ff54f19d700 1 --2- 172.21.15.71:0/3328951219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5481591e0 0x7ff548159620 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.287+0000 7ff54f19d700 1 --2- 172.21.15.71:0/3328951219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5480b0790 0x7ff5480cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.287+0000 7ff54f19d700 1 -- 172.21.15.71:0/3328951219 >> 172.21.15.71:0/3328951219 conn(0x7ff548063230 msgr2=0x7ff548063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:05.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.287+0000 7ff54f19d700 1 -- 172.21.15.71:0/3328951219 shutdown_connections 2023-10-09T08:18:05.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.287+0000 7ff54f19d700 1 -- 172.21.15.71:0/3328951219 wait complete. 2023-10-09T08:18:05.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.289+0000 7ff54f19d700 1 Processor -- start 2023-10-09T08:18:05.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.289+0000 7ff54f19d700 1 -- start start 2023-10-09T08:18:05.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.290+0000 7ff54f19d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5480b03c0 0x7ff548156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:05.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.290+0000 7ff54f19d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5480b0790 0x7ff5480c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:05.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.290+0000 7ff54f19d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5481591e0 0x7ff5481595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:05.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.290+0000 7ff54f19d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480c7c30 con 0x7ff5480b0790 2023-10-09T08:18:05.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.290+0000 7ff54f19d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480c7f10 con 0x7ff5480b03c0 2023-10-09T08:18:05.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.290+0000 7ff54f19d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480c81f0 con 0x7ff5481591e0 2023-10-09T08:18:05.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.290+0000 7ff54d99a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5480b0790 0x7ff5480c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:05.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.290+0000 7ff54d99a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5480b0790 0x7ff5480c75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40310/0 (socket says 172.21.15.71:40310) 2023-10-09T08:18:05.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.290+0000 7ff54d99a700 1 -- 172.21.15.71:0/2297729745 learned_addr learned my addr 172.21.15.71:0/2297729745 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:05.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.290+0000 7ff54e19b700 1 --2- 172.21.15.71:0/2297729745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5480b03c0 0x7ff548156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:05.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.290+0000 7ff54e99c700 1 --2- 172.21.15.71:0/2297729745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5481591e0 0x7ff5481595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:05.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.290+0000 7ff54d99a700 1 -- 172.21.15.71:0/2297729745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5481591e0 msgr2=0x7ff5481595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:05.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.290+0000 7ff54d99a700 1 --2- 172.21.15.71:0/2297729745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5481591e0 0x7ff5481595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.290+0000 7ff54d99a700 1 -- 172.21.15.71:0/2297729745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5480b03c0 msgr2=0x7ff548156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:05.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.290+0000 7ff54d99a700 1 --2- 172.21.15.71:0/2297729745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5480b03c0 0x7ff548156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.290+0000 7ff54d99a700 1 -- 172.21.15.71:0/2297729745 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff540009a20 con 0x7ff5480b0790 2023-10-09T08:18:05.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.290+0000 7ff54e19b700 1 --2- 172.21.15.71:0/2297729745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5480b03c0 0x7ff548156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:18:05.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.291+0000 7ff54d99a700 1 --2- 172.21.15.71:0/2297729745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5480b0790 0x7ff5480c75a0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7ff53800d890 tx=0x7ff538008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:05.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.291+0000 7ff53e7fc700 1 -- 172.21.15.71:0/2297729745 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53800b600 con 0x7ff5480b0790 2023-10-09T08:18:05.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.291+0000 7ff53e7fc700 1 -- 172.21.15.71:0/2297729745 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53800b760 con 0x7ff5480b0790 2023-10-09T08:18:05.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.291+0000 7ff53e7fc700 1 -- 172.21.15.71:0/2297729745 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53800bae0 con 0x7ff5480b0790 2023-10-09T08:18:05.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.291+0000 7ff54f19d700 1 -- 172.21.15.71:0/2297729745 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5480c84d0 con 0x7ff5480b0790 2023-10-09T08:18:05.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.291+0000 7ff54f19d700 1 -- 172.21.15.71:0/2297729745 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5480c9450 con 0x7ff5480b0790 2023-10-09T08:18:05.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.292+0000 7ff54f19d700 1 -- 172.21.15.71:0/2297729745 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff54804c3c0 con 0x7ff5480b0790 2023-10-09T08:18:05.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.293+0000 7ff53e7fc700 1 -- 172.21.15.71:0/2297729745 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff53801e460 con 0x7ff5480b0790 2023-10-09T08:18:05.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.293+0000 7ff53e7fc700 1 --2- 172.21.15.71:0/2297729745 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff52c066f30 0x7ff52c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:05.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.294+0000 7ff53e7fc700 1 -- 172.21.15.71:0/2297729745 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7ff538084dc0 con 0x7ff5480b0790 2023-10-09T08:18:05.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.294+0000 7ff53e7fc700 1 --2- 172.21.15.71:0/2297729745 >> [v2:172.21.15.179:6800/86042,v1:172.21.15.179:6801/86042] conn(0x7ff52c06d6d0 0x7ff52c06fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:05.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.294+0000 7ff53e7fc700 1 -- 172.21.15.71:0/2297729745 --> [v2:172.21.15.179:6800/86042,v1:172.21.15.179:6801/86042] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff52c070170 con 0x7ff52c06d6d0 2023-10-09T08:18:05.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.294+0000 7ff53e7fc700 1 -- 172.21.15.71:0/2297729745 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=215) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5380872c0 con 0x7ff5480b0790 2023-10-09T08:18:05.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.294+0000 7ff54e19b700 1 --2- 172.21.15.71:0/2297729745 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff52c066f30 0x7ff52c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:05.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.294+0000 7ff54e99c700 1 --2- 172.21.15.71:0/2297729745 >> [v2:172.21.15.179:6800/86042,v1:172.21.15.179:6801/86042] conn(0x7ff52c06d6d0 0x7ff52c06fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:05.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.295+0000 7ff54e99c700 1 --2- 172.21.15.71:0/2297729745 >> [v2:172.21.15.179:6800/86042,v1:172.21.15.179:6801/86042] conn(0x7ff52c06d6d0 0x7ff52c06fb40 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:05.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.295+0000 7ff54e19b700 1 --2- 172.21.15.71:0/2297729745 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff52c066f30 0x7ff52c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff544001810 tx=0x7ff544009040 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:05.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.296+0000 7ff53e7fc700 1 -- 172.21.15.71:0/2297729745 <== osd.6 v2:172.21.15.179:6800/86042 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ff52c070170 con 0x7ff52c06d6d0 2023-10-09T08:18:05.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.310+0000 7ff54f19d700 1 -- 172.21.15.71:0/2297729745 --> [v2:172.21.15.179:6800/86042,v1:172.21.15.179:6801/86042] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff5480cad50 con 0x7ff52c06d6d0 2023-10-09T08:18:05.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.311+0000 7ff53e7fc700 1 -- 172.21.15.71:0/2297729745 <== osd.6 v2:172.21.15.179:6800/86042 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff5480cad50 con 0x7ff52c06d6d0 2023-10-09T08:18:05.312 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T08:18:05.312 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T08:18:05.312 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T08:18:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.311+0000 7ff54f19d700 1 -- 172.21.15.71:0/2297729745 >> [v2:172.21.15.179:6800/86042,v1:172.21.15.179:6801/86042] conn(0x7ff52c06d6d0 msgr2=0x7ff52c06fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.311+0000 7ff54f19d700 1 --2- 172.21.15.71:0/2297729745 >> [v2:172.21.15.179:6800/86042,v1:172.21.15.179:6801/86042] conn(0x7ff52c06d6d0 0x7ff52c06fb40 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.311+0000 7ff54f19d700 1 -- 172.21.15.71:0/2297729745 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff52c066f30 msgr2=0x7ff52c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.311+0000 7ff54f19d700 1 --2- 172.21.15.71:0/2297729745 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff52c066f30 0x7ff52c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff544001810 tx=0x7ff544009040 comp rx=0 tx=0).stop 2023-10-09T08:18:05.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.311+0000 7ff54f19d700 1 -- 172.21.15.71:0/2297729745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5480b0790 msgr2=0x7ff5480c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:05.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.311+0000 7ff54f19d700 1 --2- 172.21.15.71:0/2297729745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5480b0790 0x7ff5480c75a0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7ff53800d890 tx=0x7ff538008040 comp rx=0 tx=0).stop 2023-10-09T08:18:05.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.311+0000 7ff54e99c700 1 -- 172.21.15.71:0/2297729745 reap_dead start 2023-10-09T08:18:05.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.311+0000 7ff54f19d700 1 -- 172.21.15.71:0/2297729745 shutdown_connections 2023-10-09T08:18:05.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.311+0000 7ff54f19d700 1 -- 172.21.15.71:0/2297729745 >> 172.21.15.71:0/2297729745 conn(0x7ff548063230 msgr2=0x7ff548069a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:05.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.311+0000 7ff54f19d700 1 -- 172.21.15.71:0/2297729745 shutdown_connections 2023-10-09T08:18:05.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.311+0000 7ff54f19d700 1 -- 172.21.15.71:0/2297729745 wait complete. 2023-10-09T08:18:05.330 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-09T08:18:05.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.511+0000 7f00aefff700 1 Processor -- start 2023-10-09T08:18:05.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.511+0000 7f00aefff700 1 -- start start 2023-10-09T08:18:05.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.512+0000 7f00aefff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00a80cbf30 0x7f00a80ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:05.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.513+0000 7f00aefff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f00a80b1420 0x7f00a80c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:05.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.513+0000 7f00aefff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a80cc300 con 0x7f00a80ccf90 2023-10-09T08:18:05.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.513+0000 7f00aefff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a8156bf0 con 0x7f00a80b1420 2023-10-09T08:18:05.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.513+0000 7f00aefff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a80ae950 con 0x7f00a80cbf30 2023-10-09T08:18:05.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.513+0000 7f00ad59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f00a80b1420 0x7f00a80c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:05.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.513+0000 7f00ad59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f00a80b1420 0x7f00a80c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40312/0 (socket says 172.21.15.71:40312) 2023-10-09T08:18:05.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.513+0000 7f00ad59c700 1 -- 172.21.15.71:0/206609634 learned_addr learned my addr 172.21.15.71:0/206609634 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:05.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.513+0000 7f00acd9b700 1 --2- 172.21.15.71:0/206609634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00a80cbf30 0x7f00a80ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:05.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.513+0000 7f00ad59c700 1 -- 172.21.15.71:0/206609634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00a80cbf30 msgr2=0x7f00a80ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:05.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.513+0000 7f00ad59c700 1 --2- 172.21.15.71:0/206609634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00a80cbf30 0x7f00a80ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.513+0000 7f00ad59c700 1 -- 172.21.15.71:0/206609634 >> v1:172.21.15.179:6789/0 conn(0x7f00a80ccf90 legacy=0x7f00a80b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:05.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.513+0000 7f00ad59c700 1 -- 172.21.15.71:0/206609634 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a80ad370 con 0x7f00a80b1420 2023-10-09T08:18:05.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.514+0000 7f00ad59c700 1 --2- 172.21.15.71:0/206609634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00a80b1420 0x7f00a80c9740 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f00a0009f50 tx=0x7f00a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f23eadd01c3f1b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:05.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.514+0000 7f00a77fe700 1 -- 172.21.15.71:0/206609634 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a000e070 con 0x7f00a80b1420 2023-10-09T08:18:05.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.514+0000 7f00a77fe700 1 -- 172.21.15.71:0/206609634 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a000b9c0 con 0x7f00a80b1420 2023-10-09T08:18:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.514+0000 7f00a77fe700 1 -- 172.21.15.71:0/206609634 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a00092e0 con 0x7f00a80b1420 2023-10-09T08:18:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.514+0000 7f00aefff700 1 -- 172.21.15.71:0/206609634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00a80b1420 msgr2=0x7f00a80c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.514+0000 7f00aefff700 1 --2- 172.21.15.71:0/206609634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00a80b1420 0x7f00a80c9740 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f00a0009f50 tx=0x7f00a0009840 comp rx=0 tx=0).stop 2023-10-09T08:18:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.514+0000 7f00aefff700 1 -- 172.21.15.71:0/206609634 shutdown_connections 2023-10-09T08:18:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.514+0000 7f00aefff700 1 --2- 172.21.15.71:0/206609634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00a80b1420 0x7f00a80c9740 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.514+0000 7f00aefff700 1 --2- 172.21.15.71:0/206609634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00a80cbf30 0x7f00a80ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.515+0000 7f00aefff700 1 -- 172.21.15.71:0/206609634 >> 172.21.15.71:0/206609634 conn(0x7f00a806a320 msgr2=0x7f00a80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.515+0000 7f00aefff700 1 -- 172.21.15.71:0/206609634 shutdown_connections 2023-10-09T08:18:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.515+0000 7f00aefff700 1 -- 172.21.15.71:0/206609634 wait complete. 2023-10-09T08:18:05.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.516+0000 7f00aefff700 1 Processor -- start 2023-10-09T08:18:05.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.516+0000 7f00aefff700 1 -- start start 2023-10-09T08:18:05.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.517+0000 7f00aefff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00a80b1420 0x7f00a8154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:05.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.517+0000 7f00aefff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00a80cbf30 0x7f00a80c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.517+0000 7f00aefff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00a80ccf90 0x7f00a8167c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.517+0000 7f00aefff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a81549d0 con 0x7f00a80ccf90 2023-10-09T08:18:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.517+0000 7f00aefff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a80c6240 con 0x7f00a80cbf30 2023-10-09T08:18:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.517+0000 7f00aefff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a80c7450 con 0x7f00a80b1420 2023-10-09T08:18:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.517+0000 7f00ad59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00a80ccf90 0x7f00a8167c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.517+0000 7f00ad59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00a80ccf90 0x7f00a8167c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40324/0 (socket says 172.21.15.71:40324) 2023-10-09T08:18:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.517+0000 7f00ad59c700 1 -- 172.21.15.71:0/2435277066 learned_addr learned my addr 172.21.15.71:0/2435277066 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.518+0000 7f00ad59c700 1 -- 172.21.15.71:0/2435277066 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00a80b1420 msgr2=0x7f00a8154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.518+0000 7f00acd9b700 1 --2- 172.21.15.71:0/2435277066 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00a80b1420 0x7f00a8154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.518+0000 7f00a7fff700 1 --2- 172.21.15.71:0/2435277066 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00a80cbf30 0x7f00a80c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.518+0000 7f00ad59c700 1 --2- 172.21.15.71:0/2435277066 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00a80b1420 0x7f00a8154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.518+0000 7f00ad59c700 1 -- 172.21.15.71:0/2435277066 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00a80cbf30 msgr2=0x7f00a80c5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.518+0000 7f00ad59c700 1 --2- 172.21.15.71:0/2435277066 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00a80cbf30 0x7f00a80c5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.518+0000 7f00ad59c700 1 -- 172.21.15.71:0/2435277066 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a0009ae0 con 0x7f00a80ccf90 2023-10-09T08:18:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.518+0000 7f00a7fff700 1 --2- 172.21.15.71:0/2435277066 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00a80cbf30 0x7f00a80c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:18:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.518+0000 7f00acd9b700 1 --2- 172.21.15.71:0/2435277066 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00a80b1420 0x7f00a8154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T08:18:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.518+0000 7f00ad59c700 1 --2- 172.21.15.71:0/2435277066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00a80ccf90 0x7f00a8167c40 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f00a0009880 tx=0x7f00a0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.518+0000 7f00a4ff9700 1 -- 172.21.15.71:0/2435277066 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0008d00 con 0x7f00a80ccf90 2023-10-09T08:18:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.518+0000 7f00a4ff9700 1 -- 172.21.15.71:0/2435277066 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a0008e60 con 0x7f00a80ccf90 2023-10-09T08:18:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.518+0000 7f00a4ff9700 1 -- 172.21.15.71:0/2435277066 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0026690 con 0x7f00a80ccf90 2023-10-09T08:18:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.518+0000 7f00aefff700 1 -- 172.21.15.71:0/2435277066 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a80c34c0 con 0x7f00a80ccf90 2023-10-09T08:18:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.518+0000 7f00aefff700 1 -- 172.21.15.71:0/2435277066 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a80c3a80 con 0x7f00a80ccf90 2023-10-09T08:18:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.519+0000 7f00aefff700 1 -- 172.21.15.71:0/2435277066 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a804c3c0 con 0x7f00a80ccf90 2023-10-09T08:18:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.520+0000 7f00a4ff9700 1 -- 172.21.15.71:0/2435277066 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00a0003040 con 0x7f00a80ccf90 2023-10-09T08:18:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.521+0000 7f00a4ff9700 1 --2- 172.21.15.71:0/2435277066 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f008c066f30 0x7f008c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.522+0000 7f00a4ff9700 1 -- 172.21.15.71:0/2435277066 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f00a0086600 con 0x7f00a80ccf90 2023-10-09T08:18:05.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.522+0000 7f00acd9b700 1 --2- 172.21.15.71:0/2435277066 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f008c066f30 0x7f008c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:05.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.523+0000 7f00acd9b700 1 --2- 172.21.15.71:0/2435277066 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f008c066f30 0x7f008c0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f009c006f00 tx=0x7f009c008040 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.526+0000 7f00a4ff9700 1 -- 172.21.15.71:0/2435277066 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00a0053730 con 0x7f00a80ccf90 2023-10-09T08:18:05.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.720+0000 7f00aefff700 1 -- 172.21.15.71:0/2435277066 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f00a80ad650 con 0x7f008c066f30 2023-10-09T08:18:05.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.721+0000 7f00a4ff9700 1 -- 172.21.15.71:0/2435277066 <== mgr.9898 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f00a80ad650 con 0x7f008c066f30 2023-10-09T08:18:05.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.723+0000 7f00aefff700 1 -- 172.21.15.71:0/2435277066 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f008c066f30 msgr2=0x7f008c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:05.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.723+0000 7f00aefff700 1 --2- 172.21.15.71:0/2435277066 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f008c066f30 0x7f008c0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f009c006f00 tx=0x7f009c008040 comp rx=0 tx=0).stop 2023-10-09T08:18:05.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.723+0000 7f00aefff700 1 -- 172.21.15.71:0/2435277066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00a80ccf90 msgr2=0x7f00a8167c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:05.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.723+0000 7f00aefff700 1 --2- 172.21.15.71:0/2435277066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00a80ccf90 0x7f00a8167c40 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f00a0009880 tx=0x7f00a0018000 comp rx=0 tx=0).stop 2023-10-09T08:18:05.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.723+0000 7f00aefff700 1 -- 172.21.15.71:0/2435277066 shutdown_connections 2023-10-09T08:18:05.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.723+0000 7f00aefff700 1 --2- 172.21.15.71:0/2435277066 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f008c066f30 0x7f008c0693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.723+0000 7f00aefff700 1 --2- 172.21.15.71:0/2435277066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00a80ccf90 0x7f00a8167c40 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.723+0000 7f00aefff700 1 --2- 172.21.15.71:0/2435277066 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00a80b1420 0x7f00a8154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.723+0000 7f00aefff700 1 --2- 172.21.15.71:0/2435277066 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00a80cbf30 0x7f00a80c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.723+0000 7f00aefff700 1 -- 172.21.15.71:0/2435277066 >> 172.21.15.71:0/2435277066 conn(0x7f00a806a320 msgr2=0x7f00a806daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:05.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.723+0000 7f00aefff700 1 -- 172.21.15.71:0/2435277066 shutdown_connections 2023-10-09T08:18:05.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.723+0000 7f00aefff700 1 -- 172.21.15.71:0/2435277066 wait complete. 2023-10-09T08:18:05.726 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 6 to deep-scrub 2023-10-09T08:18:05.742 INFO:tasks.ceph:Scrubbing osd.7 2023-10-09T08:18:05.742 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-09T08:18:05.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.925+0000 7f7b92dff700 1 Processor -- start 2023-10-09T08:18:05.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.926+0000 7f7b92dff700 1 -- start start 2023-10-09T08:18:05.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.927+0000 7f7b92dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b8c0b2100 0x7f7b8c068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:05.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.927+0000 7f7b92dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b8c0ae6d0 con 0x7f7b8c0688d0 2023-10-09T08:18:05.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.927+0000 7f7b92dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b8c06dc20 con 0x7f7b8c157740 2023-10-09T08:18:05.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.927+0000 7f7b92dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c0acc00 con 0x7f7b8c0b2100 2023-10-09T08:18:05.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.927+0000 7f7b9139c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f7b8c0688d0 0x7f7b8c06e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59884/0 (socket says 172.21.15.71:59884) 2023-10-09T08:18:05.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.927+0000 7f7b9139c700 1 -- 172.21.15.71:0/663593880 learned_addr learned my addr 172.21.15.71:0/663593880 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:18:05.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.927+0000 7f7b8bfff700 1 --2- 172.21.15.71:0/663593880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b8c0b2100 0x7f7b8c068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:05.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.927+0000 7f7b8b7fe700 1 -- 172.21.15.71:0/663593880 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005766362 0 0) 0x7f7b84001490 con 0x7f7b8c0688d0 2023-10-09T08:18:05.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.927+0000 7f7b8b7fe700 1 -- 172.21.15.71:0/663593880 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b7c003570 con 0x7f7b8c0688d0 2023-10-09T08:18:05.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.928+0000 7f7b8b7fe700 1 -- 172.21.15.71:0/663593880 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934160846 0 0) 0x7f7b8c06dc20 con 0x7f7b8c157740 2023-10-09T08:18:05.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.928+0000 7f7b8b7fe700 1 -- 172.21.15.71:0/663593880 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b84001490 con 0x7f7b8c157740 2023-10-09T08:18:05.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.928+0000 7f7b8b7fe700 1 -- 172.21.15.71:0/663593880 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3871785805 0 0) 0x7f7b7c003570 con 0x7f7b8c0688d0 2023-10-09T08:18:05.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.928+0000 7f7b8b7fe700 1 -- 172.21.15.71:0/663593880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b8c0b2100 msgr2=0x7f7b8c068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:05.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.928+0000 7f7b8b7fe700 1 --2- 172.21.15.71:0/663593880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b8c0b2100 0x7f7b8c068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.928+0000 7f7b8b7fe700 1 -- 172.21.15.71:0/663593880 >> v1:172.21.15.179:6789/0 conn(0x7f7b8c157740 legacy=0x7f7b8c0adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:05.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.928+0000 7f7b8b7fe700 1 -- 172.21.15.71:0/663593880 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8c0ae910 con 0x7f7b8c0688d0 2023-10-09T08:18:05.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.928+0000 7f7b8b7fe700 1 -- 172.21.15.71:0/663593880 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1325046461 0 0) 0x7f7b84001980 con 0x7f7b8c0688d0 2023-10-09T08:18:05.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.928+0000 7f7b8bfff700 1 --2- 172.21.15.71:0/663593880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b8c0b2100 0x7f7b8c068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T08:18:05.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.928+0000 7f7b8b7fe700 1 -- 172.21.15.71:0/663593880 >> v1:172.21.15.71:6789/0 conn(0x7f7b8c0688d0 legacy=0x7f7b8c06e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:05.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.928+0000 7f7b8b7fe700 1 --2- 172.21.15.71:0/663593880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b7c003c20 0x7f7b7c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:05.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.928+0000 7f7b8b7fe700 1 --2- 172.21.15.71:0/663593880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b7c004810 0x7f7b7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:05.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.928+0000 7f7b8b7fe700 1 --2- 172.21.15.71:0/663593880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b8c0b2100 0x7f7b7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:05.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.928+0000 7f7b8b7fe700 1 -- 172.21.15.71:0/663593880 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c0acc00 con 0x7f7b7c004810 2023-10-09T08:18:05.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.928+0000 7f7b8b7fe700 1 -- 172.21.15.71:0/663593880 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c00bb10 con 0x7f7b7c003c20 2023-10-09T08:18:05.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.928+0000 7f7b8b7fe700 1 -- 172.21.15.71:0/663593880 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c00bcd0 con 0x7f7b8c0b2100 2023-10-09T08:18:05.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.928+0000 7f7b8bfff700 1 --2- 172.21.15.71:0/663593880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b7c004810 0x7f7b7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:05.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.928+0000 7f7b90b9b700 1 --2- 172.21.15.71:0/663593880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b7c003c20 0x7f7b7c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:05.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.928+0000 7f7b9139c700 1 --2- 172.21.15.71:0/663593880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b8c0b2100 0x7f7b7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:05.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.929+0000 7f7b8bfff700 1 -- 172.21.15.71:0/663593880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b8c0b2100 msgr2=0x7f7b7c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:05.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.929+0000 7f7b8bfff700 1 --2- 172.21.15.71:0/663593880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b8c0b2100 0x7f7b7c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.929+0000 7f7b8bfff700 1 -- 172.21.15.71:0/663593880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b7c003c20 msgr2=0x7f7b7c004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:05.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.929+0000 7f7b8bfff700 1 --2- 172.21.15.71:0/663593880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b7c003c20 0x7f7b7c004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.929+0000 7f7b8bfff700 1 -- 172.21.15.71:0/663593880 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b78009420 con 0x7f7b7c004810 2023-10-09T08:18:05.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.929+0000 7f7b8bfff700 1 --2- 172.21.15.71:0/663593880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b7c004810 0x7f7b7c004c80 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f7b78009df0 tx=0x7f7b780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608c1b551a7e10d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:05.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.929+0000 7f7b8b7fe700 1 -- 172.21.15.71:0/663593880 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b78009740 con 0x7f7b7c004810 2023-10-09T08:18:05.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.929+0000 7f7b8b7fe700 1 -- 172.21.15.71:0/663593880 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7800e920 con 0x7f7b7c004810 2023-10-09T08:18:05.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.929+0000 7f7b8b7fe700 1 -- 172.21.15.71:0/663593880 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7800ece0 con 0x7f7b7c004810 2023-10-09T08:18:05.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.930+0000 7f7b92dff700 1 -- 172.21.15.71:0/663593880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b7c004810 msgr2=0x7f7b7c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:05.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.930+0000 7f7b92dff700 1 --2- 172.21.15.71:0/663593880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b7c004810 0x7f7b7c004c80 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f7b78009df0 tx=0x7f7b780091a0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.930+0000 7f7b9139c700 1 -- 172.21.15.71:0/663593880 reap_dead start 2023-10-09T08:18:05.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.930+0000 7f7b92dff700 1 -- 172.21.15.71:0/663593880 shutdown_connections 2023-10-09T08:18:05.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.930+0000 7f7b92dff700 1 -- 172.21.15.71:0/663593880 >> 172.21.15.71:0/663593880 conn(0x7f7b8c0c8f90 msgr2=0x7f7b8c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:05.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.930+0000 7f7b92dff700 1 -- 172.21.15.71:0/663593880 shutdown_connections 2023-10-09T08:18:05.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.930+0000 7f7b92dff700 1 -- 172.21.15.71:0/663593880 wait complete. 2023-10-09T08:18:05.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.931+0000 7f7b92dff700 1 Processor -- start 2023-10-09T08:18:05.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.931+0000 7f7b92dff700 1 -- start start 2023-10-09T08:18:05.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.932+0000 7f7b92dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b7c004810 0x7f7b8c0c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:05.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.932+0000 7f7b92dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b8c0c8470 0x7f7b8c154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:05.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.932+0000 7f7b92dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b8c0c5d60 0x7f7b8c0b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:05.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.932+0000 7f7b92dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c0c58d0 con 0x7f7b8c0c8470 2023-10-09T08:18:05.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.932+0000 7f7b92dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c0c8a10 con 0x7f7b8c0c5d60 2023-10-09T08:18:05.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.932+0000 7f7b92dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c0c4fa0 con 0x7f7b7c004810 2023-10-09T08:18:05.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.932+0000 7f7b8bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b8c0c8470 0x7f7b8c154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:05.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.932+0000 7f7b8bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b8c0c8470 0x7f7b8c154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40346/0 (socket says 172.21.15.71:40346) 2023-10-09T08:18:05.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.932+0000 7f7b8bfff700 1 -- 172.21.15.71:0/4135146649 learned_addr learned my addr 172.21.15.71:0/4135146649 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:05.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.933+0000 7f7b9139c700 1 --2- 172.21.15.71:0/4135146649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b8c0c5d60 0x7f7b8c0b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:05.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.933+0000 7f7b90b9b700 1 --2- 172.21.15.71:0/4135146649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b7c004810 0x7f7b8c0c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:05.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.933+0000 7f7b8bfff700 1 -- 172.21.15.71:0/4135146649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b7c004810 msgr2=0x7f7b8c0c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:05.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.933+0000 7f7b8bfff700 1 --2- 172.21.15.71:0/4135146649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b7c004810 0x7f7b8c0c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.933+0000 7f7b8bfff700 1 -- 172.21.15.71:0/4135146649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b8c0c5d60 msgr2=0x7f7b8c0b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:05.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.933+0000 7f7b8bfff700 1 --2- 172.21.15.71:0/4135146649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b8c0c5d60 0x7f7b8c0b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.933+0000 7f7b8bfff700 1 -- 172.21.15.71:0/4135146649 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8c0c5280 con 0x7f7b8c0c8470 2023-10-09T08:18:05.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.933+0000 7f7b8bfff700 1 --2- 172.21.15.71:0/4135146649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b8c0c8470 0x7f7b8c154b50 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800e790 tx=0x7f7b7801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:05.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.933+0000 7f7b88ff9700 1 -- 172.21.15.71:0/4135146649 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b78022070 con 0x7f7b8c0c8470 2023-10-09T08:18:05.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.933+0000 7f7b88ff9700 1 -- 172.21.15.71:0/4135146649 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b78009740 con 0x7f7b8c0c8470 2023-10-09T08:18:05.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.933+0000 7f7b92dff700 1 -- 172.21.15.71:0/4135146649 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8c0c5560 con 0x7f7b8c0c8470 2023-10-09T08:18:05.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.933+0000 7f7b88ff9700 1 -- 172.21.15.71:0/4135146649 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7801c450 con 0x7f7b8c0c8470 2023-10-09T08:18:05.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.933+0000 7f7b92dff700 1 -- 172.21.15.71:0/4135146649 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8c155090 con 0x7f7b8c0c8470 2023-10-09T08:18:05.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.934+0000 7f7b92dff700 1 -- 172.21.15.71:0/4135146649 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7b8c0718b0 con 0x7f7b8c0c8470 2023-10-09T08:18:05.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.935+0000 7f7b88ff9700 1 -- 172.21.15.71:0/4135146649 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7b78026070 con 0x7f7b8c0c8470 2023-10-09T08:18:05.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.936+0000 7f7b88ff9700 1 --2- 172.21.15.71:0/4135146649 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f7b70066f30 0x7f7b700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:05.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.936+0000 7f7b88ff9700 1 -- 172.21.15.71:0/4135146649 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f7b78085e50 con 0x7f7b8c0c8470 2023-10-09T08:18:05.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.936+0000 7f7b88ff9700 1 --2- 172.21.15.71:0/4135146649 >> [v2:172.21.15.179:6808/86043,v1:172.21.15.179:6809/86043] conn(0x7f7b7006d6d0 0x7f7b7006fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:05.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.936+0000 7f7b88ff9700 1 -- 172.21.15.71:0/4135146649 --> [v2:172.21.15.179:6808/86043,v1:172.21.15.179:6809/86043] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b70070170 con 0x7f7b7006d6d0 2023-10-09T08:18:05.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.936+0000 7f7b88ff9700 1 -- 172.21.15.71:0/4135146649 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=215) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b78088350 con 0x7f7b8c0c8470 2023-10-09T08:18:05.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.936+0000 7f7b90b9b700 1 --2- 172.21.15.71:0/4135146649 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f7b70066f30 0x7f7b700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:05.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.937+0000 7f7b9139c700 1 --2- 172.21.15.71:0/4135146649 >> [v2:172.21.15.179:6808/86043,v1:172.21.15.179:6809/86043] conn(0x7f7b7006d6d0 0x7f7b7006fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:05.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.937+0000 7f7b90b9b700 1 --2- 172.21.15.71:0/4135146649 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f7b70066f30 0x7f7b700693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7b80000f60 tx=0x7f7b80009040 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:05.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.937+0000 7f7b9139c700 1 --2- 172.21.15.71:0/4135146649 >> [v2:172.21.15.179:6808/86043,v1:172.21.15.179:6809/86043] conn(0x7f7b7006d6d0 0x7f7b7006fb40 crc :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:05.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.938+0000 7f7b88ff9700 1 -- 172.21.15.71:0/4135146649 <== osd.7 v2:172.21.15.179:6808/86043 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f7b70070170 con 0x7f7b7006d6d0 2023-10-09T08:18:05.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.952+0000 7f7b92dff700 1 -- 172.21.15.71:0/4135146649 --> [v2:172.21.15.179:6808/86043,v1:172.21.15.179:6809/86043] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7b8c0678d0 con 0x7f7b7006d6d0 2023-10-09T08:18:05.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.952+0000 7f7b88ff9700 1 -- 172.21.15.71:0/4135146649 <== osd.7 v2:172.21.15.179:6808/86043 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7b8c0678d0 con 0x7f7b7006d6d0 2023-10-09T08:18:05.953 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-09T08:18:05.954 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T08:18:05.954 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-09T08:18:05.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.953+0000 7f7b92dff700 1 -- 172.21.15.71:0/4135146649 >> [v2:172.21.15.179:6808/86043,v1:172.21.15.179:6809/86043] conn(0x7f7b7006d6d0 msgr2=0x7f7b7006fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:05.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.953+0000 7f7b92dff700 1 --2- 172.21.15.71:0/4135146649 >> [v2:172.21.15.179:6808/86043,v1:172.21.15.179:6809/86043] conn(0x7f7b7006d6d0 0x7f7b7006fb40 crc :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:05.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.953+0000 7f7b92dff700 1 -- 172.21.15.71:0/4135146649 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f7b70066f30 msgr2=0x7f7b700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:05.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.953+0000 7f7b92dff700 1 --2- 172.21.15.71:0/4135146649 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f7b70066f30 0x7f7b700693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7b80000f60 tx=0x7f7b80009040 comp rx=0 tx=0).stop 2023-10-09T08:18:05.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.953+0000 7f7b92dff700 1 -- 172.21.15.71:0/4135146649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b8c0c8470 msgr2=0x7f7b8c154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:05.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.953+0000 7f7b92dff700 1 --2- 172.21.15.71:0/4135146649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b8c0c8470 0x7f7b8c154b50 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800e790 tx=0x7f7b7801a000 comp rx=0 tx=0).stop 2023-10-09T08:18:05.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.953+0000 7f7b9139c700 1 -- 172.21.15.71:0/4135146649 reap_dead start 2023-10-09T08:18:05.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.953+0000 7f7b92dff700 1 -- 172.21.15.71:0/4135146649 shutdown_connections 2023-10-09T08:18:05.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.953+0000 7f7b92dff700 1 -- 172.21.15.71:0/4135146649 >> 172.21.15.71:0/4135146649 conn(0x7f7b8c0c8f90 msgr2=0x7f7b8c0ca290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:05.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.953+0000 7f7b92dff700 1 -- 172.21.15.71:0/4135146649 shutdown_connections 2023-10-09T08:18:05.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:05.953+0000 7f7b92dff700 1 -- 172.21.15.71:0/4135146649 wait complete. 2023-10-09T08:18:05.971 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-09T08:18:06.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.151+0000 7f092abff700 1 Processor -- start 2023-10-09T08:18:06.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.151+0000 7f092abff700 1 -- start start 2023-10-09T08:18:06.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.152+0000 7f092abff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f092406bcd0 0x7f09240caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:06.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.152+0000 7f092abff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f092406c0a0 0x7f092415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:06.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.152+0000 7f092abff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092415d7e0 con 0x7f092415df50 2023-10-09T08:18:06.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.152+0000 7f092abff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f092415dac0 con 0x7f092406c0a0 2023-10-09T08:18:06.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.152+0000 7f092abff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092415aa30 con 0x7f092406bcd0 2023-10-09T08:18:06.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.153+0000 7f0923fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f092406c0a0 0x7f092415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:06.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.153+0000 7f0923fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f092406c0a0 0x7f092415a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40356/0 (socket says 172.21.15.71:40356) 2023-10-09T08:18:06.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.153+0000 7f0923fff700 1 -- 172.21.15.71:0/3123008923 learned_addr learned my addr 172.21.15.71:0/3123008923 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:06.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.153+0000 7f092899b700 1 --2- 172.21.15.71:0/3123008923 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f092406bcd0 0x7f09240caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:06.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.153+0000 7f0923fff700 1 -- 172.21.15.71:0/3123008923 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f092406bcd0 msgr2=0x7f09240caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:06.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.153+0000 7f0923fff700 1 --2- 172.21.15.71:0/3123008923 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f092406bcd0 0x7f09240caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:06.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.153+0000 7f0923fff700 1 -- 172.21.15.71:0/3123008923 >> v1:172.21.15.179:6789/0 conn(0x7f092415df50 legacy=0x7f09240c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:06.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.153+0000 7f0923fff700 1 -- 172.21.15.71:0/3123008923 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092415ad10 con 0x7f092406c0a0 2023-10-09T08:18:06.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.153+0000 7f0923fff700 1 --2- 172.21.15.71:0/3123008923 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f092406c0a0 0x7f092415a1e0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f09100099b0 tx=0x7f0910009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab355dfdcc9c5f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:06.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.154+0000 7f09237fe700 1 -- 172.21.15.71:0/3123008923 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091000b860 con 0x7f092406c0a0 2023-10-09T08:18:06.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.154+0000 7f09237fe700 1 -- 172.21.15.71:0/3123008923 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091000b9c0 con 0x7f092406c0a0 2023-10-09T08:18:06.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.154+0000 7f09237fe700 1 -- 172.21.15.71:0/3123008923 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091000bd80 con 0x7f092406c0a0 2023-10-09T08:18:06.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.154+0000 7f092abff700 1 -- 172.21.15.71:0/3123008923 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f092406c0a0 msgr2=0x7f092415a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:06.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.154+0000 7f092abff700 1 --2- 172.21.15.71:0/3123008923 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f092406c0a0 0x7f092415a1e0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f09100099b0 tx=0x7f0910009250 comp rx=0 tx=0).stop 2023-10-09T08:18:06.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.154+0000 7f092abff700 1 -- 172.21.15.71:0/3123008923 shutdown_connections 2023-10-09T08:18:06.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.154+0000 7f092abff700 1 --2- 172.21.15.71:0/3123008923 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f092406bcd0 0x7f09240caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:06.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.154+0000 7f092abff700 1 --2- 172.21.15.71:0/3123008923 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f092406c0a0 0x7f092415a1e0 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:06.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.154+0000 7f092abff700 1 -- 172.21.15.71:0/3123008923 >> 172.21.15.71:0/3123008923 conn(0x7f09240ce600 msgr2=0x7f09240cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:06.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.154+0000 7f092abff700 1 -- 172.21.15.71:0/3123008923 shutdown_connections 2023-10-09T08:18:06.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.154+0000 7f092abff700 1 -- 172.21.15.71:0/3123008923 wait complete. 2023-10-09T08:18:06.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.156+0000 7f092abff700 1 Processor -- start 2023-10-09T08:18:06.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.156+0000 7f092abff700 1 -- start start 2023-10-09T08:18:06.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.157+0000 7f092abff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f092406bcd0 0x7f09240b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:06.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.157+0000 7f092abff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f092406c0a0 0x7f09240c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:06.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.157+0000 7f092abff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f092415df50 0x7f092415c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:06.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.157+0000 7f092abff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09240b4220 con 0x7f092406c0a0 2023-10-09T08:18:06.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.157+0000 7f092abff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09240b3850 con 0x7f092406bcd0 2023-10-09T08:18:06.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.157+0000 7f092abff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09240b2f20 con 0x7f092415df50 2023-10-09T08:18:06.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.157+0000 7f0923fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f092406c0a0 0x7f09240c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:06.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.157+0000 7f0923fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f092406c0a0 0x7f09240c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40370/0 (socket says 172.21.15.71:40370) 2023-10-09T08:18:06.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.157+0000 7f0923fff700 1 -- 172.21.15.71:0/1987121370 learned_addr learned my addr 172.21.15.71:0/1987121370 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:06.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.157+0000 7f092899b700 1 --2- 172.21.15.71:0/1987121370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f092406bcd0 0x7f09240b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:06.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.157+0000 7f092919c700 1 --2- 172.21.15.71:0/1987121370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f092415df50 0x7f092415c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:06.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.158+0000 7f0923fff700 1 -- 172.21.15.71:0/1987121370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f092415df50 msgr2=0x7f092415c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:06.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.158+0000 7f0923fff700 1 --2- 172.21.15.71:0/1987121370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f092415df50 0x7f092415c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:06.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.158+0000 7f0923fff700 1 -- 172.21.15.71:0/1987121370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f092406bcd0 msgr2=0x7f09240b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:06.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.158+0000 7f0923fff700 1 --2- 172.21.15.71:0/1987121370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f092406bcd0 0x7f09240b3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:06.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.158+0000 7f0923fff700 1 -- 172.21.15.71:0/1987121370 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09100094f0 con 0x7f092406c0a0 2023-10-09T08:18:06.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.158+0000 7f092899b700 1 --2- 172.21.15.71:0/1987121370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f092406bcd0 0x7f09240b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:18:06.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.158+0000 7f0923fff700 1 --2- 172.21.15.71:0/1987121370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f092406c0a0 0x7f09240c6540 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f0910006fd0 tx=0x7f0910017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:06.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.158+0000 7f0920ff9700 1 -- 172.21.15.71:0/1987121370 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091001f070 con 0x7f092406c0a0 2023-10-09T08:18:06.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.158+0000 7f0920ff9700 1 -- 172.21.15.71:0/1987121370 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091001a420 con 0x7f092406c0a0 2023-10-09T08:18:06.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.158+0000 7f0920ff9700 1 -- 172.21.15.71:0/1987121370 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091001a7c0 con 0x7f092406c0a0 2023-10-09T08:18:06.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.158+0000 7f092abff700 1 -- 172.21.15.71:0/1987121370 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09240b3200 con 0x7f092406c0a0 2023-10-09T08:18:06.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.158+0000 7f092abff700 1 -- 172.21.15.71:0/1987121370 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09240c6a80 con 0x7f092406c0a0 2023-10-09T08:18:06.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.159+0000 7f092abff700 1 -- 172.21.15.71:0/1987121370 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0924064ed0 con 0x7f092406c0a0 2023-10-09T08:18:06.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.160+0000 7f0920ff9700 1 -- 172.21.15.71:0/1987121370 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f091001ab70 con 0x7f092406c0a0 2023-10-09T08:18:06.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.161+0000 7f0920ff9700 1 --2- 172.21.15.71:0/1987121370 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0908066f30 0x7f09080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:06.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.161+0000 7f0920ff9700 1 -- 172.21.15.71:0/1987121370 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f0910085c20 con 0x7f092406c0a0 2023-10-09T08:18:06.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.162+0000 7f092899b700 1 --2- 172.21.15.71:0/1987121370 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0908066f30 0x7f09080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:06.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.162+0000 7f092899b700 1 --2- 172.21.15.71:0/1987121370 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0908066f30 0x7f09080693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0918006fd0 tx=0x7f0918008040 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:06.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.165+0000 7f0920ff9700 1 -- 172.21.15.71:0/1987121370 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0910052d30 con 0x7f092406c0a0 2023-10-09T08:18:06.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.355+0000 7f092abff700 1 -- 172.21.15.71:0/1987121370 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f092404c3c0 con 0x7f0908066f30 2023-10-09T08:18:06.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.356+0000 7f0920ff9700 1 -- 172.21.15.71:0/1987121370 <== mgr.9898 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f092404c3c0 con 0x7f0908066f30 2023-10-09T08:18:06.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.359+0000 7f092abff700 1 -- 172.21.15.71:0/1987121370 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0908066f30 msgr2=0x7f09080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:06.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.359+0000 7f092abff700 1 --2- 172.21.15.71:0/1987121370 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0908066f30 0x7f09080693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0918006fd0 tx=0x7f0918008040 comp rx=0 tx=0).stop 2023-10-09T08:18:06.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.359+0000 7f092abff700 1 -- 172.21.15.71:0/1987121370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f092406c0a0 msgr2=0x7f09240c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:06.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.359+0000 7f092abff700 1 --2- 172.21.15.71:0/1987121370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f092406c0a0 0x7f09240c6540 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f0910006fd0 tx=0x7f0910017000 comp rx=0 tx=0).stop 2023-10-09T08:18:06.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.359+0000 7f092abff700 1 -- 172.21.15.71:0/1987121370 shutdown_connections 2023-10-09T08:18:06.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.359+0000 7f092abff700 1 --2- 172.21.15.71:0/1987121370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f092415df50 0x7f092415c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:06.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.359+0000 7f092abff700 1 --2- 172.21.15.71:0/1987121370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f092406bcd0 0x7f09240b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:06.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.359+0000 7f092abff700 1 --2- 172.21.15.71:0/1987121370 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f0908066f30 0x7f09080693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:06.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.359+0000 7f092abff700 1 --2- 172.21.15.71:0/1987121370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f092406c0a0 0x7f09240c6540 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:06.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.359+0000 7f092abff700 1 -- 172.21.15.71:0/1987121370 >> 172.21.15.71:0/1987121370 conn(0x7f09240ce600 msgr2=0x7f09240cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:06.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.359+0000 7f092abff700 1 -- 172.21.15.71:0/1987121370 shutdown_connections 2023-10-09T08:18:06.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.359+0000 7f092abff700 1 -- 172.21.15.71:0/1987121370 wait complete. 2023-10-09T08:18:06.362 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 7 to deep-scrub 2023-10-09T08:18:06.377 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T08:18:06.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.556+0000 7f0165dff700 1 Processor -- start 2023-10-09T08:18:06.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.556+0000 7f0165dff700 1 -- start start 2023-10-09T08:18:06.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.557+0000 7f0165dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f01600cbf30 0x7f01600ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:06.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.557+0000 7f0165dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f01600ccf90 0x7f01600b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:06.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.557+0000 7f0165dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f016015a270 0x7f01600b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:06.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.557+0000 7f0165dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0160156bf0 con 0x7f01600ccf90 2023-10-09T08:18:06.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.557+0000 7f0165dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01600ae950 con 0x7f01600cbf30 2023-10-09T08:18:06.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.557+0000 7f0165dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01600cc300 con 0x7f016015a270 2023-10-09T08:18:06.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.558+0000 7f015effd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f01600ccf90 0x7f01600b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:06.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.558+0000 7f015effd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f01600ccf90 0x7f01600b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40386/0 (socket says 172.21.15.71:40386) 2023-10-09T08:18:06.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.558+0000 7f015effd700 1 -- 172.21.15.71:0/1103083626 learned_addr learned my addr 172.21.15.71:0/1103083626 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:06.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.558+0000 7f015ffff700 1 --2- 172.21.15.71:0/1103083626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f016015a270 0x7f01600b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:06.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.558+0000 7f015f7fe700 1 --2- 172.21.15.71:0/1103083626 >> v2:172.21.15.179:3300/0 conn(0x7f01600cbf30 0x7f01600ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:06.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.558+0000 7f015effd700 1 -- 172.21.15.71:0/1103083626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f016015a270 msgr2=0x7f01600b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:06.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.558+0000 7f015effd700 1 --2- 172.21.15.71:0/1103083626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f016015a270 0x7f01600b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:06.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.558+0000 7f015effd700 1 -- 172.21.15.71:0/1103083626 >> v2:172.21.15.179:3300/0 conn(0x7f01600cbf30 msgr2=0x7f01600ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:06.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.558+0000 7f015effd700 1 --2- 172.21.15.71:0/1103083626 >> v2:172.21.15.179:3300/0 conn(0x7f01600cbf30 0x7f01600ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:06.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.558+0000 7f015effd700 1 -- 172.21.15.71:0/1103083626 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01600ad370 con 0x7f01600ccf90 2023-10-09T08:18:06.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.558+0000 7f015effd700 1 --2- 172.21.15.71:0/1103083626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01600ccf90 0x7f01600b0d10 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f0160063d40 tx=0x7f0154009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc1ee5f830d9a7b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:06.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.559+0000 7f015e7fc700 1 -- 172.21.15.71:0/1103083626 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015400b640 con 0x7f01600ccf90 2023-10-09T08:18:06.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.559+0000 7f015e7fc700 1 -- 172.21.15.71:0/1103083626 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015400b7a0 con 0x7f01600ccf90 2023-10-09T08:18:06.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.559+0000 7f015e7fc700 1 -- 172.21.15.71:0/1103083626 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015400bb40 con 0x7f01600ccf90 2023-10-09T08:18:06.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.559+0000 7f0165dff700 1 -- 172.21.15.71:0/1103083626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01600ccf90 msgr2=0x7f01600b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:06.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.559+0000 7f0165dff700 1 --2- 172.21.15.71:0/1103083626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01600ccf90 0x7f01600b0d10 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f0160063d40 tx=0x7f0154009250 comp rx=0 tx=0).stop 2023-10-09T08:18:06.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.559+0000 7f0165dff700 1 -- 172.21.15.71:0/1103083626 shutdown_connections 2023-10-09T08:18:06.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.559+0000 7f0165dff700 1 --2- 172.21.15.71:0/1103083626 >> v2:172.21.15.179:3300/0 conn(0x7f01600cbf30 0x7f01600ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:06.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.559+0000 7f0165dff700 1 --2- 172.21.15.71:0/1103083626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f016015a270 0x7f01600b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:06.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.559+0000 7f0165dff700 1 --2- 172.21.15.71:0/1103083626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01600ccf90 0x7f01600b0d10 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:06.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.559+0000 7f0165dff700 1 -- 172.21.15.71:0/1103083626 >> 172.21.15.71:0/1103083626 conn(0x7f016006a320 msgr2=0x7f01600cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:06.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.559+0000 7f0165dff700 1 -- 172.21.15.71:0/1103083626 shutdown_connections 2023-10-09T08:18:06.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.559+0000 7f0165dff700 1 -- 172.21.15.71:0/1103083626 wait complete. 2023-10-09T08:18:06.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.561+0000 7f0165dff700 1 Processor -- start 2023-10-09T08:18:06.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.561+0000 7f0165dff700 1 -- start start 2023-10-09T08:18:06.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.562+0000 7f0165dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01600cbf30 0x7f0160155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:06.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.562+0000 7f0165dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01600ccf90 0x7f01600ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:06.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.562+0000 7f0165dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f016015a270 0x7f01600ac900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:06.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.562+0000 7f0165dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01600aadc0 con 0x7f01600cbf30 2023-10-09T08:18:06.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.562+0000 7f0165dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0160155960 con 0x7f016015a270 2023-10-09T08:18:06.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.562+0000 7f0165dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016016aaf0 con 0x7f01600ccf90 2023-10-09T08:18:06.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.562+0000 7f015f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01600cbf30 0x7f0160155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:06.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.562+0000 7f015f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01600cbf30 0x7f0160155420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40402/0 (socket says 172.21.15.71:40402) 2023-10-09T08:18:06.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.562+0000 7f015f7fe700 1 -- 172.21.15.71:0/162655372 learned_addr learned my addr 172.21.15.71:0/162655372 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:06.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.562+0000 7f015effd700 1 --2- 172.21.15.71:0/162655372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01600ccf90 0x7f01600ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:06.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.562+0000 7f015ffff700 1 --2- 172.21.15.71:0/162655372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f016015a270 0x7f01600ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.563+0000 7f015f7fe700 1 -- 172.21.15.71:0/162655372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01600ccf90 msgr2=0x7f01600ac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.563+0000 7f015f7fe700 1 --2- 172.21.15.71:0/162655372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01600ccf90 0x7f01600ac3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.563+0000 7f015f7fe700 1 -- 172.21.15.71:0/162655372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f016015a270 msgr2=0x7f01600ac900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.563+0000 7f015f7fe700 1 --2- 172.21.15.71:0/162655372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f016015a270 0x7f01600ac900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.563+0000 7f015f7fe700 1 -- 172.21.15.71:0/162655372 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01540094f0 con 0x7f01600cbf30 2023-10-09T08:18:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.563+0000 7f015effd700 1 --2- 172.21.15.71:0/162655372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01600ccf90 0x7f01600ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:18:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.563+0000 7f015ffff700 1 --2- 172.21.15.71:0/162655372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f016015a270 0x7f01600ac900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:18:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.563+0000 7f015f7fe700 1 --2- 172.21.15.71:0/162655372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01600cbf30 0x7f0160155420 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f015000e930 tx=0x7f01500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.563+0000 7f01477fe700 1 -- 172.21.15.71:0/162655372 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015000eed0 con 0x7f01600cbf30 2023-10-09T08:18:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.563+0000 7f01477fe700 1 -- 172.21.15.71:0/162655372 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015000c850 con 0x7f01600cbf30 2023-10-09T08:18:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.563+0000 7f01477fe700 1 -- 172.21.15.71:0/162655372 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015000cbf0 con 0x7f01600cbf30 2023-10-09T08:18:06.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.563+0000 7f0165dff700 1 -- 172.21.15.71:0/162655372 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01600aa490 con 0x7f01600cbf30 2023-10-09T08:18:06.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.563+0000 7f0165dff700 1 -- 172.21.15.71:0/162655372 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01600aaa50 con 0x7f01600cbf30 2023-10-09T08:18:06.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.564+0000 7f0165dff700 1 -- 172.21.15.71:0/162655372 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f016004c3c0 con 0x7f01600cbf30 2023-10-09T08:18:06.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.566+0000 7f01477fe700 1 -- 172.21.15.71:0/162655372 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0150013470 con 0x7f01600cbf30 2023-10-09T08:18:06.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.566+0000 7f01477fe700 1 --2- 172.21.15.71:0/162655372 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f014c066f30 0x7f014c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:06.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.566+0000 7f01477fe700 1 -- 172.21.15.71:0/162655372 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f0150084940 con 0x7f01600cbf30 2023-10-09T08:18:06.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.567+0000 7f015effd700 1 --2- 172.21.15.71:0/162655372 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f014c066f30 0x7f014c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:06.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.568+0000 7f015effd700 1 --2- 172.21.15.71:0/162655372 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f014c066f30 0x7f014c0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0160063d40 tx=0x7f0154017000 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:06.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.571+0000 7f01477fe700 1 -- 172.21.15.71:0/162655372 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01500519d0 con 0x7f01600cbf30 2023-10-09T08:18:06.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.756+0000 7f0165dff700 1 -- 172.21.15.71:0/162655372 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f01600aaf00 con 0x7f014c066f30 2023-10-09T08:18:06.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.760+0000 7f01477fe700 1 -- 172.21.15.71:0/162655372 <== mgr.9898 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50766 (secure 0 0 0) 0x7f0154000c50 con 0x7f014c066f30 2023-10-09T08:18:06.761 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:18:06.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.762+0000 7f0165dff700 1 -- 172.21.15.71:0/162655372 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f014c066f30 msgr2=0x7f014c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:06.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.762+0000 7f0165dff700 1 --2- 172.21.15.71:0/162655372 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f014c066f30 0x7f014c0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0160063d40 tx=0x7f0154017000 comp rx=0 tx=0).stop 2023-10-09T08:18:06.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.762+0000 7f0165dff700 1 -- 172.21.15.71:0/162655372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01600cbf30 msgr2=0x7f0160155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.762+0000 7f0165dff700 1 --2- 172.21.15.71:0/162655372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01600cbf30 0x7f0160155420 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f015000e930 tx=0x7f01500091a0 comp rx=0 tx=0).stop 2023-10-09T08:18:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.762+0000 7f0165dff700 1 -- 172.21.15.71:0/162655372 shutdown_connections 2023-10-09T08:18:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.762+0000 7f0165dff700 1 --2- 172.21.15.71:0/162655372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f016015a270 0x7f01600ac900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.762+0000 7f0165dff700 1 --2- 172.21.15.71:0/162655372 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f014c066f30 0x7f014c0693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.762+0000 7f0165dff700 1 --2- 172.21.15.71:0/162655372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01600cbf30 0x7f0160155420 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.762+0000 7f0165dff700 1 --2- 172.21.15.71:0/162655372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01600ccf90 0x7f01600ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.762+0000 7f0165dff700 1 -- 172.21.15.71:0/162655372 >> 172.21.15.71:0/162655372 conn(0x7f016006a320 msgr2=0x7f0160068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.762+0000 7f0165dff700 1 -- 172.21.15.71:0/162655372 shutdown_connections 2023-10-09T08:18:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:06.762+0000 7f0165dff700 1 -- 172.21.15.71:0/162655372 wait complete. 2023-10-09T08:18:06.765 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T08:18:06.780 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2023-10-09T08:18:05.214144+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2461992,"kb_used_data":22248,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752512728,"statfs":{"total":773094113280,"available":770573033472,"internally_reserved":0,"allocated":22781952,"data_stored":12081432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002010"},"pg_stats":[{"pgid":"1.0","version":"213'370","reported_seq":1225,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-09T08:17:53.281031+0000","last_change":"2023-10-09T06:42:28.246580+0000","last_active":"2023-10-09T08:17:53.281031+0000","last_peered":"2023-10-09T08:17:53.281031+0000","last_clean":"2023-10-09T08:17:53.281031+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T08:17:53.281031+0000","last_undegraded":"2023-10-09T08:17:53.281031+0000","last_fullsized":"2023-10-09T08:17:53.281031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T06:42:26.865845+0000","last_clean_scrub_stamp":"2023-10-09T06:42:26.865845+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:43.242058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575980,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312792,"kb_used_data":3216,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059048,"statfs":{"total":96636764160,"available":96316465152,"internally_reserved":0,"allocated":3293184,"data_stored":1952955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72899999999999998,"15min":0.751},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85799999999999998,"5min":0.98699999999999999,"15min":1.1220000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72399999999999998,"15min":0.74099999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.93300000000000005,"5min":1.0069999999999999,"15min":1.0209999999999999},"last":0.66700000000000004}]},{"osd":1,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.879,"5min":1.28,"15min":1.28},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.71899999999999997,"15min":0.74299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90000000000000002,"5min":1.298,"15min":1.298},"last":0.56899999999999995}]},{"osd":2,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73199999999999998,"15min":0.74399999999999999},"min":{"1min":0.47599999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88700000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.745,"15min":0.76700000000000002},"min":{"1min":0.55700000000000005,"5min":0.49299999999999999,"15min":0.442},"max":{"1min":0.90200000000000002,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.58499999999999996}]},{"osd":3,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73099999999999998,"15min":0.73699999999999999},"min":{"1min":0.50900000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86099999999999999,"5min":1.399,"15min":1.399},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.76400000000000001,"15min":0.77200000000000002},"min":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.91500000000000004,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.63100000000000001}]},{"osd":4,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.62,"15min":0.60499999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83999999999999997,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.5},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63900000000000001,"15min":0.629},"min":{"1min":0.40699999999999997,"5min":0.39900000000000002,"15min":0.38600000000000001},"max":{"1min":0.96299999999999997,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.59399999999999997}]},{"osd":5,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.376},"max":{"1min":0.85999999999999999,"5min":1.413,"15min":1.413},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.40100000000000002},"max":{"1min":0.96399999999999997,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74399999999999999,"15min":0.73699999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98899999999999999,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70899999999999996,"15min":0.70599999999999996},"min":{"1min":0.48299999999999998,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":1.016,"5min":1.595,"15min":1.595},"last":0.82499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":316308,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055532,"statfs":{"total":96636764160,"available":96312864768,"internally_reserved":0,"allocated":2699264,"data_stored":1362587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.75700000000000001,"15min":0.74399999999999999},"min":{"1min":0.50700000000000001,"5min":0.46899999999999997,"15min":0.40300000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0189999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.73199999999999998,"15min":0.72799999999999998},"min":{"1min":0.46700000000000003,"5min":0.44400000000000001,"15min":0.35399999999999998},"max":{"1min":0.86699999999999999,"5min":0.96299999999999997,"15min":0.97399999999999998},"last":0.57799999999999996}]},{"osd":1,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73599999999999999,"15min":0.74299999999999999},"min":{"1min":0.47499999999999998,"5min":0.45300000000000001,"15min":0.38500000000000001},"max":{"1min":0.83599999999999997,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77400000000000002,"15min":0.76000000000000001},"min":{"1min":0.52700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.96299999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.56399999999999995}]},{"osd":2,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.496,"5min":0.495,"15min":0.47099999999999997},"max":{"1min":0.97099999999999997,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76900000000000002,"15min":0.77100000000000002},"min":{"1min":0.56899999999999995,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.61499999999999999}]},{"osd":3,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.504,"15min":0.45300000000000001},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79800000000000004,"15min":0.78700000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.99099999999999999,"5min":1.119,"15min":1.119},"last":0.50900000000000001}]},{"osd":4,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64200000000000002,"15min":0.63800000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.40200000000000002},"max":{"1min":0.93300000000000005,"5min":1.0149999999999999,"15min":1.032},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.32000000000000001},"max":{"1min":0.82999999999999996,"5min":0.90300000000000002,"15min":0.93700000000000006},"last":0.44700000000000001}]},{"osd":5,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.67300000000000004,"15min":0.67200000000000004},"min":{"1min":0.53000000000000003,"5min":0.42399999999999999,"15min":0.40100000000000002},"max":{"1min":0.97699999999999998,"5min":1.232,"15min":1.232},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.72099999999999997,"15min":0.70899999999999996},"min":{"1min":0.496,"5min":0.46600000000000003,"15min":0.45200000000000001},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.121},"last":0.52400000000000002}]},{"osd":7,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.69799999999999995,"15min":0.68899999999999995},"min":{"1min":0.54800000000000004,"5min":0.46800000000000003,"15min":0.36299999999999999},"max":{"1min":0.92800000000000005,"5min":0.93200000000000005,"15min":0.98699999999999999},"last":0.496},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.755,"15min":0.74199999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.442},"max":{"1min":1.008,"5min":1.194,"15min":1.194},"last":0.42499999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575980,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308116,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063724,"statfs":{"total":96636764160,"available":96321253376,"internally_reserved":0,"allocated":2699264,"data_stored":1362587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45600000000000002,"15min":0.45700000000000002},"min":{"1min":0.34100000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.65000000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.40000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78300000000000003,"5min":0.95499999999999996,"15min":1.2230000000000001},"last":0.68600000000000005}]},{"osd":2,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.39200000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71599999999999997,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42699999999999999,"5min":0.40300000000000002,"15min":0.39500000000000002},"max":{"1min":0.77300000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.60099999999999998}]},{"osd":3,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63,"15min":0.627},"min":{"1min":0.49199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84199999999999997,"5min":1.0049999999999999,"15min":1.2589999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.435,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":1.1519999999999999},"last":0.53900000000000003}]},{"osd":4,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78800000000000003,"15min":0.78200000000000003},"min":{"1min":0.58999999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.087,"5min":1.1759999999999999,"15min":1.224},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.80400000000000005,"15min":0.80300000000000005},"min":{"1min":0.66700000000000004,"5min":0.56499999999999995,"15min":0.51800000000000002},"max":{"1min":1.0329999999999999,"5min":1.071,"15min":1.5800000000000001},"last":0.79200000000000004}]},{"osd":5,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.81699999999999995,"15min":0.81399999999999995},"min":{"1min":0.61599999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.77},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.81799999999999995,"15min":0.80700000000000005},"min":{"1min":0.67500000000000004,"5min":0.56100000000000005,"15min":0.49299999999999999},"max":{"1min":1.177,"5min":1.262,"15min":1.288},"last":0.76100000000000001}]},{"osd":6,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.82699999999999996,"15min":0.81999999999999995},"min":{"1min":0.63900000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.071,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.84999999999999998,"15min":0.83799999999999997},"min":{"1min":0.77300000000000002,"5min":0.59999999999999998,"15min":0.56699999999999995},"max":{"1min":1.135,"5min":1.3819999999999999,"15min":1.843},"last":0.77900000000000003}]},{"osd":7,"last update":"Mon Oct 9 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.872,"15min":0.86299999999999999},"min":{"1min":0.751,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.103,"5min":1.1739999999999999,"15min":1.9139999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.86299999999999999,"15min":0.85299999999999998},"min":{"1min":0.70699999999999996,"5min":0.61799999999999999,"15min":0.54300000000000004},"max":{"1min":1.1339999999999999,"5min":1.2270000000000001,"15min":1.347},"last":0.83999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575979,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308696,"kb_used_data":3216,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063144,"statfs":{"total":96636764160,"available":96320659456,"internally_reserved":0,"allocated":3293184,"data_stored":1952955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46500000000000002,"15min":0.48099999999999998},"min":{"1min":0.315,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61099999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.433},{"interface":"front","average":{"1min":0.5,"5min":0.51600000000000001,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.64100000000000001,"5min":0.82199999999999995,"15min":0.83599999999999997},"last":0.51700000000000002}]},{"osd":2,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.55100000000000005,"15min":0.57399999999999995},"min":{"1min":0.40699999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.63300000000000001,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48699999999999999,"15min":0.50600000000000001},"min":{"1min":0.33300000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.61399999999999999,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.47799999999999998}]},{"osd":3,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.50700000000000001,"15min":0.52900000000000003},"min":{"1min":0.38300000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69599999999999995,"5min":0.78200000000000003,"15min":0.80500000000000005},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59399999999999997,"15min":0.61399999999999999},"min":{"1min":0.438,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84299999999999997,"5min":0.92100000000000004,"15min":0.93200000000000005},"last":0.66100000000000003}]},{"osd":4,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77900000000000003,"15min":0.78400000000000003},"min":{"1min":0.48599999999999999,"5min":0.46600000000000003,"15min":0.42899999999999999},"max":{"1min":1.0780000000000001,"5min":1.1759999999999999,"15min":1.226},"last":0.624},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.53000000000000003},"max":{"1min":1.0229999999999999,"5min":1.216,"15min":1.23},"last":0.61099999999999999}]},{"osd":5,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79300000000000004,"15min":0.81000000000000005},"min":{"1min":0.63500000000000001,"5min":0.51500000000000001,"15min":0.501},"max":{"1min":1.008,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78900000000000003,"15min":0.81499999999999995},"min":{"1min":0.55100000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97799999999999998,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.68500000000000005}]},{"osd":6,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.83499999999999996,"15min":0.84599999999999997},"min":{"1min":0.621,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0680000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.79100000000000004,"15min":0.81799999999999995},"min":{"1min":0.56999999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94099999999999995,"5min":1.1819999999999999,"15min":1.24},"last":0.67100000000000004}]},{"osd":7,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.85799999999999998},"min":{"1min":0.59699999999999998,"5min":0.497,"15min":0.497},"max":{"1min":1.163,"5min":1.2470000000000001,"15min":1.2929999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.83999999999999997,"15min":0.871},"min":{"1min":0.58399999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0880000000000001,"5min":1.2,"15min":1.2110000000000001},"last":0.72699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299924,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071916,"statfs":{"total":96636764160,"available":96329641984,"internally_reserved":0,"allocated":2699264,"data_stored":1362587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46300000000000002,"15min":0.46800000000000003},"min":{"1min":0.28499999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57599999999999996,"5min":0.67900000000000005,"15min":0.752},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.47899999999999998,"15min":0.498},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.59099999999999997,"5min":0.73299999999999998,"15min":0.82299999999999995},"last":0.41799999999999998}]},{"osd":1,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48299999999999998,"15min":0.49299999999999999},"min":{"1min":0.34000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.60199999999999998,"5min":1.03,"15min":1.03},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69799999999999995,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.40300000000000002}]},{"osd":3,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.441,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.73299999999999998,"5min":0.89000000000000001,"15min":0.96999999999999997},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.43099999999999999},"max":{"1min":0.73199999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56100000000000005}]},{"osd":4,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78700000000000003,"15min":0.80800000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0129999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.79200000000000004,"15min":0.79500000000000004},"min":{"1min":0.56499999999999995,"5min":0.54500000000000004,"15min":0.48399999999999999},"max":{"1min":1.0960000000000001,"5min":1.206,"15min":1.206},"last":0.57699999999999996}]},{"osd":5,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.78900000000000003,"15min":0.80400000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93100000000000005,"5min":1.181,"15min":1.181},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79700000000000004,"15min":0.81999999999999995},"min":{"1min":0.57599999999999996,"5min":0.56799999999999995,"15min":0.47799999999999998},"max":{"1min":0.96699999999999997,"5min":1.234,"15min":1.234},"last":0.48099999999999998}]},{"osd":6,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.98199999999999998,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.80300000000000005,"15min":0.82799999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0529999999999999,"5min":1.1799999999999999,"15min":1.224},"last":0.91400000000000003}]},{"osd":7,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.84099999999999997,"15min":0.85799999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.47899999999999998},"max":{"1min":1.0329999999999999,"5min":1.448,"15min":1.448},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.86199999999999999,"15min":0.873},"min":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1299999999999999,"5min":1.518,"15min":1.518},"last":0.95599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575980,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312212,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059628,"statfs":{"total":96636764160,"available":96317059072,"internally_reserved":0,"allocated":2699264,"data_stored":1362587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47799999999999998,"15min":0.48799999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59199999999999997,"5min":0.78600000000000003,"15min":0.85999999999999999},"last":0.316},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.503,"15min":0.505},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.63100000000000001,"5min":0.73499999999999999,"15min":0.74299999999999999},"last":0.39900000000000002}]},{"osd":1,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.5,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66900000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78400000000000003,"5min":0.84999999999999998,"15min":0.91300000000000003},"last":0.35999999999999999}]},{"osd":2,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70099999999999996,"5min":0.85699999999999998,"15min":0.97299999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.65000000000000002,"15min":0.65700000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80700000000000005,"5min":0.90200000000000002,"15min":1.036},"last":0.41999999999999998}]},{"osd":4,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52100000000000002,"5min":0.49099999999999999,"15min":0.46000000000000002},"max":{"1min":1.0149999999999999,"5min":1.175,"15min":1.175},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.85899999999999999,"15min":0.86699999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.97699999999999998,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.51200000000000001}]},{"osd":5,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.47399999999999998},"max":{"1min":1.026,"5min":1.1419999999999999,"15min":1.2170000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.83099999999999996,"15min":0.83399999999999996},"min":{"1min":0.64200000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.96599999999999997,"5min":1.1719999999999999,"15min":1.1739999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97799999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.81200000000000006,"15min":0.81299999999999994},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.54800000000000004},"max":{"1min":1.0620000000000001,"5min":1.1339999999999999,"15min":1.149},"last":0.625}]},{"osd":7,"last update":"Mon Oct 9 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.84799999999999998,"15min":0.85399999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.96199999999999997,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.85999999999999999,"15min":0.85299999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0900000000000001,"5min":1.155,"15min":1.1639999999999999},"last":0.48999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":304020,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067820,"statfs":{"total":96636764160,"available":96325447680,"internally_reserved":0,"allocated":2699264,"data_stored":1362587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69999999999999996,"15min":0.71799999999999997},"min":{"1min":0.44800000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90700000000000003,"5min":0.94799999999999995,"15min":1.0029999999999999},"last":0.748},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71599999999999997,"15min":0.73699999999999999},"min":{"1min":0.48099999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.94199999999999995,"5min":0.995,"15min":0.995},"last":0.72699999999999998}]},{"osd":1,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.71799999999999997},"min":{"1min":0.48099999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84899999999999998,"5min":0.92700000000000005,"15min":1.03},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70599999999999996,"15min":0.73399999999999999},"min":{"1min":0.47699999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94199999999999995,"5min":0.97299999999999998,"15min":1.0009999999999999},"last":0.70799999999999996}]},{"osd":2,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77100000000000002,"15min":0.79200000000000004},"min":{"1min":0.58099999999999996,"5min":0.51200000000000001,"15min":0.45000000000000001},"max":{"1min":0.95999999999999996,"5min":0.99399999999999999,"15min":1.0569999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.80100000000000005},"min":{"1min":0.52900000000000003,"5min":0.51000000000000001,"15min":0.47999999999999998},"max":{"1min":0.95199999999999996,"5min":0.97999999999999998,"15min":1.077},"last":0.82999999999999996}]},{"osd":3,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71499999999999997,"15min":0.73999999999999999},"min":{"1min":0.55200000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.876,"5min":0.96999999999999997,"15min":1.016},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73799999999999999,"15min":0.76700000000000002},"min":{"1min":0.53200000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90200000000000002,"5min":0.92200000000000004,"15min":1.036},"last":0.80400000000000005}]},{"osd":5,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.36899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77200000000000002,"5min":0.94899999999999995,"15min":1.006},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.629,"15min":0.63},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84999999999999998,"5min":0.94199999999999995,"15min":1.0580000000000001},"last":0.61499999999999999}]},{"osd":6,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.439,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.996,"5min":1.022,"15min":1.034},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67000000000000004,"15min":0.67900000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85599999999999998,"5min":0.998,"15min":1.0609999999999999},"last":0.64500000000000002}]},{"osd":7,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71899999999999997,"15min":0.72599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.44700000000000001},"max":{"1min":0.89500000000000002,"5min":1.036,"15min":1.036},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76400000000000001,"15min":0.77500000000000002},"min":{"1min":0.59299999999999997,"5min":0.498,"15min":0.443},"max":{"1min":1.044,"5min":1.0609999999999999,"15min":1.079},"last":0.91900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575980,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299924,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071916,"statfs":{"total":96636764160,"available":96329641984,"internally_reserved":0,"allocated":2699264,"data_stored":1362587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.71299999999999997,"15min":0.72799999999999998},"min":{"1min":0.49399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.69499999999999995,"15min":0.70999999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.40899999999999997},"max":{"1min":0.79200000000000004,"5min":0.96699999999999997,"15min":0.97699999999999998},"last":0.55600000000000005}]},{"osd":1,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68500000000000005,"15min":0.71399999999999997},"min":{"1min":0.46999999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.86099999999999999,"5min":0.90400000000000003,"15min":1.0129999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.752,"15min":0.746},"min":{"1min":0.443,"5min":0.443,"15min":0.435},"max":{"1min":0.98599999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.48799999999999999}]},{"osd":2,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72399999999999998,"15min":0.745},"min":{"1min":0.52200000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88300000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73399999999999999,"15min":0.74299999999999999},"min":{"1min":0.54500000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.90200000000000002,"5min":0.99299999999999999,"15min":1.1359999999999999},"last":0.54500000000000004}]},{"osd":3,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72999999999999998,"15min":0.745},"min":{"1min":0.52100000000000002,"5min":0.50900000000000001,"15min":0.49199999999999999},"max":{"1min":0.94099999999999995,"5min":0.95999999999999996,"15min":0.98199999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76800000000000002,"15min":0.78600000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":1.0189999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.58399999999999996}]},{"osd":4,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.51200000000000001,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.60999999999999999},"min":{"1min":0.437,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89100000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.47599999999999998}]},{"osd":6,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63100000000000001,"15min":0.625},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.98699999999999999,"5min":1,"15min":1},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.70699999999999996,"15min":0.68300000000000005},"min":{"1min":0.46100000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0840000000000001,"5min":1.123,"15min":1.123},"last":0.56999999999999995}]},{"osd":7,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69499999999999995,"15min":0.68600000000000005},"min":{"1min":0.48299999999999998,"5min":0.48099999999999998,"15min":0.44400000000000001},"max":{"1min":0.97999999999999998,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.58499999999999996,"5min":0.50600000000000001,"15min":0.48599999999999999},"max":{"1min":1.052,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.65000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T08:18:06.784 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-09T06:42:26.865845+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=9, tm_hour=6, tm_min=42, tm_sec=26, tm_wday=0, tm_yday=282, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=9, tm_hour=8, tm_min=18, tm_sec=0, tm_wday=0, tm_yday=282, tm_isdst=0) 2023-10-09T08:18:06.784 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-09T08:18:26.785 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T08:18:26.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.975+0000 7f4b0c7ff700 1 Processor -- start 2023-10-09T08:18:26.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.975+0000 7f4b0c7ff700 1 -- start start 2023-10-09T08:18:26.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.977+0000 7f4b0c7ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4b040cbf30 0x7f4b040ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:26.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.977+0000 7f4b0c7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4b040ccf90 0x7f4b040b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:26.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.977+0000 7f4b0c7ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b040cc300 con 0x7f4b0415a270 2023-10-09T08:18:26.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.977+0000 7f4b0c7ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b04156bf0 con 0x7f4b040cbf30 2023-10-09T08:18:26.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.977+0000 7f4b0c7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b040ae950 con 0x7f4b040ccf90 2023-10-09T08:18:26.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.977+0000 7f4b0a59b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4b040cbf30 0x7f4b040ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:26.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.977+0000 7f4b0ad9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f4b0415a270 0x7f4b040c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43984/0 (socket says 172.21.15.71:43984) 2023-10-09T08:18:26.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.977+0000 7f4b0ad9c700 1 -- 172.21.15.71:0/320335452 learned_addr learned my addr 172.21.15.71:0/320335452 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:18:26.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.977+0000 7f4b09d9a700 1 --2- 172.21.15.71:0/320335452 >> v2:172.21.15.179:3300/0 conn(0x7f4b040ccf90 0x7f4b040b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:26.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.977+0000 7f4b0a59b700 1 -- 172.21.15.71:0/320335452 >> v2:172.21.15.179:3300/0 conn(0x7f4b040ccf90 msgr2=0x7f4b040b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:26.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.977+0000 7f4b0a59b700 1 --2- 172.21.15.71:0/320335452 >> v2:172.21.15.179:3300/0 conn(0x7f4b040ccf90 0x7f4b040b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:26.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.977+0000 7f4b0a59b700 1 -- 172.21.15.71:0/320335452 >> v1:172.21.15.71:6789/0 conn(0x7f4b0415a270 legacy=0x7f4b040c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:26.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.978+0000 7f4b0a59b700 1 -- 172.21.15.71:0/320335452 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b040ad370 con 0x7f4b040cbf30 2023-10-09T08:18:26.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.977+0000 7f4b09599700 1 -- 172.21.15.71:0/320335452 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675801356 0 0) 0x7f4b040cc300 con 0x7f4b0415a270 2023-10-09T08:18:26.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.978+0000 7f4b0a59b700 1 --2- 172.21.15.71:0/320335452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b040cbf30 0x7f4b040ae410 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f4b0406d670 tx=0x7f4b000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80b1975813fda26 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:26.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.978+0000 7f4b09599700 1 -- 172.21.15.71:0/320335452 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b00009e80 con 0x7f4b040cbf30 2023-10-09T08:18:26.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.978+0000 7f4b09599700 1 -- 172.21.15.71:0/320335452 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0000b820 con 0x7f4b040cbf30 2023-10-09T08:18:26.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.978+0000 7f4b09599700 1 -- 172.21.15.71:0/320335452 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0000bba0 con 0x7f4b040cbf30 2023-10-09T08:18:26.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.978+0000 7f4b0c7ff700 1 -- 172.21.15.71:0/320335452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b040cbf30 msgr2=0x7f4b040ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:26.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.978+0000 7f4b0c7ff700 1 --2- 172.21.15.71:0/320335452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b040cbf30 0x7f4b040ae410 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f4b0406d670 tx=0x7f4b000091a0 comp rx=0 tx=0).stop 2023-10-09T08:18:26.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.979+0000 7f4b0c7ff700 1 -- 172.21.15.71:0/320335452 shutdown_connections 2023-10-09T08:18:26.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.979+0000 7f4b0c7ff700 1 --2- 172.21.15.71:0/320335452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b040cbf30 0x7f4b040ae410 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:26.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.979+0000 7f4b0c7ff700 1 --2- 172.21.15.71:0/320335452 >> v2:172.21.15.179:3300/0 conn(0x7f4b040ccf90 0x7f4b040b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:26.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.979+0000 7f4b0c7ff700 1 -- 172.21.15.71:0/320335452 >> 172.21.15.71:0/320335452 conn(0x7f4b0406a320 msgr2=0x7f4b040cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:26.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.979+0000 7f4b0c7ff700 1 -- 172.21.15.71:0/320335452 shutdown_connections 2023-10-09T08:18:26.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.979+0000 7f4b0c7ff700 1 -- 172.21.15.71:0/320335452 wait complete. 2023-10-09T08:18:26.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.980+0000 7f4b0c7ff700 1 Processor -- start 2023-10-09T08:18:26.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.980+0000 7f4b0c7ff700 1 -- start start 2023-10-09T08:18:26.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.981+0000 7f4b0c7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b040cbf30 0x7f4b041699b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:26.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.981+0000 7f4b0c7ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b040ccf90 0x7f4b041510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:26.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.981+0000 7f4b0c7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b0415a270 0x7f4b040aaac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:26.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.981+0000 7f4b0c7ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b04157c60 con 0x7f4b040ccf90 2023-10-09T08:18:26.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.981+0000 7f4b0c7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b04156d70 con 0x7f4b040cbf30 2023-10-09T08:18:26.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.981+0000 7f4b0c7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b04157050 con 0x7f4b0415a270 2023-10-09T08:18:26.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.981+0000 7f4b09d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b040ccf90 0x7f4b041510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:26.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.981+0000 7f4b09d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b040ccf90 0x7f4b041510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44274/0 (socket says 172.21.15.71:44274) 2023-10-09T08:18:26.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.981+0000 7f4b09d9a700 1 -- 172.21.15.71:0/1328226599 learned_addr learned my addr 172.21.15.71:0/1328226599 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:26.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.982+0000 7f4b0ad9c700 1 --2- 172.21.15.71:0/1328226599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b0415a270 0x7f4b040aaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:26.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.982+0000 7f4b0a59b700 1 --2- 172.21.15.71:0/1328226599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b040cbf30 0x7f4b041699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:26.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.982+0000 7f4b09d9a700 1 -- 172.21.15.71:0/1328226599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b0415a270 msgr2=0x7f4b040aaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:26.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.982+0000 7f4b09d9a700 1 --2- 172.21.15.71:0/1328226599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b0415a270 0x7f4b040aaac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:26.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.982+0000 7f4b09d9a700 1 -- 172.21.15.71:0/1328226599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b040cbf30 msgr2=0x7f4b041699b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:26.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.982+0000 7f4b09d9a700 1 --2- 172.21.15.71:0/1328226599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b040cbf30 0x7f4b041699b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:26.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.982+0000 7f4b09d9a700 1 -- 172.21.15.71:0/1328226599 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b00009420 con 0x7f4b040ccf90 2023-10-09T08:18:26.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.982+0000 7f4b09d9a700 1 --2- 172.21.15.71:0/1328226599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b040ccf90 0x7f4b041510a0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f4af400d890 tx=0x7f4af4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:26.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.982+0000 7f4afa7fc700 1 -- 172.21.15.71:0/1328226599 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af400b690 con 0x7f4b040ccf90 2023-10-09T08:18:26.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.982+0000 7f4afa7fc700 1 -- 172.21.15.71:0/1328226599 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af400b7f0 con 0x7f4b040ccf90 2023-10-09T08:18:26.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.982+0000 7f4b0c7ff700 1 -- 172.21.15.71:0/1328226599 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b04157330 con 0x7f4b040ccf90 2023-10-09T08:18:26.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.982+0000 7f4afa7fc700 1 -- 172.21.15.71:0/1328226599 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af400bb70 con 0x7f4b040ccf90 2023-10-09T08:18:26.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.982+0000 7f4b0c7ff700 1 -- 172.21.15.71:0/1328226599 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b041578f0 con 0x7f4b040ccf90 2023-10-09T08:18:26.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.983+0000 7f4b0c7ff700 1 -- 172.21.15.71:0/1328226599 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0404c3c0 con 0x7f4b040ccf90 2023-10-09T08:18:26.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.984+0000 7f4afa7fc700 1 -- 172.21.15.71:0/1328226599 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4af401e460 con 0x7f4b040ccf90 2023-10-09T08:18:26.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.985+0000 7f4afa7fc700 1 --2- 172.21.15.71:0/1328226599 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f4ae8066f30 0x7f4ae80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:26.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.985+0000 7f4afa7fc700 1 -- 172.21.15.71:0/1328226599 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f4af4084e90 con 0x7f4b040ccf90 2023-10-09T08:18:26.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.985+0000 7f4b0a59b700 1 --2- 172.21.15.71:0/1328226599 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f4ae8066f30 0x7f4ae80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:26.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.986+0000 7f4b0a59b700 1 --2- 172.21.15.71:0/1328226599 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f4ae8066f30 0x7f4ae80693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4b000093f0 tx=0x7f4b00017000 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:26.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:26.989+0000 7f4afa7fc700 1 -- 172.21.15.71:0/1328226599 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4af4051f20 con 0x7f4b040ccf90 2023-10-09T08:18:27.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.175+0000 7f4b0c7ff700 1 -- 172.21.15.71:0/1328226599 --> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b04157da0 con 0x7f4ae8066f30 2023-10-09T08:18:27.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.178+0000 7f4afa7fc700 1 -- 172.21.15.71:0/1328226599 <== mgr.9898 v2:172.21.15.179:6835/101206 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50666 (secure 0 0 0) 0x7f4b04157da0 con 0x7f4ae8066f30 2023-10-09T08:18:27.180 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:18:27.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.180+0000 7f4b0c7ff700 1 -- 172.21.15.71:0/1328226599 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f4ae8066f30 msgr2=0x7f4ae80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:27.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.180+0000 7f4b0c7ff700 1 --2- 172.21.15.71:0/1328226599 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f4ae8066f30 0x7f4ae80693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4b000093f0 tx=0x7f4b00017000 comp rx=0 tx=0).stop 2023-10-09T08:18:27.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.180+0000 7f4b0c7ff700 1 -- 172.21.15.71:0/1328226599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b040ccf90 msgr2=0x7f4b041510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:27.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.180+0000 7f4b0c7ff700 1 --2- 172.21.15.71:0/1328226599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b040ccf90 0x7f4b041510a0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f4af400d890 tx=0x7f4af4008040 comp rx=0 tx=0).stop 2023-10-09T08:18:27.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.180+0000 7f4b0c7ff700 1 -- 172.21.15.71:0/1328226599 shutdown_connections 2023-10-09T08:18:27.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.180+0000 7f4b0c7ff700 1 --2- 172.21.15.71:0/1328226599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b0415a270 0x7f4b040aaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:27.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.180+0000 7f4b0c7ff700 1 --2- 172.21.15.71:0/1328226599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b040cbf30 0x7f4b041699b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:27.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.180+0000 7f4b0c7ff700 1 --2- 172.21.15.71:0/1328226599 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f4ae8066f30 0x7f4ae80693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:27.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.180+0000 7f4b0c7ff700 1 --2- 172.21.15.71:0/1328226599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b040ccf90 0x7f4b041510a0 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:27.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.180+0000 7f4b0c7ff700 1 -- 172.21.15.71:0/1328226599 >> 172.21.15.71:0/1328226599 conn(0x7f4b0406a320 msgr2=0x7f4b0406d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:27.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.180+0000 7f4b0c7ff700 1 -- 172.21.15.71:0/1328226599 shutdown_connections 2023-10-09T08:18:27.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.181+0000 7f4b0c7ff700 1 -- 172.21.15.71:0/1328226599 wait complete. 2023-10-09T08:18:27.183 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-09T08:18:27.199 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-09T08:18:25.218312+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":371,"ondisk_log_size":371,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2461992,"kb_used_data":22248,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752512728,"statfs":{"total":773094113280,"available":770573033472,"internally_reserved":0,"allocated":22781952,"data_stored":12081432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002477"},"pg_stats":[{"pgid":"1.0","version":"215'371","reported_seq":1237,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-09T08:18:06.801298+0000","last_change":"2023-10-09T08:18:06.801260+0000","last_active":"2023-10-09T08:18:06.801298+0000","last_peered":"2023-10-09T08:18:06.801298+0000","last_clean":"2023-10-09T08:18:06.801298+0000","last_became_active":"2023-10-09T06:42:28.245492+0000","last_became_peered":"2023-10-09T06:42:28.245492+0000","last_unstale":"2023-10-09T08:18:06.801298+0000","last_undegraded":"2023-10-09T08:18:06.801298+0000","last_fullsized":"2023-10-09T08:18:06.801298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"215'371","last_scrub_stamp":"2023-10-09T08:18:06.801163+0000","last_deep_scrub":"215'371","last_deep_scrub_stamp":"2023-10-09T08:18:06.801163+0000","last_clean_scrub_stamp":"2023-10-09T08:18:06.801163+0000","objects_scrubbed":2,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:12.665772+0000","scrub_duration":0.0055440690000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":371,"ondisk_log_size":371,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575984,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312792,"kb_used_data":3216,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059048,"statfs":{"total":96636764160,"available":96316465152,"internally_reserved":0,"allocated":3293184,"data_stored":1952955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72899999999999998,"15min":0.751},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85799999999999998,"5min":0.98699999999999999,"15min":1.1220000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72399999999999998,"15min":0.74099999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.93300000000000005,"5min":1.0069999999999999,"15min":1.0209999999999999},"last":0.70099999999999996}]},{"osd":1,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.879,"5min":1.28,"15min":1.28},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.71899999999999997,"15min":0.74299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90000000000000002,"5min":1.298,"15min":1.298},"last":0.80000000000000004}]},{"osd":2,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73199999999999998,"15min":0.74399999999999999},"min":{"1min":0.47599999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88700000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.87},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.745,"15min":0.76700000000000002},"min":{"1min":0.55700000000000005,"5min":0.49299999999999999,"15min":0.442},"max":{"1min":0.90200000000000002,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.73499999999999999}]},{"osd":3,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73099999999999998,"15min":0.73699999999999999},"min":{"1min":0.50900000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86099999999999999,"5min":1.399,"15min":1.399},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.76400000000000001,"15min":0.77200000000000002},"min":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.91500000000000004,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.96299999999999997}]},{"osd":4,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.62,"15min":0.60499999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83999999999999997,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63900000000000001,"15min":0.629},"min":{"1min":0.40699999999999997,"5min":0.39900000000000002,"15min":0.38600000000000001},"max":{"1min":0.96299999999999997,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.75900000000000001}]},{"osd":5,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.376},"max":{"1min":0.85999999999999999,"5min":1.413,"15min":1.413},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.40100000000000002},"max":{"1min":0.96399999999999997,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.82899999999999996}]},{"osd":6,"last update":"Mon Oct 9 08:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74399999999999999,"15min":0.73699999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98899999999999999,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70899999999999996,"15min":0.70599999999999996},"min":{"1min":0.48299999999999998,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":1.016,"5min":1.595,"15min":1.595},"last":0.71499999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":316308,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055532,"statfs":{"total":96636764160,"available":96312864768,"internally_reserved":0,"allocated":2699264,"data_stored":1362587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.75700000000000001,"15min":0.74399999999999999},"min":{"1min":0.50700000000000001,"5min":0.46899999999999997,"15min":0.40300000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0189999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.73199999999999998,"15min":0.72799999999999998},"min":{"1min":0.46700000000000003,"5min":0.44400000000000001,"15min":0.35399999999999998},"max":{"1min":0.86699999999999999,"5min":0.96299999999999997,"15min":0.97399999999999998},"last":0.82699999999999996}]},{"osd":1,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73599999999999999,"15min":0.74299999999999999},"min":{"1min":0.47499999999999998,"5min":0.45300000000000001,"15min":0.38500000000000001},"max":{"1min":0.83599999999999997,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77400000000000002,"15min":0.76000000000000001},"min":{"1min":0.52700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.96299999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.79300000000000004}]},{"osd":2,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.496,"5min":0.495,"15min":0.47099999999999997},"max":{"1min":0.97099999999999997,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76900000000000002,"15min":0.77100000000000002},"min":{"1min":0.56899999999999995,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.72499999999999998}]},{"osd":3,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.504,"15min":0.45300000000000001},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79800000000000004,"15min":0.78700000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.99099999999999999,"5min":1.119,"15min":1.119},"last":0.74099999999999999}]},{"osd":4,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64200000000000002,"15min":0.63800000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.40200000000000002},"max":{"1min":0.93300000000000005,"5min":1.0149999999999999,"15min":1.032},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.32000000000000001},"max":{"1min":0.82999999999999996,"5min":0.90300000000000002,"15min":0.93700000000000006},"last":0.40999999999999998}]},{"osd":5,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.67300000000000004,"15min":0.67200000000000004},"min":{"1min":0.53000000000000003,"5min":0.42399999999999999,"15min":0.40100000000000002},"max":{"1min":0.97699999999999998,"5min":1.232,"15min":1.232},"last":0.499},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.72099999999999997,"15min":0.70899999999999996},"min":{"1min":0.496,"5min":0.46600000000000003,"15min":0.45200000000000001},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.121},"last":0.59099999999999997}]},{"osd":7,"last update":"Mon Oct 9 08:17:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.69799999999999995,"15min":0.68899999999999995},"min":{"1min":0.54800000000000004,"5min":0.46800000000000003,"15min":0.36299999999999999},"max":{"1min":0.92800000000000005,"5min":0.93200000000000005,"15min":0.98699999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.755,"15min":0.74199999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.442},"max":{"1min":1.008,"5min":1.194,"15min":1.194},"last":0.53400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308116,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063724,"statfs":{"total":96636764160,"available":96321253376,"internally_reserved":0,"allocated":2699264,"data_stored":1362587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.439,"15min":0.45300000000000001},"min":{"1min":0.29299999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.57599999999999996,"5min":0.68100000000000005,"15min":0.82099999999999995},"last":0.437},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.51000000000000001,"15min":0.51400000000000001},"min":{"1min":0.35899999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.72899999999999998,"5min":0.78300000000000003,"15min":1.2230000000000001},"last":0.67400000000000004}]},{"osd":2,"last update":"Mon Oct 9 08:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.505,"15min":0.51100000000000001},"min":{"1min":0.32000000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68799999999999994,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.56499999999999995,"15min":0.58099999999999996},"min":{"1min":0.41399999999999998,"5min":0.40300000000000002,"15min":0.39500000000000002},"max":{"1min":0.76400000000000001,"5min":0.77300000000000002,"15min":0.96399999999999997},"last":0.56599999999999995}]},{"osd":3,"last update":"Mon Oct 9 08:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.60299999999999998,"15min":0.621},"min":{"1min":0.46400000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.70299999999999996,"5min":0.84199999999999997,"15min":1.2589999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56999999999999995,"15min":0.58199999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79800000000000004,"5min":0.80700000000000005,"15min":1.1519999999999999},"last":0.48199999999999998}]},{"osd":4,"last update":"Mon Oct 9 08:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.54700000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98199999999999998,"5min":1.1759999999999999,"15min":1.224},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.78900000000000003,"15min":0.80000000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51800000000000002},"max":{"1min":0.90300000000000002,"5min":1.071,"15min":1.5800000000000001},"last":0.74199999999999999}]},{"osd":5,"last update":"Mon Oct 9 08:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.79600000000000004,"15min":0.80700000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95999999999999996,"5min":1.1850000000000001,"15min":1.77},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.80200000000000005,"15min":0.80100000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49299999999999999},"max":{"1min":1.0369999999999999,"5min":1.262,"15min":1.288},"last":0.77500000000000002}]},{"osd":6,"last update":"Mon Oct 9 08:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.79800000000000004,"15min":0.81599999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.95499999999999996,"5min":1.143,"15min":1.3160000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.82599999999999996,"15min":0.83499999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.004,"5min":1.135,"15min":1.843},"last":0.72599999999999998}]},{"osd":7,"last update":"Mon Oct 9 08:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.84899999999999998,"15min":0.85799999999999998},"min":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.014,"5min":1.135,"15min":1.9139999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.999,"5min":1.2270000000000001,"15min":1.347},"last":0.82399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575983,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308696,"kb_used_data":3216,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063144,"statfs":{"total":96636764160,"available":96320659456,"internally_reserved":0,"allocated":3293184,"data_stored":1952955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46500000000000002,"15min":0.48099999999999998},"min":{"1min":0.315,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61099999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.51600000000000001,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.64100000000000001,"5min":0.82199999999999995,"15min":0.83599999999999997},"last":0.44600000000000001}]},{"osd":2,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.55100000000000005,"15min":0.57399999999999995},"min":{"1min":0.40699999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.63300000000000001,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48699999999999999,"15min":0.50600000000000001},"min":{"1min":0.33300000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.61399999999999999,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.51200000000000001}]},{"osd":3,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.50700000000000001,"15min":0.52900000000000003},"min":{"1min":0.38300000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69599999999999995,"5min":0.78200000000000003,"15min":0.80500000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59399999999999997,"15min":0.61399999999999999},"min":{"1min":0.438,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84299999999999997,"5min":0.92100000000000004,"15min":0.93200000000000005},"last":0.56699999999999995}]},{"osd":4,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77900000000000003,"15min":0.78400000000000003},"min":{"1min":0.48599999999999999,"5min":0.46600000000000003,"15min":0.42899999999999999},"max":{"1min":1.0780000000000001,"5min":1.1759999999999999,"15min":1.226},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.53000000000000003},"max":{"1min":1.0229999999999999,"5min":1.216,"15min":1.23},"last":1.0469999999999999}]},{"osd":5,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79300000000000004,"15min":0.81000000000000005},"min":{"1min":0.63500000000000001,"5min":0.51500000000000001,"15min":0.501},"max":{"1min":1.008,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":1.01},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78900000000000003,"15min":0.81499999999999995},"min":{"1min":0.55100000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97799999999999998,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.0289999999999999}]},{"osd":6,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.83499999999999996,"15min":0.84599999999999997},"min":{"1min":0.621,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0680000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":1},{"interface":"front","average":{"1min":0.746,"5min":0.79100000000000004,"15min":0.81799999999999995},"min":{"1min":0.56999999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94099999999999995,"5min":1.1819999999999999,"15min":1.24},"last":1.083}]},{"osd":7,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.85799999999999998},"min":{"1min":0.59699999999999998,"5min":0.497,"15min":0.497},"max":{"1min":1.163,"5min":1.2470000000000001,"15min":1.2929999999999999},"last":1.137},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.83999999999999997,"15min":0.871},"min":{"1min":0.58399999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0880000000000001,"5min":1.2,"15min":1.2110000000000001},"last":0.98099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299924,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071916,"statfs":{"total":96636764160,"available":96329641984,"internally_reserved":0,"allocated":2699264,"data_stored":1362587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46300000000000002,"15min":0.46800000000000003},"min":{"1min":0.28499999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57599999999999996,"5min":0.67900000000000005,"15min":0.752},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.47899999999999998,"15min":0.498},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.59099999999999997,"5min":0.73299999999999998,"15min":0.82299999999999995},"last":0.40500000000000003}]},{"osd":1,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48299999999999998,"15min":0.49299999999999999},"min":{"1min":0.34000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.60199999999999998,"5min":1.03,"15min":1.03},"last":0.433},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69799999999999995,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.67000000000000004}]},{"osd":3,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.441,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.73299999999999998,"5min":0.89000000000000001,"15min":0.96999999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.43099999999999999},"max":{"1min":0.73199999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.624}]},{"osd":4,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78700000000000003,"15min":0.80800000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0129999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.79200000000000004,"15min":0.79500000000000004},"min":{"1min":0.56499999999999995,"5min":0.54500000000000004,"15min":0.48399999999999999},"max":{"1min":1.0960000000000001,"5min":1.206,"15min":1.206},"last":0.72899999999999998}]},{"osd":5,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.78900000000000003,"15min":0.80400000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93100000000000005,"5min":1.181,"15min":1.181},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79700000000000004,"15min":0.81999999999999995},"min":{"1min":0.57599999999999996,"5min":0.56799999999999995,"15min":0.47799999999999998},"max":{"1min":0.96699999999999997,"5min":1.234,"15min":1.234},"last":0.77500000000000002}]},{"osd":6,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.98199999999999998,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.80300000000000005,"15min":0.82799999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0529999999999999,"5min":1.1799999999999999,"15min":1.224},"last":0.753}]},{"osd":7,"last update":"Mon Oct 9 08:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.84099999999999997,"15min":0.85799999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.47899999999999998},"max":{"1min":1.0329999999999999,"5min":1.448,"15min":1.448},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.86199999999999999,"15min":0.873},"min":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1299999999999999,"5min":1.518,"15min":1.518},"last":0.81599999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312212,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059628,"statfs":{"total":96636764160,"available":96317059072,"internally_reserved":0,"allocated":2699264,"data_stored":1362587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46999999999999997,"15min":0.48599999999999999},"min":{"1min":0.316,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70599999999999996,"5min":0.78600000000000003,"15min":0.85999999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.498,"15min":0.504},"min":{"1min":0.39900000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.438}]},{"osd":1,"last update":"Mon Oct 9 08:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.47699999999999998,"15min":0.504},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.57499999999999996,"5min":0.70999999999999996,"15min":0.83999999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54600000000000004,"15min":0.56799999999999995},"min":{"1min":0.35999999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91300000000000003},"last":0.49199999999999999}]},{"osd":2,"last update":"Mon Oct 9 08:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57299999999999995,"15min":0.59299999999999997},"min":{"1min":0.45500000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.97299999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.63200000000000001,"15min":0.65400000000000003},"min":{"1min":0.41999999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.036},"last":0.57899999999999996}]},{"osd":4,"last update":"Mon Oct 9 08:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.75,"15min":0.77500000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46000000000000002},"max":{"1min":0.98499999999999999,"5min":1.175,"15min":1.175},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.83699999999999997,"15min":0.86199999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0209999999999999,"5min":1.0629999999999999,"15min":1.2190000000000001},"last":0.84899999999999998}]},{"osd":5,"last update":"Mon Oct 9 08:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.502,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.85899999999999999,"5min":1.1419999999999999,"15min":1.2170000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.80100000000000005,"15min":0.82599999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.98599999999999999,"5min":1.1080000000000001,"15min":1.1739999999999999},"last":0.78300000000000003}]},{"osd":6,"last update":"Mon Oct 9 08:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92000000000000004,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79600000000000004,"15min":0.81000000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93799999999999994,"5min":1.093,"15min":1.149},"last":0.69299999999999995}]},{"osd":7,"last update":"Mon Oct 9 08:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82799999999999996,"15min":0.84999999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.95999999999999996,"5min":1.0800000000000001,"15min":1.1859999999999999},"last":0.871},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.83799999999999997,"15min":0.85099999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.012,"5min":1.147,"15min":1.1639999999999999},"last":0.81499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":304020,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067820,"statfs":{"total":96636764160,"available":96325447680,"internally_reserved":0,"allocated":2699264,"data_stored":1362587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69999999999999996,"15min":0.71799999999999997},"min":{"1min":0.44800000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90700000000000003,"5min":0.94799999999999995,"15min":1.0029999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71599999999999997,"15min":0.73699999999999999},"min":{"1min":0.48099999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.94199999999999995,"5min":0.995,"15min":0.995},"last":0.81899999999999995}]},{"osd":1,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.71799999999999997},"min":{"1min":0.48099999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84899999999999998,"5min":0.92700000000000005,"15min":1.03},"last":0.62},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70599999999999996,"15min":0.73399999999999999},"min":{"1min":0.47699999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94199999999999995,"5min":0.97299999999999998,"15min":1.0009999999999999},"last":0.66000000000000003}]},{"osd":2,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77100000000000002,"15min":0.79200000000000004},"min":{"1min":0.58099999999999996,"5min":0.51200000000000001,"15min":0.45000000000000001},"max":{"1min":0.95999999999999996,"5min":0.99399999999999999,"15min":1.0569999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.80100000000000005},"min":{"1min":0.52900000000000003,"5min":0.51000000000000001,"15min":0.47999999999999998},"max":{"1min":0.95199999999999996,"5min":0.97999999999999998,"15min":1.077},"last":0.79800000000000004}]},{"osd":3,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71499999999999997,"15min":0.73999999999999999},"min":{"1min":0.55200000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.876,"5min":0.96999999999999997,"15min":1.016},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73799999999999999,"15min":0.76700000000000002},"min":{"1min":0.53200000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90200000000000002,"5min":0.92200000000000004,"15min":1.036},"last":0.67800000000000005}]},{"osd":5,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.36899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77200000000000002,"5min":0.94899999999999995,"15min":1.006},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.629,"15min":0.63},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84999999999999998,"5min":0.94199999999999995,"15min":1.0580000000000001},"last":0.76500000000000001}]},{"osd":6,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.439,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.996,"5min":1.022,"15min":1.034},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67000000000000004,"15min":0.67900000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85599999999999998,"5min":0.998,"15min":1.0609999999999999},"last":0.70199999999999996}]},{"osd":7,"last update":"Mon Oct 9 08:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71899999999999997,"15min":0.72599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.44700000000000001},"max":{"1min":0.89500000000000002,"5min":1.036,"15min":1.036},"last":0.877},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76400000000000001,"15min":0.77500000000000002},"min":{"1min":0.59299999999999997,"5min":0.498,"15min":0.443},"max":{"1min":1.044,"5min":1.0609999999999999,"15min":1.079},"last":0.86199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299924,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071916,"statfs":{"total":96636764160,"available":96329641984,"internally_reserved":0,"allocated":2699264,"data_stored":1362587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.71299999999999997,"15min":0.72799999999999998},"min":{"1min":0.49399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.88},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.69499999999999995,"15min":0.70999999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.40899999999999997},"max":{"1min":0.79200000000000004,"5min":0.96699999999999997,"15min":0.97699999999999998},"last":0.81699999999999995}]},{"osd":1,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68500000000000005,"15min":0.71399999999999997},"min":{"1min":0.46999999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.86099999999999999,"5min":0.90400000000000003,"15min":1.0129999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.752,"15min":0.746},"min":{"1min":0.443,"5min":0.443,"15min":0.435},"max":{"1min":0.98599999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.65700000000000003}]},{"osd":2,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72399999999999998,"15min":0.745},"min":{"1min":0.52200000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88300000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73399999999999999,"15min":0.74299999999999999},"min":{"1min":0.54500000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.90200000000000002,"5min":0.99299999999999999,"15min":1.1359999999999999},"last":0.85399999999999998}]},{"osd":3,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72999999999999998,"15min":0.745},"min":{"1min":0.52100000000000002,"5min":0.50900000000000001,"15min":0.49199999999999999},"max":{"1min":0.94099999999999995,"5min":0.95999999999999996,"15min":0.98199999999999998},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76800000000000002,"15min":0.78600000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":1.0189999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.77700000000000002}]},{"osd":4,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.51200000000000001,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.60999999999999999},"min":{"1min":0.437,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89100000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.755}]},{"osd":6,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63100000000000001,"15min":0.625},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.98699999999999999,"5min":1,"15min":1},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.70699999999999996,"15min":0.68300000000000005},"min":{"1min":0.46100000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0840000000000001,"5min":1.123,"15min":1.123},"last":0.79400000000000004}]},{"osd":7,"last update":"Mon Oct 9 08:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69499999999999995,"15min":0.68600000000000005},"min":{"1min":0.48299999999999998,"5min":0.48099999999999998,"15min":0.44400000000000001},"max":{"1min":0.97999999999999998,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.58499999999999996,"5min":0.50600000000000001,"15min":0.48599999999999999},"max":{"1min":1.052,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.94799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T08:18:27.202 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-09T08:18:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.379+0000 7f9370d9d700 1 Processor -- start 2023-10-09T08:18:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.380+0000 7f9370d9d700 1 -- start start 2023-10-09T08:18:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.381+0000 7f9370d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f936c1407e0 0x7f936c06a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.381+0000 7f9370d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f936c06dc00 0x7f936c06a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.381+0000 7f9370d9d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f936c0c6820 con 0x7f936c140bb0 2023-10-09T08:18:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.381+0000 7f9370d9d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f936c0c6de0 con 0x7f936c1407e0 2023-10-09T08:18:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.381+0000 7f9370d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f936c141270 con 0x7f936c06dc00 2023-10-09T08:18:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.381+0000 7f936b7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f936c1407e0 0x7f936c06a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.381+0000 7f936affd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f936c140bb0 0x7f936c06d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43992/0 (socket says 172.21.15.71:43992) 2023-10-09T08:18:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.381+0000 7f936affd700 1 -- 172.21.15.71:0/3544372055 learned_addr learned my addr 172.21.15.71:0/3544372055 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-09T08:18:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.382+0000 7f936bfff700 1 --2- 172.21.15.71:0/3544372055 >> v2:172.21.15.179:3300/0 conn(0x7f936c06dc00 0x7f936c06a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.382+0000 7f936b7fe700 1 -- 172.21.15.71:0/3544372055 >> v2:172.21.15.179:3300/0 conn(0x7f936c06dc00 msgr2=0x7f936c06a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.382+0000 7f936b7fe700 1 --2- 172.21.15.71:0/3544372055 >> v2:172.21.15.179:3300/0 conn(0x7f936c06dc00 0x7f936c06a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.382+0000 7f936b7fe700 1 -- 172.21.15.71:0/3544372055 >> v1:172.21.15.71:6789/0 conn(0x7f936c140bb0 legacy=0x7f936c06d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.382+0000 7f936b7fe700 1 -- 172.21.15.71:0/3544372055 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c06acf0 con 0x7f936c1407e0 2023-10-09T08:18:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.382+0000 7f936a7fc700 1 -- 172.21.15.71:0/3544372055 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988371794 0 0) 0x7f936c0c6820 con 0x7f936c140bb0 2023-10-09T08:18:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.382+0000 7f936b7fe700 1 --2- 172.21.15.71:0/3544372055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f936c1407e0 0x7f936c06a180 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f936c0aed40 tx=0x7f935c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7860573c187eaf10 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.382+0000 7f936a7fc700 1 -- 172.21.15.71:0/3544372055 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c00b6b0 con 0x7f936c1407e0 2023-10-09T08:18:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.382+0000 7f936a7fc700 1 -- 172.21.15.71:0/3544372055 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c00b810 con 0x7f936c1407e0 2023-10-09T08:18:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.382+0000 7f936a7fc700 1 -- 172.21.15.71:0/3544372055 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c00bbb0 con 0x7f936c1407e0 2023-10-09T08:18:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.383+0000 7f9370d9d700 1 -- 172.21.15.71:0/3544372055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f936c1407e0 msgr2=0x7f936c06a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.383+0000 7f9370d9d700 1 --2- 172.21.15.71:0/3544372055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f936c1407e0 0x7f936c06a180 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f936c0aed40 tx=0x7f935c0091a0 comp rx=0 tx=0).stop 2023-10-09T08:18:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.383+0000 7f9370d9d700 1 -- 172.21.15.71:0/3544372055 shutdown_connections 2023-10-09T08:18:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.383+0000 7f9370d9d700 1 --2- 172.21.15.71:0/3544372055 >> v2:172.21.15.179:3300/0 conn(0x7f936c06dc00 0x7f936c06a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.383+0000 7f9370d9d700 1 --2- 172.21.15.71:0/3544372055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f936c1407e0 0x7f936c06a180 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.383+0000 7f9370d9d700 1 -- 172.21.15.71:0/3544372055 >> 172.21.15.71:0/3544372055 conn(0x7f936c0cc1e0 msgr2=0x7f936c0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.383+0000 7f9370d9d700 1 -- 172.21.15.71:0/3544372055 shutdown_connections 2023-10-09T08:18:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.383+0000 7f9370d9d700 1 -- 172.21.15.71:0/3544372055 wait complete. 2023-10-09T08:18:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.384+0000 7f9370d9d700 1 Processor -- start 2023-10-09T08:18:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.384+0000 7f9370d9d700 1 -- start start 2023-10-09T08:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.385+0000 7f9370d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f936c06dc00 0x7f936c167ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.385+0000 7f9370d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f936c1407e0 0x7f936c16aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.385+0000 7f9370d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f936c140bb0 0x7f936c0c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.385+0000 7f9370d9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c15b4b0 con 0x7f936c140bb0 2023-10-09T08:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.385+0000 7f9370d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c0c65b0 con 0x7f936c06dc00 2023-10-09T08:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.385+0000 7f9370d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936c15ae60 con 0x7f936c1407e0 2023-10-09T08:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.386+0000 7f936bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f936c140bb0 0x7f936c0c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.386+0000 7f936bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f936c140bb0 0x7f936c0c5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44302/0 (socket says 172.21.15.71:44302) 2023-10-09T08:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.386+0000 7f936bfff700 1 -- 172.21.15.71:0/3995706961 learned_addr learned my addr 172.21.15.71:0/3995706961 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.386+0000 7f936b7fe700 1 --2- 172.21.15.71:0/3995706961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f936c06dc00 0x7f936c167ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.386+0000 7f936affd700 1 --2- 172.21.15.71:0/3995706961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f936c1407e0 0x7f936c16aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.386+0000 7f936bfff700 1 -- 172.21.15.71:0/3995706961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f936c1407e0 msgr2=0x7f936c16aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.386+0000 7f936bfff700 1 --2- 172.21.15.71:0/3995706961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f936c1407e0 0x7f936c16aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.386+0000 7f936bfff700 1 -- 172.21.15.71:0/3995706961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f936c06dc00 msgr2=0x7f936c167ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.386+0000 7f936bfff700 1 --2- 172.21.15.71:0/3995706961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f936c06dc00 0x7f936c167ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.386+0000 7f936bfff700 1 -- 172.21.15.71:0/3995706961 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935c009420 con 0x7f936c140bb0 2023-10-09T08:18:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.386+0000 7f936bfff700 1 --2- 172.21.15.71:0/3995706961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f936c140bb0 0x7f936c0c5eb0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f9364007f20 tx=0x7f93640098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.386+0000 7f93537fe700 1 -- 172.21.15.71:0/3995706961 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936400eca0 con 0x7f936c140bb0 2023-10-09T08:18:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.387+0000 7f93537fe700 1 -- 172.21.15.71:0/3995706961 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936400ee20 con 0x7f936c140bb0 2023-10-09T08:18:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.387+0000 7f9370d9d700 1 -- 172.21.15.71:0/3995706961 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f936c15b140 con 0x7f936c140bb0 2023-10-09T08:18:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.387+0000 7f93537fe700 1 -- 172.21.15.71:0/3995706961 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9364014670 con 0x7f936c140bb0 2023-10-09T08:18:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.387+0000 7f9370d9d700 1 -- 172.21.15.71:0/3995706961 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936c0c3bd0 con 0x7f936c140bb0 2023-10-09T08:18:27.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.388+0000 7f9370d9d700 1 -- 172.21.15.71:0/3995706961 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f936c06c450 con 0x7f936c140bb0 2023-10-09T08:18:27.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.388+0000 7f93537fe700 1 -- 172.21.15.71:0/3995706961 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9364014a60 con 0x7f936c140bb0 2023-10-09T08:18:27.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.389+0000 7f93537fe700 1 --2- 172.21.15.71:0/3995706961 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9358066f30 0x7f93580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:27.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.389+0000 7f93537fe700 1 -- 172.21.15.71:0/3995706961 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f9364084e70 con 0x7f936c140bb0 2023-10-09T08:18:27.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.390+0000 7f936b7fe700 1 --2- 172.21.15.71:0/3995706961 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9358066f30 0x7f93580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:27.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.391+0000 7f936b7fe700 1 --2- 172.21.15.71:0/3995706961 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9358066f30 0x7f93580693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f935c0091e0 tx=0x7f935c017000 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.393+0000 7f93537fe700 1 -- 172.21.15.71:0/3995706961 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9364051f00 con 0x7f936c140bb0 2023-10-09T08:18:27.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.586+0000 7f9370d9d700 1 -- 172.21.15.71:0/3995706961 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f936c06afd0 con 0x7f936c140bb0 2023-10-09T08:18:27.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.591+0000 7f93537fe700 1 -- 172.21.15.71:0/3995706961 <== mon.0 v2:172.21.15.71:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9364009a00 con 0x7f936c140bb0 2023-10-09T08:18:27.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.592+0000 7f93537fe700 1 -- 172.21.15.71:0/3995706961 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v76)=0 v76) v1 ==== 123+0+0 (secure 0 0 0) 0x7f9364055520 con 0x7f936c140bb0 2023-10-09T08:18:27.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.595+0000 7f9370d9d700 1 -- 172.21.15.71:0/3995706961 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9358066f30 msgr2=0x7f93580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:27.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.595+0000 7f9370d9d700 1 --2- 172.21.15.71:0/3995706961 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9358066f30 0x7f93580693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f935c0091e0 tx=0x7f935c017000 comp rx=0 tx=0).stop 2023-10-09T08:18:27.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.595+0000 7f9370d9d700 1 -- 172.21.15.71:0/3995706961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f936c140bb0 msgr2=0x7f936c0c5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:27.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.595+0000 7f9370d9d700 1 --2- 172.21.15.71:0/3995706961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f936c140bb0 0x7f936c0c5eb0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f9364007f20 tx=0x7f93640098a0 comp rx=0 tx=0).stop 2023-10-09T08:18:27.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.595+0000 7f9370d9d700 1 -- 172.21.15.71:0/3995706961 shutdown_connections 2023-10-09T08:18:27.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.595+0000 7f9370d9d700 1 --2- 172.21.15.71:0/3995706961 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7f9358066f30 0x7f93580693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:27.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.595+0000 7f9370d9d700 1 --2- 172.21.15.71:0/3995706961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f936c140bb0 0x7f936c0c5eb0 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:27.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.595+0000 7f9370d9d700 1 --2- 172.21.15.71:0/3995706961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f936c06dc00 0x7f936c167ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:27.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.595+0000 7f9370d9d700 1 --2- 172.21.15.71:0/3995706961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f936c1407e0 0x7f936c16aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:27.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.595+0000 7f9370d9d700 1 -- 172.21.15.71:0/3995706961 >> 172.21.15.71:0/3995706961 conn(0x7f936c0cc1e0 msgr2=0x7f936c0cc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:27.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.595+0000 7f9370d9d700 1 -- 172.21.15.71:0/3995706961 shutdown_connections 2023-10-09T08:18:27.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.595+0000 7f9370d9d700 1 -- 172.21.15.71:0/3995706961 wait complete. 2023-10-09T08:18:27.613 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T08:18:27.614 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T08:18:27.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.793+0000 7ff5badff700 1 Processor -- start 2023-10-09T08:18:27.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.793+0000 7ff5badff700 1 -- start start 2023-10-09T08:18:27.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.794+0000 7ff5badff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff5b4155c10 0x7ff5b4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:27.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.794+0000 7ff5badff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b40ac230 0x7ff5b40ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:27.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.794+0000 7ff5badff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff5b41568a0 0x7ff5b4156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:27.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.794+0000 7ff5badff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b40ad930 con 0x7ff5b4155c10 2023-10-09T08:18:27.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.794+0000 7ff5badff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b40acd20 con 0x7ff5b41568a0 2023-10-09T08:18:27.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.794+0000 7ff5badff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b40ad000 con 0x7ff5b40ac230 2023-10-09T08:18:27.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.795+0000 7ff5b8b9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff5b4155c10 0x7ff5b4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:27.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.795+0000 7ff5b8b9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff5b4155c10 0x7ff5b4155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44310/0 (socket says 172.21.15.71:44310) 2023-10-09T08:18:27.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.795+0000 7ff5b8b9b700 1 -- 172.21.15.71:0/1038342790 learned_addr learned my addr 172.21.15.71:0/1038342790 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:27.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.795+0000 7ff5b3fff700 1 --2- 172.21.15.71:0/1038342790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b40ac230 0x7ff5b40ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:27.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.795+0000 7ff5b939c700 1 --2- 172.21.15.71:0/1038342790 >> v2:172.21.15.179:3300/0 conn(0x7ff5b41568a0 0x7ff5b4156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:27.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.795+0000 7ff5b8b9b700 1 -- 172.21.15.71:0/1038342790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b40ac230 msgr2=0x7ff5b40ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:27.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.795+0000 7ff5b8b9b700 1 --2- 172.21.15.71:0/1038342790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b40ac230 0x7ff5b40ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:27.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.795+0000 7ff5b8b9b700 1 -- 172.21.15.71:0/1038342790 >> v2:172.21.15.179:3300/0 conn(0x7ff5b41568a0 msgr2=0x7ff5b4156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T08:18:27.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.795+0000 7ff5b8b9b700 1 --2- 172.21.15.71:0/1038342790 >> v2:172.21.15.179:3300/0 conn(0x7ff5b41568a0 0x7ff5b4156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:27.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.795+0000 7ff5b8b9b700 1 -- 172.21.15.71:0/1038342790 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b40ad2e0 con 0x7ff5b4155c10 2023-10-09T08:18:27.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.796+0000 7ff5b8b9b700 1 --2- 172.21.15.71:0/1038342790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5b4155c10 0x7ff5b4155fe0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40c8c60 tx=0x7ff5a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a51d074d979a95 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:27.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.796+0000 7ff5b37fe700 1 -- 172.21.15.71:0/1038342790 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a800b860 con 0x7ff5b4155c10 2023-10-09T08:18:27.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.796+0000 7ff5b37fe700 1 -- 172.21.15.71:0/1038342790 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff5a800b9c0 con 0x7ff5b4155c10 2023-10-09T08:18:27.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.796+0000 7ff5b37fe700 1 -- 172.21.15.71:0/1038342790 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a800bd80 con 0x7ff5b4155c10 2023-10-09T08:18:27.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.796+0000 7ff5badff700 1 -- 172.21.15.71:0/1038342790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5b4155c10 msgr2=0x7ff5b4155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:27.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.796+0000 7ff5badff700 1 --2- 172.21.15.71:0/1038342790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5b4155c10 0x7ff5b4155fe0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40c8c60 tx=0x7ff5a8009250 comp rx=0 tx=0).stop 2023-10-09T08:18:27.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.796+0000 7ff5badff700 1 -- 172.21.15.71:0/1038342790 shutdown_connections 2023-10-09T08:18:27.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.796+0000 7ff5badff700 1 --2- 172.21.15.71:0/1038342790 >> v2:172.21.15.179:3300/0 conn(0x7ff5b41568a0 0x7ff5b4156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:27.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.796+0000 7ff5badff700 1 --2- 172.21.15.71:0/1038342790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5b4155c10 0x7ff5b4155fe0 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:27.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.796+0000 7ff5badff700 1 --2- 172.21.15.71:0/1038342790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b40ac230 0x7ff5b40ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:27.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.796+0000 7ff5badff700 1 -- 172.21.15.71:0/1038342790 >> 172.21.15.71:0/1038342790 conn(0x7ff5b406a320 msgr2=0x7ff5b40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:27.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.796+0000 7ff5badff700 1 -- 172.21.15.71:0/1038342790 shutdown_connections 2023-10-09T08:18:27.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.796+0000 7ff5badff700 1 -- 172.21.15.71:0/1038342790 wait complete. 2023-10-09T08:18:27.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.798+0000 7ff5badff700 1 Processor -- start 2023-10-09T08:18:27.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.798+0000 7ff5badff700 1 -- start start 2023-10-09T08:18:27.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.799+0000 7ff5badff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5b40ac230 0x7ff5b40a6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:27.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.799+0000 7ff5badff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b4155c10 0x7ff5b40aab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:27.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.799+0000 7ff5badff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5b41568a0 0x7ff5b4158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:27.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.799+0000 7ff5badff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b416a1f0 con 0x7ff5b41568a0 2023-10-09T08:18:27.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.799+0000 7ff5badff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b40a6570 con 0x7ff5b40ac230 2023-10-09T08:18:27.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.799+0000 7ff5badff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b41598b0 con 0x7ff5b4155c10 2023-10-09T08:18:27.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.799+0000 7ff5b939c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5b41568a0 0x7ff5b4158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:27.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.799+0000 7ff5b939c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5b41568a0 0x7ff5b4158cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44318/0 (socket says 172.21.15.71:44318) 2023-10-09T08:18:27.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.799+0000 7ff5b939c700 1 -- 172.21.15.71:0/3503049219 learned_addr learned my addr 172.21.15.71:0/3503049219 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-09T08:18:27.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.799+0000 7ff5b3fff700 1 --2- 172.21.15.71:0/3503049219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b4155c10 0x7ff5b40aab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:27.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.799+0000 7ff5b8b9b700 1 --2- 172.21.15.71:0/3503049219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5b40ac230 0x7ff5b40a6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:27.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.799+0000 7ff5b939c700 1 -- 172.21.15.71:0/3503049219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b4155c10 msgr2=0x7ff5b40aab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:27.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.799+0000 7ff5b939c700 1 --2- 172.21.15.71:0/3503049219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b4155c10 0x7ff5b40aab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:27.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.799+0000 7ff5b939c700 1 -- 172.21.15.71:0/3503049219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5b40ac230 msgr2=0x7ff5b40a6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:27.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.799+0000 7ff5b939c700 1 --2- 172.21.15.71:0/3503049219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5b40ac230 0x7ff5b40a6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:27.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.799+0000 7ff5b939c700 1 -- 172.21.15.71:0/3503049219 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a80094f0 con 0x7ff5b41568a0 2023-10-09T08:18:27.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.799+0000 7ff5b3fff700 1 --2- 172.21.15.71:0/3503049219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b4155c10 0x7ff5b40aab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:18:27.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.800+0000 7ff5b8b9b700 1 --2- 172.21.15.71:0/3503049219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5b40ac230 0x7ff5b40a6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T08:18:27.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.800+0000 7ff5b939c700 1 --2- 172.21.15.71:0/3503049219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5b41568a0 0x7ff5b4158cd0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac009fa0 tx=0x7ff5ac009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:27.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.800+0000 7ff5b0ff9700 1 -- 172.21.15.71:0/3503049219 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac00ed20 con 0x7ff5b41568a0 2023-10-09T08:18:27.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.800+0000 7ff5b0ff9700 1 -- 172.21.15.71:0/3503049219 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff5ac00ee80 con 0x7ff5b41568a0 2023-10-09T08:18:27.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.800+0000 7ff5b0ff9700 1 -- 172.21.15.71:0/3503049219 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac014690 con 0x7ff5b41568a0 2023-10-09T08:18:27.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.800+0000 7ff5badff700 1 -- 172.21.15.71:0/3503049219 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b4159b90 con 0x7ff5b41568a0 2023-10-09T08:18:27.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.800+0000 7ff5badff700 1 -- 172.21.15.71:0/3503049219 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b40a6200 con 0x7ff5b41568a0 2023-10-09T08:18:27.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.801+0000 7ff5badff700 1 -- 172.21.15.71:0/3503049219 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b40a6700 con 0x7ff5b41568a0 2023-10-09T08:18:27.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.802+0000 7ff5b0ff9700 1 -- 172.21.15.71:0/3503049219 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 109) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff5ac014a00 con 0x7ff5b41568a0 2023-10-09T08:18:27.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.803+0000 7ff5b0ff9700 1 --2- 172.21.15.71:0/3503049219 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff598066f30 0x7ff5980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T08:18:27.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.803+0000 7ff5b0ff9700 1 -- 172.21.15.71:0/3503049219 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6018+0+0 (secure 0 0 0) 0x7ff5ac084f30 con 0x7ff5b41568a0 2023-10-09T08:18:27.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.803+0000 7ff5b8b9b700 1 --2- 172.21.15.71:0/3503049219 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff598066f30 0x7ff5980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T08:18:27.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.804+0000 7ff5b8b9b700 1 --2- 172.21.15.71:0/3503049219 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff598066f30 0x7ff5980693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40c8c60 tx=0x7ff5a8009250 comp rx=0 tx=0).ready entity=mgr.9898 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T08:18:27.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:27.807+0000 7ff5b0ff9700 1 -- 172.21.15.71:0/3503049219 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5ac052040 con 0x7ff5b41568a0 2023-10-09T08:18:28.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:28.038+0000 7ff5badff700 1 -- 172.21.15.71:0/3503049219 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5b404c3c0 con 0x7ff5b41568a0 2023-10-09T08:18:28.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:28.038+0000 7ff5b0ff9700 1 -- 172.21.15.71:0/3503049219 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+3534 (secure 0 0 0) 0x7ff5ac014cb0 con 0x7ff5b41568a0 2023-10-09T08:18:28.040 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-09T08:18:28.040 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":99,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1242627383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1242627383},{"type":"v1","addr":"172.21.15.179:6836","nonce":1242627383}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":9628,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1306881721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1306881721},{"type":"v1","addr":"172.21.15.179:6834","nonce":1306881721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10143,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/717406174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":717406174},{"type":"v1","addr":"172.21.15.71:6834","nonce":717406174}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10527,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/4263382795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":4263382795},{"type":"v1","addr":"172.21.15.71:6835","nonce":4263382795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99}],"filesystems":[]} 2023-10-09T08:18:28.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:28.041+0000 7ff5badff700 1 -- 172.21.15.71:0/3503049219 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff598066f30 msgr2=0x7ff5980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:28.041+0000 7ff5badff700 1 --2- 172.21.15.71:0/3503049219 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff598066f30 0x7ff5980693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40c8c60 tx=0x7ff5a8009250 comp rx=0 tx=0).stop 2023-10-09T08:18:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:28.041+0000 7ff5badff700 1 -- 172.21.15.71:0/3503049219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5b41568a0 msgr2=0x7ff5b4158cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T08:18:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:28.041+0000 7ff5badff700 1 --2- 172.21.15.71:0/3503049219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5b41568a0 0x7ff5b4158cd0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac009fa0 tx=0x7ff5ac009900 comp rx=0 tx=0).stop 2023-10-09T08:18:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:28.041+0000 7ff5badff700 1 -- 172.21.15.71:0/3503049219 shutdown_connections 2023-10-09T08:18:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:28.041+0000 7ff5badff700 1 --2- 172.21.15.71:0/3503049219 >> [v2:172.21.15.179:6835/101206,v1:172.21.15.179:6837/101206] conn(0x7ff598066f30 0x7ff5980693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:28.041+0000 7ff5badff700 1 --2- 172.21.15.71:0/3503049219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5b41568a0 0x7ff5b4158cd0 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:28.041+0000 7ff5badff700 1 --2- 172.21.15.71:0/3503049219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5b40ac230 0x7ff5b40a6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:28.041+0000 7ff5badff700 1 --2- 172.21.15.71:0/3503049219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b4155c10 0x7ff5b40aab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T08:18:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:28.041+0000 7ff5badff700 1 -- 172.21.15.71:0/3503049219 >> 172.21.15.71:0/3503049219 conn(0x7ff5b406a320 msgr2=0x7ff5b41548b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T08:18:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:28.041+0000 7ff5badff700 1 -- 172.21.15.71:0/3503049219 shutdown_connections 2023-10-09T08:18:28.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-09T08:18:28.041+0000 7ff5badff700 1 -- 172.21.15.71:0/3503049219 wait complete. 2023-10-09T08:18:28.044 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 99 2023-10-09T08:18:28.060 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-09T08:18:28.060 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-09T08:18:28.060 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T08:18:28.060 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:18:28.073 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T08:18:28.073 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T08:18:28.073 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:18:28.128 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T08:18:28.128 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T08:18:28.128 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:18:28.145 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T08:18:28.146 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T08:18:28.146 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:18:28.202 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T08:18:28.202 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-09T08:18:28.202 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-09T08:18:28.202 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:18:28.249 INFO:tasks.ceph.osd.0:Stopped 2023-10-09T08:18:28.249 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-09T08:18:28.250 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:18:28.300 INFO:tasks.ceph.osd.1:Stopped 2023-10-09T08:18:28.301 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-09T08:18:28.301 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:18:28.347 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:18:28.353 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:18:28.354 INFO:tasks.ceph.osd.2:Stopped 2023-10-09T08:18:28.355 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-09T08:18:28.355 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:18:28.439 INFO:tasks.ceph.osd.3:Stopped 2023-10-09T08:18:28.439 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-09T08:18:28.439 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:18:28.483 INFO:tasks.ceph.osd.4:Stopped 2023-10-09T08:18:28.483 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-09T08:18:28.483 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:18:28.565 INFO:tasks.ceph.osd.5:Stopped 2023-10-09T08:18:28.565 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-09T08:18:28.565 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:18:28.621 INFO:tasks.ceph.osd.6:Stopped 2023-10-09T08:18:28.622 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-09T08:18:28.622 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:18:28.677 INFO:tasks.ceph.osd.7:Stopped 2023-10-09T08:18:28.677 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-09T08:18:28.677 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-09T08:18:28.677 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:18:28.737 INFO:tasks.ceph.mgr.y:Stopped 2023-10-09T08:18:28.738 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-09T08:18:28.738 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:18:28.804 INFO:tasks.ceph.mgr.x:Stopped 2023-10-09T08:18:28.804 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-09T08:18:28.804 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-09T08:18:28.804 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:18:28.835 INFO:tasks.ceph.mon.a:Stopped 2023-10-09T08:18:28.836 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-09T08:18:28.836 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:18:28.859 INFO:tasks.ceph.mon.b:Stopped 2023-10-09T08:18:28.859 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-09T08:18:28.859 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T08:18:28.924 INFO:tasks.ceph.mon.c:Stopped 2023-10-09T08:18:28.924 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-09T08:18:28.925 DEBUG:teuthology.orchestra.run.smithi071:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-09T08:18:28.997 INFO:teuthology.orchestra.run.smithi071.stdout:1696838385.8347495 mon.a (mon.0) 1382 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-10-09T08:18:28.999 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-09T08:18:28.999 DEBUG:teuthology.orchestra.run.smithi071:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-09T08:18:29.070 DEBUG:teuthology.orchestra.run.smithi071:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-09T08:18:29.143 DEBUG:teuthology.orchestra.run.smithi071:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-09T08:18:29.213 INFO:teuthology.orchestra.run.smithi071.stdout:1696838385.8347495 mon.a (mon.0) 1382 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-10-09T08:18:29.215 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T08:18:29.215 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-09T08:18:29.536 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T08:18:29.536 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-09T08:18:29.751 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T08:18:29.751 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-09T08:18:29.963 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T08:18:29.963 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-09T08:18:30.172 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-09T08:18:30.172 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-09T08:18:30.493 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-09T08:18:30.494 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-09T08:18:30.686 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-09T08:18:30.686 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-09T08:18:30.888 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi179.front.sepia.ceph.com 2023-10-09T08:18:30.888 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-09T08:18:31.060 INFO:tasks.ceph:Archiving mon data... 2023-10-09T08:18:31.062 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418378/data/mon.a.tgz 2023-10-09T08:18:31.062 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2023-10-09T08:18:31.102 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.uaywrKr8zH 2023-10-09T08:18:31.102 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.uaywrKr8zH 2023-10-09T08:18:31.574 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.uaywrKr8zH 2023-10-09T08:18:31.674 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.uaywrKr8zH is 2MB 2023-10-09T08:18:31.809 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.uaywrKr8zH 2023-10-09T08:18:31.845 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418378/data/mon.b.tgz 2023-10-09T08:18:31.846 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2023-10-09T08:18:31.884 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.LOnGhMWc8I 2023-10-09T08:18:31.885 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.LOnGhMWc8I 2023-10-09T08:18:32.376 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.LOnGhMWc8I 2023-10-09T08:18:32.476 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.LOnGhMWc8I is 2MB 2023-10-09T08:18:32.591 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.LOnGhMWc8I 2023-10-09T08:18:32.628 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418378/data/mon.c.tgz 2023-10-09T08:18:32.628 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2023-10-09T08:18:32.703 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.f28nZzTYYy 2023-10-09T08:18:32.704 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.f28nZzTYYy 2023-10-09T08:18:33.167 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.f28nZzTYYy 2023-10-09T08:18:33.266 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.f28nZzTYYy is 2MB 2023-10-09T08:18:33.389 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.f28nZzTYYy 2023-10-09T08:18:33.426 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-09T08:18:33.426 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-09T08:18:33.433 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-09T08:18:33.527 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-09T08:18:33.527 DEBUG:teuthology.orchestra.run.smithi071:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-09T08:18:33.531 DEBUG:teuthology.orchestra.run.smithi179:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-09T08:18:33.599 INFO:teuthology.orchestra.run.smithi179.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-09T08:18:33.672 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-09T08:18:33.688 INFO:tasks.ceph:Archiving crash dumps... 2023-10-09T08:18:33.690 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418378/remote/smithi071/crash 2023-10-09T08:18:33.691 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-09T08:18:33.750 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418378/remote/smithi179/crash 2023-10-09T08:18:33.751 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-09T08:18:33.811 INFO:tasks.ceph:Shutting down logrotate 2023-10-09T08:18:33.811 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:18:33.815 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T08:18:33.907 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-09T08:18:33.968 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-09T08:18:34.028 INFO:tasks.ceph:Compressing logs... 2023-10-09T08:18:34.028 DEBUG:teuthology.orchestra.run.smithi071:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-09T08:18:34.033 DEBUG:teuthology.orchestra.run.smithi179:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-09T08:18:34.088 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101157.log 2023-10-09T08:18:34.089 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95487.log 2023-10-09T08:18:34.090 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.101157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125946.log 2023-10-09T08:18:34.090 INFO:teuthology.orchestra.run.smithi071.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.101157.log.gz 2023-10-09T08:18:34.091 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.95487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125705.log 2023-10-09T08:18:34.091 INFO:teuthology.orchestra.run.smithi071.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.95487.log.gz 2023-10-09T08:18:34.092 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85817.log 2023-10-09T08:18:34.093 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125946.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.125946.log.gz 2023-10-09T08:18:34.093 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110096.log 2023-10-09T08:18:34.094 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-09T08:18:34.094 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125705.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.125705.log.gz 2023-10-09T08:18:34.094 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104740.log 2023-10-09T08:18:34.095 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.110096.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.110096.log.gz 2023-10-09T08:18:34.095 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137855.log 2023-10-09T08:18:34.097 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.104740.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104740.log.gz 2023-10-09T08:18:34.097 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97656.log 2023-10-09T08:18:34.097 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.137855.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.137855.log.gz 2023-10-09T08:18:34.097 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134207.log 2023-10-09T08:18:34.097 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.85817.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-09T08:18:34.098 INFO:teuthology.orchestra.run.smithi179.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.85817.log.gz 2023-10-09T08:18:34.098 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-09T08:18:34.098 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85901.log 2023-10-09T08:18:34.098 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-09T08:18:34.099 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.85901.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.85901.log.gz 2023-10-09T08:18:34.099 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-09T08:18:34.100 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.97656.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97656.log.gz 2023-10-09T08:18:34.100 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133363.log 2023-10-09T08:18:34.100 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.134207.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.134207.log.gz 2023-10-09T08:18:34.100 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129784.log 2023-10-09T08:18:34.100 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133363.log: gzip 88.7%-5 -- replaced with /var/log/ceph/ceph-client.admin.133363.log.gz--verbose 2023-10-09T08:18:34.100 INFO:teuthology.orchestra.run.smithi071.stderr:-- /var/log/ceph/ceph-client.admin.102125.log 2023-10-09T08:18:34.104 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-09T08:18:34.104 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-09T08:18:34.104 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85686.log 2023-10-09T08:18:34.105 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129784.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.129784.log.gz-5 2023-10-09T08:18:34.105 INFO:teuthology.orchestra.run.smithi071.stderr:--verbose -- /var/log/ceph/ceph-client.admin.114697.log 2023-10-09T08:18:34.105 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.102125.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102125.log.gz 2023-10-09T08:18:34.105 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116330.log 2023-10-09T08:18:34.105 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114697.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114697.log.gz 2023-10-09T08:18:34.105 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95655.log 2023-10-09T08:18:34.105 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.116330.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116330.log.gz 2023-10-09T08:18:34.105 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118541.log 2023-10-09T08:18:34.106 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.95655.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95655.log.gz 2023-10-09T08:18:34.106 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109795.log 2023-10-09T08:18:34.111 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118541.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.118541.log.gz 2023-10-09T08:18:34.111 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119718.log 2023-10-09T08:18:34.111 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.109795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125476.log 2023-10-09T08:18:34.111 INFO:teuthology.orchestra.run.smithi071.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.109795.log.gz 2023-10-09T08:18:34.111 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119718.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.119718.log.gz 2023-10-09T08:18:34.111 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93676.log 2023-10-09T08:18:34.111 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125476.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.125476.log.gz 2023-10-09T08:18:34.112 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96079.log 2023-10-09T08:18:34.112 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.93676.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93676.log.gz 2023-10-09T08:18:34.112 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116431.log 2023-10-09T08:18:34.112 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96079.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96079.log.gz 2023-10-09T08:18:34.112 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133997.log 2023-10-09T08:18:34.118 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.116431.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116431.log.gz 2023-10-09T08:18:34.118 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133281.log 2023-10-09T08:18:34.118 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133997.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.133997.log.gz 2023-10-09T08:18:34.118 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103876.log 2023-10-09T08:18:34.118 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133281.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.133281.log.gz 2023-10-09T08:18:34.118 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91532.log 2023-10-09T08:18:34.119 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.103876.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103876.log.gz 2023-10-09T08:18:34.119 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103686.log 2023-10-09T08:18:34.119 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.91532.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91532.log.gz 2023-10-09T08:18:34.119 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104165.log 2023-10-09T08:18:34.119 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.103686.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.103686.log.gz 2023-10-09T08:18:34.119 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141815.log 2023-10-09T08:18:34.119 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.104165.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104165.log.gz 2023-10-09T08:18:34.119 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116846.log 2023-10-09T08:18:34.120 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mon.c.log: 93.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-09T08:18:34.120 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85859.log 2023-10-09T08:18:34.120 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.85686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85942.log 2023-10-09T08:18:34.120 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.85859.log: 87.6% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.85686.log.gz 2023-10-09T08:18:34.120 INFO:teuthology.orchestra.run.smithi179.stderr: -- replaced with /var/log/ceph/ceph-client.admin.85859.log.gz 2023-10-09T08:18:34.120 INFO:teuthology.orchestra.run.smithi179.stderr: 93.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-09T08:18:34.121 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-09T08:18:34.121 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.85942.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.85942.log.gz 2023-10-09T08:18:34.121 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.92429.log 2023-10-09T08:18:34.121 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85645.log 2023-10-09T08:18:34.121 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.3.92429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.92429.log.gz 2023-10-09T08:18:34.121 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-09T08:18:34.121 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.85645.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.85645.log.gz 2023-10-09T08:18:34.121 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85729.log 2023-10-09T08:18:34.121 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.92060.log 2023-10-09T08:18:34.121 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.85729.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.85729.log.gz 2023-10-09T08:18:34.122 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-09T08:18:34.123 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.1.92060.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.92060.log.gz 2023-10-09T08:18:34.123 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85772.log 2023-10-09T08:18:34.125 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141815.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.141815.log.gz 2023-10-09T08:18:34.126 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111422.log 2023-10-09T08:18:34.126 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.116846.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.116846.log.gz 2023-10-09T08:18:34.126 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114316.log 2023-10-09T08:18:34.126 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.111422.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111422.log.gz 2023-10-09T08:18:34.126 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129826.log 2023-10-09T08:18:34.126 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114316.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114316.log.gz 2023-10-09T08:18:34.126 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119667.log 2023-10-09T08:18:34.126 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129826.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.129826.log.gz 2023-10-09T08:18:34.126 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112866.log 2023-10-09T08:18:34.126 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119667.log: gzip -5 --verbose 88.0%-- -- replaced with /var/log/ceph/ceph-client.admin.119667.log.gz/var/log/ceph/ceph-client.0.121396.log 2023-10-09T08:18:34.126 INFO:teuthology.orchestra.run.smithi071.stderr: 2023-10-09T08:18:34.127 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.112866.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112866.log.gz 2023-10-09T08:18:34.127 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129173.log 2023-10-09T08:18:34.127 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.121396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.121396.log.gz 2023-10-09T08:18:34.127 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96743.log 2023-10-09T08:18:34.128 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129173.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.129173.log.gz 2023-10-09T08:18:34.128 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118089.log 2023-10-09T08:18:34.129 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118898.log 2023-10-09T08:18:34.129 INFO:teuthology.orchestra.run.smithi071.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96743.log.gz 2023-10-09T08:18:34.129 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118089.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118089.log.gz 2023-10-09T08:18:34.129 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100384.log 2023-10-09T08:18:34.129 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118898.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118898.log.gz 2023-10-09T08:18:34.130 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91824.log 2023-10-09T08:18:34.130 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.100384.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100384.log.gz 2023-10-09T08:18:34.130 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99369.log 2023-10-09T08:18:34.131 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.91824.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.91824.log.gz 2023-10-09T08:18:34.132 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126156.log 2023-10-09T08:18:34.132 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.99369.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99369.log.gz 2023-10-09T08:18:34.132 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104515.log 2023-10-09T08:18:34.133 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-09T08:18:34.133 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126156.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.126156.log.gz 2023-10-09T08:18:34.134 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92872.log 2023-10-09T08:18:34.134 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.104515.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104515.log.gz 2023-10-09T08:18:34.134 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128105.log 2023-10-09T08:18:34.135 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92872.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92872.log.gz 2023-10-09T08:18:34.135 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137348.log 2023-10-09T08:18:34.136 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128105.log: gzip 87.9%-5 -- replaced with /var/log/ceph/ceph-client.admin.128105.log.gz--verbose 2023-10-09T08:18:34.136 INFO:teuthology.orchestra.run.smithi071.stderr:-- /var/log/ceph/ceph-client.admin.99932.log 2023-10-09T08:18:34.137 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.137348.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.137348.log.gz 2023-10-09T08:18:34.137 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129027.log 2023-10-09T08:18:34.138 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.99932.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99932.log.gz 2023-10-09T08:18:34.138 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121093.log 2023-10-09T08:18:34.139 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129027.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.129027.log.gz 2023-10-09T08:18:34.139 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126114.log 2023-10-09T08:18:34.140 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121093.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.121093.log.gz 2023-10-09T08:18:34.140 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109440.log 2023-10-09T08:18:34.141 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126114.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.126114.log.gz 2023-10-09T08:18:34.141 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100616.log 2023-10-09T08:18:34.142 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.85772.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.85772.log.gz 2023-10-09T08:18:34.143 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.109440.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109440.log.gz 2023-10-09T08:18:34.143 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104081.log 2023-10-09T08:18:34.143 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.100616.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100616.log.gz 2023-10-09T08:18:34.143 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110732.log 2023-10-09T08:18:34.144 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.104081.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.104081.log.gz 2023-10-09T08:18:34.144 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92549.log 2023-10-09T08:18:34.145 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.110732.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110732.log.gz 2023-10-09T08:18:34.145 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125850.log 2023-10-09T08:18:34.146 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92549.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92549.log.gz 2023-10-09T08:18:34.146 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119505.log 2023-10-09T08:18:34.147 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125850.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125850.log.gz 2023-10-09T08:18:34.147 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103500.log 2023-10-09T08:18:34.148 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119505.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.119505.log.gz 2023-10-09T08:18:34.148 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103966.log 2023-10-09T08:18:34.149 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.103500.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.103500.log.gz 2023-10-09T08:18:34.149 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109526.log 2023-10-09T08:18:34.150 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.103966.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103966.log.gz 2023-10-09T08:18:34.150 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127442.log 2023-10-09T08:18:34.151 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.109526.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109526.log.gz 2023-10-09T08:18:34.151 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92038.log 2023-10-09T08:18:34.152 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127442.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.127442.log.gz 2023-10-09T08:18:34.152 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126938.log 2023-10-09T08:18:34.153 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92038.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92038.log.gz 2023-10-09T08:18:34.153 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95100.log 2023-10-09T08:18:34.154 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126938.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.126938.log.gz 2023-10-09T08:18:34.154 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129459.log 2023-10-09T08:18:34.155 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.95100.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95100.log.gz 2023-10-09T08:18:34.155 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114440.log 2023-10-09T08:18:34.156 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129459.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.129459.log.gz 2023-10-09T08:18:34.156 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91868.log 2023-10-09T08:18:34.157 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114440.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114440.log.gz 2023-10-09T08:18:34.157 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140288.log 2023-10-09T08:18:34.158 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.91868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112051.log 2023-10-09T08:18:34.159 INFO:teuthology.orchestra.run.smithi071.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.91868.log.gz 2023-10-09T08:18:34.159 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.140288.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140288.log.gz 2023-10-09T08:18:34.160 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115117.log 2023-10-09T08:18:34.160 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.112051.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.112051.log.gz 2023-10-09T08:18:34.160 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139887.log 2023-10-09T08:18:34.161 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.115117.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115117.log.gz 2023-10-09T08:18:34.162 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141017.log 2023-10-09T08:18:34.162 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.139887.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139887.log.gz 2023-10-09T08:18:34.163 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139729.log 2023-10-09T08:18:34.163 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141017.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141017.log.gz 2023-10-09T08:18:34.164 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127786.log 2023-10-09T08:18:34.164 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.139729.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.139729.log.gz 2023-10-09T08:18:34.164 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112824.log 2023-10-09T08:18:34.165 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127786.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127786.log.gz 2023-10-09T08:18:34.166 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106172.log 2023-10-09T08:18:34.166 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.112824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.112824.log.gz 2023-10-09T08:18:34.166 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-09T08:18:34.168 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.106172.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106172.log.gz 2023-10-09T08:18:34.168 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138638.log 2023-10-09T08:18:34.169 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133871.log 2023-10-09T08:18:34.169 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.138638.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.138638.log.gz 2023-10-09T08:18:34.170 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128320.log 2023-10-09T08:18:34.171 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133871.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.133871.log.gz 2023-10-09T08:18:34.171 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106130.log 2023-10-09T08:18:34.172 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128320.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.128320.log.gz 2023-10-09T08:18:34.172 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137679.log 2023-10-09T08:18:34.173 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.106130.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106130.log.gz 2023-10-09T08:18:34.173 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138460.log 2023-10-09T08:18:34.173 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.137679.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.137679.log.gz 2023-10-09T08:18:34.174 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108702.log 2023-10-09T08:18:34.175 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.138460.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.138460.log.gz 2023-10-09T08:18:34.175 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111770.log 2023-10-09T08:18:34.175 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.108702.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108702.log.gz 2023-10-09T08:18:34.176 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128549.log 2023-10-09T08:18:34.176 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.111770.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111770.log.gz 2023-10-09T08:18:34.177 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140010.log 2023-10-09T08:18:34.177 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128549.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.128549.log.gz 2023-10-09T08:18:34.178 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114823.log 2023-10-09T08:18:34.178 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.140010.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.140010.log.gz 2023-10-09T08:18:34.179 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126852.log 2023-10-09T08:18:34.179 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114823.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114823.log.gz 2023-10-09T08:18:34.180 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140476.log 2023-10-09T08:18:34.180 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126852.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.126852.log.gz 2023-10-09T08:18:34.181 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140801.log 2023-10-09T08:18:34.181 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.140476.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140476.log.gz 2023-10-09T08:18:34.182 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93216.log 2023-10-09T08:18:34.183 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.140801.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140801.log.gz 2023-10-09T08:18:34.183 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121137.log 2023-10-09T08:18:34.183 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.93216.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93216.log.gz 2023-10-09T08:18:34.184 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95865.log 2023-10-09T08:18:34.185 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133955.log 2023-10-09T08:18:34.185 INFO:teuthology.orchestra.run.smithi071.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.121137.log.gz 2023-10-09T08:18:34.185 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.95865.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.95865.log.gz 2023-10-09T08:18:34.186 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109627.log 2023-10-09T08:18:34.187 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133955.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.133955.log.gz 2023-10-09T08:18:34.187 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136903.log 2023-10-09T08:18:34.188 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.109627.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.109627.log.gz-5 2023-10-09T08:18:34.188 INFO:teuthology.orchestra.run.smithi071.stderr:--verbose -- /var/log/ceph/ceph-client.admin.132435.log 2023-10-09T08:18:34.189 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.136903.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.136903.log.gz 2023-10-09T08:18:34.189 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116804.log 2023-10-09T08:18:34.190 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.132435.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.132435.log.gz 2023-10-09T08:18:34.190 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97276.log 2023-10-09T08:18:34.191 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.116804.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116804.log.gz 2023-10-09T08:18:34.192 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112397.log 2023-10-09T08:18:34.193 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.97276.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97276.log.gz 2023-10-09T08:18:34.193 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109753.log 2023-10-09T08:18:34.193 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.112397.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.112397.log.gz 2023-10-09T08:18:34.194 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120952.log 2023-10-09T08:18:34.194 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.109753.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109753.log.gz 2023-10-09T08:18:34.194 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140331.log 2023-10-09T08:18:34.195 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120952.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.120952.log.gz 2023-10-09T08:18:34.196 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134315.log 2023-10-09T08:18:34.196 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.140331.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.140331.log.gz 2023-10-09T08:18:34.197 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101875.log 2023-10-09T08:18:34.197 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.134315.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.134315.log.gz 2023-10-09T08:18:34.198 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110422.log 2023-10-09T08:18:34.198 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.101875.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101875.log.gz 2023-10-09T08:18:34.198 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112565.log 2023-10-09T08:18:34.199 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.110422.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110422.log.gz 2023-10-09T08:18:34.199 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92374.log 2023-10-09T08:18:34.200 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.112565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117584.log 2023-10-09T08:18:34.201 INFO:teuthology.orchestra.run.smithi071.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.112565.log.gz 2023-10-09T08:18:34.202 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92374.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92374.log.gz 2023-10-09T08:18:34.202 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108576.log 2023-10-09T08:18:34.203 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117584.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117584.log.gz 2023-10-09T08:18:34.203 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93592.log 2023-10-09T08:18:34.204 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.108576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120446.log 2023-10-09T08:18:34.204 INFO:teuthology.orchestra.run.smithi071.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108576.log.gz 2023-10-09T08:18:34.205 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.93592.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93592.log.gz 2023-10-09T08:18:34.205 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119176.log 2023-10-09T08:18:34.206 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120446.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.120446.log.gz 2023-10-09T08:18:34.206 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130162.log 2023-10-09T08:18:34.207 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119176.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.119176.log.gz 2023-10-09T08:18:34.207 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140148.log 2023-10-09T08:18:34.208 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130162.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.130162.log.gz 2023-10-09T08:18:34.208 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138594.log 2023-10-09T08:18:34.209 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.140148.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140148.log.gz 2023-10-09T08:18:34.209 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137164.log 2023-10-09T08:18:34.210 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.138594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139573.log 2023-10-09T08:18:34.210 INFO:teuthology.orchestra.run.smithi071.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.138594.log.gz 2023-10-09T08:18:34.211 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.137164.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.137164.log.gz 2023-10-09T08:18:34.211 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120074.log 2023-10-09T08:18:34.212 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.139573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110251.log 2023-10-09T08:18:34.212 INFO:teuthology.orchestra.run.smithi071.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139573.log.gz 2023-10-09T08:18:34.213 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120074.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.120074.log.gz 2023-10-09T08:18:34.213 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108416.log 2023-10-09T08:18:34.214 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.110251.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110251.log.gz 2023-10-09T08:18:34.214 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138330.log 2023-10-09T08:18:34.215 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.108416.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108416.log.gz 2023-10-09T08:18:34.215 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140196.log 2023-10-09T08:18:34.216 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.138330.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.138330.log.gz 2023-10-09T08:18:34.216 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129606.log 2023-10-09T08:18:34.217 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.140196.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140196.log.gz 2023-10-09T08:18:34.217 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116027.log 2023-10-09T08:18:34.218 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129606.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.129606.log.gz 2023-10-09T08:18:34.218 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120532.log 2023-10-09T08:18:34.219 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.116027.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.116027.log.gz 2023-10-09T08:18:34.219 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140102.log 2023-10-09T08:18:34.220 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120532.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120532.log.gz 2023-10-09T08:18:34.220 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115786.log 2023-10-09T08:18:34.221 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.140102.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.140102.log.gz 2023-10-09T08:18:34.221 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95226.log 2023-10-09T08:18:34.222 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.115786.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.115786.log.gz 2023-10-09T08:18:34.222 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118635.log 2023-10-09T08:18:34.223 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.95226.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95226.log.gz 2023-10-09T08:18:34.223 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114092.log 2023-10-09T08:18:34.224 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118635.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118635.log.gz 2023-10-09T08:18:34.224 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127911.log 2023-10-09T08:18:34.225 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114092.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114092.log.gz 2023-10-09T08:18:34.225 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134705.log 2023-10-09T08:18:34.226 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113607.log 2023-10-09T08:18:34.226 INFO:teuthology.orchestra.run.smithi071.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127911.log.gz 2023-10-09T08:18:34.227 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.134705.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.134705.log.gz 2023-10-09T08:18:34.227 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108083.log 2023-10-09T08:18:34.228 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.113607.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113607.log.gz 2023-10-09T08:18:34.228 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126896.log 2023-10-09T08:18:34.229 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.108083.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.108083.log.gz 2023-10-09T08:18:34.229 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119131.log 2023-10-09T08:18:34.230 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110684.log 2023-10-09T08:18:34.230 INFO:teuthology.orchestra.run.smithi071.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.126896.log.gz 2023-10-09T08:18:34.231 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119131.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119131.log.gz 2023-10-09T08:18:34.231 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126462.log 2023-10-09T08:18:34.232 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.110684.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110684.log.gz 2023-10-09T08:18:34.232 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97530.log 2023-10-09T08:18:34.233 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126462.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.126462.log.gz 2023-10-09T08:18:34.233 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134123.log 2023-10-09T08:18:34.234 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.97530.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97530.log.gz 2023-10-09T08:18:34.234 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96911.log 2023-10-09T08:18:34.235 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.134123.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.134123.log.gz 2023-10-09T08:18:34.235 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117320.log 2023-10-09T08:18:34.236 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96911.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96911.log.gz 2023-10-09T08:18:34.236 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116762.log 2023-10-09T08:18:34.237 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117320.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.117320.log.gz 2023-10-09T08:18:34.237 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99411.log 2023-10-09T08:18:34.238 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.116762.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.116762.log.gz 2023-10-09T08:18:34.239 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106036.log 2023-10-09T08:18:34.239 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.99411.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99411.log.gz 2023-10-09T08:18:34.240 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104291.log 2023-10-09T08:18:34.240 INFO:teuthology.orchestra.run.smithi071.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-09T08:18:34.241 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.106036.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.106036.log.gz 2023-10-09T08:18:34.241 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96541.log 2023-10-09T08:18:34.242 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.104291.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104291.log.gz 2023-10-09T08:18:34.242 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97488.log 2023-10-09T08:18:34.243 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96541.log: gzip -5 --verbose 88.8%-- /var/log/ceph/ceph-client.admin.128414.log -- replaced with /var/log/ceph/ceph-client.admin.96541.log.gz 2023-10-09T08:18:34.243 INFO:teuthology.orchestra.run.smithi071.stderr: 2023-10-09T08:18:34.244 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.97488.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97488.log.gz 2023-10-09T08:18:34.244 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97226.log 2023-10-09T08:18:34.245 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128414.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.128414.log.gz 2023-10-09T08:18:34.245 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97138.log 2023-10-09T08:18:34.246 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.97226.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97226.log.gz 2023-10-09T08:18:34.246 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110922.log 2023-10-09T08:18:34.247 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.97138.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97138.log.gz 2023-10-09T08:18:34.247 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92540.log 2023-10-09T08:18:34.248 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.110922.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110922.log.gz 2023-10-09T08:18:34.248 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93166.log 2023-10-09T08:18:34.249 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92540.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92540.log.gz 2023-10-09T08:18:34.249 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126768.log 2023-10-09T08:18:34.250 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.93166.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93166.log.gz 2023-10-09T08:18:34.250 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103125.log 2023-10-09T08:18:34.251 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126768.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.126768.log.gz 2023-10-09T08:18:34.251 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111812.log 2023-10-09T08:18:34.252 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.103125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120402.log 2023-10-09T08:18:34.252 INFO:teuthology.orchestra.run.smithi071.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.103125.log.gz 2023-10-09T08:18:34.253 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.111812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99243.log 2023-10-09T08:18:34.253 INFO:teuthology.orchestra.run.smithi071.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111812.log.gz 2023-10-09T08:18:34.254 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120402.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.120402.log.gz 2023-10-09T08:18:34.254 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113660.log 2023-10-09T08:18:34.255 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.99243.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99243.log.gz 2023-10-09T08:18:34.255 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103592.log 2023-10-09T08:18:34.255 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mon.b.log: 92.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-09T08:18:34.256 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.113660.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.113660.log.gz 2023-10-09T08:18:34.256 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114865.log 2023-10-09T08:18:34.257 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.103592.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.103592.log.gz 2023-10-09T08:18:34.257 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103821.log 2023-10-09T08:18:34.258 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114865.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.114865.log.gz 2023-10-09T08:18:34.258 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129251.log 2023-10-09T08:18:34.259 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.103821.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103821.log.gz 2023-10-09T08:18:34.259 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114398.log 2023-10-09T08:18:34.260 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129251.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.129251.log.gz 2023-10-09T08:18:34.260 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99025.log 2023-10-09T08:18:34.261 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114398.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.114398.log.gz 2023-10-09T08:18:34.261 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97824.log 2023-10-09T08:18:34.262 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.99025.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99025.log.gz 2023-10-09T08:18:34.262 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95142.log 2023-10-09T08:18:34.263 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.97824.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97824.log.gz 2023-10-09T08:18:34.263 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139075.log 2023-10-09T08:18:34.264 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.95142.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.95142.log.gz 2023-10-09T08:18:34.264 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93161.log 2023-10-09T08:18:34.265 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.139075.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.139075.log.gz 2023-10-09T08:18:34.265 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118023.log 2023-10-09T08:18:34.266 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.93161.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93161.log.gz 2023-10-09T08:18:34.266 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97698.log 2023-10-09T08:18:34.267 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108266.log 2023-10-09T08:18:34.267 INFO:teuthology.orchestra.run.smithi071.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.118023.log.gz 2023-10-09T08:18:34.268 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.97698.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97698.log.gz 2023-10-09T08:18:34.268 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111856.log 2023-10-09T08:18:34.269 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.108266.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108266.log.gz 2023-10-09T08:18:34.269 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128757.log 2023-10-09T08:18:34.270 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.111856.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.111856.log.gz 2023-10-09T08:18:34.270 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138848.log 2023-10-09T08:18:34.271 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128757.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.128757.log.gz 2023-10-09T08:18:34.271 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120012.log 2023-10-09T08:18:34.272 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.138848.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.138848.log.gz 2023-10-09T08:18:34.272 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131795.log 2023-10-09T08:18:34.273 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120012.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.120012.log.gz 2023-10-09T08:18:34.273 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92868.log 2023-10-09T08:18:34.274 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.131795.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.131795.log.gz 2023-10-09T08:18:34.274 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110638.log 2023-10-09T08:18:34.275 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92868.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92868.log.gz 2023-10-09T08:18:34.275 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111295.log 2023-10-09T08:18:34.276 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.110638.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110638.log.gz 2023-10-09T08:18:34.276 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108223.log 2023-10-09T08:18:34.277 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.111295.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111295.log.gz 2023-10-09T08:18:34.277 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116239.log 2023-10-09T08:18:34.278 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.108223.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108223.log.gz 2023-10-09T08:18:34.278 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133531.log 2023-10-09T08:18:34.279 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.116239.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116239.log.gz 2023-10-09T08:18:34.279 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141353.log 2023-10-09T08:18:34.280 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133531.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.133531.log.gz 2023-10-09T08:18:34.280 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138949.log 2023-10-09T08:18:34.281 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141353.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.141353.log.gz 2023-10-09T08:18:34.281 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120233.log 2023-10-09T08:18:34.282 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.138949.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.138949.log.gz 2023-10-09T08:18:34.282 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130204.log 2023-10-09T08:18:34.283 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120233.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.120233.log.gz 2023-10-09T08:18:34.283 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-09T08:18:34.284 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130204.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.130204.log.gz 2023-10-09T08:18:34.284 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103638.log 2023-10-09T08:18:34.285 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85913.log 2023-10-09T08:18:34.286 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.103638.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103638.log.gz 2023-10-09T08:18:34.286 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139771.log 2023-10-09T08:18:34.287 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.85913.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.85913.log.gz 2023-10-09T08:18:34.287 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128901.log 2023-10-09T08:18:34.288 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.139771.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.139771.log.gz 2023-10-09T08:18:34.288 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125615.log 2023-10-09T08:18:34.289 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128901.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.128901.log.gz 2023-10-09T08:18:34.289 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133489.log 2023-10-09T08:18:34.290 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125615.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125615.log.gz 2023-10-09T08:18:34.290 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133703.log 2023-10-09T08:18:34.291 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133489.log: 88.5% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-09T08:18:34.291 INFO:teuthology.orchestra.run.smithi071.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.133489.log.gz 2023-10-09T08:18:34.291 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120742.log 2023-10-09T08:18:34.292 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133703.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.133703.log.gz 2023-10-09T08:18:34.292 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96827.log 2023-10-09T08:18:34.293 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120742.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.120742.log.gz 2023-10-09T08:18:34.293 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111484.log 2023-10-09T08:18:34.294 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96827.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96827.log.gz 2023-10-09T08:18:34.294 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137771.log 2023-10-09T08:18:34.295 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.111484.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111484.log.gz 2023-10-09T08:18:34.295 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102625.log 2023-10-09T08:18:34.296 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.137771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105056.log 2023-10-09T08:18:34.296 INFO:teuthology.orchestra.run.smithi071.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.137771.log.gz 2023-10-09T08:18:34.297 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.102625.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102625.log.gz 2023-10-09T08:18:34.297 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96457.log 2023-10-09T08:18:34.298 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.105056.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105056.log.gz 2023-10-09T08:18:34.298 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92248.log 2023-10-09T08:18:34.299 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96457.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96457.log.gz 2023-10-09T08:18:34.299 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134654.log 2023-10-09T08:18:34.300 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92248.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.92248.log.gz 2023-10-09T08:18:34.300 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114991.log 2023-10-09T08:18:34.301 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.134654.log: gzip 89.2%-5 -- replaced with /var/log/ceph/ceph-client.admin.134654.log.gz 2023-10-09T08:18:34.301 INFO:teuthology.orchestra.run.smithi071.stderr:--verbose -- /var/log/ceph/ceph-client.admin.98322.log 2023-10-09T08:18:34.302 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114991.log: gzip 87.8%-5 -- replaced with /var/log/ceph/ceph-client.admin.114991.log.gz--verbose 2023-10-09T08:18:34.302 INFO:teuthology.orchestra.run.smithi071.stderr:-- /var/log/ceph/ceph-client.admin.129952.log 2023-10-09T08:18:34.303 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.98322.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98322.log.gz 2023-10-09T08:18:34.303 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137939.log 2023-10-09T08:18:34.304 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129952.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129952.log.gz 2023-10-09T08:18:34.304 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100100.log 2023-10-09T08:18:34.305 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.137939.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.137939.log.gz 2023-10-09T08:18:34.305 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95823.log 2023-10-09T08:18:34.306 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.100100.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100100.log.gz 2023-10-09T08:18:34.306 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108365.log 2023-10-09T08:18:34.307 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.95823.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95823.log.gz 2023-10-09T08:18:34.307 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94588.log 2023-10-09T08:18:34.308 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.108365.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108365.log.gz 2023-10-09T08:18:34.308 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132249.log 2023-10-09T08:18:34.309 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.94588.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.94588.log.gz 2023-10-09T08:18:34.309 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116620.log 2023-10-09T08:18:34.310 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.132249.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.132249.log.gz 2023-10-09T08:18:34.310 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108988.log 2023-10-09T08:18:34.311 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.116620.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116620.log.gz 2023-10-09T08:18:34.311 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98400.log 2023-10-09T08:18:34.312 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.108988.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108988.log.gz 2023-10-09T08:18:34.312 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96619.log 2023-10-09T08:18:34.313 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.98400.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.98400.log.gz 2023-10-09T08:18:34.313 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120360.log 2023-10-09T08:18:34.314 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96619.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96619.log.gz 2023-10-09T08:18:34.314 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139813.log 2023-10-09T08:18:34.315 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120360.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120360.log.gz 2023-10-09T08:18:34.315 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100058.log 2023-10-09T08:18:34.316 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.139813.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139813.log.gz 2023-10-09T08:18:34.316 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138246.log 2023-10-09T08:18:34.317 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.100058.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100058.log.gz 2023-10-09T08:18:34.317 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128048.log 2023-10-09T08:18:34.318 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.138246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100184.log 2023-10-09T08:18:34.318 INFO:teuthology.orchestra.run.smithi071.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.138246.log.gz 2023-10-09T08:18:34.319 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128048.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.128048.log.gz 2023-10-09T08:18:34.319 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132341.log 2023-10-09T08:18:34.320 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.100184.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.100184.log.gz 2023-10-09T08:18:34.320 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117939.log 2023-10-09T08:18:34.321 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.132341.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.132341.log.gz 2023-10-09T08:18:34.321 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113865.log 2023-10-09T08:18:34.322 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117939.log: gzip -5 --verbose 87.6%-- /var/log/ceph/ceph-client.admin.98800.log -- replaced with /var/log/ceph/ceph-client.admin.117939.log.gz 2023-10-09T08:18:34.322 INFO:teuthology.orchestra.run.smithi071.stderr: 2023-10-09T08:18:34.323 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.113865.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.113865.log.gz 2023-10-09T08:18:34.323 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121749.log 2023-10-09T08:18:34.324 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.98800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105308.log 88.3% 2023-10-09T08:18:34.324 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.98800.log.gz 2023-10-09T08:18:34.325 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121749.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.121749.log.gz-5 2023-10-09T08:18:34.325 INFO:teuthology.orchestra.run.smithi071.stderr:--verbose -- /var/log/ceph/ceph-client.admin.110824.log 2023-10-09T08:18:34.326 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.105308.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105308.log.gz 2023-10-09T08:18:34.326 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140975.log 2023-10-09T08:18:34.327 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.110824.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110824.log.gz 2023-10-09T08:18:34.327 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120826.log 2023-10-09T08:18:34.328 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.140975.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140975.log.gz 2023-10-09T08:18:34.328 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117014.log 2023-10-09T08:18:34.329 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120826.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.120826.log.gz 2023-10-09T08:18:34.329 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128275.log 2023-10-09T08:18:34.330 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117014.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.117014.log.gz 2023-10-09T08:18:34.330 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116930.log 2023-10-09T08:18:34.331 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128275.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.128275.log.gz 2023-10-09T08:18:34.331 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133787.log 2023-10-09T08:18:34.332 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.116930.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.116930.log.gz 2023-10-09T08:18:34.332 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126718.log 2023-10-09T08:18:34.333 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133787.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.133787.log.gz 2023-10-09T08:18:34.333 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128228.log 2023-10-09T08:18:34.334 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126718.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.126718.log.gz 2023-10-09T08:18:34.334 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93928.log 2023-10-09T08:18:34.335 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128228.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128228.log.gz 2023-10-09T08:18:34.335 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112355.log 2023-10-09T08:18:34.336 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.93928.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.93928.log.gz 2023-10-09T08:18:34.336 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116284.log 2023-10-09T08:18:34.337 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.112355.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112355.log.gz 2023-10-09T08:18:34.337 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116711.log 2023-10-09T08:18:34.338 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.116284.log: gzip -5 --verbose -- 87.8%/var/log/ceph/ceph-client.admin.99159.log -- replaced with /var/log/ceph/ceph-client.admin.116284.log.gz 2023-10-09T08:18:34.338 INFO:teuthology.orchestra.run.smithi071.stderr: 2023-10-09T08:18:34.339 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.116711.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116711.log.gz 2023-10-09T08:18:34.339 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137255.log 2023-10-09T08:18:34.340 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.99159.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99159.log.gz 2023-10-09T08:18:34.340 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108618.log 2023-10-09T08:18:34.341 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.137255.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.137255.log.gz 2023-10-09T08:18:34.341 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114567.log 2023-10-09T08:18:34.342 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.108618.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.108618.log.gz 2023-10-09T08:18:34.342 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.98125.log 2023-10-09T08:18:34.343 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114567.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114567.log.gz 2023-10-09T08:18:34.343 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98275.log 2023-10-09T08:18:34.343 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.98125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.98125.log.gz 2023-10-09T08:18:34.344 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108482.log 2023-10-09T08:18:34.344 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.98275.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98275.log.gz 2023-10-09T08:18:34.345 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138552.log 2023-10-09T08:18:34.346 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.108482.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108482.log.gz 2023-10-09T08:18:34.346 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109711.log 2023-10-09T08:18:34.347 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.138552.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.138552.log.gz 2023-10-09T08:18:34.347 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.134508.log 2023-10-09T08:18:34.348 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.109711.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109711.log.gz 2023-10-09T08:18:34.348 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112137.log 2023-10-09T08:18:34.348 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.134508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.134508.log.gz 2023-10-09T08:18:34.349 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105224.log 2023-10-09T08:18:34.350 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.112137.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112137.log.gz 2023-10-09T08:18:34.350 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113814.log 2023-10-09T08:18:34.351 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.105224.log: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.105224.log.gz 2023-10-09T08:18:34.351 INFO:teuthology.orchestra.run.smithi071.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.111211.log 2023-10-09T08:18:34.352 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.113814.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.113814.log.gz 2023-10-09T08:18:34.352 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92332.log 2023-10-09T08:18:34.353 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.111211.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111211.log.gz 2023-10-09T08:18:34.353 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137303.log 2023-10-09T08:18:34.354 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92332.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92332.log.gz 2023-10-09T08:18:34.354 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125760.log 2023-10-09T08:18:34.355 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.137303.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.137303.log.gz 2023-10-09T08:18:34.355 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92164.log 2023-10-09T08:18:34.356 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125760.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125760.log.gz 2023-10-09T08:18:34.356 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126588.log 2023-10-09T08:18:34.357 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92164.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.92164.log.gz 2023-10-09T08:18:34.357 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125384.log 2023-10-09T08:18:34.358 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126588.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.126588.log.gz 2023-10-09T08:18:34.358 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114238.log 2023-10-09T08:18:34.359 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125384.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.125384.log.gz 2023-10-09T08:18:34.359 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97318.log 2023-10-09T08:18:34.360 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114238.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114238.log.gz 2023-10-09T08:18:34.360 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98167.log 2023-10-09T08:18:34.361 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.97318.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97318.log.gz 2023-10-09T08:18:34.361 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98974.log 2023-10-09T08:18:34.362 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.98167.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98167.log.gz 2023-10-09T08:18:34.362 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100790.log 2023-10-09T08:18:34.363 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.98974.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98974.log.gz 2023-10-09T08:18:34.363 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126546.log 2023-10-09T08:18:34.364 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.100790.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100790.log.gz 2023-10-09T08:18:34.364 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108828.log 2023-10-09T08:18:34.365 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126546.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.126546.log.gz 2023-10-09T08:18:34.365 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91439.log 2023-10-09T08:18:34.366 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.108828.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108828.log.gz 2023-10-09T08:18:34.366 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129868.log 2023-10-09T08:18:34.367 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.91439.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.91439.log.gz 2023-10-09T08:18:34.367 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96785.log 2023-10-09T08:18:34.368 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129868.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.129868.log.gz 2023-10-09T08:18:34.369 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118988.log 2023-10-09T08:18:34.369 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96785.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96785.log.gz 2023-10-09T08:18:34.370 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141311.log 2023-10-09T08:18:34.370 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118988.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118988.log.gz 2023-10-09T08:18:34.371 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117278.log 2023-10-09T08:18:34.371 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141311.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141311.log.gz 2023-10-09T08:18:34.372 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109262.log 2023-10-09T08:18:34.373 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117278.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117278.log.gz 2023-10-09T08:18:34.373 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131439.log 2023-10-09T08:18:34.374 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.109262.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109262.log.gz 2023-10-09T08:18:34.374 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111686.log 2023-10-09T08:18:34.374 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.131439.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.131439.log.gz 2023-10-09T08:18:34.375 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131397.log 2023-10-09T08:18:34.376 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.111686.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.111686.log.gz 2023-10-09T08:18:34.376 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120658.log 2023-10-09T08:18:34.377 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.131397.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.131397.log.gz 2023-10-09T08:18:34.377 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109576.log 2023-10-09T08:18:34.378 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120658.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.120658.log.gz 2023-10-09T08:18:34.378 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140591.log 2023-10-09T08:18:34.379 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.109576.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.109576.log.gz 2023-10-09T08:18:34.379 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110546.log 2023-10-09T08:18:34.380 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.140591.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140591.log.gz 2023-10-09T08:18:34.380 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109861.log 2023-10-09T08:18:34.381 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.110546.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110546.log.gz 2023-10-09T08:18:34.381 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91740.log 2023-10-09T08:18:34.382 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.109861.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109861.log.gz 2023-10-09T08:18:34.382 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105098.log 2023-10-09T08:18:34.383 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.91740.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.91740.log.gz 2023-10-09T08:18:34.383 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130036.log 2023-10-09T08:18:34.384 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.105098.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105098.log.gz 2023-10-09T08:18:34.384 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105476.log 2023-10-09T08:18:34.385 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130036.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.130036.log.gz 2023-10-09T08:18:34.385 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129332.log 2023-10-09T08:18:34.386 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.105476.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.105476.log.gz 2023-10-09T08:18:34.386 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-09T08:18:34.387 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129332.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129332.log.gz 2023-10-09T08:18:34.388 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141269.log 2023-10-09T08:18:34.388 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132296.log 2023-10-09T08:18:34.389 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141269.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.141269.log.gz 2023-10-09T08:18:34.390 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132847.log 2023-10-09T08:18:34.391 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.132296.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.132296.log.gz 2023-10-09T08:18:34.391 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92536.log 2023-10-09T08:18:34.392 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.132847.log: 89.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-09T08:18:34.392 INFO:teuthology.orchestra.run.smithi071.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.132847.log.gz 2023-10-09T08:18:34.392 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138288.log 2023-10-09T08:18:34.393 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92536.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.92536.log.gz 2023-10-09T08:18:34.393 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.130505.log 2023-10-09T08:18:34.394 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.138288.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.138288.log.gz 2023-10-09T08:18:34.394 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111562.log 2023-10-09T08:18:34.395 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.130505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.130505.log.gz 2023-10-09T08:18:34.395 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141059.log 2023-10-09T08:18:34.398 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.111562.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111562.log.gz 2023-10-09T08:18:34.398 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121546.log 2023-10-09T08:18:34.398 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141059.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.141059.log.gz 2023-10-09T08:18:34.398 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92877.log 2023-10-09T08:18:34.399 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121546.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.121546.log.gz 2023-10-09T08:18:34.399 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137897.log 2023-10-09T08:18:34.400 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92877.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92877.log.gz 2023-10-09T08:18:34.400 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137538.log 2023-10-09T08:18:34.400 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.137897.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.137897.log.gz 2023-10-09T08:18:34.401 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108321.log 2023-10-09T08:18:34.401 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.137538.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.137538.log.gz 2023-10-09T08:18:34.401 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98626.log 2023-10-09T08:18:34.402 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.108321.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108321.log.gz 2023-10-09T08:18:34.402 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107698.log 2023-10-09T08:18:34.403 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.98626.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98626.log.gz 2023-10-09T08:18:34.404 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101391.log 2023-10-09T08:18:34.404 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.107698.log: gzip -5 88.5%--verbose -- replaced with /var/log/ceph/ceph-client.admin.107698.log.gz-- 2023-10-09T08:18:34.404 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119269.log 2023-10-09T08:18:34.405 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.101391.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101391.log.gz 2023-10-09T08:18:34.405 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95571.log 2023-10-09T08:18:34.406 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119269.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119269.log.gz 2023-10-09T08:18:34.407 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128648.log 2023-10-09T08:18:34.407 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.95571.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95571.log.gz 2023-10-09T08:18:34.408 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103375.log 2023-10-09T08:18:34.409 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128648.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.128648.log.gz 2023-10-09T08:18:34.409 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92883.log 2023-10-09T08:18:34.410 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.103375.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103375.log.gz 2023-10-09T08:18:34.410 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100848.log 2023-10-09T08:18:34.411 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92883.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92883.log.gz 2023-10-09T08:18:34.411 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99201.log 2023-10-09T08:18:34.412 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.100848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98684.log 2023-10-09T08:18:34.412 INFO:teuthology.orchestra.run.smithi071.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100848.log.gz 2023-10-09T08:18:34.413 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.99201.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99201.log.gz 2023-10-09T08:18:34.413 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137209.log 2023-10-09T08:18:34.414 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.98684.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98684.log.gz 2023-10-09T08:18:34.414 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111728.log 2023-10-09T08:18:34.415 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.137209.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.137209.log.gz 2023-10-09T08:18:34.415 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120616.log 2023-10-09T08:18:34.416 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.111728.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111728.log.gz 2023-10-09T08:18:34.416 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118366.log 2023-10-09T08:18:34.417 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120616.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.120616.log.gz 2023-10-09T08:18:34.417 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96701.log 2023-10-09T08:18:34.418 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118366.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.118366.log.gz 2023-10-09T08:18:34.418 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100674.log 2023-10-09T08:18:34.419 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96701.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96701.log.gz 2023-10-09T08:18:34.419 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.79526.log 2023-10-09T08:18:34.420 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.100674.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100674.log.gz 2023-10-09T08:18:34.420 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125431.log 2023-10-09T08:18:34.421 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.tmp-client.admin.79526.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.79526.log.gz 2023-10-09T08:18:34.421 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126240.log 2023-10-09T08:18:34.422 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125431.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.125431.log.gz 2023-10-09T08:18:34.422 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95269.log 2023-10-09T08:18:34.423 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126240.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.126240.log.gz 2023-10-09T08:18:34.423 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92885.log 2023-10-09T08:18:34.424 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.95269.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95269.log.gz 2023-10-09T08:18:34.424 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131695.log 2023-10-09T08:18:34.425 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92885.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92885.log.gz 2023-10-09T08:18:34.425 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126810.log 2023-10-09T08:18:34.426 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.131695.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.131695.log.gz 2023-10-09T08:18:34.426 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105140.log 2023-10-09T08:18:34.427 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126810.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.126810.log.gz 2023-10-09T08:18:34.427 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117729.log 2023-10-09T08:18:34.428 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.105140.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.105140.log.gz 2023-10-09T08:18:34.428 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132670.log 2023-10-09T08:18:34.429 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117729.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117729.log.gz 2023-10-09T08:18:34.429 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120784.log 2023-10-09T08:18:34.430 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.132670.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.132670.log.gz 2023-10-09T08:18:34.430 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117056.log 2023-10-09T08:18:34.431 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120784.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.120784.log.gzgzip 2023-10-09T08:18:34.431 INFO:teuthology.orchestra.run.smithi071.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.104437.log 2023-10-09T08:18:34.432 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117056.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117056.log.gz 2023-10-09T08:18:34.432 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111917.log 2023-10-09T08:18:34.433 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.104437.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104437.log.gz 2023-10-09T08:18:34.433 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-09T08:18:34.434 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.111917.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111917.log.gz 2023-10-09T08:18:34.434 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102375.log 2023-10-09T08:18:34.435 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128694.log 2023-10-09T08:18:34.436 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.102375.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102375.log.gz 2023-10-09T08:18:34.436 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108744.log 2023-10-09T08:18:34.437 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128694.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.128694.log.gz 2023-10-09T08:18:34.437 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134766.log 2023-10-09T08:18:34.438 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.108744.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.108744.log.gz 2023-10-09T08:18:34.438 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129111.log 2023-10-09T08:18:34.439 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.134766.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.134766.log.gz 2023-10-09T08:18:34.439 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96289.log 2023-10-09T08:18:34.440 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129111.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.129111.log.gz 2023-10-09T08:18:34.440 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113750.log 2023-10-09T08:18:34.441 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96289.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96289.log.gz 2023-10-09T08:18:34.441 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132527.log 2023-10-09T08:18:34.442 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.113750.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113750.log.gz 2023-10-09T08:18:34.442 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133745.log 2023-10-09T08:18:34.443 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.132527.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.132527.log.gz 2023-10-09T08:18:34.443 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95184.log 2023-10-09T08:18:34.444 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133745.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.133745.log.gz 2023-10-09T08:18:34.444 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93242.log 2023-10-09T08:18:34.445 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.95184.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95184.log.gz 2023-10-09T08:18:34.445 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127065.log 2023-10-09T08:18:34.446 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.93242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97740.log 2023-10-09T08:18:34.446 INFO:teuthology.orchestra.run.smithi071.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93242.log.gz 2023-10-09T08:18:34.447 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.139376.log 2023-10-09T08:18:34.447 INFO:teuthology.orchestra.run.smithi071.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.127065.log.gz 2023-10-09T08:18:34.448 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.97740.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97740.log.gz 2023-10-09T08:18:34.448 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100890.log 2023-10-09T08:18:34.449 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.139376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.139376.log.gz 2023-10-09T08:18:34.449 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109050.log 2023-10-09T08:18:34.455 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.100890.log: gzip -5 88.9%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.100890.log.gz/var/log/ceph/ceph-client.admin.127334.log 2023-10-09T08:18:34.455 INFO:teuthology.orchestra.run.smithi071.stderr: 2023-10-09T08:18:34.455 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.109050.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.109050.log.gzgzip 2023-10-09T08:18:34.455 INFO:teuthology.orchestra.run.smithi071.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.119360.log 2023-10-09T08:18:34.455 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127334.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127334.log.gz 2023-10-09T08:18:34.455 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108176.log 2023-10-09T08:18:34.455 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119360.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.119360.log.gz 2023-10-09T08:18:34.455 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105584.log 2023-10-09T08:18:34.455 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.108176.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108176.log.gz 2023-10-09T08:18:34.455 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93112.log 2023-10-09T08:18:34.456 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.105584.log: gzip 88.4%-5 -- replaced with /var/log/ceph/ceph-client.admin.105584.log.gz--verbose 2023-10-09T08:18:34.456 INFO:teuthology.orchestra.run.smithi071.stderr:-- /var/log/ceph/ceph-client.admin.97932.log 2023-10-09T08:18:34.456 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.93112.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93112.log.gz 2023-10-09T08:18:34.456 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109134.log 2023-10-09T08:18:34.457 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.97932.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97932.log.gz 2023-10-09T08:18:34.457 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130078.log 2023-10-09T08:18:34.458 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.109134.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109134.log.gz 2023-10-09T08:18:34.458 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117813.log 2023-10-09T08:18:34.459 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130078.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130078.log.gz 2023-10-09T08:18:34.459 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128817.log 2023-10-09T08:18:34.460 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117813.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117813.log.gz 2023-10-09T08:18:34.460 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134920.log 2023-10-09T08:18:34.461 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128817.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.128817.log.gz 2023-10-09T08:18:34.461 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141479.log 2023-10-09T08:18:34.462 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.134920.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.134920.log.gz 2023-10-09T08:18:34.462 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127233.log 2023-10-09T08:18:34.463 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141479.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.141479.log.gz 2023-10-09T08:18:34.463 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105434.log 2023-10-09T08:18:34.464 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127233.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.127233.log.gz 2023-10-09T08:18:34.464 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141689.log 2023-10-09T08:18:34.465 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.105434.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105434.log.gz 2023-10-09T08:18:34.465 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91954.log 2023-10-09T08:18:34.466 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141689.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.141689.log.gz 2023-10-09T08:18:34.466 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100142.log 2023-10-09T08:18:34.467 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.91954.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.91954.log.gz 2023-10-09T08:18:34.467 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126198.log 2023-10-09T08:18:34.468 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.100142.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100142.log.gz 2023-10-09T08:18:34.469 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112481.log 2023-10-09T08:18:34.469 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126198.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.126198.log.gz 2023-10-09T08:18:34.470 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134249.log 2023-10-09T08:18:34.471 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.112481.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112481.log.gz 2023-10-09T08:18:34.471 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.105777.log 2023-10-09T08:18:34.471 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.134249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113424.log 2023-10-09T08:18:34.472 INFO:teuthology.orchestra.run.smithi071.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.134249.log.gz 2023-10-09T08:18:34.473 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.105777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.105777.log.gz 2023-10-09T08:18:34.473 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141143.log 2023-10-09T08:18:34.474 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.113424.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113424.log.gz 2023-10-09T08:18:34.474 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104655.log 2023-10-09T08:18:34.475 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141143.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141143.log.gz 2023-10-09T08:18:34.476 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113924.log 2023-10-09T08:18:34.476 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.104655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114525.log 2023-10-09T08:18:34.476 INFO:teuthology.orchestra.run.smithi071.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104655.log.gz 2023-10-09T08:18:34.477 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.113924.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113924.log.gzgzip 2023-10-09T08:18:34.478 INFO:teuthology.orchestra.run.smithi071.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.140386.log 2023-10-09T08:18:34.478 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114525.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114525.log.gz 2023-10-09T08:18:34.478 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104782.log 2023-10-09T08:18:34.479 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.140386.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140386.log.gz 2023-10-09T08:18:34.479 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134592.log 2023-10-09T08:18:34.479 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.104782.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104782.log.gz 2023-10-09T08:18:34.480 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120700.log 2023-10-09T08:18:34.481 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.134592.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.134592.log.gz 2023-10-09T08:18:34.481 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93508.log 2023-10-09T08:18:34.482 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120700.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.120700.log.gz 2023-10-09T08:18:34.482 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96121.log 2023-10-09T08:18:34.483 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.93508.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93508.log.gz 2023-10-09T08:18:34.483 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109306.log 2023-10-09T08:18:34.484 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96121.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96121.log.gz 2023-10-09T08:18:34.484 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119452.log 2023-10-09T08:18:34.486 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.109306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127107.log 2023-10-09T08:18:34.486 INFO:teuthology.orchestra.run.smithi071.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109306.log.gz 2023-10-09T08:18:34.486 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119452.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119452.log.gz 2023-10-09T08:18:34.486 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116972.log 2023-10-09T08:18:34.487 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127107.log: 89.2%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.127107.log.gz--verbose 2023-10-09T08:18:34.487 INFO:teuthology.orchestra.run.smithi071.stderr:-- /var/log/ceph/ceph-client.admin.98209.log 2023-10-09T08:18:34.487 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.116972.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.116972.log.gz 2023-10-09T08:18:34.488 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112263.log 2023-10-09T08:18:34.489 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.98209.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98209.log.gz 2023-10-09T08:18:34.489 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96163.log 2023-10-09T08:18:34.489 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.112263.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112263.log.gz 2023-10-09T08:18:34.489 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141395.log 2023-10-09T08:18:34.490 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96163.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96163.log.gz 2023-10-09T08:18:34.490 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125662.log 2023-10-09T08:18:34.491 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141395.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.141395.log.gz 2023-10-09T08:18:34.491 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133575.log 2023-10-09T08:18:34.492 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125662.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.125662.log.gz 2023-10-09T08:18:34.492 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91996.log 2023-10-09T08:18:34.493 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133575.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.133575.log.gz 2023-10-09T08:18:34.493 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140717.log 2023-10-09T08:18:34.494 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.91996.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.91996.log.gz 2023-10-09T08:18:34.494 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116478.log 2023-10-09T08:18:34.495 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.140717.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.140717.log.gz 2023-10-09T08:18:34.495 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110138.log 2023-10-09T08:18:34.496 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.116478.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116478.log.gz 2023-10-09T08:18:34.496 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132715.log 2023-10-09T08:18:34.497 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.110138.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110138.log.gz 2023-10-09T08:18:34.497 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.118282.log 2023-10-09T08:18:34.498 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.132715.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.132715.log.gz 2023-10-09T08:18:34.498 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134878.log 2023-10-09T08:18:34.499 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.118282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.118282.log.gz 2023-10-09T08:18:34.499 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119221.log 2023-10-09T08:18:34.500 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.134878.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.134878.log.gz 2023-10-09T08:18:34.500 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113021.log 2023-10-09T08:18:34.501 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119221.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.119221.log.gz 2023-10-09T08:18:34.501 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137981.log 2023-10-09T08:18:34.502 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.113021.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113021.log.gz 2023-10-09T08:18:34.502 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133015.log 2023-10-09T08:18:34.503 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.137981.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.137981.log.gz 2023-10-09T08:18:34.503 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91655.log 2023-10-09T08:18:34.504 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133015.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.133015.log.gz 2023-10-09T08:18:34.504 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112523.log 2023-10-09T08:18:34.505 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.91655.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91655.log.gz 2023-10-09T08:18:34.505 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98916.log 2023-10-09T08:18:34.506 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.112523.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.112523.log.gz-5 2023-10-09T08:18:34.506 INFO:teuthology.orchestra.run.smithi071.stderr:--verbose -- /var/log/ceph/ceph-client.admin.116386.log 2023-10-09T08:18:34.507 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.98916.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98916.log.gz 2023-10-09T08:18:34.507 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113563.log 2023-10-09T08:18:34.508 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.116386.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.116386.log.gz 2023-10-09T08:18:34.508 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110593.log 2023-10-09T08:18:34.509 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.113563.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113563.log.gz 2023-10-09T08:18:34.509 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103547.log 2023-10-09T08:18:34.510 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.110593.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110593.log.gz 2023-10-09T08:18:34.510 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127023.log 2023-10-09T08:18:34.511 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.103547.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103547.log.gz 2023-10-09T08:18:34.511 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121203.log 2023-10-09T08:18:34.512 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127023.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.127023.log.gz 2023-10-09T08:18:34.512 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129374.log 2023-10-09T08:18:34.513 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121203.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.121203.log.gz 2023-10-09T08:18:34.513 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114050.log 2023-10-09T08:18:34.515 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129374.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.129374.log.gz 2023-10-09T08:18:34.515 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134039.log 2023-10-09T08:18:34.515 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114050.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.114050.log.gz 2023-10-09T08:18:34.516 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124246.log 2023-10-09T08:18:34.517 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.134039.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.134039.log.gz 2023-10-09T08:18:34.518 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140633.log 2023-10-09T08:18:34.518 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.124246.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124246.log.gz 2023-10-09T08:18:34.518 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128006.log 2023-10-09T08:18:34.520 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.140633.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.140633.log.gz 2023-10-09T08:18:34.520 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99285.log 2023-10-09T08:18:34.520 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128006.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.128006.log.gz-5 2023-10-09T08:18:34.520 INFO:teuthology.orchestra.run.smithi071.stderr:--verbose -- /var/log/ceph/ceph-client.admin.112221.log 2023-10-09T08:18:34.520 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.99285.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.99285.log.gz 2023-10-09T08:18:34.520 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129562.log 2023-10-09T08:18:34.521 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.112221.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112221.log.gz 2023-10-09T08:18:34.521 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128459.log 2023-10-09T08:18:34.522 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129562.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.129562.log.gz 2023-10-09T08:18:34.522 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105392.log 2023-10-09T08:18:34.523 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128459.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.128459.log.gz 2023-10-09T08:18:34.523 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139635.log 2023-10-09T08:18:34.524 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.105392.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105392.log.gz 2023-10-09T08:18:34.524 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114611.log 2023-10-09T08:18:34.525 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.139635.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.139635.log.gz 2023-10-09T08:18:34.525 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94188.log 2023-10-09T08:18:34.526 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114611.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.114611.log.gz 2023-10-09T08:18:34.526 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111337.log 2023-10-09T08:18:34.527 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.94188.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94188.log.gz 2023-10-09T08:18:34.527 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111075.log 2023-10-09T08:18:34.528 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.111337.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111337.log.gz 2023-10-09T08:18:34.528 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114482.log 2023-10-09T08:18:34.529 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.111075.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111075.log.gz 2023-10-09T08:18:34.529 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120317.log 2023-10-09T08:18:34.530 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114482.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114482.log.gz 2023-10-09T08:18:34.530 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130874.log 2023-10-09T08:18:34.531 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120317.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.120317.log.gz 2023-10-09T08:18:34.531 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117855.log 2023-10-09T08:18:34.532 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130874.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.130874.log.gz 2023-10-09T08:18:34.532 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109218.log 2023-10-09T08:18:34.533 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117855.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117855.log.gz 2023-10-09T08:18:34.533 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113966.log 2023-10-09T08:18:34.534 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.109218.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109218.log.gz 2023-10-09T08:18:34.534 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98510.log 2023-10-09T08:18:34.534 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.113966.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113966.log.gz 2023-10-09T08:18:34.535 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141731.log 2023-10-09T08:18:34.536 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.98510.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98510.log.gz 2023-10-09T08:18:34.536 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91613.log 2023-10-09T08:18:34.537 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118324.log 2023-10-09T08:18:34.537 INFO:teuthology.orchestra.run.smithi071.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.141731.log.gz 2023-10-09T08:18:34.537 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.91613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128985.log 2023-10-09T08:18:34.538 INFO:teuthology.orchestra.run.smithi071.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.91613.log.gz 2023-10-09T08:18:34.538 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118324.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118324.log.gz 2023-10-09T08:18:34.539 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121480.log 2023-10-09T08:18:34.540 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128985.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128985.log.gz 2023-10-09T08:18:34.540 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95311.log 2023-10-09T08:18:34.541 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121480.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.121480.log.gz 2023-10-09T08:18:34.541 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140675.log 2023-10-09T08:18:34.542 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.95311.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95311.log.gz 2023-10-09T08:18:34.542 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134165.log 2023-10-09T08:18:34.543 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.140675.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.140675.log.gz 2023-10-09T08:18:34.543 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138510.log 2023-10-09T08:18:34.544 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.134165.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.134165.log.gz 2023-10-09T08:18:34.544 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112974.log 2023-10-09T08:18:34.545 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.138510.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.138510.log.gz 2023-10-09T08:18:34.545 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107821.log 2023-10-09T08:18:34.546 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.112974.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112974.log.gz 2023-10-09T08:18:34.546 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116576.log 2023-10-09T08:18:34.547 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.107821.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107821.log.gz 2023-10-09T08:18:34.547 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126030.log 2023-10-09T08:18:34.548 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.116576.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116576.log.gz 2023-10-09T08:18:34.548 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137493.log 2023-10-09T08:18:34.549 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126030.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.126030.log.gz 2023-10-09T08:18:34.549 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127292.log 2023-10-09T08:18:34.550 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.137493.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137493.log.gz 2023-10-09T08:18:34.550 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115159.log 2023-10-09T08:18:34.551 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125259.log 2023-10-09T08:18:34.551 INFO:teuthology.orchestra.run.smithi071.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.127292.log.gz 2023-10-09T08:18:34.552 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.115159.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115159.log.gz 2023-10-09T08:18:34.552 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91782.log 2023-10-09T08:18:34.553 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125259.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125259.log.gz 2023-10-09T08:18:34.553 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120275.log 2023-10-09T08:18:34.554 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.91782.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.91782.log.gz 2023-10-09T08:18:34.554 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-09T08:18:34.555 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120275.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.120275.log.gz 2023-10-09T08:18:34.555 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115285.log 2023-10-09T08:18:34.556 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129069.log 2023-10-09T08:18:34.557 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.115285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138416.log 2023-10-09T08:18:34.557 INFO:teuthology.orchestra.run.smithi071.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.115285.log.gz 2023-10-09T08:18:34.558 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129069.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.129069.log.gz 2023-10-09T08:18:34.558 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137117.log 2023-10-09T08:18:34.559 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.138416.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.138416.log.gz 2023-10-09T08:18:34.559 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93177.log 2023-10-09T08:18:34.561 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.137117.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137117.log.gz 2023-10-09T08:18:34.561 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141991.log 2023-10-09T08:18:34.562 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.93177.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93177.log.gz 2023-10-09T08:18:34.562 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115628.log 2023-10-09T08:18:34.563 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141991.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.141991.log.gz 2023-10-09T08:18:34.563 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93634.log 2023-10-09T08:18:34.563 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.115628.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115628.log.gz 2023-10-09T08:18:34.564 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93970.log 2023-10-09T08:18:34.565 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.93634.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93634.log.gz 2023-10-09T08:18:34.565 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112313.log 2023-10-09T08:18:34.566 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.93970.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93970.log.gz 2023-10-09T08:18:34.566 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137438.log 2023-10-09T08:18:34.567 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.112313.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112313.log.gz 2023-10-09T08:18:34.567 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117771.log 2023-10-09T08:18:34.568 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.137438.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.137438.log.gz 2023-10-09T08:18:34.568 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119802.log 2023-10-09T08:18:34.570 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117771.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117771.log.gz 2023-10-09T08:18:34.570 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139183.log 2023-10-09T08:18:34.570 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119802.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.119802.log.gz 2023-10-09T08:18:34.571 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126630.log 2023-10-09T08:18:34.572 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.139183.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.139183.log.gz 2023-10-09T08:18:34.572 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109176.log 2023-10-09T08:18:34.573 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126630.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126630.log.gz 2023-10-09T08:18:34.573 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-09T08:18:34.574 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.109176.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109176.log.gz 2023-10-09T08:18:34.574 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130120.log 2023-10-09T08:18:34.575 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116521.log 2023-10-09T08:18:34.576 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130120.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130120.log.gz 2023-10-09T08:18:34.577 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141909.log 2023-10-09T08:18:34.578 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.116521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119844.log 2023-10-09T08:18:34.578 INFO:teuthology.orchestra.run.smithi071.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116521.log.gz 2023-10-09T08:18:34.579 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141909.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.141909.log.gz 2023-10-09T08:18:34.579 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126504.log 2023-10-09T08:18:34.580 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115351.log 2023-10-09T08:18:34.581 INFO:teuthology.orchestra.run.smithi071.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119844.log.gz 2023-10-09T08:18:34.581 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126504.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.126504.log.gz 2023-10-09T08:18:34.582 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92080.log 2023-10-09T08:18:34.583 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.115351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125522.log 2023-10-09T08:18:34.583 INFO:teuthology.orchestra.run.smithi071.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115351.log.gz 2023-10-09T08:18:34.584 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92080.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92080.log.gz 2023-10-09T08:18:34.584 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141563.log 2023-10-09T08:18:34.585 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138764.log 2023-10-09T08:18:34.586 INFO:teuthology.orchestra.run.smithi071.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125522.log.gz 2023-10-09T08:18:34.587 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141563.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.141563.log.gz 2023-10-09T08:18:34.587 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132625.log 2023-10-09T08:18:34.588 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.138764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140430.log 2023-10-09T08:18:34.589 INFO:teuthology.orchestra.run.smithi071.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.138764.log.gz 2023-10-09T08:18:34.589 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.132625.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.132625.log.gz 2023-10-09T08:18:34.590 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129910.log 2023-10-09T08:18:34.591 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.140430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117897.log 2023-10-09T08:18:34.591 INFO:teuthology.orchestra.run.smithi071.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.140430.log.gz 2023-10-09T08:18:34.592 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129910.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.129910.log.gz 2023-10-09T08:18:34.592 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113286.log 2023-10-09T08:18:34.593 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113705.log 2023-10-09T08:18:34.593 INFO:teuthology.orchestra.run.smithi071.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117897.log.gz 2023-10-09T08:18:34.594 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.113286.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113286.log.gz 2023-10-09T08:18:34.594 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133661.log 2023-10-09T08:18:34.596 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.113705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138680.log 2023-10-09T08:18:34.596 INFO:teuthology.orchestra.run.smithi071.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113705.log.gz 2023-10-09T08:18:34.596 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133661.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.133661.log.gz 2023-10-09T08:18:34.597 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133099.log 2023-10-09T08:18:34.598 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.138680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105927.log 2023-10-09T08:18:34.598 INFO:teuthology.orchestra.run.smithi071.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.138680.log.gz 2023-10-09T08:18:34.599 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133099.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.133099.log.gz 2023-10-09T08:18:34.600 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104029.log 2023-10-09T08:18:34.601 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.105927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112009.log 2023-10-09T08:18:34.601 INFO:teuthology.orchestra.run.smithi071.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.105927.log.gz 2023-10-09T08:18:34.602 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.104029.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104029.log.gz 2023-10-09T08:18:34.602 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95995.log 2023-10-09T08:18:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.112009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96953.log 2023-10-09T08:18:34.603 INFO:teuthology.orchestra.run.smithi071.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112009.log.gz 2023-10-09T08:18:34.604 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.95995.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95995.log.gz 2023-10-09T08:18:34.605 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133829.log 2023-10-09T08:18:34.606 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112908.log 2023-10-09T08:18:34.606 INFO:teuthology.orchestra.run.smithi071.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96953.log.gz 2023-10-09T08:18:34.607 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133829.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.133829.log.gz 2023-10-09T08:18:34.607 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105861.log 2023-10-09T08:18:34.608 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.112908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104962.log 2023-10-09T08:18:34.609 INFO:teuthology.orchestra.run.smithi071.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112908.log.gz 2023-10-09T08:18:34.609 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.105861.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.105861.log.gz 2023-10-09T08:18:34.610 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108890.log 2023-10-09T08:18:34.611 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.104962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129416.log 2023-10-09T08:18:34.611 INFO:teuthology.orchestra.run.smithi071.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104962.log.gz 2023-10-09T08:18:34.612 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.108890.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108890.log.gz 2023-10-09T08:18:34.612 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132570.log 2023-10-09T08:18:34.613 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128604.log 2023-10-09T08:18:34.614 INFO:teuthology.orchestra.run.smithi071.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129416.log.gz 2023-10-09T08:18:34.614 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.132570.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.132570.log.gz 2023-10-09T08:18:34.615 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95697.log 2023-10-09T08:18:34.616 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120868.log 2023-10-09T08:18:34.616 INFO:teuthology.orchestra.run.smithi071.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.128604.log.gz 2023-10-09T08:18:34.617 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.95697.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95697.log.gz 2023-10-09T08:18:34.617 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96331.log 2023-10-09T08:18:34.618 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99890.log 2023-10-09T08:18:34.619 INFO:teuthology.orchestra.run.smithi071.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120868.log.gz 2023-10-09T08:18:34.620 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96331.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.96331.log.gz 2023-10-09T08:18:34.620 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113471.log 2023-10-09T08:18:34.621 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.99890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.110054.log 2023-10-09T08:18:34.621 INFO:teuthology.orchestra.run.smithi071.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99890.log.gz 2023-10-09T08:18:34.622 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.113471.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113471.log.gz 2023-10-09T08:18:34.622 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141185.log 2023-10-09T08:18:34.624 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.110054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134081.log 2023-10-09T08:18:34.624 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.110054.log.gz 2023-10-09T08:18:34.625 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141185.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.141185.log.gz 2023-10-09T08:18:34.625 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117404.log 2023-10-09T08:18:34.626 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.134081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117626.log 2023-10-09T08:18:34.626 INFO:teuthology.orchestra.run.smithi071.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.134081.log.gz 2023-10-09T08:18:34.627 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117404.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.117404.log.gz 2023-10-09T08:18:34.627 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116192.log 2023-10-09T08:18:34.629 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113515.log 2023-10-09T08:18:34.629 INFO:teuthology.orchestra.run.smithi071.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117626.log.gz 2023-10-09T08:18:34.630 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.116192.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116192.log.gz 2023-10-09T08:18:34.630 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140057.log 2023-10-09T08:18:34.631 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.113515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96205.log 2023-10-09T08:18:34.631 INFO:teuthology.orchestra.run.smithi071.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113515.log.gz 2023-10-09T08:18:34.632 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.140057.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140057.log.gz 2023-10-09T08:18:34.632 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96037.log 2023-10-09T08:18:34.634 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133405.log 2023-10-09T08:18:34.634 INFO:teuthology.orchestra.run.smithi071.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96205.log.gz 2023-10-09T08:18:34.635 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96037.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96037.log.gz 2023-10-09T08:18:34.635 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-09T08:18:34.636 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117362.log 2023-10-09T08:18:34.637 INFO:teuthology.orchestra.run.smithi071.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.133405.log.gz 2023-10-09T08:18:34.638 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93218.log 2023-10-09T08:18:34.639 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117362.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117362.log.gz 2023-10-09T08:18:34.639 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141605.log 2023-10-09T08:18:34.641 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.93218.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93218.log.gz 2023-10-09T08:18:34.641 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94054.log 2023-10-09T08:18:34.642 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141605.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.141605.log.gz 2023-10-09T08:18:34.642 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119550.log 2023-10-09T08:18:34.644 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.94054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96373.log 2023-10-09T08:18:34.644 INFO:teuthology.orchestra.run.smithi071.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.94054.log.gz 2023-10-09T08:18:34.646 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119550.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.119550.log.gz 2023-10-09T08:18:34.646 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115586.log 2023-10-09T08:18:34.647 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96373.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96373.log.gz 2023-10-09T08:18:34.647 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139418.log 2023-10-09T08:18:34.649 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.115586.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115586.log.gz 2023-10-09T08:18:34.649 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127376.log 2023-10-09T08:18:34.651 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.139418.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.139418.log.gz 2023-10-09T08:18:34.651 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129501.log 2023-10-09T08:18:34.653 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115075.log 2023-10-09T08:18:34.653 INFO:teuthology.orchestra.run.smithi071.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.127376.log.gz 2023-10-09T08:18:34.653 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129501.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.129501.log.gz 2023-10-09T08:18:34.654 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97866.log 2023-10-09T08:18:34.655 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.115075.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115075.log.gz 2023-10-09T08:18:34.656 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113376.log 2023-10-09T08:18:34.658 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.97866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111169.log 2023-10-09T08:18:34.658 INFO:teuthology.orchestra.run.smithi071.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.97866.log.gz 2023-10-09T08:18:34.658 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.113376.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113376.log.gz 2023-10-09T08:18:34.659 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108660.log 2023-10-09T08:18:34.660 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.111169.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111169.log.gz 2023-10-09T08:18:34.660 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112439.log 2023-10-09T08:18:34.662 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.108660.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108660.log.gz 2023-10-09T08:18:34.662 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141101.log 2023-10-09T08:18:34.663 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.112439.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112439.log.gz 2023-10-09T08:18:34.664 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99327.log 2023-10-09T08:18:34.665 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141101.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141101.log.gz 2023-10-09T08:18:34.665 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140539.log 2023-10-09T08:18:34.667 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.99327.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.99327.log.gz 2023-10-09T08:18:34.667 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138991.log 2023-10-09T08:18:34.668 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.140539.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140539.log.gz 2023-10-09T08:18:34.669 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100732.log 2023-10-09T08:18:34.670 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.138991.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.138991.log.gz 2023-10-09T08:18:34.670 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101625.log 2023-10-09T08:18:34.672 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.100732.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100732.log.gz 2023-10-09T08:18:34.672 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132931.log 2023-10-09T08:18:34.673 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.101625.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101625.log.gz 2023-10-09T08:18:34.673 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117534.log 2023-10-09T08:18:34.675 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.132931.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.132931.log.gz 2023-10-09T08:18:34.675 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139526.log 2023-10-09T08:18:34.677 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117534.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.117534.log.gz 2023-10-09T08:18:34.677 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109669.log 2023-10-09T08:18:34.679 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.139526.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139526.log.gz 2023-10-09T08:18:34.679 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110777.log 2023-10-09T08:18:34.679 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.109669.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109669.log.gz 2023-10-09T08:18:34.680 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115898.log 2023-10-09T08:18:34.682 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.110777.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110777.log.gz 2023-10-09T08:18:34.682 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92869.log 2023-10-09T08:18:34.683 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.115898.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115898.log.gz 2023-10-09T08:18:34.684 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.95016.log 2023-10-09T08:18:34.684 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92869.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92869.log.gz 2023-10-09T08:18:34.685 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138122.log 2023-10-09T08:18:34.686 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.2.95016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.95016.log.gz 2023-10-09T08:18:34.687 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127149.log 2023-10-09T08:18:34.688 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.138122.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.138122.log.gz 2023-10-09T08:18:34.689 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117446.log 2023-10-09T08:18:34.689 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127149.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127149.log.gz 2023-10-09T08:18:34.690 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99974.log 2023-10-09T08:18:34.691 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117446.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.117446.log.gz 2023-10-09T08:18:34.691 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116069.log 2023-10-09T08:18:34.693 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.99974.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99974.log.gz 2023-10-09T08:18:34.693 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105182.log 2023-10-09T08:18:34.694 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.116069.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116069.log.gz 2023-10-09T08:18:34.695 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114949.log 2023-10-09T08:18:34.696 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.105182.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105182.log.gz 2023-10-09T08:18:34.697 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109398.log 2023-10-09T08:18:34.698 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114949.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126380.log 2023-10-09T08:18:34.698 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.114949.log.gz 2023-10-09T08:18:34.699 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.109398.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109398.log.gz 2023-10-09T08:18:34.700 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119928.log 2023-10-09T08:18:34.701 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126380.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.126380.log.gz 2023-10-09T08:18:34.701 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109356.log 2023-10-09T08:18:34.702 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119928.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.119928.log.gz 2023-10-09T08:18:34.703 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92122.log 2023-10-09T08:18:34.705 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.109356.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109356.log.gz 2023-10-09T08:18:34.705 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137395.log 2023-10-09T08:18:34.705 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92122.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.92122.log.gz 2023-10-09T08:18:34.706 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93550.log 2023-10-09T08:18:34.708 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.137395.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137395.log.gz 2023-10-09T08:18:34.708 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137729.log 2023-10-09T08:18:34.709 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.93550.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.93550.log.gz 2023-10-09T08:18:34.709 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95613.log 2023-10-09T08:18:34.711 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.137729.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.137729.log.gz 2023-10-09T08:18:34.711 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97614.log 2023-10-09T08:18:34.712 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.95613.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95613.log.gz 2023-10-09T08:18:34.712 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112179.log 2023-10-09T08:18:34.717 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.97614.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97614.log.gz 2023-10-09T08:18:34.718 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127678.log 2023-10-09T08:18:34.719 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.112179.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112179.log.gz 2023-10-09T08:18:34.719 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114176.log 2023-10-09T08:18:34.720 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127678.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.127678.log.gz 2023-10-09T08:18:34.720 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97182.log 2023-10-09T08:18:34.720 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114176.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.114176.log.gz 2023-10-09T08:18:34.720 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120152.log 2023-10-09T08:18:34.720 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.97182.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97182.log.gz 2023-10-09T08:18:34.721 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97037.log 2023-10-09T08:18:34.722 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120152.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.120152.log.gz 2023-10-09T08:18:34.722 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141521.log 2023-10-09T08:18:34.724 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.97037.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97037.log.gz 2023-10-09T08:18:34.724 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127847.log 2023-10-09T08:18:34.725 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141521.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141521.log.gz 2023-10-09T08:18:34.726 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96869.log 2023-10-09T08:18:34.727 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127847.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127847.log.gz 2023-10-09T08:18:34.727 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105350.log 2023-10-09T08:18:34.729 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96869.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96869.log.gz 2023-10-09T08:18:34.729 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138044.log 2023-10-09T08:18:34.730 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.105350.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.105350.log.gz 2023-10-09T08:18:34.731 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117216.log 2023-10-09T08:18:34.732 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.138044.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.138044.log.gz 2023-10-09T08:18:34.732 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95739.log 2023-10-09T08:18:34.734 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117216.log: gzip 88.9%-5 -- replaced with /var/log/ceph/ceph-client.admin.117216.log.gz--verbose 2023-10-09T08:18:34.734 INFO:teuthology.orchestra.run.smithi071.stderr:-- /var/log/ceph/ceph-client.admin.91912.log 2023-10-09T08:18:34.735 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.95739.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.95739.log.gz 2023-10-09T08:18:34.736 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113331.log 2023-10-09T08:18:34.737 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.91912.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.91912.log.gz 2023-10-09T08:18:34.737 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.127635.log 2023-10-09T08:18:34.738 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.113331.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113331.log.gz 2023-10-09T08:18:34.739 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103920.log 2023-10-09T08:18:34.740 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.127635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.127635.log.gz 2023-10-09T08:18:34.740 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92206.log 2023-10-09T08:18:34.741 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.103920.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103920.log.gz 2023-10-09T08:18:34.742 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115985.log 2023-10-09T08:18:34.744 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92206.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92206.log.gz 2023-10-09T08:18:34.744 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139033.log 2023-10-09T08:18:34.745 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.115985.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115985.log.gz 2023-10-09T08:18:34.746 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137583.log 2023-10-09T08:18:34.747 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.139033.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.139033.log.gz 2023-10-09T08:18:34.747 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131753.log 2023-10-09T08:18:34.748 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.137583.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137583.log.gz 2023-10-09T08:18:34.749 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110204.log 2023-10-09T08:18:34.750 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.131753.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.131753.log.gz 2023-10-09T08:18:34.751 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117668.log 2023-10-09T08:18:34.751 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.110204.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110204.log.gz 2023-10-09T08:18:34.752 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129698.log 2023-10-09T08:18:34.753 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117668.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117668.log.gz 2023-10-09T08:18:34.754 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100016.log 2023-10-09T08:18:34.755 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129698.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.129698.log.gz 2023-10-09T08:18:34.755 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116666.log 2023-10-09T08:18:34.756 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.100016.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.100016.log.gz 2023-10-09T08:18:34.757 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130780.log 2023-10-09T08:18:34.758 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.116666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112095.log 2023-10-09T08:18:34.759 INFO:teuthology.orchestra.run.smithi071.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.116666.log.gz 2023-10-09T08:18:34.760 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130780.log: 89.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111644.log 2023-10-09T08:18:34.760 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.130780.log.gz 2023-10-09T08:18:34.762 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.112095.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.112095.log.gz 2023-10-09T08:18:34.762 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141647.log 2023-10-09T08:18:34.763 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.111644.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111644.log.gz 2023-10-09T08:18:34.763 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107945.log 2023-10-09T08:18:34.765 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141647.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.141647.log.gz 2023-10-09T08:18:34.765 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104870.log 2023-10-09T08:18:34.766 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.107945.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107945.log.gz 2023-10-09T08:18:34.767 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129656.log 2023-10-09T08:18:34.767 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.104870.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.104870.log.gz 2023-10-09T08:18:34.768 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115201.log 2023-10-09T08:18:34.769 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129656.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129656.log.gz 2023-10-09T08:18:34.770 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96499.log 2023-10-09T08:18:34.771 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.115201.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115201.log.gz 2023-10-09T08:18:34.771 INFO:teuthology.orchestra.run.smithi071.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.91341.log 2023-10-09T08:18:34.772 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96499.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96499.log.gz 2023-10-09T08:18:34.773 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100442.log 2023-10-09T08:18:34.774 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.91341.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.91341.log.gz 2023-10-09T08:18:34.775 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113066.log 2023-10-09T08:18:34.776 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.100442.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100442.log.gz 2023-10-09T08:18:34.776 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119408.log 2023-10-09T08:18:34.777 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.113066.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.113066.log.gz 2023-10-09T08:18:34.778 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140759.log 2023-10-09T08:18:34.779 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119408.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.119408.log.gz 2023-10-09T08:18:34.779 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109484.log 2023-10-09T08:18:34.781 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.140759.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140759.log.gz 2023-10-09T08:18:34.781 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137628.log 2023-10-09T08:18:34.782 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.109484.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109484.log.gz 2023-10-09T08:18:34.783 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138722.log 2023-10-09T08:18:34.784 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.137628.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137628.log.gz 2023-10-09T08:18:34.784 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104333.log 2023-10-09T08:18:34.786 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.138722.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138722.log.gz 2023-10-09T08:18:34.786 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133913.log 2023-10-09T08:18:34.787 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.104333.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104333.log.gz 2023-10-09T08:18:34.788 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125895.log 2023-10-09T08:18:34.789 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133913.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.133913.log.gz 2023-10-09T08:18:34.789 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97782.log 2023-10-09T08:18:34.791 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125895.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125895.log.gz 2023-10-09T08:18:34.791 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-09T08:18:34.792 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.97782.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97782.log.gz 2023-10-09T08:18:34.793 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.115544.log 2023-10-09T08:18:34.794 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132387.log 2023-10-09T08:18:34.795 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.115544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.115544.log.gz 2023-10-09T08:18:34.796 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128366.log 2023-10-09T08:18:34.797 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.132387.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.132387.log.gz 2023-10-09T08:18:34.798 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119970.log 2023-10-09T08:18:34.799 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128366.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.128366.log.gz 2023-10-09T08:18:34.800 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119760.log 2023-10-09T08:18:34.801 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119970.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119970.log.gz 2023-10-09T08:18:34.801 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104249.log 2023-10-09T08:18:34.803 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119760.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.119760.log.gz 2023-10-09T08:18:34.803 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104207.log 2023-10-09T08:18:34.804 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.104249.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104249.log.gz 2023-10-09T08:18:34.804 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98742.log 2023-10-09T08:18:34.807 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.104207.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104207.log.gz 2023-10-09T08:18:34.807 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141773.log 2023-10-09T08:18:34.808 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.98742.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98742.log.gz 2023-10-09T08:18:34.808 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109092.log 2023-10-09T08:18:34.810 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141773.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104123.log 2023-10-09T08:18:34.810 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.141773.log.gz 2023-10-09T08:18:34.812 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.109092.log: gzip 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109092.log.gz 2023-10-09T08:18:34.812 INFO:teuthology.orchestra.run.smithi071.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.115243.log 2023-10-09T08:18:34.812 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.104123.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104123.log.gz 2023-10-09T08:18:34.813 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103778.log 2023-10-09T08:18:34.814 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.115243.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.115243.log.gz 2023-10-09T08:18:34.815 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98568.log 2023-10-09T08:18:34.816 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.103778.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103778.log.gz 2023-10-09T08:18:34.817 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129742.log 2023-10-09T08:18:34.818 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.98568.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98568.log.gz 2023-10-09T08:18:34.819 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95403.log 2023-10-09T08:18:34.820 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129742.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129742.log.gz 2023-10-09T08:18:34.820 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132889.log 2023-10-09T08:18:34.822 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.95403.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95403.log.gz 2023-10-09T08:18:34.822 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85787.log 2023-10-09T08:18:34.823 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.132889.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.132889.log.gz 2023-10-09T08:18:34.824 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96995.log 2023-10-09T08:18:34.825 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.85787.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.85787.log.gz 2023-10-09T08:18:34.826 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120994.log 2023-10-09T08:18:34.827 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96995.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96995.log.gz 2023-10-09T08:18:34.828 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111380.log 2023-10-09T08:18:34.829 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120994.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.120994.log.gz 2023-10-09T08:18:34.829 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104826.log 2023-10-09T08:18:34.830 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.111380.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111380.log.gz 2023-10-09T08:18:34.831 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133619.log 2023-10-09T08:18:34.832 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.104826.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.104826.log.gz 2023-10-09T08:18:34.833 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91698.log 2023-10-09T08:18:34.834 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133619.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.133619.log.gz 2023-10-09T08:18:34.834 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95529.log 2023-10-09T08:18:34.836 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.91698.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.91698.log.gz 2023-10-09T08:18:34.836 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97360.log 2023-10-09T08:18:34.838 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.95529.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95529.log.gz 2023-10-09T08:18:34.838 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133057.log 2023-10-09T08:18:34.839 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.97360.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.97360.log.gz 2023-10-09T08:18:34.839 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100326.log 2023-10-09T08:18:34.841 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133057.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.133057.log.gz 2023-10-09T08:18:34.841 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138372.log 2023-10-09T08:18:34.842 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.100326.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100326.log.gz 2023-10-09T08:18:34.843 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95781.log 2023-10-09T08:18:34.845 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.138372.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.138372.log.gz 2023-10-09T08:18:34.845 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125570.log 2023-10-09T08:18:34.846 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.95781.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95781.log.gz 2023-10-09T08:18:34.846 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95445.log 2023-10-09T08:18:34.848 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125570.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.125570.log.gz 2023-10-09T08:18:34.848 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97572.log 2023-10-09T08:18:34.849 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.95445.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95445.log.gz 2023-10-09T08:18:34.850 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114655.log 2023-10-09T08:18:34.851 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.97572.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97572.log.gz 2023-10-09T08:18:34.852 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110966.log 2023-10-09T08:18:34.853 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114655.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.114655.log.gz 2023-10-09T08:18:34.853 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112631.log 2023-10-09T08:18:34.855 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.110966.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.110966.log.gz 2023-10-09T08:18:34.855 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100268.log 2023-10-09T08:18:34.856 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.112631.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112631.log.gz 2023-10-09T08:18:34.857 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120490.log 2023-10-09T08:18:34.859 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.100268.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100268.log.gz 2023-10-09T08:18:34.859 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105974.log 2023-10-09T08:18:34.860 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120490.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120490.log.gz 2023-10-09T08:18:34.860 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132480.log 2023-10-09T08:18:34.861 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.105974.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.105974.log.gz 2023-10-09T08:18:34.862 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92538.log 2023-10-09T08:18:34.863 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.132480.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.132480.log.gz 2023-10-09T08:18:34.863 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140241.log 2023-10-09T08:18:34.866 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92538.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92538.log.gz 2023-10-09T08:18:34.866 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126981.log 2023-10-09T08:18:34.867 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.140241.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140241.log.gz 2023-10-09T08:18:34.867 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111012.log 2023-10-09T08:18:34.868 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126981.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.126981.log.gz 2023-10-09T08:18:34.869 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105518.log 2023-10-09T08:18:34.870 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.111012.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111012.log.gz 2023-10-09T08:18:34.871 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141227.log 2023-10-09T08:18:34.873 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.105518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92290.log 2023-10-09T08:18:34.873 INFO:teuthology.orchestra.run.smithi071.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.105518.log.gz 2023-10-09T08:18:34.873 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141227.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.141227.log.gz 2023-10-09T08:18:34.874 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105004.log 2023-10-09T08:18:34.876 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92290.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92290.log.gz 2023-10-09T08:18:34.876 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121791.log 2023-10-09T08:18:34.877 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.105004.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.105004.log.gz 2023-10-09T08:18:34.878 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119315.log 2023-10-09T08:18:34.879 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121791.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.121791.log.gz 2023-10-09T08:18:34.880 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92548.log 2023-10-09T08:18:34.881 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119315.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.119315.log.gz 2023-10-09T08:18:34.881 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104375.log 2023-10-09T08:18:34.882 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92548.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92548.log.gz 2023-10-09T08:18:34.883 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-09T08:18:34.884 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.104375.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104375.log.gz 2023-10-09T08:18:34.885 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114008.log 2023-10-09T08:18:34.887 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93718.log 2023-10-09T08:18:34.888 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114008.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.114008.log.gz 2023-10-09T08:18:34.888 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126302.log 2023-10-09T08:18:34.890 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.93718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133203.log 2023-10-09T08:18:34.891 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126302.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93718.log.gz 2023-10-09T08:18:34.891 INFO:teuthology.orchestra.run.smithi071.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.126302.log.gz 2023-10-09T08:18:34.893 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121036.log 2023-10-09T08:18:34.895 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107992.log 2023-10-09T08:18:34.895 INFO:teuthology.orchestra.run.smithi071.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.133203.log.gz 2023-10-09T08:18:34.897 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121036.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.121036.log.gz 2023-10-09T08:18:34.897 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111967.log 2023-10-09T08:18:34.898 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.107992.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107992.log.gz 2023-10-09T08:18:34.899 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96415.log 2023-10-09T08:18:34.901 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.111967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104613.log 2023-10-09T08:18:34.902 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96415.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111967.log.gz 2023-10-09T08:18:34.902 INFO:teuthology.orchestra.run.smithi071.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96415.log.gz 2023-10-09T08:18:34.903 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118432.log 2023-10-09T08:18:34.905 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.104613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136993.log 2023-10-09T08:18:34.906 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118432.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104613.log.gz 2023-10-09T08:18:34.906 INFO:teuthology.orchestra.run.smithi071.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118432.log.gz 2023-10-09T08:18:34.907 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133447.log 2023-10-09T08:18:34.909 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.136993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132125.log 2023-10-09T08:18:34.909 INFO:teuthology.orchestra.run.smithi071.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.136993.log.gz 2023-10-09T08:18:34.911 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133447.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.133447.log.gz-5 --verbose -- /var/log/ceph/ceph-client.admin.99075.log 2023-10-09T08:18:34.911 INFO:teuthology.orchestra.run.smithi071.stderr: 2023-10-09T08:18:34.913 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.132125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128859.log 2023-10-09T08:18:34.914 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.99075.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.132125.log.gz 2023-10-09T08:18:34.914 INFO:teuthology.orchestra.run.smithi071.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99075.log.gz 2023-10-09T08:18:34.916 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102875.log 2023-10-09T08:18:34.917 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128859.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.128859.log.gz 2023-10-09T08:18:34.917 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94648.log 2023-10-09T08:18:34.919 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.102875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126674.log 2023-10-09T08:18:34.920 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.94648.log: 89.0% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94648.log.gz 2023-10-09T08:18:34.920 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102875.log.gz 2023-10-09T08:18:34.922 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99117.log 2023-10-09T08:18:34.923 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126674.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.126674.log.gz 2023-10-09T08:18:34.923 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93424.log 2023-10-09T08:18:34.925 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.99117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132973.log 2023-10-09T08:18:34.926 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.93424.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93424.log.gz 2023-10-09T08:18:34.927 INFO:teuthology.orchestra.run.smithi071.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99117.log.gz 2023-10-09T08:18:34.928 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130702.log 2023-10-09T08:18:34.929 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.132973.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.132973.log.gz 2023-10-09T08:18:34.929 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113160.log 2023-10-09T08:18:34.931 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133141.log 2023-10-09T08:18:34.932 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.113160.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.130702.log.gz 2023-10-09T08:18:34.933 INFO:teuthology.orchestra.run.smithi071.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113160.log.gz 2023-10-09T08:18:34.934 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134550.log 2023-10-09T08:18:34.935 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133141.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.133141.log.gz 2023-10-09T08:18:34.936 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108534.log 2023-10-09T08:18:34.937 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.134550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92884.log 2023-10-09T08:18:34.939 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.108534.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108534.log.gz 2023-10-09T08:18:34.939 INFO:teuthology.orchestra.run.smithi071.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.134550.log.gz 2023-10-09T08:18:34.940 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105266.log 2023-10-09T08:18:34.941 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92884.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.92884.log.gz 2023-10-09T08:18:34.942 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128943.log 2023-10-09T08:18:34.943 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.105266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108131.log 2023-10-09T08:18:34.944 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128943.log: 87.2% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.128943.log.gz 2023-10-09T08:18:34.945 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.105266.log.gz 2023-10-09T08:18:34.946 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127191.log 2023-10-09T08:18:34.947 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.108131.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108131.log.gz 2023-10-09T08:18:34.947 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105819.log 2023-10-09T08:18:34.949 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115033.log 2023-10-09T08:18:34.951 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.105819.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.127191.log.gz 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105819.log.gz 2023-10-09T08:18:34.951 INFO:teuthology.orchestra.run.smithi071.stderr: 2023-10-09T08:18:34.952 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130547.log 2023-10-09T08:18:34.954 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.115033.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.115033.log.gz 2023-10-09T08:18:34.954 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111127.log 2023-10-09T08:18:34.956 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117118.log 2023-10-09T08:18:34.957 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.111127.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130547.log.gz 2023-10-09T08:18:34.957 INFO:teuthology.orchestra.run.smithi071.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111127.log.gz 2023-10-09T08:18:34.959 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100500.log 2023-10-09T08:18:34.960 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117118.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.117118.log.gz 2023-10-09T08:18:34.960 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115741.log 2023-10-09T08:18:34.961 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.100500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92546.log 2023-10-09T08:18:34.962 INFO:teuthology.orchestra.run.smithi071.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100500.log.gz 2023-10-09T08:18:34.964 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.115741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97404.log 2023-10-09T08:18:34.965 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92546.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115741.log.gz 2023-10-09T08:18:34.965 INFO:teuthology.orchestra.run.smithi071.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92546.log.gz 2023-10-09T08:18:34.966 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126072.log 2023-10-09T08:18:34.968 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.97404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117981.log 2023-10-09T08:18:34.969 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126072.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.126072.log.gz 2023-10-09T08:18:34.969 INFO:teuthology.orchestra.run.smithi071.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.97404.log.gz 2023-10-09T08:18:34.970 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121655.log 2023-10-09T08:18:34.972 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117981.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117981.log.gz 2023-10-09T08:18:34.972 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98858.log 2023-10-09T08:18:34.973 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93844.log 2023-10-09T08:18:34.974 INFO:teuthology.orchestra.run.smithi071.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.121655.log.gz 2023-10-09T08:18:34.976 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.98858.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96247.log 2023-10-09T08:18:34.976 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.98858.log.gz/var/log/ceph/ceph-client.admin.93844.log: 2023-10-09T08:18:34.977 INFO:teuthology.orchestra.run.smithi071.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93844.log.gz 2023-10-09T08:18:34.977 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121438.log 2023-10-09T08:18:34.979 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121594.log 2023-10-09T08:18:34.981 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121438.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96247.log.gz 87.3% -- replaced with /var/log/ceph/ceph-client.admin.121438.log.gz 2023-10-09T08:18:34.981 INFO:teuthology.orchestra.run.smithi071.stderr: 2023-10-09T08:18:34.982 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141949.log 2023-10-09T08:18:34.983 INFO:teuthology.orchestra.run.smithi179.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-09T08:18:34.984 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121594.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.121594.log.gz 2023-10-09T08:18:34.984 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93886.log 2023-10-09T08:18:34.986 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138806.log 2023-10-09T08:18:34.987 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.93886.log: 88.0% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93886.log.gz 2023-10-09T08:18:34.987 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.141949.log.gz 2023-10-09T08:18:34.988 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104920.log 2023-10-09T08:18:34.989 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.138806.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.138806.log.gz 2023-10-09T08:18:34.990 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138907.log 2023-10-09T08:18:34.992 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.104920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117490.log 2023-10-09T08:18:34.993 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.138907.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.104920.log.gz 2023-10-09T08:18:34.993 INFO:teuthology.orchestra.run.smithi071.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138907.log.gz 2023-10-09T08:18:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100226.log 2023-10-09T08:18:34.996 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129994.log 2023-10-09T08:18:34.997 INFO:teuthology.orchestra.run.smithi071.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117490.log.gz 2023-10-09T08:18:34.998 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.100226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127722.log 2023-10-09T08:18:34.999 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129994.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100226.log.gz 2023-10-09T08:18:35.000 INFO:teuthology.orchestra.run.smithi071.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.129994.log.gz 2023-10-09T08:18:35.000 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125988.log 2023-10-09T08:18:35.003 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92882.log 2023-10-09T08:18:35.003 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125988.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127722.log.gz 2023-10-09T08:18:35.004 INFO:teuthology.orchestra.run.smithi071.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.125988.log.gz 2023-10-09T08:18:35.005 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95058.log 2023-10-09T08:18:35.007 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115694.log 2023-10-09T08:18:35.008 INFO:teuthology.orchestra.run.smithi071.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.92882.log.gz 2023-10-09T08:18:35.008 INFO:teuthology.orchestra.run.smithi071.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-09T08:18:35.009 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.95058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93213.log 2023-10-09T08:18:35.010 INFO:teuthology.orchestra.run.smithi071.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.95058.log.gz 2023-10-09T08:18:35.010 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.115694.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.115694.log.gz 2023-10-09T08:18:35.011 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116888.log 2023-10-09T08:18:35.012 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.93213.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.93213.log.gz 2023-10-09T08:18:35.012 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130246.log 2023-10-09T08:18:35.014 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.116888.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116888.log.gz 2023-10-09T08:18:35.015 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139460.log 2023-10-09T08:18:35.016 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130246.log: gzip -5 --verbose -- 91.1% -- replaced with /var/log/ceph/ceph-client.admin.130246.log.gz 2023-10-09T08:18:35.016 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114781.log 2023-10-09T08:18:35.017 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.139460.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139460.log.gz 2023-10-09T08:18:35.018 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95361.log 2023-10-09T08:18:35.019 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114781.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.114781.log.gz 2023-10-09T08:18:35.020 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108037.log 2023-10-09T08:18:35.021 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.95361.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95361.log.gz 2023-10-09T08:18:35.021 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125804.log 2023-10-09T08:18:35.023 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.108037.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108037.log.gz 2023-10-09T08:18:35.024 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93760.log 2023-10-09T08:18:35.025 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125804.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.125804.log.gz 2023-10-09T08:18:35.025 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104697.log 2023-10-09T08:18:35.027 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.93760.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93760.log.gz 2023-10-09T08:18:35.027 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119886.log 2023-10-09T08:18:35.028 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.104697.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104697.log.gz 2023-10-09T08:18:35.029 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130312.log 2023-10-09T08:18:35.030 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119886.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.119886.log.gz 2023-10-09T08:18:35.031 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139117.log 2023-10-09T08:18:35.032 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130312.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.130312.log.gz 2023-10-09T08:18:35.032 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114907.log 2023-10-09T08:18:35.034 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.139117.log: gzip -5 91.2% -- replaced with /var/log/ceph/ceph-client.admin.139117.log.gz 2023-10-09T08:18:35.034 INFO:teuthology.orchestra.run.smithi071.stderr:--verbose -- /var/log/ceph/ceph-client.admin.130589.log 2023-10-09T08:18:35.035 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114907.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.114907.log.gz 2023-10-09T08:18:35.036 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93466.log 2023-10-09T08:18:35.037 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130589.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.130589.log.gz 2023-10-09T08:18:35.038 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124288.log 2023-10-09T08:18:35.039 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.93466.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93466.log.gz 2023-10-09T08:18:35.040 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103731.log 2023-10-09T08:18:35.041 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.124288.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124288.log.gz 2023-10-09T08:18:35.042 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97446.log 2023-10-09T08:18:35.044 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.103731.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103731.log.gz 2023-10-09T08:18:35.044 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114739.log 2023-10-09T08:18:35.044 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.97446.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97446.log.gz 2023-10-09T08:18:35.045 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119603.log 2023-10-09T08:18:35.046 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114739.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.114739.log.gz 2023-10-09T08:18:35.047 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92533.log 2023-10-09T08:18:35.048 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119603.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119603.log.gz 2023-10-09T08:18:35.049 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120574.log 2023-10-09T08:18:35.050 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92533.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92533.log.gz 2023-10-09T08:18:35.051 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114134.log 2023-10-09T08:18:35.051 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120574.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120574.log.gz 2023-10-09T08:18:35.052 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138204.log 2023-10-09T08:18:35.053 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114134.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114134.log.gz 2023-10-09T08:18:35.054 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141437.log 2023-10-09T08:18:35.055 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.138204.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.138204.log.gz 2023-10-09T08:18:35.056 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100558.log 2023-10-09T08:18:35.057 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141437.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.141437.log.gz 2023-10-09T08:18:35.058 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120910.log 2023-10-09T08:18:35.058 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.100558.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100558.log.gz 2023-10-09T08:18:35.059 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92547.log 2023-10-09T08:18:35.061 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120910.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.120910.log.gz 2023-10-09T08:18:35.061 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137813.log 2023-10-09T08:18:35.062 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92547.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.92547.log.gz 2023-10-09T08:18:35.062 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93802.log 2023-10-09T08:18:35.064 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.137813.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.137813.log.gz 2023-10-09T08:18:35.064 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-09T08:18:35.065 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.93802.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93802.log.gz 2023-10-09T08:18:35.066 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128506.log 2023-10-09T08:18:35.073 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85517.log 2023-10-09T08:18:35.073 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128506.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128506.log.gz 2023-10-09T08:18:35.073 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94012.log 2023-10-09T08:18:35.073 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.85517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110313.log 2023-10-09T08:18:35.073 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.94012.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94012.log.gz 92.3% -- replaced with /var/log/ceph/ceph-client.admin.85517.log.gz 2023-10-09T08:18:35.073 INFO:teuthology.orchestra.run.smithi071.stderr: 2023-10-09T08:18:35.074 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110867.log 2023-10-09T08:18:35.075 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.110313.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110313.log.gz 2023-10-09T08:18:35.075 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108786.log 2023-10-09T08:18:35.077 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.110867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118479.log 2023-10-09T08:18:35.079 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.108786.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110867.log.gz 2023-10-09T08:18:35.079 INFO:teuthology.orchestra.run.smithi071.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108786.log.gz 2023-10-09T08:18:35.080 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130655.log 2023-10-09T08:18:35.082 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118479.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118479.log.gz 2023-10-09T08:18:35.082 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132779.log 2023-10-09T08:18:35.084 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111253.log 2023-10-09T08:18:35.085 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.132779.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.130655.log.gz 2023-10-09T08:18:35.085 INFO:teuthology.orchestra.run.smithi071.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.132779.log.gz 2023-10-09T08:18:35.086 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141857.log 2023-10-09T08:18:35.088 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.111253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97079.log 2023-10-09T08:18:35.089 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141857.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111253.log.gz 2023-10-09T08:18:35.090 INFO:teuthology.orchestra.run.smithi071.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.141857.log.gz 2023-10-09T08:18:35.092 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.97079.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97079.log.gz 2023-10-09T08:18:35.268 INFO:teuthology.orchestra.run.smithi071.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-09T08:18:35.761 INFO:teuthology.orchestra.run.smithi179.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-09T08:18:36.046 INFO:teuthology.orchestra.run.smithi179.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-09T08:18:36.170 INFO:teuthology.orchestra.run.smithi179.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-09T08:18:36.822 INFO:teuthology.orchestra.run.smithi179.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-09T08:18:37.268 INFO:teuthology.orchestra.run.smithi179.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-09T08:18:37.269 INFO:teuthology.orchestra.run.smithi179.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-09T08:18:37.308 INFO:teuthology.orchestra.run.smithi179.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-09T08:18:37.311 INFO:teuthology.orchestra.run.smithi179.stderr: 2023-10-09T08:18:37.311 INFO:teuthology.orchestra.run.smithi179.stderr:real 0m3.245s 2023-10-09T08:18:37.311 INFO:teuthology.orchestra.run.smithi179.stderr:user 0m17.282s 2023-10-09T08:18:37.311 INFO:teuthology.orchestra.run.smithi179.stderr:sys 0m1.610s 2023-10-09T08:18:37.349 INFO:teuthology.orchestra.run.smithi071.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-09T08:18:37.691 INFO:teuthology.orchestra.run.smithi071.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-09T08:18:37.904 INFO:teuthology.orchestra.run.smithi071.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-09T08:18:37.929 INFO:teuthology.orchestra.run.smithi071.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-09T08:18:38.238 INFO:teuthology.orchestra.run.smithi071.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-09T08:18:38.241 INFO:teuthology.orchestra.run.smithi071.stderr: 2023-10-09T08:18:38.241 INFO:teuthology.orchestra.run.smithi071.stderr:real 0m4.180s 2023-10-09T08:18:38.242 INFO:teuthology.orchestra.run.smithi071.stderr:user 0m15.499s 2023-10-09T08:18:38.242 INFO:teuthology.orchestra.run.smithi071.stderr:sys 0m3.064s 2023-10-09T08:18:38.242 INFO:tasks.ceph:Archiving logs... 2023-10-09T08:18:38.243 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418378/remote/smithi071/log 2023-10-09T08:18:38.245 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-09T08:18:41.039 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418378/remote/smithi179/log 2023-10-09T08:18:41.040 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-09T08:18:43.047 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-09T08:18:43.057 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-09T08:18:43.057 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-09T08:18:43.062 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-09T08:18:43.176 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-09T08:18:43.186 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-09T08:18:43.186 DEBUG:teuthology.orchestra.run.smithi071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T08:18:43.191 DEBUG:teuthology.orchestra.run.smithi179:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T08:18:43.222 INFO:teuthology.orchestra.run.smithi071.stderr:bash: ntpq: command not found 2023-10-09T08:18:43.224 INFO:teuthology.orchestra.run.smithi179.stderr:bash: ntpq: command not found 2023-10-09T08:18:43.227 INFO:teuthology.orchestra.run.smithi071.stdout:210 Number of sources = 4 2023-10-09T08:18:43.227 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T08:18:43.227 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2023-10-09T08:18:43.227 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv01.front.sepia.ceph.com 2 8 377 24 -742us[ -782us] +/- 72ms 2023-10-09T08:18:43.228 INFO:teuthology.orchestra.run.smithi071.stdout:^* hv02.front.sepia.ceph.com 3 7 377 18 +284us[ +244us] +/- 55ms 2023-10-09T08:18:43.228 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 +325us[ +285us] +/- 71ms 2023-10-09T08:18:43.228 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T08:18:43.230 INFO:teuthology.orchestra.run.smithi179.stdout:210 Number of sources = 4 2023-10-09T08:18:43.230 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T08:18:43.230 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2023-10-09T08:18:43.230 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv01.front.sepia.ceph.com 2 9 377 152 -771us[ -751us] +/- 70ms 2023-10-09T08:18:43.230 INFO:teuthology.orchestra.run.smithi179.stdout:^* hv02.front.sepia.ceph.com 3 7 377 85 +255us[ +273us] +/- 54ms 2023-10-09T08:18:43.230 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 22 +348us[ +348us] +/- 71ms 2023-10-09T08:18:43.230 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T08:18:43.231 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-09T08:18:43.241 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-09T08:18:43.242 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-09T08:18:43.286 DEBUG:teuthology.orchestra.run.smithi071:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-09T08:18:43.428 DEBUG:teuthology.orchestra.run.smithi179:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-09T08:18:43.616 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T08:18:43.678 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T08:18:43.679 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T08:18:43.746 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T08:18:43.747 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-09T08:18:43.757 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-09T08:18:43.801 INFO:teuthology.task.internal:Duration was 6643.222518 seconds 2023-10-09T08:18:43.801 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-09T08:18:43.834 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-09T08:18:43.834 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-09T08:18:43.838 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-09T08:18:43.943 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T08:18:43.947 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T08:18:44.070 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-09T08:18:44.070 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi071.front.sepia.ceph.com 2023-10-09T08:18:44.070 DEBUG:teuthology.orchestra.run.smithi071:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-09T08:18:44.120 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi179.front.sepia.ceph.com 2023-10-09T08:18:44.121 DEBUG:teuthology.orchestra.run.smithi179:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-09T08:18:44.171 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-09T08:18:44.171 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-09T08:18:44.176 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-09T08:18:44.257 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-09T08:18:44.257 DEBUG:teuthology.orchestra.run.smithi071:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-09T08:18:44.262 DEBUG:teuthology.orchestra.run.smithi179:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-09T08:18:44.400 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-09T08:18:44.410 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-09T08:18:44.410 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-09T08:18:44.471 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-09T08:18:44.531 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-09T08:18:44.543 DEBUG:teuthology.orchestra.run.smithi071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-09T08:18:44.548 DEBUG:teuthology.orchestra.run.smithi179:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-09T08:18:44.603 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = core 2023-10-09T08:18:44.608 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = core 2023-10-09T08:18:44.642 DEBUG:teuthology.orchestra.run.smithi071:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-09T08:18:44.677 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T08:18:44.678 DEBUG:teuthology.orchestra.run.smithi179:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-09T08:18:44.712 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T08:18:44.712 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-09T08:18:44.725 INFO:teuthology.task.internal:Transferring archived files... 2023-10-09T08:18:44.726 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418378/remote/smithi071 2023-10-09T08:18:44.726 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-09T08:18:44.795 DEBUG:teuthology.misc:Transferring archived files from smithi179:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418378/remote/smithi179 2023-10-09T08:18:44.797 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-09T08:18:44.870 INFO:teuthology.task.internal:Removing archive directory... 2023-10-09T08:18:44.870 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-09T08:18:44.874 DEBUG:teuthology.orchestra.run.smithi179:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-09T08:18:44.910 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-09T08:18:44.922 INFO:teuthology.task.internal:Not uploading archives. 2023-10-09T08:18:44.922 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-09T08:18:45.031 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-09T08:18:45.031 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-09T08:18:45.036 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-09T08:18:45.068 INFO:teuthology.orchestra.run.smithi071.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 9 08:18 /home/ubuntu/cephtest 2023-10-09T08:18:45.072 INFO:teuthology.orchestra.run.smithi179.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 9 08:18 /home/ubuntu/cephtest 2023-10-09T08:18:45.075 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-09T08:18:45.117 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-09T08:18:45.150 INFO:teuthology.nuke:Checking targets against current locks 2023-10-09T08:18:45.175 DEBUG:teuthology.nuke:shortname: smithi071 2023-10-09T08:18:45.176 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T08:18:45.199 DEBUG:teuthology.nuke:shortname: smithi179 2023-10-09T08:18:45.200 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T08:18:45.203 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418378', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 06:18:38.723216', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIRJ4qdiIKOm6ZBaxD08Dwdvukm3DT3qdA2DfHnyFLPGYl92IveRjBn6erkhNm843iVuL8hVdADiSgBNrFomEVg='} 2023-10-09T08:18:45.224 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_05:36:44-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418378', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 06:18:38.725099', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEnRlHUHakBP4LvTw/XdcGQUfDtTX9A81YyPazj2kbMbDrSdwTKfcH6UUpEyvmwY6Xe0P/7RwCnyNSPbv/m769k='} 2023-10-09T08:18:45.257 INFO:teuthology.orchestra.console.smithi071:Power off 2023-10-09T08:18:45.257 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T08:18:45.278 DEBUG:teuthology.orchestra.console.smithi071:power off output: Chassis Power Control: Down/Off 2023-10-09T08:18:45.279 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T08:18:45.294 INFO:teuthology.orchestra.console.smithi179:Power off 2023-10-09T08:18:45.294 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T08:18:45.304 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2023-10-09T08:18:45.317 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-10-09T08:18:45.317 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T08:18:45.338 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-10-09T08:18:49.305 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T08:18:49.338 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T08:18:49.415 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2023-10-09T08:18:49.450 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-10-09T08:18:53.419 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T08:18:53.451 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T08:18:53.530 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2023-10-09T08:18:53.561 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-10-09T08:18:57.534 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T08:18:57.562 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T08:18:57.644 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2023-10-09T08:18:57.670 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-10-09T08:18:57.746 INFO:teuthology.orchestra.console.smithi071:Power off completed 2023-10-09T08:18:57.772 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-10-09T08:18:57.876 INFO:teuthology.run:Summary data: client.0-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c client.1-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} duration: 6643.222518444061 failure_reason: '"1696838385.8347495 mon.a (mon.0) 1382 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log' flavor: default owner: scheduled_vshankar@teuthology success: false 2023-10-09T08:18:57.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T08:18:57.956 INFO:teuthology.run:FAIL